2023-10-07T08:30:15.096 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-07T08:30:15.097 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} --verbose --name yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273 --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273/orig.config.yaml 2023-10-07T08:30:15.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-07T08:30:15.231 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273 branch: wip-yuri-testing-2023-10-06-0949-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: yweinste@redhat.com first_in_suite: false job_id: '7416273' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-06-0949-quincy ceph: cephfs: ec_profile: - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-06-0949-quincy sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4726 sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-06-0949-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBElw/sNKbAi6Re7S4J5mVhmqROP/WipIfjfAHplOVNjhPtKrO3UAC3ISPWFRULacki/Jpc40Jwkgf5VOHxeQFKo= smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBxW+7hJ4TMaHcy+kLXQTeuF6omXcB7/y1HwV4fhPoIIyk8MshvUK9K51g6IIDrBgosrywd/XASJBUlUyG1ZU+4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-07_00:40:05 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-07T08:30:15.231 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa; will attempt to use it 2023-10-07T08:30:15.232 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks 2023-10-07T08:30:15.232 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-07T08:30:15.234 INFO:teuthology.task.internal:Checking packages... 2023-10-07T08:30:15.256 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '08cac0187919fc3a247efdf445f652e2fb30a647' 2023-10-07T08:30:15.256 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-07T08:30:15.256 INFO:teuthology.packaging:ref: None 2023-10-07T08:30:15.256 INFO:teuthology.packaging:tag: None 2023-10-07T08:30:15.257 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-06-0949-quincy 2023-10-07T08:30:15.257 INFO:teuthology.packaging:sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-07T08:30:15.257 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-06-0949-quincy 2023-10-07T08:30:15.406 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1320.g08cac018 2023-10-07T08:30:15.406 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-07T08:30:15.412 INFO:teuthology.task.internal:no buildpackages task found 2023-10-07T08:30:15.412 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-07T08:30:15.422 INFO:teuthology.task.internal:Saving configuration 2023-10-07T08:30:15.439 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-07T08:30:15.445 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-07T08:30:15.470 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-07 08:25:03.942972', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBElw/sNKbAi6Re7S4J5mVhmqROP/WipIfjfAHplOVNjhPtKrO3UAC3ISPWFRULacki/Jpc40Jwkgf5VOHxeQFKo='} 2023-10-07T08:30:15.493 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-07 08:25:03.941656', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBxW+7hJ4TMaHcy+kLXQTeuF6omXcB7/y1HwV4fhPoIIyk8MshvUK9K51g6IIDrBgosrywd/XASJBUlUyG1ZU+4='} 2023-10-07T08:30:15.493 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-07T08:30:15.502 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-07T08:30:15.503 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-07T08:30:15.503 INFO:teuthology.run_tasks:Running task console_log... 2023-10-07T08:30:15.623 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa6829deb80>, signals=[15]) 2023-10-07T08:30:15.623 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-07T08:30:15.641 INFO:teuthology.task.internal:Opening connections... 2023-10-07T08:30:15.642 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:30:15.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:30:15.713 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:30:15.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:30:15.781 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-07T08:30:15.789 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-10-07T08:30:15.806 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-10-07T08:30:15.806 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-10-07T08:30:15.862 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2023-10-07T08:30:15.863 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.4 (Ootpa)" 2023-10-07T08:30:15.863 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2023-10-07T08:30:15.863 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2023-10-07T08:30:15.863 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.4" 2023-10-07T08:30:15.863 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-10-07T08:30:15.863 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-07T08:30:15.863 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-10-07T08:30:15.863 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-07T08:30:15.863 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2023-10-07T08:30:15.863 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-07T08:30:15.864 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-07T08:30:15.864 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:30:15.864 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-07T08:30:15.864 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-07T08:30:15.864 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-07T08:30:15.864 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-07T08:30:15.864 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-10-07T08:30:15.886 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-10-07T08:30:15.903 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-10-07T08:30:15.904 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-10-07T08:30:15.960 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Red Hat Enterprise Linux" 2023-10-07T08:30:15.960 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8.4 (Ootpa)" 2023-10-07T08:30:15.960 INFO:teuthology.orchestra.run.smithi089.stdout:ID="rhel" 2023-10-07T08:30:15.960 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="fedora" 2023-10-07T08:30:15.961 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8.4" 2023-10-07T08:30:15.961 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2023-10-07T08:30:15.961 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-07T08:30:15.961 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-10-07T08:30:15.961 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-07T08:30:15.961 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.redhat.com/" 2023-10-07T08:30:15.961 INFO:teuthology.orchestra.run.smithi089.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-07T08:30:15.961 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-07T08:30:15.961 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:30:15.961 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-07T08:30:15.961 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-07T08:30:15.961 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-07T08:30:15.962 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-07T08:30:15.962 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-10-07T08:30:15.986 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-07T08:30:15.996 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-07T08:30:16.091 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-07T08:30:16.091 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2023-10-07T08:30:16.093 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2023-10-07T08:30:16.108 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-07T08:30:16.148 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-07T08:30:16.148 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2023-10-07T08:30:16.151 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2023-10-07T08:30:16.165 INFO:teuthology.orchestra.run.smithi081.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-07T08:30:16.167 INFO:teuthology.orchestra.run.smithi089.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-07T08:30:16.168 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-07T08:30:16.217 INFO:teuthology.run_tasks:Running task kernel... 2023-10-07T08:30:16.235 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-07T08:30:16.235 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-07T08:30:16.235 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-07T08:30:16.235 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-07T08:30:16.237 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-07T08:30:16.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:30:16.252 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-10-07T08:30:16.253 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:30:16.253 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2023-10-07T08:30:16.309 INFO:teuthology.orchestra.run.smithi081.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-07T08:30:16.311 INFO:teuthology.task.kernel:Running kernel on smithi081: 4.18.0-305.25.1.el8_4.x86_64 2023-10-07T08:30:16.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y kernel 2023-10-07T08:30:16.312 INFO:teuthology.orchestra.run.smithi089.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-07T08:30:16.312 INFO:teuthology.task.kernel:Running kernel on smithi089: 4.18.0-305.25.1.el8_4.x86_64 2023-10-07T08:30:16.312 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum install -y kernel 2023-10-07T08:30:17.700 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-10-07T08:30:17.700 INFO:teuthology.orchestra.run.smithi089.stdout:Unable to read consumer identity 2023-10-07T08:30:17.879 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-07T08:30:17.880 INFO:teuthology.orchestra.run.smithi081.stdout:Unable to read consumer identity 2023-10-07T08:30:19.041 INFO:teuthology.orchestra.run.smithi089.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-10-07T08:30:19.360 INFO:teuthology.orchestra.run.smithi081.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-10-07T08:30:20.040 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-10-07T08:30:20.304 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-10-07T08:30:23.354 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-07T08:30:23.703 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-07T08:30:24.081 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-07T08:30:24.081 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-07T08:30:24.081 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-07T08:30:24.242 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-10-07T08:30:24.243 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-10-07T08:30:24.244 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-10-07T08:30:24.368 DEBUG:teuthology.orchestra.run.smithi089:> echo no | sudo yum reinstall kernel || true 2023-10-07T08:30:24.438 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-07T08:30:24.438 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-07T08:30:24.438 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-07T08:30:24.600 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2023-10-07T08:30:24.600 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2023-10-07T08:30:24.600 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2023-10-07T08:30:24.707 DEBUG:teuthology.orchestra.run.smithi081:> echo no | sudo yum reinstall kernel || true 2023-10-07T08:30:24.712 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-10-07T08:30:24.713 INFO:teuthology.orchestra.run.smithi089.stdout:Unable to read consumer identity 2023-10-07T08:30:25.012 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:02 ago on Sat 07 Oct 2023 08:30:23 AM UTC. 2023-10-07T08:30:25.049 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-07T08:30:25.049 INFO:teuthology.orchestra.run.smithi081.stdout:Unable to read consumer identity 2023-10-07T08:30:25.131 INFO:teuthology.orchestra.run.smithi089.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-07T08:30:25.131 INFO:teuthology.orchestra.run.smithi089.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-07T08:30:25.132 INFO:teuthology.orchestra.run.smithi089.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-07T08:30:25.167 INFO:teuthology.orchestra.run.smithi089.stderr:Error: No packages marked for reinstall. 2023-10-07T08:30:25.217 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum reinstall -y kernel || true 2023-10-07T08:30:25.346 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:02 ago on Sat 07 Oct 2023 08:30:23 AM UTC. 2023-10-07T08:30:25.476 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-07T08:30:25.476 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-07T08:30:25.476 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-07T08:30:25.504 INFO:teuthology.orchestra.run.smithi081.stderr:Error: No packages marked for reinstall. 2023-10-07T08:30:25.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum reinstall -y kernel || true 2023-10-07T08:30:25.560 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-10-07T08:30:25.560 INFO:teuthology.orchestra.run.smithi089.stdout:Unable to read consumer identity 2023-10-07T08:30:25.856 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:02 ago on Sat 07 Oct 2023 08:30:23 AM UTC. 2023-10-07T08:30:25.895 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-07T08:30:25.896 INFO:teuthology.orchestra.run.smithi081.stdout:Unable to read consumer identity 2023-10-07T08:30:25.988 INFO:teuthology.orchestra.run.smithi089.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-07T08:30:25.988 INFO:teuthology.orchestra.run.smithi089.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-07T08:30:25.989 INFO:teuthology.orchestra.run.smithi089.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-07T08:30:26.008 INFO:teuthology.orchestra.run.smithi089.stderr:Error: No packages marked for reinstall. 2023-10-07T08:30:26.064 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2023-10-07T08:30:26.182 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:03 ago on Sat 07 Oct 2023 08:30:23 AM UTC. 2023-10-07T08:30:26.191 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-07T08:30:26.191 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:30:26.191 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:30:26.191 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-07T08:30:26.192 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-07T08:30:26.192 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-07T08:30:26.192 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2023-10-07T08:30:26.192 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2023-10-07T08:30:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-07T08:30:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-07T08:30:26.309 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-07T08:30:26.317 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-07T08:30:26.317 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:30:26.317 DEBUG:teuthology.orchestra.run.smithi089:> sudo rpm -qi grub2-tools 2023-10-07T08:30:26.325 INFO:teuthology.orchestra.run.smithi081.stderr:Error: No packages marked for reinstall. 2023-10-07T08:30:26.346 INFO:teuthology.orchestra.run.smithi089.stdout:Name : grub2-tools 2023-10-07T08:30:26.346 INFO:teuthology.orchestra.run.smithi089.stdout:Epoch : 1 2023-10-07T08:30:26.346 INFO:teuthology.orchestra.run.smithi089.stdout:Version : 2.02 2023-10-07T08:30:26.346 INFO:teuthology.orchestra.run.smithi089.stdout:Release : 99.el8_4.1 2023-10-07T08:30:26.346 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: x86_64 2023-10-07T08:30:26.346 INFO:teuthology.orchestra.run.smithi089.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-07T08:30:26.346 INFO:teuthology.orchestra.run.smithi089.stdout:Group : System Environment/Base 2023-10-07T08:30:26.346 INFO:teuthology.orchestra.run.smithi089.stdout:Size : 9264631 2023-10-07T08:30:26.346 INFO:teuthology.orchestra.run.smithi089.stdout:License : GPLv3+ 2023-10-07T08:30:26.347 INFO:teuthology.orchestra.run.smithi089.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-07T08:30:26.347 INFO:teuthology.orchestra.run.smithi089.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-07T08:30:26.347 INFO:teuthology.orchestra.run.smithi089.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-07T08:30:26.347 INFO:teuthology.orchestra.run.smithi089.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-07T08:30:26.347 INFO:teuthology.orchestra.run.smithi089.stdout:Relocations : (not relocatable) 2023-10-07T08:30:26.347 INFO:teuthology.orchestra.run.smithi089.stdout:Packager : Red Hat, Inc. 2023-10-07T08:30:26.347 INFO:teuthology.orchestra.run.smithi089.stdout:Vendor : Red Hat, Inc. 2023-10-07T08:30:26.347 INFO:teuthology.orchestra.run.smithi089.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-07T08:30:26.347 INFO:teuthology.orchestra.run.smithi089.stdout:Summary : Support tools for GRUB. 2023-10-07T08:30:26.347 INFO:teuthology.orchestra.run.smithi089.stdout:Description : 2023-10-07T08:30:26.347 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:30:26.347 INFO:teuthology.orchestra.run.smithi089.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-07T08:30:26.347 INFO:teuthology.orchestra.run.smithi089.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-07T08:30:26.348 INFO:teuthology.orchestra.run.smithi089.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-07T08:30:26.348 INFO:teuthology.orchestra.run.smithi089.stdout:hardware devices. 2023-10-07T08:30:26.348 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:30:26.348 INFO:teuthology.orchestra.run.smithi089.stdout:This subpackage provides tools for support of all platforms. 2023-10-07T08:30:26.349 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-07T08:30:26.349 INFO:teuthology.task.kernel:Updating grub on smithi089 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:30:26.349 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-07T08:30:26.379 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2023-10-07T08:30:26.503 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-07T08:30:26.504 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:30:26.504 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:30:26.504 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-07T08:30:26.504 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-07T08:30:26.504 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-07T08:30:26.504 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2023-10-07T08:30:26.504 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2023-10-07T08:30:26.630 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-07T08:30:26.630 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:30:26.630 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2023-10-07T08:30:26.657 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2023-10-07T08:30:26.657 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2023-10-07T08:30:26.657 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.02 2023-10-07T08:30:26.657 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 99.el8_4.1 2023-10-07T08:30:26.657 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2023-10-07T08:30:26.657 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-07T08:30:26.657 INFO:teuthology.orchestra.run.smithi081.stdout:Group : System Environment/Base 2023-10-07T08:30:26.658 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 9264631 2023-10-07T08:30:26.658 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2023-10-07T08:30:26.658 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-07T08:30:26.658 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-07T08:30:26.658 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-07T08:30:26.658 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-07T08:30:26.658 INFO:teuthology.orchestra.run.smithi081.stdout:Relocations : (not relocatable) 2023-10-07T08:30:26.658 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : Red Hat, Inc. 2023-10-07T08:30:26.658 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : Red Hat, Inc. 2023-10-07T08:30:26.658 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-07T08:30:26.658 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2023-10-07T08:30:26.658 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2023-10-07T08:30:26.659 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:30:26.659 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-07T08:30:26.659 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-07T08:30:26.659 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-07T08:30:26.659 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2023-10-07T08:30:26.659 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:30:26.659 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2023-10-07T08:30:26.660 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-07T08:30:26.660 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:30:26.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-07T08:30:27.547 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2023-10-07T08:30:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2023-10-07T08:30:29.575 INFO:teuthology.orchestra.run.smithi089.stderr:done 2023-10-07T08:30:29.577 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-10-07T08:30:29.591 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.aWluNqHOv2 2023-10-07T08:30:29.591 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.aWluNqHOv2 2023-10-07T08:30:29.665 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.aWluNqHOv2 2023-10-07T08:30:29.831 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.aWluNqHOv2 is 6KB 2023-10-07T08:30:29.878 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.aWluNqHOv2 2023-10-07T08:30:29.892 DEBUG:teuthology.orchestra.run.smithi089:> sudo /bin/ls /boot/loader/entries || true 2023-10-07T08:30:29.953 INFO:teuthology.orchestra.run.smithi089.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-07T08:30:29.953 INFO:teuthology.orchestra.run.smithi089.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-07T08:30:29.954 INFO:teuthology.orchestra.run.smithi089.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-07T08:30:29.954 INFO:teuthology.orchestra.run.smithi089.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-07T08:30:29.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-07T08:30:30.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2023-10-07T08:30:30.369 INFO:teuthology.orchestra.run.smithi081.stderr:done 2023-10-07T08:30:30.371 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2023-10-07T08:30:30.399 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.vwhofsIgvn 2023-10-07T08:30:30.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vwhofsIgvn 2023-10-07T08:30:30.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.vwhofsIgvn 2023-10-07T08:30:30.631 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.vwhofsIgvn is 6KB 2023-10-07T08:30:30.678 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.vwhofsIgvn 2023-10-07T08:30:30.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2023-10-07T08:30:30.777 INFO:teuthology.orchestra.run.smithi081.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-07T08:30:30.777 INFO:teuthology.orchestra.run.smithi081.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-07T08:30:30.777 INFO:teuthology.orchestra.run.smithi081.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-07T08:30:30.777 INFO:teuthology.orchestra.run.smithi081.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-07T08:30:30.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-07T08:30:30.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2023-10-07T08:31:00.142 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-07T08:31:00.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-07T08:31:00.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:31:00.881 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-07T08:31:00.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-07T08:31:00.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:32:00.202 DEBUG:teuthology.orchestra.remote:timed out 2023-10-07T08:32:00.884 DEBUG:teuthology.orchestra.remote:timed out 2023-10-07T08:32:09.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-07T08:32:09.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:32:09.650 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-10-07T08:32:09.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-07T08:32:09.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:32:09.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-07T08:32:09.948 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-07T08:32:09.949 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2023-10-07T08:32:09.964 INFO:teuthology.orchestra.run.smithi089.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-07T08:32:09.964 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:32:09.964 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-07T08:32:09.964 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-07T08:32:10.342 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-10-07T08:32:10.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-07T08:32:10.651 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-07T08:32:10.652 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-10-07T08:32:10.705 INFO:teuthology.orchestra.run.smithi081.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-07T08:32:10.706 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-07T08:32:10.706 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-07T08:32:10.706 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-07T08:32:10.965 DEBUG:teuthology.parallel:result is None 2023-10-07T08:32:11.706 DEBUG:teuthology.parallel:result is None 2023-10-07T08:32:11.707 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-07T08:32:11.717 INFO:teuthology.task.internal:Creating test directory... 2023-10-07T08:32:11.718 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-07T08:32:11.721 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-07T08:32:11.738 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-07T08:32:11.746 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-07T08:32:11.757 INFO:teuthology.task.internal:Creating archive directory... 2023-10-07T08:32:11.758 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-07T08:32:11.776 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-07T08:32:11.807 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-07T08:32:11.815 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-07T08:32:11.815 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-07T08:32:11.842 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-07T08:32:11.955 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-07T08:32:11.992 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-07T08:32:11.996 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-07T08:32:12.015 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-07T08:32:12.016 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-07T08:32:12.027 INFO:teuthology.task.internal:Configuring sudo... 2023-10-07T08:32:12.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-07T08:32:12.029 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-07T08:32:12.053 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-07T08:32:12.062 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-07T08:32:12.062 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-07T08:32:12.094 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-07T08:32:12.110 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-07T08:32:12.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-07T08:32:12.230 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-07T08:32:12.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-07T08:32:12.350 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:32:12.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-07T08:32:12.426 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-07T08:32:12.467 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-07T08:32:12.514 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-07T08:32:12.601 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-07T08:32:12.643 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:32:12.643 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-07T08:32:12.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2023-10-07T08:32:12.723 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2023-10-07T08:32:12.801 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-07T08:32:12.817 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-07T08:32:13.113 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-07T08:32:13.121 INFO:teuthology.task.internal:Starting timer... 2023-10-07T08:32:13.122 INFO:teuthology.run_tasks:Running task pcp... 2023-10-07T08:32:13.145 INFO:teuthology.run_tasks:Running task selinux... 2023-10-07T08:32:13.157 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-07T08:32:13.157 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2023-10-07T08:32:13.237 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: [ OK ] 2023-10-07T08:32:13.239 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2023-10-07T08:32:13.300 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: [ OK ] 2023-10-07T08:32:13.302 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-07T08:32:13.303 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2023-10-07T08:32:13.323 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2023-10-07T08:32:13.324 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2023-10-07T08:32:13.343 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2023-10-07T08:32:13.343 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi089.front.sepia.ceph.com': 'permissive'} 2023-10-07T08:32:13.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-07T08:32:13.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:32:13.439 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-07T08:32:14.034 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:32:14.034 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-07T08:32:14.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2023-10-07T08:32:14.061 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2023-10-07T08:32:14.103 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-07T08:32:14.112 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-07T08:32:14.113 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-07T08:32:14.129 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-07T08:32:14.131 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi089.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-07T08:40:25.105 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com')] 2023-10-07T08:40:25.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-07T08:40:25.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:40:25.177 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-10-07T08:40:25.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-07T08:40:25.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-07T08:40:25.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-07T08:40:25.270 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-10-07T08:40:25.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-07T08:40:25.334 INFO:teuthology.run_tasks:Running task clock... 2023-10-07T08:40:25.345 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-07T08:40:25.345 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-07T08:40:25.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-07T08:40:25.348 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-07T08:40:25.348 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-07T08:40:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-07T08:40:25.388 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-07T08:40:25.403 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-07T08:40:25.417 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-07T08:40:25.422 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2023-10-07T08:40:25.432 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2023-10-07T08:40:25.446 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-07T08:40:25.450 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2023-10-07T08:40:25.459 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-07T08:40:25.460 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2023-10-07T08:40:25.475 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-07T08:40:25.488 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-07T08:40:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:bash: ntpq: command not found 2023-10-07T08:40:25.544 INFO:teuthology.orchestra.run.smithi081.stdout:210 Number of sources = 4 2023-10-07T08:40:25.544 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-07T08:40:25.544 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2023-10-07T08:40:25.544 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:40:25.545 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:40:25.545 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:40:25.545 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:40:25.558 INFO:teuthology.orchestra.run.smithi089.stderr:bash: ntpq: command not found 2023-10-07T08:40:25.561 INFO:teuthology.orchestra.run.smithi089.stdout:210 Number of sources = 4 2023-10-07T08:40:25.561 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-07T08:40:25.561 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2023-10-07T08:40:25.561 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:40:25.561 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:40:25.561 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:40:25.561 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:40:25.562 INFO:teuthology.run_tasks:Running task install... 2023-10-07T08:40:25.570 DEBUG:teuthology.task.install:project ceph 2023-10-07T08:40:25.570 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}} 2023-10-07T08:40:25.570 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'} 2023-10-07T08:40:25.570 INFO:teuthology.task.install:Using flavor: default 2023-10-07T08:40:25.576 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-07T08:40:25.576 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-07T08:40:25.577 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-07T08:40:25.577 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-07T08:40:25.579 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-07T08:40:25.579 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-07T08:40:25.727 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-07T08:40:25.727 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-07T08:40:25.832 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-07T08:40:25.832 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-07T08:40:25.841 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-07T08:40:25.841 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:40:25.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-07T08:40:25.865 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-07T08:40:25.866 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-07T08:40:25.932 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-07T08:40:26.006 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-07T08:40:26.011 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-07T08:40:26.012 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:40:26.012 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-07T08:40:26.037 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-07T08:40:26.037 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-07T08:40:26.071 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2023-10-07T08:40:26.072 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2023-10-07T08:40:26.103 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-07T08:40:26.177 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-07T08:40:26.241 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2023-10-07T08:40:26.242 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2023-10-07T08:40:26.461 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-07T08:40:26.632 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-10-07T08:40:26.763 INFO:teuthology.orchestra.run.smithi081.stdout:44 files removed 2023-10-07T08:40:26.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-07T08:40:26.922 INFO:teuthology.orchestra.run.smithi089.stdout:44 files removed 2023-10-07T08:40:26.972 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-07T08:40:27.165 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-07T08:40:27.321 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-10-07T08:40:27.946 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 211 kB/s | 78 kB 00:00 2023-10-07T08:40:28.044 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 253 kB/s | 78 kB 00:00 2023-10-07T08:40:28.232 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 38 kB/s | 9.2 kB 00:00 2023-10-07T08:40:28.266 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 50 kB/s | 9.2 kB 00:00 2023-10-07T08:40:28.501 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 6.1 kB/s | 1.5 kB 00:00 2023-10-07T08:40:28.542 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 5.9 kB/s | 1.5 kB 00:00 2023-10-07T08:40:28.607 INFO:teuthology.orchestra.run.smithi081.stdout:Copr repo for python3-asyncssh owned by ceph 45 kB/s | 3.5 kB 00:00 2023-10-07T08:40:28.650 INFO:teuthology.orchestra.run.smithi089.stdout:Copr repo for python3-asyncssh owned by ceph 44 kB/s | 3.5 kB 00:00 2023-10-07T08:40:28.880 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 80 MB/s | 16 MB 00:00 2023-10-07T08:40:29.015 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 42 MB/s | 16 MB 00:00 2023-10-07T08:40:32.230 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-07T08:40:32.461 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-10-07T08:40:32.609 INFO:teuthology.orchestra.run.smithi089.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 128 MB/s | 38 MB 00:00 2023-10-07T08:40:32.854 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 123 MB/s | 38 MB 00:00 2023-10-07T08:40:38.051 INFO:teuthology.orchestra.run.smithi089.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 121 MB/s | 33 MB 00:00 2023-10-07T08:40:38.365 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 120 MB/s | 33 MB 00:00 2023-10-07T08:40:46.116 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-07T08:40:46.116 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-07T08:40:46.127 INFO:teuthology.orchestra.run.smithi089.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-07T08:40:46.128 INFO:teuthology.orchestra.run.smithi089.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-07T08:40:46.129 INFO:teuthology.orchestra.run.smithi089.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-07T08:40:46.130 INFO:teuthology.orchestra.run.smithi089.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-07T08:40:46.132 INFO:teuthology.orchestra.run.smithi089.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-07T08:40:46.134 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-07T08:40:46.135 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-07T08:40:46.610 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-07T08:40:46.611 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-07T08:40:46.620 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-10-07T08:40:46.622 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-07T08:40:46.622 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-07T08:40:46.623 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-07T08:40:46.624 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-07T08:40:46.626 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-07T08:40:46.628 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-07T08:40:46.629 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-07T08:40:46.631 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================================================== 2023-10-07T08:40:46.631 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-10-07T08:40:46.631 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================================================== 2023-10-07T08:40:46.631 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-10-07T08:40:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-07T08:40:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-07T08:40:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-07T08:40:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-07T08:40:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-07T08:40:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-07T08:40:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-07T08:40:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-07T08:40:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-07T08:40:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-07T08:40:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-07T08:40:46.632 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-07T08:40:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-07T08:40:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-07T08:40:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-07T08:40:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-07T08:40:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-07T08:40:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-07T08:40:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-07T08:40:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-07T08:40:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-07T08:40:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-07T08:40:46.633 INFO:teuthology.orchestra.run.smithi089.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-07T08:40:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-07T08:40:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-07T08:40:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-07T08:40:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-07T08:40:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-07T08:40:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-07T08:40:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-07T08:40:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-07T08:40:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-07T08:40:46.634 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-07T08:40:46.634 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2023-10-07T08:40:46.635 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-07T08:40:46.635 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-07T08:40:46.636 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-10-07T08:40:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-07T08:40:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-07T08:40:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-07T08:40:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-07T08:40:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-07T08:40:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-07T08:40:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-07T08:40:46.636 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-07T08:40:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-07T08:40:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-07T08:40:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-07T08:40:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-07T08:40:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-07T08:40:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-07T08:40:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-07T08:40:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-07T08:40:46.637 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-07T08:40:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-07T08:40:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-07T08:40:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-07T08:40:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-07T08:40:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-07T08:40:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-07T08:40:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-07T08:40:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-07T08:40:46.638 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-07T08:40:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-07T08:40:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-07T08:40:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-07T08:40:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-07T08:40:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-07T08:40:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-07T08:40:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-07T08:40:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-07T08:40:46.639 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-07T08:40:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-07T08:40:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-07T08:40:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-07T08:40:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-07T08:40:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-07T08:40:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-07T08:40:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-07T08:40:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-07T08:40:46.640 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-07T08:40:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-07T08:40:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-07T08:40:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-07T08:40:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-07T08:40:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-07T08:40:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-07T08:40:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-07T08:40:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-07T08:40:46.641 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-07T08:40:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-07T08:40:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-07T08:40:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-07T08:40:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-07T08:40:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-07T08:40:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-07T08:40:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-07T08:40:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-07T08:40:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-07T08:40:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-07T08:40:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-07T08:40:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-07T08:40:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-07T08:40:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-07T08:40:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-07T08:40:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-07T08:40:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-07T08:40:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-07T08:40:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-07T08:40:46.643 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-07T08:40:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-07T08:40:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-07T08:40:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-07T08:40:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-07T08:40:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-07T08:40:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-07T08:40:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-07T08:40:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-07T08:40:46.644 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-07T08:40:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-07T08:40:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-07T08:40:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-07T08:40:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:40:46.645 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-10-07T08:40:46.645 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================================================== 2023-10-07T08:40:46.645 INFO:teuthology.orchestra.run.smithi089.stdout:Install 118 Packages 2023-10-07T08:40:46.645 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 2 Packages 2023-10-07T08:40:46.645 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:40:46.646 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 202 M 2023-10-07T08:40:46.646 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-10-07T08:40:46.955 INFO:teuthology.orchestra.run.smithi089.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 43 kB/s | 6.4 kB 00:00 2023-10-07T08:40:47.119 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2023-10-07T08:40:47.131 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================================================== 2023-10-07T08:40:47.131 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2023-10-07T08:40:47.131 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================================================== 2023-10-07T08:40:47.131 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2023-10-07T08:40:47.131 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-07T08:40:47.131 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-07T08:40:47.131 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-07T08:40:47.131 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-07T08:40:47.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-07T08:40:47.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-07T08:40:47.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-07T08:40:47.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-07T08:40:47.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-07T08:40:47.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-07T08:40:47.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-07T08:40:47.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-07T08:40:47.132 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-07T08:40:47.132 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-07T08:40:47.132 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-07T08:40:47.132 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-07T08:40:47.133 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-07T08:40:47.133 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-07T08:40:47.133 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-07T08:40:47.133 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-07T08:40:47.133 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-07T08:40:47.133 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-07T08:40:47.133 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-07T08:40:47.133 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-07T08:40:47.133 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-07T08:40:47.133 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-07T08:40:47.133 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-07T08:40:47.133 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-07T08:40:47.134 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-07T08:40:47.134 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-07T08:40:47.134 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-07T08:40:47.134 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-07T08:40:47.134 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-07T08:40:47.134 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2023-10-07T08:40:47.134 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-07T08:40:47.134 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-07T08:40:47.134 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2023-10-07T08:40:47.134 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-07T08:40:47.134 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-07T08:40:47.135 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-07T08:40:47.135 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-07T08:40:47.135 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-07T08:40:47.135 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-07T08:40:47.135 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-07T08:40:47.135 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-07T08:40:47.135 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-07T08:40:47.135 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-07T08:40:47.135 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-07T08:40:47.135 INFO:teuthology.orchestra.run.smithi081.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-07T08:40:47.135 INFO:teuthology.orchestra.run.smithi081.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-07T08:40:47.135 INFO:teuthology.orchestra.run.smithi081.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-07T08:40:47.136 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-07T08:40:47.136 INFO:teuthology.orchestra.run.smithi081.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-07T08:40:47.136 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-07T08:40:47.136 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-07T08:40:47.136 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-07T08:40:47.136 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-07T08:40:47.136 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-07T08:40:47.136 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-07T08:40:47.136 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-07T08:40:47.136 INFO:teuthology.orchestra.run.smithi081.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-07T08:40:47.136 INFO:teuthology.orchestra.run.smithi081.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-07T08:40:47.137 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-07T08:40:47.137 INFO:teuthology.orchestra.run.smithi081.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-07T08:40:47.137 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-07T08:40:47.137 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-07T08:40:47.137 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-07T08:40:47.137 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-07T08:40:47.137 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-07T08:40:47.137 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-07T08:40:47.137 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-07T08:40:47.137 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-07T08:40:47.137 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-07T08:40:47.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-07T08:40:47.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-07T08:40:47.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-07T08:40:47.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-07T08:40:47.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-07T08:40:47.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-07T08:40:47.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-07T08:40:47.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-07T08:40:47.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-07T08:40:47.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-07T08:40:47.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-07T08:40:47.138 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-07T08:40:47.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-07T08:40:47.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-07T08:40:47.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-07T08:40:47.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-07T08:40:47.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-07T08:40:47.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-07T08:40:47.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-07T08:40:47.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-07T08:40:47.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-07T08:40:47.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-07T08:40:47.139 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-07T08:40:47.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-07T08:40:47.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-07T08:40:47.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-07T08:40:47.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-07T08:40:47.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-07T08:40:47.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-07T08:40:47.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-07T08:40:47.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-07T08:40:47.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-07T08:40:47.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-07T08:40:47.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-07T08:40:47.140 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-07T08:40:47.141 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-07T08:40:47.141 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-07T08:40:47.141 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-07T08:40:47.141 INFO:teuthology.orchestra.run.smithi081.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-07T08:40:47.141 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-07T08:40:47.141 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-07T08:40:47.141 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-07T08:40:47.141 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-07T08:40:47.141 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-07T08:40:47.141 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-07T08:40:47.141 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-07T08:40:47.142 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-07T08:40:47.142 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-07T08:40:47.142 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-07T08:40:47.142 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:40:47.142 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2023-10-07T08:40:47.142 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================================================== 2023-10-07T08:40:47.142 INFO:teuthology.orchestra.run.smithi081.stdout:Install 118 Packages 2023-10-07T08:40:47.142 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 2 Packages 2023-10-07T08:40:47.142 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:40:47.143 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 202 M 2023-10-07T08:40:47.143 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2023-10-07T08:40:47.388 INFO:teuthology.orchestra.run.smithi081.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 37 kB/s | 6.4 kB 00:00 2023-10-07T08:40:47.399 INFO:teuthology.orchestra.run.smithi089.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 1.9 MB/s | 876 kB 00:00 2023-10-07T08:40:47.475 INFO:teuthology.orchestra.run.smithi089.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 2.1 MB/s | 162 kB 00:00 2023-10-07T08:40:48.121 INFO:teuthology.orchestra.run.smithi081.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 1.2 MB/s | 876 kB 00:00 2023-10-07T08:40:48.162 INFO:teuthology.orchestra.run.smithi081.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 3.8 MB/s | 162 kB 00:00 2023-10-07T08:40:48.190 INFO:teuthology.orchestra.run.smithi089.stdout:(4/120): ceph-common-17.2.6-1320.g08cac018.el8. 17 MB/s | 23 MB 00:01 2023-10-07T08:40:48.301 INFO:teuthology.orchestra.run.smithi089.stdout:(5/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 14 MB/s | 1.6 MB 00:00 2023-10-07T08:40:48.327 INFO:teuthology.orchestra.run.smithi089.stdout:(6/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 2.7 MB/s | 2.3 MB 00:00 2023-10-07T08:40:48.597 INFO:teuthology.orchestra.run.smithi089.stdout:(7/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 13 MB/s | 3.9 MB 00:00 2023-10-07T08:40:49.005 INFO:teuthology.orchestra.run.smithi089.stdout:(8/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 2.3 MB/s | 5.2 MB 00:02 2023-10-07T08:40:49.093 INFO:teuthology.orchestra.run.smithi089.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 277 kB/s | 24 kB 00:00 2023-10-07T08:40:49.101 INFO:teuthology.orchestra.run.smithi081.stdout:(4/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 2.5 MB/s | 2.3 MB 00:00 2023-10-07T08:40:49.125 INFO:teuthology.orchestra.run.smithi081.stdout:(5/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 2.7 MB/s | 5.2 MB 00:01 2023-10-07T08:40:49.587 INFO:teuthology.orchestra.run.smithi081.stdout:(6/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 3.2 MB/s | 1.6 MB 00:00 2023-10-07T08:40:50.034 INFO:teuthology.orchestra.run.smithi089.stdout:(10/120): ceph-radosgw-17.2.6-1320.g08cac018.el 12 MB/s | 17 MB 00:01 2023-10-07T08:40:50.086 INFO:teuthology.orchestra.run.smithi089.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 4.8 MB/s | 255 kB 00:00 2023-10-07T08:40:50.136 INFO:teuthology.orchestra.run.smithi089.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 492 kB/s | 25 kB 00:00 2023-10-07T08:40:50.190 INFO:teuthology.orchestra.run.smithi081.stdout:(7/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 3.7 MB/s | 3.9 MB 00:01 2023-10-07T08:40:50.211 INFO:teuthology.orchestra.run.smithi089.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 10 MB/s | 797 kB 00:00 2023-10-07T08:40:50.273 INFO:teuthology.orchestra.run.smithi089.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 2.8 MB/s | 174 kB 00:00 2023-10-07T08:40:50.335 INFO:teuthology.orchestra.run.smithi089.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 2.1 MB/s | 130 kB 00:00 2023-10-07T08:40:50.408 INFO:teuthology.orchestra.run.smithi089.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 6.8 MB/s | 507 kB 00:00 2023-10-07T08:40:51.061 INFO:teuthology.orchestra.run.smithi089.stdout:(17/120): librgw2-17.2.6-1320.g08cac018.el8.x86 8.5 MB/s | 5.6 MB 00:00 2023-10-07T08:40:51.104 INFO:teuthology.orchestra.run.smithi089.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 1.0 MB/s | 45 kB 00:00 2023-10-07T08:40:51.151 INFO:teuthology.orchestra.run.smithi089.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 2.4 MB/s | 115 kB 00:00 2023-10-07T08:40:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 3.6 MB/s | 190 kB 00:00 2023-10-07T08:40:51.263 INFO:teuthology.orchestra.run.smithi089.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 6.1 MB/s | 371 kB 00:00 2023-10-07T08:40:51.323 INFO:teuthology.orchestra.run.smithi089.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 5.8 MB/s | 358 kB 00:00 2023-10-07T08:40:51.376 INFO:teuthology.orchestra.run.smithi089.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 2.0 MB/s | 107 kB 00:00 2023-10-07T08:40:51.421 INFO:teuthology.orchestra.run.smithi089.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 2.0 MB/s | 90 kB 00:00 2023-10-07T08:40:51.827 INFO:teuthology.orchestra.run.smithi089.stdout:(25/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 8.5 MB/s | 3.5 MB 00:00 2023-10-07T08:40:51.875 INFO:teuthology.orchestra.run.smithi089.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 3.5 MB/s | 173 kB 00:00 2023-10-07T08:40:51.896 INFO:teuthology.orchestra.run.smithi089.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 1.1 MB/s | 23 kB 00:00 2023-10-07T08:40:51.919 INFO:teuthology.orchestra.run.smithi089.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 5.2 MB/s | 121 kB 00:00 2023-10-07T08:40:51.949 INFO:teuthology.orchestra.run.smithi081.stdout:(8/120): ceph-osd-17.2.6-1320.g08cac018.el8.x86 7.1 MB/s | 17 MB 00:02 2023-10-07T08:40:52.005 INFO:teuthology.orchestra.run.smithi081.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 442 kB/s | 24 kB 00:00 2023-10-07T08:40:52.092 INFO:teuthology.orchestra.run.smithi089.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 9.8 MB/s | 1.7 MB 00:00 2023-10-07T08:40:52.360 INFO:teuthology.orchestra.run.smithi089.stdout:(30/120): ceph-osd-17.2.6-1320.g08cac018.el8.x8 4.1 MB/s | 17 MB 00:04 2023-10-07T08:40:52.447 INFO:teuthology.orchestra.run.smithi089.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 2.7 MB/s | 238 kB 00:00 2023-10-07T08:40:52.525 INFO:teuthology.orchestra.run.smithi089.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 607 kB/s | 47 kB 00:00 2023-10-07T08:40:52.600 INFO:teuthology.orchestra.run.smithi089.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 193 kB/s | 14 kB 00:00 2023-10-07T08:40:52.686 INFO:teuthology.orchestra.run.smithi089.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 3.0 MB/s | 267 kB 00:00 2023-10-07T08:40:52.765 INFO:teuthology.orchestra.run.smithi089.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 1.0 MB/s | 80 kB 00:00 2023-10-07T08:40:52.840 INFO:teuthology.orchestra.run.smithi089.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 238 kB/s | 18 kB 00:00 2023-10-07T08:40:52.937 INFO:teuthology.orchestra.run.smithi089.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 8.8 MB/s | 7.4 MB 00:00 2023-10-07T08:40:53.186 INFO:teuthology.orchestra.run.smithi089.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 236 kB/s | 59 kB 00:00 2023-10-07T08:40:53.300 INFO:teuthology.orchestra.run.smithi089.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 661 kB/s | 75 kB 00:00 2023-10-07T08:40:53.309 INFO:teuthology.orchestra.run.smithi089.stdout:(40/120): gperftools-libs-2.7-9.el8.x86_64.rpm 653 kB/s | 306 kB 00:00 2023-10-07T08:40:53.371 INFO:teuthology.orchestra.run.smithi089.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 731 kB/s | 44 kB 00:00 2023-10-07T08:40:53.545 INFO:teuthology.orchestra.run.smithi089.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.0 MB/s | 185 kB 00:00 2023-10-07T08:40:53.602 INFO:teuthology.orchestra.run.smithi089.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 586 kB/s | 33 kB 00:00 2023-10-07T08:40:53.653 INFO:teuthology.orchestra.run.smithi089.stdout:(44/120): python3-asyncssh-2.7.0-2.el8.noarch.r 1.3 MB/s | 476 kB 00:00 2023-10-07T08:40:53.654 INFO:teuthology.orchestra.run.smithi089.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 313 kB/s | 16 kB 00:00 2023-10-07T08:40:53.720 INFO:teuthology.orchestra.run.smithi089.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 2.5 MB/s | 173 kB 00:00 2023-10-07T08:40:53.776 INFO:teuthology.orchestra.run.smithi089.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-10-07T08:40:53.825 INFO:teuthology.orchestra.run.smithi089.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 227 kB/s | 11 kB 00:00 2023-10-07T08:40:53.876 INFO:teuthology.orchestra.run.smithi089.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 350 kB/s | 18 kB 00:00 2023-10-07T08:40:53.929 INFO:teuthology.orchestra.run.smithi081.stdout:(10/120): ceph-common-17.2.6-1320.g08cac018.el8 3.5 MB/s | 23 MB 00:06 2023-10-07T08:40:53.999 INFO:teuthology.orchestra.run.smithi089.stdout:(50/120): python3-cherrypy-18.4.0-1.el8.noarch. 1.1 MB/s | 384 kB 00:00 2023-10-07T08:40:54.002 INFO:teuthology.orchestra.run.smithi081.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 3.4 MB/s | 255 kB 00:00 2023-10-07T08:40:54.038 INFO:teuthology.orchestra.run.smithi081.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 706 kB/s | 25 kB 00:00 2023-10-07T08:40:54.043 INFO:teuthology.orchestra.run.smithi089.stdout:(51/120): python3-kubernetes-11.0.0-6.el8.noarc 7.0 MB/s | 1.2 MB 00:00 2023-10-07T08:40:54.061 INFO:teuthology.orchestra.run.smithi089.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 794 kB/s | 49 kB 00:00 2023-10-07T08:40:54.093 INFO:teuthology.orchestra.run.smithi089.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-10-07T08:40:54.125 INFO:teuthology.orchestra.run.smithi089.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 941 kB/s | 60 kB 00:00 2023-10-07T08:40:54.151 INFO:teuthology.orchestra.run.smithi089.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 4.8 MB/s | 283 kB 00:00 2023-10-07T08:40:54.177 INFO:teuthology.orchestra.run.smithi089.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 299 kB/s | 16 kB 00:00 2023-10-07T08:40:54.200 INFO:teuthology.orchestra.run.smithi089.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 687 kB/s | 34 kB 00:00 2023-10-07T08:40:54.201 INFO:teuthology.orchestra.run.smithi081.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 4.8 MB/s | 797 kB 00:00 2023-10-07T08:40:54.241 INFO:teuthology.orchestra.run.smithi081.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 4.3 MB/s | 174 kB 00:00 2023-10-07T08:40:54.250 INFO:teuthology.orchestra.run.smithi089.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 1.2 MB/s | 64 kB 00:00 2023-10-07T08:40:54.299 INFO:teuthology.orchestra.run.smithi089.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 383 kB/s | 19 kB 00:00 2023-10-07T08:40:54.348 INFO:teuthology.orchestra.run.smithi089.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 488 kB/s | 24 kB 00:00 2023-10-07T08:40:54.354 INFO:teuthology.orchestra.run.smithi089.stdout:(61/120): python3-routes-2.4.1-12.el8.noarch.rp 1.1 MB/s | 196 kB 00:00 2023-10-07T08:40:54.366 INFO:teuthology.orchestra.run.smithi081.stdout:(15/120): ceph-radosgw-17.2.6-1320.g08cac018.el 4.0 MB/s | 17 MB 00:04 2023-10-07T08:40:54.367 INFO:teuthology.orchestra.run.smithi081.stdout:(16/120): librados-devel-17.2.6-1320.g08cac018. 1.0 MB/s | 130 kB 00:00 2023-10-07T08:40:54.397 INFO:teuthology.orchestra.run.smithi089.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 597 kB/s | 29 kB 00:00 2023-10-07T08:40:54.410 INFO:teuthology.orchestra.run.smithi089.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 496 kB/s | 27 kB 00:00 2023-10-07T08:40:54.454 INFO:teuthology.orchestra.run.smithi089.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 4.4 MB/s | 255 kB 00:00 2023-10-07T08:40:54.481 INFO:teuthology.orchestra.run.smithi081.stdout:(17/120): libradosstriper1-17.2.6-1320.g08cac01 4.3 MB/s | 507 kB 00:00 2023-10-07T08:40:54.503 INFO:teuthology.orchestra.run.smithi089.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-10-07T08:40:54.515 INFO:teuthology.orchestra.run.smithi081.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 1.3 MB/s | 45 kB 00:00 2023-10-07T08:40:54.553 INFO:teuthology.orchestra.run.smithi081.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 3.0 MB/s | 115 kB 00:00 2023-10-07T08:40:54.555 INFO:teuthology.orchestra.run.smithi089.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 1.6 MB/s | 85 kB 00:00 2023-10-07T08:40:54.596 INFO:teuthology.orchestra.run.smithi081.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 4.3 MB/s | 190 kB 00:00 2023-10-07T08:40:54.604 INFO:teuthology.orchestra.run.smithi089.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 468 kB/s | 23 kB 00:00 2023-10-07T08:40:54.643 INFO:teuthology.orchestra.run.smithi089.stdout:(68/120): python3-webob-1.8.5-1.el8.1.noarch.rp 1.1 MB/s | 251 kB 00:00 2023-10-07T08:40:54.647 INFO:teuthology.orchestra.run.smithi089.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 18 MB/s | 70 kB 00:00 2023-10-07T08:40:54.677 INFO:teuthology.orchestra.run.smithi081.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 4.5 MB/s | 371 kB 00:00 2023-10-07T08:40:54.684 INFO:teuthology.orchestra.run.smithi089.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 503 kB/s | 19 kB 00:00 2023-10-07T08:40:54.701 INFO:teuthology.orchestra.run.smithi089.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.5 MB/s | 43 kB 00:00 2023-10-07T08:40:54.718 INFO:teuthology.orchestra.run.smithi089.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 9.2 MB/s | 155 kB 00:00 2023-10-07T08:40:54.735 INFO:teuthology.orchestra.run.smithi089.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 13 MB/s | 220 kB 00:00 2023-10-07T08:40:54.751 INFO:teuthology.orchestra.run.smithi089.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.0 MB/s | 48 kB 00:00 2023-10-07T08:40:54.759 INFO:teuthology.orchestra.run.smithi081.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 4.3 MB/s | 358 kB 00:00 2023-10-07T08:40:54.770 INFO:teuthology.orchestra.run.smithi089.stdout:(75/120): thrift-0.13.0-2.el8.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2023-10-07T08:40:54.773 INFO:teuthology.orchestra.run.smithi089.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 10 MB/s | 229 kB 00:00 2023-10-07T08:40:54.798 INFO:teuthology.orchestra.run.smithi081.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 2.7 MB/s | 107 kB 00:00 2023-10-07T08:40:54.807 INFO:teuthology.orchestra.run.smithi089.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 1.1 MB/s | 43 kB 00:00 2023-10-07T08:40:54.815 INFO:teuthology.orchestra.run.smithi089.stdout:(78/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 56 MB/s | 2.3 MB 00:00 2023-10-07T08:40:54.826 INFO:teuthology.orchestra.run.smithi089.stdout:(79/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 974 kB/s | 18 kB 00:00 2023-10-07T08:40:54.835 INFO:teuthology.orchestra.run.smithi081.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 2.4 MB/s | 90 kB 00:00 2023-10-07T08:40:54.840 INFO:teuthology.orchestra.run.smithi089.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 24 MB/s | 605 kB 00:00 2023-10-07T08:40:54.843 INFO:teuthology.orchestra.run.smithi089.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 4.5 MB/s | 83 kB 00:00 2023-10-07T08:40:54.856 INFO:teuthology.orchestra.run.smithi089.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 3.6 MB/s | 59 kB 00:00 2023-10-07T08:40:54.866 INFO:teuthology.orchestra.run.smithi089.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 7.6 MB/s | 169 kB 00:00 2023-10-07T08:40:54.873 INFO:teuthology.orchestra.run.smithi089.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.2 MB/s | 38 kB 00:00 2023-10-07T08:40:54.881 INFO:teuthology.orchestra.run.smithi089.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.5 MB/s | 86 kB 00:00 2023-10-07T08:40:54.890 INFO:teuthology.orchestra.run.smithi089.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.4 MB/s | 58 kB 00:00 2023-10-07T08:40:54.895 INFO:teuthology.orchestra.run.smithi089.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.4 MB/s | 47 kB 00:00 2023-10-07T08:40:54.913 INFO:teuthology.orchestra.run.smithi089.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 24 MB/s | 559 kB 00:00 2023-10-07T08:40:54.917 INFO:teuthology.orchestra.run.smithi089.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 28 MB/s | 639 kB 00:00 2023-10-07T08:40:54.930 INFO:teuthology.orchestra.run.smithi089.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.0 MB/s | 70 kB 00:00 2023-10-07T08:40:54.932 INFO:teuthology.orchestra.run.smithi089.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 13 MB/s | 200 kB 00:00 2023-10-07T08:40:54.948 INFO:teuthology.orchestra.run.smithi089.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 5.5 MB/s | 97 kB 00:00 2023-10-07T08:40:54.966 INFO:teuthology.orchestra.run.smithi089.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 2.4 MB/s | 44 kB 00:00 2023-10-07T08:40:54.982 INFO:teuthology.orchestra.run.smithi089.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.6 MB/s | 27 kB 00:00 2023-10-07T08:40:55.000 INFO:teuthology.orchestra.run.smithi089.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 8.8 MB/s | 161 kB 00:00 2023-10-07T08:40:55.021 INFO:teuthology.orchestra.run.smithi089.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 16 MB/s | 320 kB 00:00 2023-10-07T08:40:55.042 INFO:teuthology.orchestra.run.smithi089.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 21 MB/s | 457 kB 00:00 2023-10-07T08:40:55.193 INFO:teuthology.orchestra.run.smithi089.stdout:(98/120): python3-scipy-1.0.0-20.module+el8.1.0 56 MB/s | 15 MB 00:00 2023-10-07T08:40:55.207 INFO:teuthology.orchestra.run.smithi089.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.9 MB/s | 39 kB 00:00 2023-10-07T08:40:55.227 INFO:teuthology.orchestra.run.smithi089.stdout:(100/120): python3-babel-2.5.1-5.el8.noarch.rpm 26 MB/s | 4.8 MB 00:00 2023-10-07T08:40:55.234 INFO:teuthology.orchestra.run.smithi089.stdout:(101/120): bison-3.0.4-10.el8.x86_64.rpm 24 MB/s | 688 kB 00:00 2023-10-07T08:40:55.243 INFO:teuthology.orchestra.run.smithi089.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 16 MB/s | 259 kB 00:00 2023-10-07T08:40:55.250 INFO:teuthology.orchestra.run.smithi089.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 14 MB/s | 225 kB 00:00 2023-10-07T08:40:55.258 INFO:teuthology.orchestra.run.smithi089.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 8.8 MB/s | 126 kB 00:00 2023-10-07T08:40:55.275 INFO:teuthology.orchestra.run.smithi089.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 11 MB/s | 187 kB 00:00 2023-10-07T08:40:55.294 INFO:teuthology.orchestra.run.smithi089.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 27 MB/s | 538 kB 00:00 2023-10-07T08:40:55.307 INFO:teuthology.orchestra.run.smithi089.stdout:(107/120): python3-numpy-1.14.3-9.el8.x86_64.rp 66 MB/s | 3.7 MB 00:00 2023-10-07T08:40:55.311 INFO:teuthology.orchestra.run.smithi089.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 18 MB/s | 302 kB 00:00 2023-10-07T08:40:55.327 INFO:teuthology.orchestra.run.smithi089.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 8.1 MB/s | 157 kB 00:00 2023-10-07T08:40:55.333 INFO:teuthology.orchestra.run.smithi089.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 5.1 MB/s | 110 kB 00:00 2023-10-07T08:40:55.343 INFO:teuthology.orchestra.run.smithi089.stdout:(111/120): librdkafka-0.11.4-1.el8.x86_64.rpm 21 MB/s | 353 kB 00:00 2023-10-07T08:40:55.347 INFO:teuthology.orchestra.run.smithi089.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.3 MB/s | 20 kB 00:00 2023-10-07T08:40:55.348 INFO:teuthology.orchestra.run.smithi081.stdout:(25/120): librgw2-17.2.6-1320.g08cac018.el8.x86 5.7 MB/s | 5.6 MB 00:00 2023-10-07T08:40:55.361 INFO:teuthology.orchestra.run.smithi089.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.0 MB/s | 54 kB 00:00 2023-10-07T08:40:55.364 INFO:teuthology.orchestra.run.smithi089.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 34 MB/s | 709 kB 00:00 2023-10-07T08:40:55.389 INFO:teuthology.orchestra.run.smithi081.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 4.2 MB/s | 173 kB 00:00 2023-10-07T08:40:55.428 INFO:teuthology.orchestra.run.smithi081.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 609 kB/s | 23 kB 00:00 2023-10-07T08:40:55.441 INFO:teuthology.orchestra.run.smithi089.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 64 MB/s | 4.7 MB 00:00 2023-10-07T08:40:55.450 INFO:teuthology.orchestra.run.smithi089.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 53 MB/s | 4.6 MB 00:00 2023-10-07T08:40:55.458 INFO:teuthology.orchestra.run.smithi089.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 31 MB/s | 713 kB 00:00 2023-10-07T08:40:55.461 INFO:teuthology.orchestra.run.smithi081.stdout:(28/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 5.5 MB/s | 3.5 MB 00:00 2023-10-07T08:40:55.462 INFO:teuthology.orchestra.run.smithi081.stdout:(29/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 3.3 MB/s | 121 kB 00:00 2023-10-07T08:40:55.834 INFO:teuthology.orchestra.run.smithi081.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 4.6 MB/s | 1.7 MB 00:00 2023-10-07T08:40:55.906 INFO:teuthology.orchestra.run.smithi081.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 3.2 MB/s | 238 kB 00:00 2023-10-07T08:40:55.976 INFO:teuthology.orchestra.run.smithi081.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 682 kB/s | 47 kB 00:00 2023-10-07T08:40:56.045 INFO:teuthology.orchestra.run.smithi081.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 212 kB/s | 14 kB 00:00 2023-10-07T08:40:56.092 INFO:teuthology.orchestra.run.smithi089.stdout:(118/120): librbd1-17.2.6-1320.g08cac018.el8.x8 5.7 MB/s | 3.6 MB 00:00 2023-10-07T08:40:56.157 INFO:teuthology.orchestra.run.smithi081.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 2.3 MB/s | 267 kB 00:00 2023-10-07T08:40:56.202 INFO:teuthology.orchestra.run.smithi081.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 1.7 MB/s | 80 kB 00:00 2023-10-07T08:40:56.245 INFO:teuthology.orchestra.run.smithi081.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 419 kB/s | 18 kB 00:00 2023-10-07T08:40:56.413 INFO:teuthology.orchestra.run.smithi089.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 3.6 MB/s | 3.5 MB 00:00 2023-10-07T08:40:56.700 INFO:teuthology.orchestra.run.smithi081.stdout:(37/120): ceph-test-17.2.6-1320.g08cac018.el8.x 11 MB/s | 52 MB 00:04 2023-10-07T08:40:56.835 INFO:teuthology.orchestra.run.smithi081.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 437 kB/s | 59 kB 00:00 2023-10-07T08:40:56.886 INFO:teuthology.orchestra.run.smithi081.stdout:(39/120): ceph-mgr-diskprediction-local-17.2.6- 5.2 MB/s | 7.4 MB 00:01 2023-10-07T08:40:56.887 INFO:teuthology.orchestra.run.smithi081.stdout:(40/120): gperftools-libs-2.7-9.el8.x86_64.rpm 477 kB/s | 306 kB 00:00 2023-10-07T08:40:56.899 INFO:teuthology.orchestra.run.smithi081.stdout:(41/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.1 MB/s | 75 kB 00:00 2023-10-07T08:40:56.921 INFO:teuthology.orchestra.run.smithi081.stdout:(42/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.3 MB/s | 44 kB 00:00 2023-10-07T08:40:56.955 INFO:teuthology.orchestra.run.smithi081.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 975 kB/s | 33 kB 00:00 2023-10-07T08:40:56.968 INFO:teuthology.orchestra.run.smithi081.stdout:(44/120): python3-beautifulsoup4-4.6.3-2.el8.1. 2.6 MB/s | 185 kB 00:00 2023-10-07T08:40:56.987 INFO:teuthology.orchestra.run.smithi081.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 515 kB/s | 16 kB 00:00 2023-10-07T08:40:57.011 INFO:teuthology.orchestra.run.smithi081.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 3.9 MB/s | 173 kB 00:00 2023-10-07T08:40:57.049 INFO:teuthology.orchestra.run.smithi081.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 2.2 MB/s | 81 kB 00:00 2023-10-07T08:40:57.053 INFO:teuthology.orchestra.run.smithi081.stdout:(48/120): python3-cherrypy-18.4.0-1.el8.noarch. 5.7 MB/s | 384 kB 00:00 2023-10-07T08:40:57.080 INFO:teuthology.orchestra.run.smithi081.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 353 kB/s | 11 kB 00:00 2023-10-07T08:40:57.085 INFO:teuthology.orchestra.run.smithi081.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 549 kB/s | 18 kB 00:00 2023-10-07T08:40:57.117 INFO:teuthology.orchestra.run.smithi081.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 1.5 MB/s | 49 kB 00:00 2023-10-07T08:40:57.119 INFO:teuthology.orchestra.run.smithi081.stdout:(52/120): python3-asyncssh-2.7.0-2.el8.noarch.r 2.0 MB/s | 476 kB 00:00 2023-10-07T08:40:57.150 INFO:teuthology.orchestra.run.smithi081.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 1.8 MB/s | 59 kB 00:00 2023-10-07T08:40:57.152 INFO:teuthology.orchestra.run.smithi081.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.8 MB/s | 60 kB 00:00 2023-10-07T08:40:57.185 INFO:teuthology.orchestra.run.smithi081.stdout:(55/120): python3-kubernetes-11.0.0-6.el8.noarc 11 MB/s | 1.2 MB 00:00 2023-10-07T08:40:57.185 INFO:teuthology.orchestra.run.smithi081.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 472 kB/s | 16 kB 00:00 2023-10-07T08:40:57.191 INFO:teuthology.orchestra.run.smithi081.stdout:(57/120): python3-pecan-1.3.2-9.el8.noarch.rpm 6.8 MB/s | 283 kB 00:00 2023-10-07T08:40:57.217 INFO:teuthology.orchestra.run.smithi081.stdout:(58/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.0 MB/s | 34 kB 00:00 2023-10-07T08:40:57.225 INFO:teuthology.orchestra.run.smithi081.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 1.9 MB/s | 64 kB 00:00 2023-10-07T08:40:57.227 INFO:teuthology.orchestra.run.smithi081.stdout:(60/120): python3-routes-2.4.1-12.el8.noarch.rp 4.7 MB/s | 196 kB 00:00 2023-10-07T08:40:57.248 INFO:teuthology.orchestra.run.smithi081.stdout:(61/120): python3-simplegeneric-0.8.1-17.el8.no 604 kB/s | 19 kB 00:00 2023-10-07T08:40:57.257 INFO:teuthology.orchestra.run.smithi081.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 760 kB/s | 24 kB 00:00 2023-10-07T08:40:57.258 INFO:teuthology.orchestra.run.smithi081.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 933 kB/s | 29 kB 00:00 2023-10-07T08:40:57.280 INFO:teuthology.orchestra.run.smithi081.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 882 kB/s | 27 kB 00:00 2023-10-07T08:40:57.297 INFO:teuthology.orchestra.run.smithi081.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 6.2 MB/s | 255 kB 00:00 2023-10-07T08:40:57.303 INFO:teuthology.orchestra.run.smithi081.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 5.6 MB/s | 251 kB 00:00 2023-10-07T08:40:57.312 INFO:teuthology.orchestra.run.smithi081.stdout:(67/120): python3-websocket-client-0.56.0-5.el8 1.9 MB/s | 61 kB 00:00 2023-10-07T08:40:57.330 INFO:teuthology.orchestra.run.smithi081.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 2.5 MB/s | 85 kB 00:00 2023-10-07T08:40:57.334 INFO:teuthology.orchestra.run.smithi081.stdout:(69/120): python3-zc-lockfile-2.0-2.el8.noarch. 726 kB/s | 23 kB 00:00 2023-10-07T08:40:57.335 INFO:teuthology.orchestra.run.smithi081.stdout:(70/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-07T08:40:57.366 INFO:teuthology.orchestra.run.smithi081.stdout:(71/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 596 kB/s | 19 kB 00:00 2023-10-07T08:40:57.372 INFO:teuthology.orchestra.run.smithi081.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.1 MB/s | 43 kB 00:00 2023-10-07T08:40:57.383 INFO:teuthology.orchestra.run.smithi081.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 9.0 MB/s | 155 kB 00:00 2023-10-07T08:40:57.390 INFO:teuthology.orchestra.run.smithi081.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 12 MB/s | 220 kB 00:00 2023-10-07T08:40:57.395 INFO:teuthology.orchestra.run.smithi081.stdout:(75/120): thrift-0.13.0-2.el8.x86_64.rpm 21 MB/s | 1.7 MB 00:00 2023-10-07T08:40:57.399 INFO:teuthology.orchestra.run.smithi081.stdout:(76/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.0 MB/s | 48 kB 00:00 2023-10-07T08:40:57.411 INFO:teuthology.orchestra.run.smithi081.stdout:(77/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 11 MB/s | 229 kB 00:00 2023-10-07T08:40:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:(78/120): python3-requests-oauthlib-1.0.0-1.el8 1.3 MB/s | 43 kB 00:00 2023-10-07T08:40:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:(79/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.0 MB/s | 18 kB 00:00 2023-10-07T08:40:57.443 INFO:teuthology.orchestra.run.smithi081.stdout:(80/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 53 MB/s | 2.3 MB 00:00 2023-10-07T08:40:57.444 INFO:teuthology.orchestra.run.smithi081.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 5.1 MB/s | 83 kB 00:00 2023-10-07T08:40:57.450 INFO:teuthology.orchestra.run.smithi081.stdout:(82/120): pcre2-devel-10.32-2.el8.x86_64.rpm 27 MB/s | 605 kB 00:00 2023-10-07T08:40:57.457 INFO:teuthology.orchestra.run.smithi081.stdout:(83/120): elfutils-libelf-devel-0.182-3.el8.x86 4.1 MB/s | 59 kB 00:00 2023-10-07T08:40:57.460 INFO:teuthology.orchestra.run.smithi081.stdout:(84/120): libquadmath-8.4.1-1.el8.x86_64.rpm 11 MB/s | 169 kB 00:00 2023-10-07T08:40:57.464 INFO:teuthology.orchestra.run.smithi081.stdout:(85/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.6 MB/s | 38 kB 00:00 2023-10-07T08:40:57.472 INFO:teuthology.orchestra.run.smithi081.stdout:(86/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.8 MB/s | 86 kB 00:00 2023-10-07T08:40:57.474 INFO:teuthology.orchestra.run.smithi081.stdout:(87/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.9 MB/s | 58 kB 00:00 2023-10-07T08:40:57.480 INFO:teuthology.orchestra.run.smithi081.stdout:(88/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.9 MB/s | 47 kB 00:00 2023-10-07T08:40:57.491 INFO:teuthology.orchestra.run.smithi081.stdout:(89/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 28 MB/s | 559 kB 00:00 2023-10-07T08:40:57.498 INFO:teuthology.orchestra.run.smithi081.stdout:(90/120): libgfortran-8.4.1-1.el8.x86_64.rpm 26 MB/s | 639 kB 00:00 2023-10-07T08:40:57.501 INFO:teuthology.orchestra.run.smithi081.stdout:(91/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 3.3 MB/s | 70 kB 00:00 2023-10-07T08:40:57.508 INFO:teuthology.orchestra.run.smithi081.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 12 MB/s | 200 kB 00:00 2023-10-07T08:40:57.515 INFO:teuthology.orchestra.run.smithi081.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 5.7 MB/s | 97 kB 00:00 2023-10-07T08:40:57.521 INFO:teuthology.orchestra.run.smithi081.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 3.3 MB/s | 44 kB 00:00 2023-10-07T08:40:57.529 INFO:teuthology.orchestra.run.smithi081.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.9 MB/s | 27 kB 00:00 2023-10-07T08:40:57.537 INFO:teuthology.orchestra.run.smithi081.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 9.8 MB/s | 161 kB 00:00 2023-10-07T08:40:57.545 INFO:teuthology.orchestra.run.smithi081.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 19 MB/s | 320 kB 00:00 2023-10-07T08:40:57.556 INFO:teuthology.orchestra.run.smithi081.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 24 MB/s | 457 kB 00:00 2023-10-07T08:40:57.573 INFO:teuthology.orchestra.run.smithi081.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.4 MB/s | 39 kB 00:00 2023-10-07T08:40:57.596 INFO:teuthology.orchestra.run.smithi081.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 30 MB/s | 688 kB 00:00 2023-10-07T08:40:57.612 INFO:teuthology.orchestra.run.smithi081.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 16 MB/s | 259 kB 00:00 2023-10-07T08:40:57.633 INFO:teuthology.orchestra.run.smithi081.stdout:(102/120): python3-babel-2.5.1-5.el8.noarch.rpm 55 MB/s | 4.8 MB 00:00 2023-10-07T08:40:57.636 INFO:teuthology.orchestra.run.smithi081.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 9.2 MB/s | 225 kB 00:00 2023-10-07T08:40:57.648 INFO:teuthology.orchestra.run.smithi081.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 7.9 MB/s | 126 kB 00:00 2023-10-07T08:40:57.667 INFO:teuthology.orchestra.run.smithi081.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 9.9 MB/s | 187 kB 00:00 2023-10-07T08:40:57.687 INFO:teuthology.orchestra.run.smithi081.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 27 MB/s | 538 kB 00:00 2023-10-07T08:40:57.795 INFO:teuthology.orchestra.run.smithi081.stdout:(107/120): python3-scipy-1.0.0-20.module+el8.1. 50 MB/s | 15 MB 00:00 2023-10-07T08:40:57.799 INFO:teuthology.orchestra.run.smithi081.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 2.6 MB/s | 302 kB 00:00 2023-10-07T08:40:57.810 INFO:teuthology.orchestra.run.smithi081.stdout:(109/120): python3-numpy-1.14.3-9.el8.x86_64.rp 22 MB/s | 3.7 MB 00:00 2023-10-07T08:40:57.812 INFO:teuthology.orchestra.run.smithi081.stdout:(110/120): python3-mako-1.0.6-13.el8.noarch.rpm 9.2 MB/s | 157 kB 00:00 2023-10-07T08:40:57.813 INFO:teuthology.orchestra.run.smithi081.stdout:(111/120): python3-pyasn1-modules-0.3.7-6.el8.n 7.8 MB/s | 110 kB 00:00 2023-10-07T08:40:57.825 INFO:teuthology.orchestra.run.smithi081.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.5 MB/s | 20 kB 00:00 2023-10-07T08:40:57.829 INFO:teuthology.orchestra.run.smithi081.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 17 MB/s | 353 kB 00:00 2023-10-07T08:40:57.838 INFO:teuthology.orchestra.run.smithi081.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.1 MB/s | 54 kB 00:00 2023-10-07T08:40:57.841 INFO:teuthology.orchestra.run.smithi081.stdout:(115/120): libtool-2.4.6-25.el8.x86_64.rpm 25 MB/s | 709 kB 00:00 2023-10-07T08:40:57.866 INFO:teuthology.orchestra.run.smithi081.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 28 MB/s | 713 kB 00:00 2023-10-07T08:40:57.913 INFO:teuthology.orchestra.run.smithi081.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 57 MB/s | 4.7 MB 00:00 2023-10-07T08:40:57.931 INFO:teuthology.orchestra.run.smithi081.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 50 MB/s | 4.6 MB 00:00 2023-10-07T08:40:58.165 INFO:teuthology.orchestra.run.smithi081.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 12 MB/s | 3.5 MB 00:00 2023-10-07T08:40:58.358 INFO:teuthology.orchestra.run.smithi081.stdout:(120/120): librbd1-17.2.6-1320.g08cac018.el8.x8 8.1 MB/s | 3.6 MB 00:00 2023-10-07T08:40:58.361 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2023-10-07T08:40:58.361 INFO:teuthology.orchestra.run.smithi081.stdout:Total 18 MB/s | 202 MB 00:11 2023-10-07T08:40:58.409 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2023-10-07T08:40:58.523 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2023-10-07T08:40:58.523 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2023-10-07T08:40:59.621 INFO:teuthology.orchestra.run.smithi089.stdout:(120/120): ceph-test-17.2.6-1320.g08cac018.el8. 4.9 MB/s | 52 MB 00:10 2023-10-07T08:40:59.628 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-10-07T08:40:59.628 INFO:teuthology.orchestra.run.smithi089.stdout:Total 16 MB/s | 202 MB 00:12 2023-10-07T08:40:59.681 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-10-07T08:40:59.798 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-10-07T08:40:59.798 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-10-07T08:41:00.233 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2023-10-07T08:41:00.237 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2023-10-07T08:41:01.491 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-10-07T08:41:01.495 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-10-07T08:41:04.647 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2023-10-07T08:41:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-07T08:41:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-07T08:41:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-07T08:41:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-07T08:41:05.818 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-07T08:41:06.029 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-07T08:41:06.031 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-10-07T08:41:06.245 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-07T08:41:06.423 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-07T08:41:06.454 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-07T08:41:06.591 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-07T08:41:06.654 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-07T08:41:06.762 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-07T08:41:06.772 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-07T08:41:06.954 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-07T08:41:07.053 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-07T08:41:07.162 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-07T08:41:07.217 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-07T08:41:07.387 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-07T08:41:07.525 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-07T08:41:07.789 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-07T08:41:08.037 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-07T08:41:08.170 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-07T08:41:08.182 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-07T08:41:08.337 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-07T08:41:08.379 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-07T08:41:08.482 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-07T08:41:08.487 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-07T08:41:08.659 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-07T08:41:08.741 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-07T08:41:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-07T08:41:08.968 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-07T08:41:09.078 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-07T08:41:09.177 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-07T08:41:09.353 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-07T08:41:09.432 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-07T08:41:09.599 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-07T08:41:09.639 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-07T08:41:09.795 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-07T08:41:09.861 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-07T08:41:09.906 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-07T08:41:10.069 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-07T08:41:10.141 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-07T08:41:10.208 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-07T08:41:10.294 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-07T08:41:10.362 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-07T08:41:10.495 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-07T08:41:10.503 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-07T08:41:10.606 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-07T08:41:10.678 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-07T08:41:10.770 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-07T08:41:10.860 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-07T08:41:11.100 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-07T08:41:11.250 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-07T08:41:11.336 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-07T08:41:11.428 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-07T08:41:11.560 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-07T08:41:11.701 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-07T08:41:11.837 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-07T08:41:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-07T08:41:11.965 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-07T08:41:12.111 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-07T08:41:12.178 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-07T08:41:12.654 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-07T08:41:12.811 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-07T08:41:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-07T08:41:13.182 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-07T08:41:13.329 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-07T08:41:13.431 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-07T08:41:13.520 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-07T08:41:13.666 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-07T08:41:13.851 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-07T08:41:13.997 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-07T08:41:14.259 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-07T08:41:14.271 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-07T08:41:14.493 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-07T08:41:14.523 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-07T08:41:14.772 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-07T08:41:14.804 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-07T08:41:15.011 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-07T08:41:15.048 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-07T08:41:15.226 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-07T08:41:15.363 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-07T08:41:15.669 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-07T08:41:15.910 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-07T08:41:16.654 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-07T08:41:16.852 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-07T08:41:17.120 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-07T08:41:17.477 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-07T08:41:18.517 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-07T08:41:18.860 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-07T08:41:18.955 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-07T08:41:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-07T08:41:19.318 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-07T08:41:19.366 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-07T08:41:19.564 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-07T08:41:19.762 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-07T08:41:19.959 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-07T08:41:20.248 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-07T08:41:20.350 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-07T08:41:20.460 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-07T08:41:20.634 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-07T08:41:20.667 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-07T08:41:20.832 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-07T08:41:20.889 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-07T08:41:21.047 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-07T08:41:21.091 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-07T08:41:21.202 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-07T08:41:21.280 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-07T08:41:21.297 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-07T08:41:21.444 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-07T08:41:21.496 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-07T08:41:21.602 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-07T08:41:21.703 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-07T08:41:21.761 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-07T08:41:21.941 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-07T08:41:22.002 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-07T08:41:22.096 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-07T08:41:22.201 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-07T08:41:22.263 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-07T08:41:22.398 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-07T08:41:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-07T08:41:22.586 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-07T08:41:22.590 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-07T08:41:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-07T08:41:22.805 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-07T08:41:22.943 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-07T08:41:23.020 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-07T08:41:23.078 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-07T08:41:23.185 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-07T08:41:23.338 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-07T08:41:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-07T08:41:23.550 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-07T08:41:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-07T08:41:23.723 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-07T08:41:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-07T08:41:23.916 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-07T08:41:24.062 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-07T08:41:24.069 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-07T08:41:24.205 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-07T08:41:24.249 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-07T08:41:24.418 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-07T08:41:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-07T08:41:24.571 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-07T08:41:24.752 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-07T08:41:24.855 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-07T08:41:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-07T08:41:25.109 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-07T08:41:25.111 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-07T08:41:25.262 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-07T08:41:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-07T08:41:25.475 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-07T08:41:25.653 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-07T08:41:25.681 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-07T08:41:25.819 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-07T08:41:25.888 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-07T08:41:26.015 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-07T08:41:26.088 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-07T08:41:26.249 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-07T08:41:26.250 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-07T08:41:26.476 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-07T08:41:26.521 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-07T08:41:26.683 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-07T08:41:26.757 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-07T08:41:26.834 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-07T08:41:26.967 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-07T08:41:27.021 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-07T08:41:27.221 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-07T08:41:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-07T08:41:27.457 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-07T08:41:27.500 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-07T08:41:27.654 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-07T08:41:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-07T08:41:27.854 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-07T08:41:27.934 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-07T08:41:28.032 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-07T08:41:28.257 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-07T08:41:28.505 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-07T08:41:28.698 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-07T08:41:28.976 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-07T08:41:29.133 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-07T08:41:29.233 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-07T08:41:29.416 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-07T08:41:29.433 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-07T08:41:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-07T08:41:29.682 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-07T08:41:29.996 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-07T08:41:30.243 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-07T08:41:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-07T08:41:30.796 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-07T08:41:30.844 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-07T08:41:31.018 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-07T08:41:31.148 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-07T08:41:31.234 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-07T08:41:31.377 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-07T08:41:31.743 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-07T08:41:32.066 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-07T08:41:32.383 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-07T08:41:32.639 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-07T08:41:32.801 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-07T08:41:32.992 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-07T08:41:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-07T08:41:36.476 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-07T08:41:37.051 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-07T08:41:37.483 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-07T08:41:37.582 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-07T08:41:37.716 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-07T08:41:38.161 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-07T08:41:38.400 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-07T08:41:38.978 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-07T08:41:39.270 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-07T08:41:39.365 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-07T08:41:39.499 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-07T08:41:55.407 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-07T08:41:55.407 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2023-10-07T08:41:55.407 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2023-10-07T08:41:55.407 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /dev 2023-10-07T08:41:55.408 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /run 2023-10-07T08:41:55.408 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2023-10-07T08:41:55.408 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2023-10-07T08:41:55.408 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2023-10-07T08:41:55.408 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2023-10-07T08:41:55.409 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /dev 2023-10-07T08:41:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:41:55.773 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-07T08:41:57.262 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-07T08:41:57.328 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-07T08:41:57.328 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2023-10-07T08:41:57.328 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2023-10-07T08:41:57.328 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /dev 2023-10-07T08:41:57.328 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /run 2023-10-07T08:41:57.329 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2023-10-07T08:41:57.329 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2023-10-07T08:41:57.329 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2023-10-07T08:41:57.329 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2023-10-07T08:41:57.329 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /dev 2023-10-07T08:41:57.329 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:41:57.422 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-07T08:41:57.647 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-07T08:41:57.696 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-07T08:41:57.855 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-07T08:41:58.246 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-07T08:41:58.389 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-07T08:41:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-07T08:41:59.185 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-07T08:41:59.333 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-07T08:41:59.556 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-07T08:41:59.735 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-07T08:42:00.124 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-07T08:42:00.271 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-07T08:42:00.288 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-07T08:42:01.184 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-07T08:42:01.308 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-07T08:42:01.520 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-07T08:42:01.688 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-07T08:42:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-07T08:42:02.093 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-07T08:42:02.321 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-07T08:42:03.143 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-07T08:42:03.286 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-07T08:42:03.296 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-07T08:42:03.463 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-07T08:42:03.510 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-07T08:42:03.564 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-07T08:42:03.690 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-07T08:42:03.870 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-07T08:42:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-07T08:42:04.089 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-07T08:42:04.164 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-07T08:42:04.202 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-07T08:42:04.282 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-07T08:42:04.346 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-07T08:42:04.358 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-07T08:42:05.251 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-07T08:42:05.403 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-07T08:42:05.503 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-07T08:42:05.847 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-07T08:42:05.935 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-07T08:42:06.041 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-07T08:42:06.078 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-07T08:42:06.163 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-07T08:42:06.220 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-07T08:42:06.231 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-07T08:42:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-07T08:42:06.372 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-07T08:42:06.415 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-07T08:42:06.572 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-07T08:42:06.922 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-07T08:42:07.080 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-07T08:42:07.821 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-07T08:42:08.066 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-07T08:42:08.161 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-07T08:42:08.304 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-07T08:42:08.346 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-07T08:42:08.512 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-07T08:42:08.859 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-07T08:42:09.020 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-07T08:42:12.023 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-07T08:42:12.979 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-07T08:42:13.363 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-07T08:42:13.546 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-07T08:42:13.775 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-07T08:42:13.938 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-07T08:42:13.970 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-07T08:42:13.982 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-07T08:42:14.116 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-07T08:42:14.267 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-07T08:42:14.437 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-07T08:42:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-07T08:42:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-07T08:42:14.907 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-07T08:42:15.061 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-07T08:42:15.115 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-07T08:42:15.287 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-07T08:42:15.295 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-07T08:42:15.304 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-07T08:42:15.422 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-07T08:42:15.422 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-07T08:42:15.478 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-07T08:42:15.623 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-07T08:42:15.623 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-07T08:42:15.723 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-07T08:42:15.902 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-07T08:42:15.913 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-07T08:42:16.090 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-07T08:42:16.273 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-07T08:42:16.427 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-07T08:42:16.444 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-07T08:42:16.444 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-07T08:42:16.444 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-07T08:42:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-07T08:42:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-07T08:42:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-07T08:42:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-07T08:42:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-07T08:42:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-07T08:42:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-07T08:42:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-07T08:42:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-07T08:42:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-07T08:42:16.445 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-07T08:42:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-07T08:42:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-07T08:42:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-07T08:42:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-07T08:42:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-07T08:42:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-07T08:42:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-07T08:42:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-07T08:42:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-07T08:42:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-07T08:42:16.446 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-07T08:42:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-07T08:42:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-07T08:42:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-07T08:42:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-07T08:42:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-07T08:42:16.447 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-07T08:42:16.455 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-07T08:42:16.455 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-07T08:42:16.455 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-07T08:42:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-07T08:42:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-07T08:42:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-07T08:42:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-07T08:42:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-07T08:42:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-07T08:42:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-07T08:42:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-07T08:42:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-07T08:42:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-07T08:42:16.456 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-07T08:42:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-07T08:42:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-07T08:42:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-07T08:42:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-07T08:42:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-07T08:42:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-07T08:42:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-07T08:42:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-07T08:42:16.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-07T08:42:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-07T08:42:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-07T08:42:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-07T08:42:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-07T08:42:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-07T08:42:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-07T08:42:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-07T08:42:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-07T08:42:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-07T08:42:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-07T08:42:16.458 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-07T08:42:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-07T08:42:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-07T08:42:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-07T08:42:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-07T08:42:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-07T08:42:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-07T08:42:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-07T08:42:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-07T08:42:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-07T08:42:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-07T08:42:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-07T08:42:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-07T08:42:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-07T08:42:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-07T08:42:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-07T08:42:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-07T08:42:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-07T08:42:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-07T08:42:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-07T08:42:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-07T08:42:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-07T08:42:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-07T08:42:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-07T08:42:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-07T08:42:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-07T08:42:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-07T08:42:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-07T08:42:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-07T08:42:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-07T08:42:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-07T08:42:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-07T08:42:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-07T08:42:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-07T08:42:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-07T08:42:16.461 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-07T08:42:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-07T08:42:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-07T08:42:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-07T08:42:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-07T08:42:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-07T08:42:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-07T08:42:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-07T08:42:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-07T08:42:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-07T08:42:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-07T08:42:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-07T08:42:16.462 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-07T08:42:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-07T08:42:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-07T08:42:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-07T08:42:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-07T08:42:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-07T08:42:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-07T08:42:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-07T08:42:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-07T08:42:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-07T08:42:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-07T08:42:16.610 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-07T08:42:16.861 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-07T08:42:17.035 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-07T08:42:17.092 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-07T08:42:17.285 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-07T08:42:17.294 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-07T08:42:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-07T08:42:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-07T08:42:17.596 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-07T08:42:17.596 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-07T08:42:18.431 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-07T08:42:18.431 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-07T08:42:18.431 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-07T08:42:18.431 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-07T08:42:18.431 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-07T08:42:18.431 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-07T08:42:18.431 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-07T08:42:18.431 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-07T08:42:18.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-07T08:42:18.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-07T08:42:18.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-07T08:42:18.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-07T08:42:18.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-07T08:42:18.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-07T08:42:18.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-07T08:42:18.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-07T08:42:18.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-07T08:42:18.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-07T08:42:18.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-07T08:42:18.432 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-07T08:42:18.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-07T08:42:18.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-07T08:42:18.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-07T08:42:18.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-07T08:42:18.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-07T08:42:18.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-07T08:42:18.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-07T08:42:18.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-07T08:42:18.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-07T08:42:18.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-07T08:42:18.433 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-07T08:42:18.441 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-07T08:42:18.441 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-07T08:42:18.441 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-07T08:42:18.441 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-07T08:42:18.442 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-07T08:42:18.442 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-07T08:42:18.442 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-07T08:42:18.442 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-07T08:42:18.442 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-07T08:42:18.442 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-07T08:42:18.442 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-07T08:42:18.442 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-07T08:42:18.442 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-07T08:42:18.442 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-07T08:42:18.442 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-07T08:42:18.443 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-07T08:42:18.443 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-07T08:42:18.443 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-07T08:42:18.443 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-07T08:42:18.443 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-07T08:42:18.443 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-07T08:42:18.443 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-07T08:42:18.443 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-07T08:42:18.443 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-07T08:42:18.443 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-07T08:42:18.443 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-07T08:42:18.443 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-07T08:42:18.444 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-07T08:42:18.444 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-07T08:42:18.444 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-07T08:42:18.444 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-07T08:42:18.444 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-07T08:42:18.444 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-07T08:42:18.444 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-07T08:42:18.444 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-07T08:42:18.444 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-07T08:42:18.444 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-07T08:42:18.444 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-07T08:42:18.444 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-07T08:42:18.445 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-07T08:42:18.445 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-07T08:42:18.445 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-07T08:42:18.445 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-07T08:42:18.445 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-07T08:42:18.445 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-07T08:42:18.445 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-07T08:42:18.445 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-07T08:42:18.445 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-07T08:42:18.445 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-07T08:42:18.445 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-07T08:42:18.445 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-07T08:42:18.446 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-07T08:42:18.446 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-07T08:42:18.446 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-07T08:42:18.446 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-07T08:42:18.446 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-07T08:42:18.446 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-07T08:42:18.446 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-07T08:42:18.446 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-07T08:42:18.446 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-07T08:42:18.446 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-07T08:42:18.446 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-07T08:42:18.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-07T08:42:18.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-07T08:42:18.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-07T08:42:18.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-07T08:42:18.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-07T08:42:18.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-07T08:42:18.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-07T08:42:18.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-07T08:42:18.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-07T08:42:18.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-07T08:42:18.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-07T08:42:18.447 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-07T08:42:18.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-07T08:42:18.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-07T08:42:18.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-07T08:42:18.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-07T08:42:18.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-07T08:42:18.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-07T08:42:18.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-07T08:42:18.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-07T08:42:18.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-07T08:42:18.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-07T08:42:18.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-07T08:42:18.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-07T08:42:18.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-07T08:42:18.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-07T08:42:18.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-07T08:42:18.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-07T08:42:18.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-07T08:42:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-07T08:42:18.599 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:40 ago on Sat 07 Oct 2023 08:40:38 AM UTC. 2023-10-07T08:42:20.601 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-07T08:42:20.601 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:43 ago on Sat 07 Oct 2023 08:40:37 AM UTC. 2023-10-07T08:42:20.644 INFO:teuthology.orchestra.run.smithi081.stdout:Installed products updated. 2023-10-07T08:42:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:20.791 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2023-10-07T08:42:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.791 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2023-10-07T08:42:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.1-7.el8.noarch 2023-10-07T08:42:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.0.4-10.el8.x86_64 2023-10-07T08:42:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-07T08:42:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.1-9.el8.x86_64 2023-10-07T08:42:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-07T08:42:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-07T08:42:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: jq-1.5-12.el8.x86_64 2023-10-07T08:42:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-07T08:42:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-07T08:42:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-07T08:42:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-07T08:42:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-07T08:42:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-07T08:42:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-07T08:42:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-07T08:42:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-07T08:42:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-07T08:42:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-07T08:42:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-07T08:42:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-07T08:42:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-07T08:42:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-07T08:42:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-07T08:42:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-07T08:42:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-07T08:42:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-07T08:42:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-07T08:42:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-07T08:42:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-07T08:42:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-07T08:42:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-07T08:42:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-07T08:42:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-07T08:42:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-07T08:42:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-07T08:42:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-07T08:42:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-07T08:42:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-07T08:42:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-07T08:42:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-07T08:42:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-07T08:42:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-07T08:42:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-07T08:42:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-07T08:42:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-07T08:42:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-07T08:42:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-07T08:42:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-07T08:42:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-07T08:42:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-07T08:42:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-07T08:42:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-07T08:42:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-07T08:42:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-07T08:42:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-07T08:42:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-2.6-1.el8.noarch 2023-10-07T08:42:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-07T08:42:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-07T08:42:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-07T08:42:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-07T08:42:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-07T08:42:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-07T08:42:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-07T08:42:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-07T08:42:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-07T08:42:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-07T08:42:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-07T08:42:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-07T08:42:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-07T08:42:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-07T08:42:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-07T08:42:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-07T08:42:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-07T08:42:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-07T08:42:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-07T08:42:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-07T08:42:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-07T08:42:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-07T08:42:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-07T08:42:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-07T08:42:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:20.803 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2023-10-07T08:42:21.059 DEBUG:teuthology.parallel:result is None 2023-10-07T08:42:22.885 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-10-07T08:42:23.032 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:23.033 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2023-10-07T08:42:23.033 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.033 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.033 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-10-07T08:42:23.033 INFO:teuthology.orchestra.run.smithi089.stdout: automake-1.16.1-7.el8.noarch 2023-10-07T08:42:23.033 INFO:teuthology.orchestra.run.smithi089.stdout: bison-3.0.4-10.el8.x86_64 2023-10-07T08:42:23.033 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.033 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.033 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.033 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.034 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:23.034 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.034 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.034 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.034 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:23.034 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:23.034 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:23.034 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:23.034 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:23.034 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.034 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.034 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:23.035 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.035 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.035 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.035 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:23.035 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:23.035 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.035 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-07T08:42:23.035 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-07T08:42:23.035 INFO:teuthology.orchestra.run.smithi089.stdout: flex-2.6.1-9.el8.x86_64 2023-10-07T08:42:23.035 INFO:teuthology.orchestra.run.smithi089.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-07T08:42:23.035 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-07T08:42:23.036 INFO:teuthology.orchestra.run.smithi089.stdout: jq-1.5-12.el8.x86_64 2023-10-07T08:42:23.036 INFO:teuthology.orchestra.run.smithi089.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-07T08:42:23.036 INFO:teuthology.orchestra.run.smithi089.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-07T08:42:23.036 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-07T08:42:23.036 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.036 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.036 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.036 INFO:teuthology.orchestra.run.smithi089.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-07T08:42:23.036 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-07T08:42:23.036 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-07T08:42:23.036 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-07T08:42:23.036 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-07T08:42:23.037 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.037 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.037 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-07T08:42:23.037 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.037 INFO:teuthology.orchestra.run.smithi089.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-07T08:42:23.037 INFO:teuthology.orchestra.run.smithi089.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-07T08:42:23.037 INFO:teuthology.orchestra.run.smithi089.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-07T08:42:23.037 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-07T08:42:23.037 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-07T08:42:23.037 INFO:teuthology.orchestra.run.smithi089.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-07T08:42:23.037 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-07T08:42:23.038 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-07T08:42:23.038 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-07T08:42:23.038 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-07T08:42:23.038 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-07T08:42:23.038 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-07T08:42:23.038 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-07T08:42:23.038 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-07T08:42:23.038 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-07T08:42:23.039 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-07T08:42:23.039 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-07T08:42:23.039 INFO:teuthology.orchestra.run.smithi089.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-07T08:42:23.039 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-07T08:42:23.039 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.039 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.039 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.039 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-07T08:42:23.039 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-07T08:42:23.039 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-07T08:42:23.039 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-07T08:42:23.039 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-07T08:42:23.040 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-07T08:42:23.040 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-07T08:42:23.040 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-07T08:42:23.040 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-07T08:42:23.040 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-07T08:42:23.040 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-07T08:42:23.040 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-07T08:42:23.040 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-07T08:42:23.040 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-07T08:42:23.040 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-07T08:42:23.040 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-07T08:42:23.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-07T08:42:23.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-07T08:42:23.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-07T08:42:23.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-07T08:42:23.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-2.6-1.el8.noarch 2023-10-07T08:42:23.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-07T08:42:23.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-07T08:42:23.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-07T08:42:23.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-07T08:42:23.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-07T08:42:23.042 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-07T08:42:23.042 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.042 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-07T08:42:23.042 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-07T08:42:23.042 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-07T08:42:23.042 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-07T08:42:23.042 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-07T08:42:23.042 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-07T08:42:23.042 INFO:teuthology.orchestra.run.smithi089.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-07T08:42:23.042 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-07T08:42:23.042 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-07T08:42:23.042 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-07T08:42:23.043 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-07T08:42:23.043 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-07T08:42:23.043 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-07T08:42:23.043 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.043 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.043 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-07T08:42:23.043 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-07T08:42:23.043 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-07T08:42:23.043 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-07T08:42:23.043 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-07T08:42:23.044 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-07T08:42:23.044 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:23.044 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-10-07T08:42:23.280 DEBUG:teuthology.parallel:result is None 2023-10-07T08:42:23.281 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-07T08:42:23.423 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-07T08:42:23.448 INFO:teuthology.orchestra.run.smithi081.stdout:17.2.6-1320.g08cac018.el8 2023-10-07T08:42:23.448 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-07T08:42:23.449 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-07T08:42:23.449 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-07T08:42:23.590 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-07T08:42:23.611 INFO:teuthology.orchestra.run.smithi089.stdout:17.2.6-1320.g08cac018.el8 2023-10-07T08:42:23.611 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-07T08:42:23.612 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-07T08:42:23.612 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-07T08:42:23.612 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:23.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-07T08:42:23.655 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:23.655 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-07T08:42:23.693 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-07T08:42:23.693 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:23.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2023-10-07T08:42:23.722 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-07T08:42:23.788 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:23.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2023-10-07T08:42:23.812 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-07T08:42:23.876 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-07T08:42:23.876 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:23.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-07T08:42:23.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-07T08:42:23.967 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:23.967 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-07T08:42:23.991 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-07T08:42:24.054 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-07T08:42:24.055 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:24.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2023-10-07T08:42:24.079 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-07T08:42:24.144 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:24.144 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2023-10-07T08:42:24.168 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-07T08:42:24.232 INFO:teuthology.run_tasks:Running task ceph... 2023-10-07T08:42:24.293 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-07T08:42:24.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2023-10-07T08:42:24.296 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2023-10-07T08:42:24.319 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-07T08:42:24.319 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-07T08:42:24.360 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-07T08:42:24.384 INFO:tasks.ceph:Creating extra log directories... 2023-10-07T08:42:24.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-07T08:42:24.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-07T08:42:24.456 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-07T08:42:24.456 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-07T08:42:24.456 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-07T08:42:24.456 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:24.456 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-07T08:42:24.503 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-07T08:42:24.613 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-07T08:42:24.637 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:24.637 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-07T08:42:24.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-07T08:42:24.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-07T08:42:24.805 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-07T08:42:24.805 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-07T08:42:24.806 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273', 'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7416273', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4726, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBElw/sNKbAi6Re7S4J5mVhmqROP/WipIfjfAHplOVNjhPtKrO3UAC3ISPWFRULacki/Jpc40Jwkgf5VOHxeQFKo=', 'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBxW+7hJ4TMaHcy+kLXQTeuF6omXcB7/y1HwV4fhPoIIyk8MshvUK9K51g6IIDrBgosrywd/XASJBUlUyG1ZU+4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-07_00:40:05', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-07T08:42:24.806 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-07T08:42:24.808 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-07T08:42:24.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2023-10-07T08:42:24.863 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2023-10-07T08:42:24.918 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:24.918 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2023-10-07T08:42:24.940 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-07T08:42:24.940 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2023-10-07T08:42:24.995 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-07T08:42:24.995 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T08:42:24.995 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 220333 Links: 1 2023-10-07T08:42:24.995 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T08:42:24.995 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T08:42:24.995 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-10-07 08:42:16.061271310 +0000 2023-10-07T08:42:24.995 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-07 08:39:54.085029895 +0000 2023-10-07T08:42:24.995 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-07 08:39:54.085029895 +0000 2023-10-07T08:42:24.995 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-10-07T08:42:24.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-07T08:42:25.058 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-10-07T08:42:25.058 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-10-07T08:42:25.058 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000261024 s, 2.0 MB/s 2023-10-07T08:42:25.059 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-07T08:42:25.115 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2023-10-07T08:42:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-07T08:42:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T08:42:25.170 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 218947 Links: 1 2023-10-07T08:42:25.170 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T08:42:25.170 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T08:42:25.170 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-10-07 08:42:16.061271310 +0000 2023-10-07T08:42:25.170 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-07 08:39:54.577020598 +0000 2023-10-07T08:42:25.170 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-07 08:39:54.577020598 +0000 2023-10-07T08:42:25.171 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-10-07T08:42:25.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-07T08:42:25.232 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-10-07T08:42:25.233 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-10-07T08:42:25.233 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000262834 s, 1.9 MB/s 2023-10-07T08:42:25.234 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-07T08:42:25.289 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2023-10-07T08:42:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-07T08:42:25.345 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T08:42:25.345 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 222234 Links: 1 2023-10-07T08:42:25.345 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T08:42:25.345 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T08:42:25.345 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-10-07 08:42:16.061271310 +0000 2023-10-07T08:42:25.345 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-07 08:39:55.070011284 +0000 2023-10-07T08:42:25.345 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-07 08:39:55.070011284 +0000 2023-10-07T08:42:25.345 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-10-07T08:42:25.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-07T08:42:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-10-07T08:42:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-10-07T08:42:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000233446 s, 2.2 MB/s 2023-10-07T08:42:25.409 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-07T08:42:25.464 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2023-10-07T08:42:25.519 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-07T08:42:25.519 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T08:42:25.519 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 220455 Links: 1 2023-10-07T08:42:25.519 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T08:42:25.519 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T08:42:25.519 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-10-07 08:42:16.061271310 +0000 2023-10-07T08:42:25.519 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-07 08:39:55.561002006 +0000 2023-10-07T08:42:25.520 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-07 08:39:55.561002006 +0000 2023-10-07T08:42:25.520 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-10-07T08:42:25.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-07T08:42:25.582 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-10-07T08:42:25.582 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-10-07T08:42:25.582 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000220864 s, 2.3 MB/s 2023-10-07T08:42:25.583 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-07T08:42:25.638 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-07T08:42:25.638 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:25.639 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2023-10-07T08:42:25.653 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-07T08:42:25.653 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2023-10-07T08:42:25.709 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-07T08:42:25.709 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T08:42:25.709 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 222327 Links: 1 2023-10-07T08:42:25.709 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T08:42:25.709 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T08:42:25.709 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-10-07 08:42:18.038002120 +0000 2023-10-07T08:42:25.709 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-10-07 08:39:54.086416439 +0000 2023-10-07T08:42:25.709 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-10-07 08:39:54.086416439 +0000 2023-10-07T08:42:25.709 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-10-07T08:42:25.710 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-07T08:42:25.772 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-10-07T08:42:25.772 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-10-07T08:42:25.772 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000243593 s, 2.1 MB/s 2023-10-07T08:42:25.773 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-07T08:42:25.829 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2023-10-07T08:42:25.884 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-07T08:42:25.885 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T08:42:25.885 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 220619 Links: 1 2023-10-07T08:42:25.885 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T08:42:25.885 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T08:42:25.885 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-10-07 08:42:18.039002098 +0000 2023-10-07T08:42:25.885 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-10-07 08:39:54.611404842 +0000 2023-10-07T08:42:25.885 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-10-07 08:39:54.611404842 +0000 2023-10-07T08:42:25.885 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-10-07T08:42:25.885 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-07T08:42:25.947 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-10-07T08:42:25.947 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-10-07T08:42:25.947 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000224876 s, 2.3 MB/s 2023-10-07T08:42:25.948 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-07T08:42:26.003 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2023-10-07T08:42:26.059 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-07T08:42:26.059 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T08:42:26.059 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 220692 Links: 1 2023-10-07T08:42:26.059 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T08:42:26.060 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T08:42:26.060 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-10-07 08:42:18.039002098 +0000 2023-10-07T08:42:26.060 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-10-07 08:39:55.129393399 +0000 2023-10-07T08:42:26.060 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-10-07 08:39:55.129393399 +0000 2023-10-07T08:42:26.060 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-10-07T08:42:26.061 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-07T08:42:26.122 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-10-07T08:42:26.122 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-10-07T08:42:26.122 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000231283 s, 2.2 MB/s 2023-10-07T08:42:26.123 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-07T08:42:26.179 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2023-10-07T08:42:26.234 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-07T08:42:26.234 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-07T08:42:26.234 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 220834 Links: 1 2023-10-07T08:42:26.235 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-07T08:42:26.235 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-10-07T08:42:26.235 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-10-07 08:42:18.039002098 +0000 2023-10-07T08:42:26.235 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-10-07 08:39:55.622382509 +0000 2023-10-07T08:42:26.235 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-10-07 08:39:55.622382509 +0000 2023-10-07T08:42:26.235 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-10-07T08:42:26.237 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-07T08:42:26.297 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-10-07T08:42:26.297 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-10-07T08:42:26.297 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.00019588 s, 2.6 MB/s 2023-10-07T08:42:26.298 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-07T08:42:26.354 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-07T08:42:26.354 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-07T08:42:26.354 INFO:tasks.ceph:Generating config... 2023-10-07T08:42:26.355 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-07T08:42:26.355 INFO:tasks.ceph:[client] debug client = 20 2023-10-07T08:42:26.356 INFO:tasks.ceph:[client] debug ms = 1 2023-10-07T08:42:26.356 INFO:tasks.ceph:[client] pid file = 2023-10-07T08:42:26.356 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-07T08:42:26.356 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-07T08:42:26.356 INFO:tasks.ceph:[client.0] debug client = 20 2023-10-07T08:42:26.356 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-10-07T08:42:26.356 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-10-07T08:42:26.356 INFO:tasks.ceph:[client.1] debug client = 20 2023-10-07T08:42:26.356 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-10-07T08:42:26.356 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-10-07T08:42:26.356 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-07T08:42:26.357 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-07T08:42:26.357 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-07T08:42:26.357 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-07T08:42:26.357 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-07T08:42:26.357 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-07T08:42:26.357 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-07T08:42:26.357 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-07T08:42:26.357 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-07T08:42:26.357 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-07T08:42:26.357 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-07T08:42:26.357 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-07T08:42:26.358 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-07T08:42:26.358 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-07T08:42:26.358 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-07T08:42:26.358 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-07T08:42:26.358 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-10-07T08:42:26.358 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-10-07T08:42:26.358 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-10-07T08:42:26.358 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-07T08:42:26.358 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-07T08:42:26.358 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-07T08:42:26.358 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-07T08:42:26.358 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-07T08:42:26.359 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-07T08:42:26.359 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-07T08:42:26.359 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-07T08:42:26.359 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-07T08:42:26.359 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-07T08:42:26.359 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-10-07T08:42:26.359 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-07T08:42:26.359 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-07T08:42:26.359 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-07T08:42:26.359 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-10-07T08:42:26.359 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-10-07T08:42:26.359 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-10-07T08:42:26.360 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-07T08:42:26.360 INFO:tasks.ceph:Setting up mon.a... 2023-10-07T08:42:26.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-07T08:42:26.412 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2023-10-07T08:42:26.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-07T08:42:26.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-07T08:42:26.485 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.81'), ('mon.b', '172.21.15.89'), ('mon.c', '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]')] 2023-10-07T08:42:26.485 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.81,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-07T08:42:26.486 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:26.486 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-07T08:42:26.540 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --add b 172.21.15.89 --addv c '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:42:26.622 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:42:26.623 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid f2fc6535-cadc-4a0b-bdad-da2d602c784a 2023-10-07T08:42:26.623 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = octopus 2023-10-07T08:42:26.623 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2023-10-07T08:42:26.623 INFO:teuthology.orchestra.run.smithi081.stdout:fsid f2fc6535-cadc-4a0b-bdad-da2d602c784a 2023-10-07T08:42:26.623 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2023-10-07T08:42:26.622744+0000 2023-10-07T08:42:26.623 INFO:teuthology.orchestra.run.smithi081.stdout:created 2023-10-07T08:42:26.622744+0000 2023-10-07T08:42:26.623 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 15 (octopus) 2023-10-07T08:42:26.623 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2023-10-07T08:42:26.623 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2023-10-07T08:42:26.623 INFO:teuthology.orchestra.run.smithi081.stdout:1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2023-10-07T08:42:26.623 INFO:teuthology.orchestra.run.smithi081.stdout:2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2023-10-07T08:42:26.624 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-07T08:42:26.625 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-07T08:42:26.679 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f2fc6535-cadc-4a0b-bdad-da2d602c784a... 2023-10-07T08:42:26.681 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-07T08:42:26.722 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-07T08:42:26.762 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2023-10-07T08:42:26.762 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2023-10-07T08:42:26.762 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-07T08:42:26.762 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2023-10-07T08:42:26.762 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.762 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2023-10-07T08:42:26.762 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.762 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2023-10-07T08:42:26.762 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.762 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2023-10-07T08:42:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2023-10-07T08:42:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2023-10-07T08:42:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2023-10-07T08:42:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-07T08:42:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2023-10-07T08:42:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2023-10-07T08:42:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-07T08:42:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.763 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2023-10-07T08:42:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2023-10-07T08:42:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2023-10-07T08:42:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2023-10-07T08:42:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2023-10-07T08:42:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2023-10-07T08:42:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2023-10-07T08:42:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2023-10-07T08:42:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-07T08:42:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-07T08:42:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2023-10-07T08:42:26.764 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-07T08:42:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2023-10-07T08:42:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2023-10-07T08:42:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2023-10-07T08:42:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2023-10-07T08:42:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2023-10-07T08:42:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2023-10-07T08:42:26.765 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on skipped message = False 2023-10-07T08:42:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = f2fc6535-cadc-4a0b-bdad-da2d602c784a 2023-10-07T08:42:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.766 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2023-10-07T08:42:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2023-10-07T08:42:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2023-10-07T08:42:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2023-10-07T08:42:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2023-10-07T08:42:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2023-10-07T08:42:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2023-10-07T08:42:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2023-10-07T08:42:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2023-10-07T08:42:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2023-10-07T08:42:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2023-10-07T08:42:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2023-10-07T08:42:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2023-10-07T08:42:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2023-10-07T08:42:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2023-10-07T08:42:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2023-10-07T08:42:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2023-10-07T08:42:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2023-10-07T08:42:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2023-10-07T08:42:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: bdev async discard = True 2023-10-07T08:42:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: bdev enable discard = True 2023-10-07T08:42:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore allocator = bitmap 2023-10-07T08:42:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2023-10-07T08:42:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2023-10-07T08:42:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 1/20 2023-10-07T08:42:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 1/20 2023-10-07T08:42:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-07T08:42:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2023-10-07T08:42:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 4/10 2023-10-07T08:42:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: memstore device bytes = 200000000 2023-10-07T08:42:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2023-10-07T08:42:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2023-10-07T08:42:26.769 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2023-10-07T08:42:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 1.0 2023-10-07T08:42:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: osd mon report interval = 5 2023-10-07T08:42:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = memstore 2023-10-07T08:42:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-10-07T08:42:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.770 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2023-10-07T08:42:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-07T08:42:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2023-10-07T08:42:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-10-07T08:42:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-10-07T08:42:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-10-07T08:42:26.770 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-10-07T08:42:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2023-10-07T08:42:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.771 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2023-10-07T08:42:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-07T08:42:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-10-07T08:42:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2023-10-07T08:42:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-10-07T08:42:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2023-10-07T08:42:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2023-10-07T08:42:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-10-07T08:42:26.771 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2023-10-07T08:42:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2023-10-07T08:42:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-10-07T08:42:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-07T08:42:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2023-10-07T08:42:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2023-10-07T08:42:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2023-10-07T08:42:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-07T08:42:26.772 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-07T08:42:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2023-10-07T08:42:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2023-10-07T08:42:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2023-10-07T08:42:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: mon op complaint time = 120 2023-10-07T08:42:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull ratio = 0.6 2023-10-07T08:42:26.773 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.7 2023-10-07T08:42:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.6 2023-10-07T08:42:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:26.774 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2023-10-07T08:42:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2023-10-07T08:42:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2023-10-07T08:42:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2023-10-07T08:42:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-07T08:42:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-07T08:42:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 600 2023-10-07T08:42:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2023-10-07T08:42:26.774 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-07T08:42:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = "" 2023-10-07T08:42:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-10-07T08:42:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-10-07T08:42:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2023-10-07T08:42:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2023-10-07T08:42:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2023-10-07T08:42:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-10-07T08:42:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2023-10-07T08:42:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-10-07T08:42:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2023-10-07T08:42:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2023-10-07T08:42:26.775 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2023-10-07T08:42:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: debug objectcacher = 20 2023-10-07T08:42:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: debug objecter = 20 2023-10-07T08:42:26.776 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2023-10-07T08:42:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2023-10-07T08:42:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: debug objectcacher = 20 2023-10-07T08:42:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: debug objecter = 20 2023-10-07T08:42:26.776 INFO:teuthology.orchestra.run.smithi081.stdout:[mds] 2023-10-07T08:42:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds = 20 2023-10-07T08:42:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-07T08:42:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug frag = True 2023-10-07T08:42:26.776 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug scatterstat = True 2023-10-07T08:42:26.777 INFO:teuthology.orchestra.run.smithi081.stdout: mds op complaint time = 180 2023-10-07T08:42:26.777 INFO:teuthology.orchestra.run.smithi081.stdout: mds verify scatter = True 2023-10-07T08:42:26.777 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-10-07T08:42:26.777 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-10-07T08:42:26.777 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-10-07T08:42:26.779 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2023-10-07T08:42:26.779 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2023-10-07T08:42:26.779 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-07T08:42:26.779 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2023-10-07T08:42:26.779 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.779 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2023-10-07T08:42:26.779 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.779 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2023-10-07T08:42:26.779 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.779 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2023-10-07T08:42:26.779 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2023-10-07T08:42:26.780 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.780 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2023-10-07T08:42:26.780 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2023-10-07T08:42:26.780 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.780 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-07T08:42:26.780 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2023-10-07T08:42:26.780 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.780 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2023-10-07T08:42:26.780 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-07T08:42:26.781 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.781 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2023-10-07T08:42:26.781 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.781 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2023-10-07T08:42:26.781 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2023-10-07T08:42:26.781 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2023-10-07T08:42:26.781 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2023-10-07T08:42:26.781 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2023-10-07T08:42:26.781 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2023-10-07T08:42:26.781 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2023-10-07T08:42:26.781 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-07T08:42:26.781 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-07T08:42:26.782 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2023-10-07T08:42:26.782 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.782 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-07T08:42:26.782 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.782 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2023-10-07T08:42:26.782 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.782 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2023-10-07T08:42:26.782 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.782 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2023-10-07T08:42:26.782 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2023-10-07T08:42:26.782 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2023-10-07T08:42:26.782 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.81,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2023-10-07T08:42:26.783 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on skipped message = False 2023-10-07T08:42:26.783 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = f2fc6535-cadc-4a0b-bdad-da2d602c784a 2023-10-07T08:42:26.783 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.783 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2023-10-07T08:42:26.783 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2023-10-07T08:42:26.783 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.783 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2023-10-07T08:42:26.783 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2023-10-07T08:42:26.783 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2023-10-07T08:42:26.783 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.783 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2023-10-07T08:42:26.784 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2023-10-07T08:42:26.784 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.784 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2023-10-07T08:42:26.784 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2023-10-07T08:42:26.784 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2023-10-07T08:42:26.784 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.784 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2023-10-07T08:42:26.784 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2023-10-07T08:42:26.784 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.784 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2023-10-07T08:42:26.784 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.784 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2023-10-07T08:42:26.785 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.785 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2023-10-07T08:42:26.785 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.785 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2023-10-07T08:42:26.785 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2023-10-07T08:42:26.785 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.785 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2023-10-07T08:42:26.785 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2023-10-07T08:42:26.785 INFO:teuthology.orchestra.run.smithi089.stdout: bdev async discard = True 2023-10-07T08:42:26.785 INFO:teuthology.orchestra.run.smithi089.stdout: bdev enable discard = True 2023-10-07T08:42:26.785 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore allocator = bitmap 2023-10-07T08:42:26.785 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2023-10-07T08:42:26.786 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2023-10-07T08:42:26.786 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 1/20 2023-10-07T08:42:26.786 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 1/20 2023-10-07T08:42:26.786 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-07T08:42:26.786 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2023-10-07T08:42:26.786 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 4/10 2023-10-07T08:42:26.786 INFO:teuthology.orchestra.run.smithi089.stdout: memstore device bytes = 200000000 2023-10-07T08:42:26.786 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2023-10-07T08:42:26.786 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2023-10-07T08:42:26.786 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2023-10-07T08:42:26.786 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 1.0 2023-10-07T08:42:26.787 INFO:teuthology.orchestra.run.smithi089.stdout: osd mon report interval = 5 2023-10-07T08:42:26.787 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = memstore 2023-10-07T08:42:26.787 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-10-07T08:42:26.787 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.787 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2023-10-07T08:42:26.787 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-07T08:42:26.787 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2023-10-07T08:42:26.787 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-10-07T08:42:26.787 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-10-07T08:42:26.787 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-10-07T08:42:26.787 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-10-07T08:42:26.787 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2023-10-07T08:42:26.788 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.788 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2023-10-07T08:42:26.788 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-07T08:42:26.788 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-10-07T08:42:26.788 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2023-10-07T08:42:26.788 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-10-07T08:42:26.788 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2023-10-07T08:42:26.788 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2023-10-07T08:42:26.788 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-10-07T08:42:26.788 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2023-10-07T08:42:26.788 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2023-10-07T08:42:26.788 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-10-07T08:42:26.788 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.789 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-07T08:42:26.789 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2023-10-07T08:42:26.789 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2023-10-07T08:42:26.789 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.789 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2023-10-07T08:42:26.789 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-07T08:42:26.789 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-07T08:42:26.789 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.789 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2023-10-07T08:42:26.789 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2023-10-07T08:42:26.789 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.789 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2023-10-07T08:42:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: mon op complaint time = 120 2023-10-07T08:42:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull ratio = 0.6 2023-10-07T08:42:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.7 2023-10-07T08:42:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.6 2023-10-07T08:42:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-07T08:42:26.790 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2023-10-07T08:42:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2023-10-07T08:42:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2023-10-07T08:42:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2023-10-07T08:42:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-07T08:42:26.790 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-07T08:42:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: client mount timeout = 600 2023-10-07T08:42:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2023-10-07T08:42:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-07T08:42:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = "" 2023-10-07T08:42:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-10-07T08:42:26.791 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-10-07T08:42:26.791 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2023-10-07T08:42:26.791 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2023-10-07T08:42:26.791 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2023-10-07T08:42:26.791 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-10-07T08:42:26.791 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-10-07T08:42:26.791 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-10-07T08:42:26.791 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.d] 2023-10-07T08:42:26.792 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-10-07T08:42:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2023-10-07T08:42:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: debug objectcacher = 20 2023-10-07T08:42:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: debug objecter = 20 2023-10-07T08:42:26.792 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2023-10-07T08:42:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2023-10-07T08:42:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: debug objectcacher = 20 2023-10-07T08:42:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: debug objecter = 20 2023-10-07T08:42:26.792 INFO:teuthology.orchestra.run.smithi089.stdout:[mds] 2023-10-07T08:42:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds = 20 2023-10-07T08:42:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-07T08:42:26.792 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug frag = True 2023-10-07T08:42:26.793 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug scatterstat = True 2023-10-07T08:42:26.793 INFO:teuthology.orchestra.run.smithi089.stdout: mds op complaint time = 180 2023-10-07T08:42:26.793 INFO:teuthology.orchestra.run.smithi089.stdout: mds verify scatter = True 2023-10-07T08:42:26.793 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-10-07T08:42:26.793 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-10-07T08:42:26.793 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-10-07T08:42:26.793 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-07T08:42:26.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-07T08:42:26.869 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-07T08:42:26.870 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:26.870 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-07T08:42:26.884 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:26.884 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-07T08:42:26.938 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:42:26.939 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:26.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-07T08:42:26.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-07T08:42:27.013 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:27.013 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:42:27.068 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:42:27.068 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:27.068 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-07T08:42:27.068 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-07T08:42:27.102 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:27.102 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:42:27.157 INFO:tasks.ceph:Setting up mon nodes... 2023-10-07T08:42:27.157 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-07T08:42:27.157 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-07T08:42:27.204 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-07T08:42:27.206 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-07T08:42:27.267 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-07T08:42:27.269 INFO:tasks.ceph:Setting up mds nodes... 2023-10-07T08:42:27.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-07T08:42:27.317 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-07T08:42:27.320 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-07T08:42:27.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-07T08:42:27.431 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-07T08:42:27.433 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-07T08:42:27.457 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-07T08:42:27.505 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-07T08:42:27.507 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-07T08:42:27.531 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-07T08:42:27.618 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-07T08:42:27.620 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-07T08:42:27.644 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-07T08:42:27.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-07T08:42:27.682 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-07T08:42:27.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-07T08:42:27.772 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-07T08:42:27.784 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-07T08:42:27.821 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-07T08:42:27.834 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-07T08:42:27.911 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-07T08:42:27.923 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-07T08:42:27.923 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-07T08:42:27.924 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-07T08:42:27.948 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-07T08:42:27.948 INFO:tasks.ceph:role: osd.0 2023-10-07T08:42:27.948 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:42:27.948 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-07T08:42:28.020 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-07T08:42:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-07T08:42:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-07T08:42:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2023-10-07T08:42:28.020 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-07T08:42:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-10-07T08:42:28.020 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-07T08:42:28.020 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-07T08:42:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-07T08:42:28.020 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-07T08:42:28.451 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-10-07T08:42:28.453 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-10-07T08:42:28.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-07T08:42:28.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-07T08:42:28.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-07T08:42:28.684 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-07T08:42:28.685 INFO:tasks.ceph:role: osd.1 2023-10-07T08:42:28.685 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:42:28.685 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-07T08:42:28.756 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-07T08:42:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-07T08:42:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-07T08:42:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2023-10-07T08:42:28.757 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-07T08:42:28.757 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-10-07T08:42:28.757 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-07T08:42:28.757 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-07T08:42:28.757 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-07T08:42:28.757 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-07T08:42:29.184 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-10-07T08:42:29.185 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-10-07T08:42:29.185 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-07T08:42:29.267 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-07T08:42:29.336 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-07T08:42:29.400 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-07T08:42:29.400 INFO:tasks.ceph:role: osd.2 2023-10-07T08:42:29.400 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:42:29.400 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-07T08:42:29.471 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-07T08:42:29.471 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-07T08:42:29.471 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-07T08:42:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2023-10-07T08:42:29.472 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-07T08:42:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-10-07T08:42:29.472 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-07T08:42:29.472 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-07T08:42:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-07T08:42:29.472 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-07T08:42:29.929 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-10-07T08:42:29.931 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-10-07T08:42:29.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-07T08:42:30.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-07T08:42:30.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-07T08:42:30.139 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-07T08:42:30.139 INFO:tasks.ceph:role: osd.3 2023-10-07T08:42:30.139 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:42:30.140 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-07T08:42:30.211 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-07T08:42:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-07T08:42:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-07T08:42:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2023-10-07T08:42:30.211 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-07T08:42:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-10-07T08:42:30.212 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-07T08:42:30.212 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-07T08:42:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-07T08:42:30.212 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-07T08:42:30.655 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-10-07T08:42:30.657 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-10-07T08:42:30.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-07T08:42:30.825 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-07T08:42:30.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:42:30.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:30.943+0000 7fe8e16e1540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-07T08:42:30.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:30.946+0000 7fe8e16e1540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-07T08:42:30.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:30.946+0000 7fe8e16e1540 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-10-07T08:42:30.963 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-07T08:42:30.988 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:42:31.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:31.068+0000 7f7df334f540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-07T08:42:31.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:31.071+0000 7f7df334f540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-07T08:42:31.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:31.072+0000 7f7df334f540 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-10-07T08:42:31.085 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-07T08:42:31.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:42:31.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:31.228+0000 7fc1a6f6b540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-07T08:42:31.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:31.232+0000 7fc1a6f6b540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-07T08:42:31.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:31.236+0000 7fc1a6f6b540 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-10-07T08:42:31.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-07T08:42:31.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:42:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:31.393+0000 7f5357d69540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-07T08:42:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:31.393+0000 7f5357d69540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-07T08:42:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:31.394+0000 7f5357d69540 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-10-07T08:42:31.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-07T08:42:31.464 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-07T08:42:31.494 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-07T08:42:31.494 INFO:tasks.ceph:role: osd.4 2023-10-07T08:42:31.494 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:42:31.494 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-07T08:42:31.570 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-07T08:42:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-07T08:42:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-07T08:42:31.570 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 2023-10-07T08:42:31.571 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-07T08:42:31.571 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-10-07T08:42:31.571 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-07T08:42:31.571 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-07T08:42:31.571 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-07T08:42:31.571 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-07T08:42:32.013 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-10-07T08:42:32.015 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-10-07T08:42:32.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-07T08:42:32.199 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-07T08:42:32.233 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-07T08:42:32.298 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-07T08:42:32.298 INFO:tasks.ceph:role: osd.5 2023-10-07T08:42:32.299 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:42:32.299 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-07T08:42:32.370 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-07T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-07T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-07T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 2023-10-07T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-07T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-10-07T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-07T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-07T08:42:32.371 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-07T08:42:32.372 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-07T08:42:32.789 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-10-07T08:42:32.791 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-10-07T08:42:32.791 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-07T08:42:32.897 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-07T08:42:32.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-07T08:42:32.991 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-07T08:42:32.991 INFO:tasks.ceph:role: osd.6 2023-10-07T08:42:32.991 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:42:32.992 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-07T08:42:33.063 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-07T08:42:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-07T08:42:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-07T08:42:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 2023-10-07T08:42:33.064 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-07T08:42:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-10-07T08:42:33.064 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-07T08:42:33.064 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-07T08:42:33.064 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-07T08:42:33.064 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-07T08:42:33.511 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-10-07T08:42:33.512 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-10-07T08:42:33.512 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-07T08:42:33.639 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-07T08:42:33.670 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-07T08:42:33.735 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-07T08:42:33.735 INFO:tasks.ceph:role: osd.7 2023-10-07T08:42:33.735 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:42:33.735 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-07T08:42:33.808 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-07T08:42:33.808 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-07T08:42:33.808 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-07T08:42:33.808 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 2023-10-07T08:42:33.808 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-07T08:42:33.809 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-10-07T08:42:33.809 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-07T08:42:33.809 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-07T08:42:33.809 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-07T08:42:33.809 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-07T08:42:34.254 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-10-07T08:42:34.255 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-10-07T08:42:34.256 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-07T08:42:34.442 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-07T08:42:34.473 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:42:34.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:34.558+0000 7f2642960540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-07T08:42:34.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:34.558+0000 7f2642960540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-07T08:42:34.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:34.558+0000 7f2642960540 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-10-07T08:42:34.571 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-07T08:42:34.594 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:42:34.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:34.673+0000 7f8c2c041540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-07T08:42:34.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:34.673+0000 7f8c2c041540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-07T08:42:34.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:34.673+0000 7f8c2c041540 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-10-07T08:42:34.681 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-07T08:42:34.746 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:42:34.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:34.824+0000 7fb20d0dc540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-07T08:42:34.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:34.825+0000 7fb20d0dc540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-07T08:42:34.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:34.825+0000 7fb20d0dc540 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-10-07T08:42:34.835 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-07T08:42:34.899 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:42:34.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:34.977+0000 7f52de672540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-07T08:42:34.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:34.977+0000 7f52de672540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-07T08:42:34.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:34.978+0000 7f52de672540 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-10-07T08:42:34.984 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-07T08:42:35.048 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-07T08:42:35.049 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:35.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-07T08:42:35.076 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:35.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-07T08:42:35.142 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:35.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-07T08:42:35.208 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:35.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-07T08:42:35.273 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:35.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-07T08:42:35.338 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:35.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-07T08:42:35.402 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:35.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-07T08:42:35.466 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:35.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-07T08:42:35.491 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:35.491 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-07T08:42:35.556 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:35.556 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-07T08:42:35.619 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:35.620 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-07T08:42:35.683 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:35.683 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-07T08:42:35.747 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:35.747 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-07T08:42:35.811 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:35.812 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-07T08:42:35.875 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:35.875 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-07T08:42:35.891 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:35.891 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-07T08:42:35.946 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:35.946 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-07T08:42:35.962 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:35.962 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-07T08:42:36.016 INFO:tasks.ceph:Adding keys to all mons... 2023-10-07T08:42:36.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-07T08:42:36.019 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-07T08:42:36.059 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2023-10-07T08:42:36.059 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDzGSFlByYuDBAA2xkiT3FNBRXjSMlu+GdRjg== 2023-10-07T08:42:36.059 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-10-07T08:42:36.059 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDzGSFlK8v0EhAAyj+l+ifyEevPT96HbuWzkw== 2023-10-07T08:42:36.060 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2023-10-07T08:42:36.060 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDzGSFlvsm6GRAApZehzqt3HugU+h9RGWQh8g== 2023-10-07T08:42:36.060 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2023-10-07T08:42:36.060 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD2GSFlwYNOOBAAMpoFTAZdRERvqFbI4Lno9g== 2023-10-07T08:42:36.060 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2023-10-07T08:42:36.060 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD3GSFlejEnBBAAsnZCgsTTMWvqr2n4FfgWCQ== 2023-10-07T08:42:36.060 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2023-10-07T08:42:36.060 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD3GSFlDjS3DRAAfyBS9XSkAY6Se+RNw9jwWw== 2023-10-07T08:42:36.060 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2023-10-07T08:42:36.060 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD3GSFlnLaEFxAAtQ3AxrEGCcXYvJF2/wP1yw== 2023-10-07T08:42:36.060 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2023-10-07T08:42:36.060 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDzGSFl8c3zDxAAKU/DHPPZhFJ1MKw48C6lJQ== 2023-10-07T08:42:36.061 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-10-07T08:42:36.061 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDzGSFlN0UcHhAA0o1jHEL9Ow40VDezKTunOw== 2023-10-07T08:42:36.061 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2023-10-07T08:42:36.061 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDzGSFl8XLiJBAAMBqSo/+NZuuL/pPnTitAUw== 2023-10-07T08:42:36.061 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2023-10-07T08:42:36.061 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD6GSFlllNdIRAAXgD+PAR1Piya6p94xfGbXA== 2023-10-07T08:42:36.061 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2023-10-07T08:42:36.061 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD6GSFleIM7KBAAIz+WlbgsmtAuSMPO+kh/Xw== 2023-10-07T08:42:36.061 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2023-10-07T08:42:36.061 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD6GSFlFNlEMRAAt7dpMTylOj0KsJy/law6Nw== 2023-10-07T08:42:36.061 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2023-10-07T08:42:36.062 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD6GSFloCRbOhAA8XzXVwVYYYZIJV+F84EiDQ== 2023-10-07T08:42:36.062 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2023-10-07T08:42:36.062 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDzGSFl7cS0KBAA2K6kkFjyEZYa0xYx53Nf7g== 2023-10-07T08:42:36.062 INFO:teuthology.orchestra.run.smithi081.stdout:[client.2] 2023-10-07T08:42:36.062 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDzGSFldtgKLhAAX8L0S1NgyHsOj4cUljxH/A== 2023-10-07T08:42:36.062 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2023-10-07T08:42:36.062 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDzGSFlP3EBMRAAWXcQeEkoEzBCSQzvz/AzBQ== 2023-10-07T08:42:36.062 INFO:teuthology.orchestra.run.smithi081.stdout:[client.3] 2023-10-07T08:42:36.062 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDzGSFlJ+VXNhAA9sXFpdOEIZxQLiS8LJwa3A== 2023-10-07T08:42:36.078 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.y] 2023-10-07T08:42:36.079 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDzGSFlByYuDBAA2xkiT3FNBRXjSMlu+GdRjg== 2023-10-07T08:42:36.079 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-10-07T08:42:36.079 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDzGSFlK8v0EhAAyj+l+ifyEevPT96HbuWzkw== 2023-10-07T08:42:36.080 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-10-07T08:42:36.080 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDzGSFlvsm6GRAApZehzqt3HugU+h9RGWQh8g== 2023-10-07T08:42:36.080 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2023-10-07T08:42:36.080 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD2GSFlwYNOOBAAMpoFTAZdRERvqFbI4Lno9g== 2023-10-07T08:42:36.080 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2023-10-07T08:42:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD3GSFlejEnBBAAsnZCgsTTMWvqr2n4FfgWCQ== 2023-10-07T08:42:36.081 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2023-10-07T08:42:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD3GSFlDjS3DRAAfyBS9XSkAY6Se+RNw9jwWw== 2023-10-07T08:42:36.081 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2023-10-07T08:42:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD3GSFlnLaEFxAAtQ3AxrEGCcXYvJF2/wP1yw== 2023-10-07T08:42:36.081 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2023-10-07T08:42:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDzGSFl8c3zDxAAKU/DHPPZhFJ1MKw48C6lJQ== 2023-10-07T08:42:36.081 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-10-07T08:42:36.081 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDzGSFlN0UcHhAA0o1jHEL9Ow40VDezKTunOw== 2023-10-07T08:42:36.081 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.d] 2023-10-07T08:42:36.082 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDzGSFl8XLiJBAAMBqSo/+NZuuL/pPnTitAUw== 2023-10-07T08:42:36.082 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.4] 2023-10-07T08:42:36.082 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD6GSFlllNdIRAAXgD+PAR1Piya6p94xfGbXA== 2023-10-07T08:42:36.082 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.5] 2023-10-07T08:42:36.082 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD6GSFleIM7KBAAIz+WlbgsmtAuSMPO+kh/Xw== 2023-10-07T08:42:36.082 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.6] 2023-10-07T08:42:36.082 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD6GSFlFNlEMRAAt7dpMTylOj0KsJy/law6Nw== 2023-10-07T08:42:36.083 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.7] 2023-10-07T08:42:36.083 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD6GSFloCRbOhAA8XzXVwVYYYZIJV+F84EiDQ== 2023-10-07T08:42:36.083 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-10-07T08:42:36.083 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDzGSFl7cS0KBAA2K6kkFjyEZYa0xYx53Nf7g== 2023-10-07T08:42:36.083 INFO:teuthology.orchestra.run.smithi089.stdout:[client.2] 2023-10-07T08:42:36.083 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDzGSFldtgKLhAAX8L0S1NgyHsOj4cUljxH/A== 2023-10-07T08:42:36.083 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2023-10-07T08:42:36.083 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDzGSFlP3EBMRAAWXcQeEkoEzBCSQzvz/AzBQ== 2023-10-07T08:42:36.083 INFO:teuthology.orchestra.run.smithi089.stdout:[client.3] 2023-10-07T08:42:36.083 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDzGSFlJ+VXNhAA9sXFpdOEIZxQLiS8LJwa3A== 2023-10-07T08:42:36.085 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-07T08:42:36.106 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-07T08:42:36.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-07T08:42:36.180 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-07T08:42:36.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-07T08:42:36.250 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-07T08:42:36.323 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:42:36.325 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:42:36.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:42:36.381 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:42:36.596 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:42:36.599 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:42:36.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:42:36.704 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:42:36.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-07T08:42:36.776 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-07T08:42:36.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-07T08:42:36.825 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-07T08:42:36.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-07T08:42:36.895 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-07T08:42:37.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:42:37.022 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:42:37.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:42:37.084 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:42:37.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:42:37.155 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:42:37.221 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:42:37.223 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-07T08:42:37.271 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-07T08:42:37.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-07T08:42:37.323 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-07T08:42:37.325 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-07T08:42:37.447 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-07T08:42:37.449 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-07T08:42:37.531 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-07T08:42:37.533 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-07T08:42:37.611 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-07T08:42:37.611 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-07T08:42:37.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-07T08:42:37.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-07T08:42:37.754 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-07T08:42:37.780 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-07T08:42:37.873 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-07T08:42:37.897 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-07T08:42:37.961 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-07T08:42:38.053 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-07T08:42:38.076 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:42:38.079 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-07T08:42:38.131 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-07T08:42:38.131 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-07T08:42:38.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-07T08:42:38.134 INFO:tasks.ceph.mon.a:Started 2023-10-07T08:42:38.134 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-07T08:42:38.134 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-07T08:42:38.173 INFO:tasks.ceph.mon.b:Started 2023-10-07T08:42:38.173 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-07T08:42:38.174 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-07T08:42:38.175 INFO:tasks.ceph.mon.c:Started 2023-10-07T08:42:38.176 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-07T08:42:38.176 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-07T08:42:38.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-07T08:42:38.178 INFO:tasks.ceph.mgr.y:Started 2023-10-07T08:42:38.178 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-07T08:42:38.178 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-07T08:42:38.180 INFO:tasks.ceph.mgr.x:Started 2023-10-07T08:42:38.180 INFO:tasks.ceph:Setting crush tunables to default 2023-10-07T08:42:38.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2023-10-07T08:42:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.294+0000 7f575626b700 1 Processor -- start 2023-10-07T08:42:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.294+0000 7f575626b700 1 -- start start 2023-10-07T08:42:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.294+0000 7f575626b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 0x7f575015b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.294+0000 7f575626b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f575006c190 0x7f57500b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.294+0000 7f575626b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f57500b3170 0x7f575006a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.294+0000 7f575626b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57500b35d0 con 0x7f575006c190 2023-10-07T08:42:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.294+0000 7f575626b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5750069d10 con 0x7f57500b3170 2023-10-07T08:42:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.294+0000 7f575626b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575015c130 con 0x7f5750157a60 2023-10-07T08:42:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f574f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f575006c190 0x7f57500b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f574f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f575006c190 0x7f57500b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59026/0 (socket says 172.21.15.81:59026) 2023-10-07T08:42:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f574f7fe700 1 -- 172.21.15.81:0/3555847345 learned_addr learned my addr 172.21.15.81:0/3555847345 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f574ffff700 1 --2- 172.21.15.81:0/3555847345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 0x7f575015b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f5754808700 1 --2- 172.21.15.81:0/3555847345 >> v2:172.21.15.89:3300/0 conn(0x7f57500b3170 0x7f575006a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f574f7fe700 1 -- 172.21.15.81:0/3555847345 >> v2:172.21.15.81:3300/0 conn(0x7f575006c190 msgr2=0x7f57500b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-07T08:42:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f574f7fe700 1 -- 172.21.15.81:0/3555847345 >> v2:172.21.15.81:3300/0 conn(0x7f575006c190 msgr2=0x7f57500b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:42:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f574f7fe700 1 --2- 172.21.15.81:0/3555847345 >> v2:172.21.15.81:3300/0 conn(0x7f575006c190 0x7f57500b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:42:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f574ffff700 1 -- 172.21.15.81:0/3555847345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 msgr2=0x7f575015b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-07T08:42:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f574ffff700 1 -- 172.21.15.81:0/3555847345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 msgr2=0x7f575015b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:42:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f574f7fe700 1 --2- 172.21.15.81:0/3555847345 >> v2:172.21.15.81:3300/0 conn(0x7f575006c190 0x7f57500b2c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-07T08:42:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f5754808700 1 -- 172.21.15.81:0/3555847345 >> v2:172.21.15.89:3300/0 conn(0x7f57500b3170 msgr2=0x7f575006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-07T08:42:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f574ffff700 1 --2- 172.21.15.81:0/3555847345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 0x7f575015b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:42:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f5754808700 1 -- 172.21.15.81:0/3555847345 >> v2:172.21.15.89:3300/0 conn(0x7f57500b3170 msgr2=0x7f575006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:42:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f5754808700 1 --2- 172.21.15.81:0/3555847345 >> v2:172.21.15.89:3300/0 conn(0x7f57500b3170 0x7f575006a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:42:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f574ffff700 1 --2- 172.21.15.81:0/3555847345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 0x7f575015b8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-07T08:42:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.295+0000 7f5754808700 1 --2- 172.21.15.81:0/3555847345 >> v2:172.21.15.89:3300/0 conn(0x7f57500b3170 0x7f575006a1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-07T08:42:38.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.496+0000 7f574f7fe700 1 --2- 172.21.15.81:0/3555847345 >> v2:172.21.15.81:3300/0 conn(0x7f575006c190 0x7f57500b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:38.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.496+0000 7f5754808700 1 --2- 172.21.15.81:0/3555847345 >> v2:172.21.15.89:3300/0 conn(0x7f57500b3170 0x7f575006a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:38.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.496+0000 7f574ffff700 1 --2- 172.21.15.81:0/3555847345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 0x7f575015b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:38.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.496+0000 7f574f7fe700 1 -- 172.21.15.81:0/3555847345 >> v2:172.21.15.81:3300/0 conn(0x7f575006c190 msgr2=0x7f57500b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-07T08:42:38.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.496+0000 7f574f7fe700 1 -- 172.21.15.81:0/3555847345 >> v2:172.21.15.81:3300/0 conn(0x7f575006c190 msgr2=0x7f57500b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:42:38.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.496+0000 7f574f7fe700 1 --2- 172.21.15.81:0/3555847345 >> v2:172.21.15.81:3300/0 conn(0x7f575006c190 0x7f57500b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:42:38.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.496+0000 7f574ffff700 1 -- 172.21.15.81:0/3555847345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 msgr2=0x7f575015b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-07T08:42:38.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.496+0000 7f574ffff700 1 -- 172.21.15.81:0/3555847345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 msgr2=0x7f575015b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:42:38.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.496+0000 7f574ffff700 1 --2- 172.21.15.81:0/3555847345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 0x7f575015b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:42:38.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.496+0000 7f574f7fe700 1 --2- 172.21.15.81:0/3555847345 >> v2:172.21.15.81:3300/0 conn(0x7f575006c190 0x7f57500b2c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-07T08:42:38.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.496+0000 7f5754808700 1 -- 172.21.15.81:0/3555847345 >> v2:172.21.15.89:3300/0 conn(0x7f57500b3170 msgr2=0x7f575006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-07T08:42:38.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.496+0000 7f5754808700 1 -- 172.21.15.81:0/3555847345 >> v2:172.21.15.89:3300/0 conn(0x7f57500b3170 msgr2=0x7f575006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-07T08:42:38.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.496+0000 7f574ffff700 1 --2- 172.21.15.81:0/3555847345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 0x7f575015b8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-07T08:42:38.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.496+0000 7f5754808700 1 --2- 172.21.15.81:0/3555847345 >> v2:172.21.15.89:3300/0 conn(0x7f57500b3170 0x7f575006a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-07T08:42:38.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.496+0000 7f5754808700 1 --2- 172.21.15.81:0/3555847345 >> v2:172.21.15.89:3300/0 conn(0x7f57500b3170 0x7f575006a1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-07T08:42:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.897+0000 7f574f7fe700 1 --2- 172.21.15.81:0/3555847345 >> v2:172.21.15.81:3300/0 conn(0x7f575006c190 0x7f57500b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.897+0000 7f574ffff700 1 --2- 172.21.15.81:0/3555847345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 0x7f575015b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.897+0000 7f5754808700 1 --2- 172.21.15.81:0/3555847345 >> v2:172.21.15.89:3300/0 conn(0x7f57500b3170 0x7f575006a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.897+0000 7f574f7fe700 1 -- 172.21.15.81:0/3555847345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 msgr2=0x7f575015b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.897+0000 7f574f7fe700 1 --2- 172.21.15.81:0/3555847345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 0x7f575015b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.897+0000 7f574f7fe700 1 -- 172.21.15.81:0/3555847345 >> v2:172.21.15.89:3300/0 conn(0x7f57500b3170 msgr2=0x7f575006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.897+0000 7f574f7fe700 1 --2- 172.21.15.81:0/3555847345 >> v2:172.21.15.89:3300/0 conn(0x7f57500b3170 0x7f575006a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.897+0000 7f574f7fe700 1 -- 172.21.15.81:0/3555847345 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575015c410 con 0x7f575006c190 2023-10-07T08:42:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.897+0000 7f574f7fe700 1 --2- 172.21.15.81:0/3555847345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575006c190 0x7f57500b2c30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f57500ca270 tx=0x7f5740008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143d2e692872d14 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.897+0000 7f574effd700 1 -- 172.21.15.81:0/3555847345 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5740010710 con 0x7f575006c190 2023-10-07T08:42:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.897+0000 7f574effd700 1 -- 172.21.15.81:0/3555847345 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574000c050 con 0x7f575006c190 2023-10-07T08:42:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.897+0000 7f574effd700 1 -- 172.21.15.81:0/3555847345 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5740010ae0 con 0x7f575006c190 2023-10-07T08:42:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.898+0000 7f575626b700 1 -- 172.21.15.81:0/3555847345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575006c190 msgr2=0x7f57500b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.898+0000 7f575626b700 1 --2- 172.21.15.81:0/3555847345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575006c190 0x7f57500b2c30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f57500ca270 tx=0x7f5740008040 comp rx=0 tx=0).stop 2023-10-07T08:42:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.898+0000 7f575626b700 1 -- 172.21.15.81:0/3555847345 shutdown_connections 2023-10-07T08:42:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.898+0000 7f575626b700 1 --2- 172.21.15.81:0/3555847345 >> v2:172.21.15.89:3300/0 conn(0x7f57500b3170 0x7f575006a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.898+0000 7f575626b700 1 --2- 172.21.15.81:0/3555847345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 0x7f575015b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.898+0000 7f575626b700 1 --2- 172.21.15.81:0/3555847345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575006c190 0x7f57500b2c30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.898+0000 7f575626b700 1 -- 172.21.15.81:0/3555847345 >> 172.21.15.81:0/3555847345 conn(0x7f575006cca0 msgr2=0x7f575006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.898+0000 7f575626b700 1 -- 172.21.15.81:0/3555847345 shutdown_connections 2023-10-07T08:42:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.898+0000 7f575626b700 1 -- 172.21.15.81:0/3555847345 wait complete. 2023-10-07T08:42:38.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.899+0000 7f575626b700 1 Processor -- start 2023-10-07T08:42:38.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.899+0000 7f575626b700 1 -- start start 2023-10-07T08:42:38.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.900+0000 7f575626b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575006c190 0x7f5750154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:38.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.900+0000 7f575626b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57500b3170 0x7f5750150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:38.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.900+0000 7f575626b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 0x7f57501508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.900+0000 7f575626b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57500b0ac0 con 0x7f575006c190 2023-10-07T08:42:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.900+0000 7f575626b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57500ab630 con 0x7f57500b3170 2023-10-07T08:42:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.900+0000 7f575626b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57500b0d60 con 0x7f5750157a60 2023-10-07T08:42:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.900+0000 7f574ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575006c190 0x7f5750154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.900+0000 7f574ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575006c190 0x7f5750154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59090/0 (socket says 172.21.15.81:59090) 2023-10-07T08:42:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.900+0000 7f574ffff700 1 -- 172.21.15.81:0/1038136399 learned_addr learned my addr 172.21.15.81:0/1038136399 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.900+0000 7f574f7fe700 1 --2- 172.21.15.81:0/1038136399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57500b3170 0x7f5750150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.900+0000 7f5754808700 1 --2- 172.21.15.81:0/1038136399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 0x7f57501508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.901+0000 7f5754808700 1 -- 172.21.15.81:0/1038136399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57500b3170 msgr2=0x7f5750150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.901+0000 7f5754808700 1 --2- 172.21.15.81:0/1038136399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57500b3170 0x7f5750150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.901+0000 7f5754808700 1 -- 172.21.15.81:0/1038136399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575006c190 msgr2=0x7f5750154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.901+0000 7f5754808700 1 --2- 172.21.15.81:0/1038136399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575006c190 0x7f5750154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.901+0000 7f5754808700 1 -- 172.21.15.81:0/1038136399 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574000e5d0 con 0x7f5750157a60 2023-10-07T08:42:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.901+0000 7f574ffff700 1 --2- 172.21.15.81:0/1038136399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575006c190 0x7f5750154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:42:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.901+0000 7f5754808700 1 --2- 172.21.15.81:0/1038136399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 0x7f57501508c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5748002300 tx=0x7f57480098a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.901+0000 7f5737fff700 1 -- 172.21.15.81:0/1038136399 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748002de0 con 0x7f5750157a60 2023-10-07T08:42:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.901+0000 7f5737fff700 1 -- 172.21.15.81:0/1038136399 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574800f040 con 0x7f5750157a60 2023-10-07T08:42:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.901+0000 7f575626b700 1 -- 172.21.15.81:0/1038136399 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57500b1040 con 0x7f5750157a60 2023-10-07T08:42:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.901+0000 7f5737fff700 1 -- 172.21.15.81:0/1038136399 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57480166b0 con 0x7f5750157a60 2023-10-07T08:42:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.901+0000 7f575626b700 1 -- 172.21.15.81:0/1038136399 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5750154ab0 con 0x7f5750157a60 2023-10-07T08:42:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.901+0000 7f5737fff700 1 -- 172.21.15.81:0/1038136399 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5748003040 con 0x7f5750157a60 2023-10-07T08:42:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.901+0000 7f5737fff700 1 -- 172.21.15.81:0/1038136399 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f574801f4d0 con 0x7f5750157a60 2023-10-07T08:42:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.902+0000 7f575626b700 1 -- 172.21.15.81:0/1038136399 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57500b1280 con 0x7f5750157a60 2023-10-07T08:42:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.904+0000 7f5737fff700 1 -- 172.21.15.81:0/1038136399 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f574803d6d0 con 0x7f5750157a60 2023-10-07T08:42:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.978+0000 7f575626b700 1 -- 172.21.15.81:0/1038136399 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f575015c6f0 con 0x7f5750157a60 2023-10-07T08:42:38.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.982+0000 7f5737fff700 1 -- 172.21.15.81:0/1038136399 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f574802c020 con 0x7f5750157a60 2023-10-07T08:42:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.983+0000 7f575626b700 1 -- 172.21.15.81:0/1038136399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 msgr2=0x7f57501508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.983+0000 7f575626b700 1 --2- 172.21.15.81:0/1038136399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 0x7f57501508c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5748002300 tx=0x7f57480098a0 comp rx=0 tx=0).stop 2023-10-07T08:42:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.983+0000 7f575626b700 1 -- 172.21.15.81:0/1038136399 shutdown_connections 2023-10-07T08:42:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.983+0000 7f575626b700 1 --2- 172.21.15.81:0/1038136399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5750157a60 0x7f57501508c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.983+0000 7f575626b700 1 --2- 172.21.15.81:0/1038136399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575006c190 0x7f5750154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.983+0000 7f575626b700 1 --2- 172.21.15.81:0/1038136399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57500b3170 0x7f5750150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.983+0000 7f575626b700 1 -- 172.21.15.81:0/1038136399 >> 172.21.15.81:0/1038136399 conn(0x7f575006cca0 msgr2=0x7f575006d070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.983+0000 7f575626b700 1 -- 172.21.15.81:0/1038136399 shutdown_connections 2023-10-07T08:42:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:38.984+0000 7f575626b700 1 -- 172.21.15.81:0/1038136399 wait complete. 2023-10-07T08:42:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2023-10-07T08:42:38.996 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-07T08:42:38.996 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:38.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-07T08:42:39.020 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:39.021 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-07T08:42:39.085 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:39.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-07T08:42:39.149 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-07T08:42:39.150 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-07T08:42:39.215 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:39.215 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-07T08:42:39.241 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:39.241 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-07T08:42:39.307 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:39.307 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-07T08:42:39.371 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-07T08:42:39.372 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-07T08:42:39.437 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-10-07T08:42:39.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.593+0000 7fdce519f700 1 Processor -- start 2023-10-07T08:42:39.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.593+0000 7fdce519f700 1 -- start start 2023-10-07T08:42:39.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.594+0000 7fdce519f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce00b43c0 0x7fdce00cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:39.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.594+0000 7fdce519f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdce00cddd0 0x7fdce00ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:39.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.594+0000 7fdce519f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce00cadb0 con 0x7fdce00cd030 2023-10-07T08:42:39.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.594+0000 7fdce519f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce00cc250 con 0x7fdce00cddd0 2023-10-07T08:42:39.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.594+0000 7fdce519f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce00cf000 con 0x7fdce00b43c0 2023-10-07T08:42:39.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.594+0000 7fdcdffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce00b43c0 0x7fdce00cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:39.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.594+0000 7fdcdf7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdce00cddd0 0x7fdce00ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:39.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.594+0000 7fdcdffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce00b43c0 0x7fdce00cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:42686/0 (socket says 172.21.15.89:42686) 2023-10-07T08:42:39.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.594+0000 7fdcdf7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdce00cddd0 0x7fdce00ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42162/0 (socket says 172.21.15.89:42162) 2023-10-07T08:42:39.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.594+0000 7fdcdffff700 1 -- 172.21.15.89:0/2584774162 learned_addr learned my addr 172.21.15.89:0/2584774162 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-07T08:42:39.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.594+0000 7fdcdffff700 1 -- 172.21.15.89:0/2584774162 >> v2:172.21.15.89:3300/0 conn(0x7fdce00cddd0 msgr2=0x7fdce00ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:39.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.594+0000 7fdcdffff700 1 --2- 172.21.15.89:0/2584774162 >> v2:172.21.15.89:3300/0 conn(0x7fdce00cddd0 0x7fdce00ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.594+0000 7fdcdffff700 1 -- 172.21.15.89:0/2584774162 >> v1:172.21.15.81:6789/0 conn(0x7fdce00cd030 legacy=0x7fdce015b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:39.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.594+0000 7fdcdffff700 1 -- 172.21.15.89:0/2584774162 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce00cf2e0 con 0x7fdce00b43c0 2023-10-07T08:42:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.594+0000 7fdcdf7fe700 1 --2- 172.21.15.89:0/2584774162 >> v2:172.21.15.89:3300/0 conn(0x7fdce00cddd0 0x7fdce00ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:42:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.595+0000 7fdcdffff700 1 --2- 172.21.15.89:0/2584774162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce00b43c0 0x7fdce00cc5b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40099b0 tx=0x7fdcd4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7da64ca46b739c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.595+0000 7fdcdeffd700 1 -- 172.21.15.89:0/2584774162 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4009ea0 con 0x7fdce00b43c0 2023-10-07T08:42:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.595+0000 7fdcdeffd700 1 -- 172.21.15.89:0/2584774162 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd400b860 con 0x7fdce00b43c0 2023-10-07T08:42:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.595+0000 7fdcdeffd700 1 -- 172.21.15.89:0/2584774162 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd400bc00 con 0x7fdce00b43c0 2023-10-07T08:42:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.595+0000 7fdce519f700 1 -- 172.21.15.89:0/2584774162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce00b43c0 msgr2=0x7fdce00cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.595+0000 7fdce519f700 1 --2- 172.21.15.89:0/2584774162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce00b43c0 0x7fdce00cc5b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40099b0 tx=0x7fdcd4009250 comp rx=0 tx=0).stop 2023-10-07T08:42:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.595+0000 7fdce519f700 1 -- 172.21.15.89:0/2584774162 shutdown_connections 2023-10-07T08:42:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.595+0000 7fdce519f700 1 --2- 172.21.15.89:0/2584774162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce00b43c0 0x7fdce00cc5b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.595+0000 7fdce519f700 1 --2- 172.21.15.89:0/2584774162 >> v2:172.21.15.89:3300/0 conn(0x7fdce00cddd0 0x7fdce00ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.595+0000 7fdce519f700 1 -- 172.21.15.89:0/2584774162 >> 172.21.15.89:0/2584774162 conn(0x7fdce0068110 msgr2=0x7fdce006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.595+0000 7fdce519f700 1 -- 172.21.15.89:0/2584774162 shutdown_connections 2023-10-07T08:42:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.595+0000 7fdce519f700 1 -- 172.21.15.89:0/2584774162 wait complete. 2023-10-07T08:42:39.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.596+0000 7fdce519f700 1 Processor -- start 2023-10-07T08:42:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.597+0000 7fdce519f700 1 -- start start 2023-10-07T08:42:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.597+0000 7fdce519f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdce00b43c0 0x7fdce00c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.597+0000 7fdce519f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce00cd030 0x7fdce00c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.597+0000 7fdce519f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce00cddd0 0x7fdce006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.597+0000 7fdce519f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce01581a0 con 0x7fdce00b43c0 2023-10-07T08:42:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.597+0000 7fdce519f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce0158440 con 0x7fdce00cd030 2023-10-07T08:42:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.597+0000 7fdce519f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce0158720 con 0x7fdce00cddd0 2023-10-07T08:42:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.597+0000 7fdcdf7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce00cd030 0x7fdce00c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.597+0000 7fdce499e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce00cddd0 0x7fdce006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.597+0000 7fdcdf7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce00cd030 0x7fdce00c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42166/0 (socket says 172.21.15.89:42166) 2023-10-07T08:42:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.597+0000 7fdcdf7fe700 1 -- 172.21.15.89:0/3751097201 learned_addr learned my addr 172.21.15.89:0/3751097201 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-07T08:42:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.598+0000 7fdcdffff700 1 --2- 172.21.15.89:0/3751097201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdce00b43c0 0x7fdce00c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.598+0000 7fdce499e700 1 -- 172.21.15.89:0/3751097201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce00cd030 msgr2=0x7fdce00c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.598+0000 7fdce499e700 1 --2- 172.21.15.89:0/3751097201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce00cd030 0x7fdce00c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.598+0000 7fdce499e700 1 -- 172.21.15.89:0/3751097201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdce00b43c0 msgr2=0x7fdce00c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.598+0000 7fdce499e700 1 --2- 172.21.15.89:0/3751097201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdce00b43c0 0x7fdce00c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.598+0000 7fdce499e700 1 -- 172.21.15.89:0/3751097201 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd0009420 con 0x7fdce00cddd0 2023-10-07T08:42:39.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.598+0000 7fdcdf7fe700 1 --2- 172.21.15.89:0/3751097201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce00cd030 0x7fdce00c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:42:39.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.598+0000 7fdce499e700 1 --2- 172.21.15.89:0/3751097201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce00cddd0 0x7fdce006dd80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800c830 tx=0x7fdcd8001690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:39.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.598+0000 7fdcc7fff700 1 -- 172.21.15.89:0/3751097201 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8012630 con 0x7fdce00cddd0 2023-10-07T08:42:39.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.598+0000 7fdcc7fff700 1 -- 172.21.15.89:0/3751097201 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8012790 con 0x7fdce00cddd0 2023-10-07T08:42:39.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.598+0000 7fdcc7fff700 1 -- 172.21.15.89:0/3751097201 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8012b50 con 0x7fdce00cddd0 2023-10-07T08:42:39.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.598+0000 7fdce519f700 1 -- 172.21.15.89:0/3751097201 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd40094f0 con 0x7fdce00cddd0 2023-10-07T08:42:39.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.598+0000 7fdce519f700 1 -- 172.21.15.89:0/3751097201 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce0158ab0 con 0x7fdce00cddd0 2023-10-07T08:42:39.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.598+0000 7fdcc7fff700 1 -- 172.21.15.89:0/3751097201 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fdcd801b400 con 0x7fdce00cddd0 2023-10-07T08:42:39.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.598+0000 7fdcc7fff700 1 -- 172.21.15.89:0/3751097201 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdcd80116d0 con 0x7fdce00cddd0 2023-10-07T08:42:39.604 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.599+0000 7fdce519f700 1 -- 172.21.15.89:0/3751097201 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce0069c00 con 0x7fdce00cddd0 2023-10-07T08:42:39.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.601+0000 7fdcc7fff700 1 -- 172.21.15.89:0/3751097201 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fdcd801b840 con 0x7fdce00cddd0 2023-10-07T08:42:39.662 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:39.661+0000 7f1f213ef180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-07T08:42:39.675 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:39.675+0000 7f4cb602d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-07T08:42:39.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.684+0000 7fdce519f700 1 -- 172.21.15.89:0/3751097201 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7fdce00c9940 con 0x7fdce00cddd0 2023-10-07T08:42:39.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.688+0000 7fdcc7fff700 1 -- 172.21.15.89:0/3751097201 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdcd801b9e0 con 0x7fdce00cddd0 2023-10-07T08:42:39.689 INFO:teuthology.orchestra.run.smithi089.stdout:0 2023-10-07T08:42:39.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.689+0000 7fdce519f700 1 -- 172.21.15.89:0/3751097201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce00cddd0 msgr2=0x7fdce006dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:39.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.689+0000 7fdce519f700 1 --2- 172.21.15.89:0/3751097201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce00cddd0 0x7fdce006dd80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800c830 tx=0x7fdcd8001690 comp rx=0 tx=0).stop 2023-10-07T08:42:39.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.689+0000 7fdce519f700 1 -- 172.21.15.89:0/3751097201 shutdown_connections 2023-10-07T08:42:39.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.689+0000 7fdce519f700 1 --2- 172.21.15.89:0/3751097201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce00cddd0 0x7fdce006dd80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.689+0000 7fdce519f700 1 --2- 172.21.15.89:0/3751097201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdce00b43c0 0x7fdce00c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.689+0000 7fdce519f700 1 --2- 172.21.15.89:0/3751097201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce00cd030 0x7fdce00c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.689+0000 7fdce519f700 1 -- 172.21.15.89:0/3751097201 >> 172.21.15.89:0/3751097201 conn(0x7fdce0068110 msgr2=0x7fdce00c5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:39.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.689+0000 7fdce519f700 1 -- 172.21.15.89:0/3751097201 shutdown_connections 2023-10-07T08:42:39.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.689+0000 7fdce519f700 1 -- 172.21.15.89:0/3751097201 wait complete. 2023-10-07T08:42:39.701 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-10-07T08:42:39.792 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:39.790+0000 7f1f213ef180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-07T08:42:39.813 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:39.813+0000 7f4cb602d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-07T08:42:39.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.816+0000 7f1ee8f95700 1 Processor -- start 2023-10-07T08:42:39.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.816+0000 7f1ee8f95700 1 -- start start 2023-10-07T08:42:39.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.817+0000 7f1ee8f95700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ee40d0b80 0x7f1ee40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:39.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.817+0000 7f1ee8f95700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ee406d700 0x7f1ee415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:39.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.817+0000 7f1ee8f95700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee40cf2d0 con 0x7f1ee40d02b0 2023-10-07T08:42:39.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.817+0000 7f1ee8f95700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee415a690 con 0x7f1ee40d0b80 2023-10-07T08:42:39.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.817+0000 7f1ee8f95700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee406dc00 con 0x7f1ee406d700 2023-10-07T08:42:39.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.817+0000 7f1ee3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ee406d700 0x7f1ee415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:39.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.817+0000 7f1ee3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ee406d700 0x7f1ee415b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:42712/0 (socket says 172.21.15.89:42712) 2023-10-07T08:42:39.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.817+0000 7f1ee3fff700 1 -- 172.21.15.89:0/1541661750 learned_addr learned my addr 172.21.15.89:0/1541661750 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-07T08:42:39.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.817+0000 7f1ee37fe700 1 --2- 172.21.15.89:0/1541661750 >> v2:172.21.15.81:3300/0 conn(0x7f1ee40d0b80 0x7f1ee40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:39.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.818+0000 7f1ee3fff700 1 -- 172.21.15.89:0/1541661750 >> v2:172.21.15.81:3300/0 conn(0x7f1ee40d0b80 msgr2=0x7f1ee40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:39.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.818+0000 7f1ee3fff700 1 --2- 172.21.15.89:0/1541661750 >> v2:172.21.15.81:3300/0 conn(0x7f1ee40d0b80 0x7f1ee40cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.818+0000 7f1ee3fff700 1 -- 172.21.15.89:0/1541661750 >> v1:172.21.15.81:6789/0 conn(0x7f1ee40d02b0 legacy=0x7f1ee406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.818+0000 7f1ee3fff700 1 -- 172.21.15.89:0/1541661750 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee40cf570 con 0x7f1ee406d700 2023-10-07T08:42:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.818+0000 7f1ee3fff700 1 --2- 172.21.15.89:0/1541661750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ee406d700 0x7f1ee415b320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1edc009f20 tx=0x7f1edc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1e5878020b312ca server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.818+0000 7f1ee2ffd700 1 -- 172.21.15.89:0/1541661750 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1edc00e070 con 0x7f1ee406d700 2023-10-07T08:42:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.818+0000 7f1ee2ffd700 1 -- 172.21.15.89:0/1541661750 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1edc00b9d0 con 0x7f1ee406d700 2023-10-07T08:42:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.818+0000 7f1ee2ffd700 1 -- 172.21.15.89:0/1541661750 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1edc0092e0 con 0x7f1ee406d700 2023-10-07T08:42:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.819+0000 7f1ee8f95700 1 -- 172.21.15.89:0/1541661750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ee406d700 msgr2=0x7f1ee415b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.819+0000 7f1ee8f95700 1 --2- 172.21.15.89:0/1541661750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ee406d700 0x7f1ee415b320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1edc009f20 tx=0x7f1edc009840 comp rx=0 tx=0).stop 2023-10-07T08:42:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.819+0000 7f1ee8f95700 1 -- 172.21.15.89:0/1541661750 shutdown_connections 2023-10-07T08:42:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.819+0000 7f1ee8f95700 1 --2- 172.21.15.89:0/1541661750 >> v2:172.21.15.81:3300/0 conn(0x7f1ee40d0b80 0x7f1ee40cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.819+0000 7f1ee8f95700 1 --2- 172.21.15.89:0/1541661750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ee406d700 0x7f1ee415b320 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.819+0000 7f1ee8f95700 1 -- 172.21.15.89:0/1541661750 >> 172.21.15.89:0/1541661750 conn(0x7f1ee4063230 msgr2=0x7f1ee4063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.819+0000 7f1ee8f95700 1 -- 172.21.15.89:0/1541661750 shutdown_connections 2023-10-07T08:42:39.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.819+0000 7f1ee8f95700 1 -- 172.21.15.89:0/1541661750 wait complete. 2023-10-07T08:42:39.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.820+0000 7f1ee8f95700 1 Processor -- start 2023-10-07T08:42:39.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.820+0000 7f1ee8f95700 1 -- start start 2023-10-07T08:42:39.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.820+0000 7f1ee8f95700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ee406d700 0x7f1ee41415b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:39.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.820+0000 7f1ee8f95700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ee40d02b0 0x7f1ee4069c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:39.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.820+0000 7f1ee8f95700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee40d0b80 0x7f1ee406a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:39.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.820+0000 7f1ee8f95700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4153620 con 0x7f1ee40d0b80 2023-10-07T08:42:39.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.820+0000 7f1ee8f95700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4153900 con 0x7f1ee406d700 2023-10-07T08:42:39.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.820+0000 7f1ee8f95700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4153be0 con 0x7f1ee40d02b0 2023-10-07T08:42:39.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1ee37fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ee406d700 0x7f1ee41415b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:39.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1edbfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ee40d02b0 0x7f1ee4069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:39.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1ee37fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ee406d700 0x7f1ee41415b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42168/0 (socket says 172.21.15.89:42168) 2023-10-07T08:42:39.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1ee37fe700 1 -- 172.21.15.89:0/2175079304 learned_addr learned my addr 172.21.15.89:0/2175079304 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-07T08:42:39.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1ee3fff700 1 --2- 172.21.15.89:0/2175079304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee40d0b80 0x7f1ee406a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:39.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1edbfff700 1 -- 172.21.15.89:0/2175079304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ee406d700 msgr2=0x7f1ee41415b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:39.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1edbfff700 1 --2- 172.21.15.89:0/2175079304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ee406d700 0x7f1ee41415b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1edbfff700 1 -- 172.21.15.89:0/2175079304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee40d0b80 msgr2=0x7f1ee406a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1edbfff700 1 --2- 172.21.15.89:0/2175079304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee40d0b80 0x7f1ee406a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1edbfff700 1 -- 172.21.15.89:0/2175079304 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc009ae0 con 0x7f1ee40d02b0 2023-10-07T08:42:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1ee37fe700 1 --2- 172.21.15.89:0/2175079304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ee406d700 0x7f1ee41415b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:42:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1edbfff700 1 --2- 172.21.15.89:0/2175079304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ee40d02b0 0x7f1ee4069c60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc00c590 tx=0x7f1ecc007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1edb7fe700 1 -- 172.21.15.89:0/2175079304 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc011590 con 0x7f1ee40d02b0 2023-10-07T08:42:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1edb7fe700 1 -- 172.21.15.89:0/2175079304 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc011710 con 0x7f1ee40d02b0 2023-10-07T08:42:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1ee8f95700 1 -- 172.21.15.89:0/2175079304 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee4153ec0 con 0x7f1ee40d02b0 2023-10-07T08:42:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1edb7fe700 1 -- 172.21.15.89:0/2175079304 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc011ad0 con 0x7f1ee40d02b0 2023-10-07T08:42:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1ee8f95700 1 -- 172.21.15.89:0/2175079304 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee4141af0 con 0x7f1ee40d02b0 2023-10-07T08:42:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1edb7fe700 1 -- 172.21.15.89:0/2175079304 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1ecc01c6c0 con 0x7f1ee40d02b0 2023-10-07T08:42:39.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.821+0000 7f1edb7fe700 1 -- 172.21.15.89:0/2175079304 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f1ecc0127e0 con 0x7f1ee40d02b0 2023-10-07T08:42:39.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.822+0000 7f1ee8f95700 1 -- 172.21.15.89:0/2175079304 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee41543e0 con 0x7f1ee40d02b0 2023-10-07T08:42:39.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.824+0000 7f1edb7fe700 1 -- 172.21.15.89:0/2175079304 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1ee41543e0 con 0x7f1ee40d02b0 2023-10-07T08:42:39.867 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:39.866+0000 7f1f213ef180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-07T08:42:39.892 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:39.891+0000 7f4cb602d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-07T08:42:39.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.907+0000 7f1ee8f95700 1 -- 172.21.15.89:0/2175079304 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7f1ee40676e0 con 0x7f1ee40d02b0 2023-10-07T08:42:39.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.910+0000 7f1edb7fe700 1 -- 172.21.15.89:0/2175079304 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1ecc017070 con 0x7f1ee40d02b0 2023-10-07T08:42:39.911 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-07T08:42:39.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.911+0000 7f1ee8f95700 1 -- 172.21.15.89:0/2175079304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ee40d02b0 msgr2=0x7f1ee4069c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:39.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.911+0000 7f1ee8f95700 1 --2- 172.21.15.89:0/2175079304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ee40d02b0 0x7f1ee4069c60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc00c590 tx=0x7f1ecc007ec0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.911+0000 7f1ee8f95700 1 -- 172.21.15.89:0/2175079304 shutdown_connections 2023-10-07T08:42:39.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.911+0000 7f1ee8f95700 1 --2- 172.21.15.89:0/2175079304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee40d0b80 0x7f1ee406a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.911+0000 7f1ee8f95700 1 --2- 172.21.15.89:0/2175079304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ee406d700 0x7f1ee41415b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.911+0000 7f1ee8f95700 1 --2- 172.21.15.89:0/2175079304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ee40d02b0 0x7f1ee4069c60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:39.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.911+0000 7f1ee8f95700 1 -- 172.21.15.89:0/2175079304 >> 172.21.15.89:0/2175079304 conn(0x7f1ee4063230 msgr2=0x7f1ee4068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:39.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.911+0000 7f1ee8f95700 1 -- 172.21.15.89:0/2175079304 shutdown_connections 2023-10-07T08:42:39.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:39.911+0000 7f1ee8f95700 1 -- 172.21.15.89:0/2175079304 wait complete. 2023-10-07T08:42:39.924 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-10-07T08:42:40.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.039+0000 7f58bc15d700 1 Processor -- start 2023-10-07T08:42:40.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.039+0000 7f58bc15d700 1 -- start start 2023-10-07T08:42:40.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.040+0000 7f58bc15d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58b4157fe0 0x7f58b40b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.040+0000 7f58bc15d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f58b40cf240 0x7f58b40b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.040+0000 7f58bc15d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b40b2890 con 0x7f58b41583b0 2023-10-07T08:42:40.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.040+0000 7f58bc15d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b40b4070 con 0x7f58b4157fe0 2023-10-07T08:42:40.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.040+0000 7f58bc15d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b40b4350 con 0x7f58b40cf240 2023-10-07T08:42:40.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.040+0000 7f58ba6fa700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f58b40cf240 0x7f58b40b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.040+0000 7f58ba6fa700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f58b40cf240 0x7f58b40b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42184/0 (socket says 172.21.15.89:42184) 2023-10-07T08:42:40.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.040+0000 7f58ba6fa700 1 -- 172.21.15.89:0/3019689686 learned_addr learned my addr 172.21.15.89:0/3019689686 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-07T08:42:40.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.040+0000 7f58b9ef9700 1 --2- 172.21.15.89:0/3019689686 >> v2:172.21.15.81:3300/0 conn(0x7f58b4157fe0 0x7f58b40b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.041+0000 7f58ba6fa700 1 -- 172.21.15.89:0/3019689686 >> v2:172.21.15.81:3300/0 conn(0x7f58b4157fe0 msgr2=0x7f58b40b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:40.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.041+0000 7f58ba6fa700 1 --2- 172.21.15.89:0/3019689686 >> v2:172.21.15.81:3300/0 conn(0x7f58b4157fe0 0x7f58b40b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.041+0000 7f58ba6fa700 1 -- 172.21.15.89:0/3019689686 >> v1:172.21.15.81:6789/0 conn(0x7f58b41583b0 legacy=0x7f58b40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.041+0000 7f58b8ef7700 1 -- 172.21.15.89:0/3019689686 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194996626 0 0) 0x7f58b40b2890 con 0x7f58b41583b0 2023-10-07T08:42:40.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.041+0000 7f58ba6fa700 1 -- 172.21.15.89:0/3019689686 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b40b4630 con 0x7f58b40cf240 2023-10-07T08:42:40.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.041+0000 7f58ba6fa700 1 --2- 172.21.15.89:0/3019689686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58b40cf240 0x7f58b40b3a00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f58b4069790 tx=0x7f58ac009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f90512f79453572 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:40.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.041+0000 7f58b8ef7700 1 -- 172.21.15.89:0/3019689686 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac00e070 con 0x7f58b40cf240 2023-10-07T08:42:40.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.041+0000 7f58b8ef7700 1 -- 172.21.15.89:0/3019689686 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ac00ba20 con 0x7f58b40cf240 2023-10-07T08:42:40.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.041+0000 7f58b8ef7700 1 -- 172.21.15.89:0/3019689686 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0092e0 con 0x7f58b40cf240 2023-10-07T08:42:40.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.042+0000 7f58bc15d700 1 -- 172.21.15.89:0/3019689686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58b40cf240 msgr2=0x7f58b40b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.042+0000 7f58bc15d700 1 --2- 172.21.15.89:0/3019689686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58b40cf240 0x7f58b40b3a00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f58b4069790 tx=0x7f58ac009840 comp rx=0 tx=0).stop 2023-10-07T08:42:40.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.042+0000 7f58bc15d700 1 -- 172.21.15.89:0/3019689686 shutdown_connections 2023-10-07T08:42:40.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.042+0000 7f58bc15d700 1 --2- 172.21.15.89:0/3019689686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58b40cf240 0x7f58b40b3a00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.042+0000 7f58bc15d700 1 --2- 172.21.15.89:0/3019689686 >> v2:172.21.15.81:3300/0 conn(0x7f58b4157fe0 0x7f58b40b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.042+0000 7f58bc15d700 1 -- 172.21.15.89:0/3019689686 >> 172.21.15.89:0/3019689686 conn(0x7f58b4067640 msgr2=0x7f58b4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:40.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.042+0000 7f58bc15d700 1 -- 172.21.15.89:0/3019689686 shutdown_connections 2023-10-07T08:42:40.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.042+0000 7f58bc15d700 1 -- 172.21.15.89:0/3019689686 wait complete. 2023-10-07T08:42:40.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.043+0000 7f58bc15d700 1 Processor -- start 2023-10-07T08:42:40.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.043+0000 7f58bc15d700 1 -- start start 2023-10-07T08:42:40.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.043+0000 7f58bc15d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58b40cf240 0x7f58b415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.043+0000 7f58bc15d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58b4157fe0 0x7f58b415a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58bc15d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58b41583b0 0x7f58b4142390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58bc15d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b415cd10 con 0x7f58b4157fe0 2023-10-07T08:42:40.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58bc15d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b414ecc0 con 0x7f58b41583b0 2023-10-07T08:42:40.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58bc15d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b415c470 con 0x7f58b40cf240 2023-10-07T08:42:40.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58b9ef9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58b40cf240 0x7f58b415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58ba6fa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58b41583b0 0x7f58b4142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58b9ef9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58b40cf240 0x7f58b415bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:42744/0 (socket says 172.21.15.89:42744) 2023-10-07T08:42:40.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58b9ef9700 1 -- 172.21.15.89:0/1257172976 learned_addr learned my addr 172.21.15.89:0/1257172976 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-07T08:42:40.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58b96f8700 1 --2- 172.21.15.89:0/1257172976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58b4157fe0 0x7f58b415a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58b9ef9700 1 -- 172.21.15.89:0/1257172976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58b41583b0 msgr2=0x7f58b4142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58b9ef9700 1 --2- 172.21.15.89:0/1257172976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58b41583b0 0x7f58b4142390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58b9ef9700 1 -- 172.21.15.89:0/1257172976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58b4157fe0 msgr2=0x7f58b415a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58b9ef9700 1 --2- 172.21.15.89:0/1257172976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58b4157fe0 0x7f58b415a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58b9ef9700 1 -- 172.21.15.89:0/1257172976 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac009ae0 con 0x7f58b40cf240 2023-10-07T08:42:40.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58b9ef9700 1 --2- 172.21.15.89:0/1257172976 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58b40cf240 0x7f58b415bc20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f58a400ec80 tx=0x7f58a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:40.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58a9ffb700 1 -- 172.21.15.89:0/1257172976 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a400c850 con 0x7f58b40cf240 2023-10-07T08:42:40.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58a9ffb700 1 -- 172.21.15.89:0/1257172976 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a400c9b0 con 0x7f58b40cf240 2023-10-07T08:42:40.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58bc15d700 1 -- 172.21.15.89:0/1257172976 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b415c750 con 0x7f58b40cf240 2023-10-07T08:42:40.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58a9ffb700 1 -- 172.21.15.89:0/1257172976 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a400cd50 con 0x7f58b40cf240 2023-10-07T08:42:40.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.044+0000 7f58bc15d700 1 -- 172.21.15.89:0/1257172976 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b414efe0 con 0x7f58b40cf240 2023-10-07T08:42:40.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.045+0000 7f58a9ffb700 1 -- 172.21.15.89:0/1257172976 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f58a4005c80 con 0x7f58b40cf240 2023-10-07T08:42:40.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.045+0000 7f58a9ffb700 1 -- 172.21.15.89:0/1257172976 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f58a4006020 con 0x7f58b40cf240 2023-10-07T08:42:40.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.045+0000 7f58bc15d700 1 -- 172.21.15.89:0/1257172976 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b414f2d0 con 0x7f58b40cf240 2023-10-07T08:42:40.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.047+0000 7f58a9ffb700 1 -- 172.21.15.89:0/1257172976 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f58a4021060 con 0x7f58b40cf240 2023-10-07T08:42:40.051 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:40.047+0000 7f1f213ef180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-07T08:42:40.083 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:40.082+0000 7f4cb602d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-07T08:42:40.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.129+0000 7f58bc15d700 1 -- 172.21.15.89:0/1257172976 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7f58b40cc6b0 con 0x7f58b40cf240 2023-10-07T08:42:40.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.133+0000 7f58a9ffb700 1 -- 172.21.15.89:0/1257172976 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f58a4017070 con 0x7f58b40cf240 2023-10-07T08:42:40.134 INFO:teuthology.orchestra.run.smithi089.stdout:2 2023-10-07T08:42:40.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.134+0000 7f58bc15d700 1 -- 172.21.15.89:0/1257172976 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58b40cf240 msgr2=0x7f58b415bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.134+0000 7f58bc15d700 1 --2- 172.21.15.89:0/1257172976 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58b40cf240 0x7f58b415bc20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f58a400ec80 tx=0x7f58a40091a0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.134+0000 7f58bc15d700 1 -- 172.21.15.89:0/1257172976 shutdown_connections 2023-10-07T08:42:40.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.134+0000 7f58bc15d700 1 --2- 172.21.15.89:0/1257172976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58b41583b0 0x7f58b4142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.134+0000 7f58bc15d700 1 --2- 172.21.15.89:0/1257172976 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58b40cf240 0x7f58b415bc20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.134+0000 7f58bc15d700 1 --2- 172.21.15.89:0/1257172976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58b4157fe0 0x7f58b415a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.134+0000 7f58bc15d700 1 -- 172.21.15.89:0/1257172976 >> 172.21.15.89:0/1257172976 conn(0x7f58b4067640 msgr2=0x7f58b4153e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:40.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.134+0000 7f58bc15d700 1 -- 172.21.15.89:0/1257172976 shutdown_connections 2023-10-07T08:42:40.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.134+0000 7f58bc15d700 1 -- 172.21.15.89:0/1257172976 wait complete. 2023-10-07T08:42:40.147 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-10-07T08:42:40.221 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:40.220+0000 7f1f213ef180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-07T08:42:40.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.260+0000 7f7a1b54d700 1 Processor -- start 2023-10-07T08:42:40.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.261+0000 7f7a1b54d700 1 -- start start 2023-10-07T08:42:40.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.261+0000 7f7a1b54d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a14156d60 0x7f7a1406b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.261+0000 7f7a1b54d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1406ac50 con 0x7f7a1406ceb0 2023-10-07T08:42:40.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.261+0000 7f7a1b54d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a140c8fd0 con 0x7f7a140c8880 2023-10-07T08:42:40.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.261+0000 7f7a1b54d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1406a400 con 0x7f7a14156d60 2023-10-07T08:42:40.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.262+0000 7f7a192e9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a14156d60 0x7f7a1406b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.262+0000 7f7a19aea700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7a140c8880 0x7f7a14157840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47834/0 (socket says 172.21.15.89:47834) 2023-10-07T08:42:40.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.262+0000 7f7a19aea700 1 -- 172.21.15.89:0/16791638 learned_addr learned my addr 172.21.15.89:0/16791638 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-10-07T08:42:40.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.262+0000 7f7a192e9700 1 -- 172.21.15.89:0/16791638 >> v1:172.21.15.89:6789/0 conn(0x7f7a140c8880 legacy=0x7f7a14157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.262+0000 7f7a192e9700 1 -- 172.21.15.89:0/16791638 >> v1:172.21.15.81:6789/0 conn(0x7f7a1406ceb0 legacy=0x7f7a14157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.262+0000 7f7a0bfff700 1 -- 172.21.15.89:0/16791638 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537602939 0 0) 0x7f7a140c8fd0 con 0x7f7a140c8880 2023-10-07T08:42:40.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.262+0000 7f7a192e9700 1 -- 172.21.15.89:0/16791638 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a140c8cf0 con 0x7f7a14156d60 2023-10-07T08:42:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.262+0000 7f7a192e9700 1 --2- 172.21.15.89:0/16791638 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a14156d60 0x7f7a1406b0e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009910 tx=0x7f7a040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58dfa7e2a3911261 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.262+0000 7f7a0bfff700 1 -- 172.21.15.89:0/16791638 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0400b860 con 0x7f7a14156d60 2023-10-07T08:42:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.262+0000 7f7a0bfff700 1 -- 172.21.15.89:0/16791638 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0400b9c0 con 0x7f7a14156d60 2023-10-07T08:42:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.262+0000 7f7a0bfff700 1 -- 172.21.15.89:0/16791638 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0400bd60 con 0x7f7a14156d60 2023-10-07T08:42:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.263+0000 7f7a1b54d700 1 -- 172.21.15.89:0/16791638 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a14156d60 msgr2=0x7f7a1406b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.263+0000 7f7a1b54d700 1 --2- 172.21.15.89:0/16791638 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a14156d60 0x7f7a1406b0e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009910 tx=0x7f7a040091a0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.265 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:40.263+0000 7f4cb602d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-07T08:42:40.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.263+0000 7f7a1b54d700 1 -- 172.21.15.89:0/16791638 shutdown_connections 2023-10-07T08:42:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.263+0000 7f7a1b54d700 1 --2- 172.21.15.89:0/16791638 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a14156d60 0x7f7a1406b0e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.263+0000 7f7a1b54d700 1 -- 172.21.15.89:0/16791638 >> 172.21.15.89:0/16791638 conn(0x7f7a140c9ca0 msgr2=0x7f7a140ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.263+0000 7f7a1b54d700 1 -- 172.21.15.89:0/16791638 shutdown_connections 2023-10-07T08:42:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.263+0000 7f7a1b54d700 1 -- 172.21.15.89:0/16791638 wait complete. 2023-10-07T08:42:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.264+0000 7f7a1b54d700 1 Processor -- start 2023-10-07T08:42:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.264+0000 7f7a1b54d700 1 -- start start 2023-10-07T08:42:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a1b54d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a1406ceb0 0x7f7a14154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a1b54d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a140c8880 0x7f7a140c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a1b54d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a14156d60 0x7f7a14144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a1b54d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a14158830 con 0x7f7a14156d60 2023-10-07T08:42:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a1b54d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a14145210 con 0x7f7a140c8880 2023-10-07T08:42:40.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a1b54d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a141679c0 con 0x7f7a1406ceb0 2023-10-07T08:42:40.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a192e9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a1406ceb0 0x7f7a14154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a18ae8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a140c8880 0x7f7a140c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a192e9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a1406ceb0 0x7f7a14154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:42754/0 (socket says 172.21.15.89:42754) 2023-10-07T08:42:40.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a192e9700 1 -- 172.21.15.89:0/993636086 learned_addr learned my addr 172.21.15.89:0/993636086 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-07T08:42:40.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a19aea700 1 --2- 172.21.15.89:0/993636086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a14156d60 0x7f7a14144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a18ae8700 1 -- 172.21.15.89:0/993636086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a1406ceb0 msgr2=0x7f7a14154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a18ae8700 1 --2- 172.21.15.89:0/993636086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a1406ceb0 0x7f7a14154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a18ae8700 1 -- 172.21.15.89:0/993636086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a14156d60 msgr2=0x7f7a14144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a18ae8700 1 --2- 172.21.15.89:0/993636086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a14156d60 0x7f7a14144cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a18ae8700 1 -- 172.21.15.89:0/993636086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a04009420 con 0x7f7a140c8880 2023-10-07T08:42:40.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a18ae8700 1 --2- 172.21.15.89:0/993636086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a140c8880 0x7f7a140c42e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000c590 tx=0x7f7a10007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:40.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.265+0000 7f7a097fa700 1 -- 172.21.15.89:0/993636086 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a10011590 con 0x7f7a140c8880 2023-10-07T08:42:40.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.266+0000 7f7a097fa700 1 -- 172.21.15.89:0/993636086 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a10011710 con 0x7f7a140c8880 2023-10-07T08:42:40.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.266+0000 7f7a097fa700 1 -- 172.21.15.89:0/993636086 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a10011ad0 con 0x7f7a140c8880 2023-10-07T08:42:40.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.266+0000 7f7a1b54d700 1 -- 172.21.15.89:0/993636086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a14167ca0 con 0x7f7a140c8880 2023-10-07T08:42:40.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.266+0000 7f7a1b54d700 1 -- 172.21.15.89:0/993636086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a14158a80 con 0x7f7a140c8880 2023-10-07T08:42:40.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.266+0000 7f7a097fa700 1 -- 172.21.15.89:0/993636086 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7a1001c6c0 con 0x7f7a140c8880 2023-10-07T08:42:40.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.266+0000 7f7a097fa700 1 -- 172.21.15.89:0/993636086 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f7a100128c0 con 0x7f7a140c8880 2023-10-07T08:42:40.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.266+0000 7f7a1b54d700 1 -- 172.21.15.89:0/993636086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a14158ca0 con 0x7f7a140c8880 2023-10-07T08:42:40.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.269+0000 7f7a097fa700 1 -- 172.21.15.89:0/993636086 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7a10017070 con 0x7f7a140c8880 2023-10-07T08:42:40.297 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:40.296+0000 7f1f213ef180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-07T08:42:40.343 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:40.342+0000 7f4cb602d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-07T08:42:40.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.351+0000 7f7a1b54d700 1 -- 172.21.15.89:0/993636086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7f7a1406a1e0 con 0x7f7a140c8880 2023-10-07T08:42:40.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.355+0000 7f7a097fa700 1 -- 172.21.15.89:0/993636086 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7a1001cba0 con 0x7f7a140c8880 2023-10-07T08:42:40.355 INFO:teuthology.orchestra.run.smithi089.stdout:3 2023-10-07T08:42:40.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.356+0000 7f7a1b54d700 1 -- 172.21.15.89:0/993636086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a140c8880 msgr2=0x7f7a140c42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.356+0000 7f7a1b54d700 1 --2- 172.21.15.89:0/993636086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a140c8880 0x7f7a140c42e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000c590 tx=0x7f7a10007ec0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.356+0000 7f7a1b54d700 1 -- 172.21.15.89:0/993636086 shutdown_connections 2023-10-07T08:42:40.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.356+0000 7f7a1b54d700 1 --2- 172.21.15.89:0/993636086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a14156d60 0x7f7a14144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.356+0000 7f7a1b54d700 1 --2- 172.21.15.89:0/993636086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a1406ceb0 0x7f7a14154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.356+0000 7f7a1b54d700 1 --2- 172.21.15.89:0/993636086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a140c8880 0x7f7a140c42e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.356+0000 7f7a1b54d700 1 -- 172.21.15.89:0/993636086 >> 172.21.15.89:0/993636086 conn(0x7f7a140c9ca0 msgr2=0x7f7a140c1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:40.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.356+0000 7f7a1b54d700 1 -- 172.21.15.89:0/993636086 shutdown_connections 2023-10-07T08:42:40.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.356+0000 7f7a1b54d700 1 -- 172.21.15.89:0/993636086 wait complete. 2023-10-07T08:42:40.369 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-10-07T08:42:40.430 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:40.428+0000 7f1f213ef180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-07T08:42:40.485 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:40.484+0000 7f4cb602d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-07T08:42:40.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.487+0000 7f0fa4fdb700 1 Processor -- start 2023-10-07T08:42:40.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.487+0000 7f0fa4fdb700 1 -- start start 2023-10-07T08:42:40.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.487+0000 7f0fa4fdb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0fa006e490 0x7f0fa006cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.487+0000 7f0fa4fdb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0fa006d0e0 0x7f0fa00aa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.487+0000 7f0fa4fdb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa006d540 con 0x7f0fa01577d0 2023-10-07T08:42:40.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.487+0000 7f0fa4fdb700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa00ad0d0 con 0x7f0fa006e490 2023-10-07T08:42:40.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.487+0000 7f0fa4fdb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa00ac790 con 0x7f0fa006d0e0 2023-10-07T08:42:40.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.488+0000 7f0f9f7fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0fa01577d0 0x7f0fa00ac9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47842/0 (socket says 172.21.15.89:47842) 2023-10-07T08:42:40.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.488+0000 7f0f9ffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0fa006d0e0 0x7f0fa00aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.488+0000 7f0f9f7fe700 1 -- 172.21.15.89:0/3581607273 learned_addr learned my addr 172.21.15.89:0/3581607273 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-10-07T08:42:40.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.488+0000 7f0f97fff700 1 --2- 172.21.15.89:0/3581607273 >> v2:172.21.15.81:3300/0 conn(0x7f0fa006e490 0x7f0fa006cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.488+0000 7f0f9effd700 1 -- 172.21.15.89:0/3581607273 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067907998 0 0) 0x7f0f90001110 con 0x7f0fa01577d0 2023-10-07T08:42:40.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.488+0000 7f0f9effd700 1 -- 172.21.15.89:0/3581607273 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f8c003570 con 0x7f0fa01577d0 2023-10-07T08:42:40.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.488+0000 7f0f9ffff700 1 -- 172.21.15.89:0/3581607273 >> v2:172.21.15.81:3300/0 conn(0x7f0fa006e490 msgr2=0x7f0fa006cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:40.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.488+0000 7f0f9ffff700 1 --2- 172.21.15.89:0/3581607273 >> v2:172.21.15.81:3300/0 conn(0x7f0fa006e490 0x7f0fa006cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.488+0000 7f0f9ffff700 1 -- 172.21.15.89:0/3581607273 >> v1:172.21.15.89:6789/0 conn(0x7f0fa01577d0 legacy=0x7f0fa00ac9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.488+0000 7f0f9ffff700 1 -- 172.21.15.89:0/3581607273 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa015a320 con 0x7f0fa006d0e0 2023-10-07T08:42:40.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.488+0000 7f0f9ffff700 1 --2- 172.21.15.89:0/3581607273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fa006d0e0 0x7f0fa00aa890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00ae2f0 tx=0x7f0f98009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41b25148bd24e271 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:40.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.488+0000 7f0f9effd700 1 -- 172.21.15.89:0/3581607273 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9800e070 con 0x7f0fa006d0e0 2023-10-07T08:42:40.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.488+0000 7f0f9effd700 1 -- 172.21.15.89:0/3581607273 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9800bab0 con 0x7f0fa006d0e0 2023-10-07T08:42:40.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.488+0000 7f0f9effd700 1 -- 172.21.15.89:0/3581607273 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9800be70 con 0x7f0fa006d0e0 2023-10-07T08:42:40.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.489+0000 7f0fa4fdb700 1 -- 172.21.15.89:0/3581607273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fa006d0e0 msgr2=0x7f0fa00aa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.489+0000 7f0fa4fdb700 1 --2- 172.21.15.89:0/3581607273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fa006d0e0 0x7f0fa00aa890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00ae2f0 tx=0x7f0f98009780 comp rx=0 tx=0).stop 2023-10-07T08:42:40.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.489+0000 7f0fa4fdb700 1 -- 172.21.15.89:0/3581607273 shutdown_connections 2023-10-07T08:42:40.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.489+0000 7f0fa4fdb700 1 --2- 172.21.15.89:0/3581607273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fa006d0e0 0x7f0fa00aa890 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.489+0000 7f0fa4fdb700 1 --2- 172.21.15.89:0/3581607273 >> v2:172.21.15.81:3300/0 conn(0x7f0fa006e490 0x7f0fa006cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.489+0000 7f0fa4fdb700 1 -- 172.21.15.89:0/3581607273 >> 172.21.15.89:0/3581607273 conn(0x7f0fa00cdb30 msgr2=0x7f0fa006da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:40.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.489+0000 7f0fa4fdb700 1 -- 172.21.15.89:0/3581607273 shutdown_connections 2023-10-07T08:42:40.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.489+0000 7f0fa4fdb700 1 -- 172.21.15.89:0/3581607273 wait complete. 2023-10-07T08:42:40.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.490+0000 7f0fa4fdb700 1 Processor -- start 2023-10-07T08:42:40.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.490+0000 7f0fa4fdb700 1 -- start start 2023-10-07T08:42:40.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0fa4fdb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fa006d0e0 0x7f0fa0154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0fa4fdb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fa006e490 0x7f0fa016d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0fa4fdb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fa01577d0 0x7f0fa016dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0fa4fdb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa016e7e0 con 0x7f0fa006d0e0 2023-10-07T08:42:40.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0fa4fdb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa00c39b0 con 0x7f0fa006e490 2023-10-07T08:42:40.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0fa4fdb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa00c33f0 con 0x7f0fa01577d0 2023-10-07T08:42:40.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0f97fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fa006e490 0x7f0fa016d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0f97fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fa006e490 0x7f0fa016d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42214/0 (socket says 172.21.15.89:42214) 2023-10-07T08:42:40.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0f97fff700 1 -- 172.21.15.89:0/2484981113 learned_addr learned my addr 172.21.15.89:0/2484981113 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-07T08:42:40.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0f9ffff700 1 --2- 172.21.15.89:0/2484981113 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fa01577d0 0x7f0fa016dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0f9f7fe700 1 --2- 172.21.15.89:0/2484981113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fa006d0e0 0x7f0fa0154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0f97fff700 1 -- 172.21.15.89:0/2484981113 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fa01577d0 msgr2=0x7f0fa016dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0f97fff700 1 --2- 172.21.15.89:0/2484981113 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fa01577d0 0x7f0fa016dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0f97fff700 1 -- 172.21.15.89:0/2484981113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fa006d0e0 msgr2=0x7f0fa0154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0f97fff700 1 --2- 172.21.15.89:0/2484981113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fa006d0e0 0x7f0fa0154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0f97fff700 1 -- 172.21.15.89:0/2484981113 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f98009a20 con 0x7f0fa006e490 2023-10-07T08:42:40.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0f9ffff700 1 --2- 172.21.15.89:0/2484981113 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fa01577d0 0x7f0fa016dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:42:40.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.491+0000 7f0f97fff700 1 --2- 172.21.15.89:0/2484981113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fa006e490 0x7f0fa016d960 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800ec50 tx=0x7f0f880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:40.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.492+0000 7f0f977fe700 1 -- 172.21.15.89:0/2484981113 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8800c850 con 0x7f0fa006e490 2023-10-07T08:42:40.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.492+0000 7f0f977fe700 1 -- 172.21.15.89:0/2484981113 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8800c9b0 con 0x7f0fa006e490 2023-10-07T08:42:40.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.492+0000 7f0f977fe700 1 -- 172.21.15.89:0/2484981113 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8800cd70 con 0x7f0fa006e490 2023-10-07T08:42:40.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.492+0000 7f0fa4fdb700 1 -- 172.21.15.89:0/2484981113 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa00c36d0 con 0x7f0fa006e490 2023-10-07T08:42:40.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.492+0000 7f0fa4fdb700 1 -- 172.21.15.89:0/2484981113 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa016b8a0 con 0x7f0fa006e490 2023-10-07T08:42:40.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.492+0000 7f0f977fe700 1 -- 172.21.15.89:0/2484981113 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0f88005c80 con 0x7f0fa006e490 2023-10-07T08:42:40.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.492+0000 7f0fa4fdb700 1 -- 172.21.15.89:0/2484981113 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa00682b0 con 0x7f0fa006e490 2023-10-07T08:42:40.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.493+0000 7f0f977fe700 1 -- 172.21.15.89:0/2484981113 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f0f88006020 con 0x7f0fa006e490 2023-10-07T08:42:40.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.495+0000 7f0f977fe700 1 -- 172.21.15.89:0/2484981113 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0f88021060 con 0x7f0fa006e490 2023-10-07T08:42:40.525 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:40.524+0000 7f1f213ef180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-07T08:42:40.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.577+0000 7f0fa4fdb700 1 -- 172.21.15.89:0/2484981113 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7f0fa00ad6a0 con 0x7f0fa006e490 2023-10-07T08:42:40.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.583+0000 7f0f977fe700 1 -- 172.21.15.89:0/2484981113 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0f8802a0b0 con 0x7f0fa006e490 2023-10-07T08:42:40.584 INFO:teuthology.orchestra.run.smithi089.stdout:4 2023-10-07T08:42:40.585 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:40.584+0000 7f4cb602d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-07T08:42:40.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.584+0000 7f0fa4fdb700 1 -- 172.21.15.89:0/2484981113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fa006e490 msgr2=0x7f0fa016d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.584+0000 7f0fa4fdb700 1 --2- 172.21.15.89:0/2484981113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fa006e490 0x7f0fa016d960 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800ec50 tx=0x7f0f880091a0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.584+0000 7f0fa4fdb700 1 -- 172.21.15.89:0/2484981113 shutdown_connections 2023-10-07T08:42:40.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.584+0000 7f0fa4fdb700 1 --2- 172.21.15.89:0/2484981113 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0fa01577d0 0x7f0fa016dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.584+0000 7f0fa4fdb700 1 --2- 172.21.15.89:0/2484981113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fa006d0e0 0x7f0fa0154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.584+0000 7f0fa4fdb700 1 --2- 172.21.15.89:0/2484981113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0fa006e490 0x7f0fa016d960 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.584+0000 7f0fa4fdb700 1 -- 172.21.15.89:0/2484981113 >> 172.21.15.89:0/2484981113 conn(0x7f0fa00cdb30 msgr2=0x7f0fa0159bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:40.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.584+0000 7f0fa4fdb700 1 -- 172.21.15.89:0/2484981113 shutdown_connections 2023-10-07T08:42:40.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.584+0000 7f0fa4fdb700 1 -- 172.21.15.89:0/2484981113 wait complete. 2023-10-07T08:42:40.597 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-10-07T08:42:40.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.711+0000 7f9914e18700 1 Processor -- start 2023-10-07T08:42:40.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.711+0000 7f9914e18700 1 -- start start 2023-10-07T08:42:40.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.712+0000 7f9914e18700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99101578d0 0x7f99100cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.712+0000 7f9914e18700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f991006d120 0x7f991006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.712+0000 7f9914e18700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991006dac0 con 0x7f9910157ca0 2023-10-07T08:42:40.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.712+0000 7f9914e18700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99100d07c0 con 0x7f991006d120 2023-10-07T08:42:40.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.712+0000 7f9914e18700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99100cfbb0 con 0x7f99101578d0 2023-10-07T08:42:40.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.712+0000 7f990e59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99101578d0 0x7f99100cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.712+0000 7f990dd9b700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9910157ca0 0x7f991015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47850/0 (socket says 172.21.15.89:47850) 2023-10-07T08:42:40.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.712+0000 7f990dd9b700 1 -- 172.21.15.89:0/3955140509 learned_addr learned my addr 172.21.15.89:0/3955140509 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-10-07T08:42:40.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.712+0000 7f990ed9d700 1 --2- 172.21.15.89:0/3955140509 >> v2:172.21.15.81:3300/0 conn(0x7f991006d120 0x7f991006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.712+0000 7f990e59c700 1 -- 172.21.15.89:0/3955140509 >> v2:172.21.15.81:3300/0 conn(0x7f991006d120 msgr2=0x7f991006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:40.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.712+0000 7f990d59a700 1 -- 172.21.15.89:0/3955140509 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436316866 0 0) 0x7f9904001110 con 0x7f9910157ca0 2023-10-07T08:42:40.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.712+0000 7f990e59c700 1 --2- 172.21.15.89:0/3955140509 >> v2:172.21.15.81:3300/0 conn(0x7f991006d120 0x7f991006d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.712+0000 7f990e59c700 1 -- 172.21.15.89:0/3955140509 >> v1:172.21.15.89:6789/0 conn(0x7f9910157ca0 legacy=0x7f991015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.712+0000 7f990e59c700 1 -- 172.21.15.89:0/3955140509 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99100cfe90 con 0x7f99101578d0 2023-10-07T08:42:40.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.712+0000 7f990e59c700 1 --2- 172.21.15.89:0/3955140509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99101578d0 0x7f99100cf4f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f99000098e0 tx=0x7f99000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=535218d99873d76f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:40.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.713+0000 7f990d59a700 1 -- 172.21.15.89:0/3955140509 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9900009e80 con 0x7f99101578d0 2023-10-07T08:42:40.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.713+0000 7f990d59a700 1 -- 172.21.15.89:0/3955140509 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990000b860 con 0x7f99101578d0 2023-10-07T08:42:40.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.713+0000 7f990d59a700 1 -- 172.21.15.89:0/3955140509 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990000bbe0 con 0x7f99101578d0 2023-10-07T08:42:40.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.713+0000 7f9914e18700 1 -- 172.21.15.89:0/3955140509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99101578d0 msgr2=0x7f99100cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.713+0000 7f9914e18700 1 --2- 172.21.15.89:0/3955140509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99101578d0 0x7f99100cf4f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f99000098e0 tx=0x7f99000091a0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.713+0000 7f9914e18700 1 -- 172.21.15.89:0/3955140509 shutdown_connections 2023-10-07T08:42:40.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.713+0000 7f9914e18700 1 --2- 172.21.15.89:0/3955140509 >> v2:172.21.15.81:3300/0 conn(0x7f991006d120 0x7f991006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.713+0000 7f9914e18700 1 --2- 172.21.15.89:0/3955140509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99101578d0 0x7f99100cf4f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.713+0000 7f9914e18700 1 -- 172.21.15.89:0/3955140509 >> 172.21.15.89:0/3955140509 conn(0x7f991006bb90 msgr2=0x7f991006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:40.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.713+0000 7f9914e18700 1 -- 172.21.15.89:0/3955140509 shutdown_connections 2023-10-07T08:42:40.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.713+0000 7f9914e18700 1 -- 172.21.15.89:0/3955140509 wait complete. 2023-10-07T08:42:40.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.714+0000 7f9914e18700 1 Processor -- start 2023-10-07T08:42:40.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.714+0000 7f9914e18700 1 -- start start 2023-10-07T08:42:40.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f9914e18700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f991006d120 0x7f9910143b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f9914e18700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99101578d0 0x7f991015c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f9914e18700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9910157ca0 0x7f991015c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f9914e18700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991015d230 con 0x7f991006d120 2023-10-07T08:42:40.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f9914e18700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99100c7880 con 0x7f99101578d0 2023-10-07T08:42:40.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f9914e18700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99100cb110 con 0x7f9910157ca0 2023-10-07T08:42:40.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f990dd9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99101578d0 0x7f991015c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f990ed9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9910157ca0 0x7f991015c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f990dd9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99101578d0 0x7f991015c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42228/0 (socket says 172.21.15.89:42228) 2023-10-07T08:42:40.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f990ed9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9910157ca0 0x7f991015c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:42778/0 (socket says 172.21.15.89:42778) 2023-10-07T08:42:40.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f990dd9b700 1 -- 172.21.15.89:0/2782049791 learned_addr learned my addr 172.21.15.89:0/2782049791 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-07T08:42:40.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f990e59c700 1 --2- 172.21.15.89:0/2782049791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f991006d120 0x7f9910143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f990dd9b700 1 -- 172.21.15.89:0/2782049791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9910157ca0 msgr2=0x7f991015c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f990dd9b700 1 --2- 172.21.15.89:0/2782049791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9910157ca0 0x7f991015c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f990dd9b700 1 -- 172.21.15.89:0/2782049791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f991006d120 msgr2=0x7f9910143b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f990dd9b700 1 --2- 172.21.15.89:0/2782049791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f991006d120 0x7f9910143b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.715+0000 7f990dd9b700 1 -- 172.21.15.89:0/2782049791 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9900009420 con 0x7f99101578d0 2023-10-07T08:42:40.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.716+0000 7f990ed9d700 1 --2- 172.21.15.89:0/2782049791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9910157ca0 0x7f991015c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:42:40.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.716+0000 7f990dd9b700 1 --2- 172.21.15.89:0/2782049791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99101578d0 0x7f991015c1d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f990400c5e0 tx=0x7f9904001070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:40.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.716+0000 7f98fe7fc700 1 -- 172.21.15.89:0/2782049791 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904005b30 con 0x7f99101578d0 2023-10-07T08:42:40.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.716+0000 7f98fe7fc700 1 -- 172.21.15.89:0/2782049791 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9904005c90 con 0x7f99101578d0 2023-10-07T08:42:40.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.716+0000 7f9914e18700 1 -- 172.21.15.89:0/2782049791 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9910144040 con 0x7f99101578d0 2023-10-07T08:42:40.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.716+0000 7f98fe7fc700 1 -- 172.21.15.89:0/2782049791 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904007300 con 0x7f99101578d0 2023-10-07T08:42:40.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.716+0000 7f9914e18700 1 -- 172.21.15.89:0/2782049791 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99100c7230 con 0x7f99101578d0 2023-10-07T08:42:40.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.716+0000 7f98fe7fc700 1 -- 172.21.15.89:0/2782049791 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f990401c6c0 con 0x7f99101578d0 2023-10-07T08:42:40.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.716+0000 7f98fe7fc700 1 -- 172.21.15.89:0/2782049791 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f9904005e00 con 0x7f99101578d0 2023-10-07T08:42:40.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.717+0000 7f9914e18700 1 -- 172.21.15.89:0/2782049791 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99100c7090 con 0x7f99101578d0 2023-10-07T08:42:40.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.719+0000 7f98fe7fc700 1 -- 172.21.15.89:0/2782049791 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f99100c7090 con 0x7f99101578d0 2023-10-07T08:42:40.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.801+0000 7f9914e18700 1 -- 172.21.15.89:0/2782049791 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7f99100c79c0 con 0x7f99101578d0 2023-10-07T08:42:40.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.810+0000 7f98fe7fc700 1 -- 172.21.15.89:0/2782049791 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9904017070 con 0x7f99101578d0 2023-10-07T08:42:40.811 INFO:teuthology.orchestra.run.smithi089.stdout:5 2023-10-07T08:42:40.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.810+0000 7f9914e18700 1 -- 172.21.15.89:0/2782049791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99101578d0 msgr2=0x7f991015c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.810+0000 7f9914e18700 1 --2- 172.21.15.89:0/2782049791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99101578d0 0x7f991015c1d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f990400c5e0 tx=0x7f9904001070 comp rx=0 tx=0).stop 2023-10-07T08:42:40.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.811+0000 7f9914e18700 1 -- 172.21.15.89:0/2782049791 shutdown_connections 2023-10-07T08:42:40.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.811+0000 7f9914e18700 1 --2- 172.21.15.89:0/2782049791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9910157ca0 0x7f991015c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.811+0000 7f9914e18700 1 --2- 172.21.15.89:0/2782049791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f991006d120 0x7f9910143b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.811+0000 7f9914e18700 1 --2- 172.21.15.89:0/2782049791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99101578d0 0x7f991015c1d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.811+0000 7f9914e18700 1 -- 172.21.15.89:0/2782049791 >> 172.21.15.89:0/2782049791 conn(0x7f991006bb90 msgr2=0x7f99100b5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:40.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.811+0000 7f9914e18700 1 -- 172.21.15.89:0/2782049791 shutdown_connections 2023-10-07T08:42:40.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.811+0000 7f9914e18700 1 -- 172.21.15.89:0/2782049791 wait complete. 2023-10-07T08:42:40.823 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-10-07T08:42:40.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.942+0000 7f12da54d700 1 Processor -- start 2023-10-07T08:42:40.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.942+0000 7f12da54d700 1 -- start start 2023-10-07T08:42:40.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.943+0000 7f12da54d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f12d41578d0 0x7f12d40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.943+0000 7f12da54d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d406d120 0x7f12d406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.943+0000 7f12da54d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d40d07c0 con 0x7f12d4157ca0 2023-10-07T08:42:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.943+0000 7f12da54d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d406daa0 con 0x7f12d41578d0 2023-10-07T08:42:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.943+0000 7f12da54d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d40cfbb0 con 0x7f12d406d120 2023-10-07T08:42:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.943+0000 7f12d3fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f12d41578d0 0x7f12d40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.943+0000 7f12d8aea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d406d120 0x7f12d406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.943+0000 7f12d3fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f12d41578d0 0x7f12d40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42232/0 (socket says 172.21.15.89:42232) 2023-10-07T08:42:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.943+0000 7f12d8aea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d406d120 0x7f12d406d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:42786/0 (socket says 172.21.15.89:42786) 2023-10-07T08:42:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.943+0000 7f12d3fff700 1 -- 172.21.15.89:0/3505090648 learned_addr learned my addr 172.21.15.89:0/3505090648 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-07T08:42:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.943+0000 7f12d8aea700 1 -- 172.21.15.89:0/3505090648 >> v2:172.21.15.89:3300/0 conn(0x7f12d41578d0 msgr2=0x7f12d40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.943+0000 7f12d8aea700 1 --2- 172.21.15.89:0/3505090648 >> v2:172.21.15.89:3300/0 conn(0x7f12d41578d0 0x7f12d40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.943+0000 7f12d8aea700 1 -- 172.21.15.89:0/3505090648 >> v1:172.21.15.81:6789/0 conn(0x7f12d4157ca0 legacy=0x7f12d415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.943+0000 7f12d8aea700 1 -- 172.21.15.89:0/3505090648 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d40cfe90 con 0x7f12d406d120 2023-10-07T08:42:40.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.943+0000 7f12d3fff700 1 --2- 172.21.15.89:0/3505090648 >> v2:172.21.15.89:3300/0 conn(0x7f12d41578d0 0x7f12d40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:42:40.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.943+0000 7f12d8aea700 1 --2- 172.21.15.89:0/3505090648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d406d120 0x7f12d406d560 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009e60 tx=0x7f12cc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38746b7de4a949a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:40.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.944+0000 7f12d2ffd700 1 -- 172.21.15.89:0/3505090648 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc00e070 con 0x7f12d406d120 2023-10-07T08:42:40.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.944+0000 7f12d2ffd700 1 -- 172.21.15.89:0/3505090648 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc00bb60 con 0x7f12d406d120 2023-10-07T08:42:40.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.944+0000 7f12d2ffd700 1 -- 172.21.15.89:0/3505090648 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc012430 con 0x7f12d406d120 2023-10-07T08:42:40.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.944+0000 7f12da54d700 1 -- 172.21.15.89:0/3505090648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d406d120 msgr2=0x7f12d406d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.944+0000 7f12da54d700 1 --2- 172.21.15.89:0/3505090648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d406d120 0x7f12d406d560 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009e60 tx=0x7f12cc009780 comp rx=0 tx=0).stop 2023-10-07T08:42:40.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.944+0000 7f12da54d700 1 -- 172.21.15.89:0/3505090648 shutdown_connections 2023-10-07T08:42:40.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.944+0000 7f12da54d700 1 --2- 172.21.15.89:0/3505090648 >> v2:172.21.15.89:3300/0 conn(0x7f12d41578d0 0x7f12d40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.944+0000 7f12da54d700 1 --2- 172.21.15.89:0/3505090648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d406d120 0x7f12d406d560 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.944+0000 7f12da54d700 1 -- 172.21.15.89:0/3505090648 >> 172.21.15.89:0/3505090648 conn(0x7f12d406bb90 msgr2=0x7f12d406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:40.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.944+0000 7f12da54d700 1 -- 172.21.15.89:0/3505090648 shutdown_connections 2023-10-07T08:42:40.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.944+0000 7f12da54d700 1 -- 172.21.15.89:0/3505090648 wait complete. 2023-10-07T08:42:40.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.945+0000 7f12da54d700 1 Processor -- start 2023-10-07T08:42:40.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.946+0000 7f12da54d700 1 -- start start 2023-10-07T08:42:40.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.946+0000 7f12da54d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d406d120 0x7f12d40b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.946+0000 7f12da54d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12d41578d0 0x7f12d4152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.946+0000 7f12da54d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12d4157ca0 0x7f12d41593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:40.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.946+0000 7f12da54d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d40b4cd0 con 0x7f12d4157ca0 2023-10-07T08:42:40.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.946+0000 7f12da54d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d40b4430 con 0x7f12d41578d0 2023-10-07T08:42:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.946+0000 7f12da54d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d40b4710 con 0x7f12d406d120 2023-10-07T08:42:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.946+0000 7f12d3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d406d120 0x7f12d40b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.946+0000 7f12d37fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12d41578d0 0x7f12d4152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.946+0000 7f12d3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d406d120 0x7f12d40b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:42802/0 (socket says 172.21.15.89:42802) 2023-10-07T08:42:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.946+0000 7f12d3fff700 1 -- 172.21.15.89:0/2299435219 learned_addr learned my addr 172.21.15.89:0/2299435219 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-07T08:42:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.946+0000 7f12d8aea700 1 --2- 172.21.15.89:0/2299435219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12d4157ca0 0x7f12d41593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.947+0000 7f12d37fe700 1 -- 172.21.15.89:0/2299435219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d406d120 msgr2=0x7f12d40b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.947+0000 7f12d37fe700 1 --2- 172.21.15.89:0/2299435219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d406d120 0x7f12d40b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.947+0000 7f12d37fe700 1 -- 172.21.15.89:0/2299435219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12d4157ca0 msgr2=0x7f12d41593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.947+0000 7f12d37fe700 1 --2- 172.21.15.89:0/2299435219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12d4157ca0 0x7f12d41593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.947+0000 7f12d37fe700 1 -- 172.21.15.89:0/2299435219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c80094f0 con 0x7f12d41578d0 2023-10-07T08:42:40.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.947+0000 7f12d3fff700 1 --2- 172.21.15.89:0/2299435219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d406d120 0x7f12d40b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:42:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.947+0000 7f12d37fe700 1 --2- 172.21.15.89:0/2299435219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12d41578d0 0x7f12d4152c80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f12c400c490 tx=0x7f12c4007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.947+0000 7f12bbfff700 1 -- 172.21.15.89:0/2299435219 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c400ce00 con 0x7f12d41578d0 2023-10-07T08:42:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.947+0000 7f12bbfff700 1 -- 172.21.15.89:0/2299435219 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c4011590 con 0x7f12d41578d0 2023-10-07T08:42:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.947+0000 7f12da54d700 1 -- 172.21.15.89:0/2299435219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12cc009a20 con 0x7f12d41578d0 2023-10-07T08:42:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.947+0000 7f12bbfff700 1 -- 172.21.15.89:0/2299435219 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4011950 con 0x7f12d41578d0 2023-10-07T08:42:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.947+0000 7f12da54d700 1 -- 172.21.15.89:0/2299435219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d40b5090 con 0x7f12d41578d0 2023-10-07T08:42:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.948+0000 7f12bbfff700 1 -- 172.21.15.89:0/2299435219 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f12c401c440 con 0x7f12d41578d0 2023-10-07T08:42:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.948+0000 7f12bbfff700 1 -- 172.21.15.89:0/2299435219 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f12c4000f90 con 0x7f12d41578d0 2023-10-07T08:42:40.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.948+0000 7f12da54d700 1 -- 172.21.15.89:0/2299435219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d40b4ef0 con 0x7f12d41578d0 2023-10-07T08:42:40.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:40.952+0000 7f12bbfff700 1 -- 172.21.15.89:0/2299435219 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f12d40b4ef0 con 0x7f12d41578d0 2023-10-07T08:42:41.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.033+0000 7f12da54d700 1 -- 172.21.15.89:0/2299435219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7f12d40ce8b0 con 0x7f12d41578d0 2023-10-07T08:42:41.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.039+0000 7f12bbfff700 1 -- 172.21.15.89:0/2299435219 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f12c4017070 con 0x7f12d41578d0 2023-10-07T08:42:41.040 INFO:teuthology.orchestra.run.smithi089.stdout:6 2023-10-07T08:42:41.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.040+0000 7f12da54d700 1 -- 172.21.15.89:0/2299435219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12d41578d0 msgr2=0x7f12d4152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:41.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.040+0000 7f12da54d700 1 --2- 172.21.15.89:0/2299435219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12d41578d0 0x7f12d4152c80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f12c400c490 tx=0x7f12c4007ec0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.040+0000 7f12da54d700 1 -- 172.21.15.89:0/2299435219 shutdown_connections 2023-10-07T08:42:41.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.040+0000 7f12da54d700 1 --2- 172.21.15.89:0/2299435219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12d4157ca0 0x7f12d41593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.040+0000 7f12da54d700 1 --2- 172.21.15.89:0/2299435219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d406d120 0x7f12d40b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.040+0000 7f12da54d700 1 --2- 172.21.15.89:0/2299435219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12d41578d0 0x7f12d4152c80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.040+0000 7f12da54d700 1 -- 172.21.15.89:0/2299435219 >> 172.21.15.89:0/2299435219 conn(0x7f12d406bb90 msgr2=0x7f12d41557a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:41.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.040+0000 7f12da54d700 1 -- 172.21.15.89:0/2299435219 shutdown_connections 2023-10-07T08:42:41.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.040+0000 7f12da54d700 1 -- 172.21.15.89:0/2299435219 wait complete. 2023-10-07T08:42:41.042 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:41.041+0000 7f1f213ef180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-07T08:42:41.053 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-10-07T08:42:41.117 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:41.116+0000 7f1f213ef180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-07T08:42:41.134 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:41.134+0000 7f4cb602d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-07T08:42:41.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.168+0000 7f8e62e43700 1 Processor -- start 2023-10-07T08:42:41.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.168+0000 7f8e62e43700 1 -- start start 2023-10-07T08:42:41.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.169+0000 7f8e62e43700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e5c0cf240 0x7f8e5c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.169+0000 7f8e62e43700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e5c06d650 0x7f8e5c06da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.169+0000 7f8e62e43700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5c0b0ca0 con 0x7f8e5c15a2a0 2023-10-07T08:42:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.169+0000 7f8e62e43700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c06ea90 con 0x7f8e5c06d650 2023-10-07T08:42:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.169+0000 7f8e62e43700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c0b00d0 con 0x7f8e5c0cf240 2023-10-07T08:42:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.169+0000 7f8e5bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e5c0cf240 0x7f8e5c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.169+0000 7f8e60bdf700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8e5c15a2a0 0x7f8e5c0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47858/0 (socket says 172.21.15.89:47858) 2023-10-07T08:42:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.169+0000 7f8e60bdf700 1 -- 172.21.15.89:0/2748091502 learned_addr learned my addr 172.21.15.89:0/2748091502 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-10-07T08:42:41.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.169+0000 7f8e613e0700 1 --2- 172.21.15.89:0/2748091502 >> v2:172.21.15.81:3300/0 conn(0x7f8e5c06d650 0x7f8e5c06da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:41.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.170+0000 7f8e5b7fe700 1 -- 172.21.15.89:0/2748091502 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920752128 0 0) 0x7f8e5c0b0ca0 con 0x7f8e5c15a2a0 2023-10-07T08:42:41.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.170+0000 7f8e5b7fe700 1 -- 172.21.15.89:0/2748091502 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e4c003570 con 0x7f8e5c15a2a0 2023-10-07T08:42:41.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.170+0000 7f8e5bfff700 1 -- 172.21.15.89:0/2748091502 >> v2:172.21.15.81:3300/0 conn(0x7f8e5c06d650 msgr2=0x7f8e5c06da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:41.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.170+0000 7f8e5bfff700 1 --2- 172.21.15.89:0/2748091502 >> v2:172.21.15.81:3300/0 conn(0x7f8e5c06d650 0x7f8e5c06da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.170+0000 7f8e5bfff700 1 -- 172.21.15.89:0/2748091502 >> v1:172.21.15.89:6789/0 conn(0x7f8e5c15a2a0 legacy=0x7f8e5c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:41.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.170+0000 7f8e5bfff700 1 -- 172.21.15.89:0/2748091502 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c0b0370 con 0x7f8e5c0cf240 2023-10-07T08:42:41.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.170+0000 7f8e5bfff700 1 --2- 172.21.15.89:0/2748091502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e5c0cf240 0x7f8e5c0b1130 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8e480098e0 tx=0x7f8e480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41392e2b1d2a2ce server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:41.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.170+0000 7f8e5b7fe700 1 -- 172.21.15.89:0/2748091502 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48011630 con 0x7f8e5c0cf240 2023-10-07T08:42:41.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.170+0000 7f8e5b7fe700 1 -- 172.21.15.89:0/2748091502 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e48011790 con 0x7f8e5c0cf240 2023-10-07T08:42:41.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.170+0000 7f8e5b7fe700 1 -- 172.21.15.89:0/2748091502 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48011b30 con 0x7f8e5c0cf240 2023-10-07T08:42:41.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.171+0000 7f8e62e43700 1 -- 172.21.15.89:0/2748091502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e5c0cf240 msgr2=0x7f8e5c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:41.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.171+0000 7f8e62e43700 1 --2- 172.21.15.89:0/2748091502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e5c0cf240 0x7f8e5c0b1130 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8e480098e0 tx=0x7f8e480091a0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.171+0000 7f8e62e43700 1 -- 172.21.15.89:0/2748091502 shutdown_connections 2023-10-07T08:42:41.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.171+0000 7f8e62e43700 1 --2- 172.21.15.89:0/2748091502 >> v2:172.21.15.81:3300/0 conn(0x7f8e5c06d650 0x7f8e5c06da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.171+0000 7f8e62e43700 1 --2- 172.21.15.89:0/2748091502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e5c0cf240 0x7f8e5c0b1130 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.171+0000 7f8e62e43700 1 -- 172.21.15.89:0/2748091502 >> 172.21.15.89:0/2748091502 conn(0x7f8e5c067640 msgr2=0x7f8e5c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:41.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.171+0000 7f8e62e43700 1 -- 172.21.15.89:0/2748091502 shutdown_connections 2023-10-07T08:42:41.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.171+0000 7f8e62e43700 1 -- 172.21.15.89:0/2748091502 wait complete. 2023-10-07T08:42:41.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.172+0000 7f8e62e43700 1 Processor -- start 2023-10-07T08:42:41.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.172+0000 7f8e62e43700 1 -- start start 2023-10-07T08:42:41.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e62e43700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e5c06d650 0x7f8e5c153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:41.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e62e43700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e5c0cf240 0x7f8e5c0b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:41.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e62e43700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e5c15a2a0 0x7f8e5c15e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:41.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e62e43700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c15d620 con 0x7f8e5c15a2a0 2023-10-07T08:42:41.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e62e43700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c154330 con 0x7f8e5c0cf240 2023-10-07T08:42:41.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e62e43700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c15ca10 con 0x7f8e5c06d650 2023-10-07T08:42:41.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e60bdf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e5c06d650 0x7f8e5c153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:41.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e5bfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e5c0cf240 0x7f8e5c0b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:41.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e60bdf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e5c06d650 0x7f8e5c153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:42828/0 (socket says 172.21.15.89:42828) 2023-10-07T08:42:41.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e60bdf700 1 -- 172.21.15.89:0/3126871421 learned_addr learned my addr 172.21.15.89:0/3126871421 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-07T08:42:41.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e5bfff700 1 --2- 172.21.15.89:0/3126871421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e5c0cf240 0x7f8e5c0b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42256/0 (socket says 172.21.15.89:42256) 2023-10-07T08:42:41.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e613e0700 1 --2- 172.21.15.89:0/3126871421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e5c15a2a0 0x7f8e5c15e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:41.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e60bdf700 1 -- 172.21.15.89:0/3126871421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e5c0cf240 msgr2=0x7f8e5c0b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:41.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e60bdf700 1 --2- 172.21.15.89:0/3126871421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e5c0cf240 0x7f8e5c0b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e60bdf700 1 -- 172.21.15.89:0/3126871421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e5c15a2a0 msgr2=0x7f8e5c15e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:41.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e60bdf700 1 --2- 172.21.15.89:0/3126871421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e5c15a2a0 0x7f8e5c15e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e60bdf700 1 -- 172.21.15.89:0/3126871421 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e48009420 con 0x7f8e5c06d650 2023-10-07T08:42:41.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e5bfff700 1 --2- 172.21.15.89:0/3126871421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e5c0cf240 0x7f8e5c0b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:42:41.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e60bdf700 1 --2- 172.21.15.89:0/3126871421 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e5c06d650 0x7f8e5c153df0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000c590 tx=0x7f8e50007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:41.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e58ff9700 1 -- 172.21.15.89:0/3126871421 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e50005b30 con 0x7f8e5c06d650 2023-10-07T08:42:41.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e58ff9700 1 -- 172.21.15.89:0/3126871421 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e50005cb0 con 0x7f8e5c06d650 2023-10-07T08:42:41.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e58ff9700 1 -- 172.21.15.89:0/3126871421 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e50007320 con 0x7f8e5c06d650 2023-10-07T08:42:41.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e62e43700 1 -- 172.21.15.89:0/3126871421 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5c15ccf0 con 0x7f8e5c06d650 2023-10-07T08:42:41.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.173+0000 7f8e62e43700 1 -- 172.21.15.89:0/3126871421 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c15d2b0 con 0x7f8e5c06d650 2023-10-07T08:42:41.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.174+0000 7f8e58ff9700 1 -- 172.21.15.89:0/3126871421 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8e5001c6c0 con 0x7f8e5c06d650 2023-10-07T08:42:41.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.174+0000 7f8e58ff9700 1 -- 172.21.15.89:0/3126871421 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f8e50005e20 con 0x7f8e5c06d650 2023-10-07T08:42:41.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.175+0000 7f8e62e43700 1 -- 172.21.15.89:0/3126871421 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5c069e40 con 0x7f8e5c06d650 2023-10-07T08:42:41.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.177+0000 7f8e58ff9700 1 -- 172.21.15.89:0/3126871421 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8e50017070 con 0x7f8e5c06d650 2023-10-07T08:42:41.194 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:41.193+0000 7f1f213ef180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-07T08:42:41.229 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:41.228+0000 7f4cb602d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-07T08:42:41.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.273+0000 7f8e62e43700 1 -- 172.21.15.89:0/3126871421 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7f8e5c0ae6e0 con 0x7f8e5c06d650 2023-10-07T08:42:41.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.281+0000 7f8e58ff9700 1 -- 172.21.15.89:0/3126871421 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e50007750 con 0x7f8e5c06d650 2023-10-07T08:42:41.282 INFO:teuthology.orchestra.run.smithi089.stdout:7 2023-10-07T08:42:41.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.282+0000 7f8e62e43700 1 -- 172.21.15.89:0/3126871421 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e5c06d650 msgr2=0x7f8e5c153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:41.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.282+0000 7f8e62e43700 1 --2- 172.21.15.89:0/3126871421 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e5c06d650 0x7f8e5c153df0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000c590 tx=0x7f8e50007e00 comp rx=0 tx=0).stop 2023-10-07T08:42:41.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.282+0000 7f8e62e43700 1 -- 172.21.15.89:0/3126871421 shutdown_connections 2023-10-07T08:42:41.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.282+0000 7f8e62e43700 1 --2- 172.21.15.89:0/3126871421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e5c15a2a0 0x7f8e5c15e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.282+0000 7f8e62e43700 1 --2- 172.21.15.89:0/3126871421 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e5c06d650 0x7f8e5c153df0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.282+0000 7f8e62e43700 1 --2- 172.21.15.89:0/3126871421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e5c0cf240 0x7f8e5c0b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.282+0000 7f8e62e43700 1 -- 172.21.15.89:0/3126871421 >> 172.21.15.89:0/3126871421 conn(0x7f8e5c067640 msgr2=0x7f8e5c157e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:41.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.282+0000 7f8e62e43700 1 -- 172.21.15.89:0/3126871421 shutdown_connections 2023-10-07T08:42:41.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-07T08:42:41.282+0000 7f8e62e43700 1 -- 172.21.15.89:0/3126871421 wait complete. 2023-10-07T08:42:41.294 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-07T08:42:41.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-07T08:42:41.296 INFO:tasks.ceph.osd.0:Started 2023-10-07T08:42:41.297 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-07T08:42:41.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-07T08:42:41.299 INFO:tasks.ceph.osd.1:Started 2023-10-07T08:42:41.299 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-07T08:42:41.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-07T08:42:41.301 INFO:tasks.ceph.osd.2:Started 2023-10-07T08:42:41.301 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-07T08:42:41.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-07T08:42:41.303 INFO:tasks.ceph.osd.3:Started 2023-10-07T08:42:41.303 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-07T08:42:41.303 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-07T08:42:41.305 INFO:tasks.ceph.osd.4:Started 2023-10-07T08:42:41.305 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-07T08:42:41.305 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-07T08:42:41.307 INFO:tasks.ceph.osd.5:Started 2023-10-07T08:42:41.307 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-07T08:42:41.307 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-07T08:42:41.308 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:41.308+0000 7f4cb602d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-07T08:42:41.309 INFO:tasks.ceph.osd.6:Started 2023-10-07T08:42:41.309 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-07T08:42:41.309 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-07T08:42:41.313 INFO:tasks.ceph.osd.7:Started 2023-10-07T08:42:41.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:42:41.382 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-10-07T08:42:41.382+0000 7fd930e23540 -1 Falling back to public interface 2023-10-07T08:42:41.383 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-10-07T08:42:41.382+0000 7f88b099a540 -1 Falling back to public interface 2023-10-07T08:42:41.387 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-10-07T08:42:41.387+0000 7f9e9f122540 -1 Falling back to public interface 2023-10-07T08:42:41.389 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-10-07T08:42:41.388+0000 7f3b90e0a540 -1 Falling back to public interface 2023-10-07T08:42:41.395 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-10-07T08:42:41.395+0000 7fd930e23540 -1 osd.4 0 log_to_monitors true 2023-10-07T08:42:41.399 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-10-07T08:42:41.398+0000 7f88b099a540 -1 osd.0 0 log_to_monitors true 2023-10-07T08:42:41.403 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-10-07T08:42:41.402+0000 7f3b90e0a540 -1 osd.3 0 log_to_monitors true 2023-10-07T08:42:41.404 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-10-07T08:42:41.403+0000 7f2b804d2540 -1 Falling back to public interface 2023-10-07T08:42:41.406 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-10-07T08:42:41.406+0000 7f9e9f122540 -1 osd.7 0 log_to_monitors true 2023-10-07T08:42:41.406 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-10-07T08:42:41.406+0000 7f5e519d4540 -1 Falling back to public interface 2023-10-07T08:42:41.407 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-10-07T08:42:41.405+0000 7f1dbe3d6540 -1 Falling back to public interface 2023-10-07T08:42:41.407 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-10-07T08:42:41.406+0000 7f4021740540 -1 Falling back to public interface 2023-10-07T08:42:41.418 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-10-07T08:42:41.418+0000 7f2b804d2540 -1 osd.5 0 log_to_monitors true 2023-10-07T08:42:41.420 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-10-07T08:42:41.419+0000 7f5e519d4540 -1 osd.6 0 log_to_monitors true 2023-10-07T08:42:41.423 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-10-07T08:42:41.422+0000 7f4021740540 -1 osd.1 0 log_to_monitors true 2023-10-07T08:42:41.423 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-10-07T08:42:41.422+0000 7f1dbe3d6540 -1 osd.2 0 log_to_monitors true 2023-10-07T08:42:41.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.477+0000 7f3334f38700 1 Processor -- start 2023-10-07T08:42:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.477+0000 7f3334f38700 1 -- start start 2023-10-07T08:42:41.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.478+0000 7f3334f38700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f33300ce1f0 0x7f33300aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:41.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.478+0000 7f3334f38700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333015dfb0 con 0x7f33300ac570 2023-10-07T08:42:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.478+0000 7f3334f38700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33300acec0 con 0x7f33300ce5c0 2023-10-07T08:42:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.478+0000 7f3334f38700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33300ad1a0 con 0x7f33300ce1f0 2023-10-07T08:42:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.478+0000 7f332ed9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f33300ac570 0x7f333006e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57896/0 (socket says 172.21.15.81:57896) 2023-10-07T08:42:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.478+0000 7f332ed9d700 1 -- 172.21.15.81:0/263993790 learned_addr learned my addr 172.21.15.81:0/263993790 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:42:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.478+0000 7f332e59c700 1 --2- 172.21.15.81:0/263993790 >> v2:172.21.15.89:3300/0 conn(0x7f33300ce1f0 0x7f33300aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.479+0000 7f332d59a700 1 -- 172.21.15.81:0/263993790 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295143222 0 0) 0x7f333015dfb0 con 0x7f33300ac570 2023-10-07T08:42:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.479+0000 7f332d59a700 1 -- 172.21.15.81:0/263993790 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3318003570 con 0x7f33300ac570 2023-10-07T08:42:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.479+0000 7f332e59c700 1 -- 172.21.15.81:0/263993790 >> v1:172.21.15.89:6789/0 conn(0x7f33300ce5c0 legacy=0x7f333015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.479+0000 7f332d59a700 1 -- 172.21.15.81:0/263993790 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220823069 0 0) 0x7f33300acec0 con 0x7f33300ce5c0 2023-10-07T08:42:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.479+0000 7f332e59c700 1 -- 172.21.15.81:0/263993790 >> v1:172.21.15.81:6789/0 conn(0x7f33300ac570 legacy=0x7f333006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.479+0000 7f332e59c700 1 -- 172.21.15.81:0/263993790 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333015dc40 con 0x7f33300ce1f0 2023-10-07T08:42:41.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.479+0000 7f332e59c700 1 --2- 172.21.15.81:0/263993790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33300ce1f0 0x7f33300aacf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f33240098e0 tx=0x7f33240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=349720650943c570 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:41.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.479+0000 7f332d59a700 1 -- 172.21.15.81:0/263993790 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332400b640 con 0x7f33300ce1f0 2023-10-07T08:42:41.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.479+0000 7f332d59a700 1 -- 172.21.15.81:0/263993790 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332400b7a0 con 0x7f33300ce1f0 2023-10-07T08:42:41.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.479+0000 7f332d59a700 1 -- 172.21.15.81:0/263993790 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332400bb40 con 0x7f33300ce1f0 2023-10-07T08:42:41.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.480+0000 7f3334f38700 1 -- 172.21.15.81:0/263993790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33300ce1f0 msgr2=0x7f33300aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:41.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.480+0000 7f3334f38700 1 --2- 172.21.15.81:0/263993790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33300ce1f0 0x7f33300aacf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f33240098e0 tx=0x7f33240091a0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.480+0000 7f3334f38700 1 -- 172.21.15.81:0/263993790 shutdown_connections 2023-10-07T08:42:41.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.480+0000 7f3334f38700 1 --2- 172.21.15.81:0/263993790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33300ce1f0 0x7f33300aacf0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.480+0000 7f3334f38700 1 -- 172.21.15.81:0/263993790 >> 172.21.15.81:0/263993790 conn(0x7f333006cca0 msgr2=0x7f333006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:41.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.480+0000 7f3334f38700 1 -- 172.21.15.81:0/263993790 shutdown_connections 2023-10-07T08:42:41.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.480+0000 7f3334f38700 1 -- 172.21.15.81:0/263993790 wait complete. 2023-10-07T08:42:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.481+0000 7f3334f38700 1 Processor -- start 2023-10-07T08:42:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.481+0000 7f3334f38700 1 -- start start 2023-10-07T08:42:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.481+0000 7f3334f38700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33300ac570 0x7f333015ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.481+0000 7f3334f38700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33300ce1f0 0x7f33301558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.481+0000 7f3334f38700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33300ce5c0 0x7f333015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.481+0000 7f3334f38700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333015ca90 con 0x7f33300ce5c0 2023-10-07T08:42:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.481+0000 7f3334f38700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33300c36f0 con 0x7f33300ce1f0 2023-10-07T08:42:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.481+0000 7f3334f38700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333015b250 con 0x7f33300ac570 2023-10-07T08:42:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f332ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33300ce5c0 0x7f333015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:41.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f332ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33300ce5c0 0x7f333015cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59172/0 (socket says 172.21.15.81:59172) 2023-10-07T08:42:41.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f332ed9d700 1 -- 172.21.15.81:0/2040088088 learned_addr learned my addr 172.21.15.81:0/2040088088 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:41.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f332e59c700 1 --2- 172.21.15.81:0/2040088088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33300ac570 0x7f333015ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:41.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f332dd9b700 1 --2- 172.21.15.81:0/2040088088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33300ce1f0 0x7f33301558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:41.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f332ed9d700 1 -- 172.21.15.81:0/2040088088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33300ac570 msgr2=0x7f333015ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:41.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f332ed9d700 1 --2- 172.21.15.81:0/2040088088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33300ac570 0x7f333015ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f332ed9d700 1 -- 172.21.15.81:0/2040088088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33300ce1f0 msgr2=0x7f33301558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:41.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f332ed9d700 1 --2- 172.21.15.81:0/2040088088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33300ce1f0 0x7f33301558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f332ed9d700 1 -- 172.21.15.81:0/2040088088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3324009420 con 0x7f33300ce5c0 2023-10-07T08:42:41.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f332ed9d700 1 --2- 172.21.15.81:0/2040088088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33300ce5c0 0x7f333015cf20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f332800cc70 tx=0x7f3328001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:41.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f331e7fc700 1 -- 172.21.15.81:0/2040088088 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332800a810 con 0x7f33300ce5c0 2023-10-07T08:42:41.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f331e7fc700 1 -- 172.21.15.81:0/2040088088 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332800a970 con 0x7f33300ce5c0 2023-10-07T08:42:41.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f3334f38700 1 -- 172.21.15.81:0/2040088088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333015be80 con 0x7f33300ce5c0 2023-10-07T08:42:41.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f331e7fc700 1 -- 172.21.15.81:0/2040088088 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332800acf0 con 0x7f33300ce5c0 2023-10-07T08:42:41.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f3334f38700 1 -- 172.21.15.81:0/2040088088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333015c440 con 0x7f33300ce5c0 2023-10-07T08:42:41.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f331e7fc700 1 -- 172.21.15.81:0/2040088088 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3328007300 con 0x7f33300ce5c0 2023-10-07T08:42:41.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.482+0000 7f331e7fc700 1 -- 172.21.15.81:0/2040088088 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f3328012ae0 con 0x7f33300ce5c0 2023-10-07T08:42:41.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.483+0000 7f3334f38700 1 -- 172.21.15.81:0/2040088088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3330063d20 con 0x7f33300ce5c0 2023-10-07T08:42:41.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.485+0000 7f331e7fc700 1 -- 172.21.15.81:0/2040088088 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3330063d20 con 0x7f33300ce5c0 2023-10-07T08:42:41.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.555+0000 7f3334f38700 1 -- 172.21.15.81:0/2040088088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3330068960 con 0x7f33300ce5c0 2023-10-07T08:42:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.556+0000 7f331e7fc700 1 -- 172.21.15.81:0/2040088088 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f3328012dc0 con 0x7f33300ce5c0 2023-10-07T08:42:41.557 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:41.558 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:41.275089+0000","last_up_change":"0.000000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:42:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.557+0000 7f3334f38700 1 -- 172.21.15.81:0/2040088088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33300ce5c0 msgr2=0x7f333015cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.557+0000 7f3334f38700 1 --2- 172.21.15.81:0/2040088088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33300ce5c0 0x7f333015cf20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f332800cc70 tx=0x7f3328001a40 comp rx=0 tx=0).stop 2023-10-07T08:42:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.557+0000 7f3334f38700 1 -- 172.21.15.81:0/2040088088 shutdown_connections 2023-10-07T08:42:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.557+0000 7f3334f38700 1 --2- 172.21.15.81:0/2040088088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33300ce5c0 0x7f333015cf20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.557+0000 7f3334f38700 1 --2- 172.21.15.81:0/2040088088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33300ac570 0x7f333015ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.557+0000 7f3334f38700 1 --2- 172.21.15.81:0/2040088088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33300ce1f0 0x7f33301558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.557+0000 7f3334f38700 1 -- 172.21.15.81:0/2040088088 >> 172.21.15.81:0/2040088088 conn(0x7f333006cca0 msgr2=0x7f33301564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.557+0000 7f3334f38700 1 -- 172.21.15.81:0/2040088088 shutdown_connections 2023-10-07T08:42:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:41.557+0000 7f3334f38700 1 -- 172.21.15.81:0/2040088088 wait complete. 2023-10-07T08:42:41.570 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-07T08:42:41.570 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-07T08:42:41.822 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:41.820+0000 7f1f213ef180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-07T08:42:41.896 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:41.895+0000 7f4cb602d180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-07T08:42:41.958 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:41.957+0000 7f1f213ef180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-07T08:42:42.032 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:42.031+0000 7f4cb602d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-07T08:42:42.049 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:42.047+0000 7f1f213ef180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-07T08:42:42.123 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:42.122+0000 7f4cb602d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-07T08:42:42.295 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:42.294+0000 7f1f213ef180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-07T08:42:42.370 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:42.369+0000 7f4cb602d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-07T08:42:42.372 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:42.371+0000 7f1f213ef180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-07T08:42:42.376 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-07T08:42:42.446 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:42.446+0000 7f4cb602d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-07T08:42:42.484 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.483+0000 7feb6313e700 1 Processor -- start 2023-10-07T08:42:42.485 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.483+0000 7feb6313e700 1 -- start start 2023-10-07T08:42:42.487 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.484+0000 7feb6313e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb5c06d950 0x7feb5c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:42.487 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.484+0000 7feb6313e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5c0cfdd0 con 0x7feb5c1577e0 2023-10-07T08:42:42.487 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.484+0000 7feb6313e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5c0d00b0 con 0x7feb5c157bb0 2023-10-07T08:42:42.487 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.484+0000 7feb6313e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c0d0390 con 0x7feb5c06d950 2023-10-07T08:42:42.487 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.484+0000 7feb60eda700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feb5c1577e0 0x7feb5c0cf510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47026/0 (socket says 172.21.15.81:47026) 2023-10-07T08:42:42.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.484+0000 7feb60eda700 1 -- 172.21.15.81:0/923937977 learned_addr learned my addr 172.21.15.81:0/923937977 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:42:42.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.484+0000 7feb616db700 1 --2- 172.21.15.81:0/923937977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb5c06d950 0x7feb5c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:42.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.484+0000 7feb5b7fe700 1 -- 172.21.15.81:0/923937977 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564060380 0 0) 0x7feb5c0cfdd0 con 0x7feb5c1577e0 2023-10-07T08:42:42.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.485+0000 7feb5b7fe700 1 -- 172.21.15.81:0/923937977 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb4c003570 con 0x7feb5c1577e0 2023-10-07T08:42:42.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.485+0000 7feb5b7fe700 1 -- 172.21.15.81:0/923937977 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269523770 0 0) 0x7feb5c0d00b0 con 0x7feb5c157bb0 2023-10-07T08:42:42.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.485+0000 7feb5b7fe700 1 -- 172.21.15.81:0/923937977 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb5c0cfdd0 con 0x7feb5c157bb0 2023-10-07T08:42:42.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.485+0000 7feb616db700 1 -- 172.21.15.81:0/923937977 >> v1:172.21.15.89:6789/0 conn(0x7feb5c157bb0 legacy=0x7feb5c06d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:42.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.485+0000 7feb616db700 1 -- 172.21.15.81:0/923937977 >> v1:172.21.15.81:6789/0 conn(0x7feb5c1577e0 legacy=0x7feb5c0cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:42.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.485+0000 7feb5b7fe700 1 -- 172.21.15.81:0/923937977 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2352462459 0 0) 0x7feb4c003570 con 0x7feb5c1577e0 2023-10-07T08:42:42.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.485+0000 7feb616db700 1 -- 172.21.15.81:0/923937977 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c0d0670 con 0x7feb5c06d950 2023-10-07T08:42:42.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.485+0000 7feb616db700 1 --2- 172.21.15.81:0/923937977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb5c06d950 0x7feb5c15b070 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7feb54009e90 tx=0x7feb54009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69bae067b0db891d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:42.488 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.485+0000 7feb5b7fe700 1 -- 172.21.15.81:0/923937977 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5400e070 con 0x7feb5c06d950 2023-10-07T08:42:42.489 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.485+0000 7feb5b7fe700 1 -- 172.21.15.81:0/923937977 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5400b870 con 0x7feb5c06d950 2023-10-07T08:42:42.489 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.485+0000 7feb5b7fe700 1 -- 172.21.15.81:0/923937977 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50001470 con 0x7feb5c06d950 2023-10-07T08:42:42.489 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.486+0000 7feb6313e700 1 -- 172.21.15.81:0/923937977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb5c06d950 msgr2=0x7feb5c15b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:42.489 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.486+0000 7feb6313e700 1 --2- 172.21.15.81:0/923937977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb5c06d950 0x7feb5c15b070 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7feb54009e90 tx=0x7feb54009780 comp rx=0 tx=0).stop 2023-10-07T08:42:42.489 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.486+0000 7feb6313e700 1 -- 172.21.15.81:0/923937977 shutdown_connections 2023-10-07T08:42:42.489 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.486+0000 7feb6313e700 1 --2- 172.21.15.81:0/923937977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb5c06d950 0x7feb5c15b070 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:42.489 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.486+0000 7feb6313e700 1 -- 172.21.15.81:0/923937977 >> 172.21.15.81:0/923937977 conn(0x7feb5c06bb90 msgr2=0x7feb5c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:42.489 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.486+0000 7feb6313e700 1 -- 172.21.15.81:0/923937977 shutdown_connections 2023-10-07T08:42:42.489 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.486+0000 7feb6313e700 1 -- 172.21.15.81:0/923937977 wait complete. 2023-10-07T08:42:42.491 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.487+0000 7feb6313e700 1 Processor -- start 2023-10-07T08:42:42.491 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.487+0000 7feb6313e700 1 -- start start 2023-10-07T08:42:42.492 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb6313e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb5c06d950 0x7feb5c0b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:42.492 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb6313e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb5c1577e0 0x7feb5c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:42.492 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb6313e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c157bb0 0x7feb5c158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:42.492 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb6313e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c069e20 con 0x7feb5c157bb0 2023-10-07T08:42:42.492 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb6313e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c06a100 con 0x7feb5c06d950 2023-10-07T08:42:42.492 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb6313e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c06a3e0 con 0x7feb5c1577e0 2023-10-07T08:42:42.492 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb616db700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c157bb0 0x7feb5c158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:42.492 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb616db700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c157bb0 0x7feb5c158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36460/0 (socket says 172.21.15.81:36460) 2023-10-07T08:42:42.492 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb616db700 1 -- 172.21.15.81:0/999078905 learned_addr learned my addr 172.21.15.81:0/999078905 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:42.492 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb60eda700 1 --2- 172.21.15.81:0/999078905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb5c06d950 0x7feb5c0b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:42.492 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb5bfff700 1 --2- 172.21.15.81:0/999078905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb5c1577e0 0x7feb5c069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:42.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb616db700 1 -- 172.21.15.81:0/999078905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb5c1577e0 msgr2=0x7feb5c069590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:42.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb616db700 1 --2- 172.21.15.81:0/999078905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb5c1577e0 0x7feb5c069590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:42.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb616db700 1 -- 172.21.15.81:0/999078905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb5c06d950 msgr2=0x7feb5c0b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:42.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb616db700 1 --2- 172.21.15.81:0/999078905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb5c06d950 0x7feb5c0b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:42.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb616db700 1 -- 172.21.15.81:0/999078905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb54009a20 con 0x7feb5c157bb0 2023-10-07T08:42:42.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb616db700 1 --2- 172.21.15.81:0/999078905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c157bb0 0x7feb5c158c80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feb54003000 tx=0x7feb54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:42.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb58ff9700 1 -- 172.21.15.81:0/999078905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb54012c20 con 0x7feb5c157bb0 2023-10-07T08:42:42.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb58ff9700 1 -- 172.21.15.81:0/999078905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb54012d80 con 0x7feb5c157bb0 2023-10-07T08:42:42.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb6313e700 1 -- 172.21.15.81:0/999078905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5c06a6c0 con 0x7feb5c157bb0 2023-10-07T08:42:42.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.488+0000 7feb58ff9700 1 -- 172.21.15.81:0/999078905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5401e6a0 con 0x7feb5c157bb0 2023-10-07T08:42:42.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.489+0000 7feb6313e700 1 -- 172.21.15.81:0/999078905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5c069ad0 con 0x7feb5c157bb0 2023-10-07T08:42:42.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.489+0000 7feb58ff9700 1 -- 172.21.15.81:0/999078905 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7feb5401ead0 con 0x7feb5c157bb0 2023-10-07T08:42:42.494 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.489+0000 7feb58ff9700 1 -- 172.21.15.81:0/999078905 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1879+0+0 (secure 0 0 0) 0x7feb5401cbb0 con 0x7feb5c157bb0 2023-10-07T08:42:42.494 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.489+0000 7feb6313e700 1 -- 172.21.15.81:0/999078905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5c06ab60 con 0x7feb5c157bb0 2023-10-07T08:42:42.494 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.491+0000 7feb58ff9700 1 -- 172.21.15.81:0/999078905 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7feb5402b060 con 0x7feb5c157bb0 2023-10-07T08:42:42.564 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.562+0000 7feb6313e700 1 -- 172.21.15.81:0/999078905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb5c04bb80 con 0x7feb5c157bb0 2023-10-07T08:42:42.565 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.563+0000 7feb58ff9700 1 -- 172.21.15.81:0/999078905 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7013 (secure 0 0 0) 0x7feb54016020 con 0x7feb5c157bb0 2023-10-07T08:42:42.565 INFO:teuthology.misc.health.smithi081.stdout: 2023-10-07T08:42:42.565 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":11,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:42.278234+0000","last_up_change":"0.000000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:42:42.566 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.564+0000 7feb6313e700 1 -- 172.21.15.81:0/999078905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c157bb0 msgr2=0x7feb5c158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:42.566 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.564+0000 7feb6313e700 1 --2- 172.21.15.81:0/999078905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c157bb0 0x7feb5c158c80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feb54003000 tx=0x7feb54017000 comp rx=0 tx=0).stop 2023-10-07T08:42:42.566 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.564+0000 7feb6313e700 1 -- 172.21.15.81:0/999078905 shutdown_connections 2023-10-07T08:42:42.566 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.564+0000 7feb6313e700 1 --2- 172.21.15.81:0/999078905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5c157bb0 0x7feb5c158c80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:42.566 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.564+0000 7feb6313e700 1 --2- 172.21.15.81:0/999078905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb5c06d950 0x7feb5c0b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:42.566 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.564+0000 7feb6313e700 1 --2- 172.21.15.81:0/999078905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb5c1577e0 0x7feb5c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:42.567 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.564+0000 7feb6313e700 1 -- 172.21.15.81:0/999078905 >> 172.21.15.81:0/999078905 conn(0x7feb5c06bb90 msgr2=0x7feb5c156730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:42.567 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.564+0000 7feb6313e700 1 -- 172.21.15.81:0/999078905 shutdown_connections 2023-10-07T08:42:42.567 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:42.564+0000 7feb6313e700 1 -- 172.21.15.81:0/999078905 wait complete. 2023-10-07T08:42:42.576 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-07T08:42:43.201 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:43.200+0000 7f1f213ef180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-07T08:42:43.263 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:43.262+0000 7f4cb602d180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-07T08:42:43.275 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:43.274+0000 7f1f213ef180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-07T08:42:43.297 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-10-07T08:42:43.297+0000 7f5e48df7700 -1 osd.6 0 waiting for initial osdmap 2023-10-07T08:42:43.298 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-10-07T08:42:43.298+0000 7f5e42bf0700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T08:42:43.303 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-10-07T08:42:43.302+0000 7f1db5ffa700 -1 osd.2 0 waiting for initial osdmap 2023-10-07T08:42:43.304 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-10-07T08:42:43.303+0000 7f1daf5f2700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T08:42:43.304 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-10-07T08:42:43.303+0000 7f3b8822d700 -1 osd.3 0 waiting for initial osdmap 2023-10-07T08:42:43.305 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-10-07T08:42:43.304+0000 7f88a7dbd700 -1 osd.0 0 waiting for initial osdmap 2023-10-07T08:42:43.305 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-10-07T08:42:43.304+0000 7f4018b63700 -1 osd.1 0 waiting for initial osdmap 2023-10-07T08:42:43.305 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-10-07T08:42:43.305+0000 7fd928246700 -1 osd.4 0 waiting for initial osdmap 2023-10-07T08:42:43.306 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-10-07T08:42:43.305+0000 7f9e96d46700 -1 osd.7 0 waiting for initial osdmap 2023-10-07T08:42:43.306 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-10-07T08:42:43.305+0000 7f2b778f5700 -1 osd.5 0 waiting for initial osdmap 2023-10-07T08:42:43.306 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-10-07T08:42:43.305+0000 7f3b82026700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T08:42:43.307 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-10-07T08:42:43.305+0000 7f88a1bb6700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T08:42:43.307 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-10-07T08:42:43.306+0000 7f401295c700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T08:42:43.307 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-10-07T08:42:43.306+0000 7fd92203f700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T08:42:43.307 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-10-07T08:42:43.306+0000 7f2b716ee700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T08:42:43.308 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-10-07T08:42:43.306+0000 7f9e9033e700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-07T08:42:43.348 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:43.348+0000 7f4cb602d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-07T08:42:43.362 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:43.361+0000 7f1f213ef180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-07T08:42:43.422 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:43.422+0000 7f4cb602d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-07T08:42:43.494 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:43.492+0000 7f1f213ef180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-07T08:42:43.554 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:43.554+0000 7f4cb602d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-07T08:42:43.621 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:43.620+0000 7f1f213ef180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-07T08:42:43.637 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:43.637+0000 7f4cb602d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-07T08:42:43.771 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:43.770+0000 7f1f213ef180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-07T08:42:43.788 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:43.788+0000 7f4cb602d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-07T08:42:43.847 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:43.846+0000 7f1f213ef180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-07T08:42:43.863 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:43.863+0000 7f4cb602d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-07T08:42:43.922 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:43.921+0000 7f1f213ef180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-07T08:42:43.937 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:43.937+0000 7f4cb602d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-07T08:42:43.996 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:43.995+0000 7f1f213ef180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-07T08:42:44.013 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-07T08:42:44.012+0000 7f4cb602d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-07T08:42:45.012 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:45.011+0000 7f1eda7f0700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-07T08:42:45.013 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-07T08:42:45.012+0000 7f1eda7f0700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-07T08:42:49.383 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-07T08:42:49.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.492+0000 7f370b7ae700 1 Processor -- start 2023-10-07T08:42:49.493 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.492+0000 7f370b7ae700 1 -- start start 2023-10-07T08:42:49.501 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.493+0000 7f370b7ae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f370415a2f0 0x7f37040cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:49.501 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.493+0000 7f370b7ae700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f37040cc760 0x7f37040c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:49.502 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.493+0000 7f370b7ae700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37040b1550 con 0x7f37040c9710 2023-10-07T08:42:49.502 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.493+0000 7f370b7ae700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370415a6c0 con 0x7f37040cc760 2023-10-07T08:42:49.502 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.493+0000 7f370b7ae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37040ce6b0 con 0x7f370415a2f0 2023-10-07T08:42:49.502 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.493+0000 7f3708d49700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f37040cc760 0x7f37040c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:49.502 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.493+0000 7f370954a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f370415a2f0 0x7f37040cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:49.502 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.493+0000 7f3709d4b700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f37040c9710 0x7f370406cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:35724/0 (socket says 172.21.15.81:35724) 2023-10-07T08:42:49.502 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.493+0000 7f3709d4b700 1 -- 172.21.15.81:0/3873534939 learned_addr learned my addr 172.21.15.81:0/3873534939 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:42:49.503 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.493+0000 7f3708d49700 1 -- 172.21.15.81:0/3873534939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f370415a2f0 msgr2=0x7f37040cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:49.503 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.493+0000 7f3708d49700 1 --2- 172.21.15.81:0/3873534939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f370415a2f0 0x7f37040cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:49.503 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.493+0000 7f3708d49700 1 -- 172.21.15.81:0/3873534939 >> v1:172.21.15.89:6789/0 conn(0x7f37040c9710 legacy=0x7f370406cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:49.503 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.493+0000 7f3708d49700 1 -- 172.21.15.81:0/3873534939 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37040ce0a0 con 0x7f37040cc760 2023-10-07T08:42:49.503 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.493+0000 7f36fbfff700 1 -- 172.21.15.81:0/3873534939 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239260632 0 0) 0x7f37040b1550 con 0x7f37040c9710 2023-10-07T08:42:49.503 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.493+0000 7f3708d49700 1 --2- 172.21.15.81:0/3873534939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37040cc760 0x7f37040c91d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f36f40098e0 tx=0x7f36f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f480f325a9b64646 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:49.503 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.494+0000 7f36fbfff700 1 -- 172.21.15.81:0/3873534939 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f400b640 con 0x7f37040cc760 2023-10-07T08:42:49.503 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.494+0000 7f36fbfff700 1 -- 172.21.15.81:0/3873534939 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f400b7a0 con 0x7f37040cc760 2023-10-07T08:42:49.503 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.494+0000 7f36fbfff700 1 -- 172.21.15.81:0/3873534939 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f400bb40 con 0x7f37040cc760 2023-10-07T08:42:49.503 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.494+0000 7f370b7ae700 1 -- 172.21.15.81:0/3873534939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37040cc760 msgr2=0x7f37040c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:49.503 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.494+0000 7f370b7ae700 1 --2- 172.21.15.81:0/3873534939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37040cc760 0x7f37040c91d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f36f40098e0 tx=0x7f36f40091a0 comp rx=0 tx=0).stop 2023-10-07T08:42:49.504 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.494+0000 7f370b7ae700 1 -- 172.21.15.81:0/3873534939 shutdown_connections 2023-10-07T08:42:49.504 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.494+0000 7f370b7ae700 1 --2- 172.21.15.81:0/3873534939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f370415a2f0 0x7f37040cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:49.504 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.494+0000 7f370b7ae700 1 --2- 172.21.15.81:0/3873534939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37040cc760 0x7f37040c91d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:49.504 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.494+0000 7f370b7ae700 1 -- 172.21.15.81:0/3873534939 >> 172.21.15.81:0/3873534939 conn(0x7f3704067640 msgr2=0x7f3704067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:49.504 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.494+0000 7f370b7ae700 1 -- 172.21.15.81:0/3873534939 shutdown_connections 2023-10-07T08:42:49.504 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.494+0000 7f370b7ae700 1 -- 172.21.15.81:0/3873534939 wait complete. 2023-10-07T08:42:49.504 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.495+0000 7f370b7ae700 1 Processor -- start 2023-10-07T08:42:49.504 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.495+0000 7f370b7ae700 1 -- start start 2023-10-07T08:42:49.504 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.496+0000 7f370b7ae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37040c9710 0x7f37041467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:49.504 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.496+0000 7f370b7ae700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37040cc760 0x7f37040b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:49.504 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.496+0000 7f370b7ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f370415a2f0 0x7f37040c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:49.504 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.496+0000 7f370b7ae700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37040c7ba0 con 0x7f370415a2f0 2023-10-07T08:42:49.505 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.496+0000 7f370b7ae700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37040c7e80 con 0x7f37040cc760 2023-10-07T08:42:49.505 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.496+0000 7f370b7ae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37040c8160 con 0x7f37040c9710 2023-10-07T08:42:49.505 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.496+0000 7f3709d4b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f370415a2f0 0x7f37040c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:49.505 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.496+0000 7f370954a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37040c9710 0x7f37041467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:49.505 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.497+0000 7f3708d49700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37040cc760 0x7f37040b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:49.505 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.497+0000 7f3709d4b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f370415a2f0 0x7f37040c9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36552/0 (socket says 172.21.15.81:36552) 2023-10-07T08:42:49.505 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.497+0000 7f370954a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37040c9710 0x7f37041467d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:39696/0 (socket says 172.21.15.81:39696) 2023-10-07T08:42:49.505 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.497+0000 7f3709d4b700 1 -- 172.21.15.81:0/2899097370 learned_addr learned my addr 172.21.15.81:0/2899097370 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:49.505 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.497+0000 7f3709d4b700 1 -- 172.21.15.81:0/2899097370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37040c9710 msgr2=0x7f37041467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:49.505 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.497+0000 7f3709d4b700 1 --2- 172.21.15.81:0/2899097370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37040c9710 0x7f37041467d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:49.506 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.497+0000 7f3709d4b700 1 -- 172.21.15.81:0/2899097370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37040cc760 msgr2=0x7f37040b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:49.506 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.497+0000 7f3709d4b700 1 --2- 172.21.15.81:0/2899097370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37040cc760 0x7f37040b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:49.506 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.497+0000 7f3709d4b700 1 -- 172.21.15.81:0/2899097370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f4009420 con 0x7f370415a2f0 2023-10-07T08:42:49.506 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.497+0000 7f3708d49700 1 --2- 172.21.15.81:0/2899097370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37040cc760 0x7f37040b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:42:49.506 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.497+0000 7f3709d4b700 1 --2- 172.21.15.81:0/2899097370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f370415a2f0 0x7f37040c9b40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00cb60 tx=0x7f36fc001920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:49.506 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.497+0000 7f36f97fa700 1 -- 172.21.15.81:0/2899097370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc00a7e0 con 0x7f370415a2f0 2023-10-07T08:42:49.506 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.497+0000 7f36f97fa700 1 -- 172.21.15.81:0/2899097370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc00a940 con 0x7f370415a2f0 2023-10-07T08:42:49.506 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.497+0000 7f370b7ae700 1 -- 172.21.15.81:0/2899097370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37040c8440 con 0x7f370415a2f0 2023-10-07T08:42:49.506 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.497+0000 7f36f97fa700 1 -- 172.21.15.81:0/2899097370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc00ad00 con 0x7f370415a2f0 2023-10-07T08:42:49.506 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.497+0000 7f370b7ae700 1 -- 172.21.15.81:0/2899097370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3704146d10 con 0x7f370415a2f0 2023-10-07T08:42:49.506 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.498+0000 7f370b7ae700 1 -- 172.21.15.81:0/2899097370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37040c88e0 con 0x7f370415a2f0 2023-10-07T08:42:49.507 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.499+0000 7f36f97fa700 1 -- 172.21.15.81:0/2899097370 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f36fc007300 con 0x7f370415a2f0 2023-10-07T08:42:49.507 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.499+0000 7f36f97fa700 1 --2- 172.21.15.81:0/2899097370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f36e8066ea0 0x7f36e8069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:49.507 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.499+0000 7f36f97fa700 1 -- 172.21.15.81:0/2899097370 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f36fc084310 con 0x7f370415a2f0 2023-10-07T08:42:49.507 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.499+0000 7f370954a700 1 --2- 172.21.15.81:0/2899097370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f36e8066ea0 0x7f36e8069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:49.507 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.499+0000 7f370954a700 1 --2- 172.21.15.81:0/2899097370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f36e8066ea0 0x7f36e8069350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3700009db0 tx=0x7f37000091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:49.507 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.504+0000 7f36f97fa700 1 -- 172.21.15.81:0/2899097370 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36fc051a30 con 0x7f370415a2f0 2023-10-07T08:42:49.690 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.688+0000 7f370b7ae700 1 -- 172.21.15.81:0/2899097370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f370406e7f0 con 0x7f370415a2f0 2023-10-07T08:42:49.690 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.689+0000 7f36f97fa700 1 -- 172.21.15.81:0/2899097370 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f36fc00ae60 con 0x7f370415a2f0 2023-10-07T08:42:49.690 INFO:teuthology.misc.health.smithi081.stdout: 2023-10-07T08:42:49.691 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":17,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:49.217583+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:42:49.693 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.691+0000 7f370b7ae700 1 -- 172.21.15.81:0/2899097370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f36e8066ea0 msgr2=0x7f36e8069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:49.693 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.691+0000 7f370b7ae700 1 --2- 172.21.15.81:0/2899097370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f36e8066ea0 0x7f36e8069350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3700009db0 tx=0x7f37000091a0 comp rx=0 tx=0).stop 2023-10-07T08:42:49.693 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.691+0000 7f370b7ae700 1 -- 172.21.15.81:0/2899097370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f370415a2f0 msgr2=0x7f37040c9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:49.693 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.691+0000 7f370b7ae700 1 --2- 172.21.15.81:0/2899097370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f370415a2f0 0x7f37040c9b40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00cb60 tx=0x7f36fc001920 comp rx=0 tx=0).stop 2023-10-07T08:42:49.693 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.691+0000 7f370b7ae700 1 -- 172.21.15.81:0/2899097370 shutdown_connections 2023-10-07T08:42:49.693 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.691+0000 7f370b7ae700 1 --2- 172.21.15.81:0/2899097370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f370415a2f0 0x7f37040c9b40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:49.693 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.691+0000 7f370b7ae700 1 --2- 172.21.15.81:0/2899097370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f36e8066ea0 0x7f36e8069350 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:49.693 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.691+0000 7f370b7ae700 1 --2- 172.21.15.81:0/2899097370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37040c9710 0x7f37041467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:49.693 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.691+0000 7f370b7ae700 1 --2- 172.21.15.81:0/2899097370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37040cc760 0x7f37040b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:49.693 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.691+0000 7f370b7ae700 1 -- 172.21.15.81:0/2899097370 >> 172.21.15.81:0/2899097370 conn(0x7f3704067640 msgr2=0x7f3704158250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:49.694 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.691+0000 7f370b7ae700 1 -- 172.21.15.81:0/2899097370 shutdown_connections 2023-10-07T08:42:49.694 INFO:teuthology.misc.health.smithi081.stderr:2023-10-07T08:42:49.691+0000 7f370b7ae700 1 -- 172.21.15.81:0/2899097370 wait complete. 2023-10-07T08:42:49.703 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-07T08:42:49.703 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-07T08:42:49.704 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T08:42:49.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T08:42:49.706 INFO:tasks.ceph.mds.a:Started 2023-10-07T08:42:49.706 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T08:42:49.706 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T08:42:49.708 INFO:tasks.ceph.mds.c:Started 2023-10-07T08:42:49.708 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T08:42:49.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T08:42:49.711 INFO:tasks.ceph.mds.b:Started 2023-10-07T08:42:49.711 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T08:42:49.711 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T08:42:49.714 INFO:tasks.ceph.mds.d:Started 2023-10-07T08:42:49.714 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-07T08:42:49.715 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:42:49.779 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-07T08:42:49.779 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-07T08:42:49.784 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-10-07T08:42:49.787 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-10-07T08:42:49.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.834+0000 7efc65c8f700 1 Processor -- start 2023-10-07T08:42:49.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.834+0000 7efc65c8f700 1 -- start start 2023-10-07T08:42:49.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.835+0000 7efc65c8f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efc6013ffe0 0x7efc600c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:49.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.835+0000 7efc65c8f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc600698b0 con 0x7efc6013fc10 2023-10-07T08:42:49.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.835+0000 7efc65c8f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc600692a0 con 0x7efc6006ccb0 2023-10-07T08:42:49.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.835+0000 7efc65c8f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6006d180 con 0x7efc6013ffe0 2023-10-07T08:42:49.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.835+0000 7efc5f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efc6013fc10 0x7efc6006c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47044/0 (socket says 172.21.15.81:47044) 2023-10-07T08:42:49.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.835+0000 7efc5f7fe700 1 -- 172.21.15.81:0/1923688176 learned_addr learned my addr 172.21.15.81:0/1923688176 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:42:49.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.835+0000 7efc5effd700 1 --2- 172.21.15.81:0/1923688176 >> v2:172.21.15.89:3300/0 conn(0x7efc6013ffe0 0x7efc600c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:49.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.836+0000 7efc5e7fc700 1 -- 172.21.15.81:0/1923688176 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046848092 0 0) 0x7efc600698b0 con 0x7efc6013fc10 2023-10-07T08:42:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.836+0000 7efc5e7fc700 1 -- 172.21.15.81:0/1923688176 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc48003570 con 0x7efc6013fc10 2023-10-07T08:42:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.836+0000 7efc5e7fc700 1 -- 172.21.15.81:0/1923688176 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226185132 0 0) 0x7efc600692a0 con 0x7efc6006ccb0 2023-10-07T08:42:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.836+0000 7efc5e7fc700 1 -- 172.21.15.81:0/1923688176 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc600698b0 con 0x7efc6006ccb0 2023-10-07T08:42:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.836+0000 7efc5effd700 1 -- 172.21.15.81:0/1923688176 >> v1:172.21.15.89:6789/0 conn(0x7efc6006ccb0 legacy=0x7efc60069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.836+0000 7efc5effd700 1 -- 172.21.15.81:0/1923688176 >> v1:172.21.15.81:6789/0 conn(0x7efc6013fc10 legacy=0x7efc6006c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.836+0000 7efc5effd700 1 -- 172.21.15.81:0/1923688176 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc60069540 con 0x7efc6013ffe0 2023-10-07T08:42:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.836+0000 7efc5effd700 1 --2- 172.21.15.81:0/1923688176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc6013ffe0 0x7efc600c7a80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efc540098e0 tx=0x7efc540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29a6439a9ea8482e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.836+0000 7efc5e7fc700 1 -- 172.21.15.81:0/1923688176 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc54011630 con 0x7efc6013ffe0 2023-10-07T08:42:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.836+0000 7efc5e7fc700 1 -- 172.21.15.81:0/1923688176 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc54011790 con 0x7efc6013ffe0 2023-10-07T08:42:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.836+0000 7efc5e7fc700 1 -- 172.21.15.81:0/1923688176 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc54011b30 con 0x7efc6013ffe0 2023-10-07T08:42:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.837+0000 7efc65c8f700 1 -- 172.21.15.81:0/1923688176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc6013ffe0 msgr2=0x7efc600c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.837+0000 7efc65c8f700 1 --2- 172.21.15.81:0/1923688176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc6013ffe0 0x7efc600c7a80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efc540098e0 tx=0x7efc540091a0 comp rx=0 tx=0).stop 2023-10-07T08:42:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.837+0000 7efc65c8f700 1 -- 172.21.15.81:0/1923688176 shutdown_connections 2023-10-07T08:42:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.837+0000 7efc65c8f700 1 --2- 172.21.15.81:0/1923688176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc6013ffe0 0x7efc600c7a80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.837+0000 7efc65c8f700 1 -- 172.21.15.81:0/1923688176 >> 172.21.15.81:0/1923688176 conn(0x7efc600c9ca0 msgr2=0x7efc600ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.837+0000 7efc65c8f700 1 -- 172.21.15.81:0/1923688176 shutdown_connections 2023-10-07T08:42:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.837+0000 7efc65c8f700 1 -- 172.21.15.81:0/1923688176 wait complete. 2023-10-07T08:42:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.838+0000 7efc65c8f700 1 Processor -- start 2023-10-07T08:42:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.838+0000 7efc65c8f700 1 -- start start 2023-10-07T08:42:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc65c8f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc6006ccb0 0x7efc60168a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc65c8f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc6013fc10 0x7efc60165480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc65c8f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6013ffe0 0x7efc600c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc65c8f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc600af430 con 0x7efc6013ffe0 2023-10-07T08:42:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc65c8f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc600c5440 con 0x7efc6006ccb0 2023-10-07T08:42:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc65c8f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc60168f90 con 0x7efc6013fc10 2023-10-07T08:42:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc5ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6013ffe0 0x7efc600c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc5ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6013ffe0 0x7efc600c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36588/0 (socket says 172.21.15.81:36588) 2023-10-07T08:42:49.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc5ffff700 1 -- 172.21.15.81:0/3163678424 learned_addr learned my addr 172.21.15.81:0/3163678424 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:49.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc5f7fe700 1 --2- 172.21.15.81:0/3163678424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc6006ccb0 0x7efc60168a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:49.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc5effd700 1 --2- 172.21.15.81:0/3163678424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc6013fc10 0x7efc60165480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:49.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc5ffff700 1 -- 172.21.15.81:0/3163678424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc6013fc10 msgr2=0x7efc60165480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:49.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc5ffff700 1 --2- 172.21.15.81:0/3163678424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc6013fc10 0x7efc60165480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:49.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc5ffff700 1 -- 172.21.15.81:0/3163678424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc6006ccb0 msgr2=0x7efc60168a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc5ffff700 1 --2- 172.21.15.81:0/3163678424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc6006ccb0 0x7efc60168a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc5ffff700 1 -- 172.21.15.81:0/3163678424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc54009420 con 0x7efc6013ffe0 2023-10-07T08:42:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc5ffff700 1 --2- 172.21.15.81:0/3163678424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6013ffe0 0x7efc600c6170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efc5800c590 tx=0x7efc58007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc477fe700 1 -- 172.21.15.81:0/3163678424 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58016070 con 0x7efc6013ffe0 2023-10-07T08:42:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc477fe700 1 -- 172.21.15.81:0/3163678424 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc58011590 con 0x7efc6013ffe0 2023-10-07T08:42:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc477fe700 1 -- 172.21.15.81:0/3163678424 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58011970 con 0x7efc6013ffe0 2023-10-07T08:42:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc65c8f700 1 -- 172.21.15.81:0/3163678424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc600c4830 con 0x7efc6013ffe0 2023-10-07T08:42:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.839+0000 7efc65c8f700 1 -- 172.21.15.81:0/3163678424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc600c4df0 con 0x7efc6013ffe0 2023-10-07T08:42:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.840+0000 7efc65c8f700 1 -- 172.21.15.81:0/3163678424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc600c55f0 con 0x7efc6013ffe0 2023-10-07T08:42:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.841+0000 7efc477fe700 1 -- 172.21.15.81:0/3163678424 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7efc58012420 con 0x7efc6013ffe0 2023-10-07T08:42:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.841+0000 7efc477fe700 1 --2- 172.21.15.81:0/3163678424 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efc4c066ea0 0x7efc4c069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:49.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.841+0000 7efc477fe700 1 -- 172.21.15.81:0/3163678424 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efc58083bc0 con 0x7efc6013ffe0 2023-10-07T08:42:49.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.841+0000 7efc5f7fe700 1 --2- 172.21.15.81:0/3163678424 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efc4c066ea0 0x7efc4c069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:49.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.841+0000 7efc5f7fe700 1 --2- 172.21.15.81:0/3163678424 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efc4c066ea0 0x7efc4c069350 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efc600ca7a0 tx=0x7efc50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:49.845+0000 7efc477fe700 1 -- 172.21.15.81:0/3163678424 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc58051260 con 0x7efc6013ffe0 2023-10-07T08:42:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.029+0000 7efc65c8f700 1 -- 172.21.15.81:0/3163678424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc6004bb80 con 0x7efc6013ffe0 2023-10-07T08:42:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.030+0000 7efc477fe700 1 -- 172.21.15.81:0/3163678424 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12079 (secure 0 0 0) 0x7efc58054880 con 0x7efc6013ffe0 2023-10-07T08:42:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:50.032 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:49.217583+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:42:50.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.032+0000 7efc65c8f700 1 -- 172.21.15.81:0/3163678424 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efc4c066ea0 msgr2=0x7efc4c069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:50.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.032+0000 7efc65c8f700 1 --2- 172.21.15.81:0/3163678424 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efc4c066ea0 0x7efc4c069350 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efc600ca7a0 tx=0x7efc50009040 comp rx=0 tx=0).stop 2023-10-07T08:42:50.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.032+0000 7efc65c8f700 1 -- 172.21.15.81:0/3163678424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6013ffe0 msgr2=0x7efc600c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:50.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.032+0000 7efc65c8f700 1 --2- 172.21.15.81:0/3163678424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6013ffe0 0x7efc600c6170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efc5800c590 tx=0x7efc58007d80 comp rx=0 tx=0).stop 2023-10-07T08:42:50.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.032+0000 7efc65c8f700 1 -- 172.21.15.81:0/3163678424 shutdown_connections 2023-10-07T08:42:50.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.032+0000 7efc65c8f700 1 --2- 172.21.15.81:0/3163678424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6013ffe0 0x7efc600c6170 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.032+0000 7efc65c8f700 1 --2- 172.21.15.81:0/3163678424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc6006ccb0 0x7efc60168a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.032+0000 7efc65c8f700 1 --2- 172.21.15.81:0/3163678424 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efc4c066ea0 0x7efc4c069350 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.032+0000 7efc65c8f700 1 --2- 172.21.15.81:0/3163678424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc6013fc10 0x7efc60165480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.032+0000 7efc65c8f700 1 -- 172.21.15.81:0/3163678424 >> 172.21.15.81:0/3163678424 conn(0x7efc600c9ca0 msgr2=0x7efc6006bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:50.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.032+0000 7efc65c8f700 1 -- 172.21.15.81:0/3163678424 shutdown_connections 2023-10-07T08:42:50.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.032+0000 7efc65c8f700 1 -- 172.21.15.81:0/3163678424 wait complete. 2023-10-07T08:42:50.046 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T08:42:50.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:42:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.161+0000 7fb9424ff700 1 Processor -- start 2023-10-07T08:42:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.161+0000 7fb9424ff700 1 -- start start 2023-10-07T08:42:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.162+0000 7fb9424ff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb93c0cf080 0x7fb93c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.162+0000 7fb9424ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c0aaf40 con 0x7fb93c159cb0 2023-10-07T08:42:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.162+0000 7fb9424ff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c06c570 con 0x7fb93c06e4e0 2023-10-07T08:42:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.162+0000 7fb9424ff700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93c0aa930 con 0x7fb93c0cf080 2023-10-07T08:42:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.162+0000 7fb9414fd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb93c159cb0 0x7fb93c0ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47054/0 (socket says 172.21.15.81:47054) 2023-10-07T08:42:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.162+0000 7fb9414fd700 1 -- 172.21.15.81:0/786798773 learned_addr learned my addr 172.21.15.81:0/786798773 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:42:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.162+0000 7fb941cfe700 1 --2- 172.21.15.81:0/786798773 >> v2:172.21.15.89:3300/0 conn(0x7fb93c0cf080 0x7fb93c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.162+0000 7fb933fff700 1 -- 172.21.15.81:0/786798773 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026271945 0 0) 0x7fb93c0aaf40 con 0x7fb93c159cb0 2023-10-07T08:42:50.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.162+0000 7fb933fff700 1 -- 172.21.15.81:0/786798773 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb928003570 con 0x7fb93c159cb0 2023-10-07T08:42:50.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.162+0000 7fb941cfe700 1 -- 172.21.15.81:0/786798773 >> v1:172.21.15.89:6789/0 conn(0x7fb93c06e4e0 legacy=0x7fb93c06cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:50.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.162+0000 7fb933fff700 1 -- 172.21.15.81:0/786798773 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276796059 0 0) 0x7fb93c06c570 con 0x7fb93c06e4e0 2023-10-07T08:42:50.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.162+0000 7fb941cfe700 1 -- 172.21.15.81:0/786798773 >> v1:172.21.15.81:6789/0 conn(0x7fb93c159cb0 legacy=0x7fb93c0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:50.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.162+0000 7fb941cfe700 1 -- 172.21.15.81:0/786798773 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c06e970 con 0x7fb93c0cf080 2023-10-07T08:42:50.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.163+0000 7fb941cfe700 1 --2- 172.21.15.81:0/786798773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb93c0cf080 0x7fb93c06d3b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb934009e60 tx=0x7fb934009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d0767e28e4f4b2d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:50.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.163+0000 7fb933fff700 1 -- 172.21.15.81:0/786798773 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93400e070 con 0x7fb93c0cf080 2023-10-07T08:42:50.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.163+0000 7fb933fff700 1 -- 172.21.15.81:0/786798773 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93400bb60 con 0x7fb93c0cf080 2023-10-07T08:42:50.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.163+0000 7fb933fff700 1 -- 172.21.15.81:0/786798773 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934012430 con 0x7fb93c0cf080 2023-10-07T08:42:50.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.163+0000 7fb9424ff700 1 -- 172.21.15.81:0/786798773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb93c0cf080 msgr2=0x7fb93c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.163+0000 7fb9424ff700 1 --2- 172.21.15.81:0/786798773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb93c0cf080 0x7fb93c06d3b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb934009e60 tx=0x7fb934009780 comp rx=0 tx=0).stop 2023-10-07T08:42:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.163+0000 7fb9424ff700 1 -- 172.21.15.81:0/786798773 shutdown_connections 2023-10-07T08:42:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.163+0000 7fb9424ff700 1 --2- 172.21.15.81:0/786798773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb93c0cf080 0x7fb93c06d3b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.163+0000 7fb9424ff700 1 -- 172.21.15.81:0/786798773 >> 172.21.15.81:0/786798773 conn(0x7fb93c068110 msgr2=0x7fb93c06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.163+0000 7fb9424ff700 1 -- 172.21.15.81:0/786798773 shutdown_connections 2023-10-07T08:42:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.163+0000 7fb9424ff700 1 -- 172.21.15.81:0/786798773 wait complete. 2023-10-07T08:42:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.164+0000 7fb9424ff700 1 Processor -- start 2023-10-07T08:42:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.165+0000 7fb9424ff700 1 -- start start 2023-10-07T08:42:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.165+0000 7fb9424ff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb93c06e4e0 0x7fb93c15a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.165+0000 7fb9424ff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb93c0cf080 0x7fb93c153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.165+0000 7fb9424ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c159cb0 0x7fb93c06cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.165+0000 7fb9424ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0c39a0 con 0x7fb93c159cb0 2023-10-07T08:42:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.165+0000 7fb9424ff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c15a5c0 con 0x7fb93c06e4e0 2023-10-07T08:42:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.165+0000 7fb9424ff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c15a860 con 0x7fb93c0cf080 2023-10-07T08:42:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.166+0000 7fb941cfe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c159cb0 0x7fb93c06cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.166+0000 7fb941cfe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c159cb0 0x7fb93c06cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36592/0 (socket says 172.21.15.81:36592) 2023-10-07T08:42:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.166+0000 7fb941cfe700 1 -- 172.21.15.81:0/1060622884 learned_addr learned my addr 172.21.15.81:0/1060622884 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.166+0000 7fb9414fd700 1 --2- 172.21.15.81:0/1060622884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb93c06e4e0 0x7fb93c15a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.166+0000 7fb940cfc700 1 --2- 172.21.15.81:0/1060622884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb93c0cf080 0x7fb93c153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.166+0000 7fb941cfe700 1 -- 172.21.15.81:0/1060622884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb93c0cf080 msgr2=0x7fb93c153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.166+0000 7fb941cfe700 1 --2- 172.21.15.81:0/1060622884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb93c0cf080 0x7fb93c153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.166+0000 7fb941cfe700 1 -- 172.21.15.81:0/1060622884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb93c06e4e0 msgr2=0x7fb93c15a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.166+0000 7fb941cfe700 1 --2- 172.21.15.81:0/1060622884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb93c06e4e0 0x7fb93c15a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.166+0000 7fb941cfe700 1 -- 172.21.15.81:0/1060622884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb934009a20 con 0x7fb93c159cb0 2023-10-07T08:42:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.166+0000 7fb941cfe700 1 --2- 172.21.15.81:0/1060622884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c159cb0 0x7fb93c06cca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb934013000 tx=0x7fb934019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.166+0000 7fb9317fa700 1 -- 172.21.15.81:0/1060622884 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934012e00 con 0x7fb93c159cb0 2023-10-07T08:42:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.166+0000 7fb9317fa700 1 -- 172.21.15.81:0/1060622884 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93401c610 con 0x7fb93c159cb0 2023-10-07T08:42:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.166+0000 7fb9424ff700 1 -- 172.21.15.81:0/1060622884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93c15ab40 con 0x7fb93c159cb0 2023-10-07T08:42:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.166+0000 7fb9317fa700 1 -- 172.21.15.81:0/1060622884 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93401c9d0 con 0x7fb93c159cb0 2023-10-07T08:42:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.166+0000 7fb9424ff700 1 -- 172.21.15.81:0/1060622884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c15b100 con 0x7fb93c159cb0 2023-10-07T08:42:50.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.167+0000 7fb9424ff700 1 -- 172.21.15.81:0/1060622884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93c0c3b10 con 0x7fb93c159cb0 2023-10-07T08:42:50.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.167+0000 7fb9317fa700 1 -- 172.21.15.81:0/1060622884 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fb93401cd40 con 0x7fb93c159cb0 2023-10-07T08:42:50.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.168+0000 7fb9317fa700 1 --2- 172.21.15.81:0/1060622884 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb920066ea0 0x7fb920069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:50.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.168+0000 7fb9317fa700 1 -- 172.21.15.81:0/1060622884 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb9340861f0 con 0x7fb93c159cb0 2023-10-07T08:42:50.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.168+0000 7fb9414fd700 1 --2- 172.21.15.81:0/1060622884 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb920066ea0 0x7fb920069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:50.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.168+0000 7fb9414fd700 1 --2- 172.21.15.81:0/1060622884 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb920066ea0 0x7fb920069350 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb9380058d0 tx=0x7fb938009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:50.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.172+0000 7fb9317fa700 1 -- 172.21.15.81:0/1060622884 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb934053890 con 0x7fb93c159cb0 2023-10-07T08:42:50.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.355+0000 7fb9424ff700 1 -- 172.21.15.81:0/1060622884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb93c0aabd0 con 0x7fb93c159cb0 2023-10-07T08:42:50.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.355+0000 7fb9317fa700 1 -- 172.21.15.81:0/1060622884 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb934056eb0 con 0x7fb93c159cb0 2023-10-07T08:42:50.357 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:42:50.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.358+0000 7fb9424ff700 1 -- 172.21.15.81:0/1060622884 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb920066ea0 msgr2=0x7fb920069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:50.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.358+0000 7fb9424ff700 1 --2- 172.21.15.81:0/1060622884 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb920066ea0 0x7fb920069350 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb9380058d0 tx=0x7fb938009040 comp rx=0 tx=0).stop 2023-10-07T08:42:50.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.358+0000 7fb9424ff700 1 -- 172.21.15.81:0/1060622884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c159cb0 msgr2=0x7fb93c06cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:50.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.358+0000 7fb9424ff700 1 --2- 172.21.15.81:0/1060622884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c159cb0 0x7fb93c06cca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb934013000 tx=0x7fb934019000 comp rx=0 tx=0).stop 2023-10-07T08:42:50.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.358+0000 7fb9424ff700 1 -- 172.21.15.81:0/1060622884 shutdown_connections 2023-10-07T08:42:50.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.358+0000 7fb9424ff700 1 --2- 172.21.15.81:0/1060622884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c159cb0 0x7fb93c06cca0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.358+0000 7fb9424ff700 1 --2- 172.21.15.81:0/1060622884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb93c06e4e0 0x7fb93c15a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.358+0000 7fb9424ff700 1 --2- 172.21.15.81:0/1060622884 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb920066ea0 0x7fb920069350 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.358+0000 7fb9424ff700 1 --2- 172.21.15.81:0/1060622884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb93c0cf080 0x7fb93c153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.358+0000 7fb9424ff700 1 -- 172.21.15.81:0/1060622884 >> 172.21.15.81:0/1060622884 conn(0x7fb93c068110 msgr2=0x7fb93c157c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:50.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.358+0000 7fb9424ff700 1 -- 172.21.15.81:0/1060622884 shutdown_connections 2023-10-07T08:42:50.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.358+0000 7fb9424ff700 1 -- 172.21.15.81:0/1060622884 wait complete. 2023-10-07T08:42:50.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:42:50.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.483+0000 7fed1e837700 1 Processor -- start 2023-10-07T08:42:50.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.483+0000 7fed1e837700 1 -- start start 2023-10-07T08:42:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.484+0000 7fed1e837700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fed181578d0 0x7fed180cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.484+0000 7fed1e837700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed180d07c0 con 0x7fed18157ca0 2023-10-07T08:42:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.484+0000 7fed1e837700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed180cfbb0 con 0x7fed1806d120 2023-10-07T08:42:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.484+0000 7fed1e837700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed180cfe90 con 0x7fed181578d0 2023-10-07T08:42:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.484+0000 7fed17fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fed181578d0 0x7fed180cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.484+0000 7fed177fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fed18157ca0 0x7fed1815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47064/0 (socket says 172.21.15.81:47064) 2023-10-07T08:42:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.484+0000 7fed177fe700 1 -- 172.21.15.81:0/2843725913 learned_addr learned my addr 172.21.15.81:0/2843725913 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:42:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.485+0000 7fed17fff700 1 -- 172.21.15.81:0/2843725913 >> v1:172.21.15.89:6789/0 conn(0x7fed1806d120 legacy=0x7fed1806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.485+0000 7fed17fff700 1 -- 172.21.15.81:0/2843725913 >> v1:172.21.15.81:6789/0 conn(0x7fed18157ca0 legacy=0x7fed1815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.485+0000 7fed17fff700 1 -- 172.21.15.81:0/2843725913 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed180d0170 con 0x7fed181578d0 2023-10-07T08:42:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.485+0000 7fed16ffd700 1 -- 172.21.15.81:0/2843725913 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033041257 0 0) 0x7fed180d07c0 con 0x7fed18157ca0 2023-10-07T08:42:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.485+0000 7fed17fff700 1 --2- 172.21.15.81:0/2843725913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed181578d0 0x7fed180cf4f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fed080098e0 tx=0x7fed080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33f8a86b444999d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.485+0000 7fed16ffd700 1 -- 172.21.15.81:0/2843725913 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08009e80 con 0x7fed181578d0 2023-10-07T08:42:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.485+0000 7fed16ffd700 1 -- 172.21.15.81:0/2843725913 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0800b820 con 0x7fed181578d0 2023-10-07T08:42:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.485+0000 7fed16ffd700 1 -- 172.21.15.81:0/2843725913 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0800bba0 con 0x7fed181578d0 2023-10-07T08:42:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.485+0000 7fed1e837700 1 -- 172.21.15.81:0/2843725913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed181578d0 msgr2=0x7fed180cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.485+0000 7fed1e837700 1 --2- 172.21.15.81:0/2843725913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed181578d0 0x7fed180cf4f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fed080098e0 tx=0x7fed080091a0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.485+0000 7fed1e837700 1 -- 172.21.15.81:0/2843725913 shutdown_connections 2023-10-07T08:42:50.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.485+0000 7fed1e837700 1 --2- 172.21.15.81:0/2843725913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed181578d0 0x7fed180cf4f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.485+0000 7fed1e837700 1 -- 172.21.15.81:0/2843725913 >> 172.21.15.81:0/2843725913 conn(0x7fed1806bb90 msgr2=0x7fed1806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:50.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.485+0000 7fed1e837700 1 -- 172.21.15.81:0/2843725913 shutdown_connections 2023-10-07T08:42:50.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.485+0000 7fed1e837700 1 -- 172.21.15.81:0/2843725913 wait complete. 2023-10-07T08:42:50.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.487+0000 7fed1e837700 1 Processor -- start 2023-10-07T08:42:50.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.487+0000 7fed1e837700 1 -- start start 2023-10-07T08:42:50.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.487+0000 7fed1e837700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed1806d120 0x7fed18151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:50.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed1e837700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed181578d0 0x7fed180b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:50.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed1e837700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed18157ca0 0x7fed18068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:50.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed1e837700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed180b4c40 con 0x7fed181578d0 2023-10-07T08:42:50.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed1e837700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed180b4030 con 0x7fed18157ca0 2023-10-07T08:42:50.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed1e837700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed180b4310 con 0x7fed1806d120 2023-10-07T08:42:50.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed181578d0 0x7fed180b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:50.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed181578d0 0x7fed180b64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36606/0 (socket says 172.21.15.81:36606) 2023-10-07T08:42:50.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed177fe700 1 -- 172.21.15.81:0/891359238 learned_addr learned my addr 172.21.15.81:0/891359238 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:50.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed1cdd4700 1 --2- 172.21.15.81:0/891359238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed18157ca0 0x7fed18068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:50.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed17fff700 1 --2- 172.21.15.81:0/891359238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed1806d120 0x7fed18151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:50.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed177fe700 1 -- 172.21.15.81:0/891359238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed1806d120 msgr2=0x7fed18151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed177fe700 1 --2- 172.21.15.81:0/891359238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed1806d120 0x7fed18151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed177fe700 1 -- 172.21.15.81:0/891359238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed18157ca0 msgr2=0x7fed18068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed177fe700 1 --2- 172.21.15.81:0/891359238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed18157ca0 0x7fed18068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed177fe700 1 -- 172.21.15.81:0/891359238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed08009420 con 0x7fed181578d0 2023-10-07T08:42:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed17fff700 1 --2- 172.21.15.81:0/891359238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed1806d120 0x7fed18151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:42:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed177fe700 1 --2- 172.21.15.81:0/891359238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed181578d0 0x7fed180b64f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00c5e0 tx=0x7fed0c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fecfffff700 1 -- 172.21.15.81:0/891359238 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c005b30 con 0x7fed181578d0 2023-10-07T08:42:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fecfffff700 1 -- 172.21.15.81:0/891359238 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c005c90 con 0x7fed181578d0 2023-10-07T08:42:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed1e837700 1 -- 172.21.15.81:0/891359238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed180b45f0 con 0x7fed181578d0 2023-10-07T08:42:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fecfffff700 1 -- 172.21.15.81:0/891359238 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c007300 con 0x7fed181578d0 2023-10-07T08:42:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.488+0000 7fed1e837700 1 -- 172.21.15.81:0/891359238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed18151d80 con 0x7fed181578d0 2023-10-07T08:42:50.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.489+0000 7fed1e837700 1 -- 172.21.15.81:0/891359238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed18067ac0 con 0x7fed181578d0 2023-10-07T08:42:50.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.489+0000 7fecfffff700 1 -- 172.21.15.81:0/891359238 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fed0c0076b0 con 0x7fed181578d0 2023-10-07T08:42:50.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.490+0000 7fecfffff700 1 --2- 172.21.15.81:0/891359238 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed04066ea0 0x7fed04069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:50.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.490+0000 7fed17fff700 1 --2- 172.21.15.81:0/891359238 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed04066ea0 0x7fed04069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:50.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.490+0000 7fecfffff700 1 -- 172.21.15.81:0/891359238 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fed0c083600 con 0x7fed181578d0 2023-10-07T08:42:50.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.490+0000 7fed17fff700 1 --2- 172.21.15.81:0/891359238 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed04066ea0 0x7fed04069350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fed080098e0 tx=0x7fed08016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.494+0000 7fecfffff700 1 -- 172.21.15.81:0/891359238 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed0c050ca0 con 0x7fed181578d0 2023-10-07T08:42:50.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.717+0000 7fed1e837700 1 -- 172.21.15.81:0/891359238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed180d0450 con 0x7fed181578d0 2023-10-07T08:42:50.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.718+0000 7fecfffff700 1 -- 172.21.15.81:0/891359238 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7fed0c017500 con 0x7fed181578d0 2023-10-07T08:42:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:50.719 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1734914753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1734914753},{"type":"v1","addr":"172.21.15.81:6837","nonce":1734914753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-07T08:42:50.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.719+0000 7fed1e837700 1 -- 172.21.15.81:0/891359238 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed04066ea0 msgr2=0x7fed04069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:50.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.719+0000 7fed1e837700 1 --2- 172.21.15.81:0/891359238 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed04066ea0 0x7fed04069350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fed080098e0 tx=0x7fed08016000 comp rx=0 tx=0).stop 2023-10-07T08:42:50.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.719+0000 7fed1e837700 1 -- 172.21.15.81:0/891359238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed181578d0 msgr2=0x7fed180b64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:50.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.719+0000 7fed1e837700 1 --2- 172.21.15.81:0/891359238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed181578d0 0x7fed180b64f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00c5e0 tx=0x7fed0c000fe0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.719+0000 7fed1e837700 1 -- 172.21.15.81:0/891359238 shutdown_connections 2023-10-07T08:42:50.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.719+0000 7fed1e837700 1 --2- 172.21.15.81:0/891359238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed18157ca0 0x7fed18068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.719+0000 7fed1e837700 1 --2- 172.21.15.81:0/891359238 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed04066ea0 0x7fed04069350 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.719+0000 7fed1e837700 1 --2- 172.21.15.81:0/891359238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed1806d120 0x7fed18151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.719+0000 7fed1e837700 1 --2- 172.21.15.81:0/891359238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed181578d0 0x7fed180b64f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:50.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.720+0000 7fed1e837700 1 -- 172.21.15.81:0/891359238 >> 172.21.15.81:0/891359238 conn(0x7fed1806bb90 msgr2=0x7fed1815d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:50.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.720+0000 7fed1e837700 1 -- 172.21.15.81:0/891359238 shutdown_connections 2023-10-07T08:42:50.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:50.720+0000 7fed1e837700 1 -- 172.21.15.81:0/891359238 wait complete. 2023-10-07T08:42:50.723 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 2 2023-10-07T08:42:52.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:42:52.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.853+0000 7fc512311700 1 Processor -- start 2023-10-07T08:42:52.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.853+0000 7fc512311700 1 -- start start 2023-10-07T08:42:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.854+0000 7fc512311700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc50c1578d0 0x7fc50c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.854+0000 7fc512311700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc50c157ca0 0x7fc50c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.854+0000 7fc512311700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50c0d07c0 con 0x7fc50c06d120 2023-10-07T08:42:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.854+0000 7fc512311700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50c0cfbb0 con 0x7fc50c1578d0 2023-10-07T08:42:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.854+0000 7fc512311700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c0cfe90 con 0x7fc50c157ca0 2023-10-07T08:42:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.854+0000 7fc5108ae700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc50c06d120 0x7fc50c15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59572/0 (socket says 172.21.15.81:59572) 2023-10-07T08:42:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.854+0000 7fc5108ae700 1 -- 172.21.15.81:0/1897231737 learned_addr learned my addr 172.21.15.81:0/1897231737 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:42:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.854+0000 7fc50bfff700 1 --2- 172.21.15.81:0/1897231737 >> v2:172.21.15.89:3300/0 conn(0x7fc50c1578d0 0x7fc50c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.854+0000 7fc50b7fe700 1 --2- 172.21.15.81:0/1897231737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc50c157ca0 0x7fc50c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.854+0000 7fc50affd700 1 -- 172.21.15.81:0/1897231737 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440894721 0 0) 0x7fc50c0d07c0 con 0x7fc50c06d120 2023-10-07T08:42:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50affd700 1 -- 172.21.15.81:0/1897231737 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4f4003570 con 0x7fc50c06d120 2023-10-07T08:42:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50affd700 1 -- 172.21.15.81:0/1897231737 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4193962461 0 0) 0x7fc4f4003570 con 0x7fc50c06d120 2023-10-07T08:42:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50affd700 1 -- 172.21.15.81:0/1897231737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc50c157ca0 msgr2=0x7fc50c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50affd700 1 --2- 172.21.15.81:0/1897231737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc50c157ca0 0x7fc50c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50affd700 1 -- 172.21.15.81:0/1897231737 >> v2:172.21.15.89:3300/0 conn(0x7fc50c1578d0 msgr2=0x7fc50c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50affd700 1 --2- 172.21.15.81:0/1897231737 >> v2:172.21.15.89:3300/0 conn(0x7fc50c1578d0 0x7fc50c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50affd700 1 -- 172.21.15.81:0/1897231737 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c0d0170 con 0x7fc50c06d120 2023-10-07T08:42:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50affd700 1 -- 172.21.15.81:0/1897231737 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fc5040017f0 con 0x7fc50c06d120 2023-10-07T08:42:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50affd700 1 -- 172.21.15.81:0/1897231737 >> v1:172.21.15.81:6789/0 conn(0x7fc50c06d120 legacy=0x7fc50c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50affd700 1 --2- 172.21.15.81:0/1897231737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f4003a60 0x7fc4f4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50affd700 1 --2- 172.21.15.81:0/1897231737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc50c157ca0 0x7fc4f4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50affd700 1 --2- 172.21.15.81:0/1897231737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f4004d50 0x7fc4f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50affd700 1 -- 172.21.15.81:0/1897231737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c0cfbb0 con 0x7fc4f4004d50 2023-10-07T08:42:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50affd700 1 -- 172.21.15.81:0/1897231737 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c0cfe90 con 0x7fc4f4003a60 2023-10-07T08:42:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50affd700 1 -- 172.21.15.81:0/1897231737 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f400ba60 con 0x7fc50c157ca0 2023-10-07T08:42:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc5108ae700 1 --2- 172.21.15.81:0/1897231737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f4004d50 0x7fc4f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50b7fe700 1 --2- 172.21.15.81:0/1897231737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc50c157ca0 0x7fc4f4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50bfff700 1 --2- 172.21.15.81:0/1897231737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f4003a60 0x7fc4f4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc5108ae700 1 -- 172.21.15.81:0/1897231737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc50c157ca0 msgr2=0x7fc4f4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc5108ae700 1 --2- 172.21.15.81:0/1897231737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc50c157ca0 0x7fc4f4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc5108ae700 1 -- 172.21.15.81:0/1897231737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f4003a60 msgr2=0x7fc4f4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc5108ae700 1 --2- 172.21.15.81:0/1897231737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f4003a60 0x7fc4f4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc5108ae700 1 -- 172.21.15.81:0/1897231737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f4003570 con 0x7fc4f4004d50 2023-10-07T08:42:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc50b7fe700 1 --2- 172.21.15.81:0/1897231737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc50c157ca0 0x7fc4f4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:42:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.855+0000 7fc5108ae700 1 --2- 172.21.15.81:0/1897231737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f4004d50 0x7fc4f40051c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc50400a970 tx=0x7fc50c0d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d0a3507de2c357 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.856+0000 7fc50affd700 1 -- 172.21.15.81:0/1897231737 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5040070d0 con 0x7fc4f4004d50 2023-10-07T08:42:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.856+0000 7fc50affd700 1 -- 172.21.15.81:0/1897231737 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc504007230 con 0x7fc4f4004d50 2023-10-07T08:42:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.856+0000 7fc50affd700 1 -- 172.21.15.81:0/1897231737 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5040075f0 con 0x7fc4f4004d50 2023-10-07T08:42:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.856+0000 7fc512311700 1 -- 172.21.15.81:0/1897231737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f4004d50 msgr2=0x7fc4f40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.856+0000 7fc512311700 1 --2- 172.21.15.81:0/1897231737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f4004d50 0x7fc4f40051c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc50400a970 tx=0x7fc50c0d0730 comp rx=0 tx=0).stop 2023-10-07T08:42:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.856+0000 7fc5108ae700 1 -- 172.21.15.81:0/1897231737 reap_dead start 2023-10-07T08:42:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.856+0000 7fc512311700 1 -- 172.21.15.81:0/1897231737 shutdown_connections 2023-10-07T08:42:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.856+0000 7fc512311700 1 -- 172.21.15.81:0/1897231737 >> 172.21.15.81:0/1897231737 conn(0x7fc50c06bb90 msgr2=0x7fc50c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.856+0000 7fc512311700 1 -- 172.21.15.81:0/1897231737 shutdown_connections 2023-10-07T08:42:52.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.856+0000 7fc512311700 1 -- 172.21.15.81:0/1897231737 wait complete. 2023-10-07T08:42:52.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.857+0000 7fc512311700 1 Processor -- start 2023-10-07T08:42:52.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.857+0000 7fc512311700 1 -- start start 2023-10-07T08:42:52.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc512311700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc50c14af70 0x7fc50c14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:52.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc512311700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc50c0b4610 0x7fc50c14c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:52.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc512311700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc50c14c780 0x7fc50c16de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:52.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc512311700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c159f90 con 0x7fc50c14c780 2023-10-07T08:42:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc512311700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c0b5db0 con 0x7fc50c14af70 2023-10-07T08:42:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc512311700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c14cbf0 con 0x7fc50c0b4610 2023-10-07T08:42:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc5108ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc50c14c780 0x7fc50c16de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc5108ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc50c14c780 0x7fc50c16de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33522/0 (socket says 172.21.15.81:33522) 2023-10-07T08:42:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc5108ae700 1 -- 172.21.15.81:0/769817743 learned_addr learned my addr 172.21.15.81:0/769817743 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc50b7fe700 1 --2- 172.21.15.81:0/769817743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc50c0b4610 0x7fc50c14c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc50bfff700 1 --2- 172.21.15.81:0/769817743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc50c14af70 0x7fc50c14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc5108ae700 1 -- 172.21.15.81:0/769817743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc50c0b4610 msgr2=0x7fc50c14c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc5108ae700 1 --2- 172.21.15.81:0/769817743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc50c0b4610 0x7fc50c14c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc5108ae700 1 -- 172.21.15.81:0/769817743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc50c14af70 msgr2=0x7fc50c14e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc5108ae700 1 --2- 172.21.15.81:0/769817743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc50c14af70 0x7fc50c14e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:52.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc5108ae700 1 -- 172.21.15.81:0/769817743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c0b5920 con 0x7fc50c14c780 2023-10-07T08:42:52.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc50b7fe700 1 --2- 172.21.15.81:0/769817743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc50c0b4610 0x7fc50c14c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:42:52.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.858+0000 7fc50bfff700 1 --2- 172.21.15.81:0/769817743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc50c14af70 0x7fc50c14e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:42:52.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.859+0000 7fc5108ae700 1 --2- 172.21.15.81:0/769817743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc50c14c780 0x7fc50c16de30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc50400af60 tx=0x7fc504016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:52.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.859+0000 7fc4f3fff700 1 -- 172.21.15.81:0/769817743 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5040070d0 con 0x7fc50c14c780 2023-10-07T08:42:52.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.859+0000 7fc4f3fff700 1 -- 172.21.15.81:0/769817743 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5040017b0 con 0x7fc50c14c780 2023-10-07T08:42:52.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.859+0000 7fc512311700 1 -- 172.21.15.81:0/769817743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50c0b4a80 con 0x7fc50c14c780 2023-10-07T08:42:52.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.859+0000 7fc4f3fff700 1 -- 172.21.15.81:0/769817743 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc504000fb0 con 0x7fc50c14c780 2023-10-07T08:42:52.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.859+0000 7fc512311700 1 -- 172.21.15.81:0/769817743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50c0b4ff0 con 0x7fc50c14c780 2023-10-07T08:42:52.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.860+0000 7fc512311700 1 -- 172.21.15.81:0/769817743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc50c0b5ab0 con 0x7fc50c14c780 2023-10-07T08:42:52.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.860+0000 7fc4f3fff700 1 -- 172.21.15.81:0/769817743 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc504024070 con 0x7fc50c14c780 2023-10-07T08:42:52.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.861+0000 7fc4f3fff700 1 --2- 172.21.15.81:0/769817743 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc4f8066f30 0x7fc4f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:52.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.861+0000 7fc50bfff700 1 --2- 172.21.15.81:0/769817743 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc4f8066f30 0x7fc4f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:52.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.861+0000 7fc4f3fff700 1 -- 172.21.15.81:0/769817743 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc5040866d0 con 0x7fc50c14c780 2023-10-07T08:42:52.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.861+0000 7fc50bfff700 1 --2- 172.21.15.81:0/769817743 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc4f8066f30 0x7fc4f80693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc006f00 tx=0x7fc4fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:52.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:52.865+0000 7fc4f3fff700 1 -- 172.21.15.81:0/769817743 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc504053c90 con 0x7fc50c14c780 2023-10-07T08:42:53.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.087+0000 7fc512311700 1 -- 172.21.15.81:0/769817743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc50c0d0450 con 0x7fc50c14c780 2023-10-07T08:42:53.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.088+0000 7fc4f3fff700 1 -- 172.21.15.81:0/769817743 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7fc5040572b0 con 0x7fc50c14c780 2023-10-07T08:42:53.089 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:53.090 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4266800811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4266800811},{"type":"v1","addr":"172.21.15.81:6836","nonce":4266800811}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1054766807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1054766807},{"type":"v1","addr":"172.21.15.89:6833","nonce":1054766807}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1734914753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1734914753},{"type":"v1","addr":"172.21.15.81:6837","nonce":1734914753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/860615068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":860615068},{"type":"v1","addr":"172.21.15.89:6835","nonce":860615068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-07T08:42:53.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.090+0000 7fc512311700 1 -- 172.21.15.81:0/769817743 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc4f8066f30 msgr2=0x7fc4f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.090+0000 7fc512311700 1 --2- 172.21.15.81:0/769817743 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc4f8066f30 0x7fc4f80693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc006f00 tx=0x7fc4fc008040 comp rx=0 tx=0).stop 2023-10-07T08:42:53.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.090+0000 7fc512311700 1 -- 172.21.15.81:0/769817743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc50c14c780 msgr2=0x7fc50c16de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.090+0000 7fc512311700 1 --2- 172.21.15.81:0/769817743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc50c14c780 0x7fc50c16de30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc50400af60 tx=0x7fc504016000 comp rx=0 tx=0).stop 2023-10-07T08:42:53.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.090+0000 7fc512311700 1 -- 172.21.15.81:0/769817743 shutdown_connections 2023-10-07T08:42:53.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.090+0000 7fc512311700 1 --2- 172.21.15.81:0/769817743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc50c14c780 0x7fc50c16de30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.090+0000 7fc512311700 1 --2- 172.21.15.81:0/769817743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc50c14af70 0x7fc50c14e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.090+0000 7fc512311700 1 --2- 172.21.15.81:0/769817743 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc4f8066f30 0x7fc4f80693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.090+0000 7fc512311700 1 --2- 172.21.15.81:0/769817743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc50c0b4610 0x7fc50c14c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.090+0000 7fc512311700 1 -- 172.21.15.81:0/769817743 >> 172.21.15.81:0/769817743 conn(0x7fc50c06bb90 msgr2=0x7fc50c15a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:53.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.090+0000 7fc512311700 1 -- 172.21.15.81:0/769817743 shutdown_connections 2023-10-07T08:42:53.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.090+0000 7fc512311700 1 -- 172.21.15.81:0/769817743 wait complete. 2023-10-07T08:42:53.093 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 3 2023-10-07T08:42:53.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:42:53.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.215+0000 7f44d202f700 1 Processor -- start 2023-10-07T08:42:53.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.215+0000 7f44d202f700 1 -- start start 2023-10-07T08:42:53.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.216+0000 7f44d202f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44cc06ee30 0x7f44cc0adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.216+0000 7f44d202f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f44cc06f200 0x7f44cc15a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.216+0000 7f44d202f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44cc15b560 con 0x7f44cc15ab40 2023-10-07T08:42:53.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.216+0000 7f44d202f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44cc15afc0 con 0x7f44cc06f200 2023-10-07T08:42:53.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.216+0000 7f44d202f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc15b280 con 0x7f44cc06ee30 2023-10-07T08:42:53.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.216+0000 7f44d082c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f44cc06f200 0x7f44cc15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.216+0000 7f44d082c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f44cc06f200 0x7f44cc15a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33536/0 (socket says 172.21.15.81:33536) 2023-10-07T08:42:53.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.216+0000 7f44d082c700 1 -- 172.21.15.81:0/1462763638 learned_addr learned my addr 172.21.15.81:0/1462763638 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:53.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.216+0000 7f44d102d700 1 --2- 172.21.15.81:0/1462763638 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44cc06ee30 0x7f44cc0adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.216+0000 7f44d082c700 1 -- 172.21.15.81:0/1462763638 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44cc06ee30 msgr2=0x7f44cc0adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:53.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.216+0000 7f44d082c700 1 --2- 172.21.15.81:0/1462763638 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44cc06ee30 0x7f44cc0adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.216+0000 7f44d082c700 1 -- 172.21.15.81:0/1462763638 >> v1:172.21.15.89:6789/0 conn(0x7f44cc15ab40 legacy=0x7f44cc0aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.216+0000 7f44d082c700 1 -- 172.21.15.81:0/1462763638 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc0ad0f0 con 0x7f44cc06f200 2023-10-07T08:42:53.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.216+0000 7f44d082c700 1 --2- 172.21.15.81:0/1462763638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44cc06f200 0x7f44cc15a600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0099b0 tx=0x7f44bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afe665fdbef11de server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:53.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.216+0000 7f44c3fff700 1 -- 172.21.15.81:0/1462763638 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc009ea0 con 0x7f44cc06f200 2023-10-07T08:42:53.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.217+0000 7f44c3fff700 1 -- 172.21.15.81:0/1462763638 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc00b860 con 0x7f44cc06f200 2023-10-07T08:42:53.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.217+0000 7f44c3fff700 1 -- 172.21.15.81:0/1462763638 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc00bc00 con 0x7f44cc06f200 2023-10-07T08:42:53.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.217+0000 7f44d202f700 1 -- 172.21.15.81:0/1462763638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44cc06f200 msgr2=0x7f44cc15a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.217+0000 7f44d202f700 1 --2- 172.21.15.81:0/1462763638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44cc06f200 0x7f44cc15a600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0099b0 tx=0x7f44bc009250 comp rx=0 tx=0).stop 2023-10-07T08:42:53.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.217+0000 7f44d202f700 1 -- 172.21.15.81:0/1462763638 shutdown_connections 2023-10-07T08:42:53.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.217+0000 7f44d202f700 1 --2- 172.21.15.81:0/1462763638 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44cc06ee30 0x7f44cc0adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.217+0000 7f44d202f700 1 --2- 172.21.15.81:0/1462763638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44cc06f200 0x7f44cc15a600 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.217+0000 7f44d202f700 1 -- 172.21.15.81:0/1462763638 >> 172.21.15.81:0/1462763638 conn(0x7f44cc0cdb70 msgr2=0x7f44cc06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:53.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.217+0000 7f44d202f700 1 -- 172.21.15.81:0/1462763638 shutdown_connections 2023-10-07T08:42:53.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.217+0000 7f44d202f700 1 -- 172.21.15.81:0/1462763638 wait complete. 2023-10-07T08:42:53.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.218+0000 7f44d202f700 1 Processor -- start 2023-10-07T08:42:53.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.218+0000 7f44d202f700 1 -- start start 2023-10-07T08:42:53.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.219+0000 7f44d202f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44cc06ee30 0x7f44cc14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.219+0000 7f44d202f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44cc06f200 0x7f44cc0a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.219+0000 7f44d202f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44cc15ab40 0x7f44cc1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.219+0000 7f44d202f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc0a7c00 con 0x7f44cc15ab40 2023-10-07T08:42:53.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.219+0000 7f44d202f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc0aa660 con 0x7f44cc06f200 2023-10-07T08:42:53.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.219+0000 7f44d202f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc0aa940 con 0x7f44cc06ee30 2023-10-07T08:42:53.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.219+0000 7f44d182e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44cc15ab40 0x7f44cc1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.219+0000 7f44d182e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44cc15ab40 0x7f44cc1558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33550/0 (socket says 172.21.15.81:33550) 2023-10-07T08:42:53.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.219+0000 7f44d182e700 1 -- 172.21.15.81:0/1019965206 learned_addr learned my addr 172.21.15.81:0/1019965206 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:53.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.219+0000 7f44d102d700 1 --2- 172.21.15.81:0/1019965206 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44cc06ee30 0x7f44cc14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.219+0000 7f44d082c700 1 --2- 172.21.15.81:0/1019965206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44cc06f200 0x7f44cc0a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.219+0000 7f44d182e700 1 -- 172.21.15.81:0/1019965206 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44cc06ee30 msgr2=0x7f44cc14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.220+0000 7f44d182e700 1 --2- 172.21.15.81:0/1019965206 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44cc06ee30 0x7f44cc14ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.220+0000 7f44d182e700 1 -- 172.21.15.81:0/1019965206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44cc06f200 msgr2=0x7f44cc0a9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.220+0000 7f44d182e700 1 --2- 172.21.15.81:0/1019965206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44cc06f200 0x7f44cc0a9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.220+0000 7f44d182e700 1 -- 172.21.15.81:0/1019965206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc0094f0 con 0x7f44cc15ab40 2023-10-07T08:42:53.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.220+0000 7f44d182e700 1 --2- 172.21.15.81:0/1019965206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44cc15ab40 0x7f44cc1558d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f44c400c840 tx=0x7f44c4001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:53.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.220+0000 7f44c17fa700 1 -- 172.21.15.81:0/1019965206 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c4012630 con 0x7f44cc15ab40 2023-10-07T08:42:53.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.220+0000 7f44c17fa700 1 -- 172.21.15.81:0/1019965206 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c40127b0 con 0x7f44cc15ab40 2023-10-07T08:42:53.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.220+0000 7f44d202f700 1 -- 172.21.15.81:0/1019965206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44cc0aac20 con 0x7f44cc15ab40 2023-10-07T08:42:53.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.220+0000 7f44c17fa700 1 -- 172.21.15.81:0/1019965206 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c4012b70 con 0x7f44cc15ab40 2023-10-07T08:42:53.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.220+0000 7f44d202f700 1 -- 172.21.15.81:0/1019965206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44cc0a6660 con 0x7f44cc15ab40 2023-10-07T08:42:53.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.221+0000 7f44d202f700 1 -- 172.21.15.81:0/1019965206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44cc067fd0 con 0x7f44cc15ab40 2023-10-07T08:42:53.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.221+0000 7f44c17fa700 1 -- 172.21.15.81:0/1019965206 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44c401a3a0 con 0x7f44cc15ab40 2023-10-07T08:42:53.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.221+0000 7f44c17fa700 1 --2- 172.21.15.81:0/1019965206 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f44b0066f30 0x7f44b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.222+0000 7f44c17fa700 1 -- 172.21.15.81:0/1019965206 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f44c4084340 con 0x7f44cc15ab40 2023-10-07T08:42:53.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.222+0000 7f44d102d700 1 --2- 172.21.15.81:0/1019965206 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f44b0066f30 0x7f44b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.222+0000 7f44d102d700 1 --2- 172.21.15.81:0/1019965206 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f44b0066f30 0x7f44b00693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009da0 tx=0x7f44c8009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:53.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.226+0000 7f44c17fa700 1 -- 172.21.15.81:0/1019965206 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44c4051900 con 0x7f44cc15ab40 2023-10-07T08:42:53.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.407+0000 7f44d202f700 1 -- 172.21.15.81:0/1019965206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44cc0ad3d0 con 0x7f44cc15ab40 2023-10-07T08:42:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.408+0000 7f44c17fa700 1 -- 172.21.15.81:0/1019965206 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f44c4054f20 con 0x7f44cc15ab40 2023-10-07T08:42:53.409 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:53.409 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:49.217583+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:42:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.409+0000 7f44d202f700 1 -- 172.21.15.81:0/1019965206 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f44b0066f30 msgr2=0x7f44b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.409+0000 7f44d202f700 1 --2- 172.21.15.81:0/1019965206 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f44b0066f30 0x7f44b00693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009da0 tx=0x7f44c8009120 comp rx=0 tx=0).stop 2023-10-07T08:42:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.409+0000 7f44d202f700 1 -- 172.21.15.81:0/1019965206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44cc15ab40 msgr2=0x7f44cc1558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.409+0000 7f44d202f700 1 --2- 172.21.15.81:0/1019965206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44cc15ab40 0x7f44cc1558d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f44c400c840 tx=0x7f44c4001670 comp rx=0 tx=0).stop 2023-10-07T08:42:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.409+0000 7f44d202f700 1 -- 172.21.15.81:0/1019965206 shutdown_connections 2023-10-07T08:42:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.409+0000 7f44d202f700 1 --2- 172.21.15.81:0/1019965206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44cc15ab40 0x7f44cc1558d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.409+0000 7f44d202f700 1 --2- 172.21.15.81:0/1019965206 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f44b0066f30 0x7f44b00693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.409+0000 7f44d202f700 1 --2- 172.21.15.81:0/1019965206 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44cc06ee30 0x7f44cc14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.409+0000 7f44d202f700 1 --2- 172.21.15.81:0/1019965206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44cc06f200 0x7f44cc0a9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.409+0000 7f44d202f700 1 -- 172.21.15.81:0/1019965206 >> 172.21.15.81:0/1019965206 conn(0x7f44cc0cdb70 msgr2=0x7f44cc06a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.410+0000 7f44d202f700 1 -- 172.21.15.81:0/1019965206 shutdown_connections 2023-10-07T08:42:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.410+0000 7f44d202f700 1 -- 172.21.15.81:0/1019965206 wait complete. 2023-10-07T08:42:53.422 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T08:42:53.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:42:53.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.538+0000 7f98fd832700 1 Processor -- start 2023-10-07T08:42:53.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.538+0000 7f98fd832700 1 -- start start 2023-10-07T08:42:53.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.539+0000 7f98fd832700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f806e4e0 0x7f98f806cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.539+0000 7f98fd832700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f98f80cf080 0x7f98f806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.539+0000 7f98fd832700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f80aaf40 con 0x7f98f8159cb0 2023-10-07T08:42:53.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.539+0000 7f98fd832700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f806c570 con 0x7f98f80cf080 2023-10-07T08:42:53.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.539+0000 7f98fd832700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f80aa930 con 0x7f98f806e4e0 2023-10-07T08:42:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.539+0000 7f98fd031700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f98f80cf080 0x7f98f806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.539+0000 7f98fd031700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f98f80cf080 0x7f98f806d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33558/0 (socket says 172.21.15.81:33558) 2023-10-07T08:42:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.539+0000 7f98fd031700 1 -- 172.21.15.81:0/2937675707 learned_addr learned my addr 172.21.15.81:0/2937675707 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.539+0000 7f98f7fff700 1 --2- 172.21.15.81:0/2937675707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f806e4e0 0x7f98f806cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.539+0000 7f98fd031700 1 -- 172.21.15.81:0/2937675707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f806e4e0 msgr2=0x7f98f806cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.539+0000 7f98fd031700 1 --2- 172.21.15.81:0/2937675707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f806e4e0 0x7f98f806cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.539+0000 7f98fd031700 1 -- 172.21.15.81:0/2937675707 >> v1:172.21.15.89:6789/0 conn(0x7f98f8159cb0 legacy=0x7f98f80ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.539+0000 7f98fd031700 1 -- 172.21.15.81:0/2937675707 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f806e970 con 0x7f98f80cf080 2023-10-07T08:42:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.540+0000 7f98fd031700 1 --2- 172.21.15.81:0/2937675707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f80cf080 0x7f98f806d1e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009f20 tx=0x7f98f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ba1cb5527de23f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.540+0000 7f98f77fe700 1 -- 172.21.15.81:0/2937675707 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f000e070 con 0x7f98f80cf080 2023-10-07T08:42:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.540+0000 7f98f77fe700 1 -- 172.21.15.81:0/2937675707 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f000b9d0 con 0x7f98f80cf080 2023-10-07T08:42:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.540+0000 7f98f77fe700 1 -- 172.21.15.81:0/2937675707 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f00092e0 con 0x7f98f80cf080 2023-10-07T08:42:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.540+0000 7f98fd832700 1 -- 172.21.15.81:0/2937675707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f80cf080 msgr2=0x7f98f806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.540+0000 7f98fd832700 1 --2- 172.21.15.81:0/2937675707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f80cf080 0x7f98f806d1e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009f20 tx=0x7f98f0009840 comp rx=0 tx=0).stop 2023-10-07T08:42:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.540+0000 7f98fd832700 1 -- 172.21.15.81:0/2937675707 shutdown_connections 2023-10-07T08:42:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.540+0000 7f98fd832700 1 --2- 172.21.15.81:0/2937675707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f80cf080 0x7f98f806d1e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.540+0000 7f98fd832700 1 --2- 172.21.15.81:0/2937675707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f806e4e0 0x7f98f806cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.540+0000 7f98fd832700 1 -- 172.21.15.81:0/2937675707 >> 172.21.15.81:0/2937675707 conn(0x7f98f8068110 msgr2=0x7f98f806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.540+0000 7f98fd832700 1 -- 172.21.15.81:0/2937675707 shutdown_connections 2023-10-07T08:42:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.540+0000 7f98fd832700 1 -- 172.21.15.81:0/2937675707 wait complete. 2023-10-07T08:42:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.541+0000 7f98fd832700 1 Processor -- start 2023-10-07T08:42:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.542+0000 7f98fd832700 1 -- start start 2023-10-07T08:42:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.542+0000 7f98fd832700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98f806e4e0 0x7f98f814b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.542+0000 7f98fd832700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f80cf080 0x7f98f80b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.542+0000 7f98fd832700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f8159cb0 0x7f98f815c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.542+0000 7f98fd832700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f816a260 con 0x7f98f8159cb0 2023-10-07T08:42:53.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.542+0000 7f98fd832700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f81532e0 con 0x7f98f806e4e0 2023-10-07T08:42:53.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.542+0000 7f98fd832700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f814bee0 con 0x7f98f80cf080 2023-10-07T08:42:53.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.542+0000 7f98fd031700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f8159cb0 0x7f98f815c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.542+0000 7f98fd031700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f8159cb0 0x7f98f815c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33570/0 (socket says 172.21.15.81:33570) 2023-10-07T08:42:53.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.542+0000 7f98fd031700 1 -- 172.21.15.81:0/3775656788 learned_addr learned my addr 172.21.15.81:0/3775656788 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:53.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.542+0000 7f98fc830700 1 --2- 172.21.15.81:0/3775656788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98f806e4e0 0x7f98f814b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.542+0000 7f98f7fff700 1 --2- 172.21.15.81:0/3775656788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f80cf080 0x7f98f80b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.543+0000 7f98fd031700 1 -- 172.21.15.81:0/3775656788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f80cf080 msgr2=0x7f98f80b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.543+0000 7f98fd031700 1 --2- 172.21.15.81:0/3775656788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f80cf080 0x7f98f80b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.543+0000 7f98fd031700 1 -- 172.21.15.81:0/3775656788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98f806e4e0 msgr2=0x7f98f814b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.543+0000 7f98fd031700 1 --2- 172.21.15.81:0/3775656788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98f806e4e0 0x7f98f814b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.543+0000 7f98fd031700 1 -- 172.21.15.81:0/3775656788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f0009ae0 con 0x7f98f8159cb0 2023-10-07T08:42:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.543+0000 7f98fd031700 1 --2- 172.21.15.81:0/3775656788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f8159cb0 0x7f98f815c740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f98f80632d0 tx=0x7f98f0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.543+0000 7f98f4ff9700 1 -- 172.21.15.81:0/3775656788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f0008ad0 con 0x7f98f8159cb0 2023-10-07T08:42:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.543+0000 7f98f4ff9700 1 -- 172.21.15.81:0/3775656788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f0008c30 con 0x7f98f8159cb0 2023-10-07T08:42:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.543+0000 7f98fd832700 1 -- 172.21.15.81:0/3775656788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f80b37d0 con 0x7f98f8159cb0 2023-10-07T08:42:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.543+0000 7f98f4ff9700 1 -- 172.21.15.81:0/3775656788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f0026460 con 0x7f98f8159cb0 2023-10-07T08:42:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.543+0000 7f98fd832700 1 -- 172.21.15.81:0/3775656788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f80b3d90 con 0x7f98f8159cb0 2023-10-07T08:42:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.544+0000 7f98fd832700 1 -- 172.21.15.81:0/3775656788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f8069c00 con 0x7f98f8159cb0 2023-10-07T08:42:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.544+0000 7f98f4ff9700 1 -- 172.21.15.81:0/3775656788 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98f0003040 con 0x7f98f8159cb0 2023-10-07T08:42:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.545+0000 7f98f4ff9700 1 --2- 172.21.15.81:0/3775656788 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f98e4066f30 0x7f98e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.545+0000 7f98fc830700 1 --2- 172.21.15.81:0/3775656788 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f98e4066f30 0x7f98e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.545+0000 7f98f4ff9700 1 -- 172.21.15.81:0/3775656788 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f98f0086050 con 0x7f98f8159cb0 2023-10-07T08:42:53.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.545+0000 7f98fc830700 1 --2- 172.21.15.81:0/3775656788 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f98e4066f30 0x7f98e40693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f98e80039e0 tx=0x7f98e8007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:53.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.549+0000 7f98f4ff9700 1 -- 172.21.15.81:0/3775656788 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98f0053610 con 0x7f98f8159cb0 2023-10-07T08:42:53.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.730+0000 7f98fd832700 1 -- 172.21.15.81:0/3775656788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f98f80aabd0 con 0x7f98f8159cb0 2023-10-07T08:42:53.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.731+0000 7f98f4ff9700 1 -- 172.21.15.81:0/3775656788 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f98f0056c30 con 0x7f98f8159cb0 2023-10-07T08:42:53.732 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:42:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.733+0000 7f98fd832700 1 -- 172.21.15.81:0/3775656788 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f98e4066f30 msgr2=0x7f98e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.733+0000 7f98fd832700 1 --2- 172.21.15.81:0/3775656788 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f98e4066f30 0x7f98e40693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f98e80039e0 tx=0x7f98e8007ec0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.733+0000 7f98fd832700 1 -- 172.21.15.81:0/3775656788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f8159cb0 msgr2=0x7f98f815c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.733+0000 7f98fd832700 1 --2- 172.21.15.81:0/3775656788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f8159cb0 0x7f98f815c740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f98f80632d0 tx=0x7f98f0018000 comp rx=0 tx=0).stop 2023-10-07T08:42:53.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.733+0000 7f98fd832700 1 -- 172.21.15.81:0/3775656788 shutdown_connections 2023-10-07T08:42:53.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.733+0000 7f98fd832700 1 --2- 172.21.15.81:0/3775656788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f8159cb0 0x7f98f815c740 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.733+0000 7f98fd832700 1 --2- 172.21.15.81:0/3775656788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98f806e4e0 0x7f98f814b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.733+0000 7f98fd832700 1 --2- 172.21.15.81:0/3775656788 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f98e4066f30 0x7f98e40693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.733+0000 7f98fd832700 1 --2- 172.21.15.81:0/3775656788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f80cf080 0x7f98f80b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.733+0000 7f98fd832700 1 -- 172.21.15.81:0/3775656788 >> 172.21.15.81:0/3775656788 conn(0x7f98f8068110 msgr2=0x7f98f806ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:53.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.733+0000 7f98fd832700 1 -- 172.21.15.81:0/3775656788 shutdown_connections 2023-10-07T08:42:53.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.733+0000 7f98fd832700 1 -- 172.21.15.81:0/3775656788 wait complete. 2023-10-07T08:42:53.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T08:42:53.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.859+0000 7f0908f23700 1 Processor -- start 2023-10-07T08:42:53.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.859+0000 7f0908f23700 1 -- start start 2023-10-07T08:42:53.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.860+0000 7f0908f23700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09041578d0 0x7f09040cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.860+0000 7f0908f23700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0904157ca0 0x7f090415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.860+0000 7f0908f23700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09040d07c0 con 0x7f090406d120 2023-10-07T08:42:53.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.860+0000 7f0908f23700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09040cfbb0 con 0x7f0904157ca0 2023-10-07T08:42:53.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.860+0000 7f0908f23700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09040cfe90 con 0x7f09041578d0 2023-10-07T08:42:53.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.860+0000 7f0902d9d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f090406d120 0x7f090415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:41978/0 (socket says 172.21.15.81:41978) 2023-10-07T08:42:53.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.861+0000 7f0902d9d700 1 -- 172.21.15.81:0/73416494 learned_addr learned my addr 172.21.15.81:0/73416494 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:42:53.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.861+0000 7f090259c700 1 --2- 172.21.15.81:0/73416494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09041578d0 0x7f09040cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.861+0000 7f08f9d9b700 1 --2- 172.21.15.81:0/73416494 >> v2:172.21.15.89:3300/0 conn(0x7f0904157ca0 0x7f090415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.861+0000 7f0901d9b700 1 -- 172.21.15.81:0/73416494 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197808875 0 0) 0x7f09040d07c0 con 0x7f090406d120 2023-10-07T08:42:53.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.861+0000 7f090259c700 1 -- 172.21.15.81:0/73416494 >> v2:172.21.15.89:3300/0 conn(0x7f0904157ca0 msgr2=0x7f090415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:53.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.861+0000 7f090259c700 1 --2- 172.21.15.81:0/73416494 >> v2:172.21.15.89:3300/0 conn(0x7f0904157ca0 0x7f090415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.861+0000 7f090259c700 1 -- 172.21.15.81:0/73416494 >> v1:172.21.15.89:6789/0 conn(0x7f090406d120 legacy=0x7f090415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.861+0000 7f090259c700 1 -- 172.21.15.81:0/73416494 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09040d0170 con 0x7f09041578d0 2023-10-07T08:42:53.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.861+0000 7f090259c700 1 --2- 172.21.15.81:0/73416494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09041578d0 0x7f09040cf4f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f08f40098e0 tx=0x7f08f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99cd603a0d9de812 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:53.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.861+0000 7f0901d9b700 1 -- 172.21.15.81:0/73416494 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400b640 con 0x7f09041578d0 2023-10-07T08:42:53.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.861+0000 7f0901d9b700 1 -- 172.21.15.81:0/73416494 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f400b7a0 con 0x7f09041578d0 2023-10-07T08:42:53.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.861+0000 7f0901d9b700 1 -- 172.21.15.81:0/73416494 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400bb40 con 0x7f09041578d0 2023-10-07T08:42:53.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.862+0000 7f0908f23700 1 -- 172.21.15.81:0/73416494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09041578d0 msgr2=0x7f09040cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.862+0000 7f0908f23700 1 --2- 172.21.15.81:0/73416494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09041578d0 0x7f09040cf4f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f08f40098e0 tx=0x7f08f40091a0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.862+0000 7f0908f23700 1 -- 172.21.15.81:0/73416494 shutdown_connections 2023-10-07T08:42:53.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.862+0000 7f0908f23700 1 --2- 172.21.15.81:0/73416494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09041578d0 0x7f09040cf4f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.862+0000 7f0908f23700 1 --2- 172.21.15.81:0/73416494 >> v2:172.21.15.89:3300/0 conn(0x7f0904157ca0 0x7f090415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.862+0000 7f0908f23700 1 -- 172.21.15.81:0/73416494 >> 172.21.15.81:0/73416494 conn(0x7f090406bb90 msgr2=0x7f090406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:53.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.862+0000 7f0908f23700 1 -- 172.21.15.81:0/73416494 shutdown_connections 2023-10-07T08:42:53.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.862+0000 7f0908f23700 1 -- 172.21.15.81:0/73416494 wait complete. 2023-10-07T08:42:53.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.863+0000 7f0908f23700 1 Processor -- start 2023-10-07T08:42:53.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.863+0000 7f0908f23700 1 -- start start 2023-10-07T08:42:53.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f0908f23700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f090406d120 0x7f09040b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f0908f23700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09041578d0 0x7f090415c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f0908f23700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0904157ca0 0x7f090415c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f0908f23700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09040abcb0 con 0x7f09041578d0 2023-10-07T08:42:53.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f0908f23700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09040b2570 con 0x7f0904157ca0 2023-10-07T08:42:53.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f0908f23700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09040aafb0 con 0x7f090406d120 2023-10-07T08:42:53.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f08f9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09041578d0 0x7f090415c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f090259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f090406d120 0x7f09040b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f090259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f090406d120 0x7f09040b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:39138/0 (socket says 172.21.15.81:39138) 2023-10-07T08:42:53.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f090259c700 1 -- 172.21.15.81:0/149610450 learned_addr learned my addr 172.21.15.81:0/149610450 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:53.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f08f9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09041578d0 0x7f090415c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33572/0 (socket says 172.21.15.81:33572) 2023-10-07T08:42:53.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f0902d9d700 1 --2- 172.21.15.81:0/149610450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0904157ca0 0x7f090415c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f090259c700 1 -- 172.21.15.81:0/149610450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0904157ca0 msgr2=0x7f090415c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f090259c700 1 --2- 172.21.15.81:0/149610450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0904157ca0 0x7f090415c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f090259c700 1 -- 172.21.15.81:0/149610450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09041578d0 msgr2=0x7f090415c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:53.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f090259c700 1 --2- 172.21.15.81:0/149610450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09041578d0 0x7f090415c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:53.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.864+0000 7f090259c700 1 -- 172.21.15.81:0/149610450 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f4009420 con 0x7f090406d120 2023-10-07T08:42:53.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.865+0000 7f090259c700 1 --2- 172.21.15.81:0/149610450 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f090406d120 0x7f09040b2030 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0904068330 tx=0x7f08f4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:53.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.865+0000 7f08faffd700 1 -- 172.21.15.81:0/149610450 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400bb20 con 0x7f090406d120 2023-10-07T08:42:53.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.865+0000 7f08faffd700 1 -- 172.21.15.81:0/149610450 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f4000c90 con 0x7f090406d120 2023-10-07T08:42:53.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.865+0000 7f08faffd700 1 -- 172.21.15.81:0/149610450 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4011630 con 0x7f090406d120 2023-10-07T08:42:53.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.865+0000 7f0908f23700 1 -- 172.21.15.81:0/149610450 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090415cd70 con 0x7f090406d120 2023-10-07T08:42:53.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.865+0000 7f0908f23700 1 -- 172.21.15.81:0/149610450 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09040ab660 con 0x7f090406d120 2023-10-07T08:42:53.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.866+0000 7f0908f23700 1 -- 172.21.15.81:0/149610450 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0904067ac0 con 0x7f090406d120 2023-10-07T08:42:53.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.866+0000 7f08faffd700 1 -- 172.21.15.81:0/149610450 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08f40119a0 con 0x7f090406d120 2023-10-07T08:42:53.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.866+0000 7f08faffd700 1 --2- 172.21.15.81:0/149610450 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f08e4066f60 0x7f08e4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:53.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.866+0000 7f08faffd700 1 -- 172.21.15.81:0/149610450 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f08f4085500 con 0x7f090406d120 2023-10-07T08:42:53.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.866+0000 7f08f9d9b700 1 --2- 172.21.15.81:0/149610450 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f08e4066f60 0x7f08e4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:53.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.867+0000 7f08f9d9b700 1 --2- 172.21.15.81:0/149610450 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f08e4066f60 0x7f08e4069410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f090415d330 tx=0x7f08ec0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:53.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:53.871+0000 7f08faffd700 1 -- 172.21.15.81:0/149610450 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08f4052ac0 con 0x7f090406d120 2023-10-07T08:42:54.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.055+0000 7f0908f23700 1 -- 172.21.15.81:0/149610450 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f09040d0450 con 0x7f090406d120 2023-10-07T08:42:54.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.056+0000 7f08faffd700 1 -- 172.21.15.81:0/149610450 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f08f4015060 con 0x7f090406d120 2023-10-07T08:42:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:54.058 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-07T08:42:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:42:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-07T08:42:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-07T08:42:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:42:54.058 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-07T08:42:54.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.058+0000 7f0908f23700 1 -- 172.21.15.81:0/149610450 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f08e4066f60 msgr2=0x7f08e4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:54.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.058+0000 7f0908f23700 1 --2- 172.21.15.81:0/149610450 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f08e4066f60 0x7f08e4069410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f090415d330 tx=0x7f08ec0091a0 comp rx=0 tx=0).stop 2023-10-07T08:42:54.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.058+0000 7f0908f23700 1 -- 172.21.15.81:0/149610450 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f090406d120 msgr2=0x7f09040b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:54.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.058+0000 7f0908f23700 1 --2- 172.21.15.81:0/149610450 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f090406d120 0x7f09040b2030 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0904068330 tx=0x7f08f4017000 comp rx=0 tx=0).stop 2023-10-07T08:42:54.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.058+0000 7f0908f23700 1 -- 172.21.15.81:0/149610450 shutdown_connections 2023-10-07T08:42:54.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.058+0000 7f0908f23700 1 --2- 172.21.15.81:0/149610450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0904157ca0 0x7f090415c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:54.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.058+0000 7f0908f23700 1 --2- 172.21.15.81:0/149610450 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f08e4066f60 0x7f08e4069410 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:54.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.058+0000 7f0908f23700 1 --2- 172.21.15.81:0/149610450 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f090406d120 0x7f09040b2030 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:54.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.058+0000 7f0908f23700 1 --2- 172.21.15.81:0/149610450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09041578d0 0x7f090415c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:54.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.058+0000 7f0908f23700 1 -- 172.21.15.81:0/149610450 >> 172.21.15.81:0/149610450 conn(0x7f090406bb90 msgr2=0x7f0904155810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:54.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.058+0000 7f0908f23700 1 -- 172.21.15.81:0/149610450 shutdown_connections 2023-10-07T08:42:54.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.058+0000 7f0908f23700 1 -- 172.21.15.81:0/149610450 wait complete. 2023-10-07T08:42:54.071 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T08:42:54.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T08:42:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.187+0000 7fd90a560700 1 Processor -- start 2023-10-07T08:42:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.187+0000 7fd90a560700 1 -- start start 2023-10-07T08:42:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.188+0000 7fd90a560700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd9041578d0 0x7fd9040cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.188+0000 7fd90a560700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd90406d120 0x7fd90406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.188+0000 7fd90a560700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9040d07c0 con 0x7fd904157ca0 2023-10-07T08:42:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.188+0000 7fd90a560700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd90406daa0 con 0x7fd9041578d0 2023-10-07T08:42:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.188+0000 7fd90a560700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9040cfbb0 con 0x7fd90406d120 2023-10-07T08:42:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.188+0000 7fd903fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd9041578d0 0x7fd9040cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.188+0000 7fd903fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd9041578d0 0x7fd9040cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33574/0 (socket says 172.21.15.81:33574) 2023-10-07T08:42:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.188+0000 7fd903fff700 1 -- 172.21.15.81:0/306441548 learned_addr learned my addr 172.21.15.81:0/306441548 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.188+0000 7fd908afd700 1 --2- 172.21.15.81:0/306441548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd90406d120 0x7fd90406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.188+0000 7fd903fff700 1 -- 172.21.15.81:0/306441548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd90406d120 msgr2=0x7fd90406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.188+0000 7fd903fff700 1 --2- 172.21.15.81:0/306441548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd90406d120 0x7fd90406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.188+0000 7fd903fff700 1 -- 172.21.15.81:0/306441548 >> v1:172.21.15.89:6789/0 conn(0x7fd904157ca0 legacy=0x7fd90415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.188+0000 7fd903fff700 1 -- 172.21.15.81:0/306441548 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9040cfe90 con 0x7fd9041578d0 2023-10-07T08:42:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.188+0000 7fd902ffd700 1 -- 172.21.15.81:0/306441548 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000086907 0 0) 0x7fd9040d07c0 con 0x7fd904157ca0 2023-10-07T08:42:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.188+0000 7fd903fff700 1 --2- 172.21.15.81:0/306441548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9041578d0 0x7fd9040cf4f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40099b0 tx=0x7fd8f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819364f261455468 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.188+0000 7fd902ffd700 1 -- 172.21.15.81:0/306441548 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4009ea0 con 0x7fd9041578d0 2023-10-07T08:42:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.189+0000 7fd902ffd700 1 -- 172.21.15.81:0/306441548 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f400b860 con 0x7fd9041578d0 2023-10-07T08:42:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.189+0000 7fd902ffd700 1 -- 172.21.15.81:0/306441548 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f400bc00 con 0x7fd9041578d0 2023-10-07T08:42:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.189+0000 7fd90a560700 1 -- 172.21.15.81:0/306441548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9041578d0 msgr2=0x7fd9040cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.189+0000 7fd90a560700 1 --2- 172.21.15.81:0/306441548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9041578d0 0x7fd9040cf4f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40099b0 tx=0x7fd8f4009250 comp rx=0 tx=0).stop 2023-10-07T08:42:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.189+0000 7fd90a560700 1 -- 172.21.15.81:0/306441548 shutdown_connections 2023-10-07T08:42:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.189+0000 7fd90a560700 1 --2- 172.21.15.81:0/306441548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd90406d120 0x7fd90406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.189+0000 7fd90a560700 1 --2- 172.21.15.81:0/306441548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9041578d0 0x7fd9040cf4f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:54.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.189+0000 7fd90a560700 1 -- 172.21.15.81:0/306441548 >> 172.21.15.81:0/306441548 conn(0x7fd90406bb90 msgr2=0x7fd90406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:54.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.189+0000 7fd90a560700 1 -- 172.21.15.81:0/306441548 shutdown_connections 2023-10-07T08:42:54.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.189+0000 7fd90a560700 1 -- 172.21.15.81:0/306441548 wait complete. 2023-10-07T08:42:54.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.190+0000 7fd90a560700 1 Processor -- start 2023-10-07T08:42:54.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.190+0000 7fd90a560700 1 -- start start 2023-10-07T08:42:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.191+0000 7fd90a560700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd90406d120 0x7fd9040b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.191+0000 7fd90a560700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9041578d0 0x7fd9040b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.191+0000 7fd90a560700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd904157ca0 0x7fd904158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.191+0000 7fd90a560700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9040b4af0 con 0x7fd9041578d0 2023-10-07T08:42:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.191+0000 7fd90a560700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90416ad00 con 0x7fd90406d120 2023-10-07T08:42:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.191+0000 7fd90a560700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90416afe0 con 0x7fd904157ca0 2023-10-07T08:42:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.191+0000 7fd9037fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9041578d0 0x7fd9040b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.191+0000 7fd9037fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9041578d0 0x7fd9040b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33580/0 (socket says 172.21.15.81:33580) 2023-10-07T08:42:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.191+0000 7fd9037fe700 1 -- 172.21.15.81:0/2789208026 learned_addr learned my addr 172.21.15.81:0/2789208026 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.191+0000 7fd908afd700 1 --2- 172.21.15.81:0/2789208026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd904157ca0 0x7fd904158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.191+0000 7fd903fff700 1 --2- 172.21.15.81:0/2789208026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd90406d120 0x7fd9040b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.191+0000 7fd9037fe700 1 -- 172.21.15.81:0/2789208026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd904157ca0 msgr2=0x7fd904158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.191+0000 7fd9037fe700 1 --2- 172.21.15.81:0/2789208026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd904157ca0 0x7fd904158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.191+0000 7fd9037fe700 1 -- 172.21.15.81:0/2789208026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd90406d120 msgr2=0x7fd9040b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.191+0000 7fd9037fe700 1 --2- 172.21.15.81:0/2789208026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd90406d120 0x7fd9040b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.191+0000 7fd9037fe700 1 -- 172.21.15.81:0/2789208026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f40094f0 con 0x7fd9041578d0 2023-10-07T08:42:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.192+0000 7fd9037fe700 1 --2- 172.21.15.81:0/2789208026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9041578d0 0x7fd9040b45b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c560 tx=0x7fd8f8007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.192+0000 7fd8ebfff700 1 -- 172.21.15.81:0/2789208026 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8011590 con 0x7fd9041578d0 2023-10-07T08:42:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.192+0000 7fd8ebfff700 1 -- 172.21.15.81:0/2789208026 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f8011710 con 0x7fd9041578d0 2023-10-07T08:42:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.192+0000 7fd90a560700 1 -- 172.21.15.81:0/2789208026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90416b2c0 con 0x7fd9041578d0 2023-10-07T08:42:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.192+0000 7fd8ebfff700 1 -- 172.21.15.81:0/2789208026 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8011ad0 con 0x7fd9041578d0 2023-10-07T08:42:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.192+0000 7fd90a560700 1 -- 172.21.15.81:0/2789208026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90416b880 con 0x7fd9041578d0 2023-10-07T08:42:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.193+0000 7fd90a560700 1 -- 172.21.15.81:0/2789208026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd904151c50 con 0x7fd9041578d0 2023-10-07T08:42:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.193+0000 7fd8ebfff700 1 -- 172.21.15.81:0/2789208026 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8f801b3b0 con 0x7fd9041578d0 2023-10-07T08:42:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.193+0000 7fd8ebfff700 1 --2- 172.21.15.81:0/2789208026 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd8f0066f30 0x7fd8f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.193+0000 7fd8ebfff700 1 -- 172.21.15.81:0/2789208026 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd8f8083650 con 0x7fd9041578d0 2023-10-07T08:42:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.193+0000 7fd903fff700 1 --2- 172.21.15.81:0/2789208026 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd8f0066f30 0x7fd8f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.194+0000 7fd903fff700 1 --2- 172.21.15.81:0/2789208026 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd8f0066f30 0x7fd8f00693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40099b0 tx=0x7fd8f4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.197+0000 7fd8ebfff700 1 -- 172.21.15.81:0/2789208026 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd904151c50 con 0x7fd9041578d0 2023-10-07T08:42:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:54.379+0000 7fd90a560700 1 -- 172.21.15.81:0/2789208026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd904151c50 con 0x7fd9041578d0 2023-10-07T08:42:54.807 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:42:54.810 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:42:55.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.243+0000 7fd8ebfff700 1 -- 172.21.15.81:0/2789208026 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd904151c50 con 0x7fd9041578d0 2023-10-07T08:42:55.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.246+0000 7fd90a560700 1 -- 172.21.15.81:0/2789208026 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd8f0066f30 msgr2=0x7fd8f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:55.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.246+0000 7fd90a560700 1 --2- 172.21.15.81:0/2789208026 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd8f0066f30 0x7fd8f00693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40099b0 tx=0x7fd8f4017000 comp rx=0 tx=0).stop 2023-10-07T08:42:55.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.246+0000 7fd90a560700 1 -- 172.21.15.81:0/2789208026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9041578d0 msgr2=0x7fd9040b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:55.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.246+0000 7fd90a560700 1 --2- 172.21.15.81:0/2789208026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9041578d0 0x7fd9040b45b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c560 tx=0x7fd8f8007f50 comp rx=0 tx=0).stop 2023-10-07T08:42:55.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.246+0000 7fd90a560700 1 -- 172.21.15.81:0/2789208026 shutdown_connections 2023-10-07T08:42:55.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.246+0000 7fd90a560700 1 --2- 172.21.15.81:0/2789208026 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd8f0066f30 0x7fd8f00693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:55.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.246+0000 7fd90a560700 1 --2- 172.21.15.81:0/2789208026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd904157ca0 0x7fd904158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:55.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.246+0000 7fd90a560700 1 --2- 172.21.15.81:0/2789208026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd90406d120 0x7fd9040b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:55.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.246+0000 7fd90a560700 1 --2- 172.21.15.81:0/2789208026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9041578d0 0x7fd9040b45b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:55.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.246+0000 7fd90a560700 1 -- 172.21.15.81:0/2789208026 >> 172.21.15.81:0/2789208026 conn(0x7fd90406bb90 msgr2=0x7fd90415cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:55.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.246+0000 7fd90a560700 1 -- 172.21.15.81:0/2789208026 shutdown_connections 2023-10-07T08:42:55.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.246+0000 7fd90a560700 1 -- 172.21.15.81:0/2789208026 wait complete. 2023-10-07T08:42:55.249 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-07T08:42:55.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T08:42:55.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.379+0000 7fa8c4d68700 1 Processor -- start 2023-10-07T08:42:55.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.379+0000 7fa8c4d68700 1 -- start start 2023-10-07T08:42:55.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.380+0000 7fa8c4d68700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8c006ea40 0x7fa8c015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:55.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.380+0000 7fa8c4d68700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa8c00b1980 0x7fa8c015a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:55.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.380+0000 7fa8c4d68700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c00b3dd0 con 0x7fa8c00cf440 2023-10-07T08:42:55.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.380+0000 7fa8c4d68700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c006da50 con 0x7fa8c00b1980 2023-10-07T08:42:55.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.380+0000 7fa8c4d68700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00b3780 con 0x7fa8c006ea40 2023-10-07T08:42:55.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.381+0000 7fa8bed9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa8c00b1980 0x7fa8c015a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:55.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.381+0000 7fa8bdd9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8c006ea40 0x7fa8c015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:55.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.381+0000 7fa8bdd9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8c006ea40 0x7fa8c015a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:39162/0 (socket says 172.21.15.81:39162) 2023-10-07T08:42:55.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.381+0000 7fa8bed9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa8c00b1980 0x7fa8c015a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:40392/0 (socket says 172.21.15.81:40392) 2023-10-07T08:42:55.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.381+0000 7fa8bdd9b700 1 -- 172.21.15.81:0/1901420568 learned_addr learned my addr 172.21.15.81:0/1901420568 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:55.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.381+0000 7fa8be59c700 1 --1- 172.21.15.81:0/1901420568 >> v1:172.21.15.89:6789/0 conn(0x7fa8c00cf440 0x7fa8c00b4260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:41988/0 (socket says 172.21.15.81:41988) 2023-10-07T08:42:55.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.381+0000 7fa8bdd9b700 1 -- 172.21.15.81:0/1901420568 >> v2:172.21.15.89:3300/0 conn(0x7fa8c00b1980 msgr2=0x7fa8c015a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:55.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.381+0000 7fa8bdd9b700 1 --2- 172.21.15.81:0/1901420568 >> v2:172.21.15.89:3300/0 conn(0x7fa8c00b1980 0x7fa8c015a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:55.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.381+0000 7fa8bdd9b700 1 -- 172.21.15.81:0/1901420568 >> v1:172.21.15.89:6789/0 conn(0x7fa8c00cf440 legacy=0x7fa8c00b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.381+0000 7fa8bdd9b700 1 -- 172.21.15.81:0/1901420568 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c00b3a60 con 0x7fa8c006ea40 2023-10-07T08:42:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.381+0000 7fa8bed9d700 1 --2- 172.21.15.81:0/1901420568 >> v2:172.21.15.89:3300/0 conn(0x7fa8c00b1980 0x7fa8c015a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:42:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.381+0000 7fa8bdd9b700 1 --2- 172.21.15.81:0/1901420568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8c006ea40 0x7fa8c015a4b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80099b0 tx=0x7fa8a8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36383910f174ecd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.381+0000 7fa8bd59a700 1 -- 172.21.15.81:0/1901420568 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8009ea0 con 0x7fa8c006ea40 2023-10-07T08:42:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.381+0000 7fa8bd59a700 1 -- 172.21.15.81:0/1901420568 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a800b860 con 0x7fa8c006ea40 2023-10-07T08:42:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.381+0000 7fa8bd59a700 1 -- 172.21.15.81:0/1901420568 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a800bc00 con 0x7fa8c006ea40 2023-10-07T08:42:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.382+0000 7fa8c4d68700 1 -- 172.21.15.81:0/1901420568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8c006ea40 msgr2=0x7fa8c015a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.382+0000 7fa8c4d68700 1 --2- 172.21.15.81:0/1901420568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8c006ea40 0x7fa8c015a4b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80099b0 tx=0x7fa8a8009250 comp rx=0 tx=0).stop 2023-10-07T08:42:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.382+0000 7fa8c4d68700 1 -- 172.21.15.81:0/1901420568 shutdown_connections 2023-10-07T08:42:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.382+0000 7fa8c4d68700 1 --2- 172.21.15.81:0/1901420568 >> v2:172.21.15.89:3300/0 conn(0x7fa8c00b1980 0x7fa8c015a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:55.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.382+0000 7fa8c4d68700 1 --2- 172.21.15.81:0/1901420568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8c006ea40 0x7fa8c015a4b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:55.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.382+0000 7fa8c4d68700 1 -- 172.21.15.81:0/1901420568 >> 172.21.15.81:0/1901420568 conn(0x7fa8c006b530 msgr2=0x7fa8c0067640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:55.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.382+0000 7fa8c4d68700 1 -- 172.21.15.81:0/1901420568 shutdown_connections 2023-10-07T08:42:55.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.382+0000 7fa8c4d68700 1 -- 172.21.15.81:0/1901420568 wait complete. 2023-10-07T08:42:55.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.383+0000 7fa8c4d68700 1 Processor -- start 2023-10-07T08:42:55.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.383+0000 7fa8c4d68700 1 -- start start 2023-10-07T08:42:55.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.384+0000 7fa8c4d68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c006ea40 0x7fa8c00cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:55.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.384+0000 7fa8c4d68700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8c00b1980 0x7fa8c014b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:55.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.384+0000 7fa8c4d68700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8c00cf440 0x7fa8c015da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:55.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.384+0000 7fa8c4d68700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00cb590 con 0x7fa8c006ea40 2023-10-07T08:42:55.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.384+0000 7fa8c4d68700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c014bd10 con 0x7fa8c00b1980 2023-10-07T08:42:55.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.384+0000 7fa8c4d68700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00ca980 con 0x7fa8c00cf440 2023-10-07T08:42:55.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.384+0000 7fa8be59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c006ea40 0x7fa8c00cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:55.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.384+0000 7fa8be59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c006ea40 0x7fa8c00cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33594/0 (socket says 172.21.15.81:33594) 2023-10-07T08:42:55.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.384+0000 7fa8be59c700 1 -- 172.21.15.81:0/3532797694 learned_addr learned my addr 172.21.15.81:0/3532797694 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:55.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.384+0000 7fa8bdd9b700 1 --2- 172.21.15.81:0/3532797694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8c00b1980 0x7fa8c014b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:55.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.384+0000 7fa8bed9d700 1 --2- 172.21.15.81:0/3532797694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8c00cf440 0x7fa8c015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.384+0000 7fa8be59c700 1 -- 172.21.15.81:0/3532797694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8c00cf440 msgr2=0x7fa8c015da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.384+0000 7fa8be59c700 1 --2- 172.21.15.81:0/3532797694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8c00cf440 0x7fa8c015da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.384+0000 7fa8be59c700 1 -- 172.21.15.81:0/3532797694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8c00b1980 msgr2=0x7fa8c014b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.384+0000 7fa8be59c700 1 --2- 172.21.15.81:0/3532797694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8c00b1980 0x7fa8c014b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.384+0000 7fa8be59c700 1 -- 172.21.15.81:0/3532797694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b8009420 con 0x7fa8c006ea40 2023-10-07T08:42:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.385+0000 7fa8be59c700 1 --2- 172.21.15.81:0/3532797694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c006ea40 0x7fa8c00cba20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000cdb0 tx=0x7fa8b0001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.385+0000 7fa8b67fc700 1 -- 172.21.15.81:0/3532797694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0005df0 con 0x7fa8c006ea40 2023-10-07T08:42:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.385+0000 7fa8b67fc700 1 -- 172.21.15.81:0/3532797694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b000a920 con 0x7fa8c006ea40 2023-10-07T08:42:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.385+0000 7fa8c4d68700 1 -- 172.21.15.81:0/3532797694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a80094f0 con 0x7fa8c006ea40 2023-10-07T08:42:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.385+0000 7fa8b67fc700 1 -- 172.21.15.81:0/3532797694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b000acc0 con 0x7fa8c006ea40 2023-10-07T08:42:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.385+0000 7fa8c4d68700 1 -- 172.21.15.81:0/3532797694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c00caf40 con 0x7fa8c006ea40 2023-10-07T08:42:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.386+0000 7fa8c4d68700 1 -- 172.21.15.81:0/3532797694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c00cb870 con 0x7fa8c006ea40 2023-10-07T08:42:55.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.386+0000 7fa8b67fc700 1 -- 172.21.15.81:0/3532797694 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa8b0007300 con 0x7fa8c006ea40 2023-10-07T08:42:55.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.386+0000 7fa8b67fc700 1 --2- 172.21.15.81:0/3532797694 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa8a0066f30 0x7fa8a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:55.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.386+0000 7fa8b67fc700 1 -- 172.21.15.81:0/3532797694 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fa8b00843e0 con 0x7fa8c006ea40 2023-10-07T08:42:55.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.386+0000 7fa8bdd9b700 1 --2- 172.21.15.81:0/3532797694 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa8a0066f30 0x7fa8a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:55.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.387+0000 7fa8bdd9b700 1 --2- 172.21.15.81:0/3532797694 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa8a0066f30 0x7fa8a00693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80099b0 tx=0x7fa8a8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:55.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.391+0000 7fa8b67fc700 1 -- 172.21.15.81:0/3532797694 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8b0051970 con 0x7fa8c006ea40 2023-10-07T08:42:55.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:55.577+0000 7fa8c4d68700 1 -- 172.21.15.81:0/3532797694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa8c006dd30 con 0x7fa8c006ea40 2023-10-07T08:42:56.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.249+0000 7fa8b67fc700 1 -- 172.21.15.81:0/3532797694 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa8b0054f90 con 0x7fa8c006ea40 2023-10-07T08:42:56.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.261+0000 7fa8c4d68700 1 -- 172.21.15.81:0/3532797694 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa8a0066f30 msgr2=0x7fa8a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:56.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.261+0000 7fa8c4d68700 1 --2- 172.21.15.81:0/3532797694 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa8a0066f30 0x7fa8a00693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80099b0 tx=0x7fa8a8017000 comp rx=0 tx=0).stop 2023-10-07T08:42:56.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.261+0000 7fa8c4d68700 1 -- 172.21.15.81:0/3532797694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c006ea40 msgr2=0x7fa8c00cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:56.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.261+0000 7fa8c4d68700 1 --2- 172.21.15.81:0/3532797694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c006ea40 0x7fa8c00cba20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000cdb0 tx=0x7fa8b0001b90 comp rx=0 tx=0).stop 2023-10-07T08:42:56.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.261+0000 7fa8c4d68700 1 -- 172.21.15.81:0/3532797694 shutdown_connections 2023-10-07T08:42:56.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.261+0000 7fa8c4d68700 1 --2- 172.21.15.81:0/3532797694 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa8a0066f30 0x7fa8a00693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.261+0000 7fa8c4d68700 1 --2- 172.21.15.81:0/3532797694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8c00cf440 0x7fa8c015da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.261+0000 7fa8c4d68700 1 --2- 172.21.15.81:0/3532797694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c006ea40 0x7fa8c00cba20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.261+0000 7fa8c4d68700 1 --2- 172.21.15.81:0/3532797694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8c00b1980 0x7fa8c014b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.261+0000 7fa8c4d68700 1 -- 172.21.15.81:0/3532797694 >> 172.21.15.81:0/3532797694 conn(0x7fa8c006b530 msgr2=0x7fa8c00ae530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.261+0000 7fa8c4d68700 1 -- 172.21.15.81:0/3532797694 shutdown_connections 2023-10-07T08:42:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.261+0000 7fa8c4d68700 1 -- 172.21.15.81:0/3532797694 wait complete. 2023-10-07T08:42:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-07T08:42:56.275 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T08:42:56.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.392+0000 7fb13a3b6700 1 Processor -- start 2023-10-07T08:42:56.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.392+0000 7fb13a3b6700 1 -- start start 2023-10-07T08:42:56.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.393+0000 7fb13a3b6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb13415a2a0 0x7fb1340b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:56.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.393+0000 7fb13a3b6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1340ceb30 0x7fb1340cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:56.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.393+0000 7fb13a3b6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1340cf4e0 con 0x7fb13406d650 2023-10-07T08:42:56.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.393+0000 7fb13a3b6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13406ea90 con 0x7fb1340ceb30 2023-10-07T08:42:56.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.393+0000 7fb13a3b6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1340b0ca0 con 0x7fb13415a2a0 2023-10-07T08:42:56.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.393+0000 7fb1337fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1340ceb30 0x7fb1340cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:56.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.393+0000 7fb138953700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb13406d650 0x7fb13406da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59578/0 (socket says 172.21.15.81:59578) 2023-10-07T08:42:56.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.393+0000 7fb138953700 1 -- 172.21.15.81:0/1042214769 learned_addr learned my addr 172.21.15.81:0/1042214769 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:42:56.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.393+0000 7fb133fff700 1 --2- 172.21.15.81:0/1042214769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb13415a2a0 0x7fb1340b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:56.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.394+0000 7fb1337fe700 1 -- 172.21.15.81:0/1042214769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb13415a2a0 msgr2=0x7fb1340b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:56.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.394+0000 7fb1337fe700 1 --2- 172.21.15.81:0/1042214769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb13415a2a0 0x7fb1340b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:56.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.394+0000 7fb1337fe700 1 -- 172.21.15.81:0/1042214769 >> v1:172.21.15.81:6789/0 conn(0x7fb13406d650 legacy=0x7fb13406da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:56.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.394+0000 7fb1337fe700 1 -- 172.21.15.81:0/1042214769 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1340b00d0 con 0x7fb1340ceb30 2023-10-07T08:42:56.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.394+0000 7fb132ffd700 1 -- 172.21.15.81:0/1042214769 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1351803577 0 0) 0x7fb1340cf4e0 con 0x7fb13406d650 2023-10-07T08:42:56.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.394+0000 7fb1337fe700 1 --2- 172.21.15.81:0/1042214769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1340ceb30 0x7fb1340cefa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb1280098e0 tx=0x7fb1280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb94124f7e639ab server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:56.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.394+0000 7fb132ffd700 1 -- 172.21.15.81:0/1042214769 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12800b640 con 0x7fb1340ceb30 2023-10-07T08:42:56.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.394+0000 7fb132ffd700 1 -- 172.21.15.81:0/1042214769 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12800b7a0 con 0x7fb1340ceb30 2023-10-07T08:42:56.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.394+0000 7fb132ffd700 1 -- 172.21.15.81:0/1042214769 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12800bb40 con 0x7fb1340ceb30 2023-10-07T08:42:56.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.394+0000 7fb13a3b6700 1 -- 172.21.15.81:0/1042214769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1340ceb30 msgr2=0x7fb1340cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:56.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.394+0000 7fb13a3b6700 1 --2- 172.21.15.81:0/1042214769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1340ceb30 0x7fb1340cefa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb1280098e0 tx=0x7fb1280091a0 comp rx=0 tx=0).stop 2023-10-07T08:42:56.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.394+0000 7fb13a3b6700 1 -- 172.21.15.81:0/1042214769 shutdown_connections 2023-10-07T08:42:56.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.394+0000 7fb13a3b6700 1 --2- 172.21.15.81:0/1042214769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb13415a2a0 0x7fb1340b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:56.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.394+0000 7fb13a3b6700 1 --2- 172.21.15.81:0/1042214769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1340ceb30 0x7fb1340cefa0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:56.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.394+0000 7fb13a3b6700 1 -- 172.21.15.81:0/1042214769 >> 172.21.15.81:0/1042214769 conn(0x7fb134067640 msgr2=0x7fb134067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:56.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.395+0000 7fb13a3b6700 1 -- 172.21.15.81:0/1042214769 shutdown_connections 2023-10-07T08:42:56.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.395+0000 7fb13a3b6700 1 -- 172.21.15.81:0/1042214769 wait complete. 2023-10-07T08:42:56.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.396+0000 7fb13a3b6700 1 Processor -- start 2023-10-07T08:42:56.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.396+0000 7fb13a3b6700 1 -- start start 2023-10-07T08:42:56.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.396+0000 7fb13a3b6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb13406d650 0x7fb134143100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:56.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.396+0000 7fb13a3b6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1340ceb30 0x7fb1340c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:56.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb13a3b6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb13415a2a0 0x7fb1340c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:56.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb13a3b6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1340ca100 con 0x7fb13406d650 2023-10-07T08:42:56.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb13a3b6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13415e4a0 con 0x7fb1340ceb30 2023-10-07T08:42:56.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb13a3b6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13415d890 con 0x7fb13415a2a0 2023-10-07T08:42:56.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb133fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb13406d650 0x7fb134143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:56.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb133fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb13406d650 0x7fb134143100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33618/0 (socket says 172.21.15.81:33618) 2023-10-07T08:42:56.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb133fff700 1 -- 172.21.15.81:0/1081897842 learned_addr learned my addr 172.21.15.81:0/1081897842 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:56.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb133fff700 1 -- 172.21.15.81:0/1081897842 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb13415a2a0 msgr2=0x7fb1340c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb133fff700 1 --2- 172.21.15.81:0/1081897842 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb13415a2a0 0x7fb1340c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb1337fe700 1 --2- 172.21.15.81:0/1081897842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1340ceb30 0x7fb1340c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb133fff700 1 -- 172.21.15.81:0/1081897842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1340ceb30 msgr2=0x7fb1340c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb133fff700 1 --2- 172.21.15.81:0/1081897842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1340ceb30 0x7fb1340c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb133fff700 1 -- 172.21.15.81:0/1081897842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb128009420 con 0x7fb13406d650 2023-10-07T08:42:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb133fff700 1 --2- 172.21.15.81:0/1081897842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb13406d650 0x7fb134143100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb12400e930 tx=0x7fb1240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb11bfff700 1 -- 172.21.15.81:0/1081897842 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12400eed0 con 0x7fb13406d650 2023-10-07T08:42:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb11bfff700 1 -- 172.21.15.81:0/1081897842 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12400c850 con 0x7fb13406d650 2023-10-07T08:42:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb13a3b6700 1 -- 172.21.15.81:0/1081897842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13415db70 con 0x7fb13406d650 2023-10-07T08:42:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb11bfff700 1 -- 172.21.15.81:0/1081897842 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12400cbf0 con 0x7fb13406d650 2023-10-07T08:42:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.397+0000 7fb13a3b6700 1 -- 172.21.15.81:0/1081897842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13415e130 con 0x7fb13406d650 2023-10-07T08:42:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.398+0000 7fb13a3b6700 1 -- 172.21.15.81:0/1081897842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb134069e40 con 0x7fb13406d650 2023-10-07T08:42:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.399+0000 7fb11bfff700 1 -- 172.21.15.81:0/1081897842 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb124013470 con 0x7fb13406d650 2023-10-07T08:42:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.399+0000 7fb11bfff700 1 --2- 172.21.15.81:0/1081897842 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb120066f30 0x7fb1200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.399+0000 7fb11bfff700 1 -- 172.21.15.81:0/1081897842 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fb124084700 con 0x7fb13406d650 2023-10-07T08:42:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.399+0000 7fb1337fe700 1 --2- 172.21.15.81:0/1081897842 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb120066f30 0x7fb1200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.399+0000 7fb1337fe700 1 --2- 172.21.15.81:0/1081897842 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb120066f30 0x7fb1200693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb1341561e0 tx=0x7fb128017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.403+0000 7fb11bfff700 1 -- 172.21.15.81:0/1081897842 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1240519d0 con 0x7fb13406d650 2023-10-07T08:42:56.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:56.631+0000 7fb13a3b6700 1 -- 172.21.15.81:0/1081897842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb13404bb80 con 0x7fb13406d650 2023-10-07T08:42:57.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:57.251+0000 7fb11bfff700 1 -- 172.21.15.81:0/1081897842 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb124054ff0 con 0x7fb13406d650 2023-10-07T08:42:58.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:57.261+0000 7fb13a3b6700 1 -- 172.21.15.81:0/1081897842 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb120066f30 msgr2=0x7fb1200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:57.261+0000 7fb13a3b6700 1 --2- 172.21.15.81:0/1081897842 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb120066f30 0x7fb1200693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb1341561e0 tx=0x7fb128017000 comp rx=0 tx=0).stop 2023-10-07T08:42:58.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:57.261+0000 7fb13a3b6700 1 -- 172.21.15.81:0/1081897842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb13406d650 msgr2=0x7fb134143100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:57.261+0000 7fb13a3b6700 1 --2- 172.21.15.81:0/1081897842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb13406d650 0x7fb134143100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb12400e930 tx=0x7fb1240091a0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:57.261+0000 7fb13a3b6700 1 -- 172.21.15.81:0/1081897842 shutdown_connections 2023-10-07T08:42:58.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:57.261+0000 7fb13a3b6700 1 --2- 172.21.15.81:0/1081897842 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb120066f30 0x7fb1200693e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:57.261+0000 7fb13a3b6700 1 --2- 172.21.15.81:0/1081897842 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb13415a2a0 0x7fb1340c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:57.261+0000 7fb13a3b6700 1 --2- 172.21.15.81:0/1081897842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb13406d650 0x7fb134143100 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:57.261+0000 7fb13a3b6700 1 --2- 172.21.15.81:0/1081897842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1340ceb30 0x7fb1340c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:57.261+0000 7fb13a3b6700 1 -- 172.21.15.81:0/1081897842 >> 172.21.15.81:0/1081897842 conn(0x7fb134067640 msgr2=0x7fb1340cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:58.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:57.261+0000 7fb13a3b6700 1 -- 172.21.15.81:0/1081897842 shutdown_connections 2023-10-07T08:42:58.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:57.261+0000 7fb13a3b6700 1 -- 172.21.15.81:0/1081897842 wait complete. 2023-10-07T08:42:58.130 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 2 and data pool 3 2023-10-07T08:42:58.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:42:58.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.252+0000 7fb550e2c700 1 Processor -- start 2023-10-07T08:42:58.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.252+0000 7fb550e2c700 1 -- start start 2023-10-07T08:42:58.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.253+0000 7fb550e2c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb54c159b60 0x7fb54c06eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.253+0000 7fb550e2c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb54c159f30 0x7fb54c0aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.253+0000 7fb550e2c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c06e810 con 0x7fb54c06f1e0 2023-10-07T08:42:58.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.253+0000 7fb550e2c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c06dc00 con 0x7fb54c159b60 2023-10-07T08:42:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.253+0000 7fb550e2c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c06dee0 con 0x7fb54c159f30 2023-10-07T08:42:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.253+0000 7fb54b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb54c159b60 0x7fb54c06eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.253+0000 7fb54b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb54c159b60 0x7fb54c06eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33628/0 (socket says 172.21.15.81:33628) 2023-10-07T08:42:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.253+0000 7fb54b7fe700 1 -- 172.21.15.81:0/2370145462 learned_addr learned my addr 172.21.15.81:0/2370145462 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.253+0000 7fb54bfff700 1 --2- 172.21.15.81:0/2370145462 >> v2:172.21.15.89:3300/0 conn(0x7fb54c159f30 0x7fb54c0aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.253+0000 7fb54b7fe700 1 -- 172.21.15.81:0/2370145462 >> v2:172.21.15.89:3300/0 conn(0x7fb54c159f30 msgr2=0x7fb54c0aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.253+0000 7fb54b7fe700 1 --2- 172.21.15.81:0/2370145462 >> v2:172.21.15.89:3300/0 conn(0x7fb54c159f30 0x7fb54c0aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.253+0000 7fb54b7fe700 1 -- 172.21.15.81:0/2370145462 >> v1:172.21.15.89:6789/0 conn(0x7fb54c06f1e0 legacy=0x7fb54c0ab460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.253+0000 7fb54b7fe700 1 -- 172.21.15.81:0/2370145462 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c06e1c0 con 0x7fb54c159b60 2023-10-07T08:42:58.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.254+0000 7fb54b7fe700 1 --2- 172.21.15.81:0/2370145462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54c159b60 0x7fb54c06eca0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb54c06d7d0 tx=0x7fb53c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7532a3ea4a8621bf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:58.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.254+0000 7fb54affd700 1 -- 172.21.15.81:0/2370145462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c005c10 con 0x7fb54c159b60 2023-10-07T08:42:58.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.254+0000 7fb54affd700 1 -- 172.21.15.81:0/2370145462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53c005d70 con 0x7fb54c159b60 2023-10-07T08:42:58.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.254+0000 7fb54affd700 1 -- 172.21.15.81:0/2370145462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c006280 con 0x7fb54c159b60 2023-10-07T08:42:58.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.254+0000 7fb550e2c700 1 -- 172.21.15.81:0/2370145462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54c159b60 msgr2=0x7fb54c06eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.254+0000 7fb550e2c700 1 --2- 172.21.15.81:0/2370145462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54c159b60 0x7fb54c06eca0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb54c06d7d0 tx=0x7fb53c009220 comp rx=0 tx=0).stop 2023-10-07T08:42:58.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.254+0000 7fb550e2c700 1 -- 172.21.15.81:0/2370145462 shutdown_connections 2023-10-07T08:42:58.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.254+0000 7fb550e2c700 1 --2- 172.21.15.81:0/2370145462 >> v2:172.21.15.89:3300/0 conn(0x7fb54c159f30 0x7fb54c0aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.254+0000 7fb550e2c700 1 --2- 172.21.15.81:0/2370145462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54c159b60 0x7fb54c06eca0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.254+0000 7fb550e2c700 1 -- 172.21.15.81:0/2370145462 >> 172.21.15.81:0/2370145462 conn(0x7fb54c0cdb70 msgr2=0x7fb54c06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:58.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.254+0000 7fb550e2c700 1 -- 172.21.15.81:0/2370145462 shutdown_connections 2023-10-07T08:42:58.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.254+0000 7fb550e2c700 1 -- 172.21.15.81:0/2370145462 wait complete. 2023-10-07T08:42:58.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.255+0000 7fb550e2c700 1 Processor -- start 2023-10-07T08:42:58.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.256+0000 7fb550e2c700 1 -- start start 2023-10-07T08:42:58.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.256+0000 7fb550e2c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54c06f1e0 0x7fb54c1454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.256+0000 7fb550e2c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb54c159b60 0x7fb54c0c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.256+0000 7fb550e2c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c159f30 0x7fb54c0c2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.256+0000 7fb550e2c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c147bb0 con 0x7fb54c06f1e0 2023-10-07T08:42:58.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.256+0000 7fb550e2c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c147e90 con 0x7fb54c159f30 2023-10-07T08:42:58.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.256+0000 7fb550e2c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c148170 con 0x7fb54c159b60 2023-10-07T08:42:58.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.256+0000 7fb54b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54c06f1e0 0x7fb54c1454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.256+0000 7fb54b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54c06f1e0 0x7fb54c1454c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33636/0 (socket says 172.21.15.81:33636) 2023-10-07T08:42:58.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.256+0000 7fb54b7fe700 1 -- 172.21.15.81:0/3427358521 learned_addr learned my addr 172.21.15.81:0/3427358521 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:58.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.256+0000 7fb54bfff700 1 --2- 172.21.15.81:0/3427358521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c159f30 0x7fb54c0c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.256+0000 7fb543fff700 1 --2- 172.21.15.81:0/3427358521 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb54c159b60 0x7fb54c0c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.257+0000 7fb54b7fe700 1 -- 172.21.15.81:0/3427358521 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb54c159b60 msgr2=0x7fb54c0c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.257+0000 7fb54b7fe700 1 --2- 172.21.15.81:0/3427358521 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb54c159b60 0x7fb54c0c1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.257+0000 7fb54b7fe700 1 -- 172.21.15.81:0/3427358521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c159f30 msgr2=0x7fb54c0c2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.257+0000 7fb54b7fe700 1 --2- 172.21.15.81:0/3427358521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c159f30 0x7fb54c0c2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.257+0000 7fb54b7fe700 1 -- 172.21.15.81:0/3427358521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c009480 con 0x7fb54c06f1e0 2023-10-07T08:42:58.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.257+0000 7fb54b7fe700 1 --2- 172.21.15.81:0/3427358521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54c06f1e0 0x7fb54c1454c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb54c068910 tx=0x7fb53c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:58.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.259+0000 7fb5437fe700 1 -- 172.21.15.81:0/3427358521 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c006240 con 0x7fb54c06f1e0 2023-10-07T08:42:58.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.259+0000 7fb5437fe700 1 -- 172.21.15.81:0/3427358521 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53c00b4a0 con 0x7fb54c06f1e0 2023-10-07T08:42:58.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.259+0000 7fb550e2c700 1 -- 172.21.15.81:0/3427358521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c148450 con 0x7fb54c06f1e0 2023-10-07T08:42:58.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.259+0000 7fb5437fe700 1 -- 172.21.15.81:0/3427358521 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c00b840 con 0x7fb54c06f1e0 2023-10-07T08:42:58.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.259+0000 7fb550e2c700 1 -- 172.21.15.81:0/3427358521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c148c50 con 0x7fb54c06f1e0 2023-10-07T08:42:58.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.260+0000 7fb550e2c700 1 -- 172.21.15.81:0/3427358521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c067fd0 con 0x7fb54c06f1e0 2023-10-07T08:42:58.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.260+0000 7fb5437fe700 1 -- 172.21.15.81:0/3427358521 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb53c00bc70 con 0x7fb54c06f1e0 2023-10-07T08:42:58.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.260+0000 7fb5437fe700 1 --2- 172.21.15.81:0/3427358521 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb52c066f30 0x7fb52c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.260+0000 7fb5437fe700 1 -- 172.21.15.81:0/3427358521 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb53c0857b0 con 0x7fb54c06f1e0 2023-10-07T08:42:58.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.260+0000 7fb543fff700 1 --2- 172.21.15.81:0/3427358521 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb52c066f30 0x7fb52c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.261+0000 7fb543fff700 1 --2- 172.21.15.81:0/3427358521 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb52c066f30 0x7fb52c0693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb54c15ac00 tx=0x7fb534007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:58.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.266+0000 7fb5437fe700 1 -- 172.21.15.81:0/3427358521 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb53c052ad0 con 0x7fb54c06f1e0 2023-10-07T08:42:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.448+0000 7fb550e2c700 1 -- 172.21.15.81:0/3427358521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb54c06e4a0 con 0x7fb54c06f1e0 2023-10-07T08:42:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.449+0000 7fb5437fe700 1 -- 172.21.15.81:0/3427358521 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fb53c029090 con 0x7fb54c06f1e0 2023-10-07T08:42:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:58.451 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:58.248338+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:42:54.397263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:42:55.595133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:42:58.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.451+0000 7fb550e2c700 1 -- 172.21.15.81:0/3427358521 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb52c066f30 msgr2=0x7fb52c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.451+0000 7fb550e2c700 1 --2- 172.21.15.81:0/3427358521 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb52c066f30 0x7fb52c0693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb54c15ac00 tx=0x7fb534007ec0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.451+0000 7fb550e2c700 1 -- 172.21.15.81:0/3427358521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54c06f1e0 msgr2=0x7fb54c1454c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.451+0000 7fb550e2c700 1 --2- 172.21.15.81:0/3427358521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54c06f1e0 0x7fb54c1454c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb54c068910 tx=0x7fb53c016000 comp rx=0 tx=0).stop 2023-10-07T08:42:58.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.451+0000 7fb550e2c700 1 -- 172.21.15.81:0/3427358521 shutdown_connections 2023-10-07T08:42:58.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.451+0000 7fb550e2c700 1 --2- 172.21.15.81:0/3427358521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c159f30 0x7fb54c0c2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.451+0000 7fb550e2c700 1 --2- 172.21.15.81:0/3427358521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54c06f1e0 0x7fb54c1454c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.451+0000 7fb550e2c700 1 --2- 172.21.15.81:0/3427358521 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb52c066f30 0x7fb52c0693e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.451+0000 7fb550e2c700 1 --2- 172.21.15.81:0/3427358521 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb54c159b60 0x7fb54c0c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.451+0000 7fb550e2c700 1 -- 172.21.15.81:0/3427358521 >> 172.21.15.81:0/3427358521 conn(0x7fb54c0cdb70 msgr2=0x7fb54c15b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:58.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.451+0000 7fb550e2c700 1 -- 172.21.15.81:0/3427358521 shutdown_connections 2023-10-07T08:42:58.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.451+0000 7fb550e2c700 1 -- 172.21.15.81:0/3427358521 wait complete. 2023-10-07T08:42:58.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:42:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.577+0000 7f8101839700 1 Processor -- start 2023-10-07T08:42:58.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.577+0000 7f8101839700 1 -- start start 2023-10-07T08:42:58.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.578+0000 7f8101839700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f80fc0cae00 0x7f80fc0aa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.578+0000 7f8101839700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f80fc0cb2a0 0x7f80fc0aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.578+0000 7f8101839700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80fc06d350 con 0x7f80fc15daa0 2023-10-07T08:42:58.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.578+0000 7f8101839700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80fc0c9ac0 con 0x7f80fc0cae00 2023-10-07T08:42:58.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.578+0000 7f8101839700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80fc06c740 con 0x7f80fc0cb2a0 2023-10-07T08:42:58.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.578+0000 7f80fa7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f80fc0cae00 0x7f80fc0aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.578+0000 7f80faffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f80fc15daa0 0x7f80fc15de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59580/0 (socket says 172.21.15.81:59580) 2023-10-07T08:42:58.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.578+0000 7f80faffd700 1 -- 172.21.15.81:0/3893328121 learned_addr learned my addr 172.21.15.81:0/3893328121 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:42:58.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.578+0000 7f80fb7fe700 1 --2- 172.21.15.81:0/3893328121 >> v2:172.21.15.89:3300/0 conn(0x7f80fc0cb2a0 0x7f80fc0aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.578+0000 7f80f9ffb700 1 -- 172.21.15.81:0/3893328121 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975249899 0 0) 0x7f80fc06d350 con 0x7f80fc15daa0 2023-10-07T08:42:58.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.579+0000 7f80f9ffb700 1 -- 172.21.15.81:0/3893328121 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80e4003570 con 0x7f80fc15daa0 2023-10-07T08:42:58.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.579+0000 7f80fa7fc700 1 -- 172.21.15.81:0/3893328121 >> v2:172.21.15.89:3300/0 conn(0x7f80fc0cb2a0 msgr2=0x7f80fc0aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:58.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.579+0000 7f80fa7fc700 1 --2- 172.21.15.81:0/3893328121 >> v2:172.21.15.89:3300/0 conn(0x7f80fc0cb2a0 0x7f80fc0aadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.579+0000 7f80fa7fc700 1 -- 172.21.15.81:0/3893328121 >> v1:172.21.15.81:6789/0 conn(0x7f80fc15daa0 legacy=0x7f80fc15de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.579+0000 7f80fa7fc700 1 -- 172.21.15.81:0/3893328121 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc06ca20 con 0x7f80fc0cae00 2023-10-07T08:42:58.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.579+0000 7f80fa7fc700 1 --2- 172.21.15.81:0/3893328121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80fc0cae00 0x7f80fc0aa890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f80fc06d980 tx=0x7f80f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556020685e6035e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:58.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.579+0000 7f80f9ffb700 1 -- 172.21.15.81:0/3893328121 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0011630 con 0x7f80fc0cae00 2023-10-07T08:42:58.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.579+0000 7f80f9ffb700 1 -- 172.21.15.81:0/3893328121 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f00117b0 con 0x7f80fc0cae00 2023-10-07T08:42:58.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.579+0000 7f80f9ffb700 1 -- 172.21.15.81:0/3893328121 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0011b70 con 0x7f80fc0cae00 2023-10-07T08:42:58.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.579+0000 7f8101839700 1 -- 172.21.15.81:0/3893328121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80fc0cae00 msgr2=0x7f80fc0aa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.579+0000 7f8101839700 1 --2- 172.21.15.81:0/3893328121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80fc0cae00 0x7f80fc0aa890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f80fc06d980 tx=0x7f80f00091a0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.579+0000 7f8101839700 1 -- 172.21.15.81:0/3893328121 shutdown_connections 2023-10-07T08:42:58.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.579+0000 7f8101839700 1 --2- 172.21.15.81:0/3893328121 >> v2:172.21.15.89:3300/0 conn(0x7f80fc0cb2a0 0x7f80fc0aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.579+0000 7f8101839700 1 --2- 172.21.15.81:0/3893328121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80fc0cae00 0x7f80fc0aa890 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.579+0000 7f8101839700 1 -- 172.21.15.81:0/3893328121 >> 172.21.15.81:0/3893328121 conn(0x7f80fc0c9ca0 msgr2=0x7f80fc0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:58.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.579+0000 7f8101839700 1 -- 172.21.15.81:0/3893328121 shutdown_connections 2023-10-07T08:42:58.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.580+0000 7f8101839700 1 -- 172.21.15.81:0/3893328121 wait complete. 2023-10-07T08:42:58.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.581+0000 7f8101839700 1 Processor -- start 2023-10-07T08:42:58.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.581+0000 7f8101839700 1 -- start start 2023-10-07T08:42:58.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.581+0000 7f8101839700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80fc0cae00 0x7f80fc0ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.581+0000 7f8101839700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80fc0cb2a0 0x7f80fc16d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.581+0000 7f8101839700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80fc15daa0 0x7f80fc16ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.581+0000 7f8101839700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc15a920 con 0x7f80fc0cae00 2023-10-07T08:42:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.581+0000 7f8101839700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc16a470 con 0x7f80fc15daa0 2023-10-07T08:42:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.581+0000 7f8101839700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc16e260 con 0x7f80fc0cb2a0 2023-10-07T08:42:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f80faffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80fc0cae00 0x7f80fc0ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f80faffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80fc0cae00 0x7f80fc0ac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33660/0 (socket says 172.21.15.81:33660) 2023-10-07T08:42:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f80faffd700 1 -- 172.21.15.81:0/4225238005 learned_addr learned my addr 172.21.15.81:0/4225238005 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f80fb7fe700 1 --2- 172.21.15.81:0/4225238005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80fc15daa0 0x7f80fc16ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f80faffd700 1 -- 172.21.15.81:0/4225238005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80fc0cb2a0 msgr2=0x7f80fc16d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f80fa7fc700 1 --2- 172.21.15.81:0/4225238005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80fc0cb2a0 0x7f80fc16d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f80faffd700 1 --2- 172.21.15.81:0/4225238005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80fc0cb2a0 0x7f80fc16d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f80faffd700 1 -- 172.21.15.81:0/4225238005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80fc15daa0 msgr2=0x7f80fc16ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f80faffd700 1 --2- 172.21.15.81:0/4225238005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80fc15daa0 0x7f80fc16ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f80faffd700 1 -- 172.21.15.81:0/4225238005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f0009420 con 0x7f80fc0cae00 2023-10-07T08:42:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f80fb7fe700 1 --2- 172.21.15.81:0/4225238005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80fc15daa0 0x7f80fc16ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:42:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f80faffd700 1 --2- 172.21.15.81:0/4225238005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80fc0cae00 0x7f80fc0ac640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00cc40 tx=0x7f80ec001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f80e2ffd700 1 -- 172.21.15.81:0/4225238005 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec00a9c0 con 0x7f80fc0cae00 2023-10-07T08:42:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f80e2ffd700 1 -- 172.21.15.81:0/4225238005 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec00ab40 con 0x7f80fc0cae00 2023-10-07T08:42:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f8101839700 1 -- 172.21.15.81:0/4225238005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80fc16e540 con 0x7f80fc0cae00 2023-10-07T08:42:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f80e2ffd700 1 -- 172.21.15.81:0/4225238005 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0070f0 con 0x7f80fc0cae00 2023-10-07T08:42:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.582+0000 7f8101839700 1 -- 172.21.15.81:0/4225238005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80fc16e820 con 0x7f80fc0cae00 2023-10-07T08:42:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.583+0000 7f8101839700 1 -- 172.21.15.81:0/4225238005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80fc068080 con 0x7f80fc0cae00 2023-10-07T08:42:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.584+0000 7f80e2ffd700 1 -- 172.21.15.81:0/4225238005 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80ec007520 con 0x7f80fc0cae00 2023-10-07T08:42:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.584+0000 7f80e2ffd700 1 --2- 172.21.15.81:0/4225238005 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80e8066f30 0x7f80e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.584+0000 7f80e2ffd700 1 -- 172.21.15.81:0/4225238005 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f80ec0849b0 con 0x7f80fc0cae00 2023-10-07T08:42:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.584+0000 7f80fa7fc700 1 --2- 172.21.15.81:0/4225238005 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80e8066f30 0x7f80e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.584+0000 7f80fa7fc700 1 --2- 172.21.15.81:0/4225238005 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80e8066f30 0x7f80e80693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f80fc06d980 tx=0x7f80f0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.588+0000 7f80e2ffd700 1 -- 172.21.15.81:0/4225238005 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80ec051ca0 con 0x7f80fc0cae00 2023-10-07T08:42:58.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.768+0000 7f8101839700 1 -- 172.21.15.81:0/4225238005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80fc0c3e30 con 0x7f80fc0cae00 2023-10-07T08:42:58.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.769+0000 7f80e2ffd700 1 -- 172.21.15.81:0/4225238005 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f80ec0552c0 con 0x7f80fc0cae00 2023-10-07T08:42:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:42:58.771 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:58.248338+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:42:54.397263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:42:55.595133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:42:58.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.771+0000 7f8101839700 1 -- 172.21.15.81:0/4225238005 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80e8066f30 msgr2=0x7f80e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.771+0000 7f8101839700 1 --2- 172.21.15.81:0/4225238005 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80e8066f30 0x7f80e80693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f80fc06d980 tx=0x7f80f0017000 comp rx=0 tx=0).stop 2023-10-07T08:42:58.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.771+0000 7f8101839700 1 -- 172.21.15.81:0/4225238005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80fc0cae00 msgr2=0x7f80fc0ac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.771+0000 7f8101839700 1 --2- 172.21.15.81:0/4225238005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80fc0cae00 0x7f80fc0ac640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00cc40 tx=0x7f80ec001a70 comp rx=0 tx=0).stop 2023-10-07T08:42:58.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.771+0000 7f8101839700 1 -- 172.21.15.81:0/4225238005 shutdown_connections 2023-10-07T08:42:58.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.771+0000 7f8101839700 1 --2- 172.21.15.81:0/4225238005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80fc15daa0 0x7f80fc16ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.771+0000 7f8101839700 1 --2- 172.21.15.81:0/4225238005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80fc0cae00 0x7f80fc0ac640 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.771+0000 7f8101839700 1 --2- 172.21.15.81:0/4225238005 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80e8066f30 0x7f80e80693e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.771+0000 7f8101839700 1 --2- 172.21.15.81:0/4225238005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80fc0cb2a0 0x7f80fc16d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.771+0000 7f8101839700 1 -- 172.21.15.81:0/4225238005 >> 172.21.15.81:0/4225238005 conn(0x7f80fc0c9ca0 msgr2=0x7f80fc15ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:58.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.771+0000 7f8101839700 1 -- 172.21.15.81:0/4225238005 shutdown_connections 2023-10-07T08:42:58.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.771+0000 7f8101839700 1 -- 172.21.15.81:0/4225238005 wait complete. 2023-10-07T08:42:58.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T08:42:58.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.900+0000 7f9f61410700 1 Processor -- start 2023-10-07T08:42:58.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.900+0000 7f9f61410700 1 -- start start 2023-10-07T08:42:58.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.901+0000 7f9f61410700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f5c0d0b80 0x7f9f5c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.901+0000 7f9f61410700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9f5c0d02b0 0x7f9f5c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.901+0000 7f9f61410700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5c0cf2d0 con 0x7f9f5c0d0f50 2023-10-07T08:42:58.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.901+0000 7f9f61410700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5c15a690 con 0x7f9f5c0d0b80 2023-10-07T08:42:58.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.901+0000 7f9f61410700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5c06dc00 con 0x7f9f5c0d02b0 2023-10-07T08:42:58.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.901+0000 7f9f5bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f5c0d0b80 0x7f9f5c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.901+0000 7f9f5bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f5c0d0b80 0x7f9f5c0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33662/0 (socket says 172.21.15.81:33662) 2023-10-07T08:42:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.901+0000 7f9f5bfff700 1 -- 172.21.15.81:0/37377065 learned_addr learned my addr 172.21.15.81:0/37377065 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.901+0000 7f9f5b7fe700 1 --2- 172.21.15.81:0/37377065 >> v2:172.21.15.89:3300/0 conn(0x7f9f5c0d02b0 0x7f9f5c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.901+0000 7f9f5bfff700 1 -- 172.21.15.81:0/37377065 >> v2:172.21.15.89:3300/0 conn(0x7f9f5c0d02b0 msgr2=0x7f9f5c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:42:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.901+0000 7f9f5bfff700 1 --2- 172.21.15.81:0/37377065 >> v2:172.21.15.89:3300/0 conn(0x7f9f5c0d02b0 0x7f9f5c06cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.901+0000 7f9f5bfff700 1 -- 172.21.15.81:0/37377065 >> v1:172.21.15.89:6789/0 conn(0x7f9f5c0d0f50 legacy=0x7f9f5c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.901+0000 7f9f5bfff700 1 -- 172.21.15.81:0/37377065 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c0cf570 con 0x7f9f5c0d0b80 2023-10-07T08:42:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.901+0000 7f9f5bfff700 1 --2- 172.21.15.81:0/37377065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0d0b80 0x7f9f5c0cfd70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0ce9b0 tx=0x7f9f4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556517d46a6bff1e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.902+0000 7f9f5affd700 1 -- 172.21.15.81:0/37377065 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c009e70 con 0x7f9f5c0d0b80 2023-10-07T08:42:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.902+0000 7f9f5affd700 1 -- 172.21.15.81:0/37377065 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c00b860 con 0x7f9f5c0d0b80 2023-10-07T08:42:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.902+0000 7f9f5affd700 1 -- 172.21.15.81:0/37377065 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c00bc00 con 0x7f9f5c0d0b80 2023-10-07T08:42:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.902+0000 7f9f61410700 1 -- 172.21.15.81:0/37377065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0d0b80 msgr2=0x7f9f5c0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.902+0000 7f9f61410700 1 --2- 172.21.15.81:0/37377065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0d0b80 0x7f9f5c0cfd70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0ce9b0 tx=0x7f9f4c009250 comp rx=0 tx=0).stop 2023-10-07T08:42:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.902+0000 7f9f61410700 1 -- 172.21.15.81:0/37377065 shutdown_connections 2023-10-07T08:42:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.902+0000 7f9f61410700 1 --2- 172.21.15.81:0/37377065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0d0b80 0x7f9f5c0cfd70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.902+0000 7f9f61410700 1 --2- 172.21.15.81:0/37377065 >> v2:172.21.15.89:3300/0 conn(0x7f9f5c0d02b0 0x7f9f5c06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.902+0000 7f9f61410700 1 -- 172.21.15.81:0/37377065 >> 172.21.15.81:0/37377065 conn(0x7f9f5c063230 msgr2=0x7f9f5c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.902+0000 7f9f61410700 1 -- 172.21.15.81:0/37377065 shutdown_connections 2023-10-07T08:42:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.902+0000 7f9f61410700 1 -- 172.21.15.81:0/37377065 wait complete. 2023-10-07T08:42:58.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.903+0000 7f9f61410700 1 Processor -- start 2023-10-07T08:42:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.903+0000 7f9f61410700 1 -- start start 2023-10-07T08:42:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.904+0000 7f9f61410700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0d02b0 0x7f9f5c16b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.904+0000 7f9f61410700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f5c0d0b80 0x7f9f5c0cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.904+0000 7f9f61410700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f5c0d0f50 0x7f9f5c0cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.904+0000 7f9f61410700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c16b610 con 0x7f9f5c0d02b0 2023-10-07T08:42:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.904+0000 7f9f61410700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0c98a0 con 0x7f9f5c0d0f50 2023-10-07T08:42:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.904+0000 7f9f61410700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0ca3e0 con 0x7f9f5c0d0b80 2023-10-07T08:42:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.904+0000 7f9f5bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0d02b0 0x7f9f5c16b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.904+0000 7f9f5bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0d02b0 0x7f9f5c16b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33668/0 (socket says 172.21.15.81:33668) 2023-10-07T08:42:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.904+0000 7f9f5bfff700 1 -- 172.21.15.81:0/3716905627 learned_addr learned my addr 172.21.15.81:0/3716905627 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.904+0000 7f9f5b7fe700 1 --2- 172.21.15.81:0/3716905627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f5c0d0b80 0x7f9f5c0cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.904+0000 7f9f60c0f700 1 --2- 172.21.15.81:0/3716905627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f5c0d0f50 0x7f9f5c0cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.904+0000 7f9f5bfff700 1 -- 172.21.15.81:0/3716905627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f5c0d0b80 msgr2=0x7f9f5c0cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.904+0000 7f9f5bfff700 1 --2- 172.21.15.81:0/3716905627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f5c0d0b80 0x7f9f5c0cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.904+0000 7f9f5bfff700 1 -- 172.21.15.81:0/3716905627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f5c0d0f50 msgr2=0x7f9f5c0cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.904+0000 7f9f5bfff700 1 --2- 172.21.15.81:0/3716905627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f5c0d0f50 0x7f9f5c0cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.904+0000 7f9f5bfff700 1 -- 172.21.15.81:0/3716905627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c0094f0 con 0x7f9f5c0d02b0 2023-10-07T08:42:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.905+0000 7f9f5bfff700 1 --2- 172.21.15.81:0/3716905627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0d02b0 0x7f9f5c16b0d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c06fcc0 tx=0x7f9f4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.905+0000 7f9f43fff700 1 -- 172.21.15.81:0/3716905627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c011420 con 0x7f9f5c0d02b0 2023-10-07T08:42:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.905+0000 7f9f43fff700 1 -- 172.21.15.81:0/3716905627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c0115a0 con 0x7f9f5c0d02b0 2023-10-07T08:42:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.905+0000 7f9f61410700 1 -- 172.21.15.81:0/3716905627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5c0ca6c0 con 0x7f9f5c0d02b0 2023-10-07T08:42:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.905+0000 7f9f43fff700 1 -- 172.21.15.81:0/3716905627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c011960 con 0x7f9f5c0d02b0 2023-10-07T08:42:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.905+0000 7f9f61410700 1 -- 172.21.15.81:0/3716905627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5c0cac80 con 0x7f9f5c0d02b0 2023-10-07T08:42:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.906+0000 7f9f61410700 1 -- 172.21.15.81:0/3716905627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5c0676e0 con 0x7f9f5c0d02b0 2023-10-07T08:42:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.906+0000 7f9f43fff700 1 -- 172.21.15.81:0/3716905627 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f4c0253f0 con 0x7f9f5c0d02b0 2023-10-07T08:42:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.907+0000 7f9f43fff700 1 --2- 172.21.15.81:0/3716905627 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f48066f30 0x7f9f480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.907+0000 7f9f5b7fe700 1 --2- 172.21.15.81:0/3716905627 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f48066f30 0x7f9f480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.907+0000 7f9f43fff700 1 -- 172.21.15.81:0/3716905627 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9f4c085f10 con 0x7f9f5c0d02b0 2023-10-07T08:42:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.907+0000 7f9f5b7fe700 1 --2- 172.21.15.81:0/3716905627 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f48066f30 0x7f9f480693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0aa9d0 tx=0x7f9f50008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:58.911+0000 7f9f43fff700 1 -- 172.21.15.81:0/3716905627 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f4c053200 con 0x7f9f5c0d02b0 2023-10-07T08:42:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.135+0000 7f9f61410700 1 -- 172.21.15.81:0/3716905627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9f5c0cf850 con 0x7f9f5c0d02b0 2023-10-07T08:42:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.265+0000 7f9f43fff700 1 -- 172.21.15.81:0/3716905627 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9f4c0150b0 con 0x7f9f5c0d02b0 2023-10-07T08:42:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.267+0000 7f9f61410700 1 -- 172.21.15.81:0/3716905627 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f48066f30 msgr2=0x7f9f480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.267+0000 7f9f61410700 1 --2- 172.21.15.81:0/3716905627 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f48066f30 0x7f9f480693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0aa9d0 tx=0x7f9f50008040 comp rx=0 tx=0).stop 2023-10-07T08:42:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.267+0000 7f9f61410700 1 -- 172.21.15.81:0/3716905627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0d02b0 msgr2=0x7f9f5c16b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.267+0000 7f9f61410700 1 --2- 172.21.15.81:0/3716905627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0d02b0 0x7f9f5c16b0d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c06fcc0 tx=0x7f9f4c017000 comp rx=0 tx=0).stop 2023-10-07T08:42:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.267+0000 7f9f61410700 1 -- 172.21.15.81:0/3716905627 shutdown_connections 2023-10-07T08:42:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.267+0000 7f9f61410700 1 --2- 172.21.15.81:0/3716905627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f5c0d0f50 0x7f9f5c0cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.267+0000 7f9f61410700 1 --2- 172.21.15.81:0/3716905627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f5c0d02b0 0x7f9f5c16b0d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.267+0000 7f9f61410700 1 --2- 172.21.15.81:0/3716905627 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f48066f30 0x7f9f480693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.267+0000 7f9f61410700 1 --2- 172.21.15.81:0/3716905627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f5c0d0b80 0x7f9f5c0cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.268+0000 7f9f61410700 1 -- 172.21.15.81:0/3716905627 >> 172.21.15.81:0/3716905627 conn(0x7f9f5c063230 msgr2=0x7f9f5c0b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.268+0000 7f9f61410700 1 -- 172.21.15.81:0/3716905627 shutdown_connections 2023-10-07T08:42:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.268+0000 7f9f61410700 1 -- 172.21.15.81:0/3716905627 wait complete. 2023-10-07T08:42:59.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T08:42:59.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.397+0000 7f79bc4ab700 1 Processor -- start 2023-10-07T08:42:59.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.397+0000 7f79bc4ab700 1 -- start start 2023-10-07T08:42:59.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.398+0000 7f79bc4ab700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79b406d830 0x7f79b40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:59.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.398+0000 7f79bc4ab700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b40d07c0 con 0x7f79b41578d0 2023-10-07T08:42:59.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.398+0000 7f79bc4ab700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b40cfbb0 con 0x7f79b4157ca0 2023-10-07T08:42:59.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.398+0000 7f79bc4ab700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b40cfe90 con 0x7f79b406d830 2023-10-07T08:42:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.398+0000 7f79baa48700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79b406d830 0x7f79b40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.398+0000 7f79ba247700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f79b41578d0 0x7f79b415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59584/0 (socket says 172.21.15.81:59584) 2023-10-07T08:42:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.398+0000 7f79ba247700 1 -- 172.21.15.81:0/1272795779 learned_addr learned my addr 172.21.15.81:0/1272795779 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:42:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.398+0000 7f79baa48700 1 -- 172.21.15.81:0/1272795779 >> v1:172.21.15.89:6789/0 conn(0x7f79b4157ca0 legacy=0x7f79b406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.398+0000 7f79baa48700 1 -- 172.21.15.81:0/1272795779 >> v1:172.21.15.81:6789/0 conn(0x7f79b41578d0 legacy=0x7f79b415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.398+0000 7f79baa48700 1 -- 172.21.15.81:0/1272795779 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b40d0170 con 0x7f79b406d830 2023-10-07T08:42:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.398+0000 7f79baa48700 1 --2- 172.21.15.81:0/1272795779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b406d830 0x7f79b40cf4f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0098e0 tx=0x7f79ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5ab833aa7d4eb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.398+0000 7f79b9245700 1 -- 172.21.15.81:0/1272795779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac009e80 con 0x7f79b406d830 2023-10-07T08:42:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.398+0000 7f79b9245700 1 -- 172.21.15.81:0/1272795779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac00b860 con 0x7f79b406d830 2023-10-07T08:42:59.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.398+0000 7f79b9245700 1 -- 172.21.15.81:0/1272795779 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac00bbe0 con 0x7f79b406d830 2023-10-07T08:42:59.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.399+0000 7f79bc4ab700 1 -- 172.21.15.81:0/1272795779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b406d830 msgr2=0x7f79b40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:59.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.399+0000 7f79bc4ab700 1 --2- 172.21.15.81:0/1272795779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b406d830 0x7f79b40cf4f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0098e0 tx=0x7f79ac0091a0 comp rx=0 tx=0).stop 2023-10-07T08:42:59.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.399+0000 7f79bc4ab700 1 -- 172.21.15.81:0/1272795779 shutdown_connections 2023-10-07T08:42:59.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.399+0000 7f79bc4ab700 1 --2- 172.21.15.81:0/1272795779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b406d830 0x7f79b40cf4f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:59.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.399+0000 7f79bc4ab700 1 -- 172.21.15.81:0/1272795779 >> 172.21.15.81:0/1272795779 conn(0x7f79b406bb90 msgr2=0x7f79b406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:42:59.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.399+0000 7f79bc4ab700 1 -- 172.21.15.81:0/1272795779 shutdown_connections 2023-10-07T08:42:59.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.399+0000 7f79bc4ab700 1 -- 172.21.15.81:0/1272795779 wait complete. 2023-10-07T08:42:59.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.400+0000 7f79bc4ab700 1 Processor -- start 2023-10-07T08:42:59.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.400+0000 7f79bc4ab700 1 -- start start 2023-10-07T08:42:59.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79bc4ab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79b406d830 0x7f79b40b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:59.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79bc4ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b41578d0 0x7f79b4154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:59.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79bc4ab700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79b4157ca0 0x7f79b40adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:59.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79bc4ab700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40af050 con 0x7f79b41578d0 2023-10-07T08:42:59.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79bc4ab700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b416a870 con 0x7f79b4157ca0 2023-10-07T08:42:59.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79bc4ab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40ac080 con 0x7f79b406d830 2023-10-07T08:42:59.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79b9a46700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b41578d0 0x7f79b4154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:59.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79b9a46700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b41578d0 0x7f79b4154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33692/0 (socket says 172.21.15.81:33692) 2023-10-07T08:42:59.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79b9a46700 1 -- 172.21.15.81:0/838669788 learned_addr learned my addr 172.21.15.81:0/838669788 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:42:59.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79baa48700 1 --2- 172.21.15.81:0/838669788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79b4157ca0 0x7f79b40adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:59.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79ba247700 1 --2- 172.21.15.81:0/838669788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79b406d830 0x7f79b40b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:59.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79b9a46700 1 -- 172.21.15.81:0/838669788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79b406d830 msgr2=0x7f79b40b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:59.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79b9a46700 1 --2- 172.21.15.81:0/838669788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79b406d830 0x7f79b40b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79b9a46700 1 -- 172.21.15.81:0/838669788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79b4157ca0 msgr2=0x7f79b40adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:42:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79b9a46700 1 --2- 172.21.15.81:0/838669788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79b4157ca0 0x7f79b40adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:42:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79b9a46700 1 -- 172.21.15.81:0/838669788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac009420 con 0x7f79b41578d0 2023-10-07T08:42:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79ba247700 1 --2- 172.21.15.81:0/838669788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79b406d830 0x7f79b40b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:42:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79baa48700 1 --2- 172.21.15.81:0/838669788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79b4157ca0 0x7f79b40adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:42:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79b9a46700 1 --2- 172.21.15.81:0/838669788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b41578d0 0x7f79b4154850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f79a400c590 tx=0x7f79a4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79aa7fc700 1 -- 172.21.15.81:0/838669788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4011590 con 0x7f79b41578d0 2023-10-07T08:42:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79aa7fc700 1 -- 172.21.15.81:0/838669788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a4011710 con 0x7f79b41578d0 2023-10-07T08:42:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79bc4ab700 1 -- 172.21.15.81:0/838669788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b40aea90 con 0x7f79b41578d0 2023-10-07T08:42:59.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79aa7fc700 1 -- 172.21.15.81:0/838669788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4011ad0 con 0x7f79b41578d0 2023-10-07T08:42:59.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.401+0000 7f79bc4ab700 1 -- 172.21.15.81:0/838669788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b40abd10 con 0x7f79b41578d0 2023-10-07T08:42:59.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.402+0000 7f79bc4ab700 1 -- 172.21.15.81:0/838669788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b40ac1f0 con 0x7f79b41578d0 2023-10-07T08:42:59.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.403+0000 7f79aa7fc700 1 -- 172.21.15.81:0/838669788 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79a401b3b0 con 0x7f79b41578d0 2023-10-07T08:42:59.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.403+0000 7f79aa7fc700 1 --2- 172.21.15.81:0/838669788 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7998066f30 0x7f79980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:42:59.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.403+0000 7f79aa7fc700 1 -- 172.21.15.81:0/838669788 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f79a40839d0 con 0x7f79b41578d0 2023-10-07T08:42:59.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.403+0000 7f79ba247700 1 --2- 172.21.15.81:0/838669788 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7998066f30 0x7f79980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:42:59.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.403+0000 7f79ba247700 1 --2- 172.21.15.81:0/838669788 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7998066f30 0x7f79980693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f79b0002230 tx=0x7f79b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:42:59.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.407+0000 7f79aa7fc700 1 -- 172.21.15.81:0/838669788 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79a4050c40 con 0x7f79b41578d0 2023-10-07T08:42:59.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:42:59.636+0000 7f79bc4ab700 1 -- 172.21.15.81:0/838669788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f79b40d0450 con 0x7f79b41578d0 2023-10-07T08:43:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.271+0000 7f79aa7fc700 1 -- 172.21.15.81:0/838669788 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f79a4017070 con 0x7f79b41578d0 2023-10-07T08:43:00.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.273+0000 7f79bc4ab700 1 -- 172.21.15.81:0/838669788 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7998066f30 msgr2=0x7f79980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.273+0000 7f79bc4ab700 1 --2- 172.21.15.81:0/838669788 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7998066f30 0x7f79980693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f79b0002230 tx=0x7f79b0009040 comp rx=0 tx=0).stop 2023-10-07T08:43:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.273+0000 7f79bc4ab700 1 -- 172.21.15.81:0/838669788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b41578d0 msgr2=0x7f79b4154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.273+0000 7f79bc4ab700 1 --2- 172.21.15.81:0/838669788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b41578d0 0x7f79b4154850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f79a400c590 tx=0x7f79a4007f50 comp rx=0 tx=0).stop 2023-10-07T08:43:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.273+0000 7f79bc4ab700 1 -- 172.21.15.81:0/838669788 shutdown_connections 2023-10-07T08:43:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.273+0000 7f79bc4ab700 1 --2- 172.21.15.81:0/838669788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79b4157ca0 0x7f79b40adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.273+0000 7f79bc4ab700 1 --2- 172.21.15.81:0/838669788 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7998066f30 0x7f79980693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.273+0000 7f79bc4ab700 1 --2- 172.21.15.81:0/838669788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79b406d830 0x7f79b40b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.273+0000 7f79bc4ab700 1 --2- 172.21.15.81:0/838669788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b41578d0 0x7f79b4154850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.273+0000 7f79bc4ab700 1 -- 172.21.15.81:0/838669788 >> 172.21.15.81:0/838669788 conn(0x7f79b406bb90 msgr2=0x7f79b406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.273+0000 7f79bc4ab700 1 -- 172.21.15.81:0/838669788 shutdown_connections 2023-10-07T08:43:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.273+0000 7f79bc4ab700 1 -- 172.21.15.81:0/838669788 wait complete. 2023-10-07T08:43:00.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:43:00.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.400+0000 7fc336b5c700 1 Processor -- start 2023-10-07T08:43:00.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.400+0000 7fc336b5c700 1 -- start start 2023-10-07T08:43:00.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.401+0000 7fc336b5c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc33006d830 0x7fc3300cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:00.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.401+0000 7fc336b5c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3300d07c0 con 0x7fc3301578d0 2023-10-07T08:43:00.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.401+0000 7fc336b5c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3300cfbb0 con 0x7fc330157ca0 2023-10-07T08:43:00.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.401+0000 7fc336b5c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3300cfe90 con 0x7fc33006d830 2023-10-07T08:43:00.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.401+0000 7fc3348f8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc3301578d0 0x7fc33015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59590/0 (socket says 172.21.15.81:59590) 2023-10-07T08:43:00.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.401+0000 7fc3348f8700 1 -- 172.21.15.81:0/1390601197 learned_addr learned my addr 172.21.15.81:0/1390601197 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:00.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.401+0000 7fc3350f9700 1 --2- 172.21.15.81:0/1390601197 >> v2:172.21.15.89:3300/0 conn(0x7fc33006d830 0x7fc3300cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:00.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.401+0000 7fc3277fe700 1 -- 172.21.15.81:0/1390601197 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656525640 0 0) 0x7fc3300d07c0 con 0x7fc3301578d0 2023-10-07T08:43:00.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.401+0000 7fc3277fe700 1 -- 172.21.15.81:0/1390601197 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc318003570 con 0x7fc3301578d0 2023-10-07T08:43:00.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3277fe700 1 -- 172.21.15.81:0/1390601197 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3356820470 0 0) 0x7fc318003570 con 0x7fc3301578d0 2023-10-07T08:43:00.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3277fe700 1 -- 172.21.15.81:0/1390601197 >> v2:172.21.15.89:3300/0 conn(0x7fc33006d830 msgr2=0x7fc3300cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:00.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3277fe700 1 --2- 172.21.15.81:0/1390601197 >> v2:172.21.15.89:3300/0 conn(0x7fc33006d830 0x7fc3300cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3277fe700 1 -- 172.21.15.81:0/1390601197 >> v1:172.21.15.89:6789/0 conn(0x7fc330157ca0 legacy=0x7fc33006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:00.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3277fe700 1 -- 172.21.15.81:0/1390601197 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3300d0170 con 0x7fc3301578d0 2023-10-07T08:43:00.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3277fe700 1 -- 172.21.15.81:0/1390601197 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fc32c001470 con 0x7fc3301578d0 2023-10-07T08:43:00.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3350f9700 1 --2- 172.21.15.81:0/1390601197 >> v2:172.21.15.89:3300/0 conn(0x7fc33006d830 0x7fc3300cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:00.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3277fe700 1 -- 172.21.15.81:0/1390601197 >> v1:172.21.15.81:6789/0 conn(0x7fc3301578d0 legacy=0x7fc33015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:00.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3277fe700 1 --2- 172.21.15.81:0/1390601197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc318003a60 0x7fc318003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:00.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3277fe700 1 --2- 172.21.15.81:0/1390601197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc318004810 0x7fc318004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:00.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3277fe700 1 --2- 172.21.15.81:0/1390601197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3180051c0 0x7fc31800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:00.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3277fe700 1 -- 172.21.15.81:0/1390601197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300cfe90 con 0x7fc318003a60 2023-10-07T08:43:00.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3277fe700 1 -- 172.21.15.81:0/1390601197 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31800c0d0 con 0x7fc3180051c0 2023-10-07T08:43:00.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3277fe700 1 -- 172.21.15.81:0/1390601197 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31800c290 con 0x7fc318004810 2023-10-07T08:43:00.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3348f8700 1 --2- 172.21.15.81:0/1390601197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc318003a60 0x7fc318003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:00.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3350f9700 1 --2- 172.21.15.81:0/1390601197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3180051c0 0x7fc31800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:00.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc327fff700 1 --2- 172.21.15.81:0/1390601197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc318004810 0x7fc318004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:00.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3348f8700 1 -- 172.21.15.81:0/1390601197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc318004810 msgr2=0x7fc318004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:00.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3348f8700 1 --2- 172.21.15.81:0/1390601197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc318004810 0x7fc318004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3348f8700 1 -- 172.21.15.81:0/1390601197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3180051c0 msgr2=0x7fc31800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:00.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3348f8700 1 --2- 172.21.15.81:0/1390601197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3180051c0 0x7fc31800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3348f8700 1 -- 172.21.15.81:0/1390601197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc318003570 con 0x7fc318003a60 2023-10-07T08:43:00.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3350f9700 1 --2- 172.21.15.81:0/1390601197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3180051c0 0x7fc31800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:00.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3350f9700 1 -- 172.21.15.81:0/1390601197 reap_dead start 2023-10-07T08:43:00.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3348f8700 1 --2- 172.21.15.81:0/1390601197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc318003a60 0x7fc318003e70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00c3c0 tx=0x7fc32c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de457de3cf9049a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:00.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3277fe700 1 -- 172.21.15.81:0/1390601197 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c00cc90 con 0x7fc318003a60 2023-10-07T08:43:00.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3277fe700 1 -- 172.21.15.81:0/1390601197 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c00cdf0 con 0x7fc318003a60 2023-10-07T08:43:00.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.402+0000 7fc3277fe700 1 -- 172.21.15.81:0/1390601197 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c005b50 con 0x7fc318003a60 2023-10-07T08:43:00.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.403+0000 7fc336b5c700 1 -- 172.21.15.81:0/1390601197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc318003a60 msgr2=0x7fc318003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:00.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.403+0000 7fc336b5c700 1 --2- 172.21.15.81:0/1390601197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc318003a60 0x7fc318003e70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00c3c0 tx=0x7fc32c001e50 comp rx=0 tx=0).stop 2023-10-07T08:43:00.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.403+0000 7fc336b5c700 1 -- 172.21.15.81:0/1390601197 shutdown_connections 2023-10-07T08:43:00.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.403+0000 7fc336b5c700 1 --2- 172.21.15.81:0/1390601197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc318003a60 0x7fc318003e70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.403+0000 7fc336b5c700 1 -- 172.21.15.81:0/1390601197 >> 172.21.15.81:0/1390601197 conn(0x7fc33006bb90 msgr2=0x7fc33006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:00.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.403+0000 7fc336b5c700 1 -- 172.21.15.81:0/1390601197 shutdown_connections 2023-10-07T08:43:00.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.403+0000 7fc336b5c700 1 -- 172.21.15.81:0/1390601197 wait complete. 2023-10-07T08:43:00.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.404+0000 7fc336b5c700 1 Processor -- start 2023-10-07T08:43:00.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.404+0000 7fc336b5c700 1 -- start start 2023-10-07T08:43:00.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc336b5c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc318003a60 0x7fc330153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:00.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc336b5c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33015c820 0x7fc33015cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:00.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc336b5c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc3300c8250 0x7fc3300c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:00.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc336b5c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33015d1d0 con 0x7fc33015c820 2023-10-07T08:43:00.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc336b5c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300b4b70 con 0x7fc318003a60 2023-10-07T08:43:00.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc336b5c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc330154480 con 0x7fc3300c8250 2023-10-07T08:43:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc327fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33015c820 0x7fc33015cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc327fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33015c820 0x7fc33015cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33700/0 (socket says 172.21.15.81:33700) 2023-10-07T08:43:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc3348f8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc318003a60 0x7fc330153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc327fff700 1 -- 172.21.15.81:0/1987516222 learned_addr learned my addr 172.21.15.81:0/1987516222 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc3350f9700 1 --2- 172.21.15.81:0/1987516222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc3300c8250 0x7fc3300c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc327fff700 1 -- 172.21.15.81:0/1987516222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc3300c8250 msgr2=0x7fc3300c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc327fff700 1 --2- 172.21.15.81:0/1987516222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc3300c8250 0x7fc3300c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc327fff700 1 -- 172.21.15.81:0/1987516222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc318003a60 msgr2=0x7fc330153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc327fff700 1 --2- 172.21.15.81:0/1987516222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc318003a60 0x7fc330153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc327fff700 1 -- 172.21.15.81:0/1987516222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3300b4dc0 con 0x7fc33015c820 2023-10-07T08:43:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.405+0000 7fc327fff700 1 --2- 172.21.15.81:0/1987516222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33015c820 0x7fc33015cc90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc32000e790 tx=0x7fc320009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.406+0000 7fc324ff9700 1 -- 172.21.15.81:0/1987516222 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320012590 con 0x7fc33015c820 2023-10-07T08:43:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.406+0000 7fc324ff9700 1 -- 172.21.15.81:0/1987516222 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc320012710 con 0x7fc33015c820 2023-10-07T08:43:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.406+0000 7fc336b5c700 1 -- 172.21.15.81:0/1987516222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3300b50a0 con 0x7fc33015c820 2023-10-07T08:43:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.406+0000 7fc324ff9700 1 -- 172.21.15.81:0/1987516222 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320012ad0 con 0x7fc33015c820 2023-10-07T08:43:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.406+0000 7fc336b5c700 1 -- 172.21.15.81:0/1987516222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3300b5660 con 0x7fc33015c820 2023-10-07T08:43:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.406+0000 7fc336b5c700 1 -- 172.21.15.81:0/1987516222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33006dec0 con 0x7fc33015c820 2023-10-07T08:43:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.407+0000 7fc324ff9700 1 -- 172.21.15.81:0/1987516222 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc320013420 con 0x7fc33015c820 2023-10-07T08:43:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.407+0000 7fc324ff9700 1 --2- 172.21.15.81:0/1987516222 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc31c066f30 0x7fc31c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.407+0000 7fc324ff9700 1 -- 172.21.15.81:0/1987516222 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc320084340 con 0x7fc33015c820 2023-10-07T08:43:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.407+0000 7fc3348f8700 1 --2- 172.21.15.81:0/1987516222 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc31c066f30 0x7fc31c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.408+0000 7fc3348f8700 1 --2- 172.21.15.81:0/1987516222 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc31c066f30 0x7fc31c0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc32c001ed0 tx=0x7fc32c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.411+0000 7fc324ff9700 1 -- 172.21.15.81:0/1987516222 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3200515b0 con 0x7fc33015c820 2023-10-07T08:43:00.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.637+0000 7fc336b5c700 1 -- 172.21.15.81:0/1987516222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3300d0450 con 0x7fc33015c820 2023-10-07T08:43:00.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.638+0000 7fc324ff9700 1 -- 172.21.15.81:0/1987516222 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fc320054bd0 con 0x7fc33015c820 2023-10-07T08:43:00.639 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:00.640 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4266800811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4266800811},{"type":"v1","addr":"172.21.15.81:6836","nonce":4266800811}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1054766807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1054766807},{"type":"v1","addr":"172.21.15.89:6833","nonce":1054766807}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1734914753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1734914753},{"type":"v1","addr":"172.21.15.81:6837","nonce":1734914753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:42:56.633557+0000","modified":"2023-10-07T08:43:00.266271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/860615068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":860615068},{"type":"v1","addr":"172.21.15.89:6835","nonce":860615068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-07T08:43:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.640+0000 7fc336b5c700 1 -- 172.21.15.81:0/1987516222 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc31c066f30 msgr2=0x7fc31c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.640+0000 7fc336b5c700 1 --2- 172.21.15.81:0/1987516222 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc31c066f30 0x7fc31c0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc32c001ed0 tx=0x7fc32c015000 comp rx=0 tx=0).stop 2023-10-07T08:43:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.640+0000 7fc336b5c700 1 -- 172.21.15.81:0/1987516222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33015c820 msgr2=0x7fc33015cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.640+0000 7fc336b5c700 1 --2- 172.21.15.81:0/1987516222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33015c820 0x7fc33015cc90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc32000e790 tx=0x7fc320009040 comp rx=0 tx=0).stop 2023-10-07T08:43:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.640+0000 7fc336b5c700 1 -- 172.21.15.81:0/1987516222 shutdown_connections 2023-10-07T08:43:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.640+0000 7fc336b5c700 1 --2- 172.21.15.81:0/1987516222 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc31c066f30 0x7fc31c0693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.640+0000 7fc336b5c700 1 --2- 172.21.15.81:0/1987516222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc3300c8250 0x7fc3300c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.640+0000 7fc336b5c700 1 --2- 172.21.15.81:0/1987516222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc318003a60 0x7fc330153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.640+0000 7fc336b5c700 1 --2- 172.21.15.81:0/1987516222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33015c820 0x7fc33015cc90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.640+0000 7fc336b5c700 1 -- 172.21.15.81:0/1987516222 >> 172.21.15.81:0/1987516222 conn(0x7fc33006bb90 msgr2=0x7fc330156820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.640+0000 7fc336b5c700 1 -- 172.21.15.81:0/1987516222 shutdown_connections 2023-10-07T08:43:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.640+0000 7fc336b5c700 1 -- 172.21.15.81:0/1987516222 wait complete. 2023-10-07T08:43:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2023-10-07T08:43:00.653 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:00.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.765+0000 7f0c8bae0700 1 Processor -- start 2023-10-07T08:43:00.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.765+0000 7f0c8bae0700 1 -- start start 2023-10-07T08:43:00.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.766+0000 7f0c8bae0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c84157fe0 0x7f0c840b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:00.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.766+0000 7f0c8bae0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c840cf240 0x7f0c840b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:00.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.766+0000 7f0c8bae0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c840b2890 con 0x7f0c841583b0 2023-10-07T08:43:00.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.766+0000 7f0c8bae0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c840b4070 con 0x7f0c840cf240 2023-10-07T08:43:00.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.766+0000 7f0c8bae0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840b4350 con 0x7f0c84157fe0 2023-10-07T08:43:00.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.766+0000 7f0c8a07d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c840cf240 0x7f0c840b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:00.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.766+0000 7f0c8a07d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c840cf240 0x7f0c840b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33708/0 (socket says 172.21.15.81:33708) 2023-10-07T08:43:00.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.766+0000 7f0c8a07d700 1 -- 172.21.15.81:0/1087210468 learned_addr learned my addr 172.21.15.81:0/1087210468 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:00.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.766+0000 7f0c8987c700 1 --2- 172.21.15.81:0/1087210468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c84157fe0 0x7f0c840b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:00.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.766+0000 7f0c8a07d700 1 -- 172.21.15.81:0/1087210468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c84157fe0 msgr2=0x7f0c840b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:00.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.766+0000 7f0c8a07d700 1 --2- 172.21.15.81:0/1087210468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c84157fe0 0x7f0c840b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.767+0000 7f0c8a07d700 1 -- 172.21.15.81:0/1087210468 >> v1:172.21.15.89:6789/0 conn(0x7f0c841583b0 legacy=0x7f0c840ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:00.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.767+0000 7f0c8a07d700 1 -- 172.21.15.81:0/1087210468 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c840b4630 con 0x7f0c840cf240 2023-10-07T08:43:00.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.767+0000 7f0c8a07d700 1 --2- 172.21.15.81:0/1087210468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c840cf240 0x7f0c840b3a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0099b0 tx=0x7f0c7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1044b1bfdad0f3d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:00.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.767+0000 7f0c8887a700 1 -- 172.21.15.81:0/1087210468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c00b860 con 0x7f0c840cf240 2023-10-07T08:43:00.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.767+0000 7f0c8887a700 1 -- 172.21.15.81:0/1087210468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c00b9c0 con 0x7f0c840cf240 2023-10-07T08:43:00.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.767+0000 7f0c8887a700 1 -- 172.21.15.81:0/1087210468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c00bd80 con 0x7f0c840cf240 2023-10-07T08:43:00.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.767+0000 7f0c8bae0700 1 -- 172.21.15.81:0/1087210468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c840cf240 msgr2=0x7f0c840b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:00.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.767+0000 7f0c8bae0700 1 --2- 172.21.15.81:0/1087210468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c840cf240 0x7f0c840b3a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0099b0 tx=0x7f0c7c009250 comp rx=0 tx=0).stop 2023-10-07T08:43:00.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.767+0000 7f0c8bae0700 1 -- 172.21.15.81:0/1087210468 shutdown_connections 2023-10-07T08:43:00.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.767+0000 7f0c8bae0700 1 --2- 172.21.15.81:0/1087210468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c840cf240 0x7f0c840b3a00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.767+0000 7f0c8bae0700 1 --2- 172.21.15.81:0/1087210468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c84157fe0 0x7f0c840b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.767+0000 7f0c8bae0700 1 -- 172.21.15.81:0/1087210468 >> 172.21.15.81:0/1087210468 conn(0x7f0c84067640 msgr2=0x7f0c84067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:00.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.767+0000 7f0c8bae0700 1 -- 172.21.15.81:0/1087210468 shutdown_connections 2023-10-07T08:43:00.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.767+0000 7f0c8bae0700 1 -- 172.21.15.81:0/1087210468 wait complete. 2023-10-07T08:43:00.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.768+0000 7f0c8bae0700 1 Processor -- start 2023-10-07T08:43:00.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.769+0000 7f0c8bae0700 1 -- start start 2023-10-07T08:43:00.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.769+0000 7f0c8bae0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c840cf240 0x7f0c840c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:00.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.769+0000 7f0c8bae0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c84157fe0 0x7f0c8415a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:00.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.769+0000 7f0c8bae0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c841583b0 0x7f0c8415ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:00.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.769+0000 7f0c8bae0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840c97d0 con 0x7f0c840cf240 2023-10-07T08:43:00.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.769+0000 7f0c8bae0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840c9340 con 0x7f0c84157fe0 2023-10-07T08:43:00.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.769+0000 7f0c8bae0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840c8730 con 0x7f0c841583b0 2023-10-07T08:43:00.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.769+0000 7f0c8987c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c840cf240 0x7f0c840c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:00.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.769+0000 7f0c8987c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c840cf240 0x7f0c840c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33724/0 (socket says 172.21.15.81:33724) 2023-10-07T08:43:00.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.769+0000 7f0c8987c700 1 -- 172.21.15.81:0/150963809 learned_addr learned my addr 172.21.15.81:0/150963809 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:00.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.769+0000 7f0c8907b700 1 --2- 172.21.15.81:0/150963809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c84157fe0 0x7f0c8415a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:00.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.770+0000 7f0c8a07d700 1 --2- 172.21.15.81:0/150963809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c841583b0 0x7f0c8415ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:00.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.770+0000 7f0c8987c700 1 -- 172.21.15.81:0/150963809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c841583b0 msgr2=0x7f0c8415ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:00.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.770+0000 7f0c8987c700 1 --2- 172.21.15.81:0/150963809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c841583b0 0x7f0c8415ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.770+0000 7f0c8987c700 1 -- 172.21.15.81:0/150963809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c84157fe0 msgr2=0x7f0c8415a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:00.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.770+0000 7f0c8987c700 1 --2- 172.21.15.81:0/150963809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c84157fe0 0x7f0c8415a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.770+0000 7f0c8987c700 1 -- 172.21.15.81:0/150963809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c0094f0 con 0x7f0c840cf240 2023-10-07T08:43:00.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.770+0000 7f0c8a07d700 1 --2- 172.21.15.81:0/150963809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c841583b0 0x7f0c8415ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:00.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.770+0000 7f0c8987c700 1 --2- 172.21.15.81:0/150963809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c840cf240 0x7f0c840c7d50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000e190 tx=0x7f0c80009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:00.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.770+0000 7f0c79ffb700 1 -- 172.21.15.81:0/150963809 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8000ee30 con 0x7f0c840cf240 2023-10-07T08:43:00.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.770+0000 7f0c79ffb700 1 -- 172.21.15.81:0/150963809 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c80014420 con 0x7f0c840cf240 2023-10-07T08:43:00.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.770+0000 7f0c8bae0700 1 -- 172.21.15.81:0/150963809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c840c8a10 con 0x7f0c840cf240 2023-10-07T08:43:00.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.770+0000 7f0c79ffb700 1 -- 172.21.15.81:0/150963809 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c800147e0 con 0x7f0c840cf240 2023-10-07T08:43:00.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.770+0000 7f0c8bae0700 1 -- 172.21.15.81:0/150963809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c840c8fd0 con 0x7f0c840cf240 2023-10-07T08:43:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.771+0000 7f0c8bae0700 1 -- 172.21.15.81:0/150963809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8415b350 con 0x7f0c840cf240 2023-10-07T08:43:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.771+0000 7f0c79ffb700 1 -- 172.21.15.81:0/150963809 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c80014b90 con 0x7f0c840cf240 2023-10-07T08:43:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.772+0000 7f0c79ffb700 1 --2- 172.21.15.81:0/150963809 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0c68066f30 0x7f0c680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.772+0000 7f0c79ffb700 1 -- 172.21.15.81:0/150963809 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0c80084dd0 con 0x7f0c840cf240 2023-10-07T08:43:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.772+0000 7f0c8907b700 1 --2- 172.21.15.81:0/150963809 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0c68066f30 0x7f0c680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.772+0000 7f0c8907b700 1 --2- 172.21.15.81:0/150963809 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0c68066f30 0x7f0c680693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0c840a6690 tx=0x7f0c74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.776+0000 7f0c79ffb700 1 -- 172.21.15.81:0/150963809 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c80051fa0 con 0x7f0c840cf240 2023-10-07T08:43:00.801 INFO:tasks.ceph.mds.d.smithi089.stderr:2023-10-07T08:43:00.800+0000 7f983033c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:43:00.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.958+0000 7f0c8bae0700 1 -- 172.21.15.81:0/150963809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c84154f70 con 0x7f0c840cf240 2023-10-07T08:43:00.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.958+0000 7f0c79ffb700 1 -- 172.21.15.81:0/150963809 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f0c80009a60 con 0x7f0c840cf240 2023-10-07T08:43:00.960 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:00.960 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:58.248338+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:42:54.397263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:42:55.595133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:00.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.961+0000 7f0c8bae0700 1 -- 172.21.15.81:0/150963809 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0c68066f30 msgr2=0x7f0c680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:00.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.961+0000 7f0c8bae0700 1 --2- 172.21.15.81:0/150963809 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0c68066f30 0x7f0c680693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0c840a6690 tx=0x7f0c74009040 comp rx=0 tx=0).stop 2023-10-07T08:43:00.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.961+0000 7f0c8bae0700 1 -- 172.21.15.81:0/150963809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c840cf240 msgr2=0x7f0c840c7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:00.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.961+0000 7f0c8bae0700 1 --2- 172.21.15.81:0/150963809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c840cf240 0x7f0c840c7d50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000e190 tx=0x7f0c80009920 comp rx=0 tx=0).stop 2023-10-07T08:43:00.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.961+0000 7f0c8bae0700 1 -- 172.21.15.81:0/150963809 shutdown_connections 2023-10-07T08:43:00.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.961+0000 7f0c8bae0700 1 --2- 172.21.15.81:0/150963809 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0c68066f30 0x7f0c680693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.961+0000 7f0c8bae0700 1 --2- 172.21.15.81:0/150963809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c841583b0 0x7f0c8415ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.961+0000 7f0c8bae0700 1 --2- 172.21.15.81:0/150963809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c840cf240 0x7f0c840c7d50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.961+0000 7f0c8bae0700 1 --2- 172.21.15.81:0/150963809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c84157fe0 0x7f0c8415a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:00.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.961+0000 7f0c8bae0700 1 -- 172.21.15.81:0/150963809 >> 172.21.15.81:0/150963809 conn(0x7f0c84067640 msgr2=0x7f0c840ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:00.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.961+0000 7f0c8bae0700 1 -- 172.21.15.81:0/150963809 shutdown_connections 2023-10-07T08:43:00.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:00.961+0000 7f0c8bae0700 1 -- 172.21.15.81:0/150963809 wait complete. 2023-10-07T08:43:00.974 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T08:43:00.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:43:01.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.086+0000 7ff79d853700 1 Processor -- start 2023-10-07T08:43:01.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.086+0000 7ff79d853700 1 -- start start 2023-10-07T08:43:01.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff79d853700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7980add30 0x7ff7980b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff79d853700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7980b17c0 con 0x7ff7980cefa0 2023-10-07T08:43:01.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff79d853700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7980b1d80 con 0x7ff798067640 2023-10-07T08:43:01.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff79d853700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980b37b0 con 0x7ff7980add30 2023-10-07T08:43:01.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff79d052700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff7980cefa0 0x7ff7980cc0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59596/0 (socket says 172.21.15.81:59596) 2023-10-07T08:43:01.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff79d052700 1 -- 172.21.15.81:0/918791468 learned_addr learned my addr 172.21.15.81:0/918791468 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:01.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff7977fe700 1 -- 172.21.15.81:0/918791468 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611292581 0 0) 0x7ff7980b17c0 con 0x7ff7980cefa0 2023-10-07T08:43:01.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff79c851700 1 --2- 172.21.15.81:0/918791468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7980add30 0x7ff7980b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff7977fe700 1 -- 172.21.15.81:0/918791468 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff780003570 con 0x7ff7980cefa0 2023-10-07T08:43:01.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff7977fe700 1 -- 172.21.15.81:0/918791468 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 322828551 0 0) 0x7ff780003570 con 0x7ff7980cefa0 2023-10-07T08:43:01.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff7977fe700 1 -- 172.21.15.81:0/918791468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7980add30 msgr2=0x7ff7980b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:01.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff7977fe700 1 --2- 172.21.15.81:0/918791468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7980add30 0x7ff7980b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff7977fe700 1 -- 172.21.15.81:0/918791468 >> v1:172.21.15.89:6789/0 conn(0x7ff798067640 legacy=0x7ff7980ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff7977fe700 1 -- 172.21.15.81:0/918791468 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff798068220 con 0x7ff7980cefa0 2023-10-07T08:43:01.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff7977fe700 1 -- 172.21.15.81:0/918791468 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7ff790001470 con 0x7ff7980cefa0 2023-10-07T08:43:01.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff7977fe700 1 -- 172.21.15.81:0/918791468 >> v1:172.21.15.81:6789/0 conn(0x7ff7980cefa0 legacy=0x7ff7980cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff7977fe700 1 --2- 172.21.15.81:0/918791468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff780003a90 0x7ff780003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.087+0000 7ff7977fe700 1 --2- 172.21.15.81:0/918791468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff780004810 0x7ff780004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.088+0000 7ff7977fe700 1 --2- 172.21.15.81:0/918791468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7980add30 0x7ff7800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.088+0000 7ff7977fe700 1 -- 172.21.15.81:0/918791468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78000bb10 con 0x7ff780004810 2023-10-07T08:43:01.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.088+0000 7ff7977fe700 1 -- 172.21.15.81:0/918791468 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78000bc50 con 0x7ff780003a90 2023-10-07T08:43:01.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.088+0000 7ff7977fe700 1 -- 172.21.15.81:0/918791468 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78000be10 con 0x7ff7980add30 2023-10-07T08:43:01.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.088+0000 7ff797fff700 1 --2- 172.21.15.81:0/918791468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff780004810 0x7ff780004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.088+0000 7ff79c851700 1 --2- 172.21.15.81:0/918791468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff780003a90 0x7ff780003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.088+0000 7ff79d052700 1 --2- 172.21.15.81:0/918791468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7980add30 0x7ff7800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.088+0000 7ff797fff700 1 -- 172.21.15.81:0/918791468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7980add30 msgr2=0x7ff7800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:01.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.088+0000 7ff797fff700 1 --2- 172.21.15.81:0/918791468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7980add30 0x7ff7800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.088+0000 7ff797fff700 1 -- 172.21.15.81:0/918791468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff780003a90 msgr2=0x7ff780003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:01.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.088+0000 7ff797fff700 1 --2- 172.21.15.81:0/918791468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff780003a90 0x7ff780003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.088+0000 7ff797fff700 1 -- 172.21.15.81:0/918791468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780003570 con 0x7ff780004810 2023-10-07T08:43:01.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.088+0000 7ff797fff700 1 --2- 172.21.15.81:0/918791468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff780004810 0x7ff780004c80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0019a0 tx=0x7ff78c007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ace546c951158d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:01.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.088+0000 7ff7977fe700 1 -- 172.21.15.81:0/918791468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c00c5d0 con 0x7ff780004810 2023-10-07T08:43:01.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.088+0000 7ff7977fe700 1 -- 172.21.15.81:0/918791468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c00c730 con 0x7ff780004810 2023-10-07T08:43:01.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.088+0000 7ff7977fe700 1 -- 172.21.15.81:0/918791468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c00caf0 con 0x7ff780004810 2023-10-07T08:43:01.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.089+0000 7ff79d853700 1 -- 172.21.15.81:0/918791468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff780004810 msgr2=0x7ff780004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.089+0000 7ff79d853700 1 --2- 172.21.15.81:0/918791468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff780004810 0x7ff780004c80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0019a0 tx=0x7ff78c007d10 comp rx=0 tx=0).stop 2023-10-07T08:43:01.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.089+0000 7ff79d052700 1 -- 172.21.15.81:0/918791468 reap_dead start 2023-10-07T08:43:01.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.089+0000 7ff79d853700 1 -- 172.21.15.81:0/918791468 shutdown_connections 2023-10-07T08:43:01.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.089+0000 7ff79d853700 1 -- 172.21.15.81:0/918791468 >> 172.21.15.81:0/918791468 conn(0x7ff79806c620 msgr2=0x7ff79806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:01.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.089+0000 7ff79d853700 1 -- 172.21.15.81:0/918791468 shutdown_connections 2023-10-07T08:43:01.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.089+0000 7ff79d853700 1 -- 172.21.15.81:0/918791468 wait complete. 2023-10-07T08:43:01.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.090+0000 7ff79d853700 1 Processor -- start 2023-10-07T08:43:01.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.090+0000 7ff79d853700 1 -- start start 2023-10-07T08:43:01.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79d853700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff780004810 0x7ff7980a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79d853700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7981466a0 0x7ff7980aa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79d853700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7980abde0 0x7ff7980ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79d853700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7981594c0 con 0x7ff780004810 2023-10-07T08:43:01.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79d853700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980acb50 con 0x7ff7980abde0 2023-10-07T08:43:01.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79d853700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980ace30 con 0x7ff7981466a0 2023-10-07T08:43:01.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79c851700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff780004810 0x7ff7980a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79c851700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff780004810 0x7ff7980a9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33730/0 (socket says 172.21.15.81:33730) 2023-10-07T08:43:01.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79c851700 1 -- 172.21.15.81:0/2799871722 learned_addr learned my addr 172.21.15.81:0/2799871722 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:01.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff797fff700 1 --2- 172.21.15.81:0/2799871722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7981466a0 0x7ff7980aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79d052700 1 --2- 172.21.15.81:0/2799871722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7980abde0 0x7ff7980ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79c851700 1 -- 172.21.15.81:0/2799871722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7981466a0 msgr2=0x7ff7980aa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79c851700 1 --2- 172.21.15.81:0/2799871722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7981466a0 0x7ff7980aa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79c851700 1 -- 172.21.15.81:0/2799871722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7980abde0 msgr2=0x7ff7980ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79c851700 1 --2- 172.21.15.81:0/2799871722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7980abde0 0x7ff7980ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79c851700 1 -- 172.21.15.81:0/2799871722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7980ad110 con 0x7ff780004810 2023-10-07T08:43:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79c851700 1 --2- 172.21.15.81:0/2799871722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff780004810 0x7ff7980a9be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff788011f80 tx=0x7ff78800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff794ff9700 1 -- 172.21.15.81:0/2799871722 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78800e040 con 0x7ff780004810 2023-10-07T08:43:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff794ff9700 1 -- 172.21.15.81:0/2799871722 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78800f040 con 0x7ff780004810 2023-10-07T08:43:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79d853700 1 -- 172.21.15.81:0/2799871722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7980ad3f0 con 0x7ff780004810 2023-10-07T08:43:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff794ff9700 1 -- 172.21.15.81:0/2799871722 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788015430 con 0x7ff780004810 2023-10-07T08:43:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.091+0000 7ff79d853700 1 -- 172.21.15.81:0/2799871722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff798159980 con 0x7ff780004810 2023-10-07T08:43:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.092+0000 7ff79d853700 1 -- 172.21.15.81:0/2799871722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff798157d50 con 0x7ff780004810 2023-10-07T08:43:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.093+0000 7ff794ff9700 1 -- 172.21.15.81:0/2799871722 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff788015820 con 0x7ff780004810 2023-10-07T08:43:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.093+0000 7ff794ff9700 1 --2- 172.21.15.81:0/2799871722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff784066f00 0x7ff7840693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.093+0000 7ff794ff9700 1 -- 172.21.15.81:0/2799871722 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff788085180 con 0x7ff780004810 2023-10-07T08:43:01.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.093+0000 7ff797fff700 1 --2- 172.21.15.81:0/2799871722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff784066f00 0x7ff7840693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.093+0000 7ff797fff700 1 --2- 172.21.15.81:0/2799871722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff784066f00 0x7ff7840693b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff78c008fd0 tx=0x7ff78c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:01.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.097+0000 7ff794ff9700 1 -- 172.21.15.81:0/2799871722 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7880523f0 con 0x7ff780004810 2023-10-07T08:43:01.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.276+0000 7ff79d853700 1 -- 172.21.15.81:0/2799871722 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff798068500 con 0x7ff784066f00 2023-10-07T08:43:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.283+0000 7ff794ff9700 1 -- 172.21.15.81:0/2799871722 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248963 (secure 0 0 0) 0x7ff798068500 con 0x7ff784066f00 2023-10-07T08:43:01.287 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.286+0000 7ff79d853700 1 -- 172.21.15.81:0/2799871722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff784066f00 msgr2=0x7ff7840693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.286+0000 7ff79d853700 1 --2- 172.21.15.81:0/2799871722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff784066f00 0x7ff7840693b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff78c008fd0 tx=0x7ff78c015000 comp rx=0 tx=0).stop 2023-10-07T08:43:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.286+0000 7ff79d853700 1 -- 172.21.15.81:0/2799871722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff780004810 msgr2=0x7ff7980a9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.286+0000 7ff79d853700 1 --2- 172.21.15.81:0/2799871722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff780004810 0x7ff7980a9be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff788011f80 tx=0x7ff78800b040 comp rx=0 tx=0).stop 2023-10-07T08:43:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.286+0000 7ff79d853700 1 -- 172.21.15.81:0/2799871722 shutdown_connections 2023-10-07T08:43:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.286+0000 7ff79d853700 1 --2- 172.21.15.81:0/2799871722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7980abde0 0x7ff7980ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.286+0000 7ff79d853700 1 --2- 172.21.15.81:0/2799871722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff780004810 0x7ff7980a9be0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.286+0000 7ff79d853700 1 --2- 172.21.15.81:0/2799871722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff784066f00 0x7ff7840693b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.286+0000 7ff79d853700 1 --2- 172.21.15.81:0/2799871722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7981466a0 0x7ff7980aa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.286+0000 7ff79d853700 1 -- 172.21.15.81:0/2799871722 >> 172.21.15.81:0/2799871722 conn(0x7ff79806c620 msgr2=0x7ff7981573d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.286+0000 7ff79d853700 1 -- 172.21.15.81:0/2799871722 shutdown_connections 2023-10-07T08:43:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.286+0000 7ff79d853700 1 -- 172.21.15.81:0/2799871722 wait complete. 2023-10-07T08:43:01.291 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:43:01.299 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-07T08:43:00.005905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1543,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560956,"statfs":{"total":1600000000,"available":1598418992,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.762972"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-07T08:42:48.806060+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:42:48.806060+0000","last_peered":"2023-10-07T08:42:48.806060+0000","last_clean":"2023-10-07T08:42:48.806060+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:42:48.806060+0000","last_undegraded":"2023-10-07T08:42:48.806060+0000","last_fullsized":"2023-10-07T08:42:48.806060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194687,"statfs":{"total":200000000,"available":199359598,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949966,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949966,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194687,"statfs":{"total":200000000,"available":199359598,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949966,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949966,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949966,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949966,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]}],"pool_statfs":[]}} 2023-10-07T08:43:01.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:43:01.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.452+0000 7fd340c9c700 1 Processor -- start 2023-10-07T08:43:01.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.452+0000 7fd340c9c700 1 -- start start 2023-10-07T08:43:01.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.453+0000 7fd340c9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd33c157ca0 0x7fd33c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.453+0000 7fd340c9c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c06d120 0x7fd33c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.453+0000 7fd340c9c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c0d07c0 con 0x7fd33c1578d0 2023-10-07T08:43:01.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.453+0000 7fd340c9c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33c06daa0 con 0x7fd33c157ca0 2023-10-07T08:43:01.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.453+0000 7fd340c9c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0cfbb0 con 0x7fd33c06d120 2023-10-07T08:43:01.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.453+0000 7fd339d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd33c157ca0 0x7fd33c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.453+0000 7fd339d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd33c157ca0 0x7fd33c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33734/0 (socket says 172.21.15.81:33734) 2023-10-07T08:43:01.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.453+0000 7fd339d9b700 1 -- 172.21.15.81:0/754683368 learned_addr learned my addr 172.21.15.81:0/754683368 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:01.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.453+0000 7fd33ad9d700 1 --2- 172.21.15.81:0/754683368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c06d120 0x7fd33c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.454+0000 7fd339d9b700 1 -- 172.21.15.81:0/754683368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c06d120 msgr2=0x7fd33c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:01.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.454+0000 7fd339d9b700 1 --2- 172.21.15.81:0/754683368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c06d120 0x7fd33c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.454+0000 7fd339d9b700 1 -- 172.21.15.81:0/754683368 >> v1:172.21.15.89:6789/0 conn(0x7fd33c1578d0 legacy=0x7fd33c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.454+0000 7fd339d9b700 1 -- 172.21.15.81:0/754683368 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c0cfe90 con 0x7fd33c157ca0 2023-10-07T08:43:01.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.454+0000 7fd33959a700 1 -- 172.21.15.81:0/754683368 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850323884 0 0) 0x7fd33c0d07c0 con 0x7fd33c1578d0 2023-10-07T08:43:01.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.454+0000 7fd339d9b700 1 --2- 172.21.15.81:0/754683368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd33c157ca0 0x7fd33c0cf4f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd3240099b0 tx=0x7fd324009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf949ab7ec23b2e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:01.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.454+0000 7fd33959a700 1 -- 172.21.15.81:0/754683368 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324009ea0 con 0x7fd33c157ca0 2023-10-07T08:43:01.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.454+0000 7fd33959a700 1 -- 172.21.15.81:0/754683368 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32400b860 con 0x7fd33c157ca0 2023-10-07T08:43:01.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.454+0000 7fd33959a700 1 -- 172.21.15.81:0/754683368 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400bc00 con 0x7fd33c157ca0 2023-10-07T08:43:01.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.454+0000 7fd340c9c700 1 -- 172.21.15.81:0/754683368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd33c157ca0 msgr2=0x7fd33c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.454+0000 7fd340c9c700 1 --2- 172.21.15.81:0/754683368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd33c157ca0 0x7fd33c0cf4f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd3240099b0 tx=0x7fd324009250 comp rx=0 tx=0).stop 2023-10-07T08:43:01.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.454+0000 7fd340c9c700 1 -- 172.21.15.81:0/754683368 shutdown_connections 2023-10-07T08:43:01.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.454+0000 7fd340c9c700 1 --2- 172.21.15.81:0/754683368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c06d120 0x7fd33c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.454+0000 7fd340c9c700 1 --2- 172.21.15.81:0/754683368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd33c157ca0 0x7fd33c0cf4f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.454+0000 7fd340c9c700 1 -- 172.21.15.81:0/754683368 >> 172.21.15.81:0/754683368 conn(0x7fd33c06bb90 msgr2=0x7fd33c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:01.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.455+0000 7fd340c9c700 1 -- 172.21.15.81:0/754683368 shutdown_connections 2023-10-07T08:43:01.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.455+0000 7fd340c9c700 1 -- 172.21.15.81:0/754683368 wait complete. 2023-10-07T08:43:01.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.456+0000 7fd340c9c700 1 Processor -- start 2023-10-07T08:43:01.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.456+0000 7fd340c9c700 1 -- start start 2023-10-07T08:43:01.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.456+0000 7fd340c9c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c06d120 0x7fd33c0b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.456+0000 7fd340c9c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd33c1578d0 0x7fd33c0b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.456+0000 7fd340c9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd33c157ca0 0x7fd33c1539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.456+0000 7fd340c9c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0ab1c0 con 0x7fd33c157ca0 2023-10-07T08:43:01.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.456+0000 7fd340c9c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0b4b90 con 0x7fd33c1578d0 2023-10-07T08:43:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.456+0000 7fd340c9c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0aa890 con 0x7fd33c06d120 2023-10-07T08:43:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.456+0000 7fd33ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd33c157ca0 0x7fd33c1539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.456+0000 7fd33ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd33c157ca0 0x7fd33c1539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33750/0 (socket says 172.21.15.81:33750) 2023-10-07T08:43:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.456+0000 7fd33ad9d700 1 -- 172.21.15.81:0/4078588776 learned_addr learned my addr 172.21.15.81:0/4078588776 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.457+0000 7fd339d9b700 1 --2- 172.21.15.81:0/4078588776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd33c1578d0 0x7fd33c0b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.457+0000 7fd33a59c700 1 --2- 172.21.15.81:0/4078588776 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c06d120 0x7fd33c0b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.457+0000 7fd33ad9d700 1 -- 172.21.15.81:0/4078588776 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c06d120 msgr2=0x7fd33c0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.457+0000 7fd33ad9d700 1 --2- 172.21.15.81:0/4078588776 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c06d120 0x7fd33c0b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.457+0000 7fd33ad9d700 1 -- 172.21.15.81:0/4078588776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd33c1578d0 msgr2=0x7fd33c0b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.457+0000 7fd33ad9d700 1 --2- 172.21.15.81:0/4078588776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd33c1578d0 0x7fd33c0b58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.457+0000 7fd33ad9d700 1 -- 172.21.15.81:0/4078588776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3240094f0 con 0x7fd33c157ca0 2023-10-07T08:43:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.457+0000 7fd33ad9d700 1 --2- 172.21.15.81:0/4078588776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd33c157ca0 0x7fd33c1539d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd33400ea50 tx=0x7fd3340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.457+0000 7fd3327fc700 1 -- 172.21.15.81:0/4078588776 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400c920 con 0x7fd33c157ca0 2023-10-07T08:43:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.457+0000 7fd3327fc700 1 -- 172.21.15.81:0/4078588776 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33400caa0 con 0x7fd33c157ca0 2023-10-07T08:43:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.457+0000 7fd3327fc700 1 -- 172.21.15.81:0/4078588776 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400ce60 con 0x7fd33c157ca0 2023-10-07T08:43:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.457+0000 7fd340c9c700 1 -- 172.21.15.81:0/4078588776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c0aab70 con 0x7fd33c157ca0 2023-10-07T08:43:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.457+0000 7fd340c9c700 1 -- 172.21.15.81:0/4078588776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33c0b5df0 con 0x7fd33c157ca0 2023-10-07T08:43:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.458+0000 7fd340c9c700 1 -- 172.21.15.81:0/4078588776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33c15d420 con 0x7fd33c157ca0 2023-10-07T08:43:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.458+0000 7fd3327fc700 1 -- 172.21.15.81:0/4078588776 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd334013680 con 0x7fd33c157ca0 2023-10-07T08:43:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.459+0000 7fd3327fc700 1 --2- 172.21.15.81:0/4078588776 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd31c066f30 0x7fd31c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.459+0000 7fd3327fc700 1 -- 172.21.15.81:0/4078588776 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3340849f0 con 0x7fd33c157ca0 2023-10-07T08:43:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.459+0000 7fd33a59c700 1 --2- 172.21.15.81:0/4078588776 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd31c066f30 0x7fd31c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.459+0000 7fd33a59c700 1 --2- 172.21.15.81:0/4078588776 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd31c066f30 0x7fd31c0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0b6410 tx=0x7fd32c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.463+0000 7fd3327fc700 1 -- 172.21.15.81:0/4078588776 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd334051bc0 con 0x7fd33c157ca0 2023-10-07T08:43:01.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.642+0000 7fd340c9c700 1 -- 172.21.15.81:0/4078588776 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd33c0ab300 con 0x7fd31c066f30 2023-10-07T08:43:01.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.649+0000 7fd3327fc700 1 -- 172.21.15.81:0/4078588776 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248963 (secure 0 0 0) 0x7fd33c0ab300 con 0x7fd31c066f30 2023-10-07T08:43:01.653 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:01.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.652+0000 7fd340c9c700 1 -- 172.21.15.81:0/4078588776 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd31c066f30 msgr2=0x7fd31c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.652+0000 7fd340c9c700 1 --2- 172.21.15.81:0/4078588776 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd31c066f30 0x7fd31c0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0b6410 tx=0x7fd32c009040 comp rx=0 tx=0).stop 2023-10-07T08:43:01.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.652+0000 7fd340c9c700 1 -- 172.21.15.81:0/4078588776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd33c157ca0 msgr2=0x7fd33c1539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.652+0000 7fd340c9c700 1 --2- 172.21.15.81:0/4078588776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd33c157ca0 0x7fd33c1539d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd33400ea50 tx=0x7fd3340091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.652+0000 7fd340c9c700 1 -- 172.21.15.81:0/4078588776 shutdown_connections 2023-10-07T08:43:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.652+0000 7fd340c9c700 1 --2- 172.21.15.81:0/4078588776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd33c157ca0 0x7fd33c1539d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.652+0000 7fd340c9c700 1 --2- 172.21.15.81:0/4078588776 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd31c066f30 0x7fd31c0693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.652+0000 7fd340c9c700 1 --2- 172.21.15.81:0/4078588776 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c06d120 0x7fd33c0b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.652+0000 7fd340c9c700 1 --2- 172.21.15.81:0/4078588776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd33c1578d0 0x7fd33c0b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.652+0000 7fd340c9c700 1 -- 172.21.15.81:0/4078588776 >> 172.21.15.81:0/4078588776 conn(0x7fd33c06bb90 msgr2=0x7fd33c155960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.652+0000 7fd340c9c700 1 -- 172.21.15.81:0/4078588776 shutdown_connections 2023-10-07T08:43:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.652+0000 7fd340c9c700 1 -- 172.21.15.81:0/4078588776 wait complete. 2023-10-07T08:43:01.656 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:43:01.665 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-07T08:43:00.005905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1543,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560956,"statfs":{"total":1600000000,"available":1598418992,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.762972"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-07T08:42:48.806060+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:42:48.806060+0000","last_peered":"2023-10-07T08:42:48.806060+0000","last_clean":"2023-10-07T08:42:48.806060+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:42:48.806060+0000","last_undegraded":"2023-10-07T08:42:48.806060+0000","last_fullsized":"2023-10-07T08:42:48.806060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:55.237912+0000","last_change":"2023-10-07T08:42:55.237912+0000","last_active":"2023-10-07T08:42:55.237912+0000","last_peered":"2023-10-07T08:42:55.237912+0000","last_clean":"2023-10-07T08:42:55.237912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:55.237912+0000","last_undegraded":"2023-10-07T08:42:55.237912+0000","last_fullsized":"2023-10-07T08:42:55.237912+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:42:56.242426+0000","last_change":"2023-10-07T08:42:56.242426+0000","last_active":"2023-10-07T08:42:56.242426+0000","last_peered":"2023-10-07T08:42:56.242426+0000","last_clean":"2023-10-07T08:42:56.242426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:42:56.242426+0000","last_undegraded":"2023-10-07T08:42:56.242426+0000","last_fullsized":"2023-10-07T08:42:56.242426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194687,"statfs":{"total":200000000,"available":199359598,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949966,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949966,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194687,"statfs":{"total":200000000,"available":199359598,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949966,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949966,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949966,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949966,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]}],"pool_statfs":[]}} 2023-10-07T08:43:01.671 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:43:01.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.819+0000 7f6e4726e700 1 Processor -- start 2023-10-07T08:43:01.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.819+0000 7f6e4726e700 1 -- start start 2023-10-07T08:43:01.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.820+0000 7f6e4726e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e400c78e0 0x7f6e400698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.820+0000 7f6e4726e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e400cb880 con 0x7f6e40156420 2023-10-07T08:43:01.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.820+0000 7f6e4726e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e400cac70 con 0x7f6e40069440 2023-10-07T08:43:01.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.820+0000 7f6e4726e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4006aa10 con 0x7f6e400c78e0 2023-10-07T08:43:01.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.820+0000 7f6e4500a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6e40156420 0x7f6e400cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59600/0 (socket says 172.21.15.81:59600) 2023-10-07T08:43:01.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.820+0000 7f6e4500a700 1 -- 172.21.15.81:0/2264461663 learned_addr learned my addr 172.21.15.81:0/2264461663 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:01.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e37fff700 1 -- 172.21.15.81:0/2264461663 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232539892 0 0) 0x7f6e400cb880 con 0x7f6e40156420 2023-10-07T08:43:01.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e4580b700 1 --2- 172.21.15.81:0/2264461663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e400c78e0 0x7f6e400698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e37fff700 1 -- 172.21.15.81:0/2264461663 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e2c003570 con 0x7f6e40156420 2023-10-07T08:43:01.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e37fff700 1 -- 172.21.15.81:0/2264461663 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1979401764 0 0) 0x7f6e2c003570 con 0x7f6e40156420 2023-10-07T08:43:01.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e37fff700 1 -- 172.21.15.81:0/2264461663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e400c78e0 msgr2=0x7f6e400698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:01.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e37fff700 1 --2- 172.21.15.81:0/2264461663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e400c78e0 0x7f6e400698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e37fff700 1 -- 172.21.15.81:0/2264461663 >> v1:172.21.15.89:6789/0 conn(0x7f6e40069440 legacy=0x7f6e400c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e37fff700 1 -- 172.21.15.81:0/2264461663 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e400caf50 con 0x7f6e40156420 2023-10-07T08:43:01.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e37fff700 1 -- 172.21.15.81:0/2264461663 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f6e3c001470 con 0x7f6e40156420 2023-10-07T08:43:01.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e37fff700 1 -- 172.21.15.81:0/2264461663 >> v1:172.21.15.81:6789/0 conn(0x7f6e40156420 legacy=0x7f6e400cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e37fff700 1 --2- 172.21.15.81:0/2264461663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e2c003a90 0x7f6e2c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e37fff700 1 --2- 172.21.15.81:0/2264461663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c004810 0x7f6e2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e37fff700 1 --2- 172.21.15.81:0/2264461663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e400c78e0 0x7f6e2c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e37fff700 1 -- 172.21.15.81:0/2264461663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4006aa10 con 0x7f6e2c003a90 2023-10-07T08:43:01.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e37fff700 1 -- 172.21.15.81:0/2264461663 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c00bb60 con 0x7f6e2c004810 2023-10-07T08:43:01.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e37fff700 1 -- 172.21.15.81:0/2264461663 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c00df30 con 0x7f6e400c78e0 2023-10-07T08:43:01.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e4500a700 1 --2- 172.21.15.81:0/2264461663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e2c003a90 0x7f6e2c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e44809700 1 --2- 172.21.15.81:0/2264461663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c004810 0x7f6e2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e4580b700 1 --2- 172.21.15.81:0/2264461663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e400c78e0 0x7f6e2c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e4500a700 1 -- 172.21.15.81:0/2264461663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e400c78e0 msgr2=0x7f6e2c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:01.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e4500a700 1 --2- 172.21.15.81:0/2264461663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e400c78e0 0x7f6e2c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e4500a700 1 -- 172.21.15.81:0/2264461663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c004810 msgr2=0x7f6e2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:01.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e4500a700 1 --2- 172.21.15.81:0/2264461663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c004810 0x7f6e2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e4500a700 1 -- 172.21.15.81:0/2264461663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c003570 con 0x7f6e2c003a90 2023-10-07T08:43:01.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e44809700 1 --2- 172.21.15.81:0/2264461663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c004810 0x7f6e2c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:01.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.821+0000 7f6e4500a700 1 --2- 172.21.15.81:0/2264461663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e2c003a90 0x7f6e2c003ea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00c3c0 tx=0x7f6e3c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1662654dd2488b29 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:01.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.822+0000 7f6e37fff700 1 -- 172.21.15.81:0/2264461663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c00cc90 con 0x7f6e2c003a90 2023-10-07T08:43:01.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.822+0000 7f6e37fff700 1 -- 172.21.15.81:0/2264461663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c00cdf0 con 0x7f6e2c003a90 2023-10-07T08:43:01.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.822+0000 7f6e37fff700 1 -- 172.21.15.81:0/2264461663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c005b50 con 0x7f6e2c003a90 2023-10-07T08:43:01.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.822+0000 7f6e4726e700 1 -- 172.21.15.81:0/2264461663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e2c003a90 msgr2=0x7f6e2c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.822+0000 7f6e4726e700 1 --2- 172.21.15.81:0/2264461663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e2c003a90 0x7f6e2c003ea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00c3c0 tx=0x7f6e3c001e50 comp rx=0 tx=0).stop 2023-10-07T08:43:01.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.822+0000 7f6e4580b700 1 -- 172.21.15.81:0/2264461663 reap_dead start 2023-10-07T08:43:01.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.822+0000 7f6e4726e700 1 -- 172.21.15.81:0/2264461663 shutdown_connections 2023-10-07T08:43:01.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.822+0000 7f6e4726e700 1 -- 172.21.15.81:0/2264461663 >> 172.21.15.81:0/2264461663 conn(0x7f6e4006c660 msgr2=0x7f6e400cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:01.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.822+0000 7f6e4726e700 1 -- 172.21.15.81:0/2264461663 shutdown_connections 2023-10-07T08:43:01.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.822+0000 7f6e4726e700 1 -- 172.21.15.81:0/2264461663 wait complete. 2023-10-07T08:43:01.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.823+0000 7f6e4726e700 1 Processor -- start 2023-10-07T08:43:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.823+0000 7f6e4726e700 1 -- start start 2023-10-07T08:43:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.824+0000 7f6e4726e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e2c003a90 0x7f6e4016b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.824+0000 7f6e4726e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e4014c070 0x7f6e40154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.824+0000 7f6e4726e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e40155080 0x7f6e400b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.824+0000 7f6e4726e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4016b730 con 0x7f6e2c003a90 2023-10-07T08:43:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.824+0000 7f6e4726e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400b1920 con 0x7f6e40155080 2023-10-07T08:43:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.824+0000 7f6e4726e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4014c550 con 0x7f6e4014c070 2023-10-07T08:43:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.824+0000 7f6e4500a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e2c003a90 0x7f6e4016b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.824+0000 7f6e4500a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e2c003a90 0x7f6e4016b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33764/0 (socket says 172.21.15.81:33764) 2023-10-07T08:43:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.824+0000 7f6e4500a700 1 -- 172.21.15.81:0/435079736 learned_addr learned my addr 172.21.15.81:0/435079736 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.824+0000 7f6e4580b700 1 --2- 172.21.15.81:0/435079736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e40155080 0x7f6e400b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.824+0000 7f6e4500a700 1 -- 172.21.15.81:0/435079736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e4014c070 msgr2=0x7f6e40154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.824+0000 7f6e4500a700 1 --2- 172.21.15.81:0/435079736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e4014c070 0x7f6e40154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.824+0000 7f6e4500a700 1 -- 172.21.15.81:0/435079736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e40155080 msgr2=0x7f6e400b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.824+0000 7f6e4500a700 1 --2- 172.21.15.81:0/435079736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e40155080 0x7f6e400b0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.824+0000 7f6e4500a700 1 -- 172.21.15.81:0/435079736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4014c830 con 0x7f6e2c003a90 2023-10-07T08:43:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.825+0000 7f6e4500a700 1 --2- 172.21.15.81:0/435079736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e2c003a90 0x7f6e4016b1f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00bb30 tx=0x7f6e3c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.825+0000 7f6e357fa700 1 -- 172.21.15.81:0/435079736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c00cc90 con 0x7f6e2c003a90 2023-10-07T08:43:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.825+0000 7f6e357fa700 1 -- 172.21.15.81:0/435079736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c0072e0 con 0x7f6e2c003a90 2023-10-07T08:43:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.825+0000 7f6e4726e700 1 -- 172.21.15.81:0/435079736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4014cb10 con 0x7f6e2c003a90 2023-10-07T08:43:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.825+0000 7f6e357fa700 1 -- 172.21.15.81:0/435079736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c001c30 con 0x7f6e2c003a90 2023-10-07T08:43:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.825+0000 7f6e4726e700 1 -- 172.21.15.81:0/435079736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4014d0d0 con 0x7f6e2c003a90 2023-10-07T08:43:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.826+0000 7f6e4726e700 1 -- 172.21.15.81:0/435079736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4014d290 con 0x7f6e2c003a90 2023-10-07T08:43:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.826+0000 7f6e357fa700 1 -- 172.21.15.81:0/435079736 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e3c019070 con 0x7f6e2c003a90 2023-10-07T08:43:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.826+0000 7f6e357fa700 1 --2- 172.21.15.81:0/435079736 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e24066f30 0x7f6e240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.826+0000 7f6e44809700 1 --2- 172.21.15.81:0/435079736 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e24066f30 0x7f6e240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.826+0000 7f6e357fa700 1 -- 172.21.15.81:0/435079736 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6e3c085910 con 0x7f6e2c003a90 2023-10-07T08:43:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.827+0000 7f6e44809700 1 --2- 172.21.15.81:0/435079736 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e24066f30 0x7f6e240693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6e30000c00 tx=0x7f6e30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:01.830+0000 7f6e357fa700 1 -- 172.21.15.81:0/435079736 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e3c052b80 con 0x7f6e2c003a90 2023-10-07T08:43:02.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.008+0000 7f6e4726e700 1 -- 172.21.15.81:0/435079736 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e4016b730 con 0x7f6e24066f30 2023-10-07T08:43:02.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.015+0000 7f6e357fa700 1 -- 172.21.15.81:0/435079736 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260129 (secure 0 0 0) 0x7f6e4016b730 con 0x7f6e24066f30 2023-10-07T08:43:02.020 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:02.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.018+0000 7f6e4726e700 1 -- 172.21.15.81:0/435079736 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e24066f30 msgr2=0x7f6e240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:02.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.018+0000 7f6e4726e700 1 --2- 172.21.15.81:0/435079736 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e24066f30 0x7f6e240693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6e30000c00 tx=0x7f6e30009040 comp rx=0 tx=0).stop 2023-10-07T08:43:02.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.018+0000 7f6e4726e700 1 -- 172.21.15.81:0/435079736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e2c003a90 msgr2=0x7f6e4016b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:02.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.018+0000 7f6e4726e700 1 --2- 172.21.15.81:0/435079736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e2c003a90 0x7f6e4016b1f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00bb30 tx=0x7f6e3c015000 comp rx=0 tx=0).stop 2023-10-07T08:43:02.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.018+0000 7f6e4726e700 1 -- 172.21.15.81:0/435079736 shutdown_connections 2023-10-07T08:43:02.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.018+0000 7f6e4726e700 1 --2- 172.21.15.81:0/435079736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e40155080 0x7f6e400b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.018+0000 7f6e4726e700 1 --2- 172.21.15.81:0/435079736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e2c003a90 0x7f6e4016b1f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.018+0000 7f6e4726e700 1 --2- 172.21.15.81:0/435079736 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e24066f30 0x7f6e240693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.018+0000 7f6e4726e700 1 --2- 172.21.15.81:0/435079736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e4014c070 0x7f6e40154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.018+0000 7f6e4726e700 1 -- 172.21.15.81:0/435079736 >> 172.21.15.81:0/435079736 conn(0x7f6e4006c660 msgr2=0x7f6e4014a920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:02.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.018+0000 7f6e4726e700 1 -- 172.21.15.81:0/435079736 shutdown_connections 2023-10-07T08:43:02.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.018+0000 7f6e4726e700 1 -- 172.21.15.81:0/435079736 wait complete. 2023-10-07T08:43:02.023 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:43:02.031 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-07T08:43:02.006222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560779,"statfs":{"total":1600000000,"available":1598238580,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000933"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271947+0000","last_change":"2023-10-07T08:42:57.271845+0000","last_active":"2023-10-07T08:42:57.271947+0000","last_peered":"2023-10-07T08:42:57.271947+0000","last_clean":"2023-10-07T08:42:57.271947+0000","last_became_active":"2023-10-07T08:42:57.271412+0000","last_became_peered":"2023-10-07T08:42:57.271412+0000","last_unstale":"2023-10-07T08:42:57.271947+0000","last_undegraded":"2023-10-07T08:42:57.271947+0000","last_fullsized":"2023-10-07T08:42:57.271947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:22:57.366438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.253974+0000","last_change":"2023-10-07T08:42:57.253759+0000","last_active":"2023-10-07T08:42:57.253974+0000","last_peered":"2023-10-07T08:42:57.253974+0000","last_clean":"2023-10-07T08:42:57.253974+0000","last_became_active":"2023-10-07T08:42:57.253082+0000","last_became_peered":"2023-10-07T08:42:57.253082+0000","last_unstale":"2023-10-07T08:42:57.253974+0000","last_undegraded":"2023-10-07T08:42:57.253974+0000","last_fullsized":"2023-10-07T08:42:57.253974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.262591+0000","last_change":"2023-10-07T08:42:57.262591+0000","last_active":"2023-10-07T08:42:57.262591+0000","last_peered":"2023-10-07T08:42:57.262591+0000","last_clean":"2023-10-07T08:42:57.262591+0000","last_became_active":"2023-10-07T08:42:57.261995+0000","last_became_peered":"2023-10-07T08:42:57.261995+0000","last_unstale":"2023-10-07T08:42:57.262591+0000","last_undegraded":"2023-10-07T08:42:57.262591+0000","last_fullsized":"2023-10-07T08:42:57.262591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:29:20.004471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271767+0000","last_change":"2023-10-07T08:42:57.269368+0000","last_active":"2023-10-07T08:42:57.271767+0000","last_peered":"2023-10-07T08:42:57.271767+0000","last_clean":"2023-10-07T08:42:57.271767+0000","last_became_active":"2023-10-07T08:42:57.268405+0000","last_became_peered":"2023-10-07T08:42:57.268405+0000","last_unstale":"2023-10-07T08:42:57.271767+0000","last_undegraded":"2023-10-07T08:42:57.271767+0000","last_fullsized":"2023-10-07T08:42:57.271767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.085430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265889+0000","last_change":"2023-10-07T08:42:57.265724+0000","last_active":"2023-10-07T08:42:57.265889+0000","last_peered":"2023-10-07T08:42:57.265889+0000","last_clean":"2023-10-07T08:42:57.265889+0000","last_became_active":"2023-10-07T08:42:57.265407+0000","last_became_peered":"2023-10-07T08:42:57.265407+0000","last_unstale":"2023-10-07T08:42:57.265889+0000","last_undegraded":"2023-10-07T08:42:57.265889+0000","last_fullsized":"2023-10-07T08:42:57.265889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.085430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273257+0000","last_change":"2023-10-07T08:42:57.273165+0000","last_active":"2023-10-07T08:42:57.273257+0000","last_peered":"2023-10-07T08:42:57.273257+0000","last_clean":"2023-10-07T08:42:57.273257+0000","last_became_active":"2023-10-07T08:42:57.272429+0000","last_became_peered":"2023-10-07T08:42:57.272429+0000","last_unstale":"2023-10-07T08:42:57.273257+0000","last_undegraded":"2023-10-07T08:42:57.273257+0000","last_fullsized":"2023-10-07T08:42:57.273257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:07:27.370919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266193+0000","last_change":"2023-10-07T08:42:57.266102+0000","last_active":"2023-10-07T08:42:57.266193+0000","last_peered":"2023-10-07T08:42:57.266193+0000","last_clean":"2023-10-07T08:42:57.266193+0000","last_became_active":"2023-10-07T08:42:57.265848+0000","last_became_peered":"2023-10-07T08:42:57.265848+0000","last_unstale":"2023-10-07T08:42:57.266193+0000","last_undegraded":"2023-10-07T08:42:57.266193+0000","last_fullsized":"2023-10-07T08:42:57.266193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:11:19.626256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.254466+0000","last_change":"2023-10-07T08:42:57.254408+0000","last_active":"2023-10-07T08:42:57.254466+0000","last_peered":"2023-10-07T08:42:57.254466+0000","last_clean":"2023-10-07T08:42:57.254466+0000","last_became_active":"2023-10-07T08:42:57.254176+0000","last_became_peered":"2023-10-07T08:42:57.254176+0000","last_unstale":"2023-10-07T08:42:57.254466+0000","last_undegraded":"2023-10-07T08:42:57.254466+0000","last_fullsized":"2023-10-07T08:42:57.254466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273333+0000","last_change":"2023-10-07T08:42:57.272880+0000","last_active":"2023-10-07T08:42:57.273333+0000","last_peered":"2023-10-07T08:42:57.273333+0000","last_clean":"2023-10-07T08:42:57.273333+0000","last_became_active":"2023-10-07T08:42:57.272657+0000","last_became_peered":"2023-10-07T08:42:57.272657+0000","last_unstale":"2023-10-07T08:42:57.273333+0000","last_undegraded":"2023-10-07T08:42:57.273333+0000","last_fullsized":"2023-10-07T08:42:57.273333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:14.856162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269087+0000","last_change":"2023-10-07T08:42:57.268989+0000","last_active":"2023-10-07T08:42:57.269087+0000","last_peered":"2023-10-07T08:42:57.269087+0000","last_clean":"2023-10-07T08:42:57.269087+0000","last_became_active":"2023-10-07T08:42:57.268767+0000","last_became_peered":"2023-10-07T08:42:57.268767+0000","last_unstale":"2023-10-07T08:42:57.269087+0000","last_undegraded":"2023-10-07T08:42:57.269087+0000","last_fullsized":"2023-10-07T08:42:57.269087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:25:20.586749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273482+0000","last_change":"2023-10-07T08:42:57.273400+0000","last_active":"2023-10-07T08:42:57.273482+0000","last_peered":"2023-10-07T08:42:57.273482+0000","last_clean":"2023-10-07T08:42:57.273482+0000","last_became_active":"2023-10-07T08:42:57.273173+0000","last_became_peered":"2023-10-07T08:42:57.273173+0000","last_unstale":"2023-10-07T08:42:57.273482+0000","last_undegraded":"2023-10-07T08:42:57.273482+0000","last_fullsized":"2023-10-07T08:42:57.273482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261699+0000","last_change":"2023-10-07T08:42:57.261158+0000","last_active":"2023-10-07T08:42:57.261699+0000","last_peered":"2023-10-07T08:42:57.261699+0000","last_clean":"2023-10-07T08:42:57.261699+0000","last_became_active":"2023-10-07T08:42:57.260929+0000","last_became_peered":"2023-10-07T08:42:57.260929+0000","last_unstale":"2023-10-07T08:42:57.261699+0000","last_undegraded":"2023-10-07T08:42:57.261699+0000","last_fullsized":"2023-10-07T08:42:57.261699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:25.788730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261649+0000","last_change":"2023-10-07T08:42:57.261591+0000","last_active":"2023-10-07T08:42:57.261649+0000","last_peered":"2023-10-07T08:42:57.261649+0000","last_clean":"2023-10-07T08:42:57.261649+0000","last_became_active":"2023-10-07T08:42:57.261195+0000","last_became_peered":"2023-10-07T08:42:57.261195+0000","last_unstale":"2023-10-07T08:42:57.261649+0000","last_undegraded":"2023-10-07T08:42:57.261649+0000","last_fullsized":"2023-10-07T08:42:57.261649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.085430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255722+0000","last_change":"2023-10-07T08:42:57.255722+0000","last_active":"2023-10-07T08:42:57.255722+0000","last_peered":"2023-10-07T08:42:57.255722+0000","last_clean":"2023-10-07T08:42:57.255722+0000","last_became_active":"2023-10-07T08:42:57.255058+0000","last_became_peered":"2023-10-07T08:42:57.255058+0000","last_unstale":"2023-10-07T08:42:57.255722+0000","last_undegraded":"2023-10-07T08:42:57.255722+0000","last_fullsized":"2023-10-07T08:42:57.255722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258968+0000","last_change":"2023-10-07T08:42:57.258735+0000","last_active":"2023-10-07T08:42:57.258968+0000","last_peered":"2023-10-07T08:42:57.258968+0000","last_clean":"2023-10-07T08:42:57.258968+0000","last_became_active":"2023-10-07T08:42:57.258531+0000","last_became_peered":"2023-10-07T08:42:57.258531+0000","last_unstale":"2023-10-07T08:42:57.258968+0000","last_undegraded":"2023-10-07T08:42:57.258968+0000","last_fullsized":"2023-10-07T08:42:57.258968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273242+0000","last_change":"2023-10-07T08:42:57.273000+0000","last_active":"2023-10-07T08:42:57.273242+0000","last_peered":"2023-10-07T08:42:57.273242+0000","last_clean":"2023-10-07T08:42:57.273242+0000","last_became_active":"2023-10-07T08:42:57.272147+0000","last_became_peered":"2023-10-07T08:42:57.272147+0000","last_unstale":"2023-10-07T08:42:57.273242+0000","last_undegraded":"2023-10-07T08:42:57.273242+0000","last_fullsized":"2023-10-07T08:42:57.273242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273615+0000","last_change":"2023-10-07T08:42:57.273534+0000","last_active":"2023-10-07T08:42:57.273615+0000","last_peered":"2023-10-07T08:42:57.273615+0000","last_clean":"2023-10-07T08:42:57.273615+0000","last_became_active":"2023-10-07T08:42:57.272752+0000","last_became_peered":"2023-10-07T08:42:57.272752+0000","last_unstale":"2023-10-07T08:42:57.273615+0000","last_undegraded":"2023-10-07T08:42:57.273615+0000","last_fullsized":"2023-10-07T08:42:57.273615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:14.856162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260472+0000","last_change":"2023-10-07T08:42:57.260016+0000","last_active":"2023-10-07T08:42:57.260472+0000","last_peered":"2023-10-07T08:42:57.260472+0000","last_clean":"2023-10-07T08:42:57.260472+0000","last_became_active":"2023-10-07T08:42:57.259796+0000","last_became_peered":"2023-10-07T08:42:57.259796+0000","last_unstale":"2023-10-07T08:42:57.260472+0000","last_undegraded":"2023-10-07T08:42:57.260472+0000","last_fullsized":"2023-10-07T08:42:57.260472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:44.958113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271244+0000","last_change":"2023-10-07T08:42:57.266814+0000","last_active":"2023-10-07T08:42:57.271244+0000","last_peered":"2023-10-07T08:42:57.271244+0000","last_clean":"2023-10-07T08:42:57.271244+0000","last_became_active":"2023-10-07T08:42:57.266212+0000","last_became_peered":"2023-10-07T08:42:57.266212+0000","last_unstale":"2023-10-07T08:42:57.271244+0000","last_undegraded":"2023-10-07T08:42:57.271244+0000","last_fullsized":"2023-10-07T08:42:57.271244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:56.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265520+0000","last_change":"2023-10-07T08:42:56.259068+0000","last_active":"2023-10-07T08:42:57.265520+0000","last_peered":"2023-10-07T08:42:57.265520+0000","last_clean":"2023-10-07T08:42:57.265520+0000","last_became_active":"2023-10-07T08:42:56.258934+0000","last_became_peered":"2023-10-07T08:42:56.258934+0000","last_unstale":"2023-10-07T08:42:57.265520+0000","last_undegraded":"2023-10-07T08:42:57.265520+0000","last_fullsized":"2023-10-07T08:42:57.265520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264519+0000","last_change":"2023-10-07T08:42:57.264466+0000","last_active":"2023-10-07T08:42:57.264519+0000","last_peered":"2023-10-07T08:42:57.264519+0000","last_clean":"2023-10-07T08:42:57.264519+0000","last_became_active":"2023-10-07T08:42:57.263468+0000","last_became_peered":"2023-10-07T08:42:57.263468+0000","last_unstale":"2023-10-07T08:42:57.264519+0000","last_undegraded":"2023-10-07T08:42:57.264519+0000","last_fullsized":"2023-10-07T08:42:57.264519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:07.393104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264975+0000","last_change":"2023-10-07T08:42:56.257405+0000","last_active":"2023-10-07T08:42:57.264975+0000","last_peered":"2023-10-07T08:42:57.264975+0000","last_clean":"2023-10-07T08:42:57.264975+0000","last_became_active":"2023-10-07T08:42:56.257065+0000","last_became_peered":"2023-10-07T08:42:56.257065+0000","last_unstale":"2023-10-07T08:42:57.264975+0000","last_undegraded":"2023-10-07T08:42:57.264975+0000","last_fullsized":"2023-10-07T08:42:57.264975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267485+0000","last_change":"2023-10-07T08:42:57.267485+0000","last_active":"2023-10-07T08:42:57.267485+0000","last_peered":"2023-10-07T08:42:57.267485+0000","last_clean":"2023-10-07T08:42:57.267485+0000","last_became_active":"2023-10-07T08:42:57.267277+0000","last_became_peered":"2023-10-07T08:42:57.267277+0000","last_unstale":"2023-10-07T08:42:57.267485+0000","last_undegraded":"2023-10-07T08:42:57.267485+0000","last_fullsized":"2023-10-07T08:42:57.267485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:13:34.785663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271811+0000","last_change":"2023-10-07T08:42:56.260298+0000","last_active":"2023-10-07T08:42:57.271811+0000","last_peered":"2023-10-07T08:42:57.271811+0000","last_clean":"2023-10-07T08:42:57.271811+0000","last_became_active":"2023-10-07T08:42:56.260074+0000","last_became_peered":"2023-10-07T08:42:56.260074+0000","last_unstale":"2023-10-07T08:42:57.271811+0000","last_undegraded":"2023-10-07T08:42:57.271811+0000","last_fullsized":"2023-10-07T08:42:57.271811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:00:57.309769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273224+0000","last_change":"2023-10-07T08:42:57.272854+0000","last_active":"2023-10-07T08:42:57.273224+0000","last_peered":"2023-10-07T08:42:57.273224+0000","last_clean":"2023-10-07T08:42:57.273224+0000","last_became_active":"2023-10-07T08:42:57.271880+0000","last_became_peered":"2023-10-07T08:42:57.271880+0000","last_unstale":"2023-10-07T08:42:57.273224+0000","last_undegraded":"2023-10-07T08:42:57.273224+0000","last_fullsized":"2023-10-07T08:42:57.273224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:11:19.626256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273211+0000","last_change":"2023-10-07T08:42:56.263017+0000","last_active":"2023-10-07T08:42:57.273211+0000","last_peered":"2023-10-07T08:42:57.273211+0000","last_clean":"2023-10-07T08:42:57.273211+0000","last_became_active":"2023-10-07T08:42:56.262769+0000","last_became_peered":"2023-10-07T08:42:56.262769+0000","last_unstale":"2023-10-07T08:42:57.273211+0000","last_undegraded":"2023-10-07T08:42:57.273211+0000","last_fullsized":"2023-10-07T08:42:57.273211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:35:43.604383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271875+0000","last_change":"2023-10-07T08:42:57.271009+0000","last_active":"2023-10-07T08:42:57.271875+0000","last_peered":"2023-10-07T08:42:57.271875+0000","last_clean":"2023-10-07T08:42:57.271875+0000","last_became_active":"2023-10-07T08:42:57.270777+0000","last_became_peered":"2023-10-07T08:42:57.270777+0000","last_unstale":"2023-10-07T08:42:57.271875+0000","last_undegraded":"2023-10-07T08:42:57.271875+0000","last_fullsized":"2023-10-07T08:42:57.271875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261893+0000","last_change":"2023-10-07T08:42:56.257276+0000","last_active":"2023-10-07T08:42:57.261893+0000","last_peered":"2023-10-07T08:42:57.261893+0000","last_clean":"2023-10-07T08:42:57.261893+0000","last_became_active":"2023-10-07T08:42:56.257051+0000","last_became_peered":"2023-10-07T08:42:56.257051+0000","last_unstale":"2023-10-07T08:42:57.261893+0000","last_undegraded":"2023-10-07T08:42:57.261893+0000","last_fullsized":"2023-10-07T08:42:57.261893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.256705+0000","last_change":"2023-10-07T08:42:57.256645+0000","last_active":"2023-10-07T08:42:57.256705+0000","last_peered":"2023-10-07T08:42:57.256705+0000","last_clean":"2023-10-07T08:42:57.256705+0000","last_became_active":"2023-10-07T08:42:57.256312+0000","last_became_peered":"2023-10-07T08:42:57.256312+0000","last_unstale":"2023-10-07T08:42:57.256705+0000","last_undegraded":"2023-10-07T08:42:57.256705+0000","last_fullsized":"2023-10-07T08:42:57.256705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:44.958113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261595+0000","last_change":"2023-10-07T08:42:56.256216+0000","last_active":"2023-10-07T08:42:57.261595+0000","last_peered":"2023-10-07T08:42:57.261595+0000","last_clean":"2023-10-07T08:42:57.261595+0000","last_became_active":"2023-10-07T08:42:56.255763+0000","last_became_peered":"2023-10-07T08:42:56.255763+0000","last_unstale":"2023-10-07T08:42:57.261595+0000","last_undegraded":"2023-10-07T08:42:57.261595+0000","last_fullsized":"2023-10-07T08:42:57.261595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260111+0000","last_change":"2023-10-07T08:42:57.260111+0000","last_active":"2023-10-07T08:42:57.260111+0000","last_peered":"2023-10-07T08:42:57.260111+0000","last_clean":"2023-10-07T08:42:57.260111+0000","last_became_active":"2023-10-07T08:42:57.259887+0000","last_became_peered":"2023-10-07T08:42:57.259887+0000","last_unstale":"2023-10-07T08:42:57.260111+0000","last_undegraded":"2023-10-07T08:42:57.260111+0000","last_fullsized":"2023-10-07T08:42:57.260111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:07.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.249477+0000","last_change":"2023-10-07T08:42:56.256584+0000","last_active":"2023-10-07T08:42:57.249477+0000","last_peered":"2023-10-07T08:42:57.249477+0000","last_clean":"2023-10-07T08:42:57.249477+0000","last_became_active":"2023-10-07T08:42:56.256306+0000","last_became_peered":"2023-10-07T08:42:56.256306+0000","last_unstale":"2023-10-07T08:42:57.249477+0000","last_undegraded":"2023-10-07T08:42:57.249477+0000","last_fullsized":"2023-10-07T08:42:57.249477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255482+0000","last_change":"2023-10-07T08:42:57.255428+0000","last_active":"2023-10-07T08:42:57.255482+0000","last_peered":"2023-10-07T08:42:57.255482+0000","last_clean":"2023-10-07T08:42:57.255482+0000","last_became_active":"2023-10-07T08:42:57.255284+0000","last_became_peered":"2023-10-07T08:42:57.255284+0000","last_unstale":"2023-10-07T08:42:57.255482+0000","last_undegraded":"2023-10-07T08:42:57.255482+0000","last_fullsized":"2023-10-07T08:42:57.255482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267031+0000","last_change":"2023-10-07T08:42:56.260669+0000","last_active":"2023-10-07T08:42:57.267031+0000","last_peered":"2023-10-07T08:42:57.267031+0000","last_clean":"2023-10-07T08:42:57.267031+0000","last_became_active":"2023-10-07T08:42:56.260436+0000","last_became_peered":"2023-10-07T08:42:56.260436+0000","last_unstale":"2023-10-07T08:42:57.267031+0000","last_undegraded":"2023-10-07T08:42:57.267031+0000","last_fullsized":"2023-10-07T08:42:57.267031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:47:14.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.257501+0000","last_change":"2023-10-07T08:42:57.257451+0000","last_active":"2023-10-07T08:42:57.257501+0000","last_peered":"2023-10-07T08:42:57.257501+0000","last_clean":"2023-10-07T08:42:57.257501+0000","last_became_active":"2023-10-07T08:42:57.257263+0000","last_became_peered":"2023-10-07T08:42:57.257263+0000","last_unstale":"2023-10-07T08:42:57.257501+0000","last_undegraded":"2023-10-07T08:42:57.257501+0000","last_fullsized":"2023-10-07T08:42:57.257501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255592+0000","last_change":"2023-10-07T08:42:56.261241+0000","last_active":"2023-10-07T08:42:57.255592+0000","last_peered":"2023-10-07T08:42:57.255592+0000","last_clean":"2023-10-07T08:42:57.255592+0000","last_became_active":"2023-10-07T08:42:56.261003+0000","last_became_peered":"2023-10-07T08:42:56.261003+0000","last_unstale":"2023-10-07T08:42:57.255592+0000","last_undegraded":"2023-10-07T08:42:57.255592+0000","last_fullsized":"2023-10-07T08:42:57.255592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273393+0000","last_change":"2023-10-07T08:42:57.273272+0000","last_active":"2023-10-07T08:42:57.273393+0000","last_peered":"2023-10-07T08:42:57.273393+0000","last_clean":"2023-10-07T08:42:57.273393+0000","last_became_active":"2023-10-07T08:42:57.272090+0000","last_became_peered":"2023-10-07T08:42:57.272090+0000","last_unstale":"2023-10-07T08:42:57.273393+0000","last_undegraded":"2023-10-07T08:42:57.273393+0000","last_fullsized":"2023-10-07T08:42:57.273393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:48.342893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255238+0000","last_change":"2023-10-07T08:42:56.260346+0000","last_active":"2023-10-07T08:42:57.255238+0000","last_peered":"2023-10-07T08:42:57.255238+0000","last_clean":"2023-10-07T08:42:57.255238+0000","last_became_active":"2023-10-07T08:42:56.259661+0000","last_became_peered":"2023-10-07T08:42:56.259661+0000","last_unstale":"2023-10-07T08:42:57.255238+0000","last_undegraded":"2023-10-07T08:42:57.255238+0000","last_fullsized":"2023-10-07T08:42:57.255238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:21.295203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273913+0000","last_change":"2023-10-07T08:42:57.273913+0000","last_active":"2023-10-07T08:42:57.273913+0000","last_peered":"2023-10-07T08:42:57.273913+0000","last_clean":"2023-10-07T08:42:57.273913+0000","last_became_active":"2023-10-07T08:42:57.273631+0000","last_became_peered":"2023-10-07T08:42:57.273631+0000","last_unstale":"2023-10-07T08:42:57.273913+0000","last_undegraded":"2023-10-07T08:42:57.273913+0000","last_fullsized":"2023-10-07T08:42:57.273913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:07.393104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271888+0000","last_change":"2023-10-07T08:42:56.257713+0000","last_active":"2023-10-07T08:42:57.271888+0000","last_peered":"2023-10-07T08:42:57.271888+0000","last_clean":"2023-10-07T08:42:57.271888+0000","last_became_active":"2023-10-07T08:42:56.257481+0000","last_became_peered":"2023-10-07T08:42:56.257481+0000","last_unstale":"2023-10-07T08:42:57.271888+0000","last_undegraded":"2023-10-07T08:42:57.271888+0000","last_fullsized":"2023-10-07T08:42:57.271888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:43.953599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266459+0000","last_change":"2023-10-07T08:42:57.266396+0000","last_active":"2023-10-07T08:42:57.266459+0000","last_peered":"2023-10-07T08:42:57.266459+0000","last_clean":"2023-10-07T08:42:57.266459+0000","last_became_active":"2023-10-07T08:42:57.266029+0000","last_became_peered":"2023-10-07T08:42:57.266029+0000","last_unstale":"2023-10-07T08:42:57.266459+0000","last_undegraded":"2023-10-07T08:42:57.266459+0000","last_fullsized":"2023-10-07T08:42:57.266459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:22.299718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269611+0000","last_change":"2023-10-07T08:42:56.259429+0000","last_active":"2023-10-07T08:42:57.269611+0000","last_peered":"2023-10-07T08:42:57.269611+0000","last_clean":"2023-10-07T08:42:57.269611+0000","last_became_active":"2023-10-07T08:42:56.259154+0000","last_became_peered":"2023-10-07T08:42:56.259154+0000","last_unstale":"2023-10-07T08:42:57.269611+0000","last_undegraded":"2023-10-07T08:42:57.269611+0000","last_fullsized":"2023-10-07T08:42:57.269611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265027+0000","last_change":"2023-10-07T08:42:57.262943+0000","last_active":"2023-10-07T08:42:57.265027+0000","last_peered":"2023-10-07T08:42:57.265027+0000","last_clean":"2023-10-07T08:42:57.265027+0000","last_became_active":"2023-10-07T08:42:57.262707+0000","last_became_peered":"2023-10-07T08:42:57.262707+0000","last_unstale":"2023-10-07T08:42:57.265027+0000","last_undegraded":"2023-10-07T08:42:57.265027+0000","last_fullsized":"2023-10-07T08:42:57.265027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267652+0000","last_change":"2023-10-07T08:42:56.250565+0000","last_active":"2023-10-07T08:42:57.267652+0000","last_peered":"2023-10-07T08:42:57.267652+0000","last_clean":"2023-10-07T08:42:57.267652+0000","last_became_active":"2023-10-07T08:42:56.250326+0000","last_became_peered":"2023-10-07T08:42:56.250326+0000","last_unstale":"2023-10-07T08:42:57.267652+0000","last_undegraded":"2023-10-07T08:42:57.267652+0000","last_fullsized":"2023-10-07T08:42:57.267652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.263608+0000","last_change":"2023-10-07T08:42:57.263608+0000","last_active":"2023-10-07T08:42:57.263608+0000","last_peered":"2023-10-07T08:42:57.263608+0000","last_clean":"2023-10-07T08:42:57.263608+0000","last_became_active":"2023-10-07T08:42:57.262971+0000","last_became_peered":"2023-10-07T08:42:57.262971+0000","last_unstale":"2023-10-07T08:42:57.263608+0000","last_undegraded":"2023-10-07T08:42:57.263608+0000","last_fullsized":"2023-10-07T08:42:57.263608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269407+0000","last_change":"2023-10-07T08:42:56.262332+0000","last_active":"2023-10-07T08:42:57.269407+0000","last_peered":"2023-10-07T08:42:57.269407+0000","last_clean":"2023-10-07T08:42:57.269407+0000","last_became_active":"2023-10-07T08:42:56.261913+0000","last_became_peered":"2023-10-07T08:42:56.261913+0000","last_unstale":"2023-10-07T08:42:57.269407+0000","last_undegraded":"2023-10-07T08:42:57.269407+0000","last_fullsized":"2023-10-07T08:42:57.269407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:47.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273297+0000","last_change":"2023-10-07T08:42:57.271943+0000","last_active":"2023-10-07T08:42:57.273297+0000","last_peered":"2023-10-07T08:42:57.273297+0000","last_clean":"2023-10-07T08:42:57.273297+0000","last_became_active":"2023-10-07T08:42:57.271217+0000","last_became_peered":"2023-10-07T08:42:57.271217+0000","last_unstale":"2023-10-07T08:42:57.273297+0000","last_undegraded":"2023-10-07T08:42:57.273297+0000","last_fullsized":"2023-10-07T08:42:57.273297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:07:27.370919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.259993+0000","last_change":"2023-10-07T08:42:56.259497+0000","last_active":"2023-10-07T08:42:57.259993+0000","last_peered":"2023-10-07T08:42:57.259993+0000","last_clean":"2023-10-07T08:42:57.259993+0000","last_became_active":"2023-10-07T08:42:56.259259+0000","last_became_peered":"2023-10-07T08:42:56.259259+0000","last_unstale":"2023-10-07T08:42:57.259993+0000","last_undegraded":"2023-10-07T08:42:57.259993+0000","last_fullsized":"2023-10-07T08:42:57.259993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:47.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267342+0000","last_change":"2023-10-07T08:42:57.264611+0000","last_active":"2023-10-07T08:42:57.267342+0000","last_peered":"2023-10-07T08:42:57.267342+0000","last_clean":"2023-10-07T08:42:57.267342+0000","last_became_active":"2023-10-07T08:42:57.264371+0000","last_became_peered":"2023-10-07T08:42:57.264371+0000","last_unstale":"2023-10-07T08:42:57.267342+0000","last_undegraded":"2023-10-07T08:42:57.267342+0000","last_fullsized":"2023-10-07T08:42:57.267342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.262375+0000","last_change":"2023-10-07T08:42:56.254762+0000","last_active":"2023-10-07T08:42:57.262375+0000","last_peered":"2023-10-07T08:42:57.262375+0000","last_clean":"2023-10-07T08:42:57.262375+0000","last_became_active":"2023-10-07T08:42:56.254460+0000","last_became_peered":"2023-10-07T08:42:56.254460+0000","last_unstale":"2023-10-07T08:42:57.262375+0000","last_undegraded":"2023-10-07T08:42:57.262375+0000","last_fullsized":"2023-10-07T08:42:57.262375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265088+0000","last_change":"2023-10-07T08:42:57.264712+0000","last_active":"2023-10-07T08:42:57.265088+0000","last_peered":"2023-10-07T08:42:57.265088+0000","last_clean":"2023-10-07T08:42:57.265088+0000","last_became_active":"2023-10-07T08:42:57.264380+0000","last_became_peered":"2023-10-07T08:42:57.264380+0000","last_unstale":"2023-10-07T08:42:57.265088+0000","last_undegraded":"2023-10-07T08:42:57.265088+0000","last_fullsized":"2023-10-07T08:42:57.265088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:48.342893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.257527+0000","last_change":"2023-10-07T08:42:56.253642+0000","last_active":"2023-10-07T08:42:57.257527+0000","last_peered":"2023-10-07T08:42:57.257527+0000","last_clean":"2023-10-07T08:42:57.257527+0000","last_became_active":"2023-10-07T08:42:56.253183+0000","last_became_peered":"2023-10-07T08:42:56.253183+0000","last_unstale":"2023-10-07T08:42:57.257527+0000","last_undegraded":"2023-10-07T08:42:57.257527+0000","last_fullsized":"2023-10-07T08:42:57.257527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:35.495354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273316+0000","last_change":"2023-10-07T08:42:57.272080+0000","last_active":"2023-10-07T08:42:57.273316+0000","last_peered":"2023-10-07T08:42:57.273316+0000","last_clean":"2023-10-07T08:42:57.273316+0000","last_became_active":"2023-10-07T08:42:57.271505+0000","last_became_peered":"2023-10-07T08:42:57.271505+0000","last_unstale":"2023-10-07T08:42:57.273316+0000","last_undegraded":"2023-10-07T08:42:57.273316+0000","last_fullsized":"2023-10-07T08:42:57.273316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:29.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.251426+0000","last_change":"2023-10-07T08:42:56.253289+0000","last_active":"2023-10-07T08:42:57.251426+0000","last_peered":"2023-10-07T08:42:57.251426+0000","last_clean":"2023-10-07T08:42:57.251426+0000","last_became_active":"2023-10-07T08:42:56.253058+0000","last_became_peered":"2023-10-07T08:42:56.253058+0000","last_unstale":"2023-10-07T08:42:57.251426+0000","last_undegraded":"2023-10-07T08:42:57.251426+0000","last_fullsized":"2023-10-07T08:42:57.251426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271749+0000","last_change":"2023-10-07T08:42:57.269245+0000","last_active":"2023-10-07T08:42:57.271749+0000","last_peered":"2023-10-07T08:42:57.271749+0000","last_clean":"2023-10-07T08:42:57.271749+0000","last_became_active":"2023-10-07T08:42:57.268139+0000","last_became_peered":"2023-10-07T08:42:57.268139+0000","last_unstale":"2023-10-07T08:42:57.271749+0000","last_undegraded":"2023-10-07T08:42:57.271749+0000","last_fullsized":"2023-10-07T08:42:57.271749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:56.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255341+0000","last_change":"2023-10-07T08:42:56.262012+0000","last_active":"2023-10-07T08:42:57.255341+0000","last_peered":"2023-10-07T08:42:57.255341+0000","last_clean":"2023-10-07T08:42:57.255341+0000","last_became_active":"2023-10-07T08:42:56.261812+0000","last_became_peered":"2023-10-07T08:42:56.261812+0000","last_unstale":"2023-10-07T08:42:57.255341+0000","last_undegraded":"2023-10-07T08:42:57.255341+0000","last_fullsized":"2023-10-07T08:42:57.255341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:43.953599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264986+0000","last_change":"2023-10-07T08:42:57.264887+0000","last_active":"2023-10-07T08:42:57.264986+0000","last_peered":"2023-10-07T08:42:57.264986+0000","last_clean":"2023-10-07T08:42:57.264986+0000","last_became_active":"2023-10-07T08:42:57.264651+0000","last_became_peered":"2023-10-07T08:42:57.264651+0000","last_unstale":"2023-10-07T08:42:57.264986+0000","last_undegraded":"2023-10-07T08:42:57.264986+0000","last_fullsized":"2023-10-07T08:42:57.264986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:32.698757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.252401+0000","last_change":"2023-10-07T08:42:57.252321+0000","last_active":"2023-10-07T08:42:57.252401+0000","last_peered":"2023-10-07T08:42:57.252401+0000","last_clean":"2023-10-07T08:42:57.252401+0000","last_became_active":"2023-10-07T08:42:57.252102+0000","last_became_peered":"2023-10-07T08:42:57.252102+0000","last_unstale":"2023-10-07T08:42:57.252401+0000","last_undegraded":"2023-10-07T08:42:57.252401+0000","last_fullsized":"2023-10-07T08:42:57.252401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:07.393104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.250654+0000","last_change":"2023-10-07T08:42:56.255406+0000","last_active":"2023-10-07T08:42:57.250654+0000","last_peered":"2023-10-07T08:42:57.250654+0000","last_clean":"2023-10-07T08:42:57.250654+0000","last_became_active":"2023-10-07T08:42:56.255167+0000","last_became_peered":"2023-10-07T08:42:56.255167+0000","last_unstale":"2023-10-07T08:42:57.250654+0000","last_undegraded":"2023-10-07T08:42:57.250654+0000","last_fullsized":"2023-10-07T08:42:57.250654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.268877+0000","last_change":"2023-10-07T08:42:57.268830+0000","last_active":"2023-10-07T08:42:57.268877+0000","last_peered":"2023-10-07T08:42:57.268877+0000","last_clean":"2023-10-07T08:42:57.268877+0000","last_became_active":"2023-10-07T08:42:57.268514+0000","last_became_peered":"2023-10-07T08:42:57.268514+0000","last_unstale":"2023-10-07T08:42:57.268877+0000","last_undegraded":"2023-10-07T08:42:57.268877+0000","last_fullsized":"2023-10-07T08:42:57.268877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:56.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269521+0000","last_change":"2023-10-07T08:42:56.262059+0000","last_active":"2023-10-07T08:42:57.269521+0000","last_peered":"2023-10-07T08:42:57.269521+0000","last_clean":"2023-10-07T08:42:57.269521+0000","last_became_active":"2023-10-07T08:42:56.260888+0000","last_became_peered":"2023-10-07T08:42:56.260888+0000","last_unstale":"2023-10-07T08:42:57.269521+0000","last_undegraded":"2023-10-07T08:42:57.269521+0000","last_fullsized":"2023-10-07T08:42:57.269521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.262180+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:42:57.262180+0000","last_peered":"2023-10-07T08:42:57.262180+0000","last_clean":"2023-10-07T08:42:57.262180+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:42:57.262180+0000","last_undegraded":"2023-10-07T08:42:57.262180+0000","last_fullsized":"2023-10-07T08:42:57.262180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.262498+0000","last_change":"2023-10-07T08:42:57.262498+0000","last_active":"2023-10-07T08:42:57.262498+0000","last_peered":"2023-10-07T08:42:57.262498+0000","last_clean":"2023-10-07T08:42:57.262498+0000","last_became_active":"2023-10-07T08:42:57.261704+0000","last_became_peered":"2023-10-07T08:42:57.261704+0000","last_unstale":"2023-10-07T08:42:57.262498+0000","last_undegraded":"2023-10-07T08:42:57.262498+0000","last_fullsized":"2023-10-07T08:42:57.262498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260276+0000","last_change":"2023-10-07T08:42:56.259333+0000","last_active":"2023-10-07T08:42:57.260276+0000","last_peered":"2023-10-07T08:42:57.260276+0000","last_clean":"2023-10-07T08:42:57.260276+0000","last_became_active":"2023-10-07T08:42:56.259178+0000","last_became_peered":"2023-10-07T08:42:56.259178+0000","last_unstale":"2023-10-07T08:42:57.260276+0000","last_undegraded":"2023-10-07T08:42:57.260276+0000","last_fullsized":"2023-10-07T08:42:57.260276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:43.953599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260369+0000","last_change":"2023-10-07T08:42:56.262061+0000","last_active":"2023-10-07T08:42:57.260369+0000","last_peered":"2023-10-07T08:42:57.260369+0000","last_clean":"2023-10-07T08:42:57.260369+0000","last_became_active":"2023-10-07T08:42:56.261842+0000","last_became_peered":"2023-10-07T08:42:56.261842+0000","last_unstale":"2023-10-07T08:42:57.260369+0000","last_undegraded":"2023-10-07T08:42:57.260369+0000","last_fullsized":"2023-10-07T08:42:57.260369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.254098+0000","last_change":"2023-10-07T08:42:57.253993+0000","last_active":"2023-10-07T08:42:57.254098+0000","last_peered":"2023-10-07T08:42:57.254098+0000","last_clean":"2023-10-07T08:42:57.254098+0000","last_became_active":"2023-10-07T08:42:57.253775+0000","last_became_peered":"2023-10-07T08:42:57.253775+0000","last_unstale":"2023-10-07T08:42:57.254098+0000","last_undegraded":"2023-10-07T08:42:57.254098+0000","last_fullsized":"2023-10-07T08:42:57.254098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-07T08:42:58.827418+0000","last_change":"2023-10-07T08:42:56.256312+0000","last_active":"2023-10-07T08:42:58.827418+0000","last_peered":"2023-10-07T08:42:58.827418+0000","last_clean":"2023-10-07T08:42:58.827418+0000","last_became_active":"2023-10-07T08:42:56.256095+0000","last_became_peered":"2023-10-07T08:42:56.256095+0000","last_unstale":"2023-10-07T08:42:58.827418+0000","last_undegraded":"2023-10-07T08:42:58.827418+0000","last_fullsized":"2023-10-07T08:42:58.827418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:21.295203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266691+0000","last_change":"2023-10-07T08:42:57.266642+0000","last_active":"2023-10-07T08:42:57.266691+0000","last_peered":"2023-10-07T08:42:57.266691+0000","last_clean":"2023-10-07T08:42:57.266691+0000","last_became_active":"2023-10-07T08:42:57.266480+0000","last_became_peered":"2023-10-07T08:42:57.266480+0000","last_unstale":"2023-10-07T08:42:57.266691+0000","last_undegraded":"2023-10-07T08:42:57.266691+0000","last_fullsized":"2023-10-07T08:42:57.266691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:07.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271789+0000","last_change":"2023-10-07T08:42:56.257795+0000","last_active":"2023-10-07T08:42:57.271789+0000","last_peered":"2023-10-07T08:42:57.271789+0000","last_clean":"2023-10-07T08:42:57.271789+0000","last_became_active":"2023-10-07T08:42:56.257560+0000","last_became_peered":"2023-10-07T08:42:56.257560+0000","last_unstale":"2023-10-07T08:42:57.271789+0000","last_undegraded":"2023-10-07T08:42:57.271789+0000","last_fullsized":"2023-10-07T08:42:57.271789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.262219+0000","last_change":"2023-10-07T08:42:57.262219+0000","last_active":"2023-10-07T08:42:57.262219+0000","last_peered":"2023-10-07T08:42:57.262219+0000","last_clean":"2023-10-07T08:42:57.262219+0000","last_became_active":"2023-10-07T08:42:57.261413+0000","last_became_peered":"2023-10-07T08:42:57.261413+0000","last_unstale":"2023-10-07T08:42:57.262219+0000","last_undegraded":"2023-10-07T08:42:57.262219+0000","last_fullsized":"2023-10-07T08:42:57.262219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:25:20.586749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261906+0000","last_change":"2023-10-07T08:42:56.258484+0000","last_active":"2023-10-07T08:42:57.261906+0000","last_peered":"2023-10-07T08:42:57.261906+0000","last_clean":"2023-10-07T08:42:57.261906+0000","last_became_active":"2023-10-07T08:42:56.258243+0000","last_became_peered":"2023-10-07T08:42:56.258243+0000","last_unstale":"2023-10-07T08:42:57.261906+0000","last_undegraded":"2023-10-07T08:42:57.261906+0000","last_fullsized":"2023-10-07T08:42:57.261906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:24.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258408+0000","last_change":"2023-10-07T08:42:57.258345+0000","last_active":"2023-10-07T08:42:57.258408+0000","last_peered":"2023-10-07T08:42:57.258408+0000","last_clean":"2023-10-07T08:42:57.258408+0000","last_became_active":"2023-10-07T08:42:57.257563+0000","last_became_peered":"2023-10-07T08:42:57.257563+0000","last_unstale":"2023-10-07T08:42:57.258408+0000","last_undegraded":"2023-10-07T08:42:57.258408+0000","last_fullsized":"2023-10-07T08:42:57.258408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:00:58.314283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.251512+0000","last_change":"2023-10-07T08:42:56.259479+0000","last_active":"2023-10-07T08:42:57.251512+0000","last_peered":"2023-10-07T08:42:57.251512+0000","last_clean":"2023-10-07T08:42:57.251512+0000","last_became_active":"2023-10-07T08:42:56.259257+0000","last_became_peered":"2023-10-07T08:42:56.259257+0000","last_unstale":"2023-10-07T08:42:57.251512+0000","last_undegraded":"2023-10-07T08:42:57.251512+0000","last_fullsized":"2023-10-07T08:42:57.251512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:00:57.309769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.253038+0000","last_change":"2023-10-07T08:42:57.252823+0000","last_active":"2023-10-07T08:42:57.253038+0000","last_peered":"2023-10-07T08:42:57.253038+0000","last_clean":"2023-10-07T08:42:57.253038+0000","last_became_active":"2023-10-07T08:42:57.252606+0000","last_became_peered":"2023-10-07T08:42:57.252606+0000","last_unstale":"2023-10-07T08:42:57.253038+0000","last_undegraded":"2023-10-07T08:42:57.253038+0000","last_fullsized":"2023-10-07T08:42:57.253038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:25.788730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.251872+0000","last_change":"2023-10-07T08:42:56.255715+0000","last_active":"2023-10-07T08:42:57.251872+0000","last_peered":"2023-10-07T08:42:57.251872+0000","last_clean":"2023-10-07T08:42:57.251872+0000","last_became_active":"2023-10-07T08:42:56.255502+0000","last_became_peered":"2023-10-07T08:42:56.255502+0000","last_unstale":"2023-10-07T08:42:57.251872+0000","last_undegraded":"2023-10-07T08:42:57.251872+0000","last_fullsized":"2023-10-07T08:42:57.251872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:47:14.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261586+0000","last_change":"2023-10-07T08:42:57.261460+0000","last_active":"2023-10-07T08:42:57.261586+0000","last_peered":"2023-10-07T08:42:57.261586+0000","last_clean":"2023-10-07T08:42:57.261586+0000","last_became_active":"2023-10-07T08:42:57.260893+0000","last_became_peered":"2023-10-07T08:42:57.260893+0000","last_unstale":"2023-10-07T08:42:57.261586+0000","last_undegraded":"2023-10-07T08:42:57.261586+0000","last_fullsized":"2023-10-07T08:42:57.261586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273745+0000","last_change":"2023-10-07T08:42:56.258635+0000","last_active":"2023-10-07T08:42:57.273745+0000","last_peered":"2023-10-07T08:42:57.273745+0000","last_clean":"2023-10-07T08:42:57.273745+0000","last_became_active":"2023-10-07T08:42:56.258323+0000","last_became_peered":"2023-10-07T08:42:56.258323+0000","last_unstale":"2023-10-07T08:42:57.273745+0000","last_undegraded":"2023-10-07T08:42:57.273745+0000","last_fullsized":"2023-10-07T08:42:57.273745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260549+0000","last_change":"2023-10-07T08:42:57.259849+0000","last_active":"2023-10-07T08:42:57.260549+0000","last_peered":"2023-10-07T08:42:57.260549+0000","last_clean":"2023-10-07T08:42:57.260549+0000","last_became_active":"2023-10-07T08:42:57.259625+0000","last_became_peered":"2023-10-07T08:42:57.259625+0000","last_unstale":"2023-10-07T08:42:57.260549+0000","last_undegraded":"2023-10-07T08:42:57.260549+0000","last_fullsized":"2023-10-07T08:42:57.260549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.250640+0000","last_change":"2023-10-07T08:42:56.260384+0000","last_active":"2023-10-07T08:42:57.250640+0000","last_peered":"2023-10-07T08:42:57.250640+0000","last_clean":"2023-10-07T08:42:57.250640+0000","last_became_active":"2023-10-07T08:42:56.260141+0000","last_became_peered":"2023-10-07T08:42:56.260141+0000","last_unstale":"2023-10-07T08:42:57.250640+0000","last_undegraded":"2023-10-07T08:42:57.250640+0000","last_fullsized":"2023-10-07T08:42:57.250640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.274600+0000","last_change":"2023-10-07T08:42:57.273820+0000","last_active":"2023-10-07T08:42:57.274600+0000","last_peered":"2023-10-07T08:42:57.274600+0000","last_clean":"2023-10-07T08:42:57.274600+0000","last_became_active":"2023-10-07T08:42:57.273591+0000","last_became_peered":"2023-10-07T08:42:57.273591+0000","last_unstale":"2023-10-07T08:42:57.274600+0000","last_undegraded":"2023-10-07T08:42:57.274600+0000","last_fullsized":"2023-10-07T08:42:57.274600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:56.744706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261775+0000","last_change":"2023-10-07T08:42:56.253272+0000","last_active":"2023-10-07T08:42:57.261775+0000","last_peered":"2023-10-07T08:42:57.261775+0000","last_clean":"2023-10-07T08:42:57.261775+0000","last_became_active":"2023-10-07T08:42:56.253029+0000","last_became_peered":"2023-10-07T08:42:56.253029+0000","last_unstale":"2023-10-07T08:42:57.261775+0000","last_undegraded":"2023-10-07T08:42:57.261775+0000","last_fullsized":"2023-10-07T08:42:57.261775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:47.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266923+0000","last_change":"2023-10-07T08:42:57.266372+0000","last_active":"2023-10-07T08:42:57.266923+0000","last_peered":"2023-10-07T08:42:57.266923+0000","last_clean":"2023-10-07T08:42:57.266923+0000","last_became_active":"2023-10-07T08:42:57.266237+0000","last_became_peered":"2023-10-07T08:42:57.266237+0000","last_unstale":"2023-10-07T08:42:57.266923+0000","last_undegraded":"2023-10-07T08:42:57.266923+0000","last_fullsized":"2023-10-07T08:42:57.266923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:29.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264466+0000","last_change":"2023-10-07T08:42:56.257581+0000","last_active":"2023-10-07T08:42:57.264466+0000","last_peered":"2023-10-07T08:42:57.264466+0000","last_clean":"2023-10-07T08:42:57.264466+0000","last_became_active":"2023-10-07T08:42:56.257339+0000","last_became_peered":"2023-10-07T08:42:56.257339+0000","last_unstale":"2023-10-07T08:42:57.264466+0000","last_undegraded":"2023-10-07T08:42:57.264466+0000","last_fullsized":"2023-10-07T08:42:57.264466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:40.492004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266968+0000","last_change":"2023-10-07T08:42:57.266483+0000","last_active":"2023-10-07T08:42:57.266968+0000","last_peered":"2023-10-07T08:42:57.266968+0000","last_clean":"2023-10-07T08:42:57.266968+0000","last_became_active":"2023-10-07T08:42:57.265437+0000","last_became_peered":"2023-10-07T08:42:57.265437+0000","last_unstale":"2023-10-07T08:42:57.266968+0000","last_undegraded":"2023-10-07T08:42:57.266968+0000","last_fullsized":"2023-10-07T08:42:57.266968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:38.758746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260567+0000","last_change":"2023-10-07T08:42:57.260425+0000","last_active":"2023-10-07T08:42:57.260567+0000","last_peered":"2023-10-07T08:42:57.260567+0000","last_clean":"2023-10-07T08:42:57.260567+0000","last_became_active":"2023-10-07T08:42:57.260226+0000","last_became_peered":"2023-10-07T08:42:57.260226+0000","last_unstale":"2023-10-07T08:42:57.260567+0000","last_undegraded":"2023-10-07T08:42:57.260567+0000","last_fullsized":"2023-10-07T08:42:57.260567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273197+0000","last_change":"2023-10-07T08:42:57.273144+0000","last_active":"2023-10-07T08:42:57.273197+0000","last_peered":"2023-10-07T08:42:57.273197+0000","last_clean":"2023-10-07T08:42:57.273197+0000","last_became_active":"2023-10-07T08:42:57.273008+0000","last_became_peered":"2023-10-07T08:42:57.273008+0000","last_unstale":"2023-10-07T08:42:57.273197+0000","last_undegraded":"2023-10-07T08:42:57.273197+0000","last_fullsized":"2023-10-07T08:42:57.273197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:22.299718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271790+0000","last_change":"2023-10-07T08:42:57.270102+0000","last_active":"2023-10-07T08:42:57.271790+0000","last_peered":"2023-10-07T08:42:57.271790+0000","last_clean":"2023-10-07T08:42:57.271790+0000","last_became_active":"2023-10-07T08:42:57.269871+0000","last_became_peered":"2023-10-07T08:42:57.269871+0000","last_unstale":"2023-10-07T08:42:57.271790+0000","last_undegraded":"2023-10-07T08:42:57.271790+0000","last_fullsized":"2023-10-07T08:42:57.271790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:22:57.366438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255880+0000","last_change":"2023-10-07T08:42:57.255880+0000","last_active":"2023-10-07T08:42:57.255880+0000","last_peered":"2023-10-07T08:42:57.255880+0000","last_clean":"2023-10-07T08:42:57.255880+0000","last_became_active":"2023-10-07T08:42:57.255498+0000","last_became_peered":"2023-10-07T08:42:57.255498+0000","last_unstale":"2023-10-07T08:42:57.255880+0000","last_undegraded":"2023-10-07T08:42:57.255880+0000","last_fullsized":"2023-10-07T08:42:57.255880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258178+0000","last_change":"2023-10-07T08:42:57.257694+0000","last_active":"2023-10-07T08:42:57.258178+0000","last_peered":"2023-10-07T08:42:57.258178+0000","last_clean":"2023-10-07T08:42:57.258178+0000","last_became_active":"2023-10-07T08:42:57.257200+0000","last_became_peered":"2023-10-07T08:42:57.257200+0000","last_unstale":"2023-10-07T08:42:57.258178+0000","last_undegraded":"2023-10-07T08:42:57.258178+0000","last_fullsized":"2023-10-07T08:42:57.258178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.253992+0000","last_change":"2023-10-07T08:42:57.253904+0000","last_active":"2023-10-07T08:42:57.253992+0000","last_peered":"2023-10-07T08:42:57.253992+0000","last_clean":"2023-10-07T08:42:57.253992+0000","last_became_active":"2023-10-07T08:42:57.253374+0000","last_became_peered":"2023-10-07T08:42:57.253374+0000","last_unstale":"2023-10-07T08:42:57.253992+0000","last_undegraded":"2023-10-07T08:42:57.253992+0000","last_fullsized":"2023-10-07T08:42:57.253992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267322+0000","last_change":"2023-10-07T08:42:57.264162+0000","last_active":"2023-10-07T08:42:57.267322+0000","last_peered":"2023-10-07T08:42:57.267322+0000","last_clean":"2023-10-07T08:42:57.267322+0000","last_became_active":"2023-10-07T08:42:57.263947+0000","last_became_peered":"2023-10-07T08:42:57.263947+0000","last_unstale":"2023-10-07T08:42:57.267322+0000","last_undegraded":"2023-10-07T08:42:57.267322+0000","last_fullsized":"2023-10-07T08:42:57.267322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:07.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.256643+0000","last_change":"2023-10-07T08:42:57.256601+0000","last_active":"2023-10-07T08:42:57.256643+0000","last_peered":"2023-10-07T08:42:57.256643+0000","last_clean":"2023-10-07T08:42:57.256643+0000","last_became_active":"2023-10-07T08:42:57.256421+0000","last_became_peered":"2023-10-07T08:42:57.256421+0000","last_unstale":"2023-10-07T08:42:57.256643+0000","last_undegraded":"2023-10-07T08:42:57.256643+0000","last_fullsized":"2023-10-07T08:42:57.256643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271714+0000","last_change":"2023-10-07T08:42:57.268643+0000","last_active":"2023-10-07T08:42:57.271714+0000","last_peered":"2023-10-07T08:42:57.271714+0000","last_clean":"2023-10-07T08:42:57.271714+0000","last_became_active":"2023-10-07T08:42:57.267817+0000","last_became_peered":"2023-10-07T08:42:57.267817+0000","last_unstale":"2023-10-07T08:42:57.271714+0000","last_undegraded":"2023-10-07T08:42:57.271714+0000","last_fullsized":"2023-10-07T08:42:57.271714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258195+0000","last_change":"2023-10-07T08:42:57.257831+0000","last_active":"2023-10-07T08:42:57.258195+0000","last_peered":"2023-10-07T08:42:57.258195+0000","last_clean":"2023-10-07T08:42:57.258195+0000","last_became_active":"2023-10-07T08:42:57.257484+0000","last_became_peered":"2023-10-07T08:42:57.257484+0000","last_unstale":"2023-10-07T08:42:57.258195+0000","last_undegraded":"2023-10-07T08:42:57.258195+0000","last_fullsized":"2023-10-07T08:42:57.258195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273509+0000","last_change":"2023-10-07T08:42:57.273405+0000","last_active":"2023-10-07T08:42:57.273509+0000","last_peered":"2023-10-07T08:42:57.273509+0000","last_clean":"2023-10-07T08:42:57.273509+0000","last_became_active":"2023-10-07T08:42:57.272454+0000","last_became_peered":"2023-10-07T08:42:57.272454+0000","last_unstale":"2023-10-07T08:42:57.273509+0000","last_undegraded":"2023-10-07T08:42:57.273509+0000","last_fullsized":"2023-10-07T08:42:57.273509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:38.758746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.263789+0000","last_change":"2023-10-07T08:42:57.263789+0000","last_active":"2023-10-07T08:42:57.263789+0000","last_peered":"2023-10-07T08:42:57.263789+0000","last_clean":"2023-10-07T08:42:57.263789+0000","last_became_active":"2023-10-07T08:42:57.263348+0000","last_became_peered":"2023-10-07T08:42:57.263348+0000","last_unstale":"2023-10-07T08:42:57.263789+0000","last_undegraded":"2023-10-07T08:42:57.263789+0000","last_fullsized":"2023-10-07T08:42:57.263789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260531+0000","last_change":"2023-10-07T08:42:57.259213+0000","last_active":"2023-10-07T08:42:57.260531+0000","last_peered":"2023-10-07T08:42:57.260531+0000","last_clean":"2023-10-07T08:42:57.260531+0000","last_became_active":"2023-10-07T08:42:57.258976+0000","last_became_peered":"2023-10-07T08:42:57.258976+0000","last_unstale":"2023-10-07T08:42:57.260531+0000","last_undegraded":"2023-10-07T08:42:57.260531+0000","last_fullsized":"2023-10-07T08:42:57.260531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:29:20.004471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194668,"statfs":{"total":200000000,"available":199340213,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929599,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924687,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194668,"statfs":{"total":200000000,"available":199340157,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924847,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199923311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931009,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924757,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]}],"pool_statfs":[]}} 2023-10-07T08:43:02.038 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-07T08:43:02.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.182+0000 7fbd13893700 1 Processor -- start 2023-10-07T08:43:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.182+0000 7fbd13893700 1 -- start start 2023-10-07T08:43:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.183+0000 7fbd13893700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbd0c15a2f0 0x7fbd0c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.183+0000 7fbd13893700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd0c0cc760 0x7fbd0c0c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.183+0000 7fbd13893700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd0c0c9710 0x7fbd0c06cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.183+0000 7fbd13893700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c15a6c0 con 0x7fbd0c0c9710 2023-10-07T08:43:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.183+0000 7fbd13893700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c0b1550 con 0x7fbd0c15a2f0 2023-10-07T08:43:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.183+0000 7fbd13893700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c0ce6b0 con 0x7fbd0c0cc760 2023-10-07T08:43:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.183+0000 7fbd11e30700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd0c0c9710 0x7fbd0c06cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.183+0000 7fbd11e30700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd0c0c9710 0x7fbd0c06cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33778/0 (socket says 172.21.15.81:33778) 2023-10-07T08:43:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.183+0000 7fbd11e30700 1 -- 172.21.15.81:0/3675531128 learned_addr learned my addr 172.21.15.81:0/3675531128 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.183+0000 7fbd1162f700 1 --2- 172.21.15.81:0/3675531128 >> v2:172.21.15.89:3300/0 conn(0x7fbd0c15a2f0 0x7fbd0c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.183+0000 7fbd10e2e700 1 --2- 172.21.15.81:0/3675531128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd0c0cc760 0x7fbd0c0c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd11e30700 1 -- 172.21.15.81:0/3675531128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd0c0cc760 msgr2=0x7fbd0c0c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd11e30700 1 --2- 172.21.15.81:0/3675531128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd0c0cc760 0x7fbd0c0c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd11e30700 1 -- 172.21.15.81:0/3675531128 >> v2:172.21.15.89:3300/0 conn(0x7fbd0c15a2f0 msgr2=0x7fbd0c0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd11e30700 1 --2- 172.21.15.81:0/3675531128 >> v2:172.21.15.89:3300/0 conn(0x7fbd0c15a2f0 0x7fbd0c0cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd11e30700 1 -- 172.21.15.81:0/3675531128 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c0ce0a0 con 0x7fbd0c0c9710 2023-10-07T08:43:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd1162f700 1 --2- 172.21.15.81:0/3675531128 >> v2:172.21.15.89:3300/0 conn(0x7fbd0c15a2f0 0x7fbd0c0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd11e30700 1 --2- 172.21.15.81:0/3675531128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd0c0c9710 0x7fbd0c06cca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c06a960 tx=0x7fbd04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb532e00b6989ca1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd03fff700 1 -- 172.21.15.81:0/3675531128 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0400b860 con 0x7fbd0c0c9710 2023-10-07T08:43:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd03fff700 1 -- 172.21.15.81:0/3675531128 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0400b9c0 con 0x7fbd0c0c9710 2023-10-07T08:43:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd03fff700 1 -- 172.21.15.81:0/3675531128 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0400bd60 con 0x7fbd0c0c9710 2023-10-07T08:43:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd13893700 1 -- 172.21.15.81:0/3675531128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd0c0c9710 msgr2=0x7fbd0c06cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd13893700 1 --2- 172.21.15.81:0/3675531128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd0c0c9710 0x7fbd0c06cca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c06a960 tx=0x7fbd04009250 comp rx=0 tx=0).stop 2023-10-07T08:43:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd13893700 1 -- 172.21.15.81:0/3675531128 shutdown_connections 2023-10-07T08:43:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd13893700 1 --2- 172.21.15.81:0/3675531128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd0c0c9710 0x7fbd0c06cca0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd13893700 1 --2- 172.21.15.81:0/3675531128 >> v2:172.21.15.89:3300/0 conn(0x7fbd0c15a2f0 0x7fbd0c0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd13893700 1 --2- 172.21.15.81:0/3675531128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd0c0cc760 0x7fbd0c0c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd13893700 1 -- 172.21.15.81:0/3675531128 >> 172.21.15.81:0/3675531128 conn(0x7fbd0c067640 msgr2=0x7fbd0c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd13893700 1 -- 172.21.15.81:0/3675531128 shutdown_connections 2023-10-07T08:43:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.184+0000 7fbd13893700 1 -- 172.21.15.81:0/3675531128 wait complete. 2023-10-07T08:43:02.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.185+0000 7fbd13893700 1 Processor -- start 2023-10-07T08:43:02.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.186+0000 7fbd13893700 1 -- start start 2023-10-07T08:43:02.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.186+0000 7fbd13893700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd0c0c9710 0x7fbd0c16ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:02.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.186+0000 7fbd13893700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd0c0cc760 0x7fbd0c1467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.186+0000 7fbd13893700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd0c15a2f0 0x7fbd0c1569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.186+0000 7fbd13893700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c0b1930 con 0x7fbd0c0cc760 2023-10-07T08:43:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.186+0000 7fbd13893700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c16b1b0 con 0x7fbd0c0c9710 2023-10-07T08:43:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.186+0000 7fbd13893700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c15c810 con 0x7fbd0c15a2f0 2023-10-07T08:43:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.187+0000 7fbd10e2e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd0c0cc760 0x7fbd0c1467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.187+0000 7fbd10e2e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd0c0cc760 0x7fbd0c1467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33782/0 (socket says 172.21.15.81:33782) 2023-10-07T08:43:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.187+0000 7fbd10e2e700 1 -- 172.21.15.81:0/355347001 learned_addr learned my addr 172.21.15.81:0/355347001 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.187+0000 7fbd1162f700 1 --2- 172.21.15.81:0/355347001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd0c0c9710 0x7fbd0c16ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.187+0000 7fbd11e30700 1 --2- 172.21.15.81:0/355347001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd0c15a2f0 0x7fbd0c1569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.187+0000 7fbd10e2e700 1 -- 172.21.15.81:0/355347001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd0c15a2f0 msgr2=0x7fbd0c1569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.187+0000 7fbd10e2e700 1 --2- 172.21.15.81:0/355347001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd0c15a2f0 0x7fbd0c1569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.187+0000 7fbd10e2e700 1 -- 172.21.15.81:0/355347001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd0c0c9710 msgr2=0x7fbd0c16ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.187+0000 7fbd10e2e700 1 --2- 172.21.15.81:0/355347001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd0c0c9710 0x7fbd0c16ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.187+0000 7fbd10e2e700 1 -- 172.21.15.81:0/355347001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd040094f0 con 0x7fbd0c0cc760 2023-10-07T08:43:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.187+0000 7fbd10e2e700 1 --2- 172.21.15.81:0/355347001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd0c0cc760 0x7fbd0c1467b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00d890 tx=0x7fbcfc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.187+0000 7fbd017fa700 1 -- 172.21.15.81:0/355347001 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc0125f0 con 0x7fbd0c0cc760 2023-10-07T08:43:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.187+0000 7fbd017fa700 1 -- 172.21.15.81:0/355347001 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcfc012750 con 0x7fbd0c0cc760 2023-10-07T08:43:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.187+0000 7fbd13893700 1 -- 172.21.15.81:0/355347001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0c15caf0 con 0x7fbd0c0cc760 2023-10-07T08:43:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.187+0000 7fbd017fa700 1 -- 172.21.15.81:0/355347001 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc012af0 con 0x7fbd0c0cc760 2023-10-07T08:43:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.187+0000 7fbd13893700 1 -- 172.21.15.81:0/355347001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0c15d0b0 con 0x7fbd0c0cc760 2023-10-07T08:43:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.188+0000 7fbd13893700 1 -- 172.21.15.81:0/355347001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd0c069bd0 con 0x7fbd0c0cc760 2023-10-07T08:43:02.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.188+0000 7fbd017fa700 1 -- 172.21.15.81:0/355347001 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbcfc01e460 con 0x7fbd0c0cc760 2023-10-07T08:43:02.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.189+0000 7fbd017fa700 1 --2- 172.21.15.81:0/355347001 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbcf0066f30 0x7fbcf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:02.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.189+0000 7fbd017fa700 1 -- 172.21.15.81:0/355347001 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbcfc084a60 con 0x7fbd0c0cc760 2023-10-07T08:43:02.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.189+0000 7fbd1162f700 1 --2- 172.21.15.81:0/355347001 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbcf0066f30 0x7fbcf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:02.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.189+0000 7fbd1162f700 1 --2- 172.21.15.81:0/355347001 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbcf0066f30 0x7fbcf00693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbd08007740 tx=0x7fbd080099d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:02.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.193+0000 7fbd017fa700 1 -- 172.21.15.81:0/355347001 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbcfc051cd0 con 0x7fbd0c0cc760 2023-10-07T08:43:02.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.451+0000 7fbd13893700 1 -- 172.21.15.81:0/355347001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbd0c06e7f0 con 0x7fbd0c0cc760 2023-10-07T08:43:02.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.451+0000 7fbd017fa700 1 -- 172.21.15.81:0/355347001 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1006 (secure 0 0 0) 0x7fbcfc0552f0 con 0x7fbd0c0cc760 2023-10-07T08:43:02.453 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:02.453 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1696668164,"num_in_osds":8,"osd_in_since":1696668161,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592674,"bytes_used":1761420,"bytes_avail":1598238580,"bytes_total":1600000000,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4273}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-07T08:42:38.481027+0000","services":{}},"progress_events":{}} 2023-10-07T08:43:02.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.453+0000 7fbd13893700 1 -- 172.21.15.81:0/355347001 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbcf0066f30 msgr2=0x7fbcf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:02.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.453+0000 7fbd13893700 1 --2- 172.21.15.81:0/355347001 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbcf0066f30 0x7fbcf00693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbd08007740 tx=0x7fbd080099d0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.453+0000 7fbd13893700 1 -- 172.21.15.81:0/355347001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd0c0cc760 msgr2=0x7fbd0c1467b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:02.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.453+0000 7fbd13893700 1 --2- 172.21.15.81:0/355347001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd0c0cc760 0x7fbd0c1467b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00d890 tx=0x7fbcfc008040 comp rx=0 tx=0).stop 2023-10-07T08:43:02.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.453+0000 7fbd13893700 1 -- 172.21.15.81:0/355347001 shutdown_connections 2023-10-07T08:43:02.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.453+0000 7fbd13893700 1 --2- 172.21.15.81:0/355347001 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbcf0066f30 0x7fbcf00693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.453+0000 7fbd13893700 1 --2- 172.21.15.81:0/355347001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd0c15a2f0 0x7fbd0c1569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.453+0000 7fbd13893700 1 --2- 172.21.15.81:0/355347001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd0c0c9710 0x7fbd0c16ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.453+0000 7fbd13893700 1 --2- 172.21.15.81:0/355347001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd0c0cc760 0x7fbd0c1467b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.453+0000 7fbd13893700 1 -- 172.21.15.81:0/355347001 >> 172.21.15.81:0/355347001 conn(0x7fbd0c067640 msgr2=0x7fbd0c0cc050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.453+0000 7fbd13893700 1 -- 172.21.15.81:0/355347001 shutdown_connections 2023-10-07T08:43:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.453+0000 7fbd13893700 1 -- 172.21.15.81:0/355347001 wait complete. 2023-10-07T08:43:02.466 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-07T08:43:02.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:43:02.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.579+0000 7fb376f69700 1 Processor -- start 2023-10-07T08:43:02.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.579+0000 7fb376f69700 1 -- start start 2023-10-07T08:43:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb376f69700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb3700add30 0x7fb3700b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb376f69700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb370067640 0x7fb370067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb376f69700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3700ce890 0x7fb3700ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb376f69700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3700b37b0 con 0x7fb370067640 2023-10-07T08:43:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb376f69700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3700cf250 con 0x7fb3700add30 2023-10-07T08:43:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb376f69700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb370067ff0 con 0x7fb3700ce890 2023-10-07T08:43:02.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb375766700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb370067640 0x7fb370067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:02.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb375766700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb370067640 0x7fb370067ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44754/0 (socket says 172.21.15.81:44754) 2023-10-07T08:43:02.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb375766700 1 -- 172.21.15.81:0/3048832255 learned_addr learned my addr 172.21.15.81:0/3048832255 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:02.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb375f67700 1 --2- 172.21.15.81:0/3048832255 >> v2:172.21.15.89:3300/0 conn(0x7fb3700add30 0x7fb3700b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:02.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb376768700 1 --2- 172.21.15.81:0/3048832255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3700ce890 0x7fb3700ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:02.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb375766700 1 -- 172.21.15.81:0/3048832255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3700ce890 msgr2=0x7fb3700ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:02.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb375766700 1 --2- 172.21.15.81:0/3048832255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3700ce890 0x7fb3700ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb375766700 1 -- 172.21.15.81:0/3048832255 >> v2:172.21.15.89:3300/0 conn(0x7fb3700add30 msgr2=0x7fb3700b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb375766700 1 --2- 172.21.15.81:0/3048832255 >> v2:172.21.15.89:3300/0 conn(0x7fb3700add30 0x7fb3700b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb375766700 1 -- 172.21.15.81:0/3048832255 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3700b17c0 con 0x7fb370067640 2023-10-07T08:43:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb375f67700 1 --2- 172.21.15.81:0/3048832255 >> v2:172.21.15.89:3300/0 conn(0x7fb3700add30 0x7fb3700b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb376768700 1 --2- 172.21.15.81:0/3048832255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3700ce890 0x7fb3700ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.580+0000 7fb375766700 1 --2- 172.21.15.81:0/3048832255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb370067640 0x7fb370067ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb37006a0f0 tx=0x7fb360009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509d1bf2b2b884e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.581+0000 7fb374f65700 1 -- 172.21.15.81:0/3048832255 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36000b820 con 0x7fb370067640 2023-10-07T08:43:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.581+0000 7fb374f65700 1 -- 172.21.15.81:0/3048832255 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36000b980 con 0x7fb370067640 2023-10-07T08:43:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.581+0000 7fb374f65700 1 -- 172.21.15.81:0/3048832255 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36000bd20 con 0x7fb370067640 2023-10-07T08:43:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.581+0000 7fb376f69700 1 -- 172.21.15.81:0/3048832255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb370067640 msgr2=0x7fb370067ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.581+0000 7fb376f69700 1 --2- 172.21.15.81:0/3048832255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb370067640 0x7fb370067ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb37006a0f0 tx=0x7fb360009250 comp rx=0 tx=0).stop 2023-10-07T08:43:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.581+0000 7fb376f69700 1 -- 172.21.15.81:0/3048832255 shutdown_connections 2023-10-07T08:43:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.581+0000 7fb376f69700 1 --2- 172.21.15.81:0/3048832255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3700ce890 0x7fb3700ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.581+0000 7fb376f69700 1 --2- 172.21.15.81:0/3048832255 >> v2:172.21.15.89:3300/0 conn(0x7fb3700add30 0x7fb3700b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.581+0000 7fb376f69700 1 --2- 172.21.15.81:0/3048832255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb370067640 0x7fb370067ab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.581+0000 7fb376f69700 1 -- 172.21.15.81:0/3048832255 >> 172.21.15.81:0/3048832255 conn(0x7fb37006c620 msgr2=0x7fb37006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.581+0000 7fb376f69700 1 -- 172.21.15.81:0/3048832255 shutdown_connections 2023-10-07T08:43:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.581+0000 7fb376f69700 1 -- 172.21.15.81:0/3048832255 wait complete. 2023-10-07T08:43:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.582+0000 7fb376f69700 1 Processor -- start 2023-10-07T08:43:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.582+0000 7fb376f69700 1 -- start start 2023-10-07T08:43:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb376f69700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb370067640 0x7fb370156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb376f69700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3700add30 0x7fb3700a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb376f69700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3700ce890 0x7fb37015da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb376f69700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700a9870 con 0x7fb3700ce890 2023-10-07T08:43:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb376f69700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700a9b50 con 0x7fb370067640 2023-10-07T08:43:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb376f69700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700a9e30 con 0x7fb3700add30 2023-10-07T08:43:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb376768700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3700ce890 0x7fb37015da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:02.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb376768700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3700ce890 0x7fb37015da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44756/0 (socket says 172.21.15.81:44756) 2023-10-07T08:43:02.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb376768700 1 -- 172.21.15.81:0/1770069356 learned_addr learned my addr 172.21.15.81:0/1770069356 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:02.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb375f67700 1 --2- 172.21.15.81:0/1770069356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb370067640 0x7fb370156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:02.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb375766700 1 --2- 172.21.15.81:0/1770069356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3700add30 0x7fb3700a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:02.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb376768700 1 -- 172.21.15.81:0/1770069356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3700add30 msgr2=0x7fb3700a8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:02.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb376768700 1 --2- 172.21.15.81:0/1770069356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3700add30 0x7fb3700a8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb376768700 1 -- 172.21.15.81:0/1770069356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb370067640 msgr2=0x7fb370156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:02.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb376768700 1 --2- 172.21.15.81:0/1770069356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb370067640 0x7fb370156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb376768700 1 -- 172.21.15.81:0/1770069356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3600094f0 con 0x7fb3700ce890 2023-10-07T08:43:02.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.583+0000 7fb376768700 1 --2- 172.21.15.81:0/1770069356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3700ce890 0x7fb37015da70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00c880 tx=0x7fb36c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:02.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.584+0000 7fb365ffb700 1 -- 172.21.15.81:0/1770069356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c011600 con 0x7fb3700ce890 2023-10-07T08:43:02.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.584+0000 7fb365ffb700 1 -- 172.21.15.81:0/1770069356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36c011760 con 0x7fb3700ce890 2023-10-07T08:43:02.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.584+0000 7fb376f69700 1 -- 172.21.15.81:0/1770069356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3700aa110 con 0x7fb3700ce890 2023-10-07T08:43:02.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.584+0000 7fb365ffb700 1 -- 172.21.15.81:0/1770069356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c011b20 con 0x7fb3700ce890 2023-10-07T08:43:02.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.584+0000 7fb376f69700 1 -- 172.21.15.81:0/1770069356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3701684d0 con 0x7fb3700ce890 2023-10-07T08:43:02.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.585+0000 7fb376f69700 1 -- 172.21.15.81:0/1770069356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb370069920 con 0x7fb3700ce890 2023-10-07T08:43:02.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.585+0000 7fb365ffb700 1 -- 172.21.15.81:0/1770069356 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb36c0193b0 con 0x7fb3700ce890 2023-10-07T08:43:02.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.585+0000 7fb365ffb700 1 --2- 172.21.15.81:0/1770069356 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb354066f30 0x7fb3540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:02.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.585+0000 7fb365ffb700 1 -- 172.21.15.81:0/1770069356 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb36c084110 con 0x7fb3700ce890 2023-10-07T08:43:02.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.585+0000 7fb375f67700 1 --2- 172.21.15.81:0/1770069356 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb354066f30 0x7fb3540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:02.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.586+0000 7fb375f67700 1 --2- 172.21.15.81:0/1770069356 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb354066f30 0x7fb3540693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb368007fd0 tx=0x7fb3680077c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:02.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.590+0000 7fb365ffb700 1 -- 172.21.15.81:0/1770069356 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb36c054e10 con 0x7fb3700ce890 2023-10-07T08:43:02.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.769+0000 7fb376f69700 1 -- 172.21.15.81:0/1770069356 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb370071b10 con 0x7fb354066f30 2023-10-07T08:43:02.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.776+0000 7fb365ffb700 1 -- 172.21.15.81:0/1770069356 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260129 (secure 0 0 0) 0x7fb370071b10 con 0x7fb354066f30 2023-10-07T08:43:02.780 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:02.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.779+0000 7fb376f69700 1 -- 172.21.15.81:0/1770069356 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb354066f30 msgr2=0x7fb3540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:02.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.779+0000 7fb376f69700 1 --2- 172.21.15.81:0/1770069356 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb354066f30 0x7fb3540693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb368007fd0 tx=0x7fb3680077c0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.779+0000 7fb376f69700 1 -- 172.21.15.81:0/1770069356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3700ce890 msgr2=0x7fb37015da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:02.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.779+0000 7fb376f69700 1 --2- 172.21.15.81:0/1770069356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3700ce890 0x7fb37015da70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00c880 tx=0x7fb36c008040 comp rx=0 tx=0).stop 2023-10-07T08:43:02.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.779+0000 7fb376f69700 1 -- 172.21.15.81:0/1770069356 shutdown_connections 2023-10-07T08:43:02.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.779+0000 7fb376f69700 1 --2- 172.21.15.81:0/1770069356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3700ce890 0x7fb37015da70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.779+0000 7fb376f69700 1 --2- 172.21.15.81:0/1770069356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb370067640 0x7fb370156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.779+0000 7fb376f69700 1 --2- 172.21.15.81:0/1770069356 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb354066f30 0x7fb3540693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.779+0000 7fb376f69700 1 --2- 172.21.15.81:0/1770069356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3700add30 0x7fb3700a8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:02.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.779+0000 7fb376f69700 1 -- 172.21.15.81:0/1770069356 >> 172.21.15.81:0/1770069356 conn(0x7fb37006c620 msgr2=0x7fb3700af790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:02.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.779+0000 7fb376f69700 1 -- 172.21.15.81:0/1770069356 shutdown_connections 2023-10-07T08:43:02.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:02.779+0000 7fb376f69700 1 -- 172.21.15.81:0/1770069356 wait complete. 2023-10-07T08:43:02.784 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:43:02.792 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-07T08:43:02.006222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560779,"statfs":{"total":1600000000,"available":1598238580,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000933"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271947+0000","last_change":"2023-10-07T08:42:57.271845+0000","last_active":"2023-10-07T08:42:57.271947+0000","last_peered":"2023-10-07T08:42:57.271947+0000","last_clean":"2023-10-07T08:42:57.271947+0000","last_became_active":"2023-10-07T08:42:57.271412+0000","last_became_peered":"2023-10-07T08:42:57.271412+0000","last_unstale":"2023-10-07T08:42:57.271947+0000","last_undegraded":"2023-10-07T08:42:57.271947+0000","last_fullsized":"2023-10-07T08:42:57.271947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:22:57.366438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.253974+0000","last_change":"2023-10-07T08:42:57.253759+0000","last_active":"2023-10-07T08:42:57.253974+0000","last_peered":"2023-10-07T08:42:57.253974+0000","last_clean":"2023-10-07T08:42:57.253974+0000","last_became_active":"2023-10-07T08:42:57.253082+0000","last_became_peered":"2023-10-07T08:42:57.253082+0000","last_unstale":"2023-10-07T08:42:57.253974+0000","last_undegraded":"2023-10-07T08:42:57.253974+0000","last_fullsized":"2023-10-07T08:42:57.253974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.262591+0000","last_change":"2023-10-07T08:42:57.262591+0000","last_active":"2023-10-07T08:42:57.262591+0000","last_peered":"2023-10-07T08:42:57.262591+0000","last_clean":"2023-10-07T08:42:57.262591+0000","last_became_active":"2023-10-07T08:42:57.261995+0000","last_became_peered":"2023-10-07T08:42:57.261995+0000","last_unstale":"2023-10-07T08:42:57.262591+0000","last_undegraded":"2023-10-07T08:42:57.262591+0000","last_fullsized":"2023-10-07T08:42:57.262591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:29:20.004471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271767+0000","last_change":"2023-10-07T08:42:57.269368+0000","last_active":"2023-10-07T08:42:57.271767+0000","last_peered":"2023-10-07T08:42:57.271767+0000","last_clean":"2023-10-07T08:42:57.271767+0000","last_became_active":"2023-10-07T08:42:57.268405+0000","last_became_peered":"2023-10-07T08:42:57.268405+0000","last_unstale":"2023-10-07T08:42:57.271767+0000","last_undegraded":"2023-10-07T08:42:57.271767+0000","last_fullsized":"2023-10-07T08:42:57.271767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.085430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265889+0000","last_change":"2023-10-07T08:42:57.265724+0000","last_active":"2023-10-07T08:42:57.265889+0000","last_peered":"2023-10-07T08:42:57.265889+0000","last_clean":"2023-10-07T08:42:57.265889+0000","last_became_active":"2023-10-07T08:42:57.265407+0000","last_became_peered":"2023-10-07T08:42:57.265407+0000","last_unstale":"2023-10-07T08:42:57.265889+0000","last_undegraded":"2023-10-07T08:42:57.265889+0000","last_fullsized":"2023-10-07T08:42:57.265889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.085430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273257+0000","last_change":"2023-10-07T08:42:57.273165+0000","last_active":"2023-10-07T08:42:57.273257+0000","last_peered":"2023-10-07T08:42:57.273257+0000","last_clean":"2023-10-07T08:42:57.273257+0000","last_became_active":"2023-10-07T08:42:57.272429+0000","last_became_peered":"2023-10-07T08:42:57.272429+0000","last_unstale":"2023-10-07T08:42:57.273257+0000","last_undegraded":"2023-10-07T08:42:57.273257+0000","last_fullsized":"2023-10-07T08:42:57.273257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:07:27.370919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266193+0000","last_change":"2023-10-07T08:42:57.266102+0000","last_active":"2023-10-07T08:42:57.266193+0000","last_peered":"2023-10-07T08:42:57.266193+0000","last_clean":"2023-10-07T08:42:57.266193+0000","last_became_active":"2023-10-07T08:42:57.265848+0000","last_became_peered":"2023-10-07T08:42:57.265848+0000","last_unstale":"2023-10-07T08:42:57.266193+0000","last_undegraded":"2023-10-07T08:42:57.266193+0000","last_fullsized":"2023-10-07T08:42:57.266193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:11:19.626256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.254466+0000","last_change":"2023-10-07T08:42:57.254408+0000","last_active":"2023-10-07T08:42:57.254466+0000","last_peered":"2023-10-07T08:42:57.254466+0000","last_clean":"2023-10-07T08:42:57.254466+0000","last_became_active":"2023-10-07T08:42:57.254176+0000","last_became_peered":"2023-10-07T08:42:57.254176+0000","last_unstale":"2023-10-07T08:42:57.254466+0000","last_undegraded":"2023-10-07T08:42:57.254466+0000","last_fullsized":"2023-10-07T08:42:57.254466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273333+0000","last_change":"2023-10-07T08:42:57.272880+0000","last_active":"2023-10-07T08:42:57.273333+0000","last_peered":"2023-10-07T08:42:57.273333+0000","last_clean":"2023-10-07T08:42:57.273333+0000","last_became_active":"2023-10-07T08:42:57.272657+0000","last_became_peered":"2023-10-07T08:42:57.272657+0000","last_unstale":"2023-10-07T08:42:57.273333+0000","last_undegraded":"2023-10-07T08:42:57.273333+0000","last_fullsized":"2023-10-07T08:42:57.273333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:14.856162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269087+0000","last_change":"2023-10-07T08:42:57.268989+0000","last_active":"2023-10-07T08:42:57.269087+0000","last_peered":"2023-10-07T08:42:57.269087+0000","last_clean":"2023-10-07T08:42:57.269087+0000","last_became_active":"2023-10-07T08:42:57.268767+0000","last_became_peered":"2023-10-07T08:42:57.268767+0000","last_unstale":"2023-10-07T08:42:57.269087+0000","last_undegraded":"2023-10-07T08:42:57.269087+0000","last_fullsized":"2023-10-07T08:42:57.269087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:25:20.586749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273482+0000","last_change":"2023-10-07T08:42:57.273400+0000","last_active":"2023-10-07T08:42:57.273482+0000","last_peered":"2023-10-07T08:42:57.273482+0000","last_clean":"2023-10-07T08:42:57.273482+0000","last_became_active":"2023-10-07T08:42:57.273173+0000","last_became_peered":"2023-10-07T08:42:57.273173+0000","last_unstale":"2023-10-07T08:42:57.273482+0000","last_undegraded":"2023-10-07T08:42:57.273482+0000","last_fullsized":"2023-10-07T08:42:57.273482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261699+0000","last_change":"2023-10-07T08:42:57.261158+0000","last_active":"2023-10-07T08:42:57.261699+0000","last_peered":"2023-10-07T08:42:57.261699+0000","last_clean":"2023-10-07T08:42:57.261699+0000","last_became_active":"2023-10-07T08:42:57.260929+0000","last_became_peered":"2023-10-07T08:42:57.260929+0000","last_unstale":"2023-10-07T08:42:57.261699+0000","last_undegraded":"2023-10-07T08:42:57.261699+0000","last_fullsized":"2023-10-07T08:42:57.261699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:25.788730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261649+0000","last_change":"2023-10-07T08:42:57.261591+0000","last_active":"2023-10-07T08:42:57.261649+0000","last_peered":"2023-10-07T08:42:57.261649+0000","last_clean":"2023-10-07T08:42:57.261649+0000","last_became_active":"2023-10-07T08:42:57.261195+0000","last_became_peered":"2023-10-07T08:42:57.261195+0000","last_unstale":"2023-10-07T08:42:57.261649+0000","last_undegraded":"2023-10-07T08:42:57.261649+0000","last_fullsized":"2023-10-07T08:42:57.261649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.085430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255722+0000","last_change":"2023-10-07T08:42:57.255722+0000","last_active":"2023-10-07T08:42:57.255722+0000","last_peered":"2023-10-07T08:42:57.255722+0000","last_clean":"2023-10-07T08:42:57.255722+0000","last_became_active":"2023-10-07T08:42:57.255058+0000","last_became_peered":"2023-10-07T08:42:57.255058+0000","last_unstale":"2023-10-07T08:42:57.255722+0000","last_undegraded":"2023-10-07T08:42:57.255722+0000","last_fullsized":"2023-10-07T08:42:57.255722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258968+0000","last_change":"2023-10-07T08:42:57.258735+0000","last_active":"2023-10-07T08:42:57.258968+0000","last_peered":"2023-10-07T08:42:57.258968+0000","last_clean":"2023-10-07T08:42:57.258968+0000","last_became_active":"2023-10-07T08:42:57.258531+0000","last_became_peered":"2023-10-07T08:42:57.258531+0000","last_unstale":"2023-10-07T08:42:57.258968+0000","last_undegraded":"2023-10-07T08:42:57.258968+0000","last_fullsized":"2023-10-07T08:42:57.258968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273242+0000","last_change":"2023-10-07T08:42:57.273000+0000","last_active":"2023-10-07T08:42:57.273242+0000","last_peered":"2023-10-07T08:42:57.273242+0000","last_clean":"2023-10-07T08:42:57.273242+0000","last_became_active":"2023-10-07T08:42:57.272147+0000","last_became_peered":"2023-10-07T08:42:57.272147+0000","last_unstale":"2023-10-07T08:42:57.273242+0000","last_undegraded":"2023-10-07T08:42:57.273242+0000","last_fullsized":"2023-10-07T08:42:57.273242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273615+0000","last_change":"2023-10-07T08:42:57.273534+0000","last_active":"2023-10-07T08:42:57.273615+0000","last_peered":"2023-10-07T08:42:57.273615+0000","last_clean":"2023-10-07T08:42:57.273615+0000","last_became_active":"2023-10-07T08:42:57.272752+0000","last_became_peered":"2023-10-07T08:42:57.272752+0000","last_unstale":"2023-10-07T08:42:57.273615+0000","last_undegraded":"2023-10-07T08:42:57.273615+0000","last_fullsized":"2023-10-07T08:42:57.273615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:14.856162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260472+0000","last_change":"2023-10-07T08:42:57.260016+0000","last_active":"2023-10-07T08:42:57.260472+0000","last_peered":"2023-10-07T08:42:57.260472+0000","last_clean":"2023-10-07T08:42:57.260472+0000","last_became_active":"2023-10-07T08:42:57.259796+0000","last_became_peered":"2023-10-07T08:42:57.259796+0000","last_unstale":"2023-10-07T08:42:57.260472+0000","last_undegraded":"2023-10-07T08:42:57.260472+0000","last_fullsized":"2023-10-07T08:42:57.260472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:44.958113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271244+0000","last_change":"2023-10-07T08:42:57.266814+0000","last_active":"2023-10-07T08:42:57.271244+0000","last_peered":"2023-10-07T08:42:57.271244+0000","last_clean":"2023-10-07T08:42:57.271244+0000","last_became_active":"2023-10-07T08:42:57.266212+0000","last_became_peered":"2023-10-07T08:42:57.266212+0000","last_unstale":"2023-10-07T08:42:57.271244+0000","last_undegraded":"2023-10-07T08:42:57.271244+0000","last_fullsized":"2023-10-07T08:42:57.271244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:56.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265520+0000","last_change":"2023-10-07T08:42:56.259068+0000","last_active":"2023-10-07T08:42:57.265520+0000","last_peered":"2023-10-07T08:42:57.265520+0000","last_clean":"2023-10-07T08:42:57.265520+0000","last_became_active":"2023-10-07T08:42:56.258934+0000","last_became_peered":"2023-10-07T08:42:56.258934+0000","last_unstale":"2023-10-07T08:42:57.265520+0000","last_undegraded":"2023-10-07T08:42:57.265520+0000","last_fullsized":"2023-10-07T08:42:57.265520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264519+0000","last_change":"2023-10-07T08:42:57.264466+0000","last_active":"2023-10-07T08:42:57.264519+0000","last_peered":"2023-10-07T08:42:57.264519+0000","last_clean":"2023-10-07T08:42:57.264519+0000","last_became_active":"2023-10-07T08:42:57.263468+0000","last_became_peered":"2023-10-07T08:42:57.263468+0000","last_unstale":"2023-10-07T08:42:57.264519+0000","last_undegraded":"2023-10-07T08:42:57.264519+0000","last_fullsized":"2023-10-07T08:42:57.264519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:07.393104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264975+0000","last_change":"2023-10-07T08:42:56.257405+0000","last_active":"2023-10-07T08:42:57.264975+0000","last_peered":"2023-10-07T08:42:57.264975+0000","last_clean":"2023-10-07T08:42:57.264975+0000","last_became_active":"2023-10-07T08:42:56.257065+0000","last_became_peered":"2023-10-07T08:42:56.257065+0000","last_unstale":"2023-10-07T08:42:57.264975+0000","last_undegraded":"2023-10-07T08:42:57.264975+0000","last_fullsized":"2023-10-07T08:42:57.264975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267485+0000","last_change":"2023-10-07T08:42:57.267485+0000","last_active":"2023-10-07T08:42:57.267485+0000","last_peered":"2023-10-07T08:42:57.267485+0000","last_clean":"2023-10-07T08:42:57.267485+0000","last_became_active":"2023-10-07T08:42:57.267277+0000","last_became_peered":"2023-10-07T08:42:57.267277+0000","last_unstale":"2023-10-07T08:42:57.267485+0000","last_undegraded":"2023-10-07T08:42:57.267485+0000","last_fullsized":"2023-10-07T08:42:57.267485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:13:34.785663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271811+0000","last_change":"2023-10-07T08:42:56.260298+0000","last_active":"2023-10-07T08:42:57.271811+0000","last_peered":"2023-10-07T08:42:57.271811+0000","last_clean":"2023-10-07T08:42:57.271811+0000","last_became_active":"2023-10-07T08:42:56.260074+0000","last_became_peered":"2023-10-07T08:42:56.260074+0000","last_unstale":"2023-10-07T08:42:57.271811+0000","last_undegraded":"2023-10-07T08:42:57.271811+0000","last_fullsized":"2023-10-07T08:42:57.271811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:00:57.309769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273224+0000","last_change":"2023-10-07T08:42:57.272854+0000","last_active":"2023-10-07T08:42:57.273224+0000","last_peered":"2023-10-07T08:42:57.273224+0000","last_clean":"2023-10-07T08:42:57.273224+0000","last_became_active":"2023-10-07T08:42:57.271880+0000","last_became_peered":"2023-10-07T08:42:57.271880+0000","last_unstale":"2023-10-07T08:42:57.273224+0000","last_undegraded":"2023-10-07T08:42:57.273224+0000","last_fullsized":"2023-10-07T08:42:57.273224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:11:19.626256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273211+0000","last_change":"2023-10-07T08:42:56.263017+0000","last_active":"2023-10-07T08:42:57.273211+0000","last_peered":"2023-10-07T08:42:57.273211+0000","last_clean":"2023-10-07T08:42:57.273211+0000","last_became_active":"2023-10-07T08:42:56.262769+0000","last_became_peered":"2023-10-07T08:42:56.262769+0000","last_unstale":"2023-10-07T08:42:57.273211+0000","last_undegraded":"2023-10-07T08:42:57.273211+0000","last_fullsized":"2023-10-07T08:42:57.273211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:35:43.604383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271875+0000","last_change":"2023-10-07T08:42:57.271009+0000","last_active":"2023-10-07T08:42:57.271875+0000","last_peered":"2023-10-07T08:42:57.271875+0000","last_clean":"2023-10-07T08:42:57.271875+0000","last_became_active":"2023-10-07T08:42:57.270777+0000","last_became_peered":"2023-10-07T08:42:57.270777+0000","last_unstale":"2023-10-07T08:42:57.271875+0000","last_undegraded":"2023-10-07T08:42:57.271875+0000","last_fullsized":"2023-10-07T08:42:57.271875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261893+0000","last_change":"2023-10-07T08:42:56.257276+0000","last_active":"2023-10-07T08:42:57.261893+0000","last_peered":"2023-10-07T08:42:57.261893+0000","last_clean":"2023-10-07T08:42:57.261893+0000","last_became_active":"2023-10-07T08:42:56.257051+0000","last_became_peered":"2023-10-07T08:42:56.257051+0000","last_unstale":"2023-10-07T08:42:57.261893+0000","last_undegraded":"2023-10-07T08:42:57.261893+0000","last_fullsized":"2023-10-07T08:42:57.261893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.256705+0000","last_change":"2023-10-07T08:42:57.256645+0000","last_active":"2023-10-07T08:42:57.256705+0000","last_peered":"2023-10-07T08:42:57.256705+0000","last_clean":"2023-10-07T08:42:57.256705+0000","last_became_active":"2023-10-07T08:42:57.256312+0000","last_became_peered":"2023-10-07T08:42:57.256312+0000","last_unstale":"2023-10-07T08:42:57.256705+0000","last_undegraded":"2023-10-07T08:42:57.256705+0000","last_fullsized":"2023-10-07T08:42:57.256705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:44.958113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261595+0000","last_change":"2023-10-07T08:42:56.256216+0000","last_active":"2023-10-07T08:42:57.261595+0000","last_peered":"2023-10-07T08:42:57.261595+0000","last_clean":"2023-10-07T08:42:57.261595+0000","last_became_active":"2023-10-07T08:42:56.255763+0000","last_became_peered":"2023-10-07T08:42:56.255763+0000","last_unstale":"2023-10-07T08:42:57.261595+0000","last_undegraded":"2023-10-07T08:42:57.261595+0000","last_fullsized":"2023-10-07T08:42:57.261595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260111+0000","last_change":"2023-10-07T08:42:57.260111+0000","last_active":"2023-10-07T08:42:57.260111+0000","last_peered":"2023-10-07T08:42:57.260111+0000","last_clean":"2023-10-07T08:42:57.260111+0000","last_became_active":"2023-10-07T08:42:57.259887+0000","last_became_peered":"2023-10-07T08:42:57.259887+0000","last_unstale":"2023-10-07T08:42:57.260111+0000","last_undegraded":"2023-10-07T08:42:57.260111+0000","last_fullsized":"2023-10-07T08:42:57.260111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:07.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.249477+0000","last_change":"2023-10-07T08:42:56.256584+0000","last_active":"2023-10-07T08:42:57.249477+0000","last_peered":"2023-10-07T08:42:57.249477+0000","last_clean":"2023-10-07T08:42:57.249477+0000","last_became_active":"2023-10-07T08:42:56.256306+0000","last_became_peered":"2023-10-07T08:42:56.256306+0000","last_unstale":"2023-10-07T08:42:57.249477+0000","last_undegraded":"2023-10-07T08:42:57.249477+0000","last_fullsized":"2023-10-07T08:42:57.249477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255482+0000","last_change":"2023-10-07T08:42:57.255428+0000","last_active":"2023-10-07T08:42:57.255482+0000","last_peered":"2023-10-07T08:42:57.255482+0000","last_clean":"2023-10-07T08:42:57.255482+0000","last_became_active":"2023-10-07T08:42:57.255284+0000","last_became_peered":"2023-10-07T08:42:57.255284+0000","last_unstale":"2023-10-07T08:42:57.255482+0000","last_undegraded":"2023-10-07T08:42:57.255482+0000","last_fullsized":"2023-10-07T08:42:57.255482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267031+0000","last_change":"2023-10-07T08:42:56.260669+0000","last_active":"2023-10-07T08:42:57.267031+0000","last_peered":"2023-10-07T08:42:57.267031+0000","last_clean":"2023-10-07T08:42:57.267031+0000","last_became_active":"2023-10-07T08:42:56.260436+0000","last_became_peered":"2023-10-07T08:42:56.260436+0000","last_unstale":"2023-10-07T08:42:57.267031+0000","last_undegraded":"2023-10-07T08:42:57.267031+0000","last_fullsized":"2023-10-07T08:42:57.267031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:47:14.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.257501+0000","last_change":"2023-10-07T08:42:57.257451+0000","last_active":"2023-10-07T08:42:57.257501+0000","last_peered":"2023-10-07T08:42:57.257501+0000","last_clean":"2023-10-07T08:42:57.257501+0000","last_became_active":"2023-10-07T08:42:57.257263+0000","last_became_peered":"2023-10-07T08:42:57.257263+0000","last_unstale":"2023-10-07T08:42:57.257501+0000","last_undegraded":"2023-10-07T08:42:57.257501+0000","last_fullsized":"2023-10-07T08:42:57.257501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255592+0000","last_change":"2023-10-07T08:42:56.261241+0000","last_active":"2023-10-07T08:42:57.255592+0000","last_peered":"2023-10-07T08:42:57.255592+0000","last_clean":"2023-10-07T08:42:57.255592+0000","last_became_active":"2023-10-07T08:42:56.261003+0000","last_became_peered":"2023-10-07T08:42:56.261003+0000","last_unstale":"2023-10-07T08:42:57.255592+0000","last_undegraded":"2023-10-07T08:42:57.255592+0000","last_fullsized":"2023-10-07T08:42:57.255592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273393+0000","last_change":"2023-10-07T08:42:57.273272+0000","last_active":"2023-10-07T08:42:57.273393+0000","last_peered":"2023-10-07T08:42:57.273393+0000","last_clean":"2023-10-07T08:42:57.273393+0000","last_became_active":"2023-10-07T08:42:57.272090+0000","last_became_peered":"2023-10-07T08:42:57.272090+0000","last_unstale":"2023-10-07T08:42:57.273393+0000","last_undegraded":"2023-10-07T08:42:57.273393+0000","last_fullsized":"2023-10-07T08:42:57.273393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:48.342893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255238+0000","last_change":"2023-10-07T08:42:56.260346+0000","last_active":"2023-10-07T08:42:57.255238+0000","last_peered":"2023-10-07T08:42:57.255238+0000","last_clean":"2023-10-07T08:42:57.255238+0000","last_became_active":"2023-10-07T08:42:56.259661+0000","last_became_peered":"2023-10-07T08:42:56.259661+0000","last_unstale":"2023-10-07T08:42:57.255238+0000","last_undegraded":"2023-10-07T08:42:57.255238+0000","last_fullsized":"2023-10-07T08:42:57.255238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:21.295203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273913+0000","last_change":"2023-10-07T08:42:57.273913+0000","last_active":"2023-10-07T08:42:57.273913+0000","last_peered":"2023-10-07T08:42:57.273913+0000","last_clean":"2023-10-07T08:42:57.273913+0000","last_became_active":"2023-10-07T08:42:57.273631+0000","last_became_peered":"2023-10-07T08:42:57.273631+0000","last_unstale":"2023-10-07T08:42:57.273913+0000","last_undegraded":"2023-10-07T08:42:57.273913+0000","last_fullsized":"2023-10-07T08:42:57.273913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:07.393104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271888+0000","last_change":"2023-10-07T08:42:56.257713+0000","last_active":"2023-10-07T08:42:57.271888+0000","last_peered":"2023-10-07T08:42:57.271888+0000","last_clean":"2023-10-07T08:42:57.271888+0000","last_became_active":"2023-10-07T08:42:56.257481+0000","last_became_peered":"2023-10-07T08:42:56.257481+0000","last_unstale":"2023-10-07T08:42:57.271888+0000","last_undegraded":"2023-10-07T08:42:57.271888+0000","last_fullsized":"2023-10-07T08:42:57.271888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:43.953599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266459+0000","last_change":"2023-10-07T08:42:57.266396+0000","last_active":"2023-10-07T08:42:57.266459+0000","last_peered":"2023-10-07T08:42:57.266459+0000","last_clean":"2023-10-07T08:42:57.266459+0000","last_became_active":"2023-10-07T08:42:57.266029+0000","last_became_peered":"2023-10-07T08:42:57.266029+0000","last_unstale":"2023-10-07T08:42:57.266459+0000","last_undegraded":"2023-10-07T08:42:57.266459+0000","last_fullsized":"2023-10-07T08:42:57.266459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:22.299718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269611+0000","last_change":"2023-10-07T08:42:56.259429+0000","last_active":"2023-10-07T08:42:57.269611+0000","last_peered":"2023-10-07T08:42:57.269611+0000","last_clean":"2023-10-07T08:42:57.269611+0000","last_became_active":"2023-10-07T08:42:56.259154+0000","last_became_peered":"2023-10-07T08:42:56.259154+0000","last_unstale":"2023-10-07T08:42:57.269611+0000","last_undegraded":"2023-10-07T08:42:57.269611+0000","last_fullsized":"2023-10-07T08:42:57.269611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265027+0000","last_change":"2023-10-07T08:42:57.262943+0000","last_active":"2023-10-07T08:42:57.265027+0000","last_peered":"2023-10-07T08:42:57.265027+0000","last_clean":"2023-10-07T08:42:57.265027+0000","last_became_active":"2023-10-07T08:42:57.262707+0000","last_became_peered":"2023-10-07T08:42:57.262707+0000","last_unstale":"2023-10-07T08:42:57.265027+0000","last_undegraded":"2023-10-07T08:42:57.265027+0000","last_fullsized":"2023-10-07T08:42:57.265027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267652+0000","last_change":"2023-10-07T08:42:56.250565+0000","last_active":"2023-10-07T08:42:57.267652+0000","last_peered":"2023-10-07T08:42:57.267652+0000","last_clean":"2023-10-07T08:42:57.267652+0000","last_became_active":"2023-10-07T08:42:56.250326+0000","last_became_peered":"2023-10-07T08:42:56.250326+0000","last_unstale":"2023-10-07T08:42:57.267652+0000","last_undegraded":"2023-10-07T08:42:57.267652+0000","last_fullsized":"2023-10-07T08:42:57.267652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.263608+0000","last_change":"2023-10-07T08:42:57.263608+0000","last_active":"2023-10-07T08:42:57.263608+0000","last_peered":"2023-10-07T08:42:57.263608+0000","last_clean":"2023-10-07T08:42:57.263608+0000","last_became_active":"2023-10-07T08:42:57.262971+0000","last_became_peered":"2023-10-07T08:42:57.262971+0000","last_unstale":"2023-10-07T08:42:57.263608+0000","last_undegraded":"2023-10-07T08:42:57.263608+0000","last_fullsized":"2023-10-07T08:42:57.263608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269407+0000","last_change":"2023-10-07T08:42:56.262332+0000","last_active":"2023-10-07T08:42:57.269407+0000","last_peered":"2023-10-07T08:42:57.269407+0000","last_clean":"2023-10-07T08:42:57.269407+0000","last_became_active":"2023-10-07T08:42:56.261913+0000","last_became_peered":"2023-10-07T08:42:56.261913+0000","last_unstale":"2023-10-07T08:42:57.269407+0000","last_undegraded":"2023-10-07T08:42:57.269407+0000","last_fullsized":"2023-10-07T08:42:57.269407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:47.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273297+0000","last_change":"2023-10-07T08:42:57.271943+0000","last_active":"2023-10-07T08:42:57.273297+0000","last_peered":"2023-10-07T08:42:57.273297+0000","last_clean":"2023-10-07T08:42:57.273297+0000","last_became_active":"2023-10-07T08:42:57.271217+0000","last_became_peered":"2023-10-07T08:42:57.271217+0000","last_unstale":"2023-10-07T08:42:57.273297+0000","last_undegraded":"2023-10-07T08:42:57.273297+0000","last_fullsized":"2023-10-07T08:42:57.273297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:07:27.370919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.259993+0000","last_change":"2023-10-07T08:42:56.259497+0000","last_active":"2023-10-07T08:42:57.259993+0000","last_peered":"2023-10-07T08:42:57.259993+0000","last_clean":"2023-10-07T08:42:57.259993+0000","last_became_active":"2023-10-07T08:42:56.259259+0000","last_became_peered":"2023-10-07T08:42:56.259259+0000","last_unstale":"2023-10-07T08:42:57.259993+0000","last_undegraded":"2023-10-07T08:42:57.259993+0000","last_fullsized":"2023-10-07T08:42:57.259993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:47.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267342+0000","last_change":"2023-10-07T08:42:57.264611+0000","last_active":"2023-10-07T08:42:57.267342+0000","last_peered":"2023-10-07T08:42:57.267342+0000","last_clean":"2023-10-07T08:42:57.267342+0000","last_became_active":"2023-10-07T08:42:57.264371+0000","last_became_peered":"2023-10-07T08:42:57.264371+0000","last_unstale":"2023-10-07T08:42:57.267342+0000","last_undegraded":"2023-10-07T08:42:57.267342+0000","last_fullsized":"2023-10-07T08:42:57.267342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.262375+0000","last_change":"2023-10-07T08:42:56.254762+0000","last_active":"2023-10-07T08:42:57.262375+0000","last_peered":"2023-10-07T08:42:57.262375+0000","last_clean":"2023-10-07T08:42:57.262375+0000","last_became_active":"2023-10-07T08:42:56.254460+0000","last_became_peered":"2023-10-07T08:42:56.254460+0000","last_unstale":"2023-10-07T08:42:57.262375+0000","last_undegraded":"2023-10-07T08:42:57.262375+0000","last_fullsized":"2023-10-07T08:42:57.262375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265088+0000","last_change":"2023-10-07T08:42:57.264712+0000","last_active":"2023-10-07T08:42:57.265088+0000","last_peered":"2023-10-07T08:42:57.265088+0000","last_clean":"2023-10-07T08:42:57.265088+0000","last_became_active":"2023-10-07T08:42:57.264380+0000","last_became_peered":"2023-10-07T08:42:57.264380+0000","last_unstale":"2023-10-07T08:42:57.265088+0000","last_undegraded":"2023-10-07T08:42:57.265088+0000","last_fullsized":"2023-10-07T08:42:57.265088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:48.342893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.257527+0000","last_change":"2023-10-07T08:42:56.253642+0000","last_active":"2023-10-07T08:42:57.257527+0000","last_peered":"2023-10-07T08:42:57.257527+0000","last_clean":"2023-10-07T08:42:57.257527+0000","last_became_active":"2023-10-07T08:42:56.253183+0000","last_became_peered":"2023-10-07T08:42:56.253183+0000","last_unstale":"2023-10-07T08:42:57.257527+0000","last_undegraded":"2023-10-07T08:42:57.257527+0000","last_fullsized":"2023-10-07T08:42:57.257527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:35.495354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273316+0000","last_change":"2023-10-07T08:42:57.272080+0000","last_active":"2023-10-07T08:42:57.273316+0000","last_peered":"2023-10-07T08:42:57.273316+0000","last_clean":"2023-10-07T08:42:57.273316+0000","last_became_active":"2023-10-07T08:42:57.271505+0000","last_became_peered":"2023-10-07T08:42:57.271505+0000","last_unstale":"2023-10-07T08:42:57.273316+0000","last_undegraded":"2023-10-07T08:42:57.273316+0000","last_fullsized":"2023-10-07T08:42:57.273316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:29.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.251426+0000","last_change":"2023-10-07T08:42:56.253289+0000","last_active":"2023-10-07T08:42:57.251426+0000","last_peered":"2023-10-07T08:42:57.251426+0000","last_clean":"2023-10-07T08:42:57.251426+0000","last_became_active":"2023-10-07T08:42:56.253058+0000","last_became_peered":"2023-10-07T08:42:56.253058+0000","last_unstale":"2023-10-07T08:42:57.251426+0000","last_undegraded":"2023-10-07T08:42:57.251426+0000","last_fullsized":"2023-10-07T08:42:57.251426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271749+0000","last_change":"2023-10-07T08:42:57.269245+0000","last_active":"2023-10-07T08:42:57.271749+0000","last_peered":"2023-10-07T08:42:57.271749+0000","last_clean":"2023-10-07T08:42:57.271749+0000","last_became_active":"2023-10-07T08:42:57.268139+0000","last_became_peered":"2023-10-07T08:42:57.268139+0000","last_unstale":"2023-10-07T08:42:57.271749+0000","last_undegraded":"2023-10-07T08:42:57.271749+0000","last_fullsized":"2023-10-07T08:42:57.271749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:56.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255341+0000","last_change":"2023-10-07T08:42:56.262012+0000","last_active":"2023-10-07T08:42:57.255341+0000","last_peered":"2023-10-07T08:42:57.255341+0000","last_clean":"2023-10-07T08:42:57.255341+0000","last_became_active":"2023-10-07T08:42:56.261812+0000","last_became_peered":"2023-10-07T08:42:56.261812+0000","last_unstale":"2023-10-07T08:42:57.255341+0000","last_undegraded":"2023-10-07T08:42:57.255341+0000","last_fullsized":"2023-10-07T08:42:57.255341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:43.953599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264986+0000","last_change":"2023-10-07T08:42:57.264887+0000","last_active":"2023-10-07T08:42:57.264986+0000","last_peered":"2023-10-07T08:42:57.264986+0000","last_clean":"2023-10-07T08:42:57.264986+0000","last_became_active":"2023-10-07T08:42:57.264651+0000","last_became_peered":"2023-10-07T08:42:57.264651+0000","last_unstale":"2023-10-07T08:42:57.264986+0000","last_undegraded":"2023-10-07T08:42:57.264986+0000","last_fullsized":"2023-10-07T08:42:57.264986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:32.698757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.252401+0000","last_change":"2023-10-07T08:42:57.252321+0000","last_active":"2023-10-07T08:42:57.252401+0000","last_peered":"2023-10-07T08:42:57.252401+0000","last_clean":"2023-10-07T08:42:57.252401+0000","last_became_active":"2023-10-07T08:42:57.252102+0000","last_became_peered":"2023-10-07T08:42:57.252102+0000","last_unstale":"2023-10-07T08:42:57.252401+0000","last_undegraded":"2023-10-07T08:42:57.252401+0000","last_fullsized":"2023-10-07T08:42:57.252401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:07.393104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.250654+0000","last_change":"2023-10-07T08:42:56.255406+0000","last_active":"2023-10-07T08:42:57.250654+0000","last_peered":"2023-10-07T08:42:57.250654+0000","last_clean":"2023-10-07T08:42:57.250654+0000","last_became_active":"2023-10-07T08:42:56.255167+0000","last_became_peered":"2023-10-07T08:42:56.255167+0000","last_unstale":"2023-10-07T08:42:57.250654+0000","last_undegraded":"2023-10-07T08:42:57.250654+0000","last_fullsized":"2023-10-07T08:42:57.250654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.268877+0000","last_change":"2023-10-07T08:42:57.268830+0000","last_active":"2023-10-07T08:42:57.268877+0000","last_peered":"2023-10-07T08:42:57.268877+0000","last_clean":"2023-10-07T08:42:57.268877+0000","last_became_active":"2023-10-07T08:42:57.268514+0000","last_became_peered":"2023-10-07T08:42:57.268514+0000","last_unstale":"2023-10-07T08:42:57.268877+0000","last_undegraded":"2023-10-07T08:42:57.268877+0000","last_fullsized":"2023-10-07T08:42:57.268877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:56.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269521+0000","last_change":"2023-10-07T08:42:56.262059+0000","last_active":"2023-10-07T08:42:57.269521+0000","last_peered":"2023-10-07T08:42:57.269521+0000","last_clean":"2023-10-07T08:42:57.269521+0000","last_became_active":"2023-10-07T08:42:56.260888+0000","last_became_peered":"2023-10-07T08:42:56.260888+0000","last_unstale":"2023-10-07T08:42:57.269521+0000","last_undegraded":"2023-10-07T08:42:57.269521+0000","last_fullsized":"2023-10-07T08:42:57.269521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.262180+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:42:57.262180+0000","last_peered":"2023-10-07T08:42:57.262180+0000","last_clean":"2023-10-07T08:42:57.262180+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:42:57.262180+0000","last_undegraded":"2023-10-07T08:42:57.262180+0000","last_fullsized":"2023-10-07T08:42:57.262180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.262498+0000","last_change":"2023-10-07T08:42:57.262498+0000","last_active":"2023-10-07T08:42:57.262498+0000","last_peered":"2023-10-07T08:42:57.262498+0000","last_clean":"2023-10-07T08:42:57.262498+0000","last_became_active":"2023-10-07T08:42:57.261704+0000","last_became_peered":"2023-10-07T08:42:57.261704+0000","last_unstale":"2023-10-07T08:42:57.262498+0000","last_undegraded":"2023-10-07T08:42:57.262498+0000","last_fullsized":"2023-10-07T08:42:57.262498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260276+0000","last_change":"2023-10-07T08:42:56.259333+0000","last_active":"2023-10-07T08:42:57.260276+0000","last_peered":"2023-10-07T08:42:57.260276+0000","last_clean":"2023-10-07T08:42:57.260276+0000","last_became_active":"2023-10-07T08:42:56.259178+0000","last_became_peered":"2023-10-07T08:42:56.259178+0000","last_unstale":"2023-10-07T08:42:57.260276+0000","last_undegraded":"2023-10-07T08:42:57.260276+0000","last_fullsized":"2023-10-07T08:42:57.260276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:43.953599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260369+0000","last_change":"2023-10-07T08:42:56.262061+0000","last_active":"2023-10-07T08:42:57.260369+0000","last_peered":"2023-10-07T08:42:57.260369+0000","last_clean":"2023-10-07T08:42:57.260369+0000","last_became_active":"2023-10-07T08:42:56.261842+0000","last_became_peered":"2023-10-07T08:42:56.261842+0000","last_unstale":"2023-10-07T08:42:57.260369+0000","last_undegraded":"2023-10-07T08:42:57.260369+0000","last_fullsized":"2023-10-07T08:42:57.260369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.254098+0000","last_change":"2023-10-07T08:42:57.253993+0000","last_active":"2023-10-07T08:42:57.254098+0000","last_peered":"2023-10-07T08:42:57.254098+0000","last_clean":"2023-10-07T08:42:57.254098+0000","last_became_active":"2023-10-07T08:42:57.253775+0000","last_became_peered":"2023-10-07T08:42:57.253775+0000","last_unstale":"2023-10-07T08:42:57.254098+0000","last_undegraded":"2023-10-07T08:42:57.254098+0000","last_fullsized":"2023-10-07T08:42:57.254098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-07T08:42:58.827418+0000","last_change":"2023-10-07T08:42:56.256312+0000","last_active":"2023-10-07T08:42:58.827418+0000","last_peered":"2023-10-07T08:42:58.827418+0000","last_clean":"2023-10-07T08:42:58.827418+0000","last_became_active":"2023-10-07T08:42:56.256095+0000","last_became_peered":"2023-10-07T08:42:56.256095+0000","last_unstale":"2023-10-07T08:42:58.827418+0000","last_undegraded":"2023-10-07T08:42:58.827418+0000","last_fullsized":"2023-10-07T08:42:58.827418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:21.295203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266691+0000","last_change":"2023-10-07T08:42:57.266642+0000","last_active":"2023-10-07T08:42:57.266691+0000","last_peered":"2023-10-07T08:42:57.266691+0000","last_clean":"2023-10-07T08:42:57.266691+0000","last_became_active":"2023-10-07T08:42:57.266480+0000","last_became_peered":"2023-10-07T08:42:57.266480+0000","last_unstale":"2023-10-07T08:42:57.266691+0000","last_undegraded":"2023-10-07T08:42:57.266691+0000","last_fullsized":"2023-10-07T08:42:57.266691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:07.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271789+0000","last_change":"2023-10-07T08:42:56.257795+0000","last_active":"2023-10-07T08:42:57.271789+0000","last_peered":"2023-10-07T08:42:57.271789+0000","last_clean":"2023-10-07T08:42:57.271789+0000","last_became_active":"2023-10-07T08:42:56.257560+0000","last_became_peered":"2023-10-07T08:42:56.257560+0000","last_unstale":"2023-10-07T08:42:57.271789+0000","last_undegraded":"2023-10-07T08:42:57.271789+0000","last_fullsized":"2023-10-07T08:42:57.271789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.262219+0000","last_change":"2023-10-07T08:42:57.262219+0000","last_active":"2023-10-07T08:42:57.262219+0000","last_peered":"2023-10-07T08:42:57.262219+0000","last_clean":"2023-10-07T08:42:57.262219+0000","last_became_active":"2023-10-07T08:42:57.261413+0000","last_became_peered":"2023-10-07T08:42:57.261413+0000","last_unstale":"2023-10-07T08:42:57.262219+0000","last_undegraded":"2023-10-07T08:42:57.262219+0000","last_fullsized":"2023-10-07T08:42:57.262219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:25:20.586749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261906+0000","last_change":"2023-10-07T08:42:56.258484+0000","last_active":"2023-10-07T08:42:57.261906+0000","last_peered":"2023-10-07T08:42:57.261906+0000","last_clean":"2023-10-07T08:42:57.261906+0000","last_became_active":"2023-10-07T08:42:56.258243+0000","last_became_peered":"2023-10-07T08:42:56.258243+0000","last_unstale":"2023-10-07T08:42:57.261906+0000","last_undegraded":"2023-10-07T08:42:57.261906+0000","last_fullsized":"2023-10-07T08:42:57.261906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:24.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258408+0000","last_change":"2023-10-07T08:42:57.258345+0000","last_active":"2023-10-07T08:42:57.258408+0000","last_peered":"2023-10-07T08:42:57.258408+0000","last_clean":"2023-10-07T08:42:57.258408+0000","last_became_active":"2023-10-07T08:42:57.257563+0000","last_became_peered":"2023-10-07T08:42:57.257563+0000","last_unstale":"2023-10-07T08:42:57.258408+0000","last_undegraded":"2023-10-07T08:42:57.258408+0000","last_fullsized":"2023-10-07T08:42:57.258408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:00:58.314283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.251512+0000","last_change":"2023-10-07T08:42:56.259479+0000","last_active":"2023-10-07T08:42:57.251512+0000","last_peered":"2023-10-07T08:42:57.251512+0000","last_clean":"2023-10-07T08:42:57.251512+0000","last_became_active":"2023-10-07T08:42:56.259257+0000","last_became_peered":"2023-10-07T08:42:56.259257+0000","last_unstale":"2023-10-07T08:42:57.251512+0000","last_undegraded":"2023-10-07T08:42:57.251512+0000","last_fullsized":"2023-10-07T08:42:57.251512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:00:57.309769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.253038+0000","last_change":"2023-10-07T08:42:57.252823+0000","last_active":"2023-10-07T08:42:57.253038+0000","last_peered":"2023-10-07T08:42:57.253038+0000","last_clean":"2023-10-07T08:42:57.253038+0000","last_became_active":"2023-10-07T08:42:57.252606+0000","last_became_peered":"2023-10-07T08:42:57.252606+0000","last_unstale":"2023-10-07T08:42:57.253038+0000","last_undegraded":"2023-10-07T08:42:57.253038+0000","last_fullsized":"2023-10-07T08:42:57.253038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:25.788730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.251872+0000","last_change":"2023-10-07T08:42:56.255715+0000","last_active":"2023-10-07T08:42:57.251872+0000","last_peered":"2023-10-07T08:42:57.251872+0000","last_clean":"2023-10-07T08:42:57.251872+0000","last_became_active":"2023-10-07T08:42:56.255502+0000","last_became_peered":"2023-10-07T08:42:56.255502+0000","last_unstale":"2023-10-07T08:42:57.251872+0000","last_undegraded":"2023-10-07T08:42:57.251872+0000","last_fullsized":"2023-10-07T08:42:57.251872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:47:14.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261586+0000","last_change":"2023-10-07T08:42:57.261460+0000","last_active":"2023-10-07T08:42:57.261586+0000","last_peered":"2023-10-07T08:42:57.261586+0000","last_clean":"2023-10-07T08:42:57.261586+0000","last_became_active":"2023-10-07T08:42:57.260893+0000","last_became_peered":"2023-10-07T08:42:57.260893+0000","last_unstale":"2023-10-07T08:42:57.261586+0000","last_undegraded":"2023-10-07T08:42:57.261586+0000","last_fullsized":"2023-10-07T08:42:57.261586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273745+0000","last_change":"2023-10-07T08:42:56.258635+0000","last_active":"2023-10-07T08:42:57.273745+0000","last_peered":"2023-10-07T08:42:57.273745+0000","last_clean":"2023-10-07T08:42:57.273745+0000","last_became_active":"2023-10-07T08:42:56.258323+0000","last_became_peered":"2023-10-07T08:42:56.258323+0000","last_unstale":"2023-10-07T08:42:57.273745+0000","last_undegraded":"2023-10-07T08:42:57.273745+0000","last_fullsized":"2023-10-07T08:42:57.273745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260549+0000","last_change":"2023-10-07T08:42:57.259849+0000","last_active":"2023-10-07T08:42:57.260549+0000","last_peered":"2023-10-07T08:42:57.260549+0000","last_clean":"2023-10-07T08:42:57.260549+0000","last_became_active":"2023-10-07T08:42:57.259625+0000","last_became_peered":"2023-10-07T08:42:57.259625+0000","last_unstale":"2023-10-07T08:42:57.260549+0000","last_undegraded":"2023-10-07T08:42:57.260549+0000","last_fullsized":"2023-10-07T08:42:57.260549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.250640+0000","last_change":"2023-10-07T08:42:56.260384+0000","last_active":"2023-10-07T08:42:57.250640+0000","last_peered":"2023-10-07T08:42:57.250640+0000","last_clean":"2023-10-07T08:42:57.250640+0000","last_became_active":"2023-10-07T08:42:56.260141+0000","last_became_peered":"2023-10-07T08:42:56.260141+0000","last_unstale":"2023-10-07T08:42:57.250640+0000","last_undegraded":"2023-10-07T08:42:57.250640+0000","last_fullsized":"2023-10-07T08:42:57.250640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.274600+0000","last_change":"2023-10-07T08:42:57.273820+0000","last_active":"2023-10-07T08:42:57.274600+0000","last_peered":"2023-10-07T08:42:57.274600+0000","last_clean":"2023-10-07T08:42:57.274600+0000","last_became_active":"2023-10-07T08:42:57.273591+0000","last_became_peered":"2023-10-07T08:42:57.273591+0000","last_unstale":"2023-10-07T08:42:57.274600+0000","last_undegraded":"2023-10-07T08:42:57.274600+0000","last_fullsized":"2023-10-07T08:42:57.274600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:56.744706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261775+0000","last_change":"2023-10-07T08:42:56.253272+0000","last_active":"2023-10-07T08:42:57.261775+0000","last_peered":"2023-10-07T08:42:57.261775+0000","last_clean":"2023-10-07T08:42:57.261775+0000","last_became_active":"2023-10-07T08:42:56.253029+0000","last_became_peered":"2023-10-07T08:42:56.253029+0000","last_unstale":"2023-10-07T08:42:57.261775+0000","last_undegraded":"2023-10-07T08:42:57.261775+0000","last_fullsized":"2023-10-07T08:42:57.261775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:47.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266923+0000","last_change":"2023-10-07T08:42:57.266372+0000","last_active":"2023-10-07T08:42:57.266923+0000","last_peered":"2023-10-07T08:42:57.266923+0000","last_clean":"2023-10-07T08:42:57.266923+0000","last_became_active":"2023-10-07T08:42:57.266237+0000","last_became_peered":"2023-10-07T08:42:57.266237+0000","last_unstale":"2023-10-07T08:42:57.266923+0000","last_undegraded":"2023-10-07T08:42:57.266923+0000","last_fullsized":"2023-10-07T08:42:57.266923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:29.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264466+0000","last_change":"2023-10-07T08:42:56.257581+0000","last_active":"2023-10-07T08:42:57.264466+0000","last_peered":"2023-10-07T08:42:57.264466+0000","last_clean":"2023-10-07T08:42:57.264466+0000","last_became_active":"2023-10-07T08:42:56.257339+0000","last_became_peered":"2023-10-07T08:42:56.257339+0000","last_unstale":"2023-10-07T08:42:57.264466+0000","last_undegraded":"2023-10-07T08:42:57.264466+0000","last_fullsized":"2023-10-07T08:42:57.264466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:40.492004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266968+0000","last_change":"2023-10-07T08:42:57.266483+0000","last_active":"2023-10-07T08:42:57.266968+0000","last_peered":"2023-10-07T08:42:57.266968+0000","last_clean":"2023-10-07T08:42:57.266968+0000","last_became_active":"2023-10-07T08:42:57.265437+0000","last_became_peered":"2023-10-07T08:42:57.265437+0000","last_unstale":"2023-10-07T08:42:57.266968+0000","last_undegraded":"2023-10-07T08:42:57.266968+0000","last_fullsized":"2023-10-07T08:42:57.266968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:38.758746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260567+0000","last_change":"2023-10-07T08:42:57.260425+0000","last_active":"2023-10-07T08:42:57.260567+0000","last_peered":"2023-10-07T08:42:57.260567+0000","last_clean":"2023-10-07T08:42:57.260567+0000","last_became_active":"2023-10-07T08:42:57.260226+0000","last_became_peered":"2023-10-07T08:42:57.260226+0000","last_unstale":"2023-10-07T08:42:57.260567+0000","last_undegraded":"2023-10-07T08:42:57.260567+0000","last_fullsized":"2023-10-07T08:42:57.260567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273197+0000","last_change":"2023-10-07T08:42:57.273144+0000","last_active":"2023-10-07T08:42:57.273197+0000","last_peered":"2023-10-07T08:42:57.273197+0000","last_clean":"2023-10-07T08:42:57.273197+0000","last_became_active":"2023-10-07T08:42:57.273008+0000","last_became_peered":"2023-10-07T08:42:57.273008+0000","last_unstale":"2023-10-07T08:42:57.273197+0000","last_undegraded":"2023-10-07T08:42:57.273197+0000","last_fullsized":"2023-10-07T08:42:57.273197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:22.299718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271790+0000","last_change":"2023-10-07T08:42:57.270102+0000","last_active":"2023-10-07T08:42:57.271790+0000","last_peered":"2023-10-07T08:42:57.271790+0000","last_clean":"2023-10-07T08:42:57.271790+0000","last_became_active":"2023-10-07T08:42:57.269871+0000","last_became_peered":"2023-10-07T08:42:57.269871+0000","last_unstale":"2023-10-07T08:42:57.271790+0000","last_undegraded":"2023-10-07T08:42:57.271790+0000","last_fullsized":"2023-10-07T08:42:57.271790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:22:57.366438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255880+0000","last_change":"2023-10-07T08:42:57.255880+0000","last_active":"2023-10-07T08:42:57.255880+0000","last_peered":"2023-10-07T08:42:57.255880+0000","last_clean":"2023-10-07T08:42:57.255880+0000","last_became_active":"2023-10-07T08:42:57.255498+0000","last_became_peered":"2023-10-07T08:42:57.255498+0000","last_unstale":"2023-10-07T08:42:57.255880+0000","last_undegraded":"2023-10-07T08:42:57.255880+0000","last_fullsized":"2023-10-07T08:42:57.255880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258178+0000","last_change":"2023-10-07T08:42:57.257694+0000","last_active":"2023-10-07T08:42:57.258178+0000","last_peered":"2023-10-07T08:42:57.258178+0000","last_clean":"2023-10-07T08:42:57.258178+0000","last_became_active":"2023-10-07T08:42:57.257200+0000","last_became_peered":"2023-10-07T08:42:57.257200+0000","last_unstale":"2023-10-07T08:42:57.258178+0000","last_undegraded":"2023-10-07T08:42:57.258178+0000","last_fullsized":"2023-10-07T08:42:57.258178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.253992+0000","last_change":"2023-10-07T08:42:57.253904+0000","last_active":"2023-10-07T08:42:57.253992+0000","last_peered":"2023-10-07T08:42:57.253992+0000","last_clean":"2023-10-07T08:42:57.253992+0000","last_became_active":"2023-10-07T08:42:57.253374+0000","last_became_peered":"2023-10-07T08:42:57.253374+0000","last_unstale":"2023-10-07T08:42:57.253992+0000","last_undegraded":"2023-10-07T08:42:57.253992+0000","last_fullsized":"2023-10-07T08:42:57.253992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267322+0000","last_change":"2023-10-07T08:42:57.264162+0000","last_active":"2023-10-07T08:42:57.267322+0000","last_peered":"2023-10-07T08:42:57.267322+0000","last_clean":"2023-10-07T08:42:57.267322+0000","last_became_active":"2023-10-07T08:42:57.263947+0000","last_became_peered":"2023-10-07T08:42:57.263947+0000","last_unstale":"2023-10-07T08:42:57.267322+0000","last_undegraded":"2023-10-07T08:42:57.267322+0000","last_fullsized":"2023-10-07T08:42:57.267322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:07.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.256643+0000","last_change":"2023-10-07T08:42:57.256601+0000","last_active":"2023-10-07T08:42:57.256643+0000","last_peered":"2023-10-07T08:42:57.256643+0000","last_clean":"2023-10-07T08:42:57.256643+0000","last_became_active":"2023-10-07T08:42:57.256421+0000","last_became_peered":"2023-10-07T08:42:57.256421+0000","last_unstale":"2023-10-07T08:42:57.256643+0000","last_undegraded":"2023-10-07T08:42:57.256643+0000","last_fullsized":"2023-10-07T08:42:57.256643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271714+0000","last_change":"2023-10-07T08:42:57.268643+0000","last_active":"2023-10-07T08:42:57.271714+0000","last_peered":"2023-10-07T08:42:57.271714+0000","last_clean":"2023-10-07T08:42:57.271714+0000","last_became_active":"2023-10-07T08:42:57.267817+0000","last_became_peered":"2023-10-07T08:42:57.267817+0000","last_unstale":"2023-10-07T08:42:57.271714+0000","last_undegraded":"2023-10-07T08:42:57.271714+0000","last_fullsized":"2023-10-07T08:42:57.271714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258195+0000","last_change":"2023-10-07T08:42:57.257831+0000","last_active":"2023-10-07T08:42:57.258195+0000","last_peered":"2023-10-07T08:42:57.258195+0000","last_clean":"2023-10-07T08:42:57.258195+0000","last_became_active":"2023-10-07T08:42:57.257484+0000","last_became_peered":"2023-10-07T08:42:57.257484+0000","last_unstale":"2023-10-07T08:42:57.258195+0000","last_undegraded":"2023-10-07T08:42:57.258195+0000","last_fullsized":"2023-10-07T08:42:57.258195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273509+0000","last_change":"2023-10-07T08:42:57.273405+0000","last_active":"2023-10-07T08:42:57.273509+0000","last_peered":"2023-10-07T08:42:57.273509+0000","last_clean":"2023-10-07T08:42:57.273509+0000","last_became_active":"2023-10-07T08:42:57.272454+0000","last_became_peered":"2023-10-07T08:42:57.272454+0000","last_unstale":"2023-10-07T08:42:57.273509+0000","last_undegraded":"2023-10-07T08:42:57.273509+0000","last_fullsized":"2023-10-07T08:42:57.273509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:38.758746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.263789+0000","last_change":"2023-10-07T08:42:57.263789+0000","last_active":"2023-10-07T08:42:57.263789+0000","last_peered":"2023-10-07T08:42:57.263789+0000","last_clean":"2023-10-07T08:42:57.263789+0000","last_became_active":"2023-10-07T08:42:57.263348+0000","last_became_peered":"2023-10-07T08:42:57.263348+0000","last_unstale":"2023-10-07T08:42:57.263789+0000","last_undegraded":"2023-10-07T08:42:57.263789+0000","last_fullsized":"2023-10-07T08:42:57.263789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260531+0000","last_change":"2023-10-07T08:42:57.259213+0000","last_active":"2023-10-07T08:42:57.260531+0000","last_peered":"2023-10-07T08:42:57.260531+0000","last_clean":"2023-10-07T08:42:57.260531+0000","last_became_active":"2023-10-07T08:42:57.258976+0000","last_became_peered":"2023-10-07T08:42:57.258976+0000","last_unstale":"2023-10-07T08:42:57.260531+0000","last_undegraded":"2023-10-07T08:42:57.260531+0000","last_fullsized":"2023-10-07T08:42:57.260531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:29:20.004471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194668,"statfs":{"total":200000000,"available":199340213,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929599,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924687,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194668,"statfs":{"total":200000000,"available":199340157,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924847,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199923311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931009,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924757,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]}],"pool_statfs":[]}} 2023-10-07T08:43:05.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:43:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.924+0000 7f0a8a79e700 1 Processor -- start 2023-10-07T08:43:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.925+0000 7f0a8a79e700 1 -- start start 2023-10-07T08:43:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.925+0000 7f0a8a79e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a84157fe0 0x7f0a840b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.925+0000 7f0a8a79e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a840cf240 0x7f0a840b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.925+0000 7f0a8a79e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a840b2890 con 0x7f0a841583b0 2023-10-07T08:43:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.925+0000 7f0a8a79e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a840b4070 con 0x7f0a840cf240 2023-10-07T08:43:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.925+0000 7f0a8a79e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a840b4350 con 0x7f0a84157fe0 2023-10-07T08:43:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.925+0000 7f0a88d3b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a840cf240 0x7f0a840b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.926+0000 7f0a88d3b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a840cf240 0x7f0a840b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44772/0 (socket says 172.21.15.81:44772) 2023-10-07T08:43:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.926+0000 7f0a88d3b700 1 -- 172.21.15.81:0/3389877388 learned_addr learned my addr 172.21.15.81:0/3389877388 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.926+0000 7f0a88d3b700 1 -- 172.21.15.81:0/3389877388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a84157fe0 msgr2=0x7f0a840b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.926+0000 7f0a83fff700 1 --2- 172.21.15.81:0/3389877388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a84157fe0 0x7f0a840b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.926+0000 7f0a88d3b700 1 --2- 172.21.15.81:0/3389877388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a84157fe0 0x7f0a840b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.926+0000 7f0a88d3b700 1 -- 172.21.15.81:0/3389877388 >> v1:172.21.15.89:6789/0 conn(0x7f0a841583b0 legacy=0x7f0a840ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.926+0000 7f0a88d3b700 1 -- 172.21.15.81:0/3389877388 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a840b4630 con 0x7f0a840cf240 2023-10-07T08:43:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.926+0000 7f0a83fff700 1 --2- 172.21.15.81:0/3389877388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a84157fe0 0x7f0a840b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.926+0000 7f0a88d3b700 1 --2- 172.21.15.81:0/3389877388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a840cf240 0x7f0a840b3a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009f20 tx=0x7f0a7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4889ce0f7c48cffc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.926+0000 7f0a82ffd700 1 -- 172.21.15.81:0/3389877388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c00e070 con 0x7f0a840cf240 2023-10-07T08:43:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.926+0000 7f0a82ffd700 1 -- 172.21.15.81:0/3389877388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c00ba40 con 0x7f0a840cf240 2023-10-07T08:43:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.926+0000 7f0a82ffd700 1 -- 172.21.15.81:0/3389877388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c0092e0 con 0x7f0a840cf240 2023-10-07T08:43:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.927+0000 7f0a8a79e700 1 -- 172.21.15.81:0/3389877388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a840cf240 msgr2=0x7f0a840b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.927+0000 7f0a8a79e700 1 --2- 172.21.15.81:0/3389877388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a840cf240 0x7f0a840b3a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009f20 tx=0x7f0a7c009840 comp rx=0 tx=0).stop 2023-10-07T08:43:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.927+0000 7f0a8a79e700 1 -- 172.21.15.81:0/3389877388 shutdown_connections 2023-10-07T08:43:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.927+0000 7f0a8a79e700 1 --2- 172.21.15.81:0/3389877388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a840cf240 0x7f0a840b3a00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.927+0000 7f0a8a79e700 1 --2- 172.21.15.81:0/3389877388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a84157fe0 0x7f0a840b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.927+0000 7f0a8a79e700 1 -- 172.21.15.81:0/3389877388 >> 172.21.15.81:0/3389877388 conn(0x7f0a84067640 msgr2=0x7f0a84067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.927+0000 7f0a8a79e700 1 -- 172.21.15.81:0/3389877388 shutdown_connections 2023-10-07T08:43:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.927+0000 7f0a8a79e700 1 -- 172.21.15.81:0/3389877388 wait complete. 2023-10-07T08:43:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.928+0000 7f0a8a79e700 1 Processor -- start 2023-10-07T08:43:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.928+0000 7f0a8a79e700 1 -- start start 2023-10-07T08:43:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a8a79e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a840cf240 0x7f0a841693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a8a79e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a84157fe0 0x7f0a8414b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a8a79e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a841583b0 0x7f0a8414cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a8a79e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a84159f20 con 0x7f0a84157fe0 2023-10-07T08:43:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a8a79e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8415a7c0 con 0x7f0a840cf240 2023-10-07T08:43:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a8a79e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8414d750 con 0x7f0a841583b0 2023-10-07T08:43:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a837fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a84157fe0 0x7f0a8414b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a837fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a84157fe0 0x7f0a8414b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44776/0 (socket says 172.21.15.81:44776) 2023-10-07T08:43:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a837fe700 1 -- 172.21.15.81:0/1491602836 learned_addr learned my addr 172.21.15.81:0/1491602836 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a83fff700 1 --2- 172.21.15.81:0/1491602836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a840cf240 0x7f0a841693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a88d3b700 1 --2- 172.21.15.81:0/1491602836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a841583b0 0x7f0a8414cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a837fe700 1 -- 172.21.15.81:0/1491602836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a841583b0 msgr2=0x7f0a8414cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a837fe700 1 --2- 172.21.15.81:0/1491602836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a841583b0 0x7f0a8414cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a837fe700 1 -- 172.21.15.81:0/1491602836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a840cf240 msgr2=0x7f0a841693d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a837fe700 1 --2- 172.21.15.81:0/1491602836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a840cf240 0x7f0a841693d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a837fe700 1 -- 172.21.15.81:0/1491602836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c009ae0 con 0x7f0a84157fe0 2023-10-07T08:43:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a837fe700 1 --2- 172.21.15.81:0/1491602836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a84157fe0 0x7f0a8414b3b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800c5d0 tx=0x7f0a78007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a6bfff700 1 -- 172.21.15.81:0/1491602836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78011590 con 0x7f0a84157fe0 2023-10-07T08:43:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a6bfff700 1 -- 172.21.15.81:0/1491602836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a78011710 con 0x7f0a84157fe0 2023-10-07T08:43:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a8a79e700 1 -- 172.21.15.81:0/1491602836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8415a170 con 0x7f0a84157fe0 2023-10-07T08:43:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.929+0000 7f0a6bfff700 1 -- 172.21.15.81:0/1491602836 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78011ad0 con 0x7f0a84157fe0 2023-10-07T08:43:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.930+0000 7f0a8a79e700 1 -- 172.21.15.81:0/1491602836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8414b8f0 con 0x7f0a84157fe0 2023-10-07T08:43:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.931+0000 7f0a8a79e700 1 -- 172.21.15.81:0/1491602836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8415a930 con 0x7f0a84157fe0 2023-10-07T08:43:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.931+0000 7f0a6bfff700 1 -- 172.21.15.81:0/1491602836 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a7801c460 con 0x7f0a84157fe0 2023-10-07T08:43:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.931+0000 7f0a6bfff700 1 --2- 172.21.15.81:0/1491602836 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0a70066f30 0x7f0a700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.931+0000 7f0a6bfff700 1 -- 172.21.15.81:0/1491602836 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a780841f0 con 0x7f0a84157fe0 2023-10-07T08:43:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.931+0000 7f0a83fff700 1 --2- 172.21.15.81:0/1491602836 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0a70066f30 0x7f0a700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.931+0000 7f0a83fff700 1 --2- 172.21.15.81:0/1491602836 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0a70066f30 0x7f0a700693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400adc0 tx=0x7f0a74006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:05.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:05.935+0000 7f0a6bfff700 1 -- 172.21.15.81:0/1491602836 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a78051460 con 0x7f0a84157fe0 2023-10-07T08:43:06.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.113+0000 7f0a8a79e700 1 -- 172.21.15.81:0/1491602836 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a840cc6b0 con 0x7f0a70066f30 2023-10-07T08:43:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.120+0000 7f0a6bfff700 1 -- 172.21.15.81:0/1491602836 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260135 (secure 0 0 0) 0x7f0a840cc6b0 con 0x7f0a70066f30 2023-10-07T08:43:06.124 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.123+0000 7f0a8a79e700 1 -- 172.21.15.81:0/1491602836 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0a70066f30 msgr2=0x7f0a700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.123+0000 7f0a8a79e700 1 --2- 172.21.15.81:0/1491602836 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0a70066f30 0x7f0a700693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400adc0 tx=0x7f0a74006f90 comp rx=0 tx=0).stop 2023-10-07T08:43:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.123+0000 7f0a8a79e700 1 -- 172.21.15.81:0/1491602836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a84157fe0 msgr2=0x7f0a8414b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.123+0000 7f0a8a79e700 1 --2- 172.21.15.81:0/1491602836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a84157fe0 0x7f0a8414b3b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800c5d0 tx=0x7f0a78007f60 comp rx=0 tx=0).stop 2023-10-07T08:43:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.123+0000 7f0a8a79e700 1 -- 172.21.15.81:0/1491602836 shutdown_connections 2023-10-07T08:43:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.123+0000 7f0a8a79e700 1 --2- 172.21.15.81:0/1491602836 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0a70066f30 0x7f0a700693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.123+0000 7f0a8a79e700 1 --2- 172.21.15.81:0/1491602836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a841583b0 0x7f0a8414cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.123+0000 7f0a8a79e700 1 --2- 172.21.15.81:0/1491602836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a840cf240 0x7f0a841693d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.123+0000 7f0a8a79e700 1 --2- 172.21.15.81:0/1491602836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a84157fe0 0x7f0a8414b3b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.123+0000 7f0a8a79e700 1 -- 172.21.15.81:0/1491602836 >> 172.21.15.81:0/1491602836 conn(0x7f0a84067640 msgr2=0x7f0a840cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.123+0000 7f0a8a79e700 1 -- 172.21.15.81:0/1491602836 shutdown_connections 2023-10-07T08:43:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.123+0000 7f0a8a79e700 1 -- 172.21.15.81:0/1491602836 wait complete. 2023-10-07T08:43:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:43:06.137 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-07T08:43:06.007051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1744,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560755,"statfs":{"total":1600000000,"available":1598213428,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.758219"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271947+0000","last_change":"2023-10-07T08:42:57.271845+0000","last_active":"2023-10-07T08:42:57.271947+0000","last_peered":"2023-10-07T08:42:57.271947+0000","last_clean":"2023-10-07T08:42:57.271947+0000","last_became_active":"2023-10-07T08:42:57.271412+0000","last_became_peered":"2023-10-07T08:42:57.271412+0000","last_unstale":"2023-10-07T08:42:57.271947+0000","last_undegraded":"2023-10-07T08:42:57.271947+0000","last_fullsized":"2023-10-07T08:42:57.271947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:22:57.366438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.253974+0000","last_change":"2023-10-07T08:42:57.253759+0000","last_active":"2023-10-07T08:42:57.253974+0000","last_peered":"2023-10-07T08:42:57.253974+0000","last_clean":"2023-10-07T08:42:57.253974+0000","last_became_active":"2023-10-07T08:42:57.253082+0000","last_became_peered":"2023-10-07T08:42:57.253082+0000","last_unstale":"2023-10-07T08:42:57.253974+0000","last_undegraded":"2023-10-07T08:42:57.253974+0000","last_fullsized":"2023-10-07T08:42:57.253974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264034+0000","last_change":"2023-10-07T08:42:57.262591+0000","last_active":"2023-10-07T08:42:57.264034+0000","last_peered":"2023-10-07T08:42:57.264034+0000","last_clean":"2023-10-07T08:42:57.264034+0000","last_became_active":"2023-10-07T08:42:57.261995+0000","last_became_peered":"2023-10-07T08:42:57.261995+0000","last_unstale":"2023-10-07T08:42:57.264034+0000","last_undegraded":"2023-10-07T08:42:57.264034+0000","last_fullsized":"2023-10-07T08:42:57.264034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:29:20.004471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271767+0000","last_change":"2023-10-07T08:42:57.269368+0000","last_active":"2023-10-07T08:42:57.271767+0000","last_peered":"2023-10-07T08:42:57.271767+0000","last_clean":"2023-10-07T08:42:57.271767+0000","last_became_active":"2023-10-07T08:42:57.268405+0000","last_became_peered":"2023-10-07T08:42:57.268405+0000","last_unstale":"2023-10-07T08:42:57.271767+0000","last_undegraded":"2023-10-07T08:42:57.271767+0000","last_fullsized":"2023-10-07T08:42:57.271767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.085430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265889+0000","last_change":"2023-10-07T08:42:57.265724+0000","last_active":"2023-10-07T08:42:57.265889+0000","last_peered":"2023-10-07T08:42:57.265889+0000","last_clean":"2023-10-07T08:42:57.265889+0000","last_became_active":"2023-10-07T08:42:57.265407+0000","last_became_peered":"2023-10-07T08:42:57.265407+0000","last_unstale":"2023-10-07T08:42:57.265889+0000","last_undegraded":"2023-10-07T08:42:57.265889+0000","last_fullsized":"2023-10-07T08:42:57.265889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.085430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273257+0000","last_change":"2023-10-07T08:42:57.273165+0000","last_active":"2023-10-07T08:42:57.273257+0000","last_peered":"2023-10-07T08:42:57.273257+0000","last_clean":"2023-10-07T08:42:57.273257+0000","last_became_active":"2023-10-07T08:42:57.272429+0000","last_became_peered":"2023-10-07T08:42:57.272429+0000","last_unstale":"2023-10-07T08:42:57.273257+0000","last_undegraded":"2023-10-07T08:42:57.273257+0000","last_fullsized":"2023-10-07T08:42:57.273257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:07:27.370919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266193+0000","last_change":"2023-10-07T08:42:57.266102+0000","last_active":"2023-10-07T08:42:57.266193+0000","last_peered":"2023-10-07T08:42:57.266193+0000","last_clean":"2023-10-07T08:42:57.266193+0000","last_became_active":"2023-10-07T08:42:57.265848+0000","last_became_peered":"2023-10-07T08:42:57.265848+0000","last_unstale":"2023-10-07T08:42:57.266193+0000","last_undegraded":"2023-10-07T08:42:57.266193+0000","last_fullsized":"2023-10-07T08:42:57.266193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:11:19.626256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.254466+0000","last_change":"2023-10-07T08:42:57.254408+0000","last_active":"2023-10-07T08:42:57.254466+0000","last_peered":"2023-10-07T08:42:57.254466+0000","last_clean":"2023-10-07T08:42:57.254466+0000","last_became_active":"2023-10-07T08:42:57.254176+0000","last_became_peered":"2023-10-07T08:42:57.254176+0000","last_unstale":"2023-10-07T08:42:57.254466+0000","last_undegraded":"2023-10-07T08:42:57.254466+0000","last_fullsized":"2023-10-07T08:42:57.254466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273333+0000","last_change":"2023-10-07T08:42:57.272880+0000","last_active":"2023-10-07T08:42:57.273333+0000","last_peered":"2023-10-07T08:42:57.273333+0000","last_clean":"2023-10-07T08:42:57.273333+0000","last_became_active":"2023-10-07T08:42:57.272657+0000","last_became_peered":"2023-10-07T08:42:57.272657+0000","last_unstale":"2023-10-07T08:42:57.273333+0000","last_undegraded":"2023-10-07T08:42:57.273333+0000","last_fullsized":"2023-10-07T08:42:57.273333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:14.856162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269087+0000","last_change":"2023-10-07T08:42:57.268989+0000","last_active":"2023-10-07T08:42:57.269087+0000","last_peered":"2023-10-07T08:42:57.269087+0000","last_clean":"2023-10-07T08:42:57.269087+0000","last_became_active":"2023-10-07T08:42:57.268767+0000","last_became_peered":"2023-10-07T08:42:57.268767+0000","last_unstale":"2023-10-07T08:42:57.269087+0000","last_undegraded":"2023-10-07T08:42:57.269087+0000","last_fullsized":"2023-10-07T08:42:57.269087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:25:20.586749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273482+0000","last_change":"2023-10-07T08:42:57.273400+0000","last_active":"2023-10-07T08:42:57.273482+0000","last_peered":"2023-10-07T08:42:57.273482+0000","last_clean":"2023-10-07T08:42:57.273482+0000","last_became_active":"2023-10-07T08:42:57.273173+0000","last_became_peered":"2023-10-07T08:42:57.273173+0000","last_unstale":"2023-10-07T08:42:57.273482+0000","last_undegraded":"2023-10-07T08:42:57.273482+0000","last_fullsized":"2023-10-07T08:42:57.273482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261699+0000","last_change":"2023-10-07T08:42:57.261158+0000","last_active":"2023-10-07T08:42:57.261699+0000","last_peered":"2023-10-07T08:42:57.261699+0000","last_clean":"2023-10-07T08:42:57.261699+0000","last_became_active":"2023-10-07T08:42:57.260929+0000","last_became_peered":"2023-10-07T08:42:57.260929+0000","last_unstale":"2023-10-07T08:42:57.261699+0000","last_undegraded":"2023-10-07T08:42:57.261699+0000","last_fullsized":"2023-10-07T08:42:57.261699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:25.788730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261649+0000","last_change":"2023-10-07T08:42:57.261591+0000","last_active":"2023-10-07T08:42:57.261649+0000","last_peered":"2023-10-07T08:42:57.261649+0000","last_clean":"2023-10-07T08:42:57.261649+0000","last_became_active":"2023-10-07T08:42:57.261195+0000","last_became_peered":"2023-10-07T08:42:57.261195+0000","last_unstale":"2023-10-07T08:42:57.261649+0000","last_undegraded":"2023-10-07T08:42:57.261649+0000","last_fullsized":"2023-10-07T08:42:57.261649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.085430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255844+0000","last_change":"2023-10-07T08:42:57.255722+0000","last_active":"2023-10-07T08:42:57.255844+0000","last_peered":"2023-10-07T08:42:57.255844+0000","last_clean":"2023-10-07T08:42:57.255844+0000","last_became_active":"2023-10-07T08:42:57.255058+0000","last_became_peered":"2023-10-07T08:42:57.255058+0000","last_unstale":"2023-10-07T08:42:57.255844+0000","last_undegraded":"2023-10-07T08:42:57.255844+0000","last_fullsized":"2023-10-07T08:42:57.255844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258968+0000","last_change":"2023-10-07T08:42:57.258735+0000","last_active":"2023-10-07T08:42:57.258968+0000","last_peered":"2023-10-07T08:42:57.258968+0000","last_clean":"2023-10-07T08:42:57.258968+0000","last_became_active":"2023-10-07T08:42:57.258531+0000","last_became_peered":"2023-10-07T08:42:57.258531+0000","last_unstale":"2023-10-07T08:42:57.258968+0000","last_undegraded":"2023-10-07T08:42:57.258968+0000","last_fullsized":"2023-10-07T08:42:57.258968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273242+0000","last_change":"2023-10-07T08:42:57.273000+0000","last_active":"2023-10-07T08:42:57.273242+0000","last_peered":"2023-10-07T08:42:57.273242+0000","last_clean":"2023-10-07T08:42:57.273242+0000","last_became_active":"2023-10-07T08:42:57.272147+0000","last_became_peered":"2023-10-07T08:42:57.272147+0000","last_unstale":"2023-10-07T08:42:57.273242+0000","last_undegraded":"2023-10-07T08:42:57.273242+0000","last_fullsized":"2023-10-07T08:42:57.273242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273615+0000","last_change":"2023-10-07T08:42:57.273534+0000","last_active":"2023-10-07T08:42:57.273615+0000","last_peered":"2023-10-07T08:42:57.273615+0000","last_clean":"2023-10-07T08:42:57.273615+0000","last_became_active":"2023-10-07T08:42:57.272752+0000","last_became_peered":"2023-10-07T08:42:57.272752+0000","last_unstale":"2023-10-07T08:42:57.273615+0000","last_undegraded":"2023-10-07T08:42:57.273615+0000","last_fullsized":"2023-10-07T08:42:57.273615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:14.856162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260472+0000","last_change":"2023-10-07T08:42:57.260016+0000","last_active":"2023-10-07T08:42:57.260472+0000","last_peered":"2023-10-07T08:42:57.260472+0000","last_clean":"2023-10-07T08:42:57.260472+0000","last_became_active":"2023-10-07T08:42:57.259796+0000","last_became_peered":"2023-10-07T08:42:57.259796+0000","last_unstale":"2023-10-07T08:42:57.260472+0000","last_undegraded":"2023-10-07T08:42:57.260472+0000","last_fullsized":"2023-10-07T08:42:57.260472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:44.958113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271244+0000","last_change":"2023-10-07T08:42:57.266814+0000","last_active":"2023-10-07T08:42:57.271244+0000","last_peered":"2023-10-07T08:42:57.271244+0000","last_clean":"2023-10-07T08:42:57.271244+0000","last_became_active":"2023-10-07T08:42:57.266212+0000","last_became_peered":"2023-10-07T08:42:57.266212+0000","last_unstale":"2023-10-07T08:42:57.271244+0000","last_undegraded":"2023-10-07T08:42:57.271244+0000","last_fullsized":"2023-10-07T08:42:57.271244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:56.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265572+0000","last_change":"2023-10-07T08:42:56.259068+0000","last_active":"2023-10-07T08:42:57.265572+0000","last_peered":"2023-10-07T08:42:57.265572+0000","last_clean":"2023-10-07T08:42:57.265572+0000","last_became_active":"2023-10-07T08:42:56.258934+0000","last_became_peered":"2023-10-07T08:42:56.258934+0000","last_unstale":"2023-10-07T08:42:57.265572+0000","last_undegraded":"2023-10-07T08:42:57.265572+0000","last_fullsized":"2023-10-07T08:42:57.265572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264519+0000","last_change":"2023-10-07T08:42:57.264466+0000","last_active":"2023-10-07T08:42:57.264519+0000","last_peered":"2023-10-07T08:42:57.264519+0000","last_clean":"2023-10-07T08:42:57.264519+0000","last_became_active":"2023-10-07T08:42:57.263468+0000","last_became_peered":"2023-10-07T08:42:57.263468+0000","last_unstale":"2023-10-07T08:42:57.264519+0000","last_undegraded":"2023-10-07T08:42:57.264519+0000","last_fullsized":"2023-10-07T08:42:57.264519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:07.393104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264975+0000","last_change":"2023-10-07T08:42:56.257405+0000","last_active":"2023-10-07T08:42:57.264975+0000","last_peered":"2023-10-07T08:42:57.264975+0000","last_clean":"2023-10-07T08:42:57.264975+0000","last_became_active":"2023-10-07T08:42:56.257065+0000","last_became_peered":"2023-10-07T08:42:56.257065+0000","last_unstale":"2023-10-07T08:42:57.264975+0000","last_undegraded":"2023-10-07T08:42:57.264975+0000","last_fullsized":"2023-10-07T08:42:57.264975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267546+0000","last_change":"2023-10-07T08:42:57.267485+0000","last_active":"2023-10-07T08:42:57.267546+0000","last_peered":"2023-10-07T08:42:57.267546+0000","last_clean":"2023-10-07T08:42:57.267546+0000","last_became_active":"2023-10-07T08:42:57.267277+0000","last_became_peered":"2023-10-07T08:42:57.267277+0000","last_unstale":"2023-10-07T08:42:57.267546+0000","last_undegraded":"2023-10-07T08:42:57.267546+0000","last_fullsized":"2023-10-07T08:42:57.267546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:13:34.785663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271811+0000","last_change":"2023-10-07T08:42:56.260298+0000","last_active":"2023-10-07T08:42:57.271811+0000","last_peered":"2023-10-07T08:42:57.271811+0000","last_clean":"2023-10-07T08:42:57.271811+0000","last_became_active":"2023-10-07T08:42:56.260074+0000","last_became_peered":"2023-10-07T08:42:56.260074+0000","last_unstale":"2023-10-07T08:42:57.271811+0000","last_undegraded":"2023-10-07T08:42:57.271811+0000","last_fullsized":"2023-10-07T08:42:57.271811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:00:57.309769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273224+0000","last_change":"2023-10-07T08:42:57.272854+0000","last_active":"2023-10-07T08:42:57.273224+0000","last_peered":"2023-10-07T08:42:57.273224+0000","last_clean":"2023-10-07T08:42:57.273224+0000","last_became_active":"2023-10-07T08:42:57.271880+0000","last_became_peered":"2023-10-07T08:42:57.271880+0000","last_unstale":"2023-10-07T08:42:57.273224+0000","last_undegraded":"2023-10-07T08:42:57.273224+0000","last_fullsized":"2023-10-07T08:42:57.273224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:11:19.626256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273211+0000","last_change":"2023-10-07T08:42:56.263017+0000","last_active":"2023-10-07T08:42:57.273211+0000","last_peered":"2023-10-07T08:42:57.273211+0000","last_clean":"2023-10-07T08:42:57.273211+0000","last_became_active":"2023-10-07T08:42:56.262769+0000","last_became_peered":"2023-10-07T08:42:56.262769+0000","last_unstale":"2023-10-07T08:42:57.273211+0000","last_undegraded":"2023-10-07T08:42:57.273211+0000","last_fullsized":"2023-10-07T08:42:57.273211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:35:43.604383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271875+0000","last_change":"2023-10-07T08:42:57.271009+0000","last_active":"2023-10-07T08:42:57.271875+0000","last_peered":"2023-10-07T08:42:57.271875+0000","last_clean":"2023-10-07T08:42:57.271875+0000","last_became_active":"2023-10-07T08:42:57.270777+0000","last_became_peered":"2023-10-07T08:42:57.270777+0000","last_unstale":"2023-10-07T08:42:57.271875+0000","last_undegraded":"2023-10-07T08:42:57.271875+0000","last_fullsized":"2023-10-07T08:42:57.271875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261893+0000","last_change":"2023-10-07T08:42:56.257276+0000","last_active":"2023-10-07T08:42:57.261893+0000","last_peered":"2023-10-07T08:42:57.261893+0000","last_clean":"2023-10-07T08:42:57.261893+0000","last_became_active":"2023-10-07T08:42:56.257051+0000","last_became_peered":"2023-10-07T08:42:56.257051+0000","last_unstale":"2023-10-07T08:42:57.261893+0000","last_undegraded":"2023-10-07T08:42:57.261893+0000","last_fullsized":"2023-10-07T08:42:57.261893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.256705+0000","last_change":"2023-10-07T08:42:57.256645+0000","last_active":"2023-10-07T08:42:57.256705+0000","last_peered":"2023-10-07T08:42:57.256705+0000","last_clean":"2023-10-07T08:42:57.256705+0000","last_became_active":"2023-10-07T08:42:57.256312+0000","last_became_peered":"2023-10-07T08:42:57.256312+0000","last_unstale":"2023-10-07T08:42:57.256705+0000","last_undegraded":"2023-10-07T08:42:57.256705+0000","last_fullsized":"2023-10-07T08:42:57.256705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:44.958113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261595+0000","last_change":"2023-10-07T08:42:56.256216+0000","last_active":"2023-10-07T08:42:57.261595+0000","last_peered":"2023-10-07T08:42:57.261595+0000","last_clean":"2023-10-07T08:42:57.261595+0000","last_became_active":"2023-10-07T08:42:56.255763+0000","last_became_peered":"2023-10-07T08:42:56.255763+0000","last_unstale":"2023-10-07T08:42:57.261595+0000","last_undegraded":"2023-10-07T08:42:57.261595+0000","last_fullsized":"2023-10-07T08:42:57.261595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260680+0000","last_change":"2023-10-07T08:42:57.260111+0000","last_active":"2023-10-07T08:42:57.260680+0000","last_peered":"2023-10-07T08:42:57.260680+0000","last_clean":"2023-10-07T08:42:57.260680+0000","last_became_active":"2023-10-07T08:42:57.259887+0000","last_became_peered":"2023-10-07T08:42:57.259887+0000","last_unstale":"2023-10-07T08:42:57.260680+0000","last_undegraded":"2023-10-07T08:42:57.260680+0000","last_fullsized":"2023-10-07T08:42:57.260680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:07.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.249477+0000","last_change":"2023-10-07T08:42:56.256584+0000","last_active":"2023-10-07T08:42:57.249477+0000","last_peered":"2023-10-07T08:42:57.249477+0000","last_clean":"2023-10-07T08:42:57.249477+0000","last_became_active":"2023-10-07T08:42:56.256306+0000","last_became_peered":"2023-10-07T08:42:56.256306+0000","last_unstale":"2023-10-07T08:42:57.249477+0000","last_undegraded":"2023-10-07T08:42:57.249477+0000","last_fullsized":"2023-10-07T08:42:57.249477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255482+0000","last_change":"2023-10-07T08:42:57.255428+0000","last_active":"2023-10-07T08:42:57.255482+0000","last_peered":"2023-10-07T08:42:57.255482+0000","last_clean":"2023-10-07T08:42:57.255482+0000","last_became_active":"2023-10-07T08:42:57.255284+0000","last_became_peered":"2023-10-07T08:42:57.255284+0000","last_unstale":"2023-10-07T08:42:57.255482+0000","last_undegraded":"2023-10-07T08:42:57.255482+0000","last_fullsized":"2023-10-07T08:42:57.255482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267031+0000","last_change":"2023-10-07T08:42:56.260669+0000","last_active":"2023-10-07T08:42:57.267031+0000","last_peered":"2023-10-07T08:42:57.267031+0000","last_clean":"2023-10-07T08:42:57.267031+0000","last_became_active":"2023-10-07T08:42:56.260436+0000","last_became_peered":"2023-10-07T08:42:56.260436+0000","last_unstale":"2023-10-07T08:42:57.267031+0000","last_undegraded":"2023-10-07T08:42:57.267031+0000","last_fullsized":"2023-10-07T08:42:57.267031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:47:14.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.257501+0000","last_change":"2023-10-07T08:42:57.257451+0000","last_active":"2023-10-07T08:42:57.257501+0000","last_peered":"2023-10-07T08:42:57.257501+0000","last_clean":"2023-10-07T08:42:57.257501+0000","last_became_active":"2023-10-07T08:42:57.257263+0000","last_became_peered":"2023-10-07T08:42:57.257263+0000","last_unstale":"2023-10-07T08:42:57.257501+0000","last_undegraded":"2023-10-07T08:42:57.257501+0000","last_fullsized":"2023-10-07T08:42:57.257501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255592+0000","last_change":"2023-10-07T08:42:56.261241+0000","last_active":"2023-10-07T08:42:57.255592+0000","last_peered":"2023-10-07T08:42:57.255592+0000","last_clean":"2023-10-07T08:42:57.255592+0000","last_became_active":"2023-10-07T08:42:56.261003+0000","last_became_peered":"2023-10-07T08:42:56.261003+0000","last_unstale":"2023-10-07T08:42:57.255592+0000","last_undegraded":"2023-10-07T08:42:57.255592+0000","last_fullsized":"2023-10-07T08:42:57.255592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273393+0000","last_change":"2023-10-07T08:42:57.273272+0000","last_active":"2023-10-07T08:42:57.273393+0000","last_peered":"2023-10-07T08:42:57.273393+0000","last_clean":"2023-10-07T08:42:57.273393+0000","last_became_active":"2023-10-07T08:42:57.272090+0000","last_became_peered":"2023-10-07T08:42:57.272090+0000","last_unstale":"2023-10-07T08:42:57.273393+0000","last_undegraded":"2023-10-07T08:42:57.273393+0000","last_fullsized":"2023-10-07T08:42:57.273393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:48.342893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255238+0000","last_change":"2023-10-07T08:42:56.260346+0000","last_active":"2023-10-07T08:42:57.255238+0000","last_peered":"2023-10-07T08:42:57.255238+0000","last_clean":"2023-10-07T08:42:57.255238+0000","last_became_active":"2023-10-07T08:42:56.259661+0000","last_became_peered":"2023-10-07T08:42:56.259661+0000","last_unstale":"2023-10-07T08:42:57.255238+0000","last_undegraded":"2023-10-07T08:42:57.255238+0000","last_fullsized":"2023-10-07T08:42:57.255238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:21.295203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273960+0000","last_change":"2023-10-07T08:42:57.273913+0000","last_active":"2023-10-07T08:42:57.273960+0000","last_peered":"2023-10-07T08:42:57.273960+0000","last_clean":"2023-10-07T08:42:57.273960+0000","last_became_active":"2023-10-07T08:42:57.273631+0000","last_became_peered":"2023-10-07T08:42:57.273631+0000","last_unstale":"2023-10-07T08:42:57.273960+0000","last_undegraded":"2023-10-07T08:42:57.273960+0000","last_fullsized":"2023-10-07T08:42:57.273960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:07.393104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271888+0000","last_change":"2023-10-07T08:42:56.257713+0000","last_active":"2023-10-07T08:42:57.271888+0000","last_peered":"2023-10-07T08:42:57.271888+0000","last_clean":"2023-10-07T08:42:57.271888+0000","last_became_active":"2023-10-07T08:42:56.257481+0000","last_became_peered":"2023-10-07T08:42:56.257481+0000","last_unstale":"2023-10-07T08:42:57.271888+0000","last_undegraded":"2023-10-07T08:42:57.271888+0000","last_fullsized":"2023-10-07T08:42:57.271888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:43.953599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266459+0000","last_change":"2023-10-07T08:42:57.266396+0000","last_active":"2023-10-07T08:42:57.266459+0000","last_peered":"2023-10-07T08:42:57.266459+0000","last_clean":"2023-10-07T08:42:57.266459+0000","last_became_active":"2023-10-07T08:42:57.266029+0000","last_became_peered":"2023-10-07T08:42:57.266029+0000","last_unstale":"2023-10-07T08:42:57.266459+0000","last_undegraded":"2023-10-07T08:42:57.266459+0000","last_fullsized":"2023-10-07T08:42:57.266459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:22.299718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269611+0000","last_change":"2023-10-07T08:42:56.259429+0000","last_active":"2023-10-07T08:42:57.269611+0000","last_peered":"2023-10-07T08:42:57.269611+0000","last_clean":"2023-10-07T08:42:57.269611+0000","last_became_active":"2023-10-07T08:42:56.259154+0000","last_became_peered":"2023-10-07T08:42:56.259154+0000","last_unstale":"2023-10-07T08:42:57.269611+0000","last_undegraded":"2023-10-07T08:42:57.269611+0000","last_fullsized":"2023-10-07T08:42:57.269611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265027+0000","last_change":"2023-10-07T08:42:57.262943+0000","last_active":"2023-10-07T08:42:57.265027+0000","last_peered":"2023-10-07T08:42:57.265027+0000","last_clean":"2023-10-07T08:42:57.265027+0000","last_became_active":"2023-10-07T08:42:57.262707+0000","last_became_peered":"2023-10-07T08:42:57.262707+0000","last_unstale":"2023-10-07T08:42:57.265027+0000","last_undegraded":"2023-10-07T08:42:57.265027+0000","last_fullsized":"2023-10-07T08:42:57.265027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269382+0000","last_change":"2023-10-07T08:42:56.250565+0000","last_active":"2023-10-07T08:42:57.269382+0000","last_peered":"2023-10-07T08:42:57.269382+0000","last_clean":"2023-10-07T08:42:57.269382+0000","last_became_active":"2023-10-07T08:42:56.250326+0000","last_became_peered":"2023-10-07T08:42:56.250326+0000","last_unstale":"2023-10-07T08:42:57.269382+0000","last_undegraded":"2023-10-07T08:42:57.269382+0000","last_fullsized":"2023-10-07T08:42:57.269382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264073+0000","last_change":"2023-10-07T08:42:57.263608+0000","last_active":"2023-10-07T08:42:57.264073+0000","last_peered":"2023-10-07T08:42:57.264073+0000","last_clean":"2023-10-07T08:42:57.264073+0000","last_became_active":"2023-10-07T08:42:57.262971+0000","last_became_peered":"2023-10-07T08:42:57.262971+0000","last_unstale":"2023-10-07T08:42:57.264073+0000","last_undegraded":"2023-10-07T08:42:57.264073+0000","last_fullsized":"2023-10-07T08:42:57.264073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269407+0000","last_change":"2023-10-07T08:42:56.262332+0000","last_active":"2023-10-07T08:42:57.269407+0000","last_peered":"2023-10-07T08:42:57.269407+0000","last_clean":"2023-10-07T08:42:57.269407+0000","last_became_active":"2023-10-07T08:42:56.261913+0000","last_became_peered":"2023-10-07T08:42:56.261913+0000","last_unstale":"2023-10-07T08:42:57.269407+0000","last_undegraded":"2023-10-07T08:42:57.269407+0000","last_fullsized":"2023-10-07T08:42:57.269407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:47.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273297+0000","last_change":"2023-10-07T08:42:57.271943+0000","last_active":"2023-10-07T08:42:57.273297+0000","last_peered":"2023-10-07T08:42:57.273297+0000","last_clean":"2023-10-07T08:42:57.273297+0000","last_became_active":"2023-10-07T08:42:57.271217+0000","last_became_peered":"2023-10-07T08:42:57.271217+0000","last_unstale":"2023-10-07T08:42:57.273297+0000","last_undegraded":"2023-10-07T08:42:57.273297+0000","last_fullsized":"2023-10-07T08:42:57.273297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:07:27.370919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.259993+0000","last_change":"2023-10-07T08:42:56.259497+0000","last_active":"2023-10-07T08:42:57.259993+0000","last_peered":"2023-10-07T08:42:57.259993+0000","last_clean":"2023-10-07T08:42:57.259993+0000","last_became_active":"2023-10-07T08:42:56.259259+0000","last_became_peered":"2023-10-07T08:42:56.259259+0000","last_unstale":"2023-10-07T08:42:57.259993+0000","last_undegraded":"2023-10-07T08:42:57.259993+0000","last_fullsized":"2023-10-07T08:42:57.259993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:47.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267342+0000","last_change":"2023-10-07T08:42:57.264611+0000","last_active":"2023-10-07T08:42:57.267342+0000","last_peered":"2023-10-07T08:42:57.267342+0000","last_clean":"2023-10-07T08:42:57.267342+0000","last_became_active":"2023-10-07T08:42:57.264371+0000","last_became_peered":"2023-10-07T08:42:57.264371+0000","last_unstale":"2023-10-07T08:42:57.267342+0000","last_undegraded":"2023-10-07T08:42:57.267342+0000","last_fullsized":"2023-10-07T08:42:57.267342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.262375+0000","last_change":"2023-10-07T08:42:56.254762+0000","last_active":"2023-10-07T08:42:57.262375+0000","last_peered":"2023-10-07T08:42:57.262375+0000","last_clean":"2023-10-07T08:42:57.262375+0000","last_became_active":"2023-10-07T08:42:56.254460+0000","last_became_peered":"2023-10-07T08:42:56.254460+0000","last_unstale":"2023-10-07T08:42:57.262375+0000","last_undegraded":"2023-10-07T08:42:57.262375+0000","last_fullsized":"2023-10-07T08:42:57.262375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265088+0000","last_change":"2023-10-07T08:42:57.264712+0000","last_active":"2023-10-07T08:42:57.265088+0000","last_peered":"2023-10-07T08:42:57.265088+0000","last_clean":"2023-10-07T08:42:57.265088+0000","last_became_active":"2023-10-07T08:42:57.264380+0000","last_became_peered":"2023-10-07T08:42:57.264380+0000","last_unstale":"2023-10-07T08:42:57.265088+0000","last_undegraded":"2023-10-07T08:42:57.265088+0000","last_fullsized":"2023-10-07T08:42:57.265088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:48.342893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.257527+0000","last_change":"2023-10-07T08:42:56.253642+0000","last_active":"2023-10-07T08:42:57.257527+0000","last_peered":"2023-10-07T08:42:57.257527+0000","last_clean":"2023-10-07T08:42:57.257527+0000","last_became_active":"2023-10-07T08:42:56.253183+0000","last_became_peered":"2023-10-07T08:42:56.253183+0000","last_unstale":"2023-10-07T08:42:57.257527+0000","last_undegraded":"2023-10-07T08:42:57.257527+0000","last_fullsized":"2023-10-07T08:42:57.257527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:35.495354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273316+0000","last_change":"2023-10-07T08:42:57.272080+0000","last_active":"2023-10-07T08:42:57.273316+0000","last_peered":"2023-10-07T08:42:57.273316+0000","last_clean":"2023-10-07T08:42:57.273316+0000","last_became_active":"2023-10-07T08:42:57.271505+0000","last_became_peered":"2023-10-07T08:42:57.271505+0000","last_unstale":"2023-10-07T08:42:57.273316+0000","last_undegraded":"2023-10-07T08:42:57.273316+0000","last_fullsized":"2023-10-07T08:42:57.273316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:29.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.251426+0000","last_change":"2023-10-07T08:42:56.253289+0000","last_active":"2023-10-07T08:42:57.251426+0000","last_peered":"2023-10-07T08:42:57.251426+0000","last_clean":"2023-10-07T08:42:57.251426+0000","last_became_active":"2023-10-07T08:42:56.253058+0000","last_became_peered":"2023-10-07T08:42:56.253058+0000","last_unstale":"2023-10-07T08:42:57.251426+0000","last_undegraded":"2023-10-07T08:42:57.251426+0000","last_fullsized":"2023-10-07T08:42:57.251426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271749+0000","last_change":"2023-10-07T08:42:57.269245+0000","last_active":"2023-10-07T08:42:57.271749+0000","last_peered":"2023-10-07T08:42:57.271749+0000","last_clean":"2023-10-07T08:42:57.271749+0000","last_became_active":"2023-10-07T08:42:57.268139+0000","last_became_peered":"2023-10-07T08:42:57.268139+0000","last_unstale":"2023-10-07T08:42:57.271749+0000","last_undegraded":"2023-10-07T08:42:57.271749+0000","last_fullsized":"2023-10-07T08:42:57.271749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:56.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255341+0000","last_change":"2023-10-07T08:42:56.262012+0000","last_active":"2023-10-07T08:42:57.255341+0000","last_peered":"2023-10-07T08:42:57.255341+0000","last_clean":"2023-10-07T08:42:57.255341+0000","last_became_active":"2023-10-07T08:42:56.261812+0000","last_became_peered":"2023-10-07T08:42:56.261812+0000","last_unstale":"2023-10-07T08:42:57.255341+0000","last_undegraded":"2023-10-07T08:42:57.255341+0000","last_fullsized":"2023-10-07T08:42:57.255341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:43.953599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264986+0000","last_change":"2023-10-07T08:42:57.264887+0000","last_active":"2023-10-07T08:42:57.264986+0000","last_peered":"2023-10-07T08:42:57.264986+0000","last_clean":"2023-10-07T08:42:57.264986+0000","last_became_active":"2023-10-07T08:42:57.264651+0000","last_became_peered":"2023-10-07T08:42:57.264651+0000","last_unstale":"2023-10-07T08:42:57.264986+0000","last_undegraded":"2023-10-07T08:42:57.264986+0000","last_fullsized":"2023-10-07T08:42:57.264986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:32.698757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.252401+0000","last_change":"2023-10-07T08:42:57.252321+0000","last_active":"2023-10-07T08:42:57.252401+0000","last_peered":"2023-10-07T08:42:57.252401+0000","last_clean":"2023-10-07T08:42:57.252401+0000","last_became_active":"2023-10-07T08:42:57.252102+0000","last_became_peered":"2023-10-07T08:42:57.252102+0000","last_unstale":"2023-10-07T08:42:57.252401+0000","last_undegraded":"2023-10-07T08:42:57.252401+0000","last_fullsized":"2023-10-07T08:42:57.252401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:07.393104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.250654+0000","last_change":"2023-10-07T08:42:56.255406+0000","last_active":"2023-10-07T08:42:57.250654+0000","last_peered":"2023-10-07T08:42:57.250654+0000","last_clean":"2023-10-07T08:42:57.250654+0000","last_became_active":"2023-10-07T08:42:56.255167+0000","last_became_peered":"2023-10-07T08:42:56.255167+0000","last_unstale":"2023-10-07T08:42:57.250654+0000","last_undegraded":"2023-10-07T08:42:57.250654+0000","last_fullsized":"2023-10-07T08:42:57.250654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.268877+0000","last_change":"2023-10-07T08:42:57.268830+0000","last_active":"2023-10-07T08:42:57.268877+0000","last_peered":"2023-10-07T08:42:57.268877+0000","last_clean":"2023-10-07T08:42:57.268877+0000","last_became_active":"2023-10-07T08:42:57.268514+0000","last_became_peered":"2023-10-07T08:42:57.268514+0000","last_unstale":"2023-10-07T08:42:57.268877+0000","last_undegraded":"2023-10-07T08:42:57.268877+0000","last_fullsized":"2023-10-07T08:42:57.268877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:56.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269521+0000","last_change":"2023-10-07T08:42:56.262059+0000","last_active":"2023-10-07T08:42:57.269521+0000","last_peered":"2023-10-07T08:42:57.269521+0000","last_clean":"2023-10-07T08:42:57.269521+0000","last_became_active":"2023-10-07T08:42:56.260888+0000","last_became_peered":"2023-10-07T08:42:56.260888+0000","last_unstale":"2023-10-07T08:42:57.269521+0000","last_undegraded":"2023-10-07T08:42:57.269521+0000","last_fullsized":"2023-10-07T08:42:57.269521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.262180+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:42:57.262180+0000","last_peered":"2023-10-07T08:42:57.262180+0000","last_clean":"2023-10-07T08:42:57.262180+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:42:57.262180+0000","last_undegraded":"2023-10-07T08:42:57.262180+0000","last_fullsized":"2023-10-07T08:42:57.262180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264015+0000","last_change":"2023-10-07T08:42:57.262498+0000","last_active":"2023-10-07T08:42:57.264015+0000","last_peered":"2023-10-07T08:42:57.264015+0000","last_clean":"2023-10-07T08:42:57.264015+0000","last_became_active":"2023-10-07T08:42:57.261704+0000","last_became_peered":"2023-10-07T08:42:57.261704+0000","last_unstale":"2023-10-07T08:42:57.264015+0000","last_undegraded":"2023-10-07T08:42:57.264015+0000","last_fullsized":"2023-10-07T08:42:57.264015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260276+0000","last_change":"2023-10-07T08:42:56.259333+0000","last_active":"2023-10-07T08:42:57.260276+0000","last_peered":"2023-10-07T08:42:57.260276+0000","last_clean":"2023-10-07T08:42:57.260276+0000","last_became_active":"2023-10-07T08:42:56.259178+0000","last_became_peered":"2023-10-07T08:42:56.259178+0000","last_unstale":"2023-10-07T08:42:57.260276+0000","last_undegraded":"2023-10-07T08:42:57.260276+0000","last_fullsized":"2023-10-07T08:42:57.260276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:43.953599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260369+0000","last_change":"2023-10-07T08:42:56.262061+0000","last_active":"2023-10-07T08:42:57.260369+0000","last_peered":"2023-10-07T08:42:57.260369+0000","last_clean":"2023-10-07T08:42:57.260369+0000","last_became_active":"2023-10-07T08:42:56.261842+0000","last_became_peered":"2023-10-07T08:42:56.261842+0000","last_unstale":"2023-10-07T08:42:57.260369+0000","last_undegraded":"2023-10-07T08:42:57.260369+0000","last_fullsized":"2023-10-07T08:42:57.260369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.254098+0000","last_change":"2023-10-07T08:42:57.253993+0000","last_active":"2023-10-07T08:42:57.254098+0000","last_peered":"2023-10-07T08:42:57.254098+0000","last_clean":"2023-10-07T08:42:57.254098+0000","last_became_active":"2023-10-07T08:42:57.253775+0000","last_became_peered":"2023-10-07T08:42:57.253775+0000","last_unstale":"2023-10-07T08:42:57.254098+0000","last_undegraded":"2023-10-07T08:42:57.254098+0000","last_fullsized":"2023-10-07T08:42:57.254098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-07T08:42:58.827418+0000","last_change":"2023-10-07T08:42:56.256312+0000","last_active":"2023-10-07T08:42:58.827418+0000","last_peered":"2023-10-07T08:42:58.827418+0000","last_clean":"2023-10-07T08:42:58.827418+0000","last_became_active":"2023-10-07T08:42:56.256095+0000","last_became_peered":"2023-10-07T08:42:56.256095+0000","last_unstale":"2023-10-07T08:42:58.827418+0000","last_undegraded":"2023-10-07T08:42:58.827418+0000","last_fullsized":"2023-10-07T08:42:58.827418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:21.295203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266691+0000","last_change":"2023-10-07T08:42:57.266642+0000","last_active":"2023-10-07T08:42:57.266691+0000","last_peered":"2023-10-07T08:42:57.266691+0000","last_clean":"2023-10-07T08:42:57.266691+0000","last_became_active":"2023-10-07T08:42:57.266480+0000","last_became_peered":"2023-10-07T08:42:57.266480+0000","last_unstale":"2023-10-07T08:42:57.266691+0000","last_undegraded":"2023-10-07T08:42:57.266691+0000","last_fullsized":"2023-10-07T08:42:57.266691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:07.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271789+0000","last_change":"2023-10-07T08:42:56.257795+0000","last_active":"2023-10-07T08:42:57.271789+0000","last_peered":"2023-10-07T08:42:57.271789+0000","last_clean":"2023-10-07T08:42:57.271789+0000","last_became_active":"2023-10-07T08:42:56.257560+0000","last_became_peered":"2023-10-07T08:42:56.257560+0000","last_unstale":"2023-10-07T08:42:57.271789+0000","last_undegraded":"2023-10-07T08:42:57.271789+0000","last_fullsized":"2023-10-07T08:42:57.271789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.263996+0000","last_change":"2023-10-07T08:42:57.262219+0000","last_active":"2023-10-07T08:42:57.263996+0000","last_peered":"2023-10-07T08:42:57.263996+0000","last_clean":"2023-10-07T08:42:57.263996+0000","last_became_active":"2023-10-07T08:42:57.261413+0000","last_became_peered":"2023-10-07T08:42:57.261413+0000","last_unstale":"2023-10-07T08:42:57.263996+0000","last_undegraded":"2023-10-07T08:42:57.263996+0000","last_fullsized":"2023-10-07T08:42:57.263996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:25:20.586749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261906+0000","last_change":"2023-10-07T08:42:56.258484+0000","last_active":"2023-10-07T08:42:57.261906+0000","last_peered":"2023-10-07T08:42:57.261906+0000","last_clean":"2023-10-07T08:42:57.261906+0000","last_became_active":"2023-10-07T08:42:56.258243+0000","last_became_peered":"2023-10-07T08:42:56.258243+0000","last_unstale":"2023-10-07T08:42:57.261906+0000","last_undegraded":"2023-10-07T08:42:57.261906+0000","last_fullsized":"2023-10-07T08:42:57.261906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:24.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258408+0000","last_change":"2023-10-07T08:42:57.258345+0000","last_active":"2023-10-07T08:42:57.258408+0000","last_peered":"2023-10-07T08:42:57.258408+0000","last_clean":"2023-10-07T08:42:57.258408+0000","last_became_active":"2023-10-07T08:42:57.257563+0000","last_became_peered":"2023-10-07T08:42:57.257563+0000","last_unstale":"2023-10-07T08:42:57.258408+0000","last_undegraded":"2023-10-07T08:42:57.258408+0000","last_fullsized":"2023-10-07T08:42:57.258408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:00:58.314283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.251512+0000","last_change":"2023-10-07T08:42:56.259479+0000","last_active":"2023-10-07T08:42:57.251512+0000","last_peered":"2023-10-07T08:42:57.251512+0000","last_clean":"2023-10-07T08:42:57.251512+0000","last_became_active":"2023-10-07T08:42:56.259257+0000","last_became_peered":"2023-10-07T08:42:56.259257+0000","last_unstale":"2023-10-07T08:42:57.251512+0000","last_undegraded":"2023-10-07T08:42:57.251512+0000","last_fullsized":"2023-10-07T08:42:57.251512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:00:57.309769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.253038+0000","last_change":"2023-10-07T08:42:57.252823+0000","last_active":"2023-10-07T08:42:57.253038+0000","last_peered":"2023-10-07T08:42:57.253038+0000","last_clean":"2023-10-07T08:42:57.253038+0000","last_became_active":"2023-10-07T08:42:57.252606+0000","last_became_peered":"2023-10-07T08:42:57.252606+0000","last_unstale":"2023-10-07T08:42:57.253038+0000","last_undegraded":"2023-10-07T08:42:57.253038+0000","last_fullsized":"2023-10-07T08:42:57.253038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:25.788730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.251872+0000","last_change":"2023-10-07T08:42:56.255715+0000","last_active":"2023-10-07T08:42:57.251872+0000","last_peered":"2023-10-07T08:42:57.251872+0000","last_clean":"2023-10-07T08:42:57.251872+0000","last_became_active":"2023-10-07T08:42:56.255502+0000","last_became_peered":"2023-10-07T08:42:56.255502+0000","last_unstale":"2023-10-07T08:42:57.251872+0000","last_undegraded":"2023-10-07T08:42:57.251872+0000","last_fullsized":"2023-10-07T08:42:57.251872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:47:14.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261586+0000","last_change":"2023-10-07T08:42:57.261460+0000","last_active":"2023-10-07T08:42:57.261586+0000","last_peered":"2023-10-07T08:42:57.261586+0000","last_clean":"2023-10-07T08:42:57.261586+0000","last_became_active":"2023-10-07T08:42:57.260893+0000","last_became_peered":"2023-10-07T08:42:57.260893+0000","last_unstale":"2023-10-07T08:42:57.261586+0000","last_undegraded":"2023-10-07T08:42:57.261586+0000","last_fullsized":"2023-10-07T08:42:57.261586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273745+0000","last_change":"2023-10-07T08:42:56.258635+0000","last_active":"2023-10-07T08:42:57.273745+0000","last_peered":"2023-10-07T08:42:57.273745+0000","last_clean":"2023-10-07T08:42:57.273745+0000","last_became_active":"2023-10-07T08:42:56.258323+0000","last_became_peered":"2023-10-07T08:42:56.258323+0000","last_unstale":"2023-10-07T08:42:57.273745+0000","last_undegraded":"2023-10-07T08:42:57.273745+0000","last_fullsized":"2023-10-07T08:42:57.273745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260549+0000","last_change":"2023-10-07T08:42:57.259849+0000","last_active":"2023-10-07T08:42:57.260549+0000","last_peered":"2023-10-07T08:42:57.260549+0000","last_clean":"2023-10-07T08:42:57.260549+0000","last_became_active":"2023-10-07T08:42:57.259625+0000","last_became_peered":"2023-10-07T08:42:57.259625+0000","last_unstale":"2023-10-07T08:42:57.260549+0000","last_undegraded":"2023-10-07T08:42:57.260549+0000","last_fullsized":"2023-10-07T08:42:57.260549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.250640+0000","last_change":"2023-10-07T08:42:56.260384+0000","last_active":"2023-10-07T08:42:57.250640+0000","last_peered":"2023-10-07T08:42:57.250640+0000","last_clean":"2023-10-07T08:42:57.250640+0000","last_became_active":"2023-10-07T08:42:56.260141+0000","last_became_peered":"2023-10-07T08:42:56.260141+0000","last_unstale":"2023-10-07T08:42:57.250640+0000","last_undegraded":"2023-10-07T08:42:57.250640+0000","last_fullsized":"2023-10-07T08:42:57.250640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.274600+0000","last_change":"2023-10-07T08:42:57.273820+0000","last_active":"2023-10-07T08:42:57.274600+0000","last_peered":"2023-10-07T08:42:57.274600+0000","last_clean":"2023-10-07T08:42:57.274600+0000","last_became_active":"2023-10-07T08:42:57.273591+0000","last_became_peered":"2023-10-07T08:42:57.273591+0000","last_unstale":"2023-10-07T08:42:57.274600+0000","last_undegraded":"2023-10-07T08:42:57.274600+0000","last_fullsized":"2023-10-07T08:42:57.274600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:56.744706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261775+0000","last_change":"2023-10-07T08:42:56.253272+0000","last_active":"2023-10-07T08:42:57.261775+0000","last_peered":"2023-10-07T08:42:57.261775+0000","last_clean":"2023-10-07T08:42:57.261775+0000","last_became_active":"2023-10-07T08:42:56.253029+0000","last_became_peered":"2023-10-07T08:42:56.253029+0000","last_unstale":"2023-10-07T08:42:57.261775+0000","last_undegraded":"2023-10-07T08:42:57.261775+0000","last_fullsized":"2023-10-07T08:42:57.261775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:47.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266923+0000","last_change":"2023-10-07T08:42:57.266372+0000","last_active":"2023-10-07T08:42:57.266923+0000","last_peered":"2023-10-07T08:42:57.266923+0000","last_clean":"2023-10-07T08:42:57.266923+0000","last_became_active":"2023-10-07T08:42:57.266237+0000","last_became_peered":"2023-10-07T08:42:57.266237+0000","last_unstale":"2023-10-07T08:42:57.266923+0000","last_undegraded":"2023-10-07T08:42:57.266923+0000","last_fullsized":"2023-10-07T08:42:57.266923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:29.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264466+0000","last_change":"2023-10-07T08:42:56.257581+0000","last_active":"2023-10-07T08:42:57.264466+0000","last_peered":"2023-10-07T08:42:57.264466+0000","last_clean":"2023-10-07T08:42:57.264466+0000","last_became_active":"2023-10-07T08:42:56.257339+0000","last_became_peered":"2023-10-07T08:42:56.257339+0000","last_unstale":"2023-10-07T08:42:57.264466+0000","last_undegraded":"2023-10-07T08:42:57.264466+0000","last_fullsized":"2023-10-07T08:42:57.264466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:40.492004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266968+0000","last_change":"2023-10-07T08:42:57.266483+0000","last_active":"2023-10-07T08:42:57.266968+0000","last_peered":"2023-10-07T08:42:57.266968+0000","last_clean":"2023-10-07T08:42:57.266968+0000","last_became_active":"2023-10-07T08:42:57.265437+0000","last_became_peered":"2023-10-07T08:42:57.265437+0000","last_unstale":"2023-10-07T08:42:57.266968+0000","last_undegraded":"2023-10-07T08:42:57.266968+0000","last_fullsized":"2023-10-07T08:42:57.266968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:38.758746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260567+0000","last_change":"2023-10-07T08:42:57.260425+0000","last_active":"2023-10-07T08:42:57.260567+0000","last_peered":"2023-10-07T08:42:57.260567+0000","last_clean":"2023-10-07T08:42:57.260567+0000","last_became_active":"2023-10-07T08:42:57.260226+0000","last_became_peered":"2023-10-07T08:42:57.260226+0000","last_unstale":"2023-10-07T08:42:57.260567+0000","last_undegraded":"2023-10-07T08:42:57.260567+0000","last_fullsized":"2023-10-07T08:42:57.260567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273197+0000","last_change":"2023-10-07T08:42:57.273144+0000","last_active":"2023-10-07T08:42:57.273197+0000","last_peered":"2023-10-07T08:42:57.273197+0000","last_clean":"2023-10-07T08:42:57.273197+0000","last_became_active":"2023-10-07T08:42:57.273008+0000","last_became_peered":"2023-10-07T08:42:57.273008+0000","last_unstale":"2023-10-07T08:42:57.273197+0000","last_undegraded":"2023-10-07T08:42:57.273197+0000","last_fullsized":"2023-10-07T08:42:57.273197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:22.299718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271790+0000","last_change":"2023-10-07T08:42:57.270102+0000","last_active":"2023-10-07T08:42:57.271790+0000","last_peered":"2023-10-07T08:42:57.271790+0000","last_clean":"2023-10-07T08:42:57.271790+0000","last_became_active":"2023-10-07T08:42:57.269871+0000","last_became_peered":"2023-10-07T08:42:57.269871+0000","last_unstale":"2023-10-07T08:42:57.271790+0000","last_undegraded":"2023-10-07T08:42:57.271790+0000","last_fullsized":"2023-10-07T08:42:57.271790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:22:57.366438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255941+0000","last_change":"2023-10-07T08:42:57.255880+0000","last_active":"2023-10-07T08:42:57.255941+0000","last_peered":"2023-10-07T08:42:57.255941+0000","last_clean":"2023-10-07T08:42:57.255941+0000","last_became_active":"2023-10-07T08:42:57.255498+0000","last_became_peered":"2023-10-07T08:42:57.255498+0000","last_unstale":"2023-10-07T08:42:57.255941+0000","last_undegraded":"2023-10-07T08:42:57.255941+0000","last_fullsized":"2023-10-07T08:42:57.255941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258178+0000","last_change":"2023-10-07T08:42:57.257694+0000","last_active":"2023-10-07T08:42:57.258178+0000","last_peered":"2023-10-07T08:42:57.258178+0000","last_clean":"2023-10-07T08:42:57.258178+0000","last_became_active":"2023-10-07T08:42:57.257200+0000","last_became_peered":"2023-10-07T08:42:57.257200+0000","last_unstale":"2023-10-07T08:42:57.258178+0000","last_undegraded":"2023-10-07T08:42:57.258178+0000","last_fullsized":"2023-10-07T08:42:57.258178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.253992+0000","last_change":"2023-10-07T08:42:57.253904+0000","last_active":"2023-10-07T08:42:57.253992+0000","last_peered":"2023-10-07T08:42:57.253992+0000","last_clean":"2023-10-07T08:42:57.253992+0000","last_became_active":"2023-10-07T08:42:57.253374+0000","last_became_peered":"2023-10-07T08:42:57.253374+0000","last_unstale":"2023-10-07T08:42:57.253992+0000","last_undegraded":"2023-10-07T08:42:57.253992+0000","last_fullsized":"2023-10-07T08:42:57.253992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267322+0000","last_change":"2023-10-07T08:42:57.264162+0000","last_active":"2023-10-07T08:42:57.267322+0000","last_peered":"2023-10-07T08:42:57.267322+0000","last_clean":"2023-10-07T08:42:57.267322+0000","last_became_active":"2023-10-07T08:42:57.263947+0000","last_became_peered":"2023-10-07T08:42:57.263947+0000","last_unstale":"2023-10-07T08:42:57.267322+0000","last_undegraded":"2023-10-07T08:42:57.267322+0000","last_fullsized":"2023-10-07T08:42:57.267322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:07.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.256643+0000","last_change":"2023-10-07T08:42:57.256601+0000","last_active":"2023-10-07T08:42:57.256643+0000","last_peered":"2023-10-07T08:42:57.256643+0000","last_clean":"2023-10-07T08:42:57.256643+0000","last_became_active":"2023-10-07T08:42:57.256421+0000","last_became_peered":"2023-10-07T08:42:57.256421+0000","last_unstale":"2023-10-07T08:42:57.256643+0000","last_undegraded":"2023-10-07T08:42:57.256643+0000","last_fullsized":"2023-10-07T08:42:57.256643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271714+0000","last_change":"2023-10-07T08:42:57.268643+0000","last_active":"2023-10-07T08:42:57.271714+0000","last_peered":"2023-10-07T08:42:57.271714+0000","last_clean":"2023-10-07T08:42:57.271714+0000","last_became_active":"2023-10-07T08:42:57.267817+0000","last_became_peered":"2023-10-07T08:42:57.267817+0000","last_unstale":"2023-10-07T08:42:57.271714+0000","last_undegraded":"2023-10-07T08:42:57.271714+0000","last_fullsized":"2023-10-07T08:42:57.271714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258195+0000","last_change":"2023-10-07T08:42:57.257831+0000","last_active":"2023-10-07T08:42:57.258195+0000","last_peered":"2023-10-07T08:42:57.258195+0000","last_clean":"2023-10-07T08:42:57.258195+0000","last_became_active":"2023-10-07T08:42:57.257484+0000","last_became_peered":"2023-10-07T08:42:57.257484+0000","last_unstale":"2023-10-07T08:42:57.258195+0000","last_undegraded":"2023-10-07T08:42:57.258195+0000","last_fullsized":"2023-10-07T08:42:57.258195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273509+0000","last_change":"2023-10-07T08:42:57.273405+0000","last_active":"2023-10-07T08:42:57.273509+0000","last_peered":"2023-10-07T08:42:57.273509+0000","last_clean":"2023-10-07T08:42:57.273509+0000","last_became_active":"2023-10-07T08:42:57.272454+0000","last_became_peered":"2023-10-07T08:42:57.272454+0000","last_unstale":"2023-10-07T08:42:57.273509+0000","last_undegraded":"2023-10-07T08:42:57.273509+0000","last_fullsized":"2023-10-07T08:42:57.273509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:38.758746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264089+0000","last_change":"2023-10-07T08:42:57.263789+0000","last_active":"2023-10-07T08:42:57.264089+0000","last_peered":"2023-10-07T08:42:57.264089+0000","last_clean":"2023-10-07T08:42:57.264089+0000","last_became_active":"2023-10-07T08:42:57.263348+0000","last_became_peered":"2023-10-07T08:42:57.263348+0000","last_unstale":"2023-10-07T08:42:57.264089+0000","last_undegraded":"2023-10-07T08:42:57.264089+0000","last_fullsized":"2023-10-07T08:42:57.264089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260531+0000","last_change":"2023-10-07T08:42:57.259213+0000","last_active":"2023-10-07T08:42:57.260531+0000","last_peered":"2023-10-07T08:42:57.260531+0000","last_clean":"2023-10-07T08:42:57.260531+0000","last_became_active":"2023-10-07T08:42:57.258976+0000","last_became_peered":"2023-10-07T08:42:57.258976+0000","last_unstale":"2023-10-07T08:42:57.260531+0000","last_undegraded":"2023-10-07T08:42:57.260531+0000","last_fullsized":"2023-10-07T08:42:57.260531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:29:20.004471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199333925,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199923311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924687,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.187}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333869,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924847,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199923311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924721,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924757,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]}]}],"pool_statfs":[]}} 2023-10-07T08:43:06.143 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T08:43:06.143 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-07T08:43:06.143 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-07T08:43:06.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-07T08:43:06.144 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-07T08:43:06.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.289+0000 7f9ab2066700 1 Processor -- start 2023-10-07T08:43:06.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.289+0000 7f9ab2066700 1 -- start start 2023-10-07T08:43:06.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.290+0000 7f9ab2066700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9aac159b40 0x7f9aac0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:06.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.290+0000 7f9ab2066700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aac0cee10 con 0x7f9aac159f10 2023-10-07T08:43:06.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.290+0000 7f9ab2066700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aac0cd040 con 0x7f9aac068e90 2023-10-07T08:43:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.290+0000 7f9ab2066700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0cd320 con 0x7f9aac159b40 2023-10-07T08:43:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.290+0000 7f9ab0863700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9aac159f10 0x7f9aac068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59370/0 (socket says 172.21.15.81:59370) 2023-10-07T08:43:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.290+0000 7f9ab0863700 1 -- 172.21.15.81:0/3703868930 learned_addr learned my addr 172.21.15.81:0/3703868930 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.290+0000 7f9ab1064700 1 --2- 172.21.15.81:0/3703868930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9aac159b40 0x7f9aac0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.290+0000 7f9aa3fff700 1 -- 172.21.15.81:0/3703868930 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524380759 0 0) 0x7f9aac0cee10 con 0x7f9aac159f10 2023-10-07T08:43:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.290+0000 7f9aa3fff700 1 -- 172.21.15.81:0/3703868930 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a98003570 con 0x7f9aac159f10 2023-10-07T08:43:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.290+0000 7f9aa3fff700 1 -- 172.21.15.81:0/3703868930 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073792510 0 0) 0x7f9aac0cd040 con 0x7f9aac068e90 2023-10-07T08:43:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.290+0000 7f9aa3fff700 1 -- 172.21.15.81:0/3703868930 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aac0cee10 con 0x7f9aac068e90 2023-10-07T08:43:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.290+0000 7f9ab1064700 1 -- 172.21.15.81:0/3703868930 >> v1:172.21.15.89:6789/0 conn(0x7f9aac068e90 legacy=0x7f9aac0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:06.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.290+0000 7f9ab1064700 1 -- 172.21.15.81:0/3703868930 >> v1:172.21.15.81:6789/0 conn(0x7f9aac159f10 legacy=0x7f9aac068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:06.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.290+0000 7f9aa3fff700 1 -- 172.21.15.81:0/3703868930 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 131999405 0 0) 0x7f9a98003570 con 0x7f9aac159f10 2023-10-07T08:43:06.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.290+0000 7f9ab1064700 1 -- 172.21.15.81:0/3703868930 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac0ce7c0 con 0x7f9aac159b40 2023-10-07T08:43:06.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.291+0000 7f9ab1064700 1 --2- 172.21.15.81:0/3703868930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9aac159b40 0x7f9aac0cc600 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009e90 tx=0x7f9aa8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e9b21421adec0e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:06.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.291+0000 7f9aa3fff700 1 -- 172.21.15.81:0/3703868930 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa800e070 con 0x7f9aac159b40 2023-10-07T08:43:06.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.291+0000 7f9aa3fff700 1 -- 172.21.15.81:0/3703868930 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa800b870 con 0x7f9aac159b40 2023-10-07T08:43:06.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.291+0000 7f9aa3fff700 1 -- 172.21.15.81:0/3703868930 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c001470 con 0x7f9aac159b40 2023-10-07T08:43:06.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.291+0000 7f9ab2066700 1 -- 172.21.15.81:0/3703868930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9aac159b40 msgr2=0x7f9aac0cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:06.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.291+0000 7f9ab2066700 1 --2- 172.21.15.81:0/3703868930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9aac159b40 0x7f9aac0cc600 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009e90 tx=0x7f9aa8009780 comp rx=0 tx=0).stop 2023-10-07T08:43:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.291+0000 7f9ab2066700 1 -- 172.21.15.81:0/3703868930 shutdown_connections 2023-10-07T08:43:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.291+0000 7f9ab2066700 1 --2- 172.21.15.81:0/3703868930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9aac159b40 0x7f9aac0cc600 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.291+0000 7f9ab2066700 1 -- 172.21.15.81:0/3703868930 >> 172.21.15.81:0/3703868930 conn(0x7f9aac0cd660 msgr2=0x7f9aac0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.291+0000 7f9ab2066700 1 -- 172.21.15.81:0/3703868930 shutdown_connections 2023-10-07T08:43:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.291+0000 7f9ab2066700 1 -- 172.21.15.81:0/3703868930 wait complete. 2023-10-07T08:43:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.292+0000 7f9ab2066700 1 Processor -- start 2023-10-07T08:43:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.293+0000 7f9ab2066700 1 -- start start 2023-10-07T08:43:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.293+0000 7f9ab2066700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aac068e90 0x7f9aac154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.293+0000 7f9ab2066700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9aac159b40 0x7f9aac156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.293+0000 7f9ab2066700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9aac159f10 0x7f9aac155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.293+0000 7f9ab2066700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac15b7f0 con 0x7f9aac068e90 2023-10-07T08:43:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.293+0000 7f9ab2066700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac157de0 con 0x7f9aac159b40 2023-10-07T08:43:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.293+0000 7f9ab2066700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac1580c0 con 0x7f9aac159f10 2023-10-07T08:43:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.293+0000 7f9ab1064700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aac068e90 0x7f9aac154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9ab1064700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aac068e90 0x7f9aac154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44778/0 (socket says 172.21.15.81:44778) 2023-10-07T08:43:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9ab1064700 1 -- 172.21.15.81:0/4051750049 learned_addr learned my addr 172.21.15.81:0/4051750049 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9ab1865700 1 --2- 172.21.15.81:0/4051750049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9aac159f10 0x7f9aac155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9ab0863700 1 --2- 172.21.15.81:0/4051750049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9aac159b40 0x7f9aac156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9ab1064700 1 -- 172.21.15.81:0/4051750049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9aac159f10 msgr2=0x7f9aac155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9ab1064700 1 --2- 172.21.15.81:0/4051750049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9aac159f10 0x7f9aac155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9ab1064700 1 -- 172.21.15.81:0/4051750049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9aac159b40 msgr2=0x7f9aac156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9ab1064700 1 --2- 172.21.15.81:0/4051750049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9aac159b40 0x7f9aac156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9ab1064700 1 -- 172.21.15.81:0/4051750049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa8009a20 con 0x7f9aac068e90 2023-10-07T08:43:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9ab0863700 1 --2- 172.21.15.81:0/4051750049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9aac159b40 0x7f9aac156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9ab1865700 1 --2- 172.21.15.81:0/4051750049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9aac159f10 0x7f9aac155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9ab1064700 1 --2- 172.21.15.81:0/4051750049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aac068e90 0x7f9aac154630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80097c0 tx=0x7f9aa8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9aa17fa700 1 -- 172.21.15.81:0/4051750049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8001090 con 0x7f9aac068e90 2023-10-07T08:43:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9aa17fa700 1 -- 172.21.15.81:0/4051750049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa8012cd0 con 0x7f9aac068e90 2023-10-07T08:43:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9ab2066700 1 -- 172.21.15.81:0/4051750049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aac1583a0 con 0x7f9aac068e90 2023-10-07T08:43:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9aa17fa700 1 -- 172.21.15.81:0/4051750049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa801e6a0 con 0x7f9aac068e90 2023-10-07T08:43:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.294+0000 7f9ab2066700 1 -- 172.21.15.81:0/4051750049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aac154b70 con 0x7f9aac068e90 2023-10-07T08:43:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.295+0000 7f9ab2066700 1 -- 172.21.15.81:0/4051750049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aac0cb910 con 0x7f9aac068e90 2023-10-07T08:43:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.295+0000 7f9aa17fa700 1 -- 172.21.15.81:0/4051750049 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9aa801ea90 con 0x7f9aac068e90 2023-10-07T08:43:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.296+0000 7f9aa17fa700 1 --2- 172.21.15.81:0/4051750049 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9a90066f30 0x7f9a900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.296+0000 7f9ab0863700 1 --2- 172.21.15.81:0/4051750049 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9a90066f30 0x7f9a900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.296+0000 7f9aa17fa700 1 -- 172.21.15.81:0/4051750049 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9aa8086990 con 0x7f9aac068e90 2023-10-07T08:43:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.296+0000 7f9ab0863700 1 --2- 172.21.15.81:0/4051750049 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9a90066f30 0x7f9a900693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0015a0 tx=0x7f9a9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.300+0000 7f9aa17fa700 1 -- 172.21.15.81:0/4051750049 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9aa8053c00 con 0x7f9aac068e90 2023-10-07T08:43:06.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.538+0000 7f9ab2066700 1 -- 172.21.15.81:0/4051750049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9aac0ceaa0 con 0x7f9aac068e90 2023-10-07T08:43:06.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.541+0000 7f9aa17fa700 1 -- 172.21.15.81:0/4051750049 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163699 (secure 0 0 0) 0x7f9aa8016090 con 0x7f9aac068e90 2023-10-07T08:43:06.544 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:06.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.544+0000 7f9ab2066700 1 -- 172.21.15.81:0/4051750049 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9a90066f30 msgr2=0x7f9a900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:06.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.544+0000 7f9ab2066700 1 --2- 172.21.15.81:0/4051750049 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9a90066f30 0x7f9a900693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0015a0 tx=0x7f9a9c009040 comp rx=0 tx=0).stop 2023-10-07T08:43:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.544+0000 7f9ab2066700 1 -- 172.21.15.81:0/4051750049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aac068e90 msgr2=0x7f9aac154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.544+0000 7f9ab2066700 1 --2- 172.21.15.81:0/4051750049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aac068e90 0x7f9aac154630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80097c0 tx=0x7f9aa8017000 comp rx=0 tx=0).stop 2023-10-07T08:43:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.544+0000 7f9ab2066700 1 -- 172.21.15.81:0/4051750049 shutdown_connections 2023-10-07T08:43:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.544+0000 7f9ab2066700 1 --2- 172.21.15.81:0/4051750049 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9a90066f30 0x7f9a900693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.544+0000 7f9ab2066700 1 --2- 172.21.15.81:0/4051750049 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9aac159f10 0x7f9aac155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.544+0000 7f9ab2066700 1 --2- 172.21.15.81:0/4051750049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aac068e90 0x7f9aac154630 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.544+0000 7f9ab2066700 1 --2- 172.21.15.81:0/4051750049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9aac159b40 0x7f9aac156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.544+0000 7f9ab2066700 1 -- 172.21.15.81:0/4051750049 >> 172.21.15.81:0/4051750049 conn(0x7f9aac0cd660 msgr2=0x7f9aac06d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.544+0000 7f9ab2066700 1 -- 172.21.15.81:0/4051750049 shutdown_connections 2023-10-07T08:43:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.544+0000 7f9ab2066700 1 -- 172.21.15.81:0/4051750049 wait complete. 2023-10-07T08:43:06.557 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":86101},{"type":"v1","addr":"172.21.15.81:6833","nonce":86101}]},"active_addr":"172.21.15.81:6833/86101","active_change":"2023-10-07T08:42:43.997943+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2774707861}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3035417423}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3645649396}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3979157790}]}]} 2023-10-07T08:43:06.562 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-07T08:43:06.562 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-07T08:43:06.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:06.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.675+0000 7f75031e6700 1 Processor -- start 2023-10-07T08:43:06.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.675+0000 7f75031e6700 1 -- start start 2023-10-07T08:43:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f75031e6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f74fc1578d0 0x7f74fc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f75031e6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f74fc157ca0 0x7f74fc15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f75031e6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc0d07c0 con 0x7f74fc06d120 2023-10-07T08:43:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f75031e6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74fc0cfbb0 con 0x7f74fc1578d0 2023-10-07T08:43:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f75031e6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74fc0cfe90 con 0x7f74fc157ca0 2023-10-07T08:43:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f7500f82700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f74fc1578d0 0x7f74fc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:06.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f7500f82700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f74fc1578d0 0x7f74fc0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44794/0 (socket says 172.21.15.81:44794) 2023-10-07T08:43:06.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f7500f82700 1 -- 172.21.15.81:0/2589959496 learned_addr learned my addr 172.21.15.81:0/2589959496 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:06.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f74fbfff700 1 --2- 172.21.15.81:0/2589959496 >> v2:172.21.15.89:3300/0 conn(0x7f74fc157ca0 0x7f74fc15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:06.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f7500f82700 1 -- 172.21.15.81:0/2589959496 >> v2:172.21.15.89:3300/0 conn(0x7f74fc157ca0 msgr2=0x7f74fc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:06.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f7500f82700 1 --2- 172.21.15.81:0/2589959496 >> v2:172.21.15.89:3300/0 conn(0x7f74fc157ca0 0x7f74fc15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f7500f82700 1 -- 172.21.15.81:0/2589959496 >> v1:172.21.15.89:6789/0 conn(0x7f74fc06d120 legacy=0x7f74fc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:06.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f7500f82700 1 -- 172.21.15.81:0/2589959496 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc0d0170 con 0x7f74fc1578d0 2023-10-07T08:43:06.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f74fbfff700 1 --2- 172.21.15.81:0/2589959496 >> v2:172.21.15.89:3300/0 conn(0x7f74fc157ca0 0x7f74fc15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:06.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f7500f82700 1 --2- 172.21.15.81:0/2589959496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74fc1578d0 0x7f74fc0cf4f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f74fc068510 tx=0x7f74f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac36ef9de4bc536 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:06.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f74fb7fe700 1 -- 172.21.15.81:0/2589959496 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f400b820 con 0x7f74fc1578d0 2023-10-07T08:43:06.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f74fb7fe700 1 -- 172.21.15.81:0/2589959496 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f400b980 con 0x7f74fc1578d0 2023-10-07T08:43:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.676+0000 7f74fb7fe700 1 -- 172.21.15.81:0/2589959496 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f400bd20 con 0x7f74fc1578d0 2023-10-07T08:43:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.677+0000 7f75031e6700 1 -- 172.21.15.81:0/2589959496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74fc1578d0 msgr2=0x7f74fc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.677+0000 7f75031e6700 1 --2- 172.21.15.81:0/2589959496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74fc1578d0 0x7f74fc0cf4f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f74fc068510 tx=0x7f74f4009250 comp rx=0 tx=0).stop 2023-10-07T08:43:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.677+0000 7f75031e6700 1 -- 172.21.15.81:0/2589959496 shutdown_connections 2023-10-07T08:43:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.677+0000 7f75031e6700 1 --2- 172.21.15.81:0/2589959496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74fc1578d0 0x7f74fc0cf4f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.677+0000 7f75031e6700 1 --2- 172.21.15.81:0/2589959496 >> v2:172.21.15.89:3300/0 conn(0x7f74fc157ca0 0x7f74fc15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.677+0000 7f75031e6700 1 -- 172.21.15.81:0/2589959496 >> 172.21.15.81:0/2589959496 conn(0x7f74fc06bb90 msgr2=0x7f74fc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.677+0000 7f75031e6700 1 -- 172.21.15.81:0/2589959496 shutdown_connections 2023-10-07T08:43:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.677+0000 7f75031e6700 1 -- 172.21.15.81:0/2589959496 wait complete. 2023-10-07T08:43:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.678+0000 7f75031e6700 1 Processor -- start 2023-10-07T08:43:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.678+0000 7f75031e6700 1 -- start start 2023-10-07T08:43:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f75031e6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74fc06d120 0x7f74fc0b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f75031e6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74fc1578d0 0x7f74fc16b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f75031e6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74fc157ca0 0x7f74fc16d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f75031e6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc1541c0 con 0x7f74fc1578d0 2023-10-07T08:43:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f75031e6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc16db20 con 0x7f74fc157ca0 2023-10-07T08:43:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f75031e6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc0c7440 con 0x7f74fc06d120 2023-10-07T08:43:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f74fbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74fc1578d0 0x7f74fc16b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f74fbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74fc1578d0 0x7f74fc16b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44808/0 (socket says 172.21.15.81:44808) 2023-10-07T08:43:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f74fbfff700 1 -- 172.21.15.81:0/644518448 learned_addr learned my addr 172.21.15.81:0/644518448 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f7500f82700 1 --2- 172.21.15.81:0/644518448 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74fc06d120 0x7f74fc0b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f7501783700 1 --2- 172.21.15.81:0/644518448 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74fc157ca0 0x7f74fc16d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f74fbfff700 1 -- 172.21.15.81:0/644518448 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74fc06d120 msgr2=0x7f74fc0b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f74fbfff700 1 --2- 172.21.15.81:0/644518448 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74fc06d120 0x7f74fc0b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f74fbfff700 1 -- 172.21.15.81:0/644518448 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74fc157ca0 msgr2=0x7f74fc16d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f74fbfff700 1 --2- 172.21.15.81:0/644518448 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74fc157ca0 0x7f74fc16d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f74fbfff700 1 -- 172.21.15.81:0/644518448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f40094f0 con 0x7f74fc1578d0 2023-10-07T08:43:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.679+0000 7f74fbfff700 1 --2- 172.21.15.81:0/644518448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74fc1578d0 0x7f74fc16b8e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f74ec007f90 tx=0x7f74ec007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.680+0000 7f74f8ff9700 1 -- 172.21.15.81:0/644518448 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec00ada0 con 0x7f74fc1578d0 2023-10-07T08:43:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.680+0000 7f74f8ff9700 1 -- 172.21.15.81:0/644518448 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec016420 con 0x7f74fc1578d0 2023-10-07T08:43:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.680+0000 7f75031e6700 1 -- 172.21.15.81:0/644518448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74fc16af20 con 0x7f74fc1578d0 2023-10-07T08:43:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.680+0000 7f74f8ff9700 1 -- 172.21.15.81:0/644518448 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec0167c0 con 0x7f74fc1578d0 2023-10-07T08:43:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.680+0000 7f75031e6700 1 -- 172.21.15.81:0/644518448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74fc16b4e0 con 0x7f74fc1578d0 2023-10-07T08:43:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.681+0000 7f75031e6700 1 -- 172.21.15.81:0/644518448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74fc16b700 con 0x7f74fc1578d0 2023-10-07T08:43:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.681+0000 7f74f8ff9700 1 -- 172.21.15.81:0/644518448 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74ec016bb0 con 0x7f74fc1578d0 2023-10-07T08:43:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.681+0000 7f74f8ff9700 1 --2- 172.21.15.81:0/644518448 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f74dc066f30 0x7f74dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.681+0000 7f74f8ff9700 1 -- 172.21.15.81:0/644518448 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f74ec012070 con 0x7f74fc1578d0 2023-10-07T08:43:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.681+0000 7f7500f82700 1 --2- 172.21.15.81:0/644518448 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f74dc066f30 0x7f74dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.682+0000 7f7500f82700 1 --2- 172.21.15.81:0/644518448 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f74dc066f30 0x7f74dc0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f74fc068510 tx=0x7f74f4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:06.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.685+0000 7f74f8ff9700 1 -- 172.21.15.81:0/644518448 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74ec04e5a0 con 0x7f74fc1578d0 2023-10-07T08:43:06.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.867+0000 7f75031e6700 1 -- 172.21.15.81:0/644518448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74fc0c7230 con 0x7f74fc1578d0 2023-10-07T08:43:06.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.868+0000 7f74f8ff9700 1 -- 172.21.15.81:0/644518448 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f74ec08b080 con 0x7f74fc1578d0 2023-10-07T08:43:06.869 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:06.869 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:58.248338+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:42:54.397263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:42:55.595133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:06.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.870+0000 7f75031e6700 1 -- 172.21.15.81:0/644518448 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f74dc066f30 msgr2=0x7f74dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:06.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.870+0000 7f75031e6700 1 --2- 172.21.15.81:0/644518448 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f74dc066f30 0x7f74dc0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f74fc068510 tx=0x7f74f4016000 comp rx=0 tx=0).stop 2023-10-07T08:43:06.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.870+0000 7f75031e6700 1 -- 172.21.15.81:0/644518448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74fc1578d0 msgr2=0x7f74fc16b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:06.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.870+0000 7f75031e6700 1 --2- 172.21.15.81:0/644518448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74fc1578d0 0x7f74fc16b8e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f74ec007f90 tx=0x7f74ec007840 comp rx=0 tx=0).stop 2023-10-07T08:43:06.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.870+0000 7f75031e6700 1 -- 172.21.15.81:0/644518448 shutdown_connections 2023-10-07T08:43:06.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.870+0000 7f75031e6700 1 --2- 172.21.15.81:0/644518448 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74fc157ca0 0x7f74fc16d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.870+0000 7f75031e6700 1 --2- 172.21.15.81:0/644518448 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f74dc066f30 0x7f74dc0693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.870+0000 7f75031e6700 1 --2- 172.21.15.81:0/644518448 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74fc06d120 0x7f74fc0b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.870+0000 7f75031e6700 1 --2- 172.21.15.81:0/644518448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74fc1578d0 0x7f74fc16b8e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:06.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.870+0000 7f75031e6700 1 -- 172.21.15.81:0/644518448 >> 172.21.15.81:0/644518448 conn(0x7f74fc06bb90 msgr2=0x7f74fc068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:06.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.870+0000 7f75031e6700 1 -- 172.21.15.81:0/644518448 shutdown_connections 2023-10-07T08:43:06.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.870+0000 7f75031e6700 1 -- 172.21.15.81:0/644518448 wait complete. 2023-10-07T08:43:06.883 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-07T08:43:06.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:06.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.995+0000 7f91a9457700 1 Processor -- start 2023-10-07T08:43:06.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.995+0000 7f91a9457700 1 -- start start 2023-10-07T08:43:06.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.996+0000 7f91a9457700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f91a406d830 0x7f91a40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:06.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.996+0000 7f91a9457700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a40d07c0 con 0x7f91a4157ca0 2023-10-07T08:43:06.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.996+0000 7f91a9457700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a40cfbb0 con 0x7f91a41578d0 2023-10-07T08:43:06.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.996+0000 7f91a9457700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a40cfe90 con 0x7f91a406d830 2023-10-07T08:43:06.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.996+0000 7f91a37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f91a406d830 0x7f91a40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.996+0000 7f91a27fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f91a4157ca0 0x7f91a406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59376/0 (socket says 172.21.15.81:59376) 2023-10-07T08:43:07.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.996+0000 7f91a27fc700 1 -- 172.21.15.81:0/929801266 learned_addr learned my addr 172.21.15.81:0/929801266 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:07.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.997+0000 7f91a37fe700 1 -- 172.21.15.81:0/929801266 >> v1:172.21.15.89:6789/0 conn(0x7f91a41578d0 legacy=0x7f91a415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.997+0000 7f91a37fe700 1 -- 172.21.15.81:0/929801266 >> v1:172.21.15.81:6789/0 conn(0x7f91a4157ca0 legacy=0x7f91a406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.997+0000 7f91a1ffb700 1 -- 172.21.15.81:0/929801266 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554057616 0 0) 0x7f91a40d07c0 con 0x7f91a4157ca0 2023-10-07T08:43:07.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.997+0000 7f91a37fe700 1 -- 172.21.15.81:0/929801266 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a40d0170 con 0x7f91a406d830 2023-10-07T08:43:07.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.997+0000 7f91a37fe700 1 --2- 172.21.15.81:0/929801266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a406d830 0x7f91a40cf4f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f919c009e60 tx=0x7f919c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9628338dfa2d46a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.997+0000 7f91a1ffb700 1 -- 172.21.15.81:0/929801266 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c00e070 con 0x7f91a406d830 2023-10-07T08:43:07.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.997+0000 7f91a1ffb700 1 -- 172.21.15.81:0/929801266 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c00bbf0 con 0x7f91a406d830 2023-10-07T08:43:07.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.997+0000 7f91a1ffb700 1 -- 172.21.15.81:0/929801266 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c012430 con 0x7f91a406d830 2023-10-07T08:43:07.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.997+0000 7f91a9457700 1 -- 172.21.15.81:0/929801266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a406d830 msgr2=0x7f91a40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.997+0000 7f91a9457700 1 --2- 172.21.15.81:0/929801266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a406d830 0x7f91a40cf4f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f919c009e60 tx=0x7f919c009780 comp rx=0 tx=0).stop 2023-10-07T08:43:07.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.997+0000 7f91a9457700 1 -- 172.21.15.81:0/929801266 shutdown_connections 2023-10-07T08:43:07.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.997+0000 7f91a9457700 1 --2- 172.21.15.81:0/929801266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a406d830 0x7f91a40cf4f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.997+0000 7f91a9457700 1 -- 172.21.15.81:0/929801266 >> 172.21.15.81:0/929801266 conn(0x7f91a406bb90 msgr2=0x7f91a406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.998+0000 7f91a9457700 1 -- 172.21.15.81:0/929801266 shutdown_connections 2023-10-07T08:43:07.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.998+0000 7f91a9457700 1 -- 172.21.15.81:0/929801266 wait complete. 2023-10-07T08:43:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.999+0000 7f91a9457700 1 Processor -- start 2023-10-07T08:43:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.999+0000 7f91a9457700 1 -- start start 2023-10-07T08:43:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.999+0000 7f91a9457700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a406d830 0x7f91a4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.999+0000 7f91a9457700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a41578d0 0x7f91a4155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.999+0000 7f91a9457700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91a4157ca0 0x7f91a4155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.999+0000 7f91a9457700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a4155a90 con 0x7f91a406d830 2023-10-07T08:43:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.999+0000 7f91a9457700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a416a810 con 0x7f91a41578d0 2023-10-07T08:43:07.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:06.999+0000 7f91a9457700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a416aaf0 con 0x7f91a4157ca0 2023-10-07T08:43:07.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f91a2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a406d830 0x7f91a4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f91a2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a406d830 0x7f91a4069b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44822/0 (socket says 172.21.15.81:44822) 2023-10-07T08:43:07.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f91a2ffd700 1 -- 172.21.15.81:0/3472967627 learned_addr learned my addr 172.21.15.81:0/3472967627 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f91a37fe700 1 --2- 172.21.15.81:0/3472967627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91a4157ca0 0x7f91a4155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f91a27fc700 1 --2- 172.21.15.81:0/3472967627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a41578d0 0x7f91a4155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f91a2ffd700 1 -- 172.21.15.81:0/3472967627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91a4157ca0 msgr2=0x7f91a4155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f91a2ffd700 1 --2- 172.21.15.81:0/3472967627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91a4157ca0 0x7f91a4155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f91a2ffd700 1 -- 172.21.15.81:0/3472967627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a41578d0 msgr2=0x7f91a4155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f91a2ffd700 1 --2- 172.21.15.81:0/3472967627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a41578d0 0x7f91a4155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f91a2ffd700 1 -- 172.21.15.81:0/3472967627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c009a20 con 0x7f91a406d830 2023-10-07T08:43:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f91a27fc700 1 --2- 172.21.15.81:0/3472967627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a41578d0 0x7f91a4155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f91a2ffd700 1 --2- 172.21.15.81:0/3472967627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a406d830 0x7f91a4069b20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f919400c5d0 tx=0x7f9194007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f918affd700 1 -- 172.21.15.81:0/3472967627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9194011590 con 0x7f91a406d830 2023-10-07T08:43:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f918affd700 1 -- 172.21.15.81:0/3472967627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9194011710 con 0x7f91a406d830 2023-10-07T08:43:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f91a9457700 1 -- 172.21.15.81:0/3472967627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a416add0 con 0x7f91a406d830 2023-10-07T08:43:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f918affd700 1 -- 172.21.15.81:0/3472967627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9194011ad0 con 0x7f91a406d830 2023-10-07T08:43:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.000+0000 7f91a9457700 1 -- 172.21.15.81:0/3472967627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a416b390 con 0x7f91a406d830 2023-10-07T08:43:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.001+0000 7f91a9457700 1 -- 172.21.15.81:0/3472967627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a416b5b0 con 0x7f91a406d830 2023-10-07T08:43:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.002+0000 7f918affd700 1 -- 172.21.15.81:0/3472967627 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f919401c460 con 0x7f91a406d830 2023-10-07T08:43:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.002+0000 7f918affd700 1 --2- 172.21.15.81:0/3472967627 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9190066f30 0x7f91900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.002+0000 7f91a27fc700 1 --2- 172.21.15.81:0/3472967627 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9190066f30 0x7f91900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.002+0000 7f918affd700 1 -- 172.21.15.81:0/3472967627 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9194084330 con 0x7f91a406d830 2023-10-07T08:43:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.002+0000 7f91a27fc700 1 --2- 172.21.15.81:0/3472967627 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9190066f30 0x7f91900693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f91a40c81b0 tx=0x7f9198009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.006+0000 7f918affd700 1 -- 172.21.15.81:0/3472967627 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91940515a0 con 0x7f91a406d830 2023-10-07T08:43:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.190+0000 7f91a9457700 1 -- 172.21.15.81:0/3472967627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91a40d0450 con 0x7f91a406d830 2023-10-07T08:43:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.191+0000 7f918affd700 1 -- 172.21.15.81:0/3472967627 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f9194054bc0 con 0x7f91a406d830 2023-10-07T08:43:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:07.192 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:58.248338+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:42:54.397263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:42:55.595133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:07.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.192+0000 7f91a9457700 1 -- 172.21.15.81:0/3472967627 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9190066f30 msgr2=0x7f91900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.192+0000 7f91a9457700 1 --2- 172.21.15.81:0/3472967627 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9190066f30 0x7f91900693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f91a40c81b0 tx=0x7f9198009040 comp rx=0 tx=0).stop 2023-10-07T08:43:07.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.192+0000 7f91a9457700 1 -- 172.21.15.81:0/3472967627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a406d830 msgr2=0x7f91a4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.192+0000 7f91a9457700 1 --2- 172.21.15.81:0/3472967627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a406d830 0x7f91a4069b20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f919400c5d0 tx=0x7f9194007f60 comp rx=0 tx=0).stop 2023-10-07T08:43:07.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.192+0000 7f91a9457700 1 -- 172.21.15.81:0/3472967627 shutdown_connections 2023-10-07T08:43:07.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.192+0000 7f91a9457700 1 --2- 172.21.15.81:0/3472967627 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9190066f30 0x7f91900693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.192+0000 7f91a9457700 1 --2- 172.21.15.81:0/3472967627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91a4157ca0 0x7f91a4155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.192+0000 7f91a9457700 1 --2- 172.21.15.81:0/3472967627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a406d830 0x7f91a4069b20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.192+0000 7f91a9457700 1 --2- 172.21.15.81:0/3472967627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a41578d0 0x7f91a4155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.192+0000 7f91a9457700 1 -- 172.21.15.81:0/3472967627 >> 172.21.15.81:0/3472967627 conn(0x7f91a406bb90 msgr2=0x7f91a41568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.193+0000 7f91a9457700 1 -- 172.21.15.81:0/3472967627 shutdown_connections 2023-10-07T08:43:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.193+0000 7f91a9457700 1 -- 172.21.15.81:0/3472967627 wait complete. 2023-10-07T08:43:07.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-07T08:43:07.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-07T08:43:07.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-07T08:43:07.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-07T08:43:07.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-07T08:43:07.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-07T08:43:07.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-07T08:43:07.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-07T08:43:07.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.404+0000 7f3cd5bf4700 1 Processor -- start 2023-10-07T08:43:07.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.404+0000 7f3cd5bf4700 1 -- start start 2023-10-07T08:43:07.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.405+0000 7f3cd5bf4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cd006e940 0x7f3cd0161950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.405+0000 7f3cd5bf4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd00b2290 con 0x7f3cd01569e0 2023-10-07T08:43:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.405+0000 7f3cd5bf4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd0157c00 con 0x7f3cd0156db0 2023-10-07T08:43:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.405+0000 7f3cd5bf4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd01572d0 con 0x7f3cd006e940 2023-10-07T08:43:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.405+0000 7f5edf14a700 1 Processor -- start 2023-10-07T08:43:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.405+0000 7f3ccffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cd006e940 0x7f3cd0161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.406+0000 7f3ccffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cd006e940 0x7f3cd0161950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:48944/0 (socket says 172.21.15.81:48944) 2023-10-07T08:43:07.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.406+0000 7f3ccffff700 1 -- 172.21.15.81:0/2831685041 learned_addr learned my addr 172.21.15.81:0/2831685041 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.406+0000 7f3ccffff700 1 -- 172.21.15.81:0/2831685041 >> v1:172.21.15.89:6789/0 conn(0x7f3cd0156db0 legacy=0x7f3cd006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.406+0000 7f5edf14a700 1 -- start start 2023-10-07T08:43:07.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.406+0000 7f3ccffff700 1 -- 172.21.15.81:0/2831685041 >> v1:172.21.15.81:6789/0 conn(0x7f3cd01569e0 legacy=0x7f3cd00b17d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T08:43:07.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.406+0000 7f3ccffff700 1 -- 172.21.15.81:0/2831685041 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd01575b0 con 0x7f3cd006e940 2023-10-07T08:43:07.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.406+0000 7f3ccffff700 1 --2- 172.21.15.81:0/2831685041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cd006e940 0x7f3cd0161950 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009f50 tx=0x7f3cc8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b020aad9a0fa52 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.406+0000 7f3cce7fc700 1 -- 172.21.15.81:0/2831685041 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc800e070 con 0x7f3cd006e940 2023-10-07T08:43:07.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7f3cce7fc700 1 -- 172.21.15.81:0/2831685041 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc800ba30 con 0x7f3cd006e940 2023-10-07T08:43:07.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7f3cce7fc700 1 -- 172.21.15.81:0/2831685041 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80092e0 con 0x7f3cd006e940 2023-10-07T08:43:07.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.406+0000 7f5ad89ba700 1 Processor -- start 2023-10-07T08:43:07.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7f5ad89ba700 1 -- start start 2023-10-07T08:43:07.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7f5edf14a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5ed81569e0 0x7f5ed80b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7f5edf14a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ed8156db0 0x7f5ed806e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7f5edf14a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed80b2290 con 0x7f5ed80b1d10 2023-10-07T08:43:07.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7f5edf14a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed8157c00 con 0x7f5ed81569e0 2023-10-07T08:43:07.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7f5edf14a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed81572d0 con 0x7f5ed8156db0 2023-10-07T08:43:07.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7f5edcee6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5ed81569e0 0x7f5ed80b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7ff40ac91700 1 Processor -- start 2023-10-07T08:43:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7f5edcee6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5ed81569e0 0x7f5ed80b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:38912/0 (socket says 172.21.15.81:38912) 2023-10-07T08:43:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7f5edcee6700 1 -- 172.21.15.81:0/1178663789 learned_addr learned my addr 172.21.15.81:0/1178663789 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7f5ed7fff700 1 --2- 172.21.15.81:0/1178663789 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ed8156db0 0x7f5ed806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7ff40ac91700 1 -- start start 2023-10-07T08:43:07.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7f3cd5bf4700 1 -- 172.21.15.81:0/2831685041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cd006e940 msgr2=0x7f3cd0161950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7f3cd5bf4700 1 --2- 172.21.15.81:0/2831685041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cd006e940 0x7f3cd0161950 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009f50 tx=0x7f3cc8009840 comp rx=0 tx=0).stop 2023-10-07T08:43:07.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7f3cd5bf4700 1 -- 172.21.15.81:0/2831685041 shutdown_connections 2023-10-07T08:43:07.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.407+0000 7f3cd5bf4700 1 --2- 172.21.15.81:0/2831685041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cd006e940 0x7f3cd0161950 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f3cd5bf4700 1 -- 172.21.15.81:0/2831685041 >> 172.21.15.81:0/2831685041 conn(0x7f3cd006cca0 msgr2=0x7f3cd006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f3cd5bf4700 1 -- 172.21.15.81:0/2831685041 shutdown_connections 2023-10-07T08:43:07.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f3cd5bf4700 1 -- 172.21.15.81:0/2831685041 wait complete. 2023-10-07T08:43:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f5ed7fff700 1 -- 172.21.15.81:0/1178663789 >> v2:172.21.15.89:3300/0 conn(0x7f5ed81569e0 msgr2=0x7f5ed80b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f5ed7fff700 1 --2- 172.21.15.81:0/1178663789 >> v2:172.21.15.89:3300/0 conn(0x7f5ed81569e0 0x7f5ed80b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f5ed7fff700 1 -- 172.21.15.81:0/1178663789 >> v1:172.21.15.81:6789/0 conn(0x7f5ed80b1d10 legacy=0x7f5ed815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f5ed7fff700 1 -- 172.21.15.81:0/1178663789 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed81575b0 con 0x7f5ed8156db0 2023-10-07T08:43:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f5ed7fff700 1 --2- 172.21.15.81:0/1178663789 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ed8156db0 0x7f5ed806e230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40098e0 tx=0x7f5ec40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9c706062ba02f32 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f5ed77fe700 1 -- 172.21.15.81:0/1178663789 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4009e80 con 0x7f5ed8156db0 2023-10-07T08:43:07.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f5ed77fe700 1 -- 172.21.15.81:0/1178663789 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec400b820 con 0x7f5ed8156db0 2023-10-07T08:43:07.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f5ed77fe700 1 -- 172.21.15.81:0/1178663789 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec400bbe0 con 0x7f5ed8156db0 2023-10-07T08:43:07.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7f5edf14a700 1 -- 172.21.15.81:0/1178663789 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ed8156db0 msgr2=0x7f5ed806e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7f5edf14a700 1 --2- 172.21.15.81:0/1178663789 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ed8156db0 0x7f5ed806e230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40098e0 tx=0x7f5ec40091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7fcdd141a700 1 Processor -- start 2023-10-07T08:43:07.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f5ad89ba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad4069290 0x7f5ad416a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f5ad89ba700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5ad40cac60 0x7f5ad406ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f5ad89ba700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad406d960 con 0x7f5ad4068c20 2023-10-07T08:43:07.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f5ad89ba700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad40696e0 con 0x7f5ad40cac60 2023-10-07T08:43:07.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f5ad89ba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad406d350 con 0x7f5ad4069290 2023-10-07T08:43:07.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f5ad259c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5ad4068c20 0x7f5ad40ca550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:55688/0 (socket says 172.21.15.81:55688) 2023-10-07T08:43:07.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f5ad259c700 1 -- 172.21.15.81:0/428899574 learned_addr learned my addr 172.21.15.81:0/428899574 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:07.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7f5ad1d9b700 1 --2- 172.21.15.81:0/428899574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad4069290 0x7f5ad416a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.408+0000 7ff40ac91700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff404155c60 0x7ff404156030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7ff40ac91700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4040cb840 0x7ff4040c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7ff40ac91700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff4040cbc90 0x7ff4040c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7ff40ac91700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4040ca550 con 0x7ff404155c60 2023-10-07T08:43:07.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7ff40ac91700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4040cb3b0 con 0x7ff4040cbc90 2023-10-07T08:43:07.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7ff40ac91700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4040ca7a0 con 0x7ff4040cb840 2023-10-07T08:43:07.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7ff403fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4040cb840 0x7ff4040c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7ff403fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4040cb840 0x7ff4040c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:48966/0 (socket says 172.21.15.81:48966) 2023-10-07T08:43:07.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7f5edf14a700 1 -- 172.21.15.81:0/1178663789 shutdown_connections 2023-10-07T08:43:07.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7f5edf14a700 1 --2- 172.21.15.81:0/1178663789 >> v2:172.21.15.89:3300/0 conn(0x7f5ed81569e0 0x7f5ed80b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7f5edf14a700 1 --2- 172.21.15.81:0/1178663789 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ed8156db0 0x7f5ed806e230 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7f5edf14a700 1 -- 172.21.15.81:0/1178663789 >> 172.21.15.81:0/1178663789 conn(0x7f5ed806cca0 msgr2=0x7f5ed806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7ff403fff700 1 -- 172.21.15.81:0/3639654091 learned_addr learned my addr 172.21.15.81:0/3639654091 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7f5edf14a700 1 -- 172.21.15.81:0/1178663789 shutdown_connections 2023-10-07T08:43:07.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7f5edf14a700 1 -- 172.21.15.81:0/1178663789 wait complete. 2023-10-07T08:43:07.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7ff40922e700 1 --2- 172.21.15.81:0/3639654091 >> v2:172.21.15.89:3300/0 conn(0x7ff4040cbc90 0x7ff4040c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7f3cd5bf4700 1 Processor -- start 2023-10-07T08:43:07.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7ff40922e700 1 -- 172.21.15.81:0/3639654091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4040cb840 msgr2=0x7ff4040c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7ff40922e700 1 --2- 172.21.15.81:0/3639654091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4040cb840 0x7ff4040c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7ff40922e700 1 -- 172.21.15.81:0/3639654091 >> v2:172.21.15.81:3300/0 conn(0x7ff404155c60 msgr2=0x7ff404156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7ff40922e700 1 --2- 172.21.15.81:0/3639654091 >> v2:172.21.15.81:3300/0 conn(0x7ff404155c60 0x7ff404156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.410+0000 7ff40922e700 1 -- 172.21.15.81:0/3639654091 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4040caa80 con 0x7ff4040cbc90 2023-10-07T08:43:07.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.410+0000 7ff40922e700 1 --2- 172.21.15.81:0/3639654091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4040cbc90 0x7ff4040c8d50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff4040af630 tx=0x7ff3f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ae29b2fdaeb1b2a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.410+0000 7ff4037fe700 1 -- 172.21.15.81:0/3639654091 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4011630 con 0x7ff4040cbc90 2023-10-07T08:43:07.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.410+0000 7ff4037fe700 1 -- 172.21.15.81:0/3639654091 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f40117b0 con 0x7ff4040cbc90 2023-10-07T08:43:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.410+0000 7ff4037fe700 1 -- 172.21.15.81:0/3639654091 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4011b70 con 0x7ff4040cbc90 2023-10-07T08:43:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7fcdd141a700 1 -- start start 2023-10-07T08:43:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.410+0000 7fcdd141a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcdcc06d120 0x7fcdcc06d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.410+0000 7fcdd141a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcdcc0cf660 0x7fcdcc0cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.410+0000 7fcdd141a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdcc06df90 con 0x7fcdcc15e3c0 2023-10-07T08:43:07.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.410+0000 7fcdd141a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc0b3ba0 con 0x7fcdcc06d120 2023-10-07T08:43:07.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.410+0000 7fcdd141a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc15f7b0 con 0x7fcdcc0cf660 2023-10-07T08:43:07.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.410+0000 7fcdc27fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcdcc06d120 0x7fcdcc06d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f5edf14a700 1 Processor -- start 2023-10-07T08:43:07.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.410+0000 7fcdc27fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcdcc06d120 0x7fcdcc06d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44842/0 (socket says 172.21.15.81:44842) 2023-10-07T08:43:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.410+0000 7fcdc27fc700 1 -- 172.21.15.81:0/1650602338 learned_addr learned my addr 172.21.15.81:0/1650602338 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7fcdc27fc700 1 -- 172.21.15.81:0/1650602338 >> v2:172.21.15.89:3300/0 conn(0x7fcdcc0cf660 msgr2=0x7fcdcc0cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7fcdc27fc700 1 --2- 172.21.15.81:0/1650602338 >> v2:172.21.15.89:3300/0 conn(0x7fcdcc0cf660 0x7fcdcc0cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7fcdc27fc700 1 -- 172.21.15.81:0/1650602338 >> v1:172.21.15.81:6789/0 conn(0x7fcdcc15e3c0 legacy=0x7fcdcc0cd750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T08:43:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7fcdc27fc700 1 -- 172.21.15.81:0/1650602338 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc06dad0 con 0x7fcdcc06d120 2023-10-07T08:43:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.409+0000 7f3cd5bf4700 1 -- start start 2023-10-07T08:43:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3cd5bf4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cd006e940 0x7f3cd0153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3cd5bf4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cd01569e0 0x7f3cd00cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3cd5bf4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd0156db0 0x7f3cd00a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3cd5bf4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00ccf10 con 0x7f3cd0156db0 2023-10-07T08:43:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3cd5bf4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd0153650 con 0x7f3cd01569e0 2023-10-07T08:43:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3cd5bf4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00cc950 con 0x7f3cd006e940 2023-10-07T08:43:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3ccffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd0156db0 0x7f3cd00a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3cceffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cd01569e0 0x7f3cd00cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3ccffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd0156db0 0x7f3cd00a6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44858/0 (socket says 172.21.15.81:44858) 2023-10-07T08:43:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3ccffff700 1 -- 172.21.15.81:0/3109561340 learned_addr learned my addr 172.21.15.81:0/3109561340 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3ccf7fe700 1 --2- 172.21.15.81:0/3109561340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cd006e940 0x7f3cd0153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7ff40ac91700 1 -- 172.21.15.81:0/3639654091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4040cbc90 msgr2=0x7ff4040c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7ff40ac91700 1 --2- 172.21.15.81:0/3639654091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4040cbc90 0x7ff4040c8d50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff4040af630 tx=0x7ff3f40091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7fcdc27fc700 1 --2- 172.21.15.81:0/1650602338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc06d120 0x7fcdcc06d590 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc06ab90 tx=0x7fcdb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a8f10c0a2f8ddc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3ccffff700 1 -- 172.21.15.81:0/3109561340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cd006e940 msgr2=0x7f3cd0153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3ccffff700 1 --2- 172.21.15.81:0/3109561340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cd006e940 0x7f3cd0153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3ccffff700 1 -- 172.21.15.81:0/3109561340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cd01569e0 msgr2=0x7f3cd00cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3ccffff700 1 --2- 172.21.15.81:0/3109561340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cd01569e0 0x7f3cd00cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3ccffff700 1 -- 172.21.15.81:0/3109561340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc8009ae0 con 0x7f3cd0156db0 2023-10-07T08:43:07.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3cceffd700 1 --2- 172.21.15.81:0/3109561340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cd01569e0 0x7f3cd00cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:07.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7ff40ac91700 1 -- 172.21.15.81:0/3639654091 shutdown_connections 2023-10-07T08:43:07.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7ff40ac91700 1 --2- 172.21.15.81:0/3639654091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4040cbc90 0x7ff4040c8d50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7ff40ac91700 1 --2- 172.21.15.81:0/3639654091 >> v2:172.21.15.81:3300/0 conn(0x7ff404155c60 0x7ff404156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7ff40ac91700 1 --2- 172.21.15.81:0/3639654091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4040cb840 0x7ff4040c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7ff40ac91700 1 -- 172.21.15.81:0/3639654091 >> 172.21.15.81:0/3639654091 conn(0x7ff4040cc980 msgr2=0x7ff4040ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7ff40ac91700 1 -- 172.21.15.81:0/3639654091 shutdown_connections 2023-10-07T08:43:07.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7ff40ac91700 1 -- 172.21.15.81:0/3639654091 wait complete. 2023-10-07T08:43:07.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f3ccffff700 1 --2- 172.21.15.81:0/3109561340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd0156db0 0x7f3cd00a6480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8003000 tx=0x7f3cc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.411+0000 7f5edf14a700 1 -- start start 2023-10-07T08:43:07.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f3cb77fe700 1 -- 172.21.15.81:0/3109561340 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80092e0 con 0x7f3cd0156db0 2023-10-07T08:43:07.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5edf14a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ed80b1d10 0x7f5ed815c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5edf14a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ed81569e0 0x7f5ed814b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5edf14a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ed8159410 0x7f5ed815d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5edf14a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed815aaa0 con 0x7f5ed80b1d10 2023-10-07T08:43:07.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5edf14a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed8158f80 con 0x7f5ed8159410 2023-10-07T08:43:07.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5edf14a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed8158370 con 0x7f5ed81569e0 2023-10-07T08:43:07.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5ad2d9d700 1 --2- 172.21.15.81:0/428899574 >> v2:172.21.15.89:3300/0 conn(0x7f5ad40cac60 0x7f5ad406ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5ad159a700 1 -- 172.21.15.81:0/428899574 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1750871421 0 0) 0x7f5ad406d960 con 0x7f5ad4068c20 2023-10-07T08:43:07.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5ad159a700 1 -- 172.21.15.81:0/428899574 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5abc003570 con 0x7f5ad4068c20 2023-10-07T08:43:07.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5ad1d9b700 1 -- 172.21.15.81:0/428899574 >> v2:172.21.15.89:3300/0 conn(0x7f5ad40cac60 msgr2=0x7f5ad406ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5ad1d9b700 1 --2- 172.21.15.81:0/428899574 >> v2:172.21.15.89:3300/0 conn(0x7f5ad40cac60 0x7f5ad406ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5ad1d9b700 1 -- 172.21.15.81:0/428899574 >> v1:172.21.15.89:6789/0 conn(0x7f5ad4068c20 legacy=0x7f5ad40ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5ad1d9b700 1 -- 172.21.15.81:0/428899574 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad40c8180 con 0x7f5ad4069290 2023-10-07T08:43:07.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7fcdca7fc700 1 -- 172.21.15.81:0/1650602338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400b820 con 0x7fcdcc06d120 2023-10-07T08:43:07.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5ed7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ed81569e0 0x7f5ed814b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5ed7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ed81569e0 0x7f5ed814b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:48996/0 (socket says 172.21.15.81:48996) 2023-10-07T08:43:07.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5ed7fff700 1 -- 172.21.15.81:0/1054222153 learned_addr learned my addr 172.21.15.81:0/1054222153 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5edd6e7700 1 --2- 172.21.15.81:0/1054222153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ed8159410 0x7f5ed815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f5ad1d9b700 1 --2- 172.21.15.81:0/428899574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad4069290 0x7f5ad416a060 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009e60 tx=0x7f5acc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fb56902ff2e4ca3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f5edcee6700 1 --2- 172.21.15.81:0/1054222153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ed80b1d10 0x7f5ed815c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f5ed7fff700 1 -- 172.21.15.81:0/1054222153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ed8159410 msgr2=0x7f5ed815d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f5ed7fff700 1 --2- 172.21.15.81:0/1054222153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ed8159410 0x7f5ed815d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f5ed7fff700 1 -- 172.21.15.81:0/1054222153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ed80b1d10 msgr2=0x7f5ed815c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f5ed7fff700 1 --2- 172.21.15.81:0/1054222153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ed80b1d10 0x7f5ed815c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f3cb77fe700 1 -- 172.21.15.81:0/3109561340 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc8012d40 con 0x7f3cd0156db0 2023-10-07T08:43:07.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f3cb77fe700 1 -- 172.21.15.81:0/3109561340 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc801e660 con 0x7f3cd0156db0 2023-10-07T08:43:07.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f3cd5bf4700 1 -- 172.21.15.81:0/3109561340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd00ccc30 con 0x7f3cd0156db0 2023-10-07T08:43:07.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7f3cd5bf4700 1 -- 172.21.15.81:0/3109561340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd00ad8c0 con 0x7f3cd0156db0 2023-10-07T08:43:07.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f5ad159a700 1 -- 172.21.15.81:0/428899574 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00e070 con 0x7f5ad4069290 2023-10-07T08:43:07.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f5ad159a700 1 -- 172.21.15.81:0/428899574 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc00bb00 con 0x7f5ad4069290 2023-10-07T08:43:07.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f5ad159a700 1 -- 172.21.15.81:0/428899574 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00be80 con 0x7f5ad4069290 2023-10-07T08:43:07.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f5ed7fff700 1 -- 172.21.15.81:0/1054222153 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4009420 con 0x7f5ed81569e0 2023-10-07T08:43:07.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f5edcee6700 1 --2- 172.21.15.81:0/1054222153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ed80b1d10 0x7f5ed815c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:07.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7ff40ac91700 1 Processor -- start 2023-10-07T08:43:07.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f5ed7fff700 1 --2- 172.21.15.81:0/1054222153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ed81569e0 0x7f5ed814b460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40091e0 tx=0x7f5ec4016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f5ed4ff9700 1 -- 172.21.15.81:0/1054222153 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec400b990 con 0x7f5ed81569e0 2023-10-07T08:43:07.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7ff40ac91700 1 -- start start 2023-10-07T08:43:07.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f5ed4ff9700 1 -- 172.21.15.81:0/1054222153 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec4020070 con 0x7f5ed81569e0 2023-10-07T08:43:07.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f5ed4ff9700 1 -- 172.21.15.81:0/1054222153 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec401b450 con 0x7f5ed81569e0 2023-10-07T08:43:07.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7fcdca7fc700 1 -- 172.21.15.81:0/1650602338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb400b980 con 0x7fcdcc06d120 2023-10-07T08:43:07.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.412+0000 7fcdca7fc700 1 -- 172.21.15.81:0/1650602338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400bd20 con 0x7fcdcc06d120 2023-10-07T08:43:07.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7fcdd141a700 1 -- 172.21.15.81:0/1650602338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc06d120 msgr2=0x7fcdcc06d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7fcdd141a700 1 --2- 172.21.15.81:0/1650602338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc06d120 0x7fcdcc06d590 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc06ab90 tx=0x7fcdb4009250 comp rx=0 tx=0).stop 2023-10-07T08:43:07.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f3cd5bf4700 1 -- 172.21.15.81:0/3109561340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3cd0068900 con 0x7f3cd0156db0 2023-10-07T08:43:07.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f865bc42700 1 Processor -- start 2023-10-07T08:43:07.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.414+0000 7f865bc42700 1 -- start start 2023-10-07T08:43:07.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.414+0000 7f5ad89ba700 1 -- 172.21.15.81:0/428899574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad4069290 msgr2=0x7f5ad416a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.414+0000 7f5ad89ba700 1 --2- 172.21.15.81:0/428899574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad4069290 0x7f5ad416a060 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009e60 tx=0x7f5acc009780 comp rx=0 tx=0).stop 2023-10-07T08:43:07.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.414+0000 7fcdd141a700 1 -- 172.21.15.81:0/1650602338 shutdown_connections 2023-10-07T08:43:07.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.414+0000 7fcdd141a700 1 --2- 172.21.15.81:0/1650602338 >> v2:172.21.15.89:3300/0 conn(0x7fcdcc0cf660 0x7fcdcc0cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.414+0000 7fcdd141a700 1 --2- 172.21.15.81:0/1650602338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc06d120 0x7fcdcc06d590 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.414+0000 7fcdd141a700 1 -- 172.21.15.81:0/1650602338 >> 172.21.15.81:0/1650602338 conn(0x7fcdcc06bb90 msgr2=0x7fcdcc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.414+0000 7ff40ac91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4040cb840 0x7ff4040afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.414+0000 7ff40ac91700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4040cbc90 0x7ff4040c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.414+0000 7ff40ac91700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff404155c60 0x7ff4040c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.414+0000 7ff40ac91700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4040b1770 con 0x7ff4040cb840 2023-10-07T08:43:07.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.414+0000 7ff40ac91700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4040b06d0 con 0x7ff404155c60 2023-10-07T08:43:07.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.414+0000 7ff40ac91700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4040b09b0 con 0x7ff4040cbc90 2023-10-07T08:43:07.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f5edf14a700 1 -- 172.21.15.81:0/1054222153 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed8158650 con 0x7f5ed81569e0 2023-10-07T08:43:07.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.414+0000 7f5edf14a700 1 -- 172.21.15.81:0/1054222153 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed8158c10 con 0x7f5ed81569e0 2023-10-07T08:43:07.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f5edf14a700 1 -- 172.21.15.81:0/1054222153 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ed8068900 con 0x7f5ed81569e0 2023-10-07T08:43:07.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7ff403fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4040cbc90 0x7ff4040c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7ff403fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4040cbc90 0x7ff4040c60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:49010/0 (socket says 172.21.15.81:49010) 2023-10-07T08:43:07.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7ff403fff700 1 -- 172.21.15.81:0/3906892382 learned_addr learned my addr 172.21.15.81:0/3906892382 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f5ad89ba700 1 -- 172.21.15.81:0/428899574 shutdown_connections 2023-10-07T08:43:07.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f5ad89ba700 1 --2- 172.21.15.81:0/428899574 >> v2:172.21.15.89:3300/0 conn(0x7f5ad40cac60 0x7f5ad406ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f5ad89ba700 1 --2- 172.21.15.81:0/428899574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad4069290 0x7f5ad416a060 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f5ad89ba700 1 -- 172.21.15.81:0/428899574 >> 172.21.15.81:0/428899574 conn(0x7f5ad40cc980 msgr2=0x7f5ad40ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7ff40922e700 1 --2- 172.21.15.81:0/3906892382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff404155c60 0x7ff4040c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7fcdd141a700 1 -- 172.21.15.81:0/1650602338 shutdown_connections 2023-10-07T08:43:07.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f865bc42700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f865406d830 0x7f86540cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f865bc42700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86540d07c0 con 0x7f8654157ca0 2023-10-07T08:43:07.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f865bc42700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86540cfbb0 con 0x7f86541578d0 2023-10-07T08:43:07.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f865bc42700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86540cfe90 con 0x7f865406d830 2023-10-07T08:43:07.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.414+0000 7f3cb77fe700 1 -- 172.21.15.81:0/3109561340 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3cc801ea50 con 0x7f3cd0156db0 2023-10-07T08:43:07.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f3cb77fe700 1 --2- 172.21.15.81:0/3109561340 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cbc066fb0 0x7f3cbc069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f3cb77fe700 1 -- 172.21.15.81:0/3109561340 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3cc80860a0 con 0x7f3cd0156db0 2023-10-07T08:43:07.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f3ccf7fe700 1 --2- 172.21.15.81:0/3109561340 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cbc066fb0 0x7f3cbc069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f3cb77fe700 1 --2- 172.21.15.81:0/3109561340 >> [v2:172.21.15.81:6808/86339,v1:172.21.15.81:6809/86339] conn(0x7f3cbc06f140 0x7f3cbc071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f3cb77fe700 1 -- 172.21.15.81:0/3109561340 --> [v2:172.21.15.81:6808/86339,v1:172.21.15.81:6809/86339] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3cbc071c00 con 0x7f3cbc06f140 2023-10-07T08:43:07.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7fcdd141a700 1 -- 172.21.15.81:0/1650602338 wait complete. 2023-10-07T08:43:07.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f5ad89ba700 1 -- 172.21.15.81:0/428899574 shutdown_connections 2023-10-07T08:43:07.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f5ad89ba700 1 -- 172.21.15.81:0/428899574 wait complete. 2023-10-07T08:43:07.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f86591dd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8654157ca0 0x7f865406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59394/0 (socket says 172.21.15.81:59394) 2023-10-07T08:43:07.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f86591dd700 1 -- 172.21.15.81:0/574027126 learned_addr learned my addr 172.21.15.81:0/574027126 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:07.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f3ccf7fe700 1 --2- 172.21.15.81:0/3109561340 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cbc066fb0 0x7f3cbc069460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4006fd0 tx=0x7f3cc4000f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f5ed4ff9700 1 -- 172.21.15.81:0/1054222153 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ec4022030 con 0x7f5ed81569e0 2023-10-07T08:43:07.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f51d0f19700 1 Processor -- start 2023-10-07T08:43:07.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.413+0000 7f51d0f19700 1 -- start start 2023-10-07T08:43:07.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f51d0f19700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f51cc0c75e0 0x7f51cc0c2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f51d0f19700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f51cc155940 0x7f51cc155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f51d0f19700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51cc0ca680 con 0x7f51cc0c7210 2023-10-07T08:43:07.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f51d0f19700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51cc0c2800 con 0x7f51cc155940 2023-10-07T08:43:07.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f51d0f19700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51cc0c2ae0 con 0x7f51cc0c75e0 2023-10-07T08:43:07.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f51c9d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f51cc0c75e0 0x7f51cc0c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f51c9d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f51cc0c75e0 0x7f51cc0c2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:38984/0 (socket says 172.21.15.81:38984) 2023-10-07T08:43:07.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7f51c9d9b700 1 -- 172.21.15.81:0/4243397517 learned_addr learned my addr 172.21.15.81:0/4243397517 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f51c9d9b700 1 -- 172.21.15.81:0/4243397517 >> v2:172.21.15.81:3300/0 conn(0x7f51cc155940 msgr2=0x7f51cc155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f51c9d9b700 1 --2- 172.21.15.81:0/4243397517 >> v2:172.21.15.81:3300/0 conn(0x7f51cc155940 0x7f51cc155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f51c9d9b700 1 -- 172.21.15.81:0/4243397517 >> v1:172.21.15.81:6789/0 conn(0x7f51cc0c7210 legacy=0x7f51cc0abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f51c9d9b700 1 -- 172.21.15.81:0/4243397517 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc0c2dc0 con 0x7f51cc0c75e0 2023-10-07T08:43:07.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f865a1df700 1 --2- 172.21.15.81:0/574027126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f865406d830 0x7f86540cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f51c9d9b700 1 --2- 172.21.15.81:0/4243397517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51cc0c75e0 0x7f51cc0c2220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f51cc068670 tx=0x7f51bc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5327e4a4f389e297 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f86589dc700 1 -- 172.21.15.81:0/574027126 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853136202 0 0) 0x7f86540cfbb0 con 0x7f86541578d0 2023-10-07T08:43:07.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f86589dc700 1 -- 172.21.15.81:0/574027126 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8640003570 con 0x7f86541578d0 2023-10-07T08:43:07.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f5ed4ff9700 1 --2- 172.21.15.81:0/1054222153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ebc066fb0 0x7f5ebc069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f865a1df700 1 -- 172.21.15.81:0/574027126 >> v1:172.21.15.89:6789/0 conn(0x7f86541578d0 legacy=0x7f865415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f865a1df700 1 -- 172.21.15.81:0/574027126 >> v1:172.21.15.81:6789/0 conn(0x7f8654157ca0 legacy=0x7f865406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f865a1df700 1 -- 172.21.15.81:0/574027126 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86540d0170 con 0x7f865406d830 2023-10-07T08:43:07.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f5ed4ff9700 1 -- 172.21.15.81:0/1054222153 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ec4086370 con 0x7f5ed81569e0 2023-10-07T08:43:07.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f5edcee6700 1 --2- 172.21.15.81:0/1054222153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ebc066fb0 0x7f5ebc069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f865a1df700 1 --2- 172.21.15.81:0/574027126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f865406d830 0x7f86540cf4f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f864c009e90 tx=0x7f864c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97b5773136752ff8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f5ed4ff9700 1 --2- 172.21.15.81:0/1054222153 >> [v2:172.21.15.81:6800/86338,v1:172.21.15.81:6801/86338] conn(0x7f5ebc06f1c0 0x7f5ebc0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f5ed4ff9700 1 -- 172.21.15.81:0/1054222153 --> [v2:172.21.15.81:6800/86338,v1:172.21.15.81:6801/86338] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ebc071c80 con 0x7f5ebc06f1c0 2023-10-07T08:43:07.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f5ed4ff9700 1 -- 172.21.15.81:0/1054222153 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ec4088850 con 0x7f5ed81569e0 2023-10-07T08:43:07.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f3cb77fe700 1 -- 172.21.15.81:0/3109561340 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cc8053270 con 0x7f3cd0156db0 2023-10-07T08:43:07.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f51c959a700 1 -- 172.21.15.81:0/4243397517 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc00be30 con 0x7f51cc0c75e0 2023-10-07T08:43:07.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f51c959a700 1 -- 172.21.15.81:0/4243397517 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc00b360 con 0x7f51cc0c75e0 2023-10-07T08:43:07.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f51c959a700 1 -- 172.21.15.81:0/4243397517 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc00b6e0 con 0x7f51cc0c75e0 2023-10-07T08:43:07.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.416+0000 7f86589dc700 1 -- 172.21.15.81:0/574027126 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c00e070 con 0x7f865406d830 2023-10-07T08:43:07.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.417+0000 7f86589dc700 1 -- 172.21.15.81:0/574027126 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c00bc30 con 0x7f865406d830 2023-10-07T08:43:07.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.417+0000 7f86589dc700 1 -- 172.21.15.81:0/574027126 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c012430 con 0x7f865406d830 2023-10-07T08:43:07.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.417+0000 7f5ad89ba700 1 Processor -- start 2023-10-07T08:43:07.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7ff40922e700 1 -- 172.21.15.81:0/3906892382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4040cbc90 msgr2=0x7ff4040c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7ff40922e700 1 --2- 172.21.15.81:0/3906892382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4040cbc90 0x7ff4040c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7ff40922e700 1 -- 172.21.15.81:0/3906892382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4040cb840 msgr2=0x7ff4040afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7ff40922e700 1 --2- 172.21.15.81:0/3906892382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4040cb840 0x7ff4040afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.415+0000 7ff40922e700 1 -- 172.21.15.81:0/3906892382 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f4009420 con 0x7ff404155c60 2023-10-07T08:43:07.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.417+0000 7f5edcee6700 1 --2- 172.21.15.81:0/1054222153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ebc066fb0 0x7f5ebc069460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc006fd0 tx=0x7f5ecc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.417+0000 7f5ad89ba700 1 -- start start 2023-10-07T08:43:07.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.417+0000 7fcdd141a700 1 Processor -- start 2023-10-07T08:43:07.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.417+0000 7f3cceffd700 1 --2- 172.21.15.81:0/3109561340 >> [v2:172.21.15.81:6808/86339,v1:172.21.15.81:6809/86339] conn(0x7f3cbc06f140 0x7f3cbc071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.417+0000 7ff40922e700 1 --2- 172.21.15.81:0/3906892382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff404155c60 0x7ff4040c3a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4016000 tx=0x7ff3f4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.417+0000 7ff400ff9700 1 -- 172.21.15.81:0/3906892382 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f401f070 con 0x7ff404155c60 2023-10-07T08:43:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.417+0000 7ff400ff9700 1 -- 172.21.15.81:0/3906892382 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f4011920 con 0x7ff404155c60 2023-10-07T08:43:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.417+0000 7ff40ac91700 1 -- 172.21.15.81:0/3906892382 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4040b0c90 con 0x7ff404155c60 2023-10-07T08:43:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.417+0000 7ff40ac91700 1 -- 172.21.15.81:0/3906892382 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4040b1250 con 0x7ff404155c60 2023-10-07T08:43:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.417+0000 7ff400ff9700 1 -- 172.21.15.81:0/3906892382 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4025420 con 0x7ff404155c60 2023-10-07T08:43:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.417+0000 7f51d0f19700 1 -- 172.21.15.81:0/4243397517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51cc0c75e0 msgr2=0x7f51cc0c2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.417+0000 7f51d0f19700 1 --2- 172.21.15.81:0/4243397517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51cc0c75e0 0x7f51cc0c2220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f51cc068670 tx=0x7f51bc009250 comp rx=0 tx=0).stop 2023-10-07T08:43:07.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f51d0f19700 1 -- 172.21.15.81:0/4243397517 shutdown_connections 2023-10-07T08:43:07.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f51d0f19700 1 --2- 172.21.15.81:0/4243397517 >> v2:172.21.15.81:3300/0 conn(0x7f51cc155940 0x7f51cc155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f51d0f19700 1 --2- 172.21.15.81:0/4243397517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51cc0c75e0 0x7f51cc0c2220 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f51d0f19700 1 -- 172.21.15.81:0/4243397517 >> 172.21.15.81:0/4243397517 conn(0x7f51cc06c660 msgr2=0x7f51cc0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f865bc42700 1 -- 172.21.15.81:0/574027126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f865406d830 msgr2=0x7f86540cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f865bc42700 1 --2- 172.21.15.81:0/574027126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f865406d830 0x7f86540cf4f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f864c009e90 tx=0x7f864c009780 comp rx=0 tx=0).stop 2023-10-07T08:43:07.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f5edd6e7700 1 --2- 172.21.15.81:0/1054222153 >> [v2:172.21.15.81:6800/86338,v1:172.21.15.81:6801/86338] conn(0x7f5ebc06f1c0 0x7f5ebc0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f865bc42700 1 -- 172.21.15.81:0/574027126 shutdown_connections 2023-10-07T08:43:07.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f865bc42700 1 --2- 172.21.15.81:0/574027126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f865406d830 0x7f86540cf4f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f865bc42700 1 -- 172.21.15.81:0/574027126 >> 172.21.15.81:0/574027126 conn(0x7f865406bb90 msgr2=0x7f865406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f3cceffd700 1 --2- 172.21.15.81:0/3109561340 >> [v2:172.21.15.81:6808/86339,v1:172.21.15.81:6809/86339] conn(0x7f3cbc06f140 0x7f3cbc071550 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f5ad89ba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad4068c20 0x7f5ad415c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f5ad89ba700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ad4069290 0x7f5ad40b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f5ad89ba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad40cac60 0x7f5ad40b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f5ad89ba700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad415c660 con 0x7f5ad4068c20 2023-10-07T08:43:07.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f5ad89ba700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad4168600 con 0x7f5ad4069290 2023-10-07T08:43:07.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f5ad89ba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40af890 con 0x7f5ad40cac60 2023-10-07T08:43:07.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f865bc42700 1 -- 172.21.15.81:0/574027126 shutdown_connections 2023-10-07T08:43:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f5edd6e7700 1 --2- 172.21.15.81:0/1054222153 >> [v2:172.21.15.81:6800/86338,v1:172.21.15.81:6801/86338] conn(0x7f5ebc06f1c0 0x7f5ebc0715d0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f5ad259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad4068c20 0x7f5ad415c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f5ad259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad4068c20 0x7f5ad415c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44890/0 (socket says 172.21.15.81:44890) 2023-10-07T08:43:07.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f5ad259c700 1 -- 172.21.15.81:0/2868814417 learned_addr learned my addr 172.21.15.81:0/2868814417 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f5ad2d9d700 1 --2- 172.21.15.81:0/2868814417 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad40cac60 0x7f5ad40b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7ff40ac91700 1 -- 172.21.15.81:0/3906892382 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff3e0000fd0 con 0x7ff404155c60 2023-10-07T08:43:07.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f5ad2d9d700 1 -- 172.21.15.81:0/2868814417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ad4069290 msgr2=0x7f5ad40b0bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-07T08:43:07.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f5ad2d9d700 1 --2- 172.21.15.81:0/2868814417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ad4069290 0x7f5ad40b0bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.419+0000 7f5ad2d9d700 1 -- 172.21.15.81:0/2868814417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad4068c20 msgr2=0x7f5ad415c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.419+0000 7f5ad2d9d700 1 --2- 172.21.15.81:0/2868814417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad4068c20 0x7f5ad415c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.419+0000 7f5ad2d9d700 1 -- 172.21.15.81:0/2868814417 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc009a20 con 0x7f5ad40cac60 2023-10-07T08:43:07.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.419+0000 7f3cb77fe700 1 -- 172.21.15.81:0/3109561340 <== osd.3 v2:172.21.15.81:6808/86339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f3cbc071c00 con 0x7f3cbc06f140 2023-10-07T08:43:07.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.419+0000 7f5ad2d9d700 1 --2- 172.21.15.81:0/2868814417 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad40cac60 0x7f5ad40b1c20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400e900 tx=0x7f5ac40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.419+0000 7f5ac27fc700 1 -- 172.21.15.81:0/2868814417 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4013680 con 0x7f5ad40cac60 2023-10-07T08:43:07.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.419+0000 7f5ac27fc700 1 -- 172.21.15.81:0/2868814417 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac4013820 con 0x7f5ad40cac60 2023-10-07T08:43:07.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.419+0000 7f5ac27fc700 1 -- 172.21.15.81:0/2868814417 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4013be0 con 0x7f5ad40cac60 2023-10-07T08:43:07.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.419+0000 7f5ad89ba700 1 -- 172.21.15.81:0/2868814417 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad40afb30 con 0x7f5ad40cac60 2023-10-07T08:43:07.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.419+0000 7f5ad89ba700 1 -- 172.21.15.81:0/2868814417 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad40b00f0 con 0x7f5ad40cac60 2023-10-07T08:43:07.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.419+0000 7ff400ff9700 1 -- 172.21.15.81:0/3906892382 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff3f4023070 con 0x7ff404155c60 2023-10-07T08:43:07.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.418+0000 7f865bc42700 1 -- 172.21.15.81:0/574027126 wait complete. 2023-10-07T08:43:07.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.420+0000 7f865bc42700 1 Processor -- start 2023-10-07T08:43:07.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.420+0000 7f5ad89ba700 1 -- 172.21.15.81:0/2868814417 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ab8000fd0 con 0x7f5ad40cac60 2023-10-07T08:43:07.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.420+0000 7ff400ff9700 1 --2- 172.21.15.81:0/3906892382 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3e8066fd0 0x7ff3e8069480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.420+0000 7ff400ff9700 1 -- 172.21.15.81:0/3906892382 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff3f4085960 con 0x7ff404155c60 2023-10-07T08:43:07.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.420+0000 7ff400ff9700 1 --2- 172.21.15.81:0/3906892382 >> [v2:172.21.15.89:6822/86582,v1:172.21.15.89:6824/86582] conn(0x7ff3e806f1e0 0x7ff3e80715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.420+0000 7ff400ff9700 1 -- 172.21.15.81:0/3906892382 --> [v2:172.21.15.89:6822/86582,v1:172.21.15.89:6824/86582] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3e8071ca0 con 0x7ff3e806f1e0 2023-10-07T08:43:07.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.420+0000 7ff400ff9700 1 -- 172.21.15.81:0/3906892382 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3f408a240 con 0x7ff404155c60 2023-10-07T08:43:07.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.420+0000 7ff403fff700 1 --2- 172.21.15.81:0/3906892382 >> [v2:172.21.15.89:6822/86582,v1:172.21.15.89:6824/86582] conn(0x7ff3e806f1e0 0x7ff3e80715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f51d0f19700 1 -- 172.21.15.81:0/4243397517 shutdown_connections 2023-10-07T08:43:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.420+0000 7f865bc42700 1 -- start start 2023-10-07T08:43:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f865bc42700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f865406d830 0x7f865416e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f865bc42700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86541578d0 0x7f8654089970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f865bc42700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8654157ca0 0x7f865415b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f865bc42700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865414b8c0 con 0x7f86541578d0 2023-10-07T08:43:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f865bc42700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865408afd0 con 0x7f865406d830 2023-10-07T08:43:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f865bc42700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865408a710 con 0x7f8654157ca0 2023-10-07T08:43:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f86591dd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86541578d0 0x7f8654089970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f865a1df700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8654157ca0 0x7f865415b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f865a1df700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8654157ca0 0x7f865415b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:49032/0 (socket says 172.21.15.81:49032) 2023-10-07T08:43:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f865a1df700 1 -- 172.21.15.81:0/976742114 learned_addr learned my addr 172.21.15.81:0/976742114 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f86599de700 1 --2- 172.21.15.81:0/976742114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f865406d830 0x7f865416e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f86591dd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86541578d0 0x7f8654089970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44902/0 (socket says 172.21.15.81:44902) 2023-10-07T08:43:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7ff403fff700 1 --2- 172.21.15.81:0/3906892382 >> [v2:172.21.15.89:6822/86582,v1:172.21.15.89:6824/86582] conn(0x7ff3e806f1e0 0x7ff3e80715f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f865a1df700 1 -- 172.21.15.81:0/976742114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f865406d830 msgr2=0x7f865416e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f865a1df700 1 --2- 172.21.15.81:0/976742114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f865406d830 0x7f865416e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f865a1df700 1 -- 172.21.15.81:0/976742114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86541578d0 msgr2=0x7f8654089970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f865a1df700 1 --2- 172.21.15.81:0/976742114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86541578d0 0x7f8654089970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f865a1df700 1 -- 172.21.15.81:0/976742114 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c009a20 con 0x7f8654157ca0 2023-10-07T08:43:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7f865a1df700 1 --2- 172.21.15.81:0/976742114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8654157ca0 0x7f865415b680 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f864c013000 tx=0x7f864c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.420+0000 7fcdd141a700 1 -- start start 2023-10-07T08:43:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.420+0000 7fcdd141a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc06d120 0x7fcdcc164630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7fcdd141a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdcc0cf660 0x7fcdcc14ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7fcdd141a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdcc15e3c0 0x7fcdcc162fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7fcdd141a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc14f190 con 0x7fcdcc06d120 2023-10-07T08:43:07.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7fcdd141a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc164e30 con 0x7fcdcc0cf660 2023-10-07T08:43:07.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7fcdd141a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc1653f0 con 0x7fcdcc15e3c0 2023-10-07T08:43:07.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7fcdcaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc06d120 0x7fcdcc164630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7fcdcaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc06d120 0x7fcdcc164630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44910/0 (socket says 172.21.15.81:44910) 2023-10-07T08:43:07.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7fcdcaffd700 1 -- 172.21.15.81:0/1856095706 learned_addr learned my addr 172.21.15.81:0/1856095706 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7fcdcaffd700 1 -- 172.21.15.81:0/1856095706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdcc15e3c0 msgr2=0x7fcdcc162fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-07T08:43:07.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7fcdcaffd700 1 --2- 172.21.15.81:0/1856095706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdcc15e3c0 0x7fcdcc162fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7fcdcaffd700 1 -- 172.21.15.81:0/1856095706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdcc0cf660 msgr2=0x7fcdcc14ec50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-07T08:43:07.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7fcdcaffd700 1 --2- 172.21.15.81:0/1856095706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdcc0cf660 0x7fcdcc14ec50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.421+0000 7fcdcaffd700 1 -- 172.21.15.81:0/1856095706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb40094f0 con 0x7fcdcc06d120 2023-10-07T08:43:07.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.420+0000 7f5ed4ff9700 1 -- 172.21.15.81:0/1054222153 <== osd.0 v2:172.21.15.81:6800/86338 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f5ebc071c80 con 0x7f5ebc06f1c0 2023-10-07T08:43:07.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.422+0000 7fcdcaffd700 1 --2- 172.21.15.81:0/1856095706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc06d120 0x7fcdcc164630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00b630 tx=0x7fcdbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.422+0000 7ff400ff9700 1 -- 172.21.15.81:0/3906892382 <== osd.6 v2:172.21.15.89:6822/86582 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7ff3e8071ca0 con 0x7ff3e806f1e0 2023-10-07T08:43:07.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.422+0000 7f8649ffb700 1 -- 172.21.15.81:0/976742114 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c012e10 con 0x7f8654157ca0 2023-10-07T08:43:07.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.422+0000 7f51d0f19700 1 -- 172.21.15.81:0/4243397517 wait complete. 2023-10-07T08:43:07.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.422+0000 7f8649ffb700 1 -- 172.21.15.81:0/976742114 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c01d630 con 0x7f8654157ca0 2023-10-07T08:43:07.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.422+0000 7f8649ffb700 1 -- 172.21.15.81:0/976742114 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c01d9f0 con 0x7f8654157ca0 2023-10-07T08:43:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.422+0000 7f865bc42700 1 -- 172.21.15.81:0/976742114 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865414be00 con 0x7f8654157ca0 2023-10-07T08:43:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.422+0000 7f865bc42700 1 -- 172.21.15.81:0/976742114 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865408ac60 con 0x7f8654157ca0 2023-10-07T08:43:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.423+0000 7fcdc37fe700 1 -- 172.21.15.81:0/1856095706 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc00f510 con 0x7fcdcc06d120 2023-10-07T08:43:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.423+0000 7fcdc37fe700 1 -- 172.21.15.81:0/1856095706 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdbc00f6b0 con 0x7fcdcc06d120 2023-10-07T08:43:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.423+0000 7fcdc37fe700 1 -- 172.21.15.81:0/1856095706 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc00fa70 con 0x7fcdcc06d120 2023-10-07T08:43:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.423+0000 7fcdd141a700 1 -- 172.21.15.81:0/1856095706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc14f3c0 con 0x7fcdcc06d120 2023-10-07T08:43:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.423+0000 7f865bc42700 1 -- 172.21.15.81:0/976742114 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f865415d1b0 con 0x7f8654157ca0 2023-10-07T08:43:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.423+0000 7fcdd141a700 1 -- 172.21.15.81:0/1856095706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc165080 con 0x7fcdcc06d120 2023-10-07T08:43:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.423+0000 7f51d0f19700 1 Processor -- start 2023-10-07T08:43:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.424+0000 7f51d0f19700 1 -- start start 2023-10-07T08:43:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.424+0000 7fcdd141a700 1 -- 172.21.15.81:0/1856095706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcdb0000fd0 con 0x7fcdcc06d120 2023-10-07T08:43:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.423+0000 7f5ac27fc700 1 -- 172.21.15.81:0/2868814417 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ac4013d40 con 0x7f5ad40cac60 2023-10-07T08:43:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.424+0000 7f5ac27fc700 1 --2- 172.21.15.81:0/2868814417 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ab4067000 0x7f5ab40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.424+0000 7f5ac27fc700 1 -- 172.21.15.81:0/2868814417 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ac4084280 con 0x7f5ad40cac60 2023-10-07T08:43:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.424+0000 7f5ac27fc700 1 --2- 172.21.15.81:0/2868814417 >> [v2:172.21.15.89:6800/86542,v1:172.21.15.89:6801/86542] conn(0x7f5ab406f210 0x7f5ab4071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.424+0000 7f5ac27fc700 1 -- 172.21.15.81:0/2868814417 --> [v2:172.21.15.89:6800/86542,v1:172.21.15.89:6801/86542] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ab4071cd0 con 0x7f5ab406f210 2023-10-07T08:43:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.424+0000 7f5ac27fc700 1 -- 172.21.15.81:0/2868814417 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ac40868c0 con 0x7f5ad40cac60 2023-10-07T08:43:07.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.424+0000 7f8649ffb700 1 -- 172.21.15.81:0/976742114 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f864c024070 con 0x7f8654157ca0 2023-10-07T08:43:07.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.424+0000 7f8649ffb700 1 --2- 172.21.15.81:0/976742114 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8638067000 0x7f86380694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.424+0000 7f86599de700 1 --2- 172.21.15.81:0/976742114 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8638067000 0x7f86380694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.424+0000 7f8649ffb700 1 -- 172.21.15.81:0/976742114 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f864c086c00 con 0x7f8654157ca0 2023-10-07T08:43:07.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.424+0000 7f8649ffb700 1 --2- 172.21.15.81:0/976742114 >> [v2:172.21.15.89:6808/86544,v1:172.21.15.89:6809/86544] conn(0x7f863806f210 0x7f8638071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.424+0000 7f8649ffb700 1 -- 172.21.15.81:0/976742114 --> [v2:172.21.15.89:6808/86544,v1:172.21.15.89:6809/86544] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8638071cd0 con 0x7f863806f210 2023-10-07T08:43:07.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.424+0000 7f8649ffb700 1 -- 172.21.15.81:0/976742114 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f864c089240 con 0x7f8654157ca0 2023-10-07T08:43:07.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f86591dd700 1 --2- 172.21.15.81:0/976742114 >> [v2:172.21.15.89:6808/86544,v1:172.21.15.89:6809/86544] conn(0x7f863806f210 0x7f8638071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f51d0f19700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51cc0c7210 0x7f51cc0b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f51d0f19700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51cc0c75e0 0x7f51cc0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f86599de700 1 --2- 172.21.15.81:0/976742114 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8638067000 0x7f86380694b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8650007fd0 tx=0x7f8650007d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f5ad1d9b700 1 --2- 172.21.15.81:0/2868814417 >> [v2:172.21.15.89:6800/86542,v1:172.21.15.89:6801/86542] conn(0x7f5ab406f210 0x7f5ab4071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7ff408a2d700 1 --2- 172.21.15.81:0/3906892382 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3e8066fd0 0x7ff3e8069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f2e3a617700 1 Processor -- start 2023-10-07T08:43:07.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f2e3a617700 1 -- start start 2023-10-07T08:43:07.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f86591dd700 1 --2- 172.21.15.81:0/976742114 >> [v2:172.21.15.89:6808/86544,v1:172.21.15.89:6809/86544] conn(0x7f863806f210 0x7f8638071620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7ff408a2d700 1 --2- 172.21.15.81:0/3906892382 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3e8066fd0 0x7ff3e8069480 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00acf0 tx=0x7ff3fc009370 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f5ad1d9b700 1 --2- 172.21.15.81:0/2868814417 >> [v2:172.21.15.89:6800/86542,v1:172.21.15.89:6801/86542] conn(0x7f5ab406f210 0x7f5ab4071620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f8649ffb700 1 -- 172.21.15.81:0/976742114 <== osd.7 v2:172.21.15.89:6808/86544 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f8638071cd0 con 0x7f863806f210 2023-10-07T08:43:07.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f2e3a617700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2e34159ca0 0x7f2e340690e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f2e3a617700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e3415a070 0x7f2e3406a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f2e3a617700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e340c8900 0x7f2e340cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f2e3a617700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3406acc0 con 0x7f2e3415a070 2023-10-07T08:43:07.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f2e3a617700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3406a2f0 con 0x7f2e34159ca0 2023-10-07T08:43:07.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f2e3a617700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e340696e0 con 0x7f2e340c8900 2023-10-07T08:43:07.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7f2e38bb4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e340c8900 0x7f2e340cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7f2e38bb4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e340c8900 0x7f2e340cb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:49042/0 (socket says 172.21.15.81:49042) 2023-10-07T08:43:07.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7f2e38bb4700 1 -- 172.21.15.81:0/886372795 learned_addr learned my addr 172.21.15.81:0/886372795 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7f2e38bb4700 1 -- 172.21.15.81:0/886372795 >> v2:172.21.15.89:3300/0 conn(0x7f2e34159ca0 msgr2=0x7f2e340690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7f2e38bb4700 1 --2- 172.21.15.81:0/886372795 >> v2:172.21.15.89:3300/0 conn(0x7f2e34159ca0 0x7f2e340690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7f2e38bb4700 1 -- 172.21.15.81:0/886372795 >> v2:172.21.15.81:3300/0 conn(0x7f2e3415a070 msgr2=0x7f2e3406a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7f2e38bb4700 1 --2- 172.21.15.81:0/886372795 >> v2:172.21.15.81:3300/0 conn(0x7f2e3415a070 0x7f2e3406a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7f2e38bb4700 1 -- 172.21.15.81:0/886372795 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e340699c0 con 0x7f2e340c8900 2023-10-07T08:43:07.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7fcdc37fe700 1 -- 172.21.15.81:0/1856095706 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcdbc024430 con 0x7fcdcc06d120 2023-10-07T08:43:07.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7f2e38bb4700 1 --2- 172.21.15.81:0/886372795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e340c8900 0x7f2e340cb020 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2e3406b0c0 tx=0x7f2e2c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dbab02e601f7b8f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7fcdc37fe700 1 --2- 172.21.15.81:0/1856095706 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcdac066fb0 0x7fcdac069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7fcdc37fe700 1 -- 172.21.15.81:0/1856095706 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcdbc084b90 con 0x7fcdcc06d120 2023-10-07T08:43:07.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7fcdc37fe700 1 --2- 172.21.15.81:0/1856095706 >> [v2:172.21.15.81:6817/86348,v1:172.21.15.81:6819/86348] conn(0x7fcdac06f1c0 0x7fcdac0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7fcdc37fe700 1 -- 172.21.15.81:0/1856095706 --> [v2:172.21.15.81:6817/86348,v1:172.21.15.81:6819/86348] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcdac071c80 con 0x7fcdac06f1c0 2023-10-07T08:43:07.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7fcdc37fe700 1 -- 172.21.15.81:0/1856095706 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdbc084ec0 con 0x7fcdcc06d120 2023-10-07T08:43:07.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7f2e32ffd700 1 -- 172.21.15.81:0/886372795 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c00e070 con 0x7f2e340c8900 2023-10-07T08:43:07.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7f2e32ffd700 1 -- 172.21.15.81:0/886372795 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2c00ba50 con 0x7f2e340c8900 2023-10-07T08:43:07.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.427+0000 7f2e32ffd700 1 -- 172.21.15.81:0/886372795 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c0092e0 con 0x7f2e340c8900 2023-10-07T08:43:07.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f51d0f19700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51cc155940 0x7f51cc169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f51d0f19700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc1520d0 con 0x7f51cc0c7210 2023-10-07T08:43:07.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f51d0f19700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc0b2770 con 0x7f51cc155940 2023-10-07T08:43:07.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f51d0f19700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc16ac30 con 0x7f51cc0c75e0 2023-10-07T08:43:07.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f51ca59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51cc0c7210 0x7f51cc0b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f51ca59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51cc0c7210 0x7f51cc0b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44920/0 (socket says 172.21.15.81:44920) 2023-10-07T08:43:07.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f51ca59c700 1 -- 172.21.15.81:0/3699535460 learned_addr learned my addr 172.21.15.81:0/3699535460 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f51c9d9b700 1 --2- 172.21.15.81:0/3699535460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51cc0c75e0 0x7f51cc0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.425+0000 7f51cad9d700 1 --2- 172.21.15.81:0/3699535460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51cc155940 0x7f51cc169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f51c9d9b700 1 -- 172.21.15.81:0/3699535460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51cc155940 msgr2=0x7f51cc169e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f51c9d9b700 1 --2- 172.21.15.81:0/3699535460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51cc155940 0x7f51cc169e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f51c9d9b700 1 -- 172.21.15.81:0/3699535460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51cc0c7210 msgr2=0x7f51cc0b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f51c9d9b700 1 --2- 172.21.15.81:0/3699535460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51cc0c7210 0x7f51cc0b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f51c9d9b700 1 -- 172.21.15.81:0/3699535460 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc0094f0 con 0x7f51cc0c75e0 2023-10-07T08:43:07.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f51cad9d700 1 --2- 172.21.15.81:0/3699535460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51cc155940 0x7f51cc169e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:07.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f51c9d9b700 1 --2- 172.21.15.81:0/3699535460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51cc0c75e0 0x7f51cc0b0f90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f51cc064670 tx=0x7f51bc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f51ba7fc700 1 -- 172.21.15.81:0/3699535460 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc026070 con 0x7f51cc0c75e0 2023-10-07T08:43:07.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f51ba7fc700 1 -- 172.21.15.81:0/3699535460 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc01c040 con 0x7f51cc0c75e0 2023-10-07T08:43:07.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f51ba7fc700 1 -- 172.21.15.81:0/3699535460 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc01b050 con 0x7f51cc0c75e0 2023-10-07T08:43:07.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f51d0f19700 1 -- 172.21.15.81:0/3699535460 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51cc0ac8b0 con 0x7f51cc0c75e0 2023-10-07T08:43:07.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.426+0000 7f51d0f19700 1 -- 172.21.15.81:0/3699535460 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51cc151cf0 con 0x7f51cc0c75e0 2023-10-07T08:43:07.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.428+0000 7f51ba7fc700 1 -- 172.21.15.81:0/3699535460 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51bc02b410 con 0x7f51cc0c75e0 2023-10-07T08:43:07.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.428+0000 7f2e3a617700 1 -- 172.21.15.81:0/886372795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e340c8900 msgr2=0x7f2e340cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.428+0000 7f2e3a617700 1 --2- 172.21.15.81:0/886372795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e340c8900 0x7f2e340cb020 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2e3406b0c0 tx=0x7f2e2c009840 comp rx=0 tx=0).stop 2023-10-07T08:43:07.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.428+0000 7f51ba7fc700 1 --2- 172.21.15.81:0/3699535460 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f51ac066f30 0x7f51ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.428+0000 7f51ba7fc700 1 -- 172.21.15.81:0/3699535460 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f51bc087ce0 con 0x7f51cc0c75e0 2023-10-07T08:43:07.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.429+0000 7f5ad259c700 1 --2- 172.21.15.81:0/2868814417 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ab4067000 0x7f5ab40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.429+0000 7f51d0f19700 1 --2- 172.21.15.81:0/3699535460 >> [v2:172.21.15.81:6816/86353,v1:172.21.15.81:6818/86353] conn(0x7f51cc0ac3d0 0x7f51cc0c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.429+0000 7f51d0f19700 1 -- 172.21.15.81:0/3699535460 --> [v2:172.21.15.81:6816/86353,v1:172.21.15.81:6818/86353] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51cc151e80 con 0x7f51cc0ac3d0 2023-10-07T08:43:07.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.429+0000 7f5ac27fc700 1 -- 172.21.15.81:0/2868814417 <== osd.4 v2:172.21.15.89:6800/86542 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f5ab4071cd0 con 0x7f5ab406f210 2023-10-07T08:43:07.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.429+0000 7f2e3a617700 1 -- 172.21.15.81:0/886372795 shutdown_connections 2023-10-07T08:43:07.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.429+0000 7f2e3a617700 1 --2- 172.21.15.81:0/886372795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e340c8900 0x7f2e340cb020 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.429+0000 7f2e3a617700 1 --2- 172.21.15.81:0/886372795 >> v2:172.21.15.89:3300/0 conn(0x7f2e34159ca0 0x7f2e340690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.429+0000 7f2e3a617700 1 --2- 172.21.15.81:0/886372795 >> v2:172.21.15.81:3300/0 conn(0x7f2e3415a070 0x7f2e3406a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.429+0000 7f2e3a617700 1 -- 172.21.15.81:0/886372795 >> 172.21.15.81:0/886372795 conn(0x7f2e340cc980 msgr2=0x7f2e340ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.429+0000 7fcdcb7fe700 1 --2- 172.21.15.81:0/1856095706 >> [v2:172.21.15.81:6817/86348,v1:172.21.15.81:6819/86348] conn(0x7fcdac06f1c0 0x7fcdac0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.429+0000 7f2e3a617700 1 -- 172.21.15.81:0/886372795 shutdown_connections 2023-10-07T08:43:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.429+0000 7f5ad259c700 1 --2- 172.21.15.81:0/2868814417 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ab4067000 0x7f5ab40694b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8007fd0 tx=0x7f5ac8007d90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.429+0000 7fcdcb7fe700 1 --2- 172.21.15.81:0/1856095706 >> [v2:172.21.15.81:6817/86348,v1:172.21.15.81:6819/86348] conn(0x7fcdac06f1c0 0x7fcdac0715d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.429+0000 7f2e3a617700 1 -- 172.21.15.81:0/886372795 wait complete. 2023-10-07T08:43:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.430+0000 7f2e3a617700 1 Processor -- start 2023-10-07T08:43:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.430+0000 7fcdc37fe700 1 -- 172.21.15.81:0/1856095706 <== osd.1 v2:172.21.15.81:6817/86348 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fcdac071c80 con 0x7fcdac06f1c0 2023-10-07T08:43:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.430+0000 7f2e3a617700 1 -- start start 2023-10-07T08:43:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.432+0000 7f2e3a617700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e340c8900 0x7f2e340c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.432+0000 7f2e3a617700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e34159ca0 0x7f2e34157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.432+0000 7f2e3a617700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e3415a070 0x7f2e340afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.432+0000 7f2e3a617700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e340b0bd0 con 0x7f2e34159ca0 2023-10-07T08:43:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.432+0000 7f2e3a617700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3415c190 con 0x7f2e3415a070 2023-10-07T08:43:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.432+0000 7f2e3a617700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3415ca10 con 0x7f2e340c8900 2023-10-07T08:43:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.432+0000 7f2e337fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e34159ca0 0x7f2e34157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.432+0000 7f2e33fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e340c8900 0x7f2e340c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.432+0000 7f2e337fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e34159ca0 0x7f2e34157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44948/0 (socket says 172.21.15.81:44948) 2023-10-07T08:43:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.432+0000 7f2e337fe700 1 -- 172.21.15.81:0/180541468 learned_addr learned my addr 172.21.15.81:0/180541468 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.432+0000 7f2e38bb4700 1 --2- 172.21.15.81:0/180541468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e3415a070 0x7f2e340afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.432+0000 7f2e33fff700 1 -- 172.21.15.81:0/180541468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e3415a070 msgr2=0x7f2e340afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.432+0000 7f2e33fff700 1 --2- 172.21.15.81:0/180541468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e3415a070 0x7f2e340afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.432+0000 7f2e33fff700 1 -- 172.21.15.81:0/180541468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e34159ca0 msgr2=0x7f2e34157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.432+0000 7f2e33fff700 1 --2- 172.21.15.81:0/180541468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e34159ca0 0x7f2e34157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.432+0000 7f2e33fff700 1 -- 172.21.15.81:0/180541468 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c009ae0 con 0x7f2e340c8900 2023-10-07T08:43:07.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.433+0000 7f2e33fff700 1 --2- 172.21.15.81:0/180541468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e340c8900 0x7f2e340c5ec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800b600 tx=0x7f2e280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.433+0000 7f2e23fff700 1 -- 172.21.15.81:0/180541468 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2800f510 con 0x7f2e340c8900 2023-10-07T08:43:07.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.433+0000 7f2e23fff700 1 -- 172.21.15.81:0/180541468 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2800f670 con 0x7f2e340c8900 2023-10-07T08:43:07.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.433+0000 7f2e23fff700 1 -- 172.21.15.81:0/180541468 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2800fa30 con 0x7f2e340c8900 2023-10-07T08:43:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.433+0000 7f2e3a617700 1 -- 172.21.15.81:0/180541468 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e340c6400 con 0x7f2e340c8900 2023-10-07T08:43:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.433+0000 7f2e3a617700 1 -- 172.21.15.81:0/180541468 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3415c3c0 con 0x7f2e340c8900 2023-10-07T08:43:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.434+0000 7f2e3a617700 1 -- 172.21.15.81:0/180541468 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2e34067bc0 con 0x7f2e340c8900 2023-10-07T08:43:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.435+0000 7f51ca59c700 1 --2- 172.21.15.81:0/3699535460 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f51ac066f30 0x7f51ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.435+0000 7f2e23fff700 1 -- 172.21.15.81:0/180541468 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e2801a400 con 0x7f2e340c8900 2023-10-07T08:43:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.435+0000 7f51ca59c700 1 --2- 172.21.15.81:0/3699535460 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f51ac066f30 0x7f51ac0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f51cc159680 tx=0x7f51c4009840 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.435+0000 7f2e23fff700 1 --2- 172.21.15.81:0/180541468 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2e18066f80 0x7f2e18069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.436+0000 7f2e23fff700 1 -- 172.21.15.81:0/180541468 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e28083f70 con 0x7f2e340c8900 2023-10-07T08:43:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.436+0000 7f2e23fff700 1 --2- 172.21.15.81:0/180541468 >> [v2:172.21.15.89:6816/86566,v1:172.21.15.89:6817/86566] conn(0x7f2e1806f190 0x7f2e180715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.436+0000 7f2e23fff700 1 -- 172.21.15.81:0/180541468 --> [v2:172.21.15.89:6816/86566,v1:172.21.15.89:6817/86566] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e18071c50 con 0x7f2e1806f190 2023-10-07T08:43:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.436+0000 7f2e23fff700 1 -- 172.21.15.81:0/180541468 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e28086510 con 0x7f2e340c8900 2023-10-07T08:43:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.436+0000 7f2e337fe700 1 --2- 172.21.15.81:0/180541468 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2e18066f80 0x7f2e18069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.436+0000 7f2e337fe700 1 --2- 172.21.15.81:0/180541468 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2e18066f80 0x7f2e18069430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2e3417aab0 tx=0x7f2e24009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.437+0000 7fcdc27fc700 1 --2- 172.21.15.81:0/1856095706 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcdac066fb0 0x7fcdac069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.437+0000 7fcdc27fc700 1 --2- 172.21.15.81:0/1856095706 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcdac066fb0 0x7fcdac069460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc06ab90 tx=0x7fcdb4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.437+0000 7f51cad9d700 1 --2- 172.21.15.81:0/3699535460 >> [v2:172.21.15.81:6816/86353,v1:172.21.15.81:6818/86353] conn(0x7f51cc0ac3d0 0x7f51cc0c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.437+0000 7f51cad9d700 1 --2- 172.21.15.81:0/3699535460 >> [v2:172.21.15.81:6816/86353,v1:172.21.15.81:6818/86353] conn(0x7f51cc0ac3d0 0x7f51cc0c1ce0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.437+0000 7f2e38bb4700 1 --2- 172.21.15.81:0/180541468 >> [v2:172.21.15.89:6816/86566,v1:172.21.15.89:6817/86566] conn(0x7f2e1806f190 0x7f2e180715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.438+0000 7f2e38bb4700 1 --2- 172.21.15.81:0/180541468 >> [v2:172.21.15.89:6816/86566,v1:172.21.15.89:6817/86566] conn(0x7f2e1806f190 0x7f2e180715a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.438+0000 7f2e23fff700 1 -- 172.21.15.81:0/180541468 <== osd.5 v2:172.21.15.89:6816/86566 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f2e18071c50 con 0x7f2e1806f190 2023-10-07T08:43:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.443+0000 7f5edf14a700 1 -- 172.21.15.81:0/1054222153 --> [v2:172.21.15.81:6800/86338,v1:172.21.15.81:6801/86338] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ed8157890 con 0x7f5ebc06f1c0 2023-10-07T08:43:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.444+0000 7f5ed4ff9700 1 -- 172.21.15.81:0/1054222153 <== osd.0 v2:172.21.15.81:6800/86338 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ed8157890 con 0x7f5ebc06f1c0 2023-10-07T08:43:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.445+0000 7f3cd5bf4700 1 -- 172.21.15.81:0/3109561340 --> [v2:172.21.15.81:6808/86339,v1:172.21.15.81:6809/86339] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3cd0157890 con 0x7f3cbc06f140 2023-10-07T08:43:07.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.445+0000 7f5edf14a700 1 -- 172.21.15.81:0/1054222153 >> [v2:172.21.15.81:6800/86338,v1:172.21.15.81:6801/86338] conn(0x7f5ebc06f1c0 msgr2=0x7f5ebc0715d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.445+0000 7f5edf14a700 1 --2- 172.21.15.81:0/1054222153 >> [v2:172.21.15.81:6800/86338,v1:172.21.15.81:6801/86338] conn(0x7f5ebc06f1c0 0x7f5ebc0715d0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.445+0000 7f5edf14a700 1 -- 172.21.15.81:0/1054222153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ebc066fb0 msgr2=0x7f5ebc069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.445+0000 7f5edf14a700 1 --2- 172.21.15.81:0/1054222153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ebc066fb0 0x7f5ebc069460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc006fd0 tx=0x7f5ecc008040 comp rx=0 tx=0).stop 2023-10-07T08:43:07.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.445+0000 7f5edf14a700 1 -- 172.21.15.81:0/1054222153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ed81569e0 msgr2=0x7f5ed814b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.445+0000 7f5edf14a700 1 --2- 172.21.15.81:0/1054222153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ed81569e0 0x7f5ed814b460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40091e0 tx=0x7f5ec4016000 comp rx=0 tx=0).stop 2023-10-07T08:43:07.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.445+0000 7f5edd6e7700 1 -- 172.21.15.81:0/1054222153 reap_dead start 2023-10-07T08:43:07.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.446+0000 7f3cb77fe700 1 -- 172.21.15.81:0/3109561340 <== osd.3 v2:172.21.15.81:6808/86339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3cd0157890 con 0x7f3cbc06f140 2023-10-07T08:43:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.446+0000 7f3cd5bf4700 1 -- 172.21.15.81:0/3109561340 >> [v2:172.21.15.81:6808/86339,v1:172.21.15.81:6809/86339] conn(0x7f3cbc06f140 msgr2=0x7f3cbc071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.446+0000 7f3cd5bf4700 1 --2- 172.21.15.81:0/3109561340 >> [v2:172.21.15.81:6808/86339,v1:172.21.15.81:6809/86339] conn(0x7f3cbc06f140 0x7f3cbc071550 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.448+0000 7f5edf14a700 1 -- 172.21.15.81:0/1054222153 shutdown_connections 2023-10-07T08:43:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.448+0000 7f5edf14a700 1 -- 172.21.15.81:0/1054222153 >> 172.21.15.81:0/1054222153 conn(0x7f5ed806cca0 msgr2=0x7f5ed8155830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.448+0000 7f3cd5bf4700 1 -- 172.21.15.81:0/3109561340 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cbc066fb0 msgr2=0x7f3cbc069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.448+0000 7f3cd5bf4700 1 --2- 172.21.15.81:0/3109561340 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cbc066fb0 0x7f3cbc069460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4006fd0 tx=0x7f3cc4000f90 comp rx=0 tx=0).stop 2023-10-07T08:43:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.448+0000 7f3cd5bf4700 1 -- 172.21.15.81:0/3109561340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd0156db0 msgr2=0x7f3cd00a6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.448+0000 7f3cd5bf4700 1 --2- 172.21.15.81:0/3109561340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd0156db0 0x7f3cd00a6480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8003000 tx=0x7f3cc8017000 comp rx=0 tx=0).stop 2023-10-07T08:43:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.448+0000 7f3ccffff700 1 -- 172.21.15.81:0/3109561340 reap_dead start 2023-10-07T08:43:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.448+0000 7f3cd5bf4700 1 -- 172.21.15.81:0/3109561340 shutdown_connections 2023-10-07T08:43:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.448+0000 7f3cd5bf4700 1 -- 172.21.15.81:0/3109561340 >> 172.21.15.81:0/3109561340 conn(0x7f3cd006cca0 msgr2=0x7f3cd0069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.448+0000 7f3cd5bf4700 1 -- 172.21.15.81:0/3109561340 shutdown_connections 2023-10-07T08:43:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.448+0000 7f3cd5bf4700 1 -- 172.21.15.81:0/3109561340 wait complete. 2023-10-07T08:43:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.448+0000 7fcdd141a700 1 -- 172.21.15.81:0/1856095706 --> [v2:172.21.15.81:6817/86348,v1:172.21.15.81:6819/86348] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcdb0002d30 con 0x7fcdac06f1c0 2023-10-07T08:43:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.448+0000 7fcdc37fe700 1 -- 172.21.15.81:0/1856095706 <== osd.1 v2:172.21.15.81:6817/86348 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcdb0002d30 con 0x7fcdac06f1c0 2023-10-07T08:43:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.449+0000 7fcdd141a700 1 -- 172.21.15.81:0/1856095706 >> [v2:172.21.15.81:6817/86348,v1:172.21.15.81:6819/86348] conn(0x7fcdac06f1c0 msgr2=0x7fcdac0715d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.449+0000 7fcdd141a700 1 --2- 172.21.15.81:0/1856095706 >> [v2:172.21.15.81:6817/86348,v1:172.21.15.81:6819/86348] conn(0x7fcdac06f1c0 0x7fcdac0715d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.449+0000 7fcdd141a700 1 -- 172.21.15.81:0/1856095706 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcdac066fb0 msgr2=0x7fcdac069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.449+0000 7fcdd141a700 1 --2- 172.21.15.81:0/1856095706 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcdac066fb0 0x7fcdac069460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc06ab90 tx=0x7fcdb4016000 comp rx=0 tx=0).stop 2023-10-07T08:43:07.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.449+0000 7fcdd141a700 1 -- 172.21.15.81:0/1856095706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc06d120 msgr2=0x7fcdcc164630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.449+0000 7fcdd141a700 1 --2- 172.21.15.81:0/1856095706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc06d120 0x7fcdcc164630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00b630 tx=0x7fcdbc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.449+0000 7fcdcb7fe700 1 -- 172.21.15.81:0/1856095706 reap_dead start 2023-10-07T08:43:07.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.449+0000 7fcdd141a700 1 -- 172.21.15.81:0/1856095706 shutdown_connections 2023-10-07T08:43:07.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.449+0000 7fcdd141a700 1 -- 172.21.15.81:0/1856095706 >> 172.21.15.81:0/1856095706 conn(0x7fcdcc06bb90 msgr2=0x7fcdcc0b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.449+0000 7fcdd141a700 1 -- 172.21.15.81:0/1856095706 shutdown_connections 2023-10-07T08:43:07.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.449+0000 7fcdd141a700 1 -- 172.21.15.81:0/1856095706 wait complete. 2023-10-07T08:43:07.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.450+0000 7f51ba7fc700 1 -- 172.21.15.81:0/3699535460 <== osd.2 v2:172.21.15.81:6816/86353 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f51cc151e80 con 0x7f51cc0ac3d0 2023-10-07T08:43:07.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.450+0000 7f5edf14a700 1 -- 172.21.15.81:0/1054222153 shutdown_connections 2023-10-07T08:43:07.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.450+0000 7f5edf14a700 1 -- 172.21.15.81:0/1054222153 wait complete. 2023-10-07T08:43:07.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.460+0000 7f5ad89ba700 1 -- 172.21.15.81:0/2868814417 --> [v2:172.21.15.89:6800/86542,v1:172.21.15.89:6801/86542] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ab8002d30 con 0x7f5ab406f210 2023-10-07T08:43:07.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.460+0000 7f5ac27fc700 1 -- 172.21.15.81:0/2868814417 <== osd.4 v2:172.21.15.89:6800/86542 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ab8002d30 con 0x7f5ab406f210 2023-10-07T08:43:07.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.460+0000 7f2e3a617700 1 -- 172.21.15.81:0/180541468 --> [v2:172.21.15.89:6816/86566,v1:172.21.15.89:6817/86566] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2e34069ca0 con 0x7f2e1806f190 2023-10-07T08:43:07.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.460+0000 7f2e23fff700 1 -- 172.21.15.81:0/180541468 <== osd.5 v2:172.21.15.89:6816/86566 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2e34069ca0 con 0x7f2e1806f190 2023-10-07T08:43:07.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.454+0000 7ff40ac91700 1 -- 172.21.15.81:0/3906892382 --> [v2:172.21.15.89:6822/86582,v1:172.21.15.89:6824/86582] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff3e0002d30 con 0x7ff3e806f1e0 2023-10-07T08:43:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.454+0000 7ff400ff9700 1 -- 172.21.15.81:0/3906892382 <== osd.6 v2:172.21.15.89:6822/86582 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff3e0002d30 con 0x7ff3e806f1e0 2023-10-07T08:43:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.460+0000 7ff40ac91700 1 -- 172.21.15.81:0/3906892382 >> [v2:172.21.15.89:6822/86582,v1:172.21.15.89:6824/86582] conn(0x7ff3e806f1e0 msgr2=0x7ff3e80715f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.460+0000 7ff40ac91700 1 --2- 172.21.15.81:0/3906892382 >> [v2:172.21.15.89:6822/86582,v1:172.21.15.89:6824/86582] conn(0x7ff3e806f1e0 0x7ff3e80715f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.460+0000 7ff40ac91700 1 -- 172.21.15.81:0/3906892382 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3e8066fd0 msgr2=0x7ff3e8069480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.460+0000 7ff40ac91700 1 --2- 172.21.15.81:0/3906892382 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3e8066fd0 0x7ff3e8069480 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00acf0 tx=0x7ff3fc009370 comp rx=0 tx=0).stop 2023-10-07T08:43:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.460+0000 7ff40ac91700 1 -- 172.21.15.81:0/3906892382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff404155c60 msgr2=0x7ff4040c3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.460+0000 7ff40ac91700 1 --2- 172.21.15.81:0/3906892382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff404155c60 0x7ff4040c3a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4016000 tx=0x7ff3f4017000 comp rx=0 tx=0).stop 2023-10-07T08:43:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.460+0000 7ff40922e700 1 -- 172.21.15.81:0/3906892382 reap_dead start 2023-10-07T08:43:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.461+0000 7ff40ac91700 1 -- 172.21.15.81:0/3906892382 shutdown_connections 2023-10-07T08:43:07.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.461+0000 7ff40ac91700 1 -- 172.21.15.81:0/3906892382 >> 172.21.15.81:0/3906892382 conn(0x7ff4040cc980 msgr2=0x7ff40414e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.461+0000 7ff40ac91700 1 -- 172.21.15.81:0/3906892382 shutdown_connections 2023-10-07T08:43:07.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.461+0000 7ff40ac91700 1 -- 172.21.15.81:0/3906892382 wait complete. 2023-10-07T08:43:07.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.452+0000 7f865bc42700 1 -- 172.21.15.81:0/976742114 --> [v2:172.21.15.89:6808/86544,v1:172.21.15.89:6809/86544] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f865415a180 con 0x7f863806f210 2023-10-07T08:43:07.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.454+0000 7f8649ffb700 1 -- 172.21.15.81:0/976742114 <== osd.7 v2:172.21.15.89:6808/86544 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f865415a180 con 0x7f863806f210 2023-10-07T08:43:07.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.454+0000 7f865bc42700 1 -- 172.21.15.81:0/976742114 >> [v2:172.21.15.89:6808/86544,v1:172.21.15.89:6809/86544] conn(0x7f863806f210 msgr2=0x7f8638071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.454+0000 7f865bc42700 1 --2- 172.21.15.81:0/976742114 >> [v2:172.21.15.89:6808/86544,v1:172.21.15.89:6809/86544] conn(0x7f863806f210 0x7f8638071620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.455+0000 7f865bc42700 1 -- 172.21.15.81:0/976742114 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8638067000 msgr2=0x7f86380694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.455+0000 7f865bc42700 1 --2- 172.21.15.81:0/976742114 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8638067000 0x7f86380694b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8650007fd0 tx=0x7f8650007d10 comp rx=0 tx=0).stop 2023-10-07T08:43:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.455+0000 7f865bc42700 1 -- 172.21.15.81:0/976742114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8654157ca0 msgr2=0x7f865415b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.455+0000 7f865bc42700 1 --2- 172.21.15.81:0/976742114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8654157ca0 0x7f865415b680 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f864c013000 tx=0x7f864c019000 comp rx=0 tx=0).stop 2023-10-07T08:43:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.455+0000 7f865a1df700 1 -- 172.21.15.81:0/976742114 reap_dead start 2023-10-07T08:43:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.455+0000 7f865bc42700 1 -- 172.21.15.81:0/976742114 shutdown_connections 2023-10-07T08:43:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.455+0000 7f865bc42700 1 -- 172.21.15.81:0/976742114 >> 172.21.15.81:0/976742114 conn(0x7f865406bb90 msgr2=0x7f865406d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.460+0000 7f865bc42700 1 -- 172.21.15.81:0/976742114 shutdown_connections 2023-10-07T08:43:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.460+0000 7f865bc42700 1 -- 172.21.15.81:0/976742114 wait complete. 2023-10-07T08:43:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.462+0000 7f2e3a617700 1 -- 172.21.15.81:0/180541468 >> [v2:172.21.15.89:6816/86566,v1:172.21.15.89:6817/86566] conn(0x7f2e1806f190 msgr2=0x7f2e180715a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.462+0000 7f2e3a617700 1 --2- 172.21.15.81:0/180541468 >> [v2:172.21.15.89:6816/86566,v1:172.21.15.89:6817/86566] conn(0x7f2e1806f190 0x7f2e180715a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.462+0000 7f5ad89ba700 1 -- 172.21.15.81:0/2868814417 >> [v2:172.21.15.89:6800/86542,v1:172.21.15.89:6801/86542] conn(0x7f5ab406f210 msgr2=0x7f5ab4071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.462+0000 7f5ad89ba700 1 --2- 172.21.15.81:0/2868814417 >> [v2:172.21.15.89:6800/86542,v1:172.21.15.89:6801/86542] conn(0x7f5ab406f210 0x7f5ab4071620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.462+0000 7f2e3a617700 1 -- 172.21.15.81:0/180541468 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2e18066f80 msgr2=0x7f2e18069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.462+0000 7f2e3a617700 1 --2- 172.21.15.81:0/180541468 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2e18066f80 0x7f2e18069430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2e3417aab0 tx=0x7f2e24009120 comp rx=0 tx=0).stop 2023-10-07T08:43:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.462+0000 7f2e3a617700 1 -- 172.21.15.81:0/180541468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e340c8900 msgr2=0x7f2e340c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.462+0000 7f2e3a617700 1 --2- 172.21.15.81:0/180541468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e340c8900 0x7f2e340c5ec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800b600 tx=0x7f2e280091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.462+0000 7f2e38bb4700 1 -- 172.21.15.81:0/180541468 reap_dead start 2023-10-07T08:43:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.463+0000 7f5ad89ba700 1 -- 172.21.15.81:0/2868814417 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ab4067000 msgr2=0x7f5ab40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.463+0000 7f5ad89ba700 1 --2- 172.21.15.81:0/2868814417 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ab4067000 0x7f5ab40694b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8007fd0 tx=0x7f5ac8007d90 comp rx=0 tx=0).stop 2023-10-07T08:43:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.463+0000 7f5ad89ba700 1 -- 172.21.15.81:0/2868814417 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad40cac60 msgr2=0x7f5ad40b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.463+0000 7f5ad89ba700 1 --2- 172.21.15.81:0/2868814417 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad40cac60 0x7f5ad40b1c20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400e900 tx=0x7f5ac40091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.512 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-07T08:43:07.513 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-07T08:43:07.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.468+0000 7f5ad2d9d700 1 -- 172.21.15.81:0/2868814417 reap_dead start 2023-10-07T08:43:07.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.468+0000 7f5ad89ba700 1 -- 172.21.15.81:0/2868814417 shutdown_connections 2023-10-07T08:43:07.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.468+0000 7f5ad89ba700 1 -- 172.21.15.81:0/2868814417 >> 172.21.15.81:0/2868814417 conn(0x7f5ad40cc980 msgr2=0x7f5ad406ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.469+0000 7f5ad89ba700 1 -- 172.21.15.81:0/2868814417 shutdown_connections 2023-10-07T08:43:07.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.469+0000 7f5ad89ba700 1 -- 172.21.15.81:0/2868814417 wait complete. 2023-10-07T08:43:07.515 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-07T08:43:07.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-07T08:43:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.471+0000 7f2e3a617700 1 -- 172.21.15.81:0/180541468 shutdown_connections 2023-10-07T08:43:07.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.471+0000 7f2e3a617700 1 -- 172.21.15.81:0/180541468 >> 172.21.15.81:0/180541468 conn(0x7f2e340cc980 msgr2=0x7f2e340c7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.516 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-07T08:43:07.516 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-07T08:43:07.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.472+0000 7f2e3a617700 1 -- 172.21.15.81:0/180541468 shutdown_connections 2023-10-07T08:43:07.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.472+0000 7f2e3a617700 1 -- 172.21.15.81:0/180541468 wait complete. 2023-10-07T08:43:07.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.474+0000 7f51d0f19700 1 -- 172.21.15.81:0/3699535460 --> [v2:172.21.15.81:6816/86353,v1:172.21.15.81:6818/86353] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f51cc067bc0 con 0x7f51cc0ac3d0 2023-10-07T08:43:07.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.474+0000 7f51ba7fc700 1 -- 172.21.15.81:0/3699535460 <== osd.2 v2:172.21.15.81:6816/86353 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f51cc067bc0 con 0x7f51cc0ac3d0 2023-10-07T08:43:07.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.475+0000 7f51d0f19700 1 -- 172.21.15.81:0/3699535460 >> [v2:172.21.15.81:6816/86353,v1:172.21.15.81:6818/86353] conn(0x7f51cc0ac3d0 msgr2=0x7f51cc0c1ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.475+0000 7f51d0f19700 1 --2- 172.21.15.81:0/3699535460 >> [v2:172.21.15.81:6816/86353,v1:172.21.15.81:6818/86353] conn(0x7f51cc0ac3d0 0x7f51cc0c1ce0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.475+0000 7f51d0f19700 1 -- 172.21.15.81:0/3699535460 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f51ac066f30 msgr2=0x7f51ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.475+0000 7f51d0f19700 1 --2- 172.21.15.81:0/3699535460 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f51ac066f30 0x7f51ac0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f51cc159680 tx=0x7f51c4009840 comp rx=0 tx=0).stop 2023-10-07T08:43:07.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.475+0000 7f51d0f19700 1 -- 172.21.15.81:0/3699535460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51cc0c75e0 msgr2=0x7f51cc0b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.475+0000 7f51d0f19700 1 --2- 172.21.15.81:0/3699535460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51cc0c75e0 0x7f51cc0b0f90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f51cc064670 tx=0x7f51bc017000 comp rx=0 tx=0).stop 2023-10-07T08:43:07.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.475+0000 7f51cad9d700 1 -- 172.21.15.81:0/3699535460 reap_dead start 2023-10-07T08:43:07.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.476+0000 7f51d0f19700 1 -- 172.21.15.81:0/3699535460 shutdown_connections 2023-10-07T08:43:07.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.476+0000 7f51d0f19700 1 -- 172.21.15.81:0/3699535460 >> 172.21.15.81:0/3699535460 conn(0x7f51cc06c660 msgr2=0x7f51cc1504c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.479+0000 7f51d0f19700 1 -- 172.21.15.81:0/3699535460 shutdown_connections 2023-10-07T08:43:07.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.479+0000 7f51d0f19700 1 -- 172.21.15.81:0/3699535460 wait complete. 2023-10-07T08:43:07.520 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-07T08:43:07.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-07T08:43:07.521 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-07T08:43:07.521 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-07T08:43:07.522 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-07T08:43:07.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-07T08:43:07.523 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-07T08:43:07.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-07T08:43:07.524 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-07T08:43:07.525 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-07T08:43:07.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.749+0000 7ff290309700 1 Processor -- start 2023-10-07T08:43:07.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.749+0000 7ff290309700 1 -- start start 2023-10-07T08:43:07.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.750+0000 7ff290309700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff288155c60 0x7ff288156030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.750+0000 7ff290309700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2880cb840 0x7ff2880c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.750+0000 7ff290309700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2880cbc90 0x7ff2880c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.750+0000 7ff290309700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2880ca550 con 0x7ff2880cbc90 2023-10-07T08:43:07.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.750+0000 7ff290309700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2880cb3b0 con 0x7ff288155c60 2023-10-07T08:43:07.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.750+0000 7ff290309700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2880ca7a0 con 0x7ff2880cb840 2023-10-07T08:43:07.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.751+0000 7ff28d8a4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2880cb840 0x7ff2880c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.751+0000 7ff28d8a4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2880cb840 0x7ff2880c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:49070/0 (socket says 172.21.15.81:49070) 2023-10-07T08:43:07.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.751+0000 7ff28d8a4700 1 -- 172.21.15.81:0/1312519954 learned_addr learned my addr 172.21.15.81:0/1312519954 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.751+0000 7ff28e0a5700 1 --2- 172.21.15.81:0/1312519954 >> v2:172.21.15.89:3300/0 conn(0x7ff288155c60 0x7ff288156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.751+0000 7ff28e0a5700 1 -- 172.21.15.81:0/1312519954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2880cb840 msgr2=0x7ff2880c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.751+0000 7ff28e0a5700 1 --2- 172.21.15.81:0/1312519954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2880cb840 0x7ff2880c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.751+0000 7ff28e0a5700 1 -- 172.21.15.81:0/1312519954 >> v2:172.21.15.81:3300/0 conn(0x7ff2880cbc90 msgr2=0x7ff2880c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.751+0000 7ff28e0a5700 1 --2- 172.21.15.81:0/1312519954 >> v2:172.21.15.81:3300/0 conn(0x7ff2880cbc90 0x7ff2880c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.751+0000 7ff28e0a5700 1 -- 172.21.15.81:0/1312519954 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2880caa80 con 0x7ff288155c60 2023-10-07T08:43:07.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.752+0000 7ff28e0a5700 1 --2- 172.21.15.81:0/1312519954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff288155c60 0x7ff288156030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff288068930 tx=0x7ff2780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bc06d10bd710119 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.752+0000 7ff28d0a3700 1 -- 172.21.15.81:0/1312519954 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780108a0 con 0x7ff288155c60 2023-10-07T08:43:07.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.752+0000 7ff28d0a3700 1 -- 172.21.15.81:0/1312519954 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff278010a20 con 0x7ff288155c60 2023-10-07T08:43:07.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.752+0000 7ff28d0a3700 1 -- 172.21.15.81:0/1312519954 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278010de0 con 0x7ff288155c60 2023-10-07T08:43:07.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.752+0000 7ff28d8a4700 1 --2- 172.21.15.81:0/1312519954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2880cb840 0x7ff2880c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:07.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.753+0000 7ff290309700 1 -- 172.21.15.81:0/1312519954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff288155c60 msgr2=0x7ff288156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.753+0000 7ff290309700 1 --2- 172.21.15.81:0/1312519954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff288155c60 0x7ff288156030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff288068930 tx=0x7ff2780091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.753+0000 7fc96cb22700 1 Processor -- start 2023-10-07T08:43:07.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.753+0000 7fc96cb22700 1 -- start start 2023-10-07T08:43:07.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.752+0000 7f7275da6700 1 Processor -- start 2023-10-07T08:43:07.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.752+0000 7f7275da6700 1 -- start start 2023-10-07T08:43:07.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.754+0000 7f7275da6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72700acf60 0x7f727015f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.754+0000 7f7275da6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72700cdc90 0x7f72700ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.754+0000 7f7275da6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72701625c0 con 0x7f72700b0a00 2023-10-07T08:43:07.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.754+0000 7f7275da6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72700ad330 con 0x7f72700acf60 2023-10-07T08:43:07.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.754+0000 7f7275da6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7270162dc0 con 0x7f72700cdc90 2023-10-07T08:43:07.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.754+0000 7f726f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72700acf60 0x7f727015f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.754+0000 7f726f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72700acf60 0x7f727015f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44974/0 (socket says 172.21.15.81:44974) 2023-10-07T08:43:07.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.754+0000 7f726f7fe700 1 -- 172.21.15.81:0/398427782 learned_addr learned my addr 172.21.15.81:0/398427782 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.754+0000 7f726ffff700 1 --2- 172.21.15.81:0/398427782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72700cdc90 0x7f72700ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.754+0000 7f726ffff700 1 -- 172.21.15.81:0/398427782 >> v2:172.21.15.81:3300/0 conn(0x7f72700acf60 msgr2=0x7f727015f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.754+0000 7f726ffff700 1 --2- 172.21.15.81:0/398427782 >> v2:172.21.15.81:3300/0 conn(0x7f72700acf60 0x7f727015f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.754+0000 7f726ffff700 1 -- 172.21.15.81:0/398427782 >> v1:172.21.15.81:6789/0 conn(0x7f72700b0a00 legacy=0x7f7270161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.754+0000 7f726ffff700 1 -- 172.21.15.81:0/398427782 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72700ce600 con 0x7f72700cdc90 2023-10-07T08:43:07.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7fef56d32700 1 Processor -- start 2023-10-07T08:43:07.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7fef56d32700 1 -- start start 2023-10-07T08:43:07.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7f726ffff700 1 --2- 172.21.15.81:0/398427782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72700cdc90 0x7f72700ce0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f72600098e0 tx=0x7f72600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2793f3a6a6734d86 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.753+0000 7ff290309700 1 -- 172.21.15.81:0/1312519954 shutdown_connections 2023-10-07T08:43:07.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.753+0000 7ff290309700 1 --2- 172.21.15.81:0/1312519954 >> v2:172.21.15.81:3300/0 conn(0x7ff2880cbc90 0x7ff2880c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.753+0000 7ff290309700 1 --2- 172.21.15.81:0/1312519954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff288155c60 0x7ff288156030 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.753+0000 7ff290309700 1 --2- 172.21.15.81:0/1312519954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2880cb840 0x7ff2880c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.753+0000 7ff290309700 1 -- 172.21.15.81:0/1312519954 >> 172.21.15.81:0/1312519954 conn(0x7ff2880cc980 msgr2=0x7ff2880ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.754+0000 7ff290309700 1 -- 172.21.15.81:0/1312519954 shutdown_connections 2023-10-07T08:43:07.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.754+0000 7ff290309700 1 -- 172.21.15.81:0/1312519954 wait complete. 2023-10-07T08:43:07.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7f1ec5458700 1 Processor -- start 2023-10-07T08:43:07.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7fc96cb22700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9681578d0 0x7fc9680cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7fc96cb22700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9680d07c0 con 0x7fc96806d120 2023-10-07T08:43:07.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7fc96cb22700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9680cfbb0 con 0x7fc968157ca0 2023-10-07T08:43:07.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7fc96cb22700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9680cfe90 con 0x7fc9681578d0 2023-10-07T08:43:07.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7fc96659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9681578d0 0x7fc9680cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7fc965d9b700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc968157ca0 0x7fc96815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:55714/0 (socket says 172.21.15.81:55714) 2023-10-07T08:43:07.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7fc965d9b700 1 -- 172.21.15.81:0/2251548242 learned_addr learned my addr 172.21.15.81:0/2251548242 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:07.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7fc96659c700 1 --2- 172.21.15.81:0/2251548242 >> v2:172.21.15.81:3300/0 conn(0x7fc9681578d0 0x7fc9680cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44982/0 (socket says 172.21.15.81:44982) 2023-10-07T08:43:07.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7f726e7fc700 1 -- 172.21.15.81:0/398427782 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726000b640 con 0x7f72700cdc90 2023-10-07T08:43:07.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7f726e7fc700 1 -- 172.21.15.81:0/398427782 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726000b7a0 con 0x7f72700cdc90 2023-10-07T08:43:07.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7f726e7fc700 1 -- 172.21.15.81:0/398427782 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726000bb40 con 0x7f72700cdc90 2023-10-07T08:43:07.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7ff290309700 1 Processor -- start 2023-10-07T08:43:07.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7fc96659c700 1 -- 172.21.15.81:0/2251548242 >> v1:172.21.15.89:6789/0 conn(0x7fc968157ca0 legacy=0x7fc96815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7fc96659c700 1 -- 172.21.15.81:0/2251548242 >> v1:172.21.15.81:6789/0 conn(0x7fc96806d120 legacy=0x7fc96806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7fc96659c700 1 -- 172.21.15.81:0/2251548242 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9680d0170 con 0x7fc9681578d0 2023-10-07T08:43:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7fc96659c700 1 --2- 172.21.15.81:0/2251548242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9681578d0 0x7fc9680cf4f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc9580098e0 tx=0x7fc9580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8430ce56afb43ba4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7fc96559a700 1 -- 172.21.15.81:0/2251548242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958009e80 con 0x7fc9681578d0 2023-10-07T08:43:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7fc96559a700 1 -- 172.21.15.81:0/2251548242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95800b860 con 0x7fc9681578d0 2023-10-07T08:43:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7fc96559a700 1 -- 172.21.15.81:0/2251548242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800bc00 con 0x7fc9681578d0 2023-10-07T08:43:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7f7275da6700 1 -- 172.21.15.81:0/398427782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72700cdc90 msgr2=0x7f72700ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7f7275da6700 1 --2- 172.21.15.81:0/398427782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72700cdc90 0x7f72700ce0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f72600098e0 tx=0x7f72600091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7fef56d32700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5006d220 0x7fef5006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7fef56d32700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fef50069670 0x7fef50069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7fef56d32700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5006dbd0 con 0x7fef501414f0 2023-10-07T08:43:07.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7fef56d32700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef500691e0 con 0x7fef50069670 2023-10-07T08:43:07.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7fef56d32700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef500cba20 con 0x7fef5006d220 2023-10-07T08:43:07.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7fef54ace700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fef501414f0 0x7fef500caf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59404/0 (socket says 172.21.15.81:59404) 2023-10-07T08:43:07.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7fef4ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5006d220 0x7fef5006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7fef54ace700 1 -- 172.21.15.81:0/2506065842 learned_addr learned my addr 172.21.15.81:0/2506065842 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f7275da6700 1 -- 172.21.15.81:0/398427782 shutdown_connections 2023-10-07T08:43:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f7275da6700 1 --2- 172.21.15.81:0/398427782 >> v2:172.21.15.81:3300/0 conn(0x7f72700acf60 0x7f727015f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f7275da6700 1 --2- 172.21.15.81:0/398427782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72700cdc90 0x7f72700ce0c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f7275da6700 1 -- 172.21.15.81:0/398427782 >> 172.21.15.81:0/398427782 conn(0x7f727006cca0 msgr2=0x7f727006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7ff290309700 1 -- start start 2023-10-07T08:43:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7ff290309700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2880cb840 0x7ff2880c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7ff290309700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2880cbc90 0x7ff2880c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7ff290309700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff288155c60 0x7ff2880c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7ff290309700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2880b2180 con 0x7ff2880cb840 2023-10-07T08:43:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7ff290309700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28816e7f0 con 0x7ff288155c60 2023-10-07T08:43:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7ff290309700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2880b18e0 con 0x7ff2880cbc90 2023-10-07T08:43:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7ff28e0a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2880cb840 0x7ff2880c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7ff28e0a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2880cb840 0x7ff2880c6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44996/0 (socket says 172.21.15.81:44996) 2023-10-07T08:43:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7ff28e0a5700 1 -- 172.21.15.81:0/2568279339 learned_addr learned my addr 172.21.15.81:0/2568279339 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7ff28d8a4700 1 --2- 172.21.15.81:0/2568279339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2880cbc90 0x7ff2880c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7ff28e8a6700 1 --2- 172.21.15.81:0/2568279339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff288155c60 0x7ff2880c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7ff28e8a6700 1 -- 172.21.15.81:0/2568279339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2880cbc90 msgr2=0x7ff2880c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7ff28e8a6700 1 --2- 172.21.15.81:0/2568279339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2880cbc90 0x7ff2880c3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7ff28e8a6700 1 -- 172.21.15.81:0/2568279339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2880cb840 msgr2=0x7ff2880c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7ff28e8a6700 1 --2- 172.21.15.81:0/2568279339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2880cb840 0x7ff2880c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7ff28e8a6700 1 -- 172.21.15.81:0/2568279339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28000be70 con 0x7ff288155c60 2023-10-07T08:43:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7ff28d8a4700 1 --2- 172.21.15.81:0/2568279339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2880cbc90 0x7ff2880c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7f12b3dbc700 1 Processor -- start 2023-10-07T08:43:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7f12b3dbc700 1 -- start start 2023-10-07T08:43:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f12b3dbc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f12ac0691b0 0x7f12ac0c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f12b3dbc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ac0c7140 con 0x7f12ac0c8720 2023-10-07T08:43:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f12b3dbc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ac0c7420 con 0x7f12ac068de0 2023-10-07T08:43:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f12b3dbc700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ac0c7700 con 0x7f12ac0691b0 2023-10-07T08:43:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f12b1b58700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f12ac068de0 0x7f12ac0cb5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:55718/0 (socket says 172.21.15.81:55718) 2023-10-07T08:43:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f12b1b58700 1 -- 172.21.15.81:0/359795414 learned_addr learned my addr 172.21.15.81:0/359795414 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.755+0000 7f1ec5458700 1 -- start start 2023-10-07T08:43:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7f1ec5458700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1ec015dff0 0x7f1ec00d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7f1ec5458700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ec006d870 0x7f1ec00b80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7f1ec5458700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec00d49e0 con 0x7f1ec00d38f0 2023-10-07T08:43:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7f1ec5458700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec00d3dd0 con 0x7f1ec015dff0 2023-10-07T08:43:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7f1ec5458700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00d40b0 con 0x7f1ec006d870 2023-10-07T08:43:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7f1ebeffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1ec015dff0 0x7f1ec00d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7f1ebeffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1ec015dff0 0x7f1ec00d1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:39034/0 (socket says 172.21.15.81:39034) 2023-10-07T08:43:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7f1ebeffd700 1 -- 172.21.15.81:0/2388166932 learned_addr learned my addr 172.21.15.81:0/2388166932 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f1ebf7fe700 1 --2- 172.21.15.81:0/2388166932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ec006d870 0x7f1ec00b80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f1ebeffd700 1 -- 172.21.15.81:0/2388166932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ec006d870 msgr2=0x7f1ec00b80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f1ebeffd700 1 --2- 172.21.15.81:0/2388166932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ec006d870 0x7f1ec00b80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f1ebeffd700 1 -- 172.21.15.81:0/2388166932 >> v1:172.21.15.81:6789/0 conn(0x7f1ec00d38f0 legacy=0x7f1ec006d160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T08:43:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f1ebeffd700 1 -- 172.21.15.81:0/2388166932 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec00d4390 con 0x7f1ec015dff0 2023-10-07T08:43:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f1ebeffd700 1 --2- 172.21.15.81:0/2388166932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ec015dff0 0x7f1ec00d1cd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40099b0 tx=0x7f1eb4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99fd339714999825 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f1ebdffb700 1 -- 172.21.15.81:0/2388166932 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb400b820 con 0x7f1ec015dff0 2023-10-07T08:43:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f1ebdffb700 1 -- 172.21.15.81:0/2388166932 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb400b980 con 0x7f1ec015dff0 2023-10-07T08:43:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f1ebdffb700 1 -- 172.21.15.81:0/2388166932 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb400bd20 con 0x7f1ec015dff0 2023-10-07T08:43:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7f80e9706700 1 Processor -- start 2023-10-07T08:43:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7f80e9706700 1 -- start start 2023-10-07T08:43:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7fc96cb22700 1 -- 172.21.15.81:0/2251548242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9681578d0 msgr2=0x7fc9680cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7fc96cb22700 1 --2- 172.21.15.81:0/2251548242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9681578d0 0x7fc9680cf4f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc9580098e0 tx=0x7fc9580091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7fc96cb22700 1 -- 172.21.15.81:0/2251548242 shutdown_connections 2023-10-07T08:43:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7fc96cb22700 1 --2- 172.21.15.81:0/2251548242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9681578d0 0x7fc9680cf4f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7fc96cb22700 1 -- 172.21.15.81:0/2251548242 >> 172.21.15.81:0/2251548242 conn(0x7fc96806bb90 msgr2=0x7fc96806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f12b0b56700 1 -- 172.21.15.81:0/359795414 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2531152 0 0) 0x7f12ac0c7420 con 0x7f12ac068de0 2023-10-07T08:43:07.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7f12b0b56700 1 -- 172.21.15.81:0/359795414 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1298003570 con 0x7f12ac068de0 2023-10-07T08:43:07.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7fc96cb22700 1 -- 172.21.15.81:0/2251548242 shutdown_connections 2023-10-07T08:43:07.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7fc96cb22700 1 -- 172.21.15.81:0/2251548242 wait complete. 2023-10-07T08:43:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.756+0000 7fef552cf700 1 --2- 172.21.15.81:0/2506065842 >> v2:172.21.15.89:3300/0 conn(0x7fef50069670 0x7fef50069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7fef4ffff700 1 -- 172.21.15.81:0/2506065842 >> v2:172.21.15.89:3300/0 conn(0x7fef50069670 msgr2=0x7fef50069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7fef4f7fe700 1 -- 172.21.15.81:0/2506065842 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257872398 0 0) 0x7fef5006dbd0 con 0x7fef501414f0 2023-10-07T08:43:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.757+0000 7ff28e8a6700 1 --2- 172.21.15.81:0/2568279339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff288155c60 0x7ff2880c3f70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff288069040 tx=0x7ff284009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7fef4ffff700 1 --2- 172.21.15.81:0/2506065842 >> v2:172.21.15.89:3300/0 conn(0x7fef50069670 0x7fef50069ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7fef4ffff700 1 -- 172.21.15.81:0/2506065842 >> v1:172.21.15.81:6789/0 conn(0x7fef501414f0 legacy=0x7fef500caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b0b56700 1 -- 172.21.15.81:0/359795414 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288569658 0 0) 0x7f12ac0c7140 con 0x7f12ac0c8720 2023-10-07T08:43:07.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b0b56700 1 -- 172.21.15.81:0/359795414 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12ac0c7420 con 0x7f12ac0c8720 2023-10-07T08:43:07.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7fef4ffff700 1 -- 172.21.15.81:0/2506065842 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef500cbd00 con 0x7fef5006d220 2023-10-07T08:43:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7ff27e7fc700 1 -- 172.21.15.81:0/2568279339 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28400f510 con 0x7ff288155c60 2023-10-07T08:43:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7ff27e7fc700 1 -- 172.21.15.81:0/2568279339 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28400f690 con 0x7ff288155c60 2023-10-07T08:43:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7ff27e7fc700 1 -- 172.21.15.81:0/2568279339 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28400fa50 con 0x7ff288155c60 2023-10-07T08:43:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7ff290309700 1 -- 172.21.15.81:0/2568279339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff278009420 con 0x7ff288155c60 2023-10-07T08:43:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7ff290309700 1 -- 172.21.15.81:0/2568279339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2880b1ea0 con 0x7ff288155c60 2023-10-07T08:43:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f80e9706700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f80e41578d0 0x7f80e40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f80e9706700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f80e406d120 0x7f80e406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f80e9706700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e40d07c0 con 0x7f80e4157ca0 2023-10-07T08:43:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f80e9706700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e406da50 con 0x7f80e41578d0 2023-10-07T08:43:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f80e9706700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e40cfbb0 con 0x7f80e406d120 2023-10-07T08:43:07.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7fef4ffff700 1 --2- 172.21.15.81:0/2506065842 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5006d220 0x7fef5006d690 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0098e0 tx=0x7fef3c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29ca39968fed572b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f1ec5458700 1 -- 172.21.15.81:0/2388166932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ec015dff0 msgr2=0x7f1ec00d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f1ec5458700 1 --2- 172.21.15.81:0/2388166932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ec015dff0 0x7f1ec00d1cd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40099b0 tx=0x7f1eb4009250 comp rx=0 tx=0).stop 2023-10-07T08:43:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f1ec5458700 1 -- 172.21.15.81:0/2388166932 shutdown_connections 2023-10-07T08:43:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f1ec5458700 1 --2- 172.21.15.81:0/2388166932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ec015dff0 0x7f1ec00d1cd0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40099b0 tx=0x7f1eb4009250 comp rx=0 tx=0).stop 2023-10-07T08:43:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f1ec5458700 1 --2- 172.21.15.81:0/2388166932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ec006d870 0x7f1ec00b80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f1ec5458700 1 -- 172.21.15.81:0/2388166932 >> 172.21.15.81:0/2388166932 conn(0x7f1ec006bb90 msgr2=0x7f1ec006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7fef4f7fe700 1 -- 172.21.15.81:0/2506065842 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c009e80 con 0x7fef5006d220 2023-10-07T08:43:07.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7fef4f7fe700 1 -- 172.21.15.81:0/2506065842 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3c00b860 con 0x7fef5006d220 2023-10-07T08:43:07.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7fef4f7fe700 1 -- 172.21.15.81:0/2506065842 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c00bc20 con 0x7fef5006d220 2023-10-07T08:43:07.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7fef552cf700 1 --2- 172.21.15.81:0/2506065842 >> v2:172.21.15.89:3300/0 conn(0x7fef50069670 0x7fef50069ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:07.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f80e37fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f80e406d120 0x7f80e406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f80e37fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f80e406d120 0x7f80e406d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:39072/0 (socket says 172.21.15.81:39072) 2023-10-07T08:43:07.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f80e37fe700 1 -- 172.21.15.81:0/1549628057 learned_addr learned my addr 172.21.15.81:0/1549628057 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b0b56700 1 -- 172.21.15.81:0/359795414 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1858267231 0 0) 0x7f12ac0c7420 con 0x7f12ac0c8720 2023-10-07T08:43:07.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b1357700 1 --2- 172.21.15.81:0/359795414 >> v2:172.21.15.89:3300/0 conn(0x7f12ac0691b0 0x7f12ac0c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b0b56700 1 -- 172.21.15.81:0/359795414 >> v2:172.21.15.89:3300/0 conn(0x7f12ac0691b0 msgr2=0x7f12ac0c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b0b56700 1 --2- 172.21.15.81:0/359795414 >> v2:172.21.15.89:3300/0 conn(0x7f12ac0691b0 0x7f12ac0c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b0b56700 1 -- 172.21.15.81:0/359795414 >> v1:172.21.15.89:6789/0 conn(0x7f12ac068de0 legacy=0x7f12ac0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b0b56700 1 -- 172.21.15.81:0/359795414 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac0c79e0 con 0x7f12ac0c8720 2023-10-07T08:43:07.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b0b56700 1 -- 172.21.15.81:0/359795414 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f12a40017f0 con 0x7f12ac0c8720 2023-10-07T08:43:07.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b0b56700 1 -- 172.21.15.81:0/359795414 >> v1:172.21.15.81:6789/0 conn(0x7f12ac0c8720 legacy=0x7f12ac06d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b0b56700 1 --2- 172.21.15.81:0/359795414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1298003c20 0x7f1298003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b0b56700 1 --2- 172.21.15.81:0/359795414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1298004810 0x7f1298004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b0b56700 1 --2- 172.21.15.81:0/359795414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12980052e0 0x7f129800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b0b56700 1 -- 172.21.15.81:0/359795414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c001230 con 0x7f12980052e0 2023-10-07T08:43:07.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b0b56700 1 -- 172.21.15.81:0/359795414 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac0c7700 con 0x7f1298003c20 2023-10-07T08:43:07.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b0b56700 1 -- 172.21.15.81:0/359795414 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129800c320 con 0x7f1298004810 2023-10-07T08:43:07.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b1b58700 1 --2- 172.21.15.81:0/359795414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1298003c20 0x7f1298003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.758+0000 7f12b1357700 1 --2- 172.21.15.81:0/359795414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1298004810 0x7f1298004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f7275da6700 1 -- 172.21.15.81:0/398427782 shutdown_connections 2023-10-07T08:43:07.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f80e2ffd700 1 --2- 172.21.15.81:0/1549628057 >> v2:172.21.15.81:3300/0 conn(0x7f80e41578d0 0x7f80e40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f12b1b58700 1 -- 172.21.15.81:0/359795414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1298004810 msgr2=0x7f1298004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f12b1b58700 1 --2- 172.21.15.81:0/359795414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1298004810 0x7f1298004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f12b1b58700 1 -- 172.21.15.81:0/359795414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12980052e0 msgr2=0x7f129800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f12b1b58700 1 --2- 172.21.15.81:0/359795414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12980052e0 0x7f129800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f12b1b58700 1 -- 172.21.15.81:0/359795414 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac0c79e0 con 0x7f1298003c20 2023-10-07T08:43:07.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f12b2359700 1 -- 172.21.15.81:0/359795414 reap_dead start 2023-10-07T08:43:07.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f80e1ffb700 1 -- 172.21.15.81:0/1549628057 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547305187 0 0) 0x7f80e40d07c0 con 0x7f80e4157ca0 2023-10-07T08:43:07.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f80e1ffb700 1 -- 172.21.15.81:0/1549628057 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80cc003570 con 0x7f80e4157ca0 2023-10-07T08:43:07.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7fc96cb22700 1 Processor -- start 2023-10-07T08:43:07.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f12b1b58700 1 --2- 172.21.15.81:0/359795414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1298003c20 0x7f1298003ff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f129c00c230 tx=0x7f129c001d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ff83679e1a1e85d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f1ec5458700 1 -- 172.21.15.81:0/2388166932 shutdown_connections 2023-10-07T08:43:07.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7fc96cb22700 1 -- start start 2023-10-07T08:43:07.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f1ec5458700 1 -- 172.21.15.81:0/2388166932 wait complete. 2023-10-07T08:43:07.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7ff27e7fc700 1 -- 172.21.15.81:0/2568279339 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff28401a400 con 0x7ff288155c60 2023-10-07T08:43:07.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7fef56d32700 1 -- 172.21.15.81:0/2506065842 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5006d220 msgr2=0x7fef5006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7fef56d32700 1 --2- 172.21.15.81:0/2506065842 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5006d220 0x7fef5006d690 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0098e0 tx=0x7fef3c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f12b0b56700 1 -- 172.21.15.81:0/359795414 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c007a10 con 0x7f1298003c20 2023-10-07T08:43:07.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f12b0b56700 1 -- 172.21.15.81:0/359795414 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c00cb20 con 0x7f1298003c20 2023-10-07T08:43:07.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f12b0b56700 1 -- 172.21.15.81:0/359795414 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c0048f0 con 0x7f1298003c20 2023-10-07T08:43:07.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7f12b3dbc700 1 -- 172.21.15.81:0/359795414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1298003c20 msgr2=0x7f1298003ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7f12b3dbc700 1 --2- 172.21.15.81:0/359795414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1298003c20 0x7f1298003ff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f129c00c230 tx=0x7f129c001d20 comp rx=0 tx=0).stop 2023-10-07T08:43:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7f80e1ffb700 1 -- 172.21.15.81:0/1549628057 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1497672113 0 0) 0x7f80cc003570 con 0x7f80e4157ca0 2023-10-07T08:43:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7f80e1ffb700 1 -- 172.21.15.81:0/1549628057 >> v2:172.21.15.89:3300/0 conn(0x7f80e406d120 msgr2=0x7f80e406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7f80e1ffb700 1 --2- 172.21.15.81:0/1549628057 >> v2:172.21.15.89:3300/0 conn(0x7f80e406d120 0x7f80e406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7f80e1ffb700 1 -- 172.21.15.81:0/1549628057 >> v2:172.21.15.81:3300/0 conn(0x7f80e41578d0 msgr2=0x7f80e40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7f80e1ffb700 1 --2- 172.21.15.81:0/1549628057 >> v2:172.21.15.81:3300/0 conn(0x7f80e41578d0 0x7f80e40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7f80e1ffb700 1 -- 172.21.15.81:0/1549628057 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e40cfe90 con 0x7f80e4157ca0 2023-10-07T08:43:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7f80e1ffb700 1 -- 172.21.15.81:0/1549628057 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f80dc0017f0 con 0x7f80e4157ca0 2023-10-07T08:43:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7f80e1ffb700 1 -- 172.21.15.81:0/1549628057 >> v1:172.21.15.81:6789/0 conn(0x7f80e4157ca0 legacy=0x7f80e415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7f80e1ffb700 1 --2- 172.21.15.81:0/1549628057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80cc003ae0 0x7f80cc003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7f80e1ffb700 1 --2- 172.21.15.81:0/1549628057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80cc004810 0x7f80cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7f80e1ffb700 1 --2- 172.21.15.81:0/1549628057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80cc0051c0 0x7f80cc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7f80e1ffb700 1 -- 172.21.15.81:0/1549628057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e406da50 con 0x7f80cc004810 2023-10-07T08:43:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7f80e1ffb700 1 -- 172.21.15.81:0/1549628057 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40cfbb0 con 0x7f80cc0051c0 2023-10-07T08:43:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7f80e1ffb700 1 -- 172.21.15.81:0/1549628057 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc00c100 con 0x7f80cc003ae0 2023-10-07T08:43:07.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7fc96cb22700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc96806d120 0x7fc968166bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7fc96cb22700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9681578d0 0x7fc9681515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7fc96cb22700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc968157ca0 0x7fc96808c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7fc96cb22700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc968167130 con 0x7fc9681578d0 2023-10-07T08:43:07.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7fc96cb22700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9681523a0 con 0x7fc96806d120 2023-10-07T08:43:07.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7fc96cb22700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc968152140 con 0x7fc968157ca0 2023-10-07T08:43:07.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.760+0000 7ff27e7fc700 1 --2- 172.21.15.81:0/2568279339 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff26c067000 0x7ff26c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7ff27e7fc700 1 -- 172.21.15.81:0/2568279339 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff284083e40 con 0x7ff288155c60 2023-10-07T08:43:07.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7fc96659c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc96806d120 0x7fc968166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7fc96659c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc96806d120 0x7fc968166bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:39104/0 (socket says 172.21.15.81:39104) 2023-10-07T08:43:07.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7fc96659c700 1 -- 172.21.15.81:0/2840820226 learned_addr learned my addr 172.21.15.81:0/2840820226 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.759+0000 7f7275da6700 1 -- 172.21.15.81:0/398427782 wait complete. 2023-10-07T08:43:07.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7f7275da6700 1 Processor -- start 2023-10-07T08:43:07.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7f80e37fe700 1 --2- 172.21.15.81:0/1549628057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80cc0051c0 0x7f80cc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7f80e27fc700 1 --2- 172.21.15.81:0/1549628057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80cc004810 0x7f80cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7f7275da6700 1 -- start start 2023-10-07T08:43:07.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7fef56d32700 1 -- 172.21.15.81:0/2506065842 shutdown_connections 2023-10-07T08:43:07.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7fef56d32700 1 --2- 172.21.15.81:0/2506065842 >> v2:172.21.15.89:3300/0 conn(0x7fef50069670 0x7fef50069ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7fef56d32700 1 --2- 172.21.15.81:0/2506065842 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5006d220 0x7fef5006d690 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7fef56d32700 1 -- 172.21.15.81:0/2506065842 >> 172.21.15.81:0/2506065842 conn(0x7fef500cc980 msgr2=0x7fef500ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7fef56d32700 1 -- 172.21.15.81:0/2506065842 shutdown_connections 2023-10-07T08:43:07.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7ff28e0a5700 1 --2- 172.21.15.81:0/2568279339 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff26c067000 0x7ff26c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7f1ec5458700 1 Processor -- start 2023-10-07T08:43:07.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7f1ec5458700 1 -- start start 2023-10-07T08:43:07.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7f80e27fc700 1 -- 172.21.15.81:0/1549628057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80cc003ae0 msgr2=0x7f80cc003ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T08:43:07.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7f80e27fc700 1 --2- 172.21.15.81:0/1549628057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80cc003ae0 0x7f80cc003ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7f80e27fc700 1 -- 172.21.15.81:0/1549628057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80cc0051c0 msgr2=0x7f80cc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:07.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7f80e27fc700 1 --2- 172.21.15.81:0/1549628057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80cc0051c0 0x7f80cc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7f80e37fe700 1 -- 172.21.15.81:0/1549628057 reap_dead start 2023-10-07T08:43:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7f80e27fc700 1 -- 172.21.15.81:0/1549628057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e40cfe90 con 0x7f80cc004810 2023-10-07T08:43:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7fc966d9d700 1 --2- 172.21.15.81:0/2840820226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc968157ca0 0x7fc96808c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7fc965d9b700 1 --2- 172.21.15.81:0/2840820226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9681578d0 0x7fc9681515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7fc96659c700 1 -- 172.21.15.81:0/2840820226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc968157ca0 msgr2=0x7fc96808c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7fc96659c700 1 --2- 172.21.15.81:0/2840820226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc968157ca0 0x7fc96808c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7fc96659c700 1 -- 172.21.15.81:0/2840820226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9681578d0 msgr2=0x7fc9681515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7fc96659c700 1 --2- 172.21.15.81:0/2840820226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9681578d0 0x7fc9681515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7fc96659c700 1 -- 172.21.15.81:0/2840820226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc958009420 con 0x7fc96806d120 2023-10-07T08:43:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7fef56d32700 1 -- 172.21.15.81:0/2506065842 wait complete. 2023-10-07T08:43:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7f80e27fc700 1 --2- 172.21.15.81:0/1549628057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80cc004810 0x7f80cc004c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0013d0 tx=0x7f80dc001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d519e5d9dca735 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7ff290309700 1 -- 172.21.15.81:0/2568279339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff288067bc0 con 0x7ff288155c60 2023-10-07T08:43:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.761+0000 7ff28e0a5700 1 --2- 172.21.15.81:0/2568279339 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff26c067000 0x7ff26c0694b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff278003080 tx=0x7ff278018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f80e1ffb700 1 -- 172.21.15.81:0/1549628057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00cee0 con 0x7f80cc004810 2023-10-07T08:43:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7fc96659c700 1 --2- 172.21.15.81:0/2840820226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc96806d120 0x7fc968166bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc96806fe20 tx=0x7fc958017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f80e1ffb700 1 -- 172.21.15.81:0/1549628057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc012400 con 0x7f80cc004810 2023-10-07T08:43:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f80e1ffb700 1 -- 172.21.15.81:0/1549628057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0127a0 con 0x7f80cc004810 2023-10-07T08:43:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f7275da6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72700acf60 0x7f72700aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f7275da6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72700b0a00 0x7f72700afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f7275da6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72700cdc90 0x7f727013a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f7275da6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727015e360 con 0x7f72700cdc90 2023-10-07T08:43:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f7275da6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72700cb160 con 0x7f72700acf60 2023-10-07T08:43:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f7275da6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72700adba0 con 0x7f72700b0a00 2023-10-07T08:43:07.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72700acf60 0x7f72700aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f12b3dbc700 1 -- 172.21.15.81:0/359795414 shutdown_connections 2023-10-07T08:43:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f12b3dbc700 1 --2- 172.21.15.81:0/359795414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1298003c20 0x7f1298003ff0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f12b3dbc700 1 -- 172.21.15.81:0/359795414 >> 172.21.15.81:0/359795414 conn(0x7f12ac0cc980 msgr2=0x7f12ac0ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72700acf60 0x7f72700aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:39116/0 (socket says 172.21.15.81:39116) 2023-10-07T08:43:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f726f7fe700 1 -- 172.21.15.81:0/3938392978 learned_addr learned my addr 172.21.15.81:0/3938392978 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f726ffff700 1 --2- 172.21.15.81:0/3938392978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72700cdc90 0x7f727013a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f726effd700 1 --2- 172.21.15.81:0/3938392978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72700b0a00 0x7f72700afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f12b3dbc700 1 -- 172.21.15.81:0/359795414 shutdown_connections 2023-10-07T08:43:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f1ec5458700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ec006d870 0x7f1ec008c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f1ec5458700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ec00d38f0 0x7f1ec0163a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f1ec5458700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ec0156400 0x7f1ec0156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f1ec5458700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec008ce30 con 0x7f1ec0156400 2023-10-07T08:43:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f1ec5458700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00897a0 con 0x7f1ec006d870 2023-10-07T08:43:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f1ec5458700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec0089a80 con 0x7f1ec00d38f0 2023-10-07T08:43:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f6bcc355700 1 Processor -- start 2023-10-07T08:43:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f6bcc355700 1 -- start start 2023-10-07T08:43:07.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f1ebe7fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ec00d38f0 0x7f1ec0163a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f1ebe7fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ec00d38f0 0x7f1ec0163a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:49140/0 (socket says 172.21.15.81:49140) 2023-10-07T08:43:07.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f1ebe7fc700 1 -- 172.21.15.81:0/3812436691 learned_addr learned my addr 172.21.15.81:0/3812436691 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f1ebeffd700 1 --2- 172.21.15.81:0/3812436691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ec006d870 0x7f1ec008c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f726ffff700 1 -- 172.21.15.81:0/3938392978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72700b0a00 msgr2=0x7f72700afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f726ffff700 1 --2- 172.21.15.81:0/3938392978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72700b0a00 0x7f72700afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f726ffff700 1 -- 172.21.15.81:0/3938392978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72700acf60 msgr2=0x7f72700aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f726ffff700 1 --2- 172.21.15.81:0/3938392978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72700acf60 0x7f72700aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f726ffff700 1 -- 172.21.15.81:0/3938392978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7260009420 con 0x7f72700cdc90 2023-10-07T08:43:07.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f80e9706700 1 -- 172.21.15.81:0/1549628057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80cc004810 msgr2=0x7f80cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f80e9706700 1 --2- 172.21.15.81:0/1549628057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80cc004810 0x7f80cc004c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0013d0 tx=0x7f80dc001e60 comp rx=0 tx=0).stop 2023-10-07T08:43:07.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f1ebf7fe700 1 --2- 172.21.15.81:0/3812436691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ec0156400 0x7f1ec0156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f80e9706700 1 -- 172.21.15.81:0/1549628057 shutdown_connections 2023-10-07T08:43:07.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f80e9706700 1 --2- 172.21.15.81:0/1549628057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80cc004810 0x7f80cc004c80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f80e9706700 1 -- 172.21.15.81:0/1549628057 >> 172.21.15.81:0/1549628057 conn(0x7f80e406bb90 msgr2=0x7f80e406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.762+0000 7f12b3dbc700 1 -- 172.21.15.81:0/359795414 wait complete. 2023-10-07T08:43:07.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f726ffff700 1 --2- 172.21.15.81:0/3938392978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72700cdc90 0x7f727013a5f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7270068da0 tx=0x7f7260017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7fef56d32700 1 Processor -- start 2023-10-07T08:43:07.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f1ebe7fc700 1 -- 172.21.15.81:0/3812436691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ec006d870 msgr2=0x7f1ec008c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f1ebe7fc700 1 --2- 172.21.15.81:0/3812436691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ec006d870 0x7f1ec008c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f1ebe7fc700 1 -- 172.21.15.81:0/3812436691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ec0156400 msgr2=0x7f1ec0156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f1ebe7fc700 1 --2- 172.21.15.81:0/3812436691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ec0156400 0x7f1ec0156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f1ebe7fc700 1 -- 172.21.15.81:0/3812436691 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb40094f0 con 0x7f1ec00d38f0 2023-10-07T08:43:07.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f1ebeffd700 1 --2- 172.21.15.81:0/3812436691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ec006d870 0x7f1ec008c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:07.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f80e9706700 1 -- 172.21.15.81:0/1549628057 shutdown_connections 2023-10-07T08:43:07.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f1ebe7fc700 1 --2- 172.21.15.81:0/3812436691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ec00d38f0 0x7f1ec0163a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000b5e0 tx=0x7f1eb00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f80e9706700 1 -- 172.21.15.81:0/1549628057 wait complete. 2023-10-07T08:43:07.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7fef56d32700 1 -- start start 2023-10-07T08:43:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f1ea6ffd700 1 -- 172.21.15.81:0/3812436691 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb000f510 con 0x7f1ec00d38f0 2023-10-07T08:43:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f1ea6ffd700 1 -- 172.21.15.81:0/3812436691 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb000f670 con 0x7f1ec00d38f0 2023-10-07T08:43:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f1ec5458700 1 -- 172.21.15.81:0/3812436691 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec0089d60 con 0x7f1ec00d38f0 2023-10-07T08:43:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.763+0000 7f1ea6ffd700 1 -- 172.21.15.81:0/3812436691 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb000fa30 con 0x7f1ec00d38f0 2023-10-07T08:43:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7f1ec5458700 1 -- 172.21.15.81:0/3812436691 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec008a320 con 0x7f1ec00d38f0 2023-10-07T08:43:07.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7f6bcc355700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bc40c1810 0x7f6bc40cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7f6bcc355700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6bc40c22f0 0x7f6bc415ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7f6bcc355700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc40cc210 con 0x7f6bc40cb0f0 2023-10-07T08:43:07.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7f6bcc355700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc40cb600 con 0x7f6bc40c22f0 2023-10-07T08:43:07.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7f6bcc355700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40cb8e0 con 0x7f6bc40c1810 2023-10-07T08:43:07.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7f12b3dbc700 1 Processor -- start 2023-10-07T08:43:07.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7f12b3dbc700 1 -- start start 2023-10-07T08:43:07.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7f6bca0f1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bc40c1810 0x7f6bc40cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7f6bca0f1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bc40c1810 0x7f6bc40cabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:49150/0 (socket says 172.21.15.81:49150) 2023-10-07T08:43:07.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7f6bca0f1700 1 -- 172.21.15.81:0/4189535696 learned_addr learned my addr 172.21.15.81:0/4189535696 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7fef56d32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef50069670 0x7fef500c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7fef56d32700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5006d220 0x7fef5015d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7fef56d32700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef501414f0 0x7fef5015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7fef56d32700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5015ee60 con 0x7fef50069670 2023-10-07T08:43:07.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7fef56d32700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef500acdf0 con 0x7fef501414f0 2023-10-07T08:43:07.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.764+0000 7fef56d32700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5015e250 con 0x7fef5006d220 2023-10-07T08:43:07.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7fef54ace700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef50069670 0x7fef500c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7fef54ace700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef50069670 0x7fef500c55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45064/0 (socket says 172.21.15.81:45064) 2023-10-07T08:43:07.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7fef54ace700 1 -- 172.21.15.81:0/3596431000 learned_addr learned my addr 172.21.15.81:0/3596431000 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7fef4ffff700 1 --2- 172.21.15.81:0/3596431000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5006d220 0x7fef5015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f6bca0f1700 1 -- 172.21.15.81:0/4189535696 >> v2:172.21.15.89:3300/0 conn(0x7f6bc40c22f0 msgr2=0x7f6bc415ff50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T08:43:07.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f6bca0f1700 1 --2- 172.21.15.81:0/4189535696 >> v2:172.21.15.89:3300/0 conn(0x7f6bc40c22f0 0x7f6bc415ff50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f6bca0f1700 1 -- 172.21.15.81:0/4189535696 >> v1:172.21.15.89:6789/0 conn(0x7f6bc40cb0f0 legacy=0x7f6bc40c1be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T08:43:07.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f6bca0f1700 1 -- 172.21.15.81:0/4189535696 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc40cbbc0 con 0x7f6bc40c1810 2023-10-07T08:43:07.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7fef552cf700 1 --2- 172.21.15.81:0/3596431000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef501414f0 0x7fef5015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f80e9706700 1 Processor -- start 2023-10-07T08:43:07.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7fef4ffff700 1 -- 172.21.15.81:0/3596431000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef501414f0 msgr2=0x7fef5015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7fef4ffff700 1 --2- 172.21.15.81:0/3596431000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef501414f0 0x7fef5015dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7fef4ffff700 1 -- 172.21.15.81:0/3596431000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef50069670 msgr2=0x7fef500c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7fef4ffff700 1 --2- 172.21.15.81:0/3596431000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef50069670 0x7fef500c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7fef4ffff700 1 -- 172.21.15.81:0/3596431000 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c009420 con 0x7fef5006d220 2023-10-07T08:43:07.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f6bca0f1700 1 --2- 172.21.15.81:0/4189535696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bc40c1810 0x7f6bc40cabb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40099b0 tx=0x7f6bb4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=841eb6756840efe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f72577fe700 1 -- 172.21.15.81:0/3938392978 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726001a430 con 0x7f72700cdc90 2023-10-07T08:43:07.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f72577fe700 1 -- 172.21.15.81:0/3938392978 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726001a590 con 0x7f72700cdc90 2023-10-07T08:43:07.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f7275da6700 1 -- 172.21.15.81:0/3938392978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72700ade80 con 0x7f72700cdc90 2023-10-07T08:43:07.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f7275da6700 1 -- 172.21.15.81:0/3938392978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72700ae440 con 0x7f72700cdc90 2023-10-07T08:43:07.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f72577fe700 1 -- 172.21.15.81:0/3938392978 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726001a930 con 0x7f72700cdc90 2023-10-07T08:43:07.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f1ea6ffd700 1 -- 172.21.15.81:0/3812436691 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1eb001a400 con 0x7f1ec00d38f0 2023-10-07T08:43:07.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f6bc90ef700 1 -- 172.21.15.81:0/4189535696 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400b820 con 0x7f6bc40c1810 2023-10-07T08:43:07.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f6bc90ef700 1 -- 172.21.15.81:0/4189535696 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb400b980 con 0x7f6bc40c1810 2023-10-07T08:43:07.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f6bc90ef700 1 -- 172.21.15.81:0/4189535696 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400bd20 con 0x7f6bc40c1810 2023-10-07T08:43:07.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f12b3dbc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1298003c20 0x7f12ac1522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f12b3dbc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12ac13de20 0x7f12ac0c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f12b3dbc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12ac0c4a30 0x7f12ac13ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f12b3dbc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac13ec50 con 0x7f12ac13de20 2023-10-07T08:43:07.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f12b3dbc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac13fab0 con 0x7f12ac0c4a30 2023-10-07T08:43:07.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f12b3dbc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac0c6820 con 0x7f1298003c20 2023-10-07T08:43:07.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7fef54ace700 1 --2- 172.21.15.81:0/3596431000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef50069670 0x7fef500c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:07.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7fef4ffff700 1 --2- 172.21.15.81:0/3596431000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5006d220 0x7fef5015d690 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef3c016000 tx=0x7fef3c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f12b1357700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12ac13de20 0x7f12ac0c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f12b1357700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12ac13de20 0x7f12ac0c44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45074/0 (socket says 172.21.15.81:45074) 2023-10-07T08:43:07.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f12b1357700 1 -- 172.21.15.81:0/399718518 learned_addr learned my addr 172.21.15.81:0/399718518 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f1ea6ffd700 1 --2- 172.21.15.81:0/3812436691 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1eac066f30 0x7f1eac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f1ea6ffd700 1 -- 172.21.15.81:0/3812436691 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1eb0083f40 con 0x7f1ec00d38f0 2023-10-07T08:43:07.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7fef4cff9700 1 -- 172.21.15.81:0/3596431000 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c01f070 con 0x7fef5006d220 2023-10-07T08:43:07.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7fef4cff9700 1 -- 172.21.15.81:0/3596431000 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3c000c90 con 0x7fef5006d220 2023-10-07T08:43:07.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7fef4cff9700 1 -- 172.21.15.81:0/3596431000 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c025420 con 0x7fef5006d220 2023-10-07T08:43:07.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7fef56d32700 1 -- 172.21.15.81:0/3596431000 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5015e530 con 0x7fef5006d220 2023-10-07T08:43:07.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f7275da6700 1 -- 172.21.15.81:0/3938392978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72500052b0 con 0x7f72700cdc90 2023-10-07T08:43:07.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f12b2359700 1 --2- 172.21.15.81:0/399718518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12ac0c4a30 0x7f12ac13ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f12b1b58700 1 --2- 172.21.15.81:0/399718518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1298003c20 0x7f12ac1522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f12b1357700 1 -- 172.21.15.81:0/399718518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1298003c20 msgr2=0x7f12ac1522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f12b1357700 1 --2- 172.21.15.81:0/399718518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1298003c20 0x7f12ac1522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f12b1357700 1 -- 172.21.15.81:0/399718518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12ac0c4a30 msgr2=0x7f12ac13ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f12b1357700 1 --2- 172.21.15.81:0/399718518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12ac0c4a30 0x7f12ac13ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f12b1357700 1 -- 172.21.15.81:0/399718518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac13eea0 con 0x7f12ac13de20 2023-10-07T08:43:07.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f12b1b58700 1 --2- 172.21.15.81:0/399718518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1298003c20 0x7f12ac1522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:07.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f1ebeffd700 1 --2- 172.21.15.81:0/3812436691 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1eac066f30 0x7f1eac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.765+0000 7f80e9706700 1 -- start start 2023-10-07T08:43:07.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f80e9706700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80cc004810 0x7f80e4174000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f80e9706700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80e415caf0 0x7f80e4176c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f80e9706700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80e4177160 0x7f80e415b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f80e9706700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e4177c30 con 0x7f80cc004810 2023-10-07T08:43:07.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f80e9706700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e4178300 con 0x7f80e4177160 2023-10-07T08:43:07.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f80e9706700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e4177670 con 0x7f80e415caf0 2023-10-07T08:43:07.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f80e27fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80e415caf0 0x7f80e4176c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f80e37fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80e4177160 0x7f80e415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f80e27fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80e415caf0 0x7f80e4176c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:49178/0 (socket says 172.21.15.81:49178) 2023-10-07T08:43:07.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f80e37fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80e4177160 0x7f80e415b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:39156/0 (socket says 172.21.15.81:39156) 2023-10-07T08:43:07.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f80e27fc700 1 -- 172.21.15.81:0/1676621383 learned_addr learned my addr 172.21.15.81:0/1676621383 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f6bcc355700 1 -- 172.21.15.81:0/4189535696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bc40c1810 msgr2=0x7f6bc40cabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f6bcc355700 1 --2- 172.21.15.81:0/4189535696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bc40c1810 0x7f6bc40cabb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40099b0 tx=0x7f6bb4009250 comp rx=0 tx=0).stop 2023-10-07T08:43:07.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f6bcc355700 1 -- 172.21.15.81:0/4189535696 shutdown_connections 2023-10-07T08:43:07.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f6bcc355700 1 --2- 172.21.15.81:0/4189535696 >> v2:172.21.15.89:3300/0 conn(0x7f6bc40c22f0 0x7f6bc415ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f6bcc355700 1 --2- 172.21.15.81:0/4189535696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bc40c1810 0x7f6bc40cabb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f6bcc355700 1 -- 172.21.15.81:0/4189535696 >> 172.21.15.81:0/4189535696 conn(0x7f6bc406c660 msgr2=0x7f6bc40cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:07.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f6bcc355700 1 -- 172.21.15.81:0/4189535696 shutdown_connections 2023-10-07T08:43:07.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.767+0000 7f1ec5458700 1 -- 172.21.15.81:0/3812436691 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea00052b0 con 0x7f1ec00d38f0 2023-10-07T08:43:07.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.767+0000 7f80e27fc700 1 -- 172.21.15.81:0/1676621383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80e4177160 msgr2=0x7f80e415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.767+0000 7f80e27fc700 1 --2- 172.21.15.81:0/1676621383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80e4177160 0x7f80e415b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.767+0000 7f80e27fc700 1 -- 172.21.15.81:0/1676621383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80cc004810 msgr2=0x7f80e4174000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.767+0000 7f80e27fc700 1 --2- 172.21.15.81:0/1676621383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80cc004810 0x7f80e4174000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.766+0000 7f6bcc355700 1 -- 172.21.15.81:0/4189535696 wait complete. 2023-10-07T08:43:07.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.767+0000 7f80e27fc700 1 -- 172.21.15.81:0/1676621383 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e4177950 con 0x7f80e415caf0 2023-10-07T08:43:07.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.767+0000 7f1ebeffd700 1 --2- 172.21.15.81:0/3812436691 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1eac066f30 0x7f1eac0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40099b0 tx=0x7f1eb4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.767+0000 7f80e27fc700 1 --2- 172.21.15.81:0/1676621383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80e415caf0 0x7f80e4176c20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00c050 tx=0x7f80dc016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.767+0000 7f72577fe700 1 -- 172.21.15.81:0/3938392978 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f726002f450 con 0x7f72700cdc90 2023-10-07T08:43:07.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.767+0000 7fef56d32700 1 -- 172.21.15.81:0/3596431000 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5015eaf0 con 0x7fef5006d220 2023-10-07T08:43:07.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.768+0000 7fef56d32700 1 -- 172.21.15.81:0/3596431000 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5015efd0 con 0x7fef5006d220 2023-10-07T08:43:07.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.768+0000 7fef4cff9700 1 -- 172.21.15.81:0/3596431000 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef3c023070 con 0x7fef5006d220 2023-10-07T08:43:07.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.768+0000 7f72577fe700 1 --2- 172.21.15.81:0/3938392978 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f725c066f30 0x7f725c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.768+0000 7f72577fe700 1 -- 172.21.15.81:0/3938392978 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72600860f0 con 0x7f72700cdc90 2023-10-07T08:43:07.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.768+0000 7ff27e7fc700 1 -- 172.21.15.81:0/2568279339 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff284058e60 con 0x7ff288155c60 2023-10-07T08:43:07.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.768+0000 7f12b1357700 1 --2- 172.21.15.81:0/399718518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12ac13de20 0x7f12ac0c44f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f12a800d8a0 tx=0x7f12a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.768+0000 7fc9567fc700 1 -- 172.21.15.81:0/2840820226 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800b9d0 con 0x7fc96806d120 2023-10-07T08:43:07.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.768+0000 7fc9567fc700 1 -- 172.21.15.81:0/2840820226 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95800bb50 con 0x7fc96806d120 2023-10-07T08:43:07.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.768+0000 7fc9567fc700 1 -- 172.21.15.81:0/2840820226 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958026680 con 0x7fc96806d120 2023-10-07T08:43:07.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.768+0000 7fc96cb22700 1 -- 172.21.15.81:0/2840820226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc968154d20 con 0x7fc96806d120 2023-10-07T08:43:07.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.768+0000 7f6bcc355700 1 Processor -- start 2023-10-07T08:43:07.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.768+0000 7f6bcc355700 1 -- start start 2023-10-07T08:43:07.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.768+0000 7fc96cb22700 1 -- 172.21.15.81:0/2840820226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9681528f0 con 0x7fc96806d120 2023-10-07T08:43:07.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7fef4cff9700 1 --2- 172.21.15.81:0/3596431000 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fef34067000 0x7fef340694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7fef4cff9700 1 -- 172.21.15.81:0/3596431000 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef3c0858c0 con 0x7fef5006d220 2023-10-07T08:43:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7f6bcc355700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bc40c1810 0x7f6bc40b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7f6bcc355700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc40c22f0 0x7f6bc4156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7f6bcc355700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bc40cb0f0 0x7f6bc41570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7f6bcc355700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc4159130 con 0x7f6bc40c22f0 2023-10-07T08:43:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7f6bcc355700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40b1c40 con 0x7f6bc40cb0f0 2023-10-07T08:43:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7f6bcc355700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc4158210 con 0x7f6bc40c1810 2023-10-07T08:43:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7f6bca0f1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bc40c1810 0x7f6bc40b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7f6bc98f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc40c22f0 0x7f6bc4156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7f6bca0f1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bc40c1810 0x7f6bc40b2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:49190/0 (socket says 172.21.15.81:49190) 2023-10-07T08:43:07.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7f6bca0f1700 1 -- 172.21.15.81:0/288698103 learned_addr learned my addr 172.21.15.81:0/288698103 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:07.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7fef54ace700 1 --2- 172.21.15.81:0/3596431000 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fef34067000 0x7fef340694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7f726f7fe700 1 --2- 172.21.15.81:0/3938392978 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f725c066f30 0x7f725c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7fc947fff700 1 -- 172.21.15.81:0/2840820226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9400052b0 con 0x7fc96806d120 2023-10-07T08:43:07.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.770+0000 7fef54ace700 1 --2- 172.21.15.81:0/3596431000 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fef34067000 0x7fef340694b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fef44007fd0 tx=0x7fef44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.770+0000 7f726f7fe700 1 --2- 172.21.15.81:0/3938392978 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f725c066f30 0x7f725c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f726800f630 tx=0x7f726800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7f6bca0f1700 1 -- 172.21.15.81:0/288698103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bc40cb0f0 msgr2=0x7f6bc41570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7f6bca0f1700 1 --2- 172.21.15.81:0/288698103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bc40cb0f0 0x7f6bc41570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7f6bca0f1700 1 -- 172.21.15.81:0/288698103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc40c22f0 msgr2=0x7f6bc4156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:07.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7f6bca0f1700 1 --2- 172.21.15.81:0/288698103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc40c22f0 0x7f6bc4156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:07.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.769+0000 7f6bca0f1700 1 -- 172.21.15.81:0/288698103 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb40094f0 con 0x7f6bc40c1810 2023-10-07T08:43:07.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.770+0000 7f6bc98f0700 1 --2- 172.21.15.81:0/288698103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc40c22f0 0x7f6bc4156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:07.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.770+0000 7f6bca0f1700 1 --2- 172.21.15.81:0/288698103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bc40c1810 0x7f6bc40b2110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009290 tx=0x7f6bb4018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.771+0000 7fc9567fc700 1 -- 172.21.15.81:0/2840820226 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc958023030 con 0x7fc96806d120 2023-10-07T08:43:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.771+0000 7fc9567fc700 1 --2- 172.21.15.81:0/2840820226 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc948066f30 0x7fc9480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.771+0000 7fc965d9b700 1 --2- 172.21.15.81:0/2840820226 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc948066f30 0x7fc9480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.771+0000 7fc9567fc700 1 -- 172.21.15.81:0/2840820226 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc958086280 con 0x7fc96806d120 2023-10-07T08:43:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.772+0000 7fc965d9b700 1 --2- 172.21.15.81:0/2840820226 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc948066f30 0x7fc9480693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc9681580c0 tx=0x7fc95c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.772+0000 7f6bba7fc700 1 -- 172.21.15.81:0/288698103 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400fc20 con 0x7f6bc40c1810 2023-10-07T08:43:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.772+0000 7f80caffd700 1 -- 172.21.15.81:0/1676621383 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc012e20 con 0x7f80e415caf0 2023-10-07T08:43:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.772+0000 7f6bcc355700 1 -- 172.21.15.81:0/288698103 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc41584b0 con 0x7f6bc40c1810 2023-10-07T08:43:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.772+0000 7f80e9706700 1 -- 172.21.15.81:0/1676621383 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e4177f90 con 0x7f80e415caf0 2023-10-07T08:43:07.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.772+0000 7f6bcc355700 1 -- 172.21.15.81:0/288698103 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc4158a70 con 0x7f6bc40c1810 2023-10-07T08:43:07.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.772+0000 7f80e9706700 1 -- 172.21.15.81:0/1676621383 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e415bd50 con 0x7f80e415caf0 2023-10-07T08:43:07.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.773+0000 7f80e9706700 1 -- 172.21.15.81:0/1676621383 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e4177df0 con 0x7f80e415caf0 2023-10-07T08:43:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.773+0000 7f6bcc355700 1 -- 172.21.15.81:0/288698103 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc4067bc0 con 0x7f6bc40c1810 2023-10-07T08:43:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.772+0000 7f1ea6ffd700 1 -- 172.21.15.81:0/3812436691 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1eb0051270 con 0x7f1ec00d38f0 2023-10-07T08:43:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.774+0000 7f12a1ffb700 1 -- 172.21.15.81:0/399718518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8012670 con 0x7f12ac13de20 2023-10-07T08:43:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.774+0000 7f12a1ffb700 1 -- 172.21.15.81:0/399718518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a800c040 con 0x7f12ac13de20 2023-10-07T08:43:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.774+0000 7f12b3dbc700 1 -- 172.21.15.81:0/399718518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ac13f180 con 0x7f12ac13de20 2023-10-07T08:43:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.774+0000 7f72577fe700 1 -- 172.21.15.81:0/3938392978 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7260053360 con 0x7f72700cdc90 2023-10-07T08:43:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.774+0000 7f12a1ffb700 1 -- 172.21.15.81:0/399718518 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8012a20 con 0x7f12ac13de20 2023-10-07T08:43:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.774+0000 7f12b3dbc700 1 -- 172.21.15.81:0/399718518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ac13f740 con 0x7f12ac13de20 2023-10-07T08:43:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.775+0000 7fc9567fc700 1 -- 172.21.15.81:0/2840820226 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc958053650 con 0x7fc96806d120 2023-10-07T08:43:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.775+0000 7f12b3dbc700 1 -- 172.21.15.81:0/399718518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ac067bc0 con 0x7f12ac13de20 2023-10-07T08:43:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.776+0000 7f12a1ffb700 1 -- 172.21.15.81:0/399718518 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12a80113c0 con 0x7f12ac13de20 2023-10-07T08:43:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.776+0000 7f12a1ffb700 1 --2- 172.21.15.81:0/399718518 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1290066f30 0x7f12900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.776+0000 7f12a1ffb700 1 -- 172.21.15.81:0/399718518 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12a8084500 con 0x7f12ac13de20 2023-10-07T08:43:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.776+0000 7f12b1b58700 1 --2- 172.21.15.81:0/399718518 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1290066f30 0x7f12900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.777+0000 7fef4cff9700 1 -- 172.21.15.81:0/3596431000 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef3c052bb0 con 0x7fef5006d220 2023-10-07T08:43:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.777+0000 7f12b1b58700 1 --2- 172.21.15.81:0/399718518 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1290066f30 0x7f12900693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f129c007ee0 tx=0x7f129c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.777+0000 7f80caffd700 1 -- 172.21.15.81:0/1676621383 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc01c630 con 0x7f80e415caf0 2023-10-07T08:43:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.777+0000 7f80caffd700 1 -- 172.21.15.81:0/1676621383 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc01c7e0 con 0x7f80e415caf0 2023-10-07T08:43:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.777+0000 7f6bba7fc700 1 -- 172.21.15.81:0/288698103 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb402a460 con 0x7f6bc40c1810 2023-10-07T08:43:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.777+0000 7f6bba7fc700 1 -- 172.21.15.81:0/288698103 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb402a5d0 con 0x7f6bc40c1810 2023-10-07T08:43:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.778+0000 7f80caffd700 1 -- 172.21.15.81:0/1676621383 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80dc023020 con 0x7f80e415caf0 2023-10-07T08:43:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.779+0000 7f80caffd700 1 --2- 172.21.15.81:0/1676621383 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80d0066f30 0x7f80d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.779+0000 7f80caffd700 1 -- 172.21.15.81:0/1676621383 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f80dc0866d0 con 0x7f80e415caf0 2023-10-07T08:43:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.778+0000 7f6bba7fc700 1 -- 172.21.15.81:0/288698103 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6bb402a730 con 0x7f6bc40c1810 2023-10-07T08:43:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.779+0000 7f6bba7fc700 1 --2- 172.21.15.81:0/288698103 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ba8066f30 0x7f6ba80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.779+0000 7f6bba7fc700 1 -- 172.21.15.81:0/288698103 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6bb4013070 con 0x7f6bc40c1810 2023-10-07T08:43:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.779+0000 7f6bc98f0700 1 --2- 172.21.15.81:0/288698103 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ba8066f30 0x7f6ba80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.779+0000 7f6bc98f0700 1 --2- 172.21.15.81:0/288698103 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ba8066f30 0x7f6ba80693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4165790 tx=0x7f6bc0009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:07.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.782+0000 7f80caffd700 1 -- 172.21.15.81:0/1676621383 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80dc0539c0 con 0x7f80e415caf0 2023-10-07T08:43:07.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.785+0000 7f12a1ffb700 1 -- 172.21.15.81:0/399718518 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12a8051770 con 0x7f12ac13de20 2023-10-07T08:43:07.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.786+0000 7f6bba7fc700 1 -- 172.21.15.81:0/288698103 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bb4053ab0 con 0x7f6bc40c1810 2023-10-07T08:43:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.785+0000 7f80e2ffd700 1 --2- 172.21.15.81:0/1676621383 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80d0066f30 0x7f80d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:07.785+0000 7f80e2ffd700 1 --2- 172.21.15.81:0/1676621383 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80d0066f30 0x7f80d00693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f80e408b420 tx=0x7f80d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:08.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.141+0000 7fef56d32700 1 -- 172.21.15.81:0/3596431000 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fef5015f1f0 con 0x7fef5006d220 2023-10-07T08:43:08.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.142+0000 7fef4cff9700 1 -- 172.21.15.81:0/3596431000 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef3c015090 con 0x7fef5006d220 2023-10-07T08:43:08.146 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-07T08:43:08.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.145+0000 7fef56d32700 1 -- 172.21.15.81:0/3596431000 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fef34067000 msgr2=0x7fef340694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:08.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.145+0000 7fef56d32700 1 --2- 172.21.15.81:0/3596431000 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fef34067000 0x7fef340694b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fef44007fd0 tx=0x7fef44009040 comp rx=0 tx=0).stop 2023-10-07T08:43:08.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.145+0000 7fef56d32700 1 -- 172.21.15.81:0/3596431000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5006d220 msgr2=0x7fef5015d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:08.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.145+0000 7fef56d32700 1 --2- 172.21.15.81:0/3596431000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5006d220 0x7fef5015d690 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef3c016000 tx=0x7fef3c017000 comp rx=0 tx=0).stop 2023-10-07T08:43:08.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.147+0000 7fef56d32700 1 -- 172.21.15.81:0/3596431000 shutdown_connections 2023-10-07T08:43:08.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.147+0000 7fef56d32700 1 --2- 172.21.15.81:0/3596431000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef501414f0 0x7fef5015dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.147+0000 7fef56d32700 1 --2- 172.21.15.81:0/3596431000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef50069670 0x7fef500c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.147+0000 7fef56d32700 1 --2- 172.21.15.81:0/3596431000 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fef34067000 0x7fef340694b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.147+0000 7fef56d32700 1 --2- 172.21.15.81:0/3596431000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef5006d220 0x7fef5015d690 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.147+0000 7fef56d32700 1 -- 172.21.15.81:0/3596431000 >> 172.21.15.81:0/3596431000 conn(0x7fef500cc980 msgr2=0x7fef500c3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:08.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.156+0000 7fc947fff700 1 -- 172.21.15.81:0/2840820226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc940005830 con 0x7fc96806d120 2023-10-07T08:43:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.156+0000 7fef56d32700 1 -- 172.21.15.81:0/3596431000 shutdown_connections 2023-10-07T08:43:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.156+0000 7fef56d32700 1 -- 172.21.15.81:0/3596431000 wait complete. 2023-10-07T08:43:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.157+0000 7fc9567fc700 1 -- 172.21.15.81:0/2840820226 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc95802e3a0 con 0x7fc96806d120 2023-10-07T08:43:08.161 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-07T08:43:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.160+0000 7fc947fff700 1 -- 172.21.15.81:0/2840820226 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc948066f30 msgr2=0x7fc9480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.160+0000 7fc947fff700 1 --2- 172.21.15.81:0/2840820226 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc948066f30 0x7fc9480693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc9681580c0 tx=0x7fc95c009040 comp rx=0 tx=0).stop 2023-10-07T08:43:08.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.160+0000 7fc947fff700 1 -- 172.21.15.81:0/2840820226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc96806d120 msgr2=0x7fc968166bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:08.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.160+0000 7fc947fff700 1 --2- 172.21.15.81:0/2840820226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc96806d120 0x7fc968166bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc96806fe20 tx=0x7fc958017000 comp rx=0 tx=0).stop 2023-10-07T08:43:08.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.164+0000 7ff290309700 1 -- 172.21.15.81:0/2568279339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff2880cad60 con 0x7ff288155c60 2023-10-07T08:43:08.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.164+0000 7f1ec5458700 1 -- 172.21.15.81:0/3812436691 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1ea0005830 con 0x7f1ec00d38f0 2023-10-07T08:43:08.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.164+0000 7ff27e7fc700 1 -- 172.21.15.81:0/2568279339 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff284051210 con 0x7ff288155c60 2023-10-07T08:43:08.166 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-07T08:43:08.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.164+0000 7f80e9706700 1 -- 172.21.15.81:0/1676621383 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f80e4177df0 con 0x7f80e415caf0 2023-10-07T08:43:08.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.165+0000 7f1ea6ffd700 1 -- 172.21.15.81:0/3812436691 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1eb0054890 con 0x7f1ec00d38f0 2023-10-07T08:43:08.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.164+0000 7f12b3dbc700 1 -- 172.21.15.81:0/399718518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f12ac0c7cc0 con 0x7f12ac13de20 2023-10-07T08:43:08.167 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-07T08:43:08.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.166+0000 7f12a1ffb700 1 -- 172.21.15.81:0/399718518 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12a8054d90 con 0x7f12ac13de20 2023-10-07T08:43:08.168 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-07T08:43:08.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.167+0000 7f80caffd700 1 -- 172.21.15.81:0/1676621383 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f80e4177df0 con 0x7f80e415caf0 2023-10-07T08:43:08.168 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-07T08:43:08.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.168+0000 7ff290309700 1 -- 172.21.15.81:0/2568279339 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff26c067000 msgr2=0x7ff26c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:08.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.168+0000 7ff290309700 1 --2- 172.21.15.81:0/2568279339 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff26c067000 0x7ff26c0694b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff278003080 tx=0x7ff278018000 comp rx=0 tx=0).stop 2023-10-07T08:43:08.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.168+0000 7ff290309700 1 -- 172.21.15.81:0/2568279339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff288155c60 msgr2=0x7ff2880c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:08.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.168+0000 7ff290309700 1 --2- 172.21.15.81:0/2568279339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff288155c60 0x7ff2880c3f70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff288069040 tx=0x7ff284009120 comp rx=0 tx=0).stop 2023-10-07T08:43:08.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7fc947fff700 1 -- 172.21.15.81:0/2840820226 shutdown_connections 2023-10-07T08:43:08.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7fc947fff700 1 --2- 172.21.15.81:0/2840820226 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc948066f30 0x7fc9480693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7fc947fff700 1 --2- 172.21.15.81:0/2840820226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc968157ca0 0x7fc96808c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7fc947fff700 1 --2- 172.21.15.81:0/2840820226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc96806d120 0x7fc968166bf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7fc947fff700 1 --2- 172.21.15.81:0/2840820226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9681578d0 0x7fc9681515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7fc947fff700 1 -- 172.21.15.81:0/2840820226 >> 172.21.15.81:0/2840820226 conn(0x7fc96806bb90 msgr2=0x7fc968068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:08.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f1ec5458700 1 -- 172.21.15.81:0/3812436691 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1eac066f30 msgr2=0x7f1eac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:08.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f1ec5458700 1 --2- 172.21.15.81:0/3812436691 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1eac066f30 0x7f1eac0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40099b0 tx=0x7f1eb4016000 comp rx=0 tx=0).stop 2023-10-07T08:43:08.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f1ec5458700 1 -- 172.21.15.81:0/3812436691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ec00d38f0 msgr2=0x7f1ec0163a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:08.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f1ec5458700 1 --2- 172.21.15.81:0/3812436691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ec00d38f0 0x7f1ec0163a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000b5e0 tx=0x7f1eb00090f0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f80e9706700 1 -- 172.21.15.81:0/1676621383 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80d0066f30 msgr2=0x7f80d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:08.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f80e9706700 1 --2- 172.21.15.81:0/1676621383 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80d0066f30 0x7f80d00693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f80e408b420 tx=0x7f80d4008040 comp rx=0 tx=0).stop 2023-10-07T08:43:08.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f80e9706700 1 -- 172.21.15.81:0/1676621383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80e415caf0 msgr2=0x7f80e4176c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:08.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f80e9706700 1 --2- 172.21.15.81:0/1676621383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80e415caf0 0x7f80e4176c20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00c050 tx=0x7f80dc016000 comp rx=0 tx=0).stop 2023-10-07T08:43:08.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f1ec5458700 1 -- 172.21.15.81:0/3812436691 shutdown_connections 2023-10-07T08:43:08.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f1ec5458700 1 --2- 172.21.15.81:0/3812436691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ec0156400 0x7f1ec0156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f1ec5458700 1 --2- 172.21.15.81:0/3812436691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ec006d870 0x7f1ec008c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f1ec5458700 1 --2- 172.21.15.81:0/3812436691 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1eac066f30 0x7f1eac0693e0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40099b0 tx=0x7f1eb4016000 comp rx=0 tx=0).stop 2023-10-07T08:43:08.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f1ec5458700 1 --2- 172.21.15.81:0/3812436691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ec00d38f0 0x7f1ec0163a50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f1ec5458700 1 -- 172.21.15.81:0/3812436691 >> 172.21.15.81:0/3812436691 conn(0x7f1ec006bb90 msgr2=0x7f1ec01594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:08.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f7275da6700 1 -- 172.21.15.81:0/3938392978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7250005830 con 0x7f72700cdc90 2023-10-07T08:43:08.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7fc947fff700 1 -- 172.21.15.81:0/2840820226 shutdown_connections 2023-10-07T08:43:08.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7fc947fff700 1 -- 172.21.15.81:0/2840820226 wait complete. 2023-10-07T08:43:08.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f1ec5458700 1 -- 172.21.15.81:0/3812436691 shutdown_connections 2023-10-07T08:43:08.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.169+0000 7f1ec5458700 1 -- 172.21.15.81:0/3812436691 wait complete. 2023-10-07T08:43:08.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7ff290309700 1 -- 172.21.15.81:0/2568279339 shutdown_connections 2023-10-07T08:43:08.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7ff290309700 1 --2- 172.21.15.81:0/2568279339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff288155c60 0x7ff2880c3f70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7ff290309700 1 --2- 172.21.15.81:0/2568279339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2880cb840 0x7ff2880c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7ff290309700 1 --2- 172.21.15.81:0/2568279339 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff26c067000 0x7ff26c0694b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7ff290309700 1 --2- 172.21.15.81:0/2568279339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2880cbc90 0x7ff2880c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7ff290309700 1 -- 172.21.15.81:0/2568279339 >> 172.21.15.81:0/2568279339 conn(0x7ff2880cc980 msgr2=0x7ff2880c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:08.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7f12b3dbc700 1 -- 172.21.15.81:0/399718518 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1290066f30 msgr2=0x7f12900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:08.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7f12b3dbc700 1 --2- 172.21.15.81:0/399718518 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1290066f30 0x7f12900693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f129c007ee0 tx=0x7f129c015000 comp rx=0 tx=0).stop 2023-10-07T08:43:08.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7f12b3dbc700 1 -- 172.21.15.81:0/399718518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12ac13de20 msgr2=0x7f12ac0c44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:08.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7f12b3dbc700 1 --2- 172.21.15.81:0/399718518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12ac13de20 0x7f12ac0c44f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f12a800d8a0 tx=0x7f12a8008040 comp rx=0 tx=0).stop 2023-10-07T08:43:08.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7f12b3dbc700 1 -- 172.21.15.81:0/399718518 shutdown_connections 2023-10-07T08:43:08.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7f12b3dbc700 1 --2- 172.21.15.81:0/399718518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12ac0c4a30 0x7f12ac13ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7f12b3dbc700 1 --2- 172.21.15.81:0/399718518 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1290066f30 0x7f12900693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7f12b3dbc700 1 --2- 172.21.15.81:0/399718518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1298003c20 0x7f12ac1522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7f12b3dbc700 1 --2- 172.21.15.81:0/399718518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12ac13de20 0x7f12ac0c44f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7f12b3dbc700 1 -- 172.21.15.81:0/399718518 >> 172.21.15.81:0/399718518 conn(0x7f12ac0cc980 msgr2=0x7f12ac15ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:08.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7ff290309700 1 -- 172.21.15.81:0/2568279339 shutdown_connections 2023-10-07T08:43:08.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7ff290309700 1 -- 172.21.15.81:0/2568279339 wait complete. 2023-10-07T08:43:08.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7f72577fe700 1 -- 172.21.15.81:0/3938392978 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7260056980 con 0x7f72700cdc90 2023-10-07T08:43:08.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7f12b3dbc700 1 -- 172.21.15.81:0/399718518 shutdown_connections 2023-10-07T08:43:08.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.170+0000 7f12b3dbc700 1 -- 172.21.15.81:0/399718518 wait complete. 2023-10-07T08:43:08.179 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-07T08:43:08.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.171+0000 7f80e9706700 1 -- 172.21.15.81:0/1676621383 shutdown_connections 2023-10-07T08:43:08.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.171+0000 7f80e9706700 1 --2- 172.21.15.81:0/1676621383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80e4177160 0x7f80e415b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.171+0000 7f80e9706700 1 --2- 172.21.15.81:0/1676621383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80cc004810 0x7f80e4174000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.171+0000 7f80e9706700 1 --2- 172.21.15.81:0/1676621383 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80d0066f30 0x7f80d00693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.171+0000 7f80e9706700 1 --2- 172.21.15.81:0/1676621383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80e415caf0 0x7f80e4176c20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.171+0000 7f80e9706700 1 -- 172.21.15.81:0/1676621383 >> 172.21.15.81:0/1676621383 conn(0x7f80e406bb90 msgr2=0x7f80e406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:08.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.173+0000 7f80e9706700 1 -- 172.21.15.81:0/1676621383 shutdown_connections 2023-10-07T08:43:08.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.173+0000 7f80e9706700 1 -- 172.21.15.81:0/1676621383 wait complete. 2023-10-07T08:43:08.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.174+0000 7f7275da6700 1 -- 172.21.15.81:0/3938392978 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f725c066f30 msgr2=0x7f725c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:08.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.174+0000 7f7275da6700 1 --2- 172.21.15.81:0/3938392978 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f725c066f30 0x7f725c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f726800f630 tx=0x7f726800b040 comp rx=0 tx=0).stop 2023-10-07T08:43:08.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.174+0000 7f7275da6700 1 -- 172.21.15.81:0/3938392978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72700cdc90 msgr2=0x7f727013a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:08.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.174+0000 7f7275da6700 1 --2- 172.21.15.81:0/3938392978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72700cdc90 0x7f727013a5f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7270068da0 tx=0x7f7260017000 comp rx=0 tx=0).stop 2023-10-07T08:43:08.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.174+0000 7f7275da6700 1 -- 172.21.15.81:0/3938392978 shutdown_connections 2023-10-07T08:43:08.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.174+0000 7f7275da6700 1 --2- 172.21.15.81:0/3938392978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72700cdc90 0x7f727013a5f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.174+0000 7f7275da6700 1 --2- 172.21.15.81:0/3938392978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72700acf60 0x7f72700aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.174+0000 7f7275da6700 1 --2- 172.21.15.81:0/3938392978 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f725c066f30 0x7f725c0693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.174+0000 7f7275da6700 1 --2- 172.21.15.81:0/3938392978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72700b0a00 0x7f72700afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.174+0000 7f7275da6700 1 -- 172.21.15.81:0/3938392978 >> 172.21.15.81:0/3938392978 conn(0x7f727006cca0 msgr2=0x7f727006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:08.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.175+0000 7f7275da6700 1 -- 172.21.15.81:0/3938392978 shutdown_connections 2023-10-07T08:43:08.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.175+0000 7f7275da6700 1 -- 172.21.15.81:0/3938392978 wait complete. 2023-10-07T08:43:08.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-07T08:43:08.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.188+0000 7f6bcc355700 1 -- 172.21.15.81:0/288698103 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6bc4067bc0 con 0x7f6bc40c1810 2023-10-07T08:43:08.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.189+0000 7f6bba7fc700 1 -- 172.21.15.81:0/288698103 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6bb40570d0 con 0x7f6bc40c1810 2023-10-07T08:43:08.194 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-07T08:43:08.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-07T08:43:08.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-07T08:43:08.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.194+0000 7f6bcc355700 1 -- 172.21.15.81:0/288698103 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ba8066f30 msgr2=0x7f6ba80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:08.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.194+0000 7f6bcc355700 1 --2- 172.21.15.81:0/288698103 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ba8066f30 0x7f6ba80693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4165790 tx=0x7f6bc0009060 comp rx=0 tx=0).stop 2023-10-07T08:43:08.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.194+0000 7f6bcc355700 1 -- 172.21.15.81:0/288698103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bc40c1810 msgr2=0x7f6bc40b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:08.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.194+0000 7f6bcc355700 1 --2- 172.21.15.81:0/288698103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bc40c1810 0x7f6bc40b2110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009290 tx=0x7f6bb4018000 comp rx=0 tx=0).stop 2023-10-07T08:43:08.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.194+0000 7f6bcc355700 1 -- 172.21.15.81:0/288698103 shutdown_connections 2023-10-07T08:43:08.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.194+0000 7f6bcc355700 1 --2- 172.21.15.81:0/288698103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bc40cb0f0 0x7f6bc41570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.194+0000 7f6bcc355700 1 --2- 172.21.15.81:0/288698103 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ba8066f30 0x7f6ba80693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.194+0000 7f6bcc355700 1 --2- 172.21.15.81:0/288698103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bc40c1810 0x7f6bc40b2110 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.194+0000 7f6bcc355700 1 --2- 172.21.15.81:0/288698103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc40c22f0 0x7f6bc4156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:08.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.194+0000 7f6bcc355700 1 -- 172.21.15.81:0/288698103 >> 172.21.15.81:0/288698103 conn(0x7f6bc406c660 msgr2=0x7f6bc40cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:08.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.195+0000 7f6bcc355700 1 -- 172.21.15.81:0/288698103 shutdown_connections 2023-10-07T08:43:08.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:08.195+0000 7f6bcc355700 1 -- 172.21.15.81:0/288698103 wait complete. 2023-10-07T08:43:08.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-07T08:43:08.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-07T08:43:08.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-07T08:43:08.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-10-07T08:43:08.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-10-07T08:43:09.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-07T08:43:09.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-07T08:43:09.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-07T08:43:09.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-07T08:43:09.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-07T08:43:09.203 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-07T08:43:09.203 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-07T08:43:09.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-07T08:43:09.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.358+0000 7f68c6ed7700 1 Processor -- start 2023-10-07T08:43:09.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.358+0000 7f68c6ed7700 1 -- start start 2023-10-07T08:43:09.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.359+0000 7f68c6ed7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0155c60 0x7f68c0156030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.359+0000 7f68c6ed7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c00ca550 con 0x7f68c00cbc90 2023-10-07T08:43:09.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.359+0000 7f68c6ed7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c00cb3b0 con 0x7f68c00cb840 2023-10-07T08:43:09.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.359+0000 7f68c6ed7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00ca7a0 con 0x7f68c0155c60 2023-10-07T08:43:09.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.360+0000 7f68bffff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f68c00cb840 0x7f68c00c8810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:55732/0 (socket says 172.21.15.81:55732) 2023-10-07T08:43:09.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.360+0000 7f68bffff700 1 -- 172.21.15.81:0/2070248868 learned_addr learned my addr 172.21.15.81:0/2070248868 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:09.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.360+0000 7f68c4c73700 1 --2- 172.21.15.81:0/2070248868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0155c60 0x7f68c0156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.360+0000 7f68c4c73700 1 -- 172.21.15.81:0/2070248868 >> v1:172.21.15.89:6789/0 conn(0x7f68c00cb840 legacy=0x7f68c00c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.360+0000 7f68c4c73700 1 -- 172.21.15.81:0/2070248868 >> v1:172.21.15.81:6789/0 conn(0x7f68c00cbc90 legacy=0x7f68c0159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:09.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.360+0000 7f68c4c73700 1 -- 172.21.15.81:0/2070248868 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00caa80 con 0x7f68c0155c60 2023-10-07T08:43:09.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.361+0000 7f68c4c73700 1 --2- 172.21.15.81:0/2070248868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0155c60 0x7f68c0156030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68b000bbb0 tx=0x7f68b000b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=225881f1b814cad6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.362+0000 7f68bf7fe700 1 -- 172.21.15.81:0/2070248868 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b000dba0 con 0x7f68c0155c60 2023-10-07T08:43:09.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.362+0000 7f68bf7fe700 1 -- 172.21.15.81:0/2070248868 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b000dd00 con 0x7f68c0155c60 2023-10-07T08:43:09.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.362+0000 7f68bf7fe700 1 -- 172.21.15.81:0/2070248868 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b00106b0 con 0x7f68c0155c60 2023-10-07T08:43:09.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.363+0000 7f68c6ed7700 1 -- 172.21.15.81:0/2070248868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0155c60 msgr2=0x7f68c0156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.363+0000 7f68c6ed7700 1 --2- 172.21.15.81:0/2070248868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0155c60 0x7f68c0156030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68b000bbb0 tx=0x7f68b000b420 comp rx=0 tx=0).stop 2023-10-07T08:43:09.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.366+0000 7f68c6ed7700 1 -- 172.21.15.81:0/2070248868 shutdown_connections 2023-10-07T08:43:09.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.366+0000 7f68c6ed7700 1 --2- 172.21.15.81:0/2070248868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0155c60 0x7f68c0156030 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.366+0000 7f68c6ed7700 1 -- 172.21.15.81:0/2070248868 >> 172.21.15.81:0/2070248868 conn(0x7f68c00cc980 msgr2=0x7f68c00ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:09.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.366+0000 7f68c6ed7700 1 -- 172.21.15.81:0/2070248868 shutdown_connections 2023-10-07T08:43:09.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.366+0000 7f68c6ed7700 1 -- 172.21.15.81:0/2070248868 wait complete. 2023-10-07T08:43:09.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.368+0000 7f68c6ed7700 1 Processor -- start 2023-10-07T08:43:09.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.368+0000 7f68c6ed7700 1 -- start start 2023-10-07T08:43:09.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.369+0000 7f68c6ed7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68c00cb840 0x7f68c0145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.369+0000 7f68c6ed7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c00cbc90 0x7f68c014fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.369+0000 7f68c6ed7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0155c60 0x7f68c014ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.369+0000 7f68c6ed7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c014a520 con 0x7f68c00cbc90 2023-10-07T08:43:09.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.369+0000 7f68c6ed7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0149910 con 0x7f68c00cb840 2023-10-07T08:43:09.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.369+0000 7f68c6ed7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0149bf0 con 0x7f68c0155c60 2023-10-07T08:43:09.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.370+0000 7f68c5474700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0155c60 0x7f68c014ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.370+0000 7f68c4c73700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68c00cb840 0x7f68c0145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.370+0000 7f68c4c73700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68c00cb840 0x7f68c0145c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:39172/0 (socket says 172.21.15.81:39172) 2023-10-07T08:43:09.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.370+0000 7f68c4c73700 1 -- 172.21.15.81:0/3072318782 learned_addr learned my addr 172.21.15.81:0/3072318782 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:09.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.370+0000 7f68bffff700 1 --2- 172.21.15.81:0/3072318782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c00cbc90 0x7f68c014fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.371+0000 7f68c4c73700 1 -- 172.21.15.81:0/3072318782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0155c60 msgr2=0x7f68c014ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.371+0000 7f68c4c73700 1 --2- 172.21.15.81:0/3072318782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0155c60 0x7f68c014ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.371+0000 7f68c4c73700 1 -- 172.21.15.81:0/3072318782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c00cbc90 msgr2=0x7f68c014fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.371+0000 7f68c4c73700 1 --2- 172.21.15.81:0/3072318782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c00cbc90 0x7f68c014fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.371+0000 7f68c4c73700 1 -- 172.21.15.81:0/3072318782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b000b6c0 con 0x7f68c00cb840 2023-10-07T08:43:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.376+0000 7f68c4c73700 1 --2- 172.21.15.81:0/3072318782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68c00cb840 0x7f68c0145c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f68b000b460 tx=0x7f68b001b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.380+0000 7f68bcff9700 1 -- 172.21.15.81:0/3072318782 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0006ad0 con 0x7f68c00cb840 2023-10-07T08:43:09.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.380+0000 7f68bcff9700 1 -- 172.21.15.81:0/3072318782 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b0006c30 con 0x7f68c00cb840 2023-10-07T08:43:09.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.380+0000 7f68bcff9700 1 -- 172.21.15.81:0/3072318782 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b001b680 con 0x7f68c00cb840 2023-10-07T08:43:09.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.380+0000 7f68c6ed7700 1 -- 172.21.15.81:0/3072318782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c0149ed0 con 0x7f68c00cb840 2023-10-07T08:43:09.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.380+0000 7f68c6ed7700 1 -- 172.21.15.81:0/3072318782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c016ead0 con 0x7f68c00cb840 2023-10-07T08:43:09.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.384+0000 7f68bcff9700 1 -- 172.21.15.81:0/3072318782 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68b0018030 con 0x7f68c00cb840 2023-10-07T08:43:09.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.385+0000 7f68bcff9700 1 --2- 172.21.15.81:0/3072318782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f68ac067080 0x7f68ac069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.385+0000 7f68bcff9700 1 -- 172.21.15.81:0/3072318782 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f68b0016070 con 0x7f68c00cb840 2023-10-07T08:43:09.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.387+0000 7f68bffff700 1 --2- 172.21.15.81:0/3072318782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f68ac067080 0x7f68ac069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.387+0000 7f68c6ed7700 1 -- 172.21.15.81:0/3072318782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a00052b0 con 0x7f68c00cb840 2023-10-07T08:43:09.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.387+0000 7f68bffff700 1 --2- 172.21.15.81:0/3072318782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f68ac067080 0x7f68ac069530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f68c014eac0 tx=0x7f68b8006450 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.393+0000 7f68bcff9700 1 -- 172.21.15.81:0/3072318782 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68b0052ed0 con 0x7f68c00cb840 2023-10-07T08:43:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.423+0000 7fef65c9d700 1 Processor -- start 2023-10-07T08:43:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.423+0000 7fef65c9d700 1 -- start start 2023-10-07T08:43:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.423+0000 7fef65c9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef600c8190 0x7fef60161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.423+0000 7fef65c9d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef600698b0 con 0x7fef6013ffe0 2023-10-07T08:43:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.423+0000 7fef65c9d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef600692a0 con 0x7fef6013fc10 2023-10-07T08:43:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.423+0000 7fef65c9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6006d180 con 0x7fef600c8190 2023-10-07T08:43:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.424+0000 7fdf7e47f700 1 Processor -- start 2023-10-07T08:43:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.424+0000 7fef5f7fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fef6013fc10 0x7fef6006c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:55748/0 (socket says 172.21.15.81:55748) 2023-10-07T08:43:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.424+0000 7fef5f7fe700 1 -- 172.21.15.81:0/3664026790 learned_addr learned my addr 172.21.15.81:0/3664026790 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.424+0000 7fef5ffff700 1 --2- 172.21.15.81:0/3664026790 >> v2:172.21.15.81:3300/0 conn(0x7fef600c8190 0x7fef60161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.425+0000 7fef5ffff700 1 -- 172.21.15.81:0/3664026790 >> v1:172.21.15.89:6789/0 conn(0x7fef6013fc10 legacy=0x7fef6006c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.425+0000 7fef5ffff700 1 -- 172.21.15.81:0/3664026790 >> v1:172.21.15.81:6789/0 conn(0x7fef6013ffe0 legacy=0x7fef600c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.425+0000 7fef5ffff700 1 -- 172.21.15.81:0/3664026790 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef60069540 con 0x7fef600c8190 2023-10-07T08:43:09.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.425+0000 7fef5ffff700 1 --2- 172.21.15.81:0/3664026790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef600c8190 0x7fef60161000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fef58009e60 tx=0x7fef58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a89e930fe33411a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.424+0000 7fdf7e47f700 1 -- start start 2023-10-07T08:43:09.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.425+0000 7fdf7e47f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdf7815e230 0x7fdf780c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.425+0000 7fdf7e47f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf7815e600 0x7fdf78069120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.425+0000 7fdf7e47f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf780cc620 0x7fdf780ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.425+0000 7fdf7e47f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf780ccfe0 con 0x7fdf780cc620 2023-10-07T08:43:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.425+0000 7fdf7e47f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7806c520 con 0x7fdf7815e230 2023-10-07T08:43:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.425+0000 7fdf7e47f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7806bc30 con 0x7fdf7815e600 2023-10-07T08:43:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.425+0000 7fdf77fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdf7815e230 0x7fdf780c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.425+0000 7fdf7ca1c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf780cc620 0x7fdf780ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.425+0000 7fdf777fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf7815e600 0x7fdf78069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7fdf7ca1c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf780cc620 0x7fdf780ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45110/0 (socket says 172.21.15.81:45110) 2023-10-07T08:43:09.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7fdf7ca1c700 1 -- 172.21.15.81:0/3249642194 learned_addr learned my addr 172.21.15.81:0/3249642194 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:09.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7fdf77fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdf7815e230 0x7fdf780c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:39176/0 (socket says 172.21.15.81:39176) 2023-10-07T08:43:09.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7fdf77fff700 1 -- 172.21.15.81:0/3249642194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf7815e600 msgr2=0x7fdf78069120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:09.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7fdf77fff700 1 --2- 172.21.15.81:0/3249642194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf7815e600 0x7fdf78069120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7fdf77fff700 1 -- 172.21.15.81:0/3249642194 >> v2:172.21.15.81:3300/0 conn(0x7fdf780cc620 msgr2=0x7fdf780ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:09.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7fdf77fff700 1 --2- 172.21.15.81:0/3249642194 >> v2:172.21.15.81:3300/0 conn(0x7fdf780cc620 0x7fdf780ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7fef5e7fc700 1 -- 172.21.15.81:0/3664026790 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5800e070 con 0x7fef600c8190 2023-10-07T08:43:09.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7fef5e7fc700 1 -- 172.21.15.81:0/3664026790 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5800bc30 con 0x7fef600c8190 2023-10-07T08:43:09.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7fef5e7fc700 1 -- 172.21.15.81:0/3664026790 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58012430 con 0x7fef600c8190 2023-10-07T08:43:09.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7fdf77fff700 1 -- 172.21.15.81:0/3249642194 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7806bed0 con 0x7fdf7815e230 2023-10-07T08:43:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7f696062f700 1 Processor -- start 2023-10-07T08:43:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7f890d516700 1 Processor -- start 2023-10-07T08:43:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7f890d516700 1 -- start start 2023-10-07T08:43:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.425+0000 7f5cf4eb8700 1 Processor -- start 2023-10-07T08:43:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.425+0000 7f5cf4eb8700 1 -- start start 2023-10-07T08:43:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7f5cf4eb8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5cf006f580 0x7f5cf00caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7f5cf4eb8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf006d220 con 0x7f5cf00692a0 2023-10-07T08:43:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7f5cf4eb8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf006d500 con 0x7f5cf006f950 2023-10-07T08:43:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7f5cf4eb8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00cb7b0 con 0x7f5cf006f580 2023-10-07T08:43:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7fdf77fff700 1 --2- 172.21.15.81:0/3249642194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf7815e230 0x7fdf780c9360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdf780c4290 tx=0x7fdf6c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cf7bc5fa504004e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7f5cedd9b700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5cf006f950 0x7f5cf0068b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:55754/0 (socket says 172.21.15.81:55754) 2023-10-07T08:43:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7f5cedd9b700 1 -- 172.21.15.81:0/176626013 learned_addr learned my addr 172.21.15.81:0/176626013 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7f5cee59c700 1 --2- 172.21.15.81:0/176626013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5cf006f580 0x7f5cf00caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7fdf76ffd700 1 -- 172.21.15.81:0/3249642194 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c011630 con 0x7fdf7815e230 2023-10-07T08:43:09.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7fdf76ffd700 1 -- 172.21.15.81:0/3249642194 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c0117b0 con 0x7fdf7815e230 2023-10-07T08:43:09.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.427+0000 7fdf76ffd700 1 -- 172.21.15.81:0/3249642194 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c011b70 con 0x7fdf7815e230 2023-10-07T08:43:09.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.427+0000 7fef65c9d700 1 -- 172.21.15.81:0/3664026790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef600c8190 msgr2=0x7fef60161000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.427+0000 7fef65c9d700 1 --2- 172.21.15.81:0/3664026790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef600c8190 0x7fef60161000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fef58009e60 tx=0x7fef58009780 comp rx=0 tx=0).stop 2023-10-07T08:43:09.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.427+0000 7ff3f198c700 1 Processor -- start 2023-10-07T08:43:09.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.427+0000 7ff3f198c700 1 -- start start 2023-10-07T08:43:09.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.427+0000 7f890d516700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f890806d220 0x7f890806d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.427+0000 7fdf7e47f700 1 -- 172.21.15.81:0/3249642194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf7815e230 msgr2=0x7fdf780c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.427+0000 7fdf7e47f700 1 --2- 172.21.15.81:0/3249642194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf7815e230 0x7fdf780c9360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdf780c4290 tx=0x7fdf6c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.427+0000 7f890d516700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89080691e0 con 0x7f89081414f0 2023-10-07T08:43:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.427+0000 7f890d516700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89080cba20 con 0x7f8908069670 2023-10-07T08:43:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.427+0000 7f890d516700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f890806dc00 con 0x7f890806d220 2023-10-07T08:43:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.426+0000 7f696062f700 1 -- start start 2023-10-07T08:43:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.427+0000 7f696062f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69580cdc90 0x7f69580ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.427+0000 7f696062f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69581625c0 con 0x7f69580acf60 2023-10-07T08:43:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.427+0000 7f696062f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6958162dc0 con 0x7f69580b0a00 2023-10-07T08:43:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.427+0000 7f696062f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695815f8d0 con 0x7f69580cdc90 2023-10-07T08:43:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f5ced59a700 1 -- 172.21.15.81:0/176626013 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2089753212 0 0) 0x7f5cf006d500 con 0x7f5cf006f950 2023-10-07T08:43:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f5ced59a700 1 -- 172.21.15.81:0/176626013 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd8003570 con 0x7f5cf006f950 2023-10-07T08:43:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f89067fc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f890806d220 0x7f890806d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f89067fc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f890806d220 0x7f890806d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:39186/0 (socket says 172.21.15.81:39186) 2023-10-07T08:43:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f89067fc700 1 -- 172.21.15.81:0/3323621052 learned_addr learned my addr 172.21.15.81:0/3323621052 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f695dbca700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f69580b0a00 0x7f6958161eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:55776/0 (socket says 172.21.15.81:55776) 2023-10-07T08:43:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f695dbca700 1 -- 172.21.15.81:0/169233284 learned_addr learned my addr 172.21.15.81:0/169233284 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:09.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f5cee59c700 1 -- 172.21.15.81:0/176626013 >> v1:172.21.15.89:6789/0 conn(0x7f5cf006f950 legacy=0x7f5cf0068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f5cee59c700 1 -- 172.21.15.81:0/176626013 >> v1:172.21.15.81:6789/0 conn(0x7f5cf00692a0 legacy=0x7f5cf006d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:09.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f5cee59c700 1 -- 172.21.15.81:0/176626013 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf00cba90 con 0x7f5cf006f580 2023-10-07T08:43:09.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f89067fc700 1 -- 172.21.15.81:0/3323621052 >> v1:172.21.15.89:6789/0 conn(0x7f8908069670 legacy=0x7f8908069a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f89067fc700 1 -- 172.21.15.81:0/3323621052 >> v1:172.21.15.81:6789/0 conn(0x7f89081414f0 legacy=0x7f89080caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f89067fc700 1 -- 172.21.15.81:0/3323621052 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89080cbd00 con 0x7f890806d220 2023-10-07T08:43:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7fdf7e47f700 1 -- 172.21.15.81:0/3249642194 shutdown_connections 2023-10-07T08:43:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7fdf7e47f700 1 --2- 172.21.15.81:0/3249642194 >> v2:172.21.15.81:3300/0 conn(0x7fdf780cc620 0x7fdf780ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7fdf7e47f700 1 --2- 172.21.15.81:0/3249642194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf7815e230 0x7fdf780c9360 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7fdf7e47f700 1 --2- 172.21.15.81:0/3249642194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf7815e600 0x7fdf78069120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7fdf7e47f700 1 -- 172.21.15.81:0/3249642194 >> 172.21.15.81:0/3249642194 conn(0x7fdf780c9ca0 msgr2=0x7fdf780ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f5cee59c700 1 --2- 172.21.15.81:0/176626013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5cf006f580 0x7f5cf00caf30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000bbb0 tx=0x7f5ce000b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=156cdec56777cd38 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f695ebcc700 1 --2- 172.21.15.81:0/169233284 >> v2:172.21.15.81:3300/0 conn(0x7f69580cdc90 0x7f69580ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f695d3c9700 1 -- 172.21.15.81:0/169233284 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877007936 0 0) 0x7f6958162dc0 con 0x7f69580b0a00 2023-10-07T08:43:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f695d3c9700 1 -- 172.21.15.81:0/169233284 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6944003570 con 0x7f69580b0a00 2023-10-07T08:43:09.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7fdf7e47f700 1 -- 172.21.15.81:0/3249642194 shutdown_connections 2023-10-07T08:43:09.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7fef65c9d700 1 -- 172.21.15.81:0/3664026790 shutdown_connections 2023-10-07T08:43:09.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7fef65c9d700 1 --2- 172.21.15.81:0/3664026790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef600c8190 0x7fef60161000 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7fef65c9d700 1 -- 172.21.15.81:0/3664026790 >> 172.21.15.81:0/3664026790 conn(0x7fef600c9ca0 msgr2=0x7fef600ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:09.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7fef65c9d700 1 -- 172.21.15.81:0/3664026790 shutdown_connections 2023-10-07T08:43:09.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7fef65c9d700 1 -- 172.21.15.81:0/3664026790 wait complete. 2023-10-07T08:43:09.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f89067fc700 1 --2- 172.21.15.81:0/3323621052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f890806d220 0x7f890806d6c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0099b0 tx=0x7f88fc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7ae35f5ddfb96c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f8905ffb700 1 -- 172.21.15.81:0/3323621052 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc00b820 con 0x7f890806d220 2023-10-07T08:43:09.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f8905ffb700 1 -- 172.21.15.81:0/3323621052 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88fc00b980 con 0x7f890806d220 2023-10-07T08:43:09.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f8905ffb700 1 -- 172.21.15.81:0/3323621052 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc00bd20 con 0x7f890806d220 2023-10-07T08:43:09.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f695d3c9700 1 -- 172.21.15.81:0/169233284 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878652310 0 0) 0x7f6950001490 con 0x7f69580acf60 2023-10-07T08:43:09.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f695d3c9700 1 -- 172.21.15.81:0/169233284 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6958162dc0 con 0x7f69580acf60 2023-10-07T08:43:09.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f695d3c9700 1 -- 172.21.15.81:0/169233284 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2874874102 0 0) 0x7f6958162dc0 con 0x7f69580acf60 2023-10-07T08:43:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f695d3c9700 1 -- 172.21.15.81:0/169233284 >> v2:172.21.15.81:3300/0 conn(0x7f69580cdc90 msgr2=0x7f69580ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f695d3c9700 1 --2- 172.21.15.81:0/169233284 >> v2:172.21.15.81:3300/0 conn(0x7f69580cdc90 0x7f69580ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f695d3c9700 1 -- 172.21.15.81:0/169233284 >> v1:172.21.15.89:6789/0 conn(0x7f69580b0a00 legacy=0x7f6958161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f695d3c9700 1 -- 172.21.15.81:0/169233284 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69580ce600 con 0x7f69580acf60 2023-10-07T08:43:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f695d3c9700 1 -- 172.21.15.81:0/169233284 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f6950001980 con 0x7f69580acf60 2023-10-07T08:43:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f695d3c9700 1 -- 172.21.15.81:0/169233284 >> v1:172.21.15.81:6789/0 conn(0x7f69580acf60 legacy=0x7f695815f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f695d3c9700 1 --2- 172.21.15.81:0/169233284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6944003bf0 0x7f6944003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f695d3c9700 1 --2- 172.21.15.81:0/169233284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6944004810 0x7f6944004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f695d3c9700 1 --2- 172.21.15.81:0/169233284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69440051c0 0x7f694400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f695d3c9700 1 -- 172.21.15.81:0/169233284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695815f8d0 con 0x7f69440051c0 2023-10-07T08:43:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f695d3c9700 1 -- 172.21.15.81:0/169233284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694400c0b0 con 0x7f6944004810 2023-10-07T08:43:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f695d3c9700 1 -- 172.21.15.81:0/169233284 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694400c270 con 0x7f6944003bf0 2023-10-07T08:43:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f695ebcc700 1 --2- 172.21.15.81:0/169233284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69440051c0 0x7f694400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7ff3f198c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff3ec0cb730 0x7ff3ec0690e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7ff3f198c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3ec06a2f0 con 0x7ff3ec159ca0 2023-10-07T08:43:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7ff3f198c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3ec0c9010 con 0x7ff3ec15a070 2023-10-07T08:43:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7ff3f198c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ec0696e0 con 0x7ff3ec0cb730 2023-10-07T08:43:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7ff3eaffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff3ec159ca0 0x7ff3ec0c8900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59468/0 (socket says 172.21.15.81:59468) 2023-10-07T08:43:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7ff3eaffd700 1 -- 172.21.15.81:0/181023820 learned_addr learned my addr 172.21.15.81:0/181023820 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f9fb395f700 1 Processor -- start 2023-10-07T08:43:09.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f9fb395f700 1 -- start start 2023-10-07T08:43:09.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f695e3cb700 1 --2- 172.21.15.81:0/169233284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6944003bf0 0x7f6944003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7ff3e9ffb700 1 -- 172.21.15.81:0/181023820 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677582697 0 0) 0x7ff3ec06a2f0 con 0x7ff3ec159ca0 2023-10-07T08:43:09.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7ff3e9ffb700 1 -- 172.21.15.81:0/181023820 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3d4003570 con 0x7ff3ec159ca0 2023-10-07T08:43:09.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f5ced59a700 1 -- 172.21.15.81:0/176626013 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce000daf0 con 0x7f5cf006f580 2023-10-07T08:43:09.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f5ced59a700 1 -- 172.21.15.81:0/176626013 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce000dc50 con 0x7f5cf006f580 2023-10-07T08:43:09.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7f5ced59a700 1 -- 172.21.15.81:0/176626013 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0010460 con 0x7f5cf006f580 2023-10-07T08:43:09.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f5cf4eb8700 1 -- 172.21.15.81:0/176626013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5cf006f580 msgr2=0x7f5cf00caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.429+0000 7f5cf4eb8700 1 --2- 172.21.15.81:0/176626013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5cf006f580 0x7f5cf00caf30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000bbb0 tx=0x7f5ce000b420 comp rx=0 tx=0).stop 2023-10-07T08:43:09.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f5cf4eb8700 1 -- 172.21.15.81:0/176626013 shutdown_connections 2023-10-07T08:43:09.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f5cf4eb8700 1 --2- 172.21.15.81:0/176626013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5cf006f580 0x7f5cf00caf30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f5cf4eb8700 1 -- 172.21.15.81:0/176626013 >> 172.21.15.81:0/176626013 conn(0x7f5cf00cc980 msgr2=0x7f5cf00ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:09.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f5cf4eb8700 1 -- 172.21.15.81:0/176626013 shutdown_connections 2023-10-07T08:43:09.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f5cf4eb8700 1 -- 172.21.15.81:0/176626013 wait complete. 2023-10-07T08:43:09.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7ff3e9ffb700 1 -- 172.21.15.81:0/181023820 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2437248575 0 0) 0x7ff3d4003570 con 0x7ff3ec159ca0 2023-10-07T08:43:09.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7ff3e9ffb700 1 -- 172.21.15.81:0/181023820 >> v2:172.21.15.89:3300/0 conn(0x7ff3ec0cb730 msgr2=0x7ff3ec0690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:09.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7ff3e9ffb700 1 --2- 172.21.15.81:0/181023820 >> v2:172.21.15.89:3300/0 conn(0x7ff3ec0cb730 0x7ff3ec0690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7ff3e9ffb700 1 -- 172.21.15.81:0/181023820 >> v1:172.21.15.89:6789/0 conn(0x7ff3ec15a070 legacy=0x7ff3ec0cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.428+0000 7fdf7e47f700 1 -- 172.21.15.81:0/3249642194 wait complete. 2023-10-07T08:43:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7ff3e9ffb700 1 -- 172.21.15.81:0/181023820 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ec0699c0 con 0x7ff3ec159ca0 2023-10-07T08:43:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7ff3e9ffb700 1 -- 172.21.15.81:0/181023820 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7ff3dc001470 con 0x7ff3ec159ca0 2023-10-07T08:43:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7ff3e9ffb700 1 -- 172.21.15.81:0/181023820 >> v1:172.21.15.81:6789/0 conn(0x7ff3ec159ca0 legacy=0x7ff3ec0c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7ff3e9ffb700 1 --2- 172.21.15.81:0/181023820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3d4003b30 0x7ff3d4003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7ff3e9ffb700 1 --2- 172.21.15.81:0/181023820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3d4004810 0x7ff3d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7ff3e9ffb700 1 --2- 172.21.15.81:0/181023820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3d4005410 0x7ff3d40142d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7fdf7e47f700 1 Processor -- start 2023-10-07T08:43:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7ff3e9ffb700 1 -- 172.21.15.81:0/181023820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec0696e0 con 0x7ff3d4005410 2023-10-07T08:43:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7ff3e9ffb700 1 -- 172.21.15.81:0/181023820 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d4014b10 con 0x7ff3d4004810 2023-10-07T08:43:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7ff3e9ffb700 1 -- 172.21.15.81:0/181023820 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d4014cd0 con 0x7ff3d4003b30 2023-10-07T08:43:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7ff3eaffd700 1 --2- 172.21.15.81:0/181023820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3d4003b30 0x7ff3d4003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f9fb395f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fac15daa0 0x7f9fac15de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f9fb395f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9fac0cb270 0x7f9fac159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f9fb395f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fac06d350 con 0x7f9fac0cae00 2023-10-07T08:43:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f9fb395f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac0c9ac0 con 0x7f9fac0cb270 2023-10-07T08:43:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f9fb395f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac15e3b0 con 0x7f9fac15daa0 2023-10-07T08:43:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7fef65c9d700 1 Processor -- start 2023-10-07T08:43:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f695ebcc700 1 -- 172.21.15.81:0/169233284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6944003bf0 msgr2=0x7f6944003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f695ebcc700 1 --2- 172.21.15.81:0/169233284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6944003bf0 0x7f6944003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f695ebcc700 1 -- 172.21.15.81:0/169233284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6944004810 msgr2=0x7f6944004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f695ebcc700 1 --2- 172.21.15.81:0/169233284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6944004810 0x7f6944004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f695ebcc700 1 -- 172.21.15.81:0/169233284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69580ce600 con 0x7f69440051c0 2023-10-07T08:43:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f695ebcc700 1 -- 172.21.15.81:0/169233284 reap_dead start 2023-10-07T08:43:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7fef65c9d700 1 -- start start 2023-10-07T08:43:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f890d516700 1 -- 172.21.15.81:0/3323621052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f890806d220 msgr2=0x7f890806d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7f890d516700 1 --2- 172.21.15.81:0/3323621052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f890806d220 0x7f890806d6c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0099b0 tx=0x7f88fc009250 comp rx=0 tx=0).stop 2023-10-07T08:43:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7f890d516700 1 -- 172.21.15.81:0/3323621052 shutdown_connections 2023-10-07T08:43:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7f890d516700 1 --2- 172.21.15.81:0/3323621052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f890806d220 0x7f890806d6c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7f890d516700 1 -- 172.21.15.81:0/3323621052 >> 172.21.15.81:0/3323621052 conn(0x7f89080cc980 msgr2=0x7f89080ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7f9fb1efc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9fac0cb270 0x7f9fac159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7f9fb1efc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9fac0cb270 0x7f9fac159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:39206/0 (socket says 172.21.15.81:39206) 2023-10-07T08:43:09.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7f9fb1efc700 1 -- 172.21.15.81:0/1168862390 learned_addr learned my addr 172.21.15.81:0/1168862390 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:09.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7f695ebcc700 1 --2- 172.21.15.81:0/169233284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69440051c0 0x7f694400ba60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6954009be0 tx=0x7f69540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad8f604c89c09a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7ff3eaffd700 1 -- 172.21.15.81:0/181023820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3d4004810 msgr2=0x7ff3d4004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-07T08:43:09.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7ff3eaffd700 1 --2- 172.21.15.81:0/181023820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3d4004810 0x7ff3d4004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7ff3eaffd700 1 -- 172.21.15.81:0/181023820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3d4005410 msgr2=0x7ff3d40142d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:09.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7ff3eaffd700 1 --2- 172.21.15.81:0/181023820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3d4005410 0x7ff3d40142d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7ff3eaffd700 1 -- 172.21.15.81:0/181023820 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d4003570 con 0x7ff3d4003b30 2023-10-07T08:43:09.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7ff3eb7fe700 1 -- 172.21.15.81:0/181023820 reap_dead start 2023-10-07T08:43:09.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7f9fb1efc700 1 -- 172.21.15.81:0/1168862390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fac15daa0 msgr2=0x7f9fac15de70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T08:43:09.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7f9fb1efc700 1 --2- 172.21.15.81:0/1168862390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fac15daa0 0x7f9fac15de70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7f9fb1efc700 1 -- 172.21.15.81:0/1168862390 >> v1:172.21.15.89:6789/0 conn(0x7f9fac0cae00 legacy=0x7f9fac159540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-07T08:43:09.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7f9fb1efc700 1 -- 172.21.15.81:0/1168862390 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac06c740 con 0x7f9fac0cb270 2023-10-07T08:43:09.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7ff3eaffd700 1 --2- 172.21.15.81:0/181023820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3d4003b30 0x7ff3d4003f20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c2d0 tx=0x7ff3dc001dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e42dde26edf3a6d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7f695d3c9700 1 -- 172.21.15.81:0/169233284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695400e710 con 0x7f69440051c0 2023-10-07T08:43:09.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef65c9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef600c8190 0x7fef600ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef65c9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef6013fc10 0x7fef6013e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef65c9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef6013ffe0 0x7fef600b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef65c9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef600b1840 con 0x7fef6013fc10 2023-10-07T08:43:09.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef65c9d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef600ae300 con 0x7fef600c8190 2023-10-07T08:43:09.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef65c9d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef600b1180 con 0x7fef6013ffe0 2023-10-07T08:43:09.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef5f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef600c8190 0x7fef600ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef5f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef600c8190 0x7fef600ada20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:39234/0 (socket says 172.21.15.81:39234) 2023-10-07T08:43:09.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef5f7fe700 1 -- 172.21.15.81:0/2551645436 learned_addr learned my addr 172.21.15.81:0/2551645436 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:09.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef5ffff700 1 --2- 172.21.15.81:0/2551645436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef6013ffe0 0x7fef600b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef5effd700 1 --2- 172.21.15.81:0/2551645436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef6013fc10 0x7fef6013e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7f695d3c9700 1 -- 172.21.15.81:0/169233284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695400e870 con 0x7f69440051c0 2023-10-07T08:43:09.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7f695d3c9700 1 -- 172.21.15.81:0/169233284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695400ec30 con 0x7f69440051c0 2023-10-07T08:43:09.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7f696062f700 1 -- 172.21.15.81:0/169233284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69440051c0 msgr2=0x7f694400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7f696062f700 1 --2- 172.21.15.81:0/169233284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69440051c0 0x7f694400ba60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6954009be0 tx=0x7f69540091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7f696062f700 1 -- 172.21.15.81:0/169233284 shutdown_connections 2023-10-07T08:43:09.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7f696062f700 1 --2- 172.21.15.81:0/169233284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69440051c0 0x7f694400ba60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7f696062f700 1 -- 172.21.15.81:0/169233284 >> 172.21.15.81:0/169233284 conn(0x7f695806cca0 msgr2=0x7f695806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:09.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7f5cf4eb8700 1 Processor -- start 2023-10-07T08:43:09.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7ff3e9ffb700 1 -- 172.21.15.81:0/181023820 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc00cba0 con 0x7ff3d4003b30 2023-10-07T08:43:09.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7ff3e9ffb700 1 -- 172.21.15.81:0/181023820 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc00cd40 con 0x7ff3d4003b30 2023-10-07T08:43:09.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7ff3e9ffb700 1 -- 172.21.15.81:0/181023820 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc005b70 con 0x7ff3d4003b30 2023-10-07T08:43:09.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7ff3f198c700 1 -- 172.21.15.81:0/181023820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3d4003b30 msgr2=0x7ff3d4003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7ff3f198c700 1 --2- 172.21.15.81:0/181023820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3d4003b30 0x7ff3d4003f20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c2d0 tx=0x7ff3dc001dc0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7ff3f198c700 1 -- 172.21.15.81:0/181023820 shutdown_connections 2023-10-07T08:43:09.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7ff3f198c700 1 --2- 172.21.15.81:0/181023820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3d4003b30 0x7ff3d4003f20 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c2d0 tx=0x7ff3dc001dc0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7ff3f198c700 1 -- 172.21.15.81:0/181023820 >> 172.21.15.81:0/181023820 conn(0x7ff3ec0cc980 msgr2=0x7ff3ec0ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:09.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7ff3f198c700 1 -- 172.21.15.81:0/181023820 shutdown_connections 2023-10-07T08:43:09.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7ff3f198c700 1 -- 172.21.15.81:0/181023820 wait complete. 2023-10-07T08:43:09.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7f9fb1efc700 1 --2- 172.21.15.81:0/1168862390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fac0cb270 0x7f9fac159c50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009f20 tx=0x7f9fa4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bba236b23ee4b9c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7f9fa3fff700 1 -- 172.21.15.81:0/1168862390 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa400e070 con 0x7f9fac0cb270 2023-10-07T08:43:09.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7f9fa3fff700 1 -- 172.21.15.81:0/1168862390 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa400ba40 con 0x7f9fac0cb270 2023-10-07T08:43:09.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7f9fa3fff700 1 -- 172.21.15.81:0/1168862390 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40092e0 con 0x7f9fac0cb270 2023-10-07T08:43:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.430+0000 7fdf7e47f700 1 -- start start 2023-10-07T08:43:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7fdf7e47f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf780cc620 0x7fdf78148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7fdf7e47f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf7815e230 0x7fdf780c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7fdf7e47f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf7815e600 0x7fdf781798e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7fdf7e47f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf781506d0 con 0x7fdf7815e600 2023-10-07T08:43:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7fdf7e47f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf780c7970 con 0x7fdf780cc620 2023-10-07T08:43:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.431+0000 7fdf7e47f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7814f7e0 con 0x7fdf7815e230 2023-10-07T08:43:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fdf77fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf780cc620 0x7fdf78148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fdf7ca1c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf7815e600 0x7fdf781798e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fdf77fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf780cc620 0x7fdf78148680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:39218/0 (socket says 172.21.15.81:39218) 2023-10-07T08:43:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fdf77fff700 1 -- 172.21.15.81:0/4182714239 learned_addr learned my addr 172.21.15.81:0/4182714239 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fdf7ca1c700 1 -- 172.21.15.81:0/4182714239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf7815e230 msgr2=0x7fdf780c7430 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-07T08:43:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fdf7ca1c700 1 --2- 172.21.15.81:0/4182714239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf7815e230 0x7fdf780c7430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fdf7ca1c700 1 -- 172.21.15.81:0/4182714239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf780cc620 msgr2=0x7fdf78148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fdf7ca1c700 1 --2- 172.21.15.81:0/4182714239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf780cc620 0x7fdf78148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fdf7ca1c700 1 -- 172.21.15.81:0/4182714239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c009420 con 0x7fdf7815e600 2023-10-07T08:43:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef5ffff700 1 -- 172.21.15.81:0/2551645436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef600c8190 msgr2=0x7fef600ada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef5ffff700 1 --2- 172.21.15.81:0/2551645436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef600c8190 0x7fef600ada20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef5ffff700 1 -- 172.21.15.81:0/2551645436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef6013fc10 msgr2=0x7fef6013e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef5ffff700 1 --2- 172.21.15.81:0/2551645436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef6013fc10 0x7fef6013e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef5ffff700 1 -- 172.21.15.81:0/2551645436 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef58009a20 con 0x7fef6013ffe0 2023-10-07T08:43:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fef5f7fe700 1 --2- 172.21.15.81:0/2551645436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef600c8190 0x7fef600ada20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f696062f700 1 -- 172.21.15.81:0/169233284 shutdown_connections 2023-10-07T08:43:09.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7fef5ffff700 1 --2- 172.21.15.81:0/2551645436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef6013ffe0 0x7fef600b1c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fef58016000 tx=0x7fef58019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7fdf7ca1c700 1 --2- 172.21.15.81:0/4182714239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf7815e600 0x7fdf781798e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdf70009e50 tx=0x7fdf7000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7fdf5ffff700 1 -- 172.21.15.81:0/4182714239 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7000c940 con 0x7fdf7815e600 2023-10-07T08:43:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7fdf5ffff700 1 -- 172.21.15.81:0/4182714239 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7000f040 con 0x7fdf7815e600 2023-10-07T08:43:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7fdf5ffff700 1 -- 172.21.15.81:0/4182714239 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7000ccf0 con 0x7fdf7815e600 2023-10-07T08:43:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7fef477fe700 1 -- 172.21.15.81:0/2551645436 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5801e630 con 0x7fef6013ffe0 2023-10-07T08:43:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f890d516700 1 -- 172.21.15.81:0/3323621052 shutdown_connections 2023-10-07T08:43:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7fef477fe700 1 -- 172.21.15.81:0/2551645436 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5801e7d0 con 0x7fef6013ffe0 2023-10-07T08:43:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7fef65c9d700 1 -- 172.21.15.81:0/2551645436 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef600b1460 con 0x7fef6013ffe0 2023-10-07T08:43:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7fef65c9d700 1 -- 172.21.15.81:0/2551645436 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6013ead0 con 0x7fef6013ffe0 2023-10-07T08:43:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7fef477fe700 1 -- 172.21.15.81:0/2551645436 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5801eb90 con 0x7fef6013ffe0 2023-10-07T08:43:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.435+0000 7fef65c9d700 1 -- 172.21.15.81:0/2551645436 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef400052b0 con 0x7fef6013ffe0 2023-10-07T08:43:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.435+0000 7fef477fe700 1 -- 172.21.15.81:0/2551645436 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef58024070 con 0x7fef6013ffe0 2023-10-07T08:43:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.435+0000 7fef477fe700 1 --2- 172.21.15.81:0/2551645436 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fef4c067000 0x7fef4c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.435+0000 7fef477fe700 1 -- 172.21.15.81:0/2551645436 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef58086cb0 con 0x7fef6013ffe0 2023-10-07T08:43:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.435+0000 7fef5f7fe700 1 --2- 172.21.15.81:0/2551645436 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fef4c067000 0x7fef4c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.436+0000 7fef5f7fe700 1 --2- 172.21.15.81:0/2551645436 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fef4c067000 0x7fef4c0694b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fef54004900 tx=0x7fef54007f70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f890d516700 1 -- 172.21.15.81:0/3323621052 wait complete. 2023-10-07T08:43:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.435+0000 7f890d516700 1 Processor -- start 2023-10-07T08:43:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f696062f700 1 -- 172.21.15.81:0/169233284 wait complete. 2023-10-07T08:43:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.435+0000 7f696062f700 1 Processor -- start 2023-10-07T08:43:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.435+0000 7f696062f700 1 -- start start 2023-10-07T08:43:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.432+0000 7f5cf4eb8700 1 -- start start 2023-10-07T08:43:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f5cf4eb8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5cf00692a0 0x7f5cf00c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f5cf4eb8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5cf006f580 0x7f5cf00c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f5cf4eb8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf006f950 0x7f5cf00c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f5cf4eb8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf015f920 con 0x7f5cf006f950 2023-10-07T08:43:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f5cf4eb8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf0167220 con 0x7f5cf006f580 2023-10-07T08:43:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f5cf4eb8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf015fb70 con 0x7f5cf00692a0 2023-10-07T08:43:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f5cee59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5cf00692a0 0x7f5cf00c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f5cee59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5cf00692a0 0x7f5cf00c7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:49260/0 (socket says 172.21.15.81:49260) 2023-10-07T08:43:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f5cee59c700 1 -- 172.21.15.81:0/1370137395 learned_addr learned my addr 172.21.15.81:0/1370137395 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f5ceed9d700 1 --2- 172.21.15.81:0/1370137395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf006f950 0x7f5cf00c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.434+0000 7f5cedd9b700 1 --2- 172.21.15.81:0/1370137395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5cf006f580 0x7f5cf00c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.434+0000 7f5cee59c700 1 -- 172.21.15.81:0/1370137395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5cf006f580 msgr2=0x7f5cf00c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.434+0000 7f5cee59c700 1 --2- 172.21.15.81:0/1370137395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5cf006f580 0x7f5cf00c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.434+0000 7f5cee59c700 1 -- 172.21.15.81:0/1370137395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf006f950 msgr2=0x7f5cf00c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.434+0000 7f5cee59c700 1 --2- 172.21.15.81:0/1370137395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf006f950 0x7f5cf00c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.434+0000 7f5cee59c700 1 -- 172.21.15.81:0/1370137395 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce000b6c0 con 0x7f5cf00692a0 2023-10-07T08:43:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.434+0000 7f5cee59c700 1 --2- 172.21.15.81:0/1370137395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5cf00692a0 0x7f5cf00c7560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000b460 tx=0x7f5ce001b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.434+0000 7ff3f198c700 1 Processor -- start 2023-10-07T08:43:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f9fb395f700 1 -- 172.21.15.81:0/1168862390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fac0cb270 msgr2=0x7f9fac159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f9fb395f700 1 --2- 172.21.15.81:0/1168862390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fac0cb270 0x7f9fac159c50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009f20 tx=0x7f9fa4009840 comp rx=0 tx=0).stop 2023-10-07T08:43:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f9fb395f700 1 -- 172.21.15.81:0/1168862390 shutdown_connections 2023-10-07T08:43:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f9fb395f700 1 --2- 172.21.15.81:0/1168862390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fac0cb270 0x7f9fac159c50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f9fb395f700 1 --2- 172.21.15.81:0/1168862390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fac15daa0 0x7f9fac15de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.433+0000 7f9fb395f700 1 -- 172.21.15.81:0/1168862390 >> 172.21.15.81:0/1168862390 conn(0x7f9fac0c9ca0 msgr2=0x7f9fac0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.434+0000 7f9fb395f700 1 -- 172.21.15.81:0/1168862390 shutdown_connections 2023-10-07T08:43:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.434+0000 7f9fb395f700 1 -- 172.21.15.81:0/1168862390 wait complete. 2023-10-07T08:43:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.435+0000 7f9fb395f700 1 Processor -- start 2023-10-07T08:43:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.435+0000 7f9fb395f700 1 -- start start 2023-10-07T08:43:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.436+0000 7f9fb395f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0cae00 0x7f9fac0af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.436+0000 7f9fb395f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fac0cb270 0x7f9fac0c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.436+0000 7f9fb395f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fac15daa0 0x7f9fac0c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.436+0000 7f9fb395f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac16a2f0 con 0x7f9fac0cae00 2023-10-07T08:43:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.436+0000 7f9fb395f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac16a590 con 0x7f9fac0cb270 2023-10-07T08:43:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.436+0000 7f9fb395f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac0b1270 con 0x7f9fac15daa0 2023-10-07T08:43:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.434+0000 7fdf7e47f700 1 -- 172.21.15.81:0/4182714239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7814fac0 con 0x7fdf7815e600 2023-10-07T08:43:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.434+0000 7fdf7e47f700 1 -- 172.21.15.81:0/4182714239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf78150080 con 0x7fdf7815e600 2023-10-07T08:43:09.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.436+0000 7fdf7e47f700 1 -- 172.21.15.81:0/4182714239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf78150880 con 0x7fdf7815e600 2023-10-07T08:43:09.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.436+0000 7f696062f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69440051c0 0x7f69580af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.436+0000 7f696062f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6958159970 0x7f695816ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.436+0000 7f696062f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695816ef70 0x7f69580c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.436+0000 7f696062f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69581569b0 con 0x7f69440051c0 2023-10-07T08:43:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.436+0000 7f696062f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69580ae080 con 0x7f6958159970 2023-10-07T08:43:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.436+0000 7f696062f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69580ae360 con 0x7f695816ef70 2023-10-07T08:43:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f695e3cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69440051c0 0x7f69580af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f695e3cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69440051c0 0x7f69580af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45176/0 (socket says 172.21.15.81:45176) 2023-10-07T08:43:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f695e3cb700 1 -- 172.21.15.81:0/702953521 learned_addr learned my addr 172.21.15.81:0/702953521 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f695dbca700 1 --2- 172.21.15.81:0/702953521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6958159970 0x7f695816ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f695e3cb700 1 -- 172.21.15.81:0/702953521 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695816ef70 msgr2=0x7f69580c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f695ebcc700 1 --2- 172.21.15.81:0/702953521 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695816ef70 0x7f69580c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f695e3cb700 1 --2- 172.21.15.81:0/702953521 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695816ef70 0x7f69580c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f695e3cb700 1 -- 172.21.15.81:0/702953521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6958159970 msgr2=0x7f695816ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f695e3cb700 1 --2- 172.21.15.81:0/702953521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6958159970 0x7f695816ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f695e3cb700 1 -- 172.21.15.81:0/702953521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69580ae640 con 0x7f69440051c0 2023-10-07T08:43:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f695ebcc700 1 --2- 172.21.15.81:0/702953521 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695816ef70 0x7f69580c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f695e3cb700 1 --2- 172.21.15.81:0/702953521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69440051c0 0x7f69580af2c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6950007fa0 tx=0x7f6950009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f695dbca700 1 --2- 172.21.15.81:0/702953521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6958159970 0x7f695816ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.436+0000 7ff3f198c700 1 -- start start 2023-10-07T08:43:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7ff3f198c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3ec0c83e0 0x7ff3ec152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7ff3f198c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec1516d0 0x7ff3ec0c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7ff3f198c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3ec0c87b0 0x7ff3ec0c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7ff3f198c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec151c00 con 0x7ff3ec1516d0 2023-10-07T08:43:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7ff3f198c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec151ee0 con 0x7ff3ec0c87b0 2023-10-07T08:43:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7ff3f198c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec1521c0 con 0x7ff3ec0c83e0 2023-10-07T08:43:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7ff3ea7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec1516d0 0x7ff3ec0c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7ff3ea7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec1516d0 0x7ff3ec0c5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45194/0 (socket says 172.21.15.81:45194) 2023-10-07T08:43:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7ff3ea7fc700 1 -- 172.21.15.81:0/697642399 learned_addr learned my addr 172.21.15.81:0/697642399 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7ff3eaffd700 1 --2- 172.21.15.81:0/697642399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3ec0c83e0 0x7ff3ec152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7ff3eb7fe700 1 --2- 172.21.15.81:0/697642399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3ec0c87b0 0x7ff3ec0c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f9fb0efa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fac0cb270 0x7f9fac0c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f9fb16fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0cae00 0x7f9fac0af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f9fb0efa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fac0cb270 0x7f9fac0c42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:39242/0 (socket says 172.21.15.81:39242) 2023-10-07T08:43:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f9fb16fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0cae00 0x7f9fac0af180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45180/0 (socket says 172.21.15.81:45180) 2023-10-07T08:43:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f9fb0efa700 1 -- 172.21.15.81:0/3142899779 learned_addr learned my addr 172.21.15.81:0/3142899779 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f9fb1efc700 1 --2- 172.21.15.81:0/3142899779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fac15daa0 0x7f9fac0c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f9fb0efa700 1 -- 172.21.15.81:0/3142899779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fac15daa0 msgr2=0x7f9fac0c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f9fb0efa700 1 --2- 172.21.15.81:0/3142899779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fac15daa0 0x7f9fac0c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f9fb0efa700 1 -- 172.21.15.81:0/3142899779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0cae00 msgr2=0x7f9fac0af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f9fb0efa700 1 --2- 172.21.15.81:0/3142899779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0cae00 0x7f9fac0af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f9fb0efa700 1 -- 172.21.15.81:0/3142899779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa4009ae0 con 0x7f9fac0cb270 2023-10-07T08:43:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7fdf5ffff700 1 -- 172.21.15.81:0/4182714239 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf70014650 con 0x7fdf7815e600 2023-10-07T08:43:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7ff3eb7fe700 1 -- 172.21.15.81:0/697642399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3ec0c83e0 msgr2=0x7ff3ec152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7ff3eb7fe700 1 --2- 172.21.15.81:0/697642399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3ec0c83e0 0x7ff3ec152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7ff3eb7fe700 1 -- 172.21.15.81:0/697642399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec1516d0 msgr2=0x7ff3ec0c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7ff3eb7fe700 1 --2- 172.21.15.81:0/697642399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec1516d0 0x7ff3ec0c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7ff3eb7fe700 1 -- 172.21.15.81:0/697642399 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ec1524a0 con 0x7ff3ec0c87b0 2023-10-07T08:43:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7ff3eaffd700 1 --2- 172.21.15.81:0/697642399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3ec0c83e0 0x7ff3ec152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:09.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f9fb0efa700 1 --2- 172.21.15.81:0/3142899779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fac0cb270 0x7f9fac0c42e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00b600 tx=0x7f9f9c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7ff3eb7fe700 1 --2- 172.21.15.81:0/697642399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3ec0c87b0 0x7ff3ec0c5760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0cd690 tx=0x7ff3e0007f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7fdf5ffff700 1 --2- 172.21.15.81:0/4182714239 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf60067050 0x7fdf60069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7fdf5ffff700 1 -- 172.21.15.81:0/4182714239 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf70085800 con 0x7fdf7815e600 2023-10-07T08:43:09.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7fdf77fff700 1 --2- 172.21.15.81:0/4182714239 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf60067050 0x7fdf60069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f9fa17fa700 1 -- 172.21.15.81:0/3142899779 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00f510 con 0x7f9fac0cb270 2023-10-07T08:43:09.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f9fb395f700 1 -- 172.21.15.81:0/3142899779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fac0c4e50 con 0x7f9fac0cb270 2023-10-07T08:43:09.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f9fb395f700 1 -- 172.21.15.81:0/3142899779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac0c5410 con 0x7f9fac0cb270 2023-10-07T08:43:09.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f5cde7fc700 1 -- 172.21.15.81:0/1370137395 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0011b50 con 0x7f5cf00692a0 2023-10-07T08:43:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f5cde7fc700 1 -- 172.21.15.81:0/1370137395 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce0011cb0 con 0x7f5cf00692a0 2023-10-07T08:43:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f5cde7fc700 1 -- 172.21.15.81:0/1370137395 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce00061f0 con 0x7f5cf00692a0 2023-10-07T08:43:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f5cf4eb8700 1 -- 172.21.15.81:0/1370137395 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf015fe50 con 0x7f5cf00692a0 2023-10-07T08:43:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f5cf4eb8700 1 -- 172.21.15.81:0/1370137395 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf0160410 con 0x7f5cf00692a0 2023-10-07T08:43:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7ff3d2ffd700 1 -- 172.21.15.81:0/697642399 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e000ce90 con 0x7ff3ec0c87b0 2023-10-07T08:43:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7ff3d2ffd700 1 -- 172.21.15.81:0/697642399 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e00059b0 con 0x7ff3ec0c87b0 2023-10-07T08:43:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7ff3f198c700 1 -- 172.21.15.81:0/697642399 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ec0b00c0 con 0x7ff3ec0c87b0 2023-10-07T08:43:09.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.437+0000 7f890d516700 1 -- start start 2023-10-07T08:43:09.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7ff3f198c700 1 -- 172.21.15.81:0/697642399 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ec0c3a30 con 0x7ff3ec0c87b0 2023-10-07T08:43:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f890d516700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8908069670 0x7f890816dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f890d516700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f890806d220 0x7f89080ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f890d516700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89081414f0 0x7f890817a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f890d516700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89080ae300 con 0x7f890806d220 2023-10-07T08:43:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f890d516700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890817b650 con 0x7f89081414f0 2023-10-07T08:43:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f890d516700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89080ad6f0 con 0x7f8908069670 2023-10-07T08:43:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f8906ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8908069670 0x7f890816dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f89067fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f890806d220 0x7f89080ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f8906ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8908069670 0x7f890816dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:49288/0 (socket says 172.21.15.81:49288) 2023-10-07T08:43:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f8906ffd700 1 -- 172.21.15.81:0/3304970347 learned_addr learned my addr 172.21.15.81:0/3304970347 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f89067fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f890806d220 0x7f89080ac4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45200/0 (socket says 172.21.15.81:45200) 2023-10-07T08:43:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.438+0000 7f89077fe700 1 --2- 172.21.15.81:0/3304970347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89081414f0 0x7f890817a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.439+0000 7f8906ffd700 1 -- 172.21.15.81:0/3304970347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89081414f0 msgr2=0x7f890817a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.439+0000 7f8906ffd700 1 --2- 172.21.15.81:0/3304970347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89081414f0 0x7f890817a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.439+0000 7f8906ffd700 1 -- 172.21.15.81:0/3304970347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f890806d220 msgr2=0x7f89080ac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.439+0000 7f8906ffd700 1 --2- 172.21.15.81:0/3304970347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f890806d220 0x7f89080ac4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.439+0000 7f8906ffd700 1 -- 172.21.15.81:0/3304970347 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc0094f0 con 0x7f8908069670 2023-10-07T08:43:09.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.439+0000 7fdf77fff700 1 --2- 172.21.15.81:0/4182714239 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf60067050 0x7fdf60069500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c011780 tx=0x7fdf6c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.439+0000 7f89067fc700 1 --2- 172.21.15.81:0/3304970347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f890806d220 0x7f89080ac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:09.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.439+0000 7f8906ffd700 1 --2- 172.21.15.81:0/3304970347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8908069670 0x7f890816dd20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f88f800b630 tx=0x7f88f80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.439+0000 7ff3d2ffd700 1 -- 172.21.15.81:0/697642399 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0005d70 con 0x7ff3ec0c87b0 2023-10-07T08:43:09.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.439+0000 7f9fb395f700 1 -- 172.21.15.81:0/3142899779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fac16a720 con 0x7f9fac0cb270 2023-10-07T08:43:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.440+0000 7f9fb1efc700 1 --2- 172.21.15.81:0/3142899779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fac15daa0 0x7f9fac0c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.440+0000 7f5cf4eb8700 1 -- 172.21.15.81:0/1370137395 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd40052b0 con 0x7f5cf00692a0 2023-10-07T08:43:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.440+0000 7f9fa17fa700 1 -- 172.21.15.81:0/3142899779 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c00f690 con 0x7f9fac0cb270 2023-10-07T08:43:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.440+0000 7f9fa17fa700 1 -- 172.21.15.81:0/3142899779 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00fa50 con 0x7f9fac0cb270 2023-10-07T08:43:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.440+0000 7fef477fe700 1 -- 172.21.15.81:0/2551645436 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef58053fa0 con 0x7fef6013ffe0 2023-10-07T08:43:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.440+0000 7ff3f198c700 1 -- 172.21.15.81:0/697642399 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3cc0052b0 con 0x7ff3ec0c87b0 2023-10-07T08:43:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.441+0000 7ff3d2ffd700 1 -- 172.21.15.81:0/697642399 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff3e0007300 con 0x7ff3ec0c87b0 2023-10-07T08:43:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.441+0000 7f88eeffd700 1 -- 172.21.15.81:0/3304970347 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f800f510 con 0x7f8908069670 2023-10-07T08:43:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.441+0000 7f88eeffd700 1 -- 172.21.15.81:0/3304970347 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f800f690 con 0x7f8908069670 2023-10-07T08:43:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.441+0000 7f890d516700 1 -- 172.21.15.81:0/3304970347 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89080ad9d0 con 0x7f8908069670 2023-10-07T08:43:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.441+0000 7ff3d2ffd700 1 --2- 172.21.15.81:0/697642399 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3d4071650 0x7ff3d4073b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.441+0000 7f88eeffd700 1 -- 172.21.15.81:0/3304970347 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f800fa50 con 0x7f8908069670 2023-10-07T08:43:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.441+0000 7f890d516700 1 -- 172.21.15.81:0/3304970347 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89080adf90 con 0x7f8908069670 2023-10-07T08:43:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.441+0000 7ff3d2ffd700 1 -- 172.21.15.81:0/697642399 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff3e00832d0 con 0x7ff3ec0c87b0 2023-10-07T08:43:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.441+0000 7ff3eaffd700 1 --2- 172.21.15.81:0/697642399 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3d4071650 0x7ff3d4073b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.442+0000 7f5cde7fc700 1 -- 172.21.15.81:0/1370137395 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ce0018030 con 0x7f5cf00692a0 2023-10-07T08:43:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.442+0000 7f890d516700 1 -- 172.21.15.81:0/3304970347 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8908067bc0 con 0x7f8908069670 2023-10-07T08:43:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.442+0000 7f5cde7fc700 1 --2- 172.21.15.81:0/1370137395 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5cd0067000 0x7f5cd00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.442+0000 7f5cedd9b700 1 --2- 172.21.15.81:0/1370137395 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5cd0067000 0x7f5cd00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.442+0000 7f5cde7fc700 1 -- 172.21.15.81:0/1370137395 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ce0016070 con 0x7f5cf00692a0 2023-10-07T08:43:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.443+0000 7ff3eaffd700 1 --2- 172.21.15.81:0/697642399 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3d4071650 0x7ff3d4073b00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c2d0 tx=0x7ff3dc015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.443+0000 7f9fa17fa700 1 -- 172.21.15.81:0/3142899779 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f9c024430 con 0x7f9fac0cb270 2023-10-07T08:43:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.443+0000 7f5cedd9b700 1 --2- 172.21.15.81:0/1370137395 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5cd0067000 0x7f5cd00694b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4004bb0 tx=0x7f5ce40070b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.443+0000 7f9fa17fa700 1 --2- 172.21.15.81:0/3142899779 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f90066f30 0x7f9f900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.443+0000 7f9fa17fa700 1 -- 172.21.15.81:0/3142899779 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9f9c084ad0 con 0x7f9fac0cb270 2023-10-07T08:43:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.443+0000 7f9fb16fb700 1 --2- 172.21.15.81:0/3142899779 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f90066f30 0x7f9f900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.443+0000 7f9fb16fb700 1 --2- 172.21.15.81:0/3142899779 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f90066f30 0x7f9f900693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8006fd0 tx=0x7f9fa8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.444+0000 7f694e7fc700 1 -- 172.21.15.81:0/702953521 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950006e80 con 0x7f69440051c0 2023-10-07T08:43:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.444+0000 7f694e7fc700 1 -- 172.21.15.81:0/702953521 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695000ca00 con 0x7f69440051c0 2023-10-07T08:43:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.444+0000 7f696062f700 1 -- 172.21.15.81:0/702953521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69580ae920 con 0x7f69440051c0 2023-10-07T08:43:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.444+0000 7f694e7fc700 1 -- 172.21.15.81:0/702953521 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695000cda0 con 0x7f69440051c0 2023-10-07T08:43:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.444+0000 7f696062f700 1 -- 172.21.15.81:0/702953521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69580aee40 con 0x7f69440051c0 2023-10-07T08:43:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.444+0000 7fdf5ffff700 1 -- 172.21.15.81:0/4182714239 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf70052af0 con 0x7fdf7815e600 2023-10-07T08:43:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.445+0000 7f5cde7fc700 1 -- 172.21.15.81:0/1370137395 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ce00537c0 con 0x7f5cf00692a0 2023-10-07T08:43:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.445+0000 7f696062f700 1 -- 172.21.15.81:0/702953521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69580aeb10 con 0x7f69440051c0 2023-10-07T08:43:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.446+0000 7f9fa17fa700 1 -- 172.21.15.81:0/3142899779 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f9c055930 con 0x7f9fac0cb270 2023-10-07T08:43:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.446+0000 7f694e7fc700 1 -- 172.21.15.81:0/702953521 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6950014690 con 0x7f69440051c0 2023-10-07T08:43:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.446+0000 7f694e7fc700 1 --2- 172.21.15.81:0/702953521 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f69440688b0 0x7f694406ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.446+0000 7f694e7fc700 1 -- 172.21.15.81:0/702953521 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6950084d30 con 0x7f69440051c0 2023-10-07T08:43:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.446+0000 7f88eeffd700 1 -- 172.21.15.81:0/3304970347 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f88f8024430 con 0x7f8908069670 2023-10-07T08:43:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.447+0000 7f88eeffd700 1 --2- 172.21.15.81:0/3304970347 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f88f4067000 0x7f88f40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.447+0000 7f88eeffd700 1 -- 172.21.15.81:0/3304970347 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f88f8084a20 con 0x7f8908069670 2023-10-07T08:43:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.449+0000 7f88eeffd700 1 -- 172.21.15.81:0/3304970347 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88f8051df0 con 0x7f8908069670 2023-10-07T08:43:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.450+0000 7ff3d2ffd700 1 -- 172.21.15.81:0/697642399 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3e00506a0 con 0x7ff3ec0c87b0 2023-10-07T08:43:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.458+0000 7f89067fc700 1 --2- 172.21.15.81:0/3304970347 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f88f4067000 0x7f88f40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.462+0000 7f694e7fc700 1 -- 172.21.15.81:0/702953521 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6950051fa0 con 0x7f69440051c0 2023-10-07T08:43:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.462+0000 7f695dbca700 1 --2- 172.21.15.81:0/702953521 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f69440688b0 0x7f694406ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.463+0000 7f695dbca700 1 --2- 172.21.15.81:0/702953521 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f69440688b0 0x7f694406ad60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6958159de0 tx=0x7f6948009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.472+0000 7f89067fc700 1 --2- 172.21.15.81:0/3304970347 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f88f4067000 0x7f88f40694b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0099b0 tx=0x7f88fc016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.769+0000 7f68c6ed7700 1 -- 172.21.15.81:0/3072318782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f68a0005560 con 0x7f68c00cb840 2023-10-07T08:43:09.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.779+0000 7f68bcff9700 1 -- 172.21.15.81:0/3072318782 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f68b0019380 con 0x7f68c00cb840 2023-10-07T08:43:09.787 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-07T08:43:09.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.787+0000 7f68c6ed7700 1 -- 172.21.15.81:0/3072318782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f68ac067080 msgr2=0x7f68ac069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.787+0000 7f68c6ed7700 1 --2- 172.21.15.81:0/3072318782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f68ac067080 0x7f68ac069530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f68c014eac0 tx=0x7f68b8006450 comp rx=0 tx=0).stop 2023-10-07T08:43:09.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.787+0000 7f68c6ed7700 1 -- 172.21.15.81:0/3072318782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68c00cb840 msgr2=0x7f68c0145c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.787+0000 7f68c6ed7700 1 --2- 172.21.15.81:0/3072318782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68c00cb840 0x7f68c0145c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f68b000b460 tx=0x7f68b001b000 comp rx=0 tx=0).stop 2023-10-07T08:43:09.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.787+0000 7f68c6ed7700 1 -- 172.21.15.81:0/3072318782 shutdown_connections 2023-10-07T08:43:09.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.787+0000 7f68c6ed7700 1 --2- 172.21.15.81:0/3072318782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f68ac067080 0x7f68ac069530 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.787+0000 7f68c6ed7700 1 --2- 172.21.15.81:0/3072318782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0155c60 0x7f68c014ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.787+0000 7f68c6ed7700 1 --2- 172.21.15.81:0/3072318782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68c00cb840 0x7f68c0145c50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.787+0000 7f68c6ed7700 1 --2- 172.21.15.81:0/3072318782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c00cbc90 0x7f68c014fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.787+0000 7f68c6ed7700 1 -- 172.21.15.81:0/3072318782 >> 172.21.15.81:0/3072318782 conn(0x7f68c00cc980 msgr2=0x7f68c00c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.788+0000 7f68c6ed7700 1 -- 172.21.15.81:0/3072318782 shutdown_connections 2023-10-07T08:43:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.788+0000 7f68c6ed7700 1 -- 172.21.15.81:0/3072318782 wait complete. 2023-10-07T08:43:09.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-07T08:43:09.807 DEBUG:teuthology.parallel:result is None 2023-10-07T08:43:09.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.820+0000 7ff3f198c700 1 -- 172.21.15.81:0/697642399 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff3cc005830 con 0x7ff3ec0c87b0 2023-10-07T08:43:09.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.820+0000 7ff3d2ffd700 1 -- 172.21.15.81:0/697642399 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff3e0017020 con 0x7ff3ec0c87b0 2023-10-07T08:43:09.822 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-07T08:43:09.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.822+0000 7ff3f198c700 1 -- 172.21.15.81:0/697642399 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3d4071650 msgr2=0x7ff3d4073b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.822+0000 7ff3f198c700 1 --2- 172.21.15.81:0/697642399 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3d4071650 0x7ff3d4073b00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c2d0 tx=0x7ff3dc015000 comp rx=0 tx=0).stop 2023-10-07T08:43:09.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.822+0000 7ff3f198c700 1 -- 172.21.15.81:0/697642399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3ec0c87b0 msgr2=0x7ff3ec0c5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.822+0000 7ff3f198c700 1 --2- 172.21.15.81:0/697642399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3ec0c87b0 0x7ff3ec0c5760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0cd690 tx=0x7ff3e0007f20 comp rx=0 tx=0).stop 2023-10-07T08:43:09.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.823+0000 7ff3f198c700 1 -- 172.21.15.81:0/697642399 shutdown_connections 2023-10-07T08:43:09.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.823+0000 7ff3f198c700 1 --2- 172.21.15.81:0/697642399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3ec0c87b0 0x7ff3ec0c5760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.823+0000 7ff3f198c700 1 --2- 172.21.15.81:0/697642399 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3d4071650 0x7ff3d4073b00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.823+0000 7ff3f198c700 1 --2- 172.21.15.81:0/697642399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3ec0c83e0 0x7ff3ec152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.823+0000 7ff3f198c700 1 --2- 172.21.15.81:0/697642399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec1516d0 0x7ff3ec0c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.823+0000 7ff3f198c700 1 -- 172.21.15.81:0/697642399 >> 172.21.15.81:0/697642399 conn(0x7ff3ec0cc980 msgr2=0x7ff3ec1581f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:09.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.824+0000 7ff3f198c700 1 -- 172.21.15.81:0/697642399 shutdown_connections 2023-10-07T08:43:09.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.824+0000 7fef65c9d700 1 -- 172.21.15.81:0/2551645436 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fef40005830 con 0x7fef6013ffe0 2023-10-07T08:43:09.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.824+0000 7ff3f198c700 1 -- 172.21.15.81:0/697642399 wait complete. 2023-10-07T08:43:09.826 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-07T08:43:09.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.825+0000 7fef477fe700 1 -- 172.21.15.81:0/2551645436 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef580575c0 con 0x7fef6013ffe0 2023-10-07T08:43:09.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.828+0000 7f890d516700 1 -- 172.21.15.81:0/3304970347 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f89080b28c0 con 0x7f8908069670 2023-10-07T08:43:09.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.829+0000 7fef65c9d700 1 -- 172.21.15.81:0/2551645436 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fef4c067000 msgr2=0x7fef4c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.829+0000 7fef65c9d700 1 --2- 172.21.15.81:0/2551645436 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fef4c067000 0x7fef4c0694b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fef54004900 tx=0x7fef54007f70 comp rx=0 tx=0).stop 2023-10-07T08:43:09.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.829+0000 7fef65c9d700 1 -- 172.21.15.81:0/2551645436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef6013ffe0 msgr2=0x7fef600b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.829+0000 7fef65c9d700 1 --2- 172.21.15.81:0/2551645436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef6013ffe0 0x7fef600b1c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fef58016000 tx=0x7fef58019000 comp rx=0 tx=0).stop 2023-10-07T08:43:09.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.829+0000 7f88eeffd700 1 -- 172.21.15.81:0/3304970347 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88f8055410 con 0x7f8908069670 2023-10-07T08:43:09.831 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-07T08:43:09.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.831+0000 7f5cf4eb8700 1 -- 172.21.15.81:0/1370137395 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5cd4005830 con 0x7f5cf00692a0 2023-10-07T08:43:09.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.831+0000 7fdf7e47f700 1 -- 172.21.15.81:0/4182714239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdf78150810 con 0x7fdf7815e600 2023-10-07T08:43:09.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.831+0000 7f5cde7fc700 1 -- 172.21.15.81:0/1370137395 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ce0056de0 con 0x7f5cf00692a0 2023-10-07T08:43:09.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7fef65c9d700 1 -- 172.21.15.81:0/2551645436 shutdown_connections 2023-10-07T08:43:09.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7fef65c9d700 1 --2- 172.21.15.81:0/2551645436 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fef4c067000 0x7fef4c0694b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7fef65c9d700 1 --2- 172.21.15.81:0/2551645436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef6013ffe0 0x7fef600b1c60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7fef65c9d700 1 --2- 172.21.15.81:0/2551645436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef600c8190 0x7fef600ada20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7fef65c9d700 1 --2- 172.21.15.81:0/2551645436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef6013fc10 0x7fef6013e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7fef65c9d700 1 -- 172.21.15.81:0/2551645436 >> 172.21.15.81:0/2551645436 conn(0x7fef600c9ca0 msgr2=0x7fef6006a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:09.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.833+0000 7fef65c9d700 1 -- 172.21.15.81:0/2551645436 shutdown_connections 2023-10-07T08:43:09.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.833+0000 7fef65c9d700 1 -- 172.21.15.81:0/2551645436 wait complete. 2023-10-07T08:43:09.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7f890d516700 1 -- 172.21.15.81:0/3304970347 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f88f4067000 msgr2=0x7f88f40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7f890d516700 1 --2- 172.21.15.81:0/3304970347 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f88f4067000 0x7f88f40694b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0099b0 tx=0x7f88fc016000 comp rx=0 tx=0).stop 2023-10-07T08:43:09.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7f890d516700 1 -- 172.21.15.81:0/3304970347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8908069670 msgr2=0x7f890816dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7f890d516700 1 --2- 172.21.15.81:0/3304970347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8908069670 0x7f890816dd20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f88f800b630 tx=0x7f88f80091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7f890d516700 1 -- 172.21.15.81:0/3304970347 shutdown_connections 2023-10-07T08:43:09.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7f890d516700 1 --2- 172.21.15.81:0/3304970347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89081414f0 0x7f890817a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7f890d516700 1 --2- 172.21.15.81:0/3304970347 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f88f4067000 0x7f88f40694b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7f890d516700 1 --2- 172.21.15.81:0/3304970347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8908069670 0x7f890816dd20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7f890d516700 1 --2- 172.21.15.81:0/3304970347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f890806d220 0x7f89080ac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7f890d516700 1 -- 172.21.15.81:0/3304970347 >> 172.21.15.81:0/3304970347 conn(0x7f89080cc980 msgr2=0x7f89080c20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:09.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7f890d516700 1 -- 172.21.15.81:0/3304970347 shutdown_connections 2023-10-07T08:43:09.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.832+0000 7f890d516700 1 -- 172.21.15.81:0/3304970347 wait complete. 2023-10-07T08:43:09.838 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-07T08:43:09.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.834+0000 7f9fb395f700 1 -- 172.21.15.81:0/3142899779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9fac0af730 con 0x7f9fac0cb270 2023-10-07T08:43:09.839 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-07T08:43:09.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.831+0000 7fdf5ffff700 1 -- 172.21.15.81:0/4182714239 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf70056110 con 0x7fdf7815e600 2023-10-07T08:43:09.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.834+0000 7f5cf4eb8700 1 -- 172.21.15.81:0/1370137395 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5cd0067000 msgr2=0x7f5cd00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.834+0000 7f5cf4eb8700 1 --2- 172.21.15.81:0/1370137395 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5cd0067000 0x7f5cd00694b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4004bb0 tx=0x7f5ce40070b0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.834+0000 7f5cf4eb8700 1 -- 172.21.15.81:0/1370137395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5cf00692a0 msgr2=0x7f5cf00c7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.834+0000 7f5cf4eb8700 1 --2- 172.21.15.81:0/1370137395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5cf00692a0 0x7f5cf00c7560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000b460 tx=0x7f5ce001b000 comp rx=0 tx=0).stop 2023-10-07T08:43:09.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.835+0000 7fdf7e47f700 1 -- 172.21.15.81:0/4182714239 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf60067050 msgr2=0x7fdf60069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.835+0000 7fdf7e47f700 1 --2- 172.21.15.81:0/4182714239 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf60067050 0x7fdf60069500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c011780 tx=0x7fdf6c017000 comp rx=0 tx=0).stop 2023-10-07T08:43:09.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.835+0000 7fdf7e47f700 1 -- 172.21.15.81:0/4182714239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf7815e600 msgr2=0x7fdf781798e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.835+0000 7fdf7e47f700 1 --2- 172.21.15.81:0/4182714239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf7815e600 0x7fdf781798e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdf70009e50 tx=0x7fdf7000b040 comp rx=0 tx=0).stop 2023-10-07T08:43:09.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.835+0000 7fdf7e47f700 1 -- 172.21.15.81:0/4182714239 shutdown_connections 2023-10-07T08:43:09.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.835+0000 7fdf7e47f700 1 --2- 172.21.15.81:0/4182714239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf7815e600 0x7fdf781798e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.835+0000 7fdf7e47f700 1 --2- 172.21.15.81:0/4182714239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf780cc620 0x7fdf78148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.835+0000 7fdf7e47f700 1 --2- 172.21.15.81:0/4182714239 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf60067050 0x7fdf60069500 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.835+0000 7fdf7e47f700 1 --2- 172.21.15.81:0/4182714239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf7815e230 0x7fdf780c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.835+0000 7fdf7e47f700 1 -- 172.21.15.81:0/4182714239 >> 172.21.15.81:0/4182714239 conn(0x7fdf780c9ca0 msgr2=0x7fdf780c25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:09.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.836+0000 7f5cf4eb8700 1 -- 172.21.15.81:0/1370137395 shutdown_connections 2023-10-07T08:43:09.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.836+0000 7f5cf4eb8700 1 --2- 172.21.15.81:0/1370137395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf006f950 0x7f5cf00c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.836+0000 7f5cf4eb8700 1 --2- 172.21.15.81:0/1370137395 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5cd0067000 0x7f5cd00694b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.836+0000 7f5cf4eb8700 1 --2- 172.21.15.81:0/1370137395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5cf00692a0 0x7f5cf00c7560 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.836+0000 7f5cf4eb8700 1 --2- 172.21.15.81:0/1370137395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5cf006f580 0x7f5cf00c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.836+0000 7f5cf4eb8700 1 -- 172.21.15.81:0/1370137395 >> 172.21.15.81:0/1370137395 conn(0x7f5cf00cc980 msgr2=0x7f5cf006ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:09.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.836+0000 7f5cf4eb8700 1 -- 172.21.15.81:0/1370137395 shutdown_connections 2023-10-07T08:43:09.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.836+0000 7f5cf4eb8700 1 -- 172.21.15.81:0/1370137395 wait complete. 2023-10-07T08:43:09.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.837+0000 7fdf7e47f700 1 -- 172.21.15.81:0/4182714239 shutdown_connections 2023-10-07T08:43:09.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.837+0000 7f9fa17fa700 1 -- 172.21.15.81:0/3142899779 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f9c0554c0 con 0x7f9fac0cb270 2023-10-07T08:43:09.843 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-07T08:43:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.840+0000 7f9fb395f700 1 -- 172.21.15.81:0/3142899779 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f90066f30 msgr2=0x7f9f900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.840+0000 7f9fb395f700 1 --2- 172.21.15.81:0/3142899779 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f90066f30 0x7f9f900693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8006fd0 tx=0x7f9fa8008040 comp rx=0 tx=0).stop 2023-10-07T08:43:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.840+0000 7f9fb395f700 1 -- 172.21.15.81:0/3142899779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fac0cb270 msgr2=0x7f9fac0c42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.840+0000 7f9fb395f700 1 --2- 172.21.15.81:0/3142899779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fac0cb270 0x7f9fac0c42e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00b600 tx=0x7f9f9c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.841+0000 7f9fb395f700 1 -- 172.21.15.81:0/3142899779 shutdown_connections 2023-10-07T08:43:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.841+0000 7f9fb395f700 1 --2- 172.21.15.81:0/3142899779 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f90066f30 0x7f9f900693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.841+0000 7f9fb395f700 1 --2- 172.21.15.81:0/3142899779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fac15daa0 0x7f9fac0c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.841+0000 7f9fb395f700 1 --2- 172.21.15.81:0/3142899779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0cae00 0x7f9fac0af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.841+0000 7f9fb395f700 1 --2- 172.21.15.81:0/3142899779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fac0cb270 0x7f9fac0c42e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.841+0000 7fdf7e47f700 1 -- 172.21.15.81:0/4182714239 wait complete. 2023-10-07T08:43:09.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.841+0000 7f9fb395f700 1 -- 172.21.15.81:0/3142899779 >> 172.21.15.81:0/3142899779 conn(0x7f9fac0c9ca0 msgr2=0x7f9fac15ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:09.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.841+0000 7f9fb395f700 1 -- 172.21.15.81:0/3142899779 shutdown_connections 2023-10-07T08:43:09.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.841+0000 7f9fb395f700 1 -- 172.21.15.81:0/3142899779 wait complete. 2023-10-07T08:43:09.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-07T08:43:09.847 DEBUG:teuthology.parallel:result is None 2023-10-07T08:43:09.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.847+0000 7f696062f700 1 -- 172.21.15.81:0/702953521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f69581625c0 con 0x7f69440051c0 2023-10-07T08:43:09.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.848+0000 7f694e7fc700 1 -- 172.21.15.81:0/702953521 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69581625c0 con 0x7f69440051c0 2023-10-07T08:43:09.849 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-07T08:43:09.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.851+0000 7f696062f700 1 -- 172.21.15.81:0/702953521 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f69440688b0 msgr2=0x7f694406ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.851+0000 7f696062f700 1 --2- 172.21.15.81:0/702953521 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f69440688b0 0x7f694406ad60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6958159de0 tx=0x7f6948009040 comp rx=0 tx=0).stop 2023-10-07T08:43:09.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.851+0000 7f696062f700 1 -- 172.21.15.81:0/702953521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69440051c0 msgr2=0x7f69580af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.851+0000 7f696062f700 1 --2- 172.21.15.81:0/702953521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69440051c0 0x7f69580af2c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6950007fa0 tx=0x7f6950009040 comp rx=0 tx=0).stop 2023-10-07T08:43:09.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-07T08:43:09.854 DEBUG:teuthology.parallel:result is None 2023-10-07T08:43:09.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.856+0000 7f696062f700 1 -- 172.21.15.81:0/702953521 shutdown_connections 2023-10-07T08:43:09.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.856+0000 7f696062f700 1 --2- 172.21.15.81:0/702953521 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f69440688b0 0x7f694406ad60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.856+0000 7f696062f700 1 --2- 172.21.15.81:0/702953521 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f695816ef70 0x7f69580c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.856+0000 7f696062f700 1 --2- 172.21.15.81:0/702953521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69440051c0 0x7f69580af2c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.856+0000 7f696062f700 1 --2- 172.21.15.81:0/702953521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6958159970 0x7f695816ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:09.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.856+0000 7f696062f700 1 -- 172.21.15.81:0/702953521 >> 172.21.15.81:0/702953521 conn(0x7f695806cca0 msgr2=0x7f6958156120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:09.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-07T08:43:09.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.856+0000 7f696062f700 1 -- 172.21.15.81:0/702953521 shutdown_connections 2023-10-07T08:43:09.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:09.857+0000 7f696062f700 1 -- 172.21.15.81:0/702953521 wait complete. 2023-10-07T08:43:09.859 DEBUG:teuthology.parallel:result is None 2023-10-07T08:43:09.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-10-07T08:43:09.864 DEBUG:teuthology.parallel:result is None 2023-10-07T08:43:09.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-07T08:43:09.867 DEBUG:teuthology.parallel:result is None 2023-10-07T08:43:09.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-10-07T08:43:09.868 DEBUG:teuthology.parallel:result is None 2023-10-07T08:43:09.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-07T08:43:09.872 DEBUG:teuthology.parallel:result is None 2023-10-07T08:43:09.872 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-07T08:43:09.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:43:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.025+0000 7faeaf13c700 1 Processor -- start 2023-10-07T08:43:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.025+0000 7faeaf13c700 1 -- start start 2023-10-07T08:43:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.026+0000 7faeaf13c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faea8159f10 0x7faea8068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.026+0000 7faeaf13c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faea8068cc0 0x7faea80cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.026+0000 7faeaf13c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea80cee10 con 0x7faea8159b40 2023-10-07T08:43:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.026+0000 7faeaf13c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea8069140 con 0x7faea8068cc0 2023-10-07T08:43:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.026+0000 7faeaf13c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea80cd040 con 0x7faea8159f10 2023-10-07T08:43:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.026+0000 7faeae93b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faea8068cc0 0x7faea80cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.026+0000 7faeae93b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faea8068cc0 0x7faea80cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45212/0 (socket says 172.21.15.81:45212) 2023-10-07T08:43:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.026+0000 7faeae93b700 1 -- 172.21.15.81:0/3192053927 learned_addr learned my addr 172.21.15.81:0/3192053927 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.026+0000 7faead939700 1 --2- 172.21.15.81:0/3192053927 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faea8159f10 0x7faea8068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.026+0000 7faeae93b700 1 -- 172.21.15.81:0/3192053927 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faea8159f10 msgr2=0x7faea8068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.026+0000 7faeae93b700 1 --2- 172.21.15.81:0/3192053927 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faea8159f10 0x7faea8068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.026+0000 7faeae93b700 1 -- 172.21.15.81:0/3192053927 >> v1:172.21.15.89:6789/0 conn(0x7faea8159b40 legacy=0x7faea80cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.026+0000 7faeae93b700 1 -- 172.21.15.81:0/3192053927 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea80cd320 con 0x7faea8068cc0 2023-10-07T08:43:10.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.026+0000 7faead939700 1 --2- 172.21.15.81:0/3192053927 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faea8159f10 0x7faea8068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:10.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.027+0000 7faeae93b700 1 --2- 172.21.15.81:0/3192053927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea8068cc0 0x7faea80cf2a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faea0009f20 tx=0x7faea0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d4913537c238e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:10.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.027+0000 7faead138700 1 -- 172.21.15.81:0/3192053927 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea000e070 con 0x7faea8068cc0 2023-10-07T08:43:10.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.027+0000 7faead138700 1 -- 172.21.15.81:0/3192053927 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea000ba40 con 0x7faea8068cc0 2023-10-07T08:43:10.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.027+0000 7faead138700 1 -- 172.21.15.81:0/3192053927 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea00092e0 con 0x7faea8068cc0 2023-10-07T08:43:10.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.027+0000 7faeaf13c700 1 -- 172.21.15.81:0/3192053927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea8068cc0 msgr2=0x7faea80cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:10.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.027+0000 7faeaf13c700 1 --2- 172.21.15.81:0/3192053927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea8068cc0 0x7faea80cf2a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faea0009f20 tx=0x7faea0009840 comp rx=0 tx=0).stop 2023-10-07T08:43:10.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.027+0000 7faeaf13c700 1 -- 172.21.15.81:0/3192053927 shutdown_connections 2023-10-07T08:43:10.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.027+0000 7faeaf13c700 1 --2- 172.21.15.81:0/3192053927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea8068cc0 0x7faea80cf2a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.027+0000 7faeaf13c700 1 --2- 172.21.15.81:0/3192053927 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faea8159f10 0x7faea8068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.027+0000 7faeaf13c700 1 -- 172.21.15.81:0/3192053927 >> 172.21.15.81:0/3192053927 conn(0x7faea80cd660 msgr2=0x7faea80cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:10.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.027+0000 7faeaf13c700 1 -- 172.21.15.81:0/3192053927 shutdown_connections 2023-10-07T08:43:10.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.027+0000 7faeaf13c700 1 -- 172.21.15.81:0/3192053927 wait complete. 2023-10-07T08:43:10.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.028+0000 7faeaf13c700 1 Processor -- start 2023-10-07T08:43:10.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.028+0000 7faeaf13c700 1 -- start start 2023-10-07T08:43:10.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faeaf13c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea8068cc0 0x7faea81557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faeaf13c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faea8159b40 0x7faea8155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faeaf13c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faea8159f10 0x7faea80b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faeaf13c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea8155d30 con 0x7faea8068cc0 2023-10-07T08:43:10.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faeaf13c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea80b2ea0 con 0x7faea8159b40 2023-10-07T08:43:10.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faeaf13c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea815b9a0 con 0x7faea8159f10 2023-10-07T08:43:10.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faeae13a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea8068cc0 0x7faea81557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faeae13a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea8068cc0 0x7faea81557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45228/0 (socket says 172.21.15.81:45228) 2023-10-07T08:43:10.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faeae13a700 1 -- 172.21.15.81:0/3667773462 learned_addr learned my addr 172.21.15.81:0/3667773462 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:10.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faeae93b700 1 --2- 172.21.15.81:0/3667773462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faea8159f10 0x7faea80b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faead939700 1 --2- 172.21.15.81:0/3667773462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faea8159b40 0x7faea8155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faeae13a700 1 -- 172.21.15.81:0/3667773462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faea8159f10 msgr2=0x7faea80b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faeae13a700 1 --2- 172.21.15.81:0/3667773462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faea8159f10 0x7faea80b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faeae13a700 1 -- 172.21.15.81:0/3667773462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faea8159b40 msgr2=0x7faea8155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faeae13a700 1 --2- 172.21.15.81:0/3667773462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faea8159b40 0x7faea8155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faeae13a700 1 -- 172.21.15.81:0/3667773462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea0009ae0 con 0x7faea8068cc0 2023-10-07T08:43:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faeae93b700 1 --2- 172.21.15.81:0/3667773462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faea8159f10 0x7faea80b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.029+0000 7faead939700 1 --2- 172.21.15.81:0/3667773462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faea8159b40 0x7faea8155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.030+0000 7faeae13a700 1 --2- 172.21.15.81:0/3667773462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea8068cc0 0x7faea81557f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faea400c5d0 tx=0x7faea4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.030+0000 7fae9e7fc700 1 -- 172.21.15.81:0/3667773462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4011590 con 0x7faea8068cc0 2023-10-07T08:43:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.030+0000 7fae9e7fc700 1 -- 172.21.15.81:0/3667773462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea4011710 con 0x7faea8068cc0 2023-10-07T08:43:10.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.030+0000 7faeaf13c700 1 -- 172.21.15.81:0/3667773462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea815bf60 con 0x7faea8068cc0 2023-10-07T08:43:10.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.030+0000 7fae9e7fc700 1 -- 172.21.15.81:0/3667773462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4011ad0 con 0x7faea8068cc0 2023-10-07T08:43:10.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.030+0000 7faeaf13c700 1 -- 172.21.15.81:0/3667773462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea8159290 con 0x7faea8068cc0 2023-10-07T08:43:10.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.031+0000 7faeaf13c700 1 -- 172.21.15.81:0/3667773462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea8063e90 con 0x7faea8068cc0 2023-10-07T08:43:10.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.031+0000 7fae9e7fc700 1 -- 172.21.15.81:0/3667773462 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faea401c460 con 0x7faea8068cc0 2023-10-07T08:43:10.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.031+0000 7fae9e7fc700 1 --2- 172.21.15.81:0/3667773462 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fae8c066f30 0x7fae8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.032+0000 7fae9e7fc700 1 -- 172.21.15.81:0/3667773462 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faea40842f0 con 0x7faea8068cc0 2023-10-07T08:43:10.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.032+0000 7faead939700 1 --2- 172.21.15.81:0/3667773462 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fae8c066f30 0x7fae8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.032+0000 7faead939700 1 --2- 172.21.15.81:0/3667773462 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fae8c066f30 0x7fae8c0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faea80cc3a0 tx=0x7fae98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:10.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.036+0000 7fae9e7fc700 1 -- 172.21.15.81:0/3667773462 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faea4051560 con 0x7faea8068cc0 2023-10-07T08:43:10.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.213+0000 7faeaf13c700 1 -- 172.21.15.81:0/3667773462 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faea815bcb0 con 0x7fae8c066f30 2023-10-07T08:43:10.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.220+0000 7fae9e7fc700 1 -- 172.21.15.81:0/3667773462 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260178 (secure 0 0 0) 0x7faea815bcb0 con 0x7fae8c066f30 2023-10-07T08:43:10.224 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:10.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.223+0000 7faeaf13c700 1 -- 172.21.15.81:0/3667773462 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fae8c066f30 msgr2=0x7fae8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:10.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.223+0000 7faeaf13c700 1 --2- 172.21.15.81:0/3667773462 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fae8c066f30 0x7fae8c0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faea80cc3a0 tx=0x7fae98008040 comp rx=0 tx=0).stop 2023-10-07T08:43:10.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.223+0000 7faeaf13c700 1 -- 172.21.15.81:0/3667773462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea8068cc0 msgr2=0x7faea81557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:10.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.223+0000 7faeaf13c700 1 --2- 172.21.15.81:0/3667773462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea8068cc0 0x7faea81557f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faea400c5d0 tx=0x7faea4007f60 comp rx=0 tx=0).stop 2023-10-07T08:43:10.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.223+0000 7faeaf13c700 1 -- 172.21.15.81:0/3667773462 shutdown_connections 2023-10-07T08:43:10.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.223+0000 7faeaf13c700 1 --2- 172.21.15.81:0/3667773462 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fae8c066f30 0x7fae8c0693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.223+0000 7faeaf13c700 1 --2- 172.21.15.81:0/3667773462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faea8159f10 0x7faea80b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.223+0000 7faeaf13c700 1 --2- 172.21.15.81:0/3667773462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea8068cc0 0x7faea81557f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.223+0000 7faeaf13c700 1 --2- 172.21.15.81:0/3667773462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faea8159b40 0x7faea8155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.223+0000 7faeaf13c700 1 -- 172.21.15.81:0/3667773462 >> 172.21.15.81:0/3667773462 conn(0x7faea80cd660 msgr2=0x7faea806e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:10.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.223+0000 7faeaf13c700 1 -- 172.21.15.81:0/3667773462 shutdown_connections 2023-10-07T08:43:10.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.223+0000 7faeaf13c700 1 -- 172.21.15.81:0/3667773462 wait complete. 2023-10-07T08:43:10.227 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:43:10.236 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-07T08:43:10.008867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1744,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560755,"statfs":{"total":1600000000,"available":1598213428,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.758217"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271947+0000","last_change":"2023-10-07T08:42:57.271845+0000","last_active":"2023-10-07T08:42:57.271947+0000","last_peered":"2023-10-07T08:42:57.271947+0000","last_clean":"2023-10-07T08:42:57.271947+0000","last_became_active":"2023-10-07T08:42:57.271412+0000","last_became_peered":"2023-10-07T08:42:57.271412+0000","last_unstale":"2023-10-07T08:42:57.271947+0000","last_undegraded":"2023-10-07T08:42:57.271947+0000","last_fullsized":"2023-10-07T08:42:57.271947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:22:57.366438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.253974+0000","last_change":"2023-10-07T08:42:57.253759+0000","last_active":"2023-10-07T08:42:57.253974+0000","last_peered":"2023-10-07T08:42:57.253974+0000","last_clean":"2023-10-07T08:42:57.253974+0000","last_became_active":"2023-10-07T08:42:57.253082+0000","last_became_peered":"2023-10-07T08:42:57.253082+0000","last_unstale":"2023-10-07T08:42:57.253974+0000","last_undegraded":"2023-10-07T08:42:57.253974+0000","last_fullsized":"2023-10-07T08:42:57.253974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264034+0000","last_change":"2023-10-07T08:42:57.262591+0000","last_active":"2023-10-07T08:42:57.264034+0000","last_peered":"2023-10-07T08:42:57.264034+0000","last_clean":"2023-10-07T08:42:57.264034+0000","last_became_active":"2023-10-07T08:42:57.261995+0000","last_became_peered":"2023-10-07T08:42:57.261995+0000","last_unstale":"2023-10-07T08:42:57.264034+0000","last_undegraded":"2023-10-07T08:42:57.264034+0000","last_fullsized":"2023-10-07T08:42:57.264034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:29:20.004471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271767+0000","last_change":"2023-10-07T08:42:57.269368+0000","last_active":"2023-10-07T08:42:57.271767+0000","last_peered":"2023-10-07T08:42:57.271767+0000","last_clean":"2023-10-07T08:42:57.271767+0000","last_became_active":"2023-10-07T08:42:57.268405+0000","last_became_peered":"2023-10-07T08:42:57.268405+0000","last_unstale":"2023-10-07T08:42:57.271767+0000","last_undegraded":"2023-10-07T08:42:57.271767+0000","last_fullsized":"2023-10-07T08:42:57.271767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.085430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265889+0000","last_change":"2023-10-07T08:42:57.265724+0000","last_active":"2023-10-07T08:42:57.265889+0000","last_peered":"2023-10-07T08:42:57.265889+0000","last_clean":"2023-10-07T08:42:57.265889+0000","last_became_active":"2023-10-07T08:42:57.265407+0000","last_became_peered":"2023-10-07T08:42:57.265407+0000","last_unstale":"2023-10-07T08:42:57.265889+0000","last_undegraded":"2023-10-07T08:42:57.265889+0000","last_fullsized":"2023-10-07T08:42:57.265889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.085430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273257+0000","last_change":"2023-10-07T08:42:57.273165+0000","last_active":"2023-10-07T08:42:57.273257+0000","last_peered":"2023-10-07T08:42:57.273257+0000","last_clean":"2023-10-07T08:42:57.273257+0000","last_became_active":"2023-10-07T08:42:57.272429+0000","last_became_peered":"2023-10-07T08:42:57.272429+0000","last_unstale":"2023-10-07T08:42:57.273257+0000","last_undegraded":"2023-10-07T08:42:57.273257+0000","last_fullsized":"2023-10-07T08:42:57.273257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:07:27.370919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266193+0000","last_change":"2023-10-07T08:42:57.266102+0000","last_active":"2023-10-07T08:42:57.266193+0000","last_peered":"2023-10-07T08:42:57.266193+0000","last_clean":"2023-10-07T08:42:57.266193+0000","last_became_active":"2023-10-07T08:42:57.265848+0000","last_became_peered":"2023-10-07T08:42:57.265848+0000","last_unstale":"2023-10-07T08:42:57.266193+0000","last_undegraded":"2023-10-07T08:42:57.266193+0000","last_fullsized":"2023-10-07T08:42:57.266193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:11:19.626256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.254466+0000","last_change":"2023-10-07T08:42:57.254408+0000","last_active":"2023-10-07T08:42:57.254466+0000","last_peered":"2023-10-07T08:42:57.254466+0000","last_clean":"2023-10-07T08:42:57.254466+0000","last_became_active":"2023-10-07T08:42:57.254176+0000","last_became_peered":"2023-10-07T08:42:57.254176+0000","last_unstale":"2023-10-07T08:42:57.254466+0000","last_undegraded":"2023-10-07T08:42:57.254466+0000","last_fullsized":"2023-10-07T08:42:57.254466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273333+0000","last_change":"2023-10-07T08:42:57.272880+0000","last_active":"2023-10-07T08:42:57.273333+0000","last_peered":"2023-10-07T08:42:57.273333+0000","last_clean":"2023-10-07T08:42:57.273333+0000","last_became_active":"2023-10-07T08:42:57.272657+0000","last_became_peered":"2023-10-07T08:42:57.272657+0000","last_unstale":"2023-10-07T08:42:57.273333+0000","last_undegraded":"2023-10-07T08:42:57.273333+0000","last_fullsized":"2023-10-07T08:42:57.273333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:14.856162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269087+0000","last_change":"2023-10-07T08:42:57.268989+0000","last_active":"2023-10-07T08:42:57.269087+0000","last_peered":"2023-10-07T08:42:57.269087+0000","last_clean":"2023-10-07T08:42:57.269087+0000","last_became_active":"2023-10-07T08:42:57.268767+0000","last_became_peered":"2023-10-07T08:42:57.268767+0000","last_unstale":"2023-10-07T08:42:57.269087+0000","last_undegraded":"2023-10-07T08:42:57.269087+0000","last_fullsized":"2023-10-07T08:42:57.269087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:25:20.586749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273482+0000","last_change":"2023-10-07T08:42:57.273400+0000","last_active":"2023-10-07T08:42:57.273482+0000","last_peered":"2023-10-07T08:42:57.273482+0000","last_clean":"2023-10-07T08:42:57.273482+0000","last_became_active":"2023-10-07T08:42:57.273173+0000","last_became_peered":"2023-10-07T08:42:57.273173+0000","last_unstale":"2023-10-07T08:42:57.273482+0000","last_undegraded":"2023-10-07T08:42:57.273482+0000","last_fullsized":"2023-10-07T08:42:57.273482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261699+0000","last_change":"2023-10-07T08:42:57.261158+0000","last_active":"2023-10-07T08:42:57.261699+0000","last_peered":"2023-10-07T08:42:57.261699+0000","last_clean":"2023-10-07T08:42:57.261699+0000","last_became_active":"2023-10-07T08:42:57.260929+0000","last_became_peered":"2023-10-07T08:42:57.260929+0000","last_unstale":"2023-10-07T08:42:57.261699+0000","last_undegraded":"2023-10-07T08:42:57.261699+0000","last_fullsized":"2023-10-07T08:42:57.261699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:25.788730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261649+0000","last_change":"2023-10-07T08:42:57.261591+0000","last_active":"2023-10-07T08:42:57.261649+0000","last_peered":"2023-10-07T08:42:57.261649+0000","last_clean":"2023-10-07T08:42:57.261649+0000","last_became_active":"2023-10-07T08:42:57.261195+0000","last_became_peered":"2023-10-07T08:42:57.261195+0000","last_unstale":"2023-10-07T08:42:57.261649+0000","last_undegraded":"2023-10-07T08:42:57.261649+0000","last_fullsized":"2023-10-07T08:42:57.261649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.085430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255844+0000","last_change":"2023-10-07T08:42:57.255722+0000","last_active":"2023-10-07T08:42:57.255844+0000","last_peered":"2023-10-07T08:42:57.255844+0000","last_clean":"2023-10-07T08:42:57.255844+0000","last_became_active":"2023-10-07T08:42:57.255058+0000","last_became_peered":"2023-10-07T08:42:57.255058+0000","last_unstale":"2023-10-07T08:42:57.255844+0000","last_undegraded":"2023-10-07T08:42:57.255844+0000","last_fullsized":"2023-10-07T08:42:57.255844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258968+0000","last_change":"2023-10-07T08:42:57.258735+0000","last_active":"2023-10-07T08:42:57.258968+0000","last_peered":"2023-10-07T08:42:57.258968+0000","last_clean":"2023-10-07T08:42:57.258968+0000","last_became_active":"2023-10-07T08:42:57.258531+0000","last_became_peered":"2023-10-07T08:42:57.258531+0000","last_unstale":"2023-10-07T08:42:57.258968+0000","last_undegraded":"2023-10-07T08:42:57.258968+0000","last_fullsized":"2023-10-07T08:42:57.258968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273242+0000","last_change":"2023-10-07T08:42:57.273000+0000","last_active":"2023-10-07T08:42:57.273242+0000","last_peered":"2023-10-07T08:42:57.273242+0000","last_clean":"2023-10-07T08:42:57.273242+0000","last_became_active":"2023-10-07T08:42:57.272147+0000","last_became_peered":"2023-10-07T08:42:57.272147+0000","last_unstale":"2023-10-07T08:42:57.273242+0000","last_undegraded":"2023-10-07T08:42:57.273242+0000","last_fullsized":"2023-10-07T08:42:57.273242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273615+0000","last_change":"2023-10-07T08:42:57.273534+0000","last_active":"2023-10-07T08:42:57.273615+0000","last_peered":"2023-10-07T08:42:57.273615+0000","last_clean":"2023-10-07T08:42:57.273615+0000","last_became_active":"2023-10-07T08:42:57.272752+0000","last_became_peered":"2023-10-07T08:42:57.272752+0000","last_unstale":"2023-10-07T08:42:57.273615+0000","last_undegraded":"2023-10-07T08:42:57.273615+0000","last_fullsized":"2023-10-07T08:42:57.273615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:14.856162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260472+0000","last_change":"2023-10-07T08:42:57.260016+0000","last_active":"2023-10-07T08:42:57.260472+0000","last_peered":"2023-10-07T08:42:57.260472+0000","last_clean":"2023-10-07T08:42:57.260472+0000","last_became_active":"2023-10-07T08:42:57.259796+0000","last_became_peered":"2023-10-07T08:42:57.259796+0000","last_unstale":"2023-10-07T08:42:57.260472+0000","last_undegraded":"2023-10-07T08:42:57.260472+0000","last_fullsized":"2023-10-07T08:42:57.260472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:44.958113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271244+0000","last_change":"2023-10-07T08:42:57.266814+0000","last_active":"2023-10-07T08:42:57.271244+0000","last_peered":"2023-10-07T08:42:57.271244+0000","last_clean":"2023-10-07T08:42:57.271244+0000","last_became_active":"2023-10-07T08:42:57.266212+0000","last_became_peered":"2023-10-07T08:42:57.266212+0000","last_unstale":"2023-10-07T08:42:57.271244+0000","last_undegraded":"2023-10-07T08:42:57.271244+0000","last_fullsized":"2023-10-07T08:42:57.271244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:56.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265572+0000","last_change":"2023-10-07T08:42:56.259068+0000","last_active":"2023-10-07T08:42:57.265572+0000","last_peered":"2023-10-07T08:42:57.265572+0000","last_clean":"2023-10-07T08:42:57.265572+0000","last_became_active":"2023-10-07T08:42:56.258934+0000","last_became_peered":"2023-10-07T08:42:56.258934+0000","last_unstale":"2023-10-07T08:42:57.265572+0000","last_undegraded":"2023-10-07T08:42:57.265572+0000","last_fullsized":"2023-10-07T08:42:57.265572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264519+0000","last_change":"2023-10-07T08:42:57.264466+0000","last_active":"2023-10-07T08:42:57.264519+0000","last_peered":"2023-10-07T08:42:57.264519+0000","last_clean":"2023-10-07T08:42:57.264519+0000","last_became_active":"2023-10-07T08:42:57.263468+0000","last_became_peered":"2023-10-07T08:42:57.263468+0000","last_unstale":"2023-10-07T08:42:57.264519+0000","last_undegraded":"2023-10-07T08:42:57.264519+0000","last_fullsized":"2023-10-07T08:42:57.264519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:07.393104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264975+0000","last_change":"2023-10-07T08:42:56.257405+0000","last_active":"2023-10-07T08:42:57.264975+0000","last_peered":"2023-10-07T08:42:57.264975+0000","last_clean":"2023-10-07T08:42:57.264975+0000","last_became_active":"2023-10-07T08:42:56.257065+0000","last_became_peered":"2023-10-07T08:42:56.257065+0000","last_unstale":"2023-10-07T08:42:57.264975+0000","last_undegraded":"2023-10-07T08:42:57.264975+0000","last_fullsized":"2023-10-07T08:42:57.264975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267546+0000","last_change":"2023-10-07T08:42:57.267485+0000","last_active":"2023-10-07T08:42:57.267546+0000","last_peered":"2023-10-07T08:42:57.267546+0000","last_clean":"2023-10-07T08:42:57.267546+0000","last_became_active":"2023-10-07T08:42:57.267277+0000","last_became_peered":"2023-10-07T08:42:57.267277+0000","last_unstale":"2023-10-07T08:42:57.267546+0000","last_undegraded":"2023-10-07T08:42:57.267546+0000","last_fullsized":"2023-10-07T08:42:57.267546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:13:34.785663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271811+0000","last_change":"2023-10-07T08:42:56.260298+0000","last_active":"2023-10-07T08:42:57.271811+0000","last_peered":"2023-10-07T08:42:57.271811+0000","last_clean":"2023-10-07T08:42:57.271811+0000","last_became_active":"2023-10-07T08:42:56.260074+0000","last_became_peered":"2023-10-07T08:42:56.260074+0000","last_unstale":"2023-10-07T08:42:57.271811+0000","last_undegraded":"2023-10-07T08:42:57.271811+0000","last_fullsized":"2023-10-07T08:42:57.271811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:00:57.309769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273224+0000","last_change":"2023-10-07T08:42:57.272854+0000","last_active":"2023-10-07T08:42:57.273224+0000","last_peered":"2023-10-07T08:42:57.273224+0000","last_clean":"2023-10-07T08:42:57.273224+0000","last_became_active":"2023-10-07T08:42:57.271880+0000","last_became_peered":"2023-10-07T08:42:57.271880+0000","last_unstale":"2023-10-07T08:42:57.273224+0000","last_undegraded":"2023-10-07T08:42:57.273224+0000","last_fullsized":"2023-10-07T08:42:57.273224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:11:19.626256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273211+0000","last_change":"2023-10-07T08:42:56.263017+0000","last_active":"2023-10-07T08:42:57.273211+0000","last_peered":"2023-10-07T08:42:57.273211+0000","last_clean":"2023-10-07T08:42:57.273211+0000","last_became_active":"2023-10-07T08:42:56.262769+0000","last_became_peered":"2023-10-07T08:42:56.262769+0000","last_unstale":"2023-10-07T08:42:57.273211+0000","last_undegraded":"2023-10-07T08:42:57.273211+0000","last_fullsized":"2023-10-07T08:42:57.273211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:35:43.604383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271875+0000","last_change":"2023-10-07T08:42:57.271009+0000","last_active":"2023-10-07T08:42:57.271875+0000","last_peered":"2023-10-07T08:42:57.271875+0000","last_clean":"2023-10-07T08:42:57.271875+0000","last_became_active":"2023-10-07T08:42:57.270777+0000","last_became_peered":"2023-10-07T08:42:57.270777+0000","last_unstale":"2023-10-07T08:42:57.271875+0000","last_undegraded":"2023-10-07T08:42:57.271875+0000","last_fullsized":"2023-10-07T08:42:57.271875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261893+0000","last_change":"2023-10-07T08:42:56.257276+0000","last_active":"2023-10-07T08:42:57.261893+0000","last_peered":"2023-10-07T08:42:57.261893+0000","last_clean":"2023-10-07T08:42:57.261893+0000","last_became_active":"2023-10-07T08:42:56.257051+0000","last_became_peered":"2023-10-07T08:42:56.257051+0000","last_unstale":"2023-10-07T08:42:57.261893+0000","last_undegraded":"2023-10-07T08:42:57.261893+0000","last_fullsized":"2023-10-07T08:42:57.261893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.256705+0000","last_change":"2023-10-07T08:42:57.256645+0000","last_active":"2023-10-07T08:42:57.256705+0000","last_peered":"2023-10-07T08:42:57.256705+0000","last_clean":"2023-10-07T08:42:57.256705+0000","last_became_active":"2023-10-07T08:42:57.256312+0000","last_became_peered":"2023-10-07T08:42:57.256312+0000","last_unstale":"2023-10-07T08:42:57.256705+0000","last_undegraded":"2023-10-07T08:42:57.256705+0000","last_fullsized":"2023-10-07T08:42:57.256705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:44.958113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261595+0000","last_change":"2023-10-07T08:42:56.256216+0000","last_active":"2023-10-07T08:42:57.261595+0000","last_peered":"2023-10-07T08:42:57.261595+0000","last_clean":"2023-10-07T08:42:57.261595+0000","last_became_active":"2023-10-07T08:42:56.255763+0000","last_became_peered":"2023-10-07T08:42:56.255763+0000","last_unstale":"2023-10-07T08:42:57.261595+0000","last_undegraded":"2023-10-07T08:42:57.261595+0000","last_fullsized":"2023-10-07T08:42:57.261595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260680+0000","last_change":"2023-10-07T08:42:57.260111+0000","last_active":"2023-10-07T08:42:57.260680+0000","last_peered":"2023-10-07T08:42:57.260680+0000","last_clean":"2023-10-07T08:42:57.260680+0000","last_became_active":"2023-10-07T08:42:57.259887+0000","last_became_peered":"2023-10-07T08:42:57.259887+0000","last_unstale":"2023-10-07T08:42:57.260680+0000","last_undegraded":"2023-10-07T08:42:57.260680+0000","last_fullsized":"2023-10-07T08:42:57.260680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:07.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.249477+0000","last_change":"2023-10-07T08:42:56.256584+0000","last_active":"2023-10-07T08:42:57.249477+0000","last_peered":"2023-10-07T08:42:57.249477+0000","last_clean":"2023-10-07T08:42:57.249477+0000","last_became_active":"2023-10-07T08:42:56.256306+0000","last_became_peered":"2023-10-07T08:42:56.256306+0000","last_unstale":"2023-10-07T08:42:57.249477+0000","last_undegraded":"2023-10-07T08:42:57.249477+0000","last_fullsized":"2023-10-07T08:42:57.249477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255482+0000","last_change":"2023-10-07T08:42:57.255428+0000","last_active":"2023-10-07T08:42:57.255482+0000","last_peered":"2023-10-07T08:42:57.255482+0000","last_clean":"2023-10-07T08:42:57.255482+0000","last_became_active":"2023-10-07T08:42:57.255284+0000","last_became_peered":"2023-10-07T08:42:57.255284+0000","last_unstale":"2023-10-07T08:42:57.255482+0000","last_undegraded":"2023-10-07T08:42:57.255482+0000","last_fullsized":"2023-10-07T08:42:57.255482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267031+0000","last_change":"2023-10-07T08:42:56.260669+0000","last_active":"2023-10-07T08:42:57.267031+0000","last_peered":"2023-10-07T08:42:57.267031+0000","last_clean":"2023-10-07T08:42:57.267031+0000","last_became_active":"2023-10-07T08:42:56.260436+0000","last_became_peered":"2023-10-07T08:42:56.260436+0000","last_unstale":"2023-10-07T08:42:57.267031+0000","last_undegraded":"2023-10-07T08:42:57.267031+0000","last_fullsized":"2023-10-07T08:42:57.267031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:47:14.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.257501+0000","last_change":"2023-10-07T08:42:57.257451+0000","last_active":"2023-10-07T08:42:57.257501+0000","last_peered":"2023-10-07T08:42:57.257501+0000","last_clean":"2023-10-07T08:42:57.257501+0000","last_became_active":"2023-10-07T08:42:57.257263+0000","last_became_peered":"2023-10-07T08:42:57.257263+0000","last_unstale":"2023-10-07T08:42:57.257501+0000","last_undegraded":"2023-10-07T08:42:57.257501+0000","last_fullsized":"2023-10-07T08:42:57.257501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255592+0000","last_change":"2023-10-07T08:42:56.261241+0000","last_active":"2023-10-07T08:42:57.255592+0000","last_peered":"2023-10-07T08:42:57.255592+0000","last_clean":"2023-10-07T08:42:57.255592+0000","last_became_active":"2023-10-07T08:42:56.261003+0000","last_became_peered":"2023-10-07T08:42:56.261003+0000","last_unstale":"2023-10-07T08:42:57.255592+0000","last_undegraded":"2023-10-07T08:42:57.255592+0000","last_fullsized":"2023-10-07T08:42:57.255592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273393+0000","last_change":"2023-10-07T08:42:57.273272+0000","last_active":"2023-10-07T08:42:57.273393+0000","last_peered":"2023-10-07T08:42:57.273393+0000","last_clean":"2023-10-07T08:42:57.273393+0000","last_became_active":"2023-10-07T08:42:57.272090+0000","last_became_peered":"2023-10-07T08:42:57.272090+0000","last_unstale":"2023-10-07T08:42:57.273393+0000","last_undegraded":"2023-10-07T08:42:57.273393+0000","last_fullsized":"2023-10-07T08:42:57.273393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:48.342893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255238+0000","last_change":"2023-10-07T08:42:56.260346+0000","last_active":"2023-10-07T08:42:57.255238+0000","last_peered":"2023-10-07T08:42:57.255238+0000","last_clean":"2023-10-07T08:42:57.255238+0000","last_became_active":"2023-10-07T08:42:56.259661+0000","last_became_peered":"2023-10-07T08:42:56.259661+0000","last_unstale":"2023-10-07T08:42:57.255238+0000","last_undegraded":"2023-10-07T08:42:57.255238+0000","last_fullsized":"2023-10-07T08:42:57.255238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:21.295203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273960+0000","last_change":"2023-10-07T08:42:57.273913+0000","last_active":"2023-10-07T08:42:57.273960+0000","last_peered":"2023-10-07T08:42:57.273960+0000","last_clean":"2023-10-07T08:42:57.273960+0000","last_became_active":"2023-10-07T08:42:57.273631+0000","last_became_peered":"2023-10-07T08:42:57.273631+0000","last_unstale":"2023-10-07T08:42:57.273960+0000","last_undegraded":"2023-10-07T08:42:57.273960+0000","last_fullsized":"2023-10-07T08:42:57.273960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:07.393104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271888+0000","last_change":"2023-10-07T08:42:56.257713+0000","last_active":"2023-10-07T08:42:57.271888+0000","last_peered":"2023-10-07T08:42:57.271888+0000","last_clean":"2023-10-07T08:42:57.271888+0000","last_became_active":"2023-10-07T08:42:56.257481+0000","last_became_peered":"2023-10-07T08:42:56.257481+0000","last_unstale":"2023-10-07T08:42:57.271888+0000","last_undegraded":"2023-10-07T08:42:57.271888+0000","last_fullsized":"2023-10-07T08:42:57.271888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:43.953599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266459+0000","last_change":"2023-10-07T08:42:57.266396+0000","last_active":"2023-10-07T08:42:57.266459+0000","last_peered":"2023-10-07T08:42:57.266459+0000","last_clean":"2023-10-07T08:42:57.266459+0000","last_became_active":"2023-10-07T08:42:57.266029+0000","last_became_peered":"2023-10-07T08:42:57.266029+0000","last_unstale":"2023-10-07T08:42:57.266459+0000","last_undegraded":"2023-10-07T08:42:57.266459+0000","last_fullsized":"2023-10-07T08:42:57.266459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:22.299718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269611+0000","last_change":"2023-10-07T08:42:56.259429+0000","last_active":"2023-10-07T08:42:57.269611+0000","last_peered":"2023-10-07T08:42:57.269611+0000","last_clean":"2023-10-07T08:42:57.269611+0000","last_became_active":"2023-10-07T08:42:56.259154+0000","last_became_peered":"2023-10-07T08:42:56.259154+0000","last_unstale":"2023-10-07T08:42:57.269611+0000","last_undegraded":"2023-10-07T08:42:57.269611+0000","last_fullsized":"2023-10-07T08:42:57.269611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265027+0000","last_change":"2023-10-07T08:42:57.262943+0000","last_active":"2023-10-07T08:42:57.265027+0000","last_peered":"2023-10-07T08:42:57.265027+0000","last_clean":"2023-10-07T08:42:57.265027+0000","last_became_active":"2023-10-07T08:42:57.262707+0000","last_became_peered":"2023-10-07T08:42:57.262707+0000","last_unstale":"2023-10-07T08:42:57.265027+0000","last_undegraded":"2023-10-07T08:42:57.265027+0000","last_fullsized":"2023-10-07T08:42:57.265027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269382+0000","last_change":"2023-10-07T08:42:56.250565+0000","last_active":"2023-10-07T08:42:57.269382+0000","last_peered":"2023-10-07T08:42:57.269382+0000","last_clean":"2023-10-07T08:42:57.269382+0000","last_became_active":"2023-10-07T08:42:56.250326+0000","last_became_peered":"2023-10-07T08:42:56.250326+0000","last_unstale":"2023-10-07T08:42:57.269382+0000","last_undegraded":"2023-10-07T08:42:57.269382+0000","last_fullsized":"2023-10-07T08:42:57.269382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264073+0000","last_change":"2023-10-07T08:42:57.263608+0000","last_active":"2023-10-07T08:42:57.264073+0000","last_peered":"2023-10-07T08:42:57.264073+0000","last_clean":"2023-10-07T08:42:57.264073+0000","last_became_active":"2023-10-07T08:42:57.262971+0000","last_became_peered":"2023-10-07T08:42:57.262971+0000","last_unstale":"2023-10-07T08:42:57.264073+0000","last_undegraded":"2023-10-07T08:42:57.264073+0000","last_fullsized":"2023-10-07T08:42:57.264073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269407+0000","last_change":"2023-10-07T08:42:56.262332+0000","last_active":"2023-10-07T08:42:57.269407+0000","last_peered":"2023-10-07T08:42:57.269407+0000","last_clean":"2023-10-07T08:42:57.269407+0000","last_became_active":"2023-10-07T08:42:56.261913+0000","last_became_peered":"2023-10-07T08:42:56.261913+0000","last_unstale":"2023-10-07T08:42:57.269407+0000","last_undegraded":"2023-10-07T08:42:57.269407+0000","last_fullsized":"2023-10-07T08:42:57.269407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:47.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273297+0000","last_change":"2023-10-07T08:42:57.271943+0000","last_active":"2023-10-07T08:42:57.273297+0000","last_peered":"2023-10-07T08:42:57.273297+0000","last_clean":"2023-10-07T08:42:57.273297+0000","last_became_active":"2023-10-07T08:42:57.271217+0000","last_became_peered":"2023-10-07T08:42:57.271217+0000","last_unstale":"2023-10-07T08:42:57.273297+0000","last_undegraded":"2023-10-07T08:42:57.273297+0000","last_fullsized":"2023-10-07T08:42:57.273297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:07:27.370919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.259993+0000","last_change":"2023-10-07T08:42:56.259497+0000","last_active":"2023-10-07T08:42:57.259993+0000","last_peered":"2023-10-07T08:42:57.259993+0000","last_clean":"2023-10-07T08:42:57.259993+0000","last_became_active":"2023-10-07T08:42:56.259259+0000","last_became_peered":"2023-10-07T08:42:56.259259+0000","last_unstale":"2023-10-07T08:42:57.259993+0000","last_undegraded":"2023-10-07T08:42:57.259993+0000","last_fullsized":"2023-10-07T08:42:57.259993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:47.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267342+0000","last_change":"2023-10-07T08:42:57.264611+0000","last_active":"2023-10-07T08:42:57.267342+0000","last_peered":"2023-10-07T08:42:57.267342+0000","last_clean":"2023-10-07T08:42:57.267342+0000","last_became_active":"2023-10-07T08:42:57.264371+0000","last_became_peered":"2023-10-07T08:42:57.264371+0000","last_unstale":"2023-10-07T08:42:57.267342+0000","last_undegraded":"2023-10-07T08:42:57.267342+0000","last_fullsized":"2023-10-07T08:42:57.267342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.262375+0000","last_change":"2023-10-07T08:42:56.254762+0000","last_active":"2023-10-07T08:42:57.262375+0000","last_peered":"2023-10-07T08:42:57.262375+0000","last_clean":"2023-10-07T08:42:57.262375+0000","last_became_active":"2023-10-07T08:42:56.254460+0000","last_became_peered":"2023-10-07T08:42:56.254460+0000","last_unstale":"2023-10-07T08:42:57.262375+0000","last_undegraded":"2023-10-07T08:42:57.262375+0000","last_fullsized":"2023-10-07T08:42:57.262375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265088+0000","last_change":"2023-10-07T08:42:57.264712+0000","last_active":"2023-10-07T08:42:57.265088+0000","last_peered":"2023-10-07T08:42:57.265088+0000","last_clean":"2023-10-07T08:42:57.265088+0000","last_became_active":"2023-10-07T08:42:57.264380+0000","last_became_peered":"2023-10-07T08:42:57.264380+0000","last_unstale":"2023-10-07T08:42:57.265088+0000","last_undegraded":"2023-10-07T08:42:57.265088+0000","last_fullsized":"2023-10-07T08:42:57.265088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:48.342893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.257527+0000","last_change":"2023-10-07T08:42:56.253642+0000","last_active":"2023-10-07T08:42:57.257527+0000","last_peered":"2023-10-07T08:42:57.257527+0000","last_clean":"2023-10-07T08:42:57.257527+0000","last_became_active":"2023-10-07T08:42:56.253183+0000","last_became_peered":"2023-10-07T08:42:56.253183+0000","last_unstale":"2023-10-07T08:42:57.257527+0000","last_undegraded":"2023-10-07T08:42:57.257527+0000","last_fullsized":"2023-10-07T08:42:57.257527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:35.495354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273316+0000","last_change":"2023-10-07T08:42:57.272080+0000","last_active":"2023-10-07T08:42:57.273316+0000","last_peered":"2023-10-07T08:42:57.273316+0000","last_clean":"2023-10-07T08:42:57.273316+0000","last_became_active":"2023-10-07T08:42:57.271505+0000","last_became_peered":"2023-10-07T08:42:57.271505+0000","last_unstale":"2023-10-07T08:42:57.273316+0000","last_undegraded":"2023-10-07T08:42:57.273316+0000","last_fullsized":"2023-10-07T08:42:57.273316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:29.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.251426+0000","last_change":"2023-10-07T08:42:56.253289+0000","last_active":"2023-10-07T08:42:57.251426+0000","last_peered":"2023-10-07T08:42:57.251426+0000","last_clean":"2023-10-07T08:42:57.251426+0000","last_became_active":"2023-10-07T08:42:56.253058+0000","last_became_peered":"2023-10-07T08:42:56.253058+0000","last_unstale":"2023-10-07T08:42:57.251426+0000","last_undegraded":"2023-10-07T08:42:57.251426+0000","last_fullsized":"2023-10-07T08:42:57.251426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271749+0000","last_change":"2023-10-07T08:42:57.269245+0000","last_active":"2023-10-07T08:42:57.271749+0000","last_peered":"2023-10-07T08:42:57.271749+0000","last_clean":"2023-10-07T08:42:57.271749+0000","last_became_active":"2023-10-07T08:42:57.268139+0000","last_became_peered":"2023-10-07T08:42:57.268139+0000","last_unstale":"2023-10-07T08:42:57.271749+0000","last_undegraded":"2023-10-07T08:42:57.271749+0000","last_fullsized":"2023-10-07T08:42:57.271749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:56.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255341+0000","last_change":"2023-10-07T08:42:56.262012+0000","last_active":"2023-10-07T08:42:57.255341+0000","last_peered":"2023-10-07T08:42:57.255341+0000","last_clean":"2023-10-07T08:42:57.255341+0000","last_became_active":"2023-10-07T08:42:56.261812+0000","last_became_peered":"2023-10-07T08:42:56.261812+0000","last_unstale":"2023-10-07T08:42:57.255341+0000","last_undegraded":"2023-10-07T08:42:57.255341+0000","last_fullsized":"2023-10-07T08:42:57.255341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:43.953599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264986+0000","last_change":"2023-10-07T08:42:57.264887+0000","last_active":"2023-10-07T08:42:57.264986+0000","last_peered":"2023-10-07T08:42:57.264986+0000","last_clean":"2023-10-07T08:42:57.264986+0000","last_became_active":"2023-10-07T08:42:57.264651+0000","last_became_peered":"2023-10-07T08:42:57.264651+0000","last_unstale":"2023-10-07T08:42:57.264986+0000","last_undegraded":"2023-10-07T08:42:57.264986+0000","last_fullsized":"2023-10-07T08:42:57.264986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:32.698757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.252401+0000","last_change":"2023-10-07T08:42:57.252321+0000","last_active":"2023-10-07T08:42:57.252401+0000","last_peered":"2023-10-07T08:42:57.252401+0000","last_clean":"2023-10-07T08:42:57.252401+0000","last_became_active":"2023-10-07T08:42:57.252102+0000","last_became_peered":"2023-10-07T08:42:57.252102+0000","last_unstale":"2023-10-07T08:42:57.252401+0000","last_undegraded":"2023-10-07T08:42:57.252401+0000","last_fullsized":"2023-10-07T08:42:57.252401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:07.393104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.250654+0000","last_change":"2023-10-07T08:42:56.255406+0000","last_active":"2023-10-07T08:42:57.250654+0000","last_peered":"2023-10-07T08:42:57.250654+0000","last_clean":"2023-10-07T08:42:57.250654+0000","last_became_active":"2023-10-07T08:42:56.255167+0000","last_became_peered":"2023-10-07T08:42:56.255167+0000","last_unstale":"2023-10-07T08:42:57.250654+0000","last_undegraded":"2023-10-07T08:42:57.250654+0000","last_fullsized":"2023-10-07T08:42:57.250654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.268877+0000","last_change":"2023-10-07T08:42:57.268830+0000","last_active":"2023-10-07T08:42:57.268877+0000","last_peered":"2023-10-07T08:42:57.268877+0000","last_clean":"2023-10-07T08:42:57.268877+0000","last_became_active":"2023-10-07T08:42:57.268514+0000","last_became_peered":"2023-10-07T08:42:57.268514+0000","last_unstale":"2023-10-07T08:42:57.268877+0000","last_undegraded":"2023-10-07T08:42:57.268877+0000","last_fullsized":"2023-10-07T08:42:57.268877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:56.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269521+0000","last_change":"2023-10-07T08:42:56.262059+0000","last_active":"2023-10-07T08:42:57.269521+0000","last_peered":"2023-10-07T08:42:57.269521+0000","last_clean":"2023-10-07T08:42:57.269521+0000","last_became_active":"2023-10-07T08:42:56.260888+0000","last_became_peered":"2023-10-07T08:42:56.260888+0000","last_unstale":"2023-10-07T08:42:57.269521+0000","last_undegraded":"2023-10-07T08:42:57.269521+0000","last_fullsized":"2023-10-07T08:42:57.269521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.262180+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:42:57.262180+0000","last_peered":"2023-10-07T08:42:57.262180+0000","last_clean":"2023-10-07T08:42:57.262180+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:42:57.262180+0000","last_undegraded":"2023-10-07T08:42:57.262180+0000","last_fullsized":"2023-10-07T08:42:57.262180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264015+0000","last_change":"2023-10-07T08:42:57.262498+0000","last_active":"2023-10-07T08:42:57.264015+0000","last_peered":"2023-10-07T08:42:57.264015+0000","last_clean":"2023-10-07T08:42:57.264015+0000","last_became_active":"2023-10-07T08:42:57.261704+0000","last_became_peered":"2023-10-07T08:42:57.261704+0000","last_unstale":"2023-10-07T08:42:57.264015+0000","last_undegraded":"2023-10-07T08:42:57.264015+0000","last_fullsized":"2023-10-07T08:42:57.264015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260276+0000","last_change":"2023-10-07T08:42:56.259333+0000","last_active":"2023-10-07T08:42:57.260276+0000","last_peered":"2023-10-07T08:42:57.260276+0000","last_clean":"2023-10-07T08:42:57.260276+0000","last_became_active":"2023-10-07T08:42:56.259178+0000","last_became_peered":"2023-10-07T08:42:56.259178+0000","last_unstale":"2023-10-07T08:42:57.260276+0000","last_undegraded":"2023-10-07T08:42:57.260276+0000","last_fullsized":"2023-10-07T08:42:57.260276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:43.953599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260369+0000","last_change":"2023-10-07T08:42:56.262061+0000","last_active":"2023-10-07T08:42:57.260369+0000","last_peered":"2023-10-07T08:42:57.260369+0000","last_clean":"2023-10-07T08:42:57.260369+0000","last_became_active":"2023-10-07T08:42:56.261842+0000","last_became_peered":"2023-10-07T08:42:56.261842+0000","last_unstale":"2023-10-07T08:42:57.260369+0000","last_undegraded":"2023-10-07T08:42:57.260369+0000","last_fullsized":"2023-10-07T08:42:57.260369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.254098+0000","last_change":"2023-10-07T08:42:57.253993+0000","last_active":"2023-10-07T08:42:57.254098+0000","last_peered":"2023-10-07T08:42:57.254098+0000","last_clean":"2023-10-07T08:42:57.254098+0000","last_became_active":"2023-10-07T08:42:57.253775+0000","last_became_peered":"2023-10-07T08:42:57.253775+0000","last_unstale":"2023-10-07T08:42:57.254098+0000","last_undegraded":"2023-10-07T08:42:57.254098+0000","last_fullsized":"2023-10-07T08:42:57.254098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-07T08:42:58.827418+0000","last_change":"2023-10-07T08:42:56.256312+0000","last_active":"2023-10-07T08:42:58.827418+0000","last_peered":"2023-10-07T08:42:58.827418+0000","last_clean":"2023-10-07T08:42:58.827418+0000","last_became_active":"2023-10-07T08:42:56.256095+0000","last_became_peered":"2023-10-07T08:42:56.256095+0000","last_unstale":"2023-10-07T08:42:58.827418+0000","last_undegraded":"2023-10-07T08:42:58.827418+0000","last_fullsized":"2023-10-07T08:42:58.827418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:21.295203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266691+0000","last_change":"2023-10-07T08:42:57.266642+0000","last_active":"2023-10-07T08:42:57.266691+0000","last_peered":"2023-10-07T08:42:57.266691+0000","last_clean":"2023-10-07T08:42:57.266691+0000","last_became_active":"2023-10-07T08:42:57.266480+0000","last_became_peered":"2023-10-07T08:42:57.266480+0000","last_unstale":"2023-10-07T08:42:57.266691+0000","last_undegraded":"2023-10-07T08:42:57.266691+0000","last_fullsized":"2023-10-07T08:42:57.266691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:07.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271789+0000","last_change":"2023-10-07T08:42:56.257795+0000","last_active":"2023-10-07T08:42:57.271789+0000","last_peered":"2023-10-07T08:42:57.271789+0000","last_clean":"2023-10-07T08:42:57.271789+0000","last_became_active":"2023-10-07T08:42:56.257560+0000","last_became_peered":"2023-10-07T08:42:56.257560+0000","last_unstale":"2023-10-07T08:42:57.271789+0000","last_undegraded":"2023-10-07T08:42:57.271789+0000","last_fullsized":"2023-10-07T08:42:57.271789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.263996+0000","last_change":"2023-10-07T08:42:57.262219+0000","last_active":"2023-10-07T08:42:57.263996+0000","last_peered":"2023-10-07T08:42:57.263996+0000","last_clean":"2023-10-07T08:42:57.263996+0000","last_became_active":"2023-10-07T08:42:57.261413+0000","last_became_peered":"2023-10-07T08:42:57.261413+0000","last_unstale":"2023-10-07T08:42:57.263996+0000","last_undegraded":"2023-10-07T08:42:57.263996+0000","last_fullsized":"2023-10-07T08:42:57.263996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:25:20.586749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261906+0000","last_change":"2023-10-07T08:42:56.258484+0000","last_active":"2023-10-07T08:42:57.261906+0000","last_peered":"2023-10-07T08:42:57.261906+0000","last_clean":"2023-10-07T08:42:57.261906+0000","last_became_active":"2023-10-07T08:42:56.258243+0000","last_became_peered":"2023-10-07T08:42:56.258243+0000","last_unstale":"2023-10-07T08:42:57.261906+0000","last_undegraded":"2023-10-07T08:42:57.261906+0000","last_fullsized":"2023-10-07T08:42:57.261906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:24.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258408+0000","last_change":"2023-10-07T08:42:57.258345+0000","last_active":"2023-10-07T08:42:57.258408+0000","last_peered":"2023-10-07T08:42:57.258408+0000","last_clean":"2023-10-07T08:42:57.258408+0000","last_became_active":"2023-10-07T08:42:57.257563+0000","last_became_peered":"2023-10-07T08:42:57.257563+0000","last_unstale":"2023-10-07T08:42:57.258408+0000","last_undegraded":"2023-10-07T08:42:57.258408+0000","last_fullsized":"2023-10-07T08:42:57.258408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:00:58.314283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.251512+0000","last_change":"2023-10-07T08:42:56.259479+0000","last_active":"2023-10-07T08:42:57.251512+0000","last_peered":"2023-10-07T08:42:57.251512+0000","last_clean":"2023-10-07T08:42:57.251512+0000","last_became_active":"2023-10-07T08:42:56.259257+0000","last_became_peered":"2023-10-07T08:42:56.259257+0000","last_unstale":"2023-10-07T08:42:57.251512+0000","last_undegraded":"2023-10-07T08:42:57.251512+0000","last_fullsized":"2023-10-07T08:42:57.251512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:00:57.309769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.253038+0000","last_change":"2023-10-07T08:42:57.252823+0000","last_active":"2023-10-07T08:42:57.253038+0000","last_peered":"2023-10-07T08:42:57.253038+0000","last_clean":"2023-10-07T08:42:57.253038+0000","last_became_active":"2023-10-07T08:42:57.252606+0000","last_became_peered":"2023-10-07T08:42:57.252606+0000","last_unstale":"2023-10-07T08:42:57.253038+0000","last_undegraded":"2023-10-07T08:42:57.253038+0000","last_fullsized":"2023-10-07T08:42:57.253038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:25.788730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.251872+0000","last_change":"2023-10-07T08:42:56.255715+0000","last_active":"2023-10-07T08:42:57.251872+0000","last_peered":"2023-10-07T08:42:57.251872+0000","last_clean":"2023-10-07T08:42:57.251872+0000","last_became_active":"2023-10-07T08:42:56.255502+0000","last_became_peered":"2023-10-07T08:42:56.255502+0000","last_unstale":"2023-10-07T08:42:57.251872+0000","last_undegraded":"2023-10-07T08:42:57.251872+0000","last_fullsized":"2023-10-07T08:42:57.251872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:47:14.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261586+0000","last_change":"2023-10-07T08:42:57.261460+0000","last_active":"2023-10-07T08:42:57.261586+0000","last_peered":"2023-10-07T08:42:57.261586+0000","last_clean":"2023-10-07T08:42:57.261586+0000","last_became_active":"2023-10-07T08:42:57.260893+0000","last_became_peered":"2023-10-07T08:42:57.260893+0000","last_unstale":"2023-10-07T08:42:57.261586+0000","last_undegraded":"2023-10-07T08:42:57.261586+0000","last_fullsized":"2023-10-07T08:42:57.261586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273745+0000","last_change":"2023-10-07T08:42:56.258635+0000","last_active":"2023-10-07T08:42:57.273745+0000","last_peered":"2023-10-07T08:42:57.273745+0000","last_clean":"2023-10-07T08:42:57.273745+0000","last_became_active":"2023-10-07T08:42:56.258323+0000","last_became_peered":"2023-10-07T08:42:56.258323+0000","last_unstale":"2023-10-07T08:42:57.273745+0000","last_undegraded":"2023-10-07T08:42:57.273745+0000","last_fullsized":"2023-10-07T08:42:57.273745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260549+0000","last_change":"2023-10-07T08:42:57.259849+0000","last_active":"2023-10-07T08:42:57.260549+0000","last_peered":"2023-10-07T08:42:57.260549+0000","last_clean":"2023-10-07T08:42:57.260549+0000","last_became_active":"2023-10-07T08:42:57.259625+0000","last_became_peered":"2023-10-07T08:42:57.259625+0000","last_unstale":"2023-10-07T08:42:57.260549+0000","last_undegraded":"2023-10-07T08:42:57.260549+0000","last_fullsized":"2023-10-07T08:42:57.260549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.250640+0000","last_change":"2023-10-07T08:42:56.260384+0000","last_active":"2023-10-07T08:42:57.250640+0000","last_peered":"2023-10-07T08:42:57.250640+0000","last_clean":"2023-10-07T08:42:57.250640+0000","last_became_active":"2023-10-07T08:42:56.260141+0000","last_became_peered":"2023-10-07T08:42:56.260141+0000","last_unstale":"2023-10-07T08:42:57.250640+0000","last_undegraded":"2023-10-07T08:42:57.250640+0000","last_fullsized":"2023-10-07T08:42:57.250640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.274600+0000","last_change":"2023-10-07T08:42:57.273820+0000","last_active":"2023-10-07T08:42:57.274600+0000","last_peered":"2023-10-07T08:42:57.274600+0000","last_clean":"2023-10-07T08:42:57.274600+0000","last_became_active":"2023-10-07T08:42:57.273591+0000","last_became_peered":"2023-10-07T08:42:57.273591+0000","last_unstale":"2023-10-07T08:42:57.274600+0000","last_undegraded":"2023-10-07T08:42:57.274600+0000","last_fullsized":"2023-10-07T08:42:57.274600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:56.744706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261775+0000","last_change":"2023-10-07T08:42:56.253272+0000","last_active":"2023-10-07T08:42:57.261775+0000","last_peered":"2023-10-07T08:42:57.261775+0000","last_clean":"2023-10-07T08:42:57.261775+0000","last_became_active":"2023-10-07T08:42:56.253029+0000","last_became_peered":"2023-10-07T08:42:56.253029+0000","last_unstale":"2023-10-07T08:42:57.261775+0000","last_undegraded":"2023-10-07T08:42:57.261775+0000","last_fullsized":"2023-10-07T08:42:57.261775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:47.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266923+0000","last_change":"2023-10-07T08:42:57.266372+0000","last_active":"2023-10-07T08:42:57.266923+0000","last_peered":"2023-10-07T08:42:57.266923+0000","last_clean":"2023-10-07T08:42:57.266923+0000","last_became_active":"2023-10-07T08:42:57.266237+0000","last_became_peered":"2023-10-07T08:42:57.266237+0000","last_unstale":"2023-10-07T08:42:57.266923+0000","last_undegraded":"2023-10-07T08:42:57.266923+0000","last_fullsized":"2023-10-07T08:42:57.266923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:29.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264466+0000","last_change":"2023-10-07T08:42:56.257581+0000","last_active":"2023-10-07T08:42:57.264466+0000","last_peered":"2023-10-07T08:42:57.264466+0000","last_clean":"2023-10-07T08:42:57.264466+0000","last_became_active":"2023-10-07T08:42:56.257339+0000","last_became_peered":"2023-10-07T08:42:56.257339+0000","last_unstale":"2023-10-07T08:42:57.264466+0000","last_undegraded":"2023-10-07T08:42:57.264466+0000","last_fullsized":"2023-10-07T08:42:57.264466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:40.492004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266968+0000","last_change":"2023-10-07T08:42:57.266483+0000","last_active":"2023-10-07T08:42:57.266968+0000","last_peered":"2023-10-07T08:42:57.266968+0000","last_clean":"2023-10-07T08:42:57.266968+0000","last_became_active":"2023-10-07T08:42:57.265437+0000","last_became_peered":"2023-10-07T08:42:57.265437+0000","last_unstale":"2023-10-07T08:42:57.266968+0000","last_undegraded":"2023-10-07T08:42:57.266968+0000","last_fullsized":"2023-10-07T08:42:57.266968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:38.758746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260567+0000","last_change":"2023-10-07T08:42:57.260425+0000","last_active":"2023-10-07T08:42:57.260567+0000","last_peered":"2023-10-07T08:42:57.260567+0000","last_clean":"2023-10-07T08:42:57.260567+0000","last_became_active":"2023-10-07T08:42:57.260226+0000","last_became_peered":"2023-10-07T08:42:57.260226+0000","last_unstale":"2023-10-07T08:42:57.260567+0000","last_undegraded":"2023-10-07T08:42:57.260567+0000","last_fullsized":"2023-10-07T08:42:57.260567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273197+0000","last_change":"2023-10-07T08:42:57.273144+0000","last_active":"2023-10-07T08:42:57.273197+0000","last_peered":"2023-10-07T08:42:57.273197+0000","last_clean":"2023-10-07T08:42:57.273197+0000","last_became_active":"2023-10-07T08:42:57.273008+0000","last_became_peered":"2023-10-07T08:42:57.273008+0000","last_unstale":"2023-10-07T08:42:57.273197+0000","last_undegraded":"2023-10-07T08:42:57.273197+0000","last_fullsized":"2023-10-07T08:42:57.273197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:22.299718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271790+0000","last_change":"2023-10-07T08:42:57.270102+0000","last_active":"2023-10-07T08:42:57.271790+0000","last_peered":"2023-10-07T08:42:57.271790+0000","last_clean":"2023-10-07T08:42:57.271790+0000","last_became_active":"2023-10-07T08:42:57.269871+0000","last_became_peered":"2023-10-07T08:42:57.269871+0000","last_unstale":"2023-10-07T08:42:57.271790+0000","last_undegraded":"2023-10-07T08:42:57.271790+0000","last_fullsized":"2023-10-07T08:42:57.271790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:22:57.366438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255941+0000","last_change":"2023-10-07T08:42:57.255880+0000","last_active":"2023-10-07T08:42:57.255941+0000","last_peered":"2023-10-07T08:42:57.255941+0000","last_clean":"2023-10-07T08:42:57.255941+0000","last_became_active":"2023-10-07T08:42:57.255498+0000","last_became_peered":"2023-10-07T08:42:57.255498+0000","last_unstale":"2023-10-07T08:42:57.255941+0000","last_undegraded":"2023-10-07T08:42:57.255941+0000","last_fullsized":"2023-10-07T08:42:57.255941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258178+0000","last_change":"2023-10-07T08:42:57.257694+0000","last_active":"2023-10-07T08:42:57.258178+0000","last_peered":"2023-10-07T08:42:57.258178+0000","last_clean":"2023-10-07T08:42:57.258178+0000","last_became_active":"2023-10-07T08:42:57.257200+0000","last_became_peered":"2023-10-07T08:42:57.257200+0000","last_unstale":"2023-10-07T08:42:57.258178+0000","last_undegraded":"2023-10-07T08:42:57.258178+0000","last_fullsized":"2023-10-07T08:42:57.258178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.253992+0000","last_change":"2023-10-07T08:42:57.253904+0000","last_active":"2023-10-07T08:42:57.253992+0000","last_peered":"2023-10-07T08:42:57.253992+0000","last_clean":"2023-10-07T08:42:57.253992+0000","last_became_active":"2023-10-07T08:42:57.253374+0000","last_became_peered":"2023-10-07T08:42:57.253374+0000","last_unstale":"2023-10-07T08:42:57.253992+0000","last_undegraded":"2023-10-07T08:42:57.253992+0000","last_fullsized":"2023-10-07T08:42:57.253992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267322+0000","last_change":"2023-10-07T08:42:57.264162+0000","last_active":"2023-10-07T08:42:57.267322+0000","last_peered":"2023-10-07T08:42:57.267322+0000","last_clean":"2023-10-07T08:42:57.267322+0000","last_became_active":"2023-10-07T08:42:57.263947+0000","last_became_peered":"2023-10-07T08:42:57.263947+0000","last_unstale":"2023-10-07T08:42:57.267322+0000","last_undegraded":"2023-10-07T08:42:57.267322+0000","last_fullsized":"2023-10-07T08:42:57.267322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:07.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.256643+0000","last_change":"2023-10-07T08:42:57.256601+0000","last_active":"2023-10-07T08:42:57.256643+0000","last_peered":"2023-10-07T08:42:57.256643+0000","last_clean":"2023-10-07T08:42:57.256643+0000","last_became_active":"2023-10-07T08:42:57.256421+0000","last_became_peered":"2023-10-07T08:42:57.256421+0000","last_unstale":"2023-10-07T08:42:57.256643+0000","last_undegraded":"2023-10-07T08:42:57.256643+0000","last_fullsized":"2023-10-07T08:42:57.256643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271714+0000","last_change":"2023-10-07T08:42:57.268643+0000","last_active":"2023-10-07T08:42:57.271714+0000","last_peered":"2023-10-07T08:42:57.271714+0000","last_clean":"2023-10-07T08:42:57.271714+0000","last_became_active":"2023-10-07T08:42:57.267817+0000","last_became_peered":"2023-10-07T08:42:57.267817+0000","last_unstale":"2023-10-07T08:42:57.271714+0000","last_undegraded":"2023-10-07T08:42:57.271714+0000","last_fullsized":"2023-10-07T08:42:57.271714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258195+0000","last_change":"2023-10-07T08:42:57.257831+0000","last_active":"2023-10-07T08:42:57.258195+0000","last_peered":"2023-10-07T08:42:57.258195+0000","last_clean":"2023-10-07T08:42:57.258195+0000","last_became_active":"2023-10-07T08:42:57.257484+0000","last_became_peered":"2023-10-07T08:42:57.257484+0000","last_unstale":"2023-10-07T08:42:57.258195+0000","last_undegraded":"2023-10-07T08:42:57.258195+0000","last_fullsized":"2023-10-07T08:42:57.258195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273509+0000","last_change":"2023-10-07T08:42:57.273405+0000","last_active":"2023-10-07T08:42:57.273509+0000","last_peered":"2023-10-07T08:42:57.273509+0000","last_clean":"2023-10-07T08:42:57.273509+0000","last_became_active":"2023-10-07T08:42:57.272454+0000","last_became_peered":"2023-10-07T08:42:57.272454+0000","last_unstale":"2023-10-07T08:42:57.273509+0000","last_undegraded":"2023-10-07T08:42:57.273509+0000","last_fullsized":"2023-10-07T08:42:57.273509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:38.758746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264089+0000","last_change":"2023-10-07T08:42:57.263789+0000","last_active":"2023-10-07T08:42:57.264089+0000","last_peered":"2023-10-07T08:42:57.264089+0000","last_clean":"2023-10-07T08:42:57.264089+0000","last_became_active":"2023-10-07T08:42:57.263348+0000","last_became_peered":"2023-10-07T08:42:57.263348+0000","last_unstale":"2023-10-07T08:42:57.264089+0000","last_undegraded":"2023-10-07T08:42:57.264089+0000","last_fullsized":"2023-10-07T08:42:57.264089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260531+0000","last_change":"2023-10-07T08:42:57.259213+0000","last_active":"2023-10-07T08:42:57.260531+0000","last_peered":"2023-10-07T08:42:57.260531+0000","last_clean":"2023-10-07T08:42:57.260531+0000","last_became_active":"2023-10-07T08:42:57.258976+0000","last_became_peered":"2023-10-07T08:42:57.258976+0000","last_unstale":"2023-10-07T08:42:57.260531+0000","last_undegraded":"2023-10-07T08:42:57.260531+0000","last_fullsized":"2023-10-07T08:42:57.260531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:29:20.004471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199333925,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199923311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924687,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333869,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924847,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.187}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199923311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924721,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924757,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]}]}],"pool_statfs":[]}} 2023-10-07T08:43:10.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:43:10.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.391+0000 7efdf759e700 1 Processor -- start 2023-10-07T08:43:10.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.391+0000 7efdf759e700 1 -- start start 2023-10-07T08:43:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.392+0000 7efdf759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efdf80cf060 0x7efdf80b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.392+0000 7efdf759e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efdf8159f90 0x7efdf806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.392+0000 7efdf759e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf8067640 con 0x7efdf8159bc0 2023-10-07T08:43:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.392+0000 7efdf759e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf80b1e50 con 0x7efdf80cf060 2023-10-07T08:43:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.392+0000 7efdf759e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf8067890 con 0x7efdf8159f90 2023-10-07T08:43:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.392+0000 7efdf5d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efdf80cf060 0x7efdf80b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.392+0000 7efdf5d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efdf80cf060 0x7efdf80b17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45234/0 (socket says 172.21.15.81:45234) 2023-10-07T08:43:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.392+0000 7efdf5d9b700 1 -- 172.21.15.81:0/731650827 learned_addr learned my addr 172.21.15.81:0/731650827 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.392+0000 7efdf6d9d700 1 --2- 172.21.15.81:0/731650827 >> v2:172.21.15.89:3300/0 conn(0x7efdf8159f90 0x7efdf806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.392+0000 7efdf5d9b700 1 -- 172.21.15.81:0/731650827 >> v2:172.21.15.89:3300/0 conn(0x7efdf8159f90 msgr2=0x7efdf806b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.392+0000 7efdf5d9b700 1 --2- 172.21.15.81:0/731650827 >> v2:172.21.15.89:3300/0 conn(0x7efdf8159f90 0x7efdf806b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.392+0000 7efdf5d9b700 1 -- 172.21.15.81:0/731650827 >> v1:172.21.15.89:6789/0 conn(0x7efdf8159bc0 legacy=0x7efdf80ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.392+0000 7efdf5d9b700 1 -- 172.21.15.81:0/731650827 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf8067b70 con 0x7efdf80cf060 2023-10-07T08:43:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.392+0000 7efdf6d9d700 1 --2- 172.21.15.81:0/731650827 >> v2:172.21.15.89:3300/0 conn(0x7efdf8159f90 0x7efdf806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.392+0000 7efdf5d9b700 1 --2- 172.21.15.81:0/731650827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf80cf060 0x7efdf80b17c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efdf80b2a40 tx=0x7efdec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c627737d77c769 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.393+0000 7efdf559a700 1 -- 172.21.15.81:0/731650827 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec00b860 con 0x7efdf80cf060 2023-10-07T08:43:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.393+0000 7efdf559a700 1 -- 172.21.15.81:0/731650827 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec00b9c0 con 0x7efdf80cf060 2023-10-07T08:43:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.393+0000 7efdf559a700 1 -- 172.21.15.81:0/731650827 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec00bd60 con 0x7efdf80cf060 2023-10-07T08:43:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.393+0000 7efdf759e700 1 -- 172.21.15.81:0/731650827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf80cf060 msgr2=0x7efdf80b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.393+0000 7efdf759e700 1 --2- 172.21.15.81:0/731650827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf80cf060 0x7efdf80b17c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efdf80b2a40 tx=0x7efdec009250 comp rx=0 tx=0).stop 2023-10-07T08:43:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.393+0000 7efdf759e700 1 -- 172.21.15.81:0/731650827 shutdown_connections 2023-10-07T08:43:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.393+0000 7efdf759e700 1 --2- 172.21.15.81:0/731650827 >> v2:172.21.15.89:3300/0 conn(0x7efdf8159f90 0x7efdf806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.393+0000 7efdf759e700 1 --2- 172.21.15.81:0/731650827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf80cf060 0x7efdf80b17c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.393+0000 7efdf759e700 1 -- 172.21.15.81:0/731650827 >> 172.21.15.81:0/731650827 conn(0x7efdf806c620 msgr2=0x7efdf806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:10.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.393+0000 7efdf759e700 1 -- 172.21.15.81:0/731650827 shutdown_connections 2023-10-07T08:43:10.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.393+0000 7efdf759e700 1 -- 172.21.15.81:0/731650827 wait complete. 2023-10-07T08:43:10.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.394+0000 7efdf759e700 1 Processor -- start 2023-10-07T08:43:10.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.394+0000 7efdf759e700 1 -- start start 2023-10-07T08:43:10.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.395+0000 7efdf759e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efdf80cf060 0x7efdf8156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.395+0000 7efdf759e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdf8159bc0 0x7efdf8158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.395+0000 7efdf759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf8159f90 0x7efdf816cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.395+0000 7efdf759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf80af3a0 con 0x7efdf8159f90 2023-10-07T08:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.395+0000 7efdf759e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf81576f0 con 0x7efdf8159bc0 2023-10-07T08:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.395+0000 7efdf759e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf80af640 con 0x7efdf80cf060 2023-10-07T08:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.395+0000 7efdf6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf8159f90 0x7efdf816cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.395+0000 7efdf6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf8159f90 0x7efdf816cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45246/0 (socket says 172.21.15.81:45246) 2023-10-07T08:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.395+0000 7efdf6d9d700 1 -- 172.21.15.81:0/2392280022 learned_addr learned my addr 172.21.15.81:0/2392280022 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.395+0000 7efdf659c700 1 --2- 172.21.15.81:0/2392280022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efdf80cf060 0x7efdf8156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.395+0000 7efdf5d9b700 1 --2- 172.21.15.81:0/2392280022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdf8159bc0 0x7efdf8158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.395+0000 7efdf6d9d700 1 -- 172.21.15.81:0/2392280022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efdf80cf060 msgr2=0x7efdf8156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.395+0000 7efdf6d9d700 1 --2- 172.21.15.81:0/2392280022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efdf80cf060 0x7efdf8156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.395+0000 7efdf6d9d700 1 -- 172.21.15.81:0/2392280022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdf8159bc0 msgr2=0x7efdf8158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.395+0000 7efdf6d9d700 1 --2- 172.21.15.81:0/2392280022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdf8159bc0 0x7efdf8158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.395+0000 7efdf6d9d700 1 -- 172.21.15.81:0/2392280022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec0094f0 con 0x7efdf8159f90 2023-10-07T08:43:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.396+0000 7efdf6d9d700 1 --2- 172.21.15.81:0/2392280022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf8159f90 0x7efdf816cd10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efde800e870 tx=0x7efde8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.396+0000 7efde67fc700 1 -- 172.21.15.81:0/2392280022 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8013410 con 0x7efdf8159f90 2023-10-07T08:43:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.396+0000 7efde67fc700 1 -- 172.21.15.81:0/2392280022 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde8013570 con 0x7efdf8159f90 2023-10-07T08:43:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.396+0000 7efdf759e700 1 -- 172.21.15.81:0/2392280022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf80af920 con 0x7efdf8159f90 2023-10-07T08:43:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.396+0000 7efde67fc700 1 -- 172.21.15.81:0/2392280022 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80138f0 con 0x7efdf8159f90 2023-10-07T08:43:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.396+0000 7efdf759e700 1 -- 172.21.15.81:0/2392280022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf8157330 con 0x7efdf8159f90 2023-10-07T08:43:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.397+0000 7efdf759e700 1 -- 172.21.15.81:0/2392280022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf8069920 con 0x7efdf8159f90 2023-10-07T08:43:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.397+0000 7efde67fc700 1 -- 172.21.15.81:0/2392280022 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efde8013ca0 con 0x7efdf8159f90 2023-10-07T08:43:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.397+0000 7efde67fc700 1 --2- 172.21.15.81:0/2392280022 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdd8066f30 0x7efdd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.398+0000 7efde67fc700 1 -- 172.21.15.81:0/2392280022 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efde8084190 con 0x7efdf8159f90 2023-10-07T08:43:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.398+0000 7efdf659c700 1 --2- 172.21.15.81:0/2392280022 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdd8066f30 0x7efdd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.398+0000 7efdf659c700 1 --2- 172.21.15.81:0/2392280022 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdd8066f30 0x7efdd80693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efdf0007fd0 tx=0x7efdf00016f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.401+0000 7efde67fc700 1 -- 172.21.15.81:0/2392280022 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efde8054e90 con 0x7efdf8159f90 2023-10-07T08:43:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.579+0000 7efdf759e700 1 -- 172.21.15.81:0/2392280022 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efdf80ad580 con 0x7efdd8066f30 2023-10-07T08:43:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.586+0000 7efde67fc700 1 -- 172.21.15.81:0/2392280022 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260178 (secure 0 0 0) 0x7efdf80ad580 con 0x7efdd8066f30 2023-10-07T08:43:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.589+0000 7efdf759e700 1 -- 172.21.15.81:0/2392280022 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdd8066f30 msgr2=0x7efdd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.589+0000 7efdf759e700 1 --2- 172.21.15.81:0/2392280022 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdd8066f30 0x7efdd80693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efdf0007fd0 tx=0x7efdf00016f0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.589+0000 7efdf759e700 1 -- 172.21.15.81:0/2392280022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf8159f90 msgr2=0x7efdf816cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.589+0000 7efdf759e700 1 --2- 172.21.15.81:0/2392280022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf8159f90 0x7efdf816cd10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efde800e870 tx=0x7efde8008040 comp rx=0 tx=0).stop 2023-10-07T08:43:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.589+0000 7efdf759e700 1 -- 172.21.15.81:0/2392280022 shutdown_connections 2023-10-07T08:43:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.589+0000 7efdf759e700 1 --2- 172.21.15.81:0/2392280022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf8159f90 0x7efdf816cd10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.589+0000 7efdf759e700 1 --2- 172.21.15.81:0/2392280022 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdd8066f30 0x7efdd80693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.589+0000 7efdf759e700 1 --2- 172.21.15.81:0/2392280022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efdf80cf060 0x7efdf8156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.589+0000 7efdf759e700 1 --2- 172.21.15.81:0/2392280022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdf8159bc0 0x7efdf8158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.589+0000 7efdf759e700 1 -- 172.21.15.81:0/2392280022 >> 172.21.15.81:0/2392280022 conn(0x7efdf806c620 msgr2=0x7efdf8154530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.589+0000 7efdf759e700 1 -- 172.21.15.81:0/2392280022 shutdown_connections 2023-10-07T08:43:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.589+0000 7efdf759e700 1 -- 172.21.15.81:0/2392280022 wait complete. 2023-10-07T08:43:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:43:10.602 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-07T08:43:10.008867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1744,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560755,"statfs":{"total":1600000000,"available":1598213428,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.758217"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271947+0000","last_change":"2023-10-07T08:42:57.271845+0000","last_active":"2023-10-07T08:42:57.271947+0000","last_peered":"2023-10-07T08:42:57.271947+0000","last_clean":"2023-10-07T08:42:57.271947+0000","last_became_active":"2023-10-07T08:42:57.271412+0000","last_became_peered":"2023-10-07T08:42:57.271412+0000","last_unstale":"2023-10-07T08:42:57.271947+0000","last_undegraded":"2023-10-07T08:42:57.271947+0000","last_fullsized":"2023-10-07T08:42:57.271947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:22:57.366438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.253974+0000","last_change":"2023-10-07T08:42:57.253759+0000","last_active":"2023-10-07T08:42:57.253974+0000","last_peered":"2023-10-07T08:42:57.253974+0000","last_clean":"2023-10-07T08:42:57.253974+0000","last_became_active":"2023-10-07T08:42:57.253082+0000","last_became_peered":"2023-10-07T08:42:57.253082+0000","last_unstale":"2023-10-07T08:42:57.253974+0000","last_undegraded":"2023-10-07T08:42:57.253974+0000","last_fullsized":"2023-10-07T08:42:57.253974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264034+0000","last_change":"2023-10-07T08:42:57.262591+0000","last_active":"2023-10-07T08:42:57.264034+0000","last_peered":"2023-10-07T08:42:57.264034+0000","last_clean":"2023-10-07T08:42:57.264034+0000","last_became_active":"2023-10-07T08:42:57.261995+0000","last_became_peered":"2023-10-07T08:42:57.261995+0000","last_unstale":"2023-10-07T08:42:57.264034+0000","last_undegraded":"2023-10-07T08:42:57.264034+0000","last_fullsized":"2023-10-07T08:42:57.264034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:29:20.004471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271767+0000","last_change":"2023-10-07T08:42:57.269368+0000","last_active":"2023-10-07T08:42:57.271767+0000","last_peered":"2023-10-07T08:42:57.271767+0000","last_clean":"2023-10-07T08:42:57.271767+0000","last_became_active":"2023-10-07T08:42:57.268405+0000","last_became_peered":"2023-10-07T08:42:57.268405+0000","last_unstale":"2023-10-07T08:42:57.271767+0000","last_undegraded":"2023-10-07T08:42:57.271767+0000","last_fullsized":"2023-10-07T08:42:57.271767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.085430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265889+0000","last_change":"2023-10-07T08:42:57.265724+0000","last_active":"2023-10-07T08:42:57.265889+0000","last_peered":"2023-10-07T08:42:57.265889+0000","last_clean":"2023-10-07T08:42:57.265889+0000","last_became_active":"2023-10-07T08:42:57.265407+0000","last_became_peered":"2023-10-07T08:42:57.265407+0000","last_unstale":"2023-10-07T08:42:57.265889+0000","last_undegraded":"2023-10-07T08:42:57.265889+0000","last_fullsized":"2023-10-07T08:42:57.265889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.085430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273257+0000","last_change":"2023-10-07T08:42:57.273165+0000","last_active":"2023-10-07T08:42:57.273257+0000","last_peered":"2023-10-07T08:42:57.273257+0000","last_clean":"2023-10-07T08:42:57.273257+0000","last_became_active":"2023-10-07T08:42:57.272429+0000","last_became_peered":"2023-10-07T08:42:57.272429+0000","last_unstale":"2023-10-07T08:42:57.273257+0000","last_undegraded":"2023-10-07T08:42:57.273257+0000","last_fullsized":"2023-10-07T08:42:57.273257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:07:27.370919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266193+0000","last_change":"2023-10-07T08:42:57.266102+0000","last_active":"2023-10-07T08:42:57.266193+0000","last_peered":"2023-10-07T08:42:57.266193+0000","last_clean":"2023-10-07T08:42:57.266193+0000","last_became_active":"2023-10-07T08:42:57.265848+0000","last_became_peered":"2023-10-07T08:42:57.265848+0000","last_unstale":"2023-10-07T08:42:57.266193+0000","last_undegraded":"2023-10-07T08:42:57.266193+0000","last_fullsized":"2023-10-07T08:42:57.266193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:11:19.626256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.254466+0000","last_change":"2023-10-07T08:42:57.254408+0000","last_active":"2023-10-07T08:42:57.254466+0000","last_peered":"2023-10-07T08:42:57.254466+0000","last_clean":"2023-10-07T08:42:57.254466+0000","last_became_active":"2023-10-07T08:42:57.254176+0000","last_became_peered":"2023-10-07T08:42:57.254176+0000","last_unstale":"2023-10-07T08:42:57.254466+0000","last_undegraded":"2023-10-07T08:42:57.254466+0000","last_fullsized":"2023-10-07T08:42:57.254466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273333+0000","last_change":"2023-10-07T08:42:57.272880+0000","last_active":"2023-10-07T08:42:57.273333+0000","last_peered":"2023-10-07T08:42:57.273333+0000","last_clean":"2023-10-07T08:42:57.273333+0000","last_became_active":"2023-10-07T08:42:57.272657+0000","last_became_peered":"2023-10-07T08:42:57.272657+0000","last_unstale":"2023-10-07T08:42:57.273333+0000","last_undegraded":"2023-10-07T08:42:57.273333+0000","last_fullsized":"2023-10-07T08:42:57.273333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:14.856162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269087+0000","last_change":"2023-10-07T08:42:57.268989+0000","last_active":"2023-10-07T08:42:57.269087+0000","last_peered":"2023-10-07T08:42:57.269087+0000","last_clean":"2023-10-07T08:42:57.269087+0000","last_became_active":"2023-10-07T08:42:57.268767+0000","last_became_peered":"2023-10-07T08:42:57.268767+0000","last_unstale":"2023-10-07T08:42:57.269087+0000","last_undegraded":"2023-10-07T08:42:57.269087+0000","last_fullsized":"2023-10-07T08:42:57.269087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:25:20.586749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273482+0000","last_change":"2023-10-07T08:42:57.273400+0000","last_active":"2023-10-07T08:42:57.273482+0000","last_peered":"2023-10-07T08:42:57.273482+0000","last_clean":"2023-10-07T08:42:57.273482+0000","last_became_active":"2023-10-07T08:42:57.273173+0000","last_became_peered":"2023-10-07T08:42:57.273173+0000","last_unstale":"2023-10-07T08:42:57.273482+0000","last_undegraded":"2023-10-07T08:42:57.273482+0000","last_fullsized":"2023-10-07T08:42:57.273482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261699+0000","last_change":"2023-10-07T08:42:57.261158+0000","last_active":"2023-10-07T08:42:57.261699+0000","last_peered":"2023-10-07T08:42:57.261699+0000","last_clean":"2023-10-07T08:42:57.261699+0000","last_became_active":"2023-10-07T08:42:57.260929+0000","last_became_peered":"2023-10-07T08:42:57.260929+0000","last_unstale":"2023-10-07T08:42:57.261699+0000","last_undegraded":"2023-10-07T08:42:57.261699+0000","last_fullsized":"2023-10-07T08:42:57.261699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:25.788730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261649+0000","last_change":"2023-10-07T08:42:57.261591+0000","last_active":"2023-10-07T08:42:57.261649+0000","last_peered":"2023-10-07T08:42:57.261649+0000","last_clean":"2023-10-07T08:42:57.261649+0000","last_became_active":"2023-10-07T08:42:57.261195+0000","last_became_peered":"2023-10-07T08:42:57.261195+0000","last_unstale":"2023-10-07T08:42:57.261649+0000","last_undegraded":"2023-10-07T08:42:57.261649+0000","last_fullsized":"2023-10-07T08:42:57.261649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.085430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255844+0000","last_change":"2023-10-07T08:42:57.255722+0000","last_active":"2023-10-07T08:42:57.255844+0000","last_peered":"2023-10-07T08:42:57.255844+0000","last_clean":"2023-10-07T08:42:57.255844+0000","last_became_active":"2023-10-07T08:42:57.255058+0000","last_became_peered":"2023-10-07T08:42:57.255058+0000","last_unstale":"2023-10-07T08:42:57.255844+0000","last_undegraded":"2023-10-07T08:42:57.255844+0000","last_fullsized":"2023-10-07T08:42:57.255844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258968+0000","last_change":"2023-10-07T08:42:57.258735+0000","last_active":"2023-10-07T08:42:57.258968+0000","last_peered":"2023-10-07T08:42:57.258968+0000","last_clean":"2023-10-07T08:42:57.258968+0000","last_became_active":"2023-10-07T08:42:57.258531+0000","last_became_peered":"2023-10-07T08:42:57.258531+0000","last_unstale":"2023-10-07T08:42:57.258968+0000","last_undegraded":"2023-10-07T08:42:57.258968+0000","last_fullsized":"2023-10-07T08:42:57.258968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273242+0000","last_change":"2023-10-07T08:42:57.273000+0000","last_active":"2023-10-07T08:42:57.273242+0000","last_peered":"2023-10-07T08:42:57.273242+0000","last_clean":"2023-10-07T08:42:57.273242+0000","last_became_active":"2023-10-07T08:42:57.272147+0000","last_became_peered":"2023-10-07T08:42:57.272147+0000","last_unstale":"2023-10-07T08:42:57.273242+0000","last_undegraded":"2023-10-07T08:42:57.273242+0000","last_fullsized":"2023-10-07T08:42:57.273242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273615+0000","last_change":"2023-10-07T08:42:57.273534+0000","last_active":"2023-10-07T08:42:57.273615+0000","last_peered":"2023-10-07T08:42:57.273615+0000","last_clean":"2023-10-07T08:42:57.273615+0000","last_became_active":"2023-10-07T08:42:57.272752+0000","last_became_peered":"2023-10-07T08:42:57.272752+0000","last_unstale":"2023-10-07T08:42:57.273615+0000","last_undegraded":"2023-10-07T08:42:57.273615+0000","last_fullsized":"2023-10-07T08:42:57.273615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:14.856162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260472+0000","last_change":"2023-10-07T08:42:57.260016+0000","last_active":"2023-10-07T08:42:57.260472+0000","last_peered":"2023-10-07T08:42:57.260472+0000","last_clean":"2023-10-07T08:42:57.260472+0000","last_became_active":"2023-10-07T08:42:57.259796+0000","last_became_peered":"2023-10-07T08:42:57.259796+0000","last_unstale":"2023-10-07T08:42:57.260472+0000","last_undegraded":"2023-10-07T08:42:57.260472+0000","last_fullsized":"2023-10-07T08:42:57.260472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:44.958113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271244+0000","last_change":"2023-10-07T08:42:57.266814+0000","last_active":"2023-10-07T08:42:57.271244+0000","last_peered":"2023-10-07T08:42:57.271244+0000","last_clean":"2023-10-07T08:42:57.271244+0000","last_became_active":"2023-10-07T08:42:57.266212+0000","last_became_peered":"2023-10-07T08:42:57.266212+0000","last_unstale":"2023-10-07T08:42:57.271244+0000","last_undegraded":"2023-10-07T08:42:57.271244+0000","last_fullsized":"2023-10-07T08:42:57.271244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:56.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265572+0000","last_change":"2023-10-07T08:42:56.259068+0000","last_active":"2023-10-07T08:42:57.265572+0000","last_peered":"2023-10-07T08:42:57.265572+0000","last_clean":"2023-10-07T08:42:57.265572+0000","last_became_active":"2023-10-07T08:42:56.258934+0000","last_became_peered":"2023-10-07T08:42:56.258934+0000","last_unstale":"2023-10-07T08:42:57.265572+0000","last_undegraded":"2023-10-07T08:42:57.265572+0000","last_fullsized":"2023-10-07T08:42:57.265572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264519+0000","last_change":"2023-10-07T08:42:57.264466+0000","last_active":"2023-10-07T08:42:57.264519+0000","last_peered":"2023-10-07T08:42:57.264519+0000","last_clean":"2023-10-07T08:42:57.264519+0000","last_became_active":"2023-10-07T08:42:57.263468+0000","last_became_peered":"2023-10-07T08:42:57.263468+0000","last_unstale":"2023-10-07T08:42:57.264519+0000","last_undegraded":"2023-10-07T08:42:57.264519+0000","last_fullsized":"2023-10-07T08:42:57.264519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:07.393104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264975+0000","last_change":"2023-10-07T08:42:56.257405+0000","last_active":"2023-10-07T08:42:57.264975+0000","last_peered":"2023-10-07T08:42:57.264975+0000","last_clean":"2023-10-07T08:42:57.264975+0000","last_became_active":"2023-10-07T08:42:56.257065+0000","last_became_peered":"2023-10-07T08:42:56.257065+0000","last_unstale":"2023-10-07T08:42:57.264975+0000","last_undegraded":"2023-10-07T08:42:57.264975+0000","last_fullsized":"2023-10-07T08:42:57.264975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267546+0000","last_change":"2023-10-07T08:42:57.267485+0000","last_active":"2023-10-07T08:42:57.267546+0000","last_peered":"2023-10-07T08:42:57.267546+0000","last_clean":"2023-10-07T08:42:57.267546+0000","last_became_active":"2023-10-07T08:42:57.267277+0000","last_became_peered":"2023-10-07T08:42:57.267277+0000","last_unstale":"2023-10-07T08:42:57.267546+0000","last_undegraded":"2023-10-07T08:42:57.267546+0000","last_fullsized":"2023-10-07T08:42:57.267546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:13:34.785663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271811+0000","last_change":"2023-10-07T08:42:56.260298+0000","last_active":"2023-10-07T08:42:57.271811+0000","last_peered":"2023-10-07T08:42:57.271811+0000","last_clean":"2023-10-07T08:42:57.271811+0000","last_became_active":"2023-10-07T08:42:56.260074+0000","last_became_peered":"2023-10-07T08:42:56.260074+0000","last_unstale":"2023-10-07T08:42:57.271811+0000","last_undegraded":"2023-10-07T08:42:57.271811+0000","last_fullsized":"2023-10-07T08:42:57.271811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:00:57.309769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273224+0000","last_change":"2023-10-07T08:42:57.272854+0000","last_active":"2023-10-07T08:42:57.273224+0000","last_peered":"2023-10-07T08:42:57.273224+0000","last_clean":"2023-10-07T08:42:57.273224+0000","last_became_active":"2023-10-07T08:42:57.271880+0000","last_became_peered":"2023-10-07T08:42:57.271880+0000","last_unstale":"2023-10-07T08:42:57.273224+0000","last_undegraded":"2023-10-07T08:42:57.273224+0000","last_fullsized":"2023-10-07T08:42:57.273224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:11:19.626256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273211+0000","last_change":"2023-10-07T08:42:56.263017+0000","last_active":"2023-10-07T08:42:57.273211+0000","last_peered":"2023-10-07T08:42:57.273211+0000","last_clean":"2023-10-07T08:42:57.273211+0000","last_became_active":"2023-10-07T08:42:56.262769+0000","last_became_peered":"2023-10-07T08:42:56.262769+0000","last_unstale":"2023-10-07T08:42:57.273211+0000","last_undegraded":"2023-10-07T08:42:57.273211+0000","last_fullsized":"2023-10-07T08:42:57.273211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:35:43.604383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271875+0000","last_change":"2023-10-07T08:42:57.271009+0000","last_active":"2023-10-07T08:42:57.271875+0000","last_peered":"2023-10-07T08:42:57.271875+0000","last_clean":"2023-10-07T08:42:57.271875+0000","last_became_active":"2023-10-07T08:42:57.270777+0000","last_became_peered":"2023-10-07T08:42:57.270777+0000","last_unstale":"2023-10-07T08:42:57.271875+0000","last_undegraded":"2023-10-07T08:42:57.271875+0000","last_fullsized":"2023-10-07T08:42:57.271875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261893+0000","last_change":"2023-10-07T08:42:56.257276+0000","last_active":"2023-10-07T08:42:57.261893+0000","last_peered":"2023-10-07T08:42:57.261893+0000","last_clean":"2023-10-07T08:42:57.261893+0000","last_became_active":"2023-10-07T08:42:56.257051+0000","last_became_peered":"2023-10-07T08:42:56.257051+0000","last_unstale":"2023-10-07T08:42:57.261893+0000","last_undegraded":"2023-10-07T08:42:57.261893+0000","last_fullsized":"2023-10-07T08:42:57.261893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.256705+0000","last_change":"2023-10-07T08:42:57.256645+0000","last_active":"2023-10-07T08:42:57.256705+0000","last_peered":"2023-10-07T08:42:57.256705+0000","last_clean":"2023-10-07T08:42:57.256705+0000","last_became_active":"2023-10-07T08:42:57.256312+0000","last_became_peered":"2023-10-07T08:42:57.256312+0000","last_unstale":"2023-10-07T08:42:57.256705+0000","last_undegraded":"2023-10-07T08:42:57.256705+0000","last_fullsized":"2023-10-07T08:42:57.256705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:44.958113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261595+0000","last_change":"2023-10-07T08:42:56.256216+0000","last_active":"2023-10-07T08:42:57.261595+0000","last_peered":"2023-10-07T08:42:57.261595+0000","last_clean":"2023-10-07T08:42:57.261595+0000","last_became_active":"2023-10-07T08:42:56.255763+0000","last_became_peered":"2023-10-07T08:42:56.255763+0000","last_unstale":"2023-10-07T08:42:57.261595+0000","last_undegraded":"2023-10-07T08:42:57.261595+0000","last_fullsized":"2023-10-07T08:42:57.261595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260680+0000","last_change":"2023-10-07T08:42:57.260111+0000","last_active":"2023-10-07T08:42:57.260680+0000","last_peered":"2023-10-07T08:42:57.260680+0000","last_clean":"2023-10-07T08:42:57.260680+0000","last_became_active":"2023-10-07T08:42:57.259887+0000","last_became_peered":"2023-10-07T08:42:57.259887+0000","last_unstale":"2023-10-07T08:42:57.260680+0000","last_undegraded":"2023-10-07T08:42:57.260680+0000","last_fullsized":"2023-10-07T08:42:57.260680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:07.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.249477+0000","last_change":"2023-10-07T08:42:56.256584+0000","last_active":"2023-10-07T08:42:57.249477+0000","last_peered":"2023-10-07T08:42:57.249477+0000","last_clean":"2023-10-07T08:42:57.249477+0000","last_became_active":"2023-10-07T08:42:56.256306+0000","last_became_peered":"2023-10-07T08:42:56.256306+0000","last_unstale":"2023-10-07T08:42:57.249477+0000","last_undegraded":"2023-10-07T08:42:57.249477+0000","last_fullsized":"2023-10-07T08:42:57.249477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255482+0000","last_change":"2023-10-07T08:42:57.255428+0000","last_active":"2023-10-07T08:42:57.255482+0000","last_peered":"2023-10-07T08:42:57.255482+0000","last_clean":"2023-10-07T08:42:57.255482+0000","last_became_active":"2023-10-07T08:42:57.255284+0000","last_became_peered":"2023-10-07T08:42:57.255284+0000","last_unstale":"2023-10-07T08:42:57.255482+0000","last_undegraded":"2023-10-07T08:42:57.255482+0000","last_fullsized":"2023-10-07T08:42:57.255482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267031+0000","last_change":"2023-10-07T08:42:56.260669+0000","last_active":"2023-10-07T08:42:57.267031+0000","last_peered":"2023-10-07T08:42:57.267031+0000","last_clean":"2023-10-07T08:42:57.267031+0000","last_became_active":"2023-10-07T08:42:56.260436+0000","last_became_peered":"2023-10-07T08:42:56.260436+0000","last_unstale":"2023-10-07T08:42:57.267031+0000","last_undegraded":"2023-10-07T08:42:57.267031+0000","last_fullsized":"2023-10-07T08:42:57.267031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:47:14.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.257501+0000","last_change":"2023-10-07T08:42:57.257451+0000","last_active":"2023-10-07T08:42:57.257501+0000","last_peered":"2023-10-07T08:42:57.257501+0000","last_clean":"2023-10-07T08:42:57.257501+0000","last_became_active":"2023-10-07T08:42:57.257263+0000","last_became_peered":"2023-10-07T08:42:57.257263+0000","last_unstale":"2023-10-07T08:42:57.257501+0000","last_undegraded":"2023-10-07T08:42:57.257501+0000","last_fullsized":"2023-10-07T08:42:57.257501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255592+0000","last_change":"2023-10-07T08:42:56.261241+0000","last_active":"2023-10-07T08:42:57.255592+0000","last_peered":"2023-10-07T08:42:57.255592+0000","last_clean":"2023-10-07T08:42:57.255592+0000","last_became_active":"2023-10-07T08:42:56.261003+0000","last_became_peered":"2023-10-07T08:42:56.261003+0000","last_unstale":"2023-10-07T08:42:57.255592+0000","last_undegraded":"2023-10-07T08:42:57.255592+0000","last_fullsized":"2023-10-07T08:42:57.255592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273393+0000","last_change":"2023-10-07T08:42:57.273272+0000","last_active":"2023-10-07T08:42:57.273393+0000","last_peered":"2023-10-07T08:42:57.273393+0000","last_clean":"2023-10-07T08:42:57.273393+0000","last_became_active":"2023-10-07T08:42:57.272090+0000","last_became_peered":"2023-10-07T08:42:57.272090+0000","last_unstale":"2023-10-07T08:42:57.273393+0000","last_undegraded":"2023-10-07T08:42:57.273393+0000","last_fullsized":"2023-10-07T08:42:57.273393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:48.342893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255238+0000","last_change":"2023-10-07T08:42:56.260346+0000","last_active":"2023-10-07T08:42:57.255238+0000","last_peered":"2023-10-07T08:42:57.255238+0000","last_clean":"2023-10-07T08:42:57.255238+0000","last_became_active":"2023-10-07T08:42:56.259661+0000","last_became_peered":"2023-10-07T08:42:56.259661+0000","last_unstale":"2023-10-07T08:42:57.255238+0000","last_undegraded":"2023-10-07T08:42:57.255238+0000","last_fullsized":"2023-10-07T08:42:57.255238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:21.295203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273960+0000","last_change":"2023-10-07T08:42:57.273913+0000","last_active":"2023-10-07T08:42:57.273960+0000","last_peered":"2023-10-07T08:42:57.273960+0000","last_clean":"2023-10-07T08:42:57.273960+0000","last_became_active":"2023-10-07T08:42:57.273631+0000","last_became_peered":"2023-10-07T08:42:57.273631+0000","last_unstale":"2023-10-07T08:42:57.273960+0000","last_undegraded":"2023-10-07T08:42:57.273960+0000","last_fullsized":"2023-10-07T08:42:57.273960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:07.393104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271888+0000","last_change":"2023-10-07T08:42:56.257713+0000","last_active":"2023-10-07T08:42:57.271888+0000","last_peered":"2023-10-07T08:42:57.271888+0000","last_clean":"2023-10-07T08:42:57.271888+0000","last_became_active":"2023-10-07T08:42:56.257481+0000","last_became_peered":"2023-10-07T08:42:56.257481+0000","last_unstale":"2023-10-07T08:42:57.271888+0000","last_undegraded":"2023-10-07T08:42:57.271888+0000","last_fullsized":"2023-10-07T08:42:57.271888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:43.953599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266459+0000","last_change":"2023-10-07T08:42:57.266396+0000","last_active":"2023-10-07T08:42:57.266459+0000","last_peered":"2023-10-07T08:42:57.266459+0000","last_clean":"2023-10-07T08:42:57.266459+0000","last_became_active":"2023-10-07T08:42:57.266029+0000","last_became_peered":"2023-10-07T08:42:57.266029+0000","last_unstale":"2023-10-07T08:42:57.266459+0000","last_undegraded":"2023-10-07T08:42:57.266459+0000","last_fullsized":"2023-10-07T08:42:57.266459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:22.299718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269611+0000","last_change":"2023-10-07T08:42:56.259429+0000","last_active":"2023-10-07T08:42:57.269611+0000","last_peered":"2023-10-07T08:42:57.269611+0000","last_clean":"2023-10-07T08:42:57.269611+0000","last_became_active":"2023-10-07T08:42:56.259154+0000","last_became_peered":"2023-10-07T08:42:56.259154+0000","last_unstale":"2023-10-07T08:42:57.269611+0000","last_undegraded":"2023-10-07T08:42:57.269611+0000","last_fullsized":"2023-10-07T08:42:57.269611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265027+0000","last_change":"2023-10-07T08:42:57.262943+0000","last_active":"2023-10-07T08:42:57.265027+0000","last_peered":"2023-10-07T08:42:57.265027+0000","last_clean":"2023-10-07T08:42:57.265027+0000","last_became_active":"2023-10-07T08:42:57.262707+0000","last_became_peered":"2023-10-07T08:42:57.262707+0000","last_unstale":"2023-10-07T08:42:57.265027+0000","last_undegraded":"2023-10-07T08:42:57.265027+0000","last_fullsized":"2023-10-07T08:42:57.265027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269382+0000","last_change":"2023-10-07T08:42:56.250565+0000","last_active":"2023-10-07T08:42:57.269382+0000","last_peered":"2023-10-07T08:42:57.269382+0000","last_clean":"2023-10-07T08:42:57.269382+0000","last_became_active":"2023-10-07T08:42:56.250326+0000","last_became_peered":"2023-10-07T08:42:56.250326+0000","last_unstale":"2023-10-07T08:42:57.269382+0000","last_undegraded":"2023-10-07T08:42:57.269382+0000","last_fullsized":"2023-10-07T08:42:57.269382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264073+0000","last_change":"2023-10-07T08:42:57.263608+0000","last_active":"2023-10-07T08:42:57.264073+0000","last_peered":"2023-10-07T08:42:57.264073+0000","last_clean":"2023-10-07T08:42:57.264073+0000","last_became_active":"2023-10-07T08:42:57.262971+0000","last_became_peered":"2023-10-07T08:42:57.262971+0000","last_unstale":"2023-10-07T08:42:57.264073+0000","last_undegraded":"2023-10-07T08:42:57.264073+0000","last_fullsized":"2023-10-07T08:42:57.264073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269407+0000","last_change":"2023-10-07T08:42:56.262332+0000","last_active":"2023-10-07T08:42:57.269407+0000","last_peered":"2023-10-07T08:42:57.269407+0000","last_clean":"2023-10-07T08:42:57.269407+0000","last_became_active":"2023-10-07T08:42:56.261913+0000","last_became_peered":"2023-10-07T08:42:56.261913+0000","last_unstale":"2023-10-07T08:42:57.269407+0000","last_undegraded":"2023-10-07T08:42:57.269407+0000","last_fullsized":"2023-10-07T08:42:57.269407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:47.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273297+0000","last_change":"2023-10-07T08:42:57.271943+0000","last_active":"2023-10-07T08:42:57.273297+0000","last_peered":"2023-10-07T08:42:57.273297+0000","last_clean":"2023-10-07T08:42:57.273297+0000","last_became_active":"2023-10-07T08:42:57.271217+0000","last_became_peered":"2023-10-07T08:42:57.271217+0000","last_unstale":"2023-10-07T08:42:57.273297+0000","last_undegraded":"2023-10-07T08:42:57.273297+0000","last_fullsized":"2023-10-07T08:42:57.273297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:07:27.370919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.259993+0000","last_change":"2023-10-07T08:42:56.259497+0000","last_active":"2023-10-07T08:42:57.259993+0000","last_peered":"2023-10-07T08:42:57.259993+0000","last_clean":"2023-10-07T08:42:57.259993+0000","last_became_active":"2023-10-07T08:42:56.259259+0000","last_became_peered":"2023-10-07T08:42:56.259259+0000","last_unstale":"2023-10-07T08:42:57.259993+0000","last_undegraded":"2023-10-07T08:42:57.259993+0000","last_fullsized":"2023-10-07T08:42:57.259993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:47.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267342+0000","last_change":"2023-10-07T08:42:57.264611+0000","last_active":"2023-10-07T08:42:57.267342+0000","last_peered":"2023-10-07T08:42:57.267342+0000","last_clean":"2023-10-07T08:42:57.267342+0000","last_became_active":"2023-10-07T08:42:57.264371+0000","last_became_peered":"2023-10-07T08:42:57.264371+0000","last_unstale":"2023-10-07T08:42:57.267342+0000","last_undegraded":"2023-10-07T08:42:57.267342+0000","last_fullsized":"2023-10-07T08:42:57.267342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.262375+0000","last_change":"2023-10-07T08:42:56.254762+0000","last_active":"2023-10-07T08:42:57.262375+0000","last_peered":"2023-10-07T08:42:57.262375+0000","last_clean":"2023-10-07T08:42:57.262375+0000","last_became_active":"2023-10-07T08:42:56.254460+0000","last_became_peered":"2023-10-07T08:42:56.254460+0000","last_unstale":"2023-10-07T08:42:57.262375+0000","last_undegraded":"2023-10-07T08:42:57.262375+0000","last_fullsized":"2023-10-07T08:42:57.262375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.265088+0000","last_change":"2023-10-07T08:42:57.264712+0000","last_active":"2023-10-07T08:42:57.265088+0000","last_peered":"2023-10-07T08:42:57.265088+0000","last_clean":"2023-10-07T08:42:57.265088+0000","last_became_active":"2023-10-07T08:42:57.264380+0000","last_became_peered":"2023-10-07T08:42:57.264380+0000","last_unstale":"2023-10-07T08:42:57.265088+0000","last_undegraded":"2023-10-07T08:42:57.265088+0000","last_fullsized":"2023-10-07T08:42:57.265088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:48.342893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.257527+0000","last_change":"2023-10-07T08:42:56.253642+0000","last_active":"2023-10-07T08:42:57.257527+0000","last_peered":"2023-10-07T08:42:57.257527+0000","last_clean":"2023-10-07T08:42:57.257527+0000","last_became_active":"2023-10-07T08:42:56.253183+0000","last_became_peered":"2023-10-07T08:42:56.253183+0000","last_unstale":"2023-10-07T08:42:57.257527+0000","last_undegraded":"2023-10-07T08:42:57.257527+0000","last_fullsized":"2023-10-07T08:42:57.257527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:35.495354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273316+0000","last_change":"2023-10-07T08:42:57.272080+0000","last_active":"2023-10-07T08:42:57.273316+0000","last_peered":"2023-10-07T08:42:57.273316+0000","last_clean":"2023-10-07T08:42:57.273316+0000","last_became_active":"2023-10-07T08:42:57.271505+0000","last_became_peered":"2023-10-07T08:42:57.271505+0000","last_unstale":"2023-10-07T08:42:57.273316+0000","last_undegraded":"2023-10-07T08:42:57.273316+0000","last_fullsized":"2023-10-07T08:42:57.273316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:29.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.251426+0000","last_change":"2023-10-07T08:42:56.253289+0000","last_active":"2023-10-07T08:42:57.251426+0000","last_peered":"2023-10-07T08:42:57.251426+0000","last_clean":"2023-10-07T08:42:57.251426+0000","last_became_active":"2023-10-07T08:42:56.253058+0000","last_became_peered":"2023-10-07T08:42:56.253058+0000","last_unstale":"2023-10-07T08:42:57.251426+0000","last_undegraded":"2023-10-07T08:42:57.251426+0000","last_fullsized":"2023-10-07T08:42:57.251426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271749+0000","last_change":"2023-10-07T08:42:57.269245+0000","last_active":"2023-10-07T08:42:57.271749+0000","last_peered":"2023-10-07T08:42:57.271749+0000","last_clean":"2023-10-07T08:42:57.271749+0000","last_became_active":"2023-10-07T08:42:57.268139+0000","last_became_peered":"2023-10-07T08:42:57.268139+0000","last_unstale":"2023-10-07T08:42:57.271749+0000","last_undegraded":"2023-10-07T08:42:57.271749+0000","last_fullsized":"2023-10-07T08:42:57.271749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:56.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255341+0000","last_change":"2023-10-07T08:42:56.262012+0000","last_active":"2023-10-07T08:42:57.255341+0000","last_peered":"2023-10-07T08:42:57.255341+0000","last_clean":"2023-10-07T08:42:57.255341+0000","last_became_active":"2023-10-07T08:42:56.261812+0000","last_became_peered":"2023-10-07T08:42:56.261812+0000","last_unstale":"2023-10-07T08:42:57.255341+0000","last_undegraded":"2023-10-07T08:42:57.255341+0000","last_fullsized":"2023-10-07T08:42:57.255341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:43.953599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264986+0000","last_change":"2023-10-07T08:42:57.264887+0000","last_active":"2023-10-07T08:42:57.264986+0000","last_peered":"2023-10-07T08:42:57.264986+0000","last_clean":"2023-10-07T08:42:57.264986+0000","last_became_active":"2023-10-07T08:42:57.264651+0000","last_became_peered":"2023-10-07T08:42:57.264651+0000","last_unstale":"2023-10-07T08:42:57.264986+0000","last_undegraded":"2023-10-07T08:42:57.264986+0000","last_fullsized":"2023-10-07T08:42:57.264986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:32.698757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.252401+0000","last_change":"2023-10-07T08:42:57.252321+0000","last_active":"2023-10-07T08:42:57.252401+0000","last_peered":"2023-10-07T08:42:57.252401+0000","last_clean":"2023-10-07T08:42:57.252401+0000","last_became_active":"2023-10-07T08:42:57.252102+0000","last_became_peered":"2023-10-07T08:42:57.252102+0000","last_unstale":"2023-10-07T08:42:57.252401+0000","last_undegraded":"2023-10-07T08:42:57.252401+0000","last_fullsized":"2023-10-07T08:42:57.252401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:07.393104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.250654+0000","last_change":"2023-10-07T08:42:56.255406+0000","last_active":"2023-10-07T08:42:57.250654+0000","last_peered":"2023-10-07T08:42:57.250654+0000","last_clean":"2023-10-07T08:42:57.250654+0000","last_became_active":"2023-10-07T08:42:56.255167+0000","last_became_peered":"2023-10-07T08:42:56.255167+0000","last_unstale":"2023-10-07T08:42:57.250654+0000","last_undegraded":"2023-10-07T08:42:57.250654+0000","last_fullsized":"2023-10-07T08:42:57.250654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:26.521295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.268877+0000","last_change":"2023-10-07T08:42:57.268830+0000","last_active":"2023-10-07T08:42:57.268877+0000","last_peered":"2023-10-07T08:42:57.268877+0000","last_clean":"2023-10-07T08:42:57.268877+0000","last_became_active":"2023-10-07T08:42:57.268514+0000","last_became_peered":"2023-10-07T08:42:57.268514+0000","last_unstale":"2023-10-07T08:42:57.268877+0000","last_undegraded":"2023-10-07T08:42:57.268877+0000","last_fullsized":"2023-10-07T08:42:57.268877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:28:56.247862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.269521+0000","last_change":"2023-10-07T08:42:56.262059+0000","last_active":"2023-10-07T08:42:57.269521+0000","last_peered":"2023-10-07T08:42:57.269521+0000","last_clean":"2023-10-07T08:42:57.269521+0000","last_became_active":"2023-10-07T08:42:56.260888+0000","last_became_peered":"2023-10-07T08:42:56.260888+0000","last_unstale":"2023-10-07T08:42:57.269521+0000","last_undegraded":"2023-10-07T08:42:57.269521+0000","last_fullsized":"2023-10-07T08:42:57.269521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.262180+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:42:57.262180+0000","last_peered":"2023-10-07T08:42:57.262180+0000","last_clean":"2023-10-07T08:42:57.262180+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:42:57.262180+0000","last_undegraded":"2023-10-07T08:42:57.262180+0000","last_fullsized":"2023-10-07T08:42:57.262180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264015+0000","last_change":"2023-10-07T08:42:57.262498+0000","last_active":"2023-10-07T08:42:57.264015+0000","last_peered":"2023-10-07T08:42:57.264015+0000","last_clean":"2023-10-07T08:42:57.264015+0000","last_became_active":"2023-10-07T08:42:57.261704+0000","last_became_peered":"2023-10-07T08:42:57.261704+0000","last_unstale":"2023-10-07T08:42:57.264015+0000","last_undegraded":"2023-10-07T08:42:57.264015+0000","last_fullsized":"2023-10-07T08:42:57.264015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260276+0000","last_change":"2023-10-07T08:42:56.259333+0000","last_active":"2023-10-07T08:42:57.260276+0000","last_peered":"2023-10-07T08:42:57.260276+0000","last_clean":"2023-10-07T08:42:57.260276+0000","last_became_active":"2023-10-07T08:42:56.259178+0000","last_became_peered":"2023-10-07T08:42:56.259178+0000","last_unstale":"2023-10-07T08:42:57.260276+0000","last_undegraded":"2023-10-07T08:42:57.260276+0000","last_fullsized":"2023-10-07T08:42:57.260276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:49:43.953599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260369+0000","last_change":"2023-10-07T08:42:56.262061+0000","last_active":"2023-10-07T08:42:57.260369+0000","last_peered":"2023-10-07T08:42:57.260369+0000","last_clean":"2023-10-07T08:42:57.260369+0000","last_became_active":"2023-10-07T08:42:56.261842+0000","last_became_peered":"2023-10-07T08:42:56.261842+0000","last_unstale":"2023-10-07T08:42:57.260369+0000","last_undegraded":"2023-10-07T08:42:57.260369+0000","last_fullsized":"2023-10-07T08:42:57.260369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.254098+0000","last_change":"2023-10-07T08:42:57.253993+0000","last_active":"2023-10-07T08:42:57.254098+0000","last_peered":"2023-10-07T08:42:57.254098+0000","last_clean":"2023-10-07T08:42:57.254098+0000","last_became_active":"2023-10-07T08:42:57.253775+0000","last_became_peered":"2023-10-07T08:42:57.253775+0000","last_unstale":"2023-10-07T08:42:57.254098+0000","last_undegraded":"2023-10-07T08:42:57.254098+0000","last_fullsized":"2023-10-07T08:42:57.254098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-07T08:42:58.827418+0000","last_change":"2023-10-07T08:42:56.256312+0000","last_active":"2023-10-07T08:42:58.827418+0000","last_peered":"2023-10-07T08:42:58.827418+0000","last_clean":"2023-10-07T08:42:58.827418+0000","last_became_active":"2023-10-07T08:42:56.256095+0000","last_became_peered":"2023-10-07T08:42:56.256095+0000","last_unstale":"2023-10-07T08:42:58.827418+0000","last_undegraded":"2023-10-07T08:42:58.827418+0000","last_fullsized":"2023-10-07T08:42:58.827418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:21.295203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266691+0000","last_change":"2023-10-07T08:42:57.266642+0000","last_active":"2023-10-07T08:42:57.266691+0000","last_peered":"2023-10-07T08:42:57.266691+0000","last_clean":"2023-10-07T08:42:57.266691+0000","last_became_active":"2023-10-07T08:42:57.266480+0000","last_became_peered":"2023-10-07T08:42:57.266480+0000","last_unstale":"2023-10-07T08:42:57.266691+0000","last_undegraded":"2023-10-07T08:42:57.266691+0000","last_fullsized":"2023-10-07T08:42:57.266691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:07.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271789+0000","last_change":"2023-10-07T08:42:56.257795+0000","last_active":"2023-10-07T08:42:57.271789+0000","last_peered":"2023-10-07T08:42:57.271789+0000","last_clean":"2023-10-07T08:42:57.271789+0000","last_became_active":"2023-10-07T08:42:56.257560+0000","last_became_peered":"2023-10-07T08:42:56.257560+0000","last_unstale":"2023-10-07T08:42:57.271789+0000","last_undegraded":"2023-10-07T08:42:57.271789+0000","last_fullsized":"2023-10-07T08:42:57.271789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:31.694242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.263996+0000","last_change":"2023-10-07T08:42:57.262219+0000","last_active":"2023-10-07T08:42:57.263996+0000","last_peered":"2023-10-07T08:42:57.263996+0000","last_clean":"2023-10-07T08:42:57.263996+0000","last_became_active":"2023-10-07T08:42:57.261413+0000","last_became_peered":"2023-10-07T08:42:57.261413+0000","last_unstale":"2023-10-07T08:42:57.263996+0000","last_undegraded":"2023-10-07T08:42:57.263996+0000","last_fullsized":"2023-10-07T08:42:57.263996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:25:20.586749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261906+0000","last_change":"2023-10-07T08:42:56.258484+0000","last_active":"2023-10-07T08:42:57.261906+0000","last_peered":"2023-10-07T08:42:57.261906+0000","last_clean":"2023-10-07T08:42:57.261906+0000","last_became_active":"2023-10-07T08:42:56.258243+0000","last_became_peered":"2023-10-07T08:42:56.258243+0000","last_unstale":"2023-10-07T08:42:57.261906+0000","last_undegraded":"2023-10-07T08:42:57.261906+0000","last_fullsized":"2023-10-07T08:42:57.261906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:24.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258408+0000","last_change":"2023-10-07T08:42:57.258345+0000","last_active":"2023-10-07T08:42:57.258408+0000","last_peered":"2023-10-07T08:42:57.258408+0000","last_clean":"2023-10-07T08:42:57.258408+0000","last_became_active":"2023-10-07T08:42:57.257563+0000","last_became_peered":"2023-10-07T08:42:57.257563+0000","last_unstale":"2023-10-07T08:42:57.258408+0000","last_undegraded":"2023-10-07T08:42:57.258408+0000","last_fullsized":"2023-10-07T08:42:57.258408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:00:58.314283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.251512+0000","last_change":"2023-10-07T08:42:56.259479+0000","last_active":"2023-10-07T08:42:57.251512+0000","last_peered":"2023-10-07T08:42:57.251512+0000","last_clean":"2023-10-07T08:42:57.251512+0000","last_became_active":"2023-10-07T08:42:56.259257+0000","last_became_peered":"2023-10-07T08:42:56.259257+0000","last_unstale":"2023-10-07T08:42:57.251512+0000","last_undegraded":"2023-10-07T08:42:57.251512+0000","last_fullsized":"2023-10-07T08:42:57.251512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:00:57.309769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.253038+0000","last_change":"2023-10-07T08:42:57.252823+0000","last_active":"2023-10-07T08:42:57.253038+0000","last_peered":"2023-10-07T08:42:57.253038+0000","last_clean":"2023-10-07T08:42:57.253038+0000","last_became_active":"2023-10-07T08:42:57.252606+0000","last_became_peered":"2023-10-07T08:42:57.252606+0000","last_unstale":"2023-10-07T08:42:57.253038+0000","last_undegraded":"2023-10-07T08:42:57.253038+0000","last_fullsized":"2023-10-07T08:42:57.253038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:09:25.788730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.251872+0000","last_change":"2023-10-07T08:42:56.255715+0000","last_active":"2023-10-07T08:42:57.251872+0000","last_peered":"2023-10-07T08:42:57.251872+0000","last_clean":"2023-10-07T08:42:57.251872+0000","last_became_active":"2023-10-07T08:42:56.255502+0000","last_became_peered":"2023-10-07T08:42:56.255502+0000","last_unstale":"2023-10-07T08:42:57.251872+0000","last_undegraded":"2023-10-07T08:42:57.251872+0000","last_fullsized":"2023-10-07T08:42:57.251872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:47:14.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261586+0000","last_change":"2023-10-07T08:42:57.261460+0000","last_active":"2023-10-07T08:42:57.261586+0000","last_peered":"2023-10-07T08:42:57.261586+0000","last_clean":"2023-10-07T08:42:57.261586+0000","last_became_active":"2023-10-07T08:42:57.260893+0000","last_became_peered":"2023-10-07T08:42:57.260893+0000","last_unstale":"2023-10-07T08:42:57.261586+0000","last_undegraded":"2023-10-07T08:42:57.261586+0000","last_fullsized":"2023-10-07T08:42:57.261586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273745+0000","last_change":"2023-10-07T08:42:56.258635+0000","last_active":"2023-10-07T08:42:57.273745+0000","last_peered":"2023-10-07T08:42:57.273745+0000","last_clean":"2023-10-07T08:42:57.273745+0000","last_became_active":"2023-10-07T08:42:56.258323+0000","last_became_peered":"2023-10-07T08:42:56.258323+0000","last_unstale":"2023-10-07T08:42:57.273745+0000","last_undegraded":"2023-10-07T08:42:57.273745+0000","last_fullsized":"2023-10-07T08:42:57.273745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:37.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260549+0000","last_change":"2023-10-07T08:42:57.259849+0000","last_active":"2023-10-07T08:42:57.260549+0000","last_peered":"2023-10-07T08:42:57.260549+0000","last_clean":"2023-10-07T08:42:57.260549+0000","last_became_active":"2023-10-07T08:42:57.259625+0000","last_became_peered":"2023-10-07T08:42:57.259625+0000","last_unstale":"2023-10-07T08:42:57.260549+0000","last_undegraded":"2023-10-07T08:42:57.260549+0000","last_fullsized":"2023-10-07T08:42:57.260549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:59:04.257140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.250640+0000","last_change":"2023-10-07T08:42:56.260384+0000","last_active":"2023-10-07T08:42:57.250640+0000","last_peered":"2023-10-07T08:42:57.250640+0000","last_clean":"2023-10-07T08:42:57.250640+0000","last_became_active":"2023-10-07T08:42:56.260141+0000","last_became_peered":"2023-10-07T08:42:56.260141+0000","last_unstale":"2023-10-07T08:42:57.250640+0000","last_undegraded":"2023-10-07T08:42:57.250640+0000","last_fullsized":"2023-10-07T08:42:57.250640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:13:43.850105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.274600+0000","last_change":"2023-10-07T08:42:57.273820+0000","last_active":"2023-10-07T08:42:57.274600+0000","last_peered":"2023-10-07T08:42:57.274600+0000","last_clean":"2023-10-07T08:42:57.274600+0000","last_became_active":"2023-10-07T08:42:57.273591+0000","last_became_peered":"2023-10-07T08:42:57.273591+0000","last_unstale":"2023-10-07T08:42:57.274600+0000","last_undegraded":"2023-10-07T08:42:57.274600+0000","last_fullsized":"2023-10-07T08:42:57.274600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:56.744706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.261775+0000","last_change":"2023-10-07T08:42:56.253272+0000","last_active":"2023-10-07T08:42:57.261775+0000","last_peered":"2023-10-07T08:42:57.261775+0000","last_clean":"2023-10-07T08:42:57.261775+0000","last_became_active":"2023-10-07T08:42:56.253029+0000","last_became_peered":"2023-10-07T08:42:56.253029+0000","last_unstale":"2023-10-07T08:42:57.261775+0000","last_undegraded":"2023-10-07T08:42:57.261775+0000","last_fullsized":"2023-10-07T08:42:57.261775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:47.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266923+0000","last_change":"2023-10-07T08:42:57.266372+0000","last_active":"2023-10-07T08:42:57.266923+0000","last_peered":"2023-10-07T08:42:57.266923+0000","last_clean":"2023-10-07T08:42:57.266923+0000","last_became_active":"2023-10-07T08:42:57.266237+0000","last_became_peered":"2023-10-07T08:42:57.266237+0000","last_unstale":"2023-10-07T08:42:57.266923+0000","last_undegraded":"2023-10-07T08:42:57.266923+0000","last_fullsized":"2023-10-07T08:42:57.266923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:29.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264466+0000","last_change":"2023-10-07T08:42:56.257581+0000","last_active":"2023-10-07T08:42:57.264466+0000","last_peered":"2023-10-07T08:42:57.264466+0000","last_clean":"2023-10-07T08:42:57.264466+0000","last_became_active":"2023-10-07T08:42:56.257339+0000","last_became_peered":"2023-10-07T08:42:56.257339+0000","last_unstale":"2023-10-07T08:42:57.264466+0000","last_undegraded":"2023-10-07T08:42:57.264466+0000","last_fullsized":"2023-10-07T08:42:57.264466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:55.237912+0000","last_clean_scrub_stamp":"2023-10-07T08:42:55.237912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:40.492004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.266968+0000","last_change":"2023-10-07T08:42:57.266483+0000","last_active":"2023-10-07T08:42:57.266968+0000","last_peered":"2023-10-07T08:42:57.266968+0000","last_clean":"2023-10-07T08:42:57.266968+0000","last_became_active":"2023-10-07T08:42:57.265437+0000","last_became_peered":"2023-10-07T08:42:57.265437+0000","last_unstale":"2023-10-07T08:42:57.266968+0000","last_undegraded":"2023-10-07T08:42:57.266968+0000","last_fullsized":"2023-10-07T08:42:57.266968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:38.758746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260567+0000","last_change":"2023-10-07T08:42:57.260425+0000","last_active":"2023-10-07T08:42:57.260567+0000","last_peered":"2023-10-07T08:42:57.260567+0000","last_clean":"2023-10-07T08:42:57.260567+0000","last_became_active":"2023-10-07T08:42:57.260226+0000","last_became_peered":"2023-10-07T08:42:57.260226+0000","last_unstale":"2023-10-07T08:42:57.260567+0000","last_undegraded":"2023-10-07T08:42:57.260567+0000","last_fullsized":"2023-10-07T08:42:57.260567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273197+0000","last_change":"2023-10-07T08:42:57.273144+0000","last_active":"2023-10-07T08:42:57.273197+0000","last_peered":"2023-10-07T08:42:57.273197+0000","last_clean":"2023-10-07T08:42:57.273197+0000","last_became_active":"2023-10-07T08:42:57.273008+0000","last_became_peered":"2023-10-07T08:42:57.273008+0000","last_unstale":"2023-10-07T08:42:57.273197+0000","last_undegraded":"2023-10-07T08:42:57.273197+0000","last_fullsized":"2023-10-07T08:42:57.273197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:22.299718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271790+0000","last_change":"2023-10-07T08:42:57.270102+0000","last_active":"2023-10-07T08:42:57.271790+0000","last_peered":"2023-10-07T08:42:57.271790+0000","last_clean":"2023-10-07T08:42:57.271790+0000","last_became_active":"2023-10-07T08:42:57.269871+0000","last_became_peered":"2023-10-07T08:42:57.269871+0000","last_unstale":"2023-10-07T08:42:57.271790+0000","last_undegraded":"2023-10-07T08:42:57.271790+0000","last_fullsized":"2023-10-07T08:42:57.271790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:22:57.366438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.255941+0000","last_change":"2023-10-07T08:42:57.255880+0000","last_active":"2023-10-07T08:42:57.255941+0000","last_peered":"2023-10-07T08:42:57.255941+0000","last_clean":"2023-10-07T08:42:57.255941+0000","last_became_active":"2023-10-07T08:42:57.255498+0000","last_became_peered":"2023-10-07T08:42:57.255498+0000","last_unstale":"2023-10-07T08:42:57.255941+0000","last_undegraded":"2023-10-07T08:42:57.255941+0000","last_fullsized":"2023-10-07T08:42:57.255941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:48:20.538119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258178+0000","last_change":"2023-10-07T08:42:57.257694+0000","last_active":"2023-10-07T08:42:57.258178+0000","last_peered":"2023-10-07T08:42:57.258178+0000","last_clean":"2023-10-07T08:42:57.258178+0000","last_became_active":"2023-10-07T08:42:57.257200+0000","last_became_peered":"2023-10-07T08:42:57.257200+0000","last_unstale":"2023-10-07T08:42:57.258178+0000","last_undegraded":"2023-10-07T08:42:57.258178+0000","last_fullsized":"2023-10-07T08:42:57.258178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.253992+0000","last_change":"2023-10-07T08:42:57.253904+0000","last_active":"2023-10-07T08:42:57.253992+0000","last_peered":"2023-10-07T08:42:57.253992+0000","last_clean":"2023-10-07T08:42:57.253992+0000","last_became_active":"2023-10-07T08:42:57.253374+0000","last_became_peered":"2023-10-07T08:42:57.253374+0000","last_unstale":"2023-10-07T08:42:57.253992+0000","last_undegraded":"2023-10-07T08:42:57.253992+0000","last_fullsized":"2023-10-07T08:42:57.253992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:07.198677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.267322+0000","last_change":"2023-10-07T08:42:57.264162+0000","last_active":"2023-10-07T08:42:57.267322+0000","last_peered":"2023-10-07T08:42:57.267322+0000","last_clean":"2023-10-07T08:42:57.267322+0000","last_became_active":"2023-10-07T08:42:57.263947+0000","last_became_peered":"2023-10-07T08:42:57.263947+0000","last_unstale":"2023-10-07T08:42:57.267322+0000","last_undegraded":"2023-10-07T08:42:57.267322+0000","last_fullsized":"2023-10-07T08:42:57.267322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:07.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.256643+0000","last_change":"2023-10-07T08:42:57.256601+0000","last_active":"2023-10-07T08:42:57.256643+0000","last_peered":"2023-10-07T08:42:57.256643+0000","last_clean":"2023-10-07T08:42:57.256643+0000","last_became_active":"2023-10-07T08:42:57.256421+0000","last_became_peered":"2023-10-07T08:42:57.256421+0000","last_unstale":"2023-10-07T08:42:57.256643+0000","last_undegraded":"2023-10-07T08:42:57.256643+0000","last_fullsized":"2023-10-07T08:42:57.256643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.271714+0000","last_change":"2023-10-07T08:42:57.268643+0000","last_active":"2023-10-07T08:42:57.271714+0000","last_peered":"2023-10-07T08:42:57.271714+0000","last_clean":"2023-10-07T08:42:57.271714+0000","last_became_active":"2023-10-07T08:42:57.267817+0000","last_became_peered":"2023-10-07T08:42:57.267817+0000","last_unstale":"2023-10-07T08:42:57.271714+0000","last_undegraded":"2023-10-07T08:42:57.271714+0000","last_fullsized":"2023-10-07T08:42:57.271714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:28:36.456596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.258195+0000","last_change":"2023-10-07T08:42:57.257831+0000","last_active":"2023-10-07T08:42:57.258195+0000","last_peered":"2023-10-07T08:42:57.258195+0000","last_clean":"2023-10-07T08:42:57.258195+0000","last_became_active":"2023-10-07T08:42:57.257484+0000","last_became_peered":"2023-10-07T08:42:57.257484+0000","last_unstale":"2023-10-07T08:42:57.258195+0000","last_undegraded":"2023-10-07T08:42:57.258195+0000","last_fullsized":"2023-10-07T08:42:57.258195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:15:40.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.273509+0000","last_change":"2023-10-07T08:42:57.273405+0000","last_active":"2023-10-07T08:42:57.273509+0000","last_peered":"2023-10-07T08:42:57.273509+0000","last_clean":"2023-10-07T08:42:57.273509+0000","last_became_active":"2023-10-07T08:42:57.272454+0000","last_became_peered":"2023-10-07T08:42:57.272454+0000","last_unstale":"2023-10-07T08:42:57.273509+0000","last_undegraded":"2023-10-07T08:42:57.273509+0000","last_fullsized":"2023-10-07T08:42:57.273509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:38.758746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.264089+0000","last_change":"2023-10-07T08:42:57.263789+0000","last_active":"2023-10-07T08:42:57.264089+0000","last_peered":"2023-10-07T08:42:57.264089+0000","last_clean":"2023-10-07T08:42:57.264089+0000","last_became_active":"2023-10-07T08:42:57.263348+0000","last_became_peered":"2023-10-07T08:42:57.263348+0000","last_unstale":"2023-10-07T08:42:57.264089+0000","last_undegraded":"2023-10-07T08:42:57.264089+0000","last_fullsized":"2023-10-07T08:42:57.264089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:35.738106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-07T08:42:57.260531+0000","last_change":"2023-10-07T08:42:57.259213+0000","last_active":"2023-10-07T08:42:57.260531+0000","last_peered":"2023-10-07T08:42:57.260531+0000","last_clean":"2023-10-07T08:42:57.260531+0000","last_became_active":"2023-10-07T08:42:57.258976+0000","last_became_peered":"2023-10-07T08:42:57.258976+0000","last_unstale":"2023-10-07T08:42:57.260531+0000","last_undegraded":"2023-10-07T08:42:57.260531+0000","last_fullsized":"2023-10-07T08:42:57.260531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:56.242426+0000","last_clean_scrub_stamp":"2023-10-07T08:42:56.242426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:29:20.004471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199333925,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199923311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924687,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333869,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924847,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.187}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199923311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924721,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924757,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]}]}],"pool_statfs":[]}} 2023-10-07T08:43:10.607 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-07T08:43:10.607 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-07T08:43:10.608 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-07T08:43:10.608 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-07T08:43:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.755+0000 7f559ce89700 1 Processor -- start 2023-10-07T08:43:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.755+0000 7f559ce89700 1 -- start start 2023-10-07T08:43:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f559ce89700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f55981577e0 0x7f559815b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f559ce89700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5598157bb0 0x7f55980cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f559ce89700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f559806d240 0x7f559806d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f559ce89700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559806dc00 con 0x7f559806d240 2023-10-07T08:43:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f559ce89700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55980cfdd0 con 0x7f55981577e0 2023-10-07T08:43:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f559ce89700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55980d00b0 con 0x7f5598157bb0 2023-10-07T08:43:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f5596d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f559806d240 0x7f559806d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f5596d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f559806d240 0x7f559806d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45262/0 (socket says 172.21.15.81:45262) 2023-10-07T08:43:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f5596d9d700 1 -- 172.21.15.81:0/1260048302 learned_addr learned my addr 172.21.15.81:0/1260048302 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f5595d9b700 1 --2- 172.21.15.81:0/1260048302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5598157bb0 0x7f55980cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f559659c700 1 --2- 172.21.15.81:0/1260048302 >> v2:172.21.15.89:3300/0 conn(0x7f55981577e0 0x7f559815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f5596d9d700 1 -- 172.21.15.81:0/1260048302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5598157bb0 msgr2=0x7f55980cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f5596d9d700 1 --2- 172.21.15.81:0/1260048302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5598157bb0 0x7f55980cf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f5596d9d700 1 -- 172.21.15.81:0/1260048302 >> v2:172.21.15.89:3300/0 conn(0x7f55981577e0 msgr2=0x7f559815b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f5596d9d700 1 --2- 172.21.15.81:0/1260048302 >> v2:172.21.15.89:3300/0 conn(0x7f55981577e0 0x7f559815b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f5596d9d700 1 -- 172.21.15.81:0/1260048302 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55980d0390 con 0x7f559806d240 2023-10-07T08:43:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f559659c700 1 --2- 172.21.15.81:0/1260048302 >> v2:172.21.15.89:3300/0 conn(0x7f55981577e0 0x7f559815b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f5596d9d700 1 --2- 172.21.15.81:0/1260048302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559806d240 0x7f559806d6c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5598064ac0 tx=0x7f5590009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d333bc1a8639584a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.756+0000 7f559559a700 1 -- 172.21.15.81:0/1260048302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559000e070 con 0x7f559806d240 2023-10-07T08:43:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.757+0000 7f559559a700 1 -- 172.21.15.81:0/1260048302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559000ba50 con 0x7f559806d240 2023-10-07T08:43:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.757+0000 7f559559a700 1 -- 172.21.15.81:0/1260048302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55900092e0 con 0x7f559806d240 2023-10-07T08:43:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.757+0000 7f559ce89700 1 -- 172.21.15.81:0/1260048302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559806d240 msgr2=0x7f559806d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.757+0000 7f559ce89700 1 --2- 172.21.15.81:0/1260048302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559806d240 0x7f559806d6c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5598064ac0 tx=0x7f5590009840 comp rx=0 tx=0).stop 2023-10-07T08:43:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.757+0000 7f559ce89700 1 -- 172.21.15.81:0/1260048302 shutdown_connections 2023-10-07T08:43:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.757+0000 7f559ce89700 1 --2- 172.21.15.81:0/1260048302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559806d240 0x7f559806d6c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.757+0000 7f559ce89700 1 --2- 172.21.15.81:0/1260048302 >> v2:172.21.15.89:3300/0 conn(0x7f55981577e0 0x7f559815b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.757+0000 7f559ce89700 1 --2- 172.21.15.81:0/1260048302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5598157bb0 0x7f55980cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.757+0000 7f559ce89700 1 -- 172.21.15.81:0/1260048302 >> 172.21.15.81:0/1260048302 conn(0x7f559806bb90 msgr2=0x7f559806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.757+0000 7f559ce89700 1 -- 172.21.15.81:0/1260048302 shutdown_connections 2023-10-07T08:43:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.757+0000 7f559ce89700 1 -- 172.21.15.81:0/1260048302 wait complete. 2023-10-07T08:43:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.758+0000 7f559ce89700 1 Processor -- start 2023-10-07T08:43:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.758+0000 7f559ce89700 1 -- start start 2023-10-07T08:43:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f559ce89700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559806d240 0x7f55980aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f559ce89700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55981577e0 0x7f5598140670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f559ce89700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5598157bb0 0x7f559815c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f559ce89700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5598069a70 con 0x7f5598157bb0 2023-10-07T08:43:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f559ce89700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5598069cc0 con 0x7f55981577e0 2023-10-07T08:43:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f559ce89700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5598069fa0 con 0x7f559806d240 2023-10-07T08:43:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f5596d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5598157bb0 0x7f559815c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f5596d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5598157bb0 0x7f559815c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45264/0 (socket says 172.21.15.81:45264) 2023-10-07T08:43:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f5596d9d700 1 -- 172.21.15.81:0/1870299652 learned_addr learned my addr 172.21.15.81:0/1870299652 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f559659c700 1 --2- 172.21.15.81:0/1870299652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559806d240 0x7f55980aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f5595d9b700 1 --2- 172.21.15.81:0/1870299652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55981577e0 0x7f5598140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f5596d9d700 1 -- 172.21.15.81:0/1870299652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559806d240 msgr2=0x7f55980aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f5596d9d700 1 --2- 172.21.15.81:0/1870299652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559806d240 0x7f55980aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f5596d9d700 1 -- 172.21.15.81:0/1870299652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55981577e0 msgr2=0x7f5598140670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f5596d9d700 1 --2- 172.21.15.81:0/1870299652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55981577e0 0x7f5598140670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f5596d9d700 1 -- 172.21.15.81:0/1870299652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5590009ae0 con 0x7f5598157bb0 2023-10-07T08:43:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f5595d9b700 1 --2- 172.21.15.81:0/1870299652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55981577e0 0x7f5598140670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.759+0000 7f5596d9d700 1 --2- 172.21.15.81:0/1870299652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5598157bb0 0x7f559815c870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5598067780 tx=0x7f5590018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.760+0000 7f55867fc700 1 -- 172.21.15.81:0/1870299652 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55900094e0 con 0x7f5598157bb0 2023-10-07T08:43:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.760+0000 7f55867fc700 1 -- 172.21.15.81:0/1870299652 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55900032f0 con 0x7f5598157bb0 2023-10-07T08:43:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.760+0000 7f55867fc700 1 -- 172.21.15.81:0/1870299652 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590026460 con 0x7f5598157bb0 2023-10-07T08:43:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.760+0000 7f559ce89700 1 -- 172.21.15.81:0/1870299652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559806a280 con 0x7f5598157bb0 2023-10-07T08:43:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.760+0000 7f559ce89700 1 -- 172.21.15.81:0/1870299652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55980aadd0 con 0x7f5598157bb0 2023-10-07T08:43:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.760+0000 7f559ce89700 1 -- 172.21.15.81:0/1870299652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5598067850 con 0x7f5598157bb0 2023-10-07T08:43:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.761+0000 7f55867fc700 1 -- 172.21.15.81:0/1870299652 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5590003040 con 0x7f5598157bb0 2023-10-07T08:43:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.761+0000 7f55867fc700 1 --2- 172.21.15.81:0/1870299652 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5578066f30 0x7f55780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.761+0000 7f559659c700 1 --2- 172.21.15.81:0/1870299652 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5578066f30 0x7f55780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.761+0000 7f55867fc700 1 -- 172.21.15.81:0/1870299652 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5590086410 con 0x7f5598157bb0 2023-10-07T08:43:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.762+0000 7f559659c700 1 --2- 172.21.15.81:0/1870299652 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5578066f30 0x7f55780693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f55980b2e00 tx=0x7f5588006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.765+0000 7f55867fc700 1 -- 172.21.15.81:0/1870299652 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5590053680 con 0x7f5598157bb0 2023-10-07T08:43:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.986+0000 7f559ce89700 1 -- 172.21.15.81:0/1870299652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f55980d0670 con 0x7f5598157bb0 2023-10-07T08:43:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.986+0000 7f55867fc700 1 -- 172.21.15.81:0/1870299652 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5590056ca0 con 0x7f5598157bb0 2023-10-07T08:43:10.988 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:10.988 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-07T08:43:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.988+0000 7f559ce89700 1 -- 172.21.15.81:0/1870299652 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5578066f30 msgr2=0x7f55780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.988+0000 7f559ce89700 1 --2- 172.21.15.81:0/1870299652 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5578066f30 0x7f55780693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f55980b2e00 tx=0x7f5588006f90 comp rx=0 tx=0).stop 2023-10-07T08:43:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.988+0000 7f559ce89700 1 -- 172.21.15.81:0/1870299652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5598157bb0 msgr2=0x7f559815c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.988+0000 7f559ce89700 1 --2- 172.21.15.81:0/1870299652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5598157bb0 0x7f559815c870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5598067780 tx=0x7f5590018000 comp rx=0 tx=0).stop 2023-10-07T08:43:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.988+0000 7f559ce89700 1 -- 172.21.15.81:0/1870299652 shutdown_connections 2023-10-07T08:43:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.988+0000 7f559ce89700 1 --2- 172.21.15.81:0/1870299652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5598157bb0 0x7f559815c870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.988+0000 7f559ce89700 1 --2- 172.21.15.81:0/1870299652 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5578066f30 0x7f55780693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.988+0000 7f559ce89700 1 --2- 172.21.15.81:0/1870299652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559806d240 0x7f55980aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.988+0000 7f559ce89700 1 --2- 172.21.15.81:0/1870299652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55981577e0 0x7f5598140670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.988+0000 7f559ce89700 1 -- 172.21.15.81:0/1870299652 >> 172.21.15.81:0/1870299652 conn(0x7f559806bb90 msgr2=0x7f55980b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.988+0000 7f559ce89700 1 -- 172.21.15.81:0/1870299652 shutdown_connections 2023-10-07T08:43:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:10.988+0000 7f559ce89700 1 -- 172.21.15.81:0/1870299652 wait complete. 2023-10-07T08:43:11.001 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-07T08:43:11.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.114+0000 7f131e5b5700 1 Processor -- start 2023-10-07T08:43:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.114+0000 7f131e5b5700 1 -- start start 2023-10-07T08:43:11.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.114+0000 7f131e5b5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f13180cf240 0x7f13180b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.114+0000 7f131e5b5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13180b0ca0 con 0x7f131806d650 2023-10-07T08:43:11.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.114+0000 7f131e5b5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13180b00d0 con 0x7f131815a2a0 2023-10-07T08:43:11.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.114+0000 7f131e5b5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131806ea90 con 0x7f13180cf240 2023-10-07T08:43:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.115+0000 7f131cb52700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f131806d650 0x7f131806da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59470/0 (socket says 172.21.15.81:59470) 2023-10-07T08:43:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.115+0000 7f131cb52700 1 -- 172.21.15.81:0/2206081087 learned_addr learned my addr 172.21.15.81:0/2206081087 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.115+0000 7f13177fe700 1 --2- 172.21.15.81:0/2206081087 >> v2:172.21.15.89:3300/0 conn(0x7f13180cf240 0x7f13180b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.115+0000 7f1316ffd700 1 -- 172.21.15.81:0/2206081087 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943717035 0 0) 0x7f13180b0ca0 con 0x7f131806d650 2023-10-07T08:43:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.115+0000 7f1316ffd700 1 -- 172.21.15.81:0/2206081087 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1300003570 con 0x7f131806d650 2023-10-07T08:43:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.115+0000 7f1316ffd700 1 -- 172.21.15.81:0/2206081087 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3697490228 0 0) 0x7f1300003570 con 0x7f131806d650 2023-10-07T08:43:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.115+0000 7f13177fe700 1 -- 172.21.15.81:0/2206081087 >> v1:172.21.15.89:6789/0 conn(0x7f131815a2a0 legacy=0x7f13180ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.115+0000 7f13177fe700 1 -- 172.21.15.81:0/2206081087 >> v1:172.21.15.81:6789/0 conn(0x7f131806d650 legacy=0x7f131806da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.115+0000 7f13177fe700 1 -- 172.21.15.81:0/2206081087 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13180b0370 con 0x7f13180cf240 2023-10-07T08:43:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.115+0000 7f13177fe700 1 --2- 172.21.15.81:0/2206081087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13180cf240 0x7f13180b1130 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f130c0098e0 tx=0x7f130c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a910f9e08ec8d701 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.115+0000 7f1316ffd700 1 -- 172.21.15.81:0/2206081087 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13100017f0 con 0x7f13180cf240 2023-10-07T08:43:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.115+0000 7f1316ffd700 1 -- 172.21.15.81:0/2206081087 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c011420 con 0x7f13180cf240 2023-10-07T08:43:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.115+0000 7f1316ffd700 1 -- 172.21.15.81:0/2206081087 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c0117c0 con 0x7f13180cf240 2023-10-07T08:43:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.116+0000 7f131e5b5700 1 -- 172.21.15.81:0/2206081087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13180cf240 msgr2=0x7f13180b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.116+0000 7f131e5b5700 1 --2- 172.21.15.81:0/2206081087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13180cf240 0x7f13180b1130 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f130c0098e0 tx=0x7f130c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.116+0000 7f131e5b5700 1 -- 172.21.15.81:0/2206081087 shutdown_connections 2023-10-07T08:43:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.116+0000 7f131e5b5700 1 --2- 172.21.15.81:0/2206081087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13180cf240 0x7f13180b1130 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.116+0000 7f131e5b5700 1 -- 172.21.15.81:0/2206081087 >> 172.21.15.81:0/2206081087 conn(0x7f1318067640 msgr2=0x7f1318067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.116+0000 7f131e5b5700 1 -- 172.21.15.81:0/2206081087 shutdown_connections 2023-10-07T08:43:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.116+0000 7f131e5b5700 1 -- 172.21.15.81:0/2206081087 wait complete. 2023-10-07T08:43:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.117+0000 7f131e5b5700 1 Processor -- start 2023-10-07T08:43:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.117+0000 7f131e5b5700 1 -- start start 2023-10-07T08:43:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f131e5b5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f131806d650 0x7f13180b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f131e5b5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13180cf240 0x7f13181488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f131e5b5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f131815a2a0 0x7f13180b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f131e5b5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1318148e20 con 0x7f131806d650 2023-10-07T08:43:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f131e5b5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13180b3840 con 0x7f131815a2a0 2023-10-07T08:43:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f131e5b5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13180b4ac0 con 0x7f13180cf240 2023-10-07T08:43:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f1317fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f131806d650 0x7f13180b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f1317fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f131806d650 0x7f13180b2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45274/0 (socket says 172.21.15.81:45274) 2023-10-07T08:43:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f1317fff700 1 -- 172.21.15.81:0/2045541782 learned_addr learned my addr 172.21.15.81:0/2045541782 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f131cb52700 1 --2- 172.21.15.81:0/2045541782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f131815a2a0 0x7f13180b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f13177fe700 1 --2- 172.21.15.81:0/2045541782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13180cf240 0x7f13181488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f1317fff700 1 -- 172.21.15.81:0/2045541782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13180cf240 msgr2=0x7f13181488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f1317fff700 1 --2- 172.21.15.81:0/2045541782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13180cf240 0x7f13181488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f1317fff700 1 -- 172.21.15.81:0/2045541782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f131815a2a0 msgr2=0x7f13180b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f1317fff700 1 --2- 172.21.15.81:0/2045541782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f131815a2a0 0x7f13180b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f1317fff700 1 -- 172.21.15.81:0/2045541782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c009420 con 0x7f131806d650 2023-10-07T08:43:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f1317fff700 1 --2- 172.21.15.81:0/2045541782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f131806d650 0x7f13180b2910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f130800c4e0 tx=0x7f130800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.118+0000 7f12fffff700 1 -- 172.21.15.81:0/2045541782 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308011590 con 0x7f131806d650 2023-10-07T08:43:11.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.119+0000 7f131e5b5700 1 -- 172.21.15.81:0/2045541782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13180b2fa0 con 0x7f131806d650 2023-10-07T08:43:11.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.119+0000 7f12fffff700 1 -- 172.21.15.81:0/2045541782 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1308011710 con 0x7f131806d650 2023-10-07T08:43:11.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.119+0000 7f12fffff700 1 -- 172.21.15.81:0/2045541782 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308011ad0 con 0x7f131806d650 2023-10-07T08:43:11.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.119+0000 7f131e5b5700 1 -- 172.21.15.81:0/2045541782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13180b3560 con 0x7f131806d650 2023-10-07T08:43:11.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.119+0000 7f131e5b5700 1 -- 172.21.15.81:0/2045541782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1318069e40 con 0x7f131806d650 2023-10-07T08:43:11.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.120+0000 7f12fffff700 1 -- 172.21.15.81:0/2045541782 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f130801b3b0 con 0x7f131806d650 2023-10-07T08:43:11.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.120+0000 7f12fffff700 1 --2- 172.21.15.81:0/2045541782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1304066f30 0x7f13040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.120+0000 7f12fffff700 1 -- 172.21.15.81:0/2045541782 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f13080838f0 con 0x7f131806d650 2023-10-07T08:43:11.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.120+0000 7f13177fe700 1 --2- 172.21.15.81:0/2045541782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1304066f30 0x7f13040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.121+0000 7f13177fe700 1 --2- 172.21.15.81:0/2045541782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1304066f30 0x7f13040693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f130c0098e0 tx=0x7f130c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:11.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.124+0000 7f12fffff700 1 -- 172.21.15.81:0/2045541782 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1308050b60 con 0x7f131806d650 2023-10-07T08:43:11.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.309+0000 7f131e5b5700 1 -- 172.21.15.81:0/2045541782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f131804bb80 con 0x7f131806d650 2023-10-07T08:43:11.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.310+0000 7f12fffff700 1 -- 172.21.15.81:0/2045541782 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f1308017070 con 0x7f131806d650 2023-10-07T08:43:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:11.311 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:58.248338+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:42:54.397263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:42:55.595133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:11.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.311+0000 7f131e5b5700 1 -- 172.21.15.81:0/2045541782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1304066f30 msgr2=0x7f13040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.311+0000 7f131e5b5700 1 --2- 172.21.15.81:0/2045541782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1304066f30 0x7f13040693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f130c0098e0 tx=0x7f130c016000 comp rx=0 tx=0).stop 2023-10-07T08:43:11.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.311+0000 7f131e5b5700 1 -- 172.21.15.81:0/2045541782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f131806d650 msgr2=0x7f13180b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.311+0000 7f131e5b5700 1 --2- 172.21.15.81:0/2045541782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f131806d650 0x7f13180b2910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f130800c4e0 tx=0x7f130800c7f0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.312+0000 7f131e5b5700 1 -- 172.21.15.81:0/2045541782 shutdown_connections 2023-10-07T08:43:11.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.312+0000 7f131e5b5700 1 --2- 172.21.15.81:0/2045541782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f131815a2a0 0x7f13180b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.312+0000 7f131e5b5700 1 --2- 172.21.15.81:0/2045541782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f131806d650 0x7f13180b2910 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.312+0000 7f131e5b5700 1 --2- 172.21.15.81:0/2045541782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1304066f30 0x7f13040693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.312+0000 7f131e5b5700 1 --2- 172.21.15.81:0/2045541782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13180cf240 0x7f13181488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.312+0000 7f131e5b5700 1 -- 172.21.15.81:0/2045541782 >> 172.21.15.81:0/2045541782 conn(0x7f1318067640 msgr2=0x7f1318156bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:11.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.312+0000 7f131e5b5700 1 -- 172.21.15.81:0/2045541782 shutdown_connections 2023-10-07T08:43:11.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.312+0000 7f131e5b5700 1 -- 172.21.15.81:0/2045541782 wait complete. 2023-10-07T08:43:11.325 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:42:54.397263+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:42:55.595133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:43:11.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:43:11.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.442+0000 7ff9b573a700 1 Processor -- start 2023-10-07T08:43:11.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.442+0000 7ff9b573a700 1 -- start start 2023-10-07T08:43:11.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.443+0000 7ff9b573a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff9b00cf240 0x7ff9b0162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.443+0000 7ff9b573a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b00b2890 con 0x7ff9b0157fe0 2023-10-07T08:43:11.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.443+0000 7ff9b573a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b00b4070 con 0x7ff9b00b3bd0 2023-10-07T08:43:11.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.443+0000 7ff9b573a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b00b4350 con 0x7ff9b00cf240 2023-10-07T08:43:11.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.443+0000 7ff9af7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff9b00cf240 0x7ff9b0162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.443+0000 7ff9aeffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff9b0157fe0 0x7ff9b00b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59478/0 (socket says 172.21.15.81:59478) 2023-10-07T08:43:11.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.443+0000 7ff9aeffd700 1 -- 172.21.15.81:0/1017235578 learned_addr learned my addr 172.21.15.81:0/1017235578 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.444+0000 7ff9af7fe700 1 -- 172.21.15.81:0/1017235578 >> v1:172.21.15.89:6789/0 conn(0x7ff9b00b3bd0 legacy=0x7ff9b00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.444+0000 7ff9af7fe700 1 -- 172.21.15.81:0/1017235578 >> v1:172.21.15.81:6789/0 conn(0x7ff9b0157fe0 legacy=0x7ff9b00b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.444+0000 7ff9af7fe700 1 -- 172.21.15.81:0/1017235578 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b00b4630 con 0x7ff9b00cf240 2023-10-07T08:43:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.444+0000 7ff9ae7fc700 1 -- 172.21.15.81:0/1017235578 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759771534 0 0) 0x7ff9b00b2890 con 0x7ff9b0157fe0 2023-10-07T08:43:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.444+0000 7ff9af7fe700 1 --2- 172.21.15.81:0/1017235578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b00cf240 0x7ff9b0162cd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009e60 tx=0x7ff9a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2986023493de2e91 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.444+0000 7ff9ae7fc700 1 -- 172.21.15.81:0/1017235578 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a800e070 con 0x7ff9b00cf240 2023-10-07T08:43:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.444+0000 7ff9ae7fc700 1 -- 172.21.15.81:0/1017235578 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a800bc30 con 0x7ff9b00cf240 2023-10-07T08:43:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.444+0000 7ff9ae7fc700 1 -- 172.21.15.81:0/1017235578 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8012430 con 0x7ff9b00cf240 2023-10-07T08:43:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.444+0000 7ff9b573a700 1 -- 172.21.15.81:0/1017235578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b00cf240 msgr2=0x7ff9b0162cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.444+0000 7ff9b573a700 1 --2- 172.21.15.81:0/1017235578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b00cf240 0x7ff9b0162cd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009e60 tx=0x7ff9a8009780 comp rx=0 tx=0).stop 2023-10-07T08:43:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.444+0000 7ff9b573a700 1 -- 172.21.15.81:0/1017235578 shutdown_connections 2023-10-07T08:43:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.444+0000 7ff9b573a700 1 --2- 172.21.15.81:0/1017235578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b00cf240 0x7ff9b0162cd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.444+0000 7ff9b573a700 1 -- 172.21.15.81:0/1017235578 >> 172.21.15.81:0/1017235578 conn(0x7ff9b0067640 msgr2=0x7ff9b0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.444+0000 7ff9b573a700 1 -- 172.21.15.81:0/1017235578 shutdown_connections 2023-10-07T08:43:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.444+0000 7ff9b573a700 1 -- 172.21.15.81:0/1017235578 wait complete. 2023-10-07T08:43:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.446+0000 7ff9b573a700 1 Processor -- start 2023-10-07T08:43:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.446+0000 7ff9b573a700 1 -- start start 2023-10-07T08:43:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.446+0000 7ff9b573a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b00b3bd0 0x7ff9b015a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.446+0000 7ff9b573a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b00cf240 0x7ff9b00c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.446+0000 7ff9b573a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b0157fe0 0x7ff9b0153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.446+0000 7ff9b573a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00c7d00 con 0x7ff9b0157fe0 2023-10-07T08:43:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.446+0000 7ff9b573a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00c3940 con 0x7ff9b00cf240 2023-10-07T08:43:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.446+0000 7ff9b573a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00c3ec0 con 0x7ff9b00b3bd0 2023-10-07T08:43:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.446+0000 7ff9af7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b0157fe0 0x7ff9b0153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.446+0000 7ff9af7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b0157fe0 0x7ff9b0153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45288/0 (socket says 172.21.15.81:45288) 2023-10-07T08:43:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.446+0000 7ff9af7fe700 1 -- 172.21.15.81:0/4095971870 learned_addr learned my addr 172.21.15.81:0/4095971870 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.447+0000 7ff9aeffd700 1 --2- 172.21.15.81:0/4095971870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b00b3bd0 0x7ff9b015a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.447+0000 7ff9a67fc700 1 --2- 172.21.15.81:0/4095971870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b00cf240 0x7ff9b00c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.447+0000 7ff9af7fe700 1 -- 172.21.15.81:0/4095971870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b00b3bd0 msgr2=0x7ff9b015a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.447+0000 7ff9af7fe700 1 --2- 172.21.15.81:0/4095971870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b00b3bd0 0x7ff9b015a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.447+0000 7ff9af7fe700 1 -- 172.21.15.81:0/4095971870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b00cf240 msgr2=0x7ff9b00c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.447+0000 7ff9af7fe700 1 --2- 172.21.15.81:0/4095971870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b00cf240 0x7ff9b00c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.447+0000 7ff9af7fe700 1 -- 172.21.15.81:0/4095971870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a8009a20 con 0x7ff9b0157fe0 2023-10-07T08:43:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.447+0000 7ff9aeffd700 1 --2- 172.21.15.81:0/4095971870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b00b3bd0 0x7ff9b015a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.447+0000 7ff9a67fc700 1 --2- 172.21.15.81:0/4095971870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b00cf240 0x7ff9b00c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.447+0000 7ff9af7fe700 1 --2- 172.21.15.81:0/4095971870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b0157fe0 0x7ff9b0153180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9b006f990 tx=0x7ff9a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.447+0000 7ff9a77fe700 1 -- 172.21.15.81:0/4095971870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a801b630 con 0x7ff9b0157fe0 2023-10-07T08:43:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.447+0000 7ff9a77fe700 1 -- 172.21.15.81:0/4095971870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a801b790 con 0x7ff9b0157fe0 2023-10-07T08:43:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.447+0000 7ff9b573a700 1 -- 172.21.15.81:0/4095971870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b00c77a0 con 0x7ff9b0157fe0 2023-10-07T08:43:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.447+0000 7ff9a77fe700 1 -- 172.21.15.81:0/4095971870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a801bb50 con 0x7ff9b0157fe0 2023-10-07T08:43:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.447+0000 7ff9b573a700 1 -- 172.21.15.81:0/4095971870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b015a710 con 0x7ff9b0157fe0 2023-10-07T08:43:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.448+0000 7ff9b573a700 1 -- 172.21.15.81:0/4095971870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b015a900 con 0x7ff9b0157fe0 2023-10-07T08:43:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.448+0000 7ff9a77fe700 1 -- 172.21.15.81:0/4095971870 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9a801c400 con 0x7ff9b0157fe0 2023-10-07T08:43:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.449+0000 7ff9a77fe700 1 --2- 172.21.15.81:0/4095971870 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff990066f30 0x7ff9900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.449+0000 7ff9aeffd700 1 --2- 172.21.15.81:0/4095971870 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff990066f30 0x7ff9900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.449+0000 7ff9a77fe700 1 -- 172.21.15.81:0/4095971870 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9a80864d0 con 0x7ff9b0157fe0 2023-10-07T08:43:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.449+0000 7ff9aeffd700 1 --2- 172.21.15.81:0/4095971870 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff990066f30 0x7ff9900693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00011e0 tx=0x7ff9a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:11.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.453+0000 7ff9a77fe700 1 -- 172.21.15.81:0/4095971870 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9a8053740 con 0x7ff9b0157fe0 2023-10-07T08:43:11.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.634+0000 7ff9b573a700 1 -- 172.21.15.81:0/4095971870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9b004bb80 con 0x7ff9b0157fe0 2023-10-07T08:43:11.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.635+0000 7ff9a77fe700 1 -- 172.21.15.81:0/4095971870 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9a8056d60 con 0x7ff9b0157fe0 2023-10-07T08:43:11.636 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:43:11.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.637+0000 7ff9b573a700 1 -- 172.21.15.81:0/4095971870 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff990066f30 msgr2=0x7ff9900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.637+0000 7ff9b573a700 1 --2- 172.21.15.81:0/4095971870 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff990066f30 0x7ff9900693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00011e0 tx=0x7ff9a0009040 comp rx=0 tx=0).stop 2023-10-07T08:43:11.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.637+0000 7ff9b573a700 1 -- 172.21.15.81:0/4095971870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b0157fe0 msgr2=0x7ff9b0153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.637+0000 7ff9b573a700 1 --2- 172.21.15.81:0/4095971870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b0157fe0 0x7ff9b0153180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9b006f990 tx=0x7ff9a8019000 comp rx=0 tx=0).stop 2023-10-07T08:43:11.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.637+0000 7ff9b573a700 1 -- 172.21.15.81:0/4095971870 shutdown_connections 2023-10-07T08:43:11.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.637+0000 7ff9b573a700 1 --2- 172.21.15.81:0/4095971870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b0157fe0 0x7ff9b0153180 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.637+0000 7ff9b573a700 1 --2- 172.21.15.81:0/4095971870 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff990066f30 0x7ff9900693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.637+0000 7ff9b573a700 1 --2- 172.21.15.81:0/4095971870 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b00b3bd0 0x7ff9b015a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.637+0000 7ff9b573a700 1 --2- 172.21.15.81:0/4095971870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b00cf240 0x7ff9b00c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.637+0000 7ff9b573a700 1 -- 172.21.15.81:0/4095971870 >> 172.21.15.81:0/4095971870 conn(0x7ff9b0067640 msgr2=0x7ff9b00b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:11.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.637+0000 7ff9b573a700 1 -- 172.21.15.81:0/4095971870 shutdown_connections 2023-10-07T08:43:11.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.637+0000 7ff9b573a700 1 -- 172.21.15.81:0/4095971870 wait complete. 2023-10-07T08:43:11.650 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:43:11.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.765+0000 7f49713cf700 1 Processor -- start 2023-10-07T08:43:11.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.765+0000 7f49713cf700 1 -- start start 2023-10-07T08:43:11.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.766+0000 7f49713cf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f496c06d830 0x7f496c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.766+0000 7f49713cf700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496c0d07c0 con 0x7f496c1578d0 2023-10-07T08:43:11.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.766+0000 7f49713cf700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496c0cfbb0 con 0x7f496c157ca0 2023-10-07T08:43:11.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.766+0000 7f49713cf700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496c0cfe90 con 0x7f496c06d830 2023-10-07T08:43:11.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.766+0000 7f496affd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f496c1578d0 0x7f496c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59492/0 (socket says 172.21.15.81:59492) 2023-10-07T08:43:11.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.766+0000 7f496affd700 1 -- 172.21.15.81:0/1549953833 learned_addr learned my addr 172.21.15.81:0/1549953833 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:11.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.766+0000 7f496b7fe700 1 --2- 172.21.15.81:0/1549953833 >> v2:172.21.15.89:3300/0 conn(0x7f496c06d830 0x7f496c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.766+0000 7f496a7fc700 1 -- 172.21.15.81:0/1549953833 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152331369 0 0) 0x7f496c0d07c0 con 0x7f496c1578d0 2023-10-07T08:43:11.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.766+0000 7f496a7fc700 1 -- 172.21.15.81:0/1549953833 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4958003570 con 0x7f496c1578d0 2023-10-07T08:43:11.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496a7fc700 1 -- 172.21.15.81:0/1549953833 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3084262047 0 0) 0x7f4958003570 con 0x7f496c1578d0 2023-10-07T08:43:11.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496a7fc700 1 -- 172.21.15.81:0/1549953833 >> v2:172.21.15.89:3300/0 conn(0x7f496c06d830 msgr2=0x7f496c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:11.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496a7fc700 1 --2- 172.21.15.81:0/1549953833 >> v2:172.21.15.89:3300/0 conn(0x7f496c06d830 0x7f496c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496a7fc700 1 -- 172.21.15.81:0/1549953833 >> v1:172.21.15.89:6789/0 conn(0x7f496c157ca0 legacy=0x7f496c06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496a7fc700 1 -- 172.21.15.81:0/1549953833 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c0d0170 con 0x7f496c1578d0 2023-10-07T08:43:11.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496a7fc700 1 -- 172.21.15.81:0/1549953833 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f495c001470 con 0x7f496c1578d0 2023-10-07T08:43:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496a7fc700 1 -- 172.21.15.81:0/1549953833 >> v1:172.21.15.81:6789/0 conn(0x7f496c1578d0 legacy=0x7f496c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496a7fc700 1 --2- 172.21.15.81:0/1549953833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4958003a60 0x7f4958003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496a7fc700 1 --2- 172.21.15.81:0/1549953833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4958004810 0x7f4958004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496a7fc700 1 --2- 172.21.15.81:0/1549953833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49580051c0 0x7f495800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496a7fc700 1 -- 172.21.15.81:0/1549953833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0cfe90 con 0x7f4958003a60 2023-10-07T08:43:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496a7fc700 1 -- 172.21.15.81:0/1549953833 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495800c0d0 con 0x7f49580051c0 2023-10-07T08:43:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496a7fc700 1 -- 172.21.15.81:0/1549953833 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495800c290 con 0x7f4958004810 2023-10-07T08:43:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496b7fe700 1 --2- 172.21.15.81:0/1549953833 >> v2:172.21.15.89:3300/0 conn(0x7f496c06d830 0x7f496c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496affd700 1 --2- 172.21.15.81:0/1549953833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4958003a60 0x7f4958003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496b7fe700 1 --2- 172.21.15.81:0/1549953833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49580051c0 0x7f495800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f49627fc700 1 --2- 172.21.15.81:0/1549953833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4958004810 0x7f4958004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496affd700 1 -- 172.21.15.81:0/1549953833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4958004810 msgr2=0x7f4958004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496affd700 1 --2- 172.21.15.81:0/1549953833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4958004810 0x7f4958004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496affd700 1 -- 172.21.15.81:0/1549953833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49580051c0 msgr2=0x7f495800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496affd700 1 --2- 172.21.15.81:0/1549953833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49580051c0 0x7f495800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496affd700 1 -- 172.21.15.81:0/1549953833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4958003570 con 0x7f4958003a60 2023-10-07T08:43:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496b7fe700 1 --2- 172.21.15.81:0/1549953833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49580051c0 0x7f495800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496b7fe700 1 -- 172.21.15.81:0/1549953833 reap_dead start 2023-10-07T08:43:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496affd700 1 --2- 172.21.15.81:0/1549953833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4958003a60 0x7f4958003e70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f495c00c3c0 tx=0x7f495c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8c9d5b3f2e1ea server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496a7fc700 1 -- 172.21.15.81:0/1549953833 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00cc90 con 0x7f4958003a60 2023-10-07T08:43:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496a7fc700 1 -- 172.21.15.81:0/1549953833 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c00cdf0 con 0x7f4958003a60 2023-10-07T08:43:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.767+0000 7f496a7fc700 1 -- 172.21.15.81:0/1549953833 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c005b50 con 0x7f4958003a60 2023-10-07T08:43:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.768+0000 7f49713cf700 1 -- 172.21.15.81:0/1549953833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4958003a60 msgr2=0x7f4958003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.768+0000 7f49713cf700 1 --2- 172.21.15.81:0/1549953833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4958003a60 0x7f4958003e70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f495c00c3c0 tx=0x7f495c001e50 comp rx=0 tx=0).stop 2023-10-07T08:43:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.768+0000 7f49713cf700 1 -- 172.21.15.81:0/1549953833 shutdown_connections 2023-10-07T08:43:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.768+0000 7f49713cf700 1 --2- 172.21.15.81:0/1549953833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4958003a60 0x7f4958003e70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.768+0000 7f49713cf700 1 -- 172.21.15.81:0/1549953833 >> 172.21.15.81:0/1549953833 conn(0x7f496c06bb90 msgr2=0x7f496c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.768+0000 7f49713cf700 1 -- 172.21.15.81:0/1549953833 shutdown_connections 2023-10-07T08:43:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.768+0000 7f49713cf700 1 -- 172.21.15.81:0/1549953833 wait complete. 2023-10-07T08:43:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.769+0000 7f49713cf700 1 Processor -- start 2023-10-07T08:43:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.769+0000 7f49713cf700 1 -- start start 2023-10-07T08:43:11.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f49713cf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4958003a60 0x7f496c151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f49713cf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f496c14eb80 0x7f496c1397c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f49713cf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f496c15c820 0x7f496c15cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f49713cf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c15d1d0 con 0x7f496c15c820 2023-10-07T08:43:11.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f49713cf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c151580 con 0x7f496c14eb80 2023-10-07T08:43:11.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f49713cf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496c1506d0 con 0x7f4958003a60 2023-10-07T08:43:11.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f496b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f496c15c820 0x7f496c15cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f496affd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4958003a60 0x7f496c151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f496b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f496c15c820 0x7f496c15cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45308/0 (socket says 172.21.15.81:45308) 2023-10-07T08:43:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f496b7fe700 1 -- 172.21.15.81:0/1226092532 learned_addr learned my addr 172.21.15.81:0/1226092532 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f49627fc700 1 --2- 172.21.15.81:0/1226092532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f496c14eb80 0x7f496c1397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f496b7fe700 1 -- 172.21.15.81:0/1226092532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4958003a60 msgr2=0x7f496c151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f496b7fe700 1 --2- 172.21.15.81:0/1226092532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4958003a60 0x7f496c151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f496b7fe700 1 -- 172.21.15.81:0/1226092532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f496c14eb80 msgr2=0x7f496c1397c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f496b7fe700 1 --2- 172.21.15.81:0/1226092532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f496c14eb80 0x7f496c1397c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f496b7fe700 1 -- 172.21.15.81:0/1226092532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c150970 con 0x7f496c15c820 2023-10-07T08:43:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f496b7fe700 1 --2- 172.21.15.81:0/1226092532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f496c15c820 0x7f496c15cc90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f496c0b2ee0 tx=0x7f496400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:11.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f49637fe700 1 -- 172.21.15.81:0/1226092532 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496400e070 con 0x7f496c15c820 2023-10-07T08:43:11.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f49637fe700 1 -- 172.21.15.81:0/1226092532 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4964011c50 con 0x7f496c15c820 2023-10-07T08:43:11.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.770+0000 7f49713cf700 1 -- 172.21.15.81:0/1226092532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496c150c50 con 0x7f496c15c820 2023-10-07T08:43:11.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.771+0000 7f49637fe700 1 -- 172.21.15.81:0/1226092532 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4964016470 con 0x7f496c15c820 2023-10-07T08:43:11.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.771+0000 7f49713cf700 1 -- 172.21.15.81:0/1226092532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496c151210 con 0x7f496c15c820 2023-10-07T08:43:11.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.772+0000 7f49713cf700 1 -- 172.21.15.81:0/1226092532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496c1513d0 con 0x7f496c15c820 2023-10-07T08:43:11.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.772+0000 7f49637fe700 1 -- 172.21.15.81:0/1226092532 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49640167e0 con 0x7f496c15c820 2023-10-07T08:43:11.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.772+0000 7f49637fe700 1 --2- 172.21.15.81:0/1226092532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f494c066f30 0x7f494c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:11.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.772+0000 7f49637fe700 1 -- 172.21.15.81:0/1226092532 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4964085050 con 0x7f496c15c820 2023-10-07T08:43:11.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.772+0000 7f496affd700 1 --2- 172.21.15.81:0/1226092532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f494c066f30 0x7f494c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.773+0000 7f496affd700 1 --2- 172.21.15.81:0/1226092532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f494c066f30 0x7f494c0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f495c001ed0 tx=0x7f495c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.777+0000 7f49637fe700 1 -- 172.21.15.81:0/1226092532 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49640522c0 con 0x7f496c15c820 2023-10-07T08:43:11.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.956+0000 7f49713cf700 1 -- 172.21.15.81:0/1226092532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f496c0d0450 con 0x7f496c15c820 2023-10-07T08:43:11.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.956+0000 7f49637fe700 1 -- 172.21.15.81:0/1226092532 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f49640558e0 con 0x7f496c15c820 2023-10-07T08:43:11.958 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:43:11.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.958+0000 7f49713cf700 1 -- 172.21.15.81:0/1226092532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f494c066f30 msgr2=0x7f494c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.958+0000 7f49713cf700 1 --2- 172.21.15.81:0/1226092532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f494c066f30 0x7f494c0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f495c001ed0 tx=0x7f495c015000 comp rx=0 tx=0).stop 2023-10-07T08:43:11.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.958+0000 7f49713cf700 1 -- 172.21.15.81:0/1226092532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f496c15c820 msgr2=0x7f496c15cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:11.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.958+0000 7f49713cf700 1 --2- 172.21.15.81:0/1226092532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f496c15c820 0x7f496c15cc90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f496c0b2ee0 tx=0x7f496400b040 comp rx=0 tx=0).stop 2023-10-07T08:43:11.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.958+0000 7f49713cf700 1 -- 172.21.15.81:0/1226092532 shutdown_connections 2023-10-07T08:43:11.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.958+0000 7f49713cf700 1 --2- 172.21.15.81:0/1226092532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f496c15c820 0x7f496c15cc90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.958+0000 7f49713cf700 1 --2- 172.21.15.81:0/1226092532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f494c066f30 0x7f494c0693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.958+0000 7f49713cf700 1 --2- 172.21.15.81:0/1226092532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4958003a60 0x7f496c151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.958+0000 7f49713cf700 1 --2- 172.21.15.81:0/1226092532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f496c14eb80 0x7f496c1397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:11.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.958+0000 7f49713cf700 1 -- 172.21.15.81:0/1226092532 >> 172.21.15.81:0/1226092532 conn(0x7f496c06bb90 msgr2=0x7f496c1567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:11.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.958+0000 7f49713cf700 1 -- 172.21.15.81:0/1226092532 shutdown_connections 2023-10-07T08:43:11.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:11.958+0000 7f49713cf700 1 -- 172.21.15.81:0/1226092532 wait complete. 2023-10-07T08:43:11.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:43:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.088+0000 7fdfc68d5700 1 Processor -- start 2023-10-07T08:43:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.088+0000 7fdfc68d5700 1 -- start start 2023-10-07T08:43:12.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.088+0000 7fdfc68d5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdfc015a2a0 0x7fdfc00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.088+0000 7fdfc68d5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc00b0ca0 con 0x7fdfc00ceb30 2023-10-07T08:43:12.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.088+0000 7fdfc68d5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc00b00d0 con 0x7fdfc006dd60 2023-10-07T08:43:12.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.088+0000 7fdfc68d5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc006e160 con 0x7fdfc015a2a0 2023-10-07T08:43:12.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.088+0000 7fdfbf7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdfc00ceb30 0x7fdfc006d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59496/0 (socket says 172.21.15.81:59496) 2023-10-07T08:43:12.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.088+0000 7fdfbf7fe700 1 -- 172.21.15.81:0/1955132858 learned_addr learned my addr 172.21.15.81:0/1955132858 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:12.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.089+0000 7fdfbffff700 1 --2- 172.21.15.81:0/1955132858 >> v2:172.21.15.89:3300/0 conn(0x7fdfc015a2a0 0x7fdfc00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.089+0000 7fdfbeffd700 1 -- 172.21.15.81:0/1955132858 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443322014 0 0) 0x7fdfc00b0ca0 con 0x7fdfc00ceb30 2023-10-07T08:43:12.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.089+0000 7fdfbeffd700 1 -- 172.21.15.81:0/1955132858 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfa8003570 con 0x7fdfc00ceb30 2023-10-07T08:43:12.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.089+0000 7fdfbffff700 1 -- 172.21.15.81:0/1955132858 >> v1:172.21.15.89:6789/0 conn(0x7fdfc006dd60 legacy=0x7fdfc00b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.089+0000 7fdfbffff700 1 -- 172.21.15.81:0/1955132858 >> v1:172.21.15.81:6789/0 conn(0x7fdfc00ceb30 legacy=0x7fdfc006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.089+0000 7fdfbffff700 1 -- 172.21.15.81:0/1955132858 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc00b0370 con 0x7fdfc015a2a0 2023-10-07T08:43:12.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.089+0000 7fdfbffff700 1 --2- 172.21.15.81:0/1955132858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfc015a2a0 0x7fdfc00b1130 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00098e0 tx=0x7fdfb00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcb3f1eca0d30443 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:12.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.089+0000 7fdfbeffd700 1 -- 172.21.15.81:0/1955132858 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000b640 con 0x7fdfc015a2a0 2023-10-07T08:43:12.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.089+0000 7fdfbeffd700 1 -- 172.21.15.81:0/1955132858 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb000b7a0 con 0x7fdfc015a2a0 2023-10-07T08:43:12.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.089+0000 7fdfbeffd700 1 -- 172.21.15.81:0/1955132858 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000bb40 con 0x7fdfc015a2a0 2023-10-07T08:43:12.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.090+0000 7fdfc68d5700 1 -- 172.21.15.81:0/1955132858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfc015a2a0 msgr2=0x7fdfc00b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.090+0000 7fdfc68d5700 1 --2- 172.21.15.81:0/1955132858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfc015a2a0 0x7fdfc00b1130 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00098e0 tx=0x7fdfb00091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.090+0000 7fdfc68d5700 1 -- 172.21.15.81:0/1955132858 shutdown_connections 2023-10-07T08:43:12.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.090+0000 7fdfc68d5700 1 --2- 172.21.15.81:0/1955132858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfc015a2a0 0x7fdfc00b1130 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.090+0000 7fdfc68d5700 1 -- 172.21.15.81:0/1955132858 >> 172.21.15.81:0/1955132858 conn(0x7fdfc0067640 msgr2=0x7fdfc0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:12.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.090+0000 7fdfc68d5700 1 -- 172.21.15.81:0/1955132858 shutdown_connections 2023-10-07T08:43:12.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.090+0000 7fdfc68d5700 1 -- 172.21.15.81:0/1955132858 wait complete. 2023-10-07T08:43:12.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.091+0000 7fdfc68d5700 1 Processor -- start 2023-10-07T08:43:12.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.091+0000 7fdfc68d5700 1 -- start start 2023-10-07T08:43:12.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfc68d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfc006dd60 0x7fdfc0146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfc68d5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfc00ceb30 0x7fdfc00cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfc68d5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfc015a2a0 0x7fdfc00ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfc68d5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc016a9b0 con 0x7fdfc006dd60 2023-10-07T08:43:12.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfc68d5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc016b960 con 0x7fdfc00ceb30 2023-10-07T08:43:12.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfc68d5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc016b4d0 con 0x7fdfc015a2a0 2023-10-07T08:43:12.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfbffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfc006dd60 0x7fdfc0146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfbffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfc006dd60 0x7fdfc0146750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45314/0 (socket says 172.21.15.81:45314) 2023-10-07T08:43:12.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfbffff700 1 -- 172.21.15.81:0/632040460 learned_addr learned my addr 172.21.15.81:0/632040460 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:12.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfbf7fe700 1 --2- 172.21.15.81:0/632040460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfc00ceb30 0x7fdfc00cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfc4e72700 1 --2- 172.21.15.81:0/632040460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfc015a2a0 0x7fdfc00ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfbffff700 1 -- 172.21.15.81:0/632040460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfc015a2a0 msgr2=0x7fdfc00ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfbffff700 1 --2- 172.21.15.81:0/632040460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfc015a2a0 0x7fdfc00ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfbffff700 1 -- 172.21.15.81:0/632040460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfc00ceb30 msgr2=0x7fdfc00cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfbffff700 1 --2- 172.21.15.81:0/632040460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfc00ceb30 0x7fdfc00cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfbffff700 1 -- 172.21.15.81:0/632040460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb0009420 con 0x7fdfc006dd60 2023-10-07T08:43:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfc4e72700 1 --2- 172.21.15.81:0/632040460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfc015a2a0 0x7fdfc00ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfbf7fe700 1 --2- 172.21.15.81:0/632040460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfc00ceb30 0x7fdfc00cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfbffff700 1 --2- 172.21.15.81:0/632040460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfc006dd60 0x7fdfc0146750 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009f80 tx=0x7fdfb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.092+0000 7fdfa7fff700 1 -- 172.21.15.81:0/632040460 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000bb20 con 0x7fdfc006dd60 2023-10-07T08:43:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.093+0000 7fdfa7fff700 1 -- 172.21.15.81:0/632040460 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb0011420 con 0x7fdfc006dd60 2023-10-07T08:43:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.093+0000 7fdfc68d5700 1 -- 172.21.15.81:0/632040460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc016aba0 con 0x7fdfc006dd60 2023-10-07T08:43:12.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.093+0000 7fdfa7fff700 1 -- 172.21.15.81:0/632040460 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00117a0 con 0x7fdfc006dd60 2023-10-07T08:43:12.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.093+0000 7fdfc68d5700 1 -- 172.21.15.81:0/632040460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc016b160 con 0x7fdfc006dd60 2023-10-07T08:43:12.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.093+0000 7fdfc68d5700 1 -- 172.21.15.81:0/632040460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc016b7b0 con 0x7fdfc006dd60 2023-10-07T08:43:12.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.094+0000 7fdfa7fff700 1 -- 172.21.15.81:0/632040460 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfb0011b10 con 0x7fdfc006dd60 2023-10-07T08:43:12.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.094+0000 7fdfa7fff700 1 --2- 172.21.15.81:0/632040460 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdfac066f30 0x7fdfac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.094+0000 7fdfbf7fe700 1 --2- 172.21.15.81:0/632040460 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdfac066f30 0x7fdfac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.094+0000 7fdfa7fff700 1 -- 172.21.15.81:0/632040460 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdfb0085920 con 0x7fdfc006dd60 2023-10-07T08:43:12.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.095+0000 7fdfbf7fe700 1 --2- 172.21.15.81:0/632040460 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdfac066f30 0x7fdfac0693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdfc015d430 tx=0x7fdfb4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:12.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.099+0000 7fdfa7fff700 1 -- 172.21.15.81:0/632040460 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfb0052c10 con 0x7fdfc006dd60 2023-10-07T08:43:12.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.282+0000 7fdfc68d5700 1 -- 172.21.15.81:0/632040460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdfc01588c0 con 0x7fdfc006dd60 2023-10-07T08:43:12.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.283+0000 7fdfa7fff700 1 -- 172.21.15.81:0/632040460 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdfb00150a0 con 0x7fdfc006dd60 2023-10-07T08:43:12.284 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:43:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.284+0000 7fdfc68d5700 1 -- 172.21.15.81:0/632040460 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdfac066f30 msgr2=0x7fdfac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.284+0000 7fdfc68d5700 1 --2- 172.21.15.81:0/632040460 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdfac066f30 0x7fdfac0693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdfc015d430 tx=0x7fdfb4009040 comp rx=0 tx=0).stop 2023-10-07T08:43:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.284+0000 7fdfc68d5700 1 -- 172.21.15.81:0/632040460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfc006dd60 msgr2=0x7fdfc0146750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.284+0000 7fdfc68d5700 1 --2- 172.21.15.81:0/632040460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfc006dd60 0x7fdfc0146750 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009f80 tx=0x7fdfb0017000 comp rx=0 tx=0).stop 2023-10-07T08:43:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.285+0000 7fdfc68d5700 1 -- 172.21.15.81:0/632040460 shutdown_connections 2023-10-07T08:43:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.285+0000 7fdfc68d5700 1 --2- 172.21.15.81:0/632040460 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdfac066f30 0x7fdfac0693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.285+0000 7fdfc68d5700 1 --2- 172.21.15.81:0/632040460 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfc015a2a0 0x7fdfc00ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.285+0000 7fdfc68d5700 1 --2- 172.21.15.81:0/632040460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfc006dd60 0x7fdfc0146750 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.285+0000 7fdfc68d5700 1 --2- 172.21.15.81:0/632040460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfc00ceb30 0x7fdfc00cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.285+0000 7fdfc68d5700 1 -- 172.21.15.81:0/632040460 >> 172.21.15.81:0/632040460 conn(0x7fdfc0067640 msgr2=0x7fdfc015fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.285+0000 7fdfc68d5700 1 -- 172.21.15.81:0/632040460 shutdown_connections 2023-10-07T08:43:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.285+0000 7fdfc68d5700 1 -- 172.21.15.81:0/632040460 wait complete. 2023-10-07T08:43:12.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:43:12.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.413+0000 7f36a7190700 1 Processor -- start 2023-10-07T08:43:12.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.413+0000 7f36a7190700 1 -- start start 2023-10-07T08:43:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a7190700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36a0159b40 0x7f36a00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a7190700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36a0159f10 0x7f36a0068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a7190700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f36a00ccb40 0x7f36a0068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a7190700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a00cee10 con 0x7f36a0159f10 2023-10-07T08:43:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a7190700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a00cd040 con 0x7f36a00ccb40 2023-10-07T08:43:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a7190700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00cd320 con 0x7f36a0159b40 2023-10-07T08:43:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a598d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36a0159f10 0x7f36a0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a598d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36a0159f10 0x7f36a0068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39050/0 (socket says 172.21.15.81:39050) 2023-10-07T08:43:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a598d700 1 -- 172.21.15.81:0/3765457994 learned_addr learned my addr 172.21.15.81:0/3765457994 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a598d700 1 -- 172.21.15.81:0/3765457994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36a0159b40 msgr2=0x7f36a00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a618e700 1 --2- 172.21.15.81:0/3765457994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36a0159b40 0x7f36a00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a698f700 1 --2- 172.21.15.81:0/3765457994 >> v2:172.21.15.89:3300/0 conn(0x7f36a00ccb40 0x7f36a0068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a598d700 1 --2- 172.21.15.81:0/3765457994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36a0159b40 0x7f36a00cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a598d700 1 -- 172.21.15.81:0/3765457994 >> v2:172.21.15.89:3300/0 conn(0x7f36a00ccb40 msgr2=0x7f36a0068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a598d700 1 --2- 172.21.15.81:0/3765457994 >> v2:172.21.15.89:3300/0 conn(0x7f36a00ccb40 0x7f36a0068cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a598d700 1 -- 172.21.15.81:0/3765457994 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a00ce7c0 con 0x7f36a0159f10 2023-10-07T08:43:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a598d700 1 --2- 172.21.15.81:0/3765457994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36a0159f10 0x7f36a0068780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f36a00b6bf0 tx=0x7f3690009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18d1bf5c81c5e8c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a518c700 1 -- 172.21.15.81:0/3765457994 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369000b860 con 0x7f36a0159f10 2023-10-07T08:43:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a518c700 1 -- 172.21.15.81:0/3765457994 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369000b9c0 con 0x7f36a0159f10 2023-10-07T08:43:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a518c700 1 -- 172.21.15.81:0/3765457994 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369000bd60 con 0x7f36a0159f10 2023-10-07T08:43:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a7190700 1 -- 172.21.15.81:0/3765457994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36a0159f10 msgr2=0x7f36a0068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a7190700 1 --2- 172.21.15.81:0/3765457994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36a0159f10 0x7f36a0068780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f36a00b6bf0 tx=0x7f3690009250 comp rx=0 tx=0).stop 2023-10-07T08:43:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a7190700 1 -- 172.21.15.81:0/3765457994 shutdown_connections 2023-10-07T08:43:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a7190700 1 --2- 172.21.15.81:0/3765457994 >> v2:172.21.15.89:3300/0 conn(0x7f36a00ccb40 0x7f36a0068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a7190700 1 --2- 172.21.15.81:0/3765457994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36a0159b40 0x7f36a00cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a7190700 1 --2- 172.21.15.81:0/3765457994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36a0159f10 0x7f36a0068780 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a7190700 1 -- 172.21.15.81:0/3765457994 >> 172.21.15.81:0/3765457994 conn(0x7f36a00cd660 msgr2=0x7f36a00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a7190700 1 -- 172.21.15.81:0/3765457994 shutdown_connections 2023-10-07T08:43:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.414+0000 7f36a7190700 1 -- 172.21.15.81:0/3765457994 wait complete. 2023-10-07T08:43:12.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.415+0000 7f36a7190700 1 Processor -- start 2023-10-07T08:43:12.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.415+0000 7f36a7190700 1 -- start start 2023-10-07T08:43:12.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a7190700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36a00ccb40 0x7f36a0140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a7190700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36a0159b40 0x7f36a0158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a7190700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36a0159f10 0x7f36a0141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a7190700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a0157c30 con 0x7f36a0159b40 2023-10-07T08:43:12.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a7190700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a015a5d0 con 0x7f36a0159f10 2023-10-07T08:43:12.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a7190700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a0157020 con 0x7f36a00ccb40 2023-10-07T08:43:12.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a598d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36a0159b40 0x7f36a0158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a598d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36a0159b40 0x7f36a0158d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39056/0 (socket says 172.21.15.81:39056) 2023-10-07T08:43:12.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a598d700 1 -- 172.21.15.81:0/3079821538 learned_addr learned my addr 172.21.15.81:0/3079821538 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:12.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a618e700 1 --2- 172.21.15.81:0/3079821538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36a00ccb40 0x7f36a0140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a698f700 1 --2- 172.21.15.81:0/3079821538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36a0159f10 0x7f36a0141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a598d700 1 -- 172.21.15.81:0/3079821538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36a00ccb40 msgr2=0x7f36a0140d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a598d700 1 --2- 172.21.15.81:0/3079821538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36a00ccb40 0x7f36a0140d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a598d700 1 -- 172.21.15.81:0/3079821538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36a0159f10 msgr2=0x7f36a0141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a598d700 1 --2- 172.21.15.81:0/3079821538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36a0159f10 0x7f36a0141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a598d700 1 -- 172.21.15.81:0/3079821538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900094f0 con 0x7f36a0159b40 2023-10-07T08:43:12.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.416+0000 7f36a598d700 1 --2- 172.21.15.81:0/3079821538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36a0159b40 0x7f36a0158d60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f36a006fe10 tx=0x7f3690017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:12.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.417+0000 7f36967fc700 1 -- 172.21.15.81:0/3079821538 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690011dc0 con 0x7f36a0159b40 2023-10-07T08:43:12.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.417+0000 7f36967fc700 1 -- 172.21.15.81:0/3079821538 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3690024440 con 0x7f36a0159b40 2023-10-07T08:43:12.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.417+0000 7f36967fc700 1 -- 172.21.15.81:0/3079821538 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690024800 con 0x7f36a0159b40 2023-10-07T08:43:12.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.417+0000 7f36a7190700 1 -- 172.21.15.81:0/3079821538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a0157300 con 0x7f36a0159b40 2023-10-07T08:43:12.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.417+0000 7f36a7190700 1 -- 172.21.15.81:0/3079821538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a01578c0 con 0x7f36a0159b40 2023-10-07T08:43:12.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.418+0000 7f36a7190700 1 -- 172.21.15.81:0/3079821538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a0157da0 con 0x7f36a0159b40 2023-10-07T08:43:12.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.418+0000 7f36967fc700 1 -- 172.21.15.81:0/3079821538 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f369001a420 con 0x7f36a0159b40 2023-10-07T08:43:12.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.418+0000 7f36967fc700 1 --2- 172.21.15.81:0/3079821538 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3684066f30 0x7f36840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.419+0000 7f36a618e700 1 --2- 172.21.15.81:0/3079821538 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3684066f30 0x7f36840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.419+0000 7f36967fc700 1 -- 172.21.15.81:0/3079821538 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f36900863a0 con 0x7f36a0159b40 2023-10-07T08:43:12.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.419+0000 7f36a618e700 1 --2- 172.21.15.81:0/3079821538 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3684066f30 0x7f36840693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f369c00acb0 tx=0x7f369c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:12.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.423+0000 7f36967fc700 1 -- 172.21.15.81:0/3079821538 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3690053610 con 0x7f36a0159b40 2023-10-07T08:43:12.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.644+0000 7f36a7190700 1 -- 172.21.15.81:0/3079821538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36a00cb890 con 0x7f36a0159b40 2023-10-07T08:43:12.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.644+0000 7f36967fc700 1 -- 172.21.15.81:0/3079821538 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f3690056c30 con 0x7f36a0159b40 2023-10-07T08:43:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:12.646 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4266800811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4266800811},{"type":"v1","addr":"172.21.15.81:6836","nonce":4266800811}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1054766807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1054766807},{"type":"v1","addr":"172.21.15.89:6833","nonce":1054766807}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1734914753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1734914753},{"type":"v1","addr":"172.21.15.81:6837","nonce":1734914753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:42:56.633557+0000","modified":"2023-10-07T08:43:00.266271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/860615068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":860615068},{"type":"v1","addr":"172.21.15.89:6835","nonce":860615068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-07T08:43:12.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.647+0000 7f36a7190700 1 -- 172.21.15.81:0/3079821538 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3684066f30 msgr2=0x7f36840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.647+0000 7f36a7190700 1 --2- 172.21.15.81:0/3079821538 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3684066f30 0x7f36840693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f369c00acb0 tx=0x7f369c008040 comp rx=0 tx=0).stop 2023-10-07T08:43:12.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.647+0000 7f36a7190700 1 -- 172.21.15.81:0/3079821538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36a0159b40 msgr2=0x7f36a0158d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.647+0000 7f36a7190700 1 --2- 172.21.15.81:0/3079821538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36a0159b40 0x7f36a0158d60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f36a006fe10 tx=0x7f3690017000 comp rx=0 tx=0).stop 2023-10-07T08:43:12.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.647+0000 7f36a7190700 1 -- 172.21.15.81:0/3079821538 shutdown_connections 2023-10-07T08:43:12.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.647+0000 7f36a7190700 1 --2- 172.21.15.81:0/3079821538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36a0159f10 0x7f36a0141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.647+0000 7f36a7190700 1 --2- 172.21.15.81:0/3079821538 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3684066f30 0x7f36840693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.647+0000 7f36a7190700 1 --2- 172.21.15.81:0/3079821538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36a00ccb40 0x7f36a0140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.647+0000 7f36a7190700 1 --2- 172.21.15.81:0/3079821538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36a0159b40 0x7f36a0158d60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.647+0000 7f36a7190700 1 -- 172.21.15.81:0/3079821538 >> 172.21.15.81:0/3079821538 conn(0x7f36a00cd660 msgr2=0x7f36a006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:12.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.647+0000 7f36a7190700 1 -- 172.21.15.81:0/3079821538 shutdown_connections 2023-10-07T08:43:12.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.647+0000 7f36a7190700 1 -- 172.21.15.81:0/3079821538 wait complete. 2023-10-07T08:43:12.650 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2023-10-07T08:43:12.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:12.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.773+0000 7fcddebfc700 1 Processor -- start 2023-10-07T08:43:12.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.773+0000 7fcddebfc700 1 -- start start 2023-10-07T08:43:12.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.773+0000 7fcddebfc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcdd8157ca0 0x7fcdd80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.773+0000 7fcddebfc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd80d07c0 con 0x7fcdd81578d0 2023-10-07T08:43:12.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.773+0000 7fcddebfc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd80cfbb0 con 0x7fcdd806d120 2023-10-07T08:43:12.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.773+0000 7fcddebfc700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd80cfe90 con 0x7fcdd8157ca0 2023-10-07T08:43:12.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.773+0000 7fcdcffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcdd8157ca0 0x7fcdd80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.773+0000 7fcddc998700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcdd81578d0 0x7fcdd815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39554/0 (socket says 172.21.15.81:39554) 2023-10-07T08:43:12.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.773+0000 7fcddc998700 1 -- 172.21.15.81:0/854518218 learned_addr learned my addr 172.21.15.81:0/854518218 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.774+0000 7fcdcffff700 1 -- 172.21.15.81:0/854518218 >> v1:172.21.15.89:6789/0 conn(0x7fcdd806d120 legacy=0x7fcdd806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.774+0000 7fcdcffff700 1 -- 172.21.15.81:0/854518218 >> v1:172.21.15.81:6789/0 conn(0x7fcdd81578d0 legacy=0x7fcdd815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.774+0000 7fcdcffff700 1 -- 172.21.15.81:0/854518218 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd80d0170 con 0x7fcdd8157ca0 2023-10-07T08:43:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.774+0000 7fcdcffff700 1 --2- 172.21.15.81:0/854518218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd8157ca0 0x7fcdd80cf4f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80098e0 tx=0x7fcdc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271a10bda41b3fb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.774+0000 7fcdcf7fe700 1 -- 172.21.15.81:0/854518218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8009e80 con 0x7fcdd8157ca0 2023-10-07T08:43:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.774+0000 7fcdcf7fe700 1 -- 172.21.15.81:0/854518218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc800b820 con 0x7fcdd8157ca0 2023-10-07T08:43:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.774+0000 7fcdcf7fe700 1 -- 172.21.15.81:0/854518218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800bba0 con 0x7fcdd8157ca0 2023-10-07T08:43:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.774+0000 7fcddebfc700 1 -- 172.21.15.81:0/854518218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd8157ca0 msgr2=0x7fcdd80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.774+0000 7fcddebfc700 1 --2- 172.21.15.81:0/854518218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd8157ca0 0x7fcdd80cf4f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80098e0 tx=0x7fcdc80091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.774+0000 7fcddebfc700 1 -- 172.21.15.81:0/854518218 shutdown_connections 2023-10-07T08:43:12.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.774+0000 7fcddebfc700 1 --2- 172.21.15.81:0/854518218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd8157ca0 0x7fcdd80cf4f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.774+0000 7fcddebfc700 1 -- 172.21.15.81:0/854518218 >> 172.21.15.81:0/854518218 conn(0x7fcdd806bb90 msgr2=0x7fcdd806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:12.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.774+0000 7fcddebfc700 1 -- 172.21.15.81:0/854518218 shutdown_connections 2023-10-07T08:43:12.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.774+0000 7fcddebfc700 1 -- 172.21.15.81:0/854518218 wait complete. 2023-10-07T08:43:12.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.775+0000 7fcddebfc700 1 Processor -- start 2023-10-07T08:43:12.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.776+0000 7fcddebfc700 1 -- start start 2023-10-07T08:43:12.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.776+0000 7fcddebfc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdd806d120 0x7fcdd80b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.776+0000 7fcddebfc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdd81578d0 0x7fcdd80b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.776+0000 7fcddebfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd8157ca0 0x7fcdd80ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.776+0000 7fcddebfc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80ab340 con 0x7fcdd8157ca0 2023-10-07T08:43:12.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.776+0000 7fcddebfc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80ab5b0 con 0x7fcdd806d120 2023-10-07T08:43:12.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.776+0000 7fcddebfc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80ab890 con 0x7fcdd81578d0 2023-10-07T08:43:12.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.776+0000 7fcddd199700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd8157ca0 0x7fcdd80ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.777+0000 7fcddd199700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd8157ca0 0x7fcdd80ac670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39068/0 (socket says 172.21.15.81:39068) 2023-10-07T08:43:12.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.777+0000 7fcddd199700 1 -- 172.21.15.81:0/1835972113 learned_addr learned my addr 172.21.15.81:0/1835972113 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:12.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.777+0000 7fcddc998700 1 --2- 172.21.15.81:0/1835972113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdd806d120 0x7fcdd80b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.777+0000 7fcdcffff700 1 --2- 172.21.15.81:0/1835972113 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdd81578d0 0x7fcdd80b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.777+0000 7fcddd199700 1 -- 172.21.15.81:0/1835972113 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdd81578d0 msgr2=0x7fcdd80b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.777+0000 7fcddd199700 1 --2- 172.21.15.81:0/1835972113 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdd81578d0 0x7fcdd80b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.777+0000 7fcddd199700 1 -- 172.21.15.81:0/1835972113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdd806d120 msgr2=0x7fcdd80b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.777+0000 7fcddd199700 1 --2- 172.21.15.81:0/1835972113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdd806d120 0x7fcdd80b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.777+0000 7fcddd199700 1 -- 172.21.15.81:0/1835972113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc8009420 con 0x7fcdd8157ca0 2023-10-07T08:43:12.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.777+0000 7fcddc998700 1 --2- 172.21.15.81:0/1835972113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdd806d120 0x7fcdd80b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:12.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.777+0000 7fcddd199700 1 --2- 172.21.15.81:0/1835972113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd8157ca0 0x7fcdd80ac670 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000bbb0 tx=0x7fcdd0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:12.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.777+0000 7fcdccff9700 1 -- 172.21.15.81:0/1835972113 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00092e0 con 0x7fcdd8157ca0 2023-10-07T08:43:12.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.777+0000 7fcdccff9700 1 -- 172.21.15.81:0/1835972113 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd000c7a0 con 0x7fcdd8157ca0 2023-10-07T08:43:12.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.777+0000 7fcdccff9700 1 -- 172.21.15.81:0/1835972113 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd000cb40 con 0x7fcdd8157ca0 2023-10-07T08:43:12.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.777+0000 7fcddebfc700 1 -- 172.21.15.81:0/1835972113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd80abb70 con 0x7fcdd8157ca0 2023-10-07T08:43:12.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.777+0000 7fcddebfc700 1 -- 172.21.15.81:0/1835972113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd80b6590 con 0x7fcdd8157ca0 2023-10-07T08:43:12.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.778+0000 7fcddebfc700 1 -- 172.21.15.81:0/1835972113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd8067ac0 con 0x7fcdd8157ca0 2023-10-07T08:43:12.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.778+0000 7fcdccff9700 1 -- 172.21.15.81:0/1835972113 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcdd0012070 con 0x7fcdd8157ca0 2023-10-07T08:43:12.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.779+0000 7fcdccff9700 1 --2- 172.21.15.81:0/1835972113 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcdc4066f30 0x7fcdc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:12.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.779+0000 7fcdccff9700 1 -- 172.21.15.81:0/1835972113 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcdd0084270 con 0x7fcdd8157ca0 2023-10-07T08:43:12.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.779+0000 7fcddc998700 1 --2- 172.21.15.81:0/1835972113 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcdc4066f30 0x7fcdc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:12.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.779+0000 7fcddc998700 1 --2- 172.21.15.81:0/1835972113 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcdc4066f30 0x7fcdc40693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40018c0 tx=0x7fcdd4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:12.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.784+0000 7fcdccff9700 1 -- 172.21.15.81:0/1835972113 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcdd00514e0 con 0x7fcdd8157ca0 2023-10-07T08:43:12.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.965+0000 7fcddebfc700 1 -- 172.21.15.81:0/1835972113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdd80d0450 con 0x7fcdd8157ca0 2023-10-07T08:43:12.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.966+0000 7fcdccff9700 1 -- 172.21.15.81:0/1835972113 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fcdd0054b00 con 0x7fcdd8157ca0 2023-10-07T08:43:12.967 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:12.967 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:58.248338+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:42:54.397263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:42:55.595133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:12.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.968+0000 7fcddebfc700 1 -- 172.21.15.81:0/1835972113 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcdc4066f30 msgr2=0x7fcdc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.968+0000 7fcddebfc700 1 --2- 172.21.15.81:0/1835972113 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcdc4066f30 0x7fcdc40693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40018c0 tx=0x7fcdd4009040 comp rx=0 tx=0).stop 2023-10-07T08:43:12.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.968+0000 7fcddebfc700 1 -- 172.21.15.81:0/1835972113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd8157ca0 msgr2=0x7fcdd80ac670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:12.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.968+0000 7fcddebfc700 1 --2- 172.21.15.81:0/1835972113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd8157ca0 0x7fcdd80ac670 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000bbb0 tx=0x7fcdd0009840 comp rx=0 tx=0).stop 2023-10-07T08:43:12.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.968+0000 7fcddebfc700 1 -- 172.21.15.81:0/1835972113 shutdown_connections 2023-10-07T08:43:12.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.968+0000 7fcddebfc700 1 --2- 172.21.15.81:0/1835972113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdd8157ca0 0x7fcdd80ac670 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.968+0000 7fcddebfc700 1 --2- 172.21.15.81:0/1835972113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcdd806d120 0x7fcdd80b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.968+0000 7fcddebfc700 1 --2- 172.21.15.81:0/1835972113 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcdc4066f30 0x7fcdc40693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.968+0000 7fcddebfc700 1 --2- 172.21.15.81:0/1835972113 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcdd81578d0 0x7fcdd80b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:12.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.968+0000 7fcddebfc700 1 -- 172.21.15.81:0/1835972113 >> 172.21.15.81:0/1835972113 conn(0x7fcdd806bb90 msgr2=0x7fcdd8069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:12.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.968+0000 7fcddebfc700 1 -- 172.21.15.81:0/1835972113 shutdown_connections 2023-10-07T08:43:12.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:12.968+0000 7fcddebfc700 1 -- 172.21.15.81:0/1835972113 wait complete. 2023-10-07T08:43:12.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:42:54.397263+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:42:55.595133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:43:12.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:43:13.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.098+0000 7fde18168700 1 Processor -- start 2023-10-07T08:43:13.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.098+0000 7fde18168700 1 -- start start 2023-10-07T08:43:13.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde18168700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fde10157ca0 0x7fde100cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde18168700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1006d120 0x7fde1006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde18168700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde100d07c0 con 0x7fde101578d0 2023-10-07T08:43:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde18168700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde1006daa0 con 0x7fde10157ca0 2023-10-07T08:43:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde18168700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde100cfbb0 con 0x7fde1006d120 2023-10-07T08:43:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde15703700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fde10157ca0 0x7fde100cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde15703700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fde10157ca0 0x7fde100cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39072/0 (socket says 172.21.15.81:39072) 2023-10-07T08:43:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde15703700 1 -- 172.21.15.81:0/2295672129 learned_addr learned my addr 172.21.15.81:0/2295672129 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde16705700 1 --2- 172.21.15.81:0/2295672129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1006d120 0x7fde1006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde15703700 1 -- 172.21.15.81:0/2295672129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1006d120 msgr2=0x7fde1006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde15703700 1 --2- 172.21.15.81:0/2295672129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1006d120 0x7fde1006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde15703700 1 -- 172.21.15.81:0/2295672129 >> v1:172.21.15.89:6789/0 conn(0x7fde101578d0 legacy=0x7fde1015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde15703700 1 -- 172.21.15.81:0/2295672129 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde100cfe90 con 0x7fde10157ca0 2023-10-07T08:43:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde16705700 1 --2- 172.21.15.81:0/2295672129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1006d120 0x7fde1006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde15703700 1 --2- 172.21.15.81:0/2295672129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde10157ca0 0x7fde100cf4f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fde040099b0 tx=0x7fde04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70855906c351a54 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde14f02700 1 -- 172.21.15.81:0/2295672129 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0400b860 con 0x7fde10157ca0 2023-10-07T08:43:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde14f02700 1 -- 172.21.15.81:0/2295672129 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0400b9c0 con 0x7fde10157ca0 2023-10-07T08:43:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.099+0000 7fde14f02700 1 -- 172.21.15.81:0/2295672129 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0400bd60 con 0x7fde10157ca0 2023-10-07T08:43:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.100+0000 7fde18168700 1 -- 172.21.15.81:0/2295672129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde10157ca0 msgr2=0x7fde100cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.100+0000 7fde18168700 1 --2- 172.21.15.81:0/2295672129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde10157ca0 0x7fde100cf4f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fde040099b0 tx=0x7fde04009250 comp rx=0 tx=0).stop 2023-10-07T08:43:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.100+0000 7fde18168700 1 -- 172.21.15.81:0/2295672129 shutdown_connections 2023-10-07T08:43:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.100+0000 7fde18168700 1 --2- 172.21.15.81:0/2295672129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde1006d120 0x7fde1006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.100+0000 7fde18168700 1 --2- 172.21.15.81:0/2295672129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde10157ca0 0x7fde100cf4f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.100+0000 7fde18168700 1 -- 172.21.15.81:0/2295672129 >> 172.21.15.81:0/2295672129 conn(0x7fde1006bb90 msgr2=0x7fde1006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.100+0000 7fde18168700 1 -- 172.21.15.81:0/2295672129 shutdown_connections 2023-10-07T08:43:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.100+0000 7fde18168700 1 -- 172.21.15.81:0/2295672129 wait complete. 2023-10-07T08:43:13.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.101+0000 7fde18168700 1 Processor -- start 2023-10-07T08:43:13.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.101+0000 7fde18168700 1 -- start start 2023-10-07T08:43:13.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde18168700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1006d120 0x7fde100b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde18168700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde101578d0 0x7fde10153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde18168700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde10157ca0 0x7fde100b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde18168700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde10154120 con 0x7fde1006d120 2023-10-07T08:43:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde18168700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde100b2950 con 0x7fde101578d0 2023-10-07T08:43:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde18168700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde100b2670 con 0x7fde10157ca0 2023-10-07T08:43:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde15f04700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1006d120 0x7fde100b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde15f04700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1006d120 0x7fde100b5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39088/0 (socket says 172.21.15.81:39088) 2023-10-07T08:43:13.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde15f04700 1 -- 172.21.15.81:0/3378295131 learned_addr learned my addr 172.21.15.81:0/3378295131 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:13.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde16705700 1 --2- 172.21.15.81:0/3378295131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde10157ca0 0x7fde100b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde15703700 1 --2- 172.21.15.81:0/3378295131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde101578d0 0x7fde10153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde15f04700 1 -- 172.21.15.81:0/3378295131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde10157ca0 msgr2=0x7fde100b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde15f04700 1 --2- 172.21.15.81:0/3378295131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde10157ca0 0x7fde100b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde15f04700 1 -- 172.21.15.81:0/3378295131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde101578d0 msgr2=0x7fde10153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde15f04700 1 --2- 172.21.15.81:0/3378295131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde101578d0 0x7fde10153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde15f04700 1 -- 172.21.15.81:0/3378295131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde040094f0 con 0x7fde1006d120 2023-10-07T08:43:13.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde15f04700 1 --2- 172.21.15.81:0/3378295131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1006d120 0x7fde100b5780 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fde0800c590 tx=0x7fde0800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde0dffb700 1 -- 172.21.15.81:0/3378295131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08011590 con 0x7fde1006d120 2023-10-07T08:43:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde0dffb700 1 -- 172.21.15.81:0/3378295131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde08011710 con 0x7fde1006d120 2023-10-07T08:43:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde18168700 1 -- 172.21.15.81:0/3378295131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde100b4ca0 con 0x7fde1006d120 2023-10-07T08:43:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.102+0000 7fde0dffb700 1 -- 172.21.15.81:0/3378295131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08011ad0 con 0x7fde1006d120 2023-10-07T08:43:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.103+0000 7fde18168700 1 -- 172.21.15.81:0/3378295131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde100b5260 con 0x7fde1006d120 2023-10-07T08:43:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.103+0000 7fde18168700 1 -- 172.21.15.81:0/3378295131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde100b5450 con 0x7fde1006d120 2023-10-07T08:43:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.104+0000 7fde0dffb700 1 -- 172.21.15.81:0/3378295131 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde0801b3b0 con 0x7fde1006d120 2023-10-07T08:43:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.104+0000 7fde0dffb700 1 --2- 172.21.15.81:0/3378295131 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fddfc066f30 0x7fddfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.104+0000 7fde0dffb700 1 -- 172.21.15.81:0/3378295131 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde080839c0 con 0x7fde1006d120 2023-10-07T08:43:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.104+0000 7fde15703700 1 --2- 172.21.15.81:0/3378295131 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fddfc066f30 0x7fddfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.104+0000 7fde15703700 1 --2- 172.21.15.81:0/3378295131 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fddfc066f30 0x7fddfc0693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fde040099b0 tx=0x7fde04017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:13.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.108+0000 7fde0dffb700 1 -- 172.21.15.81:0/3378295131 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde08050c30 con 0x7fde1006d120 2023-10-07T08:43:13.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.293+0000 7fde18168700 1 -- 172.21.15.81:0/3378295131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde100d0170 con 0x7fde1006d120 2023-10-07T08:43:13.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.294+0000 7fde0dffb700 1 -- 172.21.15.81:0/3378295131 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fde08017070 con 0x7fde1006d120 2023-10-07T08:43:13.294 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:43:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.296+0000 7fde18168700 1 -- 172.21.15.81:0/3378295131 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fddfc066f30 msgr2=0x7fddfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.296+0000 7fde18168700 1 --2- 172.21.15.81:0/3378295131 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fddfc066f30 0x7fddfc0693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fde040099b0 tx=0x7fde04017000 comp rx=0 tx=0).stop 2023-10-07T08:43:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.296+0000 7fde18168700 1 -- 172.21.15.81:0/3378295131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1006d120 msgr2=0x7fde100b5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.296+0000 7fde18168700 1 --2- 172.21.15.81:0/3378295131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1006d120 0x7fde100b5780 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fde0800c590 tx=0x7fde0800c8a0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.296+0000 7fde18168700 1 -- 172.21.15.81:0/3378295131 shutdown_connections 2023-10-07T08:43:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.296+0000 7fde18168700 1 --2- 172.21.15.81:0/3378295131 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fddfc066f30 0x7fddfc0693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.296+0000 7fde18168700 1 --2- 172.21.15.81:0/3378295131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde10157ca0 0x7fde100b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.296+0000 7fde18168700 1 --2- 172.21.15.81:0/3378295131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1006d120 0x7fde100b5780 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.296+0000 7fde18168700 1 --2- 172.21.15.81:0/3378295131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde101578d0 0x7fde10153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.296+0000 7fde18168700 1 -- 172.21.15.81:0/3378295131 >> 172.21.15.81:0/3378295131 conn(0x7fde1006bb90 msgr2=0x7fde10068aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.296+0000 7fde18168700 1 -- 172.21.15.81:0/3378295131 shutdown_connections 2023-10-07T08:43:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.296+0000 7fde18168700 1 -- 172.21.15.81:0/3378295131 wait complete. 2023-10-07T08:43:13.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:43:13.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.426+0000 7f9297fff700 1 Processor -- start 2023-10-07T08:43:13.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.426+0000 7f9297fff700 1 -- start start 2023-10-07T08:43:13.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.427+0000 7f9297fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f92980d0b80 0x7f92980cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.427+0000 7f9297fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92980cf2d0 con 0x7f92980d02b0 2023-10-07T08:43:13.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.427+0000 7f9297fff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929806dc00 con 0x7f929806d700 2023-10-07T08:43:13.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.427+0000 7f9297fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929815a690 con 0x7f92980d0b80 2023-10-07T08:43:13.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.427+0000 7f9296ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f92980d0b80 0x7f92980cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.427+0000 7f92967fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f92980d02b0 0x7f929806cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39558/0 (socket says 172.21.15.81:39558) 2023-10-07T08:43:13.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.427+0000 7f92967fc700 1 -- 172.21.15.81:0/1106023650 learned_addr learned my addr 172.21.15.81:0/1106023650 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:13.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.427+0000 7f9296ffd700 1 -- 172.21.15.81:0/1106023650 >> v1:172.21.15.89:6789/0 conn(0x7f929806d700 legacy=0x7f929815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:13.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.427+0000 7f9296ffd700 1 -- 172.21.15.81:0/1106023650 >> v1:172.21.15.81:6789/0 conn(0x7f92980d02b0 legacy=0x7f929806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.427+0000 7f9295ffb700 1 -- 172.21.15.81:0/1106023650 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565028152 0 0) 0x7f92980cf2d0 con 0x7f92980d02b0 2023-10-07T08:43:13.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.427+0000 7f9296ffd700 1 -- 172.21.15.81:0/1106023650 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92980cf570 con 0x7f92980d0b80 2023-10-07T08:43:13.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.427+0000 7f9296ffd700 1 --2- 172.21.15.81:0/1106023650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92980d0b80 0x7f92980cfd70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9288009e90 tx=0x7f9288009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210c569a5de27bb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:13.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.428+0000 7f9295ffb700 1 -- 172.21.15.81:0/1106023650 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928800e070 con 0x7f92980d0b80 2023-10-07T08:43:13.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.428+0000 7f9295ffb700 1 -- 172.21.15.81:0/1106023650 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928800bbb0 con 0x7f92980d0b80 2023-10-07T08:43:13.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.428+0000 7f9295ffb700 1 -- 172.21.15.81:0/1106023650 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288012430 con 0x7f92980d0b80 2023-10-07T08:43:13.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.428+0000 7f9297fff700 1 -- 172.21.15.81:0/1106023650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92980d0b80 msgr2=0x7f92980cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.428+0000 7f9297fff700 1 --2- 172.21.15.81:0/1106023650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92980d0b80 0x7f92980cfd70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9288009e90 tx=0x7f9288009780 comp rx=0 tx=0).stop 2023-10-07T08:43:13.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.428+0000 7f9297fff700 1 -- 172.21.15.81:0/1106023650 shutdown_connections 2023-10-07T08:43:13.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.428+0000 7f9297fff700 1 --2- 172.21.15.81:0/1106023650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92980d0b80 0x7f92980cfd70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.428+0000 7f9297fff700 1 -- 172.21.15.81:0/1106023650 >> 172.21.15.81:0/1106023650 conn(0x7f9298063230 msgr2=0x7f9298063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:13.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.428+0000 7f9297fff700 1 -- 172.21.15.81:0/1106023650 shutdown_connections 2023-10-07T08:43:13.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.428+0000 7f9297fff700 1 -- 172.21.15.81:0/1106023650 wait complete. 2023-10-07T08:43:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.429+0000 7f9297fff700 1 Processor -- start 2023-10-07T08:43:13.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.429+0000 7f9297fff700 1 -- start start 2023-10-07T08:43:13.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f9297fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929806d700 0x7f92981431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f9297fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92980d02b0 0x7f9298068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f9297fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92980d0b80 0x7f9298068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f9297fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929816b740 con 0x7f929806d700 2023-10-07T08:43:13.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f9297fff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980add60 con 0x7f92980d02b0 2023-10-07T08:43:13.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f9297fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92980ab100 con 0x7f92980d0b80 2023-10-07T08:43:13.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f9296ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929806d700 0x7f92981431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f9296ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929806d700 0x7f92981431e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39094/0 (socket says 172.21.15.81:39094) 2023-10-07T08:43:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f9296ffd700 1 -- 172.21.15.81:0/4085299928 learned_addr learned my addr 172.21.15.81:0/4085299928 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f92967fc700 1 --2- 172.21.15.81:0/4085299928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92980d02b0 0x7f9298068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f92977fe700 1 --2- 172.21.15.81:0/4085299928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92980d0b80 0x7f9298068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f9296ffd700 1 -- 172.21.15.81:0/4085299928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92980d0b80 msgr2=0x7f9298068e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f9296ffd700 1 --2- 172.21.15.81:0/4085299928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92980d0b80 0x7f9298068e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f9296ffd700 1 -- 172.21.15.81:0/4085299928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92980d02b0 msgr2=0x7f9298068920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f9296ffd700 1 --2- 172.21.15.81:0/4085299928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92980d02b0 0x7f9298068920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f9296ffd700 1 -- 172.21.15.81:0/4085299928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9288009a20 con 0x7f929806d700 2023-10-07T08:43:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.430+0000 7f92967fc700 1 --2- 172.21.15.81:0/4085299928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92980d02b0 0x7f9298068920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.431+0000 7f9296ffd700 1 --2- 172.21.15.81:0/4085299928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929806d700 0x7f92981431e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f92880099f0 tx=0x7f9288018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.431+0000 7f927effd700 1 -- 172.21.15.81:0/4085299928 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288001090 con 0x7f929806d700 2023-10-07T08:43:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.431+0000 7f927effd700 1 -- 172.21.15.81:0/4085299928 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9288012e60 con 0x7f929806d700 2023-10-07T08:43:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.431+0000 7f927effd700 1 -- 172.21.15.81:0/4085299928 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928801d890 con 0x7f929806d700 2023-10-07T08:43:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.431+0000 7f9297fff700 1 -- 172.21.15.81:0/4085299928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92980ab9a0 con 0x7f929806d700 2023-10-07T08:43:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.431+0000 7f9297fff700 1 -- 172.21.15.81:0/4085299928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92980ab350 con 0x7f929806d700 2023-10-07T08:43:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.432+0000 7f9297fff700 1 -- 172.21.15.81:0/4085299928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92980676e0 con 0x7f929806d700 2023-10-07T08:43:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.432+0000 7f927effd700 1 -- 172.21.15.81:0/4085299928 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9288024070 con 0x7f929806d700 2023-10-07T08:43:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.433+0000 7f927effd700 1 --2- 172.21.15.81:0/4085299928 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9284066f30 0x7f92840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.433+0000 7f92967fc700 1 --2- 172.21.15.81:0/4085299928 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9284066f30 0x7f92840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.433+0000 7f927effd700 1 -- 172.21.15.81:0/4085299928 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9288086d30 con 0x7f929806d700 2023-10-07T08:43:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.433+0000 7f92967fc700 1 --2- 172.21.15.81:0/4085299928 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9284066f30 0x7f92840693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92980b2860 tx=0x7f928c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:13.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.437+0000 7f927effd700 1 -- 172.21.15.81:0/4085299928 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9288053fa0 con 0x7f929806d700 2023-10-07T08:43:13.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.619+0000 7f9297fff700 1 -- 172.21.15.81:0/4085299928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9298071b10 con 0x7f929806d700 2023-10-07T08:43:13.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.620+0000 7f927effd700 1 -- 172.21.15.81:0/4085299928 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f92880575c0 con 0x7f929806d700 2023-10-07T08:43:13.620 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:43:13.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.622+0000 7f9297fff700 1 -- 172.21.15.81:0/4085299928 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9284066f30 msgr2=0x7f92840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.622+0000 7f9297fff700 1 --2- 172.21.15.81:0/4085299928 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9284066f30 0x7f92840693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92980b2860 tx=0x7f928c009040 comp rx=0 tx=0).stop 2023-10-07T08:43:13.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.622+0000 7f9297fff700 1 -- 172.21.15.81:0/4085299928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929806d700 msgr2=0x7f92981431e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.622+0000 7f9297fff700 1 --2- 172.21.15.81:0/4085299928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929806d700 0x7f92981431e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f92880099f0 tx=0x7f9288018000 comp rx=0 tx=0).stop 2023-10-07T08:43:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.622+0000 7f9297fff700 1 -- 172.21.15.81:0/4085299928 shutdown_connections 2023-10-07T08:43:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.622+0000 7f9297fff700 1 --2- 172.21.15.81:0/4085299928 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9284066f30 0x7f92840693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.622+0000 7f9297fff700 1 --2- 172.21.15.81:0/4085299928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92980d0b80 0x7f9298068e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.622+0000 7f9297fff700 1 --2- 172.21.15.81:0/4085299928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929806d700 0x7f92981431e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.622+0000 7f9297fff700 1 --2- 172.21.15.81:0/4085299928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92980d02b0 0x7f9298068920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.622+0000 7f9297fff700 1 -- 172.21.15.81:0/4085299928 >> 172.21.15.81:0/4085299928 conn(0x7f9298063230 msgr2=0x7f929815a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.622+0000 7f9297fff700 1 -- 172.21.15.81:0/4085299928 shutdown_connections 2023-10-07T08:43:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.622+0000 7f9297fff700 1 -- 172.21.15.81:0/4085299928 wait complete. 2023-10-07T08:43:13.635 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:43:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.751+0000 7efff230e700 1 Processor -- start 2023-10-07T08:43:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.751+0000 7efff230e700 1 -- start start 2023-10-07T08:43:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.752+0000 7efff230e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effec1578d0 0x7effec0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.752+0000 7efff230e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7effec06d120 0x7effec06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.752+0000 7efff230e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec06dac0 con 0x7effec157ca0 2023-10-07T08:43:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.752+0000 7efff230e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec0d07c0 con 0x7effec06d120 2023-10-07T08:43:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.752+0000 7efff230e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec0cfbb0 con 0x7effec1578d0 2023-10-07T08:43:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.752+0000 7effeb7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7effec157ca0 0x7effec15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39568/0 (socket says 172.21.15.81:39568) 2023-10-07T08:43:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.752+0000 7effeb7fe700 1 -- 172.21.15.81:0/4291136463 learned_addr learned my addr 172.21.15.81:0/4291136463 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.752+0000 7effebfff700 1 --2- 172.21.15.81:0/4291136463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effec1578d0 0x7effec0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.752+0000 7effeaffd700 1 -- 172.21.15.81:0/4291136463 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296644620 0 0) 0x7effe0001110 con 0x7effec157ca0 2023-10-07T08:43:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.752+0000 7efff08ab700 1 --2- 172.21.15.81:0/4291136463 >> v2:172.21.15.89:3300/0 conn(0x7effec06d120 0x7effec06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 -- 172.21.15.81:0/4291136463 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effd4003570 con 0x7effec157ca0 2023-10-07T08:43:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 -- 172.21.15.81:0/4291136463 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3835420171 0 0) 0x7effd4003570 con 0x7effec157ca0 2023-10-07T08:43:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 -- 172.21.15.81:0/4291136463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effec1578d0 msgr2=0x7effec0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 --2- 172.21.15.81:0/4291136463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effec1578d0 0x7effec0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 -- 172.21.15.81:0/4291136463 >> v2:172.21.15.89:3300/0 conn(0x7effec06d120 msgr2=0x7effec06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 --2- 172.21.15.81:0/4291136463 >> v2:172.21.15.89:3300/0 conn(0x7effec06d120 0x7effec06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 -- 172.21.15.81:0/4291136463 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec0cfe90 con 0x7effec157ca0 2023-10-07T08:43:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 -- 172.21.15.81:0/4291136463 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7effe0001600 con 0x7effec157ca0 2023-10-07T08:43:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 -- 172.21.15.81:0/4291136463 >> v1:172.21.15.81:6789/0 conn(0x7effec157ca0 legacy=0x7effec15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 --2- 172.21.15.81:0/4291136463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effd4003a60 0x7effd4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 --2- 172.21.15.81:0/4291136463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effd4004810 0x7effd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 --2- 172.21.15.81:0/4291136463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effec1578d0 0x7effd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 -- 172.21.15.81:0/4291136463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec0d07c0 con 0x7effd4003a60 2023-10-07T08:43:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 -- 172.21.15.81:0/4291136463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec0cfbb0 con 0x7effd4004810 2023-10-07T08:43:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 -- 172.21.15.81:0/4291136463 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd400ba60 con 0x7effec1578d0 2023-10-07T08:43:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effebfff700 1 --2- 172.21.15.81:0/4291136463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effd4003a60 0x7effd4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeb7fe700 1 --2- 172.21.15.81:0/4291136463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effd4004810 0x7effd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7efff08ab700 1 --2- 172.21.15.81:0/4291136463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effec1578d0 0x7effd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effebfff700 1 -- 172.21.15.81:0/4291136463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effec1578d0 msgr2=0x7effd40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effebfff700 1 --2- 172.21.15.81:0/4291136463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effec1578d0 0x7effd40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effebfff700 1 -- 172.21.15.81:0/4291136463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effd4004810 msgr2=0x7effd4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effebfff700 1 --2- 172.21.15.81:0/4291136463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effd4004810 0x7effd4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effebfff700 1 -- 172.21.15.81:0/4291136463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd4003570 con 0x7effd4003a60 2023-10-07T08:43:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effebfff700 1 --2- 172.21.15.81:0/4291136463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effd4003a60 0x7effd4003e70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7effdc009c30 tx=0x7effdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afdd0a6ef248515 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 -- 172.21.15.81:0/4291136463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc00e710 con 0x7effd4003a60 2023-10-07T08:43:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 -- 172.21.15.81:0/4291136463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc00e870 con 0x7effd4003a60 2023-10-07T08:43:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.753+0000 7effeaffd700 1 -- 172.21.15.81:0/4291136463 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc00ec30 con 0x7effd4003a60 2023-10-07T08:43:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.754+0000 7efff230e700 1 -- 172.21.15.81:0/4291136463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effd4003a60 msgr2=0x7effd4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.754+0000 7efff230e700 1 --2- 172.21.15.81:0/4291136463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effd4003a60 0x7effd4003e70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7effdc009c30 tx=0x7effdc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.754+0000 7efff08ab700 1 -- 172.21.15.81:0/4291136463 reap_dead start 2023-10-07T08:43:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.754+0000 7efff230e700 1 -- 172.21.15.81:0/4291136463 shutdown_connections 2023-10-07T08:43:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.754+0000 7efff230e700 1 -- 172.21.15.81:0/4291136463 >> 172.21.15.81:0/4291136463 conn(0x7effec06bb90 msgr2=0x7effec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.754+0000 7efff230e700 1 -- 172.21.15.81:0/4291136463 shutdown_connections 2023-10-07T08:43:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.754+0000 7efff230e700 1 -- 172.21.15.81:0/4291136463 wait complete. 2023-10-07T08:43:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.755+0000 7efff230e700 1 Processor -- start 2023-10-07T08:43:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.755+0000 7efff230e700 1 -- start start 2023-10-07T08:43:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7efff230e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effd4003a60 0x7effec16b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7efff230e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effec0b4b70 0x7effec15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7efff230e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effec15cd30 0x7effec0c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7efff230e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec15d1a0 con 0x7effec15cd30 2023-10-07T08:43:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7efff230e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec0b5bd0 con 0x7effec0b4b70 2023-10-07T08:43:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7efff230e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec16b8b0 con 0x7effd4003a60 2023-10-07T08:43:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7efff08ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effec15cd30 0x7effec0c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7efff08ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effec15cd30 0x7effec0c7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39102/0 (socket says 172.21.15.81:39102) 2023-10-07T08:43:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7efff08ab700 1 -- 172.21.15.81:0/2950407272 learned_addr learned my addr 172.21.15.81:0/2950407272 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7effebfff700 1 --2- 172.21.15.81:0/2950407272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effd4003a60 0x7effec16b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7effeb7fe700 1 --2- 172.21.15.81:0/2950407272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effec0b4b70 0x7effec15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7efff08ab700 1 -- 172.21.15.81:0/2950407272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effd4003a60 msgr2=0x7effec16b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7efff08ab700 1 --2- 172.21.15.81:0/2950407272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effd4003a60 0x7effec16b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7efff08ab700 1 -- 172.21.15.81:0/2950407272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effec0b4b70 msgr2=0x7effec15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7efff08ab700 1 --2- 172.21.15.81:0/2950407272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effec0b4b70 0x7effec15c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7efff08ab700 1 -- 172.21.15.81:0/2950407272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec0b5330 con 0x7effec15cd30 2023-10-07T08:43:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7effebfff700 1 --2- 172.21.15.81:0/2950407272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effd4003a60 0x7effec16b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.756+0000 7efff08ab700 1 --2- 172.21.15.81:0/2950407272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effec15cd30 0x7effec0c7d70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7effec068300 tx=0x7effe400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:13.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.757+0000 7effd3fff700 1 -- 172.21.15.81:0/2950407272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe400e040 con 0x7effec15cd30 2023-10-07T08:43:13.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.757+0000 7effd3fff700 1 -- 172.21.15.81:0/2950407272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe400f040 con 0x7effec15cd30 2023-10-07T08:43:13.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.757+0000 7efff230e700 1 -- 172.21.15.81:0/2950407272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec0b5610 con 0x7effec15cd30 2023-10-07T08:43:13.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.757+0000 7effd3fff700 1 -- 172.21.15.81:0/2950407272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe400fe20 con 0x7effec15cd30 2023-10-07T08:43:13.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.757+0000 7efff230e700 1 -- 172.21.15.81:0/2950407272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec0b4fe0 con 0x7effec15cd30 2023-10-07T08:43:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.758+0000 7efff230e700 1 -- 172.21.15.81:0/2950407272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec16b680 con 0x7effec15cd30 2023-10-07T08:43:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.758+0000 7effd3fff700 1 -- 172.21.15.81:0/2950407272 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7effe4015640 con 0x7effec15cd30 2023-10-07T08:43:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.758+0000 7effd3fff700 1 --2- 172.21.15.81:0/2950407272 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7effd8066f30 0x7effd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.758+0000 7effebfff700 1 --2- 172.21.15.81:0/2950407272 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7effd8066f30 0x7effd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.759+0000 7effd3fff700 1 -- 172.21.15.81:0/2950407272 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7effe4084cd0 con 0x7effec15cd30 2023-10-07T08:43:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.759+0000 7effebfff700 1 --2- 172.21.15.81:0/2950407272 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7effd8066f30 0x7effd80693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7effdc0091e0 tx=0x7effdc01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.763+0000 7effd3fff700 1 -- 172.21.15.81:0/2950407272 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7effec16b680 con 0x7effec15cd30 2023-10-07T08:43:13.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.943+0000 7efff230e700 1 -- 172.21.15.81:0/2950407272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7effec16b680 con 0x7effec15cd30 2023-10-07T08:43:13.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.944+0000 7effd3fff700 1 -- 172.21.15.81:0/2950407272 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7effec16b680 con 0x7effec15cd30 2023-10-07T08:43:13.944 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:43:13.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.946+0000 7efff230e700 1 -- 172.21.15.81:0/2950407272 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7effd8066f30 msgr2=0x7effd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.946+0000 7efff230e700 1 --2- 172.21.15.81:0/2950407272 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7effd8066f30 0x7effd80693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7effdc0091e0 tx=0x7effdc01a000 comp rx=0 tx=0).stop 2023-10-07T08:43:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.946+0000 7efff230e700 1 -- 172.21.15.81:0/2950407272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effec15cd30 msgr2=0x7effec0c7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.946+0000 7efff230e700 1 --2- 172.21.15.81:0/2950407272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effec15cd30 0x7effec0c7d70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7effec068300 tx=0x7effe400b040 comp rx=0 tx=0).stop 2023-10-07T08:43:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.946+0000 7efff230e700 1 -- 172.21.15.81:0/2950407272 shutdown_connections 2023-10-07T08:43:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.946+0000 7efff230e700 1 --2- 172.21.15.81:0/2950407272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effec15cd30 0x7effec0c7d70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.946+0000 7efff230e700 1 --2- 172.21.15.81:0/2950407272 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7effd8066f30 0x7effd80693e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.946+0000 7efff230e700 1 --2- 172.21.15.81:0/2950407272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effd4003a60 0x7effec16b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.946+0000 7efff230e700 1 --2- 172.21.15.81:0/2950407272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effec0b4b70 0x7effec15c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.946+0000 7efff230e700 1 -- 172.21.15.81:0/2950407272 >> 172.21.15.81:0/2950407272 conn(0x7effec06bb90 msgr2=0x7effec068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.946+0000 7efff230e700 1 -- 172.21.15.81:0/2950407272 shutdown_connections 2023-10-07T08:43:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:13.946+0000 7efff230e700 1 -- 172.21.15.81:0/2950407272 wait complete. 2023-10-07T08:43:13.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:43:14.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.072+0000 7fe1b435e700 1 Processor -- start 2023-10-07T08:43:14.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.072+0000 7fe1b435e700 1 -- start start 2023-10-07T08:43:14.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.073+0000 7fe1b435e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ac1578d0 0x7fe1ac0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.073+0000 7fe1b435e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1ac157ca0 0x7fe1ac15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.073+0000 7fe1b435e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac0d07c0 con 0x7fe1ac06d120 2023-10-07T08:43:14.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.073+0000 7fe1b435e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac0cfbb0 con 0x7fe1ac157ca0 2023-10-07T08:43:14.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.073+0000 7fe1b435e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0cfe90 con 0x7fe1ac1578d0 2023-10-07T08:43:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.073+0000 7fe1b18f9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1ac157ca0 0x7fe1ac15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.073+0000 7fe1b18f9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1ac157ca0 0x7fe1ac15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39106/0 (socket says 172.21.15.81:39106) 2023-10-07T08:43:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.073+0000 7fe1b18f9700 1 -- 172.21.15.81:0/3723001208 learned_addr learned my addr 172.21.15.81:0/3723001208 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.073+0000 7fe1b20fa700 1 --2- 172.21.15.81:0/3723001208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ac1578d0 0x7fe1ac0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.073+0000 7fe1b18f9700 1 -- 172.21.15.81:0/3723001208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ac1578d0 msgr2=0x7fe1ac0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.073+0000 7fe1b18f9700 1 --2- 172.21.15.81:0/3723001208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ac1578d0 0x7fe1ac0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.073+0000 7fe1b18f9700 1 -- 172.21.15.81:0/3723001208 >> v1:172.21.15.89:6789/0 conn(0x7fe1ac06d120 legacy=0x7fe1ac15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.074+0000 7fe1b18f9700 1 -- 172.21.15.81:0/3723001208 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac0d0170 con 0x7fe1ac157ca0 2023-10-07T08:43:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.074+0000 7fe1b20fa700 1 --2- 172.21.15.81:0/3723001208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ac1578d0 0x7fe1ac0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.074+0000 7fe1b18f9700 1 --2- 172.21.15.81:0/3723001208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ac157ca0 0x7fe1ac15af00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0099b0 tx=0x7fe19c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50dd09777bbe3c96 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:14.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.074+0000 7fe1b10f8700 1 -- 172.21.15.81:0/3723001208 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c00b820 con 0x7fe1ac157ca0 2023-10-07T08:43:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.074+0000 7fe1b10f8700 1 -- 172.21.15.81:0/3723001208 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c00b980 con 0x7fe1ac157ca0 2023-10-07T08:43:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.074+0000 7fe1b10f8700 1 -- 172.21.15.81:0/3723001208 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c00bd20 con 0x7fe1ac157ca0 2023-10-07T08:43:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.074+0000 7fe1b435e700 1 -- 172.21.15.81:0/3723001208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ac157ca0 msgr2=0x7fe1ac15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.074+0000 7fe1b435e700 1 --2- 172.21.15.81:0/3723001208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ac157ca0 0x7fe1ac15af00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0099b0 tx=0x7fe19c009250 comp rx=0 tx=0).stop 2023-10-07T08:43:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.074+0000 7fe1b435e700 1 -- 172.21.15.81:0/3723001208 shutdown_connections 2023-10-07T08:43:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.074+0000 7fe1b435e700 1 --2- 172.21.15.81:0/3723001208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ac1578d0 0x7fe1ac0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.074+0000 7fe1b435e700 1 --2- 172.21.15.81:0/3723001208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ac157ca0 0x7fe1ac15af00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.074+0000 7fe1b435e700 1 -- 172.21.15.81:0/3723001208 >> 172.21.15.81:0/3723001208 conn(0x7fe1ac06bb90 msgr2=0x7fe1ac06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.074+0000 7fe1b435e700 1 -- 172.21.15.81:0/3723001208 shutdown_connections 2023-10-07T08:43:14.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.074+0000 7fe1b435e700 1 -- 172.21.15.81:0/3723001208 wait complete. 2023-10-07T08:43:14.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.076+0000 7fe1b435e700 1 Processor -- start 2023-10-07T08:43:14.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.076+0000 7fe1b435e700 1 -- start start 2023-10-07T08:43:14.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.076+0000 7fe1b435e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ac06d120 0x7fe1ac145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.076+0000 7fe1b435e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ac1578d0 0x7fe1ac0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.076+0000 7fe1b435e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ac157ca0 0x7fe1ac0c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.076+0000 7fe1b435e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0b3c30 con 0x7fe1ac1578d0 2023-10-07T08:43:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.076+0000 7fe1b435e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0c66b0 con 0x7fe1ac157ca0 2023-10-07T08:43:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.076+0000 7fe1b435e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0c6990 con 0x7fe1ac06d120 2023-10-07T08:43:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.076+0000 7fe1b18f9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ac1578d0 0x7fe1ac0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.076+0000 7fe1b18f9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ac1578d0 0x7fe1ac0b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39122/0 (socket says 172.21.15.81:39122) 2023-10-07T08:43:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.076+0000 7fe1b18f9700 1 -- 172.21.15.81:0/30280941 learned_addr learned my addr 172.21.15.81:0/30280941 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.077+0000 7fe1b20fa700 1 --2- 172.21.15.81:0/30280941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ac06d120 0x7fe1ac145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.077+0000 7fe1b28fb700 1 --2- 172.21.15.81:0/30280941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ac157ca0 0x7fe1ac0c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.077+0000 7fe1b18f9700 1 -- 172.21.15.81:0/30280941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ac06d120 msgr2=0x7fe1ac145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.077+0000 7fe1b18f9700 1 --2- 172.21.15.81:0/30280941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ac06d120 0x7fe1ac145780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.077+0000 7fe1b18f9700 1 -- 172.21.15.81:0/30280941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ac157ca0 msgr2=0x7fe1ac0c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.077+0000 7fe1b18f9700 1 --2- 172.21.15.81:0/30280941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ac157ca0 0x7fe1ac0c74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.077+0000 7fe1b18f9700 1 -- 172.21.15.81:0/30280941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c0094f0 con 0x7fe1ac1578d0 2023-10-07T08:43:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.077+0000 7fe1b18f9700 1 --2- 172.21.15.81:0/30280941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ac1578d0 0x7fe1ac0b5c30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0030c0 tx=0x7fe19c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.077+0000 7fe1a27fc700 1 -- 172.21.15.81:0/30280941 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c011ea0 con 0x7fe1ac1578d0 2023-10-07T08:43:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.077+0000 7fe1a27fc700 1 -- 172.21.15.81:0/30280941 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c020070 con 0x7fe1ac1578d0 2023-10-07T08:43:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.077+0000 7fe1b435e700 1 -- 172.21.15.81:0/30280941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac0c6c70 con 0x7fe1ac1578d0 2023-10-07T08:43:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.077+0000 7fe1a27fc700 1 -- 172.21.15.81:0/30280941 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c01b6a0 con 0x7fe1ac1578d0 2023-10-07T08:43:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.077+0000 7fe1b435e700 1 -- 172.21.15.81:0/30280941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac145cc0 con 0x7fe1ac1578d0 2023-10-07T08:43:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.078+0000 7fe1b435e700 1 -- 172.21.15.81:0/30280941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac067ac0 con 0x7fe1ac1578d0 2023-10-07T08:43:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.078+0000 7fe1a27fc700 1 -- 172.21.15.81:0/30280941 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe19c022030 con 0x7fe1ac1578d0 2023-10-07T08:43:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.079+0000 7fe1a27fc700 1 --2- 172.21.15.81:0/30280941 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe190066f30 0x7fe1900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.079+0000 7fe1a27fc700 1 -- 172.21.15.81:0/30280941 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe19c0864e0 con 0x7fe1ac1578d0 2023-10-07T08:43:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.079+0000 7fe1b20fa700 1 --2- 172.21.15.81:0/30280941 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe190066f30 0x7fe1900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.079+0000 7fe1b20fa700 1 --2- 172.21.15.81:0/30280941 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe190066f30 0x7fe1900693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac15d8c0 tx=0x7fe1a80075c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.083+0000 7fe1a27fc700 1 -- 172.21.15.81:0/30280941 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe19c053750 con 0x7fe1ac1578d0 2023-10-07T08:43:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.305+0000 7fe1b435e700 1 -- 172.21.15.81:0/30280941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1ac0b3d70 con 0x7fe1ac1578d0 2023-10-07T08:43:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.305+0000 7fe1a27fc700 1 -- 172.21.15.81:0/30280941 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fe19c056d70 con 0x7fe1ac1578d0 2023-10-07T08:43:14.306 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:14.306 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4266800811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4266800811},{"type":"v1","addr":"172.21.15.81:6836","nonce":4266800811}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1054766807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1054766807},{"type":"v1","addr":"172.21.15.89:6833","nonce":1054766807}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1734914753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1734914753},{"type":"v1","addr":"172.21.15.81:6837","nonce":1734914753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:42:56.633557+0000","modified":"2023-10-07T08:43:00.266271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/860615068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":860615068},{"type":"v1","addr":"172.21.15.89:6835","nonce":860615068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-07T08:43:14.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.307+0000 7fe1b435e700 1 -- 172.21.15.81:0/30280941 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe190066f30 msgr2=0x7fe1900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.307+0000 7fe1b435e700 1 --2- 172.21.15.81:0/30280941 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe190066f30 0x7fe1900693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac15d8c0 tx=0x7fe1a80075c0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.307+0000 7fe1b435e700 1 -- 172.21.15.81:0/30280941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ac1578d0 msgr2=0x7fe1ac0b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.307+0000 7fe1b435e700 1 --2- 172.21.15.81:0/30280941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ac1578d0 0x7fe1ac0b5c30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0030c0 tx=0x7fe19c016000 comp rx=0 tx=0).stop 2023-10-07T08:43:14.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.307+0000 7fe1b435e700 1 -- 172.21.15.81:0/30280941 shutdown_connections 2023-10-07T08:43:14.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.307+0000 7fe1b435e700 1 --2- 172.21.15.81:0/30280941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ac157ca0 0x7fe1ac0c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.307+0000 7fe1b435e700 1 --2- 172.21.15.81:0/30280941 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe190066f30 0x7fe1900693e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.307+0000 7fe1b435e700 1 --2- 172.21.15.81:0/30280941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ac06d120 0x7fe1ac145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.307+0000 7fe1b435e700 1 --2- 172.21.15.81:0/30280941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ac1578d0 0x7fe1ac0b5c30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.307+0000 7fe1b435e700 1 -- 172.21.15.81:0/30280941 >> 172.21.15.81:0/30280941 conn(0x7fe1ac06bb90 msgr2=0x7fe1ac06d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.307+0000 7fe1b435e700 1 -- 172.21.15.81:0/30280941 shutdown_connections 2023-10-07T08:43:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.307+0000 7fe1b435e700 1 -- 172.21.15.81:0/30280941 wait complete. 2023-10-07T08:43:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2023-10-07T08:43:14.319 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.434+0000 7f08ec7c2700 1 Processor -- start 2023-10-07T08:43:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.434+0000 7f08ec7c2700 1 -- start start 2023-10-07T08:43:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.435+0000 7f08ec7c2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08e406d830 0x7f08e40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.435+0000 7f08ec7c2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e40d07c0 con 0x7f08e41578d0 2023-10-07T08:43:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.435+0000 7f08ec7c2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e40cfbb0 con 0x7f08e4157ca0 2023-10-07T08:43:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.435+0000 7f08ec7c2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e40cfe90 con 0x7f08e406d830 2023-10-07T08:43:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.435+0000 7f08ead5f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08e406d830 0x7f08e40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.435+0000 7f08ea55e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f08e41578d0 0x7f08e415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39582/0 (socket says 172.21.15.81:39582) 2023-10-07T08:43:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.435+0000 7f08ea55e700 1 -- 172.21.15.81:0/398944557 learned_addr learned my addr 172.21.15.81:0/398944557 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.435+0000 7f08ead5f700 1 -- 172.21.15.81:0/398944557 >> v1:172.21.15.89:6789/0 conn(0x7f08e4157ca0 legacy=0x7f08e406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.435+0000 7f08ead5f700 1 -- 172.21.15.81:0/398944557 >> v1:172.21.15.81:6789/0 conn(0x7f08e41578d0 legacy=0x7f08e415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.435+0000 7f08e955c700 1 -- 172.21.15.81:0/398944557 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447630620 0 0) 0x7f08e40d07c0 con 0x7f08e41578d0 2023-10-07T08:43:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.435+0000 7f08ead5f700 1 -- 172.21.15.81:0/398944557 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e40d0170 con 0x7f08e406d830 2023-10-07T08:43:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.435+0000 7f08ead5f700 1 --2- 172.21.15.81:0/398944557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08e406d830 0x7f08e40cf4f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0098e0 tx=0x7f08dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b761480749fd71f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.435+0000 7f08e955c700 1 -- 172.21.15.81:0/398944557 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc009e80 con 0x7f08e406d830 2023-10-07T08:43:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.436+0000 7f08e955c700 1 -- 172.21.15.81:0/398944557 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08dc00b820 con 0x7f08e406d830 2023-10-07T08:43:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.436+0000 7f08e955c700 1 -- 172.21.15.81:0/398944557 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc00bba0 con 0x7f08e406d830 2023-10-07T08:43:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.436+0000 7f08ec7c2700 1 -- 172.21.15.81:0/398944557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08e406d830 msgr2=0x7f08e40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.436+0000 7f08ec7c2700 1 --2- 172.21.15.81:0/398944557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08e406d830 0x7f08e40cf4f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0098e0 tx=0x7f08dc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.436+0000 7f08ec7c2700 1 -- 172.21.15.81:0/398944557 shutdown_connections 2023-10-07T08:43:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.436+0000 7f08ec7c2700 1 --2- 172.21.15.81:0/398944557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08e406d830 0x7f08e40cf4f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.436+0000 7f08ec7c2700 1 -- 172.21.15.81:0/398944557 >> 172.21.15.81:0/398944557 conn(0x7f08e406bb90 msgr2=0x7f08e406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.436+0000 7f08ec7c2700 1 -- 172.21.15.81:0/398944557 shutdown_connections 2023-10-07T08:43:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.436+0000 7f08ec7c2700 1 -- 172.21.15.81:0/398944557 wait complete. 2023-10-07T08:43:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.437+0000 7f08ec7c2700 1 Processor -- start 2023-10-07T08:43:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.437+0000 7f08ec7c2700 1 -- start start 2023-10-07T08:43:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08ec7c2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08e406d830 0x7f08e4153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08ec7c2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08e41578d0 0x7f08e40b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08ec7c2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08e4157ca0 0x7f08e415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08ec7c2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e40b6890 con 0x7f08e41578d0 2023-10-07T08:43:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08ec7c2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e40b4320 con 0x7f08e406d830 2023-10-07T08:43:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08ec7c2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e4154400 con 0x7f08e4157ca0 2023-10-07T08:43:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08e9d5d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08e41578d0 0x7f08e40b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08e9d5d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08e41578d0 0x7f08e40b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39142/0 (socket says 172.21.15.81:39142) 2023-10-07T08:43:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08e9d5d700 1 -- 172.21.15.81:0/4287038498 learned_addr learned my addr 172.21.15.81:0/4287038498 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08ea55e700 1 --2- 172.21.15.81:0/4287038498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08e406d830 0x7f08e4153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08ead5f700 1 --2- 172.21.15.81:0/4287038498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08e4157ca0 0x7f08e415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08e9d5d700 1 -- 172.21.15.81:0/4287038498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08e4157ca0 msgr2=0x7f08e415c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08e9d5d700 1 --2- 172.21.15.81:0/4287038498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08e4157ca0 0x7f08e415c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08e9d5d700 1 -- 172.21.15.81:0/4287038498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08e406d830 msgr2=0x7f08e4153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08e9d5d700 1 --2- 172.21.15.81:0/4287038498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08e406d830 0x7f08e4153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08e9d5d700 1 -- 172.21.15.81:0/4287038498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc009420 con 0x7f08e41578d0 2023-10-07T08:43:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.438+0000 7f08e9d5d700 1 --2- 172.21.15.81:0/4287038498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08e41578d0 0x7f08e40b5b60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f08d400b5e0 tx=0x7f08d40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.439+0000 7f08da7fc700 1 -- 172.21.15.81:0/4287038498 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d400f510 con 0x7f08e41578d0 2023-10-07T08:43:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.439+0000 7f08da7fc700 1 -- 172.21.15.81:0/4287038498 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d400f6b0 con 0x7f08e41578d0 2023-10-07T08:43:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.439+0000 7f08ec7c2700 1 -- 172.21.15.81:0/4287038498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e40b65b0 con 0x7f08e41578d0 2023-10-07T08:43:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.439+0000 7f08da7fc700 1 -- 172.21.15.81:0/4287038498 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d400fa70 con 0x7f08e41578d0 2023-10-07T08:43:14.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.439+0000 7f08ec7c2700 1 -- 172.21.15.81:0/4287038498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e40b3fb0 con 0x7f08e41578d0 2023-10-07T08:43:14.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.440+0000 7f08ec7c2700 1 -- 172.21.15.81:0/4287038498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e40b4490 con 0x7f08e41578d0 2023-10-07T08:43:14.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.440+0000 7f08da7fc700 1 -- 172.21.15.81:0/4287038498 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08d401a400 con 0x7f08e41578d0 2023-10-07T08:43:14.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.440+0000 7f08da7fc700 1 --2- 172.21.15.81:0/4287038498 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f08c8066f30 0x7f08c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.441+0000 7f08ea55e700 1 --2- 172.21.15.81:0/4287038498 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f08c8066f30 0x7f08c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.441+0000 7f08da7fc700 1 -- 172.21.15.81:0/4287038498 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f08d4083f20 con 0x7f08e41578d0 2023-10-07T08:43:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.441+0000 7f08ea55e700 1 --2- 172.21.15.81:0/4287038498 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f08c8066f30 0x7f08c80693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f08e0002250 tx=0x7f08e0001a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.445+0000 7f08da7fc700 1 -- 172.21.15.81:0/4287038498 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08d4051190 con 0x7f08e41578d0 2023-10-07T08:43:14.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.627+0000 7f08ec7c2700 1 -- 172.21.15.81:0/4287038498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08e40d0450 con 0x7f08e41578d0 2023-10-07T08:43:14.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.628+0000 7f08da7fc700 1 -- 172.21.15.81:0/4287038498 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f08d40091f0 con 0x7f08e41578d0 2023-10-07T08:43:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:14.629 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:58.248338+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:42:54.397263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:42:55.595133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:14.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.630+0000 7f08ec7c2700 1 -- 172.21.15.81:0/4287038498 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f08c8066f30 msgr2=0x7f08c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.630+0000 7f08ec7c2700 1 --2- 172.21.15.81:0/4287038498 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f08c8066f30 0x7f08c80693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f08e0002250 tx=0x7f08e0001a20 comp rx=0 tx=0).stop 2023-10-07T08:43:14.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.630+0000 7f08ec7c2700 1 -- 172.21.15.81:0/4287038498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08e41578d0 msgr2=0x7f08e40b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.630+0000 7f08ec7c2700 1 --2- 172.21.15.81:0/4287038498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08e41578d0 0x7f08e40b5b60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f08d400b5e0 tx=0x7f08d40090f0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.630+0000 7f08ec7c2700 1 -- 172.21.15.81:0/4287038498 shutdown_connections 2023-10-07T08:43:14.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.630+0000 7f08ec7c2700 1 --2- 172.21.15.81:0/4287038498 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f08c8066f30 0x7f08c80693e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.630+0000 7f08ec7c2700 1 --2- 172.21.15.81:0/4287038498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08e4157ca0 0x7f08e415c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.630+0000 7f08ec7c2700 1 --2- 172.21.15.81:0/4287038498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08e406d830 0x7f08e4153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.630+0000 7f08ec7c2700 1 --2- 172.21.15.81:0/4287038498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08e41578d0 0x7f08e40b5b60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.630+0000 7f08ec7c2700 1 -- 172.21.15.81:0/4287038498 >> 172.21.15.81:0/4287038498 conn(0x7f08e406bb90 msgr2=0x7f08e406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:14.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.630+0000 7f08ec7c2700 1 -- 172.21.15.81:0/4287038498 shutdown_connections 2023-10-07T08:43:14.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.630+0000 7f08ec7c2700 1 -- 172.21.15.81:0/4287038498 wait complete. 2023-10-07T08:43:14.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:43:14.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.755+0000 7f8a123d6700 1 Processor -- start 2023-10-07T08:43:14.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.755+0000 7f8a123d6700 1 -- start start 2023-10-07T08:43:14.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.756+0000 7f8a123d6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a0c1578d0 0x7f8a0c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.756+0000 7f8a123d6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8a0c157ca0 0x7f8a0c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.756+0000 7f8a123d6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0c0d07c0 con 0x7f8a0c06d120 2023-10-07T08:43:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.756+0000 7f8a123d6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c0cfbb0 con 0x7f8a0c1578d0 2023-10-07T08:43:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.756+0000 7f8a123d6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c0cfe90 con 0x7f8a0c157ca0 2023-10-07T08:43:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.756+0000 7f8a0bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a0c1578d0 0x7f8a0c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.756+0000 7f8a0bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a0c1578d0 0x7f8a0c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39152/0 (socket says 172.21.15.81:39152) 2023-10-07T08:43:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.756+0000 7f8a0bfff700 1 -- 172.21.15.81:0/829520513 learned_addr learned my addr 172.21.15.81:0/829520513 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.756+0000 7f8a0b7fe700 1 --2- 172.21.15.81:0/829520513 >> v2:172.21.15.89:3300/0 conn(0x7f8a0c157ca0 0x7f8a0c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.756+0000 7f8a0bfff700 1 -- 172.21.15.81:0/829520513 >> v2:172.21.15.89:3300/0 conn(0x7f8a0c157ca0 msgr2=0x7f8a0c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.756+0000 7f8a0bfff700 1 --2- 172.21.15.81:0/829520513 >> v2:172.21.15.89:3300/0 conn(0x7f8a0c157ca0 0x7f8a0c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.756+0000 7f8a0bfff700 1 -- 172.21.15.81:0/829520513 >> v1:172.21.15.89:6789/0 conn(0x7f8a0c06d120 legacy=0x7f8a0c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.756+0000 7f8a0bfff700 1 -- 172.21.15.81:0/829520513 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c0d0170 con 0x7f8a0c1578d0 2023-10-07T08:43:14.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.756+0000 7f8a0bfff700 1 --2- 172.21.15.81:0/829520513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c1578d0 0x7f8a0c0cf4f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c068510 tx=0x7f89fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548ae3eb82ca0a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:14.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.756+0000 7f8a0affd700 1 -- 172.21.15.81:0/829520513 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc009e70 con 0x7f8a0c1578d0 2023-10-07T08:43:14.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.757+0000 7f8a0affd700 1 -- 172.21.15.81:0/829520513 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc00b860 con 0x7f8a0c1578d0 2023-10-07T08:43:14.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.757+0000 7f8a0affd700 1 -- 172.21.15.81:0/829520513 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc00bc00 con 0x7f8a0c1578d0 2023-10-07T08:43:14.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.757+0000 7f8a123d6700 1 -- 172.21.15.81:0/829520513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c1578d0 msgr2=0x7f8a0c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.757+0000 7f8a123d6700 1 --2- 172.21.15.81:0/829520513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c1578d0 0x7f8a0c0cf4f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c068510 tx=0x7f89fc009250 comp rx=0 tx=0).stop 2023-10-07T08:43:14.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.757+0000 7f8a123d6700 1 -- 172.21.15.81:0/829520513 shutdown_connections 2023-10-07T08:43:14.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.757+0000 7f8a123d6700 1 --2- 172.21.15.81:0/829520513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c1578d0 0x7f8a0c0cf4f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.757+0000 7f8a123d6700 1 --2- 172.21.15.81:0/829520513 >> v2:172.21.15.89:3300/0 conn(0x7f8a0c157ca0 0x7f8a0c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.757+0000 7f8a123d6700 1 -- 172.21.15.81:0/829520513 >> 172.21.15.81:0/829520513 conn(0x7f8a0c06bb90 msgr2=0x7f8a0c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:14.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.757+0000 7f8a123d6700 1 -- 172.21.15.81:0/829520513 shutdown_connections 2023-10-07T08:43:14.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.757+0000 7f8a123d6700 1 -- 172.21.15.81:0/829520513 wait complete. 2023-10-07T08:43:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.758+0000 7f8a123d6700 1 Processor -- start 2023-10-07T08:43:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.758+0000 7f8a123d6700 1 -- start start 2023-10-07T08:43:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.759+0000 7f8a123d6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a0c06d120 0x7f8a0c16b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.759+0000 7f8a123d6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c1578d0 0x7f8a0c154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.759+0000 7f8a123d6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a0c157ca0 0x7f8a0c0c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.759+0000 7f8a123d6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0c6b30 con 0x7f8a0c1578d0 2023-10-07T08:43:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.759+0000 7f8a123d6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0c6060 con 0x7f8a0c157ca0 2023-10-07T08:43:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.759+0000 7f8a123d6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0c81c0 con 0x7f8a0c06d120 2023-10-07T08:43:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.759+0000 7f8a0b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c1578d0 0x7f8a0c154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.759+0000 7f8a0b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c1578d0 0x7f8a0c154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39164/0 (socket says 172.21.15.81:39164) 2023-10-07T08:43:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.759+0000 7f8a0b7fe700 1 -- 172.21.15.81:0/4207183150 learned_addr learned my addr 172.21.15.81:0/4207183150 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.759+0000 7f8a0bfff700 1 --2- 172.21.15.81:0/4207183150 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a0c06d120 0x7f8a0c16b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.759+0000 7f8a10973700 1 --2- 172.21.15.81:0/4207183150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a0c157ca0 0x7f8a0c0c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.759+0000 7f8a0b7fe700 1 -- 172.21.15.81:0/4207183150 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a0c06d120 msgr2=0x7f8a0c16b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.759+0000 7f8a0b7fe700 1 --2- 172.21.15.81:0/4207183150 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a0c06d120 0x7f8a0c16b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.759+0000 7f8a0b7fe700 1 -- 172.21.15.81:0/4207183150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a0c157ca0 msgr2=0x7f8a0c0c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.759+0000 7f8a0b7fe700 1 --2- 172.21.15.81:0/4207183150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a0c157ca0 0x7f8a0c0c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.759+0000 7f8a0b7fe700 1 -- 172.21.15.81:0/4207183150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc0094f0 con 0x7f8a0c1578d0 2023-10-07T08:43:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.760+0000 7f8a0b7fe700 1 --2- 172.21.15.81:0/4207183150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c1578d0 0x7f8a0c154e40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000e900 tx=0x7f8a000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.760+0000 7f89f3fff700 1 -- 172.21.15.81:0/4207183150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a00013680 con 0x7f8a0c1578d0 2023-10-07T08:43:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.760+0000 7f89f3fff700 1 -- 172.21.15.81:0/4207183150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a000137e0 con 0x7f8a0c1578d0 2023-10-07T08:43:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.760+0000 7f8a123d6700 1 -- 172.21.15.81:0/4207183150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c0c6290 con 0x7f8a0c1578d0 2023-10-07T08:43:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.760+0000 7f89f3fff700 1 -- 172.21.15.81:0/4207183150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a00013ba0 con 0x7f8a0c1578d0 2023-10-07T08:43:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.760+0000 7f8a123d6700 1 -- 172.21.15.81:0/4207183150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c0c6850 con 0x7f8a0c1578d0 2023-10-07T08:43:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.761+0000 7f8a123d6700 1 -- 172.21.15.81:0/4207183150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0c067ac0 con 0x7f8a0c1578d0 2023-10-07T08:43:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.761+0000 7f89f3fff700 1 -- 172.21.15.81:0/4207183150 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a000123d0 con 0x7f8a0c1578d0 2023-10-07T08:43:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.761+0000 7f89f3fff700 1 --2- 172.21.15.81:0/4207183150 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89f8066f30 0x7f89f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.762+0000 7f89f3fff700 1 -- 172.21.15.81:0/4207183150 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a000845e0 con 0x7f8a0c1578d0 2023-10-07T08:43:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.762+0000 7f8a0bfff700 1 --2- 172.21.15.81:0/4207183150 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89f8066f30 0x7f89f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.762+0000 7f8a0bfff700 1 --2- 172.21.15.81:0/4207183150 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89f8066f30 0x7f89f80693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c068510 tx=0x7f89fc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.766+0000 7f89f3fff700 1 -- 172.21.15.81:0/4207183150 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a00051850 con 0x7f8a0c1578d0 2023-10-07T08:43:14.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.990+0000 7f8a123d6700 1 -- 172.21.15.81:0/4207183150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a0c0c8300 con 0x7f8a0c1578d0 2023-10-07T08:43:14.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.990+0000 7f89f3fff700 1 -- 172.21.15.81:0/4207183150 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f8a00054e70 con 0x7f8a0c1578d0 2023-10-07T08:43:14.991 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:14.991 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4266800811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4266800811},{"type":"v1","addr":"172.21.15.81:6836","nonce":4266800811}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1054766807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1054766807},{"type":"v1","addr":"172.21.15.89:6833","nonce":1054766807}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1734914753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1734914753},{"type":"v1","addr":"172.21.15.81:6837","nonce":1734914753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:42:56.633557+0000","modified":"2023-10-07T08:43:00.266271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/860615068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":860615068},{"type":"v1","addr":"172.21.15.89:6835","nonce":860615068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-07T08:43:14.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.992+0000 7f8a123d6700 1 -- 172.21.15.81:0/4207183150 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89f8066f30 msgr2=0x7f89f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.992+0000 7f8a123d6700 1 --2- 172.21.15.81:0/4207183150 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89f8066f30 0x7f89f80693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c068510 tx=0x7f89fc017000 comp rx=0 tx=0).stop 2023-10-07T08:43:14.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.992+0000 7f8a123d6700 1 -- 172.21.15.81:0/4207183150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c1578d0 msgr2=0x7f8a0c154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:14.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.992+0000 7f8a123d6700 1 --2- 172.21.15.81:0/4207183150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c1578d0 0x7f8a0c154e40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000e900 tx=0x7f8a000091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.992+0000 7f8a123d6700 1 -- 172.21.15.81:0/4207183150 shutdown_connections 2023-10-07T08:43:14.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.992+0000 7f8a123d6700 1 --2- 172.21.15.81:0/4207183150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a0c157ca0 0x7f8a0c0c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.992+0000 7f8a123d6700 1 --2- 172.21.15.81:0/4207183150 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89f8066f30 0x7f89f80693e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.992+0000 7f8a123d6700 1 --2- 172.21.15.81:0/4207183150 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a0c06d120 0x7f8a0c16b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.992+0000 7f8a123d6700 1 --2- 172.21.15.81:0/4207183150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c1578d0 0x7f8a0c154e40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:14.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.992+0000 7f8a123d6700 1 -- 172.21.15.81:0/4207183150 >> 172.21.15.81:0/4207183150 conn(0x7f8a0c06bb90 msgr2=0x7f8a0c069960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:14.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.992+0000 7f8a123d6700 1 -- 172.21.15.81:0/4207183150 shutdown_connections 2023-10-07T08:43:14.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:14.992+0000 7f8a123d6700 1 -- 172.21.15.81:0/4207183150 wait complete. 2023-10-07T08:43:14.994 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2023-10-07T08:43:15.407 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T08:42:56.633557+0000', 'modified': '2023-10-07T08:43:00.266271+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6835/860615068', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 860615068}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 860615068}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T08:43:15.407 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T08:43:15.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-07T08:43:15.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.523+0000 7f2327469700 1 Processor -- start 2023-10-07T08:43:15.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.523+0000 7f2327469700 1 -- start start 2023-10-07T08:43:15.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.524+0000 7f2327469700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2320159f10 0x7f2320068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.524+0000 7f2327469700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2320068cc0 0x7f23200cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.524+0000 7f2327469700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23200cee10 con 0x7f2320159b40 2023-10-07T08:43:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.524+0000 7f2327469700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2320069140 con 0x7f2320159f10 2023-10-07T08:43:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.524+0000 7f2327469700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23200cd040 con 0x7f2320068cc0 2023-10-07T08:43:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.524+0000 7f2325c66700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2320159f10 0x7f2320068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.524+0000 7f2326c68700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2320068cc0 0x7f23200cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.524+0000 7f2325c66700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2320159f10 0x7f2320068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:56256/0 (socket says 172.21.15.81:56256) 2023-10-07T08:43:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.524+0000 7f2325c66700 1 -- 172.21.15.81:0/2982391300 learned_addr learned my addr 172.21.15.81:0/2982391300 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.524+0000 7f2326467700 1 --1- 172.21.15.81:0/2982391300 >> v1:172.21.15.89:6789/0 conn(0x7f2320159b40 0x7f23200cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:48560/0 (socket says 172.21.15.81:48560) 2023-10-07T08:43:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.524+0000 7f2326c68700 1 -- 172.21.15.81:0/2982391300 >> v2:172.21.15.89:3300/0 conn(0x7f2320159f10 msgr2=0x7f2320068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.524+0000 7f2326c68700 1 --2- 172.21.15.81:0/2982391300 >> v2:172.21.15.89:3300/0 conn(0x7f2320159f10 0x7f2320068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.524+0000 7f2326c68700 1 -- 172.21.15.81:0/2982391300 >> v1:172.21.15.89:6789/0 conn(0x7f2320159b40 legacy=0x7f23200cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.524+0000 7f2326c68700 1 -- 172.21.15.81:0/2982391300 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200cd320 con 0x7f2320068cc0 2023-10-07T08:43:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.524+0000 7f2325465700 1 -- 172.21.15.81:0/2982391300 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432815682 0 0) 0x7f23200cee10 con 0x7f2320159b40 2023-10-07T08:43:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.525+0000 7f2325c66700 1 --2- 172.21.15.81:0/2982391300 >> v2:172.21.15.89:3300/0 conn(0x7f2320159f10 0x7f2320068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.525+0000 7f2326c68700 1 --2- 172.21.15.81:0/2982391300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2320068cc0 0x7f23200cf2a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2318009e60 tx=0x7f2318009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=566f95bf95e3a71d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.525+0000 7f2325465700 1 -- 172.21.15.81:0/2982391300 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231800e070 con 0x7f2320068cc0 2023-10-07T08:43:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.525+0000 7f2325465700 1 -- 172.21.15.81:0/2982391300 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231800bb60 con 0x7f2320068cc0 2023-10-07T08:43:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.525+0000 7f2325465700 1 -- 172.21.15.81:0/2982391300 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318012430 con 0x7f2320068cc0 2023-10-07T08:43:15.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.525+0000 7f2327469700 1 -- 172.21.15.81:0/2982391300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2320068cc0 msgr2=0x7f23200cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:15.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.525+0000 7f2327469700 1 --2- 172.21.15.81:0/2982391300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2320068cc0 0x7f23200cf2a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2318009e60 tx=0x7f2318009780 comp rx=0 tx=0).stop 2023-10-07T08:43:15.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.525+0000 7f2327469700 1 -- 172.21.15.81:0/2982391300 shutdown_connections 2023-10-07T08:43:15.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.525+0000 7f2327469700 1 --2- 172.21.15.81:0/2982391300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2320068cc0 0x7f23200cf2a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.525+0000 7f2327469700 1 --2- 172.21.15.81:0/2982391300 >> v2:172.21.15.89:3300/0 conn(0x7f2320159f10 0x7f2320068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.525+0000 7f2327469700 1 -- 172.21.15.81:0/2982391300 >> 172.21.15.81:0/2982391300 conn(0x7f23200cd660 msgr2=0x7f23200cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:15.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.525+0000 7f2327469700 1 -- 172.21.15.81:0/2982391300 shutdown_connections 2023-10-07T08:43:15.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.525+0000 7f2327469700 1 -- 172.21.15.81:0/2982391300 wait complete. 2023-10-07T08:43:15.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.526+0000 7f2327469700 1 Processor -- start 2023-10-07T08:43:15.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.527+0000 7f2327469700 1 -- start start 2023-10-07T08:43:15.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.527+0000 7f2327469700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2320068cc0 0x7f2320154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.527+0000 7f2327469700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2320159b40 0x7f23200c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.527+0000 7f2327469700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2320159f10 0x7f232015b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.527+0000 7f2327469700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2320157b00 con 0x7f2320068cc0 2023-10-07T08:43:15.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.527+0000 7f2327469700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200c9800 con 0x7f2320159f10 2023-10-07T08:43:15.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.527+0000 7f2327469700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2320158660 con 0x7f2320159b40 2023-10-07T08:43:15.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.527+0000 7f2326467700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2320068cc0 0x7f2320154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.527+0000 7f2326467700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2320068cc0 0x7f2320154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39174/0 (socket says 172.21.15.81:39174) 2023-10-07T08:43:15.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.527+0000 7f2326467700 1 -- 172.21.15.81:0/837263394 learned_addr learned my addr 172.21.15.81:0/837263394 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:15.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.528+0000 7f2325c66700 1 --2- 172.21.15.81:0/837263394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2320159b40 0x7f23200c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.528+0000 7f2326c68700 1 --2- 172.21.15.81:0/837263394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2320159f10 0x7f232015b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.528+0000 7f2326467700 1 -- 172.21.15.81:0/837263394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2320159b40 msgr2=0x7f23200c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:15.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.528+0000 7f2326467700 1 --2- 172.21.15.81:0/837263394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2320159b40 0x7f23200c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.528+0000 7f2326467700 1 -- 172.21.15.81:0/837263394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2320159f10 msgr2=0x7f232015b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:15.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.528+0000 7f2326467700 1 --2- 172.21.15.81:0/837263394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2320159f10 0x7f232015b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.528+0000 7f2326467700 1 -- 172.21.15.81:0/837263394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23100094f0 con 0x7f2320068cc0 2023-10-07T08:43:15.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.528+0000 7f2326467700 1 --2- 172.21.15.81:0/837263394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2320068cc0 0x7f2320154c20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f231c00c7e0 tx=0x7f231c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:15.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.528+0000 7f23167fc700 1 -- 172.21.15.81:0/837263394 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c007300 con 0x7f2320068cc0 2023-10-07T08:43:15.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.528+0000 7f23167fc700 1 -- 172.21.15.81:0/837263394 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c007460 con 0x7f2320068cc0 2023-10-07T08:43:15.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.528+0000 7f2327469700 1 -- 172.21.15.81:0/837263394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2318009a20 con 0x7f2320068cc0 2023-10-07T08:43:15.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.528+0000 7f23167fc700 1 -- 172.21.15.81:0/837263394 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c004830 con 0x7f2320068cc0 2023-10-07T08:43:15.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.528+0000 7f2327469700 1 -- 172.21.15.81:0/837263394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2320158010 con 0x7f2320068cc0 2023-10-07T08:43:15.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.529+0000 7f23167fc700 1 -- 172.21.15.81:0/837263394 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f231c004be0 con 0x7f2320068cc0 2023-10-07T08:43:15.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.530+0000 7f23167fc700 1 --2- 172.21.15.81:0/837263394 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2304066f30 0x7f23040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.530+0000 7f23167fc700 1 -- 172.21.15.81:0/837263394 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f231c083a50 con 0x7f2320068cc0 2023-10-07T08:43:15.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.530+0000 7f2325c66700 1 --2- 172.21.15.81:0/837263394 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2304066f30 0x7f23040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.530+0000 7f2325c66700 1 --2- 172.21.15.81:0/837263394 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2304066f30 0x7f23040693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f232015d130 tx=0x7f2310008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.532+0000 7f23319c3b80 1 Processor -- start 2023-10-07T08:43:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.532+0000 7f23319c3b80 1 -- start start 2023-10-07T08:43:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.532+0000 7f23319c3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef7907d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.532+0000 7f23319c3b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 0x5645ef7b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.532+0000 7f23319c3b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef766ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.532+0000 7f23319c3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ef6bda70 con 0x5645ef7b1480 2023-10-07T08:43:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.532+0000 7f23319c3b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ef6bb270 con 0x5645ef766b80 2023-10-07T08:43:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.532+0000 7f23319c3b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645ef6b7060 con 0x5645ef7645f0 2023-10-07T08:43:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.532+0000 7f2326467700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef7907d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.532+0000 7f2326467700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef7907d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39182/0 (socket says 172.21.15.81:39182) 2023-10-07T08:43:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.532+0000 7f2326467700 1 -- 172.21.15.81:0/2128119777 learned_addr learned my addr 172.21.15.81:0/2128119777 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.532+0000 7f2326c68700 1 --2- 172.21.15.81:0/2128119777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef766ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.532+0000 7f2325c66700 1 --2- 172.21.15.81:0/2128119777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 0x5645ef7b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f2326467700 1 -- 172.21.15.81:0/2128119777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 msgr2=0x5645ef7b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f2326467700 1 --2- 172.21.15.81:0/2128119777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 0x5645ef7b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f2326467700 1 -- 172.21.15.81:0/2128119777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 msgr2=0x5645ef766ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f2326467700 1 --2- 172.21.15.81:0/2128119777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef766ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f2326467700 1 -- 172.21.15.81:0/2128119777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645ef551270 con 0x5645ef7b1480 2023-10-07T08:43:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f2326c68700 1 --2- 172.21.15.81:0/2128119777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef766ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f2326467700 1 --2- 172.21.15.81:0/2128119777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef7907d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f231c082020 tx=0x7f231c081ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda98558f240dca5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f23037fe700 1 -- 172.21.15.81:0/2128119777 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c054540 con 0x5645ef7b1480 2023-10-07T08:43:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f23037fe700 1 -- 172.21.15.81:0/2128119777 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c004e90 con 0x5645ef7b1480 2023-10-07T08:43:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f23037fe700 1 -- 172.21.15.81:0/2128119777 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c057c50 con 0x5645ef7b1480 2023-10-07T08:43:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f23319c3b80 1 -- 172.21.15.81:0/2128119777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 msgr2=0x5645ef7907d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f23319c3b80 1 --2- 172.21.15.81:0/2128119777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef7907d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f231c082020 tx=0x7f231c081ed0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f23319c3b80 1 -- 172.21.15.81:0/2128119777 shutdown_connections 2023-10-07T08:43:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f23319c3b80 1 --2- 172.21.15.81:0/2128119777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef766ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f23319c3b80 1 --2- 172.21.15.81:0/2128119777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef7907d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f23319c3b80 1 --2- 172.21.15.81:0/2128119777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 0x5645ef7b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.533+0000 7f23319c3b80 1 -- 172.21.15.81:0/2128119777 >> 172.21.15.81:0/2128119777 conn(0x5645ef7680c0 msgr2=0x5645ef7688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.534+0000 7f23319c3b80 1 -- 172.21.15.81:0/2128119777 shutdown_connections 2023-10-07T08:43:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.534+0000 7f23319c3b80 1 -- 172.21.15.81:0/2128119777 wait complete. 2023-10-07T08:43:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.534+0000 7f23319c3b80 1 -- start start 2023-10-07T08:43:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.534+0000 7f23319c3b80 1 Processor -- start 2023-10-07T08:43:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f23319c3b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 0x5645ef78ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f23319c3b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef7b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f23319c3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef7ae330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f23319c3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ef662890 con 0x5645ef7b1480 2023-10-07T08:43:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f23319c3b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ef67dea0 con 0x5645ef766b80 2023-10-07T08:43:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f23319c3b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645ef539e30 con 0x5645ef7645f0 2023-10-07T08:43:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f23319c3b80 10 client.0 _ll_register_callbacks cb 0x5645ef72a2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:43:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f2326c68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef7ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f2326c68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef7ae330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39194/0 (socket says 172.21.15.81:39194) 2023-10-07T08:43:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f2326c68700 1 -- 172.21.15.81:0/1318666647 learned_addr learned my addr 172.21.15.81:0/1318666647 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f2325c66700 1 --2- 172.21.15.81:0/1318666647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef7b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f2326467700 1 --2- 172.21.15.81:0/1318666647 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 0x5645ef78ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f2326c68700 1 -- 172.21.15.81:0/1318666647 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 msgr2=0x5645ef78ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f2326c68700 1 --2- 172.21.15.81:0/1318666647 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 0x5645ef78ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f2326c68700 1 -- 172.21.15.81:0/1318666647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 msgr2=0x5645ef7b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f2326c68700 1 --2- 172.21.15.81:0/1318666647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef7b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.535+0000 7f2326c68700 1 -- 172.21.15.81:0/1318666647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2320158010 con 0x5645ef7b1480 2023-10-07T08:43:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f2326c68700 1 --2- 172.21.15.81:0/1318666647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef7ae330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2320068580 tx=0x7f2318019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bf8679f92eb71a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f2300ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:43:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f2300ff9700 1 -- 172.21.15.81:0/1318666647 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318023070 con 0x5645ef7b1480 2023-10-07T08:43:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f2300ff9700 1 -- 172.21.15.81:0/1318666647 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2318012de0 con 0x5645ef7b1480 2023-10-07T08:43:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f23319c3b80 1 -- 172.21.15.81:0/1318666647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5645ef75bcd0 con 0x5645ef7b1480 2023-10-07T08:43:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f2300ff9700 1 -- 172.21.15.81:0/1318666647 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f231801d620 con 0x5645ef7b1480 2023-10-07T08:43:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f23319c3b80 10 client.4650 fetch_fsmap learned FSMap version 7 2023-10-07T08:43:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f23319c3b80 1 -- 172.21.15.81:0/1318666647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5645ef4f3fe0 con 0x5645ef7b1480 2023-10-07T08:43:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f2300ff9700 1 -- 172.21.15.81:0/1318666647 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5645ef75bcd0 con 0x5645ef7b1480 2023-10-07T08:43:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f2300ff9700 1 -- 172.21.15.81:0/1318666647 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f231801d780 con 0x5645ef7b1480 2023-10-07T08:43:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f23319c3b80 10 client.4650 fetch_fsmap finished waiting for FSMap version 7 2023-10-07T08:43:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f23319c3b80 10 client.4650 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-07T08:43:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f23319c3b80 20 client.4650 populate_metadata read hostname 'smithi081' 2023-10-07T08:43:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f23319c3b80 1 --2- 172.21.15.81:0/1318666647 >> [v2:172.21.15.89:6834/860615068,v1:172.21.15.89:6835/860615068] conn(0x5645ef790c00 0x5645ef790fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f23319c3b80 4 client.4650 mds_command: new command op to 4273 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T08:43:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f23319c3b80 1 -- 172.21.15.81:0/1318666647 --> [v2:172.21.15.89:6834/860615068,v1:172.21.15.89:6835/860615068] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5645ef738aa0 con 0x5645ef790c00 2023-10-07T08:43:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.536+0000 7f2326467700 1 --2- 172.21.15.81:0/1318666647 >> [v2:172.21.15.89:6834/860615068,v1:172.21.15.89:6835/860615068] conn(0x5645ef790c00 0x5645ef790fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.537+0000 7f2300ff9700 10 client.4650 ms_handle_connect on v2:172.21.15.89:6834/860615068 2023-10-07T08:43:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.537+0000 7f2326467700 1 --2- 172.21.15.81:0/1318666647 >> [v2:172.21.15.89:6834/860615068,v1:172.21.15.89:6835/860615068] conn(0x5645ef790c00 0x5645ef790fd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1c24fae50f51e10 server_cookie=e900a1192ca21d5d in_seq=0 out_seq=0 2023-10-07T08:43:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.537+0000 7f2300ff9700 1 -- 172.21.15.81:0/1318666647 <== mds.0 v2:172.21.15.89:6834/860615068 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5645ef738aa0 con 0x5645ef790c00 2023-10-07T08:43:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.537+0000 7f2300ff9700 10 client.4650 handle_command_reply: tid=0 2023-10-07T08:43:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.537+0000 7f23319c3b80 1 client.4650 shutdown 2023-10-07T08:43:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.538+0000 7f23319c3b80 1 -- 172.21.15.81:0/1318666647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 msgr2=0x5645ef7ae330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.538+0000 7f23319c3b80 1 --2- 172.21.15.81:0/1318666647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef7ae330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2320068580 tx=0x7f2318019000 comp rx=0 tx=0).stop 2023-10-07T08:43:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.538+0000 7f23319c3b80 1 -- 172.21.15.81:0/1318666647 shutdown_connections 2023-10-07T08:43:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.538+0000 7f23319c3b80 1 --2- 172.21.15.81:0/1318666647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef7ae330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.538+0000 7f23319c3b80 1 --2- 172.21.15.81:0/1318666647 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 0x5645ef78ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.538+0000 7f23319c3b80 1 --2- 172.21.15.81:0/1318666647 >> [v2:172.21.15.89:6834/860615068,v1:172.21.15.89:6835/860615068] conn(0x5645ef790c00 0x5645ef790fd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.538+0000 7f23319c3b80 1 --2- 172.21.15.81:0/1318666647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef7b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.538+0000 7f2300ff9700 0 client.4650 ms_handle_reset on v2:172.21.15.89:6834/860615068 2023-10-07T08:43:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.538+0000 7f23319c3b80 1 -- 172.21.15.81:0/1318666647 >> 172.21.15.81:0/1318666647 conn(0x5645ef7680c0 msgr2=0x5645ef75dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.538+0000 7f23319c3b80 1 -- 172.21.15.81:0/1318666647 shutdown_connections 2023-10-07T08:43:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.538+0000 7f23319c3b80 1 -- 172.21.15.81:0/1318666647 wait complete. 2023-10-07T08:43:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.538+0000 7f23319c3b80 20 client.4650 trim_cache size 0 max 16384 2023-10-07T08:43:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.554+0000 7f23319c3b80 1 Processor -- start 2023-10-07T08:43:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.554+0000 7f23319c3b80 1 -- start start 2023-10-07T08:43:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.555+0000 7f23319c3b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 0x5645ef7ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.555+0000 7f23319c3b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef763a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.555+0000 7f23319c3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef763f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.555+0000 7f23319c3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ef7c0590 con 0x5645ef7b1480 2023-10-07T08:43:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.555+0000 7f23319c3b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ef794030 con 0x5645ef766b80 2023-10-07T08:43:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.555+0000 7f23319c3b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645ef792000 con 0x5645ef7645f0 2023-10-07T08:43:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.555+0000 7f2326c68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef763f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.555+0000 7f2326c68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef763f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39200/0 (socket says 172.21.15.81:39200) 2023-10-07T08:43:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.555+0000 7f2326c68700 1 -- 172.21.15.81:0/875020524 learned_addr learned my addr 172.21.15.81:0/875020524 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.555+0000 7f2326c68700 1 -- 172.21.15.81:0/875020524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 msgr2=0x5645ef7ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.555+0000 7f2326c68700 1 --2- 172.21.15.81:0/875020524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 0x5645ef7ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.555+0000 7f2325c66700 1 --2- 172.21.15.81:0/875020524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef763a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.555+0000 7f2326c68700 1 -- 172.21.15.81:0/875020524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 msgr2=0x5645ef763a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.555+0000 7f2326c68700 1 --2- 172.21.15.81:0/875020524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef763a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.555+0000 7f2326c68700 1 -- 172.21.15.81:0/875020524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645ef685780 con 0x5645ef7b1480 2023-10-07T08:43:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.556+0000 7f2326c68700 1 --2- 172.21.15.81:0/875020524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef763f80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f23180097c0 tx=0x7f2318023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3dbc9b6d5fea45 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.556+0000 7f2303fff700 1 -- 172.21.15.81:0/875020524 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231801dc40 con 0x5645ef7b1480 2023-10-07T08:43:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.556+0000 7f2303fff700 1 -- 172.21.15.81:0/875020524 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2318012430 con 0x5645ef7b1480 2023-10-07T08:43:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.556+0000 7f2303fff700 1 -- 172.21.15.81:0/875020524 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231801d850 con 0x5645ef7b1480 2023-10-07T08:43:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.556+0000 7f23319c3b80 1 -- 172.21.15.81:0/875020524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 msgr2=0x5645ef763f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.556+0000 7f23319c3b80 1 --2- 172.21.15.81:0/875020524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef763f80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f23180097c0 tx=0x7f2318023000 comp rx=0 tx=0).stop 2023-10-07T08:43:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.556+0000 7f23319c3b80 1 -- 172.21.15.81:0/875020524 shutdown_connections 2023-10-07T08:43:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.556+0000 7f23319c3b80 1 --2- 172.21.15.81:0/875020524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef763f80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.556+0000 7f23319c3b80 1 --2- 172.21.15.81:0/875020524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 0x5645ef7ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.556+0000 7f23319c3b80 1 --2- 172.21.15.81:0/875020524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef763a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.556+0000 7f23319c3b80 1 -- 172.21.15.81:0/875020524 >> 172.21.15.81:0/875020524 conn(0x5645ef7680c0 msgr2=0x5645ef789f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:15.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.556+0000 7f23319c3b80 1 -- 172.21.15.81:0/875020524 shutdown_connections 2023-10-07T08:43:15.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.556+0000 7f23319c3b80 1 -- 172.21.15.81:0/875020524 wait complete. 2023-10-07T08:43:15.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.557+0000 7f23319c3b80 1 -- start start 2023-10-07T08:43:15.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.557+0000 7f23319c3b80 1 Processor -- start 2023-10-07T08:43:15.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f23319c3b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 0x5645ef812660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f23319c3b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef78ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f23319c3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef78b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f23319c3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ef78f3c0 con 0x5645ef7b1480 2023-10-07T08:43:15.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f23319c3b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ef812ba0 con 0x5645ef766b80 2023-10-07T08:43:15.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f23319c3b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645ef814320 con 0x5645ef7645f0 2023-10-07T08:43:15.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f23319c3b80 10 client.0 _ll_register_callbacks cb 0x5645ef72a2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:43:15.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f2326c68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef78b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f2326c68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef78b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39204/0 (socket says 172.21.15.81:39204) 2023-10-07T08:43:15.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f2326c68700 1 -- 172.21.15.81:0/3024158597 learned_addr learned my addr 172.21.15.81:0/3024158597 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:15.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f2325c66700 1 --2- 172.21.15.81:0/3024158597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef78ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f2326467700 1 --2- 172.21.15.81:0/3024158597 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 0x5645ef812660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f2326c68700 1 -- 172.21.15.81:0/3024158597 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 msgr2=0x5645ef812660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:15.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f2326c68700 1 --2- 172.21.15.81:0/3024158597 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 0x5645ef812660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f2326c68700 1 -- 172.21.15.81:0/3024158597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 msgr2=0x5645ef78ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:15.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f2326c68700 1 --2- 172.21.15.81:0/3024158597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef78ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f2326c68700 1 -- 172.21.15.81:0/3024158597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645ef4f3fe0 con 0x5645ef7b1480 2023-10-07T08:43:15.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f2325c66700 1 --2- 172.21.15.81:0/3024158597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef78ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:15.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f2326c68700 1 --2- 172.21.15.81:0/3024158597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef78b360 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2318007140 tx=0x7f231801f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516d5fa60190f21b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:15.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f2300ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:43:15.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f2300ff9700 1 -- 172.21.15.81:0/3024158597 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318023040 con 0x5645ef7b1480 2023-10-07T08:43:15.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f2300ff9700 1 -- 172.21.15.81:0/3024158597 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f231801d830 con 0x5645ef7b1480 2023-10-07T08:43:15.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.558+0000 7f23319c3b80 1 -- 172.21.15.81:0/3024158597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f231c004e90 con 0x5645ef7b1480 2023-10-07T08:43:15.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.559+0000 7f2300ff9700 1 -- 172.21.15.81:0/3024158597 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f231802eb30 con 0x5645ef7b1480 2023-10-07T08:43:15.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.559+0000 7f23319c3b80 10 client.4656 fetch_fsmap learned FSMap version 7 2023-10-07T08:43:15.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.559+0000 7f23319c3b80 1 -- 172.21.15.81:0/3024158597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5645ef66c470 con 0x5645ef7b1480 2023-10-07T08:43:15.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.559+0000 7f2300ff9700 1 -- 172.21.15.81:0/3024158597 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c004e90 con 0x5645ef7b1480 2023-10-07T08:43:15.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.559+0000 7f2300ff9700 1 -- 172.21.15.81:0/3024158597 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f231802ec90 con 0x5645ef7b1480 2023-10-07T08:43:15.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.559+0000 7f23319c3b80 10 client.4656 fetch_fsmap finished waiting for FSMap version 7 2023-10-07T08:43:15.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.559+0000 7f23319c3b80 10 client.4656 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-07T08:43:15.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.559+0000 7f23319c3b80 20 client.4656 populate_metadata read hostname 'smithi081' 2023-10-07T08:43:15.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.559+0000 7f23319c3b80 1 --2- 172.21.15.81:0/3024158597 >> [v2:172.21.15.89:6834/860615068,v1:172.21.15.89:6835/860615068] conn(0x5645ef792850 0x5645ef792c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:15.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.559+0000 7f23319c3b80 4 client.4656 mds_command: new command op to 4273 tid=0[{"prefix": "status"}] 2023-10-07T08:43:15.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.559+0000 7f23319c3b80 1 -- 172.21.15.81:0/3024158597 --> [v2:172.21.15.89:6834/860615068,v1:172.21.15.89:6835/860615068] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5645ef659e00 con 0x5645ef792850 2023-10-07T08:43:15.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.559+0000 7f2326467700 1 --2- 172.21.15.81:0/3024158597 >> [v2:172.21.15.89:6834/860615068,v1:172.21.15.89:6835/860615068] conn(0x5645ef792850 0x5645ef792c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:15.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.559+0000 7f2326467700 1 --2- 172.21.15.81:0/3024158597 >> [v2:172.21.15.89:6834/860615068,v1:172.21.15.89:6835/860615068] conn(0x5645ef792850 0x5645ef792c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab9b259bff1a704f server_cookie=3277f4ddf8fb193d in_seq=0 out_seq=0 2023-10-07T08:43:15.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.559+0000 7f2300ff9700 10 client.4656 ms_handle_connect on v2:172.21.15.89:6834/860615068 2023-10-07T08:43:15.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f2300ff9700 1 -- 172.21.15.81:0/3024158597 <== mds.0 v2:172.21.15.89:6834/860615068 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5645ef659e00 con 0x5645ef792850 2023-10-07T08:43:15.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f2300ff9700 10 client.4656 handle_command_reply: tid=0 2023-10-07T08:43:15.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f23319c3b80 1 client.4656 shutdown 2023-10-07T08:43:15.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f23319c3b80 1 -- 172.21.15.81:0/3024158597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 msgr2=0x5645ef78b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:15.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f23319c3b80 1 --2- 172.21.15.81:0/3024158597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef78b360 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2318007140 tx=0x7f231801f050 comp rx=0 tx=0).stop 2023-10-07T08:43:15.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f23319c3b80 1 -- 172.21.15.81:0/3024158597 shutdown_connections 2023-10-07T08:43:15.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f23319c3b80 1 --2- 172.21.15.81:0/3024158597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5645ef7b1480 0x5645ef78b360 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f23319c3b80 1 --2- 172.21.15.81:0/3024158597 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5645ef7645f0 0x5645ef812660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f23319c3b80 1 --2- 172.21.15.81:0/3024158597 >> [v2:172.21.15.89:6834/860615068,v1:172.21.15.89:6835/860615068] conn(0x5645ef792850 0x5645ef792c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f23319c3b80 1 --2- 172.21.15.81:0/3024158597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645ef766b80 0x5645ef78ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f2300ff9700 0 client.4656 ms_handle_reset on v2:172.21.15.89:6834/860615068 2023-10-07T08:43:15.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f23319c3b80 1 -- 172.21.15.81:0/3024158597 >> 172.21.15.81:0/3024158597 conn(0x5645ef7680c0 msgr2=0x5645ef7acba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:15.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f23319c3b80 1 -- 172.21.15.81:0/3024158597 shutdown_connections 2023-10-07T08:43:15.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f23319c3b80 1 -- 172.21.15.81:0/3024158597 wait complete. 2023-10-07T08:43:15.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f23319c3b80 20 client.4656 trim_cache size 0 max 16384 2023-10-07T08:43:15.569 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:43:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:43:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-07T08:43:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4273, 2023-10-07T08:43:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-07T08:43:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-07T08:43:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-07T08:43:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 18.310819863999999, 2023-10-07T08:43:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 7, 2023-10-07T08:43:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 21, 2023-10-07T08:43:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 21, 2023-10-07T08:43:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 25.771429598000001 2023-10-07T08:43:15.571 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:43:15.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f2327469700 1 -- 172.21.15.81:0/837263394 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2304066f30 msgr2=0x7f23040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:15.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f2327469700 1 --2- 172.21.15.81:0/837263394 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2304066f30 0x7f23040693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f232015d130 tx=0x7f2310008040 comp rx=0 tx=0).stop 2023-10-07T08:43:15.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f2327469700 1 -- 172.21.15.81:0/837263394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2320068cc0 msgr2=0x7f2320154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:15.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f2327469700 1 --2- 172.21.15.81:0/837263394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2320068cc0 0x7f2320154c20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f231c00c7e0 tx=0x7f231c007e10 comp rx=0 tx=0).stop 2023-10-07T08:43:15.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f2327469700 1 -- 172.21.15.81:0/837263394 shutdown_connections 2023-10-07T08:43:15.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f2327469700 1 --2- 172.21.15.81:0/837263394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2320159f10 0x7f232015b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f2327469700 1 --2- 172.21.15.81:0/837263394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2320068cc0 0x7f2320154c20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f2327469700 1 --2- 172.21.15.81:0/837263394 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2304066f30 0x7f23040693e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f2327469700 1 --2- 172.21.15.81:0/837263394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2320159b40 0x7f23200c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:15.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f2327469700 1 -- 172.21.15.81:0/837263394 >> 172.21.15.81:0/837263394 conn(0x7f23200cd660 msgr2=0x7f232006d620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:15.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f2327469700 1 -- 172.21.15.81:0/837263394 shutdown_connections 2023-10-07T08:43:15.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:15.560+0000 7f2327469700 1 -- 172.21.15.81:0/837263394 wait complete. 2023-10-07T08:43:15.573 INFO:teuthology.run_tasks:Running task kclient... 2023-10-07T08:43:15.599 INFO:tasks.kclient:Mounting kernel clients... 2023-10-07T08:43:15.599 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-07T08:43:15.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:15.599 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-07T08:43:15.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:15.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-10-07T08:43:15.682 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2023-10-07T08:43:15.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:43:15.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:15.684 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-07T08:43:15.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:15.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-10-07T08:43:15.804 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2023-10-07T08:43:15.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:43:15.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:15.806 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-07T08:43:15.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:15.825 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2023-10-07T08:43:15.896 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2023-10-07T08:43:15.896 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:43:15.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:15.897 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-07T08:43:15.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:15.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2023-10-07T08:43:16.021 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2023-10-07T08:43:16.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:43:16.023 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-07T08:43:16.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:43:16.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.137+0000 7f4e1b59e700 1 Processor -- start 2023-10-07T08:43:16.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.137+0000 7f4e1b59e700 1 -- start start 2023-10-07T08:43:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.138+0000 7f4e1b59e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4e1c159f10 0x7f4e1c068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.138+0000 7f4e1b59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e1c068cc0 0x7f4e1c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.138+0000 7f4e1b59e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1c069120 con 0x7f4e1c159b40 2023-10-07T08:43:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.138+0000 7f4e1b59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1c0cee10 con 0x7f4e1c068cc0 2023-10-07T08:43:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.138+0000 7f4e1b59e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1c0cd040 con 0x7f4e1c159f10 2023-10-07T08:43:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.138+0000 7f4e1ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e1c068cc0 0x7f4e1c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.138+0000 7f4e1ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e1c068cc0 0x7f4e1c0cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39218/0 (socket says 172.21.15.81:39218) 2023-10-07T08:43:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.138+0000 7f4e1ad9d700 1 -- 172.21.15.81:0/4132613198 learned_addr learned my addr 172.21.15.81:0/4132613198 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:16.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.138+0000 7f4e19d9b700 1 --2- 172.21.15.81:0/4132613198 >> v2:172.21.15.89:3300/0 conn(0x7f4e1c159f10 0x7f4e1c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:16.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.138+0000 7f4e1ad9d700 1 -- 172.21.15.81:0/4132613198 >> v2:172.21.15.89:3300/0 conn(0x7f4e1c159f10 msgr2=0x7f4e1c068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:16.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.138+0000 7f4e1ad9d700 1 --2- 172.21.15.81:0/4132613198 >> v2:172.21.15.89:3300/0 conn(0x7f4e1c159f10 0x7f4e1c068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:16.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.138+0000 7f4e1ad9d700 1 -- 172.21.15.81:0/4132613198 >> v1:172.21.15.89:6789/0 conn(0x7f4e1c159b40 legacy=0x7f4e1c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:16.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.138+0000 7f4e1ad9d700 1 -- 172.21.15.81:0/4132613198 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c0cd320 con 0x7f4e1c068cc0 2023-10-07T08:43:16.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.138+0000 7f4e1ad9d700 1 --2- 172.21.15.81:0/4132613198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c068cc0 0x7f4e1c0cf2a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c06fd80 tx=0x7f4e14009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89cdc26a20262d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:16.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.139+0000 7f4e1959a700 1 -- 172.21.15.81:0/4132613198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1400e070 con 0x7f4e1c068cc0 2023-10-07T08:43:16.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.139+0000 7f4e1959a700 1 -- 172.21.15.81:0/4132613198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1400ba10 con 0x7f4e1c068cc0 2023-10-07T08:43:16.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.139+0000 7f4e1959a700 1 -- 172.21.15.81:0/4132613198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140092e0 con 0x7f4e1c068cc0 2023-10-07T08:43:16.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.139+0000 7f4e1b59e700 1 -- 172.21.15.81:0/4132613198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c068cc0 msgr2=0x7f4e1c0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:16.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.139+0000 7f4e1b59e700 1 --2- 172.21.15.81:0/4132613198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c068cc0 0x7f4e1c0cf2a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c06fd80 tx=0x7f4e14009840 comp rx=0 tx=0).stop 2023-10-07T08:43:16.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.139+0000 7f4e1b59e700 1 -- 172.21.15.81:0/4132613198 shutdown_connections 2023-10-07T08:43:16.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.139+0000 7f4e1b59e700 1 --2- 172.21.15.81:0/4132613198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c068cc0 0x7f4e1c0cf2a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:16.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.139+0000 7f4e1b59e700 1 --2- 172.21.15.81:0/4132613198 >> v2:172.21.15.89:3300/0 conn(0x7f4e1c159f10 0x7f4e1c068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:16.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.139+0000 7f4e1b59e700 1 -- 172.21.15.81:0/4132613198 >> 172.21.15.81:0/4132613198 conn(0x7f4e1c0cd660 msgr2=0x7f4e1c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:16.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.139+0000 7f4e1b59e700 1 -- 172.21.15.81:0/4132613198 shutdown_connections 2023-10-07T08:43:16.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.139+0000 7f4e1b59e700 1 -- 172.21.15.81:0/4132613198 wait complete. 2023-10-07T08:43:16.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.140+0000 7f4e1b59e700 1 Processor -- start 2023-10-07T08:43:16.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.140+0000 7f4e1b59e700 1 -- start start 2023-10-07T08:43:16.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.141+0000 7f4e1b59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e1c068cc0 0x7f4e1c16b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:16.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.141+0000 7f4e1b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c159b40 0x7f4e1c16d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:16.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.141+0000 7f4e1b59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1c159f10 0x7f4e1c155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:16.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.141+0000 7f4e1b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c16da50 con 0x7f4e1c159b40 2023-10-07T08:43:16.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.141+0000 7f4e1b59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c144f20 con 0x7f4e1c159f10 2023-10-07T08:43:16.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.141+0000 7f4e1b59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c158f60 con 0x7f4e1c068cc0 2023-10-07T08:43:16.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.141+0000 7f4e19d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c159b40 0x7f4e1c16d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:16.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.141+0000 7f4e19d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c159b40 0x7f4e1c16d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39232/0 (socket says 172.21.15.81:39232) 2023-10-07T08:43:16.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.141+0000 7f4e19d9b700 1 -- 172.21.15.81:0/1549831044 learned_addr learned my addr 172.21.15.81:0/1549831044 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:16.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.141+0000 7f4e1a59c700 1 --2- 172.21.15.81:0/1549831044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e1c068cc0 0x7f4e1c16b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:16.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.141+0000 7f4e1ad9d700 1 --2- 172.21.15.81:0/1549831044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1c159f10 0x7f4e1c155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:16.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.141+0000 7f4e19d9b700 1 -- 172.21.15.81:0/1549831044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e1c068cc0 msgr2=0x7f4e1c16b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:16.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.141+0000 7f4e19d9b700 1 --2- 172.21.15.81:0/1549831044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e1c068cc0 0x7f4e1c16b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:16.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.141+0000 7f4e19d9b700 1 -- 172.21.15.81:0/1549831044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1c159f10 msgr2=0x7f4e1c155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:16.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.141+0000 7f4e19d9b700 1 --2- 172.21.15.81:0/1549831044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1c159f10 0x7f4e1c155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:16.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.141+0000 7f4e19d9b700 1 -- 172.21.15.81:0/1549831044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14009ae0 con 0x7f4e1c159b40 2023-10-07T08:43:16.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.142+0000 7f4e19d9b700 1 --2- 172.21.15.81:0/1549831044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c159b40 0x7f4e1c16d510 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000c880 tx=0x7f4e10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.142+0000 7f4e0a7fc700 1 -- 172.21.15.81:0/1549831044 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10011600 con 0x7f4e1c159b40 2023-10-07T08:43:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.142+0000 7f4e0a7fc700 1 -- 172.21.15.81:0/1549831044 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e10011760 con 0x7f4e1c159b40 2023-10-07T08:43:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.142+0000 7f4e1b59e700 1 -- 172.21.15.81:0/1549831044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1c0b4c90 con 0x7f4e1c159b40 2023-10-07T08:43:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.142+0000 7f4e0a7fc700 1 -- 172.21.15.81:0/1549831044 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10011b20 con 0x7f4e1c159b40 2023-10-07T08:43:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.142+0000 7f4e1b59e700 1 -- 172.21.15.81:0/1549831044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1c0b5250 con 0x7f4e1c159b40 2023-10-07T08:43:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.143+0000 7f4e1b59e700 1 -- 172.21.15.81:0/1549831044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1c0b5470 con 0x7f4e1c159b40 2023-10-07T08:43:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.143+0000 7f4e0a7fc700 1 -- 172.21.15.81:0/1549831044 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e10019400 con 0x7f4e1c159b40 2023-10-07T08:43:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.143+0000 7f4e0a7fc700 1 --2- 172.21.15.81:0/1549831044 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4dfc066f30 0x7f4dfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.143+0000 7f4e0a7fc700 1 -- 172.21.15.81:0/1549831044 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e100844d0 con 0x7f4e1c159b40 2023-10-07T08:43:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.143+0000 7f4e1a59c700 1 --2- 172.21.15.81:0/1549831044 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4dfc066f30 0x7f4dfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.144+0000 7f4e1a59c700 1 --2- 172.21.15.81:0/1549831044 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4dfc066f30 0x7f4dfc0693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c006fd0 tx=0x7f4e0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:16.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.148+0000 7f4e0a7fc700 1 -- 172.21.15.81:0/1549831044 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e10051740 con 0x7f4e1c159b40 2023-10-07T08:43:16.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.372+0000 7f4e1b59e700 1 -- 172.21.15.81:0/1549831044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4e1c063e90 con 0x7f4e1c159b40 2023-10-07T08:43:16.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.372+0000 7f4e0a7fc700 1 -- 172.21.15.81:0/1549831044 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4e10054d60 con 0x7f4e1c159b40 2023-10-07T08:43:16.373 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:43:16.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.374+0000 7f4e1b59e700 1 -- 172.21.15.81:0/1549831044 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4dfc066f30 msgr2=0x7f4dfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:16.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.374+0000 7f4e1b59e700 1 --2- 172.21.15.81:0/1549831044 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4dfc066f30 0x7f4dfc0693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c006fd0 tx=0x7f4e0c008040 comp rx=0 tx=0).stop 2023-10-07T08:43:16.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.374+0000 7f4e1b59e700 1 -- 172.21.15.81:0/1549831044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c159b40 msgr2=0x7f4e1c16d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:16.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.374+0000 7f4e1b59e700 1 --2- 172.21.15.81:0/1549831044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c159b40 0x7f4e1c16d510 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000c880 tx=0x7f4e10008040 comp rx=0 tx=0).stop 2023-10-07T08:43:16.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.374+0000 7f4e1b59e700 1 -- 172.21.15.81:0/1549831044 shutdown_connections 2023-10-07T08:43:16.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.374+0000 7f4e1b59e700 1 --2- 172.21.15.81:0/1549831044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1c159f10 0x7f4e1c155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:16.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.374+0000 7f4e1b59e700 1 --2- 172.21.15.81:0/1549831044 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4dfc066f30 0x7f4dfc0693e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:16.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.374+0000 7f4e1b59e700 1 --2- 172.21.15.81:0/1549831044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e1c068cc0 0x7f4e1c16b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:16.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.374+0000 7f4e1b59e700 1 --2- 172.21.15.81:0/1549831044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c159b40 0x7f4e1c16d510 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:16.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.374+0000 7f4e1b59e700 1 -- 172.21.15.81:0/1549831044 >> 172.21.15.81:0/1549831044 conn(0x7f4e1c0cd660 msgr2=0x7f4e1c0cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:16.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.375+0000 7f4e1b59e700 1 -- 172.21.15.81:0/1549831044 shutdown_connections 2023-10-07T08:43:16.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:16.375+0000 7f4e1b59e700 1 -- 172.21.15.81:0/1549831044 wait complete. 2023-10-07T08:43:16.386 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-07T08:43:16.387 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:43:16.387 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-07T08:43:16.387 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T08:43:16.387 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T08:43:16.387 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-07T08:43:16.387 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-07T08:43:16.387 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:43:16.387 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:43:16.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:16.388 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-07T08:43:16.402 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:43:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:43:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:43:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:16.402 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-07T08:43:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:16.403 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-07T08:43:16.403 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-07T08:43:16.403 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:16.403 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:16.403 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:43:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:43:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42532sec preferred_lft 42532sec 2023-10-07T08:43:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-10-07T08:43:16.404 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:16.404 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-07T08:43:16.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:16.405 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:43:16.405 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:43:16.405 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2023-10-07T08:43:16.405 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2023-10-07T08:43:16.405 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2023-10-07T08:43:16.405 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-07T08:43:16.405 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:43:16.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:16.565 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:43:16.605 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-07T08:43:16.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:16.606 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-07T08:43:16.677 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-07T08:43:16.677 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:43:16.677 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:43:16.677 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:43:16.677 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:43:16.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:16.678 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:43:16.678 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:43:16.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:43:16.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:43:16.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:43:16.678 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:43:16.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:16.912 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-07T08:43:16.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:16.927 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2023-10-07T08:43:16.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:16.981 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:43:16.981 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:43:16.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T08:43:16.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-07T08:43:16.982 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:43:17.070 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-07T08:43:17.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:17.071 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:43:17.071 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:43:17.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-07T08:43:17.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-07T08:43:17.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-07T08:43:17.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-07T08:43:17.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-07T08:43:17.072 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:43:17.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:17.255 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:43:17.255 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:43:17.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-07T08:43:17.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2023-10-07T08:43:17.255 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:43:17.347 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:43:17.347 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T08:43:17.362 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:43:17.362 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:43:17.362 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:43:17.417 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:43:17.417 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:43:17.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:43:17.501 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:43:17.501 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:43:17.501 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:43:17.603 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:43:17.603 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:43:17.604 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:43:17.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:17.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:43:17.670 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-10-07T08:43:17.671 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:43:17.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.825+0000 7f35c7d6e700 1 Processor -- start 2023-10-07T08:43:17.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.825+0000 7f35c7d6e700 1 -- start start 2023-10-07T08:43:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.826+0000 7f35c7d6e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35c00ce1f0 0x7f35c00aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.826+0000 7f35c7d6e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f35c00ac570 0x7f35c006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.826+0000 7f35c7d6e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c015dfb0 con 0x7f35c00ce5c0 2023-10-07T08:43:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.826+0000 7f35c7d6e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c00acec0 con 0x7f35c00ac570 2023-10-07T08:43:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.826+0000 7f35c7d6e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00ad1a0 con 0x7f35c00ce1f0 2023-10-07T08:43:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.826+0000 7f35c5309700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f35c00ce5c0 0x7f35c015e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39586/0 (socket says 172.21.15.81:39586) 2023-10-07T08:43:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.826+0000 7f35c5309700 1 -- 172.21.15.81:0/2062981340 learned_addr learned my addr 172.21.15.81:0/2062981340 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.827+0000 7f35c5b0a700 1 --2- 172.21.15.81:0/2062981340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35c00ce1f0 0x7f35c00aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.827+0000 7f35c630b700 1 --2- 172.21.15.81:0/2062981340 >> v2:172.21.15.89:3300/0 conn(0x7f35c00ac570 0x7f35c006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.827+0000 7f35c4b08700 1 -- 172.21.15.81:0/2062981340 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062817958 0 0) 0x7f35c015dfb0 con 0x7f35c00ce5c0 2023-10-07T08:43:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.827+0000 7f35c4b08700 1 -- 172.21.15.81:0/2062981340 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35a8003570 con 0x7f35c00ce5c0 2023-10-07T08:43:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.827+0000 7f35c5b0a700 1 -- 172.21.15.81:0/2062981340 >> v2:172.21.15.89:3300/0 conn(0x7f35c00ac570 msgr2=0x7f35c006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.827+0000 7f35c5b0a700 1 --2- 172.21.15.81:0/2062981340 >> v2:172.21.15.89:3300/0 conn(0x7f35c00ac570 0x7f35c006e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.827+0000 7f35c5b0a700 1 -- 172.21.15.81:0/2062981340 >> v1:172.21.15.81:6789/0 conn(0x7f35c00ce5c0 legacy=0x7f35c015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.827+0000 7f35c5b0a700 1 -- 172.21.15.81:0/2062981340 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c015dc40 con 0x7f35c00ce1f0 2023-10-07T08:43:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.827+0000 7f35c5b0a700 1 --2- 172.21.15.81:0/2062981340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35c00ce1f0 0x7f35c00aacf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f35b00098e0 tx=0x7f35b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eae0df8677663371 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.827+0000 7f35c4b08700 1 -- 172.21.15.81:0/2062981340 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0011630 con 0x7f35c00ce1f0 2023-10-07T08:43:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.827+0000 7f35c4b08700 1 -- 172.21.15.81:0/2062981340 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b0011790 con 0x7f35c00ce1f0 2023-10-07T08:43:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.827+0000 7f35c4b08700 1 -- 172.21.15.81:0/2062981340 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0011b30 con 0x7f35c00ce1f0 2023-10-07T08:43:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.828+0000 7f35c7d6e700 1 -- 172.21.15.81:0/2062981340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35c00ce1f0 msgr2=0x7f35c00aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.828+0000 7f35c7d6e700 1 --2- 172.21.15.81:0/2062981340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35c00ce1f0 0x7f35c00aacf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f35b00098e0 tx=0x7f35b00091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.828+0000 7f35c7d6e700 1 -- 172.21.15.81:0/2062981340 shutdown_connections 2023-10-07T08:43:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.828+0000 7f35c7d6e700 1 --2- 172.21.15.81:0/2062981340 >> v2:172.21.15.89:3300/0 conn(0x7f35c00ac570 0x7f35c006e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.828+0000 7f35c7d6e700 1 --2- 172.21.15.81:0/2062981340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35c00ce1f0 0x7f35c00aacf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.828+0000 7f35c7d6e700 1 -- 172.21.15.81:0/2062981340 >> 172.21.15.81:0/2062981340 conn(0x7f35c006cca0 msgr2=0x7f35c006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.828+0000 7f35c7d6e700 1 -- 172.21.15.81:0/2062981340 shutdown_connections 2023-10-07T08:43:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.828+0000 7f35c7d6e700 1 -- 172.21.15.81:0/2062981340 wait complete. 2023-10-07T08:43:17.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.829+0000 7f35c7d6e700 1 Processor -- start 2023-10-07T08:43:17.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.829+0000 7f35c7d6e700 1 -- start start 2023-10-07T08:43:17.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c7d6e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c00ac570 0x7f35c016d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:17.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c7d6e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35c00ce1f0 0x7f35c016b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:17.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c7d6e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35c00ce5c0 0x7f35c01591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c7d6e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c016b3a0 con 0x7f35c00ac570 2023-10-07T08:43:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c7d6e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c015c470 con 0x7f35c00ce1f0 2023-10-07T08:43:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c7d6e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c016b0c0 con 0x7f35c00ce5c0 2023-10-07T08:43:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c5b0a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c00ac570 0x7f35c016d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c5b0a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c00ac570 0x7f35c016d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39248/0 (socket says 172.21.15.81:39248) 2023-10-07T08:43:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c5b0a700 1 -- 172.21.15.81:0/3825490542 learned_addr learned my addr 172.21.15.81:0/3825490542 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c630b700 1 --2- 172.21.15.81:0/3825490542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35c00ce5c0 0x7f35c01591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c5309700 1 --2- 172.21.15.81:0/3825490542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35c00ce1f0 0x7f35c016b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c5b0a700 1 -- 172.21.15.81:0/3825490542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35c00ce5c0 msgr2=0x7f35c01591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c5b0a700 1 --2- 172.21.15.81:0/3825490542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35c00ce5c0 0x7f35c01591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c5b0a700 1 -- 172.21.15.81:0/3825490542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35c00ce1f0 msgr2=0x7f35c016b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c5b0a700 1 --2- 172.21.15.81:0/3825490542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35c00ce1f0 0x7f35c016b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c5b0a700 1 -- 172.21.15.81:0/3825490542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b0009420 con 0x7f35c00ac570 2023-10-07T08:43:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c5b0a700 1 --2- 172.21.15.81:0/3825490542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c00ac570 0x7f35c016d360 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35c015da20 tx=0x7f35b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35bdffb700 1 -- 172.21.15.81:0/3825490542 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b001f070 con 0x7f35c00ac570 2023-10-07T08:43:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35bdffb700 1 -- 172.21.15.81:0/3825490542 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b0000c90 con 0x7f35c00ac570 2023-10-07T08:43:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c7d6e700 1 -- 172.21.15.81:0/3825490542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c015be20 con 0x7f35c00ac570 2023-10-07T08:43:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35bdffb700 1 -- 172.21.15.81:0/3825490542 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0011b30 con 0x7f35c00ac570 2023-10-07T08:43:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.830+0000 7f35c7d6e700 1 -- 172.21.15.81:0/3825490542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c0159730 con 0x7f35c00ac570 2023-10-07T08:43:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.831+0000 7f35c7d6e700 1 -- 172.21.15.81:0/3825490542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c015bc80 con 0x7f35c00ac570 2023-10-07T08:43:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.832+0000 7f35bdffb700 1 -- 172.21.15.81:0/3825490542 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35b0023070 con 0x7f35c00ac570 2023-10-07T08:43:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.832+0000 7f35bdffb700 1 --2- 172.21.15.81:0/3825490542 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f35ac066f30 0x7f35ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.832+0000 7f35bdffb700 1 -- 172.21.15.81:0/3825490542 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f35b0085910 con 0x7f35c00ac570 2023-10-07T08:43:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.832+0000 7f35c5309700 1 --2- 172.21.15.81:0/3825490542 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f35ac066f30 0x7f35ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.833+0000 7f35c5309700 1 --2- 172.21.15.81:0/3825490542 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f35ac066f30 0x7f35ac0693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35c016d8a0 tx=0x7f35b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:17.836+0000 7f35bdffb700 1 -- 172.21.15.81:0/3825490542 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35c015bc80 con 0x7f35c00ac570 2023-10-07T08:43:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:18.062+0000 7f35c7d6e700 1 -- 172.21.15.81:0/3825490542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f35c015bc80 con 0x7f35c00ac570 2023-10-07T08:43:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:18.062+0000 7f35bdffb700 1 -- 172.21.15.81:0/3825490542 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f35c015bc80 con 0x7f35c00ac570 2023-10-07T08:43:18.062 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:43:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:18.064+0000 7f35c7d6e700 1 -- 172.21.15.81:0/3825490542 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f35ac066f30 msgr2=0x7f35ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:18.064+0000 7f35c7d6e700 1 --2- 172.21.15.81:0/3825490542 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f35ac066f30 0x7f35ac0693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35c016d8a0 tx=0x7f35b4009040 comp rx=0 tx=0).stop 2023-10-07T08:43:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:18.064+0000 7f35c7d6e700 1 -- 172.21.15.81:0/3825490542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c00ac570 msgr2=0x7f35c016d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:18.064+0000 7f35c7d6e700 1 --2- 172.21.15.81:0/3825490542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c00ac570 0x7f35c016d360 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35c015da20 tx=0x7f35b0017000 comp rx=0 tx=0).stop 2023-10-07T08:43:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:18.064+0000 7f35c7d6e700 1 -- 172.21.15.81:0/3825490542 shutdown_connections 2023-10-07T08:43:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:18.064+0000 7f35c7d6e700 1 --2- 172.21.15.81:0/3825490542 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f35ac066f30 0x7f35ac0693e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:18.064+0000 7f35c7d6e700 1 --2- 172.21.15.81:0/3825490542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35c00ce5c0 0x7f35c01591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:18.064+0000 7f35c7d6e700 1 --2- 172.21.15.81:0/3825490542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c00ac570 0x7f35c016d360 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:18.064+0000 7f35c7d6e700 1 --2- 172.21.15.81:0/3825490542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35c00ce1f0 0x7f35c016b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:18.064+0000 7f35c7d6e700 1 -- 172.21.15.81:0/3825490542 >> 172.21.15.81:0/3825490542 conn(0x7f35c006cca0 msgr2=0x7f35c01564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:18.064+0000 7f35c7d6e700 1 -- 172.21.15.81:0/3825490542 shutdown_connections 2023-10-07T08:43:18.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:18.064+0000 7f35c7d6e700 1 -- 172.21.15.81:0/3825490542 wait complete. 2023-10-07T08:43:18.076 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-07T08:43:18.077 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:43:18.077 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-07T08:43:18.077 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-07T08:43:18.077 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-07T08:43:18.077 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-07T08:43:18.077 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-07T08:43:18.077 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:43:18.077 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-07T08:43:18.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:18.078 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-07T08:43:18.093 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:43:18.095 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:43:18.095 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:43:18.095 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:18.095 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-07T08:43:18.095 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:18.095 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:18.096 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:18.096 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-07T08:43:18.096 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:18.096 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:18.096 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-07T08:43:18.097 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:18.097 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:18.097 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:43:18.097 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:18.097 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:43:18.097 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42530sec preferred_lft 42530sec 2023-10-07T08:43:18.097 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-10-07T08:43:18.097 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:18.098 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:43:18.098 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:fe:81:9d:9c:0a brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:18.098 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:43:18.098 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:18.098 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::8c72:9ff:fe74:8c7e/64 scope link 2023-10-07T08:43:18.098 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:18.098 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:43:18.098 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:fe:81:9d:9c:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T08:43:18.098 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8fe:81ff:fe9d:9c0a/64 scope link tentative 2023-10-07T08:43:18.099 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:18.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:18.099 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:43:18.156 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-07T08:43:18.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:18.158 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-07T08:43:18.214 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-07T08:43:18.214 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:43:18.214 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:43:18.214 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:43:18.214 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:43:18.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:18.215 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:43:18.215 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:43:18.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:43:18.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:43:18.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:43:18.215 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:43:18.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:18.314 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-07T08:43:18.328 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T08:43:18.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:18.329 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2023-10-07T08:43:18.384 INFO:teuthology.orchestra.run.smithi081.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-07T08:43:18.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:18.384 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:43:18.384 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:43:18.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T08:43:18.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-07T08:43:18.384 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:43:18.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:18.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-07T08:43:18.506 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:43:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:43:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:43:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-07T08:43:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:18.507 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:43:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:2e:fc:ab:ea:5a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-07T08:43:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-07T08:43:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d82e:fcff:feab:ea5a/64 scope link tentative 2023-10-07T08:43:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:18.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:18.516 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-07T08:43:18.599 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:43:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:43:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:43:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-07T08:43:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:18.600 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:43:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:2e:fc:ab:ea:5a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-07T08:43:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-07T08:43:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d82e:fcff:feab:ea5a/64 scope link tentative 2023-10-07T08:43:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:18.619 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-07T08:43:18.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:18.620 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:43:18.620 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:43:18.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-07T08:43:18.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-07T08:43:18.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-07T08:43:18.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-07T08:43:18.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-07T08:43:18.620 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:43:18.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:18.832 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:43:18.833 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:43:18.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.1 up 2023-10-07T08:43:18.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.1 master ceph-brx 2023-10-07T08:43:18.833 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:43:18.912 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:43:18.912 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-07T08:43:18.927 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-07T08:43:18.928 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:43:18.928 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-07T08:43:18.983 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:43:18.983 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:43:18.984 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-07T08:43:19.063 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-07T08:43:19.063 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-07T08:43:19.063 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:43:19.072 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-07T08:43:19.072 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-07T08:43:19.072 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:43:19.072 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:43:19.072 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:43:19.094 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-07T08:43:19.094 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-07T08:43:19.094 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:43:19.094 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:43:19.094 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:43:19.094 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:43:19.094 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:43:19.095 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:43:19.096 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:43:19.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:19.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-07T08:43:19.160 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-10-07T08:43:19.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:43:19.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.314+0000 7f812359e700 1 Processor -- start 2023-10-07T08:43:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.314+0000 7f812359e700 1 -- start start 2023-10-07T08:43:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.315+0000 7f812359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8124159b40 0x7f81240cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.315+0000 7f812359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8124068e90 0x7f81240cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.315+0000 7f812359e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81240cee10 con 0x7f8124159f10 2023-10-07T08:43:19.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.315+0000 7f812359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81240cd040 con 0x7f8124068e90 2023-10-07T08:43:19.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.315+0000 7f812359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81240cd320 con 0x7f8124159b40 2023-10-07T08:43:19.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.315+0000 7f8122d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8124068e90 0x7f81240cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:19.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.315+0000 7f8122d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8124068e90 0x7f81240cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39262/0 (socket says 172.21.15.81:39262) 2023-10-07T08:43:19.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.315+0000 7f8122d9d700 1 -- 172.21.15.81:0/1744889248 learned_addr learned my addr 172.21.15.81:0/1744889248 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:19.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.315+0000 7f812259c700 1 --2- 172.21.15.81:0/1744889248 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8124159b40 0x7f81240cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:19.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.315+0000 7f8122d9d700 1 -- 172.21.15.81:0/1744889248 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8124159b40 msgr2=0x7f81240cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:19.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.315+0000 7f8122d9d700 1 --2- 172.21.15.81:0/1744889248 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8124159b40 0x7f81240cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:19.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.315+0000 7f8122d9d700 1 -- 172.21.15.81:0/1744889248 >> v1:172.21.15.89:6789/0 conn(0x7f8124159f10 legacy=0x7f8124068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:19.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.315+0000 7f8122d9d700 1 -- 172.21.15.81:0/1744889248 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81240ce7c0 con 0x7f8124068e90 2023-10-07T08:43:19.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.315+0000 7f8122d9d700 1 --2- 172.21.15.81:0/1744889248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8124068e90 0x7f81240cf2a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f811c009f20 tx=0x7f811c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e876eba90cfb5a70 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:19.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.315+0000 7f812159a700 1 -- 172.21.15.81:0/1744889248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c00e070 con 0x7f8124068e90 2023-10-07T08:43:19.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.316+0000 7f812159a700 1 -- 172.21.15.81:0/1744889248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c00ba40 con 0x7f8124068e90 2023-10-07T08:43:19.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.316+0000 7f812159a700 1 -- 172.21.15.81:0/1744889248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c0092e0 con 0x7f8124068e90 2023-10-07T08:43:19.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.316+0000 7f812359e700 1 -- 172.21.15.81:0/1744889248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8124068e90 msgr2=0x7f81240cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:19.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.316+0000 7f812359e700 1 --2- 172.21.15.81:0/1744889248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8124068e90 0x7f81240cf2a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f811c009f20 tx=0x7f811c009840 comp rx=0 tx=0).stop 2023-10-07T08:43:19.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.316+0000 7f812359e700 1 -- 172.21.15.81:0/1744889248 shutdown_connections 2023-10-07T08:43:19.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.316+0000 7f812359e700 1 --2- 172.21.15.81:0/1744889248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8124068e90 0x7f81240cf2a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:19.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.316+0000 7f812359e700 1 --2- 172.21.15.81:0/1744889248 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8124159b40 0x7f81240cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:19.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.316+0000 7f812359e700 1 -- 172.21.15.81:0/1744889248 >> 172.21.15.81:0/1744889248 conn(0x7f81240cd660 msgr2=0x7f81240cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:19.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.316+0000 7f812359e700 1 -- 172.21.15.81:0/1744889248 shutdown_connections 2023-10-07T08:43:19.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.316+0000 7f812359e700 1 -- 172.21.15.81:0/1744889248 wait complete. 2023-10-07T08:43:19.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.317+0000 7f812359e700 1 Processor -- start 2023-10-07T08:43:19.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.317+0000 7f812359e700 1 -- start start 2023-10-07T08:43:19.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f812359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8124068e90 0x7f812415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:19.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f812359e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8124159b40 0x7f81240c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:19.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f812359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8124159f10 0x7f8124154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:19.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f812359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812415ab90 con 0x7f8124068e90 2023-10-07T08:43:19.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f812359e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812415ae70 con 0x7f8124159b40 2023-10-07T08:43:19.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f812359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812415b150 con 0x7f8124159f10 2023-10-07T08:43:19.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f812259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8124068e90 0x7f812415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:19.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f812259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8124068e90 0x7f812415a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39264/0 (socket says 172.21.15.81:39264) 2023-10-07T08:43:19.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f812259c700 1 -- 172.21.15.81:0/2400952636 learned_addr learned my addr 172.21.15.81:0/2400952636 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:19.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f8121d9b700 1 --2- 172.21.15.81:0/2400952636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8124159b40 0x7f81240c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:19.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f8122d9d700 1 --2- 172.21.15.81:0/2400952636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8124159f10 0x7f8124154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:19.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f812259c700 1 -- 172.21.15.81:0/2400952636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8124159f10 msgr2=0x7f8124154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:19.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f812259c700 1 --2- 172.21.15.81:0/2400952636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8124159f10 0x7f8124154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:19.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f812259c700 1 -- 172.21.15.81:0/2400952636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8124159b40 msgr2=0x7f81240c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:19.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f812259c700 1 --2- 172.21.15.81:0/2400952636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8124159b40 0x7f81240c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:19.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f812259c700 1 -- 172.21.15.81:0/2400952636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c009ae0 con 0x7f8124068e90 2023-10-07T08:43:19.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.318+0000 7f812259c700 1 --2- 172.21.15.81:0/2400952636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8124068e90 0x7f812415a340 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f811400d890 tx=0x7f8114008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:19.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.319+0000 7f81127fc700 1 -- 172.21.15.81:0/2400952636 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140125f0 con 0x7f8124068e90 2023-10-07T08:43:19.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.319+0000 7f81127fc700 1 -- 172.21.15.81:0/2400952636 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8114012770 con 0x7f8124068e90 2023-10-07T08:43:19.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.319+0000 7f812359e700 1 -- 172.21.15.81:0/2400952636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812415b430 con 0x7f8124068e90 2023-10-07T08:43:19.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.319+0000 7f81127fc700 1 -- 172.21.15.81:0/2400952636 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114012b30 con 0x7f8124068e90 2023-10-07T08:43:19.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.319+0000 7f812359e700 1 -- 172.21.15.81:0/2400952636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812415a880 con 0x7f8124068e90 2023-10-07T08:43:19.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.320+0000 7f812359e700 1 -- 172.21.15.81:0/2400952636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812415b950 con 0x7f8124068e90 2023-10-07T08:43:19.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.320+0000 7f81127fc700 1 -- 172.21.15.81:0/2400952636 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f811401e460 con 0x7f8124068e90 2023-10-07T08:43:19.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.320+0000 7f81127fc700 1 --2- 172.21.15.81:0/2400952636 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8104066f30 0x7f81040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:19.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.320+0000 7f81127fc700 1 -- 172.21.15.81:0/2400952636 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8114084ab0 con 0x7f8124068e90 2023-10-07T08:43:19.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.320+0000 7f8121d9b700 1 --2- 172.21.15.81:0/2400952636 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8104066f30 0x7f81040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:19.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.321+0000 7f8121d9b700 1 --2- 172.21.15.81:0/2400952636 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8104066f30 0x7f81040693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f81240b2e00 tx=0x7f8118009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:19.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.325+0000 7f81127fc700 1 -- 172.21.15.81:0/2400952636 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f812415b950 con 0x7f8124068e90 2023-10-07T08:43:19.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.550+0000 7f812359e700 1 -- 172.21.15.81:0/2400952636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f812415b950 con 0x7f8124068e90 2023-10-07T08:43:19.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.550+0000 7f81127fc700 1 -- 172.21.15.81:0/2400952636 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f81140557b0 con 0x7f8124068e90 2023-10-07T08:43:19.551 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:43:19.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.553+0000 7f812359e700 1 -- 172.21.15.81:0/2400952636 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8104066f30 msgr2=0x7f81040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:19.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.553+0000 7f812359e700 1 --2- 172.21.15.81:0/2400952636 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8104066f30 0x7f81040693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f81240b2e00 tx=0x7f8118009060 comp rx=0 tx=0).stop 2023-10-07T08:43:19.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.553+0000 7f812359e700 1 -- 172.21.15.81:0/2400952636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8124068e90 msgr2=0x7f812415a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:19.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.553+0000 7f812359e700 1 --2- 172.21.15.81:0/2400952636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8124068e90 0x7f812415a340 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f811400d890 tx=0x7f8114008040 comp rx=0 tx=0).stop 2023-10-07T08:43:19.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.553+0000 7f812359e700 1 -- 172.21.15.81:0/2400952636 shutdown_connections 2023-10-07T08:43:19.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.553+0000 7f812359e700 1 --2- 172.21.15.81:0/2400952636 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8104066f30 0x7f81040693e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:19.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.553+0000 7f812359e700 1 --2- 172.21.15.81:0/2400952636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8124159f10 0x7f8124154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:19.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.553+0000 7f812359e700 1 --2- 172.21.15.81:0/2400952636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8124068e90 0x7f812415a340 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:19.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.553+0000 7f812359e700 1 --2- 172.21.15.81:0/2400952636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8124159b40 0x7f81240c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:19.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.553+0000 7f812359e700 1 -- 172.21.15.81:0/2400952636 >> 172.21.15.81:0/2400952636 conn(0x7f81240cd660 msgr2=0x7f81240cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:19.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.553+0000 7f812359e700 1 -- 172.21.15.81:0/2400952636 shutdown_connections 2023-10-07T08:43:19.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:19.553+0000 7f812359e700 1 -- 172.21.15.81:0/2400952636 wait complete. 2023-10-07T08:43:19.565 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-07T08:43:19.565 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:43:19.565 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-07T08:43:19.565 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T08:43:19.565 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T08:43:19.565 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-07T08:43:19.565 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-07T08:43:19.565 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:43:19.566 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:43:19.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:19.566 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-07T08:43:19.585 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:43:19.586 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:43:19.586 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:43:19.586 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:19.586 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-07T08:43:19.586 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:19.586 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:19.586 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:19.586 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-10-07T08:43:19.587 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:19.587 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:19.587 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-10-07T08:43:19.587 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:19.587 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:19.587 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:43:19.587 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:19.587 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:43:19.587 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42529sec preferred_lft 42529sec 2023-10-07T08:43:19.588 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2023-10-07T08:43:19.588 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:19.588 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-07T08:43:19.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:19.588 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:43:19.589 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:43:19.589 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add name ceph-brx type bridge 2023-10-07T08:43:19.589 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr flush dev ceph-brx 2023-10-07T08:43:19.589 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set ceph-brx up 2023-10-07T08:43:19.589 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-07T08:43:19.589 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:43:19.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:19.759 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:43:19.800 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-07T08:43:19.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:19.802 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-07T08:43:19.877 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-07T08:43:19.877 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:43:19.877 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:43:19.877 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:43:19.877 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:43:19.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:19.877 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:43:19.878 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:43:19.878 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:43:19.878 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:43:19.878 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:43:19.878 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:43:20.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:20.112 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-07T08:43:20.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:20.127 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2023-10-07T08:43:20.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:20.182 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:43:20.182 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:43:20.182 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T08:43:20.182 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-07T08:43:20.182 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:43:20.273 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-07T08:43:20.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:20.273 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:43:20.273 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:43:20.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-07T08:43:20.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-07T08:43:20.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-07T08:43:20.274 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-07T08:43:20.274 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-07T08:43:20.274 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:43:20.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:20.471 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:43:20.471 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:43:20.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-07T08:43:20.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.0 master ceph-brx 2023-10-07T08:43:20.472 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:43:20.563 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:43:20.563 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T08:43:20.577 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:43:20.578 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:43:20.578 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:43:20.632 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:43:20.633 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:43:20.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:43:20.721 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:43:20.721 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:43:20.721 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:43:20.796 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:43:20.796 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:43:20.796 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:43:20.796 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:43:20.796 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:43:20.817 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:43:20.817 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:43:20.817 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:43:20.817 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:43:20.817 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:43:20.817 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:43:20.817 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:43:20.818 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:43:20.820 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:43:20.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:20.820 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:43:20.844 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-10-07T08:43:20.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:43:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.969+0000 7f702359e700 1 Processor -- start 2023-10-07T08:43:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.969+0000 7f702359e700 1 -- start start 2023-10-07T08:43:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.970+0000 7f702359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70240c28e0 0x7f7024158340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.970+0000 7f702359e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f70241513b0 0x7f7024157110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.970+0000 7f702359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7024069810 con 0x7f70240c2cb0 2023-10-07T08:43:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.970+0000 7f702359e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70241581b0 con 0x7f70241513b0 2023-10-07T08:43:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.970+0000 7f702359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7024068f20 con 0x7f70240c28e0 2023-10-07T08:43:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.970+0000 7f701bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f70240c2cb0 0x7f7024150ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39596/0 (socket says 172.21.15.81:39596) 2023-10-07T08:43:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.970+0000 7f701bfff700 1 -- 172.21.15.81:0/2843895539 learned_addr learned my addr 172.21.15.81:0/2843895539 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.970+0000 7f702259c700 1 --2- 172.21.15.81:0/2843895539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70240c28e0 0x7f7024158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.970+0000 7f7022d9d700 1 --2- 172.21.15.81:0/2843895539 >> v2:172.21.15.89:3300/0 conn(0x7f70241513b0 0x7f7024157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.970+0000 7f7021d9b700 1 -- 172.21.15.81:0/2843895539 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995114535 0 0) 0x7f7024069810 con 0x7f70240c2cb0 2023-10-07T08:43:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.970+0000 7f7021d9b700 1 -- 172.21.15.81:0/2843895539 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7010003570 con 0x7f70240c2cb0 2023-10-07T08:43:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.971+0000 7f702259c700 1 -- 172.21.15.81:0/2843895539 >> v2:172.21.15.89:3300/0 conn(0x7f70241513b0 msgr2=0x7f7024157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.971+0000 7f702259c700 1 --2- 172.21.15.81:0/2843895539 >> v2:172.21.15.89:3300/0 conn(0x7f70241513b0 0x7f7024157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.971+0000 7f702259c700 1 -- 172.21.15.81:0/2843895539 >> v1:172.21.15.81:6789/0 conn(0x7f70240c2cb0 legacy=0x7f7024150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.971+0000 7f702259c700 1 -- 172.21.15.81:0/2843895539 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7024157ed0 con 0x7f70240c28e0 2023-10-07T08:43:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.971+0000 7f7022d9d700 1 --2- 172.21.15.81:0/2843895539 >> v2:172.21.15.89:3300/0 conn(0x7f70241513b0 0x7f7024157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.971+0000 7f702259c700 1 --2- 172.21.15.81:0/2843895539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70240c28e0 0x7f7024158340 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f70140098e0 tx=0x7f70140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f28914ae413910dc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.971+0000 7f7021d9b700 1 -- 172.21.15.81:0/2843895539 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7014011630 con 0x7f70240c28e0 2023-10-07T08:43:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.971+0000 7f7021d9b700 1 -- 172.21.15.81:0/2843895539 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7014011790 con 0x7f70240c28e0 2023-10-07T08:43:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.971+0000 7f7021d9b700 1 -- 172.21.15.81:0/2843895539 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7014011b30 con 0x7f70240c28e0 2023-10-07T08:43:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.971+0000 7f702359e700 1 -- 172.21.15.81:0/2843895539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70240c28e0 msgr2=0x7f7024158340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.971+0000 7f702359e700 1 --2- 172.21.15.81:0/2843895539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70240c28e0 0x7f7024158340 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f70140098e0 tx=0x7f70140091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.971+0000 7f702359e700 1 -- 172.21.15.81:0/2843895539 shutdown_connections 2023-10-07T08:43:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.971+0000 7f702359e700 1 --2- 172.21.15.81:0/2843895539 >> v2:172.21.15.89:3300/0 conn(0x7f70241513b0 0x7f7024157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.972+0000 7f702359e700 1 --2- 172.21.15.81:0/2843895539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70240c28e0 0x7f7024158340 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.972+0000 7f702359e700 1 -- 172.21.15.81:0/2843895539 >> 172.21.15.81:0/2843895539 conn(0x7f70240cd2b0 msgr2=0x7f70240c9250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:20.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.972+0000 7f702359e700 1 -- 172.21.15.81:0/2843895539 shutdown_connections 2023-10-07T08:43:20.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.972+0000 7f702359e700 1 -- 172.21.15.81:0/2843895539 wait complete. 2023-10-07T08:43:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.973+0000 7f702359e700 1 Processor -- start 2023-10-07T08:43:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.973+0000 7f702359e700 1 -- start start 2023-10-07T08:43:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.973+0000 7f702359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70240c28e0 0x7f70241457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.973+0000 7f702359e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70240c2cb0 0x7f7024165d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.973+0000 7f702359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70241513b0 0x7f7024146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.973+0000 7f702359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70240b0c90 con 0x7f70240c28e0 2023-10-07T08:43:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.973+0000 7f702359e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70240b0f70 con 0x7f70240c2cb0 2023-10-07T08:43:20.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.973+0000 7f702359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70240b1250 con 0x7f70241513b0 2023-10-07T08:43:20.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.973+0000 7f702259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70240c28e0 0x7f70241457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:20.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.973+0000 7f702259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70240c28e0 0x7f70241457f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39266/0 (socket says 172.21.15.81:39266) 2023-10-07T08:43:20.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.973+0000 7f702259c700 1 -- 172.21.15.81:0/1028772373 learned_addr learned my addr 172.21.15.81:0/1028772373 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:20.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.974+0000 7f701bfff700 1 --2- 172.21.15.81:0/1028772373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70240c2cb0 0x7f7024165d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.974+0000 7f7022d9d700 1 --2- 172.21.15.81:0/1028772373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70241513b0 0x7f7024146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.974+0000 7f702259c700 1 -- 172.21.15.81:0/1028772373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70241513b0 msgr2=0x7f7024146ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.974+0000 7f702259c700 1 --2- 172.21.15.81:0/1028772373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70241513b0 0x7f7024146ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.974+0000 7f702259c700 1 -- 172.21.15.81:0/1028772373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70240c2cb0 msgr2=0x7f7024165d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.974+0000 7f702259c700 1 --2- 172.21.15.81:0/1028772373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70240c2cb0 0x7f7024165d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.974+0000 7f702259c700 1 -- 172.21.15.81:0/1028772373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c009a20 con 0x7f70240c28e0 2023-10-07T08:43:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.974+0000 7f7022d9d700 1 --2- 172.21.15.81:0/1028772373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70241513b0 0x7f7024146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.974+0000 7f702259c700 1 --2- 172.21.15.81:0/1028772373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70240c28e0 0x7f70241457f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7024065bb0 tx=0x7f7014017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.974+0000 7f701a7fc700 1 -- 172.21.15.81:0/1028772373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7014011b10 con 0x7f70240c28e0 2023-10-07T08:43:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.974+0000 7f701a7fc700 1 -- 172.21.15.81:0/1028772373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7014000cc0 con 0x7f70240c28e0 2023-10-07T08:43:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.974+0000 7f702359e700 1 -- 172.21.15.81:0/1028772373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7014009420 con 0x7f70240c28e0 2023-10-07T08:43:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.974+0000 7f701a7fc700 1 -- 172.21.15.81:0/1028772373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7014025620 con 0x7f70240c28e0 2023-10-07T08:43:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.974+0000 7f702359e700 1 -- 172.21.15.81:0/1028772373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7024147960 con 0x7f70240c28e0 2023-10-07T08:43:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.975+0000 7f702359e700 1 -- 172.21.15.81:0/1028772373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7024063c90 con 0x7f70240c28e0 2023-10-07T08:43:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.975+0000 7f701a7fc700 1 -- 172.21.15.81:0/1028772373 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7014025a10 con 0x7f70240c28e0 2023-10-07T08:43:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.976+0000 7f701a7fc700 1 --2- 172.21.15.81:0/1028772373 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7004066f30 0x7f70040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.976+0000 7f701a7fc700 1 -- 172.21.15.81:0/1028772373 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7014085d50 con 0x7f70240c28e0 2023-10-07T08:43:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.976+0000 7f701bfff700 1 --2- 172.21.15.81:0/1028772373 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7004066f30 0x7f70040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.976+0000 7f701bfff700 1 --2- 172.21.15.81:0/1028772373 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7004066f30 0x7f70040693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7024149310 tx=0x7f700c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:20.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:20.980+0000 7f701a7fc700 1 -- 172.21.15.81:0/1028772373 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7014089030 con 0x7f70240c28e0 2023-10-07T08:43:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:21.205+0000 7f702359e700 1 -- 172.21.15.81:0/1028772373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f70240b0dd0 con 0x7f70240c28e0 2023-10-07T08:43:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:21.205+0000 7f701a7fc700 1 -- 172.21.15.81:0/1028772373 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f70240b0dd0 con 0x7f70240c28e0 2023-10-07T08:43:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:43:21.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:21.207+0000 7f702359e700 1 -- 172.21.15.81:0/1028772373 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7004066f30 msgr2=0x7f70040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:21.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:21.207+0000 7f702359e700 1 --2- 172.21.15.81:0/1028772373 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7004066f30 0x7f70040693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7024149310 tx=0x7f700c009040 comp rx=0 tx=0).stop 2023-10-07T08:43:21.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:21.207+0000 7f702359e700 1 -- 172.21.15.81:0/1028772373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70240c28e0 msgr2=0x7f70241457f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:21.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:21.207+0000 7f702359e700 1 --2- 172.21.15.81:0/1028772373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70240c28e0 0x7f70241457f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7024065bb0 tx=0x7f7014017000 comp rx=0 tx=0).stop 2023-10-07T08:43:21.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:21.207+0000 7f702359e700 1 -- 172.21.15.81:0/1028772373 shutdown_connections 2023-10-07T08:43:21.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:21.207+0000 7f702359e700 1 --2- 172.21.15.81:0/1028772373 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7004066f30 0x7f70040693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:21.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:21.207+0000 7f702359e700 1 --2- 172.21.15.81:0/1028772373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70241513b0 0x7f7024146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:21.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:21.207+0000 7f702359e700 1 --2- 172.21.15.81:0/1028772373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70240c28e0 0x7f70241457f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:21.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:21.207+0000 7f702359e700 1 --2- 172.21.15.81:0/1028772373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70240c2cb0 0x7f7024165d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:21.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:21.207+0000 7f702359e700 1 -- 172.21.15.81:0/1028772373 >> 172.21.15.81:0/1028772373 conn(0x7f70240cd2b0 msgr2=0x7f70240c1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:21.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:21.207+0000 7f702359e700 1 -- 172.21.15.81:0/1028772373 shutdown_connections 2023-10-07T08:43:21.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:21.207+0000 7f702359e700 1 -- 172.21.15.81:0/1028772373 wait complete. 2023-10-07T08:43:21.219 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-07T08:43:21.220 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:43:21.220 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-07T08:43:21.220 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-07T08:43:21.220 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-07T08:43:21.220 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-07T08:43:21.220 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-07T08:43:21.220 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:43:21.220 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-07T08:43:21.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:21.221 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-07T08:43:21.236 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:43:21.236 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:43:21.236 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:43:21.236 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:21.236 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-07T08:43:21.237 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:21.237 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:21.237 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:21.237 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-10-07T08:43:21.237 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:21.237 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:21.237 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-10-07T08:43:21.237 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:21.237 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:21.237 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:43:21.237 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:21.237 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:43:21.238 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42527sec preferred_lft 42527sec 2023-10-07T08:43:21.238 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2023-10-07T08:43:21.238 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:21.238 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:43:21.238 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:21.238 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:43:21.238 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:21.238 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::74d7:a9ff:fe87:ed9/64 scope link tentative 2023-10-07T08:43:21.238 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:21.238 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:43:21.238 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T08:43:21.238 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6c40:c5ff:fe3a:a57/64 scope link tentative 2023-10-07T08:43:21.239 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:21.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:21.239 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:43:21.301 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-07T08:43:21.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:21.303 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-07T08:43:21.358 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-07T08:43:21.359 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:43:21.359 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:43:21.359 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:43:21.359 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:43:21.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:21.359 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:43:21.359 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:43:21.360 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:43:21.360 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:43:21.360 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:43:21.360 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:43:21.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:21.459 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-07T08:43:21.474 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T08:43:21.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:21.475 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2023-10-07T08:43:21.529 INFO:teuthology.orchestra.run.smithi089.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-07T08:43:21.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:21.529 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:43:21.530 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:43:21.530 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T08:43:21.530 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-07T08:43:21.530 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:43:21.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:21.618 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-07T08:43:21.655 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:43:21.656 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:43:21.656 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:43:21.656 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:21.656 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-07T08:43:21.656 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:21.656 INFO:teuthology.orchestra.run.smithi089.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:43:21.656 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether c6:9a:33:d5:04:94 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-07T08:43:21.656 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-07T08:43:21.656 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:21.656 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::c49a:33ff:fed5:494/64 scope link tentative 2023-10-07T08:43:21.656 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:21.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:21.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-07T08:43:21.753 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:43:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:43:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:43:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-07T08:43:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:21.754 INFO:teuthology.orchestra.run.smithi089.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:43:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether c6:9a:33:d5:04:94 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-07T08:43:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-07T08:43:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::c49a:33ff:fed5:494/64 scope link tentative 2023-10-07T08:43:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:21.764 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-07T08:43:21.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:21.765 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:43:21.765 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:43:21.765 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-07T08:43:21.765 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-07T08:43:21.765 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-07T08:43:21.765 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-07T08:43:21.765 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-07T08:43:21.766 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:43:21.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:21.938 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:43:21.938 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:43:21.938 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.1 up 2023-10-07T08:43:21.938 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.1 master ceph-brx 2023-10-07T08:43:21.938 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:43:22.017 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:43:22.018 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-07T08:43:22.031 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-07T08:43:22.032 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:43:22.032 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-07T08:43:22.085 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:43:22.086 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:43:22.086 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-07T08:43:22.165 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-07T08:43:22.165 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-07T08:43:22.165 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:43:22.173 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-07T08:43:22.173 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-07T08:43:22.173 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:43:22.174 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:43:22.174 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:43:22.195 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-07T08:43:22.195 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-07T08:43:22.195 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:43:22.195 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:43:22.195 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:43:22.195 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:43:22.195 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:43:22.196 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:43:22.197 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:43:22.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:22.197 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-07T08:43:22.261 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-07T08:43:22.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:22.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.405+0000 7eff29557700 1 Processor -- start 2023-10-07T08:43:22.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.405+0000 7eff29557700 1 -- start start 2023-10-07T08:43:22.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff29557700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff240c8980 0x7eff240aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:22.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff29557700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2406d350 con 0x7eff2415daa0 2023-10-07T08:43:22.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff29557700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff240c9ac0 con 0x7eff240cae00 2023-10-07T08:43:22.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff29557700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2406c740 con 0x7eff240c8980 2023-10-07T08:43:22.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff22ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7eff2415daa0 0x7eff2415de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52988/0 (socket says 172.21.15.81:52988) 2023-10-07T08:43:22.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff22ffd700 1 -- 172.21.15.81:0/2145042245 learned_addr learned my addr 172.21.15.81:0/2145042245 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:22.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff237fe700 1 --2- 172.21.15.81:0/2145042245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff240c8980 0x7eff240aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:22.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff21ffb700 1 -- 172.21.15.81:0/2145042245 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368425776 0 0) 0x7eff2406d350 con 0x7eff2415daa0 2023-10-07T08:43:22.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff21ffb700 1 -- 172.21.15.81:0/2145042245 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff0c003570 con 0x7eff2415daa0 2023-10-07T08:43:22.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff21ffb700 1 -- 172.21.15.81:0/2145042245 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483951721 0 0) 0x7eff240c9ac0 con 0x7eff240cae00 2023-10-07T08:43:22.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff21ffb700 1 -- 172.21.15.81:0/2145042245 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff2406d350 con 0x7eff240cae00 2023-10-07T08:43:22.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff237fe700 1 -- 172.21.15.81:0/2145042245 >> v1:172.21.15.89:6789/0 conn(0x7eff240cae00 legacy=0x7eff240aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:22.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff237fe700 1 -- 172.21.15.81:0/2145042245 >> v1:172.21.15.81:6789/0 conn(0x7eff2415daa0 legacy=0x7eff2415de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:22.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff237fe700 1 -- 172.21.15.81:0/2145042245 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2406ca20 con 0x7eff240c8980 2023-10-07T08:43:22.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff237fe700 1 --2- 172.21.15.81:0/2145042245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff240c8980 0x7eff240aafa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff1c009e90 tx=0x7eff1c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aff1e1d1a27c3cb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:22.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff21ffb700 1 -- 172.21.15.81:0/2145042245 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00e070 con 0x7eff240c8980 2023-10-07T08:43:22.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.406+0000 7eff21ffb700 1 -- 172.21.15.81:0/2145042245 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c00bb80 con 0x7eff240c8980 2023-10-07T08:43:22.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.407+0000 7eff21ffb700 1 -- 172.21.15.81:0/2145042245 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c012430 con 0x7eff240c8980 2023-10-07T08:43:22.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.407+0000 7eff29557700 1 -- 172.21.15.81:0/2145042245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff240c8980 msgr2=0x7eff240aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:22.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.407+0000 7eff29557700 1 --2- 172.21.15.81:0/2145042245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff240c8980 0x7eff240aafa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff1c009e90 tx=0x7eff1c009780 comp rx=0 tx=0).stop 2023-10-07T08:43:22.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.407+0000 7eff29557700 1 -- 172.21.15.81:0/2145042245 shutdown_connections 2023-10-07T08:43:22.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.407+0000 7eff29557700 1 --2- 172.21.15.81:0/2145042245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff240c8980 0x7eff240aafa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.407+0000 7eff29557700 1 -- 172.21.15.81:0/2145042245 >> 172.21.15.81:0/2145042245 conn(0x7eff240c9ca0 msgr2=0x7eff240ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:22.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.407+0000 7eff29557700 1 -- 172.21.15.81:0/2145042245 shutdown_connections 2023-10-07T08:43:22.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.407+0000 7eff29557700 1 -- 172.21.15.81:0/2145042245 wait complete. 2023-10-07T08:43:22.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.408+0000 7eff29557700 1 Processor -- start 2023-10-07T08:43:22.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.408+0000 7eff29557700 1 -- start start 2023-10-07T08:43:22.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.409+0000 7eff29557700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff240c8980 0x7eff2414cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:22.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.409+0000 7eff29557700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff240cae00 0x7eff240c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:22.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.409+0000 7eff29557700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff2415daa0 0x7eff240ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.409+0000 7eff29557700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff240abb40 con 0x7eff2415daa0 2023-10-07T08:43:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.409+0000 7eff29557700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2414d300 con 0x7eff240c8980 2023-10-07T08:43:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.409+0000 7eff29557700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff240ae740 con 0x7eff240cae00 2023-10-07T08:43:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.409+0000 7eff237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff2415daa0 0x7eff240ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.409+0000 7eff237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff2415daa0 0x7eff240ac140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46206/0 (socket says 172.21.15.81:46206) 2023-10-07T08:43:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.409+0000 7eff237fe700 1 -- 172.21.15.81:0/2331728058 learned_addr learned my addr 172.21.15.81:0/2331728058 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.409+0000 7eff22ffd700 1 --2- 172.21.15.81:0/2331728058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff240c8980 0x7eff2414cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.409+0000 7eff227fc700 1 --2- 172.21.15.81:0/2331728058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff240cae00 0x7eff240c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.409+0000 7eff237fe700 1 -- 172.21.15.81:0/2331728058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff240cae00 msgr2=0x7eff240c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.410+0000 7eff237fe700 1 --2- 172.21.15.81:0/2331728058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff240cae00 0x7eff240c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.410+0000 7eff237fe700 1 -- 172.21.15.81:0/2331728058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff240c8980 msgr2=0x7eff2414cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.410+0000 7eff237fe700 1 --2- 172.21.15.81:0/2331728058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff240c8980 0x7eff2414cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.410+0000 7eff237fe700 1 -- 172.21.15.81:0/2331728058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c009a20 con 0x7eff2415daa0 2023-10-07T08:43:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.410+0000 7eff237fe700 1 --2- 172.21.15.81:0/2331728058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff2415daa0 0x7eff240ac140 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00b610 tx=0x7eff1c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.410+0000 7eff0affd700 1 -- 172.21.15.81:0/2331728058 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c026480 con 0x7eff2415daa0 2023-10-07T08:43:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.410+0000 7eff0affd700 1 -- 172.21.15.81:0/2331728058 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c026600 con 0x7eff2415daa0 2023-10-07T08:43:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.410+0000 7eff29557700 1 -- 172.21.15.81:0/2331728058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff240ae130 con 0x7eff2415daa0 2023-10-07T08:43:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.410+0000 7eff0affd700 1 -- 172.21.15.81:0/2331728058 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c0269c0 con 0x7eff2415daa0 2023-10-07T08:43:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.410+0000 7eff29557700 1 -- 172.21.15.81:0/2331728058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff240ab860 con 0x7eff2415daa0 2023-10-07T08:43:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.411+0000 7eff29557700 1 -- 172.21.15.81:0/2331728058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff24068080 con 0x7eff2415daa0 2023-10-07T08:43:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.411+0000 7eff0affd700 1 -- 172.21.15.81:0/2331728058 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff1c01c400 con 0x7eff2415daa0 2023-10-07T08:43:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.411+0000 7eff0affd700 1 --2- 172.21.15.81:0/2331728058 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff10066f30 0x7eff100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.412+0000 7eff0affd700 1 -- 172.21.15.81:0/2331728058 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff1c0867a0 con 0x7eff2415daa0 2023-10-07T08:43:22.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.412+0000 7eff22ffd700 1 --2- 172.21.15.81:0/2331728058 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff10066f30 0x7eff100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:22.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.412+0000 7eff22ffd700 1 --2- 172.21.15.81:0/2331728058 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff10066f30 0x7eff100693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff14007fd0 tx=0x7eff14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:22.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.416+0000 7eff0affd700 1 -- 172.21.15.81:0/2331728058 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff1c053a10 con 0x7eff2415daa0 2023-10-07T08:43:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.599+0000 7eff29557700 1 -- 172.21.15.81:0/2331728058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff2404bb80 con 0x7eff2415daa0 2023-10-07T08:43:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.600+0000 7eff0affd700 1 -- 172.21.15.81:0/2331728058 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7eff1c057030 con 0x7eff2415daa0 2023-10-07T08:43:22.603 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:22.603 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:58.248338+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:42:54.397263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:42:55.595133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:22.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.602+0000 7eff29557700 1 -- 172.21.15.81:0/2331728058 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff10066f30 msgr2=0x7eff100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:22.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.602+0000 7eff29557700 1 --2- 172.21.15.81:0/2331728058 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff10066f30 0x7eff100693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff14007fd0 tx=0x7eff14009040 comp rx=0 tx=0).stop 2023-10-07T08:43:22.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.602+0000 7eff29557700 1 -- 172.21.15.81:0/2331728058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff2415daa0 msgr2=0x7eff240ac140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:22.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.602+0000 7eff29557700 1 --2- 172.21.15.81:0/2331728058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff2415daa0 0x7eff240ac140 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00b610 tx=0x7eff1c019000 comp rx=0 tx=0).stop 2023-10-07T08:43:22.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.602+0000 7eff29557700 1 -- 172.21.15.81:0/2331728058 shutdown_connections 2023-10-07T08:43:22.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.602+0000 7eff29557700 1 --2- 172.21.15.81:0/2331728058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff2415daa0 0x7eff240ac140 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.602+0000 7eff29557700 1 --2- 172.21.15.81:0/2331728058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff240c8980 0x7eff2414cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.602+0000 7eff29557700 1 --2- 172.21.15.81:0/2331728058 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff10066f30 0x7eff100693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.602+0000 7eff29557700 1 --2- 172.21.15.81:0/2331728058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff240cae00 0x7eff240c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.602+0000 7eff29557700 1 -- 172.21.15.81:0/2331728058 >> 172.21.15.81:0/2331728058 conn(0x7eff240c9ca0 msgr2=0x7eff2415b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.602+0000 7eff29557700 1 -- 172.21.15.81:0/2331728058 shutdown_connections 2023-10-07T08:43:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.602+0000 7eff29557700 1 -- 172.21.15.81:0/2331728058 wait complete. 2023-10-07T08:43:22.614 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:42:54.397263+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:42:55.595133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:43:22.614 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:43:22.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.731+0000 7fcd82300700 1 Processor -- start 2023-10-07T08:43:22.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.731+0000 7fcd82300700 1 -- start start 2023-10-07T08:43:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.732+0000 7fcd82300700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd7c1578d0 0x7fcd7c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.732+0000 7fcd82300700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd7c157ca0 0x7fcd7c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.732+0000 7fcd82300700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c0d07c0 con 0x7fcd7c06d120 2023-10-07T08:43:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.732+0000 7fcd82300700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c0cfbb0 con 0x7fcd7c1578d0 2023-10-07T08:43:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.732+0000 7fcd82300700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0cfe90 con 0x7fcd7c157ca0 2023-10-07T08:43:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.732+0000 7fcd7bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd7c1578d0 0x7fcd7c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.732+0000 7fcd8089d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fcd7c06d120 0x7fcd7c15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:40958/0 (socket says 172.21.15.81:40958) 2023-10-07T08:43:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.732+0000 7fcd7bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd7c1578d0 0x7fcd7c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46218/0 (socket says 172.21.15.81:46218) 2023-10-07T08:43:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.732+0000 7fcd8089d700 1 -- 172.21.15.81:0/3917352619 learned_addr learned my addr 172.21.15.81:0/3917352619 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.732+0000 7fcd7b7fe700 1 --2- 172.21.15.81:0/3917352619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd7c157ca0 0x7fcd7c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.732+0000 7fcd7affd700 1 -- 172.21.15.81:0/3917352619 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820103969 0 0) 0x7fcd7c0d07c0 con 0x7fcd7c06d120 2023-10-07T08:43:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.732+0000 7fcd7bfff700 1 -- 172.21.15.81:0/3917352619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd7c157ca0 msgr2=0x7fcd7c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.732+0000 7fcd7bfff700 1 --2- 172.21.15.81:0/3917352619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd7c157ca0 0x7fcd7c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.732+0000 7fcd7bfff700 1 -- 172.21.15.81:0/3917352619 >> v1:172.21.15.89:6789/0 conn(0x7fcd7c06d120 legacy=0x7fcd7c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.732+0000 7fcd7bfff700 1 -- 172.21.15.81:0/3917352619 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c0d0170 con 0x7fcd7c1578d0 2023-10-07T08:43:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.733+0000 7fcd7bfff700 1 --2- 172.21.15.81:0/3917352619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd7c1578d0 0x7fcd7c0cf4f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0098e0 tx=0x7fcd6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6212453db2ee86a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.733+0000 7fcd7affd700 1 -- 172.21.15.81:0/3917352619 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c00b640 con 0x7fcd7c1578d0 2023-10-07T08:43:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.733+0000 7fcd7affd700 1 -- 172.21.15.81:0/3917352619 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c00b7a0 con 0x7fcd7c1578d0 2023-10-07T08:43:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.733+0000 7fcd7affd700 1 -- 172.21.15.81:0/3917352619 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c00bb40 con 0x7fcd7c1578d0 2023-10-07T08:43:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.733+0000 7fcd82300700 1 -- 172.21.15.81:0/3917352619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd7c1578d0 msgr2=0x7fcd7c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.733+0000 7fcd82300700 1 --2- 172.21.15.81:0/3917352619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd7c1578d0 0x7fcd7c0cf4f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0098e0 tx=0x7fcd6c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.733+0000 7fcd82300700 1 -- 172.21.15.81:0/3917352619 shutdown_connections 2023-10-07T08:43:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.733+0000 7fcd82300700 1 --2- 172.21.15.81:0/3917352619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd7c1578d0 0x7fcd7c0cf4f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.733+0000 7fcd82300700 1 --2- 172.21.15.81:0/3917352619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd7c157ca0 0x7fcd7c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.733+0000 7fcd82300700 1 -- 172.21.15.81:0/3917352619 >> 172.21.15.81:0/3917352619 conn(0x7fcd7c06bb90 msgr2=0x7fcd7c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.733+0000 7fcd82300700 1 -- 172.21.15.81:0/3917352619 shutdown_connections 2023-10-07T08:43:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.733+0000 7fcd82300700 1 -- 172.21.15.81:0/3917352619 wait complete. 2023-10-07T08:43:22.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.734+0000 7fcd82300700 1 Processor -- start 2023-10-07T08:43:22.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.735+0000 7fcd82300700 1 -- start start 2023-10-07T08:43:22.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.735+0000 7fcd82300700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd7c06d120 0x7fcd7c1546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:22.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.735+0000 7fcd82300700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd7c1578d0 0x7fcd7c156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:22.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.735+0000 7fcd82300700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd7c157ca0 0x7fcd7c069a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:22.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.735+0000 7fcd82300700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0c8420 con 0x7fcd7c157ca0 2023-10-07T08:43:22.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.735+0000 7fcd82300700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0c9240 con 0x7fcd7c06d120 2023-10-07T08:43:22.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.735+0000 7fcd82300700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0c8630 con 0x7fcd7c1578d0 2023-10-07T08:43:22.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.735+0000 7fcd8089d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd7c157ca0 0x7fcd7c069a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:22.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.735+0000 7fcd8089d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd7c157ca0 0x7fcd7c069a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46220/0 (socket says 172.21.15.81:46220) 2023-10-07T08:43:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.735+0000 7fcd8089d700 1 -- 172.21.15.81:0/1592073697 learned_addr learned my addr 172.21.15.81:0/1592073697 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.736+0000 7fcd7bfff700 1 --2- 172.21.15.81:0/1592073697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd7c06d120 0x7fcd7c1546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.736+0000 7fcd8089d700 1 -- 172.21.15.81:0/1592073697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd7c1578d0 msgr2=0x7fcd7c156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.736+0000 7fcd8089d700 1 --2- 172.21.15.81:0/1592073697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd7c1578d0 0x7fcd7c156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.736+0000 7fcd8089d700 1 -- 172.21.15.81:0/1592073697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd7c06d120 msgr2=0x7fcd7c1546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.736+0000 7fcd8089d700 1 --2- 172.21.15.81:0/1592073697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd7c06d120 0x7fcd7c1546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.736+0000 7fcd8089d700 1 -- 172.21.15.81:0/1592073697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c009420 con 0x7fcd7c157ca0 2023-10-07T08:43:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.736+0000 7fcd7bfff700 1 --2- 172.21.15.81:0/1592073697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd7c06d120 0x7fcd7c1546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.736+0000 7fcd8089d700 1 --2- 172.21.15.81:0/1592073697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd7c157ca0 0x7fcd7c069a50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400cc90 tx=0x7fcd74001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.736+0000 7fcd63fff700 1 -- 172.21.15.81:0/1592073697 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7400cea0 con 0x7fcd7c157ca0 2023-10-07T08:43:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.736+0000 7fcd63fff700 1 -- 172.21.15.81:0/1592073697 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7400ab70 con 0x7fcd7c157ca0 2023-10-07T08:43:22.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.736+0000 7fcd82300700 1 -- 172.21.15.81:0/1592073697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c0c8910 con 0x7fcd7c157ca0 2023-10-07T08:43:22.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.736+0000 7fcd63fff700 1 -- 172.21.15.81:0/1592073697 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd740070f0 con 0x7fcd7c157ca0 2023-10-07T08:43:22.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.736+0000 7fcd82300700 1 -- 172.21.15.81:0/1592073697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c0c8ed0 con 0x7fcd7c157ca0 2023-10-07T08:43:22.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.737+0000 7fcd82300700 1 -- 172.21.15.81:0/1592073697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c067ac0 con 0x7fcd7c157ca0 2023-10-07T08:43:22.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.737+0000 7fcd63fff700 1 -- 172.21.15.81:0/1592073697 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd740074a0 con 0x7fcd7c157ca0 2023-10-07T08:43:22.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.738+0000 7fcd63fff700 1 --2- 172.21.15.81:0/1592073697 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcd68066f30 0x7fcd680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:22.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.738+0000 7fcd63fff700 1 -- 172.21.15.81:0/1592073697 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd74084a10 con 0x7fcd7c157ca0 2023-10-07T08:43:22.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.738+0000 7fcd7bfff700 1 --2- 172.21.15.81:0/1592073697 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcd68066f30 0x7fcd680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:22.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.738+0000 7fcd7bfff700 1 --2- 172.21.15.81:0/1592073697 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcd68066f30 0x7fcd680693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c003080 tx=0x7fcd6c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:22.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.742+0000 7fcd63fff700 1 -- 172.21.15.81:0/1592073697 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd74051d00 con 0x7fcd7c157ca0 2023-10-07T08:43:22.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.921+0000 7fcd82300700 1 -- 172.21.15.81:0/1592073697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd7c0d0450 con 0x7fcd7c157ca0 2023-10-07T08:43:22.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.922+0000 7fcd63fff700 1 -- 172.21.15.81:0/1592073697 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd74055320 con 0x7fcd7c157ca0 2023-10-07T08:43:22.922 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:43:22.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.923+0000 7fcd82300700 1 -- 172.21.15.81:0/1592073697 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcd68066f30 msgr2=0x7fcd680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:22.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.923+0000 7fcd82300700 1 --2- 172.21.15.81:0/1592073697 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcd68066f30 0x7fcd680693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c003080 tx=0x7fcd6c017000 comp rx=0 tx=0).stop 2023-10-07T08:43:22.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.923+0000 7fcd82300700 1 -- 172.21.15.81:0/1592073697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd7c157ca0 msgr2=0x7fcd7c069a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:22.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.923+0000 7fcd82300700 1 --2- 172.21.15.81:0/1592073697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd7c157ca0 0x7fcd7c069a50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400cc90 tx=0x7fcd74001a80 comp rx=0 tx=0).stop 2023-10-07T08:43:22.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.923+0000 7fcd82300700 1 -- 172.21.15.81:0/1592073697 shutdown_connections 2023-10-07T08:43:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.923+0000 7fcd82300700 1 --2- 172.21.15.81:0/1592073697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd7c157ca0 0x7fcd7c069a50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.923+0000 7fcd82300700 1 --2- 172.21.15.81:0/1592073697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd7c06d120 0x7fcd7c1546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.923+0000 7fcd82300700 1 --2- 172.21.15.81:0/1592073697 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcd68066f30 0x7fcd680693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.923+0000 7fcd82300700 1 --2- 172.21.15.81:0/1592073697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd7c1578d0 0x7fcd7c156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.923+0000 7fcd82300700 1 -- 172.21.15.81:0/1592073697 >> 172.21.15.81:0/1592073697 conn(0x7fcd7c06bb90 msgr2=0x7fcd7c155c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.924+0000 7fcd82300700 1 -- 172.21.15.81:0/1592073697 shutdown_connections 2023-10-07T08:43:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:22.924+0000 7fcd82300700 1 -- 172.21.15.81:0/1592073697 wait complete. 2023-10-07T08:43:22.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:43:23.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.051+0000 7ff759296700 1 Processor -- start 2023-10-07T08:43:23.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.051+0000 7ff759296700 1 -- start start 2023-10-07T08:43:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.052+0000 7ff759296700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff7541578d0 0x7ff7540cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.052+0000 7ff759296700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff754157ca0 0x7ff75415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.052+0000 7ff759296700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7540d07c0 con 0x7ff75406d120 2023-10-07T08:43:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.052+0000 7ff759296700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7540cfbb0 con 0x7ff7541578d0 2023-10-07T08:43:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.052+0000 7ff759296700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7540cfe90 con 0x7ff754157ca0 2023-10-07T08:43:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.052+0000 7ff752ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff7541578d0 0x7ff7540cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.052+0000 7ff7537fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff75406d120 0x7ff75406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52996/0 (socket says 172.21.15.81:52996) 2023-10-07T08:43:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.052+0000 7ff7537fe700 1 -- 172.21.15.81:0/3438497475 learned_addr learned my addr 172.21.15.81:0/3438497475 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.052+0000 7ff752ffd700 1 --2- 172.21.15.81:0/3438497475 >> v2:172.21.15.81:3300/0 conn(0x7ff7541578d0 0x7ff7540cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46224/0 (socket says 172.21.15.81:46224) 2023-10-07T08:43:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.052+0000 7ff7527fc700 1 --2- 172.21.15.81:0/3438497475 >> v2:172.21.15.89:3300/0 conn(0x7ff754157ca0 0x7ff75415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.053+0000 7ff752ffd700 1 -- 172.21.15.81:0/3438497475 >> v2:172.21.15.89:3300/0 conn(0x7ff754157ca0 msgr2=0x7ff75415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.053+0000 7ff752ffd700 1 --2- 172.21.15.81:0/3438497475 >> v2:172.21.15.89:3300/0 conn(0x7ff754157ca0 0x7ff75415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.053+0000 7ff752ffd700 1 -- 172.21.15.81:0/3438497475 >> v1:172.21.15.81:6789/0 conn(0x7ff75406d120 legacy=0x7ff75406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.053+0000 7ff751ffb700 1 -- 172.21.15.81:0/3438497475 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609396760 0 0) 0x7ff7540d07c0 con 0x7ff75406d120 2023-10-07T08:43:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.053+0000 7ff752ffd700 1 -- 172.21.15.81:0/3438497475 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7540d0170 con 0x7ff7541578d0 2023-10-07T08:43:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.053+0000 7ff752ffd700 1 --2- 172.21.15.81:0/3438497475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7541578d0 0x7ff7540cf4f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff754068510 tx=0x7ff744009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05879e49ff6e1cf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.053+0000 7ff751ffb700 1 -- 172.21.15.81:0/3438497475 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74400e070 con 0x7ff7541578d0 2023-10-07T08:43:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.053+0000 7ff751ffb700 1 -- 172.21.15.81:0/3438497475 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74400bb60 con 0x7ff7541578d0 2023-10-07T08:43:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.053+0000 7ff751ffb700 1 -- 172.21.15.81:0/3438497475 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744012430 con 0x7ff7541578d0 2023-10-07T08:43:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.053+0000 7ff759296700 1 -- 172.21.15.81:0/3438497475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7541578d0 msgr2=0x7ff7540cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.053+0000 7ff759296700 1 --2- 172.21.15.81:0/3438497475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7541578d0 0x7ff7540cf4f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff754068510 tx=0x7ff744009780 comp rx=0 tx=0).stop 2023-10-07T08:43:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.053+0000 7ff759296700 1 -- 172.21.15.81:0/3438497475 shutdown_connections 2023-10-07T08:43:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.053+0000 7ff759296700 1 --2- 172.21.15.81:0/3438497475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7541578d0 0x7ff7540cf4f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.054+0000 7ff759296700 1 --2- 172.21.15.81:0/3438497475 >> v2:172.21.15.89:3300/0 conn(0x7ff754157ca0 0x7ff75415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.054+0000 7ff759296700 1 -- 172.21.15.81:0/3438497475 >> 172.21.15.81:0/3438497475 conn(0x7ff75406bb90 msgr2=0x7ff75406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.054+0000 7ff759296700 1 -- 172.21.15.81:0/3438497475 shutdown_connections 2023-10-07T08:43:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.054+0000 7ff759296700 1 -- 172.21.15.81:0/3438497475 wait complete. 2023-10-07T08:43:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.055+0000 7ff759296700 1 Processor -- start 2023-10-07T08:43:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.055+0000 7ff759296700 1 -- start start 2023-10-07T08:43:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.055+0000 7ff759296700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff75406d120 0x7ff754153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.055+0000 7ff759296700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7541578d0 0x7ff7540b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.055+0000 7ff759296700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff754157ca0 0x7ff754068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.055+0000 7ff759296700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff754154140 con 0x7ff7541578d0 2023-10-07T08:43:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.055+0000 7ff759296700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540b4c10 con 0x7ff75406d120 2023-10-07T08:43:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.055+0000 7ff759296700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540b4ef0 con 0x7ff754157ca0 2023-10-07T08:43:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff7527fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7541578d0 0x7ff7540b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff7527fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7541578d0 0x7ff7540b6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46234/0 (socket says 172.21.15.81:46234) 2023-10-07T08:43:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff7527fc700 1 -- 172.21.15.81:0/2475027878 learned_addr learned my addr 172.21.15.81:0/2475027878 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff752ffd700 1 --2- 172.21.15.81:0/2475027878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff75406d120 0x7ff754153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff7537fe700 1 --2- 172.21.15.81:0/2475027878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff754157ca0 0x7ff754068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff7527fc700 1 -- 172.21.15.81:0/2475027878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff754157ca0 msgr2=0x7ff754068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff7527fc700 1 --2- 172.21.15.81:0/2475027878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff754157ca0 0x7ff754068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff7527fc700 1 -- 172.21.15.81:0/2475027878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff75406d120 msgr2=0x7ff754153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff7527fc700 1 --2- 172.21.15.81:0/2475027878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff75406d120 0x7ff754153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff7527fc700 1 -- 172.21.15.81:0/2475027878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff744009a20 con 0x7ff7541578d0 2023-10-07T08:43:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff7537fe700 1 --2- 172.21.15.81:0/2475027878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff754157ca0 0x7ff754068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff7527fc700 1 --2- 172.21.15.81:0/2475027878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7541578d0 0x7ff7540b6180 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00e900 tx=0x7ff73c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff74affd700 1 -- 172.21.15.81:0/2475027878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c013680 con 0x7ff7541578d0 2023-10-07T08:43:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff74affd700 1 -- 172.21.15.81:0/2475027878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c0137e0 con 0x7ff7541578d0 2023-10-07T08:43:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff759296700 1 -- 172.21.15.81:0/2475027878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7540b51d0 con 0x7ff7541578d0 2023-10-07T08:43:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff74affd700 1 -- 172.21.15.81:0/2475027878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c013ba0 con 0x7ff7541578d0 2023-10-07T08:43:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.056+0000 7ff759296700 1 -- 172.21.15.81:0/2475027878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7540b59d0 con 0x7ff7541578d0 2023-10-07T08:43:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.057+0000 7ff759296700 1 -- 172.21.15.81:0/2475027878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7540b5820 con 0x7ff7541578d0 2023-10-07T08:43:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.057+0000 7ff74affd700 1 -- 172.21.15.81:0/2475027878 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff73c00c460 con 0x7ff7541578d0 2023-10-07T08:43:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.058+0000 7ff74affd700 1 --2- 172.21.15.81:0/2475027878 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff734066f30 0x7ff7340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.058+0000 7ff74affd700 1 -- 172.21.15.81:0/2475027878 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff73c0846b0 con 0x7ff7541578d0 2023-10-07T08:43:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.058+0000 7ff752ffd700 1 --2- 172.21.15.81:0/2475027878 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff734066f30 0x7ff7340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.058+0000 7ff752ffd700 1 --2- 172.21.15.81:0/2475027878 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff734066f30 0x7ff7340693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff7440099f0 tx=0x7ff744019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.062+0000 7ff74affd700 1 -- 172.21.15.81:0/2475027878 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff73c051920 con 0x7ff7541578d0 2023-10-07T08:43:23.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.245+0000 7ff759296700 1 -- 172.21.15.81:0/2475027878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7540ceb10 con 0x7ff7541578d0 2023-10-07T08:43:23.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.245+0000 7ff74affd700 1 -- 172.21.15.81:0/2475027878 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff73c054f40 con 0x7ff7541578d0 2023-10-07T08:43:23.246 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:43:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.247+0000 7ff759296700 1 -- 172.21.15.81:0/2475027878 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff734066f30 msgr2=0x7ff7340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.247+0000 7ff759296700 1 --2- 172.21.15.81:0/2475027878 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff734066f30 0x7ff7340693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff7440099f0 tx=0x7ff744019000 comp rx=0 tx=0).stop 2023-10-07T08:43:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.247+0000 7ff759296700 1 -- 172.21.15.81:0/2475027878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7541578d0 msgr2=0x7ff7540b6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.247+0000 7ff759296700 1 --2- 172.21.15.81:0/2475027878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7541578d0 0x7ff7540b6180 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00e900 tx=0x7ff73c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.247+0000 7ff759296700 1 -- 172.21.15.81:0/2475027878 shutdown_connections 2023-10-07T08:43:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.247+0000 7ff759296700 1 --2- 172.21.15.81:0/2475027878 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff734066f30 0x7ff7340693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.247+0000 7ff759296700 1 --2- 172.21.15.81:0/2475027878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff754157ca0 0x7ff754068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.247+0000 7ff759296700 1 --2- 172.21.15.81:0/2475027878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff75406d120 0x7ff754153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.247+0000 7ff759296700 1 --2- 172.21.15.81:0/2475027878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7541578d0 0x7ff7540b6180 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.247+0000 7ff759296700 1 -- 172.21.15.81:0/2475027878 >> 172.21.15.81:0/2475027878 conn(0x7ff75406bb90 msgr2=0x7ff75406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:23.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.248+0000 7ff759296700 1 -- 172.21.15.81:0/2475027878 shutdown_connections 2023-10-07T08:43:23.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.248+0000 7ff759296700 1 -- 172.21.15.81:0/2475027878 wait complete. 2023-10-07T08:43:23.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:43:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.375+0000 7faedffff700 1 Processor -- start 2023-10-07T08:43:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.375+0000 7faedffff700 1 -- start start 2023-10-07T08:43:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.376+0000 7faedffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faee00d0b80 0x7faee00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.376+0000 7faedffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee00cf2d0 con 0x7faee00d02b0 2023-10-07T08:43:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.376+0000 7faedffff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee006dc00 con 0x7faee006d700 2023-10-07T08:43:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.376+0000 7faedffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee015a690 con 0x7faee00d0b80 2023-10-07T08:43:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.376+0000 7faedeffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faee00d0b80 0x7faee00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.376+0000 7faede7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faee00d02b0 0x7faee006cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53000/0 (socket says 172.21.15.81:53000) 2023-10-07T08:43:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.376+0000 7faede7fc700 1 -- 172.21.15.81:0/1491359901 learned_addr learned my addr 172.21.15.81:0/1491359901 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.376+0000 7faedeffd700 1 -- 172.21.15.81:0/1491359901 >> v1:172.21.15.89:6789/0 conn(0x7faee006d700 legacy=0x7faee015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.376+0000 7faedeffd700 1 -- 172.21.15.81:0/1491359901 >> v1:172.21.15.81:6789/0 conn(0x7faee00d02b0 legacy=0x7faee006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.376+0000 7faedeffd700 1 -- 172.21.15.81:0/1491359901 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee00cf570 con 0x7faee00d0b80 2023-10-07T08:43:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.376+0000 7faedeffd700 1 --2- 172.21.15.81:0/1491359901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee00d0b80 0x7faee00cfd70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faed0009e90 tx=0x7faed0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939823ce044f267c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.377+0000 7faeddffb700 1 -- 172.21.15.81:0/1491359901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed000e070 con 0x7faee00d0b80 2023-10-07T08:43:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.377+0000 7faeddffb700 1 -- 172.21.15.81:0/1491359901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed000bbb0 con 0x7faee00d0b80 2023-10-07T08:43:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.377+0000 7faeddffb700 1 -- 172.21.15.81:0/1491359901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0012430 con 0x7faee00d0b80 2023-10-07T08:43:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.377+0000 7faedffff700 1 -- 172.21.15.81:0/1491359901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee00d0b80 msgr2=0x7faee00cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.377+0000 7faedffff700 1 --2- 172.21.15.81:0/1491359901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee00d0b80 0x7faee00cfd70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faed0009e90 tx=0x7faed0009780 comp rx=0 tx=0).stop 2023-10-07T08:43:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.377+0000 7faedffff700 1 -- 172.21.15.81:0/1491359901 shutdown_connections 2023-10-07T08:43:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.377+0000 7faedffff700 1 --2- 172.21.15.81:0/1491359901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee00d0b80 0x7faee00cfd70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.377+0000 7faedffff700 1 -- 172.21.15.81:0/1491359901 >> 172.21.15.81:0/1491359901 conn(0x7faee0063230 msgr2=0x7faee0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.377+0000 7faedffff700 1 -- 172.21.15.81:0/1491359901 shutdown_connections 2023-10-07T08:43:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.377+0000 7faedffff700 1 -- 172.21.15.81:0/1491359901 wait complete. 2023-10-07T08:43:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.378+0000 7faedffff700 1 Processor -- start 2023-10-07T08:43:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.378+0000 7faedffff700 1 -- start start 2023-10-07T08:43:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.379+0000 7faedffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee006d700 0x7faee00c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.379+0000 7faedffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faee00d02b0 0x7faee016a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.379+0000 7faedffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee00d0b80 0x7faee00cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.379+0000 7faedffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00ca420 con 0x7faee006d700 2023-10-07T08:43:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.379+0000 7faedffff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00ca700 con 0x7faee00d02b0 2023-10-07T08:43:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.379+0000 7faedffff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee00ca9e0 con 0x7faee00d0b80 2023-10-07T08:43:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.379+0000 7faedeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee006d700 0x7faee00c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.379+0000 7faedeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee006d700 0x7faee00c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46258/0 (socket says 172.21.15.81:46258) 2023-10-07T08:43:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.379+0000 7faedeffd700 1 -- 172.21.15.81:0/4279177318 learned_addr learned my addr 172.21.15.81:0/4279177318 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.379+0000 7faede7fc700 1 --2- 172.21.15.81:0/4279177318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faee00d02b0 0x7faee016a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.379+0000 7faedf7fe700 1 --2- 172.21.15.81:0/4279177318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee00d0b80 0x7faee00cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.379+0000 7faedeffd700 1 -- 172.21.15.81:0/4279177318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee00d0b80 msgr2=0x7faee00cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.379+0000 7faedeffd700 1 --2- 172.21.15.81:0/4279177318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee00d0b80 0x7faee00cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.379+0000 7faedeffd700 1 -- 172.21.15.81:0/4279177318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faee00d02b0 msgr2=0x7faee016a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.379+0000 7faedeffd700 1 --2- 172.21.15.81:0/4279177318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faee00d02b0 0x7faee016a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.379+0000 7faedeffd700 1 -- 172.21.15.81:0/4279177318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed0009a20 con 0x7faee006d700 2023-10-07T08:43:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.380+0000 7faedeffd700 1 --2- 172.21.15.81:0/4279177318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee006d700 0x7faee00c8440 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7faed00099f0 tx=0x7faed0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.380+0000 7faed6ffd700 1 -- 172.21.15.81:0/4279177318 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0001090 con 0x7faee006d700 2023-10-07T08:43:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.380+0000 7faed6ffd700 1 -- 172.21.15.81:0/4279177318 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed0012e60 con 0x7faee006d700 2023-10-07T08:43:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.380+0000 7faed6ffd700 1 -- 172.21.15.81:0/4279177318 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed001e890 con 0x7faee006d700 2023-10-07T08:43:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.380+0000 7faedffff700 1 -- 172.21.15.81:0/4279177318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee00cacc0 con 0x7faee006d700 2023-10-07T08:43:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.380+0000 7faedffff700 1 -- 172.21.15.81:0/4279177318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee00c8980 con 0x7faee006d700 2023-10-07T08:43:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.381+0000 7faedffff700 1 -- 172.21.15.81:0/4279177318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee00676e0 con 0x7faee006d700 2023-10-07T08:43:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.381+0000 7faed6ffd700 1 -- 172.21.15.81:0/4279177318 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faed001ec80 con 0x7faee006d700 2023-10-07T08:43:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.381+0000 7faed6ffd700 1 --2- 172.21.15.81:0/4279177318 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faec0066f30 0x7faec00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.381+0000 7faed6ffd700 1 -- 172.21.15.81:0/4279177318 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faed0086bf0 con 0x7faee006d700 2023-10-07T08:43:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.382+0000 7faede7fc700 1 --2- 172.21.15.81:0/4279177318 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faec0066f30 0x7faec00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.382+0000 7faede7fc700 1 --2- 172.21.15.81:0/4279177318 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faec0066f30 0x7faec00693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faee00c9920 tx=0x7faec8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.386+0000 7faed6ffd700 1 -- 172.21.15.81:0/4279177318 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faed0053e60 con 0x7faee006d700 2023-10-07T08:43:23.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.569+0000 7faedffff700 1 -- 172.21.15.81:0/4279177318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faee0071b10 con 0x7faee006d700 2023-10-07T08:43:23.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.569+0000 7faed6ffd700 1 -- 172.21.15.81:0/4279177318 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7faed0057480 con 0x7faee006d700 2023-10-07T08:43:23.570 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:43:23.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.571+0000 7faedffff700 1 -- 172.21.15.81:0/4279177318 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faec0066f30 msgr2=0x7faec00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.571+0000 7faedffff700 1 --2- 172.21.15.81:0/4279177318 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faec0066f30 0x7faec00693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faee00c9920 tx=0x7faec8009040 comp rx=0 tx=0).stop 2023-10-07T08:43:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.571+0000 7faedffff700 1 -- 172.21.15.81:0/4279177318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee006d700 msgr2=0x7faee00c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.571+0000 7faedffff700 1 --2- 172.21.15.81:0/4279177318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee006d700 0x7faee00c8440 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7faed00099f0 tx=0x7faed0018000 comp rx=0 tx=0).stop 2023-10-07T08:43:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.571+0000 7faedffff700 1 -- 172.21.15.81:0/4279177318 shutdown_connections 2023-10-07T08:43:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.571+0000 7faedffff700 1 --2- 172.21.15.81:0/4279177318 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faec0066f30 0x7faec00693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.571+0000 7faedffff700 1 --2- 172.21.15.81:0/4279177318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee00d0b80 0x7faee00cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.571+0000 7faedffff700 1 --2- 172.21.15.81:0/4279177318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee006d700 0x7faee00c8440 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.571+0000 7faedffff700 1 --2- 172.21.15.81:0/4279177318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faee00d02b0 0x7faee016a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.571+0000 7faedffff700 1 -- 172.21.15.81:0/4279177318 >> 172.21.15.81:0/4279177318 conn(0x7faee0063230 msgr2=0x7faee015cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.572+0000 7faedffff700 1 -- 172.21.15.81:0/4279177318 shutdown_connections 2023-10-07T08:43:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.572+0000 7faedffff700 1 -- 172.21.15.81:0/4279177318 wait complete. 2023-10-07T08:43:23.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.698+0000 7fcbed02d700 1 Processor -- start 2023-10-07T08:43:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.698+0000 7fcbed02d700 1 -- start start 2023-10-07T08:43:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.699+0000 7fcbed02d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcbe806d830 0x7fcbe80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.699+0000 7fcbed02d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe80d07c0 con 0x7fcbe8157ca0 2023-10-07T08:43:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.699+0000 7fcbed02d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe80cfbb0 con 0x7fcbe81578d0 2023-10-07T08:43:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.699+0000 7fcbed02d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe80cfe90 con 0x7fcbe806d830 2023-10-07T08:43:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.699+0000 7fcbde59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcbe8157ca0 0x7fcbe806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53016/0 (socket says 172.21.15.81:53016) 2023-10-07T08:43:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.699+0000 7fcbde59c700 1 -- 172.21.15.81:0/2250816402 learned_addr learned my addr 172.21.15.81:0/2250816402 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.699+0000 7fcbe759e700 1 --2- 172.21.15.81:0/2250816402 >> v2:172.21.15.89:3300/0 conn(0x7fcbe806d830 0x7fcbe80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.699+0000 7fcbe659c700 1 -- 172.21.15.81:0/2250816402 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239693343 0 0) 0x7fcbe80d07c0 con 0x7fcbe8157ca0 2023-10-07T08:43:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.699+0000 7fcbe659c700 1 -- 172.21.15.81:0/2250816402 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbd4003570 con 0x7fcbe8157ca0 2023-10-07T08:43:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.699+0000 7fcbe659c700 1 -- 172.21.15.81:0/2250816402 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404556809 0 0) 0x7fcbe80cfbb0 con 0x7fcbe81578d0 2023-10-07T08:43:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.699+0000 7fcbe659c700 1 -- 172.21.15.81:0/2250816402 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbe80d07c0 con 0x7fcbe81578d0 2023-10-07T08:43:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.699+0000 7fcbe759e700 1 -- 172.21.15.81:0/2250816402 >> v1:172.21.15.89:6789/0 conn(0x7fcbe81578d0 legacy=0x7fcbe815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.699+0000 7fcbe759e700 1 -- 172.21.15.81:0/2250816402 >> v1:172.21.15.81:6789/0 conn(0x7fcbe8157ca0 legacy=0x7fcbe806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.699+0000 7fcbe759e700 1 -- 172.21.15.81:0/2250816402 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe80d0170 con 0x7fcbe806d830 2023-10-07T08:43:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.700+0000 7fcbe759e700 1 --2- 172.21.15.81:0/2250816402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe806d830 0x7fcbe80cf4f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009e60 tx=0x7fcbe0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdb676815565e96f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.700+0000 7fcbe659c700 1 -- 172.21.15.81:0/2250816402 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe000e070 con 0x7fcbe806d830 2023-10-07T08:43:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.700+0000 7fcbe659c700 1 -- 172.21.15.81:0/2250816402 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe000bab0 con 0x7fcbe806d830 2023-10-07T08:43:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.700+0000 7fcbe659c700 1 -- 172.21.15.81:0/2250816402 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe000be70 con 0x7fcbe806d830 2023-10-07T08:43:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.700+0000 7fcbed02d700 1 -- 172.21.15.81:0/2250816402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe806d830 msgr2=0x7fcbe80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.700+0000 7fcbed02d700 1 --2- 172.21.15.81:0/2250816402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe806d830 0x7fcbe80cf4f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009e60 tx=0x7fcbe0009780 comp rx=0 tx=0).stop 2023-10-07T08:43:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.700+0000 7fcbed02d700 1 -- 172.21.15.81:0/2250816402 shutdown_connections 2023-10-07T08:43:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.700+0000 7fcbed02d700 1 --2- 172.21.15.81:0/2250816402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe806d830 0x7fcbe80cf4f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.700+0000 7fcbed02d700 1 -- 172.21.15.81:0/2250816402 >> 172.21.15.81:0/2250816402 conn(0x7fcbe806bb90 msgr2=0x7fcbe806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.700+0000 7fcbed02d700 1 -- 172.21.15.81:0/2250816402 shutdown_connections 2023-10-07T08:43:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.700+0000 7fcbed02d700 1 -- 172.21.15.81:0/2250816402 wait complete. 2023-10-07T08:43:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.701+0000 7fcbed02d700 1 Processor -- start 2023-10-07T08:43:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.701+0000 7fcbed02d700 1 -- start start 2023-10-07T08:43:23.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.702+0000 7fcbed02d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbe806d830 0x7fcbe8153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:23.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.702+0000 7fcbed02d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe81578d0 0x7fcbe80aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:23.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.702+0000 7fcbed02d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe8157ca0 0x7fcbe80aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:23.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.702+0000 7fcbed02d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe80b5330 con 0x7fcbe81578d0 2023-10-07T08:43:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.702+0000 7fcbed02d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe80b4720 con 0x7fcbe8157ca0 2023-10-07T08:43:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.702+0000 7fcbed02d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe80b4a00 con 0x7fcbe806d830 2023-10-07T08:43:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.702+0000 7fcbde59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe81578d0 0x7fcbe80aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.702+0000 7fcbde59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe81578d0 0x7fcbe80aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46260/0 (socket says 172.21.15.81:46260) 2023-10-07T08:43:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.702+0000 7fcbde59c700 1 -- 172.21.15.81:0/265997604 learned_addr learned my addr 172.21.15.81:0/265997604 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.702+0000 7fcbe6d9d700 1 --2- 172.21.15.81:0/265997604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbe806d830 0x7fcbe8153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.703+0000 7fcbe759e700 1 --2- 172.21.15.81:0/265997604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe8157ca0 0x7fcbe80aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.703+0000 7fcbde59c700 1 -- 172.21.15.81:0/265997604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbe806d830 msgr2=0x7fcbe8153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.703+0000 7fcbde59c700 1 --2- 172.21.15.81:0/265997604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbe806d830 0x7fcbe8153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.703+0000 7fcbde59c700 1 -- 172.21.15.81:0/265997604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe8157ca0 msgr2=0x7fcbe80aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.703+0000 7fcbde59c700 1 --2- 172.21.15.81:0/265997604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe8157ca0 0x7fcbe80aadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.703+0000 7fcbde59c700 1 -- 172.21.15.81:0/265997604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe0009a20 con 0x7fcbe81578d0 2023-10-07T08:43:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.703+0000 7fcbde59c700 1 --2- 172.21.15.81:0/265997604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe81578d0 0x7fcbe80aa890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000c790 tx=0x7fcbd0007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.703+0000 7fcbdf7fe700 1 -- 172.21.15.81:0/265997604 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0005b30 con 0x7fcbe81578d0 2023-10-07T08:43:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.703+0000 7fcbdf7fe700 1 -- 172.21.15.81:0/265997604 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd0005c90 con 0x7fcbe81578d0 2023-10-07T08:43:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.703+0000 7fcbed02d700 1 -- 172.21.15.81:0/265997604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe80b4ce0 con 0x7fcbe81578d0 2023-10-07T08:43:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.703+0000 7fcbdf7fe700 1 -- 172.21.15.81:0/265997604 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd00072e0 con 0x7fcbe81578d0 2023-10-07T08:43:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.703+0000 7fcbed02d700 1 -- 172.21.15.81:0/265997604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe8154180 con 0x7fcbe81578d0 2023-10-07T08:43:23.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.704+0000 7fcbed02d700 1 -- 172.21.15.81:0/265997604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe80b54e0 con 0x7fcbe81578d0 2023-10-07T08:43:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.704+0000 7fcbdf7fe700 1 -- 172.21.15.81:0/265997604 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcbd0007690 con 0x7fcbe81578d0 2023-10-07T08:43:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.704+0000 7fcbdf7fe700 1 --2- 172.21.15.81:0/265997604 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcbc8066f30 0x7fcbc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.705+0000 7fcbdf7fe700 1 -- 172.21.15.81:0/265997604 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcbd00838f0 con 0x7fcbe81578d0 2023-10-07T08:43:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.705+0000 7fcbe6d9d700 1 --2- 172.21.15.81:0/265997604 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcbc8066f30 0x7fcbc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.705+0000 7fcbe6d9d700 1 --2- 172.21.15.81:0/265997604 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcbc8066f30 0x7fcbc80693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80027d0 tx=0x7fcbd8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.709+0000 7fcbdf7fe700 1 -- 172.21.15.81:0/265997604 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcbd004b5a0 con 0x7fcbe81578d0 2023-10-07T08:43:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.890+0000 7fcbed02d700 1 -- 172.21.15.81:0/265997604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbe80d0450 con 0x7fcbe81578d0 2023-10-07T08:43:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.891+0000 7fcbdf7fe700 1 -- 172.21.15.81:0/265997604 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fcbd0017020 con 0x7fcbe81578d0 2023-10-07T08:43:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:23.893 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:58.248338+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:42:54.397263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:42:55.595133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.893+0000 7fcbed02d700 1 -- 172.21.15.81:0/265997604 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcbc8066f30 msgr2=0x7fcbc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.893+0000 7fcbed02d700 1 --2- 172.21.15.81:0/265997604 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcbc8066f30 0x7fcbc80693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80027d0 tx=0x7fcbd8009040 comp rx=0 tx=0).stop 2023-10-07T08:43:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.893+0000 7fcbed02d700 1 -- 172.21.15.81:0/265997604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe81578d0 msgr2=0x7fcbe80aa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.893+0000 7fcbed02d700 1 --2- 172.21.15.81:0/265997604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe81578d0 0x7fcbe80aa890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000c790 tx=0x7fcbd0007e40 comp rx=0 tx=0).stop 2023-10-07T08:43:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.893+0000 7fcbed02d700 1 -- 172.21.15.81:0/265997604 shutdown_connections 2023-10-07T08:43:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.893+0000 7fcbed02d700 1 --2- 172.21.15.81:0/265997604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbe8157ca0 0x7fcbe80aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.893+0000 7fcbed02d700 1 --2- 172.21.15.81:0/265997604 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcbc8066f30 0x7fcbc80693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.893+0000 7fcbed02d700 1 --2- 172.21.15.81:0/265997604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbe806d830 0x7fcbe8153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.893+0000 7fcbed02d700 1 --2- 172.21.15.81:0/265997604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe81578d0 0x7fcbe80aa890 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.893+0000 7fcbed02d700 1 -- 172.21.15.81:0/265997604 >> 172.21.15.81:0/265997604 conn(0x7fcbe806bb90 msgr2=0x7fcbe8156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.894+0000 7fcbed02d700 1 -- 172.21.15.81:0/265997604 shutdown_connections 2023-10-07T08:43:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:23.894+0000 7fcbed02d700 1 -- 172.21.15.81:0/265997604 wait complete. 2023-10-07T08:43:23.907 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:42:54.397263+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:42:55.595133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:43:23.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:43:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.022+0000 7f27eadc6700 1 Processor -- start 2023-10-07T08:43:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.022+0000 7f27eadc6700 1 -- start start 2023-10-07T08:43:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.023+0000 7f27eadc6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27e41578d0 0x7f27e40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.023+0000 7f27eadc6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27e406d120 0x7f27e406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.023+0000 7f27eadc6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e406dac0 con 0x7f27e4157ca0 2023-10-07T08:43:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.023+0000 7f27eadc6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e40d07c0 con 0x7f27e406d120 2023-10-07T08:43:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.023+0000 7f27eadc6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40cfbb0 con 0x7f27e41578d0 2023-10-07T08:43:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.023+0000 7f27e9363700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27e406d120 0x7f27e406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.023+0000 7f27e3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f27e4157ca0 0x7f27e415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53018/0 (socket says 172.21.15.81:53018) 2023-10-07T08:43:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.023+0000 7f27e3fff700 1 -- 172.21.15.81:0/2825726591 learned_addr learned my addr 172.21.15.81:0/2825726591 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.023+0000 7f27e8b62700 1 --2- 172.21.15.81:0/2825726591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27e41578d0 0x7f27e40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.023+0000 7f27e9363700 1 -- 172.21.15.81:0/2825726591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27e41578d0 msgr2=0x7f27e40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.023+0000 7f27e9363700 1 --2- 172.21.15.81:0/2825726591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27e41578d0 0x7f27e40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.023+0000 7f27e9363700 1 -- 172.21.15.81:0/2825726591 >> v1:172.21.15.81:6789/0 conn(0x7f27e4157ca0 legacy=0x7f27e415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.023+0000 7f27e9363700 1 -- 172.21.15.81:0/2825726591 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e40cfe90 con 0x7f27e406d120 2023-10-07T08:43:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.023+0000 7f27e37fe700 1 -- 172.21.15.81:0/2825726591 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217217100 0 0) 0x7f27d8001110 con 0x7f27e4157ca0 2023-10-07T08:43:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.023+0000 7f27e8b62700 1 --2- 172.21.15.81:0/2825726591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27e41578d0 0x7f27e40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.024+0000 7f27e9363700 1 --2- 172.21.15.81:0/2825726591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406d120 0x7f27e406d580 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0098e0 tx=0x7f27dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc9d0c0962b9aa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.024+0000 7f27e37fe700 1 -- 172.21.15.81:0/2825726591 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc009e80 con 0x7f27e406d120 2023-10-07T08:43:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.024+0000 7f27e37fe700 1 -- 172.21.15.81:0/2825726591 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc00b860 con 0x7f27e406d120 2023-10-07T08:43:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.024+0000 7f27e37fe700 1 -- 172.21.15.81:0/2825726591 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc00bbe0 con 0x7f27e406d120 2023-10-07T08:43:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.024+0000 7f27eadc6700 1 -- 172.21.15.81:0/2825726591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406d120 msgr2=0x7f27e406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.024+0000 7f27eadc6700 1 --2- 172.21.15.81:0/2825726591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406d120 0x7f27e406d580 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0098e0 tx=0x7f27dc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.024+0000 7f27eadc6700 1 -- 172.21.15.81:0/2825726591 shutdown_connections 2023-10-07T08:43:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.024+0000 7f27eadc6700 1 --2- 172.21.15.81:0/2825726591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406d120 0x7f27e406d580 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.024+0000 7f27eadc6700 1 --2- 172.21.15.81:0/2825726591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27e41578d0 0x7f27e40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.024+0000 7f27eadc6700 1 -- 172.21.15.81:0/2825726591 >> 172.21.15.81:0/2825726591 conn(0x7f27e406bb90 msgr2=0x7f27e406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.024+0000 7f27eadc6700 1 -- 172.21.15.81:0/2825726591 shutdown_connections 2023-10-07T08:43:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.024+0000 7f27eadc6700 1 -- 172.21.15.81:0/2825726591 wait complete. 2023-10-07T08:43:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.025+0000 7f27eadc6700 1 Processor -- start 2023-10-07T08:43:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.026+0000 7f27eadc6700 1 -- start start 2023-10-07T08:43:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.026+0000 7f27eadc6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406d120 0x7f27e40b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.026+0000 7f27eadc6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27e41578d0 0x7f27e414b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.026+0000 7f27eadc6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27e4157ca0 0x7f27e40af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.026+0000 7f27eadc6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40b23d0 con 0x7f27e406d120 2023-10-07T08:43:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.026+0000 7f27eadc6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e416a8f0 con 0x7f27e4157ca0 2023-10-07T08:43:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.026+0000 7f27eadc6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e4156260 con 0x7f27e41578d0 2023-10-07T08:43:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.026+0000 7f27e8b62700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406d120 0x7f27e40b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.026+0000 7f27e8b62700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406d120 0x7f27e40b1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46276/0 (socket says 172.21.15.81:46276) 2023-10-07T08:43:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.026+0000 7f27e8b62700 1 -- 172.21.15.81:0/1918879821 learned_addr learned my addr 172.21.15.81:0/1918879821 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.027+0000 7f27e9363700 1 --2- 172.21.15.81:0/1918879821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27e4157ca0 0x7f27e40af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.027+0000 7f27e3fff700 1 --2- 172.21.15.81:0/1918879821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27e41578d0 0x7f27e414b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.027+0000 7f27e8b62700 1 -- 172.21.15.81:0/1918879821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27e41578d0 msgr2=0x7f27e414b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.027+0000 7f27e8b62700 1 --2- 172.21.15.81:0/1918879821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27e41578d0 0x7f27e414b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.027+0000 7f27e8b62700 1 -- 172.21.15.81:0/1918879821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27e4157ca0 msgr2=0x7f27e40af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.027+0000 7f27e8b62700 1 --2- 172.21.15.81:0/1918879821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27e4157ca0 0x7f27e40af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.027+0000 7f27e8b62700 1 -- 172.21.15.81:0/1918879821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc009420 con 0x7f27e406d120 2023-10-07T08:43:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.027+0000 7f27e9363700 1 --2- 172.21.15.81:0/1918879821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27e4157ca0 0x7f27e40af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.027+0000 7f27e8b62700 1 --2- 172.21.15.81:0/1918879821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406d120 0x7f27e40b1e90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f27d400a430 tx=0x7f27d4007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.027+0000 7f27e0ff9700 1 -- 172.21.15.81:0/1918879821 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d400d650 con 0x7f27e406d120 2023-10-07T08:43:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.027+0000 7f27e0ff9700 1 -- 172.21.15.81:0/1918879821 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d400d7b0 con 0x7f27e406d120 2023-10-07T08:43:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.027+0000 7f27eadc6700 1 -- 172.21.15.81:0/1918879821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e414be90 con 0x7f27e406d120 2023-10-07T08:43:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.027+0000 7f27e0ff9700 1 -- 172.21.15.81:0/1918879821 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d400db50 con 0x7f27e406d120 2023-10-07T08:43:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.027+0000 7f27eadc6700 1 -- 172.21.15.81:0/1918879821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e416a2a0 con 0x7f27e406d120 2023-10-07T08:43:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.028+0000 7f27eadc6700 1 -- 172.21.15.81:0/1918879821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e4067ac0 con 0x7f27e406d120 2023-10-07T08:43:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.028+0000 7f27e0ff9700 1 -- 172.21.15.81:0/1918879821 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27d4015440 con 0x7f27e406d120 2023-10-07T08:43:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.029+0000 7f27e0ff9700 1 --2- 172.21.15.81:0/1918879821 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27d0066f30 0x7f27d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.029+0000 7f27e0ff9700 1 -- 172.21.15.81:0/1918879821 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f27d4084df0 con 0x7f27e406d120 2023-10-07T08:43:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.029+0000 7f27e3fff700 1 --2- 172.21.15.81:0/1918879821 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27d0066f30 0x7f27d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.029+0000 7f27e3fff700 1 --2- 172.21.15.81:0/1918879821 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27d0066f30 0x7f27d00693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f27e415c6a0 tx=0x7f27d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.033+0000 7f27e0ff9700 1 -- 172.21.15.81:0/1918879821 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27d404e5a0 con 0x7f27e406d120 2023-10-07T08:43:24.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.213+0000 7f27eadc6700 1 -- 172.21.15.81:0/1918879821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27e40d0170 con 0x7f27e406d120 2023-10-07T08:43:24.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.213+0000 7f27e0ff9700 1 -- 172.21.15.81:0/1918879821 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27d401a0a0 con 0x7f27e406d120 2023-10-07T08:43:24.214 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:43:24.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.215+0000 7f27eadc6700 1 -- 172.21.15.81:0/1918879821 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27d0066f30 msgr2=0x7f27d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.215+0000 7f27eadc6700 1 --2- 172.21.15.81:0/1918879821 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27d0066f30 0x7f27d00693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f27e415c6a0 tx=0x7f27d8009040 comp rx=0 tx=0).stop 2023-10-07T08:43:24.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.215+0000 7f27eadc6700 1 -- 172.21.15.81:0/1918879821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406d120 msgr2=0x7f27e40b1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.215+0000 7f27eadc6700 1 --2- 172.21.15.81:0/1918879821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406d120 0x7f27e40b1e90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f27d400a430 tx=0x7f27d4007910 comp rx=0 tx=0).stop 2023-10-07T08:43:24.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.215+0000 7f27eadc6700 1 -- 172.21.15.81:0/1918879821 shutdown_connections 2023-10-07T08:43:24.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.215+0000 7f27eadc6700 1 --2- 172.21.15.81:0/1918879821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27e4157ca0 0x7f27e40af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.215+0000 7f27eadc6700 1 --2- 172.21.15.81:0/1918879821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406d120 0x7f27e40b1e90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.215+0000 7f27eadc6700 1 --2- 172.21.15.81:0/1918879821 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27d0066f30 0x7f27d00693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.215+0000 7f27eadc6700 1 --2- 172.21.15.81:0/1918879821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27e41578d0 0x7f27e414b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.215+0000 7f27eadc6700 1 -- 172.21.15.81:0/1918879821 >> 172.21.15.81:0/1918879821 conn(0x7f27e406bb90 msgr2=0x7f27e4068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:24.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.215+0000 7f27eadc6700 1 -- 172.21.15.81:0/1918879821 shutdown_connections 2023-10-07T08:43:24.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.215+0000 7f27eadc6700 1 -- 172.21.15.81:0/1918879821 wait complete. 2023-10-07T08:43:24.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:43:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.343+0000 7fed8151f700 1 Processor -- start 2023-10-07T08:43:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.343+0000 7fed8151f700 1 -- start start 2023-10-07T08:43:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.344+0000 7fed8151f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fed7c157fe0 0x7fed7c0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.344+0000 7fed8151f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fed7c1583b0 0x7fed7c0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.344+0000 7fed8151f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed7c0ceb30 0x7fed7c0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.344+0000 7fed8151f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7c0cf4b0 con 0x7fed7c157fe0 2023-10-07T08:43:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.344+0000 7fed8151f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7c0b2890 con 0x7fed7c1583b0 2023-10-07T08:43:24.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.344+0000 7fed8151f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c0b4070 con 0x7fed7c0ceb30 2023-10-07T08:43:24.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.344+0000 7fed7affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fed7c157fe0 0x7fed7c0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.344+0000 7fed7affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fed7c157fe0 0x7fed7c0b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46286/0 (socket says 172.21.15.81:46286) 2023-10-07T08:43:24.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.344+0000 7fed7affd700 1 -- 172.21.15.81:0/2937192613 learned_addr learned my addr 172.21.15.81:0/2937192613 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:24.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed7a7fc700 1 --2- 172.21.15.81:0/2937192613 >> v2:172.21.15.89:3300/0 conn(0x7fed7c1583b0 0x7fed7c0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed7b7fe700 1 --2- 172.21.15.81:0/2937192613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed7c0ceb30 0x7fed7c0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed7affd700 1 -- 172.21.15.81:0/2937192613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed7c0ceb30 msgr2=0x7fed7c0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:24.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed7affd700 1 --2- 172.21.15.81:0/2937192613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed7c0ceb30 0x7fed7c0cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed7affd700 1 -- 172.21.15.81:0/2937192613 >> v2:172.21.15.89:3300/0 conn(0x7fed7c1583b0 msgr2=0x7fed7c0b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:24.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed7affd700 1 --2- 172.21.15.81:0/2937192613 >> v2:172.21.15.89:3300/0 conn(0x7fed7c1583b0 0x7fed7c0b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed7affd700 1 -- 172.21.15.81:0/2937192613 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7c0b4350 con 0x7fed7c157fe0 2023-10-07T08:43:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed7affd700 1 --2- 172.21.15.81:0/2937192613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c157fe0 0x7fed7c0b34c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fed7c04c150 tx=0x7fed6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8e4aa4af56d460 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed79ffb700 1 -- 172.21.15.81:0/2937192613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c00e070 con 0x7fed7c157fe0 2023-10-07T08:43:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed79ffb700 1 -- 172.21.15.81:0/2937192613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c00ba50 con 0x7fed7c157fe0 2023-10-07T08:43:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed79ffb700 1 -- 172.21.15.81:0/2937192613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c0092e0 con 0x7fed7c157fe0 2023-10-07T08:43:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed8151f700 1 -- 172.21.15.81:0/2937192613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c157fe0 msgr2=0x7fed7c0b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed8151f700 1 --2- 172.21.15.81:0/2937192613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c157fe0 0x7fed7c0b34c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fed7c04c150 tx=0x7fed6c009840 comp rx=0 tx=0).stop 2023-10-07T08:43:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed8151f700 1 -- 172.21.15.81:0/2937192613 shutdown_connections 2023-10-07T08:43:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed8151f700 1 --2- 172.21.15.81:0/2937192613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed7c0ceb30 0x7fed7c0cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed8151f700 1 --2- 172.21.15.81:0/2937192613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c157fe0 0x7fed7c0b34c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed8151f700 1 --2- 172.21.15.81:0/2937192613 >> v2:172.21.15.89:3300/0 conn(0x7fed7c1583b0 0x7fed7c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed8151f700 1 -- 172.21.15.81:0/2937192613 >> 172.21.15.81:0/2937192613 conn(0x7fed7c067640 msgr2=0x7fed7c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed8151f700 1 -- 172.21.15.81:0/2937192613 shutdown_connections 2023-10-07T08:43:24.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.345+0000 7fed8151f700 1 -- 172.21.15.81:0/2937192613 wait complete. 2023-10-07T08:43:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.347+0000 7fed8151f700 1 Processor -- start 2023-10-07T08:43:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.347+0000 7fed8151f700 1 -- start start 2023-10-07T08:43:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.347+0000 7fed8151f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c0ceb30 0x7fed7c15a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.347+0000 7fed8151f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed7c157fe0 0x7fed7c0c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.347+0000 7fed8151f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed7c1583b0 0x7fed7c0c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.347+0000 7fed8151f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c1686f0 con 0x7fed7c0ceb30 2023-10-07T08:43:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.347+0000 7fed8151f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c169520 con 0x7fed7c1583b0 2023-10-07T08:43:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.347+0000 7fed8151f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c168910 con 0x7fed7c157fe0 2023-10-07T08:43:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.347+0000 7fed7affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c0ceb30 0x7fed7c15a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.347+0000 7fed7affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c0ceb30 0x7fed7c15a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46288/0 (socket says 172.21.15.81:46288) 2023-10-07T08:43:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.347+0000 7fed7affd700 1 -- 172.21.15.81:0/1395636660 learned_addr learned my addr 172.21.15.81:0/1395636660 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.348+0000 7fed7b7fe700 1 --2- 172.21.15.81:0/1395636660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed7c1583b0 0x7fed7c0c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.348+0000 7fed7a7fc700 1 --2- 172.21.15.81:0/1395636660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed7c157fe0 0x7fed7c0c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.348+0000 7fed7affd700 1 -- 172.21.15.81:0/1395636660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed7c157fe0 msgr2=0x7fed7c0c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.348+0000 7fed7affd700 1 --2- 172.21.15.81:0/1395636660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed7c157fe0 0x7fed7c0c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.348+0000 7fed7affd700 1 -- 172.21.15.81:0/1395636660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed7c1583b0 msgr2=0x7fed7c0c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.348+0000 7fed7affd700 1 --2- 172.21.15.81:0/1395636660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed7c1583b0 0x7fed7c0c3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.348+0000 7fed7affd700 1 -- 172.21.15.81:0/1395636660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c009ae0 con 0x7fed7c0ceb30 2023-10-07T08:43:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.348+0000 7fed7a7fc700 1 --2- 172.21.15.81:0/1395636660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed7c157fe0 0x7fed7c0c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.348+0000 7fed7affd700 1 --2- 172.21.15.81:0/1395636660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c0ceb30 0x7fed7c15a940 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed6c009fd0 tx=0x7fed6c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.348+0000 7fed72ffd700 1 -- 172.21.15.81:0/1395636660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c0079a0 con 0x7fed7c0ceb30 2023-10-07T08:43:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.348+0000 7fed72ffd700 1 -- 172.21.15.81:0/1395636660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c007b00 con 0x7fed7c0ceb30 2023-10-07T08:43:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.348+0000 7fed8151f700 1 -- 172.21.15.81:0/1395636660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7c168bf0 con 0x7fed7c0ceb30 2023-10-07T08:43:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.348+0000 7fed72ffd700 1 -- 172.21.15.81:0/1395636660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c026460 con 0x7fed7c0ceb30 2023-10-07T08:43:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.348+0000 7fed8151f700 1 -- 172.21.15.81:0/1395636660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7c1691b0 con 0x7fed7c0ceb30 2023-10-07T08:43:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.349+0000 7fed8151f700 1 -- 172.21.15.81:0/1395636660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7c071b70 con 0x7fed7c0ceb30 2023-10-07T08:43:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.349+0000 7fed72ffd700 1 -- 172.21.15.81:0/1395636660 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed6c01d420 con 0x7fed7c0ceb30 2023-10-07T08:43:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.350+0000 7fed72ffd700 1 --2- 172.21.15.81:0/1395636660 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed5c066f30 0x7fed5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.350+0000 7fed72ffd700 1 -- 172.21.15.81:0/1395636660 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fed6c086310 con 0x7fed7c0ceb30 2023-10-07T08:43:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.350+0000 7fed7a7fc700 1 --2- 172.21.15.81:0/1395636660 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed5c066f30 0x7fed5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.350+0000 7fed7a7fc700 1 --2- 172.21.15.81:0/1395636660 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed5c066f30 0x7fed5c0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fed7c15bbc0 tx=0x7fed64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.354+0000 7fed72ffd700 1 -- 172.21.15.81:0/1395636660 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed6c053630 con 0x7fed7c0ceb30 2023-10-07T08:43:24.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.537+0000 7fed8151f700 1 -- 172.21.15.81:0/1395636660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fed7c169340 con 0x7fed7c0ceb30 2023-10-07T08:43:24.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.537+0000 7fed72ffd700 1 -- 172.21.15.81:0/1395636660 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fed6c056c50 con 0x7fed7c0ceb30 2023-10-07T08:43:24.539 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:43:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.539+0000 7fed8151f700 1 -- 172.21.15.81:0/1395636660 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed5c066f30 msgr2=0x7fed5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.539+0000 7fed8151f700 1 --2- 172.21.15.81:0/1395636660 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed5c066f30 0x7fed5c0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fed7c15bbc0 tx=0x7fed64008040 comp rx=0 tx=0).stop 2023-10-07T08:43:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.539+0000 7fed8151f700 1 -- 172.21.15.81:0/1395636660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c0ceb30 msgr2=0x7fed7c15a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.539+0000 7fed8151f700 1 --2- 172.21.15.81:0/1395636660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c0ceb30 0x7fed7c15a940 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed6c009fd0 tx=0x7fed6c018000 comp rx=0 tx=0).stop 2023-10-07T08:43:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.539+0000 7fed8151f700 1 -- 172.21.15.81:0/1395636660 shutdown_connections 2023-10-07T08:43:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.539+0000 7fed8151f700 1 --2- 172.21.15.81:0/1395636660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed7c1583b0 0x7fed7c0c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.539+0000 7fed8151f700 1 --2- 172.21.15.81:0/1395636660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c0ceb30 0x7fed7c15a940 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.539+0000 7fed8151f700 1 --2- 172.21.15.81:0/1395636660 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed5c066f30 0x7fed5c0693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.539+0000 7fed8151f700 1 --2- 172.21.15.81:0/1395636660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed7c157fe0 0x7fed7c0c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.539+0000 7fed8151f700 1 -- 172.21.15.81:0/1395636660 >> 172.21.15.81:0/1395636660 conn(0x7fed7c067640 msgr2=0x7fed7c154300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:24.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.539+0000 7fed8151f700 1 -- 172.21.15.81:0/1395636660 shutdown_connections 2023-10-07T08:43:24.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.539+0000 7fed8151f700 1 -- 172.21.15.81:0/1395636660 wait complete. 2023-10-07T08:43:24.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:43:24.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.668+0000 7f55d4354700 1 Processor -- start 2023-10-07T08:43:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.668+0000 7f55d4354700 1 -- start start 2023-10-07T08:43:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.669+0000 7f55d4354700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f55cc15a2a0 0x7f55cc0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.669+0000 7f55d4354700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55cc0b0ca0 con 0x7f55cc0ceb30 2023-10-07T08:43:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.669+0000 7f55d4354700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55cc0b00d0 con 0x7f55cc06dd60 2023-10-07T08:43:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.669+0000 7f55d4354700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55cc06e160 con 0x7f55cc15a2a0 2023-10-07T08:43:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.669+0000 7f55d18ef700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f55cc0ceb30 0x7f55cc06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53026/0 (socket says 172.21.15.81:53026) 2023-10-07T08:43:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.669+0000 7f55d18ef700 1 -- 172.21.15.81:0/855493036 learned_addr learned my addr 172.21.15.81:0/855493036 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.669+0000 7f55d20f0700 1 --2- 172.21.15.81:0/855493036 >> v2:172.21.15.89:3300/0 conn(0x7f55cc15a2a0 0x7f55cc0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.670+0000 7f55d10ee700 1 -- 172.21.15.81:0/855493036 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839540344 0 0) 0x7f55cc0b0ca0 con 0x7f55cc0ceb30 2023-10-07T08:43:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.670+0000 7f55d10ee700 1 -- 172.21.15.81:0/855493036 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55b8003570 con 0x7f55cc0ceb30 2023-10-07T08:43:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.670+0000 7f55d20f0700 1 -- 172.21.15.81:0/855493036 >> v1:172.21.15.89:6789/0 conn(0x7f55cc06dd60 legacy=0x7f55cc0b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.670+0000 7f55d10ee700 1 -- 172.21.15.81:0/855493036 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966540135 0 0) 0x7f55cc0b00d0 con 0x7f55cc06dd60 2023-10-07T08:43:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.670+0000 7f55d20f0700 1 -- 172.21.15.81:0/855493036 >> v1:172.21.15.81:6789/0 conn(0x7f55cc0ceb30 legacy=0x7f55cc06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.670+0000 7f55d20f0700 1 -- 172.21.15.81:0/855493036 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc0b0370 con 0x7f55cc15a2a0 2023-10-07T08:43:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.670+0000 7f55d20f0700 1 --2- 172.21.15.81:0/855493036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55cc15a2a0 0x7f55cc0b1130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f55c80098e0 tx=0x7f55c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=134d23cd0d9e95b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.670+0000 7f55d10ee700 1 -- 172.21.15.81:0/855493036 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c800b640 con 0x7f55cc15a2a0 2023-10-07T08:43:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.670+0000 7f55d10ee700 1 -- 172.21.15.81:0/855493036 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c800b7a0 con 0x7f55cc15a2a0 2023-10-07T08:43:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.670+0000 7f55d10ee700 1 -- 172.21.15.81:0/855493036 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c800bb40 con 0x7f55cc15a2a0 2023-10-07T08:43:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.671+0000 7f55d4354700 1 -- 172.21.15.81:0/855493036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55cc15a2a0 msgr2=0x7f55cc0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.671+0000 7f55d4354700 1 --2- 172.21.15.81:0/855493036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55cc15a2a0 0x7f55cc0b1130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f55c80098e0 tx=0x7f55c80091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.671+0000 7f55d4354700 1 -- 172.21.15.81:0/855493036 shutdown_connections 2023-10-07T08:43:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.671+0000 7f55d4354700 1 --2- 172.21.15.81:0/855493036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55cc15a2a0 0x7f55cc0b1130 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.671+0000 7f55d4354700 1 -- 172.21.15.81:0/855493036 >> 172.21.15.81:0/855493036 conn(0x7f55cc067640 msgr2=0x7f55cc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.671+0000 7f55d4354700 1 -- 172.21.15.81:0/855493036 shutdown_connections 2023-10-07T08:43:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.671+0000 7f55d4354700 1 -- 172.21.15.81:0/855493036 wait complete. 2023-10-07T08:43:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.672+0000 7f55d4354700 1 Processor -- start 2023-10-07T08:43:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.672+0000 7f55d4354700 1 -- start start 2023-10-07T08:43:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d4354700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55cc06dd60 0x7f55cc0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d4354700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55cc0ceb30 0x7f55cc0cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d4354700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55cc15a2a0 0x7f55cc0c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d4354700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc0b24c0 con 0x7f55cc06dd60 2023-10-07T08:43:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d4354700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc143310 con 0x7f55cc0ceb30 2023-10-07T08:43:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d4354700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc0b3570 con 0x7f55cc15a2a0 2023-10-07T08:43:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d20f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55cc06dd60 0x7f55cc0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d20f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55cc06dd60 0x7f55cc0b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46302/0 (socket says 172.21.15.81:46302) 2023-10-07T08:43:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d20f0700 1 -- 172.21.15.81:0/3272577505 learned_addr learned my addr 172.21.15.81:0/3272577505 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d20f0700 1 -- 172.21.15.81:0/3272577505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55cc15a2a0 msgr2=0x7f55cc0c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d20f0700 1 --2- 172.21.15.81:0/3272577505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55cc15a2a0 0x7f55cc0c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d20f0700 1 -- 172.21.15.81:0/3272577505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55cc0ceb30 msgr2=0x7f55cc0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d20f0700 1 --2- 172.21.15.81:0/3272577505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55cc0ceb30 0x7f55cc0cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d20f0700 1 -- 172.21.15.81:0/3272577505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c8009420 con 0x7f55cc06dd60 2023-10-07T08:43:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d20f0700 1 --2- 172.21.15.81:0/3272577505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55cc06dd60 0x7f55cc0b4610 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f55cc06f990 tx=0x7f55c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55c27fc700 1 -- 172.21.15.81:0/3272577505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c801f070 con 0x7f55cc06dd60 2023-10-07T08:43:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55c27fc700 1 -- 172.21.15.81:0/3272577505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c8000c90 con 0x7f55cc06dd60 2023-10-07T08:43:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d4354700 1 -- 172.21.15.81:0/3272577505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55cc0b3850 con 0x7f55cc06dd60 2023-10-07T08:43:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55c27fc700 1 -- 172.21.15.81:0/3272577505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c800bb40 con 0x7f55cc06dd60 2023-10-07T08:43:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.673+0000 7f55d4354700 1 -- 172.21.15.81:0/3272577505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55cc0b3e90 con 0x7f55cc06dd60 2023-10-07T08:43:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.674+0000 7f55d4354700 1 -- 172.21.15.81:0/3272577505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55cc069e40 con 0x7f55cc06dd60 2023-10-07T08:43:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.675+0000 7f55c27fc700 1 -- 172.21.15.81:0/3272577505 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55c8023070 con 0x7f55cc06dd60 2023-10-07T08:43:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.675+0000 7f55c27fc700 1 --2- 172.21.15.81:0/3272577505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f55b0066f30 0x7f55b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.675+0000 7f55c27fc700 1 -- 172.21.15.81:0/3272577505 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f55c8085950 con 0x7f55cc06dd60 2023-10-07T08:43:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.675+0000 7f55d18ef700 1 --2- 172.21.15.81:0/3272577505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f55b0066f30 0x7f55b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.675+0000 7f55d18ef700 1 --2- 172.21.15.81:0/3272577505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f55b0066f30 0x7f55b00693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0058d0 tx=0x7f55bc0079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.679+0000 7f55c27fc700 1 -- 172.21.15.81:0/3272577505 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55c8052bc0 con 0x7f55cc06dd60 2023-10-07T08:43:24.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.859+0000 7f55d4354700 1 -- 172.21.15.81:0/3272577505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f55cc0b1130 con 0x7f55cc06dd60 2023-10-07T08:43:24.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.860+0000 7f55c27fc700 1 -- 172.21.15.81:0/3272577505 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f55c80150a0 con 0x7f55cc06dd60 2023-10-07T08:43:24.861 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:43:24.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.862+0000 7f55d4354700 1 -- 172.21.15.81:0/3272577505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f55b0066f30 msgr2=0x7f55b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.862+0000 7f55d4354700 1 --2- 172.21.15.81:0/3272577505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f55b0066f30 0x7f55b00693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0058d0 tx=0x7f55bc0079d0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.862+0000 7f55d4354700 1 -- 172.21.15.81:0/3272577505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55cc06dd60 msgr2=0x7f55cc0b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.862+0000 7f55d4354700 1 --2- 172.21.15.81:0/3272577505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55cc06dd60 0x7f55cc0b4610 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f55cc06f990 tx=0x7f55c8017000 comp rx=0 tx=0).stop 2023-10-07T08:43:24.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.862+0000 7f55d4354700 1 -- 172.21.15.81:0/3272577505 shutdown_connections 2023-10-07T08:43:24.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.862+0000 7f55d4354700 1 --2- 172.21.15.81:0/3272577505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f55b0066f30 0x7f55b00693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.862+0000 7f55d4354700 1 --2- 172.21.15.81:0/3272577505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55cc15a2a0 0x7f55cc0c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.862+0000 7f55d4354700 1 --2- 172.21.15.81:0/3272577505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55cc06dd60 0x7f55cc0b4610 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.862+0000 7f55d4354700 1 --2- 172.21.15.81:0/3272577505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55cc0ceb30 0x7f55cc0cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.862+0000 7f55d4354700 1 -- 172.21.15.81:0/3272577505 >> 172.21.15.81:0/3272577505 conn(0x7f55cc067640 msgr2=0x7f55cc158380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:24.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.862+0000 7f55d4354700 1 -- 172.21.15.81:0/3272577505 shutdown_connections 2023-10-07T08:43:24.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.862+0000 7f55d4354700 1 -- 172.21.15.81:0/3272577505 wait complete. 2023-10-07T08:43:24.875 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:24.904 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:43:24.920 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:43:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.991+0000 7f4ca2351700 1 Processor -- start 2023-10-07T08:43:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.991+0000 7f4ca2351700 1 -- start start 2023-10-07T08:43:24.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.992+0000 7f4ca2351700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c9c159f10 0x7f4c9c068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.992+0000 7f4ca2351700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4c9c068cc0 0x7f4c9c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:24.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.992+0000 7f4ca2351700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c9c0cee10 con 0x7f4c9c159b40 2023-10-07T08:43:24.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.992+0000 7f4ca2351700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c9c069140 con 0x7f4c9c068cc0 2023-10-07T08:43:24.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.992+0000 7f4ca2351700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c0cd040 con 0x7f4c9c159f10 2023-10-07T08:43:24.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.992+0000 7f4ca0b4e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c9c159f10 0x7f4c9c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.992+0000 7f4ca1b50700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4c9c068cc0 0x7f4c9c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:24.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.992+0000 7f4ca1b50700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4c9c068cc0 0x7f4c9c0cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:47468/0 (socket says 172.21.15.81:47468) 2023-10-07T08:43:24.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.992+0000 7f4ca134f700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4c9c159b40 0x7f4c9c0cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:40994/0 (socket says 172.21.15.81:40994) 2023-10-07T08:43:24.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.992+0000 7f4ca0b4e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c9c159f10 0x7f4c9c068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:37746/0 (socket says 172.21.15.81:37746) 2023-10-07T08:43:24.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.992+0000 7f4ca1b50700 1 -- 172.21.15.81:0/3674361677 learned_addr learned my addr 172.21.15.81:0/3674361677 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:24.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.993+0000 7f4ca0b4e700 1 -- 172.21.15.81:0/3674361677 >> v2:172.21.15.89:3300/0 conn(0x7f4c9c068cc0 msgr2=0x7f4c9c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:24.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.993+0000 7f4ca0b4e700 1 --2- 172.21.15.81:0/3674361677 >> v2:172.21.15.89:3300/0 conn(0x7f4c9c068cc0 0x7f4c9c0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.993+0000 7f4ca0b4e700 1 -- 172.21.15.81:0/3674361677 >> v1:172.21.15.89:6789/0 conn(0x7f4c9c159b40 legacy=0x7f4c9c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.993+0000 7f4ca0b4e700 1 -- 172.21.15.81:0/3674361677 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c0cd320 con 0x7f4c9c159f10 2023-10-07T08:43:24.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.993+0000 7f4ca1b50700 1 --2- 172.21.15.81:0/3674361677 >> v2:172.21.15.89:3300/0 conn(0x7f4c9c068cc0 0x7f4c9c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:24.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.993+0000 7f4ca0b4e700 1 --2- 172.21.15.81:0/3674361677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c9c159f10 0x7f4c9c068780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0098e0 tx=0x7f4c8c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83ab4a5cb69326d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:24.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.993+0000 7f4c93fff700 1 -- 172.21.15.81:0/3674361677 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c00b640 con 0x7f4c9c159f10 2023-10-07T08:43:24.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.993+0000 7f4c93fff700 1 -- 172.21.15.81:0/3674361677 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c00b7a0 con 0x7f4c9c159f10 2023-10-07T08:43:24.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.993+0000 7f4c93fff700 1 -- 172.21.15.81:0/3674361677 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c00bb40 con 0x7f4c9c159f10 2023-10-07T08:43:24.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.994+0000 7f4ca2351700 1 -- 172.21.15.81:0/3674361677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c9c159f10 msgr2=0x7f4c9c068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:24.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.994+0000 7f4ca2351700 1 --2- 172.21.15.81:0/3674361677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c9c159f10 0x7f4c9c068780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0098e0 tx=0x7f4c8c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.994+0000 7f4ca2351700 1 -- 172.21.15.81:0/3674361677 shutdown_connections 2023-10-07T08:43:24.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.994+0000 7f4ca2351700 1 --2- 172.21.15.81:0/3674361677 >> v2:172.21.15.89:3300/0 conn(0x7f4c9c068cc0 0x7f4c9c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.994+0000 7f4ca2351700 1 --2- 172.21.15.81:0/3674361677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c9c159f10 0x7f4c9c068780 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:24.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.994+0000 7f4ca2351700 1 -- 172.21.15.81:0/3674361677 >> 172.21.15.81:0/3674361677 conn(0x7f4c9c0cd660 msgr2=0x7f4c9c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:24.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.994+0000 7f4ca2351700 1 -- 172.21.15.81:0/3674361677 shutdown_connections 2023-10-07T08:43:24.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.994+0000 7f4ca2351700 1 -- 172.21.15.81:0/3674361677 wait complete. 2023-10-07T08:43:24.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.995+0000 7f4ca2351700 1 Processor -- start 2023-10-07T08:43:24.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.995+0000 7f4ca2351700 1 -- start start 2023-10-07T08:43:25.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca2351700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c9c068cc0 0x7f4c9c16d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca2351700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c9c159b40 0x7f4c9c15bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca2351700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c9c159f10 0x7f4c9c1485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca2351700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c149b10 con 0x7f4c9c068cc0 2023-10-07T08:43:25.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca2351700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c16de80 con 0x7f4c9c159f10 2023-10-07T08:43:25.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca2351700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c0c7ed0 con 0x7f4c9c159b40 2023-10-07T08:43:25.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca134f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c9c068cc0 0x7f4c9c16d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca134f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c9c068cc0 0x7f4c9c16d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46310/0 (socket says 172.21.15.81:46310) 2023-10-07T08:43:25.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca134f700 1 -- 172.21.15.81:0/3219097463 learned_addr learned my addr 172.21.15.81:0/3219097463 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:25.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca1b50700 1 --2- 172.21.15.81:0/3219097463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c9c159f10 0x7f4c9c1485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca0b4e700 1 --2- 172.21.15.81:0/3219097463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c9c159b40 0x7f4c9c15bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca134f700 1 -- 172.21.15.81:0/3219097463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c9c159b40 msgr2=0x7f4c9c15bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:25.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca134f700 1 --2- 172.21.15.81:0/3219097463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c9c159b40 0x7f4c9c15bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca134f700 1 -- 172.21.15.81:0/3219097463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c9c159f10 msgr2=0x7f4c9c1485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:25.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca134f700 1 --2- 172.21.15.81:0/3219097463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c9c159f10 0x7f4c9c1485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca134f700 1 -- 172.21.15.81:0/3219097463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c940094f0 con 0x7f4c9c068cc0 2023-10-07T08:43:25.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca134f700 1 --2- 172.21.15.81:0/3219097463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c9c068cc0 0x7f4c9c16d940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800cdb0 tx=0x7f4c98001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:25.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4c917fa700 1 -- 172.21.15.81:0/3219097463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98005df0 con 0x7f4c9c068cc0 2023-10-07T08:43:25.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4c917fa700 1 -- 172.21.15.81:0/3219097463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9800a870 con 0x7f4c9c068cc0 2023-10-07T08:43:25.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4ca2351700 1 -- 172.21.15.81:0/3219097463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8c009420 con 0x7f4c9c068cc0 2023-10-07T08:43:25.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.996+0000 7f4c917fa700 1 -- 172.21.15.81:0/3219097463 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9800ac10 con 0x7f4c9c068cc0 2023-10-07T08:43:25.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.997+0000 7f4ca2351700 1 -- 172.21.15.81:0/3219097463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9c16e390 con 0x7f4c9c068cc0 2023-10-07T08:43:25.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.997+0000 7f4ca2351700 1 -- 172.21.15.81:0/3219097463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9c0c7c80 con 0x7f4c9c068cc0 2023-10-07T08:43:25.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.998+0000 7f4c917fa700 1 -- 172.21.15.81:0/3219097463 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c980070f0 con 0x7f4c9c068cc0 2023-10-07T08:43:25.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.998+0000 7f4c917fa700 1 --2- 172.21.15.81:0/3219097463 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4c80066f30 0x7f4c800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.998+0000 7f4c917fa700 1 -- 172.21.15.81:0/3219097463 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c98084650 con 0x7f4c9c068cc0 2023-10-07T08:43:25.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.998+0000 7f4ca0b4e700 1 --2- 172.21.15.81:0/3219097463 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4c80066f30 0x7f4c800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:24.999+0000 7f4ca0b4e700 1 --2- 172.21.15.81:0/3219097463 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4c80066f30 0x7f4c800693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0093f0 tx=0x7f4c8c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:25.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.002+0000 7f4c917fa700 1 -- 172.21.15.81:0/3219097463 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c980518c0 con 0x7f4c9c068cc0 2023-10-07T08:43:25.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.187+0000 7f4ca2351700 1 -- 172.21.15.81:0/3219097463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c9c0cca70 con 0x7f4c9c068cc0 2023-10-07T08:43:25.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.187+0000 7f4c917fa700 1 -- 172.21.15.81:0/3219097463 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f4c98054ee0 con 0x7f4c9c068cc0 2023-10-07T08:43:25.189 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:25.189 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:58.248338+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:42:54.397263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:42:55.595133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:25.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.189+0000 7f4ca2351700 1 -- 172.21.15.81:0/3219097463 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4c80066f30 msgr2=0x7f4c800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:25.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.189+0000 7f4ca2351700 1 --2- 172.21.15.81:0/3219097463 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4c80066f30 0x7f4c800693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0093f0 tx=0x7f4c8c017000 comp rx=0 tx=0).stop 2023-10-07T08:43:25.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.189+0000 7f4ca2351700 1 -- 172.21.15.81:0/3219097463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c9c068cc0 msgr2=0x7f4c9c16d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:25.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.189+0000 7f4ca2351700 1 --2- 172.21.15.81:0/3219097463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c9c068cc0 0x7f4c9c16d940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800cdb0 tx=0x7f4c98001b90 comp rx=0 tx=0).stop 2023-10-07T08:43:25.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.189+0000 7f4ca2351700 1 -- 172.21.15.81:0/3219097463 shutdown_connections 2023-10-07T08:43:25.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.189+0000 7f4ca2351700 1 --2- 172.21.15.81:0/3219097463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c9c159f10 0x7f4c9c1485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.189+0000 7f4ca2351700 1 --2- 172.21.15.81:0/3219097463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c9c068cc0 0x7f4c9c16d940 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.189+0000 7f4ca2351700 1 --2- 172.21.15.81:0/3219097463 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4c80066f30 0x7f4c800693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.189+0000 7f4ca2351700 1 --2- 172.21.15.81:0/3219097463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c9c159b40 0x7f4c9c15bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.189+0000 7f4ca2351700 1 -- 172.21.15.81:0/3219097463 >> 172.21.15.81:0/3219097463 conn(0x7f4c9c0cd660 msgr2=0x7f4c9c06e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:25.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.189+0000 7f4ca2351700 1 -- 172.21.15.81:0/3219097463 shutdown_connections 2023-10-07T08:43:25.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.189+0000 7f4ca2351700 1 -- 172.21.15.81:0/3219097463 wait complete. 2023-10-07T08:43:25.203 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:42:54.397263+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:42:55.595133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:43:25.203 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:43:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.359+0000 7f6f16967700 1 Processor -- start 2023-10-07T08:43:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.359+0000 7f6f16967700 1 -- start start 2023-10-07T08:43:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.360+0000 7f6f16967700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6f100d0b80 0x7f6f100cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.360+0000 7f6f16967700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f100d02b0 0x7f6f1006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.360+0000 7f6f16967700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f100cf2d0 con 0x7f6f100d0f50 2023-10-07T08:43:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.360+0000 7f6f16967700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f1015a690 con 0x7f6f100d0b80 2023-10-07T08:43:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.360+0000 7f6f16967700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1006dc00 con 0x7f6f100d02b0 2023-10-07T08:43:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.360+0000 7f6f16166700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6f100d0f50 0x7f6f1015b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53036/0 (socket says 172.21.15.81:53036) 2023-10-07T08:43:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.360+0000 7f6f16166700 1 -- 172.21.15.81:0/3931109775 learned_addr learned my addr 172.21.15.81:0/3931109775 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.360+0000 7f6f15164700 1 --2- 172.21.15.81:0/3931109775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f100d02b0 0x7f6f1006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.360+0000 7f6f15965700 1 --2- 172.21.15.81:0/3931109775 >> v2:172.21.15.89:3300/0 conn(0x7f6f100d0b80 0x7f6f100cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.360+0000 7f6f14963700 1 -- 172.21.15.81:0/3931109775 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005438938 0 0) 0x7f6f100cf2d0 con 0x7f6f100d0f50 2023-10-07T08:43:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.360+0000 7f6f14963700 1 -- 172.21.15.81:0/3931109775 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6efc003570 con 0x7f6f100d0f50 2023-10-07T08:43:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.360+0000 7f6f15164700 1 -- 172.21.15.81:0/3931109775 >> v2:172.21.15.89:3300/0 conn(0x7f6f100d0b80 msgr2=0x7f6f100cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.360+0000 7f6f15164700 1 --2- 172.21.15.81:0/3931109775 >> v2:172.21.15.89:3300/0 conn(0x7f6f100d0b80 0x7f6f100cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.360+0000 7f6f15164700 1 -- 172.21.15.81:0/3931109775 >> v1:172.21.15.81:6789/0 conn(0x7f6f100d0f50 legacy=0x7f6f1015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.360+0000 7f6f14963700 1 -- 172.21.15.81:0/3931109775 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3651125572 0 0) 0x7f6efc003570 con 0x7f6f100d0f50 2023-10-07T08:43:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.360+0000 7f6f15164700 1 -- 172.21.15.81:0/3931109775 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f100cf570 con 0x7f6f100d02b0 2023-10-07T08:43:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.361+0000 7f6f15164700 1 --2- 172.21.15.81:0/3931109775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f100d02b0 0x7f6f1006cff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6f000098e0 tx=0x7f6f000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c6a5bc523b63eb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.361+0000 7f6f14963700 1 -- 172.21.15.81:0/3931109775 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c001470 con 0x7f6f100d02b0 2023-10-07T08:43:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.361+0000 7f6f14963700 1 -- 172.21.15.81:0/3931109775 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f00011420 con 0x7f6f100d02b0 2023-10-07T08:43:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.361+0000 7f6f14963700 1 -- 172.21.15.81:0/3931109775 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f000117c0 con 0x7f6f100d02b0 2023-10-07T08:43:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.361+0000 7f6f16967700 1 -- 172.21.15.81:0/3931109775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f100d02b0 msgr2=0x7f6f1006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.361+0000 7f6f16967700 1 --2- 172.21.15.81:0/3931109775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f100d02b0 0x7f6f1006cff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6f000098e0 tx=0x7f6f000091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.361+0000 7f6f16967700 1 -- 172.21.15.81:0/3931109775 shutdown_connections 2023-10-07T08:43:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.361+0000 7f6f16967700 1 --2- 172.21.15.81:0/3931109775 >> v2:172.21.15.89:3300/0 conn(0x7f6f100d0b80 0x7f6f100cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.361+0000 7f6f16967700 1 --2- 172.21.15.81:0/3931109775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f100d02b0 0x7f6f1006cff0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.361+0000 7f6f16967700 1 -- 172.21.15.81:0/3931109775 >> 172.21.15.81:0/3931109775 conn(0x7f6f10063230 msgr2=0x7f6f10063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.361+0000 7f6f16967700 1 -- 172.21.15.81:0/3931109775 shutdown_connections 2023-10-07T08:43:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.361+0000 7f6f16967700 1 -- 172.21.15.81:0/3931109775 wait complete. 2023-10-07T08:43:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.362+0000 7f6f16967700 1 Processor -- start 2023-10-07T08:43:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.362+0000 7f6f16967700 1 -- start start 2023-10-07T08:43:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.363+0000 7f6f16967700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f100d02b0 0x7f6f100b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.363+0000 7f6f16967700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f100d0b80 0x7f6f100cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.363+0000 7f6f16967700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f100d0f50 0x7f6f100cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.363+0000 7f6f16967700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f100c8580 con 0x7f6f100d0b80 2023-10-07T08:43:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.363+0000 7f6f16967700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f100c7970 con 0x7f6f100d0f50 2023-10-07T08:43:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.363+0000 7f6f16967700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f100c7c50 con 0x7f6f100d02b0 2023-10-07T08:43:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.363+0000 7f6f15164700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f100d0b80 0x7f6f100cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.363+0000 7f6f15164700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f100d0b80 0x7f6f100cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46316/0 (socket says 172.21.15.81:46316) 2023-10-07T08:43:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.363+0000 7f6f15164700 1 -- 172.21.15.81:0/1118315132 learned_addr learned my addr 172.21.15.81:0/1118315132 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.363+0000 7f6f16166700 1 --2- 172.21.15.81:0/1118315132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f100d0f50 0x7f6f100cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.363+0000 7f6f15965700 1 --2- 172.21.15.81:0/1118315132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f100d02b0 0x7f6f100b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.364+0000 7f6f15164700 1 -- 172.21.15.81:0/1118315132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f100d02b0 msgr2=0x7f6f100b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.364+0000 7f6f15164700 1 --2- 172.21.15.81:0/1118315132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f100d02b0 0x7f6f100b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.364+0000 7f6f15164700 1 -- 172.21.15.81:0/1118315132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f100d0f50 msgr2=0x7f6f100cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.364+0000 7f6f15164700 1 --2- 172.21.15.81:0/1118315132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f100d0f50 0x7f6f100cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.364+0000 7f6f15164700 1 -- 172.21.15.81:0/1118315132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f00009420 con 0x7f6f100d0b80 2023-10-07T08:43:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.364+0000 7f6f16166700 1 --2- 172.21.15.81:0/1118315132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f100d0f50 0x7f6f100cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.364+0000 7f6f15965700 1 --2- 172.21.15.81:0/1118315132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f100d02b0 0x7f6f100b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.364+0000 7f6f15164700 1 --2- 172.21.15.81:0/1118315132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f100d0b80 0x7f6f100cbfb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6f000030c0 tx=0x7f6f00016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.364+0000 7f6f05ffb700 1 -- 172.21.15.81:0/1118315132 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0001cc90 con 0x7f6f100d0b80 2023-10-07T08:43:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.364+0000 7f6f05ffb700 1 -- 172.21.15.81:0/1118315132 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0001cdf0 con 0x7f6f100d0b80 2023-10-07T08:43:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.364+0000 7f6f16967700 1 -- 172.21.15.81:0/1118315132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f100c7f30 con 0x7f6f100d0b80 2023-10-07T08:43:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.364+0000 7f6f05ffb700 1 -- 172.21.15.81:0/1118315132 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0001a6a0 con 0x7f6f100d0b80 2023-10-07T08:43:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.364+0000 7f6f16967700 1 -- 172.21.15.81:0/1118315132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f100b27f0 con 0x7f6f100d0b80 2023-10-07T08:43:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.365+0000 7f6f16967700 1 -- 172.21.15.81:0/1118315132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f100676e0 con 0x7f6f100d0b80 2023-10-07T08:43:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.365+0000 7f6f05ffb700 1 -- 172.21.15.81:0/1118315132 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f0001aad0 con 0x7f6f100d0b80 2023-10-07T08:43:25.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.366+0000 7f6f05ffb700 1 --2- 172.21.15.81:0/1118315132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ef4066f30 0x7f6ef40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.366+0000 7f6f05ffb700 1 -- 172.21.15.81:0/1118315132 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f00085f20 con 0x7f6f100d0b80 2023-10-07T08:43:25.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.366+0000 7f6f15965700 1 --2- 172.21.15.81:0/1118315132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ef4066f30 0x7f6ef40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.366+0000 7f6f15965700 1 --2- 172.21.15.81:0/1118315132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ef4066f30 0x7f6ef40693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f080094d0 tx=0x7f6f0800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:25.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.370+0000 7f6f05ffb700 1 -- 172.21.15.81:0/1118315132 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f00053190 con 0x7f6f100d0b80 2023-10-07T08:43:25.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.557+0000 7f6f16967700 1 -- 172.21.15.81:0/1118315132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f100cf850 con 0x7f6f100d0b80 2023-10-07T08:43:25.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.557+0000 7f6f05ffb700 1 -- 172.21.15.81:0/1118315132 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f000567b0 con 0x7f6f100d0b80 2023-10-07T08:43:25.559 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:43:25.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.559+0000 7f6f16967700 1 -- 172.21.15.81:0/1118315132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ef4066f30 msgr2=0x7f6ef40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:25.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.559+0000 7f6f16967700 1 --2- 172.21.15.81:0/1118315132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ef4066f30 0x7f6ef40693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f080094d0 tx=0x7f6f0800b040 comp rx=0 tx=0).stop 2023-10-07T08:43:25.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.559+0000 7f6f16967700 1 -- 172.21.15.81:0/1118315132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f100d0b80 msgr2=0x7f6f100cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:25.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.559+0000 7f6f16967700 1 --2- 172.21.15.81:0/1118315132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f100d0b80 0x7f6f100cbfb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6f000030c0 tx=0x7f6f00016000 comp rx=0 tx=0).stop 2023-10-07T08:43:25.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.559+0000 7f6f16967700 1 -- 172.21.15.81:0/1118315132 shutdown_connections 2023-10-07T08:43:25.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.559+0000 7f6f16967700 1 --2- 172.21.15.81:0/1118315132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f100d0f50 0x7f6f100cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.559+0000 7f6f16967700 1 --2- 172.21.15.81:0/1118315132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ef4066f30 0x7f6ef40693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.559+0000 7f6f16967700 1 --2- 172.21.15.81:0/1118315132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f100d02b0 0x7f6f100b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.559+0000 7f6f16967700 1 --2- 172.21.15.81:0/1118315132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f100d0b80 0x7f6f100cbfb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.559+0000 7f6f16967700 1 -- 172.21.15.81:0/1118315132 >> 172.21.15.81:0/1118315132 conn(0x7f6f10063230 msgr2=0x7f6f100689a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:25.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.559+0000 7f6f16967700 1 -- 172.21.15.81:0/1118315132 shutdown_connections 2023-10-07T08:43:25.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.559+0000 7f6f16967700 1 -- 172.21.15.81:0/1118315132 wait complete. 2023-10-07T08:43:25.572 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:43:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.687+0000 7f9880679700 1 Processor -- start 2023-10-07T08:43:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.687+0000 7f9880679700 1 -- start start 2023-10-07T08:43:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.688+0000 7f9880679700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98780b3bd0 0x7f98780ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.688+0000 7f9880679700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f98781583b0 0x7f98780cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.688+0000 7f9880679700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98780b2890 con 0x7f9878157fe0 2023-10-07T08:43:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.688+0000 7f9880679700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98780b4070 con 0x7f98781583b0 2023-10-07T08:43:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.688+0000 7f9880679700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98780b4350 con 0x7f98780b3bd0 2023-10-07T08:43:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.688+0000 7f987e415700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9878157fe0 0x7f98780b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53048/0 (socket says 172.21.15.81:53048) 2023-10-07T08:43:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.688+0000 7f987e415700 1 -- 172.21.15.81:0/1786717793 learned_addr learned my addr 172.21.15.81:0/1786717793 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987d413700 1 -- 172.21.15.81:0/1786717793 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305474463 0 0) 0x7f98780b2890 con 0x7f9878157fe0 2023-10-07T08:43:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987d413700 1 -- 172.21.15.81:0/1786717793 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9864003570 con 0x7f9878157fe0 2023-10-07T08:43:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987ec16700 1 --2- 172.21.15.81:0/1786717793 >> v2:172.21.15.89:3300/0 conn(0x7f98781583b0 0x7f98780cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987dc14700 1 --2- 172.21.15.81:0/1786717793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98780b3bd0 0x7f98780ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987d413700 1 -- 172.21.15.81:0/1786717793 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 875089090 0 0) 0x7f9864003570 con 0x7f9878157fe0 2023-10-07T08:43:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987d413700 1 -- 172.21.15.81:0/1786717793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98780b3bd0 msgr2=0x7f98780ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987d413700 1 --2- 172.21.15.81:0/1786717793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98780b3bd0 0x7f98780ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987d413700 1 -- 172.21.15.81:0/1786717793 >> v2:172.21.15.89:3300/0 conn(0x7f98781583b0 msgr2=0x7f98780cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987d413700 1 --2- 172.21.15.81:0/1786717793 >> v2:172.21.15.89:3300/0 conn(0x7f98781583b0 0x7f98780cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987d413700 1 -- 172.21.15.81:0/1786717793 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98780b4630 con 0x7f9878157fe0 2023-10-07T08:43:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987d413700 1 -- 172.21.15.81:0/1786717793 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f98740017f0 con 0x7f9878157fe0 2023-10-07T08:43:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987d413700 1 -- 172.21.15.81:0/1786717793 >> v1:172.21.15.81:6789/0 conn(0x7f9878157fe0 legacy=0x7f98780b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987d413700 1 --2- 172.21.15.81:0/1786717793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9864003a60 0x7f9864003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987d413700 1 --2- 172.21.15.81:0/1786717793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9864004810 0x7f9864004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987d413700 1 --2- 172.21.15.81:0/1786717793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98640051c0 0x7f986400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987d413700 1 -- 172.21.15.81:0/1786717793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98780b4070 con 0x7f9864003a60 2023-10-07T08:43:25.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987d413700 1 -- 172.21.15.81:0/1786717793 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98780b4350 con 0x7f9864004810 2023-10-07T08:43:25.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987d413700 1 -- 172.21.15.81:0/1786717793 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986400c050 con 0x7f98640051c0 2023-10-07T08:43:25.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987dc14700 1 --2- 172.21.15.81:0/1786717793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98780b3bd0 0x7f98780ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:25.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987e415700 1 --2- 172.21.15.81:0/1786717793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9864003a60 0x7f9864003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987ec16700 1 --2- 172.21.15.81:0/1786717793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98640051c0 0x7f986400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987dc14700 1 --2- 172.21.15.81:0/1786717793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9864004810 0x7f9864004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987e415700 1 -- 172.21.15.81:0/1786717793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98640051c0 msgr2=0x7f986400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:25.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987e415700 1 --2- 172.21.15.81:0/1786717793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98640051c0 0x7f986400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987e415700 1 -- 172.21.15.81:0/1786717793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9864004810 msgr2=0x7f9864004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:25.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987e415700 1 --2- 172.21.15.81:0/1786717793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9864004810 0x7f9864004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987e415700 1 -- 172.21.15.81:0/1786717793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9864003570 con 0x7f9864003a60 2023-10-07T08:43:25.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.689+0000 7f987ec16700 1 --2- 172.21.15.81:0/1786717793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98640051c0 0x7f986400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:25.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.690+0000 7f987e415700 1 --2- 172.21.15.81:0/1786717793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9864003a60 0x7f9864003e70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f987400a970 tx=0x7f9874002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb75bdb5f01fc616 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:25.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.690+0000 7f987d413700 1 -- 172.21.15.81:0/1786717793 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740070d0 con 0x7f9864003a60 2023-10-07T08:43:25.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.690+0000 7f987d413700 1 -- 172.21.15.81:0/1786717793 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9874007230 con 0x7f9864003a60 2023-10-07T08:43:25.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.690+0000 7f987d413700 1 -- 172.21.15.81:0/1786717793 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740075f0 con 0x7f9864003a60 2023-10-07T08:43:25.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.690+0000 7f9880679700 1 -- 172.21.15.81:0/1786717793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9864003a60 msgr2=0x7f9864003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:25.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.690+0000 7f9880679700 1 --2- 172.21.15.81:0/1786717793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9864003a60 0x7f9864003e70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f987400a970 tx=0x7f9874002210 comp rx=0 tx=0).stop 2023-10-07T08:43:25.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.690+0000 7f987ec16700 1 -- 172.21.15.81:0/1786717793 reap_dead start 2023-10-07T08:43:25.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.690+0000 7f9880679700 1 -- 172.21.15.81:0/1786717793 shutdown_connections 2023-10-07T08:43:25.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.690+0000 7f9880679700 1 -- 172.21.15.81:0/1786717793 >> 172.21.15.81:0/1786717793 conn(0x7f9878067640 msgr2=0x7f9878067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:25.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.690+0000 7f9880679700 1 -- 172.21.15.81:0/1786717793 shutdown_connections 2023-10-07T08:43:25.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.690+0000 7f9880679700 1 -- 172.21.15.81:0/1786717793 wait complete. 2023-10-07T08:43:25.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.691+0000 7f9880679700 1 Processor -- start 2023-10-07T08:43:25.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.691+0000 7f9880679700 1 -- start start 2023-10-07T08:43:25.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.692+0000 7f9880679700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9864003a60 0x7f987816d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.692+0000 7f9880679700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98780c7d50 0x7f98780c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.692+0000 7f9880679700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f987806dc70 0x7f987806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.692+0000 7f9880679700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98780caa60 con 0x7f98780c7d50 2023-10-07T08:43:25.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.692+0000 7f9880679700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98780c9490 con 0x7f9864003a60 2023-10-07T08:43:25.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.692+0000 7f9880679700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987806e620 con 0x7f987806dc70 2023-10-07T08:43:25.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.692+0000 7f987dc14700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98780c7d50 0x7f98780c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.692+0000 7f987dc14700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98780c7d50 0x7f98780c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46332/0 (socket says 172.21.15.81:46332) 2023-10-07T08:43:25.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.692+0000 7f987dc14700 1 -- 172.21.15.81:0/729511232 learned_addr learned my addr 172.21.15.81:0/729511232 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:25.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.692+0000 7f987ec16700 1 --2- 172.21.15.81:0/729511232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f987806dc70 0x7f987806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.692+0000 7f987e415700 1 --2- 172.21.15.81:0/729511232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9864003a60 0x7f987816d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.692+0000 7f987dc14700 1 -- 172.21.15.81:0/729511232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f987806dc70 msgr2=0x7f987806e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:25.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.692+0000 7f987dc14700 1 --2- 172.21.15.81:0/729511232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f987806dc70 0x7f987806e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.692+0000 7f987dc14700 1 -- 172.21.15.81:0/729511232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9864003a60 msgr2=0x7f987816d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:25.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.692+0000 7f987dc14700 1 --2- 172.21.15.81:0/729511232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9864003a60 0x7f987816d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.692+0000 7f987dc14700 1 -- 172.21.15.81:0/729511232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98780c8810 con 0x7f98780c7d50 2023-10-07T08:43:25.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.693+0000 7f987dc14700 1 --2- 172.21.15.81:0/729511232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98780c7d50 0x7f98780c81a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9868010900 tx=0x7f9868008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:25.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.693+0000 7f986e7fc700 1 -- 172.21.15.81:0/729511232 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9868010e40 con 0x7f98780c7d50 2023-10-07T08:43:25.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.693+0000 7f986e7fc700 1 -- 172.21.15.81:0/729511232 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986800c850 con 0x7f98780c7d50 2023-10-07T08:43:25.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.693+0000 7f986e7fc700 1 -- 172.21.15.81:0/729511232 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986800cbf0 con 0x7f98780c7d50 2023-10-07T08:43:25.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.693+0000 7f9880679700 1 -- 172.21.15.81:0/729511232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98780c8af0 con 0x7f98780c7d50 2023-10-07T08:43:25.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.693+0000 7f9880679700 1 -- 172.21.15.81:0/729511232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98780c90b0 con 0x7f98780c7d50 2023-10-07T08:43:25.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.694+0000 7f9880679700 1 -- 172.21.15.81:0/729511232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9878069e40 con 0x7f98780c7d50 2023-10-07T08:43:25.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.694+0000 7f986e7fc700 1 -- 172.21.15.81:0/729511232 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f986800cd50 con 0x7f98780c7d50 2023-10-07T08:43:25.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.694+0000 7f986e7fc700 1 --2- 172.21.15.81:0/729511232 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f985c066f30 0x7f985c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:25.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.694+0000 7f986e7fc700 1 -- 172.21.15.81:0/729511232 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9868084f90 con 0x7f98780c7d50 2023-10-07T08:43:25.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.694+0000 7f987e415700 1 --2- 172.21.15.81:0/729511232 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f985c066f30 0x7f985c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:25.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.695+0000 7f987e415700 1 --2- 172.21.15.81:0/729511232 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f985c066f30 0x7f985c0693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f98780cad50 tx=0x7f9874015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:25.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.699+0000 7f986e7fc700 1 -- 172.21.15.81:0/729511232 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98680b65a0 con 0x7f98780c7d50 2023-10-07T08:43:25.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.879+0000 7f9880679700 1 -- 172.21.15.81:0/729511232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98780cc6b0 con 0x7f98780c7d50 2023-10-07T08:43:25.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.880+0000 7f986e7fc700 1 -- 172.21.15.81:0/729511232 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9868052200 con 0x7f98780c7d50 2023-10-07T08:43:25.881 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:43:25.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.882+0000 7f9880679700 1 -- 172.21.15.81:0/729511232 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f985c066f30 msgr2=0x7f985c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:25.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.882+0000 7f9880679700 1 --2- 172.21.15.81:0/729511232 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f985c066f30 0x7f985c0693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f98780cad50 tx=0x7f9874015000 comp rx=0 tx=0).stop 2023-10-07T08:43:25.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.882+0000 7f9880679700 1 -- 172.21.15.81:0/729511232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98780c7d50 msgr2=0x7f98780c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:25.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.882+0000 7f9880679700 1 --2- 172.21.15.81:0/729511232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98780c7d50 0x7f98780c81a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9868010900 tx=0x7f9868008040 comp rx=0 tx=0).stop 2023-10-07T08:43:25.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.882+0000 7f9880679700 1 -- 172.21.15.81:0/729511232 shutdown_connections 2023-10-07T08:43:25.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.882+0000 7f9880679700 1 --2- 172.21.15.81:0/729511232 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f985c066f30 0x7f985c0693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.882+0000 7f9880679700 1 --2- 172.21.15.81:0/729511232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f987806dc70 0x7f987806e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.882+0000 7f9880679700 1 --2- 172.21.15.81:0/729511232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9864003a60 0x7f987816d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.882+0000 7f9880679700 1 --2- 172.21.15.81:0/729511232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98780c7d50 0x7f98780c81a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:25.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.882+0000 7f9880679700 1 -- 172.21.15.81:0/729511232 >> 172.21.15.81:0/729511232 conn(0x7f9878067640 msgr2=0x7f98780cb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:25.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.882+0000 7f9880679700 1 -- 172.21.15.81:0/729511232 shutdown_connections 2023-10-07T08:43:25.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:25.882+0000 7f9880679700 1 -- 172.21.15.81:0/729511232 wait complete. 2023-10-07T08:43:25.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:43:26.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.011+0000 7f2022b95700 1 Processor -- start 2023-10-07T08:43:26.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.011+0000 7f2022b95700 1 -- start start 2023-10-07T08:43:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.012+0000 7f2022b95700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f201c0d0f50 0x7f201c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.012+0000 7f2022b95700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f201c06d530 0x7f201c15b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.012+0000 7f2022b95700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201c06d990 con 0x7f201c0d0b80 2023-10-07T08:43:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.012+0000 7f2022b95700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201c15a690 con 0x7f201c06d530 2023-10-07T08:43:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.012+0000 7f2022b95700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201c0cf2d0 con 0x7f201c0d0f50 2023-10-07T08:43:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.012+0000 7f2022394700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f201c06d530 0x7f201c15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.012+0000 7f2021b93700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f201c0d0b80 0x7f201c0cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53062/0 (socket says 172.21.15.81:53062) 2023-10-07T08:43:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.012+0000 7f2022394700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f201c06d530 0x7f201c15b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46348/0 (socket says 172.21.15.81:46348) 2023-10-07T08:43:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.012+0000 7f2021b93700 1 -- 172.21.15.81:0/3277321653 learned_addr learned my addr 172.21.15.81:0/3277321653 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.012+0000 7f2021392700 1 --2- 172.21.15.81:0/3277321653 >> v2:172.21.15.89:3300/0 conn(0x7f201c0d0f50 0x7f201c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.012+0000 7f2022394700 1 -- 172.21.15.81:0/3277321653 >> v2:172.21.15.89:3300/0 conn(0x7f201c0d0f50 msgr2=0x7f201c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.012+0000 7f2022394700 1 --2- 172.21.15.81:0/3277321653 >> v2:172.21.15.89:3300/0 conn(0x7f201c0d0f50 0x7f201c06cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.012+0000 7f2022394700 1 -- 172.21.15.81:0/3277321653 >> v1:172.21.15.81:6789/0 conn(0x7f201c0d0b80 legacy=0x7f201c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.012+0000 7f2020b91700 1 -- 172.21.15.81:0/3277321653 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521362566 0 0) 0x7f201c06d990 con 0x7f201c0d0b80 2023-10-07T08:43:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.012+0000 7f2022394700 1 -- 172.21.15.81:0/3277321653 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c0d0480 con 0x7f201c06d530 2023-10-07T08:43:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.012+0000 7f2022394700 1 --2- 172.21.15.81:0/3277321653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c06d530 0x7f201c15b320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f201c0cecc0 tx=0x7f2014009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f797411f780fc1b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.013+0000 7f2020b91700 1 -- 172.21.15.81:0/3277321653 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201400e070 con 0x7f201c06d530 2023-10-07T08:43:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.013+0000 7f2020b91700 1 -- 172.21.15.81:0/3277321653 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201400bc30 con 0x7f201c06d530 2023-10-07T08:43:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.013+0000 7f2020b91700 1 -- 172.21.15.81:0/3277321653 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014012430 con 0x7f201c06d530 2023-10-07T08:43:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.013+0000 7f2022b95700 1 -- 172.21.15.81:0/3277321653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c06d530 msgr2=0x7f201c15b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.013+0000 7f2022b95700 1 --2- 172.21.15.81:0/3277321653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c06d530 0x7f201c15b320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f201c0cecc0 tx=0x7f2014009780 comp rx=0 tx=0).stop 2023-10-07T08:43:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.013+0000 7f2022b95700 1 -- 172.21.15.81:0/3277321653 shutdown_connections 2023-10-07T08:43:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.013+0000 7f2022b95700 1 --2- 172.21.15.81:0/3277321653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c06d530 0x7f201c15b320 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.013+0000 7f2022b95700 1 --2- 172.21.15.81:0/3277321653 >> v2:172.21.15.89:3300/0 conn(0x7f201c0d0f50 0x7f201c06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.013+0000 7f2022b95700 1 -- 172.21.15.81:0/3277321653 >> 172.21.15.81:0/3277321653 conn(0x7f201c063230 msgr2=0x7f201c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.013+0000 7f2022b95700 1 -- 172.21.15.81:0/3277321653 shutdown_connections 2023-10-07T08:43:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.013+0000 7f2022b95700 1 -- 172.21.15.81:0/3277321653 wait complete. 2023-10-07T08:43:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.014+0000 7f2022b95700 1 Processor -- start 2023-10-07T08:43:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.014+0000 7f2022b95700 1 -- start start 2023-10-07T08:43:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.015+0000 7f2022b95700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c06d530 0x7f201c14a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.015+0000 7f2022b95700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f201c0d0b80 0x7f201c0b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.015+0000 7f2022b95700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f201c0d0f50 0x7f201c0b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.015+0000 7f2022b95700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c0af4b0 con 0x7f201c06d530 2023-10-07T08:43:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.015+0000 7f2022b95700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c0b0030 con 0x7f201c0d0f50 2023-10-07T08:43:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.015+0000 7f2022b95700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c14ac60 con 0x7f201c0d0b80 2023-10-07T08:43:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.015+0000 7f2021b93700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c06d530 0x7f201c14a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.015+0000 7f2021b93700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c06d530 0x7f201c14a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46364/0 (socket says 172.21.15.81:46364) 2023-10-07T08:43:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.015+0000 7f2021b93700 1 -- 172.21.15.81:0/515751147 learned_addr learned my addr 172.21.15.81:0/515751147 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.015+0000 7f2021b93700 1 -- 172.21.15.81:0/515751147 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f201c0d0b80 msgr2=0x7f201c0b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.015+0000 7f2021b93700 1 --2- 172.21.15.81:0/515751147 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f201c0d0b80 0x7f201c0b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.015+0000 7f2021b93700 1 -- 172.21.15.81:0/515751147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f201c0d0f50 msgr2=0x7f201c0b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.015+0000 7f2021b93700 1 --2- 172.21.15.81:0/515751147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f201c0d0f50 0x7f201c0b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.015+0000 7f2021b93700 1 -- 172.21.15.81:0/515751147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2014009a20 con 0x7f201c06d530 2023-10-07T08:43:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.015+0000 7f2021b93700 1 --2- 172.21.15.81:0/515751147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c06d530 0x7f201c14a720 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f201800c7e0 tx=0x7f2018007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.016+0000 7f2011ffb700 1 -- 172.21.15.81:0/515751147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018005b30 con 0x7f201c06d530 2023-10-07T08:43:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.016+0000 7f2011ffb700 1 -- 172.21.15.81:0/515751147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2018005c90 con 0x7f201c06d530 2023-10-07T08:43:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.016+0000 7f2022b95700 1 -- 172.21.15.81:0/515751147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f201c0af700 con 0x7f201c06d530 2023-10-07T08:43:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.016+0000 7f2011ffb700 1 -- 172.21.15.81:0/515751147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018007300 con 0x7f201c06d530 2023-10-07T08:43:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.016+0000 7f2022b95700 1 -- 172.21.15.81:0/515751147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201c0afcc0 con 0x7f201c06d530 2023-10-07T08:43:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.017+0000 7f2022b95700 1 -- 172.21.15.81:0/515751147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201c0676e0 con 0x7f201c06d530 2023-10-07T08:43:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.017+0000 7f2011ffb700 1 -- 172.21.15.81:0/515751147 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f201801b400 con 0x7f201c06d530 2023-10-07T08:43:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.017+0000 7f2011ffb700 1 --2- 172.21.15.81:0/515751147 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2000066f30 0x7f20000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.017+0000 7f2011ffb700 1 -- 172.21.15.81:0/515751147 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2018083fe0 con 0x7f201c06d530 2023-10-07T08:43:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.017+0000 7f2021392700 1 --2- 172.21.15.81:0/515751147 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2000066f30 0x7f20000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.018+0000 7f2021392700 1 --2- 172.21.15.81:0/515751147 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2000066f30 0x7f20000693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f200c009a40 tx=0x7f200c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.022+0000 7f2011ffb700 1 -- 172.21.15.81:0/515751147 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20180512d0 con 0x7f201c06d530 2023-10-07T08:43:26.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.202+0000 7f2022b95700 1 -- 172.21.15.81:0/515751147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f201c06dc00 con 0x7f201c06d530 2023-10-07T08:43:26.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.202+0000 7f2011ffb700 1 -- 172.21.15.81:0/515751147 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20180548f0 con 0x7f201c06d530 2023-10-07T08:43:26.204 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:43:26.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.204+0000 7f2022b95700 1 -- 172.21.15.81:0/515751147 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2000066f30 msgr2=0x7f20000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.204+0000 7f2022b95700 1 --2- 172.21.15.81:0/515751147 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2000066f30 0x7f20000693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f200c009a40 tx=0x7f200c008040 comp rx=0 tx=0).stop 2023-10-07T08:43:26.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.204+0000 7f2022b95700 1 -- 172.21.15.81:0/515751147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c06d530 msgr2=0x7f201c14a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.204+0000 7f2022b95700 1 --2- 172.21.15.81:0/515751147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c06d530 0x7f201c14a720 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f201800c7e0 tx=0x7f2018007df0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.204+0000 7f2022b95700 1 -- 172.21.15.81:0/515751147 shutdown_connections 2023-10-07T08:43:26.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.204+0000 7f2022b95700 1 --2- 172.21.15.81:0/515751147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f201c0d0f50 0x7f201c0b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.204+0000 7f2022b95700 1 --2- 172.21.15.81:0/515751147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c06d530 0x7f201c14a720 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.204+0000 7f2022b95700 1 --2- 172.21.15.81:0/515751147 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2000066f30 0x7f20000693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.204+0000 7f2022b95700 1 --2- 172.21.15.81:0/515751147 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f201c0d0b80 0x7f201c0b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.204+0000 7f2022b95700 1 -- 172.21.15.81:0/515751147 >> 172.21.15.81:0/515751147 conn(0x7f201c063230 msgr2=0x7f201c0b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:26.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.204+0000 7f2022b95700 1 -- 172.21.15.81:0/515751147 shutdown_connections 2023-10-07T08:43:26.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.204+0000 7f2022b95700 1 -- 172.21.15.81:0/515751147 wait complete. 2023-10-07T08:43:26.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:26.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.330+0000 7f5adb470700 1 Processor -- start 2023-10-07T08:43:26.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.330+0000 7f5adb470700 1 -- start start 2023-10-07T08:43:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5adb470700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ad41578d0 0x7f5ad40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5adb470700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5ad4157ca0 0x7f5ad415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5adb470700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad406d120 0x7f5ad406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5adb470700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad40d07c0 con 0x7f5ad41578d0 2023-10-07T08:43:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5adb470700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad406daa0 con 0x7f5ad4157ca0 2023-10-07T08:43:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5adb470700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40cfbb0 con 0x7f5ad406d120 2023-10-07T08:43:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5ad920c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ad41578d0 0x7f5ad40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5ad920c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ad41578d0 0x7f5ad40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46368/0 (socket says 172.21.15.81:46368) 2023-10-07T08:43:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5ad920c700 1 -- 172.21.15.81:0/2983790056 learned_addr learned my addr 172.21.15.81:0/2983790056 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5ad9a0d700 1 --2- 172.21.15.81:0/2983790056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad406d120 0x7f5ad406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5ad8a0b700 1 --2- 172.21.15.81:0/2983790056 >> v2:172.21.15.89:3300/0 conn(0x7f5ad4157ca0 0x7f5ad415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5ad920c700 1 -- 172.21.15.81:0/2983790056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad406d120 msgr2=0x7f5ad406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5ad920c700 1 --2- 172.21.15.81:0/2983790056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad406d120 0x7f5ad406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5ad920c700 1 -- 172.21.15.81:0/2983790056 >> v2:172.21.15.89:3300/0 conn(0x7f5ad4157ca0 msgr2=0x7f5ad415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5ad920c700 1 --2- 172.21.15.81:0/2983790056 >> v2:172.21.15.89:3300/0 conn(0x7f5ad4157ca0 0x7f5ad415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5ad920c700 1 -- 172.21.15.81:0/2983790056 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad40cfe90 con 0x7f5ad41578d0 2023-10-07T08:43:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5ad9a0d700 1 --2- 172.21.15.81:0/2983790056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad406d120 0x7f5ad406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5ad8a0b700 1 --2- 172.21.15.81:0/2983790056 >> v2:172.21.15.89:3300/0 conn(0x7f5ad4157ca0 0x7f5ad415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5ad920c700 1 --2- 172.21.15.81:0/2983790056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad41578d0 0x7f5ad40cf4f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4068510 tx=0x7f5ad0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc771ea20f5c2b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5acbfff700 1 -- 172.21.15.81:0/2983790056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000b860 con 0x7f5ad41578d0 2023-10-07T08:43:26.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5acbfff700 1 -- 172.21.15.81:0/2983790056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad000b9c0 con 0x7f5ad41578d0 2023-10-07T08:43:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.331+0000 7f5acbfff700 1 -- 172.21.15.81:0/2983790056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000bd60 con 0x7f5ad41578d0 2023-10-07T08:43:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.332+0000 7f5adb470700 1 -- 172.21.15.81:0/2983790056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad41578d0 msgr2=0x7f5ad40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.332+0000 7f5adb470700 1 --2- 172.21.15.81:0/2983790056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad41578d0 0x7f5ad40cf4f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4068510 tx=0x7f5ad0009250 comp rx=0 tx=0).stop 2023-10-07T08:43:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.332+0000 7f5adb470700 1 -- 172.21.15.81:0/2983790056 shutdown_connections 2023-10-07T08:43:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.332+0000 7f5adb470700 1 --2- 172.21.15.81:0/2983790056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad406d120 0x7f5ad406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.332+0000 7f5adb470700 1 --2- 172.21.15.81:0/2983790056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad41578d0 0x7f5ad40cf4f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.332+0000 7f5adb470700 1 --2- 172.21.15.81:0/2983790056 >> v2:172.21.15.89:3300/0 conn(0x7f5ad4157ca0 0x7f5ad415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.332+0000 7f5adb470700 1 -- 172.21.15.81:0/2983790056 >> 172.21.15.81:0/2983790056 conn(0x7f5ad406bb90 msgr2=0x7f5ad406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.332+0000 7f5adb470700 1 -- 172.21.15.81:0/2983790056 shutdown_connections 2023-10-07T08:43:26.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.332+0000 7f5adb470700 1 -- 172.21.15.81:0/2983790056 wait complete. 2023-10-07T08:43:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.333+0000 7f5adb470700 1 Processor -- start 2023-10-07T08:43:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.333+0000 7f5adb470700 1 -- start start 2023-10-07T08:43:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5adb470700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad406d120 0x7f5ad414a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5adb470700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad41578d0 0x7f5ad40b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5adb470700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ad4157ca0 0x7f5ad41528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5adb470700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad414e810 con 0x7f5ad41578d0 2023-10-07T08:43:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5adb470700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad414e9a0 con 0x7f5ad4157ca0 2023-10-07T08:43:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5adb470700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40b5000 con 0x7f5ad406d120 2023-10-07T08:43:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5ad8a0b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad41578d0 0x7f5ad40b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5ad8a0b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad41578d0 0x7f5ad40b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46374/0 (socket says 172.21.15.81:46374) 2023-10-07T08:43:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5ad8a0b700 1 -- 172.21.15.81:0/723656852 learned_addr learned my addr 172.21.15.81:0/723656852 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5ad920c700 1 --2- 172.21.15.81:0/723656852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad406d120 0x7f5ad414a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5ad9a0d700 1 --2- 172.21.15.81:0/723656852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ad4157ca0 0x7f5ad41528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5ad8a0b700 1 -- 172.21.15.81:0/723656852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad406d120 msgr2=0x7f5ad414a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5ad8a0b700 1 --2- 172.21.15.81:0/723656852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad406d120 0x7f5ad414a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5ad8a0b700 1 -- 172.21.15.81:0/723656852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ad4157ca0 msgr2=0x7f5ad41528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5ad8a0b700 1 --2- 172.21.15.81:0/723656852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ad4157ca0 0x7f5ad41528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5ad8a0b700 1 -- 172.21.15.81:0/723656852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad00094f0 con 0x7f5ad41578d0 2023-10-07T08:43:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.334+0000 7f5ad920c700 1 --2- 172.21.15.81:0/723656852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad406d120 0x7f5ad414a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.335+0000 7f5ad8a0b700 1 --2- 172.21.15.81:0/723656852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad41578d0 0x7f5ad40b45b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400c800 tx=0x7f5ac4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.335+0000 7f5ac97fa700 1 -- 172.21.15.81:0/723656852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4011600 con 0x7f5ad41578d0 2023-10-07T08:43:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.335+0000 7f5ac97fa700 1 -- 172.21.15.81:0/723656852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac4011760 con 0x7f5ad41578d0 2023-10-07T08:43:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.335+0000 7f5adb470700 1 -- 172.21.15.81:0/723656852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad40b52e0 con 0x7f5ad41578d0 2023-10-07T08:43:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.335+0000 7f5ac97fa700 1 -- 172.21.15.81:0/723656852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4011ae0 con 0x7f5ad41578d0 2023-10-07T08:43:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.335+0000 7f5adb470700 1 -- 172.21.15.81:0/723656852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad40b5670 con 0x7f5ad41578d0 2023-10-07T08:43:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.336+0000 7f5adb470700 1 -- 172.21.15.81:0/723656852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad414eb10 con 0x7f5ad41578d0 2023-10-07T08:43:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.336+0000 7f5ac97fa700 1 -- 172.21.15.81:0/723656852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ac4021350 con 0x7f5ad41578d0 2023-10-07T08:43:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.336+0000 7f5ac97fa700 1 --2- 172.21.15.81:0/723656852 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ab8066f30 0x7f5ab80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.336+0000 7f5ac97fa700 1 -- 172.21.15.81:0/723656852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ac4084380 con 0x7f5ad41578d0 2023-10-07T08:43:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.336+0000 7f5ad920c700 1 --2- 172.21.15.81:0/723656852 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ab8066f30 0x7f5ab80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.337+0000 7f5ad920c700 1 --2- 172.21.15.81:0/723656852 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ab8066f30 0x7f5ab80693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4068510 tx=0x7f5ad0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.340+0000 7f5ac97fa700 1 -- 172.21.15.81:0/723656852 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ac4055080 con 0x7f5ad41578d0 2023-10-07T08:43:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.526+0000 7f5adb470700 1 -- 172.21.15.81:0/723656852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ad4069b30 con 0x7f5ad41578d0 2023-10-07T08:43:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.527+0000 7f5ac97fa700 1 -- 172.21.15.81:0/723656852 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f5ac4054c10 con 0x7f5ad41578d0 2023-10-07T08:43:26.528 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:26.528 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:58.248338+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:42:54.397263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:42:55.595133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.529+0000 7f5adb470700 1 -- 172.21.15.81:0/723656852 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ab8066f30 msgr2=0x7f5ab80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.529+0000 7f5adb470700 1 --2- 172.21.15.81:0/723656852 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ab8066f30 0x7f5ab80693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4068510 tx=0x7f5ad0017000 comp rx=0 tx=0).stop 2023-10-07T08:43:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.529+0000 7f5adb470700 1 -- 172.21.15.81:0/723656852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad41578d0 msgr2=0x7f5ad40b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.529+0000 7f5adb470700 1 --2- 172.21.15.81:0/723656852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad41578d0 0x7f5ad40b45b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400c800 tx=0x7f5ac4008040 comp rx=0 tx=0).stop 2023-10-07T08:43:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.529+0000 7f5adb470700 1 -- 172.21.15.81:0/723656852 shutdown_connections 2023-10-07T08:43:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.529+0000 7f5adb470700 1 --2- 172.21.15.81:0/723656852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ad4157ca0 0x7f5ad41528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.529+0000 7f5adb470700 1 --2- 172.21.15.81:0/723656852 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ab8066f30 0x7f5ab80693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.529+0000 7f5adb470700 1 --2- 172.21.15.81:0/723656852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad406d120 0x7f5ad414a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.529+0000 7f5adb470700 1 --2- 172.21.15.81:0/723656852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad41578d0 0x7f5ad40b45b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.529+0000 7f5adb470700 1 -- 172.21.15.81:0/723656852 >> 172.21.15.81:0/723656852 conn(0x7f5ad406bb90 msgr2=0x7f5ad41556b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:26.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.529+0000 7f5adb470700 1 -- 172.21.15.81:0/723656852 shutdown_connections 2023-10-07T08:43:26.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.529+0000 7f5adb470700 1 -- 172.21.15.81:0/723656852 wait complete. 2023-10-07T08:43:26.543 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:42:54.397263+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:42:55.595133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:43:26.543 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:43:26.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.660+0000 7f48d9da8700 1 Processor -- start 2023-10-07T08:43:26.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.660+0000 7f48d9da8700 1 -- start start 2023-10-07T08:43:26.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.661+0000 7f48d9da8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f48d4157ca0 0x7f48d40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.661+0000 7f48d9da8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d40d07c0 con 0x7f48d406d120 2023-10-07T08:43:26.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.661+0000 7f48d9da8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d40cfbb0 con 0x7f48d41578d0 2023-10-07T08:43:26.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.661+0000 7f48d9da8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d40cfe90 con 0x7f48d4157ca0 2023-10-07T08:43:26.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.661+0000 7f48d3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f48d406d120 0x7f48d406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53078/0 (socket says 172.21.15.81:53078) 2023-10-07T08:43:26.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.661+0000 7f48d3fff700 1 -- 172.21.15.81:0/1033779631 learned_addr learned my addr 172.21.15.81:0/1033779631 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.661+0000 7f48d2ffd700 1 --2- 172.21.15.81:0/1033779631 >> v2:172.21.15.89:3300/0 conn(0x7f48d4157ca0 0x7f48d40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.662+0000 7f48d27fc700 1 -- 172.21.15.81:0/1033779631 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927880766 0 0) 0x7f48d40d07c0 con 0x7f48d406d120 2023-10-07T08:43:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.662+0000 7f48d27fc700 1 -- 172.21.15.81:0/1033779631 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48bc003570 con 0x7f48d406d120 2023-10-07T08:43:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.662+0000 7f48d27fc700 1 -- 172.21.15.81:0/1033779631 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698379197 0 0) 0x7f48d40cfbb0 con 0x7f48d41578d0 2023-10-07T08:43:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.662+0000 7f48d27fc700 1 -- 172.21.15.81:0/1033779631 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48d40d07c0 con 0x7f48d41578d0 2023-10-07T08:43:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.662+0000 7f48d27fc700 1 -- 172.21.15.81:0/1033779631 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 93313403 0 0) 0x7f48bc003570 con 0x7f48d406d120 2023-10-07T08:43:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.662+0000 7f48d2ffd700 1 -- 172.21.15.81:0/1033779631 >> v1:172.21.15.89:6789/0 conn(0x7f48d41578d0 legacy=0x7f48d415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.662+0000 7f48d2ffd700 1 -- 172.21.15.81:0/1033779631 >> v1:172.21.15.81:6789/0 conn(0x7f48d406d120 legacy=0x7f48d406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.662+0000 7f48d2ffd700 1 -- 172.21.15.81:0/1033779631 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d40d0170 con 0x7f48d4157ca0 2023-10-07T08:43:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.662+0000 7f48d2ffd700 1 --2- 172.21.15.81:0/1033779631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d4157ca0 0x7f48d40cf4f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48c80098e0 tx=0x7f48c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aec4567cfd1bc56 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.662+0000 7f48d27fc700 1 -- 172.21.15.81:0/1033779631 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc001470 con 0x7f48d4157ca0 2023-10-07T08:43:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.662+0000 7f48d27fc700 1 -- 172.21.15.81:0/1033779631 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c8011420 con 0x7f48d4157ca0 2023-10-07T08:43:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.662+0000 7f48d27fc700 1 -- 172.21.15.81:0/1033779631 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c80117c0 con 0x7f48d4157ca0 2023-10-07T08:43:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.663+0000 7f48d9da8700 1 -- 172.21.15.81:0/1033779631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d4157ca0 msgr2=0x7f48d40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.663+0000 7f48d9da8700 1 --2- 172.21.15.81:0/1033779631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d4157ca0 0x7f48d40cf4f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48c80098e0 tx=0x7f48c80091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.663+0000 7f48d9da8700 1 -- 172.21.15.81:0/1033779631 shutdown_connections 2023-10-07T08:43:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.663+0000 7f48d9da8700 1 --2- 172.21.15.81:0/1033779631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d4157ca0 0x7f48d40cf4f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.663+0000 7f48d9da8700 1 -- 172.21.15.81:0/1033779631 >> 172.21.15.81:0/1033779631 conn(0x7f48d406bb90 msgr2=0x7f48d406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.663+0000 7f48d9da8700 1 -- 172.21.15.81:0/1033779631 shutdown_connections 2023-10-07T08:43:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.663+0000 7f48d9da8700 1 -- 172.21.15.81:0/1033779631 wait complete. 2023-10-07T08:43:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.664+0000 7f48d9da8700 1 Processor -- start 2023-10-07T08:43:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.664+0000 7f48d9da8700 1 -- start start 2023-10-07T08:43:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d9da8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d406d120 0x7f48d40b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d9da8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d41578d0 0x7f48d40b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d9da8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d4157ca0 0x7f48d40ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d9da8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d41543f0 con 0x7f48d4157ca0 2023-10-07T08:43:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d9da8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d40b47b0 con 0x7f48d41578d0 2023-10-07T08:43:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d9da8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d40b3ba0 con 0x7f48d406d120 2023-10-07T08:43:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d4157ca0 0x7f48d40ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d4157ca0 0x7f48d40ac9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46376/0 (socket says 172.21.15.81:46376) 2023-10-07T08:43:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d3fff700 1 -- 172.21.15.81:0/1346011885 learned_addr learned my addr 172.21.15.81:0/1346011885 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d2ffd700 1 --2- 172.21.15.81:0/1346011885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d41578d0 0x7f48d40b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d37fe700 1 --2- 172.21.15.81:0/1346011885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d406d120 0x7f48d40b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d3fff700 1 -- 172.21.15.81:0/1346011885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d406d120 msgr2=0x7f48d40b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d3fff700 1 --2- 172.21.15.81:0/1346011885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d406d120 0x7f48d40b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d3fff700 1 -- 172.21.15.81:0/1346011885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d41578d0 msgr2=0x7f48d40b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d3fff700 1 --2- 172.21.15.81:0/1346011885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d41578d0 0x7f48d40b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d3fff700 1 -- 172.21.15.81:0/1346011885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c8009420 con 0x7f48d4157ca0 2023-10-07T08:43:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48d3fff700 1 --2- 172.21.15.81:0/1346011885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d4157ca0 0x7f48d40ac9f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00cb70 tx=0x7f48cc001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.665+0000 7f48bb7fe700 1 -- 172.21.15.81:0/1346011885 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc007150 con 0x7f48d4157ca0 2023-10-07T08:43:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.666+0000 7f48bb7fe700 1 -- 172.21.15.81:0/1346011885 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48cc0072d0 con 0x7f48d4157ca0 2023-10-07T08:43:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.666+0000 7f48d9da8700 1 -- 172.21.15.81:0/1346011885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d40b3e80 con 0x7f48d4157ca0 2023-10-07T08:43:26.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.666+0000 7f48bb7fe700 1 -- 172.21.15.81:0/1346011885 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc007690 con 0x7f48d4157ca0 2023-10-07T08:43:26.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.666+0000 7f48d9da8700 1 -- 172.21.15.81:0/1346011885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d40b4440 con 0x7f48d4157ca0 2023-10-07T08:43:26.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.666+0000 7f48d9da8700 1 -- 172.21.15.81:0/1346011885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d40b4940 con 0x7f48d4157ca0 2023-10-07T08:43:26.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.667+0000 7f48bb7fe700 1 -- 172.21.15.81:0/1346011885 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48cc004a40 con 0x7f48d4157ca0 2023-10-07T08:43:26.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.667+0000 7f48bb7fe700 1 --2- 172.21.15.81:0/1346011885 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48c0066f00 0x7f48c00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.667+0000 7f48bb7fe700 1 -- 172.21.15.81:0/1346011885 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f48cc083970 con 0x7f48d4157ca0 2023-10-07T08:43:26.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.667+0000 7f48d37fe700 1 --2- 172.21.15.81:0/1346011885 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48c0066f00 0x7f48c00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.668+0000 7f48d37fe700 1 --2- 172.21.15.81:0/1346011885 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48c0066f00 0x7f48c00693b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f48c4004140 tx=0x7f48c4007f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:26.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.671+0000 7f48bb7fe700 1 -- 172.21.15.81:0/1346011885 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48cc054670 con 0x7f48d4157ca0 2023-10-07T08:43:26.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.856+0000 7f48d9da8700 1 -- 172.21.15.81:0/1346011885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48d40d0450 con 0x7f48d4157ca0 2023-10-07T08:43:26.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.857+0000 7f48bb7fe700 1 -- 172.21.15.81:0/1346011885 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f48cc0180a0 con 0x7f48d4157ca0 2023-10-07T08:43:26.858 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:43:26.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.858+0000 7f48d9da8700 1 -- 172.21.15.81:0/1346011885 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48c0066f00 msgr2=0x7f48c00693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.858+0000 7f48d9da8700 1 --2- 172.21.15.81:0/1346011885 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48c0066f00 0x7f48c00693b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f48c4004140 tx=0x7f48c4007f90 comp rx=0 tx=0).stop 2023-10-07T08:43:26.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.859+0000 7f48d9da8700 1 -- 172.21.15.81:0/1346011885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d4157ca0 msgr2=0x7f48d40ac9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.859+0000 7f48d9da8700 1 --2- 172.21.15.81:0/1346011885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d4157ca0 0x7f48d40ac9f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00cb70 tx=0x7f48cc001ad0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.859+0000 7f48d9da8700 1 -- 172.21.15.81:0/1346011885 shutdown_connections 2023-10-07T08:43:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.859+0000 7f48d9da8700 1 --2- 172.21.15.81:0/1346011885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d4157ca0 0x7f48d40ac9f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.859+0000 7f48d9da8700 1 --2- 172.21.15.81:0/1346011885 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48c0066f00 0x7f48c00693b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.859+0000 7f48d9da8700 1 --2- 172.21.15.81:0/1346011885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d406d120 0x7f48d40b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.859+0000 7f48d9da8700 1 --2- 172.21.15.81:0/1346011885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d41578d0 0x7f48d40b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.859+0000 7f48d9da8700 1 -- 172.21.15.81:0/1346011885 >> 172.21.15.81:0/1346011885 conn(0x7f48d406bb90 msgr2=0x7f48d4068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.859+0000 7f48d9da8700 1 -- 172.21.15.81:0/1346011885 shutdown_connections 2023-10-07T08:43:26.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.859+0000 7f48d9da8700 1 -- 172.21.15.81:0/1346011885 wait complete. 2023-10-07T08:43:26.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:43:26.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.988+0000 7f6e611f6700 1 Processor -- start 2023-10-07T08:43:26.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.988+0000 7f6e611f6700 1 -- start start 2023-10-07T08:43:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e611f6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6e5c0d0b80 0x7f6e5c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e611f6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e5c06d700 0x7f6e5c15b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e611f6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5c0cf2d0 con 0x7f6e5c0d02b0 2023-10-07T08:43:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e611f6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5c15a690 con 0x7f6e5c06d700 2023-10-07T08:43:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e611f6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5c06dc00 con 0x7f6e5c0d0b80 2023-10-07T08:43:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e609f5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e5c06d700 0x7f6e5c15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e5b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6e5c0d02b0 0x7f6e5c06cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53084/0 (socket says 172.21.15.81:53084) 2023-10-07T08:43:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e5b7fe700 1 -- 172.21.15.81:0/2335015353 learned_addr learned my addr 172.21.15.81:0/2335015353 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e609f5700 1 -- 172.21.15.81:0/2335015353 >> v2:172.21.15.89:3300/0 conn(0x7f6e5c0d0b80 msgr2=0x7f6e5c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e5bfff700 1 --2- 172.21.15.81:0/2335015353 >> v2:172.21.15.89:3300/0 conn(0x7f6e5c0d0b80 0x7f6e5c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e609f5700 1 --2- 172.21.15.81:0/2335015353 >> v2:172.21.15.89:3300/0 conn(0x7f6e5c0d0b80 0x7f6e5c0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e5affd700 1 -- 172.21.15.81:0/2335015353 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63333927 0 0) 0x7f6e5c0cf2d0 con 0x7f6e5c0d02b0 2023-10-07T08:43:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e609f5700 1 -- 172.21.15.81:0/2335015353 >> v1:172.21.15.81:6789/0 conn(0x7f6e5c0d02b0 legacy=0x7f6e5c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e609f5700 1 -- 172.21.15.81:0/2335015353 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c0cf570 con 0x7f6e5c06d700 2023-10-07T08:43:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e609f5700 1 --2- 172.21.15.81:0/2335015353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5c06d700 0x7f6e5c15b320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009e60 tx=0x7f6e54009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea677794b458cf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e5affd700 1 -- 172.21.15.81:0/2335015353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5400e070 con 0x7f6e5c06d700 2023-10-07T08:43:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e5affd700 1 -- 172.21.15.81:0/2335015353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5400bbf0 con 0x7f6e5c06d700 2023-10-07T08:43:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.989+0000 7f6e5affd700 1 -- 172.21.15.81:0/2335015353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e54012430 con 0x7f6e5c06d700 2023-10-07T08:43:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.990+0000 7f6e611f6700 1 -- 172.21.15.81:0/2335015353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5c06d700 msgr2=0x7f6e5c15b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.990+0000 7f6e611f6700 1 --2- 172.21.15.81:0/2335015353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5c06d700 0x7f6e5c15b320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009e60 tx=0x7f6e54009780 comp rx=0 tx=0).stop 2023-10-07T08:43:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.990+0000 7f6e611f6700 1 -- 172.21.15.81:0/2335015353 shutdown_connections 2023-10-07T08:43:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.990+0000 7f6e611f6700 1 --2- 172.21.15.81:0/2335015353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5c06d700 0x7f6e5c15b320 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.990+0000 7f6e611f6700 1 --2- 172.21.15.81:0/2335015353 >> v2:172.21.15.89:3300/0 conn(0x7f6e5c0d0b80 0x7f6e5c0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.990+0000 7f6e611f6700 1 -- 172.21.15.81:0/2335015353 >> 172.21.15.81:0/2335015353 conn(0x7f6e5c063230 msgr2=0x7f6e5c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.990+0000 7f6e611f6700 1 -- 172.21.15.81:0/2335015353 shutdown_connections 2023-10-07T08:43:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.990+0000 7f6e611f6700 1 -- 172.21.15.81:0/2335015353 wait complete. 2023-10-07T08:43:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.991+0000 7f6e611f6700 1 Processor -- start 2023-10-07T08:43:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.991+0000 7f6e611f6700 1 -- start start 2023-10-07T08:43:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.992+0000 7f6e611f6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e5c06d700 0x7f6e5c155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.992+0000 7f6e611f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5c0d02b0 0x7f6e5c0aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.992+0000 7f6e611f6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e5c0d0b80 0x7f6e5c0aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.992+0000 7f6e611f6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0b6410 con 0x7f6e5c0d02b0 2023-10-07T08:43:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.992+0000 7f6e611f6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0ab400 con 0x7f6e5c06d700 2023-10-07T08:43:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.992+0000 7f6e611f6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0ab6e0 con 0x7f6e5c0d0b80 2023-10-07T08:43:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.992+0000 7f6e5b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5c0d02b0 0x7f6e5c0aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.992+0000 7f6e5b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5c0d02b0 0x7f6e5c0aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46386/0 (socket says 172.21.15.81:46386) 2023-10-07T08:43:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.992+0000 7f6e5b7fe700 1 -- 172.21.15.81:0/2584368713 learned_addr learned my addr 172.21.15.81:0/2584368713 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.992+0000 7f6e5bfff700 1 --2- 172.21.15.81:0/2584368713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e5c06d700 0x7f6e5c155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.992+0000 7f6e5b7fe700 1 -- 172.21.15.81:0/2584368713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e5c0d0b80 msgr2=0x7f6e5c0aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.992+0000 7f6e5b7fe700 1 --2- 172.21.15.81:0/2584368713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e5c0d0b80 0x7f6e5c0aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.992+0000 7f6e5b7fe700 1 -- 172.21.15.81:0/2584368713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e5c06d700 msgr2=0x7f6e5c155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.992+0000 7f6e5b7fe700 1 --2- 172.21.15.81:0/2584368713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e5c06d700 0x7f6e5c155430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.992+0000 7f6e5b7fe700 1 -- 172.21.15.81:0/2584368713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e54009a20 con 0x7f6e5c0d02b0 2023-10-07T08:43:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.992+0000 7f6e5b7fe700 1 --2- 172.21.15.81:0/2584368713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5c0d02b0 0x7f6e5c0aa890 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000c7e0 tx=0x7f6e50007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.993+0000 7f6e43fff700 1 -- 172.21.15.81:0/2584368713 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50005b30 con 0x7f6e5c0d02b0 2023-10-07T08:43:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.993+0000 7f6e43fff700 1 -- 172.21.15.81:0/2584368713 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e50005c90 con 0x7f6e5c0d02b0 2023-10-07T08:43:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.993+0000 7f6e611f6700 1 -- 172.21.15.81:0/2584368713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5c0ab9c0 con 0x7f6e5c0d02b0 2023-10-07T08:43:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.993+0000 7f6e43fff700 1 -- 172.21.15.81:0/2584368713 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50007300 con 0x7f6e5c0d02b0 2023-10-07T08:43:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.993+0000 7f6e611f6700 1 -- 172.21.15.81:0/2584368713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5c169f30 con 0x7f6e5c0d02b0 2023-10-07T08:43:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.994+0000 7f6e611f6700 1 -- 172.21.15.81:0/2584368713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5c16a150 con 0x7f6e5c0d02b0 2023-10-07T08:43:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.994+0000 7f6e43fff700 1 -- 172.21.15.81:0/2584368713 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e5001b400 con 0x7f6e5c0d02b0 2023-10-07T08:43:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.994+0000 7f6e43fff700 1 --2- 172.21.15.81:0/2584368713 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e48066f30 0x7f6e480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.994+0000 7f6e43fff700 1 -- 172.21.15.81:0/2584368713 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6e50084040 con 0x7f6e5c0d02b0 2023-10-07T08:43:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.994+0000 7f6e5bfff700 1 --2- 172.21.15.81:0/2584368713 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e48066f30 0x7f6e480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.995+0000 7f6e5bfff700 1 --2- 172.21.15.81:0/2584368713 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e48066f30 0x7f6e480693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c006fd0 tx=0x7f6e4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:26.998+0000 7f6e43fff700 1 -- 172.21.15.81:0/2584368713 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e50051330 con 0x7f6e5c0d02b0 2023-10-07T08:43:27.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.180+0000 7f6e611f6700 1 -- 172.21.15.81:0/2584368713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e5c0676e0 con 0x7f6e5c0d02b0 2023-10-07T08:43:27.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.180+0000 7f6e43fff700 1 -- 172.21.15.81:0/2584368713 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e50054950 con 0x7f6e5c0d02b0 2023-10-07T08:43:27.182 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:43:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.183+0000 7f6e611f6700 1 -- 172.21.15.81:0/2584368713 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e48066f30 msgr2=0x7f6e480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.183+0000 7f6e611f6700 1 --2- 172.21.15.81:0/2584368713 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e48066f30 0x7f6e480693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c006fd0 tx=0x7f6e4c008040 comp rx=0 tx=0).stop 2023-10-07T08:43:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.183+0000 7f6e611f6700 1 -- 172.21.15.81:0/2584368713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5c0d02b0 msgr2=0x7f6e5c0aa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.183+0000 7f6e611f6700 1 --2- 172.21.15.81:0/2584368713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5c0d02b0 0x7f6e5c0aa890 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000c7e0 tx=0x7f6e50007df0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.183+0000 7f6e611f6700 1 -- 172.21.15.81:0/2584368713 shutdown_connections 2023-10-07T08:43:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.183+0000 7f6e611f6700 1 --2- 172.21.15.81:0/2584368713 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e48066f30 0x7f6e480693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.183+0000 7f6e611f6700 1 --2- 172.21.15.81:0/2584368713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e5c0d0b80 0x7f6e5c0aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.183+0000 7f6e611f6700 1 --2- 172.21.15.81:0/2584368713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e5c06d700 0x7f6e5c155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.183+0000 7f6e611f6700 1 --2- 172.21.15.81:0/2584368713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5c0d02b0 0x7f6e5c0aa890 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.183+0000 7f6e611f6700 1 -- 172.21.15.81:0/2584368713 >> 172.21.15.81:0/2584368713 conn(0x7f6e5c063230 msgr2=0x7f6e5c157410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.183+0000 7f6e611f6700 1 -- 172.21.15.81:0/2584368713 shutdown_connections 2023-10-07T08:43:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.183+0000 7f6e611f6700 1 -- 172.21.15.81:0/2584368713 wait complete. 2023-10-07T08:43:27.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:43:27.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.311+0000 7f4edf479700 1 Processor -- start 2023-10-07T08:43:27.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.311+0000 7f4edf479700 1 -- start start 2023-10-07T08:43:27.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.312+0000 7f4edf479700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ed815b2f0 0x7f4ed80c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:27.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.312+0000 7f4edf479700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4ed806f2a0 0x7f4ed80ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:27.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.312+0000 7f4edf479700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed806ee10 con 0x7f4ed80c8b60 2023-10-07T08:43:27.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.312+0000 7f4edf479700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806e200 con 0x7f4ed815b2f0 2023-10-07T08:43:27.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.312+0000 7f4edf479700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806e4e0 con 0x7f4ed806f2a0 2023-10-07T08:43:27.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.312+0000 7f4eddc76700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ed815b2f0 0x7f4ed80c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:27.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.312+0000 7f4eddc76700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ed815b2f0 0x7f4ed80c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46394/0 (socket says 172.21.15.81:46394) 2023-10-07T08:43:27.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.312+0000 7f4eddc76700 1 -- 172.21.15.81:0/1726034281 learned_addr learned my addr 172.21.15.81:0/1726034281 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:27.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.312+0000 7f4edec78700 1 --2- 172.21.15.81:0/1726034281 >> v2:172.21.15.89:3300/0 conn(0x7f4ed806f2a0 0x7f4ed80ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:27.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.312+0000 7f4eddc76700 1 -- 172.21.15.81:0/1726034281 >> v2:172.21.15.89:3300/0 conn(0x7f4ed806f2a0 msgr2=0x7f4ed80ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:27.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.312+0000 7f4eddc76700 1 --2- 172.21.15.81:0/1726034281 >> v2:172.21.15.89:3300/0 conn(0x7f4ed806f2a0 0x7f4ed80ac8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.312+0000 7f4eddc76700 1 -- 172.21.15.81:0/1726034281 >> v1:172.21.15.89:6789/0 conn(0x7f4ed80c8b60 legacy=0x7f4ed80ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:27.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.312+0000 7f4eddc76700 1 -- 172.21.15.81:0/1726034281 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed806e7c0 con 0x7f4ed815b2f0 2023-10-07T08:43:27.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.312+0000 7f4edec78700 1 --2- 172.21.15.81:0/1726034281 >> v2:172.21.15.89:3300/0 conn(0x7f4ed806f2a0 0x7f4ed80ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:27.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.312+0000 7f4eddc76700 1 --2- 172.21.15.81:0/1726034281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed815b2f0 0x7f4ed80c8f30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80099b0 tx=0x7f4ec8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77eb85b62f82cd82 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:27.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.313+0000 7f4edd475700 1 -- 172.21.15.81:0/1726034281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec800b7e0 con 0x7f4ed815b2f0 2023-10-07T08:43:27.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.313+0000 7f4edd475700 1 -- 172.21.15.81:0/1726034281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec800b940 con 0x7f4ed815b2f0 2023-10-07T08:43:27.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.313+0000 7f4edd475700 1 -- 172.21.15.81:0/1726034281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec800bce0 con 0x7f4ed815b2f0 2023-10-07T08:43:27.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.313+0000 7f4edf479700 1 -- 172.21.15.81:0/1726034281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed815b2f0 msgr2=0x7f4ed80c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:27.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.313+0000 7f4edf479700 1 --2- 172.21.15.81:0/1726034281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed815b2f0 0x7f4ed80c8f30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80099b0 tx=0x7f4ec8009250 comp rx=0 tx=0).stop 2023-10-07T08:43:27.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.313+0000 7f4edf479700 1 -- 172.21.15.81:0/1726034281 shutdown_connections 2023-10-07T08:43:27.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.313+0000 7f4edf479700 1 --2- 172.21.15.81:0/1726034281 >> v2:172.21.15.89:3300/0 conn(0x7f4ed806f2a0 0x7f4ed80ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.313+0000 7f4edf479700 1 --2- 172.21.15.81:0/1726034281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed815b2f0 0x7f4ed80c8f30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.313+0000 7f4edf479700 1 -- 172.21.15.81:0/1726034281 >> 172.21.15.81:0/1726034281 conn(0x7f4ed806cca0 msgr2=0x7f4ed806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:27.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.313+0000 7f4edf479700 1 -- 172.21.15.81:0/1726034281 shutdown_connections 2023-10-07T08:43:27.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.313+0000 7f4edf479700 1 -- 172.21.15.81:0/1726034281 wait complete. 2023-10-07T08:43:27.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.314+0000 7f4edf479700 1 Processor -- start 2023-10-07T08:43:27.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.314+0000 7f4edf479700 1 -- start start 2023-10-07T08:43:27.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.315+0000 7f4edf479700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ed806f2a0 0x7f4ed80b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:27.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.315+0000 7f4edf479700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed80c8b60 0x7f4ed80cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:27.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.315+0000 7f4edf479700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ed815b2f0 0x7f4ed814ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:27.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.315+0000 7f4edf479700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80cd040 con 0x7f4ed80c8b60 2023-10-07T08:43:27.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.315+0000 7f4edf479700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80cc4d0 con 0x7f4ed815b2f0 2023-10-07T08:43:27.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.315+0000 7f4edf479700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80cbf10 con 0x7f4ed806f2a0 2023-10-07T08:43:27.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.315+0000 7f4eddc76700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed80c8b60 0x7f4ed80cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:27.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.315+0000 7f4eddc76700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed80c8b60 0x7f4ed80cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46404/0 (socket says 172.21.15.81:46404) 2023-10-07T08:43:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.315+0000 7f4eddc76700 1 -- 172.21.15.81:0/936738826 learned_addr learned my addr 172.21.15.81:0/936738826 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.315+0000 7f4ede477700 1 --2- 172.21.15.81:0/936738826 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ed806f2a0 0x7f4ed80b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.315+0000 7f4edec78700 1 --2- 172.21.15.81:0/936738826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ed815b2f0 0x7f4ed814ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.315+0000 7f4eddc76700 1 -- 172.21.15.81:0/936738826 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ed806f2a0 msgr2=0x7f4ed80b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.315+0000 7f4eddc76700 1 --2- 172.21.15.81:0/936738826 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ed806f2a0 0x7f4ed80b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.315+0000 7f4eddc76700 1 -- 172.21.15.81:0/936738826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ed815b2f0 msgr2=0x7f4ed814ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.315+0000 7f4eddc76700 1 --2- 172.21.15.81:0/936738826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ed815b2f0 0x7f4ed814ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.315+0000 7f4eddc76700 1 -- 172.21.15.81:0/936738826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec80094f0 con 0x7f4ed80c8b60 2023-10-07T08:43:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.316+0000 7f4eddc76700 1 --2- 172.21.15.81:0/936738826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed80c8b60 0x7f4ed80cb470 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8063d30 tx=0x7f4ec8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.316+0000 7f4ece7fc700 1 -- 172.21.15.81:0/936738826 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8011ea0 con 0x7f4ed80c8b60 2023-10-07T08:43:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.316+0000 7f4ece7fc700 1 -- 172.21.15.81:0/936738826 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec801b680 con 0x7f4ed80c8b60 2023-10-07T08:43:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.316+0000 7f4edf479700 1 -- 172.21.15.81:0/936738826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed80cc1f0 con 0x7f4ed80c8b60 2023-10-07T08:43:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.316+0000 7f4ece7fc700 1 -- 172.21.15.81:0/936738826 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec801ba40 con 0x7f4ed80c8b60 2023-10-07T08:43:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.316+0000 7f4edf479700 1 -- 172.21.15.81:0/936738826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed816adc0 con 0x7f4ed80c8b60 2023-10-07T08:43:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.317+0000 7f4edf479700 1 -- 172.21.15.81:0/936738826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed80cd180 con 0x7f4ed80c8b60 2023-10-07T08:43:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.317+0000 7f4ece7fc700 1 -- 172.21.15.81:0/936738826 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ec801c450 con 0x7f4ed80c8b60 2023-10-07T08:43:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.317+0000 7f4ece7fc700 1 --2- 172.21.15.81:0/936738826 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4ebc066f30 0x7f4ebc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.318+0000 7f4ece7fc700 1 -- 172.21.15.81:0/936738826 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ec8086270 con 0x7f4ed80c8b60 2023-10-07T08:43:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.318+0000 7f4ede477700 1 --2- 172.21.15.81:0/936738826 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4ebc066f30 0x7f4ebc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.318+0000 7f4ede477700 1 --2- 172.21.15.81:0/936738826 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4ebc066f30 0x7f4ebc0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80b2dd0 tx=0x7f4ed4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:27.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.322+0000 7f4ece7fc700 1 -- 172.21.15.81:0/936738826 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ed80cd180 con 0x7f4ed80c8b60 2023-10-07T08:43:27.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.503+0000 7f4edf479700 1 -- 172.21.15.81:0/936738826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ed80cd180 con 0x7f4ed80c8b60 2023-10-07T08:43:27.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.504+0000 7f4ece7fc700 1 -- 172.21.15.81:0/936738826 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ed80cd180 con 0x7f4ed80c8b60 2023-10-07T08:43:27.505 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:43:27.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.506+0000 7f4edf479700 1 -- 172.21.15.81:0/936738826 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4ebc066f30 msgr2=0x7f4ebc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:27.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.506+0000 7f4edf479700 1 --2- 172.21.15.81:0/936738826 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4ebc066f30 0x7f4ebc0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80b2dd0 tx=0x7f4ed4009040 comp rx=0 tx=0).stop 2023-10-07T08:43:27.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.506+0000 7f4edf479700 1 -- 172.21.15.81:0/936738826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed80c8b60 msgr2=0x7f4ed80cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:27.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.506+0000 7f4edf479700 1 --2- 172.21.15.81:0/936738826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed80c8b60 0x7f4ed80cb470 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8063d30 tx=0x7f4ec8016000 comp rx=0 tx=0).stop 2023-10-07T08:43:27.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.506+0000 7f4edf479700 1 -- 172.21.15.81:0/936738826 shutdown_connections 2023-10-07T08:43:27.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.506+0000 7f4edf479700 1 --2- 172.21.15.81:0/936738826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ed815b2f0 0x7f4ed814ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.506+0000 7f4edf479700 1 --2- 172.21.15.81:0/936738826 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4ebc066f30 0x7f4ebc0693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.506+0000 7f4edf479700 1 --2- 172.21.15.81:0/936738826 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ed806f2a0 0x7f4ed80b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.506+0000 7f4edf479700 1 --2- 172.21.15.81:0/936738826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed80c8b60 0x7f4ed80cb470 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.506+0000 7f4edf479700 1 -- 172.21.15.81:0/936738826 >> 172.21.15.81:0/936738826 conn(0x7f4ed806cca0 msgr2=0x7f4ed80c7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:27.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.506+0000 7f4edf479700 1 -- 172.21.15.81:0/936738826 shutdown_connections 2023-10-07T08:43:27.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.506+0000 7f4edf479700 1 -- 172.21.15.81:0/936738826 wait complete. 2023-10-07T08:43:27.531 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-07T08:43:27.531 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-10-07T08:43:27.531 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-07T08:43:27.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.644+0000 7f2c257bd700 1 Processor -- start 2023-10-07T08:43:27.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.645+0000 7f2c257bd700 1 -- start start 2023-10-07T08:43:27.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.645+0000 7f2c257bd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2c2006cba0 0x7f2c2006cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:27.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.645+0000 7f2c257bd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c20159d70 con 0x7f2c201508b0 2023-10-07T08:43:27.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.645+0000 7f2c257bd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2015abd0 con 0x7f2c200c7770 2023-10-07T08:43:27.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.645+0000 7f2c257bd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2006d4b0 con 0x7f2c2006cba0 2023-10-07T08:43:27.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.645+0000 7f2c1f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2c201508b0 0x7f2c20069100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53092/0 (socket says 172.21.15.81:53092) 2023-10-07T08:43:27.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1f7fe700 1 -- 172.21.15.81:0/4162043234 learned_addr learned my addr 172.21.15.81:0/4162043234 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:27.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1effd700 1 --2- 172.21.15.81:0/4162043234 >> v2:172.21.15.89:3300/0 conn(0x7f2c2006cba0 0x7f2c2006cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:27.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1e7fc700 1 -- 172.21.15.81:0/4162043234 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733863075 0 0) 0x7f2c20159d70 con 0x7f2c201508b0 2023-10-07T08:43:27.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1e7fc700 1 -- 172.21.15.81:0/4162043234 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c0c003570 con 0x7f2c201508b0 2023-10-07T08:43:27.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1e7fc700 1 -- 172.21.15.81:0/4162043234 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 823854840 0 0) 0x7f2c0c003570 con 0x7f2c201508b0 2023-10-07T08:43:27.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1e7fc700 1 -- 172.21.15.81:0/4162043234 >> v2:172.21.15.89:3300/0 conn(0x7f2c2006cba0 msgr2=0x7f2c2006cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:27.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1e7fc700 1 --2- 172.21.15.81:0/4162043234 >> v2:172.21.15.89:3300/0 conn(0x7f2c2006cba0 0x7f2c2006cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1e7fc700 1 -- 172.21.15.81:0/4162043234 >> v1:172.21.15.89:6789/0 conn(0x7f2c200c7770 legacy=0x7f2c201501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:27.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1e7fc700 1 -- 172.21.15.81:0/4162043234 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c20159fc0 con 0x7f2c201508b0 2023-10-07T08:43:27.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1e7fc700 1 -- 172.21.15.81:0/4162043234 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f2c180017f0 con 0x7f2c201508b0 2023-10-07T08:43:27.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1e7fc700 1 -- 172.21.15.81:0/4162043234 >> v1:172.21.15.81:6789/0 conn(0x7f2c201508b0 legacy=0x7f2c20069100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1e7fc700 1 --2- 172.21.15.81:0/4162043234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c0c003a60 0x7f2c0c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1e7fc700 1 --2- 172.21.15.81:0/4162043234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c0c004810 0x7f2c0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1e7fc700 1 --2- 172.21.15.81:0/4162043234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0c0051c0 0x7f2c0c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1e7fc700 1 -- 172.21.15.81:0/4162043234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2006d4b0 con 0x7f2c0c003a60 2023-10-07T08:43:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1e7fc700 1 -- 172.21.15.81:0/4162043234 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c00c050 con 0x7f2c0c004810 2023-10-07T08:43:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1e7fc700 1 -- 172.21.15.81:0/4162043234 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c00c210 con 0x7f2c0c0051c0 2023-10-07T08:43:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1effd700 1 --2- 172.21.15.81:0/4162043234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c0c003a60 0x7f2c0c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1f7fe700 1 --2- 172.21.15.81:0/4162043234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0c0051c0 0x7f2c0c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c17fff700 1 --2- 172.21.15.81:0/4162043234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c0c004810 0x7f2c0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1effd700 1 -- 172.21.15.81:0/4162043234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0c0051c0 msgr2=0x7f2c0c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1effd700 1 --2- 172.21.15.81:0/4162043234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0c0051c0 0x7f2c0c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1effd700 1 -- 172.21.15.81:0/4162043234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c0c004810 msgr2=0x7f2c0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1effd700 1 --2- 172.21.15.81:0/4162043234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c0c004810 0x7f2c0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1effd700 1 -- 172.21.15.81:0/4162043234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c003570 con 0x7f2c0c003a60 2023-10-07T08:43:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c17fff700 1 --2- 172.21.15.81:0/4162043234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c0c004810 0x7f2c0c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.646+0000 7f2c1f7fe700 1 --2- 172.21.15.81:0/4162043234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c0c0051c0 0x7f2c0c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.647+0000 7f2c1f7fe700 1 -- 172.21.15.81:0/4162043234 reap_dead start 2023-10-07T08:43:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.647+0000 7f2c1effd700 1 --2- 172.21.15.81:0/4162043234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c0c003a60 0x7f2c0c003e30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009c00 tx=0x7f2c100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2896f04a789841f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.647+0000 7f2c1e7fc700 1 -- 172.21.15.81:0/4162043234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1000e710 con 0x7f2c0c003a60 2023-10-07T08:43:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.647+0000 7f2c1e7fc700 1 -- 172.21.15.81:0/4162043234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1000e870 con 0x7f2c0c003a60 2023-10-07T08:43:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.647+0000 7f2c1e7fc700 1 -- 172.21.15.81:0/4162043234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1000ec30 con 0x7f2c0c003a60 2023-10-07T08:43:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.647+0000 7f2c257bd700 1 -- 172.21.15.81:0/4162043234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c0c003a60 msgr2=0x7f2c0c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.647+0000 7f2c257bd700 1 --2- 172.21.15.81:0/4162043234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c0c003a60 0x7f2c0c003e30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009c00 tx=0x7f2c100091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.647+0000 7f2c257bd700 1 -- 172.21.15.81:0/4162043234 shutdown_connections 2023-10-07T08:43:27.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.647+0000 7f2c257bd700 1 --2- 172.21.15.81:0/4162043234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c0c003a60 0x7f2c0c003e30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.647+0000 7f2c257bd700 1 -- 172.21.15.81:0/4162043234 >> 172.21.15.81:0/4162043234 conn(0x7f2c200c9ac0 msgr2=0x7f2c200c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:27.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.647+0000 7f2c257bd700 1 -- 172.21.15.81:0/4162043234 shutdown_connections 2023-10-07T08:43:27.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.647+0000 7f2c257bd700 1 -- 172.21.15.81:0/4162043234 wait complete. 2023-10-07T08:43:27.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.648+0000 7f2c257bd700 1 Processor -- start 2023-10-07T08:43:27.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.648+0000 7f2c257bd700 1 -- start start 2023-10-07T08:43:27.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.649+0000 7f2c257bd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c0c003a60 0x7f2c2013a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:27.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.649+0000 7f2c257bd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2013bf30 0x7f2c200c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.649+0000 7f2c257bd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c2013eed0 0x7f2c2016a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.649+0000 7f2c257bd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2013aa80 con 0x7f2c2013bf30 2023-10-07T08:43:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.649+0000 7f2c257bd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c20138060 con 0x7f2c0c003a60 2023-10-07T08:43:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.649+0000 7f2c257bd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c20137730 con 0x7f2c2013eed0 2023-10-07T08:43:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.649+0000 7f2c17fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2013bf30 0x7f2c200c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.649+0000 7f2c17fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2013bf30 0x7f2c200c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46424/0 (socket says 172.21.15.81:46424) 2023-10-07T08:43:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.649+0000 7f2c17fff700 1 -- 172.21.15.81:0/3815395584 learned_addr learned my addr 172.21.15.81:0/3815395584 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.649+0000 7f2c1effd700 1 --2- 172.21.15.81:0/3815395584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c0c003a60 0x7f2c2013a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.649+0000 7f2c1f7fe700 1 --2- 172.21.15.81:0/3815395584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c2013eed0 0x7f2c2016a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.649+0000 7f2c17fff700 1 -- 172.21.15.81:0/3815395584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c2013eed0 msgr2=0x7f2c2016a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.649+0000 7f2c17fff700 1 --2- 172.21.15.81:0/3815395584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c2013eed0 0x7f2c2016a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.650+0000 7f2c17fff700 1 -- 172.21.15.81:0/3815395584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c0c003a60 msgr2=0x7f2c2013a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.650+0000 7f2c17fff700 1 --2- 172.21.15.81:0/3815395584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c0c003a60 0x7f2c2013a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.650+0000 7f2c17fff700 1 -- 172.21.15.81:0/3815395584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c20137a10 con 0x7f2c2013bf30 2023-10-07T08:43:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.650+0000 7f2c17fff700 1 --2- 172.21.15.81:0/3815395584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2013bf30 0x7f2c200c5020 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2c08000f60 tx=0x7f2c08009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.650+0000 7f2c16ffd700 1 -- 172.21.15.81:0/3815395584 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08006820 con 0x7f2c2013bf30 2023-10-07T08:43:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.650+0000 7f2c16ffd700 1 -- 172.21.15.81:0/3815395584 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c08006980 con 0x7f2c2013bf30 2023-10-07T08:43:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.650+0000 7f2c16ffd700 1 -- 172.21.15.81:0/3815395584 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08006d40 con 0x7f2c2013bf30 2023-10-07T08:43:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.650+0000 7f2c257bd700 1 -- 172.21.15.81:0/3815395584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c20137cf0 con 0x7f2c2013bf30 2023-10-07T08:43:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.650+0000 7f2c257bd700 1 -- 172.21.15.81:0/3815395584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c200c5560 con 0x7f2c2013bf30 2023-10-07T08:43:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.651+0000 7f2c257bd700 1 -- 172.21.15.81:0/3815395584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c20138210 con 0x7f2c2013bf30 2023-10-07T08:43:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.651+0000 7f2c16ffd700 1 -- 172.21.15.81:0/3815395584 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c08007240 con 0x7f2c2013bf30 2023-10-07T08:43:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.651+0000 7f2c16ffd700 1 --2- 172.21.15.81:0/3815395584 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2c00066f30 0x7f2c000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.652+0000 7f2c16ffd700 1 -- 172.21.15.81:0/3815395584 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2c08084210 con 0x7f2c2013bf30 2023-10-07T08:43:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.652+0000 7f2c1effd700 1 --2- 172.21.15.81:0/3815395584 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2c00066f30 0x7f2c000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.652+0000 7f2c1effd700 1 --2- 172.21.15.81:0/3815395584 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2c00066f30 0x7f2c000693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2c100091e0 tx=0x7f2c1001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.656+0000 7f2c16ffd700 1 -- 172.21.15.81:0/3815395584 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c20138210 con 0x7f2c2013bf30 2023-10-07T08:43:27.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:27.911+0000 7f2c257bd700 1 -- 172.21.15.81:0/3815395584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f2c201381d0 con 0x7f2c2013bf30 2023-10-07T08:43:28.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.420+0000 7f2c16ffd700 1 -- 172.21.15.81:0/3815395584 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2c08051480 con 0x7f2c2013bf30 2023-10-07T08:43:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.422+0000 7f2c257bd700 1 -- 172.21.15.81:0/3815395584 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2c00066f30 msgr2=0x7f2c000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.422+0000 7f2c257bd700 1 --2- 172.21.15.81:0/3815395584 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2c00066f30 0x7f2c000693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2c100091e0 tx=0x7f2c1001a000 comp rx=0 tx=0).stop 2023-10-07T08:43:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.422+0000 7f2c257bd700 1 -- 172.21.15.81:0/3815395584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2013bf30 msgr2=0x7f2c200c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.422+0000 7f2c257bd700 1 --2- 172.21.15.81:0/3815395584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2013bf30 0x7f2c200c5020 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2c08000f60 tx=0x7f2c08009040 comp rx=0 tx=0).stop 2023-10-07T08:43:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.422+0000 7f2c257bd700 1 -- 172.21.15.81:0/3815395584 shutdown_connections 2023-10-07T08:43:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.422+0000 7f2c257bd700 1 --2- 172.21.15.81:0/3815395584 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2c00066f30 0x7f2c000693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.422+0000 7f2c257bd700 1 --2- 172.21.15.81:0/3815395584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c2013eed0 0x7f2c2016a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.422+0000 7f2c257bd700 1 --2- 172.21.15.81:0/3815395584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c0c003a60 0x7f2c2013a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.422+0000 7f2c257bd700 1 --2- 172.21.15.81:0/3815395584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2013bf30 0x7f2c200c5020 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.422+0000 7f2c257bd700 1 -- 172.21.15.81:0/3815395584 >> 172.21.15.81:0/3815395584 conn(0x7f2c200c9ac0 msgr2=0x7f2c200c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.422+0000 7f2c257bd700 1 -- 172.21.15.81:0/3815395584 shutdown_connections 2023-10-07T08:43:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.422+0000 7f2c257bd700 1 -- 172.21.15.81:0/3815395584 wait complete. 2023-10-07T08:43:28.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-07T08:43:28.565 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_objectstore":"memstore"} 2023-10-07T08:43:28.565 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-07T08:43:28.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T08:43:28.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.681+0000 7fa116cd3700 1 Processor -- start 2023-10-07T08:43:28.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.681+0000 7fa116cd3700 1 -- start start 2023-10-07T08:43:28.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.682+0000 7fa116cd3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa110157ca0 0x7fa1100cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:28.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.682+0000 7fa116cd3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1100d07c0 con 0x7fa11006d120 2023-10-07T08:43:28.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.682+0000 7fa116cd3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1100cfbb0 con 0x7fa1101578d0 2023-10-07T08:43:28.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.682+0000 7fa116cd3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1100cfe90 con 0x7fa110157ca0 2023-10-07T08:43:28.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.682+0000 7fa107fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa110157ca0 0x7fa1100cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:28.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.682+0000 7fa115270700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa11006d120 0x7fa11006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53102/0 (socket says 172.21.15.81:53102) 2023-10-07T08:43:28.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.682+0000 7fa115270700 1 -- 172.21.15.81:0/1905324089 learned_addr learned my addr 172.21.15.81:0/1905324089 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:28.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.682+0000 7fa107fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa110157ca0 0x7fa1100cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46436/0 (socket says 172.21.15.81:46436) 2023-10-07T08:43:28.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.682+0000 7fa107fff700 1 -- 172.21.15.81:0/1905324089 >> v1:172.21.15.89:6789/0 conn(0x7fa1101578d0 legacy=0x7fa11015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:28.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.682+0000 7fa107fff700 1 -- 172.21.15.81:0/1905324089 >> v1:172.21.15.81:6789/0 conn(0x7fa11006d120 legacy=0x7fa11006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:28.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.682+0000 7fa107fff700 1 -- 172.21.15.81:0/1905324089 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1100d0170 con 0x7fa110157ca0 2023-10-07T08:43:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.682+0000 7fa1077fe700 1 -- 172.21.15.81:0/1905324089 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249193524 0 0) 0x7fa1100d07c0 con 0x7fa11006d120 2023-10-07T08:43:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.683+0000 7fa107fff700 1 --2- 172.21.15.81:0/1905324089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa110157ca0 0x7fa1100cf4f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa1000098e0 tx=0x7fa1000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308410e19e774 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.683+0000 7fa1077fe700 1 -- 172.21.15.81:0/1905324089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa100009e80 con 0x7fa110157ca0 2023-10-07T08:43:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.683+0000 7fa1077fe700 1 -- 172.21.15.81:0/1905324089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10000b860 con 0x7fa110157ca0 2023-10-07T08:43:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.683+0000 7fa1077fe700 1 -- 172.21.15.81:0/1905324089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10000bbe0 con 0x7fa110157ca0 2023-10-07T08:43:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.683+0000 7fa116cd3700 1 -- 172.21.15.81:0/1905324089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa110157ca0 msgr2=0x7fa1100cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.683+0000 7fa116cd3700 1 --2- 172.21.15.81:0/1905324089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa110157ca0 0x7fa1100cf4f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa1000098e0 tx=0x7fa1000091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.683+0000 7fa116cd3700 1 -- 172.21.15.81:0/1905324089 shutdown_connections 2023-10-07T08:43:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.683+0000 7fa116cd3700 1 --2- 172.21.15.81:0/1905324089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa110157ca0 0x7fa1100cf4f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.683+0000 7fa116cd3700 1 -- 172.21.15.81:0/1905324089 >> 172.21.15.81:0/1905324089 conn(0x7fa11006bb90 msgr2=0x7fa11006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.683+0000 7fa116cd3700 1 -- 172.21.15.81:0/1905324089 shutdown_connections 2023-10-07T08:43:28.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.683+0000 7fa116cd3700 1 -- 172.21.15.81:0/1905324089 wait complete. 2023-10-07T08:43:28.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.684+0000 7fa116cd3700 1 Processor -- start 2023-10-07T08:43:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.685+0000 7fa116cd3700 1 -- start start 2023-10-07T08:43:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.685+0000 7fa116cd3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa11006d120 0x7fa11016e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.685+0000 7fa116cd3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1101578d0 0x7fa1100b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.685+0000 7fa116cd3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa110157ca0 0x7fa1100c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.685+0000 7fa116cd3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11016bca0 con 0x7fa1101578d0 2023-10-07T08:43:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.685+0000 7fa116cd3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100b5ef0 con 0x7fa11006d120 2023-10-07T08:43:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.685+0000 7fa116cd3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100b61d0 con 0x7fa110157ca0 2023-10-07T08:43:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.685+0000 7fa107fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1101578d0 0x7fa1100b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.685+0000 7fa107fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1101578d0 0x7fa1100b5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46438/0 (socket says 172.21.15.81:46438) 2023-10-07T08:43:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.685+0000 7fa107fff700 1 -- 172.21.15.81:0/1237656361 learned_addr learned my addr 172.21.15.81:0/1237656361 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.686+0000 7fa115270700 1 --2- 172.21.15.81:0/1237656361 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa110157ca0 0x7fa1100c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:28.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.686+0000 7fa107fff700 1 -- 172.21.15.81:0/1237656361 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa110157ca0 msgr2=0x7fa1100c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:28.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.686+0000 7fa107fff700 1 --2- 172.21.15.81:0/1237656361 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa110157ca0 0x7fa1100c7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:28.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.686+0000 7fa114a6f700 1 --2- 172.21.15.81:0/1237656361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa11006d120 0x7fa11016e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:28.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.686+0000 7fa107fff700 1 -- 172.21.15.81:0/1237656361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa11006d120 msgr2=0x7fa11016e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:28.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.686+0000 7fa107fff700 1 --2- 172.21.15.81:0/1237656361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa11006d120 0x7fa11016e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:28.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.686+0000 7fa107fff700 1 -- 172.21.15.81:0/1237656361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa100009420 con 0x7fa1101578d0 2023-10-07T08:43:28.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.686+0000 7fa114a6f700 1 --2- 172.21.15.81:0/1237656361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa11006d120 0x7fa11016e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:28.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.686+0000 7fa107fff700 1 --2- 172.21.15.81:0/1237656361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1101578d0 0x7fa1100b5530 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa100013000 tx=0x7fa100017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:28.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.686+0000 7fa104ff9700 1 -- 172.21.15.81:0/1237656361 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10001f070 con 0x7fa1101578d0 2023-10-07T08:43:28.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.686+0000 7fa104ff9700 1 -- 172.21.15.81:0/1237656361 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa100011420 con 0x7fa1101578d0 2023-10-07T08:43:28.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.686+0000 7fa116cd3700 1 -- 172.21.15.81:0/1237656361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1100b64b0 con 0x7fa1101578d0 2023-10-07T08:43:28.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.686+0000 7fa104ff9700 1 -- 172.21.15.81:0/1237656361 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10000bbe0 con 0x7fa1101578d0 2023-10-07T08:43:28.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.686+0000 7fa116cd3700 1 -- 172.21.15.81:0/1237656361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1100b5a70 con 0x7fa1101578d0 2023-10-07T08:43:28.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.687+0000 7fa116cd3700 1 -- 172.21.15.81:0/1237656361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1100684b0 con 0x7fa1101578d0 2023-10-07T08:43:28.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.687+0000 7fa104ff9700 1 -- 172.21.15.81:0/1237656361 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa100011a50 con 0x7fa1101578d0 2023-10-07T08:43:28.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.688+0000 7fa104ff9700 1 --2- 172.21.15.81:0/1237656361 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa0fc066f00 0x7fa0fc0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:28.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.688+0000 7fa104ff9700 1 -- 172.21.15.81:0/1237656361 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa100085a90 con 0x7fa1101578d0 2023-10-07T08:43:28.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.688+0000 7fa114a6f700 1 --2- 172.21.15.81:0/1237656361 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa0fc066f00 0x7fa0fc0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:28.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.688+0000 7fa114a6f700 1 --2- 172.21.15.81:0/1237656361 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa0fc066f00 0x7fa0fc0693b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa10c007fd0 tx=0x7fa10c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:28.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.692+0000 7fa104ff9700 1 -- 172.21.15.81:0/1237656361 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa100052d00 con 0x7fa1101578d0 2023-10-07T08:43:28.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.874+0000 7fa116cd3700 1 -- 172.21.15.81:0/1237656361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa11016ba70 con 0x7fa1101578d0 2023-10-07T08:43:28.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.877+0000 7fa104ff9700 1 -- 172.21.15.81:0/1237656361 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa1000150c0 con 0x7fa1101578d0 2023-10-07T08:43:28.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.879+0000 7fa116cd3700 1 -- 172.21.15.81:0/1237656361 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa0fc066f00 msgr2=0x7fa0fc0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:28.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.879+0000 7fa116cd3700 1 --2- 172.21.15.81:0/1237656361 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa0fc066f00 0x7fa0fc0693b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa10c007fd0 tx=0x7fa10c009040 comp rx=0 tx=0).stop 2023-10-07T08:43:28.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.879+0000 7fa116cd3700 1 -- 172.21.15.81:0/1237656361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1101578d0 msgr2=0x7fa1100b5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:28.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.879+0000 7fa116cd3700 1 --2- 172.21.15.81:0/1237656361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1101578d0 0x7fa1100b5530 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa100013000 tx=0x7fa100017000 comp rx=0 tx=0).stop 2023-10-07T08:43:28.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.879+0000 7fa116cd3700 1 -- 172.21.15.81:0/1237656361 shutdown_connections 2023-10-07T08:43:28.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.879+0000 7fa116cd3700 1 --2- 172.21.15.81:0/1237656361 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa0fc066f00 0x7fa0fc0693b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:28.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.879+0000 7fa116cd3700 1 --2- 172.21.15.81:0/1237656361 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa110157ca0 0x7fa1100c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:28.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.879+0000 7fa116cd3700 1 --2- 172.21.15.81:0/1237656361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa11006d120 0x7fa11016e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:28.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.879+0000 7fa116cd3700 1 --2- 172.21.15.81:0/1237656361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1101578d0 0x7fa1100b5530 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:28.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.879+0000 7fa116cd3700 1 -- 172.21.15.81:0/1237656361 >> 172.21.15.81:0/1237656361 conn(0x7fa11006bb90 msgr2=0x7fa1101567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:28.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.879+0000 7fa116cd3700 1 -- 172.21.15.81:0/1237656361 shutdown_connections 2023-10-07T08:43:28.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:28.879+0000 7fa116cd3700 1 -- 172.21.15.81:0/1237656361 wait complete. 2023-10-07T08:43:28.893 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:43:28.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:43:28.932 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:43:28.976 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:43:28.976 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T08:43:28.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:43:28.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-07T08:43:29.017 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:43:29.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:29.018 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T08:43:29.073 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T08:43:29.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:43:29.073 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-07T08:43:29.120 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:43:29.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:29.120 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T08:43:29.136 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-07T08:43:29.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:43:29.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-07T08:43:29.171 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:43:29.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:29.172 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-07T08:43:29.227 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-07T08:43:29.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:43:29.227 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-07T08:43:29.265 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:43:29.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:29.266 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-07T08:43:29.322 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T08:43:29.322 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:43:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.437+0000 7fbacd576700 1 Processor -- start 2023-10-07T08:43:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.437+0000 7fbacd576700 1 -- start start 2023-10-07T08:43:29.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbacd576700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbac8157860 0x7fbac806dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbacd576700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbac80ce270 0x7fbac815a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbacd576700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac80cbec0 con 0x7fbac806a020 2023-10-07T08:43:29.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbacd576700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac80cb9d0 con 0x7fbac80ce270 2023-10-07T08:43:29.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbacd576700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac815b2d0 con 0x7fbac8157860 2023-10-07T08:43:29.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbac77fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbac806a020 0x7fbac80cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53104/0 (socket says 172.21.15.81:53104) 2023-10-07T08:43:29.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbac77fe700 1 -- 172.21.15.81:0/3726312854 learned_addr learned my addr 172.21.15.81:0/3726312854 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:29.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbac7fff700 1 --2- 172.21.15.81:0/3726312854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbac8157860 0x7fbac806dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbac6ffd700 1 -- 172.21.15.81:0/3726312854 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651433118 0 0) 0x7fbac80cbec0 con 0x7fbac806a020 2023-10-07T08:43:29.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbac6ffd700 1 -- 172.21.15.81:0/3726312854 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab0003570 con 0x7fbac806a020 2023-10-07T08:43:29.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbaccd75700 1 --2- 172.21.15.81:0/3726312854 >> v2:172.21.15.89:3300/0 conn(0x7fbac80ce270 0x7fbac815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbac6ffd700 1 -- 172.21.15.81:0/3726312854 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1096976470 0 0) 0x7fbab0003570 con 0x7fbac806a020 2023-10-07T08:43:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbac6ffd700 1 -- 172.21.15.81:0/3726312854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbac8157860 msgr2=0x7fbac806dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbac6ffd700 1 --2- 172.21.15.81:0/3726312854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbac8157860 0x7fbac806dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbac6ffd700 1 -- 172.21.15.81:0/3726312854 >> v2:172.21.15.89:3300/0 conn(0x7fbac80ce270 msgr2=0x7fbac815a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbac6ffd700 1 --2- 172.21.15.81:0/3726312854 >> v2:172.21.15.89:3300/0 conn(0x7fbac80ce270 0x7fbac815a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbac6ffd700 1 -- 172.21.15.81:0/3726312854 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80cc180 con 0x7fbac806a020 2023-10-07T08:43:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbac6ffd700 1 -- 172.21.15.81:0/3726312854 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fbabc001470 con 0x7fbac806a020 2023-10-07T08:43:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbac6ffd700 1 -- 172.21.15.81:0/3726312854 >> v1:172.21.15.81:6789/0 conn(0x7fbac806a020 legacy=0x7fbac80cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.438+0000 7fbac6ffd700 1 --2- 172.21.15.81:0/3726312854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbab0003a60 0x7fbab0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbac6ffd700 1 --2- 172.21.15.81:0/3726312854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbab0004810 0x7fbab0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbac6ffd700 1 --2- 172.21.15.81:0/3726312854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbac8157860 0x7fbab00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbac6ffd700 1 -- 172.21.15.81:0/3726312854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80cb9d0 con 0x7fbab0003a60 2023-10-07T08:43:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbac6ffd700 1 -- 172.21.15.81:0/3726312854 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac815b2d0 con 0x7fbab0004810 2023-10-07T08:43:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbac6ffd700 1 -- 172.21.15.81:0/3726312854 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab000ba60 con 0x7fbac8157860 2023-10-07T08:43:29.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbac7fff700 1 --2- 172.21.15.81:0/3726312854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbab0003a60 0x7fbab0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbac77fe700 1 --2- 172.21.15.81:0/3726312854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbab0004810 0x7fbab0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbaccd75700 1 --2- 172.21.15.81:0/3726312854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbac8157860 0x7fbab00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbac7fff700 1 -- 172.21.15.81:0/3726312854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbac8157860 msgr2=0x7fbab00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:29.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbac7fff700 1 --2- 172.21.15.81:0/3726312854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbac8157860 0x7fbab00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbac7fff700 1 -- 172.21.15.81:0/3726312854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbab0004810 msgr2=0x7fbab0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:29.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbac7fff700 1 --2- 172.21.15.81:0/3726312854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbab0004810 0x7fbab0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbac7fff700 1 -- 172.21.15.81:0/3726312854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab0003570 con 0x7fbab0003a60 2023-10-07T08:43:29.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbac7fff700 1 --2- 172.21.15.81:0/3726312854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbab0003a60 0x7fbab0003e70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009c30 tx=0x7fbab80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b091145f475f8469 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:29.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbac6ffd700 1 -- 172.21.15.81:0/3726312854 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab800e710 con 0x7fbab0003a60 2023-10-07T08:43:29.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbac6ffd700 1 -- 172.21.15.81:0/3726312854 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab800e870 con 0x7fbab0003a60 2023-10-07T08:43:29.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.439+0000 7fbac6ffd700 1 -- 172.21.15.81:0/3726312854 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab800ec30 con 0x7fbab0003a60 2023-10-07T08:43:29.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.440+0000 7fbacd576700 1 -- 172.21.15.81:0/3726312854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbab0003a60 msgr2=0x7fbab0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:29.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.440+0000 7fbacd576700 1 --2- 172.21.15.81:0/3726312854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbab0003a60 0x7fbab0003e70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009c30 tx=0x7fbab80091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.440+0000 7fbaccd75700 1 -- 172.21.15.81:0/3726312854 reap_dead start 2023-10-07T08:43:29.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.440+0000 7fbacd576700 1 -- 172.21.15.81:0/3726312854 shutdown_connections 2023-10-07T08:43:29.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.440+0000 7fbacd576700 1 -- 172.21.15.81:0/3726312854 >> 172.21.15.81:0/3726312854 conn(0x7fbac8063230 msgr2=0x7fbac8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:29.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.440+0000 7fbacd576700 1 -- 172.21.15.81:0/3726312854 shutdown_connections 2023-10-07T08:43:29.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.440+0000 7fbacd576700 1 -- 172.21.15.81:0/3726312854 wait complete. 2023-10-07T08:43:29.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.441+0000 7fbacd576700 1 Processor -- start 2023-10-07T08:43:29.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.441+0000 7fbacd576700 1 -- start start 2023-10-07T08:43:29.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbacd576700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbab0003a60 0x7fbac80b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbacd576700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbac80ca330 0x7fbac8151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbacd576700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbac8156cc0 0x7fbac8152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbacd576700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80c7ab0 con 0x7fbab0003a60 2023-10-07T08:43:29.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbacd576700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80c6ea0 con 0x7fbac80ca330 2023-10-07T08:43:29.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbacd576700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80c7180 con 0x7fbac8156cc0 2023-10-07T08:43:29.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbac7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbab0003a60 0x7fbac80b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbac7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbab0003a60 0x7fbac80b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46462/0 (socket says 172.21.15.81:46462) 2023-10-07T08:43:29.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbac7fff700 1 -- 172.21.15.81:0/2640685921 learned_addr learned my addr 172.21.15.81:0/2640685921 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:29.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbac77fe700 1 --2- 172.21.15.81:0/2640685921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbac80ca330 0x7fbac8151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbaccd75700 1 --2- 172.21.15.81:0/2640685921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbac8156cc0 0x7fbac8152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbac7fff700 1 -- 172.21.15.81:0/2640685921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbac8156cc0 msgr2=0x7fbac8152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:29.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbac7fff700 1 --2- 172.21.15.81:0/2640685921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbac8156cc0 0x7fbac8152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbac7fff700 1 -- 172.21.15.81:0/2640685921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbac80ca330 msgr2=0x7fbac8151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:29.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbac7fff700 1 --2- 172.21.15.81:0/2640685921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbac80ca330 0x7fbac8151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbac7fff700 1 -- 172.21.15.81:0/2640685921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80c7460 con 0x7fbab0003a60 2023-10-07T08:43:29.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbaccd75700 1 --2- 172.21.15.81:0/2640685921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbac8156cc0 0x7fbac8152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:29.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbac7fff700 1 --2- 172.21.15.81:0/2640685921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbab0003a60 0x7fbac80b1ac0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbab00046d0 tx=0x7fbab801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:29.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbaaffff700 1 -- 172.21.15.81:0/2640685921 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8022070 con 0x7fbab0003a60 2023-10-07T08:43:29.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbaaffff700 1 -- 172.21.15.81:0/2640685921 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab800e9e0 con 0x7fbab0003a60 2023-10-07T08:43:29.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbaaffff700 1 -- 172.21.15.81:0/2640685921 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab801c450 con 0x7fbab0003a60 2023-10-07T08:43:29.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbacd576700 1 -- 172.21.15.81:0/2640685921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac80c7740 con 0x7fbab0003a60 2023-10-07T08:43:29.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.442+0000 7fbacd576700 1 -- 172.21.15.81:0/2640685921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac80b2000 con 0x7fbab0003a60 2023-10-07T08:43:29.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.443+0000 7fbacd576700 1 -- 172.21.15.81:0/2640685921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac80b2220 con 0x7fbab0003a60 2023-10-07T08:43:29.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.444+0000 7fbaaffff700 1 -- 172.21.15.81:0/2640685921 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbab801c840 con 0x7fbab0003a60 2023-10-07T08:43:29.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.444+0000 7fbaaffff700 1 --2- 172.21.15.81:0/2640685921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbab4066f30 0x7fbab40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.444+0000 7fbaaffff700 1 -- 172.21.15.81:0/2640685921 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbab8085da0 con 0x7fbab0003a60 2023-10-07T08:43:29.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.444+0000 7fbac77fe700 1 --2- 172.21.15.81:0/2640685921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbab4066f30 0x7fbab40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.444+0000 7fbac77fe700 1 --2- 172.21.15.81:0/2640685921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbab4066f30 0x7fbab40693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbabc000fd0 tx=0x7fbac80cc0f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:29.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.448+0000 7fbaaffff700 1 -- 172.21.15.81:0/2640685921 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbab8053010 con 0x7fbab0003a60 2023-10-07T08:43:29.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.671+0000 7fbacd576700 1 -- 172.21.15.81:0/2640685921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbac80c7d90 con 0x7fbab0003a60 2023-10-07T08:43:29.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.672+0000 7fbaaffff700 1 -- 172.21.15.81:0/2640685921 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fbab8056630 con 0x7fbab0003a60 2023-10-07T08:43:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:29.673 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4266800811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4266800811},{"type":"v1","addr":"172.21.15.81:6836","nonce":4266800811}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1054766807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1054766807},{"type":"v1","addr":"172.21.15.89:6833","nonce":1054766807}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1734914753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1734914753},{"type":"v1","addr":"172.21.15.81:6837","nonce":1734914753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:42:56.633557+0000","modified":"2023-10-07T08:43:00.266271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/860615068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":860615068},{"type":"v1","addr":"172.21.15.89:6835","nonce":860615068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-07T08:43:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.674+0000 7fbacd576700 1 -- 172.21.15.81:0/2640685921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbab4066f30 msgr2=0x7fbab40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.674+0000 7fbacd576700 1 --2- 172.21.15.81:0/2640685921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbab4066f30 0x7fbab40693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbabc000fd0 tx=0x7fbac80cc0f0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.674+0000 7fbacd576700 1 -- 172.21.15.81:0/2640685921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbab0003a60 msgr2=0x7fbac80b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.674+0000 7fbacd576700 1 --2- 172.21.15.81:0/2640685921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbab0003a60 0x7fbac80b1ac0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbab00046d0 tx=0x7fbab801a000 comp rx=0 tx=0).stop 2023-10-07T08:43:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.674+0000 7fbacd576700 1 -- 172.21.15.81:0/2640685921 shutdown_connections 2023-10-07T08:43:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.674+0000 7fbacd576700 1 --2- 172.21.15.81:0/2640685921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbab4066f30 0x7fbab40693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.674+0000 7fbacd576700 1 --2- 172.21.15.81:0/2640685921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbac8156cc0 0x7fbac8152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.674+0000 7fbacd576700 1 --2- 172.21.15.81:0/2640685921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbab0003a60 0x7fbac80b1ac0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.674+0000 7fbacd576700 1 --2- 172.21.15.81:0/2640685921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbac80ca330 0x7fbac8151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.674+0000 7fbacd576700 1 -- 172.21.15.81:0/2640685921 >> 172.21.15.81:0/2640685921 conn(0x7fbac8063230 msgr2=0x7fbac806cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.674+0000 7fbacd576700 1 -- 172.21.15.81:0/2640685921 shutdown_connections 2023-10-07T08:43:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.674+0000 7fbacd576700 1 -- 172.21.15.81:0/2640685921 wait complete. 2023-10-07T08:43:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2023-10-07T08:43:29.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.800+0000 7f11cf572700 1 Processor -- start 2023-10-07T08:43:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.800+0000 7f11cf572700 1 -- start start 2023-10-07T08:43:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11cf572700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c806d830 0x7f11c80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11cf572700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c80d07c0 con 0x7f11c8157ca0 2023-10-07T08:43:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11cf572700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c80cfbb0 con 0x7f11c81578d0 2023-10-07T08:43:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11cf572700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80cfe90 con 0x7f11c806d830 2023-10-07T08:43:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11ccb0d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f11c8157ca0 0x7f11c806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53116/0 (socket says 172.21.15.81:53116) 2023-10-07T08:43:29.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11ccb0d700 1 -- 172.21.15.81:0/1433908279 learned_addr learned my addr 172.21.15.81:0/1433908279 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:29.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11cdb0f700 1 --2- 172.21.15.81:0/1433908279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c806d830 0x7f11c80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11bffff700 1 -- 172.21.15.81:0/1433908279 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710701977 0 0) 0x7f11c80d07c0 con 0x7f11c8157ca0 2023-10-07T08:43:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11bffff700 1 -- 172.21.15.81:0/1433908279 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11b4003570 con 0x7f11c8157ca0 2023-10-07T08:43:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11bffff700 1 -- 172.21.15.81:0/1433908279 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 87347580 0 0) 0x7f11b4003570 con 0x7f11c8157ca0 2023-10-07T08:43:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11bffff700 1 -- 172.21.15.81:0/1433908279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c806d830 msgr2=0x7f11c80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11bffff700 1 --2- 172.21.15.81:0/1433908279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c806d830 0x7f11c80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11bffff700 1 -- 172.21.15.81:0/1433908279 >> v1:172.21.15.89:6789/0 conn(0x7f11c81578d0 legacy=0x7f11c815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11bffff700 1 -- 172.21.15.81:0/1433908279 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c80d0170 con 0x7f11c8157ca0 2023-10-07T08:43:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11bffff700 1 -- 172.21.15.81:0/1433908279 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f11b8001470 con 0x7f11c8157ca0 2023-10-07T08:43:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11bffff700 1 -- 172.21.15.81:0/1433908279 >> v1:172.21.15.81:6789/0 conn(0x7f11c8157ca0 legacy=0x7f11c806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11bffff700 1 --2- 172.21.15.81:0/1433908279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b4003a90 0x7f11b4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11bffff700 1 --2- 172.21.15.81:0/1433908279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11b4004810 0x7f11b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11bffff700 1 --2- 172.21.15.81:0/1433908279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11b40051c0 0x7f11b400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11bffff700 1 -- 172.21.15.81:0/1433908279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80cfe90 con 0x7f11b4003a90 2023-10-07T08:43:29.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.801+0000 7f11bffff700 1 -- 172.21.15.81:0/1433908279 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b400bfa0 con 0x7f11b40051c0 2023-10-07T08:43:29.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.802+0000 7f11bffff700 1 -- 172.21.15.81:0/1433908279 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b400c160 con 0x7f11b4004810 2023-10-07T08:43:29.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.802+0000 7f11cdb0f700 1 --2- 172.21.15.81:0/1433908279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c806d830 0x7f11c80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:29.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.802+0000 7f11cd30e700 1 --2- 172.21.15.81:0/1433908279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b4003a90 0x7f11b4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.802+0000 7f11ccb0d700 1 --2- 172.21.15.81:0/1433908279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11b4004810 0x7f11b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.802+0000 7f11cdb0f700 1 --2- 172.21.15.81:0/1433908279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11b40051c0 0x7f11b400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.802+0000 7f11cd30e700 1 -- 172.21.15.81:0/1433908279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11b4004810 msgr2=0x7f11b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:29.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.802+0000 7f11cd30e700 1 --2- 172.21.15.81:0/1433908279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11b4004810 0x7f11b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.802+0000 7f11cd30e700 1 -- 172.21.15.81:0/1433908279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11b40051c0 msgr2=0x7f11b400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:29.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.802+0000 7f11cd30e700 1 --2- 172.21.15.81:0/1433908279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11b40051c0 0x7f11b400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.802+0000 7f11cd30e700 1 -- 172.21.15.81:0/1433908279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b4003570 con 0x7f11b4003a90 2023-10-07T08:43:29.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.802+0000 7f11ccb0d700 1 --2- 172.21.15.81:0/1433908279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11b4004810 0x7f11b4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:29.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.802+0000 7f11cd30e700 1 --2- 172.21.15.81:0/1433908279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b4003a90 0x7f11b4003e60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f11c4001960 tx=0x7f11c4007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff7a8a1f8e51b0d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:29.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.802+0000 7f11bffff700 1 -- 172.21.15.81:0/1433908279 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c400c5d0 con 0x7f11b4003a90 2023-10-07T08:43:29.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.802+0000 7f11bffff700 1 -- 172.21.15.81:0/1433908279 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c400c730 con 0x7f11b4003a90 2023-10-07T08:43:29.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.802+0000 7f11bffff700 1 -- 172.21.15.81:0/1433908279 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c400cad0 con 0x7f11b4003a90 2023-10-07T08:43:29.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.803+0000 7f11cf572700 1 -- 172.21.15.81:0/1433908279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b4003a90 msgr2=0x7f11b4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:29.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.803+0000 7f11cf572700 1 --2- 172.21.15.81:0/1433908279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b4003a90 0x7f11b4003e60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f11c4001960 tx=0x7f11c4007d10 comp rx=0 tx=0).stop 2023-10-07T08:43:29.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.803+0000 7f11cdb0f700 1 -- 172.21.15.81:0/1433908279 reap_dead start 2023-10-07T08:43:29.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.803+0000 7f11cf572700 1 -- 172.21.15.81:0/1433908279 shutdown_connections 2023-10-07T08:43:29.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.803+0000 7f11cf572700 1 -- 172.21.15.81:0/1433908279 >> 172.21.15.81:0/1433908279 conn(0x7f11c806bb90 msgr2=0x7f11c806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:29.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.803+0000 7f11cf572700 1 -- 172.21.15.81:0/1433908279 shutdown_connections 2023-10-07T08:43:29.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.803+0000 7f11cf572700 1 -- 172.21.15.81:0/1433908279 wait complete. 2023-10-07T08:43:29.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.804+0000 7f11cf572700 1 Processor -- start 2023-10-07T08:43:29.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.804+0000 7f11cf572700 1 -- start start 2023-10-07T08:43:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cf572700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b4003a90 0x7f11c8159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cf572700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c816a560 0x7f11c816a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cf572700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c816af10 0x7f11c80b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cf572700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c81594c0 con 0x7f11b4003a90 2023-10-07T08:43:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cf572700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c81588b0 con 0x7f11c816a560 2023-10-07T08:43:29.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cf572700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c8158b90 con 0x7f11c816af10 2023-10-07T08:43:29.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cd30e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b4003a90 0x7f11c8159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cd30e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b4003a90 0x7f11c8159950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46476/0 (socket says 172.21.15.81:46476) 2023-10-07T08:43:29.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cd30e700 1 -- 172.21.15.81:0/1279615458 learned_addr learned my addr 172.21.15.81:0/1279615458 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:29.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11ccb0d700 1 --2- 172.21.15.81:0/1279615458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c816a560 0x7f11c816a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cdb0f700 1 --2- 172.21.15.81:0/1279615458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c816af10 0x7f11c80b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cd30e700 1 -- 172.21.15.81:0/1279615458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c816af10 msgr2=0x7f11c80b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:29.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cd30e700 1 --2- 172.21.15.81:0/1279615458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c816af10 0x7f11c80b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cd30e700 1 -- 172.21.15.81:0/1279615458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c816a560 msgr2=0x7f11c816a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:29.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cd30e700 1 --2- 172.21.15.81:0/1279615458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c816a560 0x7f11c816a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cd30e700 1 -- 172.21.15.81:0/1279615458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c8158e70 con 0x7f11b4003a90 2023-10-07T08:43:29.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cd30e700 1 --2- 172.21.15.81:0/1279615458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b4003a90 0x7f11c8159950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f11c400c3c0 tx=0x7f11c4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:29.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11bd7fa700 1 -- 172.21.15.81:0/1279615458 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c400ce40 con 0x7f11b4003a90 2023-10-07T08:43:29.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11bd7fa700 1 -- 172.21.15.81:0/1279615458 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c400c8a0 con 0x7f11b4003a90 2023-10-07T08:43:29.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cf572700 1 -- 172.21.15.81:0/1279615458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c8159150 con 0x7f11b4003a90 2023-10-07T08:43:29.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11bd7fa700 1 -- 172.21.15.81:0/1279615458 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4006820 con 0x7f11b4003a90 2023-10-07T08:43:29.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.805+0000 7f11cf572700 1 -- 172.21.15.81:0/1279615458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c80b6b10 con 0x7f11b4003a90 2023-10-07T08:43:29.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.806+0000 7f11cf572700 1 -- 172.21.15.81:0/1279615458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c8159e90 con 0x7f11b4003a90 2023-10-07T08:43:29.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.807+0000 7f11bd7fa700 1 -- 172.21.15.81:0/1279615458 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11c4019030 con 0x7f11b4003a90 2023-10-07T08:43:29.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.807+0000 7f11bd7fa700 1 --2- 172.21.15.81:0/1279615458 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f11ac066fb0 0x7f11ac069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:29.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.807+0000 7f11bd7fa700 1 -- 172.21.15.81:0/1279615458 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f11c40858b0 con 0x7f11b4003a90 2023-10-07T08:43:29.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.807+0000 7f11ccb0d700 1 --2- 172.21.15.81:0/1279615458 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f11ac066fb0 0x7f11ac069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:29.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.808+0000 7f11ccb0d700 1 --2- 172.21.15.81:0/1279615458 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f11ac066fb0 0x7f11ac069460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f11b8001100 tx=0x7f11b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:29.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.811+0000 7f11bd7fa700 1 -- 172.21.15.81:0/1279615458 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11c4052b40 con 0x7f11b4003a90 2023-10-07T08:43:29.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.993+0000 7f11cf572700 1 -- 172.21.15.81:0/1279615458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11c81597a0 con 0x7f11b4003a90 2023-10-07T08:43:29.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.994+0000 7f11bd7fa700 1 -- 172.21.15.81:0/1279615458 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f11c402c090 con 0x7f11b4003a90 2023-10-07T08:43:29.995 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:29.995 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:58.248338+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:42:54.397263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:42:55.595133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:29.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.996+0000 7f11cf572700 1 -- 172.21.15.81:0/1279615458 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f11ac066fb0 msgr2=0x7f11ac069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:29.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.996+0000 7f11cf572700 1 --2- 172.21.15.81:0/1279615458 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f11ac066fb0 0x7f11ac069460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f11b8001100 tx=0x7f11b8009040 comp rx=0 tx=0).stop 2023-10-07T08:43:29.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.996+0000 7f11cf572700 1 -- 172.21.15.81:0/1279615458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b4003a90 msgr2=0x7f11c8159950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:29.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.996+0000 7f11cf572700 1 --2- 172.21.15.81:0/1279615458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b4003a90 0x7f11c8159950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f11c400c3c0 tx=0x7f11c4015000 comp rx=0 tx=0).stop 2023-10-07T08:43:29.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.996+0000 7f11cf572700 1 -- 172.21.15.81:0/1279615458 shutdown_connections 2023-10-07T08:43:29.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.996+0000 7f11cf572700 1 --2- 172.21.15.81:0/1279615458 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f11ac066fb0 0x7f11ac069460 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.996+0000 7f11cf572700 1 --2- 172.21.15.81:0/1279615458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c816af10 0x7f11c80b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.996+0000 7f11cf572700 1 --2- 172.21.15.81:0/1279615458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11b4003a90 0x7f11c8159950 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.996+0000 7f11cf572700 1 --2- 172.21.15.81:0/1279615458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c816a560 0x7f11c816a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:29.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.996+0000 7f11cf572700 1 -- 172.21.15.81:0/1279615458 >> 172.21.15.81:0/1279615458 conn(0x7f11c806bb90 msgr2=0x7f11c815b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:29.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.996+0000 7f11cf572700 1 -- 172.21.15.81:0/1279615458 shutdown_connections 2023-10-07T08:43:29.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:29.996+0000 7f11cf572700 1 -- 172.21.15.81:0/1279615458 wait complete. 2023-10-07T08:43:30.010 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:42:54.397263+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:42:55.595133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:43:30.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:43:30.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.127+0000 7f4f964b4700 1 Processor -- start 2023-10-07T08:43:30.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.127+0000 7f4f964b4700 1 -- start start 2023-10-07T08:43:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f964b4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f901578d0 0x7f4f900cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f964b4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f90157ca0 0x7f4f9015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f964b4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4f9006d120 0x7f4f9006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f964b4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9006dac0 con 0x7f4f90157ca0 2023-10-07T08:43:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f964b4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f900d07c0 con 0x7f4f9006d120 2023-10-07T08:43:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f964b4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900cfbb0 con 0x7f4f901578d0 2023-10-07T08:43:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f8f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f90157ca0 0x7f4f9015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f8f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f90157ca0 0x7f4f9015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46490/0 (socket says 172.21.15.81:46490) 2023-10-07T08:43:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f8f7fe700 1 -- 172.21.15.81:0/2444568148 learned_addr learned my addr 172.21.15.81:0/2444568148 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f8ffff700 1 --2- 172.21.15.81:0/2444568148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f901578d0 0x7f4f900cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f94a51700 1 --2- 172.21.15.81:0/2444568148 >> v2:172.21.15.89:3300/0 conn(0x7f4f9006d120 0x7f4f9006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f8f7fe700 1 -- 172.21.15.81:0/2444568148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f901578d0 msgr2=0x7f4f900cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f8f7fe700 1 --2- 172.21.15.81:0/2444568148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f901578d0 0x7f4f900cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f8f7fe700 1 -- 172.21.15.81:0/2444568148 >> v2:172.21.15.89:3300/0 conn(0x7f4f9006d120 msgr2=0x7f4f9006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f8f7fe700 1 --2- 172.21.15.81:0/2444568148 >> v2:172.21.15.89:3300/0 conn(0x7f4f9006d120 0x7f4f9006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f8f7fe700 1 -- 172.21.15.81:0/2444568148 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f900cfe90 con 0x7f4f90157ca0 2023-10-07T08:43:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f8ffff700 1 --2- 172.21.15.81:0/2444568148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f901578d0 0x7f4f900cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f8f7fe700 1 --2- 172.21.15.81:0/2444568148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f90157ca0 0x7f4f9015af00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4f900b3940 tx=0x7f4f84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0e1dc99553bb4b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f8effd700 1 -- 172.21.15.81:0/2444568148 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400b860 con 0x7f4f90157ca0 2023-10-07T08:43:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f8effd700 1 -- 172.21.15.81:0/2444568148 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8400b9c0 con 0x7f4f90157ca0 2023-10-07T08:43:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.128+0000 7f4f8effd700 1 -- 172.21.15.81:0/2444568148 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400bd60 con 0x7f4f90157ca0 2023-10-07T08:43:30.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.129+0000 7f4f964b4700 1 -- 172.21.15.81:0/2444568148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f90157ca0 msgr2=0x7f4f9015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.129+0000 7f4f964b4700 1 --2- 172.21.15.81:0/2444568148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f90157ca0 0x7f4f9015af00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4f900b3940 tx=0x7f4f84009250 comp rx=0 tx=0).stop 2023-10-07T08:43:30.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.129+0000 7f4f964b4700 1 -- 172.21.15.81:0/2444568148 shutdown_connections 2023-10-07T08:43:30.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.129+0000 7f4f964b4700 1 --2- 172.21.15.81:0/2444568148 >> v2:172.21.15.89:3300/0 conn(0x7f4f9006d120 0x7f4f9006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.129+0000 7f4f964b4700 1 --2- 172.21.15.81:0/2444568148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f901578d0 0x7f4f900cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.129+0000 7f4f964b4700 1 --2- 172.21.15.81:0/2444568148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f90157ca0 0x7f4f9015af00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.129+0000 7f4f964b4700 1 -- 172.21.15.81:0/2444568148 >> 172.21.15.81:0/2444568148 conn(0x7f4f9006bb90 msgr2=0x7f4f9006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:30.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.129+0000 7f4f964b4700 1 -- 172.21.15.81:0/2444568148 shutdown_connections 2023-10-07T08:43:30.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.129+0000 7f4f964b4700 1 -- 172.21.15.81:0/2444568148 wait complete. 2023-10-07T08:43:30.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.130+0000 7f4f964b4700 1 Processor -- start 2023-10-07T08:43:30.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.130+0000 7f4f964b4700 1 -- start start 2023-10-07T08:43:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f964b4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f9006d120 0x7f4f90147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f964b4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f901578d0 0x7f4f900ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f964b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f90157ca0 0x7f4f900ab790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f964b4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900b6420 con 0x7f4f90157ca0 2023-10-07T08:43:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f964b4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900b5570 con 0x7f4f9006d120 2023-10-07T08:43:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f964b4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900b5810 con 0x7f4f901578d0 2023-10-07T08:43:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f94a51700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f90157ca0 0x7f4f900ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f94a51700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f90157ca0 0x7f4f900ab790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46498/0 (socket says 172.21.15.81:46498) 2023-10-07T08:43:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f94a51700 1 -- 172.21.15.81:0/1735206341 learned_addr learned my addr 172.21.15.81:0/1735206341 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f8f7fe700 1 --2- 172.21.15.81:0/1735206341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f901578d0 0x7f4f900ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f8ffff700 1 --2- 172.21.15.81:0/1735206341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f9006d120 0x7f4f90147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f94a51700 1 -- 172.21.15.81:0/1735206341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f901578d0 msgr2=0x7f4f900ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f94a51700 1 --2- 172.21.15.81:0/1735206341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f901578d0 0x7f4f900ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f94a51700 1 -- 172.21.15.81:0/1735206341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f9006d120 msgr2=0x7f4f90147900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f94a51700 1 --2- 172.21.15.81:0/1735206341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f9006d120 0x7f4f90147900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f94a51700 1 -- 172.21.15.81:0/1735206341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f840094f0 con 0x7f4f90157ca0 2023-10-07T08:43:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f94a51700 1 --2- 172.21.15.81:0/1735206341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f90157ca0 0x7f4f900ab790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009fa0 tx=0x7f4f88009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.131+0000 7f4f77fff700 1 -- 172.21.15.81:0/1735206341 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800ebc0 con 0x7f4f90157ca0 2023-10-07T08:43:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.132+0000 7f4f964b4700 1 -- 172.21.15.81:0/1735206341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f900b5af0 con 0x7f4f90157ca0 2023-10-07T08:43:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.132+0000 7f4f77fff700 1 -- 172.21.15.81:0/1735206341 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8800ed20 con 0x7f4f90157ca0 2023-10-07T08:43:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.132+0000 7f4f77fff700 1 -- 172.21.15.81:0/1735206341 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f88014670 con 0x7f4f90157ca0 2023-10-07T08:43:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.132+0000 7f4f964b4700 1 -- 172.21.15.81:0/1735206341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f900b60b0 con 0x7f4f90157ca0 2023-10-07T08:43:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.132+0000 7f4f964b4700 1 -- 172.21.15.81:0/1735206341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9015d2d0 con 0x7f4f90157ca0 2023-10-07T08:43:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.133+0000 7f4f77fff700 1 -- 172.21.15.81:0/1735206341 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f880149e0 con 0x7f4f90157ca0 2023-10-07T08:43:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.133+0000 7f4f77fff700 1 --2- 172.21.15.81:0/1735206341 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4f7c066f30 0x7f4f7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.133+0000 7f4f8ffff700 1 --2- 172.21.15.81:0/1735206341 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4f7c066f30 0x7f4f7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.133+0000 7f4f77fff700 1 -- 172.21.15.81:0/1735206341 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f88084c20 con 0x7f4f90157ca0 2023-10-07T08:43:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.134+0000 7f4f8ffff700 1 --2- 172.21.15.81:0/1735206341 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4f7c066f30 0x7f4f7c0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4f80006f00 tx=0x7f4f80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.137+0000 7f4f77fff700 1 -- 172.21.15.81:0/1735206341 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f88051e90 con 0x7f4f90157ca0 2023-10-07T08:43:30.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.318+0000 7f4f964b4700 1 -- 172.21.15.81:0/1735206341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f900b6560 con 0x7f4f90157ca0 2023-10-07T08:43:30.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.318+0000 7f4f77fff700 1 -- 172.21.15.81:0/1735206341 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f880554b0 con 0x7f4f90157ca0 2023-10-07T08:43:30.320 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:43:30.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.320+0000 7f4f964b4700 1 -- 172.21.15.81:0/1735206341 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4f7c066f30 msgr2=0x7f4f7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.320+0000 7f4f964b4700 1 --2- 172.21.15.81:0/1735206341 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4f7c066f30 0x7f4f7c0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4f80006f00 tx=0x7f4f80008040 comp rx=0 tx=0).stop 2023-10-07T08:43:30.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.320+0000 7f4f964b4700 1 -- 172.21.15.81:0/1735206341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f90157ca0 msgr2=0x7f4f900ab790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.320+0000 7f4f964b4700 1 --2- 172.21.15.81:0/1735206341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f90157ca0 0x7f4f900ab790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009fa0 tx=0x7f4f88009900 comp rx=0 tx=0).stop 2023-10-07T08:43:30.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.320+0000 7f4f964b4700 1 -- 172.21.15.81:0/1735206341 shutdown_connections 2023-10-07T08:43:30.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.320+0000 7f4f964b4700 1 --2- 172.21.15.81:0/1735206341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f90157ca0 0x7f4f900ab790 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.320+0000 7f4f964b4700 1 --2- 172.21.15.81:0/1735206341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f9006d120 0x7f4f90147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.320+0000 7f4f964b4700 1 --2- 172.21.15.81:0/1735206341 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4f7c066f30 0x7f4f7c0693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.320+0000 7f4f964b4700 1 --2- 172.21.15.81:0/1735206341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f901578d0 0x7f4f900ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.320+0000 7f4f964b4700 1 -- 172.21.15.81:0/1735206341 >> 172.21.15.81:0/1735206341 conn(0x7f4f9006bb90 msgr2=0x7f4f901557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:30.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.321+0000 7f4f964b4700 1 -- 172.21.15.81:0/1735206341 shutdown_connections 2023-10-07T08:43:30.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.321+0000 7f4f964b4700 1 -- 172.21.15.81:0/1735206341 wait complete. 2023-10-07T08:43:30.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:43:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.450+0000 7f45c1740700 1 Processor -- start 2023-10-07T08:43:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.450+0000 7f45c1740700 1 -- start start 2023-10-07T08:43:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45c1740700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc15b6e0 0x7f45bc15bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45c1740700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f45bc06f180 0x7f45bc0ae960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45c1740700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45bc063560 con 0x7f45bc06ed10 2023-10-07T08:43:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45c1740700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45bc0c9ec0 con 0x7f45bc06f180 2023-10-07T08:43:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45c1740700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc06e880 con 0x7f45bc15b6e0 2023-10-07T08:43:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45bb7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f45bc06f180 0x7f45bc0ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45ba7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f45bc06ed10 0x7f45bc1592b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53130/0 (socket says 172.21.15.81:53130) 2023-10-07T08:43:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45bb7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f45bc06f180 0x7f45bc0ae960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46500/0 (socket says 172.21.15.81:46500) 2023-10-07T08:43:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45ba7fc700 1 -- 172.21.15.81:0/555182338 learned_addr learned my addr 172.21.15.81:0/555182338 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45baffd700 1 --2- 172.21.15.81:0/555182338 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc15b6e0 0x7f45bc15bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45bb7fe700 1 -- 172.21.15.81:0/555182338 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc15b6e0 msgr2=0x7f45bc15bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45bb7fe700 1 --2- 172.21.15.81:0/555182338 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc15b6e0 0x7f45bc15bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45bb7fe700 1 -- 172.21.15.81:0/555182338 >> v1:172.21.15.81:6789/0 conn(0x7f45bc06ed10 legacy=0x7f45bc1592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45bb7fe700 1 -- 172.21.15.81:0/555182338 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc15bff0 con 0x7f45bc06f180 2023-10-07T08:43:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45b9ffb700 1 -- 172.21.15.81:0/555182338 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514903036 0 0) 0x7f45bc063560 con 0x7f45bc06ed10 2023-10-07T08:43:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45bb7fe700 1 --2- 172.21.15.81:0/555182338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45bc06f180 0x7f45bc0ae960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0098e0 tx=0x7f45ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318ecaa264f8709b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45b9ffb700 1 -- 172.21.15.81:0/555182338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac00b640 con 0x7f45bc06f180 2023-10-07T08:43:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45b9ffb700 1 -- 172.21.15.81:0/555182338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac00b7a0 con 0x7f45bc06f180 2023-10-07T08:43:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.451+0000 7f45b9ffb700 1 -- 172.21.15.81:0/555182338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac00bb40 con 0x7f45bc06f180 2023-10-07T08:43:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.452+0000 7f45c1740700 1 -- 172.21.15.81:0/555182338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45bc06f180 msgr2=0x7f45bc0ae960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.452+0000 7f45c1740700 1 --2- 172.21.15.81:0/555182338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45bc06f180 0x7f45bc0ae960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0098e0 tx=0x7f45ac0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.452+0000 7f45c1740700 1 -- 172.21.15.81:0/555182338 shutdown_connections 2023-10-07T08:43:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.452+0000 7f45c1740700 1 --2- 172.21.15.81:0/555182338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45bc06f180 0x7f45bc0ae960 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.452+0000 7f45c1740700 1 --2- 172.21.15.81:0/555182338 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc15b6e0 0x7f45bc15bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.452+0000 7f45c1740700 1 -- 172.21.15.81:0/555182338 >> 172.21.15.81:0/555182338 conn(0x7f45bc0cdb70 msgr2=0x7f45bc06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.452+0000 7f45c1740700 1 -- 172.21.15.81:0/555182338 shutdown_connections 2023-10-07T08:43:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.452+0000 7f45c1740700 1 -- 172.21.15.81:0/555182338 wait complete. 2023-10-07T08:43:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.453+0000 7f45c1740700 1 Processor -- start 2023-10-07T08:43:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.453+0000 7f45c1740700 1 -- start start 2023-10-07T08:43:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45c1740700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc06ed10 0x7f45bc0acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45c1740700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45bc06f180 0x7f45bc0ab260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45c1740700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45bc15b6e0 0x7f45bc0c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45c1740700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0ac950 con 0x7f45bc15b6e0 2023-10-07T08:43:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45c1740700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0b1d70 con 0x7f45bc06f180 2023-10-07T08:43:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45c1740700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0ad320 con 0x7f45bc06ed10 2023-10-07T08:43:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45bb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45bc15b6e0 0x7f45bc0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45bb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45bc15b6e0 0x7f45bc0c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46516/0 (socket says 172.21.15.81:46516) 2023-10-07T08:43:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45bb7fe700 1 -- 172.21.15.81:0/1724445120 learned_addr learned my addr 172.21.15.81:0/1724445120 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45baffd700 1 --2- 172.21.15.81:0/1724445120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc06ed10 0x7f45bc0acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45ba7fc700 1 --2- 172.21.15.81:0/1724445120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45bc06f180 0x7f45bc0ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45bb7fe700 1 -- 172.21.15.81:0/1724445120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc06ed10 msgr2=0x7f45bc0acde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45bb7fe700 1 --2- 172.21.15.81:0/1724445120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc06ed10 0x7f45bc0acde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45bb7fe700 1 -- 172.21.15.81:0/1724445120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45bc06f180 msgr2=0x7f45bc0ab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45bb7fe700 1 --2- 172.21.15.81:0/1724445120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45bc06f180 0x7f45bc0ab260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45bb7fe700 1 -- 172.21.15.81:0/1724445120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac009420 con 0x7f45bc15b6e0 2023-10-07T08:43:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45ba7fc700 1 --2- 172.21.15.81:0/1724445120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45bc06f180 0x7f45bc0ab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45bb7fe700 1 --2- 172.21.15.81:0/1724445120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45bc15b6e0 0x7f45bc0c6910 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f45bc068910 tx=0x7f45ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.454+0000 7f45a2ffd700 1 -- 172.21.15.81:0/1724445120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac011420 con 0x7f45bc15b6e0 2023-10-07T08:43:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.455+0000 7f45a2ffd700 1 -- 172.21.15.81:0/1724445120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac011580 con 0x7f45bc15b6e0 2023-10-07T08:43:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.455+0000 7f45a2ffd700 1 -- 172.21.15.81:0/1724445120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac011920 con 0x7f45bc15b6e0 2023-10-07T08:43:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.455+0000 7f45c1740700 1 -- 172.21.15.81:0/1724445120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45bc0abd40 con 0x7f45bc15b6e0 2023-10-07T08:43:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.455+0000 7f45c1740700 1 -- 172.21.15.81:0/1724445120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45bc0ac300 con 0x7f45bc15b6e0 2023-10-07T08:43:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.456+0000 7f45c1740700 1 -- 172.21.15.81:0/1724445120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45bc067fd0 con 0x7f45bc15b6e0 2023-10-07T08:43:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.456+0000 7f45a2ffd700 1 -- 172.21.15.81:0/1724445120 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45ac011c90 con 0x7f45bc15b6e0 2023-10-07T08:43:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.456+0000 7f45a2ffd700 1 --2- 172.21.15.81:0/1724445120 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f45a8066f30 0x7f45a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.457+0000 7f45a2ffd700 1 -- 172.21.15.81:0/1724445120 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45ac086020 con 0x7f45bc15b6e0 2023-10-07T08:43:30.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.457+0000 7f45baffd700 1 --2- 172.21.15.81:0/1724445120 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f45a8066f30 0x7f45a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.457+0000 7f45baffd700 1 --2- 172.21.15.81:0/1724445120 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f45a8066f30 0x7f45a80693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f45b400f510 tx=0x7f45b400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:30.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.461+0000 7f45a2ffd700 1 -- 172.21.15.81:0/1724445120 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45ac053290 con 0x7f45bc15b6e0 2023-10-07T08:43:30.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.641+0000 7f45c1740700 1 -- 172.21.15.81:0/1724445120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45bc06dc70 con 0x7f45bc15b6e0 2023-10-07T08:43:30.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.642+0000 7f45a2ffd700 1 -- 172.21.15.81:0/1724445120 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45ac0568b0 con 0x7f45bc15b6e0 2023-10-07T08:43:30.643 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:43:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.644+0000 7f45c1740700 1 -- 172.21.15.81:0/1724445120 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f45a8066f30 msgr2=0x7f45a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.644+0000 7f45c1740700 1 --2- 172.21.15.81:0/1724445120 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f45a8066f30 0x7f45a80693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f45b400f510 tx=0x7f45b400b040 comp rx=0 tx=0).stop 2023-10-07T08:43:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.644+0000 7f45c1740700 1 -- 172.21.15.81:0/1724445120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45bc15b6e0 msgr2=0x7f45bc0c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.644+0000 7f45c1740700 1 --2- 172.21.15.81:0/1724445120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45bc15b6e0 0x7f45bc0c6910 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f45bc068910 tx=0x7f45ac017000 comp rx=0 tx=0).stop 2023-10-07T08:43:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.644+0000 7f45c1740700 1 -- 172.21.15.81:0/1724445120 shutdown_connections 2023-10-07T08:43:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.644+0000 7f45c1740700 1 --2- 172.21.15.81:0/1724445120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45bc15b6e0 0x7f45bc0c6910 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.644+0000 7f45c1740700 1 --2- 172.21.15.81:0/1724445120 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f45a8066f30 0x7f45a80693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.644+0000 7f45c1740700 1 --2- 172.21.15.81:0/1724445120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc06ed10 0x7f45bc0acde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.644+0000 7f45c1740700 1 --2- 172.21.15.81:0/1724445120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45bc06f180 0x7f45bc0ab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.644+0000 7f45c1740700 1 -- 172.21.15.81:0/1724445120 >> 172.21.15.81:0/1724445120 conn(0x7f45bc0cdb70 msgr2=0x7f45bc15aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.644+0000 7f45c1740700 1 -- 172.21.15.81:0/1724445120 shutdown_connections 2023-10-07T08:43:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.644+0000 7f45c1740700 1 -- 172.21.15.81:0/1724445120 wait complete. 2023-10-07T08:43:30.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:43:30.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.773+0000 7fb156809700 1 Processor -- start 2023-10-07T08:43:30.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.773+0000 7fb156809700 1 -- start start 2023-10-07T08:43:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.774+0000 7fb156809700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1500d0b80 0x7fb1500cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.774+0000 7fb156809700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1500cf2d0 con 0x7fb15006d700 2023-10-07T08:43:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.774+0000 7fb156809700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb15006dc00 con 0x7fb1500d02b0 2023-10-07T08:43:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.774+0000 7fb156809700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15015a690 con 0x7fb1500d0b80 2023-10-07T08:43:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.774+0000 7fb156008700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb15006d700 0x7fb15015b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53132/0 (socket says 172.21.15.81:53132) 2023-10-07T08:43:30.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.774+0000 7fb156008700 1 -- 172.21.15.81:0/681411091 learned_addr learned my addr 172.21.15.81:0/681411091 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:30.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.774+0000 7fb155807700 1 --2- 172.21.15.81:0/681411091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1500d0b80 0x7fb1500cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.774+0000 7fb154805700 1 -- 172.21.15.81:0/681411091 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227304291 0 0) 0x7fb1500cf2d0 con 0x7fb15006d700 2023-10-07T08:43:30.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.774+0000 7fb154805700 1 -- 172.21.15.81:0/681411091 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb13c003570 con 0x7fb15006d700 2023-10-07T08:43:30.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.774+0000 7fb154805700 1 -- 172.21.15.81:0/681411091 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 27810037 0 0) 0x7fb13c003570 con 0x7fb15006d700 2023-10-07T08:43:30.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.774+0000 7fb154805700 1 -- 172.21.15.81:0/681411091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1500d0b80 msgr2=0x7fb1500cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:30.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.774+0000 7fb154805700 1 --2- 172.21.15.81:0/681411091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1500d0b80 0x7fb1500cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.774+0000 7fb154805700 1 -- 172.21.15.81:0/681411091 >> v1:172.21.15.89:6789/0 conn(0x7fb1500d02b0 legacy=0x7fb15006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.774+0000 7fb154805700 1 -- 172.21.15.81:0/681411091 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1500cf570 con 0x7fb15006d700 2023-10-07T08:43:30.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.774+0000 7fb154805700 1 -- 172.21.15.81:0/681411091 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fb148001470 con 0x7fb15006d700 2023-10-07T08:43:30.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb154805700 1 -- 172.21.15.81:0/681411091 >> v1:172.21.15.81:6789/0 conn(0x7fb15006d700 legacy=0x7fb15015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb154805700 1 --2- 172.21.15.81:0/681411091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb13c003a90 0x7fb13c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb154805700 1 --2- 172.21.15.81:0/681411091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb13c004810 0x7fb13c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb154805700 1 --2- 172.21.15.81:0/681411091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1500d0b80 0x7fb13c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb154805700 1 -- 172.21.15.81:0/681411091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15015a690 con 0x7fb13c004810 2023-10-07T08:43:30.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb154805700 1 -- 172.21.15.81:0/681411091 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c00bb10 con 0x7fb13c003a90 2023-10-07T08:43:30.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb154805700 1 -- 172.21.15.81:0/681411091 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c00bcd0 con 0x7fb1500d0b80 2023-10-07T08:43:30.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb155006700 1 --2- 172.21.15.81:0/681411091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb13c004810 0x7fb13c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb155807700 1 --2- 172.21.15.81:0/681411091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb13c003a90 0x7fb13c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb156008700 1 --2- 172.21.15.81:0/681411091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1500d0b80 0x7fb13c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb155006700 1 -- 172.21.15.81:0/681411091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1500d0b80 msgr2=0x7fb13c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:30.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb155006700 1 --2- 172.21.15.81:0/681411091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1500d0b80 0x7fb13c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb155006700 1 -- 172.21.15.81:0/681411091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb13c003a90 msgr2=0x7fb13c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:30.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb155006700 1 --2- 172.21.15.81:0/681411091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb13c003a90 0x7fb13c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb155006700 1 -- 172.21.15.81:0/681411091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c003570 con 0x7fb13c004810 2023-10-07T08:43:30.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb155006700 1 --2- 172.21.15.81:0/681411091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb13c004810 0x7fb13c004c80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb1400019a0 tx=0x7fb140007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b82b11c349c5ef server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:30.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb154805700 1 -- 172.21.15.81:0/681411091 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14000c5d0 con 0x7fb13c004810 2023-10-07T08:43:30.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb154805700 1 -- 172.21.15.81:0/681411091 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14000c750 con 0x7fb13c004810 2023-10-07T08:43:30.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.775+0000 7fb154805700 1 -- 172.21.15.81:0/681411091 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14000cb10 con 0x7fb13c004810 2023-10-07T08:43:30.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.776+0000 7fb156809700 1 -- 172.21.15.81:0/681411091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb13c004810 msgr2=0x7fb13c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.776+0000 7fb156809700 1 --2- 172.21.15.81:0/681411091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb13c004810 0x7fb13c004c80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb1400019a0 tx=0x7fb140007d10 comp rx=0 tx=0).stop 2023-10-07T08:43:30.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.776+0000 7fb156008700 1 -- 172.21.15.81:0/681411091 reap_dead start 2023-10-07T08:43:30.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.776+0000 7fb156809700 1 -- 172.21.15.81:0/681411091 shutdown_connections 2023-10-07T08:43:30.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.776+0000 7fb156809700 1 -- 172.21.15.81:0/681411091 >> 172.21.15.81:0/681411091 conn(0x7fb150063230 msgr2=0x7fb150063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:30.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.776+0000 7fb156809700 1 -- 172.21.15.81:0/681411091 shutdown_connections 2023-10-07T08:43:30.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.776+0000 7fb156809700 1 -- 172.21.15.81:0/681411091 wait complete. 2023-10-07T08:43:30.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.777+0000 7fb156809700 1 Processor -- start 2023-10-07T08:43:30.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.777+0000 7fb156809700 1 -- start start 2023-10-07T08:43:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb156809700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb13c004810 0x7fb15016ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb156809700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150152990 0x7fb150152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb156809700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1500b5600 0x7fb1500b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb156809700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15016d210 con 0x7fb150152990 2023-10-07T08:43:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb156809700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15016abc0 con 0x7fb13c004810 2023-10-07T08:43:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb156809700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb150169fb0 con 0x7fb1500b5600 2023-10-07T08:43:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb155006700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150152990 0x7fb150152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb155006700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150152990 0x7fb150152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46532/0 (socket says 172.21.15.81:46532) 2023-10-07T08:43:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb155006700 1 -- 172.21.15.81:0/1292279768 learned_addr learned my addr 172.21.15.81:0/1292279768 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb156008700 1 --2- 172.21.15.81:0/1292279768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1500b5600 0x7fb1500b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb155807700 1 --2- 172.21.15.81:0/1292279768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb13c004810 0x7fb15016ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb155006700 1 -- 172.21.15.81:0/1292279768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1500b5600 msgr2=0x7fb1500b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb155006700 1 --2- 172.21.15.81:0/1292279768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1500b5600 0x7fb1500b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb155006700 1 -- 172.21.15.81:0/1292279768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb13c004810 msgr2=0x7fb15016ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb155006700 1 --2- 172.21.15.81:0/1292279768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb13c004810 0x7fb15016ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb155006700 1 -- 172.21.15.81:0/1292279768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15016a290 con 0x7fb150152990 2023-10-07T08:43:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb155006700 1 --2- 172.21.15.81:0/1292279768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150152990 0x7fb150152e00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb13c004770 tx=0x7fb140015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb145ffb700 1 -- 172.21.15.81:0/1292279768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14000c5d0 con 0x7fb150152990 2023-10-07T08:43:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb145ffb700 1 -- 172.21.15.81:0/1292279768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14000cad0 con 0x7fb150152990 2023-10-07T08:43:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb145ffb700 1 -- 172.21.15.81:0/1292279768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14001e650 con 0x7fb150152990 2023-10-07T08:43:30.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.778+0000 7fb156809700 1 -- 172.21.15.81:0/1292279768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15016a570 con 0x7fb150152990 2023-10-07T08:43:30.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.779+0000 7fb156809700 1 -- 172.21.15.81:0/1292279768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb150153340 con 0x7fb150152990 2023-10-07T08:43:30.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.779+0000 7fb156809700 1 -- 172.21.15.81:0/1292279768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb15016ad70 con 0x7fb150152990 2023-10-07T08:43:30.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.780+0000 7fb145ffb700 1 -- 172.21.15.81:0/1292279768 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb140019030 con 0x7fb150152990 2023-10-07T08:43:30.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.780+0000 7fb145ffb700 1 --2- 172.21.15.81:0/1292279768 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb134066f30 0x7fb1340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:30.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.780+0000 7fb145ffb700 1 -- 172.21.15.81:0/1292279768 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb140085ef0 con 0x7fb150152990 2023-10-07T08:43:30.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.780+0000 7fb155807700 1 --2- 172.21.15.81:0/1292279768 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb134066f30 0x7fb1340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:30.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.781+0000 7fb155807700 1 --2- 172.21.15.81:0/1292279768 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb134066f30 0x7fb1340693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0094d0 tx=0x7fb14c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:30.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.785+0000 7fb145ffb700 1 -- 172.21.15.81:0/1292279768 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb15016ad70 con 0x7fb150152990 2023-10-07T08:43:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.964+0000 7fb156809700 1 -- 172.21.15.81:0/1292279768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb1500676e0 con 0x7fb150152990 2023-10-07T08:43:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.965+0000 7fb145ffb700 1 -- 172.21.15.81:0/1292279768 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1400170a0 con 0x7fb150152990 2023-10-07T08:43:30.966 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:43:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.967+0000 7fb156809700 1 -- 172.21.15.81:0/1292279768 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb134066f30 msgr2=0x7fb1340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.967+0000 7fb156809700 1 --2- 172.21.15.81:0/1292279768 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb134066f30 0x7fb1340693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0094d0 tx=0x7fb14c00b040 comp rx=0 tx=0).stop 2023-10-07T08:43:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.967+0000 7fb156809700 1 -- 172.21.15.81:0/1292279768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150152990 msgr2=0x7fb150152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.967+0000 7fb156809700 1 --2- 172.21.15.81:0/1292279768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150152990 0x7fb150152e00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb13c004770 tx=0x7fb140015000 comp rx=0 tx=0).stop 2023-10-07T08:43:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.967+0000 7fb156809700 1 -- 172.21.15.81:0/1292279768 shutdown_connections 2023-10-07T08:43:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.967+0000 7fb156809700 1 --2- 172.21.15.81:0/1292279768 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb134066f30 0x7fb1340693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.967+0000 7fb156809700 1 --2- 172.21.15.81:0/1292279768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1500b5600 0x7fb1500b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.967+0000 7fb156809700 1 --2- 172.21.15.81:0/1292279768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb13c004810 0x7fb15016ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.967+0000 7fb156809700 1 --2- 172.21.15.81:0/1292279768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb150152990 0x7fb150152e00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.967+0000 7fb156809700 1 -- 172.21.15.81:0/1292279768 >> 172.21.15.81:0/1292279768 conn(0x7fb150063230 msgr2=0x7fb1501591f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.967+0000 7fb156809700 1 -- 172.21.15.81:0/1292279768 shutdown_connections 2023-10-07T08:43:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:30.967+0000 7fb156809700 1 -- 172.21.15.81:0/1292279768 wait complete. 2023-10-07T08:43:30.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:43:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.092+0000 7f36352fa700 1 Processor -- start 2023-10-07T08:43:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.092+0000 7f36352fa700 1 -- start start 2023-10-07T08:43:31.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.093+0000 7f36352fa700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f363015a2a0 0x7f36300b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.093+0000 7f36352fa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36300ceb30 0x7f36300cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.093+0000 7f36352fa700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f363006d650 0x7f363006da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.093+0000 7f36352fa700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363006ea90 con 0x7f363006d650 2023-10-07T08:43:31.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.093+0000 7f36352fa700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36300b0ca0 con 0x7f363015a2a0 2023-10-07T08:43:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.093+0000 7f36352fa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36300cf4c0 con 0x7f36300ceb30 2023-10-07T08:43:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.093+0000 7f362f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f363006d650 0x7f363006da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.093+0000 7f362f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f363006d650 0x7f363006da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46544/0 (socket says 172.21.15.81:46544) 2023-10-07T08:43:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.093+0000 7f362f7fe700 1 -- 172.21.15.81:0/4164934364 learned_addr learned my addr 172.21.15.81:0/4164934364 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.094+0000 7f362effd700 1 --2- 172.21.15.81:0/4164934364 >> v2:172.21.15.89:3300/0 conn(0x7f363015a2a0 0x7f36300b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.094+0000 7f362e7fc700 1 --2- 172.21.15.81:0/4164934364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36300ceb30 0x7f36300cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.094+0000 7f362f7fe700 1 -- 172.21.15.81:0/4164934364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36300ceb30 msgr2=0x7f36300cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.094+0000 7f362f7fe700 1 --2- 172.21.15.81:0/4164934364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36300ceb30 0x7f36300cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.094+0000 7f362f7fe700 1 -- 172.21.15.81:0/4164934364 >> v2:172.21.15.89:3300/0 conn(0x7f363015a2a0 msgr2=0x7f36300b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.094+0000 7f362f7fe700 1 --2- 172.21.15.81:0/4164934364 >> v2:172.21.15.89:3300/0 conn(0x7f363015a2a0 0x7f36300b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.094+0000 7f362f7fe700 1 -- 172.21.15.81:0/4164934364 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36300b00d0 con 0x7f363006d650 2023-10-07T08:43:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.094+0000 7f362effd700 1 --2- 172.21.15.81:0/4164934364 >> v2:172.21.15.89:3300/0 conn(0x7f363015a2a0 0x7f36300b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:31.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.094+0000 7f362f7fe700 1 --2- 172.21.15.81:0/4164934364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f363006d650 0x7f363006da70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f36300637a0 tx=0x7f3628009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6745fecdaba08214 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:31.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.094+0000 7f362dffb700 1 -- 172.21.15.81:0/4164934364 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362800b860 con 0x7f363006d650 2023-10-07T08:43:31.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.094+0000 7f362dffb700 1 -- 172.21.15.81:0/4164934364 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362800b9c0 con 0x7f363006d650 2023-10-07T08:43:31.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.094+0000 7f362dffb700 1 -- 172.21.15.81:0/4164934364 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362800bd60 con 0x7f363006d650 2023-10-07T08:43:31.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.095+0000 7f36352fa700 1 -- 172.21.15.81:0/4164934364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f363006d650 msgr2=0x7f363006da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:31.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.095+0000 7f36352fa700 1 --2- 172.21.15.81:0/4164934364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f363006d650 0x7f363006da70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f36300637a0 tx=0x7f3628009250 comp rx=0 tx=0).stop 2023-10-07T08:43:31.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.095+0000 7f36352fa700 1 -- 172.21.15.81:0/4164934364 shutdown_connections 2023-10-07T08:43:31.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.095+0000 7f36352fa700 1 --2- 172.21.15.81:0/4164934364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f363006d650 0x7f363006da70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.095+0000 7f36352fa700 1 --2- 172.21.15.81:0/4164934364 >> v2:172.21.15.89:3300/0 conn(0x7f363015a2a0 0x7f36300b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.095+0000 7f36352fa700 1 --2- 172.21.15.81:0/4164934364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36300ceb30 0x7f36300cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.095+0000 7f36352fa700 1 -- 172.21.15.81:0/4164934364 >> 172.21.15.81:0/4164934364 conn(0x7f3630067640 msgr2=0x7f3630067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:31.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.095+0000 7f36352fa700 1 -- 172.21.15.81:0/4164934364 shutdown_connections 2023-10-07T08:43:31.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.095+0000 7f36352fa700 1 -- 172.21.15.81:0/4164934364 wait complete. 2023-10-07T08:43:31.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.096+0000 7f36352fa700 1 Processor -- start 2023-10-07T08:43:31.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.096+0000 7f36352fa700 1 -- start start 2023-10-07T08:43:31.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f36352fa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f363006d650 0x7f36300cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f36352fa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36300ceb30 0x7f363014a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f36352fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f363015a2a0 0x7f363015b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f36352fa700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300caff0 con 0x7f363015a2a0 2023-10-07T08:43:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f36352fa700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300ca420 con 0x7f363006d650 2023-10-07T08:43:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f36352fa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36300ca6c0 con 0x7f36300ceb30 2023-10-07T08:43:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f362f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f363015a2a0 0x7f363015b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f362f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f363015a2a0 0x7f363015b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46550/0 (socket says 172.21.15.81:46550) 2023-10-07T08:43:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f362f7fe700 1 -- 172.21.15.81:0/1020768935 learned_addr learned my addr 172.21.15.81:0/1020768935 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f362f7fe700 1 -- 172.21.15.81:0/1020768935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36300ceb30 msgr2=0x7f363014a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f362f7fe700 1 --2- 172.21.15.81:0/1020768935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36300ceb30 0x7f363014a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f362f7fe700 1 -- 172.21.15.81:0/1020768935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f363006d650 msgr2=0x7f36300cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f362f7fe700 1 --2- 172.21.15.81:0/1020768935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f363006d650 0x7f36300cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f362f7fe700 1 -- 172.21.15.81:0/1020768935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36280094f0 con 0x7f363015a2a0 2023-10-07T08:43:31.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f362f7fe700 1 --2- 172.21.15.81:0/1020768935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f363015a2a0 0x7f363015b740 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f36280090b0 tx=0x7f3628017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:31.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f3626ffd700 1 -- 172.21.15.81:0/1020768935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362801a640 con 0x7f363015a2a0 2023-10-07T08:43:31.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f3626ffd700 1 -- 172.21.15.81:0/1020768935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362801f070 con 0x7f363015a2a0 2023-10-07T08:43:31.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f3626ffd700 1 -- 172.21.15.81:0/1020768935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362801aa10 con 0x7f363015a2a0 2023-10-07T08:43:31.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f36352fa700 1 -- 172.21.15.81:0/1020768935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36300ca9a0 con 0x7f363015a2a0 2023-10-07T08:43:31.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.097+0000 7f36352fa700 1 -- 172.21.15.81:0/1020768935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363014aca0 con 0x7f363015a2a0 2023-10-07T08:43:31.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.098+0000 7f36352fa700 1 -- 172.21.15.81:0/1020768935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36300cb2d0 con 0x7f363015a2a0 2023-10-07T08:43:31.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.098+0000 7f3626ffd700 1 -- 172.21.15.81:0/1020768935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f362801b430 con 0x7f363015a2a0 2023-10-07T08:43:31.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.099+0000 7f3626ffd700 1 --2- 172.21.15.81:0/1020768935 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3610066f30 0x7f36100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.099+0000 7f3626ffd700 1 -- 172.21.15.81:0/1020768935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3628021070 con 0x7f363015a2a0 2023-10-07T08:43:31.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.099+0000 7f362effd700 1 --2- 172.21.15.81:0/1020768935 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3610066f30 0x7f36100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:31.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.099+0000 7f362effd700 1 --2- 172.21.15.81:0/1020768935 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3610066f30 0x7f36100693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f36200094d0 tx=0x7f36200096b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:31.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.103+0000 7f3626ffd700 1 -- 172.21.15.81:0/1020768935 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36280538a0 con 0x7f363015a2a0 2023-10-07T08:43:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.330+0000 7f36352fa700 1 -- 172.21.15.81:0/1020768935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36300cb130 con 0x7f363015a2a0 2023-10-07T08:43:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.330+0000 7f3626ffd700 1 -- 172.21.15.81:0/1020768935 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f36300cb130 con 0x7f363015a2a0 2023-10-07T08:43:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:31.332 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4266800811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4266800811},{"type":"v1","addr":"172.21.15.81:6836","nonce":4266800811}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1054766807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1054766807},{"type":"v1","addr":"172.21.15.89:6833","nonce":1054766807}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1734914753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1734914753},{"type":"v1","addr":"172.21.15.81:6837","nonce":1734914753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:42:56.633557+0000","modified":"2023-10-07T08:43:00.266271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/860615068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":860615068},{"type":"v1","addr":"172.21.15.89:6835","nonce":860615068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-07T08:43:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.332+0000 7f36352fa700 1 -- 172.21.15.81:0/1020768935 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3610066f30 msgr2=0x7f36100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.332+0000 7f36352fa700 1 --2- 172.21.15.81:0/1020768935 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3610066f30 0x7f36100693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f36200094d0 tx=0x7f36200096b0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.332+0000 7f36352fa700 1 -- 172.21.15.81:0/1020768935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f363015a2a0 msgr2=0x7f363015b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.332+0000 7f36352fa700 1 --2- 172.21.15.81:0/1020768935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f363015a2a0 0x7f363015b740 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f36280090b0 tx=0x7f3628017000 comp rx=0 tx=0).stop 2023-10-07T08:43:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.332+0000 7f36352fa700 1 -- 172.21.15.81:0/1020768935 shutdown_connections 2023-10-07T08:43:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.332+0000 7f36352fa700 1 --2- 172.21.15.81:0/1020768935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f363015a2a0 0x7f363015b740 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.332+0000 7f36352fa700 1 --2- 172.21.15.81:0/1020768935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f363006d650 0x7f36300cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.332+0000 7f36352fa700 1 --2- 172.21.15.81:0/1020768935 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3610066f30 0x7f36100693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.332+0000 7f36352fa700 1 --2- 172.21.15.81:0/1020768935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36300ceb30 0x7f363014a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.332+0000 7f36352fa700 1 -- 172.21.15.81:0/1020768935 >> 172.21.15.81:0/1020768935 conn(0x7f3630067640 msgr2=0x7f3630158be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.332+0000 7f36352fa700 1 -- 172.21.15.81:0/1020768935 shutdown_connections 2023-10-07T08:43:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.332+0000 7f36352fa700 1 -- 172.21.15.81:0/1020768935 wait complete. 2023-10-07T08:43:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2023-10-07T08:43:31.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.459+0000 7f3ce759e700 1 Processor -- start 2023-10-07T08:43:31.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.459+0000 7f3ce759e700 1 -- start start 2023-10-07T08:43:31.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.460+0000 7f3ce759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ce8159f10 0x7f3ce8068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.460+0000 7f3ce759e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce8069120 con 0x7f3ce8068cc0 2023-10-07T08:43:31.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.460+0000 7f3ce759e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce80cee10 con 0x7f3ce8159b40 2023-10-07T08:43:31.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.460+0000 7f3ce759e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce80cd040 con 0x7f3ce8159f10 2023-10-07T08:43:31.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.460+0000 7f3ce5d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ce8159f10 0x7f3ce8068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:31.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.460+0000 7f3ce6d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3ce8068cc0 0x7f3ce80cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53146/0 (socket says 172.21.15.81:53146) 2023-10-07T08:43:31.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.460+0000 7f3ce6d9d700 1 -- 172.21.15.81:0/3003610088 learned_addr learned my addr 172.21.15.81:0/3003610088 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:31.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.461+0000 7f3ce5d9b700 1 -- 172.21.15.81:0/3003610088 >> v1:172.21.15.89:6789/0 conn(0x7f3ce8159b40 legacy=0x7f3ce80cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:31.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.461+0000 7f3ce5d9b700 1 -- 172.21.15.81:0/3003610088 >> v1:172.21.15.81:6789/0 conn(0x7f3ce8068cc0 legacy=0x7f3ce80cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:31.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.461+0000 7f3ce5d9b700 1 -- 172.21.15.81:0/3003610088 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce80cd320 con 0x7f3ce8159f10 2023-10-07T08:43:31.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.461+0000 7f3ce5d9b700 1 --2- 172.21.15.81:0/3003610088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce8159f10 0x7f3ce8068780 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0098e0 tx=0x7f3cdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e840d3c4514b82 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:31.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.461+0000 7f3ce559a700 1 -- 172.21.15.81:0/3003610088 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc009e80 con 0x7f3ce8159f10 2023-10-07T08:43:31.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.461+0000 7f3ce559a700 1 -- 172.21.15.81:0/3003610088 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc00b760 con 0x7f3ce8159f10 2023-10-07T08:43:31.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.461+0000 7f3ce559a700 1 -- 172.21.15.81:0/3003610088 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00bb00 con 0x7f3ce8159f10 2023-10-07T08:43:31.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.461+0000 7f3ce759e700 1 -- 172.21.15.81:0/3003610088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce8159f10 msgr2=0x7f3ce8068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:31.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.461+0000 7f3ce759e700 1 --2- 172.21.15.81:0/3003610088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce8159f10 0x7f3ce8068780 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0098e0 tx=0x7f3cdc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.461+0000 7f3ce759e700 1 -- 172.21.15.81:0/3003610088 shutdown_connections 2023-10-07T08:43:31.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.461+0000 7f3ce759e700 1 --2- 172.21.15.81:0/3003610088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce8159f10 0x7f3ce8068780 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.461+0000 7f3ce759e700 1 -- 172.21.15.81:0/3003610088 >> 172.21.15.81:0/3003610088 conn(0x7f3ce80cd660 msgr2=0x7f3ce80cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:31.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.461+0000 7f3ce759e700 1 -- 172.21.15.81:0/3003610088 shutdown_connections 2023-10-07T08:43:31.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.462+0000 7f3ce759e700 1 -- 172.21.15.81:0/3003610088 wait complete. 2023-10-07T08:43:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.462+0000 7f3ce759e700 1 Processor -- start 2023-10-07T08:43:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.463+0000 7f3ce759e700 1 -- start start 2023-10-07T08:43:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.463+0000 7f3ce759e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ce8068cc0 0x7f3ce81446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.463+0000 7f3ce759e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ce8159b40 0x7f3ce815d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.463+0000 7f3ce759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce8159f10 0x7f3ce815db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.463+0000 7f3ce759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce815f690 con 0x7f3ce8159f10 2023-10-07T08:43:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.463+0000 7f3ce759e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce815f820 con 0x7f3ce8159b40 2023-10-07T08:43:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.463+0000 7f3ce759e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce80c9c60 con 0x7f3ce8068cc0 2023-10-07T08:43:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.463+0000 7f3ce6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce8159f10 0x7f3ce815db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.463+0000 7f3ce6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce8159f10 0x7f3ce815db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46564/0 (socket says 172.21.15.81:46564) 2023-10-07T08:43:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.463+0000 7f3ce6d9d700 1 -- 172.21.15.81:0/4251660211 learned_addr learned my addr 172.21.15.81:0/4251660211 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.464+0000 7f3ce5d9b700 1 --2- 172.21.15.81:0/4251660211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ce8159b40 0x7f3ce815d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.463+0000 7f3ce659c700 1 --2- 172.21.15.81:0/4251660211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ce8068cc0 0x7f3ce81446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.464+0000 7f3ce6d9d700 1 -- 172.21.15.81:0/4251660211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ce8068cc0 msgr2=0x7f3ce81446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.464+0000 7f3ce6d9d700 1 --2- 172.21.15.81:0/4251660211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ce8068cc0 0x7f3ce81446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.464+0000 7f3ce6d9d700 1 -- 172.21.15.81:0/4251660211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ce8159b40 msgr2=0x7f3ce815d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.464+0000 7f3ce6d9d700 1 --2- 172.21.15.81:0/4251660211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ce8159b40 0x7f3ce815d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.464+0000 7f3ce6d9d700 1 -- 172.21.15.81:0/4251660211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc009420 con 0x7f3ce8159f10 2023-10-07T08:43:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.464+0000 7f3ce6d9d700 1 --2- 172.21.15.81:0/4251660211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce8159f10 0x7f3ce815db80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000c880 tx=0x7f3ce0007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.464+0000 7f3cd67fc700 1 -- 172.21.15.81:0/4251660211 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0005b30 con 0x7f3ce8159f10 2023-10-07T08:43:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.464+0000 7f3cd67fc700 1 -- 172.21.15.81:0/4251660211 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce0005c90 con 0x7f3ce8159f10 2023-10-07T08:43:31.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.464+0000 7f3ce759e700 1 -- 172.21.15.81:0/4251660211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce80c9f40 con 0x7f3ce8159f10 2023-10-07T08:43:31.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.464+0000 7f3cd67fc700 1 -- 172.21.15.81:0/4251660211 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0007340 con 0x7f3ce8159f10 2023-10-07T08:43:31.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.464+0000 7f3ce759e700 1 -- 172.21.15.81:0/4251660211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce80ca500 con 0x7f3ce8159f10 2023-10-07T08:43:31.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.465+0000 7f3ce759e700 1 -- 172.21.15.81:0/4251660211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce80cb890 con 0x7f3ce8159f10 2023-10-07T08:43:31.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.465+0000 7f3cd67fc700 1 -- 172.21.15.81:0/4251660211 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ce001b400 con 0x7f3ce8159f10 2023-10-07T08:43:31.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.465+0000 7f3cd67fc700 1 --2- 172.21.15.81:0/4251660211 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cc8066f30 0x7f3cc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.466+0000 7f3cd67fc700 1 -- 172.21.15.81:0/4251660211 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ce00840d0 con 0x7f3ce8159f10 2023-10-07T08:43:31.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.466+0000 7f3ce659c700 1 --2- 172.21.15.81:0/4251660211 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cc8066f30 0x7f3cc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:31.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.466+0000 7f3ce659c700 1 --2- 172.21.15.81:0/4251660211 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cc8066f30 0x7f3cc80693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8007fd0 tx=0x7f3cd8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:31.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.470+0000 7f3cd67fc700 1 -- 172.21.15.81:0/4251660211 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ce00513c0 con 0x7f3ce8159f10 2023-10-07T08:43:31.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.651+0000 7f3ce759e700 1 -- 172.21.15.81:0/4251660211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ce8069120 con 0x7f3ce8159f10 2023-10-07T08:43:31.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.652+0000 7f3cd67fc700 1 -- 172.21.15.81:0/4251660211 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f3ce8069120 con 0x7f3ce8159f10 2023-10-07T08:43:31.654 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:31.654 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:58.248338+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:42:54.397263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:42:55.595133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:31.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.654+0000 7f3ce759e700 1 -- 172.21.15.81:0/4251660211 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cc8066f30 msgr2=0x7f3cc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:31.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.654+0000 7f3ce759e700 1 --2- 172.21.15.81:0/4251660211 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cc8066f30 0x7f3cc80693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8007fd0 tx=0x7f3cd8009040 comp rx=0 tx=0).stop 2023-10-07T08:43:31.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.654+0000 7f3ce759e700 1 -- 172.21.15.81:0/4251660211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce8159f10 msgr2=0x7f3ce815db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:31.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.654+0000 7f3ce759e700 1 --2- 172.21.15.81:0/4251660211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce8159f10 0x7f3ce815db80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000c880 tx=0x7f3ce0007ea0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.654+0000 7f3ce759e700 1 -- 172.21.15.81:0/4251660211 shutdown_connections 2023-10-07T08:43:31.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.654+0000 7f3ce759e700 1 --2- 172.21.15.81:0/4251660211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce8159f10 0x7f3ce815db80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.654+0000 7f3ce759e700 1 --2- 172.21.15.81:0/4251660211 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cc8066f30 0x7f3cc80693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.654+0000 7f3ce759e700 1 --2- 172.21.15.81:0/4251660211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ce8068cc0 0x7f3ce81446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.654+0000 7f3ce759e700 1 --2- 172.21.15.81:0/4251660211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ce8159b40 0x7f3ce815d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.654+0000 7f3ce759e700 1 -- 172.21.15.81:0/4251660211 >> 172.21.15.81:0/4251660211 conn(0x7f3ce80cd660 msgr2=0x7f3ce80cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:31.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.654+0000 7f3ce759e700 1 -- 172.21.15.81:0/4251660211 shutdown_connections 2023-10-07T08:43:31.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.654+0000 7f3ce759e700 1 -- 172.21.15.81:0/4251660211 wait complete. 2023-10-07T08:43:31.668 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T08:43:31.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:43:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.782+0000 7ff9b5846700 1 Processor -- start 2023-10-07T08:43:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.782+0000 7ff9b5846700 1 -- start start 2023-10-07T08:43:31.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.783+0000 7ff9b5846700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b006e940 0x7ff9b0161950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.783+0000 7ff9b5846700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b00b2290 con 0x7ff9b0156db0 2023-10-07T08:43:31.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.783+0000 7ff9b5846700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b0157c00 con 0x7ff9b01569e0 2023-10-07T08:43:31.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.783+0000 7ff9b5846700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b01572d0 con 0x7ff9b006e940 2023-10-07T08:43:31.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.783+0000 7ff9ae7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff9b0156db0 0x7ff9b006e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53154/0 (socket says 172.21.15.81:53154) 2023-10-07T08:43:31.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.783+0000 7ff9ae7fc700 1 -- 172.21.15.81:0/3213036874 learned_addr learned my addr 172.21.15.81:0/3213036874 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:31.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.783+0000 7ff9af7fe700 1 --2- 172.21.15.81:0/3213036874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b006e940 0x7ff9b0161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:31.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.784+0000 7ff9adffb700 1 -- 172.21.15.81:0/3213036874 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147300139 0 0) 0x7ff9b00b2290 con 0x7ff9b0156db0 2023-10-07T08:43:31.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.784+0000 7ff9adffb700 1 -- 172.21.15.81:0/3213036874 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff998003570 con 0x7ff9b0156db0 2023-10-07T08:43:31.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.784+0000 7ff9adffb700 1 -- 172.21.15.81:0/3213036874 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482851337 0 0) 0x7ff9b0157c00 con 0x7ff9b01569e0 2023-10-07T08:43:31.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.784+0000 7ff9adffb700 1 -- 172.21.15.81:0/3213036874 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9b00b2290 con 0x7ff9b01569e0 2023-10-07T08:43:31.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.784+0000 7ff9af7fe700 1 -- 172.21.15.81:0/3213036874 >> v1:172.21.15.89:6789/0 conn(0x7ff9b01569e0 legacy=0x7ff9b00b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:31.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.784+0000 7ff9af7fe700 1 -- 172.21.15.81:0/3213036874 >> v1:172.21.15.81:6789/0 conn(0x7ff9b0156db0 legacy=0x7ff9b006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:31.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.784+0000 7ff9af7fe700 1 -- 172.21.15.81:0/3213036874 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b01575b0 con 0x7ff9b006e940 2023-10-07T08:43:31.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.784+0000 7ff9af7fe700 1 --2- 172.21.15.81:0/3213036874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b006e940 0x7ff9b0161950 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009910 tx=0x7ff9a80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adbae055d8d39a41 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:31.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.784+0000 7ff9adffb700 1 -- 172.21.15.81:0/3213036874 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8011630 con 0x7ff9b006e940 2023-10-07T08:43:31.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.784+0000 7ff9adffb700 1 -- 172.21.15.81:0/3213036874 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a8011790 con 0x7ff9b006e940 2023-10-07T08:43:31.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.784+0000 7ff9adffb700 1 -- 172.21.15.81:0/3213036874 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8011b30 con 0x7ff9b006e940 2023-10-07T08:43:31.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.785+0000 7ff9b5846700 1 -- 172.21.15.81:0/3213036874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b006e940 msgr2=0x7ff9b0161950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:31.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.785+0000 7ff9b5846700 1 --2- 172.21.15.81:0/3213036874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b006e940 0x7ff9b0161950 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009910 tx=0x7ff9a80091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.785+0000 7ff9b5846700 1 -- 172.21.15.81:0/3213036874 shutdown_connections 2023-10-07T08:43:31.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.785+0000 7ff9b5846700 1 --2- 172.21.15.81:0/3213036874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b006e940 0x7ff9b0161950 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.785+0000 7ff9b5846700 1 -- 172.21.15.81:0/3213036874 >> 172.21.15.81:0/3213036874 conn(0x7ff9b006cca0 msgr2=0x7ff9b006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:31.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.785+0000 7ff9b5846700 1 -- 172.21.15.81:0/3213036874 shutdown_connections 2023-10-07T08:43:31.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.785+0000 7ff9b5846700 1 -- 172.21.15.81:0/3213036874 wait complete. 2023-10-07T08:43:31.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.786+0000 7ff9b5846700 1 Processor -- start 2023-10-07T08:43:31.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.786+0000 7ff9b5846700 1 -- start start 2023-10-07T08:43:31.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9b5846700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b006e940 0x7ff9b01515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9b5846700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b01569e0 0x7ff9b0154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9b5846700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b0156db0 0x7ff9b0154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9b5846700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00ac3c0 con 0x7ff9b0156db0 2023-10-07T08:43:31.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9b5846700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b0159790 con 0x7ff9b01569e0 2023-10-07T08:43:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9b5846700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b0151b10 con 0x7ff9b006e940 2023-10-07T08:43:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9af7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b0156db0 0x7ff9b0154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9af7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b0156db0 0x7ff9b0154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46566/0 (socket says 172.21.15.81:46566) 2023-10-07T08:43:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9af7fe700 1 -- 172.21.15.81:0/293080869 learned_addr learned my addr 172.21.15.81:0/293080869 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9aeffd700 1 --2- 172.21.15.81:0/293080869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b006e940 0x7ff9b01515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9ae7fc700 1 --2- 172.21.15.81:0/293080869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b01569e0 0x7ff9b0154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9af7fe700 1 -- 172.21.15.81:0/293080869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b006e940 msgr2=0x7ff9b01515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9af7fe700 1 --2- 172.21.15.81:0/293080869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b006e940 0x7ff9b01515d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9af7fe700 1 -- 172.21.15.81:0/293080869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b01569e0 msgr2=0x7ff9b0154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9af7fe700 1 --2- 172.21.15.81:0/293080869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b01569e0 0x7ff9b0154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9af7fe700 1 -- 172.21.15.81:0/293080869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a8009420 con 0x7ff9b0156db0 2023-10-07T08:43:31.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9af7fe700 1 --2- 172.21.15.81:0/293080869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b0156db0 0x7ff9b0154850 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8013000 tx=0x7ff9a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:31.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff996ffd700 1 -- 172.21.15.81:0/293080869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a801f070 con 0x7ff9b0156db0 2023-10-07T08:43:31.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff996ffd700 1 -- 172.21.15.81:0/293080869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a8002f70 con 0x7ff9b0156db0 2023-10-07T08:43:31.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff9b5846700 1 -- 172.21.15.81:0/293080869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b0158b80 con 0x7ff9b0156db0 2023-10-07T08:43:31.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.787+0000 7ff996ffd700 1 -- 172.21.15.81:0/293080869 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8011630 con 0x7ff9b0156db0 2023-10-07T08:43:31.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.788+0000 7ff9b5846700 1 -- 172.21.15.81:0/293080869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b0159140 con 0x7ff9b0156db0 2023-10-07T08:43:31.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.788+0000 7ff9b5846700 1 -- 172.21.15.81:0/293080869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b0068900 con 0x7ff9b0156db0 2023-10-07T08:43:31.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.789+0000 7ff996ffd700 1 -- 172.21.15.81:0/293080869 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9a8023070 con 0x7ff9b0156db0 2023-10-07T08:43:31.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.789+0000 7ff996ffd700 1 --2- 172.21.15.81:0/293080869 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff99c066f30 0x7ff99c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:31.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.789+0000 7ff996ffd700 1 -- 172.21.15.81:0/293080869 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9a80858d0 con 0x7ff9b0156db0 2023-10-07T08:43:31.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.789+0000 7ff9aeffd700 1 --2- 172.21.15.81:0/293080869 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff99c066f30 0x7ff99c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:31.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.789+0000 7ff9aeffd700 1 --2- 172.21.15.81:0/293080869 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff99c066f30 0x7ff99c0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0004140 tx=0x7ff9a0007f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:31.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:31.793+0000 7ff996ffd700 1 -- 172.21.15.81:0/293080869 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9a8052b40 con 0x7ff9b0156db0 2023-10-07T08:43:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.018+0000 7ff9b5846700 1 -- 172.21.15.81:0/293080869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9b0157890 con 0x7ff9b0156db0 2023-10-07T08:43:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.018+0000 7ff996ffd700 1 -- 172.21.15.81:0/293080869 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7ff9a802a020 con 0x7ff9b0156db0 2023-10-07T08:43:32.020 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:32.020 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4266800811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4266800811},{"type":"v1","addr":"172.21.15.81:6836","nonce":4266800811}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1054766807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1054766807},{"type":"v1","addr":"172.21.15.89:6833","nonce":1054766807}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1734914753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1734914753},{"type":"v1","addr":"172.21.15.81:6837","nonce":1734914753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:42:56.633557+0000","modified":"2023-10-07T08:43:00.266271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/860615068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":860615068},{"type":"v1","addr":"172.21.15.89:6835","nonce":860615068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-07T08:43:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.020+0000 7ff9b5846700 1 -- 172.21.15.81:0/293080869 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff99c066f30 msgr2=0x7ff99c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.020+0000 7ff9b5846700 1 --2- 172.21.15.81:0/293080869 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff99c066f30 0x7ff99c0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0004140 tx=0x7ff9a0007f90 comp rx=0 tx=0).stop 2023-10-07T08:43:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.020+0000 7ff9b5846700 1 -- 172.21.15.81:0/293080869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b0156db0 msgr2=0x7ff9b0154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.020+0000 7ff9b5846700 1 --2- 172.21.15.81:0/293080869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b0156db0 0x7ff9b0154850 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8013000 tx=0x7ff9a8017000 comp rx=0 tx=0).stop 2023-10-07T08:43:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.020+0000 7ff9b5846700 1 -- 172.21.15.81:0/293080869 shutdown_connections 2023-10-07T08:43:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.020+0000 7ff9b5846700 1 --2- 172.21.15.81:0/293080869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b0156db0 0x7ff9b0154850 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.020+0000 7ff9b5846700 1 --2- 172.21.15.81:0/293080869 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff99c066f30 0x7ff99c0693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.020+0000 7ff9b5846700 1 --2- 172.21.15.81:0/293080869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b006e940 0x7ff9b01515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.020+0000 7ff9b5846700 1 --2- 172.21.15.81:0/293080869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b01569e0 0x7ff9b0154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.020+0000 7ff9b5846700 1 -- 172.21.15.81:0/293080869 >> 172.21.15.81:0/293080869 conn(0x7ff9b006cca0 msgr2=0x7ff9b01524a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.020+0000 7ff9b5846700 1 -- 172.21.15.81:0/293080869 shutdown_connections 2023-10-07T08:43:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.021+0000 7ff9b5846700 1 -- 172.21.15.81:0/293080869 wait complete. 2023-10-07T08:43:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2023-10-07T08:43:32.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:43:32.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.146+0000 7fccc7b5d700 1 Processor -- start 2023-10-07T08:43:32.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.146+0000 7fccc7b5d700 1 -- start start 2023-10-07T08:43:32.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.147+0000 7fccc7b5d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fccc01578d0 0x7fccc00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.147+0000 7fccc7b5d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fccc0157ca0 0x7fccc015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.147+0000 7fccc7b5d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc00d07c0 con 0x7fccc006d120 2023-10-07T08:43:32.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.147+0000 7fccc7b5d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc00cfbb0 con 0x7fccc0157ca0 2023-10-07T08:43:32.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.147+0000 7fccc7b5d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc00cfe90 con 0x7fccc01578d0 2023-10-07T08:43:32.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.147+0000 7fccc50f8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fccc0157ca0 0x7fccc015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.147+0000 7fccc60fa700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fccc006d120 0x7fccc006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53164/0 (socket says 172.21.15.81:53164) 2023-10-07T08:43:32.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.147+0000 7fccc60fa700 1 -- 172.21.15.81:0/3937877454 learned_addr learned my addr 172.21.15.81:0/3937877454 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:32.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.147+0000 7fccc58f9700 1 --2- 172.21.15.81:0/3937877454 >> v2:172.21.15.89:3300/0 conn(0x7fccc01578d0 0x7fccc00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.147+0000 7fccc50f8700 1 -- 172.21.15.81:0/3937877454 >> v2:172.21.15.89:3300/0 conn(0x7fccc01578d0 msgr2=0x7fccc00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:32.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.147+0000 7fccc50f8700 1 --2- 172.21.15.81:0/3937877454 >> v2:172.21.15.89:3300/0 conn(0x7fccc01578d0 0x7fccc00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.147+0000 7fccc50f8700 1 -- 172.21.15.81:0/3937877454 >> v1:172.21.15.81:6789/0 conn(0x7fccc006d120 legacy=0x7fccc006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.147+0000 7fccc48f7700 1 -- 172.21.15.81:0/3937877454 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015021361 0 0) 0x7fccc00d07c0 con 0x7fccc006d120 2023-10-07T08:43:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.147+0000 7fccc50f8700 1 -- 172.21.15.81:0/3937877454 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00d0170 con 0x7fccc0157ca0 2023-10-07T08:43:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.147+0000 7fccc50f8700 1 --2- 172.21.15.81:0/3937877454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc0157ca0 0x7fccc015af00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fccc00646b0 tx=0x7fccb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b643c5f15e06afc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.147+0000 7fccc48f7700 1 -- 172.21.15.81:0/3937877454 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0011630 con 0x7fccc0157ca0 2023-10-07T08:43:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.148+0000 7fccc48f7700 1 -- 172.21.15.81:0/3937877454 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb0011790 con 0x7fccc0157ca0 2023-10-07T08:43:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.148+0000 7fccc48f7700 1 -- 172.21.15.81:0/3937877454 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0011b30 con 0x7fccc0157ca0 2023-10-07T08:43:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.148+0000 7fccc7b5d700 1 -- 172.21.15.81:0/3937877454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc0157ca0 msgr2=0x7fccc015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.148+0000 7fccc7b5d700 1 --2- 172.21.15.81:0/3937877454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc0157ca0 0x7fccc015af00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fccc00646b0 tx=0x7fccb00091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.148+0000 7fccc7b5d700 1 -- 172.21.15.81:0/3937877454 shutdown_connections 2023-10-07T08:43:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.148+0000 7fccc7b5d700 1 --2- 172.21.15.81:0/3937877454 >> v2:172.21.15.89:3300/0 conn(0x7fccc01578d0 0x7fccc00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.148+0000 7fccc7b5d700 1 --2- 172.21.15.81:0/3937877454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc0157ca0 0x7fccc015af00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.148+0000 7fccc7b5d700 1 -- 172.21.15.81:0/3937877454 >> 172.21.15.81:0/3937877454 conn(0x7fccc006bb90 msgr2=0x7fccc006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:32.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.148+0000 7fccc7b5d700 1 -- 172.21.15.81:0/3937877454 shutdown_connections 2023-10-07T08:43:32.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.148+0000 7fccc7b5d700 1 -- 172.21.15.81:0/3937877454 wait complete. 2023-10-07T08:43:32.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.149+0000 7fccc7b5d700 1 Processor -- start 2023-10-07T08:43:32.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.149+0000 7fccc7b5d700 1 -- start start 2023-10-07T08:43:32.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.150+0000 7fccc7b5d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccc006d120 0x7fccc00c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.150+0000 7fccc7b5d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc01578d0 0x7fccc00b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.150+0000 7fccc7b5d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc0157ca0 0x7fccc00c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.150+0000 7fccc7b5d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00c7f70 con 0x7fccc01578d0 2023-10-07T08:43:32.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.150+0000 7fccc7b5d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00c5b20 con 0x7fccc0157ca0 2023-10-07T08:43:32.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.150+0000 7fccc7b5d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00c7c90 con 0x7fccc006d120 2023-10-07T08:43:32.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.150+0000 7fccc50f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc01578d0 0x7fccc00b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.150+0000 7fccc50f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc01578d0 0x7fccc00b5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46580/0 (socket says 172.21.15.81:46580) 2023-10-07T08:43:32.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.150+0000 7fccc50f8700 1 -- 172.21.15.81:0/3663340432 learned_addr learned my addr 172.21.15.81:0/3663340432 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:32.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.150+0000 7fccc60fa700 1 --2- 172.21.15.81:0/3663340432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc0157ca0 0x7fccc00c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.150+0000 7fccc58f9700 1 --2- 172.21.15.81:0/3663340432 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccc006d120 0x7fccc00c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.150+0000 7fccc50f8700 1 -- 172.21.15.81:0/3663340432 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccc006d120 msgr2=0x7fccc00c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.150+0000 7fccc50f8700 1 --2- 172.21.15.81:0/3663340432 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccc006d120 0x7fccc00c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.150+0000 7fccc50f8700 1 -- 172.21.15.81:0/3663340432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc0157ca0 msgr2=0x7fccc00c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.150+0000 7fccc50f8700 1 --2- 172.21.15.81:0/3663340432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc0157ca0 0x7fccc00c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.150+0000 7fccc50f8700 1 -- 172.21.15.81:0/3663340432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb0009420 con 0x7fccc01578d0 2023-10-07T08:43:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.151+0000 7fccc50f8700 1 --2- 172.21.15.81:0/3663340432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc01578d0 0x7fccc00b5170 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fccb0013000 tx=0x7fccb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.151+0000 7fccb5ffb700 1 -- 172.21.15.81:0/3663340432 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0000d10 con 0x7fccc01578d0 2023-10-07T08:43:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.151+0000 7fccb5ffb700 1 -- 172.21.15.81:0/3663340432 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb0011900 con 0x7fccc01578d0 2023-10-07T08:43:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.151+0000 7fccb5ffb700 1 -- 172.21.15.81:0/3663340432 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0025420 con 0x7fccc01578d0 2023-10-07T08:43:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.151+0000 7fccc7b5d700 1 -- 172.21.15.81:0/3663340432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc00c5d70 con 0x7fccc01578d0 2023-10-07T08:43:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.151+0000 7fccc7b5d700 1 -- 172.21.15.81:0/3663340432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc00b56b0 con 0x7fccc01578d0 2023-10-07T08:43:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.152+0000 7fccc7b5d700 1 -- 172.21.15.81:0/3663340432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc00c6570 con 0x7fccc01578d0 2023-10-07T08:43:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.152+0000 7fccb5ffb700 1 -- 172.21.15.81:0/3663340432 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fccb0023070 con 0x7fccc01578d0 2023-10-07T08:43:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.153+0000 7fccb5ffb700 1 --2- 172.21.15.81:0/3663340432 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcca4066f30 0x7fcca40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.153+0000 7fccb5ffb700 1 -- 172.21.15.81:0/3663340432 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fccb00858f0 con 0x7fccc01578d0 2023-10-07T08:43:32.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.153+0000 7fccc58f9700 1 --2- 172.21.15.81:0/3663340432 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcca4066f30 0x7fcca40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.153+0000 7fccc58f9700 1 --2- 172.21.15.81:0/3663340432 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcca4066f30 0x7fcca40693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fccc015d870 tx=0x7fccb80091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:32.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.157+0000 7fccb5ffb700 1 -- 172.21.15.81:0/3663340432 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fccc00c6570 con 0x7fccc01578d0 2023-10-07T08:43:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.381+0000 7fccc7b5d700 1 -- 172.21.15.81:0/3663340432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fccc00c6570 con 0x7fccc01578d0 2023-10-07T08:43:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.381+0000 7fccb5ffb700 1 -- 172.21.15.81:0/3663340432 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fccc00c6570 con 0x7fccc01578d0 2023-10-07T08:43:32.383 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:32.383 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4266800811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4266800811},{"type":"v1","addr":"172.21.15.81:6836","nonce":4266800811}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1054766807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1054766807},{"type":"v1","addr":"172.21.15.89:6833","nonce":1054766807}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1734914753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1734914753},{"type":"v1","addr":"172.21.15.81:6837","nonce":1734914753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:42:56.633557+0000","modified":"2023-10-07T08:43:00.266271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6835/860615068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":860615068},{"type":"v1","addr":"172.21.15.89:6835","nonce":860615068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-07T08:43:32.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.383+0000 7fccc7b5d700 1 -- 172.21.15.81:0/3663340432 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcca4066f30 msgr2=0x7fcca40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.383+0000 7fccc7b5d700 1 --2- 172.21.15.81:0/3663340432 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcca4066f30 0x7fcca40693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fccc015d870 tx=0x7fccb80091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.383+0000 7fccc7b5d700 1 -- 172.21.15.81:0/3663340432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc01578d0 msgr2=0x7fccc00b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.383+0000 7fccc7b5d700 1 --2- 172.21.15.81:0/3663340432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc01578d0 0x7fccc00b5170 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fccb0013000 tx=0x7fccb0017000 comp rx=0 tx=0).stop 2023-10-07T08:43:32.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.383+0000 7fccc7b5d700 1 -- 172.21.15.81:0/3663340432 shutdown_connections 2023-10-07T08:43:32.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.383+0000 7fccc7b5d700 1 --2- 172.21.15.81:0/3663340432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc0157ca0 0x7fccc00c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.383+0000 7fccc7b5d700 1 --2- 172.21.15.81:0/3663340432 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcca4066f30 0x7fcca40693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.383+0000 7fccc7b5d700 1 --2- 172.21.15.81:0/3663340432 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccc006d120 0x7fccc00c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.383+0000 7fccc7b5d700 1 --2- 172.21.15.81:0/3663340432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc01578d0 0x7fccc00b5170 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.383+0000 7fccc7b5d700 1 -- 172.21.15.81:0/3663340432 >> 172.21.15.81:0/3663340432 conn(0x7fccc006bb90 msgr2=0x7fccc01548a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:32.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.384+0000 7fccc7b5d700 1 -- 172.21.15.81:0/3663340432 shutdown_connections 2023-10-07T08:43:32.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.384+0000 7fccc7b5d700 1 -- 172.21.15.81:0/3663340432 wait complete. 2023-10-07T08:43:32.387 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2023-10-07T08:43:32.397 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:32.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.509+0000 7ff8e6836700 1 Processor -- start 2023-10-07T08:43:32.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.509+0000 7ff8e6836700 1 -- start start 2023-10-07T08:43:32.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8e6836700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8e00aeea0 0x7ff8e00c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8e6836700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff8e00af270 0x7ff8e00c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8e6836700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e006aae0 con 0x7ff8e00c7d00 2023-10-07T08:43:32.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8e6836700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e00c8810 con 0x7ff8e00aeea0 2023-10-07T08:43:32.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8e6836700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e0069ed0 con 0x7ff8e00af270 2023-10-07T08:43:32.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8dffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8e00aeea0 0x7ff8e00c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8e4dd3700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff8e00c7d00 0x7ff8e00c8100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49654/0 (socket says 172.21.15.81:49654) 2023-10-07T08:43:32.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8e4dd3700 1 -- 172.21.15.81:0/3845393761 learned_addr learned my addr 172.21.15.81:0/3845393761 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:32.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8dffff700 1 -- 172.21.15.81:0/3845393761 >> v2:172.21.15.89:3300/0 conn(0x7ff8e00af270 msgr2=0x7ff8e00c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:32.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8df7fe700 1 --2- 172.21.15.81:0/3845393761 >> v2:172.21.15.89:3300/0 conn(0x7ff8e00af270 0x7ff8e00c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8deffd700 1 -- 172.21.15.81:0/3845393761 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410927267 0 0) 0x7ff8e006aae0 con 0x7ff8e00c7d00 2023-10-07T08:43:32.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8dffff700 1 --2- 172.21.15.81:0/3845393761 >> v2:172.21.15.89:3300/0 conn(0x7ff8e00af270 0x7ff8e00c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8dffff700 1 -- 172.21.15.81:0/3845393761 >> v1:172.21.15.81:6789/0 conn(0x7ff8e00c7d00 legacy=0x7ff8e00c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8dffff700 1 -- 172.21.15.81:0/3845393761 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e006a1b0 con 0x7ff8e00aeea0 2023-10-07T08:43:32.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8df7fe700 1 --2- 172.21.15.81:0/3845393761 >> v2:172.21.15.89:3300/0 conn(0x7ff8e00af270 0x7ff8e00c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:32.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8dffff700 1 --2- 172.21.15.81:0/3845393761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e00aeea0 0x7ff8e00c2920 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00c73a0 tx=0x7ff8d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df18bdee265b67c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:32.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8deffd700 1 -- 172.21.15.81:0/3845393761 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000b740 con 0x7ff8e00aeea0 2023-10-07T08:43:32.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8deffd700 1 -- 172.21.15.81:0/3845393761 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d000b8a0 con 0x7ff8e00aeea0 2023-10-07T08:43:32.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.510+0000 7ff8deffd700 1 -- 172.21.15.81:0/3845393761 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000bc40 con 0x7ff8e00aeea0 2023-10-07T08:43:32.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.511+0000 7ff8e6836700 1 -- 172.21.15.81:0/3845393761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e00aeea0 msgr2=0x7ff8e00c2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.511+0000 7ff8e6836700 1 --2- 172.21.15.81:0/3845393761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e00aeea0 0x7ff8e00c2920 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00c73a0 tx=0x7ff8d00091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.511+0000 7ff8e6836700 1 -- 172.21.15.81:0/3845393761 shutdown_connections 2023-10-07T08:43:32.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.511+0000 7ff8e6836700 1 --2- 172.21.15.81:0/3845393761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e00aeea0 0x7ff8e00c2920 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.511+0000 7ff8e6836700 1 --2- 172.21.15.81:0/3845393761 >> v2:172.21.15.89:3300/0 conn(0x7ff8e00af270 0x7ff8e00c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.511+0000 7ff8e6836700 1 -- 172.21.15.81:0/3845393761 >> 172.21.15.81:0/3845393761 conn(0x7ff8e006c660 msgr2=0x7ff8e00cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:32.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.511+0000 7ff8e6836700 1 -- 172.21.15.81:0/3845393761 shutdown_connections 2023-10-07T08:43:32.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.511+0000 7ff8e6836700 1 -- 172.21.15.81:0/3845393761 wait complete. 2023-10-07T08:43:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.512+0000 7ff8e6836700 1 Processor -- start 2023-10-07T08:43:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.512+0000 7ff8e6836700 1 -- start start 2023-10-07T08:43:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.513+0000 7ff8e6836700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e00aeea0 0x7ff8e0155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.513+0000 7ff8e6836700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8e00af270 0x7ff8e01671e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.513+0000 7ff8e6836700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8e00c7d00 0x7ff8e01530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.513+0000 7ff8e6836700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00afac0 con 0x7ff8e00aeea0 2023-10-07T08:43:32.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.513+0000 7ff8e6836700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0167a10 con 0x7ff8e00c7d00 2023-10-07T08:43:32.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.513+0000 7ff8e6836700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0167cf0 con 0x7ff8e00af270 2023-10-07T08:43:32.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.513+0000 7ff8dffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e00aeea0 0x7ff8e0155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.513+0000 7ff8dffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e00aeea0 0x7ff8e0155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44976/0 (socket says 172.21.15.81:44976) 2023-10-07T08:43:32.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.513+0000 7ff8dffff700 1 -- 172.21.15.81:0/1556398040 learned_addr learned my addr 172.21.15.81:0/1556398040 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:32.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.513+0000 7ff8e4dd3700 1 --2- 172.21.15.81:0/1556398040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8e00c7d00 0x7ff8e01530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.513+0000 7ff8df7fe700 1 --2- 172.21.15.81:0/1556398040 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8e00af270 0x7ff8e01671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.513+0000 7ff8dffff700 1 -- 172.21.15.81:0/1556398040 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8e00af270 msgr2=0x7ff8e01671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.513+0000 7ff8dffff700 1 --2- 172.21.15.81:0/1556398040 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8e00af270 0x7ff8e01671e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.513+0000 7ff8dffff700 1 -- 172.21.15.81:0/1556398040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8e00c7d00 msgr2=0x7ff8e01530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.513+0000 7ff8dffff700 1 --2- 172.21.15.81:0/1556398040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8e00c7d00 0x7ff8e01530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.513+0000 7ff8dffff700 1 -- 172.21.15.81:0/1556398040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d0009420 con 0x7ff8e00aeea0 2023-10-07T08:43:32.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.514+0000 7ff8dffff700 1 --2- 172.21.15.81:0/1556398040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e00aeea0 0x7ff8e0155160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0064700 tx=0x7ff8d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:32.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.514+0000 7ff8c7fff700 1 -- 172.21.15.81:0/1556398040 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000bbe0 con 0x7ff8e00aeea0 2023-10-07T08:43:32.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.514+0000 7ff8c7fff700 1 -- 172.21.15.81:0/1556398040 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d0011630 con 0x7ff8e00aeea0 2023-10-07T08:43:32.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.514+0000 7ff8e6836700 1 -- 172.21.15.81:0/1556398040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e0167fd0 con 0x7ff8e00aeea0 2023-10-07T08:43:32.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.514+0000 7ff8c7fff700 1 -- 172.21.15.81:0/1556398040 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00119f0 con 0x7ff8e00aeea0 2023-10-07T08:43:32.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.514+0000 7ff8e6836700 1 -- 172.21.15.81:0/1556398040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e01535f0 con 0x7ff8e00aeea0 2023-10-07T08:43:32.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.515+0000 7ff8e6836700 1 -- 172.21.15.81:0/1556398040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e00af890 con 0x7ff8e00aeea0 2023-10-07T08:43:32.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.515+0000 7ff8c7fff700 1 -- 172.21.15.81:0/1556398040 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8d00193b0 con 0x7ff8e00aeea0 2023-10-07T08:43:32.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.515+0000 7ff8c7fff700 1 --2- 172.21.15.81:0/1556398040 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff8cc066f30 0x7ff8cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.515+0000 7ff8c7fff700 1 -- 172.21.15.81:0/1556398040 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff8d00853c0 con 0x7ff8e00aeea0 2023-10-07T08:43:32.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.516+0000 7ff8df7fe700 1 --2- 172.21.15.81:0/1556398040 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff8cc066f30 0x7ff8cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.516+0000 7ff8df7fe700 1 --2- 172.21.15.81:0/1556398040 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff8cc066f30 0x7ff8cc0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0164e20 tx=0x7ff8d4006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:32.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.520+0000 7ff8c7fff700 1 -- 172.21.15.81:0/1556398040 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8d0052630 con 0x7ff8e00aeea0 2023-10-07T08:43:32.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.704+0000 7ff8e6836700 1 -- 172.21.15.81:0/1556398040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8e01681c0 con 0x7ff8e00aeea0 2023-10-07T08:43:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.704+0000 7ff8c7fff700 1 -- 172.21.15.81:0/1556398040 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7ff8d0055c50 con 0x7ff8e00aeea0 2023-10-07T08:43:32.706 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:32.706 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:42:58.248338+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:42:54.397263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-07T08:42:55.595133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.706+0000 7ff8e6836700 1 -- 172.21.15.81:0/1556398040 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff8cc066f30 msgr2=0x7ff8cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.706+0000 7ff8e6836700 1 --2- 172.21.15.81:0/1556398040 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff8cc066f30 0x7ff8cc0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0164e20 tx=0x7ff8d4006f90 comp rx=0 tx=0).stop 2023-10-07T08:43:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.706+0000 7ff8e6836700 1 -- 172.21.15.81:0/1556398040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e00aeea0 msgr2=0x7ff8e0155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.706+0000 7ff8e6836700 1 --2- 172.21.15.81:0/1556398040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e00aeea0 0x7ff8e0155160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0064700 tx=0x7ff8d0017000 comp rx=0 tx=0).stop 2023-10-07T08:43:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.706+0000 7ff8e6836700 1 -- 172.21.15.81:0/1556398040 shutdown_connections 2023-10-07T08:43:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.706+0000 7ff8e6836700 1 --2- 172.21.15.81:0/1556398040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8e00c7d00 0x7ff8e01530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.706+0000 7ff8e6836700 1 --2- 172.21.15.81:0/1556398040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e00aeea0 0x7ff8e0155160 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.706+0000 7ff8e6836700 1 --2- 172.21.15.81:0/1556398040 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff8cc066f30 0x7ff8cc0693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.706+0000 7ff8e6836700 1 --2- 172.21.15.81:0/1556398040 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8e00af270 0x7ff8e01671e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.706+0000 7ff8e6836700 1 -- 172.21.15.81:0/1556398040 >> 172.21.15.81:0/1556398040 conn(0x7ff8e006c660 msgr2=0x7ff8e00692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.706+0000 7ff8e6836700 1 -- 172.21.15.81:0/1556398040 shutdown_connections 2023-10-07T08:43:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.706+0000 7ff8e6836700 1 -- 172.21.15.81:0/1556398040 wait complete. 2023-10-07T08:43:32.720 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T08:43:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.833+0000 7f3bdfc21700 1 Processor -- start 2023-10-07T08:43:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.833+0000 7f3bdfc21700 1 -- start start 2023-10-07T08:43:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.834+0000 7f3bdfc21700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bd8157ca0 0x7f3bd80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.834+0000 7f3bdfc21700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3bd806d120 0x7f3bd806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.834+0000 7f3bdfc21700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd806dac0 con 0x7f3bd81578d0 2023-10-07T08:43:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.834+0000 7f3bdfc21700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd80d07c0 con 0x7f3bd806d120 2023-10-07T08:43:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.834+0000 7f3bdfc21700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80cfbb0 con 0x7f3bd8157ca0 2023-10-07T08:43:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.834+0000 7f3bde1be700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3bd806d120 0x7f3bd806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.834+0000 7f3bdd1bc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bd8157ca0 0x7f3bd80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.834+0000 7f3bde1be700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3bd806d120 0x7f3bd806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:57510/0 (socket says 172.21.15.81:57510) 2023-10-07T08:43:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.834+0000 7f3bdd1bc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bd8157ca0 0x7f3bd80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:54334/0 (socket says 172.21.15.81:54334) 2023-10-07T08:43:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.834+0000 7f3bde1be700 1 -- 172.21.15.81:0/3444589120 learned_addr learned my addr 172.21.15.81:0/3444589120 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.834+0000 7f3bdd9bd700 1 --1- 172.21.15.81:0/3444589120 >> v1:172.21.15.89:6789/0 conn(0x7f3bd81578d0 0x7f3bd815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:41788/0 (socket says 172.21.15.81:41788) 2023-10-07T08:43:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.835+0000 7f3bde1be700 1 -- 172.21.15.81:0/3444589120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bd8157ca0 msgr2=0x7f3bd80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.835+0000 7f3bde1be700 1 --2- 172.21.15.81:0/3444589120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bd8157ca0 0x7f3bd80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.835+0000 7f3bde1be700 1 -- 172.21.15.81:0/3444589120 >> v1:172.21.15.89:6789/0 conn(0x7f3bd81578d0 legacy=0x7f3bd815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.835+0000 7f3bdc9bb700 1 -- 172.21.15.81:0/3444589120 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345685410 0 0) 0x7f3bd0001490 con 0x7f3bd81578d0 2023-10-07T08:43:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.835+0000 7f3bde1be700 1 -- 172.21.15.81:0/3444589120 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80cfe90 con 0x7f3bd806d120 2023-10-07T08:43:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.835+0000 7f3bdd1bc700 1 --2- 172.21.15.81:0/3444589120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bd8157ca0 0x7f3bd80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.835+0000 7f3bde1be700 1 --2- 172.21.15.81:0/3444589120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bd806d120 0x7f3bd806d580 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80099b0 tx=0x7f3bc8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe7318d0f2fbf68d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.835+0000 7f3bdc9bb700 1 -- 172.21.15.81:0/3444589120 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8009ea0 con 0x7f3bd806d120 2023-10-07T08:43:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.835+0000 7f3bdc9bb700 1 -- 172.21.15.81:0/3444589120 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc800b860 con 0x7f3bd806d120 2023-10-07T08:43:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.835+0000 7f3bdc9bb700 1 -- 172.21.15.81:0/3444589120 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc800bc00 con 0x7f3bd806d120 2023-10-07T08:43:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.836+0000 7f3bdfc21700 1 -- 172.21.15.81:0/3444589120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bd806d120 msgr2=0x7f3bd806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.836+0000 7f3bdfc21700 1 --2- 172.21.15.81:0/3444589120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bd806d120 0x7f3bd806d580 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80099b0 tx=0x7f3bc8009250 comp rx=0 tx=0).stop 2023-10-07T08:43:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.836+0000 7f3bdfc21700 1 -- 172.21.15.81:0/3444589120 shutdown_connections 2023-10-07T08:43:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.836+0000 7f3bdfc21700 1 --2- 172.21.15.81:0/3444589120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bd806d120 0x7f3bd806d580 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.836+0000 7f3bdfc21700 1 --2- 172.21.15.81:0/3444589120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bd8157ca0 0x7f3bd80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.836+0000 7f3bdfc21700 1 -- 172.21.15.81:0/3444589120 >> 172.21.15.81:0/3444589120 conn(0x7f3bd806bb90 msgr2=0x7f3bd806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.836+0000 7f3bdfc21700 1 -- 172.21.15.81:0/3444589120 shutdown_connections 2023-10-07T08:43:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.836+0000 7f3bdfc21700 1 -- 172.21.15.81:0/3444589120 wait complete. 2023-10-07T08:43:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.837+0000 7f3bdfc21700 1 Processor -- start 2023-10-07T08:43:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.837+0000 7f3bdfc21700 1 -- start start 2023-10-07T08:43:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.837+0000 7f3bdfc21700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd806d120 0x7f3bd8158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.837+0000 7f3bdfc21700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bd81578d0 0x7f3bd81537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bdfc21700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bd8157ca0 0x7f3bd80b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bdfc21700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd815cfe0 con 0x7f3bd806d120 2023-10-07T08:43:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bdfc21700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd816a090 con 0x7f3bd81578d0 2023-10-07T08:43:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bdfc21700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd8158fb0 con 0x7f3bd8157ca0 2023-10-07T08:43:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bdd9bd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd806d120 0x7f3bd8158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bdd9bd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd806d120 0x7f3bd8158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44978/0 (socket says 172.21.15.81:44978) 2023-10-07T08:43:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bdd9bd700 1 -- 172.21.15.81:0/3393646949 learned_addr learned my addr 172.21.15.81:0/3393646949 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bde1be700 1 --2- 172.21.15.81:0/3393646949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bd8157ca0 0x7f3bd80b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bdd1bc700 1 --2- 172.21.15.81:0/3393646949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bd81578d0 0x7f3bd81537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bdd9bd700 1 -- 172.21.15.81:0/3393646949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bd8157ca0 msgr2=0x7f3bd80b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bdd9bd700 1 --2- 172.21.15.81:0/3393646949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bd8157ca0 0x7f3bd80b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bdd9bd700 1 -- 172.21.15.81:0/3393646949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bd81578d0 msgr2=0x7f3bd81537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bdd9bd700 1 --2- 172.21.15.81:0/3393646949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bd81578d0 0x7f3bd81537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bdd9bd700 1 -- 172.21.15.81:0/3393646949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc009420 con 0x7f3bd806d120 2023-10-07T08:43:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bdd9bd700 1 --2- 172.21.15.81:0/3393646949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd806d120 0x7f3bd8158a70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000cdd0 tx=0x7f3bd0001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bd5ffb700 1 -- 172.21.15.81:0/3393646949 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0005df0 con 0x7f3bd806d120 2023-10-07T08:43:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bdfc21700 1 -- 172.21.15.81:0/3393646949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc80094f0 con 0x7f3bd806d120 2023-10-07T08:43:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bd5ffb700 1 -- 172.21.15.81:0/3393646949 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd000a8b0 con 0x7f3bd806d120 2023-10-07T08:43:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bd5ffb700 1 -- 172.21.15.81:0/3393646949 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd000ac70 con 0x7f3bd806d120 2023-10-07T08:43:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.838+0000 7f3bdfc21700 1 -- 172.21.15.81:0/3393646949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd8159510 con 0x7f3bd806d120 2023-10-07T08:43:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.840+0000 7f3bdfc21700 1 -- 172.21.15.81:0/3393646949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd8067ac0 con 0x7f3bd806d120 2023-10-07T08:43:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.840+0000 7f3bd5ffb700 1 -- 172.21.15.81:0/3393646949 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bd0007300 con 0x7f3bd806d120 2023-10-07T08:43:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.840+0000 7f3bd5ffb700 1 --2- 172.21.15.81:0/3393646949 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3bc4066f30 0x7f3bc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.840+0000 7f3bdd1bc700 1 --2- 172.21.15.81:0/3393646949 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3bc4066f30 0x7f3bc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.840+0000 7f3bd5ffb700 1 -- 172.21.15.81:0/3393646949 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3bd00845e0 con 0x7f3bd806d120 2023-10-07T08:43:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.841+0000 7f3bdd1bc700 1 --2- 172.21.15.81:0/3393646949 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3bc4066f30 0x7f3bc40693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc016fd0 tx=0x7f3bcc018040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:32.845+0000 7f3bd5ffb700 1 -- 172.21.15.81:0/3393646949 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bd00517b0 con 0x7f3bd806d120 2023-10-07T08:43:33.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.070+0000 7f3bdfc21700 1 -- 172.21.15.81:0/3393646949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3bd806da90 con 0x7f3bd806d120 2023-10-07T08:43:33.072 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:43:33.071+0000 7f43c472d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T08:43:33.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.074+0000 7f3bd5ffb700 1 -- 172.21.15.81:0/3393646949 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3bd0054dd0 con 0x7f3bd806d120 2023-10-07T08:43:33.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.076+0000 7f3bdfc21700 1 -- 172.21.15.81:0/3393646949 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3bc4066f30 msgr2=0x7f3bc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:33.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.076+0000 7f3bdfc21700 1 --2- 172.21.15.81:0/3393646949 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3bc4066f30 0x7f3bc40693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc016fd0 tx=0x7f3bcc018040 comp rx=0 tx=0).stop 2023-10-07T08:43:33.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.076+0000 7f3bdfc21700 1 -- 172.21.15.81:0/3393646949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd806d120 msgr2=0x7f3bd8158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:33.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.076+0000 7f3bdfc21700 1 --2- 172.21.15.81:0/3393646949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd806d120 0x7f3bd8158a70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000cdd0 tx=0x7f3bd0001b90 comp rx=0 tx=0).stop 2023-10-07T08:43:33.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.076+0000 7f3bdfc21700 1 -- 172.21.15.81:0/3393646949 shutdown_connections 2023-10-07T08:43:33.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.076+0000 7f3bdfc21700 1 --2- 172.21.15.81:0/3393646949 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3bc4066f30 0x7f3bc40693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:33.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.076+0000 7f3bdfc21700 1 --2- 172.21.15.81:0/3393646949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bd8157ca0 0x7f3bd80b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:33.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.076+0000 7f3bdfc21700 1 --2- 172.21.15.81:0/3393646949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd806d120 0x7f3bd8158a70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:33.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.076+0000 7f3bdfc21700 1 --2- 172.21.15.81:0/3393646949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bd81578d0 0x7f3bd81537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:33.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.076+0000 7f3bdfc21700 1 -- 172.21.15.81:0/3393646949 >> 172.21.15.81:0/3393646949 conn(0x7f3bd806bb90 msgr2=0x7f3bd806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:33.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.076+0000 7f3bdfc21700 1 -- 172.21.15.81:0/3393646949 shutdown_connections 2023-10-07T08:43:33.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.076+0000 7f3bdfc21700 1 -- 172.21.15.81:0/3393646949 wait complete. 2023-10-07T08:43:33.079 INFO:tasks.ceph.mds.d.smithi089.stderr: -1651> 2023-10-07T08:43:00.800+0000 7f983033c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:43:33.079 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T08:43:33.090 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T08:43:33.101 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-10-07T08:43:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.203+0000 7efde4a34700 1 Processor -- start 2023-10-07T08:43:33.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.203+0000 7efde4a34700 1 -- start start 2023-10-07T08:43:33.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.204+0000 7efde4a34700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efde006d830 0x7efde00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:33.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.204+0000 7efde4a34700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde00d07c0 con 0x7efde0157ca0 2023-10-07T08:43:33.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.204+0000 7efde4a34700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde00cfbb0 con 0x7efde01578d0 2023-10-07T08:43:33.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.204+0000 7efde4a34700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde00cfe90 con 0x7efde006d830 2023-10-07T08:43:33.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.205+0000 7efdddd9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efde0157ca0 0x7efde006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49670/0 (socket says 172.21.15.81:49670) 2023-10-07T08:43:33.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.205+0000 7efdddd9b700 1 -- 172.21.15.81:0/3508642793 learned_addr learned my addr 172.21.15.81:0/3508642793 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:33.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.205+0000 7efdded9d700 1 --2- 172.21.15.81:0/3508642793 >> v2:172.21.15.89:3300/0 conn(0x7efde006d830 0x7efde00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:33.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.205+0000 7efddd59a700 1 -- 172.21.15.81:0/3508642793 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228245396 0 0) 0x7efde00d07c0 con 0x7efde0157ca0 2023-10-07T08:43:33.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.205+0000 7efddd59a700 1 -- 172.21.15.81:0/3508642793 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdcc003570 con 0x7efde0157ca0 2023-10-07T08:43:33.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.205+0000 7efddd59a700 1 -- 172.21.15.81:0/3508642793 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752001519 0 0) 0x7efde00cfbb0 con 0x7efde01578d0 2023-10-07T08:43:33.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.205+0000 7efddd59a700 1 -- 172.21.15.81:0/3508642793 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde00d07c0 con 0x7efde01578d0 2023-10-07T08:43:33.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.205+0000 7efdded9d700 1 -- 172.21.15.81:0/3508642793 >> v1:172.21.15.89:6789/0 conn(0x7efde01578d0 legacy=0x7efde015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:33.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.205+0000 7efdded9d700 1 -- 172.21.15.81:0/3508642793 >> v1:172.21.15.81:6789/0 conn(0x7efde0157ca0 legacy=0x7efde006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:33.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.205+0000 7efdded9d700 1 -- 172.21.15.81:0/3508642793 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde00d0170 con 0x7efde006d830 2023-10-07T08:43:33.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.205+0000 7efdded9d700 1 --2- 172.21.15.81:0/3508642793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde006d830 0x7efde00cf4f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efdd80098e0 tx=0x7efdd80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d17724da845b683 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:33.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.205+0000 7efddd59a700 1 -- 172.21.15.81:0/3508642793 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd8011630 con 0x7efde006d830 2023-10-07T08:43:33.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.205+0000 7efddd59a700 1 -- 172.21.15.81:0/3508642793 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd8011790 con 0x7efde006d830 2023-10-07T08:43:33.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.205+0000 7efddd59a700 1 -- 172.21.15.81:0/3508642793 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd8011b30 con 0x7efde006d830 2023-10-07T08:43:33.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.206+0000 7efde4a34700 1 -- 172.21.15.81:0/3508642793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde006d830 msgr2=0x7efde00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:33.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.206+0000 7efde4a34700 1 --2- 172.21.15.81:0/3508642793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde006d830 0x7efde00cf4f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efdd80098e0 tx=0x7efdd80091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:33.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.206+0000 7efde4a34700 1 -- 172.21.15.81:0/3508642793 shutdown_connections 2023-10-07T08:43:33.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.206+0000 7efde4a34700 1 --2- 172.21.15.81:0/3508642793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde006d830 0x7efde00cf4f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:33.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.206+0000 7efde4a34700 1 -- 172.21.15.81:0/3508642793 >> 172.21.15.81:0/3508642793 conn(0x7efde006bb90 msgr2=0x7efde006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:33.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.206+0000 7efde4a34700 1 -- 172.21.15.81:0/3508642793 shutdown_connections 2023-10-07T08:43:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.206+0000 7efde4a34700 1 -- 172.21.15.81:0/3508642793 wait complete. 2023-10-07T08:43:33.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.207+0000 7efde4a34700 1 Processor -- start 2023-10-07T08:43:33.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.207+0000 7efde4a34700 1 -- start start 2023-10-07T08:43:33.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efde4a34700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde006d830 0x7efde01489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:33.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efde4a34700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde01578d0 0x7efde00b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:33.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efde4a34700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efde0157ca0 0x7efde00c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:33.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efde4a34700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde01553e0 con 0x7efde006d830 2023-10-07T08:43:33.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efde4a34700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde00b3ba0 con 0x7efde01578d0 2023-10-07T08:43:33.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efde4a34700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde0148f00 con 0x7efde0157ca0 2023-10-07T08:43:33.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efdde59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde006d830 0x7efde01489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:33.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efdde59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde006d830 0x7efde01489c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44992/0 (socket says 172.21.15.81:44992) 2023-10-07T08:43:33.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efdde59c700 1 -- 172.21.15.81:0/3828553227 learned_addr learned my addr 172.21.15.81:0/3828553227 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:33.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efdded9d700 1 --2- 172.21.15.81:0/3828553227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efde0157ca0 0x7efde00c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:33.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efdddd9b700 1 --2- 172.21.15.81:0/3828553227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde01578d0 0x7efde00b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:33.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efdde59c700 1 -- 172.21.15.81:0/3828553227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efde0157ca0 msgr2=0x7efde00c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:33.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efdde59c700 1 --2- 172.21.15.81:0/3828553227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efde0157ca0 0x7efde00c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:33.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efdde59c700 1 -- 172.21.15.81:0/3828553227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde01578d0 msgr2=0x7efde00b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:33.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efdde59c700 1 --2- 172.21.15.81:0/3828553227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde01578d0 0x7efde00b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:33.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efdde59c700 1 -- 172.21.15.81:0/3828553227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd8009420 con 0x7efde006d830 2023-10-07T08:43:33.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efdddd9b700 1 --2- 172.21.15.81:0/3828553227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde01578d0 0x7efde00b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:33.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efdde59c700 1 --2- 172.21.15.81:0/3828553227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde006d830 0x7efde01489c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efdd000cb10 tx=0x7efdd0002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:33.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.208+0000 7efdd67fc700 1 -- 172.21.15.81:0/3828553227 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000a7e0 con 0x7efde006d830 2023-10-07T08:43:33.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.209+0000 7efdd67fc700 1 -- 172.21.15.81:0/3828553227 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd000a940 con 0x7efde006d830 2023-10-07T08:43:33.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.209+0000 7efdd67fc700 1 -- 172.21.15.81:0/3828553227 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000ad00 con 0x7efde006d830 2023-10-07T08:43:33.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.209+0000 7efde4a34700 1 -- 172.21.15.81:0/3828553227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde00b3df0 con 0x7efde006d830 2023-10-07T08:43:33.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.209+0000 7efde4a34700 1 -- 172.21.15.81:0/3828553227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde00b43b0 con 0x7efde006d830 2023-10-07T08:43:33.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.209+0000 7efde4a34700 1 -- 172.21.15.81:0/3828553227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde0067ac0 con 0x7efde006d830 2023-10-07T08:43:33.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.210+0000 7efdd67fc700 1 -- 172.21.15.81:0/3828553227 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efdd0012630 con 0x7efde006d830 2023-10-07T08:43:33.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.210+0000 7efdd67fc700 1 --2- 172.21.15.81:0/3828553227 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdc0066f30 0x7efdc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:33.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.210+0000 7efdd67fc700 1 -- 172.21.15.81:0/3828553227 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7efdd00847b0 con 0x7efde006d830 2023-10-07T08:43:33.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.210+0000 7efdddd9b700 1 --2- 172.21.15.81:0/3828553227 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdc0066f30 0x7efdc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:33.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.211+0000 7efdddd9b700 1 --2- 172.21.15.81:0/3828553227 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdc0066f30 0x7efdc00693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efdc80058d0 tx=0x7efdc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:33.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.214+0000 7efdd67fc700 1 -- 172.21.15.81:0/3828553227 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdd00519d0 con 0x7efde006d830 2023-10-07T08:43:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:33.440+0000 7efde4a34700 1 -- 172.21.15.81:0/3828553227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efde00d0450 con 0x7efde006d830 2023-10-07T08:43:34.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.075+0000 7efdd67fc700 1 -- 172.21.15.81:0/3828553227 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7efdd000ae60 con 0x7efde006d830 2023-10-07T08:43:34.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.078+0000 7efde4a34700 1 -- 172.21.15.81:0/3828553227 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdc0066f30 msgr2=0x7efdc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:34.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.078+0000 7efde4a34700 1 --2- 172.21.15.81:0/3828553227 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdc0066f30 0x7efdc00693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efdc80058d0 tx=0x7efdc8009040 comp rx=0 tx=0).stop 2023-10-07T08:43:34.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.078+0000 7efde4a34700 1 -- 172.21.15.81:0/3828553227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde006d830 msgr2=0x7efde01489c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.078+0000 7efde4a34700 1 --2- 172.21.15.81:0/3828553227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde006d830 0x7efde01489c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efdd000cb10 tx=0x7efdd0002820 comp rx=0 tx=0).stop 2023-10-07T08:43:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.078+0000 7efde4a34700 1 -- 172.21.15.81:0/3828553227 shutdown_connections 2023-10-07T08:43:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.078+0000 7efde4a34700 1 --2- 172.21.15.81:0/3828553227 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdc0066f30 0x7efdc00693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.078+0000 7efde4a34700 1 --2- 172.21.15.81:0/3828553227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efde0157ca0 0x7efde00c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.078+0000 7efde4a34700 1 --2- 172.21.15.81:0/3828553227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde006d830 0x7efde01489c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.078+0000 7efde4a34700 1 --2- 172.21.15.81:0/3828553227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efde01578d0 0x7efde00b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.078+0000 7efde4a34700 1 -- 172.21.15.81:0/3828553227 >> 172.21.15.81:0/3828553227 conn(0x7efde006bb90 msgr2=0x7efde006d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.078+0000 7efde4a34700 1 -- 172.21.15.81:0/3828553227 shutdown_connections 2023-10-07T08:43:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.078+0000 7efde4a34700 1 -- 172.21.15.81:0/3828553227 wait complete. 2023-10-07T08:43:34.091 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T08:43:34.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.207+0000 7fc730a2b700 1 Processor -- start 2023-10-07T08:43:34.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.207+0000 7fc730a2b700 1 -- start start 2023-10-07T08:43:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.208+0000 7fc730a2b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc72c1578d0 0x7fc72c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.208+0000 7fc730a2b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc72c157ca0 0x7fc72c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.208+0000 7fc730a2b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72c0d07c0 con 0x7fc72c06d120 2023-10-07T08:43:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.208+0000 7fc730a2b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72c0cfbb0 con 0x7fc72c157ca0 2023-10-07T08:43:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.208+0000 7fc730a2b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72c0cfe90 con 0x7fc72c1578d0 2023-10-07T08:43:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.208+0000 7fc729d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc72c157ca0 0x7fc72c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.208+0000 7fc72ad9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc72c06d120 0x7fc72c06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49674/0 (socket says 172.21.15.81:49674) 2023-10-07T08:43:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.208+0000 7fc72ad9d700 1 -- 172.21.15.81:0/2036557925 learned_addr learned my addr 172.21.15.81:0/2036557925 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc72a59c700 1 --2- 172.21.15.81:0/2036557925 >> v2:172.21.15.89:3300/0 conn(0x7fc72c1578d0 0x7fc72c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc729d9b700 1 -- 172.21.15.81:0/2036557925 >> v2:172.21.15.89:3300/0 conn(0x7fc72c1578d0 msgr2=0x7fc72c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc729d9b700 1 --2- 172.21.15.81:0/2036557925 >> v2:172.21.15.89:3300/0 conn(0x7fc72c1578d0 0x7fc72c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc729d9b700 1 -- 172.21.15.81:0/2036557925 >> v1:172.21.15.81:6789/0 conn(0x7fc72c06d120 legacy=0x7fc72c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc729d9b700 1 -- 172.21.15.81:0/2036557925 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c0d0170 con 0x7fc72c157ca0 2023-10-07T08:43:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc72959a700 1 -- 172.21.15.81:0/2036557925 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075574810 0 0) 0x7fc72c0d07c0 con 0x7fc72c06d120 2023-10-07T08:43:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc72a59c700 1 --2- 172.21.15.81:0/2036557925 >> v2:172.21.15.89:3300/0 conn(0x7fc72c1578d0 0x7fc72c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc729d9b700 1 --2- 172.21.15.81:0/2036557925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc72c157ca0 0x7fc72c15af00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc72c0646b0 tx=0x7fc7200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2274bdf032f15e04 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc72959a700 1 -- 172.21.15.81:0/2036557925 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000b6b0 con 0x7fc72c157ca0 2023-10-07T08:43:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc72959a700 1 -- 172.21.15.81:0/2036557925 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72000b810 con 0x7fc72c157ca0 2023-10-07T08:43:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc72959a700 1 -- 172.21.15.81:0/2036557925 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000bbb0 con 0x7fc72c157ca0 2023-10-07T08:43:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc730a2b700 1 -- 172.21.15.81:0/2036557925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc72c157ca0 msgr2=0x7fc72c15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc730a2b700 1 --2- 172.21.15.81:0/2036557925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc72c157ca0 0x7fc72c15af00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc72c0646b0 tx=0x7fc7200091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc730a2b700 1 -- 172.21.15.81:0/2036557925 shutdown_connections 2023-10-07T08:43:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc730a2b700 1 --2- 172.21.15.81:0/2036557925 >> v2:172.21.15.89:3300/0 conn(0x7fc72c1578d0 0x7fc72c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc730a2b700 1 --2- 172.21.15.81:0/2036557925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc72c157ca0 0x7fc72c15af00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc730a2b700 1 -- 172.21.15.81:0/2036557925 >> 172.21.15.81:0/2036557925 conn(0x7fc72c06bb90 msgr2=0x7fc72c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.209+0000 7fc730a2b700 1 -- 172.21.15.81:0/2036557925 shutdown_connections 2023-10-07T08:43:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.210+0000 7fc730a2b700 1 -- 172.21.15.81:0/2036557925 wait complete. 2023-10-07T08:43:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.211+0000 7fc730a2b700 1 Processor -- start 2023-10-07T08:43:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.211+0000 7fc730a2b700 1 -- start start 2023-10-07T08:43:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.211+0000 7fc730a2b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc72c06d120 0x7fc72c1477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.211+0000 7fc730a2b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc72c1578d0 0x7fc72c0b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.211+0000 7fc730a2b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc72c157ca0 0x7fc72c0b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.211+0000 7fc730a2b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c147d30 con 0x7fc72c1578d0 2023-10-07T08:43:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.211+0000 7fc730a2b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0c6800 con 0x7fc72c06d120 2023-10-07T08:43:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.211+0000 7fc730a2b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0c6ae0 con 0x7fc72c157ca0 2023-10-07T08:43:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.211+0000 7fc729d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc72c1578d0 0x7fc72c0b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.211+0000 7fc729d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc72c1578d0 0x7fc72c0b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45004/0 (socket says 172.21.15.81:45004) 2023-10-07T08:43:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.211+0000 7fc729d9b700 1 -- 172.21.15.81:0/1764495733 learned_addr learned my addr 172.21.15.81:0/1764495733 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.212+0000 7fc72a59c700 1 --2- 172.21.15.81:0/1764495733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc72c06d120 0x7fc72c1477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.212+0000 7fc72ad9d700 1 --2- 172.21.15.81:0/1764495733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc72c157ca0 0x7fc72c0b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.212+0000 7fc729d9b700 1 -- 172.21.15.81:0/1764495733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc72c157ca0 msgr2=0x7fc72c0b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.212+0000 7fc729d9b700 1 --2- 172.21.15.81:0/1764495733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc72c157ca0 0x7fc72c0b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.212+0000 7fc729d9b700 1 -- 172.21.15.81:0/1764495733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc72c06d120 msgr2=0x7fc72c1477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.212+0000 7fc729d9b700 1 --2- 172.21.15.81:0/1764495733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc72c06d120 0x7fc72c1477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.212+0000 7fc729d9b700 1 -- 172.21.15.81:0/1764495733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc720009420 con 0x7fc72c1578d0 2023-10-07T08:43:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.212+0000 7fc72a59c700 1 --2- 172.21.15.81:0/1764495733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc72c06d120 0x7fc72c1477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.212+0000 7fc729d9b700 1 --2- 172.21.15.81:0/1764495733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc72c1578d0 0x7fc72c0b6040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc720013000 tx=0x7fc720017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.212+0000 7fc71a7fc700 1 -- 172.21.15.81:0/1764495733 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc720011420 con 0x7fc72c1578d0 2023-10-07T08:43:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.212+0000 7fc71a7fc700 1 -- 172.21.15.81:0/1764495733 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc720011580 con 0x7fc72c1578d0 2023-10-07T08:43:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.212+0000 7fc71a7fc700 1 -- 172.21.15.81:0/1764495733 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc720011920 con 0x7fc72c1578d0 2023-10-07T08:43:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.212+0000 7fc730a2b700 1 -- 172.21.15.81:0/1764495733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72c0c6dc0 con 0x7fc72c1578d0 2023-10-07T08:43:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.212+0000 7fc730a2b700 1 -- 172.21.15.81:0/1764495733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72c0c7380 con 0x7fc72c1578d0 2023-10-07T08:43:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.213+0000 7fc730a2b700 1 -- 172.21.15.81:0/1764495733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72c0ceb10 con 0x7fc72c1578d0 2023-10-07T08:43:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.213+0000 7fc71a7fc700 1 -- 172.21.15.81:0/1764495733 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc720011d10 con 0x7fc72c1578d0 2023-10-07T08:43:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.214+0000 7fc71a7fc700 1 --2- 172.21.15.81:0/1764495733 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc70c066f60 0x7fc70c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.214+0000 7fc71a7fc700 1 -- 172.21.15.81:0/1764495733 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fc720086020 con 0x7fc72c1578d0 2023-10-07T08:43:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.214+0000 7fc72a59c700 1 --2- 172.21.15.81:0/1764495733 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc70c066f60 0x7fc70c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.214+0000 7fc72a59c700 1 --2- 172.21.15.81:0/1764495733 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc70c066f60 0x7fc70c069410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc72c06a980 tx=0x7fc71c0077a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.218+0000 7fc71a7fc700 1 -- 172.21.15.81:0/1764495733 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc720053300 con 0x7fc72c1578d0 2023-10-07T08:43:34.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:34.401+0000 7fc730a2b700 1 -- 172.21.15.81:0/1764495733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc72c0c7570 con 0x7fc72c1578d0 2023-10-07T08:43:35.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.077+0000 7fc71a7fc700 1 -- 172.21.15.81:0/1764495733 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc7200568e0 con 0x7fc72c1578d0 2023-10-07T08:43:35.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.080+0000 7fc730a2b700 1 -- 172.21.15.81:0/1764495733 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc70c066f60 msgr2=0x7fc70c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:35.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.080+0000 7fc730a2b700 1 --2- 172.21.15.81:0/1764495733 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc70c066f60 0x7fc70c069410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc72c06a980 tx=0x7fc71c0077a0 comp rx=0 tx=0).stop 2023-10-07T08:43:35.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.080+0000 7fc730a2b700 1 -- 172.21.15.81:0/1764495733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc72c1578d0 msgr2=0x7fc72c0b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:35.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.080+0000 7fc730a2b700 1 --2- 172.21.15.81:0/1764495733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc72c1578d0 0x7fc72c0b6040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc720013000 tx=0x7fc720017000 comp rx=0 tx=0).stop 2023-10-07T08:43:35.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.080+0000 7fc730a2b700 1 -- 172.21.15.81:0/1764495733 shutdown_connections 2023-10-07T08:43:35.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.080+0000 7fc730a2b700 1 --2- 172.21.15.81:0/1764495733 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc70c066f60 0x7fc70c069410 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:35.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.080+0000 7fc730a2b700 1 --2- 172.21.15.81:0/1764495733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc72c157ca0 0x7fc72c0b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:35.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.080+0000 7fc730a2b700 1 --2- 172.21.15.81:0/1764495733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc72c06d120 0x7fc72c1477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:35.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.080+0000 7fc730a2b700 1 --2- 172.21.15.81:0/1764495733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc72c1578d0 0x7fc72c0b6040 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:35.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.080+0000 7fc730a2b700 1 -- 172.21.15.81:0/1764495733 >> 172.21.15.81:0/1764495733 conn(0x7fc72c06bb90 msgr2=0x7fc72c1565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:35.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.080+0000 7fc730a2b700 1 -- 172.21.15.81:0/1764495733 shutdown_connections 2023-10-07T08:43:35.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.080+0000 7fc730a2b700 1 -- 172.21.15.81:0/1764495733 wait complete. 2023-10-07T08:43:35.083 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-07T08:43:35.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T08:43:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.214+0000 7f38545ae700 1 Processor -- start 2023-10-07T08:43:35.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.214+0000 7f38545ae700 1 -- start start 2023-10-07T08:43:35.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.215+0000 7f38545ae700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f384c157ca0 0x7f384c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:35.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.215+0000 7f38545ae700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f384c06d120 0x7f384c06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:35.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.215+0000 7f38545ae700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384c0d07c0 con 0x7f384c1578d0 2023-10-07T08:43:35.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.215+0000 7f38545ae700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384c06da50 con 0x7f384c06d120 2023-10-07T08:43:35.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.215+0000 7f38545ae700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384c0cfbb0 con 0x7f384c157ca0 2023-10-07T08:43:35.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.215+0000 7f3852b4b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f384c06d120 0x7f384c06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:35.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.215+0000 7f385234a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f384c1578d0 0x7f384c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49684/0 (socket says 172.21.15.81:49684) 2023-10-07T08:43:35.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.215+0000 7f385234a700 1 -- 172.21.15.81:0/120720392 learned_addr learned my addr 172.21.15.81:0/120720392 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:35.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.215+0000 7f3851b49700 1 --2- 172.21.15.81:0/120720392 >> v2:172.21.15.89:3300/0 conn(0x7f384c157ca0 0x7f384c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:35.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f3852b4b700 1 -- 172.21.15.81:0/120720392 >> v2:172.21.15.89:3300/0 conn(0x7f384c157ca0 msgr2=0x7f384c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:35.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f3852b4b700 1 --2- 172.21.15.81:0/120720392 >> v2:172.21.15.89:3300/0 conn(0x7f384c157ca0 0x7f384c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:35.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f3852b4b700 1 -- 172.21.15.81:0/120720392 >> v1:172.21.15.81:6789/0 conn(0x7f384c1578d0 legacy=0x7f384c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:35.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f3851348700 1 -- 172.21.15.81:0/120720392 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275438894 0 0) 0x7f384c0d07c0 con 0x7f384c1578d0 2023-10-07T08:43:35.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f3852b4b700 1 -- 172.21.15.81:0/120720392 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c0cfe90 con 0x7f384c06d120 2023-10-07T08:43:35.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f3851b49700 1 --2- 172.21.15.81:0/120720392 >> v2:172.21.15.89:3300/0 conn(0x7f384c157ca0 0x7f384c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:35.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f3852b4b700 1 --2- 172.21.15.81:0/120720392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c06d120 0x7f384c06d510 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f384c068510 tx=0x7f38440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3561092e19ddf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f3851348700 1 -- 172.21.15.81:0/120720392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400b6b0 con 0x7f384c06d120 2023-10-07T08:43:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f3851348700 1 -- 172.21.15.81:0/120720392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384400b810 con 0x7f384c06d120 2023-10-07T08:43:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f3851348700 1 -- 172.21.15.81:0/120720392 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400bbb0 con 0x7f384c06d120 2023-10-07T08:43:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f38545ae700 1 -- 172.21.15.81:0/120720392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c06d120 msgr2=0x7f384c06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f38545ae700 1 --2- 172.21.15.81:0/120720392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c06d120 0x7f384c06d510 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f384c068510 tx=0x7f38440091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f38545ae700 1 -- 172.21.15.81:0/120720392 shutdown_connections 2023-10-07T08:43:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f38545ae700 1 --2- 172.21.15.81:0/120720392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c06d120 0x7f384c06d510 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f38545ae700 1 --2- 172.21.15.81:0/120720392 >> v2:172.21.15.89:3300/0 conn(0x7f384c157ca0 0x7f384c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f38545ae700 1 -- 172.21.15.81:0/120720392 >> 172.21.15.81:0/120720392 conn(0x7f384c06bb90 msgr2=0x7f384c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:35.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f38545ae700 1 -- 172.21.15.81:0/120720392 shutdown_connections 2023-10-07T08:43:35.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.216+0000 7f38545ae700 1 -- 172.21.15.81:0/120720392 wait complete. 2023-10-07T08:43:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.217+0000 7f38545ae700 1 Processor -- start 2023-10-07T08:43:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.218+0000 7f38545ae700 1 -- start start 2023-10-07T08:43:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.218+0000 7f38545ae700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f384c06d120 0x7f384c0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.218+0000 7f38545ae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c1578d0 0x7f384c154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.218+0000 7f38545ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c157ca0 0x7f384c159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.218+0000 7f38545ae700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0c6af0 con 0x7f384c157ca0 2023-10-07T08:43:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.218+0000 7f38545ae700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0b6a80 con 0x7f384c06d120 2023-10-07T08:43:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.218+0000 7f38545ae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0b6130 con 0x7f384c1578d0 2023-10-07T08:43:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.218+0000 7f3852b4b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c157ca0 0x7f384c159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.218+0000 7f3852b4b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c157ca0 0x7f384c159370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45022/0 (socket says 172.21.15.81:45022) 2023-10-07T08:43:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.218+0000 7f3852b4b700 1 -- 172.21.15.81:0/1964183252 learned_addr learned my addr 172.21.15.81:0/1964183252 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.219+0000 7f3851b49700 1 --2- 172.21.15.81:0/1964183252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c1578d0 0x7f384c154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.219+0000 7f385234a700 1 --2- 172.21.15.81:0/1964183252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f384c06d120 0x7f384c0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.219+0000 7f3852b4b700 1 -- 172.21.15.81:0/1964183252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c1578d0 msgr2=0x7f384c154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:35.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.219+0000 7f3852b4b700 1 --2- 172.21.15.81:0/1964183252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c1578d0 0x7f384c154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:35.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.219+0000 7f3852b4b700 1 -- 172.21.15.81:0/1964183252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f384c06d120 msgr2=0x7f384c0b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:35.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.219+0000 7f3852b4b700 1 --2- 172.21.15.81:0/1964183252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f384c06d120 0x7f384c0b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:35.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.219+0000 7f3852b4b700 1 -- 172.21.15.81:0/1964183252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3844009420 con 0x7f384c157ca0 2023-10-07T08:43:35.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.219+0000 7f3852b4b700 1 --2- 172.21.15.81:0/1964183252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c157ca0 0x7f384c159370 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f384c06fe20 tx=0x7f3844017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:35.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.219+0000 7f38427fc700 1 -- 172.21.15.81:0/1964183252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844025420 con 0x7f384c157ca0 2023-10-07T08:43:35.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.219+0000 7f38427fc700 1 -- 172.21.15.81:0/1964183252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3844025580 con 0x7f384c157ca0 2023-10-07T08:43:35.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.219+0000 7f38427fc700 1 -- 172.21.15.81:0/1964183252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844025920 con 0x7f384c157ca0 2023-10-07T08:43:35.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.219+0000 7f38545ae700 1 -- 172.21.15.81:0/1964183252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384c0c5ee0 con 0x7f384c157ca0 2023-10-07T08:43:35.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.219+0000 7f38545ae700 1 -- 172.21.15.81:0/1964183252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384c0c64a0 con 0x7f384c157ca0 2023-10-07T08:43:35.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.220+0000 7f38545ae700 1 -- 172.21.15.81:0/1964183252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384c0c6c60 con 0x7f384c157ca0 2023-10-07T08:43:35.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.220+0000 7f38427fc700 1 -- 172.21.15.81:0/1964183252 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3844023070 con 0x7f384c157ca0 2023-10-07T08:43:35.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.221+0000 7f38427fc700 1 --2- 172.21.15.81:0/1964183252 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3830066f30 0x7f38300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:35.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.221+0000 7f385234a700 1 --2- 172.21.15.81:0/1964183252 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3830066f30 0x7f38300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:35.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.221+0000 7f38427fc700 1 -- 172.21.15.81:0/1964183252 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f3844085b20 con 0x7f384c157ca0 2023-10-07T08:43:35.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.221+0000 7f385234a700 1 --2- 172.21.15.81:0/1964183252 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3830066f30 0x7f38300693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f384c0b2e70 tx=0x7f3848009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:35.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.225+0000 7f38427fc700 1 -- 172.21.15.81:0/1964183252 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3844052ef0 con 0x7f384c157ca0 2023-10-07T08:43:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:35.407+0000 7f38545ae700 1 -- 172.21.15.81:0/1964183252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f384c0d0170 con 0x7f384c157ca0 2023-10-07T08:43:36.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.080+0000 7f38427fc700 1 -- 172.21.15.81:0/1964183252 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f38440150d0 con 0x7f384c157ca0 2023-10-07T08:43:36.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.082+0000 7f38545ae700 1 -- 172.21.15.81:0/1964183252 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3830066f30 msgr2=0x7f38300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:36.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.082+0000 7f38545ae700 1 --2- 172.21.15.81:0/1964183252 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3830066f30 0x7f38300693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f384c0b2e70 tx=0x7f3848009040 comp rx=0 tx=0).stop 2023-10-07T08:43:36.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.082+0000 7f38545ae700 1 -- 172.21.15.81:0/1964183252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c157ca0 msgr2=0x7f384c159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:36.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.082+0000 7f38545ae700 1 --2- 172.21.15.81:0/1964183252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c157ca0 0x7f384c159370 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f384c06fe20 tx=0x7f3844017000 comp rx=0 tx=0).stop 2023-10-07T08:43:36.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.082+0000 7f38545ae700 1 -- 172.21.15.81:0/1964183252 shutdown_connections 2023-10-07T08:43:36.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.082+0000 7f38545ae700 1 --2- 172.21.15.81:0/1964183252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c157ca0 0x7f384c159370 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.082+0000 7f38545ae700 1 --2- 172.21.15.81:0/1964183252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f384c06d120 0x7f384c0b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.082+0000 7f38545ae700 1 --2- 172.21.15.81:0/1964183252 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3830066f30 0x7f38300693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.082+0000 7f38545ae700 1 --2- 172.21.15.81:0/1964183252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c1578d0 0x7f384c154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.083+0000 7f38545ae700 1 -- 172.21.15.81:0/1964183252 >> 172.21.15.81:0/1964183252 conn(0x7f384c06bb90 msgr2=0x7f384c068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.083+0000 7f38545ae700 1 -- 172.21.15.81:0/1964183252 shutdown_connections 2023-10-07T08:43:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.083+0000 7f38545ae700 1 -- 172.21.15.81:0/1964183252 wait complete. 2023-10-07T08:43:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-07T08:43:36.096 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T08:43:36.096 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T08:43:36.096 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T08:43:36.097 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:43:36.097 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T08:43:36.097 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T08:43:36.097 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T08:43:36.097 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:43:36.098 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T08:43:36.098 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T08:43:36.098 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T08:43:36.098 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:43:36.098 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T08:43:36.098 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T08:43:36.099 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T08:43:36.099 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:43:36.107 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T08:43:36.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T08:43:36.108 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T08:43:36.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T08:43:36.109 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T08:43:36.110 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T08:43:36.111 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T08:43:36.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T08:43:36.149 INFO:tasks.ceph.mds.a:Started 2023-10-07T08:43:36.149 DEBUG:teuthology.parallel:result is None 2023-10-07T08:43:36.150 INFO:tasks.ceph.mds.c:Started 2023-10-07T08:43:36.150 DEBUG:teuthology.parallel:result is None 2023-10-07T08:43:36.152 INFO:tasks.ceph.mds.b:Started 2023-10-07T08:43:36.152 DEBUG:teuthology.parallel:result is None 2023-10-07T08:43:36.153 INFO:tasks.ceph.mds.d:Started 2023-10-07T08:43:36.153 DEBUG:teuthology.parallel:result is None 2023-10-07T08:43:36.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T08:43:36.222 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-07T08:43:36.222 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-07T08:43:36.232 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-10-07T08:43:36.232 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-10-07T08:43:36.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.273+0000 7f4ae6a37700 1 Processor -- start 2023-10-07T08:43:36.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.273+0000 7f4ae6a37700 1 -- start start 2023-10-07T08:43:36.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.274+0000 7f4ae6a37700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ae015a2a0 0x7f4ae00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:36.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.274+0000 7f4ae6a37700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae00b0ca0 con 0x7f4ae006dd60 2023-10-07T08:43:36.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.274+0000 7f4ae6a37700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae00b00d0 con 0x7f4ae00ceb30 2023-10-07T08:43:36.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.274+0000 7f4ae6a37700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae006e160 con 0x7f4ae015a2a0 2023-10-07T08:43:36.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.274+0000 7f4adffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ae015a2a0 0x7f4ae00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:36.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.274+0000 7f4ae4fd4700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4ae006dd60 0x7f4ae00b1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49710/0 (socket says 172.21.15.81:49710) 2023-10-07T08:43:36.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.274+0000 7f4ae4fd4700 1 -- 172.21.15.81:0/4033547996 learned_addr learned my addr 172.21.15.81:0/4033547996 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:36.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.274+0000 7f4adffff700 1 -- 172.21.15.81:0/4033547996 >> v1:172.21.15.89:6789/0 conn(0x7f4ae00ceb30 legacy=0x7f4ae006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:36.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.274+0000 7f4adffff700 1 -- 172.21.15.81:0/4033547996 >> v1:172.21.15.81:6789/0 conn(0x7f4ae006dd60 legacy=0x7f4ae00b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:36.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.274+0000 7f4adeffd700 1 -- 172.21.15.81:0/4033547996 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126572682 0 0) 0x7f4ae00b0ca0 con 0x7f4ae006dd60 2023-10-07T08:43:36.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.274+0000 7f4adffff700 1 -- 172.21.15.81:0/4033547996 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae00b0370 con 0x7f4ae015a2a0 2023-10-07T08:43:36.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.274+0000 7f4adffff700 1 --2- 172.21.15.81:0/4033547996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae015a2a0 0x7f4ae00b1130 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00098e0 tx=0x7f4ad00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4e3c5eed826e1f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:36.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.274+0000 7f4adeffd700 1 -- 172.21.15.81:0/4033547996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0009e80 con 0x7f4ae015a2a0 2023-10-07T08:43:36.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.274+0000 7f4adeffd700 1 -- 172.21.15.81:0/4033547996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad000b860 con 0x7f4ae015a2a0 2023-10-07T08:43:36.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.274+0000 7f4adeffd700 1 -- 172.21.15.81:0/4033547996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad000bbe0 con 0x7f4ae015a2a0 2023-10-07T08:43:36.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.275+0000 7f4ae6a37700 1 -- 172.21.15.81:0/4033547996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae015a2a0 msgr2=0x7f4ae00b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:36.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.275+0000 7f4ae6a37700 1 --2- 172.21.15.81:0/4033547996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae015a2a0 0x7f4ae00b1130 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00098e0 tx=0x7f4ad00091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:36.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.275+0000 7f4ae6a37700 1 -- 172.21.15.81:0/4033547996 shutdown_connections 2023-10-07T08:43:36.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.275+0000 7f4ae6a37700 1 --2- 172.21.15.81:0/4033547996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae015a2a0 0x7f4ae00b1130 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:36.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.275+0000 7f4ae6a37700 1 -- 172.21.15.81:0/4033547996 >> 172.21.15.81:0/4033547996 conn(0x7f4ae0067640 msgr2=0x7f4ae0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:36.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.275+0000 7f4ae6a37700 1 -- 172.21.15.81:0/4033547996 shutdown_connections 2023-10-07T08:43:36.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.275+0000 7f4ae6a37700 1 -- 172.21.15.81:0/4033547996 wait complete. 2023-10-07T08:43:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.276+0000 7f4ae6a37700 1 Processor -- start 2023-10-07T08:43:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.276+0000 7f4ae6a37700 1 -- start start 2023-10-07T08:43:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.277+0000 7f4ae6a37700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae006dd60 0x7f4ae00b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.277+0000 7f4ae6a37700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ae00ceb30 0x7f4ae014f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:36.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.277+0000 7f4ae6a37700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae015a2a0 0x7f4ae00b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:36.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.277+0000 7f4ae6a37700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00b3ff0 con 0x7f4ae015a2a0 2023-10-07T08:43:36.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.277+0000 7f4ae6a37700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00b33e0 con 0x7f4ae006dd60 2023-10-07T08:43:36.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.277+0000 7f4ae6a37700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00b36c0 con 0x7f4ae00ceb30 2023-10-07T08:43:36.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.277+0000 7f4adffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae006dd60 0x7f4ae00b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:36.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.277+0000 7f4ae4fd4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae015a2a0 0x7f4ae00b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:36.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.277+0000 7f4adffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae006dd60 0x7f4ae00b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:57628/0 (socket says 172.21.15.81:57628) 2023-10-07T08:43:36.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.277+0000 7f4adffff700 1 -- 172.21.15.81:0/181009920 learned_addr learned my addr 172.21.15.81:0/181009920 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:36.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.277+0000 7f4adf7fe700 1 --2- 172.21.15.81:0/181009920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ae00ceb30 0x7f4ae014f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:36.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.278+0000 7f4adffff700 1 -- 172.21.15.81:0/181009920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ae00ceb30 msgr2=0x7f4ae014f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:36.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.278+0000 7f4adffff700 1 --2- 172.21.15.81:0/181009920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ae00ceb30 0x7f4ae014f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:36.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.278+0000 7f4adffff700 1 -- 172.21.15.81:0/181009920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae015a2a0 msgr2=0x7f4ae00b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:36.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.278+0000 7f4adffff700 1 --2- 172.21.15.81:0/181009920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae015a2a0 0x7f4ae00b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:36.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.278+0000 7f4adffff700 1 -- 172.21.15.81:0/181009920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad0009420 con 0x7f4ae006dd60 2023-10-07T08:43:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.278+0000 7f4adffff700 1 --2- 172.21.15.81:0/181009920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae006dd60 0x7f4ae00b4480 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4ae006f990 tx=0x7f4ad0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.278+0000 7f4ac7fff700 1 -- 172.21.15.81:0/181009920 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad001f070 con 0x7f4ae006dd60 2023-10-07T08:43:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.278+0000 7f4ac7fff700 1 -- 172.21.15.81:0/181009920 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad0000c90 con 0x7f4ae006dd60 2023-10-07T08:43:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.278+0000 7f4ae6a37700 1 -- 172.21.15.81:0/181009920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae00b39a0 con 0x7f4ae006dd60 2023-10-07T08:43:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.278+0000 7f4ac7fff700 1 -- 172.21.15.81:0/181009920 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0025420 con 0x7f4ae006dd60 2023-10-07T08:43:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.278+0000 7f4ae6a37700 1 -- 172.21.15.81:0/181009920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae014fe90 con 0x7f4ae006dd60 2023-10-07T08:43:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.279+0000 7f4ae6a37700 1 -- 172.21.15.81:0/181009920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae0069e40 con 0x7f4ae006dd60 2023-10-07T08:43:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.279+0000 7f4ac7fff700 1 -- 172.21.15.81:0/181009920 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ad0023070 con 0x7f4ae006dd60 2023-10-07T08:43:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.280+0000 7f4ac7fff700 1 --2- 172.21.15.81:0/181009920 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4acc066f30 0x7f4acc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:36.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.280+0000 7f4ac7fff700 1 -- 172.21.15.81:0/181009920 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4ad0085610 con 0x7f4ae006dd60 2023-10-07T08:43:36.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.280+0000 7f4adf7fe700 1 --2- 172.21.15.81:0/181009920 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4acc066f30 0x7f4acc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:36.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.280+0000 7f4adf7fe700 1 --2- 172.21.15.81:0/181009920 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4acc066f30 0x7f4acc0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00b2350 tx=0x7f4ad4007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:36.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.284+0000 7f4ac7fff700 1 -- 172.21.15.81:0/181009920 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ad0052b80 con 0x7f4ae006dd60 2023-10-07T08:43:36.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:36.488+0000 7f4ae6a37700 1 -- 172.21.15.81:0/181009920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4ae00b42d0 con 0x7f4ae006dd60 2023-10-07T08:43:37.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.467+0000 7f4ac7fff700 1 -- 172.21.15.81:0/181009920 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4ad00561a0 con 0x7f4ae006dd60 2023-10-07T08:43:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.469+0000 7f4ae6a37700 1 -- 172.21.15.81:0/181009920 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4acc066f30 msgr2=0x7f4acc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.469+0000 7f4ae6a37700 1 --2- 172.21.15.81:0/181009920 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4acc066f30 0x7f4acc0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00b2350 tx=0x7f4ad4007ec0 comp rx=0 tx=0).stop 2023-10-07T08:43:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.469+0000 7f4ae6a37700 1 -- 172.21.15.81:0/181009920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae006dd60 msgr2=0x7f4ae00b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.469+0000 7f4ae6a37700 1 --2- 172.21.15.81:0/181009920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae006dd60 0x7f4ae00b4480 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4ae006f990 tx=0x7f4ad0017000 comp rx=0 tx=0).stop 2023-10-07T08:43:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.469+0000 7f4ae6a37700 1 -- 172.21.15.81:0/181009920 shutdown_connections 2023-10-07T08:43:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.469+0000 7f4ae6a37700 1 --2- 172.21.15.81:0/181009920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae015a2a0 0x7f4ae00b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.469+0000 7f4ae6a37700 1 --2- 172.21.15.81:0/181009920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae006dd60 0x7f4ae00b4480 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:37.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.469+0000 7f4ae6a37700 1 --2- 172.21.15.81:0/181009920 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4acc066f30 0x7f4acc0693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:37.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.469+0000 7f4ae6a37700 1 --2- 172.21.15.81:0/181009920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ae00ceb30 0x7f4ae014f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:37.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.469+0000 7f4ae6a37700 1 -- 172.21.15.81:0/181009920 >> 172.21.15.81:0/181009920 conn(0x7f4ae0067640 msgr2=0x7f4ae01502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:37.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.469+0000 7f4ae6a37700 1 -- 172.21.15.81:0/181009920 shutdown_connections 2023-10-07T08:43:37.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.469+0000 7f4ae6a37700 1 -- 172.21.15.81:0/181009920 wait complete. 2023-10-07T08:43:37.472 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-07T08:43:37.485 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T08:43:37.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.602+0000 7fe92f7b7700 1 Processor -- start 2023-10-07T08:43:37.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.602+0000 7fe92f7b7700 1 -- start start 2023-10-07T08:43:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.603+0000 7fe92f7b7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9281578d0 0x7fe9280cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.603+0000 7fe92f7b7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe928157ca0 0x7fe92815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.603+0000 7fe92f7b7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280d07c0 con 0x7fe92806d120 2023-10-07T08:43:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.603+0000 7fe92f7b7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9280cfbb0 con 0x7fe928157ca0 2023-10-07T08:43:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.603+0000 7fe92f7b7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280cfe90 con 0x7fe9281578d0 2023-10-07T08:43:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.603+0000 7fe92dd54700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe92806d120 0x7fe92815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49718/0 (socket says 172.21.15.81:49718) 2023-10-07T08:43:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.603+0000 7fe92dd54700 1 -- 172.21.15.81:0/961604476 learned_addr learned my addr 172.21.15.81:0/961604476 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.603+0000 7fe91ffff700 1 -- 172.21.15.81:0/961604476 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167809574 0 0) 0x7fe9280d07c0 con 0x7fe92806d120 2023-10-07T08:43:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe91ffff700 1 -- 172.21.15.81:0/961604476 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe914003570 con 0x7fe92806d120 2023-10-07T08:43:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe92cd52700 1 --2- 172.21.15.81:0/961604476 >> v2:172.21.15.89:3300/0 conn(0x7fe928157ca0 0x7fe92815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe92d553700 1 --2- 172.21.15.81:0/961604476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9281578d0 0x7fe9280cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe91ffff700 1 -- 172.21.15.81:0/961604476 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 539728584 0 0) 0x7fe914003570 con 0x7fe92806d120 2023-10-07T08:43:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe91ffff700 1 -- 172.21.15.81:0/961604476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9281578d0 msgr2=0x7fe9280cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe91ffff700 1 --2- 172.21.15.81:0/961604476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9281578d0 0x7fe9280cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe91ffff700 1 -- 172.21.15.81:0/961604476 >> v2:172.21.15.89:3300/0 conn(0x7fe928157ca0 msgr2=0x7fe92815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe91ffff700 1 --2- 172.21.15.81:0/961604476 >> v2:172.21.15.89:3300/0 conn(0x7fe928157ca0 0x7fe92815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe91ffff700 1 -- 172.21.15.81:0/961604476 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9280d0170 con 0x7fe92806d120 2023-10-07T08:43:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe91ffff700 1 -- 172.21.15.81:0/961604476 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fe9200017f0 con 0x7fe92806d120 2023-10-07T08:43:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe91ffff700 1 -- 172.21.15.81:0/961604476 >> v1:172.21.15.81:6789/0 conn(0x7fe92806d120 legacy=0x7fe92815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe91ffff700 1 --2- 172.21.15.81:0/961604476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe914003a60 0x7fe914003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe91ffff700 1 --2- 172.21.15.81:0/961604476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9281578d0 0x7fe914004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe91ffff700 1 --2- 172.21.15.81:0/961604476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe914004d50 0x7fe9140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe91ffff700 1 -- 172.21.15.81:0/961604476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280cfbb0 con 0x7fe914003a60 2023-10-07T08:43:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe91ffff700 1 -- 172.21.15.81:0/961604476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280cfe90 con 0x7fe914004d50 2023-10-07T08:43:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe91ffff700 1 -- 172.21.15.81:0/961604476 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91400ba60 con 0x7fe9281578d0 2023-10-07T08:43:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe92d553700 1 --2- 172.21.15.81:0/961604476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe914003a60 0x7fe914003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe92cd52700 1 --2- 172.21.15.81:0/961604476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9281578d0 0x7fe914004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe92dd54700 1 --2- 172.21.15.81:0/961604476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe914004d50 0x7fe9140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe92d553700 1 -- 172.21.15.81:0/961604476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9281578d0 msgr2=0x7fe914004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe92d553700 1 --2- 172.21.15.81:0/961604476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9281578d0 0x7fe914004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe92d553700 1 -- 172.21.15.81:0/961604476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe914004d50 msgr2=0x7fe9140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe92d553700 1 --2- 172.21.15.81:0/961604476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe914004d50 0x7fe9140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe92d553700 1 -- 172.21.15.81:0/961604476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe914003570 con 0x7fe914003a60 2023-10-07T08:43:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe92d553700 1 --2- 172.21.15.81:0/961604476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe914003a60 0x7fe914003e70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe924009c00 tx=0x7fe9240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c188c9fdf0ea72c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.604+0000 7fe91ffff700 1 -- 172.21.15.81:0/961604476 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92400e6b0 con 0x7fe914003a60 2023-10-07T08:43:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.605+0000 7fe91ffff700 1 -- 172.21.15.81:0/961604476 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92400e810 con 0x7fe914003a60 2023-10-07T08:43:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.605+0000 7fe91ffff700 1 -- 172.21.15.81:0/961604476 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92400ebd0 con 0x7fe914003a60 2023-10-07T08:43:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.605+0000 7fe92f7b7700 1 -- 172.21.15.81:0/961604476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe914003a60 msgr2=0x7fe914003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.605+0000 7fe92f7b7700 1 --2- 172.21.15.81:0/961604476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe914003a60 0x7fe914003e70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe924009c00 tx=0x7fe9240091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.605+0000 7fe92dd54700 1 -- 172.21.15.81:0/961604476 reap_dead start 2023-10-07T08:43:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.605+0000 7fe92f7b7700 1 -- 172.21.15.81:0/961604476 shutdown_connections 2023-10-07T08:43:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.605+0000 7fe92f7b7700 1 -- 172.21.15.81:0/961604476 >> 172.21.15.81:0/961604476 conn(0x7fe92806bb90 msgr2=0x7fe92806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.605+0000 7fe92f7b7700 1 -- 172.21.15.81:0/961604476 shutdown_connections 2023-10-07T08:43:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.605+0000 7fe92f7b7700 1 -- 172.21.15.81:0/961604476 wait complete. 2023-10-07T08:43:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.606+0000 7fe92f7b7700 1 Processor -- start 2023-10-07T08:43:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.606+0000 7fe92f7b7700 1 -- start start 2023-10-07T08:43:37.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.607+0000 7fe92f7b7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe914003a60 0x7fe9280b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:37.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.607+0000 7fe92f7b7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe928069cf0 0x7fe92806a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:37.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.607+0000 7fe92f7b7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9280b4c90 0x7fe9280b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:37.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.607+0000 7fe92f7b7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92806a6a0 con 0x7fe9280b4c90 2023-10-07T08:43:37.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.607+0000 7fe92f7b7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92816a860 con 0x7fe914003a60 2023-10-07T08:43:37.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.607+0000 7fe92f7b7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92816ab40 con 0x7fe928069cf0 2023-10-07T08:43:37.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.607+0000 7fe92dd54700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9280b4c90 0x7fe9280b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:37.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.607+0000 7fe92dd54700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9280b4c90 0x7fe9280b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45110/0 (socket says 172.21.15.81:45110) 2023-10-07T08:43:37.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.607+0000 7fe92dd54700 1 -- 172.21.15.81:0/1289580162 learned_addr learned my addr 172.21.15.81:0/1289580162 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:37.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.607+0000 7fe92cd52700 1 --2- 172.21.15.81:0/1289580162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe928069cf0 0x7fe92806a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:37.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.607+0000 7fe92d553700 1 --2- 172.21.15.81:0/1289580162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe914003a60 0x7fe9280b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:37.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.607+0000 7fe92dd54700 1 -- 172.21.15.81:0/1289580162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe928069cf0 msgr2=0x7fe92806a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:37.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.607+0000 7fe92dd54700 1 --2- 172.21.15.81:0/1289580162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe928069cf0 0x7fe92806a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:37.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.607+0000 7fe92dd54700 1 -- 172.21.15.81:0/1289580162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe914003a60 msgr2=0x7fe9280b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:37.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.607+0000 7fe92dd54700 1 --2- 172.21.15.81:0/1289580162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe914003a60 0x7fe9280b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:37.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.607+0000 7fe92dd54700 1 -- 172.21.15.81:0/1289580162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92816ae20 con 0x7fe9280b4c90 2023-10-07T08:43:37.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.608+0000 7fe92dd54700 1 --2- 172.21.15.81:0/1289580162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9280b4c90 0x7fe9280b50e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe920000f80 tx=0x7fe9280d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:37.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.608+0000 7fe91d7fa700 1 -- 172.21.15.81:0/1289580162 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92000ad40 con 0x7fe9280b4c90 2023-10-07T08:43:37.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.608+0000 7fe91d7fa700 1 -- 172.21.15.81:0/1289580162 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9200133f0 con 0x7fe9280b4c90 2023-10-07T08:43:37.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.608+0000 7fe92f7b7700 1 -- 172.21.15.81:0/1289580162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92816b100 con 0x7fe9280b4c90 2023-10-07T08:43:37.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.608+0000 7fe91d7fa700 1 -- 172.21.15.81:0/1289580162 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9200137b0 con 0x7fe9280b4c90 2023-10-07T08:43:37.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.608+0000 7fe92f7b7700 1 -- 172.21.15.81:0/1289580162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9280b5620 con 0x7fe9280b4c90 2023-10-07T08:43:37.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.609+0000 7fe92f7b7700 1 -- 172.21.15.81:0/1289580162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92816b2f0 con 0x7fe9280b4c90 2023-10-07T08:43:37.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.609+0000 7fe91d7fa700 1 -- 172.21.15.81:0/1289580162 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe920013b60 con 0x7fe9280b4c90 2023-10-07T08:43:37.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.609+0000 7fe91d7fa700 1 --2- 172.21.15.81:0/1289580162 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe90c066f30 0x7fe90c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:37.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.609+0000 7fe91d7fa700 1 -- 172.21.15.81:0/1289580162 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe920084a70 con 0x7fe9280b4c90 2023-10-07T08:43:37.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.609+0000 7fe92d553700 1 --2- 172.21.15.81:0/1289580162 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe90c066f30 0x7fe90c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:37.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.610+0000 7fe92d553700 1 --2- 172.21.15.81:0/1289580162 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe90c066f30 0x7fe90c0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe9240091e0 tx=0x7fe92401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:37.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.613+0000 7fe91d7fa700 1 -- 172.21.15.81:0/1289580162 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe920052030 con 0x7fe9280b4c90 2023-10-07T08:43:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.870+0000 7fe92f7b7700 1 -- 172.21.15.81:0/1289580162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe9280d0450 con 0x7fe9280b4c90 2023-10-07T08:43:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.870+0000 7fe91d7fa700 1 -- 172.21.15.81:0/1289580162 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fe920055650 con 0x7fe9280b4c90 2023-10-07T08:43:37.872 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:37.872 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:43:37.872 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-07T08:43:37.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.872 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-07T08:43:37.872 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlK8v0EhAAyj+l+ifyEevPT96HbuWzkw==", 2023-10-07T08:43:37.872 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:43:37.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:43:37.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:43:37.872 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:43:37.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.873 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-07T08:43:37.873 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlN0UcHhAA0o1jHEL9Ow40VDezKTunOw==", 2023-10-07T08:43:37.873 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:43:37.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:43:37.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:43:37.873 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:43:37.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.874 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-07T08:43:37.874 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlvsm6GRAApZehzqt3HugU+h9RGWQh8g==", 2023-10-07T08:43:37.874 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.874 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:43:37.874 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:43:37.874 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:43:37.874 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:43:37.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.874 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-07T08:43:37.875 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8XLiJBAAMBqSo/+NZuuL/pPnTitAUw==", 2023-10-07T08:43:37.875 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:43:37.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:43:37.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:43:37.875 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:43:37.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.875 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-07T08:43:37.875 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD2GSFlwYNOOBAAMpoFTAZdRERvqFbI4Lno9g==", 2023-10-07T08:43:37.875 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:43:37.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:43:37.876 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:43:37.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.876 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-07T08:43:37.876 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlejEnBBAAsnZCgsTTMWvqr2n4FfgWCQ==", 2023-10-07T08:43:37.876 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:43:37.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:43:37.876 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:43:37.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.877 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-07T08:43:37.877 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlDjS3DRAAfyBS9XSkAY6Se+RNw9jwWw==", 2023-10-07T08:43:37.877 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:43:37.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:43:37.877 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:43:37.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.877 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-07T08:43:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlnLaEFxAAtQ3AxrEGCcXYvJF2/wP1yw==", 2023-10-07T08:43:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:43:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:43:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:43:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-07T08:43:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlllNdIRAAXgD+PAR1Piya6p94xfGbXA==", 2023-10-07T08:43:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:43:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:43:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:43:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-07T08:43:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFleIM7KBAAIz+WlbgsmtAuSMPO+kh/Xw==", 2023-10-07T08:43:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:43:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:43:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:43:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.880 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-07T08:43:37.880 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlFNlEMRAAt7dpMTylOj0KsJy/law6Nw==", 2023-10-07T08:43:37.880 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:43:37.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:43:37.880 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:43:37.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.880 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-07T08:43:37.881 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFloCRbOhAA8XzXVwVYYYZIJV+F84EiDQ==", 2023-10-07T08:43:37.881 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.881 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:43:37.881 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:43:37.881 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:43:37.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.881 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-07T08:43:37.881 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl7cS0KBAA2K6kkFjyEZYa0xYx53Nf7g==", 2023-10-07T08:43:37.881 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.881 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:43:37.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:43:37.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:43:37.882 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:43:37.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.882 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-07T08:43:37.882 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlP3EBMRAAWXcQeEkoEzBCSQzvz/AzBQ==", 2023-10-07T08:43:37.882 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:43:37.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:43:37.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:43:37.883 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:43:37.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.883 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-07T08:43:37.883 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFldtgKLhAAX8L0S1NgyHsOj4cUljxH/A==", 2023-10-07T08:43:37.883 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:43:37.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:43:37.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:43:37.883 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:43:37.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.884 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-07T08:43:37.884 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlJ+VXNhAA9sXFpdOEIZxQLiS8LJwa3A==", 2023-10-07T08:43:37.884 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:43:37.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:43:37.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:43:37.884 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:43:37.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.884 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-07T08:43:37.885 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDyGSFle021MxAA39oudTkATALz6ZklfA0QQA==", 2023-10-07T08:43:37.885 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:43:37.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:43:37.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:43:37.885 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:43:37.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.885 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mds", 2023-10-07T08:43:37.885 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+GSFlHFOhHBAAyllXfRI+xvA8193+xlF7NA==", 2023-10-07T08:43:37.885 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mds" 2023-10-07T08:43:37.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.886 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mgr", 2023-10-07T08:43:37.886 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+GSFlQmChHBAA80tjUDQXOhwz4Dk1XMuW/A==", 2023-10-07T08:43:37.886 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-07T08:43:37.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.886 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-osd", 2023-10-07T08:43:37.887 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+GSFlPGqhHBAAKz5JFWTkAbxkRTMkE+lBLA==", 2023-10-07T08:43:37.887 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-osd" 2023-10-07T08:43:37.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.887 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd", 2023-10-07T08:43:37.887 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+GSFloHKhHBAAks/LRTtWfowsXtvRUF+wYg==", 2023-10-07T08:43:37.887 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-07T08:43:37.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.888 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-07T08:43:37.888 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+GSFlBHqhHBAAhDzXo1Y0tdnTJfqt6PHmpg==", 2023-10-07T08:43:37.888 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-07T08:43:37.888 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.888 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rgw", 2023-10-07T08:43:37.888 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+GSFlhIGhHBAAhQ5z+xU7aZAvTgHlgWx6tg==", 2023-10-07T08:43:37.888 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-07T08:43:37.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.889 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-07T08:43:37.889 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8c3zDxAAKU/DHPPZhFJ1MKw48C6lJQ==", 2023-10-07T08:43:37.889 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:43:37.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:43:37.889 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:43:37.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:37.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:37.890 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-07T08:43:37.890 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlByYuDBAA2xkiT3FNBRXjSMlu+GdRjg==", 2023-10-07T08:43:37.891 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:43:37.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:43:37.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:43:37.891 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:43:37.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:37.891 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:43:37.891 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:43:37.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.872+0000 7fe92f7b7700 1 -- 172.21.15.81:0/1289580162 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe90c066f30 msgr2=0x7fe90c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:37.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.872+0000 7fe92f7b7700 1 --2- 172.21.15.81:0/1289580162 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe90c066f30 0x7fe90c0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe9240091e0 tx=0x7fe92401a000 comp rx=0 tx=0).stop 2023-10-07T08:43:37.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.872+0000 7fe92f7b7700 1 -- 172.21.15.81:0/1289580162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9280b4c90 msgr2=0x7fe9280b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:37.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.872+0000 7fe92f7b7700 1 --2- 172.21.15.81:0/1289580162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9280b4c90 0x7fe9280b50e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe920000f80 tx=0x7fe9280d0730 comp rx=0 tx=0).stop 2023-10-07T08:43:37.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.872+0000 7fe92f7b7700 1 -- 172.21.15.81:0/1289580162 shutdown_connections 2023-10-07T08:43:37.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.872+0000 7fe92f7b7700 1 --2- 172.21.15.81:0/1289580162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9280b4c90 0x7fe9280b50e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:37.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.872+0000 7fe92f7b7700 1 --2- 172.21.15.81:0/1289580162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe914003a60 0x7fe9280b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:37.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.872+0000 7fe92f7b7700 1 --2- 172.21.15.81:0/1289580162 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe90c066f30 0x7fe90c0693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:37.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.872+0000 7fe92f7b7700 1 --2- 172.21.15.81:0/1289580162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe928069cf0 0x7fe92806a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:37.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.872+0000 7fe92f7b7700 1 -- 172.21.15.81:0/1289580162 >> 172.21.15.81:0/1289580162 conn(0x7fe92806bb90 msgr2=0x7fe92815a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:37.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.872+0000 7fe92f7b7700 1 -- 172.21.15.81:0/1289580162 shutdown_connections 2023-10-07T08:43:37.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:37.872+0000 7fe92f7b7700 1 -- 172.21.15.81:0/1289580162 wait complete. 2023-10-07T08:43:37.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-07T08:43:38.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.007+0000 7f7e59ef6700 1 Processor -- start 2023-10-07T08:43:38.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.007+0000 7f7e59ef6700 1 -- start start 2023-10-07T08:43:38.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.008+0000 7f7e59ef6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e54157ca0 0x7f7e540cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.008+0000 7f7e59ef6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e540d07c0 con 0x7f7e5406d120 2023-10-07T08:43:38.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.008+0000 7f7e59ef6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e540cfbb0 con 0x7f7e541578d0 2023-10-07T08:43:38.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.008+0000 7f7e59ef6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540cfe90 con 0x7f7e54157ca0 2023-10-07T08:43:38.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.008+0000 7f7e53fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7e5406d120 0x7f7e5415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49730/0 (socket says 172.21.15.81:49730) 2023-10-07T08:43:38.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.008+0000 7f7e53fff700 1 -- 172.21.15.81:0/2399432589 learned_addr learned my addr 172.21.15.81:0/2399432589 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.008+0000 7f7e527fc700 1 -- 172.21.15.81:0/2399432589 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097476637 0 0) 0x7f7e540d07c0 con 0x7f7e5406d120 2023-10-07T08:43:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.008+0000 7f7e52ffd700 1 --2- 172.21.15.81:0/2399432589 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e54157ca0 0x7f7e540cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.008+0000 7f7e527fc700 1 -- 172.21.15.81:0/2399432589 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e3c003570 con 0x7f7e5406d120 2023-10-07T08:43:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e527fc700 1 -- 172.21.15.81:0/2399432589 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 280817869 0 0) 0x7f7e3c003570 con 0x7f7e5406d120 2023-10-07T08:43:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e527fc700 1 -- 172.21.15.81:0/2399432589 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e54157ca0 msgr2=0x7f7e540cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e527fc700 1 --2- 172.21.15.81:0/2399432589 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e54157ca0 0x7f7e540cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e527fc700 1 -- 172.21.15.81:0/2399432589 >> v1:172.21.15.89:6789/0 conn(0x7f7e541578d0 legacy=0x7f7e5415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e527fc700 1 -- 172.21.15.81:0/2399432589 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e540d0170 con 0x7f7e5406d120 2023-10-07T08:43:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e527fc700 1 -- 172.21.15.81:0/2399432589 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f7e4c001470 con 0x7f7e5406d120 2023-10-07T08:43:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e527fc700 1 -- 172.21.15.81:0/2399432589 >> v1:172.21.15.81:6789/0 conn(0x7f7e5406d120 legacy=0x7f7e5415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e527fc700 1 --2- 172.21.15.81:0/2399432589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c003a90 0x7f7e3c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e527fc700 1 --2- 172.21.15.81:0/2399432589 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e54157ca0 0x7f7e3c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e527fc700 1 --2- 172.21.15.81:0/2399432589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e3c004d50 0x7f7e3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e527fc700 1 -- 172.21.15.81:0/2399432589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540cfe90 con 0x7f7e3c003a90 2023-10-07T08:43:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e527fc700 1 -- 172.21.15.81:0/2399432589 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c00bb70 con 0x7f7e3c004d50 2023-10-07T08:43:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e527fc700 1 -- 172.21.15.81:0/2399432589 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c00bd30 con 0x7f7e54157ca0 2023-10-07T08:43:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e537fe700 1 --2- 172.21.15.81:0/2399432589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c003a90 0x7f7e3c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e52ffd700 1 --2- 172.21.15.81:0/2399432589 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e54157ca0 0x7f7e3c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e53fff700 1 --2- 172.21.15.81:0/2399432589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e3c004d50 0x7f7e3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e537fe700 1 -- 172.21.15.81:0/2399432589 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e54157ca0 msgr2=0x7f7e3c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e537fe700 1 --2- 172.21.15.81:0/2399432589 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e54157ca0 0x7f7e3c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e537fe700 1 -- 172.21.15.81:0/2399432589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e3c004d50 msgr2=0x7f7e3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e537fe700 1 --2- 172.21.15.81:0/2399432589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e3c004d50 0x7f7e3c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.009+0000 7f7e537fe700 1 -- 172.21.15.81:0/2399432589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c003570 con 0x7f7e3c003a90 2023-10-07T08:43:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.010+0000 7f7e537fe700 1 --2- 172.21.15.81:0/2399432589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c003a90 0x7f7e3c003ea0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7e44001fc0 tx=0x7f7e44001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75184ee1c96633af server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.010+0000 7f7e527fc700 1 -- 172.21.15.81:0/2399432589 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44001950 con 0x7f7e3c003a90 2023-10-07T08:43:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.010+0000 7f7e527fc700 1 -- 172.21.15.81:0/2399432589 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4400c8b0 con 0x7f7e3c003a90 2023-10-07T08:43:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.010+0000 7f7e527fc700 1 -- 172.21.15.81:0/2399432589 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4400cc50 con 0x7f7e3c003a90 2023-10-07T08:43:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.010+0000 7f7e59ef6700 1 -- 172.21.15.81:0/2399432589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c003a90 msgr2=0x7f7e3c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.010+0000 7f7e59ef6700 1 --2- 172.21.15.81:0/2399432589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c003a90 0x7f7e3c003ea0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7e44001fc0 tx=0x7f7e44001640 comp rx=0 tx=0).stop 2023-10-07T08:43:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.010+0000 7f7e53fff700 1 -- 172.21.15.81:0/2399432589 reap_dead start 2023-10-07T08:43:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.010+0000 7f7e59ef6700 1 -- 172.21.15.81:0/2399432589 shutdown_connections 2023-10-07T08:43:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.010+0000 7f7e59ef6700 1 -- 172.21.15.81:0/2399432589 >> 172.21.15.81:0/2399432589 conn(0x7f7e5406bb90 msgr2=0x7f7e5406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.010+0000 7f7e59ef6700 1 -- 172.21.15.81:0/2399432589 shutdown_connections 2023-10-07T08:43:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.010+0000 7f7e59ef6700 1 -- 172.21.15.81:0/2399432589 wait complete. 2023-10-07T08:43:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.012+0000 7f7e59ef6700 1 Processor -- start 2023-10-07T08:43:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.012+0000 7f7e59ef6700 1 -- start start 2023-10-07T08:43:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.012+0000 7f7e59ef6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e3c003a90 0x7f7e5414f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.012+0000 7f7e59ef6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e541559b0 0x7f7e5414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.012+0000 7f7e59ef6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e5415e6a0 0x7f7e5415eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.012+0000 7f7e59ef6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5415f080 con 0x7f7e5415e6a0 2023-10-07T08:43:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.012+0000 7f7e59ef6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540b5620 con 0x7f7e3c003a90 2023-10-07T08:43:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.012+0000 7f7e59ef6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540b57b0 con 0x7f7e541559b0 2023-10-07T08:43:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.012+0000 7f7e53fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e5415e6a0 0x7f7e5415eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.012+0000 7f7e53fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e5415e6a0 0x7f7e5415eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45130/0 (socket says 172.21.15.81:45130) 2023-10-07T08:43:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.012+0000 7f7e53fff700 1 -- 172.21.15.81:0/2019825459 learned_addr learned my addr 172.21.15.81:0/2019825459 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.012+0000 7f7e52ffd700 1 --2- 172.21.15.81:0/2019825459 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e541559b0 0x7f7e5414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.012+0000 7f7e537fe700 1 --2- 172.21.15.81:0/2019825459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e3c003a90 0x7f7e5414f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.013+0000 7f7e53fff700 1 -- 172.21.15.81:0/2019825459 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e541559b0 msgr2=0x7f7e5414dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.013+0000 7f7e53fff700 1 --2- 172.21.15.81:0/2019825459 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e541559b0 0x7f7e5414dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.013+0000 7f7e53fff700 1 -- 172.21.15.81:0/2019825459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e3c003a90 msgr2=0x7f7e5414f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.013+0000 7f7e53fff700 1 --2- 172.21.15.81:0/2019825459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e3c003a90 0x7f7e5414f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.013+0000 7f7e53fff700 1 -- 172.21.15.81:0/2019825459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5414e1e0 con 0x7f7e5415e6a0 2023-10-07T08:43:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.013+0000 7f7e53fff700 1 --2- 172.21.15.81:0/2019825459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e5415e6a0 0x7f7e5415eb40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7e54068510 tx=0x7f7e5415b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.013+0000 7f7e3b7fe700 1 -- 172.21.15.81:0/2019825459 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c012590 con 0x7f7e5415e6a0 2023-10-07T08:43:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.013+0000 7f7e3b7fe700 1 -- 172.21.15.81:0/2019825459 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4c0126f0 con 0x7f7e5415e6a0 2023-10-07T08:43:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.013+0000 7f7e59ef6700 1 -- 172.21.15.81:0/2019825459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5416b3d0 con 0x7f7e5415e6a0 2023-10-07T08:43:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.013+0000 7f7e3b7fe700 1 -- 172.21.15.81:0/2019825459 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c012ab0 con 0x7f7e5415e6a0 2023-10-07T08:43:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.013+0000 7f7e59ef6700 1 -- 172.21.15.81:0/2019825459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e540b3d40 con 0x7f7e5415e6a0 2023-10-07T08:43:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.014+0000 7f7e59ef6700 1 -- 172.21.15.81:0/2019825459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e540b3ba0 con 0x7f7e5415e6a0 2023-10-07T08:43:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.015+0000 7f7e3b7fe700 1 -- 172.21.15.81:0/2019825459 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e4c01d460 con 0x7f7e5415e6a0 2023-10-07T08:43:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.015+0000 7f7e3b7fe700 1 --2- 172.21.15.81:0/2019825459 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e40066f30 0x7f7e400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.015+0000 7f7e3b7fe700 1 -- 172.21.15.81:0/2019825459 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7e4c084020 con 0x7f7e5415e6a0 2023-10-07T08:43:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.015+0000 7f7e537fe700 1 --2- 172.21.15.81:0/2019825459 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e40066f30 0x7f7e400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.016+0000 7f7e537fe700 1 --2- 172.21.15.81:0/2019825459 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e40066f30 0x7f7e400693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7e44001390 tx=0x7f7e44015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.019+0000 7f7e3b7fe700 1 -- 172.21.15.81:0/2019825459 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e540b3ba0 con 0x7f7e5415e6a0 2023-10-07T08:43:38.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.276+0000 7f7e59ef6700 1 -- 172.21.15.81:0/2019825459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f7e540b3ba0 con 0x7f7e5415e6a0 2023-10-07T08:43:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.279+0000 7f7e3b7fe700 1 -- 172.21.15.81:0/2019825459 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7e540b3ba0 con 0x7f7e5415e6a0 2023-10-07T08:43:38.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.281+0000 7f7e59ef6700 1 -- 172.21.15.81:0/2019825459 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e40066f30 msgr2=0x7f7e400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.281+0000 7f7e59ef6700 1 --2- 172.21.15.81:0/2019825459 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e40066f30 0x7f7e400693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7e44001390 tx=0x7f7e44015000 comp rx=0 tx=0).stop 2023-10-07T08:43:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.281+0000 7f7e59ef6700 1 -- 172.21.15.81:0/2019825459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e5415e6a0 msgr2=0x7f7e5415eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.281+0000 7f7e59ef6700 1 --2- 172.21.15.81:0/2019825459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e5415e6a0 0x7f7e5415eb40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7e54068510 tx=0x7f7e5415b610 comp rx=0 tx=0).stop 2023-10-07T08:43:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.281+0000 7f7e59ef6700 1 -- 172.21.15.81:0/2019825459 shutdown_connections 2023-10-07T08:43:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.281+0000 7f7e59ef6700 1 --2- 172.21.15.81:0/2019825459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e5415e6a0 0x7f7e5415eb40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.281+0000 7f7e59ef6700 1 --2- 172.21.15.81:0/2019825459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e3c003a90 0x7f7e5414f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.281+0000 7f7e59ef6700 1 --2- 172.21.15.81:0/2019825459 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e40066f30 0x7f7e400693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.281+0000 7f7e59ef6700 1 --2- 172.21.15.81:0/2019825459 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e541559b0 0x7f7e5414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.281+0000 7f7e59ef6700 1 -- 172.21.15.81:0/2019825459 >> 172.21.15.81:0/2019825459 conn(0x7f7e5406bb90 msgr2=0x7f7e5414fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:38.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.281+0000 7f7e59ef6700 1 -- 172.21.15.81:0/2019825459 shutdown_connections 2023-10-07T08:43:38.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.281+0000 7f7e59ef6700 1 -- 172.21.15.81:0/2019825459 wait complete. 2023-10-07T08:43:38.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-07T08:43:38.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.408+0000 7f9e712d5700 1 Processor -- start 2023-10-07T08:43:38.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.408+0000 7f9e712d5700 1 -- start start 2023-10-07T08:43:38.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.409+0000 7f9e712d5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e6c069440 0x7f9e6c0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.409+0000 7f9e712d5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9e6c0c71d0 0x7f9e6c0c7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.409+0000 7f9e712d5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6c0cb880 con 0x7f9e6c156420 2023-10-07T08:43:38.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.409+0000 7f9e712d5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6c06aa10 con 0x7f9e6c069440 2023-10-07T08:43:38.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.409+0000 7f9e712d5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6c0c7b50 con 0x7f9e6c0c71d0 2023-10-07T08:43:38.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.409+0000 7f9e627fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e6c069440 0x7f9e6c0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.409+0000 7f9e627fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e6c069440 0x7f9e6c0698b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45142/0 (socket says 172.21.15.81:45142) 2023-10-07T08:43:38.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.409+0000 7f9e627fc700 1 -- 172.21.15.81:0/1390268693 learned_addr learned my addr 172.21.15.81:0/1390268693 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:38.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.409+0000 7f9e6b7fe700 1 --2- 172.21.15.81:0/1390268693 >> v2:172.21.15.89:3300/0 conn(0x7f9e6c0c71d0 0x7f9e6c0c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.409+0000 7f9e627fc700 1 -- 172.21.15.81:0/1390268693 >> v2:172.21.15.89:3300/0 conn(0x7f9e6c0c71d0 msgr2=0x7f9e6c0c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:38.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.409+0000 7f9e627fc700 1 --2- 172.21.15.81:0/1390268693 >> v2:172.21.15.89:3300/0 conn(0x7f9e6c0c71d0 0x7f9e6c0c7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.409+0000 7f9e627fc700 1 -- 172.21.15.81:0/1390268693 >> v1:172.21.15.89:6789/0 conn(0x7f9e6c156420 legacy=0x7f9e6c0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:38.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.410+0000 7f9e627fc700 1 -- 172.21.15.81:0/1390268693 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c0cac70 con 0x7f9e6c069440 2023-10-07T08:43:38.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.410+0000 7f9e6b7fe700 1 --2- 172.21.15.81:0/1390268693 >> v2:172.21.15.89:3300/0 conn(0x7f9e6c0c71d0 0x7f9e6c0c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:38.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.410+0000 7f9e627fc700 1 --2- 172.21.15.81:0/1390268693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c069440 0x7f9e6c0698b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0c3680 tx=0x7f9e5400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af623b6df6eaddc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:38.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.410+0000 7f9e6a7fc700 1 -- 172.21.15.81:0/1390268693 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5400dc10 con 0x7f9e6c069440 2023-10-07T08:43:38.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.410+0000 7f9e6a7fc700 1 -- 172.21.15.81:0/1390268693 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5400dd70 con 0x7f9e6c069440 2023-10-07T08:43:38.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.410+0000 7f9e6a7fc700 1 -- 172.21.15.81:0/1390268693 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540106c0 con 0x7f9e6c069440 2023-10-07T08:43:38.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.410+0000 7f9e712d5700 1 -- 172.21.15.81:0/1390268693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c069440 msgr2=0x7f9e6c0698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.410+0000 7f9e712d5700 1 --2- 172.21.15.81:0/1390268693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c069440 0x7f9e6c0698b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0c3680 tx=0x7f9e5400b4f0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.410+0000 7f9e712d5700 1 -- 172.21.15.81:0/1390268693 shutdown_connections 2023-10-07T08:43:38.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.410+0000 7f9e712d5700 1 --2- 172.21.15.81:0/1390268693 >> v2:172.21.15.89:3300/0 conn(0x7f9e6c0c71d0 0x7f9e6c0c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.410+0000 7f9e712d5700 1 --2- 172.21.15.81:0/1390268693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c069440 0x7f9e6c0698b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.410+0000 7f9e712d5700 1 -- 172.21.15.81:0/1390268693 >> 172.21.15.81:0/1390268693 conn(0x7f9e6c06c660 msgr2=0x7f9e6c0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:38.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.410+0000 7f9e712d5700 1 -- 172.21.15.81:0/1390268693 shutdown_connections 2023-10-07T08:43:38.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.410+0000 7f9e712d5700 1 -- 172.21.15.81:0/1390268693 wait complete. 2023-10-07T08:43:38.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.412+0000 7f9e712d5700 1 Processor -- start 2023-10-07T08:43:38.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.412+0000 7f9e712d5700 1 -- start start 2023-10-07T08:43:38.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.412+0000 7f9e712d5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e6c069440 0x7f9e6c155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.412+0000 7f9e712d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c0c71d0 0x7f9e6c0c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.412+0000 7f9e712d5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e6c156420 0x7f9e6c143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.412+0000 7f9e712d5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c0c4e20 con 0x7f9e6c0c71d0 2023-10-07T08:43:38.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.412+0000 7f9e712d5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c0c3f70 con 0x7f9e6c069440 2023-10-07T08:43:38.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.412+0000 7f9e712d5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c0c4210 con 0x7f9e6c156420 2023-10-07T08:43:38.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.412+0000 7f9e627fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c0c71d0 0x7f9e6c0c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.412+0000 7f9e627fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c0c71d0 0x7f9e6c0c3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45150/0 (socket says 172.21.15.81:45150) 2023-10-07T08:43:38.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.412+0000 7f9e627fc700 1 -- 172.21.15.81:0/2578531062 learned_addr learned my addr 172.21.15.81:0/2578531062 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:38.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.413+0000 7f9e6b7fe700 1 --2- 172.21.15.81:0/2578531062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e6c156420 0x7f9e6c143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.413+0000 7f9e6affd700 1 --2- 172.21.15.81:0/2578531062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e6c069440 0x7f9e6c155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.413+0000 7f9e627fc700 1 -- 172.21.15.81:0/2578531062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e6c156420 msgr2=0x7f9e6c143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.413+0000 7f9e627fc700 1 --2- 172.21.15.81:0/2578531062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e6c156420 0x7f9e6c143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.413+0000 7f9e627fc700 1 -- 172.21.15.81:0/2578531062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e6c069440 msgr2=0x7f9e6c155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.413+0000 7f9e627fc700 1 --2- 172.21.15.81:0/2578531062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e6c069440 0x7f9e6c155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.413+0000 7f9e627fc700 1 -- 172.21.15.81:0/2578531062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5400b790 con 0x7f9e6c0c71d0 2023-10-07T08:43:38.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.413+0000 7f9e6affd700 1 --2- 172.21.15.81:0/2578531062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e6c069440 0x7f9e6c155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:38.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.413+0000 7f9e627fc700 1 --2- 172.21.15.81:0/2578531062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c0c71d0 0x7f9e6c0c3a30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400b530 tx=0x7f9e5401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:38.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.413+0000 7f9e637fe700 1 -- 172.21.15.81:0/2578531062 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54018780 con 0x7f9e6c0c71d0 2023-10-07T08:43:38.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.413+0000 7f9e637fe700 1 -- 172.21.15.81:0/2578531062 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e54018900 con 0x7f9e6c0c71d0 2023-10-07T08:43:38.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.413+0000 7f9e637fe700 1 -- 172.21.15.81:0/2578531062 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54018cc0 con 0x7f9e6c0c71d0 2023-10-07T08:43:38.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.413+0000 7f9e712d5700 1 -- 172.21.15.81:0/2578531062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6c0c44f0 con 0x7f9e6c0c71d0 2023-10-07T08:43:38.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.413+0000 7f9e712d5700 1 -- 172.21.15.81:0/2578531062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6c0c4ab0 con 0x7f9e6c0c71d0 2023-10-07T08:43:38.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.414+0000 7f9e712d5700 1 -- 172.21.15.81:0/2578531062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e6c0c4f90 con 0x7f9e6c0c71d0 2023-10-07T08:43:38.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.414+0000 7f9e637fe700 1 -- 172.21.15.81:0/2578531062 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e540233d0 con 0x7f9e6c0c71d0 2023-10-07T08:43:38.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.415+0000 7f9e637fe700 1 --2- 172.21.15.81:0/2578531062 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9e4c066f30 0x7f9e4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.415+0000 7f9e637fe700 1 -- 172.21.15.81:0/2578531062 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9e54014070 con 0x7f9e6c0c71d0 2023-10-07T08:43:38.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.415+0000 7f9e6affd700 1 --2- 172.21.15.81:0/2578531062 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9e4c066f30 0x7f9e4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.415+0000 7f9e6affd700 1 --2- 172.21.15.81:0/2578531062 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9e4c066f30 0x7f9e4c0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c006fd0 tx=0x7f9e5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:38.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.419+0000 7f9e637fe700 1 -- 172.21.15.81:0/2578531062 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e54055360 con 0x7f9e6c0c71d0 2023-10-07T08:43:38.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.675+0000 7f9e712d5700 1 -- 172.21.15.81:0/2578531062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f9e6c0caf50 con 0x7f9e6c0c71d0 2023-10-07T08:43:38.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.679+0000 7f9e637fe700 1 -- 172.21.15.81:0/2578531062 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9e540290a0 con 0x7f9e6c0c71d0 2023-10-07T08:43:38.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.681+0000 7f9e712d5700 1 -- 172.21.15.81:0/2578531062 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9e4c066f30 msgr2=0x7f9e4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.681+0000 7f9e712d5700 1 --2- 172.21.15.81:0/2578531062 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9e4c066f30 0x7f9e4c0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c006fd0 tx=0x7f9e5c008040 comp rx=0 tx=0).stop 2023-10-07T08:43:38.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.681+0000 7f9e712d5700 1 -- 172.21.15.81:0/2578531062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c0c71d0 msgr2=0x7f9e6c0c3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.681+0000 7f9e712d5700 1 --2- 172.21.15.81:0/2578531062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c0c71d0 0x7f9e6c0c3a30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400b530 tx=0x7f9e5401a000 comp rx=0 tx=0).stop 2023-10-07T08:43:38.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.681+0000 7f9e712d5700 1 -- 172.21.15.81:0/2578531062 shutdown_connections 2023-10-07T08:43:38.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.681+0000 7f9e712d5700 1 --2- 172.21.15.81:0/2578531062 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9e4c066f30 0x7f9e4c0693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.681+0000 7f9e712d5700 1 --2- 172.21.15.81:0/2578531062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e6c156420 0x7f9e6c143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.681+0000 7f9e712d5700 1 --2- 172.21.15.81:0/2578531062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e6c069440 0x7f9e6c155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.681+0000 7f9e712d5700 1 --2- 172.21.15.81:0/2578531062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c0c71d0 0x7f9e6c0c3a30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.681+0000 7f9e712d5700 1 -- 172.21.15.81:0/2578531062 >> 172.21.15.81:0/2578531062 conn(0x7f9e6c06c660 msgr2=0x7f9e6c0cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:38.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.681+0000 7f9e712d5700 1 -- 172.21.15.81:0/2578531062 shutdown_connections 2023-10-07T08:43:38.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.681+0000 7f9e712d5700 1 -- 172.21.15.81:0/2578531062 wait complete. 2023-10-07T08:43:38.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-07T08:43:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.807+0000 7f8af25ef700 1 Processor -- start 2023-10-07T08:43:38.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.807+0000 7f8af25ef700 1 -- start start 2023-10-07T08:43:38.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.808+0000 7f8af25ef700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8aec159bc0 0x7f8aec0b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.808+0000 7f8af25ef700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aec067640 con 0x7f8aec159f90 2023-10-07T08:43:38.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.808+0000 7f8af25ef700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aec0b1e50 con 0x7f8aec0cf060 2023-10-07T08:43:38.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.808+0000 7f8af25ef700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aec067890 con 0x7f8aec159bc0 2023-10-07T08:43:38.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.808+0000 7f8af15ed700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8aec159bc0 0x7f8aec0b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.808+0000 7f8af0dec700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8aec159f90 0x7f8aec0ce950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49734/0 (socket says 172.21.15.81:49734) 2023-10-07T08:43:38.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.808+0000 7f8af0dec700 1 -- 172.21.15.81:0/4251854826 learned_addr learned my addr 172.21.15.81:0/4251854826 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:38.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.808+0000 7f8af15ed700 1 -- 172.21.15.81:0/4251854826 >> v1:172.21.15.89:6789/0 conn(0x7f8aec0cf060 legacy=0x7f8aec163930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.808+0000 7f8af15ed700 1 -- 172.21.15.81:0/4251854826 >> v1:172.21.15.81:6789/0 conn(0x7f8aec159f90 legacy=0x7f8aec0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.808+0000 7f8af15ed700 1 -- 172.21.15.81:0/4251854826 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec067b70 con 0x7f8aec159bc0 2023-10-07T08:43:38.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.808+0000 7f8ae3fff700 1 -- 172.21.15.81:0/4251854826 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882791983 0 0) 0x7f8aec067640 con 0x7f8aec159f90 2023-10-07T08:43:38.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.809+0000 7f8af15ed700 1 --2- 172.21.15.81:0/4251854826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aec159bc0 0x7f8aec0b17c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80098e0 tx=0x7f8ae80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64aef4df21e294fb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:38.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.809+0000 7f8ae3fff700 1 -- 172.21.15.81:0/4251854826 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8009e80 con 0x7f8aec159bc0 2023-10-07T08:43:38.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.809+0000 7f8ae3fff700 1 -- 172.21.15.81:0/4251854826 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae800b860 con 0x7f8aec159bc0 2023-10-07T08:43:38.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.809+0000 7f8ae3fff700 1 -- 172.21.15.81:0/4251854826 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800bbe0 con 0x7f8aec159bc0 2023-10-07T08:43:38.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.809+0000 7f8af25ef700 1 -- 172.21.15.81:0/4251854826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aec159bc0 msgr2=0x7f8aec0b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.809+0000 7f8af25ef700 1 --2- 172.21.15.81:0/4251854826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aec159bc0 0x7f8aec0b17c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80098e0 tx=0x7f8ae80091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.809+0000 7f8af25ef700 1 -- 172.21.15.81:0/4251854826 shutdown_connections 2023-10-07T08:43:38.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.809+0000 7f8af25ef700 1 --2- 172.21.15.81:0/4251854826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aec159bc0 0x7f8aec0b17c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.809+0000 7f8af25ef700 1 -- 172.21.15.81:0/4251854826 >> 172.21.15.81:0/4251854826 conn(0x7f8aec06c620 msgr2=0x7f8aec06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:38.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.809+0000 7f8af25ef700 1 -- 172.21.15.81:0/4251854826 shutdown_connections 2023-10-07T08:43:38.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.809+0000 7f8af25ef700 1 -- 172.21.15.81:0/4251854826 wait complete. 2023-10-07T08:43:38.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.810+0000 7f8af25ef700 1 Processor -- start 2023-10-07T08:43:38.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.811+0000 7f8af25ef700 1 -- start start 2023-10-07T08:43:38.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.811+0000 7f8af25ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aec0cf060 0x7f8aec1581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.811+0000 7f8af25ef700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8aec159bc0 0x7f8aec156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.811+0000 7f8af25ef700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aec159f90 0x7f8aec157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.811+0000 7f8af25ef700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec152a30 con 0x7f8aec0cf060 2023-10-07T08:43:38.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.811+0000 7f8af25ef700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec1574b0 con 0x7f8aec159f90 2023-10-07T08:43:38.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.811+0000 7f8af25ef700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec1568a0 con 0x7f8aec159bc0 2023-10-07T08:43:38.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.811+0000 7f8af15ed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aec0cf060 0x7f8aec1581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.812+0000 7f8af15ed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aec0cf060 0x7f8aec1581a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45168/0 (socket says 172.21.15.81:45168) 2023-10-07T08:43:38.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.812+0000 7f8af15ed700 1 -- 172.21.15.81:0/2150369130 learned_addr learned my addr 172.21.15.81:0/2150369130 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:38.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.812+0000 7f8af15ed700 1 -- 172.21.15.81:0/2150369130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8aec159bc0 msgr2=0x7f8aec156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.812+0000 7f8af15ed700 1 --2- 172.21.15.81:0/2150369130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8aec159bc0 0x7f8aec156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.812+0000 7f8af15ed700 1 -- 172.21.15.81:0/2150369130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aec159f90 msgr2=0x7f8aec157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:38.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.812+0000 7f8af15ed700 1 --2- 172.21.15.81:0/2150369130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aec159f90 0x7f8aec157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:38.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.812+0000 7f8af15ed700 1 -- 172.21.15.81:0/2150369130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae8009420 con 0x7f8aec0cf060 2023-10-07T08:43:38.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.812+0000 7f8af15ed700 1 --2- 172.21.15.81:0/2150369130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aec0cf060 0x7f8aec1581a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8aec063870 tx=0x7f8ae8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:38.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.812+0000 7f8ae17fa700 1 -- 172.21.15.81:0/2150369130 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae801f070 con 0x7f8aec0cf060 2023-10-07T08:43:38.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.812+0000 7f8ae17fa700 1 -- 172.21.15.81:0/2150369130 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae8011420 con 0x7f8aec0cf060 2023-10-07T08:43:38.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.812+0000 7f8ae17fa700 1 -- 172.21.15.81:0/2150369130 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800bbe0 con 0x7f8aec0cf060 2023-10-07T08:43:38.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.812+0000 7f8af25ef700 1 -- 172.21.15.81:0/2150369130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aec156b80 con 0x7f8aec0cf060 2023-10-07T08:43:38.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.812+0000 7f8af25ef700 1 -- 172.21.15.81:0/2150369130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aec157140 con 0x7f8aec0cf060 2023-10-07T08:43:38.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.813+0000 7f8af25ef700 1 -- 172.21.15.81:0/2150369130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aec157790 con 0x7f8aec0cf060 2023-10-07T08:43:38.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.813+0000 7f8ae17fa700 1 -- 172.21.15.81:0/2150369130 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ae8011a50 con 0x7f8aec0cf060 2023-10-07T08:43:38.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.814+0000 7f8ae17fa700 1 --2- 172.21.15.81:0/2150369130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8ad0066f30 0x7f8ad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:38.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.814+0000 7f8ae17fa700 1 -- 172.21.15.81:0/2150369130 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8ae80858b0 con 0x7f8aec0cf060 2023-10-07T08:43:38.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.814+0000 7f8af0dec700 1 --2- 172.21.15.81:0/2150369130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8ad0066f30 0x7f8ad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:38.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.814+0000 7f8af0dec700 1 --2- 172.21.15.81:0/2150369130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8ad0066f30 0x7f8ad00693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0011e0 tx=0x7f8adc0079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:38.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:38.818+0000 7f8ae17fa700 1 -- 172.21.15.81:0/2150369130 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ae8052dd0 con 0x7f8aec0cf060 2023-10-07T08:43:39.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.074+0000 7f8af25ef700 1 -- 172.21.15.81:0/2150369130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f8aec071b10 con 0x7f8aec0cf060 2023-10-07T08:43:39.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.078+0000 7f8ae17fa700 1 -- 172.21.15.81:0/2150369130 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8ae80563f0 con 0x7f8aec0cf060 2023-10-07T08:43:39.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.080+0000 7f8af25ef700 1 -- 172.21.15.81:0/2150369130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8ad0066f30 msgr2=0x7f8ad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:39.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.080+0000 7f8af25ef700 1 --2- 172.21.15.81:0/2150369130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8ad0066f30 0x7f8ad00693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0011e0 tx=0x7f8adc0079d0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.080+0000 7f8af25ef700 1 -- 172.21.15.81:0/2150369130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aec0cf060 msgr2=0x7f8aec1581a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:39.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.080+0000 7f8af25ef700 1 --2- 172.21.15.81:0/2150369130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aec0cf060 0x7f8aec1581a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8aec063870 tx=0x7f8ae8017000 comp rx=0 tx=0).stop 2023-10-07T08:43:39.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.080+0000 7f8af25ef700 1 -- 172.21.15.81:0/2150369130 shutdown_connections 2023-10-07T08:43:39.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.080+0000 7f8af25ef700 1 --2- 172.21.15.81:0/2150369130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aec159f90 0x7f8aec157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.080+0000 7f8af25ef700 1 --2- 172.21.15.81:0/2150369130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aec0cf060 0x7f8aec1581a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.080+0000 7f8af25ef700 1 --2- 172.21.15.81:0/2150369130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8ad0066f30 0x7f8ad00693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.080+0000 7f8af25ef700 1 --2- 172.21.15.81:0/2150369130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8aec159bc0 0x7f8aec156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.080+0000 7f8af25ef700 1 -- 172.21.15.81:0/2150369130 >> 172.21.15.81:0/2150369130 conn(0x7f8aec06c620 msgr2=0x7f8aec154530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:39.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.080+0000 7f8af25ef700 1 -- 172.21.15.81:0/2150369130 shutdown_connections 2023-10-07T08:43:39.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.080+0000 7f8af25ef700 1 -- 172.21.15.81:0/2150369130 wait complete. 2023-10-07T08:43:39.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-07T08:43:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.205+0000 7f0bc2fa8700 1 Processor -- start 2023-10-07T08:43:39.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.205+0000 7f0bc2fa8700 1 -- start start 2023-10-07T08:43:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.206+0000 7f0bc2fa8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0bbc06d830 0x7f0bbc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.206+0000 7f0bc2fa8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc0d07c0 con 0x7f0bbc157ca0 2023-10-07T08:43:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.206+0000 7f0bc2fa8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc0cfbb0 con 0x7f0bbc1578d0 2023-10-07T08:43:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.206+0000 7f0bc2fa8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bbc0cfe90 con 0x7f0bbc06d830 2023-10-07T08:43:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.206+0000 7f0bc1545700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0bbc06d830 0x7f0bbc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.206+0000 7f0bb3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0bbc157ca0 0x7f0bbc06d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49748/0 (socket says 172.21.15.81:49748) 2023-10-07T08:43:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.206+0000 7f0bb3fff700 1 -- 172.21.15.81:0/3549115800 learned_addr learned my addr 172.21.15.81:0/3549115800 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.206+0000 7f0bc1545700 1 -- 172.21.15.81:0/3549115800 >> v1:172.21.15.89:6789/0 conn(0x7f0bbc1578d0 legacy=0x7f0bbc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.206+0000 7f0bc1545700 1 -- 172.21.15.81:0/3549115800 >> v1:172.21.15.81:6789/0 conn(0x7f0bbc157ca0 legacy=0x7f0bbc06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:39.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.206+0000 7f0bb37fe700 1 -- 172.21.15.81:0/3549115800 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122414060 0 0) 0x7f0bbc0d07c0 con 0x7f0bbc157ca0 2023-10-07T08:43:39.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.207+0000 7f0bc1545700 1 -- 172.21.15.81:0/3549115800 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc0d0170 con 0x7f0bbc06d830 2023-10-07T08:43:39.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.207+0000 7f0bc1545700 1 --2- 172.21.15.81:0/3549115800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bbc06d830 0x7f0bbc0cf4f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40098e0 tx=0x7f0bb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62388f3355ca6d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:39.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.207+0000 7f0bb37fe700 1 -- 172.21.15.81:0/3549115800 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4009e80 con 0x7f0bbc06d830 2023-10-07T08:43:39.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.207+0000 7f0bb37fe700 1 -- 172.21.15.81:0/3549115800 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb400b860 con 0x7f0bbc06d830 2023-10-07T08:43:39.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.207+0000 7f0bb37fe700 1 -- 172.21.15.81:0/3549115800 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb400bbe0 con 0x7f0bbc06d830 2023-10-07T08:43:39.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.207+0000 7f0bc2fa8700 1 -- 172.21.15.81:0/3549115800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bbc06d830 msgr2=0x7f0bbc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:39.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.207+0000 7f0bc2fa8700 1 --2- 172.21.15.81:0/3549115800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bbc06d830 0x7f0bbc0cf4f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40098e0 tx=0x7f0bb40091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.207+0000 7f0bc2fa8700 1 -- 172.21.15.81:0/3549115800 shutdown_connections 2023-10-07T08:43:39.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.207+0000 7f0bc2fa8700 1 --2- 172.21.15.81:0/3549115800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bbc06d830 0x7f0bbc0cf4f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.207+0000 7f0bc2fa8700 1 -- 172.21.15.81:0/3549115800 >> 172.21.15.81:0/3549115800 conn(0x7f0bbc06bb90 msgr2=0x7f0bbc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:39.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.207+0000 7f0bc2fa8700 1 -- 172.21.15.81:0/3549115800 shutdown_connections 2023-10-07T08:43:39.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.207+0000 7f0bc2fa8700 1 -- 172.21.15.81:0/3549115800 wait complete. 2023-10-07T08:43:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.208+0000 7f0bc2fa8700 1 Processor -- start 2023-10-07T08:43:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.209+0000 7f0bc2fa8700 1 -- start start 2023-10-07T08:43:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.209+0000 7f0bc2fa8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bbc06d830 0x7f0bbc0cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.209+0000 7f0bc2fa8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bbc1578d0 0x7f0bbc0ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.209+0000 7f0bc2fa8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bbc157ca0 0x7f0bbc069050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.209+0000 7f0bc2fa8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0af640 con 0x7f0bbc1578d0 2023-10-07T08:43:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.209+0000 7f0bc2fa8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0cd710 con 0x7f0bbc157ca0 2023-10-07T08:43:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.209+0000 7f0bc2fa8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0b1850 con 0x7f0bbc06d830 2023-10-07T08:43:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.209+0000 7f0bb3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bbc1578d0 0x7f0bbc0ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.209+0000 7f0bb3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bbc1578d0 0x7f0bbc0ac210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45182/0 (socket says 172.21.15.81:45182) 2023-10-07T08:43:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.209+0000 7f0bb3fff700 1 -- 172.21.15.81:0/2494176170 learned_addr learned my addr 172.21.15.81:0/2494176170 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.210+0000 7f0bc1545700 1 --2- 172.21.15.81:0/2494176170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bbc157ca0 0x7f0bbc069050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.210+0000 7f0bc0d44700 1 --2- 172.21.15.81:0/2494176170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bbc06d830 0x7f0bbc0cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.210+0000 7f0bb3fff700 1 -- 172.21.15.81:0/2494176170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bbc06d830 msgr2=0x7f0bbc0cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.210+0000 7f0bb3fff700 1 --2- 172.21.15.81:0/2494176170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bbc06d830 0x7f0bbc0cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.210+0000 7f0bb3fff700 1 -- 172.21.15.81:0/2494176170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bbc157ca0 msgr2=0x7f0bbc069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:39.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.210+0000 7f0bb3fff700 1 --2- 172.21.15.81:0/2494176170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bbc157ca0 0x7f0bbc069050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.210+0000 7f0bb3fff700 1 -- 172.21.15.81:0/2494176170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb4009420 con 0x7f0bbc1578d0 2023-10-07T08:43:39.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.210+0000 7f0bc1545700 1 --2- 172.21.15.81:0/2494176170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bbc157ca0 0x7f0bbc069050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:39.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.210+0000 7f0bc0d44700 1 --2- 172.21.15.81:0/2494176170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bbc06d830 0x7f0bbc0cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:39.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.210+0000 7f0bb3fff700 1 --2- 172.21.15.81:0/2494176170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bbc1578d0 0x7f0bbc0ac210 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00c530 tx=0x7f0bac007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:39.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.210+0000 7f0bb0ff9700 1 -- 172.21.15.81:0/2494176170 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac005b30 con 0x7f0bbc1578d0 2023-10-07T08:43:39.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.210+0000 7f0bb0ff9700 1 -- 172.21.15.81:0/2494176170 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac005c90 con 0x7f0bbc1578d0 2023-10-07T08:43:39.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.210+0000 7f0bc2fa8700 1 -- 172.21.15.81:0/2494176170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bbc0b1b30 con 0x7f0bbc1578d0 2023-10-07T08:43:39.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.210+0000 7f0bb0ff9700 1 -- 172.21.15.81:0/2494176170 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac007320 con 0x7f0bbc1578d0 2023-10-07T08:43:39.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.210+0000 7f0bc2fa8700 1 -- 172.21.15.81:0/2494176170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc0b20f0 con 0x7f0bbc1578d0 2023-10-07T08:43:39.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.211+0000 7f0bc2fa8700 1 -- 172.21.15.81:0/2494176170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bbc067ac0 con 0x7f0bbc1578d0 2023-10-07T08:43:39.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.212+0000 7f0bb0ff9700 1 -- 172.21.15.81:0/2494176170 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0bac01b3b0 con 0x7f0bbc1578d0 2023-10-07T08:43:39.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.212+0000 7f0bb0ff9700 1 --2- 172.21.15.81:0/2494176170 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0ba8066f30 0x7f0ba80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:39.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.212+0000 7f0bb0ff9700 1 -- 172.21.15.81:0/2494176170 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0bac083750 con 0x7f0bbc1578d0 2023-10-07T08:43:39.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.212+0000 7f0bc0d44700 1 --2- 172.21.15.81:0/2494176170 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0ba8066f30 0x7f0ba80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:39.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.212+0000 7f0bc0d44700 1 --2- 172.21.15.81:0/2494176170 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0ba8066f30 0x7f0ba80693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8007fd0 tx=0x7f0bb8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:39.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.216+0000 7f0bb0ff9700 1 -- 172.21.15.81:0/2494176170 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bac050d10 con 0x7f0bbc1578d0 2023-10-07T08:43:39.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.477+0000 7f0bc2fa8700 1 -- 172.21.15.81:0/2494176170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f0bbc0d0450 con 0x7f0bbc1578d0 2023-10-07T08:43:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.481+0000 7f0bb0ff9700 1 -- 172.21.15.81:0/2494176170 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0bac0170a0 con 0x7f0bbc1578d0 2023-10-07T08:43:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.483+0000 7f0bc2fa8700 1 -- 172.21.15.81:0/2494176170 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0ba8066f30 msgr2=0x7f0ba80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.483+0000 7f0bc2fa8700 1 --2- 172.21.15.81:0/2494176170 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0ba8066f30 0x7f0ba80693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8007fd0 tx=0x7f0bb8009040 comp rx=0 tx=0).stop 2023-10-07T08:43:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.483+0000 7f0bc2fa8700 1 -- 172.21.15.81:0/2494176170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bbc1578d0 msgr2=0x7f0bbc0ac210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.483+0000 7f0bc2fa8700 1 --2- 172.21.15.81:0/2494176170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bbc1578d0 0x7f0bbc0ac210 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00c530 tx=0x7f0bac007f90 comp rx=0 tx=0).stop 2023-10-07T08:43:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.483+0000 7f0bc2fa8700 1 -- 172.21.15.81:0/2494176170 shutdown_connections 2023-10-07T08:43:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.483+0000 7f0bc2fa8700 1 --2- 172.21.15.81:0/2494176170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bbc157ca0 0x7f0bbc069050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.483+0000 7f0bc2fa8700 1 --2- 172.21.15.81:0/2494176170 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0ba8066f30 0x7f0ba80693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.483+0000 7f0bc2fa8700 1 --2- 172.21.15.81:0/2494176170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bbc06d830 0x7f0bbc0cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.483+0000 7f0bc2fa8700 1 --2- 172.21.15.81:0/2494176170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bbc1578d0 0x7f0bbc0ac210 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.483+0000 7f0bc2fa8700 1 -- 172.21.15.81:0/2494176170 >> 172.21.15.81:0/2494176170 conn(0x7f0bbc06bb90 msgr2=0x7f0bbc06d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.483+0000 7f0bc2fa8700 1 -- 172.21.15.81:0/2494176170 shutdown_connections 2023-10-07T08:43:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.483+0000 7f0bc2fa8700 1 -- 172.21.15.81:0/2494176170 wait complete. 2023-10-07T08:43:39.496 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-07T08:43:39.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.609+0000 7ff2f3b4f700 1 Processor -- start 2023-10-07T08:43:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.609+0000 7ff2f3b4f700 1 -- start start 2023-10-07T08:43:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.610+0000 7ff2f3b4f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2ec1578d0 0x7ff2ec0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.610+0000 7ff2f3b4f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff2ec06d120 0x7ff2ec06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.610+0000 7ff2f3b4f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ec06dac0 con 0x7ff2ec157ca0 2023-10-07T08:43:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.610+0000 7ff2f3b4f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ec0d07c0 con 0x7ff2ec06d120 2023-10-07T08:43:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.610+0000 7ff2f3b4f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec0cfbb0 con 0x7ff2ec1578d0 2023-10-07T08:43:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.610+0000 7ff2f20ec700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff2ec06d120 0x7ff2ec06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.610+0000 7ff2f20ec700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff2ec06d120 0x7ff2ec06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:57720/0 (socket says 172.21.15.81:57720) 2023-10-07T08:43:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.610+0000 7ff2f20ec700 1 -- 172.21.15.81:0/4246674043 learned_addr learned my addr 172.21.15.81:0/4246674043 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.610+0000 7ff2f18eb700 1 --2- 172.21.15.81:0/4246674043 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2ec1578d0 0x7ff2ec0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.610+0000 7ff2f10ea700 1 --1- 172.21.15.81:0/4246674043 >> v1:172.21.15.89:6789/0 conn(0x7ff2ec157ca0 0x7ff2ec15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:41868/0 (socket says 172.21.15.81:41868) 2023-10-07T08:43:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.611+0000 7ff2f20ec700 1 -- 172.21.15.81:0/4246674043 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2ec1578d0 msgr2=0x7ff2ec0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.611+0000 7ff2f20ec700 1 --2- 172.21.15.81:0/4246674043 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2ec1578d0 0x7ff2ec0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.611+0000 7ff2f20ec700 1 -- 172.21.15.81:0/4246674043 >> v1:172.21.15.89:6789/0 conn(0x7ff2ec157ca0 legacy=0x7ff2ec15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.611+0000 7ff2f20ec700 1 -- 172.21.15.81:0/4246674043 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec0cfe90 con 0x7ff2ec06d120 2023-10-07T08:43:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.611+0000 7ff2f18eb700 1 --2- 172.21.15.81:0/4246674043 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2ec1578d0 0x7ff2ec0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.611+0000 7ff2f20ec700 1 --2- 172.21.15.81:0/4246674043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2ec06d120 0x7ff2ec06d580 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4009f20 tx=0x7ff2e4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9916d264ee44e8c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.611+0000 7ff2f08e9700 1 -- 172.21.15.81:0/4246674043 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e400e070 con 0x7ff2ec06d120 2023-10-07T08:43:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.611+0000 7ff2f08e9700 1 -- 172.21.15.81:0/4246674043 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e400b9d0 con 0x7ff2ec06d120 2023-10-07T08:43:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.611+0000 7ff2f08e9700 1 -- 172.21.15.81:0/4246674043 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40092e0 con 0x7ff2ec06d120 2023-10-07T08:43:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.612+0000 7ff2f3b4f700 1 -- 172.21.15.81:0/4246674043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2ec06d120 msgr2=0x7ff2ec06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.612+0000 7ff2f3b4f700 1 --2- 172.21.15.81:0/4246674043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2ec06d120 0x7ff2ec06d580 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4009f20 tx=0x7ff2e4009840 comp rx=0 tx=0).stop 2023-10-07T08:43:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.612+0000 7ff2f3b4f700 1 -- 172.21.15.81:0/4246674043 shutdown_connections 2023-10-07T08:43:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.612+0000 7ff2f3b4f700 1 --2- 172.21.15.81:0/4246674043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2ec06d120 0x7ff2ec06d580 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.612+0000 7ff2f3b4f700 1 --2- 172.21.15.81:0/4246674043 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2ec1578d0 0x7ff2ec0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.612+0000 7ff2f3b4f700 1 -- 172.21.15.81:0/4246674043 >> 172.21.15.81:0/4246674043 conn(0x7ff2ec06bb90 msgr2=0x7ff2ec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.612+0000 7ff2f3b4f700 1 -- 172.21.15.81:0/4246674043 shutdown_connections 2023-10-07T08:43:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.612+0000 7ff2f3b4f700 1 -- 172.21.15.81:0/4246674043 wait complete. 2023-10-07T08:43:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.613+0000 7ff2f3b4f700 1 Processor -- start 2023-10-07T08:43:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.613+0000 7ff2f3b4f700 1 -- start start 2023-10-07T08:43:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f3b4f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2ec06d120 0x7ff2ec14dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f3b4f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec1578d0 0x7ff2ec153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f3b4f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2ec157ca0 0x7ff2ec068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f3b4f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec1523d0 con 0x7ff2ec1578d0 2023-10-07T08:43:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f3b4f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec14e280 con 0x7ff2ec157ca0 2023-10-07T08:43:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f3b4f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec153bc0 con 0x7ff2ec06d120 2023-10-07T08:43:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f10ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec1578d0 0x7ff2ec153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f10ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec1578d0 0x7ff2ec153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45188/0 (socket says 172.21.15.81:45188) 2023-10-07T08:43:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f10ea700 1 -- 172.21.15.81:0/3212373766 learned_addr learned my addr 172.21.15.81:0/3212373766 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f18eb700 1 --2- 172.21.15.81:0/3212373766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2ec06d120 0x7ff2ec14dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f20ec700 1 --2- 172.21.15.81:0/3212373766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2ec157ca0 0x7ff2ec068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f10ea700 1 -- 172.21.15.81:0/3212373766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2ec06d120 msgr2=0x7ff2ec14dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f10ea700 1 --2- 172.21.15.81:0/3212373766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2ec06d120 0x7ff2ec14dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f10ea700 1 -- 172.21.15.81:0/3212373766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2ec157ca0 msgr2=0x7ff2ec068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f10ea700 1 --2- 172.21.15.81:0/3212373766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2ec157ca0 0x7ff2ec068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f10ea700 1 -- 172.21.15.81:0/3212373766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e8009420 con 0x7ff2ec1578d0 2023-10-07T08:43:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f20ec700 1 --2- 172.21.15.81:0/3212373766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2ec157ca0 0x7ff2ec068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f10ea700 1 --2- 172.21.15.81:0/3212373766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec1578d0 0x7ff2ec153170 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00c560 tx=0x7ff2dc007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2e1ffb700 1 -- 172.21.15.81:0/3212373766 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc005a70 con 0x7ff2ec1578d0 2023-10-07T08:43:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2e1ffb700 1 -- 172.21.15.81:0/3212373766 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc005bd0 con 0x7ff2ec1578d0 2023-10-07T08:43:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.614+0000 7ff2f3b4f700 1 -- 172.21.15.81:0/3212373766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e4009ae0 con 0x7ff2ec1578d0 2023-10-07T08:43:39.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.615+0000 7ff2e1ffb700 1 -- 172.21.15.81:0/3212373766 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc0070d0 con 0x7ff2ec1578d0 2023-10-07T08:43:39.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.615+0000 7ff2f3b4f700 1 -- 172.21.15.81:0/3212373766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ec151d80 con 0x7ff2ec1578d0 2023-10-07T08:43:39.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.616+0000 7ff2f3b4f700 1 -- 172.21.15.81:0/3212373766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ec15d380 con 0x7ff2ec1578d0 2023-10-07T08:43:39.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.616+0000 7ff2e1ffb700 1 -- 172.21.15.81:0/3212373766 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2dc007480 con 0x7ff2ec1578d0 2023-10-07T08:43:39.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.616+0000 7ff2e1ffb700 1 --2- 172.21.15.81:0/3212373766 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff2d0066f30 0x7ff2d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.616+0000 7ff2e1ffb700 1 -- 172.21.15.81:0/3212373766 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff2dc0833e0 con 0x7ff2ec1578d0 2023-10-07T08:43:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.616+0000 7ff2f18eb700 1 --2- 172.21.15.81:0/3212373766 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff2d0066f30 0x7ff2d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.617+0000 7ff2f18eb700 1 --2- 172.21.15.81:0/3212373766 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff2d0066f30 0x7ff2d00693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009f20 tx=0x7ff2e80091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.621+0000 7ff2e1ffb700 1 -- 172.21.15.81:0/3212373766 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2dc0509a0 con 0x7ff2ec1578d0 2023-10-07T08:43:39.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.877+0000 7ff2f3b4f700 1 -- 172.21.15.81:0/3212373766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7ff2ec06dac0 con 0x7ff2ec1578d0 2023-10-07T08:43:39.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.880+0000 7ff2e1ffb700 1 -- 172.21.15.81:0/3212373766 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff2ec06dac0 con 0x7ff2ec1578d0 2023-10-07T08:43:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.882+0000 7ff2f3b4f700 1 -- 172.21.15.81:0/3212373766 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff2d0066f30 msgr2=0x7ff2d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.882+0000 7ff2f3b4f700 1 --2- 172.21.15.81:0/3212373766 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff2d0066f30 0x7ff2d00693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009f20 tx=0x7ff2e80091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.882+0000 7ff2f3b4f700 1 -- 172.21.15.81:0/3212373766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec1578d0 msgr2=0x7ff2ec153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.882+0000 7ff2f3b4f700 1 --2- 172.21.15.81:0/3212373766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec1578d0 0x7ff2ec153170 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00c560 tx=0x7ff2dc007f70 comp rx=0 tx=0).stop 2023-10-07T08:43:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.882+0000 7ff2f3b4f700 1 -- 172.21.15.81:0/3212373766 shutdown_connections 2023-10-07T08:43:39.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.882+0000 7ff2f3b4f700 1 --2- 172.21.15.81:0/3212373766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2ec157ca0 0x7ff2ec068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.882+0000 7ff2f3b4f700 1 --2- 172.21.15.81:0/3212373766 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff2d0066f30 0x7ff2d00693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.882+0000 7ff2f3b4f700 1 --2- 172.21.15.81:0/3212373766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2ec06d120 0x7ff2ec14dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.882+0000 7ff2f3b4f700 1 --2- 172.21.15.81:0/3212373766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec1578d0 0x7ff2ec153170 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:39.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.882+0000 7ff2f3b4f700 1 -- 172.21.15.81:0/3212373766 >> 172.21.15.81:0/3212373766 conn(0x7ff2ec06bb90 msgr2=0x7ff2ec15b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:39.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.883+0000 7ff2f3b4f700 1 -- 172.21.15.81:0/3212373766 shutdown_connections 2023-10-07T08:43:39.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:39.883+0000 7ff2f3b4f700 1 -- 172.21.15.81:0/3212373766 wait complete. 2023-10-07T08:43:39.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-07T08:43:40.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.008+0000 7f8e76281700 1 Processor -- start 2023-10-07T08:43:40.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.008+0000 7f8e76281700 1 -- start start 2023-10-07T08:43:40.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.009+0000 7f8e76281700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e70159f10 0x7f8e70068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.009+0000 7f8e76281700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e70069120 con 0x7f8e70068cc0 2023-10-07T08:43:40.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.009+0000 7f8e76281700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e700cee10 con 0x7f8e70159b40 2023-10-07T08:43:40.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.009+0000 7f8e76281700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e700cd040 con 0x7f8e70159f10 2023-10-07T08:43:40.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.009+0000 7f8e74a7e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e70159f10 0x7f8e70068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.009+0000 7f8e75a80700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8e70068cc0 0x7f8e700cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49752/0 (socket says 172.21.15.81:49752) 2023-10-07T08:43:40.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.009+0000 7f8e75a80700 1 -- 172.21.15.81:0/219047262 learned_addr learned my addr 172.21.15.81:0/219047262 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:40.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.009+0000 7f8e74a7e700 1 -- 172.21.15.81:0/219047262 >> v1:172.21.15.89:6789/0 conn(0x7f8e70159b40 legacy=0x7f8e700cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.009+0000 7f8e74a7e700 1 -- 172.21.15.81:0/219047262 >> v1:172.21.15.81:6789/0 conn(0x7f8e70068cc0 legacy=0x7f8e700cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.009+0000 7f8e67fff700 1 -- 172.21.15.81:0/219047262 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157972900 0 0) 0x7f8e68001110 con 0x7f8e70068cc0 2023-10-07T08:43:40.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.009+0000 7f8e74a7e700 1 -- 172.21.15.81:0/219047262 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e700cd320 con 0x7f8e70159f10 2023-10-07T08:43:40.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.010+0000 7f8e74a7e700 1 --2- 172.21.15.81:0/219047262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e70159f10 0x7f8e70068780 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8e600098e0 tx=0x7f8e600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a75fd3a66e4bf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:40.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.010+0000 7f8e67fff700 1 -- 172.21.15.81:0/219047262 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e60009e80 con 0x7f8e70159f10 2023-10-07T08:43:40.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.010+0000 7f8e67fff700 1 -- 172.21.15.81:0/219047262 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6000b860 con 0x7f8e70159f10 2023-10-07T08:43:40.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.010+0000 7f8e67fff700 1 -- 172.21.15.81:0/219047262 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6000bbe0 con 0x7f8e70159f10 2023-10-07T08:43:40.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.010+0000 7f8e76281700 1 -- 172.21.15.81:0/219047262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e70159f10 msgr2=0x7f8e70068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.010+0000 7f8e76281700 1 --2- 172.21.15.81:0/219047262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e70159f10 0x7f8e70068780 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8e600098e0 tx=0x7f8e600091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.010+0000 7f8e76281700 1 -- 172.21.15.81:0/219047262 shutdown_connections 2023-10-07T08:43:40.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.010+0000 7f8e76281700 1 --2- 172.21.15.81:0/219047262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e70159f10 0x7f8e70068780 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.010+0000 7f8e76281700 1 -- 172.21.15.81:0/219047262 >> 172.21.15.81:0/219047262 conn(0x7f8e700cd660 msgr2=0x7f8e700cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:40.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.010+0000 7f8e76281700 1 -- 172.21.15.81:0/219047262 shutdown_connections 2023-10-07T08:43:40.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.010+0000 7f8e76281700 1 -- 172.21.15.81:0/219047262 wait complete. 2023-10-07T08:43:40.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.011+0000 7f8e76281700 1 Processor -- start 2023-10-07T08:43:40.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.012+0000 7f8e76281700 1 -- start start 2023-10-07T08:43:40.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.012+0000 7f8e76281700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e70068cc0 0x7f8e70169d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.012+0000 7f8e76281700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e70159b40 0x7f8e7016bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.012+0000 7f8e76281700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e70159f10 0x7f8e7006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.012+0000 7f8e76281700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7016a2c0 con 0x7f8e70159b40 2023-10-07T08:43:40.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.012+0000 7f8e76281700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7016c980 con 0x7f8e70068cc0 2023-10-07T08:43:40.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.012+0000 7f8e76281700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7016cc60 con 0x7f8e70159f10 2023-10-07T08:43:40.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.013+0000 7f8e74a7e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e70159b40 0x7f8e7016bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.013+0000 7f8e74a7e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e70159b40 0x7f8e7016bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45194/0 (socket says 172.21.15.81:45194) 2023-10-07T08:43:40.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.013+0000 7f8e74a7e700 1 -- 172.21.15.81:0/1005536057 learned_addr learned my addr 172.21.15.81:0/1005536057 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:40.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.013+0000 7f8e7527f700 1 --2- 172.21.15.81:0/1005536057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e70068cc0 0x7f8e70169d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.013+0000 7f8e75a80700 1 --2- 172.21.15.81:0/1005536057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e70159f10 0x7f8e7006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.013+0000 7f8e74a7e700 1 -- 172.21.15.81:0/1005536057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e70159f10 msgr2=0x7f8e7006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.013+0000 7f8e74a7e700 1 --2- 172.21.15.81:0/1005536057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e70159f10 0x7f8e7006d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.013+0000 7f8e74a7e700 1 -- 172.21.15.81:0/1005536057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e70068cc0 msgr2=0x7f8e70169d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.013+0000 7f8e74a7e700 1 --2- 172.21.15.81:0/1005536057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e70068cc0 0x7f8e70169d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.013+0000 7f8e74a7e700 1 -- 172.21.15.81:0/1005536057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e60009420 con 0x7f8e70159b40 2023-10-07T08:43:40.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.013+0000 7f8e74a7e700 1 --2- 172.21.15.81:0/1005536057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e70159b40 0x7f8e7016bfc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8e7006fe10 tx=0x7f8e60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:40.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.013+0000 7f8e657fa700 1 -- 172.21.15.81:0/1005536057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6001f070 con 0x7f8e70159b40 2023-10-07T08:43:40.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.013+0000 7f8e657fa700 1 -- 172.21.15.81:0/1005536057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e60000c90 con 0x7f8e70159b40 2023-10-07T08:43:40.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.013+0000 7f8e76281700 1 -- 172.21.15.81:0/1005536057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7016cf40 con 0x7f8e70159b40 2023-10-07T08:43:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.013+0000 7f8e657fa700 1 -- 172.21.15.81:0/1005536057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e60025420 con 0x7f8e70159b40 2023-10-07T08:43:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.013+0000 7f8e76281700 1 -- 172.21.15.81:0/1005536057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7016d500 con 0x7f8e70159b40 2023-10-07T08:43:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.014+0000 7f8e76281700 1 -- 172.21.15.81:0/1005536057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7016d6f0 con 0x7f8e70159b40 2023-10-07T08:43:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.015+0000 7f8e657fa700 1 -- 172.21.15.81:0/1005536057 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e60023070 con 0x7f8e70159b40 2023-10-07T08:43:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.015+0000 7f8e657fa700 1 --2- 172.21.15.81:0/1005536057 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8e54066f30 0x7f8e540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.015+0000 7f8e657fa700 1 -- 172.21.15.81:0/1005536057 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8e60085670 con 0x7f8e70159b40 2023-10-07T08:43:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.015+0000 7f8e7527f700 1 --2- 172.21.15.81:0/1005536057 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8e54066f30 0x7f8e540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.016+0000 7f8e7527f700 1 --2- 172.21.15.81:0/1005536057 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8e54066f30 0x7f8e540693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c007fd0 tx=0x7f8e6c0016f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:40.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.019+0000 7f8e657fa700 1 -- 172.21.15.81:0/1005536057 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e60052c30 con 0x7f8e70159b40 2023-10-07T08:43:40.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.280+0000 7f8e76281700 1 -- 172.21.15.81:0/1005536057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f8e700cb890 con 0x7f8e70159b40 2023-10-07T08:43:40.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.284+0000 7f8e657fa700 1 -- 172.21.15.81:0/1005536057 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8e600150a0 con 0x7f8e70159b40 2023-10-07T08:43:40.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.286+0000 7f8e76281700 1 -- 172.21.15.81:0/1005536057 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8e54066f30 msgr2=0x7f8e540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.286+0000 7f8e76281700 1 --2- 172.21.15.81:0/1005536057 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8e54066f30 0x7f8e540693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c007fd0 tx=0x7f8e6c0016f0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.286+0000 7f8e76281700 1 -- 172.21.15.81:0/1005536057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e70159b40 msgr2=0x7f8e7016bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.286+0000 7f8e76281700 1 --2- 172.21.15.81:0/1005536057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e70159b40 0x7f8e7016bfc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8e7006fe10 tx=0x7f8e60017000 comp rx=0 tx=0).stop 2023-10-07T08:43:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.286+0000 7f8e76281700 1 -- 172.21.15.81:0/1005536057 shutdown_connections 2023-10-07T08:43:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.286+0000 7f8e76281700 1 --2- 172.21.15.81:0/1005536057 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8e54066f30 0x7f8e540693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.286+0000 7f8e76281700 1 --2- 172.21.15.81:0/1005536057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e70159f10 0x7f8e7006d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.286+0000 7f8e76281700 1 --2- 172.21.15.81:0/1005536057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e70068cc0 0x7f8e70169d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.286+0000 7f8e76281700 1 --2- 172.21.15.81:0/1005536057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e70159b40 0x7f8e7016bfc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.286+0000 7f8e76281700 1 -- 172.21.15.81:0/1005536057 >> 172.21.15.81:0/1005536057 conn(0x7f8e700cd660 msgr2=0x7f8e700cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:40.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.286+0000 7f8e76281700 1 -- 172.21.15.81:0/1005536057 shutdown_connections 2023-10-07T08:43:40.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.286+0000 7f8e76281700 1 -- 172.21.15.81:0/1005536057 wait complete. 2023-10-07T08:43:40.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:40.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.412+0000 7fa012e6c700 1 Processor -- start 2023-10-07T08:43:40.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.412+0000 7fa012e6c700 1 -- start start 2023-10-07T08:43:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa012e6c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa00c1578d0 0x7fa00c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa012e6c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa00c157ca0 0x7fa00c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa012e6c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00c0d07c0 con 0x7fa00c06d120 2023-10-07T08:43:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa012e6c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00c0cfbb0 con 0x7fa00c1578d0 2023-10-07T08:43:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa012e6c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0cfe90 con 0x7fa00c157ca0 2023-10-07T08:43:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa011409700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa00c06d120 0x7fa00c15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49768/0 (socket says 172.21.15.81:49768) 2023-10-07T08:43:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa011409700 1 -- 172.21.15.81:0/2637333381 learned_addr learned my addr 172.21.15.81:0/2637333381 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa010c08700 1 --2- 172.21.15.81:0/2637333381 >> v2:172.21.15.89:3300/0 conn(0x7fa00c1578d0 0x7fa00c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00bfff700 1 --2- 172.21.15.81:0/2637333381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa00c157ca0 0x7fa00c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00b7fe700 1 -- 172.21.15.81:0/2637333381 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376643576 0 0) 0x7fa00c0d07c0 con 0x7fa00c06d120 2023-10-07T08:43:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00b7fe700 1 -- 172.21.15.81:0/2637333381 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ff8003570 con 0x7fa00c06d120 2023-10-07T08:43:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00b7fe700 1 -- 172.21.15.81:0/2637333381 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4079679314 0 0) 0x7f9ff8003570 con 0x7fa00c06d120 2023-10-07T08:43:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00b7fe700 1 -- 172.21.15.81:0/2637333381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa00c157ca0 msgr2=0x7fa00c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00b7fe700 1 --2- 172.21.15.81:0/2637333381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa00c157ca0 0x7fa00c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00b7fe700 1 -- 172.21.15.81:0/2637333381 >> v2:172.21.15.89:3300/0 conn(0x7fa00c1578d0 msgr2=0x7fa00c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:40.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00b7fe700 1 --2- 172.21.15.81:0/2637333381 >> v2:172.21.15.89:3300/0 conn(0x7fa00c1578d0 0x7fa00c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00b7fe700 1 -- 172.21.15.81:0/2637333381 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c0d0170 con 0x7fa00c06d120 2023-10-07T08:43:40.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00b7fe700 1 -- 172.21.15.81:0/2637333381 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f9ff4001470 con 0x7fa00c06d120 2023-10-07T08:43:40.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00b7fe700 1 -- 172.21.15.81:0/2637333381 >> v1:172.21.15.81:6789/0 conn(0x7fa00c06d120 legacy=0x7fa00c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00b7fe700 1 --2- 172.21.15.81:0/2637333381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff8003a60 0x7f9ff8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00b7fe700 1 --2- 172.21.15.81:0/2637333381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa00c157ca0 0x7f9ff8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00b7fe700 1 --2- 172.21.15.81:0/2637333381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ff8004d50 0x7f9ff80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00b7fe700 1 -- 172.21.15.81:0/2637333381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0cfbb0 con 0x7f9ff8003a60 2023-10-07T08:43:40.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00b7fe700 1 -- 172.21.15.81:0/2637333381 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0cfe90 con 0x7f9ff8004d50 2023-10-07T08:43:40.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa00b7fe700 1 -- 172.21.15.81:0/2637333381 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff800ba60 con 0x7fa00c157ca0 2023-10-07T08:43:40.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.413+0000 7fa010c08700 1 --2- 172.21.15.81:0/2637333381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff8003a60 0x7f9ff8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.414+0000 7fa00bfff700 1 --2- 172.21.15.81:0/2637333381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa00c157ca0 0x7f9ff8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.414+0000 7fa011409700 1 --2- 172.21.15.81:0/2637333381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ff8004d50 0x7f9ff80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.414+0000 7fa010c08700 1 -- 172.21.15.81:0/2637333381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa00c157ca0 msgr2=0x7f9ff8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:40.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.414+0000 7fa010c08700 1 --2- 172.21.15.81:0/2637333381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa00c157ca0 0x7f9ff8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.414+0000 7fa010c08700 1 -- 172.21.15.81:0/2637333381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ff8004d50 msgr2=0x7f9ff80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:40.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.414+0000 7fa010c08700 1 --2- 172.21.15.81:0/2637333381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ff8004d50 0x7f9ff80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.414+0000 7fa010c08700 1 -- 172.21.15.81:0/2637333381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8003570 con 0x7f9ff8003a60 2023-10-07T08:43:40.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.414+0000 7fa010c08700 1 --2- 172.21.15.81:0/2637333381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff8003a60 0x7f9ff8003e70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa004009c00 tx=0x7fa0040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331d31b6b6e1bbb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:40.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.414+0000 7fa00b7fe700 1 -- 172.21.15.81:0/2637333381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00400e6b0 con 0x7f9ff8003a60 2023-10-07T08:43:40.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.414+0000 7fa00b7fe700 1 -- 172.21.15.81:0/2637333381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00400e810 con 0x7f9ff8003a60 2023-10-07T08:43:40.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.414+0000 7fa00b7fe700 1 -- 172.21.15.81:0/2637333381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00400ebd0 con 0x7f9ff8003a60 2023-10-07T08:43:40.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.415+0000 7fa012e6c700 1 -- 172.21.15.81:0/2637333381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff8003a60 msgr2=0x7f9ff8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.415+0000 7fa012e6c700 1 --2- 172.21.15.81:0/2637333381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff8003a60 0x7f9ff8003e70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa004009c00 tx=0x7fa0040091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.415+0000 7fa011409700 1 -- 172.21.15.81:0/2637333381 reap_dead start 2023-10-07T08:43:40.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.415+0000 7fa012e6c700 1 -- 172.21.15.81:0/2637333381 shutdown_connections 2023-10-07T08:43:40.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.415+0000 7fa012e6c700 1 -- 172.21.15.81:0/2637333381 >> 172.21.15.81:0/2637333381 conn(0x7fa00c06bb90 msgr2=0x7fa00c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:40.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.415+0000 7fa012e6c700 1 -- 172.21.15.81:0/2637333381 shutdown_connections 2023-10-07T08:43:40.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.415+0000 7fa012e6c700 1 -- 172.21.15.81:0/2637333381 wait complete. 2023-10-07T08:43:40.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.416+0000 7fa012e6c700 1 Processor -- start 2023-10-07T08:43:40.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.416+0000 7fa012e6c700 1 -- start start 2023-10-07T08:43:40.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa012e6c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff8003a60 0x7fa00c16d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa012e6c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa00c16b3c0 0x7fa00c0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa012e6c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa00c0caf80 0x7fa00c0ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa012e6c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0cb420 con 0x7f9ff8003a60 2023-10-07T08:43:40.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa012e6c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0c62d0 con 0x7fa00c16b3c0 2023-10-07T08:43:40.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa012e6c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0c5ca0 con 0x7fa00c0caf80 2023-10-07T08:43:40.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa010c08700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff8003a60 0x7fa00c16d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa010c08700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff8003a60 0x7fa00c16d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45224/0 (socket says 172.21.15.81:45224) 2023-10-07T08:43:40.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa010c08700 1 -- 172.21.15.81:0/3585924751 learned_addr learned my addr 172.21.15.81:0/3585924751 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:40.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa00bfff700 1 --2- 172.21.15.81:0/3585924751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa00c16b3c0 0x7fa00c0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa011409700 1 --2- 172.21.15.81:0/3585924751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa00c0caf80 0x7fa00c0ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa010c08700 1 -- 172.21.15.81:0/3585924751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa00c0caf80 msgr2=0x7fa00c0ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa010c08700 1 --2- 172.21.15.81:0/3585924751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa00c0caf80 0x7fa00c0ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa010c08700 1 -- 172.21.15.81:0/3585924751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa00c16b3c0 msgr2=0x7fa00c0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa010c08700 1 --2- 172.21.15.81:0/3585924751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa00c16b3c0 0x7fa00c0caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa010c08700 1 -- 172.21.15.81:0/3585924751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c0cd9a0 con 0x7f9ff8003a60 2023-10-07T08:43:40.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa011409700 1 --2- 172.21.15.81:0/3585924751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa00c0caf80 0x7fa00c0ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:40.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa010c08700 1 --2- 172.21.15.81:0/3585924751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff8003a60 0x7fa00c16d000 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8004730 tx=0x7fa00401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:40.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa008ff9700 1 -- 172.21.15.81:0/3585924751 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004022070 con 0x7f9ff8003a60 2023-10-07T08:43:40.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa008ff9700 1 -- 172.21.15.81:0/3585924751 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00400e980 con 0x7f9ff8003a60 2023-10-07T08:43:40.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa012e6c700 1 -- 172.21.15.81:0/3585924751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00c0c5f60 con 0x7f9ff8003a60 2023-10-07T08:43:40.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa008ff9700 1 -- 172.21.15.81:0/3585924751 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004027470 con 0x7f9ff8003a60 2023-10-07T08:43:40.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.417+0000 7fa012e6c700 1 -- 172.21.15.81:0/3585924751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00c0cd190 con 0x7f9ff8003a60 2023-10-07T08:43:40.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.418+0000 7fa012e6c700 1 -- 172.21.15.81:0/3585924751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00c0cb380 con 0x7f9ff8003a60 2023-10-07T08:43:40.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.419+0000 7fa008ff9700 1 -- 172.21.15.81:0/3585924751 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa00401c450 con 0x7f9ff8003a60 2023-10-07T08:43:40.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.419+0000 7fa008ff9700 1 --2- 172.21.15.81:0/3585924751 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9fec066f30 0x7f9fec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.419+0000 7fa008ff9700 1 -- 172.21.15.81:0/3585924751 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa004085ce0 con 0x7f9ff8003a60 2023-10-07T08:43:40.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.419+0000 7fa00bfff700 1 --2- 172.21.15.81:0/3585924751 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9fec066f30 0x7f9fec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.419+0000 7fa00bfff700 1 --2- 172.21.15.81:0/3585924751 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9fec066f30 0x7f9fec0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0094d0 tx=0x7f9ffc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:40.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.424+0000 7fa008ff9700 1 -- 172.21.15.81:0/3585924751 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0040532a0 con 0x7f9ff8003a60 2023-10-07T08:43:40.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.606+0000 7fa012e6c700 1 -- 172.21.15.81:0/3585924751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa00c0d0450 con 0x7f9ff8003a60 2023-10-07T08:43:40.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.607+0000 7fa008ff9700 1 -- 172.21.15.81:0/3585924751 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12086 (secure 0 0 0) 0x7fa00402c090 con 0x7f9ff8003a60 2023-10-07T08:43:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:40.608 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:43:37.460111+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:40.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.609+0000 7fa012e6c700 1 -- 172.21.15.81:0/3585924751 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9fec066f30 msgr2=0x7f9fec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.609+0000 7fa012e6c700 1 --2- 172.21.15.81:0/3585924751 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9fec066f30 0x7f9fec0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0094d0 tx=0x7f9ffc00b040 comp rx=0 tx=0).stop 2023-10-07T08:43:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.609+0000 7fa012e6c700 1 -- 172.21.15.81:0/3585924751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff8003a60 msgr2=0x7fa00c16d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.609+0000 7fa012e6c700 1 --2- 172.21.15.81:0/3585924751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff8003a60 0x7fa00c16d000 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8004730 tx=0x7fa00401a000 comp rx=0 tx=0).stop 2023-10-07T08:43:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.609+0000 7fa012e6c700 1 -- 172.21.15.81:0/3585924751 shutdown_connections 2023-10-07T08:43:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.609+0000 7fa012e6c700 1 --2- 172.21.15.81:0/3585924751 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9fec066f30 0x7f9fec0693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.609+0000 7fa012e6c700 1 --2- 172.21.15.81:0/3585924751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa00c0caf80 0x7fa00c0ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.609+0000 7fa012e6c700 1 --2- 172.21.15.81:0/3585924751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff8003a60 0x7fa00c16d000 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.609+0000 7fa012e6c700 1 --2- 172.21.15.81:0/3585924751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa00c16b3c0 0x7fa00c0caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.609+0000 7fa012e6c700 1 -- 172.21.15.81:0/3585924751 >> 172.21.15.81:0/3585924751 conn(0x7fa00c06bb90 msgr2=0x7fa00c1569f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.609+0000 7fa012e6c700 1 -- 172.21.15.81:0/3585924751 shutdown_connections 2023-10-07T08:43:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.609+0000 7fa012e6c700 1 -- 172.21.15.81:0/3585924751 wait complete. 2023-10-07T08:43:40.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T08:43:40.622 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:43:40.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.739+0000 7f67d6139700 1 Processor -- start 2023-10-07T08:43:40.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.739+0000 7f67d6139700 1 -- start start 2023-10-07T08:43:40.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.740+0000 7f67d6139700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f67d00cf240 0x7f67d00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.740+0000 7f67d6139700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67d006d650 0x7f67d006da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.740+0000 7f67d6139700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d00b0ca0 con 0x7f67d015a2a0 2023-10-07T08:43:40.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.740+0000 7f67d6139700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d006ea90 con 0x7f67d00cf240 2023-10-07T08:43:40.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.740+0000 7f67d6139700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d00b00d0 con 0x7f67d006d650 2023-10-07T08:43:40.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.741+0000 7f67ceffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f67d00cf240 0x7f67d00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.741+0000 7f67cffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67d006d650 0x7f67d006da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.741+0000 7f67cf7fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f67d015a2a0 0x7f67d00ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:41876/0 (socket says 172.21.15.81:41876) 2023-10-07T08:43:40.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.741+0000 7f67cf7fe700 1 -- 172.21.15.81:0/1828096798 learned_addr learned my addr 172.21.15.81:0/1828096798 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:40.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.741+0000 7f67ceffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f67d00cf240 0x7f67d00b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:57790/0 (socket says 172.21.15.81:57790) 2023-10-07T08:43:40.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.741+0000 7f67cffff700 1 -- 172.21.15.81:0/1828096798 >> v2:172.21.15.89:3300/0 conn(0x7f67d00cf240 msgr2=0x7f67d00b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:40.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.741+0000 7f67cffff700 1 --2- 172.21.15.81:0/1828096798 >> v2:172.21.15.89:3300/0 conn(0x7f67d00cf240 0x7f67d00b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.741+0000 7f67cffff700 1 -- 172.21.15.81:0/1828096798 >> v1:172.21.15.89:6789/0 conn(0x7f67d015a2a0 legacy=0x7f67d00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.741+0000 7f67cffff700 1 -- 172.21.15.81:0/1828096798 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d00b0370 con 0x7f67d006d650 2023-10-07T08:43:40.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.741+0000 7f67cffff700 1 --2- 172.21.15.81:0/1828096798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67d006d650 0x7f67d006da70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f67c80098e0 tx=0x7f67c80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ecfb152cfc76e4f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:40.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.741+0000 7f67ce7fc700 1 -- 172.21.15.81:0/1828096798 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c800b640 con 0x7f67d006d650 2023-10-07T08:43:40.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.741+0000 7f67ce7fc700 1 -- 172.21.15.81:0/1828096798 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c800b7a0 con 0x7f67d006d650 2023-10-07T08:43:40.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.741+0000 7f67ce7fc700 1 -- 172.21.15.81:0/1828096798 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c800bb40 con 0x7f67d006d650 2023-10-07T08:43:40.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.742+0000 7f67d6139700 1 -- 172.21.15.81:0/1828096798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67d006d650 msgr2=0x7f67d006da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.742+0000 7f67d6139700 1 --2- 172.21.15.81:0/1828096798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67d006d650 0x7f67d006da70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f67c80098e0 tx=0x7f67c80091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.742+0000 7f67d6139700 1 -- 172.21.15.81:0/1828096798 shutdown_connections 2023-10-07T08:43:40.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.742+0000 7f67d6139700 1 --2- 172.21.15.81:0/1828096798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67d006d650 0x7f67d006da70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.742+0000 7f67d6139700 1 --2- 172.21.15.81:0/1828096798 >> v2:172.21.15.89:3300/0 conn(0x7f67d00cf240 0x7f67d00b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.742+0000 7f67d6139700 1 -- 172.21.15.81:0/1828096798 >> 172.21.15.81:0/1828096798 conn(0x7f67d0067640 msgr2=0x7f67d0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:40.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.742+0000 7f67d6139700 1 -- 172.21.15.81:0/1828096798 shutdown_connections 2023-10-07T08:43:40.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.742+0000 7f67d6139700 1 -- 172.21.15.81:0/1828096798 wait complete. 2023-10-07T08:43:40.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.743+0000 7f67d6139700 1 Processor -- start 2023-10-07T08:43:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.743+0000 7f67d6139700 1 -- start start 2023-10-07T08:43:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.744+0000 7f67d6139700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d006d650 0x7f67d016b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.744+0000 7f67d6139700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67d00cf240 0x7f67d0152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.744+0000 7f67d6139700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67d015a2a0 0x7f67d015d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.744+0000 7f67d6139700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d015cbc0 con 0x7f67d006d650 2023-10-07T08:43:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.744+0000 7f67d6139700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d00cc0a0 con 0x7f67d00cf240 2023-10-07T08:43:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.744+0000 7f67d6139700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d0153280 con 0x7f67d015a2a0 2023-10-07T08:43:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.744+0000 7f67cf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d006d650 0x7f67d016b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.744+0000 7f67cf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d006d650 0x7f67d016b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45236/0 (socket says 172.21.15.81:45236) 2023-10-07T08:43:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.744+0000 7f67cf7fe700 1 -- 172.21.15.81:0/1599531795 learned_addr learned my addr 172.21.15.81:0/1599531795 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.744+0000 7f67cffff700 1 --2- 172.21.15.81:0/1599531795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67d015a2a0 0x7f67d015d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.744+0000 7f67ceffd700 1 --2- 172.21.15.81:0/1599531795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67d00cf240 0x7f67d0152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.744+0000 7f67cf7fe700 1 -- 172.21.15.81:0/1599531795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67d015a2a0 msgr2=0x7f67d015d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.744+0000 7f67cf7fe700 1 --2- 172.21.15.81:0/1599531795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67d015a2a0 0x7f67d015d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.744+0000 7f67cf7fe700 1 -- 172.21.15.81:0/1599531795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67d00cf240 msgr2=0x7f67d0152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.744+0000 7f67cf7fe700 1 --2- 172.21.15.81:0/1599531795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67d00cf240 0x7f67d0152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.744+0000 7f67cf7fe700 1 -- 172.21.15.81:0/1599531795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c8009420 con 0x7f67d006d650 2023-10-07T08:43:40.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.745+0000 7f67cf7fe700 1 --2- 172.21.15.81:0/1599531795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d006d650 0x7f67d016b270 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f67c000cc70 tx=0x7f67c0001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:40.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.745+0000 7f67b77fe700 1 -- 172.21.15.81:0/1599531795 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c000a890 con 0x7f67d006d650 2023-10-07T08:43:40.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.745+0000 7f67b77fe700 1 -- 172.21.15.81:0/1599531795 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c000aa10 con 0x7f67d006d650 2023-10-07T08:43:40.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.745+0000 7f67d6139700 1 -- 172.21.15.81:0/1599531795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d00cbdc0 con 0x7f67d006d650 2023-10-07T08:43:40.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.745+0000 7f67b77fe700 1 -- 172.21.15.81:0/1599531795 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c000add0 con 0x7f67d006d650 2023-10-07T08:43:40.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.745+0000 7f67d6139700 1 -- 172.21.15.81:0/1599531795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d016aa70 con 0x7f67d006d650 2023-10-07T08:43:40.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.746+0000 7f67d6139700 1 -- 172.21.15.81:0/1599531795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d00b4b00 con 0x7f67d006d650 2023-10-07T08:43:40.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.746+0000 7f67b77fe700 1 -- 172.21.15.81:0/1599531795 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f67c0007300 con 0x7f67d006d650 2023-10-07T08:43:40.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.746+0000 7f67b77fe700 1 --2- 172.21.15.81:0/1599531795 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f67bc066f30 0x7f67bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:40.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.747+0000 7f67b77fe700 1 -- 172.21.15.81:0/1599531795 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f67c0084580 con 0x7f67d006d650 2023-10-07T08:43:40.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.747+0000 7f67ceffd700 1 --2- 172.21.15.81:0/1599531795 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f67bc066f30 0x7f67bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:40.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.747+0000 7f67ceffd700 1 --2- 172.21.15.81:0/1599531795 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f67bc066f30 0x7f67bc0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f67d00cd3d0 tx=0x7f67c40091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:40.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.751+0000 7f67b77fe700 1 -- 172.21.15.81:0/1599531795 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67c0051b20 con 0x7f67d006d650 2023-10-07T08:43:40.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.931+0000 7f67d6139700 1 -- 172.21.15.81:0/1599531795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67d004bb80 con 0x7f67d006d650 2023-10-07T08:43:40.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.931+0000 7f67b77fe700 1 -- 172.21.15.81:0/1599531795 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67c0084030 con 0x7f67d006d650 2023-10-07T08:43:40.933 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:43:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.933+0000 7f67d6139700 1 -- 172.21.15.81:0/1599531795 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f67bc066f30 msgr2=0x7f67bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.933+0000 7f67d6139700 1 --2- 172.21.15.81:0/1599531795 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f67bc066f30 0x7f67bc0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f67d00cd3d0 tx=0x7f67c40091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.933+0000 7f67d6139700 1 -- 172.21.15.81:0/1599531795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d006d650 msgr2=0x7f67d016b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.933+0000 7f67d6139700 1 --2- 172.21.15.81:0/1599531795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d006d650 0x7f67d016b270 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f67c000cc70 tx=0x7f67c0001a30 comp rx=0 tx=0).stop 2023-10-07T08:43:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.933+0000 7f67d6139700 1 -- 172.21.15.81:0/1599531795 shutdown_connections 2023-10-07T08:43:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.933+0000 7f67d6139700 1 --2- 172.21.15.81:0/1599531795 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f67bc066f30 0x7f67bc0693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.933+0000 7f67d6139700 1 --2- 172.21.15.81:0/1599531795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67d015a2a0 0x7f67d015d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.933+0000 7f67d6139700 1 --2- 172.21.15.81:0/1599531795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d006d650 0x7f67d016b270 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.933+0000 7f67d6139700 1 --2- 172.21.15.81:0/1599531795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67d00cf240 0x7f67d0152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.933+0000 7f67d6139700 1 -- 172.21.15.81:0/1599531795 >> 172.21.15.81:0/1599531795 conn(0x7f67d0067640 msgr2=0x7f67d0156f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.933+0000 7f67d6139700 1 -- 172.21.15.81:0/1599531795 shutdown_connections 2023-10-07T08:43:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:40.933+0000 7f67d6139700 1 -- 172.21.15.81:0/1599531795 wait complete. 2023-10-07T08:43:40.946 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T08:43:41.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.059+0000 7f54cffff700 1 Processor -- start 2023-10-07T08:43:41.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.059+0000 7f54cffff700 1 -- start start 2023-10-07T08:43:41.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.060+0000 7f54cffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f54d00b3230 0x7f54d015d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:41.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.060+0000 7f54cffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d015e830 con 0x7f54d00686e0 2023-10-07T08:43:41.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.060+0000 7f54cffff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d00cb3f0 con 0x7f54d0159c90 2023-10-07T08:43:41.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.060+0000 7f54cffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d00caf60 con 0x7f54d00b3230 2023-10-07T08:43:41.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.060+0000 7f54cf7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f54d00b3230 0x7f54d015d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:41.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.060+0000 7f54c67fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f54d00686e0 0x7f54d00b2b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49778/0 (socket says 172.21.15.81:49778) 2023-10-07T08:43:41.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.060+0000 7f54c67fc700 1 -- 172.21.15.81:0/673540813 learned_addr learned my addr 172.21.15.81:0/673540813 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:41.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.060+0000 7f54ce7fc700 1 -- 172.21.15.81:0/673540813 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994911835 0 0) 0x7f54b8001110 con 0x7f54d00686e0 2023-10-07T08:43:41.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.060+0000 7f54ce7fc700 1 -- 172.21.15.81:0/673540813 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54bc003570 con 0x7f54d00686e0 2023-10-07T08:43:41.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.060+0000 7f54cf7fe700 1 -- 172.21.15.81:0/673540813 >> v1:172.21.15.89:6789/0 conn(0x7f54d0159c90 legacy=0x7f54d00ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.060+0000 7f54cf7fe700 1 -- 172.21.15.81:0/673540813 >> v1:172.21.15.81:6789/0 conn(0x7f54d00686e0 legacy=0x7f54d00b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.060+0000 7f54cf7fe700 1 -- 172.21.15.81:0/673540813 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d00cd390 con 0x7f54d00b3230 2023-10-07T08:43:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.060+0000 7f54cf7fe700 1 --2- 172.21.15.81:0/673540813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54d00b3230 0x7f54d015d890 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f54c8009e60 tx=0x7f54c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77e21b5b5b8fc15 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.061+0000 7f54ce7fc700 1 -- 172.21.15.81:0/673540813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c800e070 con 0x7f54d00b3230 2023-10-07T08:43:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.061+0000 7f54ce7fc700 1 -- 172.21.15.81:0/673540813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c800bb60 con 0x7f54d00b3230 2023-10-07T08:43:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.061+0000 7f54ce7fc700 1 -- 172.21.15.81:0/673540813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c8012430 con 0x7f54d00b3230 2023-10-07T08:43:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.061+0000 7f54cffff700 1 -- 172.21.15.81:0/673540813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54d00b3230 msgr2=0x7f54d015d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.061+0000 7f54cffff700 1 --2- 172.21.15.81:0/673540813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54d00b3230 0x7f54d015d890 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f54c8009e60 tx=0x7f54c8009780 comp rx=0 tx=0).stop 2023-10-07T08:43:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.061+0000 7f54cffff700 1 -- 172.21.15.81:0/673540813 shutdown_connections 2023-10-07T08:43:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.061+0000 7f54cffff700 1 --2- 172.21.15.81:0/673540813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54d00b3230 0x7f54d015d890 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.061+0000 7f54cffff700 1 -- 172.21.15.81:0/673540813 >> 172.21.15.81:0/673540813 conn(0x7f54d006bb90 msgr2=0x7f54d006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:41.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.061+0000 7f54cffff700 1 -- 172.21.15.81:0/673540813 shutdown_connections 2023-10-07T08:43:41.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.061+0000 7f54cffff700 1 -- 172.21.15.81:0/673540813 wait complete. 2023-10-07T08:43:41.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.062+0000 7f54cffff700 1 Processor -- start 2023-10-07T08:43:41.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.062+0000 7f54cffff700 1 -- start start 2023-10-07T08:43:41.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.063+0000 7f54cffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54d00686e0 0x7f54d016a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:41.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.063+0000 7f54cffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54d00b3230 0x7f54d00ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:41.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.063+0000 7f54cffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54d0159c90 0x7f54d00d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:41.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.063+0000 7f54cffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d00cf100 con 0x7f54d00b3230 2023-10-07T08:43:41.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.063+0000 7f54cffff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d016aa40 con 0x7f54d0159c90 2023-10-07T08:43:41.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.063+0000 7f54cffff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d00ca870 con 0x7f54d00686e0 2023-10-07T08:43:41.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.063+0000 7f54c67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54d00b3230 0x7f54d00ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:41.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.063+0000 7f54c67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54d00b3230 0x7f54d00ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45258/0 (socket says 172.21.15.81:45258) 2023-10-07T08:43:41.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.063+0000 7f54c67fc700 1 -- 172.21.15.81:0/564282044 learned_addr learned my addr 172.21.15.81:0/564282044 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:41.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.063+0000 7f54ceffd700 1 --2- 172.21.15.81:0/564282044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54d00686e0 0x7f54d016a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:41.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.063+0000 7f54cf7fe700 1 --2- 172.21.15.81:0/564282044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54d0159c90 0x7f54d00d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:41.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.064+0000 7f54c67fc700 1 -- 172.21.15.81:0/564282044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54d00686e0 msgr2=0x7f54d016a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:41.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.064+0000 7f54c67fc700 1 --2- 172.21.15.81:0/564282044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54d00686e0 0x7f54d016a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:41.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.064+0000 7f54c67fc700 1 -- 172.21.15.81:0/564282044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54d0159c90 msgr2=0x7f54d00d0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:41.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.064+0000 7f54c67fc700 1 --2- 172.21.15.81:0/564282044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54d0159c90 0x7f54d00d0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:41.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.064+0000 7f54c67fc700 1 -- 172.21.15.81:0/564282044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c8009a20 con 0x7f54d00b3230 2023-10-07T08:43:41.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.064+0000 7f54c67fc700 1 --2- 172.21.15.81:0/564282044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54d00b3230 0x7f54d00ca330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f54b800c5c0 tx=0x7f54b8007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:41.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.064+0000 7f54c77fe700 1 -- 172.21.15.81:0/564282044 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8005b30 con 0x7f54d00b3230 2023-10-07T08:43:41.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.064+0000 7f54c77fe700 1 -- 172.21.15.81:0/564282044 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b8005c90 con 0x7f54d00b3230 2023-10-07T08:43:41.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.064+0000 7f54cffff700 1 -- 172.21.15.81:0/564282044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d00d15a0 con 0x7f54d00b3230 2023-10-07T08:43:41.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.064+0000 7f54c77fe700 1 -- 172.21.15.81:0/564282044 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8007320 con 0x7f54d00b3230 2023-10-07T08:43:41.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.064+0000 7f54cffff700 1 -- 172.21.15.81:0/564282044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d00ceab0 con 0x7f54d00b3230 2023-10-07T08:43:41.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.065+0000 7f54cffff700 1 -- 172.21.15.81:0/564282044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d00cf2b0 con 0x7f54d00b3230 2023-10-07T08:43:41.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.065+0000 7f54c77fe700 1 -- 172.21.15.81:0/564282044 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54b801b3b0 con 0x7f54d00b3230 2023-10-07T08:43:41.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.065+0000 7f54c77fe700 1 --2- 172.21.15.81:0/564282044 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54b0066f30 0x7f54b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:41.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.066+0000 7f54c77fe700 1 -- 172.21.15.81:0/564282044 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f54b8083480 con 0x7f54d00b3230 2023-10-07T08:43:41.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.066+0000 7f54ceffd700 1 --2- 172.21.15.81:0/564282044 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54b0066f30 0x7f54b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:41.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.066+0000 7f54ceffd700 1 --2- 172.21.15.81:0/564282044 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54b0066f30 0x7f54b00693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f54c0003a80 tx=0x7f54c0007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:41.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.070+0000 7f54c77fe700 1 -- 172.21.15.81:0/564282044 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54d00cf2b0 con 0x7f54d00b3230 2023-10-07T08:43:41.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.254+0000 7f54cffff700 1 -- 172.21.15.81:0/564282044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f54d015e830 con 0x7f54d00b3230 2023-10-07T08:43:41.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.254+0000 7f54c77fe700 1 -- 172.21.15.81:0/564282044 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7f54d015e830 con 0x7f54d00b3230 2023-10-07T08:43:41.256 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:41.256 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-07T08:43:41.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:41.256 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-07T08:43:41.256 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-07T08:43:41.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:41.256 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-07T08:43:41.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.256+0000 7f54cffff700 1 -- 172.21.15.81:0/564282044 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54b0066f30 msgr2=0x7f54b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:41.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.256+0000 7f54cffff700 1 --2- 172.21.15.81:0/564282044 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54b0066f30 0x7f54b00693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f54c0003a80 tx=0x7f54c0007ec0 comp rx=0 tx=0).stop 2023-10-07T08:43:41.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.256+0000 7f54cffff700 1 -- 172.21.15.81:0/564282044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54d00b3230 msgr2=0x7f54d00ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:41.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.256+0000 7f54cffff700 1 --2- 172.21.15.81:0/564282044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54d00b3230 0x7f54d00ca330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f54b800c5c0 tx=0x7f54b8007c70 comp rx=0 tx=0).stop 2023-10-07T08:43:41.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.256+0000 7f54cffff700 1 -- 172.21.15.81:0/564282044 shutdown_connections 2023-10-07T08:43:41.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.256+0000 7f54cffff700 1 --2- 172.21.15.81:0/564282044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54d0159c90 0x7f54d00d0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:41.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.256+0000 7f54cffff700 1 --2- 172.21.15.81:0/564282044 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54b0066f30 0x7f54b00693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:41.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.256+0000 7f54cffff700 1 --2- 172.21.15.81:0/564282044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54d00686e0 0x7f54d016a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:41.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.256+0000 7f54cffff700 1 --2- 172.21.15.81:0/564282044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54d00b3230 0x7f54d00ca330 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:41.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.256+0000 7f54cffff700 1 -- 172.21.15.81:0/564282044 >> 172.21.15.81:0/564282044 conn(0x7f54d006bb90 msgr2=0x7f54d00cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:41.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.256+0000 7f54cffff700 1 -- 172.21.15.81:0/564282044 shutdown_connections 2023-10-07T08:43:41.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.257+0000 7f54cffff700 1 -- 172.21.15.81:0/564282044 wait complete. 2023-10-07T08:43:41.269 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T08:43:41.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T08:43:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.386+0000 7fd3c7094700 1 Processor -- start 2023-10-07T08:43:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.386+0000 7fd3c7094700 1 -- start start 2023-10-07T08:43:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.387+0000 7fd3c7094700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd3c00d0f50 0x7fd3c006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.387+0000 7fd3c7094700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c006d990 con 0x7fd3c006d530 2023-10-07T08:43:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.387+0000 7fd3c7094700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c00cf2d0 con 0x7fd3c00d0b80 2023-10-07T08:43:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.387+0000 7fd3c7094700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c015a690 con 0x7fd3c00d0f50 2023-10-07T08:43:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.387+0000 7fd3c6893700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd3c006d530 0x7fd3c015b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49790/0 (socket says 172.21.15.81:49790) 2023-10-07T08:43:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.387+0000 7fd3c6893700 1 -- 172.21.15.81:0/1475333257 learned_addr learned my addr 172.21.15.81:0/1475333257 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.387+0000 7fd3c5891700 1 --2- 172.21.15.81:0/1475333257 >> v2:172.21.15.89:3300/0 conn(0x7fd3c00d0f50 0x7fd3c006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.387+0000 7fd3c5090700 1 -- 172.21.15.81:0/1475333257 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795902669 0 0) 0x7fd3c006d990 con 0x7fd3c006d530 2023-10-07T08:43:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.387+0000 7fd3c5090700 1 -- 172.21.15.81:0/1475333257 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3a8003570 con 0x7fd3c006d530 2023-10-07T08:43:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.387+0000 7fd3c5090700 1 -- 172.21.15.81:0/1475333257 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2027359734 0 0) 0x7fd3a8003570 con 0x7fd3c006d530 2023-10-07T08:43:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.387+0000 7fd3c5090700 1 -- 172.21.15.81:0/1475333257 >> v2:172.21.15.89:3300/0 conn(0x7fd3c00d0f50 msgr2=0x7fd3c006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.387+0000 7fd3c5090700 1 --2- 172.21.15.81:0/1475333257 >> v2:172.21.15.89:3300/0 conn(0x7fd3c00d0f50 0x7fd3c006cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.387+0000 7fd3c5090700 1 -- 172.21.15.81:0/1475333257 >> v1:172.21.15.89:6789/0 conn(0x7fd3c00d0b80 legacy=0x7fd3c00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.387+0000 7fd3c5090700 1 -- 172.21.15.81:0/1475333257 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c00d0480 con 0x7fd3c006d530 2023-10-07T08:43:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.387+0000 7fd3c5090700 1 -- 172.21.15.81:0/1475333257 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fd3b0001470 con 0x7fd3c006d530 2023-10-07T08:43:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.387+0000 7fd3c5090700 1 -- 172.21.15.81:0/1475333257 >> v1:172.21.15.81:6789/0 conn(0x7fd3c006d530 legacy=0x7fd3c015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c5090700 1 --2- 172.21.15.81:0/1475333257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3a8003a60 0x7fd3a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c5090700 1 --2- 172.21.15.81:0/1475333257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3a8004810 0x7fd3a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c5090700 1 --2- 172.21.15.81:0/1475333257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3a80051c0 0x7fd3a800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c5090700 1 -- 172.21.15.81:0/1475333257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c015a690 con 0x7fd3a8003a60 2023-10-07T08:43:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c5090700 1 -- 172.21.15.81:0/1475333257 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a800c0d0 con 0x7fd3a80051c0 2023-10-07T08:43:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c5090700 1 -- 172.21.15.81:0/1475333257 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a800c290 con 0x7fd3a8004810 2023-10-07T08:43:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c6092700 1 --2- 172.21.15.81:0/1475333257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3a8003a60 0x7fd3a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c5891700 1 --2- 172.21.15.81:0/1475333257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3a8004810 0x7fd3a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c6893700 1 --2- 172.21.15.81:0/1475333257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3a80051c0 0x7fd3a800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c6092700 1 -- 172.21.15.81:0/1475333257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3a8004810 msgr2=0x7fd3a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c6092700 1 --2- 172.21.15.81:0/1475333257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3a8004810 0x7fd3a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c6092700 1 -- 172.21.15.81:0/1475333257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3a80051c0 msgr2=0x7fd3a800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c6092700 1 --2- 172.21.15.81:0/1475333257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3a80051c0 0x7fd3a800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c6092700 1 -- 172.21.15.81:0/1475333257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a8003570 con 0x7fd3a8003a60 2023-10-07T08:43:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c6893700 1 -- 172.21.15.81:0/1475333257 reap_dead start 2023-10-07T08:43:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c5891700 1 --2- 172.21.15.81:0/1475333257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3a8004810 0x7fd3a8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c6092700 1 --2- 172.21.15.81:0/1475333257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3a8003a60 0x7fd3a8003e70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8001fc0 tx=0x7fd3b8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d016709fa3bdac server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c5090700 1 -- 172.21.15.81:0/1475333257 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8001950 con 0x7fd3a8003a60 2023-10-07T08:43:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c5090700 1 -- 172.21.15.81:0/1475333257 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b800c8b0 con 0x7fd3a8003a60 2023-10-07T08:43:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.388+0000 7fd3c5090700 1 -- 172.21.15.81:0/1475333257 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b800cc50 con 0x7fd3a8003a60 2023-10-07T08:43:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.389+0000 7fd3c7094700 1 -- 172.21.15.81:0/1475333257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3a8003a60 msgr2=0x7fd3a8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.389+0000 7fd3c7094700 1 --2- 172.21.15.81:0/1475333257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3a8003a60 0x7fd3a8003e70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8001fc0 tx=0x7fd3b8001640 comp rx=0 tx=0).stop 2023-10-07T08:43:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.389+0000 7fd3c7094700 1 -- 172.21.15.81:0/1475333257 shutdown_connections 2023-10-07T08:43:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.389+0000 7fd3c7094700 1 --2- 172.21.15.81:0/1475333257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3a8003a60 0x7fd3a8003e70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.389+0000 7fd3c7094700 1 -- 172.21.15.81:0/1475333257 >> 172.21.15.81:0/1475333257 conn(0x7fd3c0063230 msgr2=0x7fd3c0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.389+0000 7fd3c7094700 1 -- 172.21.15.81:0/1475333257 shutdown_connections 2023-10-07T08:43:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.389+0000 7fd3c7094700 1 -- 172.21.15.81:0/1475333257 wait complete. 2023-10-07T08:43:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.390+0000 7fd3c7094700 1 Processor -- start 2023-10-07T08:43:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.390+0000 7fd3c7094700 1 -- start start 2023-10-07T08:43:41.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.390+0000 7fd3c7094700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3a8003a60 0x7fd3c014e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:41.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.390+0000 7fd3c7094700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3c0150c30 0x7fd3c01510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:41.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.390+0000 7fd3c7094700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c00b4d70 0x7fd3c00b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:41.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3c7094700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00b4260 con 0x7fd3c00b4d70 2023-10-07T08:43:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3c7094700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c01515e0 con 0x7fd3a8003a60 2023-10-07T08:43:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3c7094700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c0152d70 con 0x7fd3c0150c30 2023-10-07T08:43:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3c6893700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c00b4d70 0x7fd3c00b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3c6893700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c00b4d70 0x7fd3c00b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45290/0 (socket says 172.21.15.81:45290) 2023-10-07T08:43:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3c6893700 1 -- 172.21.15.81:0/2138649236 learned_addr learned my addr 172.21.15.81:0/2138649236 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3c6092700 1 --2- 172.21.15.81:0/2138649236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3a8003a60 0x7fd3c014e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3c5891700 1 --2- 172.21.15.81:0/2138649236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3c0150c30 0x7fd3c01510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3c6893700 1 -- 172.21.15.81:0/2138649236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3c0150c30 msgr2=0x7fd3c01510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3c6893700 1 --2- 172.21.15.81:0/2138649236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3c0150c30 0x7fd3c01510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3c6893700 1 -- 172.21.15.81:0/2138649236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3a8003a60 msgr2=0x7fd3c014e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3c6893700 1 --2- 172.21.15.81:0/2138649236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3a8003a60 0x7fd3c014e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3c6893700 1 -- 172.21.15.81:0/2138649236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c00b5750 con 0x7fd3c00b4d70 2023-10-07T08:43:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3c6893700 1 --2- 172.21.15.81:0/2138649236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c00b4d70 0x7fd3c00b5210 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00cec90 tx=0x7fd3c00cf460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3be7fc700 1 -- 172.21.15.81:0/2138649236 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b000c7b0 con 0x7fd3c00b4d70 2023-10-07T08:43:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3be7fc700 1 -- 172.21.15.81:0/2138649236 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b000c950 con 0x7fd3c00b4d70 2023-10-07T08:43:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3be7fc700 1 -- 172.21.15.81:0/2138649236 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b000cd10 con 0x7fd3c00b4d70 2023-10-07T08:43:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3c7094700 1 -- 172.21.15.81:0/2138649236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c00b59e0 con 0x7fd3c00b4d70 2023-10-07T08:43:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.391+0000 7fd3c7094700 1 -- 172.21.15.81:0/2138649236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c00b5fa0 con 0x7fd3c00b4d70 2023-10-07T08:43:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.392+0000 7fd3c7094700 1 -- 172.21.15.81:0/2138649236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c0152f20 con 0x7fd3c00b4d70 2023-10-07T08:43:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.392+0000 7fd3be7fc700 1 -- 172.21.15.81:0/2138649236 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd3b0014690 con 0x7fd3c00b4d70 2023-10-07T08:43:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.393+0000 7fd3be7fc700 1 --2- 172.21.15.81:0/2138649236 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd3ac066f30 0x7fd3ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.393+0000 7fd3be7fc700 1 -- 172.21.15.81:0/2138649236 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd3b0083c90 con 0x7fd3c00b4d70 2023-10-07T08:43:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.393+0000 7fd3c6092700 1 --2- 172.21.15.81:0/2138649236 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd3ac066f30 0x7fd3ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.393+0000 7fd3c6092700 1 --2- 172.21.15.81:0/2138649236 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd3ac066f30 0x7fd3ac0693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8001da0 tx=0x7fd3b8015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:41.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.397+0000 7fd3be7fc700 1 -- 172.21.15.81:0/2138649236 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3b004d5a0 con 0x7fd3c00b4d70 2023-10-07T08:43:41.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:41.577+0000 7fd3c7094700 1 -- 172.21.15.81:0/2138649236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd3c00676e0 con 0x7fd3c00b4d70 2023-10-07T08:43:42.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.240+0000 7fd3be7fc700 1 -- 172.21.15.81:0/2138649236 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd3b0019020 con 0x7fd3c00b4d70 2023-10-07T08:43:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.243+0000 7fd3c7094700 1 -- 172.21.15.81:0/2138649236 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd3ac066f30 msgr2=0x7fd3ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.243+0000 7fd3c7094700 1 --2- 172.21.15.81:0/2138649236 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd3ac066f30 0x7fd3ac0693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8001da0 tx=0x7fd3b8015000 comp rx=0 tx=0).stop 2023-10-07T08:43:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.243+0000 7fd3c7094700 1 -- 172.21.15.81:0/2138649236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c00b4d70 msgr2=0x7fd3c00b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.243+0000 7fd3c7094700 1 --2- 172.21.15.81:0/2138649236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c00b4d70 0x7fd3c00b5210 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00cec90 tx=0x7fd3c00cf460 comp rx=0 tx=0).stop 2023-10-07T08:43:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.243+0000 7fd3c7094700 1 -- 172.21.15.81:0/2138649236 shutdown_connections 2023-10-07T08:43:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.243+0000 7fd3c7094700 1 --2- 172.21.15.81:0/2138649236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c00b4d70 0x7fd3c00b5210 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.243+0000 7fd3c7094700 1 --2- 172.21.15.81:0/2138649236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3a8003a60 0x7fd3c014e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.243+0000 7fd3c7094700 1 --2- 172.21.15.81:0/2138649236 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd3ac066f30 0x7fd3ac0693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.243+0000 7fd3c7094700 1 --2- 172.21.15.81:0/2138649236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3c0150c30 0x7fd3c01510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.243+0000 7fd3c7094700 1 -- 172.21.15.81:0/2138649236 >> 172.21.15.81:0/2138649236 conn(0x7fd3c0063230 msgr2=0x7fd3c015ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.243+0000 7fd3c7094700 1 -- 172.21.15.81:0/2138649236 shutdown_connections 2023-10-07T08:43:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.243+0000 7fd3c7094700 1 -- 172.21.15.81:0/2138649236 wait complete. 2023-10-07T08:43:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-07T08:43:42.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T08:43:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.376+0000 7f6dbb2c9700 1 Processor -- start 2023-10-07T08:43:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.377+0000 7f6dbb2c9700 1 -- start start 2023-10-07T08:43:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.377+0000 7f6dbb2c9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6db40b1ef0 0x7f6db406da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.378+0000 7f6dbb2c9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6db40b29d0 0x7f6db4163bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.378+0000 7f6dbb2c9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db4068d40 con 0x7f6db406f4f0 2023-10-07T08:43:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.378+0000 7f6dbb2c9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db415a520 con 0x7f6db40b29d0 2023-10-07T08:43:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.378+0000 7f6dbb2c9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db406a1e0 con 0x7f6db40b1ef0 2023-10-07T08:43:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.378+0000 7f6dbaac8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6db40b29d0 0x7f6db4163bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.378+0000 7f6dba2c7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6db40b1ef0 0x7f6db406da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.378+0000 7f6db9ac6700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6db406f4f0 0x7f6db40b22c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:34872/0 (socket says 172.21.15.81:34872) 2023-10-07T08:43:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.378+0000 7f6db9ac6700 1 -- 172.21.15.81:0/2879766715 learned_addr learned my addr 172.21.15.81:0/2879766715 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.378+0000 7f6db92c5700 1 -- 172.21.15.81:0/2879766715 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574772380 0 0) 0x7f6db4068d40 con 0x7f6db406f4f0 2023-10-07T08:43:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.378+0000 7f6db92c5700 1 -- 172.21.15.81:0/2879766715 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da0003570 con 0x7f6db406f4f0 2023-10-07T08:43:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.378+0000 7f6dba2c7700 1 -- 172.21.15.81:0/2879766715 >> v2:172.21.15.89:3300/0 conn(0x7f6db40b29d0 msgr2=0x7f6db4163bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.378+0000 7f6dba2c7700 1 --2- 172.21.15.81:0/2879766715 >> v2:172.21.15.89:3300/0 conn(0x7f6db40b29d0 0x7f6db4163bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.378+0000 7f6dba2c7700 1 -- 172.21.15.81:0/2879766715 >> v1:172.21.15.89:6789/0 conn(0x7f6db406f4f0 legacy=0x7f6db40b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.378+0000 7f6dba2c7700 1 -- 172.21.15.81:0/2879766715 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db406e2d0 con 0x7f6db40b1ef0 2023-10-07T08:43:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.378+0000 7f6dbaac8700 1 --2- 172.21.15.81:0/2879766715 >> v2:172.21.15.89:3300/0 conn(0x7f6db40b29d0 0x7f6db4163bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.378+0000 7f6dba2c7700 1 --2- 172.21.15.81:0/2879766715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6db40b1ef0 0x7f6db406da20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6db00098e0 tx=0x7f6db00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa5481f9faf33c2c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.379+0000 7f6db92c5700 1 -- 172.21.15.81:0/2879766715 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0011630 con 0x7f6db40b1ef0 2023-10-07T08:43:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.379+0000 7f6db92c5700 1 -- 172.21.15.81:0/2879766715 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db0011790 con 0x7f6db40b1ef0 2023-10-07T08:43:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.379+0000 7f6db92c5700 1 -- 172.21.15.81:0/2879766715 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0011b10 con 0x7f6db40b1ef0 2023-10-07T08:43:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.379+0000 7f6dbb2c9700 1 -- 172.21.15.81:0/2879766715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6db40b1ef0 msgr2=0x7f6db406da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.379+0000 7f6dbb2c9700 1 --2- 172.21.15.81:0/2879766715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6db40b1ef0 0x7f6db406da20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6db00098e0 tx=0x7f6db00091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.379+0000 7f6dbb2c9700 1 -- 172.21.15.81:0/2879766715 shutdown_connections 2023-10-07T08:43:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.379+0000 7f6dbb2c9700 1 --2- 172.21.15.81:0/2879766715 >> v2:172.21.15.89:3300/0 conn(0x7f6db40b29d0 0x7f6db4163bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.379+0000 7f6dbb2c9700 1 --2- 172.21.15.81:0/2879766715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6db40b1ef0 0x7f6db406da20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.379+0000 7f6dbb2c9700 1 -- 172.21.15.81:0/2879766715 >> 172.21.15.81:0/2879766715 conn(0x7f6db40d0bb0 msgr2=0x7f6db40d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:42.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.379+0000 7f6dbb2c9700 1 -- 172.21.15.81:0/2879766715 shutdown_connections 2023-10-07T08:43:42.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.379+0000 7f6dbb2c9700 1 -- 172.21.15.81:0/2879766715 wait complete. 2023-10-07T08:43:42.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.380+0000 7f6dbb2c9700 1 Processor -- start 2023-10-07T08:43:42.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.380+0000 7f6dbb2c9700 1 -- start start 2023-10-07T08:43:42.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.381+0000 7f6dbb2c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db406f4f0 0x7f6db414d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:42.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.381+0000 7f6dbb2c9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6db40b1ef0 0x7f6db4150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:42.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.381+0000 7f6dbb2c9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6db40b29d0 0x7f6db41591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:42.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.381+0000 7f6dbb2c9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4157770 con 0x7f6db406f4f0 2023-10-07T08:43:42.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.381+0000 7f6dbb2c9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db415afc0 con 0x7f6db40b1ef0 2023-10-07T08:43:42.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.381+0000 7f6dbb2c9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db415b2a0 con 0x7f6db40b29d0 2023-10-07T08:43:42.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.381+0000 7f6dba2c7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db406f4f0 0x7f6db414d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:42.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.381+0000 7f6dba2c7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db406f4f0 0x7f6db414d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33898/0 (socket says 172.21.15.81:33898) 2023-10-07T08:43:42.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.381+0000 7f6dba2c7700 1 -- 172.21.15.81:0/429555994 learned_addr learned my addr 172.21.15.81:0/429555994 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:42.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.381+0000 7f6db9ac6700 1 --2- 172.21.15.81:0/429555994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6db40b1ef0 0x7f6db4150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:42.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.381+0000 7f6dbaac8700 1 --2- 172.21.15.81:0/429555994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6db40b29d0 0x7f6db41591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:42.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.381+0000 7f6dba2c7700 1 -- 172.21.15.81:0/429555994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6db40b29d0 msgr2=0x7f6db41591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:42.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.381+0000 7f6dba2c7700 1 --2- 172.21.15.81:0/429555994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6db40b29d0 0x7f6db41591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.382+0000 7f6dba2c7700 1 -- 172.21.15.81:0/429555994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6db40b1ef0 msgr2=0x7f6db4150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.382+0000 7f6dba2c7700 1 --2- 172.21.15.81:0/429555994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6db40b1ef0 0x7f6db4150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.382+0000 7f6dba2c7700 1 -- 172.21.15.81:0/429555994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac009a20 con 0x7f6db406f4f0 2023-10-07T08:43:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.382+0000 7f6dba2c7700 1 --2- 172.21.15.81:0/429555994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db406f4f0 0x7f6db414d820 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6db415a660 tx=0x7f6db0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.382+0000 7f6daa7fc700 1 -- 172.21.15.81:0/429555994 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0011b10 con 0x7f6db406f4f0 2023-10-07T08:43:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.382+0000 7f6daa7fc700 1 -- 172.21.15.81:0/429555994 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db001a430 con 0x7f6db406f4f0 2023-10-07T08:43:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.382+0000 7f6daa7fc700 1 -- 172.21.15.81:0/429555994 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db001a7f0 con 0x7f6db406f4f0 2023-10-07T08:43:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.382+0000 7f6dbb2c9700 1 -- 172.21.15.81:0/429555994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db0009420 con 0x7f6db406f4f0 2023-10-07T08:43:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.382+0000 7f6dbb2c9700 1 -- 172.21.15.81:0/429555994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db4157400 con 0x7f6db406f4f0 2023-10-07T08:43:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.383+0000 7f6dbb2c9700 1 -- 172.21.15.81:0/429555994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db4067b70 con 0x7f6db406f4f0 2023-10-07T08:43:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.383+0000 7f6daa7fc700 1 -- 172.21.15.81:0/429555994 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6db001aba0 con 0x7f6db406f4f0 2023-10-07T08:43:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.384+0000 7f6daa7fc700 1 --2- 172.21.15.81:0/429555994 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6d98066f30 0x7f6d980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.384+0000 7f6daa7fc700 1 -- 172.21.15.81:0/429555994 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f6db0086090 con 0x7f6db406f4f0 2023-10-07T08:43:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.384+0000 7f6db9ac6700 1 --2- 172.21.15.81:0/429555994 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6d98066f30 0x7f6d980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.384+0000 7f6db9ac6700 1 --2- 172.21.15.81:0/429555994 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6d98066f30 0x7f6d980693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6db416da30 tx=0x7f6da4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.388+0000 7f6daa7fc700 1 -- 172.21.15.81:0/429555994 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6db00534e0 con 0x7f6db406f4f0 2023-10-07T08:43:42.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:42.572+0000 7f6dbb2c9700 1 -- 172.21.15.81:0/429555994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6db4071b10 con 0x7f6db406f4f0 2023-10-07T08:43:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.242+0000 7f6daa7fc700 1 -- 172.21.15.81:0/429555994 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6db0056b00 con 0x7f6db406f4f0 2023-10-07T08:43:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.249+0000 7f6dbb2c9700 1 -- 172.21.15.81:0/429555994 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6d98066f30 msgr2=0x7f6d980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.249+0000 7f6dbb2c9700 1 --2- 172.21.15.81:0/429555994 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6d98066f30 0x7f6d980693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6db416da30 tx=0x7f6da4009040 comp rx=0 tx=0).stop 2023-10-07T08:43:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.249+0000 7f6dbb2c9700 1 -- 172.21.15.81:0/429555994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db406f4f0 msgr2=0x7f6db414d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.249+0000 7f6dbb2c9700 1 --2- 172.21.15.81:0/429555994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db406f4f0 0x7f6db414d820 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6db415a660 tx=0x7f6db0017000 comp rx=0 tx=0).stop 2023-10-07T08:43:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.249+0000 7f6dbb2c9700 1 -- 172.21.15.81:0/429555994 shutdown_connections 2023-10-07T08:43:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.249+0000 7f6dbb2c9700 1 --2- 172.21.15.81:0/429555994 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6d98066f30 0x7f6d980693e0 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6db416da30 tx=0x7f6da4009040 comp rx=0 tx=0).stop 2023-10-07T08:43:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.249+0000 7f6dbb2c9700 1 --2- 172.21.15.81:0/429555994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6db40b29d0 0x7f6db41591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.249+0000 7f6dbb2c9700 1 --2- 172.21.15.81:0/429555994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db406f4f0 0x7f6db414d820 secure :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6db415a660 tx=0x7f6db0017000 comp rx=0 tx=0).stop 2023-10-07T08:43:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.249+0000 7f6dbb2c9700 1 --2- 172.21.15.81:0/429555994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6db40b1ef0 0x7f6db4150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.249+0000 7f6dbb2c9700 1 -- 172.21.15.81:0/429555994 >> 172.21.15.81:0/429555994 conn(0x7f6db40d0bb0 msgr2=0x7f6db41605e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.250+0000 7f6dbb2c9700 1 -- 172.21.15.81:0/429555994 shutdown_connections 2023-10-07T08:43:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.250+0000 7f6dbb2c9700 1 -- 172.21.15.81:0/429555994 wait complete. 2023-10-07T08:43:43.254 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-07T08:43:43.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T08:43:43.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.382+0000 7f753d5bb700 1 Processor -- start 2023-10-07T08:43:43.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.382+0000 7f753d5bb700 1 -- start start 2023-10-07T08:43:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.383+0000 7f753d5bb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f75380d0b80 0x7f75380cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.383+0000 7f753d5bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f753806d700 0x7f753815b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.383+0000 7f753d5bb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75380cf2d0 con 0x7f75380d02b0 2023-10-07T08:43:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.383+0000 7f753d5bb700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f753815a690 con 0x7f75380d0b80 2023-10-07T08:43:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.383+0000 7f753d5bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753806dc00 con 0x7f753806d700 2023-10-07T08:43:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.383+0000 7f7537fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f75380d0b80 0x7f75380cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.383+0000 7f7537fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f75380d0b80 0x7f75380cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33904/0 (socket says 172.21.15.81:33904) 2023-10-07T08:43:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.383+0000 7f7537fff700 1 -- 172.21.15.81:0/2382681866 learned_addr learned my addr 172.21.15.81:0/2382681866 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.383+0000 7f753cdba700 1 --2- 172.21.15.81:0/2382681866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f753806d700 0x7f753815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.383+0000 7f7537fff700 1 -- 172.21.15.81:0/2382681866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f753806d700 msgr2=0x7f753815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.383+0000 7f7537fff700 1 --2- 172.21.15.81:0/2382681866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f753806d700 0x7f753815b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:43.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.383+0000 7f7537fff700 1 -- 172.21.15.81:0/2382681866 >> v1:172.21.15.89:6789/0 conn(0x7f75380d02b0 legacy=0x7f753806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:43.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.383+0000 7f7537fff700 1 -- 172.21.15.81:0/2382681866 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75380cf570 con 0x7f75380d0b80 2023-10-07T08:43:43.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.383+0000 7f753cdba700 1 --2- 172.21.15.81:0/2382681866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f753806d700 0x7f753815b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:43.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.384+0000 7f7537fff700 1 --2- 172.21.15.81:0/2382681866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75380d0b80 0x7f75380cfd70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f75280099b0 tx=0x7f7528009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1170f1d5d666bd67 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:43.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.384+0000 7f7536ffd700 1 -- 172.21.15.81:0/2382681866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752800b820 con 0x7f75380d0b80 2023-10-07T08:43:43.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.384+0000 7f7536ffd700 1 -- 172.21.15.81:0/2382681866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752800b980 con 0x7f75380d0b80 2023-10-07T08:43:43.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.384+0000 7f7536ffd700 1 -- 172.21.15.81:0/2382681866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752800bd20 con 0x7f75380d0b80 2023-10-07T08:43:43.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.384+0000 7f753d5bb700 1 -- 172.21.15.81:0/2382681866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75380d0b80 msgr2=0x7f75380cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:43.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.384+0000 7f753d5bb700 1 --2- 172.21.15.81:0/2382681866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75380d0b80 0x7f75380cfd70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f75280099b0 tx=0x7f7528009250 comp rx=0 tx=0).stop 2023-10-07T08:43:43.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.384+0000 7f753d5bb700 1 -- 172.21.15.81:0/2382681866 shutdown_connections 2023-10-07T08:43:43.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.384+0000 7f753d5bb700 1 --2- 172.21.15.81:0/2382681866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f753806d700 0x7f753815b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:43.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.384+0000 7f753d5bb700 1 --2- 172.21.15.81:0/2382681866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75380d0b80 0x7f75380cfd70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:43.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.384+0000 7f753d5bb700 1 -- 172.21.15.81:0/2382681866 >> 172.21.15.81:0/2382681866 conn(0x7f7538063230 msgr2=0x7f7538063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:43.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.384+0000 7f753d5bb700 1 -- 172.21.15.81:0/2382681866 shutdown_connections 2023-10-07T08:43:43.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.384+0000 7f753d5bb700 1 -- 172.21.15.81:0/2382681866 wait complete. 2023-10-07T08:43:43.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.385+0000 7f753d5bb700 1 Processor -- start 2023-10-07T08:43:43.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.386+0000 7f753d5bb700 1 -- start start 2023-10-07T08:43:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.386+0000 7f753d5bb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f753806d700 0x7f753814e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.386+0000 7f753d5bb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75380d02b0 0x7f75381520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.386+0000 7f753d5bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75380d0b80 0x7f753816daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.386+0000 7f753d5bb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75381505c0 con 0x7f75380d02b0 2023-10-07T08:43:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.386+0000 7f753d5bb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7538152600 con 0x7f753806d700 2023-10-07T08:43:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.386+0000 7f753d5bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7538151a80 con 0x7f75380d0b80 2023-10-07T08:43:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.386+0000 7f75377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75380d02b0 0x7f75381520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.386+0000 7f75377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75380d02b0 0x7f75381520c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33908/0 (socket says 172.21.15.81:33908) 2023-10-07T08:43:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.386+0000 7f75377fe700 1 -- 172.21.15.81:0/3775181187 learned_addr learned my addr 172.21.15.81:0/3775181187 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.387+0000 7f753cdba700 1 --2- 172.21.15.81:0/3775181187 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75380d0b80 0x7f753816daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.387+0000 7f7537fff700 1 --2- 172.21.15.81:0/3775181187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f753806d700 0x7f753814e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.387+0000 7f75377fe700 1 -- 172.21.15.81:0/3775181187 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75380d0b80 msgr2=0x7f753816daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.387+0000 7f75377fe700 1 --2- 172.21.15.81:0/3775181187 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75380d0b80 0x7f753816daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.387+0000 7f75377fe700 1 -- 172.21.15.81:0/3775181187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f753806d700 msgr2=0x7f753814e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.387+0000 7f75377fe700 1 --2- 172.21.15.81:0/3775181187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f753806d700 0x7f753814e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.387+0000 7f75377fe700 1 -- 172.21.15.81:0/3775181187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75280094f0 con 0x7f75380d02b0 2023-10-07T08:43:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.387+0000 7f75377fe700 1 --2- 172.21.15.81:0/3775181187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75380d02b0 0x7f75381520c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f752c00c5d0 tx=0x7f752c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.387+0000 7f751ffff700 1 -- 172.21.15.81:0/3775181187 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c011590 con 0x7f75380d02b0 2023-10-07T08:43:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.387+0000 7f751ffff700 1 -- 172.21.15.81:0/3775181187 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c011710 con 0x7f75380d02b0 2023-10-07T08:43:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.387+0000 7f753d5bb700 1 -- 172.21.15.81:0/3775181187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753814fc90 con 0x7f75380d02b0 2023-10-07T08:43:43.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.387+0000 7f751ffff700 1 -- 172.21.15.81:0/3775181187 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c011ad0 con 0x7f75380d02b0 2023-10-07T08:43:43.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.387+0000 7f753d5bb700 1 -- 172.21.15.81:0/3775181187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7538150250 con 0x7f75380d02b0 2023-10-07T08:43:43.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.388+0000 7f753d5bb700 1 -- 172.21.15.81:0/3775181187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7538150770 con 0x7f75380d02b0 2023-10-07T08:43:43.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.389+0000 7f751ffff700 1 -- 172.21.15.81:0/3775181187 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f752c01c460 con 0x7f75380d02b0 2023-10-07T08:43:43.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.389+0000 7f751ffff700 1 --2- 172.21.15.81:0/3775181187 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7524066f60 0x7f7524069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:43.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.389+0000 7f7537fff700 1 --2- 172.21.15.81:0/3775181187 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7524066f60 0x7f7524069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:43.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.389+0000 7f751ffff700 1 -- 172.21.15.81:0/3775181187 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f752c084250 con 0x7f75380d02b0 2023-10-07T08:43:43.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.389+0000 7f7537fff700 1 --2- 172.21.15.81:0/3775181187 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7524066f60 0x7f7524069410 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f75280099b0 tx=0x7f7528016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.393+0000 7f751ffff700 1 -- 172.21.15.81:0/3775181187 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7538150770 con 0x7f75380d02b0 2023-10-07T08:43:43.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:43.619+0000 7f753d5bb700 1 -- 172.21.15.81:0/3775181187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f75380676e0 con 0x7f75380d02b0 2023-10-07T08:43:44.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.269+0000 7f751ffff700 1 -- 172.21.15.81:0/3775181187 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f752c05a020 con 0x7f75380d02b0 2023-10-07T08:43:44.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.273+0000 7f753d5bb700 1 -- 172.21.15.81:0/3775181187 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7524066f60 msgr2=0x7f7524069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:44.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.273+0000 7f753d5bb700 1 --2- 172.21.15.81:0/3775181187 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7524066f60 0x7f7524069410 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f75280099b0 tx=0x7f7528016000 comp rx=0 tx=0).stop 2023-10-07T08:43:44.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.273+0000 7f753d5bb700 1 -- 172.21.15.81:0/3775181187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75380d02b0 msgr2=0x7f75381520c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:44.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.273+0000 7f753d5bb700 1 --2- 172.21.15.81:0/3775181187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75380d02b0 0x7f75381520c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f752c00c5d0 tx=0x7f752c007f60 comp rx=0 tx=0).stop 2023-10-07T08:43:44.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.274+0000 7f753d5bb700 1 -- 172.21.15.81:0/3775181187 shutdown_connections 2023-10-07T08:43:44.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.274+0000 7f753d5bb700 1 --2- 172.21.15.81:0/3775181187 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7524066f60 0x7f7524069410 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.274+0000 7f753d5bb700 1 --2- 172.21.15.81:0/3775181187 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75380d0b80 0x7f753816daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.274+0000 7f753d5bb700 1 --2- 172.21.15.81:0/3775181187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f753806d700 0x7f753814e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.274+0000 7f753d5bb700 1 --2- 172.21.15.81:0/3775181187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75380d02b0 0x7f75381520c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.274+0000 7f753d5bb700 1 -- 172.21.15.81:0/3775181187 >> 172.21.15.81:0/3775181187 conn(0x7f7538063230 msgr2=0x7f7538069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:44.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.276+0000 7f753d5bb700 1 -- 172.21.15.81:0/3775181187 shutdown_connections 2023-10-07T08:43:44.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.276+0000 7f753d5bb700 1 -- 172.21.15.81:0/3775181187 wait complete. 2023-10-07T08:43:44.279 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 4 and data pool 5 2023-10-07T08:43:44.290 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:44.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.404+0000 7fdc1bd10700 1 Processor -- start 2023-10-07T08:43:44.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.404+0000 7fdc1bd10700 1 -- start start 2023-10-07T08:43:44.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.405+0000 7fdc1bd10700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdc14156d60 0x7fdc1406b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:44.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.405+0000 7fdc1bd10700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc140c8880 0x7fdc14157840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:44.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.405+0000 7fdc1bd10700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1406ac50 con 0x7fdc1406ceb0 2023-10-07T08:43:44.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.405+0000 7fdc1bd10700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc1406a400 con 0x7fdc14156d60 2023-10-07T08:43:44.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.405+0000 7fdc1bd10700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140c8fd0 con 0x7fdc140c8880 2023-10-07T08:43:44.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.405+0000 7fdc19aac700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdc14156d60 0x7fdc1406b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.405+0000 7fdc192ab700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdc1406ceb0 0x7fdc14157130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50122/0 (socket says 172.21.15.81:50122) 2023-10-07T08:43:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.405+0000 7fdc192ab700 1 -- 172.21.15.81:0/3559865491 learned_addr learned my addr 172.21.15.81:0/3559865491 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.406+0000 7fdc1a2ad700 1 --2- 172.21.15.81:0/3559865491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc140c8880 0x7fdc14157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.406+0000 7fdc19aac700 1 -- 172.21.15.81:0/3559865491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc140c8880 msgr2=0x7fdc14157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.406+0000 7fdc19aac700 1 --2- 172.21.15.81:0/3559865491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc140c8880 0x7fdc14157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.406+0000 7fdc19aac700 1 -- 172.21.15.81:0/3559865491 >> v1:172.21.15.81:6789/0 conn(0x7fdc1406ceb0 legacy=0x7fdc14157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.406+0000 7fdc18aaa700 1 -- 172.21.15.81:0/3559865491 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493968308 0 0) 0x7fdc1406ac50 con 0x7fdc1406ceb0 2023-10-07T08:43:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.406+0000 7fdc19aac700 1 -- 172.21.15.81:0/3559865491 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc14157d80 con 0x7fdc14156d60 2023-10-07T08:43:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.406+0000 7fdc19aac700 1 --2- 172.21.15.81:0/3559865491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc14156d60 0x7fdc1406b0e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009e60 tx=0x7fdc04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0e61aacc26519 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.406+0000 7fdc18aaa700 1 -- 172.21.15.81:0/3559865491 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0400e070 con 0x7fdc14156d60 2023-10-07T08:43:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.406+0000 7fdc18aaa700 1 -- 172.21.15.81:0/3559865491 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0400bc30 con 0x7fdc14156d60 2023-10-07T08:43:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.406+0000 7fdc18aaa700 1 -- 172.21.15.81:0/3559865491 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04012430 con 0x7fdc14156d60 2023-10-07T08:43:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.406+0000 7fdc1bd10700 1 -- 172.21.15.81:0/3559865491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc14156d60 msgr2=0x7fdc1406b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.406+0000 7fdc1bd10700 1 --2- 172.21.15.81:0/3559865491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc14156d60 0x7fdc1406b0e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009e60 tx=0x7fdc04009780 comp rx=0 tx=0).stop 2023-10-07T08:43:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.406+0000 7fdc1bd10700 1 -- 172.21.15.81:0/3559865491 shutdown_connections 2023-10-07T08:43:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.406+0000 7fdc1bd10700 1 --2- 172.21.15.81:0/3559865491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc14156d60 0x7fdc1406b0e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.406+0000 7fdc1bd10700 1 --2- 172.21.15.81:0/3559865491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc140c8880 0x7fdc14157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.406+0000 7fdc1bd10700 1 -- 172.21.15.81:0/3559865491 >> 172.21.15.81:0/3559865491 conn(0x7fdc140c9ca0 msgr2=0x7fdc140ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.407+0000 7fdc1bd10700 1 -- 172.21.15.81:0/3559865491 shutdown_connections 2023-10-07T08:43:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.407+0000 7fdc1bd10700 1 -- 172.21.15.81:0/3559865491 wait complete. 2023-10-07T08:43:44.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.408+0000 7fdc1bd10700 1 Processor -- start 2023-10-07T08:43:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.408+0000 7fdc1bd10700 1 -- start start 2023-10-07T08:43:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.408+0000 7fdc1bd10700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc1406ceb0 0x7fdc140c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.408+0000 7fdc1bd10700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc140c8880 0x7fdc1406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.408+0000 7fdc1bd10700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc14156d60 0x7fdc1406c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.408+0000 7fdc1bd10700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14168890 con 0x7fdc1406ceb0 2023-10-07T08:43:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.408+0000 7fdc1bd10700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14167a20 con 0x7fdc140c8880 2023-10-07T08:43:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.408+0000 7fdc1bd10700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14167c80 con 0x7fdc14156d60 2023-10-07T08:43:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.408+0000 7fdc19aac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc1406ceb0 0x7fdc140c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.408+0000 7fdc19aac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc1406ceb0 0x7fdc140c3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33926/0 (socket says 172.21.15.81:33926) 2023-10-07T08:43:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.408+0000 7fdc19aac700 1 -- 172.21.15.81:0/2214526363 learned_addr learned my addr 172.21.15.81:0/2214526363 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.409+0000 7fdc19aac700 1 -- 172.21.15.81:0/2214526363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc14156d60 msgr2=0x7fdc1406c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.409+0000 7fdc19aac700 1 --2- 172.21.15.81:0/2214526363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc14156d60 0x7fdc1406c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.409+0000 7fdc19aac700 1 -- 172.21.15.81:0/2214526363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc140c8880 msgr2=0x7fdc1406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.409+0000 7fdc19aac700 1 --2- 172.21.15.81:0/2214526363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc140c8880 0x7fdc1406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.409+0000 7fdc19aac700 1 -- 172.21.15.81:0/2214526363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc04009a20 con 0x7fdc1406ceb0 2023-10-07T08:43:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.409+0000 7fdc19aac700 1 --2- 172.21.15.81:0/2214526363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc1406ceb0 0x7fdc140c3520 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdc1406ebb0 tx=0x7fdc04019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.409+0000 7fdc11ffb700 1 -- 172.21.15.81:0/2214526363 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04027470 con 0x7fdc1406ceb0 2023-10-07T08:43:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.409+0000 7fdc11ffb700 1 -- 172.21.15.81:0/2214526363 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc040275f0 con 0x7fdc1406ceb0 2023-10-07T08:43:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.409+0000 7fdc11ffb700 1 -- 172.21.15.81:0/2214526363 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040279b0 con 0x7fdc1406ceb0 2023-10-07T08:43:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.409+0000 7fdc1bd10700 1 -- 172.21.15.81:0/2214526363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc14167f60 con 0x7fdc1406ceb0 2023-10-07T08:43:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.409+0000 7fdc1bd10700 1 -- 172.21.15.81:0/2214526363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc14168520 con 0x7fdc1406ceb0 2023-10-07T08:43:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.410+0000 7fdc1bd10700 1 -- 172.21.15.81:0/2214526363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc14068080 con 0x7fdc1406ceb0 2023-10-07T08:43:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.410+0000 7fdc11ffb700 1 -- 172.21.15.81:0/2214526363 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc04024070 con 0x7fdc1406ceb0 2023-10-07T08:43:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.411+0000 7fdc11ffb700 1 --2- 172.21.15.81:0/2214526363 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc00066f30 0x7fdc000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.411+0000 7fdc11ffb700 1 -- 172.21.15.81:0/2214526363 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdc04086bf0 con 0x7fdc1406ceb0 2023-10-07T08:43:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.411+0000 7fdc192ab700 1 --2- 172.21.15.81:0/2214526363 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc00066f30 0x7fdc000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.411+0000 7fdc192ab700 1 --2- 172.21.15.81:0/2214526363 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc00066f30 0x7fdc000693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdc080011e0 tx=0x7fdc080079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.415+0000 7fdc11ffb700 1 -- 172.21.15.81:0/2214526363 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc04053e60 con 0x7fdc1406ceb0 2023-10-07T08:43:44.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.600+0000 7fdc1bd10700 1 -- 172.21.15.81:0/2214526363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc140af2f0 con 0x7fdc1406ceb0 2023-10-07T08:43:44.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.601+0000 7fdc11ffb700 1 -- 172.21.15.81:0/2214526363 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15315 (secure 0 0 0) 0x7fdc04057480 con 0x7fdc1406ceb0 2023-10-07T08:43:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:44.602 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:43:43.620595+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:43:41.595379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-07T08:43:42.590185+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:44.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.603+0000 7fdc1bd10700 1 -- 172.21.15.81:0/2214526363 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc00066f30 msgr2=0x7fdc000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.603+0000 7fdc1bd10700 1 --2- 172.21.15.81:0/2214526363 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc00066f30 0x7fdc000693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdc080011e0 tx=0x7fdc080079d0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.603+0000 7fdc1bd10700 1 -- 172.21.15.81:0/2214526363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc1406ceb0 msgr2=0x7fdc140c3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.603+0000 7fdc1bd10700 1 --2- 172.21.15.81:0/2214526363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc1406ceb0 0x7fdc140c3520 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdc1406ebb0 tx=0x7fdc04019000 comp rx=0 tx=0).stop 2023-10-07T08:43:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.603+0000 7fdc1bd10700 1 -- 172.21.15.81:0/2214526363 shutdown_connections 2023-10-07T08:43:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.603+0000 7fdc1bd10700 1 --2- 172.21.15.81:0/2214526363 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc00066f30 0x7fdc000693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.603+0000 7fdc1bd10700 1 --2- 172.21.15.81:0/2214526363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc14156d60 0x7fdc1406c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.603+0000 7fdc1bd10700 1 --2- 172.21.15.81:0/2214526363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc1406ceb0 0x7fdc140c3520 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.603+0000 7fdc1bd10700 1 --2- 172.21.15.81:0/2214526363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc140c8880 0x7fdc1406bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.603+0000 7fdc1bd10700 1 -- 172.21.15.81:0/2214526363 >> 172.21.15.81:0/2214526363 conn(0x7fdc140c9ca0 msgr2=0x7fdc1406dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.603+0000 7fdc1bd10700 1 -- 172.21.15.81:0/2214526363 shutdown_connections 2023-10-07T08:43:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.603+0000 7fdc1bd10700 1 -- 172.21.15.81:0/2214526363 wait complete. 2023-10-07T08:43:44.616 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:44.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.729+0000 7f986786d700 1 Processor -- start 2023-10-07T08:43:44.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.729+0000 7f986786d700 1 -- start start 2023-10-07T08:43:44.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f986786d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9860157ca0 0x7f98600cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:44.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f986786d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f986006d120 0x7f986006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:44.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f986786d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98600d07c0 con 0x7f98601578d0 2023-10-07T08:43:44.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f986786d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986006da50 con 0x7f986006d120 2023-10-07T08:43:44.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f986786d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98600cfbb0 con 0x7f9860157ca0 2023-10-07T08:43:44.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f9865e0a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f986006d120 0x7f986006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:44.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f9865e0a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f986006d120 0x7f986006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33940/0 (socket says 172.21.15.81:33940) 2023-10-07T08:43:44.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f9865e0a700 1 -- 172.21.15.81:0/3967648943 learned_addr learned my addr 172.21.15.81:0/3967648943 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:44.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f9864e08700 1 --2- 172.21.15.81:0/3967648943 >> v2:172.21.15.89:3300/0 conn(0x7f9860157ca0 0x7f98600cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:44.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f9865e0a700 1 -- 172.21.15.81:0/3967648943 >> v2:172.21.15.89:3300/0 conn(0x7f9860157ca0 msgr2=0x7f98600cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:44.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f9865e0a700 1 --2- 172.21.15.81:0/3967648943 >> v2:172.21.15.89:3300/0 conn(0x7f9860157ca0 0x7f98600cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f9865e0a700 1 -- 172.21.15.81:0/3967648943 >> v1:172.21.15.89:6789/0 conn(0x7f98601578d0 legacy=0x7f986015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f9865e0a700 1 -- 172.21.15.81:0/3967648943 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98600cfe90 con 0x7f986006d120 2023-10-07T08:43:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f9864e08700 1 --2- 172.21.15.81:0/3967648943 >> v2:172.21.15.89:3300/0 conn(0x7f9860157ca0 0x7f98600cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f9865e0a700 1 --2- 172.21.15.81:0/3967648943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f986006d120 0x7f986006d510 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9860068510 tx=0x7f9858009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b376acef9ea539 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f9857fff700 1 -- 172.21.15.81:0/3967648943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985800e070 con 0x7f986006d120 2023-10-07T08:43:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f9857fff700 1 -- 172.21.15.81:0/3967648943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985800ba50 con 0x7f986006d120 2023-10-07T08:43:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.730+0000 7f9857fff700 1 -- 172.21.15.81:0/3967648943 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98580092e0 con 0x7f986006d120 2023-10-07T08:43:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.731+0000 7f986786d700 1 -- 172.21.15.81:0/3967648943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f986006d120 msgr2=0x7f986006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.731+0000 7f986786d700 1 --2- 172.21.15.81:0/3967648943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f986006d120 0x7f986006d510 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9860068510 tx=0x7f9858009840 comp rx=0 tx=0).stop 2023-10-07T08:43:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.731+0000 7f986786d700 1 -- 172.21.15.81:0/3967648943 shutdown_connections 2023-10-07T08:43:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.731+0000 7f986786d700 1 --2- 172.21.15.81:0/3967648943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f986006d120 0x7f986006d510 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.731+0000 7f986786d700 1 --2- 172.21.15.81:0/3967648943 >> v2:172.21.15.89:3300/0 conn(0x7f9860157ca0 0x7f98600cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.731+0000 7f986786d700 1 -- 172.21.15.81:0/3967648943 >> 172.21.15.81:0/3967648943 conn(0x7f986006bb90 msgr2=0x7f986006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:44.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.731+0000 7f986786d700 1 -- 172.21.15.81:0/3967648943 shutdown_connections 2023-10-07T08:43:44.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.731+0000 7f986786d700 1 -- 172.21.15.81:0/3967648943 wait complete. 2023-10-07T08:43:44.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.732+0000 7f986786d700 1 Processor -- start 2023-10-07T08:43:44.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.732+0000 7f986786d700 1 -- start start 2023-10-07T08:43:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f986786d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f986006d120 0x7f9860154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f986786d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98601578d0 0x7f98601593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f986786d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9860157ca0 0x7f9860159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f986786d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98600ad4e0 con 0x7f98601578d0 2023-10-07T08:43:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f986786d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98600ad050 con 0x7f9860157ca0 2023-10-07T08:43:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f986786d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9860154ec0 con 0x7f986006d120 2023-10-07T08:43:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f9864e08700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98601578d0 0x7f98601593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f9864e08700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98601578d0 0x7f98601593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33944/0 (socket says 172.21.15.81:33944) 2023-10-07T08:43:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f9864e08700 1 -- 172.21.15.81:0/1953945423 learned_addr learned my addr 172.21.15.81:0/1953945423 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f9865609700 1 --2- 172.21.15.81:0/1953945423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f986006d120 0x7f9860154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f9865e0a700 1 --2- 172.21.15.81:0/1953945423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9860157ca0 0x7f9860159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f9864e08700 1 -- 172.21.15.81:0/1953945423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f986006d120 msgr2=0x7f9860154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f9864e08700 1 --2- 172.21.15.81:0/1953945423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f986006d120 0x7f9860154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f9864e08700 1 -- 172.21.15.81:0/1953945423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9860157ca0 msgr2=0x7f9860159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f9864e08700 1 --2- 172.21.15.81:0/1953945423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9860157ca0 0x7f9860159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f9864e08700 1 -- 172.21.15.81:0/1953945423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9858009ae0 con 0x7f98601578d0 2023-10-07T08:43:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.733+0000 7f9865e0a700 1 --2- 172.21.15.81:0/1953945423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9860157ca0 0x7f9860159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.734+0000 7f9864e08700 1 --2- 172.21.15.81:0/1953945423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98601578d0 0x7f98601593e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f985000d890 tx=0x7f9850008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.734+0000 7f98557fa700 1 -- 172.21.15.81:0/1953945423 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98500125f0 con 0x7f98601578d0 2023-10-07T08:43:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.734+0000 7f98557fa700 1 -- 172.21.15.81:0/1953945423 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9850012750 con 0x7f98601578d0 2023-10-07T08:43:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.734+0000 7f986786d700 1 -- 172.21.15.81:0/1953945423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98600aca00 con 0x7f98601578d0 2023-10-07T08:43:44.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.734+0000 7f98557fa700 1 -- 172.21.15.81:0/1953945423 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850012af0 con 0x7f98601578d0 2023-10-07T08:43:44.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.734+0000 7f986786d700 1 -- 172.21.15.81:0/1953945423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986016a2e0 con 0x7f98601578d0 2023-10-07T08:43:44.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.735+0000 7f986786d700 1 -- 172.21.15.81:0/1953945423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98600ad1e0 con 0x7f98601578d0 2023-10-07T08:43:44.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.735+0000 7f98557fa700 1 -- 172.21.15.81:0/1953945423 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9850014430 con 0x7f98601578d0 2023-10-07T08:43:44.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.735+0000 7f98557fa700 1 --2- 172.21.15.81:0/1953945423 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9844066f30 0x7f98440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:44.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.735+0000 7f98557fa700 1 -- 172.21.15.81:0/1953945423 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9850084900 con 0x7f98601578d0 2023-10-07T08:43:44.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.736+0000 7f9865609700 1 --2- 172.21.15.81:0/1953945423 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9844066f30 0x7f98440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:44.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.736+0000 7f9865609700 1 --2- 172.21.15.81:0/1953945423 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9844066f30 0x7f98440693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f985c003860 tx=0x7f985c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:44.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.739+0000 7f98557fa700 1 -- 172.21.15.81:0/1953945423 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9850051b70 con 0x7f98601578d0 2023-10-07T08:43:44.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.920+0000 7f986786d700 1 -- 172.21.15.81:0/1953945423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98600d0170 con 0x7f98601578d0 2023-10-07T08:43:44.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.921+0000 7f98557fa700 1 -- 172.21.15.81:0/1953945423 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f9850055190 con 0x7f98601578d0 2023-10-07T08:43:44.922 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:44.922 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:43:43.620595+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:43:41.595379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-07T08:43:42.590185+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:44.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.923+0000 7f986786d700 1 -- 172.21.15.81:0/1953945423 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9844066f30 msgr2=0x7f98440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.923+0000 7f986786d700 1 --2- 172.21.15.81:0/1953945423 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9844066f30 0x7f98440693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f985c003860 tx=0x7f985c009040 comp rx=0 tx=0).stop 2023-10-07T08:43:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.923+0000 7f986786d700 1 -- 172.21.15.81:0/1953945423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98601578d0 msgr2=0x7f98601593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.923+0000 7f986786d700 1 --2- 172.21.15.81:0/1953945423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98601578d0 0x7f98601593e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f985000d890 tx=0x7f9850008040 comp rx=0 tx=0).stop 2023-10-07T08:43:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.923+0000 7f986786d700 1 -- 172.21.15.81:0/1953945423 shutdown_connections 2023-10-07T08:43:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.923+0000 7f986786d700 1 --2- 172.21.15.81:0/1953945423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9860157ca0 0x7f9860159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.923+0000 7f986786d700 1 --2- 172.21.15.81:0/1953945423 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9844066f30 0x7f98440693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.923+0000 7f986786d700 1 --2- 172.21.15.81:0/1953945423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f986006d120 0x7f9860154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.923+0000 7f986786d700 1 --2- 172.21.15.81:0/1953945423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98601578d0 0x7f98601593e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.923+0000 7f986786d700 1 -- 172.21.15.81:0/1953945423 >> 172.21.15.81:0/1953945423 conn(0x7f986006bb90 msgr2=0x7f9860155470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.923+0000 7f986786d700 1 -- 172.21.15.81:0/1953945423 shutdown_connections 2023-10-07T08:43:44.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:44.923+0000 7f986786d700 1 -- 172.21.15.81:0/1953945423 wait complete. 2023-10-07T08:43:44.937 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T08:43:45.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.053+0000 7fb3ae27c700 1 Processor -- start 2023-10-07T08:43:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.053+0000 7fb3ae27c700 1 -- start start 2023-10-07T08:43:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.054+0000 7fb3ae27c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a8157ca0 0x7fb3a80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.054+0000 7fb3ae27c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb3a806d120 0x7fb3a806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.054+0000 7fb3ae27c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a806dac0 con 0x7fb3a81578d0 2023-10-07T08:43:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.054+0000 7fb3ae27c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a80d07c0 con 0x7fb3a806d120 2023-10-07T08:43:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.054+0000 7fb3ae27c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80cfbb0 con 0x7fb3a8157ca0 2023-10-07T08:43:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.054+0000 7fb3a7fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb3a81578d0 0x7fb3a815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50132/0 (socket says 172.21.15.81:50132) 2023-10-07T08:43:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.054+0000 7fb3a7fff700 1 -- 172.21.15.81:0/707681971 learned_addr learned my addr 172.21.15.81:0/707681971 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.054+0000 7fb3ac819700 1 --2- 172.21.15.81:0/707681971 >> v2:172.21.15.81:3300/0 conn(0x7fb3a806d120 0x7fb3a806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.054+0000 7fb3a77fe700 1 --2- 172.21.15.81:0/707681971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a8157ca0 0x7fb3a80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.054+0000 7fb3ac819700 1 -- 172.21.15.81:0/707681971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a8157ca0 msgr2=0x7fb3a80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.054+0000 7fb3ac819700 1 --2- 172.21.15.81:0/707681971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a8157ca0 0x7fb3a80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.054+0000 7fb3ac819700 1 -- 172.21.15.81:0/707681971 >> v1:172.21.15.81:6789/0 conn(0x7fb3a81578d0 legacy=0x7fb3a815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.055+0000 7fb3ac819700 1 -- 172.21.15.81:0/707681971 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a80cfe90 con 0x7fb3a806d120 2023-10-07T08:43:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.054+0000 7fb3a6ffd700 1 -- 172.21.15.81:0/707681971 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589446329 0 0) 0x7fb398001110 con 0x7fb3a81578d0 2023-10-07T08:43:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.055+0000 7fb3ac819700 1 --2- 172.21.15.81:0/707681971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a806d120 0x7fb3a806d580 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009e60 tx=0x7fb3a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b448207d857c62e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.055+0000 7fb3a6ffd700 1 -- 172.21.15.81:0/707681971 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a000e070 con 0x7fb3a806d120 2023-10-07T08:43:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.055+0000 7fb3a6ffd700 1 -- 172.21.15.81:0/707681971 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a000bc30 con 0x7fb3a806d120 2023-10-07T08:43:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.055+0000 7fb3a6ffd700 1 -- 172.21.15.81:0/707681971 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0012430 con 0x7fb3a806d120 2023-10-07T08:43:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.055+0000 7fb3ae27c700 1 -- 172.21.15.81:0/707681971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a806d120 msgr2=0x7fb3a806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.055+0000 7fb3ae27c700 1 --2- 172.21.15.81:0/707681971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a806d120 0x7fb3a806d580 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009e60 tx=0x7fb3a0009780 comp rx=0 tx=0).stop 2023-10-07T08:43:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.055+0000 7fb3ae27c700 1 -- 172.21.15.81:0/707681971 shutdown_connections 2023-10-07T08:43:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.055+0000 7fb3ae27c700 1 --2- 172.21.15.81:0/707681971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a806d120 0x7fb3a806d580 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.055+0000 7fb3ae27c700 1 --2- 172.21.15.81:0/707681971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a8157ca0 0x7fb3a80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.055+0000 7fb3ae27c700 1 -- 172.21.15.81:0/707681971 >> 172.21.15.81:0/707681971 conn(0x7fb3a806bb90 msgr2=0x7fb3a806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.055+0000 7fb3ae27c700 1 -- 172.21.15.81:0/707681971 shutdown_connections 2023-10-07T08:43:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.055+0000 7fb3ae27c700 1 -- 172.21.15.81:0/707681971 wait complete. 2023-10-07T08:43:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.056+0000 7fb3ae27c700 1 Processor -- start 2023-10-07T08:43:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.057+0000 7fb3ae27c700 1 -- start start 2023-10-07T08:43:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.057+0000 7fb3ae27c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a806d120 0x7fb3a815ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.057+0000 7fb3ae27c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a81578d0 0x7fb3a8149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.057+0000 7fb3ae27c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3a8157ca0 0x7fb3a8149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.057+0000 7fb3ae27c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80b2a00 con 0x7fb3a81578d0 2023-10-07T08:43:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.057+0000 7fb3ae27c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80b1960 con 0x7fb3a8157ca0 2023-10-07T08:43:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.057+0000 7fb3ae27c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80b1c40 con 0x7fb3a806d120 2023-10-07T08:43:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.057+0000 7fb3a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a81578d0 0x7fb3a8149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.057+0000 7fb3a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a81578d0 0x7fb3a8149880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33970/0 (socket says 172.21.15.81:33970) 2023-10-07T08:43:45.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.057+0000 7fb3a77fe700 1 -- 172.21.15.81:0/1903104253 learned_addr learned my addr 172.21.15.81:0/1903104253 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:45.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.058+0000 7fb3a7fff700 1 --2- 172.21.15.81:0/1903104253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a806d120 0x7fb3a815ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:45.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.058+0000 7fb3ac819700 1 --2- 172.21.15.81:0/1903104253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3a8157ca0 0x7fb3a8149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:45.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.058+0000 7fb3a77fe700 1 -- 172.21.15.81:0/1903104253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a806d120 msgr2=0x7fb3a815ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:45.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.058+0000 7fb3a77fe700 1 --2- 172.21.15.81:0/1903104253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a806d120 0x7fb3a815ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:45.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.058+0000 7fb3a77fe700 1 -- 172.21.15.81:0/1903104253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3a8157ca0 msgr2=0x7fb3a8149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:45.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.058+0000 7fb3a77fe700 1 --2- 172.21.15.81:0/1903104253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3a8157ca0 0x7fb3a8149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:45.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.058+0000 7fb3a77fe700 1 -- 172.21.15.81:0/1903104253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a0009a20 con 0x7fb3a81578d0 2023-10-07T08:43:45.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.058+0000 7fb3ac819700 1 --2- 172.21.15.81:0/1903104253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3a8157ca0 0x7fb3a8149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:45.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.058+0000 7fb3a77fe700 1 --2- 172.21.15.81:0/1903104253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a81578d0 0x7fb3a8149880 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00d860 tx=0x7fb39c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:45.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.058+0000 7fb38ffff700 1 -- 172.21.15.81:0/1903104253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c009610 con 0x7fb3a81578d0 2023-10-07T08:43:45.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.058+0000 7fb38ffff700 1 -- 172.21.15.81:0/1903104253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39c009770 con 0x7fb3a81578d0 2023-10-07T08:43:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.058+0000 7fb38ffff700 1 -- 172.21.15.81:0/1903104253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c009b30 con 0x7fb3a81578d0 2023-10-07T08:43:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.058+0000 7fb3ae27c700 1 -- 172.21.15.81:0/1903104253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a80b1f20 con 0x7fb3a81578d0 2023-10-07T08:43:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.058+0000 7fb3ae27c700 1 -- 172.21.15.81:0/1903104253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a80b24e0 con 0x7fb3a81578d0 2023-10-07T08:43:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.059+0000 7fb3ae27c700 1 -- 172.21.15.81:0/1903104253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a80b6c60 con 0x7fb3a81578d0 2023-10-07T08:43:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.059+0000 7fb38ffff700 1 -- 172.21.15.81:0/1903104253 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb39c01e460 con 0x7fb3a81578d0 2023-10-07T08:43:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.060+0000 7fb38ffff700 1 --2- 172.21.15.81:0/1903104253 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb394066f30 0x7fb3940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.060+0000 7fb38ffff700 1 -- 172.21.15.81:0/1903104253 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb39c084ba0 con 0x7fb3a81578d0 2023-10-07T08:43:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.060+0000 7fb3a7fff700 1 --2- 172.21.15.81:0/1903104253 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb394066f30 0x7fb3940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.060+0000 7fb3a7fff700 1 --2- 172.21.15.81:0/1903104253 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb394066f30 0x7fb3940693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb3980018a0 tx=0x7fb398009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.064+0000 7fb38ffff700 1 -- 172.21.15.81:0/1903104253 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb39c051e10 con 0x7fb3a81578d0 2023-10-07T08:43:45.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:45.292+0000 7fb3ae27c700 1 -- 172.21.15.81:0/1903104253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb3a80d0170 con 0x7fb3a81578d0 2023-10-07T08:43:46.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.292+0000 7fb38ffff700 1 -- 172.21.15.81:0/1903104253 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb39c055430 con 0x7fb3a81578d0 2023-10-07T08:43:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.294+0000 7fb3ae27c700 1 -- 172.21.15.81:0/1903104253 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb394066f30 msgr2=0x7fb3940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.294+0000 7fb3ae27c700 1 --2- 172.21.15.81:0/1903104253 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb394066f30 0x7fb3940693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb3980018a0 tx=0x7fb398009040 comp rx=0 tx=0).stop 2023-10-07T08:43:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.294+0000 7fb3ae27c700 1 -- 172.21.15.81:0/1903104253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a81578d0 msgr2=0x7fb3a8149880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.294+0000 7fb3ae27c700 1 --2- 172.21.15.81:0/1903104253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a81578d0 0x7fb3a8149880 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00d860 tx=0x7fb39c008040 comp rx=0 tx=0).stop 2023-10-07T08:43:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.294+0000 7fb3ae27c700 1 -- 172.21.15.81:0/1903104253 shutdown_connections 2023-10-07T08:43:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.294+0000 7fb3ae27c700 1 --2- 172.21.15.81:0/1903104253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3a8157ca0 0x7fb3a8149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.294+0000 7fb3ae27c700 1 --2- 172.21.15.81:0/1903104253 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb394066f30 0x7fb3940693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.294+0000 7fb3ae27c700 1 --2- 172.21.15.81:0/1903104253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a806d120 0x7fb3a815ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.294+0000 7fb3ae27c700 1 --2- 172.21.15.81:0/1903104253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a81578d0 0x7fb3a8149880 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.294+0000 7fb3ae27c700 1 -- 172.21.15.81:0/1903104253 >> 172.21.15.81:0/1903104253 conn(0x7fb3a806bb90 msgr2=0x7fb3a8155ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.294+0000 7fb3ae27c700 1 -- 172.21.15.81:0/1903104253 shutdown_connections 2023-10-07T08:43:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.294+0000 7fb3ae27c700 1 -- 172.21.15.81:0/1903104253 wait complete. 2023-10-07T08:43:46.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T08:43:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.424+0000 7f037d2fe700 1 Processor -- start 2023-10-07T08:43:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.424+0000 7f037d2fe700 1 -- start start 2023-10-07T08:43:46.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.425+0000 7f037d2fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f03781578d0 0x7f03780cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:46.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.425+0000 7f037d2fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0378157ca0 0x7f037815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:46.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.425+0000 7f037d2fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f037806d120 0x7f037806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:46.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.425+0000 7f037d2fe700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03780d07c0 con 0x7f0378157ca0 2023-10-07T08:43:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.425+0000 7f037d2fe700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037806daa0 con 0x7f03781578d0 2023-10-07T08:43:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.425+0000 7f037d2fe700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03780cfbb0 con 0x7f037806d120 2023-10-07T08:43:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.425+0000 7f03767fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0378157ca0 0x7f037815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.425+0000 7f03767fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0378157ca0 0x7f037815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33982/0 (socket says 172.21.15.81:33982) 2023-10-07T08:43:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.425+0000 7f03767fc700 1 -- 172.21.15.81:0/1295552465 learned_addr learned my addr 172.21.15.81:0/1295552465 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.425+0000 7f03777fe700 1 --2- 172.21.15.81:0/1295552465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f037806d120 0x7f037806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.425+0000 7f0376ffd700 1 --2- 172.21.15.81:0/1295552465 >> v2:172.21.15.89:3300/0 conn(0x7f03781578d0 0x7f03780cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.425+0000 7f03767fc700 1 -- 172.21.15.81:0/1295552465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f037806d120 msgr2=0x7f037806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.425+0000 7f03767fc700 1 --2- 172.21.15.81:0/1295552465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f037806d120 0x7f037806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.426+0000 7f03767fc700 1 -- 172.21.15.81:0/1295552465 >> v2:172.21.15.89:3300/0 conn(0x7f03781578d0 msgr2=0x7f03780cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.426+0000 7f03767fc700 1 --2- 172.21.15.81:0/1295552465 >> v2:172.21.15.89:3300/0 conn(0x7f03781578d0 0x7f03780cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.426+0000 7f03767fc700 1 -- 172.21.15.81:0/1295552465 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03780cfe90 con 0x7f0378157ca0 2023-10-07T08:43:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.426+0000 7f03767fc700 1 --2- 172.21.15.81:0/1295552465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0378157ca0 0x7f037815af00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f03780646b0 tx=0x7f036c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df93de114b75c9e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.426+0000 7f0375ffb700 1 -- 172.21.15.81:0/1295552465 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c00b860 con 0x7f0378157ca0 2023-10-07T08:43:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.426+0000 7f0375ffb700 1 -- 172.21.15.81:0/1295552465 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c00b9c0 con 0x7f0378157ca0 2023-10-07T08:43:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.426+0000 7f0375ffb700 1 -- 172.21.15.81:0/1295552465 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c00bd60 con 0x7f0378157ca0 2023-10-07T08:43:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.426+0000 7f037d2fe700 1 -- 172.21.15.81:0/1295552465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0378157ca0 msgr2=0x7f037815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.426+0000 7f037d2fe700 1 --2- 172.21.15.81:0/1295552465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0378157ca0 0x7f037815af00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f03780646b0 tx=0x7f036c009250 comp rx=0 tx=0).stop 2023-10-07T08:43:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.426+0000 7f037d2fe700 1 -- 172.21.15.81:0/1295552465 shutdown_connections 2023-10-07T08:43:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.426+0000 7f037d2fe700 1 --2- 172.21.15.81:0/1295552465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f037806d120 0x7f037806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.426+0000 7f037d2fe700 1 --2- 172.21.15.81:0/1295552465 >> v2:172.21.15.89:3300/0 conn(0x7f03781578d0 0x7f03780cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.426+0000 7f037d2fe700 1 --2- 172.21.15.81:0/1295552465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0378157ca0 0x7f037815af00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.426+0000 7f037d2fe700 1 -- 172.21.15.81:0/1295552465 >> 172.21.15.81:0/1295552465 conn(0x7f037806bb90 msgr2=0x7f037806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.426+0000 7f037d2fe700 1 -- 172.21.15.81:0/1295552465 shutdown_connections 2023-10-07T08:43:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.426+0000 7f037d2fe700 1 -- 172.21.15.81:0/1295552465 wait complete. 2023-10-07T08:43:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.428+0000 7f037d2fe700 1 Processor -- start 2023-10-07T08:43:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.428+0000 7f037d2fe700 1 -- start start 2023-10-07T08:43:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.428+0000 7f037d2fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f037806d120 0x7f03780b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.428+0000 7f037d2fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03781578d0 0x7f037816d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:46.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.428+0000 7f037d2fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0378157ca0 0x7f03780c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.428+0000 7f037d2fe700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037816de50 con 0x7f03781578d0 2023-10-07T08:43:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.428+0000 7f037d2fe700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037816e080 con 0x7f037806d120 2023-10-07T08:43:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.428+0000 7f037d2fe700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037816e360 con 0x7f0378157ca0 2023-10-07T08:43:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.428+0000 7f03767fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03781578d0 0x7f037816d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.428+0000 7f03767fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03781578d0 0x7f037816d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33984/0 (socket says 172.21.15.81:33984) 2023-10-07T08:43:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.428+0000 7f03767fc700 1 -- 172.21.15.81:0/3511225070 learned_addr learned my addr 172.21.15.81:0/3511225070 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.429+0000 7f0376ffd700 1 --2- 172.21.15.81:0/3511225070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f037806d120 0x7f03780b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.429+0000 7f03777fe700 1 --2- 172.21.15.81:0/3511225070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0378157ca0 0x7f03780c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.429+0000 7f03767fc700 1 -- 172.21.15.81:0/3511225070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0378157ca0 msgr2=0x7f03780c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.429+0000 7f03767fc700 1 --2- 172.21.15.81:0/3511225070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0378157ca0 0x7f03780c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.429+0000 7f03767fc700 1 -- 172.21.15.81:0/3511225070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f037806d120 msgr2=0x7f03780b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.429+0000 7f03767fc700 1 --2- 172.21.15.81:0/3511225070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f037806d120 0x7f03780b5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.429+0000 7f03767fc700 1 -- 172.21.15.81:0/3511225070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c0094f0 con 0x7f03781578d0 2023-10-07T08:43:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.429+0000 7f03767fc700 1 --2- 172.21.15.81:0/3511225070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03781578d0 0x7f037816d910 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f037806fe20 tx=0x7f036c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.429+0000 7f035effd700 1 -- 172.21.15.81:0/3511225070 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c011dc0 con 0x7f03781578d0 2023-10-07T08:43:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.429+0000 7f035effd700 1 -- 172.21.15.81:0/3511225070 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c024440 con 0x7f03781578d0 2023-10-07T08:43:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.429+0000 7f037d2fe700 1 -- 172.21.15.81:0/3511225070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037816e640 con 0x7f03781578d0 2023-10-07T08:43:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.429+0000 7f035effd700 1 -- 172.21.15.81:0/3511225070 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c024800 con 0x7f03781578d0 2023-10-07T08:43:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.429+0000 7f037d2fe700 1 -- 172.21.15.81:0/3511225070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03780c7a50 con 0x7f03781578d0 2023-10-07T08:43:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.430+0000 7f037d2fe700 1 -- 172.21.15.81:0/3511225070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03780b3ba0 con 0x7f03781578d0 2023-10-07T08:43:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.430+0000 7f035effd700 1 -- 172.21.15.81:0/3511225070 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f036c01a420 con 0x7f03781578d0 2023-10-07T08:43:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.431+0000 7f035effd700 1 --2- 172.21.15.81:0/3511225070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0364066f30 0x7f03640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.431+0000 7f035effd700 1 -- 172.21.15.81:0/3511225070 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f036c086340 con 0x7f03781578d0 2023-10-07T08:43:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.431+0000 7f0376ffd700 1 --2- 172.21.15.81:0/3511225070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0364066f30 0x7f03640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.431+0000 7f0376ffd700 1 --2- 172.21.15.81:0/3511225070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0364066f30 0x7f03640693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0368009fd0 tx=0x7f0368009880 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.435+0000 7f035effd700 1 -- 172.21.15.81:0/3511225070 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03780b3ba0 con 0x7f03781578d0 2023-10-07T08:43:46.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:46.660+0000 7f037d2fe700 1 -- 172.21.15.81:0/3511225070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f03780b3f80 con 0x7f03781578d0 2023-10-07T08:43:47.090 INFO:tasks.ceph.mds.d.smithi089.stderr:2023-10-07T08:43:47.090+0000 7f06a5cab700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:43:47.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.293+0000 7f035effd700 1 -- 172.21.15.81:0/3511225070 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f03780b3f80 con 0x7f03781578d0 2023-10-07T08:43:47.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.295+0000 7f037d2fe700 1 -- 172.21.15.81:0/3511225070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0364066f30 msgr2=0x7f03640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:47.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.295+0000 7f037d2fe700 1 --2- 172.21.15.81:0/3511225070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0364066f30 0x7f03640693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0368009fd0 tx=0x7f0368009880 comp rx=0 tx=0).stop 2023-10-07T08:43:47.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.295+0000 7f037d2fe700 1 -- 172.21.15.81:0/3511225070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03781578d0 msgr2=0x7f037816d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:47.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.295+0000 7f037d2fe700 1 --2- 172.21.15.81:0/3511225070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03781578d0 0x7f037816d910 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f037806fe20 tx=0x7f036c017000 comp rx=0 tx=0).stop 2023-10-07T08:43:47.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.295+0000 7f037d2fe700 1 -- 172.21.15.81:0/3511225070 shutdown_connections 2023-10-07T08:43:47.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.295+0000 7f037d2fe700 1 --2- 172.21.15.81:0/3511225070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0364066f30 0x7f03640693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.295+0000 7f037d2fe700 1 --2- 172.21.15.81:0/3511225070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0378157ca0 0x7f03780c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.295+0000 7f037d2fe700 1 --2- 172.21.15.81:0/3511225070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f037806d120 0x7f03780b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.295+0000 7f037d2fe700 1 --2- 172.21.15.81:0/3511225070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03781578d0 0x7f037816d910 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.295+0000 7f037d2fe700 1 -- 172.21.15.81:0/3511225070 >> 172.21.15.81:0/3511225070 conn(0x7f037806bb90 msgr2=0x7f03781546a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:47.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.295+0000 7f037d2fe700 1 -- 172.21.15.81:0/3511225070 shutdown_connections 2023-10-07T08:43:47.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.295+0000 7f037d2fe700 1 -- 172.21.15.81:0/3511225070 wait complete. 2023-10-07T08:43:47.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:43:47.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.422+0000 7f428d489700 1 Processor -- start 2023-10-07T08:43:47.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.422+0000 7f428d489700 1 -- start start 2023-10-07T08:43:47.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.423+0000 7f428d489700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4288159b40 0x7f42880cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:47.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.423+0000 7f428d489700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42880cee10 con 0x7f4288159f10 2023-10-07T08:43:47.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.423+0000 7f428d489700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42880cd040 con 0x7f4288068e90 2023-10-07T08:43:47.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.423+0000 7f428d489700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42880cd320 con 0x7f4288159b40 2023-10-07T08:43:47.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.423+0000 7f4287fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4288159b40 0x7f42880cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:47.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.423+0000 7f42877fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4288159f10 0x7f4288068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50134/0 (socket says 172.21.15.81:50134) 2023-10-07T08:43:47.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.423+0000 7f42877fe700 1 -- 172.21.15.81:0/1198906809 learned_addr learned my addr 172.21.15.81:0/1198906809 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:47.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.423+0000 7f4287fff700 1 -- 172.21.15.81:0/1198906809 >> v1:172.21.15.89:6789/0 conn(0x7f4288068e90 legacy=0x7f42880cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:47.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.423+0000 7f4287fff700 1 -- 172.21.15.81:0/1198906809 >> v1:172.21.15.81:6789/0 conn(0x7f4288159f10 legacy=0x7f4288068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:47.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.423+0000 7f4286ffd700 1 -- 172.21.15.81:0/1198906809 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557287669 0 0) 0x7f42880cee10 con 0x7f4288159f10 2023-10-07T08:43:47.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.423+0000 7f4287fff700 1 -- 172.21.15.81:0/1198906809 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42880ce7c0 con 0x7f4288159b40 2023-10-07T08:43:47.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.424+0000 7f4287fff700 1 --2- 172.21.15.81:0/1198906809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288159b40 0x7f42880cc600 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f42780098e0 tx=0x7f42780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4c79ba26681aaa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:47.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.424+0000 7f4286ffd700 1 -- 172.21.15.81:0/1198906809 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278009e80 con 0x7f4288159b40 2023-10-07T08:43:47.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.424+0000 7f4286ffd700 1 -- 172.21.15.81:0/1198906809 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427800b820 con 0x7f4288159b40 2023-10-07T08:43:47.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.424+0000 7f4286ffd700 1 -- 172.21.15.81:0/1198906809 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800bba0 con 0x7f4288159b40 2023-10-07T08:43:47.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.424+0000 7f428d489700 1 -- 172.21.15.81:0/1198906809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288159b40 msgr2=0x7f42880cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:47.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.424+0000 7f428d489700 1 --2- 172.21.15.81:0/1198906809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288159b40 0x7f42880cc600 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f42780098e0 tx=0x7f42780091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.424+0000 7f428d489700 1 -- 172.21.15.81:0/1198906809 shutdown_connections 2023-10-07T08:43:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.424+0000 7f428d489700 1 --2- 172.21.15.81:0/1198906809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288159b40 0x7f42880cc600 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.424+0000 7f428d489700 1 -- 172.21.15.81:0/1198906809 >> 172.21.15.81:0/1198906809 conn(0x7f42880cd660 msgr2=0x7f42880cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.424+0000 7f428d489700 1 -- 172.21.15.81:0/1198906809 shutdown_connections 2023-10-07T08:43:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.424+0000 7f428d489700 1 -- 172.21.15.81:0/1198906809 wait complete. 2023-10-07T08:43:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.425+0000 7f428d489700 1 Processor -- start 2023-10-07T08:43:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.426+0000 7f428d489700 1 -- start start 2023-10-07T08:43:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.426+0000 7f428d489700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4288068e90 0x7f42880b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.426+0000 7f428d489700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288159b40 0x7f42881550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.426+0000 7f428d489700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4288159f10 0x7f42881583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.426+0000 7f428d489700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4288156d20 con 0x7f4288159b40 2023-10-07T08:43:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.426+0000 7f428d489700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4288156560 con 0x7f4288159f10 2023-10-07T08:43:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.426+0000 7f428d489700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428816a580 con 0x7f4288068e90 2023-10-07T08:43:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.426+0000 7f42877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288159b40 0x7f42881550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:47.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.426+0000 7f42877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288159b40 0x7f42881550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34004/0 (socket says 172.21.15.81:34004) 2023-10-07T08:43:47.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.426+0000 7f42877fe700 1 -- 172.21.15.81:0/749398349 learned_addr learned my addr 172.21.15.81:0/749398349 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:47.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.427+0000 7f4287fff700 1 --2- 172.21.15.81:0/749398349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4288068e90 0x7f42880b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:47.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.427+0000 7f428cc88700 1 --2- 172.21.15.81:0/749398349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4288159f10 0x7f42881583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:47.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.427+0000 7f42877fe700 1 -- 172.21.15.81:0/749398349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4288068e90 msgr2=0x7f42880b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:47.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.427+0000 7f42877fe700 1 --2- 172.21.15.81:0/749398349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4288068e90 0x7f42880b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.427+0000 7f42877fe700 1 -- 172.21.15.81:0/749398349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4288159f10 msgr2=0x7f42881583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.427+0000 7f42877fe700 1 --2- 172.21.15.81:0/749398349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4288159f10 0x7f42881583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.427+0000 7f42877fe700 1 -- 172.21.15.81:0/749398349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278009420 con 0x7f4288159b40 2023-10-07T08:43:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.427+0000 7f42877fe700 1 --2- 172.21.15.81:0/749398349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288159b40 0x7f42881550d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f427c00c5b0 tx=0x7f427c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.427+0000 7f426ffff700 1 -- 172.21.15.81:0/749398349 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c005b30 con 0x7f4288159b40 2023-10-07T08:43:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.427+0000 7f426ffff700 1 -- 172.21.15.81:0/749398349 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427c005c90 con 0x7f4288159b40 2023-10-07T08:43:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.427+0000 7f428d489700 1 -- 172.21.15.81:0/749398349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42880b2aa0 con 0x7f4288159b40 2023-10-07T08:43:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.427+0000 7f426ffff700 1 -- 172.21.15.81:0/749398349 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c007320 con 0x7f4288159b40 2023-10-07T08:43:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.427+0000 7f428d489700 1 -- 172.21.15.81:0/749398349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4288156940 con 0x7f4288159b40 2023-10-07T08:43:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.428+0000 7f428d489700 1 -- 172.21.15.81:0/749398349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4288156e60 con 0x7f4288159b40 2023-10-07T08:43:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.428+0000 7f426ffff700 1 -- 172.21.15.81:0/749398349 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f427c01b3b0 con 0x7f4288159b40 2023-10-07T08:43:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.429+0000 7f426ffff700 1 --2- 172.21.15.81:0/749398349 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4274066f30 0x7f42740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.429+0000 7f426ffff700 1 -- 172.21.15.81:0/749398349 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f427c083a70 con 0x7f4288159b40 2023-10-07T08:43:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.429+0000 7f4287fff700 1 --2- 172.21.15.81:0/749398349 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4274066f30 0x7f42740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.429+0000 7f4287fff700 1 --2- 172.21.15.81:0/749398349 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4274066f30 0x7f42740693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f42780030c0 tx=0x7f4278016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.433+0000 7f426ffff700 1 -- 172.21.15.81:0/749398349 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4288156e60 con 0x7f4288159b40 2023-10-07T08:43:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.657+0000 7f428d489700 1 -- 172.21.15.81:0/749398349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4288156e60 con 0x7f4288159b40 2023-10-07T08:43:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.658+0000 7f426ffff700 1 -- 172.21.15.81:0/749398349 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f4288156e60 con 0x7f4288159b40 2023-10-07T08:43:47.659 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:47.660 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1843075449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1843075449},{"type":"v1","addr":"172.21.15.81:6837","nonce":1843075449}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3013270804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3013270804},{"type":"v1","addr":"172.21.15.89:6835","nonce":3013270804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3825515993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3825515993},{"type":"v1","addr":"172.21.15.81:6836","nonce":3825515993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:43:43.620900+0000","modified":"2023-10-07T08:43:47.291987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6834/4005291324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":4005291324},{"type":"v1","addr":"172.21.15.89:6834","nonce":4005291324}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-07T08:43:47.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.660+0000 7f428d489700 1 -- 172.21.15.81:0/749398349 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4274066f30 msgr2=0x7f42740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:47.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.660+0000 7f428d489700 1 --2- 172.21.15.81:0/749398349 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4274066f30 0x7f42740693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f42780030c0 tx=0x7f4278016000 comp rx=0 tx=0).stop 2023-10-07T08:43:47.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.660+0000 7f428d489700 1 -- 172.21.15.81:0/749398349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288159b40 msgr2=0x7f42881550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:47.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.660+0000 7f428d489700 1 --2- 172.21.15.81:0/749398349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288159b40 0x7f42881550d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f427c00c5b0 tx=0x7f427c001070 comp rx=0 tx=0).stop 2023-10-07T08:43:47.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.660+0000 7f428d489700 1 -- 172.21.15.81:0/749398349 shutdown_connections 2023-10-07T08:43:47.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.660+0000 7f428d489700 1 --2- 172.21.15.81:0/749398349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4288159f10 0x7f42881583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.660+0000 7f428d489700 1 --2- 172.21.15.81:0/749398349 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4274066f30 0x7f42740693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.660+0000 7f428d489700 1 --2- 172.21.15.81:0/749398349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4288068e90 0x7f42880b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.660+0000 7f428d489700 1 --2- 172.21.15.81:0/749398349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288159b40 0x7f42881550d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.660+0000 7f428d489700 1 -- 172.21.15.81:0/749398349 >> 172.21.15.81:0/749398349 conn(0x7f42880cd660 msgr2=0x7f428806d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:47.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.660+0000 7f428d489700 1 -- 172.21.15.81:0/749398349 shutdown_connections 2023-10-07T08:43:47.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.660+0000 7f428d489700 1 -- 172.21.15.81:0/749398349 wait complete. 2023-10-07T08:43:47.663 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 15 2023-10-07T08:43:47.673 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.785+0000 7f2f2c8d5700 1 Processor -- start 2023-10-07T08:43:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.785+0000 7f2f2c8d5700 1 -- start start 2023-10-07T08:43:47.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.786+0000 7f2f2c8d5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f281578d0 0x7f2f280cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:47.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.786+0000 7f2f2c8d5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f28157ca0 0x7f2f2815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.786+0000 7f2f2c8d5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f280d07c0 con 0x7f2f2806d120 2023-10-07T08:43:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.786+0000 7f2f2c8d5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f280cfbb0 con 0x7f2f281578d0 2023-10-07T08:43:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.786+0000 7f2f2c8d5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f280cfe90 con 0x7f2f28157ca0 2023-10-07T08:43:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.786+0000 7f2f26d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2f2806d120 0x7f2f2815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50146/0 (socket says 172.21.15.81:50146) 2023-10-07T08:43:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.786+0000 7f2f2659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f281578d0 0x7f2f280cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.786+0000 7f2f26d9d700 1 -- 172.21.15.81:0/1739801677 learned_addr learned my addr 172.21.15.81:0/1739801677 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.786+0000 7f2f25d9b700 1 --2- 172.21.15.81:0/1739801677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f28157ca0 0x7f2f2815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.786+0000 7f2f2659c700 1 -- 172.21.15.81:0/1739801677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f28157ca0 msgr2=0x7f2f2815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.786+0000 7f2f2659c700 1 --2- 172.21.15.81:0/1739801677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f28157ca0 0x7f2f2815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.786+0000 7f2f2659c700 1 -- 172.21.15.81:0/1739801677 >> v1:172.21.15.81:6789/0 conn(0x7f2f2806d120 legacy=0x7f2f2815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.786+0000 7f2f2659c700 1 -- 172.21.15.81:0/1739801677 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f280d0170 con 0x7f2f281578d0 2023-10-07T08:43:47.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.786+0000 7f2f2559a700 1 -- 172.21.15.81:0/1739801677 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955687058 0 0) 0x7f2f280d07c0 con 0x7f2f2806d120 2023-10-07T08:43:47.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.786+0000 7f2f2659c700 1 --2- 172.21.15.81:0/1739801677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f281578d0 0x7f2f280cf4f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2f180098e0 tx=0x7f2f180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94eb76e309e8eaea server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:47.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.787+0000 7f2f2559a700 1 -- 172.21.15.81:0/1739801677 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800b640 con 0x7f2f281578d0 2023-10-07T08:43:47.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.787+0000 7f2f2559a700 1 -- 172.21.15.81:0/1739801677 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1800b7a0 con 0x7f2f281578d0 2023-10-07T08:43:47.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.787+0000 7f2f2559a700 1 -- 172.21.15.81:0/1739801677 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800bb40 con 0x7f2f281578d0 2023-10-07T08:43:47.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.787+0000 7f2f2c8d5700 1 -- 172.21.15.81:0/1739801677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f281578d0 msgr2=0x7f2f280cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:47.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.787+0000 7f2f2c8d5700 1 --2- 172.21.15.81:0/1739801677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f281578d0 0x7f2f280cf4f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2f180098e0 tx=0x7f2f180091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.787+0000 7f2f2c8d5700 1 -- 172.21.15.81:0/1739801677 shutdown_connections 2023-10-07T08:43:47.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.787+0000 7f2f2c8d5700 1 --2- 172.21.15.81:0/1739801677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f281578d0 0x7f2f280cf4f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.787+0000 7f2f2c8d5700 1 --2- 172.21.15.81:0/1739801677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f28157ca0 0x7f2f2815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.787+0000 7f2f2c8d5700 1 -- 172.21.15.81:0/1739801677 >> 172.21.15.81:0/1739801677 conn(0x7f2f2806bb90 msgr2=0x7f2f2806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:47.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.787+0000 7f2f2c8d5700 1 -- 172.21.15.81:0/1739801677 shutdown_connections 2023-10-07T08:43:47.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.787+0000 7f2f2c8d5700 1 -- 172.21.15.81:0/1739801677 wait complete. 2023-10-07T08:43:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.788+0000 7f2f2c8d5700 1 Processor -- start 2023-10-07T08:43:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.788+0000 7f2f2c8d5700 1 -- start start 2023-10-07T08:43:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f2c8d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2806d120 0x7f2f28069ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f2c8d5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f281578d0 0x7f2f280cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f2c8d5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f28157ca0 0x7f2f280cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f2c8d5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f280cc5b0 con 0x7f2f2806d120 2023-10-07T08:43:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f2c8d5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f280cb9a0 con 0x7f2f28157ca0 2023-10-07T08:43:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f2c8d5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f280cbc80 con 0x7f2f281578d0 2023-10-07T08:43:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f2659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2806d120 0x7f2f28069ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f2659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2806d120 0x7f2f28069ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34018/0 (socket says 172.21.15.81:34018) 2023-10-07T08:43:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f2659c700 1 -- 172.21.15.81:0/1940779173 learned_addr learned my addr 172.21.15.81:0/1940779173 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f25d9b700 1 --2- 172.21.15.81:0/1940779173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f281578d0 0x7f2f280cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f2659c700 1 -- 172.21.15.81:0/1940779173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f281578d0 msgr2=0x7f2f280cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f2659c700 1 --2- 172.21.15.81:0/1940779173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f281578d0 0x7f2f280cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f2659c700 1 -- 172.21.15.81:0/1940779173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f28157ca0 msgr2=0x7f2f280cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f2659c700 1 --2- 172.21.15.81:0/1940779173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f28157ca0 0x7f2f280cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f2659c700 1 -- 172.21.15.81:0/1940779173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f18009420 con 0x7f2f2806d120 2023-10-07T08:43:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f25d9b700 1 --2- 172.21.15.81:0/1940779173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f281578d0 0x7f2f280cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.789+0000 7f2f2659c700 1 --2- 172.21.15.81:0/1940779173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2806d120 0x7f2f28069ca0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2f2806fe20 tx=0x7f2f18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.790+0000 7f2f167fc700 1 -- 172.21.15.81:0/1940779173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800bb20 con 0x7f2f2806d120 2023-10-07T08:43:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.790+0000 7f2f167fc700 1 -- 172.21.15.81:0/1940779173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f18011420 con 0x7f2f2806d120 2023-10-07T08:43:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.790+0000 7f2f2c8d5700 1 -- 172.21.15.81:0/1940779173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f280cbf60 con 0x7f2f2806d120 2023-10-07T08:43:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.790+0000 7f2f167fc700 1 -- 172.21.15.81:0/1940779173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f180117a0 con 0x7f2f2806d120 2023-10-07T08:43:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.790+0000 7f2f2c8d5700 1 -- 172.21.15.81:0/1940779173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f28147300 con 0x7f2f2806d120 2023-10-07T08:43:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.791+0000 7f2f2c8d5700 1 -- 172.21.15.81:0/1940779173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f28067ac0 con 0x7f2f2806d120 2023-10-07T08:43:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.791+0000 7f2f167fc700 1 -- 172.21.15.81:0/1940779173 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f18011b50 con 0x7f2f2806d120 2023-10-07T08:43:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.791+0000 7f2f167fc700 1 --2- 172.21.15.81:0/1940779173 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f08066f30 0x7f2f080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.792+0000 7f2f167fc700 1 -- 172.21.15.81:0/1940779173 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f18085c10 con 0x7f2f2806d120 2023-10-07T08:43:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.792+0000 7f2f25d9b700 1 --2- 172.21.15.81:0/1940779173 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f08066f30 0x7f2f080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.792+0000 7f2f25d9b700 1 --2- 172.21.15.81:0/1940779173 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f08066f30 0x7f2f080693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c006f00 tx=0x7f2f1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:47.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.796+0000 7f2f167fc700 1 -- 172.21.15.81:0/1940779173 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f18052e80 con 0x7f2f2806d120 2023-10-07T08:43:47.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.977+0000 7f2f2c8d5700 1 -- 172.21.15.81:0/1940779173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f280d0450 con 0x7f2f2806d120 2023-10-07T08:43:47.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.978+0000 7f2f167fc700 1 -- 172.21.15.81:0/1940779173 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f2f180564a0 con 0x7f2f2806d120 2023-10-07T08:43:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:47.980 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":33,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:43:45.254282+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:43:41.595379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-07T08:43:42.590185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:47.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.980+0000 7f2f2c8d5700 1 -- 172.21.15.81:0/1940779173 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f08066f30 msgr2=0x7f2f080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:47.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.980+0000 7f2f2c8d5700 1 --2- 172.21.15.81:0/1940779173 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f08066f30 0x7f2f080693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c006f00 tx=0x7f2f1c008040 comp rx=0 tx=0).stop 2023-10-07T08:43:47.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.980+0000 7f2f2c8d5700 1 -- 172.21.15.81:0/1940779173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2806d120 msgr2=0x7f2f28069ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:47.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.980+0000 7f2f2c8d5700 1 --2- 172.21.15.81:0/1940779173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2806d120 0x7f2f28069ca0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2f2806fe20 tx=0x7f2f18017000 comp rx=0 tx=0).stop 2023-10-07T08:43:47.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.980+0000 7f2f2c8d5700 1 -- 172.21.15.81:0/1940779173 shutdown_connections 2023-10-07T08:43:47.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.980+0000 7f2f2c8d5700 1 --2- 172.21.15.81:0/1940779173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f28157ca0 0x7f2f280cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.980+0000 7f2f2c8d5700 1 --2- 172.21.15.81:0/1940779173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2806d120 0x7f2f28069ca0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.980+0000 7f2f2c8d5700 1 --2- 172.21.15.81:0/1940779173 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f08066f30 0x7f2f080693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.980+0000 7f2f2c8d5700 1 --2- 172.21.15.81:0/1940779173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f281578d0 0x7f2f280cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:47.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.980+0000 7f2f2c8d5700 1 -- 172.21.15.81:0/1940779173 >> 172.21.15.81:0/1940779173 conn(0x7f2f2806bb90 msgr2=0x7f2f2806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:47.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.980+0000 7f2f2c8d5700 1 -- 172.21.15.81:0/1940779173 shutdown_connections 2023-10-07T08:43:47.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:47.980+0000 7f2f2c8d5700 1 -- 172.21.15.81:0/1940779173 wait complete. 2023-10-07T08:43:47.994 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T08:43:47.994 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:43:48.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.106+0000 7f13c6d8f700 1 Processor -- start 2023-10-07T08:43:48.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.106+0000 7f13c6d8f700 1 -- start start 2023-10-07T08:43:48.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.107+0000 7f13c6d8f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13c0159b40 0x7f13c00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.107+0000 7f13c6d8f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f13c0068e90 0x7f13c00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.107+0000 7f13c6d8f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c00cee10 con 0x7f13c0159f10 2023-10-07T08:43:48.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.107+0000 7f13c6d8f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c00cd040 con 0x7f13c0068e90 2023-10-07T08:43:48.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.107+0000 7f13c6d8f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c00cd320 con 0x7f13c0159b40 2023-10-07T08:43:48.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.107+0000 7f13c558c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f13c0159f10 0x7f13c0068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50162/0 (socket says 172.21.15.81:50162) 2023-10-07T08:43:48.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.107+0000 7f13c558c700 1 -- 172.21.15.81:0/641954028 learned_addr learned my addr 172.21.15.81:0/641954028 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:48.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.107+0000 7f13c5d8d700 1 --2- 172.21.15.81:0/641954028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13c0159b40 0x7f13c00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.107+0000 7f13c658e700 1 --2- 172.21.15.81:0/641954028 >> v2:172.21.15.89:3300/0 conn(0x7f13c0068e90 0x7f13c00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.107+0000 7f13c4d8b700 1 -- 172.21.15.81:0/641954028 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867032410 0 0) 0x7f13c00cee10 con 0x7f13c0159f10 2023-10-07T08:43:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.108+0000 7f13c4d8b700 1 -- 172.21.15.81:0/641954028 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13ac003570 con 0x7f13c0159f10 2023-10-07T08:43:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.108+0000 7f13c5d8d700 1 -- 172.21.15.81:0/641954028 >> v2:172.21.15.89:3300/0 conn(0x7f13c0068e90 msgr2=0x7f13c00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.108+0000 7f13c5d8d700 1 --2- 172.21.15.81:0/641954028 >> v2:172.21.15.89:3300/0 conn(0x7f13c0068e90 0x7f13c00cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.108+0000 7f13c5d8d700 1 -- 172.21.15.81:0/641954028 >> v1:172.21.15.81:6789/0 conn(0x7f13c0159f10 legacy=0x7f13c0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.108+0000 7f13c5d8d700 1 -- 172.21.15.81:0/641954028 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c00ce7c0 con 0x7f13c0159b40 2023-10-07T08:43:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.108+0000 7f13c5d8d700 1 --2- 172.21.15.81:0/641954028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13c0159b40 0x7f13c00cc600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0098e0 tx=0x7f13bc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a7e5ee01315d2a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.108+0000 7f13c4d8b700 1 -- 172.21.15.81:0/641954028 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc011630 con 0x7f13c0159b40 2023-10-07T08:43:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.108+0000 7f13c4d8b700 1 -- 172.21.15.81:0/641954028 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc011790 con 0x7f13c0159b40 2023-10-07T08:43:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.108+0000 7f13c4d8b700 1 -- 172.21.15.81:0/641954028 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc011b30 con 0x7f13c0159b40 2023-10-07T08:43:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.108+0000 7f13c6d8f700 1 -- 172.21.15.81:0/641954028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13c0159b40 msgr2=0x7f13c00cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.108+0000 7f13c6d8f700 1 --2- 172.21.15.81:0/641954028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13c0159b40 0x7f13c00cc600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0098e0 tx=0x7f13bc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.108+0000 7f13c6d8f700 1 -- 172.21.15.81:0/641954028 shutdown_connections 2023-10-07T08:43:48.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.108+0000 7f13c6d8f700 1 --2- 172.21.15.81:0/641954028 >> v2:172.21.15.89:3300/0 conn(0x7f13c0068e90 0x7f13c00cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.108+0000 7f13c6d8f700 1 --2- 172.21.15.81:0/641954028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13c0159b40 0x7f13c00cc600 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.108+0000 7f13c6d8f700 1 -- 172.21.15.81:0/641954028 >> 172.21.15.81:0/641954028 conn(0x7f13c00cd660 msgr2=0x7f13c00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:48.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.109+0000 7f13c6d8f700 1 -- 172.21.15.81:0/641954028 shutdown_connections 2023-10-07T08:43:48.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.109+0000 7f13c6d8f700 1 -- 172.21.15.81:0/641954028 wait complete. 2023-10-07T08:43:48.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.110+0000 7f13c6d8f700 1 Processor -- start 2023-10-07T08:43:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.110+0000 7f13c6d8f700 1 -- start start 2023-10-07T08:43:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.110+0000 7f13c6d8f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13c0068e90 0x7f13c016a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.110+0000 7f13c6d8f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c0159b40 0x7f13c006e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.110+0000 7f13c6d8f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13c0159f10 0x7f13c006e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.110+0000 7f13c6d8f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c0157600 con 0x7f13c0159f10 2023-10-07T08:43:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.110+0000 7f13c6d8f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c016a610 con 0x7f13c0159b40 2023-10-07T08:43:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.110+0000 7f13c6d8f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c00c9110 con 0x7f13c0068e90 2023-10-07T08:43:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.110+0000 7f13c658e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13c0159f10 0x7f13c006e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.110+0000 7f13c658e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13c0159f10 0x7f13c006e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34030/0 (socket says 172.21.15.81:34030) 2023-10-07T08:43:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.110+0000 7f13c658e700 1 -- 172.21.15.81:0/251685614 learned_addr learned my addr 172.21.15.81:0/251685614 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.111+0000 7f13c5d8d700 1 --2- 172.21.15.81:0/251685614 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13c0068e90 0x7f13c016a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.111+0000 7f13c558c700 1 --2- 172.21.15.81:0/251685614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c0159b40 0x7f13c006e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.111+0000 7f13c658e700 1 -- 172.21.15.81:0/251685614 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13c0068e90 msgr2=0x7f13c016a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.111+0000 7f13c658e700 1 --2- 172.21.15.81:0/251685614 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13c0068e90 0x7f13c016a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.111+0000 7f13c658e700 1 -- 172.21.15.81:0/251685614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c0159b40 msgr2=0x7f13c006e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.111+0000 7f13c658e700 1 --2- 172.21.15.81:0/251685614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c0159b40 0x7f13c006e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.111+0000 7f13c658e700 1 -- 172.21.15.81:0/251685614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc009420 con 0x7f13c0159f10 2023-10-07T08:43:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.111+0000 7f13c558c700 1 --2- 172.21.15.81:0/251685614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c0159b40 0x7f13c006e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.111+0000 7f13c658e700 1 --2- 172.21.15.81:0/251685614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13c0159f10 0x7f13c006e5e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009ef0 tx=0x7f13b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.111+0000 7f13b5ffb700 1 -- 172.21.15.81:0/251685614 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b800cc50 con 0x7f13c0159f10 2023-10-07T08:43:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.111+0000 7f13b5ffb700 1 -- 172.21.15.81:0/251685614 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b800f040 con 0x7f13c0159f10 2023-10-07T08:43:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.111+0000 7f13c6d8f700 1 -- 172.21.15.81:0/251685614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c00c93f0 con 0x7f13c0159f10 2023-10-07T08:43:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.111+0000 7f13b5ffb700 1 -- 172.21.15.81:0/251685614 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b8014480 con 0x7f13c0159f10 2023-10-07T08:43:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.111+0000 7f13c6d8f700 1 -- 172.21.15.81:0/251685614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c0157190 con 0x7f13c0159f10 2023-10-07T08:43:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.112+0000 7f13c6d8f700 1 -- 172.21.15.81:0/251685614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c0157770 con 0x7f13c0159f10 2023-10-07T08:43:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.112+0000 7f13b5ffb700 1 -- 172.21.15.81:0/251685614 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13b8014830 con 0x7f13c0159f10 2023-10-07T08:43:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.113+0000 7f13b5ffb700 1 --2- 172.21.15.81:0/251685614 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f13a4066f30 0x7f13a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.113+0000 7f13b5ffb700 1 -- 172.21.15.81:0/251685614 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f13b8085320 con 0x7f13c0159f10 2023-10-07T08:43:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.113+0000 7f13c5d8d700 1 --2- 172.21.15.81:0/251685614 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f13a4066f30 0x7f13a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.113+0000 7f13c5d8d700 1 --2- 172.21.15.81:0/251685614 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f13a4066f30 0x7f13a40693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0091e0 tx=0x7f13bc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:48.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.117+0000 7f13b5ffb700 1 -- 172.21.15.81:0/251685614 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13b8052590 con 0x7f13c0159f10 2023-10-07T08:43:48.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.294+0000 7f13c6d8f700 1 -- 172.21.15.81:0/251685614 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13c00cb910 con 0x7f13a4066f30 2023-10-07T08:43:48.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.302+0000 7f13b5ffb700 1 -- 172.21.15.81:0/251685614 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263088 (secure 0 0 0) 0x7f13c00cb910 con 0x7f13a4066f30 2023-10-07T08:43:48.309 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.305+0000 7f13c6d8f700 1 -- 172.21.15.81:0/251685614 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f13a4066f30 msgr2=0x7f13a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.305+0000 7f13c6d8f700 1 --2- 172.21.15.81:0/251685614 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f13a4066f30 0x7f13a40693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0091e0 tx=0x7f13bc017000 comp rx=0 tx=0).stop 2023-10-07T08:43:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.305+0000 7f13c6d8f700 1 -- 172.21.15.81:0/251685614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13c0159f10 msgr2=0x7f13c006e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.305+0000 7f13c6d8f700 1 --2- 172.21.15.81:0/251685614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13c0159f10 0x7f13c006e5e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009ef0 tx=0x7f13b800b040 comp rx=0 tx=0).stop 2023-10-07T08:43:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.305+0000 7f13c6d8f700 1 -- 172.21.15.81:0/251685614 shutdown_connections 2023-10-07T08:43:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.305+0000 7f13c6d8f700 1 --2- 172.21.15.81:0/251685614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13c0159f10 0x7f13c006e5e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.305+0000 7f13c6d8f700 1 --2- 172.21.15.81:0/251685614 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f13a4066f30 0x7f13a40693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.305+0000 7f13c6d8f700 1 --2- 172.21.15.81:0/251685614 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13c0068e90 0x7f13c016a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.305+0000 7f13c6d8f700 1 --2- 172.21.15.81:0/251685614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c0159b40 0x7f13c006e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.305+0000 7f13c6d8f700 1 -- 172.21.15.81:0/251685614 >> 172.21.15.81:0/251685614 conn(0x7f13c00cd660 msgr2=0x7f13c006f020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:48.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.305+0000 7f13c6d8f700 1 -- 172.21.15.81:0/251685614 shutdown_connections 2023-10-07T08:43:48.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.305+0000 7f13c6d8f700 1 -- 172.21.15.81:0/251685614 wait complete. 2023-10-07T08:43:48.314 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:43:48.319 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-10-07T08:43:48.016249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560277,"statfs":{"total":1600000000,"available":1597724325,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.778796"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.271683+0000","last_change":"2023-10-07T08:43:44.271683+0000","last_active":"2023-10-07T08:43:44.271683+0000","last_peered":"2023-10-07T08:43:44.271683+0000","last_clean":"2023-10-07T08:43:44.271683+0000","last_became_active":"2023-10-07T08:43:44.271459+0000","last_became_peered":"2023-10-07T08:43:44.271459+0000","last_unstale":"2023-10-07T08:43:44.271683+0000","last_undegraded":"2023-10-07T08:43:44.271683+0000","last_fullsized":"2023-10-07T08:43:44.271683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:59:55.645827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.261648+0000","last_change":"2023-10-07T08:43:44.261648+0000","last_active":"2023-10-07T08:43:44.261648+0000","last_peered":"2023-10-07T08:43:44.261648+0000","last_clean":"2023-10-07T08:43:44.261648+0000","last_became_active":"2023-10-07T08:43:44.261436+0000","last_became_peered":"2023-10-07T08:43:44.261436+0000","last_unstale":"2023-10-07T08:43:44.261648+0000","last_undegraded":"2023-10-07T08:43:44.261648+0000","last_fullsized":"2023-10-07T08:43:44.261648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:56:56.094813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.264853+0000","last_change":"2023-10-07T08:43:44.264853+0000","last_active":"2023-10-07T08:43:44.264853+0000","last_peered":"2023-10-07T08:43:44.264853+0000","last_clean":"2023-10-07T08:43:44.264853+0000","last_became_active":"2023-10-07T08:43:44.264643+0000","last_became_peered":"2023-10-07T08:43:44.264643+0000","last_unstale":"2023-10-07T08:43:44.264853+0000","last_undegraded":"2023-10-07T08:43:44.264853+0000","last_fullsized":"2023-10-07T08:43:44.264853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:12:13.779876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.266114+0000","last_change":"2023-10-07T08:43:44.266114+0000","last_active":"2023-10-07T08:43:44.266114+0000","last_peered":"2023-10-07T08:43:44.266114+0000","last_clean":"2023-10-07T08:43:44.266114+0000","last_became_active":"2023-10-07T08:43:44.265826+0000","last_became_peered":"2023-10-07T08:43:44.265826+0000","last_unstale":"2023-10-07T08:43:44.266114+0000","last_undegraded":"2023-10-07T08:43:44.266114+0000","last_fullsized":"2023-10-07T08:43:44.266114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:30:32.421891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.261271+0000","last_change":"2023-10-07T08:43:44.261271+0000","last_active":"2023-10-07T08:43:44.261271+0000","last_peered":"2023-10-07T08:43:44.261271+0000","last_clean":"2023-10-07T08:43:44.261271+0000","last_became_active":"2023-10-07T08:43:44.261087+0000","last_became_peered":"2023-10-07T08:43:44.261087+0000","last_unstale":"2023-10-07T08:43:44.261271+0000","last_undegraded":"2023-10-07T08:43:44.261271+0000","last_fullsized":"2023-10-07T08:43:44.261271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:05:54.982960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.268405+0000","last_change":"2023-10-07T08:43:44.268405+0000","last_active":"2023-10-07T08:43:44.268405+0000","last_peered":"2023-10-07T08:43:44.268405+0000","last_clean":"2023-10-07T08:43:44.268405+0000","last_became_active":"2023-10-07T08:43:44.268277+0000","last_became_peered":"2023-10-07T08:43:44.268277+0000","last_unstale":"2023-10-07T08:43:44.268405+0000","last_undegraded":"2023-10-07T08:43:44.268405+0000","last_fullsized":"2023-10-07T08:43:44.268405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:12:57.047289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267322+0000","last_change":"2023-10-07T08:43:44.267322+0000","last_active":"2023-10-07T08:43:44.267322+0000","last_peered":"2023-10-07T08:43:44.267322+0000","last_clean":"2023-10-07T08:43:44.267322+0000","last_became_active":"2023-10-07T08:43:44.266637+0000","last_became_peered":"2023-10-07T08:43:44.266637+0000","last_unstale":"2023-10-07T08:43:44.267322+0000","last_undegraded":"2023-10-07T08:43:44.267322+0000","last_fullsized":"2023-10-07T08:43:44.267322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:55:12.347575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265699+0000","last_change":"2023-10-07T08:43:44.265699+0000","last_active":"2023-10-07T08:43:44.265699+0000","last_peered":"2023-10-07T08:43:44.265699+0000","last_clean":"2023-10-07T08:43:44.265699+0000","last_became_active":"2023-10-07T08:43:44.265433+0000","last_became_peered":"2023-10-07T08:43:44.265433+0000","last_unstale":"2023-10-07T08:43:44.265699+0000","last_undegraded":"2023-10-07T08:43:44.265699+0000","last_fullsized":"2023-10-07T08:43:44.265699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:49:21.646027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265393+0000","last_change":"2023-10-07T08:43:44.265393+0000","last_active":"2023-10-07T08:43:44.265393+0000","last_peered":"2023-10-07T08:43:44.265393+0000","last_clean":"2023-10-07T08:43:44.265393+0000","last_became_active":"2023-10-07T08:43:44.265076+0000","last_became_peered":"2023-10-07T08:43:44.265076+0000","last_unstale":"2023-10-07T08:43:44.265393+0000","last_undegraded":"2023-10-07T08:43:44.265393+0000","last_fullsized":"2023-10-07T08:43:44.265393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:59:55.645827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.266976+0000","last_change":"2023-10-07T08:43:44.266976+0000","last_active":"2023-10-07T08:43:44.266976+0000","last_peered":"2023-10-07T08:43:44.266976+0000","last_clean":"2023-10-07T08:43:44.266976+0000","last_became_active":"2023-10-07T08:43:44.266435+0000","last_became_peered":"2023-10-07T08:43:44.266435+0000","last_unstale":"2023-10-07T08:43:44.266976+0000","last_undegraded":"2023-10-07T08:43:44.266976+0000","last_fullsized":"2023-10-07T08:43:44.266976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:47:59.648220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.266513+0000","last_change":"2023-10-07T08:43:44.266513+0000","last_active":"2023-10-07T08:43:44.266513+0000","last_peered":"2023-10-07T08:43:44.266513+0000","last_clean":"2023-10-07T08:43:44.266513+0000","last_became_active":"2023-10-07T08:43:44.266171+0000","last_became_peered":"2023-10-07T08:43:44.266171+0000","last_unstale":"2023-10-07T08:43:44.266513+0000","last_undegraded":"2023-10-07T08:43:44.266513+0000","last_fullsized":"2023-10-07T08:43:44.266513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:56:56.094813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.272131+0000","last_change":"2023-10-07T08:43:44.272131+0000","last_active":"2023-10-07T08:43:44.272131+0000","last_peered":"2023-10-07T08:43:44.272131+0000","last_clean":"2023-10-07T08:43:44.272131+0000","last_became_active":"2023-10-07T08:43:44.271451+0000","last_became_peered":"2023-10-07T08:43:44.271451+0000","last_unstale":"2023-10-07T08:43:44.272131+0000","last_undegraded":"2023-10-07T08:43:44.272131+0000","last_fullsized":"2023-10-07T08:43:44.272131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:16:07.493286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.264617+0000","last_change":"2023-10-07T08:43:44.264617+0000","last_active":"2023-10-07T08:43:44.264617+0000","last_peered":"2023-10-07T08:43:44.264617+0000","last_clean":"2023-10-07T08:43:44.264617+0000","last_became_active":"2023-10-07T08:43:44.264415+0000","last_became_peered":"2023-10-07T08:43:44.264415+0000","last_unstale":"2023-10-07T08:43:44.264617+0000","last_undegraded":"2023-10-07T08:43:44.264617+0000","last_fullsized":"2023-10-07T08:43:44.264617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:54:28.889538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.259952+0000","last_change":"2023-10-07T08:43:44.259952+0000","last_active":"2023-10-07T08:43:44.259952+0000","last_peered":"2023-10-07T08:43:44.259952+0000","last_clean":"2023-10-07T08:43:44.259952+0000","last_became_active":"2023-10-07T08:43:44.259732+0000","last_became_peered":"2023-10-07T08:43:44.259732+0000","last_unstale":"2023-10-07T08:43:44.259952+0000","last_undegraded":"2023-10-07T08:43:44.259952+0000","last_fullsized":"2023-10-07T08:43:44.259952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:01:28.124750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267732+0000","last_change":"2023-10-07T08:43:44.267732+0000","last_active":"2023-10-07T08:43:44.267732+0000","last_peered":"2023-10-07T08:43:44.267732+0000","last_clean":"2023-10-07T08:43:44.267732+0000","last_became_active":"2023-10-07T08:43:44.267513+0000","last_became_peered":"2023-10-07T08:43:44.267513+0000","last_unstale":"2023-10-07T08:43:44.267732+0000","last_undegraded":"2023-10-07T08:43:44.267732+0000","last_fullsized":"2023-10-07T08:43:44.267732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:56:56.094813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.270690+0000","last_change":"2023-10-07T08:43:44.270690+0000","last_active":"2023-10-07T08:43:44.270690+0000","last_peered":"2023-10-07T08:43:44.270690+0000","last_clean":"2023-10-07T08:43:44.270690+0000","last_became_active":"2023-10-07T08:43:44.270261+0000","last_became_peered":"2023-10-07T08:43:44.270261+0000","last_unstale":"2023-10-07T08:43:44.270690+0000","last_undegraded":"2023-10-07T08:43:44.270690+0000","last_fullsized":"2023-10-07T08:43:44.270690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:40.832051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267433+0000","last_change":"2023-10-07T08:43:44.267433+0000","last_active":"2023-10-07T08:43:44.267433+0000","last_peered":"2023-10-07T08:43:44.267433+0000","last_clean":"2023-10-07T08:43:44.267433+0000","last_became_active":"2023-10-07T08:43:44.266851+0000","last_became_peered":"2023-10-07T08:43:44.266851+0000","last_unstale":"2023-10-07T08:43:44.267433+0000","last_undegraded":"2023-10-07T08:43:44.267433+0000","last_fullsized":"2023-10-07T08:43:44.267433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:47:59.648220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.264698+0000","last_change":"2023-10-07T08:43:44.264698+0000","last_active":"2023-10-07T08:43:44.264698+0000","last_peered":"2023-10-07T08:43:44.264698+0000","last_clean":"2023-10-07T08:43:44.264698+0000","last_became_active":"2023-10-07T08:43:44.264474+0000","last_became_peered":"2023-10-07T08:43:44.264474+0000","last_unstale":"2023-10-07T08:43:44.264698+0000","last_undegraded":"2023-10-07T08:43:44.264698+0000","last_fullsized":"2023-10-07T08:43:44.264698+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:49:21.646027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265395+0000","last_change":"2023-10-07T08:43:44.265395+0000","last_active":"2023-10-07T08:43:44.265395+0000","last_peered":"2023-10-07T08:43:44.265395+0000","last_clean":"2023-10-07T08:43:44.265395+0000","last_became_active":"2023-10-07T08:43:44.265003+0000","last_became_peered":"2023-10-07T08:43:44.265003+0000","last_unstale":"2023-10-07T08:43:44.265395+0000","last_undegraded":"2023-10-07T08:43:44.265395+0000","last_fullsized":"2023-10-07T08:43:44.265395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:16:07.493286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.262609+0000","last_change":"2023-10-07T08:43:44.262609+0000","last_active":"2023-10-07T08:43:44.262609+0000","last_peered":"2023-10-07T08:43:44.262609+0000","last_clean":"2023-10-07T08:43:44.262609+0000","last_became_active":"2023-10-07T08:43:44.261935+0000","last_became_peered":"2023-10-07T08:43:44.261935+0000","last_unstale":"2023-10-07T08:43:44.262609+0000","last_undegraded":"2023-10-07T08:43:44.262609+0000","last_fullsized":"2023-10-07T08:43:44.262609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:28:35.188852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.262697+0000","last_change":"2023-10-07T08:43:44.262697+0000","last_active":"2023-10-07T08:43:44.262697+0000","last_peered":"2023-10-07T08:43:44.262697+0000","last_clean":"2023-10-07T08:43:44.262697+0000","last_became_active":"2023-10-07T08:43:44.262050+0000","last_became_peered":"2023-10-07T08:43:44.262050+0000","last_unstale":"2023-10-07T08:43:44.262697+0000","last_undegraded":"2023-10-07T08:43:44.262697+0000","last_fullsized":"2023-10-07T08:43:44.262697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:43:32.723213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.261179+0000","last_change":"2023-10-07T08:43:44.261179+0000","last_active":"2023-10-07T08:43:44.261179+0000","last_peered":"2023-10-07T08:43:44.261179+0000","last_clean":"2023-10-07T08:43:44.261179+0000","last_became_active":"2023-10-07T08:43:44.260955+0000","last_became_peered":"2023-10-07T08:43:44.260955+0000","last_unstale":"2023-10-07T08:43:44.261179+0000","last_undegraded":"2023-10-07T08:43:44.261179+0000","last_fullsized":"2023-10-07T08:43:44.261179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:44:54.496304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265287+0000","last_change":"2023-10-07T08:43:44.265287+0000","last_active":"2023-10-07T08:43:44.265287+0000","last_peered":"2023-10-07T08:43:44.265287+0000","last_clean":"2023-10-07T08:43:44.265287+0000","last_became_active":"2023-10-07T08:43:44.265059+0000","last_became_peered":"2023-10-07T08:43:44.265059+0000","last_unstale":"2023-10-07T08:43:44.265287+0000","last_undegraded":"2023-10-07T08:43:44.265287+0000","last_fullsized":"2023-10-07T08:43:44.265287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:44:54.496304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.268156+0000","last_change":"2023-10-07T08:43:44.268156+0000","last_active":"2023-10-07T08:43:44.268156+0000","last_peered":"2023-10-07T08:43:44.268156+0000","last_clean":"2023-10-07T08:43:44.268156+0000","last_became_active":"2023-10-07T08:43:44.267668+0000","last_became_peered":"2023-10-07T08:43:44.267668+0000","last_unstale":"2023-10-07T08:43:44.268156+0000","last_undegraded":"2023-10-07T08:43:44.268156+0000","last_fullsized":"2023-10-07T08:43:44.268156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:12:37.684610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267111+0000","last_change":"2023-10-07T08:43:44.267111+0000","last_active":"2023-10-07T08:43:44.267111+0000","last_peered":"2023-10-07T08:43:44.267111+0000","last_clean":"2023-10-07T08:43:44.267111+0000","last_became_active":"2023-10-07T08:43:44.266725+0000","last_became_peered":"2023-10-07T08:43:44.266725+0000","last_unstale":"2023-10-07T08:43:44.267111+0000","last_undegraded":"2023-10-07T08:43:44.267111+0000","last_fullsized":"2023-10-07T08:43:44.267111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:56:56.094813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267612+0000","last_change":"2023-10-07T08:43:44.267612+0000","last_active":"2023-10-07T08:43:44.267612+0000","last_peered":"2023-10-07T08:43:44.267612+0000","last_clean":"2023-10-07T08:43:44.267612+0000","last_became_active":"2023-10-07T08:43:44.267381+0000","last_became_peered":"2023-10-07T08:43:44.267381+0000","last_unstale":"2023-10-07T08:43:44.267612+0000","last_undegraded":"2023-10-07T08:43:44.267612+0000","last_fullsized":"2023-10-07T08:43:44.267612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:30:32.421891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.268194+0000","last_change":"2023-10-07T08:43:44.268194+0000","last_active":"2023-10-07T08:43:44.268194+0000","last_peered":"2023-10-07T08:43:44.268194+0000","last_clean":"2023-10-07T08:43:44.268194+0000","last_became_active":"2023-10-07T08:43:44.267981+0000","last_became_peered":"2023-10-07T08:43:44.267981+0000","last_unstale":"2023-10-07T08:43:44.268194+0000","last_undegraded":"2023-10-07T08:43:44.268194+0000","last_fullsized":"2023-10-07T08:43:44.268194+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:12:37.684610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.269450+0000","last_change":"2023-10-07T08:43:44.269450+0000","last_active":"2023-10-07T08:43:44.269450+0000","last_peered":"2023-10-07T08:43:44.269450+0000","last_clean":"2023-10-07T08:43:44.269450+0000","last_became_active":"2023-10-07T08:43:44.269045+0000","last_became_peered":"2023-10-07T08:43:44.269045+0000","last_unstale":"2023-10-07T08:43:44.269450+0000","last_undegraded":"2023-10-07T08:43:44.269450+0000","last_fullsized":"2023-10-07T08:43:44.269450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:40.832051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.263522+0000","last_change":"2023-10-07T08:43:44.263522+0000","last_active":"2023-10-07T08:43:44.263522+0000","last_peered":"2023-10-07T08:43:44.263522+0000","last_clean":"2023-10-07T08:43:44.263522+0000","last_became_active":"2023-10-07T08:43:44.263187+0000","last_became_peered":"2023-10-07T08:43:44.263187+0000","last_unstale":"2023-10-07T08:43:44.263522+0000","last_undegraded":"2023-10-07T08:43:44.263522+0000","last_fullsized":"2023-10-07T08:43:44.263522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:00.224155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267332+0000","last_change":"2023-10-07T08:43:44.267332+0000","last_active":"2023-10-07T08:43:44.267332+0000","last_peered":"2023-10-07T08:43:44.267332+0000","last_clean":"2023-10-07T08:43:44.267332+0000","last_became_active":"2023-10-07T08:43:44.266781+0000","last_became_peered":"2023-10-07T08:43:44.266781+0000","last_unstale":"2023-10-07T08:43:44.267332+0000","last_undegraded":"2023-10-07T08:43:44.267332+0000","last_fullsized":"2023-10-07T08:43:44.267332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:33:17.939709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.264141+0000","last_change":"2023-10-07T08:43:44.264141+0000","last_active":"2023-10-07T08:43:44.264141+0000","last_peered":"2023-10-07T08:43:44.264141+0000","last_clean":"2023-10-07T08:43:44.264141+0000","last_became_active":"2023-10-07T08:43:44.263895+0000","last_became_peered":"2023-10-07T08:43:44.263895+0000","last_unstale":"2023-10-07T08:43:44.264141+0000","last_undegraded":"2023-10-07T08:43:44.264141+0000","last_fullsized":"2023-10-07T08:43:44.264141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:35.037578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267559+0000","last_change":"2023-10-07T08:43:44.267559+0000","last_active":"2023-10-07T08:43:44.267559+0000","last_peered":"2023-10-07T08:43:44.267559+0000","last_clean":"2023-10-07T08:43:44.267559+0000","last_became_active":"2023-10-07T08:43:44.267093+0000","last_became_peered":"2023-10-07T08:43:44.267093+0000","last_unstale":"2023-10-07T08:43:44.267559+0000","last_undegraded":"2023-10-07T08:43:44.267559+0000","last_fullsized":"2023-10-07T08:43:44.267559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:25.373968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.262469+0000","last_change":"2023-10-07T08:43:44.262469+0000","last_active":"2023-10-07T08:43:44.262469+0000","last_peered":"2023-10-07T08:43:44.262469+0000","last_clean":"2023-10-07T08:43:44.262469+0000","last_became_active":"2023-10-07T08:43:44.262245+0000","last_became_peered":"2023-10-07T08:43:44.262245+0000","last_unstale":"2023-10-07T08:43:44.262469+0000","last_undegraded":"2023-10-07T08:43:44.262469+0000","last_fullsized":"2023-10-07T08:43:44.262469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:57.371466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.279035+0000","last_change":"2023-10-07T08:43:43.253945+0000","last_active":"2023-10-07T08:43:44.279035+0000","last_peered":"2023-10-07T08:43:44.279035+0000","last_clean":"2023-10-07T08:43:44.279035+0000","last_became_active":"2023-10-07T08:43:43.253714+0000","last_became_peered":"2023-10-07T08:43:43.253714+0000","last_unstale":"2023-10-07T08:43:44.279035+0000","last_undegraded":"2023-10-07T08:43:44.279035+0000","last_fullsized":"2023-10-07T08:43:44.279035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:54:27.883160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.266444+0000","last_change":"2023-10-07T08:43:44.266444+0000","last_active":"2023-10-07T08:43:44.266444+0000","last_peered":"2023-10-07T08:43:44.266444+0000","last_clean":"2023-10-07T08:43:44.266444+0000","last_became_active":"2023-10-07T08:43:44.266236+0000","last_became_peered":"2023-10-07T08:43:44.266236+0000","last_unstale":"2023-10-07T08:43:44.266444+0000","last_undegraded":"2023-10-07T08:43:44.266444+0000","last_fullsized":"2023-10-07T08:43:44.266444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:50:03.669388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.259625+0000","last_change":"2023-10-07T08:43:43.250881+0000","last_active":"2023-10-07T08:43:44.259625+0000","last_peered":"2023-10-07T08:43:44.259625+0000","last_clean":"2023-10-07T08:43:44.259625+0000","last_became_active":"2023-10-07T08:43:43.250425+0000","last_became_peered":"2023-10-07T08:43:43.250425+0000","last_unstale":"2023-10-07T08:43:44.259625+0000","last_undegraded":"2023-10-07T08:43:44.259625+0000","last_fullsized":"2023-10-07T08:43:44.259625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:34.031200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.262853+0000","last_change":"2023-10-07T08:43:44.262853+0000","last_active":"2023-10-07T08:43:44.262853+0000","last_peered":"2023-10-07T08:43:44.262853+0000","last_clean":"2023-10-07T08:43:44.262853+0000","last_became_active":"2023-10-07T08:43:44.262385+0000","last_became_peered":"2023-10-07T08:43:44.262385+0000","last_unstale":"2023-10-07T08:43:44.262853+0000","last_undegraded":"2023-10-07T08:43:44.262853+0000","last_fullsized":"2023-10-07T08:43:44.262853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:39:06.009912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.273786+0000","last_change":"2023-10-07T08:43:43.249825+0000","last_active":"2023-10-07T08:43:44.273786+0000","last_peered":"2023-10-07T08:43:44.273786+0000","last_clean":"2023-10-07T08:43:44.273786+0000","last_became_active":"2023-10-07T08:43:43.249614+0000","last_became_peered":"2023-10-07T08:43:43.249614+0000","last_unstale":"2023-10-07T08:43:44.273786+0000","last_undegraded":"2023-10-07T08:43:44.273786+0000","last_fullsized":"2023-10-07T08:43:44.273786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:05:53.976582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.270289+0000","last_change":"2023-10-07T08:43:44.270289+0000","last_active":"2023-10-07T08:43:44.270289+0000","last_peered":"2023-10-07T08:43:44.270289+0000","last_clean":"2023-10-07T08:43:44.270289+0000","last_became_active":"2023-10-07T08:43:44.270033+0000","last_became_peered":"2023-10-07T08:43:44.270033+0000","last_unstale":"2023-10-07T08:43:44.270289+0000","last_undegraded":"2023-10-07T08:43:44.270289+0000","last_fullsized":"2023-10-07T08:43:44.270289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:19:21.743523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.276520+0000","last_change":"2023-10-07T08:43:43.242865+0000","last_active":"2023-10-07T08:43:44.276520+0000","last_peered":"2023-10-07T08:43:44.276520+0000","last_clean":"2023-10-07T08:43:44.276520+0000","last_became_active":"2023-10-07T08:43:43.242641+0000","last_became_peered":"2023-10-07T08:43:43.242641+0000","last_unstale":"2023-10-07T08:43:44.276520+0000","last_undegraded":"2023-10-07T08:43:44.276520+0000","last_fullsized":"2023-10-07T08:43:44.276520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:31:06.600070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.268379+0000","last_change":"2023-10-07T08:43:44.268379+0000","last_active":"2023-10-07T08:43:44.268379+0000","last_peered":"2023-10-07T08:43:44.268379+0000","last_clean":"2023-10-07T08:43:44.268379+0000","last_became_active":"2023-10-07T08:43:44.268014+0000","last_became_peered":"2023-10-07T08:43:44.268014+0000","last_unstale":"2023-10-07T08:43:44.268379+0000","last_undegraded":"2023-10-07T08:43:44.268379+0000","last_fullsized":"2023-10-07T08:43:44.268379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:05.092869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.256798+0000","last_change":"2023-10-07T08:43:43.251242+0000","last_active":"2023-10-07T08:43:44.256798+0000","last_peered":"2023-10-07T08:43:44.256798+0000","last_clean":"2023-10-07T08:43:44.256798+0000","last_became_active":"2023-10-07T08:43:43.250877+0000","last_became_peered":"2023-10-07T08:43:43.250877+0000","last_unstale":"2023-10-07T08:43:44.256798+0000","last_undegraded":"2023-10-07T08:43:44.256798+0000","last_fullsized":"2023-10-07T08:43:44.256798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:21:47.820187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.271998+0000","last_change":"2023-10-07T08:43:44.271998+0000","last_active":"2023-10-07T08:43:44.271998+0000","last_peered":"2023-10-07T08:43:44.271998+0000","last_clean":"2023-10-07T08:43:44.271998+0000","last_became_active":"2023-10-07T08:43:44.271256+0000","last_became_peered":"2023-10-07T08:43:44.271256+0000","last_unstale":"2023-10-07T08:43:44.271998+0000","last_undegraded":"2023-10-07T08:43:44.271998+0000","last_fullsized":"2023-10-07T08:43:44.271998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:33:17.939709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.257434+0000","last_change":"2023-10-07T08:43:43.247206+0000","last_active":"2023-10-07T08:43:44.257434+0000","last_peered":"2023-10-07T08:43:44.257434+0000","last_clean":"2023-10-07T08:43:44.257434+0000","last_became_active":"2023-10-07T08:43:43.246896+0000","last_became_peered":"2023-10-07T08:43:43.246896+0000","last_unstale":"2023-10-07T08:43:44.257434+0000","last_undegraded":"2023-10-07T08:43:44.257434+0000","last_fullsized":"2023-10-07T08:43:44.257434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:59:45.934372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.268639+0000","last_change":"2023-10-07T08:43:44.268639+0000","last_active":"2023-10-07T08:43:44.268639+0000","last_peered":"2023-10-07T08:43:44.268639+0000","last_clean":"2023-10-07T08:43:44.268639+0000","last_became_active":"2023-10-07T08:43:44.268022+0000","last_became_peered":"2023-10-07T08:43:44.268022+0000","last_unstale":"2023-10-07T08:43:44.268639+0000","last_undegraded":"2023-10-07T08:43:44.268639+0000","last_fullsized":"2023-10-07T08:43:44.268639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:57.371466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.251904+0000","last_change":"2023-10-07T08:43:43.251642+0000","last_active":"2023-10-07T08:43:43.251904+0000","last_peered":"2023-10-07T08:43:43.251904+0000","last_clean":"2023-10-07T08:43:43.251904+0000","last_became_active":"2023-10-07T08:43:43.250356+0000","last_became_peered":"2023-10-07T08:43:43.250356+0000","last_unstale":"2023-10-07T08:43:43.251904+0000","last_undegraded":"2023-10-07T08:43:43.251904+0000","last_fullsized":"2023-10-07T08:43:43.251904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:05:26.567450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.270495+0000","last_change":"2023-10-07T08:43:44.270495+0000","last_active":"2023-10-07T08:43:44.270495+0000","last_peered":"2023-10-07T08:43:44.270495+0000","last_clean":"2023-10-07T08:43:44.270495+0000","last_became_active":"2023-10-07T08:43:44.270316+0000","last_became_peered":"2023-10-07T08:43:44.270316+0000","last_unstale":"2023-10-07T08:43:44.270495+0000","last_undegraded":"2023-10-07T08:43:44.270495+0000","last_fullsized":"2023-10-07T08:43:44.270495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:33:17.939709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.249338+0000","last_change":"2023-10-07T08:43:43.248841+0000","last_active":"2023-10-07T08:43:43.249338+0000","last_peered":"2023-10-07T08:43:43.249338+0000","last_clean":"2023-10-07T08:43:43.249338+0000","last_became_active":"2023-10-07T08:43:43.248307+0000","last_became_peered":"2023-10-07T08:43:43.248307+0000","last_unstale":"2023-10-07T08:43:43.249338+0000","last_undegraded":"2023-10-07T08:43:43.249338+0000","last_fullsized":"2023-10-07T08:43:43.249338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:54:27.883160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.271881+0000","last_change":"2023-10-07T08:43:44.271881+0000","last_active":"2023-10-07T08:43:44.271881+0000","last_peered":"2023-10-07T08:43:44.271881+0000","last_clean":"2023-10-07T08:43:44.271881+0000","last_became_active":"2023-10-07T08:43:44.271013+0000","last_became_peered":"2023-10-07T08:43:44.271013+0000","last_unstale":"2023-10-07T08:43:44.271881+0000","last_undegraded":"2023-10-07T08:43:44.271881+0000","last_fullsized":"2023-10-07T08:43:44.271881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:05.092869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.250218+0000","last_change":"2023-10-07T08:43:43.250142+0000","last_active":"2023-10-07T08:43:43.250218+0000","last_peered":"2023-10-07T08:43:43.250218+0000","last_clean":"2023-10-07T08:43:43.250218+0000","last_became_active":"2023-10-07T08:43:43.249920+0000","last_became_peered":"2023-10-07T08:43:43.249920+0000","last_unstale":"2023-10-07T08:43:43.250218+0000","last_undegraded":"2023-10-07T08:43:43.250218+0000","last_fullsized":"2023-10-07T08:43:43.250218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:34.031200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265437+0000","last_change":"2023-10-07T08:43:44.265437+0000","last_active":"2023-10-07T08:43:44.265437+0000","last_peered":"2023-10-07T08:43:44.265437+0000","last_clean":"2023-10-07T08:43:44.265437+0000","last_became_active":"2023-10-07T08:43:44.265226+0000","last_became_peered":"2023-10-07T08:43:44.265226+0000","last_unstale":"2023-10-07T08:43:44.265437+0000","last_undegraded":"2023-10-07T08:43:44.265437+0000","last_fullsized":"2023-10-07T08:43:44.265437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:12:13.779876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.248583+0000","last_change":"2023-10-07T08:43:43.248519+0000","last_active":"2023-10-07T08:43:43.248583+0000","last_peered":"2023-10-07T08:43:43.248583+0000","last_clean":"2023-10-07T08:43:43.248583+0000","last_became_active":"2023-10-07T08:43:43.248303+0000","last_became_peered":"2023-10-07T08:43:43.248303+0000","last_unstale":"2023-10-07T08:43:43.248583+0000","last_undegraded":"2023-10-07T08:43:43.248583+0000","last_fullsized":"2023-10-07T08:43:43.248583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:37.154520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.263277+0000","last_change":"2023-10-07T08:43:44.263277+0000","last_active":"2023-10-07T08:43:44.263277+0000","last_peered":"2023-10-07T08:43:44.263277+0000","last_clean":"2023-10-07T08:43:44.263277+0000","last_became_active":"2023-10-07T08:43:44.263035+0000","last_became_peered":"2023-10-07T08:43:44.263035+0000","last_unstale":"2023-10-07T08:43:44.263277+0000","last_undegraded":"2023-10-07T08:43:44.263277+0000","last_fullsized":"2023-10-07T08:43:44.263277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:40.832051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.275380+0000","last_change":"2023-10-07T08:43:43.253149+0000","last_active":"2023-10-07T08:43:44.275380+0000","last_peered":"2023-10-07T08:43:44.275380+0000","last_clean":"2023-10-07T08:43:44.275380+0000","last_became_active":"2023-10-07T08:43:43.252636+0000","last_became_peered":"2023-10-07T08:43:43.252636+0000","last_unstale":"2023-10-07T08:43:44.275380+0000","last_undegraded":"2023-10-07T08:43:44.275380+0000","last_fullsized":"2023-10-07T08:43:44.275380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:05:26.567450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.269304+0000","last_change":"2023-10-07T08:43:44.269304+0000","last_active":"2023-10-07T08:43:44.269304+0000","last_peered":"2023-10-07T08:43:44.269304+0000","last_clean":"2023-10-07T08:43:44.269304+0000","last_became_active":"2023-10-07T08:43:44.268801+0000","last_became_peered":"2023-10-07T08:43:44.268801+0000","last_unstale":"2023-10-07T08:43:44.269304+0000","last_undegraded":"2023-10-07T08:43:44.269304+0000","last_fullsized":"2023-10-07T08:43:44.269304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:49:21.646027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.276033+0000","last_change":"2023-10-07T08:43:43.251531+0000","last_active":"2023-10-07T08:43:44.276033+0000","last_peered":"2023-10-07T08:43:44.276033+0000","last_clean":"2023-10-07T08:43:44.276033+0000","last_became_active":"2023-10-07T08:43:43.249901+0000","last_became_peered":"2023-10-07T08:43:43.249901+0000","last_unstale":"2023-10-07T08:43:44.276033+0000","last_undegraded":"2023-10-07T08:43:44.276033+0000","last_fullsized":"2023-10-07T08:43:44.276033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:37.154520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.270630+0000","last_change":"2023-10-07T08:43:44.270630+0000","last_active":"2023-10-07T08:43:44.270630+0000","last_peered":"2023-10-07T08:43:44.270630+0000","last_clean":"2023-10-07T08:43:44.270630+0000","last_became_active":"2023-10-07T08:43:44.270393+0000","last_became_peered":"2023-10-07T08:43:44.270393+0000","last_unstale":"2023-10-07T08:43:44.270630+0000","last_undegraded":"2023-10-07T08:43:44.270630+0000","last_fullsized":"2023-10-07T08:43:44.270630+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:40.832051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.279103+0000","last_change":"2023-10-07T08:43:43.248707+0000","last_active":"2023-10-07T08:43:44.279103+0000","last_peered":"2023-10-07T08:43:44.279103+0000","last_clean":"2023-10-07T08:43:44.279103+0000","last_became_active":"2023-10-07T08:43:43.247994+0000","last_became_peered":"2023-10-07T08:43:43.247994+0000","last_unstale":"2023-10-07T08:43:44.279103+0000","last_undegraded":"2023-10-07T08:43:44.279103+0000","last_fullsized":"2023-10-07T08:43:44.279103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:10:28.075292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.260829+0000","last_change":"2023-10-07T08:43:44.260829+0000","last_active":"2023-10-07T08:43:44.260829+0000","last_peered":"2023-10-07T08:43:44.260829+0000","last_clean":"2023-10-07T08:43:44.260829+0000","last_became_active":"2023-10-07T08:43:44.260608+0000","last_became_peered":"2023-10-07T08:43:44.260608+0000","last_unstale":"2023-10-07T08:43:44.260829+0000","last_undegraded":"2023-10-07T08:43:44.260829+0000","last_fullsized":"2023-10-07T08:43:44.260829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:19:21.743523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.247700+0000","last_change":"2023-10-07T08:43:43.247639+0000","last_active":"2023-10-07T08:43:43.247700+0000","last_peered":"2023-10-07T08:43:43.247700+0000","last_clean":"2023-10-07T08:43:43.247700+0000","last_became_active":"2023-10-07T08:43:43.247414+0000","last_became_peered":"2023-10-07T08:43:43.247414+0000","last_unstale":"2023-10-07T08:43:43.247700+0000","last_undegraded":"2023-10-07T08:43:43.247700+0000","last_fullsized":"2023-10-07T08:43:43.247700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:37.154520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.268226+0000","last_change":"2023-10-07T08:43:44.268226+0000","last_active":"2023-10-07T08:43:44.268226+0000","last_peered":"2023-10-07T08:43:44.268226+0000","last_clean":"2023-10-07T08:43:44.268226+0000","last_became_active":"2023-10-07T08:43:44.267734+0000","last_became_peered":"2023-10-07T08:43:44.267734+0000","last_unstale":"2023-10-07T08:43:44.268226+0000","last_undegraded":"2023-10-07T08:43:44.268226+0000","last_fullsized":"2023-10-07T08:43:44.268226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:16:07.493286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.250959+0000","last_change":"2023-10-07T08:43:43.250623+0000","last_active":"2023-10-07T08:43:43.250959+0000","last_peered":"2023-10-07T08:43:43.250959+0000","last_clean":"2023-10-07T08:43:43.250959+0000","last_became_active":"2023-10-07T08:43:43.250412+0000","last_became_peered":"2023-10-07T08:43:43.250412+0000","last_unstale":"2023-10-07T08:43:43.250959+0000","last_undegraded":"2023-10-07T08:43:43.250959+0000","last_fullsized":"2023-10-07T08:43:43.250959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:50:02.663010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.266874+0000","last_change":"2023-10-07T08:43:44.266874+0000","last_active":"2023-10-07T08:43:44.266874+0000","last_peered":"2023-10-07T08:43:44.266874+0000","last_clean":"2023-10-07T08:43:44.266874+0000","last_became_active":"2023-10-07T08:43:44.266601+0000","last_became_peered":"2023-10-07T08:43:44.266601+0000","last_unstale":"2023-10-07T08:43:44.266874+0000","last_undegraded":"2023-10-07T08:43:44.266874+0000","last_fullsized":"2023-10-07T08:43:44.266874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:21.472980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.277326+0000","last_change":"2023-10-07T08:43:43.249665+0000","last_active":"2023-10-07T08:43:44.277326+0000","last_peered":"2023-10-07T08:43:44.277326+0000","last_clean":"2023-10-07T08:43:44.277326+0000","last_became_active":"2023-10-07T08:43:43.249457+0000","last_became_peered":"2023-10-07T08:43:43.249457+0000","last_unstale":"2023-10-07T08:43:44.277326+0000","last_undegraded":"2023-10-07T08:43:44.277326+0000","last_fullsized":"2023-10-07T08:43:44.277326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:20.466602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.270143+0000","last_change":"2023-10-07T08:43:44.270143+0000","last_active":"2023-10-07T08:43:44.270143+0000","last_peered":"2023-10-07T08:43:44.270143+0000","last_clean":"2023-10-07T08:43:44.270143+0000","last_became_active":"2023-10-07T08:43:44.269924+0000","last_became_peered":"2023-10-07T08:43:44.269924+0000","last_unstale":"2023-10-07T08:43:44.270143+0000","last_undegraded":"2023-10-07T08:43:44.270143+0000","last_fullsized":"2023-10-07T08:43:44.270143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:50:03.669388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.264197+0000","last_change":"2023-10-07T08:43:43.246767+0000","last_active":"2023-10-07T08:43:44.264197+0000","last_peered":"2023-10-07T08:43:44.264197+0000","last_clean":"2023-10-07T08:43:44.264197+0000","last_became_active":"2023-10-07T08:43:43.246503+0000","last_became_peered":"2023-10-07T08:43:43.246503+0000","last_unstale":"2023-10-07T08:43:44.264197+0000","last_undegraded":"2023-10-07T08:43:44.264197+0000","last_fullsized":"2023-10-07T08:43:44.264197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:20.466602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.268287+0000","last_change":"2023-10-07T08:43:44.268287+0000","last_active":"2023-10-07T08:43:44.268287+0000","last_peered":"2023-10-07T08:43:44.268287+0000","last_clean":"2023-10-07T08:43:44.268287+0000","last_became_active":"2023-10-07T08:43:44.267939+0000","last_became_peered":"2023-10-07T08:43:44.267939+0000","last_unstale":"2023-10-07T08:43:44.268287+0000","last_undegraded":"2023-10-07T08:43:44.268287+0000","last_fullsized":"2023-10-07T08:43:44.268287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:30:32.421891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.278905+0000","last_change":"2023-10-07T08:43:43.248553+0000","last_active":"2023-10-07T08:43:44.278905+0000","last_peered":"2023-10-07T08:43:44.278905+0000","last_clean":"2023-10-07T08:43:44.278905+0000","last_became_active":"2023-10-07T08:43:43.247671+0000","last_became_peered":"2023-10-07T08:43:43.247671+0000","last_unstale":"2023-10-07T08:43:44.278905+0000","last_undegraded":"2023-10-07T08:43:44.278905+0000","last_fullsized":"2023-10-07T08:43:44.278905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:48:14.257990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267129+0000","last_change":"2023-10-07T08:43:44.267129+0000","last_active":"2023-10-07T08:43:44.267129+0000","last_peered":"2023-10-07T08:43:44.267129+0000","last_clean":"2023-10-07T08:43:44.267129+0000","last_became_active":"2023-10-07T08:43:44.266935+0000","last_became_peered":"2023-10-07T08:43:44.266935+0000","last_unstale":"2023-10-07T08:43:44.267129+0000","last_undegraded":"2023-10-07T08:43:44.267129+0000","last_fullsized":"2023-10-07T08:43:44.267129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:55:12.347575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.257481+0000","last_change":"2023-10-07T08:43:43.245449+0000","last_active":"2023-10-07T08:43:44.257481+0000","last_peered":"2023-10-07T08:43:44.257481+0000","last_clean":"2023-10-07T08:43:44.257481+0000","last_became_active":"2023-10-07T08:43:43.244960+0000","last_became_peered":"2023-10-07T08:43:43.244960+0000","last_unstale":"2023-10-07T08:43:44.257481+0000","last_undegraded":"2023-10-07T08:43:44.257481+0000","last_fullsized":"2023-10-07T08:43:44.257481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:28:00.638236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.266956+0000","last_change":"2023-10-07T08:43:44.266956+0000","last_active":"2023-10-07T08:43:44.266956+0000","last_peered":"2023-10-07T08:43:44.266956+0000","last_clean":"2023-10-07T08:43:44.266956+0000","last_became_active":"2023-10-07T08:43:44.266723+0000","last_became_peered":"2023-10-07T08:43:44.266723+0000","last_unstale":"2023-10-07T08:43:44.266956+0000","last_undegraded":"2023-10-07T08:43:44.266956+0000","last_fullsized":"2023-10-07T08:43:44.266956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:45:38.127813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.251297+0000","last_change":"2023-10-07T08:43:43.251101+0000","last_active":"2023-10-07T08:43:43.251297+0000","last_peered":"2023-10-07T08:43:43.251297+0000","last_clean":"2023-10-07T08:43:43.251297+0000","last_became_active":"2023-10-07T08:43:43.250552+0000","last_became_peered":"2023-10-07T08:43:43.250552+0000","last_unstale":"2023-10-07T08:43:43.251297+0000","last_undegraded":"2023-10-07T08:43:43.251297+0000","last_fullsized":"2023-10-07T08:43:43.251297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:58.169140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.259225+0000","last_change":"2023-10-07T08:43:44.259225+0000","last_active":"2023-10-07T08:43:44.259225+0000","last_peered":"2023-10-07T08:43:44.259225+0000","last_clean":"2023-10-07T08:43:44.259225+0000","last_became_active":"2023-10-07T08:43:44.259007+0000","last_became_peered":"2023-10-07T08:43:44.259007+0000","last_unstale":"2023-10-07T08:43:44.259225+0000","last_undegraded":"2023-10-07T08:43:44.259225+0000","last_fullsized":"2023-10-07T08:43:44.259225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:01:12.346582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.277657+0000","last_change":"2023-10-07T08:43:43.244426+0000","last_active":"2023-10-07T08:43:44.277657+0000","last_peered":"2023-10-07T08:43:44.277657+0000","last_clean":"2023-10-07T08:43:44.277657+0000","last_became_active":"2023-10-07T08:43:43.243899+0000","last_became_peered":"2023-10-07T08:43:43.243899+0000","last_unstale":"2023-10-07T08:43:44.277657+0000","last_undegraded":"2023-10-07T08:43:44.277657+0000","last_fullsized":"2023-10-07T08:43:44.277657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:45:37.121435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.259751+0000","last_change":"2023-10-07T08:43:44.259751+0000","last_active":"2023-10-07T08:43:44.259751+0000","last_peered":"2023-10-07T08:43:44.259751+0000","last_clean":"2023-10-07T08:43:44.259751+0000","last_became_active":"2023-10-07T08:43:44.259541+0000","last_became_peered":"2023-10-07T08:43:44.259541+0000","last_unstale":"2023-10-07T08:43:44.259751+0000","last_undegraded":"2023-10-07T08:43:44.259751+0000","last_fullsized":"2023-10-07T08:43:44.259751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:03:07.495229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.251418+0000","last_change":"2023-10-07T08:43:43.251361+0000","last_active":"2023-10-07T08:43:43.251418+0000","last_peered":"2023-10-07T08:43:43.251418+0000","last_clean":"2023-10-07T08:43:43.251418+0000","last_became_active":"2023-10-07T08:43:43.250790+0000","last_became_peered":"2023-10-07T08:43:43.250790+0000","last_unstale":"2023-10-07T08:43:43.251418+0000","last_undegraded":"2023-10-07T08:43:43.251418+0000","last_fullsized":"2023-10-07T08:43:43.251418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:03:06.488851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.260850+0000","last_change":"2023-10-07T08:43:44.260850+0000","last_active":"2023-10-07T08:43:44.260850+0000","last_peered":"2023-10-07T08:43:44.260850+0000","last_clean":"2023-10-07T08:43:44.260850+0000","last_became_active":"2023-10-07T08:43:44.260622+0000","last_became_peered":"2023-10-07T08:43:44.260622+0000","last_unstale":"2023-10-07T08:43:44.260850+0000","last_undegraded":"2023-10-07T08:43:44.260850+0000","last_fullsized":"2023-10-07T08:43:44.260850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:10:29.081670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.244601+0000","last_change":"2023-10-07T08:43:43.244091+0000","last_active":"2023-10-07T08:43:43.244601+0000","last_peered":"2023-10-07T08:43:43.244601+0000","last_clean":"2023-10-07T08:43:43.244601+0000","last_became_active":"2023-10-07T08:43:43.243776+0000","last_became_peered":"2023-10-07T08:43:43.243776+0000","last_unstale":"2023-10-07T08:43:43.244601+0000","last_undegraded":"2023-10-07T08:43:43.244601+0000","last_fullsized":"2023-10-07T08:43:43.244601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:50.638193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267466+0000","last_change":"2023-10-07T08:43:44.267466+0000","last_active":"2023-10-07T08:43:44.267466+0000","last_peered":"2023-10-07T08:43:44.267466+0000","last_clean":"2023-10-07T08:43:44.267466+0000","last_became_active":"2023-10-07T08:43:44.267102+0000","last_became_peered":"2023-10-07T08:43:44.267102+0000","last_unstale":"2023-10-07T08:43:44.267466+0000","last_undegraded":"2023-10-07T08:43:44.267466+0000","last_fullsized":"2023-10-07T08:43:44.267466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:30:32.421891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.252910+0000","last_change":"2023-10-07T08:43:43.252849+0000","last_active":"2023-10-07T08:43:43.252910+0000","last_peered":"2023-10-07T08:43:43.252910+0000","last_clean":"2023-10-07T08:43:43.252910+0000","last_became_active":"2023-10-07T08:43:43.252599+0000","last_became_peered":"2023-10-07T08:43:43.252599+0000","last_unstale":"2023-10-07T08:43:43.252910+0000","last_undegraded":"2023-10-07T08:43:43.252910+0000","last_fullsized":"2023-10-07T08:43:43.252910+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:34.031200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.270974+0000","last_change":"2023-10-07T08:43:44.270974+0000","last_active":"2023-10-07T08:43:44.270974+0000","last_peered":"2023-10-07T08:43:44.270974+0000","last_clean":"2023-10-07T08:43:44.270974+0000","last_became_active":"2023-10-07T08:43:44.270837+0000","last_became_peered":"2023-10-07T08:43:44.270837+0000","last_unstale":"2023-10-07T08:43:44.270974+0000","last_undegraded":"2023-10-07T08:43:44.270974+0000","last_fullsized":"2023-10-07T08:43:44.270974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:15.874391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.274608+0000","last_change":"2023-10-07T08:43:43.248288+0000","last_active":"2023-10-07T08:43:44.274608+0000","last_peered":"2023-10-07T08:43:44.274608+0000","last_clean":"2023-10-07T08:43:44.274608+0000","last_became_active":"2023-10-07T08:43:43.247931+0000","last_became_peered":"2023-10-07T08:43:43.247931+0000","last_unstale":"2023-10-07T08:43:44.274608+0000","last_undegraded":"2023-10-07T08:43:44.274608+0000","last_fullsized":"2023-10-07T08:43:44.274608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:05:26.567450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.271666+0000","last_change":"2023-10-07T08:43:44.271666+0000","last_active":"2023-10-07T08:43:44.271666+0000","last_peered":"2023-10-07T08:43:44.271666+0000","last_clean":"2023-10-07T08:43:44.271666+0000","last_became_active":"2023-10-07T08:43:44.270755+0000","last_became_peered":"2023-10-07T08:43:44.270755+0000","last_unstale":"2023-10-07T08:43:44.271666+0000","last_undegraded":"2023-10-07T08:43:44.271666+0000","last_fullsized":"2023-10-07T08:43:44.271666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:01:28.124750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.245017+0000","last_change":"2023-10-07T08:43:43.244936+0000","last_active":"2023-10-07T08:43:43.245017+0000","last_peered":"2023-10-07T08:43:43.245017+0000","last_clean":"2023-10-07T08:43:43.245017+0000","last_became_active":"2023-10-07T08:43:43.244195+0000","last_became_peered":"2023-10-07T08:43:43.244195+0000","last_unstale":"2023-10-07T08:43:43.245017+0000","last_undegraded":"2023-10-07T08:43:43.245017+0000","last_fullsized":"2023-10-07T08:43:43.245017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:05:53.976582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265119+0000","last_change":"2023-10-07T08:43:44.265119+0000","last_active":"2023-10-07T08:43:44.265119+0000","last_peered":"2023-10-07T08:43:44.265119+0000","last_clean":"2023-10-07T08:43:44.265119+0000","last_became_active":"2023-10-07T08:43:44.264895+0000","last_became_peered":"2023-10-07T08:43:44.264895+0000","last_unstale":"2023-10-07T08:43:44.265119+0000","last_undegraded":"2023-10-07T08:43:44.265119+0000","last_fullsized":"2023-10-07T08:43:44.265119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:43:32.723213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.243868+0000","last_change":"2023-10-07T08:43:43.243739+0000","last_active":"2023-10-07T08:43:43.243868+0000","last_peered":"2023-10-07T08:43:43.243868+0000","last_clean":"2023-10-07T08:43:43.243868+0000","last_became_active":"2023-10-07T08:43:43.243330+0000","last_became_peered":"2023-10-07T08:43:43.243330+0000","last_unstale":"2023-10-07T08:43:43.243868+0000","last_undegraded":"2023-10-07T08:43:43.243868+0000","last_fullsized":"2023-10-07T08:43:43.243868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:45:37.121435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.262429+0000","last_change":"2023-10-07T08:43:44.262429+0000","last_active":"2023-10-07T08:43:44.262429+0000","last_peered":"2023-10-07T08:43:44.262429+0000","last_clean":"2023-10-07T08:43:44.262429+0000","last_became_active":"2023-10-07T08:43:44.262217+0000","last_became_peered":"2023-10-07T08:43:44.262217+0000","last_unstale":"2023-10-07T08:43:44.262429+0000","last_undegraded":"2023-10-07T08:43:44.262429+0000","last_fullsized":"2023-10-07T08:43:44.262429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:38.160898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.253430+0000","last_change":"2023-10-07T08:43:43.253343+0000","last_active":"2023-10-07T08:43:43.253430+0000","last_peered":"2023-10-07T08:43:43.253430+0000","last_clean":"2023-10-07T08:43:43.253430+0000","last_became_active":"2023-10-07T08:43:43.253177+0000","last_became_peered":"2023-10-07T08:43:43.253177+0000","last_unstale":"2023-10-07T08:43:43.253430+0000","last_undegraded":"2023-10-07T08:43:43.253430+0000","last_fullsized":"2023-10-07T08:43:43.253430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:14.868013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265562+0000","last_change":"2023-10-07T08:43:44.265562+0000","last_active":"2023-10-07T08:43:44.265562+0000","last_peered":"2023-10-07T08:43:44.265562+0000","last_clean":"2023-10-07T08:43:44.265562+0000","last_became_active":"2023-10-07T08:43:44.265344+0000","last_became_peered":"2023-10-07T08:43:44.265344+0000","last_unstale":"2023-10-07T08:43:44.265562+0000","last_undegraded":"2023-10-07T08:43:44.265562+0000","last_fullsized":"2023-10-07T08:43:44.265562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:39:06.009912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.248519+0000","last_change":"2023-10-07T08:43:43.248147+0000","last_active":"2023-10-07T08:43:43.248519+0000","last_peered":"2023-10-07T08:43:43.248519+0000","last_clean":"2023-10-07T08:43:43.248519+0000","last_became_active":"2023-10-07T08:43:43.247269+0000","last_became_peered":"2023-10-07T08:43:43.247269+0000","last_unstale":"2023-10-07T08:43:43.248519+0000","last_undegraded":"2023-10-07T08:43:43.248519+0000","last_fullsized":"2023-10-07T08:43:43.248519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:34.031200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265485+0000","last_change":"2023-10-07T08:43:44.265485+0000","last_active":"2023-10-07T08:43:44.265485+0000","last_peered":"2023-10-07T08:43:44.265485+0000","last_clean":"2023-10-07T08:43:44.265485+0000","last_became_active":"2023-10-07T08:43:44.265257+0000","last_became_peered":"2023-10-07T08:43:44.265257+0000","last_unstale":"2023-10-07T08:43:44.265485+0000","last_undegraded":"2023-10-07T08:43:44.265485+0000","last_fullsized":"2023-10-07T08:43:44.265485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:05.092869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.252323+0000","last_change":"2023-10-07T08:43:43.252240+0000","last_active":"2023-10-07T08:43:43.252323+0000","last_peered":"2023-10-07T08:43:43.252323+0000","last_clean":"2023-10-07T08:43:43.252323+0000","last_became_active":"2023-10-07T08:43:43.251995+0000","last_became_peered":"2023-10-07T08:43:43.251995+0000","last_unstale":"2023-10-07T08:43:43.252323+0000","last_undegraded":"2023-10-07T08:43:43.252323+0000","last_fullsized":"2023-10-07T08:43:43.252323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:03:06.488851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.262304+0000","last_change":"2023-10-07T08:43:44.262304+0000","last_active":"2023-10-07T08:43:44.262304+0000","last_peered":"2023-10-07T08:43:44.262304+0000","last_clean":"2023-10-07T08:43:44.262304+0000","last_became_active":"2023-10-07T08:43:44.261662+0000","last_became_peered":"2023-10-07T08:43:44.261662+0000","last_unstale":"2023-10-07T08:43:44.262304+0000","last_undegraded":"2023-10-07T08:43:44.262304+0000","last_fullsized":"2023-10-07T08:43:44.262304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:18:10.633307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.252325+0000","last_change":"2023-10-07T08:43:43.252243+0000","last_active":"2023-10-07T08:43:43.252325+0000","last_peered":"2023-10-07T08:43:43.252325+0000","last_clean":"2023-10-07T08:43:43.252325+0000","last_became_active":"2023-10-07T08:43:43.251309+0000","last_became_peered":"2023-10-07T08:43:43.251309+0000","last_unstale":"2023-10-07T08:43:43.252325+0000","last_undegraded":"2023-10-07T08:43:43.252325+0000","last_fullsized":"2023-10-07T08:43:43.252325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:59:54.639449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265976+0000","last_change":"2023-10-07T08:43:44.265976+0000","last_active":"2023-10-07T08:43:44.265976+0000","last_peered":"2023-10-07T08:43:44.265976+0000","last_clean":"2023-10-07T08:43:44.265976+0000","last_became_active":"2023-10-07T08:43:44.265713+0000","last_became_peered":"2023-10-07T08:43:44.265713+0000","last_unstale":"2023-10-07T08:43:44.265976+0000","last_undegraded":"2023-10-07T08:43:44.265976+0000","last_fullsized":"2023-10-07T08:43:44.265976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:01:28.124750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.251529+0000","last_change":"2023-10-07T08:43:43.251484+0000","last_active":"2023-10-07T08:43:43.251529+0000","last_peered":"2023-10-07T08:43:43.251529+0000","last_clean":"2023-10-07T08:43:43.251529+0000","last_became_active":"2023-10-07T08:43:43.251112+0000","last_became_peered":"2023-10-07T08:43:43.251112+0000","last_unstale":"2023-10-07T08:43:43.251529+0000","last_undegraded":"2023-10-07T08:43:43.251529+0000","last_fullsized":"2023-10-07T08:43:43.251529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:10:28.075292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.249207+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:43:43.249207+0000","last_peered":"2023-10-07T08:43:43.249207+0000","last_clean":"2023-10-07T08:43:43.249207+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:43:43.249207+0000","last_undegraded":"2023-10-07T08:43:43.249207+0000","last_fullsized":"2023-10-07T08:43:43.249207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194601,"statfs":{"total":200000000,"available":199272404,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":134,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199862184,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199861214,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194601,"statfs":{"total":200000000,"available":199272404,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.378}]},{"osd":2,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.314}]},{"osd":3,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.39400000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.48499999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.443}]},{"osd":6,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.54900000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.46999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":134,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862702,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199861214,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":134,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862668,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":127,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195185,"statfs":{"total":200000000,"available":199869535,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]}],"pool_statfs":[]}} 2023-10-07T08:43:48.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:43:48.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.473+0000 7efcdbfff700 1 Processor -- start 2023-10-07T08:43:48.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.473+0000 7efcdbfff700 1 -- start start 2023-10-07T08:43:48.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.474+0000 7efcdbfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc159b40 0x7efcdc0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.474+0000 7efcdbfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc0cee10 con 0x7efcdc159f10 2023-10-07T08:43:48.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.474+0000 7efcdbfff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc0cd040 con 0x7efcdc068e90 2023-10-07T08:43:48.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.474+0000 7efcdbfff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0cd320 con 0x7efcdc159b40 2023-10-07T08:43:48.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.474+0000 7efcda7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efcdc159f10 0x7efcdc068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50170/0 (socket says 172.21.15.81:50170) 2023-10-07T08:43:48.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.474+0000 7efcda7fc700 1 -- 172.21.15.81:0/3501644390 learned_addr learned my addr 172.21.15.81:0/3501644390 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:48.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.474+0000 7efcdaffd700 1 --2- 172.21.15.81:0/3501644390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc159b40 0x7efcdc0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.474+0000 7efcd9ffb700 1 -- 172.21.15.81:0/3501644390 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271933405 0 0) 0x7efcdc0cee10 con 0x7efcdc159f10 2023-10-07T08:43:48.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.474+0000 7efcd9ffb700 1 -- 172.21.15.81:0/3501644390 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcc4003570 con 0x7efcdc159f10 2023-10-07T08:43:48.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcd9ffb700 1 -- 172.21.15.81:0/3501644390 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3316452381 0 0) 0x7efcc4003570 con 0x7efcdc159f10 2023-10-07T08:43:48.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcd9ffb700 1 -- 172.21.15.81:0/3501644390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc159b40 msgr2=0x7efcdc0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:48.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcd9ffb700 1 --2- 172.21.15.81:0/3501644390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc159b40 0x7efcdc0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcd9ffb700 1 -- 172.21.15.81:0/3501644390 >> v1:172.21.15.89:6789/0 conn(0x7efcdc068e90 legacy=0x7efcdc0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcd9ffb700 1 -- 172.21.15.81:0/3501644390 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0ce7c0 con 0x7efcdc159f10 2023-10-07T08:43:48.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcd9ffb700 1 -- 172.21.15.81:0/3501644390 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7efcd0001470 con 0x7efcdc159f10 2023-10-07T08:43:48.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcd9ffb700 1 -- 172.21.15.81:0/3501644390 >> v1:172.21.15.81:6789/0 conn(0x7efcdc159f10 legacy=0x7efcdc068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcd9ffb700 1 --2- 172.21.15.81:0/3501644390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc159b40 0x7efcc4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcd9ffb700 1 --2- 172.21.15.81:0/3501644390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4003fd0 0x7efcc4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcd9ffb700 1 --2- 172.21.15.81:0/3501644390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcc4004d50 0x7efcc40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcd9ffb700 1 -- 172.21.15.81:0/3501644390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0cd320 con 0x7efcc4003fd0 2023-10-07T08:43:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcd9ffb700 1 -- 172.21.15.81:0/3501644390 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc400bb40 con 0x7efcc4004d50 2023-10-07T08:43:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcd9ffb700 1 -- 172.21.15.81:0/3501644390 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc400bd00 con 0x7efcdc159b40 2023-10-07T08:43:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcda7fc700 1 --2- 172.21.15.81:0/3501644390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4003fd0 0x7efcc4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcdaffd700 1 --2- 172.21.15.81:0/3501644390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc159b40 0x7efcc4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcdb7fe700 1 --2- 172.21.15.81:0/3501644390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcc4004d50 0x7efcc40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcda7fc700 1 -- 172.21.15.81:0/3501644390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc159b40 msgr2=0x7efcc4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcda7fc700 1 --2- 172.21.15.81:0/3501644390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc159b40 0x7efcc4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcda7fc700 1 -- 172.21.15.81:0/3501644390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcc4004d50 msgr2=0x7efcc40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcda7fc700 1 --2- 172.21.15.81:0/3501644390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcc4004d50 0x7efcc40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcda7fc700 1 -- 172.21.15.81:0/3501644390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc4003570 con 0x7efcc4003fd0 2023-10-07T08:43:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcda7fc700 1 --2- 172.21.15.81:0/3501644390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4003fd0 0x7efcc4004810 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efcd000c3c0 tx=0x7efcd0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2050af8ea160f4e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcd9ffb700 1 -- 172.21.15.81:0/3501644390 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd000cc90 con 0x7efcc4003fd0 2023-10-07T08:43:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcd9ffb700 1 -- 172.21.15.81:0/3501644390 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd000cdf0 con 0x7efcc4003fd0 2023-10-07T08:43:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.475+0000 7efcd9ffb700 1 -- 172.21.15.81:0/3501644390 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd0005b70 con 0x7efcc4003fd0 2023-10-07T08:43:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.476+0000 7efcdbfff700 1 -- 172.21.15.81:0/3501644390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4003fd0 msgr2=0x7efcc4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.476+0000 7efcdbfff700 1 --2- 172.21.15.81:0/3501644390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4003fd0 0x7efcc4004810 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efcd000c3c0 tx=0x7efcd0001e70 comp rx=0 tx=0).stop 2023-10-07T08:43:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.476+0000 7efcdb7fe700 1 -- 172.21.15.81:0/3501644390 reap_dead start 2023-10-07T08:43:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.476+0000 7efcdbfff700 1 -- 172.21.15.81:0/3501644390 shutdown_connections 2023-10-07T08:43:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.476+0000 7efcdbfff700 1 -- 172.21.15.81:0/3501644390 >> 172.21.15.81:0/3501644390 conn(0x7efcdc0cd660 msgr2=0x7efcdc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.476+0000 7efcdbfff700 1 -- 172.21.15.81:0/3501644390 shutdown_connections 2023-10-07T08:43:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.476+0000 7efcdbfff700 1 -- 172.21.15.81:0/3501644390 wait complete. 2023-10-07T08:43:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.477+0000 7efcdbfff700 1 Processor -- start 2023-10-07T08:43:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.477+0000 7efcdbfff700 1 -- start start 2023-10-07T08:43:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcdbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4003fd0 0x7efcdc167f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcdbfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc16b4d0 0x7efcdc16ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcdbfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcdc0ca040 0x7efcdc0aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcdbfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc14c1e0 con 0x7efcc4003fd0 2023-10-07T08:43:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcdbfff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc16c6a0 con 0x7efcdc0ca040 2023-10-07T08:43:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcdbfff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc16ba90 con 0x7efcdc16b4d0 2023-10-07T08:43:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcdaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4003fd0 0x7efcdc167f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcdaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4003fd0 0x7efcdc167f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34052/0 (socket says 172.21.15.81:34052) 2023-10-07T08:43:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcdaffd700 1 -- 172.21.15.81:0/1016915130 learned_addr learned my addr 172.21.15.81:0/1016915130 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcdb7fe700 1 --2- 172.21.15.81:0/1016915130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcdc0ca040 0x7efcdc0aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcda7fc700 1 --2- 172.21.15.81:0/1016915130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc16b4d0 0x7efcdc16ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcdaffd700 1 -- 172.21.15.81:0/1016915130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc16b4d0 msgr2=0x7efcdc16ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcdaffd700 1 --2- 172.21.15.81:0/1016915130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc16b4d0 0x7efcdc16ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcdaffd700 1 -- 172.21.15.81:0/1016915130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcdc0ca040 msgr2=0x7efcdc0aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcdaffd700 1 --2- 172.21.15.81:0/1016915130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcdc0ca040 0x7efcdc0aea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcdaffd700 1 -- 172.21.15.81:0/1016915130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc16bd70 con 0x7efcc4003fd0 2023-10-07T08:43:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.478+0000 7efcdaffd700 1 --2- 172.21.15.81:0/1016915130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4003fd0 0x7efcdc167f40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efccc011f80 tx=0x7efccc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.479+0000 7efcc2ffd700 1 -- 172.21.15.81:0/1016915130 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc00e040 con 0x7efcc4003fd0 2023-10-07T08:43:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.479+0000 7efcc2ffd700 1 -- 172.21.15.81:0/1016915130 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc00f040 con 0x7efcc4003fd0 2023-10-07T08:43:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.479+0000 7efcdbfff700 1 -- 172.21.15.81:0/1016915130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc16c050 con 0x7efcc4003fd0 2023-10-07T08:43:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.479+0000 7efcc2ffd700 1 -- 172.21.15.81:0/1016915130 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc015430 con 0x7efcc4003fd0 2023-10-07T08:43:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.479+0000 7efcdbfff700 1 -- 172.21.15.81:0/1016915130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc168480 con 0x7efcc4003fd0 2023-10-07T08:43:48.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.480+0000 7efcdbfff700 1 -- 172.21.15.81:0/1016915130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc0cb890 con 0x7efcc4003fd0 2023-10-07T08:43:48.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.480+0000 7efcc2ffd700 1 -- 172.21.15.81:0/1016915130 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efccc0157e0 con 0x7efcc4003fd0 2023-10-07T08:43:48.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.480+0000 7efcc2ffd700 1 --2- 172.21.15.81:0/1016915130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efcc8066f30 0x7efcc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.480+0000 7efcda7fc700 1 --2- 172.21.15.81:0/1016915130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efcc8066f30 0x7efcc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.481+0000 7efcc2ffd700 1 -- 172.21.15.81:0/1016915130 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efccc085150 con 0x7efcc4003fd0 2023-10-07T08:43:48.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.481+0000 7efcda7fc700 1 --2- 172.21.15.81:0/1016915130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efcc8066f30 0x7efcc80693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efcd0001ed0 tx=0x7efcd0015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:48.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.485+0000 7efcc2ffd700 1 -- 172.21.15.81:0/1016915130 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efccc0523c0 con 0x7efcc4003fd0 2023-10-07T08:43:48.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.661+0000 7efcdbfff700 1 -- 172.21.15.81:0/1016915130 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efcdc0ceaa0 con 0x7efcc8066f30 2023-10-07T08:43:48.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.668+0000 7efcc2ffd700 1 -- 172.21.15.81:0/1016915130 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263088 (secure 0 0 0) 0x7efcdc0ceaa0 con 0x7efcc8066f30 2023-10-07T08:43:48.676 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:48.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.672+0000 7efcdbfff700 1 -- 172.21.15.81:0/1016915130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efcc8066f30 msgr2=0x7efcc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.672+0000 7efcdbfff700 1 --2- 172.21.15.81:0/1016915130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efcc8066f30 0x7efcc80693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efcd0001ed0 tx=0x7efcd0015000 comp rx=0 tx=0).stop 2023-10-07T08:43:48.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.672+0000 7efcdbfff700 1 -- 172.21.15.81:0/1016915130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4003fd0 msgr2=0x7efcdc167f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.672+0000 7efcdbfff700 1 --2- 172.21.15.81:0/1016915130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4003fd0 0x7efcdc167f40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efccc011f80 tx=0x7efccc00b040 comp rx=0 tx=0).stop 2023-10-07T08:43:48.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.672+0000 7efcdbfff700 1 -- 172.21.15.81:0/1016915130 shutdown_connections 2023-10-07T08:43:48.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.672+0000 7efcdbfff700 1 --2- 172.21.15.81:0/1016915130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcdc0ca040 0x7efcdc0aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.672+0000 7efcdbfff700 1 --2- 172.21.15.81:0/1016915130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4003fd0 0x7efcdc167f40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.672+0000 7efcdbfff700 1 --2- 172.21.15.81:0/1016915130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efcc8066f30 0x7efcc80693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.672+0000 7efcdbfff700 1 --2- 172.21.15.81:0/1016915130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc16b4d0 0x7efcdc16ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.672+0000 7efcdbfff700 1 -- 172.21.15.81:0/1016915130 >> 172.21.15.81:0/1016915130 conn(0x7efcdc0cd660 msgr2=0x7efcdc06d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:48.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.672+0000 7efcdbfff700 1 -- 172.21.15.81:0/1016915130 shutdown_connections 2023-10-07T08:43:48.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.672+0000 7efcdbfff700 1 -- 172.21.15.81:0/1016915130 wait complete. 2023-10-07T08:43:48.681 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:43:48.685 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-10-07T08:43:48.016249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560277,"statfs":{"total":1600000000,"available":1597724325,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.778796"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.271683+0000","last_change":"2023-10-07T08:43:44.271683+0000","last_active":"2023-10-07T08:43:44.271683+0000","last_peered":"2023-10-07T08:43:44.271683+0000","last_clean":"2023-10-07T08:43:44.271683+0000","last_became_active":"2023-10-07T08:43:44.271459+0000","last_became_peered":"2023-10-07T08:43:44.271459+0000","last_unstale":"2023-10-07T08:43:44.271683+0000","last_undegraded":"2023-10-07T08:43:44.271683+0000","last_fullsized":"2023-10-07T08:43:44.271683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:59:55.645827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.261648+0000","last_change":"2023-10-07T08:43:44.261648+0000","last_active":"2023-10-07T08:43:44.261648+0000","last_peered":"2023-10-07T08:43:44.261648+0000","last_clean":"2023-10-07T08:43:44.261648+0000","last_became_active":"2023-10-07T08:43:44.261436+0000","last_became_peered":"2023-10-07T08:43:44.261436+0000","last_unstale":"2023-10-07T08:43:44.261648+0000","last_undegraded":"2023-10-07T08:43:44.261648+0000","last_fullsized":"2023-10-07T08:43:44.261648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:56:56.094813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.264853+0000","last_change":"2023-10-07T08:43:44.264853+0000","last_active":"2023-10-07T08:43:44.264853+0000","last_peered":"2023-10-07T08:43:44.264853+0000","last_clean":"2023-10-07T08:43:44.264853+0000","last_became_active":"2023-10-07T08:43:44.264643+0000","last_became_peered":"2023-10-07T08:43:44.264643+0000","last_unstale":"2023-10-07T08:43:44.264853+0000","last_undegraded":"2023-10-07T08:43:44.264853+0000","last_fullsized":"2023-10-07T08:43:44.264853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:12:13.779876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.266114+0000","last_change":"2023-10-07T08:43:44.266114+0000","last_active":"2023-10-07T08:43:44.266114+0000","last_peered":"2023-10-07T08:43:44.266114+0000","last_clean":"2023-10-07T08:43:44.266114+0000","last_became_active":"2023-10-07T08:43:44.265826+0000","last_became_peered":"2023-10-07T08:43:44.265826+0000","last_unstale":"2023-10-07T08:43:44.266114+0000","last_undegraded":"2023-10-07T08:43:44.266114+0000","last_fullsized":"2023-10-07T08:43:44.266114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:30:32.421891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.261271+0000","last_change":"2023-10-07T08:43:44.261271+0000","last_active":"2023-10-07T08:43:44.261271+0000","last_peered":"2023-10-07T08:43:44.261271+0000","last_clean":"2023-10-07T08:43:44.261271+0000","last_became_active":"2023-10-07T08:43:44.261087+0000","last_became_peered":"2023-10-07T08:43:44.261087+0000","last_unstale":"2023-10-07T08:43:44.261271+0000","last_undegraded":"2023-10-07T08:43:44.261271+0000","last_fullsized":"2023-10-07T08:43:44.261271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:05:54.982960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.268405+0000","last_change":"2023-10-07T08:43:44.268405+0000","last_active":"2023-10-07T08:43:44.268405+0000","last_peered":"2023-10-07T08:43:44.268405+0000","last_clean":"2023-10-07T08:43:44.268405+0000","last_became_active":"2023-10-07T08:43:44.268277+0000","last_became_peered":"2023-10-07T08:43:44.268277+0000","last_unstale":"2023-10-07T08:43:44.268405+0000","last_undegraded":"2023-10-07T08:43:44.268405+0000","last_fullsized":"2023-10-07T08:43:44.268405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:12:57.047289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267322+0000","last_change":"2023-10-07T08:43:44.267322+0000","last_active":"2023-10-07T08:43:44.267322+0000","last_peered":"2023-10-07T08:43:44.267322+0000","last_clean":"2023-10-07T08:43:44.267322+0000","last_became_active":"2023-10-07T08:43:44.266637+0000","last_became_peered":"2023-10-07T08:43:44.266637+0000","last_unstale":"2023-10-07T08:43:44.267322+0000","last_undegraded":"2023-10-07T08:43:44.267322+0000","last_fullsized":"2023-10-07T08:43:44.267322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:55:12.347575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265699+0000","last_change":"2023-10-07T08:43:44.265699+0000","last_active":"2023-10-07T08:43:44.265699+0000","last_peered":"2023-10-07T08:43:44.265699+0000","last_clean":"2023-10-07T08:43:44.265699+0000","last_became_active":"2023-10-07T08:43:44.265433+0000","last_became_peered":"2023-10-07T08:43:44.265433+0000","last_unstale":"2023-10-07T08:43:44.265699+0000","last_undegraded":"2023-10-07T08:43:44.265699+0000","last_fullsized":"2023-10-07T08:43:44.265699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:49:21.646027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265393+0000","last_change":"2023-10-07T08:43:44.265393+0000","last_active":"2023-10-07T08:43:44.265393+0000","last_peered":"2023-10-07T08:43:44.265393+0000","last_clean":"2023-10-07T08:43:44.265393+0000","last_became_active":"2023-10-07T08:43:44.265076+0000","last_became_peered":"2023-10-07T08:43:44.265076+0000","last_unstale":"2023-10-07T08:43:44.265393+0000","last_undegraded":"2023-10-07T08:43:44.265393+0000","last_fullsized":"2023-10-07T08:43:44.265393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:59:55.645827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.266976+0000","last_change":"2023-10-07T08:43:44.266976+0000","last_active":"2023-10-07T08:43:44.266976+0000","last_peered":"2023-10-07T08:43:44.266976+0000","last_clean":"2023-10-07T08:43:44.266976+0000","last_became_active":"2023-10-07T08:43:44.266435+0000","last_became_peered":"2023-10-07T08:43:44.266435+0000","last_unstale":"2023-10-07T08:43:44.266976+0000","last_undegraded":"2023-10-07T08:43:44.266976+0000","last_fullsized":"2023-10-07T08:43:44.266976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:47:59.648220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.266513+0000","last_change":"2023-10-07T08:43:44.266513+0000","last_active":"2023-10-07T08:43:44.266513+0000","last_peered":"2023-10-07T08:43:44.266513+0000","last_clean":"2023-10-07T08:43:44.266513+0000","last_became_active":"2023-10-07T08:43:44.266171+0000","last_became_peered":"2023-10-07T08:43:44.266171+0000","last_unstale":"2023-10-07T08:43:44.266513+0000","last_undegraded":"2023-10-07T08:43:44.266513+0000","last_fullsized":"2023-10-07T08:43:44.266513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:56:56.094813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.272131+0000","last_change":"2023-10-07T08:43:44.272131+0000","last_active":"2023-10-07T08:43:44.272131+0000","last_peered":"2023-10-07T08:43:44.272131+0000","last_clean":"2023-10-07T08:43:44.272131+0000","last_became_active":"2023-10-07T08:43:44.271451+0000","last_became_peered":"2023-10-07T08:43:44.271451+0000","last_unstale":"2023-10-07T08:43:44.272131+0000","last_undegraded":"2023-10-07T08:43:44.272131+0000","last_fullsized":"2023-10-07T08:43:44.272131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:16:07.493286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.264617+0000","last_change":"2023-10-07T08:43:44.264617+0000","last_active":"2023-10-07T08:43:44.264617+0000","last_peered":"2023-10-07T08:43:44.264617+0000","last_clean":"2023-10-07T08:43:44.264617+0000","last_became_active":"2023-10-07T08:43:44.264415+0000","last_became_peered":"2023-10-07T08:43:44.264415+0000","last_unstale":"2023-10-07T08:43:44.264617+0000","last_undegraded":"2023-10-07T08:43:44.264617+0000","last_fullsized":"2023-10-07T08:43:44.264617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:54:28.889538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.259952+0000","last_change":"2023-10-07T08:43:44.259952+0000","last_active":"2023-10-07T08:43:44.259952+0000","last_peered":"2023-10-07T08:43:44.259952+0000","last_clean":"2023-10-07T08:43:44.259952+0000","last_became_active":"2023-10-07T08:43:44.259732+0000","last_became_peered":"2023-10-07T08:43:44.259732+0000","last_unstale":"2023-10-07T08:43:44.259952+0000","last_undegraded":"2023-10-07T08:43:44.259952+0000","last_fullsized":"2023-10-07T08:43:44.259952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:01:28.124750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267732+0000","last_change":"2023-10-07T08:43:44.267732+0000","last_active":"2023-10-07T08:43:44.267732+0000","last_peered":"2023-10-07T08:43:44.267732+0000","last_clean":"2023-10-07T08:43:44.267732+0000","last_became_active":"2023-10-07T08:43:44.267513+0000","last_became_peered":"2023-10-07T08:43:44.267513+0000","last_unstale":"2023-10-07T08:43:44.267732+0000","last_undegraded":"2023-10-07T08:43:44.267732+0000","last_fullsized":"2023-10-07T08:43:44.267732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:56:56.094813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.270690+0000","last_change":"2023-10-07T08:43:44.270690+0000","last_active":"2023-10-07T08:43:44.270690+0000","last_peered":"2023-10-07T08:43:44.270690+0000","last_clean":"2023-10-07T08:43:44.270690+0000","last_became_active":"2023-10-07T08:43:44.270261+0000","last_became_peered":"2023-10-07T08:43:44.270261+0000","last_unstale":"2023-10-07T08:43:44.270690+0000","last_undegraded":"2023-10-07T08:43:44.270690+0000","last_fullsized":"2023-10-07T08:43:44.270690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:40.832051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267433+0000","last_change":"2023-10-07T08:43:44.267433+0000","last_active":"2023-10-07T08:43:44.267433+0000","last_peered":"2023-10-07T08:43:44.267433+0000","last_clean":"2023-10-07T08:43:44.267433+0000","last_became_active":"2023-10-07T08:43:44.266851+0000","last_became_peered":"2023-10-07T08:43:44.266851+0000","last_unstale":"2023-10-07T08:43:44.267433+0000","last_undegraded":"2023-10-07T08:43:44.267433+0000","last_fullsized":"2023-10-07T08:43:44.267433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:47:59.648220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.264698+0000","last_change":"2023-10-07T08:43:44.264698+0000","last_active":"2023-10-07T08:43:44.264698+0000","last_peered":"2023-10-07T08:43:44.264698+0000","last_clean":"2023-10-07T08:43:44.264698+0000","last_became_active":"2023-10-07T08:43:44.264474+0000","last_became_peered":"2023-10-07T08:43:44.264474+0000","last_unstale":"2023-10-07T08:43:44.264698+0000","last_undegraded":"2023-10-07T08:43:44.264698+0000","last_fullsized":"2023-10-07T08:43:44.264698+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:49:21.646027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265395+0000","last_change":"2023-10-07T08:43:44.265395+0000","last_active":"2023-10-07T08:43:44.265395+0000","last_peered":"2023-10-07T08:43:44.265395+0000","last_clean":"2023-10-07T08:43:44.265395+0000","last_became_active":"2023-10-07T08:43:44.265003+0000","last_became_peered":"2023-10-07T08:43:44.265003+0000","last_unstale":"2023-10-07T08:43:44.265395+0000","last_undegraded":"2023-10-07T08:43:44.265395+0000","last_fullsized":"2023-10-07T08:43:44.265395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:16:07.493286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.262609+0000","last_change":"2023-10-07T08:43:44.262609+0000","last_active":"2023-10-07T08:43:44.262609+0000","last_peered":"2023-10-07T08:43:44.262609+0000","last_clean":"2023-10-07T08:43:44.262609+0000","last_became_active":"2023-10-07T08:43:44.261935+0000","last_became_peered":"2023-10-07T08:43:44.261935+0000","last_unstale":"2023-10-07T08:43:44.262609+0000","last_undegraded":"2023-10-07T08:43:44.262609+0000","last_fullsized":"2023-10-07T08:43:44.262609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:28:35.188852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.262697+0000","last_change":"2023-10-07T08:43:44.262697+0000","last_active":"2023-10-07T08:43:44.262697+0000","last_peered":"2023-10-07T08:43:44.262697+0000","last_clean":"2023-10-07T08:43:44.262697+0000","last_became_active":"2023-10-07T08:43:44.262050+0000","last_became_peered":"2023-10-07T08:43:44.262050+0000","last_unstale":"2023-10-07T08:43:44.262697+0000","last_undegraded":"2023-10-07T08:43:44.262697+0000","last_fullsized":"2023-10-07T08:43:44.262697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:43:32.723213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.261179+0000","last_change":"2023-10-07T08:43:44.261179+0000","last_active":"2023-10-07T08:43:44.261179+0000","last_peered":"2023-10-07T08:43:44.261179+0000","last_clean":"2023-10-07T08:43:44.261179+0000","last_became_active":"2023-10-07T08:43:44.260955+0000","last_became_peered":"2023-10-07T08:43:44.260955+0000","last_unstale":"2023-10-07T08:43:44.261179+0000","last_undegraded":"2023-10-07T08:43:44.261179+0000","last_fullsized":"2023-10-07T08:43:44.261179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:44:54.496304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265287+0000","last_change":"2023-10-07T08:43:44.265287+0000","last_active":"2023-10-07T08:43:44.265287+0000","last_peered":"2023-10-07T08:43:44.265287+0000","last_clean":"2023-10-07T08:43:44.265287+0000","last_became_active":"2023-10-07T08:43:44.265059+0000","last_became_peered":"2023-10-07T08:43:44.265059+0000","last_unstale":"2023-10-07T08:43:44.265287+0000","last_undegraded":"2023-10-07T08:43:44.265287+0000","last_fullsized":"2023-10-07T08:43:44.265287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:44:54.496304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.268156+0000","last_change":"2023-10-07T08:43:44.268156+0000","last_active":"2023-10-07T08:43:44.268156+0000","last_peered":"2023-10-07T08:43:44.268156+0000","last_clean":"2023-10-07T08:43:44.268156+0000","last_became_active":"2023-10-07T08:43:44.267668+0000","last_became_peered":"2023-10-07T08:43:44.267668+0000","last_unstale":"2023-10-07T08:43:44.268156+0000","last_undegraded":"2023-10-07T08:43:44.268156+0000","last_fullsized":"2023-10-07T08:43:44.268156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:12:37.684610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267111+0000","last_change":"2023-10-07T08:43:44.267111+0000","last_active":"2023-10-07T08:43:44.267111+0000","last_peered":"2023-10-07T08:43:44.267111+0000","last_clean":"2023-10-07T08:43:44.267111+0000","last_became_active":"2023-10-07T08:43:44.266725+0000","last_became_peered":"2023-10-07T08:43:44.266725+0000","last_unstale":"2023-10-07T08:43:44.267111+0000","last_undegraded":"2023-10-07T08:43:44.267111+0000","last_fullsized":"2023-10-07T08:43:44.267111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:56:56.094813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267612+0000","last_change":"2023-10-07T08:43:44.267612+0000","last_active":"2023-10-07T08:43:44.267612+0000","last_peered":"2023-10-07T08:43:44.267612+0000","last_clean":"2023-10-07T08:43:44.267612+0000","last_became_active":"2023-10-07T08:43:44.267381+0000","last_became_peered":"2023-10-07T08:43:44.267381+0000","last_unstale":"2023-10-07T08:43:44.267612+0000","last_undegraded":"2023-10-07T08:43:44.267612+0000","last_fullsized":"2023-10-07T08:43:44.267612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:30:32.421891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.268194+0000","last_change":"2023-10-07T08:43:44.268194+0000","last_active":"2023-10-07T08:43:44.268194+0000","last_peered":"2023-10-07T08:43:44.268194+0000","last_clean":"2023-10-07T08:43:44.268194+0000","last_became_active":"2023-10-07T08:43:44.267981+0000","last_became_peered":"2023-10-07T08:43:44.267981+0000","last_unstale":"2023-10-07T08:43:44.268194+0000","last_undegraded":"2023-10-07T08:43:44.268194+0000","last_fullsized":"2023-10-07T08:43:44.268194+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:12:37.684610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.269450+0000","last_change":"2023-10-07T08:43:44.269450+0000","last_active":"2023-10-07T08:43:44.269450+0000","last_peered":"2023-10-07T08:43:44.269450+0000","last_clean":"2023-10-07T08:43:44.269450+0000","last_became_active":"2023-10-07T08:43:44.269045+0000","last_became_peered":"2023-10-07T08:43:44.269045+0000","last_unstale":"2023-10-07T08:43:44.269450+0000","last_undegraded":"2023-10-07T08:43:44.269450+0000","last_fullsized":"2023-10-07T08:43:44.269450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:40.832051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.263522+0000","last_change":"2023-10-07T08:43:44.263522+0000","last_active":"2023-10-07T08:43:44.263522+0000","last_peered":"2023-10-07T08:43:44.263522+0000","last_clean":"2023-10-07T08:43:44.263522+0000","last_became_active":"2023-10-07T08:43:44.263187+0000","last_became_peered":"2023-10-07T08:43:44.263187+0000","last_unstale":"2023-10-07T08:43:44.263522+0000","last_undegraded":"2023-10-07T08:43:44.263522+0000","last_fullsized":"2023-10-07T08:43:44.263522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:00.224155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267332+0000","last_change":"2023-10-07T08:43:44.267332+0000","last_active":"2023-10-07T08:43:44.267332+0000","last_peered":"2023-10-07T08:43:44.267332+0000","last_clean":"2023-10-07T08:43:44.267332+0000","last_became_active":"2023-10-07T08:43:44.266781+0000","last_became_peered":"2023-10-07T08:43:44.266781+0000","last_unstale":"2023-10-07T08:43:44.267332+0000","last_undegraded":"2023-10-07T08:43:44.267332+0000","last_fullsized":"2023-10-07T08:43:44.267332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:33:17.939709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.264141+0000","last_change":"2023-10-07T08:43:44.264141+0000","last_active":"2023-10-07T08:43:44.264141+0000","last_peered":"2023-10-07T08:43:44.264141+0000","last_clean":"2023-10-07T08:43:44.264141+0000","last_became_active":"2023-10-07T08:43:44.263895+0000","last_became_peered":"2023-10-07T08:43:44.263895+0000","last_unstale":"2023-10-07T08:43:44.264141+0000","last_undegraded":"2023-10-07T08:43:44.264141+0000","last_fullsized":"2023-10-07T08:43:44.264141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:35.037578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267559+0000","last_change":"2023-10-07T08:43:44.267559+0000","last_active":"2023-10-07T08:43:44.267559+0000","last_peered":"2023-10-07T08:43:44.267559+0000","last_clean":"2023-10-07T08:43:44.267559+0000","last_became_active":"2023-10-07T08:43:44.267093+0000","last_became_peered":"2023-10-07T08:43:44.267093+0000","last_unstale":"2023-10-07T08:43:44.267559+0000","last_undegraded":"2023-10-07T08:43:44.267559+0000","last_fullsized":"2023-10-07T08:43:44.267559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:25.373968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.262469+0000","last_change":"2023-10-07T08:43:44.262469+0000","last_active":"2023-10-07T08:43:44.262469+0000","last_peered":"2023-10-07T08:43:44.262469+0000","last_clean":"2023-10-07T08:43:44.262469+0000","last_became_active":"2023-10-07T08:43:44.262245+0000","last_became_peered":"2023-10-07T08:43:44.262245+0000","last_unstale":"2023-10-07T08:43:44.262469+0000","last_undegraded":"2023-10-07T08:43:44.262469+0000","last_fullsized":"2023-10-07T08:43:44.262469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:57.371466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.279035+0000","last_change":"2023-10-07T08:43:43.253945+0000","last_active":"2023-10-07T08:43:44.279035+0000","last_peered":"2023-10-07T08:43:44.279035+0000","last_clean":"2023-10-07T08:43:44.279035+0000","last_became_active":"2023-10-07T08:43:43.253714+0000","last_became_peered":"2023-10-07T08:43:43.253714+0000","last_unstale":"2023-10-07T08:43:44.279035+0000","last_undegraded":"2023-10-07T08:43:44.279035+0000","last_fullsized":"2023-10-07T08:43:44.279035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:54:27.883160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.266444+0000","last_change":"2023-10-07T08:43:44.266444+0000","last_active":"2023-10-07T08:43:44.266444+0000","last_peered":"2023-10-07T08:43:44.266444+0000","last_clean":"2023-10-07T08:43:44.266444+0000","last_became_active":"2023-10-07T08:43:44.266236+0000","last_became_peered":"2023-10-07T08:43:44.266236+0000","last_unstale":"2023-10-07T08:43:44.266444+0000","last_undegraded":"2023-10-07T08:43:44.266444+0000","last_fullsized":"2023-10-07T08:43:44.266444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:50:03.669388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.259625+0000","last_change":"2023-10-07T08:43:43.250881+0000","last_active":"2023-10-07T08:43:44.259625+0000","last_peered":"2023-10-07T08:43:44.259625+0000","last_clean":"2023-10-07T08:43:44.259625+0000","last_became_active":"2023-10-07T08:43:43.250425+0000","last_became_peered":"2023-10-07T08:43:43.250425+0000","last_unstale":"2023-10-07T08:43:44.259625+0000","last_undegraded":"2023-10-07T08:43:44.259625+0000","last_fullsized":"2023-10-07T08:43:44.259625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:34.031200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.262853+0000","last_change":"2023-10-07T08:43:44.262853+0000","last_active":"2023-10-07T08:43:44.262853+0000","last_peered":"2023-10-07T08:43:44.262853+0000","last_clean":"2023-10-07T08:43:44.262853+0000","last_became_active":"2023-10-07T08:43:44.262385+0000","last_became_peered":"2023-10-07T08:43:44.262385+0000","last_unstale":"2023-10-07T08:43:44.262853+0000","last_undegraded":"2023-10-07T08:43:44.262853+0000","last_fullsized":"2023-10-07T08:43:44.262853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:39:06.009912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.273786+0000","last_change":"2023-10-07T08:43:43.249825+0000","last_active":"2023-10-07T08:43:44.273786+0000","last_peered":"2023-10-07T08:43:44.273786+0000","last_clean":"2023-10-07T08:43:44.273786+0000","last_became_active":"2023-10-07T08:43:43.249614+0000","last_became_peered":"2023-10-07T08:43:43.249614+0000","last_unstale":"2023-10-07T08:43:44.273786+0000","last_undegraded":"2023-10-07T08:43:44.273786+0000","last_fullsized":"2023-10-07T08:43:44.273786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:05:53.976582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.270289+0000","last_change":"2023-10-07T08:43:44.270289+0000","last_active":"2023-10-07T08:43:44.270289+0000","last_peered":"2023-10-07T08:43:44.270289+0000","last_clean":"2023-10-07T08:43:44.270289+0000","last_became_active":"2023-10-07T08:43:44.270033+0000","last_became_peered":"2023-10-07T08:43:44.270033+0000","last_unstale":"2023-10-07T08:43:44.270289+0000","last_undegraded":"2023-10-07T08:43:44.270289+0000","last_fullsized":"2023-10-07T08:43:44.270289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:19:21.743523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.276520+0000","last_change":"2023-10-07T08:43:43.242865+0000","last_active":"2023-10-07T08:43:44.276520+0000","last_peered":"2023-10-07T08:43:44.276520+0000","last_clean":"2023-10-07T08:43:44.276520+0000","last_became_active":"2023-10-07T08:43:43.242641+0000","last_became_peered":"2023-10-07T08:43:43.242641+0000","last_unstale":"2023-10-07T08:43:44.276520+0000","last_undegraded":"2023-10-07T08:43:44.276520+0000","last_fullsized":"2023-10-07T08:43:44.276520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:31:06.600070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.268379+0000","last_change":"2023-10-07T08:43:44.268379+0000","last_active":"2023-10-07T08:43:44.268379+0000","last_peered":"2023-10-07T08:43:44.268379+0000","last_clean":"2023-10-07T08:43:44.268379+0000","last_became_active":"2023-10-07T08:43:44.268014+0000","last_became_peered":"2023-10-07T08:43:44.268014+0000","last_unstale":"2023-10-07T08:43:44.268379+0000","last_undegraded":"2023-10-07T08:43:44.268379+0000","last_fullsized":"2023-10-07T08:43:44.268379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:05.092869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.256798+0000","last_change":"2023-10-07T08:43:43.251242+0000","last_active":"2023-10-07T08:43:44.256798+0000","last_peered":"2023-10-07T08:43:44.256798+0000","last_clean":"2023-10-07T08:43:44.256798+0000","last_became_active":"2023-10-07T08:43:43.250877+0000","last_became_peered":"2023-10-07T08:43:43.250877+0000","last_unstale":"2023-10-07T08:43:44.256798+0000","last_undegraded":"2023-10-07T08:43:44.256798+0000","last_fullsized":"2023-10-07T08:43:44.256798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:21:47.820187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.271998+0000","last_change":"2023-10-07T08:43:44.271998+0000","last_active":"2023-10-07T08:43:44.271998+0000","last_peered":"2023-10-07T08:43:44.271998+0000","last_clean":"2023-10-07T08:43:44.271998+0000","last_became_active":"2023-10-07T08:43:44.271256+0000","last_became_peered":"2023-10-07T08:43:44.271256+0000","last_unstale":"2023-10-07T08:43:44.271998+0000","last_undegraded":"2023-10-07T08:43:44.271998+0000","last_fullsized":"2023-10-07T08:43:44.271998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:33:17.939709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.257434+0000","last_change":"2023-10-07T08:43:43.247206+0000","last_active":"2023-10-07T08:43:44.257434+0000","last_peered":"2023-10-07T08:43:44.257434+0000","last_clean":"2023-10-07T08:43:44.257434+0000","last_became_active":"2023-10-07T08:43:43.246896+0000","last_became_peered":"2023-10-07T08:43:43.246896+0000","last_unstale":"2023-10-07T08:43:44.257434+0000","last_undegraded":"2023-10-07T08:43:44.257434+0000","last_fullsized":"2023-10-07T08:43:44.257434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:59:45.934372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.268639+0000","last_change":"2023-10-07T08:43:44.268639+0000","last_active":"2023-10-07T08:43:44.268639+0000","last_peered":"2023-10-07T08:43:44.268639+0000","last_clean":"2023-10-07T08:43:44.268639+0000","last_became_active":"2023-10-07T08:43:44.268022+0000","last_became_peered":"2023-10-07T08:43:44.268022+0000","last_unstale":"2023-10-07T08:43:44.268639+0000","last_undegraded":"2023-10-07T08:43:44.268639+0000","last_fullsized":"2023-10-07T08:43:44.268639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:57.371466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.251904+0000","last_change":"2023-10-07T08:43:43.251642+0000","last_active":"2023-10-07T08:43:43.251904+0000","last_peered":"2023-10-07T08:43:43.251904+0000","last_clean":"2023-10-07T08:43:43.251904+0000","last_became_active":"2023-10-07T08:43:43.250356+0000","last_became_peered":"2023-10-07T08:43:43.250356+0000","last_unstale":"2023-10-07T08:43:43.251904+0000","last_undegraded":"2023-10-07T08:43:43.251904+0000","last_fullsized":"2023-10-07T08:43:43.251904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:05:26.567450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.270495+0000","last_change":"2023-10-07T08:43:44.270495+0000","last_active":"2023-10-07T08:43:44.270495+0000","last_peered":"2023-10-07T08:43:44.270495+0000","last_clean":"2023-10-07T08:43:44.270495+0000","last_became_active":"2023-10-07T08:43:44.270316+0000","last_became_peered":"2023-10-07T08:43:44.270316+0000","last_unstale":"2023-10-07T08:43:44.270495+0000","last_undegraded":"2023-10-07T08:43:44.270495+0000","last_fullsized":"2023-10-07T08:43:44.270495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:33:17.939709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.249338+0000","last_change":"2023-10-07T08:43:43.248841+0000","last_active":"2023-10-07T08:43:43.249338+0000","last_peered":"2023-10-07T08:43:43.249338+0000","last_clean":"2023-10-07T08:43:43.249338+0000","last_became_active":"2023-10-07T08:43:43.248307+0000","last_became_peered":"2023-10-07T08:43:43.248307+0000","last_unstale":"2023-10-07T08:43:43.249338+0000","last_undegraded":"2023-10-07T08:43:43.249338+0000","last_fullsized":"2023-10-07T08:43:43.249338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:54:27.883160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.271881+0000","last_change":"2023-10-07T08:43:44.271881+0000","last_active":"2023-10-07T08:43:44.271881+0000","last_peered":"2023-10-07T08:43:44.271881+0000","last_clean":"2023-10-07T08:43:44.271881+0000","last_became_active":"2023-10-07T08:43:44.271013+0000","last_became_peered":"2023-10-07T08:43:44.271013+0000","last_unstale":"2023-10-07T08:43:44.271881+0000","last_undegraded":"2023-10-07T08:43:44.271881+0000","last_fullsized":"2023-10-07T08:43:44.271881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:05.092869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.250218+0000","last_change":"2023-10-07T08:43:43.250142+0000","last_active":"2023-10-07T08:43:43.250218+0000","last_peered":"2023-10-07T08:43:43.250218+0000","last_clean":"2023-10-07T08:43:43.250218+0000","last_became_active":"2023-10-07T08:43:43.249920+0000","last_became_peered":"2023-10-07T08:43:43.249920+0000","last_unstale":"2023-10-07T08:43:43.250218+0000","last_undegraded":"2023-10-07T08:43:43.250218+0000","last_fullsized":"2023-10-07T08:43:43.250218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:34.031200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265437+0000","last_change":"2023-10-07T08:43:44.265437+0000","last_active":"2023-10-07T08:43:44.265437+0000","last_peered":"2023-10-07T08:43:44.265437+0000","last_clean":"2023-10-07T08:43:44.265437+0000","last_became_active":"2023-10-07T08:43:44.265226+0000","last_became_peered":"2023-10-07T08:43:44.265226+0000","last_unstale":"2023-10-07T08:43:44.265437+0000","last_undegraded":"2023-10-07T08:43:44.265437+0000","last_fullsized":"2023-10-07T08:43:44.265437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:12:13.779876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.248583+0000","last_change":"2023-10-07T08:43:43.248519+0000","last_active":"2023-10-07T08:43:43.248583+0000","last_peered":"2023-10-07T08:43:43.248583+0000","last_clean":"2023-10-07T08:43:43.248583+0000","last_became_active":"2023-10-07T08:43:43.248303+0000","last_became_peered":"2023-10-07T08:43:43.248303+0000","last_unstale":"2023-10-07T08:43:43.248583+0000","last_undegraded":"2023-10-07T08:43:43.248583+0000","last_fullsized":"2023-10-07T08:43:43.248583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:37.154520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.263277+0000","last_change":"2023-10-07T08:43:44.263277+0000","last_active":"2023-10-07T08:43:44.263277+0000","last_peered":"2023-10-07T08:43:44.263277+0000","last_clean":"2023-10-07T08:43:44.263277+0000","last_became_active":"2023-10-07T08:43:44.263035+0000","last_became_peered":"2023-10-07T08:43:44.263035+0000","last_unstale":"2023-10-07T08:43:44.263277+0000","last_undegraded":"2023-10-07T08:43:44.263277+0000","last_fullsized":"2023-10-07T08:43:44.263277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:40.832051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.275380+0000","last_change":"2023-10-07T08:43:43.253149+0000","last_active":"2023-10-07T08:43:44.275380+0000","last_peered":"2023-10-07T08:43:44.275380+0000","last_clean":"2023-10-07T08:43:44.275380+0000","last_became_active":"2023-10-07T08:43:43.252636+0000","last_became_peered":"2023-10-07T08:43:43.252636+0000","last_unstale":"2023-10-07T08:43:44.275380+0000","last_undegraded":"2023-10-07T08:43:44.275380+0000","last_fullsized":"2023-10-07T08:43:44.275380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:05:26.567450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.269304+0000","last_change":"2023-10-07T08:43:44.269304+0000","last_active":"2023-10-07T08:43:44.269304+0000","last_peered":"2023-10-07T08:43:44.269304+0000","last_clean":"2023-10-07T08:43:44.269304+0000","last_became_active":"2023-10-07T08:43:44.268801+0000","last_became_peered":"2023-10-07T08:43:44.268801+0000","last_unstale":"2023-10-07T08:43:44.269304+0000","last_undegraded":"2023-10-07T08:43:44.269304+0000","last_fullsized":"2023-10-07T08:43:44.269304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:49:21.646027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.276033+0000","last_change":"2023-10-07T08:43:43.251531+0000","last_active":"2023-10-07T08:43:44.276033+0000","last_peered":"2023-10-07T08:43:44.276033+0000","last_clean":"2023-10-07T08:43:44.276033+0000","last_became_active":"2023-10-07T08:43:43.249901+0000","last_became_peered":"2023-10-07T08:43:43.249901+0000","last_unstale":"2023-10-07T08:43:44.276033+0000","last_undegraded":"2023-10-07T08:43:44.276033+0000","last_fullsized":"2023-10-07T08:43:44.276033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:37.154520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.270630+0000","last_change":"2023-10-07T08:43:44.270630+0000","last_active":"2023-10-07T08:43:44.270630+0000","last_peered":"2023-10-07T08:43:44.270630+0000","last_clean":"2023-10-07T08:43:44.270630+0000","last_became_active":"2023-10-07T08:43:44.270393+0000","last_became_peered":"2023-10-07T08:43:44.270393+0000","last_unstale":"2023-10-07T08:43:44.270630+0000","last_undegraded":"2023-10-07T08:43:44.270630+0000","last_fullsized":"2023-10-07T08:43:44.270630+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:40.832051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.279103+0000","last_change":"2023-10-07T08:43:43.248707+0000","last_active":"2023-10-07T08:43:44.279103+0000","last_peered":"2023-10-07T08:43:44.279103+0000","last_clean":"2023-10-07T08:43:44.279103+0000","last_became_active":"2023-10-07T08:43:43.247994+0000","last_became_peered":"2023-10-07T08:43:43.247994+0000","last_unstale":"2023-10-07T08:43:44.279103+0000","last_undegraded":"2023-10-07T08:43:44.279103+0000","last_fullsized":"2023-10-07T08:43:44.279103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:10:28.075292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.260829+0000","last_change":"2023-10-07T08:43:44.260829+0000","last_active":"2023-10-07T08:43:44.260829+0000","last_peered":"2023-10-07T08:43:44.260829+0000","last_clean":"2023-10-07T08:43:44.260829+0000","last_became_active":"2023-10-07T08:43:44.260608+0000","last_became_peered":"2023-10-07T08:43:44.260608+0000","last_unstale":"2023-10-07T08:43:44.260829+0000","last_undegraded":"2023-10-07T08:43:44.260829+0000","last_fullsized":"2023-10-07T08:43:44.260829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:19:21.743523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.247700+0000","last_change":"2023-10-07T08:43:43.247639+0000","last_active":"2023-10-07T08:43:43.247700+0000","last_peered":"2023-10-07T08:43:43.247700+0000","last_clean":"2023-10-07T08:43:43.247700+0000","last_became_active":"2023-10-07T08:43:43.247414+0000","last_became_peered":"2023-10-07T08:43:43.247414+0000","last_unstale":"2023-10-07T08:43:43.247700+0000","last_undegraded":"2023-10-07T08:43:43.247700+0000","last_fullsized":"2023-10-07T08:43:43.247700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:37.154520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.268226+0000","last_change":"2023-10-07T08:43:44.268226+0000","last_active":"2023-10-07T08:43:44.268226+0000","last_peered":"2023-10-07T08:43:44.268226+0000","last_clean":"2023-10-07T08:43:44.268226+0000","last_became_active":"2023-10-07T08:43:44.267734+0000","last_became_peered":"2023-10-07T08:43:44.267734+0000","last_unstale":"2023-10-07T08:43:44.268226+0000","last_undegraded":"2023-10-07T08:43:44.268226+0000","last_fullsized":"2023-10-07T08:43:44.268226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:16:07.493286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.250959+0000","last_change":"2023-10-07T08:43:43.250623+0000","last_active":"2023-10-07T08:43:43.250959+0000","last_peered":"2023-10-07T08:43:43.250959+0000","last_clean":"2023-10-07T08:43:43.250959+0000","last_became_active":"2023-10-07T08:43:43.250412+0000","last_became_peered":"2023-10-07T08:43:43.250412+0000","last_unstale":"2023-10-07T08:43:43.250959+0000","last_undegraded":"2023-10-07T08:43:43.250959+0000","last_fullsized":"2023-10-07T08:43:43.250959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:50:02.663010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.266874+0000","last_change":"2023-10-07T08:43:44.266874+0000","last_active":"2023-10-07T08:43:44.266874+0000","last_peered":"2023-10-07T08:43:44.266874+0000","last_clean":"2023-10-07T08:43:44.266874+0000","last_became_active":"2023-10-07T08:43:44.266601+0000","last_became_peered":"2023-10-07T08:43:44.266601+0000","last_unstale":"2023-10-07T08:43:44.266874+0000","last_undegraded":"2023-10-07T08:43:44.266874+0000","last_fullsized":"2023-10-07T08:43:44.266874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:21.472980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.277326+0000","last_change":"2023-10-07T08:43:43.249665+0000","last_active":"2023-10-07T08:43:44.277326+0000","last_peered":"2023-10-07T08:43:44.277326+0000","last_clean":"2023-10-07T08:43:44.277326+0000","last_became_active":"2023-10-07T08:43:43.249457+0000","last_became_peered":"2023-10-07T08:43:43.249457+0000","last_unstale":"2023-10-07T08:43:44.277326+0000","last_undegraded":"2023-10-07T08:43:44.277326+0000","last_fullsized":"2023-10-07T08:43:44.277326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:20.466602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.270143+0000","last_change":"2023-10-07T08:43:44.270143+0000","last_active":"2023-10-07T08:43:44.270143+0000","last_peered":"2023-10-07T08:43:44.270143+0000","last_clean":"2023-10-07T08:43:44.270143+0000","last_became_active":"2023-10-07T08:43:44.269924+0000","last_became_peered":"2023-10-07T08:43:44.269924+0000","last_unstale":"2023-10-07T08:43:44.270143+0000","last_undegraded":"2023-10-07T08:43:44.270143+0000","last_fullsized":"2023-10-07T08:43:44.270143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:50:03.669388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.264197+0000","last_change":"2023-10-07T08:43:43.246767+0000","last_active":"2023-10-07T08:43:44.264197+0000","last_peered":"2023-10-07T08:43:44.264197+0000","last_clean":"2023-10-07T08:43:44.264197+0000","last_became_active":"2023-10-07T08:43:43.246503+0000","last_became_peered":"2023-10-07T08:43:43.246503+0000","last_unstale":"2023-10-07T08:43:44.264197+0000","last_undegraded":"2023-10-07T08:43:44.264197+0000","last_fullsized":"2023-10-07T08:43:44.264197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:20.466602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.268287+0000","last_change":"2023-10-07T08:43:44.268287+0000","last_active":"2023-10-07T08:43:44.268287+0000","last_peered":"2023-10-07T08:43:44.268287+0000","last_clean":"2023-10-07T08:43:44.268287+0000","last_became_active":"2023-10-07T08:43:44.267939+0000","last_became_peered":"2023-10-07T08:43:44.267939+0000","last_unstale":"2023-10-07T08:43:44.268287+0000","last_undegraded":"2023-10-07T08:43:44.268287+0000","last_fullsized":"2023-10-07T08:43:44.268287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:30:32.421891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.278905+0000","last_change":"2023-10-07T08:43:43.248553+0000","last_active":"2023-10-07T08:43:44.278905+0000","last_peered":"2023-10-07T08:43:44.278905+0000","last_clean":"2023-10-07T08:43:44.278905+0000","last_became_active":"2023-10-07T08:43:43.247671+0000","last_became_peered":"2023-10-07T08:43:43.247671+0000","last_unstale":"2023-10-07T08:43:44.278905+0000","last_undegraded":"2023-10-07T08:43:44.278905+0000","last_fullsized":"2023-10-07T08:43:44.278905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:48:14.257990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267129+0000","last_change":"2023-10-07T08:43:44.267129+0000","last_active":"2023-10-07T08:43:44.267129+0000","last_peered":"2023-10-07T08:43:44.267129+0000","last_clean":"2023-10-07T08:43:44.267129+0000","last_became_active":"2023-10-07T08:43:44.266935+0000","last_became_peered":"2023-10-07T08:43:44.266935+0000","last_unstale":"2023-10-07T08:43:44.267129+0000","last_undegraded":"2023-10-07T08:43:44.267129+0000","last_fullsized":"2023-10-07T08:43:44.267129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:55:12.347575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.257481+0000","last_change":"2023-10-07T08:43:43.245449+0000","last_active":"2023-10-07T08:43:44.257481+0000","last_peered":"2023-10-07T08:43:44.257481+0000","last_clean":"2023-10-07T08:43:44.257481+0000","last_became_active":"2023-10-07T08:43:43.244960+0000","last_became_peered":"2023-10-07T08:43:43.244960+0000","last_unstale":"2023-10-07T08:43:44.257481+0000","last_undegraded":"2023-10-07T08:43:44.257481+0000","last_fullsized":"2023-10-07T08:43:44.257481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:28:00.638236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.266956+0000","last_change":"2023-10-07T08:43:44.266956+0000","last_active":"2023-10-07T08:43:44.266956+0000","last_peered":"2023-10-07T08:43:44.266956+0000","last_clean":"2023-10-07T08:43:44.266956+0000","last_became_active":"2023-10-07T08:43:44.266723+0000","last_became_peered":"2023-10-07T08:43:44.266723+0000","last_unstale":"2023-10-07T08:43:44.266956+0000","last_undegraded":"2023-10-07T08:43:44.266956+0000","last_fullsized":"2023-10-07T08:43:44.266956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:45:38.127813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.251297+0000","last_change":"2023-10-07T08:43:43.251101+0000","last_active":"2023-10-07T08:43:43.251297+0000","last_peered":"2023-10-07T08:43:43.251297+0000","last_clean":"2023-10-07T08:43:43.251297+0000","last_became_active":"2023-10-07T08:43:43.250552+0000","last_became_peered":"2023-10-07T08:43:43.250552+0000","last_unstale":"2023-10-07T08:43:43.251297+0000","last_undegraded":"2023-10-07T08:43:43.251297+0000","last_fullsized":"2023-10-07T08:43:43.251297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:58.169140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.259225+0000","last_change":"2023-10-07T08:43:44.259225+0000","last_active":"2023-10-07T08:43:44.259225+0000","last_peered":"2023-10-07T08:43:44.259225+0000","last_clean":"2023-10-07T08:43:44.259225+0000","last_became_active":"2023-10-07T08:43:44.259007+0000","last_became_peered":"2023-10-07T08:43:44.259007+0000","last_unstale":"2023-10-07T08:43:44.259225+0000","last_undegraded":"2023-10-07T08:43:44.259225+0000","last_fullsized":"2023-10-07T08:43:44.259225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:01:12.346582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.277657+0000","last_change":"2023-10-07T08:43:43.244426+0000","last_active":"2023-10-07T08:43:44.277657+0000","last_peered":"2023-10-07T08:43:44.277657+0000","last_clean":"2023-10-07T08:43:44.277657+0000","last_became_active":"2023-10-07T08:43:43.243899+0000","last_became_peered":"2023-10-07T08:43:43.243899+0000","last_unstale":"2023-10-07T08:43:44.277657+0000","last_undegraded":"2023-10-07T08:43:44.277657+0000","last_fullsized":"2023-10-07T08:43:44.277657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:45:37.121435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.259751+0000","last_change":"2023-10-07T08:43:44.259751+0000","last_active":"2023-10-07T08:43:44.259751+0000","last_peered":"2023-10-07T08:43:44.259751+0000","last_clean":"2023-10-07T08:43:44.259751+0000","last_became_active":"2023-10-07T08:43:44.259541+0000","last_became_peered":"2023-10-07T08:43:44.259541+0000","last_unstale":"2023-10-07T08:43:44.259751+0000","last_undegraded":"2023-10-07T08:43:44.259751+0000","last_fullsized":"2023-10-07T08:43:44.259751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:03:07.495229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.251418+0000","last_change":"2023-10-07T08:43:43.251361+0000","last_active":"2023-10-07T08:43:43.251418+0000","last_peered":"2023-10-07T08:43:43.251418+0000","last_clean":"2023-10-07T08:43:43.251418+0000","last_became_active":"2023-10-07T08:43:43.250790+0000","last_became_peered":"2023-10-07T08:43:43.250790+0000","last_unstale":"2023-10-07T08:43:43.251418+0000","last_undegraded":"2023-10-07T08:43:43.251418+0000","last_fullsized":"2023-10-07T08:43:43.251418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:03:06.488851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.260850+0000","last_change":"2023-10-07T08:43:44.260850+0000","last_active":"2023-10-07T08:43:44.260850+0000","last_peered":"2023-10-07T08:43:44.260850+0000","last_clean":"2023-10-07T08:43:44.260850+0000","last_became_active":"2023-10-07T08:43:44.260622+0000","last_became_peered":"2023-10-07T08:43:44.260622+0000","last_unstale":"2023-10-07T08:43:44.260850+0000","last_undegraded":"2023-10-07T08:43:44.260850+0000","last_fullsized":"2023-10-07T08:43:44.260850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:10:29.081670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.244601+0000","last_change":"2023-10-07T08:43:43.244091+0000","last_active":"2023-10-07T08:43:43.244601+0000","last_peered":"2023-10-07T08:43:43.244601+0000","last_clean":"2023-10-07T08:43:43.244601+0000","last_became_active":"2023-10-07T08:43:43.243776+0000","last_became_peered":"2023-10-07T08:43:43.243776+0000","last_unstale":"2023-10-07T08:43:43.244601+0000","last_undegraded":"2023-10-07T08:43:43.244601+0000","last_fullsized":"2023-10-07T08:43:43.244601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:50.638193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.267466+0000","last_change":"2023-10-07T08:43:44.267466+0000","last_active":"2023-10-07T08:43:44.267466+0000","last_peered":"2023-10-07T08:43:44.267466+0000","last_clean":"2023-10-07T08:43:44.267466+0000","last_became_active":"2023-10-07T08:43:44.267102+0000","last_became_peered":"2023-10-07T08:43:44.267102+0000","last_unstale":"2023-10-07T08:43:44.267466+0000","last_undegraded":"2023-10-07T08:43:44.267466+0000","last_fullsized":"2023-10-07T08:43:44.267466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:30:32.421891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.252910+0000","last_change":"2023-10-07T08:43:43.252849+0000","last_active":"2023-10-07T08:43:43.252910+0000","last_peered":"2023-10-07T08:43:43.252910+0000","last_clean":"2023-10-07T08:43:43.252910+0000","last_became_active":"2023-10-07T08:43:43.252599+0000","last_became_peered":"2023-10-07T08:43:43.252599+0000","last_unstale":"2023-10-07T08:43:43.252910+0000","last_undegraded":"2023-10-07T08:43:43.252910+0000","last_fullsized":"2023-10-07T08:43:43.252910+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:34.031200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.270974+0000","last_change":"2023-10-07T08:43:44.270974+0000","last_active":"2023-10-07T08:43:44.270974+0000","last_peered":"2023-10-07T08:43:44.270974+0000","last_clean":"2023-10-07T08:43:44.270974+0000","last_became_active":"2023-10-07T08:43:44.270837+0000","last_became_peered":"2023-10-07T08:43:44.270837+0000","last_unstale":"2023-10-07T08:43:44.270974+0000","last_undegraded":"2023-10-07T08:43:44.270974+0000","last_fullsized":"2023-10-07T08:43:44.270974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:15.874391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.274608+0000","last_change":"2023-10-07T08:43:43.248288+0000","last_active":"2023-10-07T08:43:44.274608+0000","last_peered":"2023-10-07T08:43:44.274608+0000","last_clean":"2023-10-07T08:43:44.274608+0000","last_became_active":"2023-10-07T08:43:43.247931+0000","last_became_peered":"2023-10-07T08:43:43.247931+0000","last_unstale":"2023-10-07T08:43:44.274608+0000","last_undegraded":"2023-10-07T08:43:44.274608+0000","last_fullsized":"2023-10-07T08:43:44.274608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:05:26.567450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.271666+0000","last_change":"2023-10-07T08:43:44.271666+0000","last_active":"2023-10-07T08:43:44.271666+0000","last_peered":"2023-10-07T08:43:44.271666+0000","last_clean":"2023-10-07T08:43:44.271666+0000","last_became_active":"2023-10-07T08:43:44.270755+0000","last_became_peered":"2023-10-07T08:43:44.270755+0000","last_unstale":"2023-10-07T08:43:44.271666+0000","last_undegraded":"2023-10-07T08:43:44.271666+0000","last_fullsized":"2023-10-07T08:43:44.271666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:01:28.124750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.245017+0000","last_change":"2023-10-07T08:43:43.244936+0000","last_active":"2023-10-07T08:43:43.245017+0000","last_peered":"2023-10-07T08:43:43.245017+0000","last_clean":"2023-10-07T08:43:43.245017+0000","last_became_active":"2023-10-07T08:43:43.244195+0000","last_became_peered":"2023-10-07T08:43:43.244195+0000","last_unstale":"2023-10-07T08:43:43.245017+0000","last_undegraded":"2023-10-07T08:43:43.245017+0000","last_fullsized":"2023-10-07T08:43:43.245017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:05:53.976582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265119+0000","last_change":"2023-10-07T08:43:44.265119+0000","last_active":"2023-10-07T08:43:44.265119+0000","last_peered":"2023-10-07T08:43:44.265119+0000","last_clean":"2023-10-07T08:43:44.265119+0000","last_became_active":"2023-10-07T08:43:44.264895+0000","last_became_peered":"2023-10-07T08:43:44.264895+0000","last_unstale":"2023-10-07T08:43:44.265119+0000","last_undegraded":"2023-10-07T08:43:44.265119+0000","last_fullsized":"2023-10-07T08:43:44.265119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:43:32.723213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.243868+0000","last_change":"2023-10-07T08:43:43.243739+0000","last_active":"2023-10-07T08:43:43.243868+0000","last_peered":"2023-10-07T08:43:43.243868+0000","last_clean":"2023-10-07T08:43:43.243868+0000","last_became_active":"2023-10-07T08:43:43.243330+0000","last_became_peered":"2023-10-07T08:43:43.243330+0000","last_unstale":"2023-10-07T08:43:43.243868+0000","last_undegraded":"2023-10-07T08:43:43.243868+0000","last_fullsized":"2023-10-07T08:43:43.243868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:45:37.121435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.262429+0000","last_change":"2023-10-07T08:43:44.262429+0000","last_active":"2023-10-07T08:43:44.262429+0000","last_peered":"2023-10-07T08:43:44.262429+0000","last_clean":"2023-10-07T08:43:44.262429+0000","last_became_active":"2023-10-07T08:43:44.262217+0000","last_became_peered":"2023-10-07T08:43:44.262217+0000","last_unstale":"2023-10-07T08:43:44.262429+0000","last_undegraded":"2023-10-07T08:43:44.262429+0000","last_fullsized":"2023-10-07T08:43:44.262429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:11:38.160898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.253430+0000","last_change":"2023-10-07T08:43:43.253343+0000","last_active":"2023-10-07T08:43:43.253430+0000","last_peered":"2023-10-07T08:43:43.253430+0000","last_clean":"2023-10-07T08:43:43.253430+0000","last_became_active":"2023-10-07T08:43:43.253177+0000","last_became_peered":"2023-10-07T08:43:43.253177+0000","last_unstale":"2023-10-07T08:43:43.253430+0000","last_undegraded":"2023-10-07T08:43:43.253430+0000","last_fullsized":"2023-10-07T08:43:43.253430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:14.868013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265562+0000","last_change":"2023-10-07T08:43:44.265562+0000","last_active":"2023-10-07T08:43:44.265562+0000","last_peered":"2023-10-07T08:43:44.265562+0000","last_clean":"2023-10-07T08:43:44.265562+0000","last_became_active":"2023-10-07T08:43:44.265344+0000","last_became_peered":"2023-10-07T08:43:44.265344+0000","last_unstale":"2023-10-07T08:43:44.265562+0000","last_undegraded":"2023-10-07T08:43:44.265562+0000","last_fullsized":"2023-10-07T08:43:44.265562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:39:06.009912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.248519+0000","last_change":"2023-10-07T08:43:43.248147+0000","last_active":"2023-10-07T08:43:43.248519+0000","last_peered":"2023-10-07T08:43:43.248519+0000","last_clean":"2023-10-07T08:43:43.248519+0000","last_became_active":"2023-10-07T08:43:43.247269+0000","last_became_peered":"2023-10-07T08:43:43.247269+0000","last_unstale":"2023-10-07T08:43:43.248519+0000","last_undegraded":"2023-10-07T08:43:43.248519+0000","last_fullsized":"2023-10-07T08:43:43.248519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:54:34.031200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265485+0000","last_change":"2023-10-07T08:43:44.265485+0000","last_active":"2023-10-07T08:43:44.265485+0000","last_peered":"2023-10-07T08:43:44.265485+0000","last_clean":"2023-10-07T08:43:44.265485+0000","last_became_active":"2023-10-07T08:43:44.265257+0000","last_became_peered":"2023-10-07T08:43:44.265257+0000","last_unstale":"2023-10-07T08:43:44.265485+0000","last_undegraded":"2023-10-07T08:43:44.265485+0000","last_fullsized":"2023-10-07T08:43:44.265485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:05.092869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.252323+0000","last_change":"2023-10-07T08:43:43.252240+0000","last_active":"2023-10-07T08:43:43.252323+0000","last_peered":"2023-10-07T08:43:43.252323+0000","last_clean":"2023-10-07T08:43:43.252323+0000","last_became_active":"2023-10-07T08:43:43.251995+0000","last_became_peered":"2023-10-07T08:43:43.251995+0000","last_unstale":"2023-10-07T08:43:43.252323+0000","last_undegraded":"2023-10-07T08:43:43.252323+0000","last_fullsized":"2023-10-07T08:43:43.252323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:03:06.488851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.262304+0000","last_change":"2023-10-07T08:43:44.262304+0000","last_active":"2023-10-07T08:43:44.262304+0000","last_peered":"2023-10-07T08:43:44.262304+0000","last_clean":"2023-10-07T08:43:44.262304+0000","last_became_active":"2023-10-07T08:43:44.261662+0000","last_became_peered":"2023-10-07T08:43:44.261662+0000","last_unstale":"2023-10-07T08:43:44.262304+0000","last_undegraded":"2023-10-07T08:43:44.262304+0000","last_fullsized":"2023-10-07T08:43:44.262304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:18:10.633307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.252325+0000","last_change":"2023-10-07T08:43:43.252243+0000","last_active":"2023-10-07T08:43:43.252325+0000","last_peered":"2023-10-07T08:43:43.252325+0000","last_clean":"2023-10-07T08:43:43.252325+0000","last_became_active":"2023-10-07T08:43:43.251309+0000","last_became_peered":"2023-10-07T08:43:43.251309+0000","last_unstale":"2023-10-07T08:43:43.252325+0000","last_undegraded":"2023-10-07T08:43:43.252325+0000","last_fullsized":"2023-10-07T08:43:43.252325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:59:54.639449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-07T08:43:44.265976+0000","last_change":"2023-10-07T08:43:44.265976+0000","last_active":"2023-10-07T08:43:44.265976+0000","last_peered":"2023-10-07T08:43:44.265976+0000","last_clean":"2023-10-07T08:43:44.265976+0000","last_became_active":"2023-10-07T08:43:44.265713+0000","last_became_peered":"2023-10-07T08:43:44.265713+0000","last_unstale":"2023-10-07T08:43:44.265976+0000","last_undegraded":"2023-10-07T08:43:44.265976+0000","last_fullsized":"2023-10-07T08:43:44.265976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:43.234411+0000","last_clean_scrub_stamp":"2023-10-07T08:43:43.234411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:01:28.124750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.251529+0000","last_change":"2023-10-07T08:43:43.251484+0000","last_active":"2023-10-07T08:43:43.251529+0000","last_peered":"2023-10-07T08:43:43.251529+0000","last_clean":"2023-10-07T08:43:43.251529+0000","last_became_active":"2023-10-07T08:43:43.251112+0000","last_became_peered":"2023-10-07T08:43:43.251112+0000","last_unstale":"2023-10-07T08:43:43.251529+0000","last_undegraded":"2023-10-07T08:43:43.251529+0000","last_fullsized":"2023-10-07T08:43:43.251529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:43:42.228033+0000","last_clean_scrub_stamp":"2023-10-07T08:43:42.228033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:10:28.075292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-07T08:43:43.249207+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:43:43.249207+0000","last_peered":"2023-10-07T08:43:43.249207+0000","last_clean":"2023-10-07T08:43:43.249207+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:43:43.249207+0000","last_undegraded":"2023-10-07T08:43:43.249207+0000","last_fullsized":"2023-10-07T08:43:43.249207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194601,"statfs":{"total":200000000,"available":199272404,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":134,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199862184,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199861214,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194601,"statfs":{"total":200000000,"available":199272404,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.378}]},{"osd":2,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.314}]},{"osd":3,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.39400000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.48499999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.443}]},{"osd":6,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.54900000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.46999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":134,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862702,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199861214,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":134,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862668,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":127,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195185,"statfs":{"total":200000000,"available":199869535,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]}],"pool_statfs":[]}} 2023-10-07T08:43:48.696 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T08:43:48.696 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T08:43:48.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.846+0000 7ff999654700 1 Processor -- start 2023-10-07T08:43:48.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.846+0000 7ff999654700 1 -- start start 2023-10-07T08:43:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.847+0000 7ff999654700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff9941577c0 0x7ff994068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.847+0000 7ff999654700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9940cbea0 0x7ff994068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.847+0000 7ff999654700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9940cca80 con 0x7ff994157b90 2023-10-07T08:43:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.847+0000 7ff999654700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9940cc2e0 con 0x7ff9941577c0 2023-10-07T08:43:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.847+0000 7ff999654700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940cedd0 con 0x7ff9940cbea0 2023-10-07T08:43:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.847+0000 7ff98a7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff994157b90 0x7ff9940cb790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50176/0 (socket says 172.21.15.81:50176) 2023-10-07T08:43:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.847+0000 7ff98a7fc700 1 -- 172.21.15.81:0/55939680 learned_addr learned my addr 172.21.15.81:0/55939680 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.847+0000 7ff992ffd700 1 --2- 172.21.15.81:0/55939680 >> v2:172.21.15.89:3300/0 conn(0x7ff9941577c0 0x7ff994068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.847+0000 7ff9937fe700 1 --2- 172.21.15.81:0/55939680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9940cbea0 0x7ff994068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.847+0000 7ff9927fc700 1 -- 172.21.15.81:0/55939680 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114754781 0 0) 0x7ff9940cca80 con 0x7ff994157b90 2023-10-07T08:43:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.847+0000 7ff9927fc700 1 -- 172.21.15.81:0/55939680 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff980003570 con 0x7ff994157b90 2023-10-07T08:43:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.848+0000 7ff992ffd700 1 -- 172.21.15.81:0/55939680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9940cbea0 msgr2=0x7ff994068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.848+0000 7ff992ffd700 1 --2- 172.21.15.81:0/55939680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9940cbea0 0x7ff994068d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.848+0000 7ff992ffd700 1 -- 172.21.15.81:0/55939680 >> v1:172.21.15.81:6789/0 conn(0x7ff994157b90 legacy=0x7ff9940cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.848+0000 7ff992ffd700 1 -- 172.21.15.81:0/55939680 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9940cc4c0 con 0x7ff9941577c0 2023-10-07T08:43:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.848+0000 7ff9937fe700 1 --2- 172.21.15.81:0/55939680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9940cbea0 0x7ff994068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.848+0000 7ff992ffd700 1 --2- 172.21.15.81:0/55939680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9941577c0 0x7ff994068810 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff9840098e0 tx=0x7ff9840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3579a934b6c1c279 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.848+0000 7ff9927fc700 1 -- 172.21.15.81:0/55939680 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984011630 con 0x7ff9941577c0 2023-10-07T08:43:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.848+0000 7ff9927fc700 1 -- 172.21.15.81:0/55939680 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff984011790 con 0x7ff9941577c0 2023-10-07T08:43:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.848+0000 7ff9927fc700 1 -- 172.21.15.81:0/55939680 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984011b30 con 0x7ff9941577c0 2023-10-07T08:43:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.848+0000 7ff999654700 1 -- 172.21.15.81:0/55939680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9941577c0 msgr2=0x7ff994068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.848+0000 7ff999654700 1 --2- 172.21.15.81:0/55939680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9941577c0 0x7ff994068810 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff9840098e0 tx=0x7ff9840091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.849+0000 7ff999654700 1 -- 172.21.15.81:0/55939680 shutdown_connections 2023-10-07T08:43:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.849+0000 7ff999654700 1 --2- 172.21.15.81:0/55939680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9941577c0 0x7ff994068810 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.849+0000 7ff999654700 1 --2- 172.21.15.81:0/55939680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9940cbea0 0x7ff994068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.849+0000 7ff999654700 1 -- 172.21.15.81:0/55939680 >> 172.21.15.81:0/55939680 conn(0x7ff9940d0df0 msgr2=0x7ff9940d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.849+0000 7ff999654700 1 -- 172.21.15.81:0/55939680 shutdown_connections 2023-10-07T08:43:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.849+0000 7ff999654700 1 -- 172.21.15.81:0/55939680 wait complete. 2023-10-07T08:43:48.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.850+0000 7ff999654700 1 Processor -- start 2023-10-07T08:43:48.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.850+0000 7ff999654700 1 -- start start 2023-10-07T08:43:48.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff999654700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9940cbea0 0x7ff9940b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff999654700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9941577c0 0x7ff99415e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff999654700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff994157b90 0x7ff9941457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff999654700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9941587d0 con 0x7ff9941577c0 2023-10-07T08:43:48.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff999654700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff994158ab0 con 0x7ff9940cbea0 2023-10-07T08:43:48.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff999654700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99415e980 con 0x7ff994157b90 2023-10-07T08:43:48.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff98a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9941577c0 0x7ff99415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff98a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9941577c0 0x7ff99415e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34066/0 (socket says 172.21.15.81:34066) 2023-10-07T08:43:48.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff98a7fc700 1 -- 172.21.15.81:0/2902136357 learned_addr learned my addr 172.21.15.81:0/2902136357 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:48.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff992ffd700 1 --2- 172.21.15.81:0/2902136357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9940cbea0 0x7ff9940b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff9937fe700 1 --2- 172.21.15.81:0/2902136357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff994157b90 0x7ff9941457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff98a7fc700 1 -- 172.21.15.81:0/2902136357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff994157b90 msgr2=0x7ff9941457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff98a7fc700 1 --2- 172.21.15.81:0/2902136357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff994157b90 0x7ff9941457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff98a7fc700 1 -- 172.21.15.81:0/2902136357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9940cbea0 msgr2=0x7ff9940b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:48.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff98a7fc700 1 --2- 172.21.15.81:0/2902136357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9940cbea0 0x7ff9940b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:48.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff98a7fc700 1 -- 172.21.15.81:0/2902136357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c009a20 con 0x7ff9941577c0 2023-10-07T08:43:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff992ffd700 1 --2- 172.21.15.81:0/2902136357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9940cbea0 0x7ff9940b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff9937fe700 1 --2- 172.21.15.81:0/2902136357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff994157b90 0x7ff9941457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff98a7fc700 1 --2- 172.21.15.81:0/2902136357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9941577c0 0x7ff99415e440 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff97c00c590 tx=0x7ff97c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff98b7fe700 1 -- 172.21.15.81:0/2902136357 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c005c00 con 0x7ff9941577c0 2023-10-07T08:43:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff98b7fe700 1 -- 172.21.15.81:0/2902136357 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97c005d60 con 0x7ff9941577c0 2023-10-07T08:43:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff999654700 1 -- 172.21.15.81:0/2902136357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff984009420 con 0x7ff9941577c0 2023-10-07T08:43:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff98b7fe700 1 -- 172.21.15.81:0/2902136357 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c007300 con 0x7ff9941577c0 2023-10-07T08:43:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.851+0000 7ff999654700 1 -- 172.21.15.81:0/2902136357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99415eee0 con 0x7ff9941577c0 2023-10-07T08:43:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.852+0000 7ff999654700 1 -- 172.21.15.81:0/2902136357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff994158c60 con 0x7ff9941577c0 2023-10-07T08:43:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.853+0000 7ff98b7fe700 1 -- 172.21.15.81:0/2902136357 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff97c01b3b0 con 0x7ff9941577c0 2023-10-07T08:43:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.853+0000 7ff98b7fe700 1 --2- 172.21.15.81:0/2902136357 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff974066f30 0x7ff9740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.853+0000 7ff98b7fe700 1 -- 172.21.15.81:0/2902136357 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff97c083a90 con 0x7ff9941577c0 2023-10-07T08:43:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.853+0000 7ff992ffd700 1 --2- 172.21.15.81:0/2902136357 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff974066f30 0x7ff9740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.853+0000 7ff992ffd700 1 --2- 172.21.15.81:0/2902136357 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff974066f30 0x7ff9740693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff9840091e0 tx=0x7ff984017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:48.857+0000 7ff98b7fe700 1 -- 172.21.15.81:0/2902136357 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff994158c60 con 0x7ff9941577c0 2023-10-07T08:43:49.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.115+0000 7ff999654700 1 -- 172.21.15.81:0/2902136357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff994158c60 con 0x7ff9941577c0 2023-10-07T08:43:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.118+0000 7ff98b7fe700 1 -- 172.21.15.81:0/2902136357 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff994158c60 con 0x7ff9941577c0 2023-10-07T08:43:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.120+0000 7ff999654700 1 -- 172.21.15.81:0/2902136357 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff974066f30 msgr2=0x7ff9740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.120+0000 7ff999654700 1 --2- 172.21.15.81:0/2902136357 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff974066f30 0x7ff9740693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff9840091e0 tx=0x7ff984017000 comp rx=0 tx=0).stop 2023-10-07T08:43:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.120+0000 7ff999654700 1 -- 172.21.15.81:0/2902136357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9941577c0 msgr2=0x7ff99415e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.120+0000 7ff999654700 1 --2- 172.21.15.81:0/2902136357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9941577c0 0x7ff99415e440 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff97c00c590 tx=0x7ff97c007dd0 comp rx=0 tx=0).stop 2023-10-07T08:43:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.120+0000 7ff999654700 1 -- 172.21.15.81:0/2902136357 shutdown_connections 2023-10-07T08:43:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.120+0000 7ff999654700 1 --2- 172.21.15.81:0/2902136357 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff974066f30 0x7ff9740693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.120+0000 7ff999654700 1 --2- 172.21.15.81:0/2902136357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff994157b90 0x7ff9941457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.120+0000 7ff999654700 1 --2- 172.21.15.81:0/2902136357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9940cbea0 0x7ff9940b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:49.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.120+0000 7ff999654700 1 --2- 172.21.15.81:0/2902136357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9941577c0 0x7ff99415e440 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:49.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.120+0000 7ff999654700 1 -- 172.21.15.81:0/2902136357 >> 172.21.15.81:0/2902136357 conn(0x7ff9940d0df0 msgr2=0x7ff9941568a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:49.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.120+0000 7ff999654700 1 -- 172.21.15.81:0/2902136357 shutdown_connections 2023-10-07T08:43:49.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.120+0000 7ff999654700 1 -- 172.21.15.81:0/2902136357 wait complete. 2023-10-07T08:43:49.124 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-07T08:43:49.134 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:43:49.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.246+0000 7efe7c03f700 1 Processor -- start 2023-10-07T08:43:49.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.246+0000 7efe7c03f700 1 -- start start 2023-10-07T08:43:49.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.247+0000 7efe7c03f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efe7415a2a0 0x7efe740b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:49.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.247+0000 7efe7c03f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe740b0ca0 con 0x7efe740ceb30 2023-10-07T08:43:49.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.247+0000 7efe7c03f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe740b00d0 con 0x7efe7406dd60 2023-10-07T08:43:49.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.247+0000 7efe7c03f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7406e160 con 0x7efe7415a2a0 2023-10-07T08:43:49.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.247+0000 7efe795da700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efe740ceb30 0x7efe7406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50188/0 (socket says 172.21.15.81:50188) 2023-10-07T08:43:49.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.247+0000 7efe795da700 1 -- 172.21.15.81:0/1227939178 learned_addr learned my addr 172.21.15.81:0/1227939178 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.247+0000 7efe79ddb700 1 --2- 172.21.15.81:0/1227939178 >> v2:172.21.15.89:3300/0 conn(0x7efe7415a2a0 0x7efe740b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe78dd9700 1 -- 172.21.15.81:0/1227939178 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678180588 0 0) 0x7efe740b0ca0 con 0x7efe740ceb30 2023-10-07T08:43:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe78dd9700 1 -- 172.21.15.81:0/1227939178 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe60003570 con 0x7efe740ceb30 2023-10-07T08:43:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe78dd9700 1 -- 172.21.15.81:0/1227939178 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1485044439 0 0) 0x7efe60003570 con 0x7efe740ceb30 2023-10-07T08:43:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe78dd9700 1 -- 172.21.15.81:0/1227939178 >> v2:172.21.15.89:3300/0 conn(0x7efe7415a2a0 msgr2=0x7efe740b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe78dd9700 1 --2- 172.21.15.81:0/1227939178 >> v2:172.21.15.89:3300/0 conn(0x7efe7415a2a0 0x7efe740b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe78dd9700 1 -- 172.21.15.81:0/1227939178 >> v1:172.21.15.89:6789/0 conn(0x7efe7406dd60 legacy=0x7efe740b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe78dd9700 1 -- 172.21.15.81:0/1227939178 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe740b0370 con 0x7efe740ceb30 2023-10-07T08:43:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe78dd9700 1 -- 172.21.15.81:0/1227939178 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7efe64001470 con 0x7efe740ceb30 2023-10-07T08:43:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe79ddb700 1 --2- 172.21.15.81:0/1227939178 >> v2:172.21.15.89:3300/0 conn(0x7efe7415a2a0 0x7efe740b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe78dd9700 1 -- 172.21.15.81:0/1227939178 >> v1:172.21.15.81:6789/0 conn(0x7efe740ceb30 legacy=0x7efe7406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe78dd9700 1 --2- 172.21.15.81:0/1227939178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe60003a60 0x7efe60003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe78dd9700 1 --2- 172.21.15.81:0/1227939178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe60004810 0x7efe60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe78dd9700 1 --2- 172.21.15.81:0/1227939178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe600051c0 0x7efe6000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe78dd9700 1 -- 172.21.15.81:0/1227939178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7406e160 con 0x7efe600051c0 2023-10-07T08:43:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe78dd9700 1 -- 172.21.15.81:0/1227939178 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6000c0d0 con 0x7efe60003a60 2023-10-07T08:43:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe78dd9700 1 -- 172.21.15.81:0/1227939178 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6000c290 con 0x7efe60004810 2023-10-07T08:43:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe7a5dc700 1 --2- 172.21.15.81:0/1227939178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe600051c0 0x7efe6000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe79ddb700 1 --2- 172.21.15.81:0/1227939178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe60003a60 0x7efe60003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe795da700 1 --2- 172.21.15.81:0/1227939178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe60004810 0x7efe60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe7a5dc700 1 -- 172.21.15.81:0/1227939178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe60004810 msgr2=0x7efe60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe7a5dc700 1 --2- 172.21.15.81:0/1227939178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe60004810 0x7efe60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe7a5dc700 1 -- 172.21.15.81:0/1227939178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe60003a60 msgr2=0x7efe60003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe7a5dc700 1 --2- 172.21.15.81:0/1227939178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe60003a60 0x7efe60003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe7a5dc700 1 -- 172.21.15.81:0/1227939178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe60003570 con 0x7efe600051c0 2023-10-07T08:43:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe7a5dc700 1 -- 172.21.15.81:0/1227939178 reap_dead start 2023-10-07T08:43:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.248+0000 7efe7a5dc700 1 --2- 172.21.15.81:0/1227939178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe600051c0 0x7efe6000ba60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efe6c001830 tx=0x7efe6c0129b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d9b1c3e2e87aec server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.249+0000 7efe78dd9700 1 -- 172.21.15.81:0/1227939178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c017070 con 0x7efe600051c0 2023-10-07T08:43:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.249+0000 7efe78dd9700 1 -- 172.21.15.81:0/1227939178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c0120d0 con 0x7efe600051c0 2023-10-07T08:43:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.249+0000 7efe78dd9700 1 -- 172.21.15.81:0/1227939178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0122a0 con 0x7efe600051c0 2023-10-07T08:43:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.249+0000 7efe7c03f700 1 -- 172.21.15.81:0/1227939178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe600051c0 msgr2=0x7efe6000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.249+0000 7efe7c03f700 1 --2- 172.21.15.81:0/1227939178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe600051c0 0x7efe6000ba60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efe6c001830 tx=0x7efe6c0129b0 comp rx=0 tx=0).stop 2023-10-07T08:43:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.249+0000 7efe7c03f700 1 -- 172.21.15.81:0/1227939178 shutdown_connections 2023-10-07T08:43:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.249+0000 7efe7c03f700 1 --2- 172.21.15.81:0/1227939178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe600051c0 0x7efe6000ba60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.249+0000 7efe7c03f700 1 -- 172.21.15.81:0/1227939178 >> 172.21.15.81:0/1227939178 conn(0x7efe74067640 msgr2=0x7efe74067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.249+0000 7efe7c03f700 1 -- 172.21.15.81:0/1227939178 shutdown_connections 2023-10-07T08:43:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.249+0000 7efe7c03f700 1 -- 172.21.15.81:0/1227939178 wait complete. 2023-10-07T08:43:49.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.250+0000 7efe7c03f700 1 Processor -- start 2023-10-07T08:43:49.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.250+0000 7efe7c03f700 1 -- start start 2023-10-07T08:43:49.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe7c03f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe600051c0 0x7efe741695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:49.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe7c03f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe741517e0 0x7efe74151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:49.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe7c03f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe740a76c0 0x7efe740a7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:49.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe7c03f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe740b25f0 con 0x7efe741517e0 2023-10-07T08:43:49.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe7c03f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe74165da0 con 0x7efe600051c0 2023-10-07T08:43:49.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe7c03f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe740b19e0 con 0x7efe740a76c0 2023-10-07T08:43:49.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe795da700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe741517e0 0x7efe74151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:49.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe795da700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe741517e0 0x7efe74151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34086/0 (socket says 172.21.15.81:34086) 2023-10-07T08:43:49.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe795da700 1 -- 172.21.15.81:0/3163219660 learned_addr learned my addr 172.21.15.81:0/3163219660 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:49.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe79ddb700 1 --2- 172.21.15.81:0/3163219660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe600051c0 0x7efe741695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:49.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe7a5dc700 1 --2- 172.21.15.81:0/3163219660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe740a76c0 0x7efe740a7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:49.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe795da700 1 -- 172.21.15.81:0/3163219660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe740a76c0 msgr2=0x7efe740a7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:49.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe795da700 1 --2- 172.21.15.81:0/3163219660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe740a76c0 0x7efe740a7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:49.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe795da700 1 -- 172.21.15.81:0/3163219660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe600051c0 msgr2=0x7efe741695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:49.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe795da700 1 --2- 172.21.15.81:0/3163219660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe600051c0 0x7efe741695b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:49.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe795da700 1 -- 172.21.15.81:0/3163219660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe740b1cc0 con 0x7efe741517e0 2023-10-07T08:43:49.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe79ddb700 1 --2- 172.21.15.81:0/3163219660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe600051c0 0x7efe741695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:49.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.251+0000 7efe795da700 1 --2- 172.21.15.81:0/3163219660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe741517e0 0x7efe74151c50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efe64007390 tx=0x7efe740b0c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:49.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.252+0000 7efe69ffb700 1 -- 172.21.15.81:0/3163219660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64018030 con 0x7efe741517e0 2023-10-07T08:43:49.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.252+0000 7efe69ffb700 1 -- 172.21.15.81:0/3163219660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe64007800 con 0x7efe741517e0 2023-10-07T08:43:49.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.252+0000 7efe7c03f700 1 -- 172.21.15.81:0/3163219660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe740b1fa0 con 0x7efe741517e0 2023-10-07T08:43:49.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.252+0000 7efe69ffb700 1 -- 172.21.15.81:0/3163219660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6400fb00 con 0x7efe741517e0 2023-10-07T08:43:49.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.252+0000 7efe7c03f700 1 -- 172.21.15.81:0/3163219660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe74152190 con 0x7efe741517e0 2023-10-07T08:43:49.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.253+0000 7efe7c03f700 1 -- 172.21.15.81:0/3163219660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe74069e40 con 0x7efe741517e0 2023-10-07T08:43:49.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.253+0000 7efe69ffb700 1 -- 172.21.15.81:0/3163219660 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe6401b070 con 0x7efe741517e0 2023-10-07T08:43:49.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.254+0000 7efe69ffb700 1 --2- 172.21.15.81:0/3163219660 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe58066f30 0x7efe580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:49.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.254+0000 7efe69ffb700 1 -- 172.21.15.81:0/3163219660 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efe64019070 con 0x7efe741517e0 2023-10-07T08:43:49.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.254+0000 7efe79ddb700 1 --2- 172.21.15.81:0/3163219660 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe58066f30 0x7efe580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:49.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.254+0000 7efe79ddb700 1 --2- 172.21.15.81:0/3163219660 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe58066f30 0x7efe580693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efe70006f00 tx=0x7efe70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:49.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.258+0000 7efe69ffb700 1 -- 172.21.15.81:0/3163219660 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe64051720 con 0x7efe741517e0 2023-10-07T08:43:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.485+0000 7efe7c03f700 1 -- 172.21.15.81:0/3163219660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe740b2730 con 0x7efe741517e0 2023-10-07T08:43:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.486+0000 7efe69ffb700 1 -- 172.21.15.81:0/3163219660 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4597 (secure 0 0 0) 0x7efe64054d40 con 0x7efe741517e0 2023-10-07T08:43:49.487 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:49.487 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1843075449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1843075449},{"type":"v1","addr":"172.21.15.81:6837","nonce":1843075449}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3013270804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3013270804},{"type":"v1","addr":"172.21.15.89:6835","nonce":3013270804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3825515993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3825515993},{"type":"v1","addr":"172.21.15.81:6836","nonce":3825515993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:43:43.620900+0000","modified":"2023-10-07T08:43:47.291987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6834/4005291324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":4005291324},{"type":"v1","addr":"172.21.15.89:6834","nonce":4005291324}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-07T08:43:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.488+0000 7efe7c03f700 1 -- 172.21.15.81:0/3163219660 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe58066f30 msgr2=0x7efe580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.488+0000 7efe7c03f700 1 --2- 172.21.15.81:0/3163219660 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe58066f30 0x7efe580693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efe70006f00 tx=0x7efe70008040 comp rx=0 tx=0).stop 2023-10-07T08:43:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.488+0000 7efe7c03f700 1 -- 172.21.15.81:0/3163219660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe741517e0 msgr2=0x7efe74151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.488+0000 7efe7c03f700 1 --2- 172.21.15.81:0/3163219660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe741517e0 0x7efe74151c50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efe64007390 tx=0x7efe740b0c10 comp rx=0 tx=0).stop 2023-10-07T08:43:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.488+0000 7efe7c03f700 1 -- 172.21.15.81:0/3163219660 shutdown_connections 2023-10-07T08:43:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.488+0000 7efe7c03f700 1 --2- 172.21.15.81:0/3163219660 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe58066f30 0x7efe580693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.488+0000 7efe7c03f700 1 --2- 172.21.15.81:0/3163219660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe740a76c0 0x7efe740a7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.488+0000 7efe7c03f700 1 --2- 172.21.15.81:0/3163219660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe600051c0 0x7efe741695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.488+0000 7efe7c03f700 1 --2- 172.21.15.81:0/3163219660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe741517e0 0x7efe74151c50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.488+0000 7efe7c03f700 1 -- 172.21.15.81:0/3163219660 >> 172.21.15.81:0/3163219660 conn(0x7efe74067640 msgr2=0x7efe740cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.488+0000 7efe7c03f700 1 -- 172.21.15.81:0/3163219660 shutdown_connections 2023-10-07T08:43:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:49.488+0000 7efe7c03f700 1 -- 172.21.15.81:0/3163219660 wait complete. 2023-10-07T08:43:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 15 2023-10-07T08:43:49.904 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T08:43:43.620900+0000', 'modified': '2023-10-07T08:43:47.291987+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4938}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4938': {'gid': 4938, 'name': 'd', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6834/4005291324', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6832', 'nonce': 4005291324}, {'type': 'v1', 'addr': '172.21.15.89:6834', 'nonce': 4005291324}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T08:43:49.904 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T08:43:49.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-07T08:43:50.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.018+0000 7f298c155700 1 Processor -- start 2023-10-07T08:43:50.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.019+0000 7f298c155700 1 -- start start 2023-10-07T08:43:50.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.019+0000 7f298c155700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29841578d0 0x7f29840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.019+0000 7f298c155700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f298406d120 0x7f298406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.019+0000 7f298c155700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29840d07c0 con 0x7f2984157ca0 2023-10-07T08:43:50.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.019+0000 7f298c155700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298406daa0 con 0x7f29841578d0 2023-10-07T08:43:50.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.019+0000 7f298c155700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29840cfbb0 con 0x7f298406d120 2023-10-07T08:43:50.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.020+0000 7f2989ef1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29841578d0 0x7f29840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.020+0000 7f29896f0700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2984157ca0 0x7f298415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50196/0 (socket says 172.21.15.81:50196) 2023-10-07T08:43:50.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.020+0000 7f29896f0700 1 -- 172.21.15.81:0/2934901629 learned_addr learned my addr 172.21.15.81:0/2934901629 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:50.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.020+0000 7f298a6f2700 1 --2- 172.21.15.81:0/2934901629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f298406d120 0x7f298406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.020+0000 7f2989ef1700 1 -- 172.21.15.81:0/2934901629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f298406d120 msgr2=0x7f298406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:50.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.020+0000 7f2989ef1700 1 --2- 172.21.15.81:0/2934901629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f298406d120 0x7f298406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.020+0000 7f2989ef1700 1 -- 172.21.15.81:0/2934901629 >> v1:172.21.15.81:6789/0 conn(0x7f2984157ca0 legacy=0x7f298415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.020+0000 7f2988eef700 1 -- 172.21.15.81:0/2934901629 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192967467 0 0) 0x7f29840d07c0 con 0x7f2984157ca0 2023-10-07T08:43:50.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.020+0000 7f2989ef1700 1 -- 172.21.15.81:0/2934901629 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29840cfe90 con 0x7f29841578d0 2023-10-07T08:43:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.020+0000 7f2989ef1700 1 --2- 172.21.15.81:0/2934901629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29841578d0 0x7f29840cf4f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2980009e60 tx=0x7f2980009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5395b5e6c55d261c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.020+0000 7f2988eef700 1 -- 172.21.15.81:0/2934901629 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298000e070 con 0x7f29841578d0 2023-10-07T08:43:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.020+0000 7f2988eef700 1 -- 172.21.15.81:0/2934901629 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298000bb60 con 0x7f29841578d0 2023-10-07T08:43:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.020+0000 7f2988eef700 1 -- 172.21.15.81:0/2934901629 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2980012430 con 0x7f29841578d0 2023-10-07T08:43:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.021+0000 7f298c155700 1 -- 172.21.15.81:0/2934901629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29841578d0 msgr2=0x7f29840cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.021+0000 7f298c155700 1 --2- 172.21.15.81:0/2934901629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29841578d0 0x7f29840cf4f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2980009e60 tx=0x7f2980009780 comp rx=0 tx=0).stop 2023-10-07T08:43:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.021+0000 7f298c155700 1 -- 172.21.15.81:0/2934901629 shutdown_connections 2023-10-07T08:43:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.021+0000 7f298c155700 1 --2- 172.21.15.81:0/2934901629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29841578d0 0x7f29840cf4f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.021+0000 7f298c155700 1 --2- 172.21.15.81:0/2934901629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f298406d120 0x7f298406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.021+0000 7f298c155700 1 -- 172.21.15.81:0/2934901629 >> 172.21.15.81:0/2934901629 conn(0x7f298406bb90 msgr2=0x7f298406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.021+0000 7f298c155700 1 -- 172.21.15.81:0/2934901629 shutdown_connections 2023-10-07T08:43:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.021+0000 7f298c155700 1 -- 172.21.15.81:0/2934901629 wait complete. 2023-10-07T08:43:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.022+0000 7f298c155700 1 Processor -- start 2023-10-07T08:43:50.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.022+0000 7f298c155700 1 -- start start 2023-10-07T08:43:50.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f298c155700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f298406d120 0x7f298414f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f298c155700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29841578d0 0x7f298416dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f298c155700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2984157ca0 0x7f29840b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f298c155700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2984153850 con 0x7f2984157ca0 2023-10-07T08:43:50.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f298c155700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2984154800 con 0x7f29841578d0 2023-10-07T08:43:50.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f298c155700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298414bf60 con 0x7f298406d120 2023-10-07T08:43:50.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f298a6f2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2984157ca0 0x7f29840b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f298a6f2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2984157ca0 0x7f29840b6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34112/0 (socket says 172.21.15.81:34112) 2023-10-07T08:43:50.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f298a6f2700 1 -- 172.21.15.81:0/1936144886 learned_addr learned my addr 172.21.15.81:0/1936144886 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:50.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f2989ef1700 1 --2- 172.21.15.81:0/1936144886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f298406d120 0x7f298414f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f29896f0700 1 --2- 172.21.15.81:0/1936144886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29841578d0 0x7f298416dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f298a6f2700 1 -- 172.21.15.81:0/1936144886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f298406d120 msgr2=0x7f298414f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f298a6f2700 1 --2- 172.21.15.81:0/1936144886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f298406d120 0x7f298414f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f298a6f2700 1 -- 172.21.15.81:0/1936144886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29841578d0 msgr2=0x7f298416dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f298a6f2700 1 --2- 172.21.15.81:0/1936144886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29841578d0 0x7f298416dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f298a6f2700 1 -- 172.21.15.81:0/1936144886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2980009a20 con 0x7f2984157ca0 2023-10-07T08:43:50.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f298a6f2700 1 --2- 172.21.15.81:0/1936144886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2984157ca0 0x7f29840b6130 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f297c00ea80 tx=0x7f297c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:50.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f2979ffb700 1 -- 172.21.15.81:0/1936144886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c00c920 con 0x7f2984157ca0 2023-10-07T08:43:50.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f2979ffb700 1 -- 172.21.15.81:0/1936144886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c00ca80 con 0x7f2984157ca0 2023-10-07T08:43:50.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f298c155700 1 -- 172.21.15.81:0/1936144886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2984153a40 con 0x7f2984157ca0 2023-10-07T08:43:50.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.023+0000 7f2979ffb700 1 -- 172.21.15.81:0/1936144886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c00ce40 con 0x7f2984157ca0 2023-10-07T08:43:50.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.024+0000 7f298c155700 1 -- 172.21.15.81:0/1936144886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2984154000 con 0x7f2984157ca0 2023-10-07T08:43:50.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.025+0000 7f2979ffb700 1 -- 172.21.15.81:0/1936144886 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f297c013680 con 0x7f2984157ca0 2023-10-07T08:43:50.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.025+0000 7f2979ffb700 1 --2- 172.21.15.81:0/1936144886 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2968066f30 0x7f29680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.025+0000 7f2979ffb700 1 -- 172.21.15.81:0/1936144886 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f297c084850 con 0x7f2984157ca0 2023-10-07T08:43:50.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.025+0000 7f2989ef1700 1 --2- 172.21.15.81:0/1936144886 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2968066f30 0x7f29680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.026+0000 7f2989ef1700 1 --2- 172.21.15.81:0/1936144886 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2968066f30 0x7f29680693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f29800097c0 tx=0x7f2980019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:50.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.027+0000 7f299544db80 1 Processor -- start 2023-10-07T08:43:50.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.027+0000 7f299544db80 1 -- start start 2023-10-07T08:43:50.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f299544db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc07bae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f299544db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 0x556bc07e3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f299544db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f299544db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc0711a70 con 0x556bc07e3f60 2023-10-07T08:43:50.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f299544db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc070f270 con 0x556bc0804d00 2023-10-07T08:43:50.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f299544db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x556bc070b060 con 0x556bc07baa50 2023-10-07T08:43:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f298a6f2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f298a6f2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07b6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34116/0 (socket says 172.21.15.81:34116) 2023-10-07T08:43:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f298a6f2700 1 -- 172.21.15.81:0/451801008 learned_addr learned my addr 172.21.15.81:0/451801008 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f2989ef1700 1 --2- 172.21.15.81:0/451801008 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc07bae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f29896f0700 1 --2- 172.21.15.81:0/451801008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 0x556bc07e3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f298a6f2700 1 -- 172.21.15.81:0/451801008 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 msgr2=0x556bc07bae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f298a6f2700 1 --2- 172.21.15.81:0/451801008 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc07bae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f298a6f2700 1 -- 172.21.15.81:0/451801008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 msgr2=0x556bc07e3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f298a6f2700 1 --2- 172.21.15.81:0/451801008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 0x556bc07e3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f298a6f2700 1 -- 172.21.15.81:0/451801008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bc05a5270 con 0x556bc07e3f60 2023-10-07T08:43:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f29896f0700 1 --2- 172.21.15.81:0/451801008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 0x556bc07e3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f2989ef1700 1 --2- 172.21.15.81:0/451801008 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc07bae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f298a6f2700 1 --2- 172.21.15.81:0/451801008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07b6cf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f297c082d40 tx=0x7f297c082cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b1002aac40c9db server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f296effd700 1 -- 172.21.15.81:0/451801008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c05c720 con 0x556bc07e3f60 2023-10-07T08:43:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f296effd700 1 -- 172.21.15.81:0/451801008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c0538c0 con 0x556bc07e3f60 2023-10-07T08:43:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.028+0000 7f296effd700 1 -- 172.21.15.81:0/451801008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c0559e0 con 0x556bc07e3f60 2023-10-07T08:43:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.029+0000 7f299544db80 1 -- 172.21.15.81:0/451801008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 msgr2=0x556bc07b6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.029+0000 7f299544db80 1 --2- 172.21.15.81:0/451801008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07b6cf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f297c082d40 tx=0x7f297c082cd0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.029+0000 7f299544db80 1 -- 172.21.15.81:0/451801008 shutdown_connections 2023-10-07T08:43:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.029+0000 7f299544db80 1 --2- 172.21.15.81:0/451801008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07b6cf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.029+0000 7f299544db80 1 --2- 172.21.15.81:0/451801008 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc07bae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.029+0000 7f299544db80 1 --2- 172.21.15.81:0/451801008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 0x556bc07e3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.029+0000 7f299544db80 1 -- 172.21.15.81:0/451801008 >> 172.21.15.81:0/451801008 conn(0x556bc07bc370 msgr2=0x556bc07bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.029+0000 7f299544db80 1 -- 172.21.15.81:0/451801008 shutdown_connections 2023-10-07T08:43:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.029+0000 7f299544db80 1 -- 172.21.15.81:0/451801008 wait complete. 2023-10-07T08:43:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.030+0000 7f299544db80 1 -- start start 2023-10-07T08:43:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.030+0000 7f299544db80 1 Processor -- start 2023-10-07T08:43:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f299544db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc07f9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f299544db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f299544db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 0x556bc07b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f299544db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc06b6890 con 0x556bc07e3f60 2023-10-07T08:43:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f299544db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc06d1ea0 con 0x556bc0804d00 2023-10-07T08:43:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f299544db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x556bc058de30 con 0x556bc07baa50 2023-10-07T08:43:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f299544db80 10 client.0 _ll_register_callbacks cb 0x556bc077e110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:43:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f29896f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f29896f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07b5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34124/0 (socket says 172.21.15.81:34124) 2023-10-07T08:43:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f29896f0700 1 -- 172.21.15.81:0/3616896873 learned_addr learned my addr 172.21.15.81:0/3616896873 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f2989ef1700 1 --2- 172.21.15.81:0/3616896873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc07f9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f298a6f2700 1 --2- 172.21.15.81:0/3616896873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 0x556bc07b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f29896f0700 1 -- 172.21.15.81:0/3616896873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 msgr2=0x556bc07f9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f29896f0700 1 --2- 172.21.15.81:0/3616896873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc07f9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f29896f0700 1 -- 172.21.15.81:0/3616896873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 msgr2=0x556bc07b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f29896f0700 1 --2- 172.21.15.81:0/3616896873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 0x556bc07b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f29896f0700 1 -- 172.21.15.81:0/3616896873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2984154000 con 0x556bc07e3f60 2023-10-07T08:43:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f298a6f2700 1 --2- 172.21.15.81:0/3616896873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 0x556bc07b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f2989ef1700 1 --2- 172.21.15.81:0/3616896873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc07f9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f29896f0700 1 --2- 172.21.15.81:0/3616896873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07b5c20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f29740078e0 tx=0x7f2974009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a234ec4ffab1c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f2963fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:43:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f2963fff700 1 -- 172.21.15.81:0/3616896873 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297400d070 con 0x556bc07e3f60 2023-10-07T08:43:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f2963fff700 1 -- 172.21.15.81:0/3616896873 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2974006ab0 con 0x556bc07e3f60 2023-10-07T08:43:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f299544db80 1 -- 172.21.15.81:0/3616896873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556bc07afb70 con 0x556bc07e3f60 2023-10-07T08:43:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f2963fff700 1 -- 172.21.15.81:0/3616896873 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f297400fde0 con 0x556bc07e3f60 2023-10-07T08:43:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f299544db80 10 client.5118 fetch_fsmap learned FSMap version 15 2023-10-07T08:43:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f299544db80 1 -- 172.21.15.81:0/3616896873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x556bc0547fe0 con 0x556bc07e3f60 2023-10-07T08:43:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.031+0000 7f2963fff700 1 -- 172.21.15.81:0/3616896873 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556bc07afb70 con 0x556bc07e3f60 2023-10-07T08:43:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.032+0000 7f2963fff700 1 -- 172.21.15.81:0/3616896873 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2974014430 con 0x556bc07e3f60 2023-10-07T08:43:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.032+0000 7f299544db80 10 client.5118 fetch_fsmap finished waiting for FSMap version 15 2023-10-07T08:43:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.032+0000 7f299544db80 10 client.5118 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-07T08:43:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.032+0000 7f299544db80 20 client.5118 populate_metadata read hostname 'smithi081' 2023-10-07T08:43:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.032+0000 7f299544db80 1 --2- 172.21.15.81:0/3616896873 >> [v2:172.21.15.89:6832/4005291324,v1:172.21.15.89:6834/4005291324] conn(0x556bc07fd7a0 0x556bc07fdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.032+0000 7f299544db80 4 client.5118 mds_command: new command op to 4938 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T08:43:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.032+0000 7f299544db80 1 -- 172.21.15.81:0/3616896873 --> [v2:172.21.15.89:6832/4005291324,v1:172.21.15.89:6834/4005291324] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556bc078caa0 con 0x556bc07fd7a0 2023-10-07T08:43:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.032+0000 7f2989ef1700 1 --2- 172.21.15.81:0/3616896873 >> [v2:172.21.15.89:6832/4005291324,v1:172.21.15.89:6834/4005291324] conn(0x556bc07fd7a0 0x556bc07fdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.032+0000 7f2963fff700 10 client.5118 ms_handle_connect on v2:172.21.15.89:6832/4005291324 2023-10-07T08:43:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.032+0000 7f2989ef1700 1 --2- 172.21.15.81:0/3616896873 >> [v2:172.21.15.89:6832/4005291324,v1:172.21.15.89:6834/4005291324] conn(0x556bc07fd7a0 0x556bc07fdb70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18d6f7d82ef7c937 server_cookie=ce31aa6a0492e4a2 in_seq=0 out_seq=0 2023-10-07T08:43:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.033+0000 7f2963fff700 1 -- 172.21.15.81:0/3616896873 <== mds.0 v2:172.21.15.89:6832/4005291324 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x556bc078caa0 con 0x556bc07fd7a0 2023-10-07T08:43:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.033+0000 7f2963fff700 10 client.5118 handle_command_reply: tid=0 2023-10-07T08:43:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.033+0000 7f299544db80 1 client.5118 shutdown 2023-10-07T08:43:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.033+0000 7f299544db80 1 -- 172.21.15.81:0/3616896873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 msgr2=0x556bc07b5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.033+0000 7f299544db80 1 --2- 172.21.15.81:0/3616896873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07b5c20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f29740078e0 tx=0x7f2974009040 comp rx=0 tx=0).stop 2023-10-07T08:43:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.033+0000 7f299544db80 1 -- 172.21.15.81:0/3616896873 shutdown_connections 2023-10-07T08:43:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.033+0000 7f299544db80 1 --2- 172.21.15.81:0/3616896873 >> [v2:172.21.15.89:6832/4005291324,v1:172.21.15.89:6834/4005291324] conn(0x556bc07fd7a0 0x556bc07fdb70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.033+0000 7f299544db80 1 --2- 172.21.15.81:0/3616896873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 0x556bc07b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.033+0000 7f2963fff700 0 client.5118 ms_handle_reset on v2:172.21.15.89:6832/4005291324 2023-10-07T08:43:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.033+0000 7f299544db80 1 --2- 172.21.15.81:0/3616896873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc07f9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.033+0000 7f299544db80 1 --2- 172.21.15.81:0/3616896873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07b5c20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.033+0000 7f299544db80 1 -- 172.21.15.81:0/3616896873 >> 172.21.15.81:0/3616896873 conn(0x556bc07bc370 msgr2=0x556bc07e2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.033+0000 7f299544db80 1 -- 172.21.15.81:0/3616896873 shutdown_connections 2023-10-07T08:43:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.033+0000 7f299544db80 1 -- 172.21.15.81:0/3616896873 wait complete. 2023-10-07T08:43:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.033+0000 7f299544db80 20 client.5118 trim_cache size 0 max 16384 2023-10-07T08:43:50.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.050+0000 7f299544db80 1 Processor -- start 2023-10-07T08:43:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.050+0000 7f299544db80 1 -- start start 2023-10-07T08:43:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.050+0000 7f299544db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc07bb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.050+0000 7f299544db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.050+0000 7f299544db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 0x556bc08035a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.050+0000 7f299544db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc0804a30 con 0x556bc07e3f60 2023-10-07T08:43:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.050+0000 7f299544db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc07b7fc0 con 0x556bc0804d00 2023-10-07T08:43:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.050+0000 7f299544db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x556bc07b55a0 con 0x556bc07baa50 2023-10-07T08:43:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.050+0000 7f29896f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.050+0000 7f29896f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07f8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34140/0 (socket says 172.21.15.81:34140) 2023-10-07T08:43:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.050+0000 7f29896f0700 1 -- 172.21.15.81:0/3822812790 learned_addr learned my addr 172.21.15.81:0/3822812790 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f29896f0700 1 -- 172.21.15.81:0/3822812790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 msgr2=0x556bc07bb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f29896f0700 1 --2- 172.21.15.81:0/3822812790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc07bb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f29896f0700 1 -- 172.21.15.81:0/3822812790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 msgr2=0x556bc08035a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f298a6f2700 1 --2- 172.21.15.81:0/3822812790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 0x556bc08035a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f29896f0700 1 --2- 172.21.15.81:0/3822812790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 0x556bc08035a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f29896f0700 1 -- 172.21.15.81:0/3822812790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bc06d9780 con 0x556bc07e3f60 2023-10-07T08:43:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f29896f0700 1 --2- 172.21.15.81:0/3822812790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07f8c20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f297400a020 tx=0x7f297401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1acbf2881c462c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f296f7fe700 1 -- 172.21.15.81:0/3822812790 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974006a20 con 0x556bc07e3f60 2023-10-07T08:43:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f296f7fe700 1 -- 172.21.15.81:0/3822812790 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2974014430 con 0x556bc07e3f60 2023-10-07T08:43:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f296f7fe700 1 -- 172.21.15.81:0/3822812790 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974006b80 con 0x556bc07e3f60 2023-10-07T08:43:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f299544db80 1 -- 172.21.15.81:0/3822812790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 msgr2=0x556bc07f8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f299544db80 1 --2- 172.21.15.81:0/3822812790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07f8c20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f297400a020 tx=0x7f297401f000 comp rx=0 tx=0).stop 2023-10-07T08:43:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f299544db80 1 -- 172.21.15.81:0/3822812790 shutdown_connections 2023-10-07T08:43:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f299544db80 1 --2- 172.21.15.81:0/3822812790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc0804d00 0x556bc08035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f299544db80 1 --2- 172.21.15.81:0/3822812790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc07bb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f299544db80 1 --2- 172.21.15.81:0/3822812790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc07e3f60 0x556bc07f8c20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.051+0000 7f299544db80 1 -- 172.21.15.81:0/3822812790 >> 172.21.15.81:0/3822812790 conn(0x556bc07bc370 msgr2=0x556bc07bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.052+0000 7f299544db80 1 -- 172.21.15.81:0/3822812790 shutdown_connections 2023-10-07T08:43:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.052+0000 7f299544db80 1 -- 172.21.15.81:0/3822812790 wait complete. 2023-10-07T08:43:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.052+0000 7f299544db80 1 -- start start 2023-10-07T08:43:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.052+0000 7f299544db80 1 Processor -- start 2023-10-07T08:43:50.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f299544db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc081e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f299544db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc07e3f60 0x556bc07e6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f299544db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc0804d00 0x556bc07b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f299544db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc07e6880 con 0x556bc0804d00 2023-10-07T08:43:50.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f299544db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc081ee00 con 0x556bc07e3f60 2023-10-07T08:43:50.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f299544db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x556bc07eaa50 con 0x556bc07baa50 2023-10-07T08:43:50.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f299544db80 10 client.0 _ll_register_callbacks cb 0x556bc077e110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:43:50.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f298a6f2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc0804d00 0x556bc07b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f298a6f2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc0804d00 0x556bc07b5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34142/0 (socket says 172.21.15.81:34142) 2023-10-07T08:43:50.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f298a6f2700 1 -- 172.21.15.81:0/4035122097 learned_addr learned my addr 172.21.15.81:0/4035122097 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f2989ef1700 1 --2- 172.21.15.81:0/4035122097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc081e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f29896f0700 1 --2- 172.21.15.81:0/4035122097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc07e3f60 0x556bc07e6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f298a6f2700 1 -- 172.21.15.81:0/4035122097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 msgr2=0x556bc081e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f298a6f2700 1 --2- 172.21.15.81:0/4035122097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc081e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f298a6f2700 1 -- 172.21.15.81:0/4035122097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc07e3f60 msgr2=0x556bc07e6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f298a6f2700 1 --2- 172.21.15.81:0/4035122097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc07e3f60 0x556bc07e6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f298a6f2700 1 -- 172.21.15.81:0/4035122097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556bc0547fe0 con 0x556bc0804d00 2023-10-07T08:43:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f298a6f2700 1 --2- 172.21.15.81:0/4035122097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc0804d00 0x556bc07b5c20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f297c0521a0 tx=0x7f297c06c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87ba8063abd01de server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:50.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.053+0000 7f2963fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:43:50.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.054+0000 7f2963fff700 1 -- 172.21.15.81:0/4035122097 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c0589d0 con 0x556bc0804d00 2023-10-07T08:43:50.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.054+0000 7f2963fff700 1 -- 172.21.15.81:0/4035122097 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f297c084070 con 0x556bc0804d00 2023-10-07T08:43:50.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.054+0000 7f299544db80 1 -- 172.21.15.81:0/4035122097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f297c0538c0 con 0x556bc0804d00 2023-10-07T08:43:50.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.054+0000 7f2963fff700 1 -- 172.21.15.81:0/4035122097 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f297c05c720 con 0x556bc0804d00 2023-10-07T08:43:50.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.054+0000 7f299544db80 10 client.5124 fetch_fsmap learned FSMap version 15 2023-10-07T08:43:50.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.054+0000 7f299544db80 1 -- 172.21.15.81:0/4035122097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x556bc06c0470 con 0x556bc0804d00 2023-10-07T08:43:50.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.054+0000 7f2963fff700 1 -- 172.21.15.81:0/4035122097 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c0538c0 con 0x556bc0804d00 2023-10-07T08:43:50.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.054+0000 7f2963fff700 1 -- 172.21.15.81:0/4035122097 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f297c063020 con 0x556bc0804d00 2023-10-07T08:43:50.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.054+0000 7f299544db80 10 client.5124 fetch_fsmap finished waiting for FSMap version 15 2023-10-07T08:43:50.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.054+0000 7f299544db80 10 client.5124 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-07T08:43:50.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.054+0000 7f299544db80 20 client.5124 populate_metadata read hostname 'smithi081' 2023-10-07T08:43:50.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.054+0000 7f299544db80 1 --2- 172.21.15.81:0/4035122097 >> [v2:172.21.15.89:6832/4005291324,v1:172.21.15.89:6834/4005291324] conn(0x556bc07f78c0 0x556bc07f7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.054+0000 7f299544db80 4 client.5124 mds_command: new command op to 4938 tid=0[{"prefix": "status"}] 2023-10-07T08:43:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.054+0000 7f299544db80 1 -- 172.21.15.81:0/4035122097 --> [v2:172.21.15.89:6832/4005291324,v1:172.21.15.89:6834/4005291324] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556bc06ade00 con 0x556bc07f78c0 2023-10-07T08:43:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.054+0000 7f2989ef1700 1 --2- 172.21.15.81:0/4035122097 >> [v2:172.21.15.89:6832/4005291324,v1:172.21.15.89:6834/4005291324] conn(0x556bc07f78c0 0x556bc07f7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f2963fff700 10 client.5124 ms_handle_connect on v2:172.21.15.89:6832/4005291324 2023-10-07T08:43:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f2989ef1700 1 --2- 172.21.15.81:0/4035122097 >> [v2:172.21.15.89:6832/4005291324,v1:172.21.15.89:6834/4005291324] conn(0x556bc07f78c0 0x556bc07f7c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c786c641a46c3096 server_cookie=b7c22d57fb57ed1e in_seq=0 out_seq=0 2023-10-07T08:43:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f2963fff700 1 -- 172.21.15.81:0/4035122097 <== mds.0 v2:172.21.15.89:6832/4005291324 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x556bc06ade00 con 0x556bc07f78c0 2023-10-07T08:43:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f2963fff700 10 client.5124 handle_command_reply: tid=0 2023-10-07T08:43:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f299544db80 1 client.5124 shutdown 2023-10-07T08:43:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f299544db80 1 -- 172.21.15.81:0/4035122097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc0804d00 msgr2=0x556bc07b5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f299544db80 1 --2- 172.21.15.81:0/4035122097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc0804d00 0x556bc07b5c20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f297c0521a0 tx=0x7f297c06c000 comp rx=0 tx=0).stop 2023-10-07T08:43:50.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f299544db80 1 -- 172.21.15.81:0/4035122097 shutdown_connections 2023-10-07T08:43:50.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f299544db80 1 --2- 172.21.15.81:0/4035122097 >> [v2:172.21.15.89:6832/4005291324,v1:172.21.15.89:6834/4005291324] conn(0x556bc07f78c0 0x556bc07f7c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f299544db80 1 --2- 172.21.15.81:0/4035122097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc0804d00 0x556bc07b5c20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f2963fff700 0 client.5124 ms_handle_reset on v2:172.21.15.89:6832/4005291324 2023-10-07T08:43:50.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f299544db80 1 --2- 172.21.15.81:0/4035122097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556bc07baa50 0x556bc081e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f299544db80 1 --2- 172.21.15.81:0/4035122097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556bc07e3f60 0x556bc07e6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f299544db80 1 -- 172.21.15.81:0/4035122097 >> 172.21.15.81:0/4035122097 conn(0x556bc07bc370 msgr2=0x556bc07fb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f299544db80 1 -- 172.21.15.81:0/4035122097 shutdown_connections 2023-10-07T08:43:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f299544db80 1 -- 172.21.15.81:0/4035122097 wait complete. 2023-10-07T08:43:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.055+0000 7f299544db80 20 client.5124 trim_cache size 0 max 16384 2023-10-07T08:43:50.070 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:43:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:43:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-07T08:43:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4938, 2023-10-07T08:43:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-07T08:43:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-07T08:43:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-07T08:43:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.7878357139999999, 2023-10-07T08:43:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 15, 2023-10-07T08:43:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 33, 2023-10-07T08:43:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 33, 2023-10-07T08:43:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 13.822410965 2023-10-07T08:43:50.073 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:43:50.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.056+0000 7f298c155700 1 -- 172.21.15.81:0/1936144886 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2968066f30 msgr2=0x7f29680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.056+0000 7f298c155700 1 --2- 172.21.15.81:0/1936144886 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2968066f30 0x7f29680693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f29800097c0 tx=0x7f2980019000 comp rx=0 tx=0).stop 2023-10-07T08:43:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.056+0000 7f298c155700 1 -- 172.21.15.81:0/1936144886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2984157ca0 msgr2=0x7f29840b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.056+0000 7f298c155700 1 --2- 172.21.15.81:0/1936144886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2984157ca0 0x7f29840b6130 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f297c00ea80 tx=0x7f297c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.056+0000 7f298c155700 1 -- 172.21.15.81:0/1936144886 shutdown_connections 2023-10-07T08:43:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.056+0000 7f298c155700 1 --2- 172.21.15.81:0/1936144886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2984157ca0 0x7f29840b6130 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.056+0000 7f298c155700 1 --2- 172.21.15.81:0/1936144886 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2968066f30 0x7f29680693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.056+0000 7f298c155700 1 --2- 172.21.15.81:0/1936144886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f298406d120 0x7f298414f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.056+0000 7f298c155700 1 --2- 172.21.15.81:0/1936144886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29841578d0 0x7f298416dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.056+0000 7f298c155700 1 -- 172.21.15.81:0/1936144886 >> 172.21.15.81:0/1936144886 conn(0x7f298406bb90 msgr2=0x7f2984156980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.056+0000 7f298c155700 1 -- 172.21.15.81:0/1936144886 shutdown_connections 2023-10-07T08:43:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.056+0000 7f298c155700 1 -- 172.21.15.81:0/1936144886 wait complete. 2023-10-07T08:43:50.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:43:50.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.188+0000 7fdafabf5700 1 Processor -- start 2023-10-07T08:43:50.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.188+0000 7fdafabf5700 1 -- start start 2023-10-07T08:43:50.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.189+0000 7fdafabf5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdaf40cf240 0x7fdaf4162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.189+0000 7fdafabf5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf40b2890 con 0x7fdaf4157fe0 2023-10-07T08:43:50.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.189+0000 7fdafabf5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf40b4070 con 0x7fdaf40b3bd0 2023-10-07T08:43:50.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.189+0000 7fdafabf5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf40b4350 con 0x7fdaf40cf240 2023-10-07T08:43:50.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.189+0000 7fdaf8991700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdaf4157fe0 0x7fdaf40b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50206/0 (socket says 172.21.15.81:50206) 2023-10-07T08:43:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.189+0000 7fdaf8991700 1 -- 172.21.15.81:0/1412928637 learned_addr learned my addr 172.21.15.81:0/1412928637 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.189+0000 7fdaf9192700 1 --2- 172.21.15.81:0/1412928637 >> v2:172.21.15.89:3300/0 conn(0x7fdaf40cf240 0x7fdaf4162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.189+0000 7fdaf37fe700 1 -- 172.21.15.81:0/1412928637 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700472402 0 0) 0x7fdaf40b2890 con 0x7fdaf4157fe0 2023-10-07T08:43:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.189+0000 7fdaf37fe700 1 -- 172.21.15.81:0/1412928637 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdae0003570 con 0x7fdaf4157fe0 2023-10-07T08:43:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf37fe700 1 -- 172.21.15.81:0/1412928637 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3906792437 0 0) 0x7fdae0003570 con 0x7fdaf4157fe0 2023-10-07T08:43:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf37fe700 1 -- 172.21.15.81:0/1412928637 >> v2:172.21.15.89:3300/0 conn(0x7fdaf40cf240 msgr2=0x7fdaf4162cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf37fe700 1 --2- 172.21.15.81:0/1412928637 >> v2:172.21.15.89:3300/0 conn(0x7fdaf40cf240 0x7fdaf4162cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf37fe700 1 -- 172.21.15.81:0/1412928637 >> v1:172.21.15.89:6789/0 conn(0x7fdaf40b3bd0 legacy=0x7fdaf40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf37fe700 1 -- 172.21.15.81:0/1412928637 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf40b4630 con 0x7fdaf4157fe0 2023-10-07T08:43:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf37fe700 1 -- 172.21.15.81:0/1412928637 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fdaec001470 con 0x7fdaf4157fe0 2023-10-07T08:43:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf37fe700 1 -- 172.21.15.81:0/1412928637 >> v1:172.21.15.81:6789/0 conn(0x7fdaf4157fe0 legacy=0x7fdaf40b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf37fe700 1 --2- 172.21.15.81:0/1412928637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdae0003a60 0x7fdae0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf37fe700 1 --2- 172.21.15.81:0/1412928637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdae0004810 0x7fdae0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf37fe700 1 --2- 172.21.15.81:0/1412928637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdae00051c0 0x7fdae000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf37fe700 1 -- 172.21.15.81:0/1412928637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40b4350 con 0x7fdae0004810 2023-10-07T08:43:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf37fe700 1 -- 172.21.15.81:0/1412928637 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae000c0e0 con 0x7fdae00051c0 2023-10-07T08:43:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf37fe700 1 -- 172.21.15.81:0/1412928637 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae000c2a0 con 0x7fdae0003a60 2023-10-07T08:43:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf3fff700 1 --2- 172.21.15.81:0/1412928637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdae0004810 0x7fdae0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf8991700 1 --2- 172.21.15.81:0/1412928637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdae0003a60 0x7fdae0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf9192700 1 --2- 172.21.15.81:0/1412928637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdae00051c0 0x7fdae000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf3fff700 1 -- 172.21.15.81:0/1412928637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdae0003a60 msgr2=0x7fdae0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf3fff700 1 --2- 172.21.15.81:0/1412928637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdae0003a60 0x7fdae0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf3fff700 1 -- 172.21.15.81:0/1412928637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdae00051c0 msgr2=0x7fdae000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf3fff700 1 --2- 172.21.15.81:0/1412928637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdae00051c0 0x7fdae000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf3fff700 1 -- 172.21.15.81:0/1412928637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae0003570 con 0x7fdae0004810 2023-10-07T08:43:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf9192700 1 --2- 172.21.15.81:0/1412928637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdae00051c0 0x7fdae000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf8991700 1 --2- 172.21.15.81:0/1412928637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdae0003a60 0x7fdae0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf9192700 1 -- 172.21.15.81:0/1412928637 reap_dead start 2023-10-07T08:43:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf3fff700 1 --2- 172.21.15.81:0/1412928637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdae0004810 0x7fdae0004c80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdae4002030 tx=0x7fdae40016e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea7da8be15c8a38 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf37fe700 1 -- 172.21.15.81:0/1412928637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae40019f0 con 0x7fdae0004810 2023-10-07T08:43:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf37fe700 1 -- 172.21.15.81:0/1412928637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae400c8b0 con 0x7fdae0004810 2023-10-07T08:43:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.190+0000 7fdaf37fe700 1 -- 172.21.15.81:0/1412928637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae400cc50 con 0x7fdae0004810 2023-10-07T08:43:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.191+0000 7fdafabf5700 1 -- 172.21.15.81:0/1412928637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdae0004810 msgr2=0x7fdae0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.191+0000 7fdafabf5700 1 --2- 172.21.15.81:0/1412928637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdae0004810 0x7fdae0004c80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdae4002030 tx=0x7fdae40016e0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.191+0000 7fdafabf5700 1 -- 172.21.15.81:0/1412928637 shutdown_connections 2023-10-07T08:43:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.191+0000 7fdafabf5700 1 --2- 172.21.15.81:0/1412928637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdae0004810 0x7fdae0004c80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.191+0000 7fdafabf5700 1 -- 172.21.15.81:0/1412928637 >> 172.21.15.81:0/1412928637 conn(0x7fdaf4067640 msgr2=0x7fdaf4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.191+0000 7fdafabf5700 1 -- 172.21.15.81:0/1412928637 shutdown_connections 2023-10-07T08:43:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.191+0000 7fdafabf5700 1 -- 172.21.15.81:0/1412928637 wait complete. 2023-10-07T08:43:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.192+0000 7fdafabf5700 1 Processor -- start 2023-10-07T08:43:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.192+0000 7fdafabf5700 1 -- start start 2023-10-07T08:43:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdafabf5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdae0004810 0x7fdaf41517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdafabf5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdaf415a140 0x7fdaf40c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdafabf5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdaf415a5b0 0x7fdaf40c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdafabf5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf41590a0 con 0x7fdae0004810 2023-10-07T08:43:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdafabf5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf4159380 con 0x7fdaf415a140 2023-10-07T08:43:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdafabf5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf4159660 con 0x7fdaf415a5b0 2023-10-07T08:43:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdaf8991700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdae0004810 0x7fdaf41517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdaf8991700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdae0004810 0x7fdaf41517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34158/0 (socket says 172.21.15.81:34158) 2023-10-07T08:43:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdaf8991700 1 -- 172.21.15.81:0/3575333326 learned_addr learned my addr 172.21.15.81:0/3575333326 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdaf3fff700 1 --2- 172.21.15.81:0/3575333326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdaf415a140 0x7fdaf40c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdaf9192700 1 --2- 172.21.15.81:0/3575333326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdaf415a5b0 0x7fdaf40c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdaf8991700 1 -- 172.21.15.81:0/3575333326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdaf415a5b0 msgr2=0x7fdaf40c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdaf8991700 1 --2- 172.21.15.81:0/3575333326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdaf415a5b0 0x7fdaf40c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdaf8991700 1 -- 172.21.15.81:0/3575333326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdaf415a140 msgr2=0x7fdaf40c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdaf8991700 1 --2- 172.21.15.81:0/3575333326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdaf415a140 0x7fdaf40c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdaf8991700 1 -- 172.21.15.81:0/3575333326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf4159940 con 0x7fdae0004810 2023-10-07T08:43:50.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdaf9192700 1 --2- 172.21.15.81:0/3575333326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdaf415a5b0 0x7fdaf40c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:50.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdaf8991700 1 --2- 172.21.15.81:0/3575333326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdae0004810 0x7fdaf41517d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdaec0010e0 tx=0x7fdaec001430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:50.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdaf0ff9700 1 -- 172.21.15.81:0/3575333326 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00c750 con 0x7fdae0004810 2023-10-07T08:43:50.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.193+0000 7fdaf0ff9700 1 -- 172.21.15.81:0/3575333326 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec00c8b0 con 0x7fdae0004810 2023-10-07T08:43:50.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.194+0000 7fdafabf5700 1 -- 172.21.15.81:0/3575333326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf4159c20 con 0x7fdae0004810 2023-10-07T08:43:50.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.194+0000 7fdaf0ff9700 1 -- 172.21.15.81:0/3575333326 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00cc50 con 0x7fdae0004810 2023-10-07T08:43:50.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.194+0000 7fdafabf5700 1 -- 172.21.15.81:0/3575333326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf41683a0 con 0x7fdae0004810 2023-10-07T08:43:50.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.194+0000 7fdafabf5700 1 -- 172.21.15.81:0/3575333326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf4158ad0 con 0x7fdae0004810 2023-10-07T08:43:50.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.195+0000 7fdaf0ff9700 1 -- 172.21.15.81:0/3575333326 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdaec01d460 con 0x7fdae0004810 2023-10-07T08:43:50.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.195+0000 7fdaf0ff9700 1 --2- 172.21.15.81:0/3575333326 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdad4066f30 0x7fdad40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:50.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.195+0000 7fdaf0ff9700 1 -- 172.21.15.81:0/3575333326 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdaec0845a0 con 0x7fdae0004810 2023-10-07T08:43:50.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.195+0000 7fdaf3fff700 1 --2- 172.21.15.81:0/3575333326 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdad4066f30 0x7fdad40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:50.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.196+0000 7fdaf3fff700 1 --2- 172.21.15.81:0/3575333326 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdad4066f30 0x7fdad40693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40c5240 tx=0x7fdae4015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:50.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.200+0000 7fdaf0ff9700 1 -- 172.21.15.81:0/3575333326 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdaec051810 con 0x7fdae0004810 2023-10-07T08:43:50.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.426+0000 7fdafabf5700 1 -- 172.21.15.81:0/3575333326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdaf40cc6b0 con 0x7fdae0004810 2023-10-07T08:43:50.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.427+0000 7fdaf0ff9700 1 -- 172.21.15.81:0/3575333326 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdaec054e30 con 0x7fdae0004810 2023-10-07T08:43:50.428 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:43:50.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.429+0000 7fdafabf5700 1 -- 172.21.15.81:0/3575333326 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdad4066f30 msgr2=0x7fdad40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.429+0000 7fdafabf5700 1 --2- 172.21.15.81:0/3575333326 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdad4066f30 0x7fdad40693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40c5240 tx=0x7fdae4015000 comp rx=0 tx=0).stop 2023-10-07T08:43:50.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.429+0000 7fdafabf5700 1 -- 172.21.15.81:0/3575333326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdae0004810 msgr2=0x7fdaf41517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:50.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.429+0000 7fdafabf5700 1 --2- 172.21.15.81:0/3575333326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdae0004810 0x7fdaf41517d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdaec0010e0 tx=0x7fdaec001430 comp rx=0 tx=0).stop 2023-10-07T08:43:50.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.429+0000 7fdafabf5700 1 -- 172.21.15.81:0/3575333326 shutdown_connections 2023-10-07T08:43:50.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.429+0000 7fdafabf5700 1 --2- 172.21.15.81:0/3575333326 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdad4066f30 0x7fdad40693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.429+0000 7fdafabf5700 1 --2- 172.21.15.81:0/3575333326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdaf415a5b0 0x7fdaf40c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.429+0000 7fdafabf5700 1 --2- 172.21.15.81:0/3575333326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdae0004810 0x7fdaf41517d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.429+0000 7fdafabf5700 1 --2- 172.21.15.81:0/3575333326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdaf415a140 0x7fdaf40c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:50.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.429+0000 7fdafabf5700 1 -- 172.21.15.81:0/3575333326 >> 172.21.15.81:0/3575333326 conn(0x7fdaf4067640 msgr2=0x7fdaf4153650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:50.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.429+0000 7fdafabf5700 1 -- 172.21.15.81:0/3575333326 shutdown_connections 2023-10-07T08:43:50.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:50.429+0000 7fdafabf5700 1 -- 172.21.15.81:0/3575333326 wait complete. 2023-10-07T08:43:50.442 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:43:50.442 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:43:50.442 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-07T08:43:50.443 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T08:43:50.443 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T08:43:50.443 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:43:50.443 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:43:50.443 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:43:50.443 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:43:50.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:50.443 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-07T08:43:50.458 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:43:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:43:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:43:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-07T08:43:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:50.459 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-07T08:43:50.459 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-07T08:43:50.459 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:50.460 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:43:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:43:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42498sec preferred_lft 42498sec 2023-10-07T08:43:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-10-07T08:43:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:50.460 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:43:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:43:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::8c72:9ff:fe74:8c7e/64 scope link 2023-10-07T08:43:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:50.461 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:43:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:fe:81:9d:9c:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T08:43:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8fe:81ff:fe9d:9c0a/64 scope link 2023-10-07T08:43:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:50.461 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:43:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T08:43:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d838:b7ff:fe6e:914d/64 scope link 2023-10-07T08:43:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:50.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:50.462 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:43:50.522 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-07T08:43:50.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:50.524 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-07T08:43:50.580 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-07T08:43:50.580 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:43:50.580 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:43:50.580 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:43:50.580 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:43:50.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:50.581 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:43:50.581 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:43:50.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:43:50.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:43:50.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:43:50.581 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:43:50.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:50.680 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-07T08:43:50.694 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T08:43:50.694 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T08:43:50.694 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:43:50.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:50.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-07T08:43:50.758 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:43:50.759 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T08:43:50.814 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:43:50.814 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:43:50.814 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:43:50.869 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:43:50.869 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:43:50.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:43:50.949 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:43:50.949 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:43:50.950 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:43:50.958 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:43:50.959 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:43:50.960 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:43:50.960 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:43:50.960 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:43:50.981 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:43:50.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:50.982 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:43:51.047 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:43:51.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.199+0000 7f461afea700 1 Processor -- start 2023-10-07T08:43:51.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.199+0000 7f461afea700 1 -- start start 2023-10-07T08:43:51.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.200+0000 7f461afea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4614157ca0 0x7f46140cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:51.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.200+0000 7f461afea700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f461406d120 0x7f461406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:51.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.200+0000 7f461afea700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461406dac0 con 0x7f46141578d0 2023-10-07T08:43:51.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.200+0000 7f461afea700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46140d07c0 con 0x7f461406d120 2023-10-07T08:43:51.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.200+0000 7f461afea700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46140cfbb0 con 0x7f4614157ca0 2023-10-07T08:43:51.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.200+0000 7f4618d86700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f46141578d0 0x7f461415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50214/0 (socket says 172.21.15.81:50214) 2023-10-07T08:43:51.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.200+0000 7f4618d86700 1 -- 172.21.15.81:0/1450622471 learned_addr learned my addr 172.21.15.81:0/1450622471 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:51.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.200+0000 7f4619587700 1 --2- 172.21.15.81:0/1450622471 >> v2:172.21.15.81:3300/0 conn(0x7f461406d120 0x7f461406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:51.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f46137fe700 1 -- 172.21.15.81:0/1450622471 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596198719 0 0) 0x7f4604001490 con 0x7f46141578d0 2023-10-07T08:43:51.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f46137fe700 1 -- 172.21.15.81:0/1450622471 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45fc003570 con 0x7f46141578d0 2023-10-07T08:43:51.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f4613fff700 1 --2- 172.21.15.81:0/1450622471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4614157ca0 0x7f46140cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:51.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f4619587700 1 -- 172.21.15.81:0/1450622471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4614157ca0 msgr2=0x7f46140cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:51.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f4619587700 1 --2- 172.21.15.81:0/1450622471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4614157ca0 0x7f46140cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:51.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f4619587700 1 -- 172.21.15.81:0/1450622471 >> v1:172.21.15.81:6789/0 conn(0x7f46141578d0 legacy=0x7f461415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:51.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f4619587700 1 -- 172.21.15.81:0/1450622471 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46140cfe90 con 0x7f461406d120 2023-10-07T08:43:51.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f4613fff700 1 --2- 172.21.15.81:0/1450622471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4614157ca0 0x7f46140cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:51.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f4619587700 1 --2- 172.21.15.81:0/1450622471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f461406d120 0x7f461406d580 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f460c0098e0 tx=0x7f460c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4276dbf80a55da server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:51.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f46137fe700 1 -- 172.21.15.81:0/1450622471 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c00b640 con 0x7f461406d120 2023-10-07T08:43:51.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f46137fe700 1 -- 172.21.15.81:0/1450622471 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c00b7a0 con 0x7f461406d120 2023-10-07T08:43:51.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f46137fe700 1 -- 172.21.15.81:0/1450622471 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c00bb40 con 0x7f461406d120 2023-10-07T08:43:51.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f461afea700 1 -- 172.21.15.81:0/1450622471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f461406d120 msgr2=0x7f461406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:51.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f461afea700 1 --2- 172.21.15.81:0/1450622471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f461406d120 0x7f461406d580 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f460c0098e0 tx=0x7f460c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:51.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f461afea700 1 -- 172.21.15.81:0/1450622471 shutdown_connections 2023-10-07T08:43:51.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f461afea700 1 --2- 172.21.15.81:0/1450622471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f461406d120 0x7f461406d580 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:51.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f461afea700 1 --2- 172.21.15.81:0/1450622471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4614157ca0 0x7f46140cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:51.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f461afea700 1 -- 172.21.15.81:0/1450622471 >> 172.21.15.81:0/1450622471 conn(0x7f461406bb90 msgr2=0x7f461406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:51.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.201+0000 7f461afea700 1 -- 172.21.15.81:0/1450622471 shutdown_connections 2023-10-07T08:43:51.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.202+0000 7f461afea700 1 -- 172.21.15.81:0/1450622471 wait complete. 2023-10-07T08:43:51.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.203+0000 7f461afea700 1 Processor -- start 2023-10-07T08:43:51.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.203+0000 7f461afea700 1 -- start start 2023-10-07T08:43:51.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.203+0000 7f461afea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f461406d120 0x7f46140b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:51.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.203+0000 7f461afea700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46141578d0 0x7f46140ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:51.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.203+0000 7f461afea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614157ca0 0x7f461416cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:51.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.203+0000 7f461afea700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46140b4aa0 con 0x7f4614157ca0 2023-10-07T08:43:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.203+0000 7f461afea700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46140b58f0 con 0x7f46141578d0 2023-10-07T08:43:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.203+0000 7f461afea700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46140ab9a0 con 0x7f461406d120 2023-10-07T08:43:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.203+0000 7f4619587700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614157ca0 0x7f461416cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f4619587700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614157ca0 0x7f461416cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34182/0 (socket says 172.21.15.81:34182) 2023-10-07T08:43:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f4619587700 1 -- 172.21.15.81:0/2682701882 learned_addr learned my addr 172.21.15.81:0/2682701882 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f4618d86700 1 --2- 172.21.15.81:0/2682701882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f461406d120 0x7f46140b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f4613fff700 1 --2- 172.21.15.81:0/2682701882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46141578d0 0x7f46140ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f4619587700 1 -- 172.21.15.81:0/2682701882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f461406d120 msgr2=0x7f46140b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f4619587700 1 --2- 172.21.15.81:0/2682701882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f461406d120 0x7f46140b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f4619587700 1 -- 172.21.15.81:0/2682701882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46141578d0 msgr2=0x7f46140ab460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f4619587700 1 --2- 172.21.15.81:0/2682701882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46141578d0 0x7f46140ab460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f4619587700 1 -- 172.21.15.81:0/2682701882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c009420 con 0x7f4614157ca0 2023-10-07T08:43:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f4618d86700 1 --2- 172.21.15.81:0/2682701882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f461406d120 0x7f46140b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f4613fff700 1 --2- 172.21.15.81:0/2682701882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46141578d0 0x7f46140ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f4619587700 1 --2- 172.21.15.81:0/2682701882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614157ca0 0x7f461416cb00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f461406fe20 tx=0x7f460c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f4610ff9700 1 -- 172.21.15.81:0/2682701882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c01be40 con 0x7f4614157ca0 2023-10-07T08:43:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f4610ff9700 1 -- 172.21.15.81:0/2682701882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c011630 con 0x7f4614157ca0 2023-10-07T08:43:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f461afea700 1 -- 172.21.15.81:0/2682701882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46140b4ce0 con 0x7f4614157ca0 2023-10-07T08:43:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f4610ff9700 1 -- 172.21.15.81:0/2682701882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c0119f0 con 0x7f4614157ca0 2023-10-07T08:43:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.204+0000 7f461afea700 1 -- 172.21.15.81:0/2682701882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46140b52a0 con 0x7f4614157ca0 2023-10-07T08:43:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.205+0000 7f461afea700 1 -- 172.21.15.81:0/2682701882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4614067ac0 con 0x7f4614157ca0 2023-10-07T08:43:51.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.205+0000 7f4610ff9700 1 -- 172.21.15.81:0/2682701882 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f460c02e440 con 0x7f4614157ca0 2023-10-07T08:43:51.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.206+0000 7f4610ff9700 1 --2- 172.21.15.81:0/2682701882 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4600066f30 0x7f46000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:51.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.206+0000 7f4610ff9700 1 -- 172.21.15.81:0/2682701882 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f460c086170 con 0x7f4614157ca0 2023-10-07T08:43:51.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.206+0000 7f4618d86700 1 --2- 172.21.15.81:0/2682701882 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4600066f30 0x7f46000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:51.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.206+0000 7f4618d86700 1 --2- 172.21.15.81:0/2682701882 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4600066f30 0x7f46000693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f46040015f0 tx=0x7f4604009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:51.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.210+0000 7f4610ff9700 1 -- 172.21.15.81:0/2682701882 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f460c0533e0 con 0x7f4614157ca0 2023-10-07T08:43:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.439+0000 7f461afea700 1 -- 172.21.15.81:0/2682701882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f461404bb80 con 0x7f4614157ca0 2023-10-07T08:43:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.439+0000 7f4610ff9700 1 -- 172.21.15.81:0/2682701882 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f460c056a00 con 0x7f4614157ca0 2023-10-07T08:43:51.440 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:43:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.441+0000 7f461afea700 1 -- 172.21.15.81:0/2682701882 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4600066f30 msgr2=0x7f46000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.441+0000 7f461afea700 1 --2- 172.21.15.81:0/2682701882 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4600066f30 0x7f46000693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f46040015f0 tx=0x7f4604009040 comp rx=0 tx=0).stop 2023-10-07T08:43:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.441+0000 7f461afea700 1 -- 172.21.15.81:0/2682701882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614157ca0 msgr2=0x7f461416cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.441+0000 7f461afea700 1 --2- 172.21.15.81:0/2682701882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614157ca0 0x7f461416cb00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f461406fe20 tx=0x7f460c017000 comp rx=0 tx=0).stop 2023-10-07T08:43:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.441+0000 7f461afea700 1 -- 172.21.15.81:0/2682701882 shutdown_connections 2023-10-07T08:43:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.441+0000 7f461afea700 1 --2- 172.21.15.81:0/2682701882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614157ca0 0x7f461416cb00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.441+0000 7f461afea700 1 --2- 172.21.15.81:0/2682701882 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4600066f30 0x7f46000693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.441+0000 7f461afea700 1 --2- 172.21.15.81:0/2682701882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f461406d120 0x7f46140b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.441+0000 7f461afea700 1 --2- 172.21.15.81:0/2682701882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46141578d0 0x7f46140ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.441+0000 7f461afea700 1 -- 172.21.15.81:0/2682701882 >> 172.21.15.81:0/2682701882 conn(0x7f461406bb90 msgr2=0x7f4614069ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.441+0000 7f461afea700 1 -- 172.21.15.81:0/2682701882 shutdown_connections 2023-10-07T08:43:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:51.441+0000 7f461afea700 1 -- 172.21.15.81:0/2682701882 wait complete. 2023-10-07T08:43:51.454 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:43:51.454 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:43:51.454 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-07T08:43:51.454 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T08:43:51.454 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T08:43:51.455 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:43:51.455 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:43:51.455 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:43:51.455 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:43:51.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:51.455 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-07T08:43:51.473 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:43:51.473 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:43:51.473 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:43:51.474 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:51.474 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-07T08:43:51.474 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:51.475 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:51.475 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:51.475 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-10-07T08:43:51.475 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:51.475 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:51.475 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-10-07T08:43:51.475 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:43:51.475 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:51.475 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:43:51.475 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:51.475 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:43:51.475 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42497sec preferred_lft 42497sec 2023-10-07T08:43:51.476 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2023-10-07T08:43:51.476 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:51.476 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:43:51.476 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:43:51.476 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:43:51.476 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:51.476 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::74d7:a9ff:fe87:ed9/64 scope link 2023-10-07T08:43:51.476 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:51.476 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:43:51.476 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T08:43:51.476 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6c40:c5ff:fe3a:a57/64 scope link 2023-10-07T08:43:51.476 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:51.477 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:43:51.477 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether de:db:cd:68:b1:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T08:43:51.477 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::dcdb:cdff:fe68:b178/64 scope link 2023-10-07T08:43:51.477 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:43:51.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:51.477 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:43:51.540 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-07T08:43:51.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:51.542 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-07T08:43:51.599 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-07T08:43:51.600 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:43:51.600 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:43:51.600 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:43:51.600 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:43:51.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:51.600 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:43:51.600 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:43:51.600 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:43:51.600 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:43:51.601 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:43:51.601 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:43:51.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:51.703 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-07T08:43:51.717 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T08:43:51.717 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T08:43:51.718 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:43:51.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:51.718 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-07T08:43:51.781 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:43:51.782 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T08:43:51.836 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:43:51.836 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:43:51.837 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:43:51.890 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:43:51.890 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:43:51.891 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:43:51.969 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:43:51.969 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:43:51.969 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:43:51.977 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:43:51.978 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:43:51.978 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:43:51.978 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:43:51.978 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:43:51.998 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:43:51.998 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:43:51.998 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:43:51.998 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:43:51.999 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:43:51.999 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:43:51.999 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:43:51.999 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:43:52.000 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:43:52.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:52.001 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:43:52.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:43:52.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.178+0000 7fb02978f700 1 Processor -- start 2023-10-07T08:43:52.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.178+0000 7fb02978f700 1 -- start start 2023-10-07T08:43:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.179+0000 7fb02978f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb024157ca0 0x7fb0240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.179+0000 7fb02978f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb02406d120 0x7fb02406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.179+0000 7fb02978f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0240d07c0 con 0x7fb0241578d0 2023-10-07T08:43:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.179+0000 7fb02978f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02406daa0 con 0x7fb024157ca0 2023-10-07T08:43:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.179+0000 7fb02978f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240cfbb0 con 0x7fb02406d120 2023-10-07T08:43:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.179+0000 7fb022ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb0241578d0 0x7fb02415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50224/0 (socket says 172.21.15.81:50224) 2023-10-07T08:43:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.179+0000 7fb022ffd700 1 -- 172.21.15.81:0/3118683069 learned_addr learned my addr 172.21.15.81:0/3118683069 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.179+0000 7fb0237fe700 1 --2- 172.21.15.81:0/3118683069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb02406d120 0x7fb02406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.179+0000 7fb0227fc700 1 --2- 172.21.15.81:0/3118683069 >> v2:172.21.15.89:3300/0 conn(0x7fb024157ca0 0x7fb0240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.180+0000 7fb021ffb700 1 -- 172.21.15.81:0/3118683069 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116857100 0 0) 0x7fb0240d07c0 con 0x7fb0241578d0 2023-10-07T08:43:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.180+0000 7fb021ffb700 1 -- 172.21.15.81:0/3118683069 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb00c003570 con 0x7fb0241578d0 2023-10-07T08:43:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.180+0000 7fb0237fe700 1 -- 172.21.15.81:0/3118683069 >> v2:172.21.15.89:3300/0 conn(0x7fb024157ca0 msgr2=0x7fb0240cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.180+0000 7fb0237fe700 1 --2- 172.21.15.81:0/3118683069 >> v2:172.21.15.89:3300/0 conn(0x7fb024157ca0 0x7fb0240cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.180+0000 7fb0237fe700 1 -- 172.21.15.81:0/3118683069 >> v1:172.21.15.81:6789/0 conn(0x7fb0241578d0 legacy=0x7fb02415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.180+0000 7fb0237fe700 1 -- 172.21.15.81:0/3118683069 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0240cfe90 con 0x7fb02406d120 2023-10-07T08:43:52.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.180+0000 7fb0237fe700 1 --2- 172.21.15.81:0/3118683069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb02406d120 0x7fb02406d560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0098e0 tx=0x7fb01c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d397fcd470533c75 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:52.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.180+0000 7fb021ffb700 1 -- 172.21.15.81:0/3118683069 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c011630 con 0x7fb02406d120 2023-10-07T08:43:52.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.180+0000 7fb021ffb700 1 -- 172.21.15.81:0/3118683069 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c011790 con 0x7fb02406d120 2023-10-07T08:43:52.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.180+0000 7fb021ffb700 1 -- 172.21.15.81:0/3118683069 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c011b30 con 0x7fb02406d120 2023-10-07T08:43:52.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.181+0000 7fb02978f700 1 -- 172.21.15.81:0/3118683069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb02406d120 msgr2=0x7fb02406d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:52.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.181+0000 7fb02978f700 1 --2- 172.21.15.81:0/3118683069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb02406d120 0x7fb02406d560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0098e0 tx=0x7fb01c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.181+0000 7fb02978f700 1 -- 172.21.15.81:0/3118683069 shutdown_connections 2023-10-07T08:43:52.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.181+0000 7fb02978f700 1 --2- 172.21.15.81:0/3118683069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb02406d120 0x7fb02406d560 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.181+0000 7fb02978f700 1 --2- 172.21.15.81:0/3118683069 >> v2:172.21.15.89:3300/0 conn(0x7fb024157ca0 0x7fb0240cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.181+0000 7fb02978f700 1 -- 172.21.15.81:0/3118683069 >> 172.21.15.81:0/3118683069 conn(0x7fb02406bb90 msgr2=0x7fb02406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.181+0000 7fb02978f700 1 -- 172.21.15.81:0/3118683069 shutdown_connections 2023-10-07T08:43:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.181+0000 7fb02978f700 1 -- 172.21.15.81:0/3118683069 wait complete. 2023-10-07T08:43:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.182+0000 7fb02978f700 1 Processor -- start 2023-10-07T08:43:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.182+0000 7fb02978f700 1 -- start start 2023-10-07T08:43:52.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb02978f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb02406d120 0x7fb0240aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:52.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb02978f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0241578d0 0x7fb024169f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:52.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb02978f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb024157ca0 0x7fb024154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:52.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb02978f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02415f180 con 0x7fb0241578d0 2023-10-07T08:43:52.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb02978f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240689b0 con 0x7fb02406d120 2023-10-07T08:43:52.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb02978f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240ab810 con 0x7fb024157ca0 2023-10-07T08:43:52.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb0227fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0241578d0 0x7fb024169f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:52.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb0227fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0241578d0 0x7fb024169f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34192/0 (socket says 172.21.15.81:34192) 2023-10-07T08:43:52.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb0227fc700 1 -- 172.21.15.81:0/2429013318 learned_addr learned my addr 172.21.15.81:0/2429013318 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:52.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb0237fe700 1 --2- 172.21.15.81:0/2429013318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb024157ca0 0x7fb024154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:52.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb022ffd700 1 --2- 172.21.15.81:0/2429013318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb02406d120 0x7fb0240aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:52.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb0227fc700 1 -- 172.21.15.81:0/2429013318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb024157ca0 msgr2=0x7fb024154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:52.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb0227fc700 1 --2- 172.21.15.81:0/2429013318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb024157ca0 0x7fb024154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb0227fc700 1 -- 172.21.15.81:0/2429013318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb02406d120 msgr2=0x7fb0240aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:52.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb0227fc700 1 --2- 172.21.15.81:0/2429013318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb02406d120 0x7fb0240aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb0227fc700 1 -- 172.21.15.81:0/2429013318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c009420 con 0x7fb0241578d0 2023-10-07T08:43:52.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb0237fe700 1 --2- 172.21.15.81:0/2429013318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb024157ca0 0x7fb024154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:52.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb0227fc700 1 --2- 172.21.15.81:0/2429013318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0241578d0 0x7fb024169f80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb01800e900 tx=0x7fb0180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:52.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb00affd700 1 -- 172.21.15.81:0/2429013318 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01800eea0 con 0x7fb0241578d0 2023-10-07T08:43:52.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb00affd700 1 -- 172.21.15.81:0/2429013318 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01800c850 con 0x7fb0241578d0 2023-10-07T08:43:52.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb02978f700 1 -- 172.21.15.81:0/2429013318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0240aaf70 con 0x7fb0241578d0 2023-10-07T08:43:52.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb00affd700 1 -- 172.21.15.81:0/2429013318 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01800cc10 con 0x7fb0241578d0 2023-10-07T08:43:52.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.183+0000 7fb02978f700 1 -- 172.21.15.81:0/2429013318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0240ab530 con 0x7fb0241578d0 2023-10-07T08:43:52.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.184+0000 7fb02978f700 1 -- 172.21.15.81:0/2429013318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb024067ac0 con 0x7fb0241578d0 2023-10-07T08:43:52.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.185+0000 7fb00affd700 1 -- 172.21.15.81:0/2429013318 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb018013470 con 0x7fb0241578d0 2023-10-07T08:43:52.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.185+0000 7fb00affd700 1 --2- 172.21.15.81:0/2429013318 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb010066f30 0x7fb0100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:52.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.185+0000 7fb00affd700 1 -- 172.21.15.81:0/2429013318 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb0180846a0 con 0x7fb0241578d0 2023-10-07T08:43:52.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.185+0000 7fb022ffd700 1 --2- 172.21.15.81:0/2429013318 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb010066f30 0x7fb0100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:52.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.185+0000 7fb022ffd700 1 --2- 172.21.15.81:0/2429013318 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb010066f30 0x7fb0100693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb014005c50 tx=0x7fb014009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:52.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.189+0000 7fb00affd700 1 -- 172.21.15.81:0/2429013318 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb018051910 con 0x7fb0241578d0 2023-10-07T08:43:52.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.417+0000 7fb02978f700 1 -- 172.21.15.81:0/2429013318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0240d0170 con 0x7fb0241578d0 2023-10-07T08:43:52.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.418+0000 7fb00affd700 1 -- 172.21.15.81:0/2429013318 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fb018054f30 con 0x7fb0241578d0 2023-10-07T08:43:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:52.419 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1843075449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1843075449},{"type":"v1","addr":"172.21.15.81:6837","nonce":1843075449}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3013270804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3013270804},{"type":"v1","addr":"172.21.15.89:6835","nonce":3013270804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3825515993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3825515993},{"type":"v1","addr":"172.21.15.81:6836","nonce":3825515993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:43:43.620900+0000","modified":"2023-10-07T08:43:47.291987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6834/4005291324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":4005291324},{"type":"v1","addr":"172.21.15.89:6834","nonce":4005291324}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-07T08:43:52.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.419+0000 7fb02978f700 1 -- 172.21.15.81:0/2429013318 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb010066f30 msgr2=0x7fb0100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:52.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.419+0000 7fb02978f700 1 --2- 172.21.15.81:0/2429013318 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb010066f30 0x7fb0100693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb014005c50 tx=0x7fb014009040 comp rx=0 tx=0).stop 2023-10-07T08:43:52.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.419+0000 7fb02978f700 1 -- 172.21.15.81:0/2429013318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0241578d0 msgr2=0x7fb024169f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:52.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.419+0000 7fb02978f700 1 --2- 172.21.15.81:0/2429013318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0241578d0 0x7fb024169f80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb01800e900 tx=0x7fb0180091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.420+0000 7fb02978f700 1 -- 172.21.15.81:0/2429013318 shutdown_connections 2023-10-07T08:43:52.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.420+0000 7fb02978f700 1 --2- 172.21.15.81:0/2429013318 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb010066f30 0x7fb0100693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.420+0000 7fb02978f700 1 --2- 172.21.15.81:0/2429013318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb024157ca0 0x7fb024154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.420+0000 7fb02978f700 1 --2- 172.21.15.81:0/2429013318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb02406d120 0x7fb0240aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.420+0000 7fb02978f700 1 --2- 172.21.15.81:0/2429013318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0241578d0 0x7fb024169f80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.420+0000 7fb02978f700 1 -- 172.21.15.81:0/2429013318 >> 172.21.15.81:0/2429013318 conn(0x7fb02406bb90 msgr2=0x7fb02415f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:52.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.420+0000 7fb02978f700 1 -- 172.21.15.81:0/2429013318 shutdown_connections 2023-10-07T08:43:52.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.420+0000 7fb02978f700 1 -- 172.21.15.81:0/2429013318 wait complete. 2023-10-07T08:43:52.423 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 15 2023-10-07T08:43:52.433 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-07T08:43:52.566 INFO:teuthology.orchestra.run.smithi089.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":4938,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.2876138079999997,"mdsmap_epoch":15,"osdmap_epoch":33,"osdmap_epoch_barrier":33,"uptime":16.322191311000001} 2023-10-07T08:43:52.566 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 4938, "mdsmap_epoch": 15, "osdmap_epoch": 33, "osdmap_epoch_barrier": 33, "rank_uptime": 8.287613808, "state": "up:active", "uptime": 16.322191311, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:43:52.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-10-07T08:43:52.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.678+0000 7f40a9304700 1 Processor -- start 2023-10-07T08:43:52.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.678+0000 7f40a9304700 1 -- start start 2023-10-07T08:43:52.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.679+0000 7f40a9304700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f40a41434d0 0x7f40a4068a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:52.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.679+0000 7f40a9304700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f40a41438a0 0x7f40a4068f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:52.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.679+0000 7f40a9304700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a40cb2e0 con 0x7f40a406d0c0 2023-10-07T08:43:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.679+0000 7f40a9304700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a40cb5c0 con 0x7f40a41434d0 2023-10-07T08:43:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.679+0000 7f40a9304700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a40cb8a0 con 0x7f40a41438a0 2023-10-07T08:43:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.679+0000 7f40a3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f40a41434d0 0x7f40a4068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.679+0000 7f40a8b03700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f40a406d0c0 0x7f40a40cf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59398/0 (socket says 172.21.15.81:59398) 2023-10-07T08:43:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.679+0000 7f40a3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f40a41434d0 0x7f40a4068a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36346/0 (socket says 172.21.15.81:36346) 2023-10-07T08:43:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.679+0000 7f40a8b03700 1 -- 172.21.15.81:0/2841825124 learned_addr learned my addr 172.21.15.81:0/2841825124 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.679+0000 7f40a37fe700 1 --2- 172.21.15.81:0/2841825124 >> v2:172.21.15.89:3300/0 conn(0x7f40a41438a0 0x7f40a4068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.679+0000 7f40a3fff700 1 -- 172.21.15.81:0/2841825124 >> v2:172.21.15.89:3300/0 conn(0x7f40a41438a0 msgr2=0x7f40a4068f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.679+0000 7f40a3fff700 1 --2- 172.21.15.81:0/2841825124 >> v2:172.21.15.89:3300/0 conn(0x7f40a41438a0 0x7f40a4068f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.679+0000 7f40a3fff700 1 -- 172.21.15.81:0/2841825124 >> v1:172.21.15.81:6789/0 conn(0x7f40a406d0c0 legacy=0x7f40a40cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.679+0000 7f40a3fff700 1 -- 172.21.15.81:0/2841825124 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a40cbb80 con 0x7f40a41434d0 2023-10-07T08:43:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.679+0000 7f40a2ffd700 1 -- 172.21.15.81:0/2841825124 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994677373 0 0) 0x7f40a40cb2e0 con 0x7f40a406d0c0 2023-10-07T08:43:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.679+0000 7f40a37fe700 1 --2- 172.21.15.81:0/2841825124 >> v2:172.21.15.89:3300/0 conn(0x7f40a41438a0 0x7f40a4068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.680+0000 7f40a3fff700 1 --2- 172.21.15.81:0/2841825124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a41434d0 0x7f40a4068a00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f40a40d0b20 tx=0x7f40940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6039161d09d05f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.680+0000 7f40a2ffd700 1 -- 172.21.15.81:0/2841825124 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409400b6b0 con 0x7f40a41434d0 2023-10-07T08:43:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.680+0000 7f40a2ffd700 1 -- 172.21.15.81:0/2841825124 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409400b810 con 0x7f40a41434d0 2023-10-07T08:43:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.680+0000 7f40a2ffd700 1 -- 172.21.15.81:0/2841825124 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409400bbb0 con 0x7f40a41434d0 2023-10-07T08:43:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.680+0000 7f40a9304700 1 -- 172.21.15.81:0/2841825124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a41434d0 msgr2=0x7f40a4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.680+0000 7f40a9304700 1 --2- 172.21.15.81:0/2841825124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a41434d0 0x7f40a4068a00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f40a40d0b20 tx=0x7f40940091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.680+0000 7f40a9304700 1 -- 172.21.15.81:0/2841825124 shutdown_connections 2023-10-07T08:43:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.680+0000 7f40a9304700 1 --2- 172.21.15.81:0/2841825124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a41434d0 0x7f40a4068a00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.680+0000 7f40a9304700 1 --2- 172.21.15.81:0/2841825124 >> v2:172.21.15.89:3300/0 conn(0x7f40a41438a0 0x7f40a4068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.680+0000 7f40a9304700 1 -- 172.21.15.81:0/2841825124 >> 172.21.15.81:0/2841825124 conn(0x7f40a40cd610 msgr2=0x7f40a40cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:52.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.680+0000 7f40a9304700 1 -- 172.21.15.81:0/2841825124 shutdown_connections 2023-10-07T08:43:52.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.680+0000 7f40a9304700 1 -- 172.21.15.81:0/2841825124 wait complete. 2023-10-07T08:43:52.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.681+0000 7f40a9304700 1 Processor -- start 2023-10-07T08:43:52.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.682+0000 7f40a9304700 1 -- start start 2023-10-07T08:43:52.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.682+0000 7f40a9304700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40a406d0c0 0x7f40a40c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:52.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.682+0000 7f40a9304700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a41434d0 0x7f40a415c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:52.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.682+0000 7f40a9304700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40a41438a0 0x7f40a40cf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:52.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.682+0000 7f40a9304700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a40b15b0 con 0x7f40a41434d0 2023-10-07T08:43:52.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.682+0000 7f40a9304700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a40cf570 con 0x7f40a406d0c0 2023-10-07T08:43:52.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.682+0000 7f40a9304700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a415ce30 con 0x7f40a41438a0 2023-10-07T08:43:52.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.682+0000 7f40a37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a41434d0 0x7f40a415c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:52.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.682+0000 7f40a37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a41434d0 0x7f40a415c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36356/0 (socket says 172.21.15.81:36356) 2023-10-07T08:43:52.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.682+0000 7f40a37fe700 1 -- 172.21.15.81:0/4098103868 learned_addr learned my addr 172.21.15.81:0/4098103868 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:52.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.682+0000 7f40a3fff700 1 --2- 172.21.15.81:0/4098103868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40a406d0c0 0x7f40a40c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:52.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.683+0000 7f40a8b03700 1 --2- 172.21.15.81:0/4098103868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40a41438a0 0x7f40a40cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:52.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.683+0000 7f40a37fe700 1 -- 172.21.15.81:0/4098103868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40a41438a0 msgr2=0x7f40a40cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:52.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.683+0000 7f40a37fe700 1 --2- 172.21.15.81:0/4098103868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40a41438a0 0x7f40a40cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.683+0000 7f40a37fe700 1 -- 172.21.15.81:0/4098103868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40a406d0c0 msgr2=0x7f40a40c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:52.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.683+0000 7f40a37fe700 1 --2- 172.21.15.81:0/4098103868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40a406d0c0 0x7f40a40c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.683+0000 7f40a37fe700 1 -- 172.21.15.81:0/4098103868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4094009420 con 0x7f40a41434d0 2023-10-07T08:43:52.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.683+0000 7f40a37fe700 1 --2- 172.21.15.81:0/4098103868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a41434d0 0x7f40a415c800 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f409800c850 tx=0x7f4098008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:52.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.683+0000 7f408bfff700 1 -- 172.21.15.81:0/4098103868 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098011600 con 0x7f40a41434d0 2023-10-07T08:43:52.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.683+0000 7f408bfff700 1 -- 172.21.15.81:0/4098103868 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4098011760 con 0x7f40a41434d0 2023-10-07T08:43:52.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.683+0000 7f40a9304700 1 -- 172.21.15.81:0/4098103868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a415d110 con 0x7f40a41434d0 2023-10-07T08:43:52.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.683+0000 7f408bfff700 1 -- 172.21.15.81:0/4098103868 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098011b00 con 0x7f40a41434d0 2023-10-07T08:43:52.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.683+0000 7f40a9304700 1 -- 172.21.15.81:0/4098103868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a40b1240 con 0x7f40a41434d0 2023-10-07T08:43:52.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.684+0000 7f40a9304700 1 -- 172.21.15.81:0/4098103868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a40b1760 con 0x7f40a41434d0 2023-10-07T08:43:52.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.684+0000 7f408bfff700 1 -- 172.21.15.81:0/4098103868 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4098018350 con 0x7f40a41434d0 2023-10-07T08:43:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.685+0000 7f408bfff700 1 --2- 172.21.15.81:0/4098103868 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4090066f30 0x7f40900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.685+0000 7f408bfff700 1 -- 172.21.15.81:0/4098103868 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40980843d0 con 0x7f40a41434d0 2023-10-07T08:43:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.685+0000 7f40a3fff700 1 --2- 172.21.15.81:0/4098103868 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4090066f30 0x7f40900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.685+0000 7f40a3fff700 1 --2- 172.21.15.81:0/4098103868 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4090066f30 0x7f40900693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f40940093f0 tx=0x7f4094017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.689+0000 7f408bfff700 1 -- 172.21.15.81:0/4098103868 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40a40b1760 con 0x7f40a41434d0 2023-10-07T08:43:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.942+0000 7f40a9304700 1 -- 172.21.15.81:0/4098103868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f40a40b16f0 con 0x7f40a41434d0 2023-10-07T08:43:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.943+0000 7f408bfff700 1 -- 172.21.15.81:0/4098103868 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1619 (secure 0 0 0) 0x7f40980550d0 con 0x7f40a41434d0 2023-10-07T08:43:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:52.945 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:43:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: "stats": { 2023-10-07T08:43:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: "total_bytes": 1600000000, 2023-10-07T08:43:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: "total_avail_bytes": 1597666524, 2023-10-07T08:43:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: "total_used_bytes": 2333476, 2023-10-07T08:43:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: "total_used_raw_bytes": 2333476, 2023-10-07T08:43:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: "total_used_raw_ratio": 0.0014584225136786699, 2023-10-07T08:43:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: "num_osds": 8, 2023-10-07T08:43:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: "num_per_pool_osds": 0, 2023-10-07T08:43:52.945 INFO:teuthology.orchestra.run.smithi081.stdout: "num_per_pool_omap_osds": 0 2023-10-07T08:43:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "stats_by_class": { 2023-10-07T08:43:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "hdd": { 2023-10-07T08:43:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "total_bytes": 1600000000, 2023-10-07T08:43:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "total_avail_bytes": 1597666524, 2023-10-07T08:43:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "total_used_bytes": 2333476, 2023-10-07T08:43:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "total_used_raw_bytes": 2333476, 2023-10-07T08:43:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: "total_used_raw_ratio": 0.0014584225136786699 2023-10-07T08:43:52.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:43:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "name": ".mgr", 2023-10-07T08:43:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 1, 2023-10-07T08:43:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "stats": { 2023-10-07T08:43:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "stored": 590368, 2023-10-07T08:43:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "objects": 2, 2023-10-07T08:43:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "kb_used": 577, 2023-10-07T08:43:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_used": 590368, 2023-10-07T08:43:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "percent_used": 0.00052961398614570498, 2023-10-07T08:43:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: "max_avail": 557061696 2023-10-07T08:43:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephfs_metadata", 2023-10-07T08:43:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4, 2023-10-07T08:43:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "stats": { 2023-10-07T08:43:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "stored": 2306, 2023-10-07T08:43:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "objects": 22, 2023-10-07T08:43:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "kb_used": 3, 2023-10-07T08:43:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_used": 2306, 2023-10-07T08:43:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "percent_used": 2.069784386549145e-06, 2023-10-07T08:43:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "max_avail": 557061696 2023-10-07T08:43:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:43:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:43:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephfs_data", 2023-10-07T08:43:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5, 2023-10-07T08:43:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: "stats": { 2023-10-07T08:43:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: "stored": 0, 2023-10-07T08:43:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: "objects": 0, 2023-10-07T08:43:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: "kb_used": 0, 2023-10-07T08:43:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_used": 0, 2023-10-07T08:43:52.949 INFO:teuthology.orchestra.run.smithi081.stdout: "percent_used": 0, 2023-10-07T08:43:52.950 INFO:teuthology.orchestra.run.smithi081.stdout: "max_avail": 557061696 2023-10-07T08:43:52.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:52.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:43:52.950 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:43:52.950 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:43:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.945+0000 7f40a9304700 1 -- 172.21.15.81:0/4098103868 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4090066f30 msgr2=0x7f40900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.945+0000 7f40a9304700 1 --2- 172.21.15.81:0/4098103868 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4090066f30 0x7f40900693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f40940093f0 tx=0x7f4094017000 comp rx=0 tx=0).stop 2023-10-07T08:43:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.945+0000 7f40a9304700 1 -- 172.21.15.81:0/4098103868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a41434d0 msgr2=0x7f40a415c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.945+0000 7f40a9304700 1 --2- 172.21.15.81:0/4098103868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a41434d0 0x7f40a415c800 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f409800c850 tx=0x7f4098008040 comp rx=0 tx=0).stop 2023-10-07T08:43:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.945+0000 7f40a9304700 1 -- 172.21.15.81:0/4098103868 shutdown_connections 2023-10-07T08:43:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.945+0000 7f40a9304700 1 --2- 172.21.15.81:0/4098103868 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4090066f30 0x7f40900693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.945+0000 7f40a9304700 1 --2- 172.21.15.81:0/4098103868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40a41438a0 0x7f40a40cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.945+0000 7f40a9304700 1 --2- 172.21.15.81:0/4098103868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40a406d0c0 0x7f40a40c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.945+0000 7f40a9304700 1 --2- 172.21.15.81:0/4098103868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40a41434d0 0x7f40a415c800 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:52.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.945+0000 7f40a9304700 1 -- 172.21.15.81:0/4098103868 >> 172.21.15.81:0/4098103868 conn(0x7f40a40cd610 msgr2=0x7f40a406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:52.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.945+0000 7f40a9304700 1 -- 172.21.15.81:0/4098103868 shutdown_connections 2023-10-07T08:43:52.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:52.945+0000 7f40a9304700 1 -- 172.21.15.81:0/4098103868 wait complete. 2023-10-07T08:43:52.958 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-07T08:43:52.959 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-07T08:43:52.959 DEBUG:teuthology.orchestra.run.smithi081:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-07T08:43:52.959 DEBUG:teuthology.orchestra.run.smithi081:> os.fchmod(fd, 0O666) 2023-10-07T08:43:52.959 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(fd) 2023-10-07T08:43:52.959 DEBUG:teuthology.orchestra.run.smithi081:> os.close(fd) 2023-10-07T08:43:52.959 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-07T08:43:53.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:43:53.212 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-07T08:43:53.281 INFO:teuthology.orchestra.run.smithi081.stdout:client5133 2023-10-07T08:43:53.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:53.281 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f2fc6535-cadc-4a0b-bdad-da2d602c784a.client5133/osdmap') 2023-10-07T08:43:53.356 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 33 barrier 33 flags 0x588000 2023-10-07T08:43:53.357 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:43:53.357 INFO:teuthology.orchestra.run.smithi081.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:43:53.357 INFO:teuthology.orchestra.run.smithi081.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:43:53.357 INFO:teuthology.orchestra.run.smithi081.stdout:osd0 (1)172.21.15.81:6801 100% (exists, up) 100% -1 2023-10-07T08:43:53.357 INFO:teuthology.orchestra.run.smithi081.stdout:osd1 (1)172.21.15.81:6819 100% (exists, up) 100% -1 2023-10-07T08:43:53.357 INFO:teuthology.orchestra.run.smithi081.stdout:osd2 (1)172.21.15.81:6818 100% (exists, up) 100% -1 2023-10-07T08:43:53.357 INFO:teuthology.orchestra.run.smithi081.stdout:osd3 (1)172.21.15.81:6809 100% (exists, up) 100% -1 2023-10-07T08:43:53.357 INFO:teuthology.orchestra.run.smithi081.stdout:osd4 (1)172.21.15.89:6801 100% (exists, up) 100% -1 2023-10-07T08:43:53.357 INFO:teuthology.orchestra.run.smithi081.stdout:osd5 (1)172.21.15.89:6817 100% (exists, up) 100% -1 2023-10-07T08:43:53.357 INFO:teuthology.orchestra.run.smithi081.stdout:osd6 (1)172.21.15.89:6824 100% (exists, up) 100% -1 2023-10-07T08:43:53.357 INFO:teuthology.orchestra.run.smithi081.stdout:osd7 (1)172.21.15.89:6809 100% (exists, up) 100% -1 2023-10-07T08:43:53.358 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records in 2023-10-07T08:43:53.358 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records out 2023-10-07T08:43:53.359 INFO:teuthology.orchestra.run.smithi081.stderr:791 bytes copied, 5.2467e-05 s, 15.1 MB/s 2023-10-07T08:43:53.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-10-07T08:43:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.512+0000 7f9ed2bd7700 1 Processor -- start 2023-10-07T08:43:53.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.512+0000 7f9ed2bd7700 1 -- start start 2023-10-07T08:43:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.513+0000 7f9ed2bd7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9ecc157ca0 0x7f9ecc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.513+0000 7f9ed2bd7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9ecc06d120 0x7f9ecc06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.513+0000 7f9ed2bd7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ecc0d07c0 con 0x7f9ecc1578d0 2023-10-07T08:43:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.513+0000 7f9ed2bd7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ecc06da50 con 0x7f9ecc06d120 2023-10-07T08:43:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.513+0000 7f9ed2bd7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ecc0cfbb0 con 0x7f9ecc157ca0 2023-10-07T08:43:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.513+0000 7f9ed0973700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9ecc1578d0 0x7f9ecc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59412/0 (socket says 172.21.15.81:59412) 2023-10-07T08:43:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.513+0000 7f9ed1174700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9ecc06d120 0x7f9ecc06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.513+0000 7f9ed0973700 1 -- 172.21.15.81:0/1629765054 learned_addr learned my addr 172.21.15.81:0/1629765054 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.513+0000 7f9ec3fff700 1 --2- 172.21.15.81:0/1629765054 >> v2:172.21.15.89:3300/0 conn(0x7f9ecc157ca0 0x7f9ecc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.513+0000 7f9ec37fe700 1 -- 172.21.15.81:0/1629765054 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360584316 0 0) 0x7f9ecc0d07c0 con 0x7f9ecc1578d0 2023-10-07T08:43:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.513+0000 7f9ec37fe700 1 -- 172.21.15.81:0/1629765054 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb4003570 con 0x7f9ecc1578d0 2023-10-07T08:43:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.514+0000 7f9ed1174700 1 -- 172.21.15.81:0/1629765054 >> v2:172.21.15.89:3300/0 conn(0x7f9ecc157ca0 msgr2=0x7f9ecc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.514+0000 7f9ed1174700 1 --2- 172.21.15.81:0/1629765054 >> v2:172.21.15.89:3300/0 conn(0x7f9ecc157ca0 0x7f9ecc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.514+0000 7f9ed1174700 1 -- 172.21.15.81:0/1629765054 >> v1:172.21.15.81:6789/0 conn(0x7f9ecc1578d0 legacy=0x7f9ecc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.514+0000 7f9ed1174700 1 -- 172.21.15.81:0/1629765054 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0cfe90 con 0x7f9ecc06d120 2023-10-07T08:43:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.514+0000 7f9ed1174700 1 --2- 172.21.15.81:0/1629765054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc06d120 0x7f9ecc06d510 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc068510 tx=0x7f9ec40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a02eb46c33f1cec server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.514+0000 7f9ec37fe700 1 -- 172.21.15.81:0/1629765054 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4011630 con 0x7f9ecc06d120 2023-10-07T08:43:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.514+0000 7f9ec37fe700 1 -- 172.21.15.81:0/1629765054 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec40117b0 con 0x7f9ecc06d120 2023-10-07T08:43:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.514+0000 7f9ec37fe700 1 -- 172.21.15.81:0/1629765054 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4011b70 con 0x7f9ecc06d120 2023-10-07T08:43:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.514+0000 7f9ed2bd7700 1 -- 172.21.15.81:0/1629765054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc06d120 msgr2=0x7f9ecc06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.514+0000 7f9ed2bd7700 1 --2- 172.21.15.81:0/1629765054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc06d120 0x7f9ecc06d510 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc068510 tx=0x7f9ec40091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.514+0000 7f9ed2bd7700 1 -- 172.21.15.81:0/1629765054 shutdown_connections 2023-10-07T08:43:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.514+0000 7f9ed2bd7700 1 --2- 172.21.15.81:0/1629765054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc06d120 0x7f9ecc06d510 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.514+0000 7f9ed2bd7700 1 --2- 172.21.15.81:0/1629765054 >> v2:172.21.15.89:3300/0 conn(0x7f9ecc157ca0 0x7f9ecc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.514+0000 7f9ed2bd7700 1 -- 172.21.15.81:0/1629765054 >> 172.21.15.81:0/1629765054 conn(0x7f9ecc06bb90 msgr2=0x7f9ecc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.514+0000 7f9ed2bd7700 1 -- 172.21.15.81:0/1629765054 shutdown_connections 2023-10-07T08:43:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.514+0000 7f9ed2bd7700 1 -- 172.21.15.81:0/1629765054 wait complete. 2023-10-07T08:43:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.516+0000 7f9ed2bd7700 1 Processor -- start 2023-10-07T08:43:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.516+0000 7f9ed2bd7700 1 -- start start 2023-10-07T08:43:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.516+0000 7f9ed2bd7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc06d120 0x7f9ecc159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.516+0000 7f9ed2bd7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ecc1578d0 0x7f9ecc152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.516+0000 7f9ed2bd7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ecc157ca0 0x7f9ecc158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.516+0000 7f9ed2bd7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc16a170 con 0x7f9ecc06d120 2023-10-07T08:43:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.516+0000 7f9ed2bd7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc152db0 con 0x7f9ecc157ca0 2023-10-07T08:43:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.516+0000 7f9ed2bd7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc153010 con 0x7f9ecc1578d0 2023-10-07T08:43:53.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.516+0000 7f9ed0973700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc06d120 0x7f9ecc159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:53.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ed0973700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc06d120 0x7f9ecc159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36378/0 (socket says 172.21.15.81:36378) 2023-10-07T08:43:53.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ed0973700 1 -- 172.21.15.81:0/3093747565 learned_addr learned my addr 172.21.15.81:0/3093747565 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:53.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ec3fff700 1 --2- 172.21.15.81:0/3093747565 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ecc1578d0 0x7f9ecc152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:53.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ed1174700 1 --2- 172.21.15.81:0/3093747565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ecc157ca0 0x7f9ecc158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:53.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ed0973700 1 -- 172.21.15.81:0/3093747565 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ecc1578d0 msgr2=0x7f9ecc152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:53.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ed0973700 1 --2- 172.21.15.81:0/3093747565 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ecc1578d0 0x7f9ecc152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:53.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ed0973700 1 -- 172.21.15.81:0/3093747565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ecc157ca0 msgr2=0x7f9ecc158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:53.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ed0973700 1 --2- 172.21.15.81:0/3093747565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ecc157ca0 0x7f9ecc158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:53.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ed0973700 1 -- 172.21.15.81:0/3093747565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4009420 con 0x7f9ecc06d120 2023-10-07T08:43:53.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ec3fff700 1 --2- 172.21.15.81:0/3093747565 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ecc1578d0 0x7f9ecc152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:53.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ed1174700 1 --2- 172.21.15.81:0/3093747565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ecc157ca0 0x7f9ecc158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ed0973700 1 --2- 172.21.15.81:0/3093747565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc06d120 0x7f9ecc159440 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800cd30 tx=0x7f9ec8001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ec0ff9700 1 -- 172.21.15.81:0/3093747565 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec800ab70 con 0x7f9ecc06d120 2023-10-07T08:43:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ec0ff9700 1 -- 172.21.15.81:0/3093747565 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec800acd0 con 0x7f9ecc06d120 2023-10-07T08:43:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ed2bd7700 1 -- 172.21.15.81:0/3093747565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ecc1532f0 con 0x7f9ecc06d120 2023-10-07T08:43:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ec0ff9700 1 -- 172.21.15.81:0/3093747565 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8007340 con 0x7f9ecc06d120 2023-10-07T08:43:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.517+0000 7f9ed2bd7700 1 -- 172.21.15.81:0/3093747565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ecc1538b0 con 0x7f9ecc06d120 2023-10-07T08:43:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.518+0000 7f9ed2bd7700 1 -- 172.21.15.81:0/3093747565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ecc067ac0 con 0x7f9ecc06d120 2023-10-07T08:43:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.518+0000 7f9ec0ff9700 1 -- 172.21.15.81:0/3093747565 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ec8007770 con 0x7f9ecc06d120 2023-10-07T08:43:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.519+0000 7f9ec0ff9700 1 --2- 172.21.15.81:0/3093747565 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9eb8066f30 0x7f9eb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.519+0000 7f9ec3fff700 1 --2- 172.21.15.81:0/3093747565 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9eb8066f30 0x7f9eb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.519+0000 7f9ec0ff9700 1 -- 172.21.15.81:0/3093747565 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ec80849b0 con 0x7f9ecc06d120 2023-10-07T08:43:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.519+0000 7f9ec3fff700 1 --2- 172.21.15.81:0/3093747565 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9eb8066f30 0x7f9eb80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc154750 tx=0x7f9ebc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.523+0000 7f9ec0ff9700 1 -- 172.21.15.81:0/3093747565 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ec8051ca0 con 0x7f9ecc06d120 2023-10-07T08:43:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:53.714+0000 7f9ed2bd7700 1 -- 172.21.15.81:0/3093747565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f9ecc0d0170 con 0x7f9ecc06d120 2023-10-07T08:43:54.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.325+0000 7f9ec0ff9700 1 -- 172.21.15.81:0/3093747565 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v34) v1 ==== 93+0+0 (secure 0 0 0) 0x7f9ec80552c0 con 0x7f9ecc06d120 2023-10-07T08:43:54.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.327+0000 7f9ed2bd7700 1 -- 172.21.15.81:0/3093747565 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9eb8066f30 msgr2=0x7f9eb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:54.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.327+0000 7f9ed2bd7700 1 --2- 172.21.15.81:0/3093747565 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9eb8066f30 0x7f9eb80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc154750 tx=0x7f9ebc008040 comp rx=0 tx=0).stop 2023-10-07T08:43:54.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.327+0000 7f9ed2bd7700 1 -- 172.21.15.81:0/3093747565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc06d120 msgr2=0x7f9ecc159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:54.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.327+0000 7f9ed2bd7700 1 --2- 172.21.15.81:0/3093747565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc06d120 0x7f9ecc159440 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800cd30 tx=0x7f9ec8001b10 comp rx=0 tx=0).stop 2023-10-07T08:43:54.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.327+0000 7f9ed2bd7700 1 -- 172.21.15.81:0/3093747565 shutdown_connections 2023-10-07T08:43:54.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.327+0000 7f9ed2bd7700 1 --2- 172.21.15.81:0/3093747565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ecc157ca0 0x7f9ecc158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:54.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.327+0000 7f9ed2bd7700 1 --2- 172.21.15.81:0/3093747565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ecc06d120 0x7f9ecc159440 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:54.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.327+0000 7f9ed2bd7700 1 --2- 172.21.15.81:0/3093747565 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9eb8066f30 0x7f9eb80693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:54.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.327+0000 7f9ed2bd7700 1 --2- 172.21.15.81:0/3093747565 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ecc1578d0 0x7f9ecc152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:54.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.327+0000 7f9ed2bd7700 1 -- 172.21.15.81:0/3093747565 >> 172.21.15.81:0/3093747565 conn(0x7f9ecc06bb90 msgr2=0x7f9ecc159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:54.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.328+0000 7f9ed2bd7700 1 -- 172.21.15.81:0/3093747565 shutdown_connections 2023-10-07T08:43:54.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.328+0000 7f9ed2bd7700 1 -- 172.21.15.81:0/3093747565 wait complete. 2023-10-07T08:43:54.330 INFO:teuthology.orchestra.run.smithi081.stderr:pauserd,pausewr is set 2023-10-07T08:43:54.341 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-10-07T08:43:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.455+0000 7fb0e0e20700 1 Processor -- start 2023-10-07T08:43:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.455+0000 7fb0e0e20700 1 -- start start 2023-10-07T08:43:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.456+0000 7fb0e0e20700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb0dc15a2a0 0x7fb0dc0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.456+0000 7fb0e0e20700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0dc06dd60 0x7fb0dc0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.456+0000 7fb0e0e20700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0dc0b0ca0 con 0x7fb0dc0ceb30 2023-10-07T08:43:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.456+0000 7fb0e0e20700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0dc06e160 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.456+0000 7fb0e0e20700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc06ea90 con 0x7fb0dc06dd60 2023-10-07T08:43:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.456+0000 7fb0da59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb0dc15a2a0 0x7fb0dc0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.456+0000 7fb0da59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb0dc15a2a0 0x7fb0dc0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36388/0 (socket says 172.21.15.81:36388) 2023-10-07T08:43:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.456+0000 7fb0da59c700 1 -- 172.21.15.81:0/3348057792 learned_addr learned my addr 172.21.15.81:0/3348057792 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.457+0000 7fb0da59c700 1 -- 172.21.15.81:0/3348057792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0dc06dd60 msgr2=0x7fb0dc0cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.457+0000 7fb0da59c700 1 --2- 172.21.15.81:0/3348057792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0dc06dd60 0x7fb0dc0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.457+0000 7fb0da59c700 1 -- 172.21.15.81:0/3348057792 >> v1:172.21.15.89:6789/0 conn(0x7fb0dc0ceb30 legacy=0x7fb0dc06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.457+0000 7fb0da59c700 1 -- 172.21.15.81:0/3348057792 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc0b00d0 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.457+0000 7fb0da59c700 1 --2- 172.21.15.81:0/3348057792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0dc15a2a0 0x7fb0dc0b1130 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0099b0 tx=0x7fb0cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d68350dd347ed0d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.457+0000 7fb0d9d9b700 1 -- 172.21.15.81:0/3348057792 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc00b820 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.457+0000 7fb0d9d9b700 1 -- 172.21.15.81:0/3348057792 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc00b980 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.457+0000 7fb0d9d9b700 1 -- 172.21.15.81:0/3348057792 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc00bd20 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.457+0000 7fb0e0e20700 1 -- 172.21.15.81:0/3348057792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0dc15a2a0 msgr2=0x7fb0dc0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.457+0000 7fb0e0e20700 1 --2- 172.21.15.81:0/3348057792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0dc15a2a0 0x7fb0dc0b1130 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0099b0 tx=0x7fb0cc009250 comp rx=0 tx=0).stop 2023-10-07T08:43:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.457+0000 7fb0e0e20700 1 -- 172.21.15.81:0/3348057792 shutdown_connections 2023-10-07T08:43:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.457+0000 7fb0e0e20700 1 --2- 172.21.15.81:0/3348057792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0dc06dd60 0x7fb0dc0cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.457+0000 7fb0e0e20700 1 --2- 172.21.15.81:0/3348057792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0dc15a2a0 0x7fb0dc0b1130 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.457+0000 7fb0e0e20700 1 -- 172.21.15.81:0/3348057792 >> 172.21.15.81:0/3348057792 conn(0x7fb0dc067640 msgr2=0x7fb0dc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.457+0000 7fb0e0e20700 1 -- 172.21.15.81:0/3348057792 shutdown_connections 2023-10-07T08:43:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.457+0000 7fb0e0e20700 1 -- 172.21.15.81:0/3348057792 wait complete. 2023-10-07T08:43:54.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.459+0000 7fb0e0e20700 1 Processor -- start 2023-10-07T08:43:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.459+0000 7fb0e0e20700 1 -- start start 2023-10-07T08:43:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.459+0000 7fb0e0e20700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc06dd60 0x7fb0dc155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.459+0000 7fb0e0e20700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0dc0ceb30 0x7fb0dc0ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.459+0000 7fb0e0e20700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0dc15a2a0 0x7fb0dc15b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.459+0000 7fb0e0e20700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc156220 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.459+0000 7fb0e0e20700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc0cae40 con 0x7fb0dc06dd60 2023-10-07T08:43:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.459+0000 7fb0e0e20700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc0cb120 con 0x7fb0dc0ceb30 2023-10-07T08:43:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.459+0000 7fb0dad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0dc15a2a0 0x7fb0dc15b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.459+0000 7fb0dad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0dc15a2a0 0x7fb0dc15b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36390/0 (socket says 172.21.15.81:36390) 2023-10-07T08:43:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.459+0000 7fb0dad9d700 1 -- 172.21.15.81:0/3450810725 learned_addr learned my addr 172.21.15.81:0/3450810725 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.459+0000 7fb0da59c700 1 --2- 172.21.15.81:0/3450810725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc06dd60 0x7fb0dc155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.459+0000 7fb0d1d9b700 1 --2- 172.21.15.81:0/3450810725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0dc0ceb30 0x7fb0dc0ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.460+0000 7fb0dad9d700 1 -- 172.21.15.81:0/3450810725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0dc0ceb30 msgr2=0x7fb0dc0ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.460+0000 7fb0dad9d700 1 --2- 172.21.15.81:0/3450810725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0dc0ceb30 0x7fb0dc0ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.460+0000 7fb0dad9d700 1 -- 172.21.15.81:0/3450810725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc06dd60 msgr2=0x7fb0dc155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.460+0000 7fb0dad9d700 1 --2- 172.21.15.81:0/3450810725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc06dd60 0x7fb0dc155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.460+0000 7fb0dad9d700 1 -- 172.21.15.81:0/3450810725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc0094f0 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.460+0000 7fb0dad9d700 1 --2- 172.21.15.81:0/3450810725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0dc15a2a0 0x7fb0dc15b180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400bc30 tx=0x7fb0d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.460+0000 7fb0d2ffd700 1 -- 172.21.15.81:0/3450810725 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d40092e0 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.460+0000 7fb0d2ffd700 1 -- 172.21.15.81:0/3450810725 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d400c630 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.460+0000 7fb0e0e20700 1 -- 172.21.15.81:0/3450810725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0dc0cb400 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.460+0000 7fb0d2ffd700 1 -- 172.21.15.81:0/3450810725 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d400ca10 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.460+0000 7fb0e0e20700 1 -- 172.21.15.81:0/3450810725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0dc15dbb0 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.461+0000 7fb0e0e20700 1 -- 172.21.15.81:0/3450810725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0dc069e40 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.461+0000 7fb0d2ffd700 1 -- 172.21.15.81:0/3450810725 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0d4012070 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.462+0000 7fb0d2ffd700 1 --2- 172.21.15.81:0/3450810725 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb0bc066f30 0x7fb0bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:54.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.462+0000 7fb0d2ffd700 1 -- 172.21.15.81:0/3450810725 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb0d4084070 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.462+0000 7fb0da59c700 1 --2- 172.21.15.81:0/3450810725 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb0bc066f30 0x7fb0bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:54.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.462+0000 7fb0d2ffd700 1 -- 172.21.15.81:0/3450810725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=35+}) v3 -- 0x7fb0bc06ea50 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.462+0000 7fb0da59c700 1 --2- 172.21.15.81:0/3450810725 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb0bc066f30 0x7fb0bc0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0099b0 tx=0x7fb0cc016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.466+0000 7fb0d2ffd700 1 -- 172.21.15.81:0/3450810725 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0d401a020 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:54.661+0000 7fb0e0e20700 1 -- 172.21.15.81:0/3450810725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7fb0dc0ccaa0 con 0x7fb0dc15a2a0 2023-10-07T08:43:54.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:43:54.983 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:43:55.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.328+0000 7fb0d2ffd700 1 -- 172.21.15.81:0/3450810725 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(35..35 src has 1..35) v4 ==== 280+0+0 (secure 0 0 0) 0x7fb0d40556a0 con 0x7fb0dc15a2a0 2023-10-07T08:43:55.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.328+0000 7fb0d2ffd700 1 -- 172.21.15.81:0/3450810725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=36}) v3 -- 0x7fb0bc06f2d0 con 0x7fb0dc15a2a0 2023-10-07T08:43:55.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.330+0000 7fb0d2ffd700 1 -- 172.21.15.81:0/3450810725 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb0d40512e0 con 0x7fb0dc15a2a0 2023-10-07T08:43:55.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.332+0000 7fb0e0e20700 1 -- 172.21.15.81:0/3450810725 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb0bc066f30 msgr2=0x7fb0bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:55.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.332+0000 7fb0e0e20700 1 --2- 172.21.15.81:0/3450810725 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb0bc066f30 0x7fb0bc0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0099b0 tx=0x7fb0cc016000 comp rx=0 tx=0).stop 2023-10-07T08:43:55.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.332+0000 7fb0e0e20700 1 -- 172.21.15.81:0/3450810725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0dc15a2a0 msgr2=0x7fb0dc15b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:55.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.332+0000 7fb0e0e20700 1 --2- 172.21.15.81:0/3450810725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0dc15a2a0 0x7fb0dc15b180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400bc30 tx=0x7fb0d4009840 comp rx=0 tx=0).stop 2023-10-07T08:43:55.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.332+0000 7fb0e0e20700 1 -- 172.21.15.81:0/3450810725 shutdown_connections 2023-10-07T08:43:55.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.332+0000 7fb0e0e20700 1 --2- 172.21.15.81:0/3450810725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0dc15a2a0 0x7fb0dc15b180 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:55.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.332+0000 7fb0e0e20700 1 --2- 172.21.15.81:0/3450810725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc06dd60 0x7fb0dc155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:55.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.332+0000 7fb0e0e20700 1 --2- 172.21.15.81:0/3450810725 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb0bc066f30 0x7fb0bc0693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:55.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.332+0000 7fb0e0e20700 1 --2- 172.21.15.81:0/3450810725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0dc0ceb30 0x7fb0dc0ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:55.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.332+0000 7fb0e0e20700 1 -- 172.21.15.81:0/3450810725 >> 172.21.15.81:0/3450810725 conn(0x7fb0dc067640 msgr2=0x7fb0dc0ad6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:55.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.332+0000 7fb0e0e20700 1 -- 172.21.15.81:0/3450810725 shutdown_connections 2023-10-07T08:43:55.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.332+0000 7fb0e0e20700 1 -- 172.21.15.81:0/3450810725 wait complete. 2023-10-07T08:43:55.335 INFO:teuthology.orchestra.run.smithi081.stderr:pauserd,pausewr is unset 2023-10-07T08:43:55.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:55.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.459+0000 7f616d6b8700 1 Processor -- start 2023-10-07T08:43:55.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.459+0000 7f616d6b8700 1 -- start start 2023-10-07T08:43:55.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.460+0000 7f616d6b8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6168159f10 0x7f6168068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:55.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.460+0000 7f616d6b8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6168068cc0 0x7f61680cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:55.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.460+0000 7f616d6b8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61680cee10 con 0x7f6168159b40 2023-10-07T08:43:55.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.460+0000 7f616d6b8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6168069140 con 0x7f6168068cc0 2023-10-07T08:43:55.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.460+0000 7f616d6b8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61680cd040 con 0x7f6168159f10 2023-10-07T08:43:55.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.460+0000 7f616ceb7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6168068cc0 0x7f61680cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:55.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.460+0000 7f61677fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6168159f10 0x7f6168068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:55.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.460+0000 7f6167fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6168159b40 0x7f61680cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:49988/0 (socket says 172.21.15.81:49988) 2023-10-07T08:43:55.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.460+0000 7f6167fff700 1 -- 172.21.15.81:0/1371698419 learned_addr learned my addr 172.21.15.81:0/1371698419 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:55.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.461+0000 7f61677fe700 1 -- 172.21.15.81:0/1371698419 >> v2:172.21.15.89:3300/0 conn(0x7f6168068cc0 msgr2=0x7f61680cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:55.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.461+0000 7f61677fe700 1 --2- 172.21.15.81:0/1371698419 >> v2:172.21.15.89:3300/0 conn(0x7f6168068cc0 0x7f61680cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:55.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.461+0000 7f61677fe700 1 -- 172.21.15.81:0/1371698419 >> v1:172.21.15.89:6789/0 conn(0x7f6168159b40 legacy=0x7f61680cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:55.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.461+0000 7f61677fe700 1 -- 172.21.15.81:0/1371698419 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61680cd320 con 0x7f6168159f10 2023-10-07T08:43:55.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.461+0000 7f616ceb7700 1 --2- 172.21.15.81:0/1371698419 >> v2:172.21.15.89:3300/0 conn(0x7f6168068cc0 0x7f61680cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:43:55.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.461+0000 7f61677fe700 1 --2- 172.21.15.81:0/1371698419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6168159f10 0x7f6168068780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f615c0098e0 tx=0x7f615c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59657da7c6a4acdc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:55.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.461+0000 7f6166ffd700 1 -- 172.21.15.81:0/1371698419 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c00b640 con 0x7f6168159f10 2023-10-07T08:43:55.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.461+0000 7f6166ffd700 1 -- 172.21.15.81:0/1371698419 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c00b7a0 con 0x7f6168159f10 2023-10-07T08:43:55.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.461+0000 7f6166ffd700 1 -- 172.21.15.81:0/1371698419 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c00bb40 con 0x7f6168159f10 2023-10-07T08:43:55.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.461+0000 7f616d6b8700 1 -- 172.21.15.81:0/1371698419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6168159f10 msgr2=0x7f6168068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:55.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.461+0000 7f616d6b8700 1 --2- 172.21.15.81:0/1371698419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6168159f10 0x7f6168068780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f615c0098e0 tx=0x7f615c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:55.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.462+0000 7f616d6b8700 1 -- 172.21.15.81:0/1371698419 shutdown_connections 2023-10-07T08:43:55.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.462+0000 7f616d6b8700 1 --2- 172.21.15.81:0/1371698419 >> v2:172.21.15.89:3300/0 conn(0x7f6168068cc0 0x7f61680cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:55.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.462+0000 7f616d6b8700 1 --2- 172.21.15.81:0/1371698419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6168159f10 0x7f6168068780 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:55.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.462+0000 7f616d6b8700 1 -- 172.21.15.81:0/1371698419 >> 172.21.15.81:0/1371698419 conn(0x7f61680cd660 msgr2=0x7f61680cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:55.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.462+0000 7f616d6b8700 1 -- 172.21.15.81:0/1371698419 shutdown_connections 2023-10-07T08:43:55.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.462+0000 7f616d6b8700 1 -- 172.21.15.81:0/1371698419 wait complete. 2023-10-07T08:43:55.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.463+0000 7f616d6b8700 1 Processor -- start 2023-10-07T08:43:55.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.463+0000 7f616d6b8700 1 -- start start 2023-10-07T08:43:55.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.463+0000 7f616d6b8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6168068cc0 0x7f616816d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:55.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.463+0000 7f616d6b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6168159b40 0x7f616815bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:55.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f616d6b8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6168159f10 0x7f61681485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:55.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f616d6b8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6168149b10 con 0x7f6168159b40 2023-10-07T08:43:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f616d6b8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616816de80 con 0x7f6168068cc0 2023-10-07T08:43:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f616d6b8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61680c7ed0 con 0x7f6168159f10 2023-10-07T08:43:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f61677fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6168159b40 0x7f616815bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f61677fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6168159b40 0x7f616815bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36396/0 (socket says 172.21.15.81:36396) 2023-10-07T08:43:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f61677fe700 1 -- 172.21.15.81:0/616026017 learned_addr learned my addr 172.21.15.81:0/616026017 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f616ceb7700 1 --2- 172.21.15.81:0/616026017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6168159f10 0x7f61681485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f6167fff700 1 --2- 172.21.15.81:0/616026017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6168068cc0 0x7f616816d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f61677fe700 1 -- 172.21.15.81:0/616026017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6168159f10 msgr2=0x7f61681485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f61677fe700 1 --2- 172.21.15.81:0/616026017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6168159f10 0x7f61681485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f61677fe700 1 -- 172.21.15.81:0/616026017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6168068cc0 msgr2=0x7f616816d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f61677fe700 1 --2- 172.21.15.81:0/616026017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6168068cc0 0x7f616816d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f61677fe700 1 -- 172.21.15.81:0/616026017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6160009a20 con 0x7f6168159b40 2023-10-07T08:43:55.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f6167fff700 1 --2- 172.21.15.81:0/616026017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6168068cc0 0x7f616816d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:55.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f61677fe700 1 --2- 172.21.15.81:0/616026017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6168159b40 0x7f616815bcd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f615c009f80 tx=0x7f615c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:55.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f614ffff700 1 -- 172.21.15.81:0/616026017 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c01bd90 con 0x7f6168159b40 2023-10-07T08:43:55.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f614ffff700 1 -- 172.21.15.81:0/616026017 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c011420 con 0x7f6168159b40 2023-10-07T08:43:55.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f616d6b8700 1 -- 172.21.15.81:0/616026017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c009420 con 0x7f6168159b40 2023-10-07T08:43:55.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f614ffff700 1 -- 172.21.15.81:0/616026017 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c0117e0 con 0x7f6168159b40 2023-10-07T08:43:55.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.464+0000 7f616d6b8700 1 -- 172.21.15.81:0/616026017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616816e390 con 0x7f6168159b40 2023-10-07T08:43:55.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.465+0000 7f616d6b8700 1 -- 172.21.15.81:0/616026017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61680c8010 con 0x7f6168159b40 2023-10-07T08:43:55.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.466+0000 7f614ffff700 1 -- 172.21.15.81:0/616026017 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f615c011b50 con 0x7f6168159b40 2023-10-07T08:43:55.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.466+0000 7f614ffff700 1 --2- 172.21.15.81:0/616026017 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6154066f30 0x7f61540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:55.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.466+0000 7f614ffff700 1 -- 172.21.15.81:0/616026017 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f615c085c90 con 0x7f6168159b40 2023-10-07T08:43:55.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.466+0000 7f6167fff700 1 --2- 172.21.15.81:0/616026017 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6154066f30 0x7f61540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:55.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.466+0000 7f6167fff700 1 --2- 172.21.15.81:0/616026017 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6154066f30 0x7f61540693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6158001820 tx=0x7f6158009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:55.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.470+0000 7f614ffff700 1 -- 172.21.15.81:0/616026017 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f615c052f00 con 0x7f6168159b40 2023-10-07T08:43:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.654+0000 7f616d6b8700 1 -- 172.21.15.81:0/616026017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61680ce7c0 con 0x7f6168159b40 2023-10-07T08:43:55.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.655+0000 7f614ffff700 1 -- 172.21.15.81:0/616026017 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f615c056520 con 0x7f6168159b40 2023-10-07T08:43:55.656 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:55.657 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":35,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:43:55.325199+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:43:41.595379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-07T08:43:42.590185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:55.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.657+0000 7f616d6b8700 1 -- 172.21.15.81:0/616026017 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6154066f30 msgr2=0x7f61540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:55.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.657+0000 7f616d6b8700 1 --2- 172.21.15.81:0/616026017 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6154066f30 0x7f61540693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6158001820 tx=0x7f6158009040 comp rx=0 tx=0).stop 2023-10-07T08:43:55.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.657+0000 7f616d6b8700 1 -- 172.21.15.81:0/616026017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6168159b40 msgr2=0x7f616815bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:55.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.657+0000 7f616d6b8700 1 --2- 172.21.15.81:0/616026017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6168159b40 0x7f616815bcd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f615c009f80 tx=0x7f615c017000 comp rx=0 tx=0).stop 2023-10-07T08:43:55.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.657+0000 7f616d6b8700 1 -- 172.21.15.81:0/616026017 shutdown_connections 2023-10-07T08:43:55.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.657+0000 7f616d6b8700 1 --2- 172.21.15.81:0/616026017 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6154066f30 0x7f61540693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:55.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.657+0000 7f616d6b8700 1 --2- 172.21.15.81:0/616026017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6168159f10 0x7f61681485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:55.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.657+0000 7f616d6b8700 1 --2- 172.21.15.81:0/616026017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6168068cc0 0x7f616816d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:55.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.657+0000 7f616d6b8700 1 --2- 172.21.15.81:0/616026017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6168159b40 0x7f616815bcd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:55.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.657+0000 7f616d6b8700 1 -- 172.21.15.81:0/616026017 >> 172.21.15.81:0/616026017 conn(0x7f61680cd660 msgr2=0x7f616806e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:55.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.657+0000 7f616d6b8700 1 -- 172.21.15.81:0/616026017 shutdown_connections 2023-10-07T08:43:55.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:55.657+0000 7f616d6b8700 1 -- 172.21.15.81:0/616026017 wait complete. 2023-10-07T08:43:55.670 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-07T08:43:55.670 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-07T08:43:55.671 DEBUG:teuthology.orchestra.run.smithi081:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-07T08:43:55.671 DEBUG:teuthology.orchestra.run.smithi081:> os.fchmod(fd, 0O666) 2023-10-07T08:43:55.671 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(fd) 2023-10-07T08:43:55.671 DEBUG:teuthology.orchestra.run.smithi081:> os.close(fd) 2023-10-07T08:43:55.671 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-07T08:43:55.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:43:55.923 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-07T08:43:55.992 INFO:teuthology.orchestra.run.smithi081.stdout:client5133 2023-10-07T08:43:55.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:55.992 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f2fc6535-cadc-4a0b-bdad-da2d602c784a.client5133/osdmap') 2023-10-07T08:43:56.068 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 33 barrier 33 flags 0x588000 2023-10-07T08:43:56.068 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:43:56.068 INFO:teuthology.orchestra.run.smithi081.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:43:56.068 INFO:teuthology.orchestra.run.smithi081.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:43:56.068 INFO:teuthology.orchestra.run.smithi081.stdout:osd0 (1)172.21.15.81:6801 100% (exists, up) 100% -1 2023-10-07T08:43:56.068 INFO:teuthology.orchestra.run.smithi081.stdout:osd1 (1)172.21.15.81:6819 100% (exists, up) 100% -1 2023-10-07T08:43:56.068 INFO:teuthology.orchestra.run.smithi081.stdout:osd2 (1)172.21.15.81:6818 100% (exists, up) 100% -1 2023-10-07T08:43:56.068 INFO:teuthology.orchestra.run.smithi081.stdout:osd3 (1)172.21.15.81:6809 100% (exists, up) 100% -1 2023-10-07T08:43:56.068 INFO:teuthology.orchestra.run.smithi081.stdout:osd4 (1)172.21.15.89:6801 100% (exists, up) 100% -1 2023-10-07T08:43:56.068 INFO:teuthology.orchestra.run.smithi081.stdout:osd5 (1)172.21.15.89:6817 100% (exists, up) 100% -1 2023-10-07T08:43:56.069 INFO:teuthology.orchestra.run.smithi081.stdout:osd6 (1)172.21.15.89:6824 100% (exists, up) 100% -1 2023-10-07T08:43:56.069 INFO:teuthology.orchestra.run.smithi081.stdout:osd7 (1)172.21.15.89:6809 100% (exists, up) 100% -1 2023-10-07T08:43:56.069 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records in 2023-10-07T08:43:56.069 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records out 2023-10-07T08:43:56.070 INFO:teuthology.orchestra.run.smithi081.stderr:791 bytes copied, 3.273e-05 s, 24.2 MB/s 2023-10-07T08:43:56.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:43:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.222+0000 7f7fdffe3700 1 Processor -- start 2023-10-07T08:43:56.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.222+0000 7f7fdffe3700 1 -- start start 2023-10-07T08:43:56.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.223+0000 7f7fdffe3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fd8157fe0 0x7f7fd80b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:56.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.223+0000 7f7fdffe3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7fd81583b0 0x7f7fd80b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:56.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.223+0000 7f7fdffe3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd80ceb30 0x7f7fd80cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:56.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.223+0000 7f7fdffe3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd80cf4b0 con 0x7f7fd8157fe0 2023-10-07T08:43:56.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.223+0000 7f7fdffe3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd80b2890 con 0x7f7fd81583b0 2023-10-07T08:43:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.223+0000 7f7fdffe3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd80b4070 con 0x7f7fd80ceb30 2023-10-07T08:43:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.223+0000 7f7fddd7f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fd8157fe0 0x7f7fd80b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.223+0000 7f7fddd7f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fd8157fe0 0x7f7fd80b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36400/0 (socket says 172.21.15.81:36400) 2023-10-07T08:43:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.223+0000 7f7fddd7f700 1 -- 172.21.15.81:0/1254708322 learned_addr learned my addr 172.21.15.81:0/1254708322 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.224+0000 7f7fde580700 1 --2- 172.21.15.81:0/1254708322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd80ceb30 0x7f7fd80cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.224+0000 7f7fdd57e700 1 --2- 172.21.15.81:0/1254708322 >> v2:172.21.15.89:3300/0 conn(0x7f7fd81583b0 0x7f7fd80b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.224+0000 7f7fddd7f700 1 -- 172.21.15.81:0/1254708322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd80ceb30 msgr2=0x7f7fd80cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.224+0000 7f7fddd7f700 1 --2- 172.21.15.81:0/1254708322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd80ceb30 0x7f7fd80cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.224+0000 7f7fddd7f700 1 -- 172.21.15.81:0/1254708322 >> v2:172.21.15.89:3300/0 conn(0x7f7fd81583b0 msgr2=0x7f7fd80b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.224+0000 7f7fddd7f700 1 --2- 172.21.15.81:0/1254708322 >> v2:172.21.15.89:3300/0 conn(0x7f7fd81583b0 0x7f7fd80b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.224+0000 7f7fddd7f700 1 -- 172.21.15.81:0/1254708322 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd80b4350 con 0x7f7fd8157fe0 2023-10-07T08:43:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.224+0000 7f7fde580700 1 --2- 172.21.15.81:0/1254708322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd80ceb30 0x7f7fd80cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.224+0000 7f7fddd7f700 1 --2- 172.21.15.81:0/1254708322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fd8157fe0 0x7f7fd80b34c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7fd804c150 tx=0x7f7fd4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9dfc3d87c01af6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.224+0000 7f7fdcd7d700 1 -- 172.21.15.81:0/1254708322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd400e070 con 0x7f7fd8157fe0 2023-10-07T08:43:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.224+0000 7f7fdcd7d700 1 -- 172.21.15.81:0/1254708322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd400ba50 con 0x7f7fd8157fe0 2023-10-07T08:43:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.224+0000 7f7fdcd7d700 1 -- 172.21.15.81:0/1254708322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40092e0 con 0x7f7fd8157fe0 2023-10-07T08:43:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.224+0000 7f7fdffe3700 1 -- 172.21.15.81:0/1254708322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fd8157fe0 msgr2=0x7f7fd80b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.224+0000 7f7fdffe3700 1 --2- 172.21.15.81:0/1254708322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fd8157fe0 0x7f7fd80b34c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7fd804c150 tx=0x7f7fd4009840 comp rx=0 tx=0).stop 2023-10-07T08:43:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.225+0000 7f7fdffe3700 1 -- 172.21.15.81:0/1254708322 shutdown_connections 2023-10-07T08:43:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.225+0000 7f7fdffe3700 1 --2- 172.21.15.81:0/1254708322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd80ceb30 0x7f7fd80cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.225+0000 7f7fdffe3700 1 --2- 172.21.15.81:0/1254708322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fd8157fe0 0x7f7fd80b34c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.225+0000 7f7fdffe3700 1 --2- 172.21.15.81:0/1254708322 >> v2:172.21.15.89:3300/0 conn(0x7f7fd81583b0 0x7f7fd80b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:56.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.225+0000 7f7fdffe3700 1 -- 172.21.15.81:0/1254708322 >> 172.21.15.81:0/1254708322 conn(0x7f7fd8067640 msgr2=0x7f7fd8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:56.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.225+0000 7f7fdffe3700 1 -- 172.21.15.81:0/1254708322 shutdown_connections 2023-10-07T08:43:56.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.225+0000 7f7fdffe3700 1 -- 172.21.15.81:0/1254708322 wait complete. 2023-10-07T08:43:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.226+0000 7f7fdffe3700 1 Processor -- start 2023-10-07T08:43:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.226+0000 7f7fdffe3700 1 -- start start 2023-10-07T08:43:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.226+0000 7f7fdffe3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd80ceb30 0x7f7fd806e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.226+0000 7f7fdffe3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd8157fe0 0x7f7fd81513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.226+0000 7f7fdffe3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fd81583b0 0x7f7fd8152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.226+0000 7f7fdffe3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd815b820 con 0x7f7fd81583b0 2023-10-07T08:43:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.226+0000 7f7fdffe3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd815a930 con 0x7f7fd80ceb30 2023-10-07T08:43:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fdffe3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd815ac10 con 0x7f7fd8157fe0 2023-10-07T08:43:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fde580700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fd81583b0 0x7f7fd8152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fde580700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fd81583b0 0x7f7fd8152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36416/0 (socket says 172.21.15.81:36416) 2023-10-07T08:43:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fde580700 1 -- 172.21.15.81:0/2469593693 learned_addr learned my addr 172.21.15.81:0/2469593693 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fdd57e700 1 --2- 172.21.15.81:0/2469593693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd8157fe0 0x7f7fd81513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fddd7f700 1 --2- 172.21.15.81:0/2469593693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd80ceb30 0x7f7fd806e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fde580700 1 -- 172.21.15.81:0/2469593693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd8157fe0 msgr2=0x7f7fd81513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fde580700 1 --2- 172.21.15.81:0/2469593693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd8157fe0 0x7f7fd81513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fde580700 1 -- 172.21.15.81:0/2469593693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd80ceb30 msgr2=0x7f7fd806e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fde580700 1 --2- 172.21.15.81:0/2469593693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd80ceb30 0x7f7fd806e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fde580700 1 -- 172.21.15.81:0/2469593693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd4009ae0 con 0x7f7fd81583b0 2023-10-07T08:43:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fddd7f700 1 --2- 172.21.15.81:0/2469593693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd80ceb30 0x7f7fd806e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fdd57e700 1 --2- 172.21.15.81:0/2469593693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd8157fe0 0x7f7fd81513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fde580700 1 --2- 172.21.15.81:0/2469593693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fd81583b0 0x7f7fd8152b70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000d860 tx=0x7f7fd0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fcdffb700 1 -- 172.21.15.81:0/2469593693 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd00125f0 con 0x7f7fd81583b0 2023-10-07T08:43:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fcdffb700 1 -- 172.21.15.81:0/2469593693 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd0012750 con 0x7f7fd81583b0 2023-10-07T08:43:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fdffe3700 1 -- 172.21.15.81:0/2469593693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd815aef0 con 0x7f7fd81583b0 2023-10-07T08:43:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fcdffb700 1 -- 172.21.15.81:0/2469593693 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0012ad0 con 0x7f7fd81583b0 2023-10-07T08:43:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.227+0000 7f7fdffe3700 1 -- 172.21.15.81:0/2469593693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd815b4b0 con 0x7f7fd81583b0 2023-10-07T08:43:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.228+0000 7f7fdffe3700 1 -- 172.21.15.81:0/2469593693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd8069e40 con 0x7f7fd81583b0 2023-10-07T08:43:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.229+0000 7f7fcdffb700 1 -- 172.21.15.81:0/2469593693 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7fd0014430 con 0x7f7fd81583b0 2023-10-07T08:43:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.229+0000 7f7fcdffb700 1 --2- 172.21.15.81:0/2469593693 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7fbc066f30 0x7f7fbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.229+0000 7f7fcdffb700 1 -- 172.21.15.81:0/2469593693 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7fd00848c0 con 0x7f7fd81583b0 2023-10-07T08:43:56.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.229+0000 7f7fddd7f700 1 --2- 172.21.15.81:0/2469593693 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7fbc066f30 0x7f7fbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:56.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.229+0000 7f7fddd7f700 1 --2- 172.21.15.81:0/2469593693 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7fbc066f30 0x7f7fbc0693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7fd804c150 tx=0x7f7fd4018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:56.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.233+0000 7f7fcdffb700 1 -- 172.21.15.81:0/2469593693 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fd00555c0 con 0x7f7fd81583b0 2023-10-07T08:43:56.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.458+0000 7f7fdffe3700 1 -- 172.21.15.81:0/2469593693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fd815b960 con 0x7f7fd81583b0 2023-10-07T08:43:56.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.459+0000 7f7fcdffb700 1 -- 172.21.15.81:0/2469593693 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f7fd0055150 con 0x7f7fd81583b0 2023-10-07T08:43:56.460 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:56.460 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1843075449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1843075449},{"type":"v1","addr":"172.21.15.81:6837","nonce":1843075449}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3013270804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3013270804},{"type":"v1","addr":"172.21.15.89:6835","nonce":3013270804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3825515993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3825515993},{"type":"v1","addr":"172.21.15.81:6836","nonce":3825515993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:43:43.620900+0000","modified":"2023-10-07T08:43:47.291987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6834/4005291324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":4005291324},{"type":"v1","addr":"172.21.15.89:6834","nonce":4005291324}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-07T08:43:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.461+0000 7f7fdffe3700 1 -- 172.21.15.81:0/2469593693 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7fbc066f30 msgr2=0x7f7fbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.461+0000 7f7fdffe3700 1 --2- 172.21.15.81:0/2469593693 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7fbc066f30 0x7f7fbc0693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7fd804c150 tx=0x7f7fd4018000 comp rx=0 tx=0).stop 2023-10-07T08:43:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.461+0000 7f7fdffe3700 1 -- 172.21.15.81:0/2469593693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fd81583b0 msgr2=0x7f7fd8152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.461+0000 7f7fdffe3700 1 --2- 172.21.15.81:0/2469593693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fd81583b0 0x7f7fd8152b70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000d860 tx=0x7f7fd0008040 comp rx=0 tx=0).stop 2023-10-07T08:43:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.461+0000 7f7fdffe3700 1 -- 172.21.15.81:0/2469593693 shutdown_connections 2023-10-07T08:43:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.461+0000 7f7fdffe3700 1 --2- 172.21.15.81:0/2469593693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fd81583b0 0x7f7fd8152b70 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.461+0000 7f7fdffe3700 1 --2- 172.21.15.81:0/2469593693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd80ceb30 0x7f7fd806e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.461+0000 7f7fdffe3700 1 --2- 172.21.15.81:0/2469593693 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7fbc066f30 0x7f7fbc0693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.461+0000 7f7fdffe3700 1 --2- 172.21.15.81:0/2469593693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd8157fe0 0x7f7fd81513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.461+0000 7f7fdffe3700 1 -- 172.21.15.81:0/2469593693 >> 172.21.15.81:0/2469593693 conn(0x7f7fd8067640 msgr2=0x7f7fd8154070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.461+0000 7f7fdffe3700 1 -- 172.21.15.81:0/2469593693 shutdown_connections 2023-10-07T08:43:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:56.461+0000 7f7fdffe3700 1 -- 172.21.15.81:0/2469593693 wait complete. 2023-10-07T08:43:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 15 2023-10-07T08:43:56.475 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json osdmap barrier 35 2023-10-07T08:43:56.619 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-07T08:43:56.621 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-07T08:43:56.621 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-07T08:43:56.621 DEBUG:teuthology.orchestra.run.smithi081:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-07T08:43:56.621 DEBUG:teuthology.orchestra.run.smithi081:> os.fchmod(fd, 0O666) 2023-10-07T08:43:56.621 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(fd) 2023-10-07T08:43:56.621 DEBUG:teuthology.orchestra.run.smithi081:> os.close(fd) 2023-10-07T08:43:56.622 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-07T08:43:56.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:43:56.875 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-07T08:43:56.943 INFO:teuthology.orchestra.run.smithi081.stdout:client5133 2023-10-07T08:43:56.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:56.943 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f2fc6535-cadc-4a0b-bdad-da2d602c784a.client5133/osdmap') 2023-10-07T08:43:57.018 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 35 barrier 35 flags 0x588000 2023-10-07T08:43:57.019 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:43:57.019 INFO:teuthology.orchestra.run.smithi081.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:43:57.019 INFO:teuthology.orchestra.run.smithi081.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:43:57.019 INFO:teuthology.orchestra.run.smithi081.stdout:osd0 (1)172.21.15.81:6801 100% (exists, up) 100% -1 2023-10-07T08:43:57.019 INFO:teuthology.orchestra.run.smithi081.stdout:osd1 (1)172.21.15.81:6819 100% (exists, up) 100% -1 2023-10-07T08:43:57.019 INFO:teuthology.orchestra.run.smithi081.stdout:osd2 (1)172.21.15.81:6818 100% (exists, up) 100% -1 2023-10-07T08:43:57.019 INFO:teuthology.orchestra.run.smithi081.stdout:osd3 (1)172.21.15.81:6809 100% (exists, up) 100% -1 2023-10-07T08:43:57.019 INFO:teuthology.orchestra.run.smithi081.stdout:osd4 (1)172.21.15.89:6801 100% (exists, up) 100% -1 2023-10-07T08:43:57.019 INFO:teuthology.orchestra.run.smithi081.stdout:osd5 (1)172.21.15.89:6817 100% (exists, up) 100% -1 2023-10-07T08:43:57.019 INFO:teuthology.orchestra.run.smithi081.stdout:osd6 (1)172.21.15.89:6824 100% (exists, up) 100% -1 2023-10-07T08:43:57.020 INFO:teuthology.orchestra.run.smithi081.stdout:osd7 (1)172.21.15.89:6809 100% (exists, up) 100% -1 2023-10-07T08:43:57.020 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records in 2023-10-07T08:43:57.020 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records out 2023-10-07T08:43:57.021 INFO:teuthology.orchestra.run.smithi081.stderr:791 bytes copied, 3.6162e-05 s, 21.9 MB/s 2023-10-07T08:43:57.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:43:57.021 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-07T08:43:57.089 INFO:teuthology.orchestra.run.smithi081.stdout:client5133 2023-10-07T08:43:57.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:57.089 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f2fc6535-cadc-4a0b-bdad-da2d602c784a.client5133/osdmap') 2023-10-07T08:43:57.165 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 35 barrier 35 flags 0x588000 2023-10-07T08:43:57.166 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:43:57.166 INFO:teuthology.orchestra.run.smithi081.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:43:57.166 INFO:teuthology.orchestra.run.smithi081.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:43:57.166 INFO:teuthology.orchestra.run.smithi081.stdout:osd0 (1)172.21.15.81:6801 100% (exists, up) 100% -1 2023-10-07T08:43:57.166 INFO:teuthology.orchestra.run.smithi081.stdout:osd1 (1)172.21.15.81:6819 100% (exists, up) 100% -1 2023-10-07T08:43:57.166 INFO:teuthology.orchestra.run.smithi081.stdout:osd2 (1)172.21.15.81:6818 100% (exists, up) 100% -1 2023-10-07T08:43:57.166 INFO:teuthology.orchestra.run.smithi081.stdout:osd3 (1)172.21.15.81:6809 100% (exists, up) 100% -1 2023-10-07T08:43:57.166 INFO:teuthology.orchestra.run.smithi081.stdout:osd4 (1)172.21.15.89:6801 100% (exists, up) 100% -1 2023-10-07T08:43:57.166 INFO:teuthology.orchestra.run.smithi081.stdout:osd5 (1)172.21.15.89:6817 100% (exists, up) 100% -1 2023-10-07T08:43:57.166 INFO:teuthology.orchestra.run.smithi081.stdout:osd6 (1)172.21.15.89:6824 100% (exists, up) 100% -1 2023-10-07T08:43:57.167 INFO:teuthology.orchestra.run.smithi081.stdout:osd7 (1)172.21.15.89:6809 100% (exists, up) 100% -1 2023-10-07T08:43:57.167 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records in 2023-10-07T08:43:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records out 2023-10-07T08:43:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:791 bytes copied, 3.2989e-05 s, 24.0 MB/s 2023-10-07T08:43:57.168 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-07T08:43:57.168 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:43:57.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:43:57.258 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:43:57.301 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:43:57.301 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T08:43:57.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:43:57.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T08:43:57.353 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:43:57.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:57.353 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T08:43:57.372 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T08:43:57.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:43:57.372 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T08:43:57.413 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:43:57.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:43:57.413 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T08:43:57.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:43:57.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.581+0000 7f745a622700 1 Processor -- start 2023-10-07T08:43:57.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.581+0000 7f745a622700 1 -- start start 2023-10-07T08:43:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.582+0000 7f745a622700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f745406d830 0x7f74540cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.582+0000 7f745a622700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74540d07c0 con 0x7f7454157ca0 2023-10-07T08:43:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.582+0000 7f745a622700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74540cfbb0 con 0x7f74541578d0 2023-10-07T08:43:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.582+0000 7f745a622700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74540cfe90 con 0x7f745406d830 2023-10-07T08:43:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.582+0000 7f7458bbf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f745406d830 0x7f74540cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.582+0000 7f74537fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7454157ca0 0x7f745406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59426/0 (socket says 172.21.15.81:59426) 2023-10-07T08:43:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.582+0000 7f74537fe700 1 -- 172.21.15.81:0/1891348921 learned_addr learned my addr 172.21.15.81:0/1891348921 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.582+0000 7f7458bbf700 1 -- 172.21.15.81:0/1891348921 >> v1:172.21.15.89:6789/0 conn(0x7f74541578d0 legacy=0x7f745415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.582+0000 7f7458bbf700 1 -- 172.21.15.81:0/1891348921 >> v1:172.21.15.81:6789/0 conn(0x7f7454157ca0 legacy=0x7f745406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.582+0000 7f7458bbf700 1 -- 172.21.15.81:0/1891348921 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74540d0170 con 0x7f745406d830 2023-10-07T08:43:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.582+0000 7f7452ffd700 1 -- 172.21.15.81:0/1891348921 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072102052 0 0) 0x7f74540d07c0 con 0x7f7454157ca0 2023-10-07T08:43:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.582+0000 7f7458bbf700 1 --2- 172.21.15.81:0/1891348921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745406d830 0x7f74540cf4f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f744c009e60 tx=0x7f744c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9365785487ea68a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.583+0000 7f7452ffd700 1 -- 172.21.15.81:0/1891348921 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c00e070 con 0x7f745406d830 2023-10-07T08:43:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.583+0000 7f7452ffd700 1 -- 172.21.15.81:0/1891348921 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c00bc30 con 0x7f745406d830 2023-10-07T08:43:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.583+0000 7f7452ffd700 1 -- 172.21.15.81:0/1891348921 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c012430 con 0x7f745406d830 2023-10-07T08:43:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.583+0000 7f745a622700 1 -- 172.21.15.81:0/1891348921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745406d830 msgr2=0x7f74540cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.583+0000 7f745a622700 1 --2- 172.21.15.81:0/1891348921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745406d830 0x7f74540cf4f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f744c009e60 tx=0x7f744c009780 comp rx=0 tx=0).stop 2023-10-07T08:43:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.583+0000 7f745a622700 1 -- 172.21.15.81:0/1891348921 shutdown_connections 2023-10-07T08:43:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.583+0000 7f745a622700 1 --2- 172.21.15.81:0/1891348921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745406d830 0x7f74540cf4f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.583+0000 7f745a622700 1 -- 172.21.15.81:0/1891348921 >> 172.21.15.81:0/1891348921 conn(0x7f745406bb90 msgr2=0x7f745406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.583+0000 7f745a622700 1 -- 172.21.15.81:0/1891348921 shutdown_connections 2023-10-07T08:43:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.583+0000 7f745a622700 1 -- 172.21.15.81:0/1891348921 wait complete. 2023-10-07T08:43:57.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.584+0000 7f745a622700 1 Processor -- start 2023-10-07T08:43:57.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.584+0000 7f745a622700 1 -- start start 2023-10-07T08:43:57.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f745a622700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745406d830 0x7f745414dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:57.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f745a622700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74541578d0 0x7f74540b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:57.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f745a622700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7454157ca0 0x7f7454155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:57.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f745a622700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74540b55b0 con 0x7f745406d830 2023-10-07T08:43:57.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f745a622700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745414e280 con 0x7f7454157ca0 2023-10-07T08:43:57.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f745a622700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7454152180 con 0x7f74541578d0 2023-10-07T08:43:57.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f7453fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745406d830 0x7f745414dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:57.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f7453fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745406d830 0x7f745414dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36440/0 (socket says 172.21.15.81:36440) 2023-10-07T08:43:57.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f7453fff700 1 -- 172.21.15.81:0/3786480712 learned_addr learned my addr 172.21.15.81:0/3786480712 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:57.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f7458bbf700 1 --2- 172.21.15.81:0/3786480712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7454157ca0 0x7f7454155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:57.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f74537fe700 1 --2- 172.21.15.81:0/3786480712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74541578d0 0x7f74540b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:57.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f7453fff700 1 -- 172.21.15.81:0/3786480712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74541578d0 msgr2=0x7f74540b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:57.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f7453fff700 1 --2- 172.21.15.81:0/3786480712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74541578d0 0x7f74540b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:57.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f7453fff700 1 -- 172.21.15.81:0/3786480712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7454157ca0 msgr2=0x7f7454155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:57.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f7453fff700 1 --2- 172.21.15.81:0/3786480712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7454157ca0 0x7f7454155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:57.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f7453fff700 1 -- 172.21.15.81:0/3786480712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c009a20 con 0x7f745406d830 2023-10-07T08:43:57.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.585+0000 7f7458bbf700 1 --2- 172.21.15.81:0/3786480712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7454157ca0 0x7f7454155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:57.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.586+0000 7f7453fff700 1 --2- 172.21.15.81:0/3786480712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745406d830 0x7f745414dd40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f744400c590 tx=0x7f744400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:57.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.586+0000 7f743bfff700 1 -- 172.21.15.81:0/3786480712 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7444011590 con 0x7f745406d830 2023-10-07T08:43:57.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.586+0000 7f743bfff700 1 -- 172.21.15.81:0/3786480712 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74440116f0 con 0x7f745406d830 2023-10-07T08:43:57.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.586+0000 7f745a622700 1 -- 172.21.15.81:0/3786480712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74540b52d0 con 0x7f745406d830 2023-10-07T08:43:57.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.586+0000 7f743bfff700 1 -- 172.21.15.81:0/3786480712 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7444011ab0 con 0x7f745406d830 2023-10-07T08:43:57.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.586+0000 7f745a622700 1 -- 172.21.15.81:0/3786480712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7454151e10 con 0x7f745406d830 2023-10-07T08:43:57.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.587+0000 7f745a622700 1 -- 172.21.15.81:0/3786480712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7454151990 con 0x7f745406d830 2023-10-07T08:43:57.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.587+0000 7f743bfff700 1 -- 172.21.15.81:0/3786480712 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f744401b3b0 con 0x7f745406d830 2023-10-07T08:43:57.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.587+0000 7f743bfff700 1 --2- 172.21.15.81:0/3786480712 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7440066f30 0x7f74400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:57.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.588+0000 7f743bfff700 1 -- 172.21.15.81:0/3786480712 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7444083b60 con 0x7f745406d830 2023-10-07T08:43:57.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.588+0000 7f74537fe700 1 --2- 172.21.15.81:0/3786480712 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7440066f30 0x7f74400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:57.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.588+0000 7f74537fe700 1 --2- 172.21.15.81:0/3786480712 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7440066f30 0x7f74400693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7454153810 tx=0x7f7448009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:57.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.592+0000 7f743bfff700 1 -- 172.21.15.81:0/3786480712 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7454151990 con 0x7f745406d830 2023-10-07T08:43:57.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.814+0000 7f745a622700 1 -- 172.21.15.81:0/3786480712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7454151990 con 0x7f745406d830 2023-10-07T08:43:57.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.815+0000 7f743bfff700 1 -- 172.21.15.81:0/3786480712 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f7454151990 con 0x7f745406d830 2023-10-07T08:43:57.816 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:57.817 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1843075449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1843075449},{"type":"v1","addr":"172.21.15.81:6837","nonce":1843075449}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3013270804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3013270804},{"type":"v1","addr":"172.21.15.89:6835","nonce":3013270804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3825515993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3825515993},{"type":"v1","addr":"172.21.15.81:6836","nonce":3825515993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:43:43.620900+0000","modified":"2023-10-07T08:43:47.291987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6834/4005291324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":4005291324},{"type":"v1","addr":"172.21.15.89:6834","nonce":4005291324}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-07T08:43:57.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.817+0000 7f745a622700 1 -- 172.21.15.81:0/3786480712 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7440066f30 msgr2=0x7f74400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.817+0000 7f745a622700 1 --2- 172.21.15.81:0/3786480712 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7440066f30 0x7f74400693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7454153810 tx=0x7f7448009040 comp rx=0 tx=0).stop 2023-10-07T08:43:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.817+0000 7f745a622700 1 -- 172.21.15.81:0/3786480712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745406d830 msgr2=0x7f745414dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.817+0000 7f745a622700 1 --2- 172.21.15.81:0/3786480712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745406d830 0x7f745414dd40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f744400c590 tx=0x7f744400c950 comp rx=0 tx=0).stop 2023-10-07T08:43:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.817+0000 7f745a622700 1 -- 172.21.15.81:0/3786480712 shutdown_connections 2023-10-07T08:43:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.817+0000 7f745a622700 1 --2- 172.21.15.81:0/3786480712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7454157ca0 0x7f7454155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.817+0000 7f745a622700 1 --2- 172.21.15.81:0/3786480712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745406d830 0x7f745414dd40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.817+0000 7f745a622700 1 --2- 172.21.15.81:0/3786480712 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7440066f30 0x7f74400693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.817+0000 7f745a622700 1 --2- 172.21.15.81:0/3786480712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74541578d0 0x7f74540b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.817+0000 7f745a622700 1 -- 172.21.15.81:0/3786480712 >> 172.21.15.81:0/3786480712 conn(0x7f745406bb90 msgr2=0x7f7454156090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.817+0000 7f745a622700 1 -- 172.21.15.81:0/3786480712 shutdown_connections 2023-10-07T08:43:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.817+0000 7f745a622700 1 -- 172.21.15.81:0/3786480712 wait complete. 2023-10-07T08:43:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 15 2023-10-07T08:43:57.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:57.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.942+0000 7f8284765700 1 Processor -- start 2023-10-07T08:43:57.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.942+0000 7f8284765700 1 -- start start 2023-10-07T08:43:57.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.943+0000 7f8284765700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f827c157ca0 0x7f827c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:57.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.943+0000 7f8284765700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827c0d07c0 con 0x7f827c1578d0 2023-10-07T08:43:57.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.943+0000 7f8284765700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827c0cfbb0 con 0x7f827c06d120 2023-10-07T08:43:57.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.943+0000 7f8284765700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827c0cfe90 con 0x7f827c157ca0 2023-10-07T08:43:57.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.943+0000 7f8281d00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f827c157ca0 0x7f827c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:57.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.943+0000 7f8282501700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f827c1578d0 0x7f827c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59434/0 (socket says 172.21.15.81:59434) 2023-10-07T08:43:57.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.943+0000 7f8282501700 1 -- 172.21.15.81:0/233016739 learned_addr learned my addr 172.21.15.81:0/233016739 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.943+0000 7f8281d00700 1 -- 172.21.15.81:0/233016739 >> v1:172.21.15.89:6789/0 conn(0x7f827c06d120 legacy=0x7f827c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.943+0000 7f8281d00700 1 -- 172.21.15.81:0/233016739 >> v1:172.21.15.81:6789/0 conn(0x7f827c1578d0 legacy=0x7f827c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.944+0000 7f8281d00700 1 -- 172.21.15.81:0/233016739 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c0d0170 con 0x7f827c157ca0 2023-10-07T08:43:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.943+0000 7f82814ff700 1 -- 172.21.15.81:0/233016739 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176990049 0 0) 0x7f827c0d07c0 con 0x7f827c1578d0 2023-10-07T08:43:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.944+0000 7f8281d00700 1 --2- 172.21.15.81:0/233016739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827c157ca0 0x7f827c0cf4f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f826c0098e0 tx=0x7f826c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f175c6bf10e69f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.944+0000 7f82814ff700 1 -- 172.21.15.81:0/233016739 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c009e80 con 0x7f827c157ca0 2023-10-07T08:43:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.944+0000 7f82814ff700 1 -- 172.21.15.81:0/233016739 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c00b820 con 0x7f827c157ca0 2023-10-07T08:43:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.944+0000 7f82814ff700 1 -- 172.21.15.81:0/233016739 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c00bba0 con 0x7f827c157ca0 2023-10-07T08:43:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.944+0000 7f8284765700 1 -- 172.21.15.81:0/233016739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827c157ca0 msgr2=0x7f827c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.944+0000 7f8284765700 1 --2- 172.21.15.81:0/233016739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827c157ca0 0x7f827c0cf4f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f826c0098e0 tx=0x7f826c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.944+0000 7f8284765700 1 -- 172.21.15.81:0/233016739 shutdown_connections 2023-10-07T08:43:57.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.944+0000 7f8284765700 1 --2- 172.21.15.81:0/233016739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827c157ca0 0x7f827c0cf4f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:57.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.944+0000 7f8284765700 1 -- 172.21.15.81:0/233016739 >> 172.21.15.81:0/233016739 conn(0x7f827c06bb90 msgr2=0x7f827c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:57.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.944+0000 7f8284765700 1 -- 172.21.15.81:0/233016739 shutdown_connections 2023-10-07T08:43:57.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.944+0000 7f8284765700 1 -- 172.21.15.81:0/233016739 wait complete. 2023-10-07T08:43:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.945+0000 7f8284765700 1 Processor -- start 2023-10-07T08:43:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.946+0000 7f8284765700 1 -- start start 2023-10-07T08:43:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.946+0000 7f8284765700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827c06d120 0x7f827c13a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.946+0000 7f8284765700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f827c1578d0 0x7f827c151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.946+0000 7f8284765700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f827c157ca0 0x7f827c1565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.946+0000 7f8284765700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c13ab40 con 0x7f827c06d120 2023-10-07T08:43:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.946+0000 7f8284765700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c13a810 con 0x7f827c1578d0 2023-10-07T08:43:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.946+0000 7f8284765700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827c152590 con 0x7f827c157ca0 2023-10-07T08:43:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.946+0000 7f8282501700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827c06d120 0x7f827c13a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.946+0000 7f8282501700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827c06d120 0x7f827c13a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36454/0 (socket says 172.21.15.81:36454) 2023-10-07T08:43:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.946+0000 7f8282501700 1 -- 172.21.15.81:0/3516977613 learned_addr learned my addr 172.21.15.81:0/3516977613 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.947+0000 7f8281d00700 1 --2- 172.21.15.81:0/3516977613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f827c1578d0 0x7f827c151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.947+0000 7f8282d02700 1 --2- 172.21.15.81:0/3516977613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f827c157ca0 0x7f827c1565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.947+0000 7f8282501700 1 -- 172.21.15.81:0/3516977613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f827c157ca0 msgr2=0x7f827c1565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.947+0000 7f8282501700 1 --2- 172.21.15.81:0/3516977613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f827c157ca0 0x7f827c1565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.947+0000 7f8282501700 1 -- 172.21.15.81:0/3516977613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f827c1578d0 msgr2=0x7f827c151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.947+0000 7f8282501700 1 --2- 172.21.15.81:0/3516977613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f827c1578d0 0x7f827c151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.947+0000 7f8282501700 1 -- 172.21.15.81:0/3516977613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c009420 con 0x7f827c06d120 2023-10-07T08:43:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.947+0000 7f8281d00700 1 --2- 172.21.15.81:0/3516977613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f827c1578d0 0x7f827c151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.947+0000 7f8282d02700 1 --2- 172.21.15.81:0/3516977613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f827c157ca0 0x7f827c1565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.947+0000 7f8282501700 1 --2- 172.21.15.81:0/3516977613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827c06d120 0x7f827c13a0b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f827800c7e0 tx=0x7f8278007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.947+0000 7f82727fc700 1 -- 172.21.15.81:0/3516977613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8278005b30 con 0x7f827c06d120 2023-10-07T08:43:57.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.947+0000 7f82727fc700 1 -- 172.21.15.81:0/3516977613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8278005c90 con 0x7f827c06d120 2023-10-07T08:43:57.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.947+0000 7f8284765700 1 -- 172.21.15.81:0/3516977613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827c152870 con 0x7f827c06d120 2023-10-07T08:43:57.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.947+0000 7f82727fc700 1 -- 172.21.15.81:0/3516977613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8278007300 con 0x7f827c06d120 2023-10-07T08:43:57.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.947+0000 7f8284765700 1 -- 172.21.15.81:0/3516977613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827c14f9e0 con 0x7f827c06d120 2023-10-07T08:43:57.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.948+0000 7f8284765700 1 -- 172.21.15.81:0/3516977613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f827c14fc30 con 0x7f827c06d120 2023-10-07T08:43:57.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.948+0000 7f82727fc700 1 -- 172.21.15.81:0/3516977613 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f827801b400 con 0x7f827c06d120 2023-10-07T08:43:57.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.949+0000 7f82727fc700 1 --2- 172.21.15.81:0/3516977613 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8260066f30 0x7f82600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:57.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.949+0000 7f82727fc700 1 -- 172.21.15.81:0/3516977613 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8278084040 con 0x7f827c06d120 2023-10-07T08:43:57.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.949+0000 7f8281d00700 1 --2- 172.21.15.81:0/3516977613 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8260066f30 0x7f82600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:57.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.949+0000 7f8281d00700 1 --2- 172.21.15.81:0/3516977613 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8260066f30 0x7f82600693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f827c1580c0 tx=0x7f826c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:57.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:57.953+0000 7f82727fc700 1 -- 172.21.15.81:0/3516977613 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8278051330 con 0x7f827c06d120 2023-10-07T08:43:58.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.137+0000 7f8284765700 1 -- 172.21.15.81:0/3516977613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f827c0d0450 con 0x7f827c06d120 2023-10-07T08:43:58.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.138+0000 7f82727fc700 1 -- 172.21.15.81:0/3516977613 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f8278054950 con 0x7f827c06d120 2023-10-07T08:43:58.140 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:58.140 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":35,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:43:55.325199+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:43:41.595379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-07T08:43:42.590185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:58.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.140+0000 7f8284765700 1 -- 172.21.15.81:0/3516977613 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8260066f30 msgr2=0x7f82600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.140+0000 7f8284765700 1 --2- 172.21.15.81:0/3516977613 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8260066f30 0x7f82600693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f827c1580c0 tx=0x7f826c016000 comp rx=0 tx=0).stop 2023-10-07T08:43:58.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.140+0000 7f8284765700 1 -- 172.21.15.81:0/3516977613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827c06d120 msgr2=0x7f827c13a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.140+0000 7f8284765700 1 --2- 172.21.15.81:0/3516977613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827c06d120 0x7f827c13a0b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f827800c7e0 tx=0x7f8278007df0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.140+0000 7f8284765700 1 -- 172.21.15.81:0/3516977613 shutdown_connections 2023-10-07T08:43:58.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.140+0000 7f8284765700 1 --2- 172.21.15.81:0/3516977613 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8260066f30 0x7f82600693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.140+0000 7f8284765700 1 --2- 172.21.15.81:0/3516977613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f827c157ca0 0x7f827c1565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.140+0000 7f8284765700 1 --2- 172.21.15.81:0/3516977613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827c06d120 0x7f827c13a0b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.140+0000 7f8284765700 1 --2- 172.21.15.81:0/3516977613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f827c1578d0 0x7f827c151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.140+0000 7f8284765700 1 -- 172.21.15.81:0/3516977613 >> 172.21.15.81:0/3516977613 conn(0x7f827c06bb90 msgr2=0x7f827c155970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:58.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.140+0000 7f8284765700 1 -- 172.21.15.81:0/3516977613 shutdown_connections 2023-10-07T08:43:58.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.140+0000 7f8284765700 1 -- 172.21.15.81:0/3516977613 wait complete. 2023-10-07T08:43:58.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:43:41.595379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:43:42.590185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:43:58.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:43:58.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.269+0000 7feeb72f2700 1 Processor -- start 2023-10-07T08:43:58.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.269+0000 7feeb72f2700 1 -- start start 2023-10-07T08:43:58.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.270+0000 7feeb72f2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb01578d0 0x7feeb00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.270+0000 7feeb72f2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feeb006d120 0x7feeb006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.270+0000 7feeb72f2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb006dac0 con 0x7feeb0157ca0 2023-10-07T08:43:58.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.270+0000 7feeb72f2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb00d07c0 con 0x7feeb006d120 2023-10-07T08:43:58.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.270+0000 7feeb72f2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00cfbb0 con 0x7feeb01578d0 2023-10-07T08:43:58.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.270+0000 7feeb588f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feeb006d120 0x7feeb006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.270+0000 7feeb588f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feeb006d120 0x7feeb006d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36464/0 (socket says 172.21.15.81:36464) 2023-10-07T08:43:58.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.270+0000 7feeb588f700 1 -- 172.21.15.81:0/2447566583 learned_addr learned my addr 172.21.15.81:0/2447566583 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:58.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.271+0000 7feeb508e700 1 --2- 172.21.15.81:0/2447566583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb01578d0 0x7feeb00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.271+0000 7feeb588f700 1 -- 172.21.15.81:0/2447566583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb01578d0 msgr2=0x7feeb00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:58.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.271+0000 7feeb588f700 1 --2- 172.21.15.81:0/2447566583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb01578d0 0x7feeb00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.271+0000 7feeb588f700 1 -- 172.21.15.81:0/2447566583 >> v1:172.21.15.89:6789/0 conn(0x7feeb0157ca0 legacy=0x7feeb015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:58.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.271+0000 7feeb588f700 1 -- 172.21.15.81:0/2447566583 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb00cfe90 con 0x7feeb006d120 2023-10-07T08:43:58.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.271+0000 7feeb588f700 1 --2- 172.21.15.81:0/2447566583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb006d120 0x7feeb006d580 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7feea8009f20 tx=0x7feea8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf968614c852fba server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:58.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.271+0000 7feea7fff700 1 -- 172.21.15.81:0/2447566583 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea800e070 con 0x7feeb006d120 2023-10-07T08:43:58.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.271+0000 7feea7fff700 1 -- 172.21.15.81:0/2447566583 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea800ba40 con 0x7feeb006d120 2023-10-07T08:43:58.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.271+0000 7feea7fff700 1 -- 172.21.15.81:0/2447566583 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea80092e0 con 0x7feeb006d120 2023-10-07T08:43:58.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.271+0000 7feeb72f2700 1 -- 172.21.15.81:0/2447566583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb006d120 msgr2=0x7feeb006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.271+0000 7feeb72f2700 1 --2- 172.21.15.81:0/2447566583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb006d120 0x7feeb006d580 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7feea8009f20 tx=0x7feea8009840 comp rx=0 tx=0).stop 2023-10-07T08:43:58.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.272+0000 7feeb72f2700 1 -- 172.21.15.81:0/2447566583 shutdown_connections 2023-10-07T08:43:58.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.272+0000 7feeb72f2700 1 --2- 172.21.15.81:0/2447566583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb006d120 0x7feeb006d580 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.272+0000 7feeb72f2700 1 --2- 172.21.15.81:0/2447566583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb01578d0 0x7feeb00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.272+0000 7feeb72f2700 1 -- 172.21.15.81:0/2447566583 >> 172.21.15.81:0/2447566583 conn(0x7feeb006bb90 msgr2=0x7feeb006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:58.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.272+0000 7feeb72f2700 1 -- 172.21.15.81:0/2447566583 shutdown_connections 2023-10-07T08:43:58.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.272+0000 7feeb72f2700 1 -- 172.21.15.81:0/2447566583 wait complete. 2023-10-07T08:43:58.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.273+0000 7feeb72f2700 1 Processor -- start 2023-10-07T08:43:58.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.273+0000 7feeb72f2700 1 -- start start 2023-10-07T08:43:58.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb72f2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb006d120 0x7feeb0151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb72f2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feeb01578d0 0x7feeb014cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb72f2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb0157ca0 0x7feeb0158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb72f2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb014f920 con 0x7feeb0157ca0 2023-10-07T08:43:58.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb72f2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0152700 con 0x7feeb01578d0 2023-10-07T08:43:58.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb72f2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb014eff0 con 0x7feeb006d120 2023-10-07T08:43:58.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb588f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb0157ca0 0x7feeb0158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb588f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb0157ca0 0x7feeb0158490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36478/0 (socket says 172.21.15.81:36478) 2023-10-07T08:43:58.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb588f700 1 -- 172.21.15.81:0/2164404971 learned_addr learned my addr 172.21.15.81:0/2164404971 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:58.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb488d700 1 --2- 172.21.15.81:0/2164404971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feeb01578d0 0x7feeb014cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb508e700 1 --2- 172.21.15.81:0/2164404971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb006d120 0x7feeb0151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb588f700 1 -- 172.21.15.81:0/2164404971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb006d120 msgr2=0x7feeb0151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb588f700 1 --2- 172.21.15.81:0/2164404971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb006d120 0x7feeb0151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb588f700 1 -- 172.21.15.81:0/2164404971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feeb01578d0 msgr2=0x7feeb014cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb588f700 1 --2- 172.21.15.81:0/2164404971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feeb01578d0 0x7feeb014cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb588f700 1 -- 172.21.15.81:0/2164404971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea8009ae0 con 0x7feeb0157ca0 2023-10-07T08:43:58.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb488d700 1 --2- 172.21.15.81:0/2164404971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feeb01578d0 0x7feeb014cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:58.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb588f700 1 --2- 172.21.15.81:0/2164404971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb0157ca0 0x7feeb0158490 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7feeb006fe20 tx=0x7feea8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feea57fa700 1 -- 172.21.15.81:0/2164404971 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8012e60 con 0x7feeb0157ca0 2023-10-07T08:43:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feea57fa700 1 -- 172.21.15.81:0/2164404971 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea801d420 con 0x7feeb0157ca0 2023-10-07T08:43:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb72f2700 1 -- 172.21.15.81:0/2164404971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb014f2d0 con 0x7feeb0157ca0 2023-10-07T08:43:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feea57fa700 1 -- 172.21.15.81:0/2164404971 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea801d7e0 con 0x7feeb0157ca0 2023-10-07T08:43:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.274+0000 7feeb72f2700 1 -- 172.21.15.81:0/2164404971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb0152410 con 0x7feeb0157ca0 2023-10-07T08:43:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.275+0000 7feeb72f2700 1 -- 172.21.15.81:0/2164404971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb014fad0 con 0x7feeb0157ca0 2023-10-07T08:43:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.276+0000 7feea57fa700 1 -- 172.21.15.81:0/2164404971 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feea801db90 con 0x7feeb0157ca0 2023-10-07T08:43:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.276+0000 7feea57fa700 1 --2- 172.21.15.81:0/2164404971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee94066f30 0x7fee940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.276+0000 7feeb508e700 1 --2- 172.21.15.81:0/2164404971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee94066f30 0x7fee940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.276+0000 7feea57fa700 1 -- 172.21.15.81:0/2164404971 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feea8085d00 con 0x7feeb0157ca0 2023-10-07T08:43:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.276+0000 7feeb508e700 1 --2- 172.21.15.81:0/2164404971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee94066f30 0x7fee940693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feeac00ab30 tx=0x7feeac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:58.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.280+0000 7feea57fa700 1 -- 172.21.15.81:0/2164404971 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feeb014fad0 con 0x7feeb0157ca0 2023-10-07T08:43:58.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.462+0000 7feeb72f2700 1 -- 172.21.15.81:0/2164404971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feeb006dac0 con 0x7feeb0157ca0 2023-10-07T08:43:58.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.463+0000 7feea57fa700 1 -- 172.21.15.81:0/2164404971 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7feeb006dac0 con 0x7feeb0157ca0 2023-10-07T08:43:58.466 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:43:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.465+0000 7feeb72f2700 1 -- 172.21.15.81:0/2164404971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee94066f30 msgr2=0x7fee940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.465+0000 7feeb72f2700 1 --2- 172.21.15.81:0/2164404971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee94066f30 0x7fee940693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feeac00ab30 tx=0x7feeac008040 comp rx=0 tx=0).stop 2023-10-07T08:43:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.465+0000 7feeb72f2700 1 -- 172.21.15.81:0/2164404971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb0157ca0 msgr2=0x7feeb0158490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.465+0000 7feeb72f2700 1 --2- 172.21.15.81:0/2164404971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb0157ca0 0x7feeb0158490 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7feeb006fe20 tx=0x7feea8017000 comp rx=0 tx=0).stop 2023-10-07T08:43:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.465+0000 7feeb72f2700 1 -- 172.21.15.81:0/2164404971 shutdown_connections 2023-10-07T08:43:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.465+0000 7feeb72f2700 1 --2- 172.21.15.81:0/2164404971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb0157ca0 0x7feeb0158490 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.465+0000 7feeb72f2700 1 --2- 172.21.15.81:0/2164404971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee94066f30 0x7fee940693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.465+0000 7feeb72f2700 1 --2- 172.21.15.81:0/2164404971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb006d120 0x7feeb0151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.465+0000 7feeb72f2700 1 --2- 172.21.15.81:0/2164404971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feeb01578d0 0x7feeb014cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.465+0000 7feeb72f2700 1 -- 172.21.15.81:0/2164404971 >> 172.21.15.81:0/2164404971 conn(0x7feeb006bb90 msgr2=0x7feeb015b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.465+0000 7feeb72f2700 1 -- 172.21.15.81:0/2164404971 shutdown_connections 2023-10-07T08:43:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.465+0000 7feeb72f2700 1 -- 172.21.15.81:0/2164404971 wait complete. 2023-10-07T08:43:58.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:43:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.594+0000 7f5bac501700 1 Processor -- start 2023-10-07T08:43:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.594+0000 7f5bac501700 1 -- start start 2023-10-07T08:43:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.595+0000 7f5bac501700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ba40b3bd0 0x7f5ba40ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.595+0000 7f5bac501700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba40b2890 con 0x7f5ba4157fe0 2023-10-07T08:43:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.595+0000 7f5bac501700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba40b4070 con 0x7f5ba41583b0 2023-10-07T08:43:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.595+0000 7f5bac501700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba40b4350 con 0x7f5ba40b3bd0 2023-10-07T08:43:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.595+0000 7f5ba9a9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ba40b3bd0 0x7f5ba40ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.595+0000 7f5baa29d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5ba4157fe0 0x7f5ba40b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59442/0 (socket says 172.21.15.81:59442) 2023-10-07T08:43:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.595+0000 7f5baa29d700 1 -- 172.21.15.81:0/767599727 learned_addr learned my addr 172.21.15.81:0/767599727 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.596+0000 7f5ba9a9c700 1 -- 172.21.15.81:0/767599727 >> v1:172.21.15.89:6789/0 conn(0x7f5ba41583b0 legacy=0x7f5ba4158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.596+0000 7f5ba9a9c700 1 -- 172.21.15.81:0/767599727 >> v1:172.21.15.81:6789/0 conn(0x7f5ba4157fe0 legacy=0x7f5ba40b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.596+0000 7f5ba9a9c700 1 -- 172.21.15.81:0/767599727 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba40b4630 con 0x7f5ba40b3bd0 2023-10-07T08:43:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.596+0000 7f5ba9a9c700 1 --2- 172.21.15.81:0/767599727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba40b3bd0 0x7f5ba40ceb30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5b940098e0 tx=0x7f5b940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ef8edd255dba4d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.596+0000 7f5ba929b700 1 -- 172.21.15.81:0/767599727 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94009e80 con 0x7f5ba40b3bd0 2023-10-07T08:43:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.596+0000 7f5ba929b700 1 -- 172.21.15.81:0/767599727 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9400b860 con 0x7f5ba40b3bd0 2023-10-07T08:43:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.596+0000 7f5ba929b700 1 -- 172.21.15.81:0/767599727 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9400bbe0 con 0x7f5ba40b3bd0 2023-10-07T08:43:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.596+0000 7f5bac501700 1 -- 172.21.15.81:0/767599727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba40b3bd0 msgr2=0x7f5ba40ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.596+0000 7f5bac501700 1 --2- 172.21.15.81:0/767599727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba40b3bd0 0x7f5ba40ceb30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5b940098e0 tx=0x7f5b940091a0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.596+0000 7f5bac501700 1 -- 172.21.15.81:0/767599727 shutdown_connections 2023-10-07T08:43:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.596+0000 7f5bac501700 1 --2- 172.21.15.81:0/767599727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba40b3bd0 0x7f5ba40ceb30 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.596+0000 7f5bac501700 1 -- 172.21.15.81:0/767599727 >> 172.21.15.81:0/767599727 conn(0x7f5ba4067640 msgr2=0x7f5ba4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.597+0000 7f5bac501700 1 -- 172.21.15.81:0/767599727 shutdown_connections 2023-10-07T08:43:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.597+0000 7f5bac501700 1 -- 172.21.15.81:0/767599727 wait complete. 2023-10-07T08:43:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.598+0000 7f5bac501700 1 Processor -- start 2023-10-07T08:43:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.598+0000 7f5bac501700 1 -- start start 2023-10-07T08:43:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.598+0000 7f5bac501700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ba40b3bd0 0x7f5ba415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.598+0000 7f5bac501700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba4157fe0 0x7f5ba4148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.598+0000 7f5bac501700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba41583b0 0x7f5ba40ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.598+0000 7f5bac501700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba415a110 con 0x7f5ba4157fe0 2023-10-07T08:43:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.598+0000 7f5bac501700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba41490e0 con 0x7f5ba40b3bd0 2023-10-07T08:43:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.598+0000 7f5bac501700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba415c950 con 0x7f5ba41583b0 2023-10-07T08:43:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.598+0000 7f5ba9a9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba4157fe0 0x7f5ba4148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.598+0000 7f5ba9a9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba4157fe0 0x7f5ba4148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36492/0 (socket says 172.21.15.81:36492) 2023-10-07T08:43:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.598+0000 7f5ba9a9c700 1 -- 172.21.15.81:0/507249921 learned_addr learned my addr 172.21.15.81:0/507249921 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.599+0000 7f5baa29d700 1 --2- 172.21.15.81:0/507249921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ba40b3bd0 0x7f5ba415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.599+0000 7f5baaa9e700 1 --2- 172.21.15.81:0/507249921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba41583b0 0x7f5ba40ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.599+0000 7f5ba9a9c700 1 -- 172.21.15.81:0/507249921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba41583b0 msgr2=0x7f5ba40ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.599+0000 7f5ba9a9c700 1 --2- 172.21.15.81:0/507249921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba41583b0 0x7f5ba40ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.599+0000 7f5ba9a9c700 1 -- 172.21.15.81:0/507249921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ba40b3bd0 msgr2=0x7f5ba415d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.599+0000 7f5ba9a9c700 1 --2- 172.21.15.81:0/507249921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ba40b3bd0 0x7f5ba415d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.599+0000 7f5ba9a9c700 1 -- 172.21.15.81:0/507249921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b94009420 con 0x7f5ba4157fe0 2023-10-07T08:43:58.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.599+0000 7f5baaa9e700 1 --2- 172.21.15.81:0/507249921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba41583b0 0x7f5ba40ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:43:58.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.599+0000 7f5ba9a9c700 1 --2- 172.21.15.81:0/507249921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba4157fe0 0x7f5ba4148ba0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5b940030c0 tx=0x7f5b94016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:58.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.599+0000 7f5b9a7fc700 1 -- 172.21.15.81:0/507249921 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9400bad0 con 0x7f5ba4157fe0 2023-10-07T08:43:58.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.599+0000 7f5b9a7fc700 1 -- 172.21.15.81:0/507249921 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b94020070 con 0x7f5ba4157fe0 2023-10-07T08:43:58.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.599+0000 7f5bac501700 1 -- 172.21.15.81:0/507249921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba415cc30 con 0x7f5ba4157fe0 2023-10-07T08:43:58.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.599+0000 7f5b9a7fc700 1 -- 172.21.15.81:0/507249921 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9401b680 con 0x7f5ba4157fe0 2023-10-07T08:43:58.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.599+0000 7f5bac501700 1 -- 172.21.15.81:0/507249921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba415d1f0 con 0x7f5ba4157fe0 2023-10-07T08:43:58.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.600+0000 7f5bac501700 1 -- 172.21.15.81:0/507249921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba4069e40 con 0x7f5ba4157fe0 2023-10-07T08:43:58.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.600+0000 7f5b9a7fc700 1 -- 172.21.15.81:0/507249921 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b94022030 con 0x7f5ba4157fe0 2023-10-07T08:43:58.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.601+0000 7f5b9a7fc700 1 --2- 172.21.15.81:0/507249921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5b88066f30 0x7f5b880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.601+0000 7f5b9a7fc700 1 -- 172.21.15.81:0/507249921 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b94086460 con 0x7f5ba4157fe0 2023-10-07T08:43:58.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.601+0000 7f5baa29d700 1 --2- 172.21.15.81:0/507249921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5b88066f30 0x7f5b880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.601+0000 7f5baa29d700 1 --2- 172.21.15.81:0/507249921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5b88066f30 0x7f5b880693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000e160 tx=0x7f5ba0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:58.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.605+0000 7f5b9a7fc700 1 -- 172.21.15.81:0/507249921 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b940536d0 con 0x7f5ba4157fe0 2023-10-07T08:43:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.784+0000 7f5bac501700 1 -- 172.21.15.81:0/507249921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ba40cc6b0 con 0x7f5ba4157fe0 2023-10-07T08:43:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.784+0000 7f5b9a7fc700 1 -- 172.21.15.81:0/507249921 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5b94056cf0 con 0x7f5ba4157fe0 2023-10-07T08:43:58.786 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:43:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.786+0000 7f5bac501700 1 -- 172.21.15.81:0/507249921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5b88066f30 msgr2=0x7f5b880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.786+0000 7f5bac501700 1 --2- 172.21.15.81:0/507249921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5b88066f30 0x7f5b880693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000e160 tx=0x7f5ba0009040 comp rx=0 tx=0).stop 2023-10-07T08:43:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.786+0000 7f5bac501700 1 -- 172.21.15.81:0/507249921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba4157fe0 msgr2=0x7f5ba4148ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.786+0000 7f5bac501700 1 --2- 172.21.15.81:0/507249921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba4157fe0 0x7f5ba4148ba0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5b940030c0 tx=0x7f5b94016000 comp rx=0 tx=0).stop 2023-10-07T08:43:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.786+0000 7f5bac501700 1 -- 172.21.15.81:0/507249921 shutdown_connections 2023-10-07T08:43:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.786+0000 7f5bac501700 1 --2- 172.21.15.81:0/507249921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5b88066f30 0x7f5b880693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.786+0000 7f5bac501700 1 --2- 172.21.15.81:0/507249921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ba41583b0 0x7f5ba40ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.786+0000 7f5bac501700 1 --2- 172.21.15.81:0/507249921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ba40b3bd0 0x7f5ba415d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.786+0000 7f5bac501700 1 --2- 172.21.15.81:0/507249921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba4157fe0 0x7f5ba4148ba0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.786+0000 7f5bac501700 1 -- 172.21.15.81:0/507249921 >> 172.21.15.81:0/507249921 conn(0x7f5ba4067640 msgr2=0x7f5ba40cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:58.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.786+0000 7f5bac501700 1 -- 172.21.15.81:0/507249921 shutdown_connections 2023-10-07T08:43:58.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.786+0000 7f5bac501700 1 -- 172.21.15.81:0/507249921 wait complete. 2023-10-07T08:43:58.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:43:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.914+0000 7ff1d895d700 1 Processor -- start 2023-10-07T08:43:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.914+0000 7ff1d895d700 1 -- start start 2023-10-07T08:43:58.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.915+0000 7ff1d895d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1d41578d0 0x7ff1d40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.915+0000 7ff1d895d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1d406d120 0x7ff1d406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.915+0000 7ff1d895d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d406dac0 con 0x7ff1d4157ca0 2023-10-07T08:43:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.915+0000 7ff1d895d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1d40d07c0 con 0x7ff1d406d120 2023-10-07T08:43:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.915+0000 7ff1d895d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d40cfbb0 con 0x7ff1d41578d0 2023-10-07T08:43:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.915+0000 7ff1d2d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1d406d120 0x7ff1d406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.915+0000 7ff1c9d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff1d4157ca0 0x7ff1d415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59452/0 (socket says 172.21.15.81:59452) 2023-10-07T08:43:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.915+0000 7ff1c9d9b700 1 -- 172.21.15.81:0/566798206 learned_addr learned my addr 172.21.15.81:0/566798206 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.915+0000 7ff1d259c700 1 --2- 172.21.15.81:0/566798206 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1d41578d0 0x7ff1d40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.915+0000 7ff1d2d9d700 1 -- 172.21.15.81:0/566798206 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1d41578d0 msgr2=0x7ff1d40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.915+0000 7ff1d2d9d700 1 --2- 172.21.15.81:0/566798206 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1d41578d0 0x7ff1d40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.915+0000 7ff1d2d9d700 1 -- 172.21.15.81:0/566798206 >> v1:172.21.15.81:6789/0 conn(0x7ff1d4157ca0 legacy=0x7ff1d415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.915+0000 7ff1d2d9d700 1 -- 172.21.15.81:0/566798206 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d40cfe90 con 0x7ff1d406d120 2023-10-07T08:43:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.915+0000 7ff1d1d9b700 1 -- 172.21.15.81:0/566798206 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788748965 0 0) 0x7ff1bc001110 con 0x7ff1d4157ca0 2023-10-07T08:43:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.915+0000 7ff1d2d9d700 1 --2- 172.21.15.81:0/566798206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d406d120 0x7ff1d406d580 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009e60 tx=0x7ff1cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e6665d58fc2d31 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.915+0000 7ff1d1d9b700 1 -- 172.21.15.81:0/566798206 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc00e070 con 0x7ff1d406d120 2023-10-07T08:43:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.916+0000 7ff1d1d9b700 1 -- 172.21.15.81:0/566798206 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1cc00bc30 con 0x7ff1d406d120 2023-10-07T08:43:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.916+0000 7ff1d1d9b700 1 -- 172.21.15.81:0/566798206 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc012430 con 0x7ff1d406d120 2023-10-07T08:43:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.916+0000 7ff1d895d700 1 -- 172.21.15.81:0/566798206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d406d120 msgr2=0x7ff1d406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.916+0000 7ff1d895d700 1 --2- 172.21.15.81:0/566798206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d406d120 0x7ff1d406d580 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009e60 tx=0x7ff1cc009780 comp rx=0 tx=0).stop 2023-10-07T08:43:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.916+0000 7ff1d895d700 1 -- 172.21.15.81:0/566798206 shutdown_connections 2023-10-07T08:43:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.916+0000 7ff1d895d700 1 --2- 172.21.15.81:0/566798206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d406d120 0x7ff1d406d580 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.916+0000 7ff1d895d700 1 --2- 172.21.15.81:0/566798206 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1d41578d0 0x7ff1d40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.916+0000 7ff1d895d700 1 -- 172.21.15.81:0/566798206 >> 172.21.15.81:0/566798206 conn(0x7ff1d406bb90 msgr2=0x7ff1d406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:58.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.916+0000 7ff1d895d700 1 -- 172.21.15.81:0/566798206 shutdown_connections 2023-10-07T08:43:58.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.916+0000 7ff1d895d700 1 -- 172.21.15.81:0/566798206 wait complete. 2023-10-07T08:43:58.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.917+0000 7ff1d895d700 1 Processor -- start 2023-10-07T08:43:58.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.917+0000 7ff1d895d700 1 -- start start 2023-10-07T08:43:58.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.918+0000 7ff1d895d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d406d120 0x7ff1d4154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.918+0000 7ff1d895d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1d41578d0 0x7ff1d40accb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.918+0000 7ff1d895d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d4157ca0 0x7ff1d4068dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.918+0000 7ff1d895d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d40ad1f0 con 0x7ff1d4157ca0 2023-10-07T08:43:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.918+0000 7ff1d895d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d40ab410 con 0x7ff1d406d120 2023-10-07T08:43:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.918+0000 7ff1d895d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d4069310 con 0x7ff1d41578d0 2023-10-07T08:43:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.918+0000 7ff1d2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d4157ca0 0x7ff1d4068dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.918+0000 7ff1d2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d4157ca0 0x7ff1d4068dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36508/0 (socket says 172.21.15.81:36508) 2023-10-07T08:43:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.918+0000 7ff1d2d9d700 1 -- 172.21.15.81:0/1258185893 learned_addr learned my addr 172.21.15.81:0/1258185893 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.918+0000 7ff1c9d9b700 1 --2- 172.21.15.81:0/1258185893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1d41578d0 0x7ff1d40accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.918+0000 7ff1d259c700 1 --2- 172.21.15.81:0/1258185893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d406d120 0x7ff1d4154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.918+0000 7ff1d2d9d700 1 -- 172.21.15.81:0/1258185893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1d41578d0 msgr2=0x7ff1d40accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.918+0000 7ff1d2d9d700 1 --2- 172.21.15.81:0/1258185893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1d41578d0 0x7ff1d40accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.918+0000 7ff1d2d9d700 1 -- 172.21.15.81:0/1258185893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d406d120 msgr2=0x7ff1d4154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.918+0000 7ff1d2d9d700 1 --2- 172.21.15.81:0/1258185893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d406d120 0x7ff1d4154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.918+0000 7ff1d2d9d700 1 -- 172.21.15.81:0/1258185893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc009a20 con 0x7ff1d4157ca0 2023-10-07T08:43:58.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.919+0000 7ff1d2d9d700 1 --2- 172.21.15.81:0/1258185893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d4157ca0 0x7ff1d4068dd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff1d406fe20 tx=0x7ff1cc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:58.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.919+0000 7ff1caffd700 1 -- 172.21.15.81:0/1258185893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc027470 con 0x7ff1d4157ca0 2023-10-07T08:43:58.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.919+0000 7ff1caffd700 1 -- 172.21.15.81:0/1258185893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1cc0275d0 con 0x7ff1d4157ca0 2023-10-07T08:43:58.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.919+0000 7ff1d895d700 1 -- 172.21.15.81:0/1258185893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d40aa890 con 0x7ff1d4157ca0 2023-10-07T08:43:58.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.919+0000 7ff1caffd700 1 -- 172.21.15.81:0/1258185893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc027990 con 0x7ff1d4157ca0 2023-10-07T08:43:58.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.919+0000 7ff1d895d700 1 -- 172.21.15.81:0/1258185893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d40aadc0 con 0x7ff1d4157ca0 2023-10-07T08:43:58.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.920+0000 7ff1d895d700 1 -- 172.21.15.81:0/1258185893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d40ab5c0 con 0x7ff1d4157ca0 2023-10-07T08:43:58.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.920+0000 7ff1caffd700 1 -- 172.21.15.81:0/1258185893 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1cc024070 con 0x7ff1d4157ca0 2023-10-07T08:43:58.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.921+0000 7ff1caffd700 1 --2- 172.21.15.81:0/1258185893 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff1b4066f30 0x7ff1b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:58.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.921+0000 7ff1d259c700 1 --2- 172.21.15.81:0/1258185893 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff1b4066f30 0x7ff1b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:58.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.921+0000 7ff1caffd700 1 -- 172.21.15.81:0/1258185893 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff1cc086ca0 con 0x7ff1d4157ca0 2023-10-07T08:43:58.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.921+0000 7ff1d259c700 1 --2- 172.21.15.81:0/1258185893 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff1b4066f30 0x7ff1b40693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4006fd0 tx=0x7ff1c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:58.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:58.925+0000 7ff1caffd700 1 -- 172.21.15.81:0/1258185893 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1cc053f10 con 0x7ff1d4157ca0 2023-10-07T08:43:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.105+0000 7ff1d895d700 1 -- 172.21.15.81:0/1258185893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff1d40b2ee0 con 0x7ff1d4157ca0 2023-10-07T08:43:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.106+0000 7ff1caffd700 1 -- 172.21.15.81:0/1258185893 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff1cc057530 con 0x7ff1d4157ca0 2023-10-07T08:43:59.107 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:43:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.107+0000 7ff1d895d700 1 -- 172.21.15.81:0/1258185893 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff1b4066f30 msgr2=0x7ff1b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.107+0000 7ff1d895d700 1 --2- 172.21.15.81:0/1258185893 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff1b4066f30 0x7ff1b40693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4006fd0 tx=0x7ff1c4008040 comp rx=0 tx=0).stop 2023-10-07T08:43:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.107+0000 7ff1d895d700 1 -- 172.21.15.81:0/1258185893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d4157ca0 msgr2=0x7ff1d4068dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.107+0000 7ff1d895d700 1 --2- 172.21.15.81:0/1258185893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d4157ca0 0x7ff1d4068dd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff1d406fe20 tx=0x7ff1cc019000 comp rx=0 tx=0).stop 2023-10-07T08:43:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.107+0000 7ff1d895d700 1 -- 172.21.15.81:0/1258185893 shutdown_connections 2023-10-07T08:43:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.107+0000 7ff1d895d700 1 --2- 172.21.15.81:0/1258185893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d4157ca0 0x7ff1d4068dd0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.107+0000 7ff1d895d700 1 --2- 172.21.15.81:0/1258185893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d406d120 0x7ff1d4154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.107+0000 7ff1d895d700 1 --2- 172.21.15.81:0/1258185893 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff1b4066f30 0x7ff1b40693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.107+0000 7ff1d895d700 1 --2- 172.21.15.81:0/1258185893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1d41578d0 0x7ff1d40accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.107+0000 7ff1d895d700 1 -- 172.21.15.81:0/1258185893 >> 172.21.15.81:0/1258185893 conn(0x7ff1d406bb90 msgr2=0x7ff1d4158390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.108+0000 7ff1d895d700 1 -- 172.21.15.81:0/1258185893 shutdown_connections 2023-10-07T08:43:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.108+0000 7ff1d895d700 1 -- 172.21.15.81:0/1258185893 wait complete. 2023-10-07T08:43:59.121 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:43:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.232+0000 7f148df3a700 1 Processor -- start 2023-10-07T08:43:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.232+0000 7f148df3a700 1 -- start start 2023-10-07T08:43:59.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.233+0000 7f148df3a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f14881569e0 0x7f14880b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.233+0000 7f148df3a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f148806e940 0x7f14880cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.233+0000 7f148df3a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14880b2290 con 0x7f1488156db0 2023-10-07T08:43:59.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.233+0000 7f148df3a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1488157c00 con 0x7f14881569e0 2023-10-07T08:43:59.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.233+0000 7f148df3a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14881572d0 con 0x7f148806e940 2023-10-07T08:43:59.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.233+0000 7f1486ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1488156db0 0x7f148806e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59454/0 (socket says 172.21.15.81:59454) 2023-10-07T08:43:59.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.233+0000 7f1486ffd700 1 -- 172.21.15.81:0/1279931737 learned_addr learned my addr 172.21.15.81:0/1279931737 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:59.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14877fe700 1 --2- 172.21.15.81:0/1279931737 >> v2:172.21.15.89:3300/0 conn(0x7f14881569e0 0x7f14880b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14867fc700 1 -- 172.21.15.81:0/1279931737 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974532127 0 0) 0x7f14880b2290 con 0x7f1488156db0 2023-10-07T08:43:59.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f1487fff700 1 --2- 172.21.15.81:0/1279931737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f148806e940 0x7f14880cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14867fc700 1 -- 172.21.15.81:0/1279931737 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1470003570 con 0x7f1488156db0 2023-10-07T08:43:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14867fc700 1 -- 172.21.15.81:0/1279931737 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1728272085 0 0) 0x7f1470003570 con 0x7f1488156db0 2023-10-07T08:43:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14867fc700 1 -- 172.21.15.81:0/1279931737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f148806e940 msgr2=0x7f14880cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14867fc700 1 --2- 172.21.15.81:0/1279931737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f148806e940 0x7f14880cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14867fc700 1 -- 172.21.15.81:0/1279931737 >> v2:172.21.15.89:3300/0 conn(0x7f14881569e0 msgr2=0x7f14880b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14867fc700 1 --2- 172.21.15.81:0/1279931737 >> v2:172.21.15.89:3300/0 conn(0x7f14881569e0 0x7f14880b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14867fc700 1 -- 172.21.15.81:0/1279931737 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14881575b0 con 0x7f1488156db0 2023-10-07T08:43:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14867fc700 1 -- 172.21.15.81:0/1279931737 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f147c001470 con 0x7f1488156db0 2023-10-07T08:43:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14867fc700 1 -- 172.21.15.81:0/1279931737 >> v1:172.21.15.81:6789/0 conn(0x7f1488156db0 legacy=0x7f148806e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14867fc700 1 --2- 172.21.15.81:0/1279931737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1470003a60 0x7f1470003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14867fc700 1 --2- 172.21.15.81:0/1279931737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1470004810 0x7f1470004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14867fc700 1 --2- 172.21.15.81:0/1279931737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f148806e940 0x7f14700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14867fc700 1 -- 172.21.15.81:0/1279931737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1488157c00 con 0x7f1470004810 2023-10-07T08:43:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14867fc700 1 -- 172.21.15.81:0/1279931737 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14881572d0 con 0x7f1470003a60 2023-10-07T08:43:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14867fc700 1 -- 172.21.15.81:0/1279931737 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147000ba60 con 0x7f148806e940 2023-10-07T08:43:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f1486ffd700 1 --2- 172.21.15.81:0/1279931737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1470004810 0x7f1470004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f14877fe700 1 --2- 172.21.15.81:0/1279931737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1470003a60 0x7f1470003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f1487fff700 1 --2- 172.21.15.81:0/1279931737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f148806e940 0x7f14700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f1486ffd700 1 -- 172.21.15.81:0/1279931737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f148806e940 msgr2=0x7f14700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f1486ffd700 1 --2- 172.21.15.81:0/1279931737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f148806e940 0x7f14700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f1486ffd700 1 -- 172.21.15.81:0/1279931737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1470003a60 msgr2=0x7f1470003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f1486ffd700 1 --2- 172.21.15.81:0/1279931737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1470003a60 0x7f1470003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f1486ffd700 1 -- 172.21.15.81:0/1279931737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1470003570 con 0x7f1470004810 2023-10-07T08:43:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.234+0000 7f1486ffd700 1 --2- 172.21.15.81:0/1279931737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1470004810 0x7f1470004c80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f147c00c3c0 tx=0x7f147c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f117f5ccf3b8bdb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.235+0000 7f14867fc700 1 -- 172.21.15.81:0/1279931737 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c00cc50 con 0x7f1470004810 2023-10-07T08:43:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.235+0000 7f14867fc700 1 -- 172.21.15.81:0/1279931737 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c00cdd0 con 0x7f1470004810 2023-10-07T08:43:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.235+0000 7f14867fc700 1 -- 172.21.15.81:0/1279931737 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c005b70 con 0x7f1470004810 2023-10-07T08:43:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.235+0000 7f148df3a700 1 -- 172.21.15.81:0/1279931737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1470004810 msgr2=0x7f1470004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.235+0000 7f148df3a700 1 --2- 172.21.15.81:0/1279931737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1470004810 0x7f1470004c80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f147c00c3c0 tx=0x7f147c001e90 comp rx=0 tx=0).stop 2023-10-07T08:43:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.235+0000 7f1487fff700 1 -- 172.21.15.81:0/1279931737 reap_dead start 2023-10-07T08:43:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.235+0000 7f148df3a700 1 -- 172.21.15.81:0/1279931737 shutdown_connections 2023-10-07T08:43:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.235+0000 7f148df3a700 1 -- 172.21.15.81:0/1279931737 >> 172.21.15.81:0/1279931737 conn(0x7f148806cca0 msgr2=0x7f148806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.235+0000 7f148df3a700 1 -- 172.21.15.81:0/1279931737 shutdown_connections 2023-10-07T08:43:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.235+0000 7f148df3a700 1 -- 172.21.15.81:0/1279931737 wait complete. 2023-10-07T08:43:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.236+0000 7f148df3a700 1 Processor -- start 2023-10-07T08:43:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.236+0000 7f148df3a700 1 -- start start 2023-10-07T08:43:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.237+0000 7f148df3a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1470004810 0x7f148816b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.237+0000 7f148df3a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14880c4a20 0x7f148814f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.237+0000 7f148df3a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1488168bd0 0x7f1488169020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.237+0000 7f148df3a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1488168740 con 0x7f1470004810 2023-10-07T08:43:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.237+0000 7f148df3a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14881683f0 con 0x7f1488168bd0 2023-10-07T08:43:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.237+0000 7f148df3a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148816bf30 con 0x7f14880c4a20 2023-10-07T08:43:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.237+0000 7f14877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1470004810 0x7f148816b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.237+0000 7f14877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1470004810 0x7f148816b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36522/0 (socket says 172.21.15.81:36522) 2023-10-07T08:43:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.237+0000 7f14877fe700 1 -- 172.21.15.81:0/2698780426 learned_addr learned my addr 172.21.15.81:0/2698780426 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.237+0000 7f14877fe700 1 -- 172.21.15.81:0/2698780426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14880c4a20 msgr2=0x7f148814f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.237+0000 7f1486ffd700 1 --2- 172.21.15.81:0/2698780426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14880c4a20 0x7f148814f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.237+0000 7f14877fe700 1 --2- 172.21.15.81:0/2698780426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14880c4a20 0x7f148814f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.237+0000 7f14877fe700 1 -- 172.21.15.81:0/2698780426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1488168bd0 msgr2=0x7f1488169020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.237+0000 7f14877fe700 1 --2- 172.21.15.81:0/2698780426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1488168bd0 0x7f1488169020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.237+0000 7f14877fe700 1 -- 172.21.15.81:0/2698780426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148816c200 con 0x7f1470004810 2023-10-07T08:43:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.238+0000 7f14877fe700 1 --2- 172.21.15.81:0/2698780426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1470004810 0x7f148816b9f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1478011f80 tx=0x7f147800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.238+0000 7f146f7fe700 1 -- 172.21.15.81:0/2698780426 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147800e040 con 0x7f1470004810 2023-10-07T08:43:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.238+0000 7f146f7fe700 1 -- 172.21.15.81:0/2698780426 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147800f040 con 0x7f1470004810 2023-10-07T08:43:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.238+0000 7f146f7fe700 1 -- 172.21.15.81:0/2698780426 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478015430 con 0x7f1470004810 2023-10-07T08:43:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.238+0000 7f148df3a700 1 -- 172.21.15.81:0/2698780426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148816c4e0 con 0x7f1470004810 2023-10-07T08:43:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.238+0000 7f148df3a700 1 -- 172.21.15.81:0/2698780426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148814fd10 con 0x7f1470004810 2023-10-07T08:43:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.239+0000 7f148df3a700 1 -- 172.21.15.81:0/2698780426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148806d7f0 con 0x7f1470004810 2023-10-07T08:43:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.239+0000 7f146f7fe700 1 -- 172.21.15.81:0/2698780426 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14780157e0 con 0x7f1470004810 2023-10-07T08:43:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.239+0000 7f146f7fe700 1 --2- 172.21.15.81:0/2698780426 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1474066f30 0x7f14740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.239+0000 7f146f7fe700 1 -- 172.21.15.81:0/2698780426 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1478085290 con 0x7f1470004810 2023-10-07T08:43:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.239+0000 7f1486ffd700 1 --2- 172.21.15.81:0/2698780426 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1474066f30 0x7f14740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.240+0000 7f1486ffd700 1 --2- 172.21.15.81:0/2698780426 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1474066f30 0x7f14740693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f14880ca130 tx=0x7f147c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.244+0000 7f146f7fe700 1 -- 172.21.15.81:0/2698780426 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1478055f90 con 0x7f1470004810 2023-10-07T08:43:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.469+0000 7f148df3a700 1 -- 172.21.15.81:0/2698780426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1488157890 con 0x7f1470004810 2023-10-07T08:43:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.470+0000 7f146f7fe700 1 -- 172.21.15.81:0/2698780426 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f1478055b20 con 0x7f1470004810 2023-10-07T08:43:59.471 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:59.471 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1843075449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1843075449},{"type":"v1","addr":"172.21.15.81:6837","nonce":1843075449}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3013270804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3013270804},{"type":"v1","addr":"172.21.15.89:6835","nonce":3013270804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3825515993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3825515993},{"type":"v1","addr":"172.21.15.81:6836","nonce":3825515993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:43:43.620900+0000","modified":"2023-10-07T08:43:47.291987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6834/4005291324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":4005291324},{"type":"v1","addr":"172.21.15.89:6834","nonce":4005291324}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-07T08:43:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.471+0000 7f148df3a700 1 -- 172.21.15.81:0/2698780426 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1474066f30 msgr2=0x7f14740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.471+0000 7f148df3a700 1 --2- 172.21.15.81:0/2698780426 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1474066f30 0x7f14740693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f14880ca130 tx=0x7f147c015000 comp rx=0 tx=0).stop 2023-10-07T08:43:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.471+0000 7f148df3a700 1 -- 172.21.15.81:0/2698780426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1470004810 msgr2=0x7f148816b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.471+0000 7f148df3a700 1 --2- 172.21.15.81:0/2698780426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1470004810 0x7f148816b9f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1478011f80 tx=0x7f147800b040 comp rx=0 tx=0).stop 2023-10-07T08:43:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.471+0000 7f148df3a700 1 -- 172.21.15.81:0/2698780426 shutdown_connections 2023-10-07T08:43:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.472+0000 7f148df3a700 1 --2- 172.21.15.81:0/2698780426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1488168bd0 0x7f1488169020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.472+0000 7f148df3a700 1 --2- 172.21.15.81:0/2698780426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1470004810 0x7f148816b9f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.472+0000 7f148df3a700 1 --2- 172.21.15.81:0/2698780426 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1474066f30 0x7f14740693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.472+0000 7f148df3a700 1 --2- 172.21.15.81:0/2698780426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14880c4a20 0x7f148814f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.472+0000 7f148df3a700 1 -- 172.21.15.81:0/2698780426 >> 172.21.15.81:0/2698780426 conn(0x7f148806cca0 msgr2=0x7f1488150220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.472+0000 7f148df3a700 1 -- 172.21.15.81:0/2698780426 shutdown_connections 2023-10-07T08:43:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.472+0000 7f148df3a700 1 -- 172.21.15.81:0/2698780426 wait complete. 2023-10-07T08:43:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 15 2023-10-07T08:43:59.485 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:43:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.598+0000 7f7b6359e700 1 Processor -- start 2023-10-07T08:43:59.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.598+0000 7f7b6359e700 1 -- start start 2023-10-07T08:43:59.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.599+0000 7f7b6359e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7b64159f10 0x7f7b64068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.599+0000 7f7b6359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b64069120 con 0x7f7b64068cc0 2023-10-07T08:43:59.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.599+0000 7f7b6359e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b640cee10 con 0x7f7b64159b40 2023-10-07T08:43:59.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.599+0000 7f7b6359e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b640cd040 con 0x7f7b64159f10 2023-10-07T08:43:59.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.599+0000 7f7b62d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7b64068cc0 0x7f7b640cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59472/0 (socket says 172.21.15.81:59472) 2023-10-07T08:43:59.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.599+0000 7f7b62d9d700 1 -- 172.21.15.81:0/1592238814 learned_addr learned my addr 172.21.15.81:0/1592238814 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:59.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.599+0000 7f7b61d9b700 1 --2- 172.21.15.81:0/1592238814 >> v2:172.21.15.89:3300/0 conn(0x7f7b64159f10 0x7f7b64068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.599+0000 7f7b6159a700 1 -- 172.21.15.81:0/1592238814 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719886178 0 0) 0x7f7b5c001110 con 0x7f7b64068cc0 2023-10-07T08:43:59.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.599+0000 7f7b6159a700 1 -- 172.21.15.81:0/1592238814 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b4c003570 con 0x7f7b64068cc0 2023-10-07T08:43:59.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6159a700 1 -- 172.21.15.81:0/1592238814 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2509035531 0 0) 0x7f7b4c003570 con 0x7f7b64068cc0 2023-10-07T08:43:59.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6159a700 1 -- 172.21.15.81:0/1592238814 >> v2:172.21.15.89:3300/0 conn(0x7f7b64159f10 msgr2=0x7f7b64068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:59.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6159a700 1 --2- 172.21.15.81:0/1592238814 >> v2:172.21.15.89:3300/0 conn(0x7f7b64159f10 0x7f7b64068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6159a700 1 -- 172.21.15.81:0/1592238814 >> v1:172.21.15.89:6789/0 conn(0x7f7b64159b40 legacy=0x7f7b640cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6159a700 1 -- 172.21.15.81:0/1592238814 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b640cd320 con 0x7f7b64068cc0 2023-10-07T08:43:59.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6159a700 1 -- 172.21.15.81:0/1592238814 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f7b5c001600 con 0x7f7b64068cc0 2023-10-07T08:43:59.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6159a700 1 -- 172.21.15.81:0/1592238814 >> v1:172.21.15.81:6789/0 conn(0x7f7b64068cc0 legacy=0x7f7b640cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6159a700 1 --2- 172.21.15.81:0/1592238814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b4c003a60 0x7f7b4c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6159a700 1 --2- 172.21.15.81:0/1592238814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b4c004810 0x7f7b4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6159a700 1 --2- 172.21.15.81:0/1592238814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b4c0051c0 0x7f7b4c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6159a700 1 -- 172.21.15.81:0/1592238814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b640cd040 con 0x7f7b4c0051c0 2023-10-07T08:43:59.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6159a700 1 -- 172.21.15.81:0/1592238814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c00c0d0 con 0x7f7b4c003a60 2023-10-07T08:43:59.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6159a700 1 -- 172.21.15.81:0/1592238814 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c00c290 con 0x7f7b4c004810 2023-10-07T08:43:59.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b62d9d700 1 --2- 172.21.15.81:0/1592238814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b4c0051c0 0x7f7b4c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b61d9b700 1 --2- 172.21.15.81:0/1592238814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b4c004810 0x7f7b4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6259c700 1 --2- 172.21.15.81:0/1592238814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b4c003a60 0x7f7b4c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b62d9d700 1 -- 172.21.15.81:0/1592238814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b4c004810 msgr2=0x7f7b4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:59.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b62d9d700 1 --2- 172.21.15.81:0/1592238814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b4c004810 0x7f7b4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b62d9d700 1 -- 172.21.15.81:0/1592238814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b4c003a60 msgr2=0x7f7b4c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:59.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b62d9d700 1 --2- 172.21.15.81:0/1592238814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b4c003a60 0x7f7b4c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b62d9d700 1 -- 172.21.15.81:0/1592238814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c003570 con 0x7f7b4c0051c0 2023-10-07T08:43:59.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6259c700 1 --2- 172.21.15.81:0/1592238814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b4c003a60 0x7f7b4c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:59.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b62d9d700 1 -- 172.21.15.81:0/1592238814 reap_dead start 2023-10-07T08:43:59.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b62d9d700 1 --2- 172.21.15.81:0/1592238814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b4c0051c0 0x7f7b4c00ba60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c5c0 tx=0x7f7b5c007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a4e24f797a7a6b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:59.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6159a700 1 -- 172.21.15.81:0/1592238814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c00cdc0 con 0x7f7b4c0051c0 2023-10-07T08:43:59.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6159a700 1 -- 172.21.15.81:0/1592238814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c005920 con 0x7f7b4c0051c0 2023-10-07T08:43:59.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.600+0000 7f7b6159a700 1 -- 172.21.15.81:0/1592238814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c005ce0 con 0x7f7b4c0051c0 2023-10-07T08:43:59.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.601+0000 7f7b6359e700 1 -- 172.21.15.81:0/1592238814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b4c0051c0 msgr2=0x7f7b4c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.601+0000 7f7b6359e700 1 --2- 172.21.15.81:0/1592238814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b4c0051c0 0x7f7b4c00ba60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c5c0 tx=0x7f7b5c007a50 comp rx=0 tx=0).stop 2023-10-07T08:43:59.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.601+0000 7f7b6359e700 1 -- 172.21.15.81:0/1592238814 shutdown_connections 2023-10-07T08:43:59.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.601+0000 7f7b6359e700 1 --2- 172.21.15.81:0/1592238814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b4c0051c0 0x7f7b4c00ba60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.601+0000 7f7b6359e700 1 -- 172.21.15.81:0/1592238814 >> 172.21.15.81:0/1592238814 conn(0x7f7b640cd660 msgr2=0x7f7b640cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:59.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.601+0000 7f7b6359e700 1 -- 172.21.15.81:0/1592238814 shutdown_connections 2023-10-07T08:43:59.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.601+0000 7f7b6359e700 1 -- 172.21.15.81:0/1592238814 wait complete. 2023-10-07T08:43:59.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.602+0000 7f7b6359e700 1 Processor -- start 2023-10-07T08:43:59.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.602+0000 7f7b6359e700 1 -- start start 2023-10-07T08:43:59.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b6359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b4c0051c0 0x7f7b6415d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b6359e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b64158c60 0x7f7b640b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b6359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b640b6020 0x7f7b64160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b6359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6415cde0 con 0x7f7b640b6020 2023-10-07T08:43:59.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b6359e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b640b6470 con 0x7f7b64158c60 2023-10-07T08:43:59.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b6359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6415d7b0 con 0x7f7b4c0051c0 2023-10-07T08:43:59.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b62d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b640b6020 0x7f7b64160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b62d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b640b6020 0x7f7b64160560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36536/0 (socket says 172.21.15.81:36536) 2023-10-07T08:43:59.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b62d9d700 1 -- 172.21.15.81:0/3238092585 learned_addr learned my addr 172.21.15.81:0/3238092585 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:59.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b6259c700 1 --2- 172.21.15.81:0/3238092585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b4c0051c0 0x7f7b6415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b61d9b700 1 --2- 172.21.15.81:0/3238092585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b64158c60 0x7f7b640b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b62d9d700 1 -- 172.21.15.81:0/3238092585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b4c0051c0 msgr2=0x7f7b6415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b62d9d700 1 --2- 172.21.15.81:0/3238092585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b4c0051c0 0x7f7b6415d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b62d9d700 1 -- 172.21.15.81:0/3238092585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b64158c60 msgr2=0x7f7b640b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b62d9d700 1 --2- 172.21.15.81:0/3238092585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b64158c60 0x7f7b640b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b62d9d700 1 -- 172.21.15.81:0/3238092585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6415c4d0 con 0x7f7b640b6020 2023-10-07T08:43:59.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b62d9d700 1 --2- 172.21.15.81:0/3238092585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b640b6020 0x7f7b64160560 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c5c0 tx=0x7f7b5c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:59.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b527fc700 1 -- 172.21.15.81:0/3238092585 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c001110 con 0x7f7b640b6020 2023-10-07T08:43:59.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b527fc700 1 -- 172.21.15.81:0/3238092585 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c0072e0 con 0x7f7b640b6020 2023-10-07T08:43:59.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b6359e700 1 -- 172.21.15.81:0/3238092585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b641612b0 con 0x7f7b640b6020 2023-10-07T08:43:59.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b527fc700 1 -- 172.21.15.81:0/3238092585 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c0076a0 con 0x7f7b640b6020 2023-10-07T08:43:59.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.603+0000 7f7b6359e700 1 -- 172.21.15.81:0/3238092585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6415ca70 con 0x7f7b640b6020 2023-10-07T08:43:59.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.604+0000 7f7b6359e700 1 -- 172.21.15.81:0/3238092585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6415cf90 con 0x7f7b640b6020 2023-10-07T08:43:59.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.605+0000 7f7b527fc700 1 -- 172.21.15.81:0/3238092585 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b5c012400 con 0x7f7b640b6020 2023-10-07T08:43:59.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.605+0000 7f7b527fc700 1 --2- 172.21.15.81:0/3238092585 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7b44066f60 0x7f7b44069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.605+0000 7f7b527fc700 1 -- 172.21.15.81:0/3238092585 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b5c083bb0 con 0x7f7b640b6020 2023-10-07T08:43:59.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.605+0000 7f7b6259c700 1 --2- 172.21.15.81:0/3238092585 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7b44066f60 0x7f7b44069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.605+0000 7f7b6259c700 1 --2- 172.21.15.81:0/3238092585 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7b44066f60 0x7f7b44069410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7b54000f80 tx=0x7f7b5400c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:59.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.609+0000 7f7b527fc700 1 -- 172.21.15.81:0/3238092585 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b6415cf90 con 0x7f7b640b6020 2023-10-07T08:43:59.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.791+0000 7f7b6359e700 1 -- 172.21.15.81:0/3238092585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b64069120 con 0x7f7b640b6020 2023-10-07T08:43:59.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.792+0000 7f7b527fc700 1 -- 172.21.15.81:0/3238092585 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f7b64069120 con 0x7f7b640b6020 2023-10-07T08:43:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:43:59.794 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":35,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:43:55.325199+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:43:41.595379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-07T08:43:42.590185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:43:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.794+0000 7f7b6359e700 1 -- 172.21.15.81:0/3238092585 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7b44066f60 msgr2=0x7f7b44069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.794+0000 7f7b6359e700 1 --2- 172.21.15.81:0/3238092585 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7b44066f60 0x7f7b44069410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7b54000f80 tx=0x7f7b5400c040 comp rx=0 tx=0).stop 2023-10-07T08:43:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.794+0000 7f7b6359e700 1 -- 172.21.15.81:0/3238092585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b640b6020 msgr2=0x7f7b64160560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.794+0000 7f7b6359e700 1 --2- 172.21.15.81:0/3238092585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b640b6020 0x7f7b64160560 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c5c0 tx=0x7f7b5c013000 comp rx=0 tx=0).stop 2023-10-07T08:43:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.794+0000 7f7b6359e700 1 -- 172.21.15.81:0/3238092585 shutdown_connections 2023-10-07T08:43:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.794+0000 7f7b6359e700 1 --2- 172.21.15.81:0/3238092585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b640b6020 0x7f7b64160560 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.794+0000 7f7b6359e700 1 --2- 172.21.15.81:0/3238092585 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7b44066f60 0x7f7b44069410 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.794+0000 7f7b6359e700 1 --2- 172.21.15.81:0/3238092585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b4c0051c0 0x7f7b6415d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.794+0000 7f7b6359e700 1 --2- 172.21.15.81:0/3238092585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b64158c60 0x7f7b640b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.794+0000 7f7b6359e700 1 -- 172.21.15.81:0/3238092585 >> 172.21.15.81:0/3238092585 conn(0x7f7b640cd660 msgr2=0x7f7b6406e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.794+0000 7f7b6359e700 1 -- 172.21.15.81:0/3238092585 shutdown_connections 2023-10-07T08:43:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.794+0000 7f7b6359e700 1 -- 172.21.15.81:0/3238092585 wait complete. 2023-10-07T08:43:59.808 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T08:43:59.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:43:59.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.921+0000 7ff3cc9a5700 1 Processor -- start 2023-10-07T08:43:59.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.921+0000 7ff3cc9a5700 1 -- start start 2023-10-07T08:43:59.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.922+0000 7ff3cc9a5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c81578d0 0x7ff3c80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.922+0000 7ff3cc9a5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3c806d120 0x7ff3c806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.922+0000 7ff3cc9a5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c806dac0 con 0x7ff3c8157ca0 2023-10-07T08:43:59.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.922+0000 7ff3cc9a5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c80d07c0 con 0x7ff3c806d120 2023-10-07T08:43:59.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.922+0000 7ff3cc9a5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80cfbb0 con 0x7ff3c81578d0 2023-10-07T08:43:59.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.922+0000 7ff3c6d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3c806d120 0x7ff3c806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.922+0000 7ff3bdd9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff3c8157ca0 0x7ff3c815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59474/0 (socket says 172.21.15.81:59474) 2023-10-07T08:43:59.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.922+0000 7ff3bdd9b700 1 -- 172.21.15.81:0/1116205813 learned_addr learned my addr 172.21.15.81:0/1116205813 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:43:59.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.922+0000 7ff3c659c700 1 --2- 172.21.15.81:0/1116205813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c81578d0 0x7ff3c80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.922+0000 7ff3c6d9d700 1 -- 172.21.15.81:0/1116205813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c81578d0 msgr2=0x7ff3c80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:43:59.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.922+0000 7ff3c6d9d700 1 --2- 172.21.15.81:0/1116205813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c81578d0 0x7ff3c80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.922+0000 7ff3c6d9d700 1 -- 172.21.15.81:0/1116205813 >> v1:172.21.15.81:6789/0 conn(0x7ff3c8157ca0 legacy=0x7ff3c815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.922+0000 7ff3c6d9d700 1 -- 172.21.15.81:0/1116205813 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c80cfe90 con 0x7ff3c806d120 2023-10-07T08:43:59.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.922+0000 7ff3c5d9b700 1 -- 172.21.15.81:0/1116205813 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461824492 0 0) 0x7ff3b0001110 con 0x7ff3c8157ca0 2023-10-07T08:43:59.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.922+0000 7ff3c6d9d700 1 --2- 172.21.15.81:0/1116205813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c806d120 0x7ff3c806d580 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009e60 tx=0x7ff3c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdc80cc8ba891c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:59.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.923+0000 7ff3c5d9b700 1 -- 172.21.15.81:0/1116205813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c000e070 con 0x7ff3c806d120 2023-10-07T08:43:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.923+0000 7ff3c5d9b700 1 -- 172.21.15.81:0/1116205813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c000bb60 con 0x7ff3c806d120 2023-10-07T08:43:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.923+0000 7ff3c5d9b700 1 -- 172.21.15.81:0/1116205813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0012430 con 0x7ff3c806d120 2023-10-07T08:43:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.923+0000 7ff3cc9a5700 1 -- 172.21.15.81:0/1116205813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c806d120 msgr2=0x7ff3c806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.923+0000 7ff3cc9a5700 1 --2- 172.21.15.81:0/1116205813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c806d120 0x7ff3c806d580 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009e60 tx=0x7ff3c0009780 comp rx=0 tx=0).stop 2023-10-07T08:43:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.923+0000 7ff3cc9a5700 1 -- 172.21.15.81:0/1116205813 shutdown_connections 2023-10-07T08:43:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.923+0000 7ff3cc9a5700 1 --2- 172.21.15.81:0/1116205813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c806d120 0x7ff3c806d580 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.923+0000 7ff3cc9a5700 1 --2- 172.21.15.81:0/1116205813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c81578d0 0x7ff3c80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.923+0000 7ff3cc9a5700 1 -- 172.21.15.81:0/1116205813 >> 172.21.15.81:0/1116205813 conn(0x7ff3c806bb90 msgr2=0x7ff3c806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:43:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.923+0000 7ff3cc9a5700 1 -- 172.21.15.81:0/1116205813 shutdown_connections 2023-10-07T08:43:59.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.923+0000 7ff3cc9a5700 1 -- 172.21.15.81:0/1116205813 wait complete. 2023-10-07T08:43:59.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.924+0000 7ff3cc9a5700 1 Processor -- start 2023-10-07T08:43:59.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.924+0000 7ff3cc9a5700 1 -- start start 2023-10-07T08:43:59.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3cc9a5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3c806d120 0x7ff3c8068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3cc9a5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c81578d0 0x7ff3c8169c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3cc9a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c8157ca0 0x7ff3c816a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3cc9a5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c816ae40 con 0x7ff3c8157ca0 2023-10-07T08:43:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3cc9a5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c8159c10 con 0x7ff3c806d120 2023-10-07T08:43:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3cc9a5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c816a7a0 con 0x7ff3c81578d0 2023-10-07T08:43:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3c6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c8157ca0 0x7ff3c816a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3c6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c8157ca0 0x7ff3c816a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36552/0 (socket says 172.21.15.81:36552) 2023-10-07T08:43:59.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3c6d9d700 1 -- 172.21.15.81:0/1968540371 learned_addr learned my addr 172.21.15.81:0/1968540371 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:43:59.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3c659c700 1 --2- 172.21.15.81:0/1968540371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3c806d120 0x7ff3c8068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3bdd9b700 1 --2- 172.21.15.81:0/1968540371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c81578d0 0x7ff3c8169c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3c6d9d700 1 -- 172.21.15.81:0/1968540371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c81578d0 msgr2=0x7ff3c8169c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3c6d9d700 1 --2- 172.21.15.81:0/1968540371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c81578d0 0x7ff3c8169c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3c6d9d700 1 -- 172.21.15.81:0/1968540371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3c806d120 msgr2=0x7ff3c8068a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:43:59.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3c6d9d700 1 --2- 172.21.15.81:0/1968540371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3c806d120 0x7ff3c8068a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:43:59.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3c6d9d700 1 -- 172.21.15.81:0/1968540371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c0009a20 con 0x7ff3c8157ca0 2023-10-07T08:43:59.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.925+0000 7ff3c659c700 1 --2- 172.21.15.81:0/1968540371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3c806d120 0x7ff3c8068a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:43:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.926+0000 7ff3c6d9d700 1 --2- 172.21.15.81:0/1968540371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c8157ca0 0x7ff3c816a1b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000b6c0 tx=0x7ff3c0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.926+0000 7ff3beffd700 1 -- 172.21.15.81:0/1968540371 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0012e70 con 0x7ff3c8157ca0 2023-10-07T08:43:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.926+0000 7ff3beffd700 1 -- 172.21.15.81:0/1968540371 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c001d630 con 0x7ff3c8157ca0 2023-10-07T08:43:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.926+0000 7ff3cc9a5700 1 -- 172.21.15.81:0/1968540371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c816aa80 con 0x7ff3c8157ca0 2023-10-07T08:43:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.926+0000 7ff3beffd700 1 -- 172.21.15.81:0/1968540371 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c001d9f0 con 0x7ff3c8157ca0 2023-10-07T08:43:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.926+0000 7ff3cc9a5700 1 -- 172.21.15.81:0/1968540371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c816b370 con 0x7ff3c8157ca0 2023-10-07T08:43:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.927+0000 7ff3cc9a5700 1 -- 172.21.15.81:0/1968540371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c8067ac0 con 0x7ff3c8157ca0 2023-10-07T08:43:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.927+0000 7ff3beffd700 1 -- 172.21.15.81:0/1968540371 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff3c0024070 con 0x7ff3c8157ca0 2023-10-07T08:43:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.928+0000 7ff3beffd700 1 --2- 172.21.15.81:0/1968540371 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3a8066f30 0x7ff3a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:43:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.928+0000 7ff3c659c700 1 --2- 172.21.15.81:0/1968540371 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3a8066f30 0x7ff3a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:43:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.928+0000 7ff3beffd700 1 -- 172.21.15.81:0/1968540371 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff3c0086e40 con 0x7ff3c8157ca0 2023-10-07T08:43:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.928+0000 7ff3c659c700 1 --2- 172.21.15.81:0/1968540371 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3a8066f30 0x7ff3a80693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8009d80 tx=0x7ff3b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:43:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:43:59.932+0000 7ff3beffd700 1 -- 172.21.15.81:0/1968540371 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3c0054010 con 0x7ff3c8157ca0 2023-10-07T08:44:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.159+0000 7ff3cc9a5700 1 -- 172.21.15.81:0/1968540371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3c80d0170 con 0x7ff3c8157ca0 2023-10-07T08:44:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.160+0000 7ff3beffd700 1 -- 172.21.15.81:0/1968540371 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4597 (secure 0 0 0) 0x7ff3c0057630 con 0x7ff3c8157ca0 2023-10-07T08:44:00.161 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:00.162 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1843075449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1843075449},{"type":"v1","addr":"172.21.15.81:6837","nonce":1843075449}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3013270804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3013270804},{"type":"v1","addr":"172.21.15.89:6835","nonce":3013270804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3825515993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3825515993},{"type":"v1","addr":"172.21.15.81:6836","nonce":3825515993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:43:43.620900+0000","modified":"2023-10-07T08:43:47.291987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6834/4005291324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":4005291324},{"type":"v1","addr":"172.21.15.89:6834","nonce":4005291324}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-07T08:44:00.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.162+0000 7ff3cc9a5700 1 -- 172.21.15.81:0/1968540371 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3a8066f30 msgr2=0x7ff3a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.162+0000 7ff3cc9a5700 1 --2- 172.21.15.81:0/1968540371 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3a8066f30 0x7ff3a80693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8009d80 tx=0x7ff3b8008040 comp rx=0 tx=0).stop 2023-10-07T08:44:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.162+0000 7ff3cc9a5700 1 -- 172.21.15.81:0/1968540371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c8157ca0 msgr2=0x7ff3c816a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.162+0000 7ff3cc9a5700 1 --2- 172.21.15.81:0/1968540371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c8157ca0 0x7ff3c816a1b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000b6c0 tx=0x7ff3c0019000 comp rx=0 tx=0).stop 2023-10-07T08:44:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.162+0000 7ff3cc9a5700 1 -- 172.21.15.81:0/1968540371 shutdown_connections 2023-10-07T08:44:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.162+0000 7ff3cc9a5700 1 --2- 172.21.15.81:0/1968540371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c8157ca0 0x7ff3c816a1b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.162+0000 7ff3cc9a5700 1 --2- 172.21.15.81:0/1968540371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3c806d120 0x7ff3c8068a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.162+0000 7ff3cc9a5700 1 --2- 172.21.15.81:0/1968540371 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff3a8066f30 0x7ff3a80693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.162+0000 7ff3cc9a5700 1 --2- 172.21.15.81:0/1968540371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3c81578d0 0x7ff3c8169c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.162+0000 7ff3cc9a5700 1 -- 172.21.15.81:0/1968540371 >> 172.21.15.81:0/1968540371 conn(0x7ff3c806bb90 msgr2=0x7ff3c815c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.162+0000 7ff3cc9a5700 1 -- 172.21.15.81:0/1968540371 shutdown_connections 2023-10-07T08:44:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.162+0000 7ff3cc9a5700 1 -- 172.21.15.81:0/1968540371 wait complete. 2023-10-07T08:44:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 15 2023-10-07T08:44:00.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:44:00.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.291+0000 7f9b970eb700 1 Processor -- start 2023-10-07T08:44:00.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.291+0000 7f9b970eb700 1 -- start start 2023-10-07T08:44:00.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.292+0000 7f9b970eb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b9006d830 0x7f9b900cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.292+0000 7f9b970eb700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b900d07c0 con 0x7f9b90157ca0 2023-10-07T08:44:00.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.292+0000 7f9b970eb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b900cfbb0 con 0x7f9b901578d0 2023-10-07T08:44:00.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.292+0000 7f9b970eb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900cfe90 con 0x7f9b9006d830 2023-10-07T08:44:00.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.292+0000 7f9b87fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9b90157ca0 0x7f9b9006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59476/0 (socket says 172.21.15.81:59476) 2023-10-07T08:44:00.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.292+0000 7f9b87fff700 1 -- 172.21.15.81:0/1377119172 learned_addr learned my addr 172.21.15.81:0/1377119172 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:00.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b95688700 1 --2- 172.21.15.81:0/1377119172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b9006d830 0x7f9b900cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.292+0000 7f9b877fe700 1 -- 172.21.15.81:0/1377119172 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941323364 0 0) 0x7f9b900d07c0 con 0x7f9b90157ca0 2023-10-07T08:44:00.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b877fe700 1 -- 172.21.15.81:0/1377119172 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b78003570 con 0x7f9b90157ca0 2023-10-07T08:44:00.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b877fe700 1 -- 172.21.15.81:0/1377119172 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659202437 0 0) 0x7f9b900cfbb0 con 0x7f9b901578d0 2023-10-07T08:44:00.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b877fe700 1 -- 172.21.15.81:0/1377119172 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b900d07c0 con 0x7f9b901578d0 2023-10-07T08:44:00.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b877fe700 1 -- 172.21.15.81:0/1377119172 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 640114801 0 0) 0x7f9b78003570 con 0x7f9b90157ca0 2023-10-07T08:44:00.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b877fe700 1 -- 172.21.15.81:0/1377119172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b9006d830 msgr2=0x7f9b900cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:00.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b877fe700 1 --2- 172.21.15.81:0/1377119172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b9006d830 0x7f9b900cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b877fe700 1 -- 172.21.15.81:0/1377119172 >> v1:172.21.15.89:6789/0 conn(0x7f9b901578d0 legacy=0x7f9b9015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b877fe700 1 -- 172.21.15.81:0/1377119172 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b900d0170 con 0x7f9b90157ca0 2023-10-07T08:44:00.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b877fe700 1 -- 172.21.15.81:0/1377119172 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f9b80001470 con 0x7f9b90157ca0 2023-10-07T08:44:00.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b877fe700 1 -- 172.21.15.81:0/1377119172 >> v1:172.21.15.81:6789/0 conn(0x7f9b90157ca0 legacy=0x7f9b9006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b877fe700 1 --2- 172.21.15.81:0/1377119172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b78003c20 0x7f9b78004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b877fe700 1 --2- 172.21.15.81:0/1377119172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78004810 0x7f9b78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b877fe700 1 --2- 172.21.15.81:0/1377119172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b780051c0 0x7f9b7800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b877fe700 1 -- 172.21.15.81:0/1377119172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900cfe90 con 0x7f9b78004810 2023-10-07T08:44:00.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b877fe700 1 -- 172.21.15.81:0/1377119172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7800c0b0 con 0x7f9b78003c20 2023-10-07T08:44:00.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b877fe700 1 -- 172.21.15.81:0/1377119172 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7800c270 con 0x7f9b780051c0 2023-10-07T08:44:00.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b95688700 1 --2- 172.21.15.81:0/1377119172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b9006d830 0x7f9b900cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:44:00.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b87fff700 1 --2- 172.21.15.81:0/1377119172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78004810 0x7f9b78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b94e87700 1 --2- 172.21.15.81:0/1377119172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b78003c20 0x7f9b78004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b95688700 1 --2- 172.21.15.81:0/1377119172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b780051c0 0x7f9b7800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b87fff700 1 -- 172.21.15.81:0/1377119172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b780051c0 msgr2=0x7f9b7800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:00.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b87fff700 1 --2- 172.21.15.81:0/1377119172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b780051c0 0x7f9b7800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b87fff700 1 -- 172.21.15.81:0/1377119172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b78003c20 msgr2=0x7f9b78004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:00.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b87fff700 1 --2- 172.21.15.81:0/1377119172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b78003c20 0x7f9b78004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b87fff700 1 -- 172.21.15.81:0/1377119172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b78003570 con 0x7f9b78004810 2023-10-07T08:44:00.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b95688700 1 --2- 172.21.15.81:0/1377119172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b780051c0 0x7f9b7800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:00.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.293+0000 7f9b87fff700 1 --2- 172.21.15.81:0/1377119172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78004810 0x7f9b78004c80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9b80007fd0 tx=0x7f9b9015b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81480f7d3ef4bc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:00.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.294+0000 7f9b877fe700 1 -- 172.21.15.81:0/1377119172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000cae0 con 0x7f9b78004810 2023-10-07T08:44:00.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.294+0000 7f9b877fe700 1 -- 172.21.15.81:0/1377119172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8000cc60 con 0x7f9b78004810 2023-10-07T08:44:00.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.294+0000 7f9b877fe700 1 -- 172.21.15.81:0/1377119172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80005920 con 0x7f9b78004810 2023-10-07T08:44:00.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.294+0000 7f9b970eb700 1 -- 172.21.15.81:0/1377119172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78004810 msgr2=0x7f9b78004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.294+0000 7f9b970eb700 1 --2- 172.21.15.81:0/1377119172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78004810 0x7f9b78004c80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9b80007fd0 tx=0x7f9b9015b610 comp rx=0 tx=0).stop 2023-10-07T08:44:00.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.294+0000 7f9b95688700 1 -- 172.21.15.81:0/1377119172 reap_dead start 2023-10-07T08:44:00.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.294+0000 7f9b970eb700 1 -- 172.21.15.81:0/1377119172 shutdown_connections 2023-10-07T08:44:00.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.294+0000 7f9b970eb700 1 -- 172.21.15.81:0/1377119172 >> 172.21.15.81:0/1377119172 conn(0x7f9b9006bb90 msgr2=0x7f9b9006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:00.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.294+0000 7f9b970eb700 1 -- 172.21.15.81:0/1377119172 shutdown_connections 2023-10-07T08:44:00.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.294+0000 7f9b970eb700 1 -- 172.21.15.81:0/1377119172 wait complete. 2023-10-07T08:44:00.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.295+0000 7f9b970eb700 1 Processor -- start 2023-10-07T08:44:00.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.295+0000 7f9b970eb700 1 -- start start 2023-10-07T08:44:00.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.296+0000 7f9b970eb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78004810 0x7f9b9016b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.296+0000 7f9b970eb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b901534e0 0x7f9b9016a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.296+0000 7f9b970eb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b90151ef0 0x7f9b900c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.296+0000 7f9b970eb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b90154410 con 0x7f9b78004810 2023-10-07T08:44:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.296+0000 7f9b970eb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b90153050 con 0x7f9b901534e0 2023-10-07T08:44:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.296+0000 7f9b970eb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9016b790 con 0x7f9b90151ef0 2023-10-07T08:44:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.296+0000 7f9b94e87700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78004810 0x7f9b9016b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.296+0000 7f9b94e87700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78004810 0x7f9b9016b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36558/0 (socket says 172.21.15.81:36558) 2023-10-07T08:44:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.296+0000 7f9b94e87700 1 -- 172.21.15.81:0/1873707176 learned_addr learned my addr 172.21.15.81:0/1873707176 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.296+0000 7f9b87fff700 1 --2- 172.21.15.81:0/1873707176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b901534e0 0x7f9b9016a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.296+0000 7f9b95688700 1 --2- 172.21.15.81:0/1873707176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b90151ef0 0x7f9b900c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.296+0000 7f9b94e87700 1 -- 172.21.15.81:0/1873707176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b90151ef0 msgr2=0x7f9b900c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.296+0000 7f9b94e87700 1 --2- 172.21.15.81:0/1873707176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b90151ef0 0x7f9b900c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.297+0000 7f9b94e87700 1 -- 172.21.15.81:0/1873707176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b901534e0 msgr2=0x7f9b9016a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.297+0000 7f9b94e87700 1 --2- 172.21.15.81:0/1873707176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b901534e0 0x7f9b9016a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.297+0000 7f9b94e87700 1 -- 172.21.15.81:0/1873707176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b90152440 con 0x7f9b78004810 2023-10-07T08:44:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.297+0000 7f9b95688700 1 --2- 172.21.15.81:0/1873707176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b90151ef0 0x7f9b900c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.297+0000 7f9b87fff700 1 --2- 172.21.15.81:0/1873707176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b901534e0 0x7f9b9016a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.297+0000 7f9b94e87700 1 --2- 172.21.15.81:0/1873707176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78004810 0x7f9b9016b250 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0015c0 tx=0x7f9b8c001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.297+0000 7f9b84ff9700 1 -- 172.21.15.81:0/1873707176 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c018070 con 0x7f9b78004810 2023-10-07T08:44:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.297+0000 7f9b84ff9700 1 -- 172.21.15.81:0/1873707176 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c001d40 con 0x7f9b78004810 2023-10-07T08:44:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.297+0000 7f9b84ff9700 1 -- 172.21.15.81:0/1873707176 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c006df0 con 0x7f9b78004810 2023-10-07T08:44:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.297+0000 7f9b970eb700 1 -- 172.21.15.81:0/1873707176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b90152720 con 0x7f9b78004810 2023-10-07T08:44:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.297+0000 7f9b970eb700 1 -- 172.21.15.81:0/1873707176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b90152ce0 con 0x7f9b78004810 2023-10-07T08:44:00.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.298+0000 7f9b970eb700 1 -- 172.21.15.81:0/1873707176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b90153330 con 0x7f9b78004810 2023-10-07T08:44:00.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.298+0000 7f9b84ff9700 1 -- 172.21.15.81:0/1873707176 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b8c00cb70 con 0x7f9b78004810 2023-10-07T08:44:00.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.299+0000 7f9b84ff9700 1 --2- 172.21.15.81:0/1873707176 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b7c066f30 0x7f9b7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.299+0000 7f9b87fff700 1 --2- 172.21.15.81:0/1873707176 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b7c066f30 0x7f9b7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.299+0000 7f9b84ff9700 1 -- 172.21.15.81:0/1873707176 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9b8c084820 con 0x7f9b78004810 2023-10-07T08:44:00.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.299+0000 7f9b87fff700 1 --2- 172.21.15.81:0/1873707176 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b7c066f30 0x7f9b7c0693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9b80007fd0 tx=0x7f9b80015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:00.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.303+0000 7f9b84ff9700 1 -- 172.21.15.81:0/1873707176 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b8c051a90 con 0x7f9b78004810 2023-10-07T08:44:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.531+0000 7f9b970eb700 1 -- 172.21.15.81:0/1873707176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b900cf0d0 con 0x7f9b78004810 2023-10-07T08:44:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.532+0000 7f9b84ff9700 1 -- 172.21.15.81:0/1873707176 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f9b8c0550b0 con 0x7f9b78004810 2023-10-07T08:44:00.533 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:00.533 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1843075449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1843075449},{"type":"v1","addr":"172.21.15.81:6837","nonce":1843075449}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3013270804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3013270804},{"type":"v1","addr":"172.21.15.89:6835","nonce":3013270804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3825515993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3825515993},{"type":"v1","addr":"172.21.15.81:6836","nonce":3825515993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:43:43.620900+0000","modified":"2023-10-07T08:43:47.291987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6834/4005291324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":4005291324},{"type":"v1","addr":"172.21.15.89:6834","nonce":4005291324}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-07T08:44:00.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.534+0000 7f9b970eb700 1 -- 172.21.15.81:0/1873707176 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b7c066f30 msgr2=0x7f9b7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.534+0000 7f9b970eb700 1 --2- 172.21.15.81:0/1873707176 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b7c066f30 0x7f9b7c0693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9b80007fd0 tx=0x7f9b80015000 comp rx=0 tx=0).stop 2023-10-07T08:44:00.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.534+0000 7f9b970eb700 1 -- 172.21.15.81:0/1873707176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78004810 msgr2=0x7f9b9016b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.534+0000 7f9b970eb700 1 --2- 172.21.15.81:0/1873707176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78004810 0x7f9b9016b250 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0015c0 tx=0x7f9b8c001800 comp rx=0 tx=0).stop 2023-10-07T08:44:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.534+0000 7f9b970eb700 1 -- 172.21.15.81:0/1873707176 shutdown_connections 2023-10-07T08:44:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.534+0000 7f9b970eb700 1 --2- 172.21.15.81:0/1873707176 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b7c066f30 0x7f9b7c0693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.534+0000 7f9b970eb700 1 --2- 172.21.15.81:0/1873707176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b90151ef0 0x7f9b900c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.534+0000 7f9b970eb700 1 --2- 172.21.15.81:0/1873707176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78004810 0x7f9b9016b250 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.534+0000 7f9b970eb700 1 --2- 172.21.15.81:0/1873707176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b901534e0 0x7f9b9016a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.534+0000 7f9b970eb700 1 -- 172.21.15.81:0/1873707176 >> 172.21.15.81:0/1873707176 conn(0x7f9b9006bb90 msgr2=0x7f9b900690a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.534+0000 7f9b970eb700 1 -- 172.21.15.81:0/1873707176 shutdown_connections 2023-10-07T08:44:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.534+0000 7f9b970eb700 1 -- 172.21.15.81:0/1873707176 wait complete. 2023-10-07T08:44:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 15 2023-10-07T08:44:00.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:44:00.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.660+0000 7efd7cd47700 1 Processor -- start 2023-10-07T08:44:00.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.660+0000 7efd7cd47700 1 -- start start 2023-10-07T08:44:00.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.661+0000 7efd7cd47700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7806d830 0x7efd780cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.661+0000 7efd7cd47700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd780d07c0 con 0x7efd78157ca0 2023-10-07T08:44:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.661+0000 7efd7cd47700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd780cfbb0 con 0x7efd781578d0 2023-10-07T08:44:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.661+0000 7efd7cd47700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd780cfe90 con 0x7efd7806d830 2023-10-07T08:44:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.661+0000 7efd6dd9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efd78157ca0 0x7efd7806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59488/0 (socket says 172.21.15.81:59488) 2023-10-07T08:44:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.661+0000 7efd6dd9b700 1 -- 172.21.15.81:0/3130172955 learned_addr learned my addr 172.21.15.81:0/3130172955 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.661+0000 7efd76d9d700 1 --2- 172.21.15.81:0/3130172955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7806d830 0x7efd780cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.661+0000 7efd75d9b700 1 -- 172.21.15.81:0/3130172955 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593168284 0 0) 0x7efd780d07c0 con 0x7efd78157ca0 2023-10-07T08:44:00.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd75d9b700 1 -- 172.21.15.81:0/3130172955 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd64003570 con 0x7efd78157ca0 2023-10-07T08:44:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd75d9b700 1 -- 172.21.15.81:0/3130172955 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3248190627 0 0) 0x7efd64003570 con 0x7efd78157ca0 2023-10-07T08:44:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd75d9b700 1 -- 172.21.15.81:0/3130172955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7806d830 msgr2=0x7efd780cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd75d9b700 1 --2- 172.21.15.81:0/3130172955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7806d830 0x7efd780cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd75d9b700 1 -- 172.21.15.81:0/3130172955 >> v1:172.21.15.89:6789/0 conn(0x7efd781578d0 legacy=0x7efd7815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd75d9b700 1 -- 172.21.15.81:0/3130172955 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd780d0170 con 0x7efd78157ca0 2023-10-07T08:44:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd75d9b700 1 -- 172.21.15.81:0/3130172955 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7efd60001470 con 0x7efd78157ca0 2023-10-07T08:44:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd75d9b700 1 -- 172.21.15.81:0/3130172955 >> v1:172.21.15.81:6789/0 conn(0x7efd78157ca0 legacy=0x7efd7806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd75d9b700 1 --2- 172.21.15.81:0/3130172955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7806d830 0x7efd64003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd75d9b700 1 --2- 172.21.15.81:0/3130172955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd64003fd0 0x7efd64004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd75d9b700 1 --2- 172.21.15.81:0/3130172955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd64004d50 0x7efd640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd75d9b700 1 -- 172.21.15.81:0/3130172955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd780cfe90 con 0x7efd64004d50 2023-10-07T08:44:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd75d9b700 1 -- 172.21.15.81:0/3130172955 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6400bb40 con 0x7efd64003fd0 2023-10-07T08:44:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd75d9b700 1 -- 172.21.15.81:0/3130172955 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6400bd00 con 0x7efd7806d830 2023-10-07T08:44:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd76d9d700 1 --2- 172.21.15.81:0/3130172955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd64004d50 0x7efd640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd6dd9b700 1 --2- 172.21.15.81:0/3130172955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd64003fd0 0x7efd64004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd7659c700 1 --2- 172.21.15.81:0/3130172955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7806d830 0x7efd64003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd76d9d700 1 -- 172.21.15.81:0/3130172955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7806d830 msgr2=0x7efd64003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd76d9d700 1 --2- 172.21.15.81:0/3130172955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7806d830 0x7efd64003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd76d9d700 1 -- 172.21.15.81:0/3130172955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd64003fd0 msgr2=0x7efd64004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd76d9d700 1 --2- 172.21.15.81:0/3130172955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd64003fd0 0x7efd64004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd76d9d700 1 -- 172.21.15.81:0/3130172955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64003570 con 0x7efd64004d50 2023-10-07T08:44:00.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.662+0000 7efd76d9d700 1 --2- 172.21.15.81:0/3130172955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd64004d50 0x7efd640051c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efd7806dc30 tx=0x7efd7000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01011485d807e5e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.663+0000 7efd75d9b700 1 -- 172.21.15.81:0/3130172955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7000ea00 con 0x7efd64004d50 2023-10-07T08:44:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.663+0000 7efd75d9b700 1 -- 172.21.15.81:0/3130172955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7000f040 con 0x7efd64004d50 2023-10-07T08:44:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.663+0000 7efd75d9b700 1 -- 172.21.15.81:0/3130172955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7000edb0 con 0x7efd64004d50 2023-10-07T08:44:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.663+0000 7efd7cd47700 1 -- 172.21.15.81:0/3130172955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd64004d50 msgr2=0x7efd640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.663+0000 7efd7cd47700 1 --2- 172.21.15.81:0/3130172955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd64004d50 0x7efd640051c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efd7806dc30 tx=0x7efd7000b040 comp rx=0 tx=0).stop 2023-10-07T08:44:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.663+0000 7efd76d9d700 1 -- 172.21.15.81:0/3130172955 reap_dead start 2023-10-07T08:44:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.663+0000 7efd7cd47700 1 -- 172.21.15.81:0/3130172955 shutdown_connections 2023-10-07T08:44:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.663+0000 7efd7cd47700 1 -- 172.21.15.81:0/3130172955 >> 172.21.15.81:0/3130172955 conn(0x7efd7806bb90 msgr2=0x7efd7806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.663+0000 7efd7cd47700 1 -- 172.21.15.81:0/3130172955 shutdown_connections 2023-10-07T08:44:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.663+0000 7efd7cd47700 1 -- 172.21.15.81:0/3130172955 wait complete. 2023-10-07T08:44:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.664+0000 7efd7cd47700 1 Processor -- start 2023-10-07T08:44:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.664+0000 7efd7cd47700 1 -- start start 2023-10-07T08:44:00.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.665+0000 7efd7cd47700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd64004d50 0x7efd78154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.665+0000 7efd7cd47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78154c60 0x7efd7815c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.665+0000 7efd7cd47700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd7815cf30 0x7efd78155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.665+0000 7efd7cd47700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd781549c0 con 0x7efd78154c60 2023-10-07T08:44:00.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.665+0000 7efd7cd47700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7815c4c0 con 0x7efd7815cf30 2023-10-07T08:44:00.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.665+0000 7efd7cd47700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7815b8b0 con 0x7efd64004d50 2023-10-07T08:44:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.665+0000 7efd6dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78154c60 0x7efd7815c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.665+0000 7efd6dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78154c60 0x7efd7815c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36584/0 (socket says 172.21.15.81:36584) 2023-10-07T08:44:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.665+0000 7efd6dd9b700 1 -- 172.21.15.81:0/1883978173 learned_addr learned my addr 172.21.15.81:0/1883978173 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.665+0000 7efd7659c700 1 --2- 172.21.15.81:0/1883978173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd64004d50 0x7efd78154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.665+0000 7efd76d9d700 1 --2- 172.21.15.81:0/1883978173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd7815cf30 0x7efd78155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.665+0000 7efd6dd9b700 1 -- 172.21.15.81:0/1883978173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd64004d50 msgr2=0x7efd78154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.666+0000 7efd6dd9b700 1 --2- 172.21.15.81:0/1883978173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd64004d50 0x7efd78154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.666+0000 7efd6dd9b700 1 -- 172.21.15.81:0/1883978173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd7815cf30 msgr2=0x7efd78155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.666+0000 7efd6dd9b700 1 --2- 172.21.15.81:0/1883978173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd7815cf30 0x7efd78155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.666+0000 7efd6dd9b700 1 -- 172.21.15.81:0/1883978173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7815bb90 con 0x7efd78154c60 2023-10-07T08:44:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.666+0000 7efd6dd9b700 1 --2- 172.21.15.81:0/1883978173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78154c60 0x7efd7815c9f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efd60000e10 tx=0x7efd7815b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:00.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.666+0000 7efd6effd700 1 -- 172.21.15.81:0/1883978173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60018030 con 0x7efd78154c60 2023-10-07T08:44:00.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.666+0000 7efd6effd700 1 -- 172.21.15.81:0/1883978173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd600077d0 con 0x7efd78154c60 2023-10-07T08:44:00.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.666+0000 7efd7cd47700 1 -- 172.21.15.81:0/1883978173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7815be70 con 0x7efd78154c60 2023-10-07T08:44:00.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.666+0000 7efd6effd700 1 -- 172.21.15.81:0/1883978173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6000fab0 con 0x7efd78154c60 2023-10-07T08:44:00.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.666+0000 7efd7cd47700 1 -- 172.21.15.81:0/1883978173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd78155dd0 con 0x7efd78154c60 2023-10-07T08:44:00.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.667+0000 7efd7cd47700 1 -- 172.21.15.81:0/1883978173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7815ac10 con 0x7efd78154c60 2023-10-07T08:44:00.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.667+0000 7efd6effd700 1 -- 172.21.15.81:0/1883978173 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd6001b070 con 0x7efd78154c60 2023-10-07T08:44:00.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.667+0000 7efd6effd700 1 --2- 172.21.15.81:0/1883978173 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efd58066f30 0x7efd580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.668+0000 7efd6effd700 1 -- 172.21.15.81:0/1883978173 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd60019070 con 0x7efd78154c60 2023-10-07T08:44:00.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.668+0000 7efd7659c700 1 --2- 172.21.15.81:0/1883978173 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efd58066f30 0x7efd580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.668+0000 7efd7659c700 1 --2- 172.21.15.81:0/1883978173 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efd58066f30 0x7efd580693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efd68001050 tx=0x7efd68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:00.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.672+0000 7efd6effd700 1 -- 172.21.15.81:0/1883978173 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd60051600 con 0x7efd78154c60 2023-10-07T08:44:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.853+0000 7efd7cd47700 1 -- 172.21.15.81:0/1883978173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd780cead0 con 0x7efd78154c60 2023-10-07T08:44:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.854+0000 7efd6effd700 1 -- 172.21.15.81:0/1883978173 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+15302 (secure 0 0 0) 0x7efd60054c20 con 0x7efd78154c60 2023-10-07T08:44:00.855 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:00.855 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":35,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:43:55.325199+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:43:41.595379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-07T08:43:42.590185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:44:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.856+0000 7efd7cd47700 1 -- 172.21.15.81:0/1883978173 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efd58066f30 msgr2=0x7efd580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.856+0000 7efd7cd47700 1 --2- 172.21.15.81:0/1883978173 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efd58066f30 0x7efd580693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efd68001050 tx=0x7efd68009040 comp rx=0 tx=0).stop 2023-10-07T08:44:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.856+0000 7efd7cd47700 1 -- 172.21.15.81:0/1883978173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78154c60 msgr2=0x7efd7815c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.856+0000 7efd7cd47700 1 --2- 172.21.15.81:0/1883978173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78154c60 0x7efd7815c9f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efd60000e10 tx=0x7efd7815b610 comp rx=0 tx=0).stop 2023-10-07T08:44:00.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.856+0000 7efd7cd47700 1 -- 172.21.15.81:0/1883978173 shutdown_connections 2023-10-07T08:44:00.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.856+0000 7efd7cd47700 1 --2- 172.21.15.81:0/1883978173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd7815cf30 0x7efd78155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.856+0000 7efd7cd47700 1 --2- 172.21.15.81:0/1883978173 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efd58066f30 0x7efd580693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.856+0000 7efd7cd47700 1 --2- 172.21.15.81:0/1883978173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd64004d50 0x7efd78154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.856+0000 7efd7cd47700 1 --2- 172.21.15.81:0/1883978173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78154c60 0x7efd7815c9f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.856+0000 7efd7cd47700 1 -- 172.21.15.81:0/1883978173 >> 172.21.15.81:0/1883978173 conn(0x7efd7806bb90 msgr2=0x7efd781569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:00.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.856+0000 7efd7cd47700 1 -- 172.21.15.81:0/1883978173 shutdown_connections 2023-10-07T08:44:00.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.856+0000 7efd7cd47700 1 -- 172.21.15.81:0/1883978173 wait complete. 2023-10-07T08:44:00.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T08:44:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.981+0000 7f6a3ab50700 1 Processor -- start 2023-10-07T08:44:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.981+0000 7f6a3ab50700 1 -- start start 2023-10-07T08:44:00.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.982+0000 7f6a3ab50700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6a340b3bd0 0x7f6a340ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.982+0000 7f6a3ab50700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a340b2890 con 0x7f6a34157fe0 2023-10-07T08:44:00.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.982+0000 7f6a3ab50700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a340b4070 con 0x7f6a341583b0 2023-10-07T08:44:00.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.982+0000 7f6a3ab50700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a340b4350 con 0x7f6a340b3bd0 2023-10-07T08:44:00.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.982+0000 7f6a388ec700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6a34157fe0 0x7f6a340b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59502/0 (socket says 172.21.15.81:59502) 2023-10-07T08:44:00.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.982+0000 7f6a388ec700 1 -- 172.21.15.81:0/2303812462 learned_addr learned my addr 172.21.15.81:0/2303812462 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:00.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.982+0000 7f6a33fff700 1 --2- 172.21.15.81:0/2303812462 >> v2:172.21.15.89:3300/0 conn(0x7f6a340b3bd0 0x7f6a340ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a337fe700 1 -- 172.21.15.81:0/2303812462 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689486165 0 0) 0x7f6a340b2890 con 0x7f6a34157fe0 2023-10-07T08:44:00.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a337fe700 1 -- 172.21.15.81:0/2303812462 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a1c003570 con 0x7f6a34157fe0 2023-10-07T08:44:00.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a337fe700 1 -- 172.21.15.81:0/2303812462 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1468287539 0 0) 0x7f6a1c003570 con 0x7f6a34157fe0 2023-10-07T08:44:00.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a337fe700 1 -- 172.21.15.81:0/2303812462 >> v2:172.21.15.89:3300/0 conn(0x7f6a340b3bd0 msgr2=0x7f6a340ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a337fe700 1 --2- 172.21.15.81:0/2303812462 >> v2:172.21.15.89:3300/0 conn(0x7f6a340b3bd0 0x7f6a340ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a337fe700 1 -- 172.21.15.81:0/2303812462 >> v1:172.21.15.89:6789/0 conn(0x7f6a341583b0 legacy=0x7f6a34158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a337fe700 1 -- 172.21.15.81:0/2303812462 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a340b4630 con 0x7f6a34157fe0 2023-10-07T08:44:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a337fe700 1 -- 172.21.15.81:0/2303812462 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f6a240017f0 con 0x7f6a34157fe0 2023-10-07T08:44:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a337fe700 1 -- 172.21.15.81:0/2303812462 >> v1:172.21.15.81:6789/0 conn(0x7f6a34157fe0 legacy=0x7f6a340b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a337fe700 1 --2- 172.21.15.81:0/2303812462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a1c003a60 0x7f6a1c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a337fe700 1 --2- 172.21.15.81:0/2303812462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a1c004810 0x7f6a1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a337fe700 1 --2- 172.21.15.81:0/2303812462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c0051c0 0x7f6a1c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a337fe700 1 -- 172.21.15.81:0/2303812462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340b4350 con 0x7f6a1c004810 2023-10-07T08:44:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a337fe700 1 -- 172.21.15.81:0/2303812462 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c00c160 con 0x7f6a1c0051c0 2023-10-07T08:44:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a337fe700 1 -- 172.21.15.81:0/2303812462 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c00c320 con 0x7f6a1c003a60 2023-10-07T08:44:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a33fff700 1 --2- 172.21.15.81:0/2303812462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a1c004810 0x7f6a1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a388ec700 1 --2- 172.21.15.81:0/2303812462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a1c003a60 0x7f6a1c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a390ed700 1 --2- 172.21.15.81:0/2303812462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c0051c0 0x7f6a1c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a33fff700 1 -- 172.21.15.81:0/2303812462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a1c003a60 msgr2=0x7f6a1c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a33fff700 1 --2- 172.21.15.81:0/2303812462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a1c003a60 0x7f6a1c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a33fff700 1 -- 172.21.15.81:0/2303812462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c0051c0 msgr2=0x7f6a1c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a33fff700 1 --2- 172.21.15.81:0/2303812462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c0051c0 0x7f6a1c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a33fff700 1 -- 172.21.15.81:0/2303812462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c003570 con 0x7f6a1c004810 2023-10-07T08:44:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a390ed700 1 --2- 172.21.15.81:0/2303812462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c0051c0 0x7f6a1c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a390ed700 1 -- 172.21.15.81:0/2303812462 reap_dead start 2023-10-07T08:44:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a33fff700 1 --2- 172.21.15.81:0/2303812462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a1c004810 0x7f6a1c004c80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6a340b3fa0 tx=0x7f6a280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bccaa182470876 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.983+0000 7f6a337fe700 1 -- 172.21.15.81:0/2303812462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2800e710 con 0x7f6a1c004810 2023-10-07T08:44:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.984+0000 7f6a337fe700 1 -- 172.21.15.81:0/2303812462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2800e870 con 0x7f6a1c004810 2023-10-07T08:44:00.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.984+0000 7f6a337fe700 1 -- 172.21.15.81:0/2303812462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2800ec30 con 0x7f6a1c004810 2023-10-07T08:44:00.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.984+0000 7f6a3ab50700 1 -- 172.21.15.81:0/2303812462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a1c004810 msgr2=0x7f6a1c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.984+0000 7f6a3ab50700 1 --2- 172.21.15.81:0/2303812462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a1c004810 0x7f6a1c004c80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6a340b3fa0 tx=0x7f6a280091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.984+0000 7f6a3ab50700 1 -- 172.21.15.81:0/2303812462 shutdown_connections 2023-10-07T08:44:00.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.984+0000 7f6a3ab50700 1 --2- 172.21.15.81:0/2303812462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a1c004810 0x7f6a1c004c80 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.984+0000 7f6a3ab50700 1 -- 172.21.15.81:0/2303812462 >> 172.21.15.81:0/2303812462 conn(0x7f6a34067640 msgr2=0x7f6a34067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:00.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.984+0000 7f6a3ab50700 1 -- 172.21.15.81:0/2303812462 shutdown_connections 2023-10-07T08:44:00.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.984+0000 7f6a3ab50700 1 -- 172.21.15.81:0/2303812462 wait complete. 2023-10-07T08:44:00.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.985+0000 7f6a3ab50700 1 Processor -- start 2023-10-07T08:44:00.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.985+0000 7f6a3ab50700 1 -- start start 2023-10-07T08:44:00.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a3ab50700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c004810 0x7f6a340c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a3ab50700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a340c4190 0x7f6a34168a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a3ab50700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a34168f70 0x7f6a341693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a3ab50700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34169930 con 0x7f6a340c4190 2023-10-07T08:44:00.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a3ab50700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340c53b0 con 0x7f6a1c004810 2023-10-07T08:44:00.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a3ab50700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340c6040 con 0x7f6a34168f70 2023-10-07T08:44:00.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a33fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a340c4190 0x7f6a34168a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a33fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a340c4190 0x7f6a34168a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36606/0 (socket says 172.21.15.81:36606) 2023-10-07T08:44:00.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a33fff700 1 -- 172.21.15.81:0/3929752501 learned_addr learned my addr 172.21.15.81:0/3929752501 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:00.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a390ed700 1 --2- 172.21.15.81:0/3929752501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a34168f70 0x7f6a341693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a388ec700 1 --2- 172.21.15.81:0/3929752501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c004810 0x7f6a340c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a33fff700 1 -- 172.21.15.81:0/3929752501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a34168f70 msgr2=0x7f6a341693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a33fff700 1 --2- 172.21.15.81:0/3929752501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a34168f70 0x7f6a341693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a33fff700 1 -- 172.21.15.81:0/3929752501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c004810 msgr2=0x7f6a340c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a33fff700 1 --2- 172.21.15.81:0/3929752501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c004810 0x7f6a340c3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a33fff700 1 -- 172.21.15.81:0/3929752501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a340c47a0 con 0x7f6a340c4190 2023-10-07T08:44:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.986+0000 7f6a390ed700 1 --2- 172.21.15.81:0/3929752501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a34168f70 0x7f6a341693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.987+0000 7f6a33fff700 1 --2- 172.21.15.81:0/3929752501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a340c4190 0x7f6a34168a30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800e4b0 tx=0x7f6a2801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.987+0000 7f6a30ff9700 1 -- 172.21.15.81:0/3929752501 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28022070 con 0x7f6a340c4190 2023-10-07T08:44:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.987+0000 7f6a30ff9700 1 -- 172.21.15.81:0/3929752501 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2800e9e0 con 0x7f6a340c4190 2023-10-07T08:44:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.987+0000 7f6a3ab50700 1 -- 172.21.15.81:0/3929752501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a340c4a80 con 0x7f6a340c4190 2023-10-07T08:44:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.987+0000 7f6a30ff9700 1 -- 172.21.15.81:0/3929752501 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2801c450 con 0x7f6a340c4190 2023-10-07T08:44:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.987+0000 7f6a3ab50700 1 -- 172.21.15.81:0/3929752501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a340c5040 con 0x7f6a340c4190 2023-10-07T08:44:00.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.988+0000 7f6a3ab50700 1 -- 172.21.15.81:0/3929752501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a340b0ba0 con 0x7f6a340c4190 2023-10-07T08:44:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.988+0000 7f6a30ff9700 1 -- 172.21.15.81:0/3929752501 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a2801c860 con 0x7f6a340c4190 2023-10-07T08:44:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.988+0000 7f6a30ff9700 1 --2- 172.21.15.81:0/3929752501 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a20066f30 0x7f6a200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.989+0000 7f6a30ff9700 1 -- 172.21.15.81:0/3929752501 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a28085d20 con 0x7f6a340c4190 2023-10-07T08:44:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.989+0000 7f6a388ec700 1 --2- 172.21.15.81:0/3929752501 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a20066f30 0x7f6a200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.989+0000 7f6a388ec700 1 --2- 172.21.15.81:0/3929752501 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a20066f30 0x7f6a200693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6a24001190 tx=0x7f6a24006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:00.993+0000 7f6a30ff9700 1 -- 172.21.15.81:0/3929752501 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a28052f90 con 0x7f6a340c4190 2023-10-07T08:44:01.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.214+0000 7f6a3ab50700 1 -- 172.21.15.81:0/3929752501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6a340b0650 con 0x7f6a340c4190 2023-10-07T08:44:01.216 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:44:01.214+0000 7f43c472d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T08:44:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.220+0000 7f6a30ff9700 1 -- 172.21.15.81:0/3929752501 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6a28017090 con 0x7f6a340c4190 2023-10-07T08:44:01.223 INFO:tasks.ceph.mds.d.smithi089.stderr: -3354> 2023-10-07T08:43:47.090+0000 7f06a5cab700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:44:01.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.223+0000 7f6a3ab50700 1 -- 172.21.15.81:0/3929752501 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a20066f30 msgr2=0x7f6a200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:01.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.223+0000 7f6a3ab50700 1 --2- 172.21.15.81:0/3929752501 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a20066f30 0x7f6a200693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6a24001190 tx=0x7f6a24006040 comp rx=0 tx=0).stop 2023-10-07T08:44:01.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.223+0000 7f6a3ab50700 1 -- 172.21.15.81:0/3929752501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a340c4190 msgr2=0x7f6a34168a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:01.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.223+0000 7f6a3ab50700 1 --2- 172.21.15.81:0/3929752501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a340c4190 0x7f6a34168a30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800e4b0 tx=0x7f6a2801a000 comp rx=0 tx=0).stop 2023-10-07T08:44:01.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.223+0000 7f6a3ab50700 1 -- 172.21.15.81:0/3929752501 shutdown_connections 2023-10-07T08:44:01.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.223+0000 7f6a3ab50700 1 --2- 172.21.15.81:0/3929752501 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a20066f30 0x7f6a200693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:01.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.223+0000 7f6a3ab50700 1 --2- 172.21.15.81:0/3929752501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a34168f70 0x7f6a341693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:01.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.223+0000 7f6a3ab50700 1 --2- 172.21.15.81:0/3929752501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c004810 0x7f6a340c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:01.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.223+0000 7f6a3ab50700 1 --2- 172.21.15.81:0/3929752501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a340c4190 0x7f6a34168a30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:01.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.223+0000 7f6a3ab50700 1 -- 172.21.15.81:0/3929752501 >> 172.21.15.81:0/3929752501 conn(0x7f6a34067640 msgr2=0x7f6a340cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:01.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.223+0000 7f6a3ab50700 1 -- 172.21.15.81:0/3929752501 shutdown_connections 2023-10-07T08:44:01.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.223+0000 7f6a3ab50700 1 -- 172.21.15.81:0/3929752501 wait complete. 2023-10-07T08:44:01.226 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T08:44:01.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T08:44:01.247 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-10-07T08:44:01.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.352+0000 7f7e8d437700 1 Processor -- start 2023-10-07T08:44:01.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.352+0000 7f7e8d437700 1 -- start start 2023-10-07T08:44:01.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.353+0000 7f7e8d437700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e8815b2f0 0x7f7e880c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:01.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.353+0000 7f7e8d437700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8806ee10 con 0x7f7e8806f2a0 2023-10-07T08:44:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.353+0000 7f7e8d437700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8806e200 con 0x7f7e880c8b60 2023-10-07T08:44:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.353+0000 7f7e8d437700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8806e4e0 con 0x7f7e8815b2f0 2023-10-07T08:44:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.353+0000 7f7e877fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e8815b2f0 0x7f7e880c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.353+0000 7f7e8cc36700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7e8806f2a0 0x7f7e880ac8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59514/0 (socket says 172.21.15.81:59514) 2023-10-07T08:44:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.353+0000 7f7e8cc36700 1 -- 172.21.15.81:0/850150176 learned_addr learned my addr 172.21.15.81:0/850150176 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.353+0000 7f7e877fe700 1 -- 172.21.15.81:0/850150176 >> v1:172.21.15.89:6789/0 conn(0x7f7e880c8b60 legacy=0x7f7e880ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.353+0000 7f7e877fe700 1 -- 172.21.15.81:0/850150176 >> v1:172.21.15.81:6789/0 conn(0x7f7e8806f2a0 legacy=0x7f7e880ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.353+0000 7f7e877fe700 1 -- 172.21.15.81:0/850150176 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8806e7c0 con 0x7f7e8815b2f0 2023-10-07T08:44:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.353+0000 7f7e86ffd700 1 -- 172.21.15.81:0/850150176 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728922093 0 0) 0x7f7e8806ee10 con 0x7f7e8806f2a0 2023-10-07T08:44:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.353+0000 7f7e877fe700 1 --2- 172.21.15.81:0/850150176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8815b2f0 0x7f7e880c8f30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009910 tx=0x7f7e780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9852a6f153543e19 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.353+0000 7f7e86ffd700 1 -- 172.21.15.81:0/850150176 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7800b7e0 con 0x7f7e8815b2f0 2023-10-07T08:44:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.353+0000 7f7e86ffd700 1 -- 172.21.15.81:0/850150176 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7800b940 con 0x7f7e8815b2f0 2023-10-07T08:44:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.353+0000 7f7e86ffd700 1 -- 172.21.15.81:0/850150176 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7800bce0 con 0x7f7e8815b2f0 2023-10-07T08:44:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.354+0000 7f7e8d437700 1 -- 172.21.15.81:0/850150176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8815b2f0 msgr2=0x7f7e880c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.354+0000 7f7e8d437700 1 --2- 172.21.15.81:0/850150176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8815b2f0 0x7f7e880c8f30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009910 tx=0x7f7e780091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.354+0000 7f7e8d437700 1 -- 172.21.15.81:0/850150176 shutdown_connections 2023-10-07T08:44:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.354+0000 7f7e8d437700 1 --2- 172.21.15.81:0/850150176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8815b2f0 0x7f7e880c8f30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.354+0000 7f7e8d437700 1 -- 172.21.15.81:0/850150176 >> 172.21.15.81:0/850150176 conn(0x7f7e8806cca0 msgr2=0x7f7e8806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.354+0000 7f7e8d437700 1 -- 172.21.15.81:0/850150176 shutdown_connections 2023-10-07T08:44:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.354+0000 7f7e8d437700 1 -- 172.21.15.81:0/850150176 wait complete. 2023-10-07T08:44:01.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.355+0000 7f7e8d437700 1 Processor -- start 2023-10-07T08:44:01.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.355+0000 7f7e8d437700 1 -- start start 2023-10-07T08:44:01.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e8d437700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8806f2a0 0x7f7e881554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:01.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e8d437700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e880c8b60 0x7f7e880c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:01.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e8d437700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e8815b2f0 0x7f7e88168690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:01.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e8d437700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880c6880 con 0x7f7e8806f2a0 2023-10-07T08:44:01.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e8d437700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e88155a20 con 0x7f7e880c8b60 2023-10-07T08:44:01.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e8d437700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e88169190 con 0x7f7e8815b2f0 2023-10-07T08:44:01.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e87fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8806f2a0 0x7f7e881554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:01.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e87fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8806f2a0 0x7f7e881554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36622/0 (socket says 172.21.15.81:36622) 2023-10-07T08:44:01.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e87fff700 1 -- 172.21.15.81:0/203132594 learned_addr learned my addr 172.21.15.81:0/203132594 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:01.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e877fe700 1 --2- 172.21.15.81:0/203132594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e880c8b60 0x7f7e880c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:01.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e8cc36700 1 --2- 172.21.15.81:0/203132594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e8815b2f0 0x7f7e88168690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:01.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e87fff700 1 -- 172.21.15.81:0/203132594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e8815b2f0 msgr2=0x7f7e88168690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:01.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e87fff700 1 --2- 172.21.15.81:0/203132594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e8815b2f0 0x7f7e88168690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:01.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e87fff700 1 -- 172.21.15.81:0/203132594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e880c8b60 msgr2=0x7f7e880c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:01.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e87fff700 1 --2- 172.21.15.81:0/203132594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e880c8b60 0x7f7e880c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:01.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e87fff700 1 -- 172.21.15.81:0/203132594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e78009420 con 0x7f7e8806f2a0 2023-10-07T08:44:01.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e877fe700 1 --2- 172.21.15.81:0/203132594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e880c8b60 0x7f7e880c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:01.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e8cc36700 1 --2- 172.21.15.81:0/203132594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e8815b2f0 0x7f7e88168690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:01.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.356+0000 7f7e87fff700 1 --2- 172.21.15.81:0/203132594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8806f2a0 0x7f7e881554e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00c5d0 tx=0x7f7e7c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:01.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.357+0000 7f7e6ffff700 1 -- 172.21.15.81:0/203132594 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c011590 con 0x7f7e8806f2a0 2023-10-07T08:44:01.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.357+0000 7f7e6ffff700 1 -- 172.21.15.81:0/203132594 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c011710 con 0x7f7e8806f2a0 2023-10-07T08:44:01.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.357+0000 7f7e8d437700 1 -- 172.21.15.81:0/203132594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e88169470 con 0x7f7e8806f2a0 2023-10-07T08:44:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.357+0000 7f7e6ffff700 1 -- 172.21.15.81:0/203132594 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c011ad0 con 0x7f7e8806f2a0 2023-10-07T08:44:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.357+0000 7f7e8d437700 1 -- 172.21.15.81:0/203132594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e880cdd90 con 0x7f7e8806f2a0 2023-10-07T08:44:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.357+0000 7f7e8d437700 1 -- 172.21.15.81:0/203132594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e881696b0 con 0x7f7e8806f2a0 2023-10-07T08:44:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.358+0000 7f7e6ffff700 1 -- 172.21.15.81:0/203132594 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e7c01c460 con 0x7f7e8806f2a0 2023-10-07T08:44:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.358+0000 7f7e6ffff700 1 --2- 172.21.15.81:0/203132594 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e74066f30 0x7f7e740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.358+0000 7f7e6ffff700 1 -- 172.21.15.81:0/203132594 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f7e7c084380 con 0x7f7e8806f2a0 2023-10-07T08:44:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.358+0000 7f7e877fe700 1 --2- 172.21.15.81:0/203132594 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e74066f30 0x7f7e740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.359+0000 7f7e877fe700 1 --2- 172.21.15.81:0/203132594 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e74066f30 0x7f7e740693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009910 tx=0x7f7e78016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.362+0000 7f7e6ffff700 1 -- 172.21.15.81:0/203132594 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e881696b0 con 0x7f7e8806f2a0 2023-10-07T08:44:01.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:01.587+0000 7f7e8d437700 1 -- 172.21.15.81:0/203132594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7e880c6370 con 0x7f7e8806f2a0 2023-10-07T08:44:02.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.219+0000 7f7e6ffff700 1 -- 172.21.15.81:0/203132594 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7e880c6370 con 0x7f7e8806f2a0 2023-10-07T08:44:02.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.221+0000 7f7e8d437700 1 -- 172.21.15.81:0/203132594 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e74066f30 msgr2=0x7f7e740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:02.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.221+0000 7f7e8d437700 1 --2- 172.21.15.81:0/203132594 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e74066f30 0x7f7e740693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009910 tx=0x7f7e78016000 comp rx=0 tx=0).stop 2023-10-07T08:44:02.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.221+0000 7f7e8d437700 1 -- 172.21.15.81:0/203132594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8806f2a0 msgr2=0x7f7e881554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:02.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.221+0000 7f7e8d437700 1 --2- 172.21.15.81:0/203132594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8806f2a0 0x7f7e881554e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00c5d0 tx=0x7f7e7c007f60 comp rx=0 tx=0).stop 2023-10-07T08:44:02.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.221+0000 7f7e8d437700 1 -- 172.21.15.81:0/203132594 shutdown_connections 2023-10-07T08:44:02.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.221+0000 7f7e8d437700 1 --2- 172.21.15.81:0/203132594 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e74066f30 0x7f7e740693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:02.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.221+0000 7f7e8d437700 1 --2- 172.21.15.81:0/203132594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e8815b2f0 0x7f7e88168690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:02.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.221+0000 7f7e8d437700 1 --2- 172.21.15.81:0/203132594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8806f2a0 0x7f7e881554e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:02.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.221+0000 7f7e8d437700 1 --2- 172.21.15.81:0/203132594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e880c8b60 0x7f7e880c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:02.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.222+0000 7f7e8d437700 1 -- 172.21.15.81:0/203132594 >> 172.21.15.81:0/203132594 conn(0x7f7e8806cca0 msgr2=0x7f7e880ca080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:02.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.222+0000 7f7e8d437700 1 -- 172.21.15.81:0/203132594 shutdown_connections 2023-10-07T08:44:02.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.222+0000 7f7e8d437700 1 -- 172.21.15.81:0/203132594 wait complete. 2023-10-07T08:44:02.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T08:44:02.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.356+0000 7f532b5d6700 1 Processor -- start 2023-10-07T08:44:02.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.356+0000 7f532b5d6700 1 -- start start 2023-10-07T08:44:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.357+0000 7f532b5d6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f53240c2c20 0x7f53240af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.357+0000 7f532b5d6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53240c30c0 0x7f53240afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.357+0000 7f532b5d6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5324158100 con 0x7f53240c6fc0 2023-10-07T08:44:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.357+0000 7f532b5d6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53240b0310 con 0x7f53240c2c20 2023-10-07T08:44:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.357+0000 7f532b5d6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53240c2790 con 0x7f53240c30c0 2023-10-07T08:44:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.357+0000 7f5329372700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f53240c6fc0 0x7f53240c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57038/0 (socket says 172.21.15.81:57038) 2023-10-07T08:44:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.357+0000 7f5329372700 1 -- 172.21.15.81:0/191806088 learned_addr learned my addr 172.21.15.81:0/191806088 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.357+0000 7f5328b71700 1 --2- 172.21.15.81:0/191806088 >> v2:172.21.15.89:3300/0 conn(0x7f53240c2c20 0x7f53240af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.357+0000 7f5329b73700 1 --2- 172.21.15.81:0/191806088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53240c30c0 0x7f53240afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.357+0000 7f531bfff700 1 -- 172.21.15.81:0/191806088 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684097461 0 0) 0x7f5324158100 con 0x7f53240c6fc0 2023-10-07T08:44:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.357+0000 7f531bfff700 1 -- 172.21.15.81:0/191806088 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5310003570 con 0x7f53240c6fc0 2023-10-07T08:44:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.358+0000 7f5329b73700 1 -- 172.21.15.81:0/191806088 >> v2:172.21.15.89:3300/0 conn(0x7f53240c2c20 msgr2=0x7f53240af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.358+0000 7f5329b73700 1 --2- 172.21.15.81:0/191806088 >> v2:172.21.15.89:3300/0 conn(0x7f53240c2c20 0x7f53240af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.358+0000 7f5329b73700 1 -- 172.21.15.81:0/191806088 >> v1:172.21.15.81:6789/0 conn(0x7f53240c6fc0 legacy=0x7f53240c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.358+0000 7f5329b73700 1 -- 172.21.15.81:0/191806088 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5324068c50 con 0x7f53240c30c0 2023-10-07T08:44:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.358+0000 7f5328b71700 1 --2- 172.21.15.81:0/191806088 >> v2:172.21.15.89:3300/0 conn(0x7f53240c2c20 0x7f53240af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:44:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.358+0000 7f5329b73700 1 --2- 172.21.15.81:0/191806088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53240c30c0 0x7f53240afdd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f531c0098e0 tx=0x7f531c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e0426b84d060876 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:02.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.358+0000 7f531bfff700 1 -- 172.21.15.81:0/191806088 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c011630 con 0x7f53240c30c0 2023-10-07T08:44:02.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.358+0000 7f531bfff700 1 -- 172.21.15.81:0/191806088 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c011790 con 0x7f53240c30c0 2023-10-07T08:44:02.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.358+0000 7f531bfff700 1 -- 172.21.15.81:0/191806088 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c011b30 con 0x7f53240c30c0 2023-10-07T08:44:02.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.359+0000 7f532b5d6700 1 -- 172.21.15.81:0/191806088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53240c30c0 msgr2=0x7f53240afdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:02.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.359+0000 7f532b5d6700 1 --2- 172.21.15.81:0/191806088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53240c30c0 0x7f53240afdd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f531c0098e0 tx=0x7f531c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:02.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.359+0000 7f532b5d6700 1 -- 172.21.15.81:0/191806088 shutdown_connections 2023-10-07T08:44:02.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.359+0000 7f532b5d6700 1 --2- 172.21.15.81:0/191806088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53240c30c0 0x7f53240afdd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:02.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.359+0000 7f532b5d6700 1 --2- 172.21.15.81:0/191806088 >> v2:172.21.15.89:3300/0 conn(0x7f53240c2c20 0x7f53240af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:02.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.359+0000 7f532b5d6700 1 -- 172.21.15.81:0/191806088 >> 172.21.15.81:0/191806088 conn(0x7f532406c660 msgr2=0x7f53240cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:02.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.359+0000 7f532b5d6700 1 -- 172.21.15.81:0/191806088 shutdown_connections 2023-10-07T08:44:02.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.359+0000 7f532b5d6700 1 -- 172.21.15.81:0/191806088 wait complete. 2023-10-07T08:44:02.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.360+0000 7f532b5d6700 1 Processor -- start 2023-10-07T08:44:02.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.360+0000 7f532b5d6700 1 -- start start 2023-10-07T08:44:02.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f532b5d6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53240c2c20 0x7f532415bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:02.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f532b5d6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53240c30c0 0x7f532415c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:02.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f532b5d6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53240c6fc0 0x7f532416b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:02.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f532b5d6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53240a67b0 con 0x7f53240c2c20 2023-10-07T08:44:02.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f532b5d6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53241694f0 con 0x7f53240c30c0 2023-10-07T08:44:02.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f532b5d6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532415c8c0 con 0x7f53240c6fc0 2023-10-07T08:44:02.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f5329372700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53240c2c20 0x7f532415bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:02.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f5329372700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53240c2c20 0x7f532415bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39664/0 (socket says 172.21.15.81:39664) 2023-10-07T08:44:02.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f5329372700 1 -- 172.21.15.81:0/2457112757 learned_addr learned my addr 172.21.15.81:0/2457112757 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:02.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f5328b71700 1 --2- 172.21.15.81:0/2457112757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53240c30c0 0x7f532415c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:02.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f5329b73700 1 --2- 172.21.15.81:0/2457112757 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53240c6fc0 0x7f532416b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:02.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f5329372700 1 -- 172.21.15.81:0/2457112757 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53240c6fc0 msgr2=0x7f532416b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f5329372700 1 --2- 172.21.15.81:0/2457112757 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53240c6fc0 0x7f532416b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f5329372700 1 -- 172.21.15.81:0/2457112757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53240c30c0 msgr2=0x7f532415c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f5329372700 1 --2- 172.21.15.81:0/2457112757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53240c30c0 0x7f532415c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f5329372700 1 -- 172.21.15.81:0/2457112757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5314009420 con 0x7f53240c2c20 2023-10-07T08:44:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f5328b71700 1 --2- 172.21.15.81:0/2457112757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53240c30c0 0x7f532415c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f5329372700 1 --2- 172.21.15.81:0/2457112757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53240c2c20 0x7f532415bce0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f532000cc40 tx=0x7f5320001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f53197fa700 1 -- 172.21.15.81:0/2457112757 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532000a9c0 con 0x7f53240c2c20 2023-10-07T08:44:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f53197fa700 1 -- 172.21.15.81:0/2457112757 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532000ab40 con 0x7f53240c2c20 2023-10-07T08:44:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f53197fa700 1 -- 172.21.15.81:0/2457112757 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53200070f0 con 0x7f53240c2c20 2023-10-07T08:44:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f532b5d6700 1 -- 172.21.15.81:0/2457112757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531c009420 con 0x7f53240c2c20 2023-10-07T08:44:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.361+0000 7f532b5d6700 1 -- 172.21.15.81:0/2457112757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5324169a70 con 0x7f53240c2c20 2023-10-07T08:44:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.362+0000 7f532b5d6700 1 -- 172.21.15.81:0/2457112757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5324169c90 con 0x7f53240c2c20 2023-10-07T08:44:02.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.363+0000 7f53197fa700 1 -- 172.21.15.81:0/2457112757 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5320007520 con 0x7f53240c2c20 2023-10-07T08:44:02.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.363+0000 7f53197fa700 1 --2- 172.21.15.81:0/2457112757 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5308066f30 0x7f53080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:02.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.363+0000 7f53197fa700 1 -- 172.21.15.81:0/2457112757 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f5320084a00 con 0x7f53240c2c20 2023-10-07T08:44:02.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.363+0000 7f5328b71700 1 --2- 172.21.15.81:0/2457112757 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5308066f30 0x7f53080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:02.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.363+0000 7f5328b71700 1 --2- 172.21.15.81:0/2457112757 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5308066f30 0x7f53080693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f53140093f0 tx=0x7f5314008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:02.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.367+0000 7f53197fa700 1 -- 172.21.15.81:0/2457112757 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5320051ca0 con 0x7f53240c2c20 2023-10-07T08:44:02.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:02.550+0000 7f532b5d6700 1 -- 172.21.15.81:0/2457112757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f53240c1b80 con 0x7f53240c2c20 2023-10-07T08:44:03.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.356+0000 7f53197fa700 1 -- 172.21.15.81:0/2457112757 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7f53200552c0 con 0x7f53240c2c20 2023-10-07T08:44:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.359+0000 7f532b5d6700 1 -- 172.21.15.81:0/2457112757 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5308066f30 msgr2=0x7f53080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.359+0000 7f532b5d6700 1 --2- 172.21.15.81:0/2457112757 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5308066f30 0x7f53080693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f53140093f0 tx=0x7f5314008040 comp rx=0 tx=0).stop 2023-10-07T08:44:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.359+0000 7f532b5d6700 1 -- 172.21.15.81:0/2457112757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53240c2c20 msgr2=0x7f532415bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.359+0000 7f532b5d6700 1 --2- 172.21.15.81:0/2457112757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53240c2c20 0x7f532415bce0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f532000cc40 tx=0x7f5320001a70 comp rx=0 tx=0).stop 2023-10-07T08:44:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.359+0000 7f532b5d6700 1 -- 172.21.15.81:0/2457112757 shutdown_connections 2023-10-07T08:44:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.359+0000 7f532b5d6700 1 --2- 172.21.15.81:0/2457112757 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5308066f30 0x7f53080693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.359+0000 7f532b5d6700 1 --2- 172.21.15.81:0/2457112757 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53240c6fc0 0x7f532416b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.359+0000 7f532b5d6700 1 --2- 172.21.15.81:0/2457112757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53240c2c20 0x7f532415bce0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.359+0000 7f532b5d6700 1 --2- 172.21.15.81:0/2457112757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53240c30c0 0x7f532415c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.359+0000 7f532b5d6700 1 -- 172.21.15.81:0/2457112757 >> 172.21.15.81:0/2457112757 conn(0x7f532406c660 msgr2=0x7f532406a370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.360+0000 7f532b5d6700 1 -- 172.21.15.81:0/2457112757 shutdown_connections 2023-10-07T08:44:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.360+0000 7f532b5d6700 1 -- 172.21.15.81:0/2457112757 wait complete. 2023-10-07T08:44:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-07T08:44:03.375 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T08:44:03.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.496+0000 7f04acaa9700 1 Processor -- start 2023-10-07T08:44:03.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.496+0000 7f04acaa9700 1 -- start start 2023-10-07T08:44:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.497+0000 7f04acaa9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f04a806d830 0x7f04a80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.497+0000 7f04acaa9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a80d07c0 con 0x7f04a8157ca0 2023-10-07T08:44:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.497+0000 7f04acaa9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a80cfbb0 con 0x7f04a81578d0 2023-10-07T08:44:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.497+0000 7f04acaa9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a80cfe90 con 0x7f04a806d830 2023-10-07T08:44:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.497+0000 7f049dd9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f04a8157ca0 0x7f04a806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57052/0 (socket says 172.21.15.81:57052) 2023-10-07T08:44:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.497+0000 7f049dd9b700 1 -- 172.21.15.81:0/2918122702 learned_addr learned my addr 172.21.15.81:0/2918122702 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.497+0000 7f04a6d9d700 1 --2- 172.21.15.81:0/2918122702 >> v2:172.21.15.89:3300/0 conn(0x7f04a806d830 0x7f04a80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.497+0000 7f04a5d9b700 1 -- 172.21.15.81:0/2918122702 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055184465 0 0) 0x7f04a80d07c0 con 0x7f04a8157ca0 2023-10-07T08:44:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.497+0000 7f04a5d9b700 1 -- 172.21.15.81:0/2918122702 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0494003570 con 0x7f04a8157ca0 2023-10-07T08:44:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.498+0000 7f04a6d9d700 1 -- 172.21.15.81:0/2918122702 >> v1:172.21.15.89:6789/0 conn(0x7f04a81578d0 legacy=0x7f04a815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.498+0000 7f04a6d9d700 1 -- 172.21.15.81:0/2918122702 >> v1:172.21.15.81:6789/0 conn(0x7f04a8157ca0 legacy=0x7f04a806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.498+0000 7f04a6d9d700 1 -- 172.21.15.81:0/2918122702 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a80d0170 con 0x7f04a806d830 2023-10-07T08:44:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.498+0000 7f04a6d9d700 1 --2- 172.21.15.81:0/2918122702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04a806d830 0x7f04a80cf4f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f04a00098e0 tx=0x7f04a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=339260584f9ddb48 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.498+0000 7f04a5d9b700 1 -- 172.21.15.81:0/2918122702 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a000b640 con 0x7f04a806d830 2023-10-07T08:44:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.498+0000 7f04a5d9b700 1 -- 172.21.15.81:0/2918122702 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a000b7a0 con 0x7f04a806d830 2023-10-07T08:44:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.498+0000 7f04a5d9b700 1 -- 172.21.15.81:0/2918122702 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a000bb20 con 0x7f04a806d830 2023-10-07T08:44:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.498+0000 7f04acaa9700 1 -- 172.21.15.81:0/2918122702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04a806d830 msgr2=0x7f04a80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.498+0000 7f04acaa9700 1 --2- 172.21.15.81:0/2918122702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04a806d830 0x7f04a80cf4f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f04a00098e0 tx=0x7f04a00091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.498+0000 7f04acaa9700 1 -- 172.21.15.81:0/2918122702 shutdown_connections 2023-10-07T08:44:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.498+0000 7f04acaa9700 1 --2- 172.21.15.81:0/2918122702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04a806d830 0x7f04a80cf4f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.498+0000 7f04acaa9700 1 -- 172.21.15.81:0/2918122702 >> 172.21.15.81:0/2918122702 conn(0x7f04a806bb90 msgr2=0x7f04a806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.498+0000 7f04acaa9700 1 -- 172.21.15.81:0/2918122702 shutdown_connections 2023-10-07T08:44:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.498+0000 7f04acaa9700 1 -- 172.21.15.81:0/2918122702 wait complete. 2023-10-07T08:44:03.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.500+0000 7f04acaa9700 1 Processor -- start 2023-10-07T08:44:03.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.500+0000 7f04acaa9700 1 -- start start 2023-10-07T08:44:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.500+0000 7f04acaa9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04a806d830 0x7f04a816a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.500+0000 7f04acaa9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04a81578d0 0x7f04a813f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.500+0000 7f04acaa9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04a8157ca0 0x7f04a8159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.500+0000 7f04acaa9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a816b0e0 con 0x7f04a806d830 2023-10-07T08:44:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.500+0000 7f04acaa9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a80b3cd0 con 0x7f04a81578d0 2023-10-07T08:44:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.500+0000 7f04acaa9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a816a840 con 0x7f04a8157ca0 2023-10-07T08:44:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.500+0000 7f04a659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04a806d830 0x7f04a816a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.501+0000 7f04a659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04a806d830 0x7f04a816a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39668/0 (socket says 172.21.15.81:39668) 2023-10-07T08:44:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.501+0000 7f04a659c700 1 -- 172.21.15.81:0/1825358814 learned_addr learned my addr 172.21.15.81:0/1825358814 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.501+0000 7f049dd9b700 1 --2- 172.21.15.81:0/1825358814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04a81578d0 0x7f04a813f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.501+0000 7f04a6d9d700 1 --2- 172.21.15.81:0/1825358814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04a8157ca0 0x7f04a8159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.501+0000 7f04a659c700 1 -- 172.21.15.81:0/1825358814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04a8157ca0 msgr2=0x7f04a8159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.501+0000 7f04a659c700 1 --2- 172.21.15.81:0/1825358814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04a8157ca0 0x7f04a8159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.501+0000 7f04a659c700 1 -- 172.21.15.81:0/1825358814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04a81578d0 msgr2=0x7f04a813f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.501+0000 7f04a659c700 1 --2- 172.21.15.81:0/1825358814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04a81578d0 0x7f04a813f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.501+0000 7f04a659c700 1 -- 172.21.15.81:0/1825358814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a0009420 con 0x7f04a806d830 2023-10-07T08:44:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.501+0000 7f049dd9b700 1 --2- 172.21.15.81:0/1825358814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04a81578d0 0x7f04a813f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.501+0000 7f04a659c700 1 --2- 172.21.15.81:0/1825358814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04a806d830 0x7f04a816a130 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f049800cb40 tx=0x7f0498001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:03.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.501+0000 7f049effd700 1 -- 172.21.15.81:0/1825358814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049800a7e0 con 0x7f04a806d830 2023-10-07T08:44:03.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.501+0000 7f049effd700 1 -- 172.21.15.81:0/1825358814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049800a940 con 0x7f04a806d830 2023-10-07T08:44:03.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.501+0000 7f04acaa9700 1 -- 172.21.15.81:0/1825358814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a816ab20 con 0x7f04a806d830 2023-10-07T08:44:03.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.501+0000 7f049effd700 1 -- 172.21.15.81:0/1825358814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049800ad00 con 0x7f04a806d830 2023-10-07T08:44:03.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.501+0000 7f04acaa9700 1 -- 172.21.15.81:0/1825358814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a80b6590 con 0x7f04a806d830 2023-10-07T08:44:03.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.502+0000 7f04acaa9700 1 -- 172.21.15.81:0/1825358814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a8067ac0 con 0x7f04a806d830 2023-10-07T08:44:03.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.502+0000 7f049effd700 1 -- 172.21.15.81:0/1825358814 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0498003030 con 0x7f04a806d830 2023-10-07T08:44:03.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.503+0000 7f049effd700 1 --2- 172.21.15.81:0/1825358814 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0488066f30 0x7f04880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:03.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.503+0000 7f049effd700 1 -- 172.21.15.81:0/1825358814 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f0498084600 con 0x7f04a806d830 2023-10-07T08:44:03.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.503+0000 7f049dd9b700 1 --2- 172.21.15.81:0/1825358814 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0488066f30 0x7f04880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:03.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.503+0000 7f049dd9b700 1 --2- 172.21.15.81:0/1825358814 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0488066f30 0x7f04880693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f04a8069e70 tx=0x7f0490009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:03.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.509+0000 7f049effd700 1 -- 172.21.15.81:0/1825358814 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0498051930 con 0x7f04a806d830 2023-10-07T08:44:03.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:03.690+0000 7f04acaa9700 1 -- 172.21.15.81:0/1825358814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f04a80d0450 con 0x7f04a806d830 2023-10-07T08:44:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.367+0000 7f049effd700 1 -- 172.21.15.81:0/1825358814 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7f049800ae60 con 0x7f04a806d830 2023-10-07T08:44:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.369+0000 7f04acaa9700 1 -- 172.21.15.81:0/1825358814 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0488066f30 msgr2=0x7f04880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.369+0000 7f04acaa9700 1 --2- 172.21.15.81:0/1825358814 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0488066f30 0x7f04880693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f04a8069e70 tx=0x7f0490009040 comp rx=0 tx=0).stop 2023-10-07T08:44:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.369+0000 7f04acaa9700 1 -- 172.21.15.81:0/1825358814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04a806d830 msgr2=0x7f04a816a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:04.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.369+0000 7f04acaa9700 1 --2- 172.21.15.81:0/1825358814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04a806d830 0x7f04a816a130 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f049800cb40 tx=0x7f0498001770 comp rx=0 tx=0).stop 2023-10-07T08:44:04.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.370+0000 7f04acaa9700 1 -- 172.21.15.81:0/1825358814 shutdown_connections 2023-10-07T08:44:04.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.370+0000 7f04acaa9700 1 --2- 172.21.15.81:0/1825358814 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0488066f30 0x7f04880693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.370+0000 7f04acaa9700 1 --2- 172.21.15.81:0/1825358814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04a8157ca0 0x7f04a8159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.370+0000 7f04acaa9700 1 --2- 172.21.15.81:0/1825358814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04a806d830 0x7f04a816a130 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.370+0000 7f04acaa9700 1 --2- 172.21.15.81:0/1825358814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04a81578d0 0x7f04a813f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.370+0000 7f04acaa9700 1 -- 172.21.15.81:0/1825358814 >> 172.21.15.81:0/1825358814 conn(0x7f04a806bb90 msgr2=0x7f04a806d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:04.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.370+0000 7f04acaa9700 1 -- 172.21.15.81:0/1825358814 shutdown_connections 2023-10-07T08:44:04.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.370+0000 7f04acaa9700 1 -- 172.21.15.81:0/1825358814 wait complete. 2023-10-07T08:44:04.373 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-07T08:44:04.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T08:44:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.503+0000 7f2676505700 1 Processor -- start 2023-10-07T08:44:04.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.503+0000 7f2676505700 1 -- start start 2023-10-07T08:44:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.504+0000 7f2676505700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f26701578d0 0x7f26700cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.504+0000 7f2676505700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f267006d120 0x7f267006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.504+0000 7f2676505700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26700d07c0 con 0x7f2670157ca0 2023-10-07T08:44:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.504+0000 7f2676505700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267006da50 con 0x7f26701578d0 2023-10-07T08:44:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.504+0000 7f2676505700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26700cfbb0 con 0x7f267006d120 2023-10-07T08:44:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.504+0000 7f266ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f26701578d0 0x7f26700cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.504+0000 7f266ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f26701578d0 0x7f26700cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39672/0 (socket says 172.21.15.81:39672) 2023-10-07T08:44:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.504+0000 7f266ffff700 1 -- 172.21.15.81:0/2901077743 learned_addr learned my addr 172.21.15.81:0/2901077743 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.504+0000 7f2674aa2700 1 --2- 172.21.15.81:0/2901077743 >> v2:172.21.15.89:3300/0 conn(0x7f267006d120 0x7f267006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.504+0000 7f266ffff700 1 -- 172.21.15.81:0/2901077743 >> v2:172.21.15.89:3300/0 conn(0x7f267006d120 msgr2=0x7f267006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.504+0000 7f266ffff700 1 --2- 172.21.15.81:0/2901077743 >> v2:172.21.15.89:3300/0 conn(0x7f267006d120 0x7f267006d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.504+0000 7f266ffff700 1 -- 172.21.15.81:0/2901077743 >> v1:172.21.15.89:6789/0 conn(0x7f2670157ca0 legacy=0x7f267015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:04.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.504+0000 7f266ffff700 1 -- 172.21.15.81:0/2901077743 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26700cfe90 con 0x7f26701578d0 2023-10-07T08:44:04.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.505+0000 7f266ffff700 1 --2- 172.21.15.81:0/2901077743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26701578d0 0x7f26700cf4f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2670068300 tx=0x7f2660009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44be8b4de05e3a03 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:04.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.505+0000 7f266effd700 1 -- 172.21.15.81:0/2901077743 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266000b820 con 0x7f26701578d0 2023-10-07T08:44:04.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.505+0000 7f266effd700 1 -- 172.21.15.81:0/2901077743 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266000b980 con 0x7f26701578d0 2023-10-07T08:44:04.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.505+0000 7f266effd700 1 -- 172.21.15.81:0/2901077743 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266000bd20 con 0x7f26701578d0 2023-10-07T08:44:04.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.505+0000 7f2676505700 1 -- 172.21.15.81:0/2901077743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26701578d0 msgr2=0x7f26700cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:04.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.505+0000 7f2676505700 1 --2- 172.21.15.81:0/2901077743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26701578d0 0x7f26700cf4f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2670068300 tx=0x7f2660009250 comp rx=0 tx=0).stop 2023-10-07T08:44:04.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.505+0000 7f2676505700 1 -- 172.21.15.81:0/2901077743 shutdown_connections 2023-10-07T08:44:04.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.505+0000 7f2676505700 1 --2- 172.21.15.81:0/2901077743 >> v2:172.21.15.89:3300/0 conn(0x7f267006d120 0x7f267006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.505+0000 7f2676505700 1 --2- 172.21.15.81:0/2901077743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26701578d0 0x7f26700cf4f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.505+0000 7f2676505700 1 -- 172.21.15.81:0/2901077743 >> 172.21.15.81:0/2901077743 conn(0x7f267006bb90 msgr2=0x7f267006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:04.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.505+0000 7f2676505700 1 -- 172.21.15.81:0/2901077743 shutdown_connections 2023-10-07T08:44:04.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.505+0000 7f2676505700 1 -- 172.21.15.81:0/2901077743 wait complete. 2023-10-07T08:44:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.506+0000 7f2676505700 1 Processor -- start 2023-10-07T08:44:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.507+0000 7f2676505700 1 -- start start 2023-10-07T08:44:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.507+0000 7f2676505700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f267006d120 0x7f2670153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.507+0000 7f2676505700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26701578d0 0x7f26700cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.507+0000 7f2676505700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2670157ca0 0x7f26700cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.507+0000 7f2676505700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267016a5b0 con 0x7f2670157ca0 2023-10-07T08:44:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.507+0000 7f2676505700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267016a890 con 0x7f26701578d0 2023-10-07T08:44:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.507+0000 7f2676505700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267016ab70 con 0x7f267006d120 2023-10-07T08:44:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.507+0000 7f2674aa2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2670157ca0 0x7f26700cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.507+0000 7f2674aa2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2670157ca0 0x7f26700cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39680/0 (socket says 172.21.15.81:39680) 2023-10-07T08:44:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.507+0000 7f2674aa2700 1 -- 172.21.15.81:0/383804445 learned_addr learned my addr 172.21.15.81:0/383804445 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.508+0000 7f2674aa2700 1 -- 172.21.15.81:0/383804445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f267006d120 msgr2=0x7f2670153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.508+0000 7f2674aa2700 1 --2- 172.21.15.81:0/383804445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f267006d120 0x7f2670153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.508+0000 7f2674aa2700 1 -- 172.21.15.81:0/383804445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26701578d0 msgr2=0x7f26700cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.508+0000 7f2674aa2700 1 --2- 172.21.15.81:0/383804445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26701578d0 0x7f26700cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.508+0000 7f2674aa2700 1 -- 172.21.15.81:0/383804445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26600094f0 con 0x7f2670157ca0 2023-10-07T08:44:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.508+0000 7f2674aa2700 1 --2- 172.21.15.81:0/383804445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2670157ca0 0x7f26700cd570 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2668009fa0 tx=0x7f2668009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.508+0000 7f2657fff700 1 -- 172.21.15.81:0/383804445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266800ed20 con 0x7f2670157ca0 2023-10-07T08:44:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.508+0000 7f2657fff700 1 -- 172.21.15.81:0/383804445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266800ee80 con 0x7f2670157ca0 2023-10-07T08:44:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.508+0000 7f2676505700 1 -- 172.21.15.81:0/383804445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267016ae50 con 0x7f2670157ca0 2023-10-07T08:44:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.508+0000 7f2657fff700 1 -- 172.21.15.81:0/383804445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668014650 con 0x7f2670157ca0 2023-10-07T08:44:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.508+0000 7f2676505700 1 -- 172.21.15.81:0/383804445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2670153760 con 0x7f2670157ca0 2023-10-07T08:44:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.509+0000 7f2676505700 1 -- 172.21.15.81:0/383804445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2670067ac0 con 0x7f2670157ca0 2023-10-07T08:44:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.509+0000 7f2657fff700 1 -- 172.21.15.81:0/383804445 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2668014a00 con 0x7f2670157ca0 2023-10-07T08:44:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.509+0000 7f2657fff700 1 --2- 172.21.15.81:0/383804445 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f265c066f30 0x7f265c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.510+0000 7f2657fff700 1 -- 172.21.15.81:0/383804445 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2668084a80 con 0x7f2670157ca0 2023-10-07T08:44:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.510+0000 7f266ffff700 1 --2- 172.21.15.81:0/383804445 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f265c066f30 0x7f265c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.510+0000 7f266ffff700 1 --2- 172.21.15.81:0/383804445 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f265c066f30 0x7f265c0693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2670068300 tx=0x7f2660016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:04.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.514+0000 7f2657fff700 1 -- 172.21.15.81:0/383804445 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2668051ff0 con 0x7f2670157ca0 2023-10-07T08:44:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.697+0000 7f2676505700 1 -- 172.21.15.81:0/383804445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f26700d0170 con 0x7f2670157ca0 2023-10-07T08:44:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.700+0000 7f2657fff700 1 -- 172.21.15.81:0/383804445 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2668014cb0 con 0x7f2670157ca0 2023-10-07T08:44:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.703+0000 7f2676505700 1 -- 172.21.15.81:0/383804445 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f265c066f30 msgr2=0x7f265c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.703+0000 7f2676505700 1 --2- 172.21.15.81:0/383804445 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f265c066f30 0x7f265c0693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2670068300 tx=0x7f2660016000 comp rx=0 tx=0).stop 2023-10-07T08:44:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.703+0000 7f2676505700 1 -- 172.21.15.81:0/383804445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2670157ca0 msgr2=0x7f26700cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.703+0000 7f2676505700 1 --2- 172.21.15.81:0/383804445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2670157ca0 0x7f26700cd570 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2668009fa0 tx=0x7f2668009900 comp rx=0 tx=0).stop 2023-10-07T08:44:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.703+0000 7f2676505700 1 -- 172.21.15.81:0/383804445 shutdown_connections 2023-10-07T08:44:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.703+0000 7f2676505700 1 --2- 172.21.15.81:0/383804445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2670157ca0 0x7f26700cd570 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.703+0000 7f2676505700 1 --2- 172.21.15.81:0/383804445 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f265c066f30 0x7f265c0693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.703+0000 7f2676505700 1 --2- 172.21.15.81:0/383804445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f267006d120 0x7f2670153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.703+0000 7f2676505700 1 --2- 172.21.15.81:0/383804445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26701578d0 0x7f26700cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.703+0000 7f2676505700 1 -- 172.21.15.81:0/383804445 >> 172.21.15.81:0/383804445 conn(0x7f267006bb90 msgr2=0x7f2670154940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.703+0000 7f2676505700 1 -- 172.21.15.81:0/383804445 shutdown_connections 2023-10-07T08:44:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.703+0000 7f2676505700 1 -- 172.21.15.81:0/383804445 wait complete. 2023-10-07T08:44:04.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-07T08:44:04.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.828+0000 7f4956ae1700 1 Processor -- start 2023-10-07T08:44:04.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.828+0000 7f4956ae1700 1 -- start start 2023-10-07T08:44:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.828+0000 7f4956ae1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4950157ca0 0x7f49500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.828+0000 7f4956ae1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49500d07c0 con 0x7f495006d120 2023-10-07T08:44:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.828+0000 7f4956ae1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49500cfbb0 con 0x7f49501578d0 2023-10-07T08:44:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.828+0000 7f4956ae1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49500cfe90 con 0x7f4950157ca0 2023-10-07T08:44:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f495507e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f495006d120 0x7f495015b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57060/0 (socket says 172.21.15.81:57060) 2023-10-07T08:44:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f495507e700 1 -- 172.21.15.81:0/157303418 learned_addr learned my addr 172.21.15.81:0/157303418 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494ffff700 1 --2- 172.21.15.81:0/157303418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4950157ca0 0x7f49500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:04.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 -- 172.21.15.81:0/157303418 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476612049 0 0) 0x7f49500d07c0 con 0x7f495006d120 2023-10-07T08:44:04.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 -- 172.21.15.81:0/157303418 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4938003570 con 0x7f495006d120 2023-10-07T08:44:04.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 -- 172.21.15.81:0/157303418 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320913504 0 0) 0x7f49500cfbb0 con 0x7f49501578d0 2023-10-07T08:44:04.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 -- 172.21.15.81:0/157303418 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49500d07c0 con 0x7f49501578d0 2023-10-07T08:44:04.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 -- 172.21.15.81:0/157303418 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 136919362 0 0) 0x7f4938003570 con 0x7f495006d120 2023-10-07T08:44:04.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 -- 172.21.15.81:0/157303418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4950157ca0 msgr2=0x7f49500cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:04.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 --2- 172.21.15.81:0/157303418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4950157ca0 0x7f49500cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 -- 172.21.15.81:0/157303418 >> v1:172.21.15.89:6789/0 conn(0x7f49501578d0 legacy=0x7f495015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:04.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 -- 172.21.15.81:0/157303418 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49500d0170 con 0x7f495006d120 2023-10-07T08:44:04.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 -- 172.21.15.81:0/157303418 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f4948001470 con 0x7f495006d120 2023-10-07T08:44:04.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494ffff700 1 --2- 172.21.15.81:0/157303418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4950157ca0 0x7f49500cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:44:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 -- 172.21.15.81:0/157303418 >> v1:172.21.15.81:6789/0 conn(0x7f495006d120 legacy=0x7f495015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 --2- 172.21.15.81:0/157303418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4938003c20 0x7f4938004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 --2- 172.21.15.81:0/157303418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4950157ca0 0x7f4938004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 --2- 172.21.15.81:0/157303418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4938004d50 0x7f49380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 -- 172.21.15.81:0/157303418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49500cfe90 con 0x7f4938004d50 2023-10-07T08:44:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 -- 172.21.15.81:0/157303418 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493800bb10 con 0x7f4938003c20 2023-10-07T08:44:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494f7fe700 1 -- 172.21.15.81:0/157303418 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493800bcd0 con 0x7f4950157ca0 2023-10-07T08:44:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f495507e700 1 --2- 172.21.15.81:0/157303418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4938004d50 0x7f49380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f494ffff700 1 --2- 172.21.15.81:0/157303418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4950157ca0 0x7f4938004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.829+0000 7f495487d700 1 --2- 172.21.15.81:0/157303418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4938003c20 0x7f4938004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.830+0000 7f495507e700 1 -- 172.21.15.81:0/157303418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4950157ca0 msgr2=0x7f4938004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.830+0000 7f495507e700 1 --2- 172.21.15.81:0/157303418 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4950157ca0 0x7f4938004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.830+0000 7f495507e700 1 -- 172.21.15.81:0/157303418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4938003c20 msgr2=0x7f4938004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.830+0000 7f495507e700 1 --2- 172.21.15.81:0/157303418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4938003c20 0x7f4938004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.830+0000 7f495507e700 1 -- 172.21.15.81:0/157303418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4944009420 con 0x7f4938004d50 2023-10-07T08:44:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.830+0000 7f495507e700 1 --2- 172.21.15.81:0/157303418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4938004d50 0x7f49380051c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f494800c2d0 tx=0x7f495015b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38442cc5a69f0040 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.830+0000 7f494f7fe700 1 -- 172.21.15.81:0/157303418 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494800cba0 con 0x7f4938004d50 2023-10-07T08:44:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.830+0000 7f494f7fe700 1 -- 172.21.15.81:0/157303418 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494800cd20 con 0x7f4938004d50 2023-10-07T08:44:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.830+0000 7f494f7fe700 1 -- 172.21.15.81:0/157303418 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948005b70 con 0x7f4938004d50 2023-10-07T08:44:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.830+0000 7f4956ae1700 1 -- 172.21.15.81:0/157303418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4938004d50 msgr2=0x7f49380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.830+0000 7f4956ae1700 1 --2- 172.21.15.81:0/157303418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4938004d50 0x7f49380051c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f494800c2d0 tx=0x7f495015b610 comp rx=0 tx=0).stop 2023-10-07T08:44:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.830+0000 7f495507e700 1 -- 172.21.15.81:0/157303418 reap_dead start 2023-10-07T08:44:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.830+0000 7f4956ae1700 1 -- 172.21.15.81:0/157303418 shutdown_connections 2023-10-07T08:44:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.830+0000 7f4956ae1700 1 -- 172.21.15.81:0/157303418 >> 172.21.15.81:0/157303418 conn(0x7f495006bb90 msgr2=0x7f495006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.830+0000 7f4956ae1700 1 -- 172.21.15.81:0/157303418 shutdown_connections 2023-10-07T08:44:04.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.830+0000 7f4956ae1700 1 -- 172.21.15.81:0/157303418 wait complete. 2023-10-07T08:44:04.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.831+0000 7f4956ae1700 1 Processor -- start 2023-10-07T08:44:04.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.832+0000 7f4956ae1700 1 -- start start 2023-10-07T08:44:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.832+0000 7f4956ae1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49500c7980 0x7f49500b6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.832+0000 7f4956ae1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49500c7d50 0x7f49501565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.832+0000 7f4956ae1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4950156b10 0x7f49500b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.832+0000 7f4956ae1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4950156f90 con 0x7f4950156b10 2023-10-07T08:44:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.832+0000 7f4956ae1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49500c6af0 con 0x7f49500c7d50 2023-10-07T08:44:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.832+0000 7f4956ae1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49500c5ee0 con 0x7f49500c7980 2023-10-07T08:44:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.833+0000 7f495507e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4950156b10 0x7f49500b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.833+0000 7f495507e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4950156b10 0x7f49500b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39694/0 (socket says 172.21.15.81:39694) 2023-10-07T08:44:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.833+0000 7f495507e700 1 -- 172.21.15.81:0/562201515 learned_addr learned my addr 172.21.15.81:0/562201515 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.833+0000 7f494ffff700 1 --2- 172.21.15.81:0/562201515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49500c7d50 0x7f49501565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.833+0000 7f495487d700 1 --2- 172.21.15.81:0/562201515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49500c7980 0x7f49500b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.833+0000 7f495507e700 1 -- 172.21.15.81:0/562201515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49500c7980 msgr2=0x7f49500b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.833+0000 7f495507e700 1 --2- 172.21.15.81:0/562201515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49500c7980 0x7f49500b6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.833+0000 7f495507e700 1 -- 172.21.15.81:0/562201515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49500c7d50 msgr2=0x7f49501565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.833+0000 7f495507e700 1 --2- 172.21.15.81:0/562201515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49500c7d50 0x7f49501565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.833+0000 7f495507e700 1 -- 172.21.15.81:0/562201515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49500c61c0 con 0x7f4950156b10 2023-10-07T08:44:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.833+0000 7f495507e700 1 --2- 172.21.15.81:0/562201515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4950156b10 0x7f49500b3ba0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4948001ed0 tx=0x7f4948015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.833+0000 7f494cff9700 1 -- 172.21.15.81:0/562201515 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494800cba0 con 0x7f4950156b10 2023-10-07T08:44:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.833+0000 7f494cff9700 1 -- 172.21.15.81:0/562201515 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494800ce90 con 0x7f4950156b10 2023-10-07T08:44:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.833+0000 7f4956ae1700 1 -- 172.21.15.81:0/562201515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49500c64a0 con 0x7f4950156b10 2023-10-07T08:44:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.833+0000 7f494cff9700 1 -- 172.21.15.81:0/562201515 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49480070d0 con 0x7f4950156b10 2023-10-07T08:44:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.833+0000 7f4956ae1700 1 -- 172.21.15.81:0/562201515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49500b5f90 con 0x7f4950156b10 2023-10-07T08:44:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.834+0000 7f4956ae1700 1 -- 172.21.15.81:0/562201515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49500c6c80 con 0x7f4950156b10 2023-10-07T08:44:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.834+0000 7f494cff9700 1 -- 172.21.15.81:0/562201515 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49480074c0 con 0x7f4950156b10 2023-10-07T08:44:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.835+0000 7f494cff9700 1 --2- 172.21.15.81:0/562201515 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f493c066f30 0x7f493c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.835+0000 7f494cff9700 1 -- 172.21.15.81:0/562201515 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4948085700 con 0x7f4950156b10 2023-10-07T08:44:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.835+0000 7f495487d700 1 --2- 172.21.15.81:0/562201515 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f493c066f30 0x7f493c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.835+0000 7f495487d700 1 --2- 172.21.15.81:0/562201515 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f493c066f30 0x7f493c0693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f495006a5d0 tx=0x7f49400017a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:04.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:04.839+0000 7f494cff9700 1 -- 172.21.15.81:0/562201515 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4948052cd0 con 0x7f4950156b10 2023-10-07T08:44:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.097+0000 7f4956ae1700 1 -- 172.21.15.81:0/562201515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f49500d0450 con 0x7f4950156b10 2023-10-07T08:44:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.366+0000 7f494cff9700 1 -- 172.21.15.81:0/562201515 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v84) v1 ==== 130+0+0 (secure 0 0 0) 0x7f49480562f0 con 0x7f4950156b10 2023-10-07T08:44:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.368+0000 7f4956ae1700 1 -- 172.21.15.81:0/562201515 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f493c066f30 msgr2=0x7f493c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.368+0000 7f4956ae1700 1 --2- 172.21.15.81:0/562201515 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f493c066f30 0x7f493c0693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f495006a5d0 tx=0x7f49400017a0 comp rx=0 tx=0).stop 2023-10-07T08:44:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.368+0000 7f4956ae1700 1 -- 172.21.15.81:0/562201515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4950156b10 msgr2=0x7f49500b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.368+0000 7f4956ae1700 1 --2- 172.21.15.81:0/562201515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4950156b10 0x7f49500b3ba0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4948001ed0 tx=0x7f4948015000 comp rx=0 tx=0).stop 2023-10-07T08:44:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.368+0000 7f4956ae1700 1 -- 172.21.15.81:0/562201515 shutdown_connections 2023-10-07T08:44:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.368+0000 7f4956ae1700 1 --2- 172.21.15.81:0/562201515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4950156b10 0x7f49500b3ba0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.368+0000 7f4956ae1700 1 --2- 172.21.15.81:0/562201515 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f493c066f30 0x7f493c0693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.368+0000 7f4956ae1700 1 --2- 172.21.15.81:0/562201515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49500c7980 0x7f49500b6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.368+0000 7f4956ae1700 1 --2- 172.21.15.81:0/562201515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49500c7d50 0x7f49501565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.368+0000 7f4956ae1700 1 -- 172.21.15.81:0/562201515 >> 172.21.15.81:0/562201515 conn(0x7f495006bb90 msgr2=0x7f4950154590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.368+0000 7f4956ae1700 1 -- 172.21.15.81:0/562201515 shutdown_connections 2023-10-07T08:44:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.368+0000 7f4956ae1700 1 -- 172.21.15.81:0/562201515 wait complete. 2023-10-07T08:44:05.381 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-10-07T08:44:05.381 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-10-07T08:44:05.382 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-10-07T08:44:05.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.495+0000 7f53f897c700 1 Processor -- start 2023-10-07T08:44:05.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.495+0000 7f53f897c700 1 -- start start 2023-10-07T08:44:05.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.496+0000 7f53f897c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f53f4159f10 0x7f53f4068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:05.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.496+0000 7f53f897c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f4068cc0 0x7f53f40cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:05.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.496+0000 7f53f897c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f40cee10 con 0x7f53f4159b40 2023-10-07T08:44:05.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.496+0000 7f53f897c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f4069140 con 0x7f53f4159f10 2023-10-07T08:44:05.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.496+0000 7f53f897c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40cd040 con 0x7f53f4068cc0 2023-10-07T08:44:05.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.496+0000 7f53f37fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f53f4159b40 0x7f53f40cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57066/0 (socket says 172.21.15.81:57066) 2023-10-07T08:44:05.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.496+0000 7f53f37fe700 1 -- 172.21.15.81:0/3228311663 learned_addr learned my addr 172.21.15.81:0/3228311663 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:05.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.496+0000 7f53f27fc700 1 -- 172.21.15.81:0/3228311663 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027470988 0 0) 0x7f53f40cee10 con 0x7f53f4159b40 2023-10-07T08:44:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.496+0000 7f53f3fff700 1 --2- 172.21.15.81:0/3228311663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f4068cc0 0x7f53f40cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.496+0000 7f53f2ffd700 1 --2- 172.21.15.81:0/3228311663 >> v2:172.21.15.89:3300/0 conn(0x7f53f4159f10 0x7f53f4068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.496+0000 7f53f27fc700 1 -- 172.21.15.81:0/3228311663 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53dc003570 con 0x7f53f4159b40 2023-10-07T08:44:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 -- 172.21.15.81:0/3228311663 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2225458337 0 0) 0x7f53dc003570 con 0x7f53f4159b40 2023-10-07T08:44:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 -- 172.21.15.81:0/3228311663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f4068cc0 msgr2=0x7f53f40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 --2- 172.21.15.81:0/3228311663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f4068cc0 0x7f53f40cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 -- 172.21.15.81:0/3228311663 >> v2:172.21.15.89:3300/0 conn(0x7f53f4159f10 msgr2=0x7f53f4068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 --2- 172.21.15.81:0/3228311663 >> v2:172.21.15.89:3300/0 conn(0x7f53f4159f10 0x7f53f4068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 -- 172.21.15.81:0/3228311663 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f40cd320 con 0x7f53f4159b40 2023-10-07T08:44:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 -- 172.21.15.81:0/3228311663 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f53e40017f0 con 0x7f53f4159b40 2023-10-07T08:44:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 -- 172.21.15.81:0/3228311663 >> v1:172.21.15.81:6789/0 conn(0x7f53f4159b40 legacy=0x7f53f40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 --2- 172.21.15.81:0/3228311663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53dc003a60 0x7f53dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 --2- 172.21.15.81:0/3228311663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53dc004810 0x7f53dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:05.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 --2- 172.21.15.81:0/3228311663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f4068cc0 0x7f53dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:05.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 -- 172.21.15.81:0/3228311663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f4069140 con 0x7f53dc003a60 2023-10-07T08:44:05.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 -- 172.21.15.81:0/3228311663 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40cd040 con 0x7f53dc004810 2023-10-07T08:44:05.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 -- 172.21.15.81:0/3228311663 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc00ba60 con 0x7f53f4068cc0 2023-10-07T08:44:05.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f37fe700 1 --2- 172.21.15.81:0/3228311663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53dc003a60 0x7f53dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:05.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f2ffd700 1 --2- 172.21.15.81:0/3228311663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53dc004810 0x7f53dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:05.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f3fff700 1 --2- 172.21.15.81:0/3228311663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f4068cc0 0x7f53dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:05.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f37fe700 1 -- 172.21.15.81:0/3228311663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f4068cc0 msgr2=0x7f53dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:05.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f37fe700 1 --2- 172.21.15.81:0/3228311663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f4068cc0 0x7f53dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:05.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f37fe700 1 -- 172.21.15.81:0/3228311663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53dc004810 msgr2=0x7f53dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:05.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f37fe700 1 --2- 172.21.15.81:0/3228311663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53dc004810 0x7f53dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:05.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f37fe700 1 -- 172.21.15.81:0/3228311663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc003570 con 0x7f53dc003a60 2023-10-07T08:44:05.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f2ffd700 1 --2- 172.21.15.81:0/3228311663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53dc004810 0x7f53dc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:05.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f37fe700 1 --2- 172.21.15.81:0/3228311663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53dc003a60 0x7f53dc003e70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f53e400a9a0 tx=0x7f53e4002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d4bbd593a05e9d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:05.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 -- 172.21.15.81:0/3228311663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4012440 con 0x7f53dc003a60 2023-10-07T08:44:05.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 -- 172.21.15.81:0/3228311663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e40125c0 con 0x7f53dc003a60 2023-10-07T08:44:05.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.497+0000 7f53f27fc700 1 -- 172.21.15.81:0/3228311663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4012980 con 0x7f53dc003a60 2023-10-07T08:44:05.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.498+0000 7f53f897c700 1 -- 172.21.15.81:0/3228311663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53dc003a60 msgr2=0x7f53dc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:05.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.498+0000 7f53f897c700 1 --2- 172.21.15.81:0/3228311663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53dc003a60 0x7f53dc003e70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f53e400a9a0 tx=0x7f53e4002210 comp rx=0 tx=0).stop 2023-10-07T08:44:05.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.498+0000 7f53f3fff700 1 -- 172.21.15.81:0/3228311663 reap_dead start 2023-10-07T08:44:05.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.498+0000 7f53f897c700 1 -- 172.21.15.81:0/3228311663 shutdown_connections 2023-10-07T08:44:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.498+0000 7f53f897c700 1 -- 172.21.15.81:0/3228311663 >> 172.21.15.81:0/3228311663 conn(0x7f53f40cd660 msgr2=0x7f53f40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.498+0000 7f53f897c700 1 -- 172.21.15.81:0/3228311663 shutdown_connections 2023-10-07T08:44:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.498+0000 7f53f897c700 1 -- 172.21.15.81:0/3228311663 wait complete. 2023-10-07T08:44:05.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.499+0000 7f53f897c700 1 Processor -- start 2023-10-07T08:44:05.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.499+0000 7f53f897c700 1 -- start start 2023-10-07T08:44:05.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f897c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53dc003a60 0x7f53f416ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:05.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f897c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53f415f5c0 0x7f53f415fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:05.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f897c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f40c5990 0x7f53f40c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:05.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f897c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f4160d20 con 0x7f53f415f5c0 2023-10-07T08:44:05.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f897c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40c6320 con 0x7f53f40c5990 2023-10-07T08:44:05.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f897c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f4160110 con 0x7f53dc003a60 2023-10-07T08:44:05.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53f415f5c0 0x7f53f415fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:05.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53f415f5c0 0x7f53f415fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39708/0 (socket says 172.21.15.81:39708) 2023-10-07T08:44:05.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f2ffd700 1 -- 172.21.15.81:0/2528475975 learned_addr learned my addr 172.21.15.81:0/2528475975 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:05.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f3fff700 1 --2- 172.21.15.81:0/2528475975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f40c5990 0x7f53f40c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:05.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f37fe700 1 --2- 172.21.15.81:0/2528475975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53dc003a60 0x7f53f416ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:05.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f2ffd700 1 -- 172.21.15.81:0/2528475975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53dc003a60 msgr2=0x7f53f416ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:05.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f2ffd700 1 --2- 172.21.15.81:0/2528475975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53dc003a60 0x7f53f416ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:05.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f2ffd700 1 -- 172.21.15.81:0/2528475975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f40c5990 msgr2=0x7f53f40c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:05.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f2ffd700 1 --2- 172.21.15.81:0/2528475975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f40c5990 0x7f53f40c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:05.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f2ffd700 1 -- 172.21.15.81:0/2528475975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f41603f0 con 0x7f53f415f5c0 2023-10-07T08:44:05.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f3fff700 1 --2- 172.21.15.81:0/2528475975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f40c5990 0x7f53f40c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:05.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.500+0000 7f53f37fe700 1 --2- 172.21.15.81:0/2528475975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53dc003a60 0x7f53f416ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:05.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.501+0000 7f53f2ffd700 1 --2- 172.21.15.81:0/2528475975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53f415f5c0 0x7f53f415fa30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f53e80118e0 tx=0x7f53e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:05.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.501+0000 7f53db7fe700 1 -- 172.21.15.81:0/2528475975 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8011e80 con 0x7f53f415f5c0 2023-10-07T08:44:05.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.501+0000 7f53db7fe700 1 -- 172.21.15.81:0/2528475975 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e800f8e0 con 0x7f53f415f5c0 2023-10-07T08:44:05.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.501+0000 7f53f897c700 1 -- 172.21.15.81:0/2528475975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f41606d0 con 0x7f53f415f5c0 2023-10-07T08:44:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.501+0000 7f53db7fe700 1 -- 172.21.15.81:0/2528475975 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e800fc80 con 0x7f53f415f5c0 2023-10-07T08:44:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.501+0000 7f53f897c700 1 -- 172.21.15.81:0/2528475975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f40ca730 con 0x7f53f415f5c0 2023-10-07T08:44:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.502+0000 7f53f897c700 1 -- 172.21.15.81:0/2528475975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f4160ed0 con 0x7f53f415f5c0 2023-10-07T08:44:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.502+0000 7f53db7fe700 1 -- 172.21.15.81:0/2528475975 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53e8015460 con 0x7f53f415f5c0 2023-10-07T08:44:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.502+0000 7f53db7fe700 1 --2- 172.21.15.81:0/2528475975 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f53e0066f30 0x7f53e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.502+0000 7f53db7fe700 1 -- 172.21.15.81:0/2528475975 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f53e8084ad0 con 0x7f53f415f5c0 2023-10-07T08:44:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.502+0000 7f53f37fe700 1 --2- 172.21.15.81:0/2528475975 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f53e0066f30 0x7f53e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:05.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.503+0000 7f53f37fe700 1 --2- 172.21.15.81:0/2528475975 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f53e0066f30 0x7f53e00693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f53e400a8c0 tx=0x7f53e4015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.507+0000 7f53db7fe700 1 -- 172.21.15.81:0/2528475975 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53f4160ed0 con 0x7f53f415f5c0 2023-10-07T08:44:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:05.760+0000 7f53f897c700 1 -- 172.21.15.81:0/2528475975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f53f40cb890 con 0x7f53f415f5c0 2023-10-07T08:44:06.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.370+0000 7f53db7fe700 1 -- 172.21.15.81:0/2528475975 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v85) v1 ==== 145+0+0 (secure 0 0 0) 0x7f53e8052000 con 0x7f53f415f5c0 2023-10-07T08:44:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.373+0000 7f53f897c700 1 -- 172.21.15.81:0/2528475975 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f53e0066f30 msgr2=0x7f53e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.373+0000 7f53f897c700 1 --2- 172.21.15.81:0/2528475975 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f53e0066f30 0x7f53e00693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f53e400a8c0 tx=0x7f53e4015000 comp rx=0 tx=0).stop 2023-10-07T08:44:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.373+0000 7f53f897c700 1 -- 172.21.15.81:0/2528475975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53f415f5c0 msgr2=0x7f53f415fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.373+0000 7f53f897c700 1 --2- 172.21.15.81:0/2528475975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53f415f5c0 0x7f53f415fa30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f53e80118e0 tx=0x7f53e8008040 comp rx=0 tx=0).stop 2023-10-07T08:44:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.373+0000 7f53f897c700 1 -- 172.21.15.81:0/2528475975 shutdown_connections 2023-10-07T08:44:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.373+0000 7f53f897c700 1 --2- 172.21.15.81:0/2528475975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f40c5990 0x7f53f40c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.373+0000 7f53f897c700 1 --2- 172.21.15.81:0/2528475975 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f53e0066f30 0x7f53e00693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.373+0000 7f53f897c700 1 --2- 172.21.15.81:0/2528475975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53dc003a60 0x7f53f416ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:06.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.373+0000 7f53f897c700 1 --2- 172.21.15.81:0/2528475975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53f415f5c0 0x7f53f415fa30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:06.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.373+0000 7f53f897c700 1 -- 172.21.15.81:0/2528475975 >> 172.21.15.81:0/2528475975 conn(0x7f53f40cd660 msgr2=0x7f53f406c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:06.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.373+0000 7f53f897c700 1 -- 172.21.15.81:0/2528475975 shutdown_connections 2023-10-07T08:44:06.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.373+0000 7f53f897c700 1 -- 172.21.15.81:0/2528475975 wait complete. 2023-10-07T08:44:06.388 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-07T08:44:06.520 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_objectstore":"memstore"} 2023-10-07T08:44:06.522 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-07T08:44:06.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T08:44:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.637+0000 7efebc559700 1 Processor -- start 2023-10-07T08:44:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.637+0000 7efebc559700 1 -- start start 2023-10-07T08:44:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efebc559700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeb41569e0 0x7efeb40b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efebc559700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb40b2290 con 0x7efeb4156db0 2023-10-07T08:44:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efebc559700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb4157c00 con 0x7efeb406e940 2023-10-07T08:44:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efebc559700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb41572d0 con 0x7efeb41569e0 2023-10-07T08:44:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb9af4700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efeb4156db0 0x7efeb406e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57082/0 (socket says 172.21.15.81:57082) 2023-10-07T08:44:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb9af4700 1 -- 172.21.15.81:0/279157829 learned_addr learned my addr 172.21.15.81:0/279157829 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb92f3700 1 -- 172.21.15.81:0/279157829 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906853996 0 0) 0x7efeb40b2290 con 0x7efeb4156db0 2023-10-07T08:44:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeba2f5700 1 --2- 172.21.15.81:0/279157829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeb41569e0 0x7efeb40b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb92f3700 1 -- 172.21.15.81:0/279157829 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efea0003570 con 0x7efeb4156db0 2023-10-07T08:44:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb92f3700 1 -- 172.21.15.81:0/279157829 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 262034850 0 0) 0x7efea0003570 con 0x7efeb4156db0 2023-10-07T08:44:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb92f3700 1 -- 172.21.15.81:0/279157829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeb41569e0 msgr2=0x7efeb40b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb92f3700 1 --2- 172.21.15.81:0/279157829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeb41569e0 0x7efeb40b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb92f3700 1 -- 172.21.15.81:0/279157829 >> v1:172.21.15.89:6789/0 conn(0x7efeb406e940 legacy=0x7efeb40cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb92f3700 1 -- 172.21.15.81:0/279157829 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb41575b0 con 0x7efeb4156db0 2023-10-07T08:44:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb92f3700 1 -- 172.21.15.81:0/279157829 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7efea4001470 con 0x7efeb4156db0 2023-10-07T08:44:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb92f3700 1 -- 172.21.15.81:0/279157829 >> v1:172.21.15.81:6789/0 conn(0x7efeb4156db0 legacy=0x7efeb406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb92f3700 1 --2- 172.21.15.81:0/279157829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efea0003a90 0x7efea0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb92f3700 1 --2- 172.21.15.81:0/279157829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeb41569e0 0x7efea0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb92f3700 1 --2- 172.21.15.81:0/279157829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0004d50 0x7efea00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb92f3700 1 -- 172.21.15.81:0/279157829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb41572d0 con 0x7efea0004d50 2023-10-07T08:44:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb92f3700 1 -- 172.21.15.81:0/279157829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea000bb70 con 0x7efea0003a90 2023-10-07T08:44:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb92f3700 1 -- 172.21.15.81:0/279157829 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea000bd30 con 0x7efeb41569e0 2023-10-07T08:44:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efebaaf6700 1 --2- 172.21.15.81:0/279157829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0004d50 0x7efea00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeb9af4700 1 --2- 172.21.15.81:0/279157829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeb41569e0 0x7efea0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efeba2f5700 1 --2- 172.21.15.81:0/279157829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efea0003a90 0x7efea0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efebaaf6700 1 -- 172.21.15.81:0/279157829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeb41569e0 msgr2=0x7efea0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efebaaf6700 1 --2- 172.21.15.81:0/279157829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeb41569e0 0x7efea0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efebaaf6700 1 -- 172.21.15.81:0/279157829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efea0003a90 msgr2=0x7efea0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efebaaf6700 1 --2- 172.21.15.81:0/279157829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efea0003a90 0x7efea0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.639+0000 7efebaaf6700 1 -- 172.21.15.81:0/279157829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea0003570 con 0x7efea0004d50 2023-10-07T08:44:06.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.640+0000 7efebaaf6700 1 --2- 172.21.15.81:0/279157829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0004d50 0x7efea00051c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efeb406ed40 tx=0x7efeac001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a48f2968d39d1ad server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:06.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.640+0000 7efeb92f3700 1 -- 172.21.15.81:0/279157829 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac001950 con 0x7efea0004d50 2023-10-07T08:44:06.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.640+0000 7efeb92f3700 1 -- 172.21.15.81:0/279157829 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac004030 con 0x7efea0004d50 2023-10-07T08:44:06.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.640+0000 7efeb92f3700 1 -- 172.21.15.81:0/279157829 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac00cae0 con 0x7efea0004d50 2023-10-07T08:44:06.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.640+0000 7efebc559700 1 -- 172.21.15.81:0/279157829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0004d50 msgr2=0x7efea00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:06.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.640+0000 7efebc559700 1 --2- 172.21.15.81:0/279157829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0004d50 0x7efea00051c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efeb406ed40 tx=0x7efeac001640 comp rx=0 tx=0).stop 2023-10-07T08:44:06.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.640+0000 7efebaaf6700 1 -- 172.21.15.81:0/279157829 reap_dead start 2023-10-07T08:44:06.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.640+0000 7efebc559700 1 -- 172.21.15.81:0/279157829 shutdown_connections 2023-10-07T08:44:06.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.640+0000 7efebc559700 1 -- 172.21.15.81:0/279157829 >> 172.21.15.81:0/279157829 conn(0x7efeb406cca0 msgr2=0x7efeb406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:06.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.640+0000 7efebc559700 1 -- 172.21.15.81:0/279157829 shutdown_connections 2023-10-07T08:44:06.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.640+0000 7efebc559700 1 -- 172.21.15.81:0/279157829 wait complete. 2023-10-07T08:44:06.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.641+0000 7efebc559700 1 Processor -- start 2023-10-07T08:44:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.641+0000 7efebc559700 1 -- start start 2023-10-07T08:44:06.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.642+0000 7efebc559700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0004d50 0x7efeb4138b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.642+0000 7efebc559700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efeb415a1a0 0x7efeb415a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.642+0000 7efebc559700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeb414d120 0x7efeb414d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.642+0000 7efebc559700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb41390b0 con 0x7efea0004d50 2023-10-07T08:44:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.642+0000 7efebc559700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb414e960 con 0x7efeb415a1a0 2023-10-07T08:44:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.642+0000 7efebc559700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb415ab30 con 0x7efeb414d120 2023-10-07T08:44:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.642+0000 7efeba2f5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0004d50 0x7efeb4138b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.642+0000 7efeba2f5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0004d50 0x7efeb4138b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39730/0 (socket says 172.21.15.81:39730) 2023-10-07T08:44:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.642+0000 7efeba2f5700 1 -- 172.21.15.81:0/65791096 learned_addr learned my addr 172.21.15.81:0/65791096 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.642+0000 7efeb9af4700 1 --2- 172.21.15.81:0/65791096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efeb415a1a0 0x7efeb415a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.642+0000 7efebaaf6700 1 --2- 172.21.15.81:0/65791096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeb414d120 0x7efeb414d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.643+0000 7efeba2f5700 1 -- 172.21.15.81:0/65791096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeb414d120 msgr2=0x7efeb414d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.643+0000 7efeba2f5700 1 --2- 172.21.15.81:0/65791096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeb414d120 0x7efeb414d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:06.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.643+0000 7efeba2f5700 1 -- 172.21.15.81:0/65791096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efeb415a1a0 msgr2=0x7efeb415a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:06.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.643+0000 7efeba2f5700 1 --2- 172.21.15.81:0/65791096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efeb415a1a0 0x7efeb415a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:06.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.643+0000 7efeba2f5700 1 -- 172.21.15.81:0/65791096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb414e2f0 con 0x7efea0004d50 2023-10-07T08:44:06.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.643+0000 7efebaaf6700 1 --2- 172.21.15.81:0/65791096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeb414d120 0x7efeb414d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:06.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.643+0000 7efeba2f5700 1 --2- 172.21.15.81:0/65791096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0004d50 0x7efeb4138b70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efeb0011b10 tx=0x7efeb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:06.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.643+0000 7efeaa7fc700 1 -- 172.21.15.81:0/65791096 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb000f9f0 con 0x7efea0004d50 2023-10-07T08:44:06.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.643+0000 7efeaa7fc700 1 -- 172.21.15.81:0/65791096 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb000fb50 con 0x7efea0004d50 2023-10-07T08:44:06.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.643+0000 7efeaa7fc700 1 -- 172.21.15.81:0/65791096 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb000fed0 con 0x7efea0004d50 2023-10-07T08:44:06.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.643+0000 7efebc559700 1 -- 172.21.15.81:0/65791096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb414dab0 con 0x7efea0004d50 2023-10-07T08:44:06.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.643+0000 7efebc559700 1 -- 172.21.15.81:0/65791096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb414e010 con 0x7efea0004d50 2023-10-07T08:44:06.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.644+0000 7efebc559700 1 -- 172.21.15.81:0/65791096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb4068900 con 0x7efea0004d50 2023-10-07T08:44:06.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.644+0000 7efeaa7fc700 1 -- 172.21.15.81:0/65791096 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efeb0014650 con 0x7efea0004d50 2023-10-07T08:44:06.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.645+0000 7efeaa7fc700 1 --2- 172.21.15.81:0/65791096 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe98066f30 0x7efe980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:06.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.645+0000 7efeaa7fc700 1 -- 172.21.15.81:0/65791096 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efeb0018030 con 0x7efea0004d50 2023-10-07T08:44:06.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.645+0000 7efeb9af4700 1 --2- 172.21.15.81:0/65791096 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe98066f30 0x7efe980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:06.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.645+0000 7efeb9af4700 1 --2- 172.21.15.81:0/65791096 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe98066f30 0x7efe980693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efea4001ce0 tx=0x7efea4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:06.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.650+0000 7efeaa7fc700 1 -- 172.21.15.81:0/65791096 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efeb00522d0 con 0x7efea0004d50 2023-10-07T08:44:06.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.832+0000 7efebc559700 1 -- 172.21.15.81:0/65791096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7efeb4157890 con 0x7efea0004d50 2023-10-07T08:44:06.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.836+0000 7efeaa7fc700 1 -- 172.21.15.81:0/65791096 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7efeb00220c0 con 0x7efea0004d50 2023-10-07T08:44:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.838+0000 7efebc559700 1 -- 172.21.15.81:0/65791096 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe98066f30 msgr2=0x7efe980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.838+0000 7efebc559700 1 --2- 172.21.15.81:0/65791096 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe98066f30 0x7efe980693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efea4001ce0 tx=0x7efea4009040 comp rx=0 tx=0).stop 2023-10-07T08:44:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.838+0000 7efebc559700 1 -- 172.21.15.81:0/65791096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0004d50 msgr2=0x7efeb4138b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.838+0000 7efebc559700 1 --2- 172.21.15.81:0/65791096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0004d50 0x7efeb4138b70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efeb0011b10 tx=0x7efeb00091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.838+0000 7efebc559700 1 -- 172.21.15.81:0/65791096 shutdown_connections 2023-10-07T08:44:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.838+0000 7efebc559700 1 --2- 172.21.15.81:0/65791096 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe98066f30 0x7efe980693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.838+0000 7efebc559700 1 --2- 172.21.15.81:0/65791096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efeb414d120 0x7efeb414d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.838+0000 7efebc559700 1 --2- 172.21.15.81:0/65791096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea0004d50 0x7efeb4138b70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.838+0000 7efebc559700 1 --2- 172.21.15.81:0/65791096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efeb415a1a0 0x7efeb415a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.838+0000 7efebc559700 1 -- 172.21.15.81:0/65791096 >> 172.21.15.81:0/65791096 conn(0x7efeb406cca0 msgr2=0x7efeb4154ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:06.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.838+0000 7efebc559700 1 -- 172.21.15.81:0/65791096 shutdown_connections 2023-10-07T08:44:06.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:06.838+0000 7efebc559700 1 -- 172.21.15.81:0/65791096 wait complete. 2023-10-07T08:44:06.850 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:44:06.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:44:06.887 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:44:06.935 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:44:06.935 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T08:44:06.935 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:44:07.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.049+0000 7f527bfff700 1 Processor -- start 2023-10-07T08:44:07.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.049+0000 7f527bfff700 1 -- start start 2023-10-07T08:44:07.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.050+0000 7f527bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f527c159b40 0x7f527c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:07.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.050+0000 7f527bfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527c0cee10 con 0x7f527c068e90 2023-10-07T08:44:07.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.050+0000 7f527bfff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527c0cd040 con 0x7f527c159f10 2023-10-07T08:44:07.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.050+0000 7f527bfff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527c0cd320 con 0x7f527c159b40 2023-10-07T08:44:07.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.050+0000 7f527b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f527c068e90 0x7f527c0cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57084/0 (socket says 172.21.15.81:57084) 2023-10-07T08:44:07.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.050+0000 7f527b7fe700 1 -- 172.21.15.81:0/2583881836 learned_addr learned my addr 172.21.15.81:0/2583881836 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:07.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.050+0000 7f527affd700 1 --2- 172.21.15.81:0/2583881836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f527c159b40 0x7f527c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:07.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.050+0000 7f527a7fc700 1 -- 172.21.15.81:0/2583881836 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664715854 0 0) 0x7f527c0cee10 con 0x7f527c068e90 2023-10-07T08:44:07.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.050+0000 7f527a7fc700 1 -- 172.21.15.81:0/2583881836 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5268003570 con 0x7f527c068e90 2023-10-07T08:44:07.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.050+0000 7f527a7fc700 1 -- 172.21.15.81:0/2583881836 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717449590 0 0) 0x7f527c0cd040 con 0x7f527c159f10 2023-10-07T08:44:07.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.050+0000 7f527a7fc700 1 -- 172.21.15.81:0/2583881836 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f527c0cee10 con 0x7f527c159f10 2023-10-07T08:44:07.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527a7fc700 1 -- 172.21.15.81:0/2583881836 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3010251935 0 0) 0x7f5268003570 con 0x7f527c068e90 2023-10-07T08:44:07.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527a7fc700 1 -- 172.21.15.81:0/2583881836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f527c159b40 msgr2=0x7f527c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:07.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527a7fc700 1 --2- 172.21.15.81:0/2583881836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f527c159b40 0x7f527c0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:07.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527a7fc700 1 -- 172.21.15.81:0/2583881836 >> v1:172.21.15.89:6789/0 conn(0x7f527c159f10 legacy=0x7f527c068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:07.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527a7fc700 1 -- 172.21.15.81:0/2583881836 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c0ce7c0 con 0x7f527c068e90 2023-10-07T08:44:07.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527a7fc700 1 -- 172.21.15.81:0/2583881836 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f52740017f0 con 0x7f527c068e90 2023-10-07T08:44:07.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527a7fc700 1 -- 172.21.15.81:0/2583881836 >> v1:172.21.15.81:6789/0 conn(0x7f527c068e90 legacy=0x7f527c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:07.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527a7fc700 1 --2- 172.21.15.81:0/2583881836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5268003c20 0x7f5268004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:07.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527a7fc700 1 --2- 172.21.15.81:0/2583881836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5268004810 0x7f5268004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:07.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527a7fc700 1 --2- 172.21.15.81:0/2583881836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f527c159b40 0x7f52680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:07.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527a7fc700 1 -- 172.21.15.81:0/2583881836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c0cd320 con 0x7f5268004810 2023-10-07T08:44:07.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527a7fc700 1 -- 172.21.15.81:0/2583881836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526800bb40 con 0x7f5268003c20 2023-10-07T08:44:07.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527a7fc700 1 -- 172.21.15.81:0/2583881836 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526800bd00 con 0x7f527c159b40 2023-10-07T08:44:07.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f52727fc700 1 --2- 172.21.15.81:0/2583881836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5268004810 0x7f5268004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:07.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527affd700 1 --2- 172.21.15.81:0/2583881836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5268003c20 0x7f5268004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:07.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527b7fe700 1 --2- 172.21.15.81:0/2583881836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f527c159b40 0x7f52680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f52727fc700 1 -- 172.21.15.81:0/2583881836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f527c159b40 msgr2=0x7f52680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f52727fc700 1 --2- 172.21.15.81:0/2583881836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f527c159b40 0x7f52680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f52727fc700 1 -- 172.21.15.81:0/2583881836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5268003c20 msgr2=0x7f5268004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f52727fc700 1 --2- 172.21.15.81:0/2583881836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5268003c20 0x7f5268004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f52727fc700 1 -- 172.21.15.81:0/2583881836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5268003570 con 0x7f5268004810 2023-10-07T08:44:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527b7fe700 1 --2- 172.21.15.81:0/2583881836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f527c159b40 0x7f52680051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f52727fc700 1 --2- 172.21.15.81:0/2583881836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5268004810 0x7f5268004c80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5264001a10 tx=0x7f5264007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c513ffb833bf8f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527a7fc700 1 -- 172.21.15.81:0/2583881836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526400c5d0 con 0x7f5268004810 2023-10-07T08:44:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527a7fc700 1 -- 172.21.15.81:0/2583881836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526400c730 con 0x7f5268004810 2023-10-07T08:44:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.051+0000 7f527a7fc700 1 -- 172.21.15.81:0/2583881836 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526400cad0 con 0x7f5268004810 2023-10-07T08:44:07.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.052+0000 7f527bfff700 1 -- 172.21.15.81:0/2583881836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5268004810 msgr2=0x7f5268004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:07.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.052+0000 7f527bfff700 1 --2- 172.21.15.81:0/2583881836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5268004810 0x7f5268004c80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5264001a10 tx=0x7f5264007d30 comp rx=0 tx=0).stop 2023-10-07T08:44:07.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.052+0000 7f527b7fe700 1 -- 172.21.15.81:0/2583881836 reap_dead start 2023-10-07T08:44:07.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.052+0000 7f527bfff700 1 -- 172.21.15.81:0/2583881836 shutdown_connections 2023-10-07T08:44:07.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.052+0000 7f527bfff700 1 -- 172.21.15.81:0/2583881836 >> 172.21.15.81:0/2583881836 conn(0x7f527c0cd660 msgr2=0x7f527c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:07.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.052+0000 7f527bfff700 1 -- 172.21.15.81:0/2583881836 shutdown_connections 2023-10-07T08:44:07.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.052+0000 7f527bfff700 1 -- 172.21.15.81:0/2583881836 wait complete. 2023-10-07T08:44:07.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.053+0000 7f527bfff700 1 Processor -- start 2023-10-07T08:44:07.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.053+0000 7f527bfff700 1 -- start start 2023-10-07T08:44:07.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5268004810 0x7f527c0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:07.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527bfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f527c0ca280 0x7f527c0ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:07.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f527c15ebc0 0x7f527c15f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:07.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c0cac30 con 0x7f527c15ebc0 2023-10-07T08:44:07.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527bfff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c15f570 con 0x7f527c0ca280 2023-10-07T08:44:07.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527bfff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527c16a7e0 con 0x7f5268004810 2023-10-07T08:44:07.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f527c15ebc0 0x7f527c15f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:07.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f527c15ebc0 0x7f527c15f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39754/0 (socket says 172.21.15.81:39754) 2023-10-07T08:44:07.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527b7fe700 1 -- 172.21.15.81:0/2538868385 learned_addr learned my addr 172.21.15.81:0/2538868385 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:07.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527affd700 1 --2- 172.21.15.81:0/2538868385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5268004810 0x7f527c0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:07.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f52727fc700 1 --2- 172.21.15.81:0/2538868385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f527c0ca280 0x7f527c0ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:07.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527b7fe700 1 -- 172.21.15.81:0/2538868385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5268004810 msgr2=0x7f527c0cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:07.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527b7fe700 1 --2- 172.21.15.81:0/2538868385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5268004810 0x7f527c0cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527b7fe700 1 -- 172.21.15.81:0/2538868385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f527c0ca280 msgr2=0x7f527c0ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527b7fe700 1 --2- 172.21.15.81:0/2538868385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f527c0ca280 0x7f527c0ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527b7fe700 1 -- 172.21.15.81:0/2538868385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c16aac0 con 0x7f527c15ebc0 2023-10-07T08:44:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527b7fe700 1 --2- 172.21.15.81:0/2538868385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f527c15ebc0 0x7f527c15f030 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5274000f80 tx=0x7f52740012a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f52737fe700 1 -- 172.21.15.81:0/2538868385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527400eab0 con 0x7f527c15ebc0 2023-10-07T08:44:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f52737fe700 1 -- 172.21.15.81:0/2538868385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527400ec30 con 0x7f527c15ebc0 2023-10-07T08:44:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.054+0000 7f527bfff700 1 -- 172.21.15.81:0/2538868385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c16ada0 con 0x7f527c15ebc0 2023-10-07T08:44:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.055+0000 7f52737fe700 1 -- 172.21.15.81:0/2538868385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274013420 con 0x7f527c15ebc0 2023-10-07T08:44:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.055+0000 7f527bfff700 1 -- 172.21.15.81:0/2538868385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c16b360 con 0x7f527c15ebc0 2023-10-07T08:44:07.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.056+0000 7f52737fe700 1 -- 172.21.15.81:0/2538868385 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52740137d0 con 0x7f527c15ebc0 2023-10-07T08:44:07.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.056+0000 7f527bfff700 1 -- 172.21.15.81:0/2538868385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527c063e90 con 0x7f527c15ebc0 2023-10-07T08:44:07.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.056+0000 7f52737fe700 1 --2- 172.21.15.81:0/2538868385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f525c066f30 0x7f525c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:07.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.056+0000 7f52737fe700 1 -- 172.21.15.81:0/2538868385 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f52740846e0 con 0x7f527c15ebc0 2023-10-07T08:44:07.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.056+0000 7f527affd700 1 --2- 172.21.15.81:0/2538868385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f525c066f30 0x7f525c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:07.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.057+0000 7f527affd700 1 --2- 172.21.15.81:0/2538868385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f525c066f30 0x7f525c0693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f526c006f00 tx=0x7f526c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:07.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.061+0000 7f52737fe700 1 -- 172.21.15.81:0/2538868385 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5274051bb0 con 0x7f527c15ebc0 2023-10-07T08:44:07.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.281+0000 7f527bfff700 1 -- 172.21.15.81:0/2538868385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f527c0ceaa0 con 0x7f527c15ebc0 2023-10-07T08:44:07.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.282+0000 7f52737fe700 1 -- 172.21.15.81:0/2538868385 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f52740551d0 con 0x7f527c15ebc0 2023-10-07T08:44:07.282 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:07.283 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1843075449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1843075449},{"type":"v1","addr":"172.21.15.81:6837","nonce":1843075449}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3013270804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3013270804},{"type":"v1","addr":"172.21.15.89:6835","nonce":3013270804}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4823,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/3406609789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3406609789},{"type":"v1","addr":"172.21.15.89:6834","nonce":3406609789}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3825515993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3825515993},{"type":"v1","addr":"172.21.15.81:6836","nonce":3825515993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-10-07T08:44:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.284+0000 7f527bfff700 1 -- 172.21.15.81:0/2538868385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f525c066f30 msgr2=0x7f525c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.284+0000 7f527bfff700 1 --2- 172.21.15.81:0/2538868385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f525c066f30 0x7f525c0693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f526c006f00 tx=0x7f526c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.284+0000 7f527bfff700 1 -- 172.21.15.81:0/2538868385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f527c15ebc0 msgr2=0x7f527c15f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.284+0000 7f527bfff700 1 --2- 172.21.15.81:0/2538868385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f527c15ebc0 0x7f527c15f030 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5274000f80 tx=0x7f52740012a0 comp rx=0 tx=0).stop 2023-10-07T08:44:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.284+0000 7f527bfff700 1 -- 172.21.15.81:0/2538868385 shutdown_connections 2023-10-07T08:44:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.284+0000 7f527bfff700 1 --2- 172.21.15.81:0/2538868385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f527c15ebc0 0x7f527c15f030 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.284+0000 7f527bfff700 1 --2- 172.21.15.81:0/2538868385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f525c066f30 0x7f525c0693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.284+0000 7f527bfff700 1 --2- 172.21.15.81:0/2538868385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5268004810 0x7f527c0cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.284+0000 7f527bfff700 1 --2- 172.21.15.81:0/2538868385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f527c0ca280 0x7f527c0ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.284+0000 7f527bfff700 1 -- 172.21.15.81:0/2538868385 >> 172.21.15.81:0/2538868385 conn(0x7f527c0cd660 msgr2=0x7f527c158c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.284+0000 7f527bfff700 1 -- 172.21.15.81:0/2538868385 shutdown_connections 2023-10-07T08:44:07.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:07.284+0000 7f527bfff700 1 -- 172.21.15.81:0/2538868385 wait complete. 2023-10-07T08:44:07.286 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-10-07T08:44:07.298 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T08:44:07.298 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T08:44:07.299 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T08:44:07.299 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:44:07.299 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T08:44:07.299 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T08:44:07.299 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T08:44:07.299 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:44:07.299 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T08:44:07.300 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T08:44:07.300 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T08:44:07.300 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:44:07.300 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T08:44:07.300 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T08:44:07.300 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T08:44:07.300 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:44:07.310 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T08:44:07.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T08:44:07.311 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T08:44:07.311 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T08:44:07.312 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T08:44:07.312 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T08:44:07.353 INFO:tasks.ceph.mds.c:Started 2023-10-07T08:44:07.353 DEBUG:teuthology.parallel:result is None 2023-10-07T08:44:07.354 INFO:tasks.ceph.mds.b:Started 2023-10-07T08:44:07.354 DEBUG:teuthology.parallel:result is None 2023-10-07T08:44:07.355 INFO:tasks.ceph.mds.d:Started 2023-10-07T08:44:07.355 DEBUG:teuthology.parallel:result is None 2023-10-07T08:44:07.423 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-07T08:44:07.434 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-10-07T08:44:07.434 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-10-07T08:44:08.179 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-07T08:44:13.310 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T08:44:13.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T08:44:13.312 INFO:tasks.ceph.mds.a:Started 2023-10-07T08:44:13.313 DEBUG:teuthology.parallel:result is None 2023-10-07T08:44:13.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T08:44:13.391 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-07T08:44:13.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.437+0000 7fec16b61700 1 Processor -- start 2023-10-07T08:44:13.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.437+0000 7fec16b61700 1 -- start start 2023-10-07T08:44:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.437+0000 7fec16b61700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec101578d0 0x7fec100cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.437+0000 7fec16b61700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec10157ca0 0x7fec1015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.437+0000 7fec16b61700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fec1006d120 0x7fec1006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.437+0000 7fec16b61700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1006dac0 con 0x7fec10157ca0 2023-10-07T08:44:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.437+0000 7fec16b61700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec100d07c0 con 0x7fec1006d120 2023-10-07T08:44:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.437+0000 7fec16b61700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec100cfbb0 con 0x7fec101578d0 2023-10-07T08:44:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.438+0000 7fec07fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec10157ca0 0x7fec1015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.438+0000 7fec07fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec10157ca0 0x7fec1015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39826/0 (socket says 172.21.15.81:39826) 2023-10-07T08:44:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.438+0000 7fec07fff700 1 -- 172.21.15.81:0/492560554 learned_addr learned my addr 172.21.15.81:0/492560554 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.438+0000 7fec150fe700 1 --2- 172.21.15.81:0/492560554 >> v2:172.21.15.89:3300/0 conn(0x7fec1006d120 0x7fec1006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.438+0000 7fec148fd700 1 --2- 172.21.15.81:0/492560554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec101578d0 0x7fec100cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.438+0000 7fec07fff700 1 -- 172.21.15.81:0/492560554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec101578d0 msgr2=0x7fec100cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.438+0000 7fec07fff700 1 --2- 172.21.15.81:0/492560554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec101578d0 0x7fec100cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.438+0000 7fec07fff700 1 -- 172.21.15.81:0/492560554 >> v2:172.21.15.89:3300/0 conn(0x7fec1006d120 msgr2=0x7fec1006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.438+0000 7fec07fff700 1 --2- 172.21.15.81:0/492560554 >> v2:172.21.15.89:3300/0 conn(0x7fec1006d120 0x7fec1006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.438+0000 7fec07fff700 1 -- 172.21.15.81:0/492560554 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec100cfe90 con 0x7fec10157ca0 2023-10-07T08:44:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.438+0000 7fec07fff700 1 --2- 172.21.15.81:0/492560554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec10157ca0 0x7fec1015af00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fec100b3940 tx=0x7fec00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e981cefb6c7448db server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.438+0000 7fec077fe700 1 -- 172.21.15.81:0/492560554 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000b640 con 0x7fec10157ca0 2023-10-07T08:44:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.438+0000 7fec077fe700 1 -- 172.21.15.81:0/492560554 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0000b7a0 con 0x7fec10157ca0 2023-10-07T08:44:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.438+0000 7fec077fe700 1 -- 172.21.15.81:0/492560554 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000bb60 con 0x7fec10157ca0 2023-10-07T08:44:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.439+0000 7fec16b61700 1 -- 172.21.15.81:0/492560554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec10157ca0 msgr2=0x7fec1015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.439+0000 7fec16b61700 1 --2- 172.21.15.81:0/492560554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec10157ca0 0x7fec1015af00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fec100b3940 tx=0x7fec00009250 comp rx=0 tx=0).stop 2023-10-07T08:44:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.439+0000 7fec16b61700 1 -- 172.21.15.81:0/492560554 shutdown_connections 2023-10-07T08:44:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.439+0000 7fec16b61700 1 --2- 172.21.15.81:0/492560554 >> v2:172.21.15.89:3300/0 conn(0x7fec1006d120 0x7fec1006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.439+0000 7fec16b61700 1 --2- 172.21.15.81:0/492560554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec101578d0 0x7fec100cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.439+0000 7fec16b61700 1 --2- 172.21.15.81:0/492560554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec10157ca0 0x7fec1015af00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.439+0000 7fec16b61700 1 -- 172.21.15.81:0/492560554 >> 172.21.15.81:0/492560554 conn(0x7fec1006bb90 msgr2=0x7fec1006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.439+0000 7fec16b61700 1 -- 172.21.15.81:0/492560554 shutdown_connections 2023-10-07T08:44:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.439+0000 7fec16b61700 1 -- 172.21.15.81:0/492560554 wait complete. 2023-10-07T08:44:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.440+0000 7fec16b61700 1 Processor -- start 2023-10-07T08:44:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.440+0000 7fec16b61700 1 -- start start 2023-10-07T08:44:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec16b61700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec1006d120 0x7fec1016ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec16b61700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec101578d0 0x7fec100b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec16b61700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec10157ca0 0x7fec100b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec16b61700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec100c9460 con 0x7fec101578d0 2023-10-07T08:44:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec16b61700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec100c9670 con 0x7fec1006d120 2023-10-07T08:44:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec16b61700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec100c9950 con 0x7fec10157ca0 2023-10-07T08:44:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec07fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec101578d0 0x7fec100b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec07fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec101578d0 0x7fec100b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39842/0 (socket says 172.21.15.81:39842) 2023-10-07T08:44:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec07fff700 1 -- 172.21.15.81:0/1228579968 learned_addr learned my addr 172.21.15.81:0/1228579968 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec150fe700 1 --2- 172.21.15.81:0/1228579968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec10157ca0 0x7fec100b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec148fd700 1 --2- 172.21.15.81:0/1228579968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec1006d120 0x7fec1016ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:13.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec07fff700 1 -- 172.21.15.81:0/1228579968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec10157ca0 msgr2=0x7fec100b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:13.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec07fff700 1 --2- 172.21.15.81:0/1228579968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec10157ca0 0x7fec100b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:13.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec07fff700 1 -- 172.21.15.81:0/1228579968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec1006d120 msgr2=0x7fec1016ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:13.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec07fff700 1 --2- 172.21.15.81:0/1228579968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec1006d120 0x7fec1016ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:13.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec07fff700 1 -- 172.21.15.81:0/1228579968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec000094f0 con 0x7fec101578d0 2023-10-07T08:44:13.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec07fff700 1 --2- 172.21.15.81:0/1228579968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec101578d0 0x7fec100b5cf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fec1006fe20 tx=0x7fec00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:13.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec04ff9700 1 -- 172.21.15.81:0/1228579968 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000b910 con 0x7fec101578d0 2023-10-07T08:44:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec04ff9700 1 -- 172.21.15.81:0/1228579968 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0000ba70 con 0x7fec101578d0 2023-10-07T08:44:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec16b61700 1 -- 172.21.15.81:0/1228579968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec100c9c30 con 0x7fec101578d0 2023-10-07T08:44:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec04ff9700 1 -- 172.21.15.81:0/1228579968 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec00011630 con 0x7fec101578d0 2023-10-07T08:44:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.441+0000 7fec16b61700 1 -- 172.21.15.81:0/1228579968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec100ca430 con 0x7fec101578d0 2023-10-07T08:44:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.442+0000 7fec16b61700 1 -- 172.21.15.81:0/1228579968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec10067ac0 con 0x7fec101578d0 2023-10-07T08:44:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.443+0000 7fec04ff9700 1 -- 172.21.15.81:0/1228579968 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec000119a0 con 0x7fec101578d0 2023-10-07T08:44:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.443+0000 7fec04ff9700 1 --2- 172.21.15.81:0/1228579968 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7febfc066f30 0x7febfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.443+0000 7fec04ff9700 1 -- 172.21.15.81:0/1228579968 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fec00085850 con 0x7fec101578d0 2023-10-07T08:44:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.443+0000 7fec148fd700 1 --2- 172.21.15.81:0/1228579968 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7febfc066f30 0x7febfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.443+0000 7fec148fd700 1 --2- 172.21.15.81:0/1228579968 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7febfc066f30 0x7febfc0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009db0 tx=0x7fec0c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.447+0000 7fec04ff9700 1 -- 172.21.15.81:0/1228579968 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec00052dc0 con 0x7fec101578d0 2023-10-07T08:44:13.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:13.642+0000 7fec16b61700 1 -- 172.21.15.81:0/1228579968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fec100d0170 con 0x7fec101578d0 2023-10-07T08:44:14.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-07T08:44:15.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.392+0000 7fec04ff9700 1 -- 172.21.15.81:0/1228579968 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v43) v1 ==== 97+0+0 (secure 0 0 0) 0x7fec000563e0 con 0x7fec101578d0 2023-10-07T08:44:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.394+0000 7fec16b61700 1 -- 172.21.15.81:0/1228579968 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7febfc066f30 msgr2=0x7febfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.394+0000 7fec16b61700 1 --2- 172.21.15.81:0/1228579968 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7febfc066f30 0x7febfc0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009db0 tx=0x7fec0c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.394+0000 7fec16b61700 1 -- 172.21.15.81:0/1228579968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec101578d0 msgr2=0x7fec100b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.394+0000 7fec16b61700 1 --2- 172.21.15.81:0/1228579968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec101578d0 0x7fec100b5cf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fec1006fe20 tx=0x7fec00017000 comp rx=0 tx=0).stop 2023-10-07T08:44:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.394+0000 7fec16b61700 1 -- 172.21.15.81:0/1228579968 shutdown_connections 2023-10-07T08:44:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.394+0000 7fec16b61700 1 --2- 172.21.15.81:0/1228579968 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7febfc066f30 0x7febfc0693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.394+0000 7fec16b61700 1 --2- 172.21.15.81:0/1228579968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec10157ca0 0x7fec100b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.394+0000 7fec16b61700 1 --2- 172.21.15.81:0/1228579968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec1006d120 0x7fec1016ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.394+0000 7fec16b61700 1 --2- 172.21.15.81:0/1228579968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec101578d0 0x7fec100b5cf0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.394+0000 7fec16b61700 1 -- 172.21.15.81:0/1228579968 >> 172.21.15.81:0/1228579968 conn(0x7fec1006bb90 msgr2=0x7fec10156620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.394+0000 7fec16b61700 1 -- 172.21.15.81:0/1228579968 shutdown_connections 2023-10-07T08:44:15.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.394+0000 7fec16b61700 1 -- 172.21.15.81:0/1228579968 wait complete. 2023-10-07T08:44:15.396 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-07T08:44:15.408 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T08:44:15.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.524+0000 7faac25a4700 1 Processor -- start 2023-10-07T08:44:15.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.524+0000 7faac25a4700 1 -- start start 2023-10-07T08:44:15.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.525+0000 7faac25a4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faabc157ca0 0x7faabc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:15.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.525+0000 7faac25a4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc0d07c0 con 0x7faabc06d120 2023-10-07T08:44:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.525+0000 7faac25a4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc0cfbb0 con 0x7faabc1578d0 2023-10-07T08:44:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.525+0000 7faac25a4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faabc0cfe90 con 0x7faabc157ca0 2023-10-07T08:44:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.525+0000 7faabb7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faabc157ca0 0x7faabc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.525+0000 7faac0b41700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faabc06d120 0x7faabc06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33034/0 (socket says 172.21.15.81:33034) 2023-10-07T08:44:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.525+0000 7faac0b41700 1 -- 172.21.15.81:0/2568039413 learned_addr learned my addr 172.21.15.81:0/2568039413 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.526+0000 7faabb7fe700 1 -- 172.21.15.81:0/2568039413 >> v1:172.21.15.89:6789/0 conn(0x7faabc1578d0 legacy=0x7faabc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.526+0000 7faabb7fe700 1 -- 172.21.15.81:0/2568039413 >> v1:172.21.15.81:6789/0 conn(0x7faabc06d120 legacy=0x7faabc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.526+0000 7faabaffd700 1 -- 172.21.15.81:0/2568039413 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595293546 0 0) 0x7faabc0d07c0 con 0x7faabc06d120 2023-10-07T08:44:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.526+0000 7faabb7fe700 1 -- 172.21.15.81:0/2568039413 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc0d0170 con 0x7faabc157ca0 2023-10-07T08:44:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.526+0000 7faabb7fe700 1 --2- 172.21.15.81:0/2568039413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faabc157ca0 0x7faabc0cf4f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7faaa40098e0 tx=0x7faaa40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584ece6bda6a5066 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:15.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.526+0000 7faabaffd700 1 -- 172.21.15.81:0/2568039413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4009e80 con 0x7faabc157ca0 2023-10-07T08:44:15.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.526+0000 7faabaffd700 1 -- 172.21.15.81:0/2568039413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa400b820 con 0x7faabc157ca0 2023-10-07T08:44:15.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.526+0000 7faabaffd700 1 -- 172.21.15.81:0/2568039413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa400bba0 con 0x7faabc157ca0 2023-10-07T08:44:15.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.526+0000 7faac25a4700 1 -- 172.21.15.81:0/2568039413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faabc157ca0 msgr2=0x7faabc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:15.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.526+0000 7faac25a4700 1 --2- 172.21.15.81:0/2568039413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faabc157ca0 0x7faabc0cf4f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7faaa40098e0 tx=0x7faaa40091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.526+0000 7faac25a4700 1 -- 172.21.15.81:0/2568039413 shutdown_connections 2023-10-07T08:44:15.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.526+0000 7faac25a4700 1 --2- 172.21.15.81:0/2568039413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faabc157ca0 0x7faabc0cf4f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.526+0000 7faac25a4700 1 -- 172.21.15.81:0/2568039413 >> 172.21.15.81:0/2568039413 conn(0x7faabc06bb90 msgr2=0x7faabc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:15.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.526+0000 7faac25a4700 1 -- 172.21.15.81:0/2568039413 shutdown_connections 2023-10-07T08:44:15.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.527+0000 7faac25a4700 1 -- 172.21.15.81:0/2568039413 wait complete. 2023-10-07T08:44:15.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.527+0000 7faac25a4700 1 Processor -- start 2023-10-07T08:44:15.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.528+0000 7faac25a4700 1 -- start start 2023-10-07T08:44:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.528+0000 7faac25a4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faabc06d120 0x7faabc143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.528+0000 7faac25a4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faabc1578d0 0x7faabc159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.528+0000 7faac25a4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faabc157ca0 0x7faabc0aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.528+0000 7faac25a4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc159ac0 con 0x7faabc06d120 2023-10-07T08:44:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.528+0000 7faac25a4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc1432e0 con 0x7faabc157ca0 2023-10-07T08:44:15.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.528+0000 7faac25a4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0ac420 con 0x7faabc1578d0 2023-10-07T08:44:15.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.528+0000 7faabbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faabc06d120 0x7faabc143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:15.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faabbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faabc06d120 0x7faabc143570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39848/0 (socket says 172.21.15.81:39848) 2023-10-07T08:44:15.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faabbfff700 1 -- 172.21.15.81:0/1579107364 learned_addr learned my addr 172.21.15.81:0/1579107364 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:15.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faabbfff700 1 -- 172.21.15.81:0/1579107364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faabc1578d0 msgr2=0x7faabc159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:15.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faabb7fe700 1 --2- 172.21.15.81:0/1579107364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faabc1578d0 0x7faabc159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:15.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faac0b41700 1 --2- 172.21.15.81:0/1579107364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faabc157ca0 0x7faabc0aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:15.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faabbfff700 1 --2- 172.21.15.81:0/1579107364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faabc1578d0 0x7faabc159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faabbfff700 1 -- 172.21.15.81:0/1579107364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faabc157ca0 msgr2=0x7faabc0aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:15.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faabbfff700 1 --2- 172.21.15.81:0/1579107364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faabc157ca0 0x7faabc0aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faabbfff700 1 -- 172.21.15.81:0/1579107364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa4009420 con 0x7faabc06d120 2023-10-07T08:44:15.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faac0b41700 1 --2- 172.21.15.81:0/1579107364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faabc157ca0 0x7faabc0aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:15.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faabb7fe700 1 --2- 172.21.15.81:0/1579107364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faabc1578d0 0x7faabc159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:15.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faabbfff700 1 --2- 172.21.15.81:0/1579107364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faabc06d120 0x7faabc143570 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7faaac00c5d0 tx=0x7faaac007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:15.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faab3fff700 1 -- 172.21.15.81:0/1579107364 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac011590 con 0x7faabc06d120 2023-10-07T08:44:15.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faab3fff700 1 -- 172.21.15.81:0/1579107364 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac011710 con 0x7faabc06d120 2023-10-07T08:44:15.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faac25a4700 1 -- 172.21.15.81:0/1579107364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faabc0ab810 con 0x7faabc06d120 2023-10-07T08:44:15.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faab3fff700 1 -- 172.21.15.81:0/1579107364 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac011ad0 con 0x7faabc06d120 2023-10-07T08:44:15.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.529+0000 7faac25a4700 1 -- 172.21.15.81:0/1579107364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc0abdd0 con 0x7faabc06d120 2023-10-07T08:44:15.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.530+0000 7faac25a4700 1 -- 172.21.15.81:0/1579107364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faabc067ac0 con 0x7faabc06d120 2023-10-07T08:44:15.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.530+0000 7faab3fff700 1 -- 172.21.15.81:0/1579107364 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faaac01c460 con 0x7faabc06d120 2023-10-07T08:44:15.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.531+0000 7faab3fff700 1 --2- 172.21.15.81:0/1579107364 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faa9c066f30 0x7faa9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:15.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.531+0000 7faab3fff700 1 -- 172.21.15.81:0/1579107364 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4853+0+0 (secure 0 0 0) 0x7faaac083f80 con 0x7faabc06d120 2023-10-07T08:44:15.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.531+0000 7faabb7fe700 1 --2- 172.21.15.81:0/1579107364 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faa9c066f30 0x7faa9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:15.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.531+0000 7faabb7fe700 1 --2- 172.21.15.81:0/1579107364 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faa9c066f30 0x7faa9c0693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faabc1580c0 tx=0x7faaa4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:15.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.535+0000 7faab3fff700 1 -- 172.21.15.81:0/1579107364 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faaac051540 con 0x7faabc06d120 2023-10-07T08:44:15.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.788+0000 7faac25a4700 1 -- 172.21.15.81:0/1579107364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7faabc0d0450 con 0x7faabc06d120 2023-10-07T08:44:15.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.789+0000 7faab3fff700 1 -- 172.21.15.81:0/1579107364 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7faaac054b60 con 0x7faabc06d120 2023-10-07T08:44:15.789 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:15.789 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:44:15.790 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-07T08:44:15.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.790 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-07T08:44:15.790 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlK8v0EhAAyj+l+ifyEevPT96HbuWzkw==", 2023-10-07T08:44:15.790 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.790 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:44:15.790 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:44:15.790 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:44:15.790 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:44:15.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.791 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-07T08:44:15.791 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlN0UcHhAA0o1jHEL9Ow40VDezKTunOw==", 2023-10-07T08:44:15.791 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.791 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:44:15.791 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:44:15.792 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:44:15.792 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:44:15.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.792 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-07T08:44:15.792 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlvsm6GRAApZehzqt3HugU+h9RGWQh8g==", 2023-10-07T08:44:15.792 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.792 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:44:15.793 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:44:15.793 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:44:15.793 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:44:15.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.793 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-07T08:44:15.793 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8XLiJBAAMBqSo/+NZuuL/pPnTitAUw==", 2023-10-07T08:44:15.793 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.794 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:44:15.794 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:44:15.794 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:44:15.794 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:44:15.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.795 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-07T08:44:15.795 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD2GSFlwYNOOBAAMpoFTAZdRERvqFbI4Lno9g==", 2023-10-07T08:44:15.795 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.795 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:44:15.795 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:44:15.795 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:44:15.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.796 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-07T08:44:15.796 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlejEnBBAAsnZCgsTTMWvqr2n4FfgWCQ==", 2023-10-07T08:44:15.796 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.796 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:44:15.796 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:44:15.796 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:44:15.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.797 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-07T08:44:15.797 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlDjS3DRAAfyBS9XSkAY6Se+RNw9jwWw==", 2023-10-07T08:44:15.797 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.797 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:44:15.797 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:44:15.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:44:15.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.798 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-07T08:44:15.798 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlnLaEFxAAtQ3AxrEGCcXYvJF2/wP1yw==", 2023-10-07T08:44:15.798 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.798 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:44:15.798 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:44:15.799 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:44:15.799 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.799 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-07T08:44:15.799 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlllNdIRAAXgD+PAR1Piya6p94xfGbXA==", 2023-10-07T08:44:15.799 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.799 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:44:15.799 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:44:15.799 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:44:15.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.800 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-07T08:44:15.800 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFleIM7KBAAIz+WlbgsmtAuSMPO+kh/Xw==", 2023-10-07T08:44:15.800 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.800 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:44:15.800 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:44:15.800 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:44:15.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.801 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-07T08:44:15.801 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlFNlEMRAAt7dpMTylOj0KsJy/law6Nw==", 2023-10-07T08:44:15.801 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.801 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:44:15.801 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:44:15.801 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:44:15.801 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.801 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-07T08:44:15.801 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFloCRbOhAA8XzXVwVYYYZIJV+F84EiDQ==", 2023-10-07T08:44:15.801 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.802 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:44:15.802 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:44:15.802 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:44:15.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.804 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-07T08:44:15.804 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl7cS0KBAA2K6kkFjyEZYa0xYx53Nf7g==", 2023-10-07T08:44:15.804 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.804 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:44:15.804 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-07T08:44:15.804 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T08:44:15.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.805 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-07T08:44:15.805 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlP3EBMRAAWXcQeEkoEzBCSQzvz/AzBQ==", 2023-10-07T08:44:15.805 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.805 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:44:15.805 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:44:15.805 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:44:15.805 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:44:15.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.806 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-07T08:44:15.806 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFldtgKLhAAX8L0S1NgyHsOj4cUljxH/A==", 2023-10-07T08:44:15.806 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.806 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:44:15.806 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:44:15.807 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:44:15.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:44:15.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.807 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-07T08:44:15.807 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlJ+VXNhAA9sXFpdOEIZxQLiS8LJwa3A==", 2023-10-07T08:44:15.807 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:44:15.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:44:15.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:44:15.808 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:44:15.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.808 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-07T08:44:15.808 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDyGSFle021MxAA39oudTkATALz6ZklfA0QQA==", 2023-10-07T08:44:15.808 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:44:15.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:44:15.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:44:15.809 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:44:15.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.809 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-07T08:44:15.809 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8c3zDxAAKU/DHPPZhFJ1MKw48C6lJQ==", 2023-10-07T08:44:15.809 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:44:15.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:44:15.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:44:15.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:15.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:15.810 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-07T08:44:15.810 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlByYuDBAA2xkiT3FNBRXjSMlu+GdRjg==", 2023-10-07T08:44:15.810 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:44:15.810 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:44:15.810 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:44:15.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:44:15.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:15.811 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:15.811 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:44:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.791+0000 7faac25a4700 1 -- 172.21.15.81:0/1579107364 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faa9c066f30 msgr2=0x7faa9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.791+0000 7faac25a4700 1 --2- 172.21.15.81:0/1579107364 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faa9c066f30 0x7faa9c0693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faabc1580c0 tx=0x7faaa4016000 comp rx=0 tx=0).stop 2023-10-07T08:44:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.791+0000 7faac25a4700 1 -- 172.21.15.81:0/1579107364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faabc06d120 msgr2=0x7faabc143570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.791+0000 7faac25a4700 1 --2- 172.21.15.81:0/1579107364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faabc06d120 0x7faabc143570 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7faaac00c5d0 tx=0x7faaac007f60 comp rx=0 tx=0).stop 2023-10-07T08:44:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.791+0000 7faac25a4700 1 -- 172.21.15.81:0/1579107364 shutdown_connections 2023-10-07T08:44:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.791+0000 7faac25a4700 1 --2- 172.21.15.81:0/1579107364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faabc157ca0 0x7faabc0aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.791+0000 7faac25a4700 1 --2- 172.21.15.81:0/1579107364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faabc06d120 0x7faabc143570 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.791+0000 7faac25a4700 1 --2- 172.21.15.81:0/1579107364 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faa9c066f30 0x7faa9c0693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.791+0000 7faac25a4700 1 --2- 172.21.15.81:0/1579107364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faabc1578d0 0x7faabc159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.791+0000 7faac25a4700 1 -- 172.21.15.81:0/1579107364 >> 172.21.15.81:0/1579107364 conn(0x7faabc06bb90 msgr2=0x7faabc155940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.791+0000 7faac25a4700 1 -- 172.21.15.81:0/1579107364 shutdown_connections 2023-10-07T08:44:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.791+0000 7faac25a4700 1 -- 172.21.15.81:0/1579107364 wait complete. 2023-10-07T08:44:15.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:44:15.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.927+0000 7f8b7f216700 1 Processor -- start 2023-10-07T08:44:15.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.927+0000 7f8b7f216700 1 -- start start 2023-10-07T08:44:15.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.928+0000 7f8b7f216700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b78159f10 0x7f8b78068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:15.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.928+0000 7f8b7f216700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b78069120 con 0x7f8b78159b40 2023-10-07T08:44:15.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.928+0000 7f8b7f216700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b780cee10 con 0x7f8b78068cc0 2023-10-07T08:44:15.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.928+0000 7f8b7f216700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b780cd040 con 0x7f8b78159f10 2023-10-07T08:44:15.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.928+0000 7f8b7e214700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8b78159b40 0x7f8b780cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33044/0 (socket says 172.21.15.81:33044) 2023-10-07T08:44:15.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.928+0000 7f8b7e214700 1 -- 172.21.15.81:0/3758260046 learned_addr learned my addr 172.21.15.81:0/3758260046 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:15.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.928+0000 7f8b7d212700 1 -- 172.21.15.81:0/3758260046 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961055454 0 0) 0x7f8b74001490 con 0x7f8b78159b40 2023-10-07T08:44:15.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.928+0000 7f8b7d212700 1 -- 172.21.15.81:0/3758260046 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b64003570 con 0x7f8b78159b40 2023-10-07T08:44:15.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.928+0000 7f8b7da13700 1 --2- 172.21.15.81:0/3758260046 >> v2:172.21.15.89:3300/0 conn(0x7f8b78159f10 0x7f8b78068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:15.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7d212700 1 -- 172.21.15.81:0/3758260046 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3393865551 0 0) 0x7f8b64003570 con 0x7f8b78159b40 2023-10-07T08:44:15.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7d212700 1 -- 172.21.15.81:0/3758260046 >> v2:172.21.15.89:3300/0 conn(0x7f8b78159f10 msgr2=0x7f8b78068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:15.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7d212700 1 --2- 172.21.15.81:0/3758260046 >> v2:172.21.15.89:3300/0 conn(0x7f8b78159f10 0x7f8b78068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7d212700 1 -- 172.21.15.81:0/3758260046 >> v1:172.21.15.89:6789/0 conn(0x7f8b78068cc0 legacy=0x7f8b780cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:15.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7d212700 1 -- 172.21.15.81:0/3758260046 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b780cd320 con 0x7f8b78159b40 2023-10-07T08:44:15.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7d212700 1 -- 172.21.15.81:0/3758260046 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f8b74001980 con 0x7f8b78159b40 2023-10-07T08:44:15.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7d212700 1 -- 172.21.15.81:0/3758260046 >> v1:172.21.15.81:6789/0 conn(0x7f8b78159b40 legacy=0x7f8b780cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:15.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7d212700 1 --2- 172.21.15.81:0/3758260046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b64003a60 0x7f8b64003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:15.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7d212700 1 --2- 172.21.15.81:0/3758260046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b64004810 0x7f8b64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:15.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7d212700 1 --2- 172.21.15.81:0/3758260046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b640051c0 0x7f8b6400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:15.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7d212700 1 -- 172.21.15.81:0/3758260046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b780cd040 con 0x7f8b64004810 2023-10-07T08:44:15.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7d212700 1 -- 172.21.15.81:0/3758260046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6400c0d0 con 0x7f8b640051c0 2023-10-07T08:44:15.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7d212700 1 -- 172.21.15.81:0/3758260046 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6400c290 con 0x7f8b64003a60 2023-10-07T08:44:15.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7da13700 1 --2- 172.21.15.81:0/3758260046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b64004810 0x7f8b64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:15.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7e214700 1 --2- 172.21.15.81:0/3758260046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b64003a60 0x7f8b64003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:15.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7ea15700 1 --2- 172.21.15.81:0/3758260046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b640051c0 0x7f8b6400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:15.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7da13700 1 -- 172.21.15.81:0/3758260046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b64003a60 msgr2=0x7f8b64003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:15.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7da13700 1 --2- 172.21.15.81:0/3758260046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b64003a60 0x7f8b64003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7da13700 1 -- 172.21.15.81:0/3758260046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b640051c0 msgr2=0x7f8b6400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:15.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7da13700 1 --2- 172.21.15.81:0/3758260046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b640051c0 0x7f8b6400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7ea15700 1 -- 172.21.15.81:0/3758260046 reap_dead start 2023-10-07T08:44:15.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7da13700 1 -- 172.21.15.81:0/3758260046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b64003570 con 0x7f8b64004810 2023-10-07T08:44:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7da13700 1 --2- 172.21.15.81:0/3758260046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b64004810 0x7f8b64004c80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009c00 tx=0x7f8b680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d35b3954c7263d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7d212700 1 -- 172.21.15.81:0/3758260046 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6800e710 con 0x7f8b64004810 2023-10-07T08:44:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7d212700 1 -- 172.21.15.81:0/3758260046 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6800e870 con 0x7f8b64004810 2023-10-07T08:44:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.929+0000 7f8b7d212700 1 -- 172.21.15.81:0/3758260046 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6800ec30 con 0x7f8b64004810 2023-10-07T08:44:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.930+0000 7f8b7f216700 1 -- 172.21.15.81:0/3758260046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b64004810 msgr2=0x7f8b64004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.930+0000 7f8b7f216700 1 --2- 172.21.15.81:0/3758260046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b64004810 0x7f8b64004c80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009c00 tx=0x7f8b680091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.930+0000 7f8b7f216700 1 -- 172.21.15.81:0/3758260046 shutdown_connections 2023-10-07T08:44:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.930+0000 7f8b7f216700 1 --2- 172.21.15.81:0/3758260046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b64004810 0x7f8b64004c80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.930+0000 7f8b7f216700 1 -- 172.21.15.81:0/3758260046 >> 172.21.15.81:0/3758260046 conn(0x7f8b780cd660 msgr2=0x7f8b780cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.930+0000 7f8b7f216700 1 -- 172.21.15.81:0/3758260046 shutdown_connections 2023-10-07T08:44:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.930+0000 7f8b7f216700 1 -- 172.21.15.81:0/3758260046 wait complete. 2023-10-07T08:44:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.931+0000 7f8b7f216700 1 Processor -- start 2023-10-07T08:44:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.931+0000 7f8b7f216700 1 -- start start 2023-10-07T08:44:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7f216700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b64004810 0x7f8b781589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7f216700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b7816a2c0 0x7f8b7815c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7f216700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b7816a730 0x7f8b7816d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7f216700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b780c8ed0 con 0x7f8b64004810 2023-10-07T08:44:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7f216700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b780c9a50 con 0x7f8b7816a2c0 2023-10-07T08:44:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7f216700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7816e650 con 0x7f8b7816a730 2023-10-07T08:44:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7e214700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b64004810 0x7f8b781589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7e214700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b64004810 0x7f8b781589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39874/0 (socket says 172.21.15.81:39874) 2023-10-07T08:44:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7e214700 1 -- 172.21.15.81:0/2946510541 learned_addr learned my addr 172.21.15.81:0/2946510541 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:15.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7da13700 1 --2- 172.21.15.81:0/2946510541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b7816a2c0 0x7f8b7815c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:15.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7ea15700 1 --2- 172.21.15.81:0/2946510541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b7816a730 0x7f8b7816d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:15.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7e214700 1 -- 172.21.15.81:0/2946510541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b7816a730 msgr2=0x7f8b7816d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:15.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7e214700 1 --2- 172.21.15.81:0/2946510541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b7816a730 0x7f8b7816d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7e214700 1 -- 172.21.15.81:0/2946510541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b7816a2c0 msgr2=0x7f8b7815c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:15.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7e214700 1 --2- 172.21.15.81:0/2946510541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b7816a2c0 0x7f8b7815c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:15.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7e214700 1 -- 172.21.15.81:0/2946510541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b780c9120 con 0x7f8b64004810 2023-10-07T08:44:15.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7da13700 1 --2- 172.21.15.81:0/2946510541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b7816a2c0 0x7f8b7815c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:15.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.932+0000 7f8b7e214700 1 --2- 172.21.15.81:0/2946510541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b64004810 0x7f8b781589c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400af10 tx=0x7f8b7400a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:15.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.933+0000 7f8b6e7fc700 1 -- 172.21.15.81:0/2946510541 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b740133f0 con 0x7f8b64004810 2023-10-07T08:44:15.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.933+0000 7f8b6e7fc700 1 -- 172.21.15.81:0/2946510541 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b74013550 con 0x7f8b64004810 2023-10-07T08:44:15.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.933+0000 7f8b7f216700 1 -- 172.21.15.81:0/2946510541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b780c9400 con 0x7f8b64004810 2023-10-07T08:44:15.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.933+0000 7f8b6e7fc700 1 -- 172.21.15.81:0/2946510541 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74013910 con 0x7f8b64004810 2023-10-07T08:44:15.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.933+0000 7f8b7f216700 1 -- 172.21.15.81:0/2946510541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b78158f00 con 0x7f8b64004810 2023-10-07T08:44:15.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.933+0000 7f8b7f216700 1 -- 172.21.15.81:0/2946510541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b780cc060 con 0x7f8b64004810 2023-10-07T08:44:15.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.934+0000 7f8b6e7fc700 1 -- 172.21.15.81:0/2946510541 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b74013cc0 con 0x7f8b64004810 2023-10-07T08:44:15.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.934+0000 7f8b6e7fc700 1 --2- 172.21.15.81:0/2946510541 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8b5c066f30 0x7f8b5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:15.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.934+0000 7f8b6e7fc700 1 -- 172.21.15.81:0/2946510541 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8b74084fb0 con 0x7f8b64004810 2023-10-07T08:44:15.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.934+0000 7f8b7da13700 1 --2- 172.21.15.81:0/2946510541 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8b5c066f30 0x7f8b5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:15.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.935+0000 7f8b7da13700 1 --2- 172.21.15.81:0/2946510541 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8b5c066f30 0x7f8b5c0693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8b680091e0 tx=0x7f8b6801a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:15.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:15.939+0000 7f8b6e7fc700 1 -- 172.21.15.81:0/2946510541 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b74052570 con 0x7f8b64004810 2023-10-07T08:44:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.122+0000 7f8b7f216700 1 -- 172.21.15.81:0/2946510541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b78069120 con 0x7f8b64004810 2023-10-07T08:44:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.123+0000 7f8b6e7fc700 1 -- 172.21.15.81:0/2946510541 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12086 (secure 0 0 0) 0x7f8b78069120 con 0x7f8b64004810 2023-10-07T08:44:16.124 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:16.124 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":43,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:44:15.388786+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:44:16.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.125+0000 7f8b7f216700 1 -- 172.21.15.81:0/2946510541 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8b5c066f30 msgr2=0x7f8b5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.125+0000 7f8b7f216700 1 --2- 172.21.15.81:0/2946510541 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8b5c066f30 0x7f8b5c0693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8b680091e0 tx=0x7f8b6801a000 comp rx=0 tx=0).stop 2023-10-07T08:44:16.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.125+0000 7f8b7f216700 1 -- 172.21.15.81:0/2946510541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b64004810 msgr2=0x7f8b781589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.125+0000 7f8b7f216700 1 --2- 172.21.15.81:0/2946510541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b64004810 0x7f8b781589c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400af10 tx=0x7f8b7400a170 comp rx=0 tx=0).stop 2023-10-07T08:44:16.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.125+0000 7f8b7f216700 1 -- 172.21.15.81:0/2946510541 shutdown_connections 2023-10-07T08:44:16.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.125+0000 7f8b7f216700 1 --2- 172.21.15.81:0/2946510541 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8b5c066f30 0x7f8b5c0693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.125+0000 7f8b7f216700 1 --2- 172.21.15.81:0/2946510541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b7816a730 0x7f8b7816d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.125+0000 7f8b7f216700 1 --2- 172.21.15.81:0/2946510541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b64004810 0x7f8b781589c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.125+0000 7f8b7f216700 1 --2- 172.21.15.81:0/2946510541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b7816a2c0 0x7f8b7815c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.125+0000 7f8b7f216700 1 -- 172.21.15.81:0/2946510541 >> 172.21.15.81:0/2946510541 conn(0x7f8b780cd660 msgr2=0x7f8b7806f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:16.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.125+0000 7f8b7f216700 1 -- 172.21.15.81:0/2946510541 shutdown_connections 2023-10-07T08:44:16.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.125+0000 7f8b7f216700 1 -- 172.21.15.81:0/2946510541 wait complete. 2023-10-07T08:44:16.138 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T08:44:16.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:44:16.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.255+0000 7f2909efd700 1 Processor -- start 2023-10-07T08:44:16.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.255+0000 7f2909efd700 1 -- start start 2023-10-07T08:44:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.256+0000 7f2909efd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2904160750 0x7f2904162b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.256+0000 7f2909efd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29040cadb0 con 0x7f29040b43c0 2023-10-07T08:44:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.256+0000 7f2909efd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29040cd3d0 con 0x7f29040cddd0 2023-10-07T08:44:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.256+0000 7f2909efd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29040cc250 con 0x7f2904160750 2023-10-07T08:44:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.256+0000 7f29096fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2904160750 0x7f2904162b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.256+0000 7f2908efb700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f29040b43c0 0x7f29040cc5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33046/0 (socket says 172.21.15.81:33046) 2023-10-07T08:44:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.256+0000 7f2908efb700 1 -- 172.21.15.81:0/3799908347 learned_addr learned my addr 172.21.15.81:0/3799908347 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.256+0000 7f29096fc700 1 -- 172.21.15.81:0/3799908347 >> v1:172.21.15.89:6789/0 conn(0x7f29040cddd0 legacy=0x7f29040cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.256+0000 7f29096fc700 1 -- 172.21.15.81:0/3799908347 >> v1:172.21.15.81:6789/0 conn(0x7f29040b43c0 legacy=0x7f29040cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.256+0000 7f29096fc700 1 -- 172.21.15.81:0/3799908347 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29040cf000 con 0x7f2904160750 2023-10-07T08:44:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.256+0000 7f28fb7fe700 1 -- 172.21.15.81:0/3799908347 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346760246 0 0) 0x7f29040cadb0 con 0x7f29040b43c0 2023-10-07T08:44:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.257+0000 7f29096fc700 1 --2- 172.21.15.81:0/3799908347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2904160750 0x7f2904162b30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0098e0 tx=0x7f28fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84133c71057f9eaf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.257+0000 7f28fb7fe700 1 -- 172.21.15.81:0/3799908347 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc009e80 con 0x7f2904160750 2023-10-07T08:44:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.257+0000 7f28fb7fe700 1 -- 172.21.15.81:0/3799908347 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28fc00b820 con 0x7f2904160750 2023-10-07T08:44:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.257+0000 7f28fb7fe700 1 -- 172.21.15.81:0/3799908347 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc00bba0 con 0x7f2904160750 2023-10-07T08:44:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.257+0000 7f2909efd700 1 -- 172.21.15.81:0/3799908347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2904160750 msgr2=0x7f2904162b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.257+0000 7f2909efd700 1 --2- 172.21.15.81:0/3799908347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2904160750 0x7f2904162b30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0098e0 tx=0x7f28fc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.257+0000 7f2909efd700 1 -- 172.21.15.81:0/3799908347 shutdown_connections 2023-10-07T08:44:16.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.257+0000 7f2909efd700 1 --2- 172.21.15.81:0/3799908347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2904160750 0x7f2904162b30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.257+0000 7f2909efd700 1 -- 172.21.15.81:0/3799908347 >> 172.21.15.81:0/3799908347 conn(0x7f2904068110 msgr2=0x7f290406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:16.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.257+0000 7f2909efd700 1 -- 172.21.15.81:0/3799908347 shutdown_connections 2023-10-07T08:44:16.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.257+0000 7f2909efd700 1 -- 172.21.15.81:0/3799908347 wait complete. 2023-10-07T08:44:16.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.258+0000 7f2909efd700 1 Processor -- start 2023-10-07T08:44:16.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.259+0000 7f2909efd700 1 -- start start 2023-10-07T08:44:16.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.259+0000 7f2909efd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29040b43c0 0x7f2904168450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:16.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.259+0000 7f2909efd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29040cddd0 0x7f2904152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:16.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.259+0000 7f2909efd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2904160750 0x7f29040c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:16.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.259+0000 7f2909efd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2904169360 con 0x7f29040b43c0 2023-10-07T08:44:16.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.259+0000 7f2909efd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2904159510 con 0x7f29040cddd0 2023-10-07T08:44:16.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.259+0000 7f2909efd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2904168ac0 con 0x7f2904160750 2023-10-07T08:44:16.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.259+0000 7f2908efb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29040b43c0 0x7f2904168450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:16.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.259+0000 7f2908efb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29040b43c0 0x7f2904168450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39894/0 (socket says 172.21.15.81:39894) 2023-10-07T08:44:16.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.259+0000 7f2908efb700 1 -- 172.21.15.81:0/671945898 learned_addr learned my addr 172.21.15.81:0/671945898 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:16.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.260+0000 7f2908efb700 1 -- 172.21.15.81:0/671945898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2904160750 msgr2=0x7f29040c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.260+0000 7f2908efb700 1 --2- 172.21.15.81:0/671945898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2904160750 0x7f29040c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.260+0000 7f2908efb700 1 -- 172.21.15.81:0/671945898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29040cddd0 msgr2=0x7f2904152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.260+0000 7f2908efb700 1 --2- 172.21.15.81:0/671945898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29040cddd0 0x7f2904152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.260+0000 7f2908efb700 1 -- 172.21.15.81:0/671945898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc009420 con 0x7f29040b43c0 2023-10-07T08:44:16.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.260+0000 7f2908efb700 1 --2- 172.21.15.81:0/671945898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29040b43c0 0x7f2904168450 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f290000cd80 tx=0x7f2900001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:16.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.260+0000 7f28f8ff9700 1 -- 172.21.15.81:0/671945898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290000ab10 con 0x7f29040b43c0 2023-10-07T08:44:16.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.260+0000 7f28f8ff9700 1 -- 172.21.15.81:0/671945898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290000ac70 con 0x7f29040b43c0 2023-10-07T08:44:16.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.260+0000 7f2909efd700 1 -- 172.21.15.81:0/671945898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2904168da0 con 0x7f29040b43c0 2023-10-07T08:44:16.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.260+0000 7f28f8ff9700 1 -- 172.21.15.81:0/671945898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29000070f0 con 0x7f29040b43c0 2023-10-07T08:44:16.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.260+0000 7f2909efd700 1 -- 172.21.15.81:0/671945898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29040c8970 con 0x7f29040b43c0 2023-10-07T08:44:16.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.261+0000 7f2909efd700 1 -- 172.21.15.81:0/671945898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2904069c00 con 0x7f29040b43c0 2023-10-07T08:44:16.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.261+0000 7f28f8ff9700 1 -- 172.21.15.81:0/671945898 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29000074e0 con 0x7f29040b43c0 2023-10-07T08:44:16.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.262+0000 7f28f8ff9700 1 --2- 172.21.15.81:0/671945898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f28f0066f30 0x7f28f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:16.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.262+0000 7f28f8ff9700 1 -- 172.21.15.81:0/671945898 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2900084700 con 0x7f29040b43c0 2023-10-07T08:44:16.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.262+0000 7f28fbfff700 1 --2- 172.21.15.81:0/671945898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f28f0066f30 0x7f28f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:16.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.262+0000 7f28fbfff700 1 --2- 172.21.15.81:0/671945898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f28f0066f30 0x7f28f00693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f28f4007fd0 tx=0x7f28f4007b20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:16.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.266+0000 7f28f8ff9700 1 -- 172.21.15.81:0/671945898 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29000557d0 con 0x7f29040b43c0 2023-10-07T08:44:16.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.449+0000 7f2909efd700 1 -- 172.21.15.81:0/671945898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2904071b10 con 0x7f29040b43c0 2023-10-07T08:44:16.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.449+0000 7f28f8ff9700 1 -- 172.21.15.81:0/671945898 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2900055360 con 0x7f29040b43c0 2023-10-07T08:44:16.450 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:44:16.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.451+0000 7f2909efd700 1 -- 172.21.15.81:0/671945898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f28f0066f30 msgr2=0x7f28f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.451+0000 7f2909efd700 1 --2- 172.21.15.81:0/671945898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f28f0066f30 0x7f28f00693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f28f4007fd0 tx=0x7f28f4007b20 comp rx=0 tx=0).stop 2023-10-07T08:44:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.451+0000 7f2909efd700 1 -- 172.21.15.81:0/671945898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29040b43c0 msgr2=0x7f2904168450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.451+0000 7f2909efd700 1 --2- 172.21.15.81:0/671945898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29040b43c0 0x7f2904168450 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f290000cd80 tx=0x7f2900001ae0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.451+0000 7f2909efd700 1 -- 172.21.15.81:0/671945898 shutdown_connections 2023-10-07T08:44:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.451+0000 7f2909efd700 1 --2- 172.21.15.81:0/671945898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f28f0066f30 0x7f28f00693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.451+0000 7f2909efd700 1 --2- 172.21.15.81:0/671945898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2904160750 0x7f29040c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.451+0000 7f2909efd700 1 --2- 172.21.15.81:0/671945898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29040b43c0 0x7f2904168450 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.451+0000 7f2909efd700 1 --2- 172.21.15.81:0/671945898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29040cddd0 0x7f2904152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.451+0000 7f2909efd700 1 -- 172.21.15.81:0/671945898 >> 172.21.15.81:0/671945898 conn(0x7f2904068110 msgr2=0x7f290406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.451+0000 7f2909efd700 1 -- 172.21.15.81:0/671945898 shutdown_connections 2023-10-07T08:44:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.451+0000 7f2909efd700 1 -- 172.21.15.81:0/671945898 wait complete. 2023-10-07T08:44:16.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T08:44:16.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.577+0000 7fc4a5106700 1 Processor -- start 2023-10-07T08:44:16.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.577+0000 7fc4a5106700 1 -- start start 2023-10-07T08:44:16.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.578+0000 7fc4a5106700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4a0157fe0 0x7fc4a00b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:16.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.578+0000 7fc4a5106700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a01583b0 0x7fc4a00b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:16.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.578+0000 7fc4a5106700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a00b2890 con 0x7fc4a00ceb30 2023-10-07T08:44:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.578+0000 7fc4a5106700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a00b4070 con 0x7fc4a0157fe0 2023-10-07T08:44:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.578+0000 7fc4a5106700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a00b4350 con 0x7fc4a01583b0 2023-10-07T08:44:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.578+0000 7fc49ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4a0157fe0 0x7fc4a00b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.578+0000 7fc49f59e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc4a00ceb30 0x7fc4a00cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33058/0 (socket says 172.21.15.81:33058) 2023-10-07T08:44:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.578+0000 7fc49f59e700 1 -- 172.21.15.81:0/3672533710 learned_addr learned my addr 172.21.15.81:0/3672533710 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.579+0000 7fc49e59c700 1 --2- 172.21.15.81:0/3672533710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a01583b0 0x7fc4a00b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.579+0000 7fc49dd9b700 1 -- 172.21.15.81:0/3672533710 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185574004 0 0) 0x7fc4a00b2890 con 0x7fc4a00ceb30 2023-10-07T08:44:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.579+0000 7fc49dd9b700 1 -- 172.21.15.81:0/3672533710 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc488003570 con 0x7fc4a00ceb30 2023-10-07T08:44:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.579+0000 7fc49ed9d700 1 -- 172.21.15.81:0/3672533710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a01583b0 msgr2=0x7fc4a00b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:16.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.579+0000 7fc49ed9d700 1 --2- 172.21.15.81:0/3672533710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a01583b0 0x7fc4a00b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.579+0000 7fc49ed9d700 1 -- 172.21.15.81:0/3672533710 >> v1:172.21.15.81:6789/0 conn(0x7fc4a00ceb30 legacy=0x7fc4a00cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.579+0000 7fc49ed9d700 1 -- 172.21.15.81:0/3672533710 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a00b4630 con 0x7fc4a0157fe0 2023-10-07T08:44:16.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.579+0000 7fc49e59c700 1 --2- 172.21.15.81:0/3672533710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a01583b0 0x7fc4a00b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:16.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.579+0000 7fc49ed9d700 1 --2- 172.21.15.81:0/3672533710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a0157fe0 0x7fc4a00b34c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc490009e60 tx=0x7fc490009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a9dbb89a8c566f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:16.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.579+0000 7fc49dd9b700 1 -- 172.21.15.81:0/3672533710 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49000e070 con 0x7fc4a0157fe0 2023-10-07T08:44:16.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.579+0000 7fc49dd9b700 1 -- 172.21.15.81:0/3672533710 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49000bb60 con 0x7fc4a0157fe0 2023-10-07T08:44:16.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.579+0000 7fc49dd9b700 1 -- 172.21.15.81:0/3672533710 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc490012430 con 0x7fc4a0157fe0 2023-10-07T08:44:16.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.580+0000 7fc4a5106700 1 -- 172.21.15.81:0/3672533710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a0157fe0 msgr2=0x7fc4a00b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.580+0000 7fc4a5106700 1 --2- 172.21.15.81:0/3672533710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a0157fe0 0x7fc4a00b34c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc490009e60 tx=0x7fc490009780 comp rx=0 tx=0).stop 2023-10-07T08:44:16.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.580+0000 7fc4a5106700 1 -- 172.21.15.81:0/3672533710 shutdown_connections 2023-10-07T08:44:16.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.580+0000 7fc4a5106700 1 --2- 172.21.15.81:0/3672533710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a0157fe0 0x7fc4a00b34c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.580+0000 7fc4a5106700 1 --2- 172.21.15.81:0/3672533710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a01583b0 0x7fc4a00b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.580+0000 7fc4a5106700 1 -- 172.21.15.81:0/3672533710 >> 172.21.15.81:0/3672533710 conn(0x7fc4a0067640 msgr2=0x7fc4a0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:16.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.580+0000 7fc4a5106700 1 -- 172.21.15.81:0/3672533710 shutdown_connections 2023-10-07T08:44:16.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.580+0000 7fc4a5106700 1 -- 172.21.15.81:0/3672533710 wait complete. 2023-10-07T08:44:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.581+0000 7fc4a5106700 1 Processor -- start 2023-10-07T08:44:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.581+0000 7fc4a5106700 1 -- start start 2023-10-07T08:44:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc4a5106700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a00ceb30 0x7fc4a013d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc4a5106700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4a0157fe0 0x7fc4a015cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc4a5106700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a01583b0 0x7fc4a015d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc4a5106700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a013d8a0 con 0x7fc4a00ceb30 2023-10-07T08:44:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc4a5106700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a01595d0 con 0x7fc4a0157fe0 2023-10-07T08:44:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc4a5106700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a015a180 con 0x7fc4a01583b0 2023-10-07T08:44:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc49ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a00ceb30 0x7fc4a013d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc49ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a00ceb30 0x7fc4a013d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39918/0 (socket says 172.21.15.81:39918) 2023-10-07T08:44:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc49ed9d700 1 -- 172.21.15.81:0/4090982505 learned_addr learned my addr 172.21.15.81:0/4090982505 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc49ed9d700 1 -- 172.21.15.81:0/4090982505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a01583b0 msgr2=0x7fc4a015d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc49f59e700 1 --2- 172.21.15.81:0/4090982505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a01583b0 0x7fc4a015d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc49e59c700 1 --2- 172.21.15.81:0/4090982505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4a0157fe0 0x7fc4a015cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc49ed9d700 1 --2- 172.21.15.81:0/4090982505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a01583b0 0x7fc4a015d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc49ed9d700 1 -- 172.21.15.81:0/4090982505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4a0157fe0 msgr2=0x7fc4a015cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc49ed9d700 1 --2- 172.21.15.81:0/4090982505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4a0157fe0 0x7fc4a015cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc49ed9d700 1 -- 172.21.15.81:0/4090982505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc490009a20 con 0x7fc4a00ceb30 2023-10-07T08:44:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc49f59e700 1 --2- 172.21.15.81:0/4090982505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a01583b0 0x7fc4a015d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc49e59c700 1 --2- 172.21.15.81:0/4090982505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4a0157fe0 0x7fc4a015cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc49ed9d700 1 --2- 172.21.15.81:0/4090982505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a00ceb30 0x7fc4a013d360 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc4900098d0 tx=0x7fc490019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc486ffd700 1 -- 172.21.15.81:0/4090982505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc490012ab0 con 0x7fc4a00ceb30 2023-10-07T08:44:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc486ffd700 1 -- 172.21.15.81:0/4090982505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc490021070 con 0x7fc4a00ceb30 2023-10-07T08:44:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc4a5106700 1 -- 172.21.15.81:0/4090982505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a0151170 con 0x7fc4a00ceb30 2023-10-07T08:44:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc486ffd700 1 -- 172.21.15.81:0/4090982505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc490012ea0 con 0x7fc4a00ceb30 2023-10-07T08:44:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.582+0000 7fc4a5106700 1 -- 172.21.15.81:0/4090982505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a0159e10 con 0x7fc4a00ceb30 2023-10-07T08:44:16.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.583+0000 7fc4a5106700 1 -- 172.21.15.81:0/4090982505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a0069e40 con 0x7fc4a00ceb30 2023-10-07T08:44:16.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.584+0000 7fc486ffd700 1 -- 172.21.15.81:0/4090982505 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc490023030 con 0x7fc4a00ceb30 2023-10-07T08:44:16.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.584+0000 7fc486ffd700 1 --2- 172.21.15.81:0/4090982505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc48c066f30 0x7fc48c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:16.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.584+0000 7fc486ffd700 1 -- 172.21.15.81:0/4090982505 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc4900860c0 con 0x7fc4a00ceb30 2023-10-07T08:44:16.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.584+0000 7fc49e59c700 1 --2- 172.21.15.81:0/4090982505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc48c066f30 0x7fc48c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:16.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.584+0000 7fc49e59c700 1 --2- 172.21.15.81:0/4090982505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc48c066f30 0x7fc48c0693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc494006f00 tx=0x7fc494008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:16.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.588+0000 7fc486ffd700 1 -- 172.21.15.81:0/4090982505 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc490053680 con 0x7fc4a00ceb30 2023-10-07T08:44:16.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.772+0000 7fc4a5106700 1 -- 172.21.15.81:0/4090982505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc4a004bb80 con 0x7fc4a00ceb30 2023-10-07T08:44:16.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.772+0000 7fc486ffd700 1 -- 172.21.15.81:0/4090982505 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc490056ca0 con 0x7fc4a00ceb30 2023-10-07T08:44:16.772 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:16.773 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-07T08:44:16.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:16.773 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-07T08:44:16.773 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-07T08:44:16.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:16.773 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-07T08:44:16.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.774+0000 7fc4a5106700 1 -- 172.21.15.81:0/4090982505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc48c066f30 msgr2=0x7fc48c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.774+0000 7fc4a5106700 1 --2- 172.21.15.81:0/4090982505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc48c066f30 0x7fc48c0693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc494006f00 tx=0x7fc494008040 comp rx=0 tx=0).stop 2023-10-07T08:44:16.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.774+0000 7fc4a5106700 1 -- 172.21.15.81:0/4090982505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a00ceb30 msgr2=0x7fc4a013d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.774+0000 7fc4a5106700 1 --2- 172.21.15.81:0/4090982505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a00ceb30 0x7fc4a013d360 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc4900098d0 tx=0x7fc490019000 comp rx=0 tx=0).stop 2023-10-07T08:44:16.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.774+0000 7fc4a5106700 1 -- 172.21.15.81:0/4090982505 shutdown_connections 2023-10-07T08:44:16.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.774+0000 7fc4a5106700 1 --2- 172.21.15.81:0/4090982505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc48c066f30 0x7fc48c0693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.774+0000 7fc4a5106700 1 --2- 172.21.15.81:0/4090982505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a01583b0 0x7fc4a015d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.774+0000 7fc4a5106700 1 --2- 172.21.15.81:0/4090982505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a00ceb30 0x7fc4a013d360 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.774+0000 7fc4a5106700 1 --2- 172.21.15.81:0/4090982505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4a0157fe0 0x7fc4a015cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.774+0000 7fc4a5106700 1 -- 172.21.15.81:0/4090982505 >> 172.21.15.81:0/4090982505 conn(0x7fc4a0067640 msgr2=0x7fc4a00cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:16.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.774+0000 7fc4a5106700 1 -- 172.21.15.81:0/4090982505 shutdown_connections 2023-10-07T08:44:16.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.774+0000 7fc4a5106700 1 -- 172.21.15.81:0/4090982505 wait complete. 2023-10-07T08:44:16.786 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T08:44:16.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T08:44:16.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.904+0000 7f9b871e5700 1 Processor -- start 2023-10-07T08:44:16.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.904+0000 7f9b871e5700 1 -- start start 2023-10-07T08:44:16.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.905+0000 7f9b871e5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9b80157ca0 0x7f9b800cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:16.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.905+0000 7f9b871e5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b800d07c0 con 0x7f9b8006d120 2023-10-07T08:44:16.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.905+0000 7f9b871e5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b800cfbb0 con 0x7f9b801578d0 2023-10-07T08:44:16.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.905+0000 7f9b871e5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b800cfe90 con 0x7f9b80157ca0 2023-10-07T08:44:16.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.905+0000 7f9b7ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9b80157ca0 0x7f9b800cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:16.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.905+0000 7f9b85782700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9b8006d120 0x7f9b8006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33062/0 (socket says 172.21.15.81:33062) 2023-10-07T08:44:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.905+0000 7f9b85782700 1 -- 172.21.15.81:0/1252983360 learned_addr learned my addr 172.21.15.81:0/1252983360 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.905+0000 7f9b7ffff700 1 -- 172.21.15.81:0/1252983360 >> v1:172.21.15.89:6789/0 conn(0x7f9b801578d0 legacy=0x7f9b8015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.905+0000 7f9b7ffff700 1 -- 172.21.15.81:0/1252983360 >> v1:172.21.15.81:6789/0 conn(0x7f9b8006d120 legacy=0x7f9b8006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.905+0000 7f9b7f7fe700 1 -- 172.21.15.81:0/1252983360 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069795297 0 0) 0x7f9b800d07c0 con 0x7f9b8006d120 2023-10-07T08:44:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.905+0000 7f9b7ffff700 1 -- 172.21.15.81:0/1252983360 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b800d0170 con 0x7f9b80157ca0 2023-10-07T08:44:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.905+0000 7f9b7ffff700 1 --2- 172.21.15.81:0/1252983360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80157ca0 0x7f9b800cf4f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c0098e0 tx=0x7f9b6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3a2b1318df40f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.906+0000 7f9b7f7fe700 1 -- 172.21.15.81:0/1252983360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c009e80 con 0x7f9b80157ca0 2023-10-07T08:44:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.906+0000 7f9b7f7fe700 1 -- 172.21.15.81:0/1252983360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c00b860 con 0x7f9b80157ca0 2023-10-07T08:44:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.906+0000 7f9b7f7fe700 1 -- 172.21.15.81:0/1252983360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c00bbe0 con 0x7f9b80157ca0 2023-10-07T08:44:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.906+0000 7f9b871e5700 1 -- 172.21.15.81:0/1252983360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80157ca0 msgr2=0x7f9b800cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.906+0000 7f9b871e5700 1 --2- 172.21.15.81:0/1252983360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80157ca0 0x7f9b800cf4f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c0098e0 tx=0x7f9b6c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.906+0000 7f9b871e5700 1 -- 172.21.15.81:0/1252983360 shutdown_connections 2023-10-07T08:44:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.906+0000 7f9b871e5700 1 --2- 172.21.15.81:0/1252983360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80157ca0 0x7f9b800cf4f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.906+0000 7f9b871e5700 1 -- 172.21.15.81:0/1252983360 >> 172.21.15.81:0/1252983360 conn(0x7f9b8006bb90 msgr2=0x7f9b8006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.906+0000 7f9b871e5700 1 -- 172.21.15.81:0/1252983360 shutdown_connections 2023-10-07T08:44:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.906+0000 7f9b871e5700 1 -- 172.21.15.81:0/1252983360 wait complete. 2023-10-07T08:44:16.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.907+0000 7f9b871e5700 1 Processor -- start 2023-10-07T08:44:16.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.907+0000 7f9b871e5700 1 -- start start 2023-10-07T08:44:16.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.908+0000 7f9b871e5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8006d120 0x7f9b8016e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:16.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.908+0000 7f9b871e5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b801578d0 0x7f9b800b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:16.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.908+0000 7f9b871e5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b80157ca0 0x7f9b800c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:16.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.908+0000 7f9b871e5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8016bca0 con 0x7f9b8006d120 2023-10-07T08:44:16.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.908+0000 7f9b871e5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800b5ef0 con 0x7f9b801578d0 2023-10-07T08:44:16.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.908+0000 7f9b871e5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800b61d0 con 0x7f9b80157ca0 2023-10-07T08:44:16.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.908+0000 7f9b84f81700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8006d120 0x7f9b8016e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:16.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.908+0000 7f9b84f81700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8006d120 0x7f9b8016e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39938/0 (socket says 172.21.15.81:39938) 2023-10-07T08:44:16.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.908+0000 7f9b84f81700 1 -- 172.21.15.81:0/1368736097 learned_addr learned my addr 172.21.15.81:0/1368736097 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:16.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.908+0000 7f9b7ffff700 1 --2- 172.21.15.81:0/1368736097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b801578d0 0x7f9b800b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:16.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.908+0000 7f9b85782700 1 --2- 172.21.15.81:0/1368736097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b80157ca0 0x7f9b800c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:16.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.909+0000 7f9b84f81700 1 -- 172.21.15.81:0/1368736097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b80157ca0 msgr2=0x7f9b800c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.909+0000 7f9b84f81700 1 --2- 172.21.15.81:0/1368736097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b80157ca0 0x7f9b800c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.909+0000 7f9b84f81700 1 -- 172.21.15.81:0/1368736097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b801578d0 msgr2=0x7f9b800b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:16.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.909+0000 7f9b84f81700 1 --2- 172.21.15.81:0/1368736097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b801578d0 0x7f9b800b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:16.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.909+0000 7f9b84f81700 1 -- 172.21.15.81:0/1368736097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c009420 con 0x7f9b8006d120 2023-10-07T08:44:16.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.909+0000 7f9b85782700 1 --2- 172.21.15.81:0/1368736097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b80157ca0 0x7f9b800c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:16.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.909+0000 7f9b84f81700 1 --2- 172.21.15.81:0/1368736097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8006d120 0x7f9b8016e0f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400c590 tx=0x7f9b7400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:16.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.909+0000 7f9b7cff9700 1 -- 172.21.15.81:0/1368736097 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74011590 con 0x7f9b8006d120 2023-10-07T08:44:16.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.909+0000 7f9b7cff9700 1 -- 172.21.15.81:0/1368736097 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b74011710 con 0x7f9b8006d120 2023-10-07T08:44:16.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.909+0000 7f9b871e5700 1 -- 172.21.15.81:0/1368736097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b800b64b0 con 0x7f9b8006d120 2023-10-07T08:44:16.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.909+0000 7f9b7cff9700 1 -- 172.21.15.81:0/1368736097 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74011ad0 con 0x7f9b8006d120 2023-10-07T08:44:16.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.909+0000 7f9b871e5700 1 -- 172.21.15.81:0/1368736097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b800b5a70 con 0x7f9b8006d120 2023-10-07T08:44:16.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.910+0000 7f9b871e5700 1 -- 172.21.15.81:0/1368736097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b800b5cc0 con 0x7f9b8006d120 2023-10-07T08:44:16.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.910+0000 7f9b7cff9700 1 -- 172.21.15.81:0/1368736097 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b7401b3b0 con 0x7f9b8006d120 2023-10-07T08:44:16.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.911+0000 7f9b7cff9700 1 --2- 172.21.15.81:0/1368736097 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b64066f00 0x7f9b640693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:16.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.911+0000 7f9b7cff9700 1 -- 172.21.15.81:0/1368736097 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9b74083720 con 0x7f9b8006d120 2023-10-07T08:44:16.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.911+0000 7f9b7ffff700 1 --2- 172.21.15.81:0/1368736097 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b64066f00 0x7f9b640693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:16.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.911+0000 7f9b7ffff700 1 --2- 172.21.15.81:0/1368736097 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b64066f00 0x7f9b640693b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9b801580c0 tx=0x7f9b6c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:16.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:16.915+0000 7f9b7cff9700 1 -- 172.21.15.81:0/1368736097 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b74050ce0 con 0x7f9b8006d120 2023-10-07T08:44:17.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.096+0000 7f9b871e5700 1 -- 172.21.15.81:0/1368736097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9b800684b0 con 0x7f9b8006d120 2023-10-07T08:44:17.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.415+0000 7f9b7cff9700 1 -- 172.21.15.81:0/1368736097 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v44) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9b74017020 con 0x7f9b8006d120 2023-10-07T08:44:17.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.418+0000 7f9b871e5700 1 -- 172.21.15.81:0/1368736097 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b64066f00 msgr2=0x7f9b640693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:17.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.418+0000 7f9b871e5700 1 --2- 172.21.15.81:0/1368736097 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b64066f00 0x7f9b640693b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9b801580c0 tx=0x7f9b6c017000 comp rx=0 tx=0).stop 2023-10-07T08:44:17.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.418+0000 7f9b871e5700 1 -- 172.21.15.81:0/1368736097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8006d120 msgr2=0x7f9b8016e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:17.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.418+0000 7f9b871e5700 1 --2- 172.21.15.81:0/1368736097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8006d120 0x7f9b8016e0f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400c590 tx=0x7f9b7400c8a0 comp rx=0 tx=0).stop 2023-10-07T08:44:17.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.419+0000 7f9b871e5700 1 -- 172.21.15.81:0/1368736097 shutdown_connections 2023-10-07T08:44:17.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.419+0000 7f9b871e5700 1 --2- 172.21.15.81:0/1368736097 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b64066f00 0x7f9b640693b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:17.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.419+0000 7f9b871e5700 1 --2- 172.21.15.81:0/1368736097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b80157ca0 0x7f9b800c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:17.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.419+0000 7f9b871e5700 1 --2- 172.21.15.81:0/1368736097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8006d120 0x7f9b8016e0f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:17.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.419+0000 7f9b871e5700 1 --2- 172.21.15.81:0/1368736097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b801578d0 0x7f9b800b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:17.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.419+0000 7f9b871e5700 1 -- 172.21.15.81:0/1368736097 >> 172.21.15.81:0/1368736097 conn(0x7f9b8006bb90 msgr2=0x7f9b801567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:17.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.419+0000 7f9b871e5700 1 -- 172.21.15.81:0/1368736097 shutdown_connections 2023-10-07T08:44:17.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.419+0000 7f9b871e5700 1 -- 172.21.15.81:0/1368736097 wait complete. 2023-10-07T08:44:17.420 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-07T08:44:17.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T08:44:17.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.552+0000 7fc1a359e700 1 Processor -- start 2023-10-07T08:44:17.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.552+0000 7fc1a359e700 1 -- start start 2023-10-07T08:44:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1a40adb30 0x7fc1a415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a359e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc1a406af30 0x7fc1a406b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a406aaa0 con 0x7fc1a4158000 2023-10-07T08:44:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a359e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a415c500 con 0x7fc1a406af30 2023-10-07T08:44:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a4158770 con 0x7fc1a40adb30 2023-10-07T08:44:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a1d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc1a4158000 0x7fc1a40b1780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33066/0 (socket says 172.21.15.81:33066) 2023-10-07T08:44:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a1d9b700 1 -- 172.21.15.81:0/1668392595 learned_addr learned my addr 172.21.15.81:0/1668392595 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a159a700 1 -- 172.21.15.81:0/1668392595 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735677805 0 0) 0x7fc1a406aaa0 con 0x7fc1a4158000 2023-10-07T08:44:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a259c700 1 --2- 172.21.15.81:0/1668392595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1a40adb30 0x7fc1a415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a159a700 1 -- 172.21.15.81:0/1668392595 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc18c003570 con 0x7fc1a4158000 2023-10-07T08:44:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a2d9d700 1 --2- 172.21.15.81:0/1668392595 >> v2:172.21.15.89:3300/0 conn(0x7fc1a406af30 0x7fc1a406b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a159a700 1 -- 172.21.15.81:0/1668392595 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 447434748 0 0) 0x7fc18c003570 con 0x7fc1a4158000 2023-10-07T08:44:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a159a700 1 -- 172.21.15.81:0/1668392595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1a40adb30 msgr2=0x7fc1a415bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a159a700 1 --2- 172.21.15.81:0/1668392595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1a40adb30 0x7fc1a415bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a159a700 1 -- 172.21.15.81:0/1668392595 >> v2:172.21.15.89:3300/0 conn(0x7fc1a406af30 msgr2=0x7fc1a406b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a159a700 1 --2- 172.21.15.81:0/1668392595 >> v2:172.21.15.89:3300/0 conn(0x7fc1a406af30 0x7fc1a406b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a159a700 1 -- 172.21.15.81:0/1668392595 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a4158a50 con 0x7fc1a4158000 2023-10-07T08:44:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a159a700 1 -- 172.21.15.81:0/1668392595 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fc198001470 con 0x7fc1a4158000 2023-10-07T08:44:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a259c700 1 --2- 172.21.15.81:0/1668392595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1a40adb30 0x7fc1a415bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a159a700 1 -- 172.21.15.81:0/1668392595 >> v1:172.21.15.81:6789/0 conn(0x7fc1a4158000 legacy=0x7fc1a40b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a159a700 1 --2- 172.21.15.81:0/1668392595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc18c003a60 0x7fc18c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a159a700 1 --2- 172.21.15.81:0/1668392595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1a40adb30 0x7fc18c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a159a700 1 --2- 172.21.15.81:0/1668392595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc18c004d50 0x7fc18c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a159a700 1 -- 172.21.15.81:0/1668392595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a415c500 con 0x7fc18c003a60 2023-10-07T08:44:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a159a700 1 -- 172.21.15.81:0/1668392595 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a4158770 con 0x7fc18c004d50 2023-10-07T08:44:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a159a700 1 -- 172.21.15.81:0/1668392595 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c00bab0 con 0x7fc1a40adb30 2023-10-07T08:44:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.553+0000 7fc1a259c700 1 --2- 172.21.15.81:0/1668392595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc18c003a60 0x7fc18c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.554+0000 7fc1a2d9d700 1 --2- 172.21.15.81:0/1668392595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc18c004d50 0x7fc18c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.554+0000 7fc1a1d9b700 1 --2- 172.21.15.81:0/1668392595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1a40adb30 0x7fc18c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.554+0000 7fc1a259c700 1 -- 172.21.15.81:0/1668392595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1a40adb30 msgr2=0x7fc18c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.554+0000 7fc1a259c700 1 --2- 172.21.15.81:0/1668392595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1a40adb30 0x7fc18c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.554+0000 7fc1a259c700 1 -- 172.21.15.81:0/1668392595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc18c004d50 msgr2=0x7fc18c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.554+0000 7fc1a259c700 1 --2- 172.21.15.81:0/1668392595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc18c004d50 0x7fc18c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.554+0000 7fc1a259c700 1 -- 172.21.15.81:0/1668392595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c003570 con 0x7fc18c003a60 2023-10-07T08:44:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.554+0000 7fc1a1d9b700 1 --2- 172.21.15.81:0/1668392595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1a40adb30 0x7fc18c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.554+0000 7fc1a259c700 1 --2- 172.21.15.81:0/1668392595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc18c003a60 0x7fc18c003e70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc194007580 tx=0x7fc1940097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0337d0d67e32265 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.554+0000 7fc1a159a700 1 -- 172.21.15.81:0/1668392595 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194009ae0 con 0x7fc18c003a60 2023-10-07T08:44:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.554+0000 7fc1a159a700 1 -- 172.21.15.81:0/1668392595 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc194007dd0 con 0x7fc18c003a60 2023-10-07T08:44:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.554+0000 7fc1a159a700 1 -- 172.21.15.81:0/1668392595 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194014630 con 0x7fc18c003a60 2023-10-07T08:44:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.554+0000 7fc1a359e700 1 -- 172.21.15.81:0/1668392595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc18c003a60 msgr2=0x7fc18c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.554+0000 7fc1a359e700 1 --2- 172.21.15.81:0/1668392595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc18c003a60 0x7fc18c003e70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc194007580 tx=0x7fc1940097d0 comp rx=0 tx=0).stop 2023-10-07T08:44:17.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.554+0000 7fc1a2d9d700 1 -- 172.21.15.81:0/1668392595 reap_dead start 2023-10-07T08:44:17.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.555+0000 7fc1a359e700 1 -- 172.21.15.81:0/1668392595 shutdown_connections 2023-10-07T08:44:17.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.555+0000 7fc1a359e700 1 -- 172.21.15.81:0/1668392595 >> 172.21.15.81:0/1668392595 conn(0x7fc1a40680b0 msgr2=0x7fc1a406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:17.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.555+0000 7fc1a359e700 1 -- 172.21.15.81:0/1668392595 shutdown_connections 2023-10-07T08:44:17.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.555+0000 7fc1a359e700 1 -- 172.21.15.81:0/1668392595 wait complete. 2023-10-07T08:44:17.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.556+0000 7fc1a359e700 1 Processor -- start 2023-10-07T08:44:17.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.556+0000 7fc1a359e700 1 -- start start 2023-10-07T08:44:17.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.556+0000 7fc1a359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc18c003a60 0x7fc1a40af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:17.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.556+0000 7fc1a359e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1a414d690 0x7fc1a416c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:17.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.556+0000 7fc1a359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a414bbe0 0x7fc1a40cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:17.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.556+0000 7fc1a359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a416c580 con 0x7fc1a414bbe0 2023-10-07T08:44:17.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.556+0000 7fc1a359e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a416b5f0 con 0x7fc1a414d690 2023-10-07T08:44:17.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.556+0000 7fc1a359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a416bbb0 con 0x7fc18c003a60 2023-10-07T08:44:17.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.556+0000 7fc1a2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a414bbe0 0x7fc1a40cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:17.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.556+0000 7fc1a2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a414bbe0 0x7fc1a40cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39964/0 (socket says 172.21.15.81:39964) 2023-10-07T08:44:17.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.556+0000 7fc1a2d9d700 1 -- 172.21.15.81:0/7613533 learned_addr learned my addr 172.21.15.81:0/7613533 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:17.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.557+0000 7fc1a1d9b700 1 --2- 172.21.15.81:0/7613533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1a414d690 0x7fc1a416c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:17.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.557+0000 7fc1a259c700 1 --2- 172.21.15.81:0/7613533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc18c003a60 0x7fc1a40af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:17.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.557+0000 7fc1a2d9d700 1 -- 172.21.15.81:0/7613533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc18c003a60 msgr2=0x7fc1a40af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:17.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.557+0000 7fc1a2d9d700 1 --2- 172.21.15.81:0/7613533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc18c003a60 0x7fc1a40af590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:17.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.557+0000 7fc1a2d9d700 1 -- 172.21.15.81:0/7613533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1a414d690 msgr2=0x7fc1a416c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:17.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.557+0000 7fc1a2d9d700 1 --2- 172.21.15.81:0/7613533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1a414d690 0x7fc1a416c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:17.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.557+0000 7fc1a2d9d700 1 -- 172.21.15.81:0/7613533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a414db00 con 0x7fc1a414bbe0 2023-10-07T08:44:17.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.557+0000 7fc1a1d9b700 1 --2- 172.21.15.81:0/7613533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1a414d690 0x7fc1a416c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:17.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.557+0000 7fc1a2d9d700 1 --2- 172.21.15.81:0/7613533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a414bbe0 0x7fc1a40cced0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0118f0 tx=0x7fc19c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:17.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.557+0000 7fc1927fc700 1 -- 172.21.15.81:0/7613533 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00f940 con 0x7fc1a414bbe0 2023-10-07T08:44:17.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.557+0000 7fc1927fc700 1 -- 172.21.15.81:0/7613533 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c00faa0 con 0x7fc1a414bbe0 2023-10-07T08:44:17.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.557+0000 7fc1a359e700 1 -- 172.21.15.81:0/7613533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a414ddc0 con 0x7fc1a414bbe0 2023-10-07T08:44:17.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.557+0000 7fc1927fc700 1 -- 172.21.15.81:0/7613533 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00fe40 con 0x7fc1a414bbe0 2023-10-07T08:44:17.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.557+0000 7fc1a359e700 1 -- 172.21.15.81:0/7613533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a416b840 con 0x7fc1a414bbe0 2023-10-07T08:44:17.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.558+0000 7fc1a359e700 1 -- 172.21.15.81:0/7613533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a416bd40 con 0x7fc1a414bbe0 2023-10-07T08:44:17.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.558+0000 7fc1927fc700 1 -- 172.21.15.81:0/7613533 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc19c014650 con 0x7fc1a414bbe0 2023-10-07T08:44:17.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.559+0000 7fc1927fc700 1 --2- 172.21.15.81:0/7613533 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc184066f30 0x7fc1840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:17.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.559+0000 7fc1927fc700 1 -- 172.21.15.81:0/7613533 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fc19c084820 con 0x7fc1a414bbe0 2023-10-07T08:44:17.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.559+0000 7fc1a259c700 1 --2- 172.21.15.81:0/7613533 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc184066f30 0x7fc1840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:17.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.559+0000 7fc1a259c700 1 --2- 172.21.15.81:0/7613533 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc184066f30 0x7fc1840693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc194007580 tx=0x7fc194018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:17.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.563+0000 7fc1927fc700 1 -- 172.21.15.81:0/7613533 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc19c051cf0 con 0x7fc1a414bbe0 2023-10-07T08:44:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:17.746+0000 7fc1a359e700 1 -- 172.21.15.81:0/7613533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc1a414e2e0 con 0x7fc1a414bbe0 2023-10-07T08:44:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.427+0000 7fc1927fc700 1 -- 172.21.15.81:0/7613533 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v45) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc19c0220d0 con 0x7fc1a414bbe0 2023-10-07T08:44:18.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.431+0000 7fc1a359e700 1 -- 172.21.15.81:0/7613533 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc184066f30 msgr2=0x7fc1840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:18.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.431+0000 7fc1a359e700 1 --2- 172.21.15.81:0/7613533 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc184066f30 0x7fc1840693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc194007580 tx=0x7fc194018000 comp rx=0 tx=0).stop 2023-10-07T08:44:18.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.431+0000 7fc1a359e700 1 -- 172.21.15.81:0/7613533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a414bbe0 msgr2=0x7fc1a40cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:18.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.431+0000 7fc1a359e700 1 --2- 172.21.15.81:0/7613533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a414bbe0 0x7fc1a40cced0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0118f0 tx=0x7fc19c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:18.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.432+0000 7fc1a359e700 1 -- 172.21.15.81:0/7613533 shutdown_connections 2023-10-07T08:44:18.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.432+0000 7fc1a359e700 1 --2- 172.21.15.81:0/7613533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a414bbe0 0x7fc1a40cced0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:18.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.432+0000 7fc1a359e700 1 --2- 172.21.15.81:0/7613533 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc184066f30 0x7fc1840693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:18.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.432+0000 7fc1a359e700 1 --2- 172.21.15.81:0/7613533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc18c003a60 0x7fc1a40af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:18.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.432+0000 7fc1a359e700 1 --2- 172.21.15.81:0/7613533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1a414d690 0x7fc1a416c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:18.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.432+0000 7fc1a359e700 1 -- 172.21.15.81:0/7613533 >> 172.21.15.81:0/7613533 conn(0x7fc1a40680b0 msgr2=0x7fc1a4157340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:18.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.433+0000 7fc1a359e700 1 -- 172.21.15.81:0/7613533 shutdown_connections 2023-10-07T08:44:18.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.433+0000 7fc1a359e700 1 -- 172.21.15.81:0/7613533 wait complete. 2023-10-07T08:44:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-07T08:44:18.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T08:44:18.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.564+0000 7f861a8b9700 1 Processor -- start 2023-10-07T08:44:18.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.564+0000 7f861a8b9700 1 -- start start 2023-10-07T08:44:18.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.565+0000 7f861a8b9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86141578d0 0x7f86140cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:18.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.565+0000 7f861a8b9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8614157ca0 0x7f861415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:18.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.565+0000 7f861a8b9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86140d07c0 con 0x7f861406d120 2023-10-07T08:44:18.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.565+0000 7f861a8b9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86140cfbb0 con 0x7f86141578d0 2023-10-07T08:44:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.565+0000 7f861a8b9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86140cfe90 con 0x7f8614157ca0 2023-10-07T08:44:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.565+0000 7f8613fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86141578d0 0x7f86140cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.565+0000 7f8613fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86141578d0 0x7f86140cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39970/0 (socket says 172.21.15.81:39970) 2023-10-07T08:44:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.565+0000 7f8613fff700 1 -- 172.21.15.81:0/2092341010 learned_addr learned my addr 172.21.15.81:0/2092341010 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.565+0000 7f8613fff700 1 -- 172.21.15.81:0/2092341010 >> v2:172.21.15.89:3300/0 conn(0x7f8614157ca0 msgr2=0x7f861415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.565+0000 7f8613fff700 1 --2- 172.21.15.81:0/2092341010 >> v2:172.21.15.89:3300/0 conn(0x7f8614157ca0 0x7f861415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.565+0000 7f8613fff700 1 -- 172.21.15.81:0/2092341010 >> v1:172.21.15.89:6789/0 conn(0x7f861406d120 legacy=0x7f861406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.565+0000 7f8613fff700 1 -- 172.21.15.81:0/2092341010 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86140d0170 con 0x7f86141578d0 2023-10-07T08:44:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.566+0000 7f8613fff700 1 --2- 172.21.15.81:0/2092341010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86141578d0 0x7f86140cf4f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8614068510 tx=0x7f8604009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbf2af462415d91 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.566+0000 7f8612ffd700 1 -- 172.21.15.81:0/2092341010 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860400b820 con 0x7f86141578d0 2023-10-07T08:44:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.566+0000 7f8612ffd700 1 -- 172.21.15.81:0/2092341010 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860400b980 con 0x7f86141578d0 2023-10-07T08:44:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.566+0000 7f8612ffd700 1 -- 172.21.15.81:0/2092341010 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860400bd20 con 0x7f86141578d0 2023-10-07T08:44:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.566+0000 7f861a8b9700 1 -- 172.21.15.81:0/2092341010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86141578d0 msgr2=0x7f86140cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.566+0000 7f861a8b9700 1 --2- 172.21.15.81:0/2092341010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86141578d0 0x7f86140cf4f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8614068510 tx=0x7f8604009250 comp rx=0 tx=0).stop 2023-10-07T08:44:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.566+0000 7f861a8b9700 1 -- 172.21.15.81:0/2092341010 shutdown_connections 2023-10-07T08:44:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.566+0000 7f861a8b9700 1 --2- 172.21.15.81:0/2092341010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86141578d0 0x7f86140cf4f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.566+0000 7f861a8b9700 1 --2- 172.21.15.81:0/2092341010 >> v2:172.21.15.89:3300/0 conn(0x7f8614157ca0 0x7f861415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.566+0000 7f861a8b9700 1 -- 172.21.15.81:0/2092341010 >> 172.21.15.81:0/2092341010 conn(0x7f861406bb90 msgr2=0x7f861406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.566+0000 7f861a8b9700 1 -- 172.21.15.81:0/2092341010 shutdown_connections 2023-10-07T08:44:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.566+0000 7f861a8b9700 1 -- 172.21.15.81:0/2092341010 wait complete. 2023-10-07T08:44:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.567+0000 7f861a8b9700 1 Processor -- start 2023-10-07T08:44:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.568+0000 7f861a8b9700 1 -- start start 2023-10-07T08:44:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.568+0000 7f861a8b9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f861406d120 0x7f86140cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.568+0000 7f861a8b9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86141578d0 0x7f86140c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.568+0000 7f861a8b9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8614157ca0 0x7f86140c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.568+0000 7f861a8b9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86140c87f0 con 0x7f861406d120 2023-10-07T08:44:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.568+0000 7f861a8b9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86140c7210 con 0x7f8614157ca0 2023-10-07T08:44:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.568+0000 7f861a8b9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86140c74f0 con 0x7f86141578d0 2023-10-07T08:44:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.568+0000 7f8613fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f861406d120 0x7f86140cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.568+0000 7f8613fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f861406d120 0x7f86140cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39974/0 (socket says 172.21.15.81:39974) 2023-10-07T08:44:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.568+0000 7f8613fff700 1 -- 172.21.15.81:0/1484496811 learned_addr learned my addr 172.21.15.81:0/1484496811 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.569+0000 7f86137fe700 1 --2- 172.21.15.81:0/1484496811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86141578d0 0x7f86140c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.569+0000 7f8618e56700 1 --2- 172.21.15.81:0/1484496811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8614157ca0 0x7f86140c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.569+0000 7f8613fff700 1 -- 172.21.15.81:0/1484496811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86141578d0 msgr2=0x7f86140c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.569+0000 7f8613fff700 1 --2- 172.21.15.81:0/1484496811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86141578d0 0x7f86140c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.569+0000 7f8613fff700 1 -- 172.21.15.81:0/1484496811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8614157ca0 msgr2=0x7f86140c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.569+0000 7f8613fff700 1 --2- 172.21.15.81:0/1484496811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8614157ca0 0x7f86140c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.569+0000 7f8613fff700 1 -- 172.21.15.81:0/1484496811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86040094f0 con 0x7f861406d120 2023-10-07T08:44:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.569+0000 7f8618e56700 1 --2- 172.21.15.81:0/1484496811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8614157ca0 0x7f86140c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.569+0000 7f8613fff700 1 --2- 172.21.15.81:0/1484496811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f861406d120 0x7f86140cd100 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8604003080 tx=0x7f8604016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.569+0000 7f85fbfff700 1 -- 172.21.15.81:0/1484496811 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604026480 con 0x7f861406d120 2023-10-07T08:44:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.569+0000 7f85fbfff700 1 -- 172.21.15.81:0/1484496811 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860401f070 con 0x7f861406d120 2023-10-07T08:44:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.569+0000 7f861a8b9700 1 -- 172.21.15.81:0/1484496811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86140c77d0 con 0x7f861406d120 2023-10-07T08:44:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.569+0000 7f85fbfff700 1 -- 172.21.15.81:0/1484496811 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604026830 con 0x7f861406d120 2023-10-07T08:44:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.569+0000 7f861a8b9700 1 -- 172.21.15.81:0/1484496811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86140c7d90 con 0x7f861406d120 2023-10-07T08:44:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.570+0000 7f861a8b9700 1 -- 172.21.15.81:0/1484496811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86140c7fb0 con 0x7f861406d120 2023-10-07T08:44:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.570+0000 7f85fbfff700 1 -- 172.21.15.81:0/1484496811 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f860401a440 con 0x7f861406d120 2023-10-07T08:44:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.571+0000 7f85fbfff700 1 --2- 172.21.15.81:0/1484496811 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8600066f30 0x7f86000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.571+0000 7f85fbfff700 1 -- 172.21.15.81:0/1484496811 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f8604021070 con 0x7f861406d120 2023-10-07T08:44:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.571+0000 7f86137fe700 1 --2- 172.21.15.81:0/1484496811 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8600066f30 0x7f86000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.571+0000 7f86137fe700 1 --2- 172.21.15.81:0/1484496811 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8600066f30 0x7f86000693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f861415ce30 tx=0x7f86080090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.575+0000 7f85fbfff700 1 -- 172.21.15.81:0/1484496811 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8604053e10 con 0x7f861406d120 2023-10-07T08:44:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:18.796+0000 7f861a8b9700 1 -- 172.21.15.81:0/1484496811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8614159270 con 0x7f861406d120 2023-10-07T08:44:19.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.426+0000 7f85fbfff700 1 -- 172.21.15.81:0/1484496811 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8604057430 con 0x7f861406d120 2023-10-07T08:44:19.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.433+0000 7f861a8b9700 1 -- 172.21.15.81:0/1484496811 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8600066f30 msgr2=0x7f86000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:19.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.433+0000 7f861a8b9700 1 --2- 172.21.15.81:0/1484496811 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8600066f30 0x7f86000693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f861415ce30 tx=0x7f86080090f0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.433+0000 7f861a8b9700 1 -- 172.21.15.81:0/1484496811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f861406d120 msgr2=0x7f86140cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:19.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.433+0000 7f861a8b9700 1 --2- 172.21.15.81:0/1484496811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f861406d120 0x7f86140cd100 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8604003080 tx=0x7f8604016000 comp rx=0 tx=0).stop 2023-10-07T08:44:19.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.434+0000 7f861a8b9700 1 -- 172.21.15.81:0/1484496811 shutdown_connections 2023-10-07T08:44:19.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.434+0000 7f861a8b9700 1 --2- 172.21.15.81:0/1484496811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8614157ca0 0x7f86140c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.434+0000 7f861a8b9700 1 --2- 172.21.15.81:0/1484496811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f861406d120 0x7f86140cd100 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.434+0000 7f861a8b9700 1 --2- 172.21.15.81:0/1484496811 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8600066f30 0x7f86000693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.434+0000 7f861a8b9700 1 --2- 172.21.15.81:0/1484496811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86141578d0 0x7f86140c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.434+0000 7f861a8b9700 1 -- 172.21.15.81:0/1484496811 >> 172.21.15.81:0/1484496811 conn(0x7f861406bb90 msgr2=0x7f861406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:19.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.435+0000 7f861a8b9700 1 -- 172.21.15.81:0/1484496811 shutdown_connections 2023-10-07T08:44:19.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.435+0000 7f861a8b9700 1 -- 172.21.15.81:0/1484496811 wait complete. 2023-10-07T08:44:19.437 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 6 and data pool 7 2023-10-07T08:44:19.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:44:19.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.569+0000 7f01ca4cf700 1 Processor -- start 2023-10-07T08:44:19.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.569+0000 7f01ca4cf700 1 -- start start 2023-10-07T08:44:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.570+0000 7f01ca4cf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f01c41578d0 0x7f01c40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.570+0000 7f01ca4cf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01c4157ca0 0x7f01c415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.570+0000 7f01ca4cf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01c406d120 0x7f01c406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.570+0000 7f01ca4cf700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c40d07c0 con 0x7f01c4157ca0 2023-10-07T08:44:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.570+0000 7f01ca4cf700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c406daa0 con 0x7f01c41578d0 2023-10-07T08:44:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.570+0000 7f01ca4cf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c40cfbb0 con 0x7f01c406d120 2023-10-07T08:44:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.570+0000 7f01c37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01c4157ca0 0x7f01c415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.570+0000 7f01c37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01c4157ca0 0x7f01c415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39978/0 (socket says 172.21.15.81:39978) 2023-10-07T08:44:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.570+0000 7f01c37fe700 1 -- 172.21.15.81:0/1272427477 learned_addr learned my addr 172.21.15.81:0/1272427477 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.570+0000 7f01c3fff700 1 --2- 172.21.15.81:0/1272427477 >> v2:172.21.15.89:3300/0 conn(0x7f01c41578d0 0x7f01c40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:19.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.570+0000 7f01c8a6c700 1 --2- 172.21.15.81:0/1272427477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01c406d120 0x7f01c406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:19.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.570+0000 7f01c37fe700 1 -- 172.21.15.81:0/1272427477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01c406d120 msgr2=0x7f01c406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:19.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.570+0000 7f01c37fe700 1 --2- 172.21.15.81:0/1272427477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01c406d120 0x7f01c406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.570+0000 7f01c37fe700 1 -- 172.21.15.81:0/1272427477 >> v2:172.21.15.89:3300/0 conn(0x7f01c41578d0 msgr2=0x7f01c40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:19.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.570+0000 7f01c37fe700 1 --2- 172.21.15.81:0/1272427477 >> v2:172.21.15.89:3300/0 conn(0x7f01c41578d0 0x7f01c40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.570+0000 7f01c37fe700 1 -- 172.21.15.81:0/1272427477 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c40cfe90 con 0x7f01c4157ca0 2023-10-07T08:44:19.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.571+0000 7f01c37fe700 1 --2- 172.21.15.81:0/1272427477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c4157ca0 0x7f01c415af00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f01c40646b0 tx=0x7f01b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ccdc73fa0a7d39 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:19.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.571+0000 7f01c2ffd700 1 -- 172.21.15.81:0/1272427477 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b800b640 con 0x7f01c4157ca0 2023-10-07T08:44:19.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.571+0000 7f01c2ffd700 1 -- 172.21.15.81:0/1272427477 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b800b7a0 con 0x7f01c4157ca0 2023-10-07T08:44:19.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.571+0000 7f01c2ffd700 1 -- 172.21.15.81:0/1272427477 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b800bb60 con 0x7f01c4157ca0 2023-10-07T08:44:19.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.571+0000 7f01ca4cf700 1 -- 172.21.15.81:0/1272427477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c4157ca0 msgr2=0x7f01c415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:19.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.571+0000 7f01ca4cf700 1 --2- 172.21.15.81:0/1272427477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c4157ca0 0x7f01c415af00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f01c40646b0 tx=0x7f01b8009250 comp rx=0 tx=0).stop 2023-10-07T08:44:19.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.571+0000 7f01ca4cf700 1 -- 172.21.15.81:0/1272427477 shutdown_connections 2023-10-07T08:44:19.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.571+0000 7f01ca4cf700 1 --2- 172.21.15.81:0/1272427477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01c406d120 0x7f01c406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.571+0000 7f01ca4cf700 1 --2- 172.21.15.81:0/1272427477 >> v2:172.21.15.89:3300/0 conn(0x7f01c41578d0 0x7f01c40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.571+0000 7f01ca4cf700 1 --2- 172.21.15.81:0/1272427477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c4157ca0 0x7f01c415af00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.571+0000 7f01ca4cf700 1 -- 172.21.15.81:0/1272427477 >> 172.21.15.81:0/1272427477 conn(0x7f01c406bb90 msgr2=0x7f01c406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:19.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.571+0000 7f01ca4cf700 1 -- 172.21.15.81:0/1272427477 shutdown_connections 2023-10-07T08:44:19.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.571+0000 7f01ca4cf700 1 -- 172.21.15.81:0/1272427477 wait complete. 2023-10-07T08:44:19.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.572+0000 7f01ca4cf700 1 Processor -- start 2023-10-07T08:44:19.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.573+0000 7f01ca4cf700 1 -- start start 2023-10-07T08:44:19.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.573+0000 7f01ca4cf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01c406d120 0x7f01c416abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:19.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.573+0000 7f01ca4cf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01c41578d0 0x7f01c4147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:19.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.573+0000 7f01ca4cf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c4157ca0 0x7f01c40ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:19.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.573+0000 7f01ca4cf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c416b110 con 0x7f01c4157ca0 2023-10-07T08:44:19.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.573+0000 7f01ca4cf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c416bfd0 con 0x7f01c406d120 2023-10-07T08:44:19.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.573+0000 7f01ca4cf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c416b3c0 con 0x7f01c41578d0 2023-10-07T08:44:19.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.573+0000 7f01c8a6c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c4157ca0 0x7f01c40ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:19.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.573+0000 7f01c8a6c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c4157ca0 0x7f01c40ae230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39986/0 (socket says 172.21.15.81:39986) 2023-10-07T08:44:19.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.573+0000 7f01c8a6c700 1 -- 172.21.15.81:0/943091028 learned_addr learned my addr 172.21.15.81:0/943091028 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:19.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.574+0000 7f01c3fff700 1 --2- 172.21.15.81:0/943091028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01c406d120 0x7f01c416abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:19.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.574+0000 7f01c37fe700 1 --2- 172.21.15.81:0/943091028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01c41578d0 0x7f01c4147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:19.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.574+0000 7f01c8a6c700 1 -- 172.21.15.81:0/943091028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01c41578d0 msgr2=0x7f01c4147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:19.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.574+0000 7f01c8a6c700 1 --2- 172.21.15.81:0/943091028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01c41578d0 0x7f01c4147780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.574+0000 7f01c8a6c700 1 -- 172.21.15.81:0/943091028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01c406d120 msgr2=0x7f01c416abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:19.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.574+0000 7f01c8a6c700 1 --2- 172.21.15.81:0/943091028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01c406d120 0x7f01c416abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.574+0000 7f01c8a6c700 1 -- 172.21.15.81:0/943091028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b80094f0 con 0x7f01c4157ca0 2023-10-07T08:44:19.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.574+0000 7f01c37fe700 1 --2- 172.21.15.81:0/943091028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01c41578d0 0x7f01c4147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:19.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.574+0000 7f01c8a6c700 1 --2- 172.21.15.81:0/943091028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c4157ca0 0x7f01c40ae230 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009e90 tx=0x7f01bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:19.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.574+0000 7f01abfff700 1 -- 172.21.15.81:0/943091028 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc00cc20 con 0x7f01c4157ca0 2023-10-07T08:44:19.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.574+0000 7f01abfff700 1 -- 172.21.15.81:0/943091028 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc00f040 con 0x7f01c4157ca0 2023-10-07T08:44:19.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.574+0000 7f01ca4cf700 1 -- 172.21.15.81:0/943091028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c416b6a0 con 0x7f01c4157ca0 2023-10-07T08:44:19.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.574+0000 7f01abfff700 1 -- 172.21.15.81:0/943091028 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc014480 con 0x7f01c4157ca0 2023-10-07T08:44:19.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.574+0000 7f01ca4cf700 1 -- 172.21.15.81:0/943091028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c416bc60 con 0x7f01c4157ca0 2023-10-07T08:44:19.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.575+0000 7f01ca4cf700 1 -- 172.21.15.81:0/943091028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c40ce810 con 0x7f01c4157ca0 2023-10-07T08:44:19.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.575+0000 7f01abfff700 1 -- 172.21.15.81:0/943091028 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f01bc014830 con 0x7f01c4157ca0 2023-10-07T08:44:19.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.576+0000 7f01abfff700 1 --2- 172.21.15.81:0/943091028 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f01b0066f30 0x7f01b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:19.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.576+0000 7f01abfff700 1 -- 172.21.15.81:0/943091028 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01bc085060 con 0x7f01c4157ca0 2023-10-07T08:44:19.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.576+0000 7f01c3fff700 1 --2- 172.21.15.81:0/943091028 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f01b0066f30 0x7f01b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:19.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.576+0000 7f01c3fff700 1 --2- 172.21.15.81:0/943091028 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f01b0066f30 0x7f01b00693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009db0 tx=0x7f01b40091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:19.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.580+0000 7f01abfff700 1 -- 172.21.15.81:0/943091028 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01bc055d60 con 0x7f01c4157ca0 2023-10-07T08:44:19.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.765+0000 7f01ca4cf700 1 -- 172.21.15.81:0/943091028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01c416c110 con 0x7f01c4157ca0 2023-10-07T08:44:19.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.766+0000 7f01abfff700 1 -- 172.21.15.81:0/943091028 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f01bc0558f0 con 0x7f01c4157ca0 2023-10-07T08:44:19.767 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:19.767 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":46,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:44:18.798109+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:44:17.114223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-07T08:44:17.763615+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:44:19.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.768+0000 7f01ca4cf700 1 -- 172.21.15.81:0/943091028 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f01b0066f30 msgr2=0x7f01b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:19.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.768+0000 7f01ca4cf700 1 --2- 172.21.15.81:0/943091028 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f01b0066f30 0x7f01b00693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009db0 tx=0x7f01b40091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.768+0000 7f01ca4cf700 1 -- 172.21.15.81:0/943091028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c4157ca0 msgr2=0x7f01c40ae230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:19.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.768+0000 7f01ca4cf700 1 --2- 172.21.15.81:0/943091028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c4157ca0 0x7f01c40ae230 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009e90 tx=0x7f01bc00b040 comp rx=0 tx=0).stop 2023-10-07T08:44:19.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.768+0000 7f01ca4cf700 1 -- 172.21.15.81:0/943091028 shutdown_connections 2023-10-07T08:44:19.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.768+0000 7f01ca4cf700 1 --2- 172.21.15.81:0/943091028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c4157ca0 0x7f01c40ae230 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.768+0000 7f01ca4cf700 1 --2- 172.21.15.81:0/943091028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01c406d120 0x7f01c416abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.768+0000 7f01ca4cf700 1 --2- 172.21.15.81:0/943091028 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f01b0066f30 0x7f01b00693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.768+0000 7f01ca4cf700 1 --2- 172.21.15.81:0/943091028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01c41578d0 0x7f01c4147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.768+0000 7f01ca4cf700 1 -- 172.21.15.81:0/943091028 >> 172.21.15.81:0/943091028 conn(0x7f01c406bb90 msgr2=0x7f01c4070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.768+0000 7f01ca4cf700 1 -- 172.21.15.81:0/943091028 shutdown_connections 2023-10-07T08:44:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.768+0000 7f01ca4cf700 1 -- 172.21.15.81:0/943091028 wait complete. 2023-10-07T08:44:19.782 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:44:19.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.894+0000 7f32332d8700 1 Processor -- start 2023-10-07T08:44:19.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.894+0000 7f32332d8700 1 -- start start 2023-10-07T08:44:19.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.895+0000 7f32332d8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f322c157fe0 0x7f322c0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:19.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.895+0000 7f32332d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f322c0cf240 0x7f322c0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:19.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.895+0000 7f32332d8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322c0b2890 con 0x7f322c1583b0 2023-10-07T08:44:19.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.895+0000 7f32332d8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322c0b4070 con 0x7f322c157fe0 2023-10-07T08:44:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.895+0000 7f32332d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0b4350 con 0x7f322c0cf240 2023-10-07T08:44:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.895+0000 7f3231074700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f322c157fe0 0x7f322c0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.895+0000 7f3230873700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f322c1583b0 0x7f322c0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33076/0 (socket says 172.21.15.81:33076) 2023-10-07T08:44:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.895+0000 7f3230873700 1 -- 172.21.15.81:0/2196709953 learned_addr learned my addr 172.21.15.81:0/2196709953 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f3231875700 1 --2- 172.21.15.81:0/2196709953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f322c0cf240 0x7f322c0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f3231074700 1 -- 172.21.15.81:0/2196709953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f322c0cf240 msgr2=0x7f322c0b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f3231074700 1 --2- 172.21.15.81:0/2196709953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f322c0cf240 0x7f322c0b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f3231074700 1 -- 172.21.15.81:0/2196709953 >> v1:172.21.15.81:6789/0 conn(0x7f322c1583b0 legacy=0x7f322c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f3231074700 1 -- 172.21.15.81:0/2196709953 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c0b4630 con 0x7f322c157fe0 2023-10-07T08:44:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f3223fff700 1 -- 172.21.15.81:0/2196709953 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787552765 0 0) 0x7f322c0b2890 con 0x7f322c1583b0 2023-10-07T08:44:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f3231875700 1 --2- 172.21.15.81:0/2196709953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f322c0cf240 0x7f322c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f3231074700 1 --2- 172.21.15.81:0/2196709953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c157fe0 0x7f322c0b34c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3228009e60 tx=0x7f3228009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35980be04c6398 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f3223fff700 1 -- 172.21.15.81:0/2196709953 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322800e070 con 0x7f322c157fe0 2023-10-07T08:44:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f3223fff700 1 -- 172.21.15.81:0/2196709953 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322800bc30 con 0x7f322c157fe0 2023-10-07T08:44:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f3223fff700 1 -- 172.21.15.81:0/2196709953 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228012430 con 0x7f322c157fe0 2023-10-07T08:44:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f32332d8700 1 -- 172.21.15.81:0/2196709953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c157fe0 msgr2=0x7f322c0b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f32332d8700 1 --2- 172.21.15.81:0/2196709953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c157fe0 0x7f322c0b34c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3228009e60 tx=0x7f3228009780 comp rx=0 tx=0).stop 2023-10-07T08:44:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f32332d8700 1 -- 172.21.15.81:0/2196709953 shutdown_connections 2023-10-07T08:44:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f32332d8700 1 --2- 172.21.15.81:0/2196709953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c157fe0 0x7f322c0b34c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f32332d8700 1 --2- 172.21.15.81:0/2196709953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f322c0cf240 0x7f322c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.896+0000 7f32332d8700 1 -- 172.21.15.81:0/2196709953 >> 172.21.15.81:0/2196709953 conn(0x7f322c067640 msgr2=0x7f322c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.897+0000 7f32332d8700 1 -- 172.21.15.81:0/2196709953 shutdown_connections 2023-10-07T08:44:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.897+0000 7f32332d8700 1 -- 172.21.15.81:0/2196709953 wait complete. 2023-10-07T08:44:19.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.898+0000 7f32332d8700 1 Processor -- start 2023-10-07T08:44:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.898+0000 7f32332d8700 1 -- start start 2023-10-07T08:44:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.898+0000 7f32332d8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f322c0cf240 0x7f322c16b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.898+0000 7f32332d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f322c157fe0 0x7f322c0c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.898+0000 7f32332d8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c1583b0 0x7f322c0c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.898+0000 7f32332d8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0caab0 con 0x7f322c1583b0 2023-10-07T08:44:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.898+0000 7f32332d8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c16b690 con 0x7f322c0cf240 2023-10-07T08:44:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.898+0000 7f32332d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322c16ca20 con 0x7f322c157fe0 2023-10-07T08:44:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f3231875700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c1583b0 0x7f322c0c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f3231875700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c1583b0 0x7f322c0c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39994/0 (socket says 172.21.15.81:39994) 2023-10-07T08:44:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f3231875700 1 -- 172.21.15.81:0/584049777 learned_addr learned my addr 172.21.15.81:0/584049777 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f3231074700 1 --2- 172.21.15.81:0/584049777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f322c0cf240 0x7f322c16b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f3230873700 1 --2- 172.21.15.81:0/584049777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f322c157fe0 0x7f322c0c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f3231875700 1 -- 172.21.15.81:0/584049777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f322c157fe0 msgr2=0x7f322c0c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f3231875700 1 --2- 172.21.15.81:0/584049777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f322c157fe0 0x7f322c0c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f3231875700 1 -- 172.21.15.81:0/584049777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f322c0cf240 msgr2=0x7f322c16b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f3231875700 1 --2- 172.21.15.81:0/584049777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f322c0cf240 0x7f322c16b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f3231875700 1 -- 172.21.15.81:0/584049777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3228009a20 con 0x7f322c1583b0 2023-10-07T08:44:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f3231074700 1 --2- 172.21.15.81:0/584049777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f322c0cf240 0x7f322c16b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f3231875700 1 --2- 172.21.15.81:0/584049777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c1583b0 0x7f322c0c9c00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f322400d860 tx=0x7f3224008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f32217fa700 1 -- 172.21.15.81:0/584049777 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32240125f0 con 0x7f322c1583b0 2023-10-07T08:44:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f32217fa700 1 -- 172.21.15.81:0/584049777 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3224012750 con 0x7f322c1583b0 2023-10-07T08:44:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f32332d8700 1 -- 172.21.15.81:0/584049777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322c16be10 con 0x7f322c1583b0 2023-10-07T08:44:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f32217fa700 1 -- 172.21.15.81:0/584049777 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3224012af0 con 0x7f322c1583b0 2023-10-07T08:44:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.899+0000 7f32332d8700 1 -- 172.21.15.81:0/584049777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322c16c3d0 con 0x7f322c1583b0 2023-10-07T08:44:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.900+0000 7f32332d8700 1 -- 172.21.15.81:0/584049777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322c069e40 con 0x7f322c1583b0 2023-10-07T08:44:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.900+0000 7f32217fa700 1 -- 172.21.15.81:0/584049777 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f322401e460 con 0x7f322c1583b0 2023-10-07T08:44:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.901+0000 7f32217fa700 1 --2- 172.21.15.81:0/584049777 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3210066f30 0x7f32100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.901+0000 7f32217fa700 1 -- 172.21.15.81:0/584049777 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3224084b80 con 0x7f322c1583b0 2023-10-07T08:44:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.901+0000 7f3231074700 1 --2- 172.21.15.81:0/584049777 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3210066f30 0x7f32100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.901+0000 7f3231074700 1 --2- 172.21.15.81:0/584049777 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3210066f30 0x7f32100693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f322c06dd90 tx=0x7f3228019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:19.905+0000 7f32217fa700 1 -- 172.21.15.81:0/584049777 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3224051d50 con 0x7f322c1583b0 2023-10-07T08:44:20.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.090+0000 7f32332d8700 1 -- 172.21.15.81:0/584049777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f322c0cc6b0 con 0x7f322c1583b0 2023-10-07T08:44:20.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.091+0000 7f32217fa700 1 -- 172.21.15.81:0/584049777 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f3224084e60 con 0x7f322c1583b0 2023-10-07T08:44:20.092 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:20.093 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":46,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:44:18.798109+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:44:17.114223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-07T08:44:17.763615+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:44:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.093+0000 7f32332d8700 1 -- 172.21.15.81:0/584049777 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3210066f30 msgr2=0x7f32100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.093+0000 7f32332d8700 1 --2- 172.21.15.81:0/584049777 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3210066f30 0x7f32100693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f322c06dd90 tx=0x7f3228019000 comp rx=0 tx=0).stop 2023-10-07T08:44:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.093+0000 7f32332d8700 1 -- 172.21.15.81:0/584049777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c1583b0 msgr2=0x7f322c0c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.093+0000 7f32332d8700 1 --2- 172.21.15.81:0/584049777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c1583b0 0x7f322c0c9c00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f322400d860 tx=0x7f3224008040 comp rx=0 tx=0).stop 2023-10-07T08:44:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.093+0000 7f32332d8700 1 -- 172.21.15.81:0/584049777 shutdown_connections 2023-10-07T08:44:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.093+0000 7f32332d8700 1 --2- 172.21.15.81:0/584049777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c1583b0 0x7f322c0c9c00 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.093+0000 7f32332d8700 1 --2- 172.21.15.81:0/584049777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f322c0cf240 0x7f322c16b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.093+0000 7f32332d8700 1 --2- 172.21.15.81:0/584049777 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3210066f30 0x7f32100693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.093+0000 7f32332d8700 1 --2- 172.21.15.81:0/584049777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f322c157fe0 0x7f322c0c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:20.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.093+0000 7f32332d8700 1 -- 172.21.15.81:0/584049777 >> 172.21.15.81:0/584049777 conn(0x7f322c067640 msgr2=0x7f322c1535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:20.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.093+0000 7f32332d8700 1 -- 172.21.15.81:0/584049777 shutdown_connections 2023-10-07T08:44:20.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.093+0000 7f32332d8700 1 -- 172.21.15.81:0/584049777 wait complete. 2023-10-07T08:44:20.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T08:44:20.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.223+0000 7fa153fff700 1 Processor -- start 2023-10-07T08:44:20.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.223+0000 7fa153fff700 1 -- start start 2023-10-07T08:44:20.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa153fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa1540d0b80 0x7fa1540cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa153fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1540d02b0 0x7fa15406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa153fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1540cf2d0 con 0x7fa1540d0f50 2023-10-07T08:44:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa153fff700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15415a690 con 0x7fa1540d0b80 2023-10-07T08:44:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa153fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15406dc00 con 0x7fa1540d02b0 2023-10-07T08:44:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa1537fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa1540d0f50 0x7fa15415b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33086/0 (socket says 172.21.15.81:33086) 2023-10-07T08:44:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa1537fe700 1 -- 172.21.15.81:0/3310756946 learned_addr learned my addr 172.21.15.81:0/3310756946 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa1527fc700 1 -- 172.21.15.81:0/3310756946 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337347931 0 0) 0x7fa1540cf2d0 con 0x7fa1540d0f50 2023-10-07T08:44:20.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa152ffd700 1 --2- 172.21.15.81:0/3310756946 >> v2:172.21.15.89:3300/0 conn(0x7fa1540d0b80 0x7fa1540cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:20.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa1527fc700 1 -- 172.21.15.81:0/3310756946 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa140003570 con 0x7fa1540d0f50 2023-10-07T08:44:20.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa14a7fc700 1 --2- 172.21.15.81:0/3310756946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1540d02b0 0x7fa15406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:20.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa1527fc700 1 -- 172.21.15.81:0/3310756946 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 276425838 0 0) 0x7fa140003570 con 0x7fa1540d0f50 2023-10-07T08:44:20.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa1527fc700 1 -- 172.21.15.81:0/3310756946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1540d02b0 msgr2=0x7fa15406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:20.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa1527fc700 1 --2- 172.21.15.81:0/3310756946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1540d02b0 0x7fa15406cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:20.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa1527fc700 1 -- 172.21.15.81:0/3310756946 >> v2:172.21.15.89:3300/0 conn(0x7fa1540d0b80 msgr2=0x7fa1540cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:20.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa1527fc700 1 --2- 172.21.15.81:0/3310756946 >> v2:172.21.15.89:3300/0 conn(0x7fa1540d0b80 0x7fa1540cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:20.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa1527fc700 1 -- 172.21.15.81:0/3310756946 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1540cf570 con 0x7fa1540d0f50 2023-10-07T08:44:20.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.224+0000 7fa1527fc700 1 -- 172.21.15.81:0/3310756946 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fa14c0017f0 con 0x7fa1540d0f50 2023-10-07T08:44:20.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa1527fc700 1 -- 172.21.15.81:0/3310756946 >> v1:172.21.15.81:6789/0 conn(0x7fa1540d0f50 legacy=0x7fa15415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:20.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa1527fc700 1 --2- 172.21.15.81:0/3310756946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140003a60 0x7fa140003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:20.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa1527fc700 1 --2- 172.21.15.81:0/3310756946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa140004810 0x7fa140004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:20.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa1527fc700 1 --2- 172.21.15.81:0/3310756946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1540d02b0 0x7fa1400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:20.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa1527fc700 1 -- 172.21.15.81:0/3310756946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15415a690 con 0x7fa140004810 2023-10-07T08:44:20.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa1527fc700 1 -- 172.21.15.81:0/3310756946 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15406dc00 con 0x7fa140003a60 2023-10-07T08:44:20.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa1527fc700 1 -- 172.21.15.81:0/3310756946 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14000ba60 con 0x7fa1540d02b0 2023-10-07T08:44:20.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa14a7fc700 1 --2- 172.21.15.81:0/3310756946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa140004810 0x7fa140004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:20.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa152ffd700 1 --2- 172.21.15.81:0/3310756946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140003a60 0x7fa140003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa1537fe700 1 --2- 172.21.15.81:0/3310756946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1540d02b0 0x7fa1400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa14a7fc700 1 -- 172.21.15.81:0/3310756946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1540d02b0 msgr2=0x7fa1400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa14a7fc700 1 --2- 172.21.15.81:0/3310756946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1540d02b0 0x7fa1400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa14a7fc700 1 -- 172.21.15.81:0/3310756946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140003a60 msgr2=0x7fa140003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa14a7fc700 1 --2- 172.21.15.81:0/3310756946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140003a60 0x7fa140003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa14a7fc700 1 -- 172.21.15.81:0/3310756946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa140003570 con 0x7fa140004810 2023-10-07T08:44:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa152ffd700 1 --2- 172.21.15.81:0/3310756946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140003a60 0x7fa140003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa14a7fc700 1 --2- 172.21.15.81:0/3310756946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa140004810 0x7fa140004c80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa13c009c30 tx=0x7fa13c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d5e69f18dad0b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa1527fc700 1 -- 172.21.15.81:0/3310756946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13c00e710 con 0x7fa140004810 2023-10-07T08:44:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa1527fc700 1 -- 172.21.15.81:0/3310756946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13c00e870 con 0x7fa140004810 2023-10-07T08:44:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.225+0000 7fa1527fc700 1 -- 172.21.15.81:0/3310756946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13c00ec30 con 0x7fa140004810 2023-10-07T08:44:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.226+0000 7fa153fff700 1 -- 172.21.15.81:0/3310756946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa140004810 msgr2=0x7fa140004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.226+0000 7fa153fff700 1 --2- 172.21.15.81:0/3310756946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa140004810 0x7fa140004c80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa13c009c30 tx=0x7fa13c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.226+0000 7fa1537fe700 1 -- 172.21.15.81:0/3310756946 reap_dead start 2023-10-07T08:44:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.226+0000 7fa153fff700 1 -- 172.21.15.81:0/3310756946 shutdown_connections 2023-10-07T08:44:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.226+0000 7fa153fff700 1 -- 172.21.15.81:0/3310756946 >> 172.21.15.81:0/3310756946 conn(0x7fa154063230 msgr2=0x7fa154063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.226+0000 7fa153fff700 1 -- 172.21.15.81:0/3310756946 shutdown_connections 2023-10-07T08:44:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.226+0000 7fa153fff700 1 -- 172.21.15.81:0/3310756946 wait complete. 2023-10-07T08:44:20.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.227+0000 7fa153fff700 1 Processor -- start 2023-10-07T08:44:20.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.227+0000 7fa153fff700 1 -- start start 2023-10-07T08:44:20.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa153fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140004810 0x7fa1541509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:20.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa153fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa154156f50 0x7fa1540c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:20.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa153fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1540c7480 0x7fa154069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa153fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa154150ef0 con 0x7fa1540c7480 2023-10-07T08:44:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa153fff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1540c63e0 con 0x7fa140004810 2023-10-07T08:44:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa153fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1540c66c0 con 0x7fa154156f50 2023-10-07T08:44:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa1537fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1540c7480 0x7fa154069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa14a7fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa154156f50 0x7fa1540c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa152ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140004810 0x7fa1541509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa1537fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1540c7480 0x7fa154069910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40010/0 (socket says 172.21.15.81:40010) 2023-10-07T08:44:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa1537fe700 1 -- 172.21.15.81:0/1770622518 learned_addr learned my addr 172.21.15.81:0/1770622518 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa1537fe700 1 -- 172.21.15.81:0/1770622518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa154156f50 msgr2=0x7fa1540c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa1537fe700 1 --2- 172.21.15.81:0/1770622518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa154156f50 0x7fa1540c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa1537fe700 1 -- 172.21.15.81:0/1770622518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140004810 msgr2=0x7fa1541509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa1537fe700 1 --2- 172.21.15.81:0/1770622518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140004810 0x7fa1541509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa1537fe700 1 -- 172.21.15.81:0/1770622518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1540c69a0 con 0x7fa1540c7480 2023-10-07T08:44:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.228+0000 7fa1537fe700 1 --2- 172.21.15.81:0/1770622518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1540c7480 0x7fa154069910 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa14c000f80 tx=0x7fa1540cf460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.229+0000 7fa14b7fe700 1 -- 172.21.15.81:0/1770622518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c00ac70 con 0x7fa1540c7480 2023-10-07T08:44:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.229+0000 7fa14b7fe700 1 -- 172.21.15.81:0/1770622518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c00adf0 con 0x7fa1540c7480 2023-10-07T08:44:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.229+0000 7fa153fff700 1 -- 172.21.15.81:0/1770622518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1540c6c80 con 0x7fa1540c7480 2023-10-07T08:44:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.229+0000 7fa14b7fe700 1 -- 172.21.15.81:0/1770622518 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c013640 con 0x7fa1540c7480 2023-10-07T08:44:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.229+0000 7fa153fff700 1 -- 172.21.15.81:0/1770622518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1540c6060 con 0x7fa1540c7480 2023-10-07T08:44:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.230+0000 7fa153fff700 1 -- 172.21.15.81:0/1770622518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1540676e0 con 0x7fa1540c7480 2023-10-07T08:44:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.230+0000 7fa14b7fe700 1 -- 172.21.15.81:0/1770622518 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa14c0139b0 con 0x7fa1540c7480 2023-10-07T08:44:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.230+0000 7fa14b7fe700 1 --2- 172.21.15.81:0/1770622518 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa134066f30 0x7fa1340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:20.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.231+0000 7fa14b7fe700 1 -- 172.21.15.81:0/1770622518 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa14c084da0 con 0x7fa1540c7480 2023-10-07T08:44:20.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.231+0000 7fa152ffd700 1 --2- 172.21.15.81:0/1770622518 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa134066f30 0x7fa1340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:20.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.231+0000 7fa152ffd700 1 --2- 172.21.15.81:0/1770622518 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa134066f30 0x7fa1340693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa144009ee0 tx=0x7fa144008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:20.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.235+0000 7fa14b7fe700 1 -- 172.21.15.81:0/1770622518 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa14c052010 con 0x7fa1540c7480 2023-10-07T08:44:20.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:20.467+0000 7fa153fff700 1 -- 172.21.15.81:0/1770622518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa1540cf850 con 0x7fa1540c7480 2023-10-07T08:44:21.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.459+0000 7fa14b7fe700 1 -- 172.21.15.81:0/1770622518 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa14c055630 con 0x7fa1540c7480 2023-10-07T08:44:21.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.462+0000 7fa153fff700 1 -- 172.21.15.81:0/1770622518 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa134066f30 msgr2=0x7fa1340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:21.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.462+0000 7fa153fff700 1 --2- 172.21.15.81:0/1770622518 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa134066f30 0x7fa1340693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa144009ee0 tx=0x7fa144008040 comp rx=0 tx=0).stop 2023-10-07T08:44:21.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.462+0000 7fa153fff700 1 -- 172.21.15.81:0/1770622518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1540c7480 msgr2=0x7fa154069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:21.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.462+0000 7fa153fff700 1 --2- 172.21.15.81:0/1770622518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1540c7480 0x7fa154069910 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa14c000f80 tx=0x7fa1540cf460 comp rx=0 tx=0).stop 2023-10-07T08:44:21.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.462+0000 7fa153fff700 1 -- 172.21.15.81:0/1770622518 shutdown_connections 2023-10-07T08:44:21.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.462+0000 7fa153fff700 1 --2- 172.21.15.81:0/1770622518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1540c7480 0x7fa154069910 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:21.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.462+0000 7fa153fff700 1 --2- 172.21.15.81:0/1770622518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140004810 0x7fa1541509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:21.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.462+0000 7fa153fff700 1 --2- 172.21.15.81:0/1770622518 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa134066f30 0x7fa1340693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:21.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.462+0000 7fa153fff700 1 --2- 172.21.15.81:0/1770622518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa154156f50 0x7fa1540c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:21.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.462+0000 7fa153fff700 1 -- 172.21.15.81:0/1770622518 >> 172.21.15.81:0/1770622518 conn(0x7fa154063230 msgr2=0x7fa1540b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:21.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.462+0000 7fa153fff700 1 -- 172.21.15.81:0/1770622518 shutdown_connections 2023-10-07T08:44:21.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.462+0000 7fa153fff700 1 -- 172.21.15.81:0/1770622518 wait complete. 2023-10-07T08:44:21.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T08:44:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.599+0000 7f6d0da5e700 1 Processor -- start 2023-10-07T08:44:21.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.599+0000 7f6d0da5e700 1 -- start start 2023-10-07T08:44:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.600+0000 7f6d0da5e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d08157ca0 0x7f6d080cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.600+0000 7f6d0da5e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6d0806d120 0x7f6d0806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.600+0000 7f6d0da5e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d0806dac0 con 0x7f6d081578d0 2023-10-07T08:44:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.600+0000 7f6d0da5e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d080d07c0 con 0x7f6d0806d120 2023-10-07T08:44:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.600+0000 7f6d0da5e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080cfbb0 con 0x7f6d08157ca0 2023-10-07T08:44:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.600+0000 7f6d06ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6d081578d0 0x7f6d0815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33094/0 (socket says 172.21.15.81:33094) 2023-10-07T08:44:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.600+0000 7f6d06ffd700 1 -- 172.21.15.81:0/3847738158 learned_addr learned my addr 172.21.15.81:0/3847738158 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.600+0000 7f6cfe7fc700 1 --2- 172.21.15.81:0/3847738158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d08157ca0 0x7f6d080cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.600+0000 7f6d077fe700 1 --2- 172.21.15.81:0/3847738158 >> v2:172.21.15.89:3300/0 conn(0x7f6d0806d120 0x7f6d0806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.600+0000 7f6d067fc700 1 -- 172.21.15.81:0/3847738158 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150410738 0 0) 0x7f6cf8001110 con 0x7f6d081578d0 2023-10-07T08:44:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.600+0000 7f6d067fc700 1 -- 172.21.15.81:0/3847738158 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cf4003570 con 0x7f6d081578d0 2023-10-07T08:44:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.601+0000 7f6cfe7fc700 1 -- 172.21.15.81:0/3847738158 >> v2:172.21.15.89:3300/0 conn(0x7f6d0806d120 msgr2=0x7f6d0806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.601+0000 7f6cfe7fc700 1 --2- 172.21.15.81:0/3847738158 >> v2:172.21.15.89:3300/0 conn(0x7f6d0806d120 0x7f6d0806d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.601+0000 7f6cfe7fc700 1 -- 172.21.15.81:0/3847738158 >> v1:172.21.15.81:6789/0 conn(0x7f6d081578d0 legacy=0x7f6d0815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.601+0000 7f6d067fc700 1 -- 172.21.15.81:0/3847738158 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2553530277 0 0) 0x7f6cf4003570 con 0x7f6d081578d0 2023-10-07T08:44:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.601+0000 7f6cfe7fc700 1 -- 172.21.15.81:0/3847738158 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d080cfe90 con 0x7f6d08157ca0 2023-10-07T08:44:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.601+0000 7f6cfe7fc700 1 --2- 172.21.15.81:0/3847738158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d08157ca0 0x7f6d080cf4f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00098e0 tx=0x7f6cf00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f539775d4b0ee9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.601+0000 7f6d067fc700 1 -- 172.21.15.81:0/3847738158 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8001600 con 0x7f6d08157ca0 2023-10-07T08:44:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.601+0000 7f6d067fc700 1 -- 172.21.15.81:0/3847738158 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf0011420 con 0x7f6d08157ca0 2023-10-07T08:44:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.601+0000 7f6d067fc700 1 -- 172.21.15.81:0/3847738158 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00117c0 con 0x7f6d08157ca0 2023-10-07T08:44:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.601+0000 7f6d0da5e700 1 -- 172.21.15.81:0/3847738158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d08157ca0 msgr2=0x7f6d080cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.601+0000 7f6d0da5e700 1 --2- 172.21.15.81:0/3847738158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d08157ca0 0x7f6d080cf4f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00098e0 tx=0x7f6cf00091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.602+0000 7f6d0da5e700 1 -- 172.21.15.81:0/3847738158 shutdown_connections 2023-10-07T08:44:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.602+0000 7f6d0da5e700 1 --2- 172.21.15.81:0/3847738158 >> v2:172.21.15.89:3300/0 conn(0x7f6d0806d120 0x7f6d0806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.602+0000 7f6d0da5e700 1 --2- 172.21.15.81:0/3847738158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d08157ca0 0x7f6d080cf4f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.602+0000 7f6d0da5e700 1 -- 172.21.15.81:0/3847738158 >> 172.21.15.81:0/3847738158 conn(0x7f6d0806bb90 msgr2=0x7f6d0806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.602+0000 7f6d0da5e700 1 -- 172.21.15.81:0/3847738158 shutdown_connections 2023-10-07T08:44:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.602+0000 7f6d0da5e700 1 -- 172.21.15.81:0/3847738158 wait complete. 2023-10-07T08:44:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.603+0000 7f6d0da5e700 1 Processor -- start 2023-10-07T08:44:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.603+0000 7f6d0da5e700 1 -- start start 2023-10-07T08:44:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6d0da5e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d0806d120 0x7f6d080c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6d0da5e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d081578d0 0x7f6d080c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6d0da5e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d08157ca0 0x7f6d0816abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:21.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6d0da5e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080c68d0 con 0x7f6d081578d0 2023-10-07T08:44:21.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6d0da5e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080c5cc0 con 0x7f6d0806d120 2023-10-07T08:44:21.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6d0da5e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080c5fa0 con 0x7f6d08157ca0 2023-10-07T08:44:21.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6cfe7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d081578d0 0x7f6d080c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:21.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6cfe7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d081578d0 0x7f6d080c78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40016/0 (socket says 172.21.15.81:40016) 2023-10-07T08:44:21.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6cfe7fc700 1 -- 172.21.15.81:0/2761782359 learned_addr learned my addr 172.21.15.81:0/2761782359 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:21.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6d077fe700 1 --2- 172.21.15.81:0/2761782359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d08157ca0 0x7f6d0816abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:21.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6d06ffd700 1 --2- 172.21.15.81:0/2761782359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d0806d120 0x7f6d080c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:21.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6cfe7fc700 1 -- 172.21.15.81:0/2761782359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d08157ca0 msgr2=0x7f6d0816abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:21.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6cfe7fc700 1 --2- 172.21.15.81:0/2761782359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d08157ca0 0x7f6d0816abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:21.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6cfe7fc700 1 -- 172.21.15.81:0/2761782359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d0806d120 msgr2=0x7f6d080c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:21.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6cfe7fc700 1 --2- 172.21.15.81:0/2761782359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d0806d120 0x7f6d080c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:21.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6cfe7fc700 1 -- 172.21.15.81:0/2761782359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf0009420 con 0x7f6d081578d0 2023-10-07T08:44:21.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6d077fe700 1 --2- 172.21.15.81:0/2761782359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d08157ca0 0x7f6d0816abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:21.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6cfe7fc700 1 --2- 172.21.15.81:0/2761782359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d081578d0 0x7f6d080c78c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00030c0 tx=0x7f6cf0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:21.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6cff7fe700 1 -- 172.21.15.81:0/2761782359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf001cc90 con 0x7f6d081578d0 2023-10-07T08:44:21.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6cff7fe700 1 -- 172.21.15.81:0/2761782359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf001cdf0 con 0x7f6d081578d0 2023-10-07T08:44:21.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6d0da5e700 1 -- 172.21.15.81:0/2761782359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d080c6280 con 0x7f6d081578d0 2023-10-07T08:44:21.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6cff7fe700 1 -- 172.21.15.81:0/2761782359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf001a6a0 con 0x7f6d081578d0 2023-10-07T08:44:21.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.604+0000 7f6d0da5e700 1 -- 172.21.15.81:0/2761782359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d080c7e00 con 0x7f6d081578d0 2023-10-07T08:44:21.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.605+0000 7f6d0da5e700 1 -- 172.21.15.81:0/2761782359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d080c6720 con 0x7f6d081578d0 2023-10-07T08:44:21.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.606+0000 7f6cff7fe700 1 -- 172.21.15.81:0/2761782359 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6cf001aad0 con 0x7f6d081578d0 2023-10-07T08:44:21.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.606+0000 7f6cff7fe700 1 --2- 172.21.15.81:0/2761782359 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ce8066f30 0x7f6ce80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:21.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.606+0000 7f6d06ffd700 1 --2- 172.21.15.81:0/2761782359 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ce8066f30 0x7f6ce80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:21.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.606+0000 7f6cff7fe700 1 -- 172.21.15.81:0/2761782359 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6cf0085e60 con 0x7f6d081578d0 2023-10-07T08:44:21.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.606+0000 7f6d06ffd700 1 --2- 172.21.15.81:0/2761782359 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ce8066f30 0x7f6ce80693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8005cc0 tx=0x7f6cf80011b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:21.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.610+0000 7f6cff7fe700 1 -- 172.21.15.81:0/2761782359 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cf00530d0 con 0x7f6d081578d0 2023-10-07T08:44:21.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:21.835+0000 7f6d0da5e700 1 -- 172.21.15.81:0/2761782359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6d080c6a10 con 0x7f6d081578d0 2023-10-07T08:44:22.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.461+0000 7f6cff7fe700 1 -- 172.21.15.81:0/2761782359 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6cf00290c0 con 0x7f6d081578d0 2023-10-07T08:44:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.463+0000 7f6d0da5e700 1 -- 172.21.15.81:0/2761782359 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ce8066f30 msgr2=0x7f6ce80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.463+0000 7f6d0da5e700 1 --2- 172.21.15.81:0/2761782359 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ce8066f30 0x7f6ce80693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8005cc0 tx=0x7f6cf80011b0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.463+0000 7f6d0da5e700 1 -- 172.21.15.81:0/2761782359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d081578d0 msgr2=0x7f6d080c78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.463+0000 7f6d0da5e700 1 --2- 172.21.15.81:0/2761782359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d081578d0 0x7f6d080c78c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00030c0 tx=0x7f6cf0016000 comp rx=0 tx=0).stop 2023-10-07T08:44:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.463+0000 7f6d0da5e700 1 -- 172.21.15.81:0/2761782359 shutdown_connections 2023-10-07T08:44:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.463+0000 7f6d0da5e700 1 --2- 172.21.15.81:0/2761782359 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ce8066f30 0x7f6ce80693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.463+0000 7f6d0da5e700 1 --2- 172.21.15.81:0/2761782359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d08157ca0 0x7f6d0816abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.463+0000 7f6d0da5e700 1 --2- 172.21.15.81:0/2761782359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d0806d120 0x7f6d080c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.463+0000 7f6d0da5e700 1 --2- 172.21.15.81:0/2761782359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d081578d0 0x7f6d080c78c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.463+0000 7f6d0da5e700 1 -- 172.21.15.81:0/2761782359 >> 172.21.15.81:0/2761782359 conn(0x7f6d0806bb90 msgr2=0x7f6d08156840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.463+0000 7f6d0da5e700 1 -- 172.21.15.81:0/2761782359 shutdown_connections 2023-10-07T08:44:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.463+0000 7f6d0da5e700 1 -- 172.21.15.81:0/2761782359 wait complete. 2023-10-07T08:44:22.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:44:22.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.594+0000 7fc665ce1700 1 Processor -- start 2023-10-07T08:44:22.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.594+0000 7fc665ce1700 1 -- start start 2023-10-07T08:44:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.594+0000 7fc665ce1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6600b3bd0 0x7fc6600ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.594+0000 7fc665ce1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6600b2890 con 0x7fc660157fe0 2023-10-07T08:44:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.594+0000 7fc665ce1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6600b4070 con 0x7fc6601583b0 2023-10-07T08:44:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.594+0000 7fc665ce1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6600b4350 con 0x7fc6600b3bd0 2023-10-07T08:44:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.595+0000 7fc657fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6600b3bd0 0x7fc6600ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.595+0000 7fc65f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc660157fe0 0x7fc6600b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32846/0 (socket says 172.21.15.81:32846) 2023-10-07T08:44:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.595+0000 7fc65f7fe700 1 -- 172.21.15.81:0/2919297126 learned_addr learned my addr 172.21.15.81:0/2919297126 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.595+0000 7fc657fff700 1 -- 172.21.15.81:0/2919297126 >> v1:172.21.15.89:6789/0 conn(0x7fc6601583b0 legacy=0x7fc660158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.595+0000 7fc657fff700 1 -- 172.21.15.81:0/2919297126 >> v1:172.21.15.81:6789/0 conn(0x7fc660157fe0 legacy=0x7fc6600b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.595+0000 7fc657fff700 1 -- 172.21.15.81:0/2919297126 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6600b4630 con 0x7fc6600b3bd0 2023-10-07T08:44:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.595+0000 7fc65effd700 1 -- 172.21.15.81:0/2919297126 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582926313 0 0) 0x7fc6600b2890 con 0x7fc660157fe0 2023-10-07T08:44:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.595+0000 7fc657fff700 1 --2- 172.21.15.81:0/2919297126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6600b3bd0 0x7fc6600ceb30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc6480098e0 tx=0x7fc6480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12d3c3d7cea38eb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.595+0000 7fc65effd700 1 -- 172.21.15.81:0/2919297126 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648009e80 con 0x7fc6600b3bd0 2023-10-07T08:44:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.595+0000 7fc65effd700 1 -- 172.21.15.81:0/2919297126 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64800b860 con 0x7fc6600b3bd0 2023-10-07T08:44:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.595+0000 7fc65effd700 1 -- 172.21.15.81:0/2919297126 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64800bbe0 con 0x7fc6600b3bd0 2023-10-07T08:44:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.596+0000 7fc665ce1700 1 -- 172.21.15.81:0/2919297126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6600b3bd0 msgr2=0x7fc6600ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.596+0000 7fc665ce1700 1 --2- 172.21.15.81:0/2919297126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6600b3bd0 0x7fc6600ceb30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc6480098e0 tx=0x7fc6480091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.596+0000 7fc665ce1700 1 -- 172.21.15.81:0/2919297126 shutdown_connections 2023-10-07T08:44:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.596+0000 7fc665ce1700 1 --2- 172.21.15.81:0/2919297126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6600b3bd0 0x7fc6600ceb30 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.596+0000 7fc665ce1700 1 -- 172.21.15.81:0/2919297126 >> 172.21.15.81:0/2919297126 conn(0x7fc660067640 msgr2=0x7fc660067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.596+0000 7fc665ce1700 1 -- 172.21.15.81:0/2919297126 shutdown_connections 2023-10-07T08:44:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.596+0000 7fc665ce1700 1 -- 172.21.15.81:0/2919297126 wait complete. 2023-10-07T08:44:22.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.597+0000 7fc665ce1700 1 Processor -- start 2023-10-07T08:44:22.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.597+0000 7fc665ce1700 1 -- start start 2023-10-07T08:44:22.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.597+0000 7fc665ce1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6600b3bd0 0x7fc66014af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:22.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.597+0000 7fc665ce1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc660157fe0 0x7fc6600cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc665ce1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6601583b0 0x7fc66014be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc665ce1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66006cca0 con 0x7fc6601583b0 2023-10-07T08:44:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc665ce1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66006cf80 con 0x7fc6600b3bd0 2023-10-07T08:44:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc665ce1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66006d260 con 0x7fc660157fe0 2023-10-07T08:44:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc65ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6601583b0 0x7fc66014be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc65ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6601583b0 0x7fc66014be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48446/0 (socket says 172.21.15.81:48446) 2023-10-07T08:44:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc65ffff700 1 -- 172.21.15.81:0/1734526540 learned_addr learned my addr 172.21.15.81:0/1734526540 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc65f7fe700 1 --2- 172.21.15.81:0/1734526540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6600b3bd0 0x7fc66014af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc657fff700 1 --2- 172.21.15.81:0/1734526540 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc660157fe0 0x7fc6600cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc65ffff700 1 -- 172.21.15.81:0/1734526540 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc660157fe0 msgr2=0x7fc6600cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc65ffff700 1 --2- 172.21.15.81:0/1734526540 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc660157fe0 0x7fc6600cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc65ffff700 1 -- 172.21.15.81:0/1734526540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6600b3bd0 msgr2=0x7fc66014af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc65ffff700 1 --2- 172.21.15.81:0/1734526540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6600b3bd0 0x7fc66014af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc65ffff700 1 -- 172.21.15.81:0/1734526540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc648009420 con 0x7fc6601583b0 2023-10-07T08:44:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc65ffff700 1 --2- 172.21.15.81:0/1734526540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6601583b0 0x7fc66014be40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc65800c930 tx=0x7fc6580026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc6577fe700 1 -- 172.21.15.81:0/1734526540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65800ce70 con 0x7fc6601583b0 2023-10-07T08:44:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc6577fe700 1 -- 172.21.15.81:0/1734526540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65800a7e0 con 0x7fc6601583b0 2023-10-07T08:44:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc665ce1700 1 -- 172.21.15.81:0/1734526540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66006d540 con 0x7fc6601583b0 2023-10-07T08:44:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc6577fe700 1 -- 172.21.15.81:0/1734526540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65800aba0 con 0x7fc6601583b0 2023-10-07T08:44:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.598+0000 7fc665ce1700 1 -- 172.21.15.81:0/1734526540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66016b4e0 con 0x7fc6601583b0 2023-10-07T08:44:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.599+0000 7fc665ce1700 1 -- 172.21.15.81:0/1734526540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66006da60 con 0x7fc6601583b0 2023-10-07T08:44:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.599+0000 7fc6577fe700 1 -- 172.21.15.81:0/1734526540 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc658012420 con 0x7fc6601583b0 2023-10-07T08:44:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.600+0000 7fc6577fe700 1 --2- 172.21.15.81:0/1734526540 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc640066f30 0x7fc6400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:22.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.600+0000 7fc6577fe700 1 -- 172.21.15.81:0/1734526540 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc658084920 con 0x7fc6601583b0 2023-10-07T08:44:22.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.600+0000 7fc65f7fe700 1 --2- 172.21.15.81:0/1734526540 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc640066f30 0x7fc6400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:22.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.600+0000 7fc65f7fe700 1 --2- 172.21.15.81:0/1734526540 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc640066f30 0x7fc6400693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc6500011e0 tx=0x7fc650009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.604+0000 7fc6577fe700 1 -- 172.21.15.81:0/1734526540 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc66006da60 con 0x7fc6601583b0 2023-10-07T08:44:22.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.825+0000 7fc665ce1700 1 -- 172.21.15.81:0/1734526540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc66006da60 con 0x7fc6601583b0 2023-10-07T08:44:22.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.825+0000 7fc6577fe700 1 -- 172.21.15.81:0/1734526540 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fc66006da60 con 0x7fc6601583b0 2023-10-07T08:44:22.827 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:22.827 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1491348117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1491348117},{"type":"v1","addr":"172.21.15.89:6834","nonce":1491348117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/748490276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":748490276},{"type":"v1","addr":"172.21.15.89:6835","nonce":748490276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2260626922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2260626922},{"type":"v1","addr":"172.21.15.81:6835","nonce":2260626922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:44:18.798458+0000","modified":"2023-10-07T08:44:22.459128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5340":{"gid":5340,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2750584146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2750584146},{"type":"v1","addr":"172.21.15.81:6837","nonce":2750584146}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-07T08:44:22.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.827+0000 7fc665ce1700 1 -- 172.21.15.81:0/1734526540 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc640066f30 msgr2=0x7fc6400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:22.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.827+0000 7fc665ce1700 1 --2- 172.21.15.81:0/1734526540 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc640066f30 0x7fc6400693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc6500011e0 tx=0x7fc650009040 comp rx=0 tx=0).stop 2023-10-07T08:44:22.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.827+0000 7fc665ce1700 1 -- 172.21.15.81:0/1734526540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6601583b0 msgr2=0x7fc66014be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:22.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.827+0000 7fc665ce1700 1 --2- 172.21.15.81:0/1734526540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6601583b0 0x7fc66014be40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc65800c930 tx=0x7fc6580026e0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.827+0000 7fc665ce1700 1 -- 172.21.15.81:0/1734526540 shutdown_connections 2023-10-07T08:44:22.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.827+0000 7fc665ce1700 1 --2- 172.21.15.81:0/1734526540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6601583b0 0x7fc66014be40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.827+0000 7fc665ce1700 1 --2- 172.21.15.81:0/1734526540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6600b3bd0 0x7fc66014af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.827+0000 7fc665ce1700 1 --2- 172.21.15.81:0/1734526540 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc640066f30 0x7fc6400693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.827+0000 7fc665ce1700 1 --2- 172.21.15.81:0/1734526540 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc660157fe0 0x7fc6600cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.827+0000 7fc665ce1700 1 -- 172.21.15.81:0/1734526540 >> 172.21.15.81:0/1734526540 conn(0x7fc660067640 msgr2=0x7fc660155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:22.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.827+0000 7fc665ce1700 1 -- 172.21.15.81:0/1734526540 shutdown_connections 2023-10-07T08:44:22.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.827+0000 7fc665ce1700 1 -- 172.21.15.81:0/1734526540 wait complete. 2023-10-07T08:44:22.830 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2023-10-07T08:44:22.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:44:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.952+0000 7f95319aa700 1 Processor -- start 2023-10-07T08:44:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.952+0000 7f95319aa700 1 -- start start 2023-10-07T08:44:22.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.953+0000 7f95319aa700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f952c1578d0 0x7f952c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:22.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.953+0000 7f95319aa700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f952c157ca0 0x7f952c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:22.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.953+0000 7f95319aa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f952c06d120 0x7f952c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.953+0000 7f95319aa700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952c0d07c0 con 0x7f952c157ca0 2023-10-07T08:44:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.953+0000 7f95319aa700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952c06daa0 con 0x7f952c1578d0 2023-10-07T08:44:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.953+0000 7f95319aa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0cfbb0 con 0x7f952c06d120 2023-10-07T08:44:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.953+0000 7f952a7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f952c157ca0 0x7f952c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.953+0000 7f952a7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f952c157ca0 0x7f952c15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48458/0 (socket says 172.21.15.81:48458) 2023-10-07T08:44:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.953+0000 7f952a7fc700 1 -- 172.21.15.81:0/4149965193 learned_addr learned my addr 172.21.15.81:0/4149965193 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.953+0000 7f952b7fe700 1 --2- 172.21.15.81:0/4149965193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f952c06d120 0x7f952c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.953+0000 7f952affd700 1 --2- 172.21.15.81:0/4149965193 >> v2:172.21.15.89:3300/0 conn(0x7f952c1578d0 0x7f952c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f952a7fc700 1 -- 172.21.15.81:0/4149965193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f952c06d120 msgr2=0x7f952c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f952a7fc700 1 --2- 172.21.15.81:0/4149965193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f952c06d120 0x7f952c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f952a7fc700 1 -- 172.21.15.81:0/4149965193 >> v2:172.21.15.89:3300/0 conn(0x7f952c1578d0 msgr2=0x7f952c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f952a7fc700 1 --2- 172.21.15.81:0/4149965193 >> v2:172.21.15.89:3300/0 conn(0x7f952c1578d0 0x7f952c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f952a7fc700 1 -- 172.21.15.81:0/4149965193 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c0cfe90 con 0x7f952c157ca0 2023-10-07T08:44:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f952a7fc700 1 --2- 172.21.15.81:0/4149965193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c157ca0 0x7f952c15af00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f952c0646b0 tx=0x7f9514009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9756bef3a2cc7550 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f9529ffb700 1 -- 172.21.15.81:0/4149965193 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400b640 con 0x7f952c157ca0 2023-10-07T08:44:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f9529ffb700 1 -- 172.21.15.81:0/4149965193 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951400b7a0 con 0x7f952c157ca0 2023-10-07T08:44:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f9529ffb700 1 -- 172.21.15.81:0/4149965193 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400bb60 con 0x7f952c157ca0 2023-10-07T08:44:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f95319aa700 1 -- 172.21.15.81:0/4149965193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c157ca0 msgr2=0x7f952c15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f95319aa700 1 --2- 172.21.15.81:0/4149965193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c157ca0 0x7f952c15af00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f952c0646b0 tx=0x7f9514009250 comp rx=0 tx=0).stop 2023-10-07T08:44:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f95319aa700 1 -- 172.21.15.81:0/4149965193 shutdown_connections 2023-10-07T08:44:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f95319aa700 1 --2- 172.21.15.81:0/4149965193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f952c06d120 0x7f952c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f95319aa700 1 --2- 172.21.15.81:0/4149965193 >> v2:172.21.15.89:3300/0 conn(0x7f952c1578d0 0x7f952c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f95319aa700 1 --2- 172.21.15.81:0/4149965193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c157ca0 0x7f952c15af00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f95319aa700 1 -- 172.21.15.81:0/4149965193 >> 172.21.15.81:0/4149965193 conn(0x7f952c06bb90 msgr2=0x7f952c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f95319aa700 1 -- 172.21.15.81:0/4149965193 shutdown_connections 2023-10-07T08:44:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.954+0000 7f95319aa700 1 -- 172.21.15.81:0/4149965193 wait complete. 2023-10-07T08:44:22.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.956+0000 7f95319aa700 1 Processor -- start 2023-10-07T08:44:22.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.956+0000 7f95319aa700 1 -- start start 2023-10-07T08:44:22.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.956+0000 7f95319aa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c06d120 0x7f952c16abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:22.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.956+0000 7f95319aa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f952c1578d0 0x7f952c147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.956+0000 7f95319aa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f952c157ca0 0x7f952c0ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.956+0000 7f95319aa700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c16b110 con 0x7f952c06d120 2023-10-07T08:44:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.956+0000 7f95319aa700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c16bfd0 con 0x7f952c1578d0 2023-10-07T08:44:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.956+0000 7f95319aa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c16b3c0 con 0x7f952c157ca0 2023-10-07T08:44:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.956+0000 7f952affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c06d120 0x7f952c16abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.957+0000 7f952affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c06d120 0x7f952c16abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48466/0 (socket says 172.21.15.81:48466) 2023-10-07T08:44:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.957+0000 7f952affd700 1 -- 172.21.15.81:0/1428620153 learned_addr learned my addr 172.21.15.81:0/1428620153 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.957+0000 7f952b7fe700 1 --2- 172.21.15.81:0/1428620153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f952c157ca0 0x7f952c0ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.957+0000 7f952a7fc700 1 --2- 172.21.15.81:0/1428620153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f952c1578d0 0x7f952c147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.957+0000 7f952affd700 1 -- 172.21.15.81:0/1428620153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f952c157ca0 msgr2=0x7f952c0ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.957+0000 7f952affd700 1 --2- 172.21.15.81:0/1428620153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f952c157ca0 0x7f952c0ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.957+0000 7f952affd700 1 -- 172.21.15.81:0/1428620153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f952c1578d0 msgr2=0x7f952c147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:22.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.957+0000 7f952affd700 1 --2- 172.21.15.81:0/1428620153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f952c1578d0 0x7f952c147780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:22.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.957+0000 7f952affd700 1 -- 172.21.15.81:0/1428620153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95140094f0 con 0x7f952c06d120 2023-10-07T08:44:22.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.957+0000 7f952b7fe700 1 --2- 172.21.15.81:0/1428620153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f952c157ca0 0x7f952c0ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:22.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.957+0000 7f952affd700 1 --2- 172.21.15.81:0/1428620153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c06d120 0x7f952c16abd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f951c009ef0 tx=0x7f951c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:22.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.957+0000 7f9522ffd700 1 -- 172.21.15.81:0/1428620153 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c00cc50 con 0x7f952c06d120 2023-10-07T08:44:22.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.957+0000 7f9522ffd700 1 -- 172.21.15.81:0/1428620153 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c00f040 con 0x7f952c06d120 2023-10-07T08:44:22.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.957+0000 7f95319aa700 1 -- 172.21.15.81:0/1428620153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c16b6a0 con 0x7f952c06d120 2023-10-07T08:44:22.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.957+0000 7f9522ffd700 1 -- 172.21.15.81:0/1428620153 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c014480 con 0x7f952c06d120 2023-10-07T08:44:22.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.957+0000 7f95319aa700 1 -- 172.21.15.81:0/1428620153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c16bc60 con 0x7f952c06d120 2023-10-07T08:44:22.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.958+0000 7f95319aa700 1 -- 172.21.15.81:0/1428620153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c0ce810 con 0x7f952c06d120 2023-10-07T08:44:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.958+0000 7f9522ffd700 1 -- 172.21.15.81:0/1428620153 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f951c0147f0 con 0x7f952c06d120 2023-10-07T08:44:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.959+0000 7f9522ffd700 1 --2- 172.21.15.81:0/1428620153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f950c066f30 0x7f950c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.959+0000 7f952a7fc700 1 --2- 172.21.15.81:0/1428620153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f950c066f30 0x7f950c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.959+0000 7f9522ffd700 1 -- 172.21.15.81:0/1428620153 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f951c085000 con 0x7f952c06d120 2023-10-07T08:44:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.959+0000 7f952a7fc700 1 --2- 172.21.15.81:0/1428620153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f950c066f30 0x7f950c0693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f952c0646b0 tx=0x7f9514017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:22.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:22.963+0000 7f9522ffd700 1 -- 172.21.15.81:0/1428620153 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f951c052270 con 0x7f952c06d120 2023-10-07T08:44:23.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.144+0000 7f95319aa700 1 -- 172.21.15.81:0/1428620153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f952c0d0170 con 0x7f952c06d120 2023-10-07T08:44:23.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.145+0000 7f9522ffd700 1 -- 172.21.15.81:0/1428620153 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f951c055890 con 0x7f952c06d120 2023-10-07T08:44:23.147 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:23.147 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":47,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:44:20.421712+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:44:17.114223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-07T08:44:17.763615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:44:23.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.148+0000 7f95319aa700 1 -- 172.21.15.81:0/1428620153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f950c066f30 msgr2=0x7f950c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:23.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.148+0000 7f95319aa700 1 --2- 172.21.15.81:0/1428620153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f950c066f30 0x7f950c0693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f952c0646b0 tx=0x7f9514017000 comp rx=0 tx=0).stop 2023-10-07T08:44:23.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.148+0000 7f95319aa700 1 -- 172.21.15.81:0/1428620153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c06d120 msgr2=0x7f952c16abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:23.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.148+0000 7f95319aa700 1 --2- 172.21.15.81:0/1428620153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c06d120 0x7f952c16abd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f951c009ef0 tx=0x7f951c00b040 comp rx=0 tx=0).stop 2023-10-07T08:44:23.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.148+0000 7f95319aa700 1 -- 172.21.15.81:0/1428620153 shutdown_connections 2023-10-07T08:44:23.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.148+0000 7f95319aa700 1 --2- 172.21.15.81:0/1428620153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f950c066f30 0x7f950c0693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.148+0000 7f95319aa700 1 --2- 172.21.15.81:0/1428620153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f952c157ca0 0x7f952c0ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.148+0000 7f95319aa700 1 --2- 172.21.15.81:0/1428620153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c06d120 0x7f952c16abd0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.148+0000 7f95319aa700 1 --2- 172.21.15.81:0/1428620153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f952c1578d0 0x7f952c147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.148+0000 7f95319aa700 1 -- 172.21.15.81:0/1428620153 >> 172.21.15.81:0/1428620153 conn(0x7f952c06bb90 msgr2=0x7f952c070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:23.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.148+0000 7f95319aa700 1 -- 172.21.15.81:0/1428620153 shutdown_connections 2023-10-07T08:44:23.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.148+0000 7f95319aa700 1 -- 172.21.15.81:0/1428620153 wait complete. 2023-10-07T08:44:23.161 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T08:44:23.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:44:23.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.274+0000 7fee5b716700 1 Processor -- start 2023-10-07T08:44:23.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.275+0000 7fee5b716700 1 -- start start 2023-10-07T08:44:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.275+0000 7fee5b716700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee540ce1f0 0x7fee540aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.275+0000 7fee5b716700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fee540ce5c0 0x7fee5415e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.275+0000 7fee5b716700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee540ac570 0x7fee5406e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.275+0000 7fee5b716700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5415dfb0 con 0x7fee540ac570 2023-10-07T08:44:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.275+0000 7fee5b716700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee540acec0 con 0x7fee540ce5c0 2023-10-07T08:44:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.275+0000 7fee5b716700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540ad1a0 con 0x7fee540ce1f0 2023-10-07T08:44:23.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.276+0000 7fee59cb3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee540ac570 0x7fee5406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.276+0000 7fee59cb3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee540ac570 0x7fee5406e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48470/0 (socket says 172.21.15.81:48470) 2023-10-07T08:44:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.276+0000 7fee59cb3700 1 -- 172.21.15.81:0/1666553311 learned_addr learned my addr 172.21.15.81:0/1666553311 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.276+0000 7fee594b2700 1 --2- 172.21.15.81:0/1666553311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee540ce1f0 0x7fee540aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.276+0000 7fee58cb1700 1 --2- 172.21.15.81:0/1666553311 >> v2:172.21.15.89:3300/0 conn(0x7fee540ce5c0 0x7fee5415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.276+0000 7fee59cb3700 1 -- 172.21.15.81:0/1666553311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee540ce1f0 msgr2=0x7fee540aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.276+0000 7fee59cb3700 1 --2- 172.21.15.81:0/1666553311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee540ce1f0 0x7fee540aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.276+0000 7fee59cb3700 1 -- 172.21.15.81:0/1666553311 >> v2:172.21.15.89:3300/0 conn(0x7fee540ce5c0 msgr2=0x7fee5415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.276+0000 7fee59cb3700 1 --2- 172.21.15.81:0/1666553311 >> v2:172.21.15.89:3300/0 conn(0x7fee540ce5c0 0x7fee5415e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.276+0000 7fee59cb3700 1 -- 172.21.15.81:0/1666553311 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5415dc40 con 0x7fee540ac570 2023-10-07T08:44:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.276+0000 7fee59cb3700 1 --2- 172.21.15.81:0/1666553311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee540ac570 0x7fee5406e230 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fee54071580 tx=0x7fee4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d484d33167b98d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.276+0000 7fee4bfff700 1 -- 172.21.15.81:0/1666553311 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c00e070 con 0x7fee540ac570 2023-10-07T08:44:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.276+0000 7fee4bfff700 1 -- 172.21.15.81:0/1666553311 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c00b970 con 0x7fee540ac570 2023-10-07T08:44:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.276+0000 7fee4bfff700 1 -- 172.21.15.81:0/1666553311 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c0092e0 con 0x7fee540ac570 2023-10-07T08:44:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.277+0000 7fee5b716700 1 -- 172.21.15.81:0/1666553311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee540ac570 msgr2=0x7fee5406e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.277+0000 7fee5b716700 1 --2- 172.21.15.81:0/1666553311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee540ac570 0x7fee5406e230 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fee54071580 tx=0x7fee4c009840 comp rx=0 tx=0).stop 2023-10-07T08:44:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.277+0000 7fee5b716700 1 -- 172.21.15.81:0/1666553311 shutdown_connections 2023-10-07T08:44:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.277+0000 7fee5b716700 1 --2- 172.21.15.81:0/1666553311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee540ac570 0x7fee5406e230 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.277+0000 7fee5b716700 1 --2- 172.21.15.81:0/1666553311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee540ce1f0 0x7fee540aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.277+0000 7fee5b716700 1 --2- 172.21.15.81:0/1666553311 >> v2:172.21.15.89:3300/0 conn(0x7fee540ce5c0 0x7fee5415e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.277+0000 7fee5b716700 1 -- 172.21.15.81:0/1666553311 >> 172.21.15.81:0/1666553311 conn(0x7fee5406cca0 msgr2=0x7fee5406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.277+0000 7fee5b716700 1 -- 172.21.15.81:0/1666553311 shutdown_connections 2023-10-07T08:44:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.277+0000 7fee5b716700 1 -- 172.21.15.81:0/1666553311 wait complete. 2023-10-07T08:44:23.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.278+0000 7fee5b716700 1 Processor -- start 2023-10-07T08:44:23.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.278+0000 7fee5b716700 1 -- start start 2023-10-07T08:44:23.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee5b716700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee540ac570 0x7fee540af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:23.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee5b716700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee540ce1f0 0x7fee54155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:23.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee5b716700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee540ce5c0 0x7fee5416a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:23.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee5b716700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540aebc0 con 0x7fee540ce5c0 2023-10-07T08:44:23.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee5b716700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540adfb0 con 0x7fee540ac570 2023-10-07T08:44:23.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee5b716700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540ae290 con 0x7fee540ce1f0 2023-10-07T08:44:23.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee59cb3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee540ce5c0 0x7fee5416a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee59cb3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee540ce5c0 0x7fee5416a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48486/0 (socket says 172.21.15.81:48486) 2023-10-07T08:44:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee59cb3700 1 -- 172.21.15.81:0/2628771580 learned_addr learned my addr 172.21.15.81:0/2628771580 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee594b2700 1 --2- 172.21.15.81:0/2628771580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee540ac570 0x7fee540af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee58cb1700 1 --2- 172.21.15.81:0/2628771580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee540ce1f0 0x7fee54155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee59cb3700 1 -- 172.21.15.81:0/2628771580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee540ce1f0 msgr2=0x7fee54155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee59cb3700 1 --2- 172.21.15.81:0/2628771580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee540ce1f0 0x7fee54155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee59cb3700 1 -- 172.21.15.81:0/2628771580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee540ac570 msgr2=0x7fee540af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee59cb3700 1 --2- 172.21.15.81:0/2628771580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee540ac570 0x7fee540af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee59cb3700 1 -- 172.21.15.81:0/2628771580 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c009ae0 con 0x7fee540ce5c0 2023-10-07T08:44:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee59cb3700 1 --2- 172.21.15.81:0/2628771580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee540ce5c0 0x7fee5416a300 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fee5406cc70 tx=0x7fee4c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee497fa700 1 -- 172.21.15.81:0/2628771580 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c008ad0 con 0x7fee540ce5c0 2023-10-07T08:44:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee497fa700 1 -- 172.21.15.81:0/2628771580 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c008c50 con 0x7fee540ce5c0 2023-10-07T08:44:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee5b716700 1 -- 172.21.15.81:0/2628771580 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee540ae570 con 0x7fee540ce5c0 2023-10-07T08:44:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee497fa700 1 -- 172.21.15.81:0/2628771580 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c01c410 con 0x7fee540ce5c0 2023-10-07T08:44:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.279+0000 7fee5b716700 1 -- 172.21.15.81:0/2628771580 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee540af590 con 0x7fee540ce5c0 2023-10-07T08:44:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.280+0000 7fee5b716700 1 -- 172.21.15.81:0/2628771580 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee540aed70 con 0x7fee540ce5c0 2023-10-07T08:44:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.281+0000 7fee497fa700 1 -- 172.21.15.81:0/2628771580 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee4c003040 con 0x7fee540ce5c0 2023-10-07T08:44:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.281+0000 7fee497fa700 1 --2- 172.21.15.81:0/2628771580 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee38066f30 0x7fee380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.281+0000 7fee497fa700 1 -- 172.21.15.81:0/2628771580 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee4c085a90 con 0x7fee540ce5c0 2023-10-07T08:44:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.281+0000 7fee594b2700 1 --2- 172.21.15.81:0/2628771580 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee38066f30 0x7fee380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.282+0000 7fee594b2700 1 --2- 172.21.15.81:0/2628771580 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee38066f30 0x7fee380693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fee50009db0 tx=0x7fee500091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.285+0000 7fee497fa700 1 -- 172.21.15.81:0/2628771580 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee540aed70 con 0x7fee540ce5c0 2023-10-07T08:44:23.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.464+0000 7fee5b716700 1 -- 172.21.15.81:0/2628771580 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fee540aed70 con 0x7fee38066f30 2023-10-07T08:44:23.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.472+0000 7fee497fa700 1 -- 172.21.15.81:0/2628771580 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284818 (secure 0 0 0) 0x7fee540aed70 con 0x7fee38066f30 2023-10-07T08:44:23.477 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:23.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.476+0000 7fee5b716700 1 -- 172.21.15.81:0/2628771580 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee38066f30 msgr2=0x7fee380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:23.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.476+0000 7fee5b716700 1 --2- 172.21.15.81:0/2628771580 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee38066f30 0x7fee380693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fee50009db0 tx=0x7fee500091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.476+0000 7fee5b716700 1 -- 172.21.15.81:0/2628771580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee540ce5c0 msgr2=0x7fee5416a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.476+0000 7fee5b716700 1 --2- 172.21.15.81:0/2628771580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee540ce5c0 0x7fee5416a300 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fee5406cc70 tx=0x7fee4c018000 comp rx=0 tx=0).stop 2023-10-07T08:44:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.476+0000 7fee5b716700 1 -- 172.21.15.81:0/2628771580 shutdown_connections 2023-10-07T08:44:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.476+0000 7fee5b716700 1 --2- 172.21.15.81:0/2628771580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee540ce5c0 0x7fee5416a300 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.476+0000 7fee5b716700 1 --2- 172.21.15.81:0/2628771580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee540ac570 0x7fee540af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.476+0000 7fee5b716700 1 --2- 172.21.15.81:0/2628771580 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee38066f30 0x7fee380693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.476+0000 7fee5b716700 1 --2- 172.21.15.81:0/2628771580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee540ce1f0 0x7fee54155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.476+0000 7fee5b716700 1 -- 172.21.15.81:0/2628771580 >> 172.21.15.81:0/2628771580 conn(0x7fee5406cca0 msgr2=0x7fee540b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.476+0000 7fee5b716700 1 -- 172.21.15.81:0/2628771580 shutdown_connections 2023-10-07T08:44:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.476+0000 7fee5b716700 1 -- 172.21.15.81:0/2628771580 wait complete. 2023-10-07T08:44:23.480 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:44:23.489 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2023-10-07T08:44:22.022918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2834,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559665,"statfs":{"total":1600000000,"available":1597097275,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.608640"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438925+0000","last_change":"2023-10-07T08:44:19.438925+0000","last_active":"2023-10-07T08:44:19.438925+0000","last_peered":"2023-10-07T08:44:19.438925+0000","last_clean":"2023-10-07T08:44:19.438925+0000","last_became_active":"2023-10-07T08:44:19.438371+0000","last_became_peered":"2023-10-07T08:44:19.438371+0000","last_unstale":"2023-10-07T08:44:19.438925+0000","last_undegraded":"2023-10-07T08:44:19.438925+0000","last_fullsized":"2023-10-07T08:44:19.438925+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:50:08.318385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.436652+0000","last_change":"2023-10-07T08:44:19.436652+0000","last_active":"2023-10-07T08:44:19.436652+0000","last_peered":"2023-10-07T08:44:19.436652+0000","last_clean":"2023-10-07T08:44:19.436652+0000","last_became_active":"2023-10-07T08:44:19.435434+0000","last_became_peered":"2023-10-07T08:44:19.435434+0000","last_unstale":"2023-10-07T08:44:19.436652+0000","last_undegraded":"2023-10-07T08:44:19.436652+0000","last_fullsized":"2023-10-07T08:44:19.436652+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:08.157631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438728+0000","last_change":"2023-10-07T08:44:19.438728+0000","last_active":"2023-10-07T08:44:19.438728+0000","last_peered":"2023-10-07T08:44:19.438728+0000","last_clean":"2023-10-07T08:44:19.438728+0000","last_became_active":"2023-10-07T08:44:19.438322+0000","last_became_peered":"2023-10-07T08:44:19.438322+0000","last_unstale":"2023-10-07T08:44:19.438728+0000","last_undegraded":"2023-10-07T08:44:19.438728+0000","last_fullsized":"2023-10-07T08:44:19.438728+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:21:05.206733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.441286+0000","last_change":"2023-10-07T08:44:19.441286+0000","last_active":"2023-10-07T08:44:19.441286+0000","last_peered":"2023-10-07T08:44:19.441286+0000","last_clean":"2023-10-07T08:44:19.441286+0000","last_became_active":"2023-10-07T08:44:19.440997+0000","last_became_peered":"2023-10-07T08:44:19.440997+0000","last_unstale":"2023-10-07T08:44:19.441286+0000","last_undegraded":"2023-10-07T08:44:19.441286+0000","last_fullsized":"2023-10-07T08:44:19.441286+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:08.157631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.444908+0000","last_change":"2023-10-07T08:44:19.444908+0000","last_active":"2023-10-07T08:44:19.444908+0000","last_peered":"2023-10-07T08:44:19.444908+0000","last_clean":"2023-10-07T08:44:19.444908+0000","last_became_active":"2023-10-07T08:44:19.444684+0000","last_became_peered":"2023-10-07T08:44:19.444684+0000","last_unstale":"2023-10-07T08:44:19.444908+0000","last_undegraded":"2023-10-07T08:44:19.444908+0000","last_fullsized":"2023-10-07T08:44:19.444908+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:27.368132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438236+0000","last_change":"2023-10-07T08:44:19.438236+0000","last_active":"2023-10-07T08:44:19.438236+0000","last_peered":"2023-10-07T08:44:19.438236+0000","last_clean":"2023-10-07T08:44:19.438236+0000","last_became_active":"2023-10-07T08:44:19.437803+0000","last_became_peered":"2023-10-07T08:44:19.437803+0000","last_unstale":"2023-10-07T08:44:19.438236+0000","last_undegraded":"2023-10-07T08:44:19.438236+0000","last_fullsized":"2023-10-07T08:44:19.438236+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:06:27.466043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437000+0000","last_change":"2023-10-07T08:44:19.437000+0000","last_active":"2023-10-07T08:44:19.437000+0000","last_peered":"2023-10-07T08:44:19.437000+0000","last_clean":"2023-10-07T08:44:19.437000+0000","last_became_active":"2023-10-07T08:44:19.436754+0000","last_became_peered":"2023-10-07T08:44:19.436754+0000","last_unstale":"2023-10-07T08:44:19.437000+0000","last_undegraded":"2023-10-07T08:44:19.437000+0000","last_fullsized":"2023-10-07T08:44:19.437000+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:08.157631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.435895+0000","last_change":"2023-10-07T08:44:19.435895+0000","last_active":"2023-10-07T08:44:19.435895+0000","last_peered":"2023-10-07T08:44:19.435895+0000","last_clean":"2023-10-07T08:44:19.435895+0000","last_became_active":"2023-10-07T08:44:19.435631+0000","last_became_peered":"2023-10-07T08:44:19.435631+0000","last_unstale":"2023-10-07T08:44:19.435895+0000","last_undegraded":"2023-10-07T08:44:19.435895+0000","last_fullsized":"2023-10-07T08:44:19.435895+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:41:49.752256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.436802+0000","last_change":"2023-10-07T08:44:19.436802+0000","last_active":"2023-10-07T08:44:19.436802+0000","last_peered":"2023-10-07T08:44:19.436802+0000","last_clean":"2023-10-07T08:44:19.436802+0000","last_became_active":"2023-10-07T08:44:19.436500+0000","last_became_peered":"2023-10-07T08:44:19.436500+0000","last_unstale":"2023-10-07T08:44:19.436802+0000","last_undegraded":"2023-10-07T08:44:19.436802+0000","last_fullsized":"2023-10-07T08:44:19.436802+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:44:44.640310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.443755+0000","last_change":"2023-10-07T08:44:19.443755+0000","last_active":"2023-10-07T08:44:19.443755+0000","last_peered":"2023-10-07T08:44:19.443755+0000","last_clean":"2023-10-07T08:44:19.443755+0000","last_became_active":"2023-10-07T08:44:19.442873+0000","last_became_peered":"2023-10-07T08:44:19.442873+0000","last_unstale":"2023-10-07T08:44:19.443755+0000","last_undegraded":"2023-10-07T08:44:19.443755+0000","last_fullsized":"2023-10-07T08:44:19.443755+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:24:21.981463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.433912+0000","last_change":"2023-10-07T08:44:19.433912+0000","last_active":"2023-10-07T08:44:19.433912+0000","last_peered":"2023-10-07T08:44:19.433912+0000","last_clean":"2023-10-07T08:44:19.433912+0000","last_became_active":"2023-10-07T08:44:19.433758+0000","last_became_peered":"2023-10-07T08:44:19.433758+0000","last_unstale":"2023-10-07T08:44:19.433912+0000","last_undegraded":"2023-10-07T08:44:19.433912+0000","last_fullsized":"2023-10-07T08:44:19.433912+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:26:34.170132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.433931+0000","last_change":"2023-10-07T08:44:19.433931+0000","last_active":"2023-10-07T08:44:19.433931+0000","last_peered":"2023-10-07T08:44:19.433931+0000","last_clean":"2023-10-07T08:44:19.433931+0000","last_became_active":"2023-10-07T08:44:19.433608+0000","last_became_peered":"2023-10-07T08:44:19.433608+0000","last_unstale":"2023-10-07T08:44:19.433931+0000","last_undegraded":"2023-10-07T08:44:19.433931+0000","last_fullsized":"2023-10-07T08:44:19.433931+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:22:46.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.428825+0000","last_change":"2023-10-07T08:44:19.428825+0000","last_active":"2023-10-07T08:44:19.428825+0000","last_peered":"2023-10-07T08:44:19.428825+0000","last_clean":"2023-10-07T08:44:19.428825+0000","last_became_active":"2023-10-07T08:44:19.428607+0000","last_became_peered":"2023-10-07T08:44:19.428607+0000","last_unstale":"2023-10-07T08:44:19.428825+0000","last_undegraded":"2023-10-07T08:44:19.428825+0000","last_fullsized":"2023-10-07T08:44:19.428825+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:49.691282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.436667+0000","last_change":"2023-10-07T08:44:19.436667+0000","last_active":"2023-10-07T08:44:19.436667+0000","last_peered":"2023-10-07T08:44:19.436667+0000","last_clean":"2023-10-07T08:44:19.436667+0000","last_became_active":"2023-10-07T08:44:19.436220+0000","last_became_peered":"2023-10-07T08:44:19.436220+0000","last_unstale":"2023-10-07T08:44:19.436667+0000","last_undegraded":"2023-10-07T08:44:19.436667+0000","last_fullsized":"2023-10-07T08:44:19.436667+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:22:46.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434405+0000","last_change":"2023-10-07T08:44:19.434405+0000","last_active":"2023-10-07T08:44:19.434405+0000","last_peered":"2023-10-07T08:44:19.434405+0000","last_clean":"2023-10-07T08:44:19.434405+0000","last_became_active":"2023-10-07T08:44:19.434185+0000","last_became_peered":"2023-10-07T08:44:19.434185+0000","last_unstale":"2023-10-07T08:44:19.434405+0000","last_undegraded":"2023-10-07T08:44:19.434405+0000","last_fullsized":"2023-10-07T08:44:19.434405+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:40:00.233375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.439392+0000","last_change":"2023-10-07T08:44:19.439392+0000","last_active":"2023-10-07T08:44:19.439392+0000","last_peered":"2023-10-07T08:44:19.439392+0000","last_clean":"2023-10-07T08:44:19.439392+0000","last_became_active":"2023-10-07T08:44:19.439043+0000","last_became_peered":"2023-10-07T08:44:19.439043+0000","last_unstale":"2023-10-07T08:44:19.439392+0000","last_undegraded":"2023-10-07T08:44:19.439392+0000","last_fullsized":"2023-10-07T08:44:19.439392+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:34:00.732970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437711+0000","last_change":"2023-10-07T08:44:19.437711+0000","last_active":"2023-10-07T08:44:19.437711+0000","last_peered":"2023-10-07T08:44:19.437711+0000","last_clean":"2023-10-07T08:44:19.437711+0000","last_became_active":"2023-10-07T08:44:19.437236+0000","last_became_peered":"2023-10-07T08:44:19.437236+0000","last_unstale":"2023-10-07T08:44:19.437711+0000","last_undegraded":"2023-10-07T08:44:19.437711+0000","last_fullsized":"2023-10-07T08:44:19.437711+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:40:16.929872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438562+0000","last_change":"2023-10-07T08:44:19.438562+0000","last_active":"2023-10-07T08:44:19.438562+0000","last_peered":"2023-10-07T08:44:19.438562+0000","last_clean":"2023-10-07T08:44:19.438562+0000","last_became_active":"2023-10-07T08:44:19.437714+0000","last_became_peered":"2023-10-07T08:44:19.437714+0000","last_unstale":"2023-10-07T08:44:19.438562+0000","last_undegraded":"2023-10-07T08:44:19.438562+0000","last_fullsized":"2023-10-07T08:44:19.438562+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:26:34.170132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437506+0000","last_change":"2023-10-07T08:44:19.437506+0000","last_active":"2023-10-07T08:44:19.437506+0000","last_peered":"2023-10-07T08:44:19.437506+0000","last_clean":"2023-10-07T08:44:19.437506+0000","last_became_active":"2023-10-07T08:44:19.437259+0000","last_became_peered":"2023-10-07T08:44:19.437259+0000","last_unstale":"2023-10-07T08:44:19.437506+0000","last_undegraded":"2023-10-07T08:44:19.437506+0000","last_fullsized":"2023-10-07T08:44:19.437506+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:55:19.127969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.442426+0000","last_change":"2023-10-07T08:44:19.442426+0000","last_active":"2023-10-07T08:44:19.442426+0000","last_peered":"2023-10-07T08:44:19.442426+0000","last_clean":"2023-10-07T08:44:19.442426+0000","last_became_active":"2023-10-07T08:44:19.442188+0000","last_became_peered":"2023-10-07T08:44:19.442188+0000","last_unstale":"2023-10-07T08:44:19.442426+0000","last_undegraded":"2023-10-07T08:44:19.442426+0000","last_fullsized":"2023-10-07T08:44:19.442426+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:23.798374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437996+0000","last_change":"2023-10-07T08:44:19.437996+0000","last_active":"2023-10-07T08:44:19.437996+0000","last_peered":"2023-10-07T08:44:19.437996+0000","last_clean":"2023-10-07T08:44:19.437996+0000","last_became_active":"2023-10-07T08:44:19.436968+0000","last_became_peered":"2023-10-07T08:44:19.436968+0000","last_unstale":"2023-10-07T08:44:19.437996+0000","last_undegraded":"2023-10-07T08:44:19.437996+0000","last_fullsized":"2023-10-07T08:44:19.437996+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:04:34.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.440033+0000","last_change":"2023-10-07T08:44:19.440033+0000","last_active":"2023-10-07T08:44:19.440033+0000","last_peered":"2023-10-07T08:44:19.440033+0000","last_clean":"2023-10-07T08:44:19.440033+0000","last_became_active":"2023-10-07T08:44:19.439797+0000","last_became_peered":"2023-10-07T08:44:19.439797+0000","last_unstale":"2023-10-07T08:44:19.440033+0000","last_undegraded":"2023-10-07T08:44:19.440033+0000","last_fullsized":"2023-10-07T08:44:19.440033+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:30.407673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434038+0000","last_change":"2023-10-07T08:44:19.434038+0000","last_active":"2023-10-07T08:44:19.434038+0000","last_peered":"2023-10-07T08:44:19.434038+0000","last_clean":"2023-10-07T08:44:19.434038+0000","last_became_active":"2023-10-07T08:44:19.433070+0000","last_became_peered":"2023-10-07T08:44:19.433070+0000","last_unstale":"2023-10-07T08:44:19.434038+0000","last_undegraded":"2023-10-07T08:44:19.434038+0000","last_fullsized":"2023-10-07T08:44:19.434038+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:07:35.252087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.433433+0000","last_change":"2023-10-07T08:44:19.433433+0000","last_active":"2023-10-07T08:44:19.433433+0000","last_peered":"2023-10-07T08:44:19.433433+0000","last_clean":"2023-10-07T08:44:19.433433+0000","last_became_active":"2023-10-07T08:44:19.432938+0000","last_became_peered":"2023-10-07T08:44:19.432938+0000","last_unstale":"2023-10-07T08:44:19.433433+0000","last_undegraded":"2023-10-07T08:44:19.433433+0000","last_fullsized":"2023-10-07T08:44:19.433433+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:55:48.683261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438926+0000","last_change":"2023-10-07T08:44:19.438926+0000","last_active":"2023-10-07T08:44:19.438926+0000","last_peered":"2023-10-07T08:44:19.438926+0000","last_clean":"2023-10-07T08:44:19.438926+0000","last_became_active":"2023-10-07T08:44:19.438710+0000","last_became_peered":"2023-10-07T08:44:19.438710+0000","last_unstale":"2023-10-07T08:44:19.438926+0000","last_undegraded":"2023-10-07T08:44:19.438926+0000","last_fullsized":"2023-10-07T08:44:19.438926+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:49:42.089780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434177+0000","last_change":"2023-10-07T08:44:19.434177+0000","last_active":"2023-10-07T08:44:19.434177+0000","last_peered":"2023-10-07T08:44:19.434177+0000","last_clean":"2023-10-07T08:44:19.434177+0000","last_became_active":"2023-10-07T08:44:19.433855+0000","last_became_peered":"2023-10-07T08:44:19.433855+0000","last_unstale":"2023-10-07T08:44:19.434177+0000","last_undegraded":"2023-10-07T08:44:19.434177+0000","last_fullsized":"2023-10-07T08:44:19.434177+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:44:34.902336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437576+0000","last_change":"2023-10-07T08:44:19.437576+0000","last_active":"2023-10-07T08:44:19.437576+0000","last_peered":"2023-10-07T08:44:19.437576+0000","last_clean":"2023-10-07T08:44:19.437576+0000","last_became_active":"2023-10-07T08:44:19.436918+0000","last_became_peered":"2023-10-07T08:44:19.436918+0000","last_unstale":"2023-10-07T08:44:19.437576+0000","last_undegraded":"2023-10-07T08:44:19.437576+0000","last_fullsized":"2023-10-07T08:44:19.437576+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:12.227434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.432570+0000","last_change":"2023-10-07T08:44:19.432570+0000","last_active":"2023-10-07T08:44:19.432570+0000","last_peered":"2023-10-07T08:44:19.432570+0000","last_clean":"2023-10-07T08:44:19.432570+0000","last_became_active":"2023-10-07T08:44:19.431913+0000","last_became_peered":"2023-10-07T08:44:19.431913+0000","last_unstale":"2023-10-07T08:44:19.432570+0000","last_undegraded":"2023-10-07T08:44:19.432570+0000","last_fullsized":"2023-10-07T08:44:19.432570+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:45:58.316227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.439971+0000","last_change":"2023-10-07T08:44:19.439971+0000","last_active":"2023-10-07T08:44:19.439971+0000","last_peered":"2023-10-07T08:44:19.439971+0000","last_clean":"2023-10-07T08:44:19.439971+0000","last_became_active":"2023-10-07T08:44:19.439785+0000","last_became_peered":"2023-10-07T08:44:19.439785+0000","last_unstale":"2023-10-07T08:44:19.439971+0000","last_undegraded":"2023-10-07T08:44:19.439971+0000","last_fullsized":"2023-10-07T08:44:19.439971+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:41:03.873418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.435910+0000","last_change":"2023-10-07T08:44:19.435910+0000","last_active":"2023-10-07T08:44:19.435910+0000","last_peered":"2023-10-07T08:44:19.435910+0000","last_clean":"2023-10-07T08:44:19.435910+0000","last_became_active":"2023-10-07T08:44:19.430945+0000","last_became_peered":"2023-10-07T08:44:19.430945+0000","last_unstale":"2023-10-07T08:44:19.435910+0000","last_undegraded":"2023-10-07T08:44:19.435910+0000","last_fullsized":"2023-10-07T08:44:19.435910+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:36.300770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.429543+0000","last_change":"2023-10-07T08:44:19.429543+0000","last_active":"2023-10-07T08:44:19.429543+0000","last_peered":"2023-10-07T08:44:19.429543+0000","last_clean":"2023-10-07T08:44:19.429543+0000","last_became_active":"2023-10-07T08:44:19.429319+0000","last_became_peered":"2023-10-07T08:44:19.429319+0000","last_unstale":"2023-10-07T08:44:19.429543+0000","last_undegraded":"2023-10-07T08:44:19.429543+0000","last_fullsized":"2023-10-07T08:44:19.429543+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:07.584019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437606+0000","last_change":"2023-10-07T08:44:19.437606+0000","last_active":"2023-10-07T08:44:19.437606+0000","last_peered":"2023-10-07T08:44:19.437606+0000","last_clean":"2023-10-07T08:44:19.437606+0000","last_became_active":"2023-10-07T08:44:19.434901+0000","last_became_peered":"2023-10-07T08:44:19.434901+0000","last_unstale":"2023-10-07T08:44:19.437606+0000","last_undegraded":"2023-10-07T08:44:19.437606+0000","last_fullsized":"2023-10-07T08:44:19.437606+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:09.985496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437201+0000","last_change":"2023-10-07T08:44:19.437201+0000","last_active":"2023-10-07T08:44:19.437201+0000","last_peered":"2023-10-07T08:44:19.437201+0000","last_clean":"2023-10-07T08:44:19.437201+0000","last_became_active":"2023-10-07T08:44:19.436988+0000","last_became_peered":"2023-10-07T08:44:19.436988+0000","last_unstale":"2023-10-07T08:44:19.437201+0000","last_undegraded":"2023-10-07T08:44:19.437201+0000","last_fullsized":"2023-10-07T08:44:19.437201+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:36.300770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.446920+0000","last_change":"2023-10-07T08:44:18.436107+0000","last_active":"2023-10-07T08:44:19.446920+0000","last_peered":"2023-10-07T08:44:19.446920+0000","last_clean":"2023-10-07T08:44:19.446920+0000","last_became_active":"2023-10-07T08:44:18.434726+0000","last_became_peered":"2023-10-07T08:44:18.434726+0000","last_unstale":"2023-10-07T08:44:19.446920+0000","last_undegraded":"2023-10-07T08:44:19.446920+0000","last_fullsized":"2023-10-07T08:44:19.446920+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:22:29.226194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434891+0000","last_change":"2023-10-07T08:44:19.434891+0000","last_active":"2023-10-07T08:44:19.434891+0000","last_peered":"2023-10-07T08:44:19.434891+0000","last_clean":"2023-10-07T08:44:19.434891+0000","last_became_active":"2023-10-07T08:44:19.434402+0000","last_became_peered":"2023-10-07T08:44:19.434402+0000","last_unstale":"2023-10-07T08:44:19.434891+0000","last_undegraded":"2023-10-07T08:44:19.434891+0000","last_fullsized":"2023-10-07T08:44:19.434891+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:10:45.644394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.429115+0000","last_change":"2023-10-07T08:44:18.435510+0000","last_active":"2023-10-07T08:44:19.429115+0000","last_peered":"2023-10-07T08:44:19.429115+0000","last_clean":"2023-10-07T08:44:19.429115+0000","last_became_active":"2023-10-07T08:44:18.435264+0000","last_became_peered":"2023-10-07T08:44:18.435264+0000","last_unstale":"2023-10-07T08:44:19.429115+0000","last_undegraded":"2023-10-07T08:44:19.429115+0000","last_fullsized":"2023-10-07T08:44:19.429115+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:22:10.385544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.435659+0000","last_change":"2023-10-07T08:44:19.435659+0000","last_active":"2023-10-07T08:44:19.435659+0000","last_peered":"2023-10-07T08:44:19.435659+0000","last_clean":"2023-10-07T08:44:19.435659+0000","last_became_active":"2023-10-07T08:44:19.434752+0000","last_became_peered":"2023-10-07T08:44:19.434752+0000","last_unstale":"2023-10-07T08:44:19.435659+0000","last_undegraded":"2023-10-07T08:44:19.435659+0000","last_fullsized":"2023-10-07T08:44:19.435659+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:44:44.640310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.445367+0000","last_change":"2023-10-07T08:44:18.428408+0000","last_active":"2023-10-07T08:44:19.445367+0000","last_peered":"2023-10-07T08:44:19.445367+0000","last_clean":"2023-10-07T08:44:19.445367+0000","last_became_active":"2023-10-07T08:44:18.427721+0000","last_became_peered":"2023-10-07T08:44:18.427721+0000","last_unstale":"2023-10-07T08:44:19.445367+0000","last_undegraded":"2023-10-07T08:44:19.445367+0000","last_fullsized":"2023-10-07T08:44:19.445367+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:33:59.724107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438841+0000","last_change":"2023-10-07T08:44:19.438841+0000","last_active":"2023-10-07T08:44:19.438841+0000","last_peered":"2023-10-07T08:44:19.438841+0000","last_clean":"2023-10-07T08:44:19.438841+0000","last_became_active":"2023-10-07T08:44:19.438618+0000","last_became_peered":"2023-10-07T08:44:19.438618+0000","last_unstale":"2023-10-07T08:44:19.438841+0000","last_undegraded":"2023-10-07T08:44:19.438841+0000","last_fullsized":"2023-10-07T08:44:19.438841+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:37:00.692341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.445327+0000","last_change":"2023-10-07T08:44:18.426995+0000","last_active":"2023-10-07T08:44:19.445327+0000","last_peered":"2023-10-07T08:44:19.445327+0000","last_clean":"2023-10-07T08:44:19.445327+0000","last_became_active":"2023-10-07T08:44:18.426775+0000","last_became_peered":"2023-10-07T08:44:18.426775+0000","last_unstale":"2023-10-07T08:44:19.445327+0000","last_undegraded":"2023-10-07T08:44:19.445327+0000","last_fullsized":"2023-10-07T08:44:19.445327+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:29.398810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437946+0000","last_change":"2023-10-07T08:44:19.437946+0000","last_active":"2023-10-07T08:44:19.437946+0000","last_peered":"2023-10-07T08:44:19.437946+0000","last_clean":"2023-10-07T08:44:19.437946+0000","last_became_active":"2023-10-07T08:44:19.436768+0000","last_became_peered":"2023-10-07T08:44:19.436768+0000","last_unstale":"2023-10-07T08:44:19.437946+0000","last_undegraded":"2023-10-07T08:44:19.437946+0000","last_fullsized":"2023-10-07T08:44:19.437946+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:37:00.692341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.425718+0000","last_change":"2023-10-07T08:44:18.425145+0000","last_active":"2023-10-07T08:44:19.425718+0000","last_peered":"2023-10-07T08:44:19.425718+0000","last_clean":"2023-10-07T08:44:19.425718+0000","last_became_active":"2023-10-07T08:44:18.424906+0000","last_became_peered":"2023-10-07T08:44:18.424906+0000","last_unstale":"2023-10-07T08:44:19.425718+0000","last_undegraded":"2023-10-07T08:44:19.425718+0000","last_fullsized":"2023-10-07T08:44:19.425718+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:24:20.972600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437969+0000","last_change":"2023-10-07T08:44:19.437969+0000","last_active":"2023-10-07T08:44:19.437969+0000","last_peered":"2023-10-07T08:44:19.437969+0000","last_clean":"2023-10-07T08:44:19.437969+0000","last_became_active":"2023-10-07T08:44:19.437598+0000","last_became_peered":"2023-10-07T08:44:19.437598+0000","last_unstale":"2023-10-07T08:44:19.437969+0000","last_undegraded":"2023-10-07T08:44:19.437969+0000","last_fullsized":"2023-10-07T08:44:19.437969+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:21:05.206733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.430053+0000","last_change":"2023-10-07T08:44:18.434610+0000","last_active":"2023-10-07T08:44:19.430053+0000","last_peered":"2023-10-07T08:44:19.430053+0000","last_clean":"2023-10-07T08:44:19.430053+0000","last_became_active":"2023-10-07T08:44:18.433934+0000","last_became_peered":"2023-10-07T08:44:18.433934+0000","last_unstale":"2023-10-07T08:44:19.430053+0000","last_undegraded":"2023-10-07T08:44:19.430053+0000","last_fullsized":"2023-10-07T08:44:19.430053+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:49:41.080917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.443578+0000","last_change":"2023-10-07T08:44:19.443578+0000","last_active":"2023-10-07T08:44:19.443578+0000","last_peered":"2023-10-07T08:44:19.443578+0000","last_clean":"2023-10-07T08:44:19.443578+0000","last_became_active":"2023-10-07T08:44:19.442577+0000","last_became_peered":"2023-10-07T08:44:19.442577+0000","last_unstale":"2023-10-07T08:44:19.443578+0000","last_undegraded":"2023-10-07T08:44:19.443578+0000","last_fullsized":"2023-10-07T08:44:19.443578+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:12.227434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.428859+0000","last_change":"2023-10-07T08:44:18.428768+0000","last_active":"2023-10-07T08:44:18.428859+0000","last_peered":"2023-10-07T08:44:18.428859+0000","last_clean":"2023-10-07T08:44:18.428859+0000","last_became_active":"2023-10-07T08:44:18.428531+0000","last_became_peered":"2023-10-07T08:44:18.428531+0000","last_unstale":"2023-10-07T08:44:18.428859+0000","last_undegraded":"2023-10-07T08:44:18.428859+0000","last_fullsized":"2023-10-07T08:44:18.428859+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:21:04.197869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.433241+0000","last_change":"2023-10-07T08:44:19.433241+0000","last_active":"2023-10-07T08:44:19.433241+0000","last_peered":"2023-10-07T08:44:19.433241+0000","last_clean":"2023-10-07T08:44:19.433241+0000","last_became_active":"2023-10-07T08:44:19.432650+0000","last_became_peered":"2023-10-07T08:44:19.432650+0000","last_unstale":"2023-10-07T08:44:19.433241+0000","last_undegraded":"2023-10-07T08:44:19.433241+0000","last_fullsized":"2023-10-07T08:44:19.433241+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:09.847735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.427222+0000","last_change":"2023-10-07T08:44:18.427027+0000","last_active":"2023-10-07T08:44:18.427222+0000","last_peered":"2023-10-07T08:44:18.427222+0000","last_clean":"2023-10-07T08:44:18.427222+0000","last_became_active":"2023-10-07T08:44:18.426543+0000","last_became_peered":"2023-10-07T08:44:18.426543+0000","last_unstale":"2023-10-07T08:44:18.427222+0000","last_undegraded":"2023-10-07T08:44:18.427222+0000","last_fullsized":"2023-10-07T08:44:18.427222+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:49:41.080917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.441079+0000","last_change":"2023-10-07T08:44:19.441079+0000","last_active":"2023-10-07T08:44:19.441079+0000","last_peered":"2023-10-07T08:44:19.441079+0000","last_clean":"2023-10-07T08:44:19.441079+0000","last_became_active":"2023-10-07T08:44:19.440928+0000","last_became_peered":"2023-10-07T08:44:19.440928+0000","last_unstale":"2023-10-07T08:44:19.441079+0000","last_undegraded":"2023-10-07T08:44:19.441079+0000","last_fullsized":"2023-10-07T08:44:19.441079+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:30.407673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.433673+0000","last_change":"2023-10-07T08:44:18.433605+0000","last_active":"2023-10-07T08:44:18.433673+0000","last_peered":"2023-10-07T08:44:18.433673+0000","last_clean":"2023-10-07T08:44:18.433673+0000","last_became_active":"2023-10-07T08:44:18.433319+0000","last_became_peered":"2023-10-07T08:44:18.433319+0000","last_unstale":"2023-10-07T08:44:18.433673+0000","last_undegraded":"2023-10-07T08:44:18.433673+0000","last_fullsized":"2023-10-07T08:44:18.433673+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:08.838872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438778+0000","last_change":"2023-10-07T08:44:19.438778+0000","last_active":"2023-10-07T08:44:19.438778+0000","last_peered":"2023-10-07T08:44:19.438778+0000","last_clean":"2023-10-07T08:44:19.438778+0000","last_became_active":"2023-10-07T08:44:19.438046+0000","last_became_peered":"2023-10-07T08:44:19.438046+0000","last_unstale":"2023-10-07T08:44:19.438778+0000","last_undegraded":"2023-10-07T08:44:19.438778+0000","last_fullsized":"2023-10-07T08:44:19.438778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:41:49.752256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.427006+0000","last_change":"2023-10-07T08:44:18.426945+0000","last_active":"2023-10-07T08:44:18.427006+0000","last_peered":"2023-10-07T08:44:18.427006+0000","last_clean":"2023-10-07T08:44:18.427006+0000","last_became_active":"2023-10-07T08:44:18.426713+0000","last_became_peered":"2023-10-07T08:44:18.426713+0000","last_unstale":"2023-10-07T08:44:18.427006+0000","last_undegraded":"2023-10-07T08:44:18.427006+0000","last_fullsized":"2023-10-07T08:44:18.427006+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:08.838872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.436667+0000","last_change":"2023-10-07T08:44:19.436667+0000","last_active":"2023-10-07T08:44:19.436667+0000","last_peered":"2023-10-07T08:44:19.436667+0000","last_clean":"2023-10-07T08:44:19.436667+0000","last_became_active":"2023-10-07T08:44:19.436434+0000","last_became_peered":"2023-10-07T08:44:19.436434+0000","last_unstale":"2023-10-07T08:44:19.436667+0000","last_undegraded":"2023-10-07T08:44:19.436667+0000","last_fullsized":"2023-10-07T08:44:19.436667+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:54:24.650234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.445051+0000","last_change":"2023-10-07T08:44:18.435518+0000","last_active":"2023-10-07T08:44:19.445051+0000","last_peered":"2023-10-07T08:44:19.445051+0000","last_clean":"2023-10-07T08:44:19.445051+0000","last_became_active":"2023-10-07T08:44:18.435329+0000","last_became_peered":"2023-10-07T08:44:18.435329+0000","last_unstale":"2023-10-07T08:44:19.445051+0000","last_undegraded":"2023-10-07T08:44:19.445051+0000","last_fullsized":"2023-10-07T08:44:19.445051+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:30:27.565764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434270+0000","last_change":"2023-10-07T08:44:19.434270+0000","last_active":"2023-10-07T08:44:19.434270+0000","last_peered":"2023-10-07T08:44:19.434270+0000","last_clean":"2023-10-07T08:44:19.434270+0000","last_became_active":"2023-10-07T08:44:19.433878+0000","last_became_peered":"2023-10-07T08:44:19.433878+0000","last_unstale":"2023-10-07T08:44:19.434270+0000","last_undegraded":"2023-10-07T08:44:19.434270+0000","last_fullsized":"2023-10-07T08:44:19.434270+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:44:44.640310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.447658+0000","last_change":"2023-10-07T08:44:18.426063+0000","last_active":"2023-10-07T08:44:19.447658+0000","last_peered":"2023-10-07T08:44:19.447658+0000","last_clean":"2023-10-07T08:44:19.447658+0000","last_became_active":"2023-10-07T08:44:18.425817+0000","last_became_peered":"2023-10-07T08:44:18.425817+0000","last_unstale":"2023-10-07T08:44:19.447658+0000","last_undegraded":"2023-10-07T08:44:19.447658+0000","last_fullsized":"2023-10-07T08:44:19.447658+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:11.306651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.439254+0000","last_change":"2023-10-07T08:44:19.439254+0000","last_active":"2023-10-07T08:44:19.439254+0000","last_peered":"2023-10-07T08:44:19.439254+0000","last_clean":"2023-10-07T08:44:19.439254+0000","last_became_active":"2023-10-07T08:44:19.438761+0000","last_became_peered":"2023-10-07T08:44:19.438761+0000","last_unstale":"2023-10-07T08:44:19.439254+0000","last_undegraded":"2023-10-07T08:44:19.439254+0000","last_fullsized":"2023-10-07T08:44:19.439254+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:25:17.903175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.448159+0000","last_change":"2023-10-07T08:44:18.427786+0000","last_active":"2023-10-07T08:44:19.448159+0000","last_peered":"2023-10-07T08:44:19.448159+0000","last_clean":"2023-10-07T08:44:19.448159+0000","last_became_active":"2023-10-07T08:44:18.427602+0000","last_became_peered":"2023-10-07T08:44:18.427602+0000","last_unstale":"2023-10-07T08:44:19.448159+0000","last_undegraded":"2023-10-07T08:44:19.448159+0000","last_fullsized":"2023-10-07T08:44:19.448159+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:47:50.282887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.443100+0000","last_change":"2023-10-07T08:44:19.443100+0000","last_active":"2023-10-07T08:44:19.443100+0000","last_peered":"2023-10-07T08:44:19.443100+0000","last_clean":"2023-10-07T08:44:19.443100+0000","last_became_active":"2023-10-07T08:44:19.441576+0000","last_became_peered":"2023-10-07T08:44:19.441576+0000","last_unstale":"2023-10-07T08:44:19.443100+0000","last_undegraded":"2023-10-07T08:44:19.443100+0000","last_fullsized":"2023-10-07T08:44:19.443100+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:37:00.692341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.429788+0000","last_change":"2023-10-07T08:44:18.429669+0000","last_active":"2023-10-07T08:44:18.429788+0000","last_peered":"2023-10-07T08:44:18.429788+0000","last_clean":"2023-10-07T08:44:18.429788+0000","last_became_active":"2023-10-07T08:44:18.429048+0000","last_became_peered":"2023-10-07T08:44:18.429048+0000","last_unstale":"2023-10-07T08:44:18.429788+0000","last_undegraded":"2023-10-07T08:44:18.429788+0000","last_fullsized":"2023-10-07T08:44:18.429788+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:11.218571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.432168+0000","last_change":"2023-10-07T08:44:19.432168+0000","last_active":"2023-10-07T08:44:19.432168+0000","last_peered":"2023-10-07T08:44:19.432168+0000","last_clean":"2023-10-07T08:44:19.432168+0000","last_became_active":"2023-10-07T08:44:19.431525+0000","last_became_peered":"2023-10-07T08:44:19.431525+0000","last_unstale":"2023-10-07T08:44:19.432168+0000","last_undegraded":"2023-10-07T08:44:19.432168+0000","last_fullsized":"2023-10-07T08:44:19.432168+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:49:48.932367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.427919+0000","last_change":"2023-10-07T08:44:18.427868+0000","last_active":"2023-10-07T08:44:18.427919+0000","last_peered":"2023-10-07T08:44:18.427919+0000","last_clean":"2023-10-07T08:44:18.427919+0000","last_became_active":"2023-10-07T08:44:18.427678+0000","last_became_peered":"2023-10-07T08:44:18.427678+0000","last_unstale":"2023-10-07T08:44:18.427919+0000","last_undegraded":"2023-10-07T08:44:18.427919+0000","last_fullsized":"2023-10-07T08:44:18.427919+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:11.218571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438068+0000","last_change":"2023-10-07T08:44:19.438068+0000","last_active":"2023-10-07T08:44:19.438068+0000","last_peered":"2023-10-07T08:44:19.438068+0000","last_clean":"2023-10-07T08:44:19.438068+0000","last_became_active":"2023-10-07T08:44:19.437835+0000","last_became_peered":"2023-10-07T08:44:19.437835+0000","last_unstale":"2023-10-07T08:44:19.438068+0000","last_undegraded":"2023-10-07T08:44:19.438068+0000","last_fullsized":"2023-10-07T08:44:19.438068+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:32:14.055400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.451962+0000","last_change":"2023-10-07T08:44:18.425654+0000","last_active":"2023-10-07T08:44:19.451962+0000","last_peered":"2023-10-07T08:44:19.451962+0000","last_clean":"2023-10-07T08:44:19.451962+0000","last_became_active":"2023-10-07T08:44:18.425405+0000","last_became_peered":"2023-10-07T08:44:18.425405+0000","last_unstale":"2023-10-07T08:44:19.451962+0000","last_undegraded":"2023-10-07T08:44:19.451962+0000","last_fullsized":"2023-10-07T08:44:19.451962+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:06:15.317486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434841+0000","last_change":"2023-10-07T08:44:19.434841+0000","last_active":"2023-10-07T08:44:19.434841+0000","last_peered":"2023-10-07T08:44:19.434841+0000","last_clean":"2023-10-07T08:44:19.434841+0000","last_became_active":"2023-10-07T08:44:19.434615+0000","last_became_peered":"2023-10-07T08:44:19.434615+0000","last_unstale":"2023-10-07T08:44:19.434841+0000","last_undegraded":"2023-10-07T08:44:19.434841+0000","last_fullsized":"2023-10-07T08:44:19.434841+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:26:31.716911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.429051+0000","last_change":"2023-10-07T08:44:18.424401+0000","last_active":"2023-10-07T08:44:19.429051+0000","last_peered":"2023-10-07T08:44:19.429051+0000","last_clean":"2023-10-07T08:44:19.429051+0000","last_became_active":"2023-10-07T08:44:18.424181+0000","last_became_peered":"2023-10-07T08:44:18.424181+0000","last_unstale":"2023-10-07T08:44:19.429051+0000","last_undegraded":"2023-10-07T08:44:19.429051+0000","last_fullsized":"2023-10-07T08:44:19.429051+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:00.333076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437425+0000","last_change":"2023-10-07T08:44:19.437425+0000","last_active":"2023-10-07T08:44:19.437425+0000","last_peered":"2023-10-07T08:44:19.437425+0000","last_clean":"2023-10-07T08:44:19.437425+0000","last_became_active":"2023-10-07T08:44:19.437187+0000","last_became_peered":"2023-10-07T08:44:19.437187+0000","last_unstale":"2023-10-07T08:44:19.437425+0000","last_undegraded":"2023-10-07T08:44:19.437425+0000","last_fullsized":"2023-10-07T08:44:19.437425+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:22:30.235057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.444530+0000","last_change":"2023-10-07T08:44:18.430989+0000","last_active":"2023-10-07T08:44:19.444530+0000","last_peered":"2023-10-07T08:44:19.444530+0000","last_clean":"2023-10-07T08:44:19.444530+0000","last_became_active":"2023-10-07T08:44:18.430711+0000","last_became_peered":"2023-10-07T08:44:18.430711+0000","last_unstale":"2023-10-07T08:44:19.444530+0000","last_undegraded":"2023-10-07T08:44:19.444530+0000","last_fullsized":"2023-10-07T08:44:19.444530+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:41:02.864555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.436458+0000","last_change":"2023-10-07T08:44:19.436458+0000","last_active":"2023-10-07T08:44:19.436458+0000","last_peered":"2023-10-07T08:44:19.436458+0000","last_clean":"2023-10-07T08:44:19.436458+0000","last_became_active":"2023-10-07T08:44:19.436208+0000","last_became_peered":"2023-10-07T08:44:19.436208+0000","last_unstale":"2023-10-07T08:44:19.436458+0000","last_undegraded":"2023-10-07T08:44:19.436458+0000","last_fullsized":"2023-10-07T08:44:19.436458+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:22:11.394408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.426889+0000","last_change":"2023-10-07T08:44:18.430319+0000","last_active":"2023-10-07T08:44:19.426889+0000","last_peered":"2023-10-07T08:44:19.426889+0000","last_clean":"2023-10-07T08:44:19.426889+0000","last_became_active":"2023-10-07T08:44:18.430026+0000","last_became_peered":"2023-10-07T08:44:18.430026+0000","last_unstale":"2023-10-07T08:44:19.426889+0000","last_undegraded":"2023-10-07T08:44:19.426889+0000","last_fullsized":"2023-10-07T08:44:19.426889+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:35.291907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434944+0000","last_change":"2023-10-07T08:44:19.434944+0000","last_active":"2023-10-07T08:44:19.434944+0000","last_peered":"2023-10-07T08:44:19.434944+0000","last_clean":"2023-10-07T08:44:19.434944+0000","last_became_active":"2023-10-07T08:44:19.434698+0000","last_became_peered":"2023-10-07T08:44:19.434698+0000","last_unstale":"2023-10-07T08:44:19.434944+0000","last_undegraded":"2023-10-07T08:44:19.434944+0000","last_fullsized":"2023-10-07T08:44:19.434944+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:05:50.770626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.433926+0000","last_change":"2023-10-07T08:44:18.433865+0000","last_active":"2023-10-07T08:44:18.433926+0000","last_peered":"2023-10-07T08:44:18.433926+0000","last_clean":"2023-10-07T08:44:18.433926+0000","last_became_active":"2023-10-07T08:44:18.433302+0000","last_became_peered":"2023-10-07T08:44:18.433302+0000","last_unstale":"2023-10-07T08:44:18.433926+0000","last_undegraded":"2023-10-07T08:44:18.433926+0000","last_fullsized":"2023-10-07T08:44:18.433926+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:26:33.161268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.430426+0000","last_change":"2023-10-07T08:44:19.430426+0000","last_active":"2023-10-07T08:44:19.430426+0000","last_peered":"2023-10-07T08:44:19.430426+0000","last_clean":"2023-10-07T08:44:19.430426+0000","last_became_active":"2023-10-07T08:44:19.430201+0000","last_became_peered":"2023-10-07T08:44:19.430201+0000","last_unstale":"2023-10-07T08:44:19.430426+0000","last_undegraded":"2023-10-07T08:44:19.430426+0000","last_fullsized":"2023-10-07T08:44:19.430426+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:52.382731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.446226+0000","last_change":"2023-10-07T08:44:18.427436+0000","last_active":"2023-10-07T08:44:19.446226+0000","last_peered":"2023-10-07T08:44:19.446226+0000","last_clean":"2023-10-07T08:44:19.446226+0000","last_became_active":"2023-10-07T08:44:18.427211+0000","last_became_peered":"2023-10-07T08:44:18.427211+0000","last_unstale":"2023-10-07T08:44:19.446226+0000","last_undegraded":"2023-10-07T08:44:19.446226+0000","last_fullsized":"2023-10-07T08:44:19.446226+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:35:42.498147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.433305+0000","last_change":"2023-10-07T08:44:19.433305+0000","last_active":"2023-10-07T08:44:19.433305+0000","last_peered":"2023-10-07T08:44:19.433305+0000","last_clean":"2023-10-07T08:44:19.433305+0000","last_became_active":"2023-10-07T08:44:19.433034+0000","last_became_peered":"2023-10-07T08:44:19.433034+0000","last_unstale":"2023-10-07T08:44:19.433305+0000","last_undegraded":"2023-10-07T08:44:19.433305+0000","last_fullsized":"2023-10-07T08:44:19.433305+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:21:05.206733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.436828+0000","last_change":"2023-10-07T08:44:18.436769+0000","last_active":"2023-10-07T08:44:18.436828+0000","last_peered":"2023-10-07T08:44:18.436828+0000","last_clean":"2023-10-07T08:44:18.436828+0000","last_became_active":"2023-10-07T08:44:18.436383+0000","last_became_peered":"2023-10-07T08:44:18.436383+0000","last_unstale":"2023-10-07T08:44:18.436828+0000","last_undegraded":"2023-10-07T08:44:18.436828+0000","last_fullsized":"2023-10-07T08:44:18.436828+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:36:59.683477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434293+0000","last_change":"2023-10-07T08:44:19.434293+0000","last_active":"2023-10-07T08:44:19.434293+0000","last_peered":"2023-10-07T08:44:19.434293+0000","last_clean":"2023-10-07T08:44:19.434293+0000","last_became_active":"2023-10-07T08:44:19.434041+0000","last_became_peered":"2023-10-07T08:44:19.434041+0000","last_unstale":"2023-10-07T08:44:19.434293+0000","last_undegraded":"2023-10-07T08:44:19.434293+0000","last_fullsized":"2023-10-07T08:44:19.434293+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:27:43.062347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.427238+0000","last_change":"2023-10-07T08:44:18.427153+0000","last_active":"2023-10-07T08:44:18.427238+0000","last_peered":"2023-10-07T08:44:18.427238+0000","last_clean":"2023-10-07T08:44:18.427238+0000","last_became_active":"2023-10-07T08:44:18.426820+0000","last_became_peered":"2023-10-07T08:44:18.426820+0000","last_unstale":"2023-10-07T08:44:18.427238+0000","last_undegraded":"2023-10-07T08:44:18.427238+0000","last_fullsized":"2023-10-07T08:44:18.427238+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:22:10.385544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.443240+0000","last_change":"2023-10-07T08:44:19.443240+0000","last_active":"2023-10-07T08:44:19.443240+0000","last_peered":"2023-10-07T08:44:19.443240+0000","last_clean":"2023-10-07T08:44:19.443240+0000","last_became_active":"2023-10-07T08:44:19.442003+0000","last_became_peered":"2023-10-07T08:44:19.442003+0000","last_unstale":"2023-10-07T08:44:19.443240+0000","last_undegraded":"2023-10-07T08:44:19.443240+0000","last_fullsized":"2023-10-07T08:44:19.443240+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:45:58.316227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.429927+0000","last_change":"2023-10-07T08:44:18.429815+0000","last_active":"2023-10-07T08:44:18.429927+0000","last_peered":"2023-10-07T08:44:18.429927+0000","last_clean":"2023-10-07T08:44:18.429927+0000","last_became_active":"2023-10-07T08:44:18.429408+0000","last_became_peered":"2023-10-07T08:44:18.429408+0000","last_unstale":"2023-10-07T08:44:18.429927+0000","last_undegraded":"2023-10-07T08:44:18.429927+0000","last_fullsized":"2023-10-07T08:44:18.429927+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:21:04.197869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.440831+0000","last_change":"2023-10-07T08:44:19.440831+0000","last_active":"2023-10-07T08:44:19.440831+0000","last_peered":"2023-10-07T08:44:19.440831+0000","last_clean":"2023-10-07T08:44:19.440831+0000","last_became_active":"2023-10-07T08:44:19.440451+0000","last_became_peered":"2023-10-07T08:44:19.440451+0000","last_unstale":"2023-10-07T08:44:19.440831+0000","last_undegraded":"2023-10-07T08:44:19.440831+0000","last_fullsized":"2023-10-07T08:44:19.440831+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:49.359821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.436266+0000","last_change":"2023-10-07T08:44:18.436216+0000","last_active":"2023-10-07T08:44:18.436266+0000","last_peered":"2023-10-07T08:44:18.436266+0000","last_clean":"2023-10-07T08:44:18.436266+0000","last_became_active":"2023-10-07T08:44:18.435806+0000","last_became_peered":"2023-10-07T08:44:18.435806+0000","last_unstale":"2023-10-07T08:44:18.436266+0000","last_undegraded":"2023-10-07T08:44:18.436266+0000","last_fullsized":"2023-10-07T08:44:18.436266+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:40:15.921008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.443452+0000","last_change":"2023-10-07T08:44:19.443452+0000","last_active":"2023-10-07T08:44:19.443452+0000","last_peered":"2023-10-07T08:44:19.443452+0000","last_clean":"2023-10-07T08:44:19.443452+0000","last_became_active":"2023-10-07T08:44:19.442273+0000","last_became_peered":"2023-10-07T08:44:19.442273+0000","last_unstale":"2023-10-07T08:44:19.443452+0000","last_undegraded":"2023-10-07T08:44:19.443452+0000","last_fullsized":"2023-10-07T08:44:19.443452+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:54:21.072698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.434776+0000","last_change":"2023-10-07T08:44:18.434606+0000","last_active":"2023-10-07T08:44:18.434776+0000","last_peered":"2023-10-07T08:44:18.434776+0000","last_clean":"2023-10-07T08:44:18.434776+0000","last_became_active":"2023-10-07T08:44:18.434382+0000","last_became_peered":"2023-10-07T08:44:18.434382+0000","last_unstale":"2023-10-07T08:44:18.434776+0000","last_undegraded":"2023-10-07T08:44:18.434776+0000","last_fullsized":"2023-10-07T08:44:18.434776+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:05:35.588784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434057+0000","last_change":"2023-10-07T08:44:19.434057+0000","last_active":"2023-10-07T08:44:19.434057+0000","last_peered":"2023-10-07T08:44:19.434057+0000","last_clean":"2023-10-07T08:44:19.434057+0000","last_became_active":"2023-10-07T08:44:19.433818+0000","last_became_peered":"2023-10-07T08:44:19.433818+0000","last_unstale":"2023-10-07T08:44:19.434057+0000","last_undegraded":"2023-10-07T08:44:19.434057+0000","last_fullsized":"2023-10-07T08:44:19.434057+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:54:21.072698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.428560+0000","last_change":"2023-10-07T08:44:18.428516+0000","last_active":"2023-10-07T08:44:18.428560+0000","last_peered":"2023-10-07T08:44:18.428560+0000","last_clean":"2023-10-07T08:44:18.428560+0000","last_became_active":"2023-10-07T08:44:18.427964+0000","last_became_peered":"2023-10-07T08:44:18.427964+0000","last_unstale":"2023-10-07T08:44:18.428560+0000","last_undegraded":"2023-10-07T08:44:18.428560+0000","last_fullsized":"2023-10-07T08:44:18.428560+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:55:18.119106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.435136+0000","last_change":"2023-10-07T08:44:19.435136+0000","last_active":"2023-10-07T08:44:19.435136+0000","last_peered":"2023-10-07T08:44:19.435136+0000","last_clean":"2023-10-07T08:44:19.435136+0000","last_became_active":"2023-10-07T08:44:19.434930+0000","last_became_peered":"2023-10-07T08:44:19.434930+0000","last_unstale":"2023-10-07T08:44:19.435136+0000","last_undegraded":"2023-10-07T08:44:19.435136+0000","last_fullsized":"2023-10-07T08:44:19.435136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:59.517132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.435735+0000","last_change":"2023-10-07T08:44:18.435670+0000","last_active":"2023-10-07T08:44:18.435735+0000","last_peered":"2023-10-07T08:44:18.435735+0000","last_clean":"2023-10-07T08:44:18.435735+0000","last_became_active":"2023-10-07T08:44:18.435405+0000","last_became_peered":"2023-10-07T08:44:18.435405+0000","last_unstale":"2023-10-07T08:44:18.435735+0000","last_undegraded":"2023-10-07T08:44:18.435735+0000","last_fullsized":"2023-10-07T08:44:18.435735+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:26:33.161268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438107+0000","last_change":"2023-10-07T08:44:19.438107+0000","last_active":"2023-10-07T08:44:19.438107+0000","last_peered":"2023-10-07T08:44:19.438107+0000","last_clean":"2023-10-07T08:44:19.438107+0000","last_became_active":"2023-10-07T08:44:19.437336+0000","last_became_peered":"2023-10-07T08:44:19.437336+0000","last_unstale":"2023-10-07T08:44:19.438107+0000","last_undegraded":"2023-10-07T08:44:19.438107+0000","last_fullsized":"2023-10-07T08:44:19.438107+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:13:25.158745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.433120+0000","last_change":"2023-10-07T08:44:18.432279+0000","last_active":"2023-10-07T08:44:18.433120+0000","last_peered":"2023-10-07T08:44:18.433120+0000","last_clean":"2023-10-07T08:44:18.433120+0000","last_became_active":"2023-10-07T08:44:18.432058+0000","last_became_peered":"2023-10-07T08:44:18.432058+0000","last_unstale":"2023-10-07T08:44:18.433120+0000","last_undegraded":"2023-10-07T08:44:18.433120+0000","last_fullsized":"2023-10-07T08:44:18.433120+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:05:49.761762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434853+0000","last_change":"2023-10-07T08:44:19.434853+0000","last_active":"2023-10-07T08:44:19.434853+0000","last_peered":"2023-10-07T08:44:19.434853+0000","last_clean":"2023-10-07T08:44:19.434853+0000","last_became_active":"2023-10-07T08:44:19.434626+0000","last_became_peered":"2023-10-07T08:44:19.434626+0000","last_unstale":"2023-10-07T08:44:19.434853+0000","last_undegraded":"2023-10-07T08:44:19.434853+0000","last_fullsized":"2023-10-07T08:44:19.434853+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:54:21.072698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.434930+0000","last_change":"2023-10-07T08:44:18.434867+0000","last_active":"2023-10-07T08:44:18.434930+0000","last_peered":"2023-10-07T08:44:18.434930+0000","last_clean":"2023-10-07T08:44:18.434930+0000","last_became_active":"2023-10-07T08:44:18.434634+0000","last_became_peered":"2023-10-07T08:44:18.434634+0000","last_unstale":"2023-10-07T08:44:18.434930+0000","last_undegraded":"2023-10-07T08:44:18.434930+0000","last_fullsized":"2023-10-07T08:44:18.434930+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:25:16.894311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438085+0000","last_change":"2023-10-07T08:44:19.438085+0000","last_active":"2023-10-07T08:44:19.438085+0000","last_peered":"2023-10-07T08:44:19.438085+0000","last_clean":"2023-10-07T08:44:19.438085+0000","last_became_active":"2023-10-07T08:44:19.437139+0000","last_became_peered":"2023-10-07T08:44:19.437139+0000","last_unstale":"2023-10-07T08:44:19.438085+0000","last_undegraded":"2023-10-07T08:44:19.438085+0000","last_fullsized":"2023-10-07T08:44:19.438085+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:05:36.597647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.428413+0000","last_change":"2023-10-07T08:44:18.428355+0000","last_active":"2023-10-07T08:44:18.428413+0000","last_peered":"2023-10-07T08:44:18.428413+0000","last_clean":"2023-10-07T08:44:18.428413+0000","last_became_active":"2023-10-07T08:44:18.428123+0000","last_became_peered":"2023-10-07T08:44:18.428123+0000","last_unstale":"2023-10-07T08:44:18.428413+0000","last_undegraded":"2023-10-07T08:44:18.428413+0000","last_fullsized":"2023-10-07T08:44:18.428413+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:30.317930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.435811+0000","last_change":"2023-10-07T08:44:19.435811+0000","last_active":"2023-10-07T08:44:19.435811+0000","last_peered":"2023-10-07T08:44:19.435811+0000","last_clean":"2023-10-07T08:44:19.435811+0000","last_became_active":"2023-10-07T08:44:19.435422+0000","last_became_peered":"2023-10-07T08:44:19.435422+0000","last_unstale":"2023-10-07T08:44:19.435811+0000","last_undegraded":"2023-10-07T08:44:19.435811+0000","last_fullsized":"2023-10-07T08:44:19.435811+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:39:42.693839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.443743+0000","last_change":"2023-10-07T08:44:18.425306+0000","last_active":"2023-10-07T08:44:19.443743+0000","last_peered":"2023-10-07T08:44:19.443743+0000","last_clean":"2023-10-07T08:44:19.443743+0000","last_became_active":"2023-10-07T08:44:18.425038+0000","last_became_peered":"2023-10-07T08:44:18.425038+0000","last_unstale":"2023-10-07T08:44:19.443743+0000","last_undegraded":"2023-10-07T08:44:19.443743+0000","last_fullsized":"2023-10-07T08:44:19.443743+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:05:35.588784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.423738+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:44:18.423738+0000","last_peered":"2023-10-07T08:44:18.423738+0000","last_clean":"2023-10-07T08:44:18.423738+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:44:18.423738+0000","last_undegraded":"2023-10-07T08:44:18.423738+0000","last_fullsized":"2023-10-07T08:44:18.423738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":782,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194530,"statfs":{"total":200000000,"available":199199010,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.48599999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":6.8570000000000002,"5min":6.8570000000000002,"15min":6.8570000000000002},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.78800000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.73699999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.81000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":212,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195100,"statfs":{"total":200000000,"available":199782615,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.34399999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.5},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.51500000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.57899999999999996}]},{"osd":3,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":2.3879999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.68700000000000006}]},{"osd":5,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.748}]},{"osd":7,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195106,"statfs":{"total":200000000,"available":199789378,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:43:48 2023","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.33900000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:43:48 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.311},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.32500000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:43:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.29499999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:43:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.504}]},{"osd":5,"last update":"Sat Oct 7 08:43:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.72799999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:43:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.54200000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:43:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.66900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":788,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194523,"statfs":{"total":200000000,"available":199192213,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.215},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.372}]},{"osd":3,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.44600000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.495}]},{"osd":6,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.54400000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.43099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":213,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195098,"statfs":{"total":200000000,"available":199781057,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.372}]},{"osd":1,"last update":"Sat Oct 7 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.34399999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.28899999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.504},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.57899999999999996}]},{"osd":6,"last update":"Sat Oct 7 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.70699999999999996}]},{"osd":7,"last update":"Sat Oct 7 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.52800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195106,"statfs":{"total":200000000,"available":199789378,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.371}]},{"osd":1,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.255},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.501}]},{"osd":2,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.39500000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.41299999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.45900000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.622},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.432}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":213,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195098,"statfs":{"total":200000000,"available":199781079,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.32300000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.376},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.30599999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.35799999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.44}]},{"osd":6,"last update":"Sat Oct 7 08:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.48899999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.498}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":212,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195100,"statfs":{"total":200000000,"available":199782545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.52200000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.69199999999999995}]},{"osd":2,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.71599999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.66600000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.499},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.47599999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.46100000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.40000000000000002}]}]}],"pool_statfs":[]}} 2023-10-07T08:44:23.496 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:44:23.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.642+0000 7fe5820ec700 1 Processor -- start 2023-10-07T08:44:23.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.642+0000 7fe5820ec700 1 -- start start 2023-10-07T08:44:23.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.643+0000 7fe5820ec700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe57c159b40 0x7fe57c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:23.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.643+0000 7fe5820ec700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57c0cee10 con 0x7fe57c159f10 2023-10-07T08:44:23.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.643+0000 7fe5820ec700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57c0cd040 con 0x7fe57c068e90 2023-10-07T08:44:23.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.643+0000 7fe5820ec700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57c0cd320 con 0x7fe57c159b40 2023-10-07T08:44:23.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.643+0000 7fe5810ea700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe57c159b40 0x7fe57c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:23.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.643+0000 7fe5808e9700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe57c159f10 0x7fe57c068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32852/0 (socket says 172.21.15.81:32852) 2023-10-07T08:44:23.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.643+0000 7fe5808e9700 1 -- 172.21.15.81:0/1859909063 learned_addr learned my addr 172.21.15.81:0/1859909063 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:23.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.643+0000 7fe5810ea700 1 -- 172.21.15.81:0/1859909063 >> v1:172.21.15.89:6789/0 conn(0x7fe57c068e90 legacy=0x7fe57c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:23.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.643+0000 7fe5810ea700 1 -- 172.21.15.81:0/1859909063 >> v1:172.21.15.81:6789/0 conn(0x7fe57c159f10 legacy=0x7fe57c068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:23.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.643+0000 7fe5810ea700 1 -- 172.21.15.81:0/1859909063 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c0ce7c0 con 0x7fe57c159b40 2023-10-07T08:44:23.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.643+0000 7fe573fff700 1 -- 172.21.15.81:0/1859909063 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745831514 0 0) 0x7fe57c0cee10 con 0x7fe57c159f10 2023-10-07T08:44:23.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.643+0000 7fe5810ea700 1 --2- 172.21.15.81:0/1859909063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c159b40 0x7fe57c0cc600 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe574009e60 tx=0x7fe574009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cb2ae311b057bf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:23.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.644+0000 7fe573fff700 1 -- 172.21.15.81:0/1859909063 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57400e070 con 0x7fe57c159b40 2023-10-07T08:44:23.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.644+0000 7fe573fff700 1 -- 172.21.15.81:0/1859909063 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57400bbf0 con 0x7fe57c159b40 2023-10-07T08:44:23.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.644+0000 7fe573fff700 1 -- 172.21.15.81:0/1859909063 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574012430 con 0x7fe57c159b40 2023-10-07T08:44:23.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.644+0000 7fe5820ec700 1 -- 172.21.15.81:0/1859909063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c159b40 msgr2=0x7fe57c0cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:23.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.644+0000 7fe5820ec700 1 --2- 172.21.15.81:0/1859909063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c159b40 0x7fe57c0cc600 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe574009e60 tx=0x7fe574009780 comp rx=0 tx=0).stop 2023-10-07T08:44:23.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.644+0000 7fe5820ec700 1 -- 172.21.15.81:0/1859909063 shutdown_connections 2023-10-07T08:44:23.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.644+0000 7fe5820ec700 1 --2- 172.21.15.81:0/1859909063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c159b40 0x7fe57c0cc600 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.644+0000 7fe5820ec700 1 -- 172.21.15.81:0/1859909063 >> 172.21.15.81:0/1859909063 conn(0x7fe57c0cd660 msgr2=0x7fe57c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.644+0000 7fe5820ec700 1 -- 172.21.15.81:0/1859909063 shutdown_connections 2023-10-07T08:44:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.644+0000 7fe5820ec700 1 -- 172.21.15.81:0/1859909063 wait complete. 2023-10-07T08:44:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.645+0000 7fe5820ec700 1 Processor -- start 2023-10-07T08:44:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.645+0000 7fe5820ec700 1 -- start start 2023-10-07T08:44:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.646+0000 7fe5820ec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c068e90 0x7fe57c0b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.646+0000 7fe5820ec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe57c159b40 0x7fe57c0c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.646+0000 7fe5820ec700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe57c159f10 0x7fe57c0c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.646+0000 7fe5820ec700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c158d90 con 0x7fe57c068e90 2023-10-07T08:44:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.646+0000 7fe5820ec700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c16b1b0 con 0x7fe57c159f10 2023-10-07T08:44:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.646+0000 7fe5820ec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c16a880 con 0x7fe57c159b40 2023-10-07T08:44:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.646+0000 7fe5810ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c068e90 0x7fe57c0b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.646+0000 7fe5810ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c068e90 0x7fe57c0b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48506/0 (socket says 172.21.15.81:48506) 2023-10-07T08:44:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.646+0000 7fe5810ea700 1 -- 172.21.15.81:0/2771041408 learned_addr learned my addr 172.21.15.81:0/2771041408 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.646+0000 7fe5810ea700 1 -- 172.21.15.81:0/2771041408 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe57c159b40 msgr2=0x7fe57c0c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.646+0000 7fe5810ea700 1 --2- 172.21.15.81:0/2771041408 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe57c159b40 0x7fe57c0c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.646+0000 7fe5810ea700 1 -- 172.21.15.81:0/2771041408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe57c159f10 msgr2=0x7fe57c0c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.646+0000 7fe5818eb700 1 --2- 172.21.15.81:0/2771041408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe57c159f10 0x7fe57c0c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.646+0000 7fe5810ea700 1 --2- 172.21.15.81:0/2771041408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe57c159f10 0x7fe57c0c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.646+0000 7fe5810ea700 1 -- 172.21.15.81:0/2771041408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe574009a20 con 0x7fe57c068e90 2023-10-07T08:44:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.647+0000 7fe5810ea700 1 --2- 172.21.15.81:0/2771041408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c068e90 0x7fe57c0b42b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe57c06fe10 tx=0x7fe574018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.647+0000 7fe5717fa700 1 -- 172.21.15.81:0/2771041408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574012e00 con 0x7fe57c068e90 2023-10-07T08:44:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.647+0000 7fe5717fa700 1 -- 172.21.15.81:0/2771041408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57401d640 con 0x7fe57c068e90 2023-10-07T08:44:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.647+0000 7fe5820ec700 1 -- 172.21.15.81:0/2771041408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57c16ab60 con 0x7fe57c068e90 2023-10-07T08:44:23.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.647+0000 7fe5717fa700 1 -- 172.21.15.81:0/2771041408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57401d9e0 con 0x7fe57c068e90 2023-10-07T08:44:23.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.647+0000 7fe5820ec700 1 -- 172.21.15.81:0/2771041408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57c16a4d0 con 0x7fe57c068e90 2023-10-07T08:44:23.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.648+0000 7fe5820ec700 1 -- 172.21.15.81:0/2771041408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57c0cca90 con 0x7fe57c068e90 2023-10-07T08:44:23.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.648+0000 7fe5717fa700 1 -- 172.21.15.81:0/2771041408 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe574024070 con 0x7fe57c068e90 2023-10-07T08:44:23.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.649+0000 7fe5717fa700 1 --2- 172.21.15.81:0/2771041408 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe560066f30 0x7fe5600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:23.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.649+0000 7fe5808e9700 1 --2- 172.21.15.81:0/2771041408 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe560066f30 0x7fe5600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:23.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.649+0000 7fe5717fa700 1 -- 172.21.15.81:0/2771041408 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe574086ff0 con 0x7fe57c068e90 2023-10-07T08:44:23.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.649+0000 7fe5808e9700 1 --2- 172.21.15.81:0/2771041408 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe560066f30 0x7fe5600693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe57c06abd0 tx=0x7fe56c007bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.653+0000 7fe5717fa700 1 -- 172.21.15.81:0/2771041408 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe574054260 con 0x7fe57c068e90 2023-10-07T08:44:23.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.830+0000 7fe5820ec700 1 -- 172.21.15.81:0/2771041408 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe57c16b2f0 con 0x7fe560066f30 2023-10-07T08:44:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.837+0000 7fe5717fa700 1 -- 172.21.15.81:0/2771041408 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284818 (secure 0 0 0) 0x7fe56c0058e0 con 0x7fe560066f30 2023-10-07T08:44:23.842 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.840+0000 7fe5820ec700 1 -- 172.21.15.81:0/2771041408 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe560066f30 msgr2=0x7fe5600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.840+0000 7fe5820ec700 1 --2- 172.21.15.81:0/2771041408 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe560066f30 0x7fe5600693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe57c06abd0 tx=0x7fe56c007bd0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.840+0000 7fe5820ec700 1 -- 172.21.15.81:0/2771041408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c068e90 msgr2=0x7fe57c0b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.840+0000 7fe5820ec700 1 --2- 172.21.15.81:0/2771041408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c068e90 0x7fe57c0b42b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe57c06fe10 tx=0x7fe574018000 comp rx=0 tx=0).stop 2023-10-07T08:44:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.841+0000 7fe5820ec700 1 -- 172.21.15.81:0/2771041408 shutdown_connections 2023-10-07T08:44:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.841+0000 7fe5820ec700 1 --2- 172.21.15.81:0/2771041408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe57c159f10 0x7fe57c0c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.841+0000 7fe5820ec700 1 --2- 172.21.15.81:0/2771041408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c068e90 0x7fe57c0b42b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.841+0000 7fe5820ec700 1 --2- 172.21.15.81:0/2771041408 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe560066f30 0x7fe5600693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.841+0000 7fe5820ec700 1 --2- 172.21.15.81:0/2771041408 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe57c159b40 0x7fe57c0c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.841+0000 7fe5820ec700 1 -- 172.21.15.81:0/2771041408 >> 172.21.15.81:0/2771041408 conn(0x7fe57c0cd660 msgr2=0x7fe57c06f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.841+0000 7fe5820ec700 1 -- 172.21.15.81:0/2771041408 shutdown_connections 2023-10-07T08:44:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:23.841+0000 7fe5820ec700 1 -- 172.21.15.81:0/2771041408 wait complete. 2023-10-07T08:44:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:44:23.854 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2023-10-07T08:44:22.022918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2834,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559665,"statfs":{"total":1600000000,"available":1597097275,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.608640"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438925+0000","last_change":"2023-10-07T08:44:19.438925+0000","last_active":"2023-10-07T08:44:19.438925+0000","last_peered":"2023-10-07T08:44:19.438925+0000","last_clean":"2023-10-07T08:44:19.438925+0000","last_became_active":"2023-10-07T08:44:19.438371+0000","last_became_peered":"2023-10-07T08:44:19.438371+0000","last_unstale":"2023-10-07T08:44:19.438925+0000","last_undegraded":"2023-10-07T08:44:19.438925+0000","last_fullsized":"2023-10-07T08:44:19.438925+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:50:08.318385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.436652+0000","last_change":"2023-10-07T08:44:19.436652+0000","last_active":"2023-10-07T08:44:19.436652+0000","last_peered":"2023-10-07T08:44:19.436652+0000","last_clean":"2023-10-07T08:44:19.436652+0000","last_became_active":"2023-10-07T08:44:19.435434+0000","last_became_peered":"2023-10-07T08:44:19.435434+0000","last_unstale":"2023-10-07T08:44:19.436652+0000","last_undegraded":"2023-10-07T08:44:19.436652+0000","last_fullsized":"2023-10-07T08:44:19.436652+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:08.157631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438728+0000","last_change":"2023-10-07T08:44:19.438728+0000","last_active":"2023-10-07T08:44:19.438728+0000","last_peered":"2023-10-07T08:44:19.438728+0000","last_clean":"2023-10-07T08:44:19.438728+0000","last_became_active":"2023-10-07T08:44:19.438322+0000","last_became_peered":"2023-10-07T08:44:19.438322+0000","last_unstale":"2023-10-07T08:44:19.438728+0000","last_undegraded":"2023-10-07T08:44:19.438728+0000","last_fullsized":"2023-10-07T08:44:19.438728+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:21:05.206733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.441286+0000","last_change":"2023-10-07T08:44:19.441286+0000","last_active":"2023-10-07T08:44:19.441286+0000","last_peered":"2023-10-07T08:44:19.441286+0000","last_clean":"2023-10-07T08:44:19.441286+0000","last_became_active":"2023-10-07T08:44:19.440997+0000","last_became_peered":"2023-10-07T08:44:19.440997+0000","last_unstale":"2023-10-07T08:44:19.441286+0000","last_undegraded":"2023-10-07T08:44:19.441286+0000","last_fullsized":"2023-10-07T08:44:19.441286+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:08.157631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.444908+0000","last_change":"2023-10-07T08:44:19.444908+0000","last_active":"2023-10-07T08:44:19.444908+0000","last_peered":"2023-10-07T08:44:19.444908+0000","last_clean":"2023-10-07T08:44:19.444908+0000","last_became_active":"2023-10-07T08:44:19.444684+0000","last_became_peered":"2023-10-07T08:44:19.444684+0000","last_unstale":"2023-10-07T08:44:19.444908+0000","last_undegraded":"2023-10-07T08:44:19.444908+0000","last_fullsized":"2023-10-07T08:44:19.444908+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:09:27.368132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438236+0000","last_change":"2023-10-07T08:44:19.438236+0000","last_active":"2023-10-07T08:44:19.438236+0000","last_peered":"2023-10-07T08:44:19.438236+0000","last_clean":"2023-10-07T08:44:19.438236+0000","last_became_active":"2023-10-07T08:44:19.437803+0000","last_became_peered":"2023-10-07T08:44:19.437803+0000","last_unstale":"2023-10-07T08:44:19.438236+0000","last_undegraded":"2023-10-07T08:44:19.438236+0000","last_fullsized":"2023-10-07T08:44:19.438236+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:06:27.466043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437000+0000","last_change":"2023-10-07T08:44:19.437000+0000","last_active":"2023-10-07T08:44:19.437000+0000","last_peered":"2023-10-07T08:44:19.437000+0000","last_clean":"2023-10-07T08:44:19.437000+0000","last_became_active":"2023-10-07T08:44:19.436754+0000","last_became_peered":"2023-10-07T08:44:19.436754+0000","last_unstale":"2023-10-07T08:44:19.437000+0000","last_undegraded":"2023-10-07T08:44:19.437000+0000","last_fullsized":"2023-10-07T08:44:19.437000+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:08.157631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.435895+0000","last_change":"2023-10-07T08:44:19.435895+0000","last_active":"2023-10-07T08:44:19.435895+0000","last_peered":"2023-10-07T08:44:19.435895+0000","last_clean":"2023-10-07T08:44:19.435895+0000","last_became_active":"2023-10-07T08:44:19.435631+0000","last_became_peered":"2023-10-07T08:44:19.435631+0000","last_unstale":"2023-10-07T08:44:19.435895+0000","last_undegraded":"2023-10-07T08:44:19.435895+0000","last_fullsized":"2023-10-07T08:44:19.435895+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:41:49.752256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.436802+0000","last_change":"2023-10-07T08:44:19.436802+0000","last_active":"2023-10-07T08:44:19.436802+0000","last_peered":"2023-10-07T08:44:19.436802+0000","last_clean":"2023-10-07T08:44:19.436802+0000","last_became_active":"2023-10-07T08:44:19.436500+0000","last_became_peered":"2023-10-07T08:44:19.436500+0000","last_unstale":"2023-10-07T08:44:19.436802+0000","last_undegraded":"2023-10-07T08:44:19.436802+0000","last_fullsized":"2023-10-07T08:44:19.436802+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:44:44.640310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.443755+0000","last_change":"2023-10-07T08:44:19.443755+0000","last_active":"2023-10-07T08:44:19.443755+0000","last_peered":"2023-10-07T08:44:19.443755+0000","last_clean":"2023-10-07T08:44:19.443755+0000","last_became_active":"2023-10-07T08:44:19.442873+0000","last_became_peered":"2023-10-07T08:44:19.442873+0000","last_unstale":"2023-10-07T08:44:19.443755+0000","last_undegraded":"2023-10-07T08:44:19.443755+0000","last_fullsized":"2023-10-07T08:44:19.443755+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:24:21.981463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.433912+0000","last_change":"2023-10-07T08:44:19.433912+0000","last_active":"2023-10-07T08:44:19.433912+0000","last_peered":"2023-10-07T08:44:19.433912+0000","last_clean":"2023-10-07T08:44:19.433912+0000","last_became_active":"2023-10-07T08:44:19.433758+0000","last_became_peered":"2023-10-07T08:44:19.433758+0000","last_unstale":"2023-10-07T08:44:19.433912+0000","last_undegraded":"2023-10-07T08:44:19.433912+0000","last_fullsized":"2023-10-07T08:44:19.433912+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:26:34.170132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.433931+0000","last_change":"2023-10-07T08:44:19.433931+0000","last_active":"2023-10-07T08:44:19.433931+0000","last_peered":"2023-10-07T08:44:19.433931+0000","last_clean":"2023-10-07T08:44:19.433931+0000","last_became_active":"2023-10-07T08:44:19.433608+0000","last_became_peered":"2023-10-07T08:44:19.433608+0000","last_unstale":"2023-10-07T08:44:19.433931+0000","last_undegraded":"2023-10-07T08:44:19.433931+0000","last_fullsized":"2023-10-07T08:44:19.433931+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:22:46.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.428825+0000","last_change":"2023-10-07T08:44:19.428825+0000","last_active":"2023-10-07T08:44:19.428825+0000","last_peered":"2023-10-07T08:44:19.428825+0000","last_clean":"2023-10-07T08:44:19.428825+0000","last_became_active":"2023-10-07T08:44:19.428607+0000","last_became_peered":"2023-10-07T08:44:19.428607+0000","last_unstale":"2023-10-07T08:44:19.428825+0000","last_undegraded":"2023-10-07T08:44:19.428825+0000","last_fullsized":"2023-10-07T08:44:19.428825+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:49.691282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.436667+0000","last_change":"2023-10-07T08:44:19.436667+0000","last_active":"2023-10-07T08:44:19.436667+0000","last_peered":"2023-10-07T08:44:19.436667+0000","last_clean":"2023-10-07T08:44:19.436667+0000","last_became_active":"2023-10-07T08:44:19.436220+0000","last_became_peered":"2023-10-07T08:44:19.436220+0000","last_unstale":"2023-10-07T08:44:19.436667+0000","last_undegraded":"2023-10-07T08:44:19.436667+0000","last_fullsized":"2023-10-07T08:44:19.436667+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:22:46.725687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434405+0000","last_change":"2023-10-07T08:44:19.434405+0000","last_active":"2023-10-07T08:44:19.434405+0000","last_peered":"2023-10-07T08:44:19.434405+0000","last_clean":"2023-10-07T08:44:19.434405+0000","last_became_active":"2023-10-07T08:44:19.434185+0000","last_became_peered":"2023-10-07T08:44:19.434185+0000","last_unstale":"2023-10-07T08:44:19.434405+0000","last_undegraded":"2023-10-07T08:44:19.434405+0000","last_fullsized":"2023-10-07T08:44:19.434405+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:40:00.233375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.439392+0000","last_change":"2023-10-07T08:44:19.439392+0000","last_active":"2023-10-07T08:44:19.439392+0000","last_peered":"2023-10-07T08:44:19.439392+0000","last_clean":"2023-10-07T08:44:19.439392+0000","last_became_active":"2023-10-07T08:44:19.439043+0000","last_became_peered":"2023-10-07T08:44:19.439043+0000","last_unstale":"2023-10-07T08:44:19.439392+0000","last_undegraded":"2023-10-07T08:44:19.439392+0000","last_fullsized":"2023-10-07T08:44:19.439392+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:34:00.732970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437711+0000","last_change":"2023-10-07T08:44:19.437711+0000","last_active":"2023-10-07T08:44:19.437711+0000","last_peered":"2023-10-07T08:44:19.437711+0000","last_clean":"2023-10-07T08:44:19.437711+0000","last_became_active":"2023-10-07T08:44:19.437236+0000","last_became_peered":"2023-10-07T08:44:19.437236+0000","last_unstale":"2023-10-07T08:44:19.437711+0000","last_undegraded":"2023-10-07T08:44:19.437711+0000","last_fullsized":"2023-10-07T08:44:19.437711+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:40:16.929872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438562+0000","last_change":"2023-10-07T08:44:19.438562+0000","last_active":"2023-10-07T08:44:19.438562+0000","last_peered":"2023-10-07T08:44:19.438562+0000","last_clean":"2023-10-07T08:44:19.438562+0000","last_became_active":"2023-10-07T08:44:19.437714+0000","last_became_peered":"2023-10-07T08:44:19.437714+0000","last_unstale":"2023-10-07T08:44:19.438562+0000","last_undegraded":"2023-10-07T08:44:19.438562+0000","last_fullsized":"2023-10-07T08:44:19.438562+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:26:34.170132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437506+0000","last_change":"2023-10-07T08:44:19.437506+0000","last_active":"2023-10-07T08:44:19.437506+0000","last_peered":"2023-10-07T08:44:19.437506+0000","last_clean":"2023-10-07T08:44:19.437506+0000","last_became_active":"2023-10-07T08:44:19.437259+0000","last_became_peered":"2023-10-07T08:44:19.437259+0000","last_unstale":"2023-10-07T08:44:19.437506+0000","last_undegraded":"2023-10-07T08:44:19.437506+0000","last_fullsized":"2023-10-07T08:44:19.437506+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:55:19.127969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.442426+0000","last_change":"2023-10-07T08:44:19.442426+0000","last_active":"2023-10-07T08:44:19.442426+0000","last_peered":"2023-10-07T08:44:19.442426+0000","last_clean":"2023-10-07T08:44:19.442426+0000","last_became_active":"2023-10-07T08:44:19.442188+0000","last_became_peered":"2023-10-07T08:44:19.442188+0000","last_unstale":"2023-10-07T08:44:19.442426+0000","last_undegraded":"2023-10-07T08:44:19.442426+0000","last_fullsized":"2023-10-07T08:44:19.442426+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:29:23.798374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437996+0000","last_change":"2023-10-07T08:44:19.437996+0000","last_active":"2023-10-07T08:44:19.437996+0000","last_peered":"2023-10-07T08:44:19.437996+0000","last_clean":"2023-10-07T08:44:19.437996+0000","last_became_active":"2023-10-07T08:44:19.436968+0000","last_became_peered":"2023-10-07T08:44:19.436968+0000","last_unstale":"2023-10-07T08:44:19.437996+0000","last_undegraded":"2023-10-07T08:44:19.437996+0000","last_fullsized":"2023-10-07T08:44:19.437996+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:04:34.703994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.440033+0000","last_change":"2023-10-07T08:44:19.440033+0000","last_active":"2023-10-07T08:44:19.440033+0000","last_peered":"2023-10-07T08:44:19.440033+0000","last_clean":"2023-10-07T08:44:19.440033+0000","last_became_active":"2023-10-07T08:44:19.439797+0000","last_became_peered":"2023-10-07T08:44:19.439797+0000","last_unstale":"2023-10-07T08:44:19.440033+0000","last_undegraded":"2023-10-07T08:44:19.440033+0000","last_fullsized":"2023-10-07T08:44:19.440033+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:30.407673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434038+0000","last_change":"2023-10-07T08:44:19.434038+0000","last_active":"2023-10-07T08:44:19.434038+0000","last_peered":"2023-10-07T08:44:19.434038+0000","last_clean":"2023-10-07T08:44:19.434038+0000","last_became_active":"2023-10-07T08:44:19.433070+0000","last_became_peered":"2023-10-07T08:44:19.433070+0000","last_unstale":"2023-10-07T08:44:19.434038+0000","last_undegraded":"2023-10-07T08:44:19.434038+0000","last_fullsized":"2023-10-07T08:44:19.434038+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:07:35.252087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.433433+0000","last_change":"2023-10-07T08:44:19.433433+0000","last_active":"2023-10-07T08:44:19.433433+0000","last_peered":"2023-10-07T08:44:19.433433+0000","last_clean":"2023-10-07T08:44:19.433433+0000","last_became_active":"2023-10-07T08:44:19.432938+0000","last_became_peered":"2023-10-07T08:44:19.432938+0000","last_unstale":"2023-10-07T08:44:19.433433+0000","last_undegraded":"2023-10-07T08:44:19.433433+0000","last_fullsized":"2023-10-07T08:44:19.433433+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:55:48.683261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438926+0000","last_change":"2023-10-07T08:44:19.438926+0000","last_active":"2023-10-07T08:44:19.438926+0000","last_peered":"2023-10-07T08:44:19.438926+0000","last_clean":"2023-10-07T08:44:19.438926+0000","last_became_active":"2023-10-07T08:44:19.438710+0000","last_became_peered":"2023-10-07T08:44:19.438710+0000","last_unstale":"2023-10-07T08:44:19.438926+0000","last_undegraded":"2023-10-07T08:44:19.438926+0000","last_fullsized":"2023-10-07T08:44:19.438926+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:49:42.089780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434177+0000","last_change":"2023-10-07T08:44:19.434177+0000","last_active":"2023-10-07T08:44:19.434177+0000","last_peered":"2023-10-07T08:44:19.434177+0000","last_clean":"2023-10-07T08:44:19.434177+0000","last_became_active":"2023-10-07T08:44:19.433855+0000","last_became_peered":"2023-10-07T08:44:19.433855+0000","last_unstale":"2023-10-07T08:44:19.434177+0000","last_undegraded":"2023-10-07T08:44:19.434177+0000","last_fullsized":"2023-10-07T08:44:19.434177+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:44:34.902336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437576+0000","last_change":"2023-10-07T08:44:19.437576+0000","last_active":"2023-10-07T08:44:19.437576+0000","last_peered":"2023-10-07T08:44:19.437576+0000","last_clean":"2023-10-07T08:44:19.437576+0000","last_became_active":"2023-10-07T08:44:19.436918+0000","last_became_peered":"2023-10-07T08:44:19.436918+0000","last_unstale":"2023-10-07T08:44:19.437576+0000","last_undegraded":"2023-10-07T08:44:19.437576+0000","last_fullsized":"2023-10-07T08:44:19.437576+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:12.227434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.432570+0000","last_change":"2023-10-07T08:44:19.432570+0000","last_active":"2023-10-07T08:44:19.432570+0000","last_peered":"2023-10-07T08:44:19.432570+0000","last_clean":"2023-10-07T08:44:19.432570+0000","last_became_active":"2023-10-07T08:44:19.431913+0000","last_became_peered":"2023-10-07T08:44:19.431913+0000","last_unstale":"2023-10-07T08:44:19.432570+0000","last_undegraded":"2023-10-07T08:44:19.432570+0000","last_fullsized":"2023-10-07T08:44:19.432570+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:45:58.316227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.439971+0000","last_change":"2023-10-07T08:44:19.439971+0000","last_active":"2023-10-07T08:44:19.439971+0000","last_peered":"2023-10-07T08:44:19.439971+0000","last_clean":"2023-10-07T08:44:19.439971+0000","last_became_active":"2023-10-07T08:44:19.439785+0000","last_became_peered":"2023-10-07T08:44:19.439785+0000","last_unstale":"2023-10-07T08:44:19.439971+0000","last_undegraded":"2023-10-07T08:44:19.439971+0000","last_fullsized":"2023-10-07T08:44:19.439971+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:41:03.873418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.435910+0000","last_change":"2023-10-07T08:44:19.435910+0000","last_active":"2023-10-07T08:44:19.435910+0000","last_peered":"2023-10-07T08:44:19.435910+0000","last_clean":"2023-10-07T08:44:19.435910+0000","last_became_active":"2023-10-07T08:44:19.430945+0000","last_became_peered":"2023-10-07T08:44:19.430945+0000","last_unstale":"2023-10-07T08:44:19.435910+0000","last_undegraded":"2023-10-07T08:44:19.435910+0000","last_fullsized":"2023-10-07T08:44:19.435910+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:36.300770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.429543+0000","last_change":"2023-10-07T08:44:19.429543+0000","last_active":"2023-10-07T08:44:19.429543+0000","last_peered":"2023-10-07T08:44:19.429543+0000","last_clean":"2023-10-07T08:44:19.429543+0000","last_became_active":"2023-10-07T08:44:19.429319+0000","last_became_peered":"2023-10-07T08:44:19.429319+0000","last_unstale":"2023-10-07T08:44:19.429543+0000","last_undegraded":"2023-10-07T08:44:19.429543+0000","last_fullsized":"2023-10-07T08:44:19.429543+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:07.584019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437606+0000","last_change":"2023-10-07T08:44:19.437606+0000","last_active":"2023-10-07T08:44:19.437606+0000","last_peered":"2023-10-07T08:44:19.437606+0000","last_clean":"2023-10-07T08:44:19.437606+0000","last_became_active":"2023-10-07T08:44:19.434901+0000","last_became_peered":"2023-10-07T08:44:19.434901+0000","last_unstale":"2023-10-07T08:44:19.437606+0000","last_undegraded":"2023-10-07T08:44:19.437606+0000","last_fullsized":"2023-10-07T08:44:19.437606+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:09.985496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437201+0000","last_change":"2023-10-07T08:44:19.437201+0000","last_active":"2023-10-07T08:44:19.437201+0000","last_peered":"2023-10-07T08:44:19.437201+0000","last_clean":"2023-10-07T08:44:19.437201+0000","last_became_active":"2023-10-07T08:44:19.436988+0000","last_became_peered":"2023-10-07T08:44:19.436988+0000","last_unstale":"2023-10-07T08:44:19.437201+0000","last_undegraded":"2023-10-07T08:44:19.437201+0000","last_fullsized":"2023-10-07T08:44:19.437201+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:36.300770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.446920+0000","last_change":"2023-10-07T08:44:18.436107+0000","last_active":"2023-10-07T08:44:19.446920+0000","last_peered":"2023-10-07T08:44:19.446920+0000","last_clean":"2023-10-07T08:44:19.446920+0000","last_became_active":"2023-10-07T08:44:18.434726+0000","last_became_peered":"2023-10-07T08:44:18.434726+0000","last_unstale":"2023-10-07T08:44:19.446920+0000","last_undegraded":"2023-10-07T08:44:19.446920+0000","last_fullsized":"2023-10-07T08:44:19.446920+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:22:29.226194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434891+0000","last_change":"2023-10-07T08:44:19.434891+0000","last_active":"2023-10-07T08:44:19.434891+0000","last_peered":"2023-10-07T08:44:19.434891+0000","last_clean":"2023-10-07T08:44:19.434891+0000","last_became_active":"2023-10-07T08:44:19.434402+0000","last_became_peered":"2023-10-07T08:44:19.434402+0000","last_unstale":"2023-10-07T08:44:19.434891+0000","last_undegraded":"2023-10-07T08:44:19.434891+0000","last_fullsized":"2023-10-07T08:44:19.434891+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:10:45.644394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.429115+0000","last_change":"2023-10-07T08:44:18.435510+0000","last_active":"2023-10-07T08:44:19.429115+0000","last_peered":"2023-10-07T08:44:19.429115+0000","last_clean":"2023-10-07T08:44:19.429115+0000","last_became_active":"2023-10-07T08:44:18.435264+0000","last_became_peered":"2023-10-07T08:44:18.435264+0000","last_unstale":"2023-10-07T08:44:19.429115+0000","last_undegraded":"2023-10-07T08:44:19.429115+0000","last_fullsized":"2023-10-07T08:44:19.429115+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:22:10.385544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.435659+0000","last_change":"2023-10-07T08:44:19.435659+0000","last_active":"2023-10-07T08:44:19.435659+0000","last_peered":"2023-10-07T08:44:19.435659+0000","last_clean":"2023-10-07T08:44:19.435659+0000","last_became_active":"2023-10-07T08:44:19.434752+0000","last_became_peered":"2023-10-07T08:44:19.434752+0000","last_unstale":"2023-10-07T08:44:19.435659+0000","last_undegraded":"2023-10-07T08:44:19.435659+0000","last_fullsized":"2023-10-07T08:44:19.435659+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:44:44.640310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.445367+0000","last_change":"2023-10-07T08:44:18.428408+0000","last_active":"2023-10-07T08:44:19.445367+0000","last_peered":"2023-10-07T08:44:19.445367+0000","last_clean":"2023-10-07T08:44:19.445367+0000","last_became_active":"2023-10-07T08:44:18.427721+0000","last_became_peered":"2023-10-07T08:44:18.427721+0000","last_unstale":"2023-10-07T08:44:19.445367+0000","last_undegraded":"2023-10-07T08:44:19.445367+0000","last_fullsized":"2023-10-07T08:44:19.445367+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:33:59.724107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438841+0000","last_change":"2023-10-07T08:44:19.438841+0000","last_active":"2023-10-07T08:44:19.438841+0000","last_peered":"2023-10-07T08:44:19.438841+0000","last_clean":"2023-10-07T08:44:19.438841+0000","last_became_active":"2023-10-07T08:44:19.438618+0000","last_became_peered":"2023-10-07T08:44:19.438618+0000","last_unstale":"2023-10-07T08:44:19.438841+0000","last_undegraded":"2023-10-07T08:44:19.438841+0000","last_fullsized":"2023-10-07T08:44:19.438841+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:37:00.692341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.445327+0000","last_change":"2023-10-07T08:44:18.426995+0000","last_active":"2023-10-07T08:44:19.445327+0000","last_peered":"2023-10-07T08:44:19.445327+0000","last_clean":"2023-10-07T08:44:19.445327+0000","last_became_active":"2023-10-07T08:44:18.426775+0000","last_became_peered":"2023-10-07T08:44:18.426775+0000","last_unstale":"2023-10-07T08:44:19.445327+0000","last_undegraded":"2023-10-07T08:44:19.445327+0000","last_fullsized":"2023-10-07T08:44:19.445327+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:29.398810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437946+0000","last_change":"2023-10-07T08:44:19.437946+0000","last_active":"2023-10-07T08:44:19.437946+0000","last_peered":"2023-10-07T08:44:19.437946+0000","last_clean":"2023-10-07T08:44:19.437946+0000","last_became_active":"2023-10-07T08:44:19.436768+0000","last_became_peered":"2023-10-07T08:44:19.436768+0000","last_unstale":"2023-10-07T08:44:19.437946+0000","last_undegraded":"2023-10-07T08:44:19.437946+0000","last_fullsized":"2023-10-07T08:44:19.437946+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:37:00.692341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.425718+0000","last_change":"2023-10-07T08:44:18.425145+0000","last_active":"2023-10-07T08:44:19.425718+0000","last_peered":"2023-10-07T08:44:19.425718+0000","last_clean":"2023-10-07T08:44:19.425718+0000","last_became_active":"2023-10-07T08:44:18.424906+0000","last_became_peered":"2023-10-07T08:44:18.424906+0000","last_unstale":"2023-10-07T08:44:19.425718+0000","last_undegraded":"2023-10-07T08:44:19.425718+0000","last_fullsized":"2023-10-07T08:44:19.425718+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:24:20.972600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437969+0000","last_change":"2023-10-07T08:44:19.437969+0000","last_active":"2023-10-07T08:44:19.437969+0000","last_peered":"2023-10-07T08:44:19.437969+0000","last_clean":"2023-10-07T08:44:19.437969+0000","last_became_active":"2023-10-07T08:44:19.437598+0000","last_became_peered":"2023-10-07T08:44:19.437598+0000","last_unstale":"2023-10-07T08:44:19.437969+0000","last_undegraded":"2023-10-07T08:44:19.437969+0000","last_fullsized":"2023-10-07T08:44:19.437969+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:21:05.206733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.430053+0000","last_change":"2023-10-07T08:44:18.434610+0000","last_active":"2023-10-07T08:44:19.430053+0000","last_peered":"2023-10-07T08:44:19.430053+0000","last_clean":"2023-10-07T08:44:19.430053+0000","last_became_active":"2023-10-07T08:44:18.433934+0000","last_became_peered":"2023-10-07T08:44:18.433934+0000","last_unstale":"2023-10-07T08:44:19.430053+0000","last_undegraded":"2023-10-07T08:44:19.430053+0000","last_fullsized":"2023-10-07T08:44:19.430053+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:49:41.080917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.443578+0000","last_change":"2023-10-07T08:44:19.443578+0000","last_active":"2023-10-07T08:44:19.443578+0000","last_peered":"2023-10-07T08:44:19.443578+0000","last_clean":"2023-10-07T08:44:19.443578+0000","last_became_active":"2023-10-07T08:44:19.442577+0000","last_became_peered":"2023-10-07T08:44:19.442577+0000","last_unstale":"2023-10-07T08:44:19.443578+0000","last_undegraded":"2023-10-07T08:44:19.443578+0000","last_fullsized":"2023-10-07T08:44:19.443578+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:12.227434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.428859+0000","last_change":"2023-10-07T08:44:18.428768+0000","last_active":"2023-10-07T08:44:18.428859+0000","last_peered":"2023-10-07T08:44:18.428859+0000","last_clean":"2023-10-07T08:44:18.428859+0000","last_became_active":"2023-10-07T08:44:18.428531+0000","last_became_peered":"2023-10-07T08:44:18.428531+0000","last_unstale":"2023-10-07T08:44:18.428859+0000","last_undegraded":"2023-10-07T08:44:18.428859+0000","last_fullsized":"2023-10-07T08:44:18.428859+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:21:04.197869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.433241+0000","last_change":"2023-10-07T08:44:19.433241+0000","last_active":"2023-10-07T08:44:19.433241+0000","last_peered":"2023-10-07T08:44:19.433241+0000","last_clean":"2023-10-07T08:44:19.433241+0000","last_became_active":"2023-10-07T08:44:19.432650+0000","last_became_peered":"2023-10-07T08:44:19.432650+0000","last_unstale":"2023-10-07T08:44:19.433241+0000","last_undegraded":"2023-10-07T08:44:19.433241+0000","last_fullsized":"2023-10-07T08:44:19.433241+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:09.847735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.427222+0000","last_change":"2023-10-07T08:44:18.427027+0000","last_active":"2023-10-07T08:44:18.427222+0000","last_peered":"2023-10-07T08:44:18.427222+0000","last_clean":"2023-10-07T08:44:18.427222+0000","last_became_active":"2023-10-07T08:44:18.426543+0000","last_became_peered":"2023-10-07T08:44:18.426543+0000","last_unstale":"2023-10-07T08:44:18.427222+0000","last_undegraded":"2023-10-07T08:44:18.427222+0000","last_fullsized":"2023-10-07T08:44:18.427222+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:49:41.080917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.441079+0000","last_change":"2023-10-07T08:44:19.441079+0000","last_active":"2023-10-07T08:44:19.441079+0000","last_peered":"2023-10-07T08:44:19.441079+0000","last_clean":"2023-10-07T08:44:19.441079+0000","last_became_active":"2023-10-07T08:44:19.440928+0000","last_became_peered":"2023-10-07T08:44:19.440928+0000","last_unstale":"2023-10-07T08:44:19.441079+0000","last_undegraded":"2023-10-07T08:44:19.441079+0000","last_fullsized":"2023-10-07T08:44:19.441079+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:30.407673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.433673+0000","last_change":"2023-10-07T08:44:18.433605+0000","last_active":"2023-10-07T08:44:18.433673+0000","last_peered":"2023-10-07T08:44:18.433673+0000","last_clean":"2023-10-07T08:44:18.433673+0000","last_became_active":"2023-10-07T08:44:18.433319+0000","last_became_peered":"2023-10-07T08:44:18.433319+0000","last_unstale":"2023-10-07T08:44:18.433673+0000","last_undegraded":"2023-10-07T08:44:18.433673+0000","last_fullsized":"2023-10-07T08:44:18.433673+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:08.838872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438778+0000","last_change":"2023-10-07T08:44:19.438778+0000","last_active":"2023-10-07T08:44:19.438778+0000","last_peered":"2023-10-07T08:44:19.438778+0000","last_clean":"2023-10-07T08:44:19.438778+0000","last_became_active":"2023-10-07T08:44:19.438046+0000","last_became_peered":"2023-10-07T08:44:19.438046+0000","last_unstale":"2023-10-07T08:44:19.438778+0000","last_undegraded":"2023-10-07T08:44:19.438778+0000","last_fullsized":"2023-10-07T08:44:19.438778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:41:49.752256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.427006+0000","last_change":"2023-10-07T08:44:18.426945+0000","last_active":"2023-10-07T08:44:18.427006+0000","last_peered":"2023-10-07T08:44:18.427006+0000","last_clean":"2023-10-07T08:44:18.427006+0000","last_became_active":"2023-10-07T08:44:18.426713+0000","last_became_peered":"2023-10-07T08:44:18.426713+0000","last_unstale":"2023-10-07T08:44:18.427006+0000","last_undegraded":"2023-10-07T08:44:18.427006+0000","last_fullsized":"2023-10-07T08:44:18.427006+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:08.838872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.436667+0000","last_change":"2023-10-07T08:44:19.436667+0000","last_active":"2023-10-07T08:44:19.436667+0000","last_peered":"2023-10-07T08:44:19.436667+0000","last_clean":"2023-10-07T08:44:19.436667+0000","last_became_active":"2023-10-07T08:44:19.436434+0000","last_became_peered":"2023-10-07T08:44:19.436434+0000","last_unstale":"2023-10-07T08:44:19.436667+0000","last_undegraded":"2023-10-07T08:44:19.436667+0000","last_fullsized":"2023-10-07T08:44:19.436667+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:54:24.650234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.445051+0000","last_change":"2023-10-07T08:44:18.435518+0000","last_active":"2023-10-07T08:44:19.445051+0000","last_peered":"2023-10-07T08:44:19.445051+0000","last_clean":"2023-10-07T08:44:19.445051+0000","last_became_active":"2023-10-07T08:44:18.435329+0000","last_became_peered":"2023-10-07T08:44:18.435329+0000","last_unstale":"2023-10-07T08:44:19.445051+0000","last_undegraded":"2023-10-07T08:44:19.445051+0000","last_fullsized":"2023-10-07T08:44:19.445051+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:30:27.565764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434270+0000","last_change":"2023-10-07T08:44:19.434270+0000","last_active":"2023-10-07T08:44:19.434270+0000","last_peered":"2023-10-07T08:44:19.434270+0000","last_clean":"2023-10-07T08:44:19.434270+0000","last_became_active":"2023-10-07T08:44:19.433878+0000","last_became_peered":"2023-10-07T08:44:19.433878+0000","last_unstale":"2023-10-07T08:44:19.434270+0000","last_undegraded":"2023-10-07T08:44:19.434270+0000","last_fullsized":"2023-10-07T08:44:19.434270+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:44:44.640310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.447658+0000","last_change":"2023-10-07T08:44:18.426063+0000","last_active":"2023-10-07T08:44:19.447658+0000","last_peered":"2023-10-07T08:44:19.447658+0000","last_clean":"2023-10-07T08:44:19.447658+0000","last_became_active":"2023-10-07T08:44:18.425817+0000","last_became_peered":"2023-10-07T08:44:18.425817+0000","last_unstale":"2023-10-07T08:44:19.447658+0000","last_undegraded":"2023-10-07T08:44:19.447658+0000","last_fullsized":"2023-10-07T08:44:19.447658+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:11.306651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.439254+0000","last_change":"2023-10-07T08:44:19.439254+0000","last_active":"2023-10-07T08:44:19.439254+0000","last_peered":"2023-10-07T08:44:19.439254+0000","last_clean":"2023-10-07T08:44:19.439254+0000","last_became_active":"2023-10-07T08:44:19.438761+0000","last_became_peered":"2023-10-07T08:44:19.438761+0000","last_unstale":"2023-10-07T08:44:19.439254+0000","last_undegraded":"2023-10-07T08:44:19.439254+0000","last_fullsized":"2023-10-07T08:44:19.439254+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:25:17.903175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.448159+0000","last_change":"2023-10-07T08:44:18.427786+0000","last_active":"2023-10-07T08:44:19.448159+0000","last_peered":"2023-10-07T08:44:19.448159+0000","last_clean":"2023-10-07T08:44:19.448159+0000","last_became_active":"2023-10-07T08:44:18.427602+0000","last_became_peered":"2023-10-07T08:44:18.427602+0000","last_unstale":"2023-10-07T08:44:19.448159+0000","last_undegraded":"2023-10-07T08:44:19.448159+0000","last_fullsized":"2023-10-07T08:44:19.448159+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:47:50.282887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.443100+0000","last_change":"2023-10-07T08:44:19.443100+0000","last_active":"2023-10-07T08:44:19.443100+0000","last_peered":"2023-10-07T08:44:19.443100+0000","last_clean":"2023-10-07T08:44:19.443100+0000","last_became_active":"2023-10-07T08:44:19.441576+0000","last_became_peered":"2023-10-07T08:44:19.441576+0000","last_unstale":"2023-10-07T08:44:19.443100+0000","last_undegraded":"2023-10-07T08:44:19.443100+0000","last_fullsized":"2023-10-07T08:44:19.443100+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:37:00.692341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.429788+0000","last_change":"2023-10-07T08:44:18.429669+0000","last_active":"2023-10-07T08:44:18.429788+0000","last_peered":"2023-10-07T08:44:18.429788+0000","last_clean":"2023-10-07T08:44:18.429788+0000","last_became_active":"2023-10-07T08:44:18.429048+0000","last_became_peered":"2023-10-07T08:44:18.429048+0000","last_unstale":"2023-10-07T08:44:18.429788+0000","last_undegraded":"2023-10-07T08:44:18.429788+0000","last_fullsized":"2023-10-07T08:44:18.429788+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:11.218571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.432168+0000","last_change":"2023-10-07T08:44:19.432168+0000","last_active":"2023-10-07T08:44:19.432168+0000","last_peered":"2023-10-07T08:44:19.432168+0000","last_clean":"2023-10-07T08:44:19.432168+0000","last_became_active":"2023-10-07T08:44:19.431525+0000","last_became_peered":"2023-10-07T08:44:19.431525+0000","last_unstale":"2023-10-07T08:44:19.432168+0000","last_undegraded":"2023-10-07T08:44:19.432168+0000","last_fullsized":"2023-10-07T08:44:19.432168+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:49:48.932367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.427919+0000","last_change":"2023-10-07T08:44:18.427868+0000","last_active":"2023-10-07T08:44:18.427919+0000","last_peered":"2023-10-07T08:44:18.427919+0000","last_clean":"2023-10-07T08:44:18.427919+0000","last_became_active":"2023-10-07T08:44:18.427678+0000","last_became_peered":"2023-10-07T08:44:18.427678+0000","last_unstale":"2023-10-07T08:44:18.427919+0000","last_undegraded":"2023-10-07T08:44:18.427919+0000","last_fullsized":"2023-10-07T08:44:18.427919+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:11.218571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438068+0000","last_change":"2023-10-07T08:44:19.438068+0000","last_active":"2023-10-07T08:44:19.438068+0000","last_peered":"2023-10-07T08:44:19.438068+0000","last_clean":"2023-10-07T08:44:19.438068+0000","last_became_active":"2023-10-07T08:44:19.437835+0000","last_became_peered":"2023-10-07T08:44:19.437835+0000","last_unstale":"2023-10-07T08:44:19.438068+0000","last_undegraded":"2023-10-07T08:44:19.438068+0000","last_fullsized":"2023-10-07T08:44:19.438068+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:32:14.055400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.451962+0000","last_change":"2023-10-07T08:44:18.425654+0000","last_active":"2023-10-07T08:44:19.451962+0000","last_peered":"2023-10-07T08:44:19.451962+0000","last_clean":"2023-10-07T08:44:19.451962+0000","last_became_active":"2023-10-07T08:44:18.425405+0000","last_became_peered":"2023-10-07T08:44:18.425405+0000","last_unstale":"2023-10-07T08:44:19.451962+0000","last_undegraded":"2023-10-07T08:44:19.451962+0000","last_fullsized":"2023-10-07T08:44:19.451962+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:06:15.317486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434841+0000","last_change":"2023-10-07T08:44:19.434841+0000","last_active":"2023-10-07T08:44:19.434841+0000","last_peered":"2023-10-07T08:44:19.434841+0000","last_clean":"2023-10-07T08:44:19.434841+0000","last_became_active":"2023-10-07T08:44:19.434615+0000","last_became_peered":"2023-10-07T08:44:19.434615+0000","last_unstale":"2023-10-07T08:44:19.434841+0000","last_undegraded":"2023-10-07T08:44:19.434841+0000","last_fullsized":"2023-10-07T08:44:19.434841+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:26:31.716911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.429051+0000","last_change":"2023-10-07T08:44:18.424401+0000","last_active":"2023-10-07T08:44:19.429051+0000","last_peered":"2023-10-07T08:44:19.429051+0000","last_clean":"2023-10-07T08:44:19.429051+0000","last_became_active":"2023-10-07T08:44:18.424181+0000","last_became_peered":"2023-10-07T08:44:18.424181+0000","last_unstale":"2023-10-07T08:44:19.429051+0000","last_undegraded":"2023-10-07T08:44:19.429051+0000","last_fullsized":"2023-10-07T08:44:19.429051+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:00.333076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.437425+0000","last_change":"2023-10-07T08:44:19.437425+0000","last_active":"2023-10-07T08:44:19.437425+0000","last_peered":"2023-10-07T08:44:19.437425+0000","last_clean":"2023-10-07T08:44:19.437425+0000","last_became_active":"2023-10-07T08:44:19.437187+0000","last_became_peered":"2023-10-07T08:44:19.437187+0000","last_unstale":"2023-10-07T08:44:19.437425+0000","last_undegraded":"2023-10-07T08:44:19.437425+0000","last_fullsized":"2023-10-07T08:44:19.437425+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:22:30.235057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.444530+0000","last_change":"2023-10-07T08:44:18.430989+0000","last_active":"2023-10-07T08:44:19.444530+0000","last_peered":"2023-10-07T08:44:19.444530+0000","last_clean":"2023-10-07T08:44:19.444530+0000","last_became_active":"2023-10-07T08:44:18.430711+0000","last_became_peered":"2023-10-07T08:44:18.430711+0000","last_unstale":"2023-10-07T08:44:19.444530+0000","last_undegraded":"2023-10-07T08:44:19.444530+0000","last_fullsized":"2023-10-07T08:44:19.444530+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:41:02.864555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.436458+0000","last_change":"2023-10-07T08:44:19.436458+0000","last_active":"2023-10-07T08:44:19.436458+0000","last_peered":"2023-10-07T08:44:19.436458+0000","last_clean":"2023-10-07T08:44:19.436458+0000","last_became_active":"2023-10-07T08:44:19.436208+0000","last_became_peered":"2023-10-07T08:44:19.436208+0000","last_unstale":"2023-10-07T08:44:19.436458+0000","last_undegraded":"2023-10-07T08:44:19.436458+0000","last_fullsized":"2023-10-07T08:44:19.436458+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:22:11.394408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.426889+0000","last_change":"2023-10-07T08:44:18.430319+0000","last_active":"2023-10-07T08:44:19.426889+0000","last_peered":"2023-10-07T08:44:19.426889+0000","last_clean":"2023-10-07T08:44:19.426889+0000","last_became_active":"2023-10-07T08:44:18.430026+0000","last_became_peered":"2023-10-07T08:44:18.430026+0000","last_unstale":"2023-10-07T08:44:19.426889+0000","last_undegraded":"2023-10-07T08:44:19.426889+0000","last_fullsized":"2023-10-07T08:44:19.426889+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:35.291907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434944+0000","last_change":"2023-10-07T08:44:19.434944+0000","last_active":"2023-10-07T08:44:19.434944+0000","last_peered":"2023-10-07T08:44:19.434944+0000","last_clean":"2023-10-07T08:44:19.434944+0000","last_became_active":"2023-10-07T08:44:19.434698+0000","last_became_peered":"2023-10-07T08:44:19.434698+0000","last_unstale":"2023-10-07T08:44:19.434944+0000","last_undegraded":"2023-10-07T08:44:19.434944+0000","last_fullsized":"2023-10-07T08:44:19.434944+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:05:50.770626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.433926+0000","last_change":"2023-10-07T08:44:18.433865+0000","last_active":"2023-10-07T08:44:18.433926+0000","last_peered":"2023-10-07T08:44:18.433926+0000","last_clean":"2023-10-07T08:44:18.433926+0000","last_became_active":"2023-10-07T08:44:18.433302+0000","last_became_peered":"2023-10-07T08:44:18.433302+0000","last_unstale":"2023-10-07T08:44:18.433926+0000","last_undegraded":"2023-10-07T08:44:18.433926+0000","last_fullsized":"2023-10-07T08:44:18.433926+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:26:33.161268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.430426+0000","last_change":"2023-10-07T08:44:19.430426+0000","last_active":"2023-10-07T08:44:19.430426+0000","last_peered":"2023-10-07T08:44:19.430426+0000","last_clean":"2023-10-07T08:44:19.430426+0000","last_became_active":"2023-10-07T08:44:19.430201+0000","last_became_peered":"2023-10-07T08:44:19.430201+0000","last_unstale":"2023-10-07T08:44:19.430426+0000","last_undegraded":"2023-10-07T08:44:19.430426+0000","last_fullsized":"2023-10-07T08:44:19.430426+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:52.382731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.446226+0000","last_change":"2023-10-07T08:44:18.427436+0000","last_active":"2023-10-07T08:44:19.446226+0000","last_peered":"2023-10-07T08:44:19.446226+0000","last_clean":"2023-10-07T08:44:19.446226+0000","last_became_active":"2023-10-07T08:44:18.427211+0000","last_became_peered":"2023-10-07T08:44:18.427211+0000","last_unstale":"2023-10-07T08:44:19.446226+0000","last_undegraded":"2023-10-07T08:44:19.446226+0000","last_fullsized":"2023-10-07T08:44:19.446226+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:35:42.498147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.433305+0000","last_change":"2023-10-07T08:44:19.433305+0000","last_active":"2023-10-07T08:44:19.433305+0000","last_peered":"2023-10-07T08:44:19.433305+0000","last_clean":"2023-10-07T08:44:19.433305+0000","last_became_active":"2023-10-07T08:44:19.433034+0000","last_became_peered":"2023-10-07T08:44:19.433034+0000","last_unstale":"2023-10-07T08:44:19.433305+0000","last_undegraded":"2023-10-07T08:44:19.433305+0000","last_fullsized":"2023-10-07T08:44:19.433305+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:21:05.206733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.436828+0000","last_change":"2023-10-07T08:44:18.436769+0000","last_active":"2023-10-07T08:44:18.436828+0000","last_peered":"2023-10-07T08:44:18.436828+0000","last_clean":"2023-10-07T08:44:18.436828+0000","last_became_active":"2023-10-07T08:44:18.436383+0000","last_became_peered":"2023-10-07T08:44:18.436383+0000","last_unstale":"2023-10-07T08:44:18.436828+0000","last_undegraded":"2023-10-07T08:44:18.436828+0000","last_fullsized":"2023-10-07T08:44:18.436828+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:36:59.683477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434293+0000","last_change":"2023-10-07T08:44:19.434293+0000","last_active":"2023-10-07T08:44:19.434293+0000","last_peered":"2023-10-07T08:44:19.434293+0000","last_clean":"2023-10-07T08:44:19.434293+0000","last_became_active":"2023-10-07T08:44:19.434041+0000","last_became_peered":"2023-10-07T08:44:19.434041+0000","last_unstale":"2023-10-07T08:44:19.434293+0000","last_undegraded":"2023-10-07T08:44:19.434293+0000","last_fullsized":"2023-10-07T08:44:19.434293+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:27:43.062347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.427238+0000","last_change":"2023-10-07T08:44:18.427153+0000","last_active":"2023-10-07T08:44:18.427238+0000","last_peered":"2023-10-07T08:44:18.427238+0000","last_clean":"2023-10-07T08:44:18.427238+0000","last_became_active":"2023-10-07T08:44:18.426820+0000","last_became_peered":"2023-10-07T08:44:18.426820+0000","last_unstale":"2023-10-07T08:44:18.427238+0000","last_undegraded":"2023-10-07T08:44:18.427238+0000","last_fullsized":"2023-10-07T08:44:18.427238+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:22:10.385544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.443240+0000","last_change":"2023-10-07T08:44:19.443240+0000","last_active":"2023-10-07T08:44:19.443240+0000","last_peered":"2023-10-07T08:44:19.443240+0000","last_clean":"2023-10-07T08:44:19.443240+0000","last_became_active":"2023-10-07T08:44:19.442003+0000","last_became_peered":"2023-10-07T08:44:19.442003+0000","last_unstale":"2023-10-07T08:44:19.443240+0000","last_undegraded":"2023-10-07T08:44:19.443240+0000","last_fullsized":"2023-10-07T08:44:19.443240+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:45:58.316227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.429927+0000","last_change":"2023-10-07T08:44:18.429815+0000","last_active":"2023-10-07T08:44:18.429927+0000","last_peered":"2023-10-07T08:44:18.429927+0000","last_clean":"2023-10-07T08:44:18.429927+0000","last_became_active":"2023-10-07T08:44:18.429408+0000","last_became_peered":"2023-10-07T08:44:18.429408+0000","last_unstale":"2023-10-07T08:44:18.429927+0000","last_undegraded":"2023-10-07T08:44:18.429927+0000","last_fullsized":"2023-10-07T08:44:18.429927+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:21:04.197869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.440831+0000","last_change":"2023-10-07T08:44:19.440831+0000","last_active":"2023-10-07T08:44:19.440831+0000","last_peered":"2023-10-07T08:44:19.440831+0000","last_clean":"2023-10-07T08:44:19.440831+0000","last_became_active":"2023-10-07T08:44:19.440451+0000","last_became_peered":"2023-10-07T08:44:19.440451+0000","last_unstale":"2023-10-07T08:44:19.440831+0000","last_undegraded":"2023-10-07T08:44:19.440831+0000","last_fullsized":"2023-10-07T08:44:19.440831+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:49.359821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.436266+0000","last_change":"2023-10-07T08:44:18.436216+0000","last_active":"2023-10-07T08:44:18.436266+0000","last_peered":"2023-10-07T08:44:18.436266+0000","last_clean":"2023-10-07T08:44:18.436266+0000","last_became_active":"2023-10-07T08:44:18.435806+0000","last_became_peered":"2023-10-07T08:44:18.435806+0000","last_unstale":"2023-10-07T08:44:18.436266+0000","last_undegraded":"2023-10-07T08:44:18.436266+0000","last_fullsized":"2023-10-07T08:44:18.436266+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:40:15.921008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.443452+0000","last_change":"2023-10-07T08:44:19.443452+0000","last_active":"2023-10-07T08:44:19.443452+0000","last_peered":"2023-10-07T08:44:19.443452+0000","last_clean":"2023-10-07T08:44:19.443452+0000","last_became_active":"2023-10-07T08:44:19.442273+0000","last_became_peered":"2023-10-07T08:44:19.442273+0000","last_unstale":"2023-10-07T08:44:19.443452+0000","last_undegraded":"2023-10-07T08:44:19.443452+0000","last_fullsized":"2023-10-07T08:44:19.443452+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:54:21.072698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.434776+0000","last_change":"2023-10-07T08:44:18.434606+0000","last_active":"2023-10-07T08:44:18.434776+0000","last_peered":"2023-10-07T08:44:18.434776+0000","last_clean":"2023-10-07T08:44:18.434776+0000","last_became_active":"2023-10-07T08:44:18.434382+0000","last_became_peered":"2023-10-07T08:44:18.434382+0000","last_unstale":"2023-10-07T08:44:18.434776+0000","last_undegraded":"2023-10-07T08:44:18.434776+0000","last_fullsized":"2023-10-07T08:44:18.434776+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:05:35.588784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434057+0000","last_change":"2023-10-07T08:44:19.434057+0000","last_active":"2023-10-07T08:44:19.434057+0000","last_peered":"2023-10-07T08:44:19.434057+0000","last_clean":"2023-10-07T08:44:19.434057+0000","last_became_active":"2023-10-07T08:44:19.433818+0000","last_became_peered":"2023-10-07T08:44:19.433818+0000","last_unstale":"2023-10-07T08:44:19.434057+0000","last_undegraded":"2023-10-07T08:44:19.434057+0000","last_fullsized":"2023-10-07T08:44:19.434057+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:54:21.072698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.428560+0000","last_change":"2023-10-07T08:44:18.428516+0000","last_active":"2023-10-07T08:44:18.428560+0000","last_peered":"2023-10-07T08:44:18.428560+0000","last_clean":"2023-10-07T08:44:18.428560+0000","last_became_active":"2023-10-07T08:44:18.427964+0000","last_became_peered":"2023-10-07T08:44:18.427964+0000","last_unstale":"2023-10-07T08:44:18.428560+0000","last_undegraded":"2023-10-07T08:44:18.428560+0000","last_fullsized":"2023-10-07T08:44:18.428560+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:55:18.119106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.435136+0000","last_change":"2023-10-07T08:44:19.435136+0000","last_active":"2023-10-07T08:44:19.435136+0000","last_peered":"2023-10-07T08:44:19.435136+0000","last_clean":"2023-10-07T08:44:19.435136+0000","last_became_active":"2023-10-07T08:44:19.434930+0000","last_became_peered":"2023-10-07T08:44:19.434930+0000","last_unstale":"2023-10-07T08:44:19.435136+0000","last_undegraded":"2023-10-07T08:44:19.435136+0000","last_fullsized":"2023-10-07T08:44:19.435136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:59.517132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.435735+0000","last_change":"2023-10-07T08:44:18.435670+0000","last_active":"2023-10-07T08:44:18.435735+0000","last_peered":"2023-10-07T08:44:18.435735+0000","last_clean":"2023-10-07T08:44:18.435735+0000","last_became_active":"2023-10-07T08:44:18.435405+0000","last_became_peered":"2023-10-07T08:44:18.435405+0000","last_unstale":"2023-10-07T08:44:18.435735+0000","last_undegraded":"2023-10-07T08:44:18.435735+0000","last_fullsized":"2023-10-07T08:44:18.435735+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:26:33.161268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438107+0000","last_change":"2023-10-07T08:44:19.438107+0000","last_active":"2023-10-07T08:44:19.438107+0000","last_peered":"2023-10-07T08:44:19.438107+0000","last_clean":"2023-10-07T08:44:19.438107+0000","last_became_active":"2023-10-07T08:44:19.437336+0000","last_became_peered":"2023-10-07T08:44:19.437336+0000","last_unstale":"2023-10-07T08:44:19.438107+0000","last_undegraded":"2023-10-07T08:44:19.438107+0000","last_fullsized":"2023-10-07T08:44:19.438107+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:13:25.158745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.433120+0000","last_change":"2023-10-07T08:44:18.432279+0000","last_active":"2023-10-07T08:44:18.433120+0000","last_peered":"2023-10-07T08:44:18.433120+0000","last_clean":"2023-10-07T08:44:18.433120+0000","last_became_active":"2023-10-07T08:44:18.432058+0000","last_became_peered":"2023-10-07T08:44:18.432058+0000","last_unstale":"2023-10-07T08:44:18.433120+0000","last_undegraded":"2023-10-07T08:44:18.433120+0000","last_fullsized":"2023-10-07T08:44:18.433120+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:05:49.761762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.434853+0000","last_change":"2023-10-07T08:44:19.434853+0000","last_active":"2023-10-07T08:44:19.434853+0000","last_peered":"2023-10-07T08:44:19.434853+0000","last_clean":"2023-10-07T08:44:19.434853+0000","last_became_active":"2023-10-07T08:44:19.434626+0000","last_became_peered":"2023-10-07T08:44:19.434626+0000","last_unstale":"2023-10-07T08:44:19.434853+0000","last_undegraded":"2023-10-07T08:44:19.434853+0000","last_fullsized":"2023-10-07T08:44:19.434853+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:54:21.072698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.434930+0000","last_change":"2023-10-07T08:44:18.434867+0000","last_active":"2023-10-07T08:44:18.434930+0000","last_peered":"2023-10-07T08:44:18.434930+0000","last_clean":"2023-10-07T08:44:18.434930+0000","last_became_active":"2023-10-07T08:44:18.434634+0000","last_became_peered":"2023-10-07T08:44:18.434634+0000","last_unstale":"2023-10-07T08:44:18.434930+0000","last_undegraded":"2023-10-07T08:44:18.434930+0000","last_fullsized":"2023-10-07T08:44:18.434930+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:25:16.894311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.438085+0000","last_change":"2023-10-07T08:44:19.438085+0000","last_active":"2023-10-07T08:44:19.438085+0000","last_peered":"2023-10-07T08:44:19.438085+0000","last_clean":"2023-10-07T08:44:19.438085+0000","last_became_active":"2023-10-07T08:44:19.437139+0000","last_became_peered":"2023-10-07T08:44:19.437139+0000","last_unstale":"2023-10-07T08:44:19.438085+0000","last_undegraded":"2023-10-07T08:44:19.438085+0000","last_fullsized":"2023-10-07T08:44:19.438085+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:05:36.597647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.428413+0000","last_change":"2023-10-07T08:44:18.428355+0000","last_active":"2023-10-07T08:44:18.428413+0000","last_peered":"2023-10-07T08:44:18.428413+0000","last_clean":"2023-10-07T08:44:18.428413+0000","last_became_active":"2023-10-07T08:44:18.428123+0000","last_became_peered":"2023-10-07T08:44:18.428123+0000","last_unstale":"2023-10-07T08:44:18.428413+0000","last_undegraded":"2023-10-07T08:44:18.428413+0000","last_fullsized":"2023-10-07T08:44:18.428413+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:30.317930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.435811+0000","last_change":"2023-10-07T08:44:19.435811+0000","last_active":"2023-10-07T08:44:19.435811+0000","last_peered":"2023-10-07T08:44:19.435811+0000","last_clean":"2023-10-07T08:44:19.435811+0000","last_became_active":"2023-10-07T08:44:19.435422+0000","last_became_peered":"2023-10-07T08:44:19.435422+0000","last_unstale":"2023-10-07T08:44:19.435811+0000","last_undegraded":"2023-10-07T08:44:19.435811+0000","last_fullsized":"2023-10-07T08:44:19.435811+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:18.411706+0000","last_clean_scrub_stamp":"2023-10-07T08:44:18.411706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:39:42.693839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-07T08:44:19.443743+0000","last_change":"2023-10-07T08:44:18.425306+0000","last_active":"2023-10-07T08:44:19.443743+0000","last_peered":"2023-10-07T08:44:19.443743+0000","last_clean":"2023-10-07T08:44:19.443743+0000","last_became_active":"2023-10-07T08:44:18.425038+0000","last_became_peered":"2023-10-07T08:44:18.425038+0000","last_unstale":"2023-10-07T08:44:19.443743+0000","last_undegraded":"2023-10-07T08:44:19.443743+0000","last_fullsized":"2023-10-07T08:44:19.443743+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:44:17.402843+0000","last_clean_scrub_stamp":"2023-10-07T08:44:17.402843+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:05:35.588784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-07T08:44:18.423738+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:44:18.423738+0000","last_peered":"2023-10-07T08:44:18.423738+0000","last_clean":"2023-10-07T08:44:18.423738+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:44:18.423738+0000","last_undegraded":"2023-10-07T08:44:18.423738+0000","last_fullsized":"2023-10-07T08:44:18.423738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":782,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194530,"statfs":{"total":200000000,"available":199199010,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.48599999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":6.8570000000000002,"5min":6.8570000000000002,"15min":6.8570000000000002},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.78800000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.73699999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.81000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":212,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195100,"statfs":{"total":200000000,"available":199782615,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.34399999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.5},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.51500000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.57899999999999996}]},{"osd":3,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":2.3879999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.68700000000000006}]},{"osd":5,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.748}]},{"osd":7,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195106,"statfs":{"total":200000000,"available":199789378,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:43:48 2023","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.33900000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:43:48 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.311},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.32500000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:43:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.29499999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:43:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.504}]},{"osd":5,"last update":"Sat Oct 7 08:43:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.72799999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:43:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.54200000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:43:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.66900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":788,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194523,"statfs":{"total":200000000,"available":199192213,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.215},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.372}]},{"osd":3,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.44600000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.495}]},{"osd":6,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.54400000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.43099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":213,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195098,"statfs":{"total":200000000,"available":199781057,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.372}]},{"osd":1,"last update":"Sat Oct 7 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.34399999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.28899999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.504},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.57899999999999996}]},{"osd":6,"last update":"Sat Oct 7 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.70699999999999996}]},{"osd":7,"last update":"Sat Oct 7 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.52800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195106,"statfs":{"total":200000000,"available":199789378,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.371}]},{"osd":1,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.255},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.501}]},{"osd":2,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.39500000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.41299999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.45900000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.622},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.432}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":213,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195098,"statfs":{"total":200000000,"available":199781079,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.32300000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.376},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.30599999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.35799999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.44}]},{"osd":6,"last update":"Sat Oct 7 08:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.48899999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.498}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":212,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195100,"statfs":{"total":200000000,"available":199782545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.52200000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.69199999999999995}]},{"osd":2,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.71599999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.66600000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.499},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.47599999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.46100000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.40000000000000002}]}]}],"pool_statfs":[]}} 2023-10-07T08:44:23.863 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T08:44:23.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T08:44:24.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.015+0000 7f951359e700 1 Processor -- start 2023-10-07T08:44:24.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.015+0000 7f951359e700 1 -- start start 2023-10-07T08:44:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.015+0000 7f951359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95140b1ef0 0x7f951406da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.015+0000 7f951359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f951406f4f0 0x7f95140b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.015+0000 7f951359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9514068d40 con 0x7f95140b2800 2023-10-07T08:44:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.015+0000 7f951359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951415a520 con 0x7f951406f4f0 2023-10-07T08:44:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.015+0000 7f951359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951406e2d0 con 0x7f95140b1ef0 2023-10-07T08:44:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.016+0000 7f9509d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f951406f4f0 0x7f95140b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.016+0000 7f9512d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f95140b2800 0x7f95140691d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32868/0 (socket says 172.21.15.81:32868) 2023-10-07T08:44:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.016+0000 7f9512d9d700 1 -- 172.21.15.81:0/2191129285 learned_addr learned my addr 172.21.15.81:0/2191129285 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.016+0000 7f951259c700 1 --2- 172.21.15.81:0/2191129285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95140b1ef0 0x7f951406da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.016+0000 7f9509d9b700 1 -- 172.21.15.81:0/2191129285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95140b1ef0 msgr2=0x7f951406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.016+0000 7f9509d9b700 1 --2- 172.21.15.81:0/2191129285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95140b1ef0 0x7f951406da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.016+0000 7f9509d9b700 1 -- 172.21.15.81:0/2191129285 >> v1:172.21.15.81:6789/0 conn(0x7f95140b2800 legacy=0x7f95140691d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.016+0000 7f9509d9b700 1 -- 172.21.15.81:0/2191129285 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95140686f0 con 0x7f951406f4f0 2023-10-07T08:44:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.016+0000 7f9511d9b700 1 -- 172.21.15.81:0/2191129285 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418079057 0 0) 0x7f9514068d40 con 0x7f95140b2800 2023-10-07T08:44:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.016+0000 7f951259c700 1 --2- 172.21.15.81:0/2191129285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95140b1ef0 0x7f951406da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.016+0000 7f9509d9b700 1 --2- 172.21.15.81:0/2191129285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f951406f4f0 0x7f95140b22c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f94fc0098e0 tx=0x7f94fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba6461cd3f4efa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.016+0000 7f9511d9b700 1 -- 172.21.15.81:0/2191129285 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc009e80 con 0x7f951406f4f0 2023-10-07T08:44:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.016+0000 7f9511d9b700 1 -- 172.21.15.81:0/2191129285 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94fc00b860 con 0x7f951406f4f0 2023-10-07T08:44:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.016+0000 7f9511d9b700 1 -- 172.21.15.81:0/2191129285 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc00bbe0 con 0x7f951406f4f0 2023-10-07T08:44:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.017+0000 7f951359e700 1 -- 172.21.15.81:0/2191129285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f951406f4f0 msgr2=0x7f95140b22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.017+0000 7f951359e700 1 --2- 172.21.15.81:0/2191129285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f951406f4f0 0x7f95140b22c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f94fc0098e0 tx=0x7f94fc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.017+0000 7f951359e700 1 -- 172.21.15.81:0/2191129285 shutdown_connections 2023-10-07T08:44:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.017+0000 7f951359e700 1 --2- 172.21.15.81:0/2191129285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95140b1ef0 0x7f951406da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.017+0000 7f951359e700 1 --2- 172.21.15.81:0/2191129285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f951406f4f0 0x7f95140b22c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.017+0000 7f951359e700 1 -- 172.21.15.81:0/2191129285 >> 172.21.15.81:0/2191129285 conn(0x7f95140d0bb0 msgr2=0x7f95140d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.017+0000 7f951359e700 1 -- 172.21.15.81:0/2191129285 shutdown_connections 2023-10-07T08:44:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.017+0000 7f951359e700 1 -- 172.21.15.81:0/2191129285 wait complete. 2023-10-07T08:44:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.018+0000 7f951359e700 1 Processor -- start 2023-10-07T08:44:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.018+0000 7f951359e700 1 -- start start 2023-10-07T08:44:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f951359e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f951406f4f0 0x7f9514142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f951359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95140b1ef0 0x7f951415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f951359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95140b2800 0x7f951415f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f951359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9514152ce0 con 0x7f95140b1ef0 2023-10-07T08:44:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f951359e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9514152110 con 0x7f951406f4f0 2023-10-07T08:44:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f951359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95141523b0 con 0x7f95140b2800 2023-10-07T08:44:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f9509d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95140b1ef0 0x7f951415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f9509d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95140b1ef0 0x7f951415ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48526/0 (socket says 172.21.15.81:48526) 2023-10-07T08:44:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f9509d9b700 1 -- 172.21.15.81:0/2306742184 learned_addr learned my addr 172.21.15.81:0/2306742184 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f9512d9d700 1 --2- 172.21.15.81:0/2306742184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95140b2800 0x7f951415f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f951259c700 1 --2- 172.21.15.81:0/2306742184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f951406f4f0 0x7f9514142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f9509d9b700 1 -- 172.21.15.81:0/2306742184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95140b2800 msgr2=0x7f951415f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f9509d9b700 1 --2- 172.21.15.81:0/2306742184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95140b2800 0x7f951415f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f9509d9b700 1 -- 172.21.15.81:0/2306742184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f951406f4f0 msgr2=0x7f9514142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f9509d9b700 1 --2- 172.21.15.81:0/2306742184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f951406f4f0 0x7f9514142650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f9509d9b700 1 -- 172.21.15.81:0/2306742184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc009420 con 0x7f95140b1ef0 2023-10-07T08:44:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f951259c700 1 --2- 172.21.15.81:0/2306742184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f951406f4f0 0x7f9514142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f9512d9d700 1 --2- 172.21.15.81:0/2306742184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95140b2800 0x7f951415f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f9509d9b700 1 --2- 172.21.15.81:0/2306742184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95140b1ef0 0x7f951415ecd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f95140713d0 tx=0x7f94fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f950affd700 1 -- 172.21.15.81:0/2306742184 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc00bbe0 con 0x7f95140b1ef0 2023-10-07T08:44:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f950affd700 1 -- 172.21.15.81:0/2306742184 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94fc011420 con 0x7f95140b1ef0 2023-10-07T08:44:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f950affd700 1 -- 172.21.15.81:0/2306742184 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc0117c0 con 0x7f95140b1ef0 2023-10-07T08:44:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f951359e700 1 -- 172.21.15.81:0/2306742184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9514152690 con 0x7f95140b1ef0 2023-10-07T08:44:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.019+0000 7f951359e700 1 -- 172.21.15.81:0/2306742184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9514153170 con 0x7f95140b1ef0 2023-10-07T08:44:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.020+0000 7f951359e700 1 -- 172.21.15.81:0/2306742184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9514067b70 con 0x7f95140b1ef0 2023-10-07T08:44:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.021+0000 7f950affd700 1 -- 172.21.15.81:0/2306742184 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f94fc011bb0 con 0x7f95140b1ef0 2023-10-07T08:44:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.021+0000 7f950affd700 1 --2- 172.21.15.81:0/2306742184 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f94f4066f30 0x7f94f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.021+0000 7f950affd700 1 -- 172.21.15.81:0/2306742184 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f94fc085c60 con 0x7f95140b1ef0 2023-10-07T08:44:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.021+0000 7f951259c700 1 --2- 172.21.15.81:0/2306742184 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f94f4066f30 0x7f94f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.021+0000 7f951259c700 1 --2- 172.21.15.81:0/2306742184 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f94f4066f30 0x7f94f40693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9504008b20 tx=0x7f9504008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.025+0000 7f950affd700 1 -- 172.21.15.81:0/2306742184 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94fc052ed0 con 0x7f95140b1ef0 2023-10-07T08:44:24.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.279+0000 7f951359e700 1 -- 172.21.15.81:0/2306742184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9514152e20 con 0x7f95140b1ef0 2023-10-07T08:44:24.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.283+0000 7f950affd700 1 -- 172.21.15.81:0/2306742184 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7f94fc011e60 con 0x7f95140b1ef0 2023-10-07T08:44:24.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.285+0000 7f951359e700 1 -- 172.21.15.81:0/2306742184 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f94f4066f30 msgr2=0x7f94f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:24.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.285+0000 7f951359e700 1 --2- 172.21.15.81:0/2306742184 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f94f4066f30 0x7f94f40693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9504008b20 tx=0x7f9504008040 comp rx=0 tx=0).stop 2023-10-07T08:44:24.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.285+0000 7f951359e700 1 -- 172.21.15.81:0/2306742184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95140b1ef0 msgr2=0x7f951415ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:24.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.285+0000 7f951359e700 1 --2- 172.21.15.81:0/2306742184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95140b1ef0 0x7f951415ecd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f95140713d0 tx=0x7f94fc017000 comp rx=0 tx=0).stop 2023-10-07T08:44:24.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.285+0000 7f951359e700 1 -- 172.21.15.81:0/2306742184 shutdown_connections 2023-10-07T08:44:24.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.285+0000 7f951359e700 1 --2- 172.21.15.81:0/2306742184 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f94f4066f30 0x7f94f40693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.285+0000 7f951359e700 1 --2- 172.21.15.81:0/2306742184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95140b2800 0x7f951415f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.285+0000 7f951359e700 1 --2- 172.21.15.81:0/2306742184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f951406f4f0 0x7f9514142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.285+0000 7f951359e700 1 --2- 172.21.15.81:0/2306742184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95140b1ef0 0x7f951415ecd0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.285+0000 7f951359e700 1 -- 172.21.15.81:0/2306742184 >> 172.21.15.81:0/2306742184 conn(0x7f95140d0bb0 msgr2=0x7f95140b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:24.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.285+0000 7f951359e700 1 -- 172.21.15.81:0/2306742184 shutdown_connections 2023-10-07T08:44:24.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.285+0000 7f951359e700 1 -- 172.21.15.81:0/2306742184 wait complete. 2023-10-07T08:44:24.288 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-07T08:44:24.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:44:24.397 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-10-07T08:44:24.396+0000 7fc9a730b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:44:24.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.410+0000 7f1ec2864700 1 Processor -- start 2023-10-07T08:44:24.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.410+0000 7f1ec2864700 1 -- start start 2023-10-07T08:44:24.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.411+0000 7f1ec2864700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06d830 0x7f1ebc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.411+0000 7f1ec2864700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ebc0d07c0 con 0x7f1ebc157ca0 2023-10-07T08:44:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.411+0000 7f1ec2864700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ebc0cfbb0 con 0x7f1ebc1578d0 2023-10-07T08:44:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.411+0000 7f1ec2864700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc0cfe90 con 0x7f1ebc06d830 2023-10-07T08:44:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.411+0000 7f1ebb7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1ebc157ca0 0x7f1ebc06d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32874/0 (socket says 172.21.15.81:32874) 2023-10-07T08:44:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.411+0000 7f1ebb7fe700 1 -- 172.21.15.81:0/2658095605 learned_addr learned my addr 172.21.15.81:0/2658095605 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.411+0000 7f1ec0e01700 1 --2- 172.21.15.81:0/2658095605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06d830 0x7f1ebc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.412+0000 7f1ebaffd700 1 -- 172.21.15.81:0/2658095605 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117394173 0 0) 0x7f1ebc0d07c0 con 0x7f1ebc157ca0 2023-10-07T08:44:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.412+0000 7f1ebaffd700 1 -- 172.21.15.81:0/2658095605 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ea4003570 con 0x7f1ebc157ca0 2023-10-07T08:44:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.412+0000 7f1ebaffd700 1 -- 172.21.15.81:0/2658095605 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517685387 0 0) 0x7f1ebc0cfbb0 con 0x7f1ebc1578d0 2023-10-07T08:44:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.412+0000 7f1ebaffd700 1 -- 172.21.15.81:0/2658095605 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ebc0d07c0 con 0x7f1ebc1578d0 2023-10-07T08:44:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.412+0000 7f1ec0e01700 1 -- 172.21.15.81:0/2658095605 >> v1:172.21.15.89:6789/0 conn(0x7f1ebc1578d0 legacy=0x7f1ebc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.412+0000 7f1ec0e01700 1 -- 172.21.15.81:0/2658095605 >> v1:172.21.15.81:6789/0 conn(0x7f1ebc157ca0 legacy=0x7f1ebc06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.412+0000 7f1ebaffd700 1 -- 172.21.15.81:0/2658095605 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3041296680 0 0) 0x7f1ea4003570 con 0x7f1ebc157ca0 2023-10-07T08:44:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.412+0000 7f1ec0e01700 1 -- 172.21.15.81:0/2658095605 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ebc0d0170 con 0x7f1ebc06d830 2023-10-07T08:44:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.412+0000 7f1ec0e01700 1 --2- 172.21.15.81:0/2658095605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06d830 0x7f1ebc0cf4f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4009e90 tx=0x7f1eb4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59875b5024dbf934 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.412+0000 7f1ebaffd700 1 -- 172.21.15.81:0/2658095605 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb400e070 con 0x7f1ebc06d830 2023-10-07T08:44:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.412+0000 7f1ebaffd700 1 -- 172.21.15.81:0/2658095605 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb400b870 con 0x7f1ebc06d830 2023-10-07T08:44:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.412+0000 7f1ebaffd700 1 -- 172.21.15.81:0/2658095605 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0001470 con 0x7f1ebc06d830 2023-10-07T08:44:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.413+0000 7f1ec2864700 1 -- 172.21.15.81:0/2658095605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06d830 msgr2=0x7f1ebc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.413+0000 7f1ec2864700 1 --2- 172.21.15.81:0/2658095605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06d830 0x7f1ebc0cf4f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4009e90 tx=0x7f1eb4009780 comp rx=0 tx=0).stop 2023-10-07T08:44:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.413+0000 7f1ec2864700 1 -- 172.21.15.81:0/2658095605 shutdown_connections 2023-10-07T08:44:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.413+0000 7f1ec2864700 1 --2- 172.21.15.81:0/2658095605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06d830 0x7f1ebc0cf4f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.413+0000 7f1ec2864700 1 -- 172.21.15.81:0/2658095605 >> 172.21.15.81:0/2658095605 conn(0x7f1ebc06bb90 msgr2=0x7f1ebc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.413+0000 7f1ec2864700 1 -- 172.21.15.81:0/2658095605 shutdown_connections 2023-10-07T08:44:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.413+0000 7f1ec2864700 1 -- 172.21.15.81:0/2658095605 wait complete. 2023-10-07T08:44:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.414+0000 7f1ec2864700 1 Processor -- start 2023-10-07T08:44:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.414+0000 7f1ec2864700 1 -- start start 2023-10-07T08:44:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ec2864700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06d830 0x7f1ebc0c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ec2864700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ebc1578d0 0x7f1ebc153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ec2864700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ebc157ca0 0x7f1ebc15ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ec2864700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc0c8170 con 0x7f1ebc157ca0 2023-10-07T08:44:24.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ec2864700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc0cd940 con 0x7f1ebc1578d0 2023-10-07T08:44:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ec2864700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc0b3ed0 con 0x7f1ebc06d830 2023-10-07T08:44:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ec0e01700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ebc157ca0 0x7f1ebc15ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ec0e01700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ebc157ca0 0x7f1ebc15ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48538/0 (socket says 172.21.15.81:48538) 2023-10-07T08:44:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ec0e01700 1 -- 172.21.15.81:0/1518586497 learned_addr learned my addr 172.21.15.81:0/1518586497 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ebbfff700 1 --2- 172.21.15.81:0/1518586497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06d830 0x7f1ebc0c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ebb7fe700 1 --2- 172.21.15.81:0/1518586497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ebc1578d0 0x7f1ebc153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ec0e01700 1 -- 172.21.15.81:0/1518586497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06d830 msgr2=0x7f1ebc0c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ec0e01700 1 --2- 172.21.15.81:0/1518586497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06d830 0x7f1ebc0c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ec0e01700 1 -- 172.21.15.81:0/1518586497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ebc1578d0 msgr2=0x7f1ebc153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ec0e01700 1 --2- 172.21.15.81:0/1518586497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ebc1578d0 0x7f1ebc153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ec0e01700 1 -- 172.21.15.81:0/1518586497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb4009a20 con 0x7f1ebc157ca0 2023-10-07T08:44:24.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ebb7fe700 1 --2- 172.21.15.81:0/1518586497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ebc1578d0 0x7f1ebc153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:24.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ec0e01700 1 --2- 172.21.15.81:0/1518586497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ebc157ca0 0x7f1ebc15ea10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4003000 tx=0x7f1eb4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:24.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.415+0000 7f1ea3fff700 1 -- 172.21.15.81:0/1518586497 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4012c60 con 0x7f1ebc157ca0 2023-10-07T08:44:24.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.416+0000 7f1ea3fff700 1 -- 172.21.15.81:0/1518586497 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb4012de0 con 0x7f1ebc157ca0 2023-10-07T08:44:24.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.416+0000 7f1ec2864700 1 -- 172.21.15.81:0/1518586497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ebc0b41b0 con 0x7f1ebc157ca0 2023-10-07T08:44:24.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.416+0000 7f1ea3fff700 1 -- 172.21.15.81:0/1518586497 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb401e6a0 con 0x7f1ebc157ca0 2023-10-07T08:44:24.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.416+0000 7f1ec2864700 1 -- 172.21.15.81:0/1518586497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ebc0b4540 con 0x7f1ebc157ca0 2023-10-07T08:44:24.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.416+0000 7f1ec2864700 1 -- 172.21.15.81:0/1518586497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ebc15d1b0 con 0x7f1ebc157ca0 2023-10-07T08:44:24.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.417+0000 7f1ea3fff700 1 -- 172.21.15.81:0/1518586497 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1eb401ea10 con 0x7f1ebc157ca0 2023-10-07T08:44:24.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.417+0000 7f1ea3fff700 1 --2- 172.21.15.81:0/1518586497 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1ea8066f30 0x7f1ea80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:24.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.417+0000 7f1ea3fff700 1 -- 172.21.15.81:0/1518586497 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1eb40868f0 con 0x7f1ebc157ca0 2023-10-07T08:44:24.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.417+0000 7f1ebbfff700 1 --2- 172.21.15.81:0/1518586497 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1ea8066f30 0x7f1ea80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:24.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.418+0000 7f1ebbfff700 1 --2- 172.21.15.81:0/1518586497 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1ea8066f30 0x7f1ea80693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1eac007fd0 tx=0x7f1eac007d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:24.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.421+0000 7f1ea3fff700 1 -- 172.21.15.81:0/1518586497 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1eb4053b60 con 0x7f1ebc157ca0 2023-10-07T08:44:24.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.646+0000 7f1ec2864700 1 -- 172.21.15.81:0/1518586497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ebc0d0450 con 0x7f1ebc157ca0 2023-10-07T08:44:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.646+0000 7f1ea3fff700 1 -- 172.21.15.81:0/1518586497 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f1eb4057180 con 0x7f1ebc157ca0 2023-10-07T08:44:24.648 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:24.648 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1491348117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1491348117},{"type":"v1","addr":"172.21.15.89:6834","nonce":1491348117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/748490276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":748490276},{"type":"v1","addr":"172.21.15.89:6835","nonce":748490276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2260626922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2260626922},{"type":"v1","addr":"172.21.15.81:6835","nonce":2260626922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:44:18.798458+0000","modified":"2023-10-07T08:44:22.459128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5340":{"gid":5340,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2750584146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2750584146},{"type":"v1","addr":"172.21.15.81:6837","nonce":2750584146}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-07T08:44:24.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.648+0000 7f1ec2864700 1 -- 172.21.15.81:0/1518586497 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1ea8066f30 msgr2=0x7f1ea80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:24.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.648+0000 7f1ec2864700 1 --2- 172.21.15.81:0/1518586497 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1ea8066f30 0x7f1ea80693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1eac007fd0 tx=0x7f1eac007d10 comp rx=0 tx=0).stop 2023-10-07T08:44:24.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.648+0000 7f1ec2864700 1 -- 172.21.15.81:0/1518586497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ebc157ca0 msgr2=0x7f1ebc15ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:24.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.648+0000 7f1ec2864700 1 --2- 172.21.15.81:0/1518586497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ebc157ca0 0x7f1ebc15ea10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4003000 tx=0x7f1eb4017000 comp rx=0 tx=0).stop 2023-10-07T08:44:24.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.648+0000 7f1ec2864700 1 -- 172.21.15.81:0/1518586497 shutdown_connections 2023-10-07T08:44:24.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.648+0000 7f1ec2864700 1 --2- 172.21.15.81:0/1518586497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ebc157ca0 0x7f1ebc15ea10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.648+0000 7f1ec2864700 1 --2- 172.21.15.81:0/1518586497 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1ea8066f30 0x7f1ea80693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.648+0000 7f1ec2864700 1 --2- 172.21.15.81:0/1518586497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06d830 0x7f1ebc0c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.648+0000 7f1ec2864700 1 --2- 172.21.15.81:0/1518586497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ebc1578d0 0x7f1ebc153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:24.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.648+0000 7f1ec2864700 1 -- 172.21.15.81:0/1518586497 >> 172.21.15.81:0/1518586497 conn(0x7f1ebc06bb90 msgr2=0x7f1ebc1558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:24.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.648+0000 7f1ec2864700 1 -- 172.21.15.81:0/1518586497 shutdown_connections 2023-10-07T08:44:24.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:24.648+0000 7f1ec2864700 1 -- 172.21.15.81:0/1518586497 wait complete. 2023-10-07T08:44:24.651 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2023-10-07T08:44:25.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:44:25.047 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:44:25.064 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T08:44:18.798458+0000', 'modified': '2023-10-07T08:44:22.459128+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5340}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5340': {'gid': 5340, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/2750584146', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 2750584146}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2750584146}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T08:44:25.064 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T08:44:25.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-07T08:44:25.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.201+0000 7f3f00795700 1 Processor -- start 2023-10-07T08:44:25.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.201+0000 7f3f00795700 1 -- start start 2023-10-07T08:44:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.202+0000 7f3f00795700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ef81578d0 0x7f3ef80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.202+0000 7f3f00795700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ef8157ca0 0x7f3ef815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.202+0000 7f3f00795700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef80d07c0 con 0x7f3ef806d120 2023-10-07T08:44:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.202+0000 7f3f00795700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef80cfbb0 con 0x7f3ef8157ca0 2023-10-07T08:44:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.202+0000 7f3f00795700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80cfe90 con 0x7f3ef81578d0 2023-10-07T08:44:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.202+0000 7f3efdd30700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ef8157ca0 0x7f3ef815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.202+0000 7f3efdd30700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ef8157ca0 0x7f3ef815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48548/0 (socket says 172.21.15.81:48548) 2023-10-07T08:44:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.202+0000 7f3efdd30700 1 -- 172.21.15.81:0/1304095014 learned_addr learned my addr 172.21.15.81:0/1304095014 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.202+0000 7f3efe531700 1 --2- 172.21.15.81:0/1304095014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ef81578d0 0x7f3ef80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.202+0000 7f3efdd30700 1 -- 172.21.15.81:0/1304095014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ef81578d0 msgr2=0x7f3ef80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.202+0000 7f3efdd30700 1 --2- 172.21.15.81:0/1304095014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ef81578d0 0x7f3ef80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.202+0000 7f3efdd30700 1 -- 172.21.15.81:0/1304095014 >> v1:172.21.15.89:6789/0 conn(0x7f3ef806d120 legacy=0x7f3ef815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.202+0000 7f3efdd30700 1 -- 172.21.15.81:0/1304095014 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80d0170 con 0x7f3ef8157ca0 2023-10-07T08:44:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.202+0000 7f3efe531700 1 --2- 172.21.15.81:0/1304095014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ef81578d0 0x7f3ef80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.203+0000 7f3efdd30700 1 --2- 172.21.15.81:0/1304095014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ef8157ca0 0x7f3ef815af00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80099b0 tx=0x7f3ee8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17459befd8eb3ce6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.203+0000 7f3efd52f700 1 -- 172.21.15.81:0/1304095014 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee800b820 con 0x7f3ef8157ca0 2023-10-07T08:44:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.203+0000 7f3efd52f700 1 -- 172.21.15.81:0/1304095014 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee800b980 con 0x7f3ef8157ca0 2023-10-07T08:44:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.203+0000 7f3efd52f700 1 -- 172.21.15.81:0/1304095014 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee800bd20 con 0x7f3ef8157ca0 2023-10-07T08:44:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.203+0000 7f3f00795700 1 -- 172.21.15.81:0/1304095014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ef8157ca0 msgr2=0x7f3ef815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.203+0000 7f3f00795700 1 --2- 172.21.15.81:0/1304095014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ef8157ca0 0x7f3ef815af00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80099b0 tx=0x7f3ee8009250 comp rx=0 tx=0).stop 2023-10-07T08:44:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.203+0000 7f3f00795700 1 -- 172.21.15.81:0/1304095014 shutdown_connections 2023-10-07T08:44:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.203+0000 7f3f00795700 1 --2- 172.21.15.81:0/1304095014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ef81578d0 0x7f3ef80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.203+0000 7f3f00795700 1 --2- 172.21.15.81:0/1304095014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ef8157ca0 0x7f3ef815af00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.203+0000 7f3f00795700 1 -- 172.21.15.81:0/1304095014 >> 172.21.15.81:0/1304095014 conn(0x7f3ef806bb90 msgr2=0x7f3ef806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.203+0000 7f3f00795700 1 -- 172.21.15.81:0/1304095014 shutdown_connections 2023-10-07T08:44:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.203+0000 7f3f00795700 1 -- 172.21.15.81:0/1304095014 wait complete. 2023-10-07T08:44:25.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.204+0000 7f3f00795700 1 Processor -- start 2023-10-07T08:44:25.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.205+0000 7f3f00795700 1 -- start start 2023-10-07T08:44:25.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.205+0000 7f3f00795700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ef806d120 0x7f3ef815c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.205+0000 7f3f00795700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ef81578d0 0x7f3ef80b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.205+0000 7f3f00795700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ef8157ca0 0x7f3ef80b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.205+0000 7f3f00795700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80ad030 con 0x7f3ef8157ca0 2023-10-07T08:44:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.205+0000 7f3f00795700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80ac420 con 0x7f3ef806d120 2023-10-07T08:44:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.205+0000 7f3f00795700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80ac700 con 0x7f3ef81578d0 2023-10-07T08:44:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.205+0000 7f3efed32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ef8157ca0 0x7f3ef80b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.205+0000 7f3efed32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ef8157ca0 0x7f3ef80b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48550/0 (socket says 172.21.15.81:48550) 2023-10-07T08:44:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.205+0000 7f3efed32700 1 -- 172.21.15.81:0/3635205429 learned_addr learned my addr 172.21.15.81:0/3635205429 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.206+0000 7f3efed32700 1 -- 172.21.15.81:0/3635205429 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ef81578d0 msgr2=0x7f3ef80b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.206+0000 7f3efed32700 1 --2- 172.21.15.81:0/3635205429 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ef81578d0 0x7f3ef80b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.206+0000 7f3efed32700 1 -- 172.21.15.81:0/3635205429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ef806d120 msgr2=0x7f3ef815c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.206+0000 7f3efed32700 1 --2- 172.21.15.81:0/3635205429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ef806d120 0x7f3ef815c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.206+0000 7f3efed32700 1 -- 172.21.15.81:0/3635205429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee80094f0 con 0x7f3ef8157ca0 2023-10-07T08:44:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.206+0000 7f3efed32700 1 --2- 172.21.15.81:0/3635205429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ef8157ca0 0x7f3ef80b5260 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000c5b0 tx=0x7f3ef0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.206+0000 7f3eee7fc700 1 -- 172.21.15.81:0/3635205429 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0011590 con 0x7f3ef8157ca0 2023-10-07T08:44:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.206+0000 7f3eee7fc700 1 -- 172.21.15.81:0/3635205429 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef0011710 con 0x7f3ef8157ca0 2023-10-07T08:44:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.206+0000 7f3f00795700 1 -- 172.21.15.81:0/3635205429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef80ac9e0 con 0x7f3ef8157ca0 2023-10-07T08:44:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.206+0000 7f3eee7fc700 1 -- 172.21.15.81:0/3635205429 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0011ad0 con 0x7f3ef8157ca0 2023-10-07T08:44:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.206+0000 7f3f00795700 1 -- 172.21.15.81:0/3635205429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef815c960 con 0x7f3ef8157ca0 2023-10-07T08:44:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.207+0000 7f3eee7fc700 1 -- 172.21.15.81:0/3635205429 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ef001c460 con 0x7f3ef8157ca0 2023-10-07T08:44:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.208+0000 7f3eee7fc700 1 --2- 172.21.15.81:0/3635205429 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3edc066f30 0x7f3edc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.208+0000 7f3eee7fc700 1 -- 172.21.15.81:0/3635205429 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ef0084200 con 0x7f3ef8157ca0 2023-10-07T08:44:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.208+0000 7f3efe531700 1 --2- 172.21.15.81:0/3635205429 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3edc066f30 0x7f3edc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.208+0000 7f3efe531700 1 --2- 172.21.15.81:0/3635205429 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3edc066f30 0x7f3edc0693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400c3d0 tx=0x7f3ef40074d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:25.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.209+0000 7f3f09a8db80 1 Processor -- start 2023-10-07T08:44:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.210+0000 7f3f09a8db80 1 -- start start 2023-10-07T08:44:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.210+0000 7f3f09a8db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65bdb6a50 0x55a65bdb6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.210+0000 7f3f09a8db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65be00d00 0x55a65bddfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.210+0000 7f3f09a8db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65bddff60 0x55a65bdb2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.210+0000 7f3f09a8db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a65bd0da70 con 0x55a65be00d00 2023-10-07T08:44:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.210+0000 7f3f09a8db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a65bd0b270 con 0x55a65bdb6a50 2023-10-07T08:44:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.210+0000 7f3f09a8db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a65bd07060 con 0x55a65bddff60 2023-10-07T08:44:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.210+0000 7f3efdd30700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65be00d00 0x55a65bddfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.210+0000 7f3efdd30700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65be00d00 0x55a65bddfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48558/0 (socket says 172.21.15.81:48558) 2023-10-07T08:44:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.210+0000 7f3efdd30700 1 -- 172.21.15.81:0/3523188025 learned_addr learned my addr 172.21.15.81:0/3523188025 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.210+0000 7f3efe531700 1 --2- 172.21.15.81:0/3523188025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65bdb6a50 0x55a65bdb6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.210+0000 7f3efed32700 1 --2- 172.21.15.81:0/3523188025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65bddff60 0x55a65bdb2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.211+0000 7f3efdd30700 1 -- 172.21.15.81:0/3523188025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65bddff60 msgr2=0x55a65bdb2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.211+0000 7f3efdd30700 1 --2- 172.21.15.81:0/3523188025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65bddff60 0x55a65bdb2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.211+0000 7f3efdd30700 1 -- 172.21.15.81:0/3523188025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65bdb6a50 msgr2=0x55a65bdb6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.211+0000 7f3efdd30700 1 --2- 172.21.15.81:0/3523188025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65bdb6a50 0x55a65bdb6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.211+0000 7f3efdd30700 1 -- 172.21.15.81:0/3523188025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a65bba1270 con 0x55a65be00d00 2023-10-07T08:44:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.211+0000 7f3efdd30700 1 --2- 172.21.15.81:0/3523188025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65be00d00 0x55a65bddfa20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8006fd0 tx=0x7f3ee8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe81a059e6b17b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.211+0000 7f3edb7fe700 1 -- 172.21.15.81:0/3523188025 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8000d10 con 0x55a65be00d00 2023-10-07T08:44:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.211+0000 7f3edb7fe700 1 -- 172.21.15.81:0/3523188025 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee8020070 con 0x55a65be00d00 2023-10-07T08:44:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.211+0000 7f3edb7fe700 1 -- 172.21.15.81:0/3523188025 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee800baf0 con 0x55a65be00d00 2023-10-07T08:44:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.211+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3523188025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65be00d00 msgr2=0x55a65bddfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.211+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/3523188025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65be00d00 0x55a65bddfa20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8006fd0 tx=0x7f3ee8016000 comp rx=0 tx=0).stop 2023-10-07T08:44:25.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.212+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3523188025 shutdown_connections 2023-10-07T08:44:25.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.212+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/3523188025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65bddff60 0x55a65bdb2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.212+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/3523188025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65bdb6a50 0x55a65bdb6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.212+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/3523188025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65be00d00 0x55a65bddfa20 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.212+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3523188025 >> 172.21.15.81:0/3523188025 conn(0x55a65bdb8370 msgr2=0x55a65bdb8740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:25.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.212+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3523188025 shutdown_connections 2023-10-07T08:44:25.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.212+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3523188025 wait complete. 2023-10-07T08:44:25.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.212+0000 7f3f09a8db80 1 -- start start 2023-10-07T08:44:25.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.212+0000 7f3f09a8db80 1 Processor -- start 2023-10-07T08:44:25.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3f09a8db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bdb6a50 0x55a65bddc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3f09a8db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65bddff60 0x55a65bdde3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3f09a8db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65be00d00 0x55a65bdde900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3f09a8db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a65bcb2890 con 0x55a65bdb6a50 2023-10-07T08:44:25.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3f09a8db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a65bccdea0 con 0x55a65be00d00 2023-10-07T08:44:25.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3f09a8db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a65bb89e30 con 0x55a65bddff60 2023-10-07T08:44:25.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3f09a8db80 10 client.0 _ll_register_callbacks cb 0x55a65bd7a110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:44:25.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3efe531700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bdb6a50 0x55a65bddc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3efe531700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bdb6a50 0x55a65bddc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48574/0 (socket says 172.21.15.81:48574) 2023-10-07T08:44:25.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3efe531700 1 -- 172.21.15.81:0/3257715125 learned_addr learned my addr 172.21.15.81:0/3257715125 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:25.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3efdd30700 1 --2- 172.21.15.81:0/3257715125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65bddff60 0x55a65bdde3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3efed32700 1 --2- 172.21.15.81:0/3257715125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65be00d00 0x55a65bdde900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3efe531700 1 -- 172.21.15.81:0/3257715125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65bddff60 msgr2=0x55a65bdde3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:25.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3efe531700 1 --2- 172.21.15.81:0/3257715125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65bddff60 0x55a65bdde3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3efe531700 1 -- 172.21.15.81:0/3257715125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65be00d00 msgr2=0x55a65bdde900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3efe531700 1 --2- 172.21.15.81:0/3257715125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65be00d00 0x55a65bdde900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.213+0000 7f3efe531700 1 -- 172.21.15.81:0/3257715125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef80d0170 con 0x55a65bdb6a50 2023-10-07T08:44:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3efe531700 1 --2- 172.21.15.81:0/3257715125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bdb6a50 0x55a65bddc3b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3ef401a470 tx=0x7f3ef4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5578b6137a3f5e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3ed8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:44:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3257715125 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef401acc0 con 0x55a65bdb6a50 2023-10-07T08:44:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3257715125 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ef4013070 con 0x55a65bdb6a50 2023-10-07T08:44:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3257715125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a65bdabb70 con 0x55a65bdb6a50 2023-10-07T08:44:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3257715125 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ef401b430 con 0x55a65bdb6a50 2023-10-07T08:44:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3f09a8db80 10 client.5484 fetch_fsmap learned FSMap version 24 2023-10-07T08:44:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3257715125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55a65bb43fe0 con 0x55a65bdb6a50 2023-10-07T08:44:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3257715125 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a65bdabb70 con 0x55a65bdb6a50 2023-10-07T08:44:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3257715125 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3ef401b590 con 0x55a65bdb6a50 2023-10-07T08:44:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3f09a8db80 10 client.5484 fetch_fsmap finished waiting for FSMap version 24 2023-10-07T08:44:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3f09a8db80 10 client.5484 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T08:44:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3f09a8db80 20 client.5484 populate_metadata read hostname 'smithi081' 2023-10-07T08:44:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/3257715125 >> [v2:172.21.15.81:6836/2750584146,v1:172.21.15.81:6837/2750584146] conn(0x55a65bdfa3b0 0x55a65bdfa780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3f09a8db80 4 client.5484 mds_command: new command op to 5340 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T08:44:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3257715125 --> [v2:172.21.15.81:6836/2750584146,v1:172.21.15.81:6837/2750584146] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a65bd88aa0 con 0x55a65bdfa3b0 2023-10-07T08:44:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.214+0000 7f3efdd30700 1 --2- 172.21.15.81:0/3257715125 >> [v2:172.21.15.81:6836/2750584146,v1:172.21.15.81:6837/2750584146] conn(0x55a65bdfa3b0 0x55a65bdfa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.215+0000 7f3ed8ff9700 10 client.5484 ms_handle_connect on v2:172.21.15.81:6836/2750584146 2023-10-07T08:44:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.215+0000 7f3efdd30700 1 --2- 172.21.15.81:0/3257715125 >> [v2:172.21.15.81:6836/2750584146,v1:172.21.15.81:6837/2750584146] conn(0x55a65bdfa3b0 0x55a65bdfa780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a03d9fa4da84049b server_cookie=fa71c4839c762d30 in_seq=0 out_seq=0 2023-10-07T08:44:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.215+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3257715125 <== mds.0 v2:172.21.15.81:6836/2750584146 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a65bd88aa0 con 0x55a65bdfa3b0 2023-10-07T08:44:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.215+0000 7f3ed8ff9700 10 client.5484 handle_command_reply: tid=0 2023-10-07T08:44:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.215+0000 7f3f09a8db80 1 client.5484 shutdown 2023-10-07T08:44:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.215+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3257715125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bdb6a50 msgr2=0x55a65bddc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.215+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/3257715125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bdb6a50 0x55a65bddc3b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3ef401a470 tx=0x7f3ef4013000 comp rx=0 tx=0).stop 2023-10-07T08:44:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.215+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3257715125 shutdown_connections 2023-10-07T08:44:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.215+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/3257715125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65be00d00 0x55a65bdde900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.215+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/3257715125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bdb6a50 0x55a65bddc3b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.215+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/3257715125 >> [v2:172.21.15.81:6836/2750584146,v1:172.21.15.81:6837/2750584146] conn(0x55a65bdfa3b0 0x55a65bdfa780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.215+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/3257715125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65bddff60 0x55a65bdde3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.215+0000 7f3ed8ff9700 0 client.5484 ms_handle_reset on v2:172.21.15.81:6836/2750584146 2023-10-07T08:44:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.215+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3257715125 >> 172.21.15.81:0/3257715125 conn(0x55a65bdb8370 msgr2=0x55a65bdfc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.215+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3257715125 shutdown_connections 2023-10-07T08:44:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.215+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3257715125 wait complete. 2023-10-07T08:44:25.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.216+0000 7f3f09a8db80 20 client.5484 trim_cache size 0 max 16384 2023-10-07T08:44:25.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.232+0000 7f3f09a8db80 1 Processor -- start 2023-10-07T08:44:25.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.232+0000 7f3f09a8db80 1 -- start start 2023-10-07T08:44:25.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3f09a8db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65bdb6a50 0x55a65bdb9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3f09a8db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bddff60 0x55a65bdde160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3f09a8db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65be00d00 0x55a65bdde6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3f09a8db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a65bdff220 con 0x55a65bddff60 2023-10-07T08:44:25.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3f09a8db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a65bdb5cd0 con 0x55a65be00d00 2023-10-07T08:44:25.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3f09a8db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a65bdb4250 con 0x55a65bdb6a50 2023-10-07T08:44:25.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3efdd30700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bddff60 0x55a65bdde160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3efdd30700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bddff60 0x55a65bdde160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48584/0 (socket says 172.21.15.81:48584) 2023-10-07T08:44:25.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3efdd30700 1 -- 172.21.15.81:0/1241232837 learned_addr learned my addr 172.21.15.81:0/1241232837 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:25.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3efe531700 1 --2- 172.21.15.81:0/1241232837 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65bdb6a50 0x55a65bdb9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3efed32700 1 --2- 172.21.15.81:0/1241232837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65be00d00 0x55a65bdde6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3efdd30700 1 -- 172.21.15.81:0/1241232837 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65bdb6a50 msgr2=0x55a65bdb9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:25.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3efdd30700 1 --2- 172.21.15.81:0/1241232837 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65bdb6a50 0x55a65bdb9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3efdd30700 1 -- 172.21.15.81:0/1241232837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65be00d00 msgr2=0x55a65bdde6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:25.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3efdd30700 1 --2- 172.21.15.81:0/1241232837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65be00d00 0x55a65bdde6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3efdd30700 1 -- 172.21.15.81:0/1241232837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a65bddc680 con 0x55a65bddff60 2023-10-07T08:44:25.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3efe531700 1 --2- 172.21.15.81:0/1241232837 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65bdb6a50 0x55a65bdb9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:25.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3efdd30700 1 --2- 172.21.15.81:0/1241232837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bddff60 0x55a65bdde160 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8003010 tx=0x7f3ee8027040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792348549237ea6d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:25.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3edbfff700 1 -- 172.21.15.81:0/1241232837 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee800b610 con 0x55a65bddff60 2023-10-07T08:44:25.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3edbfff700 1 -- 172.21.15.81:0/1241232837 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee8033030 con 0x55a65bddff60 2023-10-07T08:44:25.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.233+0000 7f3edbfff700 1 -- 172.21.15.81:0/1241232837 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8000bc0 con 0x55a65bddff60 2023-10-07T08:44:25.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.234+0000 7f3f09a8db80 1 -- 172.21.15.81:0/1241232837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bddff60 msgr2=0x55a65bdde160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:25.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.234+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/1241232837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bddff60 0x55a65bdde160 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8003010 tx=0x7f3ee8027040 comp rx=0 tx=0).stop 2023-10-07T08:44:25.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.234+0000 7f3f09a8db80 1 -- 172.21.15.81:0/1241232837 shutdown_connections 2023-10-07T08:44:25.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.234+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/1241232837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65be00d00 0x55a65bdde6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.234+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/1241232837 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65bdb6a50 0x55a65bdb9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.234+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/1241232837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bddff60 0x55a65bdde160 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.234+0000 7f3f09a8db80 1 -- 172.21.15.81:0/1241232837 >> 172.21.15.81:0/1241232837 conn(0x55a65bdb8370 msgr2=0x55a65bdfe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:25.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.234+0000 7f3f09a8db80 1 -- 172.21.15.81:0/1241232837 shutdown_connections 2023-10-07T08:44:25.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.234+0000 7f3f09a8db80 1 -- 172.21.15.81:0/1241232837 wait complete. 2023-10-07T08:44:25.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.234+0000 7f3f09a8db80 1 -- start start 2023-10-07T08:44:25.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.235+0000 7f3f09a8db80 1 Processor -- start 2023-10-07T08:44:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.235+0000 7f3f09a8db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bdb6a50 0x55a65bdf8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.235+0000 7f3f09a8db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65bddff60 0x55a65be60cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.235+0000 7f3f09a8db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65be00d00 0x55a65bdf3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.235+0000 7f3f09a8db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a65be644b0 con 0x55a65bdb6a50 2023-10-07T08:44:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.235+0000 7f3f09a8db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a65bdf7710 con 0x55a65bddff60 2023-10-07T08:44:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.235+0000 7f3f09a8db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a65bdf8160 con 0x55a65be00d00 2023-10-07T08:44:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.235+0000 7f3f09a8db80 10 client.0 _ll_register_callbacks cb 0x55a65bd7a110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:44:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3efe531700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bdb6a50 0x55a65bdf8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3efe531700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bdb6a50 0x55a65bdf8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48592/0 (socket says 172.21.15.81:48592) 2023-10-07T08:44:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3efe531700 1 -- 172.21.15.81:0/3073484843 learned_addr learned my addr 172.21.15.81:0/3073484843 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3efed32700 1 --2- 172.21.15.81:0/3073484843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65be00d00 0x55a65bdf3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3efdd30700 1 --2- 172.21.15.81:0/3073484843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65bddff60 0x55a65be60cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3efe531700 1 -- 172.21.15.81:0/3073484843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65be00d00 msgr2=0x55a65bdf3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3efe531700 1 --2- 172.21.15.81:0/3073484843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65be00d00 0x55a65bdf3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3efe531700 1 -- 172.21.15.81:0/3073484843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65bddff60 msgr2=0x55a65be60cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3efe531700 1 --2- 172.21.15.81:0/3073484843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65bddff60 0x55a65be60cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3efe531700 1 -- 172.21.15.81:0/3073484843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee8029040 con 0x55a65bdb6a50 2023-10-07T08:44:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3efe531700 1 --2- 172.21.15.81:0/3073484843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bdb6a50 0x55a65bdf8bb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40073b0 tx=0x7f3ef4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2f32d1eaa9fe98 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3ed8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:44:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3073484843 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef401b430 con 0x55a65bdb6a50 2023-10-07T08:44:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3073484843 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ef4013040 con 0x55a65bdb6a50 2023-10-07T08:44:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3073484843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ee8020070 con 0x55a65bdb6a50 2023-10-07T08:44:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3073484843 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ef400a610 con 0x55a65bdb6a50 2023-10-07T08:44:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3f09a8db80 10 client.5490 fetch_fsmap learned FSMap version 24 2023-10-07T08:44:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3073484843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55a65bcd5780 con 0x55a65bdb6a50 2023-10-07T08:44:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3073484843 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee8020070 con 0x55a65bdb6a50 2023-10-07T08:44:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3073484843 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3ef400a770 con 0x55a65bdb6a50 2023-10-07T08:44:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3f09a8db80 10 client.5490 fetch_fsmap finished waiting for FSMap version 24 2023-10-07T08:44:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3f09a8db80 10 client.5490 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T08:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3f09a8db80 20 client.5490 populate_metadata read hostname 'smithi081' 2023-10-07T08:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.236+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/3073484843 >> [v2:172.21.15.81:6836/2750584146,v1:172.21.15.81:6837/2750584146] conn(0x55a65bdb6e20 0x55a65bdb71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3f09a8db80 4 client.5490 mds_command: new command op to 5340 tid=0[{"prefix": "status"}] 2023-10-07T08:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3073484843 --> [v2:172.21.15.81:6836/2750584146,v1:172.21.15.81:6837/2750584146] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a65bca9e00 con 0x55a65bdb6e20 2023-10-07T08:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3efdd30700 1 --2- 172.21.15.81:0/3073484843 >> [v2:172.21.15.81:6836/2750584146,v1:172.21.15.81:6837/2750584146] conn(0x55a65bdb6e20 0x55a65bdb71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3efdd30700 1 --2- 172.21.15.81:0/3073484843 >> [v2:172.21.15.81:6836/2750584146,v1:172.21.15.81:6837/2750584146] conn(0x55a65bdb6e20 0x55a65bdb71f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffbace7803ab30c9 server_cookie=46032ecc5ddf3961 in_seq=0 out_seq=0 2023-10-07T08:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3ed8ff9700 10 client.5490 ms_handle_connect on v2:172.21.15.81:6836/2750584146 2023-10-07T08:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3ed8ff9700 1 -- 172.21.15.81:0/3073484843 <== mds.0 v2:172.21.15.81:6836/2750584146 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a65bca9e00 con 0x55a65bdb6e20 2023-10-07T08:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3ed8ff9700 10 client.5490 handle_command_reply: tid=0 2023-10-07T08:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3f09a8db80 1 client.5490 shutdown 2023-10-07T08:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3073484843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bdb6a50 msgr2=0x55a65bdf8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/3073484843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bdb6a50 0x55a65bdf8bb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40073b0 tx=0x7f3ef4018000 comp rx=0 tx=0).stop 2023-10-07T08:44:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3073484843 shutdown_connections 2023-10-07T08:44:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/3073484843 >> [v2:172.21.15.81:6836/2750584146,v1:172.21.15.81:6837/2750584146] conn(0x55a65bdb6e20 0x55a65bdb71f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/3073484843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55a65be00d00 0x55a65bdf3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/3073484843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a65bdb6a50 0x55a65bdf8bb0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3ed8ff9700 0 client.5490 ms_handle_reset on v2:172.21.15.81:6836/2750584146 2023-10-07T08:44:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3f09a8db80 1 --2- 172.21.15.81:0/3073484843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a65bddff60 0x55a65be60cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3073484843 >> 172.21.15.81:0/3073484843 conn(0x55a65bdb8370 msgr2=0x55a65bdfde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3073484843 shutdown_connections 2023-10-07T08:44:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.237+0000 7f3f09a8db80 1 -- 172.21.15.81:0/3073484843 wait complete. 2023-10-07T08:44:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.238+0000 7f3f09a8db80 20 client.5490 trim_cache size 0 max 16384 2023-10-07T08:44:25.247 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:44:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:44:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-07T08:44:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5340, 2023-10-07T08:44:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-07T08:44:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-07T08:44:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-07T08:44:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.8165808620000004, 2023-10-07T08:44:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 24, 2023-10-07T08:44:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 47, 2023-10-07T08:44:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 47, 2023-10-07T08:44:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 11.846011520999999 2023-10-07T08:44:25.248 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:44:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.238+0000 7f3f00795700 1 -- 172.21.15.81:0/3635205429 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3edc066f30 msgr2=0x7f3edc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.238+0000 7f3f00795700 1 --2- 172.21.15.81:0/3635205429 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3edc066f30 0x7f3edc0693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400c3d0 tx=0x7f3ef40074d0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.238+0000 7f3f00795700 1 -- 172.21.15.81:0/3635205429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ef8157ca0 msgr2=0x7f3ef80b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.238+0000 7f3f00795700 1 --2- 172.21.15.81:0/3635205429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ef8157ca0 0x7f3ef80b5260 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000c5b0 tx=0x7f3ef0007f60 comp rx=0 tx=0).stop 2023-10-07T08:44:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.238+0000 7f3f00795700 1 -- 172.21.15.81:0/3635205429 shutdown_connections 2023-10-07T08:44:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.238+0000 7f3f00795700 1 --2- 172.21.15.81:0/3635205429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ef8157ca0 0x7f3ef80b5260 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.238+0000 7f3f00795700 1 --2- 172.21.15.81:0/3635205429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ef806d120 0x7f3ef815c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.238+0000 7f3f00795700 1 --2- 172.21.15.81:0/3635205429 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3edc066f30 0x7f3edc0693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.238+0000 7f3f00795700 1 --2- 172.21.15.81:0/3635205429 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ef81578d0 0x7f3ef80b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.238+0000 7f3f00795700 1 -- 172.21.15.81:0/3635205429 >> 172.21.15.81:0/3635205429 conn(0x7f3ef806bb90 msgr2=0x7f3ef8155080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:25.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.238+0000 7f3f00795700 1 -- 172.21.15.81:0/3635205429 shutdown_connections 2023-10-07T08:44:25.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.238+0000 7f3f00795700 1 -- 172.21.15.81:0/3635205429 wait complete. 2023-10-07T08:44:25.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:44:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.363+0000 7fee2f4f5700 1 Processor -- start 2023-10-07T08:44:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.363+0000 7fee2f4f5700 1 -- start start 2023-10-07T08:44:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee2f4f5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fee281578d0 0x7fee280cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee2f4f5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee280d07c0 con 0x7fee2806d120 2023-10-07T08:44:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee2f4f5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee280cfbb0 con 0x7fee28157ca0 2023-10-07T08:44:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee2f4f5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee280cfe90 con 0x7fee281578d0 2023-10-07T08:44:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee2da92700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fee2806d120 0x7fee2806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32880/0 (socket says 172.21.15.81:32880) 2023-10-07T08:44:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee2da92700 1 -- 172.21.15.81:0/451471212 learned_addr learned my addr 172.21.15.81:0/451471212 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee2d291700 1 --2- 172.21.15.81:0/451471212 >> v2:172.21.15.89:3300/0 conn(0x7fee281578d0 0x7fee280cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee1ffff700 1 -- 172.21.15.81:0/451471212 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677926925 0 0) 0x7fee280d07c0 con 0x7fee2806d120 2023-10-07T08:44:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee1ffff700 1 -- 172.21.15.81:0/451471212 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee14003570 con 0x7fee2806d120 2023-10-07T08:44:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee1ffff700 1 -- 172.21.15.81:0/451471212 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1645730959 0 0) 0x7fee14003570 con 0x7fee2806d120 2023-10-07T08:44:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee1ffff700 1 -- 172.21.15.81:0/451471212 >> v2:172.21.15.89:3300/0 conn(0x7fee281578d0 msgr2=0x7fee280cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee1ffff700 1 --2- 172.21.15.81:0/451471212 >> v2:172.21.15.89:3300/0 conn(0x7fee281578d0 0x7fee280cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee1ffff700 1 -- 172.21.15.81:0/451471212 >> v1:172.21.15.89:6789/0 conn(0x7fee28157ca0 legacy=0x7fee2815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee1ffff700 1 -- 172.21.15.81:0/451471212 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee280d0170 con 0x7fee2806d120 2023-10-07T08:44:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee1ffff700 1 -- 172.21.15.81:0/451471212 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fee200017f0 con 0x7fee2806d120 2023-10-07T08:44:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee1ffff700 1 -- 172.21.15.81:0/451471212 >> v1:172.21.15.81:6789/0 conn(0x7fee2806d120 legacy=0x7fee2806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee1ffff700 1 --2- 172.21.15.81:0/451471212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee14003a60 0x7fee14003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee1ffff700 1 --2- 172.21.15.81:0/451471212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee14004810 0x7fee14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee1ffff700 1 --2- 172.21.15.81:0/451471212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee140051c0 0x7fee1400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee1ffff700 1 -- 172.21.15.81:0/451471212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee280cfe90 con 0x7fee14003a60 2023-10-07T08:44:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee1ffff700 1 -- 172.21.15.81:0/451471212 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1400c050 con 0x7fee140051c0 2023-10-07T08:44:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee1ffff700 1 -- 172.21.15.81:0/451471212 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1400c210 con 0x7fee14004810 2023-10-07T08:44:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.364+0000 7fee2d291700 1 --2- 172.21.15.81:0/451471212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee14003a60 0x7fee14003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.365+0000 7fee2ca90700 1 --2- 172.21.15.81:0/451471212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee14004810 0x7fee14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.365+0000 7fee2da92700 1 --2- 172.21.15.81:0/451471212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee140051c0 0x7fee1400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.365+0000 7fee2d291700 1 -- 172.21.15.81:0/451471212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee14004810 msgr2=0x7fee14004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.365+0000 7fee2d291700 1 --2- 172.21.15.81:0/451471212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee14004810 0x7fee14004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.365+0000 7fee2d291700 1 -- 172.21.15.81:0/451471212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee140051c0 msgr2=0x7fee1400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.365+0000 7fee2d291700 1 --2- 172.21.15.81:0/451471212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee140051c0 0x7fee1400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.365+0000 7fee2d291700 1 -- 172.21.15.81:0/451471212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee14003570 con 0x7fee14003a60 2023-10-07T08:44:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.365+0000 7fee2da92700 1 --2- 172.21.15.81:0/451471212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee140051c0 0x7fee1400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.365+0000 7fee2ca90700 1 --2- 172.21.15.81:0/451471212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee14004810 0x7fee14004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.365+0000 7fee2da92700 1 -- 172.21.15.81:0/451471212 reap_dead start 2023-10-07T08:44:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.365+0000 7fee2d291700 1 --2- 172.21.15.81:0/451471212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee14003a60 0x7fee14003e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fee24009c00 tx=0x7fee240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76db424e8e86f29 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.365+0000 7fee1ffff700 1 -- 172.21.15.81:0/451471212 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2400e710 con 0x7fee14003a60 2023-10-07T08:44:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.365+0000 7fee1ffff700 1 -- 172.21.15.81:0/451471212 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2400e870 con 0x7fee14003a60 2023-10-07T08:44:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.365+0000 7fee1ffff700 1 -- 172.21.15.81:0/451471212 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2400ec30 con 0x7fee14003a60 2023-10-07T08:44:25.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.366+0000 7fee2f4f5700 1 -- 172.21.15.81:0/451471212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee14003a60 msgr2=0x7fee14003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:25.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.366+0000 7fee2f4f5700 1 --2- 172.21.15.81:0/451471212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee14003a60 0x7fee14003e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fee24009c00 tx=0x7fee240091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.366+0000 7fee2f4f5700 1 -- 172.21.15.81:0/451471212 shutdown_connections 2023-10-07T08:44:25.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.366+0000 7fee2f4f5700 1 --2- 172.21.15.81:0/451471212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee14003a60 0x7fee14003e30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.366+0000 7fee2f4f5700 1 -- 172.21.15.81:0/451471212 >> 172.21.15.81:0/451471212 conn(0x7fee2806bb90 msgr2=0x7fee2806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:25.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.366+0000 7fee2f4f5700 1 -- 172.21.15.81:0/451471212 shutdown_connections 2023-10-07T08:44:25.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.366+0000 7fee2f4f5700 1 -- 172.21.15.81:0/451471212 wait complete. 2023-10-07T08:44:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.367+0000 7fee2f4f5700 1 Processor -- start 2023-10-07T08:44:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.367+0000 7fee2f4f5700 1 -- start start 2023-10-07T08:44:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2f4f5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee14003a60 0x7fee28154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2f4f5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee280b65f0 0x7fee280c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2f4f5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee280cd690 0x7fee280c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2f4f5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee280b6c20 con 0x7fee280b65f0 2023-10-07T08:44:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2f4f5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee280c9bf0 con 0x7fee14003a60 2023-10-07T08:44:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2f4f5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee28155480 con 0x7fee280cd690 2023-10-07T08:44:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2ca90700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee280b65f0 0x7fee280c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2ca90700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee280b65f0 0x7fee280c7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48614/0 (socket says 172.21.15.81:48614) 2023-10-07T08:44:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2ca90700 1 -- 172.21.15.81:0/3827187302 learned_addr learned my addr 172.21.15.81:0/3827187302 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2d291700 1 --2- 172.21.15.81:0/3827187302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee14003a60 0x7fee28154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2da92700 1 --2- 172.21.15.81:0/3827187302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee280cd690 0x7fee280c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2ca90700 1 -- 172.21.15.81:0/3827187302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee280cd690 msgr2=0x7fee280c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2ca90700 1 --2- 172.21.15.81:0/3827187302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee280cd690 0x7fee280c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2ca90700 1 -- 172.21.15.81:0/3827187302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee14003a60 msgr2=0x7fee28154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2ca90700 1 --2- 172.21.15.81:0/3827187302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee14003a60 0x7fee28154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2ca90700 1 -- 172.21.15.81:0/3827187302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee280b3dd0 con 0x7fee280b65f0 2023-10-07T08:44:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2da92700 1 --2- 172.21.15.81:0/3827187302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee280cd690 0x7fee280c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2ca90700 1 --2- 172.21.15.81:0/3827187302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee280b65f0 0x7fee280c7b00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fee18000c00 tx=0x7fee18009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee1d7fa700 1 -- 172.21.15.81:0/3827187302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee180115c0 con 0x7fee280b65f0 2023-10-07T08:44:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee1d7fa700 1 -- 172.21.15.81:0/3827187302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee18011720 con 0x7fee280b65f0 2023-10-07T08:44:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2f4f5700 1 -- 172.21.15.81:0/3827187302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee280c69b0 con 0x7fee280b65f0 2023-10-07T08:44:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee1d7fa700 1 -- 172.21.15.81:0/3827187302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee18011ae0 con 0x7fee280b65f0 2023-10-07T08:44:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.368+0000 7fee2f4f5700 1 -- 172.21.15.81:0/3827187302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee280c6f30 con 0x7fee280b65f0 2023-10-07T08:44:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.369+0000 7fee2f4f5700 1 -- 172.21.15.81:0/3827187302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee280b3ba0 con 0x7fee280b65f0 2023-10-07T08:44:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.370+0000 7fee1d7fa700 1 -- 172.21.15.81:0/3827187302 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee18014480 con 0x7fee280b65f0 2023-10-07T08:44:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.370+0000 7fee1d7fa700 1 --2- 172.21.15.81:0/3827187302 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee0c066f30 0x7fee0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.370+0000 7fee2d291700 1 --2- 172.21.15.81:0/3827187302 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee0c066f30 0x7fee0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.370+0000 7fee1d7fa700 1 -- 172.21.15.81:0/3827187302 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee18083e00 con 0x7fee280b65f0 2023-10-07T08:44:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.371+0000 7fee2d291700 1 --2- 172.21.15.81:0/3827187302 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee0c066f30 0x7fee0c0693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fee240091e0 tx=0x7fee2401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.374+0000 7fee1d7fa700 1 -- 172.21.15.81:0/3827187302 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee1804d5a0 con 0x7fee280b65f0 2023-10-07T08:44:25.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.600+0000 7fee2f4f5700 1 -- 172.21.15.81:0/3827187302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fee280b3f60 con 0x7fee280b65f0 2023-10-07T08:44:25.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.600+0000 7fee1d7fa700 1 -- 172.21.15.81:0/3827187302 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7fee280b3ba0 con 0x7fee280b65f0 2023-10-07T08:44:25.602 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:44:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.602+0000 7fee2f4f5700 1 -- 172.21.15.81:0/3827187302 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee0c066f30 msgr2=0x7fee0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.602+0000 7fee2f4f5700 1 --2- 172.21.15.81:0/3827187302 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee0c066f30 0x7fee0c0693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fee240091e0 tx=0x7fee2401a000 comp rx=0 tx=0).stop 2023-10-07T08:44:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.602+0000 7fee2f4f5700 1 -- 172.21.15.81:0/3827187302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee280b65f0 msgr2=0x7fee280c7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.602+0000 7fee2f4f5700 1 --2- 172.21.15.81:0/3827187302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee280b65f0 0x7fee280c7b00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fee18000c00 tx=0x7fee18009040 comp rx=0 tx=0).stop 2023-10-07T08:44:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.602+0000 7fee2f4f5700 1 -- 172.21.15.81:0/3827187302 shutdown_connections 2023-10-07T08:44:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.602+0000 7fee2f4f5700 1 --2- 172.21.15.81:0/3827187302 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee0c066f30 0x7fee0c0693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.602+0000 7fee2f4f5700 1 --2- 172.21.15.81:0/3827187302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee280cd690 0x7fee280c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.602+0000 7fee2f4f5700 1 --2- 172.21.15.81:0/3827187302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee14003a60 0x7fee28154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.602+0000 7fee2f4f5700 1 --2- 172.21.15.81:0/3827187302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee280b65f0 0x7fee280c7b00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.602+0000 7fee2f4f5700 1 -- 172.21.15.81:0/3827187302 >> 172.21.15.81:0/3827187302 conn(0x7fee2806bb90 msgr2=0x7fee28156c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.602+0000 7fee2f4f5700 1 -- 172.21.15.81:0/3827187302 shutdown_connections 2023-10-07T08:44:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:25.602+0000 7fee2f4f5700 1 -- 172.21.15.81:0/3827187302 wait complete. 2023-10-07T08:44:25.615 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:44:25.615 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:44:25.615 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-07T08:44:25.616 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T08:44:25.616 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T08:44:25.616 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:44:25.616 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:44:25.616 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:44:25.616 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:44:25.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:44:25.616 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-07T08:44:25.631 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:44:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:44:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:44:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:44:25.631 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-07T08:44:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:44:25.632 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:44:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:44:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-07T08:44:25.632 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:44:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:44:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-07T08:44:25.632 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:44:25.632 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:44:25.632 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:44:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:44:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:44:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42463sec preferred_lft 42463sec 2023-10-07T08:44:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-10-07T08:44:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:44:25.633 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:44:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff 2023-10-07T08:44:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:44:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:44:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::8c72:9ff:fe74:8c7e/64 scope link 2023-10-07T08:44:25.633 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:44:25.633 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:44:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:fe:81:9d:9c:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T08:44:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8fe:81ff:fe9d:9c0a/64 scope link 2023-10-07T08:44:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:44:25.634 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:44:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T08:44:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d838:b7ff:fe6e:914d/64 scope link 2023-10-07T08:44:25.634 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:44:25.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:44:25.634 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:44:25.693 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-07T08:44:25.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:44:25.695 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-07T08:44:25.751 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-07T08:44:25.751 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:44:25.751 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:44:25.751 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:44:25.751 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:44:25.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:44:25.752 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:44:25.752 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:44:25.752 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:44:25.752 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:44:25.752 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:44:25.752 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:44:25.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:44:25.850 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-07T08:44:25.865 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T08:44:25.865 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T08:44:25.865 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:44:25.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:44:25.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-07T08:44:25.929 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:44:25.930 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T08:44:25.985 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:44:25.985 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:44:25.985 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:44:26.039 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:44:26.039 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:44:26.040 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:44:26.118 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:44:26.119 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:44:26.119 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:44:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:44:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:44:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:44:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:44:26.127 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:44:26.148 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:44:26.149 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:44:26.149 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:44:26.149 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:44:26.149 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:44:26.149 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:44:26.149 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:44:26.150 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:44:26.151 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:44:26.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:44:26.151 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:44:26.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:44:26.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.368+0000 7fd69421a700 1 Processor -- start 2023-10-07T08:44:26.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.368+0000 7fd69421a700 1 -- start start 2023-10-07T08:44:26.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.369+0000 7fd69421a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd68c1578d0 0x7fd68c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:26.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.369+0000 7fd69421a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd68c06d120 0x7fd68c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:26.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.369+0000 7fd69421a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68c06dac0 con 0x7fd68c157ca0 2023-10-07T08:44:26.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.369+0000 7fd69421a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68c0d07c0 con 0x7fd68c06d120 2023-10-07T08:44:26.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.369+0000 7fd69421a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c0cfbb0 con 0x7fd68c1578d0 2023-10-07T08:44:26.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.369+0000 7fd691fb6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd68c1578d0 0x7fd68c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:26.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.369+0000 7fd6927b7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd68c06d120 0x7fd68c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:26.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.370+0000 7fd6927b7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd68c06d120 0x7fd68c06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:60930/0 (socket says 172.21.15.81:60930) 2023-10-07T08:44:26.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.370+0000 7fd691fb6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd68c1578d0 0x7fd68c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:56020/0 (socket says 172.21.15.81:56020) 2023-10-07T08:44:26.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.370+0000 7fd6917b5700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd68c157ca0 0x7fd68c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:44608/0 (socket says 172.21.15.81:44608) 2023-10-07T08:44:26.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.370+0000 7fd6927b7700 1 -- 172.21.15.81:0/1306756561 learned_addr learned my addr 172.21.15.81:0/1306756561 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:26.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.370+0000 7fd691fb6700 1 -- 172.21.15.81:0/1306756561 >> v2:172.21.15.89:3300/0 conn(0x7fd68c06d120 msgr2=0x7fd68c06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:26.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.370+0000 7fd691fb6700 1 --2- 172.21.15.81:0/1306756561 >> v2:172.21.15.89:3300/0 conn(0x7fd68c06d120 0x7fd68c06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:26.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.370+0000 7fd691fb6700 1 -- 172.21.15.81:0/1306756561 >> v1:172.21.15.89:6789/0 conn(0x7fd68c157ca0 legacy=0x7fd68c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:26.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.370+0000 7fd691fb6700 1 -- 172.21.15.81:0/1306756561 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c0cfe90 con 0x7fd68c1578d0 2023-10-07T08:44:26.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.370+0000 7fd6927b7700 1 --2- 172.21.15.81:0/1306756561 >> v2:172.21.15.89:3300/0 conn(0x7fd68c06d120 0x7fd68c06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:44:26.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.370+0000 7fd691fb6700 1 --2- 172.21.15.81:0/1306756561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd68c1578d0 0x7fd68c0cf4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd688009e60 tx=0x7fd688009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=953c2697eb25548f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:26.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.370+0000 7fd690fb4700 1 -- 172.21.15.81:0/1306756561 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68800e070 con 0x7fd68c1578d0 2023-10-07T08:44:26.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.370+0000 7fd690fb4700 1 -- 172.21.15.81:0/1306756561 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68800bb60 con 0x7fd68c1578d0 2023-10-07T08:44:26.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.370+0000 7fd690fb4700 1 -- 172.21.15.81:0/1306756561 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688012430 con 0x7fd68c1578d0 2023-10-07T08:44:26.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.371+0000 7fd69421a700 1 -- 172.21.15.81:0/1306756561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd68c1578d0 msgr2=0x7fd68c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:26.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.371+0000 7fd69421a700 1 --2- 172.21.15.81:0/1306756561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd68c1578d0 0x7fd68c0cf4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd688009e60 tx=0x7fd688009780 comp rx=0 tx=0).stop 2023-10-07T08:44:26.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.371+0000 7fd69421a700 1 -- 172.21.15.81:0/1306756561 shutdown_connections 2023-10-07T08:44:26.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.371+0000 7fd69421a700 1 --2- 172.21.15.81:0/1306756561 >> v2:172.21.15.89:3300/0 conn(0x7fd68c06d120 0x7fd68c06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:26.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.371+0000 7fd69421a700 1 --2- 172.21.15.81:0/1306756561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd68c1578d0 0x7fd68c0cf4f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:26.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.371+0000 7fd69421a700 1 -- 172.21.15.81:0/1306756561 >> 172.21.15.81:0/1306756561 conn(0x7fd68c06bb90 msgr2=0x7fd68c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:26.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.371+0000 7fd69421a700 1 -- 172.21.15.81:0/1306756561 shutdown_connections 2023-10-07T08:44:26.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.371+0000 7fd69421a700 1 -- 172.21.15.81:0/1306756561 wait complete. 2023-10-07T08:44:26.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.372+0000 7fd69421a700 1 Processor -- start 2023-10-07T08:44:26.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.372+0000 7fd69421a700 1 -- start start 2023-10-07T08:44:26.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd69421a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd68c06d120 0x7fd68c153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:26.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd69421a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd68c1578d0 0x7fd68c069d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:26.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd69421a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd68c157ca0 0x7fd68c06a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:26.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd69421a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c1542e0 con 0x7fd68c157ca0 2023-10-07T08:44:26.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd69421a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c0c6e80 con 0x7fd68c06d120 2023-10-07T08:44:26.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd69421a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c0c7160 con 0x7fd68c1578d0 2023-10-07T08:44:26.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd6927b7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd68c157ca0 0x7fd68c06a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:26.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd6927b7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd68c157ca0 0x7fd68c06a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48620/0 (socket says 172.21.15.81:48620) 2023-10-07T08:44:26.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd6927b7700 1 -- 172.21.15.81:0/4280407467 learned_addr learned my addr 172.21.15.81:0/4280407467 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:26.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd691fb6700 1 --2- 172.21.15.81:0/4280407467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd68c06d120 0x7fd68c153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:26.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd6917b5700 1 --2- 172.21.15.81:0/4280407467 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd68c1578d0 0x7fd68c069d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd6927b7700 1 -- 172.21.15.81:0/4280407467 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd68c1578d0 msgr2=0x7fd68c069d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd6927b7700 1 --2- 172.21.15.81:0/4280407467 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd68c1578d0 0x7fd68c069d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd6927b7700 1 -- 172.21.15.81:0/4280407467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd68c06d120 msgr2=0x7fd68c153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd6927b7700 1 --2- 172.21.15.81:0/4280407467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd68c06d120 0x7fd68c153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd6927b7700 1 -- 172.21.15.81:0/4280407467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6840094f0 con 0x7fd68c157ca0 2023-10-07T08:44:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.373+0000 7fd6927b7700 1 --2- 172.21.15.81:0/4280407467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd68c157ca0 0x7fd68c06a270 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd68400ec50 tx=0x7fd684009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.374+0000 7fd681ffb700 1 -- 172.21.15.81:0/4280407467 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68400c850 con 0x7fd68c157ca0 2023-10-07T08:44:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.374+0000 7fd681ffb700 1 -- 172.21.15.81:0/4280407467 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68400c9b0 con 0x7fd68c157ca0 2023-10-07T08:44:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.374+0000 7fd69421a700 1 -- 172.21.15.81:0/4280407467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd688009a20 con 0x7fd68c157ca0 2023-10-07T08:44:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.374+0000 7fd681ffb700 1 -- 172.21.15.81:0/4280407467 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68400cd50 con 0x7fd68c157ca0 2023-10-07T08:44:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.374+0000 7fd69421a700 1 -- 172.21.15.81:0/4280407467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68c16b100 con 0x7fd68c157ca0 2023-10-07T08:44:26.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.375+0000 7fd69421a700 1 -- 172.21.15.81:0/4280407467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68c16b320 con 0x7fd68c157ca0 2023-10-07T08:44:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.375+0000 7fd681ffb700 1 -- 172.21.15.81:0/4280407467 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd684013680 con 0x7fd68c157ca0 2023-10-07T08:44:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.375+0000 7fd681ffb700 1 --2- 172.21.15.81:0/4280407467 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd670066f30 0x7fd6700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.375+0000 7fd681ffb700 1 -- 172.21.15.81:0/4280407467 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd684084710 con 0x7fd68c157ca0 2023-10-07T08:44:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.375+0000 7fd691fb6700 1 --2- 172.21.15.81:0/4280407467 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd670066f30 0x7fd6700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.376+0000 7fd691fb6700 1 --2- 172.21.15.81:0/4280407467 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd670066f30 0x7fd6700693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd6880097c0 tx=0x7fd688019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.379+0000 7fd681ffb700 1 -- 172.21.15.81:0/4280407467 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd684051980 con 0x7fd68c157ca0 2023-10-07T08:44:26.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.607+0000 7fd69421a700 1 -- 172.21.15.81:0/4280407467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd68c0d0170 con 0x7fd68c157ca0 2023-10-07T08:44:26.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.607+0000 7fd681ffb700 1 -- 172.21.15.81:0/4280407467 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd684054fa0 con 0x7fd68c157ca0 2023-10-07T08:44:26.609 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:44:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.609+0000 7fd69421a700 1 -- 172.21.15.81:0/4280407467 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd670066f30 msgr2=0x7fd6700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.609+0000 7fd69421a700 1 --2- 172.21.15.81:0/4280407467 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd670066f30 0x7fd6700693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd6880097c0 tx=0x7fd688019000 comp rx=0 tx=0).stop 2023-10-07T08:44:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.609+0000 7fd69421a700 1 -- 172.21.15.81:0/4280407467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd68c157ca0 msgr2=0x7fd68c06a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.609+0000 7fd69421a700 1 --2- 172.21.15.81:0/4280407467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd68c157ca0 0x7fd68c06a270 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd68400ec50 tx=0x7fd684009250 comp rx=0 tx=0).stop 2023-10-07T08:44:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.609+0000 7fd69421a700 1 -- 172.21.15.81:0/4280407467 shutdown_connections 2023-10-07T08:44:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.609+0000 7fd69421a700 1 --2- 172.21.15.81:0/4280407467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd68c157ca0 0x7fd68c06a270 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.609+0000 7fd69421a700 1 --2- 172.21.15.81:0/4280407467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd68c06d120 0x7fd68c153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.609+0000 7fd69421a700 1 --2- 172.21.15.81:0/4280407467 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd670066f30 0x7fd6700693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:26.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.609+0000 7fd69421a700 1 --2- 172.21.15.81:0/4280407467 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd68c1578d0 0x7fd68c069d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:26.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.609+0000 7fd69421a700 1 -- 172.21.15.81:0/4280407467 >> 172.21.15.81:0/4280407467 conn(0x7fd68c06bb90 msgr2=0x7fd68c155d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:26.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.609+0000 7fd69421a700 1 -- 172.21.15.81:0/4280407467 shutdown_connections 2023-10-07T08:44:26.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:26.609+0000 7fd69421a700 1 -- 172.21.15.81:0/4280407467 wait complete. 2023-10-07T08:44:26.622 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:44:26.622 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:44:26.622 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-07T08:44:26.623 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T08:44:26.623 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T08:44:26.623 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:44:26.623 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:44:26.623 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:44:26.623 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:44:26.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:44:26.623 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-07T08:44:26.641 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:44:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:44:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:44:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:44:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-07T08:44:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:44:26.642 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:44:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:44:26.642 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-10-07T08:44:26.642 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:44:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:44:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-10-07T08:44:26.643 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:44:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:44:26.643 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:44:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:44:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:44:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42462sec preferred_lft 42462sec 2023-10-07T08:44:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2023-10-07T08:44:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:44:26.643 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:44:26.643 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:44:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:44:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:44:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::74d7:a9ff:fe87:ed9/64 scope link 2023-10-07T08:44:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:44:26.644 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:44:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T08:44:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6c40:c5ff:fe3a:a57/64 scope link 2023-10-07T08:44:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:44:26.644 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:44:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether de:db:cd:68:b1:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T08:44:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::dcdb:cdff:fe68:b178/64 scope link 2023-10-07T08:44:26.644 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:44:26.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:44:26.645 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:44:26.709 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-07T08:44:26.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:44:26.711 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-07T08:44:26.770 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-07T08:44:26.770 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:44:26.770 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:44:26.770 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:44:26.770 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:44:26.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:44:26.771 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:44:26.771 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:44:26.771 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:44:26.771 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:44:26.771 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:44:26.771 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:44:26.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:44:26.877 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-07T08:44:26.893 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T08:44:26.893 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T08:44:26.893 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:44:26.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:44:26.893 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-07T08:44:26.959 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:44:26.959 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T08:44:27.015 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:44:27.015 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:44:27.015 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:44:27.070 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:44:27.070 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:44:27.070 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:44:27.150 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:44:27.150 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:44:27.151 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:44:27.159 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:44:27.159 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:44:27.159 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:44:27.159 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:44:27.159 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:44:27.180 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:44:27.181 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:44:27.181 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:44:27.181 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:44:27.181 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:44:27.181 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:44:27.181 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:44:27.181 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:44:27.183 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:44:27.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:44:27.183 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:44:27.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:44:27.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.364+0000 7f1591661700 1 Processor -- start 2023-10-07T08:44:27.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.364+0000 7f1591661700 1 -- start start 2023-10-07T08:44:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.365+0000 7f1591661700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f158c159b40 0x7f158c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.365+0000 7f1591661700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f158c159f10 0x7f158c068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.365+0000 7f1591661700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158c0cee10 con 0x7f158c0ccb40 2023-10-07T08:44:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.365+0000 7f1591661700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158c0cd040 con 0x7f158c159b40 2023-10-07T08:44:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.365+0000 7f1591661700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158c0cd320 con 0x7f158c159f10 2023-10-07T08:44:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.366+0000 7f158b7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f158c159f10 0x7f158c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.366+0000 7f158b7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f158c159f10 0x7f158c068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:56034/0 (socket says 172.21.15.81:56034) 2023-10-07T08:44:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.366+0000 7f158b7fe700 1 -- 172.21.15.81:0/538193568 learned_addr learned my addr 172.21.15.81:0/538193568 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.366+0000 7f158bfff700 1 --2- 172.21.15.81:0/538193568 >> v2:172.21.15.89:3300/0 conn(0x7f158c159b40 0x7f158c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.366+0000 7f158b7fe700 1 -- 172.21.15.81:0/538193568 >> v2:172.21.15.89:3300/0 conn(0x7f158c159b40 msgr2=0x7f158c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.366+0000 7f158b7fe700 1 --2- 172.21.15.81:0/538193568 >> v2:172.21.15.89:3300/0 conn(0x7f158c159b40 0x7f158c0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.366+0000 7f158b7fe700 1 -- 172.21.15.81:0/538193568 >> v1:172.21.15.89:6789/0 conn(0x7f158c0ccb40 legacy=0x7f158c15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.366+0000 7f158b7fe700 1 -- 172.21.15.81:0/538193568 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c0ce7c0 con 0x7f158c159f10 2023-10-07T08:44:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.366+0000 7f158b7fe700 1 --2- 172.21.15.81:0/538193568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f158c159f10 0x7f158c068780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f15800099b0 tx=0x7f1580009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21a29b19ee5f87ab server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.366+0000 7f158affd700 1 -- 172.21.15.81:0/538193568 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1580009ea0 con 0x7f158c159f10 2023-10-07T08:44:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.366+0000 7f158affd700 1 -- 172.21.15.81:0/538193568 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158000b860 con 0x7f158c159f10 2023-10-07T08:44:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.366+0000 7f158affd700 1 -- 172.21.15.81:0/538193568 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158000bc00 con 0x7f158c159f10 2023-10-07T08:44:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.367+0000 7f1591661700 1 -- 172.21.15.81:0/538193568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f158c159f10 msgr2=0x7f158c068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.367+0000 7f1591661700 1 --2- 172.21.15.81:0/538193568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f158c159f10 0x7f158c068780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f15800099b0 tx=0x7f1580009250 comp rx=0 tx=0).stop 2023-10-07T08:44:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.367+0000 7f1591661700 1 -- 172.21.15.81:0/538193568 shutdown_connections 2023-10-07T08:44:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.367+0000 7f1591661700 1 --2- 172.21.15.81:0/538193568 >> v2:172.21.15.89:3300/0 conn(0x7f158c159b40 0x7f158c0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.367+0000 7f1591661700 1 --2- 172.21.15.81:0/538193568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f158c159f10 0x7f158c068780 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.367+0000 7f1591661700 1 -- 172.21.15.81:0/538193568 >> 172.21.15.81:0/538193568 conn(0x7f158c0cd660 msgr2=0x7f158c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.367+0000 7f1591661700 1 -- 172.21.15.81:0/538193568 shutdown_connections 2023-10-07T08:44:27.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.367+0000 7f1591661700 1 -- 172.21.15.81:0/538193568 wait complete. 2023-10-07T08:44:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.368+0000 7f1591661700 1 Processor -- start 2023-10-07T08:44:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.368+0000 7f1591661700 1 -- start start 2023-10-07T08:44:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f1591661700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f158c0ccb40 0x7f158c16ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f1591661700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158c159b40 0x7f158c154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f1591661700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f158c159f10 0x7f158c0cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f1591661700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c0ca570 con 0x7f158c159b40 2023-10-07T08:44:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f1591661700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c16b2e0 con 0x7f158c0ccb40 2023-10-07T08:44:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f1591661700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158c16b590 con 0x7f158c159f10 2023-10-07T08:44:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f158b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158c159b40 0x7f158c154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f158b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158c159b40 0x7f158c154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48636/0 (socket says 172.21.15.81:48636) 2023-10-07T08:44:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f1590e60700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f158c159f10 0x7f158c0cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f158bfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f158c0ccb40 0x7f158c16ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f158b7fe700 1 -- 172.21.15.81:0/3856625737 learned_addr learned my addr 172.21.15.81:0/3856625737 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f158b7fe700 1 -- 172.21.15.81:0/3856625737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f158c159f10 msgr2=0x7f158c0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f158b7fe700 1 --2- 172.21.15.81:0/3856625737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f158c159f10 0x7f158c0cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f158b7fe700 1 -- 172.21.15.81:0/3856625737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f158c0ccb40 msgr2=0x7f158c16ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f158b7fe700 1 --2- 172.21.15.81:0/3856625737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f158c0ccb40 0x7f158c16ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f158b7fe700 1 -- 172.21.15.81:0/3856625737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15800094f0 con 0x7f158c159b40 2023-10-07T08:44:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f1590e60700 1 --2- 172.21.15.81:0/3856625737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f158c159f10 0x7f158c0cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:44:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f158b7fe700 1 --2- 172.21.15.81:0/3856625737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158c159b40 0x7f158c154a10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1580006fd0 tx=0x7f1580017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f1573fff700 1 -- 172.21.15.81:0/3856625737 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158000bbe0 con 0x7f158c159b40 2023-10-07T08:44:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f1573fff700 1 -- 172.21.15.81:0/3856625737 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1580000c90 con 0x7f158c159b40 2023-10-07T08:44:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f1591661700 1 -- 172.21.15.81:0/3856625737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158c0ca7c0 con 0x7f158c159b40 2023-10-07T08:44:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.369+0000 7f1573fff700 1 -- 172.21.15.81:0/3856625737 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1580011650 con 0x7f158c159b40 2023-10-07T08:44:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.370+0000 7f1591661700 1 -- 172.21.15.81:0/3856625737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158c16bae0 con 0x7f158c159b40 2023-10-07T08:44:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.370+0000 7f1591661700 1 -- 172.21.15.81:0/3856625737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158c16bcd0 con 0x7f158c159b40 2023-10-07T08:44:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.371+0000 7f1573fff700 1 -- 172.21.15.81:0/3856625737 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1580011a40 con 0x7f158c159b40 2023-10-07T08:44:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.371+0000 7f1573fff700 1 --2- 172.21.15.81:0/3856625737 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1578066f30 0x7f15780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.371+0000 7f158bfff700 1 --2- 172.21.15.81:0/3856625737 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1578066f30 0x7f15780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.371+0000 7f1573fff700 1 -- 172.21.15.81:0/3856625737 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1580085cc0 con 0x7f158c159b40 2023-10-07T08:44:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.372+0000 7f158bfff700 1 --2- 172.21.15.81:0/3856625737 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1578066f30 0x7f15780693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f157c009db0 tx=0x7f157c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.375+0000 7f1573fff700 1 -- 172.21.15.81:0/3856625737 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1580052f30 con 0x7f158c159b40 2023-10-07T08:44:27.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.603+0000 7f1591661700 1 -- 172.21.15.81:0/3856625737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f158c0cb910 con 0x7f158c159b40 2023-10-07T08:44:27.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.603+0000 7f1573fff700 1 -- 172.21.15.81:0/3856625737 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f1580056550 con 0x7f158c159b40 2023-10-07T08:44:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:27.605 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1491348117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1491348117},{"type":"v1","addr":"172.21.15.89:6834","nonce":1491348117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/748490276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":748490276},{"type":"v1","addr":"172.21.15.89:6835","nonce":748490276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2260626922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2260626922},{"type":"v1","addr":"172.21.15.81:6835","nonce":2260626922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:44:18.798458+0000","modified":"2023-10-07T08:44:22.459128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5340":{"gid":5340,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2750584146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2750584146},{"type":"v1","addr":"172.21.15.81:6837","nonce":2750584146}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-07T08:44:27.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.606+0000 7f1591661700 1 -- 172.21.15.81:0/3856625737 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1578066f30 msgr2=0x7f15780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:27.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.606+0000 7f1591661700 1 --2- 172.21.15.81:0/3856625737 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1578066f30 0x7f15780693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f157c009db0 tx=0x7f157c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:27.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.606+0000 7f1591661700 1 -- 172.21.15.81:0/3856625737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158c159b40 msgr2=0x7f158c154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:27.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.606+0000 7f1591661700 1 --2- 172.21.15.81:0/3856625737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158c159b40 0x7f158c154a10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1580006fd0 tx=0x7f1580017000 comp rx=0 tx=0).stop 2023-10-07T08:44:27.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.606+0000 7f1591661700 1 -- 172.21.15.81:0/3856625737 shutdown_connections 2023-10-07T08:44:27.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.606+0000 7f1591661700 1 --2- 172.21.15.81:0/3856625737 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1578066f30 0x7f15780693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:27.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.606+0000 7f1591661700 1 --2- 172.21.15.81:0/3856625737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f158c159f10 0x7f158c0cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:27.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.606+0000 7f1591661700 1 --2- 172.21.15.81:0/3856625737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f158c0ccb40 0x7f158c16ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:27.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.606+0000 7f1591661700 1 --2- 172.21.15.81:0/3856625737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158c159b40 0x7f158c154a10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:27.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.606+0000 7f1591661700 1 -- 172.21.15.81:0/3856625737 >> 172.21.15.81:0/3856625737 conn(0x7f158c0cd660 msgr2=0x7f158c06e540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:27.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.606+0000 7f1591661700 1 -- 172.21.15.81:0/3856625737 shutdown_connections 2023-10-07T08:44:27.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:27.606+0000 7f1591661700 1 -- 172.21.15.81:0/3856625737 wait complete. 2023-10-07T08:44:27.610 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2023-10-07T08:44:27.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-07T08:44:27.752 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":5340,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3192320019999997,"mdsmap_epoch":24,"osdmap_epoch":47,"osdmap_epoch_barrier":47,"uptime":14.348665651999999} 2023-10-07T08:44:27.752 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 5340, "mdsmap_epoch": 24, "osdmap_epoch": 47, "osdmap_epoch_barrier": 47, "rank_uptime": 8.319232002, "state": "up:active", "uptime": 14.348665652, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:44:27.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-07T08:44:27.881 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_mon_report_interval":"5"} 2023-10-07T08:44:27.881 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-07T08:44:27.881 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-10-07T08:44:27.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:44:27.881 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-10-07T08:44:29.268 INFO:teuthology.orchestra.run.smithi081.stderr:265+0 records in 2023-10-07T08:44:29.268 INFO:teuthology.orchestra.run.smithi081.stderr:265+0 records out 2023-10-07T08:44:29.268 INFO:teuthology.orchestra.run.smithi081.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.36986 s, 203 MB/s 2023-10-07T08:44:29.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:44:29.269 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-10-07T08:44:30.789 INFO:teuthology.orchestra.run.smithi081.stderr:292+0 records in 2023-10-07T08:44:30.789 INFO:teuthology.orchestra.run.smithi081.stderr:292+0 records out 2023-10-07T08:44:30.789 INFO:teuthology.orchestra.run.smithi081.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.5041 s, 204 MB/s 2023-10-07T08:44:30.790 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-07T08:44:30.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:44:30.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.902+0000 7ff811bc1700 1 Processor -- start 2023-10-07T08:44:30.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.902+0000 7ff811bc1700 1 -- start start 2023-10-07T08:44:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff811bc1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff80c1578d0 0x7ff80c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff811bc1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80c157ca0 0x7ff80c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff811bc1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff80c06d120 0x7ff80c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff811bc1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80c06dac0 con 0x7ff80c1578d0 2023-10-07T08:44:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff811bc1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80c0d07c0 con 0x7ff80c06d120 2023-10-07T08:44:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff811bc1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c0cfbb0 con 0x7ff80c157ca0 2023-10-07T08:44:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff80b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff80c1578d0 0x7ff80c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff80b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff80c1578d0 0x7ff80c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48650/0 (socket says 172.21.15.81:48650) 2023-10-07T08:44:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff80b7fe700 1 -- 172.21.15.81:0/1973623309 learned_addr learned my addr 172.21.15.81:0/1973623309 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff80affd700 1 --2- 172.21.15.81:0/1973623309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80c157ca0 0x7ff80c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff80bfff700 1 --2- 172.21.15.81:0/1973623309 >> v2:172.21.15.89:3300/0 conn(0x7ff80c06d120 0x7ff80c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff80b7fe700 1 -- 172.21.15.81:0/1973623309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80c157ca0 msgr2=0x7ff80c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff80b7fe700 1 --2- 172.21.15.81:0/1973623309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80c157ca0 0x7ff80c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff80b7fe700 1 -- 172.21.15.81:0/1973623309 >> v2:172.21.15.89:3300/0 conn(0x7ff80c06d120 msgr2=0x7ff80c06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff80b7fe700 1 --2- 172.21.15.81:0/1973623309 >> v2:172.21.15.89:3300/0 conn(0x7ff80c06d120 0x7ff80c06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff80b7fe700 1 -- 172.21.15.81:0/1973623309 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c0cfe90 con 0x7ff80c1578d0 2023-10-07T08:44:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff80bfff700 1 --2- 172.21.15.81:0/1973623309 >> v2:172.21.15.89:3300/0 conn(0x7ff80c06d120 0x7ff80c06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.903+0000 7ff80affd700 1 --2- 172.21.15.81:0/1973623309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80c157ca0 0x7ff80c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.904+0000 7ff80b7fe700 1 --2- 172.21.15.81:0/1973623309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c1578d0 0x7ff80c0cf4f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff80c0b3940 tx=0x7ff7fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ff0e71f420ea68 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.904+0000 7ff80a7fc700 1 -- 172.21.15.81:0/1973623309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc00e070 con 0x7ff80c1578d0 2023-10-07T08:44:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.904+0000 7ff80a7fc700 1 -- 172.21.15.81:0/1973623309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7fc00ba50 con 0x7ff80c1578d0 2023-10-07T08:44:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.904+0000 7ff80a7fc700 1 -- 172.21.15.81:0/1973623309 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc0092e0 con 0x7ff80c1578d0 2023-10-07T08:44:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.904+0000 7ff811bc1700 1 -- 172.21.15.81:0/1973623309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c1578d0 msgr2=0x7ff80c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.904+0000 7ff811bc1700 1 --2- 172.21.15.81:0/1973623309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c1578d0 0x7ff80c0cf4f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff80c0b3940 tx=0x7ff7fc009840 comp rx=0 tx=0).stop 2023-10-07T08:44:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.904+0000 7ff811bc1700 1 -- 172.21.15.81:0/1973623309 shutdown_connections 2023-10-07T08:44:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.904+0000 7ff811bc1700 1 --2- 172.21.15.81:0/1973623309 >> v2:172.21.15.89:3300/0 conn(0x7ff80c06d120 0x7ff80c06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.904+0000 7ff811bc1700 1 --2- 172.21.15.81:0/1973623309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c1578d0 0x7ff80c0cf4f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.904+0000 7ff811bc1700 1 --2- 172.21.15.81:0/1973623309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80c157ca0 0x7ff80c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.904+0000 7ff811bc1700 1 -- 172.21.15.81:0/1973623309 >> 172.21.15.81:0/1973623309 conn(0x7ff80c06bb90 msgr2=0x7ff80c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.904+0000 7ff811bc1700 1 -- 172.21.15.81:0/1973623309 shutdown_connections 2023-10-07T08:44:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.904+0000 7ff811bc1700 1 -- 172.21.15.81:0/1973623309 wait complete. 2023-10-07T08:44:30.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.905+0000 7ff811bc1700 1 Processor -- start 2023-10-07T08:44:30.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.905+0000 7ff811bc1700 1 -- start start 2023-10-07T08:44:30.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.906+0000 7ff811bc1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff80c06d120 0x7ff80c0cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:30.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.906+0000 7ff811bc1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80c1578d0 0x7ff80c16aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:30.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.906+0000 7ff811bc1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c157ca0 0x7ff80c069b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:30.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.906+0000 7ff811bc1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c1598c0 con 0x7ff80c157ca0 2023-10-07T08:44:30.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.906+0000 7ff811bc1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c16b3e0 con 0x7ff80c06d120 2023-10-07T08:44:30.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.906+0000 7ff811bc1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c0c9330 con 0x7ff80c1578d0 2023-10-07T08:44:30.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.906+0000 7ff80bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c157ca0 0x7ff80c069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:30.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.906+0000 7ff80bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c157ca0 0x7ff80c069b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48660/0 (socket says 172.21.15.81:48660) 2023-10-07T08:44:30.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.906+0000 7ff80bfff700 1 -- 172.21.15.81:0/4214779273 learned_addr learned my addr 172.21.15.81:0/4214779273 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:30.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.906+0000 7ff80b7fe700 1 --2- 172.21.15.81:0/4214779273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff80c06d120 0x7ff80c0cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:30.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.906+0000 7ff80affd700 1 --2- 172.21.15.81:0/4214779273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80c1578d0 0x7ff80c16aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:30.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.907+0000 7ff80bfff700 1 -- 172.21.15.81:0/4214779273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80c1578d0 msgr2=0x7ff80c16aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:30.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.907+0000 7ff80bfff700 1 --2- 172.21.15.81:0/4214779273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80c1578d0 0x7ff80c16aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:30.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.907+0000 7ff80bfff700 1 -- 172.21.15.81:0/4214779273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff80c06d120 msgr2=0x7ff80c0cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:30.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.907+0000 7ff80bfff700 1 --2- 172.21.15.81:0/4214779273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff80c06d120 0x7ff80c0cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:30.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.907+0000 7ff80bfff700 1 -- 172.21.15.81:0/4214779273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc009ae0 con 0x7ff80c157ca0 2023-10-07T08:44:30.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.907+0000 7ff80bfff700 1 --2- 172.21.15.81:0/4214779273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c157ca0 0x7ff80c069b30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff80400e870 tx=0x7ff804008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:30.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.907+0000 7ff7f37fe700 1 -- 172.21.15.81:0/4214779273 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804013410 con 0x7ff80c157ca0 2023-10-07T08:44:30.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.907+0000 7ff7f37fe700 1 -- 172.21.15.81:0/4214779273 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff804013570 con 0x7ff80c157ca0 2023-10-07T08:44:30.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.907+0000 7ff811bc1700 1 -- 172.21.15.81:0/4214779273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80c0c8720 con 0x7ff80c157ca0 2023-10-07T08:44:30.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.907+0000 7ff7f37fe700 1 -- 172.21.15.81:0/4214779273 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8040138f0 con 0x7ff80c157ca0 2023-10-07T08:44:30.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.907+0000 7ff811bc1700 1 -- 172.21.15.81:0/4214779273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80c0c8ce0 con 0x7ff80c157ca0 2023-10-07T08:44:30.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.908+0000 7ff811bc1700 1 -- 172.21.15.81:0/4214779273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80c067ac0 con 0x7ff80c157ca0 2023-10-07T08:44:30.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.908+0000 7ff7f37fe700 1 -- 172.21.15.81:0/4214779273 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff804013ca0 con 0x7ff80c157ca0 2023-10-07T08:44:30.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.908+0000 7ff7f37fe700 1 --2- 172.21.15.81:0/4214779273 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff7f8066f30 0x7ff7f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:30.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.909+0000 7ff7f37fe700 1 -- 172.21.15.81:0/4214779273 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff8040841d0 con 0x7ff80c157ca0 2023-10-07T08:44:30.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.909+0000 7ff80b7fe700 1 --2- 172.21.15.81:0/4214779273 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff7f8066f30 0x7ff7f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:30.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.909+0000 7ff80b7fe700 1 --2- 172.21.15.81:0/4214779273 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff7f8066f30 0x7ff7f80693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc009880 tx=0x7ff7fc018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:30.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:30.913+0000 7ff7f37fe700 1 -- 172.21.15.81:0/4214779273 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff804054ed0 con 0x7ff80c157ca0 2023-10-07T08:44:31.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:31.094+0000 7ff811bc1700 1 -- 172.21.15.81:0/4214779273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff80c0d0170 con 0x7ff80c157ca0 2023-10-07T08:44:31.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:31.095+0000 7ff7f37fe700 1 -- 172.21.15.81:0/4214779273 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v47) v1 ==== 81+0+32212 (secure 0 0 0) 0x7ff804054a60 con 0x7ff80c157ca0 2023-10-07T08:44:31.096 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:31.097 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:44:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 47, 2023-10-07T08:44:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:44:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:44:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:44:20.421712+0000", 2023-10-07T08:44:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:44:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:44:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:44:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:44:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:44:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:44:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:44:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:44:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:44:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:44:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:44:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:44:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:44:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:44:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 7, 2023-10-07T08:44:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:44:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:44:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:44:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:44:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:44:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:44:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:44:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:44:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:44:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:44:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:44:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:44:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:44:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:44:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:44:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "17", 2023-10-07T08:44:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:44:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:44:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:44:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 6, 2023-10-07T08:44:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:44:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:44:17.114223+0000", 2023-10-07T08:44:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:44:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:44:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:44:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:44:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:44:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:44:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:44:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "46", 2023-10-07T08:44:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:44:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:44:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:44:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:44:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:44:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 7, 2023-10-07T08:44:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:44:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:44:17.763615+0000", 2023-10-07T08:44:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:44:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:44:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:44:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:44:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:44:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:44:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:44:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "47", 2023-10-07T08:44:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:44:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:44:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:44:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:44:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:44:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:44:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:44:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:44:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:44:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:44:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:44:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:44:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:44:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:44:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:44:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:44:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:44:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:44:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:44:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:44:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:44:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:44:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:44:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:44:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:44:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:44:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:44:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:44:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:44:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:44:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:44:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:44:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:44:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:44:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:44:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:44:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.138 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:31.138 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.138 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:44:31.138 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:31.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.138 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:44:31.138 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:31.138 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.139 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.139 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:31.139 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.139 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.139 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:44:31.139 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:31.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.139 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.139 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:44:31.140 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:31.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.140 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.140 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:44:31.140 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:44:31.140 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:44:31.140 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:44:31.140 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:31.140 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:31.140 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:31.140 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.141 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:44:31.141 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:31.141 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:31.141 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:31.141 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:31.141 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:31.141 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:31.141 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:31.141 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:31.141 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:31.141 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:31.142 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:31.142 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:31.142 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.142 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.142 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:44:31.142 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:31.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.142 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.142 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:44:31.142 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:31.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.143 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.143 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:31.143 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.143 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.143 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:44:31.143 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:31.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.143 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.144 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:44:31.144 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:31.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.144 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.144 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:31.144 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.144 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:44:31.144 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:31.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.145 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:44:31.145 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:31.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.145 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.145 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:31.145 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.145 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:44:31.146 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:31.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.146 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.146 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:44:31.146 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:31.146 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.146 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.146 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:44:31.146 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:44:31.146 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:44:31.146 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:44:31.147 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:31.147 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:31.147 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:31.147 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.147 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:44:31.147 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:31.147 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:31.147 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:31.147 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:31.147 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:44:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:44:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:44:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:44:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:44:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:44:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:44:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:44:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:44:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:44:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:44:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:44:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:44:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:44:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:44:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:44:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:44:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:44:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:44:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:44:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:44:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:44:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:44:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:44:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:44:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:31.160 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:31.160 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:31.160 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.160 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:44:31.160 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:31.160 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:31.160 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:31.161 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:31.161 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:31.161 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:31.161 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:31.161 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:31.161 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:31.161 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:31.161 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:31.161 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:31.162 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.162 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:44:31.162 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:31.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.162 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:44:31.163 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:31.163 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.163 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.163 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:31.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:44:31.164 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:31.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.164 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.164 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:44:31.164 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:31.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.164 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.164 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:31.165 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.165 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:44:31.165 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:31.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.165 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:44:31.165 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:31.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.165 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.166 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:31.166 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.166 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.166 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:44:31.166 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:31.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.166 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.166 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:44:31.166 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:31.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.167 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.167 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:44:31.167 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:44:31.167 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:44:31.167 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:44:31.167 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:31.167 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:31.167 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:31.167 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.168 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:44:31.168 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:31.168 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:31.168 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:31.168 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:31.168 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:31.168 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:31.168 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:31.168 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:31.168 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:31.168 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:31.168 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:31.169 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:31.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:44:31.169 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:31.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:44:31.169 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:31.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.169 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.170 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:31.170 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.170 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:44:31.170 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:31.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.171 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.171 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:44:31.171 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:31.171 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.171 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.171 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:31.171 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.171 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.171 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:44:31.171 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:31.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.172 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.172 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:44:31.172 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:31.172 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.172 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.172 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:31.172 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:31.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.172 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:31.173 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:44:31.173 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:31.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.173 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:31.173 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:44:31.173 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:31.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.173 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.173 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:44:31.173 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:44:31.174 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:44:31.174 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:44:31.174 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:31.174 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:31.174 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:31.174 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:31.174 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.174 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:31.174 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:44:31.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.174 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:44:31.174 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:31.175 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:31.175 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:31.175 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:31.175 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:31.175 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:44:31.175 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:31.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.175 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:44:31.175 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:31.175 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:31.175 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:31.176 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:31.176 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:31.176 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:44:31.176 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:31.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.176 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:44:31.176 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:31.176 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:31.176 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:31.176 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:31.176 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:31.177 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:44:31.177 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:31.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.177 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:44:31.177 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:31.177 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:31.177 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:31.177 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:31.177 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:31.177 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:44:31.177 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:31.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.178 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:44:31.178 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:31.178 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:31.178 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:31.178 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:31.178 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:31.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:44:31.178 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:31.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.179 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:44:31.179 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:31.179 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:31.179 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:31.179 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:31.179 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:31.179 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:44:31.179 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:31.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.179 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:44:31.179 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:31.180 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:31.180 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:31.180 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:31.180 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:31.180 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:44:31.180 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:31.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:31.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:44:31.180 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:31.180 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:31.181 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:31.181 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:31.181 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:31.181 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:44:31.181 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:31.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.181 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:31.181 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:44:31.181 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:44:31.181 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:44:31.181 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:44:31.181 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:44:31.182 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:44:31.182 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:44:31.182 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:44:31.182 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:44:31.182 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:44:31.182 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:44:31.182 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:44:31.182 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:44:31.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:31.182 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:44:31.182 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:44:31.183 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:44:31.183 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:44:31.183 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:44:31.183 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:44:31.183 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:44:31.183 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:44:31.183 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:44:31.183 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:44:31.183 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:44:31.183 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:31.183 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:44:31.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:31.097+0000 7ff811bc1700 1 -- 172.21.15.81:0/4214779273 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff7f8066f30 msgr2=0x7ff7f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:31.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:31.097+0000 7ff811bc1700 1 --2- 172.21.15.81:0/4214779273 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff7f8066f30 0x7ff7f80693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc009880 tx=0x7ff7fc018000 comp rx=0 tx=0).stop 2023-10-07T08:44:31.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:31.097+0000 7ff811bc1700 1 -- 172.21.15.81:0/4214779273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c157ca0 msgr2=0x7ff80c069b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:31.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:31.097+0000 7ff811bc1700 1 --2- 172.21.15.81:0/4214779273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c157ca0 0x7ff80c069b30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff80400e870 tx=0x7ff804008040 comp rx=0 tx=0).stop 2023-10-07T08:44:31.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:31.097+0000 7ff811bc1700 1 -- 172.21.15.81:0/4214779273 shutdown_connections 2023-10-07T08:44:31.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:31.097+0000 7ff811bc1700 1 --2- 172.21.15.81:0/4214779273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c157ca0 0x7ff80c069b30 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:31.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:31.097+0000 7ff811bc1700 1 --2- 172.21.15.81:0/4214779273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff80c06d120 0x7ff80c0cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:31.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:31.097+0000 7ff811bc1700 1 --2- 172.21.15.81:0/4214779273 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff7f8066f30 0x7ff7f80693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:31.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:31.097+0000 7ff811bc1700 1 --2- 172.21.15.81:0/4214779273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff80c1578d0 0x7ff80c16aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:31.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:31.097+0000 7ff811bc1700 1 -- 172.21.15.81:0/4214779273 >> 172.21.15.81:0/4214779273 conn(0x7ff80c06bb90 msgr2=0x7ff80c155b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:31.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:31.097+0000 7ff811bc1700 1 -- 172.21.15.81:0/4214779273 shutdown_connections 2023-10-07T08:44:31.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:31.097+0000 7ff811bc1700 1 -- 172.21.15.81:0/4214779273 wait complete. 2023-10-07T08:44:31.187 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-07T08:44:32.485 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:44:32.483+0000 7f43c6f32700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-07T08:44:36.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:44:36.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.316+0000 7f3aaa63b700 1 Processor -- start 2023-10-07T08:44:36.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.316+0000 7f3aaa63b700 1 -- start start 2023-10-07T08:44:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aaa63b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3aa4157ca0 0x7f3aa40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aaa63b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa40d07c0 con 0x7f3aa406d120 2023-10-07T08:44:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aaa63b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa40cfbb0 con 0x7f3aa41578d0 2023-10-07T08:44:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aaa63b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa40cfe90 con 0x7f3aa4157ca0 2023-10-07T08:44:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa8bd8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3aa406d120 0x7f3aa415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35402/0 (socket says 172.21.15.81:35402) 2023-10-07T08:44:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa8bd8700 1 -- 172.21.15.81:0/3024324925 learned_addr learned my addr 172.21.15.81:0/3024324925 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa37fe700 1 --2- 172.21.15.81:0/3024324925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3aa4157ca0 0x7f3aa40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 -- 172.21.15.81:0/3024324925 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160752552 0 0) 0x7f3aa40d07c0 con 0x7f3aa406d120 2023-10-07T08:44:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 -- 172.21.15.81:0/3024324925 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a8c003570 con 0x7f3aa406d120 2023-10-07T08:44:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 -- 172.21.15.81:0/3024324925 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084295501 0 0) 0x7f3aa40cfbb0 con 0x7f3aa41578d0 2023-10-07T08:44:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 -- 172.21.15.81:0/3024324925 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aa40d07c0 con 0x7f3aa41578d0 2023-10-07T08:44:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 -- 172.21.15.81:0/3024324925 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 487822660 0 0) 0x7f3a8c003570 con 0x7f3aa406d120 2023-10-07T08:44:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 -- 172.21.15.81:0/3024324925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3aa4157ca0 msgr2=0x7f3aa40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 --2- 172.21.15.81:0/3024324925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3aa4157ca0 0x7f3aa40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 -- 172.21.15.81:0/3024324925 >> v1:172.21.15.89:6789/0 conn(0x7f3aa41578d0 legacy=0x7f3aa415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 -- 172.21.15.81:0/3024324925 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa40d0170 con 0x7f3aa406d120 2023-10-07T08:44:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 -- 172.21.15.81:0/3024324925 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f3a9c0017f0 con 0x7f3aa406d120 2023-10-07T08:44:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa37fe700 1 --2- 172.21.15.81:0/3024324925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3aa4157ca0 0x7f3aa40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:44:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 -- 172.21.15.81:0/3024324925 >> v1:172.21.15.81:6789/0 conn(0x7f3aa406d120 legacy=0x7f3aa415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 --2- 172.21.15.81:0/3024324925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3aa4157ca0 0x7f3a8c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 --2- 172.21.15.81:0/3024324925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a8c004160 0x7f3a8c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 --2- 172.21.15.81:0/3024324925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a8c004d50 0x7f3a8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 -- 172.21.15.81:0/3024324925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa40cfe90 con 0x7f3a8c004160 2023-10-07T08:44:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 -- 172.21.15.81:0/3024324925 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c00bba0 con 0x7f3a8c004d50 2023-10-07T08:44:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.317+0000 7f3aa2ffd700 1 -- 172.21.15.81:0/3024324925 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c00bd60 con 0x7f3aa4157ca0 2023-10-07T08:44:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.318+0000 7f3aa37fe700 1 --2- 172.21.15.81:0/3024324925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a8c004160 0x7f3a8c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.318+0000 7f3aa3fff700 1 --2- 172.21.15.81:0/3024324925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3aa4157ca0 0x7f3a8c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.318+0000 7f3aa8bd8700 1 --2- 172.21.15.81:0/3024324925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a8c004d50 0x7f3a8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.318+0000 7f3aa37fe700 1 -- 172.21.15.81:0/3024324925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3aa4157ca0 msgr2=0x7f3a8c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.318+0000 7f3aa37fe700 1 --2- 172.21.15.81:0/3024324925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3aa4157ca0 0x7f3a8c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.318+0000 7f3aa37fe700 1 -- 172.21.15.81:0/3024324925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a8c004d50 msgr2=0x7f3a8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.318+0000 7f3aa37fe700 1 --2- 172.21.15.81:0/3024324925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a8c004d50 0x7f3a8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.318+0000 7f3aa37fe700 1 -- 172.21.15.81:0/3024324925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a98009420 con 0x7f3a8c004160 2023-10-07T08:44:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.318+0000 7f3aa8bd8700 1 --2- 172.21.15.81:0/3024324925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a8c004d50 0x7f3a8c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.318+0000 7f3aa37fe700 1 --2- 172.21.15.81:0/3024324925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a8c004160 0x7f3a8c004810 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3a98009db0 tx=0x7f3a980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53db04ab50b478b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.318+0000 7f3aa2ffd700 1 -- 172.21.15.81:0/3024324925 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a98009740 con 0x7f3a8c004160 2023-10-07T08:44:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.318+0000 7f3aa2ffd700 1 -- 172.21.15.81:0/3024324925 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9800e920 con 0x7f3a8c004160 2023-10-07T08:44:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.318+0000 7f3aa2ffd700 1 -- 172.21.15.81:0/3024324925 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9800ece0 con 0x7f3a8c004160 2023-10-07T08:44:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.319+0000 7f3aaa63b700 1 -- 172.21.15.81:0/3024324925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a8c004160 msgr2=0x7f3a8c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.319+0000 7f3aaa63b700 1 --2- 172.21.15.81:0/3024324925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a8c004160 0x7f3a8c004810 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3a98009db0 tx=0x7f3a980091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.319+0000 7f3aa8bd8700 1 -- 172.21.15.81:0/3024324925 reap_dead start 2023-10-07T08:44:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.319+0000 7f3aaa63b700 1 -- 172.21.15.81:0/3024324925 shutdown_connections 2023-10-07T08:44:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.319+0000 7f3aaa63b700 1 -- 172.21.15.81:0/3024324925 >> 172.21.15.81:0/3024324925 conn(0x7f3aa406bb90 msgr2=0x7f3aa406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.319+0000 7f3aaa63b700 1 -- 172.21.15.81:0/3024324925 shutdown_connections 2023-10-07T08:44:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.319+0000 7f3aaa63b700 1 -- 172.21.15.81:0/3024324925 wait complete. 2023-10-07T08:44:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.320+0000 7f3aaa63b700 1 Processor -- start 2023-10-07T08:44:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.320+0000 7f3aaa63b700 1 -- start start 2023-10-07T08:44:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aaa63b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a8c004160 0x7f3aa40b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aaa63b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3aa416e920 0x7f3aa40b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:36.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aaa63b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa40b67e0 0x7f3aa416a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:36.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aaa63b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa40ac320 con 0x7f3aa40b67e0 2023-10-07T08:44:36.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aaa63b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa40b6c50 con 0x7f3aa416e920 2023-10-07T08:44:36.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aaa63b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa416b640 con 0x7f3a8c004160 2023-10-07T08:44:36.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aa8bd8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa40b67e0 0x7f3aa416a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:36.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aa8bd8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa40b67e0 0x7f3aa416a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35202/0 (socket says 172.21.15.81:35202) 2023-10-07T08:44:36.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aa8bd8700 1 -- 172.21.15.81:0/1811322505 learned_addr learned my addr 172.21.15.81:0/1811322505 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:36.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aa37fe700 1 --2- 172.21.15.81:0/1811322505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3aa416e920 0x7f3aa40b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:36.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aa3fff700 1 --2- 172.21.15.81:0/1811322505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a8c004160 0x7f3aa40b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aa8bd8700 1 -- 172.21.15.81:0/1811322505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a8c004160 msgr2=0x7f3aa40b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aa8bd8700 1 --2- 172.21.15.81:0/1811322505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a8c004160 0x7f3aa40b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aa8bd8700 1 -- 172.21.15.81:0/1811322505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3aa416e920 msgr2=0x7f3aa40b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aa8bd8700 1 --2- 172.21.15.81:0/1811322505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3aa416e920 0x7f3aa40b62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aa8bd8700 1 -- 172.21.15.81:0/1811322505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa416e490 con 0x7f3aa40b67e0 2023-10-07T08:44:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3aa8bd8700 1 --2- 172.21.15.81:0/1811322505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa40b67e0 0x7f3aa416a710 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c000f80 tx=0x7f3aa415b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.321+0000 7f3a8bfff700 1 -- 172.21.15.81:0/1811322505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c017070 con 0x7f3aa40b67e0 2023-10-07T08:44:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.322+0000 7f3a8bfff700 1 -- 172.21.15.81:0/1811322505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9c00eab0 con 0x7f3aa40b67e0 2023-10-07T08:44:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.322+0000 7f3aaa63b700 1 -- 172.21.15.81:0/1811322505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa416b360 con 0x7f3aa40b67e0 2023-10-07T08:44:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.322+0000 7f3a8bfff700 1 -- 172.21.15.81:0/1811322505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c00ee70 con 0x7f3aa40b67e0 2023-10-07T08:44:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.322+0000 7f3aaa63b700 1 -- 172.21.15.81:0/1811322505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa416e120 con 0x7f3aa40b67e0 2023-10-07T08:44:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.322+0000 7f3aaa63b700 1 -- 172.21.15.81:0/1811322505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa416e620 con 0x7f3aa40b67e0 2023-10-07T08:44:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.323+0000 7f3a8bfff700 1 -- 172.21.15.81:0/1811322505 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a9c013630 con 0x7f3aa40b67e0 2023-10-07T08:44:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.323+0000 7f3a8bfff700 1 --2- 172.21.15.81:0/1811322505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3a90066f60 0x7f3a90069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.323+0000 7f3a8bfff700 1 -- 172.21.15.81:0/1811322505 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a9c084200 con 0x7f3aa40b67e0 2023-10-07T08:44:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.323+0000 7f3aa3fff700 1 --2- 172.21.15.81:0/1811322505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3a90066f60 0x7f3a90069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.324+0000 7f3a8bfff700 1 -- 172.21.15.81:0/1811322505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=51}) v3 -- 0x7f3a9006ea80 con 0x7f3aa40b67e0 2023-10-07T08:44:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.324+0000 7f3aa3fff700 1 --2- 172.21.15.81:0/1811322505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3a90066f60 0x7f3a90069410 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3a94003d00 tx=0x7f3a94007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.328+0000 7f3a8bfff700 1 -- 172.21.15.81:0/1811322505 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a9c051470 con 0x7f3aa40b67e0 2023-10-07T08:44:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.512+0000 7f3aaa63b700 1 -- 172.21.15.81:0/1811322505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3aa40d0450 con 0x7f3aa40b67e0 2023-10-07T08:44:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.513+0000 7f3a8bfff700 1 -- 172.21.15.81:0/1811322505 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) v1 ==== 81+0+32355 (secure 0 0 0) 0x7f3a9c054a90 con 0x7f3aa40b67e0 2023-10-07T08:44:36.516 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:36.516 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:44:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 50, 2023-10-07T08:44:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:44:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:44:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:44:36.239610+0000", 2023-10-07T08:44:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:44:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:44:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:44:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:44:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:44:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:44:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:44:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:44:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:44:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:44:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:44:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:44:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:44:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:44:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 7, 2023-10-07T08:44:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:44:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:44:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:44:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:44:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:44:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:44:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:44:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:44:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:44:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:44:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:44:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:44:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:44:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:44:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:44:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "48", 2023-10-07T08:44:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:44:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:44:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:44:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 6, 2023-10-07T08:44:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:44:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:44:17.114223+0000", 2023-10-07T08:44:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:44:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:44:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:44:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:44:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:44:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:44:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:44:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "48", 2023-10-07T08:44:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:44:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:44:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:44:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:44:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:44:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 7, 2023-10-07T08:44:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:44:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:44:17.763615+0000", 2023-10-07T08:44:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:44:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:44:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:44:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:44:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:44:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:44:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:44:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "48", 2023-10-07T08:44:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:36.544 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:44:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:44:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:36.545 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:44:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:44:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:44:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:44:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:36.547 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:36.548 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:36.549 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:36.549 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:36.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:44:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:44:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:44:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:44:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:44:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:44:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:44:36.558 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:36.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.558 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:44:36.559 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:36.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.559 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.559 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:44:36.560 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:44:36.560 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:44:36.560 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:44:36.560 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:36.560 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:36.560 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:44:36.561 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:36.561 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.561 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:44:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:44:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:44:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:44:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:44:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:44:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:44:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:44:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:44:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:44:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:44:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:44:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:44:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:44:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:36.569 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:36.569 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:36.569 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:36.569 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:36.569 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:36.569 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.569 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:44:36.569 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:36.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.570 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.570 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:44:36.570 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:36.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.570 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.570 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:36.570 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.570 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.570 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:44:36.570 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:36.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.571 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:44:36.571 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:36.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.571 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.571 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:36.571 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.571 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:44:36.572 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:36.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.572 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.572 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:44:36.572 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:36.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.572 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.572 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:36.572 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.573 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.573 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:44:36.573 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:36.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.573 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.573 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:44:36.573 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:36.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.573 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.573 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:44:36.573 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:44:36.574 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:44:36.574 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:44:36.574 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:36.574 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:36.574 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:44:36.574 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:36.574 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.574 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:44:36.574 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:36.575 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:36.575 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:36.575 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:36.575 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:36.575 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:36.575 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:36.575 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:36.575 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:36.575 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:36.575 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:36.575 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:36.575 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.576 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:44:36.576 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:36.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.576 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:44:36.576 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:36.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.577 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.577 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:36.577 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.578 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:44:36.578 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:36.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.578 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:44:36.578 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:36.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.579 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.579 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:36.579 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.579 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:44:36.579 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:36.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.580 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:44:36.580 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:36.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.580 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.580 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:36.580 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.580 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:44:36.581 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:36.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.581 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.581 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:44:36.581 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:36.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.581 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.581 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:44:36.581 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:44:36.581 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:44:36.582 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:44:36.582 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:36.582 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull", 2023-10-07T08:44:36.582 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:36.582 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:36.582 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.583 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:44:36.583 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:36.583 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:36.583 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:36.583 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:36.583 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:36.583 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:36.583 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:36.584 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:36.584 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:36.584 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:36.584 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:36.584 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:36.584 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.584 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:44:36.584 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:36.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.585 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:44:36.585 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:36.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.585 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.585 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:36.585 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.586 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:44:36.586 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:36.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.586 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:44:36.587 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:36.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.587 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.587 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:36.587 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.588 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:44:36.588 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:36.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.589 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:44:36.589 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:36.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.589 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.590 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:36.590 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.590 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:44:36.590 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:36.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.591 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.591 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:44:36.591 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:36.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.591 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.592 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:44:36.592 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:44:36.592 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:44:36.592 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:44:36.592 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:36.592 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:36.592 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:36.592 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.593 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:44:36.593 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:36.593 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:36.593 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:36.593 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:36.593 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:36.593 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:36.593 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:36.593 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:36.593 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:36.594 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:36.594 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:36.594 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:36.594 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.594 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:44:36.594 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:36.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:44:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:44:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:44:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:44:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:44:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:44:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:44:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:44:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:44:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:44:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:44:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:44:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:44:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:44:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:44:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:44:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:44:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:44:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:44:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:44:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:44:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:44:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:44:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:44:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:44:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:44:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:44:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:44:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:44:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:44:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.613 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:44:36.613 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:36.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.614 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:44:36.614 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:36.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.614 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:44:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:44:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:44:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:44:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:44:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:44:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:44:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:44:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:44:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:36.620 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:36.620 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:36.620 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:44:36.620 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:36.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:44:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:44:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:44:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:44:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:44:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:44:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:44:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:44:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:44:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:44:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:44:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:44:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:44:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:44:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:44:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:44:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:44:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:44:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:44:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:44:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:44:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:44:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:44:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:44:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:44:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:44:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:44:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:44:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:44:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:44:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:44:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:44:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:44:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:44:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:44:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:44:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:44:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:44:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:36.629 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:44:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.515+0000 7f3aaa63b700 1 -- 172.21.15.81:0/1811322505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3a90066f60 msgr2=0x7f3a90069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.515+0000 7f3aaa63b700 1 --2- 172.21.15.81:0/1811322505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3a90066f60 0x7f3a90069410 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3a94003d00 tx=0x7f3a94007d30 comp rx=0 tx=0).stop 2023-10-07T08:44:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.515+0000 7f3aaa63b700 1 -- 172.21.15.81:0/1811322505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa40b67e0 msgr2=0x7f3aa416a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.515+0000 7f3aaa63b700 1 --2- 172.21.15.81:0/1811322505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa40b67e0 0x7f3aa416a710 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c000f80 tx=0x7f3aa415b610 comp rx=0 tx=0).stop 2023-10-07T08:44:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.515+0000 7f3aaa63b700 1 -- 172.21.15.81:0/1811322505 shutdown_connections 2023-10-07T08:44:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.515+0000 7f3aaa63b700 1 --2- 172.21.15.81:0/1811322505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa40b67e0 0x7f3aa416a710 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.515+0000 7f3aaa63b700 1 --2- 172.21.15.81:0/1811322505 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3a90066f60 0x7f3a90069410 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.515+0000 7f3aaa63b700 1 --2- 172.21.15.81:0/1811322505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a8c004160 0x7f3aa40b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.515+0000 7f3aaa63b700 1 --2- 172.21.15.81:0/1811322505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3aa416e920 0x7f3aa40b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.515+0000 7f3aaa63b700 1 -- 172.21.15.81:0/1811322505 >> 172.21.15.81:0/1811322505 conn(0x7f3aa406bb90 msgr2=0x7f3aa415a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.516+0000 7f3aaa63b700 1 -- 172.21.15.81:0/1811322505 shutdown_connections 2023-10-07T08:44:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:36.516+0000 7f3aaa63b700 1 -- 172.21.15.81:0/1811322505 wait complete. 2023-10-07T08:44:36.632 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-07T08:44:36.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:44:36.633 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-10-07T08:44:36.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:44:36.892 INFO:teuthology.orchestra.run.smithi081.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-07T08:44:36.892 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records in 2023-10-07T08:44:36.893 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records out 2023-10-07T08:44:36.893 INFO:teuthology.orchestra.run.smithi081.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.238901 s, 219 MB/s 2023-10-07T08:44:36.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:44:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.006+0000 7f40548bd700 1 Processor -- start 2023-10-07T08:44:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.006+0000 7f40548bd700 1 -- start start 2023-10-07T08:44:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.007+0000 7f40548bd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4050159f10 0x7f4050068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.007+0000 7f40548bd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4050069120 con 0x7f4050068cc0 2023-10-07T08:44:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.007+0000 7f40548bd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40500cee10 con 0x7f4050159b40 2023-10-07T08:44:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.007+0000 7f40548bd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40500cd040 con 0x7f4050159f10 2023-10-07T08:44:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.007+0000 7f404f59e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4050068cc0 0x7f40500cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35406/0 (socket says 172.21.15.81:35406) 2023-10-07T08:44:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.007+0000 7f404f59e700 1 -- 172.21.15.81:0/2018352337 learned_addr learned my addr 172.21.15.81:0/2018352337 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.007+0000 7f404659c700 1 --2- 172.21.15.81:0/2018352337 >> v2:172.21.15.89:3300/0 conn(0x7f4050159f10 0x7f4050068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.007+0000 7f404e59c700 1 -- 172.21.15.81:0/2018352337 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129223265 0 0) 0x7f4048001490 con 0x7f4050068cc0 2023-10-07T08:44:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.007+0000 7f404e59c700 1 -- 172.21.15.81:0/2018352337 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f403c003570 con 0x7f4050068cc0 2023-10-07T08:44:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404e59c700 1 -- 172.21.15.81:0/2018352337 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2091594548 0 0) 0x7f403c003570 con 0x7f4050068cc0 2023-10-07T08:44:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404e59c700 1 -- 172.21.15.81:0/2018352337 >> v2:172.21.15.89:3300/0 conn(0x7f4050159f10 msgr2=0x7f4050068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404e59c700 1 --2- 172.21.15.81:0/2018352337 >> v2:172.21.15.89:3300/0 conn(0x7f4050159f10 0x7f4050068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404e59c700 1 -- 172.21.15.81:0/2018352337 >> v1:172.21.15.89:6789/0 conn(0x7f4050159b40 legacy=0x7f40500cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404e59c700 1 -- 172.21.15.81:0/2018352337 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40500cd320 con 0x7f4050068cc0 2023-10-07T08:44:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404e59c700 1 -- 172.21.15.81:0/2018352337 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f4048001980 con 0x7f4050068cc0 2023-10-07T08:44:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404e59c700 1 -- 172.21.15.81:0/2018352337 >> v1:172.21.15.81:6789/0 conn(0x7f4050068cc0 legacy=0x7f40500cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404e59c700 1 --2- 172.21.15.81:0/2018352337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f403c003a60 0x7f403c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404e59c700 1 --2- 172.21.15.81:0/2018352337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f403c004810 0x7f403c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404e59c700 1 --2- 172.21.15.81:0/2018352337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f403c0051c0 0x7f403c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404e59c700 1 -- 172.21.15.81:0/2018352337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40500cd040 con 0x7f403c004810 2023-10-07T08:44:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404e59c700 1 -- 172.21.15.81:0/2018352337 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c00c0d0 con 0x7f403c003a60 2023-10-07T08:44:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404e59c700 1 -- 172.21.15.81:0/2018352337 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403c00c290 con 0x7f403c0051c0 2023-10-07T08:44:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404659c700 1 --2- 172.21.15.81:0/2018352337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f403c004810 0x7f403c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404ed9d700 1 --2- 172.21.15.81:0/2018352337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f403c003a60 0x7f403c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404f59e700 1 --2- 172.21.15.81:0/2018352337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f403c0051c0 0x7f403c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404659c700 1 -- 172.21.15.81:0/2018352337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f403c0051c0 msgr2=0x7f403c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404659c700 1 --2- 172.21.15.81:0/2018352337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f403c0051c0 0x7f403c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404659c700 1 -- 172.21.15.81:0/2018352337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f403c003a60 msgr2=0x7f403c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404659c700 1 --2- 172.21.15.81:0/2018352337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f403c003a60 0x7f403c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404659c700 1 -- 172.21.15.81:0/2018352337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c003570 con 0x7f403c004810 2023-10-07T08:44:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404f59e700 1 -- 172.21.15.81:0/2018352337 reap_dead start 2023-10-07T08:44:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404ed9d700 1 --2- 172.21.15.81:0/2018352337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f403c003a60 0x7f403c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404659c700 1 --2- 172.21.15.81:0/2018352337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f403c004810 0x7f403c004c80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4038009c00 tx=0x7f40380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b32fe83b4fbde2e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404e59c700 1 -- 172.21.15.81:0/2018352337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403800e710 con 0x7f403c004810 2023-10-07T08:44:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404e59c700 1 -- 172.21.15.81:0/2018352337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403800e870 con 0x7f403c004810 2023-10-07T08:44:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.008+0000 7f404e59c700 1 -- 172.21.15.81:0/2018352337 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403800ec30 con 0x7f403c004810 2023-10-07T08:44:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.009+0000 7f40548bd700 1 -- 172.21.15.81:0/2018352337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f403c004810 msgr2=0x7f403c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.009+0000 7f40548bd700 1 --2- 172.21.15.81:0/2018352337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f403c004810 0x7f403c004c80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4038009c00 tx=0x7f40380091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.009+0000 7f40548bd700 1 -- 172.21.15.81:0/2018352337 shutdown_connections 2023-10-07T08:44:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.009+0000 7f40548bd700 1 --2- 172.21.15.81:0/2018352337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f403c004810 0x7f403c004c80 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.009+0000 7f40548bd700 1 -- 172.21.15.81:0/2018352337 >> 172.21.15.81:0/2018352337 conn(0x7f40500cd660 msgr2=0x7f40500cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.009+0000 7f40548bd700 1 -- 172.21.15.81:0/2018352337 shutdown_connections 2023-10-07T08:44:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.009+0000 7f40548bd700 1 -- 172.21.15.81:0/2018352337 wait complete. 2023-10-07T08:44:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.010+0000 7f40548bd700 1 Processor -- start 2023-10-07T08:44:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.010+0000 7f40548bd700 1 -- start start 2023-10-07T08:44:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f40548bd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f403c004810 0x7f4050156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f40548bd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40500ca960 0x7f4050146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f40548bd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40501466c0 0x7f405016abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f40548bd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40500c9610 con 0x7f40501466c0 2023-10-07T08:44:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f40548bd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4050146b60 con 0x7f40500ca960 2023-10-07T08:44:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f40548bd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40500c8a00 con 0x7f403c004810 2023-10-07T08:44:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f404f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40501466c0 0x7f405016abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f404f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40501466c0 0x7f405016abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35226/0 (socket says 172.21.15.81:35226) 2023-10-07T08:44:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f404f59e700 1 -- 172.21.15.81:0/1219563383 learned_addr learned my addr 172.21.15.81:0/1219563383 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f404659c700 1 --2- 172.21.15.81:0/1219563383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40500ca960 0x7f4050146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f404ed9d700 1 --2- 172.21.15.81:0/1219563383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f403c004810 0x7f4050156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f404f59e700 1 -- 172.21.15.81:0/1219563383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f403c004810 msgr2=0x7f4050156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f404f59e700 1 --2- 172.21.15.81:0/1219563383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f403c004810 0x7f4050156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f404f59e700 1 -- 172.21.15.81:0/1219563383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40500ca960 msgr2=0x7f4050146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f404f59e700 1 --2- 172.21.15.81:0/1219563383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40500ca960 0x7f4050146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f404f59e700 1 -- 172.21.15.81:0/1219563383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40500c8ce0 con 0x7f40501466c0 2023-10-07T08:44:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f404659c700 1 --2- 172.21.15.81:0/1219563383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40500ca960 0x7f4050146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f404ed9d700 1 --2- 172.21.15.81:0/1219563383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f403c004810 0x7f4050156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.011+0000 7f404f59e700 1 --2- 172.21.15.81:0/1219563383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40501466c0 0x7f405016abc0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4048000f80 tx=0x7f4048001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.012+0000 7f40477fe700 1 -- 172.21.15.81:0/1219563383 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404800ecf0 con 0x7f40501466c0 2023-10-07T08:44:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.012+0000 7f40477fe700 1 -- 172.21.15.81:0/1219563383 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404800ee50 con 0x7f40501466c0 2023-10-07T08:44:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.012+0000 7f40548bd700 1 -- 172.21.15.81:0/1219563383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40500c8fc0 con 0x7f40501466c0 2023-10-07T08:44:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.012+0000 7f40477fe700 1 -- 172.21.15.81:0/1219563383 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4048013670 con 0x7f40501466c0 2023-10-07T08:44:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.012+0000 7f40548bd700 1 -- 172.21.15.81:0/1219563383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40500c8650 con 0x7f40501466c0 2023-10-07T08:44:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.012+0000 7f40548bd700 1 -- 172.21.15.81:0/1219563383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4050063e90 con 0x7f40501466c0 2023-10-07T08:44:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.013+0000 7f40477fe700 1 -- 172.21.15.81:0/1219563383 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4048013a20 con 0x7f40501466c0 2023-10-07T08:44:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.013+0000 7f40477fe700 1 --2- 172.21.15.81:0/1219563383 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4030066f30 0x7f40300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.013+0000 7f40477fe700 1 -- 172.21.15.81:0/1219563383 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4048084b20 con 0x7f40501466c0 2023-10-07T08:44:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.013+0000 7f404ed9d700 1 --2- 172.21.15.81:0/1219563383 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4030066f30 0x7f40300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.013+0000 7f40477fe700 1 -- 172.21.15.81:0/1219563383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=51}) v3 -- 0x7f403006ea50 con 0x7f40501466c0 2023-10-07T08:44:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.014+0000 7f404ed9d700 1 --2- 172.21.15.81:0/1219563383 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4030066f30 0x7f40300693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4040000f60 tx=0x7f4040009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.018+0000 7f40477fe700 1 -- 172.21.15.81:0/1219563383 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4048051d90 con 0x7f40501466c0 2023-10-07T08:44:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.201+0000 7f40548bd700 1 -- 172.21.15.81:0/1219563383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4050069120 con 0x7f40501466c0 2023-10-07T08:44:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.202+0000 7f40477fe700 1 -- 172.21.15.81:0/1219563383 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) v1 ==== 81+0+32355 (secure 0 0 0) 0x7f4050069120 con 0x7f40501466c0 2023-10-07T08:44:37.204 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:37.204 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:44:37.204 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 50, 2023-10-07T08:44:37.205 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:44:37.205 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:44:37.205 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:44:36.239610+0000", 2023-10-07T08:44:37.205 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:44:37.205 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:44:37.205 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:44:37.205 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:44:37.206 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:44:37.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:44:37.206 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:44:37.209 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:44:37.209 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:44:37.209 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:37.209 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:44:37.209 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:44:37.209 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:44:37.210 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:44:37.210 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:44:37.210 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 7, 2023-10-07T08:44:37.210 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:44:37.210 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:44:37.210 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:44:37.210 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:44:37.210 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:44:37.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.210 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:44:37.210 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:44:37.211 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:44:37.211 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:44:37.211 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:44:37.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:37.211 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:37.211 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:37.211 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:37.211 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:37.211 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:37.211 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:37.211 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:37.211 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:37.211 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:37.212 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:44:37.212 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:44:37.212 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:44:37.212 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:44:37.212 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:44:37.212 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:37.212 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:37.212 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:37.212 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:37.212 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:37.212 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:37.212 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "48", 2023-10-07T08:44:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:37.214 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:37.214 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:37.214 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:37.214 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:37.214 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:37.214 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:37.214 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:37.214 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:37.214 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:37.214 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:37.214 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:37.214 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:37.215 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:37.215 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:37.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:37.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.215 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:37.215 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:37.215 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:37.215 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:37.215 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:37.215 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:37.215 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:37.215 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:37.216 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:37.216 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:37.216 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:37.216 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:37.216 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:44:37.216 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:44:37.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.216 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:37.216 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:44:37.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.216 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 6, 2023-10-07T08:44:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:44:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:44:17.114223+0000", 2023-10-07T08:44:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:44:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:44:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:44:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:44:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:44:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:44:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:44:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "48", 2023-10-07T08:44:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:44:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:44:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:44:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:44:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:44:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 7, 2023-10-07T08:44:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:44:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:44:17.763615+0000", 2023-10-07T08:44:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:44:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:44:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:44:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:44:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:44:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:44:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:44:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "48", 2023-10-07T08:44:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:44:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:44:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:44:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:44:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:44:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:44:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:44:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:44:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:44:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:44:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:44:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.240 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:44:37.240 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:37.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.240 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.240 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:37.240 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:44:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:44:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.242 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:44:37.242 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:44:37.242 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:44:37.242 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:44:37.242 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:37.242 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:37.242 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:44:37.242 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:37.242 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.243 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:44:37.243 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:37.243 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:37.243 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:37.243 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:37.243 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:37.243 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:37.243 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:37.243 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:37.243 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:37.243 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:37.244 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:37.244 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:37.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:44:37.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:37.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:44:37.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:37.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.245 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.245 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:37.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:44:37.245 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:37.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.246 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:44:37.246 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:37.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.246 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.246 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:37.246 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.246 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.246 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:44:37.246 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:37.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:44:37.247 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:37.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.248 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.248 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:37.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.250 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.250 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:44:37.250 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:37.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.251 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:44:37.251 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:37.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.251 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.251 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:44:37.251 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:44:37.251 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:44:37.251 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:44:37.252 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:37.252 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:37.252 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:37.252 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.252 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:44:37.252 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:37.252 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:37.252 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:37.252 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:37.253 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:37.253 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:37.253 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:37.253 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:37.253 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:37.253 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:37.253 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:37.253 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:37.253 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.253 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:44:37.254 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:37.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:44:37.254 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:37.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.254 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.254 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:37.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.255 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:44:37.255 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:37.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.255 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:44:37.255 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:37.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.255 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.256 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:37.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.256 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:44:37.256 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:37.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.256 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:44:37.256 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:37.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.257 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.257 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:37.257 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.257 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:44:37.257 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:37.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:44:37.258 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:37.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.258 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.258 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:44:37.258 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:44:37.258 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:44:37.259 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:44:37.259 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:37.259 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:37.259 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:44:37.259 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:37.259 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.259 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:44:37.260 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:37.260 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:37.260 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:37.260 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:37.260 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:37.260 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:37.260 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:37.260 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:37.260 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:37.260 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:37.261 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:37.261 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:37.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:44:37.261 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:37.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:44:37.261 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:37.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.262 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:37.262 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.262 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.262 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:44:37.262 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:37.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:44:37.263 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:37.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.263 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.263 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:37.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:44:37.264 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:37.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:44:37.264 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:37.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.264 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.264 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:37.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:44:37.265 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:37.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:44:37.265 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:37.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:44:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:44:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:44:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:44:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull", 2023-10-07T08:44:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.266 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:44:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:37.267 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:44:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:44:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:37.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:44:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.269 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:44:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:44:37.270 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:44:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:44:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:44:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:44:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:44:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:44:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:44:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:44:37.273 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:37.274 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:44:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:44:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.275 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.276 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:37.276 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.276 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:44:37.276 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:37.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.276 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:44:37.276 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:37.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.277 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.277 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:37.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:44:37.278 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:37.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.278 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.278 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:44:37.278 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:37.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.278 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.278 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:37.278 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:44:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:44:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:37.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:44:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:44:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:44:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:44:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.281 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:44:37.281 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:37.281 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:37.281 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:37.281 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:37.281 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:37.281 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:37.281 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:37.281 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:37.282 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:37.282 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:37.282 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:37.282 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:37.282 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.282 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:44:37.282 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:37.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.283 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.283 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:44:37.283 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:37.283 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.283 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.283 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:37.283 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.283 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.284 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:44:37.284 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:37.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.284 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.284 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:44:37.284 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:37.284 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.284 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.284 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:37.285 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.285 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.285 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:44:37.285 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:37.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.285 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.285 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:44:37.285 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:37.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.286 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.286 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:37.286 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.286 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:44:37.286 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:37.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.287 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:44:37.287 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:37.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.287 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.287 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:44:37.287 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:44:37.287 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:44:37.287 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:44:37.287 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:37.287 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:37.288 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:44:37.288 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:37.288 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:44:37.288 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:37.288 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:37.288 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:37.288 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:37.288 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:37.288 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:44:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:37.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.290 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.290 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:44:37.290 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:37.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.290 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.290 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:37.290 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.290 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.291 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:44:37.291 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:37.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.291 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:44:37.291 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:37.291 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.291 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.291 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:37.292 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.292 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.292 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:44:37.292 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:37.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.292 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.292 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:44:37.292 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:37.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.292 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.293 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:37.293 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:37.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:37.293 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:44:37.293 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:37.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:37.293 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:44:37.294 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:37.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.294 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.294 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:44:37.294 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:44:37.294 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:44:37.294 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:44:37.294 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:37.294 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:37.294 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:44:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:44:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:44:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:44:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:44:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:44:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:44:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:44:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:44:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:44:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:44:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:44:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:44:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:44:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:44:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:44:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:44:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:44:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:44:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:44:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:44:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:44:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:44:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:44:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:44:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:44:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:44:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:44:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:44:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:44:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:44:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:44:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:44:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:44:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:44:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:44:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:44:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:44:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:44:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:44:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:44:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:44:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:37.305 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:44:37.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.205+0000 7f40548bd700 1 -- 172.21.15.81:0/1219563383 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4030066f30 msgr2=0x7f40300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:37.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.205+0000 7f40548bd700 1 --2- 172.21.15.81:0/1219563383 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4030066f30 0x7f40300693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4040000f60 tx=0x7f4040009040 comp rx=0 tx=0).stop 2023-10-07T08:44:37.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.205+0000 7f40548bd700 1 -- 172.21.15.81:0/1219563383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40501466c0 msgr2=0x7f405016abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:37.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.205+0000 7f40548bd700 1 --2- 172.21.15.81:0/1219563383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40501466c0 0x7f405016abc0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4048000f80 tx=0x7f4048001a70 comp rx=0 tx=0).stop 2023-10-07T08:44:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.205+0000 7f40548bd700 1 -- 172.21.15.81:0/1219563383 shutdown_connections 2023-10-07T08:44:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.205+0000 7f40548bd700 1 --2- 172.21.15.81:0/1219563383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40501466c0 0x7f405016abc0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.205+0000 7f40548bd700 1 --2- 172.21.15.81:0/1219563383 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4030066f30 0x7f40300693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.205+0000 7f40548bd700 1 --2- 172.21.15.81:0/1219563383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f403c004810 0x7f4050156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.205+0000 7f40548bd700 1 --2- 172.21.15.81:0/1219563383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40500ca960 0x7f4050146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.205+0000 7f40548bd700 1 -- 172.21.15.81:0/1219563383 >> 172.21.15.81:0/1219563383 conn(0x7f40500cd660 msgr2=0x7f40500c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.205+0000 7f40548bd700 1 -- 172.21.15.81:0/1219563383 shutdown_connections 2023-10-07T08:44:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.205+0000 7f40548bd700 1 -- 172.21.15.81:0/1219563383 wait complete. 2023-10-07T08:44:37.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:44:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.421+0000 7f5bbfea6700 1 Processor -- start 2023-10-07T08:44:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.421+0000 7f5bbfea6700 1 -- start start 2023-10-07T08:44:37.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.422+0000 7f5bbfea6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5bb80aeea0 0x7f5bb80c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:37.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.422+0000 7f5bbfea6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bb80af270 0x7f5bb80c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:37.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.422+0000 7f5bbfea6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5bb80c7d00 0x7f5bb80c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:37.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.422+0000 7f5bbfea6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb806aae0 con 0x7f5bb80aeea0 2023-10-07T08:44:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.422+0000 7f5bbfea6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb8069ed0 con 0x7f5bb80c7d00 2023-10-07T08:44:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.422+0000 7f5bbfea6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb806a1b0 con 0x7f5bb80af270 2023-10-07T08:44:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.422+0000 7f5bbdc42700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5bb80aeea0 0x7f5bb80c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.422+0000 7f5bbdc42700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5bb80aeea0 0x7f5bb80c2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35242/0 (socket says 172.21.15.81:35242) 2023-10-07T08:44:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.422+0000 7f5bbdc42700 1 -- 172.21.15.81:0/4124407136 learned_addr learned my addr 172.21.15.81:0/4124407136 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.422+0000 7f5bbd441700 1 --2- 172.21.15.81:0/4124407136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bb80af270 0x7f5bb80c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.422+0000 7f5bbe443700 1 --2- 172.21.15.81:0/4124407136 >> v2:172.21.15.89:3300/0 conn(0x7f5bb80c7d00 0x7f5bb80c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.423+0000 7f5bbdc42700 1 -- 172.21.15.81:0/4124407136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bb80af270 msgr2=0x7f5bb80c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.423+0000 7f5bbdc42700 1 --2- 172.21.15.81:0/4124407136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bb80af270 0x7f5bb80c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.423+0000 7f5bbdc42700 1 -- 172.21.15.81:0/4124407136 >> v2:172.21.15.89:3300/0 conn(0x7f5bb80c7d00 msgr2=0x7f5bb80c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:37.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.423+0000 7f5bbdc42700 1 --2- 172.21.15.81:0/4124407136 >> v2:172.21.15.89:3300/0 conn(0x7f5bb80c7d00 0x7f5bb80c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.423+0000 7f5bbdc42700 1 -- 172.21.15.81:0/4124407136 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb806a490 con 0x7f5bb80aeea0 2023-10-07T08:44:37.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.423+0000 7f5bbdc42700 1 --2- 172.21.15.81:0/4124407136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb80aeea0 0x7f5bb80c2920 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8068a10 tx=0x7f5bb400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3bf208562eae92 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:37.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.423+0000 7f5bbcc40700 1 -- 172.21.15.81:0/4124407136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb400dce0 con 0x7f5bb80aeea0 2023-10-07T08:44:37.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.423+0000 7f5bbcc40700 1 -- 172.21.15.81:0/4124407136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb400de40 con 0x7f5bb80aeea0 2023-10-07T08:44:37.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.423+0000 7f5bbcc40700 1 -- 172.21.15.81:0/4124407136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb40196d0 con 0x7f5bb80aeea0 2023-10-07T08:44:37.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.423+0000 7f5bbfea6700 1 -- 172.21.15.81:0/4124407136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb80aeea0 msgr2=0x7f5bb80c2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:37.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.423+0000 7f5bbfea6700 1 --2- 172.21.15.81:0/4124407136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb80aeea0 0x7f5bb80c2920 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8068a10 tx=0x7f5bb400b4f0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.423+0000 7f5bbfea6700 1 -- 172.21.15.81:0/4124407136 shutdown_connections 2023-10-07T08:44:37.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.423+0000 7f5bbfea6700 1 --2- 172.21.15.81:0/4124407136 >> v2:172.21.15.89:3300/0 conn(0x7f5bb80c7d00 0x7f5bb80c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.423+0000 7f5bbfea6700 1 --2- 172.21.15.81:0/4124407136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb80aeea0 0x7f5bb80c2920 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.423+0000 7f5bbfea6700 1 --2- 172.21.15.81:0/4124407136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bb80af270 0x7f5bb80c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.423+0000 7f5bbfea6700 1 -- 172.21.15.81:0/4124407136 >> 172.21.15.81:0/4124407136 conn(0x7f5bb806c660 msgr2=0x7f5bb80cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:37.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.424+0000 7f5bbfea6700 1 -- 172.21.15.81:0/4124407136 shutdown_connections 2023-10-07T08:44:37.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.424+0000 7f5bbfea6700 1 -- 172.21.15.81:0/4124407136 wait complete. 2023-10-07T08:44:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.425+0000 7f5bbfea6700 1 Processor -- start 2023-10-07T08:44:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.425+0000 7f5bbfea6700 1 -- start start 2023-10-07T08:44:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.425+0000 7f5bbfea6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb80aeea0 0x7f5bb814ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.425+0000 7f5bbfea6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb80af270 0x7f5bb80b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.425+0000 7f5bbfea6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bb80c7d00 0x7f5bb8167730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.425+0000 7f5bbfea6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb81580f0 con 0x7f5bb80af270 2023-10-07T08:44:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.425+0000 7f5bbfea6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb81574e0 con 0x7f5bb80aeea0 2023-10-07T08:44:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.425+0000 7f5bbfea6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb81577c0 con 0x7f5bb80c7d00 2023-10-07T08:44:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.425+0000 7f5bbd441700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb80af270 0x7f5bb80b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.425+0000 7f5bbd441700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb80af270 0x7f5bb80b1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35252/0 (socket says 172.21.15.81:35252) 2023-10-07T08:44:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.425+0000 7f5bbd441700 1 -- 172.21.15.81:0/3042018100 learned_addr learned my addr 172.21.15.81:0/3042018100 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.426+0000 7f5bbe443700 1 --2- 172.21.15.81:0/3042018100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bb80c7d00 0x7f5bb8167730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.426+0000 7f5bbdc42700 1 --2- 172.21.15.81:0/3042018100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb80aeea0 0x7f5bb814ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.426+0000 7f5bbd441700 1 -- 172.21.15.81:0/3042018100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bb80c7d00 msgr2=0x7f5bb8167730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.426+0000 7f5bbd441700 1 --2- 172.21.15.81:0/3042018100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bb80c7d00 0x7f5bb8167730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.426+0000 7f5bbd441700 1 -- 172.21.15.81:0/3042018100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb80aeea0 msgr2=0x7f5bb814ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.426+0000 7f5bbd441700 1 --2- 172.21.15.81:0/3042018100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb80aeea0 0x7f5bb814ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.426+0000 7f5bbd441700 1 -- 172.21.15.81:0/3042018100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb400b790 con 0x7f5bb80af270 2023-10-07T08:44:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.426+0000 7f5bbdc42700 1 --2- 172.21.15.81:0/3042018100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb80aeea0 0x7f5bb814ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.426+0000 7f5bbd441700 1 --2- 172.21.15.81:0/3042018100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb80af270 0x7f5bb80b1830 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800d890 tx=0x7f5ba8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.426+0000 7f5badffb700 1 -- 172.21.15.81:0/3042018100 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba800b600 con 0x7f5bb80af270 2023-10-07T08:44:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.426+0000 7f5badffb700 1 -- 172.21.15.81:0/3042018100 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba800b760 con 0x7f5bb80af270 2023-10-07T08:44:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.426+0000 7f5bbfea6700 1 -- 172.21.15.81:0/3042018100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb8157aa0 con 0x7f5bb80af270 2023-10-07T08:44:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.426+0000 7f5badffb700 1 -- 172.21.15.81:0/3042018100 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba800bae0 con 0x7f5bb80af270 2023-10-07T08:44:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.426+0000 7f5bbfea6700 1 -- 172.21.15.81:0/3042018100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb80b1d70 con 0x7f5bb80af270 2023-10-07T08:44:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.427+0000 7f5bbfea6700 1 -- 172.21.15.81:0/3042018100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb80b1f90 con 0x7f5bb80af270 2023-10-07T08:44:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.427+0000 7f5badffb700 1 -- 172.21.15.81:0/3042018100 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ba801e460 con 0x7f5bb80af270 2023-10-07T08:44:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.428+0000 7f5badffb700 1 --2- 172.21.15.81:0/3042018100 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5b9c066f30 0x7f5b9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.428+0000 7f5badffb700 1 -- 172.21.15.81:0/3042018100 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ba8084be0 con 0x7f5bb80af270 2023-10-07T08:44:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.428+0000 7f5bbdc42700 1 --2- 172.21.15.81:0/3042018100 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5b9c066f30 0x7f5b9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.428+0000 7f5badffb700 1 -- 172.21.15.81:0/3042018100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=51}) v3 -- 0x7f5b9c06ea50 con 0x7f5bb80af270 2023-10-07T08:44:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.428+0000 7f5bbdc42700 1 --2- 172.21.15.81:0/3042018100 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5b9c066f30 0x7f5b9c0693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8068a10 tx=0x7f5bb401b000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.432+0000 7f5badffb700 1 -- 172.21.15.81:0/3042018100 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bb80b1f90 con 0x7f5bb80af270 2023-10-07T08:44:37.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.654+0000 7f5bbfea6700 1 -- 172.21.15.81:0/3042018100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5bb80b1f90 con 0x7f5bb80af270 2023-10-07T08:44:37.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.654+0000 7f5badffb700 1 -- 172.21.15.81:0/3042018100 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f5bb80b1f90 con 0x7f5bb80af270 2023-10-07T08:44:37.656 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:37.656 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1491348117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1491348117},{"type":"v1","addr":"172.21.15.89:6834","nonce":1491348117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/748490276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":748490276},{"type":"v1","addr":"172.21.15.89:6835","nonce":748490276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2260626922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2260626922},{"type":"v1","addr":"172.21.15.81:6835","nonce":2260626922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:44:18.798458+0000","modified":"2023-10-07T08:44:22.459128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5340":{"gid":5340,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2750584146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2750584146},{"type":"v1","addr":"172.21.15.81:6837","nonce":2750584146}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-07T08:44:37.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.656+0000 7f5bbfea6700 1 -- 172.21.15.81:0/3042018100 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5b9c066f30 msgr2=0x7f5b9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:37.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.656+0000 7f5bbfea6700 1 --2- 172.21.15.81:0/3042018100 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5b9c066f30 0x7f5b9c0693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8068a10 tx=0x7f5bb401b000 comp rx=0 tx=0).stop 2023-10-07T08:44:37.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.656+0000 7f5bbfea6700 1 -- 172.21.15.81:0/3042018100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb80af270 msgr2=0x7f5bb80b1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:37.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.656+0000 7f5bbfea6700 1 --2- 172.21.15.81:0/3042018100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb80af270 0x7f5bb80b1830 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800d890 tx=0x7f5ba8008040 comp rx=0 tx=0).stop 2023-10-07T08:44:37.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.656+0000 7f5bbfea6700 1 -- 172.21.15.81:0/3042018100 shutdown_connections 2023-10-07T08:44:37.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.656+0000 7f5bbfea6700 1 --2- 172.21.15.81:0/3042018100 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5b9c066f30 0x7f5b9c0693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.656+0000 7f5bbfea6700 1 --2- 172.21.15.81:0/3042018100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bb80c7d00 0x7f5bb8167730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.656+0000 7f5bbfea6700 1 --2- 172.21.15.81:0/3042018100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb80aeea0 0x7f5bb814ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.656+0000 7f5bbfea6700 1 --2- 172.21.15.81:0/3042018100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb80af270 0x7f5bb80b1830 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:37.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.656+0000 7f5bbfea6700 1 -- 172.21.15.81:0/3042018100 >> 172.21.15.81:0/3042018100 conn(0x7f5bb806c660 msgr2=0x7f5bb80c2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:37.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.656+0000 7f5bbfea6700 1 -- 172.21.15.81:0/3042018100 shutdown_connections 2023-10-07T08:44:37.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:37.656+0000 7f5bbfea6700 1 -- 172.21.15.81:0/3042018100 wait complete. 2023-10-07T08:44:37.659 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2023-10-07T08:44:37.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-07T08:44:37.802 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":5340,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":18.370663762,"mdsmap_epoch":24,"osdmap_epoch":50,"osdmap_epoch_barrier":50,"uptime":24.400101412000001} 2023-10-07T08:44:37.803 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 5340, "mdsmap_epoch": 24, "osdmap_epoch": 50, "osdmap_epoch_barrier": 50, "rank_uptime": 18.370663762, "state": "up:active", "uptime": 24.400101412, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:44:37.803 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-07T08:44:37.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:44:37.803 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T08:44:37.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:44:37.819 INFO:teuthology.orchestra.run.smithi081.stderr:dd: failed to open 'small_file_1': Permission denied 2023-10-07T08:44:37.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:44:37.819 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-07T08:44:37.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:44:37.875 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-07T08:44:37.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:44:38.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.085+0000 7fc037fca700 1 Processor -- start 2023-10-07T08:44:38.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.085+0000 7fc037fca700 1 -- start start 2023-10-07T08:44:38.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.086+0000 7fc037fca700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc03006d830 0x7fc0300cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:38.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.086+0000 7fc037fca700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0300d07c0 con 0x7fc030157ca0 2023-10-07T08:44:38.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.086+0000 7fc037fca700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0300cfbb0 con 0x7fc0301578d0 2023-10-07T08:44:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.086+0000 7fc037fca700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0300cfe90 con 0x7fc03006d830 2023-10-07T08:44:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.086+0000 7fc035565700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc030157ca0 0x7fc03006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35410/0 (socket says 172.21.15.81:35410) 2023-10-07T08:44:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.086+0000 7fc035565700 1 -- 172.21.15.81:0/434188737 learned_addr learned my addr 172.21.15.81:0/434188737 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.086+0000 7fc036567700 1 --2- 172.21.15.81:0/434188737 >> v2:172.21.15.89:3300/0 conn(0x7fc03006d830 0x7fc0300cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.086+0000 7fc034d64700 1 -- 172.21.15.81:0/434188737 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073569406 0 0) 0x7fc0300d07c0 con 0x7fc030157ca0 2023-10-07T08:44:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc034d64700 1 -- 172.21.15.81:0/434188737 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc01c003570 con 0x7fc030157ca0 2023-10-07T08:44:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc034d64700 1 -- 172.21.15.81:0/434188737 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3727941847 0 0) 0x7fc01c003570 con 0x7fc030157ca0 2023-10-07T08:44:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc034d64700 1 -- 172.21.15.81:0/434188737 >> v2:172.21.15.89:3300/0 conn(0x7fc03006d830 msgr2=0x7fc0300cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc034d64700 1 --2- 172.21.15.81:0/434188737 >> v2:172.21.15.89:3300/0 conn(0x7fc03006d830 0x7fc0300cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc034d64700 1 -- 172.21.15.81:0/434188737 >> v1:172.21.15.89:6789/0 conn(0x7fc0301578d0 legacy=0x7fc03015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc034d64700 1 -- 172.21.15.81:0/434188737 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0300d0170 con 0x7fc030157ca0 2023-10-07T08:44:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc034d64700 1 -- 172.21.15.81:0/434188737 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fc020001470 con 0x7fc030157ca0 2023-10-07T08:44:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc034d64700 1 -- 172.21.15.81:0/434188737 >> v1:172.21.15.81:6789/0 conn(0x7fc030157ca0 legacy=0x7fc03006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc034d64700 1 --2- 172.21.15.81:0/434188737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc01c003a60 0x7fc01c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc034d64700 1 --2- 172.21.15.81:0/434188737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc01c004810 0x7fc01c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc034d64700 1 --2- 172.21.15.81:0/434188737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01c0051c0 0x7fc01c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc034d64700 1 -- 172.21.15.81:0/434188737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300cfe90 con 0x7fc01c0051c0 2023-10-07T08:44:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc034d64700 1 -- 172.21.15.81:0/434188737 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c00c050 con 0x7fc01c003a60 2023-10-07T08:44:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc034d64700 1 -- 172.21.15.81:0/434188737 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c00c210 con 0x7fc01c004810 2023-10-07T08:44:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc036567700 1 --2- 172.21.15.81:0/434188737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01c0051c0 0x7fc01c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc035d66700 1 --2- 172.21.15.81:0/434188737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc01c003a60 0x7fc01c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc035565700 1 --2- 172.21.15.81:0/434188737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc01c004810 0x7fc01c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc036567700 1 -- 172.21.15.81:0/434188737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc01c004810 msgr2=0x7fc01c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc036567700 1 --2- 172.21.15.81:0/434188737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc01c004810 0x7fc01c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc036567700 1 -- 172.21.15.81:0/434188737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc01c003a60 msgr2=0x7fc01c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc036567700 1 --2- 172.21.15.81:0/434188737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc01c003a60 0x7fc01c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc036567700 1 -- 172.21.15.81:0/434188737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c003570 con 0x7fc01c0051c0 2023-10-07T08:44:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc035d66700 1 --2- 172.21.15.81:0/434188737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc01c003a60 0x7fc01c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:44:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc036567700 1 -- 172.21.15.81:0/434188737 reap_dead start 2023-10-07T08:44:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.087+0000 7fc036567700 1 --2- 172.21.15.81:0/434188737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01c0051c0 0x7fc01c00ba60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc028009c00 tx=0x7fc0280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7431e7f92084ed server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.088+0000 7fc034d64700 1 -- 172.21.15.81:0/434188737 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02800e710 con 0x7fc01c0051c0 2023-10-07T08:44:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.088+0000 7fc034d64700 1 -- 172.21.15.81:0/434188737 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02800e890 con 0x7fc01c0051c0 2023-10-07T08:44:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.088+0000 7fc034d64700 1 -- 172.21.15.81:0/434188737 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02800ec50 con 0x7fc01c0051c0 2023-10-07T08:44:38.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.088+0000 7fc037fca700 1 -- 172.21.15.81:0/434188737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01c0051c0 msgr2=0x7fc01c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.088+0000 7fc037fca700 1 --2- 172.21.15.81:0/434188737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01c0051c0 0x7fc01c00ba60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc028009c00 tx=0x7fc0280091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.088+0000 7fc037fca700 1 -- 172.21.15.81:0/434188737 shutdown_connections 2023-10-07T08:44:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.088+0000 7fc037fca700 1 --2- 172.21.15.81:0/434188737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01c0051c0 0x7fc01c00ba60 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.088+0000 7fc037fca700 1 -- 172.21.15.81:0/434188737 >> 172.21.15.81:0/434188737 conn(0x7fc03006bb90 msgr2=0x7fc03006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.088+0000 7fc037fca700 1 -- 172.21.15.81:0/434188737 shutdown_connections 2023-10-07T08:44:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.088+0000 7fc037fca700 1 -- 172.21.15.81:0/434188737 wait complete. 2023-10-07T08:44:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.089+0000 7fc037fca700 1 Processor -- start 2023-10-07T08:44:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.089+0000 7fc037fca700 1 -- start start 2023-10-07T08:44:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.090+0000 7fc037fca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01c0051c0 0x7fc0300ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.090+0000 7fc037fca700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0300b5010 0x7fc030153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.090+0000 7fc037fca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc03015c460 0x7fc03015c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.090+0000 7fc037fca700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03015ce40 con 0x7fc01c0051c0 2023-10-07T08:44:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.090+0000 7fc037fca700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300b57d0 con 0x7fc0300b5010 2023-10-07T08:44:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.090+0000 7fc037fca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300b5ab0 con 0x7fc03015c460 2023-10-07T08:44:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.090+0000 7fc035d66700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01c0051c0 0x7fc0300ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.090+0000 7fc035d66700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01c0051c0 0x7fc0300ab380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35278/0 (socket says 172.21.15.81:35278) 2023-10-07T08:44:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.090+0000 7fc035d66700 1 -- 172.21.15.81:0/2712556853 learned_addr learned my addr 172.21.15.81:0/2712556853 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.090+0000 7fc035565700 1 --2- 172.21.15.81:0/2712556853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0300b5010 0x7fc030153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.090+0000 7fc036567700 1 --2- 172.21.15.81:0/2712556853 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc03015c460 0x7fc03015c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.090+0000 7fc035d66700 1 -- 172.21.15.81:0/2712556853 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc03015c460 msgr2=0x7fc03015c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.090+0000 7fc035d66700 1 --2- 172.21.15.81:0/2712556853 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc03015c460 0x7fc03015c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.090+0000 7fc035d66700 1 -- 172.21.15.81:0/2712556853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0300b5010 msgr2=0x7fc030153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.090+0000 7fc035d66700 1 --2- 172.21.15.81:0/2712556853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0300b5010 0x7fc030153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.090+0000 7fc035d66700 1 -- 172.21.15.81:0/2712556853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0300b5d90 con 0x7fc01c0051c0 2023-10-07T08:44:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.091+0000 7fc036567700 1 --2- 172.21.15.81:0/2712556853 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc03015c460 0x7fc03015c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.091+0000 7fc035d66700 1 --2- 172.21.15.81:0/2712556853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01c0051c0 0x7fc0300ab380 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00fd60 tx=0x7fc02c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.091+0000 7fc025ffb700 1 -- 172.21.15.81:0/2712556853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c00dbe0 con 0x7fc01c0051c0 2023-10-07T08:44:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.091+0000 7fc025ffb700 1 -- 172.21.15.81:0/2712556853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02c00dd40 con 0x7fc01c0051c0 2023-10-07T08:44:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.091+0000 7fc037fca700 1 -- 172.21.15.81:0/2712556853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0300b6070 con 0x7fc01c0051c0 2023-10-07T08:44:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.091+0000 7fc025ffb700 1 -- 172.21.15.81:0/2712556853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c013620 con 0x7fc01c0051c0 2023-10-07T08:44:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.091+0000 7fc037fca700 1 -- 172.21.15.81:0/2712556853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0301539b0 con 0x7fc01c0051c0 2023-10-07T08:44:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.092+0000 7fc037fca700 1 -- 172.21.15.81:0/2712556853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc030067ac0 con 0x7fc01c0051c0 2023-10-07T08:44:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.092+0000 7fc025ffb700 1 -- 172.21.15.81:0/2712556853 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc02c003030 con 0x7fc01c0051c0 2023-10-07T08:44:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.092+0000 7fc025ffb700 1 --2- 172.21.15.81:0/2712556853 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc014066f30 0x7fc0140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.093+0000 7fc025ffb700 1 -- 172.21.15.81:0/2712556853 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc02c084d30 con 0x7fc01c0051c0 2023-10-07T08:44:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.093+0000 7fc035565700 1 --2- 172.21.15.81:0/2712556853 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc014066f30 0x7fc0140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.093+0000 7fc025ffb700 1 -- 172.21.15.81:0/2712556853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=51}) v3 -- 0x7fc01406ea50 con 0x7fc01c0051c0 2023-10-07T08:44:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.093+0000 7fc035565700 1 --2- 172.21.15.81:0/2712556853 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc014066f30 0x7fc0140693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc020001050 tx=0x7fc020001e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.097+0000 7fc025ffb700 1 -- 172.21.15.81:0/2712556853 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc02c051fa0 con 0x7fc01c0051c0 2023-10-07T08:44:38.233 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:44:38.231+0000 7f43c6f32700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-07T08:44:38.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.280+0000 7fc037fca700 1 -- 172.21.15.81:0/2712556853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc0300d0450 con 0x7fc01c0051c0 2023-10-07T08:44:38.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.281+0000 7fc025ffb700 1 -- 172.21.15.81:0/2712556853 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) v1 ==== 81+0+32355 (secure 0 0 0) 0x7fc02c0555c0 con 0x7fc01c0051c0 2023-10-07T08:44:38.283 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:38.283 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:44:38.283 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 50, 2023-10-07T08:44:38.283 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:44:38.283 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:44:38.284 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:44:36.239610+0000", 2023-10-07T08:44:38.284 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:44:38.284 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:44:38.284 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:44:38.284 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:44:38.284 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:44:38.284 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:44:38.284 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:44:38.284 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:44:38.285 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:44:38.285 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:38.285 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:44:38.285 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:44:38.285 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:44:38.285 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:44:38.285 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:44:38.285 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 7, 2023-10-07T08:44:38.285 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:44:38.285 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:44:38.286 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:44:38.286 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:44:38.286 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:44:38.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.286 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:44:38.286 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:44:38.286 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:44:38.286 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:44:38.286 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:44:38.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:38.287 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:38.287 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:38.287 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:38.287 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:38.287 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:38.287 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:38.287 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:38.287 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:38.287 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:38.287 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:44:38.287 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:44:38.288 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:44:38.288 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:44:38.288 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:44:38.288 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:38.288 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:38.288 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:38.288 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:38.288 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:38.288 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:38.288 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:38.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.288 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "48", 2023-10-07T08:44:38.289 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:38.289 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:38.289 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:38.289 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:38.289 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:38.289 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:38.289 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:38.289 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:38.289 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:38.289 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:38.289 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:38.290 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:38.290 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:38.290 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:38.290 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:38.290 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:38.290 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:38.290 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:38.290 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:38.290 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:38.290 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:38.290 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:38.291 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:38.291 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:38.291 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:38.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:38.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.291 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:38.291 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:38.291 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:38.291 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:38.291 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:38.291 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:38.291 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:38.292 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:38.292 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:38.292 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:38.292 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:38.292 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:38.292 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:44:38.292 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:44:38.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.292 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:38.292 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:44:38.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.293 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 6, 2023-10-07T08:44:38.293 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:44:38.293 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:44:17.114223+0000", 2023-10-07T08:44:38.293 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:44:38.293 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:44:38.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:38.293 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:38.293 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:38.293 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:44:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:44:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:44:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:44:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:44:38.294 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:38.295 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:38.295 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:38.295 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:38.295 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:38.295 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:38.295 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:38.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.295 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "48", 2023-10-07T08:44:38.295 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:38.295 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:38.296 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:38.296 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:38.296 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:38.296 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:38.296 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:38.296 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:38.296 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:38.296 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:38.296 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:38.296 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:38.297 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:38.297 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:38.297 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:38.297 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:38.297 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:38.297 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:38.297 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:38.297 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:38.297 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:38.297 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:38.298 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:38.298 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:38.298 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:38.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:38.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.298 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:38.298 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:38.298 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:38.299 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:38.299 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:38.299 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:38.299 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:38.299 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:38.299 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:38.299 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:38.300 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:38.300 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:38.300 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:44:38.300 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:44:38.300 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:44:38.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.300 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:38.300 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:44:38.300 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:44:38.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.301 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 7, 2023-10-07T08:44:38.301 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:44:38.301 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:44:17.763615+0000", 2023-10-07T08:44:38.301 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:44:38.301 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:44:38.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:38.301 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:38.302 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:38.302 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:38.302 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:38.302 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:38.302 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:38.302 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:38.302 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:38.302 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:38.302 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:44:38.302 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:44:38.302 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:44:38.303 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:44:38.303 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:44:38.303 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:38.303 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:38.303 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:38.303 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:38.303 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:38.303 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:38.303 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:38.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.303 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "48", 2023-10-07T08:44:38.303 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:38.304 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:38.304 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:38.304 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:38.304 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:38.304 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:38.304 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:38.304 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:38.304 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:38.304 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:38.304 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:38.304 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:38.304 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:38.305 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:38.305 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:38.305 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:38.305 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:38.305 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:38.305 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:38.305 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:38.305 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:38.305 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:38.305 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:38.305 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:38.306 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:38.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:38.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.306 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:38.306 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:38.306 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:38.306 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:38.306 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:38.306 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:38.306 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:38.307 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:38.307 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:38.307 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:38.307 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:38.307 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:38.307 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:44:38.307 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:44:38.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.307 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:38.307 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:44:38.307 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:44:38.307 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.308 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:38.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:44:38.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:44:38.308 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:38.308 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:38.308 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:38.308 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:38.308 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:38.309 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:38.309 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:38.309 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:38.309 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:38.309 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:38.309 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:38.309 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:38.309 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.309 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.309 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:44:38.309 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:38.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.310 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:44:38.310 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:38.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.310 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.310 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:38.310 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:44:38.311 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:38.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:44:38.311 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:38.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.311 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.311 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:38.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:44:38.312 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:38.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:44:38.312 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:38.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.313 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.313 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:38.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:44:38.313 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:38.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:44:38.314 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:38.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.314 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.314 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:44:38.314 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:44:38.314 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:44:38.314 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:44:38.314 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:38.314 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:38.315 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:44:38.315 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:38.315 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.315 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:44:38.315 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:38.315 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:38.315 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:38.315 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:38.315 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:38.316 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:38.316 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:38.316 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:38.316 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:38.316 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:38.316 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:38.316 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:38.316 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.316 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.317 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:44:38.317 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:38.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.317 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.317 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:44:38.317 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:38.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.317 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.317 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:38.317 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.318 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.318 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:44:38.318 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:38.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.318 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.318 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:44:38.318 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:38.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.319 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.319 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:38.319 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.319 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:44:38.319 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:38.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.319 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:44:38.320 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:38.320 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.320 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.320 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:38.320 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.320 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.320 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:44:38.320 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:38.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.321 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.321 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:44:38.321 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:38.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.321 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.321 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:44:38.321 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:44:38.321 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:44:38.321 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:44:38.322 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:38.322 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:38.322 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:38.322 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.322 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:44:38.322 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:38.322 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:38.322 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:38.322 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:38.323 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:38.323 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:38.323 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:38.323 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:38.323 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:38.323 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:38.323 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:38.323 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:38.323 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.324 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.324 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:44:38.324 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:38.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.324 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.324 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:44:38.324 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:38.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.325 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.325 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:38.325 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.325 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:44:38.325 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:38.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.326 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.326 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:44:38.326 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:38.326 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.326 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.326 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:38.326 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.327 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:44:38.327 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:38.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.327 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:44:38.327 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:38.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.327 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.328 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:38.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:44:38.328 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:38.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:44:38.329 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:38.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.329 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.329 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:44:38.329 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:44:38.329 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:44:38.329 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:44:38.329 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:38.329 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:38.329 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:44:38.329 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:38.330 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.330 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:44:38.330 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:38.330 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:38.330 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:38.330 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:38.330 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:38.330 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:38.330 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:38.331 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:38.331 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:38.331 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:38.331 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:38.331 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:38.331 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.331 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.331 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:44:38.331 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:38.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.332 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.332 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:44:38.332 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:38.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.332 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.332 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:38.332 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.332 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.332 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:44:38.333 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:38.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.333 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.333 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:44:38.333 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:38.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.333 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.333 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:38.333 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:44:38.334 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:38.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:44:38.334 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:38.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.334 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.335 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:38.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:44:38.335 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:38.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:44:38.335 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:38.335 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.336 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.336 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:44:38.336 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:44:38.336 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:44:38.336 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:44:38.336 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:38.336 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull", 2023-10-07T08:44:38.336 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:38.336 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:38.336 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.337 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:44:38.337 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:38.337 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:38.337 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:38.337 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:38.337 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:38.337 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:38.337 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:38.337 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:38.337 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:38.337 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:38.338 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:38.338 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:38.338 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.338 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.338 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:44:38.338 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:38.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.338 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.338 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:44:38.339 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:38.339 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.339 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.339 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:38.339 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.339 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:44:38.339 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:38.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.340 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.340 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:44:38.340 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:38.340 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.340 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.340 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:38.340 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.340 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.340 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:44:38.341 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:38.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.341 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.341 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:44:38.341 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:38.341 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.341 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.341 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:38.341 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.342 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.342 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:44:38.342 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:38.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.342 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.342 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:44:38.342 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:38.342 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.342 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.343 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:44:38.343 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:44:38.343 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:44:38.343 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:44:38.343 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:38.343 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:38.343 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:38.343 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.344 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:44:38.344 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:38.344 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:38.344 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:38.344 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:38.344 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:38.344 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:38.344 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:38.344 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:38.345 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:38.345 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:38.345 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:38.345 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:38.345 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.345 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.345 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:44:38.345 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:38.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.346 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.346 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:44:38.346 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:38.346 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.346 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.346 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:38.346 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.346 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.346 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:44:38.347 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:38.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.347 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:44:38.347 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:38.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.347 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.347 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:38.347 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.348 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.348 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:44:38.348 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:38.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.348 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.348 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:44:38.348 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:38.348 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.348 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.349 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:38.349 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.349 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.349 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:44:38.349 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:38.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.349 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.349 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:44:38.349 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:38.349 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.350 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.350 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:44:38.350 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:44:38.350 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:44:38.350 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:44:38.350 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:38.350 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:38.350 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:38.351 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.351 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:44:38.352 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:38.352 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:38.352 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:38.352 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:38.352 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:38.352 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:38.352 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:38.352 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:38.352 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:38.352 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:38.352 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:38.353 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:38.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:44:38.353 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:38.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:44:38.354 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:38.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.354 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.355 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:38.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:44:38.356 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:38.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.356 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:44:38.356 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:38.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.356 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.356 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:38.356 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.357 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:44:38.357 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:38.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.357 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:44:38.357 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:38.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:44:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:44:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:44:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:44:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:44:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:44:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:44:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:44:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:44:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:44:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:44:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:44:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:44:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:44:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:44:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:44:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:44:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:44:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:44:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:44:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:44:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:44:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:44:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:44:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:44:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:44:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:44:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:44:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:44:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:44:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:44:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:44:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:44:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:44:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:44:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:44:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:44:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:44:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:44:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:44:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:44:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:44:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:44:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:44:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:44:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:44:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:44:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:44:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:44:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:44:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:44:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:44:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:44:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:44:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:44:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:44:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:44:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:44:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:44:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:44:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:44:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:44:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:38.377 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:44:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.284+0000 7fc037fca700 1 -- 172.21.15.81:0/2712556853 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc014066f30 msgr2=0x7fc0140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.284+0000 7fc037fca700 1 --2- 172.21.15.81:0/2712556853 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc014066f30 0x7fc0140693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc020001050 tx=0x7fc020001e70 comp rx=0 tx=0).stop 2023-10-07T08:44:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.284+0000 7fc037fca700 1 -- 172.21.15.81:0/2712556853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01c0051c0 msgr2=0x7fc0300ab380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.284+0000 7fc037fca700 1 --2- 172.21.15.81:0/2712556853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01c0051c0 0x7fc0300ab380 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00fd60 tx=0x7fc02c009040 comp rx=0 tx=0).stop 2023-10-07T08:44:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.284+0000 7fc037fca700 1 -- 172.21.15.81:0/2712556853 shutdown_connections 2023-10-07T08:44:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.284+0000 7fc037fca700 1 --2- 172.21.15.81:0/2712556853 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc014066f30 0x7fc0140693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.284+0000 7fc037fca700 1 --2- 172.21.15.81:0/2712556853 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc03015c460 0x7fc03015c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.284+0000 7fc037fca700 1 --2- 172.21.15.81:0/2712556853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01c0051c0 0x7fc0300ab380 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.284+0000 7fc037fca700 1 --2- 172.21.15.81:0/2712556853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0300b5010 0x7fc030153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.284+0000 7fc037fca700 1 -- 172.21.15.81:0/2712556853 >> 172.21.15.81:0/2712556853 conn(0x7fc03006bb90 msgr2=0x7fc030155720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.284+0000 7fc037fca700 1 -- 172.21.15.81:0/2712556853 shutdown_connections 2023-10-07T08:44:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:38.284+0000 7fc037fca700 1 -- 172.21.15.81:0/2712556853 wait complete. 2023-10-07T08:44:38.380 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-07T08:44:43.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:44:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.520+0000 7ffb0ca8b700 1 Processor -- start 2023-10-07T08:44:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.520+0000 7ffb0ca8b700 1 -- start start 2023-10-07T08:44:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.521+0000 7ffb0ca8b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb08159f10 0x7ffb08068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.521+0000 7ffb0ca8b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb080cee10 con 0x7ffb08159b40 2023-10-07T08:44:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.521+0000 7ffb0ca8b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb080cd040 con 0x7ffb08068cc0 2023-10-07T08:44:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.521+0000 7ffb0ca8b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb08069140 con 0x7ffb08159f10 2023-10-07T08:44:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.521+0000 7ffb077fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ffb08159b40 0x7ffb080cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49614/0 (socket says 172.21.15.81:49614) 2023-10-07T08:44:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.521+0000 7ffb077fe700 1 -- 172.21.15.81:0/3772806359 learned_addr learned my addr 172.21.15.81:0/3772806359 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.521+0000 7ffb06ffd700 1 --2- 172.21.15.81:0/3772806359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb08159f10 0x7ffb08068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.522+0000 7ffb067fc700 1 -- 172.21.15.81:0/3772806359 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895341762 0 0) 0x7ffb080cee10 con 0x7ffb08159b40 2023-10-07T08:44:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.522+0000 7ffb067fc700 1 -- 172.21.15.81:0/3772806359 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaf0003570 con 0x7ffb08159b40 2023-10-07T08:44:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.522+0000 7ffb067fc700 1 -- 172.21.15.81:0/3772806359 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080155222 0 0) 0x7ffb080cd040 con 0x7ffb08068cc0 2023-10-07T08:44:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.522+0000 7ffb067fc700 1 -- 172.21.15.81:0/3772806359 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb080cee10 con 0x7ffb08068cc0 2023-10-07T08:44:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.522+0000 7ffb067fc700 1 -- 172.21.15.81:0/3772806359 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2671482713 0 0) 0x7ffaf0003570 con 0x7ffb08159b40 2023-10-07T08:44:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.522+0000 7ffb06ffd700 1 -- 172.21.15.81:0/3772806359 >> v1:172.21.15.89:6789/0 conn(0x7ffb08068cc0 legacy=0x7ffb080cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.522+0000 7ffb06ffd700 1 -- 172.21.15.81:0/3772806359 >> v1:172.21.15.81:6789/0 conn(0x7ffb08159b40 legacy=0x7ffb080cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.522+0000 7ffb06ffd700 1 -- 172.21.15.81:0/3772806359 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb080cd320 con 0x7ffb08159f10 2023-10-07T08:44:43.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.522+0000 7ffb06ffd700 1 --2- 172.21.15.81:0/3772806359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb08159f10 0x7ffb08068780 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009910 tx=0x7ffafc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29105849bbe7cf2a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:43.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.522+0000 7ffb067fc700 1 -- 172.21.15.81:0/3772806359 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8001470 con 0x7ffb08159f10 2023-10-07T08:44:43.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.522+0000 7ffb067fc700 1 -- 172.21.15.81:0/3772806359 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc011420 con 0x7ffb08159f10 2023-10-07T08:44:43.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.522+0000 7ffb067fc700 1 -- 172.21.15.81:0/3772806359 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc0117c0 con 0x7ffb08159f10 2023-10-07T08:44:43.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.523+0000 7ffb0ca8b700 1 -- 172.21.15.81:0/3772806359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb08159f10 msgr2=0x7ffb08068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:43.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.523+0000 7ffb0ca8b700 1 --2- 172.21.15.81:0/3772806359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb08159f10 0x7ffb08068780 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009910 tx=0x7ffafc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:43.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.523+0000 7ffb0ca8b700 1 -- 172.21.15.81:0/3772806359 shutdown_connections 2023-10-07T08:44:43.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.523+0000 7ffb0ca8b700 1 --2- 172.21.15.81:0/3772806359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb08159f10 0x7ffb08068780 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:43.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.523+0000 7ffb0ca8b700 1 -- 172.21.15.81:0/3772806359 >> 172.21.15.81:0/3772806359 conn(0x7ffb080cd660 msgr2=0x7ffb080cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:43.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.523+0000 7ffb0ca8b700 1 -- 172.21.15.81:0/3772806359 shutdown_connections 2023-10-07T08:44:43.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.523+0000 7ffb0ca8b700 1 -- 172.21.15.81:0/3772806359 wait complete. 2023-10-07T08:44:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.524+0000 7ffb0ca8b700 1 Processor -- start 2023-10-07T08:44:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.524+0000 7ffb0ca8b700 1 -- start start 2023-10-07T08:44:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb0ca8b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb08068cc0 0x7ffb08167960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb0ca8b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb08159b40 0x7ffb0816ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb0ca8b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb08159f10 0x7ffb080b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb0ca8b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb08159060 con 0x7ffb08159b40 2023-10-07T08:44:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb0ca8b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0815e510 con 0x7ffb08159f10 2023-10-07T08:44:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb0ca8b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0815e9a0 con 0x7ffb08068cc0 2023-10-07T08:44:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb06ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb08159b40 0x7ffb0816ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb06ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb08159b40 0x7ffb0816ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59242/0 (socket says 172.21.15.81:59242) 2023-10-07T08:44:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb06ffd700 1 -- 172.21.15.81:0/295462334 learned_addr learned my addr 172.21.15.81:0/295462334 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb077fe700 1 --2- 172.21.15.81:0/295462334 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb08068cc0 0x7ffb08167960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb07fff700 1 --2- 172.21.15.81:0/295462334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb08159f10 0x7ffb080b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb06ffd700 1 -- 172.21.15.81:0/295462334 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb08068cc0 msgr2=0x7ffb08167960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb06ffd700 1 --2- 172.21.15.81:0/295462334 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb08068cc0 0x7ffb08167960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb06ffd700 1 -- 172.21.15.81:0/295462334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb08159f10 msgr2=0x7ffb080b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb06ffd700 1 --2- 172.21.15.81:0/295462334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb08159f10 0x7ffb080b4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb06ffd700 1 -- 172.21.15.81:0/295462334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc009420 con 0x7ffb08159b40 2023-10-07T08:44:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb07fff700 1 --2- 172.21.15.81:0/295462334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb08159f10 0x7ffb080b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb06ffd700 1 --2- 172.21.15.81:0/295462334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb08159b40 0x7ffb0816ac60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009860 tx=0x7ffafc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffaef7fe700 1 -- 172.21.15.81:0/295462334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc01cbe0 con 0x7ffb08159b40 2023-10-07T08:44:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffaef7fe700 1 -- 172.21.15.81:0/295462334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc01cd40 con 0x7ffb08159b40 2023-10-07T08:44:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb0ca8b700 1 -- 172.21.15.81:0/295462334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0815d900 con 0x7ffb08159b40 2023-10-07T08:44:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffaef7fe700 1 -- 172.21.15.81:0/295462334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc01a6a0 con 0x7ffb08159b40 2023-10-07T08:44:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.525+0000 7ffb0ca8b700 1 -- 172.21.15.81:0/295462334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0815dec0 con 0x7ffb08159b40 2023-10-07T08:44:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.526+0000 7ffb0ca8b700 1 -- 172.21.15.81:0/295462334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0815e680 con 0x7ffb08159b40 2023-10-07T08:44:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.527+0000 7ffaef7fe700 1 -- 172.21.15.81:0/295462334 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffafc01aad0 con 0x7ffb08159b40 2023-10-07T08:44:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.527+0000 7ffaef7fe700 1 --2- 172.21.15.81:0/295462334 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffaf4066f30 0x7ffaf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:43.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.527+0000 7ffaef7fe700 1 -- 172.21.15.81:0/295462334 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffafc086250 con 0x7ffb08159b40 2023-10-07T08:44:43.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.527+0000 7ffb077fe700 1 --2- 172.21.15.81:0/295462334 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffaf4066f30 0x7ffaf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:43.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.527+0000 7ffaef7fe700 1 -- 172.21.15.81:0/295462334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=51}) v3 -- 0x7ffaf406ea50 con 0x7ffb08159b40 2023-10-07T08:44:43.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.528+0000 7ffb077fe700 1 --2- 172.21.15.81:0/295462334 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffaf4066f30 0x7ffaf40693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8001ed0 tx=0x7ffaf8000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:43.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.531+0000 7ffaef7fe700 1 -- 172.21.15.81:0/295462334 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffafc0534c0 con 0x7ffb08159b40 2023-10-07T08:44:43.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.714+0000 7ffb0ca8b700 1 -- 172.21.15.81:0/295462334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ffb080ce7c0 con 0x7ffb08159b40 2023-10-07T08:44:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.715+0000 7ffaef7fe700 1 -- 172.21.15.81:0/295462334 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) v1 ==== 81+0+32355 (secure 0 0 0) 0x7ffafc056ae0 con 0x7ffb08159b40 2023-10-07T08:44:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:43.717 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:44:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 50, 2023-10-07T08:44:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:44:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:44:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:44:36.239610+0000", 2023-10-07T08:44:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:44:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:44:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:44:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:44:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:44:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:44:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:44:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:44:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:44:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:44:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:44:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:44:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:44:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:44:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 7, 2023-10-07T08:44:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:44:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:44:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:44:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:44:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:44:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:44:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:44:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:44:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:44:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:44:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:44:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:44:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:44:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:44:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:44:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "48", 2023-10-07T08:44:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:44:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:44:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:44:43.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 6, 2023-10-07T08:44:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:44:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:44:17.114223+0000", 2023-10-07T08:44:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:44:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:44:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:43.727 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:44:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:44:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:44:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:44:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:44:43.728 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "48", 2023-10-07T08:44:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:43.729 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:43.730 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:43.731 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:43.732 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:44:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:44:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:44:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:44:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:44:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.733 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 7, 2023-10-07T08:44:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:44:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:44:17.763615+0000", 2023-10-07T08:44:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:44:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:44:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:43.734 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:44:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:44:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:44:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:44:43.735 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:44:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "48", 2023-10-07T08:44:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:43.736 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:43.737 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:43.738 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:43.739 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:44:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:44:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.740 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:44:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:44:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:44:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:44:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:43.742 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:44:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.743 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:44:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:44:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:43.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:44:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:44:43.745 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:44:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:44:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:44:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.747 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:44:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:44:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:44:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:44:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:44:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.748 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:44:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:43.749 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:44:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:44:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:44:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:44:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:44:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:44:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:44:43.753 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:44:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:44:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:44:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:44:43.754 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:44:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:44:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:43.755 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:44:43.756 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:44:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:43.757 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:44:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:44:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:43.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:44:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:44:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.760 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:44:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:44:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:43.761 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:44:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:44:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:44:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:44:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:44:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:43.762 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:44:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:43.763 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:44:43.764 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:44:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:44:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:44:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:43.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:44:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:44:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:44:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:44:43.768 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:44:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:44:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:44:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:44:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull", 2023-10-07T08:44:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:43.769 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:44:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:43.770 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:44:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:43.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:44:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.772 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:44:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:44:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.773 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:44:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:44:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:44:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:44:43.775 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:44:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:44:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:44:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:44:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:44:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:44:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:44:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:44:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:44:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:44:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:44:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:44:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:44:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:44:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:44:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:44:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:44:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:44:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:44:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:44:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:44:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:44:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:44:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:44:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:44:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:44:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:44:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:44:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:44:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:44:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:44:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:44:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:44:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:44:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:44:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:44:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:44:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:44:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:44:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:44:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:44:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:44:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:44:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:44:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:44:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:44:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:44:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:44:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:44:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:44:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:44:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:44:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:44:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:44:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:44:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:44:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:44:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:44:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:44:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:44:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:44:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:44:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:44:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:44:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:44:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:44:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:44:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:44:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:44:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:44:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:44:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:44:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:44:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:44:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:44:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:44:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:44:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:44:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:44:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:44:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:44:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:44:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:44:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:44:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:44:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:44:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:43.809 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:44:43.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.717+0000 7ffb0ca8b700 1 -- 172.21.15.81:0/295462334 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffaf4066f30 msgr2=0x7ffaf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:43.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.717+0000 7ffb0ca8b700 1 --2- 172.21.15.81:0/295462334 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffaf4066f30 0x7ffaf40693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8001ed0 tx=0x7ffaf8000bc0 comp rx=0 tx=0).stop 2023-10-07T08:44:43.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.717+0000 7ffb0ca8b700 1 -- 172.21.15.81:0/295462334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb08159b40 msgr2=0x7ffb0816ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:43.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.717+0000 7ffb0ca8b700 1 --2- 172.21.15.81:0/295462334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb08159b40 0x7ffb0816ac60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009860 tx=0x7ffafc016000 comp rx=0 tx=0).stop 2023-10-07T08:44:43.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.717+0000 7ffb0ca8b700 1 -- 172.21.15.81:0/295462334 shutdown_connections 2023-10-07T08:44:43.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.717+0000 7ffb0ca8b700 1 --2- 172.21.15.81:0/295462334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb08159f10 0x7ffb080b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:43.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.717+0000 7ffb0ca8b700 1 --2- 172.21.15.81:0/295462334 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffaf4066f30 0x7ffaf40693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:43.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.717+0000 7ffb0ca8b700 1 --2- 172.21.15.81:0/295462334 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb08068cc0 0x7ffb08167960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:43.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.717+0000 7ffb0ca8b700 1 --2- 172.21.15.81:0/295462334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb08159b40 0x7ffb0816ac60 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:43.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.717+0000 7ffb0ca8b700 1 -- 172.21.15.81:0/295462334 >> 172.21.15.81:0/295462334 conn(0x7ffb080cd660 msgr2=0x7ffb080c6430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:43.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.718+0000 7ffb0ca8b700 1 -- 172.21.15.81:0/295462334 shutdown_connections 2023-10-07T08:44:43.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:43.718+0000 7ffb0ca8b700 1 -- 172.21.15.81:0/295462334 wait complete. 2023-10-07T08:44:43.812 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-07T08:44:46.268 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:44:46.267+0000 7f43c6f32700 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2023-10-07T08:44:48.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:44:48.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.939+0000 7f6efd9bb700 1 Processor -- start 2023-10-07T08:44:48.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.939+0000 7f6efd9bb700 1 -- start start 2023-10-07T08:44:48.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6efd9bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ef81578d0 0x7f6ef80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:48.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6efd9bb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ef8157ca0 0x7f6ef815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:48.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6efd9bb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6ef806d120 0x7f6ef806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:48.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6efd9bb700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef806dac0 con 0x7f6ef8157ca0 2023-10-07T08:44:48.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6efd9bb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef80d07c0 con 0x7f6ef806d120 2023-10-07T08:44:48.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6efd9bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef80cfbb0 con 0x7f6ef81578d0 2023-10-07T08:44:48.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6eeffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ef8157ca0 0x7f6ef815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:48.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6eeffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ef8157ca0 0x7f6ef815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59250/0 (socket says 172.21.15.81:59250) 2023-10-07T08:44:48.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6eeffff700 1 -- 172.21.15.81:0/933225379 learned_addr learned my addr 172.21.15.81:0/933225379 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:48.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6ef77fe700 1 --2- 172.21.15.81:0/933225379 >> v2:172.21.15.89:3300/0 conn(0x7f6ef806d120 0x7f6ef806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:48.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6ef6ffd700 1 --2- 172.21.15.81:0/933225379 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ef81578d0 0x7f6ef80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6eeffff700 1 -- 172.21.15.81:0/933225379 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ef81578d0 msgr2=0x7f6ef80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6eeffff700 1 --2- 172.21.15.81:0/933225379 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ef81578d0 0x7f6ef80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6eeffff700 1 -- 172.21.15.81:0/933225379 >> v2:172.21.15.89:3300/0 conn(0x7f6ef806d120 msgr2=0x7f6ef806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6eeffff700 1 --2- 172.21.15.81:0/933225379 >> v2:172.21.15.89:3300/0 conn(0x7f6ef806d120 0x7f6ef806d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6eeffff700 1 -- 172.21.15.81:0/933225379 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef80cfe90 con 0x7f6ef8157ca0 2023-10-07T08:44:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6eeffff700 1 --2- 172.21.15.81:0/933225379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef8157ca0 0x7f6ef815af00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80b3940 tx=0x7f6ee0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abd8d977a4033d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.940+0000 7f6ef67fc700 1 -- 172.21.15.81:0/933225379 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee000b640 con 0x7f6ef8157ca0 2023-10-07T08:44:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.941+0000 7f6ef67fc700 1 -- 172.21.15.81:0/933225379 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee000b7a0 con 0x7f6ef8157ca0 2023-10-07T08:44:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.941+0000 7f6ef67fc700 1 -- 172.21.15.81:0/933225379 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee000bb60 con 0x7f6ef8157ca0 2023-10-07T08:44:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.941+0000 7f6efd9bb700 1 -- 172.21.15.81:0/933225379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef8157ca0 msgr2=0x7f6ef815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:48.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.941+0000 7f6efd9bb700 1 --2- 172.21.15.81:0/933225379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef8157ca0 0x7f6ef815af00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80b3940 tx=0x7f6ee0009250 comp rx=0 tx=0).stop 2023-10-07T08:44:48.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.941+0000 7f6efd9bb700 1 -- 172.21.15.81:0/933225379 shutdown_connections 2023-10-07T08:44:48.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.941+0000 7f6efd9bb700 1 --2- 172.21.15.81:0/933225379 >> v2:172.21.15.89:3300/0 conn(0x7f6ef806d120 0x7f6ef806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:48.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.941+0000 7f6efd9bb700 1 --2- 172.21.15.81:0/933225379 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ef81578d0 0x7f6ef80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:48.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.941+0000 7f6efd9bb700 1 --2- 172.21.15.81:0/933225379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef8157ca0 0x7f6ef815af00 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:48.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.941+0000 7f6efd9bb700 1 -- 172.21.15.81:0/933225379 >> 172.21.15.81:0/933225379 conn(0x7f6ef806bb90 msgr2=0x7f6ef806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:48.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.941+0000 7f6efd9bb700 1 -- 172.21.15.81:0/933225379 shutdown_connections 2023-10-07T08:44:48.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.941+0000 7f6efd9bb700 1 -- 172.21.15.81:0/933225379 wait complete. 2023-10-07T08:44:48.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.942+0000 7f6efd9bb700 1 Processor -- start 2023-10-07T08:44:48.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.942+0000 7f6efd9bb700 1 -- start start 2023-10-07T08:44:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.943+0000 7f6efd9bb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef806d120 0x7f6ef8147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.943+0000 7f6efd9bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ef81578d0 0x7f6ef80b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.943+0000 7f6efd9bb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef8157ca0 0x7f6ef8069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.943+0000 7f6efd9bb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8147dc0 con 0x7f6ef8157ca0 2023-10-07T08:44:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.943+0000 7f6efd9bb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef80b57d0 con 0x7f6ef806d120 2023-10-07T08:44:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.943+0000 7f6efd9bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef80b5ab0 con 0x7f6ef81578d0 2023-10-07T08:44:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.943+0000 7f6ef77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef8157ca0 0x7f6ef8069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.943+0000 7f6ef77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef8157ca0 0x7f6ef8069850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59252/0 (socket says 172.21.15.81:59252) 2023-10-07T08:44:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.943+0000 7f6ef77fe700 1 -- 172.21.15.81:0/1275633808 learned_addr learned my addr 172.21.15.81:0/1275633808 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.943+0000 7f6ef6ffd700 1 --2- 172.21.15.81:0/1275633808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef806d120 0x7f6ef8147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.943+0000 7f6eeffff700 1 --2- 172.21.15.81:0/1275633808 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ef81578d0 0x7f6ef80b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.943+0000 7f6ef77fe700 1 -- 172.21.15.81:0/1275633808 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ef81578d0 msgr2=0x7f6ef80b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.943+0000 7f6ef77fe700 1 --2- 172.21.15.81:0/1275633808 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ef81578d0 0x7f6ef80b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.943+0000 7f6ef77fe700 1 -- 172.21.15.81:0/1275633808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef806d120 msgr2=0x7f6ef8147880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.943+0000 7f6ef77fe700 1 --2- 172.21.15.81:0/1275633808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef806d120 0x7f6ef8147880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.943+0000 7f6ef77fe700 1 -- 172.21.15.81:0/1275633808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee00094f0 con 0x7f6ef8157ca0 2023-10-07T08:44:48.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.944+0000 7f6ef77fe700 1 --2- 172.21.15.81:0/1275633808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef8157ca0 0x7f6ef8069850 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009e90 tx=0x7f6ef000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:48.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.944+0000 7f6eeeffd700 1 -- 172.21.15.81:0/1275633808 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef000cb70 con 0x7f6ef8157ca0 2023-10-07T08:44:48.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.944+0000 7f6eeeffd700 1 -- 172.21.15.81:0/1275633808 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef000f040 con 0x7f6ef8157ca0 2023-10-07T08:44:48.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.944+0000 7f6efd9bb700 1 -- 172.21.15.81:0/1275633808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef80b5d90 con 0x7f6ef8157ca0 2023-10-07T08:44:48.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.944+0000 7f6eeeffd700 1 -- 172.21.15.81:0/1275633808 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0014480 con 0x7f6ef8157ca0 2023-10-07T08:44:48.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.944+0000 7f6efd9bb700 1 -- 172.21.15.81:0/1275633808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef80b6350 con 0x7f6ef8157ca0 2023-10-07T08:44:48.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.945+0000 7f6efd9bb700 1 -- 172.21.15.81:0/1275633808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef8067ac0 con 0x7f6ef8157ca0 2023-10-07T08:44:48.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.945+0000 7f6eeeffd700 1 -- 172.21.15.81:0/1275633808 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ef00147f0 con 0x7f6ef8157ca0 2023-10-07T08:44:48.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.945+0000 7f6eeeffd700 1 --2- 172.21.15.81:0/1275633808 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ed8066f30 0x7f6ed80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:48.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.946+0000 7f6eeeffd700 1 -- 172.21.15.81:0/1275633808 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f6ef0085200 con 0x7f6ef8157ca0 2023-10-07T08:44:48.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.946+0000 7f6ef6ffd700 1 --2- 172.21.15.81:0/1275633808 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ed8066f30 0x7f6ed80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:48.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.946+0000 7f6ef6ffd700 1 --2- 172.21.15.81:0/1275633808 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ed8066f30 0x7f6ed80693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80ab0d0 tx=0x7f6ee80091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:48.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:48.950+0000 7f6eeeffd700 1 -- 172.21.15.81:0/1275633808 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ef0052430 con 0x7f6ef8157ca0 2023-10-07T08:44:49.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.137+0000 7f6efd9bb700 1 -- 172.21.15.81:0/1275633808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6ef80d0170 con 0x7f6ef8157ca0 2023-10-07T08:44:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.138+0000 7f6eeeffd700 1 -- 172.21.15.81:0/1275633808 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+32586 (secure 0 0 0) 0x7f6ef0055a50 con 0x7f6ef8157ca0 2023-10-07T08:44:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:49.140 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:44:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 55, 2023-10-07T08:44:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:44:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:44:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:44:48.276572+0000", 2023-10-07T08:44:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:44:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:44:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:44:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:44:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:44:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:44:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:44:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:44:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:44:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:44:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:44:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:44:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:44:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:44:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 7, 2023-10-07T08:44:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:44:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:44:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "luminous", 2023-10-07T08:44:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:44:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:44:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:44:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:44:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:44:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:44:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:44:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:44:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:44:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:44:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:44:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:44:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "55", 2023-10-07T08:44:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:44:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:44:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:44:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 6, 2023-10-07T08:44:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:44:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:44:17.114223+0000", 2023-10-07T08:44:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:44:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:44:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:44:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:44:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:44:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:44:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:44:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "55", 2023-10-07T08:44:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:44:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:44:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:44:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:44:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:44:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 7, 2023-10-07T08:44:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:44:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:44:17.763615+0000", 2023-10-07T08:44:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:44:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:44:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:44:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:44:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:44:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:44:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:44:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "55", 2023-10-07T08:44:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:44:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:44:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:44:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:44:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:44:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:44:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:44:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:44:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:44:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:44:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:44:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:44:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:44:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:44:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:44:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:44:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:44:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:44:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:44:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:44:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:44:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:44:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:44:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:44:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:44:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:44:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:44:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:44:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:44:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:44:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:44:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:44:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:44:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:44:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:44:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:44:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:44:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:44:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:44:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:44:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:44:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:44:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:44:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:44:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:44:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:44:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:44:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:44:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:44:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:44:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:44:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:44:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:44:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:44:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:44:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:44:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:44:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:44:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 51, 2023-10-07T08:44:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:44:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:44:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:44:49.205 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:49.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:44:49.206 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:49.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.206 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:49.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:44:49.207 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:49.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.208 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.208 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:44:49.208 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:49.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.208 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:44:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:49.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.210 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:44:49.210 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:49.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.210 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.210 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:44:49.210 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:44:49.211 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:44:49.211 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:44:49.211 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:49.211 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:49.211 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:49.211 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.211 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:44:49.211 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:49.211 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:49.212 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:49.212 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:49.212 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:49.212 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:49.212 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:49.212 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:49.212 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 51, 2023-10-07T08:44:49.212 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:49.212 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:49.212 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:49.212 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.213 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:44:49.213 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:49.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.213 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:44:49.213 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:49.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.213 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.214 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:49.214 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.214 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:44:49.214 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:49.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.214 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:44:49.215 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:49.215 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.215 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.215 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:49.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:44:49.215 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:49.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:44:49.216 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:49.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.216 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.216 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:49.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.217 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:44:49.217 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:49.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.217 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:44:49.217 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:49.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.217 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.217 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:44:49.218 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:44:49.218 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:44:49.218 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:44:49.218 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:49.218 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:49.218 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:49.218 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.218 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:44:49.218 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:49.219 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:49.219 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:49.219 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:49.219 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:49.219 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:49.219 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:49.219 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:49.219 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:49.219 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:49.219 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:49.219 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:49.219 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:44:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:44:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:44:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:44:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:44:49.222 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:44:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:44:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:44:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:44:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:44:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:44:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:44:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:44:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:44:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:44:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:44:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:44:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:44:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:44:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:44:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:44:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:44:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:44:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:44:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:44:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:44:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:44:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:44:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:44:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:44:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:44:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:44:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:44:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:44:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:44:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:44:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:44:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:44:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:44:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:44:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:44:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:44:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:44:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [ 2023-10-07T08:44:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "7.f", 2023-10-07T08:44:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "mappings": [ 2023-10-07T08:44:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "from": 0, 2023-10-07T08:44:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "to": 4 2023-10-07T08:44:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "7.32", 2023-10-07T08:44:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mappings": [ 2023-10-07T08:44:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "from": 0, 2023-10-07T08:44:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "to": 5 2023-10-07T08:44:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:44:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:44:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:44:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:44:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:44:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:44:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:44:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:44:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:44:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:44:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:44:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:44:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:44:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:44:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:44:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:44:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:44:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:44:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:44:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:44:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:44:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:44:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.250 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:44:49.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.140+0000 7f6efd9bb700 1 -- 172.21.15.81:0/1275633808 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ed8066f30 msgr2=0x7f6ed80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:49.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.140+0000 7f6efd9bb700 1 --2- 172.21.15.81:0/1275633808 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ed8066f30 0x7f6ed80693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80ab0d0 tx=0x7f6ee80091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.140+0000 7f6efd9bb700 1 -- 172.21.15.81:0/1275633808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef8157ca0 msgr2=0x7f6ef8069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.140+0000 7f6efd9bb700 1 --2- 172.21.15.81:0/1275633808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef8157ca0 0x7f6ef8069850 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009e90 tx=0x7f6ef000b040 comp rx=0 tx=0).stop 2023-10-07T08:44:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.140+0000 7f6efd9bb700 1 -- 172.21.15.81:0/1275633808 shutdown_connections 2023-10-07T08:44:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.140+0000 7f6efd9bb700 1 --2- 172.21.15.81:0/1275633808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef8157ca0 0x7f6ef8069850 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.140+0000 7f6efd9bb700 1 --2- 172.21.15.81:0/1275633808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef806d120 0x7f6ef8147880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.140+0000 7f6efd9bb700 1 --2- 172.21.15.81:0/1275633808 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ed8066f30 0x7f6ed80693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.140+0000 7f6efd9bb700 1 --2- 172.21.15.81:0/1275633808 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ef81578d0 0x7f6ef80b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.140+0000 7f6efd9bb700 1 -- 172.21.15.81:0/1275633808 >> 172.21.15.81:0/1275633808 conn(0x7f6ef806bb90 msgr2=0x7f6ef8155830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.140+0000 7f6efd9bb700 1 -- 172.21.15.81:0/1275633808 shutdown_connections 2023-10-07T08:44:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.140+0000 7f6efd9bb700 1 -- 172.21.15.81:0/1275633808 wait complete. 2023-10-07T08:44:49.253 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-07T08:44:49.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:44:49.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.366+0000 7fee69264700 1 Processor -- start 2023-10-07T08:44:49.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.366+0000 7fee69264700 1 -- start start 2023-10-07T08:44:49.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.367+0000 7fee69264700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee6406d830 0x7fee640cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:49.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.367+0000 7fee69264700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee640d07c0 con 0x7fee64157ca0 2023-10-07T08:44:49.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.367+0000 7fee69264700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee640cfbb0 con 0x7fee641578d0 2023-10-07T08:44:49.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.367+0000 7fee69264700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee640cfe90 con 0x7fee6406d830 2023-10-07T08:44:49.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.367+0000 7fee5a7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fee64157ca0 0x7fee6406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49626/0 (socket says 172.21.15.81:49626) 2023-10-07T08:44:49.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.367+0000 7fee5a7fc700 1 -- 172.21.15.81:0/2521216041 learned_addr learned my addr 172.21.15.81:0/2521216041 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:49.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.367+0000 7fee637fe700 1 --2- 172.21.15.81:0/2521216041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee6406d830 0x7fee640cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:49.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.367+0000 7fee627fc700 1 -- 172.21.15.81:0/2521216041 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920723139 0 0) 0x7fee640d07c0 con 0x7fee64157ca0 2023-10-07T08:44:49.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.367+0000 7fee627fc700 1 -- 172.21.15.81:0/2521216041 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee50003570 con 0x7fee64157ca0 2023-10-07T08:44:49.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.367+0000 7fee627fc700 1 -- 172.21.15.81:0/2521216041 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854462289 0 0) 0x7fee640cfbb0 con 0x7fee641578d0 2023-10-07T08:44:49.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.367+0000 7fee627fc700 1 -- 172.21.15.81:0/2521216041 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee640d07c0 con 0x7fee641578d0 2023-10-07T08:44:49.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.367+0000 7fee637fe700 1 -- 172.21.15.81:0/2521216041 >> v1:172.21.15.89:6789/0 conn(0x7fee641578d0 legacy=0x7fee6415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:49.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.367+0000 7fee637fe700 1 -- 172.21.15.81:0/2521216041 >> v1:172.21.15.81:6789/0 conn(0x7fee64157ca0 legacy=0x7fee6406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:49.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.368+0000 7fee637fe700 1 -- 172.21.15.81:0/2521216041 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee640d0170 con 0x7fee6406d830 2023-10-07T08:44:49.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.368+0000 7fee637fe700 1 --2- 172.21.15.81:0/2521216041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee6406d830 0x7fee640cf4f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009e90 tx=0x7fee5c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40953f9c8ab2c195 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:49.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.368+0000 7fee627fc700 1 -- 172.21.15.81:0/2521216041 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c00e070 con 0x7fee6406d830 2023-10-07T08:44:49.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.368+0000 7fee627fc700 1 -- 172.21.15.81:0/2521216041 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c00bb80 con 0x7fee6406d830 2023-10-07T08:44:49.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.368+0000 7fee627fc700 1 -- 172.21.15.81:0/2521216041 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c012430 con 0x7fee6406d830 2023-10-07T08:44:49.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.368+0000 7fee69264700 1 -- 172.21.15.81:0/2521216041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee6406d830 msgr2=0x7fee640cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:49.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.368+0000 7fee69264700 1 --2- 172.21.15.81:0/2521216041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee6406d830 0x7fee640cf4f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009e90 tx=0x7fee5c009780 comp rx=0 tx=0).stop 2023-10-07T08:44:49.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.368+0000 7fee69264700 1 -- 172.21.15.81:0/2521216041 shutdown_connections 2023-10-07T08:44:49.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.368+0000 7fee69264700 1 --2- 172.21.15.81:0/2521216041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee6406d830 0x7fee640cf4f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.368+0000 7fee69264700 1 -- 172.21.15.81:0/2521216041 >> 172.21.15.81:0/2521216041 conn(0x7fee6406bb90 msgr2=0x7fee6406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:49.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.368+0000 7fee69264700 1 -- 172.21.15.81:0/2521216041 shutdown_connections 2023-10-07T08:44:49.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.369+0000 7fee69264700 1 -- 172.21.15.81:0/2521216041 wait complete. 2023-10-07T08:44:49.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.370+0000 7fee69264700 1 Processor -- start 2023-10-07T08:44:49.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.370+0000 7fee69264700 1 -- start start 2023-10-07T08:44:49.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.370+0000 7fee69264700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee6406d830 0x7fee641549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:49.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.370+0000 7fee69264700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee641578d0 0x7fee640b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:49.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.370+0000 7fee69264700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee64157ca0 0x7fee640ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:49.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.370+0000 7fee69264700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee640b6520 con 0x7fee6406d830 2023-10-07T08:44:49.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.370+0000 7fee69264700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee640abb60 con 0x7fee641578d0 2023-10-07T08:44:49.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee69264700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee64154f30 con 0x7fee64157ca0 2023-10-07T08:44:49.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee62ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee6406d830 0x7fee641549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:49.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee62ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee6406d830 0x7fee641549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59266/0 (socket says 172.21.15.81:59266) 2023-10-07T08:44:49.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee62ffd700 1 -- 172.21.15.81:0/3016391176 learned_addr learned my addr 172.21.15.81:0/3016391176 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:49.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee5a7fc700 1 --2- 172.21.15.81:0/3016391176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee641578d0 0x7fee640b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:49.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee637fe700 1 --2- 172.21.15.81:0/3016391176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee64157ca0 0x7fee640ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:49.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee62ffd700 1 -- 172.21.15.81:0/3016391176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee64157ca0 msgr2=0x7fee640ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:49.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee62ffd700 1 --2- 172.21.15.81:0/3016391176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee64157ca0 0x7fee640ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee62ffd700 1 -- 172.21.15.81:0/3016391176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee641578d0 msgr2=0x7fee640b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:49.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee62ffd700 1 --2- 172.21.15.81:0/3016391176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee641578d0 0x7fee640b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee62ffd700 1 -- 172.21.15.81:0/3016391176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c009a20 con 0x7fee6406d830 2023-10-07T08:44:49.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee62ffd700 1 --2- 172.21.15.81:0/3016391176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee6406d830 0x7fee641549f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fee5400c7f0 tx=0x7fee54007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:49.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee5b7fe700 1 -- 172.21.15.81:0/3016391176 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540015f0 con 0x7fee6406d830 2023-10-07T08:44:49.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee5b7fe700 1 -- 172.21.15.81:0/3016391176 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee54001770 con 0x7fee6406d830 2023-10-07T08:44:49.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee5b7fe700 1 -- 172.21.15.81:0/3016391176 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54001b30 con 0x7fee6406d830 2023-10-07T08:44:49.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee69264700 1 -- 172.21.15.81:0/3016391176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee640b5f60 con 0x7fee6406d830 2023-10-07T08:44:49.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.371+0000 7fee69264700 1 -- 172.21.15.81:0/3016391176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee640ab7f0 con 0x7fee6406d830 2023-10-07T08:44:49.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.372+0000 7fee69264700 1 -- 172.21.15.81:0/3016391176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee64067ac0 con 0x7fee6406d830 2023-10-07T08:44:49.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.373+0000 7fee5b7fe700 1 -- 172.21.15.81:0/3016391176 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee5401b400 con 0x7fee6406d830 2023-10-07T08:44:49.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.373+0000 7fee5b7fe700 1 --2- 172.21.15.81:0/3016391176 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee44066f30 0x7fee440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:49.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.373+0000 7fee5b7fe700 1 -- 172.21.15.81:0/3016391176 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fee54084300 con 0x7fee6406d830 2023-10-07T08:44:49.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.373+0000 7fee5a7fc700 1 --2- 172.21.15.81:0/3016391176 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee44066f30 0x7fee440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:49.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.373+0000 7fee5a7fc700 1 --2- 172.21.15.81:0/3016391176 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee44066f30 0x7fee440693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fee4c007fd0 tx=0x7fee4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:49.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.377+0000 7fee5b7fe700 1 -- 172.21.15.81:0/3016391176 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee54051530 con 0x7fee6406d830 2023-10-07T08:44:49.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.561+0000 7fee69264700 1 -- 172.21.15.81:0/3016391176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fee640d0450 con 0x7fee6406d830 2023-10-07T08:44:49.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.562+0000 7fee5b7fe700 1 -- 172.21.15.81:0/3016391176 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+32586 (secure 0 0 0) 0x7fee54054b50 con 0x7fee6406d830 2023-10-07T08:44:49.564 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:49.564 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:44:49.564 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 55, 2023-10-07T08:44:49.564 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:44:49.564 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:44:49.564 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:44:48.276572+0000", 2023-10-07T08:44:49.565 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:44:49.565 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:44:49.565 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:44:49.565 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:44:49.565 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:44:49.565 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:44:49.565 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:44:49.565 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:44:49.565 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:44:49.565 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:49.565 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:44:49.566 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:44:49.566 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:44:49.566 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:44:49.566 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:44:49.566 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 7, 2023-10-07T08:44:49.566 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:44:49.566 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:44:49.566 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "luminous", 2023-10-07T08:44:49.566 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:44:49.567 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:44:49.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.567 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:44:49.567 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:44:49.567 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:44:49.567 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:44:49.567 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:44:49.567 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:49.568 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:49.568 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:49.568 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:49.568 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:49.568 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:49.568 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:49.568 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:49.568 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:49.568 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:49.568 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:44:49.568 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:44:49.568 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:44:49.568 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:44:49.569 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:44:49.569 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:49.569 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:49.569 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:49.569 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:49.569 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:49.569 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:49.569 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:49.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.569 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "55", 2023-10-07T08:44:49.569 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:49.569 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:49.570 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:49.570 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:49.570 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:49.570 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:49.570 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:49.570 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:49.570 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:49.571 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:49.571 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:49.571 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:49.571 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:49.572 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:49.572 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:49.572 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:49.572 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:49.572 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:49.572 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:49.573 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:49.573 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:49.573 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:49.573 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:49.574 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:49.574 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:49.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:49.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.574 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:49.574 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:49.575 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:49.575 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:49.575 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:49.575 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:49.575 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:49.575 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:49.575 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:49.576 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:49.576 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:49.576 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:49.576 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:44:49.576 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:44:49.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.576 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:49.576 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:44:49.577 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.577 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 6, 2023-10-07T08:44:49.577 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:44:49.577 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:44:17.114223+0000", 2023-10-07T08:44:49.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:44:49.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:44:49.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:49.578 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:49.578 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:49.578 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:49.578 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:49.578 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:49.579 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:49.579 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:49.579 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:49.579 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:49.579 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:44:49.579 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:44:49.579 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:44:49.580 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:44:49.580 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:44:49.580 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:49.580 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:49.580 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:49.580 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:49.581 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:49.581 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:49.581 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:49.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.581 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "55", 2023-10-07T08:44:49.581 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:49.581 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:49.581 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:49.581 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:49.581 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:49.581 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:49.582 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:49.582 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:49.582 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:49.582 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:49.582 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:49.582 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:49.582 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:49.583 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:49.583 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:49.583 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:49.583 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:49.583 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:49.583 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:49.584 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:49.584 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:49.584 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:49.584 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:49.584 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:49.584 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:49.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:49.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.585 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:49.585 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:49.585 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:49.585 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:49.586 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:49.586 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:49.586 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:49.586 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:49.586 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:49.586 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:49.586 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:49.586 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:49.586 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:44:49.586 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:44:49.587 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:44:49.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.587 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:49.587 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:44:49.587 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:44:49.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.587 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 7, 2023-10-07T08:44:49.587 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:44:49.587 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:44:17.763615+0000", 2023-10-07T08:44:49.588 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:44:49.588 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:44:49.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:44:49.588 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:44:49.588 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:44:49.588 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:44:49.588 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:44:49.588 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:44:49.588 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:44:49.588 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:44:49.588 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:44:49.588 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:44:49.589 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:44:49.589 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:44:49.589 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:44:49.589 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:44:49.589 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:44:49.589 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:44:49.589 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:44:49.589 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:44:49.589 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:44:49.589 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:44:49.589 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:44:49.589 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:44:49.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.590 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "55", 2023-10-07T08:44:49.590 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:44:49.590 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:44:49.590 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:44:49.590 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:44:49.590 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:44:49.590 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:44:49.591 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:44:49.591 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:44:49.591 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:44:49.591 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:44:49.591 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:44:49.591 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:44:49.591 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:44:49.591 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:44:49.591 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:44:49.591 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:44:49.592 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:44:49.592 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:44:49.592 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:44:49.592 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:44:49.592 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:44:49.592 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:44:49.592 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:44:49.592 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:44:49.592 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:44:49.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:44:49.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.593 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:44:49.593 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:44:49.593 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:44:49.593 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:44:49.593 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:44:49.593 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:44:49.593 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:44:49.593 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:44:49.594 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:44:49.594 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:44:49.594 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:44:49.594 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:44:49.594 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:44:49.594 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:44:49.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.594 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:44:49.594 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:44:49.595 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:44:49.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.595 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:49.595 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:44:49.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.595 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:44:49.596 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:49.596 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:49.596 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:49.596 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:49.596 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:49.596 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:49.596 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:49.596 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:49.596 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:49.596 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:49.596 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:49.597 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:49.597 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.597 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:44:49.597 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:49.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.598 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:44:49.598 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:49.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.599 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.599 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:49.599 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.600 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.600 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:44:49.600 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:49.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.600 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.600 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:44:49.600 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:49.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.601 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.601 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:49.601 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.602 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:44:49.602 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:49.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.602 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:44:49.602 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:49.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.603 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.603 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:49.603 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.604 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:44:49.604 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:49.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.604 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:44:49.604 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:44:49.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.605 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.605 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:44:49.605 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:44:49.606 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:44:49.606 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:44:49.606 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:49.606 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:49.607 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:49.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.608 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:44:49.609 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:49.609 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:49.610 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:49.610 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:49.610 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:49.611 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:49.611 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:49.611 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:49.611 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:49.611 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:44:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:44:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:44:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:44:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:44:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:44:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:44:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:44:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:44:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:44:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:44:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:44:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:44:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:44:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:44:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:44:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:44:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:44:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:44:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:44:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:44:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:44:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:44:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:44:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:44:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:44:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:44:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:44:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:44:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:44:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:44:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:44:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:44:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:44:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:44:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:44:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:44:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:44:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:44:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:44:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:44:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:44:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 51, 2023-10-07T08:44:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:44:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:44:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:44:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:44:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:44:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:44:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:44:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:44:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:44:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:44:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:44:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:44:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:44:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:44:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 51, 2023-10-07T08:44:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:44:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:44:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:44:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:44:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:44:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:44:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:44:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:44:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:44:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:44:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:44:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:44:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:44:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:44:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:44:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:44:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:44:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:44:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:44:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:44:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:44:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:44:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:44:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:44:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:44:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:44:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:44:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:44:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:44:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:44:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:44:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:44:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:44:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:44:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:44:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:44:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 45, 2023-10-07T08:44:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:44:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:44:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:44:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:44:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:44:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:44:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:44:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:44:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:44:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:44:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:44:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:44:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:44:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:44:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:44:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:44:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:44:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:44:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:44:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:44:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:44:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:44:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:44:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:44:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:44:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:44:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:44:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:44:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:44:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:44:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:44:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:44:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:44:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:44:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:44:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:44:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:44:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:44:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:44:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:44:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:44:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:44:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:44:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:44:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:44:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:44:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:44:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:44:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:44:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [ 2023-10-07T08:44:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "7.f", 2023-10-07T08:44:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "mappings": [ 2023-10-07T08:44:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "from": 0, 2023-10-07T08:44:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "to": 4 2023-10-07T08:44:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "7.32", 2023-10-07T08:44:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "mappings": [ 2023-10-07T08:44:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:44:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "from": 0, 2023-10-07T08:44:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "to": 5 2023-10-07T08:44:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:44:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:44:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:44:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:44:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:44:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:44:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:44:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:44:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:44:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:44:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:44:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:44:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:44:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:44:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:44:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:44:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:44:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:44:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:44:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:44:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:44:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:44:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:44:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:44:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:44:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:44:49.680 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:44:49.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.564+0000 7fee69264700 1 -- 172.21.15.81:0/3016391176 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee44066f30 msgr2=0x7fee440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:49.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.564+0000 7fee69264700 1 --2- 172.21.15.81:0/3016391176 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee44066f30 0x7fee440693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fee4c007fd0 tx=0x7fee4c009040 comp rx=0 tx=0).stop 2023-10-07T08:44:49.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.564+0000 7fee69264700 1 -- 172.21.15.81:0/3016391176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee6406d830 msgr2=0x7fee641549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:49.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.564+0000 7fee69264700 1 --2- 172.21.15.81:0/3016391176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee6406d830 0x7fee641549f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fee5400c7f0 tx=0x7fee54007dd0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.564+0000 7fee69264700 1 -- 172.21.15.81:0/3016391176 shutdown_connections 2023-10-07T08:44:49.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.564+0000 7fee69264700 1 --2- 172.21.15.81:0/3016391176 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee44066f30 0x7fee440693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.564+0000 7fee69264700 1 --2- 172.21.15.81:0/3016391176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee64157ca0 0x7fee640ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.564+0000 7fee69264700 1 --2- 172.21.15.81:0/3016391176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee6406d830 0x7fee641549f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.564+0000 7fee69264700 1 --2- 172.21.15.81:0/3016391176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee641578d0 0x7fee640b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.564+0000 7fee69264700 1 -- 172.21.15.81:0/3016391176 >> 172.21.15.81:0/3016391176 conn(0x7fee6406bb90 msgr2=0x7fee64155c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:49.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.564+0000 7fee69264700 1 -- 172.21.15.81:0/3016391176 shutdown_connections 2023-10-07T08:44:49.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.564+0000 7fee69264700 1 -- 172.21.15.81:0/3016391176 wait complete. 2023-10-07T08:44:49.684 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:44:49.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.795+0000 7f00aa6c8700 1 Processor -- start 2023-10-07T08:44:49.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.795+0000 7f00aa6c8700 1 -- start start 2023-10-07T08:44:49.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.796+0000 7f00aa6c8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f00a4157ca0 0x7f00a40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:49.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.796+0000 7f00aa6c8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f00a406d120 0x7f00a406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:49.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.796+0000 7f00aa6c8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a40d07c0 con 0x7f00a41578d0 2023-10-07T08:44:49.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.796+0000 7f00aa6c8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a406da50 con 0x7f00a4157ca0 2023-10-07T08:44:49.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.796+0000 7f00aa6c8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a40cfbb0 con 0x7f00a406d120 2023-10-07T08:44:49.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.796+0000 7f00a37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f00a4157ca0 0x7f00a40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:49.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.796+0000 7f00a37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f00a4157ca0 0x7f00a40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59280/0 (socket says 172.21.15.81:59280) 2023-10-07T08:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.796+0000 7f00a37fe700 1 -- 172.21.15.81:0/3787055158 learned_addr learned my addr 172.21.15.81:0/3787055158 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.796+0000 7f00a8c65700 1 --2- 172.21.15.81:0/3787055158 >> v2:172.21.15.89:3300/0 conn(0x7f00a406d120 0x7f00a406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.796+0000 7f00a37fe700 1 -- 172.21.15.81:0/3787055158 >> v2:172.21.15.89:3300/0 conn(0x7f00a406d120 msgr2=0x7f00a406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.796+0000 7f00a37fe700 1 --2- 172.21.15.81:0/3787055158 >> v2:172.21.15.89:3300/0 conn(0x7f00a406d120 0x7f00a406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.796+0000 7f00a37fe700 1 -- 172.21.15.81:0/3787055158 >> v1:172.21.15.89:6789/0 conn(0x7f00a41578d0 legacy=0x7f00a415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.796+0000 7f00a37fe700 1 -- 172.21.15.81:0/3787055158 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a40cfe90 con 0x7f00a4157ca0 2023-10-07T08:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.797+0000 7f00a37fe700 1 --2- 172.21.15.81:0/3787055158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a4157ca0 0x7f00a40cf4f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f00a4068300 tx=0x7f0098009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732eb96c3465dd42 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.797+0000 7f00a2ffd700 1 -- 172.21.15.81:0/3787055158 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009800b860 con 0x7f00a4157ca0 2023-10-07T08:44:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.797+0000 7f00a2ffd700 1 -- 172.21.15.81:0/3787055158 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009800b9c0 con 0x7f00a4157ca0 2023-10-07T08:44:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.797+0000 7f00a2ffd700 1 -- 172.21.15.81:0/3787055158 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009800bd60 con 0x7f00a4157ca0 2023-10-07T08:44:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.797+0000 7f00aa6c8700 1 -- 172.21.15.81:0/3787055158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a4157ca0 msgr2=0x7f00a40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.797+0000 7f00aa6c8700 1 --2- 172.21.15.81:0/3787055158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a4157ca0 0x7f00a40cf4f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f00a4068300 tx=0x7f0098009250 comp rx=0 tx=0).stop 2023-10-07T08:44:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.797+0000 7f00aa6c8700 1 -- 172.21.15.81:0/3787055158 shutdown_connections 2023-10-07T08:44:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.797+0000 7f00aa6c8700 1 --2- 172.21.15.81:0/3787055158 >> v2:172.21.15.89:3300/0 conn(0x7f00a406d120 0x7f00a406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.797+0000 7f00aa6c8700 1 --2- 172.21.15.81:0/3787055158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a4157ca0 0x7f00a40cf4f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.797+0000 7f00aa6c8700 1 -- 172.21.15.81:0/3787055158 >> 172.21.15.81:0/3787055158 conn(0x7f00a406bb90 msgr2=0x7f00a406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.797+0000 7f00aa6c8700 1 -- 172.21.15.81:0/3787055158 shutdown_connections 2023-10-07T08:44:49.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.797+0000 7f00aa6c8700 1 -- 172.21.15.81:0/3787055158 wait complete. 2023-10-07T08:44:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.798+0000 7f00aa6c8700 1 Processor -- start 2023-10-07T08:44:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.798+0000 7f00aa6c8700 1 -- start start 2023-10-07T08:44:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.799+0000 7f00aa6c8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00a406d120 0x7f00a40cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.799+0000 7f00aa6c8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a41578d0 0x7f00a416aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.799+0000 7f00aa6c8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00a4157ca0 0x7f00a416b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.799+0000 7f00aa6c8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a4152810 con 0x7f00a41578d0 2023-10-07T08:44:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.799+0000 7f00aa6c8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a40b5db0 con 0x7f00a4157ca0 2023-10-07T08:44:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.799+0000 7f00aa6c8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a416a5e0 con 0x7f00a406d120 2023-10-07T08:44:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.799+0000 7f00a37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a41578d0 0x7f00a416aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.799+0000 7f00a37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a41578d0 0x7f00a416aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59282/0 (socket says 172.21.15.81:59282) 2023-10-07T08:44:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.799+0000 7f00a37fe700 1 -- 172.21.15.81:0/2834123989 learned_addr learned my addr 172.21.15.81:0/2834123989 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.799+0000 7f00a8c65700 1 --2- 172.21.15.81:0/2834123989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00a4157ca0 0x7f00a416b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.799+0000 7f00a3fff700 1 --2- 172.21.15.81:0/2834123989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00a406d120 0x7f00a40cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.800+0000 7f00a37fe700 1 -- 172.21.15.81:0/2834123989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00a406d120 msgr2=0x7f00a40cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.800+0000 7f00a37fe700 1 --2- 172.21.15.81:0/2834123989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00a406d120 0x7f00a40cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.800+0000 7f00a37fe700 1 -- 172.21.15.81:0/2834123989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00a4157ca0 msgr2=0x7f00a416b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.800+0000 7f00a37fe700 1 --2- 172.21.15.81:0/2834123989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00a4157ca0 0x7f00a416b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.800+0000 7f00a37fe700 1 -- 172.21.15.81:0/2834123989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00980094f0 con 0x7f00a41578d0 2023-10-07T08:44:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.800+0000 7f00a37fe700 1 --2- 172.21.15.81:0/2834123989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a41578d0 0x7f00a416aac0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0098006fd0 tx=0x7f0098017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.800+0000 7f008bfff700 1 -- 172.21.15.81:0/2834123989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098024440 con 0x7f00a41578d0 2023-10-07T08:44:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.800+0000 7f008bfff700 1 -- 172.21.15.81:0/2834123989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00980245a0 con 0x7f00a41578d0 2023-10-07T08:44:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.800+0000 7f008bfff700 1 -- 172.21.15.81:0/2834123989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098024960 con 0x7f00a41578d0 2023-10-07T08:44:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.800+0000 7f00aa6c8700 1 -- 172.21.15.81:0/2834123989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a40b6000 con 0x7f00a41578d0 2023-10-07T08:44:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.800+0000 7f00aa6c8700 1 -- 172.21.15.81:0/2834123989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a40b65c0 con 0x7f00a41578d0 2023-10-07T08:44:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.801+0000 7f00aa6c8700 1 -- 172.21.15.81:0/2834123989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a416a7a0 con 0x7f00a41578d0 2023-10-07T08:44:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.801+0000 7f008bfff700 1 -- 172.21.15.81:0/2834123989 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f009801a420 con 0x7f00a41578d0 2023-10-07T08:44:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.802+0000 7f008bfff700 1 --2- 172.21.15.81:0/2834123989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0090066f30 0x7f00900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:49.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.802+0000 7f008bfff700 1 -- 172.21.15.81:0/2834123989 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f0098086250 con 0x7f00a41578d0 2023-10-07T08:44:49.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.802+0000 7f00a3fff700 1 --2- 172.21.15.81:0/2834123989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0090066f30 0x7f00900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:49.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.802+0000 7f00a3fff700 1 --2- 172.21.15.81:0/2834123989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0090066f30 0x7f00900693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f00a40cf0f0 tx=0x7f0094009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:49.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:49.806+0000 7f008bfff700 1 -- 172.21.15.81:0/2834123989 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0098053480 con 0x7f00a41578d0 2023-10-07T08:44:50.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.036+0000 7f00aa6c8700 1 -- 172.21.15.81:0/2834123989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00a40d0170 con 0x7f00a41578d0 2023-10-07T08:44:50.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.036+0000 7f008bfff700 1 -- 172.21.15.81:0/2834123989 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f0098056aa0 con 0x7f00a41578d0 2023-10-07T08:44:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:50.038 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1491348117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1491348117},{"type":"v1","addr":"172.21.15.89:6834","nonce":1491348117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/748490276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":748490276},{"type":"v1","addr":"172.21.15.89:6835","nonce":748490276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2260626922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2260626922},{"type":"v1","addr":"172.21.15.81:6835","nonce":2260626922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:44:18.798458+0000","modified":"2023-10-07T08:44:22.459128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5340":{"gid":5340,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2750584146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2750584146},{"type":"v1","addr":"172.21.15.81:6837","nonce":2750584146}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-07T08:44:50.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.038+0000 7f00aa6c8700 1 -- 172.21.15.81:0/2834123989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0090066f30 msgr2=0x7f00900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:50.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.038+0000 7f00aa6c8700 1 --2- 172.21.15.81:0/2834123989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0090066f30 0x7f00900693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f00a40cf0f0 tx=0x7f0094009040 comp rx=0 tx=0).stop 2023-10-07T08:44:50.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.038+0000 7f00aa6c8700 1 -- 172.21.15.81:0/2834123989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a41578d0 msgr2=0x7f00a416aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:50.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.038+0000 7f00aa6c8700 1 --2- 172.21.15.81:0/2834123989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a41578d0 0x7f00a416aac0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0098006fd0 tx=0x7f0098017000 comp rx=0 tx=0).stop 2023-10-07T08:44:50.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.038+0000 7f00aa6c8700 1 -- 172.21.15.81:0/2834123989 shutdown_connections 2023-10-07T08:44:50.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.038+0000 7f00aa6c8700 1 --2- 172.21.15.81:0/2834123989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00a4157ca0 0x7f00a416b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:50.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.038+0000 7f00aa6c8700 1 --2- 172.21.15.81:0/2834123989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0090066f30 0x7f00900693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:50.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.038+0000 7f00aa6c8700 1 --2- 172.21.15.81:0/2834123989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00a406d120 0x7f00a40cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:50.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.038+0000 7f00aa6c8700 1 --2- 172.21.15.81:0/2834123989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00a41578d0 0x7f00a416aac0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:50.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.038+0000 7f00aa6c8700 1 -- 172.21.15.81:0/2834123989 >> 172.21.15.81:0/2834123989 conn(0x7f00a406bb90 msgr2=0x7f00a415c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:50.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.039+0000 7f00aa6c8700 1 -- 172.21.15.81:0/2834123989 shutdown_connections 2023-10-07T08:44:50.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.039+0000 7f00aa6c8700 1 -- 172.21.15.81:0/2834123989 wait complete. 2023-10-07T08:44:50.042 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2023-10-07T08:44:50.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-07T08:44:50.183 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":5340,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":30.751358467999999,"mdsmap_epoch":24,"osdmap_epoch":55,"osdmap_epoch_barrier":50,"uptime":36.780792251000001} 2023-10-07T08:44:50.184 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 5340, "mdsmap_epoch": 24, "osdmap_epoch": 55, "osdmap_epoch_barrier": 50, "rank_uptime": 30.751358468, "state": "up:active", "uptime": 36.780792251, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:44:50.184 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-07T08:44:50.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:44:50.185 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-07T08:44:50.475 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records in 2023-10-07T08:44:50.475 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records out 2023-10-07T08:44:50.475 INFO:teuthology.orchestra.run.smithi081.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.273421 s, 192 MB/s 2023-10-07T08:44:50.475 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:44:50.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:44:50.515 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:44:50.552 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:44:50.552 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T08:44:50.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:44:50.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T08:44:50.622 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:44:50.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:44:50.622 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T08:44:50.636 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T08:44:50.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:44:50.637 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T08:44:50.673 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:44:50.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:44:50.674 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T08:44:50.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:44:50.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.841+0000 7f614ac1e700 1 Processor -- start 2023-10-07T08:44:50.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.841+0000 7f614ac1e700 1 -- start start 2023-10-07T08:44:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.842+0000 7f614ac1e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6144157ca0 0x7f61440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.842+0000 7f614ac1e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f614406d120 0x7f614406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.842+0000 7f614ac1e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614406dac0 con 0x7f61441578d0 2023-10-07T08:44:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.842+0000 7f614ac1e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61440d07c0 con 0x7f614406d120 2023-10-07T08:44:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.842+0000 7f614ac1e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61440cfbb0 con 0x7f6144157ca0 2023-10-07T08:44:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.842+0000 7f61489ba700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f61441578d0 0x7f614415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49632/0 (socket says 172.21.15.81:49632) 2023-10-07T08:44:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.842+0000 7f61489ba700 1 -- 172.21.15.81:0/3430192953 learned_addr learned my addr 172.21.15.81:0/3430192953 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.842+0000 7f613bfff700 1 --2- 172.21.15.81:0/3430192953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6144157ca0 0x7f61440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:50.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.842+0000 7f61491bb700 1 --2- 172.21.15.81:0/3430192953 >> v2:172.21.15.89:3300/0 conn(0x7f614406d120 0x7f614406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:50.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.842+0000 7f613b7fe700 1 -- 172.21.15.81:0/3430192953 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958470410 0 0) 0x7f6140001110 con 0x7f61441578d0 2023-10-07T08:44:50.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.842+0000 7f613b7fe700 1 -- 172.21.15.81:0/3430192953 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f612c003570 con 0x7f61441578d0 2023-10-07T08:44:50.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 -- 172.21.15.81:0/3430192953 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2946154850 0 0) 0x7f612c003570 con 0x7f61441578d0 2023-10-07T08:44:50.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 -- 172.21.15.81:0/3430192953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6144157ca0 msgr2=0x7f61440cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:50.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 --2- 172.21.15.81:0/3430192953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6144157ca0 0x7f61440cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:50.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 -- 172.21.15.81:0/3430192953 >> v2:172.21.15.89:3300/0 conn(0x7f614406d120 msgr2=0x7f614406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:50.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 --2- 172.21.15.81:0/3430192953 >> v2:172.21.15.89:3300/0 conn(0x7f614406d120 0x7f614406d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 -- 172.21.15.81:0/3430192953 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61440cfe90 con 0x7f61441578d0 2023-10-07T08:44:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 -- 172.21.15.81:0/3430192953 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f6140001600 con 0x7f61441578d0 2023-10-07T08:44:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 -- 172.21.15.81:0/3430192953 >> v1:172.21.15.81:6789/0 conn(0x7f61441578d0 legacy=0x7f614415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 --2- 172.21.15.81:0/3430192953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6144157ca0 0x7f612c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 --2- 172.21.15.81:0/3430192953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f612c003fe0 0x7f612c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 --2- 172.21.15.81:0/3430192953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f612c004d50 0x7f612c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 -- 172.21.15.81:0/3430192953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61440d07c0 con 0x7f612c004d50 2023-10-07T08:44:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 -- 172.21.15.81:0/3430192953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61440cfbb0 con 0x7f612c003fe0 2023-10-07T08:44:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 -- 172.21.15.81:0/3430192953 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c00ba90 con 0x7f6144157ca0 2023-10-07T08:44:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f61491bb700 1 --2- 172.21.15.81:0/3430192953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f612c004d50 0x7f612c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613bfff700 1 --2- 172.21.15.81:0/3430192953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f612c003fe0 0x7f612c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f61489ba700 1 --2- 172.21.15.81:0/3430192953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6144157ca0 0x7f612c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f61491bb700 1 -- 172.21.15.81:0/3430192953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6144157ca0 msgr2=0x7f612c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f61491bb700 1 --2- 172.21.15.81:0/3430192953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6144157ca0 0x7f612c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f61491bb700 1 -- 172.21.15.81:0/3430192953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f612c003fe0 msgr2=0x7f612c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f61491bb700 1 --2- 172.21.15.81:0/3430192953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f612c003fe0 0x7f612c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f61491bb700 1 -- 172.21.15.81:0/3430192953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c003570 con 0x7f612c004d50 2023-10-07T08:44:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f61491bb700 1 --2- 172.21.15.81:0/3430192953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f612c004d50 0x7f612c0051c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f613c00e210 tx=0x7f613c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41d07154b078731 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 -- 172.21.15.81:0/3430192953 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c00ea60 con 0x7f612c004d50 2023-10-07T08:44:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 -- 172.21.15.81:0/3430192953 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c00f040 con 0x7f612c004d50 2023-10-07T08:44:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.843+0000 7f613b7fe700 1 -- 172.21.15.81:0/3430192953 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c00ee10 con 0x7f612c004d50 2023-10-07T08:44:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.844+0000 7f614ac1e700 1 -- 172.21.15.81:0/3430192953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f612c004d50 msgr2=0x7f612c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.844+0000 7f614ac1e700 1 --2- 172.21.15.81:0/3430192953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f612c004d50 0x7f612c0051c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f613c00e210 tx=0x7f613c00b040 comp rx=0 tx=0).stop 2023-10-07T08:44:50.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.844+0000 7f61491bb700 1 -- 172.21.15.81:0/3430192953 reap_dead start 2023-10-07T08:44:50.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.844+0000 7f614ac1e700 1 -- 172.21.15.81:0/3430192953 shutdown_connections 2023-10-07T08:44:50.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.844+0000 7f614ac1e700 1 -- 172.21.15.81:0/3430192953 >> 172.21.15.81:0/3430192953 conn(0x7f614406bb90 msgr2=0x7f614406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:50.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.844+0000 7f614ac1e700 1 -- 172.21.15.81:0/3430192953 shutdown_connections 2023-10-07T08:44:50.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.844+0000 7f614ac1e700 1 -- 172.21.15.81:0/3430192953 wait complete. 2023-10-07T08:44:50.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.845+0000 7f614ac1e700 1 Processor -- start 2023-10-07T08:44:50.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.845+0000 7f614ac1e700 1 -- start start 2023-10-07T08:44:50.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f614ac1e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f614416d330 0x7f614416b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:50.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f614ac1e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f614416d700 0x7f6144158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:50.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f614ac1e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6144159010 0x7f61440aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:50.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f614ac1e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614416bcb0 con 0x7f6144159010 2023-10-07T08:44:50.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f614ac1e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61440b16c0 con 0x7f614416d330 2023-10-07T08:44:50.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f614ac1e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6144159440 con 0x7f614416d700 2023-10-07T08:44:50.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f61491bb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6144159010 0x7f61440aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:50.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f61491bb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6144159010 0x7f61440aab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59298/0 (socket says 172.21.15.81:59298) 2023-10-07T08:44:50.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f61491bb700 1 -- 172.21.15.81:0/1355341701 learned_addr learned my addr 172.21.15.81:0/1355341701 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:50.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f61489ba700 1 --2- 172.21.15.81:0/1355341701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f614416d330 0x7f614416b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f613bfff700 1 --2- 172.21.15.81:0/1355341701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f614416d700 0x7f6144158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f61491bb700 1 -- 172.21.15.81:0/1355341701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f614416d700 msgr2=0x7f6144158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f61491bb700 1 --2- 172.21.15.81:0/1355341701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f614416d700 0x7f6144158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f61491bb700 1 -- 172.21.15.81:0/1355341701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f614416d330 msgr2=0x7f614416b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f61491bb700 1 --2- 172.21.15.81:0/1355341701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f614416d330 0x7f614416b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f61491bb700 1 -- 172.21.15.81:0/1355341701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61440b0d90 con 0x7f6144159010 2023-10-07T08:44:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.846+0000 7f61489ba700 1 --2- 172.21.15.81:0/1355341701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f614416d330 0x7f614416b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.847+0000 7f613bfff700 1 --2- 172.21.15.81:0/1355341701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f614416d700 0x7f6144158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.847+0000 7f61491bb700 1 --2- 172.21.15.81:0/1355341701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6144159010 0x7f61440aab50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f612c004730 tx=0x7f613c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.847+0000 7f6138ff9700 1 -- 172.21.15.81:0/1355341701 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c00eee0 con 0x7f6144159010 2023-10-07T08:44:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.847+0000 7f6138ff9700 1 -- 172.21.15.81:0/1355341701 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c01d630 con 0x7f6144159010 2023-10-07T08:44:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.847+0000 7f614ac1e700 1 -- 172.21.15.81:0/1355341701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61440b1070 con 0x7f6144159010 2023-10-07T08:44:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.847+0000 7f6138ff9700 1 -- 172.21.15.81:0/1355341701 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c01d9f0 con 0x7f6144159010 2023-10-07T08:44:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.847+0000 7f614ac1e700 1 -- 172.21.15.81:0/1355341701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61440b0aa0 con 0x7f6144159010 2023-10-07T08:44:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.848+0000 7f614ac1e700 1 -- 172.21.15.81:0/1355341701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61440b1850 con 0x7f6144159010 2023-10-07T08:44:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.848+0000 7f6138ff9700 1 -- 172.21.15.81:0/1355341701 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f613c003040 con 0x7f6144159010 2023-10-07T08:44:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.848+0000 7f6138ff9700 1 --2- 172.21.15.81:0/1355341701 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6130066f30 0x7f61300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.849+0000 7f6138ff9700 1 -- 172.21.15.81:0/1355341701 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f613c0861f0 con 0x7f6144159010 2023-10-07T08:44:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.849+0000 7f61489ba700 1 --2- 172.21.15.81:0/1355341701 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6130066f30 0x7f61300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.849+0000 7f61489ba700 1 --2- 172.21.15.81:0/1355341701 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6130066f30 0x7f61300693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6140000e10 tx=0x7f6140009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:50.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:50.853+0000 7f6138ff9700 1 -- 172.21.15.81:0/1355341701 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f613c053420 con 0x7f6144159010 2023-10-07T08:44:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.079+0000 7f614ac1e700 1 -- 172.21.15.81:0/1355341701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61440d0170 con 0x7f6144159010 2023-10-07T08:44:51.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.079+0000 7f6138ff9700 1 -- 172.21.15.81:0/1355341701 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f613c056a40 con 0x7f6144159010 2023-10-07T08:44:51.081 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:51.081 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1491348117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1491348117},{"type":"v1","addr":"172.21.15.89:6834","nonce":1491348117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/748490276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":748490276},{"type":"v1","addr":"172.21.15.89:6835","nonce":748490276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2260626922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2260626922},{"type":"v1","addr":"172.21.15.81:6835","nonce":2260626922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:44:18.798458+0000","modified":"2023-10-07T08:44:22.459128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5340":{"gid":5340,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2750584146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2750584146},{"type":"v1","addr":"172.21.15.81:6837","nonce":2750584146}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-07T08:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.082+0000 7f614ac1e700 1 -- 172.21.15.81:0/1355341701 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6130066f30 msgr2=0x7f61300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.082+0000 7f614ac1e700 1 --2- 172.21.15.81:0/1355341701 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6130066f30 0x7f61300693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6140000e10 tx=0x7f6140009040 comp rx=0 tx=0).stop 2023-10-07T08:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.082+0000 7f614ac1e700 1 -- 172.21.15.81:0/1355341701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6144159010 msgr2=0x7f61440aab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.082+0000 7f614ac1e700 1 --2- 172.21.15.81:0/1355341701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6144159010 0x7f61440aab50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f612c004730 tx=0x7f613c01a000 comp rx=0 tx=0).stop 2023-10-07T08:44:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.082+0000 7f614ac1e700 1 -- 172.21.15.81:0/1355341701 shutdown_connections 2023-10-07T08:44:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.082+0000 7f614ac1e700 1 --2- 172.21.15.81:0/1355341701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6144159010 0x7f61440aab50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.082+0000 7f614ac1e700 1 --2- 172.21.15.81:0/1355341701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f614416d330 0x7f614416b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.082+0000 7f614ac1e700 1 --2- 172.21.15.81:0/1355341701 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6130066f30 0x7f61300693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.082+0000 7f614ac1e700 1 --2- 172.21.15.81:0/1355341701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f614416d700 0x7f6144158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.082+0000 7f614ac1e700 1 -- 172.21.15.81:0/1355341701 >> 172.21.15.81:0/1355341701 conn(0x7f614406bb90 msgr2=0x7f614415c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.082+0000 7f614ac1e700 1 -- 172.21.15.81:0/1355341701 shutdown_connections 2023-10-07T08:44:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.082+0000 7f614ac1e700 1 -- 172.21.15.81:0/1355341701 wait complete. 2023-10-07T08:44:51.085 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2023-10-07T08:44:51.095 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:44:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.208+0000 7f5f08506700 1 Processor -- start 2023-10-07T08:44:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.208+0000 7f5f08506700 1 -- start start 2023-10-07T08:44:51.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.209+0000 7f5f08506700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f001578d0 0x7f5f000cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.209+0000 7f5f08506700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f000d07c0 con 0x7f5f00157ca0 2023-10-07T08:44:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.209+0000 7f5f08506700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f000cfbb0 con 0x7f5f0006d120 2023-10-07T08:44:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.209+0000 7f5f08506700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f000cfe90 con 0x7f5f001578d0 2023-10-07T08:44:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.209+0000 7f5f05aa1700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5f00157ca0 0x7f5f0015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49638/0 (socket says 172.21.15.81:49638) 2023-10-07T08:44:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.209+0000 7f5f05aa1700 1 -- 172.21.15.81:0/2293384276 learned_addr learned my addr 172.21.15.81:0/2293384276 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.209+0000 7f5f062a2700 1 --2- 172.21.15.81:0/2293384276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f001578d0 0x7f5f000cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.209+0000 7f5f052a0700 1 -- 172.21.15.81:0/2293384276 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497072899 0 0) 0x7f5f000d07c0 con 0x7f5f00157ca0 2023-10-07T08:44:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.210+0000 7f5f052a0700 1 -- 172.21.15.81:0/2293384276 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eec003570 con 0x7f5f00157ca0 2023-10-07T08:44:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.210+0000 7f5f052a0700 1 -- 172.21.15.81:0/2293384276 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 31719742 0 0) 0x7f5f000cfbb0 con 0x7f5f0006d120 2023-10-07T08:44:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.210+0000 7f5f052a0700 1 -- 172.21.15.81:0/2293384276 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f000d07c0 con 0x7f5f0006d120 2023-10-07T08:44:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.210+0000 7f5f062a2700 1 -- 172.21.15.81:0/2293384276 >> v1:172.21.15.89:6789/0 conn(0x7f5f0006d120 legacy=0x7f5f0015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.210+0000 7f5f062a2700 1 -- 172.21.15.81:0/2293384276 >> v1:172.21.15.81:6789/0 conn(0x7f5f00157ca0 legacy=0x7f5f0015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.210+0000 7f5f062a2700 1 -- 172.21.15.81:0/2293384276 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f000d0170 con 0x7f5f001578d0 2023-10-07T08:44:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.210+0000 7f5f062a2700 1 --2- 172.21.15.81:0/2293384276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f001578d0 0x7f5f000cf4f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009e90 tx=0x7f5efc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eef6c095d7e4349d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.210+0000 7f5f052a0700 1 -- 172.21.15.81:0/2293384276 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc00e070 con 0x7f5f001578d0 2023-10-07T08:44:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.210+0000 7f5f052a0700 1 -- 172.21.15.81:0/2293384276 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc00bb80 con 0x7f5f001578d0 2023-10-07T08:44:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.210+0000 7f5f052a0700 1 -- 172.21.15.81:0/2293384276 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc012430 con 0x7f5f001578d0 2023-10-07T08:44:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.210+0000 7f5f08506700 1 -- 172.21.15.81:0/2293384276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f001578d0 msgr2=0x7f5f000cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.210+0000 7f5f08506700 1 --2- 172.21.15.81:0/2293384276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f001578d0 0x7f5f000cf4f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009e90 tx=0x7f5efc009780 comp rx=0 tx=0).stop 2023-10-07T08:44:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.211+0000 7f5f08506700 1 -- 172.21.15.81:0/2293384276 shutdown_connections 2023-10-07T08:44:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.211+0000 7f5f08506700 1 --2- 172.21.15.81:0/2293384276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f001578d0 0x7f5f000cf4f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.211+0000 7f5f08506700 1 -- 172.21.15.81:0/2293384276 >> 172.21.15.81:0/2293384276 conn(0x7f5f0006bb90 msgr2=0x7f5f0006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.211+0000 7f5f08506700 1 -- 172.21.15.81:0/2293384276 shutdown_connections 2023-10-07T08:44:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.211+0000 7f5f08506700 1 -- 172.21.15.81:0/2293384276 wait complete. 2023-10-07T08:44:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.212+0000 7f5f08506700 1 Processor -- start 2023-10-07T08:44:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.212+0000 7f5f08506700 1 -- start start 2023-10-07T08:44:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.212+0000 7f5f08506700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f0006d120 0x7f5f00156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.212+0000 7f5f08506700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f001578d0 0x7f5f000b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.212+0000 7f5f08506700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f00157ca0 0x7f5f000c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.212+0000 7f5f08506700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f000b50b0 con 0x7f5f001578d0 2023-10-07T08:44:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.212+0000 7f5f08506700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f000c7830 con 0x7f5f0006d120 2023-10-07T08:44:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.212+0000 7f5f08506700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f000b52e0 con 0x7f5f00157ca0 2023-10-07T08:44:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.212+0000 7f5f05aa1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f001578d0 0x7f5f000b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.212+0000 7f5f05aa1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f001578d0 0x7f5f000b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59312/0 (socket says 172.21.15.81:59312) 2023-10-07T08:44:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.212+0000 7f5f05aa1700 1 -- 172.21.15.81:0/3113686321 learned_addr learned my addr 172.21.15.81:0/3113686321 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.213+0000 7f5f062a2700 1 --2- 172.21.15.81:0/3113686321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f0006d120 0x7f5f00156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.213+0000 7f5f06aa3700 1 --2- 172.21.15.81:0/3113686321 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f00157ca0 0x7f5f000c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.213+0000 7f5f05aa1700 1 -- 172.21.15.81:0/3113686321 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f00157ca0 msgr2=0x7f5f000c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.213+0000 7f5f05aa1700 1 --2- 172.21.15.81:0/3113686321 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f00157ca0 0x7f5f000c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.213+0000 7f5f05aa1700 1 -- 172.21.15.81:0/3113686321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f0006d120 msgr2=0x7f5f00156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.213+0000 7f5f05aa1700 1 --2- 172.21.15.81:0/3113686321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f0006d120 0x7f5f00156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.213+0000 7f5f05aa1700 1 -- 172.21.15.81:0/3113686321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc009a20 con 0x7f5f001578d0 2023-10-07T08:44:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.213+0000 7f5f05aa1700 1 --2- 172.21.15.81:0/3113686321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f001578d0 0x7f5f000b4b70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000c790 tx=0x7f5ef0007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.213+0000 7f5ef67fc700 1 -- 172.21.15.81:0/3113686321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0005b30 con 0x7f5f001578d0 2023-10-07T08:44:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.213+0000 7f5ef67fc700 1 -- 172.21.15.81:0/3113686321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef0005c90 con 0x7f5f001578d0 2023-10-07T08:44:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.213+0000 7f5f08506700 1 -- 172.21.15.81:0/3113686321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f000b55c0 con 0x7f5f001578d0 2023-10-07T08:44:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.213+0000 7f5ef67fc700 1 -- 172.21.15.81:0/3113686321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0007300 con 0x7f5f001578d0 2023-10-07T08:44:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.213+0000 7f5f08506700 1 -- 172.21.15.81:0/3113686321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f000b5b80 con 0x7f5f001578d0 2023-10-07T08:44:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.214+0000 7f5f08506700 1 -- 172.21.15.81:0/3113686321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f00067ac0 con 0x7f5f001578d0 2023-10-07T08:44:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.214+0000 7f5ef67fc700 1 -- 172.21.15.81:0/3113686321 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ef001b3b0 con 0x7f5f001578d0 2023-10-07T08:44:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.215+0000 7f5ef67fc700 1 --2- 172.21.15.81:0/3113686321 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ee4066f30 0x7f5ee40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.215+0000 7f5ef67fc700 1 -- 172.21.15.81:0/3113686321 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f5ef00839a0 con 0x7f5f001578d0 2023-10-07T08:44:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.215+0000 7f5f062a2700 1 --2- 172.21.15.81:0/3113686321 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ee4066f30 0x7f5ee40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.215+0000 7f5f062a2700 1 --2- 172.21.15.81:0/3113686321 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ee4066f30 0x7f5ee40693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0099f0 tx=0x7f5efc019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:51.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.219+0000 7f5ef67fc700 1 -- 172.21.15.81:0/3113686321 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ef0054660 con 0x7f5f001578d0 2023-10-07T08:44:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.403+0000 7f5f08506700 1 -- 172.21.15.81:0/3113686321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f000d0450 con 0x7f5f001578d0 2023-10-07T08:44:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.404+0000 7f5ef67fc700 1 -- 172.21.15.81:0/3113686321 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+15397 (secure 0 0 0) 0x7f5ef0017020 con 0x7f5f001578d0 2023-10-07T08:44:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:51.406 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":55,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:44:48.276572+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:44:17.114223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-07T08:44:17.763615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:44:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.406+0000 7f5f08506700 1 -- 172.21.15.81:0/3113686321 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ee4066f30 msgr2=0x7f5ee40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.406+0000 7f5f08506700 1 --2- 172.21.15.81:0/3113686321 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ee4066f30 0x7f5ee40693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0099f0 tx=0x7f5efc019000 comp rx=0 tx=0).stop 2023-10-07T08:44:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.406+0000 7f5f08506700 1 -- 172.21.15.81:0/3113686321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f001578d0 msgr2=0x7f5f000b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.406+0000 7f5f08506700 1 --2- 172.21.15.81:0/3113686321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f001578d0 0x7f5f000b4b70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000c790 tx=0x7f5ef0007ea0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.406+0000 7f5f08506700 1 -- 172.21.15.81:0/3113686321 shutdown_connections 2023-10-07T08:44:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.406+0000 7f5f08506700 1 --2- 172.21.15.81:0/3113686321 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ee4066f30 0x7f5ee40693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.406+0000 7f5f08506700 1 --2- 172.21.15.81:0/3113686321 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f00157ca0 0x7f5f000c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.406+0000 7f5f08506700 1 --2- 172.21.15.81:0/3113686321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f0006d120 0x7f5f00156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.406+0000 7f5f08506700 1 --2- 172.21.15.81:0/3113686321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f001578d0 0x7f5f000b4b70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.406+0000 7f5f08506700 1 -- 172.21.15.81:0/3113686321 >> 172.21.15.81:0/3113686321 conn(0x7f5f0006bb90 msgr2=0x7f5f00155d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.407+0000 7f5f08506700 1 -- 172.21.15.81:0/3113686321 shutdown_connections 2023-10-07T08:44:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.407+0000 7f5f08506700 1 -- 172.21.15.81:0/3113686321 wait complete. 2023-10-07T08:44:51.420 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:44:17.114223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:44:17.763615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:44:51.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:44:51.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.537+0000 7f7e0f328700 1 Processor -- start 2023-10-07T08:44:51.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.537+0000 7f7e0f328700 1 -- start start 2023-10-07T08:44:51.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.538+0000 7f7e0f328700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e081578d0 0x7f7e080cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.538+0000 7f7e0f328700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e080d07c0 con 0x7f7e08157ca0 2023-10-07T08:44:51.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.538+0000 7f7e0f328700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e080cfbb0 con 0x7f7e0806d120 2023-10-07T08:44:51.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.538+0000 7f7e0f328700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080cfe90 con 0x7f7e081578d0 2023-10-07T08:44:51.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.538+0000 7f7e0c8c3700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7e08157ca0 0x7f7e0815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49650/0 (socket says 172.21.15.81:49650) 2023-10-07T08:44:51.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.538+0000 7f7e0c8c3700 1 -- 172.21.15.81:0/3413911145 learned_addr learned my addr 172.21.15.81:0/3413911145 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:51.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.538+0000 7f7dfffff700 1 -- 172.21.15.81:0/3413911145 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496741491 0 0) 0x7f7e080d07c0 con 0x7f7e08157ca0 2023-10-07T08:44:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.538+0000 7f7dfffff700 1 -- 172.21.15.81:0/3413911145 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df4003570 con 0x7f7e08157ca0 2023-10-07T08:44:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.538+0000 7f7e0d0c4700 1 --2- 172.21.15.81:0/3413911145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e081578d0 0x7f7e080cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7dfffff700 1 -- 172.21.15.81:0/3413911145 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1481906479 0 0) 0x7f7df4003570 con 0x7f7e08157ca0 2023-10-07T08:44:51.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7dfffff700 1 -- 172.21.15.81:0/3413911145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e081578d0 msgr2=0x7f7e080cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:51.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7dfffff700 1 --2- 172.21.15.81:0/3413911145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e081578d0 0x7f7e080cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7dfffff700 1 -- 172.21.15.81:0/3413911145 >> v1:172.21.15.89:6789/0 conn(0x7f7e0806d120 legacy=0x7f7e0815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7dfffff700 1 -- 172.21.15.81:0/3413911145 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e080d0170 con 0x7f7e08157ca0 2023-10-07T08:44:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7dfffff700 1 -- 172.21.15.81:0/3413911145 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f7df8001470 con 0x7f7e08157ca0 2023-10-07T08:44:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7dfffff700 1 -- 172.21.15.81:0/3413911145 >> v1:172.21.15.81:6789/0 conn(0x7f7e08157ca0 legacy=0x7f7e0815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7dfffff700 1 --2- 172.21.15.81:0/3413911145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df4003a90 0x7f7df4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7dfffff700 1 --2- 172.21.15.81:0/3413911145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df4004810 0x7f7df4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7dfffff700 1 --2- 172.21.15.81:0/3413911145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e081578d0 0x7f7df40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7dfffff700 1 -- 172.21.15.81:0/3413911145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080cfe90 con 0x7f7df4003a90 2023-10-07T08:44:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7dfffff700 1 -- 172.21.15.81:0/3413911145 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df400bb10 con 0x7f7df4004810 2023-10-07T08:44:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7dfffff700 1 -- 172.21.15.81:0/3413911145 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df400bcd0 con 0x7f7e081578d0 2023-10-07T08:44:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7e0d0c4700 1 --2- 172.21.15.81:0/3413911145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df4003a90 0x7f7df4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7e0c8c3700 1 --2- 172.21.15.81:0/3413911145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df4004810 0x7f7df4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7e0d8c5700 1 --2- 172.21.15.81:0/3413911145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e081578d0 0x7f7df40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7e0d0c4700 1 -- 172.21.15.81:0/3413911145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e081578d0 msgr2=0x7f7df40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:51.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7e0d0c4700 1 --2- 172.21.15.81:0/3413911145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e081578d0 0x7f7df40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7e0d0c4700 1 -- 172.21.15.81:0/3413911145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df4004810 msgr2=0x7f7df4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:51.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7e0d0c4700 1 --2- 172.21.15.81:0/3413911145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df4004810 0x7f7df4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7e0d0c4700 1 -- 172.21.15.81:0/3413911145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df4003570 con 0x7f7df4003a90 2023-10-07T08:44:51.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7e0d0c4700 1 --2- 172.21.15.81:0/3413911145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df4003a90 0x7f7df4003e60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400e210 tx=0x7f7e0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96110c4e9a3c1faa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:51.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7dfffff700 1 -- 172.21.15.81:0/3413911145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400eac0 con 0x7f7df4003a90 2023-10-07T08:44:51.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7dfffff700 1 -- 172.21.15.81:0/3413911145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0400f040 con 0x7f7df4003a90 2023-10-07T08:44:51.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.539+0000 7f7dfffff700 1 -- 172.21.15.81:0/3413911145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400ee70 con 0x7f7df4003a90 2023-10-07T08:44:51.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.540+0000 7f7e0f328700 1 -- 172.21.15.81:0/3413911145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df4003a90 msgr2=0x7f7df4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.540+0000 7f7e0f328700 1 --2- 172.21.15.81:0/3413911145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df4003a90 0x7f7df4003e60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400e210 tx=0x7f7e0400b040 comp rx=0 tx=0).stop 2023-10-07T08:44:51.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.540+0000 7f7e0d8c5700 1 -- 172.21.15.81:0/3413911145 reap_dead start 2023-10-07T08:44:51.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.540+0000 7f7e0f328700 1 -- 172.21.15.81:0/3413911145 shutdown_connections 2023-10-07T08:44:51.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.540+0000 7f7e0f328700 1 -- 172.21.15.81:0/3413911145 >> 172.21.15.81:0/3413911145 conn(0x7f7e0806bb90 msgr2=0x7f7e0806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:51.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.540+0000 7f7e0f328700 1 -- 172.21.15.81:0/3413911145 shutdown_connections 2023-10-07T08:44:51.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.540+0000 7f7e0f328700 1 -- 172.21.15.81:0/3413911145 wait complete. 2023-10-07T08:44:51.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.541+0000 7f7e0f328700 1 Processor -- start 2023-10-07T08:44:51.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.541+0000 7f7e0f328700 1 -- start start 2023-10-07T08:44:51.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.542+0000 7f7e0f328700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df4003a90 0x7f7e08154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.542+0000 7f7e0f328700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080c5e60 0x7f7e080c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.542+0000 7f7e0f328700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e0815c6a0 0x7f7e0815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.542+0000 7f7e0f328700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080c8120 con 0x7f7e080c5e60 2023-10-07T08:44:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.542+0000 7f7e0f328700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080c75e0 con 0x7f7df4003a90 2023-10-07T08:44:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.542+0000 7f7e0f328700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0815d060 con 0x7f7e0815c6a0 2023-10-07T08:44:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.542+0000 7f7e0c8c3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080c5e60 0x7f7e080c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.542+0000 7f7e0c8c3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080c5e60 0x7f7e080c62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59318/0 (socket says 172.21.15.81:59318) 2023-10-07T08:44:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.542+0000 7f7e0c8c3700 1 -- 172.21.15.81:0/2425170175 learned_addr learned my addr 172.21.15.81:0/2425170175 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.542+0000 7f7e0d8c5700 1 --2- 172.21.15.81:0/2425170175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e0815c6a0 0x7f7e0815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.542+0000 7f7e0d0c4700 1 --2- 172.21.15.81:0/2425170175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df4003a90 0x7f7e08154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.542+0000 7f7e0c8c3700 1 -- 172.21.15.81:0/2425170175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e0815c6a0 msgr2=0x7f7e0815cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.542+0000 7f7e0c8c3700 1 --2- 172.21.15.81:0/2425170175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e0815c6a0 0x7f7e0815cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.542+0000 7f7e0c8c3700 1 -- 172.21.15.81:0/2425170175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df4003a90 msgr2=0x7f7e08154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.542+0000 7f7e0c8c3700 1 --2- 172.21.15.81:0/2425170175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df4003a90 0x7f7e08154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.542+0000 7f7e0c8c3700 1 -- 172.21.15.81:0/2425170175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e080c69d0 con 0x7f7e080c5e60 2023-10-07T08:44:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.543+0000 7f7e0c8c3700 1 --2- 172.21.15.81:0/2425170175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080c5e60 0x7f7e080c62d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7df8001ba0 tx=0x7f7e0815b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.543+0000 7f7dfd7fa700 1 -- 172.21.15.81:0/2425170175 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df8018030 con 0x7f7e080c5e60 2023-10-07T08:44:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.543+0000 7f7dfd7fa700 1 -- 172.21.15.81:0/2425170175 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df800f660 con 0x7f7e080c5e60 2023-10-07T08:44:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.543+0000 7f7dfd7fa700 1 -- 172.21.15.81:0/2425170175 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df800fa00 con 0x7f7e080c5e60 2023-10-07T08:44:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.543+0000 7f7e0f328700 1 -- 172.21.15.81:0/2425170175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e080c6cb0 con 0x7f7e080c5e60 2023-10-07T08:44:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.543+0000 7f7e0f328700 1 -- 172.21.15.81:0/2425170175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e080c7270 con 0x7f7e080c5e60 2023-10-07T08:44:51.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.544+0000 7f7e0f328700 1 -- 172.21.15.81:0/2425170175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e080c7430 con 0x7f7e080c5e60 2023-10-07T08:44:51.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.544+0000 7f7dfd7fa700 1 -- 172.21.15.81:0/2425170175 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7df801b070 con 0x7f7e080c5e60 2023-10-07T08:44:51.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.544+0000 7f7dfd7fa700 1 --2- 172.21.15.81:0/2425170175 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7dec066f30 0x7f7dec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.545+0000 7f7dfd7fa700 1 -- 172.21.15.81:0/2425170175 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7df8019070 con 0x7f7e080c5e60 2023-10-07T08:44:51.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.545+0000 7f7e0d0c4700 1 --2- 172.21.15.81:0/2425170175 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7dec066f30 0x7f7dec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.545+0000 7f7e0d0c4700 1 --2- 172.21.15.81:0/2425170175 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7dec066f30 0x7f7dec0693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400afd0 tx=0x7f7e0401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:51.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.549+0000 7f7dfd7fa700 1 -- 172.21.15.81:0/2425170175 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7df8051640 con 0x7f7e080c5e60 2023-10-07T08:44:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.732+0000 7f7e0f328700 1 -- 172.21.15.81:0/2425170175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e080ca800 con 0x7f7e080c5e60 2023-10-07T08:44:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.732+0000 7f7dfd7fa700 1 -- 172.21.15.81:0/2425170175 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7df800e1c0 con 0x7f7e080c5e60 2023-10-07T08:44:51.734 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:44:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.734+0000 7f7e0f328700 1 -- 172.21.15.81:0/2425170175 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7dec066f30 msgr2=0x7f7dec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.734+0000 7f7e0f328700 1 --2- 172.21.15.81:0/2425170175 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7dec066f30 0x7f7dec0693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400afd0 tx=0x7f7e0401a000 comp rx=0 tx=0).stop 2023-10-07T08:44:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.734+0000 7f7e0f328700 1 -- 172.21.15.81:0/2425170175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080c5e60 msgr2=0x7f7e080c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.734+0000 7f7e0f328700 1 --2- 172.21.15.81:0/2425170175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080c5e60 0x7f7e080c62d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7df8001ba0 tx=0x7f7e0815b610 comp rx=0 tx=0).stop 2023-10-07T08:44:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.734+0000 7f7e0f328700 1 -- 172.21.15.81:0/2425170175 shutdown_connections 2023-10-07T08:44:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.734+0000 7f7e0f328700 1 --2- 172.21.15.81:0/2425170175 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7dec066f30 0x7f7dec0693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.734+0000 7f7e0f328700 1 --2- 172.21.15.81:0/2425170175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e0815c6a0 0x7f7e0815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.734+0000 7f7e0f328700 1 --2- 172.21.15.81:0/2425170175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7df4003a90 0x7f7e08154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.734+0000 7f7e0f328700 1 --2- 172.21.15.81:0/2425170175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e080c5e60 0x7f7e080c62d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.734+0000 7f7e0f328700 1 -- 172.21.15.81:0/2425170175 >> 172.21.15.81:0/2425170175 conn(0x7f7e0806bb90 msgr2=0x7f7e08155ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:51.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.734+0000 7f7e0f328700 1 -- 172.21.15.81:0/2425170175 shutdown_connections 2023-10-07T08:44:51.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.734+0000 7f7e0f328700 1 -- 172.21.15.81:0/2425170175 wait complete. 2023-10-07T08:44:51.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:44:51.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.862+0000 7f536a923700 1 Processor -- start 2023-10-07T08:44:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.862+0000 7f536a923700 1 -- start start 2023-10-07T08:44:51.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.863+0000 7f536a923700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f53641578d0 0x7f53640cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.863+0000 7f536a923700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5364157ca0 0x7f536415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.863+0000 7f536a923700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53640d07c0 con 0x7f536406d120 2023-10-07T08:44:51.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.863+0000 7f536a923700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53640cfbb0 con 0x7f53641578d0 2023-10-07T08:44:51.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.863+0000 7f536a923700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53640cfe90 con 0x7f5364157ca0 2023-10-07T08:44:51.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.863+0000 7f53637fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5364157ca0 0x7f536415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.863+0000 7f53637fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5364157ca0 0x7f536415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:36384/0 (socket says 172.21.15.81:36384) 2023-10-07T08:44:51.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.863+0000 7f5363fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f53641578d0 0x7f53640cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.863+0000 7f53637fe700 1 -- 172.21.15.81:0/2434045209 learned_addr learned my addr 172.21.15.81:0/2434045209 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:51.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.863+0000 7f5368ec0700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f536406d120 0x7f536415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:40494/0 (socket says 172.21.15.81:40494) 2023-10-07T08:44:51.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.864+0000 7f5363fff700 1 -- 172.21.15.81:0/2434045209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5364157ca0 msgr2=0x7f536415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:51.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.864+0000 7f5363fff700 1 --2- 172.21.15.81:0/2434045209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5364157ca0 0x7f536415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.864+0000 7f5363fff700 1 -- 172.21.15.81:0/2434045209 >> v1:172.21.15.89:6789/0 conn(0x7f536406d120 legacy=0x7f536415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.864+0000 7f5363fff700 1 -- 172.21.15.81:0/2434045209 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53640d0170 con 0x7f53641578d0 2023-10-07T08:44:51.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.864+0000 7f5362ffd700 1 -- 172.21.15.81:0/2434045209 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53587977 0 0) 0x7f53640d07c0 con 0x7f536406d120 2023-10-07T08:44:51.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.864+0000 7f53637fe700 1 --2- 172.21.15.81:0/2434045209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5364157ca0 0x7f536415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:44:51.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.864+0000 7f5363fff700 1 --2- 172.21.15.81:0/2434045209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53641578d0 0x7f53640cf4f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f53540098e0 tx=0x7f53540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f563b280f32e2f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:51.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.864+0000 7f5362ffd700 1 -- 172.21.15.81:0/2434045209 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535400b640 con 0x7f53641578d0 2023-10-07T08:44:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.864+0000 7f5362ffd700 1 -- 172.21.15.81:0/2434045209 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535400b7a0 con 0x7f53641578d0 2023-10-07T08:44:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.864+0000 7f5362ffd700 1 -- 172.21.15.81:0/2434045209 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535400bb40 con 0x7f53641578d0 2023-10-07T08:44:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.864+0000 7f536a923700 1 -- 172.21.15.81:0/2434045209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53641578d0 msgr2=0x7f53640cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.864+0000 7f536a923700 1 --2- 172.21.15.81:0/2434045209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53641578d0 0x7f53640cf4f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f53540098e0 tx=0x7f53540091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.864+0000 7f536a923700 1 -- 172.21.15.81:0/2434045209 shutdown_connections 2023-10-07T08:44:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.864+0000 7f536a923700 1 --2- 172.21.15.81:0/2434045209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53641578d0 0x7f53640cf4f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.864+0000 7f536a923700 1 --2- 172.21.15.81:0/2434045209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5364157ca0 0x7f536415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.864+0000 7f536a923700 1 -- 172.21.15.81:0/2434045209 >> 172.21.15.81:0/2434045209 conn(0x7f536406bb90 msgr2=0x7f536406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.865+0000 7f536a923700 1 -- 172.21.15.81:0/2434045209 shutdown_connections 2023-10-07T08:44:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.865+0000 7f536a923700 1 -- 172.21.15.81:0/2434045209 wait complete. 2023-10-07T08:44:51.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.866+0000 7f536a923700 1 Processor -- start 2023-10-07T08:44:51.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.866+0000 7f536a923700 1 -- start start 2023-10-07T08:44:51.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.866+0000 7f536a923700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f536406d120 0x7f53641546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.866+0000 7f536a923700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53641578d0 0x7f5364156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.866+0000 7f536a923700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5364157ca0 0x7f5364069a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.866+0000 7f536a923700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53640c8420 con 0x7f5364157ca0 2023-10-07T08:44:51.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.866+0000 7f536a923700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53640c9240 con 0x7f53641578d0 2023-10-07T08:44:51.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.866+0000 7f536a923700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53640c8630 con 0x7f536406d120 2023-10-07T08:44:51.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.867+0000 7f5368ec0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5364157ca0 0x7f5364069a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.867+0000 7f5368ec0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5364157ca0 0x7f5364069a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59334/0 (socket says 172.21.15.81:59334) 2023-10-07T08:44:51.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.867+0000 7f5368ec0700 1 -- 172.21.15.81:0/2882028716 learned_addr learned my addr 172.21.15.81:0/2882028716 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:51.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.867+0000 7f5363fff700 1 --2- 172.21.15.81:0/2882028716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f536406d120 0x7f53641546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.867+0000 7f53637fe700 1 --2- 172.21.15.81:0/2882028716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53641578d0 0x7f5364156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.867+0000 7f5368ec0700 1 -- 172.21.15.81:0/2882028716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f536406d120 msgr2=0x7f53641546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.867+0000 7f5368ec0700 1 --2- 172.21.15.81:0/2882028716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f536406d120 0x7f53641546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.867+0000 7f5368ec0700 1 -- 172.21.15.81:0/2882028716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53641578d0 msgr2=0x7f5364156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:51.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.867+0000 7f5368ec0700 1 --2- 172.21.15.81:0/2882028716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53641578d0 0x7f5364156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:51.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.867+0000 7f5368ec0700 1 -- 172.21.15.81:0/2882028716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53580094f0 con 0x7f5364157ca0 2023-10-07T08:44:51.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.867+0000 7f5368ec0700 1 --2- 172.21.15.81:0/2882028716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5364157ca0 0x7f5364069a50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f535c00cd50 tx=0x7f535c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:51.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.867+0000 7f534bfff700 1 -- 172.21.15.81:0/2882028716 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c005df0 con 0x7f5364157ca0 2023-10-07T08:44:51.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.867+0000 7f536a923700 1 -- 172.21.15.81:0/2882028716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5354009420 con 0x7f5364157ca0 2023-10-07T08:44:51.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.867+0000 7f534bfff700 1 -- 172.21.15.81:0/2882028716 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c00a8b0 con 0x7f5364157ca0 2023-10-07T08:44:51.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.867+0000 7f534bfff700 1 -- 172.21.15.81:0/2882028716 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c00ac70 con 0x7f5364157ca0 2023-10-07T08:44:51.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.867+0000 7f536a923700 1 -- 172.21.15.81:0/2882028716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53640c8bf0 con 0x7f5364157ca0 2023-10-07T08:44:51.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.868+0000 7f536a923700 1 -- 172.21.15.81:0/2882028716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5364067ac0 con 0x7f5364157ca0 2023-10-07T08:44:51.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.869+0000 7f534bfff700 1 -- 172.21.15.81:0/2882028716 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f535c007300 con 0x7f5364157ca0 2023-10-07T08:44:51.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.869+0000 7f534bfff700 1 --2- 172.21.15.81:0/2882028716 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5350066f30 0x7f53500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:51.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.869+0000 7f534bfff700 1 -- 172.21.15.81:0/2882028716 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f535c0846c0 con 0x7f5364157ca0 2023-10-07T08:44:51.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.869+0000 7f5363fff700 1 --2- 172.21.15.81:0/2882028716 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5350066f30 0x7f53500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:51.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.869+0000 7f5363fff700 1 --2- 172.21.15.81:0/2882028716 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5350066f30 0x7f53500693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f53540093f0 tx=0x7f5354017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:51.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:51.873+0000 7f534bfff700 1 -- 172.21.15.81:0/2882028716 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f535c0519a0 con 0x7f5364157ca0 2023-10-07T08:44:52.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.053+0000 7f536a923700 1 -- 172.21.15.81:0/2882028716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5364071b10 con 0x7f5364157ca0 2023-10-07T08:44:52.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.053+0000 7f534bfff700 1 -- 172.21.15.81:0/2882028716 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f535c054fc0 con 0x7f5364157ca0 2023-10-07T08:44:52.055 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:44:52.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.055+0000 7f536a923700 1 -- 172.21.15.81:0/2882028716 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5350066f30 msgr2=0x7f53500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.055+0000 7f536a923700 1 --2- 172.21.15.81:0/2882028716 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5350066f30 0x7f53500693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f53540093f0 tx=0x7f5354017000 comp rx=0 tx=0).stop 2023-10-07T08:44:52.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.055+0000 7f536a923700 1 -- 172.21.15.81:0/2882028716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5364157ca0 msgr2=0x7f5364069a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.055+0000 7f536a923700 1 --2- 172.21.15.81:0/2882028716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5364157ca0 0x7f5364069a50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f535c00cd50 tx=0x7f535c001b10 comp rx=0 tx=0).stop 2023-10-07T08:44:52.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.055+0000 7f536a923700 1 -- 172.21.15.81:0/2882028716 shutdown_connections 2023-10-07T08:44:52.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.055+0000 7f536a923700 1 --2- 172.21.15.81:0/2882028716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5364157ca0 0x7f5364069a50 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.055+0000 7f536a923700 1 --2- 172.21.15.81:0/2882028716 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5350066f30 0x7f53500693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.055+0000 7f536a923700 1 --2- 172.21.15.81:0/2882028716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f536406d120 0x7f53641546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.055+0000 7f536a923700 1 --2- 172.21.15.81:0/2882028716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53641578d0 0x7f5364156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.055+0000 7f536a923700 1 -- 172.21.15.81:0/2882028716 >> 172.21.15.81:0/2882028716 conn(0x7f536406bb90 msgr2=0x7f5364155c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:52.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.056+0000 7f536a923700 1 -- 172.21.15.81:0/2882028716 shutdown_connections 2023-10-07T08:44:52.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.056+0000 7f536a923700 1 -- 172.21.15.81:0/2882028716 wait complete. 2023-10-07T08:44:52.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:44:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.182+0000 7f064205c700 1 Processor -- start 2023-10-07T08:44:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.182+0000 7f064205c700 1 -- start start 2023-10-07T08:44:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.183+0000 7f064205c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f063c157ca0 0x7f063c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.183+0000 7f064205c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063c06d120 0x7f063c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.183+0000 7f064205c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c0d07c0 con 0x7f063c1578d0 2023-10-07T08:44:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.183+0000 7f064205c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c06daa0 con 0x7f063c157ca0 2023-10-07T08:44:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.183+0000 7f064205c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0cfbb0 con 0x7f063c06d120 2023-10-07T08:44:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.183+0000 7f063b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f063c1578d0 0x7f063c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49658/0 (socket says 172.21.15.81:49658) 2023-10-07T08:44:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.183+0000 7f063b7fe700 1 -- 172.21.15.81:0/3542788060 learned_addr learned my addr 172.21.15.81:0/3542788060 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.183+0000 7f063bfff700 1 --2- 172.21.15.81:0/3542788060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063c06d120 0x7f063c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.183+0000 7f063affd700 1 --2- 172.21.15.81:0/3542788060 >> v2:172.21.15.89:3300/0 conn(0x7f063c157ca0 0x7f063c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.183+0000 7f063a7fc700 1 -- 172.21.15.81:0/3542788060 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424793140 0 0) 0x7f063c0d07c0 con 0x7f063c1578d0 2023-10-07T08:44:52.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.183+0000 7f063a7fc700 1 -- 172.21.15.81:0/3542788060 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0624003570 con 0x7f063c1578d0 2023-10-07T08:44:52.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.183+0000 7f063affd700 1 -- 172.21.15.81:0/3542788060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063c06d120 msgr2=0x7f063c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:52.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.183+0000 7f063affd700 1 --2- 172.21.15.81:0/3542788060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063c06d120 0x7f063c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.183+0000 7f063affd700 1 -- 172.21.15.81:0/3542788060 >> v1:172.21.15.81:6789/0 conn(0x7f063c1578d0 legacy=0x7f063c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.184+0000 7f063affd700 1 -- 172.21.15.81:0/3542788060 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0cfe90 con 0x7f063c157ca0 2023-10-07T08:44:52.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.184+0000 7f063bfff700 1 --2- 172.21.15.81:0/3542788060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063c06d120 0x7f063c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:44:52.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.184+0000 7f063affd700 1 --2- 172.21.15.81:0/3542788060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f063c157ca0 0x7f063c0cf4f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f06300098e0 tx=0x7f06300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ee21c3dc1d15c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:52.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.184+0000 7f063a7fc700 1 -- 172.21.15.81:0/3542788060 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630011630 con 0x7f063c157ca0 2023-10-07T08:44:52.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.184+0000 7f063a7fc700 1 -- 172.21.15.81:0/3542788060 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0630011790 con 0x7f063c157ca0 2023-10-07T08:44:52.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.184+0000 7f063a7fc700 1 -- 172.21.15.81:0/3542788060 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630011b10 con 0x7f063c157ca0 2023-10-07T08:44:52.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.184+0000 7f064205c700 1 -- 172.21.15.81:0/3542788060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f063c157ca0 msgr2=0x7f063c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.184+0000 7f064205c700 1 --2- 172.21.15.81:0/3542788060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f063c157ca0 0x7f063c0cf4f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f06300098e0 tx=0x7f06300091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.184+0000 7f064205c700 1 -- 172.21.15.81:0/3542788060 shutdown_connections 2023-10-07T08:44:52.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.184+0000 7f064205c700 1 --2- 172.21.15.81:0/3542788060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063c06d120 0x7f063c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.184+0000 7f064205c700 1 --2- 172.21.15.81:0/3542788060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f063c157ca0 0x7f063c0cf4f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.184+0000 7f064205c700 1 -- 172.21.15.81:0/3542788060 >> 172.21.15.81:0/3542788060 conn(0x7f063c06bb90 msgr2=0x7f063c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:52.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.184+0000 7f064205c700 1 -- 172.21.15.81:0/3542788060 shutdown_connections 2023-10-07T08:44:52.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.184+0000 7f064205c700 1 -- 172.21.15.81:0/3542788060 wait complete. 2023-10-07T08:44:52.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.186+0000 7f064205c700 1 Processor -- start 2023-10-07T08:44:52.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.186+0000 7f064205c700 1 -- start start 2023-10-07T08:44:52.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.186+0000 7f064205c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063c06d120 0x7f063c0ab660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.186+0000 7f064205c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c1578d0 0x7f063c153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.186+0000 7f064205c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f063c157ca0 0x7f063c159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.186+0000 7f064205c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0ad250 con 0x7f063c1578d0 2023-10-07T08:44:52.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.186+0000 7f064205c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0ac640 con 0x7f063c157ca0 2023-10-07T08:44:52.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.186+0000 7f064205c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0ac920 con 0x7f063c06d120 2023-10-07T08:44:52.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.186+0000 7f063affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c1578d0 0x7f063c153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.186+0000 7f063affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c1578d0 0x7f063c153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59344/0 (socket says 172.21.15.81:59344) 2023-10-07T08:44:52.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.186+0000 7f063affd700 1 -- 172.21.15.81:0/1122265132 learned_addr learned my addr 172.21.15.81:0/1122265132 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:52.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.187+0000 7f063b7fe700 1 --2- 172.21.15.81:0/1122265132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063c06d120 0x7f063c0ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.187+0000 7f063bfff700 1 --2- 172.21.15.81:0/1122265132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f063c157ca0 0x7f063c159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.187+0000 7f063affd700 1 -- 172.21.15.81:0/1122265132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063c06d120 msgr2=0x7f063c0ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.187+0000 7f063affd700 1 --2- 172.21.15.81:0/1122265132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063c06d120 0x7f063c0ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.187+0000 7f063affd700 1 -- 172.21.15.81:0/1122265132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f063c157ca0 msgr2=0x7f063c159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.187+0000 7f063affd700 1 --2- 172.21.15.81:0/1122265132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f063c157ca0 0x7f063c159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.187+0000 7f063affd700 1 -- 172.21.15.81:0/1122265132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0634009420 con 0x7f063c1578d0 2023-10-07T08:44:52.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.187+0000 7f063b7fe700 1 --2- 172.21.15.81:0/1122265132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063c06d120 0x7f063c0ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:52.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.187+0000 7f063bfff700 1 --2- 172.21.15.81:0/1122265132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f063c157ca0 0x7f063c159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:52.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.187+0000 7f063affd700 1 --2- 172.21.15.81:0/1122265132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c1578d0 0x7f063c153a70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0630013000 tx=0x7f0630017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:52.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.187+0000 7f06237fe700 1 -- 172.21.15.81:0/1122265132 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630011b10 con 0x7f063c1578d0 2023-10-07T08:44:52.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.187+0000 7f06237fe700 1 -- 172.21.15.81:0/1122265132 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063001a430 con 0x7f063c1578d0 2023-10-07T08:44:52.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.187+0000 7f064205c700 1 -- 172.21.15.81:0/1122265132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0630009420 con 0x7f063c1578d0 2023-10-07T08:44:52.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.187+0000 7f06237fe700 1 -- 172.21.15.81:0/1122265132 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063001a7f0 con 0x7f063c1578d0 2023-10-07T08:44:52.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.187+0000 7f064205c700 1 -- 172.21.15.81:0/1122265132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c0acee0 con 0x7f063c1578d0 2023-10-07T08:44:52.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.188+0000 7f064205c700 1 -- 172.21.15.81:0/1122265132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c0abc60 con 0x7f063c1578d0 2023-10-07T08:44:52.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.188+0000 7f06237fe700 1 -- 172.21.15.81:0/1122265132 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f063001aba0 con 0x7f063c1578d0 2023-10-07T08:44:52.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.189+0000 7f06237fe700 1 --2- 172.21.15.81:0/1122265132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0628066f30 0x7f06280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.189+0000 7f06237fe700 1 -- 172.21.15.81:0/1122265132 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f0630086200 con 0x7f063c1578d0 2023-10-07T08:44:52.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.189+0000 7f063b7fe700 1 --2- 172.21.15.81:0/1122265132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0628066f30 0x7f06280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.189+0000 7f063b7fe700 1 --2- 172.21.15.81:0/1122265132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0628066f30 0x7f06280693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f062c005c50 tx=0x7f062c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:52.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.193+0000 7f06237fe700 1 -- 172.21.15.81:0/1122265132 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0630053430 con 0x7f063c1578d0 2023-10-07T08:44:52.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.376+0000 7f064205c700 1 -- 172.21.15.81:0/1122265132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f063c0ad390 con 0x7f063c1578d0 2023-10-07T08:44:52.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.376+0000 7f06237fe700 1 -- 172.21.15.81:0/1122265132 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0630056a50 con 0x7f063c1578d0 2023-10-07T08:44:52.378 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:44:52.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.378+0000 7f064205c700 1 -- 172.21.15.81:0/1122265132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0628066f30 msgr2=0x7f06280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.378+0000 7f064205c700 1 --2- 172.21.15.81:0/1122265132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0628066f30 0x7f06280693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f062c005c50 tx=0x7f062c009040 comp rx=0 tx=0).stop 2023-10-07T08:44:52.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.378+0000 7f064205c700 1 -- 172.21.15.81:0/1122265132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c1578d0 msgr2=0x7f063c153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.378+0000 7f064205c700 1 --2- 172.21.15.81:0/1122265132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c1578d0 0x7f063c153a70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0630013000 tx=0x7f0630017000 comp rx=0 tx=0).stop 2023-10-07T08:44:52.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.378+0000 7f064205c700 1 -- 172.21.15.81:0/1122265132 shutdown_connections 2023-10-07T08:44:52.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.378+0000 7f064205c700 1 --2- 172.21.15.81:0/1122265132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f063c157ca0 0x7f063c159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.378+0000 7f064205c700 1 --2- 172.21.15.81:0/1122265132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0628066f30 0x7f06280693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.378+0000 7f064205c700 1 --2- 172.21.15.81:0/1122265132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063c06d120 0x7f063c0ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.378+0000 7f064205c700 1 --2- 172.21.15.81:0/1122265132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f063c1578d0 0x7f063c153a70 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.378+0000 7f064205c700 1 -- 172.21.15.81:0/1122265132 >> 172.21.15.81:0/1122265132 conn(0x7f063c06bb90 msgr2=0x7f063c068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:52.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.378+0000 7f064205c700 1 -- 172.21.15.81:0/1122265132 shutdown_connections 2023-10-07T08:44:52.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.378+0000 7f064205c700 1 -- 172.21.15.81:0/1122265132 wait complete. 2023-10-07T08:44:52.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:44:52.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.504+0000 7f305e53f700 1 Processor -- start 2023-10-07T08:44:52.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.505+0000 7f305e53f700 1 -- start start 2023-10-07T08:44:52.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.505+0000 7f305e53f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30581569e0 0x7f30580b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.505+0000 7f305e53f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3058156db0 0x7f305806e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.505+0000 7f305e53f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580b2290 con 0x7f30580b1d10 2023-10-07T08:44:52.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.505+0000 7f305e53f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3058157c00 con 0x7f3058156db0 2023-10-07T08:44:52.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.505+0000 7f305e53f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30581572d0 con 0x7f30581569e0 2023-10-07T08:44:52.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.506+0000 7f30577fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3058156db0 0x7f305806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.506+0000 7f30577fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3058156db0 0x7f305806e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46840/0 (socket says 172.21.15.81:46840) 2023-10-07T08:44:52.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.506+0000 7f30577fe700 1 -- 172.21.15.81:0/1352639531 learned_addr learned my addr 172.21.15.81:0/1352639531 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:52.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.506+0000 7f3057fff700 1 --2- 172.21.15.81:0/1352639531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30581569e0 0x7f30580b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.506+0000 7f30577fe700 1 -- 172.21.15.81:0/1352639531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30581569e0 msgr2=0x7f30580b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:52.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.506+0000 7f30577fe700 1 --2- 172.21.15.81:0/1352639531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30581569e0 0x7f30580b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.506+0000 7f30577fe700 1 -- 172.21.15.81:0/1352639531 >> v1:172.21.15.89:6789/0 conn(0x7f30580b1d10 legacy=0x7f305815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.506+0000 7f30577fe700 1 -- 172.21.15.81:0/1352639531 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30581575b0 con 0x7f3058156db0 2023-10-07T08:44:52.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.506+0000 7f30577fe700 1 --2- 172.21.15.81:0/1352639531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3058156db0 0x7f305806e230 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f304c0099b0 tx=0x7f304c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b033051f0a751a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:52.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.506+0000 7f3056ffd700 1 -- 172.21.15.81:0/1352639531 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00b860 con 0x7f3058156db0 2023-10-07T08:44:52.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.506+0000 7f3056ffd700 1 -- 172.21.15.81:0/1352639531 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c00b9c0 con 0x7f3058156db0 2023-10-07T08:44:52.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.506+0000 7f3056ffd700 1 -- 172.21.15.81:0/1352639531 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00bd60 con 0x7f3058156db0 2023-10-07T08:44:52.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.507+0000 7f305e53f700 1 -- 172.21.15.81:0/1352639531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3058156db0 msgr2=0x7f305806e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.507+0000 7f305e53f700 1 --2- 172.21.15.81:0/1352639531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3058156db0 0x7f305806e230 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f304c0099b0 tx=0x7f304c009250 comp rx=0 tx=0).stop 2023-10-07T08:44:52.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.507+0000 7f305e53f700 1 -- 172.21.15.81:0/1352639531 shutdown_connections 2023-10-07T08:44:52.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.507+0000 7f305e53f700 1 --2- 172.21.15.81:0/1352639531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30581569e0 0x7f30580b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.507+0000 7f305e53f700 1 --2- 172.21.15.81:0/1352639531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3058156db0 0x7f305806e230 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.507+0000 7f305e53f700 1 -- 172.21.15.81:0/1352639531 >> 172.21.15.81:0/1352639531 conn(0x7f305806cca0 msgr2=0x7f305806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:52.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.507+0000 7f305e53f700 1 -- 172.21.15.81:0/1352639531 shutdown_connections 2023-10-07T08:44:52.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.507+0000 7f305e53f700 1 -- 172.21.15.81:0/1352639531 wait complete. 2023-10-07T08:44:52.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.508+0000 7f305e53f700 1 Processor -- start 2023-10-07T08:44:52.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.508+0000 7f305e53f700 1 -- start start 2023-10-07T08:44:52.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f305e53f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30580b1d10 0x7f305816af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f305e53f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30581569e0 0x7f3058159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f305e53f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3058156db0 0x7f30580af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f305e53f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30580aaa50 con 0x7f30581569e0 2023-10-07T08:44:52.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f305e53f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305815a390 con 0x7f30580b1d10 2023-10-07T08:44:52.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f305e53f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305815aeb0 con 0x7f3058156db0 2023-10-07T08:44:52.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f30577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30581569e0 0x7f3058159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f30577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30581569e0 0x7f3058159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46850/0 (socket says 172.21.15.81:46850) 2023-10-07T08:44:52.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f30577fe700 1 -- 172.21.15.81:0/169523249 learned_addr learned my addr 172.21.15.81:0/169523249 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:52.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f3057fff700 1 --2- 172.21.15.81:0/169523249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30580b1d10 0x7f305816af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f305cadc700 1 --2- 172.21.15.81:0/169523249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3058156db0 0x7f30580af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f30577fe700 1 -- 172.21.15.81:0/169523249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3058156db0 msgr2=0x7f30580af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f30577fe700 1 --2- 172.21.15.81:0/169523249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3058156db0 0x7f30580af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f30577fe700 1 -- 172.21.15.81:0/169523249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30580b1d10 msgr2=0x7f305816af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f30577fe700 1 --2- 172.21.15.81:0/169523249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30580b1d10 0x7f305816af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f30577fe700 1 -- 172.21.15.81:0/169523249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0094f0 con 0x7f30581569e0 2023-10-07T08:44:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f30577fe700 1 --2- 172.21.15.81:0/169523249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30581569e0 0x7f3058159e50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3058071450 tx=0x7f304c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.509+0000 7f303ffff700 1 -- 172.21.15.81:0/169523249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c011e40 con 0x7f30581569e0 2023-10-07T08:44:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.510+0000 7f303ffff700 1 -- 172.21.15.81:0/169523249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c024440 con 0x7f30581569e0 2023-10-07T08:44:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.510+0000 7f303ffff700 1 -- 172.21.15.81:0/169523249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0247e0 con 0x7f30581569e0 2023-10-07T08:44:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.510+0000 7f305e53f700 1 -- 172.21.15.81:0/169523249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305815a610 con 0x7f30581569e0 2023-10-07T08:44:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.510+0000 7f305e53f700 1 -- 172.21.15.81:0/169523249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305815abd0 con 0x7f30581569e0 2023-10-07T08:44:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.511+0000 7f305e53f700 1 -- 172.21.15.81:0/169523249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30580aac00 con 0x7f30581569e0 2023-10-07T08:44:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.511+0000 7f303ffff700 1 -- 172.21.15.81:0/169523249 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f304c01a420 con 0x7f30581569e0 2023-10-07T08:44:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.511+0000 7f303ffff700 1 --2- 172.21.15.81:0/169523249 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3044066f30 0x7f30440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.511+0000 7f303ffff700 1 -- 172.21.15.81:0/169523249 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f304c0863b0 con 0x7f30581569e0 2023-10-07T08:44:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.511+0000 7f3057fff700 1 --2- 172.21.15.81:0/169523249 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3044066f30 0x7f30440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.512+0000 7f3057fff700 1 --2- 172.21.15.81:0/169523249 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3044066f30 0x7f30440693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3048006fd0 tx=0x7f3048008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:52.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.516+0000 7f303ffff700 1 -- 172.21.15.81:0/169523249 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30580aac00 con 0x7f30581569e0 2023-10-07T08:44:52.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.740+0000 7f305e53f700 1 -- 172.21.15.81:0/169523249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30580aac00 con 0x7f30581569e0 2023-10-07T08:44:52.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.740+0000 7f303ffff700 1 -- 172.21.15.81:0/169523249 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f30580aac00 con 0x7f30581569e0 2023-10-07T08:44:52.742 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:52.742 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1491348117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1491348117},{"type":"v1","addr":"172.21.15.89:6834","nonce":1491348117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/748490276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":748490276},{"type":"v1","addr":"172.21.15.89:6835","nonce":748490276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2260626922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2260626922},{"type":"v1","addr":"172.21.15.81:6835","nonce":2260626922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:44:18.798458+0000","modified":"2023-10-07T08:44:22.459128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5340":{"gid":5340,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2750584146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2750584146},{"type":"v1","addr":"172.21.15.81:6837","nonce":2750584146}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-07T08:44:52.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.742+0000 7f305e53f700 1 -- 172.21.15.81:0/169523249 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3044066f30 msgr2=0x7f30440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.742+0000 7f305e53f700 1 --2- 172.21.15.81:0/169523249 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3044066f30 0x7f30440693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3048006fd0 tx=0x7f3048008040 comp rx=0 tx=0).stop 2023-10-07T08:44:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.742+0000 7f305e53f700 1 -- 172.21.15.81:0/169523249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30581569e0 msgr2=0x7f3058159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.742+0000 7f305e53f700 1 --2- 172.21.15.81:0/169523249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30581569e0 0x7f3058159e50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3058071450 tx=0x7f304c017000 comp rx=0 tx=0).stop 2023-10-07T08:44:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.742+0000 7f305e53f700 1 -- 172.21.15.81:0/169523249 shutdown_connections 2023-10-07T08:44:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.742+0000 7f305e53f700 1 --2- 172.21.15.81:0/169523249 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3044066f30 0x7f30440693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.742+0000 7f305e53f700 1 --2- 172.21.15.81:0/169523249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3058156db0 0x7f30580af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.742+0000 7f305e53f700 1 --2- 172.21.15.81:0/169523249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30580b1d10 0x7f305816af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.742+0000 7f305e53f700 1 --2- 172.21.15.81:0/169523249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30581569e0 0x7f3058159e50 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.742+0000 7f305e53f700 1 -- 172.21.15.81:0/169523249 >> 172.21.15.81:0/169523249 conn(0x7f305806cca0 msgr2=0x7f3058069a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.742+0000 7f305e53f700 1 -- 172.21.15.81:0/169523249 shutdown_connections 2023-10-07T08:44:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.742+0000 7f305e53f700 1 -- 172.21.15.81:0/169523249 wait complete. 2023-10-07T08:44:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2023-10-07T08:44:52.755 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:44:52.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.866+0000 7fe8472c1700 1 Processor -- start 2023-10-07T08:44:52.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.867+0000 7fe8472c1700 1 -- start start 2023-10-07T08:44:52.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.867+0000 7fe8472c1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8401578d0 0x7fe8400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.867+0000 7fe8472c1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe840157ca0 0x7fe84015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.867+0000 7fe8472c1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe84006d120 0x7fe84006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.867+0000 7fe8472c1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84006dac0 con 0x7fe84006d120 2023-10-07T08:44:52.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.867+0000 7fe8472c1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8400d07c0 con 0x7fe840157ca0 2023-10-07T08:44:52.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.867+0000 7fe8472c1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8400cfbb0 con 0x7fe8401578d0 2023-10-07T08:44:52.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.868+0000 7fe84585e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe84006d120 0x7fe84006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.868+0000 7fe84585e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe84006d120 0x7fe84006d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46854/0 (socket says 172.21.15.81:46854) 2023-10-07T08:44:52.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.868+0000 7fe84585e700 1 -- 172.21.15.81:0/231712375 learned_addr learned my addr 172.21.15.81:0/231712375 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:52.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.868+0000 7fe84485c700 1 --2- 172.21.15.81:0/231712375 >> v2:172.21.15.89:3300/0 conn(0x7fe840157ca0 0x7fe84015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.868+0000 7fe84505d700 1 --2- 172.21.15.81:0/231712375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8401578d0 0x7fe8400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.868+0000 7fe84585e700 1 -- 172.21.15.81:0/231712375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8401578d0 msgr2=0x7fe8400cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:52.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.868+0000 7fe84585e700 1 --2- 172.21.15.81:0/231712375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8401578d0 0x7fe8400cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.868+0000 7fe84585e700 1 -- 172.21.15.81:0/231712375 >> v2:172.21.15.89:3300/0 conn(0x7fe840157ca0 msgr2=0x7fe84015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:52.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.868+0000 7fe84585e700 1 --2- 172.21.15.81:0/231712375 >> v2:172.21.15.89:3300/0 conn(0x7fe840157ca0 0x7fe84015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.868+0000 7fe84585e700 1 -- 172.21.15.81:0/231712375 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8400cfe90 con 0x7fe84006d120 2023-10-07T08:44:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.868+0000 7fe84485c700 1 --2- 172.21.15.81:0/231712375 >> v2:172.21.15.89:3300/0 conn(0x7fe840157ca0 0x7fe84015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.868+0000 7fe84585e700 1 --2- 172.21.15.81:0/231712375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe84006d120 0x7fe84006d580 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe84006cb70 tx=0x7fe838009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278f7ff15df3fa8a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.868+0000 7fe837fff700 1 -- 172.21.15.81:0/231712375 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83800e070 con 0x7fe84006d120 2023-10-07T08:44:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.868+0000 7fe837fff700 1 -- 172.21.15.81:0/231712375 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83800ba50 con 0x7fe84006d120 2023-10-07T08:44:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.868+0000 7fe837fff700 1 -- 172.21.15.81:0/231712375 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8380092e0 con 0x7fe84006d120 2023-10-07T08:44:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.869+0000 7fe8472c1700 1 -- 172.21.15.81:0/231712375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe84006d120 msgr2=0x7fe84006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.869+0000 7fe8472c1700 1 --2- 172.21.15.81:0/231712375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe84006d120 0x7fe84006d580 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe84006cb70 tx=0x7fe838009840 comp rx=0 tx=0).stop 2023-10-07T08:44:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.869+0000 7fe8472c1700 1 -- 172.21.15.81:0/231712375 shutdown_connections 2023-10-07T08:44:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.869+0000 7fe8472c1700 1 --2- 172.21.15.81:0/231712375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe84006d120 0x7fe84006d580 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.869+0000 7fe8472c1700 1 --2- 172.21.15.81:0/231712375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe8401578d0 0x7fe8400cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.869+0000 7fe8472c1700 1 --2- 172.21.15.81:0/231712375 >> v2:172.21.15.89:3300/0 conn(0x7fe840157ca0 0x7fe84015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.869+0000 7fe8472c1700 1 -- 172.21.15.81:0/231712375 >> 172.21.15.81:0/231712375 conn(0x7fe84006bb90 msgr2=0x7fe84006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:52.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.869+0000 7fe8472c1700 1 -- 172.21.15.81:0/231712375 shutdown_connections 2023-10-07T08:44:52.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.869+0000 7fe8472c1700 1 -- 172.21.15.81:0/231712375 wait complete. 2023-10-07T08:44:52.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.870+0000 7fe8472c1700 1 Processor -- start 2023-10-07T08:44:52.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.870+0000 7fe8472c1700 1 -- start start 2023-10-07T08:44:52.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe8472c1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe84006d120 0x7fe840155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe8472c1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8401578d0 0x7fe8400c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe8472c1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe840157ca0 0x7fe84015fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe8472c1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84016a800 con 0x7fe8401578d0 2023-10-07T08:44:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe8472c1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe840155ec0 con 0x7fe84006d120 2023-10-07T08:44:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe8472c1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8400c6f80 con 0x7fe840157ca0 2023-10-07T08:44:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe84485c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8401578d0 0x7fe8400c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe84485c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8401578d0 0x7fe8400c64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46870/0 (socket says 172.21.15.81:46870) 2023-10-07T08:44:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe84485c700 1 -- 172.21.15.81:0/456121534 learned_addr learned my addr 172.21.15.81:0/456121534 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe84585e700 1 --2- 172.21.15.81:0/456121534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe840157ca0 0x7fe84015fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe84505d700 1 --2- 172.21.15.81:0/456121534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe84006d120 0x7fe840155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe84485c700 1 -- 172.21.15.81:0/456121534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe840157ca0 msgr2=0x7fe84015fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe84485c700 1 --2- 172.21.15.81:0/456121534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe840157ca0 0x7fe84015fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe84485c700 1 -- 172.21.15.81:0/456121534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe84006d120 msgr2=0x7fe840155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:52.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe84485c700 1 --2- 172.21.15.81:0/456121534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe84006d120 0x7fe840155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:52.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe84485c700 1 -- 172.21.15.81:0/456121534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe838009ae0 con 0x7fe8401578d0 2023-10-07T08:44:52.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe84505d700 1 --2- 172.21.15.81:0/456121534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe84006d120 0x7fe840155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:52.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe84485c700 1 --2- 172.21.15.81:0/456121534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8401578d0 0x7fe8400c64e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe83000d860 tx=0x7fe830008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:52.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.871+0000 7fe8357fa700 1 -- 172.21.15.81:0/456121534 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8300125f0 con 0x7fe8401578d0 2023-10-07T08:44:52.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.872+0000 7fe8357fa700 1 -- 172.21.15.81:0/456121534 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe830012750 con 0x7fe8401578d0 2023-10-07T08:44:52.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.872+0000 7fe8472c1700 1 -- 172.21.15.81:0/456121534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8400c7260 con 0x7fe8401578d0 2023-10-07T08:44:52.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.872+0000 7fe8357fa700 1 -- 172.21.15.81:0/456121534 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830012af0 con 0x7fe8401578d0 2023-10-07T08:44:52.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.872+0000 7fe8472c1700 1 -- 172.21.15.81:0/456121534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84016a450 con 0x7fe8401578d0 2023-10-07T08:44:52.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.872+0000 7fe8472c1700 1 -- 172.21.15.81:0/456121534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe840067ac0 con 0x7fe8401578d0 2023-10-07T08:44:52.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.873+0000 7fe8357fa700 1 -- 172.21.15.81:0/456121534 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe830014430 con 0x7fe8401578d0 2023-10-07T08:44:52.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.873+0000 7fe8357fa700 1 --2- 172.21.15.81:0/456121534 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe824066f60 0x7fe824069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:52.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.873+0000 7fe8357fa700 1 -- 172.21.15.81:0/456121534 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fe8300848c0 con 0x7fe8401578d0 2023-10-07T08:44:52.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.873+0000 7fe84505d700 1 --2- 172.21.15.81:0/456121534 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe824066f60 0x7fe824069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:52.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.874+0000 7fe84505d700 1 --2- 172.21.15.81:0/456121534 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe824066f60 0x7fe824069410 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe83c006fd0 tx=0x7fe83c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:52.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:52.877+0000 7fe8357fa700 1 -- 172.21.15.81:0/456121534 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe830051af0 con 0x7fe8401578d0 2023-10-07T08:44:53.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.058+0000 7fe8472c1700 1 -- 172.21.15.81:0/456121534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8400d0170 con 0x7fe8401578d0 2023-10-07T08:44:53.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.058+0000 7fe8357fa700 1 -- 172.21.15.81:0/456121534 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+15397 (secure 0 0 0) 0x7fe830055110 con 0x7fe8401578d0 2023-10-07T08:44:53.060 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:53.060 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":55,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:44:48.276572+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:44:17.114223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-07T08:44:17.763615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:44:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.061+0000 7fe8472c1700 1 -- 172.21.15.81:0/456121534 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe824066f60 msgr2=0x7fe824069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.061+0000 7fe8472c1700 1 --2- 172.21.15.81:0/456121534 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe824066f60 0x7fe824069410 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe83c006fd0 tx=0x7fe83c008040 comp rx=0 tx=0).stop 2023-10-07T08:44:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.061+0000 7fe8472c1700 1 -- 172.21.15.81:0/456121534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8401578d0 msgr2=0x7fe8400c64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.061+0000 7fe8472c1700 1 --2- 172.21.15.81:0/456121534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8401578d0 0x7fe8400c64e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe83000d860 tx=0x7fe830008040 comp rx=0 tx=0).stop 2023-10-07T08:44:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.061+0000 7fe8472c1700 1 -- 172.21.15.81:0/456121534 shutdown_connections 2023-10-07T08:44:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.061+0000 7fe8472c1700 1 --2- 172.21.15.81:0/456121534 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe824066f60 0x7fe824069410 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.061+0000 7fe8472c1700 1 --2- 172.21.15.81:0/456121534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe840157ca0 0x7fe84015fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.061+0000 7fe8472c1700 1 --2- 172.21.15.81:0/456121534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe84006d120 0x7fe840155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.061+0000 7fe8472c1700 1 --2- 172.21.15.81:0/456121534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8401578d0 0x7fe8400c64e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.061+0000 7fe8472c1700 1 -- 172.21.15.81:0/456121534 >> 172.21.15.81:0/456121534 conn(0x7fe84006bb90 msgr2=0x7fe84015b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:53.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.061+0000 7fe8472c1700 1 -- 172.21.15.81:0/456121534 shutdown_connections 2023-10-07T08:44:53.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.061+0000 7fe8472c1700 1 -- 172.21.15.81:0/456121534 wait complete. 2023-10-07T08:44:53.074 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T08:44:53.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:44:53.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.187+0000 7f7d0732e700 1 Processor -- start 2023-10-07T08:44:53.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.187+0000 7f7d0732e700 1 -- start start 2023-10-07T08:44:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.188+0000 7f7d0732e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d000add30 0x7f7d000b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.188+0000 7f7d0732e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d000cefa0 0x7f7d00067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.188+0000 7f7d0732e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d00067ff0 con 0x7f7d00067640 2023-10-07T08:44:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.188+0000 7f7d0732e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d000b37b0 con 0x7f7d000cefa0 2023-10-07T08:44:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.188+0000 7f7d0732e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d000b17c0 con 0x7f7d000add30 2023-10-07T08:44:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.188+0000 7f7d06b2d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d000cefa0 0x7f7d00067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.188+0000 7f7d05b2b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7d00067640 0x7f7d000ce890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33198/0 (socket says 172.21.15.81:33198) 2023-10-07T08:44:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.188+0000 7f7d05b2b700 1 -- 172.21.15.81:0/62882486 learned_addr learned my addr 172.21.15.81:0/62882486 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:53.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.188+0000 7f7d0632c700 1 --2- 172.21.15.81:0/62882486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d000add30 0x7f7d000b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.188+0000 7f7d06b2d700 1 -- 172.21.15.81:0/62882486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d000add30 msgr2=0x7f7d000b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:53.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.188+0000 7f7d06b2d700 1 --2- 172.21.15.81:0/62882486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d000add30 0x7f7d000b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.188+0000 7f7d06b2d700 1 -- 172.21.15.81:0/62882486 >> v1:172.21.15.81:6789/0 conn(0x7f7d00067640 legacy=0x7f7d000ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.188+0000 7f7d0532a700 1 -- 172.21.15.81:0/62882486 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207815110 0 0) 0x7f7d00067ff0 con 0x7f7d00067640 2023-10-07T08:44:53.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.188+0000 7f7d06b2d700 1 -- 172.21.15.81:0/62882486 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d000b1d80 con 0x7f7d000cefa0 2023-10-07T08:44:53.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.188+0000 7f7d06b2d700 1 --2- 172.21.15.81:0/62882486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d000cefa0 0x7f7d00067ab0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8009e60 tx=0x7f7cf8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2764924bdd7c29 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:53.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.189+0000 7f7d0532a700 1 -- 172.21.15.81:0/62882486 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf800e070 con 0x7f7d000cefa0 2023-10-07T08:44:53.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.189+0000 7f7d0532a700 1 -- 172.21.15.81:0/62882486 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf800bb60 con 0x7f7d000cefa0 2023-10-07T08:44:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.189+0000 7f7d0532a700 1 -- 172.21.15.81:0/62882486 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8012430 con 0x7f7d000cefa0 2023-10-07T08:44:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.189+0000 7f7d0732e700 1 -- 172.21.15.81:0/62882486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d000cefa0 msgr2=0x7f7d00067ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.189+0000 7f7d0732e700 1 --2- 172.21.15.81:0/62882486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d000cefa0 0x7f7d00067ab0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8009e60 tx=0x7f7cf8009780 comp rx=0 tx=0).stop 2023-10-07T08:44:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.189+0000 7f7d0732e700 1 -- 172.21.15.81:0/62882486 shutdown_connections 2023-10-07T08:44:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.189+0000 7f7d0732e700 1 --2- 172.21.15.81:0/62882486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d000cefa0 0x7f7d00067ab0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.189+0000 7f7d0732e700 1 --2- 172.21.15.81:0/62882486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d000add30 0x7f7d000b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.189+0000 7f7d0732e700 1 -- 172.21.15.81:0/62882486 >> 172.21.15.81:0/62882486 conn(0x7f7d0006c620 msgr2=0x7f7d0006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.189+0000 7f7d0732e700 1 -- 172.21.15.81:0/62882486 shutdown_connections 2023-10-07T08:44:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.189+0000 7f7d0732e700 1 -- 172.21.15.81:0/62882486 wait complete. 2023-10-07T08:44:53.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.190+0000 7f7d0732e700 1 Processor -- start 2023-10-07T08:44:53.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.190+0000 7f7d0732e700 1 -- start start 2023-10-07T08:44:53.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.191+0000 7f7d0732e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d00067640 0x7f7d000a97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.191+0000 7f7d0732e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d000add30 0x7f7d001585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.191+0000 7f7d0732e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d000cefa0 0x7f7d00158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.191+0000 7f7d0732e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d000a6e50 con 0x7f7d000add30 2023-10-07T08:44:53.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.191+0000 7f7d0732e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d000a72e0 con 0x7f7d00067640 2023-10-07T08:44:53.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.191+0000 7f7d0732e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d00156a40 con 0x7f7d000cefa0 2023-10-07T08:44:53.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.191+0000 7f7d05b2b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d000add30 0x7f7d001585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.191+0000 7f7d05b2b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d000add30 0x7f7d001585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46884/0 (socket says 172.21.15.81:46884) 2023-10-07T08:44:53.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.191+0000 7f7d05b2b700 1 -- 172.21.15.81:0/1909302122 learned_addr learned my addr 172.21.15.81:0/1909302122 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:53.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.191+0000 7f7d0632c700 1 --2- 172.21.15.81:0/1909302122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d00067640 0x7f7d000a97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.191+0000 7f7d06b2d700 1 --2- 172.21.15.81:0/1909302122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d000cefa0 0x7f7d00158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.191+0000 7f7d05b2b700 1 -- 172.21.15.81:0/1909302122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d000cefa0 msgr2=0x7f7d00158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.191+0000 7f7d05b2b700 1 --2- 172.21.15.81:0/1909302122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d000cefa0 0x7f7d00158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.191+0000 7f7d05b2b700 1 -- 172.21.15.81:0/1909302122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d00067640 msgr2=0x7f7d000a97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.191+0000 7f7d05b2b700 1 --2- 172.21.15.81:0/1909302122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d00067640 0x7f7d000a97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.191+0000 7f7d05b2b700 1 -- 172.21.15.81:0/1909302122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf8009a20 con 0x7f7d000add30 2023-10-07T08:44:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.192+0000 7f7d05b2b700 1 --2- 172.21.15.81:0/1909302122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d000add30 0x7f7d001585f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7cf000c7e0 tx=0x7f7cf0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.192+0000 7f7cf67fc700 1 -- 172.21.15.81:0/1909302122 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0005b30 con 0x7f7d000add30 2023-10-07T08:44:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.192+0000 7f7cf67fc700 1 -- 172.21.15.81:0/1909302122 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf0005c90 con 0x7f7d000add30 2023-10-07T08:44:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.192+0000 7f7d0732e700 1 -- 172.21.15.81:0/1909302122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d000ad430 con 0x7f7d000add30 2023-10-07T08:44:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.192+0000 7f7cf67fc700 1 -- 172.21.15.81:0/1909302122 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0007300 con 0x7f7d000add30 2023-10-07T08:44:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.192+0000 7f7d0732e700 1 -- 172.21.15.81:0/1909302122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d000a6800 con 0x7f7d000add30 2023-10-07T08:44:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.193+0000 7f7d0732e700 1 -- 172.21.15.81:0/1909302122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d00069920 con 0x7f7d000add30 2023-10-07T08:44:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.193+0000 7f7cf67fc700 1 -- 172.21.15.81:0/1909302122 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7cf001b3b0 con 0x7f7d000add30 2023-10-07T08:44:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.193+0000 7f7cf67fc700 1 --2- 172.21.15.81:0/1909302122 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7ce4066f30 0x7f7ce40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.193+0000 7f7cf67fc700 1 -- 172.21.15.81:0/1909302122 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7cf0083a90 con 0x7f7d000add30 2023-10-07T08:44:53.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.193+0000 7f7d0632c700 1 --2- 172.21.15.81:0/1909302122 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7ce4066f30 0x7f7ce40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.194+0000 7f7d0632c700 1 --2- 172.21.15.81:0/1909302122 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7ce4066f30 0x7f7ce40693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7d0016b320 tx=0x7f7cfc0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:53.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.197+0000 7f7cf67fc700 1 -- 172.21.15.81:0/1909302122 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cf0050cc0 con 0x7f7d000add30 2023-10-07T08:44:53.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.427+0000 7f7d0732e700 1 -- 172.21.15.81:0/1909302122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d000a6f90 con 0x7f7d000add30 2023-10-07T08:44:53.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.427+0000 7f7cf67fc700 1 -- 172.21.15.81:0/1909302122 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f7cf0017020 con 0x7f7d000add30 2023-10-07T08:44:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:53.429 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1491348117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1491348117},{"type":"v1","addr":"172.21.15.89:6834","nonce":1491348117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/748490276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":748490276},{"type":"v1","addr":"172.21.15.89:6835","nonce":748490276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2260626922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2260626922},{"type":"v1","addr":"172.21.15.81:6835","nonce":2260626922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:44:18.798458+0000","modified":"2023-10-07T08:44:22.459128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5340":{"gid":5340,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2750584146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2750584146},{"type":"v1","addr":"172.21.15.81:6837","nonce":2750584146}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-07T08:44:53.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.429+0000 7f7d0732e700 1 -- 172.21.15.81:0/1909302122 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7ce4066f30 msgr2=0x7f7ce40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.429+0000 7f7d0732e700 1 --2- 172.21.15.81:0/1909302122 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7ce4066f30 0x7f7ce40693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7d0016b320 tx=0x7f7cfc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.429+0000 7f7d0732e700 1 -- 172.21.15.81:0/1909302122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d000add30 msgr2=0x7f7d001585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.429+0000 7f7d0732e700 1 --2- 172.21.15.81:0/1909302122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d000add30 0x7f7d001585f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7cf000c7e0 tx=0x7f7cf0007df0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.429+0000 7f7d0732e700 1 -- 172.21.15.81:0/1909302122 shutdown_connections 2023-10-07T08:44:53.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.429+0000 7f7d0732e700 1 --2- 172.21.15.81:0/1909302122 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7ce4066f30 0x7f7ce40693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.429+0000 7f7d0732e700 1 --2- 172.21.15.81:0/1909302122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d000cefa0 0x7f7d00158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.429+0000 7f7d0732e700 1 --2- 172.21.15.81:0/1909302122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d00067640 0x7f7d000a97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.429+0000 7f7d0732e700 1 --2- 172.21.15.81:0/1909302122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d000add30 0x7f7d001585f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.429+0000 7f7d0732e700 1 -- 172.21.15.81:0/1909302122 >> 172.21.15.81:0/1909302122 conn(0x7f7d0006c620 msgr2=0x7f7d000ae990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:53.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.429+0000 7f7d0732e700 1 -- 172.21.15.81:0/1909302122 shutdown_connections 2023-10-07T08:44:53.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.429+0000 7f7d0732e700 1 -- 172.21.15.81:0/1909302122 wait complete. 2023-10-07T08:44:53.432 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2023-10-07T08:44:53.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:44:53.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.554+0000 7ff107e2a700 1 Processor -- start 2023-10-07T08:44:53.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.554+0000 7ff107e2a700 1 -- start start 2023-10-07T08:44:53.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.555+0000 7ff107e2a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff1001578d0 0x7ff1000cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.555+0000 7ff107e2a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff100157ca0 0x7ff10015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.555+0000 7ff107e2a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1000d07c0 con 0x7ff10006d120 2023-10-07T08:44:53.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.555+0000 7ff107e2a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1000cfbb0 con 0x7ff100157ca0 2023-10-07T08:44:53.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.555+0000 7ff107e2a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1000cfe90 con 0x7ff1001578d0 2023-10-07T08:44:53.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.555+0000 7ff1053c5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff100157ca0 0x7ff10015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.555+0000 7ff1063c7700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff10006d120 0x7ff10006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33210/0 (socket says 172.21.15.81:33210) 2023-10-07T08:44:53.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.555+0000 7ff1063c7700 1 -- 172.21.15.81:0/2191605078 learned_addr learned my addr 172.21.15.81:0/2191605078 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:53.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.555+0000 7ff105bc6700 1 --2- 172.21.15.81:0/2191605078 >> v2:172.21.15.89:3300/0 conn(0x7ff1001578d0 0x7ff1000cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.555+0000 7ff1053c5700 1 -- 172.21.15.81:0/2191605078 >> v2:172.21.15.89:3300/0 conn(0x7ff1001578d0 msgr2=0x7ff1000cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:53.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.555+0000 7ff1053c5700 1 --2- 172.21.15.81:0/2191605078 >> v2:172.21.15.89:3300/0 conn(0x7ff1001578d0 0x7ff1000cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.555+0000 7ff1053c5700 1 -- 172.21.15.81:0/2191605078 >> v1:172.21.15.81:6789/0 conn(0x7ff10006d120 legacy=0x7ff10006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.555+0000 7ff104bc4700 1 -- 172.21.15.81:0/2191605078 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614818618 0 0) 0x7ff1000d07c0 con 0x7ff10006d120 2023-10-07T08:44:53.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.555+0000 7ff1053c5700 1 -- 172.21.15.81:0/2191605078 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1000d0170 con 0x7ff100157ca0 2023-10-07T08:44:53.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.556+0000 7ff1053c5700 1 --2- 172.21.15.81:0/2191605078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100157ca0 0x7ff10015af00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff1000646b0 tx=0x7ff0f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed6088e30412f0a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:53.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.556+0000 7ff104bc4700 1 -- 172.21.15.81:0/2191605078 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000b6b0 con 0x7ff100157ca0 2023-10-07T08:44:53.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.556+0000 7ff104bc4700 1 -- 172.21.15.81:0/2191605078 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f000b810 con 0x7ff100157ca0 2023-10-07T08:44:53.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.556+0000 7ff104bc4700 1 -- 172.21.15.81:0/2191605078 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000bbb0 con 0x7ff100157ca0 2023-10-07T08:44:53.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.556+0000 7ff107e2a700 1 -- 172.21.15.81:0/2191605078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100157ca0 msgr2=0x7ff10015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.556+0000 7ff107e2a700 1 --2- 172.21.15.81:0/2191605078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100157ca0 0x7ff10015af00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff1000646b0 tx=0x7ff0f00091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.556+0000 7ff107e2a700 1 -- 172.21.15.81:0/2191605078 shutdown_connections 2023-10-07T08:44:53.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.556+0000 7ff107e2a700 1 --2- 172.21.15.81:0/2191605078 >> v2:172.21.15.89:3300/0 conn(0x7ff1001578d0 0x7ff1000cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.556+0000 7ff107e2a700 1 --2- 172.21.15.81:0/2191605078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100157ca0 0x7ff10015af00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.556+0000 7ff107e2a700 1 -- 172.21.15.81:0/2191605078 >> 172.21.15.81:0/2191605078 conn(0x7ff10006bb90 msgr2=0x7ff10006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:53.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.556+0000 7ff107e2a700 1 -- 172.21.15.81:0/2191605078 shutdown_connections 2023-10-07T08:44:53.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.556+0000 7ff107e2a700 1 -- 172.21.15.81:0/2191605078 wait complete. 2023-10-07T08:44:53.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.557+0000 7ff107e2a700 1 Processor -- start 2023-10-07T08:44:53.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.557+0000 7ff107e2a700 1 -- start start 2023-10-07T08:44:53.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.558+0000 7ff107e2a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff10006d120 0x7ff1000c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.558+0000 7ff107e2a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1001578d0 0x7ff1000c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.558+0000 7ff107e2a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100157ca0 0x7ff1001433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.558+0000 7ff107e2a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1000c7560 con 0x7ff100157ca0 2023-10-07T08:44:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.558+0000 7ff107e2a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1000c6060 con 0x7ff1001578d0 2023-10-07T08:44:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.558+0000 7ff107e2a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1001438f0 con 0x7ff10006d120 2023-10-07T08:44:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.558+0000 7ff1063c7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100157ca0 0x7ff1001433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.558+0000 7ff1063c7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100157ca0 0x7ff1001433b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46910/0 (socket says 172.21.15.81:46910) 2023-10-07T08:44:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.558+0000 7ff1063c7700 1 -- 172.21.15.81:0/1615726099 learned_addr learned my addr 172.21.15.81:0/1615726099 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.558+0000 7ff105bc6700 1 --2- 172.21.15.81:0/1615726099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff10006d120 0x7ff1000c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.558+0000 7ff1053c5700 1 --2- 172.21.15.81:0/1615726099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1001578d0 0x7ff1000c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.558+0000 7ff1063c7700 1 -- 172.21.15.81:0/1615726099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff10006d120 msgr2=0x7ff1000c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.559+0000 7ff1063c7700 1 --2- 172.21.15.81:0/1615726099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff10006d120 0x7ff1000c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.559+0000 7ff1063c7700 1 -- 172.21.15.81:0/1615726099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1001578d0 msgr2=0x7ff1000c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.559+0000 7ff1063c7700 1 --2- 172.21.15.81:0/1615726099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1001578d0 0x7ff1000c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.559+0000 7ff1063c7700 1 -- 172.21.15.81:0/1615726099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f0009420 con 0x7ff100157ca0 2023-10-07T08:44:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.559+0000 7ff1053c5700 1 --2- 172.21.15.81:0/1615726099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1001578d0 0x7ff1000c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.559+0000 7ff1063c7700 1 --2- 172.21.15.81:0/1615726099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100157ca0 0x7ff1001433b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800c810 tx=0x7ff0f8007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.559+0000 7ff0f5ffb700 1 -- 172.21.15.81:0/1615726099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8005c00 con 0x7ff100157ca0 2023-10-07T08:44:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.559+0000 7ff0f5ffb700 1 -- 172.21.15.81:0/1615726099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f8005da0 con 0x7ff100157ca0 2023-10-07T08:44:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.559+0000 7ff107e2a700 1 -- 172.21.15.81:0/1615726099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1000c6950 con 0x7ff100157ca0 2023-10-07T08:44:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.559+0000 7ff0f5ffb700 1 -- 172.21.15.81:0/1615726099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8004a80 con 0x7ff100157ca0 2023-10-07T08:44:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.559+0000 7ff107e2a700 1 -- 172.21.15.81:0/1615726099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1000c6f10 con 0x7ff100157ca0 2023-10-07T08:44:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.560+0000 7ff0f5ffb700 1 -- 172.21.15.81:0/1615726099 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0f8005030 con 0x7ff100157ca0 2023-10-07T08:44:53.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.560+0000 7ff107e2a700 1 -- 172.21.15.81:0/1615726099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1000c7710 con 0x7ff100157ca0 2023-10-07T08:44:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.561+0000 7ff0f5ffb700 1 --2- 172.21.15.81:0/1615726099 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff0e4066f30 0x7ff0e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.561+0000 7ff0f5ffb700 1 -- 172.21.15.81:0/1615726099 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ff0f8083a00 con 0x7ff100157ca0 2023-10-07T08:44:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.561+0000 7ff105bc6700 1 --2- 172.21.15.81:0/1615726099 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff0e4066f30 0x7ff0e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.561+0000 7ff105bc6700 1 --2- 172.21.15.81:0/1615726099 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff0e4066f30 0x7ff0e40693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0075a0 tx=0x7ff0fc0097a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:53.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.565+0000 7ff0f5ffb700 1 -- 172.21.15.81:0/1615726099 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0f804b5a0 con 0x7ff100157ca0 2023-10-07T08:44:53.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.788+0000 7ff107e2a700 1 -- 172.21.15.81:0/1615726099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1000d0450 con 0x7ff100157ca0 2023-10-07T08:44:53.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.789+0000 7ff0f5ffb700 1 -- 172.21.15.81:0/1615726099 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4594 (secure 0 0 0) 0x7ff1000c7710 con 0x7ff100157ca0 2023-10-07T08:44:53.790 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:53.790 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1491348117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1491348117},{"type":"v1","addr":"172.21.15.89:6834","nonce":1491348117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/748490276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":748490276},{"type":"v1","addr":"172.21.15.89:6835","nonce":748490276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2260626922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2260626922},{"type":"v1","addr":"172.21.15.81:6835","nonce":2260626922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:44:18.798458+0000","modified":"2023-10-07T08:44:22.459128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5340":{"gid":5340,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2750584146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2750584146},{"type":"v1","addr":"172.21.15.81:6837","nonce":2750584146}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-07T08:44:53.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.791+0000 7ff107e2a700 1 -- 172.21.15.81:0/1615726099 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff0e4066f30 msgr2=0x7ff0e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.791+0000 7ff107e2a700 1 --2- 172.21.15.81:0/1615726099 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff0e4066f30 0x7ff0e40693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0075a0 tx=0x7ff0fc0097a0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.791+0000 7ff107e2a700 1 -- 172.21.15.81:0/1615726099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100157ca0 msgr2=0x7ff1001433b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.791+0000 7ff107e2a700 1 --2- 172.21.15.81:0/1615726099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100157ca0 0x7ff1001433b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800c810 tx=0x7ff0f8007d90 comp rx=0 tx=0).stop 2023-10-07T08:44:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.791+0000 7ff107e2a700 1 -- 172.21.15.81:0/1615726099 shutdown_connections 2023-10-07T08:44:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.791+0000 7ff107e2a700 1 --2- 172.21.15.81:0/1615726099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100157ca0 0x7ff1001433b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.791+0000 7ff107e2a700 1 --2- 172.21.15.81:0/1615726099 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff0e4066f30 0x7ff0e40693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.791+0000 7ff107e2a700 1 --2- 172.21.15.81:0/1615726099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff10006d120 0x7ff1000c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.791+0000 7ff107e2a700 1 --2- 172.21.15.81:0/1615726099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1001578d0 0x7ff1000c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.791+0000 7ff107e2a700 1 -- 172.21.15.81:0/1615726099 >> 172.21.15.81:0/1615726099 conn(0x7ff10006bb90 msgr2=0x7ff10006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.791+0000 7ff107e2a700 1 -- 172.21.15.81:0/1615726099 shutdown_connections 2023-10-07T08:44:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.791+0000 7ff107e2a700 1 -- 172.21.15.81:0/1615726099 wait complete. 2023-10-07T08:44:53.794 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2023-10-07T08:44:53.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:44:53.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.916+0000 7f6a409b4700 1 Processor -- start 2023-10-07T08:44:53.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.916+0000 7f6a409b4700 1 -- start start 2023-10-07T08:44:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.917+0000 7f6a409b4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a3c069440 0x7f6a3c0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.917+0000 7f6a409b4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a3c0c71d0 0x7f6a3c0c7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.917+0000 7f6a409b4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c0cb880 con 0x7f6a3c156420 2023-10-07T08:44:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.917+0000 7f6a409b4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3c06aa10 con 0x7f6a3c0c71d0 2023-10-07T08:44:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.917+0000 7f6a409b4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0c7b90 con 0x7f6a3c069440 2023-10-07T08:44:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.917+0000 7f6a3ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a3c0c71d0 0x7f6a3c0c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.917+0000 7f6a3ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a3c0c71d0 0x7f6a3c0c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46926/0 (socket says 172.21.15.81:46926) 2023-10-07T08:44:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.917+0000 7f6a3ad9d700 1 -- 172.21.15.81:0/3499499740 learned_addr learned my addr 172.21.15.81:0/3499499740 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.917+0000 7f6a31d9b700 1 --2- 172.21.15.81:0/3499499740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a3c069440 0x7f6a3c0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.918+0000 7f6a3ad9d700 1 -- 172.21.15.81:0/3499499740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a3c069440 msgr2=0x7f6a3c0698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.918+0000 7f6a3ad9d700 1 --2- 172.21.15.81:0/3499499740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a3c069440 0x7f6a3c0698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.918+0000 7f6a3ad9d700 1 -- 172.21.15.81:0/3499499740 >> v1:172.21.15.89:6789/0 conn(0x7f6a3c156420 legacy=0x7f6a3c0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.918+0000 7f6a3ad9d700 1 -- 172.21.15.81:0/3499499740 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0cac70 con 0x7f6a3c0c71d0 2023-10-07T08:44:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.918+0000 7f6a3ad9d700 1 --2- 172.21.15.81:0/3499499740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c0c71d0 0x7f6a3c0c7650 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400d1a0 tx=0x7f6a3400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a84f2311287b1a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.918+0000 7f6a39d9b700 1 -- 172.21.15.81:0/3499499740 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34010070 con 0x7f6a3c0c71d0 2023-10-07T08:44:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.918+0000 7f6a39d9b700 1 -- 172.21.15.81:0/3499499740 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3400de10 con 0x7f6a3c0c71d0 2023-10-07T08:44:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.918+0000 7f6a39d9b700 1 -- 172.21.15.81:0/3499499740 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3400b320 con 0x7f6a3c0c71d0 2023-10-07T08:44:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.918+0000 7f6a409b4700 1 -- 172.21.15.81:0/3499499740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c0c71d0 msgr2=0x7f6a3c0c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.918+0000 7f6a409b4700 1 --2- 172.21.15.81:0/3499499740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c0c71d0 0x7f6a3c0c7650 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400d1a0 tx=0x7f6a3400ba50 comp rx=0 tx=0).stop 2023-10-07T08:44:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.919+0000 7f6a409b4700 1 -- 172.21.15.81:0/3499499740 shutdown_connections 2023-10-07T08:44:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.919+0000 7f6a409b4700 1 --2- 172.21.15.81:0/3499499740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c0c71d0 0x7f6a3c0c7650 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.919+0000 7f6a409b4700 1 --2- 172.21.15.81:0/3499499740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a3c069440 0x7f6a3c0698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.919+0000 7f6a409b4700 1 -- 172.21.15.81:0/3499499740 >> 172.21.15.81:0/3499499740 conn(0x7f6a3c06c660 msgr2=0x7f6a3c0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.919+0000 7f6a409b4700 1 -- 172.21.15.81:0/3499499740 shutdown_connections 2023-10-07T08:44:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.919+0000 7f6a409b4700 1 -- 172.21.15.81:0/3499499740 wait complete. 2023-10-07T08:44:53.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.920+0000 7f6a409b4700 1 Processor -- start 2023-10-07T08:44:53.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.920+0000 7f6a409b4700 1 -- start start 2023-10-07T08:44:53.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.920+0000 7f6a409b4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a3c069440 0x7f6a3c151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.920+0000 7f6a409b4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a3c0c71d0 0x7f6a3c1569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.920+0000 7f6a409b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c156420 0x7f6a3c156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.920+0000 7f6a409b4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0c6880 con 0x7f6a3c156420 2023-10-07T08:44:53.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.920+0000 7f6a409b4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c165de0 con 0x7f6a3c069440 2023-10-07T08:44:53.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.920+0000 7f6a409b4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0c5d00 con 0x7f6a3c0c71d0 2023-10-07T08:44:53.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a3ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c156420 0x7f6a3c156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a3ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c156420 0x7f6a3c156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46934/0 (socket says 172.21.15.81:46934) 2023-10-07T08:44:53.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a3ad9d700 1 -- 172.21.15.81:0/3893164311 learned_addr learned my addr 172.21.15.81:0/3893164311 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:53.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a31d9b700 1 --2- 172.21.15.81:0/3893164311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a3c0c71d0 0x7f6a3c1569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a3a59c700 1 --2- 172.21.15.81:0/3893164311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a3c069440 0x7f6a3c151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a3ad9d700 1 -- 172.21.15.81:0/3893164311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a3c0c71d0 msgr2=0x7f6a3c1569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a3ad9d700 1 --2- 172.21.15.81:0/3893164311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a3c0c71d0 0x7f6a3c1569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a3ad9d700 1 -- 172.21.15.81:0/3893164311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a3c069440 msgr2=0x7f6a3c151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a3ad9d700 1 --2- 172.21.15.81:0/3893164311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a3c069440 0x7f6a3c151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a3ad9d700 1 -- 172.21.15.81:0/3893164311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3400bcf0 con 0x7f6a3c156420 2023-10-07T08:44:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a3a59c700 1 --2- 172.21.15.81:0/3893164311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a3c069440 0x7f6a3c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a3ad9d700 1 --2- 172.21.15.81:0/3893164311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c156420 0x7f6a3c156ee0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c064700 tx=0x7f6a3401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a32ffd700 1 -- 172.21.15.81:0/3893164311 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3400acb0 con 0x7f6a3c156420 2023-10-07T08:44:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a32ffd700 1 -- 172.21.15.81:0/3893164311 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3400ae10 con 0x7f6a3c156420 2023-10-07T08:44:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a32ffd700 1 -- 172.21.15.81:0/3893164311 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a340286b0 con 0x7f6a3c156420 2023-10-07T08:44:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a409b4700 1 -- 172.21.15.81:0/3893164311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3c0c5fe0 con 0x7f6a3c156420 2023-10-07T08:44:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.921+0000 7f6a409b4700 1 -- 172.21.15.81:0/3893164311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3c0c65a0 con 0x7f6a3c156420 2023-10-07T08:44:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.922+0000 7f6a409b4700 1 -- 172.21.15.81:0/3893164311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3c165f50 con 0x7f6a3c156420 2023-10-07T08:44:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.922+0000 7f6a32ffd700 1 -- 172.21.15.81:0/3893164311 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a34003040 con 0x7f6a3c156420 2023-10-07T08:44:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.923+0000 7f6a32ffd700 1 --2- 172.21.15.81:0/3893164311 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a1c066f30 0x7f6a1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.923+0000 7f6a3a59c700 1 --2- 172.21.15.81:0/3893164311 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a1c066f30 0x7f6a1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.923+0000 7f6a32ffd700 1 -- 172.21.15.81:0/3893164311 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f6a340886d0 con 0x7f6a3c156420 2023-10-07T08:44:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.923+0000 7f6a3a59c700 1 --2- 172.21.15.81:0/3893164311 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a1c066f30 0x7f6a1c0693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c007fd0 tx=0x7f6a2c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:53.927+0000 7f6a32ffd700 1 -- 172.21.15.81:0/3893164311 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a3c165f50 con 0x7f6a3c156420 2023-10-07T08:44:54.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.111+0000 7f6a409b4700 1 -- 172.21.15.81:0/3893164311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a3c165f50 con 0x7f6a3c156420 2023-10-07T08:44:54.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.112+0000 7f6a32ffd700 1 -- 172.21.15.81:0/3893164311 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+15397 (secure 0 0 0) 0x7f6a3c165f50 con 0x7f6a3c156420 2023-10-07T08:44:54.113 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:44:54.113 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":55,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:44:48.276572+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:44:17.114223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-07T08:44:17.763615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:44:54.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.114+0000 7f6a409b4700 1 -- 172.21.15.81:0/3893164311 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a1c066f30 msgr2=0x7f6a1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:54.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.114+0000 7f6a409b4700 1 --2- 172.21.15.81:0/3893164311 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a1c066f30 0x7f6a1c0693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c007fd0 tx=0x7f6a2c009040 comp rx=0 tx=0).stop 2023-10-07T08:44:54.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.114+0000 7f6a409b4700 1 -- 172.21.15.81:0/3893164311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c156420 msgr2=0x7f6a3c156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:54.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.114+0000 7f6a409b4700 1 --2- 172.21.15.81:0/3893164311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c156420 0x7f6a3c156ee0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c064700 tx=0x7f6a3401a000 comp rx=0 tx=0).stop 2023-10-07T08:44:54.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.114+0000 7f6a409b4700 1 -- 172.21.15.81:0/3893164311 shutdown_connections 2023-10-07T08:44:54.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.114+0000 7f6a409b4700 1 --2- 172.21.15.81:0/3893164311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c156420 0x7f6a3c156ee0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.114+0000 7f6a409b4700 1 --2- 172.21.15.81:0/3893164311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a3c069440 0x7f6a3c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.114+0000 7f6a409b4700 1 --2- 172.21.15.81:0/3893164311 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a1c066f30 0x7f6a1c0693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.114+0000 7f6a409b4700 1 --2- 172.21.15.81:0/3893164311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a3c0c71d0 0x7f6a3c1569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.114+0000 7f6a409b4700 1 -- 172.21.15.81:0/3893164311 >> 172.21.15.81:0/3893164311 conn(0x7f6a3c06c660 msgr2=0x7f6a3c06e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:54.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.114+0000 7f6a409b4700 1 -- 172.21.15.81:0/3893164311 shutdown_connections 2023-10-07T08:44:54.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.114+0000 7f6a409b4700 1 -- 172.21.15.81:0/3893164311 wait complete. 2023-10-07T08:44:54.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T08:44:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.242+0000 7fb59a6fa700 1 Processor -- start 2023-10-07T08:44:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.242+0000 7fb59a6fa700 1 -- start start 2023-10-07T08:44:54.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.243+0000 7fb59a6fa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb594159b40 0x7fb5940cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:54.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.243+0000 7fb59a6fa700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb594068e90 0x7fb5940cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.243+0000 7fb59a6fa700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5940cee10 con 0x7fb594159f10 2023-10-07T08:44:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.243+0000 7fb59a6fa700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5940cd040 con 0x7fb594068e90 2023-10-07T08:44:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.243+0000 7fb59a6fa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5940cd320 con 0x7fb594159b40 2023-10-07T08:44:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.243+0000 7fb598ef7700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb594159f10 0x7fb594068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33216/0 (socket says 172.21.15.81:33216) 2023-10-07T08:44:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.243+0000 7fb598ef7700 1 -- 172.21.15.81:0/2143575639 learned_addr learned my addr 172.21.15.81:0/2143575639 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.243+0000 7fb5996f8700 1 --2- 172.21.15.81:0/2143575639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb594159b40 0x7fb5940cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.243+0000 7fb58bfff700 1 -- 172.21.15.81:0/2143575639 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231427680 0 0) 0x7fb5940cee10 con 0x7fb594159f10 2023-10-07T08:44:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.243+0000 7fb599ef9700 1 --2- 172.21.15.81:0/2143575639 >> v2:172.21.15.89:3300/0 conn(0x7fb594068e90 0x7fb5940cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.243+0000 7fb58bfff700 1 -- 172.21.15.81:0/2143575639 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb580003570 con 0x7fb594159f10 2023-10-07T08:44:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 -- 172.21.15.81:0/2143575639 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2054513251 0 0) 0x7fb580003570 con 0x7fb594159f10 2023-10-07T08:44:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 -- 172.21.15.81:0/2143575639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb594159b40 msgr2=0x7fb5940cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 --2- 172.21.15.81:0/2143575639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb594159b40 0x7fb5940cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 -- 172.21.15.81:0/2143575639 >> v2:172.21.15.89:3300/0 conn(0x7fb594068e90 msgr2=0x7fb5940cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 --2- 172.21.15.81:0/2143575639 >> v2:172.21.15.89:3300/0 conn(0x7fb594068e90 0x7fb5940cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 -- 172.21.15.81:0/2143575639 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5940ce7c0 con 0x7fb594159f10 2023-10-07T08:44:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 -- 172.21.15.81:0/2143575639 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fb584001470 con 0x7fb594159f10 2023-10-07T08:44:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 -- 172.21.15.81:0/2143575639 >> v1:172.21.15.81:6789/0 conn(0x7fb594159f10 legacy=0x7fb594068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 --2- 172.21.15.81:0/2143575639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb580003a60 0x7fb580003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 --2- 172.21.15.81:0/2143575639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb594159b40 0x7fb580004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 --2- 172.21.15.81:0/2143575639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb580004d50 0x7fb5800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 -- 172.21.15.81:0/2143575639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5940cd040 con 0x7fb580004d50 2023-10-07T08:44:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 -- 172.21.15.81:0/2143575639 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5940cd320 con 0x7fb580003a60 2023-10-07T08:44:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 -- 172.21.15.81:0/2143575639 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58000ba60 con 0x7fb594159b40 2023-10-07T08:44:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb599ef9700 1 --2- 172.21.15.81:0/2143575639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb580004d50 0x7fb5800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:54.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb5996f8700 1 --2- 172.21.15.81:0/2143575639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb580003a60 0x7fb580003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:54.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb598ef7700 1 --2- 172.21.15.81:0/2143575639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb594159b40 0x7fb580004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:54.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb599ef9700 1 -- 172.21.15.81:0/2143575639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb594159b40 msgr2=0x7fb580004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:54.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb599ef9700 1 --2- 172.21.15.81:0/2143575639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb594159b40 0x7fb580004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb599ef9700 1 -- 172.21.15.81:0/2143575639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb580003a60 msgr2=0x7fb580003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:54.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb599ef9700 1 --2- 172.21.15.81:0/2143575639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb580003a60 0x7fb580003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb599ef9700 1 -- 172.21.15.81:0/2143575639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb580003570 con 0x7fb580004d50 2023-10-07T08:44:54.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb599ef9700 1 --2- 172.21.15.81:0/2143575639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb580004d50 0x7fb5800051c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb594069290 tx=0x7fb58c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea14ae9c3f8886f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:54.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 -- 172.21.15.81:0/2143575639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c00e6b0 con 0x7fb580004d50 2023-10-07T08:44:54.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 -- 172.21.15.81:0/2143575639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c00e810 con 0x7fb580004d50 2023-10-07T08:44:54.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.244+0000 7fb58bfff700 1 -- 172.21.15.81:0/2143575639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c00ebd0 con 0x7fb580004d50 2023-10-07T08:44:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.245+0000 7fb59a6fa700 1 -- 172.21.15.81:0/2143575639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb580004d50 msgr2=0x7fb5800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.245+0000 7fb59a6fa700 1 --2- 172.21.15.81:0/2143575639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb580004d50 0x7fb5800051c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb594069290 tx=0x7fb58c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.245+0000 7fb599ef9700 1 -- 172.21.15.81:0/2143575639 reap_dead start 2023-10-07T08:44:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.245+0000 7fb59a6fa700 1 -- 172.21.15.81:0/2143575639 shutdown_connections 2023-10-07T08:44:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.245+0000 7fb59a6fa700 1 -- 172.21.15.81:0/2143575639 >> 172.21.15.81:0/2143575639 conn(0x7fb5940cd660 msgr2=0x7fb5940cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.245+0000 7fb59a6fa700 1 -- 172.21.15.81:0/2143575639 shutdown_connections 2023-10-07T08:44:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.245+0000 7fb59a6fa700 1 -- 172.21.15.81:0/2143575639 wait complete. 2023-10-07T08:44:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.246+0000 7fb59a6fa700 1 Processor -- start 2023-10-07T08:44:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.246+0000 7fb59a6fa700 1 -- start start 2023-10-07T08:44:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb59a6fa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5940aaae0 0x7fb5940c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb59a6fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb594156290 0x7fb594147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb59a6fa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5940aaeb0 0x7fb594147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb59a6fa700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5941480d0 con 0x7fb594156290 2023-10-07T08:44:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb59a6fa700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb594156800 con 0x7fb5940aaeb0 2023-10-07T08:44:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb59a6fa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb594156ae0 con 0x7fb5940aaae0 2023-10-07T08:44:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb598ef7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb594156290 0x7fb594147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb598ef7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb594156290 0x7fb594147650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46946/0 (socket says 172.21.15.81:46946) 2023-10-07T08:44:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb598ef7700 1 -- 172.21.15.81:0/1506394489 learned_addr learned my addr 172.21.15.81:0/1506394489 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb5996f8700 1 --2- 172.21.15.81:0/1506394489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5940aaae0 0x7fb5940c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb599ef9700 1 --2- 172.21.15.81:0/1506394489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5940aaeb0 0x7fb594147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb598ef7700 1 -- 172.21.15.81:0/1506394489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5940aaae0 msgr2=0x7fb5940c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb598ef7700 1 --2- 172.21.15.81:0/1506394489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5940aaae0 0x7fb5940c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb598ef7700 1 -- 172.21.15.81:0/1506394489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5940aaeb0 msgr2=0x7fb594147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb598ef7700 1 --2- 172.21.15.81:0/1506394489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5940aaeb0 0x7fb594147b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb598ef7700 1 -- 172.21.15.81:0/1506394489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb594156dc0 con 0x7fb594156290 2023-10-07T08:44:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.247+0000 7fb599ef9700 1 --2- 172.21.15.81:0/1506394489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5940aaeb0 0x7fb594147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.248+0000 7fb598ef7700 1 --2- 172.21.15.81:0/1506394489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb594156290 0x7fb594147650 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb5840079e0 tx=0x7fb584001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.248+0000 7fb5897fa700 1 -- 172.21.15.81:0/1506394489 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb584018030 con 0x7fb594156290 2023-10-07T08:44:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.248+0000 7fb5897fa700 1 -- 172.21.15.81:0/1506394489 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58400f8a0 con 0x7fb594156290 2023-10-07T08:44:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.248+0000 7fb59a6fa700 1 -- 172.21.15.81:0/1506394489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5941570a0 con 0x7fb594156290 2023-10-07T08:44:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.248+0000 7fb5897fa700 1 -- 172.21.15.81:0/1506394489 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58400fc60 con 0x7fb594156290 2023-10-07T08:44:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.248+0000 7fb59a6fa700 1 -- 172.21.15.81:0/1506394489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5940ca500 con 0x7fb594156290 2023-10-07T08:44:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.249+0000 7fb59a6fa700 1 -- 172.21.15.81:0/1506394489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5941575c0 con 0x7fb594156290 2023-10-07T08:44:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.249+0000 7fb5897fa700 1 -- 172.21.15.81:0/1506394489 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb58401b070 con 0x7fb594156290 2023-10-07T08:44:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.249+0000 7fb5897fa700 1 --2- 172.21.15.81:0/1506394489 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb578066f30 0x7fb5780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:54.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.249+0000 7fb5996f8700 1 --2- 172.21.15.81:0/1506394489 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb578066f30 0x7fb5780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:54.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.250+0000 7fb5897fa700 1 -- 172.21.15.81:0/1506394489 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fb584019070 con 0x7fb594156290 2023-10-07T08:44:54.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.250+0000 7fb5996f8700 1 --2- 172.21.15.81:0/1506394489 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb578066f30 0x7fb5780693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb5900094d0 tx=0x7fb59000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:54.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.254+0000 7fb5897fa700 1 -- 172.21.15.81:0/1506394489 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5941575c0 con 0x7fb594156290 2023-10-07T08:44:54.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.481+0000 7fb59a6fa700 1 -- 172.21.15.81:0/1506394489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb5941575c0 con 0x7fb594156290 2023-10-07T08:44:54.484 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:44:54.482+0000 7f43c472d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T08:44:54.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.487+0000 7fb5897fa700 1 -- 172.21.15.81:0/1506394489 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb5941575c0 con 0x7fb594156290 2023-10-07T08:44:54.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.489+0000 7fb59a6fa700 1 -- 172.21.15.81:0/1506394489 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb578066f30 msgr2=0x7fb5780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:54.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.489+0000 7fb59a6fa700 1 --2- 172.21.15.81:0/1506394489 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb578066f30 0x7fb5780693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb5900094d0 tx=0x7fb59000b040 comp rx=0 tx=0).stop 2023-10-07T08:44:54.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.489+0000 7fb59a6fa700 1 -- 172.21.15.81:0/1506394489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb594156290 msgr2=0x7fb594147650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:54.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.489+0000 7fb59a6fa700 1 --2- 172.21.15.81:0/1506394489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb594156290 0x7fb594147650 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb5840079e0 tx=0x7fb584001e90 comp rx=0 tx=0).stop 2023-10-07T08:44:54.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.489+0000 7fb59a6fa700 1 -- 172.21.15.81:0/1506394489 shutdown_connections 2023-10-07T08:44:54.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.489+0000 7fb59a6fa700 1 --2- 172.21.15.81:0/1506394489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5940aaeb0 0x7fb594147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.489+0000 7fb59a6fa700 1 --2- 172.21.15.81:0/1506394489 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb578066f30 0x7fb5780693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.489+0000 7fb59a6fa700 1 --2- 172.21.15.81:0/1506394489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5940aaae0 0x7fb5940c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.489+0000 7fb59a6fa700 1 --2- 172.21.15.81:0/1506394489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb594156290 0x7fb594147650 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.489+0000 7fb59a6fa700 1 -- 172.21.15.81:0/1506394489 >> 172.21.15.81:0/1506394489 conn(0x7fb5940cd660 msgr2=0x7fb59406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:54.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.489+0000 7fb59a6fa700 1 -- 172.21.15.81:0/1506394489 shutdown_connections 2023-10-07T08:44:54.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.489+0000 7fb59a6fa700 1 -- 172.21.15.81:0/1506394489 wait complete. 2023-10-07T08:44:54.492 INFO:tasks.ceph.mds.a.smithi081.stderr: -9053> 2023-10-07T08:44:24.396+0000 7fc9a730b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:44:54.492 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T08:44:54.503 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T08:44:54.520 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-07T08:44:54.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.618+0000 7f5f3f828700 1 Processor -- start 2023-10-07T08:44:54.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.618+0000 7f5f3f828700 1 -- start start 2023-10-07T08:44:54.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.619+0000 7f5f3f828700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5f38157fe0 0x7f5f380b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:54.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.619+0000 7f5f3f828700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f380cf240 0x7f5f380b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.619+0000 7f5f3f828700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f380b2890 con 0x7f5f381583b0 2023-10-07T08:44:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.619+0000 7f5f3f828700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f380b4070 con 0x7f5f38157fe0 2023-10-07T08:44:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.619+0000 7f5f3f828700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380b4350 con 0x7f5f380cf240 2023-10-07T08:44:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.619+0000 7f5f3cdc3700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5f381583b0 0x7f5f380ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33226/0 (socket says 172.21.15.81:33226) 2023-10-07T08:44:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.619+0000 7f5f3cdc3700 1 -- 172.21.15.81:0/4281278472 learned_addr learned my addr 172.21.15.81:0/4281278472 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.620+0000 7f5f3d5c4700 1 --2- 172.21.15.81:0/4281278472 >> v2:172.21.15.89:3300/0 conn(0x7f5f38157fe0 0x7f5f380b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.620+0000 7f5f3ddc5700 1 --2- 172.21.15.81:0/4281278472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f380cf240 0x7f5f380b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.620+0000 7f5f2ffff700 1 -- 172.21.15.81:0/4281278472 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015379730 0 0) 0x7f5f380b2890 con 0x7f5f381583b0 2023-10-07T08:44:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.620+0000 7f5f2ffff700 1 -- 172.21.15.81:0/4281278472 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f24003570 con 0x7f5f381583b0 2023-10-07T08:44:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.620+0000 7f5f3d5c4700 1 -- 172.21.15.81:0/4281278472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f380cf240 msgr2=0x7f5f380b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.620+0000 7f5f3d5c4700 1 --2- 172.21.15.81:0/4281278472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f380cf240 0x7f5f380b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.620+0000 7f5f3d5c4700 1 -- 172.21.15.81:0/4281278472 >> v1:172.21.15.81:6789/0 conn(0x7f5f381583b0 legacy=0x7f5f380ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.620+0000 7f5f2ffff700 1 -- 172.21.15.81:0/4281278472 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1820121622 0 0) 0x7f5f24003570 con 0x7f5f381583b0 2023-10-07T08:44:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.620+0000 7f5f3d5c4700 1 -- 172.21.15.81:0/4281278472 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f380b4630 con 0x7f5f38157fe0 2023-10-07T08:44:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.620+0000 7f5f3d5c4700 1 --2- 172.21.15.81:0/4281278472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f38157fe0 0x7f5f380b34c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5f340098e0 tx=0x7f5f340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9db16e99e0e533d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.620+0000 7f5f2ffff700 1 -- 172.21.15.81:0/4281278472 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28001470 con 0x7f5f38157fe0 2023-10-07T08:44:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.620+0000 7f5f2ffff700 1 -- 172.21.15.81:0/4281278472 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f34011420 con 0x7f5f38157fe0 2023-10-07T08:44:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.620+0000 7f5f2ffff700 1 -- 172.21.15.81:0/4281278472 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f340117c0 con 0x7f5f38157fe0 2023-10-07T08:44:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.621+0000 7f5f3f828700 1 -- 172.21.15.81:0/4281278472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f38157fe0 msgr2=0x7f5f380b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.621+0000 7f5f3f828700 1 --2- 172.21.15.81:0/4281278472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f38157fe0 0x7f5f380b34c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5f340098e0 tx=0x7f5f340091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.621+0000 7f5f3f828700 1 -- 172.21.15.81:0/4281278472 shutdown_connections 2023-10-07T08:44:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.621+0000 7f5f3f828700 1 --2- 172.21.15.81:0/4281278472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f38157fe0 0x7f5f380b34c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.621+0000 7f5f3f828700 1 --2- 172.21.15.81:0/4281278472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f380cf240 0x7f5f380b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.621+0000 7f5f3f828700 1 -- 172.21.15.81:0/4281278472 >> 172.21.15.81:0/4281278472 conn(0x7f5f38067640 msgr2=0x7f5f38067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.621+0000 7f5f3f828700 1 -- 172.21.15.81:0/4281278472 shutdown_connections 2023-10-07T08:44:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.621+0000 7f5f3f828700 1 -- 172.21.15.81:0/4281278472 wait complete. 2023-10-07T08:44:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.622+0000 7f5f3f828700 1 Processor -- start 2023-10-07T08:44:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.622+0000 7f5f3f828700 1 -- start start 2023-10-07T08:44:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3f828700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f380cf240 0x7f5f3816dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3f828700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f38157fe0 0x7f5f38159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3f828700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f381583b0 0x7f5f3814bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3f828700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3816e150 con 0x7f5f380cf240 2023-10-07T08:44:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3f828700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3806d750 con 0x7f5f381583b0 2023-10-07T08:44:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3f828700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3806da30 con 0x7f5f38157fe0 2023-10-07T08:44:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3d5c4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f380cf240 0x7f5f3816dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3d5c4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f380cf240 0x7f5f3816dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46968/0 (socket says 172.21.15.81:46968) 2023-10-07T08:44:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3d5c4700 1 -- 172.21.15.81:0/275145312 learned_addr learned my addr 172.21.15.81:0/275145312 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3ddc5700 1 --2- 172.21.15.81:0/275145312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f381583b0 0x7f5f3814bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3cdc3700 1 --2- 172.21.15.81:0/275145312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f38157fe0 0x7f5f38159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3d5c4700 1 -- 172.21.15.81:0/275145312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f38157fe0 msgr2=0x7f5f38159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3d5c4700 1 --2- 172.21.15.81:0/275145312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f38157fe0 0x7f5f38159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3d5c4700 1 -- 172.21.15.81:0/275145312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f381583b0 msgr2=0x7f5f3814bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3d5c4700 1 --2- 172.21.15.81:0/275145312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f381583b0 0x7f5f3814bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3d5c4700 1 -- 172.21.15.81:0/275145312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f34009420 con 0x7f5f380cf240 2023-10-07T08:44:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3ddc5700 1 --2- 172.21.15.81:0/275145312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f381583b0 0x7f5f3814bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:44:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.623+0000 7f5f3d5c4700 1 --2- 172.21.15.81:0/275145312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f380cf240 0x7f5f3816dc10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5f340030c0 tx=0x7f5f34016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.624+0000 7f5f2d7fa700 1 -- 172.21.15.81:0/275145312 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34000d10 con 0x7f5f380cf240 2023-10-07T08:44:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.624+0000 7f5f2d7fa700 1 -- 172.21.15.81:0/275145312 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3401cb30 con 0x7f5f380cf240 2023-10-07T08:44:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.624+0000 7f5f3f828700 1 -- 172.21.15.81:0/275145312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3806dd10 con 0x7f5f380cf240 2023-10-07T08:44:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.624+0000 7f5f2d7fa700 1 -- 172.21.15.81:0/275145312 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3401a450 con 0x7f5f380cf240 2023-10-07T08:44:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.624+0000 7f5f3f828700 1 -- 172.21.15.81:0/275145312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3806e2d0 con 0x7f5f380cf240 2023-10-07T08:44:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.624+0000 7f5f3f828700 1 -- 172.21.15.81:0/275145312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f38069e40 con 0x7f5f380cf240 2023-10-07T08:44:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.625+0000 7f5f2d7fa700 1 -- 172.21.15.81:0/275145312 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f3401a840 con 0x7f5f380cf240 2023-10-07T08:44:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.625+0000 7f5f2d7fa700 1 --2- 172.21.15.81:0/275145312 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5f1c066f30 0x7f5f1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.625+0000 7f5f2d7fa700 1 -- 172.21.15.81:0/275145312 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f5f34085dc0 con 0x7f5f380cf240 2023-10-07T08:44:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.625+0000 7f5f3cdc3700 1 --2- 172.21.15.81:0/275145312 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5f1c066f30 0x7f5f1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.626+0000 7f5f3cdc3700 1 --2- 172.21.15.81:0/275145312 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5f1c066f30 0x7f5f1c0693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5f3815b9a0 tx=0x7f5f28001aa0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:54.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.630+0000 7f5f2d7fa700 1 -- 172.21.15.81:0/275145312 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f34052fa0 con 0x7f5f380cf240 2023-10-07T08:44:54.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:54.854+0000 7f5f3f828700 1 -- 172.21.15.81:0/275145312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5f380b32b0 con 0x7f5f380cf240 2023-10-07T08:44:55.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:44:55.112 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:44:55.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.486+0000 7f5f2d7fa700 1 -- 172.21.15.81:0/275145312 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5f340565c0 con 0x7f5f380cf240 2023-10-07T08:44:55.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.489+0000 7f5f3f828700 1 -- 172.21.15.81:0/275145312 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5f1c066f30 msgr2=0x7f5f1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:55.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.489+0000 7f5f3f828700 1 --2- 172.21.15.81:0/275145312 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5f1c066f30 0x7f5f1c0693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5f3815b9a0 tx=0x7f5f28001aa0 comp rx=0 tx=0).stop 2023-10-07T08:44:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.489+0000 7f5f3f828700 1 -- 172.21.15.81:0/275145312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f380cf240 msgr2=0x7f5f3816dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.489+0000 7f5f3f828700 1 --2- 172.21.15.81:0/275145312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f380cf240 0x7f5f3816dc10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5f340030c0 tx=0x7f5f34016000 comp rx=0 tx=0).stop 2023-10-07T08:44:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.489+0000 7f5f3f828700 1 -- 172.21.15.81:0/275145312 shutdown_connections 2023-10-07T08:44:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.489+0000 7f5f3f828700 1 --2- 172.21.15.81:0/275145312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f381583b0 0x7f5f3814bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.489+0000 7f5f3f828700 1 --2- 172.21.15.81:0/275145312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f380cf240 0x7f5f3816dc10 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.489+0000 7f5f3f828700 1 --2- 172.21.15.81:0/275145312 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5f1c066f30 0x7f5f1c0693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.489+0000 7f5f3f828700 1 --2- 172.21.15.81:0/275145312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f38157fe0 0x7f5f38159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.489+0000 7f5f3f828700 1 -- 172.21.15.81:0/275145312 >> 172.21.15.81:0/275145312 conn(0x7f5f38067640 msgr2=0x7f5f380ce170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.489+0000 7f5f3f828700 1 -- 172.21.15.81:0/275145312 shutdown_connections 2023-10-07T08:44:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.489+0000 7f5f3f828700 1 -- 172.21.15.81:0/275145312 wait complete. 2023-10-07T08:44:55.503 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T08:44:55.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.620+0000 7fb8c00ad700 1 Processor -- start 2023-10-07T08:44:55.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.621+0000 7fb8c00ad700 1 -- start start 2023-10-07T08:44:55.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.621+0000 7fb8c00ad700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb8b80aacf0 0x7fb8b806e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:55.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.621+0000 7fb8c00ad700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b80acc80 con 0x7fb8b80ce5c0 2023-10-07T08:44:55.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.621+0000 7fb8c00ad700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b80ab150 con 0x7fb8b80ce1f0 2023-10-07T08:44:55.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.621+0000 7fb8c00ad700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b815dfb0 con 0x7fb8b80aacf0 2023-10-07T08:44:55.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.621+0000 7fb8bd648700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb8b80ce5c0 0x7fb8b80ac570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33230/0 (socket says 172.21.15.81:33230) 2023-10-07T08:44:55.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.621+0000 7fb8bd648700 1 -- 172.21.15.81:0/1228594840 learned_addr learned my addr 172.21.15.81:0/1228594840 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:55.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8be64a700 1 --2- 172.21.15.81:0/1228594840 >> v2:172.21.15.89:3300/0 conn(0x7fb8b80aacf0 0x7fb8b806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:55.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bce47700 1 -- 172.21.15.81:0/1228594840 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126129151 0 0) 0x7fb8a8001110 con 0x7fb8b80ce5c0 2023-10-07T08:44:55.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bce47700 1 -- 172.21.15.81:0/1228594840 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8a4003570 con 0x7fb8b80ce5c0 2023-10-07T08:44:55.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bce47700 1 -- 172.21.15.81:0/1228594840 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1741725082 0 0) 0x7fb8a4003570 con 0x7fb8b80ce5c0 2023-10-07T08:44:55.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bce47700 1 -- 172.21.15.81:0/1228594840 >> v2:172.21.15.89:3300/0 conn(0x7fb8b80aacf0 msgr2=0x7fb8b806e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:55.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bce47700 1 --2- 172.21.15.81:0/1228594840 >> v2:172.21.15.89:3300/0 conn(0x7fb8b80aacf0 0x7fb8b806e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:55.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bce47700 1 -- 172.21.15.81:0/1228594840 >> v1:172.21.15.89:6789/0 conn(0x7fb8b80ce1f0 legacy=0x7fb8b815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:55.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bce47700 1 -- 172.21.15.81:0/1228594840 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b80acec0 con 0x7fb8b80ce5c0 2023-10-07T08:44:55.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bce47700 1 -- 172.21.15.81:0/1228594840 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fb8a8001600 con 0x7fb8b80ce5c0 2023-10-07T08:44:55.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bce47700 1 -- 172.21.15.81:0/1228594840 >> v1:172.21.15.81:6789/0 conn(0x7fb8b80ce5c0 legacy=0x7fb8b80ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:55.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bce47700 1 --2- 172.21.15.81:0/1228594840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8a4003a60 0x7fb8a4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:55.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bce47700 1 --2- 172.21.15.81:0/1228594840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a4004810 0x7fb8a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:55.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bce47700 1 --2- 172.21.15.81:0/1228594840 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8a40051c0 0x7fb8a400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:55.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bce47700 1 -- 172.21.15.81:0/1228594840 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b815dfb0 con 0x7fb8a4004810 2023-10-07T08:44:55.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bce47700 1 -- 172.21.15.81:0/1228594840 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a400c050 con 0x7fb8a4003a60 2023-10-07T08:44:55.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bce47700 1 -- 172.21.15.81:0/1228594840 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a400c210 con 0x7fb8a40051c0 2023-10-07T08:44:55.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bd648700 1 --2- 172.21.15.81:0/1228594840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a4004810 0x7fb8a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:55.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bde49700 1 --2- 172.21.15.81:0/1228594840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8a4003a60 0x7fb8a4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:55.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8be64a700 1 --2- 172.21.15.81:0/1228594840 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8a40051c0 0x7fb8a400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:55.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bd648700 1 -- 172.21.15.81:0/1228594840 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8a40051c0 msgr2=0x7fb8a400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:55.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bd648700 1 --2- 172.21.15.81:0/1228594840 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8a40051c0 0x7fb8a400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.622+0000 7fb8bd648700 1 -- 172.21.15.81:0/1228594840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8a4003a60 msgr2=0x7fb8a4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.623+0000 7fb8bd648700 1 --2- 172.21.15.81:0/1228594840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8a4003a60 0x7fb8a4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.623+0000 7fb8be64a700 1 -- 172.21.15.81:0/1228594840 reap_dead start 2023-10-07T08:44:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.623+0000 7fb8bd648700 1 -- 172.21.15.81:0/1228594840 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a4003570 con 0x7fb8a4004810 2023-10-07T08:44:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.623+0000 7fb8bd648700 1 --2- 172.21.15.81:0/1228594840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a4004810 0x7fb8a4004c80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800c5f0 tx=0x7fb8a8007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f622de04fdf1d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.623+0000 7fb8bce47700 1 -- 172.21.15.81:0/1228594840 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a800cd70 con 0x7fb8a4004810 2023-10-07T08:44:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.623+0000 7fb8bce47700 1 -- 172.21.15.81:0/1228594840 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a8005920 con 0x7fb8a4004810 2023-10-07T08:44:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.623+0000 7fb8bce47700 1 -- 172.21.15.81:0/1228594840 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8005ce0 con 0x7fb8a4004810 2023-10-07T08:44:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.623+0000 7fb8c00ad700 1 -- 172.21.15.81:0/1228594840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a4004810 msgr2=0x7fb8a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.623+0000 7fb8c00ad700 1 --2- 172.21.15.81:0/1228594840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a4004810 0x7fb8a4004c80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800c5f0 tx=0x7fb8a8007a50 comp rx=0 tx=0).stop 2023-10-07T08:44:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.623+0000 7fb8c00ad700 1 -- 172.21.15.81:0/1228594840 shutdown_connections 2023-10-07T08:44:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.623+0000 7fb8c00ad700 1 --2- 172.21.15.81:0/1228594840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a4004810 0x7fb8a4004c80 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:55.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.623+0000 7fb8c00ad700 1 -- 172.21.15.81:0/1228594840 >> 172.21.15.81:0/1228594840 conn(0x7fb8b806cca0 msgr2=0x7fb8b806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:55.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.623+0000 7fb8c00ad700 1 -- 172.21.15.81:0/1228594840 shutdown_connections 2023-10-07T08:44:55.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.623+0000 7fb8c00ad700 1 -- 172.21.15.81:0/1228594840 wait complete. 2023-10-07T08:44:55.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.624+0000 7fb8c00ad700 1 Processor -- start 2023-10-07T08:44:55.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.625+0000 7fb8c00ad700 1 -- start start 2023-10-07T08:44:55.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.625+0000 7fb8c00ad700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8a4004810 0x7fb8b815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:55.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.625+0000 7fb8c00ad700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8b815c330 0x7fb8b815c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:55.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.625+0000 7fb8c00ad700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b816a820 0x7fb8b816acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:55.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.625+0000 7fb8c00ad700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b815cce0 con 0x7fb8b816a820 2023-10-07T08:44:55.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.625+0000 7fb8c00ad700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b815a9c0 con 0x7fb8a4004810 2023-10-07T08:44:55.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.625+0000 7fb8c00ad700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b815aca0 con 0x7fb8b815c330 2023-10-07T08:44:55.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.625+0000 7fb8be64a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b816a820 0x7fb8b816acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:55.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.625+0000 7fb8be64a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b816a820 0x7fb8b816acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46976/0 (socket says 172.21.15.81:46976) 2023-10-07T08:44:55.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.625+0000 7fb8be64a700 1 -- 172.21.15.81:0/744920828 learned_addr learned my addr 172.21.15.81:0/744920828 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:55.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.625+0000 7fb8be64a700 1 -- 172.21.15.81:0/744920828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8b815c330 msgr2=0x7fb8b815c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:55.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.625+0000 7fb8be64a700 1 --2- 172.21.15.81:0/744920828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8b815c330 0x7fb8b815c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:55.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.626+0000 7fb8be64a700 1 -- 172.21.15.81:0/744920828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8a4004810 msgr2=0x7fb8b815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:55.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.626+0000 7fb8be64a700 1 --2- 172.21.15.81:0/744920828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8a4004810 0x7fb8b815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:55.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.626+0000 7fb8be64a700 1 -- 172.21.15.81:0/744920828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b815af80 con 0x7fb8b816a820 2023-10-07T08:44:55.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.626+0000 7fb8be64a700 1 --2- 172.21.15.81:0/744920828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b816a820 0x7fb8b816acc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb8b815da20 tx=0x7fb8b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:55.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.626+0000 7fb8adffb700 1 -- 172.21.15.81:0/744920828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b000e040 con 0x7fb8b816a820 2023-10-07T08:44:55.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.626+0000 7fb8adffb700 1 -- 172.21.15.81:0/744920828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b000f040 con 0x7fb8b816a820 2023-10-07T08:44:55.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.626+0000 7fb8c00ad700 1 -- 172.21.15.81:0/744920828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b815b260 con 0x7fb8b816a820 2023-10-07T08:44:55.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.626+0000 7fb8adffb700 1 -- 172.21.15.81:0/744920828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b000fdc0 con 0x7fb8b816a820 2023-10-07T08:44:55.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.626+0000 7fb8c00ad700 1 -- 172.21.15.81:0/744920828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b816b200 con 0x7fb8b816a820 2023-10-07T08:44:55.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.627+0000 7fb8c00ad700 1 -- 172.21.15.81:0/744920828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b8068900 con 0x7fb8b816a820 2023-10-07T08:44:55.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.627+0000 7fb8adffb700 1 -- 172.21.15.81:0/744920828 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8b0015640 con 0x7fb8b816a820 2023-10-07T08:44:55.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.628+0000 7fb8adffb700 1 --2- 172.21.15.81:0/744920828 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb89c066f30 0x7fb89c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:55.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.628+0000 7fb8adffb700 1 -- 172.21.15.81:0/744920828 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fb8b0084ef0 con 0x7fb8b816a820 2023-10-07T08:44:55.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.628+0000 7fb8bde49700 1 --2- 172.21.15.81:0/744920828 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb89c066f30 0x7fb89c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:55.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.628+0000 7fb8bde49700 1 --2- 172.21.15.81:0/744920828 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb89c066f30 0x7fb89c0693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8070590 tx=0x7fb8b4007d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:55.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.632+0000 7fb8adffb700 1 -- 172.21.15.81:0/744920828 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8b00520d0 con 0x7fb8b816a820 2023-10-07T08:44:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:55.812+0000 7fb8c00ad700 1 -- 172.21.15.81:0/744920828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb8b80ad1a0 con 0x7fb8b816a820 2023-10-07T08:44:56.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.493+0000 7fb8adffb700 1 -- 172.21.15.81:0/744920828 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb8b00556f0 con 0x7fb8b816a820 2023-10-07T08:44:56.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.497+0000 7fb8c00ad700 1 -- 172.21.15.81:0/744920828 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb89c066f30 msgr2=0x7fb89c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.497+0000 7fb8c00ad700 1 --2- 172.21.15.81:0/744920828 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb89c066f30 0x7fb89c0693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8070590 tx=0x7fb8b4007d10 comp rx=0 tx=0).stop 2023-10-07T08:44:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.497+0000 7fb8c00ad700 1 -- 172.21.15.81:0/744920828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b816a820 msgr2=0x7fb8b816acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.497+0000 7fb8c00ad700 1 --2- 172.21.15.81:0/744920828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b816a820 0x7fb8b816acc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb8b815da20 tx=0x7fb8b000b040 comp rx=0 tx=0).stop 2023-10-07T08:44:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.497+0000 7fb8c00ad700 1 -- 172.21.15.81:0/744920828 shutdown_connections 2023-10-07T08:44:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.497+0000 7fb8c00ad700 1 --2- 172.21.15.81:0/744920828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b816a820 0x7fb8b816acc0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.497+0000 7fb8c00ad700 1 --2- 172.21.15.81:0/744920828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8a4004810 0x7fb8b815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.497+0000 7fb8c00ad700 1 --2- 172.21.15.81:0/744920828 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb89c066f30 0x7fb89c0693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.497+0000 7fb8c00ad700 1 --2- 172.21.15.81:0/744920828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8b815c330 0x7fb8b815c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.497+0000 7fb8c00ad700 1 -- 172.21.15.81:0/744920828 >> 172.21.15.81:0/744920828 conn(0x7fb8b806cca0 msgr2=0x7fb8b80b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.497+0000 7fb8c00ad700 1 -- 172.21.15.81:0/744920828 shutdown_connections 2023-10-07T08:44:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.497+0000 7fb8c00ad700 1 -- 172.21.15.81:0/744920828 wait complete. 2023-10-07T08:44:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-07T08:44:56.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T08:44:56.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.627+0000 7fd9509a5700 1 Processor -- start 2023-10-07T08:44:56.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.627+0000 7fd9509a5700 1 -- start start 2023-10-07T08:44:56.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.628+0000 7fd9509a5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd94c1578d0 0x7fd94c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:56.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.628+0000 7fd9509a5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94c0d07c0 con 0x7fd94c06d120 2023-10-07T08:44:56.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.628+0000 7fd9509a5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94c0cfbb0 con 0x7fd94c157ca0 2023-10-07T08:44:56.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.628+0000 7fd9509a5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94c0cfe90 con 0x7fd94c1578d0 2023-10-07T08:44:56.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.628+0000 7fd94ad9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd94c06d120 0x7fd94c06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33242/0 (socket says 172.21.15.81:33242) 2023-10-07T08:44:56.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.628+0000 7fd94ad9d700 1 -- 172.21.15.81:0/1390880791 learned_addr learned my addr 172.21.15.81:0/1390880791 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:56.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.628+0000 7fd949d9b700 1 -- 172.21.15.81:0/1390880791 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829221315 0 0) 0x7fd94c0d07c0 con 0x7fd94c06d120 2023-10-07T08:44:56.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.628+0000 7fd949d9b700 1 -- 172.21.15.81:0/1390880791 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd938003570 con 0x7fd94c06d120 2023-10-07T08:44:56.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.628+0000 7fd94a59c700 1 --2- 172.21.15.81:0/1390880791 >> v2:172.21.15.89:3300/0 conn(0x7fd94c1578d0 0x7fd94c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:56.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd949d9b700 1 -- 172.21.15.81:0/1390880791 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1577081306 0 0) 0x7fd938003570 con 0x7fd94c06d120 2023-10-07T08:44:56.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd949d9b700 1 -- 172.21.15.81:0/1390880791 >> v2:172.21.15.89:3300/0 conn(0x7fd94c1578d0 msgr2=0x7fd94c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:56.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd949d9b700 1 --2- 172.21.15.81:0/1390880791 >> v2:172.21.15.89:3300/0 conn(0x7fd94c1578d0 0x7fd94c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:56.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd949d9b700 1 -- 172.21.15.81:0/1390880791 >> v1:172.21.15.89:6789/0 conn(0x7fd94c157ca0 legacy=0x7fd94c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:56.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd949d9b700 1 -- 172.21.15.81:0/1390880791 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c0d0170 con 0x7fd94c06d120 2023-10-07T08:44:56.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd949d9b700 1 -- 172.21.15.81:0/1390880791 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fd9440017f0 con 0x7fd94c06d120 2023-10-07T08:44:56.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd949d9b700 1 -- 172.21.15.81:0/1390880791 >> v1:172.21.15.81:6789/0 conn(0x7fd94c06d120 legacy=0x7fd94c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:56.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd949d9b700 1 --2- 172.21.15.81:0/1390880791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd938003a60 0x7fd938003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:56.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd949d9b700 1 --2- 172.21.15.81:0/1390880791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd938004810 0x7fd938004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:56.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd949d9b700 1 --2- 172.21.15.81:0/1390880791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9380053c0 0x7fd93800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd949d9b700 1 -- 172.21.15.81:0/1390880791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0cfe90 con 0x7fd9380053c0 2023-10-07T08:44:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd949d9b700 1 -- 172.21.15.81:0/1390880791 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93800c250 con 0x7fd938003a60 2023-10-07T08:44:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd949d9b700 1 -- 172.21.15.81:0/1390880791 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93800c410 con 0x7fd938004810 2023-10-07T08:44:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd94a59c700 1 --2- 172.21.15.81:0/1390880791 >> v2:172.21.15.89:3300/0 conn(0x7fd94c1578d0 0x7fd94c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd94ad9d700 1 --2- 172.21.15.81:0/1390880791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9380053c0 0x7fd93800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd941d9b700 1 --2- 172.21.15.81:0/1390880791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd938004810 0x7fd938004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd94a59c700 1 --2- 172.21.15.81:0/1390880791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd938003a60 0x7fd938003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd94ad9d700 1 -- 172.21.15.81:0/1390880791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd938004810 msgr2=0x7fd938004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd94ad9d700 1 --2- 172.21.15.81:0/1390880791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd938004810 0x7fd938004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd94ad9d700 1 -- 172.21.15.81:0/1390880791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd938003a60 msgr2=0x7fd938003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd94ad9d700 1 --2- 172.21.15.81:0/1390880791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd938003a60 0x7fd938003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd94ad9d700 1 -- 172.21.15.81:0/1390880791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd938003570 con 0x7fd9380053c0 2023-10-07T08:44:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd94ad9d700 1 -- 172.21.15.81:0/1390880791 reap_dead start 2023-10-07T08:44:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd94ad9d700 1 --2- 172.21.15.81:0/1390880791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9380053c0 0x7fd93800ba60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd94400a930 tx=0x7fd9440021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2c9ab02c108d51 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd949d9b700 1 -- 172.21.15.81:0/1390880791 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9440070d0 con 0x7fd9380053c0 2023-10-07T08:44:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd949d9b700 1 -- 172.21.15.81:0/1390880791 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd944007230 con 0x7fd9380053c0 2023-10-07T08:44:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.629+0000 7fd949d9b700 1 -- 172.21.15.81:0/1390880791 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9440075d0 con 0x7fd9380053c0 2023-10-07T08:44:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.630+0000 7fd9509a5700 1 -- 172.21.15.81:0/1390880791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9380053c0 msgr2=0x7fd93800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.630+0000 7fd9509a5700 1 --2- 172.21.15.81:0/1390880791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9380053c0 0x7fd93800ba60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd94400a930 tx=0x7fd9440021d0 comp rx=0 tx=0).stop 2023-10-07T08:44:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.630+0000 7fd9509a5700 1 -- 172.21.15.81:0/1390880791 shutdown_connections 2023-10-07T08:44:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.630+0000 7fd9509a5700 1 --2- 172.21.15.81:0/1390880791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9380053c0 0x7fd93800ba60 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.630+0000 7fd9509a5700 1 -- 172.21.15.81:0/1390880791 >> 172.21.15.81:0/1390880791 conn(0x7fd94c06bb90 msgr2=0x7fd94c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.630+0000 7fd9509a5700 1 -- 172.21.15.81:0/1390880791 shutdown_connections 2023-10-07T08:44:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.630+0000 7fd9509a5700 1 -- 172.21.15.81:0/1390880791 wait complete. 2023-10-07T08:44:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.631+0000 7fd9509a5700 1 Processor -- start 2023-10-07T08:44:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.631+0000 7fd9509a5700 1 -- start start 2023-10-07T08:44:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd9509a5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9380053c0 0x7fd94c16a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd9509a5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd94c14e830 0x7fd94c14eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd9509a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd94c151f80 0x7fd94c152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd9509a5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c152cd0 con 0x7fd94c151f80 2023-10-07T08:44:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd9509a5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c152fb0 con 0x7fd94c14e830 2023-10-07T08:44:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd9509a5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c153290 con 0x7fd9380053c0 2023-10-07T08:44:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd94ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd94c151f80 0x7fd94c152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd94ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd94c151f80 0x7fd94c152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46996/0 (socket says 172.21.15.81:46996) 2023-10-07T08:44:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd94ad9d700 1 -- 172.21.15.81:0/2996960502 learned_addr learned my addr 172.21.15.81:0/2996960502 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd94a59c700 1 --2- 172.21.15.81:0/2996960502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9380053c0 0x7fd94c16a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd941d9b700 1 --2- 172.21.15.81:0/2996960502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd94c14e830 0x7fd94c14eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd94ad9d700 1 -- 172.21.15.81:0/2996960502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9380053c0 msgr2=0x7fd94c16a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd94ad9d700 1 --2- 172.21.15.81:0/2996960502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9380053c0 0x7fd94c16a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd94ad9d700 1 -- 172.21.15.81:0/2996960502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd94c14e830 msgr2=0x7fd94c14eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd94ad9d700 1 --2- 172.21.15.81:0/2996960502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd94c14e830 0x7fd94c14eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd94ad9d700 1 -- 172.21.15.81:0/2996960502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c153570 con 0x7fd94c151f80 2023-10-07T08:44:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd94ad9d700 1 --2- 172.21.15.81:0/2996960502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd94c151f80 0x7fd94c152400 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd94400a3f0 tx=0x7fd944016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd942ffd700 1 -- 172.21.15.81:0/2996960502 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944004e90 con 0x7fd94c151f80 2023-10-07T08:44:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd942ffd700 1 -- 172.21.15.81:0/2996960502 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94401d420 con 0x7fd94c151f80 2023-10-07T08:44:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd942ffd700 1 -- 172.21.15.81:0/2996960502 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94401d800 con 0x7fd94c151f80 2023-10-07T08:44:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.632+0000 7fd9509a5700 1 -- 172.21.15.81:0/2996960502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94c153850 con 0x7fd94c151f80 2023-10-07T08:44:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.633+0000 7fd9509a5700 1 -- 172.21.15.81:0/2996960502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94c152940 con 0x7fd94c151f80 2023-10-07T08:44:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.633+0000 7fd9509a5700 1 -- 172.21.15.81:0/2996960502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd94c153a40 con 0x7fd94c151f80 2023-10-07T08:44:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.634+0000 7fd942ffd700 1 -- 172.21.15.81:0/2996960502 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd94401dc30 con 0x7fd94c151f80 2023-10-07T08:44:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.634+0000 7fd942ffd700 1 --2- 172.21.15.81:0/2996960502 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd92c066f30 0x7fd92c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.634+0000 7fd942ffd700 1 -- 172.21.15.81:0/2996960502 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5411+0+0 (secure 0 0 0) 0x7fd944086710 con 0x7fd94c151f80 2023-10-07T08:44:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.634+0000 7fd94a59c700 1 --2- 172.21.15.81:0/2996960502 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd92c066f30 0x7fd92c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.634+0000 7fd94a59c700 1 --2- 172.21.15.81:0/2996960502 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd92c066f30 0x7fd92c0693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0688a0 tx=0x7fd93c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.638+0000 7fd942ffd700 1 -- 172.21.15.81:0/2996960502 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd944053aa0 con 0x7fd94c151f80 2023-10-07T08:44:56.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:56.821+0000 7fd9509a5700 1 -- 172.21.15.81:0/2996960502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd94c0d0450 con 0x7fd94c151f80 2023-10-07T08:44:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.494+0000 7fd942ffd700 1 -- 172.21.15.81:0/2996960502 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd9440570c0 con 0x7fd94c151f80 2023-10-07T08:44:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.498+0000 7fd9509a5700 1 -- 172.21.15.81:0/2996960502 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd92c066f30 msgr2=0x7fd92c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:57.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.498+0000 7fd9509a5700 1 --2- 172.21.15.81:0/2996960502 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd92c066f30 0x7fd92c0693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0688a0 tx=0x7fd93c008040 comp rx=0 tx=0).stop 2023-10-07T08:44:57.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.498+0000 7fd9509a5700 1 -- 172.21.15.81:0/2996960502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd94c151f80 msgr2=0x7fd94c152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:57.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.498+0000 7fd9509a5700 1 --2- 172.21.15.81:0/2996960502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd94c151f80 0x7fd94c152400 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd94400a3f0 tx=0x7fd944016000 comp rx=0 tx=0).stop 2023-10-07T08:44:57.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.498+0000 7fd9509a5700 1 -- 172.21.15.81:0/2996960502 shutdown_connections 2023-10-07T08:44:57.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.498+0000 7fd9509a5700 1 --2- 172.21.15.81:0/2996960502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd94c151f80 0x7fd94c152400 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.498+0000 7fd9509a5700 1 --2- 172.21.15.81:0/2996960502 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd92c066f30 0x7fd92c0693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.498+0000 7fd9509a5700 1 --2- 172.21.15.81:0/2996960502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9380053c0 0x7fd94c16a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.498+0000 7fd9509a5700 1 --2- 172.21.15.81:0/2996960502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd94c14e830 0x7fd94c14eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.498+0000 7fd9509a5700 1 -- 172.21.15.81:0/2996960502 >> 172.21.15.81:0/2996960502 conn(0x7fd94c06bb90 msgr2=0x7fd94c15a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:57.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.498+0000 7fd9509a5700 1 -- 172.21.15.81:0/2996960502 shutdown_connections 2023-10-07T08:44:57.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.498+0000 7fd9509a5700 1 -- 172.21.15.81:0/2996960502 wait complete. 2023-10-07T08:44:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-07T08:44:57.513 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T08:44:57.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.628+0000 7f09f87e5700 1 Processor -- start 2023-10-07T08:44:57.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.628+0000 7f09f87e5700 1 -- start start 2023-10-07T08:44:57.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.629+0000 7f09f87e5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f09f0157ca0 0x7f09f00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:57.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.629+0000 7f09f87e5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09f006d120 0x7f09f006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.629+0000 7f09f87e5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f00d07c0 con 0x7f09f01578d0 2023-10-07T08:44:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.629+0000 7f09f87e5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f006daa0 con 0x7f09f0157ca0 2023-10-07T08:44:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.629+0000 7f09f87e5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00cfbb0 con 0x7f09f006d120 2023-10-07T08:44:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.629+0000 7f09f6d82700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09f006d120 0x7f09f006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.629+0000 7f09f5d80700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f09f0157ca0 0x7f09f00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.629+0000 7f09f6d82700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09f006d120 0x7f09f006d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:33346/0 (socket says 172.21.15.81:33346) 2023-10-07T08:44:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.629+0000 7f09f6581700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f09f01578d0 0x7f09f015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:39874/0 (socket says 172.21.15.81:39874) 2023-10-07T08:44:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.629+0000 7f09f6d82700 1 -- 172.21.15.81:0/2723756549 learned_addr learned my addr 172.21.15.81:0/2723756549 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.630+0000 7f09f5d80700 1 -- 172.21.15.81:0/2723756549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09f006d120 msgr2=0x7f09f006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.630+0000 7f09f5d80700 1 --2- 172.21.15.81:0/2723756549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09f006d120 0x7f09f006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.630+0000 7f09f5d80700 1 -- 172.21.15.81:0/2723756549 >> v1:172.21.15.89:6789/0 conn(0x7f09f01578d0 legacy=0x7f09f015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.630+0000 7f09f5d80700 1 -- 172.21.15.81:0/2723756549 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f00cfe90 con 0x7f09f0157ca0 2023-10-07T08:44:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.630+0000 7f09f6d82700 1 --2- 172.21.15.81:0/2723756549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09f006d120 0x7f09f006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:44:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.630+0000 7f09f5d80700 1 --2- 172.21.15.81:0/2723756549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09f0157ca0 0x7f09f00cf4f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f09e00098e0 tx=0x7f09e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ba13ca1fea2cad2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.630+0000 7f09f557f700 1 -- 172.21.15.81:0/2723756549 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e000b640 con 0x7f09f0157ca0 2023-10-07T08:44:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.630+0000 7f09f557f700 1 -- 172.21.15.81:0/2723756549 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e000b7a0 con 0x7f09f0157ca0 2023-10-07T08:44:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.630+0000 7f09f557f700 1 -- 172.21.15.81:0/2723756549 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e000bb40 con 0x7f09f0157ca0 2023-10-07T08:44:57.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.631+0000 7f09f87e5700 1 -- 172.21.15.81:0/2723756549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09f0157ca0 msgr2=0x7f09f00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.631+0000 7f09f87e5700 1 --2- 172.21.15.81:0/2723756549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09f0157ca0 0x7f09f00cf4f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f09e00098e0 tx=0x7f09e00091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.631+0000 7f09f87e5700 1 -- 172.21.15.81:0/2723756549 shutdown_connections 2023-10-07T08:44:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.631+0000 7f09f87e5700 1 --2- 172.21.15.81:0/2723756549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09f006d120 0x7f09f006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.631+0000 7f09f87e5700 1 --2- 172.21.15.81:0/2723756549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09f0157ca0 0x7f09f00cf4f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.631+0000 7f09f87e5700 1 -- 172.21.15.81:0/2723756549 >> 172.21.15.81:0/2723756549 conn(0x7f09f006bb90 msgr2=0x7f09f006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.631+0000 7f09f87e5700 1 -- 172.21.15.81:0/2723756549 shutdown_connections 2023-10-07T08:44:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.631+0000 7f09f87e5700 1 -- 172.21.15.81:0/2723756549 wait complete. 2023-10-07T08:44:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.632+0000 7f09f87e5700 1 Processor -- start 2023-10-07T08:44:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.632+0000 7f09f87e5700 1 -- start start 2023-10-07T08:44:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.632+0000 7f09f87e5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09f006d120 0x7f09f016a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f87e5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09f01578d0 0x7f09f016d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f87e5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09f0157ca0 0x7f09f00aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f87e5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f01543d0 con 0x7f09f0157ca0 2023-10-07T08:44:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f87e5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00b4b70 con 0x7f09f01578d0 2023-10-07T08:44:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f87e5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f016d7c0 con 0x7f09f006d120 2023-10-07T08:44:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f6d82700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09f0157ca0 0x7f09f00aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f6d82700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09f0157ca0 0x7f09f00aad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47000/0 (socket says 172.21.15.81:47000) 2023-10-07T08:44:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f6d82700 1 -- 172.21.15.81:0/2997311687 learned_addr learned my addr 172.21.15.81:0/2997311687 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f6581700 1 --2- 172.21.15.81:0/2997311687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09f006d120 0x7f09f016a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f5d80700 1 --2- 172.21.15.81:0/2997311687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09f01578d0 0x7f09f016d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f6d82700 1 -- 172.21.15.81:0/2997311687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09f006d120 msgr2=0x7f09f016a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f6d82700 1 --2- 172.21.15.81:0/2997311687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09f006d120 0x7f09f016a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f6d82700 1 -- 172.21.15.81:0/2997311687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09f01578d0 msgr2=0x7f09f016d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f6d82700 1 --2- 172.21.15.81:0/2997311687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09f01578d0 0x7f09f016d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f6d82700 1 -- 172.21.15.81:0/2997311687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e80094f0 con 0x7f09f0157ca0 2023-10-07T08:44:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f6d82700 1 --2- 172.21.15.81:0/2997311687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09f0157ca0 0x7f09f00aad20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f09e800ec50 tx=0x7f09e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09e67fc700 1 -- 172.21.15.81:0/2997311687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e800c850 con 0x7f09f0157ca0 2023-10-07T08:44:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09e67fc700 1 -- 172.21.15.81:0/2997311687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e800c9b0 con 0x7f09f0157ca0 2023-10-07T08:44:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f87e5700 1 -- 172.21.15.81:0/2997311687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e0009420 con 0x7f09f0157ca0 2023-10-07T08:44:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09e67fc700 1 -- 172.21.15.81:0/2997311687 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e800cd50 con 0x7f09f0157ca0 2023-10-07T08:44:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.633+0000 7f09f87e5700 1 -- 172.21.15.81:0/2997311687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f00b5380 con 0x7f09f0157ca0 2023-10-07T08:44:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.634+0000 7f09f87e5700 1 -- 172.21.15.81:0/2997311687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f0067ac0 con 0x7f09f0157ca0 2023-10-07T08:44:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.635+0000 7f09e67fc700 1 -- 172.21.15.81:0/2997311687 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09e8013680 con 0x7f09f0157ca0 2023-10-07T08:44:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.635+0000 7f09e67fc700 1 --2- 172.21.15.81:0/2997311687 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f09d4066f30 0x7f09d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.635+0000 7f09e67fc700 1 -- 172.21.15.81:0/2997311687 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f09e8084410 con 0x7f09f0157ca0 2023-10-07T08:44:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.635+0000 7f09f6581700 1 --2- 172.21.15.81:0/2997311687 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f09d4066f30 0x7f09d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.636+0000 7f09f6581700 1 --2- 172.21.15.81:0/2997311687 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f09d4066f30 0x7f09d40693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0020c0 tx=0x7f09ec001ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.639+0000 7f09e67fc700 1 -- 172.21.15.81:0/2997311687 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09e8051980 con 0x7f09f0157ca0 2023-10-07T08:44:57.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.823+0000 7f09f87e5700 1 -- 172.21.15.81:0/2997311687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f09f00d0170 con 0x7f09f0157ca0 2023-10-07T08:44:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.827+0000 7f09e67fc700 1 -- 172.21.15.81:0/2997311687 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f09e8054fa0 con 0x7f09f0157ca0 2023-10-07T08:44:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.829+0000 7f09f87e5700 1 -- 172.21.15.81:0/2997311687 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f09d4066f30 msgr2=0x7f09d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.829+0000 7f09f87e5700 1 --2- 172.21.15.81:0/2997311687 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f09d4066f30 0x7f09d40693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0020c0 tx=0x7f09ec001ad0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.829+0000 7f09f87e5700 1 -- 172.21.15.81:0/2997311687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09f0157ca0 msgr2=0x7f09f00aad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.829+0000 7f09f87e5700 1 --2- 172.21.15.81:0/2997311687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09f0157ca0 0x7f09f00aad20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f09e800ec50 tx=0x7f09e8009250 comp rx=0 tx=0).stop 2023-10-07T08:44:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.829+0000 7f09f87e5700 1 -- 172.21.15.81:0/2997311687 shutdown_connections 2023-10-07T08:44:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.829+0000 7f09f87e5700 1 --2- 172.21.15.81:0/2997311687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09f0157ca0 0x7f09f00aad20 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.829+0000 7f09f87e5700 1 --2- 172.21.15.81:0/2997311687 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f09d4066f30 0x7f09d40693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.829+0000 7f09f87e5700 1 --2- 172.21.15.81:0/2997311687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09f006d120 0x7f09f016a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.829+0000 7f09f87e5700 1 --2- 172.21.15.81:0/2997311687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09f01578d0 0x7f09f016d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.829+0000 7f09f87e5700 1 -- 172.21.15.81:0/2997311687 >> 172.21.15.81:0/2997311687 conn(0x7f09f006bb90 msgr2=0x7f09f0155210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.829+0000 7f09f87e5700 1 -- 172.21.15.81:0/2997311687 shutdown_connections 2023-10-07T08:44:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.829+0000 7f09f87e5700 1 -- 172.21.15.81:0/2997311687 wait complete. 2023-10-07T08:44:57.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-10-07T08:44:57.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.955+0000 7f5e0f652700 1 Processor -- start 2023-10-07T08:44:57.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.956+0000 7f5e0f652700 1 -- start start 2023-10-07T08:44:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.957+0000 7f5e0f652700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5e0806d830 0x7f5e080cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.957+0000 7f5e0f652700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e080d07c0 con 0x7f5e08157ca0 2023-10-07T08:44:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.957+0000 7f5e0f652700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e080cfbb0 con 0x7f5e081578d0 2023-10-07T08:44:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.957+0000 7f5e0f652700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e080cfe90 con 0x7f5e0806d830 2023-10-07T08:44:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.957+0000 7f5e0dbef700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5e0806d830 0x7f5e080cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.957+0000 7f5e0cbed700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5e08157ca0 0x7f5e0806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33246/0 (socket says 172.21.15.81:33246) 2023-10-07T08:44:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.957+0000 7f5e0cbed700 1 -- 172.21.15.81:0/3586343953 learned_addr learned my addr 172.21.15.81:0/3586343953 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.957+0000 7f5e0dbef700 1 -- 172.21.15.81:0/3586343953 >> v1:172.21.15.89:6789/0 conn(0x7f5e081578d0 legacy=0x7f5e0815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.957+0000 7f5e0dbef700 1 -- 172.21.15.81:0/3586343953 >> v1:172.21.15.81:6789/0 conn(0x7f5e08157ca0 legacy=0x7f5e0806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.957+0000 7f5dfffff700 1 -- 172.21.15.81:0/3586343953 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749513429 0 0) 0x7f5e080d07c0 con 0x7f5e08157ca0 2023-10-07T08:44:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.957+0000 7f5e0dbef700 1 -- 172.21.15.81:0/3586343953 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e080d0170 con 0x7f5e0806d830 2023-10-07T08:44:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.957+0000 7f5e0dbef700 1 --2- 172.21.15.81:0/3586343953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0806d830 0x7f5e080cf4f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5e000098e0 tx=0x7f5e000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22e63511e3ddbf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.957+0000 7f5dfffff700 1 -- 172.21.15.81:0/3586343953 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00009e80 con 0x7f5e0806d830 2023-10-07T08:44:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.957+0000 7f5dfffff700 1 -- 172.21.15.81:0/3586343953 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0000b860 con 0x7f5e0806d830 2023-10-07T08:44:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.957+0000 7f5dfffff700 1 -- 172.21.15.81:0/3586343953 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0000bbe0 con 0x7f5e0806d830 2023-10-07T08:44:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.958+0000 7f5e0f652700 1 -- 172.21.15.81:0/3586343953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0806d830 msgr2=0x7f5e080cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.958+0000 7f5e0f652700 1 --2- 172.21.15.81:0/3586343953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0806d830 0x7f5e080cf4f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5e000098e0 tx=0x7f5e000091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.958+0000 7f5e0f652700 1 -- 172.21.15.81:0/3586343953 shutdown_connections 2023-10-07T08:44:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.958+0000 7f5e0f652700 1 --2- 172.21.15.81:0/3586343953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0806d830 0x7f5e080cf4f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.958+0000 7f5e0f652700 1 -- 172.21.15.81:0/3586343953 >> 172.21.15.81:0/3586343953 conn(0x7f5e0806bb90 msgr2=0x7f5e0806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.958+0000 7f5e0f652700 1 -- 172.21.15.81:0/3586343953 shutdown_connections 2023-10-07T08:44:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.958+0000 7f5e0f652700 1 -- 172.21.15.81:0/3586343953 wait complete. 2023-10-07T08:44:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.959+0000 7f5e0f652700 1 Processor -- start 2023-10-07T08:44:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.959+0000 7f5e0f652700 1 -- start start 2023-10-07T08:44:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0f652700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0806d830 0x7f5e080cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0f652700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e081578d0 0x7f5e080ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0f652700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e08157ca0 0x7f5e08069050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0f652700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080af640 con 0x7f5e081578d0 2023-10-07T08:44:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0f652700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080cd710 con 0x7f5e0806d830 2023-10-07T08:44:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0f652700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080b1850 con 0x7f5e08157ca0 2023-10-07T08:44:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0cbed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e081578d0 0x7f5e080ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0cbed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e081578d0 0x7f5e080ac210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47022/0 (socket says 172.21.15.81:47022) 2023-10-07T08:44:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0cbed700 1 -- 172.21.15.81:0/2332924905 learned_addr learned my addr 172.21.15.81:0/2332924905 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0d3ee700 1 --2- 172.21.15.81:0/2332924905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0806d830 0x7f5e080cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0dbef700 1 --2- 172.21.15.81:0/2332924905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e08157ca0 0x7f5e08069050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0cbed700 1 -- 172.21.15.81:0/2332924905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e08157ca0 msgr2=0x7f5e08069050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0cbed700 1 --2- 172.21.15.81:0/2332924905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e08157ca0 0x7f5e08069050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0cbed700 1 -- 172.21.15.81:0/2332924905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0806d830 msgr2=0x7f5e080cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0cbed700 1 --2- 172.21.15.81:0/2332924905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0806d830 0x7f5e080cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0cbed700 1 -- 172.21.15.81:0/2332924905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e00009420 con 0x7f5e081578d0 2023-10-07T08:44:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0dbef700 1 --2- 172.21.15.81:0/2332924905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e08157ca0 0x7f5e08069050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:44:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.960+0000 7f5e0cbed700 1 --2- 172.21.15.81:0/2332924905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e081578d0 0x7f5e080ac210 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5df800c530 tx=0x7f5df8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.961+0000 7f5dfd7fa700 1 -- 172.21.15.81:0/2332924905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df8005b30 con 0x7f5e081578d0 2023-10-07T08:44:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.961+0000 7f5dfd7fa700 1 -- 172.21.15.81:0/2332924905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df8005c90 con 0x7f5e081578d0 2023-10-07T08:44:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.961+0000 7f5e0f652700 1 -- 172.21.15.81:0/2332924905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e080b1b30 con 0x7f5e081578d0 2023-10-07T08:44:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.961+0000 7f5dfd7fa700 1 -- 172.21.15.81:0/2332924905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df8007320 con 0x7f5e081578d0 2023-10-07T08:44:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.961+0000 7f5e0f652700 1 -- 172.21.15.81:0/2332924905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e080b1ec0 con 0x7f5e081578d0 2023-10-07T08:44:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.962+0000 7f5e0f652700 1 -- 172.21.15.81:0/2332924905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e08067ac0 con 0x7f5e081578d0 2023-10-07T08:44:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.962+0000 7f5dfd7fa700 1 -- 172.21.15.81:0/2332924905 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5df801b3b0 con 0x7f5e081578d0 2023-10-07T08:44:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.962+0000 7f5dfd7fa700 1 --2- 172.21.15.81:0/2332924905 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5dec066f30 0x7f5dec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.962+0000 7f5dfd7fa700 1 -- 172.21.15.81:0/2332924905 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5df80836a0 con 0x7f5e081578d0 2023-10-07T08:44:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.962+0000 7f5e0d3ee700 1 --2- 172.21.15.81:0/2332924905 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5dec066f30 0x7f5dec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.963+0000 7f5e0d3ee700 1 --2- 172.21.15.81:0/2332924905 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5dec066f30 0x7f5dec0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5e04007fd0 tx=0x7f5e040016f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:57.966+0000 7f5dfd7fa700 1 -- 172.21.15.81:0/2332924905 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5df8050c10 con 0x7f5e081578d0 2023-10-07T08:44:58.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.230+0000 7f5e0f652700 1 -- 172.21.15.81:0/2332924905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f5e080d0450 con 0x7f5e081578d0 2023-10-07T08:44:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.500+0000 7f5dfd7fa700 1 -- 172.21.15.81:0/2332924905 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v129) v1 ==== 142+0+0 (secure 0 0 0) 0x7f5df8054230 con 0x7f5e081578d0 2023-10-07T08:44:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.502+0000 7f5e0f652700 1 -- 172.21.15.81:0/2332924905 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5dec066f30 msgr2=0x7f5dec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.502+0000 7f5e0f652700 1 --2- 172.21.15.81:0/2332924905 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5dec066f30 0x7f5dec0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5e04007fd0 tx=0x7f5e040016f0 comp rx=0 tx=0).stop 2023-10-07T08:44:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.502+0000 7f5e0f652700 1 -- 172.21.15.81:0/2332924905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e081578d0 msgr2=0x7f5e080ac210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.502+0000 7f5e0f652700 1 --2- 172.21.15.81:0/2332924905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e081578d0 0x7f5e080ac210 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5df800c530 tx=0x7f5df8007f90 comp rx=0 tx=0).stop 2023-10-07T08:44:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.502+0000 7f5e0f652700 1 -- 172.21.15.81:0/2332924905 shutdown_connections 2023-10-07T08:44:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.502+0000 7f5e0f652700 1 --2- 172.21.15.81:0/2332924905 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5dec066f30 0x7f5dec0693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.502+0000 7f5e0f652700 1 --2- 172.21.15.81:0/2332924905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e08157ca0 0x7f5e08069050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.502+0000 7f5e0f652700 1 --2- 172.21.15.81:0/2332924905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0806d830 0x7f5e080cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.502+0000 7f5e0f652700 1 --2- 172.21.15.81:0/2332924905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e081578d0 0x7f5e080ac210 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.502+0000 7f5e0f652700 1 -- 172.21.15.81:0/2332924905 >> 172.21.15.81:0/2332924905 conn(0x7f5e0806bb90 msgr2=0x7f5e0806d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.502+0000 7f5e0f652700 1 -- 172.21.15.81:0/2332924905 shutdown_connections 2023-10-07T08:44:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.502+0000 7f5e0f652700 1 -- 172.21.15.81:0/2332924905 wait complete. 2023-10-07T08:44:58.516 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-07T08:44:58.516 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-10-07T08:44:58.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-10-07T08:44:58.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.630+0000 7fa726ea5700 1 Processor -- start 2023-10-07T08:44:58.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.630+0000 7fa726ea5700 1 -- start start 2023-10-07T08:44:58.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.630+0000 7fa726ea5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa720157ca0 0x7fa7200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:58.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.630+0000 7fa726ea5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa72006d120 0x7fa72006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:58.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.630+0000 7fa726ea5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7200d07c0 con 0x7fa7201578d0 2023-10-07T08:44:58.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.630+0000 7fa726ea5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72006da50 con 0x7fa72006d120 2023-10-07T08:44:58.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.630+0000 7fa726ea5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7200cfbb0 con 0x7fa720157ca0 2023-10-07T08:44:58.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.631+0000 7fa724c41700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa7201578d0 0x7fa72015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33252/0 (socket says 172.21.15.81:33252) 2023-10-07T08:44:58.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.631+0000 7fa724c41700 1 -- 172.21.15.81:0/773417764 learned_addr learned my addr 172.21.15.81:0/773417764 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:58.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.631+0000 7fa725442700 1 --2- 172.21.15.81:0/773417764 >> v2:172.21.15.81:3300/0 conn(0x7fa72006d120 0x7fa72006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:58.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.631+0000 7fa717fff700 1 --2- 172.21.15.81:0/773417764 >> v2:172.21.15.89:3300/0 conn(0x7fa720157ca0 0x7fa7200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:58.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.631+0000 7fa7177fe700 1 -- 172.21.15.81:0/773417764 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694809894 0 0) 0x7fa7200d07c0 con 0x7fa7201578d0 2023-10-07T08:44:58.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.631+0000 7fa7177fe700 1 -- 172.21.15.81:0/773417764 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa708003570 con 0x7fa7201578d0 2023-10-07T08:44:58.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.631+0000 7fa725442700 1 -- 172.21.15.81:0/773417764 >> v2:172.21.15.89:3300/0 conn(0x7fa720157ca0 msgr2=0x7fa7200cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:58.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.631+0000 7fa725442700 1 --2- 172.21.15.81:0/773417764 >> v2:172.21.15.89:3300/0 conn(0x7fa720157ca0 0x7fa7200cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:58.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.631+0000 7fa725442700 1 -- 172.21.15.81:0/773417764 >> v1:172.21.15.81:6789/0 conn(0x7fa7201578d0 legacy=0x7fa72015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:58.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.631+0000 7fa725442700 1 -- 172.21.15.81:0/773417764 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7200cfe90 con 0x7fa72006d120 2023-10-07T08:44:58.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.631+0000 7fa717fff700 1 --2- 172.21.15.81:0/773417764 >> v2:172.21.15.89:3300/0 conn(0x7fa720157ca0 0x7fa7200cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:44:58.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.631+0000 7fa725442700 1 --2- 172.21.15.81:0/773417764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72006d120 0x7fa72006d510 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa720068510 tx=0x7fa7180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3fde62d746b92a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:58.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.631+0000 7fa7177fe700 1 -- 172.21.15.81:0/773417764 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718011630 con 0x7fa72006d120 2023-10-07T08:44:58.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.631+0000 7fa7177fe700 1 -- 172.21.15.81:0/773417764 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa718011790 con 0x7fa72006d120 2023-10-07T08:44:58.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.631+0000 7fa7177fe700 1 -- 172.21.15.81:0/773417764 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718011b30 con 0x7fa72006d120 2023-10-07T08:44:58.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.632+0000 7fa726ea5700 1 -- 172.21.15.81:0/773417764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72006d120 msgr2=0x7fa72006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:58.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.632+0000 7fa726ea5700 1 --2- 172.21.15.81:0/773417764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72006d120 0x7fa72006d510 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa720068510 tx=0x7fa7180091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:58.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.632+0000 7fa726ea5700 1 -- 172.21.15.81:0/773417764 shutdown_connections 2023-10-07T08:44:58.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.632+0000 7fa726ea5700 1 --2- 172.21.15.81:0/773417764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72006d120 0x7fa72006d510 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:58.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.632+0000 7fa726ea5700 1 --2- 172.21.15.81:0/773417764 >> v2:172.21.15.89:3300/0 conn(0x7fa720157ca0 0x7fa7200cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:58.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.632+0000 7fa726ea5700 1 -- 172.21.15.81:0/773417764 >> 172.21.15.81:0/773417764 conn(0x7fa72006bb90 msgr2=0x7fa72006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:58.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.632+0000 7fa726ea5700 1 -- 172.21.15.81:0/773417764 shutdown_connections 2023-10-07T08:44:58.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.632+0000 7fa726ea5700 1 -- 172.21.15.81:0/773417764 wait complete. 2023-10-07T08:44:58.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.633+0000 7fa726ea5700 1 Processor -- start 2023-10-07T08:44:58.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.633+0000 7fa726ea5700 1 -- start start 2023-10-07T08:44:58.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa726ea5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa72006d120 0x7fa72016f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:58.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa726ea5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7201578d0 0x7fa7201542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:58.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa726ea5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa720157ca0 0x7fa72014e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:58.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa726ea5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72016e7c0 con 0x7fa720157ca0 2023-10-07T08:44:58.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa726ea5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7201539b0 con 0x7fa7201578d0 2023-10-07T08:44:58.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa726ea5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72016f830 con 0x7fa72006d120 2023-10-07T08:44:58.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa725442700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa720157ca0 0x7fa72014e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:58.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa725442700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa720157ca0 0x7fa72014e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47032/0 (socket says 172.21.15.81:47032) 2023-10-07T08:44:58.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa725442700 1 -- 172.21.15.81:0/6392734 learned_addr learned my addr 172.21.15.81:0/6392734 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:58.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa717fff700 1 --2- 172.21.15.81:0/6392734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7201578d0 0x7fa7201542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:58.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa724c41700 1 --2- 172.21.15.81:0/6392734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa72006d120 0x7fa72016f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa725442700 1 -- 172.21.15.81:0/6392734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa72006d120 msgr2=0x7fa72016f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa725442700 1 --2- 172.21.15.81:0/6392734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa72006d120 0x7fa72016f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa725442700 1 -- 172.21.15.81:0/6392734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7201578d0 msgr2=0x7fa7201542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa725442700 1 --2- 172.21.15.81:0/6392734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7201578d0 0x7fa7201542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa725442700 1 -- 172.21.15.81:0/6392734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa718009420 con 0x7fa720157ca0 2023-10-07T08:44:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa725442700 1 --2- 172.21.15.81:0/6392734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa720157ca0 0x7fa72014e730 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa718009f50 tx=0x7fa718017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa714ff9700 1 -- 172.21.15.81:0/6392734 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718011ad0 con 0x7fa720157ca0 2023-10-07T08:44:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa714ff9700 1 -- 172.21.15.81:0/6392734 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7180195c0 con 0x7fa720157ca0 2023-10-07T08:44:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa726ea5700 1 -- 172.21.15.81:0/6392734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa720152da0 con 0x7fa720157ca0 2023-10-07T08:44:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa714ff9700 1 -- 172.21.15.81:0/6392734 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718019980 con 0x7fa720157ca0 2023-10-07T08:44:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.634+0000 7fa726ea5700 1 -- 172.21.15.81:0/6392734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa720153360 con 0x7fa720157ca0 2023-10-07T08:44:58.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.635+0000 7fa726ea5700 1 -- 172.21.15.81:0/6392734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa720067ac0 con 0x7fa720157ca0 2023-10-07T08:44:58.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.636+0000 7fa714ff9700 1 -- 172.21.15.81:0/6392734 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa718019d30 con 0x7fa720157ca0 2023-10-07T08:44:58.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.636+0000 7fa714ff9700 1 --2- 172.21.15.81:0/6392734 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa70c066f30 0x7fa70c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:58.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.636+0000 7fa724c41700 1 --2- 172.21.15.81:0/6392734 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa70c066f30 0x7fa70c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:58.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.636+0000 7fa714ff9700 1 -- 172.21.15.81:0/6392734 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa718085d80 con 0x7fa720157ca0 2023-10-07T08:44:58.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.637+0000 7fa724c41700 1 --2- 172.21.15.81:0/6392734 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa70c066f30 0x7fa70c0693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa72015c5d0 tx=0x7fa71c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:58.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.642+0000 7fa714ff9700 1 -- 172.21.15.81:0/6392734 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7180532f0 con 0x7fa720157ca0 2023-10-07T08:44:58.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:58.899+0000 7fa726ea5700 1 -- 172.21.15.81:0/6392734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7fa7200d0170 con 0x7fa720157ca0 2023-10-07T08:44:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.502+0000 7fa714ff9700 1 -- 172.21.15.81:0/6392734 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v130) v1 ==== 137+0+0 (secure 0 0 0) 0x7fa718056910 con 0x7fa720157ca0 2023-10-07T08:44:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.504+0000 7fa726ea5700 1 -- 172.21.15.81:0/6392734 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa70c066f30 msgr2=0x7fa70c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.504+0000 7fa726ea5700 1 --2- 172.21.15.81:0/6392734 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa70c066f30 0x7fa70c0693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa72015c5d0 tx=0x7fa71c009040 comp rx=0 tx=0).stop 2023-10-07T08:44:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.504+0000 7fa726ea5700 1 -- 172.21.15.81:0/6392734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa720157ca0 msgr2=0x7fa72014e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:59.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.504+0000 7fa726ea5700 1 --2- 172.21.15.81:0/6392734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa720157ca0 0x7fa72014e730 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa718009f50 tx=0x7fa718017000 comp rx=0 tx=0).stop 2023-10-07T08:44:59.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.504+0000 7fa726ea5700 1 -- 172.21.15.81:0/6392734 shutdown_connections 2023-10-07T08:44:59.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.504+0000 7fa726ea5700 1 --2- 172.21.15.81:0/6392734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa720157ca0 0x7fa72014e730 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:59.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.504+0000 7fa726ea5700 1 --2- 172.21.15.81:0/6392734 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa70c066f30 0x7fa70c0693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:59.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.504+0000 7fa726ea5700 1 --2- 172.21.15.81:0/6392734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa72006d120 0x7fa72016f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:59.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.504+0000 7fa726ea5700 1 --2- 172.21.15.81:0/6392734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7201578d0 0x7fa7201542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:59.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.504+0000 7fa726ea5700 1 -- 172.21.15.81:0/6392734 >> 172.21.15.81:0/6392734 conn(0x7fa72006bb90 msgr2=0x7fa72015fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:59.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.504+0000 7fa726ea5700 1 -- 172.21.15.81:0/6392734 shutdown_connections 2023-10-07T08:44:59.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.505+0000 7fa726ea5700 1 -- 172.21.15.81:0/6392734 wait complete. 2023-10-07T08:44:59.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-07T08:44:59.648 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_objectstore":"memstore"} 2023-10-07T08:44:59.649 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-07T08:44:59.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T08:44:59.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.764+0000 7fb99e878700 1 Processor -- start 2023-10-07T08:44:59.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.764+0000 7fb99e878700 1 -- start start 2023-10-07T08:44:59.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.765+0000 7fb99e878700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb99815a2a0 0x7fb9980b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.765+0000 7fb99e878700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9980ceb30 0x7fb9980cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.765+0000 7fb99e878700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9980b0ca0 con 0x7fb99806d650 2023-10-07T08:44:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.765+0000 7fb99e878700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99806ea90 con 0x7fb99815a2a0 2023-10-07T08:44:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.765+0000 7fb99e878700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9980cf4c0 con 0x7fb9980ceb30 2023-10-07T08:44:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.765+0000 7fb99ce15700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb99806d650 0x7fb99806da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33266/0 (socket says 172.21.15.81:33266) 2023-10-07T08:44:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.765+0000 7fb99ce15700 1 -- 172.21.15.81:0/3953764769 learned_addr learned my addr 172.21.15.81:0/3953764769 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:44:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.765+0000 7fb997fff700 1 --2- 172.21.15.81:0/3953764769 >> v2:172.21.15.89:3300/0 conn(0x7fb99815a2a0 0x7fb9980b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.766+0000 7fb9977fe700 1 --2- 172.21.15.81:0/3953764769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9980ceb30 0x7fb9980cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.766+0000 7fb996ffd700 1 -- 172.21.15.81:0/3953764769 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093634397 0 0) 0x7fb9980b0ca0 con 0x7fb99806d650 2023-10-07T08:44:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.766+0000 7fb996ffd700 1 -- 172.21.15.81:0/3953764769 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb980003570 con 0x7fb99806d650 2023-10-07T08:44:59.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.766+0000 7fb9977fe700 1 -- 172.21.15.81:0/3953764769 >> v2:172.21.15.89:3300/0 conn(0x7fb99815a2a0 msgr2=0x7fb9980b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:44:59.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.766+0000 7fb9977fe700 1 --2- 172.21.15.81:0/3953764769 >> v2:172.21.15.89:3300/0 conn(0x7fb99815a2a0 0x7fb9980b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:59.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.766+0000 7fb9977fe700 1 -- 172.21.15.81:0/3953764769 >> v1:172.21.15.81:6789/0 conn(0x7fb99806d650 legacy=0x7fb99806da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:59.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.766+0000 7fb9977fe700 1 -- 172.21.15.81:0/3953764769 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9980b00d0 con 0x7fb9980ceb30 2023-10-07T08:44:59.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.766+0000 7fb997fff700 1 --2- 172.21.15.81:0/3953764769 >> v2:172.21.15.89:3300/0 conn(0x7fb99815a2a0 0x7fb9980b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:44:59.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.766+0000 7fb9977fe700 1 --2- 172.21.15.81:0/3953764769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9980ceb30 0x7fb9980cef80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0098e0 tx=0x7fb98c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0518aa41186b10b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:59.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.766+0000 7fb996ffd700 1 -- 172.21.15.81:0/3953764769 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c011630 con 0x7fb9980ceb30 2023-10-07T08:44:59.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.766+0000 7fb996ffd700 1 -- 172.21.15.81:0/3953764769 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c011790 con 0x7fb9980ceb30 2023-10-07T08:44:59.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.766+0000 7fb996ffd700 1 -- 172.21.15.81:0/3953764769 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c011b30 con 0x7fb9980ceb30 2023-10-07T08:44:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.767+0000 7fb99e878700 1 -- 172.21.15.81:0/3953764769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9980ceb30 msgr2=0x7fb9980cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.767+0000 7fb99e878700 1 --2- 172.21.15.81:0/3953764769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9980ceb30 0x7fb9980cef80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0098e0 tx=0x7fb98c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.767+0000 7fb99e878700 1 -- 172.21.15.81:0/3953764769 shutdown_connections 2023-10-07T08:44:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.767+0000 7fb99e878700 1 --2- 172.21.15.81:0/3953764769 >> v2:172.21.15.89:3300/0 conn(0x7fb99815a2a0 0x7fb9980b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.767+0000 7fb99e878700 1 --2- 172.21.15.81:0/3953764769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9980ceb30 0x7fb9980cef80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.767+0000 7fb99e878700 1 -- 172.21.15.81:0/3953764769 >> 172.21.15.81:0/3953764769 conn(0x7fb998067640 msgr2=0x7fb998067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.767+0000 7fb99e878700 1 -- 172.21.15.81:0/3953764769 shutdown_connections 2023-10-07T08:44:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.767+0000 7fb99e878700 1 -- 172.21.15.81:0/3953764769 wait complete. 2023-10-07T08:44:59.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.768+0000 7fb99e878700 1 Processor -- start 2023-10-07T08:44:59.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.768+0000 7fb99e878700 1 -- start start 2023-10-07T08:44:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb99e878700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb99806d650 0x7fb998153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb99e878700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9980ceb30 0x7fb998150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb99e878700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb99815a2a0 0x7fb99815af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb99e878700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb998153d90 con 0x7fb99815a2a0 2023-10-07T08:44:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb99e878700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9980b4080 con 0x7fb99806d650 2023-10-07T08:44:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb99e878700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9980b3470 con 0x7fb9980ceb30 2023-10-07T08:44:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb99ce15700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb99815a2a0 0x7fb99815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb9977fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9980ceb30 0x7fb998150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb99ce15700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb99815a2a0 0x7fb99815af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47034/0 (socket says 172.21.15.81:47034) 2023-10-07T08:44:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb99ce15700 1 -- 172.21.15.81:0/1877714320 learned_addr learned my addr 172.21.15.81:0/1877714320 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:44:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb997fff700 1 --2- 172.21.15.81:0/1877714320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb99806d650 0x7fb998153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb9977fe700 1 -- 172.21.15.81:0/1877714320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb99806d650 msgr2=0x7fb998153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb9977fe700 1 --2- 172.21.15.81:0/1877714320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb99806d650 0x7fb998153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb9977fe700 1 -- 172.21.15.81:0/1877714320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb99815a2a0 msgr2=0x7fb99815af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb9977fe700 1 --2- 172.21.15.81:0/1877714320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb99815a2a0 0x7fb99815af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb9977fe700 1 -- 172.21.15.81:0/1877714320 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb988009420 con 0x7fb9980ceb30 2023-10-07T08:44:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.769+0000 7fb99ce15700 1 --2- 172.21.15.81:0/1877714320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb99815a2a0 0x7fb99815af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:44:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.770+0000 7fb9977fe700 1 --2- 172.21.15.81:0/1877714320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9980ceb30 0x7fb998150270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb98c016000 tx=0x7fb98c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.770+0000 7fb97ffff700 1 -- 172.21.15.81:0/1877714320 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c011900 con 0x7fb9980ceb30 2023-10-07T08:44:59.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.770+0000 7fb97ffff700 1 -- 172.21.15.81:0/1877714320 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c011a60 con 0x7fb9980ceb30 2023-10-07T08:44:59.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.770+0000 7fb99e878700 1 -- 172.21.15.81:0/1877714320 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98c009420 con 0x7fb9980ceb30 2023-10-07T08:44:59.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.770+0000 7fb97ffff700 1 -- 172.21.15.81:0/1877714320 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c025640 con 0x7fb9980ceb30 2023-10-07T08:44:59.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.770+0000 7fb99e878700 1 -- 172.21.15.81:0/1877714320 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9980b3a30 con 0x7fb9980ceb30 2023-10-07T08:44:59.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.771+0000 7fb99e878700 1 -- 172.21.15.81:0/1877714320 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb998069e40 con 0x7fb9980ceb30 2023-10-07T08:44:59.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.771+0000 7fb97ffff700 1 -- 172.21.15.81:0/1877714320 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb98c0193b0 con 0x7fb9980ceb30 2023-10-07T08:44:59.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.771+0000 7fb97ffff700 1 --2- 172.21.15.81:0/1877714320 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb984066f30 0x7fb9840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:44:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.771+0000 7fb97ffff700 1 -- 172.21.15.81:0/1877714320 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb98c0859b0 con 0x7fb9980ceb30 2023-10-07T08:44:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.771+0000 7fb997fff700 1 --2- 172.21.15.81:0/1877714320 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb984066f30 0x7fb9840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:44:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.772+0000 7fb997fff700 1 --2- 172.21.15.81:0/1877714320 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb984066f30 0x7fb9840693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb988009e10 tx=0x7fb9880091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:44:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.777+0000 7fb97ffff700 1 -- 172.21.15.81:0/1877714320 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb98c052f20 con 0x7fb9980ceb30 2023-10-07T08:44:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.960+0000 7fb99e878700 1 -- 172.21.15.81:0/1877714320 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb9980b41c0 con 0x7fb9980ceb30 2023-10-07T08:44:59.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.966+0000 7fb97ffff700 1 -- 172.21.15.81:0/1877714320 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb98c056540 con 0x7fb9980ceb30 2023-10-07T08:44:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.967+0000 7fb99e878700 1 -- 172.21.15.81:0/1877714320 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb984066f30 msgr2=0x7fb9840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.967+0000 7fb99e878700 1 --2- 172.21.15.81:0/1877714320 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb984066f30 0x7fb9840693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb988009e10 tx=0x7fb9880091a0 comp rx=0 tx=0).stop 2023-10-07T08:44:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.967+0000 7fb99e878700 1 -- 172.21.15.81:0/1877714320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9980ceb30 msgr2=0x7fb998150270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:44:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.967+0000 7fb99e878700 1 --2- 172.21.15.81:0/1877714320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9980ceb30 0x7fb998150270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb98c016000 tx=0x7fb98c017000 comp rx=0 tx=0).stop 2023-10-07T08:44:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.967+0000 7fb99e878700 1 -- 172.21.15.81:0/1877714320 shutdown_connections 2023-10-07T08:44:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.967+0000 7fb99e878700 1 --2- 172.21.15.81:0/1877714320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb99815a2a0 0x7fb99815af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.967+0000 7fb99e878700 1 --2- 172.21.15.81:0/1877714320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb99806d650 0x7fb998153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:59.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.967+0000 7fb99e878700 1 --2- 172.21.15.81:0/1877714320 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb984066f30 0x7fb9840693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:59.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.967+0000 7fb99e878700 1 --2- 172.21.15.81:0/1877714320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9980ceb30 0x7fb998150270 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:44:59.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.967+0000 7fb99e878700 1 -- 172.21.15.81:0/1877714320 >> 172.21.15.81:0/1877714320 conn(0x7fb998067640 msgr2=0x7fb9980ccb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:44:59.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.967+0000 7fb99e878700 1 -- 172.21.15.81:0/1877714320 shutdown_connections 2023-10-07T08:44:59.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:44:59.967+0000 7fb99e878700 1 -- 172.21.15.81:0/1877714320 wait complete. 2023-10-07T08:44:59.981 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:44:59.982 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:45:00.020 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:45:00.063 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:45:00.063 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T08:45:00.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:45:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.176+0000 7f1426794700 1 Processor -- start 2023-10-07T08:45:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.176+0000 7f1426794700 1 -- start start 2023-10-07T08:45:00.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.177+0000 7f1426794700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1420157ca0 0x7f14200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.177+0000 7f1426794700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f142006d120 0x7f142006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.177+0000 7f1426794700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14200d07c0 con 0x7f14201578d0 2023-10-07T08:45:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.177+0000 7f1426794700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142006da50 con 0x7f142006d120 2023-10-07T08:45:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.177+0000 7f1426794700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14200cfbb0 con 0x7f1420157ca0 2023-10-07T08:45:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.177+0000 7f1424d31700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f142006d120 0x7f142006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.177+0000 7f1424d31700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f142006d120 0x7f142006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47046/0 (socket says 172.21.15.81:47046) 2023-10-07T08:45:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.177+0000 7f1424d31700 1 -- 172.21.15.81:0/2106094445 learned_addr learned my addr 172.21.15.81:0/2106094445 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.177+0000 7f141f7fe700 1 --2- 172.21.15.81:0/2106094445 >> v2:172.21.15.89:3300/0 conn(0x7f1420157ca0 0x7f14200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f1424d31700 1 -- 172.21.15.81:0/2106094445 >> v2:172.21.15.89:3300/0 conn(0x7f1420157ca0 msgr2=0x7f14200cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f1424d31700 1 --2- 172.21.15.81:0/2106094445 >> v2:172.21.15.89:3300/0 conn(0x7f1420157ca0 0x7f14200cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f1424d31700 1 -- 172.21.15.81:0/2106094445 >> v1:172.21.15.89:6789/0 conn(0x7f14201578d0 legacy=0x7f142015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f1424d31700 1 -- 172.21.15.81:0/2106094445 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14200cfe90 con 0x7f142006d120 2023-10-07T08:45:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f141f7fe700 1 --2- 172.21.15.81:0/2106094445 >> v2:172.21.15.89:3300/0 conn(0x7f1420157ca0 0x7f14200cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:45:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f1424d31700 1 --2- 172.21.15.81:0/2106094445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f142006d120 0x7f142006d510 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1420068510 tx=0x7f1418009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614433c40435eeac server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f141effd700 1 -- 172.21.15.81:0/2106094445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141800e070 con 0x7f142006d120 2023-10-07T08:45:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f141effd700 1 -- 172.21.15.81:0/2106094445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141800ba50 con 0x7f142006d120 2023-10-07T08:45:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f141effd700 1 -- 172.21.15.81:0/2106094445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14180092e0 con 0x7f142006d120 2023-10-07T08:45:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f1426794700 1 -- 172.21.15.81:0/2106094445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f142006d120 msgr2=0x7f142006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f1426794700 1 --2- 172.21.15.81:0/2106094445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f142006d120 0x7f142006d510 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1420068510 tx=0x7f1418009840 comp rx=0 tx=0).stop 2023-10-07T08:45:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f1426794700 1 -- 172.21.15.81:0/2106094445 shutdown_connections 2023-10-07T08:45:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f1426794700 1 --2- 172.21.15.81:0/2106094445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f142006d120 0x7f142006d510 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f1426794700 1 --2- 172.21.15.81:0/2106094445 >> v2:172.21.15.89:3300/0 conn(0x7f1420157ca0 0x7f14200cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f1426794700 1 -- 172.21.15.81:0/2106094445 >> 172.21.15.81:0/2106094445 conn(0x7f142006bb90 msgr2=0x7f142006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f1426794700 1 -- 172.21.15.81:0/2106094445 shutdown_connections 2023-10-07T08:45:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.178+0000 7f1426794700 1 -- 172.21.15.81:0/2106094445 wait complete. 2023-10-07T08:45:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.179+0000 7f1426794700 1 Processor -- start 2023-10-07T08:45:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.180+0000 7f1426794700 1 -- start start 2023-10-07T08:45:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.180+0000 7f1426794700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f142006d120 0x7f1420154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.180+0000 7f1426794700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14201578d0 0x7f14201593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.180+0000 7f1426794700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1420157ca0 0x7f1420159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.180+0000 7f1426794700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14200ad4e0 con 0x7f1420157ca0 2023-10-07T08:45:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.180+0000 7f1426794700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14200ad050 con 0x7f142006d120 2023-10-07T08:45:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.180+0000 7f1426794700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1420154ec0 con 0x7f14201578d0 2023-10-07T08:45:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.181+0000 7f1424d31700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1420157ca0 0x7f1420159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.181+0000 7f1424d31700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1420157ca0 0x7f1420159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47060/0 (socket says 172.21.15.81:47060) 2023-10-07T08:45:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.181+0000 7f1424d31700 1 -- 172.21.15.81:0/2954370874 learned_addr learned my addr 172.21.15.81:0/2954370874 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:00.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.181+0000 7f141ffff700 1 --2- 172.21.15.81:0/2954370874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f142006d120 0x7f1420154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:00.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.181+0000 7f1424d31700 1 -- 172.21.15.81:0/2954370874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14201578d0 msgr2=0x7f14201593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:00.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.181+0000 7f1424d31700 1 --2- 172.21.15.81:0/2954370874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14201578d0 0x7f14201593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:00.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.181+0000 7f1424d31700 1 -- 172.21.15.81:0/2954370874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f142006d120 msgr2=0x7f1420154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:00.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.181+0000 7f1424d31700 1 --2- 172.21.15.81:0/2954370874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f142006d120 0x7f1420154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:00.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.181+0000 7f1424d31700 1 -- 172.21.15.81:0/2954370874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1418009ae0 con 0x7f1420157ca0 2023-10-07T08:45:00.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.181+0000 7f141ffff700 1 --2- 172.21.15.81:0/2954370874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f142006d120 0x7f1420154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:45:00.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.181+0000 7f1424d31700 1 --2- 172.21.15.81:0/2954370874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1420157ca0 0x7f1420159920 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f142006fe20 tx=0x7f1418018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:00.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.181+0000 7f1407fff700 1 -- 172.21.15.81:0/2954370874 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418008e40 con 0x7f1420157ca0 2023-10-07T08:45:00.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.181+0000 7f1407fff700 1 -- 172.21.15.81:0/2954370874 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141800be60 con 0x7f1420157ca0 2023-10-07T08:45:00.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.181+0000 7f1426794700 1 -- 172.21.15.81:0/2954370874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14200aca00 con 0x7f1420157ca0 2023-10-07T08:45:00.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.181+0000 7f1407fff700 1 -- 172.21.15.81:0/2954370874 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14180266b0 con 0x7f1420157ca0 2023-10-07T08:45:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.181+0000 7f1426794700 1 -- 172.21.15.81:0/2954370874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142016a2e0 con 0x7f1420157ca0 2023-10-07T08:45:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.182+0000 7f1426794700 1 -- 172.21.15.81:0/2954370874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1420067ac0 con 0x7f1420157ca0 2023-10-07T08:45:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.182+0000 7f1407fff700 1 -- 172.21.15.81:0/2954370874 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1418003040 con 0x7f1420157ca0 2023-10-07T08:45:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.183+0000 7f1407fff700 1 --2- 172.21.15.81:0/2954370874 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f140c066f30 0x7f140c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.183+0000 7f1407fff700 1 -- 172.21.15.81:0/2954370874 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f14180861f0 con 0x7f1420157ca0 2023-10-07T08:45:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.183+0000 7f141ffff700 1 --2- 172.21.15.81:0/2954370874 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f140c066f30 0x7f140c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.183+0000 7f141ffff700 1 --2- 172.21.15.81:0/2954370874 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f140c066f30 0x7f140c0693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1410001840 tx=0x7f1410009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:00.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.188+0000 7f1407fff700 1 -- 172.21.15.81:0/2954370874 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1418053760 con 0x7f1420157ca0 2023-10-07T08:45:00.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.410+0000 7f1426794700 1 -- 172.21.15.81:0/2954370874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14200ad190 con 0x7f1420157ca0 2023-10-07T08:45:00.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.410+0000 7f1407fff700 1 -- 172.21.15.81:0/2954370874 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f1418021de0 con 0x7f1420157ca0 2023-10-07T08:45:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:45:00.412 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1491348117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1491348117},{"type":"v1","addr":"172.21.15.89:6834","nonce":1491348117}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":4871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/748490276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":748490276},{"type":"v1","addr":"172.21.15.89:6835","nonce":748490276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2260626922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2260626922},{"type":"v1","addr":"172.21.15.81:6835","nonce":2260626922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3217188446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3217188446},{"type":"v1","addr":"172.21.15.81:6837","nonce":3217188446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-10-07T08:45:00.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.412+0000 7f1426794700 1 -- 172.21.15.81:0/2954370874 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f140c066f30 msgr2=0x7f140c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:00.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.412+0000 7f1426794700 1 --2- 172.21.15.81:0/2954370874 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f140c066f30 0x7f140c0693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1410001840 tx=0x7f1410009040 comp rx=0 tx=0).stop 2023-10-07T08:45:00.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.412+0000 7f1426794700 1 -- 172.21.15.81:0/2954370874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1420157ca0 msgr2=0x7f1420159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:00.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.412+0000 7f1426794700 1 --2- 172.21.15.81:0/2954370874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1420157ca0 0x7f1420159920 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f142006fe20 tx=0x7f1418018000 comp rx=0 tx=0).stop 2023-10-07T08:45:00.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.412+0000 7f1426794700 1 -- 172.21.15.81:0/2954370874 shutdown_connections 2023-10-07T08:45:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.412+0000 7f1426794700 1 --2- 172.21.15.81:0/2954370874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1420157ca0 0x7f1420159920 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.412+0000 7f1426794700 1 --2- 172.21.15.81:0/2954370874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f142006d120 0x7f1420154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.412+0000 7f1426794700 1 --2- 172.21.15.81:0/2954370874 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f140c066f30 0x7f140c0693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.412+0000 7f1426794700 1 --2- 172.21.15.81:0/2954370874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14201578d0 0x7f14201593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.412+0000 7f1426794700 1 -- 172.21.15.81:0/2954370874 >> 172.21.15.81:0/2954370874 conn(0x7f142006bb90 msgr2=0x7f1420155470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.412+0000 7f1426794700 1 -- 172.21.15.81:0/2954370874 shutdown_connections 2023-10-07T08:45:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.412+0000 7f1426794700 1 -- 172.21.15.81:0/2954370874 wait complete. 2023-10-07T08:45:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2023-10-07T08:45:00.426 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T08:45:00.426 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T08:45:00.426 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T08:45:00.426 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:45:00.427 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T08:45:00.427 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T08:45:00.427 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T08:45:00.427 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:45:00.427 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T08:45:00.427 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T08:45:00.428 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T08:45:00.428 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:45:00.428 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T08:45:00.428 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T08:45:00.428 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T08:45:00.428 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:45:00.435 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T08:45:00.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T08:45:00.436 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T08:45:00.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T08:45:00.438 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T08:45:00.438 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T08:45:00.439 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T08:45:00.439 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T08:45:00.477 INFO:tasks.ceph.mds.a:Started 2023-10-07T08:45:00.478 DEBUG:teuthology.parallel:result is None 2023-10-07T08:45:00.478 INFO:tasks.ceph.mds.c:Started 2023-10-07T08:45:00.478 DEBUG:teuthology.parallel:result is None 2023-10-07T08:45:00.481 INFO:tasks.ceph.mds.b:Started 2023-10-07T08:45:00.481 DEBUG:teuthology.parallel:result is None 2023-10-07T08:45:00.481 INFO:tasks.ceph.mds.d:Started 2023-10-07T08:45:00.482 DEBUG:teuthology.parallel:result is None 2023-10-07T08:45:00.482 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T08:45:00.558 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-07T08:45:00.558 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-07T08:45:00.561 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-10-07T08:45:00.561 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-10-07T08:45:00.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.600+0000 7f7e45eda700 1 Processor -- start 2023-10-07T08:45:00.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.600+0000 7f7e45eda700 1 -- start start 2023-10-07T08:45:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.601+0000 7f7e45eda700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7e40157ca0 0x7f7e400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.601+0000 7f7e45eda700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e4006d120 0x7f7e4006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.601+0000 7f7e45eda700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e400d07c0 con 0x7f7e401578d0 2023-10-07T08:45:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.601+0000 7f7e45eda700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4006daa0 con 0x7f7e40157ca0 2023-10-07T08:45:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.601+0000 7f7e45eda700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400cfbb0 con 0x7f7e4006d120 2023-10-07T08:45:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.601+0000 7f7e3effd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7e40157ca0 0x7f7e400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.601+0000 7f7e3ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e4006d120 0x7f7e4006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.601+0000 7f7e3effd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7e40157ca0 0x7f7e400cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:54606/0 (socket says 172.21.15.81:54606) 2023-10-07T08:45:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.601+0000 7f7e3ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e4006d120 0x7f7e4006d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:33444/0 (socket says 172.21.15.81:33444) 2023-10-07T08:45:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.601+0000 7f7e3f7fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7e401578d0 0x7f7e4015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:39906/0 (socket says 172.21.15.81:39906) 2023-10-07T08:45:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.601+0000 7f7e3effd700 1 -- 172.21.15.81:0/3035980037 learned_addr learned my addr 172.21.15.81:0/3035980037 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.601+0000 7f7e3effd700 1 -- 172.21.15.81:0/3035980037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e4006d120 msgr2=0x7f7e4006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.601+0000 7f7e3effd700 1 --2- 172.21.15.81:0/3035980037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e4006d120 0x7f7e4006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.601+0000 7f7e3effd700 1 -- 172.21.15.81:0/3035980037 >> v1:172.21.15.89:6789/0 conn(0x7f7e401578d0 legacy=0x7f7e4015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.601+0000 7f7e3effd700 1 -- 172.21.15.81:0/3035980037 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e400cfe90 con 0x7f7e40157ca0 2023-10-07T08:45:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.601+0000 7f7e3effd700 1 --2- 172.21.15.81:0/3035980037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e40157ca0 0x7f7e400cf4f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7e340099b0 tx=0x7f7e34009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=396f1bb7f54de966 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.602+0000 7f7e3e7fc700 1 -- 172.21.15.81:0/3035980037 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34009ea0 con 0x7f7e40157ca0 2023-10-07T08:45:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.602+0000 7f7e3e7fc700 1 -- 172.21.15.81:0/3035980037 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3400b860 con 0x7f7e40157ca0 2023-10-07T08:45:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.602+0000 7f7e3e7fc700 1 -- 172.21.15.81:0/3035980037 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3400bc00 con 0x7f7e40157ca0 2023-10-07T08:45:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.602+0000 7f7e45eda700 1 -- 172.21.15.81:0/3035980037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e40157ca0 msgr2=0x7f7e400cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.602+0000 7f7e45eda700 1 --2- 172.21.15.81:0/3035980037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e40157ca0 0x7f7e400cf4f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7e340099b0 tx=0x7f7e34009250 comp rx=0 tx=0).stop 2023-10-07T08:45:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.602+0000 7f7e45eda700 1 -- 172.21.15.81:0/3035980037 shutdown_connections 2023-10-07T08:45:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.602+0000 7f7e45eda700 1 --2- 172.21.15.81:0/3035980037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e4006d120 0x7f7e4006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.602+0000 7f7e45eda700 1 --2- 172.21.15.81:0/3035980037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e40157ca0 0x7f7e400cf4f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.602+0000 7f7e45eda700 1 -- 172.21.15.81:0/3035980037 >> 172.21.15.81:0/3035980037 conn(0x7f7e4006bb90 msgr2=0x7f7e4006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.602+0000 7f7e45eda700 1 -- 172.21.15.81:0/3035980037 shutdown_connections 2023-10-07T08:45:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.602+0000 7f7e45eda700 1 -- 172.21.15.81:0/3035980037 wait complete. 2023-10-07T08:45:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.603+0000 7f7e45eda700 1 Processor -- start 2023-10-07T08:45:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.603+0000 7f7e45eda700 1 -- start start 2023-10-07T08:45:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.604+0000 7f7e45eda700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e4006d120 0x7f7e40153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.604+0000 7f7e45eda700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e401578d0 0x7f7e400ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.604+0000 7f7e45eda700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e40157ca0 0x7f7e400aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.604+0000 7f7e45eda700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400ad260 con 0x7f7e401578d0 2023-10-07T08:45:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.604+0000 7f7e45eda700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400acf80 con 0x7f7e40157ca0 2023-10-07T08:45:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.604+0000 7f7e45eda700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400b3d40 con 0x7f7e4006d120 2023-10-07T08:45:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.604+0000 7f7e3effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e401578d0 0x7f7e400ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.604+0000 7f7e3effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e401578d0 0x7f7e400ac470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47092/0 (socket says 172.21.15.81:47092) 2023-10-07T08:45:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.604+0000 7f7e3effd700 1 -- 172.21.15.81:0/980539727 learned_addr learned my addr 172.21.15.81:0/980539727 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.604+0000 7f7e3f7fe700 1 --2- 172.21.15.81:0/980539727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e4006d120 0x7f7e40153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.604+0000 7f7e3ffff700 1 --2- 172.21.15.81:0/980539727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e40157ca0 0x7f7e400aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.605+0000 7f7e3effd700 1 -- 172.21.15.81:0/980539727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e4006d120 msgr2=0x7f7e40153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.605+0000 7f7e3effd700 1 --2- 172.21.15.81:0/980539727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e4006d120 0x7f7e40153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.605+0000 7f7e3effd700 1 -- 172.21.15.81:0/980539727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e40157ca0 msgr2=0x7f7e400aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.605+0000 7f7e3effd700 1 --2- 172.21.15.81:0/980539727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e40157ca0 0x7f7e400aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.605+0000 7f7e3effd700 1 -- 172.21.15.81:0/980539727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e340094f0 con 0x7f7e401578d0 2023-10-07T08:45:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.605+0000 7f7e3effd700 1 --2- 172.21.15.81:0/980539727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e401578d0 0x7f7e400ac470 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7e4006fe20 tx=0x7f7e34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.605+0000 7f7e277fe700 1 -- 172.21.15.81:0/980539727 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34000d10 con 0x7f7e401578d0 2023-10-07T08:45:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.605+0000 7f7e45eda700 1 -- 172.21.15.81:0/980539727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e400b4020 con 0x7f7e401578d0 2023-10-07T08:45:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.605+0000 7f7e277fe700 1 -- 172.21.15.81:0/980539727 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3400bbe0 con 0x7f7e401578d0 2023-10-07T08:45:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.605+0000 7f7e277fe700 1 -- 172.21.15.81:0/980539727 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34011670 con 0x7f7e401578d0 2023-10-07T08:45:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.605+0000 7f7e45eda700 1 -- 172.21.15.81:0/980539727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e400b6620 con 0x7f7e401578d0 2023-10-07T08:45:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.606+0000 7f7e45eda700 1 -- 172.21.15.81:0/980539727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e400b3ba0 con 0x7f7e401578d0 2023-10-07T08:45:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.606+0000 7f7e277fe700 1 -- 172.21.15.81:0/980539727 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e34011aa0 con 0x7f7e401578d0 2023-10-07T08:45:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.607+0000 7f7e277fe700 1 --2- 172.21.15.81:0/980539727 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e2c066f30 0x7f7e2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.607+0000 7f7e277fe700 1 -- 172.21.15.81:0/980539727 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7e34085990 con 0x7f7e401578d0 2023-10-07T08:45:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.607+0000 7f7e3f7fe700 1 --2- 172.21.15.81:0/980539727 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e2c066f30 0x7f7e2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.607+0000 7f7e3f7fe700 1 --2- 172.21.15.81:0/980539727 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e2c066f30 0x7f7e2c0693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7e300020c0 tx=0x7f7e30001ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.612+0000 7f7e277fe700 1 -- 172.21.15.81:0/980539727 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e400b3ba0 con 0x7f7e401578d0 2023-10-07T08:45:00.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:00.810+0000 7f7e45eda700 1 -- 172.21.15.81:0/980539727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7e400b4540 con 0x7f7e401578d0 2023-10-07T08:45:01.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:01.989+0000 7f7e277fe700 1 -- 172.21.15.81:0/980539727 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v63) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7e400b4540 con 0x7f7e401578d0 2023-10-07T08:45:01.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:01.991+0000 7f7e45eda700 1 -- 172.21.15.81:0/980539727 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e2c066f30 msgr2=0x7f7e2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:01.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:01.991+0000 7f7e45eda700 1 --2- 172.21.15.81:0/980539727 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e2c066f30 0x7f7e2c0693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7e300020c0 tx=0x7f7e30001ad0 comp rx=0 tx=0).stop 2023-10-07T08:45:01.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:01.991+0000 7f7e45eda700 1 -- 172.21.15.81:0/980539727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e401578d0 msgr2=0x7f7e400ac470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:01.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:01.991+0000 7f7e45eda700 1 --2- 172.21.15.81:0/980539727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e401578d0 0x7f7e400ac470 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7e4006fe20 tx=0x7f7e34017000 comp rx=0 tx=0).stop 2023-10-07T08:45:01.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:01.991+0000 7f7e45eda700 1 -- 172.21.15.81:0/980539727 shutdown_connections 2023-10-07T08:45:01.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:01.991+0000 7f7e45eda700 1 --2- 172.21.15.81:0/980539727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e40157ca0 0x7f7e400aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:01.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:01.991+0000 7f7e45eda700 1 --2- 172.21.15.81:0/980539727 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e2c066f30 0x7f7e2c0693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:01.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:01.991+0000 7f7e45eda700 1 --2- 172.21.15.81:0/980539727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e4006d120 0x7f7e40153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:01.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:01.991+0000 7f7e45eda700 1 --2- 172.21.15.81:0/980539727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e401578d0 0x7f7e400ac470 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:01.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:01.991+0000 7f7e45eda700 1 -- 172.21.15.81:0/980539727 >> 172.21.15.81:0/980539727 conn(0x7f7e4006bb90 msgr2=0x7f7e40068da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:01.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:01.991+0000 7f7e45eda700 1 -- 172.21.15.81:0/980539727 shutdown_connections 2023-10-07T08:45:01.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:01.991+0000 7f7e45eda700 1 -- 172.21.15.81:0/980539727 wait complete. 2023-10-07T08:45:01.993 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-07T08:45:02.005 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T08:45:02.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.121+0000 7f68b35d5700 1 Processor -- start 2023-10-07T08:45:02.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.121+0000 7f68b35d5700 1 -- start start 2023-10-07T08:45:02.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b35d5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68ac1578d0 0x7f68ac0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b35d5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f68ac157ca0 0x7f68ac15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b35d5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ac0d07c0 con 0x7f68ac06d120 2023-10-07T08:45:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b35d5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ac0cfbb0 con 0x7f68ac157ca0 2023-10-07T08:45:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b35d5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac0cfe90 con 0x7f68ac1578d0 2023-10-07T08:45:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b0b70700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f68ac157ca0 0x7f68ac15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b1371700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68ac1578d0 0x7f68ac0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b1371700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68ac1578d0 0x7f68ac0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:33464/0 (socket says 172.21.15.81:33464) 2023-10-07T08:45:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b1371700 1 -- 172.21.15.81:0/2510916995 learned_addr learned my addr 172.21.15.81:0/2510916995 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b1b72700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f68ac06d120 0x7f68ac15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:39916/0 (socket says 172.21.15.81:39916) 2023-10-07T08:45:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b0b70700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f68ac157ca0 0x7f68ac15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:54622/0 (socket says 172.21.15.81:54622) 2023-10-07T08:45:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b1371700 1 -- 172.21.15.81:0/2510916995 >> v2:172.21.15.89:3300/0 conn(0x7f68ac157ca0 msgr2=0x7f68ac15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:02.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b1371700 1 --2- 172.21.15.81:0/2510916995 >> v2:172.21.15.89:3300/0 conn(0x7f68ac157ca0 0x7f68ac15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b1371700 1 -- 172.21.15.81:0/2510916995 >> v1:172.21.15.89:6789/0 conn(0x7f68ac06d120 legacy=0x7f68ac15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:02.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b1371700 1 -- 172.21.15.81:0/2510916995 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac0d0170 con 0x7f68ac1578d0 2023-10-07T08:45:02.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b0b70700 1 --2- 172.21.15.81:0/2510916995 >> v2:172.21.15.89:3300/0 conn(0x7f68ac157ca0 0x7f68ac15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:45:02.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.122+0000 7f68b1371700 1 --2- 172.21.15.81:0/2510916995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68ac1578d0 0x7f68ac0cf4f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f68a4009f20 tx=0x7f68a4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7072981f24f9918c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:02.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.123+0000 7f68abfff700 1 -- 172.21.15.81:0/2510916995 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a400e070 con 0x7f68ac1578d0 2023-10-07T08:45:02.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.123+0000 7f68abfff700 1 -- 172.21.15.81:0/2510916995 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a400b9d0 con 0x7f68ac1578d0 2023-10-07T08:45:02.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.123+0000 7f68abfff700 1 -- 172.21.15.81:0/2510916995 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a40092e0 con 0x7f68ac1578d0 2023-10-07T08:45:02.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.123+0000 7f68b35d5700 1 -- 172.21.15.81:0/2510916995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68ac1578d0 msgr2=0x7f68ac0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:02.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.123+0000 7f68b35d5700 1 --2- 172.21.15.81:0/2510916995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68ac1578d0 0x7f68ac0cf4f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f68a4009f20 tx=0x7f68a4009840 comp rx=0 tx=0).stop 2023-10-07T08:45:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.123+0000 7f68b35d5700 1 -- 172.21.15.81:0/2510916995 shutdown_connections 2023-10-07T08:45:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.123+0000 7f68b35d5700 1 --2- 172.21.15.81:0/2510916995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68ac1578d0 0x7f68ac0cf4f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.123+0000 7f68b35d5700 1 --2- 172.21.15.81:0/2510916995 >> v2:172.21.15.89:3300/0 conn(0x7f68ac157ca0 0x7f68ac15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.123+0000 7f68b35d5700 1 -- 172.21.15.81:0/2510916995 >> 172.21.15.81:0/2510916995 conn(0x7f68ac06bb90 msgr2=0x7f68ac06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.123+0000 7f68b35d5700 1 -- 172.21.15.81:0/2510916995 shutdown_connections 2023-10-07T08:45:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.123+0000 7f68b35d5700 1 -- 172.21.15.81:0/2510916995 wait complete. 2023-10-07T08:45:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.124+0000 7f68b35d5700 1 Processor -- start 2023-10-07T08:45:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.124+0000 7f68b35d5700 1 -- start start 2023-10-07T08:45:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.125+0000 7f68b35d5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68ac06d120 0x7f68ac154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.125+0000 7f68b35d5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68ac1578d0 0x7f68ac0ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.125+0000 7f68b35d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ac157ca0 0x7f68ac16b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.125+0000 7f68b35d5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac0b1510 con 0x7f68ac157ca0 2023-10-07T08:45:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.125+0000 7f68b35d5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac1550d0 con 0x7f68ac06d120 2023-10-07T08:45:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.125+0000 7f68b35d5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac0b0890 con 0x7f68ac1578d0 2023-10-07T08:45:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.125+0000 7f68b1b72700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ac157ca0 0x7f68ac16b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.125+0000 7f68b1b72700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ac157ca0 0x7f68ac16b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47104/0 (socket says 172.21.15.81:47104) 2023-10-07T08:45:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.125+0000 7f68b1b72700 1 -- 172.21.15.81:0/930902216 learned_addr learned my addr 172.21.15.81:0/930902216 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.125+0000 7f68b0b70700 1 --2- 172.21.15.81:0/930902216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68ac1578d0 0x7f68ac0ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.125+0000 7f68b1371700 1 --2- 172.21.15.81:0/930902216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68ac06d120 0x7f68ac154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.126+0000 7f68b1b72700 1 -- 172.21.15.81:0/930902216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68ac1578d0 msgr2=0x7f68ac0ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.126+0000 7f68b1b72700 1 --2- 172.21.15.81:0/930902216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68ac1578d0 0x7f68ac0ab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.126+0000 7f68b1b72700 1 -- 172.21.15.81:0/930902216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68ac06d120 msgr2=0x7f68ac154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.126+0000 7f68b1b72700 1 --2- 172.21.15.81:0/930902216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68ac06d120 0x7f68ac154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.126+0000 7f68b1b72700 1 -- 172.21.15.81:0/930902216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a0009420 con 0x7f68ac157ca0 2023-10-07T08:45:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.126+0000 7f68b1371700 1 --2- 172.21.15.81:0/930902216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68ac06d120 0x7f68ac154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:45:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.126+0000 7f68b1b72700 1 --2- 172.21.15.81:0/930902216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ac157ca0 0x7f68ac16b1e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f689c00c5c0 tx=0x7f689c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.126+0000 7f68a97fa700 1 -- 172.21.15.81:0/930902216 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c005a70 con 0x7f68ac157ca0 2023-10-07T08:45:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.126+0000 7f68a97fa700 1 -- 172.21.15.81:0/930902216 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c005bd0 con 0x7f68ac157ca0 2023-10-07T08:45:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.126+0000 7f68b35d5700 1 -- 172.21.15.81:0/930902216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a4009ae0 con 0x7f68ac157ca0 2023-10-07T08:45:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.126+0000 7f68a97fa700 1 -- 172.21.15.81:0/930902216 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c0070d0 con 0x7f68ac157ca0 2023-10-07T08:45:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.126+0000 7f68b35d5700 1 -- 172.21.15.81:0/930902216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ac0b0e50 con 0x7f68ac157ca0 2023-10-07T08:45:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.127+0000 7f68b35d5700 1 -- 172.21.15.81:0/930902216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ac067ac0 con 0x7f68ac157ca0 2023-10-07T08:45:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.127+0000 7f68a97fa700 1 -- 172.21.15.81:0/930902216 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f689c0074c0 con 0x7f68ac157ca0 2023-10-07T08:45:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.128+0000 7f68a97fa700 1 --2- 172.21.15.81:0/930902216 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6898066f30 0x7f68980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.128+0000 7f68b1371700 1 --2- 172.21.15.81:0/930902216 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6898066f30 0x7f68980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.128+0000 7f68a97fa700 1 -- 172.21.15.81:0/930902216 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f689c0836c0 con 0x7f68ac157ca0 2023-10-07T08:45:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.128+0000 7f68b1371700 1 --2- 172.21.15.81:0/930902216 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6898066f30 0x7f68980693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f68ac0b6c80 tx=0x7f68a4018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:02.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.132+0000 7f68a97fa700 1 -- 172.21.15.81:0/930902216 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f689c050c80 con 0x7f68ac157ca0 2023-10-07T08:45:02.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.382+0000 7f68b35d5700 1 -- 172.21.15.81:0/930902216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f68ac0d0450 con 0x7f68ac157ca0 2023-10-07T08:45:02.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.382+0000 7f68a97fa700 1 -- 172.21.15.81:0/930902216 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f689c017090 con 0x7f68ac157ca0 2023-10-07T08:45:02.383 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:45:02.383 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:45:02.383 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-07T08:45:02.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.384 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-07T08:45:02.384 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlK8v0EhAAyj+l+ifyEevPT96HbuWzkw==", 2023-10-07T08:45:02.384 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.384 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:45:02.384 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:45:02.384 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:45:02.384 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:45:02.384 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.384 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-07T08:45:02.385 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlN0UcHhAA0o1jHEL9Ow40VDezKTunOw==", 2023-10-07T08:45:02.385 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.385 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:45:02.385 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:45:02.385 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:45:02.385 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:45:02.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.385 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-07T08:45:02.385 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlvsm6GRAApZehzqt3HugU+h9RGWQh8g==", 2023-10-07T08:45:02.385 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.386 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:45:02.386 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:45:02.386 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:45:02.386 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:45:02.386 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.386 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-07T08:45:02.386 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8XLiJBAAMBqSo/+NZuuL/pPnTitAUw==", 2023-10-07T08:45:02.386 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.387 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:45:02.387 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:45:02.387 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:45:02.387 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:45:02.387 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.387 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-07T08:45:02.387 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD2GSFlwYNOOBAAMpoFTAZdRERvqFbI4Lno9g==", 2023-10-07T08:45:02.387 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.387 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:45:02.387 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:45:02.388 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:45:02.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.388 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-07T08:45:02.388 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlejEnBBAAsnZCgsTTMWvqr2n4FfgWCQ==", 2023-10-07T08:45:02.388 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.388 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:45:02.388 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:45:02.388 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:45:02.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.389 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-07T08:45:02.389 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlDjS3DRAAfyBS9XSkAY6Se+RNw9jwWw==", 2023-10-07T08:45:02.389 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.389 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:45:02.389 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:45:02.389 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:45:02.389 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.389 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-07T08:45:02.389 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlnLaEFxAAtQ3AxrEGCcXYvJF2/wP1yw==", 2023-10-07T08:45:02.390 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.390 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:45:02.390 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:45:02.390 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:45:02.390 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.390 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-07T08:45:02.390 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlllNdIRAAXgD+PAR1Piya6p94xfGbXA==", 2023-10-07T08:45:02.390 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.390 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:45:02.390 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:45:02.390 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:45:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-07T08:45:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFleIM7KBAAIz+WlbgsmtAuSMPO+kh/Xw==", 2023-10-07T08:45:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:45:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:45:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:45:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-07T08:45:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlFNlEMRAAt7dpMTylOj0KsJy/law6Nw==", 2023-10-07T08:45:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:45:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:45:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:45:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-07T08:45:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFloCRbOhAA8XzXVwVYYYZIJV+F84EiDQ==", 2023-10-07T08:45:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:45:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:45:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:45:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-07T08:45:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl7cS0KBAA2K6kkFjyEZYa0xYx53Nf7g==", 2023-10-07T08:45:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:45:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-07T08:45:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T08:45:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.394 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-07T08:45:02.394 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlP3EBMRAAWXcQeEkoEzBCSQzvz/AzBQ==", 2023-10-07T08:45:02.394 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.394 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:45:02.394 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:45:02.394 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:45:02.394 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:45:02.394 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.395 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-07T08:45:02.395 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFldtgKLhAAX8L0S1NgyHsOj4cUljxH/A==", 2023-10-07T08:45:02.395 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.395 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:45:02.395 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:45:02.395 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:45:02.395 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:45:02.395 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.395 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-07T08:45:02.395 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlJ+VXNhAA9sXFpdOEIZxQLiS8LJwa3A==", 2023-10-07T08:45:02.395 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.396 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:45:02.396 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:45:02.396 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:45:02.396 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:45:02.396 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.396 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-07T08:45:02.396 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDyGSFle021MxAA39oudTkATALz6ZklfA0QQA==", 2023-10-07T08:45:02.396 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.396 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:45:02.396 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:45:02.397 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:45:02.397 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:45:02.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.397 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-07T08:45:02.397 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8c3zDxAAKU/DHPPZhFJ1MKw48C6lJQ==", 2023-10-07T08:45:02.397 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.397 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:45:02.397 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:45:02.397 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:45:02.398 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:45:02.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:02.398 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-07T08:45:02.398 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlByYuDBAA2xkiT3FNBRXjSMlu+GdRjg==", 2023-10-07T08:45:02.398 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:45:02.398 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:45:02.398 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:45:02.398 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:45:02.398 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.399 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:02.399 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:45:02.399 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:45:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.384+0000 7f68b35d5700 1 -- 172.21.15.81:0/930902216 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6898066f30 msgr2=0x7f68980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.384+0000 7f68b35d5700 1 --2- 172.21.15.81:0/930902216 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6898066f30 0x7f68980693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f68ac0b6c80 tx=0x7f68a4018000 comp rx=0 tx=0).stop 2023-10-07T08:45:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.384+0000 7f68b35d5700 1 -- 172.21.15.81:0/930902216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ac157ca0 msgr2=0x7f68ac16b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.384+0000 7f68b35d5700 1 --2- 172.21.15.81:0/930902216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ac157ca0 0x7f68ac16b1e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f689c00c5c0 tx=0x7f689c007ef0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.384+0000 7f68b35d5700 1 -- 172.21.15.81:0/930902216 shutdown_connections 2023-10-07T08:45:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.384+0000 7f68b35d5700 1 --2- 172.21.15.81:0/930902216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68ac157ca0 0x7f68ac16b1e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.384+0000 7f68b35d5700 1 --2- 172.21.15.81:0/930902216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68ac06d120 0x7f68ac154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.384+0000 7f68b35d5700 1 --2- 172.21.15.81:0/930902216 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6898066f30 0x7f68980693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.384+0000 7f68b35d5700 1 --2- 172.21.15.81:0/930902216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68ac1578d0 0x7f68ac0ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.384+0000 7f68b35d5700 1 -- 172.21.15.81:0/930902216 >> 172.21.15.81:0/930902216 conn(0x7f68ac06bb90 msgr2=0x7f68ac1568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.384+0000 7f68b35d5700 1 -- 172.21.15.81:0/930902216 shutdown_connections 2023-10-07T08:45:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.384+0000 7f68b35d5700 1 -- 172.21.15.81:0/930902216 wait complete. 2023-10-07T08:45:02.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:45:02.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.516+0000 7f087d8a4700 1 Processor -- start 2023-10-07T08:45:02.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.516+0000 7f087d8a4700 1 -- start start 2023-10-07T08:45:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.517+0000 7f087d8a4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08780ce1f0 0x7f08780aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.517+0000 7f087d8a4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087815dfb0 con 0x7f08780ce5c0 2023-10-07T08:45:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.517+0000 7f087d8a4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08780acec0 con 0x7f08780ac570 2023-10-07T08:45:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.517+0000 7f087d8a4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08780ad1a0 con 0x7f08780ce1f0 2023-10-07T08:45:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.517+0000 7f0876ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08780ce1f0 0x7f08780aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.517+0000 7f086e7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f08780ce5c0 0x7f087815e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37836/0 (socket says 172.21.15.81:37836) 2023-10-07T08:45:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.517+0000 7f086e7fc700 1 -- 172.21.15.81:0/3586178090 learned_addr learned my addr 172.21.15.81:0/3586178090 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:45:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.518+0000 7f0876ffd700 1 -- 172.21.15.81:0/3586178090 >> v1:172.21.15.89:6789/0 conn(0x7f08780ac570 legacy=0x7f087806e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.518+0000 7f0876ffd700 1 -- 172.21.15.81:0/3586178090 >> v1:172.21.15.81:6789/0 conn(0x7f08780ce5c0 legacy=0x7f087815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.518+0000 7f0876ffd700 1 -- 172.21.15.81:0/3586178090 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087815dc40 con 0x7f08780ce1f0 2023-10-07T08:45:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.518+0000 7f0876ffd700 1 --2- 172.21.15.81:0/3586178090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08780ce1f0 0x7f08780aacf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0868009e60 tx=0x7f0868009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99e2d3678deb06e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.518+0000 7f08767fc700 1 -- 172.21.15.81:0/3586178090 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086800e070 con 0x7f08780ce1f0 2023-10-07T08:45:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.518+0000 7f08767fc700 1 -- 172.21.15.81:0/3586178090 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086800bbf0 con 0x7f08780ce1f0 2023-10-07T08:45:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.518+0000 7f08767fc700 1 -- 172.21.15.81:0/3586178090 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868012430 con 0x7f08780ce1f0 2023-10-07T08:45:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.518+0000 7f087d8a4700 1 -- 172.21.15.81:0/3586178090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08780ce1f0 msgr2=0x7f08780aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.518+0000 7f087d8a4700 1 --2- 172.21.15.81:0/3586178090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08780ce1f0 0x7f08780aacf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0868009e60 tx=0x7f0868009780 comp rx=0 tx=0).stop 2023-10-07T08:45:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.518+0000 7f087d8a4700 1 -- 172.21.15.81:0/3586178090 shutdown_connections 2023-10-07T08:45:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.518+0000 7f087d8a4700 1 --2- 172.21.15.81:0/3586178090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08780ce1f0 0x7f08780aacf0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.518+0000 7f087d8a4700 1 -- 172.21.15.81:0/3586178090 >> 172.21.15.81:0/3586178090 conn(0x7f087806cca0 msgr2=0x7f087806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.518+0000 7f087d8a4700 1 -- 172.21.15.81:0/3586178090 shutdown_connections 2023-10-07T08:45:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.518+0000 7f087d8a4700 1 -- 172.21.15.81:0/3586178090 wait complete. 2023-10-07T08:45:02.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.520+0000 7f087d8a4700 1 Processor -- start 2023-10-07T08:45:02.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.520+0000 7f087d8a4700 1 -- start start 2023-10-07T08:45:02.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.520+0000 7f087d8a4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08780ac570 0x7f0878143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.520+0000 7f087d8a4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08780ce1f0 0x7f08780b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.520+0000 7f087d8a4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08780ce5c0 0x7f08780b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.520+0000 7f087d8a4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087815b300 con 0x7f08780ce5c0 2023-10-07T08:45:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.520+0000 7f087d8a4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087815b8c0 con 0x7f08780ac570 2023-10-07T08:45:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.520+0000 7f087d8a4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08780b2700 con 0x7f08780ce1f0 2023-10-07T08:45:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.521+0000 7f08777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08780ce5c0 0x7f08780b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.521+0000 7f08777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08780ce5c0 0x7f08780b2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52260/0 (socket says 172.21.15.81:52260) 2023-10-07T08:45:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.521+0000 7f08777fe700 1 -- 172.21.15.81:0/1737612856 learned_addr learned my addr 172.21.15.81:0/1737612856 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.521+0000 7f086e7fc700 1 --2- 172.21.15.81:0/1737612856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08780ce1f0 0x7f08780b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.521+0000 7f08777fe700 1 -- 172.21.15.81:0/1737612856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08780ce1f0 msgr2=0x7f08780b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.521+0000 7f0876ffd700 1 --2- 172.21.15.81:0/1737612856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08780ac570 0x7f0878143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.521+0000 7f08777fe700 1 --2- 172.21.15.81:0/1737612856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08780ce1f0 0x7f08780b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.521+0000 7f08777fe700 1 -- 172.21.15.81:0/1737612856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08780ac570 msgr2=0x7f0878143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.521+0000 7f08777fe700 1 --2- 172.21.15.81:0/1737612856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08780ac570 0x7f0878143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.521+0000 7f08777fe700 1 -- 172.21.15.81:0/1737612856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0868009a20 con 0x7f08780ce5c0 2023-10-07T08:45:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.521+0000 7f08777fe700 1 --2- 172.21.15.81:0/1737612856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08780ce5c0 0x7f08780b2110 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f087000b4e0 tx=0x7f0870009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.521+0000 7f086f7fe700 1 -- 172.21.15.81:0/1737612856 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087000f5e0 con 0x7f08780ce5c0 2023-10-07T08:45:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.521+0000 7f086f7fe700 1 -- 172.21.15.81:0/1737612856 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087000f760 con 0x7f08780ce5c0 2023-10-07T08:45:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.521+0000 7f086f7fe700 1 -- 172.21.15.81:0/1737612856 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087000fb20 con 0x7f08780ce5c0 2023-10-07T08:45:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.521+0000 7f087d8a4700 1 -- 172.21.15.81:0/1737612856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08780b29e0 con 0x7f08780ce5c0 2023-10-07T08:45:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.521+0000 7f087d8a4700 1 -- 172.21.15.81:0/1737612856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0878154e20 con 0x7f08780ce5c0 2023-10-07T08:45:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.522+0000 7f087d8a4700 1 -- 172.21.15.81:0/1737612856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087815ba30 con 0x7f08780ce5c0 2023-10-07T08:45:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.522+0000 7f086f7fe700 1 -- 172.21.15.81:0/1737612856 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f087001a400 con 0x7f08780ce5c0 2023-10-07T08:45:02.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.523+0000 7f086f7fe700 1 --2- 172.21.15.81:0/1737612856 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0858066f30 0x7f08580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.523+0000 7f0876ffd700 1 --2- 172.21.15.81:0/1737612856 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0858066f30 0x7f08580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.523+0000 7f086f7fe700 1 -- 172.21.15.81:0/1737612856 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0870083d20 con 0x7f08780ce5c0 2023-10-07T08:45:02.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.523+0000 7f0876ffd700 1 --2- 172.21.15.81:0/1737612856 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0858066f30 0x7f08580693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f087815d780 tx=0x7f0868018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.527+0000 7f086f7fe700 1 -- 172.21.15.81:0/1737612856 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0870051360 con 0x7f08780ce5c0 2023-10-07T08:45:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.708+0000 7f087d8a4700 1 -- 172.21.15.81:0/1737612856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f087806e940 con 0x7f08780ce5c0 2023-10-07T08:45:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.709+0000 7f086f7fe700 1 -- 172.21.15.81:0/1737612856 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+12086 (secure 0 0 0) 0x7f087000fed0 con 0x7f08780ce5c0 2023-10-07T08:45:02.709 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:45:02.710 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":63,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:45:01.985717+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:45:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.711+0000 7f087d8a4700 1 -- 172.21.15.81:0/1737612856 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0858066f30 msgr2=0x7f08580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.711+0000 7f087d8a4700 1 --2- 172.21.15.81:0/1737612856 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0858066f30 0x7f08580693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f087815d780 tx=0x7f0868018000 comp rx=0 tx=0).stop 2023-10-07T08:45:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.711+0000 7f087d8a4700 1 -- 172.21.15.81:0/1737612856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08780ce5c0 msgr2=0x7f08780b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.711+0000 7f087d8a4700 1 --2- 172.21.15.81:0/1737612856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08780ce5c0 0x7f08780b2110 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f087000b4e0 tx=0x7f0870009060 comp rx=0 tx=0).stop 2023-10-07T08:45:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.711+0000 7f087d8a4700 1 -- 172.21.15.81:0/1737612856 shutdown_connections 2023-10-07T08:45:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.711+0000 7f087d8a4700 1 --2- 172.21.15.81:0/1737612856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08780ce5c0 0x7f08780b2110 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.711+0000 7f087d8a4700 1 --2- 172.21.15.81:0/1737612856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08780ac570 0x7f0878143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.711+0000 7f087d8a4700 1 --2- 172.21.15.81:0/1737612856 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0858066f30 0x7f08580693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.711+0000 7f087d8a4700 1 --2- 172.21.15.81:0/1737612856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08780ce1f0 0x7f08780b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.711+0000 7f087d8a4700 1 -- 172.21.15.81:0/1737612856 >> 172.21.15.81:0/1737612856 conn(0x7f087806cca0 msgr2=0x7f0878159890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.711+0000 7f087d8a4700 1 -- 172.21.15.81:0/1737612856 shutdown_connections 2023-10-07T08:45:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.711+0000 7f087d8a4700 1 -- 172.21.15.81:0/1737612856 wait complete. 2023-10-07T08:45:02.724 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T08:45:02.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:45:02.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.841+0000 7ff54a3f3700 1 Processor -- start 2023-10-07T08:45:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.841+0000 7ff54a3f3700 1 -- start start 2023-10-07T08:45:02.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.842+0000 7ff54a3f3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5440b43c0 0x7ff5440cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.842+0000 7ff54a3f3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff5440cb240 0x7ff5440cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.842+0000 7ff54a3f3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5440cadb0 con 0x7ff5440cddd0 2023-10-07T08:45:02.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.842+0000 7ff54a3f3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5440cf000 con 0x7ff5440cb240 2023-10-07T08:45:02.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.842+0000 7ff54a3f3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440cf2e0 con 0x7ff5440b43c0 2023-10-07T08:45:02.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.842+0000 7ff548bf0700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff5440cddd0 0x7ff5440ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37840/0 (socket says 172.21.15.81:37840) 2023-10-07T08:45:02.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.842+0000 7ff548bf0700 1 -- 172.21.15.81:0/2504340184 learned_addr learned my addr 172.21.15.81:0/2504340184 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:45:02.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 -- 172.21.15.81:0/2504340184 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209207156 0 0) 0x7ff5440cadb0 con 0x7ff5440cddd0 2023-10-07T08:45:02.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff5493f1700 1 --2- 172.21.15.81:0/2504340184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5440b43c0 0x7ff5440cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 -- 172.21.15.81:0/2504340184 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff530003570 con 0x7ff5440cddd0 2023-10-07T08:45:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff549bf2700 1 --2- 172.21.15.81:0/2504340184 >> v2:172.21.15.89:3300/0 conn(0x7ff5440cb240 0x7ff5440cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 -- 172.21.15.81:0/2504340184 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3144375191 0 0) 0x7ff530003570 con 0x7ff5440cddd0 2023-10-07T08:45:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 -- 172.21.15.81:0/2504340184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5440b43c0 msgr2=0x7ff5440cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 --2- 172.21.15.81:0/2504340184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5440b43c0 0x7ff5440cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 -- 172.21.15.81:0/2504340184 >> v2:172.21.15.89:3300/0 conn(0x7ff5440cb240 msgr2=0x7ff5440cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 --2- 172.21.15.81:0/2504340184 >> v2:172.21.15.89:3300/0 conn(0x7ff5440cb240 0x7ff5440cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 -- 172.21.15.81:0/2504340184 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5440ca760 con 0x7ff5440cddd0 2023-10-07T08:45:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 -- 172.21.15.81:0/2504340184 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7ff534001470 con 0x7ff5440cddd0 2023-10-07T08:45:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 -- 172.21.15.81:0/2504340184 >> v1:172.21.15.81:6789/0 conn(0x7ff5440cddd0 legacy=0x7ff5440ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 --2- 172.21.15.81:0/2504340184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff530003a60 0x7ff530003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 --2- 172.21.15.81:0/2504340184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5440b43c0 0x7ff530004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 --2- 172.21.15.81:0/2504340184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff530004d50 0x7ff5300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 -- 172.21.15.81:0/2504340184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440cf000 con 0x7ff530004d50 2023-10-07T08:45:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 -- 172.21.15.81:0/2504340184 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440cf2e0 con 0x7ff530003a60 2023-10-07T08:45:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 -- 172.21.15.81:0/2504340184 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53000ba60 con 0x7ff5440b43c0 2023-10-07T08:45:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff549bf2700 1 --2- 172.21.15.81:0/2504340184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff530004d50 0x7ff5300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff5493f1700 1 --2- 172.21.15.81:0/2504340184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff530003a60 0x7ff530003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff548bf0700 1 --2- 172.21.15.81:0/2504340184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5440b43c0 0x7ff530004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff549bf2700 1 -- 172.21.15.81:0/2504340184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5440b43c0 msgr2=0x7ff530004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff549bf2700 1 --2- 172.21.15.81:0/2504340184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5440b43c0 0x7ff530004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff549bf2700 1 -- 172.21.15.81:0/2504340184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff530003a60 msgr2=0x7ff530003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff549bf2700 1 --2- 172.21.15.81:0/2504340184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff530003a60 0x7ff530003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff549bf2700 1 -- 172.21.15.81:0/2504340184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff530003570 con 0x7ff530004d50 2023-10-07T08:45:02.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff548bf0700 1 --2- 172.21.15.81:0/2504340184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5440b43c0 0x7ff530004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:45:02.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff549bf2700 1 --2- 172.21.15.81:0/2504340184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff530004d50 0x7ff5300051c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009c00 tx=0x7ff53c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae01143359a8f110 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:02.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 -- 172.21.15.81:0/2504340184 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c00e6b0 con 0x7ff530004d50 2023-10-07T08:45:02.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.843+0000 7ff53bfff700 1 -- 172.21.15.81:0/2504340184 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c00e810 con 0x7ff530004d50 2023-10-07T08:45:02.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.844+0000 7ff53bfff700 1 -- 172.21.15.81:0/2504340184 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c00ebd0 con 0x7ff530004d50 2023-10-07T08:45:02.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.844+0000 7ff54a3f3700 1 -- 172.21.15.81:0/2504340184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff530004d50 msgr2=0x7ff5300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:02.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.844+0000 7ff54a3f3700 1 --2- 172.21.15.81:0/2504340184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff530004d50 0x7ff5300051c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009c00 tx=0x7ff53c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.844+0000 7ff549bf2700 1 -- 172.21.15.81:0/2504340184 reap_dead start 2023-10-07T08:45:02.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.844+0000 7ff54a3f3700 1 -- 172.21.15.81:0/2504340184 shutdown_connections 2023-10-07T08:45:02.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.844+0000 7ff54a3f3700 1 -- 172.21.15.81:0/2504340184 >> 172.21.15.81:0/2504340184 conn(0x7ff544068110 msgr2=0x7ff54406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:02.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.844+0000 7ff54a3f3700 1 -- 172.21.15.81:0/2504340184 shutdown_connections 2023-10-07T08:45:02.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.844+0000 7ff54a3f3700 1 -- 172.21.15.81:0/2504340184 wait complete. 2023-10-07T08:45:02.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.845+0000 7ff54a3f3700 1 Processor -- start 2023-10-07T08:45:02.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.845+0000 7ff54a3f3700 1 -- start start 2023-10-07T08:45:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.846+0000 7ff54a3f3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff544143b80 0x7ff544144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.846+0000 7ff54a3f3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff544143f50 0x7ff5440a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.846+0000 7ff54a3f3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5440a69c0 0x7ff5440c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.846+0000 7ff54a3f3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440a6e40 con 0x7ff544143f50 2023-10-07T08:45:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.846+0000 7ff54a3f3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440c7dc0 con 0x7ff544143b80 2023-10-07T08:45:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.846+0000 7ff54a3f3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440c71b0 con 0x7ff5440a69c0 2023-10-07T08:45:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.846+0000 7ff548bf0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff544143f50 0x7ff5440a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.846+0000 7ff548bf0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff544143f50 0x7ff5440a6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52282/0 (socket says 172.21.15.81:52282) 2023-10-07T08:45:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.846+0000 7ff548bf0700 1 -- 172.21.15.81:0/656335977 learned_addr learned my addr 172.21.15.81:0/656335977 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.846+0000 7ff549bf2700 1 --2- 172.21.15.81:0/656335977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5440a69c0 0x7ff5440c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.846+0000 7ff5493f1700 1 --2- 172.21.15.81:0/656335977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff544143b80 0x7ff544144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.846+0000 7ff548bf0700 1 -- 172.21.15.81:0/656335977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5440a69c0 msgr2=0x7ff5440c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.846+0000 7ff548bf0700 1 --2- 172.21.15.81:0/656335977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5440a69c0 0x7ff5440c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.847+0000 7ff548bf0700 1 -- 172.21.15.81:0/656335977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff544143b80 msgr2=0x7ff544144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.847+0000 7ff548bf0700 1 --2- 172.21.15.81:0/656335977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff544143b80 0x7ff544144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.847+0000 7ff548bf0700 1 -- 172.21.15.81:0/656335977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5440c7490 con 0x7ff544143f50 2023-10-07T08:45:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.847+0000 7ff548bf0700 1 --2- 172.21.15.81:0/656335977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff544143f50 0x7ff5440a6480 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff53400eb00 tx=0x7ff5440694f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.847+0000 7ff5397fa700 1 -- 172.21.15.81:0/656335977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53400a550 con 0x7ff544143f50 2023-10-07T08:45:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.847+0000 7ff5397fa700 1 -- 172.21.15.81:0/656335977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff534010040 con 0x7ff544143f50 2023-10-07T08:45:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.847+0000 7ff5397fa700 1 -- 172.21.15.81:0/656335977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53400a8c0 con 0x7ff544143f50 2023-10-07T08:45:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.847+0000 7ff54a3f3700 1 -- 172.21.15.81:0/656335977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5440c7770 con 0x7ff544143f50 2023-10-07T08:45:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.847+0000 7ff54a3f3700 1 -- 172.21.15.81:0/656335977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff544144970 con 0x7ff544143f50 2023-10-07T08:45:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.848+0000 7ff54a3f3700 1 -- 172.21.15.81:0/656335977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff544069c00 con 0x7ff544143f50 2023-10-07T08:45:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.848+0000 7ff5397fa700 1 -- 172.21.15.81:0/656335977 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff53400ac30 con 0x7ff544143f50 2023-10-07T08:45:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.848+0000 7ff5397fa700 1 --2- 172.21.15.81:0/656335977 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff528066f30 0x7ff5280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.849+0000 7ff5397fa700 1 -- 172.21.15.81:0/656335977 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff534083600 con 0x7ff544143f50 2023-10-07T08:45:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.849+0000 7ff5493f1700 1 --2- 172.21.15.81:0/656335977 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff528066f30 0x7ff5280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.849+0000 7ff5493f1700 1 --2- 172.21.15.81:0/656335977 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff528066f30 0x7ff5280693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff5400094d0 tx=0x7ff54000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:02.853+0000 7ff5397fa700 1 -- 172.21.15.81:0/656335977 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff53404d5a0 con 0x7ff544143f50 2023-10-07T08:45:03.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.035+0000 7ff54a3f3700 1 -- 172.21.15.81:0/656335977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5440c7f00 con 0x7ff544143f50 2023-10-07T08:45:03.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.035+0000 7ff5397fa700 1 -- 172.21.15.81:0/656335977 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff534019020 con 0x7ff544143f50 2023-10-07T08:45:03.036 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:45:03.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.037+0000 7ff54a3f3700 1 -- 172.21.15.81:0/656335977 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff528066f30 msgr2=0x7ff5280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:03.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.037+0000 7ff54a3f3700 1 --2- 172.21.15.81:0/656335977 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff528066f30 0x7ff5280693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff5400094d0 tx=0x7ff54000b040 comp rx=0 tx=0).stop 2023-10-07T08:45:03.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.037+0000 7ff54a3f3700 1 -- 172.21.15.81:0/656335977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff544143f50 msgr2=0x7ff5440a6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:03.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.037+0000 7ff54a3f3700 1 --2- 172.21.15.81:0/656335977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff544143f50 0x7ff5440a6480 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff53400eb00 tx=0x7ff5440694f0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.037+0000 7ff54a3f3700 1 -- 172.21.15.81:0/656335977 shutdown_connections 2023-10-07T08:45:03.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.037+0000 7ff54a3f3700 1 --2- 172.21.15.81:0/656335977 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff528066f30 0x7ff5280693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.037+0000 7ff54a3f3700 1 --2- 172.21.15.81:0/656335977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5440a69c0 0x7ff5440c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.037+0000 7ff54a3f3700 1 --2- 172.21.15.81:0/656335977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff544143b80 0x7ff544144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.037+0000 7ff54a3f3700 1 --2- 172.21.15.81:0/656335977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff544143f50 0x7ff5440a6480 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.037+0000 7ff54a3f3700 1 -- 172.21.15.81:0/656335977 >> 172.21.15.81:0/656335977 conn(0x7ff544068110 msgr2=0x7ff54406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:03.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.037+0000 7ff54a3f3700 1 -- 172.21.15.81:0/656335977 shutdown_connections 2023-10-07T08:45:03.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.037+0000 7ff54a3f3700 1 -- 172.21.15.81:0/656335977 wait complete. 2023-10-07T08:45:03.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T08:45:03.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.162+0000 7f4e8b0c3700 1 Processor -- start 2023-10-07T08:45:03.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.162+0000 7f4e8b0c3700 1 -- start start 2023-10-07T08:45:03.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.163+0000 7f4e8b0c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e8415daa0 0x7f4e8415de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:03.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.163+0000 7f4e8b0c3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e840cb270 0x7f4e84159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:03.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.163+0000 7f4e8b0c3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8406d350 con 0x7f4e840cae00 2023-10-07T08:45:03.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.163+0000 7f4e8b0c3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e840c9ac0 con 0x7f4e840cb270 2023-10-07T08:45:03.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.163+0000 7f4e8b0c3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8415e3b0 con 0x7f4e8415daa0 2023-10-07T08:45:03.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.163+0000 7f4e89660700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e840cb270 0x7f4e84159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:03.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.163+0000 7f4e89660700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e840cb270 0x7f4e84159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52286/0 (socket says 172.21.15.81:52286) 2023-10-07T08:45:03.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.163+0000 7f4e89660700 1 -- 172.21.15.81:0/661808816 learned_addr learned my addr 172.21.15.81:0/661808816 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:03.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.164+0000 7f4e88e5f700 1 --2- 172.21.15.81:0/661808816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e8415daa0 0x7f4e8415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:03.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.164+0000 7f4e89660700 1 -- 172.21.15.81:0/661808816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e8415daa0 msgr2=0x7f4e8415de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:03.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.164+0000 7f4e89660700 1 --2- 172.21.15.81:0/661808816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e8415daa0 0x7f4e8415de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.164+0000 7f4e89660700 1 -- 172.21.15.81:0/661808816 >> v1:172.21.15.89:6789/0 conn(0x7f4e840cae00 legacy=0x7f4e84159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:03.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.164+0000 7f4e89660700 1 -- 172.21.15.81:0/661808816 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8406c740 con 0x7f4e840cb270 2023-10-07T08:45:03.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.164+0000 7f4e89660700 1 --2- 172.21.15.81:0/661808816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e840cb270 0x7f4e84159c50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0099b0 tx=0x7f4e7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772baba2cb75c89a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:03.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.164+0000 7f4e837fe700 1 -- 172.21.15.81:0/661808816 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c00b860 con 0x7f4e840cb270 2023-10-07T08:45:03.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.164+0000 7f4e837fe700 1 -- 172.21.15.81:0/661808816 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c00b9c0 con 0x7f4e840cb270 2023-10-07T08:45:03.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.164+0000 7f4e837fe700 1 -- 172.21.15.81:0/661808816 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c00bd60 con 0x7f4e840cb270 2023-10-07T08:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.165+0000 7f4e8b0c3700 1 -- 172.21.15.81:0/661808816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e840cb270 msgr2=0x7f4e84159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.165+0000 7f4e8b0c3700 1 --2- 172.21.15.81:0/661808816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e840cb270 0x7f4e84159c50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0099b0 tx=0x7f4e7c009250 comp rx=0 tx=0).stop 2023-10-07T08:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.165+0000 7f4e8b0c3700 1 -- 172.21.15.81:0/661808816 shutdown_connections 2023-10-07T08:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.165+0000 7f4e8b0c3700 1 --2- 172.21.15.81:0/661808816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e840cb270 0x7f4e84159c50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.165+0000 7f4e8b0c3700 1 --2- 172.21.15.81:0/661808816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e8415daa0 0x7f4e8415de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.165+0000 7f4e8b0c3700 1 -- 172.21.15.81:0/661808816 >> 172.21.15.81:0/661808816 conn(0x7f4e840c9ca0 msgr2=0x7f4e840ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.165+0000 7f4e8b0c3700 1 -- 172.21.15.81:0/661808816 shutdown_connections 2023-10-07T08:45:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.165+0000 7f4e8b0c3700 1 -- 172.21.15.81:0/661808816 wait complete. 2023-10-07T08:45:03.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.166+0000 7f4e8b0c3700 1 Processor -- start 2023-10-07T08:45:03.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.166+0000 7f4e8b0c3700 1 -- start start 2023-10-07T08:45:03.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e8b0c3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e840cae00 0x7f4e8414be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:03.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e8b0c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e840cb270 0x7f4e840c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:03.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e8b0c3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8415daa0 0x7f4e840b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:03.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e8b0c3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840c6ff0 con 0x7f4e8415daa0 2023-10-07T08:45:03.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e8b0c3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840c7480 con 0x7f4e840cae00 2023-10-07T08:45:03.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e8b0c3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840aab30 con 0x7f4e840cb270 2023-10-07T08:45:03.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e89660700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8415daa0 0x7f4e840b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:03.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e89660700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8415daa0 0x7f4e840b0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52294/0 (socket says 172.21.15.81:52294) 2023-10-07T08:45:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e89660700 1 -- 172.21.15.81:0/2435209558 learned_addr learned my addr 172.21.15.81:0/2435209558 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e83fff700 1 --2- 172.21.15.81:0/2435209558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e840cb270 0x7f4e840c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e88e5f700 1 --2- 172.21.15.81:0/2435209558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e840cae00 0x7f4e8414be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e89660700 1 -- 172.21.15.81:0/2435209558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e840cb270 msgr2=0x7f4e840c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e89660700 1 --2- 172.21.15.81:0/2435209558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e840cb270 0x7f4e840c5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e89660700 1 -- 172.21.15.81:0/2435209558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e840cae00 msgr2=0x7f4e8414be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e89660700 1 --2- 172.21.15.81:0/2435209558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e840cae00 0x7f4e8414be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e89660700 1 -- 172.21.15.81:0/2435209558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c0094f0 con 0x7f4e8415daa0 2023-10-07T08:45:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e89660700 1 --2- 172.21.15.81:0/2435209558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8415daa0 0x7f4e840b0fa0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4e8406ebb0 tx=0x7f4e7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e80ff9700 1 -- 172.21.15.81:0/2435209558 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c00b860 con 0x7f4e8415daa0 2023-10-07T08:45:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e80ff9700 1 -- 172.21.15.81:0/2435209558 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c01a630 con 0x7f4e8415daa0 2023-10-07T08:45:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e8b0c3700 1 -- 172.21.15.81:0/2435209558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e840c6100 con 0x7f4e8415daa0 2023-10-07T08:45:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e80ff9700 1 -- 172.21.15.81:0/2435209558 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c01aa10 con 0x7f4e8415daa0 2023-10-07T08:45:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.167+0000 7f4e8b0c3700 1 -- 172.21.15.81:0/2435209558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e840c66c0 con 0x7f4e8415daa0 2023-10-07T08:45:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.168+0000 7f4e8b0c3700 1 -- 172.21.15.81:0/2435209558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e840c7160 con 0x7f4e8415daa0 2023-10-07T08:45:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.169+0000 7f4e80ff9700 1 -- 172.21.15.81:0/2435209558 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e7c02d440 con 0x7f4e8415daa0 2023-10-07T08:45:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.169+0000 7f4e80ff9700 1 --2- 172.21.15.81:0/2435209558 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4e70066f30 0x7f4e700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.169+0000 7f4e80ff9700 1 -- 172.21.15.81:0/2435209558 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4e7c085d00 con 0x7f4e8415daa0 2023-10-07T08:45:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.169+0000 7f4e88e5f700 1 --2- 172.21.15.81:0/2435209558 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4e70066f30 0x7f4e700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.170+0000 7f4e88e5f700 1 --2- 172.21.15.81:0/2435209558 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4e70066f30 0x7f4e700693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4e840ab180 tx=0x7f4e74009850 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:03.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.173+0000 7f4e80ff9700 1 -- 172.21.15.81:0/2435209558 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e7c0532c0 con 0x7f4e8415daa0 2023-10-07T08:45:03.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.360+0000 7f4e8b0c3700 1 -- 172.21.15.81:0/2435209558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4e8404bb80 con 0x7f4e8415daa0 2023-10-07T08:45:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.360+0000 7f4e80ff9700 1 -- 172.21.15.81:0/2435209558 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v63) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4e7c006d70 con 0x7f4e8415daa0 2023-10-07T08:45:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:45:03.361 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-07T08:45:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:45:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-07T08:45:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-07T08:45:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:45:03.361 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-07T08:45:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.362+0000 7f4e8b0c3700 1 -- 172.21.15.81:0/2435209558 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4e70066f30 msgr2=0x7f4e700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.362+0000 7f4e8b0c3700 1 --2- 172.21.15.81:0/2435209558 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4e70066f30 0x7f4e700693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4e840ab180 tx=0x7f4e74009850 comp rx=0 tx=0).stop 2023-10-07T08:45:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.362+0000 7f4e8b0c3700 1 -- 172.21.15.81:0/2435209558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8415daa0 msgr2=0x7f4e840b0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.362+0000 7f4e8b0c3700 1 --2- 172.21.15.81:0/2435209558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8415daa0 0x7f4e840b0fa0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4e8406ebb0 tx=0x7f4e7c017000 comp rx=0 tx=0).stop 2023-10-07T08:45:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.362+0000 7f4e8b0c3700 1 -- 172.21.15.81:0/2435209558 shutdown_connections 2023-10-07T08:45:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.362+0000 7f4e8b0c3700 1 --2- 172.21.15.81:0/2435209558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e8415daa0 0x7f4e840b0fa0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.362+0000 7f4e8b0c3700 1 --2- 172.21.15.81:0/2435209558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e840cae00 0x7f4e8414be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.362+0000 7f4e8b0c3700 1 --2- 172.21.15.81:0/2435209558 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4e70066f30 0x7f4e700693e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.362+0000 7f4e8b0c3700 1 --2- 172.21.15.81:0/2435209558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e840cb270 0x7f4e840c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.362+0000 7f4e8b0c3700 1 -- 172.21.15.81:0/2435209558 >> 172.21.15.81:0/2435209558 conn(0x7f4e840c9ca0 msgr2=0x7f4e840697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.362+0000 7f4e8b0c3700 1 -- 172.21.15.81:0/2435209558 shutdown_connections 2023-10-07T08:45:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.362+0000 7f4e8b0c3700 1 -- 172.21.15.81:0/2435209558 wait complete. 2023-10-07T08:45:03.375 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T08:45:03.375 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T08:45:03.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.492+0000 7f07416ee700 1 Processor -- start 2023-10-07T08:45:03.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.492+0000 7f07416ee700 1 -- start start 2023-10-07T08:45:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.493+0000 7f07416ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073c157ca0 0x7f073c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.493+0000 7f07416ee700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f073c06d120 0x7f073c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.493+0000 7f07416ee700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c06dac0 con 0x7f073c1578d0 2023-10-07T08:45:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.493+0000 7f07416ee700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f073c0d07c0 con 0x7f073c06d120 2023-10-07T08:45:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.493+0000 7f07416ee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0cfbb0 con 0x7f073c157ca0 2023-10-07T08:45:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.493+0000 7f073affd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f073c1578d0 0x7f073c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37852/0 (socket says 172.21.15.81:37852) 2023-10-07T08:45:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.493+0000 7f073affd700 1 -- 172.21.15.81:0/2283076302 learned_addr learned my addr 172.21.15.81:0/2283076302 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:45:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.493+0000 7f073a7fc700 1 -- 172.21.15.81:0/2283076302 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895450840 0 0) 0x7f072c001110 con 0x7f073c1578d0 2023-10-07T08:45:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.493+0000 7f073a7fc700 1 -- 172.21.15.81:0/2283076302 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0728003570 con 0x7f073c1578d0 2023-10-07T08:45:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.493+0000 7f073b7fe700 1 --2- 172.21.15.81:0/2283076302 >> v2:172.21.15.89:3300/0 conn(0x7f073c06d120 0x7f073c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.493+0000 7f07327fc700 1 --2- 172.21.15.81:0/2283076302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073c157ca0 0x7f073c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 -- 172.21.15.81:0/2283076302 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2010606411 0 0) 0x7f0728003570 con 0x7f073c1578d0 2023-10-07T08:45:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 -- 172.21.15.81:0/2283076302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073c157ca0 msgr2=0x7f073c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 --2- 172.21.15.81:0/2283076302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073c157ca0 0x7f073c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 -- 172.21.15.81:0/2283076302 >> v2:172.21.15.89:3300/0 conn(0x7f073c06d120 msgr2=0x7f073c06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 --2- 172.21.15.81:0/2283076302 >> v2:172.21.15.89:3300/0 conn(0x7f073c06d120 0x7f073c06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 -- 172.21.15.81:0/2283076302 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c0cfe90 con 0x7f073c1578d0 2023-10-07T08:45:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 -- 172.21.15.81:0/2283076302 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f072c001600 con 0x7f073c1578d0 2023-10-07T08:45:03.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 -- 172.21.15.81:0/2283076302 >> v1:172.21.15.81:6789/0 conn(0x7f073c1578d0 legacy=0x7f073c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 --2- 172.21.15.81:0/2283076302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0728003a60 0x7f0728003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 --2- 172.21.15.81:0/2283076302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073c157ca0 0x7f0728004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 --2- 172.21.15.81:0/2283076302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0728004d50 0x7f07280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 -- 172.21.15.81:0/2283076302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0d07c0 con 0x7f0728004d50 2023-10-07T08:45:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 -- 172.21.15.81:0/2283076302 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0cfbb0 con 0x7f0728003a60 2023-10-07T08:45:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 -- 172.21.15.81:0/2283076302 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072800ba60 con 0x7f073c157ca0 2023-10-07T08:45:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073b7fe700 1 --2- 172.21.15.81:0/2283076302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0728004d50 0x7f07280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073affd700 1 --2- 172.21.15.81:0/2283076302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0728003a60 0x7f0728003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f07327fc700 1 --2- 172.21.15.81:0/2283076302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073c157ca0 0x7f0728004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073b7fe700 1 -- 172.21.15.81:0/2283076302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073c157ca0 msgr2=0x7f0728004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073b7fe700 1 --2- 172.21.15.81:0/2283076302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073c157ca0 0x7f0728004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073b7fe700 1 -- 172.21.15.81:0/2283076302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0728003a60 msgr2=0x7f0728003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073b7fe700 1 --2- 172.21.15.81:0/2283076302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0728003a60 0x7f0728003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073b7fe700 1 -- 172.21.15.81:0/2283076302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0728003570 con 0x7f0728004d50 2023-10-07T08:45:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073b7fe700 1 --2- 172.21.15.81:0/2283076302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0728004d50 0x7f07280051c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f073400e210 tx=0x7f073400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b041f3d6b2ddda4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 -- 172.21.15.81:0/2283076302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073400ea60 con 0x7f0728004d50 2023-10-07T08:45:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 -- 172.21.15.81:0/2283076302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073400f040 con 0x7f0728004d50 2023-10-07T08:45:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.494+0000 7f073a7fc700 1 -- 172.21.15.81:0/2283076302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073400ee10 con 0x7f0728004d50 2023-10-07T08:45:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.495+0000 7f07416ee700 1 -- 172.21.15.81:0/2283076302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0728004d50 msgr2=0x7f07280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.495+0000 7f07416ee700 1 --2- 172.21.15.81:0/2283076302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0728004d50 0x7f07280051c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f073400e210 tx=0x7f073400b040 comp rx=0 tx=0).stop 2023-10-07T08:45:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.495+0000 7f073b7fe700 1 -- 172.21.15.81:0/2283076302 reap_dead start 2023-10-07T08:45:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.495+0000 7f07416ee700 1 -- 172.21.15.81:0/2283076302 shutdown_connections 2023-10-07T08:45:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.495+0000 7f07416ee700 1 -- 172.21.15.81:0/2283076302 >> 172.21.15.81:0/2283076302 conn(0x7f073c06bb90 msgr2=0x7f073c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.495+0000 7f07416ee700 1 -- 172.21.15.81:0/2283076302 shutdown_connections 2023-10-07T08:45:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.495+0000 7f07416ee700 1 -- 172.21.15.81:0/2283076302 wait complete. 2023-10-07T08:45:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.496+0000 7f07416ee700 1 Processor -- start 2023-10-07T08:45:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.496+0000 7f07416ee700 1 -- start start 2023-10-07T08:45:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f07416ee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0728004d50 0x7f073c156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f07416ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073c0b5560 0x7f073c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f07416ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f073c14a680 0x7f073c14ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f07416ee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c14b040 con 0x7f073c14a680 2023-10-07T08:45:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f07416ee700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0b4fb0 con 0x7f0728004d50 2023-10-07T08:45:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f07416ee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0b3f10 con 0x7f073c0b5560 2023-10-07T08:45:03.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f073b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f073c14a680 0x7f073c14ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:03.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f073b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f073c14a680 0x7f073c14ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52306/0 (socket says 172.21.15.81:52306) 2023-10-07T08:45:03.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f073b7fe700 1 -- 172.21.15.81:0/3128661289 learned_addr learned my addr 172.21.15.81:0/3128661289 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:03.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f073affd700 1 --2- 172.21.15.81:0/3128661289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0728004d50 0x7f073c156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:03.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f07327fc700 1 --2- 172.21.15.81:0/3128661289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073c0b5560 0x7f073c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:03.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f073b7fe700 1 -- 172.21.15.81:0/3128661289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073c0b5560 msgr2=0x7f073c0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:03.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f073b7fe700 1 --2- 172.21.15.81:0/3128661289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073c0b5560 0x7f073c0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f073b7fe700 1 -- 172.21.15.81:0/3128661289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0728004d50 msgr2=0x7f073c156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:03.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f073b7fe700 1 --2- 172.21.15.81:0/3128661289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0728004d50 0x7f073c156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:03.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f073b7fe700 1 -- 172.21.15.81:0/3128661289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c0b41f0 con 0x7f073c14a680 2023-10-07T08:45:03.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.497+0000 7f073b7fe700 1 --2- 172.21.15.81:0/3128661289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f073c14a680 0x7f073c14ab00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f073400afd0 tx=0x7f073401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:03.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.498+0000 7f07337fe700 1 -- 172.21.15.81:0/3128661289 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073400eee0 con 0x7f073c14a680 2023-10-07T08:45:03.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.498+0000 7f07337fe700 1 -- 172.21.15.81:0/3128661289 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073401d630 con 0x7f073c14a680 2023-10-07T08:45:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.498+0000 7f07416ee700 1 -- 172.21.15.81:0/3128661289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073c0b44d0 con 0x7f073c14a680 2023-10-07T08:45:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.498+0000 7f07337fe700 1 -- 172.21.15.81:0/3128661289 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073401da30 con 0x7f073c14a680 2023-10-07T08:45:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.498+0000 7f07416ee700 1 -- 172.21.15.81:0/3128661289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073c0b4a90 con 0x7f073c14a680 2023-10-07T08:45:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.498+0000 7f07416ee700 1 -- 172.21.15.81:0/3128661289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f073c0b4c80 con 0x7f073c14a680 2023-10-07T08:45:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.499+0000 7f07337fe700 1 -- 172.21.15.81:0/3128661289 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0734003040 con 0x7f073c14a680 2023-10-07T08:45:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.499+0000 7f07337fe700 1 --2- 172.21.15.81:0/3128661289 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f071c066f30 0x7f071c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.499+0000 7f07337fe700 1 -- 172.21.15.81:0/3128661289 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0734084ea0 con 0x7f073c14a680 2023-10-07T08:45:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.499+0000 7f073affd700 1 --2- 172.21.15.81:0/3128661289 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f071c066f30 0x7f071c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.500+0000 7f073affd700 1 --2- 172.21.15.81:0/3128661289 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f071c066f30 0x7f071c0693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f072c007b60 tx=0x7f073c0d0730 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.504+0000 7f07337fe700 1 -- 172.21.15.81:0/3128661289 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0734052520 con 0x7f073c14a680 2023-10-07T08:45:03.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:03.684+0000 7f07416ee700 1 -- 172.21.15.81:0/3128661289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f073c0d0170 con 0x7f073c14a680 2023-10-07T08:45:04.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.523+0000 7f07337fe700 1 -- 172.21.15.81:0/3128661289 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v64) v1 ==== 138+0+0 (secure 0 0 0) 0x7f07340180b0 con 0x7f073c14a680 2023-10-07T08:45:04.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.527+0000 7f07416ee700 1 -- 172.21.15.81:0/3128661289 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f071c066f30 msgr2=0x7f071c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:04.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.527+0000 7f07416ee700 1 --2- 172.21.15.81:0/3128661289 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f071c066f30 0x7f071c0693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f072c007b60 tx=0x7f073c0d0730 comp rx=0 tx=0).stop 2023-10-07T08:45:04.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.527+0000 7f07416ee700 1 -- 172.21.15.81:0/3128661289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f073c14a680 msgr2=0x7f073c14ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:04.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.527+0000 7f07416ee700 1 --2- 172.21.15.81:0/3128661289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f073c14a680 0x7f073c14ab00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f073400afd0 tx=0x7f073401a000 comp rx=0 tx=0).stop 2023-10-07T08:45:04.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.527+0000 7f07416ee700 1 -- 172.21.15.81:0/3128661289 shutdown_connections 2023-10-07T08:45:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.527+0000 7f07416ee700 1 --2- 172.21.15.81:0/3128661289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f073c14a680 0x7f073c14ab00 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.527+0000 7f07416ee700 1 --2- 172.21.15.81:0/3128661289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0728004d50 0x7f073c156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.527+0000 7f07416ee700 1 --2- 172.21.15.81:0/3128661289 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f071c066f30 0x7f071c0693e0 secure :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f072c007b60 tx=0x7f073c0d0730 comp rx=0 tx=0).stop 2023-10-07T08:45:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.527+0000 7f07416ee700 1 --2- 172.21.15.81:0/3128661289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f073c0b5560 0x7f073c0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.527+0000 7f07416ee700 1 -- 172.21.15.81:0/3128661289 >> 172.21.15.81:0/3128661289 conn(0x7f073c06bb90 msgr2=0x7f073c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.527+0000 7f07416ee700 1 -- 172.21.15.81:0/3128661289 shutdown_connections 2023-10-07T08:45:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.527+0000 7f07416ee700 1 -- 172.21.15.81:0/3128661289 wait complete. 2023-10-07T08:45:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-07T08:45:04.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T08:45:04.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.665+0000 7fd284aa0700 1 Processor -- start 2023-10-07T08:45:04.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.665+0000 7fd284aa0700 1 -- start start 2023-10-07T08:45:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.666+0000 7fd284aa0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2800cf440 0x7fd2800b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.666+0000 7fd284aa0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28006ea40 0x7fd28015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.666+0000 7fd284aa0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2800b3dd0 con 0x7fd2800b1980 2023-10-07T08:45:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.666+0000 7fd284aa0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28006da50 con 0x7fd2800cf440 2023-10-07T08:45:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.666+0000 7fd284aa0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800b3780 con 0x7fd28006ea40 2023-10-07T08:45:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.666+0000 7fd27e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2800cf440 0x7fd2800b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.666+0000 7fd27ed9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd2800b1980 0x7fd2800b0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37854/0 (socket says 172.21.15.81:37854) 2023-10-07T08:45:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.666+0000 7fd27ed9d700 1 -- 172.21.15.81:0/3311348314 learned_addr learned my addr 172.21.15.81:0/3311348314 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:45:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.666+0000 7fd275d9b700 1 --2- 172.21.15.81:0/3311348314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28006ea40 0x7fd28015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:04.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.666+0000 7fd27e59c700 1 -- 172.21.15.81:0/3311348314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28006ea40 msgr2=0x7fd28015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.666+0000 7fd27e59c700 1 --2- 172.21.15.81:0/3311348314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28006ea40 0x7fd28015a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.666+0000 7fd27e59c700 1 -- 172.21.15.81:0/3311348314 >> v1:172.21.15.81:6789/0 conn(0x7fd2800b1980 legacy=0x7fd2800b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.667+0000 7fd27e59c700 1 -- 172.21.15.81:0/3311348314 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2800b3a60 con 0x7fd2800cf440 2023-10-07T08:45:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.667+0000 7fd27dd9b700 1 -- 172.21.15.81:0/3311348314 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146599402 0 0) 0x7fd2800b3dd0 con 0x7fd2800b1980 2023-10-07T08:45:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.667+0000 7fd27e59c700 1 --2- 172.21.15.81:0/3311348314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2800cf440 0x7fd2800b4260 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd2700098e0 tx=0x7fd2700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0efeb8fcb0059d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.667+0000 7fd27dd9b700 1 -- 172.21.15.81:0/3311348314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270009e80 con 0x7fd2800cf440 2023-10-07T08:45:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.667+0000 7fd27dd9b700 1 -- 172.21.15.81:0/3311348314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27000b860 con 0x7fd2800cf440 2023-10-07T08:45:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.667+0000 7fd27dd9b700 1 -- 172.21.15.81:0/3311348314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27000bbe0 con 0x7fd2800cf440 2023-10-07T08:45:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.667+0000 7fd284aa0700 1 -- 172.21.15.81:0/3311348314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2800cf440 msgr2=0x7fd2800b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.667+0000 7fd284aa0700 1 --2- 172.21.15.81:0/3311348314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2800cf440 0x7fd2800b4260 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd2700098e0 tx=0x7fd2700091a0 comp rx=0 tx=0).stop 2023-10-07T08:45:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.667+0000 7fd284aa0700 1 -- 172.21.15.81:0/3311348314 shutdown_connections 2023-10-07T08:45:04.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.667+0000 7fd284aa0700 1 --2- 172.21.15.81:0/3311348314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2800cf440 0x7fd2800b4260 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.667+0000 7fd284aa0700 1 --2- 172.21.15.81:0/3311348314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28006ea40 0x7fd28015a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.667+0000 7fd284aa0700 1 -- 172.21.15.81:0/3311348314 >> 172.21.15.81:0/3311348314 conn(0x7fd28006b530 msgr2=0x7fd280067640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.667+0000 7fd284aa0700 1 -- 172.21.15.81:0/3311348314 shutdown_connections 2023-10-07T08:45:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.667+0000 7fd284aa0700 1 -- 172.21.15.81:0/3311348314 wait complete. 2023-10-07T08:45:04.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.669+0000 7fd284aa0700 1 Processor -- start 2023-10-07T08:45:04.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.669+0000 7fd284aa0700 1 -- start start 2023-10-07T08:45:04.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.669+0000 7fd284aa0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28006ea40 0x7fd280156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:04.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.669+0000 7fd284aa0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2800b1980 0x7fd2800af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:04.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.669+0000 7fd284aa0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2800cf440 0x7fd2800afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:04.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.669+0000 7fd284aa0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800ca8f0 con 0x7fd2800b1980 2023-10-07T08:45:04.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.669+0000 7fd284aa0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800c9ce0 con 0x7fd28006ea40 2023-10-07T08:45:04.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.669+0000 7fd284aa0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800c9fc0 con 0x7fd2800cf440 2023-10-07T08:45:04.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.669+0000 7fd275d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2800b1980 0x7fd2800af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:04.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.669+0000 7fd275d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2800b1980 0x7fd2800af540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52318/0 (socket says 172.21.15.81:52318) 2023-10-07T08:45:04.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.669+0000 7fd275d9b700 1 -- 172.21.15.81:0/1071131907 learned_addr learned my addr 172.21.15.81:0/1071131907 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:04.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.670+0000 7fd27ed9d700 1 --2- 172.21.15.81:0/1071131907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2800cf440 0x7fd2800afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:04.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.670+0000 7fd27e59c700 1 --2- 172.21.15.81:0/1071131907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28006ea40 0x7fd280156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:04.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.670+0000 7fd275d9b700 1 -- 172.21.15.81:0/1071131907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2800cf440 msgr2=0x7fd2800afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:04.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.670+0000 7fd275d9b700 1 --2- 172.21.15.81:0/1071131907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2800cf440 0x7fd2800afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:04.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.670+0000 7fd275d9b700 1 -- 172.21.15.81:0/1071131907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28006ea40 msgr2=0x7fd280156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:04.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.670+0000 7fd275d9b700 1 --2- 172.21.15.81:0/1071131907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28006ea40 0x7fd280156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:04.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.670+0000 7fd275d9b700 1 -- 172.21.15.81:0/1071131907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd270009420 con 0x7fd2800b1980 2023-10-07T08:45:04.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.670+0000 7fd275d9b700 1 --2- 172.21.15.81:0/1071131907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2800b1980 0x7fd2800af540 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd26800d860 tx=0x7fd268008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:04.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.670+0000 7fd276ffd700 1 -- 172.21.15.81:0/1071131907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680125f0 con 0x7fd2800b1980 2023-10-07T08:45:04.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.670+0000 7fd276ffd700 1 -- 172.21.15.81:0/1071131907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd268012750 con 0x7fd2800b1980 2023-10-07T08:45:04.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.670+0000 7fd284aa0700 1 -- 172.21.15.81:0/1071131907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2800ca2a0 con 0x7fd2800b1980 2023-10-07T08:45:04.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.670+0000 7fd276ffd700 1 -- 172.21.15.81:0/1071131907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268012b10 con 0x7fd2800b1980 2023-10-07T08:45:04.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.670+0000 7fd284aa0700 1 -- 172.21.15.81:0/1071131907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd280156b80 con 0x7fd2800b1980 2023-10-07T08:45:04.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.671+0000 7fd284aa0700 1 -- 172.21.15.81:0/1071131907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2800caaa0 con 0x7fd2800b1980 2023-10-07T08:45:04.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.672+0000 7fd276ffd700 1 -- 172.21.15.81:0/1071131907 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd26801e460 con 0x7fd2800b1980 2023-10-07T08:45:04.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.672+0000 7fd276ffd700 1 --2- 172.21.15.81:0/1071131907 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd260066f30 0x7fd2600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:04.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.672+0000 7fd27e59c700 1 --2- 172.21.15.81:0/1071131907 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd260066f30 0x7fd2600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:04.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.672+0000 7fd276ffd700 1 -- 172.21.15.81:0/1071131907 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fd2680848b0 con 0x7fd2800b1980 2023-10-07T08:45:04.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.672+0000 7fd27e59c700 1 --2- 172.21.15.81:0/1071131907 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd260066f30 0x7fd2600693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd2700091e0 tx=0x7fd270017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:04.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.676+0000 7fd276ffd700 1 -- 172.21.15.81:0/1071131907 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2800caaa0 con 0x7fd2800b1980 2023-10-07T08:45:04.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:04.860+0000 7fd284aa0700 1 -- 172.21.15.81:0/1071131907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd2800caa30 con 0x7fd2800b1980 2023-10-07T08:45:05.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.526+0000 7fd276ffd700 1 -- 172.21.15.81:0/1071131907 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v65) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd268055500 con 0x7fd2800b1980 2023-10-07T08:45:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.534+0000 7fd284aa0700 1 -- 172.21.15.81:0/1071131907 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd260066f30 msgr2=0x7fd2600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.534+0000 7fd284aa0700 1 --2- 172.21.15.81:0/1071131907 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd260066f30 0x7fd2600693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd2700091e0 tx=0x7fd270017000 comp rx=0 tx=0).stop 2023-10-07T08:45:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.534+0000 7fd284aa0700 1 -- 172.21.15.81:0/1071131907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2800b1980 msgr2=0x7fd2800af540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.534+0000 7fd284aa0700 1 --2- 172.21.15.81:0/1071131907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2800b1980 0x7fd2800af540 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd26800d860 tx=0x7fd268008040 comp rx=0 tx=0).stop 2023-10-07T08:45:05.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.534+0000 7fd284aa0700 1 -- 172.21.15.81:0/1071131907 shutdown_connections 2023-10-07T08:45:05.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.534+0000 7fd284aa0700 1 --2- 172.21.15.81:0/1071131907 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd260066f30 0x7fd2600693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:05.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.534+0000 7fd284aa0700 1 --2- 172.21.15.81:0/1071131907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2800cf440 0x7fd2800afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:05.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.534+0000 7fd284aa0700 1 --2- 172.21.15.81:0/1071131907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28006ea40 0x7fd280156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:05.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.534+0000 7fd284aa0700 1 --2- 172.21.15.81:0/1071131907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2800b1980 0x7fd2800af540 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:05.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.534+0000 7fd284aa0700 1 -- 172.21.15.81:0/1071131907 >> 172.21.15.81:0/1071131907 conn(0x7fd28006b530 msgr2=0x7fd2801595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:05.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.534+0000 7fd284aa0700 1 -- 172.21.15.81:0/1071131907 shutdown_connections 2023-10-07T08:45:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.534+0000 7fd284aa0700 1 -- 172.21.15.81:0/1071131907 wait complete. 2023-10-07T08:45:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-07T08:45:05.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T08:45:05.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.664+0000 7fee92f6d700 1 Processor -- start 2023-10-07T08:45:05.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.664+0000 7fee92f6d700 1 -- start start 2023-10-07T08:45:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.665+0000 7fee92f6d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee8c157ca0 0x7fee8c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.665+0000 7fee92f6d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee8c06d120 0x7fee8c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.665+0000 7fee92f6d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee8c0d07c0 con 0x7fee8c1578d0 2023-10-07T08:45:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.665+0000 7fee92f6d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8c06daa0 con 0x7fee8c157ca0 2023-10-07T08:45:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.665+0000 7fee92f6d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c0cfbb0 con 0x7fee8c06d120 2023-10-07T08:45:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.665+0000 7fee83fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee8c157ca0 0x7fee8c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.665+0000 7fee83fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee8c157ca0 0x7fee8c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52334/0 (socket says 172.21.15.81:52334) 2023-10-07T08:45:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.665+0000 7fee83fff700 1 -- 172.21.15.81:0/2303148000 learned_addr learned my addr 172.21.15.81:0/2303148000 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.665+0000 7fee9150a700 1 --2- 172.21.15.81:0/2303148000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee8c06d120 0x7fee8c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.666+0000 7fee83fff700 1 -- 172.21.15.81:0/2303148000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee8c06d120 msgr2=0x7fee8c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.666+0000 7fee83fff700 1 --2- 172.21.15.81:0/2303148000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee8c06d120 0x7fee8c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.666+0000 7fee83fff700 1 -- 172.21.15.81:0/2303148000 >> v1:172.21.15.89:6789/0 conn(0x7fee8c1578d0 legacy=0x7fee8c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.666+0000 7fee83fff700 1 -- 172.21.15.81:0/2303148000 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8c0cfe90 con 0x7fee8c157ca0 2023-10-07T08:45:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.666+0000 7fee83fff700 1 --2- 172.21.15.81:0/2303148000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c157ca0 0x7fee8c0cf4f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fee7c0099b0 tx=0x7fee7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9604871bb00d4a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.666+0000 7fee837fe700 1 -- 172.21.15.81:0/2303148000 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c00b860 con 0x7fee8c157ca0 2023-10-07T08:45:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.666+0000 7fee837fe700 1 -- 172.21.15.81:0/2303148000 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7c00b9c0 con 0x7fee8c157ca0 2023-10-07T08:45:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.666+0000 7fee837fe700 1 -- 172.21.15.81:0/2303148000 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c00bd60 con 0x7fee8c157ca0 2023-10-07T08:45:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.666+0000 7fee92f6d700 1 -- 172.21.15.81:0/2303148000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c157ca0 msgr2=0x7fee8c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.666+0000 7fee92f6d700 1 --2- 172.21.15.81:0/2303148000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c157ca0 0x7fee8c0cf4f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fee7c0099b0 tx=0x7fee7c009250 comp rx=0 tx=0).stop 2023-10-07T08:45:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.666+0000 7fee92f6d700 1 -- 172.21.15.81:0/2303148000 shutdown_connections 2023-10-07T08:45:05.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.666+0000 7fee92f6d700 1 --2- 172.21.15.81:0/2303148000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee8c06d120 0x7fee8c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:05.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.666+0000 7fee92f6d700 1 --2- 172.21.15.81:0/2303148000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c157ca0 0x7fee8c0cf4f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:05.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.666+0000 7fee92f6d700 1 -- 172.21.15.81:0/2303148000 >> 172.21.15.81:0/2303148000 conn(0x7fee8c06bb90 msgr2=0x7fee8c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:05.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.666+0000 7fee92f6d700 1 -- 172.21.15.81:0/2303148000 shutdown_connections 2023-10-07T08:45:05.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.666+0000 7fee92f6d700 1 -- 172.21.15.81:0/2303148000 wait complete. 2023-10-07T08:45:05.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.667+0000 7fee92f6d700 1 Processor -- start 2023-10-07T08:45:05.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.668+0000 7fee92f6d700 1 -- start start 2023-10-07T08:45:05.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.668+0000 7fee92f6d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee8c06d120 0x7fee8c153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:05.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.668+0000 7fee92f6d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee8c1578d0 0x7fee8c0ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:05.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.668+0000 7fee92f6d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c157ca0 0x7fee8c0ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.668+0000 7fee92f6d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c1541b0 con 0x7fee8c157ca0 2023-10-07T08:45:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.668+0000 7fee92f6d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c0ad130 con 0x7fee8c06d120 2023-10-07T08:45:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.668+0000 7fee92f6d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c0ac260 con 0x7fee8c1578d0 2023-10-07T08:45:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.668+0000 7fee9150a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c157ca0 0x7fee8c0ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.669+0000 7fee9150a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c157ca0 0x7fee8c0ab820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52338/0 (socket says 172.21.15.81:52338) 2023-10-07T08:45:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.669+0000 7fee9150a700 1 -- 172.21.15.81:0/52338219 learned_addr learned my addr 172.21.15.81:0/52338219 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.669+0000 7fee83fff700 1 --2- 172.21.15.81:0/52338219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee8c1578d0 0x7fee8c0ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.669+0000 7fee90d09700 1 --2- 172.21.15.81:0/52338219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee8c06d120 0x7fee8c153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.669+0000 7fee9150a700 1 -- 172.21.15.81:0/52338219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee8c1578d0 msgr2=0x7fee8c0ab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.669+0000 7fee9150a700 1 --2- 172.21.15.81:0/52338219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee8c1578d0 0x7fee8c0ab2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.669+0000 7fee9150a700 1 -- 172.21.15.81:0/52338219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee8c06d120 msgr2=0x7fee8c153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.669+0000 7fee9150a700 1 --2- 172.21.15.81:0/52338219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee8c06d120 0x7fee8c153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.669+0000 7fee9150a700 1 -- 172.21.15.81:0/52338219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c0094f0 con 0x7fee8c157ca0 2023-10-07T08:45:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.669+0000 7fee9150a700 1 --2- 172.21.15.81:0/52338219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c157ca0 0x7fee8c0ab820 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fee84009fa0 tx=0x7fee84009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.669+0000 7fee80ff9700 1 -- 172.21.15.81:0/52338219 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8400ebc0 con 0x7fee8c157ca0 2023-10-07T08:45:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.669+0000 7fee80ff9700 1 -- 172.21.15.81:0/52338219 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8400ed20 con 0x7fee8c157ca0 2023-10-07T08:45:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.669+0000 7fee92f6d700 1 -- 172.21.15.81:0/52338219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8c0ac520 con 0x7fee8c157ca0 2023-10-07T08:45:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.669+0000 7fee80ff9700 1 -- 172.21.15.81:0/52338219 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84014670 con 0x7fee8c157ca0 2023-10-07T08:45:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.669+0000 7fee92f6d700 1 -- 172.21.15.81:0/52338219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8c0acae0 con 0x7fee8c157ca0 2023-10-07T08:45:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.670+0000 7fee92f6d700 1 -- 172.21.15.81:0/52338219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8c0ad2c0 con 0x7fee8c157ca0 2023-10-07T08:45:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.671+0000 7fee80ff9700 1 -- 172.21.15.81:0/52338219 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee840149e0 con 0x7fee8c157ca0 2023-10-07T08:45:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.671+0000 7fee80ff9700 1 --2- 172.21.15.81:0/52338219 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee78066f30 0x7fee780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.671+0000 7fee80ff9700 1 -- 172.21.15.81:0/52338219 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fee84084b40 con 0x7fee8c157ca0 2023-10-07T08:45:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.671+0000 7fee90d09700 1 --2- 172.21.15.81:0/52338219 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee78066f30 0x7fee780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:05.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.671+0000 7fee90d09700 1 --2- 172.21.15.81:0/52338219 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee78066f30 0x7fee780693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fee88003a80 tx=0x7fee88007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:05.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.675+0000 7fee80ff9700 1 -- 172.21.15.81:0/52338219 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee84051e10 con 0x7fee8c157ca0 2023-10-07T08:45:05.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:05.898+0000 7fee92f6d700 1 -- 172.21.15.81:0/52338219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fee8c0d0170 con 0x7fee8c157ca0 2023-10-07T08:45:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.547+0000 7fee80ff9700 1 -- 172.21.15.81:0/52338219 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v28) v1 ==== 172+0+0 (secure 0 0 0) 0x7fee84055430 con 0x7fee8c157ca0 2023-10-07T08:45:06.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.553+0000 7fee92f6d700 1 -- 172.21.15.81:0/52338219 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee78066f30 msgr2=0x7fee780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:06.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.553+0000 7fee92f6d700 1 --2- 172.21.15.81:0/52338219 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee78066f30 0x7fee780693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fee88003a80 tx=0x7fee88007ec0 comp rx=0 tx=0).stop 2023-10-07T08:45:06.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.553+0000 7fee92f6d700 1 -- 172.21.15.81:0/52338219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c157ca0 msgr2=0x7fee8c0ab820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:06.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.553+0000 7fee92f6d700 1 --2- 172.21.15.81:0/52338219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c157ca0 0x7fee8c0ab820 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fee84009fa0 tx=0x7fee84009900 comp rx=0 tx=0).stop 2023-10-07T08:45:06.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.553+0000 7fee92f6d700 1 -- 172.21.15.81:0/52338219 shutdown_connections 2023-10-07T08:45:06.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.553+0000 7fee92f6d700 1 --2- 172.21.15.81:0/52338219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c157ca0 0x7fee8c0ab820 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:06.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.553+0000 7fee92f6d700 1 --2- 172.21.15.81:0/52338219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee8c06d120 0x7fee8c153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:06.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.553+0000 7fee92f6d700 1 --2- 172.21.15.81:0/52338219 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee78066f30 0x7fee780693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:06.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.553+0000 7fee92f6d700 1 --2- 172.21.15.81:0/52338219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee8c1578d0 0x7fee8c0ab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:06.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.553+0000 7fee92f6d700 1 -- 172.21.15.81:0/52338219 >> 172.21.15.81:0/52338219 conn(0x7fee8c06bb90 msgr2=0x7fee8c1549c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:06.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.553+0000 7fee92f6d700 1 -- 172.21.15.81:0/52338219 shutdown_connections 2023-10-07T08:45:06.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.554+0000 7fee92f6d700 1 -- 172.21.15.81:0/52338219 wait complete. 2023-10-07T08:45:06.556 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 8 and data pool 9 2023-10-07T08:45:06.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:45:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.681+0000 7fea1f59e700 1 Processor -- start 2023-10-07T08:45:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.681+0000 7fea1f59e700 1 -- start start 2023-10-07T08:45:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.682+0000 7fea1f59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea20159b40 0x7fea200cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.682+0000 7fea1f59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea200cee10 con 0x7fea20159f10 2023-10-07T08:45:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.682+0000 7fea1f59e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea200cd040 con 0x7fea20068e90 2023-10-07T08:45:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.682+0000 7fea1f59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea200cd320 con 0x7fea20159b40 2023-10-07T08:45:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.682+0000 7fea15d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fea20159f10 0x7fea20068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37862/0 (socket says 172.21.15.81:37862) 2023-10-07T08:45:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.682+0000 7fea15d9b700 1 -- 172.21.15.81:0/1011527191 learned_addr learned my addr 172.21.15.81:0/1011527191 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:45:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.682+0000 7fea1e59c700 1 --2- 172.21.15.81:0/1011527191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea20159b40 0x7fea200cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.682+0000 7fea1dd9b700 1 -- 172.21.15.81:0/1011527191 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196406663 0 0) 0x7fea200cee10 con 0x7fea20159f10 2023-10-07T08:45:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.682+0000 7fea1dd9b700 1 -- 172.21.15.81:0/1011527191 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea0c003570 con 0x7fea20159f10 2023-10-07T08:45:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.682+0000 7fea1dd9b700 1 -- 172.21.15.81:0/1011527191 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455253694 0 0) 0x7fea200cd040 con 0x7fea20068e90 2023-10-07T08:45:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.682+0000 7fea1dd9b700 1 -- 172.21.15.81:0/1011527191 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea200cee10 con 0x7fea20068e90 2023-10-07T08:45:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.683+0000 7fea1e59c700 1 -- 172.21.15.81:0/1011527191 >> v1:172.21.15.89:6789/0 conn(0x7fea20068e90 legacy=0x7fea200cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.683+0000 7fea1e59c700 1 -- 172.21.15.81:0/1011527191 >> v1:172.21.15.81:6789/0 conn(0x7fea20159f10 legacy=0x7fea20068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.683+0000 7fea1e59c700 1 -- 172.21.15.81:0/1011527191 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea200ce7c0 con 0x7fea20159b40 2023-10-07T08:45:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.683+0000 7fea1e59c700 1 --2- 172.21.15.81:0/1011527191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea20159b40 0x7fea200cc600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fea10009910 tx=0x7fea100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4a91a80c17472cb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.683+0000 7fea1dd9b700 1 -- 172.21.15.81:0/1011527191 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10011630 con 0x7fea20159b40 2023-10-07T08:45:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.683+0000 7fea1dd9b700 1 -- 172.21.15.81:0/1011527191 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea10011790 con 0x7fea20159b40 2023-10-07T08:45:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.683+0000 7fea1dd9b700 1 -- 172.21.15.81:0/1011527191 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10011b30 con 0x7fea20159b40 2023-10-07T08:45:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.683+0000 7fea1f59e700 1 -- 172.21.15.81:0/1011527191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea20159b40 msgr2=0x7fea200cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.683+0000 7fea1f59e700 1 --2- 172.21.15.81:0/1011527191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea20159b40 0x7fea200cc600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fea10009910 tx=0x7fea100091a0 comp rx=0 tx=0).stop 2023-10-07T08:45:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.683+0000 7fea1f59e700 1 -- 172.21.15.81:0/1011527191 shutdown_connections 2023-10-07T08:45:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.683+0000 7fea1f59e700 1 --2- 172.21.15.81:0/1011527191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea20159b40 0x7fea200cc600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.683+0000 7fea1f59e700 1 -- 172.21.15.81:0/1011527191 >> 172.21.15.81:0/1011527191 conn(0x7fea200cd660 msgr2=0x7fea200cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.683+0000 7fea1f59e700 1 -- 172.21.15.81:0/1011527191 shutdown_connections 2023-10-07T08:45:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.683+0000 7fea1f59e700 1 -- 172.21.15.81:0/1011527191 wait complete. 2023-10-07T08:45:06.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.685+0000 7fea1f59e700 1 Processor -- start 2023-10-07T08:45:06.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.685+0000 7fea1f59e700 1 -- start start 2023-10-07T08:45:06.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.685+0000 7fea1f59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea20068e90 0x7fea20154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:06.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.685+0000 7fea1f59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea20159b40 0x7fea200c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:06.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.685+0000 7fea1f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea20159f10 0x7fea2015c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:06.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.685+0000 7fea1f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea200c8ae0 con 0x7fea20159f10 2023-10-07T08:45:06.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.685+0000 7fea1f59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea200c8dc0 con 0x7fea20068e90 2023-10-07T08:45:06.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.685+0000 7fea1f59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea200c90a0 con 0x7fea20159b40 2023-10-07T08:45:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.686+0000 7fea1ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea20159f10 0x7fea2015c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.686+0000 7fea1ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea20159f10 0x7fea2015c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52346/0 (socket says 172.21.15.81:52346) 2023-10-07T08:45:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.686+0000 7fea1ed9d700 1 -- 172.21.15.81:0/1975165740 learned_addr learned my addr 172.21.15.81:0/1975165740 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.686+0000 7fea1e59c700 1 --2- 172.21.15.81:0/1975165740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea20068e90 0x7fea20154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.686+0000 7fea15d9b700 1 --2- 172.21.15.81:0/1975165740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea20159b40 0x7fea200c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.686+0000 7fea1ed9d700 1 -- 172.21.15.81:0/1975165740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea20159b40 msgr2=0x7fea200c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.686+0000 7fea1ed9d700 1 --2- 172.21.15.81:0/1975165740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea20159b40 0x7fea200c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.686+0000 7fea1ed9d700 1 -- 172.21.15.81:0/1975165740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea20068e90 msgr2=0x7fea20154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.686+0000 7fea1ed9d700 1 --2- 172.21.15.81:0/1975165740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea20068e90 0x7fea20154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.686+0000 7fea1ed9d700 1 -- 172.21.15.81:0/1975165740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea10009420 con 0x7fea20159f10 2023-10-07T08:45:06.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.686+0000 7fea1ed9d700 1 --2- 172.21.15.81:0/1975165740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea20159f10 0x7fea2015c7b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fea1800c910 tx=0x7fea18007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.686+0000 7fea16ffd700 1 -- 172.21.15.81:0/1975165740 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea18012630 con 0x7fea20159f10 2023-10-07T08:45:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.686+0000 7fea16ffd700 1 -- 172.21.15.81:0/1975165740 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea180127b0 con 0x7fea20159f10 2023-10-07T08:45:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.686+0000 7fea16ffd700 1 -- 172.21.15.81:0/1975165740 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea18012b70 con 0x7fea20159f10 2023-10-07T08:45:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.686+0000 7fea1f59e700 1 -- 172.21.15.81:0/1975165740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea200c9380 con 0x7fea20159f10 2023-10-07T08:45:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.686+0000 7fea1f59e700 1 -- 172.21.15.81:0/1975165740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea200c85d0 con 0x7fea20159f10 2023-10-07T08:45:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.687+0000 7fea1f59e700 1 -- 172.21.15.81:0/1975165740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea200c96d0 con 0x7fea20159f10 2023-10-07T08:45:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.688+0000 7fea16ffd700 1 -- 172.21.15.81:0/1975165740 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea1801b400 con 0x7fea20159f10 2023-10-07T08:45:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.688+0000 7fea16ffd700 1 --2- 172.21.15.81:0/1975165740 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fea00066f30 0x7fea000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.688+0000 7fea16ffd700 1 -- 172.21.15.81:0/1975165740 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea18084850 con 0x7fea20159f10 2023-10-07T08:45:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.688+0000 7fea1e59c700 1 --2- 172.21.15.81:0/1975165740 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fea00066f30 0x7fea000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:06.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.688+0000 7fea1e59c700 1 --2- 172.21.15.81:0/1975165740 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fea00066f30 0x7fea000693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fea10009860 tx=0x7fea10017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:06.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.692+0000 7fea16ffd700 1 -- 172.21.15.81:0/1975165740 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea18051ac0 con 0x7fea20159f10 2023-10-07T08:45:06.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.877+0000 7fea1f59e700 1 -- 172.21.15.81:0/1975165740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea200c8850 con 0x7fea20159f10 2023-10-07T08:45:06.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.877+0000 7fea16ffd700 1 -- 172.21.15.81:0/1975165740 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+15315 (secure 0 0 0) 0x7fea18016020 con 0x7fea20159f10 2023-10-07T08:45:06.878 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:45:06.878 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:45:05.899273+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:45:03.701565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-07T08:45:04.877693+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:45:06.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.880+0000 7fea1f59e700 1 -- 172.21.15.81:0/1975165740 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fea00066f30 msgr2=0x7fea000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:06.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.880+0000 7fea1f59e700 1 --2- 172.21.15.81:0/1975165740 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fea00066f30 0x7fea000693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fea10009860 tx=0x7fea10017000 comp rx=0 tx=0).stop 2023-10-07T08:45:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.880+0000 7fea1f59e700 1 -- 172.21.15.81:0/1975165740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea20159f10 msgr2=0x7fea2015c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.880+0000 7fea1f59e700 1 --2- 172.21.15.81:0/1975165740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea20159f10 0x7fea2015c7b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fea1800c910 tx=0x7fea18007f90 comp rx=0 tx=0).stop 2023-10-07T08:45:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.880+0000 7fea1f59e700 1 -- 172.21.15.81:0/1975165740 shutdown_connections 2023-10-07T08:45:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.880+0000 7fea1f59e700 1 --2- 172.21.15.81:0/1975165740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea20159f10 0x7fea2015c7b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.880+0000 7fea1f59e700 1 --2- 172.21.15.81:0/1975165740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea20068e90 0x7fea20154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.880+0000 7fea1f59e700 1 --2- 172.21.15.81:0/1975165740 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fea00066f30 0x7fea000693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.880+0000 7fea1f59e700 1 --2- 172.21.15.81:0/1975165740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea20159b40 0x7fea200c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:06.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.880+0000 7fea1f59e700 1 -- 172.21.15.81:0/1975165740 >> 172.21.15.81:0/1975165740 conn(0x7fea200cd660 msgr2=0x7fea200cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:06.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.880+0000 7fea1f59e700 1 -- 172.21.15.81:0/1975165740 shutdown_connections 2023-10-07T08:45:06.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:06.880+0000 7fea1f59e700 1 -- 172.21.15.81:0/1975165740 wait complete. 2023-10-07T08:45:06.892 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:45:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.006+0000 7faa0c594700 1 Processor -- start 2023-10-07T08:45:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.006+0000 7faa0c594700 1 -- start start 2023-10-07T08:45:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.007+0000 7faa0c594700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa041578d0 0x7faa040cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.007+0000 7faa0c594700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa040d07c0 con 0x7faa0406d120 2023-10-07T08:45:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.007+0000 7faa0c594700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa040cfbb0 con 0x7faa04157ca0 2023-10-07T08:45:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.007+0000 7faa0c594700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa040cfe90 con 0x7faa041578d0 2023-10-07T08:45:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.007+0000 7faa0ab31700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faa0406d120 0x7faa0415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37878/0 (socket says 172.21.15.81:37878) 2023-10-07T08:45:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.007+0000 7faa0ab31700 1 -- 172.21.15.81:0/1140315352 learned_addr learned my addr 172.21.15.81:0/1140315352 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:45:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.007+0000 7faa0a330700 1 --2- 172.21.15.81:0/1140315352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa041578d0 0x7faa040cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.008+0000 7faa0932e700 1 -- 172.21.15.81:0/1140315352 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116439781 0 0) 0x7faa040d07c0 con 0x7faa0406d120 2023-10-07T08:45:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.008+0000 7faa0932e700 1 -- 172.21.15.81:0/1140315352 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f0003570 con 0x7faa0406d120 2023-10-07T08:45:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.008+0000 7faa0932e700 1 -- 172.21.15.81:0/1140315352 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011005474 0 0) 0x7faa040cfbb0 con 0x7faa04157ca0 2023-10-07T08:45:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.008+0000 7faa0932e700 1 -- 172.21.15.81:0/1140315352 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa040d07c0 con 0x7faa04157ca0 2023-10-07T08:45:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.008+0000 7faa0a330700 1 -- 172.21.15.81:0/1140315352 >> v1:172.21.15.89:6789/0 conn(0x7faa04157ca0 legacy=0x7faa0415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.008+0000 7faa0a330700 1 -- 172.21.15.81:0/1140315352 >> v1:172.21.15.81:6789/0 conn(0x7faa0406d120 legacy=0x7faa0415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.008+0000 7faa0a330700 1 -- 172.21.15.81:0/1140315352 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa040d0170 con 0x7faa041578d0 2023-10-07T08:45:07.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.008+0000 7faa0a330700 1 --2- 172.21.15.81:0/1140315352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa041578d0 0x7faa040cf4f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faa00009910 tx=0x7faa000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c5eca5634f32c72 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:07.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.008+0000 7faa0932e700 1 -- 172.21.15.81:0/1140315352 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00011630 con 0x7faa041578d0 2023-10-07T08:45:07.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.008+0000 7faa0932e700 1 -- 172.21.15.81:0/1140315352 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa00011790 con 0x7faa041578d0 2023-10-07T08:45:07.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.008+0000 7faa0932e700 1 -- 172.21.15.81:0/1140315352 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00011b10 con 0x7faa041578d0 2023-10-07T08:45:07.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.009+0000 7faa0c594700 1 -- 172.21.15.81:0/1140315352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa041578d0 msgr2=0x7faa040cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:07.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.009+0000 7faa0c594700 1 --2- 172.21.15.81:0/1140315352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa041578d0 0x7faa040cf4f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faa00009910 tx=0x7faa000091a0 comp rx=0 tx=0).stop 2023-10-07T08:45:07.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.009+0000 7faa0c594700 1 -- 172.21.15.81:0/1140315352 shutdown_connections 2023-10-07T08:45:07.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.009+0000 7faa0c594700 1 --2- 172.21.15.81:0/1140315352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa041578d0 0x7faa040cf4f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:07.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.009+0000 7faa0c594700 1 -- 172.21.15.81:0/1140315352 >> 172.21.15.81:0/1140315352 conn(0x7faa0406bb90 msgr2=0x7faa0406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:07.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.009+0000 7faa0c594700 1 -- 172.21.15.81:0/1140315352 shutdown_connections 2023-10-07T08:45:07.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.009+0000 7faa0c594700 1 -- 172.21.15.81:0/1140315352 wait complete. 2023-10-07T08:45:07.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.010+0000 7faa0c594700 1 Processor -- start 2023-10-07T08:45:07.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.010+0000 7faa0c594700 1 -- start start 2023-10-07T08:45:07.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.010+0000 7faa0c594700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa0406d120 0x7faa0415c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:07.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.010+0000 7faa0c594700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa041578d0 0x7faa041549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:07.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.010+0000 7faa0c594700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa04157ca0 0x7faa04154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:07.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.010+0000 7faa0c594700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa040c6760 con 0x7faa041578d0 2023-10-07T08:45:07.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.010+0000 7faa0c594700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa040c5bc0 con 0x7faa0406d120 2023-10-07T08:45:07.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.010+0000 7faa0c594700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa040c5e30 con 0x7faa04157ca0 2023-10-07T08:45:07.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7faa09b2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa041578d0 0x7faa041549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:07.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7faa09b2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa041578d0 0x7faa041549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52358/0 (socket says 172.21.15.81:52358) 2023-10-07T08:45:07.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7faa09b2f700 1 -- 172.21.15.81:0/421545473 learned_addr learned my addr 172.21.15.81:0/421545473 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:07.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7faa0a330700 1 --2- 172.21.15.81:0/421545473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa0406d120 0x7faa0415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:07.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7faa0ab31700 1 --2- 172.21.15.81:0/421545473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa04157ca0 0x7faa04154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:07.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7faa09b2f700 1 -- 172.21.15.81:0/421545473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa04157ca0 msgr2=0x7faa04154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:07.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7faa09b2f700 1 --2- 172.21.15.81:0/421545473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa04157ca0 0x7faa04154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:07.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7faa09b2f700 1 -- 172.21.15.81:0/421545473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa0406d120 msgr2=0x7faa0415c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:07.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7faa09b2f700 1 --2- 172.21.15.81:0/421545473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa0406d120 0x7faa0415c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:07.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7faa09b2f700 1 -- 172.21.15.81:0/421545473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa00009420 con 0x7faa041578d0 2023-10-07T08:45:07.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7faa0a330700 1 --2- 172.21.15.81:0/421545473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa0406d120 0x7faa0415c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:45:07.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7faa09b2f700 1 --2- 172.21.15.81:0/421545473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa041578d0 0x7faa041549a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400c5c0 tx=0x7fa9f4007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:07.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7fa9fa7fc700 1 -- 172.21.15.81:0/421545473 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4010510 con 0x7faa041578d0 2023-10-07T08:45:07.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7fa9fa7fc700 1 -- 172.21.15.81:0/421545473 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f4010670 con 0x7faa041578d0 2023-10-07T08:45:07.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7faa0c594700 1 -- 172.21.15.81:0/421545473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa040c6110 con 0x7faa041578d0 2023-10-07T08:45:07.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7fa9fa7fc700 1 -- 172.21.15.81:0/421545473 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4010a30 con 0x7faa041578d0 2023-10-07T08:45:07.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.011+0000 7faa0c594700 1 -- 172.21.15.81:0/421545473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0415ce00 con 0x7faa041578d0 2023-10-07T08:45:07.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.012+0000 7faa0c594700 1 -- 172.21.15.81:0/421545473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa04067ac0 con 0x7faa041578d0 2023-10-07T08:45:07.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.012+0000 7fa9fa7fc700 1 -- 172.21.15.81:0/421545473 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9f401b400 con 0x7faa041578d0 2023-10-07T08:45:07.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.013+0000 7fa9fa7fc700 1 --2- 172.21.15.81:0/421545473 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa9e8066f30 0x7fa9e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:07.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.013+0000 7fa9fa7fc700 1 -- 172.21.15.81:0/421545473 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa9f40841a0 con 0x7faa041578d0 2023-10-07T08:45:07.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.013+0000 7faa0a330700 1 --2- 172.21.15.81:0/421545473 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa9e8066f30 0x7fa9e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:07.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.013+0000 7faa0a330700 1 --2- 172.21.15.81:0/421545473 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa9e8066f30 0x7fa9e80693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faa00009860 tx=0x7faa00017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:07.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.017+0000 7fa9fa7fc700 1 -- 172.21.15.81:0/421545473 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9f4051410 con 0x7faa041578d0 2023-10-07T08:45:07.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.202+0000 7faa0c594700 1 -- 172.21.15.81:0/421545473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa040d0450 con 0x7faa041578d0 2023-10-07T08:45:07.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.203+0000 7fa9fa7fc700 1 -- 172.21.15.81:0/421545473 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+15315 (secure 0 0 0) 0x7fa9f4054a30 con 0x7faa041578d0 2023-10-07T08:45:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:45:07.203 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:45:05.899273+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:45:03.701565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-07T08:45:04.877693+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:45:07.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.205+0000 7faa0c594700 1 -- 172.21.15.81:0/421545473 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa9e8066f30 msgr2=0x7fa9e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:07.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.205+0000 7faa0c594700 1 --2- 172.21.15.81:0/421545473 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa9e8066f30 0x7fa9e80693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faa00009860 tx=0x7faa00017000 comp rx=0 tx=0).stop 2023-10-07T08:45:07.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.205+0000 7faa0c594700 1 -- 172.21.15.81:0/421545473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa041578d0 msgr2=0x7faa041549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:07.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.205+0000 7faa0c594700 1 --2- 172.21.15.81:0/421545473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa041578d0 0x7faa041549a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400c5c0 tx=0x7fa9f4007dc0 comp rx=0 tx=0).stop 2023-10-07T08:45:07.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.205+0000 7faa0c594700 1 -- 172.21.15.81:0/421545473 shutdown_connections 2023-10-07T08:45:07.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.205+0000 7faa0c594700 1 --2- 172.21.15.81:0/421545473 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa9e8066f30 0x7fa9e80693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:07.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.205+0000 7faa0c594700 1 --2- 172.21.15.81:0/421545473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa04157ca0 0x7faa04154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:07.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.205+0000 7faa0c594700 1 --2- 172.21.15.81:0/421545473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa0406d120 0x7faa0415c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:07.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.205+0000 7faa0c594700 1 --2- 172.21.15.81:0/421545473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa041578d0 0x7faa041549a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:07.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.205+0000 7faa0c594700 1 -- 172.21.15.81:0/421545473 >> 172.21.15.81:0/421545473 conn(0x7faa0406bb90 msgr2=0x7faa041568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:07.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.205+0000 7faa0c594700 1 -- 172.21.15.81:0/421545473 shutdown_connections 2023-10-07T08:45:07.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.205+0000 7faa0c594700 1 -- 172.21.15.81:0/421545473 wait complete. 2023-10-07T08:45:07.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T08:45:07.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.333+0000 7f641cb82700 1 Processor -- start 2023-10-07T08:45:07.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.333+0000 7f641cb82700 1 -- start start 2023-10-07T08:45:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f641cb82700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64180d0b80 0x7f64180cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f641cb82700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64180d02b0 0x7f641806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f641cb82700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f64180d0f50 0x7f641806d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:07.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f641cb82700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f641815a690 con 0x7f64180d0b80 2023-10-07T08:45:07.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f641cb82700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64180cf2d0 con 0x7f64180d0f50 2023-10-07T08:45:07.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f641cb82700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641806dc00 con 0x7f64180d02b0 2023-10-07T08:45:07.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f64177fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64180d0b80 0x7f64180cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:07.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f64177fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64180d0b80 0x7f64180cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52364/0 (socket says 172.21.15.81:52364) 2023-10-07T08:45:07.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f64177fe700 1 -- 172.21.15.81:0/507214290 learned_addr learned my addr 172.21.15.81:0/507214290 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:07.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f6416ffd700 1 --2- 172.21.15.81:0/507214290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64180d02b0 0x7f641806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:07.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f6417fff700 1 --2- 172.21.15.81:0/507214290 >> v2:172.21.15.89:3300/0 conn(0x7f64180d0f50 0x7f641806d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:07.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f64177fe700 1 -- 172.21.15.81:0/507214290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64180d02b0 msgr2=0x7f641806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:07.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f64177fe700 1 --2- 172.21.15.81:0/507214290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64180d02b0 0x7f641806cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f64177fe700 1 -- 172.21.15.81:0/507214290 >> v2:172.21.15.89:3300/0 conn(0x7f64180d0f50 msgr2=0x7f641806d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f64177fe700 1 --2- 172.21.15.81:0/507214290 >> v2:172.21.15.89:3300/0 conn(0x7f64180d0f50 0x7f641806d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f64177fe700 1 -- 172.21.15.81:0/507214290 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64180cf570 con 0x7f64180d0b80 2023-10-07T08:45:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.334+0000 7f64177fe700 1 --2- 172.21.15.81:0/507214290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64180d0b80 0x7f64180cfd70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f64180ce9e0 tx=0x7f6408009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e746cb41147cc328 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.335+0000 7f64167fc700 1 -- 172.21.15.81:0/507214290 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640800b860 con 0x7f64180d0b80 2023-10-07T08:45:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.335+0000 7f64167fc700 1 -- 172.21.15.81:0/507214290 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640800b9c0 con 0x7f64180d0b80 2023-10-07T08:45:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.335+0000 7f64167fc700 1 -- 172.21.15.81:0/507214290 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640800bd60 con 0x7f64180d0b80 2023-10-07T08:45:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.335+0000 7f641cb82700 1 -- 172.21.15.81:0/507214290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64180d0b80 msgr2=0x7f64180cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:07.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.335+0000 7f641cb82700 1 --2- 172.21.15.81:0/507214290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64180d0b80 0x7f64180cfd70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f64180ce9e0 tx=0x7f6408009250 comp rx=0 tx=0).stop 2023-10-07T08:45:07.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.335+0000 7f641cb82700 1 -- 172.21.15.81:0/507214290 shutdown_connections 2023-10-07T08:45:07.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.335+0000 7f641cb82700 1 --2- 172.21.15.81:0/507214290 >> v2:172.21.15.89:3300/0 conn(0x7f64180d0f50 0x7f641806d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:07.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.335+0000 7f641cb82700 1 --2- 172.21.15.81:0/507214290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64180d0b80 0x7f64180cfd70 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:07.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.335+0000 7f641cb82700 1 --2- 172.21.15.81:0/507214290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64180d02b0 0x7f641806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:07.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.335+0000 7f641cb82700 1 -- 172.21.15.81:0/507214290 >> 172.21.15.81:0/507214290 conn(0x7f6418063230 msgr2=0x7f6418063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:07.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.335+0000 7f641cb82700 1 -- 172.21.15.81:0/507214290 shutdown_connections 2023-10-07T08:45:07.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.335+0000 7f641cb82700 1 -- 172.21.15.81:0/507214290 wait complete. 2023-10-07T08:45:07.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.336+0000 7f641cb82700 1 Processor -- start 2023-10-07T08:45:07.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.336+0000 7f641cb82700 1 -- start start 2023-10-07T08:45:07.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.337+0000 7f641cb82700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64180d02b0 0x7f64180c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:07.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.337+0000 7f641cb82700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64180d0b80 0x7f6418157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:07.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.337+0000 7f641cb82700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64180d0f50 0x7f6418157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:07.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.337+0000 7f641cb82700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64181582e0 con 0x7f64180d02b0 2023-10-07T08:45:07.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.337+0000 7f641cb82700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64180c6970 con 0x7f64180d0f50 2023-10-07T08:45:07.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.337+0000 7f641cb82700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64180c6c50 con 0x7f64180d0b80 2023-10-07T08:45:07.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.337+0000 7f64177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64180d02b0 0x7f64180c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:07.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.337+0000 7f64177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64180d02b0 0x7f64180c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52368/0 (socket says 172.21.15.81:52368) 2023-10-07T08:45:07.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.337+0000 7f64177fe700 1 -- 172.21.15.81:0/465847453 learned_addr learned my addr 172.21.15.81:0/465847453 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:07.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.337+0000 7f64177fe700 1 -- 172.21.15.81:0/465847453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64180d0b80 msgr2=0x7f6418157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:07.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.337+0000 7f64177fe700 1 --2- 172.21.15.81:0/465847453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64180d0b80 0x7f6418157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:07.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.338+0000 7f64177fe700 1 -- 172.21.15.81:0/465847453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64180d0f50 msgr2=0x7f6418157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:07.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.338+0000 7f64177fe700 1 --2- 172.21.15.81:0/465847453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64180d0f50 0x7f6418157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:07.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.338+0000 7f64177fe700 1 -- 172.21.15.81:0/465847453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64080094f0 con 0x7f64180d02b0 2023-10-07T08:45:07.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.338+0000 7f64177fe700 1 --2- 172.21.15.81:0/465847453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64180d02b0 0x7f64180c7f90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f641806fcc0 tx=0x7f6408017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:07.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.338+0000 7f63ff7fe700 1 -- 172.21.15.81:0/465847453 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6408024440 con 0x7f64180d02b0 2023-10-07T08:45:07.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.338+0000 7f63ff7fe700 1 -- 172.21.15.81:0/465847453 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64080245a0 con 0x7f64180d02b0 2023-10-07T08:45:07.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.338+0000 7f641cb82700 1 -- 172.21.15.81:0/465847453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641815e3b0 con 0x7f64180d02b0 2023-10-07T08:45:07.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.338+0000 7f63ff7fe700 1 -- 172.21.15.81:0/465847453 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6408024960 con 0x7f64180d02b0 2023-10-07T08:45:07.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.338+0000 7f641cb82700 1 -- 172.21.15.81:0/465847453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64180c84d0 con 0x7f64180d02b0 2023-10-07T08:45:07.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.339+0000 7f641cb82700 1 -- 172.21.15.81:0/465847453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64180c86c0 con 0x7f64180d02b0 2023-10-07T08:45:07.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.339+0000 7f63ff7fe700 1 -- 172.21.15.81:0/465847453 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f640801a420 con 0x7f64180d02b0 2023-10-07T08:45:07.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.340+0000 7f63ff7fe700 1 --2- 172.21.15.81:0/465847453 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6404066f30 0x7f64040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:07.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.340+0000 7f63ff7fe700 1 -- 172.21.15.81:0/465847453 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f64080864e0 con 0x7f64180d02b0 2023-10-07T08:45:07.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.340+0000 7f6416ffd700 1 --2- 172.21.15.81:0/465847453 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6404066f30 0x7f64040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:07.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.340+0000 7f6416ffd700 1 --2- 172.21.15.81:0/465847453 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6404066f30 0x7f64040693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f64180b4190 tx=0x7f640c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:07.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.344+0000 7f63ff7fe700 1 -- 172.21.15.81:0/465847453 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64080536b0 con 0x7f64180d02b0 2023-10-07T08:45:07.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:07.571+0000 7f641cb82700 1 -- 172.21.15.81:0/465847453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f64180676e0 con 0x7f64180d02b0 2023-10-07T08:45:08.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.553+0000 7f63ff7fe700 1 -- 172.21.15.81:0/465847453 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6408056cd0 con 0x7f64180d02b0 2023-10-07T08:45:08.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.555+0000 7f641cb82700 1 -- 172.21.15.81:0/465847453 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6404066f30 msgr2=0x7f64040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:08.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.555+0000 7f641cb82700 1 --2- 172.21.15.81:0/465847453 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6404066f30 0x7f64040693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f64180b4190 tx=0x7f640c008040 comp rx=0 tx=0).stop 2023-10-07T08:45:08.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.555+0000 7f641cb82700 1 -- 172.21.15.81:0/465847453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64180d02b0 msgr2=0x7f64180c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:08.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.555+0000 7f641cb82700 1 --2- 172.21.15.81:0/465847453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64180d02b0 0x7f64180c7f90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f641806fcc0 tx=0x7f6408017000 comp rx=0 tx=0).stop 2023-10-07T08:45:08.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.555+0000 7f641cb82700 1 -- 172.21.15.81:0/465847453 shutdown_connections 2023-10-07T08:45:08.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.555+0000 7f641cb82700 1 --2- 172.21.15.81:0/465847453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64180d0f50 0x7f6418157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:08.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.555+0000 7f641cb82700 1 --2- 172.21.15.81:0/465847453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64180d02b0 0x7f64180c7f90 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.555+0000 7f641cb82700 1 --2- 172.21.15.81:0/465847453 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6404066f30 0x7f64040693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.555+0000 7f641cb82700 1 --2- 172.21.15.81:0/465847453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64180d0b80 0x7f6418157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.555+0000 7f641cb82700 1 -- 172.21.15.81:0/465847453 >> 172.21.15.81:0/465847453 conn(0x7f6418063230 msgr2=0x7f641806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.555+0000 7f641cb82700 1 -- 172.21.15.81:0/465847453 shutdown_connections 2023-10-07T08:45:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.555+0000 7f641cb82700 1 -- 172.21.15.81:0/465847453 wait complete. 2023-10-07T08:45:08.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T08:45:08.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.688+0000 7fcf907a6700 1 Processor -- start 2023-10-07T08:45:08.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.688+0000 7fcf907a6700 1 -- start start 2023-10-07T08:45:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.689+0000 7fcf907a6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf881578d0 0x7fcf880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.689+0000 7fcf907a6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcf8806d120 0x7fcf8806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.689+0000 7fcf907a6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf8806dac0 con 0x7fcf88157ca0 2023-10-07T08:45:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.689+0000 7fcf907a6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf880d07c0 con 0x7fcf8806d120 2023-10-07T08:45:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.689+0000 7fcf907a6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf880cfbb0 con 0x7fcf881578d0 2023-10-07T08:45:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.689+0000 7fcf8ed43700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcf8806d120 0x7fcf8806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.689+0000 7fcf8ed43700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcf8806d120 0x7fcf8806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52382/0 (socket says 172.21.15.81:52382) 2023-10-07T08:45:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.689+0000 7fcf8ed43700 1 -- 172.21.15.81:0/1613907335 learned_addr learned my addr 172.21.15.81:0/1613907335 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.689+0000 7fcf8e542700 1 --2- 172.21.15.81:0/1613907335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf881578d0 0x7fcf880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.689+0000 7fcf8ed43700 1 -- 172.21.15.81:0/1613907335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf881578d0 msgr2=0x7fcf880cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.689+0000 7fcf8ed43700 1 --2- 172.21.15.81:0/1613907335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf881578d0 0x7fcf880cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.689+0000 7fcf8ed43700 1 -- 172.21.15.81:0/1613907335 >> v1:172.21.15.89:6789/0 conn(0x7fcf88157ca0 legacy=0x7fcf8815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.689+0000 7fcf8ed43700 1 -- 172.21.15.81:0/1613907335 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf880cfe90 con 0x7fcf8806d120 2023-10-07T08:45:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.689+0000 7fcf8ed43700 1 --2- 172.21.15.81:0/1613907335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf8806d120 0x7fcf8806d580 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009f20 tx=0x7fcf78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53f7e50e201c41d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.690+0000 7fcf8d540700 1 -- 172.21.15.81:0/1613907335 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7800e070 con 0x7fcf8806d120 2023-10-07T08:45:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.690+0000 7fcf8d540700 1 -- 172.21.15.81:0/1613907335 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7800ba40 con 0x7fcf8806d120 2023-10-07T08:45:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.690+0000 7fcf8d540700 1 -- 172.21.15.81:0/1613907335 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf780092e0 con 0x7fcf8806d120 2023-10-07T08:45:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.690+0000 7fcf907a6700 1 -- 172.21.15.81:0/1613907335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf8806d120 msgr2=0x7fcf8806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.690+0000 7fcf907a6700 1 --2- 172.21.15.81:0/1613907335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf8806d120 0x7fcf8806d580 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009f20 tx=0x7fcf78009840 comp rx=0 tx=0).stop 2023-10-07T08:45:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.690+0000 7fcf907a6700 1 -- 172.21.15.81:0/1613907335 shutdown_connections 2023-10-07T08:45:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.690+0000 7fcf907a6700 1 --2- 172.21.15.81:0/1613907335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf8806d120 0x7fcf8806d580 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.690+0000 7fcf907a6700 1 --2- 172.21.15.81:0/1613907335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf881578d0 0x7fcf880cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.690+0000 7fcf907a6700 1 -- 172.21.15.81:0/1613907335 >> 172.21.15.81:0/1613907335 conn(0x7fcf8806bb90 msgr2=0x7fcf8806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.690+0000 7fcf907a6700 1 -- 172.21.15.81:0/1613907335 shutdown_connections 2023-10-07T08:45:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.690+0000 7fcf907a6700 1 -- 172.21.15.81:0/1613907335 wait complete. 2023-10-07T08:45:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.691+0000 7fcf907a6700 1 Processor -- start 2023-10-07T08:45:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.691+0000 7fcf907a6700 1 -- start start 2023-10-07T08:45:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.692+0000 7fcf907a6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf8806d120 0x7fcf88151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.692+0000 7fcf907a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf881578d0 0x7fcf8814cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.692+0000 7fcf907a6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf88157ca0 0x7fcf88158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.692+0000 7fcf907a6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8814f920 con 0x7fcf881578d0 2023-10-07T08:45:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.692+0000 7fcf907a6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf88152700 con 0x7fcf88157ca0 2023-10-07T08:45:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.692+0000 7fcf907a6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8814eff0 con 0x7fcf8806d120 2023-10-07T08:45:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.692+0000 7fcf8dd41700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf881578d0 0x7fcf8814cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.692+0000 7fcf8dd41700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf881578d0 0x7fcf8814cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52384/0 (socket says 172.21.15.81:52384) 2023-10-07T08:45:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.692+0000 7fcf8dd41700 1 -- 172.21.15.81:0/595127675 learned_addr learned my addr 172.21.15.81:0/595127675 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.692+0000 7fcf8e542700 1 --2- 172.21.15.81:0/595127675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf8806d120 0x7fcf88151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.692+0000 7fcf8ed43700 1 --2- 172.21.15.81:0/595127675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf88157ca0 0x7fcf88158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.692+0000 7fcf8dd41700 1 -- 172.21.15.81:0/595127675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf8806d120 msgr2=0x7fcf88151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.692+0000 7fcf8dd41700 1 --2- 172.21.15.81:0/595127675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf8806d120 0x7fcf88151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.692+0000 7fcf8dd41700 1 -- 172.21.15.81:0/595127675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf88157ca0 msgr2=0x7fcf88158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.692+0000 7fcf8dd41700 1 --2- 172.21.15.81:0/595127675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf88157ca0 0x7fcf88158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.692+0000 7fcf8dd41700 1 -- 172.21.15.81:0/595127675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf78009ae0 con 0x7fcf881578d0 2023-10-07T08:45:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.693+0000 7fcf8dd41700 1 --2- 172.21.15.81:0/595127675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf881578d0 0x7fcf8814cdc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00b5e0 tx=0x7fcf7c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.693+0000 7fcf867fc700 1 -- 172.21.15.81:0/595127675 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00f510 con 0x7fcf881578d0 2023-10-07T08:45:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.693+0000 7fcf867fc700 1 -- 172.21.15.81:0/595127675 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c00f670 con 0x7fcf881578d0 2023-10-07T08:45:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.693+0000 7fcf867fc700 1 -- 172.21.15.81:0/595127675 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00fa30 con 0x7fcf881578d0 2023-10-07T08:45:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.693+0000 7fcf907a6700 1 -- 172.21.15.81:0/595127675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8814f2d0 con 0x7fcf881578d0 2023-10-07T08:45:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.693+0000 7fcf907a6700 1 -- 172.21.15.81:0/595127675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf88152410 con 0x7fcf881578d0 2023-10-07T08:45:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.694+0000 7fcf907a6700 1 -- 172.21.15.81:0/595127675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8814fad0 con 0x7fcf881578d0 2023-10-07T08:45:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.694+0000 7fcf867fc700 1 -- 172.21.15.81:0/595127675 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf7c01a400 con 0x7fcf881578d0 2023-10-07T08:45:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.694+0000 7fcf867fc700 1 --2- 172.21.15.81:0/595127675 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcf74066f30 0x7fcf740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.695+0000 7fcf867fc700 1 -- 172.21.15.81:0/595127675 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf7c083ee0 con 0x7fcf881578d0 2023-10-07T08:45:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.695+0000 7fcf8e542700 1 --2- 172.21.15.81:0/595127675 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcf74066f30 0x7fcf740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.695+0000 7fcf8e542700 1 --2- 172.21.15.81:0/595127675 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcf74066f30 0x7fcf740693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000acb0 tx=0x7fcf80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:08.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.699+0000 7fcf867fc700 1 -- 172.21.15.81:0/595127675 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf8814fad0 con 0x7fcf881578d0 2023-10-07T08:45:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:08.922+0000 7fcf907a6700 1 -- 172.21.15.81:0/595127675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcf8814fa60 con 0x7fcf881578d0 2023-10-07T08:45:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.556+0000 7fcf867fc700 1 -- 172.21.15.81:0/595127675 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcf7c0511d0 con 0x7fcf881578d0 2023-10-07T08:45:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.559+0000 7fcf907a6700 1 -- 172.21.15.81:0/595127675 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcf74066f30 msgr2=0x7fcf740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.559+0000 7fcf907a6700 1 --2- 172.21.15.81:0/595127675 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcf74066f30 0x7fcf740693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000acb0 tx=0x7fcf80008040 comp rx=0 tx=0).stop 2023-10-07T08:45:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.559+0000 7fcf907a6700 1 -- 172.21.15.81:0/595127675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf881578d0 msgr2=0x7fcf8814cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.559+0000 7fcf907a6700 1 --2- 172.21.15.81:0/595127675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf881578d0 0x7fcf8814cdc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00b5e0 tx=0x7fcf7c009120 comp rx=0 tx=0).stop 2023-10-07T08:45:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.559+0000 7fcf907a6700 1 -- 172.21.15.81:0/595127675 shutdown_connections 2023-10-07T08:45:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.559+0000 7fcf907a6700 1 --2- 172.21.15.81:0/595127675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf88157ca0 0x7fcf88158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.559+0000 7fcf907a6700 1 --2- 172.21.15.81:0/595127675 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcf74066f30 0x7fcf740693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.559+0000 7fcf907a6700 1 --2- 172.21.15.81:0/595127675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf8806d120 0x7fcf88151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.559+0000 7fcf907a6700 1 --2- 172.21.15.81:0/595127675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf881578d0 0x7fcf8814cdc0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.559+0000 7fcf907a6700 1 -- 172.21.15.81:0/595127675 >> 172.21.15.81:0/595127675 conn(0x7fcf8806bb90 msgr2=0x7fcf8815b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:09.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.559+0000 7fcf907a6700 1 -- 172.21.15.81:0/595127675 shutdown_connections 2023-10-07T08:45:09.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.559+0000 7fcf907a6700 1 -- 172.21.15.81:0/595127675 wait complete. 2023-10-07T08:45:09.572 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:45:09.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.686+0000 7f3bf07c2700 1 Processor -- start 2023-10-07T08:45:09.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.686+0000 7f3bf07c2700 1 -- start start 2023-10-07T08:45:09.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.687+0000 7f3bf07c2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3be81578d0 0x7f3be80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:09.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.687+0000 7f3bf07c2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3be8157ca0 0x7f3be815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:09.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.687+0000 7f3bf07c2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be80d07c0 con 0x7f3be806d120 2023-10-07T08:45:09.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.687+0000 7f3bf07c2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be80cfbb0 con 0x7f3be81578d0 2023-10-07T08:45:09.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.687+0000 7f3bf07c2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be80cfe90 con 0x7f3be8157ca0 2023-10-07T08:45:09.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.687+0000 7f3bee55e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3be81578d0 0x7f3be80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:09.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.687+0000 7f3bee55e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3be81578d0 0x7f3be80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52400/0 (socket says 172.21.15.81:52400) 2023-10-07T08:45:09.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.687+0000 7f3bee55e700 1 -- 172.21.15.81:0/597777338 learned_addr learned my addr 172.21.15.81:0/597777338 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:09.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.688+0000 7f3bedd5d700 1 --2- 172.21.15.81:0/597777338 >> v2:172.21.15.89:3300/0 conn(0x7f3be8157ca0 0x7f3be815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:09.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.688+0000 7f3bee55e700 1 -- 172.21.15.81:0/597777338 >> v2:172.21.15.89:3300/0 conn(0x7f3be8157ca0 msgr2=0x7f3be815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:09.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.688+0000 7f3bee55e700 1 --2- 172.21.15.81:0/597777338 >> v2:172.21.15.89:3300/0 conn(0x7f3be8157ca0 0x7f3be815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:09.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.688+0000 7f3bee55e700 1 -- 172.21.15.81:0/597777338 >> v1:172.21.15.89:6789/0 conn(0x7f3be806d120 legacy=0x7f3be806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:09.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.688+0000 7f3bee55e700 1 -- 172.21.15.81:0/597777338 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be80d0170 con 0x7f3be81578d0 2023-10-07T08:45:09.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.688+0000 7f3bee55e700 1 --2- 172.21.15.81:0/597777338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be81578d0 0x7f3be80cf4f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3be8068510 tx=0x7f3be4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c078821dcd6e0af1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:09.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.688+0000 7f3bed55c700 1 -- 172.21.15.81:0/597777338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be400e070 con 0x7f3be81578d0 2023-10-07T08:45:09.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.688+0000 7f3bed55c700 1 -- 172.21.15.81:0/597777338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be400ba10 con 0x7f3be81578d0 2023-10-07T08:45:09.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.688+0000 7f3bed55c700 1 -- 172.21.15.81:0/597777338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be40092e0 con 0x7f3be81578d0 2023-10-07T08:45:09.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.688+0000 7f3bf07c2700 1 -- 172.21.15.81:0/597777338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be81578d0 msgr2=0x7f3be80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:09.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.688+0000 7f3bf07c2700 1 --2- 172.21.15.81:0/597777338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be81578d0 0x7f3be80cf4f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3be8068510 tx=0x7f3be4009840 comp rx=0 tx=0).stop 2023-10-07T08:45:09.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.689+0000 7f3bf07c2700 1 -- 172.21.15.81:0/597777338 shutdown_connections 2023-10-07T08:45:09.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.689+0000 7f3bf07c2700 1 --2- 172.21.15.81:0/597777338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be81578d0 0x7f3be80cf4f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:09.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.689+0000 7f3bf07c2700 1 --2- 172.21.15.81:0/597777338 >> v2:172.21.15.89:3300/0 conn(0x7f3be8157ca0 0x7f3be815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:09.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.689+0000 7f3bf07c2700 1 -- 172.21.15.81:0/597777338 >> 172.21.15.81:0/597777338 conn(0x7f3be806bb90 msgr2=0x7f3be806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:09.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.689+0000 7f3bf07c2700 1 -- 172.21.15.81:0/597777338 shutdown_connections 2023-10-07T08:45:09.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.689+0000 7f3bf07c2700 1 -- 172.21.15.81:0/597777338 wait complete. 2023-10-07T08:45:09.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.690+0000 7f3bf07c2700 1 Processor -- start 2023-10-07T08:45:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.690+0000 7f3bf07c2700 1 -- start start 2023-10-07T08:45:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.690+0000 7f3bf07c2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3be806d120 0x7f3be80cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.690+0000 7f3bf07c2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3be81578d0 0x7f3be81464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.690+0000 7f3bf07c2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8157ca0 0x7f3be81439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.690+0000 7f3bf07c2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80cde90 con 0x7f3be8157ca0 2023-10-07T08:45:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.690+0000 7f3bf07c2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be81444c0 con 0x7f3be81578d0 2023-10-07T08:45:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.690+0000 7f3bf07c2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be81447a0 con 0x7f3be806d120 2023-10-07T08:45:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.690+0000 7f3beed5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8157ca0 0x7f3be81439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.690+0000 7f3beed5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8157ca0 0x7f3be81439d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52412/0 (socket says 172.21.15.81:52412) 2023-10-07T08:45:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.691+0000 7f3beed5f700 1 -- 172.21.15.81:0/3369763987 learned_addr learned my addr 172.21.15.81:0/3369763987 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.691+0000 7f3bee55e700 1 --2- 172.21.15.81:0/3369763987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3be806d120 0x7f3be80cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.691+0000 7f3beed5f700 1 -- 172.21.15.81:0/3369763987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3be806d120 msgr2=0x7f3be80cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.691+0000 7f3beed5f700 1 --2- 172.21.15.81:0/3369763987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3be806d120 0x7f3be80cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.691+0000 7f3beed5f700 1 -- 172.21.15.81:0/3369763987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3be81578d0 msgr2=0x7f3be81464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.691+0000 7f3bedd5d700 1 --2- 172.21.15.81:0/3369763987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3be81578d0 0x7f3be81464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.691+0000 7f3beed5f700 1 --2- 172.21.15.81:0/3369763987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3be81578d0 0x7f3be81464f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.691+0000 7f3beed5f700 1 -- 172.21.15.81:0/3369763987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be4009ae0 con 0x7f3be8157ca0 2023-10-07T08:45:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.691+0000 7f3beed5f700 1 --2- 172.21.15.81:0/3369763987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8157ca0 0x7f3be81439d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3be000c5b0 tx=0x7f3be0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.691+0000 7f3bde7fc700 1 -- 172.21.15.81:0/3369763987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0011590 con 0x7f3be8157ca0 2023-10-07T08:45:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.691+0000 7f3bde7fc700 1 -- 172.21.15.81:0/3369763987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be0011710 con 0x7f3be8157ca0 2023-10-07T08:45:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.691+0000 7f3bf07c2700 1 -- 172.21.15.81:0/3369763987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be8144a80 con 0x7f3be8157ca0 2023-10-07T08:45:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.691+0000 7f3bde7fc700 1 -- 172.21.15.81:0/3369763987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0011ad0 con 0x7f3be8157ca0 2023-10-07T08:45:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.691+0000 7f3bf07c2700 1 -- 172.21.15.81:0/3369763987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be80b5e20 con 0x7f3be8157ca0 2023-10-07T08:45:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.692+0000 7f3bf07c2700 1 -- 172.21.15.81:0/3369763987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be8145280 con 0x7f3be8157ca0 2023-10-07T08:45:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.692+0000 7f3bde7fc700 1 -- 172.21.15.81:0/3369763987 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3be001c460 con 0x7f3be8157ca0 2023-10-07T08:45:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.693+0000 7f3bde7fc700 1 --2- 172.21.15.81:0/3369763987 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3bcc066f30 0x7f3bcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.693+0000 7f3bde7fc700 1 -- 172.21.15.81:0/3369763987 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3be0084200 con 0x7f3be8157ca0 2023-10-07T08:45:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.693+0000 7f3bee55e700 1 --2- 172.21.15.81:0/3369763987 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3bcc066f30 0x7f3bcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.693+0000 7f3bee55e700 1 --2- 172.21.15.81:0/3369763987 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3bcc066f30 0x7f3bcc0693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009880 tx=0x7f3be4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.697+0000 7f3bde7fc700 1 -- 172.21.15.81:0/3369763987 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3be8145280 con 0x7f3be8157ca0 2023-10-07T08:45:09.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.919+0000 7f3bf07c2700 1 -- 172.21.15.81:0/3369763987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3be8145280 con 0x7f3be8157ca0 2023-10-07T08:45:09.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.919+0000 7f3bde7fc700 1 -- 172.21.15.81:0/3369763987 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f3be8145280 con 0x7f3be8157ca0 2023-10-07T08:45:09.920 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:45:09.920 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3279897900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3279897900},{"type":"v1","addr":"172.21.15.89:6835","nonce":3279897900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/102905724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":102905724},{"type":"v1","addr":"172.21.15.89:6834","nonce":102905724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4063096820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":4063096820},{"type":"v1","addr":"172.21.15.81:6836","nonce":4063096820}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:45:05.899585+0000","modified":"2023-10-07T08:45:09.552432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2943588561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2943588561},{"type":"v1","addr":"172.21.15.81:6837","nonce":2943588561}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-07T08:45:09.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.921+0000 7f3bf07c2700 1 -- 172.21.15.81:0/3369763987 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3bcc066f30 msgr2=0x7f3bcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:09.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.921+0000 7f3bf07c2700 1 --2- 172.21.15.81:0/3369763987 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3bcc066f30 0x7f3bcc0693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009880 tx=0x7f3be4017000 comp rx=0 tx=0).stop 2023-10-07T08:45:09.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.921+0000 7f3bf07c2700 1 -- 172.21.15.81:0/3369763987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8157ca0 msgr2=0x7f3be81439d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:09.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.921+0000 7f3bf07c2700 1 --2- 172.21.15.81:0/3369763987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8157ca0 0x7f3be81439d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3be000c5b0 tx=0x7f3be0007f60 comp rx=0 tx=0).stop 2023-10-07T08:45:09.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.921+0000 7f3bf07c2700 1 -- 172.21.15.81:0/3369763987 shutdown_connections 2023-10-07T08:45:09.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.921+0000 7f3bf07c2700 1 --2- 172.21.15.81:0/3369763987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8157ca0 0x7f3be81439d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:09.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.921+0000 7f3bf07c2700 1 --2- 172.21.15.81:0/3369763987 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3bcc066f30 0x7f3bcc0693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:09.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.921+0000 7f3bf07c2700 1 --2- 172.21.15.81:0/3369763987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3be806d120 0x7f3be80cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:09.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.921+0000 7f3bf07c2700 1 --2- 172.21.15.81:0/3369763987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3be81578d0 0x7f3be81464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:09.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.921+0000 7f3bf07c2700 1 -- 172.21.15.81:0/3369763987 >> 172.21.15.81:0/3369763987 conn(0x7f3be806bb90 msgr2=0x7f3be8154720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:09.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.921+0000 7f3bf07c2700 1 -- 172.21.15.81:0/3369763987 shutdown_connections 2023-10-07T08:45:09.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:09.921+0000 7f3bf07c2700 1 -- 172.21.15.81:0/3369763987 wait complete. 2023-10-07T08:45:09.923 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2023-10-07T08:45:09.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:45:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.048+0000 7fedce22e700 1 Processor -- start 2023-10-07T08:45:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.048+0000 7fedce22e700 1 -- start start 2023-10-07T08:45:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.049+0000 7fedce22e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fedc8157fe0 0x7fedc80b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.049+0000 7fedce22e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fedc80cf240 0x7fedc80b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.049+0000 7fedce22e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc80b2890 con 0x7fedc81583b0 2023-10-07T08:45:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.049+0000 7fedce22e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc80b4070 con 0x7fedc8157fe0 2023-10-07T08:45:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.049+0000 7fedce22e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc80b4350 con 0x7fedc80cf240 2023-10-07T08:45:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.049+0000 7fedc77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fedc8157fe0 0x7fedc80b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.049+0000 7fedc77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fedc8157fe0 0x7fedc80b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52416/0 (socket says 172.21.15.81:52416) 2023-10-07T08:45:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.049+0000 7fedc77fe700 1 -- 172.21.15.81:0/2857352813 learned_addr learned my addr 172.21.15.81:0/2857352813 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.050+0000 7fedc7fff700 1 --2- 172.21.15.81:0/2857352813 >> v2:172.21.15.89:3300/0 conn(0x7fedc80cf240 0x7fedc80b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.050+0000 7fedc77fe700 1 -- 172.21.15.81:0/2857352813 >> v2:172.21.15.89:3300/0 conn(0x7fedc80cf240 msgr2=0x7fedc80b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.050+0000 7fedc77fe700 1 --2- 172.21.15.81:0/2857352813 >> v2:172.21.15.89:3300/0 conn(0x7fedc80cf240 0x7fedc80b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.050+0000 7fedc77fe700 1 -- 172.21.15.81:0/2857352813 >> v1:172.21.15.89:6789/0 conn(0x7fedc81583b0 legacy=0x7fedc80ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.050+0000 7fedc77fe700 1 -- 172.21.15.81:0/2857352813 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc80b4630 con 0x7fedc8157fe0 2023-10-07T08:45:10.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.050+0000 7fedc7fff700 1 --2- 172.21.15.81:0/2857352813 >> v2:172.21.15.89:3300/0 conn(0x7fedc80cf240 0x7fedc80b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:45:10.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.050+0000 7fedc77fe700 1 --2- 172.21.15.81:0/2857352813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedc8157fe0 0x7fedc80b34c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fedc8069790 tx=0x7fedb8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14cd143974a19c1c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:10.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.050+0000 7fedc67fc700 1 -- 172.21.15.81:0/2857352813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb800e070 con 0x7fedc8157fe0 2023-10-07T08:45:10.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.050+0000 7fedc67fc700 1 -- 172.21.15.81:0/2857352813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb800ba10 con 0x7fedc8157fe0 2023-10-07T08:45:10.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.050+0000 7fedc67fc700 1 -- 172.21.15.81:0/2857352813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb80092e0 con 0x7fedc8157fe0 2023-10-07T08:45:10.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.050+0000 7fedce22e700 1 -- 172.21.15.81:0/2857352813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedc8157fe0 msgr2=0x7fedc80b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:10.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.050+0000 7fedce22e700 1 --2- 172.21.15.81:0/2857352813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedc8157fe0 0x7fedc80b34c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fedc8069790 tx=0x7fedb8009840 comp rx=0 tx=0).stop 2023-10-07T08:45:10.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.051+0000 7fedce22e700 1 -- 172.21.15.81:0/2857352813 shutdown_connections 2023-10-07T08:45:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.051+0000 7fedce22e700 1 --2- 172.21.15.81:0/2857352813 >> v2:172.21.15.89:3300/0 conn(0x7fedc80cf240 0x7fedc80b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.051+0000 7fedce22e700 1 --2- 172.21.15.81:0/2857352813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedc8157fe0 0x7fedc80b34c0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.051+0000 7fedce22e700 1 -- 172.21.15.81:0/2857352813 >> 172.21.15.81:0/2857352813 conn(0x7fedc8067640 msgr2=0x7fedc8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.051+0000 7fedce22e700 1 -- 172.21.15.81:0/2857352813 shutdown_connections 2023-10-07T08:45:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.051+0000 7fedce22e700 1 -- 172.21.15.81:0/2857352813 wait complete. 2023-10-07T08:45:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.052+0000 7fedce22e700 1 Processor -- start 2023-10-07T08:45:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.052+0000 7fedce22e700 1 -- start start 2023-10-07T08:45:10.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.052+0000 7fedce22e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedc80cf240 0x7fedc8151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.052+0000 7fedce22e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedc8157fe0 0x7fedc816a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.052+0000 7fedce22e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedc81583b0 0x7fedc816df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.052+0000 7fedce22e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc806d6c0 con 0x7fedc8157fe0 2023-10-07T08:45:10.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.052+0000 7fedce22e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc80c99c0 con 0x7fedc81583b0 2023-10-07T08:45:10.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.052+0000 7fedce22e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc806cdd0 con 0x7fedc80cf240 2023-10-07T08:45:10.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.053+0000 7fedc6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedc8157fe0 0x7fedc816a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.053+0000 7fedc6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedc8157fe0 0x7fedc816a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52424/0 (socket says 172.21.15.81:52424) 2023-10-07T08:45:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.053+0000 7fedc6ffd700 1 -- 172.21.15.81:0/3393219561 learned_addr learned my addr 172.21.15.81:0/3393219561 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.053+0000 7fedc77fe700 1 --2- 172.21.15.81:0/3393219561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedc80cf240 0x7fedc8151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.053+0000 7fedc7fff700 1 --2- 172.21.15.81:0/3393219561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedc81583b0 0x7fedc816df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.053+0000 7fedc6ffd700 1 -- 172.21.15.81:0/3393219561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedc80cf240 msgr2=0x7fedc8151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.053+0000 7fedc6ffd700 1 --2- 172.21.15.81:0/3393219561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedc80cf240 0x7fedc8151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.053+0000 7fedc6ffd700 1 -- 172.21.15.81:0/3393219561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedc81583b0 msgr2=0x7fedc816df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.053+0000 7fedc6ffd700 1 --2- 172.21.15.81:0/3393219561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedc81583b0 0x7fedc816df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.053+0000 7fedc6ffd700 1 -- 172.21.15.81:0/3393219561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb8009ae0 con 0x7fedc8157fe0 2023-10-07T08:45:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.053+0000 7fedc6ffd700 1 --2- 172.21.15.81:0/3393219561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedc8157fe0 0x7fedc816a980 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00c5d0 tx=0x7fedbc007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:10.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.053+0000 7fedaf7fe700 1 -- 172.21.15.81:0/3393219561 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc011590 con 0x7fedc8157fe0 2023-10-07T08:45:10.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.053+0000 7fedaf7fe700 1 -- 172.21.15.81:0/3393219561 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedbc011710 con 0x7fedc8157fe0 2023-10-07T08:45:10.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.053+0000 7fedce22e700 1 -- 172.21.15.81:0/3393219561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc806d070 con 0x7fedc8157fe0 2023-10-07T08:45:10.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.053+0000 7fedaf7fe700 1 -- 172.21.15.81:0/3393219561 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc011ad0 con 0x7fedc8157fe0 2023-10-07T08:45:10.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.053+0000 7fedce22e700 1 -- 172.21.15.81:0/3393219561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc8151db0 con 0x7fedc8157fe0 2023-10-07T08:45:10.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.054+0000 7fedce22e700 1 -- 172.21.15.81:0/3393219561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc8069e40 con 0x7fedc8157fe0 2023-10-07T08:45:10.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.055+0000 7fedaf7fe700 1 -- 172.21.15.81:0/3393219561 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fedbc01c460 con 0x7fedc8157fe0 2023-10-07T08:45:10.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.055+0000 7fedaf7fe700 1 --2- 172.21.15.81:0/3393219561 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fedb4066f30 0x7fedb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.055+0000 7fedaf7fe700 1 -- 172.21.15.81:0/3393219561 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fedbc084250 con 0x7fedc8157fe0 2023-10-07T08:45:10.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.055+0000 7fedc77fe700 1 --2- 172.21.15.81:0/3393219561 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fedb4066f30 0x7fedb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.055+0000 7fedc77fe700 1 --2- 172.21.15.81:0/3393219561 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fedb4066f30 0x7fedb40693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fedb8009880 tx=0x7fedb8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:10.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.059+0000 7fedaf7fe700 1 -- 172.21.15.81:0/3393219561 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fedbc0514c0 con 0x7fedc8157fe0 2023-10-07T08:45:10.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.239+0000 7fedce22e700 1 -- 172.21.15.81:0/3393219561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedc806d800 con 0x7fedc8157fe0 2023-10-07T08:45:10.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.240+0000 7fedaf7fe700 1 -- 172.21.15.81:0/3393219561 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fedbc054ae0 con 0x7fedc8157fe0 2023-10-07T08:45:10.240 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:45:10.241 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":67,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:45:07.533160+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:45:03.701565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-07T08:45:04.877693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:45:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.242+0000 7fedce22e700 1 -- 172.21.15.81:0/3393219561 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fedb4066f30 msgr2=0x7fedb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.242+0000 7fedce22e700 1 --2- 172.21.15.81:0/3393219561 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fedb4066f30 0x7fedb40693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fedb8009880 tx=0x7fedb8017000 comp rx=0 tx=0).stop 2023-10-07T08:45:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.242+0000 7fedce22e700 1 -- 172.21.15.81:0/3393219561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedc8157fe0 msgr2=0x7fedc816a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.242+0000 7fedce22e700 1 --2- 172.21.15.81:0/3393219561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedc8157fe0 0x7fedc816a980 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00c5d0 tx=0x7fedbc007f60 comp rx=0 tx=0).stop 2023-10-07T08:45:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.242+0000 7fedce22e700 1 -- 172.21.15.81:0/3393219561 shutdown_connections 2023-10-07T08:45:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.242+0000 7fedce22e700 1 --2- 172.21.15.81:0/3393219561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedc81583b0 0x7fedc816df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.242+0000 7fedce22e700 1 --2- 172.21.15.81:0/3393219561 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fedb4066f30 0x7fedb40693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.242+0000 7fedce22e700 1 --2- 172.21.15.81:0/3393219561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedc80cf240 0x7fedc8151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.242+0000 7fedce22e700 1 --2- 172.21.15.81:0/3393219561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedc8157fe0 0x7fedc816a980 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.242+0000 7fedce22e700 1 -- 172.21.15.81:0/3393219561 >> 172.21.15.81:0/3393219561 conn(0x7fedc8067640 msgr2=0x7fedc8153c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:10.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.242+0000 7fedce22e700 1 -- 172.21.15.81:0/3393219561 shutdown_connections 2023-10-07T08:45:10.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.242+0000 7fedce22e700 1 -- 172.21.15.81:0/3393219561 wait complete. 2023-10-07T08:45:10.254 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T08:45:10.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:45:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.368+0000 7f6de31bf700 1 Processor -- start 2023-10-07T08:45:10.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.368+0000 7f6de31bf700 1 -- start start 2023-10-07T08:45:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.369+0000 7f6de31bf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6ddc157fe0 0x7f6ddc0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.369+0000 7f6de31bf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ddc0cf240 0x7f6ddc0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.369+0000 7f6de31bf700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ddc0b2890 con 0x7f6ddc1583b0 2023-10-07T08:45:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.369+0000 7f6de31bf700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ddc0b4070 con 0x7f6ddc157fe0 2023-10-07T08:45:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.369+0000 7f6de31bf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0b4350 con 0x7f6ddc0cf240 2023-10-07T08:45:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.370+0000 7f6dd3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6ddc1583b0 0x7f6ddc0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37890/0 (socket says 172.21.15.81:37890) 2023-10-07T08:45:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.370+0000 7f6dd3fff700 1 -- 172.21.15.81:0/3806685399 learned_addr learned my addr 172.21.15.81:0/3806685399 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:45:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.370+0000 7f6de175c700 1 --2- 172.21.15.81:0/3806685399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ddc0cf240 0x7f6ddc0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.370+0000 7f6de0f5b700 1 --2- 172.21.15.81:0/3806685399 >> v2:172.21.15.89:3300/0 conn(0x7f6ddc157fe0 0x7f6ddc0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.370+0000 7f6dd37fe700 1 -- 172.21.15.81:0/3806685399 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440244264 0 0) 0x7f6ddc0b2890 con 0x7f6ddc1583b0 2023-10-07T08:45:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.370+0000 7f6dd37fe700 1 -- 172.21.15.81:0/3806685399 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dc4003570 con 0x7f6ddc1583b0 2023-10-07T08:45:10.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.370+0000 7f6de175c700 1 -- 172.21.15.81:0/3806685399 >> v2:172.21.15.89:3300/0 conn(0x7f6ddc157fe0 msgr2=0x7f6ddc0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.370+0000 7f6de175c700 1 --2- 172.21.15.81:0/3806685399 >> v2:172.21.15.89:3300/0 conn(0x7f6ddc157fe0 0x7f6ddc0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.370+0000 7f6de175c700 1 -- 172.21.15.81:0/3806685399 >> v1:172.21.15.81:6789/0 conn(0x7f6ddc1583b0 legacy=0x7f6ddc0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.370+0000 7f6de175c700 1 -- 172.21.15.81:0/3806685399 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc0b4630 con 0x7f6ddc0cf240 2023-10-07T08:45:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.370+0000 7f6de0f5b700 1 --2- 172.21.15.81:0/3806685399 >> v2:172.21.15.89:3300/0 conn(0x7f6ddc157fe0 0x7f6ddc0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:45:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.370+0000 7f6de175c700 1 --2- 172.21.15.81:0/3806685399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ddc0cf240 0x7f6ddc0b3a00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40098e0 tx=0x7f6dd40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2288a513e7f958db server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.370+0000 7f6dd37fe700 1 -- 172.21.15.81:0/3806685399 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4011630 con 0x7f6ddc0cf240 2023-10-07T08:45:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.370+0000 7f6dd37fe700 1 -- 172.21.15.81:0/3806685399 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd4011790 con 0x7f6ddc0cf240 2023-10-07T08:45:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.370+0000 7f6dd37fe700 1 -- 172.21.15.81:0/3806685399 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4011b30 con 0x7f6ddc0cf240 2023-10-07T08:45:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.371+0000 7f6de31bf700 1 -- 172.21.15.81:0/3806685399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ddc0cf240 msgr2=0x7f6ddc0b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.371+0000 7f6de31bf700 1 --2- 172.21.15.81:0/3806685399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ddc0cf240 0x7f6ddc0b3a00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40098e0 tx=0x7f6dd40091a0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.371+0000 7f6de31bf700 1 -- 172.21.15.81:0/3806685399 shutdown_connections 2023-10-07T08:45:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.371+0000 7f6de31bf700 1 --2- 172.21.15.81:0/3806685399 >> v2:172.21.15.89:3300/0 conn(0x7f6ddc157fe0 0x7f6ddc0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.371+0000 7f6de31bf700 1 --2- 172.21.15.81:0/3806685399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ddc0cf240 0x7f6ddc0b3a00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.371+0000 7f6de31bf700 1 -- 172.21.15.81:0/3806685399 >> 172.21.15.81:0/3806685399 conn(0x7f6ddc067640 msgr2=0x7f6ddc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.371+0000 7f6de31bf700 1 -- 172.21.15.81:0/3806685399 shutdown_connections 2023-10-07T08:45:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.371+0000 7f6de31bf700 1 -- 172.21.15.81:0/3806685399 wait complete. 2023-10-07T08:45:10.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.372+0000 7f6de31bf700 1 Processor -- start 2023-10-07T08:45:10.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.372+0000 7f6de31bf700 1 -- start start 2023-10-07T08:45:10.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6de31bf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ddc0cf240 0x7f6ddc150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6de31bf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ddc157fe0 0x7f6ddc14ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6de31bf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ddc1583b0 0x7f6ddc15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6de31bf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc15bda0 con 0x7f6ddc157fe0 2023-10-07T08:45:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6de31bf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc15c080 con 0x7f6ddc1583b0 2023-10-07T08:45:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6de31bf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc15c360 con 0x7f6ddc0cf240 2023-10-07T08:45:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6dd3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ddc157fe0 0x7f6ddc14ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6dd3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ddc157fe0 0x7f6ddc14ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52434/0 (socket says 172.21.15.81:52434) 2023-10-07T08:45:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6dd3fff700 1 -- 172.21.15.81:0/680405429 learned_addr learned my addr 172.21.15.81:0/680405429 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6de175c700 1 --2- 172.21.15.81:0/680405429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ddc1583b0 0x7f6ddc15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6de0f5b700 1 --2- 172.21.15.81:0/680405429 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ddc0cf240 0x7f6ddc150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6dd3fff700 1 -- 172.21.15.81:0/680405429 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ddc0cf240 msgr2=0x7f6ddc150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:10.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6dd3fff700 1 --2- 172.21.15.81:0/680405429 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ddc0cf240 0x7f6ddc150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6dd3fff700 1 -- 172.21.15.81:0/680405429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ddc1583b0 msgr2=0x7f6ddc15aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:10.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6dd3fff700 1 --2- 172.21.15.81:0/680405429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ddc1583b0 0x7f6ddc15aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6dd3fff700 1 -- 172.21.15.81:0/680405429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd8009a20 con 0x7f6ddc157fe0 2023-10-07T08:45:10.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.373+0000 7f6dd3fff700 1 --2- 172.21.15.81:0/680405429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ddc157fe0 0x7f6ddc14ec70 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00c7c0 tx=0x7f6dcc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:10.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.374+0000 7f6dd0ff9700 1 -- 172.21.15.81:0/680405429 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc005cd0 con 0x7f6ddc157fe0 2023-10-07T08:45:10.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.374+0000 7f6dd0ff9700 1 -- 172.21.15.81:0/680405429 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc005e30 con 0x7f6ddc157fe0 2023-10-07T08:45:10.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.374+0000 7f6dd0ff9700 1 -- 172.21.15.81:0/680405429 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc007320 con 0x7f6ddc157fe0 2023-10-07T08:45:10.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.374+0000 7f6de31bf700 1 -- 172.21.15.81:0/680405429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd4009420 con 0x7f6ddc157fe0 2023-10-07T08:45:10.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.374+0000 7f6de31bf700 1 -- 172.21.15.81:0/680405429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc14f1b0 con 0x7f6ddc157fe0 2023-10-07T08:45:10.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.375+0000 7f6de31bf700 1 -- 172.21.15.81:0/680405429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc15bee0 con 0x7f6ddc157fe0 2023-10-07T08:45:10.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.375+0000 7f6dd0ff9700 1 -- 172.21.15.81:0/680405429 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6dcc01b3b0 con 0x7f6ddc157fe0 2023-10-07T08:45:10.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.375+0000 7f6dd0ff9700 1 --2- 172.21.15.81:0/680405429 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6dc8066f30 0x7f6dc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.375+0000 7f6dd0ff9700 1 -- 172.21.15.81:0/680405429 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6dcc083bd0 con 0x7f6ddc157fe0 2023-10-07T08:45:10.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.375+0000 7f6de0f5b700 1 --2- 172.21.15.81:0/680405429 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6dc8066f30 0x7f6dc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.376+0000 7f6de0f5b700 1 --2- 172.21.15.81:0/680405429 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6dc8066f30 0x7f6dc80693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009fd0 tx=0x7f6dd800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:10.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.379+0000 7f6dd0ff9700 1 -- 172.21.15.81:0/680405429 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ddc15bee0 con 0x7f6ddc157fe0 2023-10-07T08:45:10.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.557+0000 7f6de31bf700 1 -- 172.21.15.81:0/680405429 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ddc15bee0 con 0x7f6dc8066f30 2023-10-07T08:45:10.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.565+0000 7f6dd0ff9700 1 -- 172.21.15.81:0/680405429 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284648 (secure 0 0 0) 0x7f6ddc15bee0 con 0x7f6dc8066f30 2023-10-07T08:45:10.569 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:45:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.568+0000 7f6de31bf700 1 -- 172.21.15.81:0/680405429 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6dc8066f30 msgr2=0x7f6dc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.568+0000 7f6de31bf700 1 --2- 172.21.15.81:0/680405429 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6dc8066f30 0x7f6dc80693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009fd0 tx=0x7f6dd800b040 comp rx=0 tx=0).stop 2023-10-07T08:45:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.568+0000 7f6de31bf700 1 -- 172.21.15.81:0/680405429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ddc157fe0 msgr2=0x7f6ddc14ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.568+0000 7f6de31bf700 1 --2- 172.21.15.81:0/680405429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ddc157fe0 0x7f6ddc14ec70 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00c7c0 tx=0x7f6dcc007e00 comp rx=0 tx=0).stop 2023-10-07T08:45:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.568+0000 7f6de31bf700 1 -- 172.21.15.81:0/680405429 shutdown_connections 2023-10-07T08:45:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.568+0000 7f6de31bf700 1 --2- 172.21.15.81:0/680405429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ddc1583b0 0x7f6ddc15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.568+0000 7f6de31bf700 1 --2- 172.21.15.81:0/680405429 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6dc8066f30 0x7f6dc80693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.568+0000 7f6de31bf700 1 --2- 172.21.15.81:0/680405429 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ddc0cf240 0x7f6ddc150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.568+0000 7f6de31bf700 1 --2- 172.21.15.81:0/680405429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ddc157fe0 0x7f6ddc14ec70 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.568+0000 7f6de31bf700 1 -- 172.21.15.81:0/680405429 >> 172.21.15.81:0/680405429 conn(0x7f6ddc067640 msgr2=0x7f6ddc0ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.568+0000 7f6de31bf700 1 -- 172.21.15.81:0/680405429 shutdown_connections 2023-10-07T08:45:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.568+0000 7f6de31bf700 1 -- 172.21.15.81:0/680405429 wait complete. 2023-10-07T08:45:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:45:10.580 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2023-10-07T08:45:10.032389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3839,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558660,"statfs":{"total":1600000000,"available":1596068076,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.512982"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.540296+0000","last_change":"2023-10-07T08:45:06.540099+0000","last_active":"2023-10-07T08:45:06.540296+0000","last_peered":"2023-10-07T08:45:06.540296+0000","last_clean":"2023-10-07T08:45:06.540296+0000","last_became_active":"2023-10-07T08:45:06.539878+0000","last_became_peered":"2023-10-07T08:45:06.539878+0000","last_unstale":"2023-10-07T08:45:06.540296+0000","last_undegraded":"2023-10-07T08:45:06.540296+0000","last_fullsized":"2023-10-07T08:45:06.540296+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:55:29.085019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.549485+0000","last_change":"2023-10-07T08:45:06.549426+0000","last_active":"2023-10-07T08:45:06.549485+0000","last_peered":"2023-10-07T08:45:06.549485+0000","last_clean":"2023-10-07T08:45:06.549485+0000","last_became_active":"2023-10-07T08:45:06.548474+0000","last_became_peered":"2023-10-07T08:45:06.548474+0000","last_unstale":"2023-10-07T08:45:06.549485+0000","last_undegraded":"2023-10-07T08:45:06.549485+0000","last_fullsized":"2023-10-07T08:45:06.549485+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:07:00.277270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.545767+0000","last_change":"2023-10-07T08:45:06.545501+0000","last_active":"2023-10-07T08:45:06.545767+0000","last_peered":"2023-10-07T08:45:06.545767+0000","last_clean":"2023-10-07T08:45:06.545767+0000","last_became_active":"2023-10-07T08:45:06.545141+0000","last_became_peered":"2023-10-07T08:45:06.545141+0000","last_unstale":"2023-10-07T08:45:06.545767+0000","last_undegraded":"2023-10-07T08:45:06.545767+0000","last_fullsized":"2023-10-07T08:45:06.545767+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:25:26.346162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.547402+0000","last_change":"2023-10-07T08:45:06.547330+0000","last_active":"2023-10-07T08:45:06.547402+0000","last_peered":"2023-10-07T08:45:06.547402+0000","last_clean":"2023-10-07T08:45:06.547402+0000","last_became_active":"2023-10-07T08:45:06.547135+0000","last_became_peered":"2023-10-07T08:45:06.547135+0000","last_unstale":"2023-10-07T08:45:06.547402+0000","last_undegraded":"2023-10-07T08:45:06.547402+0000","last_fullsized":"2023-10-07T08:45:06.547402+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:45:14.826240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.541213+0000","last_change":"2023-10-07T08:45:06.540666+0000","last_active":"2023-10-07T08:45:06.541213+0000","last_peered":"2023-10-07T08:45:06.541213+0000","last_clean":"2023-10-07T08:45:06.541213+0000","last_became_active":"2023-10-07T08:45:06.540444+0000","last_became_peered":"2023-10-07T08:45:06.540444+0000","last_unstale":"2023-10-07T08:45:06.541213+0000","last_undegraded":"2023-10-07T08:45:06.541213+0000","last_fullsized":"2023-10-07T08:45:06.541213+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:04:20.451928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.537636+0000","last_change":"2023-10-07T08:45:06.537142+0000","last_active":"2023-10-07T08:45:06.537636+0000","last_peered":"2023-10-07T08:45:06.537636+0000","last_clean":"2023-10-07T08:45:06.537636+0000","last_became_active":"2023-10-07T08:45:06.536852+0000","last_became_peered":"2023-10-07T08:45:06.536852+0000","last_unstale":"2023-10-07T08:45:06.537636+0000","last_undegraded":"2023-10-07T08:45:06.537636+0000","last_fullsized":"2023-10-07T08:45:06.537636+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:36:04.007944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.540804+0000","last_change":"2023-10-07T08:45:06.540404+0000","last_active":"2023-10-07T08:45:06.540804+0000","last_peered":"2023-10-07T08:45:06.540804+0000","last_clean":"2023-10-07T08:45:06.540804+0000","last_became_active":"2023-10-07T08:45:06.540166+0000","last_became_peered":"2023-10-07T08:45:06.540166+0000","last_unstale":"2023-10-07T08:45:06.540804+0000","last_undegraded":"2023-10-07T08:45:06.540804+0000","last_fullsized":"2023-10-07T08:45:06.540804+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:33.157237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.548894+0000","last_change":"2023-10-07T08:45:06.548807+0000","last_active":"2023-10-07T08:45:06.548894+0000","last_peered":"2023-10-07T08:45:06.548894+0000","last_clean":"2023-10-07T08:45:06.548894+0000","last_became_active":"2023-10-07T08:45:06.546745+0000","last_became_peered":"2023-10-07T08:45:06.546745+0000","last_unstale":"2023-10-07T08:45:06.548894+0000","last_undegraded":"2023-10-07T08:45:06.548894+0000","last_fullsized":"2023-10-07T08:45:06.548894+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:48:01.457226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.537118+0000","last_change":"2023-10-07T08:45:06.537044+0000","last_active":"2023-10-07T08:45:06.537118+0000","last_peered":"2023-10-07T08:45:06.537118+0000","last_clean":"2023-10-07T08:45:06.537118+0000","last_became_active":"2023-10-07T08:45:06.536848+0000","last_became_peered":"2023-10-07T08:45:06.536848+0000","last_unstale":"2023-10-07T08:45:06.537118+0000","last_undegraded":"2023-10-07T08:45:06.537118+0000","last_fullsized":"2023-10-07T08:45:06.537118+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:07.971315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546570+0000","last_change":"2023-10-07T08:45:06.545918+0000","last_active":"2023-10-07T08:45:06.546570+0000","last_peered":"2023-10-07T08:45:06.546570+0000","last_clean":"2023-10-07T08:45:06.546570+0000","last_became_active":"2023-10-07T08:45:06.545601+0000","last_became_peered":"2023-10-07T08:45:06.545601+0000","last_unstale":"2023-10-07T08:45:06.546570+0000","last_undegraded":"2023-10-07T08:45:06.546570+0000","last_fullsized":"2023-10-07T08:45:06.546570+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:16.343328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.547863+0000","last_change":"2023-10-07T08:45:06.547801+0000","last_active":"2023-10-07T08:45:06.547863+0000","last_peered":"2023-10-07T08:45:06.547863+0000","last_clean":"2023-10-07T08:45:06.547863+0000","last_became_active":"2023-10-07T08:45:06.547047+0000","last_became_peered":"2023-10-07T08:45:06.547047+0000","last_unstale":"2023-10-07T08:45:06.547863+0000","last_undegraded":"2023-10-07T08:45:06.547863+0000","last_fullsized":"2023-10-07T08:45:06.547863+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:14:01.407779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546290+0000","last_change":"2023-10-07T08:45:06.546209+0000","last_active":"2023-10-07T08:45:06.546290+0000","last_peered":"2023-10-07T08:45:06.546290+0000","last_clean":"2023-10-07T08:45:06.546290+0000","last_became_active":"2023-10-07T08:45:06.545787+0000","last_became_peered":"2023-10-07T08:45:06.545787+0000","last_unstale":"2023-10-07T08:45:06.546290+0000","last_undegraded":"2023-10-07T08:45:06.546290+0000","last_fullsized":"2023-10-07T08:45:06.546290+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:29:53.900055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.549608+0000","last_change":"2023-10-07T08:45:06.548033+0000","last_active":"2023-10-07T08:45:06.549608+0000","last_peered":"2023-10-07T08:45:06.549608+0000","last_clean":"2023-10-07T08:45:06.549608+0000","last_became_active":"2023-10-07T08:45:06.547775+0000","last_became_peered":"2023-10-07T08:45:06.547775+0000","last_unstale":"2023-10-07T08:45:06.549608+0000","last_undegraded":"2023-10-07T08:45:06.549608+0000","last_fullsized":"2023-10-07T08:45:06.549608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:50:55.797691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.536716+0000","last_change":"2023-10-07T08:45:06.536636+0000","last_active":"2023-10-07T08:45:06.536716+0000","last_peered":"2023-10-07T08:45:06.536716+0000","last_clean":"2023-10-07T08:45:06.536716+0000","last_became_active":"2023-10-07T08:45:06.536399+0000","last_became_peered":"2023-10-07T08:45:06.536399+0000","last_unstale":"2023-10-07T08:45:06.536716+0000","last_undegraded":"2023-10-07T08:45:06.536716+0000","last_fullsized":"2023-10-07T08:45:06.536716+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:58:32.040465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.541216+0000","last_change":"2023-10-07T08:45:06.541161+0000","last_active":"2023-10-07T08:45:06.541216+0000","last_peered":"2023-10-07T08:45:06.541216+0000","last_clean":"2023-10-07T08:45:06.541216+0000","last_became_active":"2023-10-07T08:45:06.540922+0000","last_became_peered":"2023-10-07T08:45:06.540922+0000","last_unstale":"2023-10-07T08:45:06.541216+0000","last_undegraded":"2023-10-07T08:45:06.541216+0000","last_fullsized":"2023-10-07T08:45:06.541216+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:12:47.571165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.544088+0000","last_change":"2023-10-07T08:45:06.543089+0000","last_active":"2023-10-07T08:45:06.544088+0000","last_peered":"2023-10-07T08:45:06.544088+0000","last_clean":"2023-10-07T08:45:06.544088+0000","last_became_active":"2023-10-07T08:45:06.542883+0000","last_became_peered":"2023-10-07T08:45:06.542883+0000","last_unstale":"2023-10-07T08:45:06.544088+0000","last_undegraded":"2023-10-07T08:45:06.544088+0000","last_fullsized":"2023-10-07T08:45:06.544088+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:16:18.934820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.548909+0000","last_change":"2023-10-07T08:45:06.548830+0000","last_active":"2023-10-07T08:45:06.548909+0000","last_peered":"2023-10-07T08:45:06.548909+0000","last_clean":"2023-10-07T08:45:06.548909+0000","last_became_active":"2023-10-07T08:45:06.545915+0000","last_became_peered":"2023-10-07T08:45:06.545915+0000","last_unstale":"2023-10-07T08:45:06.548909+0000","last_undegraded":"2023-10-07T08:45:06.548909+0000","last_fullsized":"2023-10-07T08:45:06.548909+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:40:30.727851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.547257+0000","last_change":"2023-10-07T08:45:06.547191+0000","last_active":"2023-10-07T08:45:06.547257+0000","last_peered":"2023-10-07T08:45:06.547257+0000","last_clean":"2023-10-07T08:45:06.547257+0000","last_became_active":"2023-10-07T08:45:06.546961+0000","last_became_peered":"2023-10-07T08:45:06.546961+0000","last_unstale":"2023-10-07T08:45:06.547257+0000","last_undegraded":"2023-10-07T08:45:06.547257+0000","last_fullsized":"2023-10-07T08:45:06.547257+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:38:48.891670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.544955+0000","last_change":"2023-10-07T08:45:06.541872+0000","last_active":"2023-10-07T08:45:06.544955+0000","last_peered":"2023-10-07T08:45:06.544955+0000","last_clean":"2023-10-07T08:45:06.544955+0000","last_became_active":"2023-10-07T08:45:06.541258+0000","last_became_peered":"2023-10-07T08:45:06.541258+0000","last_unstale":"2023-10-07T08:45:06.544955+0000","last_undegraded":"2023-10-07T08:45:06.544955+0000","last_fullsized":"2023-10-07T08:45:06.544955+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:56:23.126924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.541271+0000","last_change":"2023-10-07T08:45:06.540494+0000","last_active":"2023-10-07T08:45:06.541271+0000","last_peered":"2023-10-07T08:45:06.541271+0000","last_clean":"2023-10-07T08:45:06.541271+0000","last_became_active":"2023-10-07T08:45:06.540267+0000","last_became_peered":"2023-10-07T08:45:06.540267+0000","last_unstale":"2023-10-07T08:45:06.541271+0000","last_undegraded":"2023-10-07T08:45:06.541271+0000","last_fullsized":"2023-10-07T08:45:06.541271+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:46:44.246462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.544599+0000","last_change":"2023-10-07T08:45:06.544505+0000","last_active":"2023-10-07T08:45:06.544599+0000","last_peered":"2023-10-07T08:45:06.544599+0000","last_clean":"2023-10-07T08:45:06.544599+0000","last_became_active":"2023-10-07T08:45:06.544258+0000","last_became_peered":"2023-10-07T08:45:06.544258+0000","last_unstale":"2023-10-07T08:45:06.544599+0000","last_undegraded":"2023-10-07T08:45:06.544599+0000","last_fullsized":"2023-10-07T08:45:06.544599+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:47:25.249493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.548877+0000","last_change":"2023-10-07T08:45:06.548696+0000","last_active":"2023-10-07T08:45:06.548877+0000","last_peered":"2023-10-07T08:45:06.548877+0000","last_clean":"2023-10-07T08:45:06.548877+0000","last_became_active":"2023-10-07T08:45:06.545623+0000","last_became_peered":"2023-10-07T08:45:06.545623+0000","last_unstale":"2023-10-07T08:45:06.548877+0000","last_undegraded":"2023-10-07T08:45:06.548877+0000","last_fullsized":"2023-10-07T08:45:06.548877+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:32:10.162991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.550054+0000","last_change":"2023-10-07T08:45:06.549992+0000","last_active":"2023-10-07T08:45:06.550054+0000","last_peered":"2023-10-07T08:45:06.550054+0000","last_clean":"2023-10-07T08:45:06.550054+0000","last_became_active":"2023-10-07T08:45:06.549788+0000","last_became_peered":"2023-10-07T08:45:06.549788+0000","last_unstale":"2023-10-07T08:45:06.550054+0000","last_undegraded":"2023-10-07T08:45:06.550054+0000","last_fullsized":"2023-10-07T08:45:06.550054+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:29:37.333475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.547296+0000","last_change":"2023-10-07T08:45:06.547188+0000","last_active":"2023-10-07T08:45:06.547296+0000","last_peered":"2023-10-07T08:45:06.547296+0000","last_clean":"2023-10-07T08:45:06.547296+0000","last_became_active":"2023-10-07T08:45:06.546956+0000","last_became_peered":"2023-10-07T08:45:06.546956+0000","last_unstale":"2023-10-07T08:45:06.547296+0000","last_undegraded":"2023-10-07T08:45:06.547296+0000","last_fullsized":"2023-10-07T08:45:06.547296+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:47:54.170016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546329+0000","last_change":"2023-10-07T08:45:06.546254+0000","last_active":"2023-10-07T08:45:06.546329+0000","last_peered":"2023-10-07T08:45:06.546329+0000","last_clean":"2023-10-07T08:45:06.546329+0000","last_became_active":"2023-10-07T08:45:06.546020+0000","last_became_peered":"2023-10-07T08:45:06.546020+0000","last_unstale":"2023-10-07T08:45:06.546329+0000","last_undegraded":"2023-10-07T08:45:06.546329+0000","last_fullsized":"2023-10-07T08:45:06.546329+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:10:47.979612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.542168+0000","last_change":"2023-10-07T08:45:06.542100+0000","last_active":"2023-10-07T08:45:06.542168+0000","last_peered":"2023-10-07T08:45:06.542168+0000","last_clean":"2023-10-07T08:45:06.542168+0000","last_became_active":"2023-10-07T08:45:06.541881+0000","last_became_peered":"2023-10-07T08:45:06.541881+0000","last_unstale":"2023-10-07T08:45:06.542168+0000","last_undegraded":"2023-10-07T08:45:06.542168+0000","last_fullsized":"2023-10-07T08:45:06.542168+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:47:22.329704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.544136+0000","last_change":"2023-10-07T08:45:06.543837+0000","last_active":"2023-10-07T08:45:06.544136+0000","last_peered":"2023-10-07T08:45:06.544136+0000","last_clean":"2023-10-07T08:45:06.544136+0000","last_became_active":"2023-10-07T08:45:06.543607+0000","last_became_peered":"2023-10-07T08:45:06.543607+0000","last_unstale":"2023-10-07T08:45:06.544136+0000","last_undegraded":"2023-10-07T08:45:06.544136+0000","last_fullsized":"2023-10-07T08:45:06.544136+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:50:22.114056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.541241+0000","last_change":"2023-10-07T08:45:06.541151+0000","last_active":"2023-10-07T08:45:06.541241+0000","last_peered":"2023-10-07T08:45:06.541241+0000","last_clean":"2023-10-07T08:45:06.541241+0000","last_became_active":"2023-10-07T08:45:06.540941+0000","last_became_peered":"2023-10-07T08:45:06.540941+0000","last_unstale":"2023-10-07T08:45:06.541241+0000","last_undegraded":"2023-10-07T08:45:06.541241+0000","last_fullsized":"2023-10-07T08:45:06.541241+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:25:29.873983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.545253+0000","last_change":"2023-10-07T08:45:06.543132+0000","last_active":"2023-10-07T08:45:06.545253+0000","last_peered":"2023-10-07T08:45:06.545253+0000","last_clean":"2023-10-07T08:45:06.545253+0000","last_became_active":"2023-10-07T08:45:06.542798+0000","last_became_peered":"2023-10-07T08:45:06.542798+0000","last_unstale":"2023-10-07T08:45:06.545253+0000","last_undegraded":"2023-10-07T08:45:06.545253+0000","last_fullsized":"2023-10-07T08:45:06.545253+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:16:40.079455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546114+0000","last_change":"2023-10-07T08:45:06.546043+0000","last_active":"2023-10-07T08:45:06.546114+0000","last_peered":"2023-10-07T08:45:06.546114+0000","last_clean":"2023-10-07T08:45:06.546114+0000","last_became_active":"2023-10-07T08:45:06.545248+0000","last_became_peered":"2023-10-07T08:45:06.545248+0000","last_unstale":"2023-10-07T08:45:06.546114+0000","last_undegraded":"2023-10-07T08:45:06.546114+0000","last_fullsized":"2023-10-07T08:45:06.546114+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:08.369937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546709+0000","last_change":"2023-10-07T08:45:06.546645+0000","last_active":"2023-10-07T08:45:06.546709+0000","last_peered":"2023-10-07T08:45:06.546709+0000","last_clean":"2023-10-07T08:45:06.546709+0000","last_became_active":"2023-10-07T08:45:06.546412+0000","last_became_peered":"2023-10-07T08:45:06.546412+0000","last_unstale":"2023-10-07T08:45:06.546709+0000","last_undegraded":"2023-10-07T08:45:06.546709+0000","last_fullsized":"2023-10-07T08:45:06.546709+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:46.480903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.542224+0000","last_change":"2023-10-07T08:45:06.542156+0000","last_active":"2023-10-07T08:45:06.542224+0000","last_peered":"2023-10-07T08:45:06.542224+0000","last_clean":"2023-10-07T08:45:06.542224+0000","last_became_active":"2023-10-07T08:45:06.541899+0000","last_became_peered":"2023-10-07T08:45:06.541899+0000","last_unstale":"2023-10-07T08:45:06.542224+0000","last_undegraded":"2023-10-07T08:45:06.542224+0000","last_fullsized":"2023-10-07T08:45:06.542224+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:47:25.249493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.544153+0000","last_change":"2023-10-07T08:45:06.544083+0000","last_active":"2023-10-07T08:45:06.544153+0000","last_peered":"2023-10-07T08:45:06.544153+0000","last_clean":"2023-10-07T08:45:06.544153+0000","last_became_active":"2023-10-07T08:45:06.543860+0000","last_became_peered":"2023-10-07T08:45:06.543860+0000","last_unstale":"2023-10-07T08:45:06.544153+0000","last_undegraded":"2023-10-07T08:45:06.544153+0000","last_fullsized":"2023-10-07T08:45:06.544153+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:25:26.346162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"66'4","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.553723+0000","last_change":"2023-10-07T08:45:05.530642+0000","last_active":"2023-10-07T08:45:06.553723+0000","last_peered":"2023-10-07T08:45:06.553723+0000","last_clean":"2023-10-07T08:45:06.553723+0000","last_became_active":"2023-10-07T08:45:05.530425+0000","last_became_peered":"2023-10-07T08:45:05.530425+0000","last_unstale":"2023-10-07T08:45:06.553723+0000","last_undegraded":"2023-10-07T08:45:06.553723+0000","last_fullsized":"2023-10-07T08:45:06.553723+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:12:46.564106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546539+0000","last_change":"2023-10-07T08:45:06.544664+0000","last_active":"2023-10-07T08:45:06.546539+0000","last_peered":"2023-10-07T08:45:06.546539+0000","last_clean":"2023-10-07T08:45:06.546539+0000","last_became_active":"2023-10-07T08:45:06.544443+0000","last_became_peered":"2023-10-07T08:45:06.544443+0000","last_unstale":"2023-10-07T08:45:06.546539+0000","last_undegraded":"2023-10-07T08:45:06.546539+0000","last_fullsized":"2023-10-07T08:45:06.546539+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:47:31.581339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.554536+0000","last_change":"2023-10-07T08:45:05.524825+0000","last_active":"2023-10-07T08:45:06.554536+0000","last_peered":"2023-10-07T08:45:06.554536+0000","last_clean":"2023-10-07T08:45:06.554536+0000","last_became_active":"2023-10-07T08:45:05.524496+0000","last_became_peered":"2023-10-07T08:45:05.524496+0000","last_unstale":"2023-10-07T08:45:06.554536+0000","last_undegraded":"2023-10-07T08:45:06.554536+0000","last_fullsized":"2023-10-07T08:45:06.554536+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:46:53.601825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.545664+0000","last_change":"2023-10-07T08:45:06.545497+0000","last_active":"2023-10-07T08:45:06.545664+0000","last_peered":"2023-10-07T08:45:06.545664+0000","last_clean":"2023-10-07T08:45:06.545664+0000","last_became_active":"2023-10-07T08:45:06.545260+0000","last_became_peered":"2023-10-07T08:45:06.545260+0000","last_unstale":"2023-10-07T08:45:06.545664+0000","last_undegraded":"2023-10-07T08:45:06.545664+0000","last_fullsized":"2023-10-07T08:45:06.545664+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:38:48.891670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.553469+0000","last_change":"2023-10-07T08:45:05.528198+0000","last_active":"2023-10-07T08:45:06.553469+0000","last_peered":"2023-10-07T08:45:06.553469+0000","last_clean":"2023-10-07T08:45:06.553469+0000","last_became_active":"2023-10-07T08:45:05.527981+0000","last_became_peered":"2023-10-07T08:45:05.527981+0000","last_unstale":"2023-10-07T08:45:06.553469+0000","last_undegraded":"2023-10-07T08:45:06.553469+0000","last_fullsized":"2023-10-07T08:45:06.553469+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:58:31.033406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.541022+0000","last_change":"2023-10-07T08:45:06.540893+0000","last_active":"2023-10-07T08:45:06.541022+0000","last_peered":"2023-10-07T08:45:06.541022+0000","last_clean":"2023-10-07T08:45:06.541022+0000","last_became_active":"2023-10-07T08:45:06.540671+0000","last_became_peered":"2023-10-07T08:45:06.540671+0000","last_unstale":"2023-10-07T08:45:06.541022+0000","last_undegraded":"2023-10-07T08:45:06.541022+0000","last_fullsized":"2023-10-07T08:45:06.541022+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:46:54.608884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.555078+0000","last_change":"2023-10-07T08:45:05.531333+0000","last_active":"2023-10-07T08:45:06.555078+0000","last_peered":"2023-10-07T08:45:06.555078+0000","last_clean":"2023-10-07T08:45:06.555078+0000","last_became_active":"2023-10-07T08:45:05.530971+0000","last_became_peered":"2023-10-07T08:45:05.530971+0000","last_unstale":"2023-10-07T08:45:06.555078+0000","last_undegraded":"2023-10-07T08:45:06.555078+0000","last_fullsized":"2023-10-07T08:45:06.555078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:34.425784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.541295+0000","last_change":"2023-10-07T08:45:06.541181+0000","last_active":"2023-10-07T08:45:06.541295+0000","last_peered":"2023-10-07T08:45:06.541295+0000","last_clean":"2023-10-07T08:45:06.541295+0000","last_became_active":"2023-10-07T08:45:06.540943+0000","last_became_peered":"2023-10-07T08:45:06.540943+0000","last_unstale":"2023-10-07T08:45:06.541295+0000","last_undegraded":"2023-10-07T08:45:06.541295+0000","last_fullsized":"2023-10-07T08:45:06.541295+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:06:16.352096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.551162+0000","last_change":"2023-10-07T08:45:05.522516+0000","last_active":"2023-10-07T08:45:06.551162+0000","last_peered":"2023-10-07T08:45:06.551162+0000","last_clean":"2023-10-07T08:45:06.551162+0000","last_became_active":"2023-10-07T08:45:05.522266+0000","last_became_peered":"2023-10-07T08:45:05.522266+0000","last_unstale":"2023-10-07T08:45:06.551162+0000","last_undegraded":"2023-10-07T08:45:06.551162+0000","last_fullsized":"2023-10-07T08:45:06.551162+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:24.542387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.549225+0000","last_change":"2023-10-07T08:45:06.549094+0000","last_active":"2023-10-07T08:45:06.549225+0000","last_peered":"2023-10-07T08:45:06.549225+0000","last_clean":"2023-10-07T08:45:06.549225+0000","last_became_active":"2023-10-07T08:45:06.546573+0000","last_became_peered":"2023-10-07T08:45:06.546573+0000","last_unstale":"2023-10-07T08:45:06.549225+0000","last_undegraded":"2023-10-07T08:45:06.549225+0000","last_fullsized":"2023-10-07T08:45:06.549225+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:31:25.449505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.554041+0000","last_change":"2023-10-07T08:45:05.531463+0000","last_active":"2023-10-07T08:45:06.554041+0000","last_peered":"2023-10-07T08:45:06.554041+0000","last_clean":"2023-10-07T08:45:06.554041+0000","last_became_active":"2023-10-07T08:45:05.531064+0000","last_became_peered":"2023-10-07T08:45:05.531064+0000","last_unstale":"2023-10-07T08:45:06.554041+0000","last_undegraded":"2023-10-07T08:45:06.554041+0000","last_fullsized":"2023-10-07T08:45:06.554041+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:50.409233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.547555+0000","last_change":"2023-10-07T08:45:06.547506+0000","last_active":"2023-10-07T08:45:06.547555+0000","last_peered":"2023-10-07T08:45:06.547555+0000","last_clean":"2023-10-07T08:45:06.547555+0000","last_became_active":"2023-10-07T08:45:06.547214+0000","last_became_peered":"2023-10-07T08:45:06.547214+0000","last_unstale":"2023-10-07T08:45:06.547555+0000","last_undegraded":"2023-10-07T08:45:06.547555+0000","last_fullsized":"2023-10-07T08:45:06.547555+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:13:00.158680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539451+0000","last_change":"2023-10-07T08:45:05.530586+0000","last_active":"2023-10-07T08:45:06.539451+0000","last_peered":"2023-10-07T08:45:06.539451+0000","last_clean":"2023-10-07T08:45:06.539451+0000","last_became_active":"2023-10-07T08:45:05.530104+0000","last_became_peered":"2023-10-07T08:45:05.530104+0000","last_unstale":"2023-10-07T08:45:06.539451+0000","last_undegraded":"2023-10-07T08:45:06.539451+0000","last_fullsized":"2023-10-07T08:45:06.539451+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:35:59.230954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.545236+0000","last_change":"2023-10-07T08:45:06.543008+0000","last_active":"2023-10-07T08:45:06.545236+0000","last_peered":"2023-10-07T08:45:06.545236+0000","last_clean":"2023-10-07T08:45:06.545236+0000","last_became_active":"2023-10-07T08:45:06.542450+0000","last_became_peered":"2023-10-07T08:45:06.542450+0000","last_unstale":"2023-10-07T08:45:06.545236+0000","last_undegraded":"2023-10-07T08:45:06.545236+0000","last_fullsized":"2023-10-07T08:45:06.545236+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:52:49.828010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.535645+0000","last_change":"2023-10-07T08:45:05.524721+0000","last_active":"2023-10-07T08:45:06.535645+0000","last_peered":"2023-10-07T08:45:06.535645+0000","last_clean":"2023-10-07T08:45:06.535645+0000","last_became_active":"2023-10-07T08:45:05.524415+0000","last_became_peered":"2023-10-07T08:45:05.524415+0000","last_unstale":"2023-10-07T08:45:06.535645+0000","last_undegraded":"2023-10-07T08:45:06.535645+0000","last_fullsized":"2023-10-07T08:45:06.535645+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:33:37.722828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.543195+0000","last_change":"2023-10-07T08:45:06.542785+0000","last_active":"2023-10-07T08:45:06.543195+0000","last_peered":"2023-10-07T08:45:06.543195+0000","last_clean":"2023-10-07T08:45:06.543195+0000","last_became_active":"2023-10-07T08:45:06.542518+0000","last_became_peered":"2023-10-07T08:45:06.542518+0000","last_unstale":"2023-10-07T08:45:06.543195+0000","last_undegraded":"2023-10-07T08:45:06.543195+0000","last_fullsized":"2023-10-07T08:45:06.543195+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:53:36.971647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.541340+0000","last_change":"2023-10-07T08:45:05.530365+0000","last_active":"2023-10-07T08:45:06.541340+0000","last_peered":"2023-10-07T08:45:06.541340+0000","last_clean":"2023-10-07T08:45:06.541340+0000","last_became_active":"2023-10-07T08:45:05.529673+0000","last_became_peered":"2023-10-07T08:45:05.529673+0000","last_unstale":"2023-10-07T08:45:06.541340+0000","last_undegraded":"2023-10-07T08:45:06.541340+0000","last_fullsized":"2023-10-07T08:45:06.541340+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:47:30.574279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.549670+0000","last_change":"2023-10-07T08:45:06.549569+0000","last_active":"2023-10-07T08:45:06.549670+0000","last_peered":"2023-10-07T08:45:06.549670+0000","last_clean":"2023-10-07T08:45:06.549670+0000","last_became_active":"2023-10-07T08:45:06.548769+0000","last_became_peered":"2023-10-07T08:45:06.548769+0000","last_unstale":"2023-10-07T08:45:06.549670+0000","last_undegraded":"2023-10-07T08:45:06.549670+0000","last_fullsized":"2023-10-07T08:45:06.549670+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:46:54.608884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539523+0000","last_change":"2023-10-07T08:45:05.526849+0000","last_active":"2023-10-07T08:45:06.539523+0000","last_peered":"2023-10-07T08:45:06.539523+0000","last_clean":"2023-10-07T08:45:06.539523+0000","last_became_active":"2023-10-07T08:45:05.524275+0000","last_became_peered":"2023-10-07T08:45:05.524275+0000","last_unstale":"2023-10-07T08:45:06.539523+0000","last_undegraded":"2023-10-07T08:45:06.539523+0000","last_fullsized":"2023-10-07T08:45:06.539523+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:35:24.707115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546525+0000","last_change":"2023-10-07T08:45:06.543832+0000","last_active":"2023-10-07T08:45:06.546525+0000","last_peered":"2023-10-07T08:45:06.546525+0000","last_clean":"2023-10-07T08:45:06.546525+0000","last_became_active":"2023-10-07T08:45:06.543395+0000","last_became_peered":"2023-10-07T08:45:06.543395+0000","last_unstale":"2023-10-07T08:45:06.546525+0000","last_undegraded":"2023-10-07T08:45:06.546525+0000","last_fullsized":"2023-10-07T08:45:06.546525+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:08:01.444334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"66'3","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.556049+0000","last_change":"2023-10-07T08:45:05.526977+0000","last_active":"2023-10-07T08:45:06.556049+0000","last_peered":"2023-10-07T08:45:06.556049+0000","last_clean":"2023-10-07T08:45:06.556049+0000","last_became_active":"2023-10-07T08:45:05.526750+0000","last_became_peered":"2023-10-07T08:45:05.526750+0000","last_unstale":"2023-10-07T08:45:06.556049+0000","last_undegraded":"2023-10-07T08:45:06.556049+0000","last_fullsized":"2023-10-07T08:45:06.556049+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:08:00.437274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.544616+0000","last_change":"2023-10-07T08:45:06.544529+0000","last_active":"2023-10-07T08:45:06.544616+0000","last_peered":"2023-10-07T08:45:06.544616+0000","last_clean":"2023-10-07T08:45:06.544616+0000","last_became_active":"2023-10-07T08:45:06.544327+0000","last_became_peered":"2023-10-07T08:45:06.544327+0000","last_unstale":"2023-10-07T08:45:06.544616+0000","last_undegraded":"2023-10-07T08:45:06.544616+0000","last_fullsized":"2023-10-07T08:45:06.544616+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:50:22.114056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"66'6","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.555982+0000","last_change":"2023-10-07T08:45:05.528172+0000","last_active":"2023-10-07T08:45:06.555982+0000","last_peered":"2023-10-07T08:45:06.555982+0000","last_clean":"2023-10-07T08:45:06.555982+0000","last_became_active":"2023-10-07T08:45:05.527935+0000","last_became_peered":"2023-10-07T08:45:05.527935+0000","last_unstale":"2023-10-07T08:45:06.555982+0000","last_undegraded":"2023-10-07T08:45:06.555982+0000","last_fullsized":"2023-10-07T08:45:06.555982+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:10:50.765181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.548468+0000","last_change":"2023-10-07T08:45:06.548405+0000","last_active":"2023-10-07T08:45:06.548468+0000","last_peered":"2023-10-07T08:45:06.548468+0000","last_clean":"2023-10-07T08:45:06.548468+0000","last_became_active":"2023-10-07T08:45:06.548142+0000","last_became_peered":"2023-10-07T08:45:06.548142+0000","last_unstale":"2023-10-07T08:45:06.548468+0000","last_undegraded":"2023-10-07T08:45:06.548468+0000","last_fullsized":"2023-10-07T08:45:06.548468+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:47:25.249493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.553050+0000","last_change":"2023-10-07T08:45:05.530495+0000","last_active":"2023-10-07T08:45:06.553050+0000","last_peered":"2023-10-07T08:45:06.553050+0000","last_clean":"2023-10-07T08:45:06.553050+0000","last_became_active":"2023-10-07T08:45:05.530270+0000","last_became_peered":"2023-10-07T08:45:05.530270+0000","last_unstale":"2023-10-07T08:45:06.553050+0000","last_undegraded":"2023-10-07T08:45:06.553050+0000","last_fullsized":"2023-10-07T08:45:06.553050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:29:36.326415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546446+0000","last_change":"2023-10-07T08:45:06.546385+0000","last_active":"2023-10-07T08:45:06.546446+0000","last_peered":"2023-10-07T08:45:06.546446+0000","last_clean":"2023-10-07T08:45:06.546446+0000","last_became_active":"2023-10-07T08:45:06.545823+0000","last_became_peered":"2023-10-07T08:45:06.545823+0000","last_unstale":"2023-10-07T08:45:06.546446+0000","last_undegraded":"2023-10-07T08:45:06.546446+0000","last_fullsized":"2023-10-07T08:45:06.546446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:36:04.007944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.538626+0000","last_change":"2023-10-07T08:45:05.531166+0000","last_active":"2023-10-07T08:45:06.538626+0000","last_peered":"2023-10-07T08:45:06.538626+0000","last_clean":"2023-10-07T08:45:06.538626+0000","last_became_active":"2023-10-07T08:45:05.530940+0000","last_became_peered":"2023-10-07T08:45:05.530940+0000","last_unstale":"2023-10-07T08:45:06.538626+0000","last_undegraded":"2023-10-07T08:45:06.538626+0000","last_fullsized":"2023-10-07T08:45:06.538626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:21:38.171224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.544327+0000","last_change":"2023-10-07T08:45:06.544174+0000","last_active":"2023-10-07T08:45:06.544327+0000","last_peered":"2023-10-07T08:45:06.544327+0000","last_clean":"2023-10-07T08:45:06.544327+0000","last_became_active":"2023-10-07T08:45:06.543823+0000","last_became_peered":"2023-10-07T08:45:06.543823+0000","last_unstale":"2023-10-07T08:45:06.544327+0000","last_undegraded":"2023-10-07T08:45:06.544327+0000","last_fullsized":"2023-10-07T08:45:06.544327+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:51.416293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539686+0000","last_change":"2023-10-07T08:45:05.529399+0000","last_active":"2023-10-07T08:45:06.539686+0000","last_peered":"2023-10-07T08:45:06.539686+0000","last_clean":"2023-10-07T08:45:06.539686+0000","last_became_active":"2023-10-07T08:45:05.529122+0000","last_became_peered":"2023-10-07T08:45:05.529122+0000","last_unstale":"2023-10-07T08:45:06.539686+0000","last_undegraded":"2023-10-07T08:45:06.539686+0000","last_fullsized":"2023-10-07T08:45:06.539686+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:58:24.071157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.548993+0000","last_change":"2023-10-07T08:45:06.548906+0000","last_active":"2023-10-07T08:45:06.548993+0000","last_peered":"2023-10-07T08:45:06.548993+0000","last_clean":"2023-10-07T08:45:06.548993+0000","last_became_active":"2023-10-07T08:45:06.548702+0000","last_became_peered":"2023-10-07T08:45:06.548702+0000","last_unstale":"2023-10-07T08:45:06.548993+0000","last_undegraded":"2023-10-07T08:45:06.548993+0000","last_fullsized":"2023-10-07T08:45:06.548993+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:47:22.329704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"66'8","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.555695+0000","last_change":"2023-10-07T08:45:05.532289+0000","last_active":"2023-10-07T08:45:06.555695+0000","last_peered":"2023-10-07T08:45:06.555695+0000","last_clean":"2023-10-07T08:45:06.555695+0000","last_became_active":"2023-10-07T08:45:05.532052+0000","last_became_peered":"2023-10-07T08:45:05.532052+0000","last_unstale":"2023-10-07T08:45:06.555695+0000","last_undegraded":"2023-10-07T08:45:06.555695+0000","last_fullsized":"2023-10-07T08:45:06.555695+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:14:00.400720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546293+0000","last_change":"2023-10-07T08:45:06.546220+0000","last_active":"2023-10-07T08:45:06.546293+0000","last_peered":"2023-10-07T08:45:06.546293+0000","last_clean":"2023-10-07T08:45:06.546293+0000","last_became_active":"2023-10-07T08:45:06.545556+0000","last_became_peered":"2023-10-07T08:45:06.545556+0000","last_unstale":"2023-10-07T08:45:06.546293+0000","last_undegraded":"2023-10-07T08:45:06.546293+0000","last_fullsized":"2023-10-07T08:45:06.546293+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:21:05.216426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.552338+0000","last_change":"2023-10-07T08:45:05.524699+0000","last_active":"2023-10-07T08:45:06.552338+0000","last_peered":"2023-10-07T08:45:06.552338+0000","last_clean":"2023-10-07T08:45:06.552338+0000","last_became_active":"2023-10-07T08:45:05.524212+0000","last_became_peered":"2023-10-07T08:45:05.524212+0000","last_unstale":"2023-10-07T08:45:06.552338+0000","last_undegraded":"2023-10-07T08:45:06.552338+0000","last_fullsized":"2023-10-07T08:45:06.552338+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:11:41.940876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.543063+0000","last_change":"2023-10-07T08:45:06.543007+0000","last_active":"2023-10-07T08:45:06.543063+0000","last_peered":"2023-10-07T08:45:06.543063+0000","last_clean":"2023-10-07T08:45:06.543063+0000","last_became_active":"2023-10-07T08:45:06.542802+0000","last_became_peered":"2023-10-07T08:45:06.542802+0000","last_unstale":"2023-10-07T08:45:06.543063+0000","last_undegraded":"2023-10-07T08:45:06.543063+0000","last_fullsized":"2023-10-07T08:45:06.543063+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:36:04.007944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.552397+0000","last_change":"2023-10-07T08:45:05.527757+0000","last_active":"2023-10-07T08:45:06.552397+0000","last_peered":"2023-10-07T08:45:06.552397+0000","last_clean":"2023-10-07T08:45:06.552397+0000","last_became_active":"2023-10-07T08:45:05.527532+0000","last_became_peered":"2023-10-07T08:45:05.527532+0000","last_unstale":"2023-10-07T08:45:06.552397+0000","last_undegraded":"2023-10-07T08:45:06.552397+0000","last_fullsized":"2023-10-07T08:45:06.552397+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:08:00.437274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.549075+0000","last_change":"2023-10-07T08:45:06.548958+0000","last_active":"2023-10-07T08:45:06.549075+0000","last_peered":"2023-10-07T08:45:06.549075+0000","last_clean":"2023-10-07T08:45:06.549075+0000","last_became_active":"2023-10-07T08:45:06.546215+0000","last_became_peered":"2023-10-07T08:45:06.546215+0000","last_unstale":"2023-10-07T08:45:06.549075+0000","last_undegraded":"2023-10-07T08:45:06.549075+0000","last_fullsized":"2023-10-07T08:45:06.549075+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:43.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.555529+0000","last_change":"2023-10-07T08:45:05.531192+0000","last_active":"2023-10-07T08:45:06.555529+0000","last_peered":"2023-10-07T08:45:06.555529+0000","last_clean":"2023-10-07T08:45:06.555529+0000","last_became_active":"2023-10-07T08:45:05.530661+0000","last_became_peered":"2023-10-07T08:45:05.530661+0000","last_unstale":"2023-10-07T08:45:06.555529+0000","last_undegraded":"2023-10-07T08:45:06.555529+0000","last_fullsized":"2023-10-07T08:45:06.555529+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:17:21.973572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.549815+0000","last_change":"2023-10-07T08:45:06.549759+0000","last_active":"2023-10-07T08:45:06.549815+0000","last_peered":"2023-10-07T08:45:06.549815+0000","last_clean":"2023-10-07T08:45:06.549815+0000","last_became_active":"2023-10-07T08:45:06.549066+0000","last_became_peered":"2023-10-07T08:45:06.549066+0000","last_unstale":"2023-10-07T08:45:06.549815+0000","last_undegraded":"2023-10-07T08:45:06.549815+0000","last_fullsized":"2023-10-07T08:45:06.549815+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:11:42.947936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.534358+0000","last_change":"2023-10-07T08:45:05.531672+0000","last_active":"2023-10-07T08:45:06.534358+0000","last_peered":"2023-10-07T08:45:06.534358+0000","last_clean":"2023-10-07T08:45:06.534358+0000","last_became_active":"2023-10-07T08:45:05.531028+0000","last_became_peered":"2023-10-07T08:45:05.531028+0000","last_unstale":"2023-10-07T08:45:06.534358+0000","last_undegraded":"2023-10-07T08:45:06.534358+0000","last_fullsized":"2023-10-07T08:45:06.534358+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:53:35.964587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.548129+0000","last_change":"2023-10-07T08:45:06.548068+0000","last_active":"2023-10-07T08:45:06.548129+0000","last_peered":"2023-10-07T08:45:06.548129+0000","last_clean":"2023-10-07T08:45:06.548129+0000","last_became_active":"2023-10-07T08:45:06.547853+0000","last_became_peered":"2023-10-07T08:45:06.547853+0000","last_unstale":"2023-10-07T08:45:06.548129+0000","last_undegraded":"2023-10-07T08:45:06.548129+0000","last_fullsized":"2023-10-07T08:45:06.548129+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:08.369937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.553480+0000","last_change":"2023-10-07T08:45:05.525325+0000","last_active":"2023-10-07T08:45:06.553480+0000","last_peered":"2023-10-07T08:45:06.553480+0000","last_clean":"2023-10-07T08:45:06.553480+0000","last_became_active":"2023-10-07T08:45:05.525141+0000","last_became_peered":"2023-10-07T08:45:05.525141+0000","last_unstale":"2023-10-07T08:45:06.553480+0000","last_undegraded":"2023-10-07T08:45:06.553480+0000","last_fullsized":"2023-10-07T08:45:06.553480+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:34.425784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.545681+0000","last_change":"2023-10-07T08:45:06.545549+0000","last_active":"2023-10-07T08:45:06.545681+0000","last_peered":"2023-10-07T08:45:06.545681+0000","last_clean":"2023-10-07T08:45:06.545681+0000","last_became_active":"2023-10-07T08:45:06.544891+0000","last_became_peered":"2023-10-07T08:45:06.544891+0000","last_unstale":"2023-10-07T08:45:06.545681+0000","last_undegraded":"2023-10-07T08:45:06.545681+0000","last_fullsized":"2023-10-07T08:45:06.545681+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:47:22.329704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539416+0000","last_change":"2023-10-07T08:45:05.523780+0000","last_active":"2023-10-07T08:45:06.539416+0000","last_peered":"2023-10-07T08:45:06.539416+0000","last_clean":"2023-10-07T08:45:06.539416+0000","last_became_active":"2023-10-07T08:45:05.523566+0000","last_became_peered":"2023-10-07T08:45:05.523566+0000","last_unstale":"2023-10-07T08:45:06.539416+0000","last_undegraded":"2023-10-07T08:45:06.539416+0000","last_fullsized":"2023-10-07T08:45:06.539416+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:53:10.226534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.544108+0000","last_change":"2023-10-07T08:45:06.543595+0000","last_active":"2023-10-07T08:45:06.544108+0000","last_peered":"2023-10-07T08:45:06.544108+0000","last_clean":"2023-10-07T08:45:06.544108+0000","last_became_active":"2023-10-07T08:45:06.543361+0000","last_became_peered":"2023-10-07T08:45:06.543361+0000","last_unstale":"2023-10-07T08:45:06.544108+0000","last_undegraded":"2023-10-07T08:45:06.544108+0000","last_fullsized":"2023-10-07T08:45:06.544108+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:21:05.216426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539331+0000","last_change":"2023-10-07T08:45:05.528138+0000","last_active":"2023-10-07T08:45:06.539331+0000","last_peered":"2023-10-07T08:45:06.539331+0000","last_clean":"2023-10-07T08:45:06.539331+0000","last_became_active":"2023-10-07T08:45:05.527841+0000","last_became_peered":"2023-10-07T08:45:05.527841+0000","last_unstale":"2023-10-07T08:45:06.539331+0000","last_undegraded":"2023-10-07T08:45:06.539331+0000","last_fullsized":"2023-10-07T08:45:06.539331+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:43:47.298555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546773+0000","last_change":"2023-10-07T08:45:06.546705+0000","last_active":"2023-10-07T08:45:06.546773+0000","last_peered":"2023-10-07T08:45:06.546773+0000","last_clean":"2023-10-07T08:45:06.546773+0000","last_became_active":"2023-10-07T08:45:06.546420+0000","last_became_peered":"2023-10-07T08:45:06.546420+0000","last_unstale":"2023-10-07T08:45:06.546773+0000","last_undegraded":"2023-10-07T08:45:06.546773+0000","last_fullsized":"2023-10-07T08:45:06.546773+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:16:18.934820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.554314+0000","last_change":"2023-10-07T08:45:05.523809+0000","last_active":"2023-10-07T08:45:06.554314+0000","last_peered":"2023-10-07T08:45:06.554314+0000","last_clean":"2023-10-07T08:45:06.554314+0000","last_became_active":"2023-10-07T08:45:05.523598+0000","last_became_peered":"2023-10-07T08:45:05.523598+0000","last_unstale":"2023-10-07T08:45:06.554314+0000","last_undegraded":"2023-10-07T08:45:06.554314+0000","last_fullsized":"2023-10-07T08:45:06.554314+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:05:53.564262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546272+0000","last_change":"2023-10-07T08:45:06.546056+0000","last_active":"2023-10-07T08:45:06.546272+0000","last_peered":"2023-10-07T08:45:06.546272+0000","last_clean":"2023-10-07T08:45:06.546272+0000","last_became_active":"2023-10-07T08:45:06.545475+0000","last_became_peered":"2023-10-07T08:45:06.545475+0000","last_unstale":"2023-10-07T08:45:06.546272+0000","last_undegraded":"2023-10-07T08:45:06.546272+0000","last_fullsized":"2023-10-07T08:45:06.546272+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:39:27.745793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.534629+0000","last_change":"2023-10-07T08:45:05.531582+0000","last_active":"2023-10-07T08:45:06.534629+0000","last_peered":"2023-10-07T08:45:06.534629+0000","last_clean":"2023-10-07T08:45:06.534629+0000","last_became_active":"2023-10-07T08:45:05.531287+0000","last_became_peered":"2023-10-07T08:45:05.531287+0000","last_unstale":"2023-10-07T08:45:06.534629+0000","last_undegraded":"2023-10-07T08:45:06.534629+0000","last_fullsized":"2023-10-07T08:45:06.534629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:15.336268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546555+0000","last_change":"2023-10-07T08:45:06.545800+0000","last_active":"2023-10-07T08:45:06.546555+0000","last_peered":"2023-10-07T08:45:06.546555+0000","last_clean":"2023-10-07T08:45:06.546555+0000","last_became_active":"2023-10-07T08:45:06.545256+0000","last_became_peered":"2023-10-07T08:45:06.545256+0000","last_unstale":"2023-10-07T08:45:06.546555+0000","last_undegraded":"2023-10-07T08:45:06.546555+0000","last_fullsized":"2023-10-07T08:45:06.546555+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:27:37.086711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539313+0000","last_change":"2023-10-07T08:45:05.528402+0000","last_active":"2023-10-07T08:45:06.539313+0000","last_peered":"2023-10-07T08:45:06.539313+0000","last_clean":"2023-10-07T08:45:06.539313+0000","last_became_active":"2023-10-07T08:45:05.528166+0000","last_became_peered":"2023-10-07T08:45:05.528166+0000","last_unstale":"2023-10-07T08:45:06.539313+0000","last_undegraded":"2023-10-07T08:45:06.539313+0000","last_fullsized":"2023-10-07T08:45:06.539313+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:41:05.626092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.541934+0000","last_change":"2023-10-07T08:45:06.541583+0000","last_active":"2023-10-07T08:45:06.541934+0000","last_peered":"2023-10-07T08:45:06.541934+0000","last_clean":"2023-10-07T08:45:06.541934+0000","last_became_active":"2023-10-07T08:45:06.541361+0000","last_became_peered":"2023-10-07T08:45:06.541361+0000","last_unstale":"2023-10-07T08:45:06.541934+0000","last_undegraded":"2023-10-07T08:45:06.541934+0000","last_fullsized":"2023-10-07T08:45:06.541934+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:08.369937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539197+0000","last_change":"2023-10-07T08:45:05.529099+0000","last_active":"2023-10-07T08:45:06.539197+0000","last_peered":"2023-10-07T08:45:06.539197+0000","last_clean":"2023-10-07T08:45:06.539197+0000","last_became_active":"2023-10-07T08:45:05.528819+0000","last_became_peered":"2023-10-07T08:45:05.528819+0000","last_unstale":"2023-10-07T08:45:06.539197+0000","last_undegraded":"2023-10-07T08:45:06.539197+0000","last_fullsized":"2023-10-07T08:45:06.539197+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:06.964256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.549319+0000","last_change":"2023-10-07T08:45:06.549265+0000","last_active":"2023-10-07T08:45:06.549319+0000","last_peered":"2023-10-07T08:45:06.549319+0000","last_clean":"2023-10-07T08:45:06.549319+0000","last_became_active":"2023-10-07T08:45:06.546983+0000","last_became_peered":"2023-10-07T08:45:06.546983+0000","last_unstale":"2023-10-07T08:45:06.549319+0000","last_undegraded":"2023-10-07T08:45:06.549319+0000","last_fullsized":"2023-10-07T08:45:06.549319+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:07.708034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539730+0000","last_change":"2023-10-07T08:45:05.529386+0000","last_active":"2023-10-07T08:45:06.539730+0000","last_peered":"2023-10-07T08:45:06.539730+0000","last_clean":"2023-10-07T08:45:06.539730+0000","last_became_active":"2023-10-07T08:45:05.529242+0000","last_became_peered":"2023-10-07T08:45:05.529242+0000","last_unstale":"2023-10-07T08:45:06.539730+0000","last_undegraded":"2023-10-07T08:45:06.539730+0000","last_fullsized":"2023-10-07T08:45:06.539730+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:23:36.246557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.549947+0000","last_change":"2023-10-07T08:45:06.549906+0000","last_active":"2023-10-07T08:45:06.549947+0000","last_peered":"2023-10-07T08:45:06.549947+0000","last_clean":"2023-10-07T08:45:06.549947+0000","last_became_active":"2023-10-07T08:45:06.549406+0000","last_became_peered":"2023-10-07T08:45:06.549406+0000","last_unstale":"2023-10-07T08:45:06.549947+0000","last_undegraded":"2023-10-07T08:45:06.549947+0000","last_fullsized":"2023-10-07T08:45:06.549947+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:32:32.002898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.535601+0000","last_change":"2023-10-07T08:45:05.528780+0000","last_active":"2023-10-07T08:45:06.535601+0000","last_peered":"2023-10-07T08:45:06.535601+0000","last_clean":"2023-10-07T08:45:06.535601+0000","last_became_active":"2023-10-07T08:45:05.528536+0000","last_became_peered":"2023-10-07T08:45:05.528536+0000","last_unstale":"2023-10-07T08:45:06.535601+0000","last_undegraded":"2023-10-07T08:45:06.535601+0000","last_fullsized":"2023-10-07T08:45:06.535601+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:55:42.171101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546508+0000","last_change":"2023-10-07T08:45:06.543599+0000","last_active":"2023-10-07T08:45:06.546508+0000","last_peered":"2023-10-07T08:45:06.546508+0000","last_clean":"2023-10-07T08:45:06.546508+0000","last_became_active":"2023-10-07T08:45:06.543077+0000","last_became_peered":"2023-10-07T08:45:06.543077+0000","last_unstale":"2023-10-07T08:45:06.546508+0000","last_undegraded":"2023-10-07T08:45:06.546508+0000","last_fullsized":"2023-10-07T08:45:06.546508+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:53:36.971647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.538506+0000","last_change":"2023-10-07T08:45:05.527602+0000","last_active":"2023-10-07T08:45:06.538506+0000","last_peered":"2023-10-07T08:45:06.538506+0000","last_clean":"2023-10-07T08:45:06.538506+0000","last_became_active":"2023-10-07T08:45:05.527362+0000","last_became_peered":"2023-10-07T08:45:05.527362+0000","last_unstale":"2023-10-07T08:45:06.538506+0000","last_undegraded":"2023-10-07T08:45:06.538506+0000","last_fullsized":"2023-10-07T08:45:06.538506+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:05:49.289900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.545218+0000","last_change":"2023-10-07T08:45:06.542321+0000","last_active":"2023-10-07T08:45:06.545218+0000","last_peered":"2023-10-07T08:45:06.545218+0000","last_clean":"2023-10-07T08:45:06.545218+0000","last_became_active":"2023-10-07T08:45:06.542105+0000","last_became_peered":"2023-10-07T08:45:06.542105+0000","last_unstale":"2023-10-07T08:45:06.545218+0000","last_undegraded":"2023-10-07T08:45:06.545218+0000","last_fullsized":"2023-10-07T08:45:06.545218+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:50:25.266040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.538611+0000","last_change":"2023-10-07T08:45:05.530829+0000","last_active":"2023-10-07T08:45:06.538611+0000","last_peered":"2023-10-07T08:45:06.538611+0000","last_clean":"2023-10-07T08:45:06.538611+0000","last_became_active":"2023-10-07T08:45:05.530599+0000","last_became_peered":"2023-10-07T08:45:05.530599+0000","last_unstale":"2023-10-07T08:45:06.538611+0000","last_undegraded":"2023-10-07T08:45:06.538611+0000","last_fullsized":"2023-10-07T08:45:06.538611+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:32:30.995838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.545183+0000","last_change":"2023-10-07T08:45:06.541301+0000","last_active":"2023-10-07T08:45:06.545183+0000","last_peered":"2023-10-07T08:45:06.545183+0000","last_clean":"2023-10-07T08:45:06.545183+0000","last_became_active":"2023-10-07T08:45:06.540801+0000","last_became_peered":"2023-10-07T08:45:06.540801+0000","last_unstale":"2023-10-07T08:45:06.545183+0000","last_undegraded":"2023-10-07T08:45:06.545183+0000","last_fullsized":"2023-10-07T08:45:06.545183+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:25:08.824796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539146+0000","last_change":"2023-10-07T08:45:05.528293+0000","last_active":"2023-10-07T08:45:06.539146+0000","last_peered":"2023-10-07T08:45:06.539146+0000","last_clean":"2023-10-07T08:45:06.539146+0000","last_became_active":"2023-10-07T08:45:05.528049+0000","last_became_peered":"2023-10-07T08:45:05.528049+0000","last_unstale":"2023-10-07T08:45:06.539146+0000","last_undegraded":"2023-10-07T08:45:06.539146+0000","last_fullsized":"2023-10-07T08:45:06.539146+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:48:24.909450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.538595+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:45:06.538595+0000","last_peered":"2023-10-07T08:45:06.538595+0000","last_clean":"2023-10-07T08:45:06.538595+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:45:06.538595+0000","last_undegraded":"2023-10-07T08:45:06.538595+0000","last_fullsized":"2023-10-07T08:45:06.538595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":911,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199066150,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.496,"15min":0.49299999999999999},"min":{"1min":0.36199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68000000000000005,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.374,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38100000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.38100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.73099999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.50800000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.52200000000000002},"min":{"1min":0.40699999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71799999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.40500000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.34300000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.82799999999999996,"15min":0.873},"min":{"1min":0.39700000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75900000000000001,"5min":6.8570000000000002,"15min":6.8570000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.67500000000000004,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.47599999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.314,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64700000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.53800000000000003,"15min":0.54500000000000004},"min":{"1min":0.32500000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.53400000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.505,"15min":0.51100000000000001},"min":{"1min":0.308,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.65000000000000002,"5min":0.746,"15min":0.746},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.35199999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73699999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.57299999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.40500000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70999999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.49299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":335,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194977,"statfs":{"total":200000000,"available":199656678,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.46200000000000002},"min":{"1min":0.29399999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48099999999999998,"15min":0.48299999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.38300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.497},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.52200000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.313,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.40000000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.502,"15min":0.502},"min":{"1min":0.39200000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.54300000000000004,"15min":0.52300000000000002},"min":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.56499999999999995}]},{"osd":4,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47799999999999998},"min":{"1min":0.34599999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.64300000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.32600000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.501,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.40000000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.34499999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72599999999999998,"5min":0.754,"15min":0.754},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.44,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.38100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":335,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194977,"statfs":{"total":200000000,"available":199656588,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.29799999999999999,"15min":0.29599999999999999},"min":{"1min":0.20599999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.45700000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.32000000000000001,"15min":0.316},"min":{"1min":0.222,"5min":0.192,"15min":0.192},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.41399999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.30399999999999999,"15min":0.30199999999999999},"min":{"1min":0.22700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.441,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.375,"5min":0.31900000000000001,"15min":0.309},"min":{"1min":0.26200000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.375}]},{"osd":3,"last update":"Sat Oct 7 08:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.34699999999999998,"15min":0.34100000000000003},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.31},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.33200000000000002},"min":{"1min":0.28000000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.48999999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76500000000000001,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.50900000000000001,"15min":0.504},"min":{"1min":0.30099999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40600000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.44800000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.745,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51300000000000001,"15min":0.50700000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.38500000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77800000000000002,"5min":1.04,"15min":1.04},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.74299999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.50600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":913,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194398,"statfs":{"total":200000000,"available":199064220,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.37,"15min":0.38},"min":{"1min":0.215,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.48599999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.39500000000000002,"15min":0.40100000000000002},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.441,"5min":1.079,"15min":1.079},"last":0.25800000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.26500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.46800000000000003,"5min":1.464,"15min":1.464},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27000000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51200000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.33400000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.28499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.45200000000000001,"5min":1.341,"15min":1.341},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.435,"15min":0.44},"min":{"1min":0.31,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58599999999999997,"5min":1.532,"15min":1.532},"last":0.30499999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76300000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":1.51,"15min":1.51},"last":0.42099999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59699999999999998,"15min":0.59999999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.78400000000000003,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.497},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76300000000000001,"5min":1.25,"15min":1.25},"last":0.39900000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71399999999999997,"5min":1.488,"15min":1.488},"last":0.44},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.45700000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.74099999999999999,"5min":1.024,"15min":1.024},"last":0.53300000000000003}]},{"osd":7,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.436,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76400000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.70199999999999996,"5min":1.288,"15min":1.288},"last":0.50900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":335,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194977,"statfs":{"total":200000000,"available":199656622,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34399999999999997,"15min":0.34799999999999998},"min":{"1min":0.215,"5min":0.187,"15min":0.187},"max":{"1min":0.441,"5min":1.665,"15min":1.665},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.36099999999999999,"15min":0.36399999999999999},"min":{"1min":0.22800000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47599999999999998,"5min":1.579,"15min":1.579},"last":0.32500000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.375,"15min":0.378},"min":{"1min":0.223,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.73299999999999998,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.251},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41999999999999998,"15min":0.42599999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.71199999999999997,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.37}]},{"osd":3,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38500000000000001,"15min":0.39100000000000001},"min":{"1min":0.26200000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.60199999999999998,"5min":1.454,"15min":1.454},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38600000000000001,"15min":0.39100000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.53500000000000003,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68799999999999994,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.76900000000000002,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.51900000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76400000000000001,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.44700000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78700000000000003,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.44,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71499999999999997,"5min":1.637,"15min":1.637},"last":0.46400000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81499999999999995,"5min":1.49,"15min":1.49},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.40400000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84299999999999997,"5min":1.375,"15min":1.375},"last":0.42699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":335,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194977,"statfs":{"total":200000000,"available":199656622,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.318,"15min":0.318},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.315,"15min":0.31},"min":{"1min":0.26300000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.35199999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39000000000000001,"15min":0.38900000000000001},"min":{"1min":0.253,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.65200000000000002,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.374,"15min":0.374},"min":{"1min":0.27600000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59799999999999998,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.50700000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.49299999999999999,"15min":0.48499999999999999},"min":{"1min":0.35399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.51800000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.624}]},{"osd":5,"last update":"Sat Oct 7 08:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.60199999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.55200000000000005,"15min":0.54200000000000004},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.442,"5min":0.433,"15min":0.433},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.66800000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.74199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":336,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194975,"statfs":{"total":200000000,"available":199655142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:44:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.496,"15min":0.495},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.66500000000000004}]},{"osd":1,"last update":"Sat Oct 7 08:44:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.49099999999999999,"15min":0.48699999999999999},"min":{"1min":0.30199999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.76300000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:44:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.499,"15min":0.495},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:44:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.74399999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:44:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.45400000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.29499999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:44:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.57299999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:44:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.33500000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.42299999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":335,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194976,"statfs":{"total":200000000,"available":199656054,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.505,"15min":0.504},"min":{"1min":0.34399999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72399999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.39200000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.37},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69399999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Oct 7 08:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69699999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.435},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.32700000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Oct 7 08:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73699999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48199999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47599999999999998,"15min":0.47799999999999998},"min":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69199999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.32600000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.71099999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73499999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59999999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72299999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73999999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64800000000000002}]}]}],"pool_statfs":[]}} 2023-10-07T08:45:10.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:45:10.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.733+0000 7fb2e07db700 1 Processor -- start 2023-10-07T08:45:10.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.733+0000 7fb2e07db700 1 -- start start 2023-10-07T08:45:10.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.734+0000 7fb2e07db700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2d81578d0 0x7fb2d80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.734+0000 7fb2e07db700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb2d8157ca0 0x7fb2d815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.734+0000 7fb2e07db700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d806d120 0x7fb2d806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.734+0000 7fb2e07db700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d80d07c0 con 0x7fb2d81578d0 2023-10-07T08:45:10.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.734+0000 7fb2e07db700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d806daa0 con 0x7fb2d8157ca0 2023-10-07T08:45:10.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.734+0000 7fb2e07db700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80cfbb0 con 0x7fb2d806d120 2023-10-07T08:45:10.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.734+0000 7fb2de577700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2d81578d0 0x7fb2d80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.734+0000 7fb2de577700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2d81578d0 0x7fb2d80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52436/0 (socket says 172.21.15.81:52436) 2023-10-07T08:45:10.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.734+0000 7fb2de577700 1 -- 172.21.15.81:0/2028184245 learned_addr learned my addr 172.21.15.81:0/2028184245 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:10.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.734+0000 7fb2ded78700 1 --2- 172.21.15.81:0/2028184245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d806d120 0x7fb2d806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.734+0000 7fb2ddd76700 1 --2- 172.21.15.81:0/2028184245 >> v2:172.21.15.89:3300/0 conn(0x7fb2d8157ca0 0x7fb2d815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2de577700 1 -- 172.21.15.81:0/2028184245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d806d120 msgr2=0x7fb2d806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:10.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2de577700 1 --2- 172.21.15.81:0/2028184245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d806d120 0x7fb2d806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2de577700 1 -- 172.21.15.81:0/2028184245 >> v2:172.21.15.89:3300/0 conn(0x7fb2d8157ca0 msgr2=0x7fb2d815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:10.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2de577700 1 --2- 172.21.15.81:0/2028184245 >> v2:172.21.15.89:3300/0 conn(0x7fb2d8157ca0 0x7fb2d815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2de577700 1 -- 172.21.15.81:0/2028184245 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80cfe90 con 0x7fb2d81578d0 2023-10-07T08:45:10.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2ddd76700 1 --2- 172.21.15.81:0/2028184245 >> v2:172.21.15.89:3300/0 conn(0x7fb2d8157ca0 0x7fb2d815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:45:10.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2de577700 1 --2- 172.21.15.81:0/2028184245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d81578d0 0x7fb2d80cf4f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8068510 tx=0x7fb2d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69a37e413308bfd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:10.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2dd575700 1 -- 172.21.15.81:0/2028184245 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d400e070 con 0x7fb2d81578d0 2023-10-07T08:45:10.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2dd575700 1 -- 172.21.15.81:0/2028184245 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d400ba20 con 0x7fb2d81578d0 2023-10-07T08:45:10.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2dd575700 1 -- 172.21.15.81:0/2028184245 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d40092e0 con 0x7fb2d81578d0 2023-10-07T08:45:10.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2e07db700 1 -- 172.21.15.81:0/2028184245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d81578d0 msgr2=0x7fb2d80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:10.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2e07db700 1 --2- 172.21.15.81:0/2028184245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d81578d0 0x7fb2d80cf4f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8068510 tx=0x7fb2d4009840 comp rx=0 tx=0).stop 2023-10-07T08:45:10.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2e07db700 1 -- 172.21.15.81:0/2028184245 shutdown_connections 2023-10-07T08:45:10.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2e07db700 1 --2- 172.21.15.81:0/2028184245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d806d120 0x7fb2d806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2e07db700 1 --2- 172.21.15.81:0/2028184245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d81578d0 0x7fb2d80cf4f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2e07db700 1 --2- 172.21.15.81:0/2028184245 >> v2:172.21.15.89:3300/0 conn(0x7fb2d8157ca0 0x7fb2d815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2e07db700 1 -- 172.21.15.81:0/2028184245 >> 172.21.15.81:0/2028184245 conn(0x7fb2d806bb90 msgr2=0x7fb2d806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:10.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2e07db700 1 -- 172.21.15.81:0/2028184245 shutdown_connections 2023-10-07T08:45:10.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.735+0000 7fb2e07db700 1 -- 172.21.15.81:0/2028184245 wait complete. 2023-10-07T08:45:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.736+0000 7fb2e07db700 1 Processor -- start 2023-10-07T08:45:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.737+0000 7fb2e07db700 1 -- start start 2023-10-07T08:45:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.737+0000 7fb2e07db700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d806d120 0x7fb2d8153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.737+0000 7fb2e07db700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d81578d0 0x7fb2d80c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.737+0000 7fb2e07db700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d8157ca0 0x7fb2d816a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.737+0000 7fb2e07db700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80b6c30 con 0x7fb2d8157ca0 2023-10-07T08:45:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.737+0000 7fb2e07db700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80c6ba0 con 0x7fb2d806d120 2023-10-07T08:45:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.737+0000 7fb2e07db700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80b4ce0 con 0x7fb2d81578d0 2023-10-07T08:45:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.737+0000 7fb2ded78700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d8157ca0 0x7fb2d816a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.737+0000 7fb2ded78700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d8157ca0 0x7fb2d816a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52450/0 (socket says 172.21.15.81:52450) 2023-10-07T08:45:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.737+0000 7fb2ded78700 1 -- 172.21.15.81:0/1245616487 learned_addr learned my addr 172.21.15.81:0/1245616487 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.737+0000 7fb2ddd76700 1 --2- 172.21.15.81:0/1245616487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d81578d0 0x7fb2d80c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.737+0000 7fb2de577700 1 --2- 172.21.15.81:0/1245616487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d806d120 0x7fb2d8153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.738+0000 7fb2ded78700 1 -- 172.21.15.81:0/1245616487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d81578d0 msgr2=0x7fb2d80c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.738+0000 7fb2ded78700 1 --2- 172.21.15.81:0/1245616487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d81578d0 0x7fb2d80c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.738+0000 7fb2ded78700 1 -- 172.21.15.81:0/1245616487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d806d120 msgr2=0x7fb2d8153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.738+0000 7fb2ded78700 1 --2- 172.21.15.81:0/1245616487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d806d120 0x7fb2d8153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.738+0000 7fb2ded78700 1 -- 172.21.15.81:0/1245616487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d4009ae0 con 0x7fb2d8157ca0 2023-10-07T08:45:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.738+0000 7fb2ded78700 1 --2- 172.21.15.81:0/1245616487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d8157ca0 0x7fb2d816a220 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000ea80 tx=0x7fb2d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.738+0000 7fb2ce7fc700 1 -- 172.21.15.81:0/1245616487 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d000eec0 con 0x7fb2d8157ca0 2023-10-07T08:45:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.738+0000 7fb2ce7fc700 1 -- 172.21.15.81:0/1245616487 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d000c850 con 0x7fb2d8157ca0 2023-10-07T08:45:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.738+0000 7fb2e07db700 1 -- 172.21.15.81:0/1245616487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d816b030 con 0x7fb2d8157ca0 2023-10-07T08:45:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.738+0000 7fb2ce7fc700 1 -- 172.21.15.81:0/1245616487 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d000cc10 con 0x7fb2d8157ca0 2023-10-07T08:45:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.738+0000 7fb2e07db700 1 -- 172.21.15.81:0/1245616487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d80b4970 con 0x7fb2d8157ca0 2023-10-07T08:45:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.739+0000 7fb2e07db700 1 -- 172.21.15.81:0/1245616487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d8067ac0 con 0x7fb2d8157ca0 2023-10-07T08:45:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.739+0000 7fb2ce7fc700 1 -- 172.21.15.81:0/1245616487 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2d0013470 con 0x7fb2d8157ca0 2023-10-07T08:45:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.740+0000 7fb2ce7fc700 1 --2- 172.21.15.81:0/1245616487 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb2bc066f30 0x7fb2bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.740+0000 7fb2de577700 1 --2- 172.21.15.81:0/1245616487 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb2bc066f30 0x7fb2bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.740+0000 7fb2ce7fc700 1 -- 172.21.15.81:0/1245616487 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb2d00846d0 con 0x7fb2d8157ca0 2023-10-07T08:45:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.740+0000 7fb2de577700 1 --2- 172.21.15.81:0/1245616487 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb2bc066f30 0x7fb2bc0693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009880 tx=0x7fb2d4018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.744+0000 7fb2ce7fc700 1 -- 172.21.15.81:0/1245616487 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2d0051940 con 0x7fb2d8157ca0 2023-10-07T08:45:10.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.921+0000 7fb2e07db700 1 -- 172.21.15.81:0/1245616487 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2d80b4e20 con 0x7fb2bc066f30 2023-10-07T08:45:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.928+0000 7fb2ce7fc700 1 -- 172.21.15.81:0/1245616487 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284648 (secure 0 0 0) 0x7fb2d80b4e20 con 0x7fb2bc066f30 2023-10-07T08:45:10.932 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:45:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.932+0000 7fb2e07db700 1 -- 172.21.15.81:0/1245616487 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb2bc066f30 msgr2=0x7fb2bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.932+0000 7fb2e07db700 1 --2- 172.21.15.81:0/1245616487 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb2bc066f30 0x7fb2bc0693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009880 tx=0x7fb2d4018000 comp rx=0 tx=0).stop 2023-10-07T08:45:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.932+0000 7fb2e07db700 1 -- 172.21.15.81:0/1245616487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d8157ca0 msgr2=0x7fb2d816a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.932+0000 7fb2e07db700 1 --2- 172.21.15.81:0/1245616487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d8157ca0 0x7fb2d816a220 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000ea80 tx=0x7fb2d00091a0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.932+0000 7fb2e07db700 1 -- 172.21.15.81:0/1245616487 shutdown_connections 2023-10-07T08:45:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.932+0000 7fb2e07db700 1 --2- 172.21.15.81:0/1245616487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d8157ca0 0x7fb2d816a220 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.932+0000 7fb2e07db700 1 --2- 172.21.15.81:0/1245616487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d806d120 0x7fb2d8153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.932+0000 7fb2e07db700 1 --2- 172.21.15.81:0/1245616487 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb2bc066f30 0x7fb2bc0693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.932+0000 7fb2e07db700 1 --2- 172.21.15.81:0/1245616487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2d81578d0 0x7fb2d80c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.932+0000 7fb2e07db700 1 -- 172.21.15.81:0/1245616487 >> 172.21.15.81:0/1245616487 conn(0x7fb2d806bb90 msgr2=0x7fb2d8155820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.932+0000 7fb2e07db700 1 -- 172.21.15.81:0/1245616487 shutdown_connections 2023-10-07T08:45:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:10.932+0000 7fb2e07db700 1 -- 172.21.15.81:0/1245616487 wait complete. 2023-10-07T08:45:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:45:10.944 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2023-10-07T08:45:10.032389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3839,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558660,"statfs":{"total":1600000000,"available":1596068076,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.512982"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.540296+0000","last_change":"2023-10-07T08:45:06.540099+0000","last_active":"2023-10-07T08:45:06.540296+0000","last_peered":"2023-10-07T08:45:06.540296+0000","last_clean":"2023-10-07T08:45:06.540296+0000","last_became_active":"2023-10-07T08:45:06.539878+0000","last_became_peered":"2023-10-07T08:45:06.539878+0000","last_unstale":"2023-10-07T08:45:06.540296+0000","last_undegraded":"2023-10-07T08:45:06.540296+0000","last_fullsized":"2023-10-07T08:45:06.540296+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:55:29.085019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.549485+0000","last_change":"2023-10-07T08:45:06.549426+0000","last_active":"2023-10-07T08:45:06.549485+0000","last_peered":"2023-10-07T08:45:06.549485+0000","last_clean":"2023-10-07T08:45:06.549485+0000","last_became_active":"2023-10-07T08:45:06.548474+0000","last_became_peered":"2023-10-07T08:45:06.548474+0000","last_unstale":"2023-10-07T08:45:06.549485+0000","last_undegraded":"2023-10-07T08:45:06.549485+0000","last_fullsized":"2023-10-07T08:45:06.549485+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:07:00.277270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.545767+0000","last_change":"2023-10-07T08:45:06.545501+0000","last_active":"2023-10-07T08:45:06.545767+0000","last_peered":"2023-10-07T08:45:06.545767+0000","last_clean":"2023-10-07T08:45:06.545767+0000","last_became_active":"2023-10-07T08:45:06.545141+0000","last_became_peered":"2023-10-07T08:45:06.545141+0000","last_unstale":"2023-10-07T08:45:06.545767+0000","last_undegraded":"2023-10-07T08:45:06.545767+0000","last_fullsized":"2023-10-07T08:45:06.545767+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:25:26.346162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.547402+0000","last_change":"2023-10-07T08:45:06.547330+0000","last_active":"2023-10-07T08:45:06.547402+0000","last_peered":"2023-10-07T08:45:06.547402+0000","last_clean":"2023-10-07T08:45:06.547402+0000","last_became_active":"2023-10-07T08:45:06.547135+0000","last_became_peered":"2023-10-07T08:45:06.547135+0000","last_unstale":"2023-10-07T08:45:06.547402+0000","last_undegraded":"2023-10-07T08:45:06.547402+0000","last_fullsized":"2023-10-07T08:45:06.547402+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:45:14.826240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.541213+0000","last_change":"2023-10-07T08:45:06.540666+0000","last_active":"2023-10-07T08:45:06.541213+0000","last_peered":"2023-10-07T08:45:06.541213+0000","last_clean":"2023-10-07T08:45:06.541213+0000","last_became_active":"2023-10-07T08:45:06.540444+0000","last_became_peered":"2023-10-07T08:45:06.540444+0000","last_unstale":"2023-10-07T08:45:06.541213+0000","last_undegraded":"2023-10-07T08:45:06.541213+0000","last_fullsized":"2023-10-07T08:45:06.541213+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:04:20.451928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.537636+0000","last_change":"2023-10-07T08:45:06.537142+0000","last_active":"2023-10-07T08:45:06.537636+0000","last_peered":"2023-10-07T08:45:06.537636+0000","last_clean":"2023-10-07T08:45:06.537636+0000","last_became_active":"2023-10-07T08:45:06.536852+0000","last_became_peered":"2023-10-07T08:45:06.536852+0000","last_unstale":"2023-10-07T08:45:06.537636+0000","last_undegraded":"2023-10-07T08:45:06.537636+0000","last_fullsized":"2023-10-07T08:45:06.537636+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:36:04.007944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.540804+0000","last_change":"2023-10-07T08:45:06.540404+0000","last_active":"2023-10-07T08:45:06.540804+0000","last_peered":"2023-10-07T08:45:06.540804+0000","last_clean":"2023-10-07T08:45:06.540804+0000","last_became_active":"2023-10-07T08:45:06.540166+0000","last_became_peered":"2023-10-07T08:45:06.540166+0000","last_unstale":"2023-10-07T08:45:06.540804+0000","last_undegraded":"2023-10-07T08:45:06.540804+0000","last_fullsized":"2023-10-07T08:45:06.540804+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:33.157237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.548894+0000","last_change":"2023-10-07T08:45:06.548807+0000","last_active":"2023-10-07T08:45:06.548894+0000","last_peered":"2023-10-07T08:45:06.548894+0000","last_clean":"2023-10-07T08:45:06.548894+0000","last_became_active":"2023-10-07T08:45:06.546745+0000","last_became_peered":"2023-10-07T08:45:06.546745+0000","last_unstale":"2023-10-07T08:45:06.548894+0000","last_undegraded":"2023-10-07T08:45:06.548894+0000","last_fullsized":"2023-10-07T08:45:06.548894+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:48:01.457226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.537118+0000","last_change":"2023-10-07T08:45:06.537044+0000","last_active":"2023-10-07T08:45:06.537118+0000","last_peered":"2023-10-07T08:45:06.537118+0000","last_clean":"2023-10-07T08:45:06.537118+0000","last_became_active":"2023-10-07T08:45:06.536848+0000","last_became_peered":"2023-10-07T08:45:06.536848+0000","last_unstale":"2023-10-07T08:45:06.537118+0000","last_undegraded":"2023-10-07T08:45:06.537118+0000","last_fullsized":"2023-10-07T08:45:06.537118+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:07.971315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546570+0000","last_change":"2023-10-07T08:45:06.545918+0000","last_active":"2023-10-07T08:45:06.546570+0000","last_peered":"2023-10-07T08:45:06.546570+0000","last_clean":"2023-10-07T08:45:06.546570+0000","last_became_active":"2023-10-07T08:45:06.545601+0000","last_became_peered":"2023-10-07T08:45:06.545601+0000","last_unstale":"2023-10-07T08:45:06.546570+0000","last_undegraded":"2023-10-07T08:45:06.546570+0000","last_fullsized":"2023-10-07T08:45:06.546570+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:16.343328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.547863+0000","last_change":"2023-10-07T08:45:06.547801+0000","last_active":"2023-10-07T08:45:06.547863+0000","last_peered":"2023-10-07T08:45:06.547863+0000","last_clean":"2023-10-07T08:45:06.547863+0000","last_became_active":"2023-10-07T08:45:06.547047+0000","last_became_peered":"2023-10-07T08:45:06.547047+0000","last_unstale":"2023-10-07T08:45:06.547863+0000","last_undegraded":"2023-10-07T08:45:06.547863+0000","last_fullsized":"2023-10-07T08:45:06.547863+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:14:01.407779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546290+0000","last_change":"2023-10-07T08:45:06.546209+0000","last_active":"2023-10-07T08:45:06.546290+0000","last_peered":"2023-10-07T08:45:06.546290+0000","last_clean":"2023-10-07T08:45:06.546290+0000","last_became_active":"2023-10-07T08:45:06.545787+0000","last_became_peered":"2023-10-07T08:45:06.545787+0000","last_unstale":"2023-10-07T08:45:06.546290+0000","last_undegraded":"2023-10-07T08:45:06.546290+0000","last_fullsized":"2023-10-07T08:45:06.546290+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:29:53.900055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.549608+0000","last_change":"2023-10-07T08:45:06.548033+0000","last_active":"2023-10-07T08:45:06.549608+0000","last_peered":"2023-10-07T08:45:06.549608+0000","last_clean":"2023-10-07T08:45:06.549608+0000","last_became_active":"2023-10-07T08:45:06.547775+0000","last_became_peered":"2023-10-07T08:45:06.547775+0000","last_unstale":"2023-10-07T08:45:06.549608+0000","last_undegraded":"2023-10-07T08:45:06.549608+0000","last_fullsized":"2023-10-07T08:45:06.549608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:50:55.797691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.536716+0000","last_change":"2023-10-07T08:45:06.536636+0000","last_active":"2023-10-07T08:45:06.536716+0000","last_peered":"2023-10-07T08:45:06.536716+0000","last_clean":"2023-10-07T08:45:06.536716+0000","last_became_active":"2023-10-07T08:45:06.536399+0000","last_became_peered":"2023-10-07T08:45:06.536399+0000","last_unstale":"2023-10-07T08:45:06.536716+0000","last_undegraded":"2023-10-07T08:45:06.536716+0000","last_fullsized":"2023-10-07T08:45:06.536716+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:58:32.040465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.541216+0000","last_change":"2023-10-07T08:45:06.541161+0000","last_active":"2023-10-07T08:45:06.541216+0000","last_peered":"2023-10-07T08:45:06.541216+0000","last_clean":"2023-10-07T08:45:06.541216+0000","last_became_active":"2023-10-07T08:45:06.540922+0000","last_became_peered":"2023-10-07T08:45:06.540922+0000","last_unstale":"2023-10-07T08:45:06.541216+0000","last_undegraded":"2023-10-07T08:45:06.541216+0000","last_fullsized":"2023-10-07T08:45:06.541216+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:12:47.571165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.544088+0000","last_change":"2023-10-07T08:45:06.543089+0000","last_active":"2023-10-07T08:45:06.544088+0000","last_peered":"2023-10-07T08:45:06.544088+0000","last_clean":"2023-10-07T08:45:06.544088+0000","last_became_active":"2023-10-07T08:45:06.542883+0000","last_became_peered":"2023-10-07T08:45:06.542883+0000","last_unstale":"2023-10-07T08:45:06.544088+0000","last_undegraded":"2023-10-07T08:45:06.544088+0000","last_fullsized":"2023-10-07T08:45:06.544088+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:16:18.934820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.548909+0000","last_change":"2023-10-07T08:45:06.548830+0000","last_active":"2023-10-07T08:45:06.548909+0000","last_peered":"2023-10-07T08:45:06.548909+0000","last_clean":"2023-10-07T08:45:06.548909+0000","last_became_active":"2023-10-07T08:45:06.545915+0000","last_became_peered":"2023-10-07T08:45:06.545915+0000","last_unstale":"2023-10-07T08:45:06.548909+0000","last_undegraded":"2023-10-07T08:45:06.548909+0000","last_fullsized":"2023-10-07T08:45:06.548909+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:40:30.727851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.547257+0000","last_change":"2023-10-07T08:45:06.547191+0000","last_active":"2023-10-07T08:45:06.547257+0000","last_peered":"2023-10-07T08:45:06.547257+0000","last_clean":"2023-10-07T08:45:06.547257+0000","last_became_active":"2023-10-07T08:45:06.546961+0000","last_became_peered":"2023-10-07T08:45:06.546961+0000","last_unstale":"2023-10-07T08:45:06.547257+0000","last_undegraded":"2023-10-07T08:45:06.547257+0000","last_fullsized":"2023-10-07T08:45:06.547257+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:38:48.891670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.544955+0000","last_change":"2023-10-07T08:45:06.541872+0000","last_active":"2023-10-07T08:45:06.544955+0000","last_peered":"2023-10-07T08:45:06.544955+0000","last_clean":"2023-10-07T08:45:06.544955+0000","last_became_active":"2023-10-07T08:45:06.541258+0000","last_became_peered":"2023-10-07T08:45:06.541258+0000","last_unstale":"2023-10-07T08:45:06.544955+0000","last_undegraded":"2023-10-07T08:45:06.544955+0000","last_fullsized":"2023-10-07T08:45:06.544955+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:56:23.126924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.541271+0000","last_change":"2023-10-07T08:45:06.540494+0000","last_active":"2023-10-07T08:45:06.541271+0000","last_peered":"2023-10-07T08:45:06.541271+0000","last_clean":"2023-10-07T08:45:06.541271+0000","last_became_active":"2023-10-07T08:45:06.540267+0000","last_became_peered":"2023-10-07T08:45:06.540267+0000","last_unstale":"2023-10-07T08:45:06.541271+0000","last_undegraded":"2023-10-07T08:45:06.541271+0000","last_fullsized":"2023-10-07T08:45:06.541271+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:46:44.246462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.544599+0000","last_change":"2023-10-07T08:45:06.544505+0000","last_active":"2023-10-07T08:45:06.544599+0000","last_peered":"2023-10-07T08:45:06.544599+0000","last_clean":"2023-10-07T08:45:06.544599+0000","last_became_active":"2023-10-07T08:45:06.544258+0000","last_became_peered":"2023-10-07T08:45:06.544258+0000","last_unstale":"2023-10-07T08:45:06.544599+0000","last_undegraded":"2023-10-07T08:45:06.544599+0000","last_fullsized":"2023-10-07T08:45:06.544599+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:47:25.249493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.548877+0000","last_change":"2023-10-07T08:45:06.548696+0000","last_active":"2023-10-07T08:45:06.548877+0000","last_peered":"2023-10-07T08:45:06.548877+0000","last_clean":"2023-10-07T08:45:06.548877+0000","last_became_active":"2023-10-07T08:45:06.545623+0000","last_became_peered":"2023-10-07T08:45:06.545623+0000","last_unstale":"2023-10-07T08:45:06.548877+0000","last_undegraded":"2023-10-07T08:45:06.548877+0000","last_fullsized":"2023-10-07T08:45:06.548877+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:32:10.162991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.550054+0000","last_change":"2023-10-07T08:45:06.549992+0000","last_active":"2023-10-07T08:45:06.550054+0000","last_peered":"2023-10-07T08:45:06.550054+0000","last_clean":"2023-10-07T08:45:06.550054+0000","last_became_active":"2023-10-07T08:45:06.549788+0000","last_became_peered":"2023-10-07T08:45:06.549788+0000","last_unstale":"2023-10-07T08:45:06.550054+0000","last_undegraded":"2023-10-07T08:45:06.550054+0000","last_fullsized":"2023-10-07T08:45:06.550054+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:29:37.333475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.547296+0000","last_change":"2023-10-07T08:45:06.547188+0000","last_active":"2023-10-07T08:45:06.547296+0000","last_peered":"2023-10-07T08:45:06.547296+0000","last_clean":"2023-10-07T08:45:06.547296+0000","last_became_active":"2023-10-07T08:45:06.546956+0000","last_became_peered":"2023-10-07T08:45:06.546956+0000","last_unstale":"2023-10-07T08:45:06.547296+0000","last_undegraded":"2023-10-07T08:45:06.547296+0000","last_fullsized":"2023-10-07T08:45:06.547296+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:47:54.170016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546329+0000","last_change":"2023-10-07T08:45:06.546254+0000","last_active":"2023-10-07T08:45:06.546329+0000","last_peered":"2023-10-07T08:45:06.546329+0000","last_clean":"2023-10-07T08:45:06.546329+0000","last_became_active":"2023-10-07T08:45:06.546020+0000","last_became_peered":"2023-10-07T08:45:06.546020+0000","last_unstale":"2023-10-07T08:45:06.546329+0000","last_undegraded":"2023-10-07T08:45:06.546329+0000","last_fullsized":"2023-10-07T08:45:06.546329+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:10:47.979612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.542168+0000","last_change":"2023-10-07T08:45:06.542100+0000","last_active":"2023-10-07T08:45:06.542168+0000","last_peered":"2023-10-07T08:45:06.542168+0000","last_clean":"2023-10-07T08:45:06.542168+0000","last_became_active":"2023-10-07T08:45:06.541881+0000","last_became_peered":"2023-10-07T08:45:06.541881+0000","last_unstale":"2023-10-07T08:45:06.542168+0000","last_undegraded":"2023-10-07T08:45:06.542168+0000","last_fullsized":"2023-10-07T08:45:06.542168+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:47:22.329704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.544136+0000","last_change":"2023-10-07T08:45:06.543837+0000","last_active":"2023-10-07T08:45:06.544136+0000","last_peered":"2023-10-07T08:45:06.544136+0000","last_clean":"2023-10-07T08:45:06.544136+0000","last_became_active":"2023-10-07T08:45:06.543607+0000","last_became_peered":"2023-10-07T08:45:06.543607+0000","last_unstale":"2023-10-07T08:45:06.544136+0000","last_undegraded":"2023-10-07T08:45:06.544136+0000","last_fullsized":"2023-10-07T08:45:06.544136+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:50:22.114056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.541241+0000","last_change":"2023-10-07T08:45:06.541151+0000","last_active":"2023-10-07T08:45:06.541241+0000","last_peered":"2023-10-07T08:45:06.541241+0000","last_clean":"2023-10-07T08:45:06.541241+0000","last_became_active":"2023-10-07T08:45:06.540941+0000","last_became_peered":"2023-10-07T08:45:06.540941+0000","last_unstale":"2023-10-07T08:45:06.541241+0000","last_undegraded":"2023-10-07T08:45:06.541241+0000","last_fullsized":"2023-10-07T08:45:06.541241+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:25:29.873983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.545253+0000","last_change":"2023-10-07T08:45:06.543132+0000","last_active":"2023-10-07T08:45:06.545253+0000","last_peered":"2023-10-07T08:45:06.545253+0000","last_clean":"2023-10-07T08:45:06.545253+0000","last_became_active":"2023-10-07T08:45:06.542798+0000","last_became_peered":"2023-10-07T08:45:06.542798+0000","last_unstale":"2023-10-07T08:45:06.545253+0000","last_undegraded":"2023-10-07T08:45:06.545253+0000","last_fullsized":"2023-10-07T08:45:06.545253+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:16:40.079455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546114+0000","last_change":"2023-10-07T08:45:06.546043+0000","last_active":"2023-10-07T08:45:06.546114+0000","last_peered":"2023-10-07T08:45:06.546114+0000","last_clean":"2023-10-07T08:45:06.546114+0000","last_became_active":"2023-10-07T08:45:06.545248+0000","last_became_peered":"2023-10-07T08:45:06.545248+0000","last_unstale":"2023-10-07T08:45:06.546114+0000","last_undegraded":"2023-10-07T08:45:06.546114+0000","last_fullsized":"2023-10-07T08:45:06.546114+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:08.369937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546709+0000","last_change":"2023-10-07T08:45:06.546645+0000","last_active":"2023-10-07T08:45:06.546709+0000","last_peered":"2023-10-07T08:45:06.546709+0000","last_clean":"2023-10-07T08:45:06.546709+0000","last_became_active":"2023-10-07T08:45:06.546412+0000","last_became_peered":"2023-10-07T08:45:06.546412+0000","last_unstale":"2023-10-07T08:45:06.546709+0000","last_undegraded":"2023-10-07T08:45:06.546709+0000","last_fullsized":"2023-10-07T08:45:06.546709+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:46.480903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.542224+0000","last_change":"2023-10-07T08:45:06.542156+0000","last_active":"2023-10-07T08:45:06.542224+0000","last_peered":"2023-10-07T08:45:06.542224+0000","last_clean":"2023-10-07T08:45:06.542224+0000","last_became_active":"2023-10-07T08:45:06.541899+0000","last_became_peered":"2023-10-07T08:45:06.541899+0000","last_unstale":"2023-10-07T08:45:06.542224+0000","last_undegraded":"2023-10-07T08:45:06.542224+0000","last_fullsized":"2023-10-07T08:45:06.542224+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:47:25.249493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.544153+0000","last_change":"2023-10-07T08:45:06.544083+0000","last_active":"2023-10-07T08:45:06.544153+0000","last_peered":"2023-10-07T08:45:06.544153+0000","last_clean":"2023-10-07T08:45:06.544153+0000","last_became_active":"2023-10-07T08:45:06.543860+0000","last_became_peered":"2023-10-07T08:45:06.543860+0000","last_unstale":"2023-10-07T08:45:06.544153+0000","last_undegraded":"2023-10-07T08:45:06.544153+0000","last_fullsized":"2023-10-07T08:45:06.544153+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:25:26.346162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"66'4","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.553723+0000","last_change":"2023-10-07T08:45:05.530642+0000","last_active":"2023-10-07T08:45:06.553723+0000","last_peered":"2023-10-07T08:45:06.553723+0000","last_clean":"2023-10-07T08:45:06.553723+0000","last_became_active":"2023-10-07T08:45:05.530425+0000","last_became_peered":"2023-10-07T08:45:05.530425+0000","last_unstale":"2023-10-07T08:45:06.553723+0000","last_undegraded":"2023-10-07T08:45:06.553723+0000","last_fullsized":"2023-10-07T08:45:06.553723+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:12:46.564106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546539+0000","last_change":"2023-10-07T08:45:06.544664+0000","last_active":"2023-10-07T08:45:06.546539+0000","last_peered":"2023-10-07T08:45:06.546539+0000","last_clean":"2023-10-07T08:45:06.546539+0000","last_became_active":"2023-10-07T08:45:06.544443+0000","last_became_peered":"2023-10-07T08:45:06.544443+0000","last_unstale":"2023-10-07T08:45:06.546539+0000","last_undegraded":"2023-10-07T08:45:06.546539+0000","last_fullsized":"2023-10-07T08:45:06.546539+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:47:31.581339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.554536+0000","last_change":"2023-10-07T08:45:05.524825+0000","last_active":"2023-10-07T08:45:06.554536+0000","last_peered":"2023-10-07T08:45:06.554536+0000","last_clean":"2023-10-07T08:45:06.554536+0000","last_became_active":"2023-10-07T08:45:05.524496+0000","last_became_peered":"2023-10-07T08:45:05.524496+0000","last_unstale":"2023-10-07T08:45:06.554536+0000","last_undegraded":"2023-10-07T08:45:06.554536+0000","last_fullsized":"2023-10-07T08:45:06.554536+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:46:53.601825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.545664+0000","last_change":"2023-10-07T08:45:06.545497+0000","last_active":"2023-10-07T08:45:06.545664+0000","last_peered":"2023-10-07T08:45:06.545664+0000","last_clean":"2023-10-07T08:45:06.545664+0000","last_became_active":"2023-10-07T08:45:06.545260+0000","last_became_peered":"2023-10-07T08:45:06.545260+0000","last_unstale":"2023-10-07T08:45:06.545664+0000","last_undegraded":"2023-10-07T08:45:06.545664+0000","last_fullsized":"2023-10-07T08:45:06.545664+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:38:48.891670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.553469+0000","last_change":"2023-10-07T08:45:05.528198+0000","last_active":"2023-10-07T08:45:06.553469+0000","last_peered":"2023-10-07T08:45:06.553469+0000","last_clean":"2023-10-07T08:45:06.553469+0000","last_became_active":"2023-10-07T08:45:05.527981+0000","last_became_peered":"2023-10-07T08:45:05.527981+0000","last_unstale":"2023-10-07T08:45:06.553469+0000","last_undegraded":"2023-10-07T08:45:06.553469+0000","last_fullsized":"2023-10-07T08:45:06.553469+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:58:31.033406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.541022+0000","last_change":"2023-10-07T08:45:06.540893+0000","last_active":"2023-10-07T08:45:06.541022+0000","last_peered":"2023-10-07T08:45:06.541022+0000","last_clean":"2023-10-07T08:45:06.541022+0000","last_became_active":"2023-10-07T08:45:06.540671+0000","last_became_peered":"2023-10-07T08:45:06.540671+0000","last_unstale":"2023-10-07T08:45:06.541022+0000","last_undegraded":"2023-10-07T08:45:06.541022+0000","last_fullsized":"2023-10-07T08:45:06.541022+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:46:54.608884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.555078+0000","last_change":"2023-10-07T08:45:05.531333+0000","last_active":"2023-10-07T08:45:06.555078+0000","last_peered":"2023-10-07T08:45:06.555078+0000","last_clean":"2023-10-07T08:45:06.555078+0000","last_became_active":"2023-10-07T08:45:05.530971+0000","last_became_peered":"2023-10-07T08:45:05.530971+0000","last_unstale":"2023-10-07T08:45:06.555078+0000","last_undegraded":"2023-10-07T08:45:06.555078+0000","last_fullsized":"2023-10-07T08:45:06.555078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:34.425784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.541295+0000","last_change":"2023-10-07T08:45:06.541181+0000","last_active":"2023-10-07T08:45:06.541295+0000","last_peered":"2023-10-07T08:45:06.541295+0000","last_clean":"2023-10-07T08:45:06.541295+0000","last_became_active":"2023-10-07T08:45:06.540943+0000","last_became_peered":"2023-10-07T08:45:06.540943+0000","last_unstale":"2023-10-07T08:45:06.541295+0000","last_undegraded":"2023-10-07T08:45:06.541295+0000","last_fullsized":"2023-10-07T08:45:06.541295+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:06:16.352096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.551162+0000","last_change":"2023-10-07T08:45:05.522516+0000","last_active":"2023-10-07T08:45:06.551162+0000","last_peered":"2023-10-07T08:45:06.551162+0000","last_clean":"2023-10-07T08:45:06.551162+0000","last_became_active":"2023-10-07T08:45:05.522266+0000","last_became_peered":"2023-10-07T08:45:05.522266+0000","last_unstale":"2023-10-07T08:45:06.551162+0000","last_undegraded":"2023-10-07T08:45:06.551162+0000","last_fullsized":"2023-10-07T08:45:06.551162+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:24.542387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.549225+0000","last_change":"2023-10-07T08:45:06.549094+0000","last_active":"2023-10-07T08:45:06.549225+0000","last_peered":"2023-10-07T08:45:06.549225+0000","last_clean":"2023-10-07T08:45:06.549225+0000","last_became_active":"2023-10-07T08:45:06.546573+0000","last_became_peered":"2023-10-07T08:45:06.546573+0000","last_unstale":"2023-10-07T08:45:06.549225+0000","last_undegraded":"2023-10-07T08:45:06.549225+0000","last_fullsized":"2023-10-07T08:45:06.549225+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:31:25.449505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.554041+0000","last_change":"2023-10-07T08:45:05.531463+0000","last_active":"2023-10-07T08:45:06.554041+0000","last_peered":"2023-10-07T08:45:06.554041+0000","last_clean":"2023-10-07T08:45:06.554041+0000","last_became_active":"2023-10-07T08:45:05.531064+0000","last_became_peered":"2023-10-07T08:45:05.531064+0000","last_unstale":"2023-10-07T08:45:06.554041+0000","last_undegraded":"2023-10-07T08:45:06.554041+0000","last_fullsized":"2023-10-07T08:45:06.554041+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:50.409233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.547555+0000","last_change":"2023-10-07T08:45:06.547506+0000","last_active":"2023-10-07T08:45:06.547555+0000","last_peered":"2023-10-07T08:45:06.547555+0000","last_clean":"2023-10-07T08:45:06.547555+0000","last_became_active":"2023-10-07T08:45:06.547214+0000","last_became_peered":"2023-10-07T08:45:06.547214+0000","last_unstale":"2023-10-07T08:45:06.547555+0000","last_undegraded":"2023-10-07T08:45:06.547555+0000","last_fullsized":"2023-10-07T08:45:06.547555+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:13:00.158680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539451+0000","last_change":"2023-10-07T08:45:05.530586+0000","last_active":"2023-10-07T08:45:06.539451+0000","last_peered":"2023-10-07T08:45:06.539451+0000","last_clean":"2023-10-07T08:45:06.539451+0000","last_became_active":"2023-10-07T08:45:05.530104+0000","last_became_peered":"2023-10-07T08:45:05.530104+0000","last_unstale":"2023-10-07T08:45:06.539451+0000","last_undegraded":"2023-10-07T08:45:06.539451+0000","last_fullsized":"2023-10-07T08:45:06.539451+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:35:59.230954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.545236+0000","last_change":"2023-10-07T08:45:06.543008+0000","last_active":"2023-10-07T08:45:06.545236+0000","last_peered":"2023-10-07T08:45:06.545236+0000","last_clean":"2023-10-07T08:45:06.545236+0000","last_became_active":"2023-10-07T08:45:06.542450+0000","last_became_peered":"2023-10-07T08:45:06.542450+0000","last_unstale":"2023-10-07T08:45:06.545236+0000","last_undegraded":"2023-10-07T08:45:06.545236+0000","last_fullsized":"2023-10-07T08:45:06.545236+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:52:49.828010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.535645+0000","last_change":"2023-10-07T08:45:05.524721+0000","last_active":"2023-10-07T08:45:06.535645+0000","last_peered":"2023-10-07T08:45:06.535645+0000","last_clean":"2023-10-07T08:45:06.535645+0000","last_became_active":"2023-10-07T08:45:05.524415+0000","last_became_peered":"2023-10-07T08:45:05.524415+0000","last_unstale":"2023-10-07T08:45:06.535645+0000","last_undegraded":"2023-10-07T08:45:06.535645+0000","last_fullsized":"2023-10-07T08:45:06.535645+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:33:37.722828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.543195+0000","last_change":"2023-10-07T08:45:06.542785+0000","last_active":"2023-10-07T08:45:06.543195+0000","last_peered":"2023-10-07T08:45:06.543195+0000","last_clean":"2023-10-07T08:45:06.543195+0000","last_became_active":"2023-10-07T08:45:06.542518+0000","last_became_peered":"2023-10-07T08:45:06.542518+0000","last_unstale":"2023-10-07T08:45:06.543195+0000","last_undegraded":"2023-10-07T08:45:06.543195+0000","last_fullsized":"2023-10-07T08:45:06.543195+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:53:36.971647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.541340+0000","last_change":"2023-10-07T08:45:05.530365+0000","last_active":"2023-10-07T08:45:06.541340+0000","last_peered":"2023-10-07T08:45:06.541340+0000","last_clean":"2023-10-07T08:45:06.541340+0000","last_became_active":"2023-10-07T08:45:05.529673+0000","last_became_peered":"2023-10-07T08:45:05.529673+0000","last_unstale":"2023-10-07T08:45:06.541340+0000","last_undegraded":"2023-10-07T08:45:06.541340+0000","last_fullsized":"2023-10-07T08:45:06.541340+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:47:30.574279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.549670+0000","last_change":"2023-10-07T08:45:06.549569+0000","last_active":"2023-10-07T08:45:06.549670+0000","last_peered":"2023-10-07T08:45:06.549670+0000","last_clean":"2023-10-07T08:45:06.549670+0000","last_became_active":"2023-10-07T08:45:06.548769+0000","last_became_peered":"2023-10-07T08:45:06.548769+0000","last_unstale":"2023-10-07T08:45:06.549670+0000","last_undegraded":"2023-10-07T08:45:06.549670+0000","last_fullsized":"2023-10-07T08:45:06.549670+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:46:54.608884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539523+0000","last_change":"2023-10-07T08:45:05.526849+0000","last_active":"2023-10-07T08:45:06.539523+0000","last_peered":"2023-10-07T08:45:06.539523+0000","last_clean":"2023-10-07T08:45:06.539523+0000","last_became_active":"2023-10-07T08:45:05.524275+0000","last_became_peered":"2023-10-07T08:45:05.524275+0000","last_unstale":"2023-10-07T08:45:06.539523+0000","last_undegraded":"2023-10-07T08:45:06.539523+0000","last_fullsized":"2023-10-07T08:45:06.539523+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:35:24.707115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546525+0000","last_change":"2023-10-07T08:45:06.543832+0000","last_active":"2023-10-07T08:45:06.546525+0000","last_peered":"2023-10-07T08:45:06.546525+0000","last_clean":"2023-10-07T08:45:06.546525+0000","last_became_active":"2023-10-07T08:45:06.543395+0000","last_became_peered":"2023-10-07T08:45:06.543395+0000","last_unstale":"2023-10-07T08:45:06.546525+0000","last_undegraded":"2023-10-07T08:45:06.546525+0000","last_fullsized":"2023-10-07T08:45:06.546525+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:08:01.444334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"66'3","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.556049+0000","last_change":"2023-10-07T08:45:05.526977+0000","last_active":"2023-10-07T08:45:06.556049+0000","last_peered":"2023-10-07T08:45:06.556049+0000","last_clean":"2023-10-07T08:45:06.556049+0000","last_became_active":"2023-10-07T08:45:05.526750+0000","last_became_peered":"2023-10-07T08:45:05.526750+0000","last_unstale":"2023-10-07T08:45:06.556049+0000","last_undegraded":"2023-10-07T08:45:06.556049+0000","last_fullsized":"2023-10-07T08:45:06.556049+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:08:00.437274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.544616+0000","last_change":"2023-10-07T08:45:06.544529+0000","last_active":"2023-10-07T08:45:06.544616+0000","last_peered":"2023-10-07T08:45:06.544616+0000","last_clean":"2023-10-07T08:45:06.544616+0000","last_became_active":"2023-10-07T08:45:06.544327+0000","last_became_peered":"2023-10-07T08:45:06.544327+0000","last_unstale":"2023-10-07T08:45:06.544616+0000","last_undegraded":"2023-10-07T08:45:06.544616+0000","last_fullsized":"2023-10-07T08:45:06.544616+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:50:22.114056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"66'6","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.555982+0000","last_change":"2023-10-07T08:45:05.528172+0000","last_active":"2023-10-07T08:45:06.555982+0000","last_peered":"2023-10-07T08:45:06.555982+0000","last_clean":"2023-10-07T08:45:06.555982+0000","last_became_active":"2023-10-07T08:45:05.527935+0000","last_became_peered":"2023-10-07T08:45:05.527935+0000","last_unstale":"2023-10-07T08:45:06.555982+0000","last_undegraded":"2023-10-07T08:45:06.555982+0000","last_fullsized":"2023-10-07T08:45:06.555982+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:10:50.765181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.548468+0000","last_change":"2023-10-07T08:45:06.548405+0000","last_active":"2023-10-07T08:45:06.548468+0000","last_peered":"2023-10-07T08:45:06.548468+0000","last_clean":"2023-10-07T08:45:06.548468+0000","last_became_active":"2023-10-07T08:45:06.548142+0000","last_became_peered":"2023-10-07T08:45:06.548142+0000","last_unstale":"2023-10-07T08:45:06.548468+0000","last_undegraded":"2023-10-07T08:45:06.548468+0000","last_fullsized":"2023-10-07T08:45:06.548468+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:47:25.249493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.553050+0000","last_change":"2023-10-07T08:45:05.530495+0000","last_active":"2023-10-07T08:45:06.553050+0000","last_peered":"2023-10-07T08:45:06.553050+0000","last_clean":"2023-10-07T08:45:06.553050+0000","last_became_active":"2023-10-07T08:45:05.530270+0000","last_became_peered":"2023-10-07T08:45:05.530270+0000","last_unstale":"2023-10-07T08:45:06.553050+0000","last_undegraded":"2023-10-07T08:45:06.553050+0000","last_fullsized":"2023-10-07T08:45:06.553050+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:29:36.326415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546446+0000","last_change":"2023-10-07T08:45:06.546385+0000","last_active":"2023-10-07T08:45:06.546446+0000","last_peered":"2023-10-07T08:45:06.546446+0000","last_clean":"2023-10-07T08:45:06.546446+0000","last_became_active":"2023-10-07T08:45:06.545823+0000","last_became_peered":"2023-10-07T08:45:06.545823+0000","last_unstale":"2023-10-07T08:45:06.546446+0000","last_undegraded":"2023-10-07T08:45:06.546446+0000","last_fullsized":"2023-10-07T08:45:06.546446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:36:04.007944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.538626+0000","last_change":"2023-10-07T08:45:05.531166+0000","last_active":"2023-10-07T08:45:06.538626+0000","last_peered":"2023-10-07T08:45:06.538626+0000","last_clean":"2023-10-07T08:45:06.538626+0000","last_became_active":"2023-10-07T08:45:05.530940+0000","last_became_peered":"2023-10-07T08:45:05.530940+0000","last_unstale":"2023-10-07T08:45:06.538626+0000","last_undegraded":"2023-10-07T08:45:06.538626+0000","last_fullsized":"2023-10-07T08:45:06.538626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:21:38.171224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.544327+0000","last_change":"2023-10-07T08:45:06.544174+0000","last_active":"2023-10-07T08:45:06.544327+0000","last_peered":"2023-10-07T08:45:06.544327+0000","last_clean":"2023-10-07T08:45:06.544327+0000","last_became_active":"2023-10-07T08:45:06.543823+0000","last_became_peered":"2023-10-07T08:45:06.543823+0000","last_unstale":"2023-10-07T08:45:06.544327+0000","last_undegraded":"2023-10-07T08:45:06.544327+0000","last_fullsized":"2023-10-07T08:45:06.544327+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:51.416293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539686+0000","last_change":"2023-10-07T08:45:05.529399+0000","last_active":"2023-10-07T08:45:06.539686+0000","last_peered":"2023-10-07T08:45:06.539686+0000","last_clean":"2023-10-07T08:45:06.539686+0000","last_became_active":"2023-10-07T08:45:05.529122+0000","last_became_peered":"2023-10-07T08:45:05.529122+0000","last_unstale":"2023-10-07T08:45:06.539686+0000","last_undegraded":"2023-10-07T08:45:06.539686+0000","last_fullsized":"2023-10-07T08:45:06.539686+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:58:24.071157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.548993+0000","last_change":"2023-10-07T08:45:06.548906+0000","last_active":"2023-10-07T08:45:06.548993+0000","last_peered":"2023-10-07T08:45:06.548993+0000","last_clean":"2023-10-07T08:45:06.548993+0000","last_became_active":"2023-10-07T08:45:06.548702+0000","last_became_peered":"2023-10-07T08:45:06.548702+0000","last_unstale":"2023-10-07T08:45:06.548993+0000","last_undegraded":"2023-10-07T08:45:06.548993+0000","last_fullsized":"2023-10-07T08:45:06.548993+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:47:22.329704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"66'8","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.555695+0000","last_change":"2023-10-07T08:45:05.532289+0000","last_active":"2023-10-07T08:45:06.555695+0000","last_peered":"2023-10-07T08:45:06.555695+0000","last_clean":"2023-10-07T08:45:06.555695+0000","last_became_active":"2023-10-07T08:45:05.532052+0000","last_became_peered":"2023-10-07T08:45:05.532052+0000","last_unstale":"2023-10-07T08:45:06.555695+0000","last_undegraded":"2023-10-07T08:45:06.555695+0000","last_fullsized":"2023-10-07T08:45:06.555695+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:14:00.400720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546293+0000","last_change":"2023-10-07T08:45:06.546220+0000","last_active":"2023-10-07T08:45:06.546293+0000","last_peered":"2023-10-07T08:45:06.546293+0000","last_clean":"2023-10-07T08:45:06.546293+0000","last_became_active":"2023-10-07T08:45:06.545556+0000","last_became_peered":"2023-10-07T08:45:06.545556+0000","last_unstale":"2023-10-07T08:45:06.546293+0000","last_undegraded":"2023-10-07T08:45:06.546293+0000","last_fullsized":"2023-10-07T08:45:06.546293+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:21:05.216426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.552338+0000","last_change":"2023-10-07T08:45:05.524699+0000","last_active":"2023-10-07T08:45:06.552338+0000","last_peered":"2023-10-07T08:45:06.552338+0000","last_clean":"2023-10-07T08:45:06.552338+0000","last_became_active":"2023-10-07T08:45:05.524212+0000","last_became_peered":"2023-10-07T08:45:05.524212+0000","last_unstale":"2023-10-07T08:45:06.552338+0000","last_undegraded":"2023-10-07T08:45:06.552338+0000","last_fullsized":"2023-10-07T08:45:06.552338+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:11:41.940876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.543063+0000","last_change":"2023-10-07T08:45:06.543007+0000","last_active":"2023-10-07T08:45:06.543063+0000","last_peered":"2023-10-07T08:45:06.543063+0000","last_clean":"2023-10-07T08:45:06.543063+0000","last_became_active":"2023-10-07T08:45:06.542802+0000","last_became_peered":"2023-10-07T08:45:06.542802+0000","last_unstale":"2023-10-07T08:45:06.543063+0000","last_undegraded":"2023-10-07T08:45:06.543063+0000","last_fullsized":"2023-10-07T08:45:06.543063+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:36:04.007944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.552397+0000","last_change":"2023-10-07T08:45:05.527757+0000","last_active":"2023-10-07T08:45:06.552397+0000","last_peered":"2023-10-07T08:45:06.552397+0000","last_clean":"2023-10-07T08:45:06.552397+0000","last_became_active":"2023-10-07T08:45:05.527532+0000","last_became_peered":"2023-10-07T08:45:05.527532+0000","last_unstale":"2023-10-07T08:45:06.552397+0000","last_undegraded":"2023-10-07T08:45:06.552397+0000","last_fullsized":"2023-10-07T08:45:06.552397+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:08:00.437274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.549075+0000","last_change":"2023-10-07T08:45:06.548958+0000","last_active":"2023-10-07T08:45:06.549075+0000","last_peered":"2023-10-07T08:45:06.549075+0000","last_clean":"2023-10-07T08:45:06.549075+0000","last_became_active":"2023-10-07T08:45:06.546215+0000","last_became_peered":"2023-10-07T08:45:06.546215+0000","last_unstale":"2023-10-07T08:45:06.549075+0000","last_undegraded":"2023-10-07T08:45:06.549075+0000","last_fullsized":"2023-10-07T08:45:06.549075+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:43.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.555529+0000","last_change":"2023-10-07T08:45:05.531192+0000","last_active":"2023-10-07T08:45:06.555529+0000","last_peered":"2023-10-07T08:45:06.555529+0000","last_clean":"2023-10-07T08:45:06.555529+0000","last_became_active":"2023-10-07T08:45:05.530661+0000","last_became_peered":"2023-10-07T08:45:05.530661+0000","last_unstale":"2023-10-07T08:45:06.555529+0000","last_undegraded":"2023-10-07T08:45:06.555529+0000","last_fullsized":"2023-10-07T08:45:06.555529+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:17:21.973572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.549815+0000","last_change":"2023-10-07T08:45:06.549759+0000","last_active":"2023-10-07T08:45:06.549815+0000","last_peered":"2023-10-07T08:45:06.549815+0000","last_clean":"2023-10-07T08:45:06.549815+0000","last_became_active":"2023-10-07T08:45:06.549066+0000","last_became_peered":"2023-10-07T08:45:06.549066+0000","last_unstale":"2023-10-07T08:45:06.549815+0000","last_undegraded":"2023-10-07T08:45:06.549815+0000","last_fullsized":"2023-10-07T08:45:06.549815+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:11:42.947936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.534358+0000","last_change":"2023-10-07T08:45:05.531672+0000","last_active":"2023-10-07T08:45:06.534358+0000","last_peered":"2023-10-07T08:45:06.534358+0000","last_clean":"2023-10-07T08:45:06.534358+0000","last_became_active":"2023-10-07T08:45:05.531028+0000","last_became_peered":"2023-10-07T08:45:05.531028+0000","last_unstale":"2023-10-07T08:45:06.534358+0000","last_undegraded":"2023-10-07T08:45:06.534358+0000","last_fullsized":"2023-10-07T08:45:06.534358+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:53:35.964587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.548129+0000","last_change":"2023-10-07T08:45:06.548068+0000","last_active":"2023-10-07T08:45:06.548129+0000","last_peered":"2023-10-07T08:45:06.548129+0000","last_clean":"2023-10-07T08:45:06.548129+0000","last_became_active":"2023-10-07T08:45:06.547853+0000","last_became_peered":"2023-10-07T08:45:06.547853+0000","last_unstale":"2023-10-07T08:45:06.548129+0000","last_undegraded":"2023-10-07T08:45:06.548129+0000","last_fullsized":"2023-10-07T08:45:06.548129+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:08.369937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.553480+0000","last_change":"2023-10-07T08:45:05.525325+0000","last_active":"2023-10-07T08:45:06.553480+0000","last_peered":"2023-10-07T08:45:06.553480+0000","last_clean":"2023-10-07T08:45:06.553480+0000","last_became_active":"2023-10-07T08:45:05.525141+0000","last_became_peered":"2023-10-07T08:45:05.525141+0000","last_unstale":"2023-10-07T08:45:06.553480+0000","last_undegraded":"2023-10-07T08:45:06.553480+0000","last_fullsized":"2023-10-07T08:45:06.553480+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:34.425784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.545681+0000","last_change":"2023-10-07T08:45:06.545549+0000","last_active":"2023-10-07T08:45:06.545681+0000","last_peered":"2023-10-07T08:45:06.545681+0000","last_clean":"2023-10-07T08:45:06.545681+0000","last_became_active":"2023-10-07T08:45:06.544891+0000","last_became_peered":"2023-10-07T08:45:06.544891+0000","last_unstale":"2023-10-07T08:45:06.545681+0000","last_undegraded":"2023-10-07T08:45:06.545681+0000","last_fullsized":"2023-10-07T08:45:06.545681+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:47:22.329704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539416+0000","last_change":"2023-10-07T08:45:05.523780+0000","last_active":"2023-10-07T08:45:06.539416+0000","last_peered":"2023-10-07T08:45:06.539416+0000","last_clean":"2023-10-07T08:45:06.539416+0000","last_became_active":"2023-10-07T08:45:05.523566+0000","last_became_peered":"2023-10-07T08:45:05.523566+0000","last_unstale":"2023-10-07T08:45:06.539416+0000","last_undegraded":"2023-10-07T08:45:06.539416+0000","last_fullsized":"2023-10-07T08:45:06.539416+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:53:10.226534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.544108+0000","last_change":"2023-10-07T08:45:06.543595+0000","last_active":"2023-10-07T08:45:06.544108+0000","last_peered":"2023-10-07T08:45:06.544108+0000","last_clean":"2023-10-07T08:45:06.544108+0000","last_became_active":"2023-10-07T08:45:06.543361+0000","last_became_peered":"2023-10-07T08:45:06.543361+0000","last_unstale":"2023-10-07T08:45:06.544108+0000","last_undegraded":"2023-10-07T08:45:06.544108+0000","last_fullsized":"2023-10-07T08:45:06.544108+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:21:05.216426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539331+0000","last_change":"2023-10-07T08:45:05.528138+0000","last_active":"2023-10-07T08:45:06.539331+0000","last_peered":"2023-10-07T08:45:06.539331+0000","last_clean":"2023-10-07T08:45:06.539331+0000","last_became_active":"2023-10-07T08:45:05.527841+0000","last_became_peered":"2023-10-07T08:45:05.527841+0000","last_unstale":"2023-10-07T08:45:06.539331+0000","last_undegraded":"2023-10-07T08:45:06.539331+0000","last_fullsized":"2023-10-07T08:45:06.539331+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:43:47.298555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546773+0000","last_change":"2023-10-07T08:45:06.546705+0000","last_active":"2023-10-07T08:45:06.546773+0000","last_peered":"2023-10-07T08:45:06.546773+0000","last_clean":"2023-10-07T08:45:06.546773+0000","last_became_active":"2023-10-07T08:45:06.546420+0000","last_became_peered":"2023-10-07T08:45:06.546420+0000","last_unstale":"2023-10-07T08:45:06.546773+0000","last_undegraded":"2023-10-07T08:45:06.546773+0000","last_fullsized":"2023-10-07T08:45:06.546773+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:16:18.934820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.554314+0000","last_change":"2023-10-07T08:45:05.523809+0000","last_active":"2023-10-07T08:45:06.554314+0000","last_peered":"2023-10-07T08:45:06.554314+0000","last_clean":"2023-10-07T08:45:06.554314+0000","last_became_active":"2023-10-07T08:45:05.523598+0000","last_became_peered":"2023-10-07T08:45:05.523598+0000","last_unstale":"2023-10-07T08:45:06.554314+0000","last_undegraded":"2023-10-07T08:45:06.554314+0000","last_fullsized":"2023-10-07T08:45:06.554314+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:05:53.564262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546272+0000","last_change":"2023-10-07T08:45:06.546056+0000","last_active":"2023-10-07T08:45:06.546272+0000","last_peered":"2023-10-07T08:45:06.546272+0000","last_clean":"2023-10-07T08:45:06.546272+0000","last_became_active":"2023-10-07T08:45:06.545475+0000","last_became_peered":"2023-10-07T08:45:06.545475+0000","last_unstale":"2023-10-07T08:45:06.546272+0000","last_undegraded":"2023-10-07T08:45:06.546272+0000","last_fullsized":"2023-10-07T08:45:06.546272+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:39:27.745793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.534629+0000","last_change":"2023-10-07T08:45:05.531582+0000","last_active":"2023-10-07T08:45:06.534629+0000","last_peered":"2023-10-07T08:45:06.534629+0000","last_clean":"2023-10-07T08:45:06.534629+0000","last_became_active":"2023-10-07T08:45:05.531287+0000","last_became_peered":"2023-10-07T08:45:05.531287+0000","last_unstale":"2023-10-07T08:45:06.534629+0000","last_undegraded":"2023-10-07T08:45:06.534629+0000","last_fullsized":"2023-10-07T08:45:06.534629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:15.336268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546555+0000","last_change":"2023-10-07T08:45:06.545800+0000","last_active":"2023-10-07T08:45:06.546555+0000","last_peered":"2023-10-07T08:45:06.546555+0000","last_clean":"2023-10-07T08:45:06.546555+0000","last_became_active":"2023-10-07T08:45:06.545256+0000","last_became_peered":"2023-10-07T08:45:06.545256+0000","last_unstale":"2023-10-07T08:45:06.546555+0000","last_undegraded":"2023-10-07T08:45:06.546555+0000","last_fullsized":"2023-10-07T08:45:06.546555+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:27:37.086711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539313+0000","last_change":"2023-10-07T08:45:05.528402+0000","last_active":"2023-10-07T08:45:06.539313+0000","last_peered":"2023-10-07T08:45:06.539313+0000","last_clean":"2023-10-07T08:45:06.539313+0000","last_became_active":"2023-10-07T08:45:05.528166+0000","last_became_peered":"2023-10-07T08:45:05.528166+0000","last_unstale":"2023-10-07T08:45:06.539313+0000","last_undegraded":"2023-10-07T08:45:06.539313+0000","last_fullsized":"2023-10-07T08:45:06.539313+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:41:05.626092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.541934+0000","last_change":"2023-10-07T08:45:06.541583+0000","last_active":"2023-10-07T08:45:06.541934+0000","last_peered":"2023-10-07T08:45:06.541934+0000","last_clean":"2023-10-07T08:45:06.541934+0000","last_became_active":"2023-10-07T08:45:06.541361+0000","last_became_peered":"2023-10-07T08:45:06.541361+0000","last_unstale":"2023-10-07T08:45:06.541934+0000","last_undegraded":"2023-10-07T08:45:06.541934+0000","last_fullsized":"2023-10-07T08:45:06.541934+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:08.369937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539197+0000","last_change":"2023-10-07T08:45:05.529099+0000","last_active":"2023-10-07T08:45:06.539197+0000","last_peered":"2023-10-07T08:45:06.539197+0000","last_clean":"2023-10-07T08:45:06.539197+0000","last_became_active":"2023-10-07T08:45:05.528819+0000","last_became_peered":"2023-10-07T08:45:05.528819+0000","last_unstale":"2023-10-07T08:45:06.539197+0000","last_undegraded":"2023-10-07T08:45:06.539197+0000","last_fullsized":"2023-10-07T08:45:06.539197+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:06.964256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.549319+0000","last_change":"2023-10-07T08:45:06.549265+0000","last_active":"2023-10-07T08:45:06.549319+0000","last_peered":"2023-10-07T08:45:06.549319+0000","last_clean":"2023-10-07T08:45:06.549319+0000","last_became_active":"2023-10-07T08:45:06.546983+0000","last_became_peered":"2023-10-07T08:45:06.546983+0000","last_unstale":"2023-10-07T08:45:06.549319+0000","last_undegraded":"2023-10-07T08:45:06.549319+0000","last_fullsized":"2023-10-07T08:45:06.549319+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:07.708034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539730+0000","last_change":"2023-10-07T08:45:05.529386+0000","last_active":"2023-10-07T08:45:06.539730+0000","last_peered":"2023-10-07T08:45:06.539730+0000","last_clean":"2023-10-07T08:45:06.539730+0000","last_became_active":"2023-10-07T08:45:05.529242+0000","last_became_peered":"2023-10-07T08:45:05.529242+0000","last_unstale":"2023-10-07T08:45:06.539730+0000","last_undegraded":"2023-10-07T08:45:06.539730+0000","last_fullsized":"2023-10-07T08:45:06.539730+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:23:36.246557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.549947+0000","last_change":"2023-10-07T08:45:06.549906+0000","last_active":"2023-10-07T08:45:06.549947+0000","last_peered":"2023-10-07T08:45:06.549947+0000","last_clean":"2023-10-07T08:45:06.549947+0000","last_became_active":"2023-10-07T08:45:06.549406+0000","last_became_peered":"2023-10-07T08:45:06.549406+0000","last_unstale":"2023-10-07T08:45:06.549947+0000","last_undegraded":"2023-10-07T08:45:06.549947+0000","last_fullsized":"2023-10-07T08:45:06.549947+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:32:32.002898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.535601+0000","last_change":"2023-10-07T08:45:05.528780+0000","last_active":"2023-10-07T08:45:06.535601+0000","last_peered":"2023-10-07T08:45:06.535601+0000","last_clean":"2023-10-07T08:45:06.535601+0000","last_became_active":"2023-10-07T08:45:05.528536+0000","last_became_peered":"2023-10-07T08:45:05.528536+0000","last_unstale":"2023-10-07T08:45:06.535601+0000","last_undegraded":"2023-10-07T08:45:06.535601+0000","last_fullsized":"2023-10-07T08:45:06.535601+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:55:42.171101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.546508+0000","last_change":"2023-10-07T08:45:06.543599+0000","last_active":"2023-10-07T08:45:06.546508+0000","last_peered":"2023-10-07T08:45:06.546508+0000","last_clean":"2023-10-07T08:45:06.546508+0000","last_became_active":"2023-10-07T08:45:06.543077+0000","last_became_peered":"2023-10-07T08:45:06.543077+0000","last_unstale":"2023-10-07T08:45:06.546508+0000","last_undegraded":"2023-10-07T08:45:06.546508+0000","last_fullsized":"2023-10-07T08:45:06.546508+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:53:36.971647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.538506+0000","last_change":"2023-10-07T08:45:05.527602+0000","last_active":"2023-10-07T08:45:06.538506+0000","last_peered":"2023-10-07T08:45:06.538506+0000","last_clean":"2023-10-07T08:45:06.538506+0000","last_became_active":"2023-10-07T08:45:05.527362+0000","last_became_peered":"2023-10-07T08:45:05.527362+0000","last_unstale":"2023-10-07T08:45:06.538506+0000","last_undegraded":"2023-10-07T08:45:06.538506+0000","last_fullsized":"2023-10-07T08:45:06.538506+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:05:49.289900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.545218+0000","last_change":"2023-10-07T08:45:06.542321+0000","last_active":"2023-10-07T08:45:06.545218+0000","last_peered":"2023-10-07T08:45:06.545218+0000","last_clean":"2023-10-07T08:45:06.545218+0000","last_became_active":"2023-10-07T08:45:06.542105+0000","last_became_peered":"2023-10-07T08:45:06.542105+0000","last_unstale":"2023-10-07T08:45:06.545218+0000","last_undegraded":"2023-10-07T08:45:06.545218+0000","last_fullsized":"2023-10-07T08:45:06.545218+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:50:25.266040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.538611+0000","last_change":"2023-10-07T08:45:05.530829+0000","last_active":"2023-10-07T08:45:06.538611+0000","last_peered":"2023-10-07T08:45:06.538611+0000","last_clean":"2023-10-07T08:45:06.538611+0000","last_became_active":"2023-10-07T08:45:05.530599+0000","last_became_peered":"2023-10-07T08:45:05.530599+0000","last_unstale":"2023-10-07T08:45:06.538611+0000","last_undegraded":"2023-10-07T08:45:06.538611+0000","last_fullsized":"2023-10-07T08:45:06.538611+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:32:30.995838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.545183+0000","last_change":"2023-10-07T08:45:06.541301+0000","last_active":"2023-10-07T08:45:06.545183+0000","last_peered":"2023-10-07T08:45:06.545183+0000","last_clean":"2023-10-07T08:45:06.545183+0000","last_became_active":"2023-10-07T08:45:06.540801+0000","last_became_peered":"2023-10-07T08:45:06.540801+0000","last_unstale":"2023-10-07T08:45:06.545183+0000","last_undegraded":"2023-10-07T08:45:06.545183+0000","last_fullsized":"2023-10-07T08:45:06.545183+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:05.516359+0000","last_clean_scrub_stamp":"2023-10-07T08:45:05.516359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:25:08.824796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.539146+0000","last_change":"2023-10-07T08:45:05.528293+0000","last_active":"2023-10-07T08:45:06.539146+0000","last_peered":"2023-10-07T08:45:06.539146+0000","last_clean":"2023-10-07T08:45:06.539146+0000","last_became_active":"2023-10-07T08:45:05.528049+0000","last_became_peered":"2023-10-07T08:45:05.528049+0000","last_unstale":"2023-10-07T08:45:06.539146+0000","last_undegraded":"2023-10-07T08:45:06.539146+0000","last_fullsized":"2023-10-07T08:45:06.539146+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:45:04.509300+0000","last_clean_scrub_stamp":"2023-10-07T08:45:04.509300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:48:24.909450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-07T08:45:06.538595+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:45:06.538595+0000","last_peered":"2023-10-07T08:45:06.538595+0000","last_clean":"2023-10-07T08:45:06.538595+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:45:06.538595+0000","last_undegraded":"2023-10-07T08:45:06.538595+0000","last_fullsized":"2023-10-07T08:45:06.538595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":911,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199066150,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.496,"15min":0.49299999999999999},"min":{"1min":0.36199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68000000000000005,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.374,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.38100000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.38100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.73099999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.50800000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.52200000000000002},"min":{"1min":0.40699999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71799999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.40500000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.34300000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.82799999999999996,"15min":0.873},"min":{"1min":0.39700000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75900000000000001,"5min":6.8570000000000002,"15min":6.8570000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.67500000000000004,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.47599999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.314,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64700000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.53800000000000003,"15min":0.54500000000000004},"min":{"1min":0.32500000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.53400000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.505,"15min":0.51100000000000001},"min":{"1min":0.308,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.65000000000000002,"5min":0.746,"15min":0.746},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.35199999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73699999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.57299999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.40500000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70999999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.49299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":335,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194977,"statfs":{"total":200000000,"available":199656678,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.46200000000000002},"min":{"1min":0.29399999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48099999999999998,"15min":0.48299999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.38300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.497},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.52200000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.313,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.40000000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.502,"15min":0.502},"min":{"1min":0.39200000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.54300000000000004,"15min":0.52300000000000002},"min":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.56499999999999995}]},{"osd":4,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47799999999999998},"min":{"1min":0.34599999999999997,"5min":0.309,"15min":0.309},"max":{"1min":0.64300000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.32600000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.501,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.40000000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.34499999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:44:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72599999999999998,"5min":0.754,"15min":0.754},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.44,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.38100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":335,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194977,"statfs":{"total":200000000,"available":199656588,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.29799999999999999,"15min":0.29599999999999999},"min":{"1min":0.20599999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.45700000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.32000000000000001,"15min":0.316},"min":{"1min":0.222,"5min":0.192,"15min":0.192},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.41399999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.30399999999999999,"15min":0.30199999999999999},"min":{"1min":0.22700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.441,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.375,"5min":0.31900000000000001,"15min":0.309},"min":{"1min":0.26200000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.375}]},{"osd":3,"last update":"Sat Oct 7 08:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.34699999999999998,"15min":0.34100000000000003},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.31},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.33200000000000002},"min":{"1min":0.28000000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.48999999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76500000000000001,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.50900000000000001,"15min":0.504},"min":{"1min":0.30099999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40600000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.44800000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.745,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51300000000000001,"15min":0.50700000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.38500000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77800000000000002,"5min":1.04,"15min":1.04},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.74299999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.50600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":913,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194398,"statfs":{"total":200000000,"available":199064220,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.37,"15min":0.38},"min":{"1min":0.215,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.48599999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.39500000000000002,"15min":0.40100000000000002},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.441,"5min":1.079,"15min":1.079},"last":0.25800000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.26500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.46800000000000003,"5min":1.464,"15min":1.464},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.27000000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51200000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.33400000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38700000000000001,"15min":0.39100000000000001},"min":{"1min":0.28499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.45200000000000001,"5min":1.341,"15min":1.341},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.435,"15min":0.44},"min":{"1min":0.31,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58599999999999997,"5min":1.532,"15min":1.532},"last":0.30499999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76300000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":1.51,"15min":1.51},"last":0.42099999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59699999999999998,"15min":0.59999999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.78400000000000003,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.497},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76300000000000001,"5min":1.25,"15min":1.25},"last":0.39900000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.71399999999999997,"5min":1.488,"15min":1.488},"last":0.44},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.45700000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.74099999999999999,"5min":1.024,"15min":1.024},"last":0.53300000000000003}]},{"osd":7,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.436,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76400000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.70199999999999996,"5min":1.288,"15min":1.288},"last":0.50900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":335,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194977,"statfs":{"total":200000000,"available":199656622,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34399999999999997,"15min":0.34799999999999998},"min":{"1min":0.215,"5min":0.187,"15min":0.187},"max":{"1min":0.441,"5min":1.665,"15min":1.665},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.36099999999999999,"15min":0.36399999999999999},"min":{"1min":0.22800000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47599999999999998,"5min":1.579,"15min":1.579},"last":0.32500000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.375,"15min":0.378},"min":{"1min":0.223,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.73299999999999998,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.251},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41999999999999998,"15min":0.42599999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.71199999999999997,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.37}]},{"osd":3,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38500000000000001,"15min":0.39100000000000001},"min":{"1min":0.26200000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.60199999999999998,"5min":1.454,"15min":1.454},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38600000000000001,"15min":0.39100000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.53500000000000003,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68799999999999994,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.76900000000000002,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.51900000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76400000000000001,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.44700000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78700000000000003,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.44,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71499999999999997,"5min":1.637,"15min":1.637},"last":0.46400000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:44:46 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81499999999999995,"5min":1.49,"15min":1.49},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.40400000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84299999999999997,"5min":1.375,"15min":1.375},"last":0.42699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":335,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194977,"statfs":{"total":200000000,"available":199656622,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.318,"15min":0.318},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.315,"15min":0.31},"min":{"1min":0.26300000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.35199999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39000000000000001,"15min":0.38900000000000001},"min":{"1min":0.253,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.65200000000000002,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.374,"15min":0.374},"min":{"1min":0.27600000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59799999999999998,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.50700000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.49299999999999999,"15min":0.48499999999999999},"min":{"1min":0.35399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52300000000000002,"15min":0.51800000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.624}]},{"osd":5,"last update":"Sat Oct 7 08:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.60199999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.55200000000000005,"15min":0.54200000000000004},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.442,"5min":0.433,"15min":0.433},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.66800000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:44:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.74199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":336,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194975,"statfs":{"total":200000000,"available":199655142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:44:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.496,"15min":0.495},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.66500000000000004}]},{"osd":1,"last update":"Sat Oct 7 08:44:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.49099999999999999,"15min":0.48699999999999999},"min":{"1min":0.30199999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.76300000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:44:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.499,"15min":0.495},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:44:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.74399999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:44:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.45400000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.29499999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:44:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.57299999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:44:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.33500000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.42299999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":335,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194976,"statfs":{"total":200000000,"available":199656054,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.505,"15min":0.504},"min":{"1min":0.34399999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72399999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.39200000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.37},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69399999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Oct 7 08:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69699999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.435},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.32700000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Oct 7 08:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73699999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48199999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47599999999999998,"15min":0.47799999999999998},"min":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69199999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76100000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.32600000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.71099999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73499999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59999999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72299999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73999999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64800000000000002}]}]}],"pool_statfs":[]}} 2023-10-07T08:45:10.950 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T08:45:10.950 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T08:45:11.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.105+0000 7fd937095700 1 Processor -- start 2023-10-07T08:45:11.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.105+0000 7fd937095700 1 -- start start 2023-10-07T08:45:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.106+0000 7fd937095700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd9301577c0 0x7fd930068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.106+0000 7fd937095700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd9300cbea0 0x7fd930068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.106+0000 7fd937095700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9300cca80 con 0x7fd930157b90 2023-10-07T08:45:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.106+0000 7fd937095700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9300cc2e0 con 0x7fd9300cbea0 2023-10-07T08:45:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.106+0000 7fd937095700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9300cedd0 con 0x7fd9301577c0 2023-10-07T08:45:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.106+0000 7fd935632700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd9300cbea0 0x7fd930068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.106+0000 7fd927fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd930157b90 0x7fd9300cb790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37904/0 (socket says 172.21.15.81:37904) 2023-10-07T08:45:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.106+0000 7fd927fff700 1 -- 172.21.15.81:0/2243302260 learned_addr learned my addr 172.21.15.81:0/2243302260 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:45:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.106+0000 7fd934e31700 1 --2- 172.21.15.81:0/2243302260 >> v2:172.21.15.89:3300/0 conn(0x7fd9301577c0 0x7fd930068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.106+0000 7fd9277fe700 1 -- 172.21.15.81:0/2243302260 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014272369 0 0) 0x7fd9300cca80 con 0x7fd930157b90 2023-10-07T08:45:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.107+0000 7fd9277fe700 1 -- 172.21.15.81:0/2243302260 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd918003570 con 0x7fd930157b90 2023-10-07T08:45:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.107+0000 7fd935632700 1 -- 172.21.15.81:0/2243302260 >> v2:172.21.15.89:3300/0 conn(0x7fd9301577c0 msgr2=0x7fd930068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.107+0000 7fd935632700 1 --2- 172.21.15.81:0/2243302260 >> v2:172.21.15.89:3300/0 conn(0x7fd9301577c0 0x7fd930068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.107+0000 7fd935632700 1 -- 172.21.15.81:0/2243302260 >> v1:172.21.15.81:6789/0 conn(0x7fd930157b90 legacy=0x7fd9300cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.107+0000 7fd935632700 1 -- 172.21.15.81:0/2243302260 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9300cc4c0 con 0x7fd9300cbea0 2023-10-07T08:45:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.107+0000 7fd935632700 1 --2- 172.21.15.81:0/2243302260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9300cbea0 0x7fd930068d50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd930068220 tx=0x7fd928009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429fe0c1923b475f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.107+0000 7fd9277fe700 1 -- 172.21.15.81:0/2243302260 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92800e070 con 0x7fd9300cbea0 2023-10-07T08:45:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.107+0000 7fd9277fe700 1 -- 172.21.15.81:0/2243302260 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92800bab0 con 0x7fd9300cbea0 2023-10-07T08:45:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.107+0000 7fd9277fe700 1 -- 172.21.15.81:0/2243302260 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92800be70 con 0x7fd9300cbea0 2023-10-07T08:45:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.107+0000 7fd937095700 1 -- 172.21.15.81:0/2243302260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9300cbea0 msgr2=0x7fd930068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.107+0000 7fd937095700 1 --2- 172.21.15.81:0/2243302260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9300cbea0 0x7fd930068d50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd930068220 tx=0x7fd928009780 comp rx=0 tx=0).stop 2023-10-07T08:45:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.107+0000 7fd937095700 1 -- 172.21.15.81:0/2243302260 shutdown_connections 2023-10-07T08:45:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.107+0000 7fd937095700 1 --2- 172.21.15.81:0/2243302260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9300cbea0 0x7fd930068d50 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.107+0000 7fd937095700 1 --2- 172.21.15.81:0/2243302260 >> v2:172.21.15.89:3300/0 conn(0x7fd9301577c0 0x7fd930068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.107+0000 7fd937095700 1 -- 172.21.15.81:0/2243302260 >> 172.21.15.81:0/2243302260 conn(0x7fd9300d0df0 msgr2=0x7fd9300d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.107+0000 7fd937095700 1 -- 172.21.15.81:0/2243302260 shutdown_connections 2023-10-07T08:45:11.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.108+0000 7fd937095700 1 -- 172.21.15.81:0/2243302260 wait complete. 2023-10-07T08:45:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.109+0000 7fd937095700 1 Processor -- start 2023-10-07T08:45:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.109+0000 7fd937095700 1 -- start start 2023-10-07T08:45:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.109+0000 7fd937095700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9300cbea0 0x7fd930150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.109+0000 7fd937095700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9301577c0 0x7fd9300b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.109+0000 7fd937095700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd930157b90 0x7fd930155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.109+0000 7fd937095700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93015fbf0 con 0x7fd9300cbea0 2023-10-07T08:45:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.109+0000 7fd937095700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93015efe0 con 0x7fd9301577c0 2023-10-07T08:45:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.109+0000 7fd937095700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93015f2c0 con 0x7fd930157b90 2023-10-07T08:45:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.110+0000 7fd934e31700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9300cbea0 0x7fd930150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.110+0000 7fd934e31700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9300cbea0 0x7fd930150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52460/0 (socket says 172.21.15.81:52460) 2023-10-07T08:45:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.110+0000 7fd934e31700 1 -- 172.21.15.81:0/2611693915 learned_addr learned my addr 172.21.15.81:0/2611693915 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.110+0000 7fd934e31700 1 -- 172.21.15.81:0/2611693915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd930157b90 msgr2=0x7fd930155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.110+0000 7fd934e31700 1 --2- 172.21.15.81:0/2611693915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd930157b90 0x7fd930155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.110+0000 7fd934e31700 1 -- 172.21.15.81:0/2611693915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9301577c0 msgr2=0x7fd9300b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.110+0000 7fd934e31700 1 --2- 172.21.15.81:0/2611693915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9301577c0 0x7fd9300b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.110+0000 7fd934e31700 1 -- 172.21.15.81:0/2611693915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928009a20 con 0x7fd9300cbea0 2023-10-07T08:45:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.110+0000 7fd934e31700 1 --2- 172.21.15.81:0/2611693915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9300cbea0 0x7fd930150980 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00ec80 tx=0x7fd92c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.110+0000 7fd924ff9700 1 -- 172.21.15.81:0/2611693915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c00c9d0 con 0x7fd9300cbea0 2023-10-07T08:45:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.110+0000 7fd924ff9700 1 -- 172.21.15.81:0/2611693915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c00cb30 con 0x7fd9300cbea0 2023-10-07T08:45:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.110+0000 7fd937095700 1 -- 172.21.15.81:0/2611693915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd93015f5a0 con 0x7fd9300cbea0 2023-10-07T08:45:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.110+0000 7fd924ff9700 1 -- 172.21.15.81:0/2611693915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c013470 con 0x7fd9300cbea0 2023-10-07T08:45:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.110+0000 7fd937095700 1 -- 172.21.15.81:0/2611693915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93015ec90 con 0x7fd9300cbea0 2023-10-07T08:45:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.111+0000 7fd937095700 1 -- 172.21.15.81:0/2611693915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd930067a50 con 0x7fd9300cbea0 2023-10-07T08:45:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.112+0000 7fd924ff9700 1 -- 172.21.15.81:0/2611693915 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd92c013820 con 0x7fd9300cbea0 2023-10-07T08:45:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.112+0000 7fd924ff9700 1 --2- 172.21.15.81:0/2611693915 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd91c066f30 0x7fd91c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.112+0000 7fd927fff700 1 --2- 172.21.15.81:0/2611693915 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd91c066f30 0x7fd91c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.112+0000 7fd924ff9700 1 -- 172.21.15.81:0/2611693915 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd92c0848c0 con 0x7fd9300cbea0 2023-10-07T08:45:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.112+0000 7fd927fff700 1 --2- 172.21.15.81:0/2611693915 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd91c066f30 0x7fd91c0693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd9200058d0 tx=0x7fd9200079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.116+0000 7fd924ff9700 1 -- 172.21.15.81:0/2611693915 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd92c051b30 con 0x7fd9300cbea0 2023-10-07T08:45:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.373+0000 7fd937095700 1 -- 172.21.15.81:0/2611693915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd9300cc7a0 con 0x7fd9300cbea0 2023-10-07T08:45:11.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.376+0000 7fd924ff9700 1 -- 172.21.15.81:0/2611693915 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd92c055150 con 0x7fd9300cbea0 2023-10-07T08:45:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.378+0000 7fd937095700 1 -- 172.21.15.81:0/2611693915 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd91c066f30 msgr2=0x7fd91c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.378+0000 7fd937095700 1 --2- 172.21.15.81:0/2611693915 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd91c066f30 0x7fd91c0693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd9200058d0 tx=0x7fd9200079d0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.378+0000 7fd937095700 1 -- 172.21.15.81:0/2611693915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9300cbea0 msgr2=0x7fd930150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.378+0000 7fd937095700 1 --2- 172.21.15.81:0/2611693915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9300cbea0 0x7fd930150980 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00ec80 tx=0x7fd92c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.378+0000 7fd937095700 1 -- 172.21.15.81:0/2611693915 shutdown_connections 2023-10-07T08:45:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.378+0000 7fd937095700 1 --2- 172.21.15.81:0/2611693915 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd91c066f30 0x7fd91c0693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.378+0000 7fd937095700 1 --2- 172.21.15.81:0/2611693915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd930157b90 0x7fd930155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.378+0000 7fd937095700 1 --2- 172.21.15.81:0/2611693915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9300cbea0 0x7fd930150980 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.378+0000 7fd937095700 1 --2- 172.21.15.81:0/2611693915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9301577c0 0x7fd9300b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.378+0000 7fd937095700 1 -- 172.21.15.81:0/2611693915 >> 172.21.15.81:0/2611693915 conn(0x7fd9300d0df0 msgr2=0x7fd9300c72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.379+0000 7fd937095700 1 -- 172.21.15.81:0/2611693915 shutdown_connections 2023-10-07T08:45:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.379+0000 7fd937095700 1 -- 172.21.15.81:0/2611693915 wait complete. 2023-10-07T08:45:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-07T08:45:11.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:45:11.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.504+0000 7f481bad9700 1 Processor -- start 2023-10-07T08:45:11.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.504+0000 7f481bad9700 1 -- start start 2023-10-07T08:45:11.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.505+0000 7f481bad9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f48141578d0 0x7f48140cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:11.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.505+0000 7f481bad9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4814157ca0 0x7f481415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:11.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.505+0000 7f481bad9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48140d07c0 con 0x7f481406d120 2023-10-07T08:45:11.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.505+0000 7f481bad9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48140cfbb0 con 0x7f4814157ca0 2023-10-07T08:45:11.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.505+0000 7f481bad9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48140cfe90 con 0x7f48141578d0 2023-10-07T08:45:11.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.505+0000 7f4819074700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4814157ca0 0x7f481415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:11.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.505+0000 7f481a076700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f481406d120 0x7f481406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37906/0 (socket says 172.21.15.81:37906) 2023-10-07T08:45:11.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.505+0000 7f481a076700 1 -- 172.21.15.81:0/730547951 learned_addr learned my addr 172.21.15.81:0/730547951 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:45:11.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.505+0000 7f4819875700 1 --2- 172.21.15.81:0/730547951 >> v2:172.21.15.89:3300/0 conn(0x7f48141578d0 0x7f48140cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:11.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f4819074700 1 -- 172.21.15.81:0/730547951 >> v2:172.21.15.89:3300/0 conn(0x7f48141578d0 msgr2=0x7f48140cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:11.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f4819074700 1 --2- 172.21.15.81:0/730547951 >> v2:172.21.15.89:3300/0 conn(0x7f48141578d0 0x7f48140cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f4819074700 1 -- 172.21.15.81:0/730547951 >> v1:172.21.15.81:6789/0 conn(0x7f481406d120 legacy=0x7f481406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:11.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f4819074700 1 -- 172.21.15.81:0/730547951 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48140d0170 con 0x7f4814157ca0 2023-10-07T08:45:11.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f4819875700 1 --2- 172.21.15.81:0/730547951 >> v2:172.21.15.89:3300/0 conn(0x7f48141578d0 0x7f48140cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:45:11.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f4818873700 1 -- 172.21.15.81:0/730547951 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111819756 0 0) 0x7f48140d07c0 con 0x7f481406d120 2023-10-07T08:45:11.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f4819074700 1 --2- 172.21.15.81:0/730547951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4814157ca0 0x7f481415af00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f48140646b0 tx=0x7f48040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953a8f101a24ef3d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:11.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f4818873700 1 -- 172.21.15.81:0/730547951 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480400b6b0 con 0x7f4814157ca0 2023-10-07T08:45:11.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f4818873700 1 -- 172.21.15.81:0/730547951 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480400b810 con 0x7f4814157ca0 2023-10-07T08:45:11.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f4818873700 1 -- 172.21.15.81:0/730547951 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480400bbb0 con 0x7f4814157ca0 2023-10-07T08:45:11.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f481bad9700 1 -- 172.21.15.81:0/730547951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4814157ca0 msgr2=0x7f481415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:11.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f481bad9700 1 --2- 172.21.15.81:0/730547951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4814157ca0 0x7f481415af00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f48140646b0 tx=0x7f48040091a0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f481bad9700 1 -- 172.21.15.81:0/730547951 shutdown_connections 2023-10-07T08:45:11.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f481bad9700 1 --2- 172.21.15.81:0/730547951 >> v2:172.21.15.89:3300/0 conn(0x7f48141578d0 0x7f48140cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f481bad9700 1 --2- 172.21.15.81:0/730547951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4814157ca0 0x7f481415af00 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f481bad9700 1 -- 172.21.15.81:0/730547951 >> 172.21.15.81:0/730547951 conn(0x7f481406bb90 msgr2=0x7f481406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:11.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.506+0000 7f481bad9700 1 -- 172.21.15.81:0/730547951 shutdown_connections 2023-10-07T08:45:11.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.507+0000 7f481bad9700 1 -- 172.21.15.81:0/730547951 wait complete. 2023-10-07T08:45:11.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.508+0000 7f481bad9700 1 Processor -- start 2023-10-07T08:45:11.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.508+0000 7f481bad9700 1 -- start start 2023-10-07T08:45:11.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.508+0000 7f481bad9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f481406d120 0x7f481416e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:11.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.508+0000 7f481bad9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48141578d0 0x7f48140ad100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.508+0000 7f481bad9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4814157ca0 0x7f481416cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.508+0000 7f481bad9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48140ae4f0 con 0x7f4814157ca0 2023-10-07T08:45:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.508+0000 7f481bad9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48140ad640 con 0x7f48141578d0 2023-10-07T08:45:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.508+0000 7f481bad9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48140ad8e0 con 0x7f481406d120 2023-10-07T08:45:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.508+0000 7f481a076700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4814157ca0 0x7f481416cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.508+0000 7f481a076700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4814157ca0 0x7f481416cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52476/0 (socket says 172.21.15.81:52476) 2023-10-07T08:45:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.508+0000 7f481a076700 1 -- 172.21.15.81:0/2397128067 learned_addr learned my addr 172.21.15.81:0/2397128067 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.509+0000 7f4819875700 1 --2- 172.21.15.81:0/2397128067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f481406d120 0x7f481416e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.509+0000 7f4819074700 1 --2- 172.21.15.81:0/2397128067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48141578d0 0x7f48140ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.509+0000 7f481a076700 1 -- 172.21.15.81:0/2397128067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f481406d120 msgr2=0x7f481416e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.509+0000 7f481a076700 1 --2- 172.21.15.81:0/2397128067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f481406d120 0x7f481416e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.509+0000 7f481a076700 1 -- 172.21.15.81:0/2397128067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48141578d0 msgr2=0x7f48140ad100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:11.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.509+0000 7f481a076700 1 --2- 172.21.15.81:0/2397128067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48141578d0 0x7f48140ad100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.509+0000 7f481a076700 1 -- 172.21.15.81:0/2397128067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4804009420 con 0x7f4814157ca0 2023-10-07T08:45:11.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.509+0000 7f481a076700 1 --2- 172.21.15.81:0/2397128067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4814157ca0 0x7f481416cfc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f480c00cc90 tx=0x7f480c001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:11.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.509+0000 7f4809ffb700 1 -- 172.21.15.81:0/2397128067 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c00a8b0 con 0x7f4814157ca0 2023-10-07T08:45:11.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.509+0000 7f4809ffb700 1 -- 172.21.15.81:0/2397128067 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c00aa10 con 0x7f4814157ca0 2023-10-07T08:45:11.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.509+0000 7f481bad9700 1 -- 172.21.15.81:0/2397128067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48140adbc0 con 0x7f4814157ca0 2023-10-07T08:45:11.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.509+0000 7f4809ffb700 1 -- 172.21.15.81:0/2397128067 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c00add0 con 0x7f4814157ca0 2023-10-07T08:45:11.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.509+0000 7f481bad9700 1 -- 172.21.15.81:0/2397128067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48140ae180 con 0x7f4814157ca0 2023-10-07T08:45:11.513 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-10-07T08:45:11.509+0000 7efc84b7c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:45:11.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.510+0000 7f481bad9700 1 -- 172.21.15.81:0/2397128067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481416b550 con 0x7f4814157ca0 2023-10-07T08:45:11.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.511+0000 7f4809ffb700 1 -- 172.21.15.81:0/2397128067 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f480c007300 con 0x7f4814157ca0 2023-10-07T08:45:11.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.511+0000 7f4809ffb700 1 --2- 172.21.15.81:0/2397128067 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f47f8066f30 0x7f47f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:11.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.511+0000 7f4819875700 1 --2- 172.21.15.81:0/2397128067 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f47f8066f30 0x7f47f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:11.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.511+0000 7f4809ffb700 1 -- 172.21.15.81:0/2397128067 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f480c084810 con 0x7f4814157ca0 2023-10-07T08:45:11.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.511+0000 7f4819875700 1 --2- 172.21.15.81:0/2397128067 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f47f8066f30 0x7f47f80693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4810006f00 tx=0x7f4810008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:11.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.515+0000 7f4809ffb700 1 -- 172.21.15.81:0/2397128067 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f481416b550 con 0x7f4814157ca0 2023-10-07T08:45:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.741+0000 7f481bad9700 1 -- 172.21.15.81:0/2397128067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f481416b550 con 0x7f4814157ca0 2023-10-07T08:45:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.741+0000 7f4809ffb700 1 -- 172.21.15.81:0/2397128067 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f481416b550 con 0x7f4814157ca0 2023-10-07T08:45:11.742 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:45:11.742 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3279897900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3279897900},{"type":"v1","addr":"172.21.15.89:6835","nonce":3279897900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/102905724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":102905724},{"type":"v1","addr":"172.21.15.89:6834","nonce":102905724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4063096820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":4063096820},{"type":"v1","addr":"172.21.15.81:6836","nonce":4063096820}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:45:05.899585+0000","modified":"2023-10-07T08:45:09.552432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2943588561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2943588561},{"type":"v1","addr":"172.21.15.81:6837","nonce":2943588561}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-07T08:45:11.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.743+0000 7f481bad9700 1 -- 172.21.15.81:0/2397128067 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f47f8066f30 msgr2=0x7f47f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:11.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.743+0000 7f481bad9700 1 --2- 172.21.15.81:0/2397128067 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f47f8066f30 0x7f47f80693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4810006f00 tx=0x7f4810008040 comp rx=0 tx=0).stop 2023-10-07T08:45:11.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.743+0000 7f481bad9700 1 -- 172.21.15.81:0/2397128067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4814157ca0 msgr2=0x7f481416cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:11.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.743+0000 7f481bad9700 1 --2- 172.21.15.81:0/2397128067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4814157ca0 0x7f481416cfc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f480c00cc90 tx=0x7f480c001a80 comp rx=0 tx=0).stop 2023-10-07T08:45:11.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.743+0000 7f481bad9700 1 -- 172.21.15.81:0/2397128067 shutdown_connections 2023-10-07T08:45:11.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.743+0000 7f481bad9700 1 --2- 172.21.15.81:0/2397128067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4814157ca0 0x7f481416cfc0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.743+0000 7f481bad9700 1 --2- 172.21.15.81:0/2397128067 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f47f8066f30 0x7f47f80693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.743+0000 7f481bad9700 1 --2- 172.21.15.81:0/2397128067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f481406d120 0x7f481416e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.743+0000 7f481bad9700 1 --2- 172.21.15.81:0/2397128067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48141578d0 0x7f48140ad100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.743+0000 7f481bad9700 1 -- 172.21.15.81:0/2397128067 >> 172.21.15.81:0/2397128067 conn(0x7f481406bb90 msgr2=0x7f481406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.743+0000 7f481bad9700 1 -- 172.21.15.81:0/2397128067 shutdown_connections 2023-10-07T08:45:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:11.743+0000 7f481bad9700 1 -- 172.21.15.81:0/2397128067 wait complete. 2023-10-07T08:45:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2023-10-07T08:45:12.158 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T08:45:05.899585+0000', 'modified': '2023-10-07T08:45:09.552432+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5709}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5709': {'gid': 5709, 'name': 'a', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/2943588561', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 2943588561}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2943588561}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T08:45:12.158 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T08:45:12.159 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-07T08:45:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.277+0000 7f2f561e2700 1 Processor -- start 2023-10-07T08:45:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.277+0000 7f2f561e2700 1 -- start start 2023-10-07T08:45:12.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.278+0000 7f2f561e2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f501578d0 0x7f2f500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.278+0000 7f2f561e2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f500d07c0 con 0x7f2f5006d120 2023-10-07T08:45:12.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.278+0000 7f2f561e2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f500cfbb0 con 0x7f2f50157ca0 2023-10-07T08:45:12.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.278+0000 7f2f561e2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f500cfe90 con 0x7f2f501578d0 2023-10-07T08:45:12.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.278+0000 7f2f4ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2f5006d120 0x7f2f5015b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37916/0 (socket says 172.21.15.81:37916) 2023-10-07T08:45:12.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.278+0000 7f2f4ffff700 1 -- 172.21.15.81:0/680958673 learned_addr learned my addr 172.21.15.81:0/680958673 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:45:12.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4f7fe700 1 --2- 172.21.15.81:0/680958673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f501578d0 0x7f2f500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4e7fc700 1 -- 172.21.15.81:0/680958673 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525912714 0 0) 0x7f2f500d07c0 con 0x7f2f5006d120 2023-10-07T08:45:12.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4e7fc700 1 -- 172.21.15.81:0/680958673 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f38003570 con 0x7f2f5006d120 2023-10-07T08:45:12.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4e7fc700 1 -- 172.21.15.81:0/680958673 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3343286206 0 0) 0x7f2f38003570 con 0x7f2f5006d120 2023-10-07T08:45:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4e7fc700 1 -- 172.21.15.81:0/680958673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f501578d0 msgr2=0x7f2f500cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4e7fc700 1 --2- 172.21.15.81:0/680958673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f501578d0 0x7f2f500cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4e7fc700 1 -- 172.21.15.81:0/680958673 >> v1:172.21.15.89:6789/0 conn(0x7f2f50157ca0 legacy=0x7f2f5015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4e7fc700 1 -- 172.21.15.81:0/680958673 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f500d0170 con 0x7f2f5006d120 2023-10-07T08:45:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4e7fc700 1 -- 172.21.15.81:0/680958673 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f2f480017f0 con 0x7f2f5006d120 2023-10-07T08:45:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4e7fc700 1 -- 172.21.15.81:0/680958673 >> v1:172.21.15.81:6789/0 conn(0x7f2f5006d120 legacy=0x7f2f5015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4e7fc700 1 --2- 172.21.15.81:0/680958673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f38003a90 0x7f2f38003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4e7fc700 1 --2- 172.21.15.81:0/680958673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f501578d0 0x7f2f38004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4e7fc700 1 --2- 172.21.15.81:0/680958673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f38004d50 0x7f2f380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4e7fc700 1 -- 172.21.15.81:0/680958673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f500cfe90 con 0x7f2f38004d50 2023-10-07T08:45:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4e7fc700 1 -- 172.21.15.81:0/680958673 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3800bb10 con 0x7f2f38003a90 2023-10-07T08:45:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4e7fc700 1 -- 172.21.15.81:0/680958673 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3800bcd0 con 0x7f2f501578d0 2023-10-07T08:45:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4ffff700 1 --2- 172.21.15.81:0/680958673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f38004d50 0x7f2f380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4f7fe700 1 --2- 172.21.15.81:0/680958673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f38003a90 0x7f2f38003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4effd700 1 --2- 172.21.15.81:0/680958673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f501578d0 0x7f2f38004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4ffff700 1 -- 172.21.15.81:0/680958673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f501578d0 msgr2=0x7f2f38004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4ffff700 1 --2- 172.21.15.81:0/680958673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f501578d0 0x7f2f38004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4ffff700 1 -- 172.21.15.81:0/680958673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f38003a90 msgr2=0x7f2f38003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4ffff700 1 --2- 172.21.15.81:0/680958673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f38003a90 0x7f2f38003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4ffff700 1 -- 172.21.15.81:0/680958673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f38003570 con 0x7f2f38004d50 2023-10-07T08:45:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4f7fe700 1 --2- 172.21.15.81:0/680958673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f38003a90 0x7f2f38003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:45:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4effd700 1 --2- 172.21.15.81:0/680958673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f501578d0 0x7f2f38004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:45:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.279+0000 7f2f4ffff700 1 --2- 172.21.15.81:0/680958673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f38004d50 0x7f2f380051c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800a940 tx=0x7f2f5015b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0c43f84c57949f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.280+0000 7f2f4e7fc700 1 -- 172.21.15.81:0/680958673 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f480070d0 con 0x7f2f38004d50 2023-10-07T08:45:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.280+0000 7f2f4e7fc700 1 -- 172.21.15.81:0/680958673 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f48007250 con 0x7f2f38004d50 2023-10-07T08:45:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.280+0000 7f2f4e7fc700 1 -- 172.21.15.81:0/680958673 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48007610 con 0x7f2f38004d50 2023-10-07T08:45:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.280+0000 7f2f561e2700 1 -- 172.21.15.81:0/680958673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f38004d50 msgr2=0x7f2f380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.280+0000 7f2f561e2700 1 --2- 172.21.15.81:0/680958673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f38004d50 0x7f2f380051c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800a940 tx=0x7f2f5015b610 comp rx=0 tx=0).stop 2023-10-07T08:45:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.280+0000 7f2f4ffff700 1 -- 172.21.15.81:0/680958673 reap_dead start 2023-10-07T08:45:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.280+0000 7f2f561e2700 1 -- 172.21.15.81:0/680958673 shutdown_connections 2023-10-07T08:45:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.280+0000 7f2f561e2700 1 -- 172.21.15.81:0/680958673 >> 172.21.15.81:0/680958673 conn(0x7f2f5006bb90 msgr2=0x7f2f5006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.280+0000 7f2f561e2700 1 -- 172.21.15.81:0/680958673 shutdown_connections 2023-10-07T08:45:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.280+0000 7f2f561e2700 1 -- 172.21.15.81:0/680958673 wait complete. 2023-10-07T08:45:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.281+0000 7f2f561e2700 1 Processor -- start 2023-10-07T08:45:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.281+0000 7f2f561e2700 1 -- start start 2023-10-07T08:45:12.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.282+0000 7f2f561e2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f38004d50 0x7f2f50155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.282+0000 7f2f561e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f50148560 0x7f2f501489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.282+0000 7f2f561e2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f500b5f20 0x7f2f500b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.282+0000 7f2f561e2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f50148f10 con 0x7f2f50148560 2023-10-07T08:45:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.282+0000 7f2f561e2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f500c5bc0 con 0x7f2f38004d50 2023-10-07T08:45:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.282+0000 7f2f561e2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f500c5e30 con 0x7f2f500b5f20 2023-10-07T08:45:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.282+0000 7f2f4effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f50148560 0x7f2f501489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.282+0000 7f2f4effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f50148560 0x7f2f501489d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52492/0 (socket says 172.21.15.81:52492) 2023-10-07T08:45:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.282+0000 7f2f4effd700 1 -- 172.21.15.81:0/3679110603 learned_addr learned my addr 172.21.15.81:0/3679110603 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.282+0000 7f2f4effd700 1 -- 172.21.15.81:0/3679110603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f500b5f20 msgr2=0x7f2f500b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.282+0000 7f2f4effd700 1 --2- 172.21.15.81:0/3679110603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f500b5f20 0x7f2f500b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.282+0000 7f2f4effd700 1 -- 172.21.15.81:0/3679110603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f38004d50 msgr2=0x7f2f50155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.282+0000 7f2f4effd700 1 --2- 172.21.15.81:0/3679110603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f38004d50 0x7f2f50155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.282+0000 7f2f4effd700 1 -- 172.21.15.81:0/3679110603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f500c6110 con 0x7f2f50148560 2023-10-07T08:45:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.283+0000 7f2f4effd700 1 --2- 172.21.15.81:0/3679110603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f50148560 0x7f2f501489d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400e7d0 tx=0x7f2f44009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.283+0000 7f2f377fe700 1 -- 172.21.15.81:0/3679110603 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f44012500 con 0x7f2f50148560 2023-10-07T08:45:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.283+0000 7f2f377fe700 1 -- 172.21.15.81:0/3679110603 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f44010040 con 0x7f2f50148560 2023-10-07T08:45:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.283+0000 7f2f377fe700 1 -- 172.21.15.81:0/3679110603 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f44012890 con 0x7f2f50148560 2023-10-07T08:45:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.283+0000 7f2f561e2700 1 -- 172.21.15.81:0/3679110603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f500c63f0 con 0x7f2f50148560 2023-10-07T08:45:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.283+0000 7f2f561e2700 1 -- 172.21.15.81:0/3679110603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f500c6bf0 con 0x7f2f50148560 2023-10-07T08:45:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.284+0000 7f2f377fe700 1 -- 172.21.15.81:0/3679110603 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f44012c40 con 0x7f2f50148560 2023-10-07T08:45:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.284+0000 7f2f377fe700 1 --2- 172.21.15.81:0/3679110603 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f3c066f30 0x7f2f3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.284+0000 7f2f377fe700 1 -- 172.21.15.81:0/3679110603 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f44083fd0 con 0x7f2f50148560 2023-10-07T08:45:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.284+0000 7f2f4f7fe700 1 --2- 172.21.15.81:0/3679110603 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f3c066f30 0x7f2f3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.284+0000 7f2f4f7fe700 1 --2- 172.21.15.81:0/3679110603 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f3c066f30 0x7f2f3c0693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009c40 tx=0x7f2f40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.285+0000 7f2f5f4dab80 1 Processor -- start 2023-10-07T08:45:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.286+0000 7f2f5f4dab80 1 -- start start 2023-10-07T08:45:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.286+0000 7f2f5f4dab80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558babf4a50 0x5558babf4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.286+0000 7f2f5f4dab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac3ed00 0x5558bac1da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.286+0000 7f2f5f4dab80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558bac1df60 0x5558babf0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.286+0000 7f2f5f4dab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558bab4ba70 con 0x5558bac3ed00 2023-10-07T08:45:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.286+0000 7f2f5f4dab80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558bab49270 con 0x5558bac1df60 2023-10-07T08:45:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.286+0000 7f2f5f4dab80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558bab45060 con 0x5558babf4a50 2023-10-07T08:45:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.286+0000 7f2f4effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac3ed00 0x5558bac1da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.286+0000 7f2f4effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac3ed00 0x5558bac1da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52496/0 (socket says 172.21.15.81:52496) 2023-10-07T08:45:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.286+0000 7f2f4effd700 1 -- 172.21.15.81:0/675622586 learned_addr learned my addr 172.21.15.81:0/675622586 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.287+0000 7f2f4effd700 1 -- 172.21.15.81:0/675622586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558babf4a50 msgr2=0x5558babf4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.287+0000 7f2f4effd700 1 --2- 172.21.15.81:0/675622586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558babf4a50 0x5558babf4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.287+0000 7f2f4effd700 1 -- 172.21.15.81:0/675622586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558bac1df60 msgr2=0x5558babf0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.287+0000 7f2f4effd700 1 --2- 172.21.15.81:0/675622586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558bac1df60 0x5558babf0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.287+0000 7f2f4effd700 1 -- 172.21.15.81:0/675622586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558ba9df270 con 0x5558bac3ed00 2023-10-07T08:45:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.287+0000 7f2f4effd700 1 --2- 172.21.15.81:0/675622586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac3ed00 0x5558bac1da20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2f440825a0 tx=0x7f2f44082450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a718d0d8038d1c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.287+0000 7f2f34ff9700 1 -- 172.21.15.81:0/675622586 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4405bea0 con 0x5558bac3ed00 2023-10-07T08:45:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.287+0000 7f2f34ff9700 1 -- 172.21.15.81:0/675622586 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f44058e90 con 0x5558bac3ed00 2023-10-07T08:45:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.287+0000 7f2f34ff9700 1 -- 172.21.15.81:0/675622586 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f44053350 con 0x5558bac3ed00 2023-10-07T08:45:12.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.287+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/675622586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac3ed00 msgr2=0x5558bac1da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.287+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/675622586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac3ed00 0x5558bac1da20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2f440825a0 tx=0x7f2f44082450 comp rx=0 tx=0).stop 2023-10-07T08:45:12.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.288+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/675622586 shutdown_connections 2023-10-07T08:45:12.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.288+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/675622586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558bac1df60 0x5558babf0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.288+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/675622586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558babf4a50 0x5558babf4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.288+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/675622586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac3ed00 0x5558bac1da20 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.288+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/675622586 >> 172.21.15.81:0/675622586 conn(0x5558babf6370 msgr2=0x5558babf6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:12.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.288+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/675622586 shutdown_connections 2023-10-07T08:45:12.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.288+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/675622586 wait complete. 2023-10-07T08:45:12.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.288+0000 7f2f5f4dab80 1 -- start start 2023-10-07T08:45:12.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.288+0000 7f2f5f4dab80 1 Processor -- start 2023-10-07T08:45:12.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f5f4dab80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558babf4a50 0x5558bac19d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f5f4dab80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558bac1df60 0x5558bac4ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f5f4dab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac3ed00 0x5558bac4b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f5f4dab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558baaf0890 con 0x5558bac3ed00 2023-10-07T08:45:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f5f4dab80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558bab0bea0 con 0x5558babf4a50 2023-10-07T08:45:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f5f4dab80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558ba9c7e30 con 0x5558bac1df60 2023-10-07T08:45:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f5f4dab80 10 client.0 _ll_register_callbacks cb 0x5558babb8110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:45:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f4ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac3ed00 0x5558bac4b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f4f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558babf4a50 0x5558bac19d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f4ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac3ed00 0x5558bac4b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52498/0 (socket says 172.21.15.81:52498) 2023-10-07T08:45:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f4ffff700 1 -- 172.21.15.81:0/1312007815 learned_addr learned my addr 172.21.15.81:0/1312007815 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f4effd700 1 --2- 172.21.15.81:0/1312007815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558bac1df60 0x5558bac4ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f4ffff700 1 -- 172.21.15.81:0/1312007815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558bac1df60 msgr2=0x5558bac4ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f4ffff700 1 --2- 172.21.15.81:0/1312007815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558bac1df60 0x5558bac4ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f4ffff700 1 -- 172.21.15.81:0/1312007815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558babf4a50 msgr2=0x5558bac19d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f4ffff700 1 --2- 172.21.15.81:0/1312007815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558babf4a50 0x5558bac19d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.289+0000 7f2f4ffff700 1 -- 172.21.15.81:0/1312007815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f500c6bf0 con 0x5558bac3ed00 2023-10-07T08:45:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f4ffff700 1 --2- 172.21.15.81:0/1312007815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac3ed00 0x5558bac4b2a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800af30 tx=0x7f2f48015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b756cb08e8ff14da server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:45:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f2dffb700 1 -- 172.21.15.81:0/1312007815 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f480017b0 con 0x5558bac3ed00 2023-10-07T08:45:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f2dffb700 1 -- 172.21.15.81:0/1312007815 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f480011c0 con 0x5558bac3ed00 2023-10-07T08:45:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/1312007815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5558babe9b70 con 0x5558bac3ed00 2023-10-07T08:45:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f2dffb700 1 -- 172.21.15.81:0/1312007815 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f480075d0 con 0x5558bac3ed00 2023-10-07T08:45:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f5f4dab80 10 client.5841 fetch_fsmap learned FSMap version 32 2023-10-07T08:45:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/1312007815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5558ba981fe0 con 0x5558bac3ed00 2023-10-07T08:45:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f2dffb700 1 -- 172.21.15.81:0/1312007815 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5558babe9b70 con 0x5558bac3ed00 2023-10-07T08:45:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f2dffb700 1 -- 172.21.15.81:0/1312007815 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2f48024020 con 0x5558bac3ed00 2023-10-07T08:45:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f5f4dab80 10 client.5841 fetch_fsmap finished waiting for FSMap version 32 2023-10-07T08:45:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f5f4dab80 10 client.5841 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T08:45:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f5f4dab80 20 client.5841 populate_metadata read hostname 'smithi081' 2023-10-07T08:45:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/1312007815 >> [v2:172.21.15.81:6834/2943588561,v1:172.21.15.81:6837/2943588561] conn(0x5558babf1c70 0x5558bac3dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f5f4dab80 4 client.5841 mds_command: new command op to 5709 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T08:45:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/1312007815 --> [v2:172.21.15.81:6834/2943588561,v1:172.21.15.81:6837/2943588561] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5558babc6aa0 con 0x5558babf1c70 2023-10-07T08:45:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.290+0000 7f2f4f7fe700 1 --2- 172.21.15.81:0/1312007815 >> [v2:172.21.15.81:6834/2943588561,v1:172.21.15.81:6837/2943588561] conn(0x5558babf1c70 0x5558bac3dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.291+0000 7f2f2dffb700 10 client.5841 ms_handle_connect on v2:172.21.15.81:6834/2943588561 2023-10-07T08:45:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.291+0000 7f2f4f7fe700 1 --2- 172.21.15.81:0/1312007815 >> [v2:172.21.15.81:6834/2943588561,v1:172.21.15.81:6837/2943588561] conn(0x5558babf1c70 0x5558bac3dbe0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11b03d33cc43a0d4 server_cookie=cb1e32682a892ae6 in_seq=0 out_seq=0 2023-10-07T08:45:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.291+0000 7f2f2dffb700 1 -- 172.21.15.81:0/1312007815 <== mds.0 v2:172.21.15.81:6834/2943588561 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5558babc6aa0 con 0x5558babf1c70 2023-10-07T08:45:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.291+0000 7f2f2dffb700 10 client.5841 handle_command_reply: tid=0 2023-10-07T08:45:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.291+0000 7f2f5f4dab80 1 client.5841 shutdown 2023-10-07T08:45:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.291+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/1312007815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac3ed00 msgr2=0x5558bac4b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.291+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/1312007815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac3ed00 0x5558bac4b2a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800af30 tx=0x7f2f48015000 comp rx=0 tx=0).stop 2023-10-07T08:45:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.291+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/1312007815 shutdown_connections 2023-10-07T08:45:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.291+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/1312007815 >> [v2:172.21.15.81:6834/2943588561,v1:172.21.15.81:6837/2943588561] conn(0x5558babf1c70 0x5558bac3dbe0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.291+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/1312007815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac3ed00 0x5558bac4b2a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.291+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/1312007815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558babf4a50 0x5558bac19d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.291+0000 7f2f2dffb700 0 client.5841 ms_handle_reset on v2:172.21.15.81:6834/2943588561 2023-10-07T08:45:12.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.291+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/1312007815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558bac1df60 0x5558bac4ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.291+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/1312007815 >> 172.21.15.81:0/1312007815 conn(0x5558babf6370 msgr2=0x5558bac3a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:12.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.291+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/1312007815 shutdown_connections 2023-10-07T08:45:12.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.291+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/1312007815 wait complete. 2023-10-07T08:45:12.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.292+0000 7f2f5f4dab80 20 client.5841 trim_cache size 0 max 16384 2023-10-07T08:45:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.308+0000 7f2f5f4dab80 1 Processor -- start 2023-10-07T08:45:12.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.308+0000 7f2f5f4dab80 1 -- start start 2023-10-07T08:45:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f5f4dab80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558babf4a50 0x5558babed4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f5f4dab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac1df60 0x5558bac3dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f5f4dab80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558bac3ed00 0x5558bac3e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f5f4dab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558bac24900 con 0x5558bac1df60 2023-10-07T08:45:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f5f4dab80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558babef5a0 con 0x5558bac3ed00 2023-10-07T08:45:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f5f4dab80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558babf3cd0 con 0x5558babf4a50 2023-10-07T08:45:12.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f4effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac1df60 0x5558bac3dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f4effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac1df60 0x5558bac3dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52512/0 (socket says 172.21.15.81:52512) 2023-10-07T08:45:12.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f4effd700 1 -- 172.21.15.81:0/2570542311 learned_addr learned my addr 172.21.15.81:0/2570542311 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:12.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f4f7fe700 1 --2- 172.21.15.81:0/2570542311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558babf4a50 0x5558babed4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f4ffff700 1 --2- 172.21.15.81:0/2570542311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558bac3ed00 0x5558bac3e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f4effd700 1 -- 172.21.15.81:0/2570542311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558babf4a50 msgr2=0x5558babed4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:12.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f4effd700 1 --2- 172.21.15.81:0/2570542311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558babf4a50 0x5558babed4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f4effd700 1 -- 172.21.15.81:0/2570542311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558bac3ed00 msgr2=0x5558bac3e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:12.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f4effd700 1 --2- 172.21.15.81:0/2570542311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558bac3ed00 0x5558bac3e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f4effd700 1 -- 172.21.15.81:0/2570542311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558bab13780 con 0x5558bac1df60 2023-10-07T08:45:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f4ffff700 1 --2- 172.21.15.81:0/2570542311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558bac3ed00 0x5558bac3e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:45:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.309+0000 7f2f4effd700 1 --2- 172.21.15.81:0/2570542311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac1df60 0x5558bac3dbe0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2f44007fd0 tx=0x7f2f44069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27eac58b2cf3e76c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.310+0000 7f2f357fa700 1 -- 172.21.15.81:0/2570542311 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4405bea0 con 0x5558bac1df60 2023-10-07T08:45:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.310+0000 7f2f357fa700 1 -- 172.21.15.81:0/2570542311 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f440530f0 con 0x5558bac1df60 2023-10-07T08:45:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.310+0000 7f2f357fa700 1 -- 172.21.15.81:0/2570542311 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f44053350 con 0x5558bac1df60 2023-10-07T08:45:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.310+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/2570542311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac1df60 msgr2=0x5558bac3dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.310+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/2570542311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac1df60 0x5558bac3dbe0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2f44007fd0 tx=0x7f2f44069000 comp rx=0 tx=0).stop 2023-10-07T08:45:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.310+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/2570542311 shutdown_connections 2023-10-07T08:45:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.310+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/2570542311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558bac3ed00 0x5558bac3e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.310+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/2570542311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558babf4a50 0x5558babed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.310+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/2570542311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac1df60 0x5558bac3dbe0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.310+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/2570542311 >> 172.21.15.81:0/2570542311 conn(0x5558babf6370 msgr2=0x5558bac4df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.310+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/2570542311 shutdown_connections 2023-10-07T08:45:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.310+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/2570542311 wait complete. 2023-10-07T08:45:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.311+0000 7f2f5f4dab80 1 -- start start 2023-10-07T08:45:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.311+0000 7f2f5f4dab80 1 Processor -- start 2023-10-07T08:45:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.311+0000 7f2f5f4dab80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558babf4a50 0x5558baca0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.311+0000 7f2f5f4dab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac1df60 0x5558bac3db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.311+0000 7f2f5f4dab80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558bac3ed00 0x5558bac3e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.311+0000 7f2f5f4dab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558bac35b00 con 0x5558bac1df60 2023-10-07T08:45:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.311+0000 7f2f5f4dab80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558bac1af40 con 0x5558bac3ed00 2023-10-07T08:45:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.311+0000 7f2f5f4dab80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558bac1ad20 con 0x5558babf4a50 2023-10-07T08:45:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f5f4dab80 10 client.0 _ll_register_callbacks cb 0x5558babb8110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:45:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f4effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac1df60 0x5558bac3db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f4effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac1df60 0x5558bac3db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52528/0 (socket says 172.21.15.81:52528) 2023-10-07T08:45:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f4effd700 1 -- 172.21.15.81:0/1209177362 learned_addr learned my addr 172.21.15.81:0/1209177362 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f4f7fe700 1 --2- 172.21.15.81:0/1209177362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558babf4a50 0x5558baca0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f4ffff700 1 --2- 172.21.15.81:0/1209177362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558bac3ed00 0x5558bac3e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f4effd700 1 -- 172.21.15.81:0/1209177362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558babf4a50 msgr2=0x5558baca0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f4effd700 1 --2- 172.21.15.81:0/1209177362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558babf4a50 0x5558baca0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f4effd700 1 -- 172.21.15.81:0/1209177362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558bac3ed00 msgr2=0x5558bac3e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f4effd700 1 --2- 172.21.15.81:0/1209177362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558bac3ed00 0x5558bac3e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f4effd700 1 -- 172.21.15.81:0/1209177362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558ba9df270 con 0x5558bac1df60 2023-10-07T08:45:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f4effd700 1 --2- 172.21.15.81:0/1209177362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac1df60 0x5558bac3db10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2f44014000 tx=0x7f2f4400c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a90bcb43e9f6fa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:45:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f2dffb700 1 -- 172.21.15.81:0/1209177362 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4406b100 con 0x5558bac1df60 2023-10-07T08:45:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f2dffb700 1 -- 172.21.15.81:0/1209177362 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f44082070 con 0x5558bac1df60 2023-10-07T08:45:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/1209177362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f44058e90 con 0x5558bac1df60 2023-10-07T08:45:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f2dffb700 1 -- 172.21.15.81:0/1209177362 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f44055210 con 0x5558bac1df60 2023-10-07T08:45:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f5f4dab80 10 client.5847 fetch_fsmap learned FSMap version 32 2023-10-07T08:45:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/1209177362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5558baafa470 con 0x5558bac1df60 2023-10-07T08:45:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f2dffb700 1 -- 172.21.15.81:0/1209177362 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f44058e90 con 0x5558bac1df60 2023-10-07T08:45:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f2dffb700 1 -- 172.21.15.81:0/1209177362 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2f440544a0 con 0x5558bac1df60 2023-10-07T08:45:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f5f4dab80 10 client.5847 fetch_fsmap finished waiting for FSMap version 32 2023-10-07T08:45:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f5f4dab80 10 client.5847 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T08:45:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f5f4dab80 20 client.5847 populate_metadata read hostname 'smithi081' 2023-10-07T08:45:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.312+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/1209177362 >> [v2:172.21.15.81:6834/2943588561,v1:172.21.15.81:6837/2943588561] conn(0x5558bac18800 0x5558bac18bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f5f4dab80 4 client.5847 mds_command: new command op to 5709 tid=0[{"prefix": "status"}] 2023-10-07T08:45:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/1209177362 --> [v2:172.21.15.81:6834/2943588561,v1:172.21.15.81:6837/2943588561] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5558baae7e00 con 0x5558bac18800 2023-10-07T08:45:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f4f7fe700 1 --2- 172.21.15.81:0/1209177362 >> [v2:172.21.15.81:6834/2943588561,v1:172.21.15.81:6837/2943588561] conn(0x5558bac18800 0x5558bac18bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f2dffb700 10 client.5847 ms_handle_connect on v2:172.21.15.81:6834/2943588561 2023-10-07T08:45:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f4f7fe700 1 --2- 172.21.15.81:0/1209177362 >> [v2:172.21.15.81:6834/2943588561,v1:172.21.15.81:6837/2943588561] conn(0x5558bac18800 0x5558bac18bd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6e905df5d607e0a server_cookie=bbdf17a7779a5ad1 in_seq=0 out_seq=0 2023-10-07T08:45:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f2dffb700 1 -- 172.21.15.81:0/1209177362 <== mds.0 v2:172.21.15.81:6834/2943588561 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x5558baae7e00 con 0x5558bac18800 2023-10-07T08:45:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f2dffb700 10 client.5847 handle_command_reply: tid=0 2023-10-07T08:45:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f5f4dab80 1 client.5847 shutdown 2023-10-07T08:45:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/1209177362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac1df60 msgr2=0x5558bac3db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/1209177362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac1df60 0x5558bac3db10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2f44014000 tx=0x7f2f4400c050 comp rx=0 tx=0).stop 2023-10-07T08:45:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/1209177362 shutdown_connections 2023-10-07T08:45:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/1209177362 >> [v2:172.21.15.81:6834/2943588561,v1:172.21.15.81:6837/2943588561] conn(0x5558bac18800 0x5558bac18bd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/1209177362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5558bac3ed00 0x5558bac3e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/1209177362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5558babf4a50 0x5558baca0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f5f4dab80 1 --2- 172.21.15.81:0/1209177362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558bac1df60 0x5558bac3db10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f2dffb700 0 client.5847 ms_handle_reset on v2:172.21.15.81:6834/2943588561 2023-10-07T08:45:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/1209177362 >> 172.21.15.81:0/1209177362 conn(0x5558babf6370 msgr2=0x5558bac1ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/1209177362 shutdown_connections 2023-10-07T08:45:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f5f4dab80 1 -- 172.21.15.81:0/1209177362 wait complete. 2023-10-07T08:45:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.313+0000 7f2f5f4dab80 20 client.5847 trim_cache size 0 max 16384 2023-10-07T08:45:12.324 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:45:12.324 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:45:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-07T08:45:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5709, 2023-10-07T08:45:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-07T08:45:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-07T08:45:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-07T08:45:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.773014453, 2023-10-07T08:45:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 32, 2023-10-07T08:45:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 67, 2023-10-07T08:45:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 67, 2023-10-07T08:45:12.325 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 11.754465565 2023-10-07T08:45:12.326 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:45:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.314+0000 7f2f561e2700 1 -- 172.21.15.81:0/3679110603 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f3c066f30 msgr2=0x7f2f3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.314+0000 7f2f561e2700 1 --2- 172.21.15.81:0/3679110603 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f3c066f30 0x7f2f3c0693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009c40 tx=0x7f2f40008040 comp rx=0 tx=0).stop 2023-10-07T08:45:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.314+0000 7f2f561e2700 1 -- 172.21.15.81:0/3679110603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f50148560 msgr2=0x7f2f501489d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.314+0000 7f2f561e2700 1 --2- 172.21.15.81:0/3679110603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f50148560 0x7f2f501489d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400e7d0 tx=0x7f2f44009040 comp rx=0 tx=0).stop 2023-10-07T08:45:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.314+0000 7f2f561e2700 1 -- 172.21.15.81:0/3679110603 shutdown_connections 2023-10-07T08:45:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.314+0000 7f2f561e2700 1 --2- 172.21.15.81:0/3679110603 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f3c066f30 0x7f2f3c0693e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.314+0000 7f2f561e2700 1 --2- 172.21.15.81:0/3679110603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f500b5f20 0x7f2f500b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.314+0000 7f2f561e2700 1 --2- 172.21.15.81:0/3679110603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f38004d50 0x7f2f50155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.314+0000 7f2f561e2700 1 --2- 172.21.15.81:0/3679110603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f50148560 0x7f2f501489d0 secure :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400e7d0 tx=0x7f2f44009040 comp rx=0 tx=0).stop 2023-10-07T08:45:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.314+0000 7f2f561e2700 1 -- 172.21.15.81:0/3679110603 >> 172.21.15.81:0/3679110603 conn(0x7f2f5006bb90 msgr2=0x7f2f50068ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.314+0000 7f2f561e2700 1 -- 172.21.15.81:0/3679110603 shutdown_connections 2023-10-07T08:45:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.314+0000 7f2f561e2700 1 -- 172.21.15.81:0/3679110603 wait complete. 2023-10-07T08:45:12.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:45:12.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.441+0000 7fc5a7fff700 1 Processor -- start 2023-10-07T08:45:12.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.441+0000 7fc5a7fff700 1 -- start start 2023-10-07T08:45:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.442+0000 7fc5a7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc5a8159b40 0x7fc5a80cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.442+0000 7fc5a7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5a8068e90 0x7fc5a80cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.442+0000 7fc5a7fff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a80cee10 con 0x7fc5a8159f10 2023-10-07T08:45:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.442+0000 7fc5a7fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a80cd040 con 0x7fc5a8159b40 2023-10-07T08:45:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.442+0000 7fc5a7fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a80cd320 con 0x7fc5a8068e90 2023-10-07T08:45:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.442+0000 7fc5a6ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc5a8159b40 0x7fc5a80cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.442+0000 7fc5a6ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc5a8159b40 0x7fc5a80cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60176/0 (socket says 172.21.15.81:60176) 2023-10-07T08:45:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.442+0000 7fc5a6ffd700 1 -- 172.21.15.81:0/3799137621 learned_addr learned my addr 172.21.15.81:0/3799137621 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.442+0000 7fc5a77fe700 1 --2- 172.21.15.81:0/3799137621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5a8068e90 0x7fc5a80cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.442+0000 7fc5a6ffd700 1 -- 172.21.15.81:0/3799137621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5a8068e90 msgr2=0x7fc5a80cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.442+0000 7fc5a6ffd700 1 --2- 172.21.15.81:0/3799137621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5a8068e90 0x7fc5a80cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.442+0000 7fc5a6ffd700 1 -- 172.21.15.81:0/3799137621 >> v1:172.21.15.89:6789/0 conn(0x7fc5a8159f10 legacy=0x7fc5a8068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.442+0000 7fc5a6ffd700 1 -- 172.21.15.81:0/3799137621 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a80ce7c0 con 0x7fc5a8159b40 2023-10-07T08:45:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.443+0000 7fc5a6ffd700 1 --2- 172.21.15.81:0/3799137621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a8159b40 0x7fc5a80cc600 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc5980099b0 tx=0x7fc598009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e8121c445b3bbd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.443+0000 7fc5a67fc700 1 -- 172.21.15.81:0/3799137621 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598009ea0 con 0x7fc5a8159b40 2023-10-07T08:45:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.443+0000 7fc5a67fc700 1 -- 172.21.15.81:0/3799137621 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59800b860 con 0x7fc5a8159b40 2023-10-07T08:45:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.443+0000 7fc5a67fc700 1 -- 172.21.15.81:0/3799137621 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59800bc00 con 0x7fc5a8159b40 2023-10-07T08:45:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.443+0000 7fc5a7fff700 1 -- 172.21.15.81:0/3799137621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a8159b40 msgr2=0x7fc5a80cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.443+0000 7fc5a7fff700 1 --2- 172.21.15.81:0/3799137621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a8159b40 0x7fc5a80cc600 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc5980099b0 tx=0x7fc598009250 comp rx=0 tx=0).stop 2023-10-07T08:45:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.443+0000 7fc5a7fff700 1 -- 172.21.15.81:0/3799137621 shutdown_connections 2023-10-07T08:45:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.443+0000 7fc5a7fff700 1 --2- 172.21.15.81:0/3799137621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5a8068e90 0x7fc5a80cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.443+0000 7fc5a7fff700 1 --2- 172.21.15.81:0/3799137621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a8159b40 0x7fc5a80cc600 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.443+0000 7fc5a7fff700 1 -- 172.21.15.81:0/3799137621 >> 172.21.15.81:0/3799137621 conn(0x7fc5a80cd660 msgr2=0x7fc5a80cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.443+0000 7fc5a7fff700 1 -- 172.21.15.81:0/3799137621 shutdown_connections 2023-10-07T08:45:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.443+0000 7fc5a7fff700 1 -- 172.21.15.81:0/3799137621 wait complete. 2023-10-07T08:45:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.444+0000 7fc5a7fff700 1 Processor -- start 2023-10-07T08:45:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.444+0000 7fc5a7fff700 1 -- start start 2023-10-07T08:45:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.445+0000 7fc5a7fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5a8068e90 0x7fc5a8167fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.445+0000 7fc5a7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5a8159b40 0x7fc5a816ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.445+0000 7fc5a7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a8159f10 0x7fc5a8169c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.445+0000 7fc5a7fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a816c520 con 0x7fc5a8159f10 2023-10-07T08:45:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.445+0000 7fc5a7fff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a816b2d0 con 0x7fc5a8068e90 2023-10-07T08:45:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.445+0000 7fc5a7fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a816b910 con 0x7fc5a8159b40 2023-10-07T08:45:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.445+0000 7fc5a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a8159f10 0x7fc5a8169c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.445+0000 7fc5a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a8159f10 0x7fc5a8169c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60186/0 (socket says 172.21.15.81:60186) 2023-10-07T08:45:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.445+0000 7fc5a77fe700 1 -- 172.21.15.81:0/2339236509 learned_addr learned my addr 172.21.15.81:0/2339236509 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.445+0000 7fc5a6ffd700 1 --2- 172.21.15.81:0/2339236509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5a8068e90 0x7fc5a8167fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.445+0000 7fc59e7fc700 1 --2- 172.21.15.81:0/2339236509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5a8159b40 0x7fc5a816ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.446+0000 7fc5a77fe700 1 -- 172.21.15.81:0/2339236509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5a8159b40 msgr2=0x7fc5a816ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.446+0000 7fc5a77fe700 1 --2- 172.21.15.81:0/2339236509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5a8159b40 0x7fc5a816ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.446+0000 7fc5a77fe700 1 -- 172.21.15.81:0/2339236509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5a8068e90 msgr2=0x7fc5a8167fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.446+0000 7fc5a77fe700 1 --2- 172.21.15.81:0/2339236509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5a8068e90 0x7fc5a8167fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.446+0000 7fc5a77fe700 1 -- 172.21.15.81:0/2339236509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5980094f0 con 0x7fc5a8159f10 2023-10-07T08:45:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.446+0000 7fc5a77fe700 1 --2- 172.21.15.81:0/2339236509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a8159f10 0x7fc5a8169c50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009ec0 tx=0x7fc5a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:12.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.446+0000 7fc59f7fe700 1 -- 172.21.15.81:0/2339236509 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a000cc20 con 0x7fc5a8159f10 2023-10-07T08:45:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.446+0000 7fc59f7fe700 1 -- 172.21.15.81:0/2339236509 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a000f040 con 0x7fc5a8159f10 2023-10-07T08:45:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.446+0000 7fc5a7fff700 1 -- 172.21.15.81:0/2339236509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a816bbf0 con 0x7fc5a8159f10 2023-10-07T08:45:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.446+0000 7fc59f7fe700 1 -- 172.21.15.81:0/2339236509 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0014480 con 0x7fc5a8159f10 2023-10-07T08:45:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.446+0000 7fc5a7fff700 1 -- 172.21.15.81:0/2339236509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a816c1b0 con 0x7fc5a8159f10 2023-10-07T08:45:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.447+0000 7fc5a7fff700 1 -- 172.21.15.81:0/2339236509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a816c690 con 0x7fc5a8159f10 2023-10-07T08:45:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.447+0000 7fc59f7fe700 1 -- 172.21.15.81:0/2339236509 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5a0014810 con 0x7fc5a8159f10 2023-10-07T08:45:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.448+0000 7fc59f7fe700 1 --2- 172.21.15.81:0/2339236509 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc588066f30 0x7fc5880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.448+0000 7fc59f7fe700 1 -- 172.21.15.81:0/2339236509 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5a0084fe0 con 0x7fc5a8159f10 2023-10-07T08:45:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.448+0000 7fc5a6ffd700 1 --2- 172.21.15.81:0/2339236509 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc588066f30 0x7fc5880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.448+0000 7fc5a6ffd700 1 --2- 172.21.15.81:0/2339236509 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc588066f30 0x7fc5880693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc5980099b0 tx=0x7fc598017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:12.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.452+0000 7fc59f7fe700 1 -- 172.21.15.81:0/2339236509 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5a0052250 con 0x7fc5a8159f10 2023-10-07T08:45:12.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.679+0000 7fc5a7fff700 1 -- 172.21.15.81:0/2339236509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc5a80cb910 con 0x7fc5a8159f10 2023-10-07T08:45:12.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.680+0000 7fc59f7fe700 1 -- 172.21.15.81:0/2339236509 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc5a0055870 con 0x7fc5a8159f10 2023-10-07T08:45:12.681 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:45:12.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.682+0000 7fc5a7fff700 1 -- 172.21.15.81:0/2339236509 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc588066f30 msgr2=0x7fc5880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.682+0000 7fc5a7fff700 1 --2- 172.21.15.81:0/2339236509 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc588066f30 0x7fc5880693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc5980099b0 tx=0x7fc598017000 comp rx=0 tx=0).stop 2023-10-07T08:45:12.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.682+0000 7fc5a7fff700 1 -- 172.21.15.81:0/2339236509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a8159f10 msgr2=0x7fc5a8169c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:12.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.682+0000 7fc5a7fff700 1 --2- 172.21.15.81:0/2339236509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a8159f10 0x7fc5a8169c50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009ec0 tx=0x7fc5a000b040 comp rx=0 tx=0).stop 2023-10-07T08:45:12.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.682+0000 7fc5a7fff700 1 -- 172.21.15.81:0/2339236509 shutdown_connections 2023-10-07T08:45:12.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.682+0000 7fc5a7fff700 1 --2- 172.21.15.81:0/2339236509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a8159f10 0x7fc5a8169c50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.682+0000 7fc5a7fff700 1 --2- 172.21.15.81:0/2339236509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5a8068e90 0x7fc5a8167fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.682+0000 7fc5a7fff700 1 --2- 172.21.15.81:0/2339236509 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc588066f30 0x7fc5880693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.682+0000 7fc5a7fff700 1 --2- 172.21.15.81:0/2339236509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5a8159b40 0x7fc5a816ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:12.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.682+0000 7fc5a7fff700 1 -- 172.21.15.81:0/2339236509 >> 172.21.15.81:0/2339236509 conn(0x7fc5a80cd660 msgr2=0x7fc5a806e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:12.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.682+0000 7fc5a7fff700 1 -- 172.21.15.81:0/2339236509 shutdown_connections 2023-10-07T08:45:12.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:12.682+0000 7fc5a7fff700 1 -- 172.21.15.81:0/2339236509 wait complete. 2023-10-07T08:45:12.695 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:45:12.695 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:45:12.695 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-07T08:45:12.695 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T08:45:12.695 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T08:45:12.695 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:45:12.695 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:45:12.695 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:45:12.696 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:45:12.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:45:12.696 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-07T08:45:12.711 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:45:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:45:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:45:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:45:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-07T08:45:12.711 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:45:12.711 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:45:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:45:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-07T08:45:12.712 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:45:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:45:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-07T08:45:12.712 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:45:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:45:12.712 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:45:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:45:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:45:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42416sec preferred_lft 42416sec 2023-10-07T08:45:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-10-07T08:45:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:45:12.713 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:45:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff 2023-10-07T08:45:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:45:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:45:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::8c72:9ff:fe74:8c7e/64 scope link 2023-10-07T08:45:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:45:12.713 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:45:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:fe:81:9d:9c:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T08:45:12.713 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8fe:81ff:fe9d:9c0a/64 scope link 2023-10-07T08:45:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:45:12.714 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:45:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T08:45:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d838:b7ff:fe6e:914d/64 scope link 2023-10-07T08:45:12.714 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:45:12.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:45:12.714 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:45:12.774 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-07T08:45:12.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:45:12.775 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-07T08:45:12.831 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-07T08:45:12.831 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:45:12.832 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:45:12.832 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:45:12.832 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:45:12.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:45:12.832 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:45:12.832 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:45:12.832 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:45:12.832 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:45:12.832 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:45:12.833 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:45:12.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:45:12.932 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-07T08:45:12.947 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T08:45:12.947 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T08:45:12.947 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:45:12.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:45:12.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-07T08:45:13.011 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:45:13.012 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T08:45:13.067 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:45:13.067 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:45:13.067 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:45:13.121 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:45:13.121 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:45:13.121 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:45:13.200 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:45:13.201 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:45:13.201 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:45:13.209 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:45:13.209 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:45:13.209 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:45:13.209 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:45:13.209 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:45:13.231 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:45:13.232 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:45:13.232 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:45:13.232 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:45:13.232 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:45:13.232 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:45:13.232 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:45:13.232 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:45:13.234 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:45:13.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:45:13.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:45:13.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:45:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.452+0000 7fbb7eecb700 1 Processor -- start 2023-10-07T08:45:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.452+0000 7fbb7eecb700 1 -- start start 2023-10-07T08:45:13.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.453+0000 7fbb7eecb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbb78159b40 0x7fbb780cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:13.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.453+0000 7fbb7eecb700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb780cee10 con 0x7fbb78068e90 2023-10-07T08:45:13.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.453+0000 7fbb7eecb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb780cd040 con 0x7fbb78159f10 2023-10-07T08:45:13.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.453+0000 7fbb7eecb700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb780cd320 con 0x7fbb78159b40 2023-10-07T08:45:13.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.453+0000 7fbb7dec9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbb78159b40 0x7fbb780cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:13.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.453+0000 7fbb7e6ca700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbb78068e90 0x7fbb780cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42950/0 (socket says 172.21.15.81:42950) 2023-10-07T08:45:13.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.453+0000 7fbb7e6ca700 1 -- 172.21.15.81:0/1154565651 learned_addr learned my addr 172.21.15.81:0/1154565651 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:45:13.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.453+0000 7fbb7dec9700 1 -- 172.21.15.81:0/1154565651 >> v1:172.21.15.89:6789/0 conn(0x7fbb78159f10 legacy=0x7fbb78068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.453+0000 7fbb7dec9700 1 -- 172.21.15.81:0/1154565651 >> v1:172.21.15.81:6789/0 conn(0x7fbb78068e90 legacy=0x7fbb780cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.453+0000 7fbb7dec9700 1 -- 172.21.15.81:0/1154565651 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb780ce7c0 con 0x7fbb78159b40 2023-10-07T08:45:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.453+0000 7fbb7cec7700 1 -- 172.21.15.81:0/1154565651 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623621228 0 0) 0x7fbb780cee10 con 0x7fbb78068e90 2023-10-07T08:45:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.453+0000 7fbb7dec9700 1 --2- 172.21.15.81:0/1154565651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78159b40 0x7fbb780cc600 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbb740098e0 tx=0x7fbb740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f99daf19d84eb16 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.453+0000 7fbb7cec7700 1 -- 172.21.15.81:0/1154565651 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74009e80 con 0x7fbb78159b40 2023-10-07T08:45:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.453+0000 7fbb7cec7700 1 -- 172.21.15.81:0/1154565651 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7400b820 con 0x7fbb78159b40 2023-10-07T08:45:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.453+0000 7fbb7cec7700 1 -- 172.21.15.81:0/1154565651 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7400bba0 con 0x7fbb78159b40 2023-10-07T08:45:13.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.454+0000 7fbb7eecb700 1 -- 172.21.15.81:0/1154565651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78159b40 msgr2=0x7fbb780cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:13.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.454+0000 7fbb7eecb700 1 --2- 172.21.15.81:0/1154565651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78159b40 0x7fbb780cc600 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbb740098e0 tx=0x7fbb740091a0 comp rx=0 tx=0).stop 2023-10-07T08:45:13.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.454+0000 7fbb7eecb700 1 -- 172.21.15.81:0/1154565651 shutdown_connections 2023-10-07T08:45:13.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.454+0000 7fbb7eecb700 1 --2- 172.21.15.81:0/1154565651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78159b40 0x7fbb780cc600 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:13.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.454+0000 7fbb7eecb700 1 -- 172.21.15.81:0/1154565651 >> 172.21.15.81:0/1154565651 conn(0x7fbb780cd660 msgr2=0x7fbb780cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:13.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.454+0000 7fbb7eecb700 1 -- 172.21.15.81:0/1154565651 shutdown_connections 2023-10-07T08:45:13.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.454+0000 7fbb7eecb700 1 -- 172.21.15.81:0/1154565651 wait complete. 2023-10-07T08:45:13.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.455+0000 7fbb7eecb700 1 Processor -- start 2023-10-07T08:45:13.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.455+0000 7fbb7eecb700 1 -- start start 2023-10-07T08:45:13.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7eecb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb78068e90 0x7fbb781586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:13.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7eecb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb78159b40 0x7fbb78156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:13.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7eecb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78159f10 0x7fbb7816a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:13.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7eecb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb78159350 con 0x7fbb78159f10 2023-10-07T08:45:13.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7eecb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb78156750 con 0x7fbb78159b40 2023-10-07T08:45:13.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7eecb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb78158d90 con 0x7fbb78068e90 2023-10-07T08:45:13.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7e6ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78159f10 0x7fbb7816a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:13.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7e6ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78159f10 0x7fbb7816a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60204/0 (socket says 172.21.15.81:60204) 2023-10-07T08:45:13.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7e6ca700 1 -- 172.21.15.81:0/2449631982 learned_addr learned my addr 172.21.15.81:0/2449631982 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:13.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7dec9700 1 --2- 172.21.15.81:0/2449631982 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb78068e90 0x7fbb781586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:13.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7d6c8700 1 --2- 172.21.15.81:0/2449631982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb78159b40 0x7fbb78156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:13.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7e6ca700 1 -- 172.21.15.81:0/2449631982 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb78068e90 msgr2=0x7fbb781586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:13.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7e6ca700 1 --2- 172.21.15.81:0/2449631982 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb78068e90 0x7fbb781586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:13.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7e6ca700 1 -- 172.21.15.81:0/2449631982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb78159b40 msgr2=0x7fbb78156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:13.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7e6ca700 1 --2- 172.21.15.81:0/2449631982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb78159b40 0x7fbb78156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:13.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7e6ca700 1 -- 172.21.15.81:0/2449631982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb74009420 con 0x7fbb78159f10 2023-10-07T08:45:13.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7e6ca700 1 --2- 172.21.15.81:0/2449631982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78159f10 0x7fbb7816a4f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000ccc0 tx=0x7fbb70001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:13.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb6dffb700 1 -- 172.21.15.81:0/2449631982 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7000ab10 con 0x7fbb78159f10 2023-10-07T08:45:13.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb6dffb700 1 -- 172.21.15.81:0/2449631982 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7000ac70 con 0x7fbb78159f10 2023-10-07T08:45:13.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb7eecb700 1 -- 172.21.15.81:0/2449631982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb78159070 con 0x7fbb78159f10 2023-10-07T08:45:13.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.456+0000 7fbb6dffb700 1 -- 172.21.15.81:0/2449631982 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700070f0 con 0x7fbb78159f10 2023-10-07T08:45:13.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.457+0000 7fbb7eecb700 1 -- 172.21.15.81:0/2449631982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7815b6e0 con 0x7fbb78159f10 2023-10-07T08:45:13.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.458+0000 7fbb7eecb700 1 -- 172.21.15.81:0/2449631982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7815b8d0 con 0x7fbb78159f10 2023-10-07T08:45:13.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.458+0000 7fbb6dffb700 1 -- 172.21.15.81:0/2449631982 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb70007520 con 0x7fbb78159f10 2023-10-07T08:45:13.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.458+0000 7fbb6dffb700 1 --2- 172.21.15.81:0/2449631982 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbb5c066f30 0x7fbb5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:13.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.458+0000 7fbb6dffb700 1 -- 172.21.15.81:0/2449631982 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbb70084a00 con 0x7fbb78159f10 2023-10-07T08:45:13.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.458+0000 7fbb7dec9700 1 --2- 172.21.15.81:0/2449631982 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbb5c066f30 0x7fbb5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:13.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.459+0000 7fbb7dec9700 1 --2- 172.21.15.81:0/2449631982 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbb5c066f30 0x7fbb5c0693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbb740030c0 tx=0x7fbb74016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.463+0000 7fbb6dffb700 1 -- 172.21.15.81:0/2449631982 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb70051cf0 con 0x7fbb78159f10 2023-10-07T08:45:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.690+0000 7fbb7eecb700 1 -- 172.21.15.81:0/2449631982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbb780cb910 con 0x7fbb78159f10 2023-10-07T08:45:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.690+0000 7fbb6dffb700 1 -- 172.21.15.81:0/2449631982 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbb70055310 con 0x7fbb78159f10 2023-10-07T08:45:13.692 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:45:13.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.692+0000 7fbb7eecb700 1 -- 172.21.15.81:0/2449631982 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbb5c066f30 msgr2=0x7fbb5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:13.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.692+0000 7fbb7eecb700 1 --2- 172.21.15.81:0/2449631982 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbb5c066f30 0x7fbb5c0693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbb740030c0 tx=0x7fbb74016000 comp rx=0 tx=0).stop 2023-10-07T08:45:13.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.692+0000 7fbb7eecb700 1 -- 172.21.15.81:0/2449631982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78159f10 msgr2=0x7fbb7816a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:13.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.692+0000 7fbb7eecb700 1 --2- 172.21.15.81:0/2449631982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78159f10 0x7fbb7816a4f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000ccc0 tx=0x7fbb70001a20 comp rx=0 tx=0).stop 2023-10-07T08:45:13.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.692+0000 7fbb7eecb700 1 -- 172.21.15.81:0/2449631982 shutdown_connections 2023-10-07T08:45:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.692+0000 7fbb7eecb700 1 --2- 172.21.15.81:0/2449631982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb78159f10 0x7fbb7816a4f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.692+0000 7fbb7eecb700 1 --2- 172.21.15.81:0/2449631982 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbb5c066f30 0x7fbb5c0693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.692+0000 7fbb7eecb700 1 --2- 172.21.15.81:0/2449631982 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb78068e90 0x7fbb781586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.692+0000 7fbb7eecb700 1 --2- 172.21.15.81:0/2449631982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb78159b40 0x7fbb78156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.692+0000 7fbb7eecb700 1 -- 172.21.15.81:0/2449631982 >> 172.21.15.81:0/2449631982 conn(0x7fbb780cd660 msgr2=0x7fbb7806dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.692+0000 7fbb7eecb700 1 -- 172.21.15.81:0/2449631982 shutdown_connections 2023-10-07T08:45:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:13.692+0000 7fbb7eecb700 1 -- 172.21.15.81:0/2449631982 wait complete. 2023-10-07T08:45:13.705 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:45:13.705 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:45:13.706 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-07T08:45:13.706 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T08:45:13.706 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T08:45:13.706 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:45:13.706 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:45:13.706 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:45:13.706 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:45:13.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:45:13.707 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-07T08:45:13.726 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:45:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:45:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:45:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:45:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-07T08:45:13.726 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:45:13.727 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:45:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:45:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-10-07T08:45:13.727 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:45:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:45:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-10-07T08:45:13.727 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:45:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:45:13.727 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:45:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:45:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:45:13.727 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42415sec preferred_lft 42415sec 2023-10-07T08:45:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2023-10-07T08:45:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:45:13.728 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:45:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:45:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:45:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:45:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::74d7:a9ff:fe87:ed9/64 scope link 2023-10-07T08:45:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:45:13.728 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:45:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T08:45:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6c40:c5ff:fe3a:a57/64 scope link 2023-10-07T08:45:13.728 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:45:13.728 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:45:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether de:db:cd:68:b1:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T08:45:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::dcdb:cdff:fe68:b178/64 scope link 2023-10-07T08:45:13.729 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:45:13.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:45:13.730 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:45:13.795 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-07T08:45:13.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:45:13.796 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-07T08:45:13.854 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-07T08:45:13.854 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:45:13.854 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:45:13.855 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:45:13.855 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:45:13.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:45:13.855 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:45:13.855 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:45:13.855 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:45:13.855 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:45:13.855 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:45:13.856 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:45:13.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:45:13.962 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-07T08:45:13.977 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T08:45:13.977 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T08:45:13.978 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:45:13.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:45:13.978 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-07T08:45:14.042 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:45:14.043 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T08:45:14.097 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:45:14.097 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:45:14.098 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:45:14.152 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:45:14.152 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:45:14.153 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:45:14.232 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:45:14.232 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:45:14.232 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:45:14.240 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:45:14.240 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:45:14.240 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:45:14.240 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:45:14.241 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:45:14.262 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:45:14.262 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:45:14.262 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:45:14.262 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:45:14.263 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:45:14.263 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:45:14.263 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:45:14.263 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:45:14.264 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:45:14.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:45:14.264 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:45:14.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:45:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.447+0000 7f73d0069700 1 Processor -- start 2023-10-07T08:45:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.447+0000 7f73d0069700 1 -- start start 2023-10-07T08:45:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.447+0000 7f73d0069700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f73c81578d0 0x7f73c80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.447+0000 7f73d0069700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73c8157ca0 0x7f73c815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.448+0000 7f73d0069700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c80d07c0 con 0x7f73c806d120 2023-10-07T08:45:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.448+0000 7f73d0069700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c80cfbb0 con 0x7f73c8157ca0 2023-10-07T08:45:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.448+0000 7f73d0069700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c80cfe90 con 0x7f73c81578d0 2023-10-07T08:45:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.448+0000 7f73cd604700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73c8157ca0 0x7f73c815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.448+0000 7f73cd604700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73c8157ca0 0x7f73c815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60220/0 (socket says 172.21.15.81:60220) 2023-10-07T08:45:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.448+0000 7f73cd604700 1 -- 172.21.15.81:0/817723613 learned_addr learned my addr 172.21.15.81:0/817723613 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.448+0000 7f73cde05700 1 --2- 172.21.15.81:0/817723613 >> v2:172.21.15.89:3300/0 conn(0x7f73c81578d0 0x7f73c80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.448+0000 7f73cd604700 1 -- 172.21.15.81:0/817723613 >> v2:172.21.15.89:3300/0 conn(0x7f73c81578d0 msgr2=0x7f73c80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:45:14.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.448+0000 7f73cd604700 1 --2- 172.21.15.81:0/817723613 >> v2:172.21.15.89:3300/0 conn(0x7f73c81578d0 0x7f73c80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:14.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.448+0000 7f73cd604700 1 -- 172.21.15.81:0/817723613 >> v1:172.21.15.89:6789/0 conn(0x7f73c806d120 legacy=0x7f73c806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:14.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.448+0000 7f73cd604700 1 -- 172.21.15.81:0/817723613 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c80d0170 con 0x7f73c8157ca0 2023-10-07T08:45:14.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.448+0000 7f73cd604700 1 --2- 172.21.15.81:0/817723613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c8157ca0 0x7f73c815af00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f73c80646b0 tx=0x7f73b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb33984e63ddf596 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:14.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.448+0000 7f73cce03700 1 -- 172.21.15.81:0/817723613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b8009e70 con 0x7f73c8157ca0 2023-10-07T08:45:14.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.448+0000 7f73cce03700 1 -- 172.21.15.81:0/817723613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b800b860 con 0x7f73c8157ca0 2023-10-07T08:45:14.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.448+0000 7f73cce03700 1 -- 172.21.15.81:0/817723613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b800bc00 con 0x7f73c8157ca0 2023-10-07T08:45:14.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.449+0000 7f73d0069700 1 -- 172.21.15.81:0/817723613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c8157ca0 msgr2=0x7f73c815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:14.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.449+0000 7f73d0069700 1 --2- 172.21.15.81:0/817723613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c8157ca0 0x7f73c815af00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f73c80646b0 tx=0x7f73b8009250 comp rx=0 tx=0).stop 2023-10-07T08:45:14.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.449+0000 7f73d0069700 1 -- 172.21.15.81:0/817723613 shutdown_connections 2023-10-07T08:45:14.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.449+0000 7f73d0069700 1 --2- 172.21.15.81:0/817723613 >> v2:172.21.15.89:3300/0 conn(0x7f73c81578d0 0x7f73c80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:14.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.449+0000 7f73d0069700 1 --2- 172.21.15.81:0/817723613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c8157ca0 0x7f73c815af00 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:14.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.449+0000 7f73d0069700 1 -- 172.21.15.81:0/817723613 >> 172.21.15.81:0/817723613 conn(0x7f73c806bb90 msgr2=0x7f73c806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:14.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.449+0000 7f73d0069700 1 -- 172.21.15.81:0/817723613 shutdown_connections 2023-10-07T08:45:14.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.449+0000 7f73d0069700 1 -- 172.21.15.81:0/817723613 wait complete. 2023-10-07T08:45:14.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.450+0000 7f73d0069700 1 Processor -- start 2023-10-07T08:45:14.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.450+0000 7f73d0069700 1 -- start start 2023-10-07T08:45:14.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73d0069700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c806d120 0x7f73c8144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:14.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73d0069700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73c81578d0 0x7f73c80cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73d0069700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73c8157ca0 0x7f73c81595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73d0069700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80ccf30 con 0x7f73c806d120 2023-10-07T08:45:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73d0069700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80cc080 con 0x7f73c81578d0 2023-10-07T08:45:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73d0069700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80cc320 con 0x7f73c8157ca0 2023-10-07T08:45:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73cde05700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c806d120 0x7f73c8144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73cde05700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c806d120 0x7f73c8144a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60228/0 (socket says 172.21.15.81:60228) 2023-10-07T08:45:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73cde05700 1 -- 172.21.15.81:0/3212771618 learned_addr learned my addr 172.21.15.81:0/3212771618 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:45:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73ce606700 1 --2- 172.21.15.81:0/3212771618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73c8157ca0 0x7f73c81595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73cd604700 1 --2- 172.21.15.81:0/3212771618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73c81578d0 0x7f73c80cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73cde05700 1 -- 172.21.15.81:0/3212771618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73c8157ca0 msgr2=0x7f73c81595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73cde05700 1 --2- 172.21.15.81:0/3212771618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73c8157ca0 0x7f73c81595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:14.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73cde05700 1 -- 172.21.15.81:0/3212771618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73c81578d0 msgr2=0x7f73c80cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:14.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73cde05700 1 --2- 172.21.15.81:0/3212771618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73c81578d0 0x7f73c80cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:14.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73cde05700 1 -- 172.21.15.81:0/3212771618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b80094f0 con 0x7f73c806d120 2023-10-07T08:45:14.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.451+0000 7f73cde05700 1 --2- 172.21.15.81:0/3212771618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c806d120 0x7f73c8144a10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f73c400ec80 tx=0x7f73c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:14.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.452+0000 7f73bdffb700 1 -- 172.21.15.81:0/3212771618 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c400c850 con 0x7f73c806d120 2023-10-07T08:45:14.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.452+0000 7f73bdffb700 1 -- 172.21.15.81:0/3212771618 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c400c9b0 con 0x7f73c806d120 2023-10-07T08:45:14.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.452+0000 7f73d0069700 1 -- 172.21.15.81:0/3212771618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c80cc600 con 0x7f73c806d120 2023-10-07T08:45:14.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.452+0000 7f73bdffb700 1 -- 172.21.15.81:0/3212771618 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c400cd50 con 0x7f73c806d120 2023-10-07T08:45:14.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.452+0000 7f73d0069700 1 -- 172.21.15.81:0/3212771618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c80ccbc0 con 0x7f73c806d120 2023-10-07T08:45:14.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.453+0000 7f73d0069700 1 -- 172.21.15.81:0/3212771618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c8067ac0 con 0x7f73c806d120 2023-10-07T08:45:14.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.453+0000 7f73bdffb700 1 -- 172.21.15.81:0/3212771618 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73c4013680 con 0x7f73c806d120 2023-10-07T08:45:14.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.454+0000 7f73bdffb700 1 --2- 172.21.15.81:0/3212771618 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f73ac066f30 0x7f73ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:45:14.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.454+0000 7f73bdffb700 1 -- 172.21.15.81:0/3212771618 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f73c4084720 con 0x7f73c806d120 2023-10-07T08:45:14.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.454+0000 7f73cd604700 1 --2- 172.21.15.81:0/3212771618 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f73ac066f30 0x7f73ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:45:14.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.454+0000 7f73cd604700 1 --2- 172.21.15.81:0/3212771618 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f73ac066f30 0x7f73ac0693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f73c80646b0 tx=0x7f73b8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:45:14.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.458+0000 7f73bdffb700 1 -- 172.21.15.81:0/3212771618 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73c4051990 con 0x7f73c806d120 2023-10-07T08:45:14.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.685+0000 7f73d0069700 1 -- 172.21.15.81:0/3212771618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73c80d0450 con 0x7f73c806d120 2023-10-07T08:45:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.686+0000 7f73bdffb700 1 -- 172.21.15.81:0/3212771618 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f73c4054fb0 con 0x7f73c806d120 2023-10-07T08:45:14.687 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:45:14.687 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3279897900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3279897900},{"type":"v1","addr":"172.21.15.89:6835","nonce":3279897900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/102905724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":102905724},{"type":"v1","addr":"172.21.15.89:6834","nonce":102905724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4063096820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":4063096820},{"type":"v1","addr":"172.21.15.81:6836","nonce":4063096820}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:45:05.899585+0000","modified":"2023-10-07T08:45:09.552432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2943588561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2943588561},{"type":"v1","addr":"172.21.15.81:6837","nonce":2943588561}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-07T08:45:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.688+0000 7f73d0069700 1 -- 172.21.15.81:0/3212771618 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f73ac066f30 msgr2=0x7f73ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.688+0000 7f73d0069700 1 --2- 172.21.15.81:0/3212771618 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f73ac066f30 0x7f73ac0693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f73c80646b0 tx=0x7f73b8017000 comp rx=0 tx=0).stop 2023-10-07T08:45:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.688+0000 7f73d0069700 1 -- 172.21.15.81:0/3212771618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c806d120 msgr2=0x7f73c8144a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:45:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.688+0000 7f73d0069700 1 --2- 172.21.15.81:0/3212771618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c806d120 0x7f73c8144a10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f73c400ec80 tx=0x7f73c40091a0 comp rx=0 tx=0).stop 2023-10-07T08:45:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.688+0000 7f73d0069700 1 -- 172.21.15.81:0/3212771618 shutdown_connections 2023-10-07T08:45:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.688+0000 7f73d0069700 1 --2- 172.21.15.81:0/3212771618 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f73ac066f30 0x7f73ac0693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.688+0000 7f73d0069700 1 --2- 172.21.15.81:0/3212771618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73c8157ca0 0x7f73c81595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.688+0000 7f73d0069700 1 --2- 172.21.15.81:0/3212771618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c806d120 0x7f73c8144a10 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.688+0000 7f73d0069700 1 --2- 172.21.15.81:0/3212771618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73c81578d0 0x7f73c80cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:45:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.688+0000 7f73d0069700 1 -- 172.21.15.81:0/3212771618 >> 172.21.15.81:0/3212771618 conn(0x7f73c806bb90 msgr2=0x7f73c815a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:45:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.688+0000 7f73d0069700 1 -- 172.21.15.81:0/3212771618 shutdown_connections 2023-10-07T08:45:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:45:14.688+0000 7f73d0069700 1 -- 172.21.15.81:0/3212771618 wait complete. 2023-10-07T08:45:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2023-10-07T08:45:14.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-07T08:45:14.834 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":5709,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.2815666750000005,"mdsmap_epoch":32,"osdmap_epoch":67,"osdmap_epoch_barrier":67,"uptime":14.263020117} 2023-10-07T08:45:14.834 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 5709, "mdsmap_epoch": 32, "osdmap_epoch": 67, "osdmap_epoch_barrier": 67, "rank_uptime": 8.281566675, "state": "up:active", "uptime": 14.263020117, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:45:14.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-07T08:45:14.963 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_mon_report_interval":"5"} 2023-10-07T08:45:14.963 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-07T08:45:14.963 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-07T08:45:15.085 INFO:teuthology.orchestra.run.smithi081.stdout:{"mon_tick_interval":"5"} 2023-10-07T08:45:15.086 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-07T08:45:15.086 INFO:tasks.cephfs.test_full:pool capacity 557061696, 531MB should be enough to fill it 2023-10-07T08:45:15.086 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-07T08:45:15.086 DEBUG:teuthology.orchestra.run.smithi081:> import time 2023-10-07T08:45:15.086 DEBUG:teuthology.orchestra.run.smithi081:> import datetime 2023-10-07T08:45:15.086 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-10-07T08:45:15.086 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-07T08:45:15.086 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:45:15.087 DEBUG:teuthology.orchestra.run.smithi081:> # Write some buffered data through before going full, all should be well 2023-10-07T08:45:15.087 DEBUG:teuthology.orchestra.run.smithi081:> print("writing some data through which we expect to succeed") 2023-10-07T08:45:15.087 DEBUG:teuthology.orchestra.run.smithi081:> bytes = 0 2023-10-07T08:45:15.087 DEBUG:teuthology.orchestra.run.smithi081:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-07T08:45:15.087 DEBUG:teuthology.orchestra.run.smithi081:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-07T08:45:15.087 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-10-07T08:45:15.087 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f) 2023-10-07T08:45:15.087 DEBUG:teuthology.orchestra.run.smithi081:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-07T08:45:15.087 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:45:15.087 DEBUG:teuthology.orchestra.run.smithi081:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-07T08:45:15.087 DEBUG:teuthology.orchestra.run.smithi081:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-07T08:45:15.087 DEBUG:teuthology.orchestra.run.smithi081:> # buffered IO, the error should always only appear from fsync and not 2023-10-07T08:45:15.087 DEBUG:teuthology.orchestra.run.smithi081:> # from write 2023-10-07T08:45:15.088 DEBUG:teuthology.orchestra.run.smithi081:> full = False 2023-10-07T08:45:15.088 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:45:15.088 DEBUG:teuthology.orchestra.run.smithi081:> for n in range(0, int(531 * 0.9)): 2023-10-07T08:45:15.088 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-07T08:45:15.088 DEBUG:teuthology.orchestra.run.smithi081:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-10-07T08:45:15.088 DEBUG:teuthology.orchestra.run.smithi081:> print("done writing {0} bytes".format(bytes)) 2023-10-07T08:45:15.088 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:45:15.088 DEBUG:teuthology.orchestra.run.smithi081:> # OK, now we should sneak in under the full condition 2023-10-07T08:45:15.088 DEBUG:teuthology.orchestra.run.smithi081:> # due to the time it takes the OSDs to report to the 2023-10-07T08:45:15.088 DEBUG:teuthology.orchestra.run.smithi081:> # mons, and get a successful fsync on our full-making data 2023-10-07T08:45:15.088 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f) 2023-10-07T08:45:15.088 DEBUG:teuthology.orchestra.run.smithi081:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-10-07T08:45:15.088 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:45:15.089 DEBUG:teuthology.orchestra.run.smithi081:> # buffered write, add more dirty data to the buffer 2023-10-07T08:45:15.089 DEBUG:teuthology.orchestra.run.smithi081:> print("starting buffered write") 2023-10-07T08:45:15.089 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-07T08:45:15.089 DEBUG:teuthology.orchestra.run.smithi081:> for n in range(0, int(531 * 0.2)): 2023-10-07T08:45:15.089 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-07T08:45:15.089 DEBUG:teuthology.orchestra.run.smithi081:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-07T08:45:15.089 DEBUG:teuthology.orchestra.run.smithi081:> time.sleep(15.0) 2023-10-07T08:45:15.089 DEBUG:teuthology.orchestra.run.smithi081:> except OSError: 2023-10-07T08:45:15.089 DEBUG:teuthology.orchestra.run.smithi081:> pass; 2023-10-07T08:45:15.089 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:45:15.089 DEBUG:teuthology.orchestra.run.smithi081:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-10-07T08:45:15.089 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:45:15.089 DEBUG:teuthology.orchestra.run.smithi081:> # Wait long enough for a background flush that should fail 2023-10-07T08:45:15.090 DEBUG:teuthology.orchestra.run.smithi081:> time.sleep(30) 2023-10-07T08:45:15.090 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:45:15.090 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2023-10-07T08:45:15.090 DEBUG:teuthology.orchestra.run.smithi081:> # ...and check that the failed background flush is reflected in fclose 2023-10-07T08:45:15.090 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-07T08:45:15.090 DEBUG:teuthology.orchestra.run.smithi081:> os.close(f) 2023-10-07T08:45:15.090 DEBUG:teuthology.orchestra.run.smithi081:> except OSError: 2023-10-07T08:45:15.090 DEBUG:teuthology.orchestra.run.smithi081:> print("close() returned an error as expected") 2023-10-07T08:45:15.090 DEBUG:teuthology.orchestra.run.smithi081:> else: 2023-10-07T08:45:15.090 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("close() failed to raise error") 2023-10-07T08:45:15.090 DEBUG:teuthology.orchestra.run.smithi081:> else: 2023-10-07T08:45:15.090 DEBUG:teuthology.orchestra.run.smithi081:> # The kernel cephfs client does not raise errors on fclose 2023-10-07T08:45:15.090 DEBUG:teuthology.orchestra.run.smithi081:> os.close(f) 2023-10-07T08:45:15.091 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:45:15.091 DEBUG:teuthology.orchestra.run.smithi081:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-07T08:45:15.091 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-07T08:45:15.624 INFO:teuthology.orchestra.run.smithi081.stdout:writing some data through which we expect to succeed 2023-10-07T08:45:15.624 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-07T08:45:15.624 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-10-07T08:45:15.625 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-10-07T08:45:15.625 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-10-07T08:45:15.625 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-10-07T08:45:15.625 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-10-07T08:45:15.625 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-10-07T08:45:15.625 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-10-07T08:45:15.625 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-10-07T08:45:15.625 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-10-07T08:45:15.625 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-10-07T08:45:15.625 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-10-07T08:45:15.626 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-10-07T08:45:15.626 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-10-07T08:45:15.626 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-10-07T08:45:15.626 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-10-07T08:45:15.626 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-10-07T08:45:15.626 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-10-07T08:45:15.626 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-10-07T08:45:15.626 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-10-07T08:45:15.626 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-10-07T08:45:15.626 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-10-07T08:45:15.626 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-10-07T08:45:15.626 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-10-07T08:45:15.627 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-10-07T08:45:15.627 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-10-07T08:45:15.627 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-10-07T08:45:15.627 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-10-07T08:45:15.627 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-10-07T08:45:15.627 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-10-07T08:45:15.627 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-10-07T08:45:15.627 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-10-07T08:45:15.627 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-10-07T08:45:15.627 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-10-07T08:45:15.627 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-10-07T08:45:15.627 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-10-07T08:45:15.628 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-10-07T08:45:15.628 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-10-07T08:45:15.628 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-10-07T08:45:15.628 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-10-07T08:45:15.628 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-10-07T08:45:15.628 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-10-07T08:45:15.628 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-10-07T08:45:15.628 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-10-07T08:45:15.628 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-10-07T08:45:15.628 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-10-07T08:45:15.628 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-10-07T08:45:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-10-07T08:45:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-10-07T08:45:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-10-07T08:45:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-10-07T08:45:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-10-07T08:45:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-10-07T08:45:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-10-07T08:45:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-10-07T08:45:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-10-07T08:45:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-10-07T08:45:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-10-07T08:45:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-10-07T08:45:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-10-07T08:45:15.630 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-10-07T08:45:15.630 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-10-07T08:45:15.630 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-10-07T08:45:15.630 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-10-07T08:45:15.630 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-10-07T08:45:15.630 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-10-07T08:45:15.630 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-10-07T08:45:15.630 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-10-07T08:45:15.630 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-10-07T08:45:15.630 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-10-07T08:45:15.630 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-10-07T08:45:15.630 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-10-07T08:45:15.631 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-10-07T08:45:15.631 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-10-07T08:45:15.631 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-10-07T08:45:15.631 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-10-07T08:45:15.631 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-10-07T08:45:15.631 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-10-07T08:45:15.631 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-10-07T08:45:15.631 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-10-07T08:45:15.631 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-10-07T08:45:15.631 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-10-07T08:45:15.631 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-10-07T08:45:15.631 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-10-07T08:45:15.632 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-10-07T08:45:15.632 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-10-07T08:45:15.632 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-10-07T08:45:15.632 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-10-07T08:45:15.632 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-10-07T08:45:15.632 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-10-07T08:45:15.632 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-10-07T08:45:15.632 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-10-07T08:45:15.632 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-10-07T08:45:15.632 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-10-07T08:45:15.632 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-10-07T08:45:15.633 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-10-07T08:45:15.633 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-10-07T08:45:15.633 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-10-07T08:45:15.633 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-10-07T08:45:15.633 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-10-07T08:45:15.633 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-10-07T08:45:15.633 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-10-07T08:45:15.633 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-10-07T08:45:15.633 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-10-07T08:45:15.633 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-10-07T08:45:15.633 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-10-07T08:45:15.633 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-10-07T08:45:15.634 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-10-07T08:45:15.634 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-10-07T08:45:15.634 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-10-07T08:45:15.634 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-10-07T08:45:15.634 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-10-07T08:45:15.634 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-10-07T08:45:15.634 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-10-07T08:45:15.634 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-10-07T08:45:15.634 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-10-07T08:45:15.634 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-10-07T08:45:15.635 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-10-07T08:45:15.635 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-10-07T08:45:15.635 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-10-07T08:45:15.635 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-10-07T08:45:15.635 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-10-07T08:45:15.635 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-10-07T08:45:15.635 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-10-07T08:45:15.635 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-10-07T08:45:15.635 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-10-07T08:45:15.635 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-10-07T08:45:15.636 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-10-07T08:45:15.636 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-10-07T08:45:15.636 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-10-07T08:45:15.636 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-10-07T08:45:15.636 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-10-07T08:45:15.636 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-10-07T08:45:15.637 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-10-07T08:45:15.637 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-10-07T08:45:15.637 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-10-07T08:45:15.638 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-10-07T08:45:15.638 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-10-07T08:45:15.638 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-10-07T08:45:15.638 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-10-07T08:45:15.638 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-10-07T08:45:15.638 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-10-07T08:45:15.638 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-10-07T08:45:15.638 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-10-07T08:45:15.638 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-10-07T08:45:15.639 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-10-07T08:45:15.639 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-10-07T08:45:15.639 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-10-07T08:45:15.639 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-10-07T08:45:15.639 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-10-07T08:45:15.639 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-10-07T08:45:15.639 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-10-07T08:45:15.639 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-10-07T08:45:15.639 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-10-07T08:45:15.639 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-10-07T08:45:15.673 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-10-07T08:45:15.673 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-10-07T08:45:15.673 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-10-07T08:45:15.673 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-10-07T08:45:15.673 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-10-07T08:45:15.673 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-10-07T08:45:15.673 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-10-07T08:45:15.673 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-10-07T08:45:15.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-10-07T08:45:15.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-10-07T08:45:15.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-10-07T08:45:15.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-10-07T08:45:15.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-10-07T08:45:15.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-10-07T08:45:15.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-10-07T08:45:15.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-10-07T08:45:15.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-10-07T08:45:15.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-10-07T08:45:15.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-10-07T08:45:15.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-10-07T08:45:15.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-10-07T08:45:15.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-10-07T08:45:15.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-10-07T08:45:15.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-10-07T08:45:15.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-10-07T08:45:15.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-10-07T08:45:15.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-10-07T08:45:15.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-10-07T08:45:15.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-10-07T08:45:15.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-10-07T08:45:15.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-10-07T08:45:15.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-10-07T08:45:15.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-10-07T08:45:15.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-10-07T08:45:15.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-10-07T08:45:15.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-10-07T08:45:15.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-10-07T08:45:15.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-10-07T08:45:15.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-10-07T08:45:15.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-10-07T08:45:15.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-10-07T08:45:15.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-10-07T08:45:15.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-10-07T08:45:15.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-10-07T08:45:15.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-10-07T08:45:15.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-10-07T08:45:15.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-10-07T08:45:15.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-10-07T08:45:15.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-10-07T08:45:15.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-10-07T08:45:15.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-10-07T08:45:15.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-10-07T08:45:15.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-10-07T08:45:15.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-10-07T08:45:15.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-10-07T08:45:15.679 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-10-07T08:45:15.679 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-10-07T08:45:15.679 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-10-07T08:45:15.679 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-10-07T08:45:15.679 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-10-07T08:45:15.679 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-10-07T08:45:15.679 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-10-07T08:45:15.680 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-10-07T08:45:15.680 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-10-07T08:45:15.680 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-10-07T08:45:15.680 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-10-07T08:45:15.680 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-10-07T08:45:15.680 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-10-07T08:45:15.680 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-10-07T08:45:15.681 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-10-07T08:45:15.681 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-10-07T08:45:15.681 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-10-07T08:45:15.681 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-10-07T08:45:15.681 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-10-07T08:45:15.681 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-10-07T08:45:15.681 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-10-07T08:45:15.682 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-10-07T08:45:15.682 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-10-07T08:45:15.682 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-10-07T08:45:15.682 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-10-07T08:45:15.682 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-10-07T08:45:15.682 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-10-07T08:45:15.682 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-10-07T08:45:15.683 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-10-07T08:45:15.683 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-10-07T08:45:15.683 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-10-07T08:45:15.683 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-10-07T08:45:15.683 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-10-07T08:45:15.683 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-10-07T08:45:15.683 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-10-07T08:45:15.684 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-10-07T08:45:15.684 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-10-07T08:45:15.684 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-10-07T08:45:15.684 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-10-07T08:45:15.684 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-10-07T08:45:15.684 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-10-07T08:45:15.684 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-10-07T08:45:15.684 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-10-07T08:45:15.685 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-10-07T08:45:15.685 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-10-07T08:45:15.685 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-10-07T08:45:15.685 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-10-07T08:45:15.685 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-10-07T08:45:15.685 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-10-07T08:45:15.686 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-10-07T08:45:15.686 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-10-07T08:45:15.686 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-10-07T08:45:15.686 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-10-07T08:45:15.686 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-10-07T08:45:15.686 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-10-07T08:45:15.686 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-10-07T08:45:15.687 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-10-07T08:45:15.687 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-10-07T08:45:15.687 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-10-07T08:45:15.687 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-10-07T08:45:15.687 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-10-07T08:45:15.687 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-10-07T08:45:15.687 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-10-07T08:45:15.687 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-10-07T08:45:15.688 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-10-07T08:45:15.688 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-10-07T08:45:15.688 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-10-07T08:45:15.688 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-10-07T08:45:15.688 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-10-07T08:45:15.688 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-10-07T08:45:15.688 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-10-07T08:45:15.688 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-10-07T08:45:15.689 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-10-07T08:45:15.689 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-10-07T08:45:15.689 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-10-07T08:45:15.689 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-10-07T08:45:15.689 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-10-07T08:45:15.689 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-10-07T08:45:15.689 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-10-07T08:45:15.690 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-10-07T08:45:15.690 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-10-07T08:45:15.690 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-10-07T08:45:15.690 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-10-07T08:45:15.690 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-10-07T08:45:15.690 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-10-07T08:45:15.690 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-10-07T08:45:15.691 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-10-07T08:45:15.691 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-10-07T08:45:15.691 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-10-07T08:45:15.691 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-10-07T08:45:15.691 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-10-07T08:45:15.691 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-10-07T08:45:15.691 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-10-07T08:45:15.691 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-10-07T08:45:15.692 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-10-07T08:45:15.692 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-10-07T08:45:15.692 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-10-07T08:45:15.692 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-10-07T08:45:15.692 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-10-07T08:45:15.692 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-10-07T08:45:15.721 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-10-07T08:45:15.721 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-10-07T08:45:15.721 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-10-07T08:45:15.721 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-10-07T08:45:15.721 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-10-07T08:45:15.721 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-10-07T08:45:15.721 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-10-07T08:45:15.721 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-10-07T08:45:15.721 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-10-07T08:45:15.722 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-10-07T08:45:15.722 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-10-07T08:45:15.722 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-10-07T08:45:15.722 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-10-07T08:45:15.722 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-10-07T08:45:15.722 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-10-07T08:45:15.722 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-10-07T08:45:15.722 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-10-07T08:45:15.722 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-10-07T08:45:15.722 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-10-07T08:45:15.722 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-10-07T08:45:15.722 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-10-07T08:45:15.723 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-10-07T08:45:15.723 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-10-07T08:45:15.723 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-10-07T08:45:15.723 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-10-07T08:45:15.723 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-10-07T08:45:15.723 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-10-07T08:45:15.723 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-10-07T08:45:15.723 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-10-07T08:45:15.723 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-10-07T08:45:15.723 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-10-07T08:45:15.723 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-10-07T08:45:15.723 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-10-07T08:45:15.724 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-10-07T08:45:15.724 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-10-07T08:45:15.724 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-10-07T08:45:15.724 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-10-07T08:45:15.724 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-10-07T08:45:15.724 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-10-07T08:45:15.724 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-10-07T08:45:15.724 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-10-07T08:45:15.724 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-10-07T08:45:15.724 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-10-07T08:45:15.724 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-10-07T08:45:15.724 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-10-07T08:45:15.725 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-10-07T08:45:15.725 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-10-07T08:45:15.725 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-10-07T08:45:15.725 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-10-07T08:45:15.725 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-10-07T08:45:15.725 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-10-07T08:45:15.725 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-10-07T08:45:15.725 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-10-07T08:45:15.725 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-10-07T08:45:15.725 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-10-07T08:45:15.725 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-10-07T08:45:15.725 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-10-07T08:45:15.725 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-10-07T08:45:15.726 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-10-07T08:45:15.726 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-10-07T08:45:15.726 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-10-07T08:45:15.726 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-10-07T08:45:15.726 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-10-07T08:45:15.726 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-10-07T08:45:15.726 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-10-07T08:45:15.726 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-10-07T08:45:15.726 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-10-07T08:45:15.726 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-10-07T08:45:15.726 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-10-07T08:45:15.726 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-10-07T08:45:15.727 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-10-07T08:45:15.727 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-10-07T08:45:15.727 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-10-07T08:45:15.727 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-10-07T08:45:15.727 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-10-07T08:45:15.727 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-10-07T08:45:15.727 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-10-07T08:45:15.727 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-10-07T08:45:15.727 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-10-07T08:45:15.727 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-10-07T08:45:15.727 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-10-07T08:45:15.727 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-10-07T08:45:15.727 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-10-07T08:45:15.728 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-10-07T08:45:15.728 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-10-07T08:45:15.728 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-10-07T08:45:15.728 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-10-07T08:45:15.728 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-10-07T08:45:15.728 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-10-07T08:45:15.728 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-10-07T08:45:15.728 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-10-07T08:45:15.728 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-10-07T08:45:15.728 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-10-07T08:45:15.728 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-10-07T08:45:15.729 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-10-07T08:45:15.729 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-10-07T08:45:15.729 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-10-07T08:45:15.729 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-10-07T08:45:15.729 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-10-07T08:45:15.729 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-10-07T08:45:15.729 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-10-07T08:45:15.729 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-10-07T08:45:15.729 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-10-07T08:45:15.729 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-10-07T08:45:15.729 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-10-07T08:45:15.729 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-10-07T08:45:15.730 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-10-07T08:45:15.730 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-10-07T08:45:15.730 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-10-07T08:45:15.730 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-10-07T08:45:15.730 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-10-07T08:45:15.730 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-10-07T08:45:15.730 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-10-07T08:45:15.730 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-10-07T08:45:15.730 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-10-07T08:45:15.730 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-10-07T08:45:15.730 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-10-07T08:45:15.730 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-10-07T08:45:15.731 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-10-07T08:45:15.731 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-10-07T08:45:15.731 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-10-07T08:45:15.731 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-10-07T08:45:15.731 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-10-07T08:45:15.731 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-10-07T08:45:15.731 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-10-07T08:45:15.731 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-10-07T08:45:15.732 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-10-07T08:45:15.732 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-10-07T08:45:15.732 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-10-07T08:45:15.732 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-10-07T08:45:15.732 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-10-07T08:45:15.732 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-10-07T08:45:15.732 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-10-07T08:45:15.732 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-10-07T08:45:15.732 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-10-07T08:45:15.732 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-10-07T08:45:15.732 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-10-07T08:45:15.732 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-10-07T08:45:15.733 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-10-07T08:45:15.733 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-10-07T08:45:15.733 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-10-07T08:45:15.733 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-10-07T08:45:15.733 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-10-07T08:45:15.733 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-10-07T08:45:15.733 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-10-07T08:45:15.733 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-10-07T08:45:15.733 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-10-07T08:45:15.733 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-10-07T08:45:15.733 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-10-07T08:45:15.733 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-10-07T08:45:15.734 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-10-07T08:45:15.734 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-10-07T08:45:15.734 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-10-07T08:45:15.734 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-10-07T08:45:15.734 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-10-07T08:45:17.646 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:45:17.645+0000 7f43c6f32700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-07T08:45:23.240 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:45:23.239+0000 7f43c6f32700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-07T08:45:25.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:45:25.201 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:45:55.258 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:45:55.261 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:46:25.322 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:46:25.325 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:46:31.165 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-10-07T08:46:31.176 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-10-07T08:46:31.176 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-10-07T08:46:31.176 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-10-07T08:46:31.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-10-07T08:46:31.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-10-07T08:46:31.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-10-07T08:46:31.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-10-07T08:46:31.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-10-07T08:46:31.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-10-07T08:46:31.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-10-07T08:46:31.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-10-07T08:46:31.177 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-10-07T08:46:31.177 INFO:teuthology.orchestra.run.smithi081.stdout:done writing 500695040 bytes 2023-10-07T08:46:31.177 INFO:teuthology.orchestra.run.smithi081.stdout:successfully fsync'ed prior to getting full state reported 2023-10-07T08:46:31.177 INFO:teuthology.orchestra.run.smithi081.stdout:starting buffered write 2023-10-07T08:46:31.178 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-07T08:46:31.178 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-07T08:46:31.178 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-07T08:46:31.178 INFO:teuthology.orchestra.run.smithi081.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-10-07T08:46:31.251 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:46:31.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:46:31.381 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:46:31.634 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:46:31.634 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T08:46:31.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:46:31.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T08:46:31.675 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:46:31.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:46:31.964 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T08:46:31.981 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T08:46:32.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:46:32.028 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T08:46:32.068 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:46:32.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:46:32.068 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T08:46:32.125 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:46:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.243+0000 7fbbd39ae700 1 Processor -- start 2023-10-07T08:46:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.244+0000 7fbbd39ae700 1 -- start start 2023-10-07T08:46:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.244+0000 7fbbd39ae700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbbcc1578d0 0x7fbbcc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.244+0000 7fbbd39ae700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbbcc06d120 0x7fbbcc06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.244+0000 7fbbd39ae700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbcc0d07c0 con 0x7fbbcc157ca0 2023-10-07T08:46:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.244+0000 7fbbd39ae700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbcc06da50 con 0x7fbbcc1578d0 2023-10-07T08:46:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.244+0000 7fbbd39ae700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbcc0cfbb0 con 0x7fbbcc06d120 2023-10-07T08:46:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.244+0000 7fbbd0f49700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbbcc157ca0 0x7fbbcc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36062/0 (socket says 172.21.15.81:36062) 2023-10-07T08:46:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.245+0000 7fbbd0f49700 1 -- 172.21.15.81:0/2556630442 learned_addr learned my addr 172.21.15.81:0/2556630442 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.244+0000 7fbbd174a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbbcc1578d0 0x7fbbcc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.245+0000 7fbbcbfff700 1 -- 172.21.15.81:0/2556630442 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836496183 0 0) 0x7fbbcc0d07c0 con 0x7fbbcc157ca0 2023-10-07T08:46:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.245+0000 7fbbcbfff700 1 -- 172.21.15.81:0/2556630442 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbb4003570 con 0x7fbbcc157ca0 2023-10-07T08:46:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.245+0000 7fbbd1f4b700 1 --2- 172.21.15.81:0/2556630442 >> v2:172.21.15.89:3300/0 conn(0x7fbbcc06d120 0x7fbbcc06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.245+0000 7fbbd174a700 1 -- 172.21.15.81:0/2556630442 >> v2:172.21.15.89:3300/0 conn(0x7fbbcc06d120 msgr2=0x7fbbcc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.245+0000 7fbbd174a700 1 --2- 172.21.15.81:0/2556630442 >> v2:172.21.15.89:3300/0 conn(0x7fbbcc06d120 0x7fbbcc06d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.245+0000 7fbbd174a700 1 -- 172.21.15.81:0/2556630442 >> v1:172.21.15.81:6789/0 conn(0x7fbbcc157ca0 legacy=0x7fbbcc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.245+0000 7fbbd174a700 1 -- 172.21.15.81:0/2556630442 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc0cfe90 con 0x7fbbcc1578d0 2023-10-07T08:46:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.245+0000 7fbbd174a700 1 --2- 172.21.15.81:0/2556630442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbcc1578d0 0x7fbbcc0cf4f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc068300 tx=0x7fbbbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4e5186565dd24e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.245+0000 7fbbcbfff700 1 -- 172.21.15.81:0/2556630442 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc011630 con 0x7fbbcc1578d0 2023-10-07T08:46:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.245+0000 7fbbcbfff700 1 -- 172.21.15.81:0/2556630442 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc011790 con 0x7fbbcc1578d0 2023-10-07T08:46:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.245+0000 7fbbcbfff700 1 -- 172.21.15.81:0/2556630442 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc011b10 con 0x7fbbcc1578d0 2023-10-07T08:46:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.246+0000 7fbbd39ae700 1 -- 172.21.15.81:0/2556630442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbcc1578d0 msgr2=0x7fbbcc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.246+0000 7fbbd39ae700 1 --2- 172.21.15.81:0/2556630442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbcc1578d0 0x7fbbcc0cf4f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc068300 tx=0x7fbbbc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.246+0000 7fbbd39ae700 1 -- 172.21.15.81:0/2556630442 shutdown_connections 2023-10-07T08:46:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.246+0000 7fbbd39ae700 1 --2- 172.21.15.81:0/2556630442 >> v2:172.21.15.89:3300/0 conn(0x7fbbcc06d120 0x7fbbcc06d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.246+0000 7fbbd39ae700 1 --2- 172.21.15.81:0/2556630442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbcc1578d0 0x7fbbcc0cf4f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.246+0000 7fbbd39ae700 1 -- 172.21.15.81:0/2556630442 >> 172.21.15.81:0/2556630442 conn(0x7fbbcc06bb90 msgr2=0x7fbbcc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.246+0000 7fbbd39ae700 1 -- 172.21.15.81:0/2556630442 shutdown_connections 2023-10-07T08:46:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.246+0000 7fbbd39ae700 1 -- 172.21.15.81:0/2556630442 wait complete. 2023-10-07T08:46:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.247+0000 7fbbd39ae700 1 Processor -- start 2023-10-07T08:46:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.247+0000 7fbbd39ae700 1 -- start start 2023-10-07T08:46:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd39ae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbbcc06d120 0x7fbbcc0ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd39ae700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbcc1578d0 0x7fbbcc152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd39ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbcc157ca0 0x7fbbcc0b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd39ae700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc0aadf0 con 0x7fbbcc157ca0 2023-10-07T08:46:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd39ae700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc0ac5e0 con 0x7fbbcc1578d0 2023-10-07T08:46:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd39ae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc0ab000 con 0x7fbbcc06d120 2023-10-07T08:46:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd1f4b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbcc157ca0 0x7fbbcc0b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd1f4b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbcc157ca0 0x7fbbcc0b60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59612/0 (socket says 172.21.15.81:59612) 2023-10-07T08:46:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd1f4b700 1 -- 172.21.15.81:0/1131638807 learned_addr learned my addr 172.21.15.81:0/1131638807 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd0f49700 1 --2- 172.21.15.81:0/1131638807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbcc1578d0 0x7fbbcc152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd1f4b700 1 -- 172.21.15.81:0/1131638807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbbcc06d120 msgr2=0x7fbbcc0ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd1f4b700 1 --2- 172.21.15.81:0/1131638807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbbcc06d120 0x7fbbcc0ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd1f4b700 1 -- 172.21.15.81:0/1131638807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbcc1578d0 msgr2=0x7fbbcc152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd1f4b700 1 --2- 172.21.15.81:0/1131638807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbcc1578d0 0x7fbbcc152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd1f4b700 1 -- 172.21.15.81:0/1131638807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc009420 con 0x7fbbcc157ca0 2023-10-07T08:46:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd1f4b700 1 --2- 172.21.15.81:0/1131638807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbcc157ca0 0x7fbbcc0b60c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400ceb0 tx=0x7fbbc4007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbc97fa700 1 -- 172.21.15.81:0/1131638807 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc400ae40 con 0x7fbbcc157ca0 2023-10-07T08:46:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbc97fa700 1 -- 172.21.15.81:0/1131638807 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc4016430 con 0x7fbbcc157ca0 2023-10-07T08:46:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbc97fa700 1 -- 172.21.15.81:0/1131638807 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc40167d0 con 0x7fbbcc157ca0 2023-10-07T08:46:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd39ae700 1 -- 172.21.15.81:0/1131638807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbcc0ab2e0 con 0x7fbbcc157ca0 2023-10-07T08:46:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.248+0000 7fbbd39ae700 1 -- 172.21.15.81:0/1131638807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbcc0ab920 con 0x7fbbcc157ca0 2023-10-07T08:46:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.249+0000 7fbbd39ae700 1 -- 172.21.15.81:0/1131638807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbcc067ac0 con 0x7fbbcc157ca0 2023-10-07T08:46:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.250+0000 7fbbc97fa700 1 -- 172.21.15.81:0/1131638807 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbc4003020 con 0x7fbbcc157ca0 2023-10-07T08:46:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.250+0000 7fbbc97fa700 1 --2- 172.21.15.81:0/1131638807 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbbb8066f30 0x7fbbb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.250+0000 7fbbc97fa700 1 -- 172.21.15.81:0/1131638807 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbc4012070 con 0x7fbbcc157ca0 2023-10-07T08:46:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.250+0000 7fbbd174a700 1 --2- 172.21.15.81:0/1131638807 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbbb8066f30 0x7fbbb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.250+0000 7fbbc97fa700 1 -- 172.21.15.81:0/1131638807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7fbbb806ea50 con 0x7fbbcc157ca0 2023-10-07T08:46:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.250+0000 7fbbd174a700 1 --2- 172.21.15.81:0/1131638807 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbbb8066f30 0x7fbbb80693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0091e0 tx=0x7fbbbc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.254+0000 7fbbc97fa700 1 -- 172.21.15.81:0/1131638807 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbc40526d0 con 0x7fbbcc157ca0 2023-10-07T08:46:32.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.480+0000 7fbbd39ae700 1 -- 172.21.15.81:0/1131638807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbcc0d0170 con 0x7fbbcc157ca0 2023-10-07T08:46:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.480+0000 7fbbc97fa700 1 -- 172.21.15.81:0/1131638807 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fbbc4055cf0 con 0x7fbbcc157ca0 2023-10-07T08:46:32.536 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:32.537 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3279897900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3279897900},{"type":"v1","addr":"172.21.15.89:6835","nonce":3279897900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/102905724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":102905724},{"type":"v1","addr":"172.21.15.89:6834","nonce":102905724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4063096820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":4063096820},{"type":"v1","addr":"172.21.15.81:6836","nonce":4063096820}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:45:05.899585+0000","modified":"2023-10-07T08:45:09.552432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2943588561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2943588561},{"type":"v1","addr":"172.21.15.81:6837","nonce":2943588561}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-07T08:46:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.482+0000 7fbbd39ae700 1 -- 172.21.15.81:0/1131638807 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbbb8066f30 msgr2=0x7fbbb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.482+0000 7fbbd39ae700 1 --2- 172.21.15.81:0/1131638807 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbbb8066f30 0x7fbbb80693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0091e0 tx=0x7fbbbc017000 comp rx=0 tx=0).stop 2023-10-07T08:46:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.482+0000 7fbbd39ae700 1 -- 172.21.15.81:0/1131638807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbcc157ca0 msgr2=0x7fbbcc0b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.482+0000 7fbbd39ae700 1 --2- 172.21.15.81:0/1131638807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbcc157ca0 0x7fbbcc0b60c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400ceb0 tx=0x7fbbc4007870 comp rx=0 tx=0).stop 2023-10-07T08:46:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.482+0000 7fbbd39ae700 1 -- 172.21.15.81:0/1131638807 shutdown_connections 2023-10-07T08:46:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.482+0000 7fbbd39ae700 1 --2- 172.21.15.81:0/1131638807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbcc157ca0 0x7fbbcc0b60c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.482+0000 7fbbd39ae700 1 --2- 172.21.15.81:0/1131638807 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbbb8066f30 0x7fbbb80693e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.482+0000 7fbbd39ae700 1 --2- 172.21.15.81:0/1131638807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbbcc06d120 0x7fbbcc0ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.482+0000 7fbbd39ae700 1 --2- 172.21.15.81:0/1131638807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbcc1578d0 0x7fbbcc152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.482+0000 7fbbd39ae700 1 -- 172.21.15.81:0/1131638807 >> 172.21.15.81:0/1131638807 conn(0x7fbbcc06bb90 msgr2=0x7fbbcc1568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.482+0000 7fbbd39ae700 1 -- 172.21.15.81:0/1131638807 shutdown_connections 2023-10-07T08:46:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.482+0000 7fbbd39ae700 1 -- 172.21.15.81:0/1131638807 wait complete. 2023-10-07T08:46:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2023-10-07T08:46:32.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:46:32.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.703+0000 7f411aa93700 1 Processor -- start 2023-10-07T08:46:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.703+0000 7f411aa93700 1 -- start start 2023-10-07T08:46:33.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.704+0000 7f411aa93700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f41140ce270 0x7f411406dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.704+0000 7f411aa93700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f411406a020 0x7f411415a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.704+0000 7f411aa93700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41140cbec0 con 0x7f4114157860 2023-10-07T08:46:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.704+0000 7f411aa93700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41140cb9d0 con 0x7f41140ce270 2023-10-07T08:46:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.704+0000 7f411aa93700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411415b2d0 con 0x7f411406a020 2023-10-07T08:46:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.705+0000 7f411a292700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f411406a020 0x7f411415a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.705+0000 7f4119a91700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4114157860 0x7f41140cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53798/0 (socket says 172.21.15.81:53798) 2023-10-07T08:46:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.705+0000 7f4119a91700 1 -- 172.21.15.81:0/947395832 learned_addr learned my addr 172.21.15.81:0/947395832 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.705+0000 7f4119290700 1 --2- 172.21.15.81:0/947395832 >> v2:172.21.15.81:3300/0 conn(0x7f41140ce270 0x7f411406dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.705+0000 7f411a292700 1 -- 172.21.15.81:0/947395832 >> v2:172.21.15.81:3300/0 conn(0x7f41140ce270 msgr2=0x7f411406dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.705+0000 7f411a292700 1 --2- 172.21.15.81:0/947395832 >> v2:172.21.15.81:3300/0 conn(0x7f41140ce270 0x7f411406dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.705+0000 7f411a292700 1 -- 172.21.15.81:0/947395832 >> v1:172.21.15.81:6789/0 conn(0x7f4114157860 legacy=0x7f41140cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.705+0000 7f411a292700 1 -- 172.21.15.81:0/947395832 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41140cc180 con 0x7f411406a020 2023-10-07T08:46:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.705+0000 7f411a292700 1 --2- 172.21.15.81:0/947395832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f411406a020 0x7f411415a300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f41140b3a70 tx=0x7f410c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efaf703a8f282867 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.706+0000 7f4118a8f700 1 -- 172.21.15.81:0/947395832 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c00e070 con 0x7f411406a020 2023-10-07T08:46:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.706+0000 7f4118a8f700 1 -- 172.21.15.81:0/947395832 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410c00bb60 con 0x7f411406a020 2023-10-07T08:46:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.706+0000 7f4118a8f700 1 -- 172.21.15.81:0/947395832 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c012430 con 0x7f411406a020 2023-10-07T08:46:33.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.706+0000 7f411aa93700 1 -- 172.21.15.81:0/947395832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f411406a020 msgr2=0x7f411415a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:33.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.706+0000 7f411aa93700 1 --2- 172.21.15.81:0/947395832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f411406a020 0x7f411415a300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f41140b3a70 tx=0x7f410c009780 comp rx=0 tx=0).stop 2023-10-07T08:46:33.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.706+0000 7f411aa93700 1 -- 172.21.15.81:0/947395832 shutdown_connections 2023-10-07T08:46:33.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.706+0000 7f411aa93700 1 --2- 172.21.15.81:0/947395832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f411406a020 0x7f411415a300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.706+0000 7f411aa93700 1 --2- 172.21.15.81:0/947395832 >> v2:172.21.15.81:3300/0 conn(0x7f41140ce270 0x7f411406dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.706+0000 7f411aa93700 1 -- 172.21.15.81:0/947395832 >> 172.21.15.81:0/947395832 conn(0x7f4114063230 msgr2=0x7f4114063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:33.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.706+0000 7f411aa93700 1 -- 172.21.15.81:0/947395832 shutdown_connections 2023-10-07T08:46:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.706+0000 7f411aa93700 1 -- 172.21.15.81:0/947395832 wait complete. 2023-10-07T08:46:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.708+0000 7f411aa93700 1 Processor -- start 2023-10-07T08:46:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.708+0000 7f411aa93700 1 -- start start 2023-10-07T08:46:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.708+0000 7f411aa93700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411406a020 0x7f4114151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.708+0000 7f411aa93700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41140ce270 0x7f4114153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.708+0000 7f411aa93700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4114157860 0x7f411406cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.708+0000 7f411aa93700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41140c7ac0 con 0x7f411406a020 2023-10-07T08:46:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.708+0000 7f411aa93700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4114151670 con 0x7f4114157860 2023-10-07T08:46:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.708+0000 7f411aa93700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4114154540 con 0x7f41140ce270 2023-10-07T08:46:33.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.708+0000 7f4119a91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411406a020 0x7f4114151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:33.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.708+0000 7f4119a91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411406a020 0x7f4114151130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33122/0 (socket says 172.21.15.81:33122) 2023-10-07T08:46:33.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.708+0000 7f4119a91700 1 -- 172.21.15.81:0/2804865042 learned_addr learned my addr 172.21.15.81:0/2804865042 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:33.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.709+0000 7f4119290700 1 --2- 172.21.15.81:0/2804865042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41140ce270 0x7f4114153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:33.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.709+0000 7f411a292700 1 --2- 172.21.15.81:0/2804865042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4114157860 0x7f411406cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:33.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.709+0000 7f4119a91700 1 -- 172.21.15.81:0/2804865042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41140ce270 msgr2=0x7f4114153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:33.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.709+0000 7f4119a91700 1 --2- 172.21.15.81:0/2804865042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41140ce270 0x7f4114153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.709+0000 7f4119a91700 1 -- 172.21.15.81:0/2804865042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4114157860 msgr2=0x7f411406cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:33.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.709+0000 7f4119a91700 1 --2- 172.21.15.81:0/2804865042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4114157860 0x7f411406cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.709+0000 7f4119a91700 1 -- 172.21.15.81:0/2804865042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c009a20 con 0x7f411406a020 2023-10-07T08:46:33.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.709+0000 7f4119a91700 1 --2- 172.21.15.81:0/2804865042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411406a020 0x7f4114151130 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f411000c560 tx=0x7f4110001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:33.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.709+0000 7f4109ffb700 1 -- 172.21.15.81:0/2804865042 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110005b30 con 0x7f411406a020 2023-10-07T08:46:33.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.709+0000 7f4109ffb700 1 -- 172.21.15.81:0/2804865042 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4110005c90 con 0x7f411406a020 2023-10-07T08:46:33.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.709+0000 7f411aa93700 1 -- 172.21.15.81:0/2804865042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4114154820 con 0x7f411406a020 2023-10-07T08:46:33.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.709+0000 7f4109ffb700 1 -- 172.21.15.81:0/2804865042 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110007320 con 0x7f411406a020 2023-10-07T08:46:33.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.709+0000 7f411aa93700 1 -- 172.21.15.81:0/2804865042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4114154de0 con 0x7f411406a020 2023-10-07T08:46:33.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.710+0000 7f411aa93700 1 -- 172.21.15.81:0/2804865042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41140c7890 con 0x7f411406a020 2023-10-07T08:46:33.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.710+0000 7f4109ffb700 1 -- 172.21.15.81:0/2804865042 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f411001b3b0 con 0x7f411406a020 2023-10-07T08:46:33.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.711+0000 7f4109ffb700 1 --2- 172.21.15.81:0/2804865042 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f40f8066fb0 0x7f40f8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.711+0000 7f4109ffb700 1 -- 172.21.15.81:0/2804865042 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4110083970 con 0x7f411406a020 2023-10-07T08:46:33.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.711+0000 7f4119290700 1 --2- 172.21.15.81:0/2804865042 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f40f8066fb0 0x7f40f8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:33.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.711+0000 7f4109ffb700 1 -- 172.21.15.81:0/2804865042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7f40f806ead0 con 0x7f411406a020 2023-10-07T08:46:33.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.711+0000 7f4119290700 1 --2- 172.21.15.81:0/2804865042 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f40f8066fb0 0x7f40f8069460 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f41140b2790 tx=0x7f41040091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:33.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.715+0000 7f4109ffb700 1 -- 172.21.15.81:0/2804865042 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4110017060 con 0x7f411406a020 2023-10-07T08:46:33.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.898+0000 7f411aa93700 1 -- 172.21.15.81:0/2804865042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4114071b10 con 0x7f411406a020 2023-10-07T08:46:33.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.899+0000 7f4109ffb700 1 -- 172.21.15.81:0/2804865042 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+15360 (secure 0 0 0) 0x7f4110050b40 con 0x7f411406a020 2023-10-07T08:46:33.337 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:33.337 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":71,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:45:22.252317+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:45:03.701565+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-07T08:45:04.877693+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:46:33.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.901+0000 7f411aa93700 1 -- 172.21.15.81:0/2804865042 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f40f8066fb0 msgr2=0x7f40f8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:33.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.901+0000 7f411aa93700 1 --2- 172.21.15.81:0/2804865042 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f40f8066fb0 0x7f40f8069460 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f41140b2790 tx=0x7f41040091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.901+0000 7f411aa93700 1 -- 172.21.15.81:0/2804865042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411406a020 msgr2=0x7f4114151130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:33.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.901+0000 7f411aa93700 1 --2- 172.21.15.81:0/2804865042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411406a020 0x7f4114151130 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f411000c560 tx=0x7f4110001020 comp rx=0 tx=0).stop 2023-10-07T08:46:33.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.901+0000 7f411aa93700 1 -- 172.21.15.81:0/2804865042 shutdown_connections 2023-10-07T08:46:33.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.901+0000 7f411aa93700 1 --2- 172.21.15.81:0/2804865042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4114157860 0x7f411406cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.901+0000 7f411aa93700 1 --2- 172.21.15.81:0/2804865042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411406a020 0x7f4114151130 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.901+0000 7f411aa93700 1 --2- 172.21.15.81:0/2804865042 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f40f8066fb0 0x7f40f8069460 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.901+0000 7f411aa93700 1 --2- 172.21.15.81:0/2804865042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41140ce270 0x7f4114153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.901+0000 7f411aa93700 1 -- 172.21.15.81:0/2804865042 >> 172.21.15.81:0/2804865042 conn(0x7f4114063230 msgr2=0x7f4114063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:33.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.901+0000 7f411aa93700 1 -- 172.21.15.81:0/2804865042 shutdown_connections 2023-10-07T08:46:33.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:32.901+0000 7f411aa93700 1 -- 172.21.15.81:0/2804865042 wait complete. 2023-10-07T08:46:33.340 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:45:03.701565+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:45:04.877693+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:46:33.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:46:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.504+0000 7fd9ef05b700 1 Processor -- start 2023-10-07T08:46:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.504+0000 7fd9ef05b700 1 -- start start 2023-10-07T08:46:33.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.505+0000 7fd9ef05b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9e80d0b80 0x7fd9e80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.505+0000 7fd9ef05b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd9e80d02b0 0x7fd9e806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.505+0000 7fd9ef05b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e80cf2d0 con 0x7fd9e80d0f50 2023-10-07T08:46:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.505+0000 7fd9ef05b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e815a690 con 0x7fd9e80d02b0 2023-10-07T08:46:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.505+0000 7fd9ef05b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e806dc00 con 0x7fd9e80d0b80 2023-10-07T08:46:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.505+0000 7fd9ed858700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd9e80d02b0 0x7fd9e806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.505+0000 7fd9ee85a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd9e80d0f50 0x7fd9e815b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53808/0 (socket says 172.21.15.81:53808) 2023-10-07T08:46:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.505+0000 7fd9ee85a700 1 -- 172.21.15.81:0/1008803783 learned_addr learned my addr 172.21.15.81:0/1008803783 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.505+0000 7fd9ee059700 1 --2- 172.21.15.81:0/1008803783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9e80d0b80 0x7fd9e80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.505+0000 7fd9ed858700 1 -- 172.21.15.81:0/1008803783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9e80d0b80 msgr2=0x7fd9e80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.505+0000 7fd9ed858700 1 --2- 172.21.15.81:0/1008803783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9e80d0b80 0x7fd9e80cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.505+0000 7fd9ed858700 1 -- 172.21.15.81:0/1008803783 >> v1:172.21.15.81:6789/0 conn(0x7fd9e80d0f50 legacy=0x7fd9e815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.505+0000 7fd9ed057700 1 -- 172.21.15.81:0/1008803783 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491923991 0 0) 0x7fd9e80cf2d0 con 0x7fd9e80d0f50 2023-10-07T08:46:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.505+0000 7fd9ed858700 1 -- 172.21.15.81:0/1008803783 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e80cf570 con 0x7fd9e80d02b0 2023-10-07T08:46:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.505+0000 7fd9ed858700 1 --2- 172.21.15.81:0/1008803783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e80d02b0 0x7fd9e806cff0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0098e0 tx=0x7fd9dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2fc099415dfe73 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.505+0000 7fd9ed057700 1 -- 172.21.15.81:0/1008803783 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc009e80 con 0x7fd9e80d02b0 2023-10-07T08:46:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.506+0000 7fd9ed057700 1 -- 172.21.15.81:0/1008803783 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc00b860 con 0x7fd9e80d02b0 2023-10-07T08:46:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.506+0000 7fd9ed057700 1 -- 172.21.15.81:0/1008803783 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc00bbe0 con 0x7fd9e80d02b0 2023-10-07T08:46:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.506+0000 7fd9ef05b700 1 -- 172.21.15.81:0/1008803783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e80d02b0 msgr2=0x7fd9e806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.506+0000 7fd9ef05b700 1 --2- 172.21.15.81:0/1008803783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e80d02b0 0x7fd9e806cff0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0098e0 tx=0x7fd9dc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.506+0000 7fd9ef05b700 1 -- 172.21.15.81:0/1008803783 shutdown_connections 2023-10-07T08:46:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.506+0000 7fd9ef05b700 1 --2- 172.21.15.81:0/1008803783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9e80d0b80 0x7fd9e80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.506+0000 7fd9ef05b700 1 --2- 172.21.15.81:0/1008803783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e80d02b0 0x7fd9e806cff0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.506+0000 7fd9ef05b700 1 -- 172.21.15.81:0/1008803783 >> 172.21.15.81:0/1008803783 conn(0x7fd9e8063230 msgr2=0x7fd9e8063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.506+0000 7fd9ef05b700 1 -- 172.21.15.81:0/1008803783 shutdown_connections 2023-10-07T08:46:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.506+0000 7fd9ef05b700 1 -- 172.21.15.81:0/1008803783 wait complete. 2023-10-07T08:46:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.507+0000 7fd9ef05b700 1 Processor -- start 2023-10-07T08:46:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.507+0000 7fd9ef05b700 1 -- start start 2023-10-07T08:46:33.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ef05b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9e80d02b0 0x7fd9e80cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ef05b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9e80d0b80 0x7fd9e80c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ef05b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e80d0f50 0x7fd9e80c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ef05b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e80c7cb0 con 0x7fd9e80d0f50 2023-10-07T08:46:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ef05b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e80c7f60 con 0x7fd9e80d02b0 2023-10-07T08:46:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ef05b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e80c8240 con 0x7fd9e80d0b80 2023-10-07T08:46:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ee85a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e80d0f50 0x7fd9e80c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ee85a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e80d0f50 0x7fd9e80c7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33150/0 (socket says 172.21.15.81:33150) 2023-10-07T08:46:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ee85a700 1 -- 172.21.15.81:0/2043655932 learned_addr learned my addr 172.21.15.81:0/2043655932 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ed858700 1 --2- 172.21.15.81:0/2043655932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9e80d0b80 0x7fd9e80c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ee059700 1 --2- 172.21.15.81:0/2043655932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9e80d02b0 0x7fd9e80cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ee85a700 1 -- 172.21.15.81:0/2043655932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9e80d0b80 msgr2=0x7fd9e80c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ee85a700 1 --2- 172.21.15.81:0/2043655932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9e80d0b80 0x7fd9e80c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ee85a700 1 -- 172.21.15.81:0/2043655932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9e80d02b0 msgr2=0x7fd9e80cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ee85a700 1 --2- 172.21.15.81:0/2043655932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9e80d02b0 0x7fd9e80cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ee85a700 1 -- 172.21.15.81:0/2043655932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc009420 con 0x7fd9e80d0f50 2023-10-07T08:46:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ed858700 1 --2- 172.21.15.81:0/2043655932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9e80d0b80 0x7fd9e80c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:46:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.508+0000 7fd9ee85a700 1 --2- 172.21.15.81:0/2043655932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e80d0f50 0x7fd9e80c7770 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800c530 tx=0x7fd9d8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.509+0000 7fd9e67fc700 1 -- 172.21.15.81:0/2043655932 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8005b30 con 0x7fd9e80d0f50 2023-10-07T08:46:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.509+0000 7fd9e67fc700 1 -- 172.21.15.81:0/2043655932 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d8005c90 con 0x7fd9e80d0f50 2023-10-07T08:46:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.509+0000 7fd9ef05b700 1 -- 172.21.15.81:0/2043655932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e80c8520 con 0x7fd9e80d0f50 2023-10-07T08:46:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.509+0000 7fd9e67fc700 1 -- 172.21.15.81:0/2043655932 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8007320 con 0x7fd9e80d0f50 2023-10-07T08:46:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.509+0000 7fd9ef05b700 1 -- 172.21.15.81:0/2043655932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e80cc5d0 con 0x7fd9e80d0f50 2023-10-07T08:46:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.509+0000 7fd9ef05b700 1 -- 172.21.15.81:0/2043655932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e816b7d0 con 0x7fd9e80d0f50 2023-10-07T08:46:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.510+0000 7fd9e67fc700 1 -- 172.21.15.81:0/2043655932 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9d801b3b0 con 0x7fd9e80d0f50 2023-10-07T08:46:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.510+0000 7fd9e67fc700 1 --2- 172.21.15.81:0/2043655932 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd9d4066f30 0x7fd9d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.510+0000 7fd9e67fc700 1 -- 172.21.15.81:0/2043655932 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd9d8083a10 con 0x7fd9e80d0f50 2023-10-07T08:46:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.510+0000 7fd9ee059700 1 --2- 172.21.15.81:0/2043655932 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd9d4066f30 0x7fd9d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.510+0000 7fd9e67fc700 1 -- 172.21.15.81:0/2043655932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7fd9d406ea50 con 0x7fd9e80d0f50 2023-10-07T08:46:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.511+0000 7fd9ee059700 1 --2- 172.21.15.81:0/2043655932 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd9d4066f30 0x7fd9d40693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8157680 tx=0x7fd9e000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.514+0000 7fd9e67fc700 1 -- 172.21.15.81:0/2043655932 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9d8017060 con 0x7fd9e80d0f50 2023-10-07T08:46:33.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.698+0000 7fd9ef05b700 1 -- 172.21.15.81:0/2043655932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9e80676e0 con 0x7fd9e80d0f50 2023-10-07T08:46:33.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.699+0000 7fd9e67fc700 1 -- 172.21.15.81:0/2043655932 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9d8050c80 con 0x7fd9e80d0f50 2023-10-07T08:46:33.700 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:46:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.701+0000 7fd9ef05b700 1 -- 172.21.15.81:0/2043655932 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd9d4066f30 msgr2=0x7fd9d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.701+0000 7fd9ef05b700 1 --2- 172.21.15.81:0/2043655932 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd9d4066f30 0x7fd9d40693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8157680 tx=0x7fd9e000b040 comp rx=0 tx=0).stop 2023-10-07T08:46:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.701+0000 7fd9ef05b700 1 -- 172.21.15.81:0/2043655932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e80d0f50 msgr2=0x7fd9e80c7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.701+0000 7fd9ef05b700 1 --2- 172.21.15.81:0/2043655932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e80d0f50 0x7fd9e80c7770 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800c530 tx=0x7fd9d8007f90 comp rx=0 tx=0).stop 2023-10-07T08:46:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.701+0000 7fd9ef05b700 1 -- 172.21.15.81:0/2043655932 shutdown_connections 2023-10-07T08:46:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.701+0000 7fd9ef05b700 1 --2- 172.21.15.81:0/2043655932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e80d0f50 0x7fd9e80c7770 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.701+0000 7fd9ef05b700 1 --2- 172.21.15.81:0/2043655932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9e80d02b0 0x7fd9e80cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.701+0000 7fd9ef05b700 1 --2- 172.21.15.81:0/2043655932 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd9d4066f30 0x7fd9d40693e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.701+0000 7fd9ef05b700 1 --2- 172.21.15.81:0/2043655932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9e80d0b80 0x7fd9e80c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.701+0000 7fd9ef05b700 1 -- 172.21.15.81:0/2043655932 >> 172.21.15.81:0/2043655932 conn(0x7fd9e8063230 msgr2=0x7fd9e8068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.701+0000 7fd9ef05b700 1 -- 172.21.15.81:0/2043655932 shutdown_connections 2023-10-07T08:46:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.701+0000 7fd9ef05b700 1 -- 172.21.15.81:0/2043655932 wait complete. 2023-10-07T08:46:33.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:46:33.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.829+0000 7f714a057700 1 Processor -- start 2023-10-07T08:46:33.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.829+0000 7f714a057700 1 -- start start 2023-10-07T08:46:33.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.830+0000 7f714a057700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f71440d0b80 0x7f71440cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.830+0000 7f714a057700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f71440d02b0 0x7f714406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.830+0000 7f714a057700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71440cf2d0 con 0x7f71440d0f50 2023-10-07T08:46:33.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.830+0000 7f714a057700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714415a690 con 0x7f71440d0b80 2023-10-07T08:46:33.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.830+0000 7f714a057700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714406dc00 con 0x7f71440d02b0 2023-10-07T08:46:33.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.830+0000 7f7149055700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f71440d0b80 0x7f71440cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:33.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.830+0000 7f7149055700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f71440d0b80 0x7f71440cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33154/0 (socket says 172.21.15.81:33154) 2023-10-07T08:46:33.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.830+0000 7f7149055700 1 -- 172.21.15.81:0/3509062079 learned_addr learned my addr 172.21.15.81:0/3509062079 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:33.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.830+0000 7f7148854700 1 --2- 172.21.15.81:0/3509062079 >> v2:172.21.15.89:3300/0 conn(0x7f71440d02b0 0x7f714406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:33.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.830+0000 7f7149055700 1 -- 172.21.15.81:0/3509062079 >> v2:172.21.15.89:3300/0 conn(0x7f71440d02b0 msgr2=0x7f714406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:33.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.830+0000 7f7149055700 1 --2- 172.21.15.81:0/3509062079 >> v2:172.21.15.89:3300/0 conn(0x7f71440d02b0 0x7f714406cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.830+0000 7f7149055700 1 -- 172.21.15.81:0/3509062079 >> v1:172.21.15.89:6789/0 conn(0x7f71440d0f50 legacy=0x7f714415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:33.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.830+0000 7f7149055700 1 -- 172.21.15.81:0/3509062079 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71440cf570 con 0x7f71440d0b80 2023-10-07T08:46:33.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.831+0000 7f7149055700 1 --2- 172.21.15.81:0/3509062079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71440d0b80 0x7f71440cfd70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f71440ce9b0 tx=0x7f7140009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc48ea27bcfb6ca server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:33.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.831+0000 7f713bfff700 1 -- 172.21.15.81:0/3509062079 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714000e070 con 0x7f71440d0b80 2023-10-07T08:46:33.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.831+0000 7f713bfff700 1 -- 172.21.15.81:0/3509062079 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714000ba10 con 0x7f71440d0b80 2023-10-07T08:46:33.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.831+0000 7f713bfff700 1 -- 172.21.15.81:0/3509062079 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400092e0 con 0x7f71440d0b80 2023-10-07T08:46:33.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.831+0000 7f714a057700 1 -- 172.21.15.81:0/3509062079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71440d0b80 msgr2=0x7f71440cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:33.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.831+0000 7f714a057700 1 --2- 172.21.15.81:0/3509062079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71440d0b80 0x7f71440cfd70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f71440ce9b0 tx=0x7f7140009840 comp rx=0 tx=0).stop 2023-10-07T08:46:33.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.831+0000 7f714a057700 1 -- 172.21.15.81:0/3509062079 shutdown_connections 2023-10-07T08:46:33.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.831+0000 7f714a057700 1 --2- 172.21.15.81:0/3509062079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71440d0b80 0x7f71440cfd70 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.831+0000 7f714a057700 1 --2- 172.21.15.81:0/3509062079 >> v2:172.21.15.89:3300/0 conn(0x7f71440d02b0 0x7f714406cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.831+0000 7f714a057700 1 -- 172.21.15.81:0/3509062079 >> 172.21.15.81:0/3509062079 conn(0x7f7144063230 msgr2=0x7f7144063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:33.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.831+0000 7f714a057700 1 -- 172.21.15.81:0/3509062079 shutdown_connections 2023-10-07T08:46:33.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.831+0000 7f714a057700 1 -- 172.21.15.81:0/3509062079 wait complete. 2023-10-07T08:46:33.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.832+0000 7f714a057700 1 Processor -- start 2023-10-07T08:46:33.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.832+0000 7f714a057700 1 -- start start 2023-10-07T08:46:33.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.833+0000 7f714a057700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71440d02b0 0x7f714414e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.833+0000 7f714a057700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71440d0b80 0x7f7144151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.833+0000 7f714a057700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71440d0f50 0x7f7144151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.833+0000 7f714a057700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71441533c0 con 0x7f71440d02b0 2023-10-07T08:46:33.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.833+0000 7f714a057700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714416a6c0 con 0x7f71440d0f50 2023-10-07T08:46:33.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.833+0000 7f714a057700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7144152a90 con 0x7f71440d0b80 2023-10-07T08:46:33.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.833+0000 7f7149055700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71440d02b0 0x7f714414e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:33.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.833+0000 7f7149055700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71440d02b0 0x7f714414e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33156/0 (socket says 172.21.15.81:33156) 2023-10-07T08:46:33.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.833+0000 7f7149055700 1 -- 172.21.15.81:0/1536488016 learned_addr learned my addr 172.21.15.81:0/1536488016 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:33.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.834+0000 7f7149055700 1 -- 172.21.15.81:0/1536488016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71440d0b80 msgr2=0x7f7144151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:33.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.834+0000 7f7149055700 1 --2- 172.21.15.81:0/1536488016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71440d0b80 0x7f7144151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.834+0000 7f7149055700 1 -- 172.21.15.81:0/1536488016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71440d0f50 msgr2=0x7f7144151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:33.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.834+0000 7f7149055700 1 --2- 172.21.15.81:0/1536488016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71440d0f50 0x7f7144151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:33.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.834+0000 7f7149055700 1 -- 172.21.15.81:0/1536488016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7140009ae0 con 0x7f71440d02b0 2023-10-07T08:46:33.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.834+0000 7f7149055700 1 --2- 172.21.15.81:0/1536488016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71440d02b0 0x7f714414e760 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f714406fcc0 tx=0x7f7140017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:33.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.834+0000 7f71397fa700 1 -- 172.21.15.81:0/1536488016 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140012b30 con 0x7f71440d02b0 2023-10-07T08:46:33.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.834+0000 7f71397fa700 1 -- 172.21.15.81:0/1536488016 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7140012c90 con 0x7f71440d02b0 2023-10-07T08:46:33.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.834+0000 7f71397fa700 1 -- 172.21.15.81:0/1536488016 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714001d650 con 0x7f71440d02b0 2023-10-07T08:46:33.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.834+0000 7f714a057700 1 -- 172.21.15.81:0/1536488016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7144152d70 con 0x7f71440d02b0 2023-10-07T08:46:33.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.834+0000 7f714a057700 1 -- 172.21.15.81:0/1536488016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714414eca0 con 0x7f71440d02b0 2023-10-07T08:46:33.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.835+0000 7f714a057700 1 -- 172.21.15.81:0/1536488016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71440b31d0 con 0x7f71440d02b0 2023-10-07T08:46:33.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.835+0000 7f71397fa700 1 -- 172.21.15.81:0/1536488016 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f714001da40 con 0x7f71440d02b0 2023-10-07T08:46:33.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.836+0000 7f71397fa700 1 --2- 172.21.15.81:0/1536488016 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7128066f30 0x7f71280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:33.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.836+0000 7f71397fa700 1 -- 172.21.15.81:0/1536488016 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7140085d70 con 0x7f71440d02b0 2023-10-07T08:46:33.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.836+0000 7f7148854700 1 --2- 172.21.15.81:0/1536488016 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7128066f30 0x7f71280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:33.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.836+0000 7f71397fa700 1 -- 172.21.15.81:0/1536488016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7f712806ea50 con 0x7f71440d02b0 2023-10-07T08:46:33.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.836+0000 7f7148854700 1 --2- 172.21.15.81:0/1536488016 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7128066f30 0x7f71280693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7144155e50 tx=0x7f7134008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:33.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:33.840+0000 7f71397fa700 1 -- 172.21.15.81:0/1536488016 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7140052fe0 con 0x7f71440d02b0 2023-10-07T08:46:34.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.018+0000 7f714a057700 1 -- 172.21.15.81:0/1536488016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71440676e0 con 0x7f71440d02b0 2023-10-07T08:46:34.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.018+0000 7f71397fa700 1 -- 172.21.15.81:0/1536488016 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7f714002a020 con 0x7f71440d02b0 2023-10-07T08:46:34.020 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:46:34.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.020+0000 7f714a057700 1 -- 172.21.15.81:0/1536488016 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7128066f30 msgr2=0x7f71280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.020+0000 7f714a057700 1 --2- 172.21.15.81:0/1536488016 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7128066f30 0x7f71280693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7144155e50 tx=0x7f7134008040 comp rx=0 tx=0).stop 2023-10-07T08:46:34.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.020+0000 7f714a057700 1 -- 172.21.15.81:0/1536488016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71440d02b0 msgr2=0x7f714414e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.020+0000 7f714a057700 1 --2- 172.21.15.81:0/1536488016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71440d02b0 0x7f714414e760 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f714406fcc0 tx=0x7f7140017000 comp rx=0 tx=0).stop 2023-10-07T08:46:34.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.021+0000 7f714a057700 1 -- 172.21.15.81:0/1536488016 shutdown_connections 2023-10-07T08:46:34.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.021+0000 7f714a057700 1 --2- 172.21.15.81:0/1536488016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71440d0f50 0x7f7144151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.021+0000 7f714a057700 1 --2- 172.21.15.81:0/1536488016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71440d02b0 0x7f714414e760 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.021+0000 7f714a057700 1 --2- 172.21.15.81:0/1536488016 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7128066f30 0x7f71280693e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.021+0000 7f714a057700 1 --2- 172.21.15.81:0/1536488016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71440d0b80 0x7f7144151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.021+0000 7f714a057700 1 -- 172.21.15.81:0/1536488016 >> 172.21.15.81:0/1536488016 conn(0x7f7144063230 msgr2=0x7f71440b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:34.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.021+0000 7f714a057700 1 -- 172.21.15.81:0/1536488016 shutdown_connections 2023-10-07T08:46:34.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.021+0000 7f714a057700 1 -- 172.21.15.81:0/1536488016 wait complete. 2023-10-07T08:46:34.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:46:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.149+0000 7f108bfff700 1 Processor -- start 2023-10-07T08:46:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.149+0000 7f108bfff700 1 -- start start 2023-10-07T08:46:34.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.150+0000 7f108bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f108c0d0f50 0x7f108c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.150+0000 7f108bfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108c06d990 con 0x7f108c06d530 2023-10-07T08:46:34.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.150+0000 7f108bfff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108c0cf2d0 con 0x7f108c0d0b80 2023-10-07T08:46:34.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.150+0000 7f108bfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108c15a690 con 0x7f108c0d0f50 2023-10-07T08:46:34.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.150+0000 7f108b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f108c06d530 0x7f108c15b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53814/0 (socket says 172.21.15.81:53814) 2023-10-07T08:46:34.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.150+0000 7f10827fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f108c0d0f50 0x7f108c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.150+0000 7f108b7fe700 1 -- 172.21.15.81:0/1088898595 learned_addr learned my addr 172.21.15.81:0/1088898595 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.150+0000 7f10827fc700 1 -- 172.21.15.81:0/1088898595 >> v1:172.21.15.89:6789/0 conn(0x7f108c0d0b80 legacy=0x7f108c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.150+0000 7f10827fc700 1 -- 172.21.15.81:0/1088898595 >> v1:172.21.15.81:6789/0 conn(0x7f108c06d530 legacy=0x7f108c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.150+0000 7f108a7fc700 1 -- 172.21.15.81:0/1088898595 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 393013807 0 0) 0x7f108c06d990 con 0x7f108c06d530 2023-10-07T08:46:34.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.151+0000 7f10827fc700 1 -- 172.21.15.81:0/1088898595 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c0d0480 con 0x7f108c0d0f50 2023-10-07T08:46:34.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.151+0000 7f10827fc700 1 --2- 172.21.15.81:0/1088898595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c0d0f50 0x7f108c06cff0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f10740098e0 tx=0x7f10740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6eae305925b84 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:34.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.151+0000 7f108a7fc700 1 -- 172.21.15.81:0/1088898595 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1074009e80 con 0x7f108c0d0f50 2023-10-07T08:46:34.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.151+0000 7f108a7fc700 1 -- 172.21.15.81:0/1088898595 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107400b820 con 0x7f108c0d0f50 2023-10-07T08:46:34.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.151+0000 7f108a7fc700 1 -- 172.21.15.81:0/1088898595 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107400bba0 con 0x7f108c0d0f50 2023-10-07T08:46:34.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.151+0000 7f108bfff700 1 -- 172.21.15.81:0/1088898595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c0d0f50 msgr2=0x7f108c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.151+0000 7f108bfff700 1 --2- 172.21.15.81:0/1088898595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c0d0f50 0x7f108c06cff0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f10740098e0 tx=0x7f10740091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.151+0000 7f108bfff700 1 -- 172.21.15.81:0/1088898595 shutdown_connections 2023-10-07T08:46:34.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.151+0000 7f108bfff700 1 --2- 172.21.15.81:0/1088898595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c0d0f50 0x7f108c06cff0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.151+0000 7f108bfff700 1 -- 172.21.15.81:0/1088898595 >> 172.21.15.81:0/1088898595 conn(0x7f108c063230 msgr2=0x7f108c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:34.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.151+0000 7f108bfff700 1 -- 172.21.15.81:0/1088898595 shutdown_connections 2023-10-07T08:46:34.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.151+0000 7f108bfff700 1 -- 172.21.15.81:0/1088898595 wait complete. 2023-10-07T08:46:34.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.153+0000 7f108bfff700 1 Processor -- start 2023-10-07T08:46:34.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.153+0000 7f108bfff700 1 -- start start 2023-10-07T08:46:34.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.153+0000 7f108bfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f108c06d530 0x7f108c151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.153+0000 7f108bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f108c0d0b80 0x7f108c153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.153+0000 7f108bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c0d0f50 0x7f108c154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.153+0000 7f108bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c16af60 con 0x7f108c0d0f50 2023-10-07T08:46:34.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.153+0000 7f108bfff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c16a630 con 0x7f108c06d530 2023-10-07T08:46:34.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.153+0000 7f108bfff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c16a910 con 0x7f108c0d0b80 2023-10-07T08:46:34.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.153+0000 7f108b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c0d0f50 0x7f108c154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:34.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.153+0000 7f108b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c0d0f50 0x7f108c154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33186/0 (socket says 172.21.15.81:33186) 2023-10-07T08:46:34.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.153+0000 7f108b7fe700 1 -- 172.21.15.81:0/3008700727 learned_addr learned my addr 172.21.15.81:0/3008700727 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:34.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.154+0000 7f108b7fe700 1 -- 172.21.15.81:0/3008700727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f108c0d0b80 msgr2=0x7f108c153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.154+0000 7f108affd700 1 --2- 172.21.15.81:0/3008700727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f108c06d530 0x7f108c151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:34.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.154+0000 7f108b7fe700 1 --2- 172.21.15.81:0/3008700727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f108c0d0b80 0x7f108c153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.154+0000 7f108b7fe700 1 -- 172.21.15.81:0/3008700727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f108c06d530 msgr2=0x7f108c151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.154+0000 7f108b7fe700 1 --2- 172.21.15.81:0/3008700727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f108c06d530 0x7f108c151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.154+0000 7f108b7fe700 1 -- 172.21.15.81:0/3008700727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1074009420 con 0x7f108c0d0f50 2023-10-07T08:46:34.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.154+0000 7f108b7fe700 1 --2- 172.21.15.81:0/3008700727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c0d0f50 0x7f108c154330 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f108400cc90 tx=0x7f1084001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:34.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.154+0000 7f10837fe700 1 -- 172.21.15.81:0/3008700727 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108400cea0 con 0x7f108c0d0f50 2023-10-07T08:46:34.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.154+0000 7f10837fe700 1 -- 172.21.15.81:0/3008700727 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108400ab70 con 0x7f108c0d0f50 2023-10-07T08:46:34.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.154+0000 7f108bfff700 1 -- 172.21.15.81:0/3008700727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108c16abf0 con 0x7f108c0d0f50 2023-10-07T08:46:34.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.154+0000 7f10837fe700 1 -- 172.21.15.81:0/3008700727 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10840070f0 con 0x7f108c0d0f50 2023-10-07T08:46:34.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.154+0000 7f108bfff700 1 -- 172.21.15.81:0/3008700727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108c16a2b0 con 0x7f108c0d0f50 2023-10-07T08:46:34.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.155+0000 7f108bfff700 1 -- 172.21.15.81:0/3008700727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108c16b110 con 0x7f108c0d0f50 2023-10-07T08:46:34.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.155+0000 7f10837fe700 1 -- 172.21.15.81:0/3008700727 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10840074a0 con 0x7f108c0d0f50 2023-10-07T08:46:34.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.156+0000 7f10837fe700 1 --2- 172.21.15.81:0/3008700727 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f106c066f30 0x7f106c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.156+0000 7f10837fe700 1 -- 172.21.15.81:0/3008700727 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1084084a40 con 0x7f108c0d0f50 2023-10-07T08:46:34.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.156+0000 7f108affd700 1 --2- 172.21.15.81:0/3008700727 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f106c066f30 0x7f106c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:34.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.156+0000 7f10837fe700 1 -- 172.21.15.81:0/3008700727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7f106c06ea50 con 0x7f108c0d0f50 2023-10-07T08:46:34.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.156+0000 7f108affd700 1 --2- 172.21.15.81:0/3008700727 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f106c066f30 0x7f106c0693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f107c0027e0 tx=0x7f107c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:34.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.160+0000 7f10837fe700 1 -- 172.21.15.81:0/3008700727 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f108c16b110 con 0x7f108c0d0f50 2023-10-07T08:46:34.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.348+0000 7f108bfff700 1 -- 172.21.15.81:0/3008700727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f108c0676e0 con 0x7f108c0d0f50 2023-10-07T08:46:34.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.348+0000 7f10837fe700 1 -- 172.21.15.81:0/3008700727 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1084051c90 con 0x7f108c0d0f50 2023-10-07T08:46:34.350 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:46:34.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.350+0000 7f108bfff700 1 -- 172.21.15.81:0/3008700727 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f106c066f30 msgr2=0x7f106c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.350+0000 7f108bfff700 1 --2- 172.21.15.81:0/3008700727 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f106c066f30 0x7f106c0693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f107c0027e0 tx=0x7f107c009040 comp rx=0 tx=0).stop 2023-10-07T08:46:34.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.350+0000 7f108bfff700 1 -- 172.21.15.81:0/3008700727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c0d0f50 msgr2=0x7f108c154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.350+0000 7f108bfff700 1 --2- 172.21.15.81:0/3008700727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c0d0f50 0x7f108c154330 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f108400cc90 tx=0x7f1084001a80 comp rx=0 tx=0).stop 2023-10-07T08:46:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.351+0000 7f108bfff700 1 -- 172.21.15.81:0/3008700727 shutdown_connections 2023-10-07T08:46:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.351+0000 7f108bfff700 1 --2- 172.21.15.81:0/3008700727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c0d0f50 0x7f108c154330 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.351+0000 7f108bfff700 1 --2- 172.21.15.81:0/3008700727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f108c06d530 0x7f108c151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.351+0000 7f108bfff700 1 --2- 172.21.15.81:0/3008700727 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f106c066f30 0x7f106c0693e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.351+0000 7f108bfff700 1 --2- 172.21.15.81:0/3008700727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f108c0d0b80 0x7f108c153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.351+0000 7f108bfff700 1 -- 172.21.15.81:0/3008700727 >> 172.21.15.81:0/3008700727 conn(0x7f108c063230 msgr2=0x7f108c069c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.351+0000 7f108bfff700 1 -- 172.21.15.81:0/3008700727 shutdown_connections 2023-10-07T08:46:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.351+0000 7f108bfff700 1 -- 172.21.15.81:0/3008700727 wait complete. 2023-10-07T08:46:34.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:46:34.368 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:46:34.367+0000 7f43c6f32700 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-10-07T08:46:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.478+0000 7fa4c24ee700 1 Processor -- start 2023-10-07T08:46:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.478+0000 7fa4c24ee700 1 -- start start 2023-10-07T08:46:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.478+0000 7fa4c24ee700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa4bc15a2a0 0x7fa4bc0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.478+0000 7fa4c24ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4bc06dd60 0x7fa4bc0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.478+0000 7fa4c24ee700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc0b0ca0 con 0x7fa4bc0ceb30 2023-10-07T08:46:34.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.478+0000 7fa4c24ee700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc06e160 con 0x7fa4bc15a2a0 2023-10-07T08:46:34.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.478+0000 7fa4c24ee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc06ea90 con 0x7fa4bc06dd60 2023-10-07T08:46:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.479+0000 7fa4bbfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa4bc15a2a0 0x7fa4bc0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.479+0000 7fa4c0a8b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4bc06dd60 0x7fa4bc0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.479+0000 7fa4c0a8b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4bc06dd60 0x7fa4bc0cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:39734/0 (socket says 172.21.15.81:39734) 2023-10-07T08:46:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.479+0000 7fa4c0a8b700 1 -- 172.21.15.81:0/3641807691 learned_addr learned my addr 172.21.15.81:0/3641807691 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.479+0000 7fa4baffd700 1 -- 172.21.15.81:0/3641807691 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019677682 0 0) 0x7fa4bc0b0ca0 con 0x7fa4bc0ceb30 2023-10-07T08:46:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.479+0000 7fa4baffd700 1 -- 172.21.15.81:0/3641807691 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a4003570 con 0x7fa4bc0ceb30 2023-10-07T08:46:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.479+0000 7fa4c0a8b700 1 -- 172.21.15.81:0/3641807691 >> v2:172.21.15.89:3300/0 conn(0x7fa4bc15a2a0 msgr2=0x7fa4bc0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.479+0000 7fa4c0a8b700 1 --2- 172.21.15.81:0/3641807691 >> v2:172.21.15.89:3300/0 conn(0x7fa4bc15a2a0 0x7fa4bc0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.479+0000 7fa4c0a8b700 1 -- 172.21.15.81:0/3641807691 >> v1:172.21.15.89:6789/0 conn(0x7fa4bc0ceb30 legacy=0x7fa4bc06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.479+0000 7fa4c0a8b700 1 -- 172.21.15.81:0/3641807691 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc0b00d0 con 0x7fa4bc06dd60 2023-10-07T08:46:34.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.479+0000 7fa4c0a8b700 1 --2- 172.21.15.81:0/3641807691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4bc06dd60 0x7fa4bc0cefb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4009f20 tx=0x7fa4b4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af3e18a0ee90427c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:34.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.480+0000 7fa4baffd700 1 -- 172.21.15.81:0/3641807691 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400e070 con 0x7fa4bc06dd60 2023-10-07T08:46:34.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.480+0000 7fa4baffd700 1 -- 172.21.15.81:0/3641807691 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b400b970 con 0x7fa4bc06dd60 2023-10-07T08:46:34.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.480+0000 7fa4baffd700 1 -- 172.21.15.81:0/3641807691 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40092e0 con 0x7fa4bc06dd60 2023-10-07T08:46:34.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.480+0000 7fa4c24ee700 1 -- 172.21.15.81:0/3641807691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4bc06dd60 msgr2=0x7fa4bc0cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.480+0000 7fa4c24ee700 1 --2- 172.21.15.81:0/3641807691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4bc06dd60 0x7fa4bc0cefb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4009f20 tx=0x7fa4b4009840 comp rx=0 tx=0).stop 2023-10-07T08:46:34.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.480+0000 7fa4c24ee700 1 -- 172.21.15.81:0/3641807691 shutdown_connections 2023-10-07T08:46:34.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.480+0000 7fa4c24ee700 1 --2- 172.21.15.81:0/3641807691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4bc06dd60 0x7fa4bc0cefb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.480+0000 7fa4c24ee700 1 --2- 172.21.15.81:0/3641807691 >> v2:172.21.15.89:3300/0 conn(0x7fa4bc15a2a0 0x7fa4bc0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.480+0000 7fa4c24ee700 1 -- 172.21.15.81:0/3641807691 >> 172.21.15.81:0/3641807691 conn(0x7fa4bc067640 msgr2=0x7fa4bc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:34.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.480+0000 7fa4c24ee700 1 -- 172.21.15.81:0/3641807691 shutdown_connections 2023-10-07T08:46:34.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.480+0000 7fa4c24ee700 1 -- 172.21.15.81:0/3641807691 wait complete. 2023-10-07T08:46:34.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.481+0000 7fa4c24ee700 1 Processor -- start 2023-10-07T08:46:34.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.481+0000 7fa4c24ee700 1 -- start start 2023-10-07T08:46:34.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.482+0000 7fa4c24ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06dd60 0x7fa4bc15c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.482+0000 7fa4c24ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4bc0ceb30 0x7fa4bc142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.482+0000 7fa4c24ee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4bc15a2a0 0x7fa4bc15e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.482+0000 7fa4c24ee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc15cd90 con 0x7fa4bc06dd60 2023-10-07T08:46:34.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.482+0000 7fa4c24ee700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc15cfa0 con 0x7fa4bc15a2a0 2023-10-07T08:46:34.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.482+0000 7fa4c24ee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc15d280 con 0x7fa4bc0ceb30 2023-10-07T08:46:34.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.482+0000 7fa4bbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06dd60 0x7fa4bc15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:34.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.482+0000 7fa4bbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06dd60 0x7fa4bc15c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33188/0 (socket says 172.21.15.81:33188) 2023-10-07T08:46:34.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.482+0000 7fa4bbfff700 1 -- 172.21.15.81:0/947400549 learned_addr learned my addr 172.21.15.81:0/947400549 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:34.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.482+0000 7fa4bb7fe700 1 --2- 172.21.15.81:0/947400549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4bc0ceb30 0x7fa4bc142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:34.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.482+0000 7fa4c0a8b700 1 --2- 172.21.15.81:0/947400549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4bc15a2a0 0x7fa4bc15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:34.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.482+0000 7fa4bbfff700 1 -- 172.21.15.81:0/947400549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4bc0ceb30 msgr2=0x7fa4bc142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.482+0000 7fa4bbfff700 1 --2- 172.21.15.81:0/947400549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4bc0ceb30 0x7fa4bc142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.482+0000 7fa4bbfff700 1 -- 172.21.15.81:0/947400549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4bc15a2a0 msgr2=0x7fa4bc15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.482+0000 7fa4bbfff700 1 --2- 172.21.15.81:0/947400549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4bc15a2a0 0x7fa4bc15e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.482+0000 7fa4bbfff700 1 -- 172.21.15.81:0/947400549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b4009ae0 con 0x7fa4bc06dd60 2023-10-07T08:46:34.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.483+0000 7fa4bbfff700 1 --2- 172.21.15.81:0/947400549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06dd60 0x7fa4bc15c850 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00e930 tx=0x7fa4ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:34.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.483+0000 7fa4a3fff700 1 -- 172.21.15.81:0/947400549 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac013680 con 0x7fa4bc06dd60 2023-10-07T08:46:34.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.483+0000 7fa4a3fff700 1 -- 172.21.15.81:0/947400549 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac0137e0 con 0x7fa4bc06dd60 2023-10-07T08:46:34.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.483+0000 7fa4c24ee700 1 -- 172.21.15.81:0/947400549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc15d560 con 0x7fa4bc06dd60 2023-10-07T08:46:34.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.483+0000 7fa4a3fff700 1 -- 172.21.15.81:0/947400549 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac013b80 con 0x7fa4bc06dd60 2023-10-07T08:46:34.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.483+0000 7fa4c24ee700 1 -- 172.21.15.81:0/947400549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc15db20 con 0x7fa4bc06dd60 2023-10-07T08:46:34.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.484+0000 7fa4c24ee700 1 -- 172.21.15.81:0/947400549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4bc15dce0 con 0x7fa4bc06dd60 2023-10-07T08:46:34.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.484+0000 7fa4a3fff700 1 -- 172.21.15.81:0/947400549 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4ac00c3e0 con 0x7fa4bc06dd60 2023-10-07T08:46:34.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.485+0000 7fa4a3fff700 1 --2- 172.21.15.81:0/947400549 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa4a8066f30 0x7fa4a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.485+0000 7fa4bb7fe700 1 --2- 172.21.15.81:0/947400549 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa4a8066f30 0x7fa4a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:34.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.485+0000 7fa4a3fff700 1 -- 172.21.15.81:0/947400549 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4ac0845b0 con 0x7fa4bc06dd60 2023-10-07T08:46:34.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.485+0000 7fa4a3fff700 1 -- 172.21.15.81:0/947400549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7fa4a806ea50 con 0x7fa4bc06dd60 2023-10-07T08:46:34.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.485+0000 7fa4bb7fe700 1 --2- 172.21.15.81:0/947400549 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa4a8066f30 0x7fa4a80693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0007fd0 tx=0x7fa4b0007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:34.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.489+0000 7fa4a3fff700 1 -- 172.21.15.81:0/947400549 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4ac051820 con 0x7fa4bc06dd60 2023-10-07T08:46:34.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.714+0000 7fa4c24ee700 1 -- 172.21.15.81:0/947400549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4bc063e40 con 0x7fa4bc06dd60 2023-10-07T08:46:34.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.715+0000 7fa4a3fff700 1 -- 172.21.15.81:0/947400549 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fa4ac054e40 con 0x7fa4bc06dd60 2023-10-07T08:46:34.716 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:34.716 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3279897900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3279897900},{"type":"v1","addr":"172.21.15.89:6835","nonce":3279897900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/102905724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":102905724},{"type":"v1","addr":"172.21.15.89:6834","nonce":102905724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4063096820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":4063096820},{"type":"v1","addr":"172.21.15.81:6836","nonce":4063096820}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:45:05.899585+0000","modified":"2023-10-07T08:45:09.552432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2943588561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2943588561},{"type":"v1","addr":"172.21.15.81:6837","nonce":2943588561}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-07T08:46:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.717+0000 7fa4c24ee700 1 -- 172.21.15.81:0/947400549 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa4a8066f30 msgr2=0x7fa4a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.717+0000 7fa4c24ee700 1 --2- 172.21.15.81:0/947400549 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa4a8066f30 0x7fa4a80693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0007fd0 tx=0x7fa4b0007d50 comp rx=0 tx=0).stop 2023-10-07T08:46:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.717+0000 7fa4c24ee700 1 -- 172.21.15.81:0/947400549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06dd60 msgr2=0x7fa4bc15c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.717+0000 7fa4c24ee700 1 --2- 172.21.15.81:0/947400549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06dd60 0x7fa4bc15c850 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00e930 tx=0x7fa4ac0091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.717+0000 7fa4c24ee700 1 -- 172.21.15.81:0/947400549 shutdown_connections 2023-10-07T08:46:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.717+0000 7fa4c24ee700 1 --2- 172.21.15.81:0/947400549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4bc15a2a0 0x7fa4bc15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.717+0000 7fa4c24ee700 1 --2- 172.21.15.81:0/947400549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06dd60 0x7fa4bc15c850 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.717+0000 7fa4c24ee700 1 --2- 172.21.15.81:0/947400549 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa4a8066f30 0x7fa4a80693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.717+0000 7fa4c24ee700 1 --2- 172.21.15.81:0/947400549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4bc0ceb30 0x7fa4bc142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.717+0000 7fa4c24ee700 1 -- 172.21.15.81:0/947400549 >> 172.21.15.81:0/947400549 conn(0x7fa4bc067640 msgr2=0x7fa4bc0ad6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:34.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.717+0000 7fa4c24ee700 1 -- 172.21.15.81:0/947400549 shutdown_connections 2023-10-07T08:46:34.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.717+0000 7fa4c24ee700 1 -- 172.21.15.81:0/947400549 wait complete. 2023-10-07T08:46:34.720 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2023-10-07T08:46:34.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:46:34.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.882+0000 7f5c949cc700 1 Processor -- start 2023-10-07T08:46:34.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.882+0000 7f5c949cc700 1 -- start start 2023-10-07T08:46:34.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.883+0000 7f5c949cc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5c901578d0 0x7f5c900cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.883+0000 7f5c949cc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5c90157ca0 0x7f5c9015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.883+0000 7f5c949cc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c900d07c0 con 0x7f5c9006d120 2023-10-07T08:46:34.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.883+0000 7f5c949cc700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c900cfbb0 con 0x7f5c90157ca0 2023-10-07T08:46:34.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.883+0000 7f5c949cc700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c900cfe90 con 0x7f5c901578d0 2023-10-07T08:46:34.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.883+0000 7f5c85d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5c90157ca0 0x7f5c9015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:34.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.883+0000 7f5c85d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5c90157ca0 0x7f5c9015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33192/0 (socket says 172.21.15.81:33192) 2023-10-07T08:46:34.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.883+0000 7f5c85d9b700 1 -- 172.21.15.81:0/1935131649 learned_addr learned my addr 172.21.15.81:0/1935131649 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:34.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.883+0000 7f5c8e59c700 1 --2- 172.21.15.81:0/1935131649 >> v2:172.21.15.89:3300/0 conn(0x7f5c901578d0 0x7f5c900cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:34.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.883+0000 7f5c85d9b700 1 -- 172.21.15.81:0/1935131649 >> v2:172.21.15.89:3300/0 conn(0x7f5c901578d0 msgr2=0x7f5c900cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:34.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.883+0000 7f5c85d9b700 1 --2- 172.21.15.81:0/1935131649 >> v2:172.21.15.89:3300/0 conn(0x7f5c901578d0 0x7f5c900cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.883+0000 7f5c85d9b700 1 -- 172.21.15.81:0/1935131649 >> v1:172.21.15.89:6789/0 conn(0x7f5c9006d120 legacy=0x7f5c9006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:34.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.883+0000 7f5c85d9b700 1 -- 172.21.15.81:0/1935131649 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c900d0170 con 0x7f5c90157ca0 2023-10-07T08:46:34.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.884+0000 7f5c85d9b700 1 --2- 172.21.15.81:0/1935131649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c90157ca0 0x7f5c9015af00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5c900646b0 tx=0x7f5c78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1117fd3c397fc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:34.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.884+0000 7f5c8dd9b700 1 -- 172.21.15.81:0/1935131649 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7800b820 con 0x7f5c90157ca0 2023-10-07T08:46:34.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.884+0000 7f5c8dd9b700 1 -- 172.21.15.81:0/1935131649 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7800b980 con 0x7f5c90157ca0 2023-10-07T08:46:34.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.884+0000 7f5c8dd9b700 1 -- 172.21.15.81:0/1935131649 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7800bd20 con 0x7f5c90157ca0 2023-10-07T08:46:34.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.884+0000 7f5c949cc700 1 -- 172.21.15.81:0/1935131649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c90157ca0 msgr2=0x7f5c9015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.884+0000 7f5c949cc700 1 --2- 172.21.15.81:0/1935131649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c90157ca0 0x7f5c9015af00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5c900646b0 tx=0x7f5c78009250 comp rx=0 tx=0).stop 2023-10-07T08:46:34.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.884+0000 7f5c949cc700 1 -- 172.21.15.81:0/1935131649 shutdown_connections 2023-10-07T08:46:34.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.884+0000 7f5c949cc700 1 --2- 172.21.15.81:0/1935131649 >> v2:172.21.15.89:3300/0 conn(0x7f5c901578d0 0x7f5c900cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.884+0000 7f5c949cc700 1 --2- 172.21.15.81:0/1935131649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c90157ca0 0x7f5c9015af00 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.884+0000 7f5c949cc700 1 -- 172.21.15.81:0/1935131649 >> 172.21.15.81:0/1935131649 conn(0x7f5c9006bb90 msgr2=0x7f5c9006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:34.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.884+0000 7f5c949cc700 1 -- 172.21.15.81:0/1935131649 shutdown_connections 2023-10-07T08:46:34.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.884+0000 7f5c949cc700 1 -- 172.21.15.81:0/1935131649 wait complete. 2023-10-07T08:46:34.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.885+0000 7f5c949cc700 1 Processor -- start 2023-10-07T08:46:34.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.886+0000 7f5c949cc700 1 -- start start 2023-10-07T08:46:34.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.886+0000 7f5c949cc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006d120 0x7f5c9014e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.886+0000 7f5c949cc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c901578d0 0x7f5c900b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.886+0000 7f5c949cc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c90157ca0 0x7f5c901513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.886+0000 7f5c949cc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c900b44d0 con 0x7f5c90157ca0 2023-10-07T08:46:34.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.886+0000 7f5c949cc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c901537a0 con 0x7f5c901578d0 2023-10-07T08:46:34.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.886+0000 7f5c949cc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c90151910 con 0x7f5c9006d120 2023-10-07T08:46:34.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.886+0000 7f5c8ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c90157ca0 0x7f5c901513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:34.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.886+0000 7f5c8ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c90157ca0 0x7f5c901513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33196/0 (socket says 172.21.15.81:33196) 2023-10-07T08:46:34.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.886+0000 7f5c8ed9d700 1 -- 172.21.15.81:0/3337139003 learned_addr learned my addr 172.21.15.81:0/3337139003 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:34.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.887+0000 7f5c8e59c700 1 --2- 172.21.15.81:0/3337139003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006d120 0x7f5c9014e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:34.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.887+0000 7f5c85d9b700 1 --2- 172.21.15.81:0/3337139003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c901578d0 0x7f5c900b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:34.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.887+0000 7f5c8ed9d700 1 -- 172.21.15.81:0/3337139003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006d120 msgr2=0x7f5c9014e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.887+0000 7f5c8ed9d700 1 --2- 172.21.15.81:0/3337139003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006d120 0x7f5c9014e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.887+0000 7f5c8ed9d700 1 -- 172.21.15.81:0/3337139003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c901578d0 msgr2=0x7f5c900b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:34.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.887+0000 7f5c8ed9d700 1 --2- 172.21.15.81:0/3337139003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c901578d0 0x7f5c900b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:34.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.887+0000 7f5c8ed9d700 1 -- 172.21.15.81:0/3337139003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c780094f0 con 0x7f5c90157ca0 2023-10-07T08:46:34.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.887+0000 7f5c85d9b700 1 --2- 172.21.15.81:0/3337139003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c901578d0 0x7f5c900b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:46:34.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.887+0000 7f5c8ed9d700 1 --2- 172.21.15.81:0/3337139003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c90157ca0 0x7f5c901513d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800c930 tx=0x7f5c880026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:34.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.887+0000 7f5c86ffd700 1 -- 172.21.15.81:0/3337139003 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8800ce70 con 0x7f5c90157ca0 2023-10-07T08:46:34.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.887+0000 7f5c86ffd700 1 -- 172.21.15.81:0/3337139003 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8800a7e0 con 0x7f5c90157ca0 2023-10-07T08:46:34.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.887+0000 7f5c949cc700 1 -- 172.21.15.81:0/3337139003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c90152e70 con 0x7f5c90157ca0 2023-10-07T08:46:34.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.887+0000 7f5c86ffd700 1 -- 172.21.15.81:0/3337139003 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8800aba0 con 0x7f5c90157ca0 2023-10-07T08:46:34.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.887+0000 7f5c949cc700 1 -- 172.21.15.81:0/3337139003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c90153430 con 0x7f5c90157ca0 2023-10-07T08:46:34.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.888+0000 7f5c949cc700 1 -- 172.21.15.81:0/3337139003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c90067ac0 con 0x7f5c90157ca0 2023-10-07T08:46:34.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.888+0000 7f5c86ffd700 1 -- 172.21.15.81:0/3337139003 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c88012420 con 0x7f5c90157ca0 2023-10-07T08:46:34.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.889+0000 7f5c86ffd700 1 --2- 172.21.15.81:0/3337139003 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5c70066f30 0x7f5c700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:34.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.889+0000 7f5c86ffd700 1 -- 172.21.15.81:0/3337139003 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c88084990 con 0x7f5c90157ca0 2023-10-07T08:46:34.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.889+0000 7f5c8e59c700 1 --2- 172.21.15.81:0/3337139003 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5c70066f30 0x7f5c700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:34.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.889+0000 7f5c86ffd700 1 -- 172.21.15.81:0/3337139003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f5c7006ea50 con 0x7f5c90157ca0 2023-10-07T08:46:34.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.889+0000 7f5c8e59c700 1 --2- 172.21.15.81:0/3337139003 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5c70066f30 0x7f5c700693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5c80006fd0 tx=0x7f5c80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:34.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:34.893+0000 7f5c86ffd700 1 -- 172.21.15.81:0/3337139003 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c88016060 con 0x7f5c90157ca0 2023-10-07T08:46:35.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.079+0000 7f5c949cc700 1 -- 172.21.15.81:0/3337139003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c901538e0 con 0x7f5c90157ca0 2023-10-07T08:46:35.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.080+0000 7f5c86ffd700 1 -- 172.21.15.81:0/3337139003 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+15346 (secure 0 0 0) 0x7f5c88055740 con 0x7f5c90157ca0 2023-10-07T08:46:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:35.082 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":72,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:46:34.368445+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:45:03.701565+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-07T08:45:04.877693+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:46:35.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.082+0000 7f5c949cc700 1 -- 172.21.15.81:0/3337139003 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5c70066f30 msgr2=0x7f5c700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.082+0000 7f5c949cc700 1 --2- 172.21.15.81:0/3337139003 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5c70066f30 0x7f5c700693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5c80006fd0 tx=0x7f5c80008040 comp rx=0 tx=0).stop 2023-10-07T08:46:35.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.082+0000 7f5c949cc700 1 -- 172.21.15.81:0/3337139003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c90157ca0 msgr2=0x7f5c901513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.082+0000 7f5c949cc700 1 --2- 172.21.15.81:0/3337139003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c90157ca0 0x7f5c901513d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800c930 tx=0x7f5c880026e0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.082+0000 7f5c949cc700 1 -- 172.21.15.81:0/3337139003 shutdown_connections 2023-10-07T08:46:35.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.082+0000 7f5c949cc700 1 --2- 172.21.15.81:0/3337139003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c90157ca0 0x7f5c901513d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.082+0000 7f5c949cc700 1 --2- 172.21.15.81:0/3337139003 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5c70066f30 0x7f5c700693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.082+0000 7f5c949cc700 1 --2- 172.21.15.81:0/3337139003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c9006d120 0x7f5c9014e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.082+0000 7f5c949cc700 1 --2- 172.21.15.81:0/3337139003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c901578d0 0x7f5c900b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.082+0000 7f5c949cc700 1 -- 172.21.15.81:0/3337139003 >> 172.21.15.81:0/3337139003 conn(0x7f5c9006bb90 msgr2=0x7f5c9006d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.083+0000 7f5c949cc700 1 -- 172.21.15.81:0/3337139003 shutdown_connections 2023-10-07T08:46:35.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.083+0000 7f5c949cc700 1 -- 172.21.15.81:0/3337139003 wait complete. 2023-10-07T08:46:35.096 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T08:46:35.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:46:35.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.208+0000 7febaa8ef700 1 Processor -- start 2023-10-07T08:46:35.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.208+0000 7febaa8ef700 1 -- start start 2023-10-07T08:46:35.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.209+0000 7febaa8ef700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feba4068e90 0x7feba4164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.209+0000 7febaa8ef700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba40cee10 con 0x7feba4159b40 2023-10-07T08:46:35.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.209+0000 7febaa8ef700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba40cd040 con 0x7feba4159f10 2023-10-07T08:46:35.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.209+0000 7febaa8ef700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba40cd320 con 0x7feba4068e90 2023-10-07T08:46:35.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.209+0000 7feba98ed700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feba4159b40 0x7feba40cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53824/0 (socket says 172.21.15.81:53824) 2023-10-07T08:46:35.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.209+0000 7feba98ed700 1 -- 172.21.15.81:0/3679555112 learned_addr learned my addr 172.21.15.81:0/3679555112 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:35.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.209+0000 7feba88eb700 1 -- 172.21.15.81:0/3679555112 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351613958 0 0) 0x7feba40cee10 con 0x7feba4159b40 2023-10-07T08:46:35.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.209+0000 7febaa0ee700 1 --2- 172.21.15.81:0/3679555112 >> v2:172.21.15.89:3300/0 conn(0x7feba4068e90 0x7feba4164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.209+0000 7feba88eb700 1 -- 172.21.15.81:0/3679555112 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb90003570 con 0x7feba4159b40 2023-10-07T08:46:35.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba88eb700 1 -- 172.21.15.81:0/3679555112 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3786486579 0 0) 0x7feb90003570 con 0x7feba4159b40 2023-10-07T08:46:35.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba88eb700 1 -- 172.21.15.81:0/3679555112 >> v2:172.21.15.89:3300/0 conn(0x7feba4068e90 msgr2=0x7feba4164c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:35.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba88eb700 1 --2- 172.21.15.81:0/3679555112 >> v2:172.21.15.89:3300/0 conn(0x7feba4068e90 0x7feba4164c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba88eb700 1 -- 172.21.15.81:0/3679555112 >> v1:172.21.15.89:6789/0 conn(0x7feba4159f10 legacy=0x7feba4068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba88eb700 1 -- 172.21.15.81:0/3679555112 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba40ce7c0 con 0x7feba4159b40 2023-10-07T08:46:35.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba88eb700 1 -- 172.21.15.81:0/3679555112 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7feba00017f0 con 0x7feba4159b40 2023-10-07T08:46:35.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba88eb700 1 -- 172.21.15.81:0/3679555112 >> v1:172.21.15.81:6789/0 conn(0x7feba4159b40 legacy=0x7feba40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba88eb700 1 --2- 172.21.15.81:0/3679555112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90003a60 0x7feb90003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba88eb700 1 --2- 172.21.15.81:0/3679555112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb90004810 0x7feb90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba88eb700 1 --2- 172.21.15.81:0/3679555112 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb900051c0 0x7feb9000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba88eb700 1 -- 172.21.15.81:0/3679555112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba40cd320 con 0x7feb90003a60 2023-10-07T08:46:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba88eb700 1 -- 172.21.15.81:0/3679555112 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9000c0d0 con 0x7feb90004810 2023-10-07T08:46:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba88eb700 1 -- 172.21.15.81:0/3679555112 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9000c290 con 0x7feb900051c0 2023-10-07T08:46:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba98ed700 1 --2- 172.21.15.81:0/3679555112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90003a60 0x7feb90003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba90ec700 1 --2- 172.21.15.81:0/3679555112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb90004810 0x7feb90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7febaa0ee700 1 --2- 172.21.15.81:0/3679555112 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb900051c0 0x7feb9000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba98ed700 1 -- 172.21.15.81:0/3679555112 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb900051c0 msgr2=0x7feb9000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba98ed700 1 --2- 172.21.15.81:0/3679555112 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb900051c0 0x7feb9000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba98ed700 1 -- 172.21.15.81:0/3679555112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb90004810 msgr2=0x7feb90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba98ed700 1 --2- 172.21.15.81:0/3679555112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb90004810 0x7feb90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba98ed700 1 -- 172.21.15.81:0/3679555112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90003570 con 0x7feb90003a60 2023-10-07T08:46:35.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7febaa0ee700 1 -- 172.21.15.81:0/3679555112 reap_dead start 2023-10-07T08:46:35.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba98ed700 1 --2- 172.21.15.81:0/3679555112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90003a60 0x7feb90003e70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7feba000a930 tx=0x7feba00021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b67c42cc5627c3e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:35.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba88eb700 1 -- 172.21.15.81:0/3679555112 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba00070d0 con 0x7feb90003a60 2023-10-07T08:46:35.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba88eb700 1 -- 172.21.15.81:0/3679555112 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba0007230 con 0x7feb90003a60 2023-10-07T08:46:35.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.210+0000 7feba88eb700 1 -- 172.21.15.81:0/3679555112 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba00075d0 con 0x7feb90003a60 2023-10-07T08:46:35.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.211+0000 7febaa8ef700 1 -- 172.21.15.81:0/3679555112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90003a60 msgr2=0x7feb90003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.211+0000 7febaa8ef700 1 --2- 172.21.15.81:0/3679555112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90003a60 0x7feb90003e70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7feba000a930 tx=0x7feba00021d0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.211+0000 7febaa8ef700 1 -- 172.21.15.81:0/3679555112 shutdown_connections 2023-10-07T08:46:35.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.211+0000 7febaa8ef700 1 --2- 172.21.15.81:0/3679555112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90003a60 0x7feb90003e70 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.211+0000 7febaa8ef700 1 -- 172.21.15.81:0/3679555112 >> 172.21.15.81:0/3679555112 conn(0x7feba40cd660 msgr2=0x7feba40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:35.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.211+0000 7febaa8ef700 1 -- 172.21.15.81:0/3679555112 shutdown_connections 2023-10-07T08:46:35.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.211+0000 7febaa8ef700 1 -- 172.21.15.81:0/3679555112 wait complete. 2023-10-07T08:46:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.212+0000 7febaa8ef700 1 Processor -- start 2023-10-07T08:46:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.212+0000 7febaa8ef700 1 -- start start 2023-10-07T08:46:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7febaa8ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90003a60 0x7feba415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7febaa8ef700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feba4157f60 0x7feba41583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7febaa8ef700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba415afc0 0x7feba415b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7febaa8ef700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba4158910 con 0x7feb90003a60 2023-10-07T08:46:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7febaa8ef700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba415b970 con 0x7feba4157f60 2023-10-07T08:46:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7febaa8ef700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba415cce0 con 0x7feba415afc0 2023-10-07T08:46:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7feba98ed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90003a60 0x7feba415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7feba98ed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90003a60 0x7feba415dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33206/0 (socket says 172.21.15.81:33206) 2023-10-07T08:46:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7feba98ed700 1 -- 172.21.15.81:0/866530357 learned_addr learned my addr 172.21.15.81:0/866530357 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:35.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7feba90ec700 1 --2- 172.21.15.81:0/866530357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feba4157f60 0x7feba41583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7febaa0ee700 1 --2- 172.21.15.81:0/866530357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba415afc0 0x7feba415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7feba98ed700 1 -- 172.21.15.81:0/866530357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba415afc0 msgr2=0x7feba415b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7feba98ed700 1 --2- 172.21.15.81:0/866530357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba415afc0 0x7feba415b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7feba98ed700 1 -- 172.21.15.81:0/866530357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feba4157f60 msgr2=0x7feba41583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7feba98ed700 1 --2- 172.21.15.81:0/866530357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feba4157f60 0x7feba41583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7feba98ed700 1 -- 172.21.15.81:0/866530357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba415bc40 con 0x7feb90003a60 2023-10-07T08:46:35.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7feba90ec700 1 --2- 172.21.15.81:0/866530357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feba4157f60 0x7feba41583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:35.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7feba98ed700 1 --2- 172.21.15.81:0/866530357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90003a60 0x7feba415dba0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7feba0012000 tx=0x7feba0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:35.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7feb99ffb700 1 -- 172.21.15.81:0/866530357 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba0001a40 con 0x7feb90003a60 2023-10-07T08:46:35.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7feb99ffb700 1 -- 172.21.15.81:0/866530357 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba0027470 con 0x7feb90003a60 2023-10-07T08:46:35.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7febaa8ef700 1 -- 172.21.15.81:0/866530357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba415bf20 con 0x7feb90003a60 2023-10-07T08:46:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.213+0000 7feb99ffb700 1 -- 172.21.15.81:0/866530357 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba0027830 con 0x7feb90003a60 2023-10-07T08:46:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.214+0000 7febaa8ef700 1 -- 172.21.15.81:0/866530357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba415c4e0 con 0x7feb90003a60 2023-10-07T08:46:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.215+0000 7febaa8ef700 1 -- 172.21.15.81:0/866530357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba40cb890 con 0x7feb90003a60 2023-10-07T08:46:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.215+0000 7feb99ffb700 1 -- 172.21.15.81:0/866530357 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feba0024070 con 0x7feb90003a60 2023-10-07T08:46:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.215+0000 7feb99ffb700 1 --2- 172.21.15.81:0/866530357 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb88066f60 0x7feb88069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.216+0000 7feb99ffb700 1 -- 172.21.15.81:0/866530357 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feba0086980 con 0x7feb90003a60 2023-10-07T08:46:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.216+0000 7feba90ec700 1 --2- 172.21.15.81:0/866530357 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb88066f60 0x7feb88069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.216+0000 7feb99ffb700 1 -- 172.21.15.81:0/866530357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7feb8806ea80 con 0x7feb90003a60 2023-10-07T08:46:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.216+0000 7feba90ec700 1 --2- 172.21.15.81:0/866530357 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb88066f60 0x7feb88069410 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7feba4159370 tx=0x7feb94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.220+0000 7feb99ffb700 1 -- 172.21.15.81:0/866530357 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feba002c060 con 0x7feb90003a60 2023-10-07T08:46:35.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.445+0000 7febaa8ef700 1 -- 172.21.15.81:0/866530357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feba40ceaa0 con 0x7feb90003a60 2023-10-07T08:46:35.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.445+0000 7feb99ffb700 1 -- 172.21.15.81:0/866530357 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4594 (secure 0 0 0) 0x7feba0053b50 con 0x7feb90003a60 2023-10-07T08:46:35.447 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:35.447 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3279897900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3279897900},{"type":"v1","addr":"172.21.15.89:6835","nonce":3279897900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/102905724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":102905724},{"type":"v1","addr":"172.21.15.89:6834","nonce":102905724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4063096820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":4063096820},{"type":"v1","addr":"172.21.15.81:6836","nonce":4063096820}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:45:05.899585+0000","modified":"2023-10-07T08:45:09.552432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2943588561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2943588561},{"type":"v1","addr":"172.21.15.81:6837","nonce":2943588561}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-07T08:46:35.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.447+0000 7febaa8ef700 1 -- 172.21.15.81:0/866530357 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb88066f60 msgr2=0x7feb88069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.447+0000 7febaa8ef700 1 --2- 172.21.15.81:0/866530357 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb88066f60 0x7feb88069410 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7feba4159370 tx=0x7feb94009040 comp rx=0 tx=0).stop 2023-10-07T08:46:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.447+0000 7febaa8ef700 1 -- 172.21.15.81:0/866530357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90003a60 msgr2=0x7feba415dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.447+0000 7febaa8ef700 1 --2- 172.21.15.81:0/866530357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90003a60 0x7feba415dba0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7feba0012000 tx=0x7feba0016000 comp rx=0 tx=0).stop 2023-10-07T08:46:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.447+0000 7febaa8ef700 1 -- 172.21.15.81:0/866530357 shutdown_connections 2023-10-07T08:46:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.447+0000 7febaa8ef700 1 --2- 172.21.15.81:0/866530357 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb88066f60 0x7feb88069410 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.447+0000 7febaa8ef700 1 --2- 172.21.15.81:0/866530357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba415afc0 0x7feba415b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.447+0000 7febaa8ef700 1 --2- 172.21.15.81:0/866530357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90003a60 0x7feba415dba0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.447+0000 7febaa8ef700 1 --2- 172.21.15.81:0/866530357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feba4157f60 0x7feba41583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.447+0000 7febaa8ef700 1 -- 172.21.15.81:0/866530357 >> 172.21.15.81:0/866530357 conn(0x7feba40cd660 msgr2=0x7feba406dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.447+0000 7febaa8ef700 1 -- 172.21.15.81:0/866530357 shutdown_connections 2023-10-07T08:46:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.447+0000 7febaa8ef700 1 -- 172.21.15.81:0/866530357 wait complete. 2023-10-07T08:46:35.450 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2023-10-07T08:46:35.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:46:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.573+0000 7feb4cc39700 1 Processor -- start 2023-10-07T08:46:35.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.573+0000 7feb4cc39700 1 -- start start 2023-10-07T08:46:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.574+0000 7feb4cc39700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feb48157ca0 0x7feb480cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.574+0000 7feb4cc39700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb4806d120 0x7feb4806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.574+0000 7feb4cc39700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb480d07c0 con 0x7feb481578d0 2023-10-07T08:46:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.574+0000 7feb4cc39700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4806da50 con 0x7feb4806d120 2023-10-07T08:46:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.574+0000 7feb4cc39700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb480cfbb0 con 0x7feb48157ca0 2023-10-07T08:46:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.574+0000 7feb46d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb4806d120 0x7feb4806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.574+0000 7feb4659c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feb481578d0 0x7feb4815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53832/0 (socket says 172.21.15.81:53832) 2023-10-07T08:46:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.574+0000 7feb4659c700 1 -- 172.21.15.81:0/1117159350 learned_addr learned my addr 172.21.15.81:0/1117159350 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.574+0000 7feb3dd9b700 1 --2- 172.21.15.81:0/1117159350 >> v2:172.21.15.89:3300/0 conn(0x7feb48157ca0 0x7feb480cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.574+0000 7feb45d9b700 1 -- 172.21.15.81:0/1117159350 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496153412 0 0) 0x7feb480d07c0 con 0x7feb481578d0 2023-10-07T08:46:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.574+0000 7feb45d9b700 1 -- 172.21.15.81:0/1117159350 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb34003570 con 0x7feb481578d0 2023-10-07T08:46:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.574+0000 7feb46d9d700 1 -- 172.21.15.81:0/1117159350 >> v2:172.21.15.89:3300/0 conn(0x7feb48157ca0 msgr2=0x7feb480cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.574+0000 7feb46d9d700 1 --2- 172.21.15.81:0/1117159350 >> v2:172.21.15.89:3300/0 conn(0x7feb48157ca0 0x7feb480cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.574+0000 7feb46d9d700 1 -- 172.21.15.81:0/1117159350 >> v1:172.21.15.81:6789/0 conn(0x7feb481578d0 legacy=0x7feb4815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.574+0000 7feb46d9d700 1 -- 172.21.15.81:0/1117159350 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb480cfe90 con 0x7feb4806d120 2023-10-07T08:46:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.574+0000 7feb3dd9b700 1 --2- 172.21.15.81:0/1117159350 >> v2:172.21.15.89:3300/0 conn(0x7feb48157ca0 0x7feb480cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.575+0000 7feb46d9d700 1 --2- 172.21.15.81:0/1117159350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4806d120 0x7feb4806d510 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7feb48068510 tx=0x7feb40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49178cf92df37c8c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.575+0000 7feb45d9b700 1 -- 172.21.15.81:0/1117159350 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4000e070 con 0x7feb4806d120 2023-10-07T08:46:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.575+0000 7feb45d9b700 1 -- 172.21.15.81:0/1117159350 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4000bb60 con 0x7feb4806d120 2023-10-07T08:46:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.575+0000 7feb45d9b700 1 -- 172.21.15.81:0/1117159350 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40012430 con 0x7feb4806d120 2023-10-07T08:46:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.575+0000 7feb4cc39700 1 -- 172.21.15.81:0/1117159350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4806d120 msgr2=0x7feb4806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.575+0000 7feb4cc39700 1 --2- 172.21.15.81:0/1117159350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4806d120 0x7feb4806d510 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7feb48068510 tx=0x7feb40009780 comp rx=0 tx=0).stop 2023-10-07T08:46:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.575+0000 7feb4cc39700 1 -- 172.21.15.81:0/1117159350 shutdown_connections 2023-10-07T08:46:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.575+0000 7feb4cc39700 1 --2- 172.21.15.81:0/1117159350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4806d120 0x7feb4806d510 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.575+0000 7feb4cc39700 1 --2- 172.21.15.81:0/1117159350 >> v2:172.21.15.89:3300/0 conn(0x7feb48157ca0 0x7feb480cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.575+0000 7feb4cc39700 1 -- 172.21.15.81:0/1117159350 >> 172.21.15.81:0/1117159350 conn(0x7feb4806bb90 msgr2=0x7feb4806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.575+0000 7feb4cc39700 1 -- 172.21.15.81:0/1117159350 shutdown_connections 2023-10-07T08:46:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.575+0000 7feb4cc39700 1 -- 172.21.15.81:0/1117159350 wait complete. 2023-10-07T08:46:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.576+0000 7feb4cc39700 1 Processor -- start 2023-10-07T08:46:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.577+0000 7feb4cc39700 1 -- start start 2023-10-07T08:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.577+0000 7feb4cc39700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb4806d120 0x7feb480c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.577+0000 7feb4cc39700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb481578d0 0x7feb480c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.577+0000 7feb4cc39700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb48157ca0 0x7feb48154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.577+0000 7feb4cc39700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb480b3ba0 con 0x7feb48157ca0 2023-10-07T08:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.577+0000 7feb4cc39700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb480b4160 con 0x7feb4806d120 2023-10-07T08:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.577+0000 7feb4cc39700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb480c6ad0 con 0x7feb481578d0 2023-10-07T08:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.577+0000 7feb46d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb48157ca0 0x7feb48154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.577+0000 7feb46d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb48157ca0 0x7feb48154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33214/0 (socket says 172.21.15.81:33214) 2023-10-07T08:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.577+0000 7feb46d9d700 1 -- 172.21.15.81:0/94254501 learned_addr learned my addr 172.21.15.81:0/94254501 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.578+0000 7feb46d9d700 1 -- 172.21.15.81:0/94254501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb481578d0 msgr2=0x7feb480c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.578+0000 7feb46d9d700 1 --2- 172.21.15.81:0/94254501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb481578d0 0x7feb480c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.578+0000 7feb4659c700 1 --2- 172.21.15.81:0/94254501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb4806d120 0x7feb480c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.578+0000 7feb46d9d700 1 -- 172.21.15.81:0/94254501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb4806d120 msgr2=0x7feb480c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.578+0000 7feb46d9d700 1 --2- 172.21.15.81:0/94254501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb4806d120 0x7feb480c7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.578+0000 7feb46d9d700 1 -- 172.21.15.81:0/94254501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb40009a20 con 0x7feb48157ca0 2023-10-07T08:46:35.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.578+0000 7feb46d9d700 1 --2- 172.21.15.81:0/94254501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb48157ca0 0x7feb48154060 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7feb4806fe20 tx=0x7feb40019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:35.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.578+0000 7feb3effd700 1 -- 172.21.15.81:0/94254501 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40012e00 con 0x7feb48157ca0 2023-10-07T08:46:35.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.578+0000 7feb3effd700 1 -- 172.21.15.81:0/94254501 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4001e630 con 0x7feb48157ca0 2023-10-07T08:46:35.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.578+0000 7feb4cc39700 1 -- 172.21.15.81:0/94254501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb480c6db0 con 0x7feb48157ca0 2023-10-07T08:46:35.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.578+0000 7feb3effd700 1 -- 172.21.15.81:0/94254501 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4001e9f0 con 0x7feb48157ca0 2023-10-07T08:46:35.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.578+0000 7feb4cc39700 1 -- 172.21.15.81:0/94254501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb480b60e0 con 0x7feb48157ca0 2023-10-07T08:46:35.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.579+0000 7feb4cc39700 1 -- 172.21.15.81:0/94254501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb480c6fa0 con 0x7feb48157ca0 2023-10-07T08:46:35.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.579+0000 7feb3effd700 1 -- 172.21.15.81:0/94254501 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb40024070 con 0x7feb48157ca0 2023-10-07T08:46:35.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.580+0000 7feb3effd700 1 --2- 172.21.15.81:0/94254501 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb28066f30 0x7feb280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.580+0000 7feb3effd700 1 -- 172.21.15.81:0/94254501 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb40086dd0 con 0x7feb48157ca0 2023-10-07T08:46:35.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.580+0000 7feb4659c700 1 --2- 172.21.15.81:0/94254501 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb28066f30 0x7feb280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.580+0000 7feb3effd700 1 -- 172.21.15.81:0/94254501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7feb2806ea50 con 0x7feb48157ca0 2023-10-07T08:46:35.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.580+0000 7feb4659c700 1 --2- 172.21.15.81:0/94254501 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb28066f30 0x7feb280693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feb380058d0 tx=0x7feb38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:35.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.584+0000 7feb3effd700 1 -- 172.21.15.81:0/94254501 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb40053fa0 con 0x7feb48157ca0 2023-10-07T08:46:35.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.806+0000 7feb4cc39700 1 -- 172.21.15.81:0/94254501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb480b42a0 con 0x7feb48157ca0 2023-10-07T08:46:35.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.807+0000 7feb3effd700 1 -- 172.21.15.81:0/94254501 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4594 (secure 0 0 0) 0x7feb4002c020 con 0x7feb48157ca0 2023-10-07T08:46:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:35.809 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3279897900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3279897900},{"type":"v1","addr":"172.21.15.89:6835","nonce":3279897900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/102905724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":102905724},{"type":"v1","addr":"172.21.15.89:6834","nonce":102905724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4063096820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":4063096820},{"type":"v1","addr":"172.21.15.81:6836","nonce":4063096820}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:45:05.899585+0000","modified":"2023-10-07T08:45:09.552432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2943588561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2943588561},{"type":"v1","addr":"172.21.15.81:6837","nonce":2943588561}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-07T08:46:35.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.809+0000 7feb4cc39700 1 -- 172.21.15.81:0/94254501 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb28066f30 msgr2=0x7feb280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.809+0000 7feb4cc39700 1 --2- 172.21.15.81:0/94254501 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb28066f30 0x7feb280693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feb380058d0 tx=0x7feb38009040 comp rx=0 tx=0).stop 2023-10-07T08:46:35.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.809+0000 7feb4cc39700 1 -- 172.21.15.81:0/94254501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb48157ca0 msgr2=0x7feb48154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.809+0000 7feb4cc39700 1 --2- 172.21.15.81:0/94254501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb48157ca0 0x7feb48154060 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7feb4806fe20 tx=0x7feb40019000 comp rx=0 tx=0).stop 2023-10-07T08:46:35.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.809+0000 7feb4cc39700 1 -- 172.21.15.81:0/94254501 shutdown_connections 2023-10-07T08:46:35.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.809+0000 7feb4cc39700 1 --2- 172.21.15.81:0/94254501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb48157ca0 0x7feb48154060 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.809+0000 7feb4cc39700 1 --2- 172.21.15.81:0/94254501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb4806d120 0x7feb480c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.809+0000 7feb4cc39700 1 --2- 172.21.15.81:0/94254501 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb28066f30 0x7feb280693e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.809+0000 7feb4cc39700 1 --2- 172.21.15.81:0/94254501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb481578d0 0x7feb480c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.809+0000 7feb4cc39700 1 -- 172.21.15.81:0/94254501 >> 172.21.15.81:0/94254501 conn(0x7feb4806bb90 msgr2=0x7feb4815bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:35.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.809+0000 7feb4cc39700 1 -- 172.21.15.81:0/94254501 shutdown_connections 2023-10-07T08:46:35.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.809+0000 7feb4cc39700 1 -- 172.21.15.81:0/94254501 wait complete. 2023-10-07T08:46:35.812 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2023-10-07T08:46:35.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:46:35.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.936+0000 7fe7d2263700 1 Processor -- start 2023-10-07T08:46:35.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.936+0000 7fe7d2263700 1 -- start start 2023-10-07T08:46:35.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.937+0000 7fe7d2263700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7cc1578d0 0x7fe7cc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.937+0000 7fe7d2263700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe7cc06d120 0x7fe7cc06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.937+0000 7fe7d2263700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7cc06dac0 con 0x7fe7cc157ca0 2023-10-07T08:46:35.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.937+0000 7fe7d2263700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7cc0d07c0 con 0x7fe7cc06d120 2023-10-07T08:46:35.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.937+0000 7fe7d2263700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc0cfbb0 con 0x7fe7cc1578d0 2023-10-07T08:46:35.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.937+0000 7fe7d0800700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe7cc06d120 0x7fe7cc06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.937+0000 7fe7cbfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7cc1578d0 0x7fe7cc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.937+0000 7fe7cbfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7cc1578d0 0x7fe7cc0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:39792/0 (socket says 172.21.15.81:39792) 2023-10-07T08:46:35.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.937+0000 7fe7d0800700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe7cc06d120 0x7fe7cc06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:55450/0 (socket says 172.21.15.81:55450) 2023-10-07T08:46:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.937+0000 7fe7cbfff700 1 -- 172.21.15.81:0/3195243630 learned_addr learned my addr 172.21.15.81:0/3195243630 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.937+0000 7fe7cbfff700 1 -- 172.21.15.81:0/3195243630 >> v2:172.21.15.89:3300/0 conn(0x7fe7cc06d120 msgr2=0x7fe7cc06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.937+0000 7fe7cbfff700 1 --2- 172.21.15.81:0/3195243630 >> v2:172.21.15.89:3300/0 conn(0x7fe7cc06d120 0x7fe7cc06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.937+0000 7fe7cbfff700 1 -- 172.21.15.81:0/3195243630 >> v1:172.21.15.89:6789/0 conn(0x7fe7cc157ca0 legacy=0x7fe7cc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.937+0000 7fe7cbfff700 1 -- 172.21.15.81:0/3195243630 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc0cfe90 con 0x7fe7cc1578d0 2023-10-07T08:46:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.937+0000 7fe7d0800700 1 --2- 172.21.15.81:0/3195243630 >> v2:172.21.15.89:3300/0 conn(0x7fe7cc06d120 0x7fe7cc06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:46:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.938+0000 7fe7cbfff700 1 --2- 172.21.15.81:0/3195243630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7cc1578d0 0x7fe7cc0cf4f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00099b0 tx=0x7fe7c0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e957202e88aada6d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.938+0000 7fe7caffd700 1 -- 172.21.15.81:0/3195243630 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0009ea0 con 0x7fe7cc1578d0 2023-10-07T08:46:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.938+0000 7fe7caffd700 1 -- 172.21.15.81:0/3195243630 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c000b860 con 0x7fe7cc1578d0 2023-10-07T08:46:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.938+0000 7fe7caffd700 1 -- 172.21.15.81:0/3195243630 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c000bc00 con 0x7fe7cc1578d0 2023-10-07T08:46:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.938+0000 7fe7d2263700 1 -- 172.21.15.81:0/3195243630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7cc1578d0 msgr2=0x7fe7cc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.938+0000 7fe7d2263700 1 --2- 172.21.15.81:0/3195243630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7cc1578d0 0x7fe7cc0cf4f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00099b0 tx=0x7fe7c0009250 comp rx=0 tx=0).stop 2023-10-07T08:46:35.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.938+0000 7fe7d2263700 1 -- 172.21.15.81:0/3195243630 shutdown_connections 2023-10-07T08:46:35.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.938+0000 7fe7d2263700 1 --2- 172.21.15.81:0/3195243630 >> v2:172.21.15.89:3300/0 conn(0x7fe7cc06d120 0x7fe7cc06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.938+0000 7fe7d2263700 1 --2- 172.21.15.81:0/3195243630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7cc1578d0 0x7fe7cc0cf4f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.938+0000 7fe7d2263700 1 -- 172.21.15.81:0/3195243630 >> 172.21.15.81:0/3195243630 conn(0x7fe7cc06bb90 msgr2=0x7fe7cc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:35.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.938+0000 7fe7d2263700 1 -- 172.21.15.81:0/3195243630 shutdown_connections 2023-10-07T08:46:35.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.938+0000 7fe7d2263700 1 -- 172.21.15.81:0/3195243630 wait complete. 2023-10-07T08:46:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.940+0000 7fe7d2263700 1 Processor -- start 2023-10-07T08:46:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.940+0000 7fe7d2263700 1 -- start start 2023-10-07T08:46:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.940+0000 7fe7d2263700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7cc06d120 0x7fe7cc150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.940+0000 7fe7d2263700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc1578d0 0x7fe7cc16d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.940+0000 7fe7d2263700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7cc157ca0 0x7fe7cc069ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.940+0000 7fe7d2263700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc151e20 con 0x7fe7cc06d120 2023-10-07T08:46:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.940+0000 7fe7d2263700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc151210 con 0x7fe7cc1578d0 2023-10-07T08:46:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.940+0000 7fe7d2263700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc1514f0 con 0x7fe7cc157ca0 2023-10-07T08:46:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7cc06d120 0x7fe7cc150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7cc06d120 0x7fe7cc150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33216/0 (socket says 172.21.15.81:33216) 2023-10-07T08:46:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7cbfff700 1 -- 172.21.15.81:0/1618111268 learned_addr learned my addr 172.21.15.81:0/1618111268 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7d0800700 1 --2- 172.21.15.81:0/1618111268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7cc157ca0 0x7fe7cc069ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7cb7fe700 1 --2- 172.21.15.81:0/1618111268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc1578d0 0x7fe7cc16d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7cbfff700 1 -- 172.21.15.81:0/1618111268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7cc157ca0 msgr2=0x7fe7cc069ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7cbfff700 1 --2- 172.21.15.81:0/1618111268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7cc157ca0 0x7fe7cc069ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7cbfff700 1 -- 172.21.15.81:0/1618111268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc1578d0 msgr2=0x7fe7cc16d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7cbfff700 1 --2- 172.21.15.81:0/1618111268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc1578d0 0x7fe7cc16d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7cbfff700 1 -- 172.21.15.81:0/1618111268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c4009a20 con 0x7fe7cc06d120 2023-10-07T08:46:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7d0800700 1 --2- 172.21.15.81:0/1618111268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7cc157ca0 0x7fe7cc069ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7cbfff700 1 --2- 172.21.15.81:0/1618111268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7cc06d120 0x7fe7cc150ba0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc068330 tx=0x7fe7c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7b3fff700 1 -- 172.21.15.81:0/1618111268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c000bbe0 con 0x7fe7cc06d120 2023-10-07T08:46:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7b3fff700 1 -- 172.21.15.81:0/1618111268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c0011420 con 0x7fe7cc06d120 2023-10-07T08:46:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7d2263700 1 -- 172.21.15.81:0/1618111268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c00094f0 con 0x7fe7cc06d120 2023-10-07T08:46:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7b3fff700 1 -- 172.21.15.81:0/1618111268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c00117e0 con 0x7fe7cc06d120 2023-10-07T08:46:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.941+0000 7fe7d2263700 1 -- 172.21.15.81:0/1618111268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7cc151ab0 con 0x7fe7cc06d120 2023-10-07T08:46:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.942+0000 7fe7d2263700 1 -- 172.21.15.81:0/1618111268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7cc067ac0 con 0x7fe7cc06d120 2023-10-07T08:46:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.942+0000 7fe7b3fff700 1 -- 172.21.15.81:0/1618111268 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7c0011b50 con 0x7fe7cc06d120 2023-10-07T08:46:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.943+0000 7fe7b3fff700 1 --2- 172.21.15.81:0/1618111268 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe7b8066f30 0x7fe7b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.943+0000 7fe7b3fff700 1 -- 172.21.15.81:0/1618111268 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe7c0085ae0 con 0x7fe7cc06d120 2023-10-07T08:46:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.943+0000 7fe7cb7fe700 1 --2- 172.21.15.81:0/1618111268 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe7b8066f30 0x7fe7b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.943+0000 7fe7b3fff700 1 -- 172.21.15.81:0/1618111268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7fe7b806ea50 con 0x7fe7cc06d120 2023-10-07T08:46:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.943+0000 7fe7cb7fe700 1 --2- 172.21.15.81:0/1618111268 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe7b8066f30 0x7fe7b80693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc154180 tx=0x7fe7bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:35.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:35.947+0000 7fe7b3fff700 1 -- 172.21.15.81:0/1618111268 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7c0052dd0 con 0x7fe7cc06d120 2023-10-07T08:46:36.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.131+0000 7fe7d2263700 1 -- 172.21.15.81:0/1618111268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7cc0d0170 con 0x7fe7cc06d120 2023-10-07T08:46:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.132+0000 7fe7b3fff700 1 -- 172.21.15.81:0/1618111268 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+15346 (secure 0 0 0) 0x7fe7c0028070 con 0x7fe7cc06d120 2023-10-07T08:46:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:36.133 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":72,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:46:34.368445+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:45:03.701565+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-07T08:45:04.877693+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:46:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.134+0000 7fe7d2263700 1 -- 172.21.15.81:0/1618111268 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe7b8066f30 msgr2=0x7fe7b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.134+0000 7fe7d2263700 1 --2- 172.21.15.81:0/1618111268 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe7b8066f30 0x7fe7b80693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc154180 tx=0x7fe7bc009040 comp rx=0 tx=0).stop 2023-10-07T08:46:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.134+0000 7fe7d2263700 1 -- 172.21.15.81:0/1618111268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7cc06d120 msgr2=0x7fe7cc150ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.134+0000 7fe7d2263700 1 --2- 172.21.15.81:0/1618111268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7cc06d120 0x7fe7cc150ba0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc068330 tx=0x7fe7c0017000 comp rx=0 tx=0).stop 2023-10-07T08:46:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.134+0000 7fe7d2263700 1 -- 172.21.15.81:0/1618111268 shutdown_connections 2023-10-07T08:46:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.134+0000 7fe7d2263700 1 --2- 172.21.15.81:0/1618111268 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe7b8066f30 0x7fe7b80693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.134+0000 7fe7d2263700 1 --2- 172.21.15.81:0/1618111268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7cc157ca0 0x7fe7cc069ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.134+0000 7fe7d2263700 1 --2- 172.21.15.81:0/1618111268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7cc06d120 0x7fe7cc150ba0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.134+0000 7fe7d2263700 1 --2- 172.21.15.81:0/1618111268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc1578d0 0x7fe7cc16d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.134+0000 7fe7d2263700 1 -- 172.21.15.81:0/1618111268 >> 172.21.15.81:0/1618111268 conn(0x7fe7cc06bb90 msgr2=0x7fe7cc155db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.134+0000 7fe7d2263700 1 -- 172.21.15.81:0/1618111268 shutdown_connections 2023-10-07T08:46:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.134+0000 7fe7d2263700 1 -- 172.21.15.81:0/1618111268 wait complete. 2023-10-07T08:46:36.148 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T08:46:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.260+0000 7f6cbb499700 1 Processor -- start 2023-10-07T08:46:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.260+0000 7f6cbb499700 1 -- start start 2023-10-07T08:46:36.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.261+0000 7f6cbb499700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6cb4159f10 0x7f6cb4068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.261+0000 7f6cbb499700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cb4068cc0 0x7f6cb40cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.261+0000 7f6cbb499700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb40cee10 con 0x7f6cb4159b40 2023-10-07T08:46:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.261+0000 7f6cbb499700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb4069140 con 0x7f6cb4159f10 2023-10-07T08:46:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.261+0000 7f6cbb499700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb40cd040 con 0x7f6cb4068cc0 2023-10-07T08:46:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.261+0000 7f6cbac98700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cb4068cc0 0x7f6cb40cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.261+0000 7f6cb9c96700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6cb4159f10 0x7f6cb4068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.261+0000 7f6cbac98700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cb4068cc0 0x7f6cb40cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:39804/0 (socket says 172.21.15.81:39804) 2023-10-07T08:46:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.261+0000 7f6cb9c96700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6cb4159f10 0x7f6cb4068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:55476/0 (socket says 172.21.15.81:55476) 2023-10-07T08:46:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.261+0000 7f6cbac98700 1 -- 172.21.15.81:0/1518995989 learned_addr learned my addr 172.21.15.81:0/1518995989 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.261+0000 7f6cb9495700 1 -- 172.21.15.81:0/1518995989 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163175729 0 0) 0x7f6cb40cee10 con 0x7f6cb4159b40 2023-10-07T08:46:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.261+0000 7f6cbac98700 1 -- 172.21.15.81:0/1518995989 >> v2:172.21.15.89:3300/0 conn(0x7f6cb4159f10 msgr2=0x7f6cb4068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.261+0000 7f6cbac98700 1 --2- 172.21.15.81:0/1518995989 >> v2:172.21.15.89:3300/0 conn(0x7f6cb4159f10 0x7f6cb4068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.261+0000 7f6cbac98700 1 -- 172.21.15.81:0/1518995989 >> v1:172.21.15.89:6789/0 conn(0x7f6cb4159b40 legacy=0x7f6cb40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.261+0000 7f6cbac98700 1 -- 172.21.15.81:0/1518995989 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb40cd320 con 0x7f6cb4068cc0 2023-10-07T08:46:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.261+0000 7f6cbac98700 1 --2- 172.21.15.81:0/1518995989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cb4068cc0 0x7f6cb40cf2a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0099b0 tx=0x7f6cac009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee055a600acf0609 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.262+0000 7f6cb9495700 1 -- 172.21.15.81:0/1518995989 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac009ea0 con 0x7f6cb4068cc0 2023-10-07T08:46:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.262+0000 7f6cb9495700 1 -- 172.21.15.81:0/1518995989 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cac00b860 con 0x7f6cb4068cc0 2023-10-07T08:46:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.262+0000 7f6cb9495700 1 -- 172.21.15.81:0/1518995989 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac00bc00 con 0x7f6cb4068cc0 2023-10-07T08:46:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.262+0000 7f6cbb499700 1 -- 172.21.15.81:0/1518995989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cb4068cc0 msgr2=0x7f6cb40cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.262+0000 7f6cbb499700 1 --2- 172.21.15.81:0/1518995989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cb4068cc0 0x7f6cb40cf2a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0099b0 tx=0x7f6cac009250 comp rx=0 tx=0).stop 2023-10-07T08:46:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.262+0000 7f6cbb499700 1 -- 172.21.15.81:0/1518995989 shutdown_connections 2023-10-07T08:46:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.262+0000 7f6cbb499700 1 --2- 172.21.15.81:0/1518995989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cb4068cc0 0x7f6cb40cf2a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.262+0000 7f6cbb499700 1 --2- 172.21.15.81:0/1518995989 >> v2:172.21.15.89:3300/0 conn(0x7f6cb4159f10 0x7f6cb4068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.262+0000 7f6cbb499700 1 -- 172.21.15.81:0/1518995989 >> 172.21.15.81:0/1518995989 conn(0x7f6cb40cd660 msgr2=0x7f6cb40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.262+0000 7f6cbb499700 1 -- 172.21.15.81:0/1518995989 shutdown_connections 2023-10-07T08:46:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.262+0000 7f6cbb499700 1 -- 172.21.15.81:0/1518995989 wait complete. 2023-10-07T08:46:36.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.263+0000 7f6cbb499700 1 Processor -- start 2023-10-07T08:46:36.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.263+0000 7f6cbb499700 1 -- start start 2023-10-07T08:46:36.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.264+0000 7f6cbb499700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cb4068cc0 0x7f6cb4157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.264+0000 7f6cbb499700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cb4159b40 0x7f6cb4158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.264+0000 7f6cbb499700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4159f10 0x7f6cb40b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.264+0000 7f6cbb499700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb4158970 con 0x7f6cb4159f10 2023-10-07T08:46:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.264+0000 7f6cbb499700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb4158c50 con 0x7f6cb4159b40 2023-10-07T08:46:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.264+0000 7f6cbb499700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb4158f30 con 0x7f6cb4068cc0 2023-10-07T08:46:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.264+0000 7f6cbac98700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4159f10 0x7f6cb40b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.264+0000 7f6cbac98700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4159f10 0x7f6cb40b4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33222/0 (socket says 172.21.15.81:33222) 2023-10-07T08:46:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.264+0000 7f6cbac98700 1 -- 172.21.15.81:0/517445769 learned_addr learned my addr 172.21.15.81:0/517445769 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.264+0000 7f6cba497700 1 --2- 172.21.15.81:0/517445769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cb4068cc0 0x7f6cb4157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.264+0000 7f6cb9c96700 1 --2- 172.21.15.81:0/517445769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cb4159b40 0x7f6cb4158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.265+0000 7f6cba497700 1 -- 172.21.15.81:0/517445769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cb4159b40 msgr2=0x7f6cb4158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.265+0000 7f6cba497700 1 --2- 172.21.15.81:0/517445769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cb4159b40 0x7f6cb4158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.265+0000 7f6cba497700 1 -- 172.21.15.81:0/517445769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4159f10 msgr2=0x7f6cb40b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.265+0000 7f6cba497700 1 --2- 172.21.15.81:0/517445769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4159f10 0x7f6cb40b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.265+0000 7f6cba497700 1 -- 172.21.15.81:0/517445769 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac0094f0 con 0x7f6cb4068cc0 2023-10-07T08:46:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.265+0000 7f6cbac98700 1 --2- 172.21.15.81:0/517445769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4159f10 0x7f6cb40b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:46:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.265+0000 7f6cba497700 1 --2- 172.21.15.81:0/517445769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cb4068cc0 0x7f6cb4157c00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0002230 tx=0x7f6cb00016f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.265+0000 7f6caa7fc700 1 -- 172.21.15.81:0/517445769 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0012630 con 0x7f6cb4068cc0 2023-10-07T08:46:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.265+0000 7f6caa7fc700 1 -- 172.21.15.81:0/517445769 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb00127b0 con 0x7f6cb4068cc0 2023-10-07T08:46:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.265+0000 7f6cbb499700 1 -- 172.21.15.81:0/517445769 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb4159210 con 0x7f6cb4068cc0 2023-10-07T08:46:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.265+0000 7f6caa7fc700 1 -- 172.21.15.81:0/517445769 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0012b70 con 0x7f6cb4068cc0 2023-10-07T08:46:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.265+0000 7f6cbb499700 1 -- 172.21.15.81:0/517445769 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb4158680 con 0x7f6cb4068cc0 2023-10-07T08:46:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.266+0000 7f6cbb499700 1 -- 172.21.15.81:0/517445769 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb4063e90 con 0x7f6cb4068cc0 2023-10-07T08:46:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.266+0000 7f6caa7fc700 1 -- 172.21.15.81:0/517445769 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6cb0003030 con 0x7f6cb4068cc0 2023-10-07T08:46:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.267+0000 7f6caa7fc700 1 --2- 172.21.15.81:0/517445769 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6c98066f30 0x7f6c980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.267+0000 7f6caa7fc700 1 -- 172.21.15.81:0/517445769 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6cb0084460 con 0x7f6cb4068cc0 2023-10-07T08:46:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.267+0000 7f6cb9c96700 1 --2- 172.21.15.81:0/517445769 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6c98066f30 0x7f6c980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.267+0000 7f6caa7fc700 1 -- 172.21.15.81:0/517445769 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f6c9806ea50 con 0x7f6cb4068cc0 2023-10-07T08:46:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.267+0000 7f6cb9c96700 1 --2- 172.21.15.81:0/517445769 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6c98066f30 0x7f6c980693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6cb415a640 tx=0x7f6ca40091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:36.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.271+0000 7f6caa7fc700 1 -- 172.21.15.81:0/517445769 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cb00516d0 con 0x7f6cb4068cc0 2023-10-07T08:46:36.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.495+0000 7f6cbb499700 1 -- 172.21.15.81:0/517445769 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6cb40ce7c0 con 0x7f6cb4068cc0 2023-10-07T08:46:36.498 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:46:36.497+0000 7f43c472d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T08:46:36.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.503+0000 7f6caa7fc700 1 -- 172.21.15.81:0/517445769 <== mon.2 v2:172.21.15.89:3301/0 7 ==== osd_map(73..73 src has 1..73) v4 ==== 374+0+0 (secure 0 0 0) 0x7f6cb0002260 con 0x7f6cb4068cc0 2023-10-07T08:46:36.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.503+0000 7f6caa7fc700 1 -- 172.21.15.81:0/517445769 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=74}) v3 -- 0x7f6c9806f340 con 0x7f6cb4068cc0 2023-10-07T08:46:36.506 INFO:tasks.ceph.mds.a.smithi081.stderr: -9257> 2023-10-07T08:45:11.509+0000 7efc84b7c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:46:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.506+0000 7f6caa7fc700 1 -- 172.21.15.81:0/517445769 <== mon.2 v2:172.21.15.89:3301/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6cb0054cf0 con 0x7f6cb4068cc0 2023-10-07T08:46:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.509+0000 7f6cbb499700 1 -- 172.21.15.81:0/517445769 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6c98066f30 msgr2=0x7f6c980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.509+0000 7f6cbb499700 1 --2- 172.21.15.81:0/517445769 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6c98066f30 0x7f6c980693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6cb415a640 tx=0x7f6ca40091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.509+0000 7f6cbb499700 1 -- 172.21.15.81:0/517445769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cb4068cc0 msgr2=0x7f6cb4157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.509+0000 7f6cbb499700 1 --2- 172.21.15.81:0/517445769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cb4068cc0 0x7f6cb4157c00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0002230 tx=0x7f6cb00016f0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.509+0000 7f6cbb499700 1 -- 172.21.15.81:0/517445769 shutdown_connections 2023-10-07T08:46:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.509+0000 7f6cbb499700 1 --2- 172.21.15.81:0/517445769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4159f10 0x7f6cb40b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.509+0000 7f6cbb499700 1 --2- 172.21.15.81:0/517445769 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6c98066f30 0x7f6c980693e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.509+0000 7f6cbb499700 1 --2- 172.21.15.81:0/517445769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cb4068cc0 0x7f6cb4157c00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.509+0000 7f6cbb499700 1 --2- 172.21.15.81:0/517445769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cb4159b40 0x7f6cb4158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.509+0000 7f6cbb499700 1 -- 172.21.15.81:0/517445769 >> 172.21.15.81:0/517445769 conn(0x7f6cb40cd660 msgr2=0x7f6cb40c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.509+0000 7f6cbb499700 1 -- 172.21.15.81:0/517445769 shutdown_connections 2023-10-07T08:46:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.509+0000 7f6cbb499700 1 -- 172.21.15.81:0/517445769 wait complete. 2023-10-07T08:46:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T08:46:36.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T08:46:36.535 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-07T08:46:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.639+0000 7f4a3b1a8700 1 Processor -- start 2023-10-07T08:46:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.639+0000 7f4a3b1a8700 1 -- start start 2023-10-07T08:46:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.640+0000 7f4a3b1a8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a340d0f50 0x7f4a3406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.640+0000 7f4a3b1a8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4a3406d530 0x7f4a3415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.640+0000 7f4a3b1a8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3406d9b0 con 0x7f4a340d0b80 2023-10-07T08:46:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.640+0000 7f4a3b1a8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3415a690 con 0x7f4a3406d530 2023-10-07T08:46:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.640+0000 7f4a3b1a8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a340cf2d0 con 0x7f4a340d0f50 2023-10-07T08:46:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.640+0000 7f4a3a1a6700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4a340d0b80 0x7f4a340cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53854/0 (socket says 172.21.15.81:53854) 2023-10-07T08:46:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.640+0000 7f4a3a1a6700 1 -- 172.21.15.81:0/2629863072 learned_addr learned my addr 172.21.15.81:0/2629863072 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.640+0000 7f4a3a9a7700 1 --2- 172.21.15.81:0/2629863072 >> v2:172.21.15.89:3300/0 conn(0x7f4a3406d530 0x7f4a3415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.640+0000 7f4a399a5700 1 --2- 172.21.15.81:0/2629863072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a340d0f50 0x7f4a3406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.640+0000 7f4a391a4700 1 -- 172.21.15.81:0/2629863072 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196972976 0 0) 0x7f4a3406d9b0 con 0x7f4a340d0b80 2023-10-07T08:46:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.640+0000 7f4a391a4700 1 -- 172.21.15.81:0/2629863072 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a20003570 con 0x7f4a340d0b80 2023-10-07T08:46:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.641+0000 7f4a399a5700 1 -- 172.21.15.81:0/2629863072 >> v2:172.21.15.89:3300/0 conn(0x7f4a3406d530 msgr2=0x7f4a3415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.641+0000 7f4a399a5700 1 --2- 172.21.15.81:0/2629863072 >> v2:172.21.15.89:3300/0 conn(0x7f4a3406d530 0x7f4a3415b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.641+0000 7f4a399a5700 1 -- 172.21.15.81:0/2629863072 >> v1:172.21.15.81:6789/0 conn(0x7f4a340d0b80 legacy=0x7f4a340cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.641+0000 7f4a399a5700 1 -- 172.21.15.81:0/2629863072 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a340d0480 con 0x7f4a340d0f50 2023-10-07T08:46:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.641+0000 7f4a3a9a7700 1 --2- 172.21.15.81:0/2629863072 >> v2:172.21.15.89:3300/0 conn(0x7f4a3406d530 0x7f4a3415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:46:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.641+0000 7f4a399a5700 1 --2- 172.21.15.81:0/2629863072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a340d0f50 0x7f4a3406cff0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4a240098e0 tx=0x7f4a240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0e47217e86eba1c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.641+0000 7f4a391a4700 1 -- 172.21.15.81:0/2629863072 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24011630 con 0x7f4a340d0f50 2023-10-07T08:46:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.641+0000 7f4a391a4700 1 -- 172.21.15.81:0/2629863072 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a24011790 con 0x7f4a340d0f50 2023-10-07T08:46:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.641+0000 7f4a391a4700 1 -- 172.21.15.81:0/2629863072 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24011b30 con 0x7f4a340d0f50 2023-10-07T08:46:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.641+0000 7f4a3b1a8700 1 -- 172.21.15.81:0/2629863072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a340d0f50 msgr2=0x7f4a3406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.641+0000 7f4a3b1a8700 1 --2- 172.21.15.81:0/2629863072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a340d0f50 0x7f4a3406cff0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4a240098e0 tx=0x7f4a240091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.642+0000 7f4a3b1a8700 1 -- 172.21.15.81:0/2629863072 shutdown_connections 2023-10-07T08:46:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.642+0000 7f4a3b1a8700 1 --2- 172.21.15.81:0/2629863072 >> v2:172.21.15.89:3300/0 conn(0x7f4a3406d530 0x7f4a3415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.642+0000 7f4a3b1a8700 1 --2- 172.21.15.81:0/2629863072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a340d0f50 0x7f4a3406cff0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.642+0000 7f4a3b1a8700 1 -- 172.21.15.81:0/2629863072 >> 172.21.15.81:0/2629863072 conn(0x7f4a34063230 msgr2=0x7f4a34063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.642+0000 7f4a3b1a8700 1 -- 172.21.15.81:0/2629863072 shutdown_connections 2023-10-07T08:46:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.642+0000 7f4a3b1a8700 1 -- 172.21.15.81:0/2629863072 wait complete. 2023-10-07T08:46:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.643+0000 7f4a3b1a8700 1 Processor -- start 2023-10-07T08:46:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.643+0000 7f4a3b1a8700 1 -- start start 2023-10-07T08:46:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.643+0000 7f4a3b1a8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a3406d530 0x7f4a34160170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.643+0000 7f4a3b1a8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a340d0b80 0x7f4a3413aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.643+0000 7f4a3b1a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a340d0f50 0x7f4a3415e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.643+0000 7f4a3b1a8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a341606b0 con 0x7f4a340d0f50 2023-10-07T08:46:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.643+0000 7f4a3b1a8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3415fce0 con 0x7f4a3406d530 2023-10-07T08:46:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.643+0000 7f4a3b1a8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3415ee30 con 0x7f4a340d0b80 2023-10-07T08:46:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a3a9a7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a340d0f50 0x7f4a3415e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a3a9a7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a340d0f50 0x7f4a3415e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33248/0 (socket says 172.21.15.81:33248) 2023-10-07T08:46:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a3a9a7700 1 -- 172.21.15.81:0/2869401556 learned_addr learned my addr 172.21.15.81:0/2869401556 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a399a5700 1 --2- 172.21.15.81:0/2869401556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a340d0b80 0x7f4a3413aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a3a1a6700 1 --2- 172.21.15.81:0/2869401556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a3406d530 0x7f4a34160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a3a9a7700 1 -- 172.21.15.81:0/2869401556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a340d0b80 msgr2=0x7f4a3413aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a3a9a7700 1 --2- 172.21.15.81:0/2869401556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a340d0b80 0x7f4a3413aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a3a9a7700 1 -- 172.21.15.81:0/2869401556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a3406d530 msgr2=0x7f4a34160170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a3a9a7700 1 --2- 172.21.15.81:0/2869401556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a3406d530 0x7f4a34160170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a3a9a7700 1 -- 172.21.15.81:0/2869401556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c009a20 con 0x7f4a340d0f50 2023-10-07T08:46:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a399a5700 1 --2- 172.21.15.81:0/2869401556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a340d0b80 0x7f4a3413aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:46:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a3a9a7700 1 --2- 172.21.15.81:0/2869401556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a340d0f50 0x7f4a3415e1b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009fc0 tx=0x7f4a2c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a2a7fc700 1 -- 172.21.15.81:0/2869401556 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c00cd30 con 0x7f4a340d0f50 2023-10-07T08:46:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a2a7fc700 1 -- 172.21.15.81:0/2869401556 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c00f040 con 0x7f4a340d0f50 2023-10-07T08:46:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a2a7fc700 1 -- 172.21.15.81:0/2869401556 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0146d0 con 0x7f4a340d0f50 2023-10-07T08:46:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a3b1a8700 1 -- 172.21.15.81:0/2869401556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a24009420 con 0x7f4a340d0f50 2023-10-07T08:46:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.644+0000 7f4a3b1a8700 1 -- 172.21.15.81:0/2869401556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3415f3b0 con 0x7f4a340d0f50 2023-10-07T08:46:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.645+0000 7f4a3b1a8700 1 -- 172.21.15.81:0/2869401556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a3415fe70 con 0x7f4a340d0f50 2023-10-07T08:46:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.646+0000 7f4a2a7fc700 1 -- 172.21.15.81:0/2869401556 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a2c003020 con 0x7f4a340d0f50 2023-10-07T08:46:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.646+0000 7f4a2a7fc700 1 --2- 172.21.15.81:0/2869401556 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a18066f30 0x7f4a180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.646+0000 7f4a2a7fc700 1 -- 172.21.15.81:0/2869401556 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f4a2c0850e0 con 0x7f4a340d0f50 2023-10-07T08:46:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.646+0000 7f4a3a1a6700 1 --2- 172.21.15.81:0/2869401556 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a18066f30 0x7f4a180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.646+0000 7f4a2a7fc700 1 -- 172.21.15.81:0/2869401556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=74}) v3 -- 0x7f4a1806eaf0 con 0x7f4a340d0f50 2023-10-07T08:46:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.646+0000 7f4a3a1a6700 1 --2- 172.21.15.81:0/2869401556 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a18066f30 0x7f4a180693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4a300058d0 tx=0x7f4a30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.650+0000 7f4a2a7fc700 1 -- 172.21.15.81:0/2869401556 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a2c052300 con 0x7f4a340d0f50 2023-10-07T08:46:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:36.875+0000 7f4a3b1a8700 1 -- 172.21.15.81:0/2869401556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4a340676e0 con 0x7f4a340d0f50 2023-10-07T08:46:37.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.501+0000 7f4a2a7fc700 1 -- 172.21.15.81:0/2869401556 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4a2c0180a0 con 0x7f4a340d0f50 2023-10-07T08:46:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.503+0000 7f4a3b1a8700 1 -- 172.21.15.81:0/2869401556 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a18066f30 msgr2=0x7f4a180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.503+0000 7f4a3b1a8700 1 --2- 172.21.15.81:0/2869401556 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a18066f30 0x7f4a180693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4a300058d0 tx=0x7f4a30009040 comp rx=0 tx=0).stop 2023-10-07T08:46:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.503+0000 7f4a3b1a8700 1 -- 172.21.15.81:0/2869401556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a340d0f50 msgr2=0x7f4a3415e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.503+0000 7f4a3b1a8700 1 --2- 172.21.15.81:0/2869401556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a340d0f50 0x7f4a3415e1b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009fc0 tx=0x7f4a2c00b040 comp rx=0 tx=0).stop 2023-10-07T08:46:37.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.504+0000 7f4a3b1a8700 1 -- 172.21.15.81:0/2869401556 shutdown_connections 2023-10-07T08:46:37.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.504+0000 7f4a3b1a8700 1 --2- 172.21.15.81:0/2869401556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a340d0f50 0x7f4a3415e1b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:37.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.504+0000 7f4a3b1a8700 1 --2- 172.21.15.81:0/2869401556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a3406d530 0x7f4a34160170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:37.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.504+0000 7f4a3b1a8700 1 --2- 172.21.15.81:0/2869401556 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a18066f30 0x7f4a180693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:37.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.504+0000 7f4a3b1a8700 1 --2- 172.21.15.81:0/2869401556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a340d0b80 0x7f4a3413aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:37.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.504+0000 7f4a3b1a8700 1 -- 172.21.15.81:0/2869401556 >> 172.21.15.81:0/2869401556 conn(0x7f4a34063230 msgr2=0x7f4a3415c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:37.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.504+0000 7f4a3b1a8700 1 -- 172.21.15.81:0/2869401556 shutdown_connections 2023-10-07T08:46:37.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.504+0000 7f4a3b1a8700 1 -- 172.21.15.81:0/2869401556 wait complete. 2023-10-07T08:46:37.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T08:46:37.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.676+0000 7f3839cbc700 1 Processor -- start 2023-10-07T08:46:37.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.676+0000 7f3839cbc700 1 -- start start 2023-10-07T08:46:37.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.677+0000 7f3839cbc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f38340d0b80 0x7f38340cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:37.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.677+0000 7f3839cbc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38340d02b0 0x7f383406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:37.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.677+0000 7f3839cbc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38340cf2d0 con 0x7f38340d0f50 2023-10-07T08:46:37.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.677+0000 7f3839cbc700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f383415a690 con 0x7f38340d02b0 2023-10-07T08:46:37.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.677+0000 7f3839cbc700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f383406dc00 con 0x7f38340d0b80 2023-10-07T08:46:37.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.677+0000 7f3833fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38340d02b0 0x7f383406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:37.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.677+0000 7f38394bb700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f38340d0f50 0x7f383415b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53862/0 (socket says 172.21.15.81:53862) 2023-10-07T08:46:37.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.677+0000 7f38394bb700 1 -- 172.21.15.81:0/981521377 learned_addr learned my addr 172.21.15.81:0/981521377 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:37.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.677+0000 7f3833fff700 1 -- 172.21.15.81:0/981521377 >> v2:172.21.15.89:3300/0 conn(0x7f38340d0b80 msgr2=0x7f38340cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:37.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.677+0000 7f3838cba700 1 --2- 172.21.15.81:0/981521377 >> v2:172.21.15.89:3300/0 conn(0x7f38340d0b80 0x7f38340cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:37.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f38337fe700 1 -- 172.21.15.81:0/981521377 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098745405 0 0) 0x7f38340cf2d0 con 0x7f38340d0f50 2023-10-07T08:46:37.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f3833fff700 1 --2- 172.21.15.81:0/981521377 >> v2:172.21.15.89:3300/0 conn(0x7f38340d0b80 0x7f38340cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:37.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f3833fff700 1 -- 172.21.15.81:0/981521377 >> v1:172.21.15.81:6789/0 conn(0x7f38340d0f50 legacy=0x7f383415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:37.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f3833fff700 1 -- 172.21.15.81:0/981521377 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38340cf570 con 0x7f38340d02b0 2023-10-07T08:46:37.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f3838cba700 1 --2- 172.21.15.81:0/981521377 >> v2:172.21.15.89:3300/0 conn(0x7f38340d0b80 0x7f38340cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:46:37.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f3833fff700 1 --2- 172.21.15.81:0/981521377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38340d02b0 0x7f383406cff0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f383406cd80 tx=0x7f38280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb7dc8d3904a516 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:37.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f38337fe700 1 -- 172.21.15.81:0/981521377 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382800b6b0 con 0x7f38340d02b0 2023-10-07T08:46:37.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f38337fe700 1 -- 172.21.15.81:0/981521377 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382800b810 con 0x7f38340d02b0 2023-10-07T08:46:37.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f38337fe700 1 -- 172.21.15.81:0/981521377 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382800bbb0 con 0x7f38340d02b0 2023-10-07T08:46:37.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f3839cbc700 1 -- 172.21.15.81:0/981521377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38340d02b0 msgr2=0x7f383406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:37.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f3839cbc700 1 --2- 172.21.15.81:0/981521377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38340d02b0 0x7f383406cff0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f383406cd80 tx=0x7f38280091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:37.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f3839cbc700 1 -- 172.21.15.81:0/981521377 shutdown_connections 2023-10-07T08:46:37.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f3839cbc700 1 --2- 172.21.15.81:0/981521377 >> v2:172.21.15.89:3300/0 conn(0x7f38340d0b80 0x7f38340cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:37.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f3839cbc700 1 --2- 172.21.15.81:0/981521377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38340d02b0 0x7f383406cff0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:37.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f3839cbc700 1 -- 172.21.15.81:0/981521377 >> 172.21.15.81:0/981521377 conn(0x7f3834063230 msgr2=0x7f3834063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:37.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f3839cbc700 1 -- 172.21.15.81:0/981521377 shutdown_connections 2023-10-07T08:46:37.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.678+0000 7f3839cbc700 1 -- 172.21.15.81:0/981521377 wait complete. 2023-10-07T08:46:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.679+0000 7f3839cbc700 1 Processor -- start 2023-10-07T08:46:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.680+0000 7f3839cbc700 1 -- start start 2023-10-07T08:46:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.680+0000 7f3839cbc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38340d02b0 0x7f38340acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.680+0000 7f3839cbc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38340d0b80 0x7f38340b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.680+0000 7f3839cbc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38340d0f50 0x7f383416a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.680+0000 7f3839cbc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38341571c0 con 0x7f38340d0b80 2023-10-07T08:46:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.680+0000 7f3839cbc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38340abe20 con 0x7f38340d0f50 2023-10-07T08:46:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.680+0000 7f3839cbc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38340ac100 con 0x7f38340d02b0 2023-10-07T08:46:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.681+0000 7f3833fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38340d0b80 0x7f38340b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.681+0000 7f3833fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38340d0b80 0x7f38340b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33258/0 (socket says 172.21.15.81:33258) 2023-10-07T08:46:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.681+0000 7f3833fff700 1 -- 172.21.15.81:0/1044811984 learned_addr learned my addr 172.21.15.81:0/1044811984 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.681+0000 7f3838cba700 1 --2- 172.21.15.81:0/1044811984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38340d02b0 0x7f38340acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.681+0000 7f38394bb700 1 --2- 172.21.15.81:0/1044811984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38340d0f50 0x7f383416a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.681+0000 7f3833fff700 1 -- 172.21.15.81:0/1044811984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38340d02b0 msgr2=0x7f38340acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.681+0000 7f3833fff700 1 --2- 172.21.15.81:0/1044811984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38340d02b0 0x7f38340acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.681+0000 7f3833fff700 1 -- 172.21.15.81:0/1044811984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38340d0f50 msgr2=0x7f383416a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.681+0000 7f3833fff700 1 --2- 172.21.15.81:0/1044811984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38340d0f50 0x7f383416a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.681+0000 7f3833fff700 1 -- 172.21.15.81:0/1044811984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3828009420 con 0x7f38340d0b80 2023-10-07T08:46:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.681+0000 7f3833fff700 1 --2- 172.21.15.81:0/1044811984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38340d0b80 0x7f38340b0d80 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f383406fcc0 tx=0x7f3828017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.681+0000 7f3830ff9700 1 -- 172.21.15.81:0/1044811984 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3828011420 con 0x7f38340d0b80 2023-10-07T08:46:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.681+0000 7f3830ff9700 1 -- 172.21.15.81:0/1044811984 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3828011580 con 0x7f38340d0b80 2023-10-07T08:46:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.681+0000 7f3839cbc700 1 -- 172.21.15.81:0/1044811984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38340ac3e0 con 0x7f38340d0b80 2023-10-07T08:46:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.681+0000 7f3830ff9700 1 -- 172.21.15.81:0/1044811984 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3828011920 con 0x7f38340d0b80 2023-10-07T08:46:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.681+0000 7f3839cbc700 1 -- 172.21.15.81:0/1044811984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38340ac9a0 con 0x7f38340d0b80 2023-10-07T08:46:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.682+0000 7f3839cbc700 1 -- 172.21.15.81:0/1044811984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38340676e0 con 0x7f38340d0b80 2023-10-07T08:46:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.682+0000 7f3830ff9700 1 -- 172.21.15.81:0/1044811984 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3828011d10 con 0x7f38340d0b80 2023-10-07T08:46:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.683+0000 7f3830ff9700 1 --2- 172.21.15.81:0/1044811984 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3820066f30 0x7f38200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.683+0000 7f3830ff9700 1 -- 172.21.15.81:0/1044811984 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f3828086120 con 0x7f38340d0b80 2023-10-07T08:46:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.683+0000 7f3838cba700 1 --2- 172.21.15.81:0/1044811984 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3820066f30 0x7f38200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.683+0000 7f3830ff9700 1 -- 172.21.15.81:0/1044811984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=74}) v3 -- 0x7f382006eaf0 con 0x7f38340d0b80 2023-10-07T08:46:37.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.683+0000 7f3838cba700 1 --2- 172.21.15.81:0/1044811984 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3820066f30 0x7f38200693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3824007650 tx=0x7f38240075e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.687+0000 7f3830ff9700 1 -- 172.21.15.81:0/1044811984 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3828015060 con 0x7f38340d0b80 2023-10-07T08:46:37.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:37.867+0000 7f3839cbc700 1 -- 172.21.15.81:0/1044811984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f38340cf850 con 0x7f38340d0b80 2023-10-07T08:46:38.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.507+0000 7f3830ff9700 1 -- 172.21.15.81:0/1044811984 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(74..74 src has 1..74) v4 ==== 288+0+0 (secure 0 0 0) 0x7f382800f2e0 con 0x7f38340d0b80 2023-10-07T08:46:38.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.507+0000 7f3830ff9700 1 -- 172.21.15.81:0/1044811984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=75}) v3 -- 0x7f382006cf20 con 0x7f38340d0b80 2023-10-07T08:46:38.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.509+0000 7f3830ff9700 1 -- 172.21.15.81:0/1044811984 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 181+0+0 (secure 0 0 0) 0x7f38280533c0 con 0x7f38340d0b80 2023-10-07T08:46:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.516+0000 7f3839cbc700 1 -- 172.21.15.81:0/1044811984 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3820066f30 msgr2=0x7f38200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.516+0000 7f3839cbc700 1 --2- 172.21.15.81:0/1044811984 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3820066f30 0x7f38200693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3824007650 tx=0x7f38240075e0 comp rx=0 tx=0).stop 2023-10-07T08:46:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.516+0000 7f3839cbc700 1 -- 172.21.15.81:0/1044811984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38340d0b80 msgr2=0x7f38340b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.516+0000 7f3839cbc700 1 --2- 172.21.15.81:0/1044811984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38340d0b80 0x7f38340b0d80 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f383406fcc0 tx=0x7f3828017000 comp rx=0 tx=0).stop 2023-10-07T08:46:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.516+0000 7f3839cbc700 1 -- 172.21.15.81:0/1044811984 shutdown_connections 2023-10-07T08:46:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.516+0000 7f3839cbc700 1 --2- 172.21.15.81:0/1044811984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38340d0f50 0x7f383416a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.516+0000 7f3839cbc700 1 --2- 172.21.15.81:0/1044811984 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3820066f30 0x7f38200693e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.516+0000 7f3839cbc700 1 --2- 172.21.15.81:0/1044811984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38340d02b0 0x7f38340acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.516+0000 7f3839cbc700 1 --2- 172.21.15.81:0/1044811984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38340d0b80 0x7f38340b0d80 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.516+0000 7f3839cbc700 1 -- 172.21.15.81:0/1044811984 >> 172.21.15.81:0/1044811984 conn(0x7f3834063230 msgr2=0x7f3834068780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.516+0000 7f3839cbc700 1 -- 172.21.15.81:0/1044811984 shutdown_connections 2023-10-07T08:46:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.516+0000 7f3839cbc700 1 -- 172.21.15.81:0/1044811984 wait complete. 2023-10-07T08:46:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-07T08:46:38.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T08:46:38.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.646+0000 7f4420d30700 1 Processor -- start 2023-10-07T08:46:38.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.646+0000 7f4420d30700 1 -- start start 2023-10-07T08:46:38.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f4420d30700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f441c06d900 0x7f441c06dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:38.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f4420d30700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f441c0af940 0x7f441c0afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:38.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f4420d30700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c0cc4f0 con 0x7f441c156110 2023-10-07T08:46:38.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f4420d30700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c0cb8e0 con 0x7f441c0af940 2023-10-07T08:46:38.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f4420d30700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0cbbc0 con 0x7f441c06d900 2023-10-07T08:46:38.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f441c156110 0x7f441c06e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53876/0 (socket says 172.21.15.81:53876) 2023-10-07T08:46:38.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441b7fe700 1 -- 172.21.15.81:0/1986329698 learned_addr learned my addr 172.21.15.81:0/1986329698 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:38.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441affd700 1 --2- 172.21.15.81:0/1986329698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f441c06d900 0x7f441c06dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:38.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441bfff700 1 --2- 172.21.15.81:0/1986329698 >> v2:172.21.15.89:3300/0 conn(0x7f441c0af940 0x7f441c0afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:38.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441a7fc700 1 -- 172.21.15.81:0/1986329698 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931315623 0 0) 0x7f441c0cc4f0 con 0x7f441c156110 2023-10-07T08:46:38.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441a7fc700 1 -- 172.21.15.81:0/1986329698 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4408003570 con 0x7f441c156110 2023-10-07T08:46:38.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441a7fc700 1 -- 172.21.15.81:0/1986329698 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4128877793 0 0) 0x7f4408003570 con 0x7f441c156110 2023-10-07T08:46:38.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441a7fc700 1 -- 172.21.15.81:0/1986329698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f441c06d900 msgr2=0x7f441c06dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:38.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441a7fc700 1 --2- 172.21.15.81:0/1986329698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f441c06d900 0x7f441c06dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:38.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441a7fc700 1 -- 172.21.15.81:0/1986329698 >> v2:172.21.15.89:3300/0 conn(0x7f441c0af940 msgr2=0x7f441c0afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:38.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441a7fc700 1 --2- 172.21.15.81:0/1986329698 >> v2:172.21.15.89:3300/0 conn(0x7f441c0af940 0x7f441c0afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:38.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441a7fc700 1 -- 172.21.15.81:0/1986329698 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c06e2b0 con 0x7f441c156110 2023-10-07T08:46:38.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441a7fc700 1 -- 172.21.15.81:0/1986329698 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f4414001470 con 0x7f441c156110 2023-10-07T08:46:38.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441a7fc700 1 -- 172.21.15.81:0/1986329698 >> v1:172.21.15.81:6789/0 conn(0x7f441c156110 legacy=0x7f441c06e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:38.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441a7fc700 1 --2- 172.21.15.81:0/1986329698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4408003a60 0x7f4408003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:38.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441a7fc700 1 --2- 172.21.15.81:0/1986329698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f441c06d900 0x7f4408004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:38.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441a7fc700 1 --2- 172.21.15.81:0/1986329698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4408004d50 0x7f44080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:38.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441a7fc700 1 -- 172.21.15.81:0/1986329698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0cb8e0 con 0x7f4408004d50 2023-10-07T08:46:38.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.647+0000 7f441a7fc700 1 -- 172.21.15.81:0/1986329698 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0cbbc0 con 0x7f4408003a60 2023-10-07T08:46:38.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.648+0000 7f441a7fc700 1 -- 172.21.15.81:0/1986329698 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440800ba60 con 0x7f441c06d900 2023-10-07T08:46:38.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.648+0000 7f441bfff700 1 --2- 172.21.15.81:0/1986329698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4408004d50 0x7f44080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:38.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.648+0000 7f441b7fe700 1 --2- 172.21.15.81:0/1986329698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4408003a60 0x7f4408003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:38.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.648+0000 7f441affd700 1 --2- 172.21.15.81:0/1986329698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f441c06d900 0x7f4408004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:38.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.648+0000 7f441bfff700 1 -- 172.21.15.81:0/1986329698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f441c06d900 msgr2=0x7f4408004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:38.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.648+0000 7f441bfff700 1 --2- 172.21.15.81:0/1986329698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f441c06d900 0x7f4408004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:38.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.648+0000 7f441bfff700 1 -- 172.21.15.81:0/1986329698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4408003a60 msgr2=0x7f4408003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:38.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.648+0000 7f441bfff700 1 --2- 172.21.15.81:0/1986329698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4408003a60 0x7f4408003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:38.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.648+0000 7f441bfff700 1 -- 172.21.15.81:0/1986329698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4408003570 con 0x7f4408004d50 2023-10-07T08:46:38.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.648+0000 7f441bfff700 1 --2- 172.21.15.81:0/1986329698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4408004d50 0x7f44080051c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f440c00e210 tx=0x7f440c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30ad317ab29c651 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:38.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.648+0000 7f441a7fc700 1 -- 172.21.15.81:0/1986329698 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c00ea60 con 0x7f4408004d50 2023-10-07T08:46:38.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.648+0000 7f441a7fc700 1 -- 172.21.15.81:0/1986329698 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c00f040 con 0x7f4408004d50 2023-10-07T08:46:38.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.648+0000 7f441a7fc700 1 -- 172.21.15.81:0/1986329698 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c00ee10 con 0x7f4408004d50 2023-10-07T08:46:38.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.649+0000 7f4420d30700 1 -- 172.21.15.81:0/1986329698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4408004d50 msgr2=0x7f44080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:38.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.649+0000 7f4420d30700 1 --2- 172.21.15.81:0/1986329698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4408004d50 0x7f44080051c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f440c00e210 tx=0x7f440c00b040 comp rx=0 tx=0).stop 2023-10-07T08:46:38.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.649+0000 7f441bfff700 1 -- 172.21.15.81:0/1986329698 reap_dead start 2023-10-07T08:46:38.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.649+0000 7f4420d30700 1 -- 172.21.15.81:0/1986329698 shutdown_connections 2023-10-07T08:46:38.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.649+0000 7f4420d30700 1 -- 172.21.15.81:0/1986329698 >> 172.21.15.81:0/1986329698 conn(0x7f441c06bb90 msgr2=0x7f441c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:38.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.649+0000 7f4420d30700 1 -- 172.21.15.81:0/1986329698 shutdown_connections 2023-10-07T08:46:38.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.649+0000 7f4420d30700 1 -- 172.21.15.81:0/1986329698 wait complete. 2023-10-07T08:46:38.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.650+0000 7f4420d30700 1 Processor -- start 2023-10-07T08:46:38.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.650+0000 7f4420d30700 1 -- start start 2023-10-07T08:46:38.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f4420d30700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4408004d50 0x7f441c13b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:38.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f4420d30700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f441c069b60 0x7f441c069fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:38.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f4420d30700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f441c0c71b0 0x7f441c0c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:38.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f4420d30700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0c87b0 con 0x7f441c0c71b0 2023-10-07T08:46:38.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f4420d30700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c06a510 con 0x7f441c069b60 2023-10-07T08:46:38.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f4420d30700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0c25e0 con 0x7f4408004d50 2023-10-07T08:46:38.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f441bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f441c0c71b0 0x7f441c0c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:38.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f441bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f441c0c71b0 0x7f441c0c7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33282/0 (socket says 172.21.15.81:33282) 2023-10-07T08:46:38.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f441bfff700 1 -- 172.21.15.81:0/1856238782 learned_addr learned my addr 172.21.15.81:0/1856238782 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:38.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f441b7fe700 1 --2- 172.21.15.81:0/1856238782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4408004d50 0x7f441c13b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:38.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f441affd700 1 --2- 172.21.15.81:0/1856238782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f441c069b60 0x7f441c069fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:38.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f441bfff700 1 -- 172.21.15.81:0/1856238782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4408004d50 msgr2=0x7f441c13b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:38.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f441bfff700 1 --2- 172.21.15.81:0/1856238782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4408004d50 0x7f441c13b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:38.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f441bfff700 1 -- 172.21.15.81:0/1856238782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f441c069b60 msgr2=0x7f441c069fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:38.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f441bfff700 1 --2- 172.21.15.81:0/1856238782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f441c069b60 0x7f441c069fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:38.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f441bfff700 1 -- 172.21.15.81:0/1856238782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c13baf0 con 0x7f441c0c71b0 2023-10-07T08:46:38.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f441bfff700 1 --2- 172.21.15.81:0/1856238782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f441c0c71b0 0x7f441c0c7600 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f440c00e800 tx=0x7f440c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:38.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f44137fe700 1 -- 172.21.15.81:0/1856238782 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c022030 con 0x7f441c0c71b0 2023-10-07T08:46:38.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f44137fe700 1 -- 172.21.15.81:0/1856238782 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c00ec30 con 0x7f441c0c71b0 2023-10-07T08:46:38.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f4420d30700 1 -- 172.21.15.81:0/1856238782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441c0c7f10 con 0x7f441c0c71b0 2023-10-07T08:46:38.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f44137fe700 1 -- 172.21.15.81:0/1856238782 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c01e890 con 0x7f441c0c71b0 2023-10-07T08:46:38.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.651+0000 7f4420d30700 1 -- 172.21.15.81:0/1856238782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c0c84d0 con 0x7f441c0c71b0 2023-10-07T08:46:38.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.652+0000 7f4420d30700 1 -- 172.21.15.81:0/1856238782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441c0c2750 con 0x7f441c0c71b0 2023-10-07T08:46:38.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.653+0000 7f44137fe700 1 -- 172.21.15.81:0/1856238782 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f440c025070 con 0x7f441c0c71b0 2023-10-07T08:46:38.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.653+0000 7f44137fe700 1 --2- 172.21.15.81:0/1856238782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f43fc066f30 0x7f43fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:38.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.653+0000 7f44137fe700 1 -- 172.21.15.81:0/1856238782 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f440c023070 con 0x7f441c0c71b0 2023-10-07T08:46:38.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.653+0000 7f441b7fe700 1 --2- 172.21.15.81:0/1856238782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f43fc066f30 0x7f43fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:38.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.653+0000 7f44137fe700 1 -- 172.21.15.81:0/1856238782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=75}) v3 -- 0x7f43fc06dcf0 con 0x7f441c0c71b0 2023-10-07T08:46:38.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.653+0000 7f441b7fe700 1 --2- 172.21.15.81:0/1856238782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f43fc066f30 0x7f43fc0693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4414000e10 tx=0x7f4414009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:38.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.657+0000 7f44137fe700 1 -- 172.21.15.81:0/1856238782 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f440c018060 con 0x7f441c0c71b0 2023-10-07T08:46:38.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:38.839+0000 7f4420d30700 1 -- 172.21.15.81:0/1856238782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f441c0676e0 con 0x7f441c0c71b0 2023-10-07T08:46:39.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.508+0000 7f44137fe700 1 -- 172.21.15.81:0/1856238782 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(75..75 src has 1..75) v4 ==== 296+0+0 (secure 0 0 0) 0x7f440c056c60 con 0x7f441c0c71b0 2023-10-07T08:46:39.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.508+0000 7f44137fe700 1 -- 172.21.15.81:0/1856238782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7f43fc06ca80 con 0x7f441c0c71b0 2023-10-07T08:46:39.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.518+0000 7f44137fe700 1 -- 172.21.15.81:0/1856238782 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 169+0+0 (secure 0 0 0) 0x7f440c055ec0 con 0x7f441c0c71b0 2023-10-07T08:46:39.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.522+0000 7f4420d30700 1 -- 172.21.15.81:0/1856238782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f43fc066f30 msgr2=0x7f43fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:39.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.522+0000 7f4420d30700 1 --2- 172.21.15.81:0/1856238782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f43fc066f30 0x7f43fc0693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4414000e10 tx=0x7f4414009040 comp rx=0 tx=0).stop 2023-10-07T08:46:39.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.522+0000 7f4420d30700 1 -- 172.21.15.81:0/1856238782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f441c0c71b0 msgr2=0x7f441c0c7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:39.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.522+0000 7f4420d30700 1 --2- 172.21.15.81:0/1856238782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f441c0c71b0 0x7f441c0c7600 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f440c00e800 tx=0x7f440c01a000 comp rx=0 tx=0).stop 2023-10-07T08:46:39.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.522+0000 7f4420d30700 1 -- 172.21.15.81:0/1856238782 shutdown_connections 2023-10-07T08:46:39.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.522+0000 7f4420d30700 1 --2- 172.21.15.81:0/1856238782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f441c0c71b0 0x7f441c0c7600 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.522+0000 7f4420d30700 1 --2- 172.21.15.81:0/1856238782 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f43fc066f30 0x7f43fc0693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.522+0000 7f4420d30700 1 --2- 172.21.15.81:0/1856238782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4408004d50 0x7f441c13b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.522+0000 7f4420d30700 1 --2- 172.21.15.81:0/1856238782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f441c069b60 0x7f441c069fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.522+0000 7f4420d30700 1 -- 172.21.15.81:0/1856238782 >> 172.21.15.81:0/1856238782 conn(0x7f441c06bb90 msgr2=0x7f441c06e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:39.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.522+0000 7f4420d30700 1 -- 172.21.15.81:0/1856238782 shutdown_connections 2023-10-07T08:46:39.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.522+0000 7f4420d30700 1 -- 172.21.15.81:0/1856238782 wait complete. 2023-10-07T08:46:39.525 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-07T08:46:39.537 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T08:46:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.653+0000 7fe6f9127700 1 Processor -- start 2023-10-07T08:46:39.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.653+0000 7fe6f9127700 1 -- start start 2023-10-07T08:46:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.654+0000 7fe6f9127700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe6f41578d0 0x7fe6f40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.654+0000 7fe6f9127700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6f4157ca0 0x7fe6f415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.654+0000 7fe6f9127700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f40d07c0 con 0x7fe6f406d120 2023-10-07T08:46:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.654+0000 7fe6f9127700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f40cfbb0 con 0x7fe6f4157ca0 2023-10-07T08:46:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.654+0000 7fe6f9127700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f40cfe90 con 0x7fe6f41578d0 2023-10-07T08:46:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.654+0000 7fe6ea59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6f4157ca0 0x7fe6f415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.654+0000 7fe6f359e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe6f406d120 0x7fe6f406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53880/0 (socket says 172.21.15.81:53880) 2023-10-07T08:46:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.654+0000 7fe6f359e700 1 -- 172.21.15.81:0/1386059447 learned_addr learned my addr 172.21.15.81:0/1386059447 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6f2d9d700 1 --2- 172.21.15.81:0/1386059447 >> v2:172.21.15.89:3300/0 conn(0x7fe6f41578d0 0x7fe6f40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6ea59c700 1 -- 172.21.15.81:0/1386059447 >> v2:172.21.15.89:3300/0 conn(0x7fe6f41578d0 msgr2=0x7fe6f40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6ea59c700 1 --2- 172.21.15.81:0/1386059447 >> v2:172.21.15.89:3300/0 conn(0x7fe6f41578d0 0x7fe6f40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6ea59c700 1 -- 172.21.15.81:0/1386059447 >> v1:172.21.15.81:6789/0 conn(0x7fe6f406d120 legacy=0x7fe6f406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6f259c700 1 -- 172.21.15.81:0/1386059447 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341604843 0 0) 0x7fe6f40d07c0 con 0x7fe6f406d120 2023-10-07T08:46:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6ea59c700 1 -- 172.21.15.81:0/1386059447 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f40d0170 con 0x7fe6f4157ca0 2023-10-07T08:46:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6f2d9d700 1 --2- 172.21.15.81:0/1386059447 >> v2:172.21.15.89:3300/0 conn(0x7fe6f41578d0 0x7fe6f40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:46:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6ea59c700 1 --2- 172.21.15.81:0/1386059447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f4157ca0 0x7fe6f415af00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40646b0 tx=0x7fe6dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6614f3883e0a03 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6f259c700 1 -- 172.21.15.81:0/1386059447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc00b6b0 con 0x7fe6f4157ca0 2023-10-07T08:46:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6f259c700 1 -- 172.21.15.81:0/1386059447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc00b810 con 0x7fe6f4157ca0 2023-10-07T08:46:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6f259c700 1 -- 172.21.15.81:0/1386059447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc00bbb0 con 0x7fe6f4157ca0 2023-10-07T08:46:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6f9127700 1 -- 172.21.15.81:0/1386059447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f4157ca0 msgr2=0x7fe6f415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6f9127700 1 --2- 172.21.15.81:0/1386059447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f4157ca0 0x7fe6f415af00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40646b0 tx=0x7fe6dc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6f9127700 1 -- 172.21.15.81:0/1386059447 shutdown_connections 2023-10-07T08:46:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6f9127700 1 --2- 172.21.15.81:0/1386059447 >> v2:172.21.15.89:3300/0 conn(0x7fe6f41578d0 0x7fe6f40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6f9127700 1 --2- 172.21.15.81:0/1386059447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f4157ca0 0x7fe6f415af00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6f9127700 1 -- 172.21.15.81:0/1386059447 >> 172.21.15.81:0/1386059447 conn(0x7fe6f406bb90 msgr2=0x7fe6f406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6f9127700 1 -- 172.21.15.81:0/1386059447 shutdown_connections 2023-10-07T08:46:39.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.655+0000 7fe6f9127700 1 -- 172.21.15.81:0/1386059447 wait complete. 2023-10-07T08:46:39.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.657+0000 7fe6f9127700 1 Processor -- start 2023-10-07T08:46:39.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.657+0000 7fe6f9127700 1 -- start start 2023-10-07T08:46:39.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.657+0000 7fe6f9127700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6f406d120 0x7fe6f41477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:39.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.657+0000 7fe6f9127700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f41578d0 0x7fe6f40b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:39.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.657+0000 7fe6f9127700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6f4157ca0 0x7fe6f40b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:39.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.657+0000 7fe6f9127700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f4147d30 con 0x7fe6f41578d0 2023-10-07T08:46:39.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.657+0000 7fe6f9127700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40c6800 con 0x7fe6f406d120 2023-10-07T08:46:39.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.657+0000 7fe6f9127700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40c6ae0 con 0x7fe6f4157ca0 2023-10-07T08:46:39.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6ea59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f41578d0 0x7fe6f40b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:39.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6ea59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f41578d0 0x7fe6f40b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33298/0 (socket says 172.21.15.81:33298) 2023-10-07T08:46:39.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6ea59c700 1 -- 172.21.15.81:0/1546716591 learned_addr learned my addr 172.21.15.81:0/1546716591 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:39.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6f2d9d700 1 --2- 172.21.15.81:0/1546716591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6f406d120 0x7fe6f41477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:39.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6f359e700 1 --2- 172.21.15.81:0/1546716591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6f4157ca0 0x7fe6f40b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:39.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6ea59c700 1 -- 172.21.15.81:0/1546716591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6f4157ca0 msgr2=0x7fe6f40b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:39.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6ea59c700 1 --2- 172.21.15.81:0/1546716591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6f4157ca0 0x7fe6f40b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6ea59c700 1 -- 172.21.15.81:0/1546716591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6f406d120 msgr2=0x7fe6f41477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:39.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6ea59c700 1 --2- 172.21.15.81:0/1546716591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6f406d120 0x7fe6f41477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6ea59c700 1 -- 172.21.15.81:0/1546716591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc009420 con 0x7fe6f41578d0 2023-10-07T08:46:39.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6f359e700 1 --2- 172.21.15.81:0/1546716591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6f4157ca0 0x7fe6f40b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:46:39.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6f2d9d700 1 --2- 172.21.15.81:0/1546716591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6f406d120 0x7fe6f41477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:46:39.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6ea59c700 1 --2- 172.21.15.81:0/1546716591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f41578d0 0x7fe6f40b6040 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc013000 tx=0x7fe6dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:39.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6eb7fe700 1 -- 172.21.15.81:0/1546716591 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc011420 con 0x7fe6f41578d0 2023-10-07T08:46:39.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6eb7fe700 1 -- 172.21.15.81:0/1546716591 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc011580 con 0x7fe6f41578d0 2023-10-07T08:46:39.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6f9127700 1 -- 172.21.15.81:0/1546716591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f40c6dc0 con 0x7fe6f41578d0 2023-10-07T08:46:39.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6eb7fe700 1 -- 172.21.15.81:0/1546716591 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc011920 con 0x7fe6f41578d0 2023-10-07T08:46:39.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.658+0000 7fe6f9127700 1 -- 172.21.15.81:0/1546716591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f40c7380 con 0x7fe6f41578d0 2023-10-07T08:46:39.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.659+0000 7fe6f9127700 1 -- 172.21.15.81:0/1546716591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f40ceb10 con 0x7fe6f41578d0 2023-10-07T08:46:39.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.660+0000 7fe6eb7fe700 1 -- 172.21.15.81:0/1546716591 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6dc011d10 con 0x7fe6f41578d0 2023-10-07T08:46:39.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.660+0000 7fe6eb7fe700 1 --2- 172.21.15.81:0/1546716591 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe6d4066f60 0x7fe6d4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:39.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.660+0000 7fe6eb7fe700 1 -- 172.21.15.81:0/1546716591 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe6dc085bd0 con 0x7fe6f41578d0 2023-10-07T08:46:39.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.660+0000 7fe6f2d9d700 1 --2- 172.21.15.81:0/1546716591 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe6d4066f60 0x7fe6d4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:39.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.660+0000 7fe6eb7fe700 1 -- 172.21.15.81:0/1546716591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7fe6d406c6e0 con 0x7fe6f41578d0 2023-10-07T08:46:39.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.660+0000 7fe6f2d9d700 1 --2- 172.21.15.81:0/1546716591 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe6d4066f60 0x7fe6d4069410 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4006fd0 tx=0x7fe6e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:39.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.664+0000 7fe6eb7fe700 1 -- 172.21.15.81:0/1546716591 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6dc015060 con 0x7fe6f41578d0 2023-10-07T08:46:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.846+0000 7fe6f9127700 1 -- 172.21.15.81:0/1546716591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe6f40d0450 con 0x7fe6f41578d0 2023-10-07T08:46:39.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.850+0000 7fe6eb7fe700 1 -- 172.21.15.81:0/1546716591 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe6dc0531c0 con 0x7fe6f41578d0 2023-10-07T08:46:39.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.853+0000 7fe6f9127700 1 -- 172.21.15.81:0/1546716591 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe6d4066f60 msgr2=0x7fe6d4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:39.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.853+0000 7fe6f9127700 1 --2- 172.21.15.81:0/1546716591 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe6d4066f60 0x7fe6d4069410 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4006fd0 tx=0x7fe6e4008040 comp rx=0 tx=0).stop 2023-10-07T08:46:39.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.853+0000 7fe6f9127700 1 -- 172.21.15.81:0/1546716591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f41578d0 msgr2=0x7fe6f40b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.853+0000 7fe6f9127700 1 --2- 172.21.15.81:0/1546716591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f41578d0 0x7fe6f40b6040 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc013000 tx=0x7fe6dc017000 comp rx=0 tx=0).stop 2023-10-07T08:46:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.853+0000 7fe6f9127700 1 -- 172.21.15.81:0/1546716591 shutdown_connections 2023-10-07T08:46:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.853+0000 7fe6f9127700 1 --2- 172.21.15.81:0/1546716591 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe6d4066f60 0x7fe6d4069410 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.853+0000 7fe6f9127700 1 --2- 172.21.15.81:0/1546716591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6f4157ca0 0x7fe6f40b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.853+0000 7fe6f9127700 1 --2- 172.21.15.81:0/1546716591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6f406d120 0x7fe6f41477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.853+0000 7fe6f9127700 1 --2- 172.21.15.81:0/1546716591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f41578d0 0x7fe6f40b6040 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.853+0000 7fe6f9127700 1 -- 172.21.15.81:0/1546716591 >> 172.21.15.81:0/1546716591 conn(0x7fe6f406bb90 msgr2=0x7fe6f41565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.853+0000 7fe6f9127700 1 -- 172.21.15.81:0/1546716591 shutdown_connections 2023-10-07T08:46:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.853+0000 7fe6f9127700 1 -- 172.21.15.81:0/1546716591 wait complete. 2023-10-07T08:46:39.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-10-07T08:46:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.978+0000 7efe3a138700 1 Processor -- start 2023-10-07T08:46:39.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.978+0000 7efe3a138700 1 -- start start 2023-10-07T08:46:39.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.979+0000 7efe3a138700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efe34159f10 0x7efe34068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:39.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.979+0000 7efe3a138700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe34068cc0 0x7efe340cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.979+0000 7efe3a138700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe340cee10 con 0x7efe34159b40 2023-10-07T08:46:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.979+0000 7efe3a138700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe34069140 con 0x7efe34159f10 2023-10-07T08:46:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.979+0000 7efe3a138700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe340cd040 con 0x7efe34068cc0 2023-10-07T08:46:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.979+0000 7efe39136700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efe34159b40 0x7efe340cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53890/0 (socket says 172.21.15.81:53890) 2023-10-07T08:46:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.979+0000 7efe39136700 1 -- 172.21.15.81:0/1473153553 learned_addr learned my addr 172.21.15.81:0/1473153553 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.979+0000 7efe39937700 1 --2- 172.21.15.81:0/1473153553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe34068cc0 0x7efe340cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.979+0000 7efe38935700 1 --2- 172.21.15.81:0/1473153553 >> v2:172.21.15.89:3300/0 conn(0x7efe34159f10 0x7efe34068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.979+0000 7efe2bfff700 1 -- 172.21.15.81:0/1473153553 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737439182 0 0) 0x7efe340cee10 con 0x7efe34159b40 2023-10-07T08:46:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.979+0000 7efe2bfff700 1 -- 172.21.15.81:0/1473153553 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe20003570 con 0x7efe34159b40 2023-10-07T08:46:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 -- 172.21.15.81:0/1473153553 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2647977806 0 0) 0x7efe20003570 con 0x7efe34159b40 2023-10-07T08:46:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 -- 172.21.15.81:0/1473153553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe34068cc0 msgr2=0x7efe340cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 --2- 172.21.15.81:0/1473153553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe34068cc0 0x7efe340cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 -- 172.21.15.81:0/1473153553 >> v2:172.21.15.89:3300/0 conn(0x7efe34159f10 msgr2=0x7efe34068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 --2- 172.21.15.81:0/1473153553 >> v2:172.21.15.89:3300/0 conn(0x7efe34159f10 0x7efe34068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 -- 172.21.15.81:0/1473153553 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe340cd320 con 0x7efe34159b40 2023-10-07T08:46:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 -- 172.21.15.81:0/1473153553 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7efe300017f0 con 0x7efe34159b40 2023-10-07T08:46:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 -- 172.21.15.81:0/1473153553 >> v1:172.21.15.81:6789/0 conn(0x7efe34159b40 legacy=0x7efe340cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 --2- 172.21.15.81:0/1473153553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe20003a60 0x7efe20003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 --2- 172.21.15.81:0/1473153553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe20004810 0x7efe20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 --2- 172.21.15.81:0/1473153553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe34068cc0 0x7efe200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 -- 172.21.15.81:0/1473153553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe34069140 con 0x7efe20003a60 2023-10-07T08:46:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 -- 172.21.15.81:0/1473153553 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe340cd040 con 0x7efe20004810 2023-10-07T08:46:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 -- 172.21.15.81:0/1473153553 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2000ba60 con 0x7efe34068cc0 2023-10-07T08:46:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe39136700 1 --2- 172.21.15.81:0/1473153553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe20003a60 0x7efe20003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe39937700 1 --2- 172.21.15.81:0/1473153553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe34068cc0 0x7efe200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe38935700 1 --2- 172.21.15.81:0/1473153553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe20004810 0x7efe20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe39136700 1 -- 172.21.15.81:0/1473153553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe34068cc0 msgr2=0x7efe200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe39136700 1 --2- 172.21.15.81:0/1473153553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe34068cc0 0x7efe200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe39136700 1 -- 172.21.15.81:0/1473153553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe20004810 msgr2=0x7efe20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe39136700 1 --2- 172.21.15.81:0/1473153553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe20004810 0x7efe20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe39136700 1 -- 172.21.15.81:0/1473153553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe20003570 con 0x7efe20003a60 2023-10-07T08:46:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe39136700 1 --2- 172.21.15.81:0/1473153553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe20003a60 0x7efe20003e70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7efe3000a9a0 tx=0x7efe30002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b137eab6d9dd5b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 -- 172.21.15.81:0/1473153553 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30012440 con 0x7efe20003a60 2023-10-07T08:46:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 -- 172.21.15.81:0/1473153553 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe300125c0 con 0x7efe20003a60 2023-10-07T08:46:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.980+0000 7efe2bfff700 1 -- 172.21.15.81:0/1473153553 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30012980 con 0x7efe20003a60 2023-10-07T08:46:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.981+0000 7efe3a138700 1 -- 172.21.15.81:0/1473153553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe20003a60 msgr2=0x7efe20003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.981+0000 7efe3a138700 1 --2- 172.21.15.81:0/1473153553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe20003a60 0x7efe20003e70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7efe3000a9a0 tx=0x7efe30002210 comp rx=0 tx=0).stop 2023-10-07T08:46:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.981+0000 7efe39937700 1 -- 172.21.15.81:0/1473153553 reap_dead start 2023-10-07T08:46:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.981+0000 7efe3a138700 1 -- 172.21.15.81:0/1473153553 shutdown_connections 2023-10-07T08:46:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.981+0000 7efe3a138700 1 -- 172.21.15.81:0/1473153553 >> 172.21.15.81:0/1473153553 conn(0x7efe340cd660 msgr2=0x7efe340cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.981+0000 7efe3a138700 1 -- 172.21.15.81:0/1473153553 shutdown_connections 2023-10-07T08:46:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.981+0000 7efe3a138700 1 -- 172.21.15.81:0/1473153553 wait complete. 2023-10-07T08:46:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.982+0000 7efe3a138700 1 Processor -- start 2023-10-07T08:46:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.982+0000 7efe3a138700 1 -- start start 2023-10-07T08:46:39.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe3a138700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20003a60 0x7efe3416ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:39.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe3a138700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe3415f5c0 0x7efe3415fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:39.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe3a138700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe340c5990 0x7efe340c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:39.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe3a138700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe34160d20 con 0x7efe340c5990 2023-10-07T08:46:39.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe3a138700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe340c6320 con 0x7efe3415f5c0 2023-10-07T08:46:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe3a138700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe34160110 con 0x7efe20003a60 2023-10-07T08:46:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe39937700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe340c5990 0x7efe340c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe39937700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe340c5990 0x7efe340c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33312/0 (socket says 172.21.15.81:33312) 2023-10-07T08:46:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe39937700 1 -- 172.21.15.81:0/3984209244 learned_addr learned my addr 172.21.15.81:0/3984209244 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe39136700 1 --2- 172.21.15.81:0/3984209244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20003a60 0x7efe3416ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe38935700 1 --2- 172.21.15.81:0/3984209244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe3415f5c0 0x7efe3415fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe39937700 1 -- 172.21.15.81:0/3984209244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20003a60 msgr2=0x7efe3416ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe39937700 1 --2- 172.21.15.81:0/3984209244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20003a60 0x7efe3416ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe39937700 1 -- 172.21.15.81:0/3984209244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe3415f5c0 msgr2=0x7efe3415fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe39937700 1 --2- 172.21.15.81:0/3984209244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe3415f5c0 0x7efe3415fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe39937700 1 -- 172.21.15.81:0/3984209244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe341603f0 con 0x7efe340c5990 2023-10-07T08:46:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.983+0000 7efe38935700 1 --2- 172.21.15.81:0/3984209244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe3415f5c0 0x7efe3415fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.984+0000 7efe39937700 1 --2- 172.21.15.81:0/3984209244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe340c5990 0x7efe340c5de0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7efe340ce410 tx=0x7efe2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.984+0000 7efe297fa700 1 -- 172.21.15.81:0/3984209244 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c015670 con 0x7efe340c5990 2023-10-07T08:46:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.984+0000 7efe297fa700 1 -- 172.21.15.81:0/3984209244 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c0157d0 con 0x7efe340c5990 2023-10-07T08:46:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.984+0000 7efe3a138700 1 -- 172.21.15.81:0/3984209244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe341606d0 con 0x7efe340c5990 2023-10-07T08:46:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.984+0000 7efe297fa700 1 -- 172.21.15.81:0/3984209244 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c015bd0 con 0x7efe340c5990 2023-10-07T08:46:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.984+0000 7efe3a138700 1 -- 172.21.15.81:0/3984209244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe340ca730 con 0x7efe340c5990 2023-10-07T08:46:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.985+0000 7efe3a138700 1 -- 172.21.15.81:0/3984209244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe34160ed0 con 0x7efe340c5990 2023-10-07T08:46:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.985+0000 7efe297fa700 1 -- 172.21.15.81:0/3984209244 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe2c020460 con 0x7efe340c5990 2023-10-07T08:46:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.985+0000 7efe297fa700 1 --2- 172.21.15.81:0/3984209244 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe18066f30 0x7efe180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.985+0000 7efe297fa700 1 -- 172.21.15.81:0/3984209244 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efe2c084460 con 0x7efe340c5990 2023-10-07T08:46:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.985+0000 7efe39136700 1 --2- 172.21.15.81:0/3984209244 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe18066f30 0x7efe180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.986+0000 7efe297fa700 1 -- 172.21.15.81:0/3984209244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7efe1806c6b0 con 0x7efe340c5990 2023-10-07T08:46:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.986+0000 7efe39136700 1 --2- 172.21.15.81:0/3984209244 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe18066f30 0x7efe180693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efe3000a8c0 tx=0x7efe30015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:39.989+0000 7efe297fa700 1 -- 172.21.15.81:0/3984209244 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe34160ed0 con 0x7efe340c5990 2023-10-07T08:46:40.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.248+0000 7efe3a138700 1 -- 172.21.15.81:0/3984209244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7efe340cb890 con 0x7efe340c5990 2023-10-07T08:46:40.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.386+0000 7efe297fa700 1 -- 172.21.15.81:0/3984209244 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v194) v1 ==== 134+0+0 (secure 0 0 0) 0x7efe2c0519d0 con 0x7efe340c5990 2023-10-07T08:46:40.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.388+0000 7efe3a138700 1 -- 172.21.15.81:0/3984209244 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe18066f30 msgr2=0x7efe180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:40.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.388+0000 7efe3a138700 1 --2- 172.21.15.81:0/3984209244 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe18066f30 0x7efe180693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efe3000a8c0 tx=0x7efe30015000 comp rx=0 tx=0).stop 2023-10-07T08:46:40.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.388+0000 7efe3a138700 1 -- 172.21.15.81:0/3984209244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe340c5990 msgr2=0x7efe340c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:40.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.388+0000 7efe3a138700 1 --2- 172.21.15.81:0/3984209244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe340c5990 0x7efe340c5de0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7efe340ce410 tx=0x7efe2c008040 comp rx=0 tx=0).stop 2023-10-07T08:46:40.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.388+0000 7efe3a138700 1 -- 172.21.15.81:0/3984209244 shutdown_connections 2023-10-07T08:46:40.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.388+0000 7efe3a138700 1 --2- 172.21.15.81:0/3984209244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe340c5990 0x7efe340c5de0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:40.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.388+0000 7efe3a138700 1 --2- 172.21.15.81:0/3984209244 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe18066f30 0x7efe180693e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:40.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.388+0000 7efe3a138700 1 --2- 172.21.15.81:0/3984209244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20003a60 0x7efe3416ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:40.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.388+0000 7efe3a138700 1 --2- 172.21.15.81:0/3984209244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe3415f5c0 0x7efe3415fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:40.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.388+0000 7efe3a138700 1 -- 172.21.15.81:0/3984209244 >> 172.21.15.81:0/3984209244 conn(0x7efe340cd660 msgr2=0x7efe3406c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:40.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.389+0000 7efe3a138700 1 -- 172.21.15.81:0/3984209244 shutdown_connections 2023-10-07T08:46:40.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.389+0000 7efe3a138700 1 -- 172.21.15.81:0/3984209244 wait complete. 2023-10-07T08:46:40.402 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-07T08:46:40.402 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2023-10-07T08:46:40.402 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-10-07T08:46:40.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-10-07T08:46:40.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.516+0000 7f25bd784700 1 Processor -- start 2023-10-07T08:46:40.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.516+0000 7f25bd784700 1 -- start start 2023-10-07T08:46:40.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.516+0000 7f25bd784700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b81578d0 0x7f25b80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.516+0000 7f25bd784700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f25b8157ca0 0x7f25b815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.516+0000 7f25bd784700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f25b806d120 0x7f25b806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.516+0000 7f25bd784700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b806dac0 con 0x7f25b806d120 2023-10-07T08:46:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.516+0000 7f25bd784700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b80d07c0 con 0x7f25b8157ca0 2023-10-07T08:46:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.516+0000 7f25bd784700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80cfbb0 con 0x7f25b81578d0 2023-10-07T08:46:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.517+0000 7f25b77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f25b806d120 0x7f25b806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.517+0000 7f25b77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f25b806d120 0x7f25b806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33320/0 (socket says 172.21.15.81:33320) 2023-10-07T08:46:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.517+0000 7f25b77fe700 1 -- 172.21.15.81:0/50428698 learned_addr learned my addr 172.21.15.81:0/50428698 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.517+0000 7f25ae7fc700 1 --2- 172.21.15.81:0/50428698 >> v2:172.21.15.89:3300/0 conn(0x7f25b8157ca0 0x7f25b815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.517+0000 7f25b6ffd700 1 --2- 172.21.15.81:0/50428698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b81578d0 0x7f25b80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.517+0000 7f25b77fe700 1 -- 172.21.15.81:0/50428698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b81578d0 msgr2=0x7f25b80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.517+0000 7f25b77fe700 1 --2- 172.21.15.81:0/50428698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b81578d0 0x7f25b80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.517+0000 7f25b77fe700 1 -- 172.21.15.81:0/50428698 >> v2:172.21.15.89:3300/0 conn(0x7f25b8157ca0 msgr2=0x7f25b815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.517+0000 7f25b77fe700 1 --2- 172.21.15.81:0/50428698 >> v2:172.21.15.89:3300/0 conn(0x7f25b8157ca0 0x7f25b815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.517+0000 7f25b77fe700 1 -- 172.21.15.81:0/50428698 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b80cfe90 con 0x7f25b806d120 2023-10-07T08:46:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.517+0000 7f25b77fe700 1 --2- 172.21.15.81:0/50428698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b806d120 0x7f25b806d580 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f25b806cb70 tx=0x7f25b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df563379ab56b1b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.517+0000 7f25b67fc700 1 -- 172.21.15.81:0/50428698 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b000e070 con 0x7f25b806d120 2023-10-07T08:46:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.517+0000 7f25b67fc700 1 -- 172.21.15.81:0/50428698 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b000ba50 con 0x7f25b806d120 2023-10-07T08:46:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.517+0000 7f25b67fc700 1 -- 172.21.15.81:0/50428698 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b00092e0 con 0x7f25b806d120 2023-10-07T08:46:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.518+0000 7f25bd784700 1 -- 172.21.15.81:0/50428698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b806d120 msgr2=0x7f25b806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.518+0000 7f25bd784700 1 --2- 172.21.15.81:0/50428698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b806d120 0x7f25b806d580 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f25b806cb70 tx=0x7f25b0009840 comp rx=0 tx=0).stop 2023-10-07T08:46:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.518+0000 7f25bd784700 1 -- 172.21.15.81:0/50428698 shutdown_connections 2023-10-07T08:46:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.518+0000 7f25bd784700 1 --2- 172.21.15.81:0/50428698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b806d120 0x7f25b806d580 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.518+0000 7f25bd784700 1 --2- 172.21.15.81:0/50428698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b81578d0 0x7f25b80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.518+0000 7f25bd784700 1 --2- 172.21.15.81:0/50428698 >> v2:172.21.15.89:3300/0 conn(0x7f25b8157ca0 0x7f25b815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.518+0000 7f25bd784700 1 -- 172.21.15.81:0/50428698 >> 172.21.15.81:0/50428698 conn(0x7f25b806bb90 msgr2=0x7f25b806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.518+0000 7f25bd784700 1 -- 172.21.15.81:0/50428698 shutdown_connections 2023-10-07T08:46:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.518+0000 7f25bd784700 1 -- 172.21.15.81:0/50428698 wait complete. 2023-10-07T08:46:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.519+0000 7f25bd784700 1 Processor -- start 2023-10-07T08:46:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.519+0000 7f25bd784700 1 -- start start 2023-10-07T08:46:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25bd784700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b806d120 0x7f25b8154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25bd784700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b81578d0 0x7f25b815ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25bd784700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25b8157ca0 0x7f25b80b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25bd784700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b8155050 con 0x7f25b806d120 2023-10-07T08:46:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25bd784700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b8160520 con 0x7f25b8157ca0 2023-10-07T08:46:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25bd784700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b815ef40 con 0x7f25b81578d0 2023-10-07T08:46:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25b6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b806d120 0x7f25b8154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25b6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b806d120 0x7f25b8154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33330/0 (socket says 172.21.15.81:33330) 2023-10-07T08:46:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25b6ffd700 1 -- 172.21.15.81:0/2290364538 learned_addr learned my addr 172.21.15.81:0/2290364538 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25ae7fc700 1 --2- 172.21.15.81:0/2290364538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b81578d0 0x7f25b815ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25b77fe700 1 --2- 172.21.15.81:0/2290364538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25b8157ca0 0x7f25b80b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25b6ffd700 1 -- 172.21.15.81:0/2290364538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b81578d0 msgr2=0x7f25b815ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25b6ffd700 1 --2- 172.21.15.81:0/2290364538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b81578d0 0x7f25b815ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25b6ffd700 1 -- 172.21.15.81:0/2290364538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25b8157ca0 msgr2=0x7f25b80b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25b6ffd700 1 --2- 172.21.15.81:0/2290364538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25b8157ca0 0x7f25b80b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25b6ffd700 1 -- 172.21.15.81:0/2290364538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b0009ae0 con 0x7f25b806d120 2023-10-07T08:46:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25b77fe700 1 --2- 172.21.15.81:0/2290364538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25b8157ca0 0x7f25b80b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25b6ffd700 1 --2- 172.21.15.81:0/2290364538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b806d120 0x7f25b8154b10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f25a800d890 tx=0x7f25a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25af7fe700 1 -- 172.21.15.81:0/2290364538 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a80125f0 con 0x7f25b806d120 2023-10-07T08:46:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25af7fe700 1 -- 172.21.15.81:0/2290364538 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a8012750 con 0x7f25b806d120 2023-10-07T08:46:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25bd784700 1 -- 172.21.15.81:0/2290364538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b815f220 con 0x7f25b806d120 2023-10-07T08:46:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.520+0000 7f25af7fe700 1 -- 172.21.15.81:0/2290364538 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8012ad0 con 0x7f25b806d120 2023-10-07T08:46:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.521+0000 7f25bd784700 1 -- 172.21.15.81:0/2290364538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b815f7e0 con 0x7f25b806d120 2023-10-07T08:46:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.522+0000 7f25bd784700 1 -- 172.21.15.81:0/2290364538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b815fe30 con 0x7f25b806d120 2023-10-07T08:46:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.522+0000 7f25af7fe700 1 -- 172.21.15.81:0/2290364538 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25a801e460 con 0x7f25b806d120 2023-10-07T08:46:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.522+0000 7f25af7fe700 1 --2- 172.21.15.81:0/2290364538 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2598066f30 0x7f25980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.522+0000 7f25af7fe700 1 -- 172.21.15.81:0/2290364538 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f25a8084850 con 0x7f25b806d120 2023-10-07T08:46:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.522+0000 7f25ae7fc700 1 --2- 172.21.15.81:0/2290364538 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2598066f30 0x7f25980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.522+0000 7f25af7fe700 1 -- 172.21.15.81:0/2290364538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7f259806c6b0 con 0x7f25b806d120 2023-10-07T08:46:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.523+0000 7f25ae7fc700 1 --2- 172.21.15.81:0/2290364538 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2598066f30 0x7f25980693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f25b80b6df0 tx=0x7f25a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.527+0000 7f25af7fe700 1 -- 172.21.15.81:0/2290364538 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25a8051dc0 con 0x7f25b806d120 2023-10-07T08:46:40.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.785+0000 7f25bd784700 1 -- 172.21.15.81:0/2290364538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f25b80d0170 con 0x7f25b806d120 2023-10-07T08:46:40.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.854+0000 7f25af7fe700 1 -- 172.21.15.81:0/2290364538 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(76..76 src has 1..76) v4 ==== 658+0+0 (secure 0 0 0) 0x7f25a8056180 con 0x7f25b806d120 2023-10-07T08:46:40.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:40.854+0000 7f25af7fe700 1 -- 172.21.15.81:0/2290364538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f259806d1a0 con 0x7f25b806d120 2023-10-07T08:46:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.389+0000 7f25af7fe700 1 -- 172.21.15.81:0/2290364538 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v195) v1 ==== 136+0+0 (secure 0 0 0) 0x7f25a80553e0 con 0x7f25b806d120 2023-10-07T08:46:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.391+0000 7f25bd784700 1 -- 172.21.15.81:0/2290364538 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2598066f30 msgr2=0x7f25980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.391+0000 7f25bd784700 1 --2- 172.21.15.81:0/2290364538 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2598066f30 0x7f25980693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f25b80b6df0 tx=0x7f25a0008040 comp rx=0 tx=0).stop 2023-10-07T08:46:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.391+0000 7f25bd784700 1 -- 172.21.15.81:0/2290364538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b806d120 msgr2=0x7f25b8154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.391+0000 7f25bd784700 1 --2- 172.21.15.81:0/2290364538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b806d120 0x7f25b8154b10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f25a800d890 tx=0x7f25a8008040 comp rx=0 tx=0).stop 2023-10-07T08:46:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.391+0000 7f25bd784700 1 -- 172.21.15.81:0/2290364538 shutdown_connections 2023-10-07T08:46:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.392+0000 7f25bd784700 1 --2- 172.21.15.81:0/2290364538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25b8157ca0 0x7f25b80b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.392+0000 7f25bd784700 1 --2- 172.21.15.81:0/2290364538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b806d120 0x7f25b8154b10 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.392+0000 7f25bd784700 1 --2- 172.21.15.81:0/2290364538 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2598066f30 0x7f25980693e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.392+0000 7f25bd784700 1 --2- 172.21.15.81:0/2290364538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b81578d0 0x7f25b815ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.392+0000 7f25bd784700 1 -- 172.21.15.81:0/2290364538 >> 172.21.15.81:0/2290364538 conn(0x7f25b806bb90 msgr2=0x7f25b815baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.392+0000 7f25bd784700 1 -- 172.21.15.81:0/2290364538 shutdown_connections 2023-10-07T08:46:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.392+0000 7f25bd784700 1 -- 172.21.15.81:0/2290364538 wait complete. 2023-10-07T08:46:41.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-07T08:46:41.536 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_objectstore":"memstore"} 2023-10-07T08:46:41.537 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-07T08:46:41.537 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T08:46:41.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.653+0000 7f5a4ff72700 1 Processor -- start 2023-10-07T08:46:41.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.653+0000 7f5a4ff72700 1 -- start start 2023-10-07T08:46:41.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.654+0000 7f5a4ff72700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a48157ca0 0x7f5a480cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:41.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.654+0000 7f5a4ff72700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a4806d120 0x7f5a4806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:41.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.654+0000 7f5a4ff72700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a480d07c0 con 0x7f5a481578d0 2023-10-07T08:46:41.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.654+0000 7f5a4ff72700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4806daa0 con 0x7f5a48157ca0 2023-10-07T08:46:41.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.654+0000 7f5a4ff72700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480cfbb0 con 0x7f5a4806d120 2023-10-07T08:46:41.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.654+0000 7f5a4d50d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a48157ca0 0x7f5a480cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:41.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.654+0000 7f5a4d50d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a48157ca0 0x7f5a480cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33338/0 (socket says 172.21.15.81:33338) 2023-10-07T08:46:41.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.654+0000 7f5a4d50d700 1 -- 172.21.15.81:0/137913995 learned_addr learned my addr 172.21.15.81:0/137913995 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:41.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.654+0000 7f5a4e50f700 1 --2- 172.21.15.81:0/137913995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a4806d120 0x7f5a4806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:41.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.655+0000 7f5a4d50d700 1 -- 172.21.15.81:0/137913995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a4806d120 msgr2=0x7f5a4806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:41.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.655+0000 7f5a4d50d700 1 --2- 172.21.15.81:0/137913995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a4806d120 0x7f5a4806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:41.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.655+0000 7f5a4d50d700 1 -- 172.21.15.81:0/137913995 >> v1:172.21.15.89:6789/0 conn(0x7f5a481578d0 legacy=0x7f5a4815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:41.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.655+0000 7f5a4d50d700 1 -- 172.21.15.81:0/137913995 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a480cfe90 con 0x7f5a48157ca0 2023-10-07T08:46:41.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.655+0000 7f5a4d50d700 1 --2- 172.21.15.81:0/137913995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a48157ca0 0x7f5a480cf4f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5a380099b0 tx=0x7f5a38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee6838403ef4390 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:41.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.655+0000 7f5a4cd0c700 1 -- 172.21.15.81:0/137913995 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800b860 con 0x7f5a48157ca0 2023-10-07T08:46:41.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.655+0000 7f5a4cd0c700 1 -- 172.21.15.81:0/137913995 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3800b9c0 con 0x7f5a48157ca0 2023-10-07T08:46:41.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.655+0000 7f5a4cd0c700 1 -- 172.21.15.81:0/137913995 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800bd60 con 0x7f5a48157ca0 2023-10-07T08:46:41.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.655+0000 7f5a4ff72700 1 -- 172.21.15.81:0/137913995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a48157ca0 msgr2=0x7f5a480cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:41.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.655+0000 7f5a4ff72700 1 --2- 172.21.15.81:0/137913995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a48157ca0 0x7f5a480cf4f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5a380099b0 tx=0x7f5a38009250 comp rx=0 tx=0).stop 2023-10-07T08:46:41.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.655+0000 7f5a4ff72700 1 -- 172.21.15.81:0/137913995 shutdown_connections 2023-10-07T08:46:41.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.655+0000 7f5a4ff72700 1 --2- 172.21.15.81:0/137913995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a4806d120 0x7f5a4806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:41.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.655+0000 7f5a4ff72700 1 --2- 172.21.15.81:0/137913995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a48157ca0 0x7f5a480cf4f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:41.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.655+0000 7f5a4ff72700 1 -- 172.21.15.81:0/137913995 >> 172.21.15.81:0/137913995 conn(0x7f5a4806bb90 msgr2=0x7f5a4806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:41.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.655+0000 7f5a4ff72700 1 -- 172.21.15.81:0/137913995 shutdown_connections 2023-10-07T08:46:41.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.656+0000 7f5a4ff72700 1 -- 172.21.15.81:0/137913995 wait complete. 2023-10-07T08:46:41.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.657+0000 7f5a4ff72700 1 Processor -- start 2023-10-07T08:46:41.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.657+0000 7f5a4ff72700 1 -- start start 2023-10-07T08:46:41.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.657+0000 7f5a4ff72700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4806d120 0x7f5a4816adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:41.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.657+0000 7f5a4ff72700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a481578d0 0x7f5a48154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:41.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.657+0000 7f5a4ff72700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a48157ca0 0x7f5a48159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:41.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.657+0000 7f5a4ff72700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480c5b20 con 0x7f5a481578d0 2023-10-07T08:46:41.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.657+0000 7f5a4ff72700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4816b330 con 0x7f5a4806d120 2023-10-07T08:46:41.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.657+0000 7f5a4ff72700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4816de30 con 0x7f5a48157ca0 2023-10-07T08:46:41.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.657+0000 7f5a4d50d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a481578d0 0x7f5a48154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:41.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.657+0000 7f5a4d50d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a481578d0 0x7f5a48154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33340/0 (socket says 172.21.15.81:33340) 2023-10-07T08:46:41.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.657+0000 7f5a4d50d700 1 -- 172.21.15.81:0/3971024965 learned_addr learned my addr 172.21.15.81:0/3971024965 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:41.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.658+0000 7f5a4dd0e700 1 --2- 172.21.15.81:0/3971024965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4806d120 0x7f5a4816adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:41.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.658+0000 7f5a4e50f700 1 --2- 172.21.15.81:0/3971024965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a48157ca0 0x7f5a48159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:41.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.658+0000 7f5a4d50d700 1 -- 172.21.15.81:0/3971024965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a48157ca0 msgr2=0x7f5a48159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:41.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.658+0000 7f5a4d50d700 1 --2- 172.21.15.81:0/3971024965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a48157ca0 0x7f5a48159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:41.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.658+0000 7f5a4d50d700 1 -- 172.21.15.81:0/3971024965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4806d120 msgr2=0x7f5a4816adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:41.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.658+0000 7f5a4d50d700 1 --2- 172.21.15.81:0/3971024965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4806d120 0x7f5a4816adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:41.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.658+0000 7f5a4d50d700 1 -- 172.21.15.81:0/3971024965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a380094f0 con 0x7f5a481578d0 2023-10-07T08:46:41.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.658+0000 7f5a4d50d700 1 --2- 172.21.15.81:0/3971024965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a481578d0 0x7f5a48154620 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5a4806fe20 tx=0x7f5a38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:41.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.658+0000 7f5a3dffb700 1 -- 172.21.15.81:0/3971024965 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38024440 con 0x7f5a481578d0 2023-10-07T08:46:41.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.658+0000 7f5a3dffb700 1 -- 172.21.15.81:0/3971024965 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a380245c0 con 0x7f5a481578d0 2023-10-07T08:46:41.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.658+0000 7f5a3dffb700 1 -- 172.21.15.81:0/3971024965 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38024980 con 0x7f5a481578d0 2023-10-07T08:46:41.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.658+0000 7f5a4ff72700 1 -- 172.21.15.81:0/3971024965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4816e110 con 0x7f5a481578d0 2023-10-07T08:46:41.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.658+0000 7f5a4ff72700 1 -- 172.21.15.81:0/3971024965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4816e6d0 con 0x7f5a481578d0 2023-10-07T08:46:41.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.659+0000 7f5a4ff72700 1 -- 172.21.15.81:0/3971024965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a480c5c90 con 0x7f5a481578d0 2023-10-07T08:46:41.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.659+0000 7f5a3dffb700 1 -- 172.21.15.81:0/3971024965 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a3801a420 con 0x7f5a481578d0 2023-10-07T08:46:41.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.660+0000 7f5a3dffb700 1 --2- 172.21.15.81:0/3971024965 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5a2c066f00 0x7f5a2c0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:41.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.660+0000 7f5a3dffb700 1 -- 172.21.15.81:0/3971024965 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5a38085fa0 con 0x7f5a481578d0 2023-10-07T08:46:41.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.660+0000 7f5a4dd0e700 1 --2- 172.21.15.81:0/3971024965 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5a2c066f00 0x7f5a2c0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:41.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.660+0000 7f5a4dd0e700 1 --2- 172.21.15.81:0/3971024965 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5a2c066f00 0x7f5a2c0693b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5a44007fd0 tx=0x7f5a44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:41.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.664+0000 7f5a3dffb700 1 -- 172.21.15.81:0/3971024965 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a480c5c90 con 0x7f5a481578d0 2023-10-07T08:46:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.846+0000 7f5a4ff72700 1 -- 172.21.15.81:0/3971024965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5a480c5c90 con 0x7f5a481578d0 2023-10-07T08:46:41.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.852+0000 7f5a3dffb700 1 -- 172.21.15.81:0/3971024965 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5a480c5c90 con 0x7f5a481578d0 2023-10-07T08:46:41.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.854+0000 7f5a4ff72700 1 -- 172.21.15.81:0/3971024965 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5a2c066f00 msgr2=0x7f5a2c0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:41.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.854+0000 7f5a4ff72700 1 --2- 172.21.15.81:0/3971024965 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5a2c066f00 0x7f5a2c0693b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5a44007fd0 tx=0x7f5a44009040 comp rx=0 tx=0).stop 2023-10-07T08:46:41.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.854+0000 7f5a4ff72700 1 -- 172.21.15.81:0/3971024965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a481578d0 msgr2=0x7f5a48154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:41.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.854+0000 7f5a4ff72700 1 --2- 172.21.15.81:0/3971024965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a481578d0 0x7f5a48154620 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5a4806fe20 tx=0x7f5a38017000 comp rx=0 tx=0).stop 2023-10-07T08:46:41.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.854+0000 7f5a4ff72700 1 -- 172.21.15.81:0/3971024965 shutdown_connections 2023-10-07T08:46:41.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.854+0000 7f5a4ff72700 1 --2- 172.21.15.81:0/3971024965 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5a2c066f00 0x7f5a2c0693b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:41.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.854+0000 7f5a4ff72700 1 --2- 172.21.15.81:0/3971024965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a48157ca0 0x7f5a48159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:41.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.854+0000 7f5a4ff72700 1 --2- 172.21.15.81:0/3971024965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4806d120 0x7f5a4816adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:41.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.854+0000 7f5a4ff72700 1 --2- 172.21.15.81:0/3971024965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a481578d0 0x7f5a48154620 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:41.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.854+0000 7f5a4ff72700 1 -- 172.21.15.81:0/3971024965 >> 172.21.15.81:0/3971024965 conn(0x7f5a4806bb90 msgr2=0x7f5a4806a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:41.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.855+0000 7f5a4ff72700 1 -- 172.21.15.81:0/3971024965 shutdown_connections 2023-10-07T08:46:41.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:41.855+0000 7f5a4ff72700 1 -- 172.21.15.81:0/3971024965 wait complete. 2023-10-07T08:46:41.868 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:46:41.868 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:46:41.905 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:46:41.946 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:46:41.946 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T08:46:41.946 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:46:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.059+0000 7f6fc5ff4700 1 Processor -- start 2023-10-07T08:46:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.059+0000 7f6fc5ff4700 1 -- start start 2023-10-07T08:46:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.060+0000 7f6fc5ff4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc01578d0 0x7f6fc00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.060+0000 7f6fc5ff4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6fc006d120 0x7f6fc006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.060+0000 7f6fc5ff4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc006dac0 con 0x7f6fc0157ca0 2023-10-07T08:46:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.060+0000 7f6fc5ff4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc00d07c0 con 0x7f6fc006d120 2023-10-07T08:46:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.060+0000 7f6fc5ff4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00cfbb0 con 0x7f6fc01578d0 2023-10-07T08:46:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.060+0000 7f6fbffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6fc006d120 0x7f6fc006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.060+0000 7f6fbffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6fc006d120 0x7f6fc006d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33348/0 (socket says 172.21.15.81:33348) 2023-10-07T08:46:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.060+0000 7f6fbffff700 1 -- 172.21.15.81:0/4139980794 learned_addr learned my addr 172.21.15.81:0/4139980794 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.060+0000 7f6fbf7fe700 1 --2- 172.21.15.81:0/4139980794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc01578d0 0x7f6fc00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.060+0000 7f6fbffff700 1 -- 172.21.15.81:0/4139980794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc01578d0 msgr2=0x7f6fc00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.060+0000 7f6fbffff700 1 --2- 172.21.15.81:0/4139980794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc01578d0 0x7f6fc00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.060+0000 7f6fbffff700 1 -- 172.21.15.81:0/4139980794 >> v1:172.21.15.89:6789/0 conn(0x7f6fc0157ca0 legacy=0x7f6fc015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.060+0000 7f6fbffff700 1 -- 172.21.15.81:0/4139980794 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc00cfe90 con 0x7f6fc006d120 2023-10-07T08:46:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.060+0000 7f6fbffff700 1 --2- 172.21.15.81:0/4139980794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc006d120 0x7f6fc006d580 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80099b0 tx=0x7f6fb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d17eb43e64f9637 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.061+0000 7f6fbe7fc700 1 -- 172.21.15.81:0/4139980794 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb800b860 con 0x7f6fc006d120 2023-10-07T08:46:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.061+0000 7f6fbe7fc700 1 -- 172.21.15.81:0/4139980794 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb800b9c0 con 0x7f6fc006d120 2023-10-07T08:46:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.061+0000 7f6fbe7fc700 1 -- 172.21.15.81:0/4139980794 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb800bd60 con 0x7f6fc006d120 2023-10-07T08:46:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.061+0000 7f6fc5ff4700 1 -- 172.21.15.81:0/4139980794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc006d120 msgr2=0x7f6fc006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.061+0000 7f6fc5ff4700 1 --2- 172.21.15.81:0/4139980794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc006d120 0x7f6fc006d580 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80099b0 tx=0x7f6fb8009250 comp rx=0 tx=0).stop 2023-10-07T08:46:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.061+0000 7f6fc5ff4700 1 -- 172.21.15.81:0/4139980794 shutdown_connections 2023-10-07T08:46:42.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.061+0000 7f6fc5ff4700 1 --2- 172.21.15.81:0/4139980794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc006d120 0x7f6fc006d580 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:42.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.061+0000 7f6fc5ff4700 1 --2- 172.21.15.81:0/4139980794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc01578d0 0x7f6fc00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:42.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.061+0000 7f6fc5ff4700 1 -- 172.21.15.81:0/4139980794 >> 172.21.15.81:0/4139980794 conn(0x7f6fc006bb90 msgr2=0x7f6fc006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:42.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.061+0000 7f6fc5ff4700 1 -- 172.21.15.81:0/4139980794 shutdown_connections 2023-10-07T08:46:42.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.061+0000 7f6fc5ff4700 1 -- 172.21.15.81:0/4139980794 wait complete. 2023-10-07T08:46:42.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.062+0000 7f6fc5ff4700 1 Processor -- start 2023-10-07T08:46:42.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.062+0000 7f6fc5ff4700 1 -- start start 2023-10-07T08:46:42.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fc5ff4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fc006d120 0x7f6fc0154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:42.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fc5ff4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc01578d0 0x7f6fc00c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:42.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fc5ff4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0157ca0 0x7f6fc00cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:42.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fc5ff4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00c6490 con 0x7f6fc0157ca0 2023-10-07T08:46:42.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fc5ff4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00c6770 con 0x7f6fc006d120 2023-10-07T08:46:42.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fc5ff4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00c6a50 con 0x7f6fc01578d0 2023-10-07T08:46:42.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fbffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0157ca0 0x7f6fc00cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:42.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fbffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0157ca0 0x7f6fc00cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33364/0 (socket says 172.21.15.81:33364) 2023-10-07T08:46:42.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fbffff700 1 -- 172.21.15.81:0/3928710050 learned_addr learned my addr 172.21.15.81:0/3928710050 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:42.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fbf7fe700 1 --2- 172.21.15.81:0/3928710050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fc006d120 0x7f6fc0154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:42.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fbeffd700 1 --2- 172.21.15.81:0/3928710050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc01578d0 0x7f6fc00c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:42.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fbffff700 1 -- 172.21.15.81:0/3928710050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc01578d0 msgr2=0x7f6fc00c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:42.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fbffff700 1 --2- 172.21.15.81:0/3928710050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc01578d0 0x7f6fc00c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:42.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fbffff700 1 -- 172.21.15.81:0/3928710050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fc006d120 msgr2=0x7f6fc0154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:42.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fbffff700 1 --2- 172.21.15.81:0/3928710050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fc006d120 0x7f6fc0154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:42.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fbffff700 1 -- 172.21.15.81:0/3928710050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb80094f0 con 0x7f6fc0157ca0 2023-10-07T08:46:42.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.063+0000 7f6fbeffd700 1 --2- 172.21.15.81:0/3928710050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc01578d0 0x7f6fc00c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:42.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.064+0000 7f6fbffff700 1 --2- 172.21.15.81:0/3928710050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0157ca0 0x7f6fc00cd410 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6fc006fe20 tx=0x7f6fb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:42.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.064+0000 7f6fa77fe700 1 -- 172.21.15.81:0/3928710050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb801a630 con 0x7f6fc0157ca0 2023-10-07T08:46:42.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.064+0000 7f6fa77fe700 1 -- 172.21.15.81:0/3928710050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb801a7b0 con 0x7f6fc0157ca0 2023-10-07T08:46:42.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.064+0000 7f6fc5ff4700 1 -- 172.21.15.81:0/3928710050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc00c6d30 con 0x7f6fc0157ca0 2023-10-07T08:46:42.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.064+0000 7f6fa77fe700 1 -- 172.21.15.81:0/3928710050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb801ab70 con 0x7f6fc0157ca0 2023-10-07T08:46:42.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.064+0000 7f6fc5ff4700 1 -- 172.21.15.81:0/3928710050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc0154cc0 con 0x7f6fc0157ca0 2023-10-07T08:46:42.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.065+0000 7f6fc5ff4700 1 -- 172.21.15.81:0/3928710050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc00b3ba0 con 0x7f6fc0157ca0 2023-10-07T08:46:42.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.065+0000 7f6fa77fe700 1 -- 172.21.15.81:0/3928710050 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fb802d440 con 0x7f6fc0157ca0 2023-10-07T08:46:42.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.065+0000 7f6fa77fe700 1 --2- 172.21.15.81:0/3928710050 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6fac066f30 0x7f6fac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:42.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.066+0000 7f6fa77fe700 1 -- 172.21.15.81:0/3928710050 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6fb8085ec0 con 0x7f6fc0157ca0 2023-10-07T08:46:42.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.066+0000 7f6fbf7fe700 1 --2- 172.21.15.81:0/3928710050 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6fac066f30 0x7f6fac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:42.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.066+0000 7f6fbf7fe700 1 --2- 172.21.15.81:0/3928710050 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6fac066f30 0x7f6fac0693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00075a0 tx=0x7f6fb00097a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:42.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.070+0000 7f6fa77fe700 1 -- 172.21.15.81:0/3928710050 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fb8053430 con 0x7f6fc0157ca0 2023-10-07T08:46:42.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.292+0000 7f6fc5ff4700 1 -- 172.21.15.81:0/3928710050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fc00d0170 con 0x7f6fc0157ca0 2023-10-07T08:46:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.292+0000 7f6fa77fe700 1 -- 172.21.15.81:0/3928710050 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f6fb8015de0 con 0x7f6fc0157ca0 2023-10-07T08:46:42.294 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:42.294 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3279897900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3279897900},{"type":"v1","addr":"172.21.15.89:6835","nonce":3279897900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/102905724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":102905724},{"type":"v1","addr":"172.21.15.89:6834","nonce":102905724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4063096820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":4063096820},{"type":"v1","addr":"172.21.15.81:6836","nonce":4063096820}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5952,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2057167280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2057167280},{"type":"v1","addr":"172.21.15.81:6837","nonce":2057167280}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[]} 2023-10-07T08:46:42.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.294+0000 7f6fc5ff4700 1 -- 172.21.15.81:0/3928710050 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6fac066f30 msgr2=0x7f6fac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:42.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.294+0000 7f6fc5ff4700 1 --2- 172.21.15.81:0/3928710050 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6fac066f30 0x7f6fac0693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00075a0 tx=0x7f6fb00097a0 comp rx=0 tx=0).stop 2023-10-07T08:46:42.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.294+0000 7f6fc5ff4700 1 -- 172.21.15.81:0/3928710050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0157ca0 msgr2=0x7f6fc00cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:42.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.294+0000 7f6fc5ff4700 1 --2- 172.21.15.81:0/3928710050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0157ca0 0x7f6fc00cd410 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6fc006fe20 tx=0x7f6fb8017000 comp rx=0 tx=0).stop 2023-10-07T08:46:42.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.294+0000 7f6fc5ff4700 1 -- 172.21.15.81:0/3928710050 shutdown_connections 2023-10-07T08:46:42.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.294+0000 7f6fc5ff4700 1 --2- 172.21.15.81:0/3928710050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0157ca0 0x7f6fc00cd410 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:42.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.294+0000 7f6fc5ff4700 1 --2- 172.21.15.81:0/3928710050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fc006d120 0x7f6fc0154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:42.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.294+0000 7f6fc5ff4700 1 --2- 172.21.15.81:0/3928710050 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6fac066f30 0x7f6fac0693e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:42.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.294+0000 7f6fc5ff4700 1 --2- 172.21.15.81:0/3928710050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fc01578d0 0x7f6fc00c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:42.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.294+0000 7f6fc5ff4700 1 -- 172.21.15.81:0/3928710050 >> 172.21.15.81:0/3928710050 conn(0x7f6fc006bb90 msgr2=0x7f6fc0156630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:42.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.295+0000 7f6fc5ff4700 1 -- 172.21.15.81:0/3928710050 shutdown_connections 2023-10-07T08:46:42.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.295+0000 7f6fc5ff4700 1 -- 172.21.15.81:0/3928710050 wait complete. 2023-10-07T08:46:42.298 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 34 2023-10-07T08:46:42.309 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T08:46:42.309 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T08:46:42.309 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T08:46:42.309 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:46:42.309 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T08:46:42.309 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T08:46:42.310 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T08:46:42.310 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:46:42.310 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T08:46:42.310 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T08:46:42.310 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T08:46:42.310 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:46:42.310 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T08:46:42.311 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T08:46:42.311 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T08:46:42.311 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:46:42.318 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T08:46:42.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T08:46:42.319 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T08:46:42.319 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T08:46:42.322 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T08:46:42.322 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T08:46:42.323 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T08:46:42.323 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T08:46:42.360 INFO:tasks.ceph.mds.a:Started 2023-10-07T08:46:42.360 DEBUG:teuthology.parallel:result is None 2023-10-07T08:46:42.361 INFO:tasks.ceph.mds.c:Started 2023-10-07T08:46:42.361 DEBUG:teuthology.parallel:result is None 2023-10-07T08:46:42.364 INFO:tasks.ceph.mds.b:Started 2023-10-07T08:46:42.365 DEBUG:teuthology.parallel:result is None 2023-10-07T08:46:42.365 INFO:tasks.ceph.mds.d:Started 2023-10-07T08:46:42.365 DEBUG:teuthology.parallel:result is None 2023-10-07T08:46:42.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T08:46:42.433 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-07T08:46:42.434 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-07T08:46:42.440 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-10-07T08:46:42.440 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-10-07T08:46:42.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.485+0000 7fa5ea84b700 1 Processor -- start 2023-10-07T08:46:42.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.485+0000 7fa5ea84b700 1 -- start start 2023-10-07T08:46:42.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.486+0000 7fa5ea84b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5e4154350 0x7fa5e40cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:42.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.486+0000 7fa5ea84b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5e4154720 0x7fa5e40cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:42.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.486+0000 7fa5ea84b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e40b2c20 con 0x7fa5e406f200 2023-10-07T08:46:42.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.486+0000 7fa5ea84b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e4157010 con 0x7fa5e4154720 2023-10-07T08:46:42.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.486+0000 7fa5ea84b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40b2f00 con 0x7fa5e4154350 2023-10-07T08:46:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.486+0000 7fa5ea04a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5e4154720 0x7fa5e40cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.486+0000 7fa5e9048700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa5e406f200 0x7fa5e415a610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37304/0 (socket says 172.21.15.81:37304) 2023-10-07T08:46:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.487+0000 7fa5e9048700 1 -- 172.21.15.81:0/3393561775 learned_addr learned my addr 172.21.15.81:0/3393561775 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.486+0000 7fa5e9849700 1 --2- 172.21.15.81:0/3393561775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5e4154350 0x7fa5e40cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.487+0000 7fa5e9849700 1 -- 172.21.15.81:0/3393561775 >> v2:172.21.15.81:3300/0 conn(0x7fa5e4154720 msgr2=0x7fa5e40cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.487+0000 7fa5e9849700 1 --2- 172.21.15.81:0/3393561775 >> v2:172.21.15.81:3300/0 conn(0x7fa5e4154720 0x7fa5e40cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.487+0000 7fa5e8847700 1 -- 172.21.15.81:0/3393561775 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319756248 0 0) 0x7fa5e40b2c20 con 0x7fa5e406f200 2023-10-07T08:46:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.487+0000 7fa5e9849700 1 -- 172.21.15.81:0/3393561775 >> v1:172.21.15.81:6789/0 conn(0x7fa5e406f200 legacy=0x7fa5e415a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:42.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.487+0000 7fa5e9849700 1 -- 172.21.15.81:0/3393561775 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e40b31e0 con 0x7fa5e4154350 2023-10-07T08:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.487+0000 7fa5e9849700 1 --2- 172.21.15.81:0/3393561775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5e4154350 0x7fa5e40cd040 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00098e0 tx=0x7fa5e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=608b95cfd60427c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.487+0000 7fa5e8847700 1 -- 172.21.15.81:0/3393561775 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000b640 con 0x7fa5e4154350 2023-10-07T08:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.487+0000 7fa5e8847700 1 -- 172.21.15.81:0/3393561775 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e000b7a0 con 0x7fa5e4154350 2023-10-07T08:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.487+0000 7fa5e8847700 1 -- 172.21.15.81:0/3393561775 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000bb40 con 0x7fa5e4154350 2023-10-07T08:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.488+0000 7fa5ea84b700 1 -- 172.21.15.81:0/3393561775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5e4154350 msgr2=0x7fa5e40cd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.488+0000 7fa5ea84b700 1 --2- 172.21.15.81:0/3393561775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5e4154350 0x7fa5e40cd040 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00098e0 tx=0x7fa5e00091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.488+0000 7fa5ea84b700 1 -- 172.21.15.81:0/3393561775 shutdown_connections 2023-10-07T08:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.488+0000 7fa5ea84b700 1 --2- 172.21.15.81:0/3393561775 >> v2:172.21.15.81:3300/0 conn(0x7fa5e4154720 0x7fa5e40cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.488+0000 7fa5ea84b700 1 --2- 172.21.15.81:0/3393561775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5e4154350 0x7fa5e40cd040 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.488+0000 7fa5ea84b700 1 -- 172.21.15.81:0/3393561775 >> 172.21.15.81:0/3393561775 conn(0x7fa5e4063230 msgr2=0x7fa5e4063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.488+0000 7fa5ea84b700 1 -- 172.21.15.81:0/3393561775 shutdown_connections 2023-10-07T08:46:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.488+0000 7fa5ea84b700 1 -- 172.21.15.81:0/3393561775 wait complete. 2023-10-07T08:46:42.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.489+0000 7fa5ea84b700 1 Processor -- start 2023-10-07T08:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.489+0000 7fa5ea84b700 1 -- start start 2023-10-07T08:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.489+0000 7fa5ea84b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5e406f200 0x7fa5e40c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.489+0000 7fa5ea84b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e4154350 0x7fa5e416a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.489+0000 7fa5ea84b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5e4154720 0x7fa5e4144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5ea84b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e416ab50 con 0x7fa5e4154350 2023-10-07T08:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5ea84b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40c4fc0 con 0x7fa5e406f200 2023-10-07T08:46:42.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5ea84b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e416ad80 con 0x7fa5e4154720 2023-10-07T08:46:42.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5e9048700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e4154350 0x7fa5e416a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:42.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5e9048700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e4154350 0x7fa5e416a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48434/0 (socket says 172.21.15.81:48434) 2023-10-07T08:46:42.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5e9048700 1 -- 172.21.15.81:0/3981417335 learned_addr learned my addr 172.21.15.81:0/3981417335 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:42.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5ea04a700 1 --2- 172.21.15.81:0/3981417335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5e4154720 0x7fa5e4144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:42.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5e9849700 1 --2- 172.21.15.81:0/3981417335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5e406f200 0x7fa5e40c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:42.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5e9048700 1 -- 172.21.15.81:0/3981417335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5e4154720 msgr2=0x7fa5e4144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:42.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5e9048700 1 --2- 172.21.15.81:0/3981417335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5e4154720 0x7fa5e4144310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:42.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5e9048700 1 -- 172.21.15.81:0/3981417335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5e406f200 msgr2=0x7fa5e40c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:42.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5e9048700 1 --2- 172.21.15.81:0/3981417335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5e406f200 0x7fa5e40c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:42.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5e9048700 1 -- 172.21.15.81:0/3981417335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e0009420 con 0x7fa5e4154350 2023-10-07T08:46:42.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5ea04a700 1 --2- 172.21.15.81:0/3981417335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5e4154720 0x7fa5e4144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:42.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5e9849700 1 --2- 172.21.15.81:0/3981417335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5e406f200 0x7fa5e40c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:42.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5e9048700 1 --2- 172.21.15.81:0/3981417335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e4154350 0x7fa5e416a610 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa5d400c7e0 tx=0x7fa5d4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:42.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5d9ffb700 1 -- 172.21.15.81:0/3981417335 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4005b30 con 0x7fa5e4154350 2023-10-07T08:46:42.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5d9ffb700 1 -- 172.21.15.81:0/3981417335 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d4005c90 con 0x7fa5e4154350 2023-10-07T08:46:42.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5ea84b700 1 -- 172.21.15.81:0/3981417335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e416b060 con 0x7fa5e4154350 2023-10-07T08:46:42.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5d9ffb700 1 -- 172.21.15.81:0/3981417335 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4007300 con 0x7fa5e4154350 2023-10-07T08:46:42.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.490+0000 7fa5ea84b700 1 -- 172.21.15.81:0/3981417335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e4144850 con 0x7fa5e4154350 2023-10-07T08:46:42.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.491+0000 7fa5ea84b700 1 -- 172.21.15.81:0/3981417335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e416b580 con 0x7fa5e4154350 2023-10-07T08:46:42.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.492+0000 7fa5d9ffb700 1 -- 172.21.15.81:0/3981417335 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5d401b400 con 0x7fa5e4154350 2023-10-07T08:46:42.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.492+0000 7fa5d9ffb700 1 --2- 172.21.15.81:0/3981417335 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa5c8066f30 0x7fa5c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:42.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.492+0000 7fa5d9ffb700 1 -- 172.21.15.81:0/3981417335 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa5d4083d40 con 0x7fa5e4154350 2023-10-07T08:46:42.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.492+0000 7fa5e9849700 1 --2- 172.21.15.81:0/3981417335 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa5c8066f30 0x7fa5c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:42.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.493+0000 7fa5e9849700 1 --2- 172.21.15.81:0/3981417335 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa5c8066f30 0x7fa5c80693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00093f0 tx=0x7fa5e0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:42.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.496+0000 7fa5d9ffb700 1 -- 172.21.15.81:0/3981417335 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5e416b580 con 0x7fa5e4154350 2023-10-07T08:46:42.523 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-07T08:46:42.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:42.694+0000 7fa5ea84b700 1 -- 172.21.15.81:0/3981417335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa5e416b580 con 0x7fa5e4154350 2023-10-07T08:46:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:43.875+0000 7fa5d9ffb700 1 -- 172.21.15.81:0/3981417335 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v81) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa5e416b580 con 0x7fa5e4154350 2023-10-07T08:46:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:43.878+0000 7fa5ea84b700 1 -- 172.21.15.81:0/3981417335 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa5c8066f30 msgr2=0x7fa5c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:43.878+0000 7fa5ea84b700 1 --2- 172.21.15.81:0/3981417335 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa5c8066f30 0x7fa5c80693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00093f0 tx=0x7fa5e0017000 comp rx=0 tx=0).stop 2023-10-07T08:46:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:43.878+0000 7fa5ea84b700 1 -- 172.21.15.81:0/3981417335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e4154350 msgr2=0x7fa5e416a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:43.878+0000 7fa5ea84b700 1 --2- 172.21.15.81:0/3981417335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e4154350 0x7fa5e416a610 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa5d400c7e0 tx=0x7fa5d4007df0 comp rx=0 tx=0).stop 2023-10-07T08:46:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:43.878+0000 7fa5ea84b700 1 -- 172.21.15.81:0/3981417335 shutdown_connections 2023-10-07T08:46:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:43.878+0000 7fa5ea84b700 1 --2- 172.21.15.81:0/3981417335 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa5c8066f30 0x7fa5c80693e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:43.878+0000 7fa5ea84b700 1 --2- 172.21.15.81:0/3981417335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5e4154720 0x7fa5e4144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:43.878+0000 7fa5ea84b700 1 --2- 172.21.15.81:0/3981417335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5e406f200 0x7fa5e40c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:43.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:43.878+0000 7fa5ea84b700 1 --2- 172.21.15.81:0/3981417335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e4154350 0x7fa5e416a610 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:43.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:43.878+0000 7fa5ea84b700 1 -- 172.21.15.81:0/3981417335 >> 172.21.15.81:0/3981417335 conn(0x7fa5e4063230 msgr2=0x7fa5e4156570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:43.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:43.878+0000 7fa5ea84b700 1 -- 172.21.15.81:0/3981417335 shutdown_connections 2023-10-07T08:46:43.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:43.878+0000 7fa5ea84b700 1 -- 172.21.15.81:0/3981417335 wait complete. 2023-10-07T08:46:43.882 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-07T08:46:43.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T08:46:44.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.004+0000 7ff3017f8700 1 Processor -- start 2023-10-07T08:46:44.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.004+0000 7ff3017f8700 1 -- start start 2023-10-07T08:46:44.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.005+0000 7ff3017f8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff2fc15a2a0 0x7ff2fc0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.005+0000 7ff3017f8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2fc0ceb30 0x7ff2fc0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.005+0000 7ff3017f8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2fc0b0ca0 con 0x7ff2fc06d650 2023-10-07T08:46:44.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.005+0000 7ff3017f8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2fc06e160 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.005+0000 7ff3017f8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2fc06ea90 con 0x7ff2fc15a2a0 2023-10-07T08:46:44.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.005+0000 7ff2fa7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2fc0ceb30 0x7ff2fc0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.005+0000 7ff2fa7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2fc0ceb30 0x7ff2fc0cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48438/0 (socket says 172.21.15.81:48438) 2023-10-07T08:46:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.005+0000 7ff2fa7fc700 1 -- 172.21.15.81:0/3330763549 learned_addr learned my addr 172.21.15.81:0/3330763549 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.005+0000 7ff2faffd700 1 --2- 172.21.15.81:0/3330763549 >> v2:172.21.15.89:3300/0 conn(0x7ff2fc15a2a0 0x7ff2fc0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.006+0000 7ff2fa7fc700 1 -- 172.21.15.81:0/3330763549 >> v2:172.21.15.89:3300/0 conn(0x7ff2fc15a2a0 msgr2=0x7ff2fc0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.006+0000 7ff2fa7fc700 1 --2- 172.21.15.81:0/3330763549 >> v2:172.21.15.89:3300/0 conn(0x7ff2fc15a2a0 0x7ff2fc0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.006+0000 7ff2fa7fc700 1 -- 172.21.15.81:0/3330763549 >> v1:172.21.15.89:6789/0 conn(0x7ff2fc06d650 legacy=0x7ff2fc06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.006+0000 7ff2fa7fc700 1 -- 172.21.15.81:0/3330763549 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc0b00d0 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.006+0000 7ff2fa7fc700 1 --2- 172.21.15.81:0/3330763549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2fc0ceb30 0x7ff2fc0cefb0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0637a0 tx=0x7ff2e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28eb224c2687053 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.006+0000 7ff2f9ffb700 1 -- 172.21.15.81:0/3330763549 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4009e70 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.006+0000 7ff2f9ffb700 1 -- 172.21.15.81:0/3330763549 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e400b860 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.006+0000 7ff2f9ffb700 1 -- 172.21.15.81:0/3330763549 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e400bc00 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.006+0000 7ff3017f8700 1 -- 172.21.15.81:0/3330763549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2fc0ceb30 msgr2=0x7ff2fc0cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.006+0000 7ff3017f8700 1 --2- 172.21.15.81:0/3330763549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2fc0ceb30 0x7ff2fc0cefb0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0637a0 tx=0x7ff2e4009250 comp rx=0 tx=0).stop 2023-10-07T08:46:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.006+0000 7ff3017f8700 1 -- 172.21.15.81:0/3330763549 shutdown_connections 2023-10-07T08:46:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.006+0000 7ff3017f8700 1 --2- 172.21.15.81:0/3330763549 >> v2:172.21.15.89:3300/0 conn(0x7ff2fc15a2a0 0x7ff2fc0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.006+0000 7ff3017f8700 1 --2- 172.21.15.81:0/3330763549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2fc0ceb30 0x7ff2fc0cefb0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.006+0000 7ff3017f8700 1 -- 172.21.15.81:0/3330763549 >> 172.21.15.81:0/3330763549 conn(0x7ff2fc067640 msgr2=0x7ff2fc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.007+0000 7ff3017f8700 1 -- 172.21.15.81:0/3330763549 shutdown_connections 2023-10-07T08:46:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.007+0000 7ff3017f8700 1 -- 172.21.15.81:0/3330763549 wait complete. 2023-10-07T08:46:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.008+0000 7ff3017f8700 1 Processor -- start 2023-10-07T08:46:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.008+0000 7ff3017f8700 1 -- start start 2023-10-07T08:46:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.008+0000 7ff3017f8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2fc06d650 0x7ff2fc15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.008+0000 7ff3017f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2fc0ceb30 0x7ff2fc149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.008+0000 7ff3017f8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc15a2a0 0x7ff2fc0c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.008+0000 7ff3017f8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc15e5a0 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.008+0000 7ff3017f8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc15e880 con 0x7ff2fc15a2a0 2023-10-07T08:46:44.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.008+0000 7ff3017f8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc15eb60 con 0x7ff2fc06d650 2023-10-07T08:46:44.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.009+0000 7ff2fa7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2fc0ceb30 0x7ff2fc149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.009+0000 7ff2fa7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2fc0ceb30 0x7ff2fc149750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48452/0 (socket says 172.21.15.81:48452) 2023-10-07T08:46:44.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.009+0000 7ff2fa7fc700 1 -- 172.21.15.81:0/2809724847 learned_addr learned my addr 172.21.15.81:0/2809724847 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:44.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.009+0000 7ff2fb7fe700 1 --2- 172.21.15.81:0/2809724847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc15a2a0 0x7ff2fc0c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.009+0000 7ff2faffd700 1 --2- 172.21.15.81:0/2809724847 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2fc06d650 0x7ff2fc15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.009+0000 7ff2fa7fc700 1 -- 172.21.15.81:0/2809724847 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2fc06d650 msgr2=0x7ff2fc15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.009+0000 7ff2fa7fc700 1 --2- 172.21.15.81:0/2809724847 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2fc06d650 0x7ff2fc15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.009+0000 7ff2fa7fc700 1 -- 172.21.15.81:0/2809724847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc15a2a0 msgr2=0x7ff2fc0c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.009+0000 7ff2fa7fc700 1 --2- 172.21.15.81:0/2809724847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc15a2a0 0x7ff2fc0c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.009+0000 7ff2fa7fc700 1 -- 172.21.15.81:0/2809724847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e40094f0 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.009+0000 7ff2fa7fc700 1 --2- 172.21.15.81:0/2809724847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2fc0ceb30 0x7ff2fc149750 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc06f990 tx=0x7ff2e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.009+0000 7ff2f2ffd700 1 -- 172.21.15.81:0/2809724847 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e400bbe0 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.009+0000 7ff2f2ffd700 1 -- 172.21.15.81:0/2809724847 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e4011420 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.009+0000 7ff2f2ffd700 1 -- 172.21.15.81:0/2809724847 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40117e0 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.009+0000 7ff3017f8700 1 -- 172.21.15.81:0/2809724847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2fc15ee40 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.009+0000 7ff3017f8700 1 -- 172.21.15.81:0/2809724847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2fc15c5f0 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.010+0000 7ff3017f8700 1 -- 172.21.15.81:0/2809724847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2fc15f360 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.010+0000 7ff2f2ffd700 1 -- 172.21.15.81:0/2809724847 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2e4011c10 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.011+0000 7ff2f2ffd700 1 --2- 172.21.15.81:0/2809724847 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff2dc066f30 0x7ff2dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.011+0000 7ff2f2ffd700 1 -- 172.21.15.81:0/2809724847 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff2e4085a40 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.011+0000 7ff2faffd700 1 --2- 172.21.15.81:0/2809724847 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff2dc066f30 0x7ff2dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.011+0000 7ff2faffd700 1 --2- 172.21.15.81:0/2809724847 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff2dc066f30 0x7ff2dc0693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009fd0 tx=0x7ff2ec00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.015+0000 7ff2f2ffd700 1 -- 172.21.15.81:0/2809724847 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2fc15f360 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.269+0000 7ff3017f8700 1 -- 172.21.15.81:0/2809724847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff2fc15f360 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.270+0000 7ff2f2ffd700 1 -- 172.21.15.81:0/2809724847 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff2fc15f360 con 0x7ff2fc0ceb30 2023-10-07T08:46:44.271 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:44.271 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:46:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-07T08:46:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-07T08:46:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlK8v0EhAAyj+l+ifyEevPT96HbuWzkw==", 2023-10-07T08:46:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:46:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:46:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:46:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:46:44.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-07T08:46:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlN0UcHhAA0o1jHEL9Ow40VDezKTunOw==", 2023-10-07T08:46:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:46:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:46:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:46:44.273 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:46:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-07T08:46:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlvsm6GRAApZehzqt3HugU+h9RGWQh8g==", 2023-10-07T08:46:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:46:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:46:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:46:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:46:44.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-07T08:46:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8XLiJBAAMBqSo/+NZuuL/pPnTitAUw==", 2023-10-07T08:46:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:46:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:46:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:46:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:46:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-07T08:46:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD2GSFlwYNOOBAAMpoFTAZdRERvqFbI4Lno9g==", 2023-10-07T08:46:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:46:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:46:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:46:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-07T08:46:44.276 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlejEnBBAAsnZCgsTTMWvqr2n4FfgWCQ==", 2023-10-07T08:46:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:46:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:46:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:46:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-07T08:46:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlDjS3DRAAfyBS9XSkAY6Se+RNw9jwWw==", 2023-10-07T08:46:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:46:44.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:46:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:46:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-07T08:46:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlnLaEFxAAtQ3AxrEGCcXYvJF2/wP1yw==", 2023-10-07T08:46:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:46:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:46:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:46:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-07T08:46:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlllNdIRAAXgD+PAR1Piya6p94xfGbXA==", 2023-10-07T08:46:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:46:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:46:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:46:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-07T08:46:44.279 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFleIM7KBAAIz+WlbgsmtAuSMPO+kh/Xw==", 2023-10-07T08:46:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:46:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:46:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:46:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-07T08:46:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlFNlEMRAAt7dpMTylOj0KsJy/law6Nw==", 2023-10-07T08:46:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:46:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:46:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:46:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-07T08:46:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFloCRbOhAA8XzXVwVYYYZIJV+F84EiDQ==", 2023-10-07T08:46:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:46:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:46:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:46:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-07T08:46:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl7cS0KBAA2K6kkFjyEZYa0xYx53Nf7g==", 2023-10-07T08:46:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:46:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-07T08:46:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T08:46:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.282 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-07T08:46:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlP3EBMRAAWXcQeEkoEzBCSQzvz/AzBQ==", 2023-10-07T08:46:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:46:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:46:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:46:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:46:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-07T08:46:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFldtgKLhAAX8L0S1NgyHsOj4cUljxH/A==", 2023-10-07T08:46:44.283 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:46:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:46:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:46:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:46:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-07T08:46:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlJ+VXNhAA9sXFpdOEIZxQLiS8LJwa3A==", 2023-10-07T08:46:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:46:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:46:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:46:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:46:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-07T08:46:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDyGSFle021MxAA39oudTkATALz6ZklfA0QQA==", 2023-10-07T08:46:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:46:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:46:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:46:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:46:44.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-07T08:46:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8c3zDxAAKU/DHPPZhFJ1MKw48C6lJQ==", 2023-10-07T08:46:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:46:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:46:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:46:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:46:44.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-07T08:46:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlByYuDBAA2xkiT3FNBRXjSMlu+GdRjg==", 2023-10-07T08:46:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:46:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:46:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:46:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:46:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:46:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:46:44.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.272+0000 7ff3017f8700 1 -- 172.21.15.81:0/2809724847 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff2dc066f30 msgr2=0x7ff2dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.272+0000 7ff3017f8700 1 --2- 172.21.15.81:0/2809724847 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff2dc066f30 0x7ff2dc0693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009fd0 tx=0x7ff2ec00b040 comp rx=0 tx=0).stop 2023-10-07T08:46:44.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.272+0000 7ff3017f8700 1 -- 172.21.15.81:0/2809724847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2fc0ceb30 msgr2=0x7ff2fc149750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.272+0000 7ff3017f8700 1 --2- 172.21.15.81:0/2809724847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2fc0ceb30 0x7ff2fc149750 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc06f990 tx=0x7ff2e4017000 comp rx=0 tx=0).stop 2023-10-07T08:46:44.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.272+0000 7ff3017f8700 1 -- 172.21.15.81:0/2809724847 shutdown_connections 2023-10-07T08:46:44.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.272+0000 7ff3017f8700 1 --2- 172.21.15.81:0/2809724847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc15a2a0 0x7ff2fc0c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.272+0000 7ff3017f8700 1 --2- 172.21.15.81:0/2809724847 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff2dc066f30 0x7ff2dc0693e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.272+0000 7ff3017f8700 1 --2- 172.21.15.81:0/2809724847 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2fc06d650 0x7ff2fc15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.272+0000 7ff3017f8700 1 --2- 172.21.15.81:0/2809724847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2fc0ceb30 0x7ff2fc149750 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.272+0000 7ff3017f8700 1 -- 172.21.15.81:0/2809724847 >> 172.21.15.81:0/2809724847 conn(0x7ff2fc067640 msgr2=0x7ff2fc157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:44.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.272+0000 7ff3017f8700 1 -- 172.21.15.81:0/2809724847 shutdown_connections 2023-10-07T08:46:44.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.272+0000 7ff3017f8700 1 -- 172.21.15.81:0/2809724847 wait complete. 2023-10-07T08:46:44.290 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:46:44.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.403+0000 7f7497457700 1 Processor -- start 2023-10-07T08:46:44.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.403+0000 7f7497457700 1 -- start start 2023-10-07T08:46:44.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7497457700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7490159b40 0x7f74900cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7497457700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74900cee10 con 0x7f7490068e90 2023-10-07T08:46:44.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7497457700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74900cd040 con 0x7f7490159f10 2023-10-07T08:46:44.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7497457700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74900cd320 con 0x7f7490159b40 2023-10-07T08:46:44.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7496c56700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7490068e90 0x7f74900cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37306/0 (socket says 172.21.15.81:37306) 2023-10-07T08:46:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7496c56700 1 -- 172.21.15.81:0/4150945235 learned_addr learned my addr 172.21.15.81:0/4150945235 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7495453700 1 -- 172.21.15.81:0/4150945235 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826690942 0 0) 0x7f74900cee10 con 0x7f7490068e90 2023-10-07T08:46:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7496455700 1 --2- 172.21.15.81:0/4150945235 >> v2:172.21.15.89:3300/0 conn(0x7f7490159b40 0x7f74900cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7495453700 1 -- 172.21.15.81:0/4150945235 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f747c003570 con 0x7f7490068e90 2023-10-07T08:46:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7495453700 1 -- 172.21.15.81:0/4150945235 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 297198407 0 0) 0x7f747c003570 con 0x7f7490068e90 2023-10-07T08:46:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7495453700 1 -- 172.21.15.81:0/4150945235 >> v2:172.21.15.89:3300/0 conn(0x7f7490159b40 msgr2=0x7f74900cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7495453700 1 --2- 172.21.15.81:0/4150945235 >> v2:172.21.15.89:3300/0 conn(0x7f7490159b40 0x7f74900cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7495453700 1 -- 172.21.15.81:0/4150945235 >> v1:172.21.15.89:6789/0 conn(0x7f7490159f10 legacy=0x7f7490068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7495453700 1 -- 172.21.15.81:0/4150945235 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74900ce7c0 con 0x7f7490068e90 2023-10-07T08:46:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7495453700 1 -- 172.21.15.81:0/4150945235 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f74880017f0 con 0x7f7490068e90 2023-10-07T08:46:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7495453700 1 -- 172.21.15.81:0/4150945235 >> v1:172.21.15.81:6789/0 conn(0x7f7490068e90 legacy=0x7f74900cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7495453700 1 --2- 172.21.15.81:0/4150945235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f747c003a60 0x7f747c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7495453700 1 --2- 172.21.15.81:0/4150945235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747c004810 0x7f747c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7495453700 1 --2- 172.21.15.81:0/4150945235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f747c0051c0 0x7f747c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7495453700 1 -- 172.21.15.81:0/4150945235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74900cd320 con 0x7f747c004810 2023-10-07T08:46:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7495453700 1 -- 172.21.15.81:0/4150945235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c00c0d0 con 0x7f747c0051c0 2023-10-07T08:46:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.404+0000 7f7495453700 1 -- 172.21.15.81:0/4150945235 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c00c290 con 0x7f747c003a60 2023-10-07T08:46:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.405+0000 7f7495c54700 1 --2- 172.21.15.81:0/4150945235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747c004810 0x7f747c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.405+0000 7f7496455700 1 --2- 172.21.15.81:0/4150945235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f747c003a60 0x7f747c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.405+0000 7f7496c56700 1 --2- 172.21.15.81:0/4150945235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f747c0051c0 0x7f747c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.405+0000 7f7495c54700 1 -- 172.21.15.81:0/4150945235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f747c003a60 msgr2=0x7f747c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.405+0000 7f7495c54700 1 --2- 172.21.15.81:0/4150945235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f747c003a60 0x7f747c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.405+0000 7f7495c54700 1 -- 172.21.15.81:0/4150945235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f747c0051c0 msgr2=0x7f747c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:44.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.405+0000 7f7495c54700 1 --2- 172.21.15.81:0/4150945235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f747c0051c0 0x7f747c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.405+0000 7f7496c56700 1 -- 172.21.15.81:0/4150945235 reap_dead start 2023-10-07T08:46:44.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.405+0000 7f7495c54700 1 -- 172.21.15.81:0/4150945235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c003570 con 0x7f747c004810 2023-10-07T08:46:44.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.405+0000 7f7495c54700 1 --2- 172.21.15.81:0/4150945235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747c004810 0x7f747c004c80 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f74800018b0 tx=0x7f7480007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124103610b85f16a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:44.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.405+0000 7f7495453700 1 -- 172.21.15.81:0/4150945235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7480012420 con 0x7f747c004810 2023-10-07T08:46:44.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.405+0000 7f7495453700 1 -- 172.21.15.81:0/4150945235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74800125a0 con 0x7f747c004810 2023-10-07T08:46:44.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.405+0000 7f7495453700 1 -- 172.21.15.81:0/4150945235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7480012960 con 0x7f747c004810 2023-10-07T08:46:44.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.406+0000 7f7497457700 1 -- 172.21.15.81:0/4150945235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747c004810 msgr2=0x7f747c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.406+0000 7f7497457700 1 --2- 172.21.15.81:0/4150945235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747c004810 0x7f747c004c80 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f74800018b0 tx=0x7f7480007d30 comp rx=0 tx=0).stop 2023-10-07T08:46:44.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.406+0000 7f7497457700 1 -- 172.21.15.81:0/4150945235 shutdown_connections 2023-10-07T08:46:44.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.406+0000 7f7497457700 1 --2- 172.21.15.81:0/4150945235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747c004810 0x7f747c004c80 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.406+0000 7f7497457700 1 -- 172.21.15.81:0/4150945235 >> 172.21.15.81:0/4150945235 conn(0x7f74900cd660 msgr2=0x7f74900cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:44.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.406+0000 7f7497457700 1 -- 172.21.15.81:0/4150945235 shutdown_connections 2023-10-07T08:46:44.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.406+0000 7f7497457700 1 -- 172.21.15.81:0/4150945235 wait complete. 2023-10-07T08:46:44.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.407+0000 7f7497457700 1 Processor -- start 2023-10-07T08:46:44.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.407+0000 7f7497457700 1 -- start start 2023-10-07T08:46:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.407+0000 7f7497457700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747c004810 0x7f74900aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.407+0000 7f7497457700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f749016a560 0x7f74900c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.407+0000 7f7497457700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f749016a9d0 0x7f74900c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.407+0000 7f7497457700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749016af90 con 0x7f747c004810 2023-10-07T08:46:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.407+0000 7f7497457700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749016b270 con 0x7f749016a560 2023-10-07T08:46:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.407+0000 7f7497457700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749016dce0 con 0x7f749016a9d0 2023-10-07T08:46:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.408+0000 7f7496455700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747c004810 0x7f74900aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.408+0000 7f7496455700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747c004810 0x7f74900aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48462/0 (socket says 172.21.15.81:48462) 2023-10-07T08:46:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.408+0000 7f7496455700 1 -- 172.21.15.81:0/798934971 learned_addr learned my addr 172.21.15.81:0/798934971 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.408+0000 7f7495c54700 1 --2- 172.21.15.81:0/798934971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f749016a560 0x7f74900c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.408+0000 7f7496c56700 1 --2- 172.21.15.81:0/798934971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f749016a9d0 0x7f74900c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.408+0000 7f7496455700 1 -- 172.21.15.81:0/798934971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f749016a9d0 msgr2=0x7f74900c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.408+0000 7f7496455700 1 --2- 172.21.15.81:0/798934971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f749016a9d0 0x7f74900c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.408+0000 7f7496455700 1 -- 172.21.15.81:0/798934971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f749016a560 msgr2=0x7f74900c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.408+0000 7f7496455700 1 --2- 172.21.15.81:0/798934971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f749016a560 0x7f74900c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.408+0000 7f7496455700 1 -- 172.21.15.81:0/798934971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749016dfc0 con 0x7f747c004810 2023-10-07T08:46:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.408+0000 7f7496455700 1 --2- 172.21.15.81:0/798934971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747c004810 0x7f74900aec10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f748c011d40 tx=0x7f748c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.408+0000 7f74867fc700 1 -- 172.21.15.81:0/798934971 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c00fac0 con 0x7f747c004810 2023-10-07T08:46:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.408+0000 7f74867fc700 1 -- 172.21.15.81:0/798934971 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c00fc20 con 0x7f747c004810 2023-10-07T08:46:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.408+0000 7f7497457700 1 -- 172.21.15.81:0/798934971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74900af150 con 0x7f747c004810 2023-10-07T08:46:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.408+0000 7f74867fc700 1 -- 172.21.15.81:0/798934971 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c014440 con 0x7f747c004810 2023-10-07T08:46:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.408+0000 7f7497457700 1 -- 172.21.15.81:0/798934971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74900ac740 con 0x7f747c004810 2023-10-07T08:46:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.409+0000 7f7497457700 1 -- 172.21.15.81:0/798934971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749016db40 con 0x7f747c004810 2023-10-07T08:46:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.410+0000 7f74867fc700 1 -- 172.21.15.81:0/798934971 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f748c014870 con 0x7f747c004810 2023-10-07T08:46:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.410+0000 7f74867fc700 1 --2- 172.21.15.81:0/798934971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7474066f30 0x7f74740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.410+0000 7f74867fc700 1 -- 172.21.15.81:0/798934971 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f748c018030 con 0x7f747c004810 2023-10-07T08:46:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.410+0000 7f7495c54700 1 --2- 172.21.15.81:0/798934971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7474066f30 0x7f74740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.410+0000 7f7495c54700 1 --2- 172.21.15.81:0/798934971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7474066f30 0x7f74740693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f749016daa0 tx=0x7f7480015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:44.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.414+0000 7f74867fc700 1 -- 172.21.15.81:0/798934971 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f749016db40 con 0x7f747c004810 2023-10-07T08:46:44.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.600+0000 7f7497457700 1 -- 172.21.15.81:0/798934971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f749016db40 con 0x7f747c004810 2023-10-07T08:46:44.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.601+0000 7f74867fc700 1 -- 172.21.15.81:0/798934971 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+12086 (secure 0 0 0) 0x7f749016db40 con 0x7f747c004810 2023-10-07T08:46:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:44.602 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":81,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:46:43.873623+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:46:44.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.603+0000 7f7497457700 1 -- 172.21.15.81:0/798934971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7474066f30 msgr2=0x7f74740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.603+0000 7f7497457700 1 --2- 172.21.15.81:0/798934971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7474066f30 0x7f74740693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f749016daa0 tx=0x7f7480015000 comp rx=0 tx=0).stop 2023-10-07T08:46:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.603+0000 7f7497457700 1 -- 172.21.15.81:0/798934971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747c004810 msgr2=0x7f74900aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.603+0000 7f7497457700 1 --2- 172.21.15.81:0/798934971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747c004810 0x7f74900aec10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f748c011d40 tx=0x7f748c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.603+0000 7f7497457700 1 -- 172.21.15.81:0/798934971 shutdown_connections 2023-10-07T08:46:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.603+0000 7f7497457700 1 --2- 172.21.15.81:0/798934971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7474066f30 0x7f74740693e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.603+0000 7f7497457700 1 --2- 172.21.15.81:0/798934971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f749016a9d0 0x7f74900c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.603+0000 7f7497457700 1 --2- 172.21.15.81:0/798934971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747c004810 0x7f74900aec10 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.603+0000 7f7497457700 1 --2- 172.21.15.81:0/798934971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f749016a560 0x7f74900c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.603+0000 7f7497457700 1 -- 172.21.15.81:0/798934971 >> 172.21.15.81:0/798934971 conn(0x7f74900cd660 msgr2=0x7f74900c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.603+0000 7f7497457700 1 -- 172.21.15.81:0/798934971 shutdown_connections 2023-10-07T08:46:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.603+0000 7f7497457700 1 -- 172.21.15.81:0/798934971 wait complete. 2023-10-07T08:46:44.616 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T08:46:44.617 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:46:44.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.732+0000 7f7897274700 1 Processor -- start 2023-10-07T08:46:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.732+0000 7f7897274700 1 -- start start 2023-10-07T08:46:44.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.733+0000 7f7897274700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7890157ca0 0x7f78900cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.733+0000 7f7897274700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78900d07c0 con 0x7f78901578d0 2023-10-07T08:46:44.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.733+0000 7f7897274700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78900cfbb0 con 0x7f789006d120 2023-10-07T08:46:44.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.733+0000 7f7897274700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78900cfe90 con 0x7f7890157ca0 2023-10-07T08:46:44.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.733+0000 7f7895010700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f78901578d0 0x7f789015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37314/0 (socket says 172.21.15.81:37314) 2023-10-07T08:46:44.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.733+0000 7f7895010700 1 -- 172.21.15.81:0/2480038231 learned_addr learned my addr 172.21.15.81:0/2480038231 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:44.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.733+0000 7f789480f700 1 --2- 172.21.15.81:0/2480038231 >> v2:172.21.15.89:3300/0 conn(0x7f7890157ca0 0x7f78900cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.734+0000 7f7887fff700 1 -- 172.21.15.81:0/2480038231 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868439119 0 0) 0x7f78900d07c0 con 0x7f78901578d0 2023-10-07T08:46:44.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.734+0000 7f7887fff700 1 -- 172.21.15.81:0/2480038231 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f787c003570 con 0x7f78901578d0 2023-10-07T08:46:44.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.734+0000 7f7887fff700 1 -- 172.21.15.81:0/2480038231 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751038064 0 0) 0x7f78900cfbb0 con 0x7f789006d120 2023-10-07T08:46:44.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.734+0000 7f7887fff700 1 -- 172.21.15.81:0/2480038231 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78900d07c0 con 0x7f789006d120 2023-10-07T08:46:44.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.734+0000 7f789480f700 1 -- 172.21.15.81:0/2480038231 >> v1:172.21.15.89:6789/0 conn(0x7f789006d120 legacy=0x7f789006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.734+0000 7f789480f700 1 -- 172.21.15.81:0/2480038231 >> v1:172.21.15.81:6789/0 conn(0x7f78901578d0 legacy=0x7f789015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.734+0000 7f789480f700 1 -- 172.21.15.81:0/2480038231 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78900d0170 con 0x7f7890157ca0 2023-10-07T08:46:44.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.734+0000 7f789480f700 1 --2- 172.21.15.81:0/2480038231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7890157ca0 0x7f78900cf4f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f78800098e0 tx=0x7f78800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=277e57149115553c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:44.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.734+0000 7f7887fff700 1 -- 172.21.15.81:0/2480038231 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7880011630 con 0x7f7890157ca0 2023-10-07T08:46:44.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.734+0000 7f7887fff700 1 -- 172.21.15.81:0/2480038231 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7880011790 con 0x7f7890157ca0 2023-10-07T08:46:44.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.734+0000 7f7887fff700 1 -- 172.21.15.81:0/2480038231 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7880011b30 con 0x7f7890157ca0 2023-10-07T08:46:44.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.735+0000 7f7897274700 1 -- 172.21.15.81:0/2480038231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7890157ca0 msgr2=0x7f78900cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.735+0000 7f7897274700 1 --2- 172.21.15.81:0/2480038231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7890157ca0 0x7f78900cf4f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f78800098e0 tx=0x7f78800091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.735+0000 7f7897274700 1 -- 172.21.15.81:0/2480038231 shutdown_connections 2023-10-07T08:46:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.735+0000 7f7897274700 1 --2- 172.21.15.81:0/2480038231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7890157ca0 0x7f78900cf4f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.735+0000 7f7897274700 1 -- 172.21.15.81:0/2480038231 >> 172.21.15.81:0/2480038231 conn(0x7f789006bb90 msgr2=0x7f789006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.735+0000 7f7897274700 1 -- 172.21.15.81:0/2480038231 shutdown_connections 2023-10-07T08:46:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.735+0000 7f7897274700 1 -- 172.21.15.81:0/2480038231 wait complete. 2023-10-07T08:46:44.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.736+0000 7f7897274700 1 Processor -- start 2023-10-07T08:46:44.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.736+0000 7f7897274700 1 -- start start 2023-10-07T08:46:44.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7897274700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789006d120 0x7f7890154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7897274700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78901578d0 0x7f78900b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7897274700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7890157ca0 0x7f78901594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7897274700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78900b2560 con 0x7f789006d120 2023-10-07T08:46:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7897274700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78901553f0 con 0x7f78901578d0 2023-10-07T08:46:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7897274700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78900b1950 con 0x7f7890157ca0 2023-10-07T08:46:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7895010700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789006d120 0x7f7890154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7895010700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789006d120 0x7f7890154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48466/0 (socket says 172.21.15.81:48466) 2023-10-07T08:46:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7895010700 1 -- 172.21.15.81:0/2843137950 learned_addr learned my addr 172.21.15.81:0/2843137950 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f789480f700 1 --2- 172.21.15.81:0/2843137950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78901578d0 0x7f78900b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7895811700 1 --2- 172.21.15.81:0/2843137950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7890157ca0 0x7f78901594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7895010700 1 -- 172.21.15.81:0/2843137950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7890157ca0 msgr2=0x7f78901594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7895010700 1 --2- 172.21.15.81:0/2843137950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7890157ca0 0x7f78901594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7895010700 1 -- 172.21.15.81:0/2843137950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78901578d0 msgr2=0x7f78900b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7895010700 1 --2- 172.21.15.81:0/2843137950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78901578d0 0x7f78900b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7895010700 1 -- 172.21.15.81:0/2843137950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7880009420 con 0x7f789006d120 2023-10-07T08:46:44.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7895811700 1 --2- 172.21.15.81:0/2843137950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7890157ca0 0x7f78901594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:46:44.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7895010700 1 --2- 172.21.15.81:0/2843137950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789006d120 0x7f7890154eb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f788c00c790 tx=0x7f788c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:44.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f78857fa700 1 -- 172.21.15.81:0/2843137950 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c005b30 con 0x7f789006d120 2023-10-07T08:46:44.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f78857fa700 1 -- 172.21.15.81:0/2843137950 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c005c90 con 0x7f789006d120 2023-10-07T08:46:44.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7897274700 1 -- 172.21.15.81:0/2843137950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78900b1c30 con 0x7f789006d120 2023-10-07T08:46:44.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f78857fa700 1 -- 172.21.15.81:0/2843137950 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c007300 con 0x7f789006d120 2023-10-07T08:46:44.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.737+0000 7f7897274700 1 -- 172.21.15.81:0/2843137950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78900b21f0 con 0x7f789006d120 2023-10-07T08:46:44.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.738+0000 7f7897274700 1 -- 172.21.15.81:0/2843137950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7890067ac0 con 0x7f789006d120 2023-10-07T08:46:44.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.739+0000 7f78857fa700 1 -- 172.21.15.81:0/2843137950 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f788c01b400 con 0x7f789006d120 2023-10-07T08:46:44.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.739+0000 7f78857fa700 1 --2- 172.21.15.81:0/2843137950 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7874066f30 0x7f78740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:44.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.739+0000 7f78857fa700 1 -- 172.21.15.81:0/2843137950 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f788c083d20 con 0x7f789006d120 2023-10-07T08:46:44.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.739+0000 7f789480f700 1 --2- 172.21.15.81:0/2843137950 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7874066f30 0x7f78740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:44.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.739+0000 7f789480f700 1 --2- 172.21.15.81:0/2843137950 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7874066f30 0x7f78740693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f78901580c0 tx=0x7f7880017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:44.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.743+0000 7f78857fa700 1 -- 172.21.15.81:0/2843137950 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f788c051410 con 0x7f789006d120 2023-10-07T08:46:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.923+0000 7f7897274700 1 -- 172.21.15.81:0/2843137950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78900d0450 con 0x7f789006d120 2023-10-07T08:46:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.924+0000 7f78857fa700 1 -- 172.21.15.81:0/2843137950 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f788c0076f0 con 0x7f789006d120 2023-10-07T08:46:44.925 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:46:44.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.926+0000 7f7897274700 1 -- 172.21.15.81:0/2843137950 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7874066f30 msgr2=0x7f78740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.926+0000 7f7897274700 1 --2- 172.21.15.81:0/2843137950 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7874066f30 0x7f78740693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f78901580c0 tx=0x7f7880017000 comp rx=0 tx=0).stop 2023-10-07T08:46:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.926+0000 7f7897274700 1 -- 172.21.15.81:0/2843137950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789006d120 msgr2=0x7f7890154eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.926+0000 7f7897274700 1 --2- 172.21.15.81:0/2843137950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789006d120 0x7f7890154eb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f788c00c790 tx=0x7f788c007ea0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.926+0000 7f7897274700 1 -- 172.21.15.81:0/2843137950 shutdown_connections 2023-10-07T08:46:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.926+0000 7f7897274700 1 --2- 172.21.15.81:0/2843137950 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7874066f30 0x7f78740693e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.926+0000 7f7897274700 1 --2- 172.21.15.81:0/2843137950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7890157ca0 0x7f78901594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.926+0000 7f7897274700 1 --2- 172.21.15.81:0/2843137950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789006d120 0x7f7890154eb0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.926+0000 7f7897274700 1 --2- 172.21.15.81:0/2843137950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78901578d0 0x7f78900b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.926+0000 7f7897274700 1 -- 172.21.15.81:0/2843137950 >> 172.21.15.81:0/2843137950 conn(0x7f789006bb90 msgr2=0x7f789006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.926+0000 7f7897274700 1 -- 172.21.15.81:0/2843137950 shutdown_connections 2023-10-07T08:46:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:44.926+0000 7f7897274700 1 -- 172.21.15.81:0/2843137950 wait complete. 2023-10-07T08:46:44.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T08:46:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.053+0000 7fc4f1bf0700 1 Processor -- start 2023-10-07T08:46:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.053+0000 7fc4f1bf0700 1 -- start start 2023-10-07T08:46:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.054+0000 7fc4f1bf0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc4ec157fe0 0x7fc4ec0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.054+0000 7fc4f1bf0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4ec1583b0 0x7fc4ec0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.054+0000 7fc4f1bf0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4ec0ceb30 0x7fc4ec0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.054+0000 7fc4f1bf0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ec0cf4b0 con 0x7fc4ec1583b0 2023-10-07T08:46:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.054+0000 7fc4f1bf0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ec0b2890 con 0x7fc4ec157fe0 2023-10-07T08:46:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.054+0000 7fc4f1bf0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0b4070 con 0x7fc4ec0ceb30 2023-10-07T08:46:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.054+0000 7fc4eaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4ec1583b0 0x7fc4ec0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.054+0000 7fc4eaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4ec1583b0 0x7fc4ec0b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48470/0 (socket says 172.21.15.81:48470) 2023-10-07T08:46:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.054+0000 7fc4eaffd700 1 -- 172.21.15.81:0/758988447 learned_addr learned my addr 172.21.15.81:0/758988447 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4ebfff700 1 --2- 172.21.15.81:0/758988447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4ec0ceb30 0x7fc4ec0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4eb7fe700 1 --2- 172.21.15.81:0/758988447 >> v2:172.21.15.89:3300/0 conn(0x7fc4ec157fe0 0x7fc4ec0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4eaffd700 1 -- 172.21.15.81:0/758988447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4ec0ceb30 msgr2=0x7fc4ec0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4eaffd700 1 --2- 172.21.15.81:0/758988447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4ec0ceb30 0x7fc4ec0cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4eaffd700 1 -- 172.21.15.81:0/758988447 >> v2:172.21.15.89:3300/0 conn(0x7fc4ec157fe0 msgr2=0x7fc4ec0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4eaffd700 1 --2- 172.21.15.81:0/758988447 >> v2:172.21.15.89:3300/0 conn(0x7fc4ec157fe0 0x7fc4ec0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4eaffd700 1 -- 172.21.15.81:0/758988447 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0b4350 con 0x7fc4ec1583b0 2023-10-07T08:46:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4eb7fe700 1 --2- 172.21.15.81:0/758988447 >> v2:172.21.15.89:3300/0 conn(0x7fc4ec157fe0 0x7fc4ec0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4eaffd700 1 --2- 172.21.15.81:0/758988447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4ec1583b0 0x7fc4ec0b3a00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec064d90 tx=0x7fc4e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc954f38aab6843b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4ea7fc700 1 -- 172.21.15.81:0/758988447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e000b860 con 0x7fc4ec1583b0 2023-10-07T08:46:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4ea7fc700 1 -- 172.21.15.81:0/758988447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e000b9c0 con 0x7fc4ec1583b0 2023-10-07T08:46:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4ea7fc700 1 -- 172.21.15.81:0/758988447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e000bd80 con 0x7fc4ec1583b0 2023-10-07T08:46:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4f1bf0700 1 -- 172.21.15.81:0/758988447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4ec1583b0 msgr2=0x7fc4ec0b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4f1bf0700 1 --2- 172.21.15.81:0/758988447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4ec1583b0 0x7fc4ec0b3a00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec064d90 tx=0x7fc4e0009250 comp rx=0 tx=0).stop 2023-10-07T08:46:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4f1bf0700 1 -- 172.21.15.81:0/758988447 shutdown_connections 2023-10-07T08:46:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4f1bf0700 1 --2- 172.21.15.81:0/758988447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4ec0ceb30 0x7fc4ec0cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4f1bf0700 1 --2- 172.21.15.81:0/758988447 >> v2:172.21.15.89:3300/0 conn(0x7fc4ec157fe0 0x7fc4ec0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.055+0000 7fc4f1bf0700 1 --2- 172.21.15.81:0/758988447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4ec1583b0 0x7fc4ec0b3a00 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.056+0000 7fc4f1bf0700 1 -- 172.21.15.81:0/758988447 >> 172.21.15.81:0/758988447 conn(0x7fc4ec067640 msgr2=0x7fc4ec067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.056+0000 7fc4f1bf0700 1 -- 172.21.15.81:0/758988447 shutdown_connections 2023-10-07T08:46:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.056+0000 7fc4f1bf0700 1 -- 172.21.15.81:0/758988447 wait complete. 2023-10-07T08:46:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.057+0000 7fc4f1bf0700 1 Processor -- start 2023-10-07T08:46:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.057+0000 7fc4f1bf0700 1 -- start start 2023-10-07T08:46:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.057+0000 7fc4f1bf0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4ec0ceb30 0x7fc4ec0c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4f1bf0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4ec157fe0 0x7fc4ec15a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4f1bf0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4ec1583b0 0x7fc4ec143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4f1bf0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0c4870 con 0x7fc4ec0ceb30 2023-10-07T08:46:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4f1bf0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0c42b0 con 0x7fc4ec1583b0 2023-10-07T08:46:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4f1bf0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0c4590 con 0x7fc4ec157fe0 2023-10-07T08:46:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4eb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4ec0ceb30 0x7fc4ec0c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4eb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4ec0ceb30 0x7fc4ec0c3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48474/0 (socket says 172.21.15.81:48474) 2023-10-07T08:46:45.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4eb7fe700 1 -- 172.21.15.81:0/1511104936 learned_addr learned my addr 172.21.15.81:0/1511104936 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:45.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4eaffd700 1 --2- 172.21.15.81:0/1511104936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4ec157fe0 0x7fc4ec15a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:45.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4ebfff700 1 --2- 172.21.15.81:0/1511104936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4ec1583b0 0x7fc4ec143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:45.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4eb7fe700 1 -- 172.21.15.81:0/1511104936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4ec157fe0 msgr2=0x7fc4ec15a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:45.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4eb7fe700 1 --2- 172.21.15.81:0/1511104936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4ec157fe0 0x7fc4ec15a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4eb7fe700 1 -- 172.21.15.81:0/1511104936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4ec1583b0 msgr2=0x7fc4ec143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:45.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4eb7fe700 1 --2- 172.21.15.81:0/1511104936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4ec1583b0 0x7fc4ec143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4eb7fe700 1 -- 172.21.15.81:0/1511104936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e00094f0 con 0x7fc4ec0ceb30 2023-10-07T08:46:45.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4ebfff700 1 --2- 172.21.15.81:0/1511104936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4ec1583b0 0x7fc4ec143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:45.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4eb7fe700 1 --2- 172.21.15.81:0/1511104936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4ec0ceb30 0x7fc4ec0c3940 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00d1d0 tx=0x7fc4dc009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:45.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4d37fe700 1 -- 172.21.15.81:0/1511104936 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc00ddc0 con 0x7fc4ec0ceb30 2023-10-07T08:46:45.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4d37fe700 1 -- 172.21.15.81:0/1511104936 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4dc00f040 con 0x7fc4ec0ceb30 2023-10-07T08:46:45.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4f1bf0700 1 -- 172.21.15.81:0/1511104936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ec0c5970 con 0x7fc4ec0ceb30 2023-10-07T08:46:45.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4d37fe700 1 -- 172.21.15.81:0/1511104936 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc015670 con 0x7fc4ec0ceb30 2023-10-07T08:46:45.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.058+0000 7fc4f1bf0700 1 -- 172.21.15.81:0/1511104936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ec0c98e0 con 0x7fc4ec0ceb30 2023-10-07T08:46:45.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.059+0000 7fc4f1bf0700 1 -- 172.21.15.81:0/1511104936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ec0c5e10 con 0x7fc4ec0ceb30 2023-10-07T08:46:45.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.060+0000 7fc4d37fe700 1 -- 172.21.15.81:0/1511104936 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc4dc015a60 con 0x7fc4ec0ceb30 2023-10-07T08:46:45.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.060+0000 7fc4d37fe700 1 --2- 172.21.15.81:0/1511104936 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc4d8066f30 0x7fc4d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:45.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.060+0000 7fc4d37fe700 1 -- 172.21.15.81:0/1511104936 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc4dc084610 con 0x7fc4ec0ceb30 2023-10-07T08:46:45.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.060+0000 7fc4eaffd700 1 --2- 172.21.15.81:0/1511104936 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc4d8066f30 0x7fc4d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:45.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.060+0000 7fc4eaffd700 1 --2- 172.21.15.81:0/1511104936 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc4d8066f30 0x7fc4d80693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec064d90 tx=0x7fc4e0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:45.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.064+0000 7fc4d37fe700 1 -- 172.21.15.81:0/1511104936 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4dc04e5a0 con 0x7fc4ec0ceb30 2023-10-07T08:46:45.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.249+0000 7fc4f1bf0700 1 -- 172.21.15.81:0/1511104936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc4ec0c5fc0 con 0x7fc4ec0ceb30 2023-10-07T08:46:45.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.249+0000 7fc4d37fe700 1 -- 172.21.15.81:0/1511104936 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc4dc01a060 con 0x7fc4ec0ceb30 2023-10-07T08:46:45.250 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:45.251 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-07T08:46:45.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:46:45.251 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-07T08:46:45.251 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-07T08:46:45.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:46:45.251 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-07T08:46:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.251+0000 7fc4f1bf0700 1 -- 172.21.15.81:0/1511104936 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc4d8066f30 msgr2=0x7fc4d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.251+0000 7fc4f1bf0700 1 --2- 172.21.15.81:0/1511104936 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc4d8066f30 0x7fc4d80693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec064d90 tx=0x7fc4e0017000 comp rx=0 tx=0).stop 2023-10-07T08:46:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.251+0000 7fc4f1bf0700 1 -- 172.21.15.81:0/1511104936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4ec0ceb30 msgr2=0x7fc4ec0c3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.251+0000 7fc4f1bf0700 1 --2- 172.21.15.81:0/1511104936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4ec0ceb30 0x7fc4ec0c3940 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00d1d0 tx=0x7fc4dc009a90 comp rx=0 tx=0).stop 2023-10-07T08:46:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.251+0000 7fc4f1bf0700 1 -- 172.21.15.81:0/1511104936 shutdown_connections 2023-10-07T08:46:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.251+0000 7fc4f1bf0700 1 --2- 172.21.15.81:0/1511104936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4ec1583b0 0x7fc4ec143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.251+0000 7fc4f1bf0700 1 --2- 172.21.15.81:0/1511104936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4ec0ceb30 0x7fc4ec0c3940 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.251+0000 7fc4f1bf0700 1 --2- 172.21.15.81:0/1511104936 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc4d8066f30 0x7fc4d80693e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.251+0000 7fc4f1bf0700 1 --2- 172.21.15.81:0/1511104936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4ec157fe0 0x7fc4ec15a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.251+0000 7fc4f1bf0700 1 -- 172.21.15.81:0/1511104936 >> 172.21.15.81:0/1511104936 conn(0x7fc4ec067640 msgr2=0x7fc4ec1536d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.251+0000 7fc4f1bf0700 1 -- 172.21.15.81:0/1511104936 shutdown_connections 2023-10-07T08:46:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.251+0000 7fc4f1bf0700 1 -- 172.21.15.81:0/1511104936 wait complete. 2023-10-07T08:46:45.264 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T08:46:45.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T08:46:45.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.380+0000 7face3d50700 1 Processor -- start 2023-10-07T08:46:45.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.381+0000 7face3d50700 1 -- start start 2023-10-07T08:46:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.381+0000 7face3d50700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facdc1578d0 0x7facdc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.381+0000 7face3d50700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7facdc157ca0 0x7facdc15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.381+0000 7face3d50700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facdc0d07c0 con 0x7facdc06d120 2023-10-07T08:46:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.381+0000 7face3d50700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facdc0cfbb0 con 0x7facdc157ca0 2023-10-07T08:46:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.381+0000 7face3d50700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc0cfe90 con 0x7facdc1578d0 2023-10-07T08:46:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.382+0000 7face22ed700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7facdc06d120 0x7facdc15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37328/0 (socket says 172.21.15.81:37328) 2023-10-07T08:46:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.382+0000 7face22ed700 1 -- 172.21.15.81:0/3754494357 learned_addr learned my addr 172.21.15.81:0/3754494357 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.382+0000 7face1aec700 1 --2- 172.21.15.81:0/3754494357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facdc1578d0 0x7facdc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.382+0000 7face12eb700 1 --2- 172.21.15.81:0/3754494357 >> v2:172.21.15.89:3300/0 conn(0x7facdc157ca0 0x7facdc15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.382+0000 7face0aea700 1 -- 172.21.15.81:0/3754494357 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020595111 0 0) 0x7facdc0d07c0 con 0x7facdc06d120 2023-10-07T08:46:45.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.382+0000 7face0aea700 1 -- 172.21.15.81:0/3754494357 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facc8003570 con 0x7facdc06d120 2023-10-07T08:46:45.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.382+0000 7face1aec700 1 -- 172.21.15.81:0/3754494357 >> v2:172.21.15.89:3300/0 conn(0x7facdc157ca0 msgr2=0x7facdc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:45.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.382+0000 7face1aec700 1 --2- 172.21.15.81:0/3754494357 >> v2:172.21.15.89:3300/0 conn(0x7facdc157ca0 0x7facdc15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.382+0000 7face1aec700 1 -- 172.21.15.81:0/3754494357 >> v1:172.21.15.81:6789/0 conn(0x7facdc06d120 legacy=0x7facdc15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:45.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.382+0000 7face1aec700 1 -- 172.21.15.81:0/3754494357 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc0d0170 con 0x7facdc1578d0 2023-10-07T08:46:45.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.382+0000 7face1aec700 1 --2- 172.21.15.81:0/3754494357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facdc1578d0 0x7facdc0cf4f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7facd80098e0 tx=0x7facd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2b8a1e5a43b07f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:45.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.382+0000 7face0aea700 1 -- 172.21.15.81:0/3754494357 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd8011630 con 0x7facdc1578d0 2023-10-07T08:46:45.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.382+0000 7face0aea700 1 -- 172.21.15.81:0/3754494357 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd8011790 con 0x7facdc1578d0 2023-10-07T08:46:45.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.382+0000 7face0aea700 1 -- 172.21.15.81:0/3754494357 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd8011b30 con 0x7facdc1578d0 2023-10-07T08:46:45.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.383+0000 7face3d50700 1 -- 172.21.15.81:0/3754494357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facdc1578d0 msgr2=0x7facdc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:45.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.383+0000 7face3d50700 1 --2- 172.21.15.81:0/3754494357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facdc1578d0 0x7facdc0cf4f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7facd80098e0 tx=0x7facd80091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.383+0000 7face3d50700 1 -- 172.21.15.81:0/3754494357 shutdown_connections 2023-10-07T08:46:45.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.383+0000 7face3d50700 1 --2- 172.21.15.81:0/3754494357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facdc1578d0 0x7facdc0cf4f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.383+0000 7face3d50700 1 --2- 172.21.15.81:0/3754494357 >> v2:172.21.15.89:3300/0 conn(0x7facdc157ca0 0x7facdc15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.383+0000 7face3d50700 1 -- 172.21.15.81:0/3754494357 >> 172.21.15.81:0/3754494357 conn(0x7facdc06bb90 msgr2=0x7facdc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:45.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.383+0000 7face3d50700 1 -- 172.21.15.81:0/3754494357 shutdown_connections 2023-10-07T08:46:45.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.383+0000 7face3d50700 1 -- 172.21.15.81:0/3754494357 wait complete. 2023-10-07T08:46:45.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.384+0000 7face3d50700 1 Processor -- start 2023-10-07T08:46:45.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.384+0000 7face3d50700 1 -- start start 2023-10-07T08:46:45.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face3d50700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facdc06d120 0x7facdc1537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:45.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face3d50700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facdc1578d0 0x7facdc0b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:45.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face3d50700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facdc157ca0 0x7facdc0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:45.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face3d50700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc16a540 con 0x7facdc1578d0 2023-10-07T08:46:45.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face3d50700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc15c720 con 0x7facdc157ca0 2023-10-07T08:46:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face3d50700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc15ca00 con 0x7facdc06d120 2023-10-07T08:46:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face12eb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facdc1578d0 0x7facdc0b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face12eb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facdc1578d0 0x7facdc0b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48480/0 (socket says 172.21.15.81:48480) 2023-10-07T08:46:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face12eb700 1 -- 172.21.15.81:0/3150272751 learned_addr learned my addr 172.21.15.81:0/3150272751 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face1aec700 1 --2- 172.21.15.81:0/3150272751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facdc06d120 0x7facdc1537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face22ed700 1 --2- 172.21.15.81:0/3150272751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facdc157ca0 0x7facdc0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face12eb700 1 -- 172.21.15.81:0/3150272751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facdc06d120 msgr2=0x7facdc1537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face12eb700 1 --2- 172.21.15.81:0/3150272751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facdc06d120 0x7facdc1537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face12eb700 1 -- 172.21.15.81:0/3150272751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facdc157ca0 msgr2=0x7facdc0ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face12eb700 1 --2- 172.21.15.81:0/3150272751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facdc157ca0 0x7facdc0ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face12eb700 1 -- 172.21.15.81:0/3150272751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd8009420 con 0x7facdc1578d0 2023-10-07T08:46:45.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.385+0000 7face12eb700 1 --2- 172.21.15.81:0/3150272751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facdc1578d0 0x7facdc0b63d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7faccc00e930 tx=0x7faccc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:45.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.386+0000 7facd1ffb700 1 -- 172.21.15.81:0/3150272751 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc013680 con 0x7facdc1578d0 2023-10-07T08:46:45.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.386+0000 7facd1ffb700 1 -- 172.21.15.81:0/3150272751 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc0137e0 con 0x7facdc1578d0 2023-10-07T08:46:45.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.386+0000 7face3d50700 1 -- 172.21.15.81:0/3150272751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facdc15cce0 con 0x7facdc1578d0 2023-10-07T08:46:45.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.386+0000 7facd1ffb700 1 -- 172.21.15.81:0/3150272751 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc013b80 con 0x7facdc1578d0 2023-10-07T08:46:45.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.386+0000 7face3d50700 1 -- 172.21.15.81:0/3150272751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc153cf0 con 0x7facdc1578d0 2023-10-07T08:46:45.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.387+0000 7face3d50700 1 -- 172.21.15.81:0/3150272751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facdc067ac0 con 0x7facdc1578d0 2023-10-07T08:46:45.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.387+0000 7facd1ffb700 1 -- 172.21.15.81:0/3150272751 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faccc00c3e0 con 0x7facdc1578d0 2023-10-07T08:46:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.388+0000 7facd1ffb700 1 --2- 172.21.15.81:0/3150272751 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facc0066f30 0x7facc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.388+0000 7facd1ffb700 1 -- 172.21.15.81:0/3150272751 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4853+0+0 (secure 0 0 0) 0x7faccc084300 con 0x7facdc1578d0 2023-10-07T08:46:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.388+0000 7face1aec700 1 --2- 172.21.15.81:0/3150272751 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facc0066f30 0x7facc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.388+0000 7face1aec700 1 --2- 172.21.15.81:0/3150272751 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facc0066f30 0x7facc00693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7facd80091e0 tx=0x7facd8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.392+0000 7facd1ffb700 1 -- 172.21.15.81:0/3150272751 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faccc051820 con 0x7facdc1578d0 2023-10-07T08:46:45.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:45.577+0000 7face3d50700 1 -- 172.21.15.81:0/3150272751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7facdc0d0450 con 0x7facdc1578d0 2023-10-07T08:46:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.399+0000 7facd1ffb700 1 -- 172.21.15.81:0/3150272751 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) v1 ==== 138+0+0 (secure 0 0 0) 0x7faccc054e40 con 0x7facdc1578d0 2023-10-07T08:46:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.402+0000 7face3d50700 1 -- 172.21.15.81:0/3150272751 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facc0066f30 msgr2=0x7facc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.402+0000 7face3d50700 1 --2- 172.21.15.81:0/3150272751 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facc0066f30 0x7facc00693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7facd80091e0 tx=0x7facd8017000 comp rx=0 tx=0).stop 2023-10-07T08:46:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.402+0000 7face3d50700 1 -- 172.21.15.81:0/3150272751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facdc1578d0 msgr2=0x7facdc0b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.402+0000 7face3d50700 1 --2- 172.21.15.81:0/3150272751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facdc1578d0 0x7facdc0b63d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7faccc00e930 tx=0x7faccc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.402+0000 7face3d50700 1 -- 172.21.15.81:0/3150272751 shutdown_connections 2023-10-07T08:46:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.402+0000 7face3d50700 1 --2- 172.21.15.81:0/3150272751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facdc157ca0 0x7facdc0ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.402+0000 7face3d50700 1 --2- 172.21.15.81:0/3150272751 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facc0066f30 0x7facc00693e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.402+0000 7face3d50700 1 --2- 172.21.15.81:0/3150272751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facdc06d120 0x7facdc1537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.402+0000 7face3d50700 1 --2- 172.21.15.81:0/3150272751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facdc1578d0 0x7facdc0b63d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.402+0000 7face3d50700 1 -- 172.21.15.81:0/3150272751 >> 172.21.15.81:0/3150272751 conn(0x7facdc06bb90 msgr2=0x7facdc155720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.402+0000 7face3d50700 1 -- 172.21.15.81:0/3150272751 shutdown_connections 2023-10-07T08:46:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.402+0000 7face3d50700 1 -- 172.21.15.81:0/3150272751 wait complete. 2023-10-07T08:46:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-07T08:46:46.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T08:46:46.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.535+0000 7f62cb01a700 1 Processor -- start 2023-10-07T08:46:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.535+0000 7f62cb01a700 1 -- start start 2023-10-07T08:46:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.536+0000 7f62cb01a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f62c4068f20 0x7f62c40cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.536+0000 7f62cb01a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62c4157b90 0x7f62c40cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.536+0000 7f62cb01a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c40cca80 con 0x7f62c41577c0 2023-10-07T08:46:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.536+0000 7f62cb01a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c40cedd0 con 0x7f62c4157b90 2023-10-07T08:46:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.536+0000 7f62cb01a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c40cc210 con 0x7f62c4068f20 2023-10-07T08:46:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.536+0000 7f62c95b7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62c4157b90 0x7f62c40cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.536+0000 7f62c95b7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62c4157b90 0x7f62c40cbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48488/0 (socket says 172.21.15.81:48488) 2023-10-07T08:46:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.536+0000 7f62c95b7700 1 -- 172.21.15.81:0/510730280 learned_addr learned my addr 172.21.15.81:0/510730280 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.536+0000 7f62bbfff700 1 --2- 172.21.15.81:0/510730280 >> v2:172.21.15.89:3300/0 conn(0x7f62c4068f20 0x7f62c40cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.536+0000 7f62c95b7700 1 -- 172.21.15.81:0/510730280 >> v2:172.21.15.89:3300/0 conn(0x7f62c4068f20 msgr2=0x7f62c40cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.536+0000 7f62c95b7700 1 --2- 172.21.15.81:0/510730280 >> v2:172.21.15.89:3300/0 conn(0x7f62c4068f20 0x7f62c40cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.536+0000 7f62c95b7700 1 -- 172.21.15.81:0/510730280 >> v1:172.21.15.89:6789/0 conn(0x7f62c41577c0 legacy=0x7f62c4068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.536+0000 7f62c95b7700 1 -- 172.21.15.81:0/510730280 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40cc4c0 con 0x7f62c4157b90 2023-10-07T08:46:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.537+0000 7f62c95b7700 1 --2- 172.21.15.81:0/510730280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c4157b90 0x7f62c40cbcd0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f62c40682c0 tx=0x7f62bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc74b88ff4327c3f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.537+0000 7f62bb7fe700 1 -- 172.21.15.81:0/510730280 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00e070 con 0x7f62c4157b90 2023-10-07T08:46:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.537+0000 7f62bb7fe700 1 -- 172.21.15.81:0/510730280 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc00ba10 con 0x7f62c4157b90 2023-10-07T08:46:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.537+0000 7f62bb7fe700 1 -- 172.21.15.81:0/510730280 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0092e0 con 0x7f62c4157b90 2023-10-07T08:46:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.537+0000 7f62cb01a700 1 -- 172.21.15.81:0/510730280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c4157b90 msgr2=0x7f62c40cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.537+0000 7f62cb01a700 1 --2- 172.21.15.81:0/510730280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c4157b90 0x7f62c40cbcd0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f62c40682c0 tx=0x7f62bc009840 comp rx=0 tx=0).stop 2023-10-07T08:46:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.537+0000 7f62cb01a700 1 -- 172.21.15.81:0/510730280 shutdown_connections 2023-10-07T08:46:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.537+0000 7f62cb01a700 1 --2- 172.21.15.81:0/510730280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c4157b90 0x7f62c40cbcd0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.537+0000 7f62cb01a700 1 --2- 172.21.15.81:0/510730280 >> v2:172.21.15.89:3300/0 conn(0x7f62c4068f20 0x7f62c40cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.537+0000 7f62cb01a700 1 -- 172.21.15.81:0/510730280 >> 172.21.15.81:0/510730280 conn(0x7f62c40d0df0 msgr2=0x7f62c40d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.537+0000 7f62cb01a700 1 -- 172.21.15.81:0/510730280 shutdown_connections 2023-10-07T08:46:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.537+0000 7f62cb01a700 1 -- 172.21.15.81:0/510730280 wait complete. 2023-10-07T08:46:46.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.538+0000 7f62cb01a700 1 Processor -- start 2023-10-07T08:46:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.538+0000 7f62cb01a700 1 -- start start 2023-10-07T08:46:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.539+0000 7f62cb01a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c4068f20 0x7f62c40b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.539+0000 7f62cb01a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c41577c0 0x7f62c414fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.539+0000 7f62cb01a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c4157b90 0x7f62c406e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.539+0000 7f62cb01a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40b6340 con 0x7f62c4068f20 2023-10-07T08:46:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.539+0000 7f62cb01a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c41580c0 con 0x7f62c4157b90 2023-10-07T08:46:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.539+0000 7f62cb01a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c41583a0 con 0x7f62c41577c0 2023-10-07T08:46:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.539+0000 7f62c8db6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c4068f20 0x7f62c40b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.539+0000 7f62c8db6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c4068f20 0x7f62c40b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48504/0 (socket says 172.21.15.81:48504) 2023-10-07T08:46:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.539+0000 7f62c8db6700 1 -- 172.21.15.81:0/2091029816 learned_addr learned my addr 172.21.15.81:0/2091029816 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.539+0000 7f62c95b7700 1 --2- 172.21.15.81:0/2091029816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c4157b90 0x7f62c406e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.540+0000 7f62bbfff700 1 --2- 172.21.15.81:0/2091029816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c41577c0 0x7f62c414fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.540+0000 7f62c8db6700 1 -- 172.21.15.81:0/2091029816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c41577c0 msgr2=0x7f62c414fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.540+0000 7f62c8db6700 1 --2- 172.21.15.81:0/2091029816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c41577c0 0x7f62c414fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.540+0000 7f62c8db6700 1 -- 172.21.15.81:0/2091029816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c4157b90 msgr2=0x7f62c406e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.540+0000 7f62c8db6700 1 --2- 172.21.15.81:0/2091029816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c4157b90 0x7f62c406e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.540+0000 7f62c8db6700 1 -- 172.21.15.81:0/2091029816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc009ae0 con 0x7f62c4068f20 2023-10-07T08:46:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.540+0000 7f62c8db6700 1 --2- 172.21.15.81:0/2091029816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c4068f20 0x7f62c40b5aa0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f62c000c5d0 tx=0x7f62c0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.540+0000 7f62b8ff9700 1 -- 172.21.15.81:0/2091029816 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0011590 con 0x7f62c4068f20 2023-10-07T08:46:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.540+0000 7f62b8ff9700 1 -- 172.21.15.81:0/2091029816 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c0011710 con 0x7f62c4068f20 2023-10-07T08:46:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.540+0000 7f62cb01a700 1 -- 172.21.15.81:0/2091029816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c4158680 con 0x7f62c4068f20 2023-10-07T08:46:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.540+0000 7f62b8ff9700 1 -- 172.21.15.81:0/2091029816 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0011ad0 con 0x7f62c4068f20 2023-10-07T08:46:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.540+0000 7f62cb01a700 1 -- 172.21.15.81:0/2091029816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c40b5fe0 con 0x7f62c4068f20 2023-10-07T08:46:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.541+0000 7f62cb01a700 1 -- 172.21.15.81:0/2091029816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c4067a50 con 0x7f62c4068f20 2023-10-07T08:46:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.541+0000 7f62b8ff9700 1 -- 172.21.15.81:0/2091029816 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62c001c460 con 0x7f62c4068f20 2023-10-07T08:46:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.542+0000 7f62b8ff9700 1 --2- 172.21.15.81:0/2091029816 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f62b0066f30 0x7f62b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.542+0000 7f62b8ff9700 1 -- 172.21.15.81:0/2091029816 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f62c0084150 con 0x7f62c4068f20 2023-10-07T08:46:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.542+0000 7f62bbfff700 1 --2- 172.21.15.81:0/2091029816 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f62b0066f30 0x7f62b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.542+0000 7f62bbfff700 1 --2- 172.21.15.81:0/2091029816 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f62b0066f30 0x7f62b00693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f62c41553b0 tx=0x7f62b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:46.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.546+0000 7f62b8ff9700 1 -- 172.21.15.81:0/2091029816 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62c00515a0 con 0x7f62c4068f20 2023-10-07T08:46:46.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:46.728+0000 7f62cb01a700 1 -- 172.21.15.81:0/2091029816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f62c40cc7a0 con 0x7f62c4068f20 2023-10-07T08:46:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.408+0000 7f62b8ff9700 1 -- 172.21.15.81:0/2091029816 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) v1 ==== 170+0+0 (secure 0 0 0) 0x7f62c0054bc0 con 0x7f62c4068f20 2023-10-07T08:46:47.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.414+0000 7f62cb01a700 1 -- 172.21.15.81:0/2091029816 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f62b0066f30 msgr2=0x7f62b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:47.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.414+0000 7f62cb01a700 1 --2- 172.21.15.81:0/2091029816 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f62b0066f30 0x7f62b00693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f62c41553b0 tx=0x7f62b4008040 comp rx=0 tx=0).stop 2023-10-07T08:46:47.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.414+0000 7f62cb01a700 1 -- 172.21.15.81:0/2091029816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c4068f20 msgr2=0x7f62c40b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:47.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.414+0000 7f62cb01a700 1 --2- 172.21.15.81:0/2091029816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c4068f20 0x7f62c40b5aa0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f62c000c5d0 tx=0x7f62c0007f60 comp rx=0 tx=0).stop 2023-10-07T08:46:47.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.414+0000 7f62cb01a700 1 -- 172.21.15.81:0/2091029816 shutdown_connections 2023-10-07T08:46:47.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.414+0000 7f62cb01a700 1 --2- 172.21.15.81:0/2091029816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c4157b90 0x7f62c406e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:47.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.414+0000 7f62cb01a700 1 --2- 172.21.15.81:0/2091029816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c4068f20 0x7f62c40b5aa0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:47.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.414+0000 7f62cb01a700 1 --2- 172.21.15.81:0/2091029816 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f62b0066f30 0x7f62b00693e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:47.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.414+0000 7f62cb01a700 1 --2- 172.21.15.81:0/2091029816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c41577c0 0x7f62c414fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:47.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.414+0000 7f62cb01a700 1 -- 172.21.15.81:0/2091029816 >> 172.21.15.81:0/2091029816 conn(0x7f62c40d0df0 msgr2=0x7f62c40d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:47.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.414+0000 7f62cb01a700 1 -- 172.21.15.81:0/2091029816 shutdown_connections 2023-10-07T08:46:47.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.414+0000 7f62cb01a700 1 -- 172.21.15.81:0/2091029816 wait complete. 2023-10-07T08:46:47.416 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-07T08:46:47.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T08:46:47.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.546+0000 7ff955f91700 1 Processor -- start 2023-10-07T08:46:47.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.546+0000 7ff955f91700 1 -- start start 2023-10-07T08:46:47.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.547+0000 7ff955f91700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9501578d0 0x7ff9500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:47.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.547+0000 7ff955f91700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff95006d120 0x7ff95006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:47.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.547+0000 7ff955f91700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff95006dac0 con 0x7ff950157ca0 2023-10-07T08:46:47.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.547+0000 7ff955f91700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9500d07c0 con 0x7ff95006d120 2023-10-07T08:46:47.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.547+0000 7ff955f91700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9500cfbb0 con 0x7ff9501578d0 2023-10-07T08:46:47.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.547+0000 7ff94effd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff950157ca0 0x7ff95015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37334/0 (socket says 172.21.15.81:37334) 2023-10-07T08:46:47.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.547+0000 7ff94effd700 1 -- 172.21.15.81:0/1393280495 learned_addr learned my addr 172.21.15.81:0/1393280495 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:47.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.547+0000 7ff94e7fc700 1 -- 172.21.15.81:0/1393280495 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552251360 0 0) 0x7ff944001110 con 0x7ff950157ca0 2023-10-07T08:46:47.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.547+0000 7ff94f7fe700 1 --2- 172.21.15.81:0/1393280495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9501578d0 0x7ff9500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:47.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.547+0000 7ff94ffff700 1 --2- 172.21.15.81:0/1393280495 >> v2:172.21.15.89:3300/0 conn(0x7ff95006d120 0x7ff95006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:47.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.547+0000 7ff94e7fc700 1 -- 172.21.15.81:0/1393280495 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff938003570 con 0x7ff950157ca0 2023-10-07T08:46:47.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 -- 172.21.15.81:0/1393280495 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2914764422 0 0) 0x7ff938003570 con 0x7ff950157ca0 2023-10-07T08:46:47.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 -- 172.21.15.81:0/1393280495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9501578d0 msgr2=0x7ff9500cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:47.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 --2- 172.21.15.81:0/1393280495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9501578d0 0x7ff9500cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:47.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 -- 172.21.15.81:0/1393280495 >> v2:172.21.15.89:3300/0 conn(0x7ff95006d120 msgr2=0x7ff95006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:47.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 --2- 172.21.15.81:0/1393280495 >> v2:172.21.15.89:3300/0 conn(0x7ff95006d120 0x7ff95006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:47.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 -- 172.21.15.81:0/1393280495 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9500cfe90 con 0x7ff950157ca0 2023-10-07T08:46:47.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 -- 172.21.15.81:0/1393280495 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7ff944001600 con 0x7ff950157ca0 2023-10-07T08:46:47.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94f7fe700 1 --2- 172.21.15.81:0/1393280495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9501578d0 0x7ff9500cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 -- 172.21.15.81:0/1393280495 >> v1:172.21.15.81:6789/0 conn(0x7ff950157ca0 legacy=0x7ff95015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 --2- 172.21.15.81:0/1393280495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff938003a60 0x7ff938003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 --2- 172.21.15.81:0/1393280495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9501578d0 0x7ff938004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 --2- 172.21.15.81:0/1393280495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff938004d50 0x7ff9380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 -- 172.21.15.81:0/1393280495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9500d07c0 con 0x7ff938004d50 2023-10-07T08:46:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 -- 172.21.15.81:0/1393280495 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9500cfbb0 con 0x7ff938003a60 2023-10-07T08:46:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 -- 172.21.15.81:0/1393280495 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93800bab0 con 0x7ff9501578d0 2023-10-07T08:46:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94ffff700 1 --2- 172.21.15.81:0/1393280495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff938004d50 0x7ff9380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94f7fe700 1 --2- 172.21.15.81:0/1393280495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff938003a60 0x7ff938003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94effd700 1 --2- 172.21.15.81:0/1393280495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9501578d0 0x7ff938004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94ffff700 1 -- 172.21.15.81:0/1393280495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9501578d0 msgr2=0x7ff938004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94ffff700 1 --2- 172.21.15.81:0/1393280495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9501578d0 0x7ff938004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94ffff700 1 -- 172.21.15.81:0/1393280495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff938003a60 msgr2=0x7ff938003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94ffff700 1 --2- 172.21.15.81:0/1393280495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff938003a60 0x7ff938003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94ffff700 1 -- 172.21.15.81:0/1393280495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff938003570 con 0x7ff938004d50 2023-10-07T08:46:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94ffff700 1 --2- 172.21.15.81:0/1393280495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff938004d50 0x7ff9380051c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff948009c00 tx=0x7ff9480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1760c358c5ef5c5c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 -- 172.21.15.81:0/1393280495 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94800e710 con 0x7ff938004d50 2023-10-07T08:46:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 -- 172.21.15.81:0/1393280495 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94800e870 con 0x7ff938004d50 2023-10-07T08:46:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.548+0000 7ff94e7fc700 1 -- 172.21.15.81:0/1393280495 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94800ec30 con 0x7ff938004d50 2023-10-07T08:46:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.549+0000 7ff955f91700 1 -- 172.21.15.81:0/1393280495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff938004d50 msgr2=0x7ff9380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.549+0000 7ff955f91700 1 --2- 172.21.15.81:0/1393280495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff938004d50 0x7ff9380051c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff948009c00 tx=0x7ff9480091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.549+0000 7ff94ffff700 1 -- 172.21.15.81:0/1393280495 reap_dead start 2023-10-07T08:46:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.549+0000 7ff955f91700 1 -- 172.21.15.81:0/1393280495 shutdown_connections 2023-10-07T08:46:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.549+0000 7ff955f91700 1 -- 172.21.15.81:0/1393280495 >> 172.21.15.81:0/1393280495 conn(0x7ff95006bb90 msgr2=0x7ff95006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.549+0000 7ff955f91700 1 -- 172.21.15.81:0/1393280495 shutdown_connections 2023-10-07T08:46:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.549+0000 7ff955f91700 1 -- 172.21.15.81:0/1393280495 wait complete. 2023-10-07T08:46:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.550+0000 7ff955f91700 1 Processor -- start 2023-10-07T08:46:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.550+0000 7ff955f91700 1 -- start start 2023-10-07T08:46:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.551+0000 7ff955f91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9500b51e0 0x7ff9500c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.551+0000 7ff955f91700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9500c9440 0x7ff9500b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.551+0000 7ff955f91700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9500b5af0 0x7ff9500c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.551+0000 7ff955f91700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9500c98b0 con 0x7ff9500b51e0 2023-10-07T08:46:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.551+0000 7ff955f91700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9500caf20 con 0x7ff9500b5af0 2023-10-07T08:46:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.551+0000 7ff955f91700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9500c6a40 con 0x7ff9500c9440 2023-10-07T08:46:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.551+0000 7ff94f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9500b51e0 0x7ff9500c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.551+0000 7ff94f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9500b51e0 0x7ff9500c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48520/0 (socket says 172.21.15.81:48520) 2023-10-07T08:46:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.551+0000 7ff94f7fe700 1 -- 172.21.15.81:0/2005185534 learned_addr learned my addr 172.21.15.81:0/2005185534 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.551+0000 7ff94ffff700 1 --2- 172.21.15.81:0/2005185534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9500b5af0 0x7ff9500c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.551+0000 7ff94f7fe700 1 -- 172.21.15.81:0/2005185534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9500c9440 msgr2=0x7ff9500b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.551+0000 7ff94effd700 1 --2- 172.21.15.81:0/2005185534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9500c9440 0x7ff9500b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.551+0000 7ff94f7fe700 1 --2- 172.21.15.81:0/2005185534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9500c9440 0x7ff9500b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.551+0000 7ff94f7fe700 1 -- 172.21.15.81:0/2005185534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9500b5af0 msgr2=0x7ff9500c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.551+0000 7ff94f7fe700 1 --2- 172.21.15.81:0/2005185534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9500b5af0 0x7ff9500c7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.551+0000 7ff94f7fe700 1 -- 172.21.15.81:0/2005185534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9500c6d20 con 0x7ff9500b51e0 2023-10-07T08:46:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.552+0000 7ff94f7fe700 1 --2- 172.21.15.81:0/2005185534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9500b51e0 0x7ff9500c8f00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff940007230 tx=0x7ff9400097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.552+0000 7ff9377fe700 1 -- 172.21.15.81:0/2005185534 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940010ea0 con 0x7ff9500b51e0 2023-10-07T08:46:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.552+0000 7ff9377fe700 1 -- 172.21.15.81:0/2005185534 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff940017430 con 0x7ff9500b51e0 2023-10-07T08:46:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.552+0000 7ff9377fe700 1 -- 172.21.15.81:0/2005185534 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9400177d0 con 0x7ff9500b51e0 2023-10-07T08:46:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.552+0000 7ff955f91700 1 -- 172.21.15.81:0/2005185534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9500c7000 con 0x7ff9500b51e0 2023-10-07T08:46:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.552+0000 7ff955f91700 1 -- 172.21.15.81:0/2005185534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9500c75c0 con 0x7ff9500b51e0 2023-10-07T08:46:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.553+0000 7ff955f91700 1 -- 172.21.15.81:0/2005185534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff950067ac0 con 0x7ff9500b51e0 2023-10-07T08:46:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.553+0000 7ff9377fe700 1 -- 172.21.15.81:0/2005185534 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff940017b40 con 0x7ff9500b51e0 2023-10-07T08:46:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.553+0000 7ff9377fe700 1 --2- 172.21.15.81:0/2005185534 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff93c066f60 0x7ff93c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.553+0000 7ff9377fe700 1 -- 172.21.15.81:0/2005185534 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5605+0+0 (secure 0 0 0) 0x7ff940085450 con 0x7ff9500b51e0 2023-10-07T08:46:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.553+0000 7ff94effd700 1 --2- 172.21.15.81:0/2005185534 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff93c066f60 0x7ff93c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.554+0000 7ff94effd700 1 --2- 172.21.15.81:0/2005185534 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff93c066f60 0x7ff93c069410 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff944007b60 tx=0x7ff944009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.558+0000 7ff9377fe700 1 -- 172.21.15.81:0/2005185534 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff940052720 con 0x7ff9500b51e0 2023-10-07T08:46:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:47.780+0000 7ff955f91700 1 -- 172.21.15.81:0/2005185534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff9500d0170 con 0x7ff9500b51e0 2023-10-07T08:46:48.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.416+0000 7ff9377fe700 1 -- 172.21.15.81:0/2005185534 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff940055d40 con 0x7ff9500b51e0 2023-10-07T08:46:48.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.420+0000 7ff955f91700 1 -- 172.21.15.81:0/2005185534 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff93c066f60 msgr2=0x7ff93c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:48.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.420+0000 7ff955f91700 1 --2- 172.21.15.81:0/2005185534 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff93c066f60 0x7ff93c069410 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff944007b60 tx=0x7ff944009040 comp rx=0 tx=0).stop 2023-10-07T08:46:48.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.420+0000 7ff955f91700 1 -- 172.21.15.81:0/2005185534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9500b51e0 msgr2=0x7ff9500c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:48.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.420+0000 7ff955f91700 1 --2- 172.21.15.81:0/2005185534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9500b51e0 0x7ff9500c8f00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff940007230 tx=0x7ff9400097d0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.422+0000 7ff955f91700 1 -- 172.21.15.81:0/2005185534 shutdown_connections 2023-10-07T08:46:48.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.422+0000 7ff955f91700 1 --2- 172.21.15.81:0/2005185534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9500b5af0 0x7ff9500c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.422+0000 7ff955f91700 1 --2- 172.21.15.81:0/2005185534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9500b51e0 0x7ff9500c8f00 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.422+0000 7ff955f91700 1 --2- 172.21.15.81:0/2005185534 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff93c066f60 0x7ff93c069410 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.422+0000 7ff955f91700 1 --2- 172.21.15.81:0/2005185534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9500c9440 0x7ff9500b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.422+0000 7ff955f91700 1 -- 172.21.15.81:0/2005185534 >> 172.21.15.81:0/2005185534 conn(0x7ff95006bb90 msgr2=0x7ff9500699b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:48.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.422+0000 7ff955f91700 1 -- 172.21.15.81:0/2005185534 shutdown_connections 2023-10-07T08:46:48.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.422+0000 7ff955f91700 1 -- 172.21.15.81:0/2005185534 wait complete. 2023-10-07T08:46:48.431 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 10 and data pool 11 2023-10-07T08:46:48.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:46:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.549+0000 7f3df63e5700 1 Processor -- start 2023-10-07T08:46:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.549+0000 7f3df63e5700 1 -- start start 2023-10-07T08:46:48.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.550+0000 7f3df63e5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df0159b40 0x7f3df00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:48.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.550+0000 7f3df63e5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3df0068e90 0x7f3df00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:48.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.550+0000 7f3df63e5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df00cee10 con 0x7f3df0159f10 2023-10-07T08:46:48.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.550+0000 7f3df63e5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df00cd040 con 0x7f3df0068e90 2023-10-07T08:46:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.550+0000 7f3df63e5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00cd320 con 0x7f3df0159b40 2023-10-07T08:46:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.550+0000 7f3df4be2700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3df0159f10 0x7f3df0068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37344/0 (socket says 172.21.15.81:37344) 2023-10-07T08:46:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.550+0000 7f3df4be2700 1 -- 172.21.15.81:0/1539083135 learned_addr learned my addr 172.21.15.81:0/1539083135 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.550+0000 7f3df53e3700 1 --2- 172.21.15.81:0/1539083135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df0159b40 0x7f3df00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.550+0000 7f3df5be4700 1 --2- 172.21.15.81:0/1539083135 >> v2:172.21.15.89:3300/0 conn(0x7f3df0068e90 0x7f3df00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.550+0000 7f3deffff700 1 -- 172.21.15.81:0/1539083135 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989592296 0 0) 0x7f3df00cee10 con 0x7f3df0159f10 2023-10-07T08:46:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.550+0000 7f3deffff700 1 -- 172.21.15.81:0/1539083135 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dd8003570 con 0x7f3df0159f10 2023-10-07T08:46:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 -- 172.21.15.81:0/1539083135 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4048400762 0 0) 0x7f3dd8003570 con 0x7f3df0159f10 2023-10-07T08:46:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 -- 172.21.15.81:0/1539083135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df0159b40 msgr2=0x7f3df00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 --2- 172.21.15.81:0/1539083135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df0159b40 0x7f3df00cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 -- 172.21.15.81:0/1539083135 >> v2:172.21.15.89:3300/0 conn(0x7f3df0068e90 msgr2=0x7f3df00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:48.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 --2- 172.21.15.81:0/1539083135 >> v2:172.21.15.89:3300/0 conn(0x7f3df0068e90 0x7f3df00cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 -- 172.21.15.81:0/1539083135 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df00ce7c0 con 0x7f3df0159f10 2023-10-07T08:46:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 -- 172.21.15.81:0/1539083135 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f3de4001470 con 0x7f3df0159f10 2023-10-07T08:46:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3df5be4700 1 --2- 172.21.15.81:0/1539083135 >> v2:172.21.15.89:3300/0 conn(0x7f3df0068e90 0x7f3df00cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:46:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 -- 172.21.15.81:0/1539083135 >> v1:172.21.15.81:6789/0 conn(0x7f3df0159f10 legacy=0x7f3df0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 --2- 172.21.15.81:0/1539083135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8003a60 0x7f3dd8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 --2- 172.21.15.81:0/1539083135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dd8004810 0x7f3dd8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 --2- 172.21.15.81:0/1539083135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df0159b40 0x7f3dd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 -- 172.21.15.81:0/1539083135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00cd040 con 0x7f3dd8003a60 2023-10-07T08:46:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 -- 172.21.15.81:0/1539083135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00cd320 con 0x7f3dd8004810 2023-10-07T08:46:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 -- 172.21.15.81:0/1539083135 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd800ba60 con 0x7f3df0159b40 2023-10-07T08:46:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3df53e3700 1 --2- 172.21.15.81:0/1539083135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8003a60 0x7f3dd8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3df4be2700 1 --2- 172.21.15.81:0/1539083135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dd8004810 0x7f3dd8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3df5be4700 1 --2- 172.21.15.81:0/1539083135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df0159b40 0x7f3dd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3df53e3700 1 -- 172.21.15.81:0/1539083135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df0159b40 msgr2=0x7f3dd80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3df53e3700 1 --2- 172.21.15.81:0/1539083135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df0159b40 0x7f3dd80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3df53e3700 1 -- 172.21.15.81:0/1539083135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dd8004810 msgr2=0x7f3dd8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3df53e3700 1 --2- 172.21.15.81:0/1539083135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dd8004810 0x7f3dd8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3df53e3700 1 -- 172.21.15.81:0/1539083135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd8003570 con 0x7f3dd8003a60 2023-10-07T08:46:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3df5be4700 1 --2- 172.21.15.81:0/1539083135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df0159b40 0x7f3dd80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3df53e3700 1 --2- 172.21.15.81:0/1539083135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8003a60 0x7f3dd8003e70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3de800e240 tx=0x7f3de800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250cd457c65ed118 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 -- 172.21.15.81:0/1539083135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de800eaf0 con 0x7f3dd8003a60 2023-10-07T08:46:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 -- 172.21.15.81:0/1539083135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de800f040 con 0x7f3dd8003a60 2023-10-07T08:46:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.551+0000 7f3deffff700 1 -- 172.21.15.81:0/1539083135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de800eea0 con 0x7f3dd8003a60 2023-10-07T08:46:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.552+0000 7f3df63e5700 1 -- 172.21.15.81:0/1539083135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8003a60 msgr2=0x7f3dd8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.552+0000 7f3df63e5700 1 --2- 172.21.15.81:0/1539083135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8003a60 0x7f3dd8003e70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3de800e240 tx=0x7f3de800b040 comp rx=0 tx=0).stop 2023-10-07T08:46:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.552+0000 7f3df5be4700 1 -- 172.21.15.81:0/1539083135 reap_dead start 2023-10-07T08:46:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.552+0000 7f3df63e5700 1 -- 172.21.15.81:0/1539083135 shutdown_connections 2023-10-07T08:46:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.552+0000 7f3df63e5700 1 -- 172.21.15.81:0/1539083135 >> 172.21.15.81:0/1539083135 conn(0x7f3df00cd660 msgr2=0x7f3df00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.552+0000 7f3df63e5700 1 -- 172.21.15.81:0/1539083135 shutdown_connections 2023-10-07T08:46:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.552+0000 7f3df63e5700 1 -- 172.21.15.81:0/1539083135 wait complete. 2023-10-07T08:46:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.553+0000 7f3df63e5700 1 Processor -- start 2023-10-07T08:46:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.553+0000 7f3df63e5700 1 -- start start 2023-10-07T08:46:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df63e5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8003a60 0x7f3df016ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df63e5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df01558b0 0x7f3df0155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df63e5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df00c8c70 0x7f3df00c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df63e5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00ca570 con 0x7f3dd8003a60 2023-10-07T08:46:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df63e5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00c9960 con 0x7f3df01558b0 2023-10-07T08:46:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df63e5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00c9c40 con 0x7f3df00c8c70 2023-10-07T08:46:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df53e3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8003a60 0x7f3df016ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df53e3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8003a60 0x7f3df016ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48526/0 (socket says 172.21.15.81:48526) 2023-10-07T08:46:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df53e3700 1 -- 172.21.15.81:0/2317029257 learned_addr learned my addr 172.21.15.81:0/2317029257 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df4be2700 1 --2- 172.21.15.81:0/2317029257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df01558b0 0x7f3df0155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df5be4700 1 --2- 172.21.15.81:0/2317029257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df00c8c70 0x7f3df00c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df53e3700 1 -- 172.21.15.81:0/2317029257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df00c8c70 msgr2=0x7f3df00c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df53e3700 1 --2- 172.21.15.81:0/2317029257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df00c8c70 0x7f3df00c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df53e3700 1 -- 172.21.15.81:0/2317029257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df01558b0 msgr2=0x7f3df0155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df53e3700 1 --2- 172.21.15.81:0/2317029257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df01558b0 0x7f3df0155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df53e3700 1 -- 172.21.15.81:0/2317029257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df00c9f20 con 0x7f3dd8003a60 2023-10-07T08:46:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.554+0000 7f3df5be4700 1 --2- 172.21.15.81:0/2317029257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df00c8c70 0x7f3df00c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.555+0000 7f3df53e3700 1 --2- 172.21.15.81:0/2317029257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8003a60 0x7f3df016ada0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3de800e830 tx=0x7f3de801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.555+0000 7f3ded7fa700 1 -- 172.21.15.81:0/2317029257 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de801d420 con 0x7f3dd8003a60 2023-10-07T08:46:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.555+0000 7f3ded7fa700 1 -- 172.21.15.81:0/2317029257 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de801d5a0 con 0x7f3dd8003a60 2023-10-07T08:46:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.555+0000 7f3ded7fa700 1 -- 172.21.15.81:0/2317029257 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de801d960 con 0x7f3dd8003a60 2023-10-07T08:46:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.555+0000 7f3df63e5700 1 -- 172.21.15.81:0/2317029257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df00ca200 con 0x7f3dd8003a60 2023-10-07T08:46:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.555+0000 7f3df63e5700 1 -- 172.21.15.81:0/2317029257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df00c9630 con 0x7f3dd8003a60 2023-10-07T08:46:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.556+0000 7f3df63e5700 1 -- 172.21.15.81:0/2317029257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df01578b0 con 0x7f3dd8003a60 2023-10-07T08:46:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.556+0000 7f3ded7fa700 1 -- 172.21.15.81:0/2317029257 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3de8003040 con 0x7f3dd8003a60 2023-10-07T08:46:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.556+0000 7f3ded7fa700 1 --2- 172.21.15.81:0/2317029257 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3ddc066f30 0x7f3ddc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.556+0000 7f3ded7fa700 1 -- 172.21.15.81:0/2317029257 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3de8086510 con 0x7f3dd8003a60 2023-10-07T08:46:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.556+0000 7f3df4be2700 1 --2- 172.21.15.81:0/2317029257 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3ddc066f30 0x7f3ddc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.557+0000 7f3df4be2700 1 --2- 172.21.15.81:0/2317029257 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3ddc066f30 0x7f3ddc0693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3de4001d20 tx=0x7f3de4001e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.561+0000 7f3ded7fa700 1 -- 172.21.15.81:0/2317029257 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3de8053780 con 0x7f3dd8003a60 2023-10-07T08:46:48.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.743+0000 7f3df63e5700 1 -- 172.21.15.81:0/2317029257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3df00cb890 con 0x7f3dd8003a60 2023-10-07T08:46:48.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.744+0000 7f3ded7fa700 1 -- 172.21.15.81:0/2317029257 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+15318 (secure 0 0 0) 0x7f3de8056da0 con 0x7f3dd8003a60 2023-10-07T08:46:48.746 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:48.746 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":84,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:46:47.782470+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:46:45.595534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-07T08:46:46.747683+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:46:48.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.746+0000 7f3df63e5700 1 -- 172.21.15.81:0/2317029257 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3ddc066f30 msgr2=0x7f3ddc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:48.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.746+0000 7f3df63e5700 1 --2- 172.21.15.81:0/2317029257 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3ddc066f30 0x7f3ddc0693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3de4001d20 tx=0x7f3de4001e90 comp rx=0 tx=0).stop 2023-10-07T08:46:48.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.746+0000 7f3df63e5700 1 -- 172.21.15.81:0/2317029257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8003a60 msgr2=0x7f3df016ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:48.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.746+0000 7f3df63e5700 1 --2- 172.21.15.81:0/2317029257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8003a60 0x7f3df016ada0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3de800e830 tx=0x7f3de801a000 comp rx=0 tx=0).stop 2023-10-07T08:46:48.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.746+0000 7f3df63e5700 1 -- 172.21.15.81:0/2317029257 shutdown_connections 2023-10-07T08:46:48.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.746+0000 7f3df63e5700 1 --2- 172.21.15.81:0/2317029257 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3ddc066f30 0x7f3ddc0693e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.746+0000 7f3df63e5700 1 --2- 172.21.15.81:0/2317029257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df00c8c70 0x7f3df00c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.746+0000 7f3df63e5700 1 --2- 172.21.15.81:0/2317029257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd8003a60 0x7f3df016ada0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.746+0000 7f3df63e5700 1 --2- 172.21.15.81:0/2317029257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df01558b0 0x7f3df0155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.746+0000 7f3df63e5700 1 -- 172.21.15.81:0/2317029257 >> 172.21.15.81:0/2317029257 conn(0x7f3df00cd660 msgr2=0x7f3df006d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:48.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.746+0000 7f3df63e5700 1 -- 172.21.15.81:0/2317029257 shutdown_connections 2023-10-07T08:46:48.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.746+0000 7f3df63e5700 1 -- 172.21.15.81:0/2317029257 wait complete. 2023-10-07T08:46:48.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:46:48.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.872+0000 7f16dbb9d700 1 Processor -- start 2023-10-07T08:46:48.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.872+0000 7f16dbb9d700 1 -- start start 2023-10-07T08:46:48.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.873+0000 7f16dbb9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16d406dd60 0x7f16d40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:48.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.873+0000 7f16dbb9d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d40b0ca0 con 0x7f16d40cf240 2023-10-07T08:46:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.873+0000 7f16dbb9d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d40b00d0 con 0x7f16d415a2a0 2023-10-07T08:46:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.873+0000 7f16dbb9d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d406ea90 con 0x7f16d406dd60 2023-10-07T08:46:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.873+0000 7f16d9138700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f16d40cf240 0x7f16d406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37358/0 (socket says 172.21.15.81:37358) 2023-10-07T08:46:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.873+0000 7f16d9138700 1 -- 172.21.15.81:0/2326567902 learned_addr learned my addr 172.21.15.81:0/2326567902 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.874+0000 7f16da13a700 1 --2- 172.21.15.81:0/2326567902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16d406dd60 0x7f16d40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.874+0000 7f16d8937700 1 -- 172.21.15.81:0/2326567902 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164636614 0 0) 0x7f16d40b0ca0 con 0x7f16d40cf240 2023-10-07T08:46:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.874+0000 7f16d8937700 1 -- 172.21.15.81:0/2326567902 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16c0003570 con 0x7f16d40cf240 2023-10-07T08:46:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.874+0000 7f16d8937700 1 -- 172.21.15.81:0/2326567902 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418538435 0 0) 0x7f16d40b00d0 con 0x7f16d415a2a0 2023-10-07T08:46:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.874+0000 7f16d8937700 1 -- 172.21.15.81:0/2326567902 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16d40b0ca0 con 0x7f16d415a2a0 2023-10-07T08:46:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.874+0000 7f16d8937700 1 -- 172.21.15.81:0/2326567902 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2441500376 0 0) 0x7f16c0003570 con 0x7f16d40cf240 2023-10-07T08:46:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.874+0000 7f16da13a700 1 -- 172.21.15.81:0/2326567902 >> v1:172.21.15.89:6789/0 conn(0x7f16d415a2a0 legacy=0x7f16d40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:48.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.874+0000 7f16da13a700 1 -- 172.21.15.81:0/2326567902 >> v1:172.21.15.81:6789/0 conn(0x7f16d40cf240 legacy=0x7f16d406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:48.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.874+0000 7f16da13a700 1 -- 172.21.15.81:0/2326567902 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d40b0370 con 0x7f16d406dd60 2023-10-07T08:46:48.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.874+0000 7f16da13a700 1 --2- 172.21.15.81:0/2326567902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16d406dd60 0x7f16d40b1130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009910 tx=0x7f16cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc6dab33d652086 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:48.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.874+0000 7f16d8937700 1 -- 172.21.15.81:0/2326567902 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c4001470 con 0x7f16d406dd60 2023-10-07T08:46:48.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.874+0000 7f16d8937700 1 -- 172.21.15.81:0/2326567902 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc011420 con 0x7f16d406dd60 2023-10-07T08:46:48.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.874+0000 7f16d8937700 1 -- 172.21.15.81:0/2326567902 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc0117c0 con 0x7f16d406dd60 2023-10-07T08:46:48.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.875+0000 7f16dbb9d700 1 -- 172.21.15.81:0/2326567902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16d406dd60 msgr2=0x7f16d40b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:48.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.875+0000 7f16dbb9d700 1 --2- 172.21.15.81:0/2326567902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16d406dd60 0x7f16d40b1130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009910 tx=0x7f16cc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.875+0000 7f16dbb9d700 1 -- 172.21.15.81:0/2326567902 shutdown_connections 2023-10-07T08:46:48.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.875+0000 7f16dbb9d700 1 --2- 172.21.15.81:0/2326567902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16d406dd60 0x7f16d40b1130 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.875+0000 7f16dbb9d700 1 -- 172.21.15.81:0/2326567902 >> 172.21.15.81:0/2326567902 conn(0x7f16d4067640 msgr2=0x7f16d4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:48.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.875+0000 7f16dbb9d700 1 -- 172.21.15.81:0/2326567902 shutdown_connections 2023-10-07T08:46:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.875+0000 7f16dbb9d700 1 -- 172.21.15.81:0/2326567902 wait complete. 2023-10-07T08:46:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.876+0000 7f16dbb9d700 1 Processor -- start 2023-10-07T08:46:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.876+0000 7f16dbb9d700 1 -- start start 2023-10-07T08:46:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16dbb9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16d406dd60 0x7f16d4147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16dbb9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16d40cf240 0x7f16d40b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16dbb9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d415a2a0 0x7f16d4158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16dbb9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d4147f40 con 0x7f16d415a2a0 2023-10-07T08:46:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16dbb9d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d40b46b0 con 0x7f16d406dd60 2023-10-07T08:46:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16dbb9d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d416a2a0 con 0x7f16d40cf240 2023-10-07T08:46:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16da13a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d415a2a0 0x7f16d4158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16da13a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d415a2a0 0x7f16d4158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48542/0 (socket says 172.21.15.81:48542) 2023-10-07T08:46:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16da13a700 1 -- 172.21.15.81:0/1954414640 learned_addr learned my addr 172.21.15.81:0/1954414640 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16d9939700 1 --2- 172.21.15.81:0/1954414640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16d406dd60 0x7f16d4147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16d9138700 1 --2- 172.21.15.81:0/1954414640 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16d40cf240 0x7f16d40b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16da13a700 1 -- 172.21.15.81:0/1954414640 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16d40cf240 msgr2=0x7f16d40b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16da13a700 1 --2- 172.21.15.81:0/1954414640 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16d40cf240 0x7f16d40b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16da13a700 1 -- 172.21.15.81:0/1954414640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16d406dd60 msgr2=0x7f16d4147a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16da13a700 1 --2- 172.21.15.81:0/1954414640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16d406dd60 0x7f16d4147a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16da13a700 1 -- 172.21.15.81:0/1954414640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc009420 con 0x7f16d415a2a0 2023-10-07T08:46:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16da13a700 1 --2- 172.21.15.81:0/1954414640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d415a2a0 0x7f16d4158c60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009860 tx=0x7f16cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16c9ffb700 1 -- 172.21.15.81:0/1954414640 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc01cc90 con 0x7f16d415a2a0 2023-10-07T08:46:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16c9ffb700 1 -- 172.21.15.81:0/1954414640 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc01ce10 con 0x7f16d415a2a0 2023-10-07T08:46:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16dbb9d700 1 -- 172.21.15.81:0/1954414640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d416a580 con 0x7f16d415a2a0 2023-10-07T08:46:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.877+0000 7f16c9ffb700 1 -- 172.21.15.81:0/1954414640 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc01a6a0 con 0x7f16d415a2a0 2023-10-07T08:46:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.878+0000 7f16dbb9d700 1 -- 172.21.15.81:0/1954414640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d4153e30 con 0x7f16d415a2a0 2023-10-07T08:46:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.879+0000 7f16dbb9d700 1 -- 172.21.15.81:0/1954414640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d416aa80 con 0x7f16d415a2a0 2023-10-07T08:46:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.879+0000 7f16c9ffb700 1 -- 172.21.15.81:0/1954414640 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16cc01aad0 con 0x7f16d415a2a0 2023-10-07T08:46:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.879+0000 7f16c9ffb700 1 --2- 172.21.15.81:0/1954414640 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f16b8066f30 0x7f16b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.879+0000 7f16c9ffb700 1 -- 172.21.15.81:0/1954414640 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f16cc0863c0 con 0x7f16d415a2a0 2023-10-07T08:46:48.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.879+0000 7f16d9939700 1 --2- 172.21.15.81:0/1954414640 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f16b8066f30 0x7f16b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:48.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.880+0000 7f16d9939700 1 --2- 172.21.15.81:0/1954414640 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f16b8066f30 0x7f16b80693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f16d00040a0 tx=0x7f16d0007f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:48.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:48.884+0000 7f16c9ffb700 1 -- 172.21.15.81:0/1954414640 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16cc053630 con 0x7f16d415a2a0 2023-10-07T08:46:49.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.066+0000 7f16dbb9d700 1 -- 172.21.15.81:0/1954414640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16d404bb80 con 0x7f16d415a2a0 2023-10-07T08:46:49.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.067+0000 7f16c9ffb700 1 -- 172.21.15.81:0/1954414640 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+15318 (secure 0 0 0) 0x7f16cc056c50 con 0x7f16d415a2a0 2023-10-07T08:46:49.068 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:49.069 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":84,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:46:47.782470+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:46:45.595534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-07T08:46:46.747683+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:46:49.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.069+0000 7f16dbb9d700 1 -- 172.21.15.81:0/1954414640 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f16b8066f30 msgr2=0x7f16b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:49.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.069+0000 7f16dbb9d700 1 --2- 172.21.15.81:0/1954414640 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f16b8066f30 0x7f16b80693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f16d00040a0 tx=0x7f16d0007f90 comp rx=0 tx=0).stop 2023-10-07T08:46:49.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.069+0000 7f16dbb9d700 1 -- 172.21.15.81:0/1954414640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d415a2a0 msgr2=0x7f16d4158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:49.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.069+0000 7f16dbb9d700 1 --2- 172.21.15.81:0/1954414640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d415a2a0 0x7f16d4158c60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009860 tx=0x7f16cc016000 comp rx=0 tx=0).stop 2023-10-07T08:46:49.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.069+0000 7f16dbb9d700 1 -- 172.21.15.81:0/1954414640 shutdown_connections 2023-10-07T08:46:49.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.069+0000 7f16dbb9d700 1 --2- 172.21.15.81:0/1954414640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16d415a2a0 0x7f16d4158c60 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:49.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.069+0000 7f16dbb9d700 1 --2- 172.21.15.81:0/1954414640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16d406dd60 0x7f16d4147a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:49.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.069+0000 7f16dbb9d700 1 --2- 172.21.15.81:0/1954414640 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f16b8066f30 0x7f16b80693e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:49.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.069+0000 7f16dbb9d700 1 --2- 172.21.15.81:0/1954414640 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16d40cf240 0x7f16d40b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:49.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.069+0000 7f16dbb9d700 1 -- 172.21.15.81:0/1954414640 >> 172.21.15.81:0/1954414640 conn(0x7f16d4067640 msgr2=0x7f16d40ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:49.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.069+0000 7f16dbb9d700 1 -- 172.21.15.81:0/1954414640 shutdown_connections 2023-10-07T08:46:49.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.069+0000 7f16dbb9d700 1 -- 172.21.15.81:0/1954414640 wait complete. 2023-10-07T08:46:49.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T08:46:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.198+0000 7f4c21c0a700 1 Processor -- start 2023-10-07T08:46:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.198+0000 7f4c21c0a700 1 -- start start 2023-10-07T08:46:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.199+0000 7f4c21c0a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4c1c1578d0 0x7f4c1c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.199+0000 7f4c21c0a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c0d07c0 con 0x7f4c1c06d120 2023-10-07T08:46:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.199+0000 7f4c21c0a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c0cfbb0 con 0x7f4c1c157ca0 2023-10-07T08:46:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.199+0000 7f4c21c0a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c0cfe90 con 0x7f4c1c1578d0 2023-10-07T08:46:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.199+0000 7f4c1bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4c1c06d120 0x7f4c1c06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37362/0 (socket says 172.21.15.81:37362) 2023-10-07T08:46:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.199+0000 7f4c1bfff700 1 -- 172.21.15.81:0/2258810291 learned_addr learned my addr 172.21.15.81:0/2258810291 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.199+0000 7f4c1b7fe700 1 --2- 172.21.15.81:0/2258810291 >> v2:172.21.15.89:3300/0 conn(0x7f4c1c1578d0 0x7f4c1c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.200+0000 7f4c1affd700 1 -- 172.21.15.81:0/2258810291 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595980188 0 0) 0x7f4c1c0d07c0 con 0x7f4c1c06d120 2023-10-07T08:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.200+0000 7f4c1affd700 1 -- 172.21.15.81:0/2258810291 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c08003570 con 0x7f4c1c06d120 2023-10-07T08:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.200+0000 7f4c1affd700 1 -- 172.21.15.81:0/2258810291 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490125643 0 0) 0x7f4c1c0cfbb0 con 0x7f4c1c157ca0 2023-10-07T08:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.200+0000 7f4c1affd700 1 -- 172.21.15.81:0/2258810291 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c1c0d07c0 con 0x7f4c1c157ca0 2023-10-07T08:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.200+0000 7f4c1b7fe700 1 -- 172.21.15.81:0/2258810291 >> v1:172.21.15.89:6789/0 conn(0x7f4c1c157ca0 legacy=0x7f4c1c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.200+0000 7f4c1b7fe700 1 -- 172.21.15.81:0/2258810291 >> v1:172.21.15.81:6789/0 conn(0x7f4c1c06d120 legacy=0x7f4c1c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.200+0000 7f4c1b7fe700 1 -- 172.21.15.81:0/2258810291 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0d0170 con 0x7f4c1c1578d0 2023-10-07T08:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.200+0000 7f4c1b7fe700 1 --2- 172.21.15.81:0/2258810291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c1c1578d0 0x7f4c1c0cf4f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0098e0 tx=0x7f4c0c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7eacd6b51013403 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.200+0000 7f4c1affd700 1 -- 172.21.15.81:0/2258810291 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c011630 con 0x7f4c1c1578d0 2023-10-07T08:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.200+0000 7f4c1affd700 1 -- 172.21.15.81:0/2258810291 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c011790 con 0x7f4c1c1578d0 2023-10-07T08:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.200+0000 7f4c1affd700 1 -- 172.21.15.81:0/2258810291 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c011b30 con 0x7f4c1c1578d0 2023-10-07T08:46:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.200+0000 7f4c21c0a700 1 -- 172.21.15.81:0/2258810291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c1c1578d0 msgr2=0x7f4c1c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.200+0000 7f4c21c0a700 1 --2- 172.21.15.81:0/2258810291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c1c1578d0 0x7f4c1c0cf4f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0098e0 tx=0x7f4c0c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.201+0000 7f4c21c0a700 1 -- 172.21.15.81:0/2258810291 shutdown_connections 2023-10-07T08:46:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.201+0000 7f4c21c0a700 1 --2- 172.21.15.81:0/2258810291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c1c1578d0 0x7f4c1c0cf4f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.201+0000 7f4c21c0a700 1 -- 172.21.15.81:0/2258810291 >> 172.21.15.81:0/2258810291 conn(0x7f4c1c06bb90 msgr2=0x7f4c1c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.201+0000 7f4c21c0a700 1 -- 172.21.15.81:0/2258810291 shutdown_connections 2023-10-07T08:46:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.201+0000 7f4c21c0a700 1 -- 172.21.15.81:0/2258810291 wait complete. 2023-10-07T08:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.202+0000 7f4c21c0a700 1 Processor -- start 2023-10-07T08:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.202+0000 7f4c21c0a700 1 -- start start 2023-10-07T08:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c21c0a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c1c06d120 0x7f4c1c154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c21c0a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c1c1578d0 0x7f4c1c0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c21c0a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c1c157ca0 0x7f4c1c1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c21c0a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0ac6e0 con 0x7f4c1c06d120 2023-10-07T08:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c21c0a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0af100 con 0x7f4c1c157ca0 2023-10-07T08:46:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c21c0a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0abdb0 con 0x7f4c1c1578d0 2023-10-07T08:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c1b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c1c06d120 0x7f4c1c154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c1b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c1c06d120 0x7f4c1c154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48552/0 (socket says 172.21.15.81:48552) 2023-10-07T08:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c1b7fe700 1 -- 172.21.15.81:0/3096018153 learned_addr learned my addr 172.21.15.81:0/3096018153 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c1b7fe700 1 -- 172.21.15.81:0/3096018153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c1c1578d0 msgr2=0x7f4c1c0b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c1bfff700 1 --2- 172.21.15.81:0/3096018153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c1c157ca0 0x7f4c1c1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c12ffd700 1 --2- 172.21.15.81:0/3096018153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c1c1578d0 0x7f4c1c0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c1b7fe700 1 --2- 172.21.15.81:0/3096018153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c1c1578d0 0x7f4c1c0b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c1b7fe700 1 -- 172.21.15.81:0/3096018153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c1c157ca0 msgr2=0x7f4c1c1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c1b7fe700 1 --2- 172.21.15.81:0/3096018153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c1c157ca0 0x7f4c1c1594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c1b7fe700 1 -- 172.21.15.81:0/3096018153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c009420 con 0x7f4c1c06d120 2023-10-07T08:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c12ffd700 1 --2- 172.21.15.81:0/3096018153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c1c1578d0 0x7f4c1c0b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:46:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c1bfff700 1 --2- 172.21.15.81:0/3096018153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c1c157ca0 0x7f4c1c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:46:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c1b7fe700 1 --2- 172.21.15.81:0/3096018153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c1c06d120 0x7f4c1c154c90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c06fe20 tx=0x7f4c0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c13fff700 1 -- 172.21.15.81:0/3096018153 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c01f070 con 0x7f4c1c06d120 2023-10-07T08:46:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c13fff700 1 -- 172.21.15.81:0/3096018153 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c000c90 con 0x7f4c1c06d120 2023-10-07T08:46:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c21c0a700 1 -- 172.21.15.81:0/3096018153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c0ac090 con 0x7f4c1c06d120 2023-10-07T08:46:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c13fff700 1 -- 172.21.15.81:0/3096018153 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c025420 con 0x7f4c1c06d120 2023-10-07T08:46:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.203+0000 7f4c21c0a700 1 -- 172.21.15.81:0/3096018153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c1551d0 con 0x7f4c1c06d120 2023-10-07T08:46:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.204+0000 7f4c21c0a700 1 -- 172.21.15.81:0/3096018153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c067ac0 con 0x7f4c1c06d120 2023-10-07T08:46:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.205+0000 7f4c13fff700 1 -- 172.21.15.81:0/3096018153 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c0c023070 con 0x7f4c1c06d120 2023-10-07T08:46:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.205+0000 7f4c13fff700 1 --2- 172.21.15.81:0/3096018153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4bfc066f30 0x7f4bfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.205+0000 7f4c13fff700 1 -- 172.21.15.81:0/3096018153 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c0c0859d0 con 0x7f4c1c06d120 2023-10-07T08:46:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.205+0000 7f4c12ffd700 1 --2- 172.21.15.81:0/3096018153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4bfc066f30 0x7f4bfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.205+0000 7f4c12ffd700 1 --2- 172.21.15.81:0/3096018153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4bfc066f30 0x7f4bfc0693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4c04007fd0 tx=0x7f4c04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:49.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.210+0000 7f4c13fff700 1 -- 172.21.15.81:0/3096018153 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c0c052c40 con 0x7f4c1c06d120 2023-10-07T08:46:49.235 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-07T08:46:49.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:49.437+0000 7f4c21c0a700 1 -- 172.21.15.81:0/3096018153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4c1c04bb80 con 0x7f4c1c06d120 2023-10-07T08:46:50.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.443+0000 7f4c13fff700 1 -- 172.21.15.81:0/3096018153 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4c0c02a0b0 con 0x7f4c1c06d120 2023-10-07T08:46:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.445+0000 7f4c21c0a700 1 -- 172.21.15.81:0/3096018153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4bfc066f30 msgr2=0x7f4bfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.445+0000 7f4c21c0a700 1 --2- 172.21.15.81:0/3096018153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4bfc066f30 0x7f4bfc0693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4c04007fd0 tx=0x7f4c04009040 comp rx=0 tx=0).stop 2023-10-07T08:46:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.445+0000 7f4c21c0a700 1 -- 172.21.15.81:0/3096018153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c1c06d120 msgr2=0x7f4c1c154c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.445+0000 7f4c21c0a700 1 --2- 172.21.15.81:0/3096018153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c1c06d120 0x7f4c1c154c90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c06fe20 tx=0x7f4c0c017000 comp rx=0 tx=0).stop 2023-10-07T08:46:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.445+0000 7f4c21c0a700 1 -- 172.21.15.81:0/3096018153 shutdown_connections 2023-10-07T08:46:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.445+0000 7f4c21c0a700 1 --2- 172.21.15.81:0/3096018153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c1c157ca0 0x7f4c1c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.445+0000 7f4c21c0a700 1 --2- 172.21.15.81:0/3096018153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c1c06d120 0x7f4c1c154c90 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.445+0000 7f4c21c0a700 1 --2- 172.21.15.81:0/3096018153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4bfc066f30 0x7f4bfc0693e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.445+0000 7f4c21c0a700 1 --2- 172.21.15.81:0/3096018153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c1c1578d0 0x7f4c1c0b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.445+0000 7f4c21c0a700 1 -- 172.21.15.81:0/3096018153 >> 172.21.15.81:0/3096018153 conn(0x7f4c1c06bb90 msgr2=0x7f4c1c069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.446+0000 7f4c21c0a700 1 -- 172.21.15.81:0/3096018153 shutdown_connections 2023-10-07T08:46:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.446+0000 7f4c21c0a700 1 -- 172.21.15.81:0/3096018153 wait complete. 2023-10-07T08:46:50.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T08:46:50.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.587+0000 7f040fc62700 1 Processor -- start 2023-10-07T08:46:50.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.588+0000 7f040fc62700 1 -- start start 2023-10-07T08:46:50.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.589+0000 7f040fc62700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0408157ca0 0x7f04080cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:50.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.589+0000 7f040fc62700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04080d07c0 con 0x7f040806d120 2023-10-07T08:46:50.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.589+0000 7f040fc62700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04080cfbb0 con 0x7f04081578d0 2023-10-07T08:46:50.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.589+0000 7f040fc62700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04080cfe90 con 0x7f0408157ca0 2023-10-07T08:46:50.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.589+0000 7f040e1ff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f040806d120 0x7f040815b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37366/0 (socket says 172.21.15.81:37366) 2023-10-07T08:46:50.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.589+0000 7f040e1ff700 1 -- 172.21.15.81:0/3253149574 learned_addr learned my addr 172.21.15.81:0/3253149574 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:50.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.589+0000 7f040d1fd700 1 --2- 172.21.15.81:0/3253149574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0408157ca0 0x7f04080cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:50.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.589+0000 7f040c9fc700 1 -- 172.21.15.81:0/3253149574 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446566588 0 0) 0x7f04080d07c0 con 0x7f040806d120 2023-10-07T08:46:50.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.589+0000 7f040c9fc700 1 -- 172.21.15.81:0/3253149574 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03f4003570 con 0x7f040806d120 2023-10-07T08:46:50.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.589+0000 7f040c9fc700 1 -- 172.21.15.81:0/3253149574 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203480352 0 0) 0x7f04080cfbb0 con 0x7f04081578d0 2023-10-07T08:46:50.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.589+0000 7f040c9fc700 1 -- 172.21.15.81:0/3253149574 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04080d07c0 con 0x7f04081578d0 2023-10-07T08:46:50.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.589+0000 7f040c9fc700 1 -- 172.21.15.81:0/3253149574 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2503731979 0 0) 0x7f03f4003570 con 0x7f040806d120 2023-10-07T08:46:50.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.589+0000 7f040d1fd700 1 -- 172.21.15.81:0/3253149574 >> v1:172.21.15.89:6789/0 conn(0x7f04081578d0 legacy=0x7f040815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:50.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.589+0000 7f040d1fd700 1 -- 172.21.15.81:0/3253149574 >> v1:172.21.15.81:6789/0 conn(0x7f040806d120 legacy=0x7f040815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:50.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.589+0000 7f040d1fd700 1 -- 172.21.15.81:0/3253149574 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04080d0170 con 0x7f0408157ca0 2023-10-07T08:46:50.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.589+0000 7f040d1fd700 1 --2- 172.21.15.81:0/3253149574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0408157ca0 0x7f04080cf4f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009910 tx=0x7f03f80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b08943d5c566e022 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:50.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.590+0000 7f040c9fc700 1 -- 172.21.15.81:0/3253149574 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400001770 con 0x7f0408157ca0 2023-10-07T08:46:50.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.590+0000 7f040c9fc700 1 -- 172.21.15.81:0/3253149574 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f8011420 con 0x7f0408157ca0 2023-10-07T08:46:50.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.590+0000 7f040c9fc700 1 -- 172.21.15.81:0/3253149574 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f80117a0 con 0x7f0408157ca0 2023-10-07T08:46:50.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.590+0000 7f040fc62700 1 -- 172.21.15.81:0/3253149574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0408157ca0 msgr2=0x7f04080cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:50.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.590+0000 7f040fc62700 1 --2- 172.21.15.81:0/3253149574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0408157ca0 0x7f04080cf4f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009910 tx=0x7f03f80091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:50.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.590+0000 7f040fc62700 1 -- 172.21.15.81:0/3253149574 shutdown_connections 2023-10-07T08:46:50.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.590+0000 7f040fc62700 1 --2- 172.21.15.81:0/3253149574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0408157ca0 0x7f04080cf4f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:50.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.590+0000 7f040fc62700 1 -- 172.21.15.81:0/3253149574 >> 172.21.15.81:0/3253149574 conn(0x7f040806bb90 msgr2=0x7f040806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:50.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.590+0000 7f040fc62700 1 -- 172.21.15.81:0/3253149574 shutdown_connections 2023-10-07T08:46:50.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.590+0000 7f040fc62700 1 -- 172.21.15.81:0/3253149574 wait complete. 2023-10-07T08:46:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.592+0000 7f040fc62700 1 Processor -- start 2023-10-07T08:46:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.592+0000 7f040fc62700 1 -- start start 2023-10-07T08:46:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040fc62700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f040806d120 0x7f04081525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040fc62700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04081578d0 0x7f0408069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040fc62700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0408157ca0 0x7f040806a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040fc62700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040816b470 con 0x7f04081578d0 2023-10-07T08:46:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040fc62700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040816b750 con 0x7f040806d120 2023-10-07T08:46:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040fc62700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040816ba30 con 0x7f0408157ca0 2023-10-07T08:46:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040d1fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04081578d0 0x7f0408069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:50.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040d1fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04081578d0 0x7f0408069b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48568/0 (socket says 172.21.15.81:48568) 2023-10-07T08:46:50.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040d1fd700 1 -- 172.21.15.81:0/1501620532 learned_addr learned my addr 172.21.15.81:0/1501620532 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:50.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040d9fe700 1 --2- 172.21.15.81:0/1501620532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f040806d120 0x7f04081525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:50.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040e1ff700 1 --2- 172.21.15.81:0/1501620532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0408157ca0 0x7f040806a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:50.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040d1fd700 1 -- 172.21.15.81:0/1501620532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0408157ca0 msgr2=0x7f040806a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:50.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040d1fd700 1 --2- 172.21.15.81:0/1501620532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0408157ca0 0x7f040806a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:50.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040d1fd700 1 -- 172.21.15.81:0/1501620532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f040806d120 msgr2=0x7f04081525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:50.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040d1fd700 1 --2- 172.21.15.81:0/1501620532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f040806d120 0x7f04081525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:50.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040d1fd700 1 -- 172.21.15.81:0/1501620532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f8009420 con 0x7f04081578d0 2023-10-07T08:46:50.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040e1ff700 1 --2- 172.21.15.81:0/1501620532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0408157ca0 0x7f040806a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:46:50.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040d1fd700 1 --2- 172.21.15.81:0/1501620532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04081578d0 0x7f0408069b70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009860 tx=0x7f03f8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:50.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f03fdffb700 1 -- 172.21.15.81:0/1501620532 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f801cc50 con 0x7f04081578d0 2023-10-07T08:46:50.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f03fdffb700 1 -- 172.21.15.81:0/1501620532 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f801cdb0 con 0x7f04081578d0 2023-10-07T08:46:50.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f040fc62700 1 -- 172.21.15.81:0/1501620532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040816bd10 con 0x7f04081578d0 2023-10-07T08:46:50.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.593+0000 7f03fdffb700 1 -- 172.21.15.81:0/1501620532 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f801a6a0 con 0x7f04081578d0 2023-10-07T08:46:50.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.594+0000 7f040fc62700 1 -- 172.21.15.81:0/1501620532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0408167dd0 con 0x7f04081578d0 2023-10-07T08:46:50.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.594+0000 7f040fc62700 1 -- 172.21.15.81:0/1501620532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040816c230 con 0x7f04081578d0 2023-10-07T08:46:50.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.595+0000 7f03fdffb700 1 -- 172.21.15.81:0/1501620532 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03f801aad0 con 0x7f04081578d0 2023-10-07T08:46:50.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.595+0000 7f03fdffb700 1 --2- 172.21.15.81:0/1501620532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f03ec066f30 0x7f03ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:50.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.595+0000 7f03fdffb700 1 -- 172.21.15.81:0/1501620532 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03f8085fd0 con 0x7f04081578d0 2023-10-07T08:46:50.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.595+0000 7f040d9fe700 1 --2- 172.21.15.81:0/1501620532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f03ec066f30 0x7f03ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:50.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.596+0000 7f040d9fe700 1 --2- 172.21.15.81:0/1501620532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f03ec066f30 0x7f03ec0693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f04080b28e0 tx=0x7f0404009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:50.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.599+0000 7f03fdffb700 1 -- 172.21.15.81:0/1501620532 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f040816c230 con 0x7f04081578d0 2023-10-07T08:46:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:50.825+0000 7f040fc62700 1 -- 172.21.15.81:0/1501620532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f040816c230 con 0x7f04081578d0 2023-10-07T08:46:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.446+0000 7f03fdffb700 1 -- 172.21.15.81:0/1501620532 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7f040816c230 con 0x7f04081578d0 2023-10-07T08:46:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.448+0000 7f040fc62700 1 -- 172.21.15.81:0/1501620532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f03ec066f30 msgr2=0x7f03ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.448+0000 7f040fc62700 1 --2- 172.21.15.81:0/1501620532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f03ec066f30 0x7f03ec0693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f04080b28e0 tx=0x7f0404009040 comp rx=0 tx=0).stop 2023-10-07T08:46:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.448+0000 7f040fc62700 1 -- 172.21.15.81:0/1501620532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04081578d0 msgr2=0x7f0408069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.448+0000 7f040fc62700 1 --2- 172.21.15.81:0/1501620532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04081578d0 0x7f0408069b70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009860 tx=0x7f03f8016000 comp rx=0 tx=0).stop 2023-10-07T08:46:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.449+0000 7f040fc62700 1 -- 172.21.15.81:0/1501620532 shutdown_connections 2023-10-07T08:46:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.449+0000 7f040fc62700 1 --2- 172.21.15.81:0/1501620532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f03ec066f30 0x7f03ec0693e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.449+0000 7f040fc62700 1 --2- 172.21.15.81:0/1501620532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0408157ca0 0x7f040806a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.449+0000 7f040fc62700 1 --2- 172.21.15.81:0/1501620532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f040806d120 0x7f04081525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.449+0000 7f040fc62700 1 --2- 172.21.15.81:0/1501620532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04081578d0 0x7f0408069b70 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.449+0000 7f040fc62700 1 -- 172.21.15.81:0/1501620532 >> 172.21.15.81:0/1501620532 conn(0x7f040806bb90 msgr2=0x7f0408068ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.449+0000 7f040fc62700 1 -- 172.21.15.81:0/1501620532 shutdown_connections 2023-10-07T08:46:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.449+0000 7f040fc62700 1 -- 172.21.15.81:0/1501620532 wait complete. 2023-10-07T08:46:51.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:46:51.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.579+0000 7f124f9b0700 1 Processor -- start 2023-10-07T08:46:51.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.579+0000 7f124f9b0700 1 -- start start 2023-10-07T08:46:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.580+0000 7f124f9b0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12480aeea0 0x7f12480c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.580+0000 7f124f9b0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12480af270 0x7f12480c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.580+0000 7f124f9b0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124806aae0 con 0x7f12480c7d00 2023-10-07T08:46:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.580+0000 7f124f9b0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1248069ed0 con 0x7f12480aeea0 2023-10-07T08:46:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.580+0000 7f124f9b0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124806a1b0 con 0x7f12480af270 2023-10-07T08:46:51.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.580+0000 7f124d74c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12480aeea0 0x7f12480c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:51.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.580+0000 7f124d74c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12480aeea0 0x7f12480c2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48570/0 (socket says 172.21.15.81:48570) 2023-10-07T08:46:51.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.580+0000 7f124d74c700 1 -- 172.21.15.81:0/488922685 learned_addr learned my addr 172.21.15.81:0/488922685 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:51.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.580+0000 7f124cf4b700 1 --2- 172.21.15.81:0/488922685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12480af270 0x7f12480c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:51.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.580+0000 7f124d74c700 1 -- 172.21.15.81:0/488922685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12480af270 msgr2=0x7f12480c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:51.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.580+0000 7f124d74c700 1 --2- 172.21.15.81:0/488922685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12480af270 0x7f12480c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.581+0000 7f124d74c700 1 -- 172.21.15.81:0/488922685 >> v1:172.21.15.89:6789/0 conn(0x7f12480c7d00 legacy=0x7f12480c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:51.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.581+0000 7f124d74c700 1 -- 172.21.15.81:0/488922685 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124806a490 con 0x7f12480aeea0 2023-10-07T08:46:51.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.581+0000 7f124d74c700 1 --2- 172.21.15.81:0/488922685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12480aeea0 0x7f12480c2920 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1244009f20 tx=0x7f1244009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe5c10dea37c042 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:51.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.581+0000 7f123ffff700 1 -- 172.21.15.81:0/488922685 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400e070 con 0x7f12480aeea0 2023-10-07T08:46:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.581+0000 7f123ffff700 1 -- 172.21.15.81:0/488922685 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124400bb10 con 0x7f12480aeea0 2023-10-07T08:46:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.581+0000 7f123ffff700 1 -- 172.21.15.81:0/488922685 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12440092e0 con 0x7f12480aeea0 2023-10-07T08:46:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.581+0000 7f124f9b0700 1 -- 172.21.15.81:0/488922685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12480aeea0 msgr2=0x7f12480c2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.581+0000 7f124f9b0700 1 --2- 172.21.15.81:0/488922685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12480aeea0 0x7f12480c2920 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1244009f20 tx=0x7f1244009840 comp rx=0 tx=0).stop 2023-10-07T08:46:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.581+0000 7f124f9b0700 1 -- 172.21.15.81:0/488922685 shutdown_connections 2023-10-07T08:46:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.581+0000 7f124f9b0700 1 --2- 172.21.15.81:0/488922685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12480aeea0 0x7f12480c2920 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.581+0000 7f124f9b0700 1 --2- 172.21.15.81:0/488922685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12480af270 0x7f12480c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.581+0000 7f124f9b0700 1 -- 172.21.15.81:0/488922685 >> 172.21.15.81:0/488922685 conn(0x7f124806c660 msgr2=0x7f12480cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.581+0000 7f124f9b0700 1 -- 172.21.15.81:0/488922685 shutdown_connections 2023-10-07T08:46:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.581+0000 7f124f9b0700 1 -- 172.21.15.81:0/488922685 wait complete. 2023-10-07T08:46:51.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.582+0000 7f124f9b0700 1 Processor -- start 2023-10-07T08:46:51.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.583+0000 7f124f9b0700 1 -- start start 2023-10-07T08:46:51.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.583+0000 7f124f9b0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12480aeea0 0x7f12480c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.583+0000 7f124f9b0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12480af270 0x7f12480c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.583+0000 7f124f9b0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12480c7d00 0x7f12480adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.583+0000 7f124f9b0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1248153e00 con 0x7f12480c7d00 2023-10-07T08:46:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.583+0000 7f124f9b0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12480c5a70 con 0x7f12480af270 2023-10-07T08:46:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.583+0000 7f124f9b0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1248157360 con 0x7f12480aeea0 2023-10-07T08:46:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.584+0000 7f124df4d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12480c7d00 0x7f12480adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.584+0000 7f124df4d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12480c7d00 0x7f12480adca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48572/0 (socket says 172.21.15.81:48572) 2023-10-07T08:46:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.584+0000 7f124df4d700 1 -- 172.21.15.81:0/750354909 learned_addr learned my addr 172.21.15.81:0/750354909 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.584+0000 7f124cf4b700 1 --2- 172.21.15.81:0/750354909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12480af270 0x7f12480c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.584+0000 7f124d74c700 1 --2- 172.21.15.81:0/750354909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12480aeea0 0x7f12480c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.584+0000 7f124df4d700 1 -- 172.21.15.81:0/750354909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12480aeea0 msgr2=0x7f12480c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.584+0000 7f124df4d700 1 --2- 172.21.15.81:0/750354909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12480aeea0 0x7f12480c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.584+0000 7f124df4d700 1 -- 172.21.15.81:0/750354909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12480af270 msgr2=0x7f12480c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.584+0000 7f124df4d700 1 --2- 172.21.15.81:0/750354909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12480af270 0x7f12480c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.584+0000 7f124df4d700 1 -- 172.21.15.81:0/750354909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1244009ae0 con 0x7f12480c7d00 2023-10-07T08:46:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.584+0000 7f124df4d700 1 --2- 172.21.15.81:0/750354909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12480c7d00 0x7f12480adca0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f124000c560 tx=0x7f1240007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.584+0000 7f123d7fa700 1 -- 172.21.15.81:0/750354909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1240011590 con 0x7f12480c7d00 2023-10-07T08:46:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.584+0000 7f123d7fa700 1 -- 172.21.15.81:0/750354909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12400116f0 con 0x7f12480c7d00 2023-10-07T08:46:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.584+0000 7f124f9b0700 1 -- 172.21.15.81:0/750354909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1248157ee0 con 0x7f12480c7d00 2023-10-07T08:46:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.584+0000 7f123d7fa700 1 -- 172.21.15.81:0/750354909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1240011ab0 con 0x7f12480c7d00 2023-10-07T08:46:51.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.584+0000 7f124f9b0700 1 -- 172.21.15.81:0/750354909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1248157890 con 0x7f12480c7d00 2023-10-07T08:46:51.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.585+0000 7f124f9b0700 1 -- 172.21.15.81:0/750354909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1248158070 con 0x7f12480c7d00 2023-10-07T08:46:51.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.585+0000 7f123d7fa700 1 -- 172.21.15.81:0/750354909 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f124001b3b0 con 0x7f12480c7d00 2023-10-07T08:46:51.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.586+0000 7f123d7fa700 1 --2- 172.21.15.81:0/750354909 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f122c066f30 0x7f122c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:51.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.586+0000 7f123d7fa700 1 -- 172.21.15.81:0/750354909 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1240083a50 con 0x7f12480c7d00 2023-10-07T08:46:51.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.586+0000 7f124d74c700 1 --2- 172.21.15.81:0/750354909 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f122c066f30 0x7f122c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:51.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.586+0000 7f124d74c700 1 --2- 172.21.15.81:0/750354909 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f122c066f30 0x7f122c0693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1244009880 tx=0x7f1244018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:51.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.590+0000 7f123d7fa700 1 -- 172.21.15.81:0/750354909 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1240050cc0 con 0x7f12480c7d00 2023-10-07T08:46:51.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.816+0000 7f124f9b0700 1 -- 172.21.15.81:0/750354909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12480c6e30 con 0x7f12480c7d00 2023-10-07T08:46:51.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.817+0000 7f123d7fa700 1 -- 172.21.15.81:0/750354909 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f1240017070 con 0x7f12480c7d00 2023-10-07T08:46:51.817 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/401991459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":401991459},{"type":"v1","addr":"172.21.15.89:6834","nonce":401991459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2214247931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2214247931},{"type":"v1","addr":"172.21.15.81:6836","nonce":2214247931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5620,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1168741718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1168741718},{"type":"v1","addr":"172.21.15.89:6835","nonce":1168741718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:46:47.782779+0000","modified":"2023-10-07T08:46:51.441764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6015":{"gid":6015,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2297722913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2297722913},{"type":"v1","addr":"172.21.15.81:6837","nonce":2297722913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-07T08:46:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.819+0000 7f124f9b0700 1 -- 172.21.15.81:0/750354909 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f122c066f30 msgr2=0x7f122c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.819+0000 7f124f9b0700 1 --2- 172.21.15.81:0/750354909 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f122c066f30 0x7f122c0693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1244009880 tx=0x7f1244018000 comp rx=0 tx=0).stop 2023-10-07T08:46:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.819+0000 7f124f9b0700 1 -- 172.21.15.81:0/750354909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12480c7d00 msgr2=0x7f12480adca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.819+0000 7f124f9b0700 1 --2- 172.21.15.81:0/750354909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12480c7d00 0x7f12480adca0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f124000c560 tx=0x7f1240007ef0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.819+0000 7f124f9b0700 1 -- 172.21.15.81:0/750354909 shutdown_connections 2023-10-07T08:46:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.819+0000 7f124f9b0700 1 --2- 172.21.15.81:0/750354909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12480c7d00 0x7f12480adca0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.819+0000 7f124f9b0700 1 --2- 172.21.15.81:0/750354909 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f122c066f30 0x7f122c0693e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.819+0000 7f124f9b0700 1 --2- 172.21.15.81:0/750354909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12480aeea0 0x7f12480c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.819+0000 7f124f9b0700 1 --2- 172.21.15.81:0/750354909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12480af270 0x7f12480c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.819+0000 7f124f9b0700 1 -- 172.21.15.81:0/750354909 >> 172.21.15.81:0/750354909 conn(0x7f124806c660 msgr2=0x7f12480b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.819+0000 7f124f9b0700 1 -- 172.21.15.81:0/750354909 shutdown_connections 2023-10-07T08:46:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.819+0000 7f124f9b0700 1 -- 172.21.15.81:0/750354909 wait complete. 2023-10-07T08:46:51.822 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2023-10-07T08:46:51.831 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:46:51.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.944+0000 7f52fc7c2700 1 Processor -- start 2023-10-07T08:46:51.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.944+0000 7f52fc7c2700 1 -- start start 2023-10-07T08:46:51.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.945+0000 7f52fc7c2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f52f40ce1f0 0x7f52f40aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:51.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.945+0000 7f52fc7c2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f40ce5c0 0x7f52f415e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.945+0000 7f52fc7c2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f415dfb0 con 0x7f52f40ac570 2023-10-07T08:46:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.945+0000 7f52fc7c2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f40acec0 con 0x7f52f40ce1f0 2023-10-07T08:46:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.945+0000 7f52fc7c2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f40ad1a0 con 0x7f52f40ce5c0 2023-10-07T08:46:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.945+0000 7f52f9d5d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f40ce5c0 0x7f52f415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.945+0000 7f52fa55e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f52f40ce1f0 0x7f52f40aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.945+0000 7f52fad5f700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f52f40ac570 0x7f52f406e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:48510/0 (socket says 172.21.15.81:48510) 2023-10-07T08:46:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.946+0000 7f52fad5f700 1 -- 172.21.15.81:0/4194438239 learned_addr learned my addr 172.21.15.81:0/4194438239 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.946+0000 7f52f9d5d700 1 -- 172.21.15.81:0/4194438239 >> v2:172.21.15.89:3300/0 conn(0x7f52f40ce1f0 msgr2=0x7f52f40aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.946+0000 7f52f9d5d700 1 --2- 172.21.15.81:0/4194438239 >> v2:172.21.15.89:3300/0 conn(0x7f52f40ce1f0 0x7f52f40aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.946+0000 7f52f9d5d700 1 -- 172.21.15.81:0/4194438239 >> v1:172.21.15.89:6789/0 conn(0x7f52f40ac570 legacy=0x7f52f406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:51.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.946+0000 7f52f9d5d700 1 -- 172.21.15.81:0/4194438239 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f415dc40 con 0x7f52f40ce5c0 2023-10-07T08:46:51.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.946+0000 7f52fa55e700 1 --2- 172.21.15.81:0/4194438239 >> v2:172.21.15.89:3300/0 conn(0x7f52f40ce1f0 0x7f52f40aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:46:51.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.946+0000 7f52f9d5d700 1 --2- 172.21.15.81:0/4194438239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f40ce5c0 0x7f52f415e440 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f52e40098e0 tx=0x7f52e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf40040faa98800e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:51.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.946+0000 7f52f955c700 1 -- 172.21.15.81:0/4194438239 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e400b640 con 0x7f52f40ce5c0 2023-10-07T08:46:51.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.946+0000 7f52f955c700 1 -- 172.21.15.81:0/4194438239 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e400b7a0 con 0x7f52f40ce5c0 2023-10-07T08:46:51.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.946+0000 7f52f955c700 1 -- 172.21.15.81:0/4194438239 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e400bb40 con 0x7f52f40ce5c0 2023-10-07T08:46:51.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.947+0000 7f52fc7c2700 1 -- 172.21.15.81:0/4194438239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f40ce5c0 msgr2=0x7f52f415e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:51.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.947+0000 7f52fc7c2700 1 --2- 172.21.15.81:0/4194438239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f40ce5c0 0x7f52f415e440 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f52e40098e0 tx=0x7f52e40091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.947+0000 7f52fc7c2700 1 -- 172.21.15.81:0/4194438239 shutdown_connections 2023-10-07T08:46:51.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.947+0000 7f52fc7c2700 1 --2- 172.21.15.81:0/4194438239 >> v2:172.21.15.89:3300/0 conn(0x7f52f40ce1f0 0x7f52f40aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.947+0000 7f52fc7c2700 1 --2- 172.21.15.81:0/4194438239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f40ce5c0 0x7f52f415e440 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.947+0000 7f52fc7c2700 1 -- 172.21.15.81:0/4194438239 >> 172.21.15.81:0/4194438239 conn(0x7f52f406cca0 msgr2=0x7f52f406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:51.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.947+0000 7f52fc7c2700 1 -- 172.21.15.81:0/4194438239 shutdown_connections 2023-10-07T08:46:51.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.947+0000 7f52fc7c2700 1 -- 172.21.15.81:0/4194438239 wait complete. 2023-10-07T08:46:51.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.948+0000 7f52fc7c2700 1 Processor -- start 2023-10-07T08:46:51.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.948+0000 7f52fc7c2700 1 -- start start 2023-10-07T08:46:51.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fc7c2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f40ac570 0x7f52f4155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fc7c2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f40ce1f0 0x7f52f415a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fc7c2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52f40ce5c0 0x7f52f4158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fc7c2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f415aca0 con 0x7f52f40ce5c0 2023-10-07T08:46:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fc7c2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f415af80 con 0x7f52f40ac570 2023-10-07T08:46:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fc7c2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f415b260 con 0x7f52f40ce1f0 2023-10-07T08:46:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fad5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52f40ce5c0 0x7f52f4158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fad5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52f40ce5c0 0x7f52f4158640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48578/0 (socket says 172.21.15.81:48578) 2023-10-07T08:46:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fad5f700 1 -- 172.21.15.81:0/4213191571 learned_addr learned my addr 172.21.15.81:0/4213191571 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fa55e700 1 --2- 172.21.15.81:0/4213191571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f40ac570 0x7f52f4155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52f9d5d700 1 --2- 172.21.15.81:0/4213191571 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f40ce1f0 0x7f52f415a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fad5f700 1 -- 172.21.15.81:0/4213191571 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f40ce1f0 msgr2=0x7f52f415a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fad5f700 1 --2- 172.21.15.81:0/4213191571 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f40ce1f0 0x7f52f415a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fad5f700 1 -- 172.21.15.81:0/4213191571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f40ac570 msgr2=0x7f52f4155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fad5f700 1 --2- 172.21.15.81:0/4213191571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f40ac570 0x7f52f4155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fad5f700 1 -- 172.21.15.81:0/4213191571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f0009a20 con 0x7f52f40ce5c0 2023-10-07T08:46:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fad5f700 1 --2- 172.21.15.81:0/4213191571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52f40ce5c0 0x7f52f4158640 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c560 tx=0x7f52ec007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52ea7fc700 1 -- 172.21.15.81:0/4213191571 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec005b30 con 0x7f52f40ce5c0 2023-10-07T08:46:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52ea7fc700 1 -- 172.21.15.81:0/4213191571 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec005c90 con 0x7f52f40ce5c0 2023-10-07T08:46:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fc7c2700 1 -- 172.21.15.81:0/4213191571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e4009420 con 0x7f52f40ce5c0 2023-10-07T08:46:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52ea7fc700 1 -- 172.21.15.81:0/4213191571 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0072e0 con 0x7f52f40ce5c0 2023-10-07T08:46:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.949+0000 7f52fc7c2700 1 -- 172.21.15.81:0/4213191571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f415bd10 con 0x7f52f40ce5c0 2023-10-07T08:46:51.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.950+0000 7f52fc7c2700 1 -- 172.21.15.81:0/4213191571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f4068900 con 0x7f52f40ce5c0 2023-10-07T08:46:51.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.951+0000 7f52ea7fc700 1 -- 172.21.15.81:0/4213191571 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52ec007690 con 0x7f52f40ce5c0 2023-10-07T08:46:51.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.951+0000 7f52ea7fc700 1 --2- 172.21.15.81:0/4213191571 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f52d8066f30 0x7f52d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:51.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.951+0000 7f52ea7fc700 1 -- 172.21.15.81:0/4213191571 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f52ec083760 con 0x7f52f40ce5c0 2023-10-07T08:46:51.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.951+0000 7f52fa55e700 1 --2- 172.21.15.81:0/4213191571 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f52d8066f30 0x7f52d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:51.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.952+0000 7f52fa55e700 1 --2- 172.21.15.81:0/4213191571 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f52d8066f30 0x7f52d80693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009fd0 tx=0x7f52f000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:51.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:51.955+0000 7f52ea7fc700 1 -- 172.21.15.81:0/4213191571 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52ec04b5a0 con 0x7f52f40ce5c0 2023-10-07T08:46:52.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.138+0000 7f52fc7c2700 1 -- 172.21.15.81:0/4213191571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52f415bf00 con 0x7f52f40ce5c0 2023-10-07T08:46:52.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.139+0000 7f52ea7fc700 1 -- 172.21.15.81:0/4213191571 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f52ec017090 con 0x7f52f40ce5c0 2023-10-07T08:46:52.139 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:52.140 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":85,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:46:49.257433+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:46:45.595534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-07T08:46:46.747683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:46:52.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.141+0000 7f52fc7c2700 1 -- 172.21.15.81:0/4213191571 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f52d8066f30 msgr2=0x7f52d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:52.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.141+0000 7f52fc7c2700 1 --2- 172.21.15.81:0/4213191571 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f52d8066f30 0x7f52d80693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009fd0 tx=0x7f52f000b040 comp rx=0 tx=0).stop 2023-10-07T08:46:52.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.141+0000 7f52fc7c2700 1 -- 172.21.15.81:0/4213191571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52f40ce5c0 msgr2=0x7f52f4158640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:52.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.141+0000 7f52fc7c2700 1 --2- 172.21.15.81:0/4213191571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52f40ce5c0 0x7f52f4158640 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c560 tx=0x7f52ec007f60 comp rx=0 tx=0).stop 2023-10-07T08:46:52.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.141+0000 7f52fc7c2700 1 -- 172.21.15.81:0/4213191571 shutdown_connections 2023-10-07T08:46:52.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.141+0000 7f52fc7c2700 1 --2- 172.21.15.81:0/4213191571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52f40ce5c0 0x7f52f4158640 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.141+0000 7f52fc7c2700 1 --2- 172.21.15.81:0/4213191571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f40ac570 0x7f52f4155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.141+0000 7f52fc7c2700 1 --2- 172.21.15.81:0/4213191571 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f52d8066f30 0x7f52d80693e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.141+0000 7f52fc7c2700 1 --2- 172.21.15.81:0/4213191571 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f40ce1f0 0x7f52f415a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.141+0000 7f52fc7c2700 1 -- 172.21.15.81:0/4213191571 >> 172.21.15.81:0/4213191571 conn(0x7f52f406cca0 msgr2=0x7f52f4156940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:52.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.141+0000 7f52fc7c2700 1 -- 172.21.15.81:0/4213191571 shutdown_connections 2023-10-07T08:46:52.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.141+0000 7f52fc7c2700 1 -- 172.21.15.81:0/4213191571 wait complete. 2023-10-07T08:46:52.154 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T08:46:52.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:46:52.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.267+0000 7fd4daf68700 1 Processor -- start 2023-10-07T08:46:52.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.267+0000 7fd4daf68700 1 -- start start 2023-10-07T08:46:52.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.268+0000 7fd4daf68700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d415a2a0 0x7fd4d40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:52.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.268+0000 7fd4daf68700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4d406dd60 0x7fd4d40cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:52.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.268+0000 7fd4daf68700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d40cf4e0 con 0x7fd4d40ceb30 2023-10-07T08:46:52.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.268+0000 7fd4daf68700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d406ea90 con 0x7fd4d406dd60 2023-10-07T08:46:52.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.268+0000 7fd4daf68700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40b0ca0 con 0x7fd4d415a2a0 2023-10-07T08:46:52.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.268+0000 7fd4d9505700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4d406dd60 0x7fd4d40cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:52.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.268+0000 7fd4d9505700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4d406dd60 0x7fd4d40cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48582/0 (socket says 172.21.15.81:48582) 2023-10-07T08:46:52.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.268+0000 7fd4d9505700 1 -- 172.21.15.81:0/3033717404 learned_addr learned my addr 172.21.15.81:0/3033717404 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:52.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.269+0000 7fd4d8d04700 1 --2- 172.21.15.81:0/3033717404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d415a2a0 0x7fd4d40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:52.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.269+0000 7fd4d9505700 1 -- 172.21.15.81:0/3033717404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d415a2a0 msgr2=0x7fd4d40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:52.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.269+0000 7fd4d9505700 1 --2- 172.21.15.81:0/3033717404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d415a2a0 0x7fd4d40b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.269+0000 7fd4d9505700 1 -- 172.21.15.81:0/3033717404 >> v1:172.21.15.89:6789/0 conn(0x7fd4d40ceb30 legacy=0x7fd4d406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:52.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.269+0000 7fd4d9505700 1 -- 172.21.15.81:0/3033717404 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d40b00d0 con 0x7fd4d406dd60 2023-10-07T08:46:52.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.269+0000 7fd4d9505700 1 --2- 172.21.15.81:0/3033717404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d406dd60 0x7fd4d40cefa0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009f20 tx=0x7fd4cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b877915f01f66cde server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:52.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.269+0000 7fd4cb7fe700 1 -- 172.21.15.81:0/3033717404 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc00e070 con 0x7fd4d406dd60 2023-10-07T08:46:52.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.269+0000 7fd4cb7fe700 1 -- 172.21.15.81:0/3033717404 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc00ba40 con 0x7fd4d406dd60 2023-10-07T08:46:52.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.269+0000 7fd4cb7fe700 1 -- 172.21.15.81:0/3033717404 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc0092e0 con 0x7fd4d406dd60 2023-10-07T08:46:52.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.269+0000 7fd4daf68700 1 -- 172.21.15.81:0/3033717404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d406dd60 msgr2=0x7fd4d40cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:52.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.269+0000 7fd4daf68700 1 --2- 172.21.15.81:0/3033717404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d406dd60 0x7fd4d40cefa0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009f20 tx=0x7fd4cc009840 comp rx=0 tx=0).stop 2023-10-07T08:46:52.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.269+0000 7fd4daf68700 1 -- 172.21.15.81:0/3033717404 shutdown_connections 2023-10-07T08:46:52.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.269+0000 7fd4daf68700 1 --2- 172.21.15.81:0/3033717404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d406dd60 0x7fd4d40cefa0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.269+0000 7fd4daf68700 1 --2- 172.21.15.81:0/3033717404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d415a2a0 0x7fd4d40b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.269+0000 7fd4daf68700 1 -- 172.21.15.81:0/3033717404 >> 172.21.15.81:0/3033717404 conn(0x7fd4d4067640 msgr2=0x7fd4d4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:52.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.269+0000 7fd4daf68700 1 -- 172.21.15.81:0/3033717404 shutdown_connections 2023-10-07T08:46:52.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.270+0000 7fd4daf68700 1 -- 172.21.15.81:0/3033717404 wait complete. 2023-10-07T08:46:52.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.271+0000 7fd4daf68700 1 Processor -- start 2023-10-07T08:46:52.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.271+0000 7fd4daf68700 1 -- start start 2023-10-07T08:46:52.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.271+0000 7fd4daf68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d406dd60 0x7fd4d415d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:52.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.271+0000 7fd4daf68700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40ceb30 0x7fd4d415a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:52.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.271+0000 7fd4daf68700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4d415a2a0 0x7fd4d415af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.271+0000 7fd4daf68700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d415e630 con 0x7fd4d406dd60 2023-10-07T08:46:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.271+0000 7fd4daf68700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d415da20 con 0x7fd4d415a2a0 2023-10-07T08:46:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.271+0000 7fd4daf68700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d415dd00 con 0x7fd4d40ceb30 2023-10-07T08:46:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.272+0000 7fd4d8d04700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d406dd60 0x7fd4d415d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.272+0000 7fd4d8d04700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d406dd60 0x7fd4d415d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48598/0 (socket says 172.21.15.81:48598) 2023-10-07T08:46:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.272+0000 7fd4d8d04700 1 -- 172.21.15.81:0/3064006324 learned_addr learned my addr 172.21.15.81:0/3064006324 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.272+0000 7fd4d9505700 1 --2- 172.21.15.81:0/3064006324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4d415a2a0 0x7fd4d415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.272+0000 7fd4cbfff700 1 --2- 172.21.15.81:0/3064006324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40ceb30 0x7fd4d415a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.272+0000 7fd4d8d04700 1 -- 172.21.15.81:0/3064006324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40ceb30 msgr2=0x7fd4d415a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.272+0000 7fd4d8d04700 1 --2- 172.21.15.81:0/3064006324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40ceb30 0x7fd4d415a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.272+0000 7fd4d8d04700 1 -- 172.21.15.81:0/3064006324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4d415a2a0 msgr2=0x7fd4d415af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.272+0000 7fd4d8d04700 1 --2- 172.21.15.81:0/3064006324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4d415a2a0 0x7fd4d415af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.272+0000 7fd4d8d04700 1 -- 172.21.15.81:0/3064006324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc009ae0 con 0x7fd4d406dd60 2023-10-07T08:46:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.272+0000 7fd4d8d04700 1 --2- 172.21.15.81:0/3064006324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d406dd60 0x7fd4d415d1f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000c880 tx=0x7fd4d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.272+0000 7fd4c8ff9700 1 -- 172.21.15.81:0/3064006324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0011600 con 0x7fd4d406dd60 2023-10-07T08:46:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.272+0000 7fd4c8ff9700 1 -- 172.21.15.81:0/3064006324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d0011780 con 0x7fd4d406dd60 2023-10-07T08:46:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.272+0000 7fd4daf68700 1 -- 172.21.15.81:0/3064006324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d415dfe0 con 0x7fd4d406dd60 2023-10-07T08:46:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.272+0000 7fd4c8ff9700 1 -- 172.21.15.81:0/3064006324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0011b40 con 0x7fd4d406dd60 2023-10-07T08:46:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.272+0000 7fd4daf68700 1 -- 172.21.15.81:0/3064006324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d415d730 con 0x7fd4d406dd60 2023-10-07T08:46:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.273+0000 7fd4daf68700 1 -- 172.21.15.81:0/3064006324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d4069e40 con 0x7fd4d406dd60 2023-10-07T08:46:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.273+0000 7fd4c8ff9700 1 -- 172.21.15.81:0/3064006324 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4d0018360 con 0x7fd4d406dd60 2023-10-07T08:46:52.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.274+0000 7fd4c8ff9700 1 --2- 172.21.15.81:0/3064006324 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd4c0066f30 0x7fd4c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:52.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.274+0000 7fd4c8ff9700 1 -- 172.21.15.81:0/3064006324 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd4d0084230 con 0x7fd4d406dd60 2023-10-07T08:46:52.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.274+0000 7fd4cbfff700 1 --2- 172.21.15.81:0/3064006324 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd4c0066f30 0x7fd4c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:52.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.274+0000 7fd4cbfff700 1 --2- 172.21.15.81:0/3064006324 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd4c0066f30 0x7fd4c00693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4003870 tx=0x7fd4c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:52.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.278+0000 7fd4c8ff9700 1 -- 172.21.15.81:0/3064006324 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4d0054f30 con 0x7fd4d406dd60 2023-10-07T08:46:52.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.459+0000 7fd4daf68700 1 -- 172.21.15.81:0/3064006324 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4d415e770 con 0x7fd4c0066f30 2023-10-07T08:46:52.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.467+0000 7fd4c8ff9700 1 -- 172.21.15.81:0/3064006324 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284626 (secure 0 0 0) 0x7fd4c4003450 con 0x7fd4c0066f30 2023-10-07T08:46:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.469+0000 7fd4daf68700 1 -- 172.21.15.81:0/3064006324 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd4c0066f30 msgr2=0x7fd4c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.469+0000 7fd4daf68700 1 --2- 172.21.15.81:0/3064006324 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd4c0066f30 0x7fd4c00693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4003870 tx=0x7fd4c4009040 comp rx=0 tx=0).stop 2023-10-07T08:46:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.469+0000 7fd4daf68700 1 -- 172.21.15.81:0/3064006324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d406dd60 msgr2=0x7fd4d415d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.469+0000 7fd4daf68700 1 --2- 172.21.15.81:0/3064006324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d406dd60 0x7fd4d415d1f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000c880 tx=0x7fd4d0008040 comp rx=0 tx=0).stop 2023-10-07T08:46:52.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.470+0000 7fd4daf68700 1 -- 172.21.15.81:0/3064006324 shutdown_connections 2023-10-07T08:46:52.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.470+0000 7fd4daf68700 1 --2- 172.21.15.81:0/3064006324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4d415a2a0 0x7fd4d415af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.470+0000 7fd4daf68700 1 --2- 172.21.15.81:0/3064006324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4d406dd60 0x7fd4d415d1f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.470+0000 7fd4daf68700 1 --2- 172.21.15.81:0/3064006324 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd4c0066f30 0x7fd4c00693e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.470+0000 7fd4daf68700 1 --2- 172.21.15.81:0/3064006324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40ceb30 0x7fd4d415a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.470+0000 7fd4daf68700 1 -- 172.21.15.81:0/3064006324 >> 172.21.15.81:0/3064006324 conn(0x7fd4d4067640 msgr2=0x7fd4d40cd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:52.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.470+0000 7fd4daf68700 1 -- 172.21.15.81:0/3064006324 shutdown_connections 2023-10-07T08:46:52.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.470+0000 7fd4daf68700 1 -- 172.21.15.81:0/3064006324 wait complete. 2023-10-07T08:46:52.478 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:46:52.482 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2023-10-07T08:46:52.056576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4632,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557867,"statfs":{"total":1600000000,"available":1595256356,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.657752"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269713+0000","last_change":"2023-10-07T08:46:48.269492+0000","last_active":"2023-10-07T08:46:48.269713+0000","last_peered":"2023-10-07T08:46:48.269713+0000","last_clean":"2023-10-07T08:46:48.269713+0000","last_became_active":"2023-10-07T08:46:48.267774+0000","last_became_peered":"2023-10-07T08:46:48.267774+0000","last_unstale":"2023-10-07T08:46:48.269713+0000","last_undegraded":"2023-10-07T08:46:48.269713+0000","last_fullsized":"2023-10-07T08:46:48.269713+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:05.464820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.270126+0000","last_change":"2023-10-07T08:46:48.269916+0000","last_active":"2023-10-07T08:46:48.270126+0000","last_peered":"2023-10-07T08:46:48.270126+0000","last_clean":"2023-10-07T08:46:48.270126+0000","last_became_active":"2023-10-07T08:46:48.268605+0000","last_became_peered":"2023-10-07T08:46:48.268605+0000","last_unstale":"2023-10-07T08:46:48.270126+0000","last_undegraded":"2023-10-07T08:46:48.270126+0000","last_fullsized":"2023-10-07T08:46:48.270126+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:54:27.000576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.264293+0000","last_change":"2023-10-07T08:46:48.264233+0000","last_active":"2023-10-07T08:46:48.264293+0000","last_peered":"2023-10-07T08:46:48.264293+0000","last_clean":"2023-10-07T08:46:48.264293+0000","last_became_active":"2023-10-07T08:46:48.264014+0000","last_became_peered":"2023-10-07T08:46:48.264014+0000","last_unstale":"2023-10-07T08:46:48.264293+0000","last_undegraded":"2023-10-07T08:46:48.264293+0000","last_fullsized":"2023-10-07T08:46:48.264293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:50.218936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.267377+0000","last_change":"2023-10-07T08:46:48.267192+0000","last_active":"2023-10-07T08:46:48.267377+0000","last_peered":"2023-10-07T08:46:48.267377+0000","last_clean":"2023-10-07T08:46:48.267377+0000","last_became_active":"2023-10-07T08:46:48.266337+0000","last_became_peered":"2023-10-07T08:46:48.266337+0000","last_unstale":"2023-10-07T08:46:48.267377+0000","last_undegraded":"2023-10-07T08:46:48.267377+0000","last_fullsized":"2023-10-07T08:46:48.267377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:01:03.720301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.266743+0000","last_change":"2023-10-07T08:46:48.266566+0000","last_active":"2023-10-07T08:46:48.266743+0000","last_peered":"2023-10-07T08:46:48.266743+0000","last_clean":"2023-10-07T08:46:48.266743+0000","last_became_active":"2023-10-07T08:46:48.265930+0000","last_became_peered":"2023-10-07T08:46:48.265930+0000","last_unstale":"2023-10-07T08:46:48.266743+0000","last_undegraded":"2023-10-07T08:46:48.266743+0000","last_fullsized":"2023-10-07T08:46:48.266743+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:03:50.132845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.272362+0000","last_change":"2023-10-07T08:46:48.272283+0000","last_active":"2023-10-07T08:46:48.272362+0000","last_peered":"2023-10-07T08:46:48.272362+0000","last_clean":"2023-10-07T08:46:48.272362+0000","last_became_active":"2023-10-07T08:46:48.272051+0000","last_became_peered":"2023-10-07T08:46:48.272051+0000","last_unstale":"2023-10-07T08:46:48.272362+0000","last_undegraded":"2023-10-07T08:46:48.272362+0000","last_fullsized":"2023-10-07T08:46:48.272362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:23.545539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.272501+0000","last_change":"2023-10-07T08:46:48.272283+0000","last_active":"2023-10-07T08:46:48.272501+0000","last_peered":"2023-10-07T08:46:48.272501+0000","last_clean":"2023-10-07T08:46:48.272501+0000","last_became_active":"2023-10-07T08:46:48.271615+0000","last_became_peered":"2023-10-07T08:46:48.271615+0000","last_unstale":"2023-10-07T08:46:48.272501+0000","last_undegraded":"2023-10-07T08:46:48.272501+0000","last_fullsized":"2023-10-07T08:46:48.272501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:49:28.022869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269762+0000","last_change":"2023-10-07T08:46:48.269650+0000","last_active":"2023-10-07T08:46:48.269762+0000","last_peered":"2023-10-07T08:46:48.269762+0000","last_clean":"2023-10-07T08:46:48.269762+0000","last_became_active":"2023-10-07T08:46:48.269120+0000","last_became_peered":"2023-10-07T08:46:48.269120+0000","last_unstale":"2023-10-07T08:46:48.269762+0000","last_undegraded":"2023-10-07T08:46:48.269762+0000","last_fullsized":"2023-10-07T08:46:48.269762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:30:29.382053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261031+0000","last_change":"2023-10-07T08:46:48.260743+0000","last_active":"2023-10-07T08:46:48.261031+0000","last_peered":"2023-10-07T08:46:48.261031+0000","last_clean":"2023-10-07T08:46:48.261031+0000","last_became_active":"2023-10-07T08:46:48.260531+0000","last_became_peered":"2023-10-07T08:46:48.260531+0000","last_unstale":"2023-10-07T08:46:48.261031+0000","last_undegraded":"2023-10-07T08:46:48.261031+0000","last_fullsized":"2023-10-07T08:46:48.261031+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:20:20.812889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.274168+0000","last_change":"2023-10-07T08:46:48.274103+0000","last_active":"2023-10-07T08:46:48.274168+0000","last_peered":"2023-10-07T08:46:48.274168+0000","last_clean":"2023-10-07T08:46:48.274168+0000","last_became_active":"2023-10-07T08:46:48.273330+0000","last_became_peered":"2023-10-07T08:46:48.273330+0000","last_unstale":"2023-10-07T08:46:48.274168+0000","last_undegraded":"2023-10-07T08:46:48.274168+0000","last_fullsized":"2023-10-07T08:46:48.274168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:08:51.801627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.275205+0000","last_change":"2023-10-07T08:46:48.275134+0000","last_active":"2023-10-07T08:46:48.275205+0000","last_peered":"2023-10-07T08:46:48.275205+0000","last_clean":"2023-10-07T08:46:48.275205+0000","last_became_active":"2023-10-07T08:46:48.274892+0000","last_became_peered":"2023-10-07T08:46:48.274892+0000","last_unstale":"2023-10-07T08:46:48.275205+0000","last_undegraded":"2023-10-07T08:46:48.275205+0000","last_fullsized":"2023-10-07T08:46:48.275205+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:41:48.420830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.270099+0000","last_change":"2023-10-07T08:46:48.270052+0000","last_active":"2023-10-07T08:46:48.270099+0000","last_peered":"2023-10-07T08:46:48.270099+0000","last_clean":"2023-10-07T08:46:48.270099+0000","last_became_active":"2023-10-07T08:46:48.269840+0000","last_became_peered":"2023-10-07T08:46:48.269840+0000","last_unstale":"2023-10-07T08:46:48.270099+0000","last_undegraded":"2023-10-07T08:46:48.270099+0000","last_fullsized":"2023-10-07T08:46:48.270099+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:50:26.445404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269690+0000","last_change":"2023-10-07T08:46:48.269629+0000","last_active":"2023-10-07T08:46:48.269690+0000","last_peered":"2023-10-07T08:46:48.269690+0000","last_clean":"2023-10-07T08:46:48.269690+0000","last_became_active":"2023-10-07T08:46:48.269297+0000","last_became_peered":"2023-10-07T08:46:48.269297+0000","last_unstale":"2023-10-07T08:46:48.269690+0000","last_undegraded":"2023-10-07T08:46:48.269690+0000","last_fullsized":"2023-10-07T08:46:48.269690+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:57:20.107008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.267375+0000","last_change":"2023-10-07T08:46:48.267289+0000","last_active":"2023-10-07T08:46:48.267375+0000","last_peered":"2023-10-07T08:46:48.267375+0000","last_clean":"2023-10-07T08:46:48.267375+0000","last_became_active":"2023-10-07T08:46:48.266054+0000","last_became_peered":"2023-10-07T08:46:48.266054+0000","last_unstale":"2023-10-07T08:46:48.267375+0000","last_undegraded":"2023-10-07T08:46:48.267375+0000","last_fullsized":"2023-10-07T08:46:48.267375+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:42:03.326011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.265086+0000","last_change":"2023-10-07T08:46:48.265036+0000","last_active":"2023-10-07T08:46:48.265086+0000","last_peered":"2023-10-07T08:46:48.265086+0000","last_clean":"2023-10-07T08:46:48.265086+0000","last_became_active":"2023-10-07T08:46:48.264808+0000","last_became_peered":"2023-10-07T08:46:48.264808+0000","last_unstale":"2023-10-07T08:46:48.265086+0000","last_undegraded":"2023-10-07T08:46:48.265086+0000","last_fullsized":"2023-10-07T08:46:48.265086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:39:47.722573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.273263+0000","last_change":"2023-10-07T08:46:48.273187+0000","last_active":"2023-10-07T08:46:48.273263+0000","last_peered":"2023-10-07T08:46:48.273263+0000","last_clean":"2023-10-07T08:46:48.273263+0000","last_became_active":"2023-10-07T08:46:48.272950+0000","last_became_peered":"2023-10-07T08:46:48.272950+0000","last_unstale":"2023-10-07T08:46:48.273263+0000","last_undegraded":"2023-10-07T08:46:48.273263+0000","last_fullsized":"2023-10-07T08:46:48.273263+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:33:26.919414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.264180+0000","last_change":"2023-10-07T08:46:48.264069+0000","last_active":"2023-10-07T08:46:48.264180+0000","last_peered":"2023-10-07T08:46:48.264180+0000","last_clean":"2023-10-07T08:46:48.264180+0000","last_became_active":"2023-10-07T08:46:48.263370+0000","last_became_peered":"2023-10-07T08:46:48.263370+0000","last_unstale":"2023-10-07T08:46:48.264180+0000","last_undegraded":"2023-10-07T08:46:48.264180+0000","last_fullsized":"2023-10-07T08:46:48.264180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:47:19.276829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269113+0000","last_change":"2023-10-07T08:46:48.269056+0000","last_active":"2023-10-07T08:46:48.269113+0000","last_peered":"2023-10-07T08:46:48.269113+0000","last_clean":"2023-10-07T08:46:48.269113+0000","last_became_active":"2023-10-07T08:46:48.268843+0000","last_became_peered":"2023-10-07T08:46:48.268843+0000","last_unstale":"2023-10-07T08:46:48.269113+0000","last_undegraded":"2023-10-07T08:46:48.269113+0000","last_fullsized":"2023-10-07T08:46:48.269113+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:11.268440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.266991+0000","last_change":"2023-10-07T08:46:48.266668+0000","last_active":"2023-10-07T08:46:48.266991+0000","last_peered":"2023-10-07T08:46:48.266991+0000","last_clean":"2023-10-07T08:46:48.266991+0000","last_became_active":"2023-10-07T08:46:48.266297+0000","last_became_peered":"2023-10-07T08:46:48.266297+0000","last_unstale":"2023-10-07T08:46:48.266991+0000","last_undegraded":"2023-10-07T08:46:48.266991+0000","last_fullsized":"2023-10-07T08:46:48.266991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:22.474064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.266634+0000","last_change":"2023-10-07T08:46:48.266576+0000","last_active":"2023-10-07T08:46:48.266634+0000","last_peered":"2023-10-07T08:46:48.266634+0000","last_clean":"2023-10-07T08:46:48.266634+0000","last_became_active":"2023-10-07T08:46:48.266406+0000","last_became_peered":"2023-10-07T08:46:48.266406+0000","last_unstale":"2023-10-07T08:46:48.266634+0000","last_undegraded":"2023-10-07T08:46:48.266634+0000","last_fullsized":"2023-10-07T08:46:48.266634+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:49:28.022869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.266843+0000","last_change":"2023-10-07T08:46:48.266728+0000","last_active":"2023-10-07T08:46:48.266843+0000","last_peered":"2023-10-07T08:46:48.266843+0000","last_clean":"2023-10-07T08:46:48.266843+0000","last_became_active":"2023-10-07T08:46:48.266500+0000","last_became_peered":"2023-10-07T08:46:48.266500+0000","last_unstale":"2023-10-07T08:46:48.266843+0000","last_undegraded":"2023-10-07T08:46:48.266843+0000","last_fullsized":"2023-10-07T08:46:48.266843+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:31:01.003070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.271166+0000","last_change":"2023-10-07T08:46:48.271099+0000","last_active":"2023-10-07T08:46:48.271166+0000","last_peered":"2023-10-07T08:46:48.271166+0000","last_clean":"2023-10-07T08:46:48.271166+0000","last_became_active":"2023-10-07T08:46:48.270885+0000","last_became_peered":"2023-10-07T08:46:48.270885+0000","last_unstale":"2023-10-07T08:46:48.271166+0000","last_undegraded":"2023-10-07T08:46:48.271166+0000","last_fullsized":"2023-10-07T08:46:48.271166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:24:24.288481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.270796+0000","last_change":"2023-10-07T08:46:48.270734+0000","last_active":"2023-10-07T08:46:48.270796+0000","last_peered":"2023-10-07T08:46:48.270796+0000","last_clean":"2023-10-07T08:46:48.270796+0000","last_became_active":"2023-10-07T08:46:48.269248+0000","last_became_peered":"2023-10-07T08:46:48.269248+0000","last_unstale":"2023-10-07T08:46:48.270796+0000","last_undegraded":"2023-10-07T08:46:48.270796+0000","last_fullsized":"2023-10-07T08:46:48.270796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:09:11.051849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.276797+0000","last_change":"2023-10-07T08:46:48.276696+0000","last_active":"2023-10-07T08:46:48.276797+0000","last_peered":"2023-10-07T08:46:48.276797+0000","last_clean":"2023-10-07T08:46:48.276797+0000","last_became_active":"2023-10-07T08:46:48.276442+0000","last_became_peered":"2023-10-07T08:46:48.276442+0000","last_unstale":"2023-10-07T08:46:48.276797+0000","last_undegraded":"2023-10-07T08:46:48.276797+0000","last_fullsized":"2023-10-07T08:46:48.276797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:23:55.200975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.274525+0000","last_change":"2023-10-07T08:46:48.274470+0000","last_active":"2023-10-07T08:46:48.274525+0000","last_peered":"2023-10-07T08:46:48.274525+0000","last_clean":"2023-10-07T08:46:48.274525+0000","last_became_active":"2023-10-07T08:46:48.273884+0000","last_became_peered":"2023-10-07T08:46:48.273884+0000","last_unstale":"2023-10-07T08:46:48.274525+0000","last_undegraded":"2023-10-07T08:46:48.274525+0000","last_fullsized":"2023-10-07T08:46:48.274525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:33.174267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.274035+0000","last_change":"2023-10-07T08:46:48.273975+0000","last_active":"2023-10-07T08:46:48.274035+0000","last_peered":"2023-10-07T08:46:48.274035+0000","last_clean":"2023-10-07T08:46:48.274035+0000","last_became_active":"2023-10-07T08:46:48.273767+0000","last_became_peered":"2023-10-07T08:46:48.273767+0000","last_unstale":"2023-10-07T08:46:48.274035+0000","last_undegraded":"2023-10-07T08:46:48.274035+0000","last_fullsized":"2023-10-07T08:46:48.274035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:05.464820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.265575+0000","last_change":"2023-10-07T08:46:48.265386+0000","last_active":"2023-10-07T08:46:48.265575+0000","last_peered":"2023-10-07T08:46:48.265575+0000","last_clean":"2023-10-07T08:46:48.265575+0000","last_became_active":"2023-10-07T08:46:48.264810+0000","last_became_peered":"2023-10-07T08:46:48.264810+0000","last_unstale":"2023-10-07T08:46:48.265575+0000","last_undegraded":"2023-10-07T08:46:48.265575+0000","last_fullsized":"2023-10-07T08:46:48.265575+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:35:05.459489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269955+0000","last_change":"2023-10-07T08:46:48.269892+0000","last_active":"2023-10-07T08:46:48.269955+0000","last_peered":"2023-10-07T08:46:48.269955+0000","last_clean":"2023-10-07T08:46:48.269955+0000","last_became_active":"2023-10-07T08:46:48.269645+0000","last_became_peered":"2023-10-07T08:46:48.269645+0000","last_unstale":"2023-10-07T08:46:48.269955+0000","last_undegraded":"2023-10-07T08:46:48.269955+0000","last_fullsized":"2023-10-07T08:46:48.269955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:28:28.201624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.268306+0000","last_change":"2023-10-07T08:46:48.268245+0000","last_active":"2023-10-07T08:46:48.268306+0000","last_peered":"2023-10-07T08:46:48.268306+0000","last_clean":"2023-10-07T08:46:48.268306+0000","last_became_active":"2023-10-07T08:46:48.267786+0000","last_became_peered":"2023-10-07T08:46:48.267786+0000","last_unstale":"2023-10-07T08:46:48.268306+0000","last_undegraded":"2023-10-07T08:46:48.268306+0000","last_fullsized":"2023-10-07T08:46:48.268306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:36:29.819095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.270240+0000","last_change":"2023-10-07T08:46:48.270183+0000","last_active":"2023-10-07T08:46:48.270240+0000","last_peered":"2023-10-07T08:46:48.270240+0000","last_clean":"2023-10-07T08:46:48.270240+0000","last_became_active":"2023-10-07T08:46:48.269944+0000","last_became_peered":"2023-10-07T08:46:48.269944+0000","last_unstale":"2023-10-07T08:46:48.270240+0000","last_undegraded":"2023-10-07T08:46:48.270240+0000","last_fullsized":"2023-10-07T08:46:48.270240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:17:14.195866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.266357+0000","last_change":"2023-10-07T08:46:48.266276+0000","last_active":"2023-10-07T08:46:48.266357+0000","last_peered":"2023-10-07T08:46:48.266357+0000","last_clean":"2023-10-07T08:46:48.266357+0000","last_became_active":"2023-10-07T08:46:48.265981+0000","last_became_peered":"2023-10-07T08:46:48.265981+0000","last_unstale":"2023-10-07T08:46:48.266357+0000","last_undegraded":"2023-10-07T08:46:48.266357+0000","last_fullsized":"2023-10-07T08:46:48.266357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:20:31.775459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.262017+0000","last_change":"2023-10-07T08:46:48.261947+0000","last_active":"2023-10-07T08:46:48.262017+0000","last_peered":"2023-10-07T08:46:48.262017+0000","last_clean":"2023-10-07T08:46:48.262017+0000","last_became_active":"2023-10-07T08:46:48.261708+0000","last_became_peered":"2023-10-07T08:46:48.261708+0000","last_unstale":"2023-10-07T08:46:48.262017+0000","last_undegraded":"2023-10-07T08:46:48.262017+0000","last_fullsized":"2023-10-07T08:46:48.262017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:33.571514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.276205+0000","last_change":"2023-10-07T08:46:48.276139+0000","last_active":"2023-10-07T08:46:48.276205+0000","last_peered":"2023-10-07T08:46:48.276205+0000","last_clean":"2023-10-07T08:46:48.276205+0000","last_became_active":"2023-10-07T08:46:48.275904+0000","last_became_peered":"2023-10-07T08:46:48.275904+0000","last_unstale":"2023-10-07T08:46:48.276205+0000","last_undegraded":"2023-10-07T08:46:48.276205+0000","last_fullsized":"2023-10-07T08:46:48.276205+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:53:51.393617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"84'4","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.425001+0000","last_change":"2023-10-07T08:46:47.408081+0000","last_active":"2023-10-07T08:46:48.425001+0000","last_peered":"2023-10-07T08:46:48.425001+0000","last_clean":"2023-10-07T08:46:48.425001+0000","last_became_active":"2023-10-07T08:46:47.407872+0000","last_became_peered":"2023-10-07T08:46:47.407872+0000","last_unstale":"2023-10-07T08:46:48.425001+0000","last_undegraded":"2023-10-07T08:46:48.425001+0000","last_fullsized":"2023-10-07T08:46:48.425001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:08:50.797798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261394+0000","last_change":"2023-10-07T08:46:48.261310+0000","last_active":"2023-10-07T08:46:48.261394+0000","last_peered":"2023-10-07T08:46:48.261394+0000","last_clean":"2023-10-07T08:46:48.261394+0000","last_became_active":"2023-10-07T08:46:48.261093+0000","last_became_peered":"2023-10-07T08:46:48.261093+0000","last_unstale":"2023-10-07T08:46:48.261394+0000","last_undegraded":"2023-10-07T08:46:48.261394+0000","last_fullsized":"2023-10-07T08:46:48.261394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:01:15.363106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.421946+0000","last_change":"2023-10-07T08:46:47.408292+0000","last_active":"2023-10-07T08:46:48.421946+0000","last_peered":"2023-10-07T08:46:48.421946+0000","last_clean":"2023-10-07T08:46:48.421946+0000","last_became_active":"2023-10-07T08:46:47.408015+0000","last_became_peered":"2023-10-07T08:46:47.408015+0000","last_unstale":"2023-10-07T08:46:48.421946+0000","last_undegraded":"2023-10-07T08:46:48.421946+0000","last_fullsized":"2023-10-07T08:46:48.421946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:28:27.197794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.276151+0000","last_change":"2023-10-07T08:46:48.276078+0000","last_active":"2023-10-07T08:46:48.276151+0000","last_peered":"2023-10-07T08:46:48.276151+0000","last_clean":"2023-10-07T08:46:48.276151+0000","last_became_active":"2023-10-07T08:46:48.275507+0000","last_became_peered":"2023-10-07T08:46:48.275507+0000","last_unstale":"2023-10-07T08:46:48.276151+0000","last_undegraded":"2023-10-07T08:46:48.276151+0000","last_fullsized":"2023-10-07T08:46:48.276151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:01:03.720301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.423675+0000","last_change":"2023-10-07T08:46:47.412828+0000","last_active":"2023-10-07T08:46:48.423675+0000","last_peered":"2023-10-07T08:46:48.423675+0000","last_clean":"2023-10-07T08:46:48.423675+0000","last_became_active":"2023-10-07T08:46:47.412618+0000","last_became_peered":"2023-10-07T08:46:47.412618+0000","last_unstale":"2023-10-07T08:46:48.423675+0000","last_undegraded":"2023-10-07T08:46:48.423675+0000","last_fullsized":"2023-10-07T08:46:48.423675+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:32.567685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.271138+0000","last_change":"2023-10-07T08:46:48.271011+0000","last_active":"2023-10-07T08:46:48.271138+0000","last_peered":"2023-10-07T08:46:48.271138+0000","last_clean":"2023-10-07T08:46:48.271138+0000","last_became_active":"2023-10-07T08:46:48.270696+0000","last_became_peered":"2023-10-07T08:46:48.270696+0000","last_unstale":"2023-10-07T08:46:48.271138+0000","last_undegraded":"2023-10-07T08:46:48.271138+0000","last_fullsized":"2023-10-07T08:46:48.271138+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:21:49.143056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.424794+0000","last_change":"2023-10-07T08:46:47.418346+0000","last_active":"2023-10-07T08:46:48.424794+0000","last_peered":"2023-10-07T08:46:48.424794+0000","last_clean":"2023-10-07T08:46:48.424794+0000","last_became_active":"2023-10-07T08:46:47.417910+0000","last_became_peered":"2023-10-07T08:46:47.417910+0000","last_unstale":"2023-10-07T08:46:48.424794+0000","last_undegraded":"2023-10-07T08:46:48.424794+0000","last_fullsized":"2023-10-07T08:46:48.424794+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:42:02.322182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.267259+0000","last_change":"2023-10-07T08:46:48.267192+0000","last_active":"2023-10-07T08:46:48.267259+0000","last_peered":"2023-10-07T08:46:48.267259+0000","last_clean":"2023-10-07T08:46:48.267259+0000","last_became_active":"2023-10-07T08:46:48.266958+0000","last_became_peered":"2023-10-07T08:46:48.266958+0000","last_unstale":"2023-10-07T08:46:48.267259+0000","last_undegraded":"2023-10-07T08:46:48.267259+0000","last_fullsized":"2023-10-07T08:46:48.267259+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:06:55.645362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.422643+0000","last_change":"2023-10-07T08:46:47.408495+0000","last_active":"2023-10-07T08:46:48.422643+0000","last_peered":"2023-10-07T08:46:48.422643+0000","last_clean":"2023-10-07T08:46:48.422643+0000","last_became_active":"2023-10-07T08:46:47.408296+0000","last_became_peered":"2023-10-07T08:46:47.408296+0000","last_unstale":"2023-10-07T08:46:48.422643+0000","last_undegraded":"2023-10-07T08:46:48.422643+0000","last_fullsized":"2023-10-07T08:46:48.422643+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:06:54.641533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.273245+0000","last_change":"2023-10-07T08:46:48.273169+0000","last_active":"2023-10-07T08:46:48.273245+0000","last_peered":"2023-10-07T08:46:48.273245+0000","last_clean":"2023-10-07T08:46:48.273245+0000","last_became_active":"2023-10-07T08:46:48.272921+0000","last_became_peered":"2023-10-07T08:46:48.272921+0000","last_unstale":"2023-10-07T08:46:48.273245+0000","last_undegraded":"2023-10-07T08:46:48.273245+0000","last_fullsized":"2023-10-07T08:46:48.273245+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:26:07.798358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.423168+0000","last_change":"2023-10-07T08:46:47.412902+0000","last_active":"2023-10-07T08:46:48.423168+0000","last_peered":"2023-10-07T08:46:48.423168+0000","last_clean":"2023-10-07T08:46:48.423168+0000","last_became_active":"2023-10-07T08:46:47.412434+0000","last_became_peered":"2023-10-07T08:46:47.412434+0000","last_unstale":"2023-10-07T08:46:48.423168+0000","last_undegraded":"2023-10-07T08:46:48.423168+0000","last_fullsized":"2023-10-07T08:46:48.423168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:56:37.840040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.271130+0000","last_change":"2023-10-07T08:46:48.271094+0000","last_active":"2023-10-07T08:46:48.271130+0000","last_peered":"2023-10-07T08:46:48.271130+0000","last_clean":"2023-10-07T08:46:48.271130+0000","last_became_active":"2023-10-07T08:46:48.270974+0000","last_became_peered":"2023-10-07T08:46:48.270974+0000","last_unstale":"2023-10-07T08:46:48.271130+0000","last_undegraded":"2023-10-07T08:46:48.271130+0000","last_fullsized":"2023-10-07T08:46:48.271130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:10.689376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.263856+0000","last_change":"2023-10-07T08:46:47.411077+0000","last_active":"2023-10-07T08:46:48.263856+0000","last_peered":"2023-10-07T08:46:48.263856+0000","last_clean":"2023-10-07T08:46:48.263856+0000","last_became_active":"2023-10-07T08:46:47.410190+0000","last_became_peered":"2023-10-07T08:46:47.410190+0000","last_unstale":"2023-10-07T08:46:48.263856+0000","last_undegraded":"2023-10-07T08:46:48.263856+0000","last_fullsized":"2023-10-07T08:46:48.263856+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:00.704905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.267219+0000","last_change":"2023-10-07T08:46:48.267156+0000","last_active":"2023-10-07T08:46:48.267219+0000","last_peered":"2023-10-07T08:46:48.267219+0000","last_clean":"2023-10-07T08:46:48.267219+0000","last_became_active":"2023-10-07T08:46:48.266938+0000","last_became_peered":"2023-10-07T08:46:48.266938+0000","last_unstale":"2023-10-07T08:46:48.267219+0000","last_undegraded":"2023-10-07T08:46:48.267219+0000","last_fullsized":"2023-10-07T08:46:48.267219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:18:10.096148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.259630+0000","last_change":"2023-10-07T08:46:47.407244+0000","last_active":"2023-10-07T08:46:48.259630+0000","last_peered":"2023-10-07T08:46:48.259630+0000","last_clean":"2023-10-07T08:46:48.259630+0000","last_became_active":"2023-10-07T08:46:47.407038+0000","last_became_peered":"2023-10-07T08:46:47.407038+0000","last_unstale":"2023-10-07T08:46:48.259630+0000","last_undegraded":"2023-10-07T08:46:48.259630+0000","last_fullsized":"2023-10-07T08:46:48.259630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:38:26.656578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.272516+0000","last_change":"2023-10-07T08:46:48.272421+0000","last_active":"2023-10-07T08:46:48.272516+0000","last_peered":"2023-10-07T08:46:48.272516+0000","last_clean":"2023-10-07T08:46:48.272516+0000","last_became_active":"2023-10-07T08:46:48.272063+0000","last_became_peered":"2023-10-07T08:46:48.272063+0000","last_unstale":"2023-10-07T08:46:48.272516+0000","last_undegraded":"2023-10-07T08:46:48.272516+0000","last_fullsized":"2023-10-07T08:46:48.272516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:18:10.096148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.264788+0000","last_change":"2023-10-07T08:46:47.410849+0000","last_active":"2023-10-07T08:46:48.264788+0000","last_peered":"2023-10-07T08:46:48.264788+0000","last_clean":"2023-10-07T08:46:48.264788+0000","last_became_active":"2023-10-07T08:46:47.410513+0000","last_became_peered":"2023-10-07T08:46:47.410513+0000","last_unstale":"2023-10-07T08:46:48.264788+0000","last_undegraded":"2023-10-07T08:46:48.264788+0000","last_fullsized":"2023-10-07T08:46:48.264788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:25:08.768283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.276542+0000","last_change":"2023-10-07T08:46:48.276466+0000","last_active":"2023-10-07T08:46:48.276542+0000","last_peered":"2023-10-07T08:46:48.276542+0000","last_clean":"2023-10-07T08:46:48.276542+0000","last_became_active":"2023-10-07T08:46:48.275860+0000","last_became_peered":"2023-10-07T08:46:48.275860+0000","last_unstale":"2023-10-07T08:46:48.276542+0000","last_undegraded":"2023-10-07T08:46:48.276542+0000","last_fullsized":"2023-10-07T08:46:48.276542+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:29:01.300380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.260561+0000","last_change":"2023-10-07T08:46:47.416262+0000","last_active":"2023-10-07T08:46:48.260561+0000","last_peered":"2023-10-07T08:46:48.260561+0000","last_clean":"2023-10-07T08:46:48.260561+0000","last_became_active":"2023-10-07T08:46:47.415844+0000","last_became_peered":"2023-10-07T08:46:47.415844+0000","last_unstale":"2023-10-07T08:46:48.260561+0000","last_undegraded":"2023-10-07T08:46:48.260561+0000","last_fullsized":"2023-10-07T08:46:48.260561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:44:13.593262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.266972+0000","last_change":"2023-10-07T08:46:48.266518+0000","last_active":"2023-10-07T08:46:48.266972+0000","last_peered":"2023-10-07T08:46:48.266972+0000","last_clean":"2023-10-07T08:46:48.266972+0000","last_became_active":"2023-10-07T08:46:48.265989+0000","last_became_peered":"2023-10-07T08:46:48.265989+0000","last_unstale":"2023-10-07T08:46:48.266972+0000","last_undegraded":"2023-10-07T08:46:48.266972+0000","last_fullsized":"2023-10-07T08:46:48.266972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:11:31.567925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"84'3","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.422513+0000","last_change":"2023-10-07T08:46:47.409848+0000","last_active":"2023-10-07T08:46:48.422513+0000","last_peered":"2023-10-07T08:46:48.422513+0000","last_clean":"2023-10-07T08:46:48.422513+0000","last_became_active":"2023-10-07T08:46:47.408881+0000","last_became_peered":"2023-10-07T08:46:47.408881+0000","last_unstale":"2023-10-07T08:46:48.422513+0000","last_undegraded":"2023-10-07T08:46:48.422513+0000","last_fullsized":"2023-10-07T08:46:48.422513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:04.460990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269178+0000","last_change":"2023-10-07T08:46:48.269136+0000","last_active":"2023-10-07T08:46:48.269178+0000","last_peered":"2023-10-07T08:46:48.269178+0000","last_clean":"2023-10-07T08:46:48.269178+0000","last_became_active":"2023-10-07T08:46:48.268935+0000","last_became_peered":"2023-10-07T08:46:48.268935+0000","last_unstale":"2023-10-07T08:46:48.269178+0000","last_undegraded":"2023-10-07T08:46:48.269178+0000","last_fullsized":"2023-10-07T08:46:48.269178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:15:11.308554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"84'6","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.423476+0000","last_change":"2023-10-07T08:46:47.406377+0000","last_active":"2023-10-07T08:46:48.423476+0000","last_peered":"2023-10-07T08:46:48.423476+0000","last_clean":"2023-10-07T08:46:48.423476+0000","last_became_active":"2023-10-07T08:46:47.406134+0000","last_became_peered":"2023-10-07T08:46:47.406134+0000","last_unstale":"2023-10-07T08:46:48.423476+0000","last_undegraded":"2023-10-07T08:46:48.423476+0000","last_fullsized":"2023-10-07T08:46:48.423476+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:04:32.853733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269731+0000","last_change":"2023-10-07T08:46:48.269648+0000","last_active":"2023-10-07T08:46:48.269731+0000","last_peered":"2023-10-07T08:46:48.269731+0000","last_clean":"2023-10-07T08:46:48.269731+0000","last_became_active":"2023-10-07T08:46:48.268081+0000","last_became_peered":"2023-10-07T08:46:48.268081+0000","last_unstale":"2023-10-07T08:46:48.269731+0000","last_undegraded":"2023-10-07T08:46:48.269731+0000","last_fullsized":"2023-10-07T08:46:48.269731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:17:14.195866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.424174+0000","last_change":"2023-10-07T08:46:47.408151+0000","last_active":"2023-10-07T08:46:48.424174+0000","last_peered":"2023-10-07T08:46:48.424174+0000","last_clean":"2023-10-07T08:46:48.424174+0000","last_became_active":"2023-10-07T08:46:47.407856+0000","last_became_peered":"2023-10-07T08:46:47.407856+0000","last_unstale":"2023-10-07T08:46:48.424174+0000","last_undegraded":"2023-10-07T08:46:48.424174+0000","last_fullsized":"2023-10-07T08:46:48.424174+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:18:14.571329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.273533+0000","last_change":"2023-10-07T08:46:48.273470+0000","last_active":"2023-10-07T08:46:48.273533+0000","last_peered":"2023-10-07T08:46:48.273533+0000","last_clean":"2023-10-07T08:46:48.273533+0000","last_became_active":"2023-10-07T08:46:48.273246+0000","last_became_peered":"2023-10-07T08:46:48.273246+0000","last_unstale":"2023-10-07T08:46:48.273533+0000","last_undegraded":"2023-10-07T08:46:48.273533+0000","last_fullsized":"2023-10-07T08:46:48.273533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:21:49.143056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261644+0000","last_change":"2023-10-07T08:46:47.418233+0000","last_active":"2023-10-07T08:46:48.261644+0000","last_peered":"2023-10-07T08:46:48.261644+0000","last_clean":"2023-10-07T08:46:48.261644+0000","last_became_active":"2023-10-07T08:46:47.417563+0000","last_became_peered":"2023-10-07T08:46:47.417563+0000","last_unstale":"2023-10-07T08:46:48.261644+0000","last_undegraded":"2023-10-07T08:46:48.261644+0000","last_fullsized":"2023-10-07T08:46:48.261644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:47:18.273000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269567+0000","last_change":"2023-10-07T08:46:48.269486+0000","last_active":"2023-10-07T08:46:48.269567+0000","last_peered":"2023-10-07T08:46:48.269567+0000","last_clean":"2023-10-07T08:46:48.269567+0000","last_became_active":"2023-10-07T08:46:48.269007+0000","last_became_peered":"2023-10-07T08:46:48.269007+0000","last_unstale":"2023-10-07T08:46:48.269567+0000","last_undegraded":"2023-10-07T08:46:48.269567+0000","last_fullsized":"2023-10-07T08:46:48.269567+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:41:48.420830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.271072+0000","last_change":"2023-10-07T08:46:47.409199+0000","last_active":"2023-10-07T08:46:48.271072+0000","last_peered":"2023-10-07T08:46:48.271072+0000","last_clean":"2023-10-07T08:46:48.271072+0000","last_became_active":"2023-10-07T08:46:47.408977+0000","last_became_peered":"2023-10-07T08:46:47.408977+0000","last_unstale":"2023-10-07T08:46:48.271072+0000","last_undegraded":"2023-10-07T08:46:48.271072+0000","last_fullsized":"2023-10-07T08:46:48.271072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:24:23.284652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.263996+0000","last_change":"2023-10-07T08:46:48.263567+0000","last_active":"2023-10-07T08:46:48.263996+0000","last_peered":"2023-10-07T08:46:48.263996+0000","last_clean":"2023-10-07T08:46:48.263996+0000","last_became_active":"2023-10-07T08:46:48.263065+0000","last_became_peered":"2023-10-07T08:46:48.263065+0000","last_unstale":"2023-10-07T08:46:48.263996+0000","last_undegraded":"2023-10-07T08:46:48.263996+0000","last_fullsized":"2023-10-07T08:46:48.263996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:57:24.673413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"84'8","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.425165+0000","last_change":"2023-10-07T08:46:47.412124+0000","last_active":"2023-10-07T08:46:48.425165+0000","last_peered":"2023-10-07T08:46:48.425165+0000","last_clean":"2023-10-07T08:46:48.425165+0000","last_became_active":"2023-10-07T08:46:47.411751+0000","last_became_peered":"2023-10-07T08:46:47.411751+0000","last_unstale":"2023-10-07T08:46:48.425165+0000","last_undegraded":"2023-10-07T08:46:48.425165+0000","last_fullsized":"2023-10-07T08:46:48.425165+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:50:25.441575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269438+0000","last_change":"2023-10-07T08:46:48.269360+0000","last_active":"2023-10-07T08:46:48.269438+0000","last_peered":"2023-10-07T08:46:48.269438+0000","last_clean":"2023-10-07T08:46:48.269438+0000","last_became_active":"2023-10-07T08:46:48.269109+0000","last_became_peered":"2023-10-07T08:46:48.269109+0000","last_unstale":"2023-10-07T08:46:48.269438+0000","last_undegraded":"2023-10-07T08:46:48.269438+0000","last_fullsized":"2023-10-07T08:46:48.269438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:16.353026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.424099+0000","last_change":"2023-10-07T08:46:47.411441+0000","last_active":"2023-10-07T08:46:48.424099+0000","last_peered":"2023-10-07T08:46:48.424099+0000","last_clean":"2023-10-07T08:46:48.424099+0000","last_became_active":"2023-10-07T08:46:47.409077+0000","last_became_peered":"2023-10-07T08:46:47.409077+0000","last_unstale":"2023-10-07T08:46:48.424099+0000","last_undegraded":"2023-10-07T08:46:48.424099+0000","last_fullsized":"2023-10-07T08:46:48.424099+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:42:25.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.274043+0000","last_change":"2023-10-07T08:46:48.273469+0000","last_active":"2023-10-07T08:46:48.274043+0000","last_peered":"2023-10-07T08:46:48.274043+0000","last_clean":"2023-10-07T08:46:48.274043+0000","last_became_active":"2023-10-07T08:46:48.273180+0000","last_became_peered":"2023-10-07T08:46:48.273180+0000","last_unstale":"2023-10-07T08:46:48.274043+0000","last_undegraded":"2023-10-07T08:46:48.274043+0000","last_fullsized":"2023-10-07T08:46:48.274043+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:06:55.645362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.423913+0000","last_change":"2023-10-07T08:46:47.410171+0000","last_active":"2023-10-07T08:46:48.423913+0000","last_peered":"2023-10-07T08:46:48.423913+0000","last_clean":"2023-10-07T08:46:48.423913+0000","last_became_active":"2023-10-07T08:46:47.409944+0000","last_became_peered":"2023-10-07T08:46:47.409944+0000","last_unstale":"2023-10-07T08:46:48.423913+0000","last_undegraded":"2023-10-07T08:46:48.423913+0000","last_fullsized":"2023-10-07T08:46:48.423913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:09:58.063139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.265934+0000","last_change":"2023-10-07T08:46:48.265878+0000","last_active":"2023-10-07T08:46:48.265934+0000","last_peered":"2023-10-07T08:46:48.265934+0000","last_clean":"2023-10-07T08:46:48.265934+0000","last_became_active":"2023-10-07T08:46:48.265665+0000","last_became_peered":"2023-10-07T08:46:48.265665+0000","last_unstale":"2023-10-07T08:46:48.265934+0000","last_undegraded":"2023-10-07T08:46:48.265934+0000","last_fullsized":"2023-10-07T08:46:48.265934+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:54:27.000576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.424988+0000","last_change":"2023-10-07T08:46:47.418126+0000","last_active":"2023-10-07T08:46:48.424988+0000","last_peered":"2023-10-07T08:46:48.424988+0000","last_clean":"2023-10-07T08:46:48.424988+0000","last_became_active":"2023-10-07T08:46:47.416880+0000","last_became_peered":"2023-10-07T08:46:47.416880+0000","last_unstale":"2023-10-07T08:46:48.424988+0000","last_undegraded":"2023-10-07T08:46:48.424988+0000","last_fullsized":"2023-10-07T08:46:48.424988+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:03:49.129015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.267507+0000","last_change":"2023-10-07T08:46:48.267405+0000","last_active":"2023-10-07T08:46:48.267507+0000","last_peered":"2023-10-07T08:46:48.267507+0000","last_clean":"2023-10-07T08:46:48.267507+0000","last_became_active":"2023-10-07T08:46:48.267178+0000","last_became_peered":"2023-10-07T08:46:48.267178+0000","last_unstale":"2023-10-07T08:46:48.267507+0000","last_undegraded":"2023-10-07T08:46:48.267507+0000","last_fullsized":"2023-10-07T08:46:48.267507+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:15:41.344797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.263975+0000","last_change":"2023-10-07T08:46:47.409378+0000","last_active":"2023-10-07T08:46:48.263975+0000","last_peered":"2023-10-07T08:46:48.263975+0000","last_clean":"2023-10-07T08:46:48.263975+0000","last_became_active":"2023-10-07T08:46:47.409137+0000","last_became_peered":"2023-10-07T08:46:47.409137+0000","last_unstale":"2023-10-07T08:46:48.263975+0000","last_undegraded":"2023-10-07T08:46:48.263975+0000","last_fullsized":"2023-10-07T08:46:48.263975+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:24:23.284652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269337+0000","last_change":"2023-10-07T08:46:48.269260+0000","last_active":"2023-10-07T08:46:48.269337+0000","last_peered":"2023-10-07T08:46:48.269337+0000","last_clean":"2023-10-07T08:46:48.269337+0000","last_became_active":"2023-10-07T08:46:48.269061+0000","last_became_peered":"2023-10-07T08:46:48.269061+0000","last_unstale":"2023-10-07T08:46:48.269337+0000","last_undegraded":"2023-10-07T08:46:48.269337+0000","last_fullsized":"2023-10-07T08:46:48.269337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:24:47.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261015+0000","last_change":"2023-10-07T08:46:47.412869+0000","last_active":"2023-10-07T08:46:48.261015+0000","last_peered":"2023-10-07T08:46:48.261015+0000","last_clean":"2023-10-07T08:46:48.261015+0000","last_became_active":"2023-10-07T08:46:47.412388+0000","last_became_peered":"2023-10-07T08:46:47.412388+0000","last_unstale":"2023-10-07T08:46:48.261015+0000","last_undegraded":"2023-10-07T08:46:48.261015+0000","last_fullsized":"2023-10-07T08:46:48.261015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:15:40.340968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.262818+0000","last_change":"2023-10-07T08:46:48.262762+0000","last_active":"2023-10-07T08:46:48.262818+0000","last_peered":"2023-10-07T08:46:48.262818+0000","last_clean":"2023-10-07T08:46:48.262818+0000","last_became_active":"2023-10-07T08:46:48.262548+0000","last_became_peered":"2023-10-07T08:46:48.262548+0000","last_unstale":"2023-10-07T08:46:48.262818+0000","last_undegraded":"2023-10-07T08:46:48.262818+0000","last_fullsized":"2023-10-07T08:46:48.262818+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:29.739814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.265014+0000","last_change":"2023-10-07T08:46:47.408506+0000","last_active":"2023-10-07T08:46:48.265014+0000","last_peered":"2023-10-07T08:46:48.265014+0000","last_clean":"2023-10-07T08:46:48.265014+0000","last_became_active":"2023-10-07T08:46:47.408289+0000","last_became_peered":"2023-10-07T08:46:47.408289+0000","last_unstale":"2023-10-07T08:46:48.265014+0000","last_undegraded":"2023-10-07T08:46:48.265014+0000","last_fullsized":"2023-10-07T08:46:48.265014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:08:50.797798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261673+0000","last_change":"2023-10-07T08:46:48.261604+0000","last_active":"2023-10-07T08:46:48.261673+0000","last_peered":"2023-10-07T08:46:48.261673+0000","last_clean":"2023-10-07T08:46:48.261673+0000","last_became_active":"2023-10-07T08:46:48.261370+0000","last_became_peered":"2023-10-07T08:46:48.261370+0000","last_unstale":"2023-10-07T08:46:48.261673+0000","last_undegraded":"2023-10-07T08:46:48.261673+0000","last_fullsized":"2023-10-07T08:46:48.261673+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:09.862599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261669+0000","last_change":"2023-10-07T08:46:47.411618+0000","last_active":"2023-10-07T08:46:48.261669+0000","last_peered":"2023-10-07T08:46:48.261669+0000","last_clean":"2023-10-07T08:46:48.261669+0000","last_became_active":"2023-10-07T08:46:47.411344+0000","last_became_peered":"2023-10-07T08:46:47.411344+0000","last_unstale":"2023-10-07T08:46:48.261669+0000","last_undegraded":"2023-10-07T08:46:48.261669+0000","last_fullsized":"2023-10-07T08:46:48.261669+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:32.170438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.265025+0000","last_change":"2023-10-07T08:46:48.264966+0000","last_active":"2023-10-07T08:46:48.265025+0000","last_peered":"2023-10-07T08:46:48.265025+0000","last_clean":"2023-10-07T08:46:48.265025+0000","last_became_active":"2023-10-07T08:46:48.264738+0000","last_became_peered":"2023-10-07T08:46:48.264738+0000","last_unstale":"2023-10-07T08:46:48.265025+0000","last_undegraded":"2023-10-07T08:46:48.265025+0000","last_fullsized":"2023-10-07T08:46:48.265025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:58:06.437294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.423806+0000","last_change":"2023-10-07T08:46:47.416108+0000","last_active":"2023-10-07T08:46:48.423806+0000","last_peered":"2023-10-07T08:46:48.423806+0000","last_clean":"2023-10-07T08:46:48.423806+0000","last_became_active":"2023-10-07T08:46:47.415508+0000","last_became_peered":"2023-10-07T08:46:47.415508+0000","last_unstale":"2023-10-07T08:46:48.423806+0000","last_undegraded":"2023-10-07T08:46:48.423806+0000","last_fullsized":"2023-10-07T08:46:48.423806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:01:14.359277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.272483+0000","last_change":"2023-10-07T08:46:48.271838+0000","last_active":"2023-10-07T08:46:48.272483+0000","last_peered":"2023-10-07T08:46:48.272483+0000","last_clean":"2023-10-07T08:46:48.272483+0000","last_became_active":"2023-10-07T08:46:48.271316+0000","last_became_peered":"2023-10-07T08:46:48.271316+0000","last_unstale":"2023-10-07T08:46:48.272483+0000","last_undegraded":"2023-10-07T08:46:48.272483+0000","last_fullsized":"2023-10-07T08:46:48.272483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:57:20.107008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.264466+0000","last_change":"2023-10-07T08:46:47.410107+0000","last_active":"2023-10-07T08:46:48.264466+0000","last_peered":"2023-10-07T08:46:48.264466+0000","last_clean":"2023-10-07T08:46:48.264466+0000","last_became_active":"2023-10-07T08:46:47.409630+0000","last_became_peered":"2023-10-07T08:46:47.409630+0000","last_unstale":"2023-10-07T08:46:48.264466+0000","last_undegraded":"2023-10-07T08:46:48.264466+0000","last_fullsized":"2023-10-07T08:46:48.264466+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:26:06.794529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.275397+0000","last_change":"2023-10-07T08:46:48.275132+0000","last_active":"2023-10-07T08:46:48.275397+0000","last_peered":"2023-10-07T08:46:48.275397+0000","last_clean":"2023-10-07T08:46:48.275397+0000","last_became_active":"2023-10-07T08:46:48.274187+0000","last_became_peered":"2023-10-07T08:46:48.274187+0000","last_unstale":"2023-10-07T08:46:48.275397+0000","last_undegraded":"2023-10-07T08:46:48.275397+0000","last_fullsized":"2023-10-07T08:46:48.275397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:07:00.864605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.259881+0000","last_change":"2023-10-07T08:46:47.407283+0000","last_active":"2023-10-07T08:46:48.259881+0000","last_peered":"2023-10-07T08:46:48.259881+0000","last_clean":"2023-10-07T08:46:48.259881+0000","last_became_active":"2023-10-07T08:46:47.406998+0000","last_became_peered":"2023-10-07T08:46:47.406998+0000","last_unstale":"2023-10-07T08:46:48.259881+0000","last_undegraded":"2023-10-07T08:46:48.259881+0000","last_fullsized":"2023-10-07T08:46:48.259881+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:24:09.253730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.272557+0000","last_change":"2023-10-07T08:46:48.272487+0000","last_active":"2023-10-07T08:46:48.272557+0000","last_peered":"2023-10-07T08:46:48.272557+0000","last_clean":"2023-10-07T08:46:48.272557+0000","last_became_active":"2023-10-07T08:46:48.272052+0000","last_became_peered":"2023-10-07T08:46:48.272052+0000","last_unstale":"2023-10-07T08:46:48.272557+0000","last_undegraded":"2023-10-07T08:46:48.272557+0000","last_fullsized":"2023-10-07T08:46:48.272557+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:28:54.454460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.262818+0000","last_change":"2023-10-07T08:46:47.409633+0000","last_active":"2023-10-07T08:46:48.262818+0000","last_peered":"2023-10-07T08:46:48.262818+0000","last_clean":"2023-10-07T08:46:48.262818+0000","last_became_active":"2023-10-07T08:46:47.409419+0000","last_became_peered":"2023-10-07T08:46:47.409419+0000","last_unstale":"2023-10-07T08:46:48.262818+0000","last_undegraded":"2023-10-07T08:46:48.262818+0000","last_fullsized":"2023-10-07T08:46:48.262818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:26:06.794529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.262123+0000","last_change":"2023-10-07T08:46:48.262068+0000","last_active":"2023-10-07T08:46:48.262123+0000","last_peered":"2023-10-07T08:46:48.262123+0000","last_clean":"2023-10-07T08:46:48.262123+0000","last_became_active":"2023-10-07T08:46:48.261838+0000","last_became_peered":"2023-10-07T08:46:48.261838+0000","last_unstale":"2023-10-07T08:46:48.262123+0000","last_undegraded":"2023-10-07T08:46:48.262123+0000","last_fullsized":"2023-10-07T08:46:48.262123+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:06:53.969456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.259323+0000","last_change":"2023-10-07T08:46:47.409428+0000","last_active":"2023-10-07T08:46:48.259323+0000","last_peered":"2023-10-07T08:46:48.259323+0000","last_clean":"2023-10-07T08:46:48.259323+0000","last_became_active":"2023-10-07T08:46:47.408963+0000","last_became_peered":"2023-10-07T08:46:47.408963+0000","last_unstale":"2023-10-07T08:46:48.259323+0000","last_undegraded":"2023-10-07T08:46:48.259323+0000","last_fullsized":"2023-10-07T08:46:48.259323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:29.753321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.275871+0000","last_change":"2023-10-07T08:46:48.275802+0000","last_active":"2023-10-07T08:46:48.275871+0000","last_peered":"2023-10-07T08:46:48.275871+0000","last_clean":"2023-10-07T08:46:48.275871+0000","last_became_active":"2023-10-07T08:46:48.275216+0000","last_became_peered":"2023-10-07T08:46:48.275216+0000","last_unstale":"2023-10-07T08:46:48.275871+0000","last_undegraded":"2023-10-07T08:46:48.275871+0000","last_fullsized":"2023-10-07T08:46:48.275871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:11.268440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.263774+0000","last_change":"2023-10-07T08:46:47.412001+0000","last_active":"2023-10-07T08:46:48.263774+0000","last_peered":"2023-10-07T08:46:48.263774+0000","last_clean":"2023-10-07T08:46:48.263774+0000","last_became_active":"2023-10-07T08:46:47.411776+0000","last_became_peered":"2023-10-07T08:46:47.411776+0000","last_unstale":"2023-10-07T08:46:48.263774+0000","last_undegraded":"2023-10-07T08:46:48.263774+0000","last_fullsized":"2023-10-07T08:46:48.263774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:53:48.874357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.267398+0000","last_change":"2023-10-07T08:46:48.267320+0000","last_active":"2023-10-07T08:46:48.267398+0000","last_peered":"2023-10-07T08:46:48.267398+0000","last_clean":"2023-10-07T08:46:48.267398+0000","last_became_active":"2023-10-07T08:46:48.266986+0000","last_became_peered":"2023-10-07T08:46:48.266986+0000","last_unstale":"2023-10-07T08:46:48.267398+0000","last_undegraded":"2023-10-07T08:46:48.267398+0000","last_fullsized":"2023-10-07T08:46:48.267398+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:33.571514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.266318+0000","last_change":"2023-10-07T08:46:47.411984+0000","last_active":"2023-10-07T08:46:48.266318+0000","last_peered":"2023-10-07T08:46:48.266318+0000","last_clean":"2023-10-07T08:46:48.266318+0000","last_became_active":"2023-10-07T08:46:47.411435+0000","last_became_peered":"2023-10-07T08:46:47.411435+0000","last_unstale":"2023-10-07T08:46:48.266318+0000","last_undegraded":"2023-10-07T08:46:48.266318+0000","last_fullsized":"2023-10-07T08:46:48.266318+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:54:25.996746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261511+0000","last_change":"2023-10-07T08:46:48.261460+0000","last_active":"2023-10-07T08:46:48.261511+0000","last_peered":"2023-10-07T08:46:48.261511+0000","last_clean":"2023-10-07T08:46:48.261511+0000","last_became_active":"2023-10-07T08:46:48.261289+0000","last_became_peered":"2023-10-07T08:46:48.261289+0000","last_unstale":"2023-10-07T08:46:48.261511+0000","last_undegraded":"2023-10-07T08:46:48.261511+0000","last_fullsized":"2023-10-07T08:46:48.261511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:53:49.878186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261106+0000","last_change":"2023-10-07T08:46:47.415036+0000","last_active":"2023-10-07T08:46:48.261106+0000","last_peered":"2023-10-07T08:46:48.261106+0000","last_clean":"2023-10-07T08:46:48.261106+0000","last_became_active":"2023-10-07T08:46:47.414822+0000","last_became_peered":"2023-10-07T08:46:47.414822+0000","last_unstale":"2023-10-07T08:46:48.261106+0000","last_undegraded":"2023-10-07T08:46:48.261106+0000","last_fullsized":"2023-10-07T08:46:48.261106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:37.508902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261700+0000","last_change":"2023-10-07T08:46:48.261646+0000","last_active":"2023-10-07T08:46:48.261700+0000","last_peered":"2023-10-07T08:46:48.261700+0000","last_clean":"2023-10-07T08:46:48.261700+0000","last_became_active":"2023-10-07T08:46:48.261439+0000","last_became_peered":"2023-10-07T08:46:48.261439+0000","last_unstale":"2023-10-07T08:46:48.261700+0000","last_undegraded":"2023-10-07T08:46:48.261700+0000","last_fullsized":"2023-10-07T08:46:48.261700+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:02:23.966054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.424914+0000","last_change":"2023-10-07T08:46:47.414668+0000","last_active":"2023-10-07T08:46:48.424914+0000","last_peered":"2023-10-07T08:46:48.424914+0000","last_clean":"2023-10-07T08:46:48.424914+0000","last_became_active":"2023-10-07T08:46:47.413391+0000","last_became_peered":"2023-10-07T08:46:47.413391+0000","last_unstale":"2023-10-07T08:46:48.424914+0000","last_undegraded":"2023-10-07T08:46:48.424914+0000","last_fullsized":"2023-10-07T08:46:48.424914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:09.685547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":216,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.266237+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:46:48.266237+0000","last_peered":"2023-10-07T08:46:48.266237+0000","last_clean":"2023-10-07T08:46:48.266237+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:46:48.266237+0000","last_undegraded":"2023-10-07T08:46:48.266237+0000","last_fullsized":"2023-10-07T08:46:48.266237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1008,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194304,"statfs":{"total":200000000,"available":198967401,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:45:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.49399999999999999},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.496,"15min":0.48199999999999998},"min":{"1min":0.35099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.65000000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:45:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70499999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.69599999999999995}]},{"osd":2,"last update":"Sat Oct 7 08:45:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73299999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.625},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.496,"15min":0.48399999999999999},"min":{"1min":0.34300000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71699999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:45:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.76700000000000002,"15min":0.85299999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77200000000000002,"5min":6.8570000000000002,"15min":6.8570000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":0.72299999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.68000000000000005}]},{"osd":4,"last update":"Sat Oct 7 08:45:50 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48299999999999998,"15min":0.48599999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.40200000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.78400000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.43099999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:45:50 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73399999999999999,"5min":0.746,"15min":0.746},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.35499999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.47199999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:45:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59299999999999997,"15min":0.59999999999999998},"min":{"1min":0.43099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.37,"5min":0.318,"15min":0.318},"max":{"1min":0.80200000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.49199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":431,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194881,"statfs":{"total":200000000,"available":199558265,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:45:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47199999999999998,"15min":0.46500000000000002},"min":{"1min":0.34300000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35799999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67500000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.54900000000000004}]},{"osd":1,"last update":"Sat Oct 7 08:45:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.622,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.46600000000000003}]},{"osd":2,"last update":"Sat Oct 7 08:45:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.46800000000000003},"min":{"1min":0.373,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68700000000000006,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64300000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.56399999999999995}]},{"osd":3,"last update":"Sat Oct 7 08:45:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.503,"15min":0.502},"min":{"1min":0.40699999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65500000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.442},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.52700000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69799999999999995,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.48599999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:45:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.31900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.64100000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.32600000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61899999999999999,"5min":0.748,"15min":0.748},"last":0.503}]},{"osd":5,"last update":"Sat Oct 7 08:45:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50900000000000001,"15min":0.5},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.74199999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68300000000000005,"5min":0.748,"15min":0.748},"last":0.60199999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:45:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.36699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.71899999999999997,"5min":0.754,"15min":0.754},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76700000000000002,"5min":1.052,"15min":1.052},"last":0.60999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":439,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194872,"statfs":{"total":200000000,"available":199549945,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34000000000000002,"15min":0.31},"min":{"1min":0.19400000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.46200000000000002,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.34399999999999997,"15min":0.32400000000000001},"min":{"1min":0.221,"5min":0.192,"15min":0.192},"max":{"1min":0.51500000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:46:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.315},"min":{"1min":0.25900000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48599999999999999,"5min":1.639,"15min":1.639},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.373,"15min":0.32700000000000001},"min":{"1min":0.23599999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52700000000000002,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.38700000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:46:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56200000000000006,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.34200000000000003},"min":{"1min":0.30599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55000000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:46:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.40600000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85299999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.55700000000000005,"15min":0.52000000000000002},"min":{"1min":0.41899999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.89300000000000002,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.44600000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:46:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.495},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.58699999999999997,"15min":0.56299999999999994},"min":{"1min":0.496,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90700000000000003,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.56799999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:46:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.45200000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.55300000000000005,"15min":0.52000000000000002},"min":{"1min":0.41399999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82399999999999995,"5min":0.87,"15min":0.87},"last":0.46500000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:46:49 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.47099999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81599999999999995,"5min":1.04,"15min":1.04},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.59899999999999998,"15min":0.57599999999999996},"min":{"1min":0.45300000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84299999999999997,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1007,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194304,"statfs":{"total":200000000,"available":198967989,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34599999999999997,"15min":0.372},"min":{"1min":0.24199999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.48999999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.378,"15min":0.39500000000000002},"min":{"1min":0.29499999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59099999999999997,"5min":1.079,"15min":1.079},"last":0.29299999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.376,"15min":0.39200000000000002},"min":{"1min":0.27400000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.62,"5min":1.464,"15min":1.464},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39500000000000002,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51200000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.34499999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.374,"15min":0.38600000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.497,"5min":1.341,"15min":1.341},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.42299999999999999,"15min":0.436},"min":{"1min":0.29799999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56999999999999995,"5min":1.532,"15min":1.532},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71799999999999997,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59199999999999997,"15min":0.61199999999999999},"min":{"1min":0.433,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84899999999999998,"5min":1.51,"15min":1.51},"last":0.72699999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58999999999999997,"15min":0.59799999999999998},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.75900000000000001,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.90100000000000002,"5min":1.25,"15min":1.25},"last":0.61599999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.41499999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85099999999999998,"5min":1.488,"15min":1.488},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86899999999999999,"5min":1.024,"15min":1.024},"last":0.67900000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88200000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.60599999999999998},"min":{"1min":0.40899999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.83799999999999997,"5min":1.288,"15min":1.288},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":432,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194879,"statfs":{"total":200000000,"available":199556821,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33900000000000002,"15min":0.34599999999999997},"min":{"1min":0.192,"5min":0.187,"15min":0.187},"max":{"1min":0.52800000000000002,"5min":1.665,"15min":1.665},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35599999999999998,"15min":0.36199999999999999},"min":{"1min":0.22900000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47899999999999998,"5min":1.579,"15min":1.579},"last":0.376}]},{"osd":1,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.36599999999999999,"15min":0.375},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.57899999999999996,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.42299999999999999},"min":{"1min":0.27600000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55900000000000005,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.33500000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38400000000000001,"15min":0.39000000000000001},"min":{"1min":0.28399999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54800000000000004,"5min":1.454,"15min":1.454},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.38100000000000001,"15min":0.38900000000000001},"min":{"1min":0.22800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58999999999999997,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.34999999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.77300000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.748,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.39400000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55000000000000004,"15min":0.54200000000000004},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.94399999999999995,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.81499999999999995,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.41599999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79000000000000004,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76500000000000001,"5min":1.637,"15min":1.637},"last":0.495}]},{"osd":7,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.81299999999999994,"5min":1.49,"15min":1.49},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84699999999999998,"5min":1.375,"15min":1.375},"last":0.46700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":437,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194874,"statfs":{"total":200000000,"available":199551957,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.34100000000000003,"15min":0.32600000000000001},"min":{"1min":0.22500000000000001,"5min":0.217,"15min":0.217},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.307},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.33500000000000002,"15min":0.317},"min":{"1min":0.28399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.36399999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.375,"15min":0.35799999999999998},"min":{"1min":0.25900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.41199999999999998,"15min":0.39600000000000002},"min":{"1min":0.28799999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.38800000000000001,"15min":0.379},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.41299999999999998,"15min":0.39900000000000002},"min":{"1min":0.29799999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.38300000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.51500000000000001,"15min":0.49299999999999999},"min":{"1min":0.42899999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.54900000000000004,"15min":0.52700000000000002},"min":{"1min":0.44,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.438}]},{"osd":5,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.497,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.44900000000000001,"5min":0.379,"15min":0.379},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.55500000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.57599999999999996,"15min":0.55000000000000004},"min":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.59999999999999998,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.433,"15min":0.433},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.47099999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.54900000000000004},"min":{"1min":0.434,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.48399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":437,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194874,"statfs":{"total":200000000,"available":199551999,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.28799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.35099999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.435}]},{"osd":1,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.505,"15min":0.49099999999999999},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.504,"15min":0.49199999999999999},"min":{"1min":0.34799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.499}]},{"osd":2,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.53700000000000003,"15min":0.52500000000000002},"min":{"1min":0.32100000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.51800000000000002,"15min":0.501},"min":{"1min":0.44700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.41099999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.54200000000000004,"15min":0.52000000000000002},"min":{"1min":0.35899999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.39400000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.51100000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53700000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.66500000000000004,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.48699999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.316,"15min":0.316},"max":{"1min":0.67700000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64100000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.57299999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.38600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69399999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70599999999999996,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":437,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194874,"statfs":{"total":200000000,"available":199551979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51300000000000001,"15min":0.51000000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72299999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.624},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51000000000000001,"15min":0.50600000000000001},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76200000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.49199999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.48699999999999999,"15min":0.48099999999999998},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":0.748,"15min":0.748},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53000000000000003,"15min":0.52700000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72499999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57899999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.38,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71399999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.378,"5min":0.309,"15min":0.309},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.54900000000000004}]},{"osd":3,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73799999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.36299999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59699999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70199999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.40300000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79400000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.63200000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53500000000000003,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.42699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79300000000000004,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57599999999999996,"15min":0.58599999999999997},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81599999999999995,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58899999999999997,"15min":0.60599999999999998},"min":{"1min":0.36499999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77900000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61199999999999999}]}]}],"pool_statfs":[]}} 2023-10-07T08:46:52.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:46:52.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.635+0000 7f9c04fa6700 1 Processor -- start 2023-10-07T08:46:52.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.635+0000 7f9c04fa6700 1 -- start start 2023-10-07T08:46:52.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.636+0000 7f9c04fa6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c001578d0 0x7f9c000cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:52.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.636+0000 7f9c04fa6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c0006d120 0x7f9c0006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:52.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.636+0000 7f9c04fa6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c000d07c0 con 0x7f9c00157ca0 2023-10-07T08:46:52.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.636+0000 7f9c04fa6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0006daa0 con 0x7f9c001578d0 2023-10-07T08:46:52.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.636+0000 7f9c04fa6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000cfbb0 con 0x7f9c0006d120 2023-10-07T08:46:52.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.636+0000 7f9bfe59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c001578d0 0x7f9c000cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:52.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.636+0000 7f9bfe59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c001578d0 0x7f9c000cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33140/0 (socket says 172.21.15.81:33140) 2023-10-07T08:46:52.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.636+0000 7f9bfe59c700 1 -- 172.21.15.81:0/2952278922 learned_addr learned my addr 172.21.15.81:0/2952278922 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:52.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.636+0000 7f9bfed9d700 1 --2- 172.21.15.81:0/2952278922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c0006d120 0x7f9c0006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:52.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.636+0000 7f9bfe59c700 1 -- 172.21.15.81:0/2952278922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c0006d120 msgr2=0x7f9c0006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:52.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.636+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/2952278922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c0006d120 0x7f9c0006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.636+0000 7f9bfe59c700 1 -- 172.21.15.81:0/2952278922 >> v1:172.21.15.89:6789/0 conn(0x7f9c00157ca0 legacy=0x7f9c0015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:52.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.636+0000 7f9bfe59c700 1 -- 172.21.15.81:0/2952278922 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c000cfe90 con 0x7f9c001578d0 2023-10-07T08:46:52.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.636+0000 7f9bfed9d700 1 --2- 172.21.15.81:0/2952278922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c0006d120 0x7f9c0006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:46:52.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.637+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/2952278922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c001578d0 0x7f9c000cf4f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00099b0 tx=0x7f9bf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c7105d56ee0a95 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:52.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.637+0000 7f9bfdd9b700 1 -- 172.21.15.81:0/2952278922 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf000b820 con 0x7f9c001578d0 2023-10-07T08:46:52.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.637+0000 7f9bfdd9b700 1 -- 172.21.15.81:0/2952278922 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf000b980 con 0x7f9c001578d0 2023-10-07T08:46:52.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.637+0000 7f9bfdd9b700 1 -- 172.21.15.81:0/2952278922 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf000bd20 con 0x7f9c001578d0 2023-10-07T08:46:52.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.637+0000 7f9c04fa6700 1 -- 172.21.15.81:0/2952278922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c001578d0 msgr2=0x7f9c000cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:52.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.637+0000 7f9c04fa6700 1 --2- 172.21.15.81:0/2952278922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c001578d0 0x7f9c000cf4f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00099b0 tx=0x7f9bf0009250 comp rx=0 tx=0).stop 2023-10-07T08:46:52.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.637+0000 7f9c04fa6700 1 -- 172.21.15.81:0/2952278922 shutdown_connections 2023-10-07T08:46:52.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.637+0000 7f9c04fa6700 1 --2- 172.21.15.81:0/2952278922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c0006d120 0x7f9c0006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.637+0000 7f9c04fa6700 1 --2- 172.21.15.81:0/2952278922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c001578d0 0x7f9c000cf4f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.637+0000 7f9c04fa6700 1 -- 172.21.15.81:0/2952278922 >> 172.21.15.81:0/2952278922 conn(0x7f9c0006bb90 msgr2=0x7f9c0006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:52.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.637+0000 7f9c04fa6700 1 -- 172.21.15.81:0/2952278922 shutdown_connections 2023-10-07T08:46:52.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.637+0000 7f9c04fa6700 1 -- 172.21.15.81:0/2952278922 wait complete. 2023-10-07T08:46:52.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.638+0000 7f9c04fa6700 1 Processor -- start 2023-10-07T08:46:52.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.638+0000 7f9c04fa6700 1 -- start start 2023-10-07T08:46:52.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.639+0000 7f9c04fa6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c0006d120 0x7f9c00155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:52.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.639+0000 7f9c04fa6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c001578d0 0x7f9c000c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:52.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.639+0000 7f9c04fa6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c00157ca0 0x7f9c0016dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:52.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.639+0000 7f9c04fa6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000c82e0 con 0x7f9c001578d0 2023-10-07T08:46:52.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.639+0000 7f9c04fa6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000c75a0 con 0x7f9c00157ca0 2023-10-07T08:46:52.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.639+0000 7f9c04fa6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c00155590 con 0x7f9c0006d120 2023-10-07T08:46:52.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.639+0000 7f9bf5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c001578d0 0x7f9c000c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:52.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.639+0000 7f9bf5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c001578d0 0x7f9c000c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33144/0 (socket says 172.21.15.81:33144) 2023-10-07T08:46:52.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.639+0000 7f9bf5d9b700 1 -- 172.21.15.81:0/3245625512 learned_addr learned my addr 172.21.15.81:0/3245625512 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:52.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.640+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/3245625512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c0006d120 0x7f9c00155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:52.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.640+0000 7f9bf5d9b700 1 -- 172.21.15.81:0/3245625512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c0006d120 msgr2=0x7f9c00155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:52.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.640+0000 7f9bf5d9b700 1 --2- 172.21.15.81:0/3245625512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c0006d120 0x7f9c00155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.640+0000 7f9bf5d9b700 1 -- 172.21.15.81:0/3245625512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c00157ca0 msgr2=0x7f9c0016dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:52.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.640+0000 7f9bf5d9b700 1 --2- 172.21.15.81:0/3245625512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c00157ca0 0x7f9c0016dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.640+0000 7f9bf5d9b700 1 -- 172.21.15.81:0/3245625512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf00094f0 con 0x7f9c001578d0 2023-10-07T08:46:52.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.640+0000 7f9bf5d9b700 1 --2- 172.21.15.81:0/3245625512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c001578d0 0x7f9c000c8770 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9be800b5e0 tx=0x7f9be80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:52.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.640+0000 7f9bf6ffd700 1 -- 172.21.15.81:0/3245625512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be800f510 con 0x7f9c001578d0 2023-10-07T08:46:52.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.640+0000 7f9bf6ffd700 1 -- 172.21.15.81:0/3245625512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be800f6b0 con 0x7f9c001578d0 2023-10-07T08:46:52.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.640+0000 7f9c04fa6700 1 -- 172.21.15.81:0/3245625512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0016e760 con 0x7f9c001578d0 2023-10-07T08:46:52.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.640+0000 7f9bf6ffd700 1 -- 172.21.15.81:0/3245625512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be800fa70 con 0x7f9c001578d0 2023-10-07T08:46:52.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.640+0000 7f9c04fa6700 1 -- 172.21.15.81:0/3245625512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c000c7c90 con 0x7f9c001578d0 2023-10-07T08:46:52.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.641+0000 7f9c04fa6700 1 -- 172.21.15.81:0/3245625512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c001556d0 con 0x7f9c001578d0 2023-10-07T08:46:52.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.641+0000 7f9bf6ffd700 1 -- 172.21.15.81:0/3245625512 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9be801a400 con 0x7f9c001578d0 2023-10-07T08:46:52.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.642+0000 7f9bf6ffd700 1 --2- 172.21.15.81:0/3245625512 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9be0066f30 0x7f9be00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:52.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.642+0000 7f9bf6ffd700 1 -- 172.21.15.81:0/3245625512 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9be8084080 con 0x7f9c001578d0 2023-10-07T08:46:52.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.642+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/3245625512 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9be0066f30 0x7f9be00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:52.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.642+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/3245625512 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9be0066f30 0x7f9be00693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00099b0 tx=0x7f9bf0016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:52.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.646+0000 7f9bf6ffd700 1 -- 172.21.15.81:0/3245625512 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9be8051370 con 0x7f9c001578d0 2023-10-07T08:46:52.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.822+0000 7f9c04fa6700 1 -- 172.21.15.81:0/3245625512 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c000c8420 con 0x7f9be0066f30 2023-10-07T08:46:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.830+0000 7f9bf6ffd700 1 -- 172.21.15.81:0/3245625512 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284626 (secure 0 0 0) 0x7f9c000c8420 con 0x7f9be0066f30 2023-10-07T08:46:52.833 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:52.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.833+0000 7f9c04fa6700 1 -- 172.21.15.81:0/3245625512 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9be0066f30 msgr2=0x7f9be00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:52.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.833+0000 7f9c04fa6700 1 --2- 172.21.15.81:0/3245625512 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9be0066f30 0x7f9be00693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00099b0 tx=0x7f9bf0016000 comp rx=0 tx=0).stop 2023-10-07T08:46:52.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.833+0000 7f9c04fa6700 1 -- 172.21.15.81:0/3245625512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c001578d0 msgr2=0x7f9c000c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:52.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.833+0000 7f9c04fa6700 1 --2- 172.21.15.81:0/3245625512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c001578d0 0x7f9c000c8770 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9be800b5e0 tx=0x7f9be80090f0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.833+0000 7f9c04fa6700 1 -- 172.21.15.81:0/3245625512 shutdown_connections 2023-10-07T08:46:52.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.833+0000 7f9c04fa6700 1 --2- 172.21.15.81:0/3245625512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c00157ca0 0x7f9c0016dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.833+0000 7f9c04fa6700 1 --2- 172.21.15.81:0/3245625512 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9be0066f30 0x7f9be00693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.833+0000 7f9c04fa6700 1 --2- 172.21.15.81:0/3245625512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c0006d120 0x7f9c00155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.833+0000 7f9c04fa6700 1 --2- 172.21.15.81:0/3245625512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c001578d0 0x7f9c000c8770 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:52.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.833+0000 7f9c04fa6700 1 -- 172.21.15.81:0/3245625512 >> 172.21.15.81:0/3245625512 conn(0x7f9c0006bb90 msgr2=0x7f9c0006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:52.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.833+0000 7f9c04fa6700 1 -- 172.21.15.81:0/3245625512 shutdown_connections 2023-10-07T08:46:52.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:52.833+0000 7f9c04fa6700 1 -- 172.21.15.81:0/3245625512 wait complete. 2023-10-07T08:46:52.840 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:46:52.845 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2023-10-07T08:46:52.056576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4632,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557867,"statfs":{"total":1600000000,"available":1595256356,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.657752"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269713+0000","last_change":"2023-10-07T08:46:48.269492+0000","last_active":"2023-10-07T08:46:48.269713+0000","last_peered":"2023-10-07T08:46:48.269713+0000","last_clean":"2023-10-07T08:46:48.269713+0000","last_became_active":"2023-10-07T08:46:48.267774+0000","last_became_peered":"2023-10-07T08:46:48.267774+0000","last_unstale":"2023-10-07T08:46:48.269713+0000","last_undegraded":"2023-10-07T08:46:48.269713+0000","last_fullsized":"2023-10-07T08:46:48.269713+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:05.464820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.270126+0000","last_change":"2023-10-07T08:46:48.269916+0000","last_active":"2023-10-07T08:46:48.270126+0000","last_peered":"2023-10-07T08:46:48.270126+0000","last_clean":"2023-10-07T08:46:48.270126+0000","last_became_active":"2023-10-07T08:46:48.268605+0000","last_became_peered":"2023-10-07T08:46:48.268605+0000","last_unstale":"2023-10-07T08:46:48.270126+0000","last_undegraded":"2023-10-07T08:46:48.270126+0000","last_fullsized":"2023-10-07T08:46:48.270126+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:54:27.000576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.264293+0000","last_change":"2023-10-07T08:46:48.264233+0000","last_active":"2023-10-07T08:46:48.264293+0000","last_peered":"2023-10-07T08:46:48.264293+0000","last_clean":"2023-10-07T08:46:48.264293+0000","last_became_active":"2023-10-07T08:46:48.264014+0000","last_became_peered":"2023-10-07T08:46:48.264014+0000","last_unstale":"2023-10-07T08:46:48.264293+0000","last_undegraded":"2023-10-07T08:46:48.264293+0000","last_fullsized":"2023-10-07T08:46:48.264293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:15:50.218936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.267377+0000","last_change":"2023-10-07T08:46:48.267192+0000","last_active":"2023-10-07T08:46:48.267377+0000","last_peered":"2023-10-07T08:46:48.267377+0000","last_clean":"2023-10-07T08:46:48.267377+0000","last_became_active":"2023-10-07T08:46:48.266337+0000","last_became_peered":"2023-10-07T08:46:48.266337+0000","last_unstale":"2023-10-07T08:46:48.267377+0000","last_undegraded":"2023-10-07T08:46:48.267377+0000","last_fullsized":"2023-10-07T08:46:48.267377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:01:03.720301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.266743+0000","last_change":"2023-10-07T08:46:48.266566+0000","last_active":"2023-10-07T08:46:48.266743+0000","last_peered":"2023-10-07T08:46:48.266743+0000","last_clean":"2023-10-07T08:46:48.266743+0000","last_became_active":"2023-10-07T08:46:48.265930+0000","last_became_peered":"2023-10-07T08:46:48.265930+0000","last_unstale":"2023-10-07T08:46:48.266743+0000","last_undegraded":"2023-10-07T08:46:48.266743+0000","last_fullsized":"2023-10-07T08:46:48.266743+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:03:50.132845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.272362+0000","last_change":"2023-10-07T08:46:48.272283+0000","last_active":"2023-10-07T08:46:48.272362+0000","last_peered":"2023-10-07T08:46:48.272362+0000","last_clean":"2023-10-07T08:46:48.272362+0000","last_became_active":"2023-10-07T08:46:48.272051+0000","last_became_peered":"2023-10-07T08:46:48.272051+0000","last_unstale":"2023-10-07T08:46:48.272362+0000","last_undegraded":"2023-10-07T08:46:48.272362+0000","last_fullsized":"2023-10-07T08:46:48.272362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:23.545539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.272501+0000","last_change":"2023-10-07T08:46:48.272283+0000","last_active":"2023-10-07T08:46:48.272501+0000","last_peered":"2023-10-07T08:46:48.272501+0000","last_clean":"2023-10-07T08:46:48.272501+0000","last_became_active":"2023-10-07T08:46:48.271615+0000","last_became_peered":"2023-10-07T08:46:48.271615+0000","last_unstale":"2023-10-07T08:46:48.272501+0000","last_undegraded":"2023-10-07T08:46:48.272501+0000","last_fullsized":"2023-10-07T08:46:48.272501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:49:28.022869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269762+0000","last_change":"2023-10-07T08:46:48.269650+0000","last_active":"2023-10-07T08:46:48.269762+0000","last_peered":"2023-10-07T08:46:48.269762+0000","last_clean":"2023-10-07T08:46:48.269762+0000","last_became_active":"2023-10-07T08:46:48.269120+0000","last_became_peered":"2023-10-07T08:46:48.269120+0000","last_unstale":"2023-10-07T08:46:48.269762+0000","last_undegraded":"2023-10-07T08:46:48.269762+0000","last_fullsized":"2023-10-07T08:46:48.269762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:30:29.382053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261031+0000","last_change":"2023-10-07T08:46:48.260743+0000","last_active":"2023-10-07T08:46:48.261031+0000","last_peered":"2023-10-07T08:46:48.261031+0000","last_clean":"2023-10-07T08:46:48.261031+0000","last_became_active":"2023-10-07T08:46:48.260531+0000","last_became_peered":"2023-10-07T08:46:48.260531+0000","last_unstale":"2023-10-07T08:46:48.261031+0000","last_undegraded":"2023-10-07T08:46:48.261031+0000","last_fullsized":"2023-10-07T08:46:48.261031+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:20:20.812889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.274168+0000","last_change":"2023-10-07T08:46:48.274103+0000","last_active":"2023-10-07T08:46:48.274168+0000","last_peered":"2023-10-07T08:46:48.274168+0000","last_clean":"2023-10-07T08:46:48.274168+0000","last_became_active":"2023-10-07T08:46:48.273330+0000","last_became_peered":"2023-10-07T08:46:48.273330+0000","last_unstale":"2023-10-07T08:46:48.274168+0000","last_undegraded":"2023-10-07T08:46:48.274168+0000","last_fullsized":"2023-10-07T08:46:48.274168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:08:51.801627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.275205+0000","last_change":"2023-10-07T08:46:48.275134+0000","last_active":"2023-10-07T08:46:48.275205+0000","last_peered":"2023-10-07T08:46:48.275205+0000","last_clean":"2023-10-07T08:46:48.275205+0000","last_became_active":"2023-10-07T08:46:48.274892+0000","last_became_peered":"2023-10-07T08:46:48.274892+0000","last_unstale":"2023-10-07T08:46:48.275205+0000","last_undegraded":"2023-10-07T08:46:48.275205+0000","last_fullsized":"2023-10-07T08:46:48.275205+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:41:48.420830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.270099+0000","last_change":"2023-10-07T08:46:48.270052+0000","last_active":"2023-10-07T08:46:48.270099+0000","last_peered":"2023-10-07T08:46:48.270099+0000","last_clean":"2023-10-07T08:46:48.270099+0000","last_became_active":"2023-10-07T08:46:48.269840+0000","last_became_peered":"2023-10-07T08:46:48.269840+0000","last_unstale":"2023-10-07T08:46:48.270099+0000","last_undegraded":"2023-10-07T08:46:48.270099+0000","last_fullsized":"2023-10-07T08:46:48.270099+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:50:26.445404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269690+0000","last_change":"2023-10-07T08:46:48.269629+0000","last_active":"2023-10-07T08:46:48.269690+0000","last_peered":"2023-10-07T08:46:48.269690+0000","last_clean":"2023-10-07T08:46:48.269690+0000","last_became_active":"2023-10-07T08:46:48.269297+0000","last_became_peered":"2023-10-07T08:46:48.269297+0000","last_unstale":"2023-10-07T08:46:48.269690+0000","last_undegraded":"2023-10-07T08:46:48.269690+0000","last_fullsized":"2023-10-07T08:46:48.269690+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:57:20.107008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.267375+0000","last_change":"2023-10-07T08:46:48.267289+0000","last_active":"2023-10-07T08:46:48.267375+0000","last_peered":"2023-10-07T08:46:48.267375+0000","last_clean":"2023-10-07T08:46:48.267375+0000","last_became_active":"2023-10-07T08:46:48.266054+0000","last_became_peered":"2023-10-07T08:46:48.266054+0000","last_unstale":"2023-10-07T08:46:48.267375+0000","last_undegraded":"2023-10-07T08:46:48.267375+0000","last_fullsized":"2023-10-07T08:46:48.267375+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:42:03.326011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.265086+0000","last_change":"2023-10-07T08:46:48.265036+0000","last_active":"2023-10-07T08:46:48.265086+0000","last_peered":"2023-10-07T08:46:48.265086+0000","last_clean":"2023-10-07T08:46:48.265086+0000","last_became_active":"2023-10-07T08:46:48.264808+0000","last_became_peered":"2023-10-07T08:46:48.264808+0000","last_unstale":"2023-10-07T08:46:48.265086+0000","last_undegraded":"2023-10-07T08:46:48.265086+0000","last_fullsized":"2023-10-07T08:46:48.265086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:39:47.722573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.273263+0000","last_change":"2023-10-07T08:46:48.273187+0000","last_active":"2023-10-07T08:46:48.273263+0000","last_peered":"2023-10-07T08:46:48.273263+0000","last_clean":"2023-10-07T08:46:48.273263+0000","last_became_active":"2023-10-07T08:46:48.272950+0000","last_became_peered":"2023-10-07T08:46:48.272950+0000","last_unstale":"2023-10-07T08:46:48.273263+0000","last_undegraded":"2023-10-07T08:46:48.273263+0000","last_fullsized":"2023-10-07T08:46:48.273263+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:33:26.919414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.264180+0000","last_change":"2023-10-07T08:46:48.264069+0000","last_active":"2023-10-07T08:46:48.264180+0000","last_peered":"2023-10-07T08:46:48.264180+0000","last_clean":"2023-10-07T08:46:48.264180+0000","last_became_active":"2023-10-07T08:46:48.263370+0000","last_became_peered":"2023-10-07T08:46:48.263370+0000","last_unstale":"2023-10-07T08:46:48.264180+0000","last_undegraded":"2023-10-07T08:46:48.264180+0000","last_fullsized":"2023-10-07T08:46:48.264180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:47:19.276829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269113+0000","last_change":"2023-10-07T08:46:48.269056+0000","last_active":"2023-10-07T08:46:48.269113+0000","last_peered":"2023-10-07T08:46:48.269113+0000","last_clean":"2023-10-07T08:46:48.269113+0000","last_became_active":"2023-10-07T08:46:48.268843+0000","last_became_peered":"2023-10-07T08:46:48.268843+0000","last_unstale":"2023-10-07T08:46:48.269113+0000","last_undegraded":"2023-10-07T08:46:48.269113+0000","last_fullsized":"2023-10-07T08:46:48.269113+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:11.268440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.266991+0000","last_change":"2023-10-07T08:46:48.266668+0000","last_active":"2023-10-07T08:46:48.266991+0000","last_peered":"2023-10-07T08:46:48.266991+0000","last_clean":"2023-10-07T08:46:48.266991+0000","last_became_active":"2023-10-07T08:46:48.266297+0000","last_became_peered":"2023-10-07T08:46:48.266297+0000","last_unstale":"2023-10-07T08:46:48.266991+0000","last_undegraded":"2023-10-07T08:46:48.266991+0000","last_fullsized":"2023-10-07T08:46:48.266991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:22.474064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.266634+0000","last_change":"2023-10-07T08:46:48.266576+0000","last_active":"2023-10-07T08:46:48.266634+0000","last_peered":"2023-10-07T08:46:48.266634+0000","last_clean":"2023-10-07T08:46:48.266634+0000","last_became_active":"2023-10-07T08:46:48.266406+0000","last_became_peered":"2023-10-07T08:46:48.266406+0000","last_unstale":"2023-10-07T08:46:48.266634+0000","last_undegraded":"2023-10-07T08:46:48.266634+0000","last_fullsized":"2023-10-07T08:46:48.266634+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:49:28.022869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.266843+0000","last_change":"2023-10-07T08:46:48.266728+0000","last_active":"2023-10-07T08:46:48.266843+0000","last_peered":"2023-10-07T08:46:48.266843+0000","last_clean":"2023-10-07T08:46:48.266843+0000","last_became_active":"2023-10-07T08:46:48.266500+0000","last_became_peered":"2023-10-07T08:46:48.266500+0000","last_unstale":"2023-10-07T08:46:48.266843+0000","last_undegraded":"2023-10-07T08:46:48.266843+0000","last_fullsized":"2023-10-07T08:46:48.266843+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:31:01.003070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.271166+0000","last_change":"2023-10-07T08:46:48.271099+0000","last_active":"2023-10-07T08:46:48.271166+0000","last_peered":"2023-10-07T08:46:48.271166+0000","last_clean":"2023-10-07T08:46:48.271166+0000","last_became_active":"2023-10-07T08:46:48.270885+0000","last_became_peered":"2023-10-07T08:46:48.270885+0000","last_unstale":"2023-10-07T08:46:48.271166+0000","last_undegraded":"2023-10-07T08:46:48.271166+0000","last_fullsized":"2023-10-07T08:46:48.271166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:24:24.288481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.270796+0000","last_change":"2023-10-07T08:46:48.270734+0000","last_active":"2023-10-07T08:46:48.270796+0000","last_peered":"2023-10-07T08:46:48.270796+0000","last_clean":"2023-10-07T08:46:48.270796+0000","last_became_active":"2023-10-07T08:46:48.269248+0000","last_became_peered":"2023-10-07T08:46:48.269248+0000","last_unstale":"2023-10-07T08:46:48.270796+0000","last_undegraded":"2023-10-07T08:46:48.270796+0000","last_fullsized":"2023-10-07T08:46:48.270796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:09:11.051849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.276797+0000","last_change":"2023-10-07T08:46:48.276696+0000","last_active":"2023-10-07T08:46:48.276797+0000","last_peered":"2023-10-07T08:46:48.276797+0000","last_clean":"2023-10-07T08:46:48.276797+0000","last_became_active":"2023-10-07T08:46:48.276442+0000","last_became_peered":"2023-10-07T08:46:48.276442+0000","last_unstale":"2023-10-07T08:46:48.276797+0000","last_undegraded":"2023-10-07T08:46:48.276797+0000","last_fullsized":"2023-10-07T08:46:48.276797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:23:55.200975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.274525+0000","last_change":"2023-10-07T08:46:48.274470+0000","last_active":"2023-10-07T08:46:48.274525+0000","last_peered":"2023-10-07T08:46:48.274525+0000","last_clean":"2023-10-07T08:46:48.274525+0000","last_became_active":"2023-10-07T08:46:48.273884+0000","last_became_peered":"2023-10-07T08:46:48.273884+0000","last_unstale":"2023-10-07T08:46:48.274525+0000","last_undegraded":"2023-10-07T08:46:48.274525+0000","last_fullsized":"2023-10-07T08:46:48.274525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:33.174267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.274035+0000","last_change":"2023-10-07T08:46:48.273975+0000","last_active":"2023-10-07T08:46:48.274035+0000","last_peered":"2023-10-07T08:46:48.274035+0000","last_clean":"2023-10-07T08:46:48.274035+0000","last_became_active":"2023-10-07T08:46:48.273767+0000","last_became_peered":"2023-10-07T08:46:48.273767+0000","last_unstale":"2023-10-07T08:46:48.274035+0000","last_undegraded":"2023-10-07T08:46:48.274035+0000","last_fullsized":"2023-10-07T08:46:48.274035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:05.464820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.265575+0000","last_change":"2023-10-07T08:46:48.265386+0000","last_active":"2023-10-07T08:46:48.265575+0000","last_peered":"2023-10-07T08:46:48.265575+0000","last_clean":"2023-10-07T08:46:48.265575+0000","last_became_active":"2023-10-07T08:46:48.264810+0000","last_became_peered":"2023-10-07T08:46:48.264810+0000","last_unstale":"2023-10-07T08:46:48.265575+0000","last_undegraded":"2023-10-07T08:46:48.265575+0000","last_fullsized":"2023-10-07T08:46:48.265575+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:35:05.459489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269955+0000","last_change":"2023-10-07T08:46:48.269892+0000","last_active":"2023-10-07T08:46:48.269955+0000","last_peered":"2023-10-07T08:46:48.269955+0000","last_clean":"2023-10-07T08:46:48.269955+0000","last_became_active":"2023-10-07T08:46:48.269645+0000","last_became_peered":"2023-10-07T08:46:48.269645+0000","last_unstale":"2023-10-07T08:46:48.269955+0000","last_undegraded":"2023-10-07T08:46:48.269955+0000","last_fullsized":"2023-10-07T08:46:48.269955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:28:28.201624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.268306+0000","last_change":"2023-10-07T08:46:48.268245+0000","last_active":"2023-10-07T08:46:48.268306+0000","last_peered":"2023-10-07T08:46:48.268306+0000","last_clean":"2023-10-07T08:46:48.268306+0000","last_became_active":"2023-10-07T08:46:48.267786+0000","last_became_peered":"2023-10-07T08:46:48.267786+0000","last_unstale":"2023-10-07T08:46:48.268306+0000","last_undegraded":"2023-10-07T08:46:48.268306+0000","last_fullsized":"2023-10-07T08:46:48.268306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:36:29.819095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.270240+0000","last_change":"2023-10-07T08:46:48.270183+0000","last_active":"2023-10-07T08:46:48.270240+0000","last_peered":"2023-10-07T08:46:48.270240+0000","last_clean":"2023-10-07T08:46:48.270240+0000","last_became_active":"2023-10-07T08:46:48.269944+0000","last_became_peered":"2023-10-07T08:46:48.269944+0000","last_unstale":"2023-10-07T08:46:48.270240+0000","last_undegraded":"2023-10-07T08:46:48.270240+0000","last_fullsized":"2023-10-07T08:46:48.270240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:17:14.195866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.266357+0000","last_change":"2023-10-07T08:46:48.266276+0000","last_active":"2023-10-07T08:46:48.266357+0000","last_peered":"2023-10-07T08:46:48.266357+0000","last_clean":"2023-10-07T08:46:48.266357+0000","last_became_active":"2023-10-07T08:46:48.265981+0000","last_became_peered":"2023-10-07T08:46:48.265981+0000","last_unstale":"2023-10-07T08:46:48.266357+0000","last_undegraded":"2023-10-07T08:46:48.266357+0000","last_fullsized":"2023-10-07T08:46:48.266357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:20:31.775459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.262017+0000","last_change":"2023-10-07T08:46:48.261947+0000","last_active":"2023-10-07T08:46:48.262017+0000","last_peered":"2023-10-07T08:46:48.262017+0000","last_clean":"2023-10-07T08:46:48.262017+0000","last_became_active":"2023-10-07T08:46:48.261708+0000","last_became_peered":"2023-10-07T08:46:48.261708+0000","last_unstale":"2023-10-07T08:46:48.262017+0000","last_undegraded":"2023-10-07T08:46:48.262017+0000","last_fullsized":"2023-10-07T08:46:48.262017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:33.571514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.276205+0000","last_change":"2023-10-07T08:46:48.276139+0000","last_active":"2023-10-07T08:46:48.276205+0000","last_peered":"2023-10-07T08:46:48.276205+0000","last_clean":"2023-10-07T08:46:48.276205+0000","last_became_active":"2023-10-07T08:46:48.275904+0000","last_became_peered":"2023-10-07T08:46:48.275904+0000","last_unstale":"2023-10-07T08:46:48.276205+0000","last_undegraded":"2023-10-07T08:46:48.276205+0000","last_fullsized":"2023-10-07T08:46:48.276205+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:53:51.393617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"84'4","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.425001+0000","last_change":"2023-10-07T08:46:47.408081+0000","last_active":"2023-10-07T08:46:48.425001+0000","last_peered":"2023-10-07T08:46:48.425001+0000","last_clean":"2023-10-07T08:46:48.425001+0000","last_became_active":"2023-10-07T08:46:47.407872+0000","last_became_peered":"2023-10-07T08:46:47.407872+0000","last_unstale":"2023-10-07T08:46:48.425001+0000","last_undegraded":"2023-10-07T08:46:48.425001+0000","last_fullsized":"2023-10-07T08:46:48.425001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:08:50.797798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261394+0000","last_change":"2023-10-07T08:46:48.261310+0000","last_active":"2023-10-07T08:46:48.261394+0000","last_peered":"2023-10-07T08:46:48.261394+0000","last_clean":"2023-10-07T08:46:48.261394+0000","last_became_active":"2023-10-07T08:46:48.261093+0000","last_became_peered":"2023-10-07T08:46:48.261093+0000","last_unstale":"2023-10-07T08:46:48.261394+0000","last_undegraded":"2023-10-07T08:46:48.261394+0000","last_fullsized":"2023-10-07T08:46:48.261394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:01:15.363106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.421946+0000","last_change":"2023-10-07T08:46:47.408292+0000","last_active":"2023-10-07T08:46:48.421946+0000","last_peered":"2023-10-07T08:46:48.421946+0000","last_clean":"2023-10-07T08:46:48.421946+0000","last_became_active":"2023-10-07T08:46:47.408015+0000","last_became_peered":"2023-10-07T08:46:47.408015+0000","last_unstale":"2023-10-07T08:46:48.421946+0000","last_undegraded":"2023-10-07T08:46:48.421946+0000","last_fullsized":"2023-10-07T08:46:48.421946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:28:27.197794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.276151+0000","last_change":"2023-10-07T08:46:48.276078+0000","last_active":"2023-10-07T08:46:48.276151+0000","last_peered":"2023-10-07T08:46:48.276151+0000","last_clean":"2023-10-07T08:46:48.276151+0000","last_became_active":"2023-10-07T08:46:48.275507+0000","last_became_peered":"2023-10-07T08:46:48.275507+0000","last_unstale":"2023-10-07T08:46:48.276151+0000","last_undegraded":"2023-10-07T08:46:48.276151+0000","last_fullsized":"2023-10-07T08:46:48.276151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:01:03.720301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.423675+0000","last_change":"2023-10-07T08:46:47.412828+0000","last_active":"2023-10-07T08:46:48.423675+0000","last_peered":"2023-10-07T08:46:48.423675+0000","last_clean":"2023-10-07T08:46:48.423675+0000","last_became_active":"2023-10-07T08:46:47.412618+0000","last_became_peered":"2023-10-07T08:46:47.412618+0000","last_unstale":"2023-10-07T08:46:48.423675+0000","last_undegraded":"2023-10-07T08:46:48.423675+0000","last_fullsized":"2023-10-07T08:46:48.423675+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:32.567685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.271138+0000","last_change":"2023-10-07T08:46:48.271011+0000","last_active":"2023-10-07T08:46:48.271138+0000","last_peered":"2023-10-07T08:46:48.271138+0000","last_clean":"2023-10-07T08:46:48.271138+0000","last_became_active":"2023-10-07T08:46:48.270696+0000","last_became_peered":"2023-10-07T08:46:48.270696+0000","last_unstale":"2023-10-07T08:46:48.271138+0000","last_undegraded":"2023-10-07T08:46:48.271138+0000","last_fullsized":"2023-10-07T08:46:48.271138+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:21:49.143056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.424794+0000","last_change":"2023-10-07T08:46:47.418346+0000","last_active":"2023-10-07T08:46:48.424794+0000","last_peered":"2023-10-07T08:46:48.424794+0000","last_clean":"2023-10-07T08:46:48.424794+0000","last_became_active":"2023-10-07T08:46:47.417910+0000","last_became_peered":"2023-10-07T08:46:47.417910+0000","last_unstale":"2023-10-07T08:46:48.424794+0000","last_undegraded":"2023-10-07T08:46:48.424794+0000","last_fullsized":"2023-10-07T08:46:48.424794+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:42:02.322182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.267259+0000","last_change":"2023-10-07T08:46:48.267192+0000","last_active":"2023-10-07T08:46:48.267259+0000","last_peered":"2023-10-07T08:46:48.267259+0000","last_clean":"2023-10-07T08:46:48.267259+0000","last_became_active":"2023-10-07T08:46:48.266958+0000","last_became_peered":"2023-10-07T08:46:48.266958+0000","last_unstale":"2023-10-07T08:46:48.267259+0000","last_undegraded":"2023-10-07T08:46:48.267259+0000","last_fullsized":"2023-10-07T08:46:48.267259+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:06:55.645362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.422643+0000","last_change":"2023-10-07T08:46:47.408495+0000","last_active":"2023-10-07T08:46:48.422643+0000","last_peered":"2023-10-07T08:46:48.422643+0000","last_clean":"2023-10-07T08:46:48.422643+0000","last_became_active":"2023-10-07T08:46:47.408296+0000","last_became_peered":"2023-10-07T08:46:47.408296+0000","last_unstale":"2023-10-07T08:46:48.422643+0000","last_undegraded":"2023-10-07T08:46:48.422643+0000","last_fullsized":"2023-10-07T08:46:48.422643+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:06:54.641533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.273245+0000","last_change":"2023-10-07T08:46:48.273169+0000","last_active":"2023-10-07T08:46:48.273245+0000","last_peered":"2023-10-07T08:46:48.273245+0000","last_clean":"2023-10-07T08:46:48.273245+0000","last_became_active":"2023-10-07T08:46:48.272921+0000","last_became_peered":"2023-10-07T08:46:48.272921+0000","last_unstale":"2023-10-07T08:46:48.273245+0000","last_undegraded":"2023-10-07T08:46:48.273245+0000","last_fullsized":"2023-10-07T08:46:48.273245+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:26:07.798358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.423168+0000","last_change":"2023-10-07T08:46:47.412902+0000","last_active":"2023-10-07T08:46:48.423168+0000","last_peered":"2023-10-07T08:46:48.423168+0000","last_clean":"2023-10-07T08:46:48.423168+0000","last_became_active":"2023-10-07T08:46:47.412434+0000","last_became_peered":"2023-10-07T08:46:47.412434+0000","last_unstale":"2023-10-07T08:46:48.423168+0000","last_undegraded":"2023-10-07T08:46:48.423168+0000","last_fullsized":"2023-10-07T08:46:48.423168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:56:37.840040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.271130+0000","last_change":"2023-10-07T08:46:48.271094+0000","last_active":"2023-10-07T08:46:48.271130+0000","last_peered":"2023-10-07T08:46:48.271130+0000","last_clean":"2023-10-07T08:46:48.271130+0000","last_became_active":"2023-10-07T08:46:48.270974+0000","last_became_peered":"2023-10-07T08:46:48.270974+0000","last_unstale":"2023-10-07T08:46:48.271130+0000","last_undegraded":"2023-10-07T08:46:48.271130+0000","last_fullsized":"2023-10-07T08:46:48.271130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:10.689376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.263856+0000","last_change":"2023-10-07T08:46:47.411077+0000","last_active":"2023-10-07T08:46:48.263856+0000","last_peered":"2023-10-07T08:46:48.263856+0000","last_clean":"2023-10-07T08:46:48.263856+0000","last_became_active":"2023-10-07T08:46:47.410190+0000","last_became_peered":"2023-10-07T08:46:47.410190+0000","last_unstale":"2023-10-07T08:46:48.263856+0000","last_undegraded":"2023-10-07T08:46:48.263856+0000","last_fullsized":"2023-10-07T08:46:48.263856+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:00.704905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.267219+0000","last_change":"2023-10-07T08:46:48.267156+0000","last_active":"2023-10-07T08:46:48.267219+0000","last_peered":"2023-10-07T08:46:48.267219+0000","last_clean":"2023-10-07T08:46:48.267219+0000","last_became_active":"2023-10-07T08:46:48.266938+0000","last_became_peered":"2023-10-07T08:46:48.266938+0000","last_unstale":"2023-10-07T08:46:48.267219+0000","last_undegraded":"2023-10-07T08:46:48.267219+0000","last_fullsized":"2023-10-07T08:46:48.267219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:18:10.096148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.259630+0000","last_change":"2023-10-07T08:46:47.407244+0000","last_active":"2023-10-07T08:46:48.259630+0000","last_peered":"2023-10-07T08:46:48.259630+0000","last_clean":"2023-10-07T08:46:48.259630+0000","last_became_active":"2023-10-07T08:46:47.407038+0000","last_became_peered":"2023-10-07T08:46:47.407038+0000","last_unstale":"2023-10-07T08:46:48.259630+0000","last_undegraded":"2023-10-07T08:46:48.259630+0000","last_fullsized":"2023-10-07T08:46:48.259630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:38:26.656578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.272516+0000","last_change":"2023-10-07T08:46:48.272421+0000","last_active":"2023-10-07T08:46:48.272516+0000","last_peered":"2023-10-07T08:46:48.272516+0000","last_clean":"2023-10-07T08:46:48.272516+0000","last_became_active":"2023-10-07T08:46:48.272063+0000","last_became_peered":"2023-10-07T08:46:48.272063+0000","last_unstale":"2023-10-07T08:46:48.272516+0000","last_undegraded":"2023-10-07T08:46:48.272516+0000","last_fullsized":"2023-10-07T08:46:48.272516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:18:10.096148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.264788+0000","last_change":"2023-10-07T08:46:47.410849+0000","last_active":"2023-10-07T08:46:48.264788+0000","last_peered":"2023-10-07T08:46:48.264788+0000","last_clean":"2023-10-07T08:46:48.264788+0000","last_became_active":"2023-10-07T08:46:47.410513+0000","last_became_peered":"2023-10-07T08:46:47.410513+0000","last_unstale":"2023-10-07T08:46:48.264788+0000","last_undegraded":"2023-10-07T08:46:48.264788+0000","last_fullsized":"2023-10-07T08:46:48.264788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:25:08.768283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.276542+0000","last_change":"2023-10-07T08:46:48.276466+0000","last_active":"2023-10-07T08:46:48.276542+0000","last_peered":"2023-10-07T08:46:48.276542+0000","last_clean":"2023-10-07T08:46:48.276542+0000","last_became_active":"2023-10-07T08:46:48.275860+0000","last_became_peered":"2023-10-07T08:46:48.275860+0000","last_unstale":"2023-10-07T08:46:48.276542+0000","last_undegraded":"2023-10-07T08:46:48.276542+0000","last_fullsized":"2023-10-07T08:46:48.276542+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:29:01.300380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.260561+0000","last_change":"2023-10-07T08:46:47.416262+0000","last_active":"2023-10-07T08:46:48.260561+0000","last_peered":"2023-10-07T08:46:48.260561+0000","last_clean":"2023-10-07T08:46:48.260561+0000","last_became_active":"2023-10-07T08:46:47.415844+0000","last_became_peered":"2023-10-07T08:46:47.415844+0000","last_unstale":"2023-10-07T08:46:48.260561+0000","last_undegraded":"2023-10-07T08:46:48.260561+0000","last_fullsized":"2023-10-07T08:46:48.260561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:44:13.593262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.266972+0000","last_change":"2023-10-07T08:46:48.266518+0000","last_active":"2023-10-07T08:46:48.266972+0000","last_peered":"2023-10-07T08:46:48.266972+0000","last_clean":"2023-10-07T08:46:48.266972+0000","last_became_active":"2023-10-07T08:46:48.265989+0000","last_became_peered":"2023-10-07T08:46:48.265989+0000","last_unstale":"2023-10-07T08:46:48.266972+0000","last_undegraded":"2023-10-07T08:46:48.266972+0000","last_fullsized":"2023-10-07T08:46:48.266972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:11:31.567925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"84'3","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.422513+0000","last_change":"2023-10-07T08:46:47.409848+0000","last_active":"2023-10-07T08:46:48.422513+0000","last_peered":"2023-10-07T08:46:48.422513+0000","last_clean":"2023-10-07T08:46:48.422513+0000","last_became_active":"2023-10-07T08:46:47.408881+0000","last_became_peered":"2023-10-07T08:46:47.408881+0000","last_unstale":"2023-10-07T08:46:48.422513+0000","last_undegraded":"2023-10-07T08:46:48.422513+0000","last_fullsized":"2023-10-07T08:46:48.422513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:36:04.460990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269178+0000","last_change":"2023-10-07T08:46:48.269136+0000","last_active":"2023-10-07T08:46:48.269178+0000","last_peered":"2023-10-07T08:46:48.269178+0000","last_clean":"2023-10-07T08:46:48.269178+0000","last_became_active":"2023-10-07T08:46:48.268935+0000","last_became_peered":"2023-10-07T08:46:48.268935+0000","last_unstale":"2023-10-07T08:46:48.269178+0000","last_undegraded":"2023-10-07T08:46:48.269178+0000","last_fullsized":"2023-10-07T08:46:48.269178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:15:11.308554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"84'6","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.423476+0000","last_change":"2023-10-07T08:46:47.406377+0000","last_active":"2023-10-07T08:46:48.423476+0000","last_peered":"2023-10-07T08:46:48.423476+0000","last_clean":"2023-10-07T08:46:48.423476+0000","last_became_active":"2023-10-07T08:46:47.406134+0000","last_became_peered":"2023-10-07T08:46:47.406134+0000","last_unstale":"2023-10-07T08:46:48.423476+0000","last_undegraded":"2023-10-07T08:46:48.423476+0000","last_fullsized":"2023-10-07T08:46:48.423476+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:04:32.853733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269731+0000","last_change":"2023-10-07T08:46:48.269648+0000","last_active":"2023-10-07T08:46:48.269731+0000","last_peered":"2023-10-07T08:46:48.269731+0000","last_clean":"2023-10-07T08:46:48.269731+0000","last_became_active":"2023-10-07T08:46:48.268081+0000","last_became_peered":"2023-10-07T08:46:48.268081+0000","last_unstale":"2023-10-07T08:46:48.269731+0000","last_undegraded":"2023-10-07T08:46:48.269731+0000","last_fullsized":"2023-10-07T08:46:48.269731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:17:14.195866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.424174+0000","last_change":"2023-10-07T08:46:47.408151+0000","last_active":"2023-10-07T08:46:48.424174+0000","last_peered":"2023-10-07T08:46:48.424174+0000","last_clean":"2023-10-07T08:46:48.424174+0000","last_became_active":"2023-10-07T08:46:47.407856+0000","last_became_peered":"2023-10-07T08:46:47.407856+0000","last_unstale":"2023-10-07T08:46:48.424174+0000","last_undegraded":"2023-10-07T08:46:48.424174+0000","last_fullsized":"2023-10-07T08:46:48.424174+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:18:14.571329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.273533+0000","last_change":"2023-10-07T08:46:48.273470+0000","last_active":"2023-10-07T08:46:48.273533+0000","last_peered":"2023-10-07T08:46:48.273533+0000","last_clean":"2023-10-07T08:46:48.273533+0000","last_became_active":"2023-10-07T08:46:48.273246+0000","last_became_peered":"2023-10-07T08:46:48.273246+0000","last_unstale":"2023-10-07T08:46:48.273533+0000","last_undegraded":"2023-10-07T08:46:48.273533+0000","last_fullsized":"2023-10-07T08:46:48.273533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:21:49.143056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261644+0000","last_change":"2023-10-07T08:46:47.418233+0000","last_active":"2023-10-07T08:46:48.261644+0000","last_peered":"2023-10-07T08:46:48.261644+0000","last_clean":"2023-10-07T08:46:48.261644+0000","last_became_active":"2023-10-07T08:46:47.417563+0000","last_became_peered":"2023-10-07T08:46:47.417563+0000","last_unstale":"2023-10-07T08:46:48.261644+0000","last_undegraded":"2023-10-07T08:46:48.261644+0000","last_fullsized":"2023-10-07T08:46:48.261644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:47:18.273000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269567+0000","last_change":"2023-10-07T08:46:48.269486+0000","last_active":"2023-10-07T08:46:48.269567+0000","last_peered":"2023-10-07T08:46:48.269567+0000","last_clean":"2023-10-07T08:46:48.269567+0000","last_became_active":"2023-10-07T08:46:48.269007+0000","last_became_peered":"2023-10-07T08:46:48.269007+0000","last_unstale":"2023-10-07T08:46:48.269567+0000","last_undegraded":"2023-10-07T08:46:48.269567+0000","last_fullsized":"2023-10-07T08:46:48.269567+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:41:48.420830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.271072+0000","last_change":"2023-10-07T08:46:47.409199+0000","last_active":"2023-10-07T08:46:48.271072+0000","last_peered":"2023-10-07T08:46:48.271072+0000","last_clean":"2023-10-07T08:46:48.271072+0000","last_became_active":"2023-10-07T08:46:47.408977+0000","last_became_peered":"2023-10-07T08:46:47.408977+0000","last_unstale":"2023-10-07T08:46:48.271072+0000","last_undegraded":"2023-10-07T08:46:48.271072+0000","last_fullsized":"2023-10-07T08:46:48.271072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:24:23.284652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.263996+0000","last_change":"2023-10-07T08:46:48.263567+0000","last_active":"2023-10-07T08:46:48.263996+0000","last_peered":"2023-10-07T08:46:48.263996+0000","last_clean":"2023-10-07T08:46:48.263996+0000","last_became_active":"2023-10-07T08:46:48.263065+0000","last_became_peered":"2023-10-07T08:46:48.263065+0000","last_unstale":"2023-10-07T08:46:48.263996+0000","last_undegraded":"2023-10-07T08:46:48.263996+0000","last_fullsized":"2023-10-07T08:46:48.263996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:57:24.673413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"84'8","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.425165+0000","last_change":"2023-10-07T08:46:47.412124+0000","last_active":"2023-10-07T08:46:48.425165+0000","last_peered":"2023-10-07T08:46:48.425165+0000","last_clean":"2023-10-07T08:46:48.425165+0000","last_became_active":"2023-10-07T08:46:47.411751+0000","last_became_peered":"2023-10-07T08:46:47.411751+0000","last_unstale":"2023-10-07T08:46:48.425165+0000","last_undegraded":"2023-10-07T08:46:48.425165+0000","last_fullsized":"2023-10-07T08:46:48.425165+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:50:25.441575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269438+0000","last_change":"2023-10-07T08:46:48.269360+0000","last_active":"2023-10-07T08:46:48.269438+0000","last_peered":"2023-10-07T08:46:48.269438+0000","last_clean":"2023-10-07T08:46:48.269438+0000","last_became_active":"2023-10-07T08:46:48.269109+0000","last_became_peered":"2023-10-07T08:46:48.269109+0000","last_unstale":"2023-10-07T08:46:48.269438+0000","last_undegraded":"2023-10-07T08:46:48.269438+0000","last_fullsized":"2023-10-07T08:46:48.269438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:16:16.353026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.424099+0000","last_change":"2023-10-07T08:46:47.411441+0000","last_active":"2023-10-07T08:46:48.424099+0000","last_peered":"2023-10-07T08:46:48.424099+0000","last_clean":"2023-10-07T08:46:48.424099+0000","last_became_active":"2023-10-07T08:46:47.409077+0000","last_became_peered":"2023-10-07T08:46:47.409077+0000","last_unstale":"2023-10-07T08:46:48.424099+0000","last_undegraded":"2023-10-07T08:46:48.424099+0000","last_fullsized":"2023-10-07T08:46:48.424099+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:42:25.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.274043+0000","last_change":"2023-10-07T08:46:48.273469+0000","last_active":"2023-10-07T08:46:48.274043+0000","last_peered":"2023-10-07T08:46:48.274043+0000","last_clean":"2023-10-07T08:46:48.274043+0000","last_became_active":"2023-10-07T08:46:48.273180+0000","last_became_peered":"2023-10-07T08:46:48.273180+0000","last_unstale":"2023-10-07T08:46:48.274043+0000","last_undegraded":"2023-10-07T08:46:48.274043+0000","last_fullsized":"2023-10-07T08:46:48.274043+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:06:55.645362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.423913+0000","last_change":"2023-10-07T08:46:47.410171+0000","last_active":"2023-10-07T08:46:48.423913+0000","last_peered":"2023-10-07T08:46:48.423913+0000","last_clean":"2023-10-07T08:46:48.423913+0000","last_became_active":"2023-10-07T08:46:47.409944+0000","last_became_peered":"2023-10-07T08:46:47.409944+0000","last_unstale":"2023-10-07T08:46:48.423913+0000","last_undegraded":"2023-10-07T08:46:48.423913+0000","last_fullsized":"2023-10-07T08:46:48.423913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:09:58.063139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.265934+0000","last_change":"2023-10-07T08:46:48.265878+0000","last_active":"2023-10-07T08:46:48.265934+0000","last_peered":"2023-10-07T08:46:48.265934+0000","last_clean":"2023-10-07T08:46:48.265934+0000","last_became_active":"2023-10-07T08:46:48.265665+0000","last_became_peered":"2023-10-07T08:46:48.265665+0000","last_unstale":"2023-10-07T08:46:48.265934+0000","last_undegraded":"2023-10-07T08:46:48.265934+0000","last_fullsized":"2023-10-07T08:46:48.265934+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:54:27.000576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.424988+0000","last_change":"2023-10-07T08:46:47.418126+0000","last_active":"2023-10-07T08:46:48.424988+0000","last_peered":"2023-10-07T08:46:48.424988+0000","last_clean":"2023-10-07T08:46:48.424988+0000","last_became_active":"2023-10-07T08:46:47.416880+0000","last_became_peered":"2023-10-07T08:46:47.416880+0000","last_unstale":"2023-10-07T08:46:48.424988+0000","last_undegraded":"2023-10-07T08:46:48.424988+0000","last_fullsized":"2023-10-07T08:46:48.424988+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:03:49.129015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.267507+0000","last_change":"2023-10-07T08:46:48.267405+0000","last_active":"2023-10-07T08:46:48.267507+0000","last_peered":"2023-10-07T08:46:48.267507+0000","last_clean":"2023-10-07T08:46:48.267507+0000","last_became_active":"2023-10-07T08:46:48.267178+0000","last_became_peered":"2023-10-07T08:46:48.267178+0000","last_unstale":"2023-10-07T08:46:48.267507+0000","last_undegraded":"2023-10-07T08:46:48.267507+0000","last_fullsized":"2023-10-07T08:46:48.267507+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:15:41.344797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.263975+0000","last_change":"2023-10-07T08:46:47.409378+0000","last_active":"2023-10-07T08:46:48.263975+0000","last_peered":"2023-10-07T08:46:48.263975+0000","last_clean":"2023-10-07T08:46:48.263975+0000","last_became_active":"2023-10-07T08:46:47.409137+0000","last_became_peered":"2023-10-07T08:46:47.409137+0000","last_unstale":"2023-10-07T08:46:48.263975+0000","last_undegraded":"2023-10-07T08:46:48.263975+0000","last_fullsized":"2023-10-07T08:46:48.263975+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:24:23.284652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.269337+0000","last_change":"2023-10-07T08:46:48.269260+0000","last_active":"2023-10-07T08:46:48.269337+0000","last_peered":"2023-10-07T08:46:48.269337+0000","last_clean":"2023-10-07T08:46:48.269337+0000","last_became_active":"2023-10-07T08:46:48.269061+0000","last_became_peered":"2023-10-07T08:46:48.269061+0000","last_unstale":"2023-10-07T08:46:48.269337+0000","last_undegraded":"2023-10-07T08:46:48.269337+0000","last_fullsized":"2023-10-07T08:46:48.269337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:24:47.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261015+0000","last_change":"2023-10-07T08:46:47.412869+0000","last_active":"2023-10-07T08:46:48.261015+0000","last_peered":"2023-10-07T08:46:48.261015+0000","last_clean":"2023-10-07T08:46:48.261015+0000","last_became_active":"2023-10-07T08:46:47.412388+0000","last_became_peered":"2023-10-07T08:46:47.412388+0000","last_unstale":"2023-10-07T08:46:48.261015+0000","last_undegraded":"2023-10-07T08:46:48.261015+0000","last_fullsized":"2023-10-07T08:46:48.261015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:15:40.340968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.262818+0000","last_change":"2023-10-07T08:46:48.262762+0000","last_active":"2023-10-07T08:46:48.262818+0000","last_peered":"2023-10-07T08:46:48.262818+0000","last_clean":"2023-10-07T08:46:48.262818+0000","last_became_active":"2023-10-07T08:46:48.262548+0000","last_became_peered":"2023-10-07T08:46:48.262548+0000","last_unstale":"2023-10-07T08:46:48.262818+0000","last_undegraded":"2023-10-07T08:46:48.262818+0000","last_fullsized":"2023-10-07T08:46:48.262818+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:29.739814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.265014+0000","last_change":"2023-10-07T08:46:47.408506+0000","last_active":"2023-10-07T08:46:48.265014+0000","last_peered":"2023-10-07T08:46:48.265014+0000","last_clean":"2023-10-07T08:46:48.265014+0000","last_became_active":"2023-10-07T08:46:47.408289+0000","last_became_peered":"2023-10-07T08:46:47.408289+0000","last_unstale":"2023-10-07T08:46:48.265014+0000","last_undegraded":"2023-10-07T08:46:48.265014+0000","last_fullsized":"2023-10-07T08:46:48.265014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:08:50.797798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261673+0000","last_change":"2023-10-07T08:46:48.261604+0000","last_active":"2023-10-07T08:46:48.261673+0000","last_peered":"2023-10-07T08:46:48.261673+0000","last_clean":"2023-10-07T08:46:48.261673+0000","last_became_active":"2023-10-07T08:46:48.261370+0000","last_became_peered":"2023-10-07T08:46:48.261370+0000","last_unstale":"2023-10-07T08:46:48.261673+0000","last_undegraded":"2023-10-07T08:46:48.261673+0000","last_fullsized":"2023-10-07T08:46:48.261673+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:57:09.862599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261669+0000","last_change":"2023-10-07T08:46:47.411618+0000","last_active":"2023-10-07T08:46:48.261669+0000","last_peered":"2023-10-07T08:46:48.261669+0000","last_clean":"2023-10-07T08:46:48.261669+0000","last_became_active":"2023-10-07T08:46:47.411344+0000","last_became_peered":"2023-10-07T08:46:47.411344+0000","last_unstale":"2023-10-07T08:46:48.261669+0000","last_undegraded":"2023-10-07T08:46:48.261669+0000","last_fullsized":"2023-10-07T08:46:48.261669+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:42:32.170438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.265025+0000","last_change":"2023-10-07T08:46:48.264966+0000","last_active":"2023-10-07T08:46:48.265025+0000","last_peered":"2023-10-07T08:46:48.265025+0000","last_clean":"2023-10-07T08:46:48.265025+0000","last_became_active":"2023-10-07T08:46:48.264738+0000","last_became_peered":"2023-10-07T08:46:48.264738+0000","last_unstale":"2023-10-07T08:46:48.265025+0000","last_undegraded":"2023-10-07T08:46:48.265025+0000","last_fullsized":"2023-10-07T08:46:48.265025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:58:06.437294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.423806+0000","last_change":"2023-10-07T08:46:47.416108+0000","last_active":"2023-10-07T08:46:48.423806+0000","last_peered":"2023-10-07T08:46:48.423806+0000","last_clean":"2023-10-07T08:46:48.423806+0000","last_became_active":"2023-10-07T08:46:47.415508+0000","last_became_peered":"2023-10-07T08:46:47.415508+0000","last_unstale":"2023-10-07T08:46:48.423806+0000","last_undegraded":"2023-10-07T08:46:48.423806+0000","last_fullsized":"2023-10-07T08:46:48.423806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:01:14.359277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.272483+0000","last_change":"2023-10-07T08:46:48.271838+0000","last_active":"2023-10-07T08:46:48.272483+0000","last_peered":"2023-10-07T08:46:48.272483+0000","last_clean":"2023-10-07T08:46:48.272483+0000","last_became_active":"2023-10-07T08:46:48.271316+0000","last_became_peered":"2023-10-07T08:46:48.271316+0000","last_unstale":"2023-10-07T08:46:48.272483+0000","last_undegraded":"2023-10-07T08:46:48.272483+0000","last_fullsized":"2023-10-07T08:46:48.272483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:57:20.107008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.264466+0000","last_change":"2023-10-07T08:46:47.410107+0000","last_active":"2023-10-07T08:46:48.264466+0000","last_peered":"2023-10-07T08:46:48.264466+0000","last_clean":"2023-10-07T08:46:48.264466+0000","last_became_active":"2023-10-07T08:46:47.409630+0000","last_became_peered":"2023-10-07T08:46:47.409630+0000","last_unstale":"2023-10-07T08:46:48.264466+0000","last_undegraded":"2023-10-07T08:46:48.264466+0000","last_fullsized":"2023-10-07T08:46:48.264466+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:26:06.794529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.275397+0000","last_change":"2023-10-07T08:46:48.275132+0000","last_active":"2023-10-07T08:46:48.275397+0000","last_peered":"2023-10-07T08:46:48.275397+0000","last_clean":"2023-10-07T08:46:48.275397+0000","last_became_active":"2023-10-07T08:46:48.274187+0000","last_became_peered":"2023-10-07T08:46:48.274187+0000","last_unstale":"2023-10-07T08:46:48.275397+0000","last_undegraded":"2023-10-07T08:46:48.275397+0000","last_fullsized":"2023-10-07T08:46:48.275397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:07:00.864605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.259881+0000","last_change":"2023-10-07T08:46:47.407283+0000","last_active":"2023-10-07T08:46:48.259881+0000","last_peered":"2023-10-07T08:46:48.259881+0000","last_clean":"2023-10-07T08:46:48.259881+0000","last_became_active":"2023-10-07T08:46:47.406998+0000","last_became_peered":"2023-10-07T08:46:47.406998+0000","last_unstale":"2023-10-07T08:46:48.259881+0000","last_undegraded":"2023-10-07T08:46:48.259881+0000","last_fullsized":"2023-10-07T08:46:48.259881+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:24:09.253730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.272557+0000","last_change":"2023-10-07T08:46:48.272487+0000","last_active":"2023-10-07T08:46:48.272557+0000","last_peered":"2023-10-07T08:46:48.272557+0000","last_clean":"2023-10-07T08:46:48.272557+0000","last_became_active":"2023-10-07T08:46:48.272052+0000","last_became_peered":"2023-10-07T08:46:48.272052+0000","last_unstale":"2023-10-07T08:46:48.272557+0000","last_undegraded":"2023-10-07T08:46:48.272557+0000","last_fullsized":"2023-10-07T08:46:48.272557+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:28:54.454460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.262818+0000","last_change":"2023-10-07T08:46:47.409633+0000","last_active":"2023-10-07T08:46:48.262818+0000","last_peered":"2023-10-07T08:46:48.262818+0000","last_clean":"2023-10-07T08:46:48.262818+0000","last_became_active":"2023-10-07T08:46:47.409419+0000","last_became_peered":"2023-10-07T08:46:47.409419+0000","last_unstale":"2023-10-07T08:46:48.262818+0000","last_undegraded":"2023-10-07T08:46:48.262818+0000","last_fullsized":"2023-10-07T08:46:48.262818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:26:06.794529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.262123+0000","last_change":"2023-10-07T08:46:48.262068+0000","last_active":"2023-10-07T08:46:48.262123+0000","last_peered":"2023-10-07T08:46:48.262123+0000","last_clean":"2023-10-07T08:46:48.262123+0000","last_became_active":"2023-10-07T08:46:48.261838+0000","last_became_peered":"2023-10-07T08:46:48.261838+0000","last_unstale":"2023-10-07T08:46:48.262123+0000","last_undegraded":"2023-10-07T08:46:48.262123+0000","last_fullsized":"2023-10-07T08:46:48.262123+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:06:53.969456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.259323+0000","last_change":"2023-10-07T08:46:47.409428+0000","last_active":"2023-10-07T08:46:48.259323+0000","last_peered":"2023-10-07T08:46:48.259323+0000","last_clean":"2023-10-07T08:46:48.259323+0000","last_became_active":"2023-10-07T08:46:47.408963+0000","last_became_peered":"2023-10-07T08:46:47.408963+0000","last_unstale":"2023-10-07T08:46:48.259323+0000","last_undegraded":"2023-10-07T08:46:48.259323+0000","last_fullsized":"2023-10-07T08:46:48.259323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:29.753321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.275871+0000","last_change":"2023-10-07T08:46:48.275802+0000","last_active":"2023-10-07T08:46:48.275871+0000","last_peered":"2023-10-07T08:46:48.275871+0000","last_clean":"2023-10-07T08:46:48.275871+0000","last_became_active":"2023-10-07T08:46:48.275216+0000","last_became_peered":"2023-10-07T08:46:48.275216+0000","last_unstale":"2023-10-07T08:46:48.275871+0000","last_undegraded":"2023-10-07T08:46:48.275871+0000","last_fullsized":"2023-10-07T08:46:48.275871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:11.268440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.263774+0000","last_change":"2023-10-07T08:46:47.412001+0000","last_active":"2023-10-07T08:46:48.263774+0000","last_peered":"2023-10-07T08:46:48.263774+0000","last_clean":"2023-10-07T08:46:48.263774+0000","last_became_active":"2023-10-07T08:46:47.411776+0000","last_became_peered":"2023-10-07T08:46:47.411776+0000","last_unstale":"2023-10-07T08:46:48.263774+0000","last_undegraded":"2023-10-07T08:46:48.263774+0000","last_fullsized":"2023-10-07T08:46:48.263774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:53:48.874357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.267398+0000","last_change":"2023-10-07T08:46:48.267320+0000","last_active":"2023-10-07T08:46:48.267398+0000","last_peered":"2023-10-07T08:46:48.267398+0000","last_clean":"2023-10-07T08:46:48.267398+0000","last_became_active":"2023-10-07T08:46:48.266986+0000","last_became_peered":"2023-10-07T08:46:48.266986+0000","last_unstale":"2023-10-07T08:46:48.267398+0000","last_undegraded":"2023-10-07T08:46:48.267398+0000","last_fullsized":"2023-10-07T08:46:48.267398+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:14:33.571514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.266318+0000","last_change":"2023-10-07T08:46:47.411984+0000","last_active":"2023-10-07T08:46:48.266318+0000","last_peered":"2023-10-07T08:46:48.266318+0000","last_clean":"2023-10-07T08:46:48.266318+0000","last_became_active":"2023-10-07T08:46:47.411435+0000","last_became_peered":"2023-10-07T08:46:47.411435+0000","last_unstale":"2023-10-07T08:46:48.266318+0000","last_undegraded":"2023-10-07T08:46:48.266318+0000","last_fullsized":"2023-10-07T08:46:48.266318+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:54:25.996746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261511+0000","last_change":"2023-10-07T08:46:48.261460+0000","last_active":"2023-10-07T08:46:48.261511+0000","last_peered":"2023-10-07T08:46:48.261511+0000","last_clean":"2023-10-07T08:46:48.261511+0000","last_became_active":"2023-10-07T08:46:48.261289+0000","last_became_peered":"2023-10-07T08:46:48.261289+0000","last_unstale":"2023-10-07T08:46:48.261511+0000","last_undegraded":"2023-10-07T08:46:48.261511+0000","last_fullsized":"2023-10-07T08:46:48.261511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:53:49.878186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261106+0000","last_change":"2023-10-07T08:46:47.415036+0000","last_active":"2023-10-07T08:46:48.261106+0000","last_peered":"2023-10-07T08:46:48.261106+0000","last_clean":"2023-10-07T08:46:48.261106+0000","last_became_active":"2023-10-07T08:46:47.414822+0000","last_became_peered":"2023-10-07T08:46:47.414822+0000","last_unstale":"2023-10-07T08:46:48.261106+0000","last_undegraded":"2023-10-07T08:46:48.261106+0000","last_fullsized":"2023-10-07T08:46:48.261106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:28:37.508902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.261700+0000","last_change":"2023-10-07T08:46:48.261646+0000","last_active":"2023-10-07T08:46:48.261700+0000","last_peered":"2023-10-07T08:46:48.261700+0000","last_clean":"2023-10-07T08:46:48.261700+0000","last_became_active":"2023-10-07T08:46:48.261439+0000","last_became_peered":"2023-10-07T08:46:48.261439+0000","last_unstale":"2023-10-07T08:46:48.261700+0000","last_undegraded":"2023-10-07T08:46:48.261700+0000","last_fullsized":"2023-10-07T08:46:48.261700+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:47.398517+0000","last_clean_scrub_stamp":"2023-10-07T08:46:47.398517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:02:23.966054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.424914+0000","last_change":"2023-10-07T08:46:47.414668+0000","last_active":"2023-10-07T08:46:48.424914+0000","last_peered":"2023-10-07T08:46:48.424914+0000","last_clean":"2023-10-07T08:46:48.424914+0000","last_became_active":"2023-10-07T08:46:47.413391+0000","last_became_peered":"2023-10-07T08:46:47.413391+0000","last_unstale":"2023-10-07T08:46:48.424914+0000","last_undegraded":"2023-10-07T08:46:48.424914+0000","last_fullsized":"2023-10-07T08:46:48.424914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:46:46.394688+0000","last_clean_scrub_stamp":"2023-10-07T08:46:46.394688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:09.685547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":216,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-07T08:46:48.266237+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:46:48.266237+0000","last_peered":"2023-10-07T08:46:48.266237+0000","last_clean":"2023-10-07T08:46:48.266237+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:46:48.266237+0000","last_undegraded":"2023-10-07T08:46:48.266237+0000","last_fullsized":"2023-10-07T08:46:48.266237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1008,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194304,"statfs":{"total":200000000,"available":198967401,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:45:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.49399999999999999},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.496,"15min":0.48199999999999998},"min":{"1min":0.35099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.65000000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:45:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70499999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.69599999999999995}]},{"osd":2,"last update":"Sat Oct 7 08:45:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73299999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.625},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.496,"15min":0.48399999999999999},"min":{"1min":0.34300000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71699999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:45:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.76700000000000002,"15min":0.85299999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77200000000000002,"5min":6.8570000000000002,"15min":6.8570000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":0.72299999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.68000000000000005}]},{"osd":4,"last update":"Sat Oct 7 08:45:50 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48299999999999998,"15min":0.48599999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.40200000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.78400000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.43099999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:45:50 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73399999999999999,"5min":0.746,"15min":0.746},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.35499999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.47199999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:45:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59299999999999997,"15min":0.59999999999999998},"min":{"1min":0.43099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.37,"5min":0.318,"15min":0.318},"max":{"1min":0.80200000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.49199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":431,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194881,"statfs":{"total":200000000,"available":199558265,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:45:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47199999999999998,"15min":0.46500000000000002},"min":{"1min":0.34300000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35799999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67500000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.54900000000000004}]},{"osd":1,"last update":"Sat Oct 7 08:45:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.622,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.46600000000000003}]},{"osd":2,"last update":"Sat Oct 7 08:45:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.46800000000000003},"min":{"1min":0.373,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68700000000000006,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64300000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.56399999999999995}]},{"osd":3,"last update":"Sat Oct 7 08:45:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.503,"15min":0.502},"min":{"1min":0.40699999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65500000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.442},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.52700000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69799999999999995,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.48599999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:45:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.31900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.64100000000000001,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.32600000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61899999999999999,"5min":0.748,"15min":0.748},"last":0.503}]},{"osd":5,"last update":"Sat Oct 7 08:45:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50900000000000001,"15min":0.5},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.74199999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68300000000000005,"5min":0.748,"15min":0.748},"last":0.60199999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:45:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.36699999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.71899999999999997,"5min":0.754,"15min":0.754},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76700000000000002,"5min":1.052,"15min":1.052},"last":0.60999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":439,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194872,"statfs":{"total":200000000,"available":199549945,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34000000000000002,"15min":0.31},"min":{"1min":0.19400000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.46200000000000002,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.34399999999999997,"15min":0.32400000000000001},"min":{"1min":0.221,"5min":0.192,"15min":0.192},"max":{"1min":0.51500000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:46:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.315},"min":{"1min":0.25900000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48599999999999999,"5min":1.639,"15min":1.639},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.373,"15min":0.32700000000000001},"min":{"1min":0.23599999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52700000000000002,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.38700000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:46:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.56200000000000006,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.34200000000000003},"min":{"1min":0.30599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55000000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:46:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.40600000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85299999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.55700000000000005,"15min":0.52000000000000002},"min":{"1min":0.41899999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.89300000000000002,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.44600000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:46:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.495},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.58699999999999997,"15min":0.56299999999999994},"min":{"1min":0.496,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90700000000000003,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.56799999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:46:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.45200000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.55300000000000005,"15min":0.52000000000000002},"min":{"1min":0.41399999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82399999999999995,"5min":0.87,"15min":0.87},"last":0.46500000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:46:49 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.47099999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81599999999999995,"5min":1.04,"15min":1.04},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.59899999999999998,"15min":0.57599999999999996},"min":{"1min":0.45300000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84299999999999997,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1007,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194304,"statfs":{"total":200000000,"available":198967989,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34599999999999997,"15min":0.372},"min":{"1min":0.24199999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.48999999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.378,"15min":0.39500000000000002},"min":{"1min":0.29499999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59099999999999997,"5min":1.079,"15min":1.079},"last":0.29299999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.376,"15min":0.39200000000000002},"min":{"1min":0.27400000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.62,"5min":1.464,"15min":1.464},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39500000000000002,"15min":0.39600000000000002},"min":{"1min":0.26000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51200000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.34499999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.374,"15min":0.38600000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.497,"5min":1.341,"15min":1.341},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.42299999999999999,"15min":0.436},"min":{"1min":0.29799999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56999999999999995,"5min":1.532,"15min":1.532},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71799999999999997,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59199999999999997,"15min":0.61199999999999999},"min":{"1min":0.433,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84899999999999998,"5min":1.51,"15min":1.51},"last":0.72699999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58999999999999997,"15min":0.59799999999999998},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.75900000000000001,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.90100000000000002,"5min":1.25,"15min":1.25},"last":0.61599999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.41499999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85099999999999998,"5min":1.488,"15min":1.488},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86899999999999999,"5min":1.024,"15min":1.024},"last":0.67900000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.436,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88200000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.60599999999999998},"min":{"1min":0.40899999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.83799999999999997,"5min":1.288,"15min":1.288},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":432,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194879,"statfs":{"total":200000000,"available":199556821,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33900000000000002,"15min":0.34599999999999997},"min":{"1min":0.192,"5min":0.187,"15min":0.187},"max":{"1min":0.52800000000000002,"5min":1.665,"15min":1.665},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35599999999999998,"15min":0.36199999999999999},"min":{"1min":0.22900000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47899999999999998,"5min":1.579,"15min":1.579},"last":0.376}]},{"osd":1,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.36599999999999999,"15min":0.375},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.57899999999999996,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.42299999999999999},"min":{"1min":0.27600000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55900000000000005,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.33500000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38400000000000001,"15min":0.39000000000000001},"min":{"1min":0.28399999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54800000000000004,"5min":1.454,"15min":1.454},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.38100000000000001,"15min":0.38900000000000001},"min":{"1min":0.22800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58999999999999997,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.34999999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.77300000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.40600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.748,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.39400000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55000000000000004,"15min":0.54200000000000004},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.94399999999999995,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.81499999999999995,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.41599999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79000000000000004,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76500000000000001,"5min":1.637,"15min":1.637},"last":0.495}]},{"osd":7,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.81299999999999994,"5min":1.49,"15min":1.49},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39900000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84699999999999998,"5min":1.375,"15min":1.375},"last":0.46700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":437,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194874,"statfs":{"total":200000000,"available":199551957,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.34100000000000003,"15min":0.32600000000000001},"min":{"1min":0.22500000000000001,"5min":0.217,"15min":0.217},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.307},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.33500000000000002,"15min":0.317},"min":{"1min":0.28399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.36399999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.375,"15min":0.35799999999999998},"min":{"1min":0.25900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.41199999999999998,"15min":0.39600000000000002},"min":{"1min":0.28799999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.38800000000000001,"15min":0.379},"min":{"1min":0.28299999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.41299999999999998,"15min":0.39900000000000002},"min":{"1min":0.29799999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.38300000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.51500000000000001,"15min":0.49299999999999999},"min":{"1min":0.42899999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.54900000000000004,"15min":0.52700000000000002},"min":{"1min":0.44,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.438}]},{"osd":5,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.497,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.44900000000000001,"5min":0.379,"15min":0.379},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.55500000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.57599999999999996,"15min":0.55000000000000004},"min":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.59999999999999998,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.433,"15min":0.433},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.47099999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:45:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.54900000000000004},"min":{"1min":0.434,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.48399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":437,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194874,"statfs":{"total":200000000,"available":199551999,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.28799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.35099999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.435}]},{"osd":1,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.505,"15min":0.49099999999999999},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.504,"15min":0.49199999999999999},"min":{"1min":0.34799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.499}]},{"osd":2,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.53700000000000003,"15min":0.52500000000000002},"min":{"1min":0.32100000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.51800000000000002,"15min":0.501},"min":{"1min":0.44700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.41099999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.54200000000000004,"15min":0.52000000000000002},"min":{"1min":0.35899999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.39400000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.51100000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53700000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.66500000000000004,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.48699999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.316,"15min":0.316},"max":{"1min":0.67700000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64100000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.57299999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.54700000000000004,"15min":0.56100000000000005},"min":{"1min":0.38600000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69399999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70599999999999996,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":437,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194874,"statfs":{"total":200000000,"available":199551979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51300000000000001,"15min":0.51000000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72299999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.624},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51000000000000001,"15min":0.50600000000000001},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76200000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.49199999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.48699999999999999,"15min":0.48099999999999998},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":0.748,"15min":0.748},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53000000000000003,"15min":0.52700000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72499999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57899999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.38,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71399999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.378,"5min":0.309,"15min":0.309},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.54900000000000004}]},{"osd":3,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73799999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.36299999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59699999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70199999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.40300000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79400000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.63200000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53500000000000003,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.42699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79300000000000004,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:45:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57599999999999996,"15min":0.58599999999999997},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81599999999999995,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58899999999999997,"15min":0.60599999999999998},"min":{"1min":0.36499999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77900000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61199999999999999}]}]}],"pool_statfs":[]}} 2023-10-07T08:46:52.851 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T08:46:52.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T08:46:53.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.006+0000 7eff1d9c9700 1 Processor -- start 2023-10-07T08:46:53.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.006+0000 7eff1d9c9700 1 -- start start 2023-10-07T08:46:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.007+0000 7eff1d9c9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff181577c0 0x7eff18068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.007+0000 7eff1d9c9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7eff18157b90 0x7eff18068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.007+0000 7eff1d9c9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff180cca80 con 0x7eff180cb790 2023-10-07T08:46:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.007+0000 7eff1d9c9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff180cedd0 con 0x7eff18157b90 2023-10-07T08:46:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.007+0000 7eff1d9c9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff180cc4c0 con 0x7eff181577c0 2023-10-07T08:46:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.007+0000 7eff167fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7eff18157b90 0x7eff18068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.007+0000 7eff167fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7eff18157b90 0x7eff18068d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33148/0 (socket says 172.21.15.81:33148) 2023-10-07T08:46:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.007+0000 7eff167fc700 1 -- 172.21.15.81:0/3424050302 learned_addr learned my addr 172.21.15.81:0/3424050302 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.007+0000 7eff16ffd700 1 --2- 172.21.15.81:0/3424050302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff181577c0 0x7eff18068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.007+0000 7eff167fc700 1 -- 172.21.15.81:0/3424050302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff181577c0 msgr2=0x7eff18068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.007+0000 7eff167fc700 1 --2- 172.21.15.81:0/3424050302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff181577c0 0x7eff18068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.007+0000 7eff167fc700 1 -- 172.21.15.81:0/3424050302 >> v1:172.21.15.89:6789/0 conn(0x7eff180cb790 legacy=0x7eff180cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.007+0000 7eff167fc700 1 -- 172.21.15.81:0/3424050302 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff180cc7a0 con 0x7eff18157b90 2023-10-07T08:46:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.008+0000 7eff16ffd700 1 --2- 172.21.15.81:0/3424050302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff181577c0 0x7eff18068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.008+0000 7eff167fc700 1 --2- 172.21.15.81:0/3424050302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff18157b90 0x7eff18068d50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0099b0 tx=0x7eff0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1f0167beb067a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.008+0000 7eff15ffb700 1 -- 172.21.15.81:0/3424050302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00b860 con 0x7eff18157b90 2023-10-07T08:46:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.008+0000 7eff15ffb700 1 -- 172.21.15.81:0/3424050302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c00b9c0 con 0x7eff18157b90 2023-10-07T08:46:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.008+0000 7eff15ffb700 1 -- 172.21.15.81:0/3424050302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00bd60 con 0x7eff18157b90 2023-10-07T08:46:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.008+0000 7eff1d9c9700 1 -- 172.21.15.81:0/3424050302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff18157b90 msgr2=0x7eff18068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.008+0000 7eff1d9c9700 1 --2- 172.21.15.81:0/3424050302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff18157b90 0x7eff18068d50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0099b0 tx=0x7eff0c009250 comp rx=0 tx=0).stop 2023-10-07T08:46:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.008+0000 7eff1d9c9700 1 -- 172.21.15.81:0/3424050302 shutdown_connections 2023-10-07T08:46:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.008+0000 7eff1d9c9700 1 --2- 172.21.15.81:0/3424050302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff181577c0 0x7eff18068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.008+0000 7eff1d9c9700 1 --2- 172.21.15.81:0/3424050302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff18157b90 0x7eff18068d50 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.008+0000 7eff1d9c9700 1 -- 172.21.15.81:0/3424050302 >> 172.21.15.81:0/3424050302 conn(0x7eff180d0df0 msgr2=0x7eff180d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.008+0000 7eff1d9c9700 1 -- 172.21.15.81:0/3424050302 shutdown_connections 2023-10-07T08:46:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.008+0000 7eff1d9c9700 1 -- 172.21.15.81:0/3424050302 wait complete. 2023-10-07T08:46:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.010+0000 7eff1d9c9700 1 Processor -- start 2023-10-07T08:46:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.010+0000 7eff1d9c9700 1 -- start start 2023-10-07T08:46:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.010+0000 7eff1d9c9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff180cb790 0x7eff1806e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.010+0000 7eff1d9c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff181577c0 0x7eff181549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.010+0000 7eff1d9c9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff18157b90 0x7eff18154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.010+0000 7eff1d9c9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff180b41f0 con 0x7eff181577c0 2023-10-07T08:46:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.010+0000 7eff1d9c9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff180c72b0 con 0x7eff180cb790 2023-10-07T08:46:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.010+0000 7eff1d9c9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff180c7590 con 0x7eff18157b90 2023-10-07T08:46:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.010+0000 7eff167fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff181577c0 0x7eff181549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.010+0000 7eff167fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff181577c0 0x7eff181549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33152/0 (socket says 172.21.15.81:33152) 2023-10-07T08:46:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.010+0000 7eff167fc700 1 -- 172.21.15.81:0/1261532742 learned_addr learned my addr 172.21.15.81:0/1261532742 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.010+0000 7eff177fe700 1 --2- 172.21.15.81:0/1261532742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff18157b90 0x7eff18154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.010+0000 7eff16ffd700 1 --2- 172.21.15.81:0/1261532742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff180cb790 0x7eff1806e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.011+0000 7eff167fc700 1 -- 172.21.15.81:0/1261532742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff18157b90 msgr2=0x7eff18154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.011+0000 7eff167fc700 1 --2- 172.21.15.81:0/1261532742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff18157b90 0x7eff18154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.011+0000 7eff167fc700 1 -- 172.21.15.81:0/1261532742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff180cb790 msgr2=0x7eff1806e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.011+0000 7eff167fc700 1 --2- 172.21.15.81:0/1261532742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff180cb790 0x7eff1806e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.011+0000 7eff167fc700 1 -- 172.21.15.81:0/1261532742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c0094f0 con 0x7eff181577c0 2023-10-07T08:46:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.011+0000 7eff16ffd700 1 --2- 172.21.15.81:0/1261532742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff180cb790 0x7eff1806e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.011+0000 7eff167fc700 1 --2- 172.21.15.81:0/1261532742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff181577c0 0x7eff181549c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0090b0 tx=0x7eff0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.011+0000 7efefeffd700 1 -- 172.21.15.81:0/1261532742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c024440 con 0x7eff181577c0 2023-10-07T08:46:53.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.011+0000 7efefeffd700 1 -- 172.21.15.81:0/1261532742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c0245e0 con 0x7eff181577c0 2023-10-07T08:46:53.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.011+0000 7eff1d9c9700 1 -- 172.21.15.81:0/1261532742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff180c7870 con 0x7eff181577c0 2023-10-07T08:46:53.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.011+0000 7efefeffd700 1 -- 172.21.15.81:0/1261532742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0249a0 con 0x7eff181577c0 2023-10-07T08:46:53.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.011+0000 7eff1d9c9700 1 -- 172.21.15.81:0/1261532742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1806e910 con 0x7eff181577c0 2023-10-07T08:46:53.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.012+0000 7eff1d9c9700 1 -- 172.21.15.81:0/1261532742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff180b3fc0 con 0x7eff181577c0 2023-10-07T08:46:53.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.012+0000 7efefeffd700 1 -- 172.21.15.81:0/1261532742 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff0c01a420 con 0x7eff181577c0 2023-10-07T08:46:53.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.013+0000 7efefeffd700 1 --2- 172.21.15.81:0/1261532742 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff04066f30 0x7eff040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:53.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.013+0000 7efefeffd700 1 -- 172.21.15.81:0/1261532742 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff0c086120 con 0x7eff181577c0 2023-10-07T08:46:53.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.013+0000 7eff16ffd700 1 --2- 172.21.15.81:0/1261532742 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff04066f30 0x7eff040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:53.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.013+0000 7eff16ffd700 1 --2- 172.21.15.81:0/1261532742 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff04066f30 0x7eff040693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7eff1816d9d0 tx=0x7eff08009910 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:53.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.017+0000 7efefeffd700 1 -- 172.21.15.81:0/1261532742 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff180b3fc0 con 0x7eff181577c0 2023-10-07T08:46:53.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.273+0000 7eff1d9c9700 1 -- 172.21.15.81:0/1261532742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7eff180b3fc0 con 0x7eff181577c0 2023-10-07T08:46:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.278+0000 7efefeffd700 1 -- 172.21.15.81:0/1261532742 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7eff180b3fc0 con 0x7eff181577c0 2023-10-07T08:46:53.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.281+0000 7eff1d9c9700 1 -- 172.21.15.81:0/1261532742 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff04066f30 msgr2=0x7eff040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:53.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.281+0000 7eff1d9c9700 1 --2- 172.21.15.81:0/1261532742 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff04066f30 0x7eff040693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7eff1816d9d0 tx=0x7eff08009910 comp rx=0 tx=0).stop 2023-10-07T08:46:53.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.281+0000 7eff1d9c9700 1 -- 172.21.15.81:0/1261532742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff181577c0 msgr2=0x7eff181549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.281+0000 7eff1d9c9700 1 --2- 172.21.15.81:0/1261532742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff181577c0 0x7eff181549c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0090b0 tx=0x7eff0c017000 comp rx=0 tx=0).stop 2023-10-07T08:46:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.281+0000 7eff1d9c9700 1 -- 172.21.15.81:0/1261532742 shutdown_connections 2023-10-07T08:46:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.281+0000 7eff1d9c9700 1 --2- 172.21.15.81:0/1261532742 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff04066f30 0x7eff040693e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.281+0000 7eff1d9c9700 1 --2- 172.21.15.81:0/1261532742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff18157b90 0x7eff18154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.281+0000 7eff1d9c9700 1 --2- 172.21.15.81:0/1261532742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff180cb790 0x7eff1806e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.281+0000 7eff1d9c9700 1 --2- 172.21.15.81:0/1261532742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff181577c0 0x7eff181549c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.281+0000 7eff1d9c9700 1 -- 172.21.15.81:0/1261532742 >> 172.21.15.81:0/1261532742 conn(0x7eff180d0df0 msgr2=0x7eff180cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.281+0000 7eff1d9c9700 1 -- 172.21.15.81:0/1261532742 shutdown_connections 2023-10-07T08:46:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.281+0000 7eff1d9c9700 1 -- 172.21.15.81:0/1261532742 wait complete. 2023-10-07T08:46:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-07T08:46:53.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:46:53.397 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-10-07T08:46:53.397+0000 7fe546cba700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:46:53.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.406+0000 7fce53572700 1 Processor -- start 2023-10-07T08:46:53.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.406+0000 7fce53572700 1 -- start start 2023-10-07T08:46:53.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.407+0000 7fce53572700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce4c06eda0 0x7fce4c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:53.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.407+0000 7fce53572700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4c06a2e0 con 0x7fce4c0cda80 2023-10-07T08:46:53.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.407+0000 7fce53572700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4c0b1f60 con 0x7fce4c156960 2023-10-07T08:46:53.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.407+0000 7fce53572700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4c0b2240 con 0x7fce4c06eda0 2023-10-07T08:46:53.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.407+0000 7fce50b0d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce4c06eda0 0x7fce4c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.407+0000 7fce50b0d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce4c06eda0 0x7fce4c06a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33160/0 (socket says 172.21.15.81:33160) 2023-10-07T08:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.407+0000 7fce50b0d700 1 -- 172.21.15.81:0/3003002833 learned_addr learned my addr 172.21.15.81:0/3003002833 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.407+0000 7fce51b0f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fce4c0cda80 0x7fce4c0cde90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57110/0 (socket says 172.21.15.81:57110) 2023-10-07T08:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.408+0000 7fce50b0d700 1 -- 172.21.15.81:0/3003002833 >> v1:172.21.15.89:6789/0 conn(0x7fce4c156960 legacy=0x7fce4c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.408+0000 7fce50b0d700 1 -- 172.21.15.81:0/3003002833 >> v1:172.21.15.81:6789/0 conn(0x7fce4c0cda80 legacy=0x7fce4c0cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.408+0000 7fce50b0d700 1 -- 172.21.15.81:0/3003002833 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c069c90 con 0x7fce4c06eda0 2023-10-07T08:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.408+0000 7fce43fff700 1 -- 172.21.15.81:0/3003002833 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107020165 0 0) 0x7fce4c06a2e0 con 0x7fce4c0cda80 2023-10-07T08:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.408+0000 7fce50b0d700 1 --2- 172.21.15.81:0/3003002833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce4c06eda0 0x7fce4c06a770 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00bc50 tx=0x7fce3c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd2794408e538df server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.408+0000 7fce43fff700 1 -- 172.21.15.81:0/3003002833 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c00be60 con 0x7fce4c06eda0 2023-10-07T08:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.408+0000 7fce43fff700 1 -- 172.21.15.81:0/3003002833 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c00ddc0 con 0x7fce4c06eda0 2023-10-07T08:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.408+0000 7fce43fff700 1 -- 172.21.15.81:0/3003002833 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c0106a0 con 0x7fce4c06eda0 2023-10-07T08:46:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.408+0000 7fce53572700 1 -- 172.21.15.81:0/3003002833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce4c06eda0 msgr2=0x7fce4c06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.408+0000 7fce53572700 1 --2- 172.21.15.81:0/3003002833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce4c06eda0 0x7fce4c06a770 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00bc50 tx=0x7fce3c00b4f0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.408+0000 7fce53572700 1 -- 172.21.15.81:0/3003002833 shutdown_connections 2023-10-07T08:46:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.408+0000 7fce53572700 1 --2- 172.21.15.81:0/3003002833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce4c06eda0 0x7fce4c06a770 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.408+0000 7fce53572700 1 -- 172.21.15.81:0/3003002833 >> 172.21.15.81:0/3003002833 conn(0x7fce4c06cca0 msgr2=0x7fce4c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.409+0000 7fce53572700 1 -- 172.21.15.81:0/3003002833 shutdown_connections 2023-10-07T08:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.409+0000 7fce53572700 1 -- 172.21.15.81:0/3003002833 wait complete. 2023-10-07T08:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.410+0000 7fce53572700 1 Processor -- start 2023-10-07T08:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.410+0000 7fce53572700 1 -- start start 2023-10-07T08:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.410+0000 7fce53572700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce4c06eda0 0x7fce4c0c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.410+0000 7fce53572700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce4c0cda80 0x7fce4c0c2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce53572700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce4c156960 0x7fce4c14c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce53572700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c0c3e10 con 0x7fce4c156960 2023-10-07T08:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce53572700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c0c3200 con 0x7fce4c06eda0 2023-10-07T08:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce53572700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c0c34e0 con 0x7fce4c0cda80 2023-10-07T08:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce51b0f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce4c156960 0x7fce4c14c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce51b0f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce4c156960 0x7fce4c14c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33174/0 (socket says 172.21.15.81:33174) 2023-10-07T08:46:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce51b0f700 1 -- 172.21.15.81:0/3538904083 learned_addr learned my addr 172.21.15.81:0/3538904083 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce51b0f700 1 -- 172.21.15.81:0/3538904083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce4c0cda80 msgr2=0x7fce4c0c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce51b0f700 1 --2- 172.21.15.81:0/3538904083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce4c0cda80 0x7fce4c0c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce51b0f700 1 -- 172.21.15.81:0/3538904083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce4c06eda0 msgr2=0x7fce4c0c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce51b0f700 1 --2- 172.21.15.81:0/3538904083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce4c06eda0 0x7fce4c0c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce51b0f700 1 -- 172.21.15.81:0/3538904083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c00b790 con 0x7fce4c156960 2023-10-07T08:46:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce51b0f700 1 --2- 172.21.15.81:0/3538904083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce4c156960 0x7fce4c14c180 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fce4400c5e0 tx=0x7fce44007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce417fa700 1 -- 172.21.15.81:0/3538904083 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce44005a70 con 0x7fce4c156960 2023-10-07T08:46:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce417fa700 1 -- 172.21.15.81:0/3538904083 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce44005bd0 con 0x7fce4c156960 2023-10-07T08:46:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce53572700 1 -- 172.21.15.81:0/3538904083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4c0c37c0 con 0x7fce4c156960 2023-10-07T08:46:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce417fa700 1 -- 172.21.15.81:0/3538904083 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce440070d0 con 0x7fce4c156960 2023-10-07T08:46:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.411+0000 7fce53572700 1 -- 172.21.15.81:0/3538904083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4c148980 con 0x7fce4c156960 2023-10-07T08:46:53.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.412+0000 7fce53572700 1 -- 172.21.15.81:0/3538904083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce4c068b70 con 0x7fce4c156960 2023-10-07T08:46:53.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.413+0000 7fce417fa700 1 -- 172.21.15.81:0/3538904083 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce44007440 con 0x7fce4c156960 2023-10-07T08:46:53.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.413+0000 7fce417fa700 1 --2- 172.21.15.81:0/3538904083 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fce30066f30 0x7fce300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:53.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.413+0000 7fce417fa700 1 -- 172.21.15.81:0/3538904083 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fce44083ba0 con 0x7fce4c156960 2023-10-07T08:46:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.413+0000 7fce5130e700 1 --2- 172.21.15.81:0/3538904083 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fce30066f30 0x7fce300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.413+0000 7fce5130e700 1 --2- 172.21.15.81:0/3538904083 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fce30066f30 0x7fce300693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fce4800acf0 tx=0x7fce48009350 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.417+0000 7fce417fa700 1 -- 172.21.15.81:0/3538904083 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce44050d70 con 0x7fce4c156960 2023-10-07T08:46:53.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.647+0000 7fce53572700 1 -- 172.21.15.81:0/3538904083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce4c069f70 con 0x7fce4c156960 2023-10-07T08:46:53.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.648+0000 7fce417fa700 1 -- 172.21.15.81:0/3538904083 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fce44017070 con 0x7fce4c156960 2023-10-07T08:46:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:53.649 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/401991459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":401991459},{"type":"v1","addr":"172.21.15.89:6834","nonce":401991459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2214247931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2214247931},{"type":"v1","addr":"172.21.15.81:6836","nonce":2214247931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5620,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1168741718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1168741718},{"type":"v1","addr":"172.21.15.89:6835","nonce":1168741718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:46:47.782779+0000","modified":"2023-10-07T08:46:51.441764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6015":{"gid":6015,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2297722913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2297722913},{"type":"v1","addr":"172.21.15.81:6837","nonce":2297722913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-07T08:46:53.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.650+0000 7fce53572700 1 -- 172.21.15.81:0/3538904083 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fce30066f30 msgr2=0x7fce300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:53.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.650+0000 7fce53572700 1 --2- 172.21.15.81:0/3538904083 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fce30066f30 0x7fce300693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fce4800acf0 tx=0x7fce48009350 comp rx=0 tx=0).stop 2023-10-07T08:46:53.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.650+0000 7fce53572700 1 -- 172.21.15.81:0/3538904083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce4c156960 msgr2=0x7fce4c14c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:53.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.650+0000 7fce53572700 1 --2- 172.21.15.81:0/3538904083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce4c156960 0x7fce4c14c180 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fce4400c5e0 tx=0x7fce44007d60 comp rx=0 tx=0).stop 2023-10-07T08:46:53.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.650+0000 7fce53572700 1 -- 172.21.15.81:0/3538904083 shutdown_connections 2023-10-07T08:46:53.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.650+0000 7fce53572700 1 --2- 172.21.15.81:0/3538904083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce4c156960 0x7fce4c14c180 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.650+0000 7fce53572700 1 --2- 172.21.15.81:0/3538904083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce4c06eda0 0x7fce4c0c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.650+0000 7fce53572700 1 --2- 172.21.15.81:0/3538904083 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fce30066f30 0x7fce300693e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.650+0000 7fce53572700 1 --2- 172.21.15.81:0/3538904083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce4c0cda80 0x7fce4c0c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:53.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.650+0000 7fce53572700 1 -- 172.21.15.81:0/3538904083 >> 172.21.15.81:0/3538904083 conn(0x7fce4c06cca0 msgr2=0x7fce4c06e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:53.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.650+0000 7fce53572700 1 -- 172.21.15.81:0/3538904083 shutdown_connections 2023-10-07T08:46:53.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:53.650+0000 7fce53572700 1 -- 172.21.15.81:0/3538904083 wait complete. 2023-10-07T08:46:53.652 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2023-10-07T08:46:54.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T08:46:47.782779+0000', 'modified': '2023-10-07T08:46:51.441764+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6015}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6015': {'gid': 6015, 'name': 'c', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/2297722913', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 2297722913}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2297722913}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T08:46:54.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T08:46:54.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-07T08:46:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.181+0000 7f3581bee700 1 Processor -- start 2023-10-07T08:46:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.181+0000 7f3581bee700 1 -- start start 2023-10-07T08:46:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f3581bee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357c1578d0 0x7f357c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f3581bee700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f357c06d120 0x7f357c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f3581bee700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c06dac0 con 0x7f357c157ca0 2023-10-07T08:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f3581bee700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357c0d07c0 con 0x7f357c06d120 2023-10-07T08:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f3581bee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c0cfbb0 con 0x7f357c1578d0 2023-10-07T08:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357affd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f357c157ca0 0x7f357c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57112/0 (socket says 172.21.15.81:57112) 2023-10-07T08:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357affd700 1 -- 172.21.15.81:0/3475928786 learned_addr learned my addr 172.21.15.81:0/3475928786 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357bfff700 1 --2- 172.21.15.81:0/3475928786 >> v2:172.21.15.89:3300/0 conn(0x7f357c06d120 0x7f357c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357b7fe700 1 --2- 172.21.15.81:0/3475928786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357c1578d0 0x7f357c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357a7fc700 1 -- 172.21.15.81:0/3475928786 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373413639 0 0) 0x7f3570001110 con 0x7f357c157ca0 2023-10-07T08:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357a7fc700 1 -- 172.21.15.81:0/3475928786 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3564003570 con 0x7f357c157ca0 2023-10-07T08:46:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357a7fc700 1 -- 172.21.15.81:0/3475928786 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4112529865 0 0) 0x7f3564003570 con 0x7f357c157ca0 2023-10-07T08:46:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357a7fc700 1 -- 172.21.15.81:0/3475928786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357c1578d0 msgr2=0x7f357c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357a7fc700 1 --2- 172.21.15.81:0/3475928786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357c1578d0 0x7f357c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357a7fc700 1 -- 172.21.15.81:0/3475928786 >> v2:172.21.15.89:3300/0 conn(0x7f357c06d120 msgr2=0x7f357c06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357a7fc700 1 --2- 172.21.15.81:0/3475928786 >> v2:172.21.15.89:3300/0 conn(0x7f357c06d120 0x7f357c06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357a7fc700 1 -- 172.21.15.81:0/3475928786 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c0cfe90 con 0x7f357c157ca0 2023-10-07T08:46:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357a7fc700 1 -- 172.21.15.81:0/3475928786 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f3570001600 con 0x7f357c157ca0 2023-10-07T08:46:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357bfff700 1 --2- 172.21.15.81:0/3475928786 >> v2:172.21.15.89:3300/0 conn(0x7f357c06d120 0x7f357c06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:46:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357a7fc700 1 -- 172.21.15.81:0/3475928786 >> v1:172.21.15.81:6789/0 conn(0x7f357c157ca0 legacy=0x7f357c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357a7fc700 1 --2- 172.21.15.81:0/3475928786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3564003a60 0x7f3564003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357a7fc700 1 --2- 172.21.15.81:0/3475928786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357c1578d0 0x7f3564004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357a7fc700 1 --2- 172.21.15.81:0/3475928786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564004d50 0x7f35640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357a7fc700 1 -- 172.21.15.81:0/3475928786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c0d07c0 con 0x7f3564004d50 2023-10-07T08:46:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357a7fc700 1 -- 172.21.15.81:0/3475928786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c0cfbb0 con 0x7f3564003a60 2023-10-07T08:46:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.182+0000 7f357a7fc700 1 -- 172.21.15.81:0/3475928786 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356400ba60 con 0x7f357c1578d0 2023-10-07T08:46:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.183+0000 7f357bfff700 1 --2- 172.21.15.81:0/3475928786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564004d50 0x7f35640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.183+0000 7f357b7fe700 1 --2- 172.21.15.81:0/3475928786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3564003a60 0x7f3564003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.183+0000 7f357affd700 1 --2- 172.21.15.81:0/3475928786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357c1578d0 0x7f3564004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.183+0000 7f357bfff700 1 -- 172.21.15.81:0/3475928786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357c1578d0 msgr2=0x7f3564004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.183+0000 7f357bfff700 1 --2- 172.21.15.81:0/3475928786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357c1578d0 0x7f3564004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.183+0000 7f357bfff700 1 -- 172.21.15.81:0/3475928786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3564003a60 msgr2=0x7f3564003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.183+0000 7f357bfff700 1 --2- 172.21.15.81:0/3475928786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3564003a60 0x7f3564003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.183+0000 7f357bfff700 1 -- 172.21.15.81:0/3475928786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3564003570 con 0x7f3564004d50 2023-10-07T08:46:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.183+0000 7f357bfff700 1 --2- 172.21.15.81:0/3475928786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564004d50 0x7f35640051c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3574009df0 tx=0x7f35740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87aea30815ea8f08 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.183+0000 7f357a7fc700 1 -- 172.21.15.81:0/3475928786 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357400e8c0 con 0x7f3564004d50 2023-10-07T08:46:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.183+0000 7f357a7fc700 1 -- 172.21.15.81:0/3475928786 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357400ea20 con 0x7f3564004d50 2023-10-07T08:46:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.183+0000 7f357a7fc700 1 -- 172.21.15.81:0/3475928786 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357400edc0 con 0x7f3564004d50 2023-10-07T08:46:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.184+0000 7f3581bee700 1 -- 172.21.15.81:0/3475928786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564004d50 msgr2=0x7f35640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.184+0000 7f3581bee700 1 --2- 172.21.15.81:0/3475928786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564004d50 0x7f35640051c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3574009df0 tx=0x7f35740091a0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.184+0000 7f357bfff700 1 -- 172.21.15.81:0/3475928786 reap_dead start 2023-10-07T08:46:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.184+0000 7f3581bee700 1 -- 172.21.15.81:0/3475928786 shutdown_connections 2023-10-07T08:46:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.184+0000 7f3581bee700 1 -- 172.21.15.81:0/3475928786 >> 172.21.15.81:0/3475928786 conn(0x7f357c06bb90 msgr2=0x7f357c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.184+0000 7f3581bee700 1 -- 172.21.15.81:0/3475928786 shutdown_connections 2023-10-07T08:46:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.184+0000 7f3581bee700 1 -- 172.21.15.81:0/3475928786 wait complete. 2023-10-07T08:46:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.185+0000 7f3581bee700 1 Processor -- start 2023-10-07T08:46:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.185+0000 7f3581bee700 1 -- start start 2023-10-07T08:46:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f3581bee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f357c1476f0 0x7f357c0c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f3581bee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357c147ac0 0x7f357c069ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f3581bee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c06a420 0x7f357c16dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f3581bee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c06a8c0 con 0x7f357c06a420 2023-10-07T08:46:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f3581bee700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c0cc2e0 con 0x7f357c1476f0 2023-10-07T08:46:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f3581bee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c0cb9b0 con 0x7f357c147ac0 2023-10-07T08:46:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f357bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c06a420 0x7f357c16dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f357bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c06a420 0x7f357c16dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33194/0 (socket says 172.21.15.81:33194) 2023-10-07T08:46:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f357bfff700 1 -- 172.21.15.81:0/488935060 learned_addr learned my addr 172.21.15.81:0/488935060 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f357affd700 1 --2- 172.21.15.81:0/488935060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357c147ac0 0x7f357c069ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f357b7fe700 1 --2- 172.21.15.81:0/488935060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f357c1476f0 0x7f357c0c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f357bfff700 1 -- 172.21.15.81:0/488935060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357c147ac0 msgr2=0x7f357c069ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f357bfff700 1 --2- 172.21.15.81:0/488935060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357c147ac0 0x7f357c069ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f357bfff700 1 -- 172.21.15.81:0/488935060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f357c1476f0 msgr2=0x7f357c0c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f357bfff700 1 --2- 172.21.15.81:0/488935060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f357c1476f0 0x7f357c0c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f357bfff700 1 -- 172.21.15.81:0/488935060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c0cbc90 con 0x7f357c06a420 2023-10-07T08:46:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f357bfff700 1 --2- 172.21.15.81:0/488935060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c06a420 0x7f357c16dac0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3564004730 tx=0x7f357401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f35637fe700 1 -- 172.21.15.81:0/488935060 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3574022070 con 0x7f357c06a420 2023-10-07T08:46:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f35637fe700 1 -- 172.21.15.81:0/488935060 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3574009110 con 0x7f357c06a420 2023-10-07T08:46:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f3581bee700 1 -- 172.21.15.81:0/488935060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357c0cbf70 con 0x7f357c06a420 2023-10-07T08:46:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f35637fe700 1 -- 172.21.15.81:0/488935060 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357401c890 con 0x7f357c06a420 2023-10-07T08:46:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.186+0000 7f3581bee700 1 -- 172.21.15.81:0/488935060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c16e000 con 0x7f357c06a420 2023-10-07T08:46:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.188+0000 7f35637fe700 1 -- 172.21.15.81:0/488935060 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f357401cc80 con 0x7f357c06a420 2023-10-07T08:46:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.188+0000 7f35637fe700 1 --2- 172.21.15.81:0/488935060 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3568066f30 0x7f35680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.188+0000 7f35637fe700 1 -- 172.21.15.81:0/488935060 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3574085c90 con 0x7f357c06a420 2023-10-07T08:46:54.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.188+0000 7f357b7fe700 1 --2- 172.21.15.81:0/488935060 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3568066f30 0x7f35680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.189+0000 7f357b7fe700 1 --2- 172.21.15.81:0/488935060 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3568066f30 0x7f35680693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f356c0094d0 tx=0x7f356c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:54.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.190+0000 7f358aee6b80 1 Processor -- start 2023-10-07T08:46:54.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.190+0000 7f358aee6b80 1 -- start start 2023-10-07T08:46:54.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.191+0000 7f358aee6b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc6474a50 0x556dc6474e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.191+0000 7f358aee6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc64bed00 0x556dc649da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.191+0000 7f358aee6b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc649df60 0x556dc6470cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.191+0000 7f358aee6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dc63cba70 con 0x556dc64bed00 2023-10-07T08:46:54.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.191+0000 7f358aee6b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dc63c9270 con 0x556dc649df60 2023-10-07T08:46:54.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.191+0000 7f358aee6b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x556dc63c5060 con 0x556dc6474a50 2023-10-07T08:46:54.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.191+0000 7f357affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc64bed00 0x556dc649da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.191+0000 7f357affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc64bed00 0x556dc649da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33200/0 (socket says 172.21.15.81:33200) 2023-10-07T08:46:54.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.191+0000 7f357affd700 1 -- 172.21.15.81:0/539488215 learned_addr learned my addr 172.21.15.81:0/539488215 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:54.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.191+0000 7f357b7fe700 1 --2- 172.21.15.81:0/539488215 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc6474a50 0x556dc6474e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.191+0000 7f357bfff700 1 --2- 172.21.15.81:0/539488215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc649df60 0x556dc6470cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.191+0000 7f357affd700 1 -- 172.21.15.81:0/539488215 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc6474a50 msgr2=0x556dc6474e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:54.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.191+0000 7f357affd700 1 --2- 172.21.15.81:0/539488215 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc6474a50 0x556dc6474e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.191+0000 7f357affd700 1 -- 172.21.15.81:0/539488215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc649df60 msgr2=0x556dc6470cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:54.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.191+0000 7f357affd700 1 --2- 172.21.15.81:0/539488215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc649df60 0x556dc6470cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.192+0000 7f357affd700 1 -- 172.21.15.81:0/539488215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dc625f270 con 0x556dc64bed00 2023-10-07T08:46:54.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.192+0000 7f357affd700 1 --2- 172.21.15.81:0/539488215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc64bed00 0x556dc649da20 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3570007ee0 tx=0x7f357c0d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4149fe69c06284 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:54.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.192+0000 7f3560ff9700 1 -- 172.21.15.81:0/539488215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35700074d0 con 0x556dc64bed00 2023-10-07T08:46:54.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.192+0000 7f3560ff9700 1 -- 172.21.15.81:0/539488215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3570007630 con 0x556dc64bed00 2023-10-07T08:46:54.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.192+0000 7f3560ff9700 1 -- 172.21.15.81:0/539488215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570015670 con 0x556dc64bed00 2023-10-07T08:46:54.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.192+0000 7f358aee6b80 1 -- 172.21.15.81:0/539488215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc64bed00 msgr2=0x556dc649da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:54.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.192+0000 7f358aee6b80 1 --2- 172.21.15.81:0/539488215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc64bed00 0x556dc649da20 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3570007ee0 tx=0x7f357c0d0730 comp rx=0 tx=0).stop 2023-10-07T08:46:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.192+0000 7f358aee6b80 1 -- 172.21.15.81:0/539488215 shutdown_connections 2023-10-07T08:46:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.192+0000 7f358aee6b80 1 --2- 172.21.15.81:0/539488215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc649df60 0x556dc6470cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.192+0000 7f358aee6b80 1 --2- 172.21.15.81:0/539488215 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc6474a50 0x556dc6474e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.192+0000 7f358aee6b80 1 --2- 172.21.15.81:0/539488215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc64bed00 0x556dc649da20 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.193+0000 7f358aee6b80 1 -- 172.21.15.81:0/539488215 >> 172.21.15.81:0/539488215 conn(0x556dc6476370 msgr2=0x556dc6476740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.193+0000 7f358aee6b80 1 -- 172.21.15.81:0/539488215 shutdown_connections 2023-10-07T08:46:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.193+0000 7f358aee6b80 1 -- 172.21.15.81:0/539488215 wait complete. 2023-10-07T08:46:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.193+0000 7f358aee6b80 1 -- start start 2023-10-07T08:46:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.193+0000 7f358aee6b80 1 Processor -- start 2023-10-07T08:46:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f358aee6b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc6474a50 0x556dc64b6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f358aee6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc649df60 0x556dc64bdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f358aee6b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc64bed00 0x556dc64bbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f358aee6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dc6370890 con 0x556dc649df60 2023-10-07T08:46:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f358aee6b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dc638bea0 con 0x556dc64bed00 2023-10-07T08:46:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f358aee6b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x556dc6247e30 con 0x556dc6474a50 2023-10-07T08:46:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f358aee6b80 10 client.0 _ll_register_callbacks cb 0x556dc6438110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:46:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f357affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc649df60 0x556dc64bdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f357affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc649df60 0x556dc64bdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33204/0 (socket says 172.21.15.81:33204) 2023-10-07T08:46:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f357affd700 1 -- 172.21.15.81:0/3683042815 learned_addr learned my addr 172.21.15.81:0/3683042815 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f357b7fe700 1 --2- 172.21.15.81:0/3683042815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc6474a50 0x556dc64b6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f357bfff700 1 --2- 172.21.15.81:0/3683042815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc64bed00 0x556dc64bbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f357affd700 1 -- 172.21.15.81:0/3683042815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc6474a50 msgr2=0x556dc64b6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f357affd700 1 --2- 172.21.15.81:0/3683042815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc6474a50 0x556dc64b6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f357affd700 1 -- 172.21.15.81:0/3683042815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc64bed00 msgr2=0x556dc64bbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f357affd700 1 --2- 172.21.15.81:0/3683042815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc64bed00 0x556dc64bbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f357affd700 1 -- 172.21.15.81:0/3683042815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c0cfe90 con 0x556dc649df60 2023-10-07T08:46:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f357bfff700 1 --2- 172.21.15.81:0/3683042815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc64bed00 0x556dc64bbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f357affd700 1 --2- 172.21.15.81:0/3683042815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc649df60 0x556dc64bdb10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3570001dd0 tx=0x7f357000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a41c77080371f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.194+0000 7f3559ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:46:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f3559ffb700 1 -- 172.21.15.81:0/3683042815 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570001bc0 con 0x556dc649df60 2023-10-07T08:46:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f3559ffb700 1 -- 172.21.15.81:0/3683042815 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3570015bf0 con 0x556dc649df60 2023-10-07T08:46:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f358aee6b80 1 -- 172.21.15.81:0/3683042815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556dc6469b70 con 0x556dc649df60 2023-10-07T08:46:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f3559ffb700 1 -- 172.21.15.81:0/3683042815 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f357001e420 con 0x556dc649df60 2023-10-07T08:46:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f358aee6b80 10 client.6156 fetch_fsmap learned FSMap version 40 2023-10-07T08:46:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f358aee6b80 1 -- 172.21.15.81:0/3683042815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x556dc6201fe0 con 0x556dc649df60 2023-10-07T08:46:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f3559ffb700 1 -- 172.21.15.81:0/3683042815 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556dc6469b70 con 0x556dc649df60 2023-10-07T08:46:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f3559ffb700 1 -- 172.21.15.81:0/3683042815 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3570012050 con 0x556dc649df60 2023-10-07T08:46:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f358aee6b80 10 client.6156 fetch_fsmap finished waiting for FSMap version 40 2023-10-07T08:46:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f358aee6b80 10 client.6156 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-07T08:46:54.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f358aee6b80 20 client.6156 populate_metadata read hostname 'smithi081' 2023-10-07T08:46:54.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f358aee6b80 1 --2- 172.21.15.81:0/3683042815 >> [v2:172.21.15.81:6835/2297722913,v1:172.21.15.81:6837/2297722913] conn(0x556dc64b4e70 0x556dc64b5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f358aee6b80 4 client.6156 mds_command: new command op to 6015 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T08:46:54.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f358aee6b80 1 -- 172.21.15.81:0/3683042815 --> [v2:172.21.15.81:6835/2297722913,v1:172.21.15.81:6837/2297722913] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556dc6446aa0 con 0x556dc64b4e70 2023-10-07T08:46:54.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f357b7fe700 1 --2- 172.21.15.81:0/3683042815 >> [v2:172.21.15.81:6835/2297722913,v1:172.21.15.81:6837/2297722913] conn(0x556dc64b4e70 0x556dc64b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f3559ffb700 10 client.6156 ms_handle_connect on v2:172.21.15.81:6835/2297722913 2023-10-07T08:46:54.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.195+0000 7f357b7fe700 1 --2- 172.21.15.81:0/3683042815 >> [v2:172.21.15.81:6835/2297722913,v1:172.21.15.81:6837/2297722913] conn(0x556dc64b4e70 0x556dc64b5240 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b90f061d2e7ba80b server_cookie=6fcce7822bb42c80 in_seq=0 out_seq=0 2023-10-07T08:46:54.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.196+0000 7f3559ffb700 1 -- 172.21.15.81:0/3683042815 <== mds.0 v2:172.21.15.81:6835/2297722913 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x556dc6446aa0 con 0x556dc64b4e70 2023-10-07T08:46:54.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.196+0000 7f3559ffb700 10 client.6156 handle_command_reply: tid=0 2023-10-07T08:46:54.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.196+0000 7f358aee6b80 1 client.6156 shutdown 2023-10-07T08:46:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.196+0000 7f358aee6b80 1 -- 172.21.15.81:0/3683042815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc649df60 msgr2=0x556dc64bdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.196+0000 7f358aee6b80 1 --2- 172.21.15.81:0/3683042815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc649df60 0x556dc64bdb10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3570001dd0 tx=0x7f357000a000 comp rx=0 tx=0).stop 2023-10-07T08:46:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.196+0000 7f358aee6b80 1 -- 172.21.15.81:0/3683042815 shutdown_connections 2023-10-07T08:46:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.196+0000 7f358aee6b80 1 --2- 172.21.15.81:0/3683042815 >> [v2:172.21.15.81:6835/2297722913,v1:172.21.15.81:6837/2297722913] conn(0x556dc64b4e70 0x556dc64b5240 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.196+0000 7f358aee6b80 1 --2- 172.21.15.81:0/3683042815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc64bed00 0x556dc64bbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.196+0000 7f358aee6b80 1 --2- 172.21.15.81:0/3683042815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc6474a50 0x556dc64b6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.196+0000 7f358aee6b80 1 --2- 172.21.15.81:0/3683042815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc649df60 0x556dc64bdb10 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.196+0000 7f3559ffb700 0 client.6156 ms_handle_reset on v2:172.21.15.81:6835/2297722913 2023-10-07T08:46:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.196+0000 7f358aee6b80 1 -- 172.21.15.81:0/3683042815 >> 172.21.15.81:0/3683042815 conn(0x556dc6476370 msgr2=0x556dc6471850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:54.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.196+0000 7f358aee6b80 1 -- 172.21.15.81:0/3683042815 shutdown_connections 2023-10-07T08:46:54.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.196+0000 7f358aee6b80 1 -- 172.21.15.81:0/3683042815 wait complete. 2023-10-07T08:46:54.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.196+0000 7f358aee6b80 20 client.6156 trim_cache size 0 max 16384 2023-10-07T08:46:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.213+0000 7f358aee6b80 1 Processor -- start 2023-10-07T08:46:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.213+0000 7f358aee6b80 1 -- start start 2023-10-07T08:46:54.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.213+0000 7f358aee6b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc6474a50 0x556dc64b6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.213+0000 7f358aee6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc649df60 0x556dc6475100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.213+0000 7f358aee6b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc64bed00 0x556dc649cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.213+0000 7f358aee6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dc646f830 con 0x556dc649df60 2023-10-07T08:46:54.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.213+0000 7f358aee6b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dc646f5a0 con 0x556dc64bed00 2023-10-07T08:46:54.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.213+0000 7f358aee6b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x556dc649dce0 con 0x556dc6474a50 2023-10-07T08:46:54.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.213+0000 7f357affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc649df60 0x556dc6475100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.214+0000 7f357affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc649df60 0x556dc6475100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33208/0 (socket says 172.21.15.81:33208) 2023-10-07T08:46:54.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.214+0000 7f357affd700 1 -- 172.21.15.81:0/1330068040 learned_addr learned my addr 172.21.15.81:0/1330068040 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:54.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.214+0000 7f357b7fe700 1 --2- 172.21.15.81:0/1330068040 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc6474a50 0x556dc64b6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.214+0000 7f357affd700 1 -- 172.21.15.81:0/1330068040 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc6474a50 msgr2=0x556dc64b6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.214+0000 7f357affd700 1 --2- 172.21.15.81:0/1330068040 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc6474a50 0x556dc64b6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.214+0000 7f357bfff700 1 --2- 172.21.15.81:0/1330068040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc64bed00 0x556dc649cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.214+0000 7f357affd700 1 -- 172.21.15.81:0/1330068040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc64bed00 msgr2=0x556dc649cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.214+0000 7f357affd700 1 --2- 172.21.15.81:0/1330068040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc64bed00 0x556dc649cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.214+0000 7f357affd700 1 -- 172.21.15.81:0/1330068040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dc6393780 con 0x556dc649df60 2023-10-07T08:46:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.214+0000 7f357affd700 1 --2- 172.21.15.81:0/1330068040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc649df60 0x556dc6475100 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3570000ea0 tx=0x7f3570023040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c628839b0311b78e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.214+0000 7f35617fa700 1 -- 172.21.15.81:0/1330068040 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570015bf0 con 0x556dc649df60 2023-10-07T08:46:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.214+0000 7f35617fa700 1 -- 172.21.15.81:0/1330068040 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357001ea30 con 0x556dc649df60 2023-10-07T08:46:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.214+0000 7f35617fa700 1 -- 172.21.15.81:0/1330068040 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357001e420 con 0x556dc649df60 2023-10-07T08:46:54.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.214+0000 7f358aee6b80 1 -- 172.21.15.81:0/1330068040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc649df60 msgr2=0x556dc6475100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.214+0000 7f358aee6b80 1 --2- 172.21.15.81:0/1330068040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc649df60 0x556dc6475100 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3570000ea0 tx=0x7f3570023040 comp rx=0 tx=0).stop 2023-10-07T08:46:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.215+0000 7f358aee6b80 1 -- 172.21.15.81:0/1330068040 shutdown_connections 2023-10-07T08:46:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.215+0000 7f358aee6b80 1 --2- 172.21.15.81:0/1330068040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc64bed00 0x556dc649cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.215+0000 7f358aee6b80 1 --2- 172.21.15.81:0/1330068040 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc6474a50 0x556dc64b6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.215+0000 7f358aee6b80 1 --2- 172.21.15.81:0/1330068040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc649df60 0x556dc6475100 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.215+0000 7f358aee6b80 1 -- 172.21.15.81:0/1330068040 >> 172.21.15.81:0/1330068040 conn(0x556dc6476370 msgr2=0x556dc6476740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.215+0000 7f358aee6b80 1 -- 172.21.15.81:0/1330068040 shutdown_connections 2023-10-07T08:46:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.215+0000 7f358aee6b80 1 -- 172.21.15.81:0/1330068040 wait complete. 2023-10-07T08:46:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.215+0000 7f358aee6b80 1 -- start start 2023-10-07T08:46:54.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.215+0000 7f358aee6b80 1 Processor -- start 2023-10-07T08:46:54.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f358aee6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc6474a50 0x556dc65206c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f358aee6b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc649df60 0x556dc64a4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f358aee6b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc64bed00 0x556dc64a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f358aee6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dc6499790 con 0x556dc6474a50 2023-10-07T08:46:54.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f358aee6b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dc64ba760 con 0x556dc649df60 2023-10-07T08:46:54.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f358aee6b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x556dc64d3850 con 0x556dc64bed00 2023-10-07T08:46:54.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f358aee6b80 10 client.0 _ll_register_callbacks cb 0x556dc6438110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:46:54.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f357b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc6474a50 0x556dc65206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f357b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc6474a50 0x556dc65206c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33222/0 (socket says 172.21.15.81:33222) 2023-10-07T08:46:54.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f357b7fe700 1 -- 172.21.15.81:0/702316987 learned_addr learned my addr 172.21.15.81:0/702316987 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:54.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f357affd700 1 --2- 172.21.15.81:0/702316987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc649df60 0x556dc64a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f357bfff700 1 --2- 172.21.15.81:0/702316987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc64bed00 0x556dc64a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f357b7fe700 1 -- 172.21.15.81:0/702316987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc64bed00 msgr2=0x556dc64a48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:54.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f357b7fe700 1 --2- 172.21.15.81:0/702316987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc64bed00 0x556dc64a48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f357b7fe700 1 -- 172.21.15.81:0/702316987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc649df60 msgr2=0x556dc64a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:54.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f357b7fe700 1 --2- 172.21.15.81:0/702316987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc649df60 0x556dc64a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f357b7fe700 1 -- 172.21.15.81:0/702316987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556dc6201fe0 con 0x556dc6474a50 2023-10-07T08:46:54.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f357b7fe700 1 --2- 172.21.15.81:0/702316987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc6474a50 0x556dc65206c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x556dc64b5ac0 tx=0x7f356c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d643837ffbd1ef45 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:54.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.216+0000 7f3559ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:46:54.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f3559ffb700 1 -- 172.21.15.81:0/702316987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c029040 con 0x556dc6474a50 2023-10-07T08:46:54.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f3559ffb700 1 -- 172.21.15.81:0/702316987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f356c039b30 con 0x556dc6474a50 2023-10-07T08:46:54.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f358aee6b80 1 -- 172.21.15.81:0/702316987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3570007630 con 0x556dc6474a50 2023-10-07T08:46:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f3559ffb700 1 -- 172.21.15.81:0/702316987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f356c00e040 con 0x556dc6474a50 2023-10-07T08:46:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f358aee6b80 10 client.6162 fetch_fsmap learned FSMap version 40 2023-10-07T08:46:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f358aee6b80 1 -- 172.21.15.81:0/702316987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x556dc637a470 con 0x556dc6474a50 2023-10-07T08:46:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f3559ffb700 1 -- 172.21.15.81:0/702316987 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3570007630 con 0x556dc6474a50 2023-10-07T08:46:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f3559ffb700 1 -- 172.21.15.81:0/702316987 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f356c02f7a0 con 0x556dc6474a50 2023-10-07T08:46:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f358aee6b80 10 client.6162 fetch_fsmap finished waiting for FSMap version 40 2023-10-07T08:46:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f358aee6b80 10 client.6162 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-07T08:46:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f358aee6b80 20 client.6162 populate_metadata read hostname 'smithi081' 2023-10-07T08:46:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f358aee6b80 1 --2- 172.21.15.81:0/702316987 >> [v2:172.21.15.81:6835/2297722913,v1:172.21.15.81:6837/2297722913] conn(0x556dc64b39c0 0x556dc64b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f358aee6b80 4 client.6162 mds_command: new command op to 6015 tid=0[{"prefix": "status"}] 2023-10-07T08:46:54.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f358aee6b80 1 -- 172.21.15.81:0/702316987 --> [v2:172.21.15.81:6835/2297722913,v1:172.21.15.81:6837/2297722913] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556dc6367e00 con 0x556dc64b39c0 2023-10-07T08:46:54.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f357affd700 1 --2- 172.21.15.81:0/702316987 >> [v2:172.21.15.81:6835/2297722913,v1:172.21.15.81:6837/2297722913] conn(0x556dc64b39c0 0x556dc64b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f3559ffb700 10 client.6162 ms_handle_connect on v2:172.21.15.81:6835/2297722913 2023-10-07T08:46:54.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.217+0000 7f357affd700 1 --2- 172.21.15.81:0/702316987 >> [v2:172.21.15.81:6835/2297722913,v1:172.21.15.81:6837/2297722913] conn(0x556dc64b39c0 0x556dc64b3d90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0e08e5d49c66646 server_cookie=346ee0dee51fd68b in_seq=0 out_seq=0 2023-10-07T08:46:54.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f3559ffb700 1 -- 172.21.15.81:0/702316987 <== mds.0 v2:172.21.15.81:6835/2297722913 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x556dc6367e00 con 0x556dc64b39c0 2023-10-07T08:46:54.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f3559ffb700 10 client.6162 handle_command_reply: tid=0 2023-10-07T08:46:54.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f358aee6b80 1 client.6162 shutdown 2023-10-07T08:46:54.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f358aee6b80 1 -- 172.21.15.81:0/702316987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc6474a50 msgr2=0x556dc65206c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:54.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f358aee6b80 1 --2- 172.21.15.81:0/702316987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc6474a50 0x556dc65206c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x556dc64b5ac0 tx=0x7f356c018000 comp rx=0 tx=0).stop 2023-10-07T08:46:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f358aee6b80 1 -- 172.21.15.81:0/702316987 shutdown_connections 2023-10-07T08:46:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f358aee6b80 1 --2- 172.21.15.81:0/702316987 >> [v2:172.21.15.81:6835/2297722913,v1:172.21.15.81:6837/2297722913] conn(0x556dc64b39c0 0x556dc64b3d90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f358aee6b80 1 --2- 172.21.15.81:0/702316987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x556dc64bed00 0x556dc64a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f3559ffb700 0 client.6162 ms_handle_reset on v2:172.21.15.81:6835/2297722913 2023-10-07T08:46:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f358aee6b80 1 --2- 172.21.15.81:0/702316987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dc6474a50 0x556dc65206c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f358aee6b80 1 --2- 172.21.15.81:0/702316987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556dc649df60 0x556dc64a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f358aee6b80 1 -- 172.21.15.81:0/702316987 >> 172.21.15.81:0/702316987 conn(0x556dc6476370 msgr2=0x556dc6472a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f358aee6b80 1 -- 172.21.15.81:0/702316987 shutdown_connections 2023-10-07T08:46:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f358aee6b80 1 -- 172.21.15.81:0/702316987 wait complete. 2023-10-07T08:46:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f358aee6b80 20 client.6162 trim_cache size 0 max 16384 2023-10-07T08:46:54.228 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:46:54.228 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:46:54.228 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-07T08:46:54.228 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6015, 2023-10-07T08:46:54.228 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-07T08:46:54.228 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-07T08:46:54.229 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-07T08:46:54.229 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.8019296569999996, 2023-10-07T08:46:54.229 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 40, 2023-10-07T08:46:54.229 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 85, 2023-10-07T08:46:54.229 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 85, 2023-10-07T08:46:54.229 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 11.783076604 2023-10-07T08:46:54.229 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:46:54.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f3581bee700 1 -- 172.21.15.81:0/488935060 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3568066f30 msgr2=0x7f35680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:54.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f3581bee700 1 --2- 172.21.15.81:0/488935060 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3568066f30 0x7f35680693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f356c0094d0 tx=0x7f356c00b040 comp rx=0 tx=0).stop 2023-10-07T08:46:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f3581bee700 1 -- 172.21.15.81:0/488935060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c06a420 msgr2=0x7f357c16dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f3581bee700 1 --2- 172.21.15.81:0/488935060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c06a420 0x7f357c16dac0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3564004730 tx=0x7f357401a000 comp rx=0 tx=0).stop 2023-10-07T08:46:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f3581bee700 1 -- 172.21.15.81:0/488935060 shutdown_connections 2023-10-07T08:46:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f3581bee700 1 --2- 172.21.15.81:0/488935060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c06a420 0x7f357c16dac0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f3581bee700 1 --2- 172.21.15.81:0/488935060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f357c1476f0 0x7f357c0c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f3581bee700 1 --2- 172.21.15.81:0/488935060 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3568066f30 0x7f35680693e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f3581bee700 1 --2- 172.21.15.81:0/488935060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f357c147ac0 0x7f357c069ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f3581bee700 1 -- 172.21.15.81:0/488935060 >> 172.21.15.81:0/488935060 conn(0x7f357c06bb90 msgr2=0x7f357c1559e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f3581bee700 1 -- 172.21.15.81:0/488935060 shutdown_connections 2023-10-07T08:46:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.218+0000 7f3581bee700 1 -- 172.21.15.81:0/488935060 wait complete. 2023-10-07T08:46:54.232 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:46:54.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.345+0000 7fd6c500b700 1 Processor -- start 2023-10-07T08:46:54.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.345+0000 7fd6c500b700 1 -- start start 2023-10-07T08:46:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.346+0000 7fd6c500b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6c0159b40 0x7fd6c00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.346+0000 7fd6c500b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd6c0159f10 0x7fd6c0068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.346+0000 7fd6c500b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6c00ccb40 0x7fd6c0068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.346+0000 7fd6c500b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c00cee10 con 0x7fd6c0159b40 2023-10-07T08:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.346+0000 7fd6c500b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c00cd040 con 0x7fd6c0159f10 2023-10-07T08:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.346+0000 7fd6c500b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c00cd320 con 0x7fd6c00ccb40 2023-10-07T08:46:54.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.346+0000 7fd6bffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6c0159b40 0x7fd6c00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.346+0000 7fd6bffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6c0159b40 0x7fd6c00cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33230/0 (socket says 172.21.15.81:33230) 2023-10-07T08:46:54.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.346+0000 7fd6bffff700 1 -- 172.21.15.81:0/3069483392 learned_addr learned my addr 172.21.15.81:0/3069483392 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:54.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.346+0000 7fd6c480a700 1 --2- 172.21.15.81:0/3069483392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6c00ccb40 0x7fd6c0068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.346+0000 7fd6bf7fe700 1 --2- 172.21.15.81:0/3069483392 >> v2:172.21.15.89:3300/0 conn(0x7fd6c0159f10 0x7fd6c0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.346+0000 7fd6bffff700 1 -- 172.21.15.81:0/3069483392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6c00ccb40 msgr2=0x7fd6c0068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:54.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.346+0000 7fd6bffff700 1 --2- 172.21.15.81:0/3069483392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6c00ccb40 0x7fd6c0068cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.346+0000 7fd6bffff700 1 -- 172.21.15.81:0/3069483392 >> v2:172.21.15.89:3300/0 conn(0x7fd6c0159f10 msgr2=0x7fd6c0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:54.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.346+0000 7fd6bffff700 1 --2- 172.21.15.81:0/3069483392 >> v2:172.21.15.89:3300/0 conn(0x7fd6c0159f10 0x7fd6c0068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.346+0000 7fd6bffff700 1 -- 172.21.15.81:0/3069483392 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c00ce7c0 con 0x7fd6c0159b40 2023-10-07T08:46:54.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.347+0000 7fd6bffff700 1 --2- 172.21.15.81:0/3069483392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6c0159b40 0x7fd6c00cc600 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd6c006fd80 tx=0x7fd6b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4f1ee175adb7fe server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:54.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.347+0000 7fd6beffd700 1 -- 172.21.15.81:0/3069483392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b000b860 con 0x7fd6c0159b40 2023-10-07T08:46:54.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.347+0000 7fd6beffd700 1 -- 172.21.15.81:0/3069483392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b000b9c0 con 0x7fd6c0159b40 2023-10-07T08:46:54.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.347+0000 7fd6beffd700 1 -- 172.21.15.81:0/3069483392 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b000bd60 con 0x7fd6c0159b40 2023-10-07T08:46:54.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.347+0000 7fd6c500b700 1 -- 172.21.15.81:0/3069483392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6c0159b40 msgr2=0x7fd6c00cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:54.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.347+0000 7fd6c500b700 1 --2- 172.21.15.81:0/3069483392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6c0159b40 0x7fd6c00cc600 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd6c006fd80 tx=0x7fd6b0009250 comp rx=0 tx=0).stop 2023-10-07T08:46:54.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.347+0000 7fd6c500b700 1 -- 172.21.15.81:0/3069483392 shutdown_connections 2023-10-07T08:46:54.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.347+0000 7fd6c500b700 1 --2- 172.21.15.81:0/3069483392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6c00ccb40 0x7fd6c0068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.347+0000 7fd6c500b700 1 --2- 172.21.15.81:0/3069483392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6c0159b40 0x7fd6c00cc600 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.347+0000 7fd6c500b700 1 --2- 172.21.15.81:0/3069483392 >> v2:172.21.15.89:3300/0 conn(0x7fd6c0159f10 0x7fd6c0068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.347+0000 7fd6c500b700 1 -- 172.21.15.81:0/3069483392 >> 172.21.15.81:0/3069483392 conn(0x7fd6c00cd660 msgr2=0x7fd6c00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:54.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.347+0000 7fd6c500b700 1 -- 172.21.15.81:0/3069483392 shutdown_connections 2023-10-07T08:46:54.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.347+0000 7fd6c500b700 1 -- 172.21.15.81:0/3069483392 wait complete. 2023-10-07T08:46:54.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.348+0000 7fd6c500b700 1 Processor -- start 2023-10-07T08:46:54.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.348+0000 7fd6c500b700 1 -- start start 2023-10-07T08:46:54.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.349+0000 7fd6c500b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6c00ccb40 0x7fd6c01542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.349+0000 7fd6c500b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6c0159b40 0x7fd6c006edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.349+0000 7fd6c500b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6c0159f10 0x7fd6c006f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.349+0000 7fd6c500b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c016aef0 con 0x7fd6c00ccb40 2023-10-07T08:46:54.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.349+0000 7fd6c500b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c016a5c0 con 0x7fd6c0159b40 2023-10-07T08:46:54.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.349+0000 7fd6c500b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c016a8a0 con 0x7fd6c0159f10 2023-10-07T08:46:54.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.349+0000 7fd6bffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6c00ccb40 0x7fd6c01542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.349+0000 7fd6bffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6c00ccb40 0x7fd6c01542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33240/0 (socket says 172.21.15.81:33240) 2023-10-07T08:46:54.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.349+0000 7fd6bffff700 1 -- 172.21.15.81:0/1730848137 learned_addr learned my addr 172.21.15.81:0/1730848137 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:54.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.350+0000 7fd6c480a700 1 --2- 172.21.15.81:0/1730848137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6c0159f10 0x7fd6c006f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.350+0000 7fd6bf7fe700 1 --2- 172.21.15.81:0/1730848137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6c0159b40 0x7fd6c006edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.350+0000 7fd6bffff700 1 -- 172.21.15.81:0/1730848137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6c0159f10 msgr2=0x7fd6c006f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:54.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.350+0000 7fd6bffff700 1 --2- 172.21.15.81:0/1730848137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6c0159f10 0x7fd6c006f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.350+0000 7fd6bffff700 1 -- 172.21.15.81:0/1730848137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6c0159b40 msgr2=0x7fd6c006edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:54.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.350+0000 7fd6bffff700 1 --2- 172.21.15.81:0/1730848137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6c0159b40 0x7fd6c006edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.350+0000 7fd6bffff700 1 -- 172.21.15.81:0/1730848137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b00094f0 con 0x7fd6c00ccb40 2023-10-07T08:46:54.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.350+0000 7fd6c480a700 1 --2- 172.21.15.81:0/1730848137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6c0159f10 0x7fd6c006f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:46:54.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.350+0000 7fd6bf7fe700 1 --2- 172.21.15.81:0/1730848137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6c0159b40 0x7fd6c006edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:46:54.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.350+0000 7fd6bffff700 1 --2- 172.21.15.81:0/1730848137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6c00ccb40 0x7fd6c01542f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd6c006fe10 tx=0x7fd6b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:54.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.350+0000 7fd6a7fff700 1 -- 172.21.15.81:0/1730848137 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0024440 con 0x7fd6c00ccb40 2023-10-07T08:46:54.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.350+0000 7fd6a7fff700 1 -- 172.21.15.81:0/1730848137 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b00245a0 con 0x7fd6c00ccb40 2023-10-07T08:46:54.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.350+0000 7fd6c500b700 1 -- 172.21.15.81:0/1730848137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c016ab80 con 0x7fd6c00ccb40 2023-10-07T08:46:54.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.350+0000 7fd6a7fff700 1 -- 172.21.15.81:0/1730848137 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0024960 con 0x7fd6c00ccb40 2023-10-07T08:46:54.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.350+0000 7fd6c500b700 1 -- 172.21.15.81:0/1730848137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c0154830 con 0x7fd6c00ccb40 2023-10-07T08:46:54.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.351+0000 7fd6c500b700 1 -- 172.21.15.81:0/1730848137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c00cb890 con 0x7fd6c00ccb40 2023-10-07T08:46:54.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.351+0000 7fd6a7fff700 1 -- 172.21.15.81:0/1730848137 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6b001a420 con 0x7fd6c00ccb40 2023-10-07T08:46:54.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.351+0000 7fd6a7fff700 1 --2- 172.21.15.81:0/1730848137 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd6ac066f30 0x7fd6ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:54.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.352+0000 7fd6a7fff700 1 -- 172.21.15.81:0/1730848137 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6b0086440 con 0x7fd6c00ccb40 2023-10-07T08:46:54.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.352+0000 7fd6bf7fe700 1 --2- 172.21.15.81:0/1730848137 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd6ac066f30 0x7fd6ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:54.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.352+0000 7fd6bf7fe700 1 --2- 172.21.15.81:0/1730848137 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd6ac066f30 0x7fd6ac0693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd6c00b2c90 tx=0x7fd6b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:54.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.356+0000 7fd6a7fff700 1 -- 172.21.15.81:0/1730848137 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6b00536b0 con 0x7fd6c00ccb40 2023-10-07T08:46:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.587+0000 7fd6c500b700 1 -- 172.21.15.81:0/1730848137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd6c00ceaa0 con 0x7fd6c00ccb40 2023-10-07T08:46:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.587+0000 7fd6a7fff700 1 -- 172.21.15.81:0/1730848137 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd6b0056cd0 con 0x7fd6c00ccb40 2023-10-07T08:46:54.588 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:46:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.590+0000 7fd6c500b700 1 -- 172.21.15.81:0/1730848137 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd6ac066f30 msgr2=0x7fd6ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.590+0000 7fd6c500b700 1 --2- 172.21.15.81:0/1730848137 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd6ac066f30 0x7fd6ac0693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd6c00b2c90 tx=0x7fd6b4008040 comp rx=0 tx=0).stop 2023-10-07T08:46:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.590+0000 7fd6c500b700 1 -- 172.21.15.81:0/1730848137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6c00ccb40 msgr2=0x7fd6c01542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.590+0000 7fd6c500b700 1 --2- 172.21.15.81:0/1730848137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6c00ccb40 0x7fd6c01542f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd6c006fe10 tx=0x7fd6b0017000 comp rx=0 tx=0).stop 2023-10-07T08:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.590+0000 7fd6c500b700 1 -- 172.21.15.81:0/1730848137 shutdown_connections 2023-10-07T08:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.590+0000 7fd6c500b700 1 --2- 172.21.15.81:0/1730848137 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd6ac066f30 0x7fd6ac0693e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.590+0000 7fd6c500b700 1 --2- 172.21.15.81:0/1730848137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6c0159f10 0x7fd6c006f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.590+0000 7fd6c500b700 1 --2- 172.21.15.81:0/1730848137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6c00ccb40 0x7fd6c01542f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.590+0000 7fd6c500b700 1 --2- 172.21.15.81:0/1730848137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6c0159b40 0x7fd6c006edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.590+0000 7fd6c500b700 1 -- 172.21.15.81:0/1730848137 >> 172.21.15.81:0/1730848137 conn(0x7fd6c00cd660 msgr2=0x7fd6c00b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.590+0000 7fd6c500b700 1 -- 172.21.15.81:0/1730848137 shutdown_connections 2023-10-07T08:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:54.590+0000 7fd6c500b700 1 -- 172.21.15.81:0/1730848137 wait complete. 2023-10-07T08:46:54.602 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:46:54.602 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:46:54.602 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-07T08:46:54.602 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T08:46:54.602 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T08:46:54.602 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:46:54.602 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:46:54.602 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:46:54.602 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:46:54.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:46:54.603 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-07T08:46:54.618 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:46:54.618 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:46:54.618 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:46:54.618 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:46:54.618 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-07T08:46:54.618 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:46:54.618 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:46:54.619 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:46:54.619 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-07T08:46:54.619 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:46:54.619 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:46:54.619 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-07T08:46:54.619 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:46:54.619 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:46:54.620 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:46:54.620 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:46:54.620 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:46:54.620 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42314sec preferred_lft 42314sec 2023-10-07T08:46:54.620 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-10-07T08:46:54.620 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:46:54.621 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:46:54.621 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff 2023-10-07T08:46:54.621 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:46:54.621 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:46:54.621 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::8c72:9ff:fe74:8c7e/64 scope link 2023-10-07T08:46:54.621 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:46:54.621 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:46:54.621 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:fe:81:9d:9c:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T08:46:54.621 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8fe:81ff:fe9d:9c0a/64 scope link 2023-10-07T08:46:54.622 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:46:54.622 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:46:54.622 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T08:46:54.622 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d838:b7ff:fe6e:914d/64 scope link 2023-10-07T08:46:54.622 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:46:54.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:46:54.622 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:46:54.681 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-07T08:46:54.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:46:54.682 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-07T08:46:54.738 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-07T08:46:54.738 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:46:54.738 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:46:54.738 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:46:54.739 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:46:54.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:46:54.739 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:46:54.739 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:46:54.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:46:54.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:46:54.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:46:54.740 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:46:54.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:46:54.838 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-07T08:46:54.852 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T08:46:54.852 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T08:46:54.853 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:46:54.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:46:54.853 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-07T08:46:54.918 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:46:54.918 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T08:46:54.973 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:46:54.973 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:46:54.973 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:46:55.027 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:46:55.027 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:46:55.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:46:55.106 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:46:55.106 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:46:55.107 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:46:55.115 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:46:55.115 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:46:55.115 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:46:55.115 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:46:55.115 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:46:55.136 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:46:55.137 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:46:55.137 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:46:55.137 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:46:55.137 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:46:55.137 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:46:55.138 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:46:55.138 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:46:55.139 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:46:55.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:46:55.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:46:55.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:46:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.357+0000 7fadfc8db700 1 Processor -- start 2023-10-07T08:46:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.357+0000 7fadfc8db700 1 -- start start 2023-10-07T08:46:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.358+0000 7fadfc8db700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fadf806d830 0x7fadf80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.358+0000 7fadfc8db700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf80d07c0 con 0x7fadf8157ca0 2023-10-07T08:46:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.358+0000 7fadfc8db700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf80cfbb0 con 0x7fadf81578d0 2023-10-07T08:46:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.358+0000 7fadfc8db700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf80cfe90 con 0x7fadf806d830 2023-10-07T08:46:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.358+0000 7fadf6d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fadf806d830 0x7fadf80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.358+0000 7fadedd9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fadf8157ca0 0x7fadf806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57128/0 (socket says 172.21.15.81:57128) 2023-10-07T08:46:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.358+0000 7fadedd9b700 1 -- 172.21.15.81:0/1999357364 learned_addr learned my addr 172.21.15.81:0/1999357364 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:46:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.358+0000 7fadf6d9d700 1 -- 172.21.15.81:0/1999357364 >> v1:172.21.15.89:6789/0 conn(0x7fadf81578d0 legacy=0x7fadf815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.358+0000 7fadf6d9d700 1 -- 172.21.15.81:0/1999357364 >> v1:172.21.15.81:6789/0 conn(0x7fadf8157ca0 legacy=0x7fadf806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.359+0000 7fadf6d9d700 1 -- 172.21.15.81:0/1999357364 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf80d0170 con 0x7fadf806d830 2023-10-07T08:46:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.359+0000 7fadf5d9b700 1 -- 172.21.15.81:0/1999357364 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702607406 0 0) 0x7fadf80d07c0 con 0x7fadf8157ca0 2023-10-07T08:46:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.359+0000 7fadf6d9d700 1 --2- 172.21.15.81:0/1999357364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf806d830 0x7fadf80cf4f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009e60 tx=0x7fadf0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bdedba4790f07d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.359+0000 7fadf5d9b700 1 -- 172.21.15.81:0/1999357364 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf000e070 con 0x7fadf806d830 2023-10-07T08:46:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.359+0000 7fadf5d9b700 1 -- 172.21.15.81:0/1999357364 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf000bc30 con 0x7fadf806d830 2023-10-07T08:46:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.359+0000 7fadf5d9b700 1 -- 172.21.15.81:0/1999357364 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0012430 con 0x7fadf806d830 2023-10-07T08:46:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.359+0000 7fadfc8db700 1 -- 172.21.15.81:0/1999357364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf806d830 msgr2=0x7fadf80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.359+0000 7fadfc8db700 1 --2- 172.21.15.81:0/1999357364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf806d830 0x7fadf80cf4f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009e60 tx=0x7fadf0009780 comp rx=0 tx=0).stop 2023-10-07T08:46:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.359+0000 7fadfc8db700 1 -- 172.21.15.81:0/1999357364 shutdown_connections 2023-10-07T08:46:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.359+0000 7fadfc8db700 1 --2- 172.21.15.81:0/1999357364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf806d830 0x7fadf80cf4f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:55.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.359+0000 7fadfc8db700 1 -- 172.21.15.81:0/1999357364 >> 172.21.15.81:0/1999357364 conn(0x7fadf806bb90 msgr2=0x7fadf806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:55.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.359+0000 7fadfc8db700 1 -- 172.21.15.81:0/1999357364 shutdown_connections 2023-10-07T08:46:55.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.359+0000 7fadfc8db700 1 -- 172.21.15.81:0/1999357364 wait complete. 2023-10-07T08:46:55.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.361+0000 7fadfc8db700 1 Processor -- start 2023-10-07T08:46:55.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.361+0000 7fadfc8db700 1 -- start start 2023-10-07T08:46:55.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.361+0000 7fadfc8db700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf806d830 0x7fadf80cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:55.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.361+0000 7fadfc8db700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf81578d0 0x7fadf80ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:55.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.361+0000 7fadfc8db700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf8157ca0 0x7fadf8069050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:55.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.361+0000 7fadfc8db700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf80af640 con 0x7fadf8157ca0 2023-10-07T08:46:55.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.361+0000 7fadfc8db700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf80cd710 con 0x7fadf81578d0 2023-10-07T08:46:55.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.361+0000 7fadfc8db700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf80b1850 con 0x7fadf806d830 2023-10-07T08:46:55.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.361+0000 7fadf6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf8157ca0 0x7fadf8069050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:55.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.361+0000 7fadf6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf8157ca0 0x7fadf8069050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33260/0 (socket says 172.21.15.81:33260) 2023-10-07T08:46:55.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.361+0000 7fadf6d9d700 1 -- 172.21.15.81:0/1925377551 learned_addr learned my addr 172.21.15.81:0/1925377551 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:55.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.362+0000 7fadedd9b700 1 --2- 172.21.15.81:0/1925377551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf81578d0 0x7fadf80ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:55.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.362+0000 7fadf6d9d700 1 -- 172.21.15.81:0/1925377551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf806d830 msgr2=0x7fadf80cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:55.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.362+0000 7fadf659c700 1 --2- 172.21.15.81:0/1925377551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf806d830 0x7fadf80cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:55.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.362+0000 7fadf6d9d700 1 --2- 172.21.15.81:0/1925377551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf806d830 0x7fadf80cd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:55.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.362+0000 7fadf6d9d700 1 -- 172.21.15.81:0/1925377551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf81578d0 msgr2=0x7fadf80ac210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:55.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.362+0000 7fadf6d9d700 1 --2- 172.21.15.81:0/1925377551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf81578d0 0x7fadf80ac210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:55.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.362+0000 7fadf6d9d700 1 -- 172.21.15.81:0/1925377551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf0009a20 con 0x7fadf8157ca0 2023-10-07T08:46:55.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.362+0000 7fadedd9b700 1 --2- 172.21.15.81:0/1925377551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf81578d0 0x7fadf80ac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:46:55.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.362+0000 7fadf6d9d700 1 --2- 172.21.15.81:0/1925377551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf8157ca0 0x7fadf8069050 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fadf806fe20 tx=0x7fadf0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:55.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.362+0000 7fadeeffd700 1 -- 172.21.15.81:0/1925377551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf001b630 con 0x7fadf8157ca0 2023-10-07T08:46:55.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.362+0000 7fadeeffd700 1 -- 172.21.15.81:0/1925377551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf001b790 con 0x7fadf8157ca0 2023-10-07T08:46:55.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.362+0000 7fadfc8db700 1 -- 172.21.15.81:0/1925377551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf80b1b30 con 0x7fadf8157ca0 2023-10-07T08:46:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.362+0000 7fadeeffd700 1 -- 172.21.15.81:0/1925377551 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf001bb50 con 0x7fadf8157ca0 2023-10-07T08:46:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.362+0000 7fadfc8db700 1 -- 172.21.15.81:0/1925377551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf80b20f0 con 0x7fadf8157ca0 2023-10-07T08:46:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.363+0000 7fadfc8db700 1 -- 172.21.15.81:0/1925377551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf8067ac0 con 0x7fadf8157ca0 2023-10-07T08:46:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.363+0000 7fadeeffd700 1 -- 172.21.15.81:0/1925377551 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fadf001c400 con 0x7fadf8157ca0 2023-10-07T08:46:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.364+0000 7fadeeffd700 1 --2- 172.21.15.81:0/1925377551 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fadd8066f30 0x7fadd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.364+0000 7fadeeffd700 1 -- 172.21.15.81:0/1925377551 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fadf0086560 con 0x7fadf8157ca0 2023-10-07T08:46:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.364+0000 7fadf659c700 1 --2- 172.21.15.81:0/1925377551 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fadd8066f30 0x7fadd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.364+0000 7fadf659c700 1 --2- 172.21.15.81:0/1925377551 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fadd8066f30 0x7fadd80693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fade80017a0 tx=0x7fade8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.368+0000 7fadeeffd700 1 -- 172.21.15.81:0/1925377551 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadf00537d0 con 0x7fadf8157ca0 2023-10-07T08:46:55.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:46:55.401 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:46:55.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.604+0000 7fadfc8db700 1 -- 172.21.15.81:0/1925377551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fadf80d0450 con 0x7fadf8157ca0 2023-10-07T08:46:55.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.605+0000 7fadeeffd700 1 -- 172.21.15.81:0/1925377551 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7fadf0056df0 con 0x7fadf8157ca0 2023-10-07T08:46:55.605 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:46:55.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.607+0000 7fadfc8db700 1 -- 172.21.15.81:0/1925377551 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fadd8066f30 msgr2=0x7fadd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:55.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.607+0000 7fadfc8db700 1 --2- 172.21.15.81:0/1925377551 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fadd8066f30 0x7fadd80693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fade80017a0 tx=0x7fade8009040 comp rx=0 tx=0).stop 2023-10-07T08:46:55.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.607+0000 7fadfc8db700 1 -- 172.21.15.81:0/1925377551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf8157ca0 msgr2=0x7fadf8069050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:55.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.607+0000 7fadfc8db700 1 --2- 172.21.15.81:0/1925377551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf8157ca0 0x7fadf8069050 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fadf806fe20 tx=0x7fadf0019000 comp rx=0 tx=0).stop 2023-10-07T08:46:55.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.607+0000 7fadfc8db700 1 -- 172.21.15.81:0/1925377551 shutdown_connections 2023-10-07T08:46:55.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.607+0000 7fadfc8db700 1 --2- 172.21.15.81:0/1925377551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf8157ca0 0x7fadf8069050 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:55.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.607+0000 7fadfc8db700 1 --2- 172.21.15.81:0/1925377551 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fadd8066f30 0x7fadd80693e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:55.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.607+0000 7fadfc8db700 1 --2- 172.21.15.81:0/1925377551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf806d830 0x7fadf80cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:55.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.607+0000 7fadfc8db700 1 --2- 172.21.15.81:0/1925377551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf81578d0 0x7fadf80ac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:55.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.607+0000 7fadfc8db700 1 -- 172.21.15.81:0/1925377551 >> 172.21.15.81:0/1925377551 conn(0x7fadf806bb90 msgr2=0x7fadf806d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:55.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.607+0000 7fadfc8db700 1 -- 172.21.15.81:0/1925377551 shutdown_connections 2023-10-07T08:46:55.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:55.607+0000 7fadfc8db700 1 -- 172.21.15.81:0/1925377551 wait complete. 2023-10-07T08:46:55.619 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:46:55.619 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:46:55.619 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-07T08:46:55.619 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T08:46:55.619 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T08:46:55.619 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:46:55.619 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:46:55.619 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:46:55.619 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:46:55.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:46:55.620 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-07T08:46:55.638 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:46:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:46:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:46:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:46:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-07T08:46:55.638 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:46:55.639 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:46:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:46:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-10-07T08:46:55.639 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:46:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:46:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-10-07T08:46:55.639 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:46:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:46:55.639 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:46:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:46:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:46:55.639 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42313sec preferred_lft 42313sec 2023-10-07T08:46:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2023-10-07T08:46:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:46:55.640 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:46:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:46:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:46:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:46:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::74d7:a9ff:fe87:ed9/64 scope link 2023-10-07T08:46:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:46:55.640 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:46:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T08:46:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6c40:c5ff:fe3a:a57/64 scope link 2023-10-07T08:46:55.640 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:46:55.640 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:46:55.641 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether de:db:cd:68:b1:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T08:46:55.641 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::dcdb:cdff:fe68:b178/64 scope link 2023-10-07T08:46:55.641 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:46:55.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:46:55.641 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:46:55.704 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-07T08:46:55.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:46:55.705 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-07T08:46:55.762 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-07T08:46:55.762 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:46:55.762 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:46:55.762 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:46:55.762 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:46:55.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:46:55.763 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:46:55.763 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:46:55.763 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:46:55.763 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:46:55.763 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:46:55.763 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:46:55.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:46:55.863 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-07T08:46:55.878 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T08:46:55.878 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T08:46:55.878 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:46:55.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:46:55.878 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-07T08:46:55.943 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:46:55.943 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T08:46:55.998 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:46:55.998 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:46:55.998 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:46:56.053 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:46:56.053 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:46:56.053 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:46:56.133 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:46:56.133 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:46:56.133 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:46:56.142 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:46:56.142 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:46:56.142 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:46:56.142 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:46:56.142 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:46:56.163 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:46:56.163 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:46:56.163 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:46:56.163 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:46:56.163 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:46:56.163 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:46:56.163 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:46:56.163 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:46:56.165 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:46:56.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:46:56.165 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:46:56.229 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:46:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.348+0000 7f3f47fde700 1 Processor -- start 2023-10-07T08:46:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.349+0000 7f3f47fde700 1 -- start start 2023-10-07T08:46:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.349+0000 7f3f47fde700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f40157fe0 0x7f3f400b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.349+0000 7f3f47fde700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3f401583b0 0x7f3f400b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.349+0000 7f3f47fde700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f400ceb30 0x7f3f400cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.349+0000 7f3f47fde700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f400cf4b0 con 0x7f3f40157fe0 2023-10-07T08:46:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.349+0000 7f3f47fde700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f400b2890 con 0x7f3f401583b0 2023-10-07T08:46:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.349+0000 7f3f47fde700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f400b4070 con 0x7f3f400ceb30 2023-10-07T08:46:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.349+0000 7f3f45d7a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f40157fe0 0x7f3f400b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.350+0000 7f3f45d7a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f40157fe0 0x7f3f400b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33266/0 (socket says 172.21.15.81:33266) 2023-10-07T08:46:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.350+0000 7f3f45d7a700 1 -- 172.21.15.81:0/3789621651 learned_addr learned my addr 172.21.15.81:0/3789621651 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.350+0000 7f3f45579700 1 --2- 172.21.15.81:0/3789621651 >> v2:172.21.15.89:3300/0 conn(0x7f3f401583b0 0x7f3f400b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.350+0000 7f3f4657b700 1 --2- 172.21.15.81:0/3789621651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f400ceb30 0x7f3f400cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.350+0000 7f3f45d7a700 1 -- 172.21.15.81:0/3789621651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f400ceb30 msgr2=0x7f3f400cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.350+0000 7f3f45d7a700 1 --2- 172.21.15.81:0/3789621651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f400ceb30 0x7f3f400cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.350+0000 7f3f45d7a700 1 -- 172.21.15.81:0/3789621651 >> v2:172.21.15.89:3300/0 conn(0x7f3f401583b0 msgr2=0x7f3f400b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:46:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.350+0000 7f3f45d7a700 1 --2- 172.21.15.81:0/3789621651 >> v2:172.21.15.89:3300/0 conn(0x7f3f401583b0 0x7f3f400b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.350+0000 7f3f45d7a700 1 -- 172.21.15.81:0/3789621651 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f400b4350 con 0x7f3f40157fe0 2023-10-07T08:46:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.350+0000 7f3f4657b700 1 --2- 172.21.15.81:0/3789621651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f400ceb30 0x7f3f400cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:46:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.350+0000 7f3f45d7a700 1 --2- 172.21.15.81:0/3789621651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f40157fe0 0x7f3f400b34c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3f4004c150 tx=0x7f3f3c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3b01c590f8fe5c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.350+0000 7f3f44d78700 1 -- 172.21.15.81:0/3789621651 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c00e070 con 0x7f3f40157fe0 2023-10-07T08:46:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.350+0000 7f3f44d78700 1 -- 172.21.15.81:0/3789621651 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c00ba20 con 0x7f3f40157fe0 2023-10-07T08:46:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.350+0000 7f3f44d78700 1 -- 172.21.15.81:0/3789621651 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c0092e0 con 0x7f3f40157fe0 2023-10-07T08:46:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.351+0000 7f3f47fde700 1 -- 172.21.15.81:0/3789621651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f40157fe0 msgr2=0x7f3f400b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.351+0000 7f3f47fde700 1 --2- 172.21.15.81:0/3789621651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f40157fe0 0x7f3f400b34c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3f4004c150 tx=0x7f3f3c009840 comp rx=0 tx=0).stop 2023-10-07T08:46:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.351+0000 7f3f47fde700 1 -- 172.21.15.81:0/3789621651 shutdown_connections 2023-10-07T08:46:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.351+0000 7f3f47fde700 1 --2- 172.21.15.81:0/3789621651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f400ceb30 0x7f3f400cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.351+0000 7f3f47fde700 1 --2- 172.21.15.81:0/3789621651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f40157fe0 0x7f3f400b34c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:56.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.351+0000 7f3f47fde700 1 --2- 172.21.15.81:0/3789621651 >> v2:172.21.15.89:3300/0 conn(0x7f3f401583b0 0x7f3f400b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:56.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.351+0000 7f3f47fde700 1 -- 172.21.15.81:0/3789621651 >> 172.21.15.81:0/3789621651 conn(0x7f3f40067640 msgr2=0x7f3f40067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:56.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.351+0000 7f3f47fde700 1 -- 172.21.15.81:0/3789621651 shutdown_connections 2023-10-07T08:46:56.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.351+0000 7f3f47fde700 1 -- 172.21.15.81:0/3789621651 wait complete. 2023-10-07T08:46:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.352+0000 7f3f47fde700 1 Processor -- start 2023-10-07T08:46:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.352+0000 7f3f47fde700 1 -- start start 2023-10-07T08:46:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.352+0000 7f3f47fde700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f400ceb30 0x7f3f40152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.352+0000 7f3f47fde700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f40157fe0 0x7f3f40150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.352+0000 7f3f47fde700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f401583b0 0x7f3f401509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f47fde700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40159450 con 0x7f3f401583b0 2023-10-07T08:46:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f47fde700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4006da40 con 0x7f3f400ceb30 2023-10-07T08:46:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f47fde700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f401596a0 con 0x7f3f40157fe0 2023-10-07T08:46:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f4657b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f401583b0 0x7f3f401509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f4657b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f401583b0 0x7f3f401509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33270/0 (socket says 172.21.15.81:33270) 2023-10-07T08:46:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f4657b700 1 -- 172.21.15.81:0/669781912 learned_addr learned my addr 172.21.15.81:0/669781912 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:46:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f4657b700 1 -- 172.21.15.81:0/669781912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f40157fe0 msgr2=0x7f3f40150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f4657b700 1 --2- 172.21.15.81:0/669781912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f40157fe0 0x7f3f40150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f4657b700 1 -- 172.21.15.81:0/669781912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f400ceb30 msgr2=0x7f3f40152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f4657b700 1 --2- 172.21.15.81:0/669781912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f400ceb30 0x7f3f40152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f4657b700 1 -- 172.21.15.81:0/669781912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c009ae0 con 0x7f3f401583b0 2023-10-07T08:46:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f4657b700 1 --2- 172.21.15.81:0/669781912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f401583b0 0x7f3f401509b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800d860 tx=0x7f3f38008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f35ffb700 1 -- 172.21.15.81:0/669781912 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380125f0 con 0x7f3f401583b0 2023-10-07T08:46:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f35ffb700 1 -- 172.21.15.81:0/669781912 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f38012750 con 0x7f3f401583b0 2023-10-07T08:46:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f35ffb700 1 -- 172.21.15.81:0/669781912 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38012ad0 con 0x7f3f401583b0 2023-10-07T08:46:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f47fde700 1 -- 172.21.15.81:0/669781912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f40159980 con 0x7f3f401583b0 2023-10-07T08:46:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.353+0000 7f3f47fde700 1 -- 172.21.15.81:0/669781912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f40153270 con 0x7f3f401583b0 2023-10-07T08:46:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.354+0000 7f3f47fde700 1 -- 172.21.15.81:0/669781912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f40159ea0 con 0x7f3f401583b0 2023-10-07T08:46:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.354+0000 7f3f35ffb700 1 -- 172.21.15.81:0/669781912 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f38014430 con 0x7f3f401583b0 2023-10-07T08:46:56.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.355+0000 7f3f35ffb700 1 --2- 172.21.15.81:0/669781912 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3f24066f30 0x7f3f240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:46:56.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.355+0000 7f3f45d7a700 1 --2- 172.21.15.81:0/669781912 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3f24066f30 0x7f3f240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:46:56.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.355+0000 7f3f35ffb700 1 -- 172.21.15.81:0/669781912 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f38084920 con 0x7f3f401583b0 2023-10-07T08:46:56.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.355+0000 7f3f45d7a700 1 --2- 172.21.15.81:0/669781912 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3f24066f30 0x7f3f240693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3f4004c150 tx=0x7f3f3c018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:46:56.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.359+0000 7f3f35ffb700 1 -- 172.21.15.81:0/669781912 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f40159ea0 con 0x7f3f401583b0 2023-10-07T08:46:56.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.587+0000 7f3f47fde700 1 -- 172.21.15.81:0/669781912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f40159ea0 con 0x7f3f401583b0 2023-10-07T08:46:56.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.587+0000 7f3f35ffb700 1 -- 172.21.15.81:0/669781912 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f3f40159ea0 con 0x7f3f401583b0 2023-10-07T08:46:56.588 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:46:56.588 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/401991459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":401991459},{"type":"v1","addr":"172.21.15.89:6834","nonce":401991459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2214247931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2214247931},{"type":"v1","addr":"172.21.15.81:6836","nonce":2214247931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5620,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1168741718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1168741718},{"type":"v1","addr":"172.21.15.89:6835","nonce":1168741718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:46:47.782779+0000","modified":"2023-10-07T08:46:51.441764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6015":{"gid":6015,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2297722913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2297722913},{"type":"v1","addr":"172.21.15.81:6837","nonce":2297722913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-07T08:46:56.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.589+0000 7f3f47fde700 1 -- 172.21.15.81:0/669781912 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3f24066f30 msgr2=0x7f3f240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:56.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.589+0000 7f3f47fde700 1 --2- 172.21.15.81:0/669781912 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3f24066f30 0x7f3f240693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3f4004c150 tx=0x7f3f3c018000 comp rx=0 tx=0).stop 2023-10-07T08:46:56.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.589+0000 7f3f47fde700 1 -- 172.21.15.81:0/669781912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f401583b0 msgr2=0x7f3f401509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:46:56.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.589+0000 7f3f47fde700 1 --2- 172.21.15.81:0/669781912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f401583b0 0x7f3f401509b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800d860 tx=0x7f3f38008040 comp rx=0 tx=0).stop 2023-10-07T08:46:56.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.589+0000 7f3f47fde700 1 -- 172.21.15.81:0/669781912 shutdown_connections 2023-10-07T08:46:56.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.589+0000 7f3f47fde700 1 --2- 172.21.15.81:0/669781912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f401583b0 0x7f3f401509b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:56.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.589+0000 7f3f47fde700 1 --2- 172.21.15.81:0/669781912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f400ceb30 0x7f3f40152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:56.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.589+0000 7f3f47fde700 1 --2- 172.21.15.81:0/669781912 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3f24066f30 0x7f3f240693e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:56.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.589+0000 7f3f47fde700 1 --2- 172.21.15.81:0/669781912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f40157fe0 0x7f3f40150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:46:56.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.589+0000 7f3f47fde700 1 -- 172.21.15.81:0/669781912 >> 172.21.15.81:0/669781912 conn(0x7f3f40067640 msgr2=0x7f3f400ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:46:56.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.589+0000 7f3f47fde700 1 -- 172.21.15.81:0/669781912 shutdown_connections 2023-10-07T08:46:56.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:46:56.589+0000 7f3f47fde700 1 -- 172.21.15.81:0/669781912 wait complete. 2023-10-07T08:46:56.591 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2023-10-07T08:46:56.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-07T08:46:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":6015,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3094497250000003,"mdsmap_epoch":40,"osdmap_epoch":85,"osdmap_epoch_barrier":85,"uptime":14.290599431} 2023-10-07T08:46:56.736 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 6015, "mdsmap_epoch": 40, "osdmap_epoch": 85, "osdmap_epoch_barrier": 85, "rank_uptime": 8.309449725, "state": "up:active", "uptime": 14.290599431, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:46:56.736 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-07T08:46:56.864 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_mon_report_interval":"5"} 2023-10-07T08:46:56.865 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-07T08:46:56.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-07T08:46:56.988 INFO:teuthology.orchestra.run.smithi081.stdout:{"mon_tick_interval":"5"} 2023-10-07T08:46:56.989 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-07T08:46:56.989 INFO:tasks.cephfs.test_full:pool capacity 557061696, 531MB should be enough to fill it 2023-10-07T08:46:56.989 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-07T08:46:56.989 DEBUG:teuthology.orchestra.run.smithi081:> import time 2023-10-07T08:46:56.989 DEBUG:teuthology.orchestra.run.smithi081:> import datetime 2023-10-07T08:46:56.989 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-10-07T08:46:56.989 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-07T08:46:56.989 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:46:56.990 DEBUG:teuthology.orchestra.run.smithi081:> # Write some buffered data through before going full, all should be well 2023-10-07T08:46:56.990 DEBUG:teuthology.orchestra.run.smithi081:> print("writing some data through which we expect to succeed") 2023-10-07T08:46:56.990 DEBUG:teuthology.orchestra.run.smithi081:> bytes = 0 2023-10-07T08:46:56.990 DEBUG:teuthology.orchestra.run.smithi081:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-07T08:46:56.990 DEBUG:teuthology.orchestra.run.smithi081:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-07T08:46:56.990 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-10-07T08:46:56.990 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f) 2023-10-07T08:46:56.990 DEBUG:teuthology.orchestra.run.smithi081:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-07T08:46:56.990 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:46:56.990 DEBUG:teuthology.orchestra.run.smithi081:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-07T08:46:56.990 DEBUG:teuthology.orchestra.run.smithi081:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-07T08:46:56.990 DEBUG:teuthology.orchestra.run.smithi081:> # buffered IO, the error should always only appear from fsync and not 2023-10-07T08:46:56.991 DEBUG:teuthology.orchestra.run.smithi081:> # from write 2023-10-07T08:46:56.991 DEBUG:teuthology.orchestra.run.smithi081:> full = False 2023-10-07T08:46:56.991 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:46:56.991 DEBUG:teuthology.orchestra.run.smithi081:> for n in range(0, int(531 * 1.1)): 2023-10-07T08:46:56.991 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-07T08:46:56.991 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-07T08:46:56.991 DEBUG:teuthology.orchestra.run.smithi081:> print("wrote bytes via buffered write, moving on to fsync") 2023-10-07T08:46:56.991 DEBUG:teuthology.orchestra.run.smithi081:> except OSError as e: 2023-10-07T08:46:56.991 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2023-10-07T08:46:56.991 DEBUG:teuthology.orchestra.run.smithi081:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-10-07T08:46:56.991 DEBUG:teuthology.orchestra.run.smithi081:> raise 2023-10-07T08:46:56.991 DEBUG:teuthology.orchestra.run.smithi081:> else: 2023-10-07T08:46:56.992 DEBUG:teuthology.orchestra.run.smithi081:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-07T08:46:56.992 DEBUG:teuthology.orchestra.run.smithi081:> full = True 2023-10-07T08:46:56.992 DEBUG:teuthology.orchestra.run.smithi081:> break 2023-10-07T08:46:56.992 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:46:56.992 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-07T08:46:56.992 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f) 2023-10-07T08:46:56.992 DEBUG:teuthology.orchestra.run.smithi081:> print("fsync'"'"'ed successfully") 2023-10-07T08:46:56.992 DEBUG:teuthology.orchestra.run.smithi081:> except OSError as e: 2023-10-07T08:46:56.992 DEBUG:teuthology.orchestra.run.smithi081:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-07T08:46:56.992 DEBUG:teuthology.orchestra.run.smithi081:> full = True 2023-10-07T08:46:56.992 DEBUG:teuthology.orchestra.run.smithi081:> break 2023-10-07T08:46:56.992 DEBUG:teuthology.orchestra.run.smithi081:> else: 2023-10-07T08:46:56.993 DEBUG:teuthology.orchestra.run.smithi081:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-07T08:46:56.993 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:46:56.993 DEBUG:teuthology.orchestra.run.smithi081:> if n > 531 * 0.9: 2023-10-07T08:46:56.993 DEBUG:teuthology.orchestra.run.smithi081:> # Be cautious in the last region where we expect to hit 2023-10-07T08:46:56.993 DEBUG:teuthology.orchestra.run.smithi081:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-10-07T08:46:56.993 DEBUG:teuthology.orchestra.run.smithi081:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-07T08:46:56.993 DEBUG:teuthology.orchestra.run.smithi081:> time.sleep(15.0) 2023-10-07T08:46:56.993 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:46:56.993 DEBUG:teuthology.orchestra.run.smithi081:> if not full: 2023-10-07T08:46:56.993 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-10-07T08:46:56.993 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:46:56.993 DEBUG:teuthology.orchestra.run.smithi081:> # close() should not raise an error because we already caught it in 2023-10-07T08:46:56.993 DEBUG:teuthology.orchestra.run.smithi081:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-10-07T08:46:56.993 DEBUG:teuthology.orchestra.run.smithi081:> # since then because all IOs got cancelled on the full flag. 2023-10-07T08:46:56.994 DEBUG:teuthology.orchestra.run.smithi081:> print("calling close") 2023-10-07T08:46:56.994 DEBUG:teuthology.orchestra.run.smithi081:> os.close(f) 2023-10-07T08:46:56.994 DEBUG:teuthology.orchestra.run.smithi081:> print("close() did not raise error") 2023-10-07T08:46:56.994 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:46:56.994 DEBUG:teuthology.orchestra.run.smithi081:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-07T08:46:56.994 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-07T08:46:57.660 INFO:teuthology.orchestra.run.smithi081.stdout:writing some data through which we expect to succeed 2023-10-07T08:46:57.661 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-07T08:46:57.661 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.661 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.661 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 1.00 MB 2023-10-07T08:46:57.661 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.661 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.661 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 2.00 MB 2023-10-07T08:46:57.661 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.661 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.661 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 3.00 MB 2023-10-07T08:46:57.662 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.662 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.662 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 4.00 MB 2023-10-07T08:46:57.662 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.662 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.662 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 5.00 MB 2023-10-07T08:46:57.662 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.662 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.662 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 6.00 MB 2023-10-07T08:46:57.662 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.662 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.663 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 7.00 MB 2023-10-07T08:46:57.663 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.663 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.663 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 8.00 MB 2023-10-07T08:46:57.663 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.663 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.663 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 9.00 MB 2023-10-07T08:46:57.663 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.663 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.663 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 10.00 MB 2023-10-07T08:46:57.663 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.663 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.664 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 11.00 MB 2023-10-07T08:46:57.664 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.664 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.664 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 12.00 MB 2023-10-07T08:46:57.664 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.664 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.664 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 13.00 MB 2023-10-07T08:46:57.664 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.664 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.664 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 14.00 MB 2023-10-07T08:46:57.664 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.664 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.665 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 15.00 MB 2023-10-07T08:46:57.665 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.665 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.665 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 16.00 MB 2023-10-07T08:46:57.665 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.665 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.665 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 17.00 MB 2023-10-07T08:46:57.666 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.666 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.666 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 18.00 MB 2023-10-07T08:46:57.666 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.666 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.666 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 19.00 MB 2023-10-07T08:46:57.666 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.666 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.666 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 20.00 MB 2023-10-07T08:46:57.667 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.667 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.667 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 21.00 MB 2023-10-07T08:46:57.667 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.667 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.667 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 22.00 MB 2023-10-07T08:46:57.667 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.667 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.668 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 23.00 MB 2023-10-07T08:46:57.668 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.668 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.668 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 24.00 MB 2023-10-07T08:46:57.668 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.668 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.668 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 25.00 MB 2023-10-07T08:46:57.668 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.668 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.668 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 26.00 MB 2023-10-07T08:46:57.669 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.669 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.669 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 27.00 MB 2023-10-07T08:46:57.669 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.669 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.669 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 28.00 MB 2023-10-07T08:46:57.669 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.669 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.669 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 29.00 MB 2023-10-07T08:46:57.670 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.670 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.670 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 30.00 MB 2023-10-07T08:46:57.670 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.670 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.670 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 31.00 MB 2023-10-07T08:46:57.670 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.670 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.670 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 32.00 MB 2023-10-07T08:46:57.671 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.671 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.671 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 33.00 MB 2023-10-07T08:46:57.671 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.671 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.671 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 34.00 MB 2023-10-07T08:46:57.671 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.672 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.672 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 35.00 MB 2023-10-07T08:46:57.672 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.672 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.672 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 36.00 MB 2023-10-07T08:46:57.672 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.673 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.673 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 37.00 MB 2023-10-07T08:46:57.673 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.673 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.673 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 38.00 MB 2023-10-07T08:46:57.673 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.673 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.673 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 39.00 MB 2023-10-07T08:46:57.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.674 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.674 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 40.00 MB 2023-10-07T08:46:57.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.674 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.674 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 41.00 MB 2023-10-07T08:46:57.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.674 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.674 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 42.00 MB 2023-10-07T08:46:57.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.674 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.675 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 43.00 MB 2023-10-07T08:46:57.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.675 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.675 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 44.00 MB 2023-10-07T08:46:57.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.675 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.675 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 45.00 MB 2023-10-07T08:46:57.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.675 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.675 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 46.00 MB 2023-10-07T08:46:57.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.675 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.676 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 47.00 MB 2023-10-07T08:46:57.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.676 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.676 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 48.00 MB 2023-10-07T08:46:57.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.676 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.676 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 49.00 MB 2023-10-07T08:46:57.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.676 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.676 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 50.00 MB 2023-10-07T08:46:57.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.676 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.677 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 51.00 MB 2023-10-07T08:46:57.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.677 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.677 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 52.00 MB 2023-10-07T08:46:57.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.677 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.677 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 53.00 MB 2023-10-07T08:46:57.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.678 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.678 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 54.00 MB 2023-10-07T08:46:57.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.678 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.678 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 55.00 MB 2023-10-07T08:46:57.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.678 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.678 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 56.00 MB 2023-10-07T08:46:57.678 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.679 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.679 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 57.00 MB 2023-10-07T08:46:57.679 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.679 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.679 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 58.00 MB 2023-10-07T08:46:57.679 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.679 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.679 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 59.00 MB 2023-10-07T08:46:57.679 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.679 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.680 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 60.00 MB 2023-10-07T08:46:57.680 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.680 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.680 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 61.00 MB 2023-10-07T08:46:57.680 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.680 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.680 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 62.00 MB 2023-10-07T08:46:57.680 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.680 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.680 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 63.00 MB 2023-10-07T08:46:57.680 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.681 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.681 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 64.00 MB 2023-10-07T08:46:57.681 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.681 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.681 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 65.00 MB 2023-10-07T08:46:57.681 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.681 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.681 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 66.00 MB 2023-10-07T08:46:57.681 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.682 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.682 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 67.00 MB 2023-10-07T08:46:57.682 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.682 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.682 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 68.00 MB 2023-10-07T08:46:57.682 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.682 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.682 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 69.00 MB 2023-10-07T08:46:57.682 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.682 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.682 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 70.00 MB 2023-10-07T08:46:57.682 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.683 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.683 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 71.00 MB 2023-10-07T08:46:57.683 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.683 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.683 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 72.00 MB 2023-10-07T08:46:57.683 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.683 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.683 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 73.00 MB 2023-10-07T08:46:57.683 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.683 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.684 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 74.00 MB 2023-10-07T08:46:57.684 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.684 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.684 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 75.00 MB 2023-10-07T08:46:57.684 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.684 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.684 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 76.00 MB 2023-10-07T08:46:57.684 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.684 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.684 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 77.00 MB 2023-10-07T08:46:57.684 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.684 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.684 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 78.00 MB 2023-10-07T08:46:57.685 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.685 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.685 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 79.00 MB 2023-10-07T08:46:57.685 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.685 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.685 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 80.00 MB 2023-10-07T08:46:57.863 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.863 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.863 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 81.00 MB 2023-10-07T08:46:57.863 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.864 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.864 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 82.00 MB 2023-10-07T08:46:57.864 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.864 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.864 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 83.00 MB 2023-10-07T08:46:57.864 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.864 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.864 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 84.00 MB 2023-10-07T08:46:57.864 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.864 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.864 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 85.00 MB 2023-10-07T08:46:57.864 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.865 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.865 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 86.00 MB 2023-10-07T08:46:57.865 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.865 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.865 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 87.00 MB 2023-10-07T08:46:57.865 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.865 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.865 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 88.00 MB 2023-10-07T08:46:57.865 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.865 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.865 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 89.00 MB 2023-10-07T08:46:57.866 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.866 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.866 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 90.00 MB 2023-10-07T08:46:57.866 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.866 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.866 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 91.00 MB 2023-10-07T08:46:57.866 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.866 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.866 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 92.00 MB 2023-10-07T08:46:57.866 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.866 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.866 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 93.00 MB 2023-10-07T08:46:57.867 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.867 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.867 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 94.00 MB 2023-10-07T08:46:57.867 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.867 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.867 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 95.00 MB 2023-10-07T08:46:57.867 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.867 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.867 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 96.00 MB 2023-10-07T08:46:57.867 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.867 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.867 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 97.00 MB 2023-10-07T08:46:57.867 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.868 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.868 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 98.00 MB 2023-10-07T08:46:57.868 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.868 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.868 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 99.00 MB 2023-10-07T08:46:57.868 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.868 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.868 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 100.00 MB 2023-10-07T08:46:57.868 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.868 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.868 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 101.00 MB 2023-10-07T08:46:57.868 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.869 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.869 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 102.00 MB 2023-10-07T08:46:57.869 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.869 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.869 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 103.00 MB 2023-10-07T08:46:57.869 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.869 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.869 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 104.00 MB 2023-10-07T08:46:57.869 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.869 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.869 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 105.00 MB 2023-10-07T08:46:57.869 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.870 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.870 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 106.00 MB 2023-10-07T08:46:57.870 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.870 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.870 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 107.00 MB 2023-10-07T08:46:57.870 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.870 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.870 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 108.00 MB 2023-10-07T08:46:57.870 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.870 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.870 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 109.00 MB 2023-10-07T08:46:57.870 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.871 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.871 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 110.00 MB 2023-10-07T08:46:57.871 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.871 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.871 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 111.00 MB 2023-10-07T08:46:57.871 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.871 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.871 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 112.00 MB 2023-10-07T08:46:57.871 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.871 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.871 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 113.00 MB 2023-10-07T08:46:57.871 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.872 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.872 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 114.00 MB 2023-10-07T08:46:57.872 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.872 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.872 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 115.00 MB 2023-10-07T08:46:57.872 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.872 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.872 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 116.00 MB 2023-10-07T08:46:57.872 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.872 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.872 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 117.00 MB 2023-10-07T08:46:57.872 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.873 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.873 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 118.00 MB 2023-10-07T08:46:57.873 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.873 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.873 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 119.00 MB 2023-10-07T08:46:57.873 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.873 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.873 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 120.00 MB 2023-10-07T08:46:57.873 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.873 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.873 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 121.00 MB 2023-10-07T08:46:57.873 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.873 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.874 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 122.00 MB 2023-10-07T08:46:57.874 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.874 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.874 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 123.00 MB 2023-10-07T08:46:57.874 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.874 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.874 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 124.00 MB 2023-10-07T08:46:57.874 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.874 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.874 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 125.00 MB 2023-10-07T08:46:57.874 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.874 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.875 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 126.00 MB 2023-10-07T08:46:57.875 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.875 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.875 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 127.00 MB 2023-10-07T08:46:57.875 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.875 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.875 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 128.00 MB 2023-10-07T08:46:57.875 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.875 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.875 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 129.00 MB 2023-10-07T08:46:57.875 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.876 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.876 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 130.00 MB 2023-10-07T08:46:57.876 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.876 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.876 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 131.00 MB 2023-10-07T08:46:57.876 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.876 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.876 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 132.00 MB 2023-10-07T08:46:57.876 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.876 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.876 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 133.00 MB 2023-10-07T08:46:57.876 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.876 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.877 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 134.00 MB 2023-10-07T08:46:57.877 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.877 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.877 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 135.00 MB 2023-10-07T08:46:57.877 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.877 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.877 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 136.00 MB 2023-10-07T08:46:57.877 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.877 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.877 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 137.00 MB 2023-10-07T08:46:57.877 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.878 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.878 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 138.00 MB 2023-10-07T08:46:57.878 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.878 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.878 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 139.00 MB 2023-10-07T08:46:57.878 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.878 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.878 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 140.00 MB 2023-10-07T08:46:57.878 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.878 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.878 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 141.00 MB 2023-10-07T08:46:57.878 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.879 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.879 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 142.00 MB 2023-10-07T08:46:57.879 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.879 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.879 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 143.00 MB 2023-10-07T08:46:57.879 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.879 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.879 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 144.00 MB 2023-10-07T08:46:57.879 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.879 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.879 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 145.00 MB 2023-10-07T08:46:57.879 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.880 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.880 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 146.00 MB 2023-10-07T08:46:57.880 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.880 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.880 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 147.00 MB 2023-10-07T08:46:57.880 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.880 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.880 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 148.00 MB 2023-10-07T08:46:57.880 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.880 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.880 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 149.00 MB 2023-10-07T08:46:57.880 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.881 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.881 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 150.00 MB 2023-10-07T08:46:57.881 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.881 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.881 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 151.00 MB 2023-10-07T08:46:57.881 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.881 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.881 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 152.00 MB 2023-10-07T08:46:57.881 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.881 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.881 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 153.00 MB 2023-10-07T08:46:57.882 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.882 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.882 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 154.00 MB 2023-10-07T08:46:57.882 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.882 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.882 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 155.00 MB 2023-10-07T08:46:57.882 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.882 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.882 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 156.00 MB 2023-10-07T08:46:57.882 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.882 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.882 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 157.00 MB 2023-10-07T08:46:57.883 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.883 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.883 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 158.00 MB 2023-10-07T08:46:57.883 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.883 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.883 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 159.00 MB 2023-10-07T08:46:57.883 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.883 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.883 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 160.00 MB 2023-10-07T08:46:57.883 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:57.883 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:57.883 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 161.00 MB 2023-10-07T08:46:58.061 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.061 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.061 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 162.00 MB 2023-10-07T08:46:58.061 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.061 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.062 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 163.00 MB 2023-10-07T08:46:58.062 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.062 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.062 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 164.00 MB 2023-10-07T08:46:58.062 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.062 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.063 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 165.00 MB 2023-10-07T08:46:58.063 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.063 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.063 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 166.00 MB 2023-10-07T08:46:58.063 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.063 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.063 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 167.00 MB 2023-10-07T08:46:58.063 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.064 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.064 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 168.00 MB 2023-10-07T08:46:58.064 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.064 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.064 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 169.00 MB 2023-10-07T08:46:58.064 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.064 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.065 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 170.00 MB 2023-10-07T08:46:58.065 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.065 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.065 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 171.00 MB 2023-10-07T08:46:58.065 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.065 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.065 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 172.00 MB 2023-10-07T08:46:58.065 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.065 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.066 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 173.00 MB 2023-10-07T08:46:58.066 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.066 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.066 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 174.00 MB 2023-10-07T08:46:58.066 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.066 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.066 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 175.00 MB 2023-10-07T08:46:58.067 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.067 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.067 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 176.00 MB 2023-10-07T08:46:58.067 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.067 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.067 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 177.00 MB 2023-10-07T08:46:58.068 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.068 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.068 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 178.00 MB 2023-10-07T08:46:58.068 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.068 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.068 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 179.00 MB 2023-10-07T08:46:58.069 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.069 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.069 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 180.00 MB 2023-10-07T08:46:58.069 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.069 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.069 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 181.00 MB 2023-10-07T08:46:58.070 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.070 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.070 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 182.00 MB 2023-10-07T08:46:58.070 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.070 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.071 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 183.00 MB 2023-10-07T08:46:58.071 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.071 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.071 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 184.00 MB 2023-10-07T08:46:58.071 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.071 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.072 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 185.00 MB 2023-10-07T08:46:58.072 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.072 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.072 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 186.00 MB 2023-10-07T08:46:58.072 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.072 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.072 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 187.00 MB 2023-10-07T08:46:58.073 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.073 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.073 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 188.00 MB 2023-10-07T08:46:58.073 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.073 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.073 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 189.00 MB 2023-10-07T08:46:58.074 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.074 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.074 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 190.00 MB 2023-10-07T08:46:58.074 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.074 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.074 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 191.00 MB 2023-10-07T08:46:58.075 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.075 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.075 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 192.00 MB 2023-10-07T08:46:58.075 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.075 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.075 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 193.00 MB 2023-10-07T08:46:58.076 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.076 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.076 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 194.00 MB 2023-10-07T08:46:58.076 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.076 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.076 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 195.00 MB 2023-10-07T08:46:58.076 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.077 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.077 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 196.00 MB 2023-10-07T08:46:58.077 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.077 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.077 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 197.00 MB 2023-10-07T08:46:58.077 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.077 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.078 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 198.00 MB 2023-10-07T08:46:58.078 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.078 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.078 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 199.00 MB 2023-10-07T08:46:58.078 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.078 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.078 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 200.00 MB 2023-10-07T08:46:58.078 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.079 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.079 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 201.00 MB 2023-10-07T08:46:58.079 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.079 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.079 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 202.00 MB 2023-10-07T08:46:58.079 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.079 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.079 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 203.00 MB 2023-10-07T08:46:58.079 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.079 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.079 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 204.00 MB 2023-10-07T08:46:58.079 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.080 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.080 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 205.00 MB 2023-10-07T08:46:58.080 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.080 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.080 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 206.00 MB 2023-10-07T08:46:58.080 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.080 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.080 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 207.00 MB 2023-10-07T08:46:58.080 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.080 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.080 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 208.00 MB 2023-10-07T08:46:58.080 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.081 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.081 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 209.00 MB 2023-10-07T08:46:58.081 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.081 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.081 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 210.00 MB 2023-10-07T08:46:58.081 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.081 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.081 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 211.00 MB 2023-10-07T08:46:58.081 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.081 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.081 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 212.00 MB 2023-10-07T08:46:58.081 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.082 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.082 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 213.00 MB 2023-10-07T08:46:58.082 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.082 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.082 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 214.00 MB 2023-10-07T08:46:58.082 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.082 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.082 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 215.00 MB 2023-10-07T08:46:58.082 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.082 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.082 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 216.00 MB 2023-10-07T08:46:58.082 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.083 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.083 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 217.00 MB 2023-10-07T08:46:58.083 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.083 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.083 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 218.00 MB 2023-10-07T08:46:58.083 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.083 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.083 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 219.00 MB 2023-10-07T08:46:58.083 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.083 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.083 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 220.00 MB 2023-10-07T08:46:58.084 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.084 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.084 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 221.00 MB 2023-10-07T08:46:58.084 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.084 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.084 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 222.00 MB 2023-10-07T08:46:58.084 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.084 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.084 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 223.00 MB 2023-10-07T08:46:58.084 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.084 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.084 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 224.00 MB 2023-10-07T08:46:58.085 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.085 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.085 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 225.00 MB 2023-10-07T08:46:58.085 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.085 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.085 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 226.00 MB 2023-10-07T08:46:58.085 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.085 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.085 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 227.00 MB 2023-10-07T08:46:58.085 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.085 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.085 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 228.00 MB 2023-10-07T08:46:58.086 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.086 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.086 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 229.00 MB 2023-10-07T08:46:58.086 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.086 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.086 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 230.00 MB 2023-10-07T08:46:58.086 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.086 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.086 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 231.00 MB 2023-10-07T08:46:58.086 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.086 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.087 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 232.00 MB 2023-10-07T08:46:58.087 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.087 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.087 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 233.00 MB 2023-10-07T08:46:58.087 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.087 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.087 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 234.00 MB 2023-10-07T08:46:58.087 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.087 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.087 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 235.00 MB 2023-10-07T08:46:58.087 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 236.00 MB 2023-10-07T08:46:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 237.00 MB 2023-10-07T08:46:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 238.00 MB 2023-10-07T08:46:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 239.00 MB 2023-10-07T08:46:58.088 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 240.00 MB 2023-10-07T08:46:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.089 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 241.00 MB 2023-10-07T08:46:58.253 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.253 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.253 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 242.00 MB 2023-10-07T08:46:58.254 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.254 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.254 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 243.00 MB 2023-10-07T08:46:58.254 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.254 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.254 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 244.00 MB 2023-10-07T08:46:58.254 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.254 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.254 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 245.00 MB 2023-10-07T08:46:58.254 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.254 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.255 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 246.00 MB 2023-10-07T08:46:58.255 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.255 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.255 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 247.00 MB 2023-10-07T08:46:58.255 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.255 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.255 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 248.00 MB 2023-10-07T08:46:58.255 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.255 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.255 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 249.00 MB 2023-10-07T08:46:58.255 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.255 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.256 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 250.00 MB 2023-10-07T08:46:58.256 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.256 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.256 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 251.00 MB 2023-10-07T08:46:58.256 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.256 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.256 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 252.00 MB 2023-10-07T08:46:58.256 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.256 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.256 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 253.00 MB 2023-10-07T08:46:58.256 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.256 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.257 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 254.00 MB 2023-10-07T08:46:58.257 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.257 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.257 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 255.00 MB 2023-10-07T08:46:58.257 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.257 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.257 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 256.00 MB 2023-10-07T08:46:58.257 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.257 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.257 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 257.00 MB 2023-10-07T08:46:58.257 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.257 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.258 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 258.00 MB 2023-10-07T08:46:58.258 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.258 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.258 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 259.00 MB 2023-10-07T08:46:58.258 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.258 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.258 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 260.00 MB 2023-10-07T08:46:58.258 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.258 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.258 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 261.00 MB 2023-10-07T08:46:58.258 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.258 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.259 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 262.00 MB 2023-10-07T08:46:58.259 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.259 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.259 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 263.00 MB 2023-10-07T08:46:58.259 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.259 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.259 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 264.00 MB 2023-10-07T08:46:58.259 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.259 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.259 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 265.00 MB 2023-10-07T08:46:58.259 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.259 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.260 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 266.00 MB 2023-10-07T08:46:58.260 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.260 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.260 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 267.00 MB 2023-10-07T08:46:58.260 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.260 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.260 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 268.00 MB 2023-10-07T08:46:58.260 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.260 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.260 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 269.00 MB 2023-10-07T08:46:58.260 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.260 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.261 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 270.00 MB 2023-10-07T08:46:58.261 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.261 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.261 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 271.00 MB 2023-10-07T08:46:58.261 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.261 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.261 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 272.00 MB 2023-10-07T08:46:58.261 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.261 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.261 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 273.00 MB 2023-10-07T08:46:58.261 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.261 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.262 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 274.00 MB 2023-10-07T08:46:58.262 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.262 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.262 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 275.00 MB 2023-10-07T08:46:58.262 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.262 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.262 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 276.00 MB 2023-10-07T08:46:58.262 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.262 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.262 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 277.00 MB 2023-10-07T08:46:58.262 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.262 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.263 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 278.00 MB 2023-10-07T08:46:58.263 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.263 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.263 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 279.00 MB 2023-10-07T08:46:58.263 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.263 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.263 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 280.00 MB 2023-10-07T08:46:58.263 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.263 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.263 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 281.00 MB 2023-10-07T08:46:58.264 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.264 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.264 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 282.00 MB 2023-10-07T08:46:58.264 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.264 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.264 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 283.00 MB 2023-10-07T08:46:58.264 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.264 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.264 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 284.00 MB 2023-10-07T08:46:58.264 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.264 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.265 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 285.00 MB 2023-10-07T08:46:58.265 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.265 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.265 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 286.00 MB 2023-10-07T08:46:58.265 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.265 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.265 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 287.00 MB 2023-10-07T08:46:58.265 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.265 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.265 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 288.00 MB 2023-10-07T08:46:58.266 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.266 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.266 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 289.00 MB 2023-10-07T08:46:58.266 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.266 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.266 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 290.00 MB 2023-10-07T08:46:58.266 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.266 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.266 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 291.00 MB 2023-10-07T08:46:58.266 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.266 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.267 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 292.00 MB 2023-10-07T08:46:58.267 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.267 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.267 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 293.00 MB 2023-10-07T08:46:58.267 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.267 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.267 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 294.00 MB 2023-10-07T08:46:58.267 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.267 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.267 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 295.00 MB 2023-10-07T08:46:58.267 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.267 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.268 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 296.00 MB 2023-10-07T08:46:58.268 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.268 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.268 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 297.00 MB 2023-10-07T08:46:58.268 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.268 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.268 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 298.00 MB 2023-10-07T08:46:58.268 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.268 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.268 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 299.00 MB 2023-10-07T08:46:58.268 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.269 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.269 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 300.00 MB 2023-10-07T08:46:58.269 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.269 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.269 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 301.00 MB 2023-10-07T08:46:58.269 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.269 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.269 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 302.00 MB 2023-10-07T08:46:58.269 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.269 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.269 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 303.00 MB 2023-10-07T08:46:58.269 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.270 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.270 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 304.00 MB 2023-10-07T08:46:58.270 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.270 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.270 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 305.00 MB 2023-10-07T08:46:58.270 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.270 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.270 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 306.00 MB 2023-10-07T08:46:58.270 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.270 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.270 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 307.00 MB 2023-10-07T08:46:58.271 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.271 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.271 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 308.00 MB 2023-10-07T08:46:58.271 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.271 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.271 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 309.00 MB 2023-10-07T08:46:58.271 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.271 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.271 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 310.00 MB 2023-10-07T08:46:58.271 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.271 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.271 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 311.00 MB 2023-10-07T08:46:58.272 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.272 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.272 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 312.00 MB 2023-10-07T08:46:58.272 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.272 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.272 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 313.00 MB 2023-10-07T08:46:58.272 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.272 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.272 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 314.00 MB 2023-10-07T08:46:58.272 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.272 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.272 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 315.00 MB 2023-10-07T08:46:58.273 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.273 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.273 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 316.00 MB 2023-10-07T08:46:58.273 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.273 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.273 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 317.00 MB 2023-10-07T08:46:58.273 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.273 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.273 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 318.00 MB 2023-10-07T08:46:58.273 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.273 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.274 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 319.00 MB 2023-10-07T08:46:58.274 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.274 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.274 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 320.00 MB 2023-10-07T08:46:58.274 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.274 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.274 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 321.00 MB 2023-10-07T08:46:58.274 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.274 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.452 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 322.00 MB 2023-10-07T08:46:58.452 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.453 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.453 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 323.00 MB 2023-10-07T08:46:58.453 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.453 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.453 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 324.00 MB 2023-10-07T08:46:58.453 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.453 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.453 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 325.00 MB 2023-10-07T08:46:58.453 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.454 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.454 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 326.00 MB 2023-10-07T08:46:58.454 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.454 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.454 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 327.00 MB 2023-10-07T08:46:58.454 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.454 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.454 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 328.00 MB 2023-10-07T08:46:58.455 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.455 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.455 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 329.00 MB 2023-10-07T08:46:58.455 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.455 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.455 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 330.00 MB 2023-10-07T08:46:58.455 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.455 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.456 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 331.00 MB 2023-10-07T08:46:58.456 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.456 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.456 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 332.00 MB 2023-10-07T08:46:58.456 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.456 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.456 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 333.00 MB 2023-10-07T08:46:58.456 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.457 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.457 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 334.00 MB 2023-10-07T08:46:58.457 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.457 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.457 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 335.00 MB 2023-10-07T08:46:58.457 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.457 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.457 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 336.00 MB 2023-10-07T08:46:58.457 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.457 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.458 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 337.00 MB 2023-10-07T08:46:58.458 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.458 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.458 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 338.00 MB 2023-10-07T08:46:58.458 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.458 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.458 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 339.00 MB 2023-10-07T08:46:58.458 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.459 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.459 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 340.00 MB 2023-10-07T08:46:58.459 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.459 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.459 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 341.00 MB 2023-10-07T08:46:58.459 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.459 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.459 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 342.00 MB 2023-10-07T08:46:58.460 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.460 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.460 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 343.00 MB 2023-10-07T08:46:58.460 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.460 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.460 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 344.00 MB 2023-10-07T08:46:58.460 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.460 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.461 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 345.00 MB 2023-10-07T08:46:58.461 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.461 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.461 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 346.00 MB 2023-10-07T08:46:58.461 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.461 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.461 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 347.00 MB 2023-10-07T08:46:58.461 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.461 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.461 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 348.00 MB 2023-10-07T08:46:58.462 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.462 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.462 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 349.00 MB 2023-10-07T08:46:58.462 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.462 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.462 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 350.00 MB 2023-10-07T08:46:58.462 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.462 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.462 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 351.00 MB 2023-10-07T08:46:58.462 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.463 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.463 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 352.00 MB 2023-10-07T08:46:58.463 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.463 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.463 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 353.00 MB 2023-10-07T08:46:58.463 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.463 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.463 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 354.00 MB 2023-10-07T08:46:58.463 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.463 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.464 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 355.00 MB 2023-10-07T08:46:58.464 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.464 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.464 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 356.00 MB 2023-10-07T08:46:58.464 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.464 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.464 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 357.00 MB 2023-10-07T08:46:58.464 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.464 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.464 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 358.00 MB 2023-10-07T08:46:58.465 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.465 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.465 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 359.00 MB 2023-10-07T08:46:58.465 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.465 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.465 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 360.00 MB 2023-10-07T08:46:58.465 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.465 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.465 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 361.00 MB 2023-10-07T08:46:58.465 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.466 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.466 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 362.00 MB 2023-10-07T08:46:58.466 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.466 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.466 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 363.00 MB 2023-10-07T08:46:58.466 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.466 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.466 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 364.00 MB 2023-10-07T08:46:58.466 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.467 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.467 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 365.00 MB 2023-10-07T08:46:58.467 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.467 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.467 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 366.00 MB 2023-10-07T08:46:58.467 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.467 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.467 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 367.00 MB 2023-10-07T08:46:58.467 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.467 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.467 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 368.00 MB 2023-10-07T08:46:58.467 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.468 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.468 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 369.00 MB 2023-10-07T08:46:58.468 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.468 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.468 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 370.00 MB 2023-10-07T08:46:58.468 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.468 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.468 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 371.00 MB 2023-10-07T08:46:58.468 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.468 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.469 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 372.00 MB 2023-10-07T08:46:58.469 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.469 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.469 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 373.00 MB 2023-10-07T08:46:58.469 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.469 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.469 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 374.00 MB 2023-10-07T08:46:58.469 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.469 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.470 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 375.00 MB 2023-10-07T08:46:58.470 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.470 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.470 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 376.00 MB 2023-10-07T08:46:58.470 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.470 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.470 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 377.00 MB 2023-10-07T08:46:58.471 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.471 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.471 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 378.00 MB 2023-10-07T08:46:58.471 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.471 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.471 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 379.00 MB 2023-10-07T08:46:58.471 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.471 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.472 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 380.00 MB 2023-10-07T08:46:58.472 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.472 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.472 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 381.00 MB 2023-10-07T08:46:58.472 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.472 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.472 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 382.00 MB 2023-10-07T08:46:58.472 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.473 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.473 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 383.00 MB 2023-10-07T08:46:58.473 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.473 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.473 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 384.00 MB 2023-10-07T08:46:58.473 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.473 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.473 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 385.00 MB 2023-10-07T08:46:58.474 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.474 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.474 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 386.00 MB 2023-10-07T08:46:58.474 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.474 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.474 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 387.00 MB 2023-10-07T08:46:58.474 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.475 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.475 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 388.00 MB 2023-10-07T08:46:58.475 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.475 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.475 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 389.00 MB 2023-10-07T08:46:58.475 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.475 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.475 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 390.00 MB 2023-10-07T08:46:58.476 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.476 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.476 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 391.00 MB 2023-10-07T08:46:58.476 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.476 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.476 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 392.00 MB 2023-10-07T08:46:58.476 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.476 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.477 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 393.00 MB 2023-10-07T08:46:58.477 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.477 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.477 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 394.00 MB 2023-10-07T08:46:58.477 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.477 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.477 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 395.00 MB 2023-10-07T08:46:58.477 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.477 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.477 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 396.00 MB 2023-10-07T08:46:58.478 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.478 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.478 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 397.00 MB 2023-10-07T08:46:58.478 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.478 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.478 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 398.00 MB 2023-10-07T08:46:58.478 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.478 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.478 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 399.00 MB 2023-10-07T08:46:58.478 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.479 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.479 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 400.00 MB 2023-10-07T08:46:58.479 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.479 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.479 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 401.00 MB 2023-10-07T08:46:58.479 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:46:58.479 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:46:58.479 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 402.00 MB 2023-10-07T08:47:00.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:47:00.472+0000 7f43c6f32700 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-10-07T08:47:08.259 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:47:08.257+0000 7f43c6f32700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-07T08:47:25.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:47:25.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:47:28.702 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.702 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.702 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 403.00 MB 2023-10-07T08:47:28.703 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.703 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.703 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 404.00 MB 2023-10-07T08:47:28.703 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.703 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.703 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 405.00 MB 2023-10-07T08:47:28.703 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.703 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.703 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 406.00 MB 2023-10-07T08:47:28.703 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.703 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.703 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 407.00 MB 2023-10-07T08:47:28.704 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.704 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.704 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 408.00 MB 2023-10-07T08:47:28.704 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.704 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.704 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 409.00 MB 2023-10-07T08:47:28.704 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.704 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.704 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 410.00 MB 2023-10-07T08:47:28.704 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.704 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.704 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 411.00 MB 2023-10-07T08:47:28.704 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.705 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.705 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 412.00 MB 2023-10-07T08:47:28.705 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.705 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.705 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 413.00 MB 2023-10-07T08:47:28.705 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.705 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.705 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 414.00 MB 2023-10-07T08:47:28.706 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.706 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.706 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 415.00 MB 2023-10-07T08:47:28.706 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.706 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.706 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 416.00 MB 2023-10-07T08:47:28.706 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.706 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.706 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 417.00 MB 2023-10-07T08:47:28.706 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.707 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.707 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 418.00 MB 2023-10-07T08:47:28.707 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.707 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.707 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 419.00 MB 2023-10-07T08:47:28.707 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.707 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.707 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 420.00 MB 2023-10-07T08:47:28.707 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.708 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.708 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 421.00 MB 2023-10-07T08:47:28.708 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.708 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.708 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 422.00 MB 2023-10-07T08:47:28.708 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.708 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.708 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 423.00 MB 2023-10-07T08:47:28.709 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.709 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.709 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 424.00 MB 2023-10-07T08:47:28.709 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.709 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.709 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 425.00 MB 2023-10-07T08:47:28.709 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.709 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.709 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 426.00 MB 2023-10-07T08:47:28.709 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.709 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.709 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 427.00 MB 2023-10-07T08:47:28.709 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.710 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.710 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 428.00 MB 2023-10-07T08:47:28.710 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.710 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.710 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 429.00 MB 2023-10-07T08:47:28.710 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.710 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.710 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 430.00 MB 2023-10-07T08:47:28.710 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.710 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.710 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 431.00 MB 2023-10-07T08:47:28.710 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.711 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.711 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 432.00 MB 2023-10-07T08:47:28.711 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.711 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.711 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 433.00 MB 2023-10-07T08:47:28.711 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.711 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.711 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 434.00 MB 2023-10-07T08:47:28.711 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.711 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.711 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 435.00 MB 2023-10-07T08:47:28.711 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.712 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.712 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 436.00 MB 2023-10-07T08:47:28.712 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.712 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.712 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 437.00 MB 2023-10-07T08:47:28.712 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.712 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.712 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 438.00 MB 2023-10-07T08:47:28.712 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.712 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.712 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 439.00 MB 2023-10-07T08:47:28.712 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.713 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.713 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 440.00 MB 2023-10-07T08:47:28.713 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.713 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.713 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 441.00 MB 2023-10-07T08:47:28.713 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.713 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.713 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 442.00 MB 2023-10-07T08:47:28.713 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.713 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.713 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 443.00 MB 2023-10-07T08:47:28.713 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.714 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.714 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 444.00 MB 2023-10-07T08:47:28.714 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.714 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.714 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 445.00 MB 2023-10-07T08:47:28.714 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.714 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.714 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 446.00 MB 2023-10-07T08:47:28.714 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.714 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.714 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 447.00 MB 2023-10-07T08:47:28.714 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.715 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.715 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 448.00 MB 2023-10-07T08:47:28.715 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.715 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.715 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 449.00 MB 2023-10-07T08:47:28.715 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.715 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.715 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 450.00 MB 2023-10-07T08:47:28.715 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.715 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.715 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 451.00 MB 2023-10-07T08:47:28.716 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.716 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.716 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 452.00 MB 2023-10-07T08:47:28.716 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.716 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.716 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 453.00 MB 2023-10-07T08:47:28.716 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.716 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.716 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 454.00 MB 2023-10-07T08:47:28.716 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.717 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.717 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 455.00 MB 2023-10-07T08:47:28.717 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.717 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.717 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 456.00 MB 2023-10-07T08:47:28.717 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.717 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.717 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 457.00 MB 2023-10-07T08:47:28.717 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.717 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.717 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 458.00 MB 2023-10-07T08:47:28.717 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.717 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.718 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 459.00 MB 2023-10-07T08:47:28.718 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.718 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.718 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 460.00 MB 2023-10-07T08:47:28.718 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.718 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.718 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 461.00 MB 2023-10-07T08:47:28.718 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.718 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.719 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 462.00 MB 2023-10-07T08:47:28.719 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.719 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.719 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 463.00 MB 2023-10-07T08:47:28.719 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.719 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.719 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 464.00 MB 2023-10-07T08:47:28.719 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.719 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.719 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 465.00 MB 2023-10-07T08:47:28.719 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.719 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.720 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 466.00 MB 2023-10-07T08:47:28.720 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.720 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.720 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 467.00 MB 2023-10-07T08:47:28.720 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.720 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.720 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 468.00 MB 2023-10-07T08:47:28.720 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.720 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.720 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 469.00 MB 2023-10-07T08:47:28.720 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.720 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.720 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 470.00 MB 2023-10-07T08:47:28.721 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.721 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.721 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 471.00 MB 2023-10-07T08:47:28.721 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.721 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.721 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 472.00 MB 2023-10-07T08:47:28.721 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.721 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.721 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 473.00 MB 2023-10-07T08:47:28.721 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.721 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.721 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 474.00 MB 2023-10-07T08:47:28.722 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.722 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.722 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 475.00 MB 2023-10-07T08:47:28.722 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.722 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.722 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 476.00 MB 2023-10-07T08:47:28.722 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.722 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.722 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 477.00 MB 2023-10-07T08:47:28.722 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.722 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.722 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 478.00 MB 2023-10-07T08:47:28.723 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.723 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.723 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 479.00 MB 2023-10-07T08:47:28.723 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-07T08:47:28.723 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:47:28.723 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:47:28.723 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 480.00 MB 2023-10-07T08:47:28.723 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-07T08:47:28.723 INFO:teuthology.orchestra.run.smithi081.stdout:Reached fullness after 480.00 MB 2023-10-07T08:47:28.723 INFO:teuthology.orchestra.run.smithi081.stdout:calling close 2023-10-07T08:47:28.723 INFO:teuthology.orchestra.run.smithi081.stdout:close() did not raise error 2023-10-07T08:47:28.891 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:47:28.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:47:28.933 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:47:28.979 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:47:28.979 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T08:47:28.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:47:28.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T08:47:29.027 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:47:29.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:47:29.027 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T08:47:29.043 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T08:47:29.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:47:29.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T08:47:29.093 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:47:29.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:47:29.093 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T08:47:29.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:47:29.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.225+0000 7f681aab7700 1 Processor -- start 2023-10-07T08:47:29.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.225+0000 7f681aab7700 1 -- start start 2023-10-07T08:47:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f681aab7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68140aeea0 0x7f68140c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f681aab7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68140af270 0x7f68140c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f681aab7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f681406aae0 con 0x7f68140c7d00 2023-10-07T08:47:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f681aab7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6814069ed0 con 0x7f68140af270 2023-10-07T08:47:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f681aab7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681406a1b0 con 0x7f68140aeea0 2023-10-07T08:47:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f6813fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68140af270 0x7f68140c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f6819054700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f68140c7d00 0x7f68140c8140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59400/0 (socket says 172.21.15.81:59400) 2023-10-07T08:47:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f6819054700 1 -- 172.21.15.81:0/413733014 learned_addr learned my addr 172.21.15.81:0/413733014 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f6818853700 1 --2- 172.21.15.81:0/413733014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68140aeea0 0x7f68140c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f6813fff700 1 -- 172.21.15.81:0/413733014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68140aeea0 msgr2=0x7f68140c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f6813fff700 1 --2- 172.21.15.81:0/413733014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68140aeea0 0x7f68140c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f6813fff700 1 -- 172.21.15.81:0/413733014 >> v1:172.21.15.81:6789/0 conn(0x7f68140c7d00 legacy=0x7f68140c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f6813fff700 1 -- 172.21.15.81:0/413733014 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681406a490 con 0x7f68140af270 2023-10-07T08:47:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f68137fe700 1 -- 172.21.15.81:0/413733014 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372956762 0 0) 0x7f681406aae0 con 0x7f68140c7d00 2023-10-07T08:47:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f6813fff700 1 --2- 172.21.15.81:0/413733014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140af270 0x7f68140c2e60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f68000098e0 tx=0x7f68000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7a5f450620983a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f68137fe700 1 -- 172.21.15.81:0/413733014 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680000b6d0 con 0x7f68140af270 2023-10-07T08:47:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f68137fe700 1 -- 172.21.15.81:0/413733014 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680000b830 con 0x7f68140af270 2023-10-07T08:47:29.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.226+0000 7f68137fe700 1 -- 172.21.15.81:0/413733014 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680000bbd0 con 0x7f68140af270 2023-10-07T08:47:29.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.227+0000 7f681aab7700 1 -- 172.21.15.81:0/413733014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140af270 msgr2=0x7f68140c2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.227+0000 7f681aab7700 1 --2- 172.21.15.81:0/413733014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140af270 0x7f68140c2e60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f68000098e0 tx=0x7f68000091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.227+0000 7f681aab7700 1 -- 172.21.15.81:0/413733014 shutdown_connections 2023-10-07T08:47:29.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.227+0000 7f681aab7700 1 --2- 172.21.15.81:0/413733014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68140aeea0 0x7f68140c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.227+0000 7f681aab7700 1 --2- 172.21.15.81:0/413733014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140af270 0x7f68140c2e60 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.227+0000 7f681aab7700 1 -- 172.21.15.81:0/413733014 >> 172.21.15.81:0/413733014 conn(0x7f681406c660 msgr2=0x7f68140cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.227+0000 7f681aab7700 1 -- 172.21.15.81:0/413733014 shutdown_connections 2023-10-07T08:47:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.227+0000 7f681aab7700 1 -- 172.21.15.81:0/413733014 wait complete. 2023-10-07T08:47:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.228+0000 7f681aab7700 1 Processor -- start 2023-10-07T08:47:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.228+0000 7f681aab7700 1 -- start start 2023-10-07T08:47:29.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f681aab7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140aeea0 0x7f68140c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:29.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f681aab7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68140af270 0x7f68140c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:29.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f681aab7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68140c7d00 0x7f6814167440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:29.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f681aab7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68140c6980 con 0x7f68140aeea0 2023-10-07T08:47:29.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f681aab7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68140c5af0 con 0x7f68140c7d00 2023-10-07T08:47:29.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f681aab7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68140b0d00 con 0x7f68140af270 2023-10-07T08:47:29.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f6818853700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140aeea0 0x7f68140c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:29.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f6818853700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140aeea0 0x7f68140c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51832/0 (socket says 172.21.15.81:51832) 2023-10-07T08:47:29.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f6818853700 1 -- 172.21.15.81:0/3367609945 learned_addr learned my addr 172.21.15.81:0/3367609945 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:29.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f6813fff700 1 --2- 172.21.15.81:0/3367609945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68140af270 0x7f68140c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:29.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f6819054700 1 --2- 172.21.15.81:0/3367609945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68140c7d00 0x7f6814167440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:29.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f6818853700 1 -- 172.21.15.81:0/3367609945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68140af270 msgr2=0x7f68140c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f6818853700 1 --2- 172.21.15.81:0/3367609945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68140af270 0x7f68140c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f6818853700 1 -- 172.21.15.81:0/3367609945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68140c7d00 msgr2=0x7f6814167440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f6818853700 1 --2- 172.21.15.81:0/3367609945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68140c7d00 0x7f6814167440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f6818853700 1 -- 172.21.15.81:0/3367609945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6800009420 con 0x7f68140aeea0 2023-10-07T08:47:29.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f6818853700 1 --2- 172.21.15.81:0/3367609945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140aeea0 0x7f68140c6280 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6808010b40 tx=0x7f68080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:29.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.229+0000 7f6810ff9700 1 -- 172.21.15.81:0/3367609945 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680800ea00 con 0x7f68140aeea0 2023-10-07T08:47:29.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.230+0000 7f6810ff9700 1 -- 172.21.15.81:0/3367609945 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680800eb60 con 0x7f68140aeea0 2023-10-07T08:47:29.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.230+0000 7f681aab7700 1 -- 172.21.15.81:0/3367609945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68140b03d0 con 0x7f68140aeea0 2023-10-07T08:47:29.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.230+0000 7f6810ff9700 1 -- 172.21.15.81:0/3367609945 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808011450 con 0x7f68140aeea0 2023-10-07T08:47:29.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.230+0000 7f681aab7700 1 -- 172.21.15.81:0/3367609945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68140b0990 con 0x7f68140aeea0 2023-10-07T08:47:29.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.230+0000 7f681aab7700 1 -- 172.21.15.81:0/3367609945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68140b0fe0 con 0x7f68140aeea0 2023-10-07T08:47:29.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.231+0000 7f6810ff9700 1 -- 172.21.15.81:0/3367609945 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6808011800 con 0x7f68140aeea0 2023-10-07T08:47:29.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.231+0000 7f6810ff9700 1 --2- 172.21.15.81:0/3367609945 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f67f8066f30 0x7f67f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:29.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.231+0000 7f6813fff700 1 --2- 172.21.15.81:0/3367609945 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f67f8066f30 0x7f67f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:29.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.231+0000 7f6810ff9700 1 -- 172.21.15.81:0/3367609945 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6808086630 con 0x7f68140aeea0 2023-10-07T08:47:29.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.232+0000 7f6810ff9700 1 -- 172.21.15.81:0/3367609945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f67f806ea50 con 0x7f68140aeea0 2023-10-07T08:47:29.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.232+0000 7f6813fff700 1 --2- 172.21.15.81:0/3367609945 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f67f8066f30 0x7f67f80693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f68000093f0 tx=0x7f6800017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:29.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.236+0000 7f6810ff9700 1 -- 172.21.15.81:0/3367609945 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f680801e060 con 0x7f68140aeea0 2023-10-07T08:47:29.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.489+0000 7f681aab7700 1 -- 172.21.15.81:0/3367609945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68140c31b0 con 0x7f68140aeea0 2023-10-07T08:47:29.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.489+0000 7f6810ff9700 1 -- 172.21.15.81:0/3367609945 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f68080538a0 con 0x7f68140aeea0 2023-10-07T08:47:29.491 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:29.491 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/401991459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":401991459},{"type":"v1","addr":"172.21.15.89:6834","nonce":401991459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2214247931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2214247931},{"type":"v1","addr":"172.21.15.81:6836","nonce":2214247931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5620,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1168741718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1168741718},{"type":"v1","addr":"172.21.15.89:6835","nonce":1168741718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:46:47.782779+0000","modified":"2023-10-07T08:46:51.441764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6015":{"gid":6015,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2297722913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2297722913},{"type":"v1","addr":"172.21.15.81:6837","nonce":2297722913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-07T08:47:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.493+0000 7f681aab7700 1 -- 172.21.15.81:0/3367609945 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f67f8066f30 msgr2=0x7f67f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.493+0000 7f681aab7700 1 --2- 172.21.15.81:0/3367609945 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f67f8066f30 0x7f67f80693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f68000093f0 tx=0x7f6800017000 comp rx=0 tx=0).stop 2023-10-07T08:47:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.493+0000 7f681aab7700 1 -- 172.21.15.81:0/3367609945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140aeea0 msgr2=0x7f68140c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.493+0000 7f681aab7700 1 --2- 172.21.15.81:0/3367609945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140aeea0 0x7f68140c6280 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6808010b40 tx=0x7f68080091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.493+0000 7f681aab7700 1 -- 172.21.15.81:0/3367609945 shutdown_connections 2023-10-07T08:47:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.493+0000 7f681aab7700 1 --2- 172.21.15.81:0/3367609945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68140c7d00 0x7f6814167440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.493+0000 7f681aab7700 1 --2- 172.21.15.81:0/3367609945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140aeea0 0x7f68140c6280 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.493+0000 7f681aab7700 1 --2- 172.21.15.81:0/3367609945 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f67f8066f30 0x7f67f80693e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.493+0000 7f681aab7700 1 --2- 172.21.15.81:0/3367609945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68140af270 0x7f68140c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.493+0000 7f681aab7700 1 -- 172.21.15.81:0/3367609945 >> 172.21.15.81:0/3367609945 conn(0x7f681406c660 msgr2=0x7f6814156360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.493+0000 7f681aab7700 1 -- 172.21.15.81:0/3367609945 shutdown_connections 2023-10-07T08:47:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.493+0000 7f681aab7700 1 -- 172.21.15.81:0/3367609945 wait complete. 2023-10-07T08:47:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2023-10-07T08:47:29.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:47:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.641+0000 7f784e8c3700 1 Processor -- start 2023-10-07T08:47:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.641+0000 7f784e8c3700 1 -- start start 2023-10-07T08:47:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.642+0000 7f784e8c3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f784806d830 0x7f78480cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.642+0000 7f784e8c3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78480d07c0 con 0x7f78481578d0 2023-10-07T08:47:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.642+0000 7f784e8c3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78480cfbb0 con 0x7f7848157ca0 2023-10-07T08:47:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.642+0000 7f784e8c3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78480cfe90 con 0x7f784806d830 2023-10-07T08:47:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.642+0000 7f7847fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f78481578d0 0x7f784815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59410/0 (socket says 172.21.15.81:59410) 2023-10-07T08:47:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.642+0000 7f7847fff700 1 -- 172.21.15.81:0/4065383490 learned_addr learned my addr 172.21.15.81:0/4065383490 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.642+0000 7f784ce60700 1 --2- 172.21.15.81:0/4065383490 >> v2:172.21.15.89:3300/0 conn(0x7f784806d830 0x7f78480cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.642+0000 7f7846ffd700 1 -- 172.21.15.81:0/4065383490 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140435571 0 0) 0x7f78480d07c0 con 0x7f78481578d0 2023-10-07T08:47:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.642+0000 7f7846ffd700 1 -- 172.21.15.81:0/4065383490 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7830003570 con 0x7f78481578d0 2023-10-07T08:47:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.642+0000 7f784ce60700 1 -- 172.21.15.81:0/4065383490 >> v1:172.21.15.89:6789/0 conn(0x7f7848157ca0 legacy=0x7f784806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.642+0000 7f784ce60700 1 -- 172.21.15.81:0/4065383490 >> v1:172.21.15.81:6789/0 conn(0x7f78481578d0 legacy=0x7f784815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.642+0000 7f784ce60700 1 -- 172.21.15.81:0/4065383490 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78480d0170 con 0x7f784806d830 2023-10-07T08:47:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.642+0000 7f784ce60700 1 --2- 172.21.15.81:0/4065383490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f784806d830 0x7f78480cf4f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7840009e60 tx=0x7f7840009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2578ac8c152e2e34 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.643+0000 7f7846ffd700 1 -- 172.21.15.81:0/4065383490 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784000e070 con 0x7f784806d830 2023-10-07T08:47:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.643+0000 7f7846ffd700 1 -- 172.21.15.81:0/4065383490 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784000bb60 con 0x7f784806d830 2023-10-07T08:47:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.643+0000 7f7846ffd700 1 -- 172.21.15.81:0/4065383490 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840012430 con 0x7f784806d830 2023-10-07T08:47:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.643+0000 7f784e8c3700 1 -- 172.21.15.81:0/4065383490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f784806d830 msgr2=0x7f78480cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.643+0000 7f784e8c3700 1 --2- 172.21.15.81:0/4065383490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f784806d830 0x7f78480cf4f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7840009e60 tx=0x7f7840009780 comp rx=0 tx=0).stop 2023-10-07T08:47:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.643+0000 7f784e8c3700 1 -- 172.21.15.81:0/4065383490 shutdown_connections 2023-10-07T08:47:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.643+0000 7f784e8c3700 1 --2- 172.21.15.81:0/4065383490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f784806d830 0x7f78480cf4f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.643+0000 7f784e8c3700 1 -- 172.21.15.81:0/4065383490 >> 172.21.15.81:0/4065383490 conn(0x7f784806bb90 msgr2=0x7f784806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.643+0000 7f784e8c3700 1 -- 172.21.15.81:0/4065383490 shutdown_connections 2023-10-07T08:47:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.643+0000 7f784e8c3700 1 -- 172.21.15.81:0/4065383490 wait complete. 2023-10-07T08:47:29.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.644+0000 7f784e8c3700 1 Processor -- start 2023-10-07T08:47:29.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.644+0000 7f784e8c3700 1 -- start start 2023-10-07T08:47:29.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.645+0000 7f784e8c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f784806d830 0x7f78480b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:29.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.645+0000 7f784e8c3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78481578d0 0x7f78480b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:29.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.645+0000 7f784e8c3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7848157ca0 0x7f78481582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.645+0000 7f784e8c3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78480b4f90 con 0x7f78481578d0 2023-10-07T08:47:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.645+0000 7f784e8c3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7848153ec0 con 0x7f7848157ca0 2023-10-07T08:47:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.645+0000 7f784e8c3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78480b40e0 con 0x7f784806d830 2023-10-07T08:47:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.645+0000 7f78477fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78481578d0 0x7f78480b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.645+0000 7f78477fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78481578d0 0x7f78480b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51836/0 (socket says 172.21.15.81:51836) 2023-10-07T08:47:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.645+0000 7f78477fe700 1 -- 172.21.15.81:0/3261128702 learned_addr learned my addr 172.21.15.81:0/3261128702 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.645+0000 7f784ce60700 1 --2- 172.21.15.81:0/3261128702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7848157ca0 0x7f78481582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.645+0000 7f7847fff700 1 --2- 172.21.15.81:0/3261128702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f784806d830 0x7f78480b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.646+0000 7f78477fe700 1 -- 172.21.15.81:0/3261128702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f784806d830 msgr2=0x7f78480b6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.646+0000 7f78477fe700 1 --2- 172.21.15.81:0/3261128702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f784806d830 0x7f78480b6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.646+0000 7f78477fe700 1 -- 172.21.15.81:0/3261128702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7848157ca0 msgr2=0x7f78481582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.646+0000 7f78477fe700 1 --2- 172.21.15.81:0/3261128702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7848157ca0 0x7f78481582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.646+0000 7f78477fe700 1 -- 172.21.15.81:0/3261128702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7840009a20 con 0x7f78481578d0 2023-10-07T08:47:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.646+0000 7f7847fff700 1 --2- 172.21.15.81:0/3261128702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f784806d830 0x7f78480b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.646+0000 7f78477fe700 1 --2- 172.21.15.81:0/3261128702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78481578d0 0x7f78480b3ba0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c590 tx=0x7f783c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.646+0000 7f782ffff700 1 -- 172.21.15.81:0/3261128702 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c011590 con 0x7f78481578d0 2023-10-07T08:47:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.646+0000 7f782ffff700 1 -- 172.21.15.81:0/3261128702 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c011710 con 0x7f78481578d0 2023-10-07T08:47:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.646+0000 7f784e8c3700 1 -- 172.21.15.81:0/3261128702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78480b4380 con 0x7f78481578d0 2023-10-07T08:47:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.646+0000 7f782ffff700 1 -- 172.21.15.81:0/3261128702 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c011ad0 con 0x7f78481578d0 2023-10-07T08:47:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.646+0000 7f784e8c3700 1 -- 172.21.15.81:0/3261128702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78480b4940 con 0x7f78481578d0 2023-10-07T08:47:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.647+0000 7f784e8c3700 1 -- 172.21.15.81:0/3261128702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78480b5140 con 0x7f78481578d0 2023-10-07T08:47:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.647+0000 7f782ffff700 1 -- 172.21.15.81:0/3261128702 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f783c01b3b0 con 0x7f78481578d0 2023-10-07T08:47:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.647+0000 7f782ffff700 1 --2- 172.21.15.81:0/3261128702 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7834066f30 0x7f78340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.648+0000 7f782ffff700 1 -- 172.21.15.81:0/3261128702 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f783c083980 con 0x7f78481578d0 2023-10-07T08:47:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.648+0000 7f7847fff700 1 --2- 172.21.15.81:0/3261128702 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7834066f30 0x7f78340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.648+0000 7f782ffff700 1 -- 172.21.15.81:0/3261128702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f783406ea50 con 0x7f78481578d0 2023-10-07T08:47:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.648+0000 7f7847fff700 1 --2- 172.21.15.81:0/3261128702 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7834066f30 0x7f78340693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7838007fd0 tx=0x7f7838009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.652+0000 7f782ffff700 1 -- 172.21.15.81:0/3261128702 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f783c017070 con 0x7f78481578d0 2023-10-07T08:47:29.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.835+0000 7f784e8c3700 1 -- 172.21.15.81:0/3261128702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78480d0450 con 0x7f78481578d0 2023-10-07T08:47:29.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.836+0000 7f782ffff700 1 -- 172.21.15.81:0/3261128702 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+15348 (secure 0 0 0) 0x7f78480b5140 con 0x7f78481578d0 2023-10-07T08:47:29.837 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:29.838 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":88,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:47:04.259836+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:46:45.595534+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-07T08:46:46.747683+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:47:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.838+0000 7f784e8c3700 1 -- 172.21.15.81:0/3261128702 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7834066f30 msgr2=0x7f78340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.838+0000 7f784e8c3700 1 --2- 172.21.15.81:0/3261128702 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7834066f30 0x7f78340693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7838007fd0 tx=0x7f7838009040 comp rx=0 tx=0).stop 2023-10-07T08:47:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.838+0000 7f784e8c3700 1 -- 172.21.15.81:0/3261128702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78481578d0 msgr2=0x7f78480b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.838+0000 7f784e8c3700 1 --2- 172.21.15.81:0/3261128702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78481578d0 0x7f78480b3ba0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c590 tx=0x7f783c007f50 comp rx=0 tx=0).stop 2023-10-07T08:47:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.838+0000 7f784e8c3700 1 -- 172.21.15.81:0/3261128702 shutdown_connections 2023-10-07T08:47:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.838+0000 7f784e8c3700 1 --2- 172.21.15.81:0/3261128702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7848157ca0 0x7f78481582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.838+0000 7f784e8c3700 1 --2- 172.21.15.81:0/3261128702 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7834066f30 0x7f78340693e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.838+0000 7f784e8c3700 1 --2- 172.21.15.81:0/3261128702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f784806d830 0x7f78480b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.838+0000 7f784e8c3700 1 --2- 172.21.15.81:0/3261128702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78481578d0 0x7f78480b3ba0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.838+0000 7f784e8c3700 1 -- 172.21.15.81:0/3261128702 >> 172.21.15.81:0/3261128702 conn(0x7f784806bb90 msgr2=0x7f7848156730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.838+0000 7f784e8c3700 1 -- 172.21.15.81:0/3261128702 shutdown_connections 2023-10-07T08:47:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.838+0000 7f784e8c3700 1 -- 172.21.15.81:0/3261128702 wait complete. 2023-10-07T08:47:29.852 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:46:45.595534+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:46:46.747683+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:47:29.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:47:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.967+0000 7f51724ed700 1 Processor -- start 2023-10-07T08:47:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.967+0000 7f51724ed700 1 -- start start 2023-10-07T08:47:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.967+0000 7f51724ed700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f516c157ca0 0x7f516c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.967+0000 7f51724ed700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f516c0d07c0 con 0x7f516c1578d0 2023-10-07T08:47:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.967+0000 7f51724ed700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f516c0cfbb0 con 0x7f516c06d120 2023-10-07T08:47:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.967+0000 7f51724ed700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f516c0cfe90 con 0x7f516c157ca0 2023-10-07T08:47:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.968+0000 7f516b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f516c157ca0 0x7f516c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.968+0000 7f516bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f516c1578d0 0x7f516c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59414/0 (socket says 172.21.15.81:59414) 2023-10-07T08:47:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.968+0000 7f516bfff700 1 -- 172.21.15.81:0/3140776733 learned_addr learned my addr 172.21.15.81:0/3140776733 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.968+0000 7f516b7fe700 1 -- 172.21.15.81:0/3140776733 >> v1:172.21.15.89:6789/0 conn(0x7f516c06d120 legacy=0x7f516c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.968+0000 7f516b7fe700 1 -- 172.21.15.81:0/3140776733 >> v1:172.21.15.81:6789/0 conn(0x7f516c1578d0 legacy=0x7f516c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.968+0000 7f516b7fe700 1 -- 172.21.15.81:0/3140776733 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c0d0170 con 0x7f516c157ca0 2023-10-07T08:47:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.968+0000 7f516affd700 1 -- 172.21.15.81:0/3140776733 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437123139 0 0) 0x7f516c0d07c0 con 0x7f516c1578d0 2023-10-07T08:47:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.968+0000 7f516b7fe700 1 --2- 172.21.15.81:0/3140776733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c157ca0 0x7f516c0cf4f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f51600098e0 tx=0x7f51600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648ec87921dd8d5e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.968+0000 7f516affd700 1 -- 172.21.15.81:0/3140776733 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160009e80 con 0x7f516c157ca0 2023-10-07T08:47:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.968+0000 7f516affd700 1 -- 172.21.15.81:0/3140776733 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516000b860 con 0x7f516c157ca0 2023-10-07T08:47:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.968+0000 7f516affd700 1 -- 172.21.15.81:0/3140776733 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516000bbe0 con 0x7f516c157ca0 2023-10-07T08:47:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.969+0000 7f51724ed700 1 -- 172.21.15.81:0/3140776733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c157ca0 msgr2=0x7f516c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.969+0000 7f51724ed700 1 --2- 172.21.15.81:0/3140776733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c157ca0 0x7f516c0cf4f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f51600098e0 tx=0x7f51600091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.969+0000 7f51724ed700 1 -- 172.21.15.81:0/3140776733 shutdown_connections 2023-10-07T08:47:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.969+0000 7f51724ed700 1 --2- 172.21.15.81:0/3140776733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c157ca0 0x7f516c0cf4f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.969+0000 7f51724ed700 1 -- 172.21.15.81:0/3140776733 >> 172.21.15.81:0/3140776733 conn(0x7f516c06bb90 msgr2=0x7f516c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.969+0000 7f51724ed700 1 -- 172.21.15.81:0/3140776733 shutdown_connections 2023-10-07T08:47:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.969+0000 7f51724ed700 1 -- 172.21.15.81:0/3140776733 wait complete. 2023-10-07T08:47:29.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.970+0000 7f51724ed700 1 Processor -- start 2023-10-07T08:47:29.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.970+0000 7f51724ed700 1 -- start start 2023-10-07T08:47:29.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f51724ed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c06d120 0x7f516c0af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:29.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f51724ed700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f516c1578d0 0x7f516c16dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:29.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f51724ed700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f516c157ca0 0x7f516c16e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:29.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f51724ed700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c1450d0 con 0x7f516c06d120 2023-10-07T08:47:29.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f51724ed700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c0b2220 con 0x7f516c157ca0 2023-10-07T08:47:29.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f51724ed700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516c0b2500 con 0x7f516c1578d0 2023-10-07T08:47:29.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f516bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c06d120 0x7f516c0af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:29.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f516bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c06d120 0x7f516c0af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51852/0 (socket says 172.21.15.81:51852) 2023-10-07T08:47:29.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f516bfff700 1 -- 172.21.15.81:0/2095130951 learned_addr learned my addr 172.21.15.81:0/2095130951 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:29.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f516bfff700 1 -- 172.21.15.81:0/2095130951 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f516c1578d0 msgr2=0x7f516c16dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f516bfff700 1 --2- 172.21.15.81:0/2095130951 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f516c1578d0 0x7f516c16dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f516bfff700 1 -- 172.21.15.81:0/2095130951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f516c157ca0 msgr2=0x7f516c16e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:29.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f516bfff700 1 --2- 172.21.15.81:0/2095130951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f516c157ca0 0x7f516c16e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:29.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f516bfff700 1 -- 172.21.15.81:0/2095130951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5160009420 con 0x7f516c06d120 2023-10-07T08:47:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f516bfff700 1 --2- 172.21.15.81:0/2095130951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c06d120 0x7f516c0af080 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f515c00c810 tx=0x7f515c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f5153fff700 1 -- 172.21.15.81:0/2095130951 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c005c00 con 0x7f516c06d120 2023-10-07T08:47:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f5153fff700 1 -- 172.21.15.81:0/2095130951 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c005d60 con 0x7f516c06d120 2023-10-07T08:47:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f51724ed700 1 -- 172.21.15.81:0/2095130951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516c16b900 con 0x7f516c06d120 2023-10-07T08:47:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f5153fff700 1 -- 172.21.15.81:0/2095130951 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c007340 con 0x7f516c06d120 2023-10-07T08:47:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.971+0000 7f51724ed700 1 -- 172.21.15.81:0/2095130951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516c0b14f0 con 0x7f516c06d120 2023-10-07T08:47:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.972+0000 7f51724ed700 1 -- 172.21.15.81:0/2095130951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516c16be20 con 0x7f516c06d120 2023-10-07T08:47:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.972+0000 7f5153fff700 1 -- 172.21.15.81:0/2095130951 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f515c01b400 con 0x7f516c06d120 2023-10-07T08:47:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.973+0000 7f5153fff700 1 --2- 172.21.15.81:0/2095130951 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5158066f30 0x7f51580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.973+0000 7f5153fff700 1 -- 172.21.15.81:0/2095130951 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f515c083fe0 con 0x7f516c06d120 2023-10-07T08:47:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.973+0000 7f516b7fe700 1 --2- 172.21.15.81:0/2095130951 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5158066f30 0x7f51580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.973+0000 7f5153fff700 1 -- 172.21.15.81:0/2095130951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f515806ea50 con 0x7f516c06d120 2023-10-07T08:47:29.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.973+0000 7f516b7fe700 1 --2- 172.21.15.81:0/2095130951 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5158066f30 0x7f51580693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f516c1580c0 tx=0x7f5160017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:29.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:29.977+0000 7f5153fff700 1 -- 172.21.15.81:0/2095130951 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f516c16be20 con 0x7f516c06d120 2023-10-07T08:47:30.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.161+0000 7f51724ed700 1 -- 172.21.15.81:0/2095130951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f516c16be20 con 0x7f516c06d120 2023-10-07T08:47:30.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.162+0000 7f5153fff700 1 -- 172.21.15.81:0/2095130951 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f515c0512d0 con 0x7f516c06d120 2023-10-07T08:47:30.163 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:47:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.164+0000 7f51724ed700 1 -- 172.21.15.81:0/2095130951 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5158066f30 msgr2=0x7f51580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.164+0000 7f51724ed700 1 --2- 172.21.15.81:0/2095130951 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5158066f30 0x7f51580693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f516c1580c0 tx=0x7f5160017000 comp rx=0 tx=0).stop 2023-10-07T08:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.164+0000 7f51724ed700 1 -- 172.21.15.81:0/2095130951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c06d120 msgr2=0x7f516c0af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.164+0000 7f51724ed700 1 --2- 172.21.15.81:0/2095130951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c06d120 0x7f516c0af080 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f515c00c810 tx=0x7f515c007d90 comp rx=0 tx=0).stop 2023-10-07T08:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.164+0000 7f51724ed700 1 -- 172.21.15.81:0/2095130951 shutdown_connections 2023-10-07T08:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.164+0000 7f51724ed700 1 --2- 172.21.15.81:0/2095130951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f516c157ca0 0x7f516c16e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.164+0000 7f51724ed700 1 --2- 172.21.15.81:0/2095130951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c06d120 0x7f516c0af080 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.164+0000 7f51724ed700 1 --2- 172.21.15.81:0/2095130951 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5158066f30 0x7f51580693e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.164+0000 7f51724ed700 1 --2- 172.21.15.81:0/2095130951 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f516c1578d0 0x7f516c16dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.164+0000 7f51724ed700 1 -- 172.21.15.81:0/2095130951 >> 172.21.15.81:0/2095130951 conn(0x7f516c06bb90 msgr2=0x7f516c06bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.164+0000 7f51724ed700 1 -- 172.21.15.81:0/2095130951 shutdown_connections 2023-10-07T08:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.164+0000 7f51724ed700 1 -- 172.21.15.81:0/2095130951 wait complete. 2023-10-07T08:47:30.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:47:30.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.292+0000 7f658f0dc700 1 Processor -- start 2023-10-07T08:47:30.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.292+0000 7f658f0dc700 1 -- start start 2023-10-07T08:47:30.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.293+0000 7f658f0dc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f65880d0b80 0x7f65880cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.293+0000 7f658f0dc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65880d02b0 0x7f658806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.293+0000 7f658f0dc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65880cf2d0 con 0x7f65880d0f50 2023-10-07T08:47:30.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.293+0000 7f658f0dc700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658815a690 con 0x7f65880d0b80 2023-10-07T08:47:30.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.293+0000 7f658f0dc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658806dc00 con 0x7f65880d02b0 2023-10-07T08:47:30.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.293+0000 7f658e0da700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f65880d0b80 0x7f65880cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.293+0000 7f658e0da700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f65880d0b80 0x7f65880cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51862/0 (socket says 172.21.15.81:51862) 2023-10-07T08:47:30.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.293+0000 7f658e0da700 1 -- 172.21.15.81:0/661466430 learned_addr learned my addr 172.21.15.81:0/661466430 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:30.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.293+0000 7f658d8d9700 1 --2- 172.21.15.81:0/661466430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65880d02b0 0x7f658806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.293+0000 7f658e0da700 1 -- 172.21.15.81:0/661466430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65880d02b0 msgr2=0x7f658806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:30.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.293+0000 7f658e0da700 1 --2- 172.21.15.81:0/661466430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65880d02b0 0x7f658806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.293+0000 7f658e0da700 1 -- 172.21.15.81:0/661466430 >> v1:172.21.15.89:6789/0 conn(0x7f65880d0f50 legacy=0x7f658815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.293+0000 7f658e0da700 1 -- 172.21.15.81:0/661466430 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65880cf570 con 0x7f65880d0b80 2023-10-07T08:47:30.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.293+0000 7f658e0da700 1 --2- 172.21.15.81:0/661466430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65880d0b80 0x7f65880cfd70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f65840099b0 tx=0x7f6584009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a2bdd1562fd56f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:30.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.294+0000 7f658d0d8700 1 -- 172.21.15.81:0/661466430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658400b860 con 0x7f65880d0b80 2023-10-07T08:47:30.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.294+0000 7f658d0d8700 1 -- 172.21.15.81:0/661466430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658400b9c0 con 0x7f65880d0b80 2023-10-07T08:47:30.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.294+0000 7f658d0d8700 1 -- 172.21.15.81:0/661466430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658400bd60 con 0x7f65880d0b80 2023-10-07T08:47:30.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.294+0000 7f658f0dc700 1 -- 172.21.15.81:0/661466430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65880d0b80 msgr2=0x7f65880cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.294+0000 7f658f0dc700 1 --2- 172.21.15.81:0/661466430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65880d0b80 0x7f65880cfd70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f65840099b0 tx=0x7f6584009250 comp rx=0 tx=0).stop 2023-10-07T08:47:30.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.294+0000 7f658f0dc700 1 -- 172.21.15.81:0/661466430 shutdown_connections 2023-10-07T08:47:30.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.294+0000 7f658f0dc700 1 --2- 172.21.15.81:0/661466430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65880d0b80 0x7f65880cfd70 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.294+0000 7f658f0dc700 1 --2- 172.21.15.81:0/661466430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65880d02b0 0x7f658806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.294+0000 7f658f0dc700 1 -- 172.21.15.81:0/661466430 >> 172.21.15.81:0/661466430 conn(0x7f6588063230 msgr2=0x7f6588063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:30.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.294+0000 7f658f0dc700 1 -- 172.21.15.81:0/661466430 shutdown_connections 2023-10-07T08:47:30.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.294+0000 7f658f0dc700 1 -- 172.21.15.81:0/661466430 wait complete. 2023-10-07T08:47:30.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.295+0000 7f658f0dc700 1 Processor -- start 2023-10-07T08:47:30.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.295+0000 7f658f0dc700 1 -- start start 2023-10-07T08:47:30.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658f0dc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65880d02b0 0x7f658806bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658f0dc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65880d0b80 0x7f658806c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658f0dc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65880d0f50 0x7f658816a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658f0dc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6588152140 con 0x7f65880d02b0 2023-10-07T08:47:30.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658f0dc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658814f9a0 con 0x7f65880d0b80 2023-10-07T08:47:30.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658f0dc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658816ba30 con 0x7f65880d0f50 2023-10-07T08:47:30.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658e0da700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65880d02b0 0x7f658806bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658e0da700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65880d02b0 0x7f658806bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51868/0 (socket says 172.21.15.81:51868) 2023-10-07T08:47:30.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658e0da700 1 -- 172.21.15.81:0/2188764257 learned_addr learned my addr 172.21.15.81:0/2188764257 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:30.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658d8d9700 1 --2- 172.21.15.81:0/2188764257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65880d0b80 0x7f658806c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658e0da700 1 -- 172.21.15.81:0/2188764257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65880d0f50 msgr2=0x7f658816a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658e8db700 1 --2- 172.21.15.81:0/2188764257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65880d0f50 0x7f658816a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658e0da700 1 --2- 172.21.15.81:0/2188764257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65880d0f50 0x7f658816a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658e0da700 1 -- 172.21.15.81:0/2188764257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65880d0b80 msgr2=0x7f658806c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658e0da700 1 --2- 172.21.15.81:0/2188764257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65880d0b80 0x7f658806c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658e0da700 1 -- 172.21.15.81:0/2188764257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65840094f0 con 0x7f65880d02b0 2023-10-07T08:47:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.296+0000 7f658d8d9700 1 --2- 172.21.15.81:0/2188764257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65880d0b80 0x7f658806c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.297+0000 7f658e0da700 1 --2- 172.21.15.81:0/2188764257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65880d02b0 0x7f658806bc90 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f658806fcc0 tx=0x7f6584017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.297+0000 7f657e7fc700 1 -- 172.21.15.81:0/2188764257 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584024440 con 0x7f65880d02b0 2023-10-07T08:47:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.297+0000 7f657e7fc700 1 -- 172.21.15.81:0/2188764257 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65840245c0 con 0x7f65880d02b0 2023-10-07T08:47:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.297+0000 7f658f0dc700 1 -- 172.21.15.81:0/2188764257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f658816b190 con 0x7f65880d02b0 2023-10-07T08:47:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.297+0000 7f657e7fc700 1 -- 172.21.15.81:0/2188764257 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584024980 con 0x7f65880d02b0 2023-10-07T08:47:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.297+0000 7f658f0dc700 1 -- 172.21.15.81:0/2188764257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f658816b750 con 0x7f65880d02b0 2023-10-07T08:47:30.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.298+0000 7f658f0dc700 1 -- 172.21.15.81:0/2188764257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65880676e0 con 0x7f65880d02b0 2023-10-07T08:47:30.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.298+0000 7f657e7fc700 1 -- 172.21.15.81:0/2188764257 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f658401a420 con 0x7f65880d02b0 2023-10-07T08:47:30.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.298+0000 7f657e7fc700 1 --2- 172.21.15.81:0/2188764257 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f656c066f30 0x7f656c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.298+0000 7f657e7fc700 1 -- 172.21.15.81:0/2188764257 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6584086370 con 0x7f65880d02b0 2023-10-07T08:47:30.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.298+0000 7f658d8d9700 1 --2- 172.21.15.81:0/2188764257 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f656c066f30 0x7f656c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.299+0000 7f657e7fc700 1 -- 172.21.15.81:0/2188764257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f656c06ea50 con 0x7f65880d02b0 2023-10-07T08:47:30.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.299+0000 7f658d8d9700 1 --2- 172.21.15.81:0/2188764257 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f656c066f30 0x7f656c0693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f65880ce370 tx=0x7f6578008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:30.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.303+0000 7f657e7fc700 1 -- 172.21.15.81:0/2188764257 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65840535e0 con 0x7f65880d02b0 2023-10-07T08:47:30.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.483+0000 7f658f0dc700 1 -- 172.21.15.81:0/2188764257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f65880cf850 con 0x7f65880d02b0 2023-10-07T08:47:30.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.484+0000 7f657e7fc700 1 -- 172.21.15.81:0/2188764257 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6584015020 con 0x7f65880d02b0 2023-10-07T08:47:30.486 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:47:30.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.486+0000 7f658f0dc700 1 -- 172.21.15.81:0/2188764257 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f656c066f30 msgr2=0x7f656c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.486+0000 7f658f0dc700 1 --2- 172.21.15.81:0/2188764257 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f656c066f30 0x7f656c0693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f65880ce370 tx=0x7f6578008040 comp rx=0 tx=0).stop 2023-10-07T08:47:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.486+0000 7f658f0dc700 1 -- 172.21.15.81:0/2188764257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65880d02b0 msgr2=0x7f658806bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.486+0000 7f658f0dc700 1 --2- 172.21.15.81:0/2188764257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65880d02b0 0x7f658806bc90 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f658806fcc0 tx=0x7f6584017000 comp rx=0 tx=0).stop 2023-10-07T08:47:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.486+0000 7f658f0dc700 1 -- 172.21.15.81:0/2188764257 shutdown_connections 2023-10-07T08:47:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.486+0000 7f658f0dc700 1 --2- 172.21.15.81:0/2188764257 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f656c066f30 0x7f656c0693e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.486+0000 7f658f0dc700 1 --2- 172.21.15.81:0/2188764257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65880d0f50 0x7f658816a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.486+0000 7f658f0dc700 1 --2- 172.21.15.81:0/2188764257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65880d02b0 0x7f658806bc90 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.486+0000 7f658f0dc700 1 --2- 172.21.15.81:0/2188764257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65880d0b80 0x7f658806c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.486+0000 7f658f0dc700 1 -- 172.21.15.81:0/2188764257 >> 172.21.15.81:0/2188764257 conn(0x7f6588063230 msgr2=0x7f658815b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.486+0000 7f658f0dc700 1 -- 172.21.15.81:0/2188764257 shutdown_connections 2023-10-07T08:47:30.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.486+0000 7f658f0dc700 1 -- 172.21.15.81:0/2188764257 wait complete. 2023-10-07T08:47:30.499 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:47:30.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.615+0000 7f3289418700 1 Processor -- start 2023-10-07T08:47:30.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.615+0000 7f3289418700 1 -- start start 2023-10-07T08:47:30.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.616+0000 7f3289418700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f32841578d0 0x7f32840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.616+0000 7f3289418700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32840d07c0 con 0x7f328406d120 2023-10-07T08:47:30.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.616+0000 7f3289418700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32840cfbb0 con 0x7f3284157ca0 2023-10-07T08:47:30.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.616+0000 7f3289418700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32840cfe90 con 0x7f32841578d0 2023-10-07T08:47:30.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.616+0000 7f32837fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f328406d120 0x7f328406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59420/0 (socket says 172.21.15.81:59420) 2023-10-07T08:47:30.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.616+0000 7f32837fe700 1 -- 172.21.15.81:0/945311986 learned_addr learned my addr 172.21.15.81:0/945311986 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:30.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.616+0000 7f32827fc700 1 -- 172.21.15.81:0/945311986 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33940999 0 0) 0x7f32840d07c0 con 0x7f328406d120 2023-10-07T08:47:30.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.616+0000 7f32827fc700 1 -- 172.21.15.81:0/945311986 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3270003570 con 0x7f328406d120 2023-10-07T08:47:30.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.616+0000 7f3282ffd700 1 --2- 172.21.15.81:0/945311986 >> v2:172.21.15.89:3300/0 conn(0x7f32841578d0 0x7f32840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32827fc700 1 -- 172.21.15.81:0/945311986 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3633610501 0 0) 0x7f3270003570 con 0x7f328406d120 2023-10-07T08:47:30.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32827fc700 1 -- 172.21.15.81:0/945311986 >> v2:172.21.15.89:3300/0 conn(0x7f32841578d0 msgr2=0x7f32840cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:30.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32827fc700 1 --2- 172.21.15.81:0/945311986 >> v2:172.21.15.89:3300/0 conn(0x7f32841578d0 0x7f32840cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32827fc700 1 -- 172.21.15.81:0/945311986 >> v1:172.21.15.89:6789/0 conn(0x7f3284157ca0 legacy=0x7f328415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32827fc700 1 -- 172.21.15.81:0/945311986 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32840d0170 con 0x7f328406d120 2023-10-07T08:47:30.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32827fc700 1 -- 172.21.15.81:0/945311986 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f327c0017f0 con 0x7f328406d120 2023-10-07T08:47:30.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32827fc700 1 -- 172.21.15.81:0/945311986 >> v1:172.21.15.81:6789/0 conn(0x7f328406d120 legacy=0x7f328406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32827fc700 1 --2- 172.21.15.81:0/945311986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270003a60 0x7f3270003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32827fc700 1 --2- 172.21.15.81:0/945311986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3270004810 0x7f3270004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32827fc700 1 --2- 172.21.15.81:0/945311986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32700051c0 0x7f327000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32827fc700 1 -- 172.21.15.81:0/945311986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32840cfe90 con 0x7f32700051c0 2023-10-07T08:47:30.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32827fc700 1 -- 172.21.15.81:0/945311986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327000c0d0 con 0x7f3270004810 2023-10-07T08:47:30.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32827fc700 1 -- 172.21.15.81:0/945311986 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327000c290 con 0x7f3270003a60 2023-10-07T08:47:30.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32837fe700 1 --2- 172.21.15.81:0/945311986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32700051c0 0x7f327000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f3282ffd700 1 --2- 172.21.15.81:0/945311986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270003a60 0x7f3270003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f327a7fc700 1 --2- 172.21.15.81:0/945311986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3270004810 0x7f3270004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32837fe700 1 -- 172.21.15.81:0/945311986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270003a60 msgr2=0x7f3270003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:30.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32837fe700 1 --2- 172.21.15.81:0/945311986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3270003a60 0x7f3270003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32837fe700 1 -- 172.21.15.81:0/945311986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3270004810 msgr2=0x7f3270004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:30.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32837fe700 1 --2- 172.21.15.81:0/945311986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3270004810 0x7f3270004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32837fe700 1 -- 172.21.15.81:0/945311986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270003570 con 0x7f32700051c0 2023-10-07T08:47:30.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32837fe700 1 -- 172.21.15.81:0/945311986 reap_dead start 2023-10-07T08:47:30.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32837fe700 1 --2- 172.21.15.81:0/945311986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32700051c0 0x7f327000ba60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f327c00a930 tx=0x7f327c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d44d63e4f89a1e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:30.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32827fc700 1 -- 172.21.15.81:0/945311986 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c0070d0 con 0x7f32700051c0 2023-10-07T08:47:30.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32827fc700 1 -- 172.21.15.81:0/945311986 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c007230 con 0x7f32700051c0 2023-10-07T08:47:30.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.617+0000 7f32827fc700 1 -- 172.21.15.81:0/945311986 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c0075d0 con 0x7f32700051c0 2023-10-07T08:47:30.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.618+0000 7f3289418700 1 -- 172.21.15.81:0/945311986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32700051c0 msgr2=0x7f327000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.618+0000 7f3289418700 1 --2- 172.21.15.81:0/945311986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32700051c0 0x7f327000ba60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f327c00a930 tx=0x7f327c0021d0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.618+0000 7f3289418700 1 -- 172.21.15.81:0/945311986 shutdown_connections 2023-10-07T08:47:30.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.618+0000 7f3289418700 1 --2- 172.21.15.81:0/945311986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32700051c0 0x7f327000ba60 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.618+0000 7f3289418700 1 -- 172.21.15.81:0/945311986 >> 172.21.15.81:0/945311986 conn(0x7f328406bb90 msgr2=0x7f328406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:30.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.618+0000 7f3289418700 1 -- 172.21.15.81:0/945311986 shutdown_connections 2023-10-07T08:47:30.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.618+0000 7f3289418700 1 -- 172.21.15.81:0/945311986 wait complete. 2023-10-07T08:47:30.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.619+0000 7f3289418700 1 Processor -- start 2023-10-07T08:47:30.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.619+0000 7f3289418700 1 -- start start 2023-10-07T08:47:30.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.620+0000 7f3289418700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32700051c0 0x7f32841435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.620+0000 7f3289418700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32840c85f0 0x7f32840c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.620+0000 7f3289418700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32840b5ab0 0x7f32840b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.620+0000 7f3289418700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3284143ae0 con 0x7f32840b5ab0 2023-10-07T08:47:30.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.620+0000 7f3289418700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32840c8fa0 con 0x7f32840c85f0 2023-10-07T08:47:30.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.620+0000 7f3289418700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32840c69f0 con 0x7f32700051c0 2023-10-07T08:47:30.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.620+0000 7f32837fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32840b5ab0 0x7f32840b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.620+0000 7f32837fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32840b5ab0 0x7f32840b5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51896/0 (socket says 172.21.15.81:51896) 2023-10-07T08:47:30.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.620+0000 7f32837fe700 1 -- 172.21.15.81:0/648660293 learned_addr learned my addr 172.21.15.81:0/648660293 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:30.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.620+0000 7f327a7fc700 1 --2- 172.21.15.81:0/648660293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32840c85f0 0x7f32840c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.620+0000 7f3282ffd700 1 --2- 172.21.15.81:0/648660293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32700051c0 0x7f32841435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.620+0000 7f32837fe700 1 -- 172.21.15.81:0/648660293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32700051c0 msgr2=0x7f32841435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.620+0000 7f32837fe700 1 --2- 172.21.15.81:0/648660293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32700051c0 0x7f32841435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.620+0000 7f32837fe700 1 -- 172.21.15.81:0/648660293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32840c85f0 msgr2=0x7f32840c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.620+0000 7f32837fe700 1 --2- 172.21.15.81:0/648660293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32840c85f0 0x7f32840c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.620+0000 7f32837fe700 1 -- 172.21.15.81:0/648660293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32840b6460 con 0x7f32840b5ab0 2023-10-07T08:47:30.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.621+0000 7f32837fe700 1 --2- 172.21.15.81:0/648660293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32840b5ab0 0x7f32840b5f20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f327c000f80 tx=0x7f327c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:30.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.621+0000 7f327b7fe700 1 -- 172.21.15.81:0/648660293 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c001320 con 0x7f32840b5ab0 2023-10-07T08:47:30.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.621+0000 7f327b7fe700 1 -- 172.21.15.81:0/648660293 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c0075b0 con 0x7f32840b5ab0 2023-10-07T08:47:30.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.621+0000 7f3289418700 1 -- 172.21.15.81:0/648660293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32840c5de0 con 0x7f32840b5ab0 2023-10-07T08:47:30.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.621+0000 7f327b7fe700 1 -- 172.21.15.81:0/648660293 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c01d650 con 0x7f32840b5ab0 2023-10-07T08:47:30.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.621+0000 7f3289418700 1 -- 172.21.15.81:0/648660293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32840c63a0 con 0x7f32840b5ab0 2023-10-07T08:47:30.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.622+0000 7f3289418700 1 -- 172.21.15.81:0/648660293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3284067ac0 con 0x7f32840b5ab0 2023-10-07T08:47:30.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.622+0000 7f327b7fe700 1 -- 172.21.15.81:0/648660293 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f327c01da80 con 0x7f32840b5ab0 2023-10-07T08:47:30.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.623+0000 7f327b7fe700 1 --2- 172.21.15.81:0/648660293 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3264066f30 0x7f32640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.623+0000 7f327b7fe700 1 -- 172.21.15.81:0/648660293 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f327c086000 con 0x7f32840b5ab0 2023-10-07T08:47:30.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.623+0000 7f3282ffd700 1 --2- 172.21.15.81:0/648660293 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3264066f30 0x7f32640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.623+0000 7f327b7fe700 1 -- 172.21.15.81:0/648660293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f326406ea50 con 0x7f32840b5ab0 2023-10-07T08:47:30.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.623+0000 7f3282ffd700 1 --2- 172.21.15.81:0/648660293 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3264066f30 0x7f32640693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3274006f00 tx=0x7f32740091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:30.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.627+0000 7f327b7fe700 1 -- 172.21.15.81:0/648660293 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f327c053270 con 0x7f32840b5ab0 2023-10-07T08:47:30.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.805+0000 7f3289418700 1 -- 172.21.15.81:0/648660293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f32840d0450 con 0x7f32840b5ab0 2023-10-07T08:47:30.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.805+0000 7f327b7fe700 1 -- 172.21.15.81:0/648660293 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f327c056890 con 0x7f32840b5ab0 2023-10-07T08:47:30.807 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:47:30.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.807+0000 7f3289418700 1 -- 172.21.15.81:0/648660293 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3264066f30 msgr2=0x7f32640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.807+0000 7f3289418700 1 --2- 172.21.15.81:0/648660293 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3264066f30 0x7f32640693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3274006f00 tx=0x7f32740091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.807+0000 7f3289418700 1 -- 172.21.15.81:0/648660293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32840b5ab0 msgr2=0x7f32840b5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.807+0000 7f3289418700 1 --2- 172.21.15.81:0/648660293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32840b5ab0 0x7f32840b5f20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f327c000f80 tx=0x7f327c016000 comp rx=0 tx=0).stop 2023-10-07T08:47:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.807+0000 7f3289418700 1 -- 172.21.15.81:0/648660293 shutdown_connections 2023-10-07T08:47:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.807+0000 7f3289418700 1 --2- 172.21.15.81:0/648660293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32840b5ab0 0x7f32840b5f20 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.807+0000 7f3289418700 1 --2- 172.21.15.81:0/648660293 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3264066f30 0x7f32640693e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.807+0000 7f3289418700 1 --2- 172.21.15.81:0/648660293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32700051c0 0x7f32841435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.807+0000 7f3289418700 1 --2- 172.21.15.81:0/648660293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32840c85f0 0x7f32840c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.807+0000 7f3289418700 1 -- 172.21.15.81:0/648660293 >> 172.21.15.81:0/648660293 conn(0x7f328406bb90 msgr2=0x7f3284068ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.807+0000 7f3289418700 1 -- 172.21.15.81:0/648660293 shutdown_connections 2023-10-07T08:47:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.807+0000 7f3289418700 1 -- 172.21.15.81:0/648660293 wait complete. 2023-10-07T08:47:30.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:47:30.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.933+0000 7f61eda5d700 1 Processor -- start 2023-10-07T08:47:30.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.933+0000 7f61eda5d700 1 -- start start 2023-10-07T08:47:30.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.934+0000 7f61eda5d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61e8159b40 0x7f61e80cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.934+0000 7f61eda5d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61e8159f10 0x7f61e8068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.934+0000 7f61eda5d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e80cee10 con 0x7f61e80ccb40 2023-10-07T08:47:30.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.934+0000 7f61eda5d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e80cd040 con 0x7f61e8159f10 2023-10-07T08:47:30.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.934+0000 7f61eda5d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80cd320 con 0x7f61e8159b40 2023-10-07T08:47:30.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.934+0000 7f61dffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61e8159f10 0x7f61e8068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.934+0000 7f61dffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61e8159f10 0x7f61e8068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51908/0 (socket says 172.21.15.81:51908) 2023-10-07T08:47:30.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.934+0000 7f61dffff700 1 -- 172.21.15.81:0/3500384263 learned_addr learned my addr 172.21.15.81:0/3500384263 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:30.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.934+0000 7f61eca5b700 1 --2- 172.21.15.81:0/3500384263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61e8159b40 0x7f61e80cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.934+0000 7f61dffff700 1 -- 172.21.15.81:0/3500384263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61e8159b40 msgr2=0x7f61e80cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:30.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.934+0000 7f61dffff700 1 --2- 172.21.15.81:0/3500384263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61e8159b40 0x7f61e80cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.934+0000 7f61dffff700 1 -- 172.21.15.81:0/3500384263 >> v1:172.21.15.89:6789/0 conn(0x7f61e80ccb40 legacy=0x7f61e815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.934+0000 7f61dffff700 1 -- 172.21.15.81:0/3500384263 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e80ce7c0 con 0x7f61e8159f10 2023-10-07T08:47:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.935+0000 7f61dffff700 1 --2- 172.21.15.81:0/3500384263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61e8159f10 0x7f61e8068780 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f61d80099b0 tx=0x7f61d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e1ccebbf230cda server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.935+0000 7f61df7fe700 1 -- 172.21.15.81:0/3500384263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d800b860 con 0x7f61e8159f10 2023-10-07T08:47:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.935+0000 7f61df7fe700 1 -- 172.21.15.81:0/3500384263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d800b9c0 con 0x7f61e8159f10 2023-10-07T08:47:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.935+0000 7f61df7fe700 1 -- 172.21.15.81:0/3500384263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d800bd60 con 0x7f61e8159f10 2023-10-07T08:47:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.935+0000 7f61eda5d700 1 -- 172.21.15.81:0/3500384263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61e8159f10 msgr2=0x7f61e8068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.935+0000 7f61eda5d700 1 --2- 172.21.15.81:0/3500384263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61e8159f10 0x7f61e8068780 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f61d80099b0 tx=0x7f61d8009250 comp rx=0 tx=0).stop 2023-10-07T08:47:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.935+0000 7f61eda5d700 1 -- 172.21.15.81:0/3500384263 shutdown_connections 2023-10-07T08:47:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.935+0000 7f61eda5d700 1 --2- 172.21.15.81:0/3500384263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61e8159b40 0x7f61e80cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.935+0000 7f61eda5d700 1 --2- 172.21.15.81:0/3500384263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61e8159f10 0x7f61e8068780 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.935+0000 7f61eda5d700 1 -- 172.21.15.81:0/3500384263 >> 172.21.15.81:0/3500384263 conn(0x7f61e80cd660 msgr2=0x7f61e80cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:30.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.935+0000 7f61eda5d700 1 -- 172.21.15.81:0/3500384263 shutdown_connections 2023-10-07T08:47:30.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.935+0000 7f61eda5d700 1 -- 172.21.15.81:0/3500384263 wait complete. 2023-10-07T08:47:30.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.936+0000 7f61eda5d700 1 Processor -- start 2023-10-07T08:47:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.937+0000 7f61eda5d700 1 -- start start 2023-10-07T08:47:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.937+0000 7f61eda5d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61e80ccb40 0x7f61e81548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.937+0000 7f61eda5d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61e8159b40 0x7f61e815a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.937+0000 7f61eda5d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61e8159f10 0x7f61e80c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.937+0000 7f61eda5d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e816a8e0 con 0x7f61e8159f10 2023-10-07T08:47:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.937+0000 7f61eda5d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e816ab90 con 0x7f61e8159b40 2023-10-07T08:47:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.937+0000 7f61eda5d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80caaa0 con 0x7f61e80ccb40 2023-10-07T08:47:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.937+0000 7f61ed25c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61e8159f10 0x7f61e80c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.937+0000 7f61ed25c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61e8159f10 0x7f61e80c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51922/0 (socket says 172.21.15.81:51922) 2023-10-07T08:47:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.937+0000 7f61ed25c700 1 -- 172.21.15.81:0/3352869808 learned_addr learned my addr 172.21.15.81:0/3352869808 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.938+0000 7f61dffff700 1 --2- 172.21.15.81:0/3352869808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61e8159b40 0x7f61e815a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.938+0000 7f61eca5b700 1 --2- 172.21.15.81:0/3352869808 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61e80ccb40 0x7f61e81548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.938+0000 7f61ed25c700 1 -- 172.21.15.81:0/3352869808 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61e80ccb40 msgr2=0x7f61e81548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.938+0000 7f61ed25c700 1 --2- 172.21.15.81:0/3352869808 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61e80ccb40 0x7f61e81548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.938+0000 7f61ed25c700 1 -- 172.21.15.81:0/3352869808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61e8159b40 msgr2=0x7f61e815a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.938+0000 7f61ed25c700 1 --2- 172.21.15.81:0/3352869808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61e8159b40 0x7f61e815a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.938+0000 7f61ed25c700 1 -- 172.21.15.81:0/3352869808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d80094f0 con 0x7f61e8159f10 2023-10-07T08:47:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.938+0000 7f61ed25c700 1 --2- 172.21.15.81:0/3352869808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61e8159f10 0x7f61e80c85a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f61e000c8e0 tx=0x7f61e0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.938+0000 7f61dcff9700 1 -- 172.21.15.81:0/3352869808 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000ce80 con 0x7f61e8159f10 2023-10-07T08:47:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.938+0000 7f61dcff9700 1 -- 172.21.15.81:0/3352869808 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e000a7e0 con 0x7f61e8159f10 2023-10-07T08:47:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.938+0000 7f61eda5d700 1 -- 172.21.15.81:0/3352869808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e80c9410 con 0x7f61e8159f10 2023-10-07T08:47:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.938+0000 7f61dcff9700 1 -- 172.21.15.81:0/3352869808 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000ab80 con 0x7f61e8159f10 2023-10-07T08:47:30.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.938+0000 7f61eda5d700 1 -- 172.21.15.81:0/3352869808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e80c99d0 con 0x7f61e8159f10 2023-10-07T08:47:30.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.939+0000 7f61eda5d700 1 -- 172.21.15.81:0/3352869808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e816ad20 con 0x7f61e8159f10 2023-10-07T08:47:30.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.939+0000 7f61dcff9700 1 -- 172.21.15.81:0/3352869808 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61e0012420 con 0x7f61e8159f10 2023-10-07T08:47:30.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.940+0000 7f61dcff9700 1 --2- 172.21.15.81:0/3352869808 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f61d4066f30 0x7f61d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:30.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.940+0000 7f61dcff9700 1 -- 172.21.15.81:0/3352869808 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f61e0084830 con 0x7f61e8159f10 2023-10-07T08:47:30.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.940+0000 7f61eca5b700 1 --2- 172.21.15.81:0/3352869808 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f61d4066f30 0x7f61d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:30.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.940+0000 7f61dcff9700 1 -- 172.21.15.81:0/3352869808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f61d406ea50 con 0x7f61e8159f10 2023-10-07T08:47:30.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.940+0000 7f61eca5b700 1 --2- 172.21.15.81:0/3352869808 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f61d4066f30 0x7f61d40693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f61e4006fd0 tx=0x7f61e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:30.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:30.944+0000 7f61dcff9700 1 -- 172.21.15.81:0/3352869808 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61e0084030 con 0x7f61e8159f10 2023-10-07T08:47:31.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.165+0000 7f61eda5d700 1 -- 172.21.15.81:0/3352869808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61e80cb890 con 0x7f61e8159f10 2023-10-07T08:47:31.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.165+0000 7f61dcff9700 1 -- 172.21.15.81:0/3352869808 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f61e0084030 con 0x7f61e8159f10 2023-10-07T08:47:31.167 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:31.167 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/401991459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":401991459},{"type":"v1","addr":"172.21.15.89:6834","nonce":401991459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2214247931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2214247931},{"type":"v1","addr":"172.21.15.81:6836","nonce":2214247931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5620,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1168741718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1168741718},{"type":"v1","addr":"172.21.15.89:6835","nonce":1168741718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:46:47.782779+0000","modified":"2023-10-07T08:46:51.441764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6015":{"gid":6015,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2297722913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2297722913},{"type":"v1","addr":"172.21.15.81:6837","nonce":2297722913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-07T08:47:31.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.167+0000 7f61eda5d700 1 -- 172.21.15.81:0/3352869808 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f61d4066f30 msgr2=0x7f61d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.167+0000 7f61eda5d700 1 --2- 172.21.15.81:0/3352869808 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f61d4066f30 0x7f61d40693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f61e4006fd0 tx=0x7f61e4008040 comp rx=0 tx=0).stop 2023-10-07T08:47:31.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.167+0000 7f61eda5d700 1 -- 172.21.15.81:0/3352869808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61e8159f10 msgr2=0x7f61e80c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.167+0000 7f61eda5d700 1 --2- 172.21.15.81:0/3352869808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61e8159f10 0x7f61e80c85a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f61e000c8e0 tx=0x7f61e0001710 comp rx=0 tx=0).stop 2023-10-07T08:47:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.168+0000 7f61eda5d700 1 -- 172.21.15.81:0/3352869808 shutdown_connections 2023-10-07T08:47:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.168+0000 7f61eda5d700 1 --2- 172.21.15.81:0/3352869808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61e8159f10 0x7f61e80c85a0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.168+0000 7f61eda5d700 1 --2- 172.21.15.81:0/3352869808 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f61d4066f30 0x7f61d40693e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.168+0000 7f61eda5d700 1 --2- 172.21.15.81:0/3352869808 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61e80ccb40 0x7f61e81548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.168+0000 7f61eda5d700 1 --2- 172.21.15.81:0/3352869808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61e8159b40 0x7f61e815a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.168+0000 7f61eda5d700 1 -- 172.21.15.81:0/3352869808 >> 172.21.15.81:0/3352869808 conn(0x7f61e80cd660 msgr2=0x7f61e80cbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.168+0000 7f61eda5d700 1 -- 172.21.15.81:0/3352869808 shutdown_connections 2023-10-07T08:47:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.168+0000 7f61eda5d700 1 -- 172.21.15.81:0/3352869808 wait complete. 2023-10-07T08:47:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2023-10-07T08:47:31.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:47:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.293+0000 7fec99ffd700 1 Processor -- start 2023-10-07T08:47:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.293+0000 7fec99ffd700 1 -- start start 2023-10-07T08:47:31.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.294+0000 7fec99ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec94156420 0x7fec940cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.294+0000 7fec99ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec940c71d0 0x7fec940c7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.294+0000 7fec99ffd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec940cb880 con 0x7fec940cc250 2023-10-07T08:47:31.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.294+0000 7fec99ffd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec940c7bb0 con 0x7fec94156420 2023-10-07T08:47:31.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.294+0000 7fec99ffd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9406aa10 con 0x7fec940c71d0 2023-10-07T08:47:31.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.294+0000 7fec937fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec94156420 0x7fec940cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.294+0000 7fec937fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec94156420 0x7fec940cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51938/0 (socket says 172.21.15.81:51938) 2023-10-07T08:47:31.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.294+0000 7fec937fe700 1 -- 172.21.15.81:0/3718372484 learned_addr learned my addr 172.21.15.81:0/3718372484 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:31.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec93fff700 1 --2- 172.21.15.81:0/3718372484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec940c71d0 0x7fec940c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec937fe700 1 -- 172.21.15.81:0/3718372484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec940c71d0 msgr2=0x7fec940c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:31.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec937fe700 1 --2- 172.21.15.81:0/3718372484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec940c71d0 0x7fec940c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec937fe700 1 -- 172.21.15.81:0/3718372484 >> v1:172.21.15.89:6789/0 conn(0x7fec940cc250 legacy=0x7fec94069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:31.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec937fe700 1 -- 172.21.15.81:0/3718372484 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec940cac70 con 0x7fec94156420 2023-10-07T08:47:31.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec937fe700 1 --2- 172.21.15.81:0/3718372484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec94156420 0x7fec940cbd10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fec8400ab50 tx=0x7fec8400a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfbe40e7085b4e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:31.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec927fc700 1 -- 172.21.15.81:0/3718372484 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8400ca20 con 0x7fec94156420 2023-10-07T08:47:31.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec927fc700 1 -- 172.21.15.81:0/3718372484 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8400cb80 con 0x7fec94156420 2023-10-07T08:47:31.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec927fc700 1 -- 172.21.15.81:0/3718372484 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec840183f0 con 0x7fec94156420 2023-10-07T08:47:31.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec99ffd700 1 -- 172.21.15.81:0/3718372484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec94156420 msgr2=0x7fec940cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec99ffd700 1 --2- 172.21.15.81:0/3718372484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec94156420 0x7fec940cbd10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fec8400ab50 tx=0x7fec8400a3f0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec99ffd700 1 -- 172.21.15.81:0/3718372484 shutdown_connections 2023-10-07T08:47:31.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec99ffd700 1 --2- 172.21.15.81:0/3718372484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec940c71d0 0x7fec940c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec99ffd700 1 --2- 172.21.15.81:0/3718372484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec94156420 0x7fec940cbd10 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec99ffd700 1 -- 172.21.15.81:0/3718372484 >> 172.21.15.81:0/3718372484 conn(0x7fec9406c660 msgr2=0x7fec940cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:31.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec99ffd700 1 -- 172.21.15.81:0/3718372484 shutdown_connections 2023-10-07T08:47:31.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.295+0000 7fec99ffd700 1 -- 172.21.15.81:0/3718372484 wait complete. 2023-10-07T08:47:31.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.297+0000 7fec99ffd700 1 Processor -- start 2023-10-07T08:47:31.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.297+0000 7fec99ffd700 1 -- start start 2023-10-07T08:47:31.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.297+0000 7fec99ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec940c71d0 0x7fec94159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.297+0000 7fec99ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec940cc250 0x7fec94166060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.297+0000 7fec99ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec94156420 0x7fec94158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.297+0000 7fec99ffd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec94157220 con 0x7fec94156420 2023-10-07T08:47:31.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.297+0000 7fec99ffd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec940c5410 con 0x7fec940cc250 2023-10-07T08:47:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.297+0000 7fec99ffd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec940c56f0 con 0x7fec940c71d0 2023-10-07T08:47:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec93fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec94156420 0x7fec94158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec93fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec94156420 0x7fec94158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51954/0 (socket says 172.21.15.81:51954) 2023-10-07T08:47:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec93fff700 1 -- 172.21.15.81:0/2701347196 learned_addr learned my addr 172.21.15.81:0/2701347196 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec92ffd700 1 --2- 172.21.15.81:0/2701347196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec940cc250 0x7fec94166060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec937fe700 1 --2- 172.21.15.81:0/2701347196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec940c71d0 0x7fec94159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec93fff700 1 -- 172.21.15.81:0/2701347196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec940c71d0 msgr2=0x7fec94159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec93fff700 1 --2- 172.21.15.81:0/2701347196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec940c71d0 0x7fec94159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec93fff700 1 -- 172.21.15.81:0/2701347196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec940cc250 msgr2=0x7fec94166060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec93fff700 1 --2- 172.21.15.81:0/2701347196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec940cc250 0x7fec94166060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec93fff700 1 -- 172.21.15.81:0/2701347196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8400a690 con 0x7fec94156420 2023-10-07T08:47:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec92ffd700 1 --2- 172.21.15.81:0/2701347196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec940cc250 0x7fec94166060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:47:31.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec93fff700 1 --2- 172.21.15.81:0/2701347196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec94156420 0x7fec94158990 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00cfc0 tx=0x7fec8c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:31.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec7b7fe700 1 -- 172.21.15.81:0/2701347196 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c011070 con 0x7fec94156420 2023-10-07T08:47:31.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec7b7fe700 1 -- 172.21.15.81:0/2701347196 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c00c2e0 con 0x7fec94156420 2023-10-07T08:47:31.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec7b7fe700 1 -- 172.21.15.81:0/2701347196 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c00ed20 con 0x7fec94156420 2023-10-07T08:47:31.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec99ffd700 1 -- 172.21.15.81:0/2701347196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec940c59d0 con 0x7fec94156420 2023-10-07T08:47:31.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.298+0000 7fec99ffd700 1 -- 172.21.15.81:0/2701347196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec94159bb0 con 0x7fec94156420 2023-10-07T08:47:31.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.299+0000 7fec99ffd700 1 -- 172.21.15.81:0/2701347196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec94067bc0 con 0x7fec94156420 2023-10-07T08:47:31.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.299+0000 7fec7b7fe700 1 -- 172.21.15.81:0/2701347196 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec8c003020 con 0x7fec94156420 2023-10-07T08:47:31.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.300+0000 7fec7b7fe700 1 --2- 172.21.15.81:0/2701347196 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fec80066f30 0x7fec800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.300+0000 7fec7b7fe700 1 -- 172.21.15.81:0/2701347196 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fec8c086730 con 0x7fec94156420 2023-10-07T08:47:31.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.300+0000 7fec937fe700 1 --2- 172.21.15.81:0/2701347196 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fec80066f30 0x7fec800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.300+0000 7fec7b7fe700 1 -- 172.21.15.81:0/2701347196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7fec8006ea50 con 0x7fec94156420 2023-10-07T08:47:31.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.300+0000 7fec937fe700 1 --2- 172.21.15.81:0/2701347196 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fec80066f30 0x7fec800693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fec8400ab50 tx=0x7fec84019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:31.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.304+0000 7fec7b7fe700 1 -- 172.21.15.81:0/2701347196 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec8c053900 con 0x7fec94156420 2023-10-07T08:47:31.313 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:47:31.312+0000 7f43c6f32700 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-10-07T08:47:31.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.323+0000 7fec7b7fe700 1 -- 172.21.15.81:0/2701347196 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(89..89 src has 1..89) v4 ==== 288+0+0 (secure 0 0 0) 0x7fec8c057cc0 con 0x7fec94156420 2023-10-07T08:47:31.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.323+0000 7fec7b7fe700 1 -- 172.21.15.81:0/2701347196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7fec8006f3a0 con 0x7fec94156420 2023-10-07T08:47:31.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.490+0000 7fec99ffd700 1 -- 172.21.15.81:0/2701347196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec940caf50 con 0x7fec94156420 2023-10-07T08:47:31.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.491+0000 7fec7b7fe700 1 -- 172.21.15.81:0/2701347196 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+15341 (secure 0 0 0) 0x7fec8c019020 con 0x7fec94156420 2023-10-07T08:47:31.493 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:31.493 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":89,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:47:31.313808+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:46:45.595534+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-07T08:46:46.747683+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:47:31.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.493+0000 7fec99ffd700 1 -- 172.21.15.81:0/2701347196 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fec80066f30 msgr2=0x7fec800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.494+0000 7fec99ffd700 1 --2- 172.21.15.81:0/2701347196 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fec80066f30 0x7fec800693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fec8400ab50 tx=0x7fec84019000 comp rx=0 tx=0).stop 2023-10-07T08:47:31.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.494+0000 7fec99ffd700 1 -- 172.21.15.81:0/2701347196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec94156420 msgr2=0x7fec94158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.494+0000 7fec99ffd700 1 --2- 172.21.15.81:0/2701347196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec94156420 0x7fec94158990 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00cfc0 tx=0x7fec8c007870 comp rx=0 tx=0).stop 2023-10-07T08:47:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.494+0000 7fec99ffd700 1 -- 172.21.15.81:0/2701347196 shutdown_connections 2023-10-07T08:47:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.494+0000 7fec99ffd700 1 --2- 172.21.15.81:0/2701347196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec94156420 0x7fec94158990 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.494+0000 7fec99ffd700 1 --2- 172.21.15.81:0/2701347196 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fec80066f30 0x7fec800693e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.494+0000 7fec99ffd700 1 --2- 172.21.15.81:0/2701347196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec940c71d0 0x7fec94159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.494+0000 7fec99ffd700 1 --2- 172.21.15.81:0/2701347196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec940cc250 0x7fec94166060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.494+0000 7fec99ffd700 1 -- 172.21.15.81:0/2701347196 >> 172.21.15.81:0/2701347196 conn(0x7fec9406c660 msgr2=0x7fec9406e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.494+0000 7fec99ffd700 1 -- 172.21.15.81:0/2701347196 shutdown_connections 2023-10-07T08:47:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.494+0000 7fec99ffd700 1 -- 172.21.15.81:0/2701347196 wait complete. 2023-10-07T08:47:31.507 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T08:47:31.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:47:31.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.620+0000 7fe1f0d3f700 1 Processor -- start 2023-10-07T08:47:31.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.620+0000 7fe1f0d3f700 1 -- start start 2023-10-07T08:47:31.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.621+0000 7fe1f0d3f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec157ca0 0x7fe1ec0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.621+0000 7fe1f0d3f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe1ec06d120 0x7fe1ec06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.621+0000 7fe1f0d3f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ec06dac0 con 0x7fe1ec1578d0 2023-10-07T08:47:31.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.621+0000 7fe1f0d3f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ec0d07c0 con 0x7fe1ec06d120 2023-10-07T08:47:31.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.621+0000 7fe1f0d3f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec0cfbb0 con 0x7fe1ec157ca0 2023-10-07T08:47:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.621+0000 7fe1e9d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec157ca0 0x7fe1ec0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.621+0000 7fe1ead9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe1ec06d120 0x7fe1ec06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.621+0000 7fe1ead9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe1ec06d120 0x7fe1ec06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:57948/0 (socket says 172.21.15.81:57948) 2023-10-07T08:47:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.621+0000 7fe1ead9d700 1 -- 172.21.15.81:0/1231379261 learned_addr learned my addr 172.21.15.81:0/1231379261 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.621+0000 7fe1ea59c700 1 --1- 172.21.15.81:0/1231379261 >> v1:172.21.15.89:6789/0 conn(0x7fe1ec1578d0 0x7fe1ec15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:54384/0 (socket says 172.21.15.81:54384) 2023-10-07T08:47:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.622+0000 7fe1ead9d700 1 -- 172.21.15.81:0/1231379261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec157ca0 msgr2=0x7fe1ec0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.622+0000 7fe1ead9d700 1 --2- 172.21.15.81:0/1231379261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec157ca0 0x7fe1ec0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.622+0000 7fe1ead9d700 1 -- 172.21.15.81:0/1231379261 >> v1:172.21.15.89:6789/0 conn(0x7fe1ec1578d0 legacy=0x7fe1ec15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.622+0000 7fe1ead9d700 1 -- 172.21.15.81:0/1231379261 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec0cfe90 con 0x7fe1ec06d120 2023-10-07T08:47:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.622+0000 7fe1e959a700 1 -- 172.21.15.81:0/1231379261 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232990017 0 0) 0x7fe1dc001110 con 0x7fe1ec1578d0 2023-10-07T08:47:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.622+0000 7fe1e9d9b700 1 --2- 172.21.15.81:0/1231379261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec157ca0 0x7fe1ec0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:47:31.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.622+0000 7fe1ead9d700 1 --2- 172.21.15.81:0/1231379261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ec06d120 0x7fe1ec06d580 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009f20 tx=0x7fe1e4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=454db1c04a6bef2f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:31.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.622+0000 7fe1e959a700 1 -- 172.21.15.81:0/1231379261 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e400e070 con 0x7fe1ec06d120 2023-10-07T08:47:31.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.622+0000 7fe1e959a700 1 -- 172.21.15.81:0/1231379261 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e400b9d0 con 0x7fe1ec06d120 2023-10-07T08:47:31.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.622+0000 7fe1e959a700 1 -- 172.21.15.81:0/1231379261 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40092e0 con 0x7fe1ec06d120 2023-10-07T08:47:31.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.622+0000 7fe1f0d3f700 1 -- 172.21.15.81:0/1231379261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ec06d120 msgr2=0x7fe1ec06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.622+0000 7fe1f0d3f700 1 --2- 172.21.15.81:0/1231379261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ec06d120 0x7fe1ec06d580 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009f20 tx=0x7fe1e4009840 comp rx=0 tx=0).stop 2023-10-07T08:47:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.622+0000 7fe1f0d3f700 1 -- 172.21.15.81:0/1231379261 shutdown_connections 2023-10-07T08:47:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.622+0000 7fe1f0d3f700 1 --2- 172.21.15.81:0/1231379261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ec06d120 0x7fe1ec06d580 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.622+0000 7fe1f0d3f700 1 --2- 172.21.15.81:0/1231379261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec157ca0 0x7fe1ec0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.623+0000 7fe1f0d3f700 1 -- 172.21.15.81:0/1231379261 >> 172.21.15.81:0/1231379261 conn(0x7fe1ec06bb90 msgr2=0x7fe1ec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:31.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.623+0000 7fe1f0d3f700 1 -- 172.21.15.81:0/1231379261 shutdown_connections 2023-10-07T08:47:31.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.623+0000 7fe1f0d3f700 1 -- 172.21.15.81:0/1231379261 wait complete. 2023-10-07T08:47:31.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.624+0000 7fe1f0d3f700 1 Processor -- start 2023-10-07T08:47:31.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.624+0000 7fe1f0d3f700 1 -- start start 2023-10-07T08:47:31.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.624+0000 7fe1f0d3f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ec06d120 0x7fe1ec158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.624+0000 7fe1f0d3f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec1578d0 0x7fe1ec1537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.624+0000 7fe1f0d3f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ec157ca0 0x7fe1ec0b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.624+0000 7fe1f0d3f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec15cfe0 con 0x7fe1ec157ca0 2023-10-07T08:47:31.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.624+0000 7fe1f0d3f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec16a090 con 0x7fe1ec06d120 2023-10-07T08:47:31.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.624+0000 7fe1f0d3f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec158fb0 con 0x7fe1ec1578d0 2023-10-07T08:47:31.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.624+0000 7fe1ead9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ec157ca0 0x7fe1ec0b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.625+0000 7fe1ead9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ec157ca0 0x7fe1ec0b5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51960/0 (socket says 172.21.15.81:51960) 2023-10-07T08:47:31.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.625+0000 7fe1ead9d700 1 -- 172.21.15.81:0/1446786370 learned_addr learned my addr 172.21.15.81:0/1446786370 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:31.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.625+0000 7fe1e9d9b700 1 --2- 172.21.15.81:0/1446786370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec1578d0 0x7fe1ec1537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.625+0000 7fe1ea59c700 1 --2- 172.21.15.81:0/1446786370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ec06d120 0x7fe1ec158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.625+0000 7fe1ead9d700 1 -- 172.21.15.81:0/1446786370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec1578d0 msgr2=0x7fe1ec1537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.625+0000 7fe1ead9d700 1 --2- 172.21.15.81:0/1446786370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec1578d0 0x7fe1ec1537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.625+0000 7fe1ead9d700 1 -- 172.21.15.81:0/1446786370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ec06d120 msgr2=0x7fe1ec158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.625+0000 7fe1ead9d700 1 --2- 172.21.15.81:0/1446786370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ec06d120 0x7fe1ec158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.625+0000 7fe1ead9d700 1 -- 172.21.15.81:0/1446786370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e0009420 con 0x7fe1ec157ca0 2023-10-07T08:47:31.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.625+0000 7fe1ead9d700 1 --2- 172.21.15.81:0/1446786370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ec157ca0 0x7fe1ec0b5f00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec06fe20 tx=0x7fe1e4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:31.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.625+0000 7fe1da7fc700 1 -- 172.21.15.81:0/1446786370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4008ad0 con 0x7fe1ec157ca0 2023-10-07T08:47:31.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.625+0000 7fe1da7fc700 1 -- 172.21.15.81:0/1446786370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e4008c70 con 0x7fe1ec157ca0 2023-10-07T08:47:31.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.625+0000 7fe1f0d3f700 1 -- 172.21.15.81:0/1446786370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e4009ae0 con 0x7fe1ec157ca0 2023-10-07T08:47:31.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.625+0000 7fe1da7fc700 1 -- 172.21.15.81:0/1446786370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4026460 con 0x7fe1ec157ca0 2023-10-07T08:47:31.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.625+0000 7fe1f0d3f700 1 -- 172.21.15.81:0/1446786370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ec159510 con 0x7fe1ec157ca0 2023-10-07T08:47:31.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.626+0000 7fe1f0d3f700 1 -- 172.21.15.81:0/1446786370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ec067ac0 con 0x7fe1ec157ca0 2023-10-07T08:47:31.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.627+0000 7fe1da7fc700 1 -- 172.21.15.81:0/1446786370 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1e4003040 con 0x7fe1ec157ca0 2023-10-07T08:47:31.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.627+0000 7fe1da7fc700 1 --2- 172.21.15.81:0/1446786370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe1cc066f30 0x7fe1cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.627+0000 7fe1da7fc700 1 -- 172.21.15.81:0/1446786370 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe1e40863b0 con 0x7fe1ec157ca0 2023-10-07T08:47:31.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.627+0000 7fe1ea59c700 1 --2- 172.21.15.81:0/1446786370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe1cc066f30 0x7fe1cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.627+0000 7fe1da7fc700 1 -- 172.21.15.81:0/1446786370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7fe1cc06ea50 con 0x7fe1ec157ca0 2023-10-07T08:47:31.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.627+0000 7fe1ea59c700 1 --2- 172.21.15.81:0/1446786370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe1cc066f30 0x7fe1cc0693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc007fd0 tx=0x7fe1dc007b90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:31.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.631+0000 7fe1da7fc700 1 -- 172.21.15.81:0/1446786370 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1e4053620 con 0x7fe1ec157ca0 2023-10-07T08:47:31.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.857+0000 7fe1f0d3f700 1 -- 172.21.15.81:0/1446786370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1ec0d0170 con 0x7fe1ec157ca0 2023-10-07T08:47:31.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.858+0000 7fe1da7fc700 1 -- 172.21.15.81:0/1446786370 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fe1e4021020 con 0x7fe1ec157ca0 2023-10-07T08:47:31.859 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:31.859 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/401991459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":401991459},{"type":"v1","addr":"172.21.15.89:6834","nonce":401991459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2214247931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2214247931},{"type":"v1","addr":"172.21.15.81:6836","nonce":2214247931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5620,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1168741718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1168741718},{"type":"v1","addr":"172.21.15.89:6835","nonce":1168741718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:46:47.782779+0000","modified":"2023-10-07T08:46:51.441764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6015":{"gid":6015,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2297722913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2297722913},{"type":"v1","addr":"172.21.15.81:6837","nonce":2297722913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-07T08:47:31.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.860+0000 7fe1f0d3f700 1 -- 172.21.15.81:0/1446786370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe1cc066f30 msgr2=0x7fe1cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.860+0000 7fe1f0d3f700 1 --2- 172.21.15.81:0/1446786370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe1cc066f30 0x7fe1cc0693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc007fd0 tx=0x7fe1dc007b90 comp rx=0 tx=0).stop 2023-10-07T08:47:31.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.860+0000 7fe1f0d3f700 1 -- 172.21.15.81:0/1446786370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ec157ca0 msgr2=0x7fe1ec0b5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.860+0000 7fe1f0d3f700 1 --2- 172.21.15.81:0/1446786370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ec157ca0 0x7fe1ec0b5f00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec06fe20 tx=0x7fe1e4018000 comp rx=0 tx=0).stop 2023-10-07T08:47:31.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.860+0000 7fe1f0d3f700 1 -- 172.21.15.81:0/1446786370 shutdown_connections 2023-10-07T08:47:31.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.860+0000 7fe1f0d3f700 1 --2- 172.21.15.81:0/1446786370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ec157ca0 0x7fe1ec0b5f00 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.860+0000 7fe1f0d3f700 1 --2- 172.21.15.81:0/1446786370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ec06d120 0x7fe1ec158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.860+0000 7fe1f0d3f700 1 --2- 172.21.15.81:0/1446786370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe1cc066f30 0x7fe1cc0693e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.860+0000 7fe1f0d3f700 1 --2- 172.21.15.81:0/1446786370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec1578d0 0x7fe1ec1537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.860+0000 7fe1f0d3f700 1 -- 172.21.15.81:0/1446786370 >> 172.21.15.81:0/1446786370 conn(0x7fe1ec06bb90 msgr2=0x7fe1ec06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:31.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.860+0000 7fe1f0d3f700 1 -- 172.21.15.81:0/1446786370 shutdown_connections 2023-10-07T08:47:31.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.860+0000 7fe1f0d3f700 1 -- 172.21.15.81:0/1446786370 wait complete. 2023-10-07T08:47:31.864 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2023-10-07T08:47:31.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:47:31.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.985+0000 7f125c3d0700 1 Processor -- start 2023-10-07T08:47:31.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.985+0000 7f125c3d0700 1 -- start start 2023-10-07T08:47:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.986+0000 7f125c3d0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f12540ce5c0 0x7f12540aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.986+0000 7f125c3d0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12540ac570 0x7f125406e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.986+0000 7f125c3d0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125415dfb0 con 0x7f12540ce1f0 2023-10-07T08:47:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.986+0000 7f125c3d0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12540acec0 con 0x7f12540ce5c0 2023-10-07T08:47:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.986+0000 7f125c3d0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12540ad1a0 con 0x7f12540ac570 2023-10-07T08:47:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.986+0000 7f125a16c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f12540ce1f0 0x7f125415e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59424/0 (socket says 172.21.15.81:59424) 2023-10-07T08:47:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.986+0000 7f125a16c700 1 -- 172.21.15.81:0/2357465200 learned_addr learned my addr 172.21.15.81:0/2357465200 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.987+0000 7f125996b700 1 --2- 172.21.15.81:0/2357465200 >> v2:172.21.15.89:3300/0 conn(0x7f12540ce5c0 0x7f12540aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.987+0000 7f125a96d700 1 --2- 172.21.15.81:0/2357465200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12540ac570 0x7f125406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.987+0000 7f125916a700 1 -- 172.21.15.81:0/2357465200 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168329359 0 0) 0x7f125415dfb0 con 0x7f12540ce1f0 2023-10-07T08:47:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.987+0000 7f125916a700 1 -- 172.21.15.81:0/2357465200 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1240003570 con 0x7f12540ce1f0 2023-10-07T08:47:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.987+0000 7f125996b700 1 -- 172.21.15.81:0/2357465200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12540ac570 msgr2=0x7f125406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.987+0000 7f125996b700 1 --2- 172.21.15.81:0/2357465200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12540ac570 0x7f125406e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.987+0000 7f125996b700 1 -- 172.21.15.81:0/2357465200 >> v1:172.21.15.81:6789/0 conn(0x7f12540ce1f0 legacy=0x7f125415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.987+0000 7f125996b700 1 -- 172.21.15.81:0/2357465200 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125415dc40 con 0x7f12540ce5c0 2023-10-07T08:47:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.987+0000 7f125996b700 1 --2- 172.21.15.81:0/2357465200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12540ce5c0 0x7f12540aacf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f12440098e0 tx=0x7f12440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84be9953e7906057 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.987+0000 7f125916a700 1 -- 172.21.15.81:0/2357465200 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244011630 con 0x7f12540ce5c0 2023-10-07T08:47:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.987+0000 7f125916a700 1 -- 172.21.15.81:0/2357465200 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1244011790 con 0x7f12540ce5c0 2023-10-07T08:47:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.987+0000 7f125916a700 1 -- 172.21.15.81:0/2357465200 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244011b30 con 0x7f12540ce5c0 2023-10-07T08:47:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.988+0000 7f125c3d0700 1 -- 172.21.15.81:0/2357465200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12540ce5c0 msgr2=0x7f12540aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.988+0000 7f125c3d0700 1 --2- 172.21.15.81:0/2357465200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12540ce5c0 0x7f12540aacf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f12440098e0 tx=0x7f12440091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.988+0000 7f125c3d0700 1 -- 172.21.15.81:0/2357465200 shutdown_connections 2023-10-07T08:47:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.988+0000 7f125c3d0700 1 --2- 172.21.15.81:0/2357465200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12540ac570 0x7f125406e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.988+0000 7f125c3d0700 1 --2- 172.21.15.81:0/2357465200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12540ce5c0 0x7f12540aacf0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.988+0000 7f125c3d0700 1 -- 172.21.15.81:0/2357465200 >> 172.21.15.81:0/2357465200 conn(0x7f125406cca0 msgr2=0x7f125406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.988+0000 7f125c3d0700 1 -- 172.21.15.81:0/2357465200 shutdown_connections 2023-10-07T08:47:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.988+0000 7f125c3d0700 1 -- 172.21.15.81:0/2357465200 wait complete. 2023-10-07T08:47:31.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.989+0000 7f125c3d0700 1 Processor -- start 2023-10-07T08:47:31.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.989+0000 7f125c3d0700 1 -- start start 2023-10-07T08:47:31.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125c3d0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12540ac570 0x7f12540af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125c3d0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12540ce1f0 0x7f12541480c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125c3d0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12540ce5c0 0x7f1254148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125c3d0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12540ae900 con 0x7f12540ce1f0 2023-10-07T08:47:31.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125c3d0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12540ae340 con 0x7f12540ac570 2023-10-07T08:47:31.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125c3d0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12540ae620 con 0x7f12540ce5c0 2023-10-07T08:47:31.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125996b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12540ce1f0 0x7f12541480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125996b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12540ce1f0 0x7f12541480c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51972/0 (socket says 172.21.15.81:51972) 2023-10-07T08:47:31.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125996b700 1 -- 172.21.15.81:0/3121421663 learned_addr learned my addr 172.21.15.81:0/3121421663 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:31.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125a16c700 1 --2- 172.21.15.81:0/3121421663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12540ac570 0x7f12540af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125a96d700 1 --2- 172.21.15.81:0/3121421663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12540ce5c0 0x7f1254148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125996b700 1 -- 172.21.15.81:0/3121421663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12540ce5c0 msgr2=0x7f1254148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125996b700 1 --2- 172.21.15.81:0/3121421663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12540ce5c0 0x7f1254148600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125996b700 1 -- 172.21.15.81:0/3121421663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12540ac570 msgr2=0x7f12540af4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125996b700 1 --2- 172.21.15.81:0/3121421663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12540ac570 0x7f12540af4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125996b700 1 -- 172.21.15.81:0/3121421663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1244009420 con 0x7f12540ce1f0 2023-10-07T08:47:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125996b700 1 --2- 172.21.15.81:0/3121421663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12540ce1f0 0x7f12541480c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f125406cc70 tx=0x7f1244017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f124a7fc700 1 -- 172.21.15.81:0/3121421663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244011900 con 0x7f12540ce1f0 2023-10-07T08:47:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f124a7fc700 1 -- 172.21.15.81:0/3121421663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1244011a80 con 0x7f12540ce1f0 2023-10-07T08:47:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125c3d0700 1 -- 172.21.15.81:0/3121421663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125415a460 con 0x7f12540ce1f0 2023-10-07T08:47:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f124a7fc700 1 -- 172.21.15.81:0/3121421663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244025640 con 0x7f12540ce1f0 2023-10-07T08:47:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.990+0000 7f125c3d0700 1 -- 172.21.15.81:0/3121421663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125416a910 con 0x7f12540ce1f0 2023-10-07T08:47:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.991+0000 7f125c3d0700 1 -- 172.21.15.81:0/3121421663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1254068900 con 0x7f12540ce1f0 2023-10-07T08:47:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.992+0000 7f124a7fc700 1 -- 172.21.15.81:0/3121421663 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12440259b0 con 0x7f12540ce1f0 2023-10-07T08:47:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.992+0000 7f124a7fc700 1 --2- 172.21.15.81:0/3121421663 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1238066f30 0x7f12380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.992+0000 7f125a16c700 1 --2- 172.21.15.81:0/3121421663 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1238066f30 0x7f12380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:32.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.992+0000 7f124a7fc700 1 -- 172.21.15.81:0/3121421663 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1244085c90 con 0x7f12540ce1f0 2023-10-07T08:47:32.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.992+0000 7f124a7fc700 1 -- 172.21.15.81:0/3121421663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7f123806ea50 con 0x7f12540ce1f0 2023-10-07T08:47:32.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.993+0000 7f125a16c700 1 --2- 172.21.15.81:0/3121421663 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1238066f30 0x7f12380693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1250007fd0 tx=0x7f1250009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:32.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:31.996+0000 7f124a7fc700 1 -- 172.21.15.81:0/3121421663 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1244015060 con 0x7f12540ce1f0 2023-10-07T08:47:32.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.222+0000 7f125c3d0700 1 -- 172.21.15.81:0/3121421663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12540aca10 con 0x7f12540ce1f0 2023-10-07T08:47:32.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.223+0000 7f124a7fc700 1 -- 172.21.15.81:0/3121421663 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f1244052f00 con 0x7f12540ce1f0 2023-10-07T08:47:32.224 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:32.224 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/401991459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":401991459},{"type":"v1","addr":"172.21.15.89:6834","nonce":401991459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2214247931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2214247931},{"type":"v1","addr":"172.21.15.81:6836","nonce":2214247931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5620,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1168741718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1168741718},{"type":"v1","addr":"172.21.15.89:6835","nonce":1168741718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:46:47.782779+0000","modified":"2023-10-07T08:46:51.441764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6015":{"gid":6015,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2297722913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2297722913},{"type":"v1","addr":"172.21.15.81:6837","nonce":2297722913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-07T08:47:32.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.225+0000 7f125c3d0700 1 -- 172.21.15.81:0/3121421663 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1238066f30 msgr2=0x7f12380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.225+0000 7f125c3d0700 1 --2- 172.21.15.81:0/3121421663 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1238066f30 0x7f12380693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1250007fd0 tx=0x7f1250009040 comp rx=0 tx=0).stop 2023-10-07T08:47:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.225+0000 7f125c3d0700 1 -- 172.21.15.81:0/3121421663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12540ce1f0 msgr2=0x7f12541480c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.225+0000 7f125c3d0700 1 --2- 172.21.15.81:0/3121421663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12540ce1f0 0x7f12541480c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f125406cc70 tx=0x7f1244017000 comp rx=0 tx=0).stop 2023-10-07T08:47:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.225+0000 7f125c3d0700 1 -- 172.21.15.81:0/3121421663 shutdown_connections 2023-10-07T08:47:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.225+0000 7f125c3d0700 1 --2- 172.21.15.81:0/3121421663 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1238066f30 0x7f12380693e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.225+0000 7f125c3d0700 1 --2- 172.21.15.81:0/3121421663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12540ce5c0 0x7f1254148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.225+0000 7f125c3d0700 1 --2- 172.21.15.81:0/3121421663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12540ac570 0x7f12540af4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.225+0000 7f125c3d0700 1 --2- 172.21.15.81:0/3121421663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12540ce1f0 0x7f12541480c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.225+0000 7f125c3d0700 1 -- 172.21.15.81:0/3121421663 >> 172.21.15.81:0/3121421663 conn(0x7f125406cca0 msgr2=0x7f12541594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.225+0000 7f125c3d0700 1 -- 172.21.15.81:0/3121421663 shutdown_connections 2023-10-07T08:47:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.225+0000 7f125c3d0700 1 -- 172.21.15.81:0/3121421663 wait complete. 2023-10-07T08:47:32.228 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2023-10-07T08:47:32.239 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:47:32.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.352+0000 7f7e7c849700 1 Processor -- start 2023-10-07T08:47:32.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.352+0000 7f7e7c849700 1 -- start start 2023-10-07T08:47:32.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.353+0000 7f7e7c849700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7e781578d0 0x7f7e780cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:32.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.353+0000 7f7e7c849700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e78157ca0 0x7f7e7815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:32.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.353+0000 7f7e7c849700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e780d07c0 con 0x7f7e7806d120 2023-10-07T08:47:32.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.353+0000 7f7e7c849700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e780cfbb0 con 0x7f7e78157ca0 2023-10-07T08:47:32.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.353+0000 7f7e7c849700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e780cfe90 con 0x7f7e781578d0 2023-10-07T08:47:32.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.353+0000 7f7e6dd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e78157ca0 0x7f7e7815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:32.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.353+0000 7f7e6dd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e78157ca0 0x7f7e7815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35910/0 (socket says 172.21.15.81:35910) 2023-10-07T08:47:32.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.353+0000 7f7e6dd9b700 1 -- 172.21.15.81:0/3325788274 learned_addr learned my addr 172.21.15.81:0/3325788274 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:32.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.353+0000 7f7e7659c700 1 --2- 172.21.15.81:0/3325788274 >> v2:172.21.15.89:3300/0 conn(0x7f7e781578d0 0x7f7e780cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:32.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.353+0000 7f7e6dd9b700 1 -- 172.21.15.81:0/3325788274 >> v2:172.21.15.89:3300/0 conn(0x7f7e781578d0 msgr2=0x7f7e780cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:32.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.353+0000 7f7e6dd9b700 1 --2- 172.21.15.81:0/3325788274 >> v2:172.21.15.89:3300/0 conn(0x7f7e781578d0 0x7f7e780cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.353+0000 7f7e6dd9b700 1 -- 172.21.15.81:0/3325788274 >> v1:172.21.15.89:6789/0 conn(0x7f7e7806d120 legacy=0x7f7e7806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:32.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.353+0000 7f7e6dd9b700 1 -- 172.21.15.81:0/3325788274 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e780d0170 con 0x7f7e78157ca0 2023-10-07T08:47:32.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.354+0000 7f7e6dd9b700 1 --2- 172.21.15.81:0/3325788274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e78157ca0 0x7f7e7815af00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7e780646b0 tx=0x7f7e60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9347fddd69ba1d25 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:32.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.354+0000 7f7e75d9b700 1 -- 172.21.15.81:0/3325788274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6000b820 con 0x7f7e78157ca0 2023-10-07T08:47:32.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.354+0000 7f7e75d9b700 1 -- 172.21.15.81:0/3325788274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6000b980 con 0x7f7e78157ca0 2023-10-07T08:47:32.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.354+0000 7f7e75d9b700 1 -- 172.21.15.81:0/3325788274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6000bd20 con 0x7f7e78157ca0 2023-10-07T08:47:32.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.354+0000 7f7e7c849700 1 -- 172.21.15.81:0/3325788274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e78157ca0 msgr2=0x7f7e7815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:32.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.354+0000 7f7e7c849700 1 --2- 172.21.15.81:0/3325788274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e78157ca0 0x7f7e7815af00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7e780646b0 tx=0x7f7e60009250 comp rx=0 tx=0).stop 2023-10-07T08:47:32.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.354+0000 7f7e7c849700 1 -- 172.21.15.81:0/3325788274 shutdown_connections 2023-10-07T08:47:32.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.354+0000 7f7e7c849700 1 --2- 172.21.15.81:0/3325788274 >> v2:172.21.15.89:3300/0 conn(0x7f7e781578d0 0x7f7e780cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.354+0000 7f7e7c849700 1 --2- 172.21.15.81:0/3325788274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e78157ca0 0x7f7e7815af00 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.354+0000 7f7e7c849700 1 -- 172.21.15.81:0/3325788274 >> 172.21.15.81:0/3325788274 conn(0x7f7e7806bb90 msgr2=0x7f7e7806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:32.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.354+0000 7f7e7c849700 1 -- 172.21.15.81:0/3325788274 shutdown_connections 2023-10-07T08:47:32.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.354+0000 7f7e7c849700 1 -- 172.21.15.81:0/3325788274 wait complete. 2023-10-07T08:47:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.356+0000 7f7e7c849700 1 Processor -- start 2023-10-07T08:47:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.356+0000 7f7e7c849700 1 -- start start 2023-10-07T08:47:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.356+0000 7f7e7c849700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7806d120 0x7f7e780b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.356+0000 7f7e7c849700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e781578d0 0x7f7e7816a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.356+0000 7f7e7c849700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e78157ca0 0x7f7e780c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.356+0000 7f7e7c849700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7816ab20 con 0x7f7e7806d120 2023-10-07T08:47:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.356+0000 7f7e7c849700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780c8810 con 0x7f7e78157ca0 2023-10-07T08:47:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.356+0000 7f7e7c849700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780b3d20 con 0x7f7e781578d0 2023-10-07T08:47:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.356+0000 7f7e7659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7806d120 0x7f7e780b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.356+0000 7f7e7659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7806d120 0x7f7e780b6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35924/0 (socket says 172.21.15.81:35924) 2023-10-07T08:47:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.356+0000 7f7e7659c700 1 -- 172.21.15.81:0/83743700 learned_addr learned my addr 172.21.15.81:0/83743700 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.357+0000 7f7e76d9d700 1 --2- 172.21.15.81:0/83743700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e78157ca0 0x7f7e780c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.357+0000 7f7e7659c700 1 -- 172.21.15.81:0/83743700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e781578d0 msgr2=0x7f7e7816a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.357+0000 7f7e6dd9b700 1 --2- 172.21.15.81:0/83743700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e781578d0 0x7f7e7816a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.357+0000 7f7e7659c700 1 --2- 172.21.15.81:0/83743700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e781578d0 0x7f7e7816a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.357+0000 7f7e7659c700 1 -- 172.21.15.81:0/83743700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e78157ca0 msgr2=0x7f7e780c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.357+0000 7f7e7659c700 1 --2- 172.21.15.81:0/83743700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e78157ca0 0x7f7e780c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.357+0000 7f7e7659c700 1 -- 172.21.15.81:0/83743700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e600094f0 con 0x7f7e7806d120 2023-10-07T08:47:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.357+0000 7f7e7659c700 1 --2- 172.21.15.81:0/83743700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7806d120 0x7f7e780b6690 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800c880 tx=0x7f7e68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.357+0000 7f7e6effd700 1 -- 172.21.15.81:0/83743700 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68011600 con 0x7f7e7806d120 2023-10-07T08:47:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.357+0000 7f7e6effd700 1 -- 172.21.15.81:0/83743700 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e680117a0 con 0x7f7e7806d120 2023-10-07T08:47:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.357+0000 7f7e7c849700 1 -- 172.21.15.81:0/83743700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e780b4000 con 0x7f7e7806d120 2023-10-07T08:47:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.357+0000 7f7e6effd700 1 -- 172.21.15.81:0/83743700 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68011b60 con 0x7f7e7806d120 2023-10-07T08:47:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.357+0000 7f7e7c849700 1 -- 172.21.15.81:0/83743700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e780c8520 con 0x7f7e7806d120 2023-10-07T08:47:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.358+0000 7f7e7c849700 1 -- 172.21.15.81:0/83743700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e78067ac0 con 0x7f7e7806d120 2023-10-07T08:47:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.358+0000 7f7e6effd700 1 -- 172.21.15.81:0/83743700 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e68018360 con 0x7f7e7806d120 2023-10-07T08:47:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.359+0000 7f7e6effd700 1 --2- 172.21.15.81:0/83743700 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e58066f30 0x7f7e580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.359+0000 7f7e6effd700 1 -- 172.21.15.81:0/83743700 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7e68084370 con 0x7f7e7806d120 2023-10-07T08:47:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.359+0000 7f7e6dd9b700 1 --2- 172.21.15.81:0/83743700 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e58066f30 0x7f7e580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.359+0000 7f7e6effd700 1 -- 172.21.15.81:0/83743700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7f7e5806ea50 con 0x7f7e7806d120 2023-10-07T08:47:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.359+0000 7f7e6dd9b700 1 --2- 172.21.15.81:0/83743700 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e58066f30 0x7f7e580693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7e780646b0 tx=0x7f7e60016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.363+0000 7f7e6effd700 1 -- 172.21.15.81:0/83743700 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e680515e0 con 0x7f7e7806d120 2023-10-07T08:47:32.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.548+0000 7f7e7c849700 1 -- 172.21.15.81:0/83743700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e780d0450 con 0x7f7e7806d120 2023-10-07T08:47:32.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.549+0000 7f7e6effd700 1 -- 172.21.15.81:0/83743700 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+15341 (secure 0 0 0) 0x7f7e6801e020 con 0x7f7e7806d120 2023-10-07T08:47:32.550 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:32.551 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":89,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:47:31.313808+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:46:45.595534+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-07T08:46:46.747683+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:47:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.551+0000 7f7e7c849700 1 -- 172.21.15.81:0/83743700 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e58066f30 msgr2=0x7f7e580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.551+0000 7f7e7c849700 1 --2- 172.21.15.81:0/83743700 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e58066f30 0x7f7e580693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7e780646b0 tx=0x7f7e60016000 comp rx=0 tx=0).stop 2023-10-07T08:47:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.551+0000 7f7e7c849700 1 -- 172.21.15.81:0/83743700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7806d120 msgr2=0x7f7e780b6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.551+0000 7f7e7c849700 1 --2- 172.21.15.81:0/83743700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7806d120 0x7f7e780b6690 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800c880 tx=0x7f7e68008040 comp rx=0 tx=0).stop 2023-10-07T08:47:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.551+0000 7f7e7c849700 1 -- 172.21.15.81:0/83743700 shutdown_connections 2023-10-07T08:47:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.551+0000 7f7e7c849700 1 --2- 172.21.15.81:0/83743700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e78157ca0 0x7f7e780c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.551+0000 7f7e7c849700 1 --2- 172.21.15.81:0/83743700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7806d120 0x7f7e780b6690 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.551+0000 7f7e7c849700 1 --2- 172.21.15.81:0/83743700 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e58066f30 0x7f7e580693e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.551+0000 7f7e7c849700 1 --2- 172.21.15.81:0/83743700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e781578d0 0x7f7e7816a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.551+0000 7f7e7c849700 1 -- 172.21.15.81:0/83743700 >> 172.21.15.81:0/83743700 conn(0x7f7e7806bb90 msgr2=0x7f7e78154950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:32.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.551+0000 7f7e7c849700 1 -- 172.21.15.81:0/83743700 shutdown_connections 2023-10-07T08:47:32.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.551+0000 7f7e7c849700 1 -- 172.21.15.81:0/83743700 wait complete. 2023-10-07T08:47:32.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T08:47:32.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.678+0000 7fac66ef7700 1 Processor -- start 2023-10-07T08:47:32.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.678+0000 7fac66ef7700 1 -- start start 2023-10-07T08:47:32.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.679+0000 7fac66ef7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac60159b40 0x7fac600cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:32.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.679+0000 7fac66ef7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac60159f10 0x7fac60068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:32.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.679+0000 7fac66ef7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac600cee10 con 0x7fac600ccb40 2023-10-07T08:47:32.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.679+0000 7fac66ef7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac600cd040 con 0x7fac60159b40 2023-10-07T08:47:32.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.679+0000 7fac66ef7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac600cd320 con 0x7fac60159f10 2023-10-07T08:47:32.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.679+0000 7fac65ef5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac60159b40 0x7fac600cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:32.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.679+0000 7fac65ef5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac60159b40 0x7fac600cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35938/0 (socket says 172.21.15.81:35938) 2023-10-07T08:47:32.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.679+0000 7fac65ef5700 1 -- 172.21.15.81:0/3263867912 learned_addr learned my addr 172.21.15.81:0/3263867912 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:32.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.679+0000 7fac65ef5700 1 -- 172.21.15.81:0/3263867912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac60159f10 msgr2=0x7fac60068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:32.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.679+0000 7fac656f4700 1 --2- 172.21.15.81:0/3263867912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac60159f10 0x7fac60068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.679+0000 7fac65ef5700 1 --2- 172.21.15.81:0/3263867912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac60159f10 0x7fac60068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.679+0000 7fac65ef5700 1 -- 172.21.15.81:0/3263867912 >> v1:172.21.15.89:6789/0 conn(0x7fac600ccb40 legacy=0x7fac6015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.679+0000 7fac65ef5700 1 -- 172.21.15.81:0/3263867912 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac600ce7c0 con 0x7fac60159b40 2023-10-07T08:47:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.680+0000 7fac65ef5700 1 --2- 172.21.15.81:0/3263867912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac60159b40 0x7fac600cc600 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fac58009f20 tx=0x7fac58009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8faab6dfe3246da server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.680+0000 7fac64ef3700 1 -- 172.21.15.81:0/3263867912 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5800e070 con 0x7fac60159b40 2023-10-07T08:47:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.680+0000 7fac64ef3700 1 -- 172.21.15.81:0/3263867912 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5800ba40 con 0x7fac60159b40 2023-10-07T08:47:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.680+0000 7fac64ef3700 1 -- 172.21.15.81:0/3263867912 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac580092e0 con 0x7fac60159b40 2023-10-07T08:47:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.680+0000 7fac66ef7700 1 -- 172.21.15.81:0/3263867912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac60159b40 msgr2=0x7fac600cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.680+0000 7fac66ef7700 1 --2- 172.21.15.81:0/3263867912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac60159b40 0x7fac600cc600 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fac58009f20 tx=0x7fac58009840 comp rx=0 tx=0).stop 2023-10-07T08:47:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.680+0000 7fac66ef7700 1 -- 172.21.15.81:0/3263867912 shutdown_connections 2023-10-07T08:47:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.680+0000 7fac66ef7700 1 --2- 172.21.15.81:0/3263867912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac60159b40 0x7fac600cc600 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.680+0000 7fac66ef7700 1 --2- 172.21.15.81:0/3263867912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac60159f10 0x7fac60068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.680+0000 7fac66ef7700 1 -- 172.21.15.81:0/3263867912 >> 172.21.15.81:0/3263867912 conn(0x7fac600cd660 msgr2=0x7fac600cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.680+0000 7fac66ef7700 1 -- 172.21.15.81:0/3263867912 shutdown_connections 2023-10-07T08:47:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.680+0000 7fac66ef7700 1 -- 172.21.15.81:0/3263867912 wait complete. 2023-10-07T08:47:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.681+0000 7fac66ef7700 1 Processor -- start 2023-10-07T08:47:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.681+0000 7fac66ef7700 1 -- start start 2023-10-07T08:47:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.682+0000 7fac66ef7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac600ccb40 0x7fac600c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.682+0000 7fac66ef7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac60159b40 0x7fac60155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.682+0000 7fac66ef7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac60159f10 0x7fac601575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.682+0000 7fac66ef7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6015a8e0 con 0x7fac60159b40 2023-10-07T08:47:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.682+0000 7fac66ef7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac600c9410 con 0x7fac60159f10 2023-10-07T08:47:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.682+0000 7fac66ef7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac600c96f0 con 0x7fac600ccb40 2023-10-07T08:47:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.682+0000 7fac656f4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac60159b40 0x7fac60155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.682+0000 7fac656f4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac60159b40 0x7fac60155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35944/0 (socket says 172.21.15.81:35944) 2023-10-07T08:47:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.682+0000 7fac656f4700 1 -- 172.21.15.81:0/4159958904 learned_addr learned my addr 172.21.15.81:0/4159958904 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.682+0000 7fac65ef5700 1 --2- 172.21.15.81:0/4159958904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac600ccb40 0x7fac600c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.682+0000 7fac656f4700 1 -- 172.21.15.81:0/4159958904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac600ccb40 msgr2=0x7fac600c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.682+0000 7fac656f4700 1 --2- 172.21.15.81:0/4159958904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac600ccb40 0x7fac600c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.682+0000 7fac656f4700 1 -- 172.21.15.81:0/4159958904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac60159f10 msgr2=0x7fac601575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.682+0000 7fac666f6700 1 --2- 172.21.15.81:0/4159958904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac60159f10 0x7fac601575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.683+0000 7fac656f4700 1 --2- 172.21.15.81:0/4159958904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac60159f10 0x7fac601575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.683+0000 7fac656f4700 1 -- 172.21.15.81:0/4159958904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac58009ae0 con 0x7fac60159b40 2023-10-07T08:47:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.683+0000 7fac666f6700 1 --2- 172.21.15.81:0/4159958904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac60159f10 0x7fac601575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.683+0000 7fac656f4700 1 --2- 172.21.15.81:0/4159958904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac60159b40 0x7fac60155be0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fac5000c880 tx=0x7fac50008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:32.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.683+0000 7fac55ffb700 1 -- 172.21.15.81:0/4159958904 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50011600 con 0x7fac60159b40 2023-10-07T08:47:32.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.683+0000 7fac55ffb700 1 -- 172.21.15.81:0/4159958904 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac50011760 con 0x7fac60159b40 2023-10-07T08:47:32.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.683+0000 7fac66ef7700 1 -- 172.21.15.81:0/4159958904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac600c99d0 con 0x7fac60159b40 2023-10-07T08:47:32.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.683+0000 7fac55ffb700 1 -- 172.21.15.81:0/4159958904 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50011b20 con 0x7fac60159b40 2023-10-07T08:47:32.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.683+0000 7fac66ef7700 1 -- 172.21.15.81:0/4159958904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac60156120 con 0x7fac60159b40 2023-10-07T08:47:32.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.684+0000 7fac66ef7700 1 -- 172.21.15.81:0/4159958904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac600cc0e0 con 0x7fac60159b40 2023-10-07T08:47:32.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.684+0000 7fac55ffb700 1 -- 172.21.15.81:0/4159958904 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac500223a0 con 0x7fac60159b40 2023-10-07T08:47:32.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.684+0000 7fac55ffb700 1 --2- 172.21.15.81:0/4159958904 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fac44066f30 0x7fac440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:32.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.685+0000 7fac55ffb700 1 -- 172.21.15.81:0/4159958904 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fac50084580 con 0x7fac60159b40 2023-10-07T08:47:32.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.685+0000 7fac65ef5700 1 --2- 172.21.15.81:0/4159958904 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fac44066f30 0x7fac440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:32.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.685+0000 7fac55ffb700 1 -- 172.21.15.81:0/4159958904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7fac4406ea50 con 0x7fac60159b40 2023-10-07T08:47:32.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.685+0000 7fac65ef5700 1 --2- 172.21.15.81:0/4159958904 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fac44066f30 0x7fac440693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fac58009ab0 tx=0x7fac58017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.689+0000 7fac55ffb700 1 -- 172.21.15.81:0/4159958904 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac500517f0 con 0x7fac60159b40 2023-10-07T08:47:32.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.912+0000 7fac66ef7700 1 -- 172.21.15.81:0/4159958904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fac600ceaa0 con 0x7fac60159b40 2023-10-07T08:47:32.914 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:47:32.913+0000 7f43c472d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T08:47:32.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.914+0000 7fac55ffb700 1 -- 172.21.15.81:0/4159958904 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(90..90 src has 1..90) v4 ==== 366+0+0 (secure 0 0 0) 0x7fac500554b0 con 0x7fac60159b40 2023-10-07T08:47:32.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.914+0000 7fac55ffb700 1 -- 172.21.15.81:0/4159958904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=91}) v3 -- 0x7fac4406f340 con 0x7fac60159b40 2023-10-07T08:47:32.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.917+0000 7fac55ffb700 1 -- 172.21.15.81:0/4159958904 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7fac50015020 con 0x7fac60159b40 2023-10-07T08:47:32.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.920+0000 7fac66ef7700 1 -- 172.21.15.81:0/4159958904 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fac44066f30 msgr2=0x7fac440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:32.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.920+0000 7fac66ef7700 1 --2- 172.21.15.81:0/4159958904 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fac44066f30 0x7fac440693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fac58009ab0 tx=0x7fac58017000 comp rx=0 tx=0).stop 2023-10-07T08:47:32.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.920+0000 7fac66ef7700 1 -- 172.21.15.81:0/4159958904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac60159b40 msgr2=0x7fac60155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:32.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.920+0000 7fac66ef7700 1 --2- 172.21.15.81:0/4159958904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac60159b40 0x7fac60155be0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fac5000c880 tx=0x7fac50008040 comp rx=0 tx=0).stop 2023-10-07T08:47:32.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.920+0000 7fac66ef7700 1 -- 172.21.15.81:0/4159958904 shutdown_connections 2023-10-07T08:47:32.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.920+0000 7fac66ef7700 1 --2- 172.21.15.81:0/4159958904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac60159f10 0x7fac601575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.920+0000 7fac66ef7700 1 --2- 172.21.15.81:0/4159958904 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fac44066f30 0x7fac440693e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.920+0000 7fac66ef7700 1 --2- 172.21.15.81:0/4159958904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac600ccb40 0x7fac600c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.920+0000 7fac66ef7700 1 --2- 172.21.15.81:0/4159958904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac60159b40 0x7fac60155be0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:32.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.920+0000 7fac66ef7700 1 -- 172.21.15.81:0/4159958904 >> 172.21.15.81:0/4159958904 conn(0x7fac600cd660 msgr2=0x7fac600b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:32.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.920+0000 7fac66ef7700 1 -- 172.21.15.81:0/4159958904 shutdown_connections 2023-10-07T08:47:32.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:32.920+0000 7fac66ef7700 1 -- 172.21.15.81:0/4159958904 wait complete. 2023-10-07T08:47:32.922 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T08:47:32.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T08:47:32.952 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-07T08:47:33.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.049+0000 7f79319de700 1 Processor -- start 2023-10-07T08:47:33.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.049+0000 7f79319de700 1 -- start start 2023-10-07T08:47:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.050+0000 7f79319de700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f792c15af90 0x7f792c06f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.050+0000 7f79319de700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f792c06dd50 0x7f792c06cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.050+0000 7f79319de700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792c0ab4a0 con 0x7f792c06d0e0 2023-10-07T08:47:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.050+0000 7f79319de700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792c06d580 con 0x7f792c06dd50 2023-10-07T08:47:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.050+0000 7f79319de700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c15b360 con 0x7f792c15af90 2023-10-07T08:47:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.050+0000 7f792a7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f792c06dd50 0x7f792c06cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.050+0000 7f792a7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f792c06dd50 0x7f792c06cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35952/0 (socket says 172.21.15.81:35952) 2023-10-07T08:47:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.050+0000 7f792a7fc700 1 -- 172.21.15.81:0/2267107577 learned_addr learned my addr 172.21.15.81:0/2267107577 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.050+0000 7f792affd700 1 --2- 172.21.15.81:0/2267107577 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f792c15af90 0x7f792c06f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.050+0000 7f792a7fc700 1 -- 172.21.15.81:0/2267107577 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f792c15af90 msgr2=0x7f792c06f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.050+0000 7f792a7fc700 1 --2- 172.21.15.81:0/2267107577 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f792c15af90 0x7f792c06f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.050+0000 7f792a7fc700 1 -- 172.21.15.81:0/2267107577 >> v1:172.21.15.89:6789/0 conn(0x7f792c06d0e0 legacy=0x7f792c0cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.050+0000 7f792a7fc700 1 -- 172.21.15.81:0/2267107577 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c0aa890 con 0x7f792c06dd50 2023-10-07T08:47:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.051+0000 7f792a7fc700 1 --2- 172.21.15.81:0/2267107577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c06dd50 0x7f792c06cba0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f79200099e0 tx=0x7f7920009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5588084155b690 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.051+0000 7f7929ffb700 1 -- 172.21.15.81:0/2267107577 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792000b820 con 0x7f792c06dd50 2023-10-07T08:47:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.051+0000 7f7929ffb700 1 -- 172.21.15.81:0/2267107577 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792000b980 con 0x7f792c06dd50 2023-10-07T08:47:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.051+0000 7f7929ffb700 1 -- 172.21.15.81:0/2267107577 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792000bd20 con 0x7f792c06dd50 2023-10-07T08:47:33.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.051+0000 7f79319de700 1 -- 172.21.15.81:0/2267107577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c06dd50 msgr2=0x7f792c06cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:33.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.051+0000 7f79319de700 1 --2- 172.21.15.81:0/2267107577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c06dd50 0x7f792c06cba0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f79200099e0 tx=0x7f7920009250 comp rx=0 tx=0).stop 2023-10-07T08:47:33.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.051+0000 7f79319de700 1 -- 172.21.15.81:0/2267107577 shutdown_connections 2023-10-07T08:47:33.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.051+0000 7f79319de700 1 --2- 172.21.15.81:0/2267107577 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f792c15af90 0x7f792c06f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:33.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.051+0000 7f79319de700 1 --2- 172.21.15.81:0/2267107577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c06dd50 0x7f792c06cba0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:33.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.051+0000 7f79319de700 1 -- 172.21.15.81:0/2267107577 >> 172.21.15.81:0/2267107577 conn(0x7f792c0c9ac0 msgr2=0x7f792c0c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:33.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.051+0000 7f79319de700 1 -- 172.21.15.81:0/2267107577 shutdown_connections 2023-10-07T08:47:33.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.051+0000 7f79319de700 1 -- 172.21.15.81:0/2267107577 wait complete. 2023-10-07T08:47:33.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.053+0000 7f79319de700 1 Processor -- start 2023-10-07T08:47:33.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.053+0000 7f79319de700 1 -- start start 2023-10-07T08:47:33.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.053+0000 7f79319de700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c06d0e0 0x7f792c0b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:33.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.053+0000 7f79319de700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f792c06dd50 0x7f792c16a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:33.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.053+0000 7f79319de700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f792c15af90 0x7f792c1522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:33.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.053+0000 7f79319de700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c16dee0 con 0x7f792c06d0e0 2023-10-07T08:47:33.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.053+0000 7f79319de700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c16e1c0 con 0x7f792c06dd50 2023-10-07T08:47:33.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.053+0000 7f79319de700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c16b180 con 0x7f792c15af90 2023-10-07T08:47:33.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.053+0000 7f792affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c06d0e0 0x7f792c0b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:33.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.053+0000 7f792affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c06d0e0 0x7f792c0b1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35966/0 (socket says 172.21.15.81:35966) 2023-10-07T08:47:33.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.053+0000 7f792affd700 1 -- 172.21.15.81:0/1843029645 learned_addr learned my addr 172.21.15.81:0/1843029645 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:33.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.054+0000 7f792affd700 1 -- 172.21.15.81:0/1843029645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f792c15af90 msgr2=0x7f792c1522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:33.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.054+0000 7f792affd700 1 --2- 172.21.15.81:0/1843029645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f792c15af90 0x7f792c1522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:33.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.054+0000 7f792affd700 1 -- 172.21.15.81:0/1843029645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f792c06dd50 msgr2=0x7f792c16a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:33.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.054+0000 7f792affd700 1 --2- 172.21.15.81:0/1843029645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f792c06dd50 0x7f792c16a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:33.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.054+0000 7f792affd700 1 -- 172.21.15.81:0/1843029645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79200094f0 con 0x7f792c06d0e0 2023-10-07T08:47:33.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.054+0000 7f792affd700 1 --2- 172.21.15.81:0/1843029645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c06d0e0 0x7f792c0b1a70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f791c00e190 tx=0x7f791c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:33.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.054+0000 7f7912ffd700 1 -- 172.21.15.81:0/1843029645 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00edd0 con 0x7f792c06d0e0 2023-10-07T08:47:33.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.054+0000 7f7912ffd700 1 -- 172.21.15.81:0/1843029645 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c014420 con 0x7f792c06d0e0 2023-10-07T08:47:33.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.054+0000 7f79319de700 1 -- 172.21.15.81:0/1843029645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792c16b460 con 0x7f792c06d0e0 2023-10-07T08:47:33.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.054+0000 7f7912ffd700 1 -- 172.21.15.81:0/1843029645 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c0147e0 con 0x7f792c06d0e0 2023-10-07T08:47:33.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.054+0000 7f79319de700 1 -- 172.21.15.81:0/1843029645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792c16ade0 con 0x7f792c06d0e0 2023-10-07T08:47:33.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.055+0000 7f79319de700 1 -- 172.21.15.81:0/1843029645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792c0684b0 con 0x7f792c06d0e0 2023-10-07T08:47:33.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.055+0000 7f7912ffd700 1 -- 172.21.15.81:0/1843029645 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f791c014b50 con 0x7f792c06d0e0 2023-10-07T08:47:33.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.056+0000 7f7912ffd700 1 --2- 172.21.15.81:0/1843029645 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7918066f30 0x7f79180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:33.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.056+0000 7f792a7fc700 1 --2- 172.21.15.81:0/1843029645 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7918066f30 0x7f79180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:33.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.056+0000 7f7912ffd700 1 -- 172.21.15.81:0/1843029645 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f791c084dc0 con 0x7f792c06d0e0 2023-10-07T08:47:33.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.056+0000 7f7912ffd700 1 -- 172.21.15.81:0/1843029645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=91}) v3 -- 0x7f791806eaf0 con 0x7f792c06d0e0 2023-10-07T08:47:33.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.056+0000 7f792a7fc700 1 --2- 172.21.15.81:0/1843029645 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7918066f30 0x7f79180693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f792c06e1c0 tx=0x7f7920017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:33.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.060+0000 7f7912ffd700 1 -- 172.21.15.81:0/1843029645 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f791c051fe0 con 0x7f792c06d0e0 2023-10-07T08:47:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.285+0000 7f79319de700 1 -- 172.21.15.81:0/1843029645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f792c071b10 con 0x7f792c06d0e0 2023-10-07T08:47:33.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.916+0000 7f7912ffd700 1 -- 172.21.15.81:0/1843029645 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(91..91 src has 1..91) v4 ==== 1476+0+0 (secure 0 0 0) 0x7f791c011260 con 0x7f792c06d0e0 2023-10-07T08:47:33.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.916+0000 7f7912ffd700 1 -- 172.21.15.81:0/1843029645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7f791806fce0 con 0x7f792c06d0e0 2023-10-07T08:47:33.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.922+0000 7f7912ffd700 1 -- 172.21.15.81:0/1843029645 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7f791c055600 con 0x7f792c06d0e0 2023-10-07T08:47:33.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.925+0000 7f79319de700 1 -- 172.21.15.81:0/1843029645 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7918066f30 msgr2=0x7f79180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:33.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.925+0000 7f79319de700 1 --2- 172.21.15.81:0/1843029645 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7918066f30 0x7f79180693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f792c06e1c0 tx=0x7f7920017000 comp rx=0 tx=0).stop 2023-10-07T08:47:33.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.925+0000 7f79319de700 1 -- 172.21.15.81:0/1843029645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c06d0e0 msgr2=0x7f792c0b1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:33.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.925+0000 7f79319de700 1 --2- 172.21.15.81:0/1843029645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c06d0e0 0x7f792c0b1a70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f791c00e190 tx=0x7f791c009900 comp rx=0 tx=0).stop 2023-10-07T08:47:33.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.925+0000 7f79319de700 1 -- 172.21.15.81:0/1843029645 shutdown_connections 2023-10-07T08:47:33.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.925+0000 7f79319de700 1 --2- 172.21.15.81:0/1843029645 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7918066f30 0x7f79180693e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:33.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.925+0000 7f79319de700 1 --2- 172.21.15.81:0/1843029645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f792c15af90 0x7f792c1522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:33.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.925+0000 7f79319de700 1 --2- 172.21.15.81:0/1843029645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c06d0e0 0x7f792c0b1a70 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:33.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.925+0000 7f79319de700 1 --2- 172.21.15.81:0/1843029645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f792c06dd50 0x7f792c16a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:33.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.925+0000 7f79319de700 1 -- 172.21.15.81:0/1843029645 >> 172.21.15.81:0/1843029645 conn(0x7f792c0c9ac0 msgr2=0x7f792c068f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:33.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.925+0000 7f79319de700 1 -- 172.21.15.81:0/1843029645 shutdown_connections 2023-10-07T08:47:33.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:33.925+0000 7f79319de700 1 -- 172.21.15.81:0/1843029645 wait complete. 2023-10-07T08:47:33.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T08:47:34.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.096+0000 7f6be2ddb700 1 Processor -- start 2023-10-07T08:47:34.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.096+0000 7f6be2ddb700 1 -- start start 2023-10-07T08:47:34.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.097+0000 7f6be2ddb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6bdc1578d0 0x7f6bdc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:34.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.097+0000 7f6be2ddb700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc0d07c0 con 0x7f6bdc06d120 2023-10-07T08:47:34.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.097+0000 7f6be2ddb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc0cfbb0 con 0x7f6bdc157ca0 2023-10-07T08:47:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.097+0000 7f6be2ddb700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bdc0cfe90 con 0x7f6bdc1578d0 2023-10-07T08:47:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.097+0000 7f6be0b77700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6bdc1578d0 0x7f6bdc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.097+0000 7f6be1378700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6bdc06d120 0x7f6bdc06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55582/0 (socket says 172.21.15.81:55582) 2023-10-07T08:47:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.097+0000 7f6be1378700 1 -- 172.21.15.81:0/3040855144 learned_addr learned my addr 172.21.15.81:0/3040855144 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.097+0000 7f6be0b77700 1 -- 172.21.15.81:0/3040855144 >> v1:172.21.15.89:6789/0 conn(0x7f6bdc157ca0 legacy=0x7f6bdc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:34.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.098+0000 7f6be0b77700 1 -- 172.21.15.81:0/3040855144 >> v1:172.21.15.81:6789/0 conn(0x7f6bdc06d120 legacy=0x7f6bdc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:34.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.098+0000 7f6be0b77700 1 -- 172.21.15.81:0/3040855144 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc0d0170 con 0x7f6bdc1578d0 2023-10-07T08:47:34.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.098+0000 7f6be0b77700 1 --2- 172.21.15.81:0/3040855144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bdc1578d0 0x7f6bdc0cf4f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009e60 tx=0x7f6bd8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a87aacb77a05e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:34.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.098+0000 7f6bd37fe700 1 -- 172.21.15.81:0/3040855144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd800e070 con 0x7f6bdc1578d0 2023-10-07T08:47:34.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.098+0000 7f6bd37fe700 1 -- 172.21.15.81:0/3040855144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd800bbf0 con 0x7f6bdc1578d0 2023-10-07T08:47:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.098+0000 7f6bd37fe700 1 -- 172.21.15.81:0/3040855144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8012430 con 0x7f6bdc1578d0 2023-10-07T08:47:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.098+0000 7f6be2ddb700 1 -- 172.21.15.81:0/3040855144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bdc1578d0 msgr2=0x7f6bdc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.098+0000 7f6be2ddb700 1 --2- 172.21.15.81:0/3040855144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bdc1578d0 0x7f6bdc0cf4f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009e60 tx=0x7f6bd8009780 comp rx=0 tx=0).stop 2023-10-07T08:47:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.098+0000 7f6be2ddb700 1 -- 172.21.15.81:0/3040855144 shutdown_connections 2023-10-07T08:47:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.098+0000 7f6be2ddb700 1 --2- 172.21.15.81:0/3040855144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bdc1578d0 0x7f6bdc0cf4f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.098+0000 7f6be2ddb700 1 -- 172.21.15.81:0/3040855144 >> 172.21.15.81:0/3040855144 conn(0x7f6bdc06bb90 msgr2=0x7f6bdc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.098+0000 7f6be2ddb700 1 -- 172.21.15.81:0/3040855144 shutdown_connections 2023-10-07T08:47:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.098+0000 7f6be2ddb700 1 -- 172.21.15.81:0/3040855144 wait complete. 2023-10-07T08:47:34.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.099+0000 7f6be2ddb700 1 Processor -- start 2023-10-07T08:47:34.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.100+0000 7f6be2ddb700 1 -- start start 2023-10-07T08:47:34.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.100+0000 7f6be2ddb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bdc06d120 0x7f6bdc14b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:34.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.100+0000 7f6be2ddb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bdc1578d0 0x7f6bdc0ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:34.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.100+0000 7f6be2ddb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bdc157ca0 0x7f6bdc0cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.100+0000 7f6be2ddb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc0c7580 con 0x7f6bdc1578d0 2023-10-07T08:47:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.100+0000 7f6be2ddb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc0c6970 con 0x7f6bdc157ca0 2023-10-07T08:47:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.100+0000 7f6be2ddb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc0c6c50 con 0x7f6bdc06d120 2023-10-07T08:47:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.100+0000 7f6bd3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bdc1578d0 0x7f6bdc0ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.100+0000 7f6bd3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bdc1578d0 0x7f6bdc0ca750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35972/0 (socket says 172.21.15.81:35972) 2023-10-07T08:47:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.100+0000 7f6bd3fff700 1 -- 172.21.15.81:0/3309931385 learned_addr learned my addr 172.21.15.81:0/3309931385 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.101+0000 7f6be1378700 1 --2- 172.21.15.81:0/3309931385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bdc157ca0 0x7f6bdc0cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.101+0000 7f6bd3fff700 1 -- 172.21.15.81:0/3309931385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bdc06d120 msgr2=0x7f6bdc14b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.101+0000 7f6be0b77700 1 --2- 172.21.15.81:0/3309931385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bdc06d120 0x7f6bdc14b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.101+0000 7f6bd3fff700 1 --2- 172.21.15.81:0/3309931385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bdc06d120 0x7f6bdc14b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.101+0000 7f6bd3fff700 1 -- 172.21.15.81:0/3309931385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bdc157ca0 msgr2=0x7f6bdc0cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.101+0000 7f6bd3fff700 1 --2- 172.21.15.81:0/3309931385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bdc157ca0 0x7f6bdc0cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.101+0000 7f6bd3fff700 1 -- 172.21.15.81:0/3309931385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd8009a20 con 0x7f6bdc1578d0 2023-10-07T08:47:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.101+0000 7f6be1378700 1 --2- 172.21.15.81:0/3309931385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bdc157ca0 0x7f6bdc0cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.101+0000 7f6be0b77700 1 --2- 172.21.15.81:0/3309931385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bdc06d120 0x7f6bdc14b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.101+0000 7f6bd3fff700 1 --2- 172.21.15.81:0/3309931385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bdc1578d0 0x7f6bdc0ca750 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00b5e0 tx=0x7f6bcc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.101+0000 7f6bd0ff9700 1 -- 172.21.15.81:0/3309931385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc00f510 con 0x7f6bdc1578d0 2023-10-07T08:47:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.101+0000 7f6bd0ff9700 1 -- 172.21.15.81:0/3309931385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc00f670 con 0x7f6bdc1578d0 2023-10-07T08:47:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.101+0000 7f6be2ddb700 1 -- 172.21.15.81:0/3309931385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bdc0c6f30 con 0x7f6bdc1578d0 2023-10-07T08:47:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.101+0000 7f6bd0ff9700 1 -- 172.21.15.81:0/3309931385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc00fa30 con 0x7f6bdc1578d0 2023-10-07T08:47:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.101+0000 7f6be2ddb700 1 -- 172.21.15.81:0/3309931385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bdc14bd90 con 0x7f6bdc1578d0 2023-10-07T08:47:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.102+0000 7f6be2ddb700 1 -- 172.21.15.81:0/3309931385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bdc067ac0 con 0x7f6bdc1578d0 2023-10-07T08:47:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.102+0000 7f6bd0ff9700 1 -- 172.21.15.81:0/3309931385 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6bcc01a400 con 0x7f6bdc1578d0 2023-10-07T08:47:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.103+0000 7f6bd0ff9700 1 --2- 172.21.15.81:0/3309931385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6bc8066f30 0x7f6bc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.103+0000 7f6bd0ff9700 1 -- 172.21.15.81:0/3309931385 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f6bcc084060 con 0x7f6bdc1578d0 2023-10-07T08:47:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.103+0000 7f6be0b77700 1 --2- 172.21.15.81:0/3309931385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6bc8066f30 0x7f6bc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.103+0000 7f6be0b77700 1 --2- 172.21.15.81:0/3309931385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6bc8066f30 0x7f6bc80693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80099f0 tx=0x7f6bd8018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:34.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.107+0000 7f6bd0ff9700 1 -- 172.21.15.81:0/3309931385 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bcc051300 con 0x7f6bdc1578d0 2023-10-07T08:47:34.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.289+0000 7f6be2ddb700 1 -- 172.21.15.81:0/3309931385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6bdc0d0450 con 0x7f6bdc1578d0 2023-10-07T08:47:34.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.930+0000 7f6bd0ff9700 1 -- 172.21.15.81:0/3309931385 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6bcc054920 con 0x7f6bdc1578d0 2023-10-07T08:47:34.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.934+0000 7f6be2ddb700 1 -- 172.21.15.81:0/3309931385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6bc8066f30 msgr2=0x7f6bc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:34.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.934+0000 7f6be2ddb700 1 --2- 172.21.15.81:0/3309931385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6bc8066f30 0x7f6bc80693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80099f0 tx=0x7f6bd8018000 comp rx=0 tx=0).stop 2023-10-07T08:47:34.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.934+0000 7f6be2ddb700 1 -- 172.21.15.81:0/3309931385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bdc1578d0 msgr2=0x7f6bdc0ca750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:34.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.934+0000 7f6be2ddb700 1 --2- 172.21.15.81:0/3309931385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bdc1578d0 0x7f6bdc0ca750 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00b5e0 tx=0x7f6bcc0090f0 comp rx=0 tx=0).stop 2023-10-07T08:47:34.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.934+0000 7f6be2ddb700 1 -- 172.21.15.81:0/3309931385 shutdown_connections 2023-10-07T08:47:34.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.934+0000 7f6be2ddb700 1 --2- 172.21.15.81:0/3309931385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bdc157ca0 0x7f6bdc0cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:34.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.934+0000 7f6be2ddb700 1 --2- 172.21.15.81:0/3309931385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6bc8066f30 0x7f6bc80693e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:34.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.934+0000 7f6be2ddb700 1 --2- 172.21.15.81:0/3309931385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bdc06d120 0x7f6bdc14b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:34.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.934+0000 7f6be2ddb700 1 --2- 172.21.15.81:0/3309931385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bdc1578d0 0x7f6bdc0ca750 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:34.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.934+0000 7f6be2ddb700 1 -- 172.21.15.81:0/3309931385 >> 172.21.15.81:0/3309931385 conn(0x7f6bdc06bb90 msgr2=0x7f6bdc069aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:34.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.934+0000 7f6be2ddb700 1 -- 172.21.15.81:0/3309931385 shutdown_connections 2023-10-07T08:47:34.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:34.934+0000 7f6be2ddb700 1 -- 172.21.15.81:0/3309931385 wait complete. 2023-10-07T08:47:34.939 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-07T08:47:34.948 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T08:47:35.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.065+0000 7f5e655f2700 1 Processor -- start 2023-10-07T08:47:35.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.066+0000 7f5e655f2700 1 -- start start 2023-10-07T08:47:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.066+0000 7f5e655f2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5e60157ca0 0x7f5e600cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.066+0000 7f5e655f2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e6006d120 0x7f5e6006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.066+0000 7f5e655f2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e600d07c0 con 0x7f5e601578d0 2023-10-07T08:47:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.066+0000 7f5e655f2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6006daa0 con 0x7f5e60157ca0 2023-10-07T08:47:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.066+0000 7f5e655f2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e600cfbb0 con 0x7f5e6006d120 2023-10-07T08:47:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.066+0000 7f5e567fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5e60157ca0 0x7f5e600cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.066+0000 7f5e5effd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5e601578d0 0x7f5e6015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55586/0 (socket says 172.21.15.81:55586) 2023-10-07T08:47:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.066+0000 7f5e5effd700 1 -- 172.21.15.81:0/547768048 learned_addr learned my addr 172.21.15.81:0/547768048 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.067+0000 7f5e5f7fe700 1 --2- 172.21.15.81:0/547768048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e6006d120 0x7f5e6006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.067+0000 7f5e567fc700 1 -- 172.21.15.81:0/547768048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e6006d120 msgr2=0x7f5e6006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.067+0000 7f5e567fc700 1 --2- 172.21.15.81:0/547768048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e6006d120 0x7f5e6006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.067+0000 7f5e567fc700 1 -- 172.21.15.81:0/547768048 >> v1:172.21.15.81:6789/0 conn(0x7f5e601578d0 legacy=0x7f5e6015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.067+0000 7f5e567fc700 1 -- 172.21.15.81:0/547768048 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e600cfe90 con 0x7f5e60157ca0 2023-10-07T08:47:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.067+0000 7f5e5e7fc700 1 -- 172.21.15.81:0/547768048 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268846507 0 0) 0x7f5e600d07c0 con 0x7f5e601578d0 2023-10-07T08:47:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.067+0000 7f5e567fc700 1 --2- 172.21.15.81:0/547768048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e60157ca0 0x7f5e600cf4f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f5e480098e0 tx=0x7f5e480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3cb891d0017777 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.067+0000 7f5e5e7fc700 1 -- 172.21.15.81:0/547768048 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e48009e80 con 0x7f5e60157ca0 2023-10-07T08:47:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.067+0000 7f5e5e7fc700 1 -- 172.21.15.81:0/547768048 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4800b860 con 0x7f5e60157ca0 2023-10-07T08:47:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.067+0000 7f5e5e7fc700 1 -- 172.21.15.81:0/547768048 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4800bbe0 con 0x7f5e60157ca0 2023-10-07T08:47:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.068+0000 7f5e655f2700 1 -- 172.21.15.81:0/547768048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e60157ca0 msgr2=0x7f5e600cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.068+0000 7f5e655f2700 1 --2- 172.21.15.81:0/547768048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e60157ca0 0x7f5e600cf4f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f5e480098e0 tx=0x7f5e480091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.068+0000 7f5e655f2700 1 -- 172.21.15.81:0/547768048 shutdown_connections 2023-10-07T08:47:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.068+0000 7f5e655f2700 1 --2- 172.21.15.81:0/547768048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e6006d120 0x7f5e6006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.068+0000 7f5e655f2700 1 --2- 172.21.15.81:0/547768048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e60157ca0 0x7f5e600cf4f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.068+0000 7f5e655f2700 1 -- 172.21.15.81:0/547768048 >> 172.21.15.81:0/547768048 conn(0x7f5e6006bb90 msgr2=0x7f5e6006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.068+0000 7f5e655f2700 1 -- 172.21.15.81:0/547768048 shutdown_connections 2023-10-07T08:47:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.068+0000 7f5e655f2700 1 -- 172.21.15.81:0/547768048 wait complete. 2023-10-07T08:47:35.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.069+0000 7f5e655f2700 1 Processor -- start 2023-10-07T08:47:35.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.069+0000 7f5e655f2700 1 -- start start 2023-10-07T08:47:35.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e655f2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e6006d120 0x7f5e60153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:35.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e655f2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e601578d0 0x7f5e60069910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:35.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e655f2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e60157ca0 0x7f5e60069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:35.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e655f2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e600b64b0 con 0x7f5e6006d120 2023-10-07T08:47:35.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e655f2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e60154020 con 0x7f5e601578d0 2023-10-07T08:47:35.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e655f2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e60159630 con 0x7f5e60157ca0 2023-10-07T08:47:35.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e5effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e6006d120 0x7f5e60153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:35.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e5effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e6006d120 0x7f5e60153ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35990/0 (socket says 172.21.15.81:35990) 2023-10-07T08:47:35.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e5effd700 1 -- 172.21.15.81:0/3757328495 learned_addr learned my addr 172.21.15.81:0/3757328495 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:35.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e567fc700 1 --2- 172.21.15.81:0/3757328495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e601578d0 0x7f5e60069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:35.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e5f7fe700 1 --2- 172.21.15.81:0/3757328495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e60157ca0 0x7f5e60069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:35.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e5effd700 1 -- 172.21.15.81:0/3757328495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e60157ca0 msgr2=0x7f5e60069e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:35.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e5effd700 1 --2- 172.21.15.81:0/3757328495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e60157ca0 0x7f5e60069e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:35.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e5effd700 1 -- 172.21.15.81:0/3757328495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e601578d0 msgr2=0x7f5e60069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:35.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e5effd700 1 --2- 172.21.15.81:0/3757328495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e601578d0 0x7f5e60069910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e5effd700 1 -- 172.21.15.81:0/3757328495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e48009420 con 0x7f5e6006d120 2023-10-07T08:47:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e567fc700 1 --2- 172.21.15.81:0/3757328495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e601578d0 0x7f5e60069910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e5effd700 1 --2- 172.21.15.81:0/3757328495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e6006d120 0x7f5e60153ae0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000c7e0 tx=0x7f5e50007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e577fe700 1 -- 172.21.15.81:0/3757328495 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50005b30 con 0x7f5e6006d120 2023-10-07T08:47:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e577fe700 1 -- 172.21.15.81:0/3757328495 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e50005c90 con 0x7f5e6006d120 2023-10-07T08:47:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e655f2700 1 -- 172.21.15.81:0/3757328495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e600b5930 con 0x7f5e6006d120 2023-10-07T08:47:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e577fe700 1 -- 172.21.15.81:0/3757328495 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50007300 con 0x7f5e6006d120 2023-10-07T08:47:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.070+0000 7f5e655f2700 1 -- 172.21.15.81:0/3757328495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e600b5ef0 con 0x7f5e6006d120 2023-10-07T08:47:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.071+0000 7f5e655f2700 1 -- 172.21.15.81:0/3757328495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e60067ac0 con 0x7f5e6006d120 2023-10-07T08:47:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.071+0000 7f5e577fe700 1 -- 172.21.15.81:0/3757328495 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e5001b400 con 0x7f5e6006d120 2023-10-07T08:47:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.072+0000 7f5e577fe700 1 --2- 172.21.15.81:0/3757328495 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5e40066f30 0x7f5e400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:35.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.072+0000 7f5e577fe700 1 -- 172.21.15.81:0/3757328495 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f5e50083ee0 con 0x7f5e6006d120 2023-10-07T08:47:35.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.072+0000 7f5e567fc700 1 --2- 172.21.15.81:0/3757328495 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5e40066f30 0x7f5e400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:35.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.072+0000 7f5e567fc700 1 --2- 172.21.15.81:0/3757328495 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5e40066f30 0x7f5e400693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5e601580c0 tx=0x7f5e48017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:35.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.076+0000 7f5e577fe700 1 -- 172.21.15.81:0/3757328495 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e50051330 con 0x7f5e6006d120 2023-10-07T08:47:35.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.258+0000 7f5e655f2700 1 -- 172.21.15.81:0/3757328495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5e600d0170 con 0x7f5e6006d120 2023-10-07T08:47:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.932+0000 7f5e577fe700 1 -- 172.21.15.81:0/3757328495 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5e50054950 con 0x7f5e6006d120 2023-10-07T08:47:35.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.936+0000 7f5e655f2700 1 -- 172.21.15.81:0/3757328495 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5e40066f30 msgr2=0x7f5e400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:35.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.936+0000 7f5e655f2700 1 --2- 172.21.15.81:0/3757328495 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5e40066f30 0x7f5e400693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5e601580c0 tx=0x7f5e48017000 comp rx=0 tx=0).stop 2023-10-07T08:47:35.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.936+0000 7f5e655f2700 1 -- 172.21.15.81:0/3757328495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e6006d120 msgr2=0x7f5e60153ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:35.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.936+0000 7f5e655f2700 1 --2- 172.21.15.81:0/3757328495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e6006d120 0x7f5e60153ae0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000c7e0 tx=0x7f5e50007df0 comp rx=0 tx=0).stop 2023-10-07T08:47:35.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.936+0000 7f5e655f2700 1 -- 172.21.15.81:0/3757328495 shutdown_connections 2023-10-07T08:47:35.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.936+0000 7f5e655f2700 1 --2- 172.21.15.81:0/3757328495 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5e40066f30 0x7f5e400693e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:35.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.936+0000 7f5e655f2700 1 --2- 172.21.15.81:0/3757328495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e60157ca0 0x7f5e60069e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:35.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.936+0000 7f5e655f2700 1 --2- 172.21.15.81:0/3757328495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e6006d120 0x7f5e60153ae0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:35.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.936+0000 7f5e655f2700 1 --2- 172.21.15.81:0/3757328495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e601578d0 0x7f5e60069910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:35.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.936+0000 7f5e655f2700 1 -- 172.21.15.81:0/3757328495 >> 172.21.15.81:0/3757328495 conn(0x7f5e6006bb90 msgr2=0x7f5e601584b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:35.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.936+0000 7f5e655f2700 1 -- 172.21.15.81:0/3757328495 shutdown_connections 2023-10-07T08:47:35.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:35.936+0000 7f5e655f2700 1 -- 172.21.15.81:0/3757328495 wait complete. 2023-10-07T08:47:35.939 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-07T08:47:35.950 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T08:47:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.065+0000 7f330e93d700 1 Processor -- start 2023-10-07T08:47:36.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.065+0000 7f330e93d700 1 -- start start 2023-10-07T08:47:36.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.066+0000 7f330e93d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f330806d830 0x7f33080cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:36.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.066+0000 7f330e93d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33080d07c0 con 0x7f3308157ca0 2023-10-07T08:47:36.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.066+0000 7f330e93d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33080cfbb0 con 0x7f33081578d0 2023-10-07T08:47:36.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.066+0000 7f330e93d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33080cfe90 con 0x7f330806d830 2023-10-07T08:47:36.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.066+0000 7f330ceda700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f330806d830 0x7f33080cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:36.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.066+0000 7f33077fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3308157ca0 0x7f330806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55596/0 (socket says 172.21.15.81:55596) 2023-10-07T08:47:36.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.066+0000 7f33077fe700 1 -- 172.21.15.81:0/2718136806 learned_addr learned my addr 172.21.15.81:0/2718136806 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:36.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.066+0000 7f330ceda700 1 -- 172.21.15.81:0/2718136806 >> v1:172.21.15.89:6789/0 conn(0x7f33081578d0 legacy=0x7f330815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:36.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.066+0000 7f330ceda700 1 -- 172.21.15.81:0/2718136806 >> v1:172.21.15.81:6789/0 conn(0x7f3308157ca0 legacy=0x7f330806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:36.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.066+0000 7f330ceda700 1 -- 172.21.15.81:0/2718136806 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33080d0170 con 0x7f330806d830 2023-10-07T08:47:36.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.067+0000 7f330ceda700 1 --2- 172.21.15.81:0/2718136806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f330806d830 0x7f33080cf4f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3300009e60 tx=0x7f3300009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f050edeee2f318 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:36.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.067+0000 7f3306ffd700 1 -- 172.21.15.81:0/2718136806 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330000e070 con 0x7f330806d830 2023-10-07T08:47:36.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.067+0000 7f3306ffd700 1 -- 172.21.15.81:0/2718136806 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330000bbf0 con 0x7f330806d830 2023-10-07T08:47:36.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.067+0000 7f3306ffd700 1 -- 172.21.15.81:0/2718136806 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300012430 con 0x7f330806d830 2023-10-07T08:47:36.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.067+0000 7f330e93d700 1 -- 172.21.15.81:0/2718136806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f330806d830 msgr2=0x7f33080cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:36.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.067+0000 7f330e93d700 1 --2- 172.21.15.81:0/2718136806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f330806d830 0x7f33080cf4f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3300009e60 tx=0x7f3300009780 comp rx=0 tx=0).stop 2023-10-07T08:47:36.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.067+0000 7f330e93d700 1 -- 172.21.15.81:0/2718136806 shutdown_connections 2023-10-07T08:47:36.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.067+0000 7f330e93d700 1 --2- 172.21.15.81:0/2718136806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f330806d830 0x7f33080cf4f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:36.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.067+0000 7f330e93d700 1 -- 172.21.15.81:0/2718136806 >> 172.21.15.81:0/2718136806 conn(0x7f330806bb90 msgr2=0x7f330806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:36.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.067+0000 7f330e93d700 1 -- 172.21.15.81:0/2718136806 shutdown_connections 2023-10-07T08:47:36.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.067+0000 7f330e93d700 1 -- 172.21.15.81:0/2718136806 wait complete. 2023-10-07T08:47:36.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.068+0000 7f330e93d700 1 Processor -- start 2023-10-07T08:47:36.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.069+0000 7f330e93d700 1 -- start start 2023-10-07T08:47:36.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.069+0000 7f330e93d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f330806d830 0x7f3308159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:36.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.069+0000 7f330e93d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33081578d0 0x7f3308153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:36.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.069+0000 7f330e93d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3308157ca0 0x7f33081501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:36.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.069+0000 7f330e93d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3308153e80 con 0x7f3308157ca0 2023-10-07T08:47:36.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.069+0000 7f330e93d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33081594e0 con 0x7f33081578d0 2023-10-07T08:47:36.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.069+0000 7f330e93d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3308150730 con 0x7f330806d830 2023-10-07T08:47:36.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.069+0000 7f330ceda700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3308157ca0 0x7f33081501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:36.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.069+0000 7f330ceda700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3308157ca0 0x7f33081501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36016/0 (socket says 172.21.15.81:36016) 2023-10-07T08:47:36.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.069+0000 7f330ceda700 1 -- 172.21.15.81:0/3771303370 learned_addr learned my addr 172.21.15.81:0/3771303370 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:36.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.070+0000 7f33077fe700 1 --2- 172.21.15.81:0/3771303370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33081578d0 0x7f3308153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:36.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.070+0000 7f3307fff700 1 --2- 172.21.15.81:0/3771303370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f330806d830 0x7f3308159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:36.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.070+0000 7f330ceda700 1 -- 172.21.15.81:0/3771303370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f330806d830 msgr2=0x7f3308159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:36.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.070+0000 7f330ceda700 1 --2- 172.21.15.81:0/3771303370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f330806d830 0x7f3308159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:36.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.070+0000 7f330ceda700 1 -- 172.21.15.81:0/3771303370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33081578d0 msgr2=0x7f3308153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:36.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.070+0000 7f330ceda700 1 --2- 172.21.15.81:0/3771303370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33081578d0 0x7f3308153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:36.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.070+0000 7f330ceda700 1 -- 172.21.15.81:0/3771303370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3300009a20 con 0x7f3308157ca0 2023-10-07T08:47:36.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.070+0000 7f330ceda700 1 --2- 172.21.15.81:0/3771303370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3308157ca0 0x7f33081501f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f330806fe20 tx=0x7f3300018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:36.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.070+0000 7f32effff700 1 -- 172.21.15.81:0/3771303370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330001e640 con 0x7f3308157ca0 2023-10-07T08:47:36.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.070+0000 7f32effff700 1 -- 172.21.15.81:0/3771303370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330001e7a0 con 0x7f3308157ca0 2023-10-07T08:47:36.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.070+0000 7f330e93d700 1 -- 172.21.15.81:0/3771303370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33081588d0 con 0x7f3308157ca0 2023-10-07T08:47:36.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.070+0000 7f32effff700 1 -- 172.21.15.81:0/3771303370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330001eb60 con 0x7f3308157ca0 2023-10-07T08:47:36.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.070+0000 7f330e93d700 1 -- 172.21.15.81:0/3771303370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3308158e90 con 0x7f3308157ca0 2023-10-07T08:47:36.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.071+0000 7f330e93d700 1 -- 172.21.15.81:0/3771303370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3308159650 con 0x7f3308157ca0 2023-10-07T08:47:36.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.071+0000 7f32effff700 1 -- 172.21.15.81:0/3771303370 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3300024070 con 0x7f3308157ca0 2023-10-07T08:47:36.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.072+0000 7f32effff700 1 --2- 172.21.15.81:0/3771303370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f32f4066f60 0x7f32f4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:36.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.072+0000 7f32effff700 1 -- 172.21.15.81:0/3771303370 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3300086e00 con 0x7f3308157ca0 2023-10-07T08:47:36.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.072+0000 7f3307fff700 1 --2- 172.21.15.81:0/3771303370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f32f4066f60 0x7f32f4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:36.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.072+0000 7f3307fff700 1 --2- 172.21.15.81:0/3771303370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f32f4066f60 0x7f32f4069410 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f32f8006fd0 tx=0x7f32f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:36.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.076+0000 7f32effff700 1 -- 172.21.15.81:0/3771303370 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3300054370 con 0x7f3308157ca0 2023-10-07T08:47:36.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.256+0000 7f330e93d700 1 -- 172.21.15.81:0/3771303370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f33080d0450 con 0x7f3308157ca0 2023-10-07T08:47:36.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.262+0000 7f32effff700 1 -- 172.21.15.81:0/3771303370 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3300057990 con 0x7f3308157ca0 2023-10-07T08:47:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.264+0000 7f330e93d700 1 -- 172.21.15.81:0/3771303370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f32f4066f60 msgr2=0x7f32f4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.264+0000 7f330e93d700 1 --2- 172.21.15.81:0/3771303370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f32f4066f60 0x7f32f4069410 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f32f8006fd0 tx=0x7f32f8008040 comp rx=0 tx=0).stop 2023-10-07T08:47:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.264+0000 7f330e93d700 1 -- 172.21.15.81:0/3771303370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3308157ca0 msgr2=0x7f33081501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.264+0000 7f330e93d700 1 --2- 172.21.15.81:0/3771303370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3308157ca0 0x7f33081501f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f330806fe20 tx=0x7f3300018000 comp rx=0 tx=0).stop 2023-10-07T08:47:36.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.264+0000 7f330e93d700 1 -- 172.21.15.81:0/3771303370 shutdown_connections 2023-10-07T08:47:36.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.264+0000 7f330e93d700 1 --2- 172.21.15.81:0/3771303370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3308157ca0 0x7f33081501f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:36.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.264+0000 7f330e93d700 1 --2- 172.21.15.81:0/3771303370 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f32f4066f60 0x7f32f4069410 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:36.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.264+0000 7f330e93d700 1 --2- 172.21.15.81:0/3771303370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f330806d830 0x7f3308159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:36.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.264+0000 7f330e93d700 1 --2- 172.21.15.81:0/3771303370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33081578d0 0x7f3308153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:36.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.265+0000 7f330e93d700 1 -- 172.21.15.81:0/3771303370 >> 172.21.15.81:0/3771303370 conn(0x7f330806bb90 msgr2=0x7f330806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:36.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.265+0000 7f330e93d700 1 -- 172.21.15.81:0/3771303370 shutdown_connections 2023-10-07T08:47:36.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.265+0000 7f330e93d700 1 -- 172.21.15.81:0/3771303370 wait complete. 2023-10-07T08:47:36.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-10-07T08:47:36.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.391+0000 7fc798fd9700 1 Processor -- start 2023-10-07T08:47:36.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.391+0000 7fc798fd9700 1 -- start start 2023-10-07T08:47:36.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.392+0000 7fc798fd9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc794157ca0 0x7fc7940cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:36.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.392+0000 7fc798fd9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc79406d120 0x7fc79406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:36.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.392+0000 7fc798fd9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7940d07c0 con 0x7fc7941578d0 2023-10-07T08:47:36.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.392+0000 7fc798fd9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc79406da50 con 0x7fc794157ca0 2023-10-07T08:47:36.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.392+0000 7fc798fd9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7940cfbb0 con 0x7fc79406d120 2023-10-07T08:47:36.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.392+0000 7fc791d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc794157ca0 0x7fc7940cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.392+0000 7fc791d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc794157ca0 0x7fc7940cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36022/0 (socket says 172.21.15.81:36022) 2023-10-07T08:47:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.392+0000 7fc791d9b700 1 -- 172.21.15.81:0/989286811 learned_addr learned my addr 172.21.15.81:0/989286811 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.392+0000 7fc792d9d700 1 --2- 172.21.15.81:0/989286811 >> v2:172.21.15.89:3300/0 conn(0x7fc79406d120 0x7fc79406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.393+0000 7fc791d9b700 1 -- 172.21.15.81:0/989286811 >> v2:172.21.15.89:3300/0 conn(0x7fc79406d120 msgr2=0x7fc79406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.393+0000 7fc791d9b700 1 --2- 172.21.15.81:0/989286811 >> v2:172.21.15.89:3300/0 conn(0x7fc79406d120 0x7fc79406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.393+0000 7fc791d9b700 1 -- 172.21.15.81:0/989286811 >> v1:172.21.15.89:6789/0 conn(0x7fc7941578d0 legacy=0x7fc79415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.393+0000 7fc791d9b700 1 -- 172.21.15.81:0/989286811 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7940cfe90 con 0x7fc794157ca0 2023-10-07T08:47:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.393+0000 7fc791d9b700 1 --2- 172.21.15.81:0/989286811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc794157ca0 0x7fc7940cf4f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc794068300 tx=0x7fc77c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe07a5e6d81f007b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.393+0000 7fc79159a700 1 -- 172.21.15.81:0/989286811 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c009e70 con 0x7fc794157ca0 2023-10-07T08:47:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.393+0000 7fc79159a700 1 -- 172.21.15.81:0/989286811 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77c00b860 con 0x7fc794157ca0 2023-10-07T08:47:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.393+0000 7fc79159a700 1 -- 172.21.15.81:0/989286811 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c00bc00 con 0x7fc794157ca0 2023-10-07T08:47:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.393+0000 7fc798fd9700 1 -- 172.21.15.81:0/989286811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc794157ca0 msgr2=0x7fc7940cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.393+0000 7fc798fd9700 1 --2- 172.21.15.81:0/989286811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc794157ca0 0x7fc7940cf4f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc794068300 tx=0x7fc77c009250 comp rx=0 tx=0).stop 2023-10-07T08:47:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.393+0000 7fc798fd9700 1 -- 172.21.15.81:0/989286811 shutdown_connections 2023-10-07T08:47:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.393+0000 7fc798fd9700 1 --2- 172.21.15.81:0/989286811 >> v2:172.21.15.89:3300/0 conn(0x7fc79406d120 0x7fc79406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.393+0000 7fc798fd9700 1 --2- 172.21.15.81:0/989286811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc794157ca0 0x7fc7940cf4f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.393+0000 7fc798fd9700 1 -- 172.21.15.81:0/989286811 >> 172.21.15.81:0/989286811 conn(0x7fc79406bb90 msgr2=0x7fc79406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.394+0000 7fc798fd9700 1 -- 172.21.15.81:0/989286811 shutdown_connections 2023-10-07T08:47:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.394+0000 7fc798fd9700 1 -- 172.21.15.81:0/989286811 wait complete. 2023-10-07T08:47:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.395+0000 7fc798fd9700 1 Processor -- start 2023-10-07T08:47:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.395+0000 7fc798fd9700 1 -- start start 2023-10-07T08:47:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.395+0000 7fc798fd9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc79406d120 0x7fc794153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.395+0000 7fc798fd9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7941578d0 0x7fc7940c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.395+0000 7fc798fd9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc794157ca0 0x7fc7941590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.395+0000 7fc798fd9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7940c6aa0 con 0x7fc79406d120 2023-10-07T08:47:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.395+0000 7fc798fd9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7940c5e90 con 0x7fc7941578d0 2023-10-07T08:47:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.395+0000 7fc798fd9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7940c6170 con 0x7fc794157ca0 2023-10-07T08:47:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.395+0000 7fc79259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc79406d120 0x7fc794153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.395+0000 7fc79259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc79406d120 0x7fc794153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36032/0 (socket says 172.21.15.81:36032) 2023-10-07T08:47:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.395+0000 7fc79259c700 1 -- 172.21.15.81:0/2796315723 learned_addr learned my addr 172.21.15.81:0/2796315723 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.396+0000 7fc791d9b700 1 --2- 172.21.15.81:0/2796315723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7941578d0 0x7fc7940c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.396+0000 7fc792d9d700 1 --2- 172.21.15.81:0/2796315723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc794157ca0 0x7fc7941590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.396+0000 7fc79259c700 1 -- 172.21.15.81:0/2796315723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc794157ca0 msgr2=0x7fc7941590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.396+0000 7fc79259c700 1 --2- 172.21.15.81:0/2796315723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc794157ca0 0x7fc7941590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.396+0000 7fc79259c700 1 -- 172.21.15.81:0/2796315723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7941578d0 msgr2=0x7fc7940c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.396+0000 7fc79259c700 1 --2- 172.21.15.81:0/2796315723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7941578d0 0x7fc7940c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.396+0000 7fc79259c700 1 -- 172.21.15.81:0/2796315723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c0094f0 con 0x7fc79406d120 2023-10-07T08:47:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.396+0000 7fc791d9b700 1 --2- 172.21.15.81:0/2796315723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7941578d0 0x7fc7940c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.396+0000 7fc79259c700 1 --2- 172.21.15.81:0/2796315723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc79406d120 0x7fc794153ea0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc78400cb40 tx=0x7fc784001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.396+0000 7fc78a7fc700 1 -- 172.21.15.81:0/2796315723 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78400a7e0 con 0x7fc79406d120 2023-10-07T08:47:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.396+0000 7fc78a7fc700 1 -- 172.21.15.81:0/2796315723 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78400a940 con 0x7fc79406d120 2023-10-07T08:47:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.396+0000 7fc798fd9700 1 -- 172.21.15.81:0/2796315723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7940c6450 con 0x7fc79406d120 2023-10-07T08:47:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.396+0000 7fc78a7fc700 1 -- 172.21.15.81:0/2796315723 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78400ad00 con 0x7fc79406d120 2023-10-07T08:47:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.396+0000 7fc798fd9700 1 -- 172.21.15.81:0/2796315723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7940c5b20 con 0x7fc79406d120 2023-10-07T08:47:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.397+0000 7fc798fd9700 1 -- 172.21.15.81:0/2796315723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc794067ac0 con 0x7fc79406d120 2023-10-07T08:47:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.397+0000 7fc78a7fc700 1 -- 172.21.15.81:0/2796315723 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc784003030 con 0x7fc79406d120 2023-10-07T08:47:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.398+0000 7fc78a7fc700 1 --2- 172.21.15.81:0/2796315723 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc774066f30 0x7fc7740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.398+0000 7fc78a7fc700 1 -- 172.21.15.81:0/2796315723 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc7840843b0 con 0x7fc79406d120 2023-10-07T08:47:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.398+0000 7fc791d9b700 1 --2- 172.21.15.81:0/2796315723 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc774066f30 0x7fc7740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.398+0000 7fc791d9b700 1 --2- 172.21.15.81:0/2796315723 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc774066f30 0x7fc7740693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc794068300 tx=0x7fc77c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.402+0000 7fc78a7fc700 1 -- 172.21.15.81:0/2796315723 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc784051880 con 0x7fc79406d120 2023-10-07T08:47:36.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.662+0000 7fc798fd9700 1 -- 172.21.15.81:0/2796315723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7fc7940d0170 con 0x7fc79406d120 2023-10-07T08:47:36.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.937+0000 7fc78a7fc700 1 -- 172.21.15.81:0/2796315723 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v237) v1 ==== 133+0+0 (secure 0 0 0) 0x7fc78400ae60 con 0x7fc79406d120 2023-10-07T08:47:36.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.939+0000 7fc798fd9700 1 -- 172.21.15.81:0/2796315723 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc774066f30 msgr2=0x7fc7740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:36.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.939+0000 7fc798fd9700 1 --2- 172.21.15.81:0/2796315723 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc774066f30 0x7fc7740693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc794068300 tx=0x7fc77c017000 comp rx=0 tx=0).stop 2023-10-07T08:47:36.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.939+0000 7fc798fd9700 1 -- 172.21.15.81:0/2796315723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc79406d120 msgr2=0x7fc794153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.939+0000 7fc798fd9700 1 --2- 172.21.15.81:0/2796315723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc79406d120 0x7fc794153ea0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc78400cb40 tx=0x7fc784001770 comp rx=0 tx=0).stop 2023-10-07T08:47:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.939+0000 7fc798fd9700 1 -- 172.21.15.81:0/2796315723 shutdown_connections 2023-10-07T08:47:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.939+0000 7fc798fd9700 1 --2- 172.21.15.81:0/2796315723 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc774066f30 0x7fc7740693e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.939+0000 7fc798fd9700 1 --2- 172.21.15.81:0/2796315723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc794157ca0 0x7fc7941590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.939+0000 7fc798fd9700 1 --2- 172.21.15.81:0/2796315723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc79406d120 0x7fc794153ea0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.939+0000 7fc798fd9700 1 --2- 172.21.15.81:0/2796315723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7941578d0 0x7fc7940c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.939+0000 7fc798fd9700 1 -- 172.21.15.81:0/2796315723 >> 172.21.15.81:0/2796315723 conn(0x7fc79406bb90 msgr2=0x7fc7940b5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.939+0000 7fc798fd9700 1 -- 172.21.15.81:0/2796315723 shutdown_connections 2023-10-07T08:47:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:36.939+0000 7fc798fd9700 1 -- 172.21.15.81:0/2796315723 wait complete. 2023-10-07T08:47:36.952 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-10-07T08:47:36.952 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-10-07T08:47:36.953 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-10-07T08:47:37.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.066+0000 7fbaf6b56700 1 Processor -- start 2023-10-07T08:47:37.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.066+0000 7fbaf6b56700 1 -- start start 2023-10-07T08:47:37.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.066+0000 7fbaf6b56700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbaf00b3bd0 0x7fbaf00ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:37.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.066+0000 7fbaf6b56700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbaf01583b0 0x7fbaf00cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:37.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.066+0000 7fbaf6b56700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf00b2890 con 0x7fbaf0157fe0 2023-10-07T08:47:37.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.066+0000 7fbaf6b56700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf00b4070 con 0x7fbaf00b3bd0 2023-10-07T08:47:37.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.066+0000 7fbaf6b56700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf00b4350 con 0x7fbaf01583b0 2023-10-07T08:47:37.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.067+0000 7fbaeffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbaf00b3bd0 0x7fbaf00ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:37.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.067+0000 7fbaeffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbaf00b3bd0 0x7fbaf00ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36044/0 (socket says 172.21.15.81:36044) 2023-10-07T08:47:37.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.067+0000 7fbaf48f2700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbaf0157fe0 0x7fbaf00b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55602/0 (socket says 172.21.15.81:55602) 2023-10-07T08:47:37.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.067+0000 7fbaeffff700 1 -- 172.21.15.81:0/3239741466 learned_addr learned my addr 172.21.15.81:0/3239741466 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:37.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.067+0000 7fbaf50f3700 1 --2- 172.21.15.81:0/3239741466 >> v2:172.21.15.89:3300/0 conn(0x7fbaf01583b0 0x7fbaf00cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:37.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.067+0000 7fbaeffff700 1 -- 172.21.15.81:0/3239741466 >> v2:172.21.15.89:3300/0 conn(0x7fbaf01583b0 msgr2=0x7fbaf00cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:37.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.067+0000 7fbaeffff700 1 --2- 172.21.15.81:0/3239741466 >> v2:172.21.15.89:3300/0 conn(0x7fbaf01583b0 0x7fbaf00cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:37.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.067+0000 7fbaeffff700 1 -- 172.21.15.81:0/3239741466 >> v1:172.21.15.81:6789/0 conn(0x7fbaf0157fe0 legacy=0x7fbaf00b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:37.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.067+0000 7fbaeffff700 1 -- 172.21.15.81:0/3239741466 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf00b4630 con 0x7fbaf00b3bd0 2023-10-07T08:47:37.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.067+0000 7fbaef7fe700 1 -- 172.21.15.81:0/3239741466 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61128322 0 0) 0x7fbaf00b2890 con 0x7fbaf0157fe0 2023-10-07T08:47:37.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.067+0000 7fbaf50f3700 1 --2- 172.21.15.81:0/3239741466 >> v2:172.21.15.89:3300/0 conn(0x7fbaf01583b0 0x7fbaf00cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:37.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.067+0000 7fbaeffff700 1 --2- 172.21.15.81:0/3239741466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf00b3bd0 0x7fbaf00ceb30 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00cc640 tx=0x7fbad8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23baaa25d9070749 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:37.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.067+0000 7fbaef7fe700 1 -- 172.21.15.81:0/3239741466 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800b860 con 0x7fbaf00b3bd0 2023-10-07T08:47:37.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.067+0000 7fbaef7fe700 1 -- 172.21.15.81:0/3239741466 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad800b9c0 con 0x7fbaf00b3bd0 2023-10-07T08:47:37.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.067+0000 7fbaef7fe700 1 -- 172.21.15.81:0/3239741466 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800bd60 con 0x7fbaf00b3bd0 2023-10-07T08:47:37.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.068+0000 7fbaf6b56700 1 -- 172.21.15.81:0/3239741466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf00b3bd0 msgr2=0x7fbaf00ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:37.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.068+0000 7fbaf6b56700 1 --2- 172.21.15.81:0/3239741466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf00b3bd0 0x7fbaf00ceb30 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00cc640 tx=0x7fbad8009250 comp rx=0 tx=0).stop 2023-10-07T08:47:37.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.068+0000 7fbaf6b56700 1 -- 172.21.15.81:0/3239741466 shutdown_connections 2023-10-07T08:47:37.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.068+0000 7fbaf6b56700 1 --2- 172.21.15.81:0/3239741466 >> v2:172.21.15.89:3300/0 conn(0x7fbaf01583b0 0x7fbaf00cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:37.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.068+0000 7fbaf6b56700 1 --2- 172.21.15.81:0/3239741466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf00b3bd0 0x7fbaf00ceb30 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:37.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.068+0000 7fbaf6b56700 1 -- 172.21.15.81:0/3239741466 >> 172.21.15.81:0/3239741466 conn(0x7fbaf0067640 msgr2=0x7fbaf0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:37.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.068+0000 7fbaf6b56700 1 -- 172.21.15.81:0/3239741466 shutdown_connections 2023-10-07T08:47:37.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.068+0000 7fbaf6b56700 1 -- 172.21.15.81:0/3239741466 wait complete. 2023-10-07T08:47:37.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.069+0000 7fbaf6b56700 1 Processor -- start 2023-10-07T08:47:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.069+0000 7fbaf6b56700 1 -- start start 2023-10-07T08:47:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaf6b56700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaf00b3bd0 0x7fbaf01497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaf6b56700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf0157fe0 0x7fbaf006e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaf6b56700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbaf01583b0 0x7fbaf015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaf6b56700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf006e710 con 0x7fbaf0157fe0 2023-10-07T08:47:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaf6b56700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf006dd40 con 0x7fbaf00b3bd0 2023-10-07T08:47:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaf6b56700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf006d130 con 0x7fbaf01583b0 2023-10-07T08:47:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaeffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf0157fe0 0x7fbaf006e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaeffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf0157fe0 0x7fbaf006e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36048/0 (socket says 172.21.15.81:36048) 2023-10-07T08:47:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaeffff700 1 -- 172.21.15.81:0/4152977275 learned_addr learned my addr 172.21.15.81:0/4152977275 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:37.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaeffff700 1 -- 172.21.15.81:0/4152977275 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbaf01583b0 msgr2=0x7fbaf015ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:37.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaeffff700 1 --2- 172.21.15.81:0/4152977275 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbaf01583b0 0x7fbaf015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:37.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaeffff700 1 -- 172.21.15.81:0/4152977275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaf00b3bd0 msgr2=0x7fbaf01497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:37.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaeffff700 1 --2- 172.21.15.81:0/4152977275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaf00b3bd0 0x7fbaf01497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:37.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaeffff700 1 -- 172.21.15.81:0/4152977275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad80094f0 con 0x7fbaf0157fe0 2023-10-07T08:47:37.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaeffff700 1 --2- 172.21.15.81:0/4152977275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf0157fe0 0x7fbaf006e1d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbaf006f990 tx=0x7fbad8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:37.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaecff9700 1 -- 172.21.15.81:0/4152977275 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8024440 con 0x7fbaf0157fe0 2023-10-07T08:47:37.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaecff9700 1 -- 172.21.15.81:0/4152977275 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad80245e0 con 0x7fbaf0157fe0 2023-10-07T08:47:37.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaf6b56700 1 -- 172.21.15.81:0/4152977275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf006d410 con 0x7fbaf0157fe0 2023-10-07T08:47:37.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaecff9700 1 -- 172.21.15.81:0/4152977275 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad80249a0 con 0x7fbaf0157fe0 2023-10-07T08:47:37.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.070+0000 7fbaf6b56700 1 -- 172.21.15.81:0/4152977275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf006d9d0 con 0x7fbaf0157fe0 2023-10-07T08:47:37.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.071+0000 7fbaf6b56700 1 -- 172.21.15.81:0/4152977275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf0069e40 con 0x7fbaf0157fe0 2023-10-07T08:47:37.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.072+0000 7fbaecff9700 1 -- 172.21.15.81:0/4152977275 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbad8024d50 con 0x7fbaf0157fe0 2023-10-07T08:47:37.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.072+0000 7fbaecff9700 1 --2- 172.21.15.81:0/4152977275 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbad0066f30 0x7fbad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:37.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.072+0000 7fbaf48f2700 1 --2- 172.21.15.81:0/4152977275 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbad0066f30 0x7fbad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:37.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.072+0000 7fbaecff9700 1 -- 172.21.15.81:0/4152977275 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbad8085e10 con 0x7fbaf0157fe0 2023-10-07T08:47:37.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.073+0000 7fbaf48f2700 1 --2- 172.21.15.81:0/4152977275 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbad0066f30 0x7fbad00693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbae8001560 tx=0x7fbae8001760 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:37.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.076+0000 7fbaecff9700 1 -- 172.21.15.81:0/4152977275 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbad8053380 con 0x7fbaf0157fe0 2023-10-07T08:47:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.334+0000 7fbaf6b56700 1 -- 172.21.15.81:0/4152977275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7fbaf006de80 con 0x7fbaf0157fe0 2023-10-07T08:47:37.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.938+0000 7fbaecff9700 1 -- 172.21.15.81:0/4152977275 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v238) v1 ==== 140+0+0 (secure 0 0 0) 0x7fbad802b340 con 0x7fbaf0157fe0 2023-10-07T08:47:37.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.940+0000 7fbaf6b56700 1 -- 172.21.15.81:0/4152977275 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbad0066f30 msgr2=0x7fbad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:37.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.940+0000 7fbaf6b56700 1 --2- 172.21.15.81:0/4152977275 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbad0066f30 0x7fbad00693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbae8001560 tx=0x7fbae8001760 comp rx=0 tx=0).stop 2023-10-07T08:47:37.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.940+0000 7fbaf6b56700 1 -- 172.21.15.81:0/4152977275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf0157fe0 msgr2=0x7fbaf006e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:37.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.940+0000 7fbaf6b56700 1 --2- 172.21.15.81:0/4152977275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf0157fe0 0x7fbaf006e1d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbaf006f990 tx=0x7fbad8017000 comp rx=0 tx=0).stop 2023-10-07T08:47:37.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.940+0000 7fbaf6b56700 1 -- 172.21.15.81:0/4152977275 shutdown_connections 2023-10-07T08:47:37.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.940+0000 7fbaf6b56700 1 --2- 172.21.15.81:0/4152977275 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbad0066f30 0x7fbad00693e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:37.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.940+0000 7fbaf6b56700 1 --2- 172.21.15.81:0/4152977275 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbaf01583b0 0x7fbaf015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:37.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.940+0000 7fbaf6b56700 1 --2- 172.21.15.81:0/4152977275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaf00b3bd0 0x7fbaf01497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:37.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.940+0000 7fbaf6b56700 1 --2- 172.21.15.81:0/4152977275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaf0157fe0 0x7fbaf006e1d0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:37.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.940+0000 7fbaf6b56700 1 -- 172.21.15.81:0/4152977275 >> 172.21.15.81:0/4152977275 conn(0x7fbaf0067640 msgr2=0x7fbaf00cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:37.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.941+0000 7fbaf6b56700 1 -- 172.21.15.81:0/4152977275 shutdown_connections 2023-10-07T08:47:37.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:37.941+0000 7fbaf6b56700 1 -- 172.21.15.81:0/4152977275 wait complete. 2023-10-07T08:47:37.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-07T08:47:38.082 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_objectstore":"memstore"} 2023-10-07T08:47:38.083 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-07T08:47:38.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T08:47:38.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.199+0000 7f92a3325700 1 Processor -- start 2023-10-07T08:47:38.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.199+0000 7f92a3325700 1 -- start start 2023-10-07T08:47:38.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.200+0000 7f92a3325700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929c06e4e0 0x7f929c06cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:38.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.200+0000 7f92a3325700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f929c0cf080 0x7f929c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:38.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.200+0000 7f92a3325700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929c0aaf40 con 0x7f929c159cb0 2023-10-07T08:47:38.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.200+0000 7f92a3325700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c06c570 con 0x7f929c0cf080 2023-10-07T08:47:38.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.200+0000 7f92a3325700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0aa930 con 0x7f929c06e4e0 2023-10-07T08:47:38.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.200+0000 7f92a2b24700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f929c0cf080 0x7f929c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:38.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.200+0000 7f92a2323700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f929c159cb0 0x7f929c0ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55610/0 (socket says 172.21.15.81:55610) 2023-10-07T08:47:38.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.200+0000 7f92a2b24700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f929c0cf080 0x7f929c06d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36064/0 (socket says 172.21.15.81:36064) 2023-10-07T08:47:38.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.200+0000 7f92a2323700 1 -- 172.21.15.81:0/3874529963 learned_addr learned my addr 172.21.15.81:0/3874529963 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:38.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.200+0000 7f92a2b24700 1 -- 172.21.15.81:0/3874529963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929c06e4e0 msgr2=0x7f929c06cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:38.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.200+0000 7f92a2b24700 1 --2- 172.21.15.81:0/3874529963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929c06e4e0 0x7f929c06cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.200+0000 7f92a2b24700 1 -- 172.21.15.81:0/3874529963 >> v1:172.21.15.81:6789/0 conn(0x7f929c159cb0 legacy=0x7f929c0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:38.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.200+0000 7f92a2b24700 1 -- 172.21.15.81:0/3874529963 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c06e970 con 0x7f929c0cf080 2023-10-07T08:47:38.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.200+0000 7f92a1321700 1 -- 172.21.15.81:0/3874529963 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262629732 0 0) 0x7f929c0aaf40 con 0x7f929c159cb0 2023-10-07T08:47:38.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.200+0000 7f92a2b24700 1 --2- 172.21.15.81:0/3874529963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929c0cf080 0x7f929c06d1e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f92980098e0 tx=0x7f92980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e01c172f2888ab server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:38.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.200+0000 7f92a1321700 1 -- 172.21.15.81:0/3874529963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9298009e80 con 0x7f929c0cf080 2023-10-07T08:47:38.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.201+0000 7f92a1321700 1 -- 172.21.15.81:0/3874529963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929800b860 con 0x7f929c0cf080 2023-10-07T08:47:38.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.201+0000 7f92a1321700 1 -- 172.21.15.81:0/3874529963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929800bbe0 con 0x7f929c0cf080 2023-10-07T08:47:38.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.201+0000 7f92a3325700 1 -- 172.21.15.81:0/3874529963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929c0cf080 msgr2=0x7f929c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:38.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.201+0000 7f92a3325700 1 --2- 172.21.15.81:0/3874529963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929c0cf080 0x7f929c06d1e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f92980098e0 tx=0x7f92980091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.201+0000 7f92a3325700 1 -- 172.21.15.81:0/3874529963 shutdown_connections 2023-10-07T08:47:38.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.201+0000 7f92a3325700 1 --2- 172.21.15.81:0/3874529963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929c0cf080 0x7f929c06d1e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.201+0000 7f92a3325700 1 --2- 172.21.15.81:0/3874529963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929c06e4e0 0x7f929c06cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.201+0000 7f92a3325700 1 -- 172.21.15.81:0/3874529963 >> 172.21.15.81:0/3874529963 conn(0x7f929c068110 msgr2=0x7f929c06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:38.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.201+0000 7f92a3325700 1 -- 172.21.15.81:0/3874529963 shutdown_connections 2023-10-07T08:47:38.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.201+0000 7f92a3325700 1 -- 172.21.15.81:0/3874529963 wait complete. 2023-10-07T08:47:38.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.202+0000 7f92a3325700 1 Processor -- start 2023-10-07T08:47:38.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.202+0000 7f92a3325700 1 -- start start 2023-10-07T08:47:38.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a3325700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f929c06e4e0 0x7f929c0af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:38.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a3325700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929c0cf080 0x7f929c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:38.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a3325700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929c159cb0 0x7f929c16a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:38.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a3325700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c1571c0 con 0x7f929c159cb0 2023-10-07T08:47:38.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a3325700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0ab870 con 0x7f929c06e4e0 2023-10-07T08:47:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a3325700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c16b130 con 0x7f929c0cf080 2023-10-07T08:47:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a2b24700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929c159cb0 0x7f929c16a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a2b24700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929c159cb0 0x7f929c16a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36074/0 (socket says 172.21.15.81:36074) 2023-10-07T08:47:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a2b24700 1 -- 172.21.15.81:0/2103806633 learned_addr learned my addr 172.21.15.81:0/2103806633 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a2323700 1 --2- 172.21.15.81:0/2103806633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f929c06e4e0 0x7f929c0af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a1b22700 1 --2- 172.21.15.81:0/2103806633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929c0cf080 0x7f929c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a2b24700 1 -- 172.21.15.81:0/2103806633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929c0cf080 msgr2=0x7f929c156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a2b24700 1 --2- 172.21.15.81:0/2103806633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929c0cf080 0x7f929c156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a2b24700 1 -- 172.21.15.81:0/2103806633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f929c06e4e0 msgr2=0x7f929c0af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a2b24700 1 --2- 172.21.15.81:0/2103806633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f929c06e4e0 0x7f929c0af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a2b24700 1 -- 172.21.15.81:0/2103806633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9298009420 con 0x7f929c159cb0 2023-10-07T08:47:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a2323700 1 --2- 172.21.15.81:0/2103806633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f929c06e4e0 0x7f929c0af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:47:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92a2b24700 1 --2- 172.21.15.81:0/2103806633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929c159cb0 0x7f929c16a190 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f929c0632d0 tx=0x7f9298017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.203+0000 7f92927fc700 1 -- 172.21.15.81:0/2103806633 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9298011630 con 0x7f929c159cb0 2023-10-07T08:47:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.204+0000 7f92927fc700 1 -- 172.21.15.81:0/2103806633 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92980117d0 con 0x7f929c159cb0 2023-10-07T08:47:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.204+0000 7f92a3325700 1 -- 172.21.15.81:0/2103806633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929c16ab70 con 0x7f929c159cb0 2023-10-07T08:47:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.204+0000 7f92927fc700 1 -- 172.21.15.81:0/2103806633 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9298011b90 con 0x7f929c159cb0 2023-10-07T08:47:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.204+0000 7f92a3325700 1 -- 172.21.15.81:0/2103806633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929c0ab500 con 0x7f929c159cb0 2023-10-07T08:47:38.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.204+0000 7f92a3325700 1 -- 172.21.15.81:0/2103806633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929c069c00 con 0x7f929c159cb0 2023-10-07T08:47:38.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.205+0000 7f92927fc700 1 -- 172.21.15.81:0/2103806633 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f92980253f0 con 0x7f929c159cb0 2023-10-07T08:47:38.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.205+0000 7f92927fc700 1 --2- 172.21.15.81:0/2103806633 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9280066f30 0x7f92800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:38.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.205+0000 7f92927fc700 1 -- 172.21.15.81:0/2103806633 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9298085f10 con 0x7f929c159cb0 2023-10-07T08:47:38.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.205+0000 7f92a2323700 1 --2- 172.21.15.81:0/2103806633 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9280066f30 0x7f92800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:38.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.206+0000 7f92a2323700 1 --2- 172.21.15.81:0/2103806633 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9280066f30 0x7f92800693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f929400e280 tx=0x7f9294009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:38.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.209+0000 7f92927fc700 1 -- 172.21.15.81:0/2103806633 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9298053480 con 0x7f929c159cb0 2023-10-07T08:47:38.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.393+0000 7f92a3325700 1 -- 172.21.15.81:0/2103806633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f929c0aabd0 con 0x7f929c159cb0 2023-10-07T08:47:38.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.398+0000 7f92927fc700 1 -- 172.21.15.81:0/2103806633 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9298056aa0 con 0x7f929c159cb0 2023-10-07T08:47:38.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.400+0000 7f92a3325700 1 -- 172.21.15.81:0/2103806633 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9280066f30 msgr2=0x7f92800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:38.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.400+0000 7f92a3325700 1 --2- 172.21.15.81:0/2103806633 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9280066f30 0x7f92800693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f929400e280 tx=0x7f9294009040 comp rx=0 tx=0).stop 2023-10-07T08:47:38.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.400+0000 7f92a3325700 1 -- 172.21.15.81:0/2103806633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929c159cb0 msgr2=0x7f929c16a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:38.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.400+0000 7f92a3325700 1 --2- 172.21.15.81:0/2103806633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929c159cb0 0x7f929c16a190 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f929c0632d0 tx=0x7f9298017000 comp rx=0 tx=0).stop 2023-10-07T08:47:38.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.400+0000 7f92a3325700 1 -- 172.21.15.81:0/2103806633 shutdown_connections 2023-10-07T08:47:38.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.400+0000 7f92a3325700 1 --2- 172.21.15.81:0/2103806633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f929c159cb0 0x7f929c16a190 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.401+0000 7f92a3325700 1 --2- 172.21.15.81:0/2103806633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f929c06e4e0 0x7f929c0af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.401+0000 7f92a3325700 1 --2- 172.21.15.81:0/2103806633 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9280066f30 0x7f92800693e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.401+0000 7f92a3325700 1 --2- 172.21.15.81:0/2103806633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929c0cf080 0x7f929c156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.401+0000 7f92a3325700 1 -- 172.21.15.81:0/2103806633 >> 172.21.15.81:0/2103806633 conn(0x7f929c068110 msgr2=0x7f929c06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:38.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.401+0000 7f92a3325700 1 -- 172.21.15.81:0/2103806633 shutdown_connections 2023-10-07T08:47:38.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.401+0000 7f92a3325700 1 -- 172.21.15.81:0/2103806633 wait complete. 2023-10-07T08:47:38.414 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:47:38.414 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:47:38.451 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:47:38.495 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:47:38.495 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T08:47:38.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:47:38.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.608+0000 7f82786bf700 1 Processor -- start 2023-10-07T08:47:38.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.608+0000 7f82786bf700 1 -- start start 2023-10-07T08:47:38.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f82786bf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8270157ca0 0x7f82700cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:38.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f82786bf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f827006d120 0x7f827006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:38.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f82786bf700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827006dac0 con 0x7f82701578d0 2023-10-07T08:47:38.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f82786bf700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82700d07c0 con 0x7f827006d120 2023-10-07T08:47:38.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f82786bf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82700cfbb0 con 0x7f8270157ca0 2023-10-07T08:47:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f8276c5c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f827006d120 0x7f827006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f827645b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f82701578d0 0x7f827015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55614/0 (socket says 172.21.15.81:55614) 2023-10-07T08:47:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f8276c5c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f827006d120 0x7f827006d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36076/0 (socket says 172.21.15.81:36076) 2023-10-07T08:47:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f827645b700 1 -- 172.21.15.81:0/3631230634 learned_addr learned my addr 172.21.15.81:0/3631230634 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f8275c5a700 1 --2- 172.21.15.81:0/3631230634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8270157ca0 0x7f82700cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f8276c5c700 1 -- 172.21.15.81:0/3631230634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8270157ca0 msgr2=0x7f82700cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f8276c5c700 1 --2- 172.21.15.81:0/3631230634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8270157ca0 0x7f82700cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f8276c5c700 1 -- 172.21.15.81:0/3631230634 >> v1:172.21.15.81:6789/0 conn(0x7f82701578d0 legacy=0x7f827015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f8276c5c700 1 -- 172.21.15.81:0/3631230634 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82700cfe90 con 0x7f827006d120 2023-10-07T08:47:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f8275459700 1 -- 172.21.15.81:0/3631230634 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497044871 0 0) 0x7f826c001110 con 0x7f82701578d0 2023-10-07T08:47:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f8276c5c700 1 --2- 172.21.15.81:0/3631230634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827006d120 0x7f827006d580 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8268009e60 tx=0x7f8268009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3115f5b46d151953 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f8275459700 1 -- 172.21.15.81:0/3631230634 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826800e070 con 0x7f827006d120 2023-10-07T08:47:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f8275459700 1 -- 172.21.15.81:0/3631230634 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826800bc30 con 0x7f827006d120 2023-10-07T08:47:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.609+0000 7f8275459700 1 -- 172.21.15.81:0/3631230634 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268012430 con 0x7f827006d120 2023-10-07T08:47:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.610+0000 7f82786bf700 1 -- 172.21.15.81:0/3631230634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827006d120 msgr2=0x7f827006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.610+0000 7f82786bf700 1 --2- 172.21.15.81:0/3631230634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827006d120 0x7f827006d580 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8268009e60 tx=0x7f8268009780 comp rx=0 tx=0).stop 2023-10-07T08:47:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.610+0000 7f82786bf700 1 -- 172.21.15.81:0/3631230634 shutdown_connections 2023-10-07T08:47:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.610+0000 7f82786bf700 1 --2- 172.21.15.81:0/3631230634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827006d120 0x7f827006d580 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.610+0000 7f82786bf700 1 --2- 172.21.15.81:0/3631230634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8270157ca0 0x7f82700cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.610+0000 7f82786bf700 1 -- 172.21.15.81:0/3631230634 >> 172.21.15.81:0/3631230634 conn(0x7f827006bb90 msgr2=0x7f827006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.610+0000 7f82786bf700 1 -- 172.21.15.81:0/3631230634 shutdown_connections 2023-10-07T08:47:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.610+0000 7f82786bf700 1 -- 172.21.15.81:0/3631230634 wait complete. 2023-10-07T08:47:38.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.611+0000 7f82786bf700 1 Processor -- start 2023-10-07T08:47:38.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.611+0000 7f82786bf700 1 -- start start 2023-10-07T08:47:38.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f82786bf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827006d120 0x7f8270149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:38.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f82786bf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82701578d0 0x7f8270169e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:38.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f82786bf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8270157ca0 0x7f82700ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:38.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f82786bf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8270149d70 con 0x7f827006d120 2023-10-07T08:47:38.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f82786bf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82700b4b70 con 0x7f8270157ca0 2023-10-07T08:47:38.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f82786bf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82700b4e50 con 0x7f82701578d0 2023-10-07T08:47:38.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f827645b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827006d120 0x7f8270149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:38.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f827645b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827006d120 0x7f8270149830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36080/0 (socket says 172.21.15.81:36080) 2023-10-07T08:47:38.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f827645b700 1 -- 172.21.15.81:0/325452893 learned_addr learned my addr 172.21.15.81:0/325452893 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:38.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f8275c5a700 1 --2- 172.21.15.81:0/325452893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82701578d0 0x7f8270169e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:38.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f8276c5c700 1 --2- 172.21.15.81:0/325452893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8270157ca0 0x7f82700ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:38.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f827645b700 1 -- 172.21.15.81:0/325452893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82701578d0 msgr2=0x7f8270169e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:38.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f827645b700 1 --2- 172.21.15.81:0/325452893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82701578d0 0x7f8270169e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f827645b700 1 -- 172.21.15.81:0/325452893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8270157ca0 msgr2=0x7f82700ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:38.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f827645b700 1 --2- 172.21.15.81:0/325452893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8270157ca0 0x7f82700ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f827645b700 1 -- 172.21.15.81:0/325452893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8268009a20 con 0x7f827006d120 2023-10-07T08:47:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f827645b700 1 --2- 172.21.15.81:0/325452893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827006d120 0x7f8270149830 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f826c00c810 tx=0x7f826c007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f82667fc700 1 -- 172.21.15.81:0/325452893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c005b30 con 0x7f827006d120 2023-10-07T08:47:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f82667fc700 1 -- 172.21.15.81:0/325452893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c005c90 con 0x7f827006d120 2023-10-07T08:47:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f82786bf700 1 -- 172.21.15.81:0/325452893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82700b5130 con 0x7f827006d120 2023-10-07T08:47:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.612+0000 7f82667fc700 1 -- 172.21.15.81:0/325452893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c007300 con 0x7f827006d120 2023-10-07T08:47:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.613+0000 7f82786bf700 1 -- 172.21.15.81:0/325452893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82700b56f0 con 0x7f827006d120 2023-10-07T08:47:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.613+0000 7f82786bf700 1 -- 172.21.15.81:0/325452893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82700b5910 con 0x7f827006d120 2023-10-07T08:47:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.614+0000 7f82667fc700 1 -- 172.21.15.81:0/325452893 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f826c01b3b0 con 0x7f827006d120 2023-10-07T08:47:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.614+0000 7f82667fc700 1 --2- 172.21.15.81:0/325452893 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8254066f30 0x7f82540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.614+0000 7f82667fc700 1 -- 172.21.15.81:0/325452893 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f826c083540 con 0x7f827006d120 2023-10-07T08:47:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.614+0000 7f8275c5a700 1 --2- 172.21.15.81:0/325452893 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8254066f30 0x7f82540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.615+0000 7f8275c5a700 1 --2- 172.21.15.81:0/325452893 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8254066f30 0x7f82540693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8260006fd0 tx=0x7f8260008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.618+0000 7f82667fc700 1 -- 172.21.15.81:0/325452893 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f826c050ab0 con 0x7f827006d120 2023-10-07T08:47:38.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.844+0000 7f82786bf700 1 -- 172.21.15.81:0/325452893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f827006dac0 con 0x7f827006d120 2023-10-07T08:47:38.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.844+0000 7f82667fc700 1 -- 172.21.15.81:0/325452893 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f827006dac0 con 0x7f827006d120 2023-10-07T08:47:38.846 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:38.846 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/401991459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":401991459},{"type":"v1","addr":"172.21.15.89:6834","nonce":401991459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5608,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2214247931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2214247931},{"type":"v1","addr":"172.21.15.81:6836","nonce":2214247931}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5620,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1168741718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1168741718},{"type":"v1","addr":"172.21.15.89:6835","nonce":1168741718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1026569330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1026569330},{"type":"v1","addr":"172.21.15.81:6837","nonce":1026569330}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[]} 2023-10-07T08:47:38.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.847+0000 7f82786bf700 1 -- 172.21.15.81:0/325452893 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8254066f30 msgr2=0x7f82540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:38.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.847+0000 7f82786bf700 1 --2- 172.21.15.81:0/325452893 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8254066f30 0x7f82540693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8260006fd0 tx=0x7f8260008040 comp rx=0 tx=0).stop 2023-10-07T08:47:38.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.847+0000 7f82786bf700 1 -- 172.21.15.81:0/325452893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827006d120 msgr2=0x7f8270149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.847+0000 7f82786bf700 1 --2- 172.21.15.81:0/325452893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827006d120 0x7f8270149830 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f826c00c810 tx=0x7f826c007c50 comp rx=0 tx=0).stop 2023-10-07T08:47:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.847+0000 7f82786bf700 1 -- 172.21.15.81:0/325452893 shutdown_connections 2023-10-07T08:47:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.847+0000 7f82786bf700 1 --2- 172.21.15.81:0/325452893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8270157ca0 0x7f82700ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.847+0000 7f82786bf700 1 --2- 172.21.15.81:0/325452893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827006d120 0x7f8270149830 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.847+0000 7f82786bf700 1 --2- 172.21.15.81:0/325452893 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8254066f30 0x7f82540693e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.847+0000 7f82786bf700 1 --2- 172.21.15.81:0/325452893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82701578d0 0x7f8270169e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.847+0000 7f82786bf700 1 -- 172.21.15.81:0/325452893 >> 172.21.15.81:0/325452893 conn(0x7f827006bb90 msgr2=0x7f8270155c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.847+0000 7f82786bf700 1 -- 172.21.15.81:0/325452893 shutdown_connections 2023-10-07T08:47:38.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:38.847+0000 7f82786bf700 1 -- 172.21.15.81:0/325452893 wait complete. 2023-10-07T08:47:38.850 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 42 2023-10-07T08:47:38.860 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T08:47:38.860 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T08:47:38.861 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T08:47:38.861 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:47:38.861 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T08:47:38.861 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T08:47:38.861 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T08:47:38.861 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:47:38.862 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T08:47:38.862 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T08:47:38.862 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T08:47:38.862 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:47:38.862 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T08:47:38.862 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T08:47:38.863 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T08:47:38.863 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:47:38.869 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T08:47:38.870 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T08:47:38.870 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T08:47:38.871 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T08:47:38.873 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T08:47:38.873 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T08:47:38.911 INFO:tasks.ceph.mds.a:Started 2023-10-07T08:47:38.912 DEBUG:teuthology.parallel:result is None 2023-10-07T08:47:38.912 INFO:tasks.ceph.mds.c:Started 2023-10-07T08:47:38.912 DEBUG:teuthology.parallel:result is None 2023-10-07T08:47:38.916 INFO:tasks.ceph.mds.d:Started 2023-10-07T08:47:38.916 DEBUG:teuthology.parallel:result is None 2023-10-07T08:47:38.984 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-07T08:47:38.985 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-07T08:47:38.996 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-10-07T08:47:42.852 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-07T08:47:44.873 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T08:47:44.873 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T08:47:44.876 INFO:tasks.ceph.mds.b:Started 2023-10-07T08:47:44.877 DEBUG:teuthology.parallel:result is None 2023-10-07T08:47:44.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T08:47:44.957 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-10-07T08:47:45.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.002+0000 7f6277e14700 1 Processor -- start 2023-10-07T08:47:45.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.003+0000 7f6277e14700 1 -- start start 2023-10-07T08:47:45.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.003+0000 7f6277e14700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f62701578d0 0x7f62700cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:45.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.003+0000 7f6277e14700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f627006d120 0x7f627006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:45.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.003+0000 7f6277e14700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62700d07c0 con 0x7f6270157ca0 2023-10-07T08:47:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.003+0000 7f6277e14700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627006da50 con 0x7f627006d120 2023-10-07T08:47:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.003+0000 7f6277e14700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62700cfbb0 con 0x7f62701578d0 2023-10-07T08:47:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.003+0000 7f62763b1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f627006d120 0x7f627006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.004+0000 7f62763b1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f627006d120 0x7f627006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39036/0 (socket says 172.21.15.81:39036) 2023-10-07T08:47:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.004+0000 7f62763b1700 1 -- 172.21.15.81:0/2119835355 learned_addr learned my addr 172.21.15.81:0/2119835355 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.004+0000 7f6275bb0700 1 --2- 172.21.15.81:0/2119835355 >> v2:172.21.15.89:3300/0 conn(0x7f62701578d0 0x7f62700cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.004+0000 7f62763b1700 1 -- 172.21.15.81:0/2119835355 >> v2:172.21.15.89:3300/0 conn(0x7f62701578d0 msgr2=0x7f62700cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.004+0000 7f62763b1700 1 --2- 172.21.15.81:0/2119835355 >> v2:172.21.15.89:3300/0 conn(0x7f62701578d0 0x7f62700cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.004+0000 7f62763b1700 1 -- 172.21.15.81:0/2119835355 >> v1:172.21.15.89:6789/0 conn(0x7f6270157ca0 legacy=0x7f627015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.004+0000 7f62763b1700 1 -- 172.21.15.81:0/2119835355 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700cfe90 con 0x7f627006d120 2023-10-07T08:47:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.004+0000 7f62763b1700 1 --2- 172.21.15.81:0/2119835355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f627006d120 0x7f627006d510 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f62700646b0 tx=0x7f6268009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28d2e5f1b8d6cec server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.004+0000 7f6274bae700 1 -- 172.21.15.81:0/2119835355 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626800e070 con 0x7f627006d120 2023-10-07T08:47:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.004+0000 7f6274bae700 1 -- 172.21.15.81:0/2119835355 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626800ba10 con 0x7f627006d120 2023-10-07T08:47:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.004+0000 7f6274bae700 1 -- 172.21.15.81:0/2119835355 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62680092e0 con 0x7f627006d120 2023-10-07T08:47:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.005+0000 7f6277e14700 1 -- 172.21.15.81:0/2119835355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f627006d120 msgr2=0x7f627006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.005+0000 7f6277e14700 1 --2- 172.21.15.81:0/2119835355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f627006d120 0x7f627006d510 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f62700646b0 tx=0x7f6268009840 comp rx=0 tx=0).stop 2023-10-07T08:47:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.005+0000 7f6277e14700 1 -- 172.21.15.81:0/2119835355 shutdown_connections 2023-10-07T08:47:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.005+0000 7f6277e14700 1 --2- 172.21.15.81:0/2119835355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f627006d120 0x7f627006d510 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.005+0000 7f6277e14700 1 --2- 172.21.15.81:0/2119835355 >> v2:172.21.15.89:3300/0 conn(0x7f62701578d0 0x7f62700cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.005+0000 7f6277e14700 1 -- 172.21.15.81:0/2119835355 >> 172.21.15.81:0/2119835355 conn(0x7f627006bb90 msgr2=0x7f627006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.005+0000 7f6277e14700 1 -- 172.21.15.81:0/2119835355 shutdown_connections 2023-10-07T08:47:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.005+0000 7f6277e14700 1 -- 172.21.15.81:0/2119835355 wait complete. 2023-10-07T08:47:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.006+0000 7f6277e14700 1 Processor -- start 2023-10-07T08:47:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.006+0000 7f6277e14700 1 -- start start 2023-10-07T08:47:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.006+0000 7f6277e14700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f627006d120 0x7f6270154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.006+0000 7f6277e14700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62701578d0 0x7f62700aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.006+0000 7f6277e14700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6270157ca0 0x7f62700b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f6277e14700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62700abf60 con 0x7f6270157ca0 2023-10-07T08:47:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f6277e14700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62700ab350 con 0x7f627006d120 2023-10-07T08:47:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f6277e14700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62700ab630 con 0x7f62701578d0 2023-10-07T08:47:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f62763b1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6270157ca0 0x7f62700b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f62763b1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6270157ca0 0x7f62700b22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39038/0 (socket says 172.21.15.81:39038) 2023-10-07T08:47:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f62763b1700 1 -- 172.21.15.81:0/2466130868 learned_addr learned my addr 172.21.15.81:0/2466130868 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f6275bb0700 1 --2- 172.21.15.81:0/2466130868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f627006d120 0x7f6270154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f62753af700 1 --2- 172.21.15.81:0/2466130868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62701578d0 0x7f62700aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f62763b1700 1 -- 172.21.15.81:0/2466130868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62701578d0 msgr2=0x7f62700aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f62763b1700 1 --2- 172.21.15.81:0/2466130868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62701578d0 0x7f62700aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f62763b1700 1 -- 172.21.15.81:0/2466130868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f627006d120 msgr2=0x7f6270154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f62763b1700 1 --2- 172.21.15.81:0/2466130868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f627006d120 0x7f6270154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f62763b1700 1 -- 172.21.15.81:0/2466130868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268009ae0 con 0x7f6270157ca0 2023-10-07T08:47:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f62763b1700 1 --2- 172.21.15.81:0/2466130868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6270157ca0 0x7f62700b22c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f627006fe20 tx=0x7f6268017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f6265ffb700 1 -- 172.21.15.81:0/2466130868 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626800bee0 con 0x7f6270157ca0 2023-10-07T08:47:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f6265ffb700 1 -- 172.21.15.81:0/2466130868 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62680032f0 con 0x7f6270157ca0 2023-10-07T08:47:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f6265ffb700 1 -- 172.21.15.81:0/2466130868 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626801d420 con 0x7f6270157ca0 2023-10-07T08:47:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.007+0000 7f6277e14700 1 -- 172.21.15.81:0/2466130868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62700ab910 con 0x7f6270157ca0 2023-10-07T08:47:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.008+0000 7f6277e14700 1 -- 172.21.15.81:0/2466130868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6270155150 con 0x7f6270157ca0 2023-10-07T08:47:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.008+0000 7f6277e14700 1 -- 172.21.15.81:0/2466130868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6270067ac0 con 0x7f6270157ca0 2023-10-07T08:47:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.009+0000 7f6265ffb700 1 -- 172.21.15.81:0/2466130868 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f626801d850 con 0x7f6270157ca0 2023-10-07T08:47:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.009+0000 7f6265ffb700 1 --2- 172.21.15.81:0/2466130868 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6254066f30 0x7f62540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.010+0000 7f6265ffb700 1 -- 172.21.15.81:0/2466130868 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6268085990 con 0x7f6270157ca0 2023-10-07T08:47:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.010+0000 7f6275bb0700 1 --2- 172.21.15.81:0/2466130868 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6254066f30 0x7f62540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:45.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.010+0000 7f6275bb0700 1 --2- 172.21.15.81:0/2466130868 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6254066f30 0x7f62540693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f626c006fd0 tx=0x7f626c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:45.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.014+0000 7f6265ffb700 1 -- 172.21.15.81:0/2466130868 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6268052f00 con 0x7f6270157ca0 2023-10-07T08:47:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:45.214+0000 7f6277e14700 1 -- 172.21.15.81:0/2466130868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f62700d0170 con 0x7f6270157ca0 2023-10-07T08:47:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.272+0000 7f6265ffb700 1 -- 172.21.15.81:0/2466130868 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v98) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6268056520 con 0x7f6270157ca0 2023-10-07T08:47:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.275+0000 7f6277e14700 1 -- 172.21.15.81:0/2466130868 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6254066f30 msgr2=0x7f62540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.275+0000 7f6277e14700 1 --2- 172.21.15.81:0/2466130868 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6254066f30 0x7f62540693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f626c006fd0 tx=0x7f626c008040 comp rx=0 tx=0).stop 2023-10-07T08:47:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.275+0000 7f6277e14700 1 -- 172.21.15.81:0/2466130868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6270157ca0 msgr2=0x7f62700b22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.275+0000 7f6277e14700 1 --2- 172.21.15.81:0/2466130868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6270157ca0 0x7f62700b22c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f627006fe20 tx=0x7f6268017000 comp rx=0 tx=0).stop 2023-10-07T08:47:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.275+0000 7f6277e14700 1 -- 172.21.15.81:0/2466130868 shutdown_connections 2023-10-07T08:47:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.275+0000 7f6277e14700 1 --2- 172.21.15.81:0/2466130868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6270157ca0 0x7f62700b22c0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.275+0000 7f6277e14700 1 --2- 172.21.15.81:0/2466130868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f627006d120 0x7f6270154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.275+0000 7f6277e14700 1 --2- 172.21.15.81:0/2466130868 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6254066f30 0x7f62540693e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.275+0000 7f6277e14700 1 --2- 172.21.15.81:0/2466130868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62701578d0 0x7f62700aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.275+0000 7f6277e14700 1 -- 172.21.15.81:0/2466130868 >> 172.21.15.81:0/2466130868 conn(0x7f627006bb90 msgr2=0x7f6270155500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:46.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.275+0000 7f6277e14700 1 -- 172.21.15.81:0/2466130868 shutdown_connections 2023-10-07T08:47:46.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.275+0000 7f6277e14700 1 -- 172.21.15.81:0/2466130868 wait complete. 2023-10-07T08:47:46.277 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-07T08:47:46.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T08:47:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.403+0000 7fbc6c9ab700 1 Processor -- start 2023-10-07T08:47:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.403+0000 7fbc6c9ab700 1 -- start start 2023-10-07T08:47:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.404+0000 7fbc6c9ab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc681578d0 0x7fbc680cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.404+0000 7fbc6c9ab700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbc68157ca0 0x7fbc6815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.404+0000 7fbc6c9ab700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc680d07c0 con 0x7fbc6806d120 2023-10-07T08:47:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.404+0000 7fbc6c9ab700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc680cfbb0 con 0x7fbc68157ca0 2023-10-07T08:47:46.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.404+0000 7fbc6c9ab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680cfe90 con 0x7fbc681578d0 2023-10-07T08:47:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.404+0000 7fbc5dd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbc68157ca0 0x7fbc6815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.404+0000 7fbc66d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbc6806d120 0x7fbc6815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35676/0 (socket says 172.21.15.81:35676) 2023-10-07T08:47:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.404+0000 7fbc66d9d700 1 -- 172.21.15.81:0/1464327689 learned_addr learned my addr 172.21.15.81:0/1464327689 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.405+0000 7fbc5dd9b700 1 -- 172.21.15.81:0/1464327689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc681578d0 msgr2=0x7fbc680cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.405+0000 7fbc5dd9b700 1 --2- 172.21.15.81:0/1464327689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc681578d0 0x7fbc680cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.405+0000 7fbc5dd9b700 1 -- 172.21.15.81:0/1464327689 >> v1:172.21.15.81:6789/0 conn(0x7fbc6806d120 legacy=0x7fbc6815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.405+0000 7fbc5dd9b700 1 -- 172.21.15.81:0/1464327689 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc680d0170 con 0x7fbc68157ca0 2023-10-07T08:47:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.405+0000 7fbc65d9b700 1 -- 172.21.15.81:0/1464327689 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252286012 0 0) 0x7fbc680d07c0 con 0x7fbc6806d120 2023-10-07T08:47:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.405+0000 7fbc5dd9b700 1 --2- 172.21.15.81:0/1464327689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc68157ca0 0x7fbc6815af00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fbc500098e0 tx=0x7fbc500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b462cf22b4cf9f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.405+0000 7fbc65d9b700 1 -- 172.21.15.81:0/1464327689 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50009e80 con 0x7fbc68157ca0 2023-10-07T08:47:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.405+0000 7fbc65d9b700 1 -- 172.21.15.81:0/1464327689 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5000b860 con 0x7fbc68157ca0 2023-10-07T08:47:46.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.405+0000 7fbc65d9b700 1 -- 172.21.15.81:0/1464327689 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5000bbe0 con 0x7fbc68157ca0 2023-10-07T08:47:46.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.405+0000 7fbc6c9ab700 1 -- 172.21.15.81:0/1464327689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc68157ca0 msgr2=0x7fbc6815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:46.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.405+0000 7fbc6c9ab700 1 --2- 172.21.15.81:0/1464327689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc68157ca0 0x7fbc6815af00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fbc500098e0 tx=0x7fbc500091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.405+0000 7fbc6c9ab700 1 -- 172.21.15.81:0/1464327689 shutdown_connections 2023-10-07T08:47:46.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.405+0000 7fbc6c9ab700 1 --2- 172.21.15.81:0/1464327689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc681578d0 0x7fbc680cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.405+0000 7fbc6c9ab700 1 --2- 172.21.15.81:0/1464327689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc68157ca0 0x7fbc6815af00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.405+0000 7fbc6c9ab700 1 -- 172.21.15.81:0/1464327689 >> 172.21.15.81:0/1464327689 conn(0x7fbc6806bb90 msgr2=0x7fbc6806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:46.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.406+0000 7fbc6c9ab700 1 -- 172.21.15.81:0/1464327689 shutdown_connections 2023-10-07T08:47:46.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.406+0000 7fbc6c9ab700 1 -- 172.21.15.81:0/1464327689 wait complete. 2023-10-07T08:47:46.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.407+0000 7fbc6c9ab700 1 Processor -- start 2023-10-07T08:47:46.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.407+0000 7fbc6c9ab700 1 -- start start 2023-10-07T08:47:46.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.407+0000 7fbc6c9ab700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc6806d120 0x7fbc680aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:46.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.407+0000 7fbc6c9ab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc681578d0 0x7fbc681580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.407+0000 7fbc6c9ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc68157ca0 0x7fbc681585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.407+0000 7fbc6c9ab700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680abc80 con 0x7fbc68157ca0 2023-10-07T08:47:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.407+0000 7fbc6c9ab700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680aadd0 con 0x7fbc6806d120 2023-10-07T08:47:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.407+0000 7fbc6c9ab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680ab070 con 0x7fbc681578d0 2023-10-07T08:47:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.408+0000 7fbc66d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc68157ca0 0x7fbc681585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.408+0000 7fbc66d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc68157ca0 0x7fbc681585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39052/0 (socket says 172.21.15.81:39052) 2023-10-07T08:47:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.408+0000 7fbc66d9d700 1 -- 172.21.15.81:0/2006382955 learned_addr learned my addr 172.21.15.81:0/2006382955 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.408+0000 7fbc5dd9b700 1 --2- 172.21.15.81:0/2006382955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc681578d0 0x7fbc681580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.408+0000 7fbc6659c700 1 --2- 172.21.15.81:0/2006382955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc6806d120 0x7fbc680aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.408+0000 7fbc66d9d700 1 -- 172.21.15.81:0/2006382955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc681578d0 msgr2=0x7fbc681580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.408+0000 7fbc66d9d700 1 --2- 172.21.15.81:0/2006382955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc681578d0 0x7fbc681580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.408+0000 7fbc66d9d700 1 -- 172.21.15.81:0/2006382955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc6806d120 msgr2=0x7fbc680aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:46.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.408+0000 7fbc66d9d700 1 --2- 172.21.15.81:0/2006382955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc6806d120 0x7fbc680aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.408+0000 7fbc66d9d700 1 -- 172.21.15.81:0/2006382955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc50009420 con 0x7fbc68157ca0 2023-10-07T08:47:46.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.408+0000 7fbc66d9d700 1 --2- 172.21.15.81:0/2006382955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc68157ca0 0x7fbc681585f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000cc90 tx=0x7fbc60001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:46.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.408+0000 7fbc5effd700 1 -- 172.21.15.81:0/2006382955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6000a960 con 0x7fbc68157ca0 2023-10-07T08:47:46.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.408+0000 7fbc5effd700 1 -- 172.21.15.81:0/2006382955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6000aac0 con 0x7fbc68157ca0 2023-10-07T08:47:46.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.408+0000 7fbc6c9ab700 1 -- 172.21.15.81:0/2006382955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc680ab350 con 0x7fbc68157ca0 2023-10-07T08:47:46.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.408+0000 7fbc5effd700 1 -- 172.21.15.81:0/2006382955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6000ae80 con 0x7fbc68157ca0 2023-10-07T08:47:46.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.408+0000 7fbc6c9ab700 1 -- 172.21.15.81:0/2006382955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc680ab910 con 0x7fbc68157ca0 2023-10-07T08:47:46.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.409+0000 7fbc6c9ab700 1 -- 172.21.15.81:0/2006382955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc680abdf0 con 0x7fbc68157ca0 2023-10-07T08:47:46.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.410+0000 7fbc5effd700 1 -- 172.21.15.81:0/2006382955 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc60007300 con 0x7fbc68157ca0 2023-10-07T08:47:46.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.410+0000 7fbc5effd700 1 --2- 172.21.15.81:0/2006382955 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbc48066f30 0x7fbc480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:46.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.410+0000 7fbc5effd700 1 -- 172.21.15.81:0/2006382955 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbc600845c0 con 0x7fbc68157ca0 2023-10-07T08:47:46.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.410+0000 7fbc6659c700 1 --2- 172.21.15.81:0/2006382955 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbc48066f30 0x7fbc480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:46.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.410+0000 7fbc6659c700 1 --2- 172.21.15.81:0/2006382955 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbc48066f30 0x7fbc480693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbc58006fd0 tx=0x7fbc58008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:46.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.414+0000 7fbc5effd700 1 -- 172.21.15.81:0/2006382955 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc60051c00 con 0x7fbc68157ca0 2023-10-07T08:47:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.672+0000 7fbc6c9ab700 1 -- 172.21.15.81:0/2006382955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbc680d0450 con 0x7fbc68157ca0 2023-10-07T08:47:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.672+0000 7fbc5effd700 1 -- 172.21.15.81:0/2006382955 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fbc60055220 con 0x7fbc68157ca0 2023-10-07T08:47:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:46.673 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:47:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-07T08:47:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-07T08:47:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlK8v0EhAAyj+l+ifyEevPT96HbuWzkw==", 2023-10-07T08:47:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:47:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:47:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:47:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:47:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-07T08:47:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlN0UcHhAA0o1jHEL9Ow40VDezKTunOw==", 2023-10-07T08:47:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:47:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:47:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:47:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:47:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-07T08:47:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlvsm6GRAApZehzqt3HugU+h9RGWQh8g==", 2023-10-07T08:47:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:47:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:47:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:47:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:47:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-07T08:47:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8XLiJBAAMBqSo/+NZuuL/pPnTitAUw==", 2023-10-07T08:47:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:47:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:47:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:47:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:47:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-07T08:47:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD2GSFlwYNOOBAAMpoFTAZdRERvqFbI4Lno9g==", 2023-10-07T08:47:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:47:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:47:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:47:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-07T08:47:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlejEnBBAAsnZCgsTTMWvqr2n4FfgWCQ==", 2023-10-07T08:47:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:47:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:47:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:47:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-07T08:47:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlDjS3DRAAfyBS9XSkAY6Se+RNw9jwWw==", 2023-10-07T08:47:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:47:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:47:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:47:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-07T08:47:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlnLaEFxAAtQ3AxrEGCcXYvJF2/wP1yw==", 2023-10-07T08:47:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:47:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:47:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:47:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-07T08:47:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlllNdIRAAXgD+PAR1Piya6p94xfGbXA==", 2023-10-07T08:47:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:47:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:47:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:47:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.683 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-07T08:47:46.683 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFleIM7KBAAIz+WlbgsmtAuSMPO+kh/Xw==", 2023-10-07T08:47:46.684 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.684 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:47:46.684 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:47:46.685 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:47:46.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-07T08:47:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlFNlEMRAAt7dpMTylOj0KsJy/law6Nw==", 2023-10-07T08:47:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:47:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:47:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:47:46.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.688 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-07T08:47:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFloCRbOhAA8XzXVwVYYYZIJV+F84EiDQ==", 2023-10-07T08:47:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:47:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:47:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:47:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-07T08:47:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl7cS0KBAA2K6kkFjyEZYa0xYx53Nf7g==", 2023-10-07T08:47:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:47:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-07T08:47:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T08:47:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-07T08:47:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlP3EBMRAAWXcQeEkoEzBCSQzvz/AzBQ==", 2023-10-07T08:47:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:47:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:47:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:47:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:47:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-07T08:47:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFldtgKLhAAX8L0S1NgyHsOj4cUljxH/A==", 2023-10-07T08:47:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:47:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:47:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:47:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:47:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-07T08:47:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlJ+VXNhAA9sXFpdOEIZxQLiS8LJwa3A==", 2023-10-07T08:47:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:47:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:47:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:47:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:47:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-07T08:47:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDyGSFle021MxAA39oudTkATALz6ZklfA0QQA==", 2023-10-07T08:47:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:47:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:47:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:47:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:47:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-07T08:47:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8c3zDxAAKU/DHPPZhFJ1MKw48C6lJQ==", 2023-10-07T08:47:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:47:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:47:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:47:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:47:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-07T08:47:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlByYuDBAA2xkiT3FNBRXjSMlu+GdRjg==", 2023-10-07T08:47:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:47:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:47:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:47:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:47:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:47:46.696 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:47:46.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.674+0000 7fbc6c9ab700 1 -- 172.21.15.81:0/2006382955 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbc48066f30 msgr2=0x7fbc480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:46.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.674+0000 7fbc6c9ab700 1 --2- 172.21.15.81:0/2006382955 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbc48066f30 0x7fbc480693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbc58006fd0 tx=0x7fbc58008040 comp rx=0 tx=0).stop 2023-10-07T08:47:46.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.674+0000 7fbc6c9ab700 1 -- 172.21.15.81:0/2006382955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc68157ca0 msgr2=0x7fbc681585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:46.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.674+0000 7fbc6c9ab700 1 --2- 172.21.15.81:0/2006382955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc68157ca0 0x7fbc681585f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000cc90 tx=0x7fbc60001a80 comp rx=0 tx=0).stop 2023-10-07T08:47:46.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.675+0000 7fbc6c9ab700 1 -- 172.21.15.81:0/2006382955 shutdown_connections 2023-10-07T08:47:46.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.675+0000 7fbc6c9ab700 1 --2- 172.21.15.81:0/2006382955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc68157ca0 0x7fbc681585f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.675+0000 7fbc6c9ab700 1 --2- 172.21.15.81:0/2006382955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc6806d120 0x7fbc680aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.675+0000 7fbc6c9ab700 1 --2- 172.21.15.81:0/2006382955 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbc48066f30 0x7fbc480693e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.675+0000 7fbc6c9ab700 1 --2- 172.21.15.81:0/2006382955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc681578d0 0x7fbc681580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.675+0000 7fbc6c9ab700 1 -- 172.21.15.81:0/2006382955 >> 172.21.15.81:0/2006382955 conn(0x7fbc6806bb90 msgr2=0x7fbc68068b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:46.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.675+0000 7fbc6c9ab700 1 -- 172.21.15.81:0/2006382955 shutdown_connections 2023-10-07T08:47:46.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.675+0000 7fbc6c9ab700 1 -- 172.21.15.81:0/2006382955 wait complete. 2023-10-07T08:47:46.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:47:46.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.812+0000 7f1c50b23700 1 Processor -- start 2023-10-07T08:47:46.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.812+0000 7f1c50b23700 1 -- start start 2023-10-07T08:47:46.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.813+0000 7f1c50b23700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1c4c159b40 0x7f1c4c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:46.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.813+0000 7f1c50b23700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1c4c068e90 0x7f1c4c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:46.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.813+0000 7f1c50b23700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4c0cee10 con 0x7f1c4c159f10 2023-10-07T08:47:46.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.813+0000 7f1c50b23700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c0cd040 con 0x7f1c4c068e90 2023-10-07T08:47:46.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.813+0000 7f1c50b23700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c0cd320 con 0x7f1c4c159b40 2023-10-07T08:47:46.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.813+0000 7f1c4bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1c4c068e90 0x7f1c4c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:46.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.813+0000 7f1c4affd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1c4c159f10 0x7f1c4c068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35688/0 (socket says 172.21.15.81:35688) 2023-10-07T08:47:46.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.813+0000 7f1c4affd700 1 -- 172.21.15.81:0/3364016631 learned_addr learned my addr 172.21.15.81:0/3364016631 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:46.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.813+0000 7f1c4b7fe700 1 --2- 172.21.15.81:0/3364016631 >> v2:172.21.15.89:3300/0 conn(0x7f1c4c159b40 0x7f1c4c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:46.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.813+0000 7f1c4bfff700 1 -- 172.21.15.81:0/3364016631 >> v2:172.21.15.89:3300/0 conn(0x7f1c4c159b40 msgr2=0x7f1c4c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:46.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.813+0000 7f1c4bfff700 1 --2- 172.21.15.81:0/3364016631 >> v2:172.21.15.89:3300/0 conn(0x7f1c4c159b40 0x7f1c4c0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.813+0000 7f1c4bfff700 1 -- 172.21.15.81:0/3364016631 >> v1:172.21.15.81:6789/0 conn(0x7f1c4c159f10 legacy=0x7f1c4c068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:46.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.813+0000 7f1c4bfff700 1 -- 172.21.15.81:0/3364016631 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c0ce7c0 con 0x7f1c4c068e90 2023-10-07T08:47:46.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.813+0000 7f1c4a7fc700 1 -- 172.21.15.81:0/3364016631 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921320687 0 0) 0x7f1c4c0cee10 con 0x7f1c4c159f10 2023-10-07T08:47:46.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.813+0000 7f1c4bfff700 1 --2- 172.21.15.81:0/3364016631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c068e90 0x7f1c4c0cf2a0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0d0bc0 tx=0x7f1c44009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcec34c57b5fe62 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:46.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.814+0000 7f1c4a7fc700 1 -- 172.21.15.81:0/3364016631 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4400e070 con 0x7f1c4c068e90 2023-10-07T08:47:46.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.814+0000 7f1c4a7fc700 1 -- 172.21.15.81:0/3364016631 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4400bb60 con 0x7f1c4c068e90 2023-10-07T08:47:46.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.814+0000 7f1c4a7fc700 1 -- 172.21.15.81:0/3364016631 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44012430 con 0x7f1c4c068e90 2023-10-07T08:47:46.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.814+0000 7f1c50b23700 1 -- 172.21.15.81:0/3364016631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c068e90 msgr2=0x7f1c4c0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:46.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.814+0000 7f1c50b23700 1 --2- 172.21.15.81:0/3364016631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c068e90 0x7f1c4c0cf2a0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0d0bc0 tx=0x7f1c44009780 comp rx=0 tx=0).stop 2023-10-07T08:47:46.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.814+0000 7f1c50b23700 1 -- 172.21.15.81:0/3364016631 shutdown_connections 2023-10-07T08:47:46.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.814+0000 7f1c50b23700 1 --2- 172.21.15.81:0/3364016631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c068e90 0x7f1c4c0cf2a0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.814+0000 7f1c50b23700 1 --2- 172.21.15.81:0/3364016631 >> v2:172.21.15.89:3300/0 conn(0x7f1c4c159b40 0x7f1c4c0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.814+0000 7f1c50b23700 1 -- 172.21.15.81:0/3364016631 >> 172.21.15.81:0/3364016631 conn(0x7f1c4c0cd660 msgr2=0x7f1c4c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:46.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.814+0000 7f1c50b23700 1 -- 172.21.15.81:0/3364016631 shutdown_connections 2023-10-07T08:47:46.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.814+0000 7f1c50b23700 1 -- 172.21.15.81:0/3364016631 wait complete. 2023-10-07T08:47:46.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.815+0000 7f1c50b23700 1 Processor -- start 2023-10-07T08:47:46.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.815+0000 7f1c50b23700 1 -- start start 2023-10-07T08:47:46.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.816+0000 7f1c50b23700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c4c068e90 0x7f1c4c0ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:46.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.816+0000 7f1c50b23700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c4c159b40 0x7f1c4c14bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.816+0000 7f1c50b23700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c159f10 0x7f1c4c149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.816+0000 7f1c50b23700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c14a610 con 0x7f1c4c159f10 2023-10-07T08:47:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.816+0000 7f1c50b23700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c149a00 con 0x7f1c4c068e90 2023-10-07T08:47:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.816+0000 7f1c50b23700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c149ce0 con 0x7f1c4c159b40 2023-10-07T08:47:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.816+0000 7f1c4bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c159f10 0x7f1c4c149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.816+0000 7f1c4bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c159f10 0x7f1c4c149150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39070/0 (socket says 172.21.15.81:39070) 2023-10-07T08:47:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.816+0000 7f1c4bfff700 1 -- 172.21.15.81:0/2200197196 learned_addr learned my addr 172.21.15.81:0/2200197196 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.816+0000 7f1c4b7fe700 1 --2- 172.21.15.81:0/2200197196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c4c068e90 0x7f1c4c0ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.816+0000 7f1c4bfff700 1 -- 172.21.15.81:0/2200197196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c4c159b40 msgr2=0x7f1c4c14bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.817+0000 7f1c4affd700 1 --2- 172.21.15.81:0/2200197196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c4c159b40 0x7f1c4c14bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.817+0000 7f1c4bfff700 1 --2- 172.21.15.81:0/2200197196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c4c159b40 0x7f1c4c14bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.817+0000 7f1c4bfff700 1 -- 172.21.15.81:0/2200197196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c4c068e90 msgr2=0x7f1c4c0ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.817+0000 7f1c4bfff700 1 --2- 172.21.15.81:0/2200197196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c4c068e90 0x7f1c4c0ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.817+0000 7f1c4bfff700 1 -- 172.21.15.81:0/2200197196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c44009a20 con 0x7f1c4c159f10 2023-10-07T08:47:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.817+0000 7f1c4b7fe700 1 --2- 172.21.15.81:0/2200197196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c4c068e90 0x7f1c4c0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.817+0000 7f1c4affd700 1 --2- 172.21.15.81:0/2200197196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c4c159b40 0x7f1c4c14bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.817+0000 7f1c4bfff700 1 --2- 172.21.15.81:0/2200197196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c159f10 0x7f1c4c149150 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009fd0 tx=0x7f1c44019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.817+0000 7f1c337fe700 1 -- 172.21.15.81:0/2200197196 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44012e00 con 0x7f1c4c159f10 2023-10-07T08:47:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.817+0000 7f1c337fe700 1 -- 172.21.15.81:0/2200197196 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4401d630 con 0x7f1c4c159f10 2023-10-07T08:47:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.817+0000 7f1c50b23700 1 -- 172.21.15.81:0/2200197196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4c149fc0 con 0x7f1c4c159f10 2023-10-07T08:47:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.817+0000 7f1c337fe700 1 -- 172.21.15.81:0/2200197196 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4401d9f0 con 0x7f1c4c159f10 2023-10-07T08:47:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.817+0000 7f1c50b23700 1 -- 172.21.15.81:0/2200197196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4c149690 con 0x7f1c4c159f10 2023-10-07T08:47:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.818+0000 7f1c50b23700 1 -- 172.21.15.81:0/2200197196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4c063e90 con 0x7f1c4c159f10 2023-10-07T08:47:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.818+0000 7f1c337fe700 1 -- 172.21.15.81:0/2200197196 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c44024070 con 0x7f1c4c159f10 2023-10-07T08:47:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.819+0000 7f1c337fe700 1 --2- 172.21.15.81:0/2200197196 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c38066f30 0x7f1c380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.819+0000 7f1c337fe700 1 -- 172.21.15.81:0/2200197196 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1c44086940 con 0x7f1c4c159f10 2023-10-07T08:47:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.819+0000 7f1c4b7fe700 1 --2- 172.21.15.81:0/2200197196 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c38066f30 0x7f1c380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.819+0000 7f1c4b7fe700 1 --2- 172.21.15.81:0/2200197196 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c38066f30 0x7f1c380693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c006f00 tx=0x7f1c3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:46.823+0000 7f1c337fe700 1 -- 172.21.15.81:0/2200197196 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c44053f00 con 0x7f1c4c159f10 2023-10-07T08:47:47.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.004+0000 7f1c50b23700 1 -- 172.21.15.81:0/2200197196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c4c14a750 con 0x7f1c4c159f10 2023-10-07T08:47:47.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.004+0000 7f1c337fe700 1 -- 172.21.15.81:0/2200197196 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+12087 (secure 0 0 0) 0x7f1c44057520 con 0x7f1c4c159f10 2023-10-07T08:47:47.005 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:47.005 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":98,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:47:46.269851+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:47:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.006+0000 7f1c50b23700 1 -- 172.21.15.81:0/2200197196 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c38066f30 msgr2=0x7f1c380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.006+0000 7f1c50b23700 1 --2- 172.21.15.81:0/2200197196 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c38066f30 0x7f1c380693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c006f00 tx=0x7f1c3c008040 comp rx=0 tx=0).stop 2023-10-07T08:47:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.006+0000 7f1c50b23700 1 -- 172.21.15.81:0/2200197196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c159f10 msgr2=0x7f1c4c149150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.006+0000 7f1c50b23700 1 --2- 172.21.15.81:0/2200197196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c159f10 0x7f1c4c149150 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009fd0 tx=0x7f1c44019000 comp rx=0 tx=0).stop 2023-10-07T08:47:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.006+0000 7f1c50b23700 1 -- 172.21.15.81:0/2200197196 shutdown_connections 2023-10-07T08:47:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.006+0000 7f1c50b23700 1 --2- 172.21.15.81:0/2200197196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4c159f10 0x7f1c4c149150 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.006+0000 7f1c50b23700 1 --2- 172.21.15.81:0/2200197196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c4c068e90 0x7f1c4c0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.006+0000 7f1c50b23700 1 --2- 172.21.15.81:0/2200197196 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c38066f30 0x7f1c380693e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.006+0000 7f1c50b23700 1 --2- 172.21.15.81:0/2200197196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c4c159b40 0x7f1c4c14bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.006+0000 7f1c50b23700 1 -- 172.21.15.81:0/2200197196 >> 172.21.15.81:0/2200197196 conn(0x7f1c4c0cd660 msgr2=0x7f1c4c06f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.006+0000 7f1c50b23700 1 -- 172.21.15.81:0/2200197196 shutdown_connections 2023-10-07T08:47:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.007+0000 7f1c50b23700 1 -- 172.21.15.81:0/2200197196 wait complete. 2023-10-07T08:47:47.019 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T08:47:47.019 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:47:47.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.136+0000 7f7dbde36700 1 Processor -- start 2023-10-07T08:47:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.136+0000 7f7dbde36700 1 -- start start 2023-10-07T08:47:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.136+0000 7f7dbde36700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7db81578d0 0x7f7db80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.136+0000 7f7dbde36700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7db806d120 0x7f7db806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.136+0000 7f7dbde36700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db80d07c0 con 0x7f7db8157ca0 2023-10-07T08:47:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.137+0000 7f7dbde36700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db806da50 con 0x7f7db81578d0 2023-10-07T08:47:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.137+0000 7f7dbde36700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db80cfbb0 con 0x7f7db806d120 2023-10-07T08:47:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.137+0000 7f7db77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7db81578d0 0x7f7db80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.137+0000 7f7db77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7db81578d0 0x7f7db80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39082/0 (socket says 172.21.15.81:39082) 2023-10-07T08:47:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.137+0000 7f7db77fe700 1 -- 172.21.15.81:0/933191169 learned_addr learned my addr 172.21.15.81:0/933191169 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.137+0000 7f7db7fff700 1 --2- 172.21.15.81:0/933191169 >> v2:172.21.15.89:3300/0 conn(0x7f7db806d120 0x7f7db806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.137+0000 7f7db77fe700 1 -- 172.21.15.81:0/933191169 >> v2:172.21.15.89:3300/0 conn(0x7f7db806d120 msgr2=0x7f7db806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.137+0000 7f7db77fe700 1 --2- 172.21.15.81:0/933191169 >> v2:172.21.15.89:3300/0 conn(0x7f7db806d120 0x7f7db806d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.137+0000 7f7db77fe700 1 -- 172.21.15.81:0/933191169 >> v1:172.21.15.89:6789/0 conn(0x7f7db8157ca0 legacy=0x7f7db815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.137+0000 7f7db77fe700 1 -- 172.21.15.81:0/933191169 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db80cfe90 con 0x7f7db81578d0 2023-10-07T08:47:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.137+0000 7f7db77fe700 1 --2- 172.21.15.81:0/933191169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db81578d0 0x7f7db80cf4f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7db8068300 tx=0x7f7da8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52db00ba84af00ff server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.137+0000 7f7db67fc700 1 -- 172.21.15.81:0/933191169 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da800e070 con 0x7f7db81578d0 2023-10-07T08:47:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.137+0000 7f7db67fc700 1 -- 172.21.15.81:0/933191169 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da800ba10 con 0x7f7db81578d0 2023-10-07T08:47:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.137+0000 7f7db67fc700 1 -- 172.21.15.81:0/933191169 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da80092e0 con 0x7f7db81578d0 2023-10-07T08:47:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.138+0000 7f7dbde36700 1 -- 172.21.15.81:0/933191169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db81578d0 msgr2=0x7f7db80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:47.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.138+0000 7f7dbde36700 1 --2- 172.21.15.81:0/933191169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db81578d0 0x7f7db80cf4f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7db8068300 tx=0x7f7da8009840 comp rx=0 tx=0).stop 2023-10-07T08:47:47.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.138+0000 7f7dbde36700 1 -- 172.21.15.81:0/933191169 shutdown_connections 2023-10-07T08:47:47.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.138+0000 7f7dbde36700 1 --2- 172.21.15.81:0/933191169 >> v2:172.21.15.89:3300/0 conn(0x7f7db806d120 0x7f7db806d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.138+0000 7f7dbde36700 1 --2- 172.21.15.81:0/933191169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db81578d0 0x7f7db80cf4f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.138+0000 7f7dbde36700 1 -- 172.21.15.81:0/933191169 >> 172.21.15.81:0/933191169 conn(0x7f7db806bb90 msgr2=0x7f7db806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:47.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.138+0000 7f7dbde36700 1 -- 172.21.15.81:0/933191169 shutdown_connections 2023-10-07T08:47:47.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.138+0000 7f7dbde36700 1 -- 172.21.15.81:0/933191169 wait complete. 2023-10-07T08:47:47.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.139+0000 7f7dbde36700 1 Processor -- start 2023-10-07T08:47:47.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.139+0000 7f7dbde36700 1 -- start start 2023-10-07T08:47:47.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7dbde36700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db806d120 0x7f7db8153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7dbde36700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7db81578d0 0x7f7db80c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7dbde36700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7db8157ca0 0x7f7db8069d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7dbde36700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db80c81a0 con 0x7f7db806d120 2023-10-07T08:47:47.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7dbde36700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db816d9e0 con 0x7f7db8157ca0 2023-10-07T08:47:47.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7dbde36700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db816dcc0 con 0x7f7db81578d0 2023-10-07T08:47:47.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7db77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db806d120 0x7f7db8153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7db77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db806d120 0x7f7db8153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39088/0 (socket says 172.21.15.81:39088) 2023-10-07T08:47:47.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7db77fe700 1 -- 172.21.15.81:0/2981078327 learned_addr learned my addr 172.21.15.81:0/2981078327 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:47.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7db7fff700 1 --2- 172.21.15.81:0/2981078327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7db8157ca0 0x7f7db8069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7db6ffd700 1 --2- 172.21.15.81:0/2981078327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7db81578d0 0x7f7db80c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7db77fe700 1 -- 172.21.15.81:0/2981078327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7db81578d0 msgr2=0x7f7db80c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:47.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7db77fe700 1 --2- 172.21.15.81:0/2981078327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7db81578d0 0x7f7db80c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7db77fe700 1 -- 172.21.15.81:0/2981078327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7db8157ca0 msgr2=0x7f7db8069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:47.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7db77fe700 1 --2- 172.21.15.81:0/2981078327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7db8157ca0 0x7f7db8069d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7db77fe700 1 -- 172.21.15.81:0/2981078327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da8009ae0 con 0x7f7db806d120 2023-10-07T08:47:47.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.140+0000 7f7db7fff700 1 --2- 172.21.15.81:0/2981078327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7db8157ca0 0x7f7db8069d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:47.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.141+0000 7f7db77fe700 1 --2- 172.21.15.81:0/2981078327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db806d120 0x7f7db8153a70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7db806fe20 tx=0x7f7da8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:47.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.141+0000 7f7d9f7fe700 1 -- 172.21.15.81:0/2981078327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da8012a20 con 0x7f7db806d120 2023-10-07T08:47:47.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.141+0000 7f7d9f7fe700 1 -- 172.21.15.81:0/2981078327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da8012b80 con 0x7f7db806d120 2023-10-07T08:47:47.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.141+0000 7f7dbde36700 1 -- 172.21.15.81:0/2981078327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db816dfa0 con 0x7f7db806d120 2023-10-07T08:47:47.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.141+0000 7f7d9f7fe700 1 -- 172.21.15.81:0/2981078327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da801d420 con 0x7f7db806d120 2023-10-07T08:47:47.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.141+0000 7f7dbde36700 1 -- 172.21.15.81:0/2981078327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db816e7a0 con 0x7f7db806d120 2023-10-07T08:47:47.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.142+0000 7f7dbde36700 1 -- 172.21.15.81:0/2981078327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db8067ac0 con 0x7f7db806d120 2023-10-07T08:47:47.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.142+0000 7f7d9f7fe700 1 -- 172.21.15.81:0/2981078327 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7da801d810 con 0x7f7db806d120 2023-10-07T08:47:47.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.143+0000 7f7d9f7fe700 1 --2- 172.21.15.81:0/2981078327 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7da4066fb0 0x7f7da4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.143+0000 7f7db6ffd700 1 --2- 172.21.15.81:0/2981078327 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7da4066fb0 0x7f7da4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.143+0000 7f7d9f7fe700 1 -- 172.21.15.81:0/2981078327 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7da8085c90 con 0x7f7db806d120 2023-10-07T08:47:47.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.143+0000 7f7db6ffd700 1 --2- 172.21.15.81:0/2981078327 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7da4066fb0 0x7f7da4069460 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7dac006fd0 tx=0x7f7dac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:47.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.147+0000 7f7d9f7fe700 1 -- 172.21.15.81:0/2981078327 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7da80531b0 con 0x7f7db806d120 2023-10-07T08:47:47.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.327+0000 7f7dbde36700 1 -- 172.21.15.81:0/2981078327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7db80d0170 con 0x7f7db806d120 2023-10-07T08:47:47.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.327+0000 7f7d9f7fe700 1 -- 172.21.15.81:0/2981078327 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7da80567d0 con 0x7f7db806d120 2023-10-07T08:47:47.328 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:47:47.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.329+0000 7f7dbde36700 1 -- 172.21.15.81:0/2981078327 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7da4066fb0 msgr2=0x7f7da4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:47.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.329+0000 7f7dbde36700 1 --2- 172.21.15.81:0/2981078327 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7da4066fb0 0x7f7da4069460 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7dac006fd0 tx=0x7f7dac008040 comp rx=0 tx=0).stop 2023-10-07T08:47:47.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.329+0000 7f7dbde36700 1 -- 172.21.15.81:0/2981078327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db806d120 msgr2=0x7f7db8153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:47.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.329+0000 7f7dbde36700 1 --2- 172.21.15.81:0/2981078327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db806d120 0x7f7db8153a70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7db806fe20 tx=0x7f7da8017000 comp rx=0 tx=0).stop 2023-10-07T08:47:47.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.329+0000 7f7dbde36700 1 -- 172.21.15.81:0/2981078327 shutdown_connections 2023-10-07T08:47:47.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.329+0000 7f7dbde36700 1 --2- 172.21.15.81:0/2981078327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7db8157ca0 0x7f7db8069d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.329+0000 7f7dbde36700 1 --2- 172.21.15.81:0/2981078327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db806d120 0x7f7db8153a70 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.329+0000 7f7dbde36700 1 --2- 172.21.15.81:0/2981078327 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7da4066fb0 0x7f7da4069460 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.329+0000 7f7dbde36700 1 --2- 172.21.15.81:0/2981078327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7db81578d0 0x7f7db80c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.329+0000 7f7dbde36700 1 -- 172.21.15.81:0/2981078327 >> 172.21.15.81:0/2981078327 conn(0x7f7db806bb90 msgr2=0x7f7db8155bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:47.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.329+0000 7f7dbde36700 1 -- 172.21.15.81:0/2981078327 shutdown_connections 2023-10-07T08:47:47.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.329+0000 7f7dbde36700 1 -- 172.21.15.81:0/2981078327 wait complete. 2023-10-07T08:47:47.341 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T08:47:47.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.455+0000 7f03d0bd7700 1 Processor -- start 2023-10-07T08:47:47.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.455+0000 7f03d0bd7700 1 -- start start 2023-10-07T08:47:47.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.456+0000 7f03d0bd7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f03cc159f10 0x7f03cc068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.456+0000 7f03d0bd7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03cc069120 con 0x7f03cc159b40 2023-10-07T08:47:47.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.456+0000 7f03d0bd7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03cc0cee10 con 0x7f03cc068cc0 2023-10-07T08:47:47.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.456+0000 7f03d0bd7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03cc0cd040 con 0x7f03cc159f10 2023-10-07T08:47:47.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.456+0000 7f03caffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f03cc159f10 0x7f03cc068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.456+0000 7f03cb7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f03cc159b40 0x7f03cc0cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35694/0 (socket says 172.21.15.81:35694) 2023-10-07T08:47:47.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.456+0000 7f03cb7fe700 1 -- 172.21.15.81:0/3207779549 learned_addr learned my addr 172.21.15.81:0/3207779549 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:47.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.456+0000 7f03caffd700 1 -- 172.21.15.81:0/3207779549 >> v1:172.21.15.89:6789/0 conn(0x7f03cc068cc0 legacy=0x7f03cc0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:47.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.456+0000 7f03caffd700 1 -- 172.21.15.81:0/3207779549 >> v1:172.21.15.81:6789/0 conn(0x7f03cc159b40 legacy=0x7f03cc0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:47.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.456+0000 7f03caffd700 1 -- 172.21.15.81:0/3207779549 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc0cd320 con 0x7f03cc159f10 2023-10-07T08:47:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.456+0000 7f03ca7fc700 1 -- 172.21.15.81:0/3207779549 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395464687 0 0) 0x7f03bc001110 con 0x7f03cc159b40 2023-10-07T08:47:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.457+0000 7f03caffd700 1 --2- 172.21.15.81:0/3207779549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03cc159f10 0x7f03cc068780 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f03c00098e0 tx=0x7f03c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ace82926c85202f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.457+0000 7f03ca7fc700 1 -- 172.21.15.81:0/3207779549 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0009e80 con 0x7f03cc159f10 2023-10-07T08:47:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.457+0000 7f03ca7fc700 1 -- 172.21.15.81:0/3207779549 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c000b820 con 0x7f03cc159f10 2023-10-07T08:47:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.457+0000 7f03ca7fc700 1 -- 172.21.15.81:0/3207779549 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c000bba0 con 0x7f03cc159f10 2023-10-07T08:47:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.457+0000 7f03d0bd7700 1 -- 172.21.15.81:0/3207779549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03cc159f10 msgr2=0x7f03cc068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.457+0000 7f03d0bd7700 1 --2- 172.21.15.81:0/3207779549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03cc159f10 0x7f03cc068780 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f03c00098e0 tx=0x7f03c00091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.457+0000 7f03d0bd7700 1 -- 172.21.15.81:0/3207779549 shutdown_connections 2023-10-07T08:47:47.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.457+0000 7f03d0bd7700 1 --2- 172.21.15.81:0/3207779549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03cc159f10 0x7f03cc068780 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.457+0000 7f03d0bd7700 1 -- 172.21.15.81:0/3207779549 >> 172.21.15.81:0/3207779549 conn(0x7f03cc0cd660 msgr2=0x7f03cc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:47.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.457+0000 7f03d0bd7700 1 -- 172.21.15.81:0/3207779549 shutdown_connections 2023-10-07T08:47:47.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.457+0000 7f03d0bd7700 1 -- 172.21.15.81:0/3207779549 wait complete. 2023-10-07T08:47:47.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.459+0000 7f03d0bd7700 1 Processor -- start 2023-10-07T08:47:47.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.459+0000 7f03d0bd7700 1 -- start start 2023-10-07T08:47:47.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.459+0000 7f03d0bd7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03cc068cc0 0x7f03cc158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.459+0000 7f03d0bd7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03cc159b40 0x7f03cc16acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.459+0000 7f03d0bd7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03cc159f10 0x7f03cc0c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.459+0000 7f03d0bd7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc16bce0 con 0x7f03cc068cc0 2023-10-07T08:47:47.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.459+0000 7f03d0bd7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc16c3b0 con 0x7f03cc159f10 2023-10-07T08:47:47.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.459+0000 7f03d0bd7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc16b720 con 0x7f03cc159b40 2023-10-07T08:47:47.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.459+0000 7f03cb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03cc068cc0 0x7f03cc158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.459+0000 7f03cb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03cc068cc0 0x7f03cc158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39106/0 (socket says 172.21.15.81:39106) 2023-10-07T08:47:47.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.459+0000 7f03cb7fe700 1 -- 172.21.15.81:0/1379218252 learned_addr learned my addr 172.21.15.81:0/1379218252 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:47.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.460+0000 7f03caffd700 1 --2- 172.21.15.81:0/1379218252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03cc159b40 0x7f03cc16acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.460+0000 7f03cbfff700 1 --2- 172.21.15.81:0/1379218252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03cc159f10 0x7f03cc0c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.460+0000 7f03cb7fe700 1 -- 172.21.15.81:0/1379218252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03cc159b40 msgr2=0x7f03cc16acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:47.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.460+0000 7f03cb7fe700 1 --2- 172.21.15.81:0/1379218252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03cc159b40 0x7f03cc16acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.460+0000 7f03cb7fe700 1 -- 172.21.15.81:0/1379218252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03cc159f10 msgr2=0x7f03cc0c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:47.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.460+0000 7f03cb7fe700 1 --2- 172.21.15.81:0/1379218252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03cc159f10 0x7f03cc0c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.460+0000 7f03cb7fe700 1 -- 172.21.15.81:0/1379218252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c0009420 con 0x7f03cc068cc0 2023-10-07T08:47:47.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.460+0000 7f03caffd700 1 --2- 172.21.15.81:0/1379218252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03cc159b40 0x7f03cc16acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:47.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.460+0000 7f03cbfff700 1 --2- 172.21.15.81:0/1379218252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03cc159f10 0x7f03cc0c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:47.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.460+0000 7f03cb7fe700 1 --2- 172.21.15.81:0/1379218252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03cc068cc0 0x7f03cc158100 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00c810 tx=0x7f03bc007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:47.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.460+0000 7f03b37fe700 1 -- 172.21.15.81:0/1379218252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc005b30 con 0x7f03cc068cc0 2023-10-07T08:47:47.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.460+0000 7f03b37fe700 1 -- 172.21.15.81:0/1379218252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc005c90 con 0x7f03cc068cc0 2023-10-07T08:47:47.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.460+0000 7f03d0bd7700 1 -- 172.21.15.81:0/1379218252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03cc16ba00 con 0x7f03cc068cc0 2023-10-07T08:47:47.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.460+0000 7f03b37fe700 1 -- 172.21.15.81:0/1379218252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc007340 con 0x7f03cc068cc0 2023-10-07T08:47:47.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.460+0000 7f03d0bd7700 1 -- 172.21.15.81:0/1379218252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03cc158640 con 0x7f03cc068cc0 2023-10-07T08:47:47.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.461+0000 7f03d0bd7700 1 -- 172.21.15.81:0/1379218252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03cc16bea0 con 0x7f03cc068cc0 2023-10-07T08:47:47.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.461+0000 7f03b37fe700 1 -- 172.21.15.81:0/1379218252 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03bc01b400 con 0x7f03cc068cc0 2023-10-07T08:47:47.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.462+0000 7f03b37fe700 1 --2- 172.21.15.81:0/1379218252 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f03b8066f30 0x7f03b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.462+0000 7f03b37fe700 1 -- 172.21.15.81:0/1379218252 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f03bc083b90 con 0x7f03cc068cc0 2023-10-07T08:47:47.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.462+0000 7f03caffd700 1 --2- 172.21.15.81:0/1379218252 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f03b8066f30 0x7f03b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.462+0000 7f03caffd700 1 --2- 172.21.15.81:0/1379218252 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f03b8066f30 0x7f03b80693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f03cc159340 tx=0x7f03c0016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:47.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.466+0000 7f03b37fe700 1 -- 172.21.15.81:0/1379218252 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03cc16bea0 con 0x7f03cc068cc0 2023-10-07T08:47:47.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.649+0000 7f03d0bd7700 1 -- 172.21.15.81:0/1379218252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f03cc069120 con 0x7f03cc068cc0 2023-10-07T08:47:47.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.649+0000 7f03b37fe700 1 -- 172.21.15.81:0/1379218252 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v98) v1 ==== 84+0+65 (secure 0 0 0) 0x7f03cc069120 con 0x7f03cc068cc0 2023-10-07T08:47:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:47.650 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-07T08:47:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:47:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-07T08:47:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-07T08:47:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:47:47.650 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-07T08:47:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.651+0000 7f03d0bd7700 1 -- 172.21.15.81:0/1379218252 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f03b8066f30 msgr2=0x7f03b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.651+0000 7f03d0bd7700 1 --2- 172.21.15.81:0/1379218252 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f03b8066f30 0x7f03b80693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f03cc159340 tx=0x7f03c0016000 comp rx=0 tx=0).stop 2023-10-07T08:47:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.651+0000 7f03d0bd7700 1 -- 172.21.15.81:0/1379218252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03cc068cc0 msgr2=0x7f03cc158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.651+0000 7f03d0bd7700 1 --2- 172.21.15.81:0/1379218252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03cc068cc0 0x7f03cc158100 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00c810 tx=0x7f03bc007c50 comp rx=0 tx=0).stop 2023-10-07T08:47:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.651+0000 7f03d0bd7700 1 -- 172.21.15.81:0/1379218252 shutdown_connections 2023-10-07T08:47:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.651+0000 7f03d0bd7700 1 --2- 172.21.15.81:0/1379218252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03cc159f10 0x7f03cc0c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.651+0000 7f03d0bd7700 1 --2- 172.21.15.81:0/1379218252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03cc068cc0 0x7f03cc158100 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.651+0000 7f03d0bd7700 1 --2- 172.21.15.81:0/1379218252 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f03b8066f30 0x7f03b80693e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.651+0000 7f03d0bd7700 1 --2- 172.21.15.81:0/1379218252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03cc159b40 0x7f03cc16acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.651+0000 7f03d0bd7700 1 -- 172.21.15.81:0/1379218252 >> 172.21.15.81:0/1379218252 conn(0x7f03cc0cd660 msgr2=0x7f03cc06df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.651+0000 7f03d0bd7700 1 -- 172.21.15.81:0/1379218252 shutdown_connections 2023-10-07T08:47:47.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.651+0000 7f03d0bd7700 1 -- 172.21.15.81:0/1379218252 wait complete. 2023-10-07T08:47:47.664 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T08:47:47.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T08:47:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.782+0000 7fd60dd80700 1 Processor -- start 2023-10-07T08:47:47.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.782+0000 7fd60dd80700 1 -- start start 2023-10-07T08:47:47.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60dd80700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6080d0b80 0x7fd6080cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60dd80700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6080d02b0 0x7fd60806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60dd80700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd6080d0f50 0x7fd60806d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60dd80700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60815a690 con 0x7fd6080d0b80 2023-10-07T08:47:47.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60dd80700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6080cf2d0 con 0x7fd6080d0f50 2023-10-07T08:47:47.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60dd80700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60806dc00 con 0x7fd6080d02b0 2023-10-07T08:47:47.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60cd7e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6080d0b80 0x7fd6080cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60cd7e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6080d0b80 0x7fd6080cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39110/0 (socket says 172.21.15.81:39110) 2023-10-07T08:47:47.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60cd7e700 1 -- 172.21.15.81:0/2062054714 learned_addr learned my addr 172.21.15.81:0/2062054714 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:47.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd607fff700 1 --2- 172.21.15.81:0/2062054714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6080d02b0 0x7fd60806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60d57f700 1 --2- 172.21.15.81:0/2062054714 >> v2:172.21.15.89:3300/0 conn(0x7fd6080d0f50 0x7fd60806d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60cd7e700 1 -- 172.21.15.81:0/2062054714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6080d02b0 msgr2=0x7fd60806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60cd7e700 1 --2- 172.21.15.81:0/2062054714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6080d02b0 0x7fd60806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60cd7e700 1 -- 172.21.15.81:0/2062054714 >> v2:172.21.15.89:3300/0 conn(0x7fd6080d0f50 msgr2=0x7fd60806d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60cd7e700 1 --2- 172.21.15.81:0/2062054714 >> v2:172.21.15.89:3300/0 conn(0x7fd6080d0f50 0x7fd60806d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60cd7e700 1 -- 172.21.15.81:0/2062054714 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080cf570 con 0x7fd6080d0b80 2023-10-07T08:47:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd607fff700 1 --2- 172.21.15.81:0/2062054714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6080d02b0 0x7fd60806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60d57f700 1 --2- 172.21.15.81:0/2062054714 >> v2:172.21.15.89:3300/0 conn(0x7fd6080d0f50 0x7fd60806d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd60cd7e700 1 --2- 172.21.15.81:0/2062054714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6080d0b80 0x7fd6080cfd70 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd6080ce9e0 tx=0x7fd5fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a2155ce5ca766e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd6077fe700 1 -- 172.21.15.81:0/2062054714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc00b860 con 0x7fd6080d0b80 2023-10-07T08:47:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd6077fe700 1 -- 172.21.15.81:0/2062054714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc00b9c0 con 0x7fd6080d0b80 2023-10-07T08:47:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.783+0000 7fd6077fe700 1 -- 172.21.15.81:0/2062054714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc00bd60 con 0x7fd6080d0b80 2023-10-07T08:47:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.784+0000 7fd60dd80700 1 -- 172.21.15.81:0/2062054714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6080d0b80 msgr2=0x7fd6080cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.784+0000 7fd60dd80700 1 --2- 172.21.15.81:0/2062054714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6080d0b80 0x7fd6080cfd70 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd6080ce9e0 tx=0x7fd5fc009250 comp rx=0 tx=0).stop 2023-10-07T08:47:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.784+0000 7fd60dd80700 1 -- 172.21.15.81:0/2062054714 shutdown_connections 2023-10-07T08:47:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.784+0000 7fd60dd80700 1 --2- 172.21.15.81:0/2062054714 >> v2:172.21.15.89:3300/0 conn(0x7fd6080d0f50 0x7fd60806d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.784+0000 7fd60dd80700 1 --2- 172.21.15.81:0/2062054714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6080d0b80 0x7fd6080cfd70 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.784+0000 7fd60dd80700 1 --2- 172.21.15.81:0/2062054714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6080d02b0 0x7fd60806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.784+0000 7fd60dd80700 1 -- 172.21.15.81:0/2062054714 >> 172.21.15.81:0/2062054714 conn(0x7fd608063230 msgr2=0x7fd608063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.784+0000 7fd60dd80700 1 -- 172.21.15.81:0/2062054714 shutdown_connections 2023-10-07T08:47:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.784+0000 7fd60dd80700 1 -- 172.21.15.81:0/2062054714 wait complete. 2023-10-07T08:47:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.785+0000 7fd60dd80700 1 Processor -- start 2023-10-07T08:47:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.785+0000 7fd60dd80700 1 -- start start 2023-10-07T08:47:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd60dd80700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6080d02b0 0x7fd608157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd60dd80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6080d0b80 0x7fd6080c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd60dd80700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6080d0f50 0x7fd6080c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd60dd80700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080c6060 con 0x7fd6080d0b80 2023-10-07T08:47:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd60dd80700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080c6340 con 0x7fd6080d02b0 2023-10-07T08:47:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd60dd80700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080c6620 con 0x7fd6080d0f50 2023-10-07T08:47:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd607fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6080d0b80 0x7fd6080c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd607fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6080d0b80 0x7fd6080c7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39126/0 (socket says 172.21.15.81:39126) 2023-10-07T08:47:47.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd607fff700 1 -- 172.21.15.81:0/2623531942 learned_addr learned my addr 172.21.15.81:0/2623531942 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:47.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd60cd7e700 1 --2- 172.21.15.81:0/2623531942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6080d02b0 0x7fd608157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd60d57f700 1 --2- 172.21.15.81:0/2623531942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6080d0f50 0x7fd6080c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd607fff700 1 -- 172.21.15.81:0/2623531942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6080d0f50 msgr2=0x7fd6080c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:47.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd607fff700 1 --2- 172.21.15.81:0/2623531942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6080d0f50 0x7fd6080c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd607fff700 1 -- 172.21.15.81:0/2623531942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6080d02b0 msgr2=0x7fd608157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:47.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd607fff700 1 --2- 172.21.15.81:0/2623531942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6080d02b0 0x7fd608157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:47.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd607fff700 1 -- 172.21.15.81:0/2623531942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc0094f0 con 0x7fd6080d0b80 2023-10-07T08:47:47.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.786+0000 7fd60d57f700 1 --2- 172.21.15.81:0/2623531942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6080d0f50 0x7fd6080c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:47:47.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.787+0000 7fd607fff700 1 --2- 172.21.15.81:0/2623531942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6080d0b80 0x7fd6080c7100 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd5f400c880 tx=0x7fd5f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:47.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.787+0000 7fd604ff9700 1 -- 172.21.15.81:0/2623531942 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4011660 con 0x7fd6080d0b80 2023-10-07T08:47:47.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.787+0000 7fd604ff9700 1 -- 172.21.15.81:0/2623531942 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f40117c0 con 0x7fd6080d0b80 2023-10-07T08:47:47.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.787+0000 7fd60dd80700 1 -- 172.21.15.81:0/2623531942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6080c6900 con 0x7fd6080d0b80 2023-10-07T08:47:47.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.787+0000 7fd604ff9700 1 -- 172.21.15.81:0/2623531942 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4011b60 con 0x7fd6080d0b80 2023-10-07T08:47:47.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.787+0000 7fd60dd80700 1 -- 172.21.15.81:0/2623531942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6081580f0 con 0x7fd6080d0b80 2023-10-07T08:47:47.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.788+0000 7fd60dd80700 1 -- 172.21.15.81:0/2623531942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60806e3e0 con 0x7fd6080d0b80 2023-10-07T08:47:47.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.788+0000 7fd604ff9700 1 -- 172.21.15.81:0/2623531942 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5f4021350 con 0x7fd6080d0b80 2023-10-07T08:47:47.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.789+0000 7fd604ff9700 1 --2- 172.21.15.81:0/2623531942 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd5ec066f30 0x7fd5ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:47.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.789+0000 7fd604ff9700 1 -- 172.21.15.81:0/2623531942 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd5f40840a0 con 0x7fd6080d0b80 2023-10-07T08:47:47.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.789+0000 7fd60cd7e700 1 --2- 172.21.15.81:0/2623531942 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd5ec066f30 0x7fd5ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:47.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.789+0000 7fd60cd7e700 1 --2- 172.21.15.81:0/2623531942 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd5ec066f30 0x7fd5ec0693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd6080ce9e0 tx=0x7fd5fc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:47.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.793+0000 7fd604ff9700 1 -- 172.21.15.81:0/2623531942 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5f40550f0 con 0x7fd6080d0b80 2023-10-07T08:47:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:47.975+0000 7fd60dd80700 1 -- 172.21.15.81:0/2623531942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd6080676e0 con 0x7fd6080d0b80 2023-10-07T08:47:48.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.284+0000 7fd604ff9700 1 -- 172.21.15.81:0/2623531942 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v99) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd5f4054c80 con 0x7fd6080d0b80 2023-10-07T08:47:48.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.287+0000 7fd60dd80700 1 -- 172.21.15.81:0/2623531942 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd5ec066f30 msgr2=0x7fd5ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:48.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.287+0000 7fd60dd80700 1 --2- 172.21.15.81:0/2623531942 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd5ec066f30 0x7fd5ec0693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd6080ce9e0 tx=0x7fd5fc017000 comp rx=0 tx=0).stop 2023-10-07T08:47:48.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.287+0000 7fd60dd80700 1 -- 172.21.15.81:0/2623531942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6080d0b80 msgr2=0x7fd6080c7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:48.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.287+0000 7fd60dd80700 1 --2- 172.21.15.81:0/2623531942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6080d0b80 0x7fd6080c7100 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd5f400c880 tx=0x7fd5f4008040 comp rx=0 tx=0).stop 2023-10-07T08:47:48.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.287+0000 7fd60dd80700 1 -- 172.21.15.81:0/2623531942 shutdown_connections 2023-10-07T08:47:48.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.287+0000 7fd60dd80700 1 --2- 172.21.15.81:0/2623531942 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd5ec066f30 0x7fd5ec0693e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:48.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.287+0000 7fd60dd80700 1 --2- 172.21.15.81:0/2623531942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6080d0f50 0x7fd6080c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:48.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.287+0000 7fd60dd80700 1 --2- 172.21.15.81:0/2623531942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6080d02b0 0x7fd608157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:48.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.287+0000 7fd60dd80700 1 --2- 172.21.15.81:0/2623531942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6080d0b80 0x7fd6080c7100 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:48.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.287+0000 7fd60dd80700 1 -- 172.21.15.81:0/2623531942 >> 172.21.15.81:0/2623531942 conn(0x7fd608063230 msgr2=0x7fd60806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:48.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.287+0000 7fd60dd80700 1 -- 172.21.15.81:0/2623531942 shutdown_connections 2023-10-07T08:47:48.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.287+0000 7fd60dd80700 1 -- 172.21.15.81:0/2623531942 wait complete. 2023-10-07T08:47:48.289 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-07T08:47:48.300 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T08:47:48.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.420+0000 7fa2e63ca700 1 Processor -- start 2023-10-07T08:47:48.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.421+0000 7fa2e63ca700 1 -- start start 2023-10-07T08:47:48.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.421+0000 7fa2e63ca700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa2e006f4f0 0x7fa2e00b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:48.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.421+0000 7fa2e63ca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e00b2800 0x7fa2e0163bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:48.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.421+0000 7fa2e63ca700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e0068d40 con 0x7fa2e00b1ef0 2023-10-07T08:47:48.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.421+0000 7fa2e63ca700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e015a520 con 0x7fa2e006f4f0 2023-10-07T08:47:48.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.421+0000 7fa2e63ca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e006a1e0 con 0x7fa2e00b2800 2023-10-07T08:47:48.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2e53c8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa2e00b1ef0 0x7fa2e006da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35704/0 (socket says 172.21.15.81:35704) 2023-10-07T08:47:48.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2e53c8700 1 -- 172.21.15.81:0/2091498142 learned_addr learned my addr 172.21.15.81:0/2091498142 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:48.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2e5bc9700 1 --2- 172.21.15.81:0/2091498142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e00b2800 0x7fa2e0163bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:48.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2e4bc7700 1 --2- 172.21.15.81:0/2091498142 >> v2:172.21.15.89:3300/0 conn(0x7fa2e006f4f0 0x7fa2e00b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:48.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2d7fff700 1 -- 172.21.15.81:0/2091498142 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486829216 0 0) 0x7fa2e0068d40 con 0x7fa2e00b1ef0 2023-10-07T08:47:48.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2d7fff700 1 -- 172.21.15.81:0/2091498142 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2cc003570 con 0x7fa2e00b1ef0 2023-10-07T08:47:48.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2d7fff700 1 -- 172.21.15.81:0/2091498142 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2105545891 0 0) 0x7fa2cc003570 con 0x7fa2e00b1ef0 2023-10-07T08:47:48.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2d7fff700 1 -- 172.21.15.81:0/2091498142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e00b2800 msgr2=0x7fa2e0163bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:48.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2d7fff700 1 --2- 172.21.15.81:0/2091498142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e00b2800 0x7fa2e0163bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:48.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2d7fff700 1 -- 172.21.15.81:0/2091498142 >> v2:172.21.15.89:3300/0 conn(0x7fa2e006f4f0 msgr2=0x7fa2e00b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:48.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2d7fff700 1 --2- 172.21.15.81:0/2091498142 >> v2:172.21.15.89:3300/0 conn(0x7fa2e006f4f0 0x7fa2e00b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:48.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2d7fff700 1 -- 172.21.15.81:0/2091498142 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e006e2d0 con 0x7fa2e00b1ef0 2023-10-07T08:47:48.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2d7fff700 1 -- 172.21.15.81:0/2091498142 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fa2dc001470 con 0x7fa2e00b1ef0 2023-10-07T08:47:48.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2e4bc7700 1 --2- 172.21.15.81:0/2091498142 >> v2:172.21.15.89:3300/0 conn(0x7fa2e006f4f0 0x7fa2e00b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:47:48.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2e5bc9700 1 --2- 172.21.15.81:0/2091498142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e00b2800 0x7fa2e0163bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:47:48.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2d7fff700 1 -- 172.21.15.81:0/2091498142 >> v1:172.21.15.81:6789/0 conn(0x7fa2e00b1ef0 legacy=0x7fa2e006da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:48.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2d7fff700 1 --2- 172.21.15.81:0/2091498142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e00b2800 0x7fa2cc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:48.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2d7fff700 1 --2- 172.21.15.81:0/2091498142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2cc003fa0 0x7fa2cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:48.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2d7fff700 1 --2- 172.21.15.81:0/2091498142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2cc004d50 0x7fa2cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:48.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2d7fff700 1 -- 172.21.15.81:0/2091498142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e015a520 con 0x7fa2cc003fa0 2023-10-07T08:47:48.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2d7fff700 1 -- 172.21.15.81:0/2091498142 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e006a1e0 con 0x7fa2cc004d50 2023-10-07T08:47:48.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2d7fff700 1 -- 172.21.15.81:0/2091498142 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc00ba60 con 0x7fa2e00b2800 2023-10-07T08:47:48.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2e4bc7700 1 --2- 172.21.15.81:0/2091498142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2cc003fa0 0x7fa2cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:48.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2e53c8700 1 --2- 172.21.15.81:0/2091498142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e00b2800 0x7fa2cc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:48.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.422+0000 7fa2e5bc9700 1 --2- 172.21.15.81:0/2091498142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2cc004d50 0x7fa2cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:48.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.423+0000 7fa2e4bc7700 1 -- 172.21.15.81:0/2091498142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e00b2800 msgr2=0x7fa2cc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:48.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.423+0000 7fa2e4bc7700 1 --2- 172.21.15.81:0/2091498142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e00b2800 0x7fa2cc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:48.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.423+0000 7fa2e4bc7700 1 -- 172.21.15.81:0/2091498142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2cc004d50 msgr2=0x7fa2cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:48.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.423+0000 7fa2e4bc7700 1 --2- 172.21.15.81:0/2091498142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2cc004d50 0x7fa2cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:48.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.423+0000 7fa2e4bc7700 1 -- 172.21.15.81:0/2091498142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d8009a20 con 0x7fa2cc003fa0 2023-10-07T08:47:48.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.423+0000 7fa2e4bc7700 1 --2- 172.21.15.81:0/2091498142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2cc003fa0 0x7fa2cc004810 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0009df0 tx=0x7fa2d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1c0c6b18796acc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:48.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.423+0000 7fa2d7fff700 1 -- 172.21.15.81:0/2091498142 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000e920 con 0x7fa2cc003fa0 2023-10-07T08:47:48.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.423+0000 7fa2d7fff700 1 -- 172.21.15.81:0/2091498142 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d000ea80 con 0x7fa2cc003fa0 2023-10-07T08:47:48.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.423+0000 7fa2d7fff700 1 -- 172.21.15.81:0/2091498142 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000ee20 con 0x7fa2cc003fa0 2023-10-07T08:47:48.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.423+0000 7fa2e63ca700 1 -- 172.21.15.81:0/2091498142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2cc003fa0 msgr2=0x7fa2cc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:48.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.423+0000 7fa2e63ca700 1 --2- 172.21.15.81:0/2091498142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2cc003fa0 0x7fa2cc004810 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0009df0 tx=0x7fa2d00091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:48.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.423+0000 7fa2e5bc9700 1 -- 172.21.15.81:0/2091498142 reap_dead start 2023-10-07T08:47:48.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.424+0000 7fa2e63ca700 1 -- 172.21.15.81:0/2091498142 shutdown_connections 2023-10-07T08:47:48.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.424+0000 7fa2e63ca700 1 -- 172.21.15.81:0/2091498142 >> 172.21.15.81:0/2091498142 conn(0x7fa2e00d0bb0 msgr2=0x7fa2e00d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:48.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.424+0000 7fa2e63ca700 1 -- 172.21.15.81:0/2091498142 shutdown_connections 2023-10-07T08:47:48.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.424+0000 7fa2e63ca700 1 -- 172.21.15.81:0/2091498142 wait complete. 2023-10-07T08:47:48.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.425+0000 7fa2e63ca700 1 Processor -- start 2023-10-07T08:47:48.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.425+0000 7fa2e63ca700 1 -- start start 2023-10-07T08:47:48.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e63ca700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2cc003fa0 0x7fa2e00cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:48.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e63ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e015f530 0x7fa2e01416c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:48.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e63ca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e015c040 0x7fa2e015c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e63ca700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e015ca20 con 0x7fa2e015f530 2023-10-07T08:47:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e63ca700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00cff00 con 0x7fa2cc003fa0 2023-10-07T08:47:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e63ca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00d01e0 con 0x7fa2e015c040 2023-10-07T08:47:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e4bc7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e015f530 0x7fa2e01416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e4bc7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e015f530 0x7fa2e01416c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39138/0 (socket says 172.21.15.81:39138) 2023-10-07T08:47:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e4bc7700 1 -- 172.21.15.81:0/2554232921 learned_addr learned my addr 172.21.15.81:0/2554232921 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e53c8700 1 --2- 172.21.15.81:0/2554232921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2cc003fa0 0x7fa2e00cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e5bc9700 1 --2- 172.21.15.81:0/2554232921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e015c040 0x7fa2e015c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e4bc7700 1 -- 172.21.15.81:0/2554232921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e015c040 msgr2=0x7fa2e015c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e4bc7700 1 --2- 172.21.15.81:0/2554232921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e015c040 0x7fa2e015c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e4bc7700 1 -- 172.21.15.81:0/2554232921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2cc003fa0 msgr2=0x7fa2e00cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e4bc7700 1 --2- 172.21.15.81:0/2554232921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2cc003fa0 0x7fa2e00cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e4bc7700 1 -- 172.21.15.81:0/2554232921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e00d04c0 con 0x7fa2e015f530 2023-10-07T08:47:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e4bc7700 1 --2- 172.21.15.81:0/2554232921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e015f530 0x7fa2e01416c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0046f0 tx=0x7fa2d001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2d57fa700 1 -- 172.21.15.81:0/2554232921 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0022070 con 0x7fa2e015f530 2023-10-07T08:47:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2d57fa700 1 -- 172.21.15.81:0/2554232921 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d0013b30 con 0x7fa2e015f530 2023-10-07T08:47:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2d57fa700 1 -- 172.21.15.81:0/2554232921 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d001c450 con 0x7fa2e015f530 2023-10-07T08:47:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e63ca700 1 -- 172.21.15.81:0/2554232921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e00d07a0 con 0x7fa2e015f530 2023-10-07T08:47:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.426+0000 7fa2e63ca700 1 -- 172.21.15.81:0/2554232921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e015f9a0 con 0x7fa2e015f530 2023-10-07T08:47:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.427+0000 7fa2e63ca700 1 -- 172.21.15.81:0/2554232921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e01512c0 con 0x7fa2e015f530 2023-10-07T08:47:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.428+0000 7fa2d57fa700 1 -- 172.21.15.81:0/2554232921 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2d0026070 con 0x7fa2e015f530 2023-10-07T08:47:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.428+0000 7fa2d57fa700 1 --2- 172.21.15.81:0/2554232921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa2c4066f30 0x7fa2c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.428+0000 7fa2d57fa700 1 -- 172.21.15.81:0/2554232921 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fa2d0085b40 con 0x7fa2e015f530 2023-10-07T08:47:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.428+0000 7fa2e53c8700 1 --2- 172.21.15.81:0/2554232921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa2c4066f30 0x7fa2c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.429+0000 7fa2e53c8700 1 --2- 172.21.15.81:0/2554232921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa2c4066f30 0x7fa2c40693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc001620 tx=0x7fa2dc001e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:48.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.433+0000 7fa2d57fa700 1 -- 172.21.15.81:0/2554232921 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2d0052ef0 con 0x7fa2e015f530 2023-10-07T08:47:48.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:48.614+0000 7fa2e63ca700 1 -- 172.21.15.81:0/2554232921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa2e0071b10 con 0x7fa2e015f530 2023-10-07T08:47:49.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.287+0000 7fa2d57fa700 1 -- 172.21.15.81:0/2554232921 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v100) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa2d0056510 con 0x7fa2e015f530 2023-10-07T08:47:49.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.291+0000 7fa2e63ca700 1 -- 172.21.15.81:0/2554232921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa2c4066f30 msgr2=0x7fa2c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:49.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.291+0000 7fa2e63ca700 1 --2- 172.21.15.81:0/2554232921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa2c4066f30 0x7fa2c40693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc001620 tx=0x7fa2dc001e90 comp rx=0 tx=0).stop 2023-10-07T08:47:49.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.291+0000 7fa2e63ca700 1 -- 172.21.15.81:0/2554232921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e015f530 msgr2=0x7fa2e01416c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:49.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.291+0000 7fa2e63ca700 1 --2- 172.21.15.81:0/2554232921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e015f530 0x7fa2e01416c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0046f0 tx=0x7fa2d001a000 comp rx=0 tx=0).stop 2023-10-07T08:47:49.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.293+0000 7fa2e63ca700 1 -- 172.21.15.81:0/2554232921 shutdown_connections 2023-10-07T08:47:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.293+0000 7fa2e63ca700 1 --2- 172.21.15.81:0/2554232921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa2c4066f30 0x7fa2c40693e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.293+0000 7fa2e63ca700 1 --2- 172.21.15.81:0/2554232921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e015c040 0x7fa2e015c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.293+0000 7fa2e63ca700 1 --2- 172.21.15.81:0/2554232921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2cc003fa0 0x7fa2e00cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.293+0000 7fa2e63ca700 1 --2- 172.21.15.81:0/2554232921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e015f530 0x7fa2e01416c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.293+0000 7fa2e63ca700 1 -- 172.21.15.81:0/2554232921 >> 172.21.15.81:0/2554232921 conn(0x7fa2e00d0bb0 msgr2=0x7fa2e00ce170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.293+0000 7fa2e63ca700 1 -- 172.21.15.81:0/2554232921 shutdown_connections 2023-10-07T08:47:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.293+0000 7fa2e63ca700 1 -- 172.21.15.81:0/2554232921 wait complete. 2023-10-07T08:47:49.298 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-07T08:47:49.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T08:47:49.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.433+0000 7f287cf61700 1 Processor -- start 2023-10-07T08:47:49.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.433+0000 7f287cf61700 1 -- start start 2023-10-07T08:47:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.434+0000 7f287cf61700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28781578d0 0x7f28780cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.434+0000 7f287cf61700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2878157ca0 0x7f287815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.434+0000 7f287cf61700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28780d07c0 con 0x7f287806d120 2023-10-07T08:47:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.434+0000 7f287cf61700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28780cfbb0 con 0x7f2878157ca0 2023-10-07T08:47:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.434+0000 7f287cf61700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28780cfe90 con 0x7f28781578d0 2023-10-07T08:47:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.434+0000 7f287659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28781578d0 0x7f28780cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.434+0000 7f286dd9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2878157ca0 0x7f287815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.434+0000 7f287659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28781578d0 0x7f28780cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:52398/0 (socket says 172.21.15.81:52398) 2023-10-07T08:47:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.434+0000 7f287659c700 1 -- 172.21.15.81:0/2951863340 learned_addr learned my addr 172.21.15.81:0/2951863340 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.435+0000 7f287659c700 1 -- 172.21.15.81:0/2951863340 >> v2:172.21.15.89:3300/0 conn(0x7f2878157ca0 msgr2=0x7f287815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.435+0000 7f287659c700 1 --2- 172.21.15.81:0/2951863340 >> v2:172.21.15.89:3300/0 conn(0x7f2878157ca0 0x7f287815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.435+0000 7f287659c700 1 -- 172.21.15.81:0/2951863340 >> v1:172.21.15.89:6789/0 conn(0x7f287806d120 legacy=0x7f287815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.435+0000 7f287659c700 1 -- 172.21.15.81:0/2951863340 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28780d0170 con 0x7f28781578d0 2023-10-07T08:47:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.435+0000 7f287659c700 1 --2- 172.21.15.81:0/2951863340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28781578d0 0x7f28780cf4f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2868009f20 tx=0x7f2868009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d746375528a02c86 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.435+0000 7f2875d9b700 1 -- 172.21.15.81:0/2951863340 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286800e070 con 0x7f28781578d0 2023-10-07T08:47:49.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.435+0000 7f2875d9b700 1 -- 172.21.15.81:0/2951863340 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286800b9d0 con 0x7f28781578d0 2023-10-07T08:47:49.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.435+0000 7f2875d9b700 1 -- 172.21.15.81:0/2951863340 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28680092e0 con 0x7f28781578d0 2023-10-07T08:47:49.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.435+0000 7f287cf61700 1 -- 172.21.15.81:0/2951863340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28781578d0 msgr2=0x7f28780cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:49.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.435+0000 7f287cf61700 1 --2- 172.21.15.81:0/2951863340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28781578d0 0x7f28780cf4f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2868009f20 tx=0x7f2868009840 comp rx=0 tx=0).stop 2023-10-07T08:47:49.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.435+0000 7f287cf61700 1 -- 172.21.15.81:0/2951863340 shutdown_connections 2023-10-07T08:47:49.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.435+0000 7f287cf61700 1 --2- 172.21.15.81:0/2951863340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28781578d0 0x7f28780cf4f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:49.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.435+0000 7f287cf61700 1 --2- 172.21.15.81:0/2951863340 >> v2:172.21.15.89:3300/0 conn(0x7f2878157ca0 0x7f287815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:49.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.435+0000 7f287cf61700 1 -- 172.21.15.81:0/2951863340 >> 172.21.15.81:0/2951863340 conn(0x7f287806bb90 msgr2=0x7f287806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.436+0000 7f287cf61700 1 -- 172.21.15.81:0/2951863340 shutdown_connections 2023-10-07T08:47:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.436+0000 7f287cf61700 1 -- 172.21.15.81:0/2951863340 wait complete. 2023-10-07T08:47:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.437+0000 7f287cf61700 1 Processor -- start 2023-10-07T08:47:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.437+0000 7f287cf61700 1 -- start start 2023-10-07T08:47:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.437+0000 7f287cf61700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f287806d120 0x7f287816a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.437+0000 7f287cf61700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28781578d0 0x7f28781476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f287cf61700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2878157ca0 0x7f28780b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f287cf61700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28780b5040 con 0x7f28781578d0 2023-10-07T08:47:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f287cf61700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287815c120 con 0x7f2878157ca0 2023-10-07T08:47:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f287cf61700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287815b810 con 0x7f287806d120 2023-10-07T08:47:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f286dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28781578d0 0x7f28781476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f286dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28781578d0 0x7f28781476e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39142/0 (socket says 172.21.15.81:39142) 2023-10-07T08:47:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f286dd9b700 1 -- 172.21.15.81:0/2306366581 learned_addr learned my addr 172.21.15.81:0/2306366581 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f287659c700 1 --2- 172.21.15.81:0/2306366581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f287806d120 0x7f287816a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f2876d9d700 1 --2- 172.21.15.81:0/2306366581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2878157ca0 0x7f28780b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f286dd9b700 1 -- 172.21.15.81:0/2306366581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f287806d120 msgr2=0x7f287816a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f286dd9b700 1 --2- 172.21.15.81:0/2306366581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f287806d120 0x7f287816a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f286dd9b700 1 -- 172.21.15.81:0/2306366581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2878157ca0 msgr2=0x7f28780b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f286dd9b700 1 --2- 172.21.15.81:0/2306366581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2878157ca0 0x7f28780b5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f286dd9b700 1 -- 172.21.15.81:0/2306366581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2868009ae0 con 0x7f28781578d0 2023-10-07T08:47:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f286dd9b700 1 --2- 172.21.15.81:0/2306366581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28781578d0 0x7f28781476e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f286000e930 tx=0x7f28600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f286effd700 1 -- 172.21.15.81:0/2306366581 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860013680 con 0x7f28781578d0 2023-10-07T08:47:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f286effd700 1 -- 172.21.15.81:0/2306366581 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28600137e0 con 0x7f28781578d0 2023-10-07T08:47:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f287cf61700 1 -- 172.21.15.81:0/2306366581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28780b6950 con 0x7f28781578d0 2023-10-07T08:47:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f286effd700 1 -- 172.21.15.81:0/2306366581 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860013b80 con 0x7f28781578d0 2023-10-07T08:47:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.438+0000 7f287cf61700 1 -- 172.21.15.81:0/2306366581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287815bdb0 con 0x7f28781578d0 2023-10-07T08:47:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.439+0000 7f287cf61700 1 -- 172.21.15.81:0/2306366581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2878067ac0 con 0x7f28781578d0 2023-10-07T08:47:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.440+0000 7f286effd700 1 -- 172.21.15.81:0/2306366581 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f286000c3e0 con 0x7f28781578d0 2023-10-07T08:47:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.440+0000 7f286effd700 1 --2- 172.21.15.81:0/2306366581 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2858066f30 0x7f28580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.440+0000 7f286effd700 1 -- 172.21.15.81:0/2306366581 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f2860084580 con 0x7f28781578d0 2023-10-07T08:47:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.440+0000 7f287659c700 1 --2- 172.21.15.81:0/2306366581 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2858066f30 0x7f28580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.441+0000 7f287659c700 1 --2- 172.21.15.81:0/2306366581 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2858066f30 0x7f28580693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2868009880 tx=0x7f2868018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.445+0000 7f286effd700 1 -- 172.21.15.81:0/2306366581 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2860051850 con 0x7f28781578d0 2023-10-07T08:47:49.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-07T08:47:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:49.670+0000 7f287cf61700 1 -- 172.21.15.81:0/2306366581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f287816a8c0 con 0x7f28781578d0 2023-10-07T08:47:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.321+0000 7f286effd700 1 -- 172.21.15.81:0/2306366581 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v46) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2860054e70 con 0x7f28781578d0 2023-10-07T08:47:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.325+0000 7f287cf61700 1 -- 172.21.15.81:0/2306366581 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2858066f30 msgr2=0x7f28580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.325+0000 7f287cf61700 1 --2- 172.21.15.81:0/2306366581 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2858066f30 0x7f28580693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2868009880 tx=0x7f2868018000 comp rx=0 tx=0).stop 2023-10-07T08:47:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.325+0000 7f287cf61700 1 -- 172.21.15.81:0/2306366581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28781578d0 msgr2=0x7f28781476e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.325+0000 7f287cf61700 1 --2- 172.21.15.81:0/2306366581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28781578d0 0x7f28781476e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f286000e930 tx=0x7f28600091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.325+0000 7f287cf61700 1 -- 172.21.15.81:0/2306366581 shutdown_connections 2023-10-07T08:47:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.325+0000 7f287cf61700 1 --2- 172.21.15.81:0/2306366581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2878157ca0 0x7f28780b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.325+0000 7f287cf61700 1 --2- 172.21.15.81:0/2306366581 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2858066f30 0x7f28580693e0 secure :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2868009880 tx=0x7f2868018000 comp rx=0 tx=0).stop 2023-10-07T08:47:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.325+0000 7f287cf61700 1 --2- 172.21.15.81:0/2306366581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f287806d120 0x7f287816a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.325+0000 7f287cf61700 1 --2- 172.21.15.81:0/2306366581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28781578d0 0x7f28781476e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.325+0000 7f287cf61700 1 -- 172.21.15.81:0/2306366581 >> 172.21.15.81:0/2306366581 conn(0x7f287806bb90 msgr2=0x7f2878155970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.328+0000 7f287cf61700 1 -- 172.21.15.81:0/2306366581 shutdown_connections 2023-10-07T08:47:50.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.328+0000 7f287cf61700 1 -- 172.21.15.81:0/2306366581 wait complete. 2023-10-07T08:47:50.329 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 12 and data pool 13 2023-10-07T08:47:50.341 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:47:50.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.454+0000 7fd4b2273700 1 Processor -- start 2023-10-07T08:47:50.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.454+0000 7fd4b2273700 1 -- start start 2023-10-07T08:47:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.455+0000 7fd4b2273700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd4ac157ca0 0x7fd4ac0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.455+0000 7fd4b2273700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4ac06d120 0x7fd4ac06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.455+0000 7fd4b2273700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ac0d07c0 con 0x7fd4ac1578d0 2023-10-07T08:47:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.455+0000 7fd4b2273700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ac06da50 con 0x7fd4ac06d120 2023-10-07T08:47:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.455+0000 7fd4b2273700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ac0cfbb0 con 0x7fd4ac157ca0 2023-10-07T08:47:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.455+0000 7fd4b0810700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4ac06d120 0x7fd4ac06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.455+0000 7fd4b0810700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4ac06d120 0x7fd4ac06d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39150/0 (socket says 172.21.15.81:39150) 2023-10-07T08:47:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.455+0000 7fd4b0810700 1 -- 172.21.15.81:0/2110822559 learned_addr learned my addr 172.21.15.81:0/2110822559 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.455+0000 7fd4ab7fe700 1 --2- 172.21.15.81:0/2110822559 >> v2:172.21.15.89:3300/0 conn(0x7fd4ac157ca0 0x7fd4ac0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.456+0000 7fd4b0810700 1 -- 172.21.15.81:0/2110822559 >> v2:172.21.15.89:3300/0 conn(0x7fd4ac157ca0 msgr2=0x7fd4ac0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.456+0000 7fd4b0810700 1 --2- 172.21.15.81:0/2110822559 >> v2:172.21.15.89:3300/0 conn(0x7fd4ac157ca0 0x7fd4ac0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.456+0000 7fd4b0810700 1 -- 172.21.15.81:0/2110822559 >> v1:172.21.15.89:6789/0 conn(0x7fd4ac1578d0 legacy=0x7fd4ac15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.456+0000 7fd4b0810700 1 -- 172.21.15.81:0/2110822559 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac0cfe90 con 0x7fd4ac06d120 2023-10-07T08:47:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.456+0000 7fd4b0810700 1 --2- 172.21.15.81:0/2110822559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4ac06d120 0x7fd4ac06d510 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac068510 tx=0x7fd4a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b946ecdcd9b85a1f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.456+0000 7fd4aaffd700 1 -- 172.21.15.81:0/2110822559 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400e070 con 0x7fd4ac06d120 2023-10-07T08:47:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.456+0000 7fd4aaffd700 1 -- 172.21.15.81:0/2110822559 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a400ba20 con 0x7fd4ac06d120 2023-10-07T08:47:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.456+0000 7fd4aaffd700 1 -- 172.21.15.81:0/2110822559 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a40092e0 con 0x7fd4ac06d120 2023-10-07T08:47:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.456+0000 7fd4b2273700 1 -- 172.21.15.81:0/2110822559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4ac06d120 msgr2=0x7fd4ac06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.456+0000 7fd4b2273700 1 --2- 172.21.15.81:0/2110822559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4ac06d120 0x7fd4ac06d510 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac068510 tx=0x7fd4a4009840 comp rx=0 tx=0).stop 2023-10-07T08:47:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.456+0000 7fd4b2273700 1 -- 172.21.15.81:0/2110822559 shutdown_connections 2023-10-07T08:47:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.456+0000 7fd4b2273700 1 --2- 172.21.15.81:0/2110822559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4ac06d120 0x7fd4ac06d510 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.456+0000 7fd4b2273700 1 --2- 172.21.15.81:0/2110822559 >> v2:172.21.15.89:3300/0 conn(0x7fd4ac157ca0 0x7fd4ac0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.456+0000 7fd4b2273700 1 -- 172.21.15.81:0/2110822559 >> 172.21.15.81:0/2110822559 conn(0x7fd4ac06bb90 msgr2=0x7fd4ac06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.456+0000 7fd4b2273700 1 -- 172.21.15.81:0/2110822559 shutdown_connections 2023-10-07T08:47:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.456+0000 7fd4b2273700 1 -- 172.21.15.81:0/2110822559 wait complete. 2023-10-07T08:47:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.457+0000 7fd4b2273700 1 Processor -- start 2023-10-07T08:47:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.458+0000 7fd4b2273700 1 -- start start 2023-10-07T08:47:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.458+0000 7fd4b2273700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4ac06d120 0x7fd4ac0b6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.458+0000 7fd4b2273700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4ac1578d0 0x7fd4ac1548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.458+0000 7fd4b2273700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4ac157ca0 0x7fd4ac069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.458+0000 7fd4b2273700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0b62a0 con 0x7fd4ac157ca0 2023-10-07T08:47:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.458+0000 7fd4b2273700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0b5b10 con 0x7fd4ac06d120 2023-10-07T08:47:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.458+0000 7fd4b2273700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0b4f90 con 0x7fd4ac1578d0 2023-10-07T08:47:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.458+0000 7fd4b0810700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4ac157ca0 0x7fd4ac069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.459+0000 7fd4b0810700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4ac157ca0 0x7fd4ac069e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39160/0 (socket says 172.21.15.81:39160) 2023-10-07T08:47:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.459+0000 7fd4b0810700 1 -- 172.21.15.81:0/1122969815 learned_addr learned my addr 172.21.15.81:0/1122969815 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.459+0000 7fd4b0810700 1 -- 172.21.15.81:0/1122969815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4ac1578d0 msgr2=0x7fd4ac1548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:50.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.459+0000 7fd4b0810700 1 --2- 172.21.15.81:0/1122969815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4ac1578d0 0x7fd4ac1548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.459+0000 7fd4b0810700 1 -- 172.21.15.81:0/1122969815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4ac06d120 msgr2=0x7fd4ac0b6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:50.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.459+0000 7fd4abfff700 1 --2- 172.21.15.81:0/1122969815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4ac06d120 0x7fd4ac0b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:50.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.459+0000 7fd4b0810700 1 --2- 172.21.15.81:0/1122969815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4ac06d120 0x7fd4ac0b6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.459+0000 7fd4b0810700 1 -- 172.21.15.81:0/1122969815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a4009ae0 con 0x7fd4ac157ca0 2023-10-07T08:47:50.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.459+0000 7fd4b0810700 1 --2- 172.21.15.81:0/1122969815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4ac157ca0 0x7fd4ac069e50 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009880 tx=0x7fd4a4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:50.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.459+0000 7fd493fff700 1 -- 172.21.15.81:0/1122969815 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4008be0 con 0x7fd4ac157ca0 2023-10-07T08:47:50.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.459+0000 7fd493fff700 1 -- 172.21.15.81:0/1122969815 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a4008d40 con 0x7fd4ac157ca0 2023-10-07T08:47:50.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.459+0000 7fd4b2273700 1 -- 172.21.15.81:0/1122969815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac0b5270 con 0x7fd4ac157ca0 2023-10-07T08:47:50.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.459+0000 7fd493fff700 1 -- 172.21.15.81:0/1122969815 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a40266b0 con 0x7fd4ac157ca0 2023-10-07T08:47:50.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.459+0000 7fd4b2273700 1 -- 172.21.15.81:0/1122969815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac0b5830 con 0x7fd4ac157ca0 2023-10-07T08:47:50.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.460+0000 7fd4b2273700 1 -- 172.21.15.81:0/1122969815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ac16a070 con 0x7fd4ac157ca0 2023-10-07T08:47:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.460+0000 7fd493fff700 1 -- 172.21.15.81:0/1122969815 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4a4003040 con 0x7fd4ac157ca0 2023-10-07T08:47:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.461+0000 7fd493fff700 1 --2- 172.21.15.81:0/1122969815 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd498066f30 0x7fd4980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.461+0000 7fd493fff700 1 -- 172.21.15.81:0/1122969815 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd4a40864c0 con 0x7fd4ac157ca0 2023-10-07T08:47:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.461+0000 7fd4abfff700 1 --2- 172.21.15.81:0/1122969815 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd498066f30 0x7fd4980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.461+0000 7fd4abfff700 1 --2- 172.21.15.81:0/1122969815 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd498066f30 0x7fd4980693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd49c001760 tx=0x7fd49c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:50.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.465+0000 7fd493fff700 1 -- 172.21.15.81:0/1122969815 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4ac16a070 con 0x7fd4ac157ca0 2023-10-07T08:47:50.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.648+0000 7fd4b2273700 1 -- 172.21.15.81:0/1122969815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4ac16a070 con 0x7fd4ac157ca0 2023-10-07T08:47:50.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.649+0000 7fd493fff700 1 -- 172.21.15.81:0/1122969815 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+15329 (secure 0 0 0) 0x7fd4ac16a070 con 0x7fd4ac157ca0 2023-10-07T08:47:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:50.650 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":101,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:47:49.671107+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:47:47.993754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-07T08:47:48.631797+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:47:50.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.651+0000 7fd4b2273700 1 -- 172.21.15.81:0/1122969815 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd498066f30 msgr2=0x7fd4980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:50.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.651+0000 7fd4b2273700 1 --2- 172.21.15.81:0/1122969815 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd498066f30 0x7fd4980693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd49c001760 tx=0x7fd49c009040 comp rx=0 tx=0).stop 2023-10-07T08:47:50.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.651+0000 7fd4b2273700 1 -- 172.21.15.81:0/1122969815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4ac157ca0 msgr2=0x7fd4ac069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:50.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.651+0000 7fd4b2273700 1 --2- 172.21.15.81:0/1122969815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4ac157ca0 0x7fd4ac069e50 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009880 tx=0x7fd4a4018000 comp rx=0 tx=0).stop 2023-10-07T08:47:50.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.651+0000 7fd4b2273700 1 -- 172.21.15.81:0/1122969815 shutdown_connections 2023-10-07T08:47:50.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.651+0000 7fd4b2273700 1 --2- 172.21.15.81:0/1122969815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4ac157ca0 0x7fd4ac069e50 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.651+0000 7fd4b2273700 1 --2- 172.21.15.81:0/1122969815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4ac06d120 0x7fd4ac0b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.651+0000 7fd4b2273700 1 --2- 172.21.15.81:0/1122969815 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd498066f30 0x7fd4980693e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.651+0000 7fd4b2273700 1 --2- 172.21.15.81:0/1122969815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4ac1578d0 0x7fd4ac1548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.651+0000 7fd4b2273700 1 -- 172.21.15.81:0/1122969815 >> 172.21.15.81:0/1122969815 conn(0x7fd4ac06bb90 msgr2=0x7fd4ac156820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:50.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.651+0000 7fd4b2273700 1 -- 172.21.15.81:0/1122969815 shutdown_connections 2023-10-07T08:47:50.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.652+0000 7fd4b2273700 1 -- 172.21.15.81:0/1122969815 wait complete. 2023-10-07T08:47:50.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:47:50.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.778+0000 7fb3cf59e700 1 Processor -- start 2023-10-07T08:47:50.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.778+0000 7fb3cf59e700 1 -- start start 2023-10-07T08:47:50.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.779+0000 7fb3cf59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3d0159b40 0x7fb3d00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:50.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.779+0000 7fb3cf59e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb3d0068e90 0x7fb3d00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:50.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.779+0000 7fb3cf59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d00cee10 con 0x7fb3d0159f10 2023-10-07T08:47:50.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.779+0000 7fb3cf59e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d00cd040 con 0x7fb3d0068e90 2023-10-07T08:47:50.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.779+0000 7fb3cf59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d00cd320 con 0x7fb3d0159b40 2023-10-07T08:47:50.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.779+0000 7fb3c5d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb3d0159f10 0x7fb3d0068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35716/0 (socket says 172.21.15.81:35716) 2023-10-07T08:47:50.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.779+0000 7fb3c5d9b700 1 -- 172.21.15.81:0/41634483 learned_addr learned my addr 172.21.15.81:0/41634483 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:50.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.779+0000 7fb3ce59c700 1 --2- 172.21.15.81:0/41634483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3d0159b40 0x7fb3d00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:50.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.779+0000 7fb3ced9d700 1 --2- 172.21.15.81:0/41634483 >> v2:172.21.15.89:3300/0 conn(0x7fb3d0068e90 0x7fb3d00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:50.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.779+0000 7fb3cdd9b700 1 -- 172.21.15.81:0/41634483 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059633675 0 0) 0x7fb3d00cee10 con 0x7fb3d0159f10 2023-10-07T08:47:50.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.779+0000 7fb3cdd9b700 1 -- 172.21.15.81:0/41634483 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3bc003570 con 0x7fb3d0159f10 2023-10-07T08:47:50.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.780+0000 7fb3cdd9b700 1 -- 172.21.15.81:0/41634483 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1692962751 0 0) 0x7fb3bc003570 con 0x7fb3d0159f10 2023-10-07T08:47:50.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.780+0000 7fb3ce59c700 1 -- 172.21.15.81:0/41634483 >> v2:172.21.15.89:3300/0 conn(0x7fb3d0068e90 msgr2=0x7fb3d00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:50.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.780+0000 7fb3ce59c700 1 --2- 172.21.15.81:0/41634483 >> v2:172.21.15.89:3300/0 conn(0x7fb3d0068e90 0x7fb3d00cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.780+0000 7fb3ce59c700 1 -- 172.21.15.81:0/41634483 >> v1:172.21.15.81:6789/0 conn(0x7fb3d0159f10 legacy=0x7fb3d0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:50.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.780+0000 7fb3ce59c700 1 -- 172.21.15.81:0/41634483 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d00ce7c0 con 0x7fb3d0159b40 2023-10-07T08:47:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.780+0000 7fb3ced9d700 1 --2- 172.21.15.81:0/41634483 >> v2:172.21.15.89:3300/0 conn(0x7fb3d0068e90 0x7fb3d00cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:47:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.780+0000 7fb3ce59c700 1 --2- 172.21.15.81:0/41634483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3d0159b40 0x7fb3d00cc600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb3c00098e0 tx=0x7fb3c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d37815e213ec62bb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.780+0000 7fb3cdd9b700 1 -- 172.21.15.81:0/41634483 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8001470 con 0x7fb3d0159b40 2023-10-07T08:47:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.780+0000 7fb3cdd9b700 1 -- 172.21.15.81:0/41634483 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c0011420 con 0x7fb3d0159b40 2023-10-07T08:47:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.780+0000 7fb3cdd9b700 1 -- 172.21.15.81:0/41634483 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c00117a0 con 0x7fb3d0159b40 2023-10-07T08:47:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.780+0000 7fb3cf59e700 1 -- 172.21.15.81:0/41634483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3d0159b40 msgr2=0x7fb3d00cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.780+0000 7fb3cf59e700 1 --2- 172.21.15.81:0/41634483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3d0159b40 0x7fb3d00cc600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb3c00098e0 tx=0x7fb3c00091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.780+0000 7fb3cf59e700 1 -- 172.21.15.81:0/41634483 shutdown_connections 2023-10-07T08:47:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.780+0000 7fb3cf59e700 1 --2- 172.21.15.81:0/41634483 >> v2:172.21.15.89:3300/0 conn(0x7fb3d0068e90 0x7fb3d00cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.780+0000 7fb3cf59e700 1 --2- 172.21.15.81:0/41634483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3d0159b40 0x7fb3d00cc600 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.780+0000 7fb3cf59e700 1 -- 172.21.15.81:0/41634483 >> 172.21.15.81:0/41634483 conn(0x7fb3d00cd660 msgr2=0x7fb3d00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.781+0000 7fb3cf59e700 1 -- 172.21.15.81:0/41634483 shutdown_connections 2023-10-07T08:47:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.781+0000 7fb3cf59e700 1 -- 172.21.15.81:0/41634483 wait complete. 2023-10-07T08:47:50.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.782+0000 7fb3cf59e700 1 Processor -- start 2023-10-07T08:47:50.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.782+0000 7fb3cf59e700 1 -- start start 2023-10-07T08:47:50.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.782+0000 7fb3cf59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d0068e90 0x7fb3d016ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:50.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.782+0000 7fb3cf59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3d0159b40 0x7fb3d00c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:50.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.782+0000 7fb3cf59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3d0159f10 0x7fb3d016d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:50.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.782+0000 7fb3cf59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d016e8e0 con 0x7fb3d0068e90 2023-10-07T08:47:50.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.782+0000 7fb3cf59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d016a340 con 0x7fb3d0159b40 2023-10-07T08:47:50.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.782+0000 7fb3cf59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d016a8c0 con 0x7fb3d0159f10 2023-10-07T08:47:50.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.783+0000 7fb3ce59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d0068e90 0x7fb3d016ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:50.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.783+0000 7fb3ce59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d0068e90 0x7fb3d016ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39172/0 (socket says 172.21.15.81:39172) 2023-10-07T08:47:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.783+0000 7fb3ce59c700 1 -- 172.21.15.81:0/3919496399 learned_addr learned my addr 172.21.15.81:0/3919496399 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.783+0000 7fb3ced9d700 1 --2- 172.21.15.81:0/3919496399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3d0159f10 0x7fb3d016d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.783+0000 7fb3c5d9b700 1 --2- 172.21.15.81:0/3919496399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3d0159b40 0x7fb3d00c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.783+0000 7fb3ce59c700 1 -- 172.21.15.81:0/3919496399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3d0159f10 msgr2=0x7fb3d016d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.783+0000 7fb3ce59c700 1 --2- 172.21.15.81:0/3919496399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3d0159f10 0x7fb3d016d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.783+0000 7fb3ce59c700 1 -- 172.21.15.81:0/3919496399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3d0159b40 msgr2=0x7fb3d00c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.783+0000 7fb3ce59c700 1 --2- 172.21.15.81:0/3919496399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3d0159b40 0x7fb3d00c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.783+0000 7fb3ce59c700 1 -- 172.21.15.81:0/3919496399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c8009a20 con 0x7fb3d0068e90 2023-10-07T08:47:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.783+0000 7fb3ce59c700 1 --2- 172.21.15.81:0/3919496399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d0068e90 0x7fb3d016ad50 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb3d00cd460 tx=0x7fb3c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.783+0000 7fb3c6ffd700 1 -- 172.21.15.81:0/3919496399 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c001cba0 con 0x7fb3d0068e90 2023-10-07T08:47:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.783+0000 7fb3c6ffd700 1 -- 172.21.15.81:0/3919496399 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c001cd00 con 0x7fb3d0068e90 2023-10-07T08:47:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.783+0000 7fb3cf59e700 1 -- 172.21.15.81:0/3919496399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c0009420 con 0x7fb3d0068e90 2023-10-07T08:47:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.783+0000 7fb3c6ffd700 1 -- 172.21.15.81:0/3919496399 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c001a6a0 con 0x7fb3d0068e90 2023-10-07T08:47:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.783+0000 7fb3cf59e700 1 -- 172.21.15.81:0/3919496399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d016e600 con 0x7fb3d0068e90 2023-10-07T08:47:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.784+0000 7fb3cf59e700 1 -- 172.21.15.81:0/3919496399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d00cb910 con 0x7fb3d0068e90 2023-10-07T08:47:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.784+0000 7fb3c6ffd700 1 -- 172.21.15.81:0/3919496399 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3c001aa50 con 0x7fb3d0068e90 2023-10-07T08:47:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.785+0000 7fb3c6ffd700 1 --2- 172.21.15.81:0/3919496399 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb3b0066f30 0x7fb3b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.785+0000 7fb3c6ffd700 1 -- 172.21.15.81:0/3919496399 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb3c0085f10 con 0x7fb3d0068e90 2023-10-07T08:47:50.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.785+0000 7fb3c5d9b700 1 --2- 172.21.15.81:0/3919496399 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb3b0066f30 0x7fb3b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:50.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.785+0000 7fb3c5d9b700 1 --2- 172.21.15.81:0/3919496399 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb3b0066f30 0x7fb3b00693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8001620 tx=0x7fb3b80014c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:50.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.789+0000 7fb3c6ffd700 1 -- 172.21.15.81:0/3919496399 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3c0053180 con 0x7fb3d0068e90 2023-10-07T08:47:50.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.971+0000 7fb3cf59e700 1 -- 172.21.15.81:0/3919496399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3d016aba0 con 0x7fb3d0068e90 2023-10-07T08:47:50.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.972+0000 7fb3c6ffd700 1 -- 172.21.15.81:0/3919496399 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+15329 (secure 0 0 0) 0x7fb3c00567a0 con 0x7fb3d0068e90 2023-10-07T08:47:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:50.973 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":101,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:47:49.671107+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:47:47.993754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-07T08:47:48.631797+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:47:50.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.974+0000 7fb3cf59e700 1 -- 172.21.15.81:0/3919496399 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb3b0066f30 msgr2=0x7fb3b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:50.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.974+0000 7fb3cf59e700 1 --2- 172.21.15.81:0/3919496399 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb3b0066f30 0x7fb3b00693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8001620 tx=0x7fb3b80014c0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.974+0000 7fb3cf59e700 1 -- 172.21.15.81:0/3919496399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d0068e90 msgr2=0x7fb3d016ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:50.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.974+0000 7fb3cf59e700 1 --2- 172.21.15.81:0/3919496399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d0068e90 0x7fb3d016ad50 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb3d00cd460 tx=0x7fb3c0016000 comp rx=0 tx=0).stop 2023-10-07T08:47:50.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.974+0000 7fb3cf59e700 1 -- 172.21.15.81:0/3919496399 shutdown_connections 2023-10-07T08:47:50.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.974+0000 7fb3cf59e700 1 --2- 172.21.15.81:0/3919496399 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb3b0066f30 0x7fb3b00693e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.974+0000 7fb3cf59e700 1 --2- 172.21.15.81:0/3919496399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3d0159f10 0x7fb3d016d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.974+0000 7fb3cf59e700 1 --2- 172.21.15.81:0/3919496399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d0068e90 0x7fb3d016ad50 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.974+0000 7fb3cf59e700 1 --2- 172.21.15.81:0/3919496399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3d0159b40 0x7fb3d00c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.974+0000 7fb3cf59e700 1 -- 172.21.15.81:0/3919496399 >> 172.21.15.81:0/3919496399 conn(0x7fb3d00cd660 msgr2=0x7fb3d00b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.974+0000 7fb3cf59e700 1 -- 172.21.15.81:0/3919496399 shutdown_connections 2023-10-07T08:47:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:50.974+0000 7fb3cf59e700 1 -- 172.21.15.81:0/3919496399 wait complete. 2023-10-07T08:47:50.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T08:47:51.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.104+0000 7fcac9118700 1 Processor -- start 2023-10-07T08:47:51.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.104+0000 7fcac9118700 1 -- start start 2023-10-07T08:47:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.105+0000 7fcac9118700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcac4157ca0 0x7fcac40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.105+0000 7fcac9118700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcac406d120 0x7fcac406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.105+0000 7fcac9118700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac40d07c0 con 0x7fcac41578d0 2023-10-07T08:47:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.105+0000 7fcac9118700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac406da50 con 0x7fcac4157ca0 2023-10-07T08:47:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.105+0000 7fcac9118700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac40cfbb0 con 0x7fcac406d120 2023-10-07T08:47:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.105+0000 7fcaba59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcac4157ca0 0x7fcac40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.105+0000 7fcaba59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcac4157ca0 0x7fcac40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39184/0 (socket says 172.21.15.81:39184) 2023-10-07T08:47:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.105+0000 7fcaba59c700 1 -- 172.21.15.81:0/3672216459 learned_addr learned my addr 172.21.15.81:0/3672216459 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.105+0000 7fcac359e700 1 --2- 172.21.15.81:0/3672216459 >> v2:172.21.15.89:3300/0 conn(0x7fcac406d120 0x7fcac406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.105+0000 7fcaba59c700 1 -- 172.21.15.81:0/3672216459 >> v2:172.21.15.89:3300/0 conn(0x7fcac406d120 msgr2=0x7fcac406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.105+0000 7fcaba59c700 1 --2- 172.21.15.81:0/3672216459 >> v2:172.21.15.89:3300/0 conn(0x7fcac406d120 0x7fcac406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.105+0000 7fcaba59c700 1 -- 172.21.15.81:0/3672216459 >> v1:172.21.15.89:6789/0 conn(0x7fcac41578d0 legacy=0x7fcac415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.105+0000 7fcaba59c700 1 -- 172.21.15.81:0/3672216459 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac40cfe90 con 0x7fcac4157ca0 2023-10-07T08:47:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.105+0000 7fcac359e700 1 --2- 172.21.15.81:0/3672216459 >> v2:172.21.15.89:3300/0 conn(0x7fcac406d120 0x7fcac406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.105+0000 7fcaba59c700 1 --2- 172.21.15.81:0/3672216459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac4157ca0 0x7fcac40cf4f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fcac4068300 tx=0x7fcaac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cf28ceafc5cbfd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.106+0000 7fcac259c700 1 -- 172.21.15.81:0/3672216459 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac00b820 con 0x7fcac4157ca0 2023-10-07T08:47:51.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.106+0000 7fcac259c700 1 -- 172.21.15.81:0/3672216459 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac00b980 con 0x7fcac4157ca0 2023-10-07T08:47:51.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.106+0000 7fcac259c700 1 -- 172.21.15.81:0/3672216459 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac00bd20 con 0x7fcac4157ca0 2023-10-07T08:47:51.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.106+0000 7fcac9118700 1 -- 172.21.15.81:0/3672216459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac4157ca0 msgr2=0x7fcac40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:51.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.106+0000 7fcac9118700 1 --2- 172.21.15.81:0/3672216459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac4157ca0 0x7fcac40cf4f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fcac4068300 tx=0x7fcaac009250 comp rx=0 tx=0).stop 2023-10-07T08:47:51.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.106+0000 7fcac9118700 1 -- 172.21.15.81:0/3672216459 shutdown_connections 2023-10-07T08:47:51.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.106+0000 7fcac9118700 1 --2- 172.21.15.81:0/3672216459 >> v2:172.21.15.89:3300/0 conn(0x7fcac406d120 0x7fcac406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:51.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.106+0000 7fcac9118700 1 --2- 172.21.15.81:0/3672216459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac4157ca0 0x7fcac40cf4f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:51.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.106+0000 7fcac9118700 1 -- 172.21.15.81:0/3672216459 >> 172.21.15.81:0/3672216459 conn(0x7fcac406bb90 msgr2=0x7fcac406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:51.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.106+0000 7fcac9118700 1 -- 172.21.15.81:0/3672216459 shutdown_connections 2023-10-07T08:47:51.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.106+0000 7fcac9118700 1 -- 172.21.15.81:0/3672216459 wait complete. 2023-10-07T08:47:51.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.107+0000 7fcac9118700 1 Processor -- start 2023-10-07T08:47:51.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.107+0000 7fcac9118700 1 -- start start 2023-10-07T08:47:51.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.108+0000 7fcac9118700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcac406d120 0x7fcac4169f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:51.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.108+0000 7fcac9118700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcac41578d0 0x7fcac40b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:51.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.108+0000 7fcac9118700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac4157ca0 0x7fcac40c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.108+0000 7fcac9118700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac40c64b0 con 0x7fcac4157ca0 2023-10-07T08:47:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.108+0000 7fcac9118700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac40b6040 con 0x7fcac406d120 2023-10-07T08:47:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.108+0000 7fcac9118700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac40b6320 con 0x7fcac41578d0 2023-10-07T08:47:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.108+0000 7fcac359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac4157ca0 0x7fcac40c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.108+0000 7fcac359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac4157ca0 0x7fcac40c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39196/0 (socket says 172.21.15.81:39196) 2023-10-07T08:47:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.108+0000 7fcac359e700 1 -- 172.21.15.81:0/2922597434 learned_addr learned my addr 172.21.15.81:0/2922597434 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.108+0000 7fcaba59c700 1 --2- 172.21.15.81:0/2922597434 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcac41578d0 0x7fcac40b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.108+0000 7fcac2d9d700 1 --2- 172.21.15.81:0/2922597434 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcac406d120 0x7fcac4169f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.108+0000 7fcac359e700 1 -- 172.21.15.81:0/2922597434 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcac41578d0 msgr2=0x7fcac40b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.108+0000 7fcac359e700 1 --2- 172.21.15.81:0/2922597434 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcac41578d0 0x7fcac40b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.108+0000 7fcac359e700 1 -- 172.21.15.81:0/2922597434 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcac406d120 msgr2=0x7fcac4169f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:51.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.108+0000 7fcac359e700 1 --2- 172.21.15.81:0/2922597434 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcac406d120 0x7fcac4169f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.109+0000 7fcac359e700 1 -- 172.21.15.81:0/2922597434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac0094f0 con 0x7fcac4157ca0 2023-10-07T08:47:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.109+0000 7fcac2d9d700 1 --2- 172.21.15.81:0/2922597434 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcac406d120 0x7fcac4169f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:47:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.109+0000 7fcaba59c700 1 --2- 172.21.15.81:0/2922597434 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcac41578d0 0x7fcac40b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:47:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.109+0000 7fcac359e700 1 --2- 172.21.15.81:0/2922597434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac4157ca0 0x7fcac40c8550 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00a380 tx=0x7fcabc007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.109+0000 7fcabb7fe700 1 -- 172.21.15.81:0/2922597434 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00ae10 con 0x7fcac4157ca0 2023-10-07T08:47:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.109+0000 7fcabb7fe700 1 -- 172.21.15.81:0/2922597434 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc00d650 con 0x7fcac4157ca0 2023-10-07T08:47:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.109+0000 7fcac9118700 1 -- 172.21.15.81:0/2922597434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac40c6700 con 0x7fcac4157ca0 2023-10-07T08:47:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.109+0000 7fcabb7fe700 1 -- 172.21.15.81:0/2922597434 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00da10 con 0x7fcac4157ca0 2023-10-07T08:47:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.109+0000 7fcac9118700 1 -- 172.21.15.81:0/2922597434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac40c5d70 con 0x7fcac4157ca0 2023-10-07T08:47:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.110+0000 7fcac9118700 1 -- 172.21.15.81:0/2922597434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac4067ac0 con 0x7fcac4157ca0 2023-10-07T08:47:51.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.110+0000 7fcabb7fe700 1 -- 172.21.15.81:0/2922597434 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcabc01e3b0 con 0x7fcac4157ca0 2023-10-07T08:47:51.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.111+0000 7fcabb7fe700 1 --2- 172.21.15.81:0/2922597434 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcaa4066f30 0x7fcaa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:51.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.111+0000 7fcac2d9d700 1 --2- 172.21.15.81:0/2922597434 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcaa4066f30 0x7fcaa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:51.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.111+0000 7fcabb7fe700 1 -- 172.21.15.81:0/2922597434 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcabc084e80 con 0x7fcac4157ca0 2023-10-07T08:47:51.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.111+0000 7fcac2d9d700 1 --2- 172.21.15.81:0/2922597434 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcaa4066f30 0x7fcaa40693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcab4009a80 tx=0x7fcab4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:51.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.115+0000 7fcabb7fe700 1 -- 172.21.15.81:0/2922597434 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcabc0520f0 con 0x7fcac4157ca0 2023-10-07T08:47:51.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:51.345+0000 7fcac9118700 1 -- 172.21.15.81:0/2922597434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcac40d0170 con 0x7fcac4157ca0 2023-10-07T08:47:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.343+0000 7fcabb7fe700 1 -- 172.21.15.81:0/2922597434 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v49) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcabc01a020 con 0x7fcac4157ca0 2023-10-07T08:47:52.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.345+0000 7fcac9118700 1 -- 172.21.15.81:0/2922597434 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcaa4066f30 msgr2=0x7fcaa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.345+0000 7fcac9118700 1 --2- 172.21.15.81:0/2922597434 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcaa4066f30 0x7fcaa40693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcab4009a80 tx=0x7fcab4008040 comp rx=0 tx=0).stop 2023-10-07T08:47:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.345+0000 7fcac9118700 1 -- 172.21.15.81:0/2922597434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac4157ca0 msgr2=0x7fcac40c8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.345+0000 7fcac9118700 1 --2- 172.21.15.81:0/2922597434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac4157ca0 0x7fcac40c8550 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00a380 tx=0x7fcabc007900 comp rx=0 tx=0).stop 2023-10-07T08:47:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.345+0000 7fcac9118700 1 -- 172.21.15.81:0/2922597434 shutdown_connections 2023-10-07T08:47:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.345+0000 7fcac9118700 1 --2- 172.21.15.81:0/2922597434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac4157ca0 0x7fcac40c8550 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.345+0000 7fcac9118700 1 --2- 172.21.15.81:0/2922597434 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcac406d120 0x7fcac4169f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.345+0000 7fcac9118700 1 --2- 172.21.15.81:0/2922597434 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcaa4066f30 0x7fcaa40693e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.345+0000 7fcac9118700 1 --2- 172.21.15.81:0/2922597434 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcac41578d0 0x7fcac40b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.345+0000 7fcac9118700 1 -- 172.21.15.81:0/2922597434 >> 172.21.15.81:0/2922597434 conn(0x7fcac406bb90 msgr2=0x7fcac415e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.345+0000 7fcac9118700 1 -- 172.21.15.81:0/2922597434 shutdown_connections 2023-10-07T08:47:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.345+0000 7fcac9118700 1 -- 172.21.15.81:0/2922597434 wait complete. 2023-10-07T08:47:52.358 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T08:47:52.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.476+0000 7f6ad12be700 1 Processor -- start 2023-10-07T08:47:52.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.476+0000 7f6ad12be700 1 -- start start 2023-10-07T08:47:52.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.477+0000 7f6ad12be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6acc069440 0x7f6acc0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:52.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.477+0000 7f6ad12be700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6acc0c71d0 0x7f6acc0c7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:52.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.477+0000 7f6ad12be700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6acc0cb880 con 0x7f6acc156420 2023-10-07T08:47:52.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.477+0000 7f6ad12be700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6acc06aa10 con 0x7f6acc0c71d0 2023-10-07T08:47:52.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.477+0000 7f6ad12be700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0c7b90 con 0x7f6acc069440 2023-10-07T08:47:52.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.478+0000 7f6acb7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6acc0c71d0 0x7f6acc0c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:52.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.478+0000 7f6ac27fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6acc069440 0x7f6acc0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:52.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.478+0000 7f6acb7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6acc0c71d0 0x7f6acc0c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:39012/0 (socket says 172.21.15.81:39012) 2023-10-07T08:47:52.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.478+0000 7f6acaffd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6acc156420 0x7f6acc0cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:36118/0 (socket says 172.21.15.81:36118) 2023-10-07T08:47:52.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.478+0000 7f6acb7fe700 1 -- 172.21.15.81:0/1390954965 learned_addr learned my addr 172.21.15.81:0/1390954965 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:52.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.478+0000 7f6ac27fc700 1 -- 172.21.15.81:0/1390954965 >> v2:172.21.15.89:3300/0 conn(0x7f6acc0c71d0 msgr2=0x7f6acc0c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:52.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.478+0000 7f6ac27fc700 1 --2- 172.21.15.81:0/1390954965 >> v2:172.21.15.89:3300/0 conn(0x7f6acc0c71d0 0x7f6acc0c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:52.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.478+0000 7f6ac27fc700 1 -- 172.21.15.81:0/1390954965 >> v1:172.21.15.89:6789/0 conn(0x7f6acc156420 legacy=0x7f6acc0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:52.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.478+0000 7f6ac27fc700 1 -- 172.21.15.81:0/1390954965 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc0cac70 con 0x7f6acc069440 2023-10-07T08:47:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.478+0000 7f6aca7fc700 1 -- 172.21.15.81:0/1390954965 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475266768 0 0) 0x7f6acc0cb880 con 0x7f6acc156420 2023-10-07T08:47:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.478+0000 7f6acb7fe700 1 --2- 172.21.15.81:0/1390954965 >> v2:172.21.15.89:3300/0 conn(0x7f6acc0c71d0 0x7f6acc0c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:47:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.478+0000 7f6ac27fc700 1 --2- 172.21.15.81:0/1390954965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6acc069440 0x7f6acc0698b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40098e0 tx=0x7f6ab40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b4618ce60f68d79 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.478+0000 7f6aca7fc700 1 -- 172.21.15.81:0/1390954965 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab400b640 con 0x7f6acc069440 2023-10-07T08:47:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.478+0000 7f6aca7fc700 1 -- 172.21.15.81:0/1390954965 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab400b7a0 con 0x7f6acc069440 2023-10-07T08:47:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.478+0000 7f6aca7fc700 1 -- 172.21.15.81:0/1390954965 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab400bb40 con 0x7f6acc069440 2023-10-07T08:47:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.479+0000 7f6ad12be700 1 -- 172.21.15.81:0/1390954965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6acc069440 msgr2=0x7f6acc0698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.479+0000 7f6ad12be700 1 --2- 172.21.15.81:0/1390954965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6acc069440 0x7f6acc0698b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40098e0 tx=0x7f6ab40091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.479+0000 7f6ad12be700 1 -- 172.21.15.81:0/1390954965 shutdown_connections 2023-10-07T08:47:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.479+0000 7f6ad12be700 1 --2- 172.21.15.81:0/1390954965 >> v2:172.21.15.89:3300/0 conn(0x7f6acc0c71d0 0x7f6acc0c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:52.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.479+0000 7f6ad12be700 1 --2- 172.21.15.81:0/1390954965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6acc069440 0x7f6acc0698b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:52.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.479+0000 7f6ad12be700 1 -- 172.21.15.81:0/1390954965 >> 172.21.15.81:0/1390954965 conn(0x7f6acc06c660 msgr2=0x7f6acc0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:52.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.479+0000 7f6ad12be700 1 -- 172.21.15.81:0/1390954965 shutdown_connections 2023-10-07T08:47:52.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.479+0000 7f6ad12be700 1 -- 172.21.15.81:0/1390954965 wait complete. 2023-10-07T08:47:52.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.480+0000 7f6ad12be700 1 Processor -- start 2023-10-07T08:47:52.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.480+0000 7f6ad12be700 1 -- start start 2023-10-07T08:47:52.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.481+0000 7f6ad12be700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6acc069440 0x7f6acc0c2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:52.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.481+0000 7f6ad12be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6acc0c71d0 0x7f6acc169c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:52.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.481+0000 7f6ad12be700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc156420 0x7f6acc140810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:52.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.481+0000 7f6ad12be700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc16add0 con 0x7f6acc156420 2023-10-07T08:47:52.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.481+0000 7f6ad12be700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc16a450 con 0x7f6acc069440 2023-10-07T08:47:52.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.481+0000 7f6ad12be700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc16a730 con 0x7f6acc0c71d0 2023-10-07T08:47:52.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.481+0000 7f6acb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc156420 0x7f6acc140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:52.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.481+0000 7f6acb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc156420 0x7f6acc140810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42982/0 (socket says 172.21.15.81:42982) 2023-10-07T08:47:52.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.481+0000 7f6acb7fe700 1 -- 172.21.15.81:0/4244277070 learned_addr learned my addr 172.21.15.81:0/4244277070 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:52.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.481+0000 7f6acaffd700 1 --2- 172.21.15.81:0/4244277070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6acc069440 0x7f6acc0c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:52.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.481+0000 7f6ac27fc700 1 --2- 172.21.15.81:0/4244277070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6acc0c71d0 0x7f6acc169c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:52.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.481+0000 7f6acb7fe700 1 -- 172.21.15.81:0/4244277070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6acc0c71d0 msgr2=0x7f6acc169c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:52.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.481+0000 7f6acb7fe700 1 --2- 172.21.15.81:0/4244277070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6acc0c71d0 0x7f6acc169c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:52.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.481+0000 7f6acb7fe700 1 -- 172.21.15.81:0/4244277070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6acc069440 msgr2=0x7f6acc0c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:52.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.481+0000 7f6acb7fe700 1 --2- 172.21.15.81:0/4244277070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6acc069440 0x7f6acc0c2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:52.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.481+0000 7f6acb7fe700 1 -- 172.21.15.81:0/4244277070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac4009ae0 con 0x7f6acc156420 2023-10-07T08:47:52.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.482+0000 7f6acb7fe700 1 --2- 172.21.15.81:0/4244277070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc156420 0x7f6acc140810 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009fd0 tx=0x7f6ac400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:52.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.482+0000 7f6ac37fe700 1 -- 172.21.15.81:0/4244277070 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4018070 con 0x7f6acc156420 2023-10-07T08:47:52.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.482+0000 7f6ac37fe700 1 -- 172.21.15.81:0/4244277070 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac400f040 con 0x7f6acc156420 2023-10-07T08:47:52.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.482+0000 7f6ad12be700 1 -- 172.21.15.81:0/4244277070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab4009420 con 0x7f6acc156420 2023-10-07T08:47:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.482+0000 7f6ac37fe700 1 -- 172.21.15.81:0/4244277070 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400cbf0 con 0x7f6acc156420 2023-10-07T08:47:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.482+0000 7f6ad12be700 1 -- 172.21.15.81:0/4244277070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6acc16b020 con 0x7f6acc156420 2023-10-07T08:47:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.483+0000 7f6ad12be700 1 -- 172.21.15.81:0/4244277070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6acc16b210 con 0x7f6acc156420 2023-10-07T08:47:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.483+0000 7f6ac37fe700 1 -- 172.21.15.81:0/4244277070 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ac4003020 con 0x7f6acc156420 2023-10-07T08:47:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.483+0000 7f6ac37fe700 1 --2- 172.21.15.81:0/4244277070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6aac066f30 0x7f6aac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.484+0000 7f6ac37fe700 1 -- 172.21.15.81:0/4244277070 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ac4084390 con 0x7f6acc156420 2023-10-07T08:47:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.484+0000 7f6acaffd700 1 --2- 172.21.15.81:0/4244277070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6aac066f30 0x7f6aac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.484+0000 7f6acaffd700 1 --2- 172.21.15.81:0/4244277070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6aac066f30 0x7f6aac0693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6acc16d160 tx=0x7f6abc007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.488+0000 7f6ac37fe700 1 -- 172.21.15.81:0/4244277070 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ac404d5a0 con 0x7f6acc156420 2023-10-07T08:47:52.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:52.709+0000 7f6ad12be700 1 -- 172.21.15.81:0/4244277070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6acc0caf50 con 0x7f6acc156420 2023-10-07T08:47:53.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.346+0000 7f6ac37fe700 1 -- 172.21.15.81:0/4244277070 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v50) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6ac4051600 con 0x7f6acc156420 2023-10-07T08:47:53.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.348+0000 7f6ad12be700 1 -- 172.21.15.81:0/4244277070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6aac066f30 msgr2=0x7f6aac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:53.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.348+0000 7f6ad12be700 1 --2- 172.21.15.81:0/4244277070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6aac066f30 0x7f6aac0693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6acc16d160 tx=0x7f6abc007ef0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.348+0000 7f6ad12be700 1 -- 172.21.15.81:0/4244277070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc156420 msgr2=0x7f6acc140810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:53.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.348+0000 7f6ad12be700 1 --2- 172.21.15.81:0/4244277070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc156420 0x7f6acc140810 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009fd0 tx=0x7f6ac400b040 comp rx=0 tx=0).stop 2023-10-07T08:47:53.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.348+0000 7f6ad12be700 1 -- 172.21.15.81:0/4244277070 shutdown_connections 2023-10-07T08:47:53.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.348+0000 7f6ad12be700 1 --2- 172.21.15.81:0/4244277070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc156420 0x7f6acc140810 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.348+0000 7f6ad12be700 1 --2- 172.21.15.81:0/4244277070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6acc069440 0x7f6acc0c2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.348+0000 7f6ad12be700 1 --2- 172.21.15.81:0/4244277070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6aac066f30 0x7f6aac0693e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.348+0000 7f6ad12be700 1 --2- 172.21.15.81:0/4244277070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6acc0c71d0 0x7f6acc169c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.348+0000 7f6ad12be700 1 -- 172.21.15.81:0/4244277070 >> 172.21.15.81:0/4244277070 conn(0x7f6acc06c660 msgr2=0x7f6acc0b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:53.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.348+0000 7f6ad12be700 1 -- 172.21.15.81:0/4244277070 shutdown_connections 2023-10-07T08:47:53.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.348+0000 7f6ad12be700 1 -- 172.21.15.81:0/4244277070 wait complete. 2023-10-07T08:47:53.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:47:53.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.476+0000 7f8ee3356700 1 Processor -- start 2023-10-07T08:47:53.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.476+0000 7f8ee3356700 1 -- start start 2023-10-07T08:47:53.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.477+0000 7f8ee3356700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8edc1578d0 0x7f8edc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:53.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.477+0000 7f8ee3356700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8edc157ca0 0x7f8edc15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:53.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.477+0000 7f8ee3356700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8edc0d07c0 con 0x7f8edc06d120 2023-10-07T08:47:53.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.477+0000 7f8ee3356700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8edc0cfbb0 con 0x7f8edc1578d0 2023-10-07T08:47:53.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.477+0000 7f8ee3356700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8edc0cfe90 con 0x7f8edc157ca0 2023-10-07T08:47:53.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.477+0000 7f8ee10f2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8edc1578d0 0x7f8edc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:53.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.477+0000 7f8ee18f3700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8edc06d120 0x7f8edc06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53670/0 (socket says 172.21.15.81:53670) 2023-10-07T08:47:53.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.477+0000 7f8ee18f3700 1 -- 172.21.15.81:0/1971218888 learned_addr learned my addr 172.21.15.81:0/1971218888 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:53.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.477+0000 7f8ee08f1700 1 --2- 172.21.15.81:0/1971218888 >> v2:172.21.15.89:3300/0 conn(0x7f8edc157ca0 0x7f8edc15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:53.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.478+0000 7f8ee10f2700 1 -- 172.21.15.81:0/1971218888 >> v2:172.21.15.89:3300/0 conn(0x7f8edc157ca0 msgr2=0x7f8edc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:53.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.478+0000 7f8ee10f2700 1 --2- 172.21.15.81:0/1971218888 >> v2:172.21.15.89:3300/0 conn(0x7f8edc157ca0 0x7f8edc15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.478+0000 7f8ee10f2700 1 -- 172.21.15.81:0/1971218888 >> v1:172.21.15.81:6789/0 conn(0x7f8edc06d120 legacy=0x7f8edc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:53.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.478+0000 7f8ee10f2700 1 -- 172.21.15.81:0/1971218888 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc0d0170 con 0x7f8edc1578d0 2023-10-07T08:47:53.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.478+0000 7f8ed3fff700 1 -- 172.21.15.81:0/1971218888 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008171142 0 0) 0x7f8edc0d07c0 con 0x7f8edc06d120 2023-10-07T08:47:53.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.478+0000 7f8ee08f1700 1 --2- 172.21.15.81:0/1971218888 >> v2:172.21.15.89:3300/0 conn(0x7f8edc157ca0 0x7f8edc15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:47:53.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.478+0000 7f8ee10f2700 1 --2- 172.21.15.81:0/1971218888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8edc1578d0 0x7f8edc0cf4f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f8edc068510 tx=0x7f8ed80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff8354c4106f6a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:53.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.478+0000 7f8ed3fff700 1 -- 172.21.15.81:0/1971218888 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed800b6b0 con 0x7f8edc1578d0 2023-10-07T08:47:53.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.478+0000 7f8ed3fff700 1 -- 172.21.15.81:0/1971218888 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed800b810 con 0x7f8edc1578d0 2023-10-07T08:47:53.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.478+0000 7f8ed3fff700 1 -- 172.21.15.81:0/1971218888 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed800bbb0 con 0x7f8edc1578d0 2023-10-07T08:47:53.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.478+0000 7f8ee3356700 1 -- 172.21.15.81:0/1971218888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8edc1578d0 msgr2=0x7f8edc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:53.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.478+0000 7f8ee3356700 1 --2- 172.21.15.81:0/1971218888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8edc1578d0 0x7f8edc0cf4f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f8edc068510 tx=0x7f8ed80091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.478+0000 7f8ee3356700 1 -- 172.21.15.81:0/1971218888 shutdown_connections 2023-10-07T08:47:53.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.478+0000 7f8ee3356700 1 --2- 172.21.15.81:0/1971218888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8edc1578d0 0x7f8edc0cf4f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.478+0000 7f8ee3356700 1 --2- 172.21.15.81:0/1971218888 >> v2:172.21.15.89:3300/0 conn(0x7f8edc157ca0 0x7f8edc15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.478+0000 7f8ee3356700 1 -- 172.21.15.81:0/1971218888 >> 172.21.15.81:0/1971218888 conn(0x7f8edc06bb90 msgr2=0x7f8edc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:53.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.479+0000 7f8ee3356700 1 -- 172.21.15.81:0/1971218888 shutdown_connections 2023-10-07T08:47:53.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.479+0000 7f8ee3356700 1 -- 172.21.15.81:0/1971218888 wait complete. 2023-10-07T08:47:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.480+0000 7f8ee3356700 1 Processor -- start 2023-10-07T08:47:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.480+0000 7f8ee3356700 1 -- start start 2023-10-07T08:47:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.480+0000 7f8ee3356700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8edc06d120 0x7f8edc0c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.480+0000 7f8ee3356700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8edc1578d0 0x7f8edc068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.480+0000 7f8ee3356700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8edc157ca0 0x7f8edc0c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.480+0000 7f8ee3356700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc16dc20 con 0x7f8edc06d120 2023-10-07T08:47:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.480+0000 7f8ee3356700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc16ab30 con 0x7f8edc157ca0 2023-10-07T08:47:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.480+0000 7f8ee3356700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc16ae10 con 0x7f8edc1578d0 2023-10-07T08:47:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.480+0000 7f8ee10f2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8edc06d120 0x7f8edc0c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.481+0000 7f8ee10f2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8edc06d120 0x7f8edc0c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42994/0 (socket says 172.21.15.81:42994) 2023-10-07T08:47:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.481+0000 7f8ee10f2700 1 -- 172.21.15.81:0/3591702002 learned_addr learned my addr 172.21.15.81:0/3591702002 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:53.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.481+0000 7f8ee18f3700 1 --2- 172.21.15.81:0/3591702002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8edc157ca0 0x7f8edc0c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:53.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.481+0000 7f8ee10f2700 1 -- 172.21.15.81:0/3591702002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8edc1578d0 msgr2=0x7f8edc068b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:53.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.481+0000 7f8ee08f1700 1 --2- 172.21.15.81:0/3591702002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8edc1578d0 0x7f8edc068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:53.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.481+0000 7f8ee10f2700 1 --2- 172.21.15.81:0/3591702002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8edc1578d0 0x7f8edc068b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.481+0000 7f8ee10f2700 1 -- 172.21.15.81:0/3591702002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8edc157ca0 msgr2=0x7f8edc0c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:53.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.481+0000 7f8ee10f2700 1 --2- 172.21.15.81:0/3591702002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8edc157ca0 0x7f8edc0c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.481+0000 7f8ee10f2700 1 -- 172.21.15.81:0/3591702002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8009420 con 0x7f8edc06d120 2023-10-07T08:47:53.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.481+0000 7f8ee18f3700 1 --2- 172.21.15.81:0/3591702002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8edc157ca0 0x7f8edc0c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:53.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.481+0000 7f8ee10f2700 1 --2- 172.21.15.81:0/3591702002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8edc06d120 0x7f8edc0c87a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80093f0 tx=0x7f8ed8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:53.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.481+0000 7f8ed17fa700 1 -- 172.21.15.81:0/3591702002 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed800bb90 con 0x7f8edc06d120 2023-10-07T08:47:53.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.481+0000 7f8ed17fa700 1 -- 172.21.15.81:0/3591702002 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed8011420 con 0x7f8edc06d120 2023-10-07T08:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.481+0000 7f8ee3356700 1 -- 172.21.15.81:0/3591702002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8edc16b0f0 con 0x7f8edc06d120 2023-10-07T08:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.481+0000 7f8ed17fa700 1 -- 172.21.15.81:0/3591702002 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed80117c0 con 0x7f8edc06d120 2023-10-07T08:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.481+0000 7f8ee3356700 1 -- 172.21.15.81:0/3591702002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8edc159d40 con 0x7f8edc06d120 2023-10-07T08:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.482+0000 7f8ee3356700 1 -- 172.21.15.81:0/3591702002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8edc155ee0 con 0x7f8edc06d120 2023-10-07T08:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.482+0000 7f8ed17fa700 1 -- 172.21.15.81:0/3591702002 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ed8011b30 con 0x7f8edc06d120 2023-10-07T08:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.483+0000 7f8ed17fa700 1 --2- 172.21.15.81:0/3591702002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8ec0066f30 0x7f8ec00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.483+0000 7f8ed17fa700 1 -- 172.21.15.81:0/3591702002 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ed8085b40 con 0x7f8edc06d120 2023-10-07T08:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.483+0000 7f8ee08f1700 1 --2- 172.21.15.81:0/3591702002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8ec0066f30 0x7f8ec00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.483+0000 7f8ee08f1700 1 --2- 172.21.15.81:0/3591702002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8ec0066f30 0x7f8ec00693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc006f00 tx=0x7f8ecc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.487+0000 7f8ed17fa700 1 -- 172.21.15.81:0/3591702002 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ed8052db0 con 0x7f8edc06d120 2023-10-07T08:47:53.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.712+0000 7f8ee3356700 1 -- 172.21.15.81:0/3591702002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8edc0d0450 con 0x7f8edc06d120 2023-10-07T08:47:53.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.713+0000 7f8ed17fa700 1 -- 172.21.15.81:0/3591702002 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f8ed8006cb0 con 0x7f8edc06d120 2023-10-07T08:47:53.713 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:53.714 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1015639142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1015639142},{"type":"v1","addr":"172.21.15.89:6833","nonce":1015639142}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2650972762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2650972762},{"type":"v1","addr":"172.21.15.89:6835","nonce":2650972762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2058286084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2058286084},{"type":"v1","addr":"172.21.15.81:6836","nonce":2058286084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:47:49.671409+0000","modified":"2023-10-07T08:47:53.341944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6837/3696879604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3696879604},{"type":"v1","addr":"172.21.15.81:6837","nonce":3696879604}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-07T08:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.715+0000 7f8ee3356700 1 -- 172.21.15.81:0/3591702002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8ec0066f30 msgr2=0x7f8ec00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.715+0000 7f8ee3356700 1 --2- 172.21.15.81:0/3591702002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8ec0066f30 0x7f8ec00693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc006f00 tx=0x7f8ecc008040 comp rx=0 tx=0).stop 2023-10-07T08:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.715+0000 7f8ee3356700 1 -- 172.21.15.81:0/3591702002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8edc06d120 msgr2=0x7f8edc0c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.715+0000 7f8ee3356700 1 --2- 172.21.15.81:0/3591702002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8edc06d120 0x7f8edc0c87a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80093f0 tx=0x7f8ed8017000 comp rx=0 tx=0).stop 2023-10-07T08:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.715+0000 7f8ee3356700 1 -- 172.21.15.81:0/3591702002 shutdown_connections 2023-10-07T08:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.715+0000 7f8ee3356700 1 --2- 172.21.15.81:0/3591702002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8edc157ca0 0x7f8edc0c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.715+0000 7f8ee3356700 1 --2- 172.21.15.81:0/3591702002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8edc06d120 0x7f8edc0c87a0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.715+0000 7f8ee3356700 1 --2- 172.21.15.81:0/3591702002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8ec0066f30 0x7f8ec00693e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.715+0000 7f8ee3356700 1 --2- 172.21.15.81:0/3591702002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8edc1578d0 0x7f8edc068b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.715+0000 7f8ee3356700 1 -- 172.21.15.81:0/3591702002 >> 172.21.15.81:0/3591702002 conn(0x7f8edc06bb90 msgr2=0x7f8edc06bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:53.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.715+0000 7f8ee3356700 1 -- 172.21.15.81:0/3591702002 shutdown_connections 2023-10-07T08:47:53.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.715+0000 7f8ee3356700 1 -- 172.21.15.81:0/3591702002 wait complete. 2023-10-07T08:47:53.717 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 50 2023-10-07T08:47:53.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:47:53.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.841+0000 7f0a8d12b700 1 Processor -- start 2023-10-07T08:47:53.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.841+0000 7f0a8d12b700 1 -- start start 2023-10-07T08:47:53.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.841+0000 7f0a8d12b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0a8806dd60 0x7f0a880b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:53.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.841+0000 7f0a8d12b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a880b0ca0 con 0x7f0a880cf240 2023-10-07T08:47:53.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.841+0000 7f0a8d12b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a880b00d0 con 0x7f0a8815a2a0 2023-10-07T08:47:53.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.841+0000 7f0a8d12b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8806ea90 con 0x7f0a8806dd60 2023-10-07T08:47:53.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a8659c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0a880cf240 0x7f0a8806d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53674/0 (socket says 172.21.15.81:53674) 2023-10-07T08:47:53.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a8659c700 1 -- 172.21.15.81:0/356276825 learned_addr learned my addr 172.21.15.81:0/356276825 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:53.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a85d9b700 1 -- 172.21.15.81:0/356276825 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621858211 0 0) 0x7f0a880b0ca0 con 0x7f0a880cf240 2023-10-07T08:47:53.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a85d9b700 1 -- 172.21.15.81:0/356276825 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a70003570 con 0x7f0a880cf240 2023-10-07T08:47:53.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a8759e700 1 --2- 172.21.15.81:0/356276825 >> v2:172.21.15.89:3300/0 conn(0x7f0a8806dd60 0x7f0a880b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:53.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a85d9b700 1 -- 172.21.15.81:0/356276825 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2648265565 0 0) 0x7f0a70003570 con 0x7f0a880cf240 2023-10-07T08:47:53.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a85d9b700 1 -- 172.21.15.81:0/356276825 >> v2:172.21.15.89:3300/0 conn(0x7f0a8806dd60 msgr2=0x7f0a880b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:53.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a85d9b700 1 --2- 172.21.15.81:0/356276825 >> v2:172.21.15.89:3300/0 conn(0x7f0a8806dd60 0x7f0a880b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a85d9b700 1 -- 172.21.15.81:0/356276825 >> v1:172.21.15.89:6789/0 conn(0x7f0a8815a2a0 legacy=0x7f0a880ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:53.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a85d9b700 1 -- 172.21.15.81:0/356276825 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a880b0370 con 0x7f0a880cf240 2023-10-07T08:47:53.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a85d9b700 1 -- 172.21.15.81:0/356276825 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f0a7c001470 con 0x7f0a880cf240 2023-10-07T08:47:53.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a85d9b700 1 -- 172.21.15.81:0/356276825 >> v1:172.21.15.81:6789/0 conn(0x7f0a880cf240 legacy=0x7f0a8806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:53.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a85d9b700 1 --2- 172.21.15.81:0/356276825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70003a60 0x7f0a70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:53.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a85d9b700 1 --2- 172.21.15.81:0/356276825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a70004810 0x7f0a70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:53.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a85d9b700 1 --2- 172.21.15.81:0/356276825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a700052e0 0x7f0a7000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:53.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a85d9b700 1 -- 172.21.15.81:0/356276825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8806ea90 con 0x7f0a70003a60 2023-10-07T08:47:53.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a85d9b700 1 -- 172.21.15.81:0/356276825 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7000c190 con 0x7f0a700052e0 2023-10-07T08:47:53.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a85d9b700 1 -- 172.21.15.81:0/356276825 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7000c350 con 0x7f0a70004810 2023-10-07T08:47:53.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a86d9d700 1 --2- 172.21.15.81:0/356276825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70003a60 0x7f0a70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:53.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a8759e700 1 --2- 172.21.15.81:0/356276825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a700052e0 0x7f0a7000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:53.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.842+0000 7f0a8659c700 1 --2- 172.21.15.81:0/356276825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a70004810 0x7f0a70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:53.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a86d9d700 1 -- 172.21.15.81:0/356276825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a70004810 msgr2=0x7f0a70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:53.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a86d9d700 1 --2- 172.21.15.81:0/356276825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a70004810 0x7f0a70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a86d9d700 1 -- 172.21.15.81:0/356276825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a700052e0 msgr2=0x7f0a7000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:53.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a86d9d700 1 --2- 172.21.15.81:0/356276825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a700052e0 0x7f0a7000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a8759e700 1 -- 172.21.15.81:0/356276825 reap_dead start 2023-10-07T08:47:53.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a86d9d700 1 -- 172.21.15.81:0/356276825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a70003570 con 0x7f0a70003a60 2023-10-07T08:47:53.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a86d9d700 1 --2- 172.21.15.81:0/356276825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70003a60 0x7f0a70003e70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0a780018b0 tx=0x7f0a78007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61accbb7a83375fa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:53.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a85d9b700 1 -- 172.21.15.81:0/356276825 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78012420 con 0x7f0a70003a60 2023-10-07T08:47:53.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a85d9b700 1 -- 172.21.15.81:0/356276825 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a780125a0 con 0x7f0a70003a60 2023-10-07T08:47:53.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a85d9b700 1 -- 172.21.15.81:0/356276825 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78012960 con 0x7f0a70003a60 2023-10-07T08:47:53.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a8d12b700 1 -- 172.21.15.81:0/356276825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70003a60 msgr2=0x7f0a70003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:53.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a8d12b700 1 --2- 172.21.15.81:0/356276825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70003a60 0x7f0a70003e70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0a780018b0 tx=0x7f0a78007d30 comp rx=0 tx=0).stop 2023-10-07T08:47:53.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a8d12b700 1 -- 172.21.15.81:0/356276825 shutdown_connections 2023-10-07T08:47:53.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a8d12b700 1 --2- 172.21.15.81:0/356276825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70003a60 0x7f0a70003e70 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a8d12b700 1 -- 172.21.15.81:0/356276825 >> 172.21.15.81:0/356276825 conn(0x7f0a88067640 msgr2=0x7f0a88067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:53.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a8d12b700 1 -- 172.21.15.81:0/356276825 shutdown_connections 2023-10-07T08:47:53.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.843+0000 7f0a8d12b700 1 -- 172.21.15.81:0/356276825 wait complete. 2023-10-07T08:47:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.845+0000 7f0a8d12b700 1 Processor -- start 2023-10-07T08:47:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.845+0000 7f0a8d12b700 1 -- start start 2023-10-07T08:47:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.845+0000 7f0a8d12b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a70003a60 0x7f0a8815ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.845+0000 7f0a8d12b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a881457b0 0x7f0a880b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.845+0000 7f0a8d12b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a8815e240 0x7f0a8815e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.845+0000 7f0a8d12b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a881550c0 con 0x7f0a881457b0 2023-10-07T08:47:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.845+0000 7f0a8d12b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8815d0a0 con 0x7f0a70003a60 2023-10-07T08:47:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.845+0000 7f0a8d12b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8815ddb0 con 0x7f0a8815e240 2023-10-07T08:47:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.845+0000 7f0a8659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a881457b0 0x7f0a880b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.845+0000 7f0a8659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a881457b0 0x7f0a880b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43018/0 (socket says 172.21.15.81:43018) 2023-10-07T08:47:53.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.845+0000 7f0a8659c700 1 -- 172.21.15.81:0/59688191 learned_addr learned my addr 172.21.15.81:0/59688191 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:53.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.846+0000 7f0a86d9d700 1 --2- 172.21.15.81:0/59688191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a70003a60 0x7f0a8815ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:53.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.846+0000 7f0a8759e700 1 --2- 172.21.15.81:0/59688191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a8815e240 0x7f0a8815e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:53.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.846+0000 7f0a8659c700 1 -- 172.21.15.81:0/59688191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a8815e240 msgr2=0x7f0a8815e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:53.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.846+0000 7f0a8659c700 1 --2- 172.21.15.81:0/59688191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a8815e240 0x7f0a8815e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.846+0000 7f0a8659c700 1 -- 172.21.15.81:0/59688191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a70003a60 msgr2=0x7f0a8815ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:53.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.846+0000 7f0a8659c700 1 --2- 172.21.15.81:0/59688191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a70003a60 0x7f0a8815ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:53.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.846+0000 7f0a8659c700 1 -- 172.21.15.81:0/59688191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8815d480 con 0x7f0a881457b0 2023-10-07T08:47:53.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.846+0000 7f0a8659c700 1 --2- 172.21.15.81:0/59688191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a881457b0 0x7f0a880b1bc0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0073f0 tx=0x7f0a880b0260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:53.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.846+0000 7f0a6effd700 1 -- 172.21.15.81:0/59688191 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c018030 con 0x7f0a881457b0 2023-10-07T08:47:53.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.846+0000 7f0a6effd700 1 -- 172.21.15.81:0/59688191 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c00f6c0 con 0x7f0a881457b0 2023-10-07T08:47:53.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.846+0000 7f0a8d12b700 1 -- 172.21.15.81:0/59688191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8815d760 con 0x7f0a881457b0 2023-10-07T08:47:53.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.846+0000 7f0a6effd700 1 -- 172.21.15.81:0/59688191 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c00faa0 con 0x7f0a881457b0 2023-10-07T08:47:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.846+0000 7f0a8d12b700 1 -- 172.21.15.81:0/59688191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a880b2100 con 0x7f0a881457b0 2023-10-07T08:47:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.847+0000 7f0a8d12b700 1 -- 172.21.15.81:0/59688191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8815dc00 con 0x7f0a881457b0 2023-10-07T08:47:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.847+0000 7f0a6effd700 1 -- 172.21.15.81:0/59688191 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a7c01b070 con 0x7f0a881457b0 2023-10-07T08:47:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.848+0000 7f0a6effd700 1 --2- 172.21.15.81:0/59688191 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0a74066f30 0x7f0a740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.848+0000 7f0a6effd700 1 -- 172.21.15.81:0/59688191 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a7c019070 con 0x7f0a881457b0 2023-10-07T08:47:53.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.848+0000 7f0a86d9d700 1 --2- 172.21.15.81:0/59688191 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0a74066f30 0x7f0a740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:53.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.848+0000 7f0a86d9d700 1 --2- 172.21.15.81:0/59688191 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0a74066f30 0x7f0a740693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0a880ad630 tx=0x7f0a78015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:53.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:53.852+0000 7f0a6effd700 1 -- 172.21.15.81:0/59688191 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a7c051660 con 0x7f0a881457b0 2023-10-07T08:47:54.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.035+0000 7f0a8d12b700 1 -- 172.21.15.81:0/59688191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a8815def0 con 0x7f0a881457b0 2023-10-07T08:47:54.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.036+0000 7f0a6effd700 1 -- 172.21.15.81:0/59688191 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f0a7c054c80 con 0x7f0a881457b0 2023-10-07T08:47:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:54.037 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":102,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:47:51.300911+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:47:47.993754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-07T08:47:48.631797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:47:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.038+0000 7f0a8d12b700 1 -- 172.21.15.81:0/59688191 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0a74066f30 msgr2=0x7f0a740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.038+0000 7f0a8d12b700 1 --2- 172.21.15.81:0/59688191 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0a74066f30 0x7f0a740693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0a880ad630 tx=0x7f0a78015000 comp rx=0 tx=0).stop 2023-10-07T08:47:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.038+0000 7f0a8d12b700 1 -- 172.21.15.81:0/59688191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a881457b0 msgr2=0x7f0a880b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.038+0000 7f0a8d12b700 1 --2- 172.21.15.81:0/59688191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a881457b0 0x7f0a880b1bc0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0073f0 tx=0x7f0a880b0260 comp rx=0 tx=0).stop 2023-10-07T08:47:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.038+0000 7f0a8d12b700 1 -- 172.21.15.81:0/59688191 shutdown_connections 2023-10-07T08:47:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.038+0000 7f0a8d12b700 1 --2- 172.21.15.81:0/59688191 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0a74066f30 0x7f0a740693e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.038+0000 7f0a8d12b700 1 --2- 172.21.15.81:0/59688191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a8815e240 0x7f0a8815e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.038+0000 7f0a8d12b700 1 --2- 172.21.15.81:0/59688191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a70003a60 0x7f0a8815ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.038+0000 7f0a8d12b700 1 --2- 172.21.15.81:0/59688191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a881457b0 0x7f0a880b1bc0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.038+0000 7f0a8d12b700 1 -- 172.21.15.81:0/59688191 >> 172.21.15.81:0/59688191 conn(0x7f0a88067640 msgr2=0x7f0a88156df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.038+0000 7f0a8d12b700 1 -- 172.21.15.81:0/59688191 shutdown_connections 2023-10-07T08:47:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.038+0000 7f0a8d12b700 1 -- 172.21.15.81:0/59688191 wait complete. 2023-10-07T08:47:54.052 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T08:47:54.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:47:54.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.166+0000 7fe8321f9700 1 Processor -- start 2023-10-07T08:47:54.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.166+0000 7fe8321f9700 1 -- start start 2023-10-07T08:47:54.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.167+0000 7fe8321f9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe82c068e90 0x7fe82c164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.167+0000 7fe8321f9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c0cee10 con 0x7fe82c159b40 2023-10-07T08:47:54.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.167+0000 7fe8321f9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c0cd040 con 0x7fe82c159f10 2023-10-07T08:47:54.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.167+0000 7fe8321f9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe82c0cd320 con 0x7fe82c068e90 2023-10-07T08:47:54.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.167+0000 7fe8311f7700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe82c159b40 0x7fe82c0cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53686/0 (socket says 172.21.15.81:53686) 2023-10-07T08:47:54.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.167+0000 7fe8311f7700 1 -- 172.21.15.81:0/2677581754 learned_addr learned my addr 172.21.15.81:0/2677581754 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:54.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.167+0000 7fe8319f8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe82c068e90 0x7fe82c164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.167+0000 7fe8319f8700 1 -- 172.21.15.81:0/2677581754 >> v1:172.21.15.89:6789/0 conn(0x7fe82c159f10 legacy=0x7fe82c068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:54.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.167+0000 7fe8319f8700 1 -- 172.21.15.81:0/2677581754 >> v1:172.21.15.81:6789/0 conn(0x7fe82c159b40 legacy=0x7fe82c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.167+0000 7fe8319f8700 1 -- 172.21.15.81:0/2677581754 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c0ce7c0 con 0x7fe82c068e90 2023-10-07T08:47:54.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.168+0000 7fe8319f8700 1 --2- 172.21.15.81:0/2677581754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c068e90 0x7fe82c164c70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe8240098e0 tx=0x7fe8240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfe0a32aaa97959 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:54.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.168+0000 7fe823fff700 1 -- 172.21.15.81:0/2677581754 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe824009e80 con 0x7fe82c068e90 2023-10-07T08:47:54.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.168+0000 7fe823fff700 1 -- 172.21.15.81:0/2677581754 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82400b820 con 0x7fe82c068e90 2023-10-07T08:47:54.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.168+0000 7fe823fff700 1 -- 172.21.15.81:0/2677581754 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82400bba0 con 0x7fe82c068e90 2023-10-07T08:47:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.168+0000 7fe8321f9700 1 -- 172.21.15.81:0/2677581754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c068e90 msgr2=0x7fe82c164c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.168+0000 7fe8321f9700 1 --2- 172.21.15.81:0/2677581754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c068e90 0x7fe82c164c70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe8240098e0 tx=0x7fe8240091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.168+0000 7fe8321f9700 1 -- 172.21.15.81:0/2677581754 shutdown_connections 2023-10-07T08:47:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.168+0000 7fe8321f9700 1 --2- 172.21.15.81:0/2677581754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c068e90 0x7fe82c164c70 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.168+0000 7fe8321f9700 1 -- 172.21.15.81:0/2677581754 >> 172.21.15.81:0/2677581754 conn(0x7fe82c0cd660 msgr2=0x7fe82c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.168+0000 7fe8321f9700 1 -- 172.21.15.81:0/2677581754 shutdown_connections 2023-10-07T08:47:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.168+0000 7fe8321f9700 1 -- 172.21.15.81:0/2677581754 wait complete. 2023-10-07T08:47:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.169+0000 7fe8321f9700 1 Processor -- start 2023-10-07T08:47:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.169+0000 7fe8321f9700 1 -- start start 2023-10-07T08:47:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.170+0000 7fe8321f9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe82c068e90 0x7fe82c1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.170+0000 7fe8321f9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c159b40 0x7fe82c15a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.170+0000 7fe8321f9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe82c159f10 0x7fe82c16e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.170+0000 7fe8321f9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0c8c70 con 0x7fe82c159b40 2023-10-07T08:47:54.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.170+0000 7fe8321f9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c15cc60 con 0x7fe82c159f10 2023-10-07T08:47:54.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.170+0000 7fe8321f9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c15cf40 con 0x7fe82c068e90 2023-10-07T08:47:54.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.170+0000 7fe8309f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c159b40 0x7fe82c15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.170+0000 7fe8309f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c159b40 0x7fe82c15a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43036/0 (socket says 172.21.15.81:43036) 2023-10-07T08:47:54.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.170+0000 7fe8309f6700 1 -- 172.21.15.81:0/1289848185 learned_addr learned my addr 172.21.15.81:0/1289848185 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:54.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.171+0000 7fe8311f7700 1 --2- 172.21.15.81:0/1289848185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe82c068e90 0x7fe82c1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.171+0000 7fe8319f8700 1 --2- 172.21.15.81:0/1289848185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe82c159f10 0x7fe82c16e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.171+0000 7fe8309f6700 1 -- 172.21.15.81:0/1289848185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe82c068e90 msgr2=0x7fe82c1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.171+0000 7fe8309f6700 1 --2- 172.21.15.81:0/1289848185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe82c068e90 0x7fe82c1582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.171+0000 7fe8309f6700 1 -- 172.21.15.81:0/1289848185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe82c159f10 msgr2=0x7fe82c16e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.171+0000 7fe8309f6700 1 --2- 172.21.15.81:0/1289848185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe82c159f10 0x7fe82c16e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.171+0000 7fe8309f6700 1 -- 172.21.15.81:0/1289848185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe824009420 con 0x7fe82c159b40 2023-10-07T08:47:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.171+0000 7fe8319f8700 1 --2- 172.21.15.81:0/1289848185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe82c159f10 0x7fe82c16e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:47:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.171+0000 7fe8309f6700 1 --2- 172.21.15.81:0/1289848185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c159b40 0x7fe82c15a340 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00b5e0 tx=0x7fe81c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.171+0000 7fe8217fa700 1 -- 172.21.15.81:0/1289848185 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00f510 con 0x7fe82c159b40 2023-10-07T08:47:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.171+0000 7fe8217fa700 1 -- 172.21.15.81:0/1289848185 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c00f670 con 0x7fe82c159b40 2023-10-07T08:47:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.171+0000 7fe8321f9700 1 -- 172.21.15.81:0/1289848185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c15d220 con 0x7fe82c159b40 2023-10-07T08:47:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.171+0000 7fe8217fa700 1 -- 172.21.15.81:0/1289848185 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00fa30 con 0x7fe82c159b40 2023-10-07T08:47:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.171+0000 7fe8321f9700 1 -- 172.21.15.81:0/1289848185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82c1548f0 con 0x7fe82c159b40 2023-10-07T08:47:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.172+0000 7fe8321f9700 1 -- 172.21.15.81:0/1289848185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82c063e90 con 0x7fe82c159b40 2023-10-07T08:47:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.172+0000 7fe8217fa700 1 -- 172.21.15.81:0/1289848185 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe81c01a400 con 0x7fe82c159b40 2023-10-07T08:47:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.173+0000 7fe8217fa700 1 --2- 172.21.15.81:0/1289848185 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe810066f30 0x7fe8100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.173+0000 7fe8217fa700 1 -- 172.21.15.81:0/1289848185 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe81c084060 con 0x7fe82c159b40 2023-10-07T08:47:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.173+0000 7fe8311f7700 1 --2- 172.21.15.81:0/1289848185 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe810066f30 0x7fe8100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.173+0000 7fe8311f7700 1 --2- 172.21.15.81:0/1289848185 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe810066f30 0x7fe8100693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe82800e160 tx=0x7fe828009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:54.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.177+0000 7fe8217fa700 1 -- 172.21.15.81:0/1289848185 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe81c051350 con 0x7fe82c159b40 2023-10-07T08:47:54.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.356+0000 7fe8321f9700 1 -- 172.21.15.81:0/1289848185 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe82c0ceaa0 con 0x7fe810066f30 2023-10-07T08:47:54.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.364+0000 7fe8217fa700 1 -- 172.21.15.81:0/1289848185 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282003 (secure 0 0 0) 0x7fe82c0ceaa0 con 0x7fe810066f30 2023-10-07T08:47:54.367 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.367+0000 7fe8321f9700 1 -- 172.21.15.81:0/1289848185 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe810066f30 msgr2=0x7fe8100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.367+0000 7fe8321f9700 1 --2- 172.21.15.81:0/1289848185 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe810066f30 0x7fe8100693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe82800e160 tx=0x7fe828009040 comp rx=0 tx=0).stop 2023-10-07T08:47:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.367+0000 7fe8321f9700 1 -- 172.21.15.81:0/1289848185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c159b40 msgr2=0x7fe82c15a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.367+0000 7fe8321f9700 1 --2- 172.21.15.81:0/1289848185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c159b40 0x7fe82c15a340 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00b5e0 tx=0x7fe81c009120 comp rx=0 tx=0).stop 2023-10-07T08:47:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.367+0000 7fe8321f9700 1 -- 172.21.15.81:0/1289848185 shutdown_connections 2023-10-07T08:47:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.367+0000 7fe8321f9700 1 --2- 172.21.15.81:0/1289848185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe82c159f10 0x7fe82c16e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.367+0000 7fe8321f9700 1 --2- 172.21.15.81:0/1289848185 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe810066f30 0x7fe8100693e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.367+0000 7fe8321f9700 1 --2- 172.21.15.81:0/1289848185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe82c068e90 0x7fe82c1582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.367+0000 7fe8321f9700 1 --2- 172.21.15.81:0/1289848185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82c159b40 0x7fe82c15a340 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.367+0000 7fe8321f9700 1 -- 172.21.15.81:0/1289848185 >> 172.21.15.81:0/1289848185 conn(0x7fe82c0cd660 msgr2=0x7fe82c0b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:54.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.367+0000 7fe8321f9700 1 -- 172.21.15.81:0/1289848185 shutdown_connections 2023-10-07T08:47:54.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.367+0000 7fe8321f9700 1 -- 172.21.15.81:0/1289848185 wait complete. 2023-10-07T08:47:54.371 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:47:54.379 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2023-10-07T08:47:54.069795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5322,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557177,"statfs":{"total":1600000000,"available":1594549950,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.787274"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.298194+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:15:58.515103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294002+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:48.119099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295070+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:40.234974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.297055+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:51.378610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295698+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:33.048447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293944+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:50.865656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295473+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:40:53.993327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295349+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:13.888664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296696+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:39.530542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293813+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:09:38.128184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292065+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:02:55.074077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293443+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:48.119099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292126+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:49.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296717+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:44:28.093547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.288364+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:48:32.815580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295701+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:06.585857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296786+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:03.119203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.298134+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:25:17.744264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.290131+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:48:20.456130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295473+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:49:06.137613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295824+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:56:10.032555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293650+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:11.981069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.300037+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:06.585857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296104+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:38:48.558191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292351+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:51:39.019296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292929+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:43.878989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296423+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:29.097371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.299702+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:40.971774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291376+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:23:35.234961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291698+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:52.460384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294717+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:13:54.005176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293062+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:12:59.316878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295145+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:40.971774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.303788+0000","last_change":"2023-10-07T08:47:49.303788+0000","last_active":"2023-10-07T08:47:49.303788+0000","last_peered":"2023-10-07T08:47:49.303788+0000","last_clean":"2023-10-07T08:47:49.303788+0000","last_became_active":"2023-10-07T08:47:49.302673+0000","last_became_peered":"2023-10-07T08:47:49.302673+0000","last_unstale":"2023-10-07T08:47:49.303788+0000","last_undegraded":"2023-10-07T08:47:49.303788+0000","last_fullsized":"2023-10-07T08:47:49.303788+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:51:38.015116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.299328+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:13:54.005176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298088+0000","last_change":"2023-10-07T08:47:49.298088+0000","last_active":"2023-10-07T08:47:49.298088+0000","last_peered":"2023-10-07T08:47:49.298088+0000","last_clean":"2023-10-07T08:47:49.298088+0000","last_became_active":"2023-10-07T08:47:49.297854+0000","last_became_peered":"2023-10-07T08:47:49.297854+0000","last_unstale":"2023-10-07T08:47:49.298088+0000","last_undegraded":"2023-10-07T08:47:49.298088+0000","last_fullsized":"2023-10-07T08:47:49.298088+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:47.114919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293821+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:40:14.077438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294446+0000","last_change":"2023-10-07T08:47:49.294446+0000","last_active":"2023-10-07T08:47:49.294446+0000","last_peered":"2023-10-07T08:47:49.294446+0000","last_clean":"2023-10-07T08:47:49.294446+0000","last_became_active":"2023-10-07T08:47:49.294035+0000","last_became_peered":"2023-10-07T08:47:49.294035+0000","last_unstale":"2023-10-07T08:47:49.294446+0000","last_undegraded":"2023-10-07T08:47:49.294446+0000","last_fullsized":"2023-10-07T08:47:49.294446+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:09.706320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292464+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:39.530542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294365+0000","last_change":"2023-10-07T08:47:49.294365+0000","last_active":"2023-10-07T08:47:49.294365+0000","last_peered":"2023-10-07T08:47:49.294365+0000","last_clean":"2023-10-07T08:47:49.294365+0000","last_became_active":"2023-10-07T08:47:49.294144+0000","last_became_peered":"2023-10-07T08:47:49.294144+0000","last_unstale":"2023-10-07T08:47:49.294365+0000","last_undegraded":"2023-10-07T08:47:49.294365+0000","last_fullsized":"2023-10-07T08:47:49.294365+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:28.093191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292363+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:38.566525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.300106+0000","last_change":"2023-10-07T08:47:49.300106+0000","last_active":"2023-10-07T08:47:49.300106+0000","last_peered":"2023-10-07T08:47:49.300106+0000","last_clean":"2023-10-07T08:47:49.300106+0000","last_became_active":"2023-10-07T08:47:49.299888+0000","last_became_peered":"2023-10-07T08:47:49.299888+0000","last_unstale":"2023-10-07T08:47:49.300106+0000","last_undegraded":"2023-10-07T08:47:49.300106+0000","last_fullsized":"2023-10-07T08:47:49.300106+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:40:13.073258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294924+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:32:38.753716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298895+0000","last_change":"2023-10-07T08:47:49.298895+0000","last_active":"2023-10-07T08:47:49.298895+0000","last_peered":"2023-10-07T08:47:49.298895+0000","last_clean":"2023-10-07T08:47:49.298895+0000","last_became_active":"2023-10-07T08:47:49.298649+0000","last_became_peered":"2023-10-07T08:47:49.298649+0000","last_unstale":"2023-10-07T08:47:49.298895+0000","last_undegraded":"2023-10-07T08:47:49.298895+0000","last_fullsized":"2023-10-07T08:47:49.298895+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:12:58.312698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292163+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:59:50.950670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298815+0000","last_change":"2023-10-07T08:47:49.298815+0000","last_active":"2023-10-07T08:47:49.298815+0000","last_peered":"2023-10-07T08:47:49.298815+0000","last_clean":"2023-10-07T08:47:49.298815+0000","last_became_active":"2023-10-07T08:47:49.298575+0000","last_became_peered":"2023-10-07T08:47:49.298575+0000","last_unstale":"2023-10-07T08:47:49.298815+0000","last_undegraded":"2023-10-07T08:47:49.298815+0000","last_fullsized":"2023-10-07T08:47:49.298815+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:49.861476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291333+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:03:12.608693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.292849+0000","last_change":"2023-10-07T08:47:49.292849+0000","last_active":"2023-10-07T08:47:49.292849+0000","last_peered":"2023-10-07T08:47:49.292849+0000","last_clean":"2023-10-07T08:47:49.292849+0000","last_became_active":"2023-10-07T08:47:49.292629+0000","last_became_peered":"2023-10-07T08:47:49.292629+0000","last_unstale":"2023-10-07T08:47:49.292849+0000","last_undegraded":"2023-10-07T08:47:49.292849+0000","last_fullsized":"2023-10-07T08:47:49.292849+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:51:18.386745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.288321+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:02:06.577837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298866+0000","last_change":"2023-10-07T08:47:49.298866+0000","last_active":"2023-10-07T08:47:49.298866+0000","last_peered":"2023-10-07T08:47:49.298866+0000","last_clean":"2023-10-07T08:47:49.298866+0000","last_became_active":"2023-10-07T08:47:49.298655+0000","last_became_peered":"2023-10-07T08:47:49.298655+0000","last_unstale":"2023-10-07T08:47:49.298866+0000","last_undegraded":"2023-10-07T08:47:49.298866+0000","last_fullsized":"2023-10-07T08:47:49.298866+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:27:54.845528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293540+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:10.710501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.301545+0000","last_change":"2023-10-07T08:47:49.301545+0000","last_active":"2023-10-07T08:47:49.301545+0000","last_peered":"2023-10-07T08:47:49.301545+0000","last_clean":"2023-10-07T08:47:49.301545+0000","last_became_active":"2023-10-07T08:47:49.301182+0000","last_became_peered":"2023-10-07T08:47:49.301182+0000","last_unstale":"2023-10-07T08:47:49.301545+0000","last_undegraded":"2023-10-07T08:47:49.301545+0000","last_fullsized":"2023-10-07T08:47:49.301545+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:42:55.869359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.288968+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:13.888664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.303488+0000","last_change":"2023-10-07T08:47:49.303488+0000","last_active":"2023-10-07T08:47:49.303488+0000","last_peered":"2023-10-07T08:47:49.303488+0000","last_clean":"2023-10-07T08:47:49.303488+0000","last_became_active":"2023-10-07T08:47:49.301866+0000","last_became_peered":"2023-10-07T08:47:49.301866+0000","last_unstale":"2023-10-07T08:47:49.303488+0000","last_undegraded":"2023-10-07T08:47:49.303488+0000","last_fullsized":"2023-10-07T08:47:49.303488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:11.700899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294780+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:07.294592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.300831+0000","last_change":"2023-10-07T08:47:49.300831+0000","last_active":"2023-10-07T08:47:49.300831+0000","last_peered":"2023-10-07T08:47:49.300831+0000","last_clean":"2023-10-07T08:47:49.300831+0000","last_became_active":"2023-10-07T08:47:49.300172+0000","last_became_peered":"2023-10-07T08:47:49.300172+0000","last_unstale":"2023-10-07T08:47:49.300831+0000","last_undegraded":"2023-10-07T08:47:49.300831+0000","last_fullsized":"2023-10-07T08:47:49.300831+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:02.115023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.289911+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:59:50.950670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.297586+0000","last_change":"2023-10-07T08:47:49.297586+0000","last_active":"2023-10-07T08:47:49.297586+0000","last_peered":"2023-10-07T08:47:49.297586+0000","last_clean":"2023-10-07T08:47:49.297586+0000","last_became_active":"2023-10-07T08:47:49.297059+0000","last_became_peered":"2023-10-07T08:47:49.297059+0000","last_unstale":"2023-10-07T08:47:49.297586+0000","last_undegraded":"2023-10-07T08:47:49.297586+0000","last_fullsized":"2023-10-07T08:47:49.297586+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:28:18.348796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291740+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:45.158815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.290323+0000","last_change":"2023-10-07T08:47:49.290323+0000","last_active":"2023-10-07T08:47:49.290323+0000","last_peered":"2023-10-07T08:47:49.290323+0000","last_clean":"2023-10-07T08:47:49.290323+0000","last_became_active":"2023-10-07T08:47:49.290095+0000","last_became_peered":"2023-10-07T08:47:49.290095+0000","last_unstale":"2023-10-07T08:47:49.290323+0000","last_undegraded":"2023-10-07T08:47:49.290323+0000","last_fullsized":"2023-10-07T08:47:49.290323+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:20:32.974542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291972+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:48.210053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298146+0000","last_change":"2023-10-07T08:47:49.298146+0000","last_active":"2023-10-07T08:47:49.298146+0000","last_peered":"2023-10-07T08:47:49.298146+0000","last_clean":"2023-10-07T08:47:49.298146+0000","last_became_active":"2023-10-07T08:47:49.297916+0000","last_became_peered":"2023-10-07T08:47:49.297916+0000","last_unstale":"2023-10-07T08:47:49.298146+0000","last_undegraded":"2023-10-07T08:47:49.298146+0000","last_fullsized":"2023-10-07T08:47:49.298146+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:02:34.686983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293310+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:12:59.316878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.291174+0000","last_change":"2023-10-07T08:47:49.291174+0000","last_active":"2023-10-07T08:47:49.291174+0000","last_peered":"2023-10-07T08:47:49.291174+0000","last_clean":"2023-10-07T08:47:49.291174+0000","last_became_active":"2023-10-07T08:47:49.290936+0000","last_became_peered":"2023-10-07T08:47:49.290936+0000","last_unstale":"2023-10-07T08:47:49.291174+0000","last_undegraded":"2023-10-07T08:47:49.291174+0000","last_fullsized":"2023-10-07T08:47:49.291174+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:08:58.201915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291326+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:50.865656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.302213+0000","last_change":"2023-10-07T08:47:49.302213+0000","last_active":"2023-10-07T08:47:49.302213+0000","last_peered":"2023-10-07T08:47:49.302213+0000","last_clean":"2023-10-07T08:47:49.302213+0000","last_became_active":"2023-10-07T08:47:49.301699+0000","last_became_peered":"2023-10-07T08:47:49.301699+0000","last_unstale":"2023-10-07T08:47:49.302213+0000","last_undegraded":"2023-10-07T08:47:49.302213+0000","last_fullsized":"2023-10-07T08:47:49.302213+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:47.205873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295480+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:02:29.075314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294295+0000","last_change":"2023-10-07T08:47:49.294295+0000","last_active":"2023-10-07T08:47:49.294295+0000","last_peered":"2023-10-07T08:47:49.294295+0000","last_clean":"2023-10-07T08:47:49.294295+0000","last_became_active":"2023-10-07T08:47:49.293705+0000","last_became_peered":"2023-10-07T08:47:49.293705+0000","last_unstale":"2023-10-07T08:47:49.294295+0000","last_undegraded":"2023-10-07T08:47:49.294295+0000","last_fullsized":"2023-10-07T08:47:49.294295+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:32.044267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294315+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:15:58.515103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.296520+0000","last_change":"2023-10-07T08:47:49.296520+0000","last_active":"2023-10-07T08:47:49.296520+0000","last_peered":"2023-10-07T08:47:49.296520+0000","last_clean":"2023-10-07T08:47:49.296520+0000","last_became_active":"2023-10-07T08:47:49.296297+0000","last_became_peered":"2023-10-07T08:47:49.296297+0000","last_unstale":"2023-10-07T08:47:49.296520+0000","last_undegraded":"2023-10-07T08:47:49.296520+0000","last_fullsized":"2023-10-07T08:47:49.296520+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:02:34.686983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294547+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:49:32.774690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.293143+0000","last_change":"2023-10-07T08:47:49.293143+0000","last_active":"2023-10-07T08:47:49.293143+0000","last_peered":"2023-10-07T08:47:49.293143+0000","last_clean":"2023-10-07T08:47:49.293143+0000","last_became_active":"2023-10-07T08:47:49.292921+0000","last_became_peered":"2023-10-07T08:47:49.292921+0000","last_unstale":"2023-10-07T08:47:49.293143+0000","last_undegraded":"2023-10-07T08:47:49.293143+0000","last_fullsized":"2023-10-07T08:47:49.293143+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:38.526362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294359+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:45.158815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.293954+0000","last_change":"2023-10-07T08:47:49.293954+0000","last_active":"2023-10-07T08:47:49.293954+0000","last_peered":"2023-10-07T08:47:49.293954+0000","last_clean":"2023-10-07T08:47:49.293954+0000","last_became_active":"2023-10-07T08:47:49.293733+0000","last_became_peered":"2023-10-07T08:47:49.293733+0000","last_unstale":"2023-10-07T08:47:49.293954+0000","last_undegraded":"2023-10-07T08:47:49.293954+0000","last_fullsized":"2023-10-07T08:47:49.293954+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.117157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294528+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:58:40.091484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.301153+0000","last_change":"2023-10-07T08:47:49.301153+0000","last_active":"2023-10-07T08:47:49.301153+0000","last_peered":"2023-10-07T08:47:49.301153+0000","last_clean":"2023-10-07T08:47:49.301153+0000","last_became_active":"2023-10-07T08:47:49.300932+0000","last_became_peered":"2023-10-07T08:47:49.300932+0000","last_unstale":"2023-10-07T08:47:49.301153+0000","last_undegraded":"2023-10-07T08:47:49.301153+0000","last_fullsized":"2023-10-07T08:47:49.301153+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:28:51.667344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295015+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:49.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.295423+0000","last_change":"2023-10-07T08:47:49.295423+0000","last_active":"2023-10-07T08:47:49.295423+0000","last_peered":"2023-10-07T08:47:49.295423+0000","last_clean":"2023-10-07T08:47:49.295423+0000","last_became_active":"2023-10-07T08:47:49.295149+0000","last_became_peered":"2023-10-07T08:47:49.295149+0000","last_unstale":"2023-10-07T08:47:49.295423+0000","last_undegraded":"2023-10-07T08:47:49.295423+0000","last_fullsized":"2023-10-07T08:47:49.295423+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:42.874808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294351+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:39:57.537377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294640+0000","last_change":"2023-10-07T08:47:49.294640+0000","last_active":"2023-10-07T08:47:49.294640+0000","last_peered":"2023-10-07T08:47:49.294640+0000","last_clean":"2023-10-07T08:47:49.294640+0000","last_became_active":"2023-10-07T08:47:49.294244+0000","last_became_peered":"2023-10-07T08:47:49.294244+0000","last_unstale":"2023-10-07T08:47:49.294640+0000","last_undegraded":"2023-10-07T08:47:49.294640+0000","last_fullsized":"2023-10-07T08:47:49.294640+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:39:10.789555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291042+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:10.710501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.296619+0000","last_change":"2023-10-07T08:47:49.296619+0000","last_active":"2023-10-07T08:47:49.296619+0000","last_peered":"2023-10-07T08:47:49.296619+0000","last_clean":"2023-10-07T08:47:49.296619+0000","last_became_active":"2023-10-07T08:47:49.296120+0000","last_became_peered":"2023-10-07T08:47:49.296120+0000","last_unstale":"2023-10-07T08:47:49.296619+0000","last_undegraded":"2023-10-07T08:47:49.296619+0000","last_fullsized":"2023-10-07T08:47:49.296619+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:42:22.643545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293363+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:11.981069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298676+0000","last_change":"2023-10-07T08:47:49.298676+0000","last_active":"2023-10-07T08:47:49.298676+0000","last_peered":"2023-10-07T08:47:49.298676+0000","last_clean":"2023-10-07T08:47:49.298676+0000","last_became_active":"2023-10-07T08:47:49.298453+0000","last_became_peered":"2023-10-07T08:47:49.298453+0000","last_unstale":"2023-10-07T08:47:49.298676+0000","last_undegraded":"2023-10-07T08:47:49.298676+0000","last_fullsized":"2023-10-07T08:47:49.298676+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:37.562344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293950+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:16:39.403571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294015+0000","last_change":"2023-10-07T08:47:49.294015+0000","last_active":"2023-10-07T08:47:49.294015+0000","last_peered":"2023-10-07T08:47:49.294015+0000","last_clean":"2023-10-07T08:47:49.294015+0000","last_became_active":"2023-10-07T08:47:49.292830+0000","last_became_peered":"2023-10-07T08:47:49.292830+0000","last_unstale":"2023-10-07T08:47:49.294015+0000","last_undegraded":"2023-10-07T08:47:49.294015+0000","last_fullsized":"2023-10-07T08:47:49.294015+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:51.456204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295099+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:59:50.950670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.297510+0000","last_change":"2023-10-07T08:47:49.297510+0000","last_active":"2023-10-07T08:47:49.297510+0000","last_peered":"2023-10-07T08:47:49.297510+0000","last_clean":"2023-10-07T08:47:49.297510+0000","last_became_active":"2023-10-07T08:47:49.297276+0000","last_became_peered":"2023-10-07T08:47:49.297276+0000","last_unstale":"2023-10-07T08:47:49.297510+0000","last_undegraded":"2023-10-07T08:47:49.297510+0000","last_fullsized":"2023-10-07T08:47:49.297510+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:02.115023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.289502+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:49.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.299182+0000","last_change":"2023-10-07T08:47:49.299182+0000","last_active":"2023-10-07T08:47:49.299182+0000","last_peered":"2023-10-07T08:47:49.299182+0000","last_clean":"2023-10-07T08:47:49.299182+0000","last_became_active":"2023-10-07T08:47:49.298742+0000","last_became_peered":"2023-10-07T08:47:49.298742+0000","last_unstale":"2023-10-07T08:47:49.299182+0000","last_undegraded":"2023-10-07T08:47:49.299182+0000","last_fullsized":"2023-10-07T08:47:49.299182+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:10.976889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291037+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:08:59.206095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.303627+0000","last_change":"2023-10-07T08:47:49.303627+0000","last_active":"2023-10-07T08:47:49.303627+0000","last_peered":"2023-10-07T08:47:49.303627+0000","last_clean":"2023-10-07T08:47:49.303627+0000","last_became_active":"2023-10-07T08:47:49.302365+0000","last_became_peered":"2023-10-07T08:47:49.302365+0000","last_unstale":"2023-10-07T08:47:49.303627+0000","last_undegraded":"2023-10-07T08:47:49.303627+0000","last_fullsized":"2023-10-07T08:47:49.303627+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:02:54.069896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296034+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:16:39.403571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.304623+0000","last_change":"2023-10-07T08:47:49.304623+0000","last_active":"2023-10-07T08:47:49.304623+0000","last_peered":"2023-10-07T08:47:49.304623+0000","last_clean":"2023-10-07T08:47:49.304623+0000","last_became_active":"2023-10-07T08:47:49.304380+0000","last_became_peered":"2023-10-07T08:47:49.304380+0000","last_unstale":"2023-10-07T08:47:49.304623+0000","last_undegraded":"2023-10-07T08:47:49.304623+0000","last_fullsized":"2023-10-07T08:47:49.304623+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:09:37.124003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292959+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:12.705080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.295864+0000","last_change":"2023-10-07T08:47:49.295864+0000","last_active":"2023-10-07T08:47:49.295864+0000","last_peered":"2023-10-07T08:47:49.295864+0000","last_clean":"2023-10-07T08:47:49.295864+0000","last_became_active":"2023-10-07T08:47:49.293237+0000","last_became_peered":"2023-10-07T08:47:49.293237+0000","last_unstale":"2023-10-07T08:47:49.295864+0000","last_undegraded":"2023-10-07T08:47:49.295864+0000","last_fullsized":"2023-10-07T08:47:49.295864+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:02.115023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":229,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-07T08:47:48.286028+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:47:48.286028+0000","last_peered":"2023-10-07T08:47:48.286028+0000","last_clean":"2023-10-07T08:47:48.286028+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:47:48.286028+0000","last_undegraded":"2023-10-07T08:47:48.286028+0000","last_fullsized":"2023-10-07T08:47:48.286028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1099,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194213,"statfs":{"total":200000000,"available":198874402,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.497},"min":{"1min":0.34999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68000000000000005,"5min":0.751,"15min":0.751},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.501,"15min":0.48299999999999998},"min":{"1min":0.371,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66500000000000004,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.66300000000000003}]},{"osd":1,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.51600000000000001},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76300000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.81999999999999995}]},{"osd":2,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.33400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.48699999999999999},"min":{"1min":0.36699999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.69699999999999995,"15min":0.82899999999999996},"min":{"1min":0.38400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.73299999999999998,"5min":6.8570000000000002,"15min":6.8570000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.45100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72699999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.749}]},{"osd":4,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.75900000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.27800000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.747,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54200000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.498,"15min":0.50900000000000001},"min":{"1min":0.30199999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.499},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80800000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.47699999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58099999999999996,"15min":0.59599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78200000000000003,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47999999999999998,"15min":0.46800000000000003},"min":{"1min":0.33300000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73999999999999999,"5min":0.745,"15min":0.745},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.48799999999999999,"15min":0.48599999999999999},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.56699999999999995}]},{"osd":1,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54000000000000004,"15min":0.52700000000000002},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.41499999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.70699999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.502,"15min":0.47399999999999998},"min":{"1min":0.375,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.621},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51500000000000001,"15min":0.51300000000000001},"min":{"1min":0.41999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66000000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.53100000000000003},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.80300000000000005,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.32100000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67200000000000004,"5min":0.748,"15min":0.748},"last":0.44800000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.52200000000000002},"min":{"1min":0.37,"5min":0.312,"15min":0.312},"max":{"1min":0.71599999999999997,"5min":0.754,"15min":0.754},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":1.052,"15min":1.052},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34599999999999997,"15min":0.312},"min":{"1min":0.22500000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.56699999999999995,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.25},{"interface":"front","average":{"1min":0.371,"5min":0.35499999999999998,"15min":0.32800000000000001},"min":{"1min":0.22500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.29799999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.318},"min":{"1min":0.26200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70399999999999996,"5min":1.639,"15min":1.639},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.38800000000000001,"15min":0.33200000000000002},"min":{"1min":0.28699999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.47399999999999998,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.28699999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40000000000000002,"15min":0.35899999999999999},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.52800000000000002,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.317},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.34799999999999998},"min":{"1min":0.28599999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.52200000000000002},"min":{"1min":0.35699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79100000000000004,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.52800000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.52600000000000002},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73099999999999998,"5min":0.87,"15min":0.87},"last":0.71999999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.58199999999999996},"min":{"1min":0.51800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79100000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.68400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1093,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194219,"statfs":{"total":200000000,"available":198880665,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.371},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.377,"15min":0.39500000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.67400000000000004,"5min":1.079,"15min":1.079},"last":0.26400000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.39100000000000001},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":1.464,"15min":1.464},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.40200000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67900000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.35299999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":1.341,"15min":1.341},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.42099999999999999,"15min":0.435},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68600000000000005,"5min":1.532,"15min":1.532},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90200000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.60999999999999999},"min":{"1min":0.36199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80100000000000005,"5min":1.51,"15min":1.51},"last":0.71499999999999997}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83299999999999996,"5min":1.25,"15min":1.25},"last":0.82299999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.92900000000000005,"5min":1.488,"15min":1.488},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":1.024,"15min":1.024},"last":0.69999999999999996}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.90300000000000002,"5min":1.288,"15min":1.288},"last":0.78400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.33400000000000002,"15min":0.34399999999999997},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.44700000000000001,"5min":1.665,"15min":1.665},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.36199999999999999},"min":{"1min":0.248,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47399999999999998,"5min":1.579,"15min":1.579},"last":0.32000000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36299999999999999,"15min":0.374},"min":{"1min":0.23699999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.52400000000000002,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.218},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.28799999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53600000000000003,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.26600000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38400000000000001,"15min":0.39000000000000001},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":1.454,"15min":1.454},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38,"15min":0.38900000000000001},"min":{"1min":0.26100000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.30199999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.75700000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.59899999999999998,"15min":0.59399999999999997},"min":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77400000000000002,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.747,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.40600000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.79700000000000004,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.36799999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72299999999999998,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.47899999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.80200000000000005,"5min":1.637,"15min":1.637},"last":0.503}]},{"osd":7,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41099999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.72899999999999998,"5min":1.49,"15min":1.49},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78600000000000003,"5min":1.375,"15min":1.375},"last":0.60199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":516,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194795,"statfs":{"total":200000000,"available":199471033,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34300000000000003,"15min":0.32700000000000001},"min":{"1min":0.22800000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.48099999999999998,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.254},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34100000000000003,"15min":0.31900000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.43099999999999999,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.376,"15min":0.35799999999999998},"min":{"1min":0.27100000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46000000000000002,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41499999999999998,"15min":0.39700000000000002},"min":{"1min":0.27400000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51400000000000001,"5min":1.885,"15min":1.885},"last":0.372}]},{"osd":2,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55000000000000004,"5min":1.274,"15min":1.274},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41299999999999998,"15min":0.39900000000000002},"min":{"1min":0.309,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.33400000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.498},"min":{"1min":0.377,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72599999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56200000000000006,"15min":0.53100000000000003},"min":{"1min":0.438,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74299999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.497},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.45400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.72099999999999997,"5min":1.851,"15min":1.851},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.55500000000000005},"min":{"1min":0.45200000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80100000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.60999999999999999,"15min":0.58399999999999996},"min":{"1min":0.47099999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.81399999999999995,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.48099999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71299999999999997,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.55200000000000005},"min":{"1min":0.439,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.504,"15min":0.48599999999999999},"min":{"1min":0.308,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69199999999999995,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52700000000000002,"15min":0.505},"min":{"1min":0.38800000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.69399999999999995,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.48899999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.497},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.70899999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.495},"min":{"1min":0.40799999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.64100000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.54300000000000004}]},{"osd":2,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53200000000000003,"15min":0.50600000000000001},"min":{"1min":0.33400000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73699999999999999,"5min":1.29,"15min":1.29},"last":0.63300000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70499999999999996,"5min":2.052,"15min":2.052},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":1.369,"15min":1.369},"last":0.70599999999999996}]},{"osd":5,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61299999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.36199999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71199999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.316,"15min":0.316},"max":{"1min":0.64000000000000001,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.745},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.67300000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.68899999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.316,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67700000000000005,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69299999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.79300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52300000000000002,"15min":0.51300000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51500000000000001,"15min":0.50700000000000001},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73899999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.55100000000000005}]},{"osd":1,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.498,"15min":0.48399999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.72299999999999998,"5min":0.748,"15min":0.748},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70099999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.56899999999999995}]},{"osd":2,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53000000000000003,"15min":0.52400000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73499999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.309,"15min":0.309},"max":{"1min":0.68100000000000005,"5min":0.754,"15min":0.754},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67700000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77600000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.72399999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.34300000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.627,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.59899999999999998},"min":{"1min":0.42599999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67300000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.754}]},{"osd":6,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52500000000000002,"15min":0.54600000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.73599999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.81599999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.40600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68899999999999995,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57099999999999995,"15min":0.59999999999999998},"min":{"1min":0.35699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72399999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64400000000000002}]}]}],"pool_statfs":[]}} 2023-10-07T08:47:54.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:47:54.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.535+0000 7fd0bc9a0700 1 Processor -- start 2023-10-07T08:47:54.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.535+0000 7fd0bc9a0700 1 -- start start 2023-10-07T08:47:54.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.535+0000 7fd0bc9a0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b80add30 0x7fd0b80b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.535+0000 7fd0bc9a0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd0b8067640 0x7fd0b8067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.535+0000 7fd0bc9a0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b8067ff0 con 0x7fd0b80ce890 2023-10-07T08:47:54.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.535+0000 7fd0bc9a0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b80b37b0 con 0x7fd0b8067640 2023-10-07T08:47:54.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.535+0000 7fd0bc9a0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80b17c0 con 0x7fd0b80add30 2023-10-07T08:47:54.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b7fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd0b80ce890 0x7fd0b80cc0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53692/0 (socket says 172.21.15.81:53692) 2023-10-07T08:47:54.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b7fff700 1 -- 172.21.15.81:0/3386258833 learned_addr learned my addr 172.21.15.81:0/3386258833 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:54.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b67fc700 1 -- 172.21.15.81:0/3386258833 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936574116 0 0) 0x7fd0b8067ff0 con 0x7fd0b80ce890 2023-10-07T08:47:54.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b67fc700 1 -- 172.21.15.81:0/3386258833 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0a0003570 con 0x7fd0b80ce890 2023-10-07T08:47:54.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b6ffd700 1 --2- 172.21.15.81:0/3386258833 >> v2:172.21.15.89:3300/0 conn(0x7fd0b8067640 0x7fd0b8067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b77fe700 1 --2- 172.21.15.81:0/3386258833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b80add30 0x7fd0b80b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b67fc700 1 -- 172.21.15.81:0/3386258833 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2161928629 0 0) 0x7fd0a0003570 con 0x7fd0b80ce890 2023-10-07T08:47:54.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b67fc700 1 -- 172.21.15.81:0/3386258833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b80add30 msgr2=0x7fd0b80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:54.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b67fc700 1 --2- 172.21.15.81:0/3386258833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b80add30 0x7fd0b80b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b67fc700 1 -- 172.21.15.81:0/3386258833 >> v2:172.21.15.89:3300/0 conn(0x7fd0b8067640 msgr2=0x7fd0b8067ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:54.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b67fc700 1 --2- 172.21.15.81:0/3386258833 >> v2:172.21.15.89:3300/0 conn(0x7fd0b8067640 0x7fd0b8067ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b67fc700 1 -- 172.21.15.81:0/3386258833 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b80b1d80 con 0x7fd0b80ce890 2023-10-07T08:47:54.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b67fc700 1 -- 172.21.15.81:0/3386258833 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fd0a8001470 con 0x7fd0b80ce890 2023-10-07T08:47:54.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b67fc700 1 -- 172.21.15.81:0/3386258833 >> v1:172.21.15.81:6789/0 conn(0x7fd0b80ce890 legacy=0x7fd0b80cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b67fc700 1 --2- 172.21.15.81:0/3386258833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a0003a60 0x7fd0a0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b67fc700 1 --2- 172.21.15.81:0/3386258833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b80add30 0x7fd0a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b67fc700 1 --2- 172.21.15.81:0/3386258833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a0004d50 0x7fd0a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b67fc700 1 -- 172.21.15.81:0/3386258833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80b17c0 con 0x7fd0a0004d50 2023-10-07T08:47:54.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b67fc700 1 -- 172.21.15.81:0/3386258833 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a000ba60 con 0x7fd0a0003a60 2023-10-07T08:47:54.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b67fc700 1 -- 172.21.15.81:0/3386258833 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a000bba0 con 0x7fd0b80add30 2023-10-07T08:47:54.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b7fff700 1 --2- 172.21.15.81:0/3386258833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a0004d50 0x7fd0a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b77fe700 1 --2- 172.21.15.81:0/3386258833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a0003a60 0x7fd0a0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.536+0000 7fd0b6ffd700 1 --2- 172.21.15.81:0/3386258833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b80add30 0x7fd0a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.537+0000 7fd0b7fff700 1 -- 172.21.15.81:0/3386258833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b80add30 msgr2=0x7fd0a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:54.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.537+0000 7fd0b7fff700 1 --2- 172.21.15.81:0/3386258833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b80add30 0x7fd0a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.537+0000 7fd0b7fff700 1 -- 172.21.15.81:0/3386258833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a0003a60 msgr2=0x7fd0a0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:54.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.537+0000 7fd0b7fff700 1 --2- 172.21.15.81:0/3386258833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a0003a60 0x7fd0a0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.537+0000 7fd0b7fff700 1 -- 172.21.15.81:0/3386258833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a0003570 con 0x7fd0a0004d50 2023-10-07T08:47:54.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.537+0000 7fd0b7fff700 1 --2- 172.21.15.81:0/3386258833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a0004d50 0x7fd0a00051c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800c3c0 tx=0x7fd0b80b1cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317626b3c1f60211 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:54.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.537+0000 7fd0b67fc700 1 -- 172.21.15.81:0/3386258833 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a800cc30 con 0x7fd0a0004d50 2023-10-07T08:47:54.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.537+0000 7fd0b67fc700 1 -- 172.21.15.81:0/3386258833 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a800cd90 con 0x7fd0a0004d50 2023-10-07T08:47:54.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.537+0000 7fd0b67fc700 1 -- 172.21.15.81:0/3386258833 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8005b70 con 0x7fd0a0004d50 2023-10-07T08:47:54.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.537+0000 7fd0bc9a0700 1 -- 172.21.15.81:0/3386258833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a0004d50 msgr2=0x7fd0a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.537+0000 7fd0bc9a0700 1 --2- 172.21.15.81:0/3386258833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a0004d50 0x7fd0a00051c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800c3c0 tx=0x7fd0b80b1cf0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.537+0000 7fd0b7fff700 1 -- 172.21.15.81:0/3386258833 reap_dead start 2023-10-07T08:47:54.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.537+0000 7fd0bc9a0700 1 -- 172.21.15.81:0/3386258833 shutdown_connections 2023-10-07T08:47:54.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.537+0000 7fd0bc9a0700 1 -- 172.21.15.81:0/3386258833 >> 172.21.15.81:0/3386258833 conn(0x7fd0b806c620 msgr2=0x7fd0b806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:54.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.537+0000 7fd0bc9a0700 1 -- 172.21.15.81:0/3386258833 shutdown_connections 2023-10-07T08:47:54.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.537+0000 7fd0bc9a0700 1 -- 172.21.15.81:0/3386258833 wait complete. 2023-10-07T08:47:54.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.539+0000 7fd0bc9a0700 1 Processor -- start 2023-10-07T08:47:54.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.539+0000 7fd0bc9a0700 1 -- start start 2023-10-07T08:47:54.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.539+0000 7fd0bc9a0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b8155590 0x7fd0b80ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.539+0000 7fd0bc9a0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b8155960 0x7fd0b816bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.539+0000 7fd0bc9a0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b80cd070 0x7fd0b80cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.539+0000 7fd0bc9a0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80ac940 con 0x7fd0b80cd070 2023-10-07T08:47:54.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.539+0000 7fd0bc9a0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80cda20 con 0x7fd0b8155960 2023-10-07T08:47:54.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.539+0000 7fd0bc9a0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80ac4b0 con 0x7fd0b8155590 2023-10-07T08:47:54.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.539+0000 7fd0b7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b80cd070 0x7fd0b80cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.540+0000 7fd0b7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b80cd070 0x7fd0b80cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43052/0 (socket says 172.21.15.81:43052) 2023-10-07T08:47:54.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.540+0000 7fd0b7fff700 1 -- 172.21.15.81:0/452394030 learned_addr learned my addr 172.21.15.81:0/452394030 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:54.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.540+0000 7fd0b6ffd700 1 --2- 172.21.15.81:0/452394030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b8155960 0x7fd0b816bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.540+0000 7fd0b77fe700 1 --2- 172.21.15.81:0/452394030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b8155590 0x7fd0b80ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.540+0000 7fd0b7fff700 1 -- 172.21.15.81:0/452394030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b8155590 msgr2=0x7fd0b80ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.540+0000 7fd0b7fff700 1 --2- 172.21.15.81:0/452394030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b8155590 0x7fd0b80ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.540+0000 7fd0b7fff700 1 -- 172.21.15.81:0/452394030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b8155960 msgr2=0x7fd0b816bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.540+0000 7fd0b7fff700 1 --2- 172.21.15.81:0/452394030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b8155960 0x7fd0b816bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.540+0000 7fd0b7fff700 1 -- 172.21.15.81:0/452394030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b816c230 con 0x7fd0b80cd070 2023-10-07T08:47:54.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.540+0000 7fd0b77fe700 1 --2- 172.21.15.81:0/452394030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b8155590 0x7fd0b80ab1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:47:54.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.540+0000 7fd0b7fff700 1 --2- 172.21.15.81:0/452394030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b80cd070 0x7fd0b80cd4e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009020 tx=0x7fd0a8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:54.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.540+0000 7fd09f7fe700 1 -- 172.21.15.81:0/452394030 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a800cc30 con 0x7fd0b80cd070 2023-10-07T08:47:54.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.540+0000 7fd09f7fe700 1 -- 172.21.15.81:0/452394030 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a800c9e0 con 0x7fd0b80cd070 2023-10-07T08:47:54.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.540+0000 7fd0bc9a0700 1 -- 172.21.15.81:0/452394030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b80ab8a0 con 0x7fd0b80cd070 2023-10-07T08:47:54.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.540+0000 7fd09f7fe700 1 -- 172.21.15.81:0/452394030 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8007550 con 0x7fd0b80cd070 2023-10-07T08:47:54.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.540+0000 7fd0bc9a0700 1 -- 172.21.15.81:0/452394030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b80abe60 con 0x7fd0b80cd070 2023-10-07T08:47:54.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.541+0000 7fd0bc9a0700 1 -- 172.21.15.81:0/452394030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b80ac640 con 0x7fd0b80cd070 2023-10-07T08:47:54.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.541+0000 7fd09f7fe700 1 -- 172.21.15.81:0/452394030 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd0a8027450 con 0x7fd0b80cd070 2023-10-07T08:47:54.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.542+0000 7fd09f7fe700 1 --2- 172.21.15.81:0/452394030 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd0a4066f30 0x7fd0a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.542+0000 7fd09f7fe700 1 -- 172.21.15.81:0/452394030 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd0a8084ea0 con 0x7fd0b80cd070 2023-10-07T08:47:54.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.542+0000 7fd0b77fe700 1 --2- 172.21.15.81:0/452394030 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd0a4066f30 0x7fd0a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.542+0000 7fd0b77fe700 1 --2- 172.21.15.81:0/452394030 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd0a4066f30 0x7fd0a40693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009fd0 tx=0x7fd0b000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:54.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.546+0000 7fd09f7fe700 1 -- 172.21.15.81:0/452394030 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0a8052210 con 0x7fd0b80cd070 2023-10-07T08:47:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.722+0000 7fd0bc9a0700 1 -- 172.21.15.81:0/452394030 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd0b8068220 con 0x7fd0a4066f30 2023-10-07T08:47:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.730+0000 7fd09f7fe700 1 -- 172.21.15.81:0/452394030 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282003 (secure 0 0 0) 0x7fd0b8068220 con 0x7fd0a4066f30 2023-10-07T08:47:54.733 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.732+0000 7fd0bc9a0700 1 -- 172.21.15.81:0/452394030 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd0a4066f30 msgr2=0x7fd0a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.733+0000 7fd0bc9a0700 1 --2- 172.21.15.81:0/452394030 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd0a4066f30 0x7fd0a40693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009fd0 tx=0x7fd0b000b040 comp rx=0 tx=0).stop 2023-10-07T08:47:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.733+0000 7fd0bc9a0700 1 -- 172.21.15.81:0/452394030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b80cd070 msgr2=0x7fd0b80cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.733+0000 7fd0bc9a0700 1 --2- 172.21.15.81:0/452394030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b80cd070 0x7fd0b80cd4e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009020 tx=0x7fd0a8015000 comp rx=0 tx=0).stop 2023-10-07T08:47:54.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.733+0000 7fd0bc9a0700 1 -- 172.21.15.81:0/452394030 shutdown_connections 2023-10-07T08:47:54.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.733+0000 7fd0bc9a0700 1 --2- 172.21.15.81:0/452394030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b80cd070 0x7fd0b80cd4e0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.733+0000 7fd0bc9a0700 1 --2- 172.21.15.81:0/452394030 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd0a4066f30 0x7fd0a40693e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.733+0000 7fd0bc9a0700 1 --2- 172.21.15.81:0/452394030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b8155590 0x7fd0b80ab1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.733+0000 7fd0bc9a0700 1 --2- 172.21.15.81:0/452394030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b8155960 0x7fd0b816bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.733+0000 7fd0bc9a0700 1 -- 172.21.15.81:0/452394030 >> 172.21.15.81:0/452394030 conn(0x7fd0b806c620 msgr2=0x7fd0b8157460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.733+0000 7fd0bc9a0700 1 -- 172.21.15.81:0/452394030 shutdown_connections 2023-10-07T08:47:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.733+0000 7fd0bc9a0700 1 -- 172.21.15.81:0/452394030 wait complete. 2023-10-07T08:47:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:47:54.745 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2023-10-07T08:47:54.069795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5322,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557177,"statfs":{"total":1600000000,"available":1594549950,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.787274"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.298194+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:15:58.515103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294002+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:48.119099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295070+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:40.234974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.297055+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:51.378610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295698+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:33.048447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293944+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:50.865656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295473+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:40:53.993327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295349+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:13.888664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296696+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:39.530542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293813+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:09:38.128184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292065+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:02:55.074077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293443+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:48.119099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292126+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:49.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296717+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:44:28.093547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.288364+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:48:32.815580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295701+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:06.585857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296786+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:03.119203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.298134+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:25:17.744264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.290131+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:48:20.456130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295473+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:49:06.137613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295824+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:56:10.032555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293650+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:11.981069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.300037+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:06.585857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296104+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:38:48.558191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292351+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:51:39.019296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292929+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:43.878989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296423+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:29.097371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.299702+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:40.971774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291376+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:23:35.234961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291698+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:52.460384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294717+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:13:54.005176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293062+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:12:59.316878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295145+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:40.971774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.303788+0000","last_change":"2023-10-07T08:47:49.303788+0000","last_active":"2023-10-07T08:47:49.303788+0000","last_peered":"2023-10-07T08:47:49.303788+0000","last_clean":"2023-10-07T08:47:49.303788+0000","last_became_active":"2023-10-07T08:47:49.302673+0000","last_became_peered":"2023-10-07T08:47:49.302673+0000","last_unstale":"2023-10-07T08:47:49.303788+0000","last_undegraded":"2023-10-07T08:47:49.303788+0000","last_fullsized":"2023-10-07T08:47:49.303788+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:51:38.015116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.299328+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:13:54.005176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298088+0000","last_change":"2023-10-07T08:47:49.298088+0000","last_active":"2023-10-07T08:47:49.298088+0000","last_peered":"2023-10-07T08:47:49.298088+0000","last_clean":"2023-10-07T08:47:49.298088+0000","last_became_active":"2023-10-07T08:47:49.297854+0000","last_became_peered":"2023-10-07T08:47:49.297854+0000","last_unstale":"2023-10-07T08:47:49.298088+0000","last_undegraded":"2023-10-07T08:47:49.298088+0000","last_fullsized":"2023-10-07T08:47:49.298088+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:47.114919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293821+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:40:14.077438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294446+0000","last_change":"2023-10-07T08:47:49.294446+0000","last_active":"2023-10-07T08:47:49.294446+0000","last_peered":"2023-10-07T08:47:49.294446+0000","last_clean":"2023-10-07T08:47:49.294446+0000","last_became_active":"2023-10-07T08:47:49.294035+0000","last_became_peered":"2023-10-07T08:47:49.294035+0000","last_unstale":"2023-10-07T08:47:49.294446+0000","last_undegraded":"2023-10-07T08:47:49.294446+0000","last_fullsized":"2023-10-07T08:47:49.294446+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:09.706320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292464+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:39.530542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294365+0000","last_change":"2023-10-07T08:47:49.294365+0000","last_active":"2023-10-07T08:47:49.294365+0000","last_peered":"2023-10-07T08:47:49.294365+0000","last_clean":"2023-10-07T08:47:49.294365+0000","last_became_active":"2023-10-07T08:47:49.294144+0000","last_became_peered":"2023-10-07T08:47:49.294144+0000","last_unstale":"2023-10-07T08:47:49.294365+0000","last_undegraded":"2023-10-07T08:47:49.294365+0000","last_fullsized":"2023-10-07T08:47:49.294365+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:28.093191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292363+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:38.566525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.300106+0000","last_change":"2023-10-07T08:47:49.300106+0000","last_active":"2023-10-07T08:47:49.300106+0000","last_peered":"2023-10-07T08:47:49.300106+0000","last_clean":"2023-10-07T08:47:49.300106+0000","last_became_active":"2023-10-07T08:47:49.299888+0000","last_became_peered":"2023-10-07T08:47:49.299888+0000","last_unstale":"2023-10-07T08:47:49.300106+0000","last_undegraded":"2023-10-07T08:47:49.300106+0000","last_fullsized":"2023-10-07T08:47:49.300106+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:40:13.073258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294924+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:32:38.753716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298895+0000","last_change":"2023-10-07T08:47:49.298895+0000","last_active":"2023-10-07T08:47:49.298895+0000","last_peered":"2023-10-07T08:47:49.298895+0000","last_clean":"2023-10-07T08:47:49.298895+0000","last_became_active":"2023-10-07T08:47:49.298649+0000","last_became_peered":"2023-10-07T08:47:49.298649+0000","last_unstale":"2023-10-07T08:47:49.298895+0000","last_undegraded":"2023-10-07T08:47:49.298895+0000","last_fullsized":"2023-10-07T08:47:49.298895+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:12:58.312698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292163+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:59:50.950670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298815+0000","last_change":"2023-10-07T08:47:49.298815+0000","last_active":"2023-10-07T08:47:49.298815+0000","last_peered":"2023-10-07T08:47:49.298815+0000","last_clean":"2023-10-07T08:47:49.298815+0000","last_became_active":"2023-10-07T08:47:49.298575+0000","last_became_peered":"2023-10-07T08:47:49.298575+0000","last_unstale":"2023-10-07T08:47:49.298815+0000","last_undegraded":"2023-10-07T08:47:49.298815+0000","last_fullsized":"2023-10-07T08:47:49.298815+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:49.861476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291333+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:03:12.608693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.292849+0000","last_change":"2023-10-07T08:47:49.292849+0000","last_active":"2023-10-07T08:47:49.292849+0000","last_peered":"2023-10-07T08:47:49.292849+0000","last_clean":"2023-10-07T08:47:49.292849+0000","last_became_active":"2023-10-07T08:47:49.292629+0000","last_became_peered":"2023-10-07T08:47:49.292629+0000","last_unstale":"2023-10-07T08:47:49.292849+0000","last_undegraded":"2023-10-07T08:47:49.292849+0000","last_fullsized":"2023-10-07T08:47:49.292849+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:51:18.386745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.288321+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:02:06.577837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298866+0000","last_change":"2023-10-07T08:47:49.298866+0000","last_active":"2023-10-07T08:47:49.298866+0000","last_peered":"2023-10-07T08:47:49.298866+0000","last_clean":"2023-10-07T08:47:49.298866+0000","last_became_active":"2023-10-07T08:47:49.298655+0000","last_became_peered":"2023-10-07T08:47:49.298655+0000","last_unstale":"2023-10-07T08:47:49.298866+0000","last_undegraded":"2023-10-07T08:47:49.298866+0000","last_fullsized":"2023-10-07T08:47:49.298866+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:27:54.845528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293540+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:10.710501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.301545+0000","last_change":"2023-10-07T08:47:49.301545+0000","last_active":"2023-10-07T08:47:49.301545+0000","last_peered":"2023-10-07T08:47:49.301545+0000","last_clean":"2023-10-07T08:47:49.301545+0000","last_became_active":"2023-10-07T08:47:49.301182+0000","last_became_peered":"2023-10-07T08:47:49.301182+0000","last_unstale":"2023-10-07T08:47:49.301545+0000","last_undegraded":"2023-10-07T08:47:49.301545+0000","last_fullsized":"2023-10-07T08:47:49.301545+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:42:55.869359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.288968+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:13.888664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.303488+0000","last_change":"2023-10-07T08:47:49.303488+0000","last_active":"2023-10-07T08:47:49.303488+0000","last_peered":"2023-10-07T08:47:49.303488+0000","last_clean":"2023-10-07T08:47:49.303488+0000","last_became_active":"2023-10-07T08:47:49.301866+0000","last_became_peered":"2023-10-07T08:47:49.301866+0000","last_unstale":"2023-10-07T08:47:49.303488+0000","last_undegraded":"2023-10-07T08:47:49.303488+0000","last_fullsized":"2023-10-07T08:47:49.303488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:11.700899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294780+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:07.294592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.300831+0000","last_change":"2023-10-07T08:47:49.300831+0000","last_active":"2023-10-07T08:47:49.300831+0000","last_peered":"2023-10-07T08:47:49.300831+0000","last_clean":"2023-10-07T08:47:49.300831+0000","last_became_active":"2023-10-07T08:47:49.300172+0000","last_became_peered":"2023-10-07T08:47:49.300172+0000","last_unstale":"2023-10-07T08:47:49.300831+0000","last_undegraded":"2023-10-07T08:47:49.300831+0000","last_fullsized":"2023-10-07T08:47:49.300831+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:02.115023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.289911+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:59:50.950670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.297586+0000","last_change":"2023-10-07T08:47:49.297586+0000","last_active":"2023-10-07T08:47:49.297586+0000","last_peered":"2023-10-07T08:47:49.297586+0000","last_clean":"2023-10-07T08:47:49.297586+0000","last_became_active":"2023-10-07T08:47:49.297059+0000","last_became_peered":"2023-10-07T08:47:49.297059+0000","last_unstale":"2023-10-07T08:47:49.297586+0000","last_undegraded":"2023-10-07T08:47:49.297586+0000","last_fullsized":"2023-10-07T08:47:49.297586+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:28:18.348796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291740+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:45.158815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.290323+0000","last_change":"2023-10-07T08:47:49.290323+0000","last_active":"2023-10-07T08:47:49.290323+0000","last_peered":"2023-10-07T08:47:49.290323+0000","last_clean":"2023-10-07T08:47:49.290323+0000","last_became_active":"2023-10-07T08:47:49.290095+0000","last_became_peered":"2023-10-07T08:47:49.290095+0000","last_unstale":"2023-10-07T08:47:49.290323+0000","last_undegraded":"2023-10-07T08:47:49.290323+0000","last_fullsized":"2023-10-07T08:47:49.290323+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:20:32.974542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291972+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:48.210053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298146+0000","last_change":"2023-10-07T08:47:49.298146+0000","last_active":"2023-10-07T08:47:49.298146+0000","last_peered":"2023-10-07T08:47:49.298146+0000","last_clean":"2023-10-07T08:47:49.298146+0000","last_became_active":"2023-10-07T08:47:49.297916+0000","last_became_peered":"2023-10-07T08:47:49.297916+0000","last_unstale":"2023-10-07T08:47:49.298146+0000","last_undegraded":"2023-10-07T08:47:49.298146+0000","last_fullsized":"2023-10-07T08:47:49.298146+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:02:34.686983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293310+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:12:59.316878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.291174+0000","last_change":"2023-10-07T08:47:49.291174+0000","last_active":"2023-10-07T08:47:49.291174+0000","last_peered":"2023-10-07T08:47:49.291174+0000","last_clean":"2023-10-07T08:47:49.291174+0000","last_became_active":"2023-10-07T08:47:49.290936+0000","last_became_peered":"2023-10-07T08:47:49.290936+0000","last_unstale":"2023-10-07T08:47:49.291174+0000","last_undegraded":"2023-10-07T08:47:49.291174+0000","last_fullsized":"2023-10-07T08:47:49.291174+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:08:58.201915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291326+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:50.865656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.302213+0000","last_change":"2023-10-07T08:47:49.302213+0000","last_active":"2023-10-07T08:47:49.302213+0000","last_peered":"2023-10-07T08:47:49.302213+0000","last_clean":"2023-10-07T08:47:49.302213+0000","last_became_active":"2023-10-07T08:47:49.301699+0000","last_became_peered":"2023-10-07T08:47:49.301699+0000","last_unstale":"2023-10-07T08:47:49.302213+0000","last_undegraded":"2023-10-07T08:47:49.302213+0000","last_fullsized":"2023-10-07T08:47:49.302213+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:47.205873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295480+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:02:29.075314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294295+0000","last_change":"2023-10-07T08:47:49.294295+0000","last_active":"2023-10-07T08:47:49.294295+0000","last_peered":"2023-10-07T08:47:49.294295+0000","last_clean":"2023-10-07T08:47:49.294295+0000","last_became_active":"2023-10-07T08:47:49.293705+0000","last_became_peered":"2023-10-07T08:47:49.293705+0000","last_unstale":"2023-10-07T08:47:49.294295+0000","last_undegraded":"2023-10-07T08:47:49.294295+0000","last_fullsized":"2023-10-07T08:47:49.294295+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:32.044267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294315+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:15:58.515103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.296520+0000","last_change":"2023-10-07T08:47:49.296520+0000","last_active":"2023-10-07T08:47:49.296520+0000","last_peered":"2023-10-07T08:47:49.296520+0000","last_clean":"2023-10-07T08:47:49.296520+0000","last_became_active":"2023-10-07T08:47:49.296297+0000","last_became_peered":"2023-10-07T08:47:49.296297+0000","last_unstale":"2023-10-07T08:47:49.296520+0000","last_undegraded":"2023-10-07T08:47:49.296520+0000","last_fullsized":"2023-10-07T08:47:49.296520+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:02:34.686983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294547+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:49:32.774690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.293143+0000","last_change":"2023-10-07T08:47:49.293143+0000","last_active":"2023-10-07T08:47:49.293143+0000","last_peered":"2023-10-07T08:47:49.293143+0000","last_clean":"2023-10-07T08:47:49.293143+0000","last_became_active":"2023-10-07T08:47:49.292921+0000","last_became_peered":"2023-10-07T08:47:49.292921+0000","last_unstale":"2023-10-07T08:47:49.293143+0000","last_undegraded":"2023-10-07T08:47:49.293143+0000","last_fullsized":"2023-10-07T08:47:49.293143+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:38.526362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294359+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:45.158815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.293954+0000","last_change":"2023-10-07T08:47:49.293954+0000","last_active":"2023-10-07T08:47:49.293954+0000","last_peered":"2023-10-07T08:47:49.293954+0000","last_clean":"2023-10-07T08:47:49.293954+0000","last_became_active":"2023-10-07T08:47:49.293733+0000","last_became_peered":"2023-10-07T08:47:49.293733+0000","last_unstale":"2023-10-07T08:47:49.293954+0000","last_undegraded":"2023-10-07T08:47:49.293954+0000","last_fullsized":"2023-10-07T08:47:49.293954+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.117157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294528+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:58:40.091484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.301153+0000","last_change":"2023-10-07T08:47:49.301153+0000","last_active":"2023-10-07T08:47:49.301153+0000","last_peered":"2023-10-07T08:47:49.301153+0000","last_clean":"2023-10-07T08:47:49.301153+0000","last_became_active":"2023-10-07T08:47:49.300932+0000","last_became_peered":"2023-10-07T08:47:49.300932+0000","last_unstale":"2023-10-07T08:47:49.301153+0000","last_undegraded":"2023-10-07T08:47:49.301153+0000","last_fullsized":"2023-10-07T08:47:49.301153+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:28:51.667344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295015+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:49.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.295423+0000","last_change":"2023-10-07T08:47:49.295423+0000","last_active":"2023-10-07T08:47:49.295423+0000","last_peered":"2023-10-07T08:47:49.295423+0000","last_clean":"2023-10-07T08:47:49.295423+0000","last_became_active":"2023-10-07T08:47:49.295149+0000","last_became_peered":"2023-10-07T08:47:49.295149+0000","last_unstale":"2023-10-07T08:47:49.295423+0000","last_undegraded":"2023-10-07T08:47:49.295423+0000","last_fullsized":"2023-10-07T08:47:49.295423+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:42.874808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294351+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:39:57.537377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294640+0000","last_change":"2023-10-07T08:47:49.294640+0000","last_active":"2023-10-07T08:47:49.294640+0000","last_peered":"2023-10-07T08:47:49.294640+0000","last_clean":"2023-10-07T08:47:49.294640+0000","last_became_active":"2023-10-07T08:47:49.294244+0000","last_became_peered":"2023-10-07T08:47:49.294244+0000","last_unstale":"2023-10-07T08:47:49.294640+0000","last_undegraded":"2023-10-07T08:47:49.294640+0000","last_fullsized":"2023-10-07T08:47:49.294640+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:39:10.789555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291042+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:10.710501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.296619+0000","last_change":"2023-10-07T08:47:49.296619+0000","last_active":"2023-10-07T08:47:49.296619+0000","last_peered":"2023-10-07T08:47:49.296619+0000","last_clean":"2023-10-07T08:47:49.296619+0000","last_became_active":"2023-10-07T08:47:49.296120+0000","last_became_peered":"2023-10-07T08:47:49.296120+0000","last_unstale":"2023-10-07T08:47:49.296619+0000","last_undegraded":"2023-10-07T08:47:49.296619+0000","last_fullsized":"2023-10-07T08:47:49.296619+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:42:22.643545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293363+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:11.981069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298676+0000","last_change":"2023-10-07T08:47:49.298676+0000","last_active":"2023-10-07T08:47:49.298676+0000","last_peered":"2023-10-07T08:47:49.298676+0000","last_clean":"2023-10-07T08:47:49.298676+0000","last_became_active":"2023-10-07T08:47:49.298453+0000","last_became_peered":"2023-10-07T08:47:49.298453+0000","last_unstale":"2023-10-07T08:47:49.298676+0000","last_undegraded":"2023-10-07T08:47:49.298676+0000","last_fullsized":"2023-10-07T08:47:49.298676+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:37.562344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293950+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:16:39.403571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294015+0000","last_change":"2023-10-07T08:47:49.294015+0000","last_active":"2023-10-07T08:47:49.294015+0000","last_peered":"2023-10-07T08:47:49.294015+0000","last_clean":"2023-10-07T08:47:49.294015+0000","last_became_active":"2023-10-07T08:47:49.292830+0000","last_became_peered":"2023-10-07T08:47:49.292830+0000","last_unstale":"2023-10-07T08:47:49.294015+0000","last_undegraded":"2023-10-07T08:47:49.294015+0000","last_fullsized":"2023-10-07T08:47:49.294015+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:51.456204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295099+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:59:50.950670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.297510+0000","last_change":"2023-10-07T08:47:49.297510+0000","last_active":"2023-10-07T08:47:49.297510+0000","last_peered":"2023-10-07T08:47:49.297510+0000","last_clean":"2023-10-07T08:47:49.297510+0000","last_became_active":"2023-10-07T08:47:49.297276+0000","last_became_peered":"2023-10-07T08:47:49.297276+0000","last_unstale":"2023-10-07T08:47:49.297510+0000","last_undegraded":"2023-10-07T08:47:49.297510+0000","last_fullsized":"2023-10-07T08:47:49.297510+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:02.115023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.289502+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:49.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.299182+0000","last_change":"2023-10-07T08:47:49.299182+0000","last_active":"2023-10-07T08:47:49.299182+0000","last_peered":"2023-10-07T08:47:49.299182+0000","last_clean":"2023-10-07T08:47:49.299182+0000","last_became_active":"2023-10-07T08:47:49.298742+0000","last_became_peered":"2023-10-07T08:47:49.298742+0000","last_unstale":"2023-10-07T08:47:49.299182+0000","last_undegraded":"2023-10-07T08:47:49.299182+0000","last_fullsized":"2023-10-07T08:47:49.299182+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:10.976889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291037+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:08:59.206095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.303627+0000","last_change":"2023-10-07T08:47:49.303627+0000","last_active":"2023-10-07T08:47:49.303627+0000","last_peered":"2023-10-07T08:47:49.303627+0000","last_clean":"2023-10-07T08:47:49.303627+0000","last_became_active":"2023-10-07T08:47:49.302365+0000","last_became_peered":"2023-10-07T08:47:49.302365+0000","last_unstale":"2023-10-07T08:47:49.303627+0000","last_undegraded":"2023-10-07T08:47:49.303627+0000","last_fullsized":"2023-10-07T08:47:49.303627+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:02:54.069896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296034+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:16:39.403571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.304623+0000","last_change":"2023-10-07T08:47:49.304623+0000","last_active":"2023-10-07T08:47:49.304623+0000","last_peered":"2023-10-07T08:47:49.304623+0000","last_clean":"2023-10-07T08:47:49.304623+0000","last_became_active":"2023-10-07T08:47:49.304380+0000","last_became_peered":"2023-10-07T08:47:49.304380+0000","last_unstale":"2023-10-07T08:47:49.304623+0000","last_undegraded":"2023-10-07T08:47:49.304623+0000","last_fullsized":"2023-10-07T08:47:49.304623+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:09:37.124003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292959+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:12.705080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.295864+0000","last_change":"2023-10-07T08:47:49.295864+0000","last_active":"2023-10-07T08:47:49.295864+0000","last_peered":"2023-10-07T08:47:49.295864+0000","last_clean":"2023-10-07T08:47:49.295864+0000","last_became_active":"2023-10-07T08:47:49.293237+0000","last_became_peered":"2023-10-07T08:47:49.293237+0000","last_unstale":"2023-10-07T08:47:49.295864+0000","last_undegraded":"2023-10-07T08:47:49.295864+0000","last_fullsized":"2023-10-07T08:47:49.295864+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:02.115023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":229,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-07T08:47:48.286028+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:47:48.286028+0000","last_peered":"2023-10-07T08:47:48.286028+0000","last_clean":"2023-10-07T08:47:48.286028+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:47:48.286028+0000","last_undegraded":"2023-10-07T08:47:48.286028+0000","last_fullsized":"2023-10-07T08:47:48.286028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1099,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194213,"statfs":{"total":200000000,"available":198874402,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.497},"min":{"1min":0.34999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68000000000000005,"5min":0.751,"15min":0.751},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.501,"15min":0.48299999999999998},"min":{"1min":0.371,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66500000000000004,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.66300000000000003}]},{"osd":1,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.51600000000000001},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76300000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.81999999999999995}]},{"osd":2,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.33400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.48699999999999999},"min":{"1min":0.36699999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.69699999999999995,"15min":0.82899999999999996},"min":{"1min":0.38400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.73299999999999998,"5min":6.8570000000000002,"15min":6.8570000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.45100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72699999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.749}]},{"osd":4,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.75900000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.27800000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.747,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54200000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.498,"15min":0.50900000000000001},"min":{"1min":0.30199999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.499},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80800000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.47699999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58099999999999996,"15min":0.59599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78200000000000003,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47999999999999998,"15min":0.46800000000000003},"min":{"1min":0.33300000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73999999999999999,"5min":0.745,"15min":0.745},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.48799999999999999,"15min":0.48599999999999999},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.56699999999999995}]},{"osd":1,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54000000000000004,"15min":0.52700000000000002},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.41499999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.70699999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.502,"15min":0.47399999999999998},"min":{"1min":0.375,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.621},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51500000000000001,"15min":0.51300000000000001},"min":{"1min":0.41999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66000000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.53100000000000003},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.80300000000000005,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.32100000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67200000000000004,"5min":0.748,"15min":0.748},"last":0.44800000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.52200000000000002},"min":{"1min":0.37,"5min":0.312,"15min":0.312},"max":{"1min":0.71599999999999997,"5min":0.754,"15min":0.754},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":1.052,"15min":1.052},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34599999999999997,"15min":0.312},"min":{"1min":0.22500000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.56699999999999995,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.25},{"interface":"front","average":{"1min":0.371,"5min":0.35499999999999998,"15min":0.32800000000000001},"min":{"1min":0.22500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.29799999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.318},"min":{"1min":0.26200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70399999999999996,"5min":1.639,"15min":1.639},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.38800000000000001,"15min":0.33200000000000002},"min":{"1min":0.28699999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.47399999999999998,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.28699999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40000000000000002,"15min":0.35899999999999999},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.52800000000000002,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.317},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.34799999999999998},"min":{"1min":0.28599999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.52200000000000002},"min":{"1min":0.35699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79100000000000004,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.52800000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.52600000000000002},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73099999999999998,"5min":0.87,"15min":0.87},"last":0.71999999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.58199999999999996},"min":{"1min":0.51800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79100000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.68400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1093,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194219,"statfs":{"total":200000000,"available":198880665,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.371},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.377,"15min":0.39500000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.67400000000000004,"5min":1.079,"15min":1.079},"last":0.26400000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.39100000000000001},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":1.464,"15min":1.464},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.40200000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67900000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.35299999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":1.341,"15min":1.341},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.42099999999999999,"15min":0.435},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68600000000000005,"5min":1.532,"15min":1.532},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90200000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.60999999999999999},"min":{"1min":0.36199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80100000000000005,"5min":1.51,"15min":1.51},"last":0.71499999999999997}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83299999999999996,"5min":1.25,"15min":1.25},"last":0.82299999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.92900000000000005,"5min":1.488,"15min":1.488},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":1.024,"15min":1.024},"last":0.69999999999999996}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.90300000000000002,"5min":1.288,"15min":1.288},"last":0.78400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.33400000000000002,"15min":0.34399999999999997},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.44700000000000001,"5min":1.665,"15min":1.665},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.36199999999999999},"min":{"1min":0.248,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47399999999999998,"5min":1.579,"15min":1.579},"last":0.32000000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36299999999999999,"15min":0.374},"min":{"1min":0.23699999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.52400000000000002,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.218},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.28799999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53600000000000003,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.26600000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38400000000000001,"15min":0.39000000000000001},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":1.454,"15min":1.454},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38,"15min":0.38900000000000001},"min":{"1min":0.26100000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.30199999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.75700000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.59899999999999998,"15min":0.59399999999999997},"min":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77400000000000002,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.747,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.40600000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.79700000000000004,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.36799999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72299999999999998,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.47899999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.80200000000000005,"5min":1.637,"15min":1.637},"last":0.503}]},{"osd":7,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41099999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.72899999999999998,"5min":1.49,"15min":1.49},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78600000000000003,"5min":1.375,"15min":1.375},"last":0.60199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":516,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194795,"statfs":{"total":200000000,"available":199471033,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34300000000000003,"15min":0.32700000000000001},"min":{"1min":0.22800000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.48099999999999998,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.254},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34100000000000003,"15min":0.31900000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.43099999999999999,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.376,"15min":0.35799999999999998},"min":{"1min":0.27100000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46000000000000002,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41499999999999998,"15min":0.39700000000000002},"min":{"1min":0.27400000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51400000000000001,"5min":1.885,"15min":1.885},"last":0.372}]},{"osd":2,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55000000000000004,"5min":1.274,"15min":1.274},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41299999999999998,"15min":0.39900000000000002},"min":{"1min":0.309,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.33400000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.498},"min":{"1min":0.377,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72599999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56200000000000006,"15min":0.53100000000000003},"min":{"1min":0.438,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74299999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.497},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.45400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.72099999999999997,"5min":1.851,"15min":1.851},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.55500000000000005},"min":{"1min":0.45200000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80100000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.60999999999999999,"15min":0.58399999999999996},"min":{"1min":0.47099999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.81399999999999995,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.48099999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71299999999999997,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.55200000000000005},"min":{"1min":0.439,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.504,"15min":0.48599999999999999},"min":{"1min":0.308,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69199999999999995,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52700000000000002,"15min":0.505},"min":{"1min":0.38800000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.69399999999999995,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.48899999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.497},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.70899999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.495},"min":{"1min":0.40799999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.64100000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.54300000000000004}]},{"osd":2,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53200000000000003,"15min":0.50600000000000001},"min":{"1min":0.33400000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73699999999999999,"5min":1.29,"15min":1.29},"last":0.63300000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70499999999999996,"5min":2.052,"15min":2.052},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":1.369,"15min":1.369},"last":0.70599999999999996}]},{"osd":5,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61299999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.36199999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71199999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.316,"15min":0.316},"max":{"1min":0.64000000000000001,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.745},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.67300000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.68899999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.316,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67700000000000005,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69299999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.79300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52300000000000002,"15min":0.51300000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51500000000000001,"15min":0.50700000000000001},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73899999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.55100000000000005}]},{"osd":1,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.498,"15min":0.48399999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.72299999999999998,"5min":0.748,"15min":0.748},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70099999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.56899999999999995}]},{"osd":2,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53000000000000003,"15min":0.52400000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73499999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.309,"15min":0.309},"max":{"1min":0.68100000000000005,"5min":0.754,"15min":0.754},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67700000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77600000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.72399999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.34300000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.627,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.59899999999999998},"min":{"1min":0.42599999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67300000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.754}]},{"osd":6,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52500000000000002,"15min":0.54600000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.73599999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.81599999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.40600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68899999999999995,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57099999999999995,"15min":0.59999999999999998},"min":{"1min":0.35699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72399999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64400000000000002}]}]}],"pool_statfs":[]}} 2023-10-07T08:47:54.752 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:47:54.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.898+0000 7f4769cac700 1 Processor -- start 2023-10-07T08:47:54.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.898+0000 7f4769cac700 1 -- start start 2023-10-07T08:47:54.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.899+0000 7f4769cac700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4764159b40 0x7f47640cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.899+0000 7f4769cac700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4764068e90 0x7f47640cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.899+0000 7f4769cac700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47640cee10 con 0x7f4764159f10 2023-10-07T08:47:54.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.899+0000 7f4769cac700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47640cd040 con 0x7f4764159b40 2023-10-07T08:47:54.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.899+0000 7f4769cac700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47640cd320 con 0x7f4764068e90 2023-10-07T08:47:54.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.899+0000 7f4768caa700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4764159b40 0x7f47640cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.899+0000 7f4763fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4764159f10 0x7f4764068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53704/0 (socket says 172.21.15.81:53704) 2023-10-07T08:47:54.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.899+0000 7f4763fff700 1 -- 172.21.15.81:0/4177396407 learned_addr learned my addr 172.21.15.81:0/4177396407 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:54.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.899+0000 7f4768caa700 1 -- 172.21.15.81:0/4177396407 >> v2:172.21.15.89:3300/0 conn(0x7f4764068e90 msgr2=0x7f47640cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:54.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.899+0000 7f47694ab700 1 --2- 172.21.15.81:0/4177396407 >> v2:172.21.15.89:3300/0 conn(0x7f4764068e90 0x7f47640cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.899+0000 7f47637fe700 1 -- 172.21.15.81:0/4177396407 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505907471 0 0) 0x7f47640cee10 con 0x7f4764159f10 2023-10-07T08:47:54.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.899+0000 7f4768caa700 1 --2- 172.21.15.81:0/4177396407 >> v2:172.21.15.89:3300/0 conn(0x7f4764068e90 0x7f47640cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.899+0000 7f4768caa700 1 -- 172.21.15.81:0/4177396407 >> v1:172.21.15.81:6789/0 conn(0x7f4764159f10 legacy=0x7f4764068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.899+0000 7f4768caa700 1 -- 172.21.15.81:0/4177396407 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47640ce7c0 con 0x7f4764159b40 2023-10-07T08:47:54.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.899+0000 7f4768caa700 1 --2- 172.21.15.81:0/4177396407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4764159b40 0x7f47640cc600 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f47640cae10 tx=0x7f47580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29fb22e3a5ac5e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:54.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.899+0000 7f47637fe700 1 -- 172.21.15.81:0/4177396407 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475800b6b0 con 0x7f4764159b40 2023-10-07T08:47:54.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.900+0000 7f47637fe700 1 -- 172.21.15.81:0/4177396407 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475800b810 con 0x7f4764159b40 2023-10-07T08:47:54.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.900+0000 7f47637fe700 1 -- 172.21.15.81:0/4177396407 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475800bbb0 con 0x7f4764159b40 2023-10-07T08:47:54.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.900+0000 7f4769cac700 1 -- 172.21.15.81:0/4177396407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4764159b40 msgr2=0x7f47640cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.900+0000 7f4769cac700 1 --2- 172.21.15.81:0/4177396407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4764159b40 0x7f47640cc600 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f47640cae10 tx=0x7f47580091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.900+0000 7f4769cac700 1 -- 172.21.15.81:0/4177396407 shutdown_connections 2023-10-07T08:47:54.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.900+0000 7f4769cac700 1 --2- 172.21.15.81:0/4177396407 >> v2:172.21.15.89:3300/0 conn(0x7f4764068e90 0x7f47640cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.900+0000 7f4769cac700 1 --2- 172.21.15.81:0/4177396407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4764159b40 0x7f47640cc600 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.900+0000 7f4769cac700 1 -- 172.21.15.81:0/4177396407 >> 172.21.15.81:0/4177396407 conn(0x7f47640cd660 msgr2=0x7f47640cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:54.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.900+0000 7f4769cac700 1 -- 172.21.15.81:0/4177396407 shutdown_connections 2023-10-07T08:47:54.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.900+0000 7f4769cac700 1 -- 172.21.15.81:0/4177396407 wait complete. 2023-10-07T08:47:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.901+0000 7f4769cac700 1 Processor -- start 2023-10-07T08:47:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.901+0000 7f4769cac700 1 -- start start 2023-10-07T08:47:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.902+0000 7f4769cac700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4764068e90 0x7f4764155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.902+0000 7f4769cac700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4764159b40 0x7f4764155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.902+0000 7f4769cac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4764159f10 0x7f4764158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.902+0000 7f4769cac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47641587d0 con 0x7f4764159f10 2023-10-07T08:47:54.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.902+0000 7f4769cac700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4764157bc0 con 0x7f4764159b40 2023-10-07T08:47:54.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.902+0000 7f4769cac700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4764157ea0 con 0x7f4764068e90 2023-10-07T08:47:54.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.902+0000 7f47694ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4764159f10 0x7f4764158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.902+0000 7f47694ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4764159f10 0x7f4764158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43068/0 (socket says 172.21.15.81:43068) 2023-10-07T08:47:54.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.902+0000 7f47694ab700 1 -- 172.21.15.81:0/3776074910 learned_addr learned my addr 172.21.15.81:0/3776074910 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:54.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.902+0000 7f4763fff700 1 --2- 172.21.15.81:0/3776074910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4764159b40 0x7f4764155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.902+0000 7f4768caa700 1 --2- 172.21.15.81:0/3776074910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4764068e90 0x7f4764155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.902+0000 7f47694ab700 1 -- 172.21.15.81:0/3776074910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4764068e90 msgr2=0x7f4764155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.902+0000 7f47694ab700 1 --2- 172.21.15.81:0/3776074910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4764068e90 0x7f4764155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.902+0000 7f47694ab700 1 -- 172.21.15.81:0/3776074910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4764159b40 msgr2=0x7f4764155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:54.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.902+0000 7f47694ab700 1 --2- 172.21.15.81:0/3776074910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4764159b40 0x7f4764155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:54.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.902+0000 7f47694ab700 1 -- 172.21.15.81:0/3776074910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4758009420 con 0x7f4764159f10 2023-10-07T08:47:54.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.903+0000 7f47694ab700 1 --2- 172.21.15.81:0/3776074910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4764159f10 0x7f4764158c60 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f475c00ce80 tx=0x7f475c007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:54.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.903+0000 7f4760ff9700 1 -- 172.21.15.81:0/3776074910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c00acc0 con 0x7f4764159f10 2023-10-07T08:47:54.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.903+0000 7f4760ff9700 1 -- 172.21.15.81:0/3776074910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c00ae20 con 0x7f4764159f10 2023-10-07T08:47:54.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.903+0000 7f4769cac700 1 -- 172.21.15.81:0/3776074910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4764158180 con 0x7f4764159f10 2023-10-07T08:47:54.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.903+0000 7f4760ff9700 1 -- 172.21.15.81:0/3776074910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c016680 con 0x7f4764159f10 2023-10-07T08:47:54.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.903+0000 7f4769cac700 1 -- 172.21.15.81:0/3776074910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4764156440 con 0x7f4764159f10 2023-10-07T08:47:54.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.904+0000 7f4769cac700 1 -- 172.21.15.81:0/3776074910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4764158980 con 0x7f4764159f10 2023-10-07T08:47:54.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.904+0000 7f4760ff9700 1 -- 172.21.15.81:0/3776074910 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f475c003020 con 0x7f4764159f10 2023-10-07T08:47:54.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.904+0000 7f4760ff9700 1 --2- 172.21.15.81:0/3776074910 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4748066f30 0x7f47480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:54.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.905+0000 7f4760ff9700 1 -- 172.21.15.81:0/3776074910 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f475c012070 con 0x7f4764159f10 2023-10-07T08:47:54.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.905+0000 7f4768caa700 1 --2- 172.21.15.81:0/3776074910 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4748066f30 0x7f47480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:54.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.905+0000 7f4768caa700 1 --2- 172.21.15.81:0/3776074910 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4748066f30 0x7f47480693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f47580093f0 tx=0x7f4758017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:54.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:54.909+0000 7f4760ff9700 1 -- 172.21.15.81:0/3776074910 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4764158980 con 0x7f4764159f10 2023-10-07T08:47:54.956 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-10-07T08:47:54.956+0000 7fa4cca2c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:47:55.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.086+0000 7f4769cac700 1 -- 172.21.15.81:0/3776074910 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4764158910 con 0x7f4748066f30 2023-10-07T08:47:55.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.094+0000 7f4760ff9700 1 -- 172.21.15.81:0/3776074910 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282003 (secure 0 0 0) 0x7f4764158910 con 0x7f4748066f30 2023-10-07T08:47:55.097 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.097+0000 7f4769cac700 1 -- 172.21.15.81:0/3776074910 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4748066f30 msgr2=0x7f47480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.097+0000 7f4769cac700 1 --2- 172.21.15.81:0/3776074910 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4748066f30 0x7f47480693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f47580093f0 tx=0x7f4758017000 comp rx=0 tx=0).stop 2023-10-07T08:47:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.097+0000 7f4769cac700 1 -- 172.21.15.81:0/3776074910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4764159f10 msgr2=0x7f4764158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.097+0000 7f4769cac700 1 --2- 172.21.15.81:0/3776074910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4764159f10 0x7f4764158c60 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f475c00ce80 tx=0x7f475c007840 comp rx=0 tx=0).stop 2023-10-07T08:47:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.097+0000 7f4769cac700 1 -- 172.21.15.81:0/3776074910 shutdown_connections 2023-10-07T08:47:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.097+0000 7f4769cac700 1 --2- 172.21.15.81:0/3776074910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4764159f10 0x7f4764158c60 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.097+0000 7f4769cac700 1 --2- 172.21.15.81:0/3776074910 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4748066f30 0x7f47480693e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.097+0000 7f4769cac700 1 --2- 172.21.15.81:0/3776074910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4764068e90 0x7f4764155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.097+0000 7f4769cac700 1 --2- 172.21.15.81:0/3776074910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4764159b40 0x7f4764155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.097+0000 7f4769cac700 1 -- 172.21.15.81:0/3776074910 >> 172.21.15.81:0/3776074910 conn(0x7f47640cd660 msgr2=0x7f47640c7360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.097+0000 7f4769cac700 1 -- 172.21.15.81:0/3776074910 shutdown_connections 2023-10-07T08:47:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.097+0000 7f4769cac700 1 -- 172.21.15.81:0/3776074910 wait complete. 2023-10-07T08:47:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:47:55.109 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2023-10-07T08:47:54.069795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5322,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557177,"statfs":{"total":1600000000,"available":1594549950,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.787274"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.298194+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:15:58.515103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294002+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:48.119099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295070+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:40.234974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.297055+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:51.378610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295698+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:33.048447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293944+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:50.865656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295473+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:40:53.993327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295349+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:13.888664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296696+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:39.530542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293813+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:09:38.128184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292065+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:02:55.074077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293443+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:48.119099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292126+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:49.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296717+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:44:28.093547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.288364+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:48:32.815580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295701+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:06.585857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296786+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:03.119203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.298134+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:25:17.744264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.290131+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:48:20.456130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295473+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:49:06.137613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295824+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:56:10.032555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293650+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:11.981069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.300037+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:06.585857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296104+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:38:48.558191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292351+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:51:39.019296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292929+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:43.878989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296423+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:29.097371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.299702+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:40.971774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291376+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:23:35.234961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291698+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:52.460384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294717+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:13:54.005176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293062+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:12:59.316878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295145+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:40.971774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.303788+0000","last_change":"2023-10-07T08:47:49.303788+0000","last_active":"2023-10-07T08:47:49.303788+0000","last_peered":"2023-10-07T08:47:49.303788+0000","last_clean":"2023-10-07T08:47:49.303788+0000","last_became_active":"2023-10-07T08:47:49.302673+0000","last_became_peered":"2023-10-07T08:47:49.302673+0000","last_unstale":"2023-10-07T08:47:49.303788+0000","last_undegraded":"2023-10-07T08:47:49.303788+0000","last_fullsized":"2023-10-07T08:47:49.303788+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:51:38.015116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.299328+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:13:54.005176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298088+0000","last_change":"2023-10-07T08:47:49.298088+0000","last_active":"2023-10-07T08:47:49.298088+0000","last_peered":"2023-10-07T08:47:49.298088+0000","last_clean":"2023-10-07T08:47:49.298088+0000","last_became_active":"2023-10-07T08:47:49.297854+0000","last_became_peered":"2023-10-07T08:47:49.297854+0000","last_unstale":"2023-10-07T08:47:49.298088+0000","last_undegraded":"2023-10-07T08:47:49.298088+0000","last_fullsized":"2023-10-07T08:47:49.298088+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:47.114919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293821+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:40:14.077438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294446+0000","last_change":"2023-10-07T08:47:49.294446+0000","last_active":"2023-10-07T08:47:49.294446+0000","last_peered":"2023-10-07T08:47:49.294446+0000","last_clean":"2023-10-07T08:47:49.294446+0000","last_became_active":"2023-10-07T08:47:49.294035+0000","last_became_peered":"2023-10-07T08:47:49.294035+0000","last_unstale":"2023-10-07T08:47:49.294446+0000","last_undegraded":"2023-10-07T08:47:49.294446+0000","last_fullsized":"2023-10-07T08:47:49.294446+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:09.706320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292464+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:39.530542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294365+0000","last_change":"2023-10-07T08:47:49.294365+0000","last_active":"2023-10-07T08:47:49.294365+0000","last_peered":"2023-10-07T08:47:49.294365+0000","last_clean":"2023-10-07T08:47:49.294365+0000","last_became_active":"2023-10-07T08:47:49.294144+0000","last_became_peered":"2023-10-07T08:47:49.294144+0000","last_unstale":"2023-10-07T08:47:49.294365+0000","last_undegraded":"2023-10-07T08:47:49.294365+0000","last_fullsized":"2023-10-07T08:47:49.294365+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:28.093191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292363+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:38.566525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.300106+0000","last_change":"2023-10-07T08:47:49.300106+0000","last_active":"2023-10-07T08:47:49.300106+0000","last_peered":"2023-10-07T08:47:49.300106+0000","last_clean":"2023-10-07T08:47:49.300106+0000","last_became_active":"2023-10-07T08:47:49.299888+0000","last_became_peered":"2023-10-07T08:47:49.299888+0000","last_unstale":"2023-10-07T08:47:49.300106+0000","last_undegraded":"2023-10-07T08:47:49.300106+0000","last_fullsized":"2023-10-07T08:47:49.300106+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:40:13.073258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294924+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:32:38.753716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298895+0000","last_change":"2023-10-07T08:47:49.298895+0000","last_active":"2023-10-07T08:47:49.298895+0000","last_peered":"2023-10-07T08:47:49.298895+0000","last_clean":"2023-10-07T08:47:49.298895+0000","last_became_active":"2023-10-07T08:47:49.298649+0000","last_became_peered":"2023-10-07T08:47:49.298649+0000","last_unstale":"2023-10-07T08:47:49.298895+0000","last_undegraded":"2023-10-07T08:47:49.298895+0000","last_fullsized":"2023-10-07T08:47:49.298895+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:12:58.312698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292163+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:59:50.950670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298815+0000","last_change":"2023-10-07T08:47:49.298815+0000","last_active":"2023-10-07T08:47:49.298815+0000","last_peered":"2023-10-07T08:47:49.298815+0000","last_clean":"2023-10-07T08:47:49.298815+0000","last_became_active":"2023-10-07T08:47:49.298575+0000","last_became_peered":"2023-10-07T08:47:49.298575+0000","last_unstale":"2023-10-07T08:47:49.298815+0000","last_undegraded":"2023-10-07T08:47:49.298815+0000","last_fullsized":"2023-10-07T08:47:49.298815+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:49.861476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291333+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:03:12.608693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.292849+0000","last_change":"2023-10-07T08:47:49.292849+0000","last_active":"2023-10-07T08:47:49.292849+0000","last_peered":"2023-10-07T08:47:49.292849+0000","last_clean":"2023-10-07T08:47:49.292849+0000","last_became_active":"2023-10-07T08:47:49.292629+0000","last_became_peered":"2023-10-07T08:47:49.292629+0000","last_unstale":"2023-10-07T08:47:49.292849+0000","last_undegraded":"2023-10-07T08:47:49.292849+0000","last_fullsized":"2023-10-07T08:47:49.292849+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:51:18.386745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.288321+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:02:06.577837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298866+0000","last_change":"2023-10-07T08:47:49.298866+0000","last_active":"2023-10-07T08:47:49.298866+0000","last_peered":"2023-10-07T08:47:49.298866+0000","last_clean":"2023-10-07T08:47:49.298866+0000","last_became_active":"2023-10-07T08:47:49.298655+0000","last_became_peered":"2023-10-07T08:47:49.298655+0000","last_unstale":"2023-10-07T08:47:49.298866+0000","last_undegraded":"2023-10-07T08:47:49.298866+0000","last_fullsized":"2023-10-07T08:47:49.298866+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:27:54.845528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293540+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:10.710501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.301545+0000","last_change":"2023-10-07T08:47:49.301545+0000","last_active":"2023-10-07T08:47:49.301545+0000","last_peered":"2023-10-07T08:47:49.301545+0000","last_clean":"2023-10-07T08:47:49.301545+0000","last_became_active":"2023-10-07T08:47:49.301182+0000","last_became_peered":"2023-10-07T08:47:49.301182+0000","last_unstale":"2023-10-07T08:47:49.301545+0000","last_undegraded":"2023-10-07T08:47:49.301545+0000","last_fullsized":"2023-10-07T08:47:49.301545+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:42:55.869359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.288968+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:13.888664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.303488+0000","last_change":"2023-10-07T08:47:49.303488+0000","last_active":"2023-10-07T08:47:49.303488+0000","last_peered":"2023-10-07T08:47:49.303488+0000","last_clean":"2023-10-07T08:47:49.303488+0000","last_became_active":"2023-10-07T08:47:49.301866+0000","last_became_peered":"2023-10-07T08:47:49.301866+0000","last_unstale":"2023-10-07T08:47:49.303488+0000","last_undegraded":"2023-10-07T08:47:49.303488+0000","last_fullsized":"2023-10-07T08:47:49.303488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:11.700899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294780+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:07.294592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.300831+0000","last_change":"2023-10-07T08:47:49.300831+0000","last_active":"2023-10-07T08:47:49.300831+0000","last_peered":"2023-10-07T08:47:49.300831+0000","last_clean":"2023-10-07T08:47:49.300831+0000","last_became_active":"2023-10-07T08:47:49.300172+0000","last_became_peered":"2023-10-07T08:47:49.300172+0000","last_unstale":"2023-10-07T08:47:49.300831+0000","last_undegraded":"2023-10-07T08:47:49.300831+0000","last_fullsized":"2023-10-07T08:47:49.300831+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:02.115023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.289911+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:59:50.950670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.297586+0000","last_change":"2023-10-07T08:47:49.297586+0000","last_active":"2023-10-07T08:47:49.297586+0000","last_peered":"2023-10-07T08:47:49.297586+0000","last_clean":"2023-10-07T08:47:49.297586+0000","last_became_active":"2023-10-07T08:47:49.297059+0000","last_became_peered":"2023-10-07T08:47:49.297059+0000","last_unstale":"2023-10-07T08:47:49.297586+0000","last_undegraded":"2023-10-07T08:47:49.297586+0000","last_fullsized":"2023-10-07T08:47:49.297586+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:28:18.348796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291740+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:45.158815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.290323+0000","last_change":"2023-10-07T08:47:49.290323+0000","last_active":"2023-10-07T08:47:49.290323+0000","last_peered":"2023-10-07T08:47:49.290323+0000","last_clean":"2023-10-07T08:47:49.290323+0000","last_became_active":"2023-10-07T08:47:49.290095+0000","last_became_peered":"2023-10-07T08:47:49.290095+0000","last_unstale":"2023-10-07T08:47:49.290323+0000","last_undegraded":"2023-10-07T08:47:49.290323+0000","last_fullsized":"2023-10-07T08:47:49.290323+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:20:32.974542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291972+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:48.210053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298146+0000","last_change":"2023-10-07T08:47:49.298146+0000","last_active":"2023-10-07T08:47:49.298146+0000","last_peered":"2023-10-07T08:47:49.298146+0000","last_clean":"2023-10-07T08:47:49.298146+0000","last_became_active":"2023-10-07T08:47:49.297916+0000","last_became_peered":"2023-10-07T08:47:49.297916+0000","last_unstale":"2023-10-07T08:47:49.298146+0000","last_undegraded":"2023-10-07T08:47:49.298146+0000","last_fullsized":"2023-10-07T08:47:49.298146+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:02:34.686983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293310+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:12:59.316878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.291174+0000","last_change":"2023-10-07T08:47:49.291174+0000","last_active":"2023-10-07T08:47:49.291174+0000","last_peered":"2023-10-07T08:47:49.291174+0000","last_clean":"2023-10-07T08:47:49.291174+0000","last_became_active":"2023-10-07T08:47:49.290936+0000","last_became_peered":"2023-10-07T08:47:49.290936+0000","last_unstale":"2023-10-07T08:47:49.291174+0000","last_undegraded":"2023-10-07T08:47:49.291174+0000","last_fullsized":"2023-10-07T08:47:49.291174+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:08:58.201915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291326+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:50.865656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.302213+0000","last_change":"2023-10-07T08:47:49.302213+0000","last_active":"2023-10-07T08:47:49.302213+0000","last_peered":"2023-10-07T08:47:49.302213+0000","last_clean":"2023-10-07T08:47:49.302213+0000","last_became_active":"2023-10-07T08:47:49.301699+0000","last_became_peered":"2023-10-07T08:47:49.301699+0000","last_unstale":"2023-10-07T08:47:49.302213+0000","last_undegraded":"2023-10-07T08:47:49.302213+0000","last_fullsized":"2023-10-07T08:47:49.302213+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:47.205873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295480+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:02:29.075314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294295+0000","last_change":"2023-10-07T08:47:49.294295+0000","last_active":"2023-10-07T08:47:49.294295+0000","last_peered":"2023-10-07T08:47:49.294295+0000","last_clean":"2023-10-07T08:47:49.294295+0000","last_became_active":"2023-10-07T08:47:49.293705+0000","last_became_peered":"2023-10-07T08:47:49.293705+0000","last_unstale":"2023-10-07T08:47:49.294295+0000","last_undegraded":"2023-10-07T08:47:49.294295+0000","last_fullsized":"2023-10-07T08:47:49.294295+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:32.044267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294315+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:15:58.515103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.296520+0000","last_change":"2023-10-07T08:47:49.296520+0000","last_active":"2023-10-07T08:47:49.296520+0000","last_peered":"2023-10-07T08:47:49.296520+0000","last_clean":"2023-10-07T08:47:49.296520+0000","last_became_active":"2023-10-07T08:47:49.296297+0000","last_became_peered":"2023-10-07T08:47:49.296297+0000","last_unstale":"2023-10-07T08:47:49.296520+0000","last_undegraded":"2023-10-07T08:47:49.296520+0000","last_fullsized":"2023-10-07T08:47:49.296520+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:02:34.686983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294547+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:49:32.774690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.293143+0000","last_change":"2023-10-07T08:47:49.293143+0000","last_active":"2023-10-07T08:47:49.293143+0000","last_peered":"2023-10-07T08:47:49.293143+0000","last_clean":"2023-10-07T08:47:49.293143+0000","last_became_active":"2023-10-07T08:47:49.292921+0000","last_became_peered":"2023-10-07T08:47:49.292921+0000","last_unstale":"2023-10-07T08:47:49.293143+0000","last_undegraded":"2023-10-07T08:47:49.293143+0000","last_fullsized":"2023-10-07T08:47:49.293143+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:38.526362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294359+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:45.158815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.293954+0000","last_change":"2023-10-07T08:47:49.293954+0000","last_active":"2023-10-07T08:47:49.293954+0000","last_peered":"2023-10-07T08:47:49.293954+0000","last_clean":"2023-10-07T08:47:49.293954+0000","last_became_active":"2023-10-07T08:47:49.293733+0000","last_became_peered":"2023-10-07T08:47:49.293733+0000","last_unstale":"2023-10-07T08:47:49.293954+0000","last_undegraded":"2023-10-07T08:47:49.293954+0000","last_fullsized":"2023-10-07T08:47:49.293954+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.117157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294528+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:58:40.091484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.301153+0000","last_change":"2023-10-07T08:47:49.301153+0000","last_active":"2023-10-07T08:47:49.301153+0000","last_peered":"2023-10-07T08:47:49.301153+0000","last_clean":"2023-10-07T08:47:49.301153+0000","last_became_active":"2023-10-07T08:47:49.300932+0000","last_became_peered":"2023-10-07T08:47:49.300932+0000","last_unstale":"2023-10-07T08:47:49.301153+0000","last_undegraded":"2023-10-07T08:47:49.301153+0000","last_fullsized":"2023-10-07T08:47:49.301153+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:28:51.667344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295015+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:49.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.295423+0000","last_change":"2023-10-07T08:47:49.295423+0000","last_active":"2023-10-07T08:47:49.295423+0000","last_peered":"2023-10-07T08:47:49.295423+0000","last_clean":"2023-10-07T08:47:49.295423+0000","last_became_active":"2023-10-07T08:47:49.295149+0000","last_became_peered":"2023-10-07T08:47:49.295149+0000","last_unstale":"2023-10-07T08:47:49.295423+0000","last_undegraded":"2023-10-07T08:47:49.295423+0000","last_fullsized":"2023-10-07T08:47:49.295423+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:42.874808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294351+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:39:57.537377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294640+0000","last_change":"2023-10-07T08:47:49.294640+0000","last_active":"2023-10-07T08:47:49.294640+0000","last_peered":"2023-10-07T08:47:49.294640+0000","last_clean":"2023-10-07T08:47:49.294640+0000","last_became_active":"2023-10-07T08:47:49.294244+0000","last_became_peered":"2023-10-07T08:47:49.294244+0000","last_unstale":"2023-10-07T08:47:49.294640+0000","last_undegraded":"2023-10-07T08:47:49.294640+0000","last_fullsized":"2023-10-07T08:47:49.294640+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:39:10.789555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291042+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:10.710501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.296619+0000","last_change":"2023-10-07T08:47:49.296619+0000","last_active":"2023-10-07T08:47:49.296619+0000","last_peered":"2023-10-07T08:47:49.296619+0000","last_clean":"2023-10-07T08:47:49.296619+0000","last_became_active":"2023-10-07T08:47:49.296120+0000","last_became_peered":"2023-10-07T08:47:49.296120+0000","last_unstale":"2023-10-07T08:47:49.296619+0000","last_undegraded":"2023-10-07T08:47:49.296619+0000","last_fullsized":"2023-10-07T08:47:49.296619+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:42:22.643545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293363+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:11.981069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298676+0000","last_change":"2023-10-07T08:47:49.298676+0000","last_active":"2023-10-07T08:47:49.298676+0000","last_peered":"2023-10-07T08:47:49.298676+0000","last_clean":"2023-10-07T08:47:49.298676+0000","last_became_active":"2023-10-07T08:47:49.298453+0000","last_became_peered":"2023-10-07T08:47:49.298453+0000","last_unstale":"2023-10-07T08:47:49.298676+0000","last_undegraded":"2023-10-07T08:47:49.298676+0000","last_fullsized":"2023-10-07T08:47:49.298676+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:37.562344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293950+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:16:39.403571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294015+0000","last_change":"2023-10-07T08:47:49.294015+0000","last_active":"2023-10-07T08:47:49.294015+0000","last_peered":"2023-10-07T08:47:49.294015+0000","last_clean":"2023-10-07T08:47:49.294015+0000","last_became_active":"2023-10-07T08:47:49.292830+0000","last_became_peered":"2023-10-07T08:47:49.292830+0000","last_unstale":"2023-10-07T08:47:49.294015+0000","last_undegraded":"2023-10-07T08:47:49.294015+0000","last_fullsized":"2023-10-07T08:47:49.294015+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:51.456204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295099+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:59:50.950670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.297510+0000","last_change":"2023-10-07T08:47:49.297510+0000","last_active":"2023-10-07T08:47:49.297510+0000","last_peered":"2023-10-07T08:47:49.297510+0000","last_clean":"2023-10-07T08:47:49.297510+0000","last_became_active":"2023-10-07T08:47:49.297276+0000","last_became_peered":"2023-10-07T08:47:49.297276+0000","last_unstale":"2023-10-07T08:47:49.297510+0000","last_undegraded":"2023-10-07T08:47:49.297510+0000","last_fullsized":"2023-10-07T08:47:49.297510+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:02.115023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.289502+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:49.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.299182+0000","last_change":"2023-10-07T08:47:49.299182+0000","last_active":"2023-10-07T08:47:49.299182+0000","last_peered":"2023-10-07T08:47:49.299182+0000","last_clean":"2023-10-07T08:47:49.299182+0000","last_became_active":"2023-10-07T08:47:49.298742+0000","last_became_peered":"2023-10-07T08:47:49.298742+0000","last_unstale":"2023-10-07T08:47:49.299182+0000","last_undegraded":"2023-10-07T08:47:49.299182+0000","last_fullsized":"2023-10-07T08:47:49.299182+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:10.976889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291037+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:08:59.206095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.303627+0000","last_change":"2023-10-07T08:47:49.303627+0000","last_active":"2023-10-07T08:47:49.303627+0000","last_peered":"2023-10-07T08:47:49.303627+0000","last_clean":"2023-10-07T08:47:49.303627+0000","last_became_active":"2023-10-07T08:47:49.302365+0000","last_became_peered":"2023-10-07T08:47:49.302365+0000","last_unstale":"2023-10-07T08:47:49.303627+0000","last_undegraded":"2023-10-07T08:47:49.303627+0000","last_fullsized":"2023-10-07T08:47:49.303627+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:02:54.069896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296034+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:16:39.403571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.304623+0000","last_change":"2023-10-07T08:47:49.304623+0000","last_active":"2023-10-07T08:47:49.304623+0000","last_peered":"2023-10-07T08:47:49.304623+0000","last_clean":"2023-10-07T08:47:49.304623+0000","last_became_active":"2023-10-07T08:47:49.304380+0000","last_became_peered":"2023-10-07T08:47:49.304380+0000","last_unstale":"2023-10-07T08:47:49.304623+0000","last_undegraded":"2023-10-07T08:47:49.304623+0000","last_fullsized":"2023-10-07T08:47:49.304623+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:09:37.124003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292959+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:12.705080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.295864+0000","last_change":"2023-10-07T08:47:49.295864+0000","last_active":"2023-10-07T08:47:49.295864+0000","last_peered":"2023-10-07T08:47:49.295864+0000","last_clean":"2023-10-07T08:47:49.295864+0000","last_became_active":"2023-10-07T08:47:49.293237+0000","last_became_peered":"2023-10-07T08:47:49.293237+0000","last_unstale":"2023-10-07T08:47:49.295864+0000","last_undegraded":"2023-10-07T08:47:49.295864+0000","last_fullsized":"2023-10-07T08:47:49.295864+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:02.115023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":229,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-07T08:47:48.286028+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:47:48.286028+0000","last_peered":"2023-10-07T08:47:48.286028+0000","last_clean":"2023-10-07T08:47:48.286028+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:47:48.286028+0000","last_undegraded":"2023-10-07T08:47:48.286028+0000","last_fullsized":"2023-10-07T08:47:48.286028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1099,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194213,"statfs":{"total":200000000,"available":198874402,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.497},"min":{"1min":0.34999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68000000000000005,"5min":0.751,"15min":0.751},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.501,"15min":0.48299999999999998},"min":{"1min":0.371,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66500000000000004,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.66300000000000003}]},{"osd":1,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.51600000000000001},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76300000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.81999999999999995}]},{"osd":2,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.33400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.48699999999999999},"min":{"1min":0.36699999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.69699999999999995,"15min":0.82899999999999996},"min":{"1min":0.38400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.73299999999999998,"5min":6.8570000000000002,"15min":6.8570000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.45100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72699999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.749}]},{"osd":4,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.75900000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.27800000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.747,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54200000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.498,"15min":0.50900000000000001},"min":{"1min":0.30199999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.499},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80800000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.47699999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58099999999999996,"15min":0.59599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78200000000000003,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47999999999999998,"15min":0.46800000000000003},"min":{"1min":0.33300000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73999999999999999,"5min":0.745,"15min":0.745},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.48799999999999999,"15min":0.48599999999999999},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.56699999999999995}]},{"osd":1,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54000000000000004,"15min":0.52700000000000002},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.41499999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.70699999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.502,"15min":0.47399999999999998},"min":{"1min":0.375,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.621},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51500000000000001,"15min":0.51300000000000001},"min":{"1min":0.41999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66000000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.53100000000000003},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.80300000000000005,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.32100000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67200000000000004,"5min":0.748,"15min":0.748},"last":0.44800000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.52200000000000002},"min":{"1min":0.37,"5min":0.312,"15min":0.312},"max":{"1min":0.71599999999999997,"5min":0.754,"15min":0.754},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":1.052,"15min":1.052},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34599999999999997,"15min":0.312},"min":{"1min":0.22500000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.56699999999999995,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.25},{"interface":"front","average":{"1min":0.371,"5min":0.35499999999999998,"15min":0.32800000000000001},"min":{"1min":0.22500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.29799999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.318},"min":{"1min":0.26200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70399999999999996,"5min":1.639,"15min":1.639},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.38800000000000001,"15min":0.33200000000000002},"min":{"1min":0.28699999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.47399999999999998,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.28699999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40000000000000002,"15min":0.35899999999999999},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.52800000000000002,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.317},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.34799999999999998},"min":{"1min":0.28599999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.52200000000000002},"min":{"1min":0.35699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79100000000000004,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.52800000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.52600000000000002},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73099999999999998,"5min":0.87,"15min":0.87},"last":0.71999999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.58199999999999996},"min":{"1min":0.51800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79100000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.68400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1093,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194219,"statfs":{"total":200000000,"available":198880665,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.371},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.377,"15min":0.39500000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.67400000000000004,"5min":1.079,"15min":1.079},"last":0.26400000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.39100000000000001},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":1.464,"15min":1.464},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.40200000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67900000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.35299999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":1.341,"15min":1.341},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.42099999999999999,"15min":0.435},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68600000000000005,"5min":1.532,"15min":1.532},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90200000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.60999999999999999},"min":{"1min":0.36199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80100000000000005,"5min":1.51,"15min":1.51},"last":0.71499999999999997}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83299999999999996,"5min":1.25,"15min":1.25},"last":0.82299999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.92900000000000005,"5min":1.488,"15min":1.488},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":1.024,"15min":1.024},"last":0.69999999999999996}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.90300000000000002,"5min":1.288,"15min":1.288},"last":0.78400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.33400000000000002,"15min":0.34399999999999997},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.44700000000000001,"5min":1.665,"15min":1.665},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.36199999999999999},"min":{"1min":0.248,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47399999999999998,"5min":1.579,"15min":1.579},"last":0.32000000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36299999999999999,"15min":0.374},"min":{"1min":0.23699999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.52400000000000002,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.218},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.28799999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53600000000000003,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.26600000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38400000000000001,"15min":0.39000000000000001},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":1.454,"15min":1.454},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38,"15min":0.38900000000000001},"min":{"1min":0.26100000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.30199999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.75700000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.59899999999999998,"15min":0.59399999999999997},"min":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77400000000000002,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.747,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.40600000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.79700000000000004,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.36799999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72299999999999998,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.47899999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.80200000000000005,"5min":1.637,"15min":1.637},"last":0.503}]},{"osd":7,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41099999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.72899999999999998,"5min":1.49,"15min":1.49},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78600000000000003,"5min":1.375,"15min":1.375},"last":0.60199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":516,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194795,"statfs":{"total":200000000,"available":199471033,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34300000000000003,"15min":0.32700000000000001},"min":{"1min":0.22800000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.48099999999999998,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.254},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34100000000000003,"15min":0.31900000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.43099999999999999,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.376,"15min":0.35799999999999998},"min":{"1min":0.27100000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46000000000000002,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41499999999999998,"15min":0.39700000000000002},"min":{"1min":0.27400000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51400000000000001,"5min":1.885,"15min":1.885},"last":0.372}]},{"osd":2,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55000000000000004,"5min":1.274,"15min":1.274},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41299999999999998,"15min":0.39900000000000002},"min":{"1min":0.309,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.33400000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.498},"min":{"1min":0.377,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72599999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56200000000000006,"15min":0.53100000000000003},"min":{"1min":0.438,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74299999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.497},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.45400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.72099999999999997,"5min":1.851,"15min":1.851},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.55500000000000005},"min":{"1min":0.45200000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80100000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.60999999999999999,"15min":0.58399999999999996},"min":{"1min":0.47099999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.81399999999999995,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.48099999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71299999999999997,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.55200000000000005},"min":{"1min":0.439,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.504,"15min":0.48599999999999999},"min":{"1min":0.308,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69199999999999995,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52700000000000002,"15min":0.505},"min":{"1min":0.38800000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.69399999999999995,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.48899999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.497},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.70899999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.495},"min":{"1min":0.40799999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.64100000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.54300000000000004}]},{"osd":2,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53200000000000003,"15min":0.50600000000000001},"min":{"1min":0.33400000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73699999999999999,"5min":1.29,"15min":1.29},"last":0.63300000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70499999999999996,"5min":2.052,"15min":2.052},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":1.369,"15min":1.369},"last":0.70599999999999996}]},{"osd":5,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61299999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.36199999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71199999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.316,"15min":0.316},"max":{"1min":0.64000000000000001,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.745},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.67300000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.68899999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.316,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67700000000000005,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69299999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.79300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52300000000000002,"15min":0.51300000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51500000000000001,"15min":0.50700000000000001},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73899999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.55100000000000005}]},{"osd":1,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.498,"15min":0.48399999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.72299999999999998,"5min":0.748,"15min":0.748},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70099999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.56899999999999995}]},{"osd":2,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53000000000000003,"15min":0.52400000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73499999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.309,"15min":0.309},"max":{"1min":0.68100000000000005,"5min":0.754,"15min":0.754},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67700000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77600000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.72399999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.34300000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.627,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.59899999999999998},"min":{"1min":0.42599999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67300000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.754}]},{"osd":6,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52500000000000002,"15min":0.54600000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.73599999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.81599999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.40600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68899999999999995,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57099999999999995,"15min":0.59999999999999998},"min":{"1min":0.35699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72399999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64400000000000002}]}]}],"pool_statfs":[]}} 2023-10-07T08:47:55.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-10-07T08:47:55.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.298194+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T09:15:58.515103+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T08:47:55.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2023-10-07T08:47:55.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.294002+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:15:48.119099+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T08:47:55.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-10-07T08:47:55.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.295070+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T09:16:40.234974+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T08:47:55.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2023-10-07T08:47:55.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.297055+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T20:07:51.378610+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T08:47:55.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2023-10-07T08:47:55.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.295698+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:33:33.048447+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T08:47:55.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-10-07T08:47:55.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.293944+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:26:50.865656+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T08:47:55.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2023-10-07T08:47:55.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.295473+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T13:40:53.993327+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T08:47:55.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-10-07T08:47:55.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.295349+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T10:08:13.888664+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T08:47:55.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-10-07T08:47:55.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.296696+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:23:39.530542+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T08:47:55.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-10-07T08:47:55.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.293813+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T13:09:38.128184+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T08:47:55.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2023-10-07T08:47:55.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.292065+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T17:02:55.074077+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T08:47:55.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-10-07T08:47:55.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.293443+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:15:48.119099+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T08:47:55.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-10-07T08:47:55.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.292126+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:19:49.793468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T08:47:55.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2023-10-07T08:47:55.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.296717+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T17:44:28.093547+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T08:47:55.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2023-10-07T08:47:55.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.288364+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T08:48:32.815580+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-07T08:47:55.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2023-10-07T08:47:55.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.295701+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T09:14:06.585857+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T08:47:55.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2023-10-07T08:47:55.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.296786+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T13:14:03.119203+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T08:47:55.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2023-10-07T08:47:55.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.298134+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T17:25:17.744264+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T08:47:55.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2023-10-07T08:47:55.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.290131+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T09:48:20.456130+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T08:47:55.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2023-10-07T08:47:55.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.295473+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:49:06.137613+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T08:47:55.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2023-10-07T08:47:55.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.295824+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T13:56:10.032555+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T08:47:55.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2023-10-07T08:47:55.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.293650+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:20:11.981069+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T08:47:55.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-10-07T08:47:55.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.300037+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T09:14:06.585857+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T08:47:55.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2023-10-07T08:47:55.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.296104+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T12:38:48.558191+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T08:47:55.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2023-10-07T08:47:55.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.292351+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:51:39.019296+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T08:47:55.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-10-07T08:47:55.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.292929+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T12:29:43.878989+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T08:47:55.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2023-10-07T08:47:55.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.296423+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:05:29.097371+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T08:47:55.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-10-07T08:47:55.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.299702+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:12:40.971774+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T08:47:55.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2023-10-07T08:47:55.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.291376+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T12:23:35.234961+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T08:47:55.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2023-10-07T08:47:55.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.291698+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:46:52.460384+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T08:47:55.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2023-10-07T08:47:55.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.294717+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T16:13:54.005176+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T08:47:55.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-10-07T08:47:55.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.293062+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T16:12:59.316878+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T08:47:55.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-10-07T08:47:55.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.295145+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:12:40.971774+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T08:47:55.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-10-07T08:47:55.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.299328+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T16:13:54.005176+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T08:47:55.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-10-07T08:47:55.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.293821+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T14:40:14.077438+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T08:47:55.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-10-07T08:47:55.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.292464+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:23:39.530542+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T08:47:55.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2023-10-07T08:47:55.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.292363+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:04:38.566525+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T08:47:55.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-10-07T08:47:55.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.294924+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T14:32:38.753716+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T08:47:55.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-10-07T08:47:55.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.292163+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:59:50.950670+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T08:47:55.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-10-07T08:47:55.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.291333+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:03:12.608693+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-07T08:47:55.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-10-07T08:47:55.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.288321+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T19:02:06.577837+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-07T08:47:55.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-10-07T08:47:55.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.293540+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T12:09:10.710501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T08:47:55.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-10-07T08:47:55.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.288968+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T10:08:13.888664+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T08:47:55.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-10-07T08:47:55.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.294780+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T14:01:07.294592+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T08:47:55.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-10-07T08:47:55.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.289911+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:59:50.950670+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T08:47:55.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-10-07T08:47:55.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.291740+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T10:44:45.158815+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T08:47:55.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2023-10-07T08:47:55.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.291972+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T20:40:48.210053+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T08:47:55.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2023-10-07T08:47:55.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.293310+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T16:12:59.316878+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T08:47:55.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-10-07T08:47:55.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.291326+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:26:50.865656+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T08:47:55.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-10-07T08:47:55.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.295480+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:02:29.075314+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T08:47:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-10-07T08:47:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.294315+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T09:15:58.515103+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T08:47:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2023-10-07T08:47:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.294547+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T14:49:32.774690+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T08:47:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-10-07T08:47:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.294359+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T10:44:45.158815+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T08:47:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2023-10-07T08:47:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.294528+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:58:40.091484+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T08:47:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-10-07T08:47:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.295015+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:19:49.793468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T08:47:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-10-07T08:47:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.294351+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T19:39:57.537377+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T08:47:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-10-07T08:47:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.291042+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T12:09:10.710501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T08:47:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-10-07T08:47:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.293363+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:20:11.981069+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T08:47:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-10-07T08:47:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.293950+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:16:39.403571+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T08:47:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-10-07T08:47:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.295099+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:59:50.950670+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T08:47:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-10-07T08:47:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.289502+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:19:49.793468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T08:47:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-10-07T08:47:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.291037+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T19:08:59.206095+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T08:47:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-10-07T08:47:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.296034+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:16:39.403571+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T08:47:55.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2023-10-07T08:47:55.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:47:49.282221+0000', 'last_change': '2023-10-07T08:47:49.292959+0000', 'last_active': '2023-10-07T08:47:49.282221+0000', 'last_peered': '2023-10-07T08:47:49.282221+0000', 'last_clean': '2023-10-07T08:47:49.282221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:47:49.282221+0000', 'last_undegraded': '2023-10-07T08:47:49.282221+0000', 'last_fullsized': '2023-10-07T08:47:49.282221+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'last_clean_scrub_stamp': '2023-10-07T08:47:49.282221+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:29:12.705080+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T08:47:55.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-07T08:47:55.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.261+0000 7f952f07d700 1 Processor -- start 2023-10-07T08:47:55.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.261+0000 7f952f07d700 1 -- start start 2023-10-07T08:47:55.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.262+0000 7f952f07d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9528069110 0x7f95280cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:55.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.262+0000 7f952f07d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f95281438a0 0x7f95280cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.262+0000 7f952f07d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95280cb2e0 con 0x7f95281434d0 2023-10-07T08:47:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.262+0000 7f952f07d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95280d0230 con 0x7f9528069110 2023-10-07T08:47:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.262+0000 7f952f07d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95280cb5c0 con 0x7f95281438a0 2023-10-07T08:47:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.262+0000 7f952d87a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9528069110 0x7f95280cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.262+0000 7f952d87a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9528069110 0x7f95280cf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43078/0 (socket says 172.21.15.81:43078) 2023-10-07T08:47:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.262+0000 7f952d87a700 1 -- 172.21.15.81:0/3687148673 learned_addr learned my addr 172.21.15.81:0/3687148673 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.262+0000 7f952e87c700 1 --2- 172.21.15.81:0/3687148673 >> v2:172.21.15.89:3300/0 conn(0x7f95281438a0 0x7f95280cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.262+0000 7f952d87a700 1 -- 172.21.15.81:0/3687148673 >> v2:172.21.15.89:3300/0 conn(0x7f95281438a0 msgr2=0x7f95280cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.262+0000 7f952d87a700 1 --2- 172.21.15.81:0/3687148673 >> v2:172.21.15.89:3300/0 conn(0x7f95281438a0 0x7f95280cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.262+0000 7f952d87a700 1 -- 172.21.15.81:0/3687148673 >> v1:172.21.15.89:6789/0 conn(0x7f95281434d0 legacy=0x7f9528068a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.262+0000 7f952d87a700 1 -- 172.21.15.81:0/3687148673 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95280cb8a0 con 0x7f9528069110 2023-10-07T08:47:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.262+0000 7f952e87c700 1 --2- 172.21.15.81:0/3687148673 >> v2:172.21.15.89:3300/0 conn(0x7f95281438a0 0x7f95280cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.262+0000 7f952d87a700 1 --2- 172.21.15.81:0/3687148673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528069110 0x7f95280cf7b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f95280cb0d0 tx=0x7f9518009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55f25a55dc7fdb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.263+0000 7f952d079700 1 -- 172.21.15.81:0/3687148673 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951800b820 con 0x7f9528069110 2023-10-07T08:47:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.263+0000 7f952d079700 1 -- 172.21.15.81:0/3687148673 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951800b980 con 0x7f9528069110 2023-10-07T08:47:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.263+0000 7f952d079700 1 -- 172.21.15.81:0/3687148673 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951800bd20 con 0x7f9528069110 2023-10-07T08:47:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.263+0000 7f952f07d700 1 -- 172.21.15.81:0/3687148673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528069110 msgr2=0x7f95280cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.263+0000 7f952f07d700 1 --2- 172.21.15.81:0/3687148673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528069110 0x7f95280cf7b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f95280cb0d0 tx=0x7f9518009250 comp rx=0 tx=0).stop 2023-10-07T08:47:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.263+0000 7f952f07d700 1 -- 172.21.15.81:0/3687148673 shutdown_connections 2023-10-07T08:47:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.263+0000 7f952f07d700 1 --2- 172.21.15.81:0/3687148673 >> v2:172.21.15.89:3300/0 conn(0x7f95281438a0 0x7f95280cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.263+0000 7f952f07d700 1 --2- 172.21.15.81:0/3687148673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528069110 0x7f95280cf7b0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.263+0000 7f952f07d700 1 -- 172.21.15.81:0/3687148673 >> 172.21.15.81:0/3687148673 conn(0x7f95280cd610 msgr2=0x7f95280cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:55.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.263+0000 7f952f07d700 1 -- 172.21.15.81:0/3687148673 shutdown_connections 2023-10-07T08:47:55.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.263+0000 7f952f07d700 1 -- 172.21.15.81:0/3687148673 wait complete. 2023-10-07T08:47:55.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.264+0000 7f952f07d700 1 Processor -- start 2023-10-07T08:47:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.264+0000 7f952f07d700 1 -- start start 2023-10-07T08:47:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952f07d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528069110 0x7f95280afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952f07d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95281434d0 0x7f952813b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952f07d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95281438a0 0x7f95280b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952f07d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952816a850 con 0x7f9528069110 2023-10-07T08:47:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952f07d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95280b4a10 con 0x7f95281434d0 2023-10-07T08:47:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952f07d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95280b3e00 con 0x7f95281438a0 2023-10-07T08:47:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952e07b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528069110 0x7f95280afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952e07b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528069110 0x7f95280afef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43086/0 (socket says 172.21.15.81:43086) 2023-10-07T08:47:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952e07b700 1 -- 172.21.15.81:0/4195042867 learned_addr learned my addr 172.21.15.81:0/4195042867 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952d87a700 1 --2- 172.21.15.81:0/4195042867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95281434d0 0x7f952813b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952e87c700 1 --2- 172.21.15.81:0/4195042867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95281438a0 0x7f95280b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952e07b700 1 -- 172.21.15.81:0/4195042867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95281438a0 msgr2=0x7f95280b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952e07b700 1 --2- 172.21.15.81:0/4195042867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95281438a0 0x7f95280b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952e07b700 1 -- 172.21.15.81:0/4195042867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95281434d0 msgr2=0x7f952813b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952e07b700 1 --2- 172.21.15.81:0/4195042867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95281434d0 0x7f952813b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952e07b700 1 -- 172.21.15.81:0/4195042867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95180094f0 con 0x7f9528069110 2023-10-07T08:47:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.265+0000 7f952e07b700 1 --2- 172.21.15.81:0/4195042867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528069110 0x7f95280afef0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f952000c980 tx=0x7f9520002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.266+0000 7f951e7fc700 1 -- 172.21.15.81:0/4195042867 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520012630 con 0x7f9528069110 2023-10-07T08:47:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.266+0000 7f951e7fc700 1 -- 172.21.15.81:0/4195042867 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95200127b0 con 0x7f9528069110 2023-10-07T08:47:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.266+0000 7f952f07d700 1 -- 172.21.15.81:0/4195042867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95280b40e0 con 0x7f9528069110 2023-10-07T08:47:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.266+0000 7f951e7fc700 1 -- 172.21.15.81:0/4195042867 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520012b70 con 0x7f9528069110 2023-10-07T08:47:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.266+0000 7f952f07d700 1 -- 172.21.15.81:0/4195042867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95280b46a0 con 0x7f9528069110 2023-10-07T08:47:55.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.267+0000 7f952f07d700 1 -- 172.21.15.81:0/4195042867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9528068330 con 0x7f9528069110 2023-10-07T08:47:55.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.267+0000 7f951e7fc700 1 -- 172.21.15.81:0/4195042867 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f952001b400 con 0x7f9528069110 2023-10-07T08:47:55.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.267+0000 7f951e7fc700 1 --2- 172.21.15.81:0/4195042867 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f950c066f30 0x7f950c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:55.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.268+0000 7f951e7fc700 1 -- 172.21.15.81:0/4195042867 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9520084980 con 0x7f9528069110 2023-10-07T08:47:55.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.268+0000 7f952d87a700 1 --2- 172.21.15.81:0/4195042867 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f950c066f30 0x7f950c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:55.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.268+0000 7f952d87a700 1 --2- 172.21.15.81:0/4195042867 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f950c066f30 0x7f950c0693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f95280cb0d0 tx=0x7f9518016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:55.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.272+0000 7f951e7fc700 1 -- 172.21.15.81:0/4195042867 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9520051b50 con 0x7f9528069110 2023-10-07T08:47:55.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.530+0000 7f952f07d700 1 -- 172.21.15.81:0/4195042867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f95280cbb80 con 0x7f9528069110 2023-10-07T08:47:55.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.531+0000 7f951e7fc700 1 -- 172.21.15.81:0/4195042867 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1449 (secure 0 0 0) 0x7f95200165c0 con 0x7f9528069110 2023-10-07T08:47:55.532 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:55.533 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":317,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":102,"num_osds":8,"num_up_osds":8,"osd_up_since":1696668164,"num_in_osds":8,"osd_in_since":1696668161,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":5450050,"bytes_avail":1594549950,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":50,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":6336}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-10-07T08:47:44.068054+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-07T08:47:55.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.533+0000 7f952f07d700 1 -- 172.21.15.81:0/4195042867 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f950c066f30 msgr2=0x7f950c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:55.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.533+0000 7f952f07d700 1 --2- 172.21.15.81:0/4195042867 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f950c066f30 0x7f950c0693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f95280cb0d0 tx=0x7f9518016000 comp rx=0 tx=0).stop 2023-10-07T08:47:55.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.533+0000 7f952f07d700 1 -- 172.21.15.81:0/4195042867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528069110 msgr2=0x7f95280afef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:55.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.533+0000 7f952f07d700 1 --2- 172.21.15.81:0/4195042867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528069110 0x7f95280afef0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f952000c980 tx=0x7f9520002760 comp rx=0 tx=0).stop 2023-10-07T08:47:55.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.533+0000 7f952f07d700 1 -- 172.21.15.81:0/4195042867 shutdown_connections 2023-10-07T08:47:55.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.533+0000 7f952f07d700 1 --2- 172.21.15.81:0/4195042867 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f950c066f30 0x7f950c0693e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.533+0000 7f952f07d700 1 --2- 172.21.15.81:0/4195042867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95281438a0 0x7f95280b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.533+0000 7f952f07d700 1 --2- 172.21.15.81:0/4195042867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528069110 0x7f95280afef0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.533+0000 7f952f07d700 1 --2- 172.21.15.81:0/4195042867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95281434d0 0x7f952813b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.533+0000 7f952f07d700 1 -- 172.21.15.81:0/4195042867 >> 172.21.15.81:0/4195042867 conn(0x7f95280cd610 msgr2=0x7f952813f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:55.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.533+0000 7f952f07d700 1 -- 172.21.15.81:0/4195042867 shutdown_connections 2023-10-07T08:47:55.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.533+0000 7f952f07d700 1 -- 172.21.15.81:0/4195042867 wait complete. 2023-10-07T08:47:55.537 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:47:55.539 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:47:55.546 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-07T08:47:55.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:47:55.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.699+0000 7f07a5322700 1 Processor -- start 2023-10-07T08:47:55.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.699+0000 7f07a5322700 1 -- start start 2023-10-07T08:47:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.700+0000 7f07a5322700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f07a01578d0 0x7f07a00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:55.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.700+0000 7f07a5322700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07a0157ca0 0x7f07a015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:55.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.700+0000 7f07a5322700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a00d07c0 con 0x7f07a006d120 2023-10-07T08:47:55.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.700+0000 7f07a5322700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a00cfbb0 con 0x7f07a0157ca0 2023-10-07T08:47:55.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.700+0000 7f07a5322700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a00cfe90 con 0x7f07a01578d0 2023-10-07T08:47:55.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.700+0000 7f079e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07a0157ca0 0x7f07a015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:55.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.700+0000 7f079e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07a0157ca0 0x7f07a015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43088/0 (socket says 172.21.15.81:43088) 2023-10-07T08:47:55.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.700+0000 7f079e7fc700 1 -- 172.21.15.81:0/3211779606 learned_addr learned my addr 172.21.15.81:0/3211779606 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:55.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.700+0000 7f079effd700 1 --2- 172.21.15.81:0/3211779606 >> v2:172.21.15.89:3300/0 conn(0x7f07a01578d0 0x7f07a00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:55.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.700+0000 7f079e7fc700 1 -- 172.21.15.81:0/3211779606 >> v2:172.21.15.89:3300/0 conn(0x7f07a01578d0 msgr2=0x7f07a00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:55.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.700+0000 7f079e7fc700 1 --2- 172.21.15.81:0/3211779606 >> v2:172.21.15.89:3300/0 conn(0x7f07a01578d0 0x7f07a00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.700+0000 7f079e7fc700 1 -- 172.21.15.81:0/3211779606 >> v1:172.21.15.89:6789/0 conn(0x7f07a006d120 legacy=0x7f07a006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:55.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.700+0000 7f079e7fc700 1 -- 172.21.15.81:0/3211779606 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a00d0170 con 0x7f07a0157ca0 2023-10-07T08:47:55.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.700+0000 7f079e7fc700 1 --2- 172.21.15.81:0/3211779606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a0157ca0 0x7f07a015af00 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f07a00646b0 tx=0x7f0788009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7477b6e16d320165 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:55.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.701+0000 7f079dffb700 1 -- 172.21.15.81:0/3211779606 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078800b820 con 0x7f07a0157ca0 2023-10-07T08:47:55.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.701+0000 7f079dffb700 1 -- 172.21.15.81:0/3211779606 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078800b980 con 0x7f07a0157ca0 2023-10-07T08:47:55.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.701+0000 7f079dffb700 1 -- 172.21.15.81:0/3211779606 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078800bd20 con 0x7f07a0157ca0 2023-10-07T08:47:55.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.701+0000 7f07a5322700 1 -- 172.21.15.81:0/3211779606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a0157ca0 msgr2=0x7f07a015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:55.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.701+0000 7f07a5322700 1 --2- 172.21.15.81:0/3211779606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a0157ca0 0x7f07a015af00 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f07a00646b0 tx=0x7f0788009250 comp rx=0 tx=0).stop 2023-10-07T08:47:55.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.701+0000 7f07a5322700 1 -- 172.21.15.81:0/3211779606 shutdown_connections 2023-10-07T08:47:55.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.701+0000 7f07a5322700 1 --2- 172.21.15.81:0/3211779606 >> v2:172.21.15.89:3300/0 conn(0x7f07a01578d0 0x7f07a00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.701+0000 7f07a5322700 1 --2- 172.21.15.81:0/3211779606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a0157ca0 0x7f07a015af00 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.701+0000 7f07a5322700 1 -- 172.21.15.81:0/3211779606 >> 172.21.15.81:0/3211779606 conn(0x7f07a006bb90 msgr2=0x7f07a006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:55.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.701+0000 7f07a5322700 1 -- 172.21.15.81:0/3211779606 shutdown_connections 2023-10-07T08:47:55.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.701+0000 7f07a5322700 1 -- 172.21.15.81:0/3211779606 wait complete. 2023-10-07T08:47:55.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.702+0000 7f07a5322700 1 Processor -- start 2023-10-07T08:47:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.702+0000 7f07a5322700 1 -- start start 2023-10-07T08:47:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.703+0000 7f07a5322700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07a006d120 0x7f07a00b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.703+0000 7f07a5322700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07a01578d0 0x7f07a00c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.703+0000 7f07a5322700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a0157ca0 0x7f07a0153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.703+0000 7f07a5322700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a00c8080 con 0x7f07a0157ca0 2023-10-07T08:47:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.703+0000 7f07a5322700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a00c8510 con 0x7f07a01578d0 2023-10-07T08:47:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.703+0000 7f07a5322700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a0154240 con 0x7f07a006d120 2023-10-07T08:47:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.703+0000 7f079f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a0157ca0 0x7f07a0153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.703+0000 7f079f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a0157ca0 0x7f07a0153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43090/0 (socket says 172.21.15.81:43090) 2023-10-07T08:47:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.703+0000 7f079f7fe700 1 -- 172.21.15.81:0/3724373100 learned_addr learned my addr 172.21.15.81:0/3724373100 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.703+0000 7f079e7fc700 1 --2- 172.21.15.81:0/3724373100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07a01578d0 0x7f07a00c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.703+0000 7f079effd700 1 --2- 172.21.15.81:0/3724373100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07a006d120 0x7f07a00b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.703+0000 7f079f7fe700 1 -- 172.21.15.81:0/3724373100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07a006d120 msgr2=0x7f07a00b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.703+0000 7f079f7fe700 1 --2- 172.21.15.81:0/3724373100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07a006d120 0x7f07a00b5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.703+0000 7f079f7fe700 1 -- 172.21.15.81:0/3724373100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07a01578d0 msgr2=0x7f07a00c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.703+0000 7f079f7fe700 1 --2- 172.21.15.81:0/3724373100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07a01578d0 0x7f07a00c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.704+0000 7f079f7fe700 1 -- 172.21.15.81:0/3724373100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880094f0 con 0x7f07a0157ca0 2023-10-07T08:47:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.704+0000 7f079e7fc700 1 --2- 172.21.15.81:0/3724373100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07a01578d0 0x7f07a00c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:47:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.704+0000 7f079f7fe700 1 --2- 172.21.15.81:0/3724373100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a0157ca0 0x7f07a0153d00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f079800b5e0 tx=0x7f0798009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.704+0000 7f0796ffd700 1 -- 172.21.15.81:0/3724373100 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800f510 con 0x7f07a0157ca0 2023-10-07T08:47:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.704+0000 7f0796ffd700 1 -- 172.21.15.81:0/3724373100 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079800f690 con 0x7f07a0157ca0 2023-10-07T08:47:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.704+0000 7f07a5322700 1 -- 172.21.15.81:0/3724373100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a00c7470 con 0x7f07a0157ca0 2023-10-07T08:47:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.704+0000 7f0796ffd700 1 -- 172.21.15.81:0/3724373100 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800fa50 con 0x7f07a0157ca0 2023-10-07T08:47:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.704+0000 7f07a5322700 1 -- 172.21.15.81:0/3724373100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a00c7a30 con 0x7f07a0157ca0 2023-10-07T08:47:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.705+0000 7f07a5322700 1 -- 172.21.15.81:0/3724373100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a00c81f0 con 0x7f07a0157ca0 2023-10-07T08:47:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.705+0000 7f0796ffd700 1 -- 172.21.15.81:0/3724373100 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f079801a400 con 0x7f07a0157ca0 2023-10-07T08:47:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.705+0000 7f0796ffd700 1 --2- 172.21.15.81:0/3724373100 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0780066f30 0x7f07800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.706+0000 7f0796ffd700 1 -- 172.21.15.81:0/3724373100 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0798083fa0 con 0x7f07a0157ca0 2023-10-07T08:47:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.706+0000 7f079effd700 1 --2- 172.21.15.81:0/3724373100 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0780066f30 0x7f07800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.706+0000 7f079effd700 1 --2- 172.21.15.81:0/3724373100 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0780066f30 0x7f07800693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f079000d390 tx=0x7f0790007510 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:55.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.710+0000 7f0796ffd700 1 -- 172.21.15.81:0/3724373100 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0798051290 con 0x7f07a0157ca0 2023-10-07T08:47:55.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.886+0000 7f07a5322700 1 -- 172.21.15.81:0/3724373100 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07a00d0450 con 0x7f0780066f30 2023-10-07T08:47:55.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.894+0000 7f0796ffd700 1 -- 172.21.15.81:0/3724373100 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282003 (secure 0 0 0) 0x7f07a00d0450 con 0x7f0780066f30 2023-10-07T08:47:55.898 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:55.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.897+0000 7f07a5322700 1 -- 172.21.15.81:0/3724373100 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0780066f30 msgr2=0x7f07800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.897+0000 7f07a5322700 1 --2- 172.21.15.81:0/3724373100 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0780066f30 0x7f07800693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f079000d390 tx=0x7f0790007510 comp rx=0 tx=0).stop 2023-10-07T08:47:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.897+0000 7f07a5322700 1 -- 172.21.15.81:0/3724373100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a0157ca0 msgr2=0x7f07a0153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.897+0000 7f07a5322700 1 --2- 172.21.15.81:0/3724373100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a0157ca0 0x7f07a0153d00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f079800b5e0 tx=0x7f0798009120 comp rx=0 tx=0).stop 2023-10-07T08:47:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.897+0000 7f07a5322700 1 -- 172.21.15.81:0/3724373100 shutdown_connections 2023-10-07T08:47:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.897+0000 7f07a5322700 1 --2- 172.21.15.81:0/3724373100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a0157ca0 0x7f07a0153d00 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.897+0000 7f07a5322700 1 --2- 172.21.15.81:0/3724373100 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0780066f30 0x7f07800693e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.897+0000 7f07a5322700 1 --2- 172.21.15.81:0/3724373100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07a006d120 0x7f07a00b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.897+0000 7f07a5322700 1 --2- 172.21.15.81:0/3724373100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07a01578d0 0x7f07a00c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.897+0000 7f07a5322700 1 -- 172.21.15.81:0/3724373100 >> 172.21.15.81:0/3724373100 conn(0x7f07a006bb90 msgr2=0x7f07a01567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.897+0000 7f07a5322700 1 -- 172.21.15.81:0/3724373100 shutdown_connections 2023-10-07T08:47:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:55.897+0000 7f07a5322700 1 -- 172.21.15.81:0/3724373100 wait complete. 2023-10-07T08:47:55.902 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:47:55.910 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2023-10-07T08:47:54.069795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5322,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557177,"statfs":{"total":1600000000,"available":1594549950,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.787274"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.298194+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:15:58.515103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294002+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:48.119099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295070+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:40.234974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.297055+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:07:51.378610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295698+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:33.048447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293944+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:50.865656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295473+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:40:53.993327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295349+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:13.888664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296696+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:39.530542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293813+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:09:38.128184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292065+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:02:55.074077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293443+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:48.119099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292126+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:49.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296717+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:44:28.093547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.288364+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:48:32.815580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295701+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:06.585857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296786+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:03.119203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.298134+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:25:17.744264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.290131+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:48:20.456130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295473+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:49:06.137613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295824+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:56:10.032555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293650+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:11.981069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.300037+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:14:06.585857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296104+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:38:48.558191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292351+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:51:39.019296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292929+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:43.878989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296423+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:29.097371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.299702+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:40.971774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291376+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:23:35.234961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291698+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:52.460384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294717+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:13:54.005176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293062+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:12:59.316878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295145+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:12:40.971774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.303788+0000","last_change":"2023-10-07T08:47:49.303788+0000","last_active":"2023-10-07T08:47:49.303788+0000","last_peered":"2023-10-07T08:47:49.303788+0000","last_clean":"2023-10-07T08:47:49.303788+0000","last_became_active":"2023-10-07T08:47:49.302673+0000","last_became_peered":"2023-10-07T08:47:49.302673+0000","last_unstale":"2023-10-07T08:47:49.303788+0000","last_undegraded":"2023-10-07T08:47:49.303788+0000","last_fullsized":"2023-10-07T08:47:49.303788+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:51:38.015116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.299328+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:13:54.005176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298088+0000","last_change":"2023-10-07T08:47:49.298088+0000","last_active":"2023-10-07T08:47:49.298088+0000","last_peered":"2023-10-07T08:47:49.298088+0000","last_clean":"2023-10-07T08:47:49.298088+0000","last_became_active":"2023-10-07T08:47:49.297854+0000","last_became_peered":"2023-10-07T08:47:49.297854+0000","last_unstale":"2023-10-07T08:47:49.298088+0000","last_undegraded":"2023-10-07T08:47:49.298088+0000","last_fullsized":"2023-10-07T08:47:49.298088+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:47.114919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293821+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:40:14.077438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294446+0000","last_change":"2023-10-07T08:47:49.294446+0000","last_active":"2023-10-07T08:47:49.294446+0000","last_peered":"2023-10-07T08:47:49.294446+0000","last_clean":"2023-10-07T08:47:49.294446+0000","last_became_active":"2023-10-07T08:47:49.294035+0000","last_became_peered":"2023-10-07T08:47:49.294035+0000","last_unstale":"2023-10-07T08:47:49.294446+0000","last_undegraded":"2023-10-07T08:47:49.294446+0000","last_fullsized":"2023-10-07T08:47:49.294446+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:09.706320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292464+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:39.530542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294365+0000","last_change":"2023-10-07T08:47:49.294365+0000","last_active":"2023-10-07T08:47:49.294365+0000","last_peered":"2023-10-07T08:47:49.294365+0000","last_clean":"2023-10-07T08:47:49.294365+0000","last_became_active":"2023-10-07T08:47:49.294144+0000","last_became_peered":"2023-10-07T08:47:49.294144+0000","last_unstale":"2023-10-07T08:47:49.294365+0000","last_undegraded":"2023-10-07T08:47:49.294365+0000","last_fullsized":"2023-10-07T08:47:49.294365+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:28.093191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292363+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:38.566525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.300106+0000","last_change":"2023-10-07T08:47:49.300106+0000","last_active":"2023-10-07T08:47:49.300106+0000","last_peered":"2023-10-07T08:47:49.300106+0000","last_clean":"2023-10-07T08:47:49.300106+0000","last_became_active":"2023-10-07T08:47:49.299888+0000","last_became_peered":"2023-10-07T08:47:49.299888+0000","last_unstale":"2023-10-07T08:47:49.300106+0000","last_undegraded":"2023-10-07T08:47:49.300106+0000","last_fullsized":"2023-10-07T08:47:49.300106+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:40:13.073258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294924+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:32:38.753716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298895+0000","last_change":"2023-10-07T08:47:49.298895+0000","last_active":"2023-10-07T08:47:49.298895+0000","last_peered":"2023-10-07T08:47:49.298895+0000","last_clean":"2023-10-07T08:47:49.298895+0000","last_became_active":"2023-10-07T08:47:49.298649+0000","last_became_peered":"2023-10-07T08:47:49.298649+0000","last_unstale":"2023-10-07T08:47:49.298895+0000","last_undegraded":"2023-10-07T08:47:49.298895+0000","last_fullsized":"2023-10-07T08:47:49.298895+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:12:58.312698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292163+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:59:50.950670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298815+0000","last_change":"2023-10-07T08:47:49.298815+0000","last_active":"2023-10-07T08:47:49.298815+0000","last_peered":"2023-10-07T08:47:49.298815+0000","last_clean":"2023-10-07T08:47:49.298815+0000","last_became_active":"2023-10-07T08:47:49.298575+0000","last_became_peered":"2023-10-07T08:47:49.298575+0000","last_unstale":"2023-10-07T08:47:49.298815+0000","last_undegraded":"2023-10-07T08:47:49.298815+0000","last_fullsized":"2023-10-07T08:47:49.298815+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:49.861476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291333+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:03:12.608693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.292849+0000","last_change":"2023-10-07T08:47:49.292849+0000","last_active":"2023-10-07T08:47:49.292849+0000","last_peered":"2023-10-07T08:47:49.292849+0000","last_clean":"2023-10-07T08:47:49.292849+0000","last_became_active":"2023-10-07T08:47:49.292629+0000","last_became_peered":"2023-10-07T08:47:49.292629+0000","last_unstale":"2023-10-07T08:47:49.292849+0000","last_undegraded":"2023-10-07T08:47:49.292849+0000","last_fullsized":"2023-10-07T08:47:49.292849+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:51:18.386745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.288321+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:02:06.577837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298866+0000","last_change":"2023-10-07T08:47:49.298866+0000","last_active":"2023-10-07T08:47:49.298866+0000","last_peered":"2023-10-07T08:47:49.298866+0000","last_clean":"2023-10-07T08:47:49.298866+0000","last_became_active":"2023-10-07T08:47:49.298655+0000","last_became_peered":"2023-10-07T08:47:49.298655+0000","last_unstale":"2023-10-07T08:47:49.298866+0000","last_undegraded":"2023-10-07T08:47:49.298866+0000","last_fullsized":"2023-10-07T08:47:49.298866+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:27:54.845528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293540+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:10.710501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.301545+0000","last_change":"2023-10-07T08:47:49.301545+0000","last_active":"2023-10-07T08:47:49.301545+0000","last_peered":"2023-10-07T08:47:49.301545+0000","last_clean":"2023-10-07T08:47:49.301545+0000","last_became_active":"2023-10-07T08:47:49.301182+0000","last_became_peered":"2023-10-07T08:47:49.301182+0000","last_unstale":"2023-10-07T08:47:49.301545+0000","last_undegraded":"2023-10-07T08:47:49.301545+0000","last_fullsized":"2023-10-07T08:47:49.301545+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:42:55.869359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.288968+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:13.888664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.303488+0000","last_change":"2023-10-07T08:47:49.303488+0000","last_active":"2023-10-07T08:47:49.303488+0000","last_peered":"2023-10-07T08:47:49.303488+0000","last_clean":"2023-10-07T08:47:49.303488+0000","last_became_active":"2023-10-07T08:47:49.301866+0000","last_became_peered":"2023-10-07T08:47:49.301866+0000","last_unstale":"2023-10-07T08:47:49.303488+0000","last_undegraded":"2023-10-07T08:47:49.303488+0000","last_fullsized":"2023-10-07T08:47:49.303488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:11.700899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294780+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:07.294592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.300831+0000","last_change":"2023-10-07T08:47:49.300831+0000","last_active":"2023-10-07T08:47:49.300831+0000","last_peered":"2023-10-07T08:47:49.300831+0000","last_clean":"2023-10-07T08:47:49.300831+0000","last_became_active":"2023-10-07T08:47:49.300172+0000","last_became_peered":"2023-10-07T08:47:49.300172+0000","last_unstale":"2023-10-07T08:47:49.300831+0000","last_undegraded":"2023-10-07T08:47:49.300831+0000","last_fullsized":"2023-10-07T08:47:49.300831+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:02.115023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.289911+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:59:50.950670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.297586+0000","last_change":"2023-10-07T08:47:49.297586+0000","last_active":"2023-10-07T08:47:49.297586+0000","last_peered":"2023-10-07T08:47:49.297586+0000","last_clean":"2023-10-07T08:47:49.297586+0000","last_became_active":"2023-10-07T08:47:49.297059+0000","last_became_peered":"2023-10-07T08:47:49.297059+0000","last_unstale":"2023-10-07T08:47:49.297586+0000","last_undegraded":"2023-10-07T08:47:49.297586+0000","last_fullsized":"2023-10-07T08:47:49.297586+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:28:18.348796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291740+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:45.158815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.290323+0000","last_change":"2023-10-07T08:47:49.290323+0000","last_active":"2023-10-07T08:47:49.290323+0000","last_peered":"2023-10-07T08:47:49.290323+0000","last_clean":"2023-10-07T08:47:49.290323+0000","last_became_active":"2023-10-07T08:47:49.290095+0000","last_became_peered":"2023-10-07T08:47:49.290095+0000","last_unstale":"2023-10-07T08:47:49.290323+0000","last_undegraded":"2023-10-07T08:47:49.290323+0000","last_fullsized":"2023-10-07T08:47:49.290323+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:20:32.974542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291972+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:48.210053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298146+0000","last_change":"2023-10-07T08:47:49.298146+0000","last_active":"2023-10-07T08:47:49.298146+0000","last_peered":"2023-10-07T08:47:49.298146+0000","last_clean":"2023-10-07T08:47:49.298146+0000","last_became_active":"2023-10-07T08:47:49.297916+0000","last_became_peered":"2023-10-07T08:47:49.297916+0000","last_unstale":"2023-10-07T08:47:49.298146+0000","last_undegraded":"2023-10-07T08:47:49.298146+0000","last_fullsized":"2023-10-07T08:47:49.298146+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:02:34.686983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293310+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:12:59.316878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.291174+0000","last_change":"2023-10-07T08:47:49.291174+0000","last_active":"2023-10-07T08:47:49.291174+0000","last_peered":"2023-10-07T08:47:49.291174+0000","last_clean":"2023-10-07T08:47:49.291174+0000","last_became_active":"2023-10-07T08:47:49.290936+0000","last_became_peered":"2023-10-07T08:47:49.290936+0000","last_unstale":"2023-10-07T08:47:49.291174+0000","last_undegraded":"2023-10-07T08:47:49.291174+0000","last_fullsized":"2023-10-07T08:47:49.291174+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:08:58.201915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291326+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:50.865656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.302213+0000","last_change":"2023-10-07T08:47:49.302213+0000","last_active":"2023-10-07T08:47:49.302213+0000","last_peered":"2023-10-07T08:47:49.302213+0000","last_clean":"2023-10-07T08:47:49.302213+0000","last_became_active":"2023-10-07T08:47:49.301699+0000","last_became_peered":"2023-10-07T08:47:49.301699+0000","last_unstale":"2023-10-07T08:47:49.302213+0000","last_undegraded":"2023-10-07T08:47:49.302213+0000","last_fullsized":"2023-10-07T08:47:49.302213+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:47.205873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295480+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:02:29.075314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294295+0000","last_change":"2023-10-07T08:47:49.294295+0000","last_active":"2023-10-07T08:47:49.294295+0000","last_peered":"2023-10-07T08:47:49.294295+0000","last_clean":"2023-10-07T08:47:49.294295+0000","last_became_active":"2023-10-07T08:47:49.293705+0000","last_became_peered":"2023-10-07T08:47:49.293705+0000","last_unstale":"2023-10-07T08:47:49.294295+0000","last_undegraded":"2023-10-07T08:47:49.294295+0000","last_fullsized":"2023-10-07T08:47:49.294295+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:32.044267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294315+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:15:58.515103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.296520+0000","last_change":"2023-10-07T08:47:49.296520+0000","last_active":"2023-10-07T08:47:49.296520+0000","last_peered":"2023-10-07T08:47:49.296520+0000","last_clean":"2023-10-07T08:47:49.296520+0000","last_became_active":"2023-10-07T08:47:49.296297+0000","last_became_peered":"2023-10-07T08:47:49.296297+0000","last_unstale":"2023-10-07T08:47:49.296520+0000","last_undegraded":"2023-10-07T08:47:49.296520+0000","last_fullsized":"2023-10-07T08:47:49.296520+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:02:34.686983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294547+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:49:32.774690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.293143+0000","last_change":"2023-10-07T08:47:49.293143+0000","last_active":"2023-10-07T08:47:49.293143+0000","last_peered":"2023-10-07T08:47:49.293143+0000","last_clean":"2023-10-07T08:47:49.293143+0000","last_became_active":"2023-10-07T08:47:49.292921+0000","last_became_peered":"2023-10-07T08:47:49.292921+0000","last_unstale":"2023-10-07T08:47:49.293143+0000","last_undegraded":"2023-10-07T08:47:49.293143+0000","last_fullsized":"2023-10-07T08:47:49.293143+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:38.526362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294359+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:45.158815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.293954+0000","last_change":"2023-10-07T08:47:49.293954+0000","last_active":"2023-10-07T08:47:49.293954+0000","last_peered":"2023-10-07T08:47:49.293954+0000","last_clean":"2023-10-07T08:47:49.293954+0000","last_became_active":"2023-10-07T08:47:49.293733+0000","last_became_peered":"2023-10-07T08:47:49.293733+0000","last_unstale":"2023-10-07T08:47:49.293954+0000","last_undegraded":"2023-10-07T08:47:49.293954+0000","last_fullsized":"2023-10-07T08:47:49.293954+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.117157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294528+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:58:40.091484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.301153+0000","last_change":"2023-10-07T08:47:49.301153+0000","last_active":"2023-10-07T08:47:49.301153+0000","last_peered":"2023-10-07T08:47:49.301153+0000","last_clean":"2023-10-07T08:47:49.301153+0000","last_became_active":"2023-10-07T08:47:49.300932+0000","last_became_peered":"2023-10-07T08:47:49.300932+0000","last_unstale":"2023-10-07T08:47:49.301153+0000","last_undegraded":"2023-10-07T08:47:49.301153+0000","last_fullsized":"2023-10-07T08:47:49.301153+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:28:51.667344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295015+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:49.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.295423+0000","last_change":"2023-10-07T08:47:49.295423+0000","last_active":"2023-10-07T08:47:49.295423+0000","last_peered":"2023-10-07T08:47:49.295423+0000","last_clean":"2023-10-07T08:47:49.295423+0000","last_became_active":"2023-10-07T08:47:49.295149+0000","last_became_peered":"2023-10-07T08:47:49.295149+0000","last_unstale":"2023-10-07T08:47:49.295423+0000","last_undegraded":"2023-10-07T08:47:49.295423+0000","last_fullsized":"2023-10-07T08:47:49.295423+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:42.874808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.294351+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:39:57.537377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294640+0000","last_change":"2023-10-07T08:47:49.294640+0000","last_active":"2023-10-07T08:47:49.294640+0000","last_peered":"2023-10-07T08:47:49.294640+0000","last_clean":"2023-10-07T08:47:49.294640+0000","last_became_active":"2023-10-07T08:47:49.294244+0000","last_became_peered":"2023-10-07T08:47:49.294244+0000","last_unstale":"2023-10-07T08:47:49.294640+0000","last_undegraded":"2023-10-07T08:47:49.294640+0000","last_fullsized":"2023-10-07T08:47:49.294640+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:39:10.789555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291042+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:10.710501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.296619+0000","last_change":"2023-10-07T08:47:49.296619+0000","last_active":"2023-10-07T08:47:49.296619+0000","last_peered":"2023-10-07T08:47:49.296619+0000","last_clean":"2023-10-07T08:47:49.296619+0000","last_became_active":"2023-10-07T08:47:49.296120+0000","last_became_peered":"2023-10-07T08:47:49.296120+0000","last_unstale":"2023-10-07T08:47:49.296619+0000","last_undegraded":"2023-10-07T08:47:49.296619+0000","last_fullsized":"2023-10-07T08:47:49.296619+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:42:22.643545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293363+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:11.981069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.298676+0000","last_change":"2023-10-07T08:47:49.298676+0000","last_active":"2023-10-07T08:47:49.298676+0000","last_peered":"2023-10-07T08:47:49.298676+0000","last_clean":"2023-10-07T08:47:49.298676+0000","last_became_active":"2023-10-07T08:47:49.298453+0000","last_became_peered":"2023-10-07T08:47:49.298453+0000","last_unstale":"2023-10-07T08:47:49.298676+0000","last_undegraded":"2023-10-07T08:47:49.298676+0000","last_fullsized":"2023-10-07T08:47:49.298676+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:37.562344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.293950+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:16:39.403571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.294015+0000","last_change":"2023-10-07T08:47:49.294015+0000","last_active":"2023-10-07T08:47:49.294015+0000","last_peered":"2023-10-07T08:47:49.294015+0000","last_clean":"2023-10-07T08:47:49.294015+0000","last_became_active":"2023-10-07T08:47:49.292830+0000","last_became_peered":"2023-10-07T08:47:49.292830+0000","last_unstale":"2023-10-07T08:47:49.294015+0000","last_undegraded":"2023-10-07T08:47:49.294015+0000","last_fullsized":"2023-10-07T08:47:49.294015+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:51.456204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.295099+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:59:50.950670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.297510+0000","last_change":"2023-10-07T08:47:49.297510+0000","last_active":"2023-10-07T08:47:49.297510+0000","last_peered":"2023-10-07T08:47:49.297510+0000","last_clean":"2023-10-07T08:47:49.297510+0000","last_became_active":"2023-10-07T08:47:49.297276+0000","last_became_peered":"2023-10-07T08:47:49.297276+0000","last_unstale":"2023-10-07T08:47:49.297510+0000","last_undegraded":"2023-10-07T08:47:49.297510+0000","last_fullsized":"2023-10-07T08:47:49.297510+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:02.115023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.289502+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:49.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.299182+0000","last_change":"2023-10-07T08:47:49.299182+0000","last_active":"2023-10-07T08:47:49.299182+0000","last_peered":"2023-10-07T08:47:49.299182+0000","last_clean":"2023-10-07T08:47:49.299182+0000","last_became_active":"2023-10-07T08:47:49.298742+0000","last_became_peered":"2023-10-07T08:47:49.298742+0000","last_unstale":"2023-10-07T08:47:49.299182+0000","last_undegraded":"2023-10-07T08:47:49.299182+0000","last_fullsized":"2023-10-07T08:47:49.299182+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:10.976889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.291037+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:08:59.206095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.303627+0000","last_change":"2023-10-07T08:47:49.303627+0000","last_active":"2023-10-07T08:47:49.303627+0000","last_peered":"2023-10-07T08:47:49.303627+0000","last_clean":"2023-10-07T08:47:49.303627+0000","last_became_active":"2023-10-07T08:47:49.302365+0000","last_became_peered":"2023-10-07T08:47:49.302365+0000","last_unstale":"2023-10-07T08:47:49.303627+0000","last_undegraded":"2023-10-07T08:47:49.303627+0000","last_fullsized":"2023-10-07T08:47:49.303627+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:02:54.069896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.296034+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:16:39.403571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.304623+0000","last_change":"2023-10-07T08:47:49.304623+0000","last_active":"2023-10-07T08:47:49.304623+0000","last_peered":"2023-10-07T08:47:49.304623+0000","last_clean":"2023-10-07T08:47:49.304623+0000","last_became_active":"2023-10-07T08:47:49.304380+0000","last_became_peered":"2023-10-07T08:47:49.304380+0000","last_unstale":"2023-10-07T08:47:49.304623+0000","last_undegraded":"2023-10-07T08:47:49.304623+0000","last_fullsized":"2023-10-07T08:47:49.304623+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:09:37.124003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:47:49.282221+0000","last_change":"2023-10-07T08:47:49.292959+0000","last_active":"2023-10-07T08:47:49.282221+0000","last_peered":"2023-10-07T08:47:49.282221+0000","last_clean":"2023-10-07T08:47:49.282221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:47:49.282221+0000","last_undegraded":"2023-10-07T08:47:49.282221+0000","last_fullsized":"2023-10-07T08:47:49.282221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:12.705080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-07T08:47:49.295864+0000","last_change":"2023-10-07T08:47:49.295864+0000","last_active":"2023-10-07T08:47:49.295864+0000","last_peered":"2023-10-07T08:47:49.295864+0000","last_clean":"2023-10-07T08:47:49.295864+0000","last_became_active":"2023-10-07T08:47:49.293237+0000","last_became_peered":"2023-10-07T08:47:49.293237+0000","last_unstale":"2023-10-07T08:47:49.295864+0000","last_undegraded":"2023-10-07T08:47:49.295864+0000","last_fullsized":"2023-10-07T08:47:49.295864+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:02.115023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":229,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-07T08:47:48.286028+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:47:48.286028+0000","last_peered":"2023-10-07T08:47:48.286028+0000","last_clean":"2023-10-07T08:47:48.286028+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:47:48.286028+0000","last_undegraded":"2023-10-07T08:47:48.286028+0000","last_fullsized":"2023-10-07T08:47:48.286028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1099,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194213,"statfs":{"total":200000000,"available":198874402,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.497},"min":{"1min":0.34999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68000000000000005,"5min":0.751,"15min":0.751},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.501,"15min":0.48299999999999998},"min":{"1min":0.371,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66500000000000004,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.66300000000000003}]},{"osd":1,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.51600000000000001},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76300000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.81999999999999995}]},{"osd":2,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.33400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50700000000000001,"15min":0.48699999999999999},"min":{"1min":0.36699999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.69699999999999995,"15min":0.82899999999999996},"min":{"1min":0.38400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.73299999999999998,"5min":6.8570000000000002,"15min":6.8570000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.45100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72699999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.749}]},{"osd":4,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.75900000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51800000000000002,"15min":0.53800000000000003},"min":{"1min":0.27800000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.747,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54200000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.498,"15min":0.50900000000000001},"min":{"1min":0.30199999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.499},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80800000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.47699999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58099999999999996,"15min":0.59599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78200000000000003,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47999999999999998,"15min":0.46800000000000003},"min":{"1min":0.33300000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73999999999999999,"5min":0.745,"15min":0.745},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.48799999999999999,"15min":0.48599999999999999},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.56699999999999995}]},{"osd":1,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54000000000000004,"15min":0.52700000000000002},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.41499999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.70699999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.502,"15min":0.47399999999999998},"min":{"1min":0.375,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.621},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51500000000000001,"15min":0.51300000000000001},"min":{"1min":0.41999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66000000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.53100000000000003},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.80300000000000005,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.32100000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67200000000000004,"5min":0.748,"15min":0.748},"last":0.44800000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.52200000000000002},"min":{"1min":0.37,"5min":0.312,"15min":0.312},"max":{"1min":0.71599999999999997,"5min":0.754,"15min":0.754},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":1.052,"15min":1.052},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34599999999999997,"15min":0.312},"min":{"1min":0.22500000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.56699999999999995,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.25},{"interface":"front","average":{"1min":0.371,"5min":0.35499999999999998,"15min":0.32800000000000001},"min":{"1min":0.22500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.29799999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.318},"min":{"1min":0.26200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70399999999999996,"5min":1.639,"15min":1.639},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.38800000000000001,"15min":0.33200000000000002},"min":{"1min":0.28699999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.47399999999999998,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.28699999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40000000000000002,"15min":0.35899999999999999},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.52800000000000002,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.317},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.34799999999999998},"min":{"1min":0.28599999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.52200000000000002},"min":{"1min":0.35699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79100000000000004,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.52800000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.52600000000000002},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73099999999999998,"5min":0.87,"15min":0.87},"last":0.71999999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.58199999999999996},"min":{"1min":0.51800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79100000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.68400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1093,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194219,"statfs":{"total":200000000,"available":198880665,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.371},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.377,"15min":0.39500000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.67400000000000004,"5min":1.079,"15min":1.079},"last":0.26400000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.39100000000000001},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":1.464,"15min":1.464},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.40200000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67900000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.35299999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":1.341,"15min":1.341},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.42099999999999999,"15min":0.435},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68600000000000005,"5min":1.532,"15min":1.532},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90200000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.60999999999999999},"min":{"1min":0.36199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80100000000000005,"5min":1.51,"15min":1.51},"last":0.71499999999999997}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83299999999999996,"5min":1.25,"15min":1.25},"last":0.82299999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.92900000000000005,"5min":1.488,"15min":1.488},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":1.024,"15min":1.024},"last":0.69999999999999996}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.90300000000000002,"5min":1.288,"15min":1.288},"last":0.78400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.33400000000000002,"15min":0.34399999999999997},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.44700000000000001,"5min":1.665,"15min":1.665},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.36199999999999999},"min":{"1min":0.248,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47399999999999998,"5min":1.579,"15min":1.579},"last":0.32000000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36299999999999999,"15min":0.374},"min":{"1min":0.23699999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.52400000000000002,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.218},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.28799999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53600000000000003,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.26600000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38400000000000001,"15min":0.39000000000000001},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":1.454,"15min":1.454},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38,"15min":0.38900000000000001},"min":{"1min":0.26100000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.30199999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.75700000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.59899999999999998,"15min":0.59399999999999997},"min":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77400000000000002,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.747,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.40600000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.79700000000000004,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.36799999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72299999999999998,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.47899999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.80200000000000005,"5min":1.637,"15min":1.637},"last":0.503}]},{"osd":7,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41099999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.72899999999999998,"5min":1.49,"15min":1.49},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78600000000000003,"5min":1.375,"15min":1.375},"last":0.60199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":516,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194795,"statfs":{"total":200000000,"available":199471033,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34300000000000003,"15min":0.32700000000000001},"min":{"1min":0.22800000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.48099999999999998,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.254},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34100000000000003,"15min":0.31900000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.43099999999999999,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.376,"15min":0.35799999999999998},"min":{"1min":0.27100000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46000000000000002,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41499999999999998,"15min":0.39700000000000002},"min":{"1min":0.27400000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51400000000000001,"5min":1.885,"15min":1.885},"last":0.372}]},{"osd":2,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.38},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55000000000000004,"5min":1.274,"15min":1.274},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41299999999999998,"15min":0.39900000000000002},"min":{"1min":0.309,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.33400000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.498},"min":{"1min":0.377,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72599999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56200000000000006,"15min":0.53100000000000003},"min":{"1min":0.438,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74299999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.497},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.45400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.72099999999999997,"5min":1.851,"15min":1.851},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.55500000000000005},"min":{"1min":0.45200000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80100000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.60999999999999999,"15min":0.58399999999999996},"min":{"1min":0.47099999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.81399999999999995,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Oct 7 08:46:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.48099999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71299999999999997,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.55200000000000005},"min":{"1min":0.439,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.504,"15min":0.48599999999999999},"min":{"1min":0.308,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69199999999999995,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52700000000000002,"15min":0.505},"min":{"1min":0.38800000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.69399999999999995,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.48899999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.497},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.70899999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.495},"min":{"1min":0.40799999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.64100000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.54300000000000004}]},{"osd":2,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53200000000000003,"15min":0.50600000000000001},"min":{"1min":0.33400000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73699999999999999,"5min":1.29,"15min":1.29},"last":0.63300000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70499999999999996,"5min":2.052,"15min":2.052},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":1.369,"15min":1.369},"last":0.70599999999999996}]},{"osd":5,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61299999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.36199999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71199999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.316,"15min":0.316},"max":{"1min":0.64000000000000001,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.745},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.67300000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.68899999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.316,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67700000000000005,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69299999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.79300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52300000000000002,"15min":0.51300000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51500000000000001,"15min":0.50700000000000001},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73899999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.55100000000000005}]},{"osd":1,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.498,"15min":0.48399999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.72299999999999998,"5min":0.748,"15min":0.748},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70099999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.56899999999999995}]},{"osd":2,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53000000000000003,"15min":0.52400000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73499999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.309,"15min":0.309},"max":{"1min":0.68100000000000005,"5min":0.754,"15min":0.754},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67700000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77600000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.72399999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.34300000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.627,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.59899999999999998},"min":{"1min":0.42599999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67300000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.754}]},{"osd":6,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52500000000000002,"15min":0.54600000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.73599999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.81599999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.40600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68899999999999995,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57099999999999995,"15min":0.59999999999999998},"min":{"1min":0.35699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72399999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64400000000000002}]}]}],"pool_statfs":[]}} 2023-10-07T08:47:58.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:47:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.043+0000 7faeb9d1c700 1 Processor -- start 2023-10-07T08:47:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.043+0000 7faeb9d1c700 1 -- start start 2023-10-07T08:47:59.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.044+0000 7faeb9d1c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faeb406d830 0x7faeb40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.044+0000 7faeb9d1c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb40d07c0 con 0x7faeb4157ca0 2023-10-07T08:47:59.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.044+0000 7faeb9d1c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb40cfbb0 con 0x7faeb41578d0 2023-10-07T08:47:59.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.044+0000 7faeb9d1c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb40cfe90 con 0x7faeb406d830 2023-10-07T08:47:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.044+0000 7faeb3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faeb406d830 0x7faeb40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.044+0000 7faeb2ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faeb4157ca0 0x7faeb406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53714/0 (socket says 172.21.15.81:53714) 2023-10-07T08:47:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.044+0000 7faeb2ffd700 1 -- 172.21.15.81:0/1773157536 learned_addr learned my addr 172.21.15.81:0/1773157536 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.044+0000 7faeb3fff700 1 -- 172.21.15.81:0/1773157536 >> v1:172.21.15.89:6789/0 conn(0x7faeb41578d0 legacy=0x7faeb415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.044+0000 7faeb3fff700 1 -- 172.21.15.81:0/1773157536 >> v1:172.21.15.81:6789/0 conn(0x7faeb4157ca0 legacy=0x7faeb406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.044+0000 7faeb3fff700 1 -- 172.21.15.81:0/1773157536 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb40d0170 con 0x7faeb406d830 2023-10-07T08:47:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.044+0000 7faeb3fff700 1 --2- 172.21.15.81:0/1773157536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faeb406d830 0x7faeb40cf4f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7faeac009e60 tx=0x7faeac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6835ebf4b7560550 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.044+0000 7faeb27fc700 1 -- 172.21.15.81:0/1773157536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac00e070 con 0x7faeb406d830 2023-10-07T08:47:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.044+0000 7faeb27fc700 1 -- 172.21.15.81:0/1773157536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac00bbf0 con 0x7faeb406d830 2023-10-07T08:47:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.044+0000 7faeb27fc700 1 -- 172.21.15.81:0/1773157536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac012430 con 0x7faeb406d830 2023-10-07T08:47:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.045+0000 7faeb9d1c700 1 -- 172.21.15.81:0/1773157536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faeb406d830 msgr2=0x7faeb40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.045+0000 7faeb9d1c700 1 --2- 172.21.15.81:0/1773157536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faeb406d830 0x7faeb40cf4f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7faeac009e60 tx=0x7faeac009780 comp rx=0 tx=0).stop 2023-10-07T08:47:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.045+0000 7faeb9d1c700 1 -- 172.21.15.81:0/1773157536 shutdown_connections 2023-10-07T08:47:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.045+0000 7faeb9d1c700 1 --2- 172.21.15.81:0/1773157536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faeb406d830 0x7faeb40cf4f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.045+0000 7faeb9d1c700 1 -- 172.21.15.81:0/1773157536 >> 172.21.15.81:0/1773157536 conn(0x7faeb406bb90 msgr2=0x7faeb406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.045+0000 7faeb9d1c700 1 -- 172.21.15.81:0/1773157536 shutdown_connections 2023-10-07T08:47:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.045+0000 7faeb9d1c700 1 -- 172.21.15.81:0/1773157536 wait complete. 2023-10-07T08:47:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.046+0000 7faeb9d1c700 1 Processor -- start 2023-10-07T08:47:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.046+0000 7faeb9d1c700 1 -- start start 2023-10-07T08:47:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.047+0000 7faeb9d1c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faeb406d830 0x7faeb41596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.047+0000 7faeb9d1c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faeb41578d0 0x7faeb40ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.047+0000 7faeb9d1c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeb4157ca0 0x7faeb4153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.047+0000 7faeb9d1c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb40b4a90 con 0x7faeb41578d0 2023-10-07T08:47:59.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.047+0000 7faeb9d1c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb40b3ba0 con 0x7faeb406d830 2023-10-07T08:47:59.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.047+0000 7faeb9d1c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb40b3e80 con 0x7faeb4157ca0 2023-10-07T08:47:59.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.047+0000 7faeb2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faeb41578d0 0x7faeb40ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.047+0000 7faeb2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faeb41578d0 0x7faeb40ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43110/0 (socket says 172.21.15.81:43110) 2023-10-07T08:47:59.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.047+0000 7faeb2ffd700 1 -- 172.21.15.81:0/2624049645 learned_addr learned my addr 172.21.15.81:0/2624049645 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:59.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.047+0000 7faeb37fe700 1 --2- 172.21.15.81:0/2624049645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faeb406d830 0x7faeb41596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.047+0000 7faeb3fff700 1 --2- 172.21.15.81:0/2624049645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeb4157ca0 0x7faeb4153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.047+0000 7faeb2ffd700 1 -- 172.21.15.81:0/2624049645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeb4157ca0 msgr2=0x7faeb4153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:59.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.047+0000 7faeb2ffd700 1 --2- 172.21.15.81:0/2624049645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeb4157ca0 0x7faeb4153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.047+0000 7faeb2ffd700 1 -- 172.21.15.81:0/2624049645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faeb406d830 msgr2=0x7faeb41596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:59.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.047+0000 7faeb2ffd700 1 --2- 172.21.15.81:0/2624049645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faeb406d830 0x7faeb41596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.047+0000 7faeb2ffd700 1 -- 172.21.15.81:0/2624049645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac009a20 con 0x7faeb41578d0 2023-10-07T08:47:59.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.048+0000 7faeb2ffd700 1 --2- 172.21.15.81:0/2624049645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faeb41578d0 0x7faeb40ab890 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7faea800c590 tx=0x7faea8001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:59.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.048+0000 7fae9b7fe700 1 -- 172.21.15.81:0/2624049645 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8005b30 con 0x7faeb41578d0 2023-10-07T08:47:59.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.048+0000 7fae9b7fe700 1 -- 172.21.15.81:0/2624049645 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea8005cb0 con 0x7faeb41578d0 2023-10-07T08:47:59.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.048+0000 7faeb9d1c700 1 -- 172.21.15.81:0/2624049645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb40b4160 con 0x7faeb41578d0 2023-10-07T08:47:59.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.048+0000 7fae9b7fe700 1 -- 172.21.15.81:0/2624049645 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8007320 con 0x7faeb41578d0 2023-10-07T08:47:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.048+0000 7faeb9d1c700 1 -- 172.21.15.81:0/2624049645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb40b4720 con 0x7faeb41578d0 2023-10-07T08:47:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.049+0000 7faeb9d1c700 1 -- 172.21.15.81:0/2624049645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb40b48e0 con 0x7faeb41578d0 2023-10-07T08:47:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.049+0000 7fae9b7fe700 1 -- 172.21.15.81:0/2624049645 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faea801b3b0 con 0x7faeb41578d0 2023-10-07T08:47:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.049+0000 7fae9b7fe700 1 --2- 172.21.15.81:0/2624049645 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faea0066f30 0x7faea00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.049+0000 7fae9b7fe700 1 -- 172.21.15.81:0/2624049645 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faea8083880 con 0x7faeb41578d0 2023-10-07T08:47:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.050+0000 7faeb37fe700 1 --2- 172.21.15.81:0/2624049645 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faea0066f30 0x7faea00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.050+0000 7faeb37fe700 1 --2- 172.21.15.81:0/2624049645 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faea0066f30 0x7faea00693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faea4003a30 tx=0x7faea4007ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.054+0000 7fae9b7fe700 1 -- 172.21.15.81:0/2624049645 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faea8050af0 con 0x7faeb41578d0 2023-10-07T08:47:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.231+0000 7faeb9d1c700 1 -- 172.21.15.81:0/2624049645 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faeb40d0450 con 0x7faea0066f30 2023-10-07T08:47:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.239+0000 7fae9b7fe700 1 -- 172.21.15.81:0/2624049645 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285168 (secure 0 0 0) 0x7faeb40d0450 con 0x7faea0066f30 2023-10-07T08:47:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:47:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.242+0000 7faeb9d1c700 1 -- 172.21.15.81:0/2624049645 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faea0066f30 msgr2=0x7faea00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.242+0000 7faeb9d1c700 1 --2- 172.21.15.81:0/2624049645 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faea0066f30 0x7faea00693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faea4003a30 tx=0x7faea4007ea0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.242+0000 7faeb9d1c700 1 -- 172.21.15.81:0/2624049645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faeb41578d0 msgr2=0x7faeb40ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.242+0000 7faeb9d1c700 1 --2- 172.21.15.81:0/2624049645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faeb41578d0 0x7faeb40ab890 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7faea800c590 tx=0x7faea8001020 comp rx=0 tx=0).stop 2023-10-07T08:47:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.242+0000 7faeb9d1c700 1 -- 172.21.15.81:0/2624049645 shutdown_connections 2023-10-07T08:47:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.242+0000 7faeb9d1c700 1 --2- 172.21.15.81:0/2624049645 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faea0066f30 0x7faea00693e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.242+0000 7faeb9d1c700 1 --2- 172.21.15.81:0/2624049645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faeb4157ca0 0x7faeb4153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.242+0000 7faeb9d1c700 1 --2- 172.21.15.81:0/2624049645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faeb406d830 0x7faeb41596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.242+0000 7faeb9d1c700 1 --2- 172.21.15.81:0/2624049645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faeb41578d0 0x7faeb40ab890 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.243+0000 7faeb9d1c700 1 -- 172.21.15.81:0/2624049645 >> 172.21.15.81:0/2624049645 conn(0x7faeb406bb90 msgr2=0x7faeb41558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.243+0000 7faeb9d1c700 1 -- 172.21.15.81:0/2624049645 shutdown_connections 2023-10-07T08:47:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.243+0000 7faeb9d1c700 1 -- 172.21.15.81:0/2624049645 wait complete. 2023-10-07T08:47:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:47:59.256 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":250,"stamp":"2023-10-07T08:47:58.070708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5441,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557058,"statfs":{"total":1600000000,"available":1594428404,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001814"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.318010+0000","last_change":"2023-10-07T08:47:50.317958+0000","last_active":"2023-10-07T08:47:50.318010+0000","last_peered":"2023-10-07T08:47:50.318010+0000","last_clean":"2023-10-07T08:47:50.318010+0000","last_became_active":"2023-10-07T08:47:50.317709+0000","last_became_peered":"2023-10-07T08:47:50.317709+0000","last_unstale":"2023-10-07T08:47:50.318010+0000","last_undegraded":"2023-10-07T08:47:50.318010+0000","last_fullsized":"2023-10-07T08:47:50.318010+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:29.097371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.312756+0000","last_change":"2023-10-07T08:47:50.312564+0000","last_active":"2023-10-07T08:47:50.312756+0000","last_peered":"2023-10-07T08:47:50.312756+0000","last_clean":"2023-10-07T08:47:50.312756+0000","last_became_active":"2023-10-07T08:47:50.312344+0000","last_became_peered":"2023-10-07T08:47:50.312344+0000","last_unstale":"2023-10-07T08:47:50.312756+0000","last_undegraded":"2023-10-07T08:47:50.312756+0000","last_fullsized":"2023-10-07T08:47:50.312756+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:07.294592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.313930+0000","last_change":"2023-10-07T08:47:50.313467+0000","last_active":"2023-10-07T08:47:50.313930+0000","last_peered":"2023-10-07T08:47:50.313930+0000","last_clean":"2023-10-07T08:47:50.313930+0000","last_became_active":"2023-10-07T08:47:50.313216+0000","last_became_peered":"2023-10-07T08:47:50.313216+0000","last_unstale":"2023-10-07T08:47:50.313930+0000","last_undegraded":"2023-10-07T08:47:50.313930+0000","last_fullsized":"2023-10-07T08:47:50.313930+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:03:12.608693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.316706+0000","last_change":"2023-10-07T08:47:50.316642+0000","last_active":"2023-10-07T08:47:50.316706+0000","last_peered":"2023-10-07T08:47:50.316706+0000","last_clean":"2023-10-07T08:47:50.316706+0000","last_became_active":"2023-10-07T08:47:50.315933+0000","last_became_peered":"2023-10-07T08:47:50.315933+0000","last_unstale":"2023-10-07T08:47:50.316706+0000","last_undegraded":"2023-10-07T08:47:50.316706+0000","last_fullsized":"2023-10-07T08:47:50.316706+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:46:36.248820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.311895+0000","last_change":"2023-10-07T08:47:50.311813+0000","last_active":"2023-10-07T08:47:50.311895+0000","last_peered":"2023-10-07T08:47:50.311895+0000","last_clean":"2023-10-07T08:47:50.311895+0000","last_became_active":"2023-10-07T08:47:50.311591+0000","last_became_peered":"2023-10-07T08:47:50.311591+0000","last_unstale":"2023-10-07T08:47:50.311895+0000","last_undegraded":"2023-10-07T08:47:50.311895+0000","last_fullsized":"2023-10-07T08:47:50.311895+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:59:50.950670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.312858+0000","last_change":"2023-10-07T08:47:50.312796+0000","last_active":"2023-10-07T08:47:50.312858+0000","last_peered":"2023-10-07T08:47:50.312858+0000","last_clean":"2023-10-07T08:47:50.312858+0000","last_became_active":"2023-10-07T08:47:50.312308+0000","last_became_peered":"2023-10-07T08:47:50.312308+0000","last_unstale":"2023-10-07T08:47:50.312858+0000","last_undegraded":"2023-10-07T08:47:50.312858+0000","last_fullsized":"2023-10-07T08:47:50.312858+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:20:33.978722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.304328+0000","last_change":"2023-10-07T08:47:50.304262+0000","last_active":"2023-10-07T08:47:50.304328+0000","last_peered":"2023-10-07T08:47:50.304328+0000","last_clean":"2023-10-07T08:47:50.304328+0000","last_became_active":"2023-10-07T08:47:50.304044+0000","last_became_peered":"2023-10-07T08:47:50.304044+0000","last_unstale":"2023-10-07T08:47:50.304328+0000","last_undegraded":"2023-10-07T08:47:50.304328+0000","last_fullsized":"2023-10-07T08:47:50.304328+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:18:53.670919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.315598+0000","last_change":"2023-10-07T08:47:50.315527+0000","last_active":"2023-10-07T08:47:50.315598+0000","last_peered":"2023-10-07T08:47:50.315598+0000","last_clean":"2023-10-07T08:47:50.315598+0000","last_became_active":"2023-10-07T08:47:50.315243+0000","last_became_peered":"2023-10-07T08:47:50.315243+0000","last_unstale":"2023-10-07T08:47:50.315598+0000","last_undegraded":"2023-10-07T08:47:50.315598+0000","last_fullsized":"2023-10-07T08:47:50.315598+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:02:06.577837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.312739+0000","last_change":"2023-10-07T08:47:50.312656+0000","last_active":"2023-10-07T08:47:50.312739+0000","last_peered":"2023-10-07T08:47:50.312739+0000","last_clean":"2023-10-07T08:47:50.312739+0000","last_became_active":"2023-10-07T08:47:50.312400+0000","last_became_peered":"2023-10-07T08:47:50.312400+0000","last_unstale":"2023-10-07T08:47:50.312739+0000","last_undegraded":"2023-10-07T08:47:50.312739+0000","last_fullsized":"2023-10-07T08:47:50.312739+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:48:32.815580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.314425+0000","last_change":"2023-10-07T08:47:50.314182+0000","last_active":"2023-10-07T08:47:50.314425+0000","last_peered":"2023-10-07T08:47:50.314425+0000","last_clean":"2023-10-07T08:47:50.314425+0000","last_became_active":"2023-10-07T08:47:50.313945+0000","last_became_peered":"2023-10-07T08:47:50.313945+0000","last_unstale":"2023-10-07T08:47:50.314425+0000","last_undegraded":"2023-10-07T08:47:50.314425+0000","last_fullsized":"2023-10-07T08:47:50.314425+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:32:38.753716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.311397+0000","last_change":"2023-10-07T08:47:50.311287+0000","last_active":"2023-10-07T08:47:50.311397+0000","last_peered":"2023-10-07T08:47:50.311397+0000","last_clean":"2023-10-07T08:47:50.311397+0000","last_became_active":"2023-10-07T08:47:50.311067+0000","last_became_peered":"2023-10-07T08:47:50.311067+0000","last_unstale":"2023-10-07T08:47:50.311397+0000","last_undegraded":"2023-10-07T08:47:50.311397+0000","last_fullsized":"2023-10-07T08:47:50.311397+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:16:39.403571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.317912+0000","last_change":"2023-10-07T08:47:50.317856+0000","last_active":"2023-10-07T08:47:50.317912+0000","last_peered":"2023-10-07T08:47:50.317912+0000","last_clean":"2023-10-07T08:47:50.317912+0000","last_became_active":"2023-10-07T08:47:50.316407+0000","last_became_peered":"2023-10-07T08:47:50.316407+0000","last_unstale":"2023-10-07T08:47:50.317912+0000","last_undegraded":"2023-10-07T08:47:50.317912+0000","last_fullsized":"2023-10-07T08:47:50.317912+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:39:57.537377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.310544+0000","last_change":"2023-10-07T08:47:50.310480+0000","last_active":"2023-10-07T08:47:50.310544+0000","last_peered":"2023-10-07T08:47:50.310544+0000","last_clean":"2023-10-07T08:47:50.310544+0000","last_became_active":"2023-10-07T08:47:50.310233+0000","last_became_peered":"2023-10-07T08:47:50.310233+0000","last_unstale":"2023-10-07T08:47:50.310544+0000","last_undegraded":"2023-10-07T08:47:50.310544+0000","last_fullsized":"2023-10-07T08:47:50.310544+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:48:32.815580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.316478+0000","last_change":"2023-10-07T08:47:50.316343+0000","last_active":"2023-10-07T08:47:50.316478+0000","last_peered":"2023-10-07T08:47:50.316478+0000","last_clean":"2023-10-07T08:47:50.316478+0000","last_became_active":"2023-10-07T08:47:50.315443+0000","last_became_peered":"2023-10-07T08:47:50.315443+0000","last_unstale":"2023-10-07T08:47:50.316478+0000","last_undegraded":"2023-10-07T08:47:50.316478+0000","last_fullsized":"2023-10-07T08:47:50.316478+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:40:30.498580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.305675+0000","last_change":"2023-10-07T08:47:50.305633+0000","last_active":"2023-10-07T08:47:50.305675+0000","last_peered":"2023-10-07T08:47:50.305675+0000","last_clean":"2023-10-07T08:47:50.305675+0000","last_became_active":"2023-10-07T08:47:50.305507+0000","last_became_peered":"2023-10-07T08:47:50.305507+0000","last_unstale":"2023-10-07T08:47:50.305675+0000","last_undegraded":"2023-10-07T08:47:50.305675+0000","last_fullsized":"2023-10-07T08:47:50.305675+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:03:39.115573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.319228+0000","last_change":"2023-10-07T08:47:50.319088+0000","last_active":"2023-10-07T08:47:50.319228+0000","last_peered":"2023-10-07T08:47:50.319228+0000","last_clean":"2023-10-07T08:47:50.319228+0000","last_became_active":"2023-10-07T08:47:50.318118+0000","last_became_peered":"2023-10-07T08:47:50.318118+0000","last_unstale":"2023-10-07T08:47:50.319228+0000","last_undegraded":"2023-10-07T08:47:50.319228+0000","last_fullsized":"2023-10-07T08:47:50.319228+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:48:20.456130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.316713+0000","last_change":"2023-10-07T08:47:50.316578+0000","last_active":"2023-10-07T08:47:50.316713+0000","last_peered":"2023-10-07T08:47:50.316713+0000","last_clean":"2023-10-07T08:47:50.316713+0000","last_became_active":"2023-10-07T08:47:50.316238+0000","last_became_peered":"2023-10-07T08:47:50.316238+0000","last_unstale":"2023-10-07T08:47:50.316713+0000","last_undegraded":"2023-10-07T08:47:50.316713+0000","last_fullsized":"2023-10-07T08:47:50.316713+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:45.158815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.313580+0000","last_change":"2023-10-07T08:47:50.313187+0000","last_active":"2023-10-07T08:47:50.313580+0000","last_peered":"2023-10-07T08:47:50.313580+0000","last_clean":"2023-10-07T08:47:50.313580+0000","last_became_active":"2023-10-07T08:47:50.312977+0000","last_became_peered":"2023-10-07T08:47:50.312977+0000","last_unstale":"2023-10-07T08:47:50.313580+0000","last_undegraded":"2023-10-07T08:47:50.313580+0000","last_fullsized":"2023-10-07T08:47:50.313580+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:48:43.576973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.317320+0000","last_change":"2023-10-07T08:47:50.317265+0000","last_active":"2023-10-07T08:47:50.317320+0000","last_peered":"2023-10-07T08:47:50.317320+0000","last_clean":"2023-10-07T08:47:50.317320+0000","last_became_active":"2023-10-07T08:47:50.316966+0000","last_became_peered":"2023-10-07T08:47:50.316966+0000","last_unstale":"2023-10-07T08:47:50.317320+0000","last_undegraded":"2023-10-07T08:47:50.317320+0000","last_fullsized":"2023-10-07T08:47:50.317320+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:43.878989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.310610+0000","last_change":"2023-10-07T08:47:50.309665+0000","last_active":"2023-10-07T08:47:50.310610+0000","last_peered":"2023-10-07T08:47:50.310610+0000","last_clean":"2023-10-07T08:47:50.310610+0000","last_became_active":"2023-10-07T08:47:50.309428+0000","last_became_peered":"2023-10-07T08:47:50.309428+0000","last_unstale":"2023-10-07T08:47:50.310610+0000","last_undegraded":"2023-10-07T08:47:50.310610+0000","last_fullsized":"2023-10-07T08:47:50.310610+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:00:48.573487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.311480+0000","last_change":"2023-10-07T08:47:50.311403+0000","last_active":"2023-10-07T08:47:50.311480+0000","last_peered":"2023-10-07T08:47:50.311480+0000","last_clean":"2023-10-07T08:47:50.311480+0000","last_became_active":"2023-10-07T08:47:50.310967+0000","last_became_peered":"2023-10-07T08:47:50.310967+0000","last_unstale":"2023-10-07T08:47:50.311480+0000","last_undegraded":"2023-10-07T08:47:50.311480+0000","last_fullsized":"2023-10-07T08:47:50.311480+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:32:58.061710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.312265+0000","last_change":"2023-10-07T08:47:50.312081+0000","last_active":"2023-10-07T08:47:50.312265+0000","last_peered":"2023-10-07T08:47:50.312265+0000","last_clean":"2023-10-07T08:47:50.312265+0000","last_became_active":"2023-10-07T08:47:50.311797+0000","last_became_peered":"2023-10-07T08:47:50.311797+0000","last_unstale":"2023-10-07T08:47:50.312265+0000","last_undegraded":"2023-10-07T08:47:50.312265+0000","last_fullsized":"2023-10-07T08:47:50.312265+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:09:38.128184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.314511+0000","last_change":"2023-10-07T08:47:50.314443+0000","last_active":"2023-10-07T08:47:50.314511+0000","last_peered":"2023-10-07T08:47:50.314511+0000","last_clean":"2023-10-07T08:47:50.314511+0000","last_became_active":"2023-10-07T08:47:50.314206+0000","last_became_peered":"2023-10-07T08:47:50.314206+0000","last_unstale":"2023-10-07T08:47:50.314511+0000","last_undegraded":"2023-10-07T08:47:50.314511+0000","last_fullsized":"2023-10-07T08:47:50.314511+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:08:59.206095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.316198+0000","last_change":"2023-10-07T08:47:50.316140+0000","last_active":"2023-10-07T08:47:50.316198+0000","last_peered":"2023-10-07T08:47:50.316198+0000","last_clean":"2023-10-07T08:47:50.316198+0000","last_became_active":"2023-10-07T08:47:50.315152+0000","last_became_peered":"2023-10-07T08:47:50.315152+0000","last_unstale":"2023-10-07T08:47:50.316198+0000","last_undegraded":"2023-10-07T08:47:50.316198+0000","last_fullsized":"2023-10-07T08:47:50.316198+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:45:03.883846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.314217+0000","last_change":"2023-10-07T08:47:50.314151+0000","last_active":"2023-10-07T08:47:50.314217+0000","last_peered":"2023-10-07T08:47:50.314217+0000","last_clean":"2023-10-07T08:47:50.314217+0000","last_became_active":"2023-10-07T08:47:50.313762+0000","last_became_peered":"2023-10-07T08:47:50.313762+0000","last_unstale":"2023-10-07T08:47:50.314217+0000","last_undegraded":"2023-10-07T08:47:50.314217+0000","last_fullsized":"2023-10-07T08:47:50.314217+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:15:58.515103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.316500+0000","last_change":"2023-10-07T08:47:50.316433+0000","last_active":"2023-10-07T08:47:50.316500+0000","last_peered":"2023-10-07T08:47:50.316500+0000","last_clean":"2023-10-07T08:47:50.316500+0000","last_became_active":"2023-10-07T08:47:50.316005+0000","last_became_peered":"2023-10-07T08:47:50.316005+0000","last_unstale":"2023-10-07T08:47:50.316500+0000","last_undegraded":"2023-10-07T08:47:50.316500+0000","last_fullsized":"2023-10-07T08:47:50.316500+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:54:31.373053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.317296+0000","last_change":"2023-10-07T08:47:50.317232+0000","last_active":"2023-10-07T08:47:50.317296+0000","last_peered":"2023-10-07T08:47:50.317296+0000","last_clean":"2023-10-07T08:47:50.317296+0000","last_became_active":"2023-10-07T08:47:50.317010+0000","last_became_peered":"2023-10-07T08:47:50.317010+0000","last_unstale":"2023-10-07T08:47:50.317296+0000","last_undegraded":"2023-10-07T08:47:50.317296+0000","last_fullsized":"2023-10-07T08:47:50.317296+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:49.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.317659+0000","last_change":"2023-10-07T08:47:50.317229+0000","last_active":"2023-10-07T08:47:50.317659+0000","last_peered":"2023-10-07T08:47:50.317659+0000","last_clean":"2023-10-07T08:47:50.317659+0000","last_became_active":"2023-10-07T08:47:50.317006+0000","last_became_peered":"2023-10-07T08:47:50.317006+0000","last_unstale":"2023-10-07T08:47:50.317659+0000","last_undegraded":"2023-10-07T08:47:50.317659+0000","last_fullsized":"2023-10-07T08:47:50.317659+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:10.710501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.316848+0000","last_change":"2023-10-07T08:47:50.316657+0000","last_active":"2023-10-07T08:47:50.316848+0000","last_peered":"2023-10-07T08:47:50.316848+0000","last_clean":"2023-10-07T08:47:50.316848+0000","last_became_active":"2023-10-07T08:47:50.316394+0000","last_became_peered":"2023-10-07T08:47:50.316394+0000","last_unstale":"2023-10-07T08:47:50.316848+0000","last_undegraded":"2023-10-07T08:47:50.316848+0000","last_fullsized":"2023-10-07T08:47:50.316848+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:27:55.849708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.312280+0000","last_change":"2023-10-07T08:47:50.312212+0000","last_active":"2023-10-07T08:47:50.312280+0000","last_peered":"2023-10-07T08:47:50.312280+0000","last_clean":"2023-10-07T08:47:50.312280+0000","last_became_active":"2023-10-07T08:47:50.311951+0000","last_became_peered":"2023-10-07T08:47:50.311951+0000","last_unstale":"2023-10-07T08:47:50.312280+0000","last_undegraded":"2023-10-07T08:47:50.312280+0000","last_fullsized":"2023-10-07T08:47:50.312280+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:40:14.077438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.319194+0000","last_change":"2023-10-07T08:47:50.318554+0000","last_active":"2023-10-07T08:47:50.319194+0000","last_peered":"2023-10-07T08:47:50.319194+0000","last_clean":"2023-10-07T08:47:50.319194+0000","last_became_active":"2023-10-07T08:47:50.317625+0000","last_became_peered":"2023-10-07T08:47:50.317625+0000","last_unstale":"2023-10-07T08:47:50.319194+0000","last_undegraded":"2023-10-07T08:47:50.319194+0000","last_fullsized":"2023-10-07T08:47:50.319194+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:13.888664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.317836+0000","last_change":"2023-10-07T08:47:50.317712+0000","last_active":"2023-10-07T08:47:50.317836+0000","last_peered":"2023-10-07T08:47:50.317836+0000","last_clean":"2023-10-07T08:47:50.317836+0000","last_became_active":"2023-10-07T08:47:50.316086+0000","last_became_peered":"2023-10-07T08:47:50.316086+0000","last_unstale":"2023-10-07T08:47:50.317836+0000","last_undegraded":"2023-10-07T08:47:50.317836+0000","last_fullsized":"2023-10-07T08:47:50.317836+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:08:01.325659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.319212+0000","last_change":"2023-10-07T08:47:50.318951+0000","last_active":"2023-10-07T08:47:50.319212+0000","last_peered":"2023-10-07T08:47:50.319212+0000","last_clean":"2023-10-07T08:47:50.319212+0000","last_became_active":"2023-10-07T08:47:50.318755+0000","last_became_peered":"2023-10-07T08:47:50.318755+0000","last_unstale":"2023-10-07T08:47:50.319212+0000","last_undegraded":"2023-10-07T08:47:50.319212+0000","last_fullsized":"2023-10-07T08:47:50.319212+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:39.530542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"101'4","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.327552+0000","last_change":"2023-10-07T08:47:49.303788+0000","last_active":"2023-10-07T08:47:50.327552+0000","last_peered":"2023-10-07T08:47:50.327552+0000","last_clean":"2023-10-07T08:47:50.327552+0000","last_became_active":"2023-10-07T08:47:49.302673+0000","last_became_peered":"2023-10-07T08:47:49.302673+0000","last_unstale":"2023-10-07T08:47:50.327552+0000","last_undegraded":"2023-10-07T08:47:50.327552+0000","last_fullsized":"2023-10-07T08:47:50.327552+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:51:38.015116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.316160+0000","last_change":"2023-10-07T08:47:50.316095+0000","last_active":"2023-10-07T08:47:50.316160+0000","last_peered":"2023-10-07T08:47:50.316160+0000","last_clean":"2023-10-07T08:47:50.316160+0000","last_became_active":"2023-10-07T08:47:50.315827+0000","last_became_peered":"2023-10-07T08:47:50.315827+0000","last_unstale":"2023-10-07T08:47:50.316160+0000","last_undegraded":"2023-10-07T08:47:50.316160+0000","last_fullsized":"2023-10-07T08:47:50.316160+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:02:35.691164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.328304+0000","last_change":"2023-10-07T08:47:49.298088+0000","last_active":"2023-10-07T08:47:50.328304+0000","last_peered":"2023-10-07T08:47:50.328304+0000","last_clean":"2023-10-07T08:47:50.328304+0000","last_became_active":"2023-10-07T08:47:49.297854+0000","last_became_peered":"2023-10-07T08:47:49.297854+0000","last_unstale":"2023-10-07T08:47:50.328304+0000","last_undegraded":"2023-10-07T08:47:50.328304+0000","last_fullsized":"2023-10-07T08:47:50.328304+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:47.114919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.315408+0000","last_change":"2023-10-07T08:47:50.315281+0000","last_active":"2023-10-07T08:47:50.315408+0000","last_peered":"2023-10-07T08:47:50.315408+0000","last_clean":"2023-10-07T08:47:50.315408+0000","last_became_active":"2023-10-07T08:47:50.314603+0000","last_became_peered":"2023-10-07T08:47:50.314603+0000","last_unstale":"2023-10-07T08:47:50.315408+0000","last_undegraded":"2023-10-07T08:47:50.315408+0000","last_fullsized":"2023-10-07T08:47:50.315408+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:07.294592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.326624+0000","last_change":"2023-10-07T08:47:49.294446+0000","last_active":"2023-10-07T08:47:50.326624+0000","last_peered":"2023-10-07T08:47:50.326624+0000","last_clean":"2023-10-07T08:47:50.326624+0000","last_became_active":"2023-10-07T08:47:49.294035+0000","last_became_peered":"2023-10-07T08:47:49.294035+0000","last_unstale":"2023-10-07T08:47:50.326624+0000","last_undegraded":"2023-10-07T08:47:50.326624+0000","last_fullsized":"2023-10-07T08:47:50.326624+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:09.706320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.304979+0000","last_change":"2023-10-07T08:47:50.304905+0000","last_active":"2023-10-07T08:47:50.304979+0000","last_peered":"2023-10-07T08:47:50.304979+0000","last_clean":"2023-10-07T08:47:50.304979+0000","last_became_active":"2023-10-07T08:47:50.304704+0000","last_became_peered":"2023-10-07T08:47:50.304704+0000","last_unstale":"2023-10-07T08:47:50.304979+0000","last_undegraded":"2023-10-07T08:47:50.304979+0000","last_fullsized":"2023-10-07T08:47:50.304979+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:20:33.978722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.327914+0000","last_change":"2023-10-07T08:47:49.294365+0000","last_active":"2023-10-07T08:47:50.327914+0000","last_peered":"2023-10-07T08:47:50.327914+0000","last_clean":"2023-10-07T08:47:50.327914+0000","last_became_active":"2023-10-07T08:47:49.294144+0000","last_became_peered":"2023-10-07T08:47:49.294144+0000","last_unstale":"2023-10-07T08:47:50.327914+0000","last_undegraded":"2023-10-07T08:47:50.327914+0000","last_fullsized":"2023-10-07T08:47:50.327914+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:05:28.093191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.312250+0000","last_change":"2023-10-07T08:47:50.312039+0000","last_active":"2023-10-07T08:47:50.312250+0000","last_peered":"2023-10-07T08:47:50.312250+0000","last_clean":"2023-10-07T08:47:50.312250+0000","last_became_active":"2023-10-07T08:47:50.311789+0000","last_became_peered":"2023-10-07T08:47:50.311789+0000","last_unstale":"2023-10-07T08:47:50.312250+0000","last_undegraded":"2023-10-07T08:47:50.312250+0000","last_fullsized":"2023-10-07T08:47:50.312250+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:02:29.075314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.329020+0000","last_change":"2023-10-07T08:47:49.300106+0000","last_active":"2023-10-07T08:47:50.329020+0000","last_peered":"2023-10-07T08:47:50.329020+0000","last_clean":"2023-10-07T08:47:50.329020+0000","last_became_active":"2023-10-07T08:47:49.299888+0000","last_became_peered":"2023-10-07T08:47:49.299888+0000","last_unstale":"2023-10-07T08:47:50.329020+0000","last_undegraded":"2023-10-07T08:47:50.329020+0000","last_fullsized":"2023-10-07T08:47:50.329020+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:40:13.073258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.316502+0000","last_change":"2023-10-07T08:47:50.316439+0000","last_active":"2023-10-07T08:47:50.316502+0000","last_peered":"2023-10-07T08:47:50.316502+0000","last_clean":"2023-10-07T08:47:50.316502+0000","last_became_active":"2023-10-07T08:47:50.315939+0000","last_became_peered":"2023-10-07T08:47:50.315939+0000","last_unstale":"2023-10-07T08:47:50.316502+0000","last_undegraded":"2023-10-07T08:47:50.316502+0000","last_fullsized":"2023-10-07T08:47:50.316502+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:50.865656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.327310+0000","last_change":"2023-10-07T08:47:49.298895+0000","last_active":"2023-10-07T08:47:50.327310+0000","last_peered":"2023-10-07T08:47:50.327310+0000","last_clean":"2023-10-07T08:47:50.327310+0000","last_became_active":"2023-10-07T08:47:49.298649+0000","last_became_peered":"2023-10-07T08:47:49.298649+0000","last_unstale":"2023-10-07T08:47:50.327310+0000","last_undegraded":"2023-10-07T08:47:50.327310+0000","last_fullsized":"2023-10-07T08:47:50.327310+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:12:58.312698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.310787+0000","last_change":"2023-10-07T08:47:50.310678+0000","last_active":"2023-10-07T08:47:50.310787+0000","last_peered":"2023-10-07T08:47:50.310787+0000","last_clean":"2023-10-07T08:47:50.310787+0000","last_became_active":"2023-10-07T08:47:50.310081+0000","last_became_peered":"2023-10-07T08:47:50.310081+0000","last_unstale":"2023-10-07T08:47:50.310787+0000","last_undegraded":"2023-10-07T08:47:50.310787+0000","last_fullsized":"2023-10-07T08:47:50.310787+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:03:39.115573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.307741+0000","last_change":"2023-10-07T08:47:49.298815+0000","last_active":"2023-10-07T08:47:50.307741+0000","last_peered":"2023-10-07T08:47:50.307741+0000","last_clean":"2023-10-07T08:47:50.307741+0000","last_became_active":"2023-10-07T08:47:49.298575+0000","last_became_peered":"2023-10-07T08:47:49.298575+0000","last_unstale":"2023-10-07T08:47:50.307741+0000","last_undegraded":"2023-10-07T08:47:50.307741+0000","last_fullsized":"2023-10-07T08:47:50.307741+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:49.861476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.305708+0000","last_change":"2023-10-07T08:47:50.305673+0000","last_active":"2023-10-07T08:47:50.305708+0000","last_peered":"2023-10-07T08:47:50.305708+0000","last_clean":"2023-10-07T08:47:50.305708+0000","last_became_active":"2023-10-07T08:47:50.305528+0000","last_became_peered":"2023-10-07T08:47:50.305528+0000","last_unstale":"2023-10-07T08:47:50.305708+0000","last_undegraded":"2023-10-07T08:47:50.305708+0000","last_fullsized":"2023-10-07T08:47:50.305708+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:29.236923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.308044+0000","last_change":"2023-10-07T08:47:49.292849+0000","last_active":"2023-10-07T08:47:50.308044+0000","last_peered":"2023-10-07T08:47:50.308044+0000","last_clean":"2023-10-07T08:47:50.308044+0000","last_became_active":"2023-10-07T08:47:49.292629+0000","last_became_peered":"2023-10-07T08:47:49.292629+0000","last_unstale":"2023-10-07T08:47:50.308044+0000","last_undegraded":"2023-10-07T08:47:50.308044+0000","last_fullsized":"2023-10-07T08:47:50.308044+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:51:18.386745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.314927+0000","last_change":"2023-10-07T08:47:50.314860+0000","last_active":"2023-10-07T08:47:50.314927+0000","last_peered":"2023-10-07T08:47:50.314927+0000","last_clean":"2023-10-07T08:47:50.314927+0000","last_became_active":"2023-10-07T08:47:50.314211+0000","last_became_peered":"2023-10-07T08:47:50.314211+0000","last_unstale":"2023-10-07T08:47:50.314927+0000","last_undegraded":"2023-10-07T08:47:50.314927+0000","last_fullsized":"2023-10-07T08:47:50.314927+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:54:31.373053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.309688+0000","last_change":"2023-10-07T08:47:49.298866+0000","last_active":"2023-10-07T08:47:50.309688+0000","last_peered":"2023-10-07T08:47:50.309688+0000","last_clean":"2023-10-07T08:47:50.309688+0000","last_became_active":"2023-10-07T08:47:49.298655+0000","last_became_peered":"2023-10-07T08:47:49.298655+0000","last_unstale":"2023-10-07T08:47:50.309688+0000","last_undegraded":"2023-10-07T08:47:50.309688+0000","last_fullsized":"2023-10-07T08:47:50.309688+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:27:54.845528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.312756+0000","last_change":"2023-10-07T08:47:50.312660+0000","last_active":"2023-10-07T08:47:50.312756+0000","last_peered":"2023-10-07T08:47:50.312756+0000","last_clean":"2023-10-07T08:47:50.312756+0000","last_became_active":"2023-10-07T08:47:50.311976+0000","last_became_peered":"2023-10-07T08:47:50.311976+0000","last_unstale":"2023-10-07T08:47:50.312756+0000","last_undegraded":"2023-10-07T08:47:50.312756+0000","last_fullsized":"2023-10-07T08:47:50.312756+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:43.878989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.308314+0000","last_change":"2023-10-07T08:47:49.301545+0000","last_active":"2023-10-07T08:47:50.308314+0000","last_peered":"2023-10-07T08:47:50.308314+0000","last_clean":"2023-10-07T08:47:50.308314+0000","last_became_active":"2023-10-07T08:47:49.301182+0000","last_became_peered":"2023-10-07T08:47:49.301182+0000","last_unstale":"2023-10-07T08:47:50.308314+0000","last_undegraded":"2023-10-07T08:47:50.308314+0000","last_fullsized":"2023-10-07T08:47:50.308314+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:42:55.869359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.314942+0000","last_change":"2023-10-07T08:47:50.314884+0000","last_active":"2023-10-07T08:47:50.314942+0000","last_peered":"2023-10-07T08:47:50.314942+0000","last_clean":"2023-10-07T08:47:50.314942+0000","last_became_active":"2023-10-07T08:47:50.314661+0000","last_became_peered":"2023-10-07T08:47:50.314661+0000","last_unstale":"2023-10-07T08:47:50.314942+0000","last_undegraded":"2023-10-07T08:47:50.314942+0000","last_fullsized":"2023-10-07T08:47:50.314942+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:39.530542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"101'3","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.328210+0000","last_change":"2023-10-07T08:47:49.303488+0000","last_active":"2023-10-07T08:47:50.328210+0000","last_peered":"2023-10-07T08:47:50.328210+0000","last_clean":"2023-10-07T08:47:50.328210+0000","last_became_active":"2023-10-07T08:47:49.301866+0000","last_became_peered":"2023-10-07T08:47:49.301866+0000","last_unstale":"2023-10-07T08:47:50.328210+0000","last_undegraded":"2023-10-07T08:47:50.328210+0000","last_fullsized":"2023-10-07T08:47:50.328210+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:11.700899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.314555+0000","last_change":"2023-10-07T08:47:50.314294+0000","last_active":"2023-10-07T08:47:50.314555+0000","last_peered":"2023-10-07T08:47:50.314555+0000","last_clean":"2023-10-07T08:47:50.314555+0000","last_became_active":"2023-10-07T08:47:50.314076+0000","last_became_peered":"2023-10-07T08:47:50.314076+0000","last_unstale":"2023-10-07T08:47:50.314555+0000","last_undegraded":"2023-10-07T08:47:50.314555+0000","last_fullsized":"2023-10-07T08:47:50.314555+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:09:10.710501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"101'6","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.329850+0000","last_change":"2023-10-07T08:47:49.300831+0000","last_active":"2023-10-07T08:47:50.329850+0000","last_peered":"2023-10-07T08:47:50.329850+0000","last_clean":"2023-10-07T08:47:50.329850+0000","last_became_active":"2023-10-07T08:47:49.300172+0000","last_became_peered":"2023-10-07T08:47:49.300172+0000","last_unstale":"2023-10-07T08:47:50.329850+0000","last_undegraded":"2023-10-07T08:47:50.329850+0000","last_fullsized":"2023-10-07T08:47:50.329850+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:02.115023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.315172+0000","last_change":"2023-10-07T08:47:50.315114+0000","last_active":"2023-10-07T08:47:50.315172+0000","last_peered":"2023-10-07T08:47:50.315172+0000","last_clean":"2023-10-07T08:47:50.315172+0000","last_became_active":"2023-10-07T08:47:50.314034+0000","last_became_peered":"2023-10-07T08:47:50.314034+0000","last_unstale":"2023-10-07T08:47:50.315172+0000","last_undegraded":"2023-10-07T08:47:50.315172+0000","last_fullsized":"2023-10-07T08:47:50.315172+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:20:33.978722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.327114+0000","last_change":"2023-10-07T08:47:49.297586+0000","last_active":"2023-10-07T08:47:50.327114+0000","last_peered":"2023-10-07T08:47:50.327114+0000","last_clean":"2023-10-07T08:47:50.327114+0000","last_became_active":"2023-10-07T08:47:49.297059+0000","last_became_peered":"2023-10-07T08:47:49.297059+0000","last_unstale":"2023-10-07T08:47:50.327114+0000","last_undegraded":"2023-10-07T08:47:50.327114+0000","last_fullsized":"2023-10-07T08:47:50.327114+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:28:18.348796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.310625+0000","last_change":"2023-10-07T08:47:50.310569+0000","last_active":"2023-10-07T08:47:50.310625+0000","last_peered":"2023-10-07T08:47:50.310625+0000","last_clean":"2023-10-07T08:47:50.310625+0000","last_became_active":"2023-10-07T08:47:50.309758+0000","last_became_peered":"2023-10-07T08:47:50.309758+0000","last_unstale":"2023-10-07T08:47:50.310625+0000","last_undegraded":"2023-10-07T08:47:50.310625+0000","last_fullsized":"2023-10-07T08:47:50.310625+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:02:06.577837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.304616+0000","last_change":"2023-10-07T08:47:49.290323+0000","last_active":"2023-10-07T08:47:50.304616+0000","last_peered":"2023-10-07T08:47:50.304616+0000","last_clean":"2023-10-07T08:47:50.304616+0000","last_became_active":"2023-10-07T08:47:49.290095+0000","last_became_peered":"2023-10-07T08:47:49.290095+0000","last_unstale":"2023-10-07T08:47:50.304616+0000","last_undegraded":"2023-10-07T08:47:50.304616+0000","last_fullsized":"2023-10-07T08:47:50.304616+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:20:32.974542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.311365+0000","last_change":"2023-10-07T08:47:50.310315+0000","last_active":"2023-10-07T08:47:50.311365+0000","last_peered":"2023-10-07T08:47:50.311365+0000","last_clean":"2023-10-07T08:47:50.311365+0000","last_became_active":"2023-10-07T08:47:50.310068+0000","last_became_peered":"2023-10-07T08:47:50.310068+0000","last_unstale":"2023-10-07T08:47:50.311365+0000","last_undegraded":"2023-10-07T08:47:50.311365+0000","last_fullsized":"2023-10-07T08:47:50.311365+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:44:43.730421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.309958+0000","last_change":"2023-10-07T08:47:49.298146+0000","last_active":"2023-10-07T08:47:50.309958+0000","last_peered":"2023-10-07T08:47:50.309958+0000","last_clean":"2023-10-07T08:47:50.309958+0000","last_became_active":"2023-10-07T08:47:49.297916+0000","last_became_peered":"2023-10-07T08:47:49.297916+0000","last_unstale":"2023-10-07T08:47:50.309958+0000","last_undegraded":"2023-10-07T08:47:50.309958+0000","last_fullsized":"2023-10-07T08:47:50.309958+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:02:34.686983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.312232+0000","last_change":"2023-10-07T08:47:50.311559+0000","last_active":"2023-10-07T08:47:50.312232+0000","last_peered":"2023-10-07T08:47:50.312232+0000","last_clean":"2023-10-07T08:47:50.312232+0000","last_became_active":"2023-10-07T08:47:50.311269+0000","last_became_peered":"2023-10-07T08:47:50.311269+0000","last_unstale":"2023-10-07T08:47:50.312232+0000","last_undegraded":"2023-10-07T08:47:50.312232+0000","last_fullsized":"2023-10-07T08:47:50.312232+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:13:54.005176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"101'8","reported_seq":18,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.328662+0000","last_change":"2023-10-07T08:47:49.291174+0000","last_active":"2023-10-07T08:47:50.328662+0000","last_peered":"2023-10-07T08:47:50.328662+0000","last_clean":"2023-10-07T08:47:50.328662+0000","last_became_active":"2023-10-07T08:47:49.290936+0000","last_became_peered":"2023-10-07T08:47:49.290936+0000","last_unstale":"2023-10-07T08:47:50.328662+0000","last_undegraded":"2023-10-07T08:47:50.328662+0000","last_fullsized":"2023-10-07T08:47:50.328662+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:08:58.201915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.311463+0000","last_change":"2023-10-07T08:47:50.310834+0000","last_active":"2023-10-07T08:47:50.311463+0000","last_peered":"2023-10-07T08:47:50.311463+0000","last_clean":"2023-10-07T08:47:50.311463+0000","last_became_active":"2023-10-07T08:47:50.310365+0000","last_became_peered":"2023-10-07T08:47:50.310365+0000","last_unstale":"2023-10-07T08:47:50.311463+0000","last_undegraded":"2023-10-07T08:47:50.311463+0000","last_fullsized":"2023-10-07T08:47:50.311463+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:41:50.269631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.326031+0000","last_change":"2023-10-07T08:47:49.302213+0000","last_active":"2023-10-07T08:47:50.326031+0000","last_peered":"2023-10-07T08:47:50.326031+0000","last_clean":"2023-10-07T08:47:50.326031+0000","last_became_active":"2023-10-07T08:47:49.301699+0000","last_became_peered":"2023-10-07T08:47:49.301699+0000","last_unstale":"2023-10-07T08:47:50.326031+0000","last_undegraded":"2023-10-07T08:47:50.326031+0000","last_fullsized":"2023-10-07T08:47:50.326031+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:40:47.205873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.318319+0000","last_change":"2023-10-07T08:47:50.318184+0000","last_active":"2023-10-07T08:47:50.318319+0000","last_peered":"2023-10-07T08:47:50.318319+0000","last_clean":"2023-10-07T08:47:50.318319+0000","last_became_active":"2023-10-07T08:47:50.317511+0000","last_became_peered":"2023-10-07T08:47:50.317511+0000","last_unstale":"2023-10-07T08:47:50.318319+0000","last_undegraded":"2023-10-07T08:47:50.318319+0000","last_fullsized":"2023-10-07T08:47:50.318319+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:03.119203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.326687+0000","last_change":"2023-10-07T08:47:49.294295+0000","last_active":"2023-10-07T08:47:50.326687+0000","last_peered":"2023-10-07T08:47:50.326687+0000","last_clean":"2023-10-07T08:47:50.326687+0000","last_became_active":"2023-10-07T08:47:49.293705+0000","last_became_peered":"2023-10-07T08:47:49.293705+0000","last_unstale":"2023-10-07T08:47:50.326687+0000","last_undegraded":"2023-10-07T08:47:50.326687+0000","last_fullsized":"2023-10-07T08:47:50.326687+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:32.044267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.318474+0000","last_change":"2023-10-07T08:47:50.318411+0000","last_active":"2023-10-07T08:47:50.318474+0000","last_peered":"2023-10-07T08:47:50.318474+0000","last_clean":"2023-10-07T08:47:50.318474+0000","last_became_active":"2023-10-07T08:47:50.317305+0000","last_became_peered":"2023-10-07T08:47:50.317305+0000","last_unstale":"2023-10-07T08:47:50.318474+0000","last_undegraded":"2023-10-07T08:47:50.318474+0000","last_fullsized":"2023-10-07T08:47:50.318474+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:08:01.325659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.306775+0000","last_change":"2023-10-07T08:47:49.296520+0000","last_active":"2023-10-07T08:47:50.306775+0000","last_peered":"2023-10-07T08:47:50.306775+0000","last_clean":"2023-10-07T08:47:50.306775+0000","last_became_active":"2023-10-07T08:47:49.296297+0000","last_became_peered":"2023-10-07T08:47:49.296297+0000","last_unstale":"2023-10-07T08:47:50.306775+0000","last_undegraded":"2023-10-07T08:47:50.306775+0000","last_fullsized":"2023-10-07T08:47:50.306775+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:02:34.686983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.316685+0000","last_change":"2023-10-07T08:47:50.316510+0000","last_active":"2023-10-07T08:47:50.316685+0000","last_peered":"2023-10-07T08:47:50.316685+0000","last_clean":"2023-10-07T08:47:50.316685+0000","last_became_active":"2023-10-07T08:47:50.315714+0000","last_became_peered":"2023-10-07T08:47:50.315714+0000","last_unstale":"2023-10-07T08:47:50.316685+0000","last_undegraded":"2023-10-07T08:47:50.316685+0000","last_fullsized":"2023-10-07T08:47:50.316685+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:23:33.719887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.327507+0000","last_change":"2023-10-07T08:47:49.293143+0000","last_active":"2023-10-07T08:47:50.327507+0000","last_peered":"2023-10-07T08:47:50.327507+0000","last_clean":"2023-10-07T08:47:50.327507+0000","last_became_active":"2023-10-07T08:47:49.292921+0000","last_became_peered":"2023-10-07T08:47:49.292921+0000","last_unstale":"2023-10-07T08:47:50.327507+0000","last_undegraded":"2023-10-07T08:47:50.327507+0000","last_fullsized":"2023-10-07T08:47:50.327507+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:23:38.526362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.310053+0000","last_change":"2023-10-07T08:47:50.309403+0000","last_active":"2023-10-07T08:47:50.310053+0000","last_peered":"2023-10-07T08:47:50.310053+0000","last_clean":"2023-10-07T08:47:50.310053+0000","last_became_active":"2023-10-07T08:47:50.309165+0000","last_became_peered":"2023-10-07T08:47:50.309165+0000","last_unstale":"2023-10-07T08:47:50.310053+0000","last_undegraded":"2023-10-07T08:47:50.310053+0000","last_fullsized":"2023-10-07T08:47:50.310053+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:48:20.456130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.303823+0000","last_change":"2023-10-07T08:47:49.293954+0000","last_active":"2023-10-07T08:47:50.303823+0000","last_peered":"2023-10-07T08:47:50.303823+0000","last_clean":"2023-10-07T08:47:50.303823+0000","last_became_active":"2023-10-07T08:47:49.293733+0000","last_became_peered":"2023-10-07T08:47:49.293733+0000","last_unstale":"2023-10-07T08:47:50.303823+0000","last_undegraded":"2023-10-07T08:47:50.303823+0000","last_fullsized":"2023-10-07T08:47:50.303823+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:27:08.117157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.311450+0000","last_change":"2023-10-07T08:47:50.311267+0000","last_active":"2023-10-07T08:47:50.311450+0000","last_peered":"2023-10-07T08:47:50.311450+0000","last_clean":"2023-10-07T08:47:50.311450+0000","last_became_active":"2023-10-07T08:47:50.310696+0000","last_became_peered":"2023-10-07T08:47:50.310696+0000","last_unstale":"2023-10-07T08:47:50.311450+0000","last_undegraded":"2023-10-07T08:47:50.311450+0000","last_fullsized":"2023-10-07T08:47:50.311450+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:50.557609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.302864+0000","last_change":"2023-10-07T08:47:49.301153+0000","last_active":"2023-10-07T08:47:50.302864+0000","last_peered":"2023-10-07T08:47:50.302864+0000","last_clean":"2023-10-07T08:47:50.302864+0000","last_became_active":"2023-10-07T08:47:49.300932+0000","last_became_peered":"2023-10-07T08:47:49.300932+0000","last_unstale":"2023-10-07T08:47:50.302864+0000","last_undegraded":"2023-10-07T08:47:50.302864+0000","last_fullsized":"2023-10-07T08:47:50.302864+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:28:51.667344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.312721+0000","last_change":"2023-10-07T08:47:50.312342+0000","last_active":"2023-10-07T08:47:50.312721+0000","last_peered":"2023-10-07T08:47:50.312721+0000","last_clean":"2023-10-07T08:47:50.312721+0000","last_became_active":"2023-10-07T08:47:50.312107+0000","last_became_peered":"2023-10-07T08:47:50.312107+0000","last_unstale":"2023-10-07T08:47:50.312721+0000","last_undegraded":"2023-10-07T08:47:50.312721+0000","last_fullsized":"2023-10-07T08:47:50.312721+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:40.234974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.304714+0000","last_change":"2023-10-07T08:47:49.295423+0000","last_active":"2023-10-07T08:47:50.304714+0000","last_peered":"2023-10-07T08:47:50.304714+0000","last_clean":"2023-10-07T08:47:50.304714+0000","last_became_active":"2023-10-07T08:47:49.295149+0000","last_became_peered":"2023-10-07T08:47:49.295149+0000","last_unstale":"2023-10-07T08:47:50.304714+0000","last_undegraded":"2023-10-07T08:47:50.304714+0000","last_fullsized":"2023-10-07T08:47:50.304714+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:42.874808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.315664+0000","last_change":"2023-10-07T08:47:50.315555+0000","last_active":"2023-10-07T08:47:50.315664+0000","last_peered":"2023-10-07T08:47:50.315664+0000","last_clean":"2023-10-07T08:47:50.315664+0000","last_became_active":"2023-10-07T08:47:50.314887+0000","last_became_peered":"2023-10-07T08:47:50.314887+0000","last_unstale":"2023-10-07T08:47:50.315664+0000","last_undegraded":"2023-10-07T08:47:50.315664+0000","last_fullsized":"2023-10-07T08:47:50.315664+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:02:35.691164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.329626+0000","last_change":"2023-10-07T08:47:49.294640+0000","last_active":"2023-10-07T08:47:50.329626+0000","last_peered":"2023-10-07T08:47:50.329626+0000","last_clean":"2023-10-07T08:47:50.329626+0000","last_became_active":"2023-10-07T08:47:49.294244+0000","last_became_peered":"2023-10-07T08:47:49.294244+0000","last_unstale":"2023-10-07T08:47:50.329626+0000","last_undegraded":"2023-10-07T08:47:50.329626+0000","last_fullsized":"2023-10-07T08:47:50.329626+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:39:10.789555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.309141+0000","last_change":"2023-10-07T08:47:50.309033+0000","last_active":"2023-10-07T08:47:50.309141+0000","last_peered":"2023-10-07T08:47:50.309141+0000","last_clean":"2023-10-07T08:47:50.309141+0000","last_became_active":"2023-10-07T08:47:50.308784+0000","last_became_peered":"2023-10-07T08:47:50.308784+0000","last_unstale":"2023-10-07T08:47:50.309141+0000","last_undegraded":"2023-10-07T08:47:50.309141+0000","last_fullsized":"2023-10-07T08:47:50.309141+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:48:20.456130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"102'1","reported_seq":11,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-07T08:47:51.467170+0000","last_change":"2023-10-07T08:47:49.296619+0000","last_active":"2023-10-07T08:47:51.467170+0000","last_peered":"2023-10-07T08:47:51.467170+0000","last_clean":"2023-10-07T08:47:51.467170+0000","last_became_active":"2023-10-07T08:47:49.296120+0000","last_became_peered":"2023-10-07T08:47:49.296120+0000","last_unstale":"2023-10-07T08:47:51.467170+0000","last_undegraded":"2023-10-07T08:47:51.467170+0000","last_fullsized":"2023-10-07T08:47:51.467170+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:42:22.643545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.313152+0000","last_change":"2023-10-07T08:47:50.312890+0000","last_active":"2023-10-07T08:47:50.313152+0000","last_peered":"2023-10-07T08:47:50.313152+0000","last_clean":"2023-10-07T08:47:50.313152+0000","last_became_active":"2023-10-07T08:47:50.312661+0000","last_became_peered":"2023-10-07T08:47:50.312661+0000","last_unstale":"2023-10-07T08:47:50.313152+0000","last_undegraded":"2023-10-07T08:47:50.313152+0000","last_fullsized":"2023-10-07T08:47:50.313152+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:33:33.048447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.311627+0000","last_change":"2023-10-07T08:47:49.298676+0000","last_active":"2023-10-07T08:47:50.311627+0000","last_peered":"2023-10-07T08:47:50.311627+0000","last_clean":"2023-10-07T08:47:50.311627+0000","last_became_active":"2023-10-07T08:47:49.298453+0000","last_became_peered":"2023-10-07T08:47:49.298453+0000","last_unstale":"2023-10-07T08:47:50.311627+0000","last_undegraded":"2023-10-07T08:47:50.311627+0000","last_fullsized":"2023-10-07T08:47:50.311627+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:37.562344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.315637+0000","last_change":"2023-10-07T08:47:50.315378+0000","last_active":"2023-10-07T08:47:50.315637+0000","last_peered":"2023-10-07T08:47:50.315637+0000","last_clean":"2023-10-07T08:47:50.315637+0000","last_became_active":"2023-10-07T08:47:50.315128+0000","last_became_peered":"2023-10-07T08:47:50.315128+0000","last_unstale":"2023-10-07T08:47:50.315637+0000","last_undegraded":"2023-10-07T08:47:50.315637+0000","last_fullsized":"2023-10-07T08:47:50.315637+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:08:59.206095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.309139+0000","last_change":"2023-10-07T08:47:49.294015+0000","last_active":"2023-10-07T08:47:50.309139+0000","last_peered":"2023-10-07T08:47:50.309139+0000","last_clean":"2023-10-07T08:47:50.309139+0000","last_became_active":"2023-10-07T08:47:49.292830+0000","last_became_peered":"2023-10-07T08:47:49.292830+0000","last_unstale":"2023-10-07T08:47:50.309139+0000","last_undegraded":"2023-10-07T08:47:50.309139+0000","last_fullsized":"2023-10-07T08:47:50.309139+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:51.456204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.314718+0000","last_change":"2023-10-07T08:47:50.314656+0000","last_active":"2023-10-07T08:47:50.314718+0000","last_peered":"2023-10-07T08:47:50.314718+0000","last_clean":"2023-10-07T08:47:50.314718+0000","last_became_active":"2023-10-07T08:47:50.314425+0000","last_became_peered":"2023-10-07T08:47:50.314425+0000","last_unstale":"2023-10-07T08:47:50.314718+0000","last_undegraded":"2023-10-07T08:47:50.314718+0000","last_fullsized":"2023-10-07T08:47:50.314718+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:41:50.269631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.307818+0000","last_change":"2023-10-07T08:47:49.297510+0000","last_active":"2023-10-07T08:47:50.307818+0000","last_peered":"2023-10-07T08:47:50.307818+0000","last_clean":"2023-10-07T08:47:50.307818+0000","last_became_active":"2023-10-07T08:47:49.297276+0000","last_became_peered":"2023-10-07T08:47:49.297276+0000","last_unstale":"2023-10-07T08:47:50.307818+0000","last_undegraded":"2023-10-07T08:47:50.307818+0000","last_fullsized":"2023-10-07T08:47:50.307818+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:02.115023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.318074+0000","last_change":"2023-10-07T08:47:50.318015+0000","last_active":"2023-10-07T08:47:50.318074+0000","last_peered":"2023-10-07T08:47:50.318074+0000","last_clean":"2023-10-07T08:47:50.318074+0000","last_became_active":"2023-10-07T08:47:50.317800+0000","last_became_peered":"2023-10-07T08:47:50.317800+0000","last_unstale":"2023-10-07T08:47:50.318074+0000","last_undegraded":"2023-10-07T08:47:50.318074+0000","last_fullsized":"2023-10-07T08:47:50.318074+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:40.234974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.313639+0000","last_change":"2023-10-07T08:47:49.299182+0000","last_active":"2023-10-07T08:47:50.313639+0000","last_peered":"2023-10-07T08:47:50.313639+0000","last_clean":"2023-10-07T08:47:50.313639+0000","last_became_active":"2023-10-07T08:47:49.298742+0000","last_became_peered":"2023-10-07T08:47:49.298742+0000","last_unstale":"2023-10-07T08:47:50.313639+0000","last_undegraded":"2023-10-07T08:47:50.313639+0000","last_fullsized":"2023-10-07T08:47:50.313639+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:10.976889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.314960+0000","last_change":"2023-10-07T08:47:50.314896+0000","last_active":"2023-10-07T08:47:50.314960+0000","last_peered":"2023-10-07T08:47:50.314960+0000","last_clean":"2023-10-07T08:47:50.314960+0000","last_became_active":"2023-10-07T08:47:50.314658+0000","last_became_peered":"2023-10-07T08:47:50.314658+0000","last_unstale":"2023-10-07T08:47:50.314960+0000","last_undegraded":"2023-10-07T08:47:50.314960+0000","last_fullsized":"2023-10-07T08:47:50.314960+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:08:13.888664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.312079+0000","last_change":"2023-10-07T08:47:49.303627+0000","last_active":"2023-10-07T08:47:50.312079+0000","last_peered":"2023-10-07T08:47:50.312079+0000","last_clean":"2023-10-07T08:47:50.312079+0000","last_became_active":"2023-10-07T08:47:49.302365+0000","last_became_peered":"2023-10-07T08:47:49.302365+0000","last_unstale":"2023-10-07T08:47:50.312079+0000","last_undegraded":"2023-10-07T08:47:50.312079+0000","last_fullsized":"2023-10-07T08:47:50.312079+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:02:54.069896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.315424+0000","last_change":"2023-10-07T08:47:50.315352+0000","last_active":"2023-10-07T08:47:50.315424+0000","last_peered":"2023-10-07T08:47:50.315424+0000","last_clean":"2023-10-07T08:47:50.315424+0000","last_became_active":"2023-10-07T08:47:50.315068+0000","last_became_peered":"2023-10-07T08:47:50.315068+0000","last_unstale":"2023-10-07T08:47:50.315424+0000","last_undegraded":"2023-10-07T08:47:50.315424+0000","last_fullsized":"2023-10-07T08:47:50.315424+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:26:50.865656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.309522+0000","last_change":"2023-10-07T08:47:49.304623+0000","last_active":"2023-10-07T08:47:50.309522+0000","last_peered":"2023-10-07T08:47:50.309522+0000","last_clean":"2023-10-07T08:47:50.309522+0000","last_became_active":"2023-10-07T08:47:49.304380+0000","last_became_peered":"2023-10-07T08:47:49.304380+0000","last_unstale":"2023-10-07T08:47:50.309522+0000","last_undegraded":"2023-10-07T08:47:50.309522+0000","last_fullsized":"2023-10-07T08:47:50.309522+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:09:37.124003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.314970+0000","last_change":"2023-10-07T08:47:50.314845+0000","last_active":"2023-10-07T08:47:50.314970+0000","last_peered":"2023-10-07T08:47:50.314970+0000","last_clean":"2023-10-07T08:47:50.314970+0000","last_became_active":"2023-10-07T08:47:50.314528+0000","last_became_peered":"2023-10-07T08:47:50.314528+0000","last_unstale":"2023-10-07T08:47:50.314970+0000","last_undegraded":"2023-10-07T08:47:50.314970+0000","last_fullsized":"2023-10-07T08:47:50.314970+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:49.282221+0000","last_clean_scrub_stamp":"2023-10-07T08:47:49.282221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:39:57.537377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.329056+0000","last_change":"2023-10-07T08:47:49.295864+0000","last_active":"2023-10-07T08:47:50.329056+0000","last_peered":"2023-10-07T08:47:50.329056+0000","last_clean":"2023-10-07T08:47:50.329056+0000","last_became_active":"2023-10-07T08:47:49.293237+0000","last_became_peered":"2023-10-07T08:47:49.293237+0000","last_unstale":"2023-10-07T08:47:50.329056+0000","last_undegraded":"2023-10-07T08:47:50.329056+0000","last_fullsized":"2023-10-07T08:47:50.329056+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:47:48.278041+0000","last_clean_scrub_stamp":"2023-10-07T08:47:48.278041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:14:02.115023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":231,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-07T08:47:50.302820+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:47:50.302820+0000","last_peered":"2023-10-07T08:47:50.302820+0000","last_clean":"2023-10-07T08:47:50.302820+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:47:50.302820+0000","last_undegraded":"2023-10-07T08:47:50.302820+0000","last_fullsized":"2023-10-07T08:47:50.302820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1112,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194200,"statfs":{"total":200000000,"available":198861281,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.5},"min":{"1min":0.36599999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.48699999999999999},"min":{"1min":0.379,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68000000000000005,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.52600000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.41799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.40500000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.57499999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51400000000000001,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.75},"last":0.38300000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.629,"15min":0.80700000000000005},"min":{"1min":0.38800000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.68400000000000005,"5min":6.8570000000000002,"15min":6.8570000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.749,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.28799999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66400000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.435},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.502,"15min":0.53300000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69499999999999995,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41499999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":0.751,"15min":0.751},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54200000000000004,"15min":0.56999999999999995},"min":{"1min":0.318,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73299999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.65600000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56899999999999995,"15min":0.59199999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72999999999999998,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.626},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71599999999999997,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.61899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":536,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194776,"statfs":{"total":200000000,"available":199451053,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47999999999999998,"15min":0.46800000000000003},"min":{"1min":0.33300000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73999999999999999,"5min":0.745,"15min":0.745},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.48799999999999999,"15min":0.48599999999999999},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.42299999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54000000000000004,"15min":0.52700000000000002},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.41499999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.495}]},{"osd":2,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.502,"15min":0.47399999999999998},"min":{"1min":0.375,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51500000000000001,"15min":0.51300000000000001},"min":{"1min":0.41999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.65300000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.53100000000000003},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.80300000000000005,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.32100000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.67200000000000004,"5min":0.748,"15min":0.748},"last":0.69699999999999995}]},{"osd":5,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.73899999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:46:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.52200000000000002},"min":{"1min":0.37,"5min":0.312,"15min":0.312},"max":{"1min":0.71599999999999997,"5min":0.754,"15min":0.754},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":1.052,"15min":1.052},"last":0.748}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":535,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194776,"statfs":{"total":200000000,"available":199451525,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34599999999999997,"15min":0.312},"min":{"1min":0.22500000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.56699999999999995,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.35499999999999998,"15min":0.32800000000000001},"min":{"1min":0.22500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.40300000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.318},"min":{"1min":0.26200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70399999999999996,"5min":1.639,"15min":1.639},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.38800000000000001,"15min":0.33200000000000002},"min":{"1min":0.28699999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.47399999999999998,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.38600000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40000000000000002,"15min":0.35899999999999999},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.52800000000000002,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.34799999999999998},"min":{"1min":0.28599999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.443}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.52200000000000002},"min":{"1min":0.35699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79100000000000004,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.54900000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48899999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.52600000000000002},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73099999999999998,"5min":0.87,"15min":0.87},"last":0.56399999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.58199999999999996},"min":{"1min":0.51800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79100000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.52100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194200,"statfs":{"total":200000000,"available":198861317,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.371},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.437},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.377,"15min":0.39500000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.67400000000000004,"5min":1.079,"15min":1.079},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.39100000000000001},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":1.464,"15min":1.464},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.432,"5min":0.40200000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67900000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":1.341,"15min":1.341},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.42099999999999999,"15min":0.435},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68600000000000005,"5min":1.532,"15min":1.532},"last":0.48499999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90200000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.60999999999999999},"min":{"1min":0.36199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80100000000000005,"5min":1.51,"15min":1.51},"last":0.76000000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83299999999999996,"5min":1.25,"15min":1.25},"last":0.67700000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.92900000000000005,"5min":1.488,"15min":1.488},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":1.024,"15min":1.024},"last":0.73499999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.90300000000000002,"5min":1.288,"15min":1.288},"last":0.71699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":535,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194776,"statfs":{"total":200000000,"available":199451165,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.33400000000000002,"15min":0.34399999999999997},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.44700000000000001,"5min":1.665,"15min":1.665},"last":0.434},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.36199999999999999},"min":{"1min":0.248,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47399999999999998,"5min":1.579,"15min":1.579},"last":0.46500000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36299999999999999,"15min":0.374},"min":{"1min":0.23699999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.52400000000000002,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.28799999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53600000000000003,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.52400000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38400000000000001,"15min":0.39000000000000001},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":1.454,"15min":1.454},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38,"15min":0.38900000000000001},"min":{"1min":0.26100000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.501}]},{"osd":4,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.75700000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.59899999999999998,"15min":0.59399999999999997},"min":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77400000000000002,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.747,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.40600000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.79700000000000004,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.68200000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.36799999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72299999999999998,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.47899999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.80200000000000005,"5min":1.637,"15min":1.637},"last":0.71699999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:46:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41099999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.72899999999999998,"5min":1.49,"15min":1.49},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78600000000000003,"5min":1.375,"15min":1.375},"last":0.70299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":536,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194775,"statfs":{"total":200000000,"available":199450183,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35499999999999998,"15min":0.33100000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.90200000000000002,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34899999999999998,"15min":0.32100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.504,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.27600000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38100000000000001,"15min":0.35999999999999999},"min":{"1min":0.245,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.61599999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41999999999999998,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70099999999999996,"5min":1.885,"15min":1.885},"last":0.39000000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.38100000000000001},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57699999999999996,"5min":1.274,"15min":1.274},"last":0.314},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.40300000000000002},"min":{"1min":0.32100000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.97699999999999998,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.40999999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.503},"min":{"1min":0.36699999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78500000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57399999999999995,"15min":0.53500000000000003},"min":{"1min":0.45200000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80800000000000005,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.46400000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.42799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79400000000000004,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.59699999999999998,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.038,"5min":1.851,"15min":1.851},"last":0.53600000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60299999999999998,"15min":0.55900000000000005},"min":{"1min":0.45100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77200000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.58599999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84199999999999997,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.56399999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.57699999999999996},"min":{"1min":0.45600000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0089999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.59299999999999997,"15min":0.55700000000000005},"min":{"1min":0.42699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80000000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.50900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":535,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194777,"statfs":{"total":200000000,"available":199451719,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.504,"15min":0.48599999999999999},"min":{"1min":0.308,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69199999999999995,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52700000000000002,"15min":0.505},"min":{"1min":0.38800000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.69399999999999995,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.35999999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.497},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.70899999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.495},"min":{"1min":0.40799999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.64100000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.51700000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53200000000000003,"15min":0.50600000000000001},"min":{"1min":0.33400000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73699999999999999,"5min":1.29,"15min":1.29},"last":0.48599999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70499999999999996,"5min":2.052,"15min":2.052},"last":0.503},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":1.369,"15min":1.369},"last":0.42999999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44500000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61299999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.36199999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71199999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52900000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.316,"15min":0.316},"max":{"1min":0.64000000000000001,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.67300000000000004,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:46:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.316,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67700000000000005,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69299999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.57499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":536,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194775,"statfs":{"total":200000000,"available":199450161,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52300000000000002,"15min":0.51300000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51500000000000001,"15min":0.50700000000000001},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73899999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40899999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.498,"15min":0.48399999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.72299999999999998,"5min":0.748,"15min":0.748},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70099999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.27000000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53000000000000003,"15min":0.52400000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73499999999999999,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.309,"15min":0.309},"max":{"1min":0.68100000000000005,"5min":0.754,"15min":0.754},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67700000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77600000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.34300000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.627,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.59899999999999998},"min":{"1min":0.42599999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67300000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.54600000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52500000000000002,"15min":0.54600000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.73599999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48699999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.40600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68899999999999995,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.5},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57099999999999995,"15min":0.59999999999999998},"min":{"1min":0.35699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72399999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.59199999999999997}]}]}],"pool_statfs":[]}} 2023-10-07T08:47:59.267 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T08:47:59.267 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T08:47:59.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.418+0000 7f3852078700 1 Processor -- start 2023-10-07T08:47:59.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.419+0000 7f3852078700 1 -- start start 2023-10-07T08:47:59.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.419+0000 7f3852078700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f384c1577c0 0x7f384c068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.419+0000 7f3852078700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c0cbea0 0x7f384c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.419+0000 7f3852078700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384c0cca80 con 0x7f384c157b90 2023-10-07T08:47:59.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.419+0000 7f3852078700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384c0cc2e0 con 0x7f384c1577c0 2023-10-07T08:47:59.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.419+0000 7f3852078700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0cedd0 con 0x7f384c0cbea0 2023-10-07T08:47:59.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.420+0000 7f384bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c0cbea0 0x7f384c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.420+0000 7f384b7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f384c1577c0 0x7f384c068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.420+0000 7f384b7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f384c1577c0 0x7f384c068810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:39166/0 (socket says 172.21.15.81:39166) 2023-10-07T08:47:59.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.420+0000 7f384bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c0cbea0 0x7f384c068d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:58578/0 (socket says 172.21.15.81:58578) 2023-10-07T08:47:59.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.420+0000 7f384b7fe700 1 -- 172.21.15.81:0/1842377921 learned_addr learned my addr 172.21.15.81:0/1842377921 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:59.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.420+0000 7f384affd700 1 --1- 172.21.15.81:0/1842377921 >> v1:172.21.15.89:6789/0 conn(0x7f384c157b90 0x7f384c0cb790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:36166/0 (socket says 172.21.15.81:36166) 2023-10-07T08:47:59.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.420+0000 7f384b7fe700 1 -- 172.21.15.81:0/1842377921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c0cbea0 msgr2=0x7f384c068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:59.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.420+0000 7f384b7fe700 1 --2- 172.21.15.81:0/1842377921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c0cbea0 0x7f384c068d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.420+0000 7f384b7fe700 1 -- 172.21.15.81:0/1842377921 >> v1:172.21.15.89:6789/0 conn(0x7f384c157b90 legacy=0x7f384c0cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:59.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.420+0000 7f384b7fe700 1 -- 172.21.15.81:0/1842377921 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c0cc4c0 con 0x7f384c1577c0 2023-10-07T08:47:59.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.420+0000 7f384bfff700 1 --2- 172.21.15.81:0/1842377921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c0cbea0 0x7f384c068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:47:59.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.420+0000 7f384b7fe700 1 --2- 172.21.15.81:0/1842377921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f384c1577c0 0x7f384c068810 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f383c009f20 tx=0x7f383c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9180c384f373ce2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:59.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.420+0000 7f384a7fc700 1 -- 172.21.15.81:0/1842377921 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c00e070 con 0x7f384c1577c0 2023-10-07T08:47:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.420+0000 7f384a7fc700 1 -- 172.21.15.81:0/1842377921 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c00b9d0 con 0x7f384c1577c0 2023-10-07T08:47:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.420+0000 7f384a7fc700 1 -- 172.21.15.81:0/1842377921 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c0092e0 con 0x7f384c1577c0 2023-10-07T08:47:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.421+0000 7f3852078700 1 -- 172.21.15.81:0/1842377921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f384c1577c0 msgr2=0x7f384c068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.421+0000 7f3852078700 1 --2- 172.21.15.81:0/1842377921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f384c1577c0 0x7f384c068810 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f383c009f20 tx=0x7f383c009840 comp rx=0 tx=0).stop 2023-10-07T08:47:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.421+0000 7f3852078700 1 -- 172.21.15.81:0/1842377921 shutdown_connections 2023-10-07T08:47:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.421+0000 7f3852078700 1 --2- 172.21.15.81:0/1842377921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c0cbea0 0x7f384c068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.421+0000 7f3852078700 1 --2- 172.21.15.81:0/1842377921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f384c1577c0 0x7f384c068810 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.421+0000 7f3852078700 1 -- 172.21.15.81:0/1842377921 >> 172.21.15.81:0/1842377921 conn(0x7f384c0d0df0 msgr2=0x7f384c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.421+0000 7f3852078700 1 -- 172.21.15.81:0/1842377921 shutdown_connections 2023-10-07T08:47:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.421+0000 7f3852078700 1 -- 172.21.15.81:0/1842377921 wait complete. 2023-10-07T08:47:59.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.422+0000 7f3852078700 1 Processor -- start 2023-10-07T08:47:59.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.422+0000 7f3852078700 1 -- start start 2023-10-07T08:47:59.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.423+0000 7f3852078700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f384c0cbea0 0x7f384c1547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.423+0000 7f3852078700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c1577c0 0x7f384c0b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.423+0000 7f3852078700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c157b90 0x7f384c15aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.423+0000 7f3852078700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0b3ed0 con 0x7f384c157b90 2023-10-07T08:47:59.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.423+0000 7f3852078700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c158020 con 0x7f384c0cbea0 2023-10-07T08:47:59.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.423+0000 7f3852078700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c158300 con 0x7f384c1577c0 2023-10-07T08:47:59.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.423+0000 7f384bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c157b90 0x7f384c15aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.423+0000 7f384bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c157b90 0x7f384c15aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43124/0 (socket says 172.21.15.81:43124) 2023-10-07T08:47:59.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.423+0000 7f384bfff700 1 -- 172.21.15.81:0/672126356 learned_addr learned my addr 172.21.15.81:0/672126356 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:59.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.423+0000 7f384b7fe700 1 --2- 172.21.15.81:0/672126356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f384c0cbea0 0x7f384c1547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.423+0000 7f384affd700 1 --2- 172.21.15.81:0/672126356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c1577c0 0x7f384c0b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.423+0000 7f384bfff700 1 -- 172.21.15.81:0/672126356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c1577c0 msgr2=0x7f384c0b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:59.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.423+0000 7f384bfff700 1 --2- 172.21.15.81:0/672126356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c1577c0 0x7f384c0b4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.423+0000 7f384bfff700 1 -- 172.21.15.81:0/672126356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f384c0cbea0 msgr2=0x7f384c1547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:59.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.423+0000 7f384bfff700 1 --2- 172.21.15.81:0/672126356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f384c0cbea0 0x7f384c1547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.423+0000 7f384bfff700 1 -- 172.21.15.81:0/672126356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3844009420 con 0x7f384c157b90 2023-10-07T08:47:59.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.424+0000 7f384bfff700 1 --2- 172.21.15.81:0/672126356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c157b90 0x7f384c15aa20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f384400ec80 tx=0x7f38440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:59.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.424+0000 7f38337fe700 1 -- 172.21.15.81:0/672126356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400c850 con 0x7f384c157b90 2023-10-07T08:47:59.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.424+0000 7f38337fe700 1 -- 172.21.15.81:0/672126356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384400c9b0 con 0x7f384c157b90 2023-10-07T08:47:59.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.424+0000 7f3852078700 1 -- 172.21.15.81:0/672126356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383c009ae0 con 0x7f384c157b90 2023-10-07T08:47:59.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.424+0000 7f38337fe700 1 -- 172.21.15.81:0/672126356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400cd50 con 0x7f384c157b90 2023-10-07T08:47:59.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.424+0000 7f3852078700 1 -- 172.21.15.81:0/672126356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384c1588c0 con 0x7f384c157b90 2023-10-07T08:47:59.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.425+0000 7f3852078700 1 -- 172.21.15.81:0/672126356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384c067a50 con 0x7f384c157b90 2023-10-07T08:47:59.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.425+0000 7f38337fe700 1 -- 172.21.15.81:0/672126356 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3844013680 con 0x7f384c157b90 2023-10-07T08:47:59.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.425+0000 7f38337fe700 1 --2- 172.21.15.81:0/672126356 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3838066f30 0x7f38380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.426+0000 7f38337fe700 1 -- 172.21.15.81:0/672126356 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3844084620 con 0x7f384c157b90 2023-10-07T08:47:59.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.426+0000 7f384b7fe700 1 --2- 172.21.15.81:0/672126356 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3838066f30 0x7f38380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.426+0000 7f384b7fe700 1 --2- 172.21.15.81:0/672126356 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3838066f30 0x7f38380693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f383c009880 tx=0x7f383c018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:59.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.430+0000 7f38337fe700 1 -- 172.21.15.81:0/672126356 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3844051890 con 0x7f384c157b90 2023-10-07T08:47:59.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.687+0000 7f3852078700 1 -- 172.21.15.81:0/672126356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f384c0cc7a0 con 0x7f384c157b90 2023-10-07T08:47:59.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.690+0000 7f38337fe700 1 -- 172.21.15.81:0/672126356 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3844054eb0 con 0x7f384c157b90 2023-10-07T08:47:59.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.693+0000 7f3852078700 1 -- 172.21.15.81:0/672126356 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3838066f30 msgr2=0x7f38380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:59.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.693+0000 7f3852078700 1 --2- 172.21.15.81:0/672126356 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3838066f30 0x7f38380693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f383c009880 tx=0x7f383c018000 comp rx=0 tx=0).stop 2023-10-07T08:47:59.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.693+0000 7f3852078700 1 -- 172.21.15.81:0/672126356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c157b90 msgr2=0x7f384c15aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:59.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.693+0000 7f3852078700 1 --2- 172.21.15.81:0/672126356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c157b90 0x7f384c15aa20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f384400ec80 tx=0x7f38440091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.693+0000 7f3852078700 1 -- 172.21.15.81:0/672126356 shutdown_connections 2023-10-07T08:47:59.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.693+0000 7f3852078700 1 --2- 172.21.15.81:0/672126356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c157b90 0x7f384c15aa20 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.693+0000 7f3852078700 1 --2- 172.21.15.81:0/672126356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f384c0cbea0 0x7f384c1547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.693+0000 7f3852078700 1 --2- 172.21.15.81:0/672126356 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3838066f30 0x7f38380693e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.693+0000 7f3852078700 1 --2- 172.21.15.81:0/672126356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f384c1577c0 0x7f384c0b4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.693+0000 7f3852078700 1 -- 172.21.15.81:0/672126356 >> 172.21.15.81:0/672126356 conn(0x7f384c0d0df0 msgr2=0x7f384c0c7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:59.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.693+0000 7f3852078700 1 -- 172.21.15.81:0/672126356 shutdown_connections 2023-10-07T08:47:59.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.693+0000 7f3852078700 1 -- 172.21.15.81:0/672126356 wait complete. 2023-10-07T08:47:59.697 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-07T08:47:59.706 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:47:59.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.818+0000 7fee53e9b700 1 Processor -- start 2023-10-07T08:47:59.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.818+0000 7fee53e9b700 1 -- start start 2023-10-07T08:47:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.819+0000 7fee53e9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fee4c0cf240 0x7fee4c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.819+0000 7fee53e9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee4c06d650 0x7fee4c06da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.819+0000 7fee53e9b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c0b0ca0 con 0x7fee4c15a2a0 2023-10-07T08:47:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.819+0000 7fee53e9b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c06ea90 con 0x7fee4c0cf240 2023-10-07T08:47:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.819+0000 7fee53e9b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0b00d0 con 0x7fee4c06d650 2023-10-07T08:47:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.819+0000 7fee51c37700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fee4c15a2a0 0x7fee4c0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53722/0 (socket says 172.21.15.81:53722) 2023-10-07T08:47:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.819+0000 7fee51c37700 1 -- 172.21.15.81:0/2393100678 learned_addr learned my addr 172.21.15.81:0/2393100678 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:47:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee52438700 1 --2- 172.21.15.81:0/2393100678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee4c06d650 0x7fee4c06da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee51436700 1 --2- 172.21.15.81:0/2393100678 >> v2:172.21.15.89:3300/0 conn(0x7fee4c0cf240 0x7fee4c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee50c35700 1 -- 172.21.15.81:0/2393100678 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668887809 0 0) 0x7fee4c0b0ca0 con 0x7fee4c15a2a0 2023-10-07T08:47:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee50c35700 1 -- 172.21.15.81:0/2393100678 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee34003570 con 0x7fee4c15a2a0 2023-10-07T08:47:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee50c35700 1 -- 172.21.15.81:0/2393100678 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2684124322 0 0) 0x7fee34003570 con 0x7fee4c15a2a0 2023-10-07T08:47:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee50c35700 1 -- 172.21.15.81:0/2393100678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee4c06d650 msgr2=0x7fee4c06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee50c35700 1 --2- 172.21.15.81:0/2393100678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee4c06d650 0x7fee4c06da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee50c35700 1 -- 172.21.15.81:0/2393100678 >> v2:172.21.15.89:3300/0 conn(0x7fee4c0cf240 msgr2=0x7fee4c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee50c35700 1 --2- 172.21.15.81:0/2393100678 >> v2:172.21.15.89:3300/0 conn(0x7fee4c0cf240 0x7fee4c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee50c35700 1 -- 172.21.15.81:0/2393100678 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c0b0370 con 0x7fee4c15a2a0 2023-10-07T08:47:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee50c35700 1 -- 172.21.15.81:0/2393100678 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fee3c0017f0 con 0x7fee4c15a2a0 2023-10-07T08:47:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee50c35700 1 -- 172.21.15.81:0/2393100678 >> v1:172.21.15.81:6789/0 conn(0x7fee4c15a2a0 legacy=0x7fee4c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee50c35700 1 --2- 172.21.15.81:0/2393100678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee34003a60 0x7fee34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee50c35700 1 --2- 172.21.15.81:0/2393100678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee34004810 0x7fee34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee50c35700 1 --2- 172.21.15.81:0/2393100678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee4c06d650 0x7fee340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee50c35700 1 -- 172.21.15.81:0/2393100678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c06ea90 con 0x7fee34004810 2023-10-07T08:47:59.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee50c35700 1 -- 172.21.15.81:0/2393100678 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0b00d0 con 0x7fee34003a60 2023-10-07T08:47:59.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee50c35700 1 -- 172.21.15.81:0/2393100678 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3400ba60 con 0x7fee4c06d650 2023-10-07T08:47:59.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee51436700 1 --2- 172.21.15.81:0/2393100678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee34004810 0x7fee34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee51c37700 1 --2- 172.21.15.81:0/2393100678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee34003a60 0x7fee34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee52438700 1 --2- 172.21.15.81:0/2393100678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee4c06d650 0x7fee340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee51436700 1 -- 172.21.15.81:0/2393100678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee4c06d650 msgr2=0x7fee340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:59.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee51436700 1 --2- 172.21.15.81:0/2393100678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee4c06d650 0x7fee340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee51436700 1 -- 172.21.15.81:0/2393100678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee34003a60 msgr2=0x7fee34003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:47:59.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee51436700 1 --2- 172.21.15.81:0/2393100678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee34003a60 0x7fee34003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee51436700 1 -- 172.21.15.81:0/2393100678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee34003570 con 0x7fee34004810 2023-10-07T08:47:59.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.820+0000 7fee51436700 1 --2- 172.21.15.81:0/2393100678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee34004810 0x7fee34004c80 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fee4c06f960 tx=0x7fee400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382386fae8583270 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:59.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.821+0000 7fee50c35700 1 -- 172.21.15.81:0/2393100678 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4000e710 con 0x7fee34004810 2023-10-07T08:47:59.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.821+0000 7fee50c35700 1 -- 172.21.15.81:0/2393100678 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4000e870 con 0x7fee34004810 2023-10-07T08:47:59.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.821+0000 7fee50c35700 1 -- 172.21.15.81:0/2393100678 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4000ec30 con 0x7fee34004810 2023-10-07T08:47:59.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.821+0000 7fee53e9b700 1 -- 172.21.15.81:0/2393100678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee34004810 msgr2=0x7fee34004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:59.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.821+0000 7fee53e9b700 1 --2- 172.21.15.81:0/2393100678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee34004810 0x7fee34004c80 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fee4c06f960 tx=0x7fee400091a0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.821+0000 7fee52438700 1 -- 172.21.15.81:0/2393100678 reap_dead start 2023-10-07T08:47:59.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.821+0000 7fee53e9b700 1 -- 172.21.15.81:0/2393100678 shutdown_connections 2023-10-07T08:47:59.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.821+0000 7fee53e9b700 1 -- 172.21.15.81:0/2393100678 >> 172.21.15.81:0/2393100678 conn(0x7fee4c067640 msgr2=0x7fee4c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:47:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.821+0000 7fee53e9b700 1 -- 172.21.15.81:0/2393100678 shutdown_connections 2023-10-07T08:47:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.821+0000 7fee53e9b700 1 -- 172.21.15.81:0/2393100678 wait complete. 2023-10-07T08:47:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.822+0000 7fee53e9b700 1 Processor -- start 2023-10-07T08:47:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.822+0000 7fee53e9b700 1 -- start start 2023-10-07T08:47:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee53e9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee34004810 0x7fee4c153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee53e9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee4c15d950 0x7fee4c14f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee53e9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee4c0b2390 0x7fee4c16dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee53e9b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c14fc60 con 0x7fee34004810 2023-10-07T08:47:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee53e9b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0b3a70 con 0x7fee4c15d950 2023-10-07T08:47:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee53e9b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c15ddc0 con 0x7fee4c0b2390 2023-10-07T08:47:59.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee51c37700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee34004810 0x7fee4c153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee51c37700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee34004810 0x7fee4c153060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43146/0 (socket says 172.21.15.81:43146) 2023-10-07T08:47:59.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee51c37700 1 -- 172.21.15.81:0/2720578228 learned_addr learned my addr 172.21.15.81:0/2720578228 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:47:59.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee51436700 1 --2- 172.21.15.81:0/2720578228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee4c15d950 0x7fee4c14f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee52438700 1 --2- 172.21.15.81:0/2720578228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee4c0b2390 0x7fee4c16dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee51c37700 1 -- 172.21.15.81:0/2720578228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee4c0b2390 msgr2=0x7fee4c16dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:59.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee51c37700 1 --2- 172.21.15.81:0/2720578228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee4c0b2390 0x7fee4c16dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee51c37700 1 -- 172.21.15.81:0/2720578228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee4c15d950 msgr2=0x7fee4c14f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:47:59.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee51c37700 1 --2- 172.21.15.81:0/2720578228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee4c15d950 0x7fee4c14f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:47:59.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee51c37700 1 -- 172.21.15.81:0/2720578228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c0b2bc0 con 0x7fee34004810 2023-10-07T08:47:59.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.823+0000 7fee51436700 1 --2- 172.21.15.81:0/2720578228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee4c15d950 0x7fee4c14f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:47:59.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.824+0000 7fee51c37700 1 --2- 172.21.15.81:0/2720578228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee34004810 0x7fee4c153060 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fee3c007af0 tx=0x7fee3c002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:59.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.824+0000 7fee49ffb700 1 -- 172.21.15.81:0/2720578228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c00adb0 con 0x7fee34004810 2023-10-07T08:47:59.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.824+0000 7fee49ffb700 1 -- 172.21.15.81:0/2720578228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c0133f0 con 0x7fee34004810 2023-10-07T08:47:59.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.824+0000 7fee53e9b700 1 -- 172.21.15.81:0/2720578228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c0b3420 con 0x7fee34004810 2023-10-07T08:47:59.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.824+0000 7fee49ffb700 1 -- 172.21.15.81:0/2720578228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0137b0 con 0x7fee34004810 2023-10-07T08:47:59.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.824+0000 7fee53e9b700 1 -- 172.21.15.81:0/2720578228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c0b2ea0 con 0x7fee34004810 2023-10-07T08:47:59.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.825+0000 7fee53e9b700 1 -- 172.21.15.81:0/2720578228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4c069e40 con 0x7fee34004810 2023-10-07T08:47:59.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.825+0000 7fee49ffb700 1 -- 172.21.15.81:0/2720578228 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee3c013ba0 con 0x7fee34004810 2023-10-07T08:47:59.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.826+0000 7fee49ffb700 1 --2- 172.21.15.81:0/2720578228 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee38066f30 0x7fee380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:47:59.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.826+0000 7fee51436700 1 --2- 172.21.15.81:0/2720578228 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee38066f30 0x7fee380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:47:59.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.826+0000 7fee49ffb700 1 -- 172.21.15.81:0/2720578228 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee3c084fc0 con 0x7fee34004810 2023-10-07T08:47:59.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.826+0000 7fee51436700 1 --2- 172.21.15.81:0/2720578228 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee38066f30 0x7fee380693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fee400091e0 tx=0x7fee4001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:47:59.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:47:59.830+0000 7fee49ffb700 1 -- 172.21.15.81:0/2720578228 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee3c052230 con 0x7fee34004810 2023-10-07T08:48:00.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.052+0000 7fee53e9b700 1 -- 172.21.15.81:0/2720578228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee4c04bb80 con 0x7fee34004810 2023-10-07T08:48:00.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.052+0000 7fee49ffb700 1 -- 172.21.15.81:0/2720578228 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fee3c055850 con 0x7fee34004810 2023-10-07T08:48:00.055 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:00.055 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1015639142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1015639142},{"type":"v1","addr":"172.21.15.89:6833","nonce":1015639142}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2650972762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2650972762},{"type":"v1","addr":"172.21.15.89:6835","nonce":2650972762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2058286084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2058286084},{"type":"v1","addr":"172.21.15.81:6836","nonce":2058286084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:47:49.671409+0000","modified":"2023-10-07T08:47:53.341944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6837/3696879604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3696879604},{"type":"v1","addr":"172.21.15.81:6837","nonce":3696879604}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-07T08:48:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.054+0000 7fee53e9b700 1 -- 172.21.15.81:0/2720578228 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee38066f30 msgr2=0x7fee380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.054+0000 7fee53e9b700 1 --2- 172.21.15.81:0/2720578228 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee38066f30 0x7fee380693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fee400091e0 tx=0x7fee4001a000 comp rx=0 tx=0).stop 2023-10-07T08:48:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.054+0000 7fee53e9b700 1 -- 172.21.15.81:0/2720578228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee34004810 msgr2=0x7fee4c153060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.054+0000 7fee53e9b700 1 --2- 172.21.15.81:0/2720578228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee34004810 0x7fee4c153060 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fee3c007af0 tx=0x7fee3c002210 comp rx=0 tx=0).stop 2023-10-07T08:48:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.055+0000 7fee53e9b700 1 -- 172.21.15.81:0/2720578228 shutdown_connections 2023-10-07T08:48:00.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.055+0000 7fee53e9b700 1 --2- 172.21.15.81:0/2720578228 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fee38066f30 0x7fee380693e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.055+0000 7fee53e9b700 1 --2- 172.21.15.81:0/2720578228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee4c0b2390 0x7fee4c16dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.055+0000 7fee53e9b700 1 --2- 172.21.15.81:0/2720578228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee34004810 0x7fee4c153060 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.055+0000 7fee53e9b700 1 --2- 172.21.15.81:0/2720578228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee4c15d950 0x7fee4c14f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.055+0000 7fee53e9b700 1 -- 172.21.15.81:0/2720578228 >> 172.21.15.81:0/2720578228 conn(0x7fee4c067640 msgr2=0x7fee4c1501b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:00.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.055+0000 7fee53e9b700 1 -- 172.21.15.81:0/2720578228 shutdown_connections 2023-10-07T08:48:00.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.055+0000 7fee53e9b700 1 -- 172.21.15.81:0/2720578228 wait complete. 2023-10-07T08:48:00.057 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 50 2023-10-07T08:48:00.470 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T08:47:49.671409+0000', 'modified': '2023-10-07T08:47:53.341944+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6336}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6336': {'gid': 6336, 'name': 'a', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.81:6837/3696879604', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 3696879604}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3696879604}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T08:48:00.470 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T08:48:00.471 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-07T08:48:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.585+0000 7f5f3d318700 1 Processor -- start 2023-10-07T08:48:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.585+0000 7f5f3d318700 1 -- start start 2023-10-07T08:48:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.586+0000 7f5f3d318700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5f380cdb60 0x7f5f380cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.586+0000 7f5f3d318700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f380ce510 con 0x7f5f38157df0 2023-10-07T08:48:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.586+0000 7f5f3d318700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3806c380 con 0x7f5f38157a20 2023-10-07T08:48:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.586+0000 7f5f3d318700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f380b0450 con 0x7f5f380cdb60 2023-10-07T08:48:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.586+0000 7f5f3cb17700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5f38157df0 0x7f5f38158270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53724/0 (socket says 172.21.15.81:53724) 2023-10-07T08:48:00.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.586+0000 7f5f3cb17700 1 -- 172.21.15.81:0/245052150 learned_addr learned my addr 172.21.15.81:0/245052150 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:00.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.586+0000 7f5f377fe700 1 --2- 172.21.15.81:0/245052150 >> v2:172.21.15.89:3300/0 conn(0x7f5f380cdb60 0x7f5f380cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.586+0000 7f5f36ffd700 1 -- 172.21.15.81:0/245052150 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903164485 0 0) 0x7f5f380ce510 con 0x7f5f38157df0 2023-10-07T08:48:00.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.586+0000 7f5f36ffd700 1 -- 172.21.15.81:0/245052150 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f24003570 con 0x7f5f38157df0 2023-10-07T08:48:00.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.586+0000 7f5f36ffd700 1 -- 172.21.15.81:0/245052150 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2790472335 0 0) 0x7f5f24003570 con 0x7f5f38157df0 2023-10-07T08:48:00.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.586+0000 7f5f36ffd700 1 -- 172.21.15.81:0/245052150 >> v2:172.21.15.89:3300/0 conn(0x7f5f380cdb60 msgr2=0x7f5f380cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:00.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.586+0000 7f5f36ffd700 1 --2- 172.21.15.81:0/245052150 >> v2:172.21.15.89:3300/0 conn(0x7f5f380cdb60 0x7f5f380cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.586+0000 7f5f36ffd700 1 -- 172.21.15.81:0/245052150 >> v1:172.21.15.89:6789/0 conn(0x7f5f38157a20 legacy=0x7f5f380af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:00.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f36ffd700 1 -- 172.21.15.81:0/245052150 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f380b0170 con 0x7f5f38157df0 2023-10-07T08:48:00.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f36ffd700 1 -- 172.21.15.81:0/245052150 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f5f300017f0 con 0x7f5f38157df0 2023-10-07T08:48:00.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f36ffd700 1 -- 172.21.15.81:0/245052150 >> v1:172.21.15.81:6789/0 conn(0x7f5f38157df0 legacy=0x7f5f38158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f36ffd700 1 --2- 172.21.15.81:0/245052150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f24003a60 0x7f5f24003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f36ffd700 1 --2- 172.21.15.81:0/245052150 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f24004810 0x7f5f24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f36ffd700 1 --2- 172.21.15.81:0/245052150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f240052e0 0x7f5f2400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f36ffd700 1 -- 172.21.15.81:0/245052150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380b0450 con 0x7f5f24003a60 2023-10-07T08:48:00.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f36ffd700 1 -- 172.21.15.81:0/245052150 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2400c190 con 0x7f5f240052e0 2023-10-07T08:48:00.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f36ffd700 1 -- 172.21.15.81:0/245052150 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2400c350 con 0x7f5f24004810 2023-10-07T08:48:00.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f37fff700 1 --2- 172.21.15.81:0/245052150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f24003a60 0x7f5f24003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f377fe700 1 --2- 172.21.15.81:0/245052150 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f24004810 0x7f5f24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f3cb17700 1 --2- 172.21.15.81:0/245052150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f240052e0 0x7f5f2400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f37fff700 1 -- 172.21.15.81:0/245052150 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f24004810 msgr2=0x7f5f24004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:00.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f37fff700 1 --2- 172.21.15.81:0/245052150 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f24004810 0x7f5f24004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f37fff700 1 -- 172.21.15.81:0/245052150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f240052e0 msgr2=0x7f5f2400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:00.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f37fff700 1 --2- 172.21.15.81:0/245052150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f240052e0 0x7f5f2400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f37fff700 1 -- 172.21.15.81:0/245052150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f24003570 con 0x7f5f24003a60 2023-10-07T08:48:00.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f3cb17700 1 -- 172.21.15.81:0/245052150 reap_dead start 2023-10-07T08:48:00.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f37fff700 1 --2- 172.21.15.81:0/245052150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f24003a60 0x7f5f24003e70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f5f200018b0 tx=0x7f5f20007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4144da6599aa5b63 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:00.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f36ffd700 1 -- 172.21.15.81:0/245052150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20012420 con 0x7f5f24003a60 2023-10-07T08:48:00.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f36ffd700 1 -- 172.21.15.81:0/245052150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f200125a0 con 0x7f5f24003a60 2023-10-07T08:48:00.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.587+0000 7f5f36ffd700 1 -- 172.21.15.81:0/245052150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20012960 con 0x7f5f24003a60 2023-10-07T08:48:00.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.588+0000 7f5f3d318700 1 -- 172.21.15.81:0/245052150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f24003a60 msgr2=0x7f5f24003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.588+0000 7f5f3d318700 1 --2- 172.21.15.81:0/245052150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f24003a60 0x7f5f24003e70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f5f200018b0 tx=0x7f5f20007d30 comp rx=0 tx=0).stop 2023-10-07T08:48:00.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.588+0000 7f5f3d318700 1 -- 172.21.15.81:0/245052150 shutdown_connections 2023-10-07T08:48:00.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.588+0000 7f5f3d318700 1 --2- 172.21.15.81:0/245052150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f24003a60 0x7f5f24003e70 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.588+0000 7f5f3d318700 1 -- 172.21.15.81:0/245052150 >> 172.21.15.81:0/245052150 conn(0x7f5f38063230 msgr2=0x7f5f38063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:00.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.588+0000 7f5f3d318700 1 -- 172.21.15.81:0/245052150 shutdown_connections 2023-10-07T08:48:00.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.588+0000 7f5f3d318700 1 -- 172.21.15.81:0/245052150 wait complete. 2023-10-07T08:48:00.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.589+0000 7f5f3d318700 1 Processor -- start 2023-10-07T08:48:00.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.589+0000 7f5f3d318700 1 -- start start 2023-10-07T08:48:00.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f3d318700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f24003a60 0x7f5f381484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f3d318700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f38152750 0x7f5f3815cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f3d318700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f3815b530 0x7f5f3806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f3d318700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f38148a00 con 0x7f5f24003a60 2023-10-07T08:48:00.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f3d318700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3815cab0 con 0x7f5f38152750 2023-10-07T08:48:00.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f3d318700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3815bea0 con 0x7f5f3815b530 2023-10-07T08:48:00.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f37fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f24003a60 0x7f5f381484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f37fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f24003a60 0x7f5f381484c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43160/0 (socket says 172.21.15.81:43160) 2023-10-07T08:48:00.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f37fff700 1 -- 172.21.15.81:0/2820883670 learned_addr learned my addr 172.21.15.81:0/2820883670 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:00.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f377fe700 1 --2- 172.21.15.81:0/2820883670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f38152750 0x7f5f3815cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f3cb17700 1 --2- 172.21.15.81:0/2820883670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f3815b530 0x7f5f3806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f37fff700 1 -- 172.21.15.81:0/2820883670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f3815b530 msgr2=0x7f5f3806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f37fff700 1 --2- 172.21.15.81:0/2820883670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f3815b530 0x7f5f3806dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f37fff700 1 -- 172.21.15.81:0/2820883670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f38152750 msgr2=0x7f5f3815cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f37fff700 1 --2- 172.21.15.81:0/2820883670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f38152750 0x7f5f3815cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f37fff700 1 -- 172.21.15.81:0/2820883670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3815c180 con 0x7f5f24003a60 2023-10-07T08:48:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.590+0000 7f5f37fff700 1 --2- 172.21.15.81:0/2820883670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f24003a60 0x7f5f381484c0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f5f20007a70 tx=0x7f5f20015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.591+0000 7f5f2ffff700 1 -- 172.21.15.81:0/2820883670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2001f6f0 con 0x7f5f24003a60 2023-10-07T08:48:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.591+0000 7f5f2ffff700 1 -- 172.21.15.81:0/2820883670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2001f870 con 0x7f5f24003a60 2023-10-07T08:48:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.591+0000 7f5f3d318700 1 -- 172.21.15.81:0/2820883670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3815c460 con 0x7f5f24003a60 2023-10-07T08:48:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.591+0000 7f5f2ffff700 1 -- 172.21.15.81:0/2820883670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2001fc30 con 0x7f5f24003a60 2023-10-07T08:48:00.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.591+0000 7f5f3d318700 1 -- 172.21.15.81:0/2820883670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3815d480 con 0x7f5f24003a60 2023-10-07T08:48:00.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.592+0000 7f5f2ffff700 1 -- 172.21.15.81:0/2820883670 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f2000c420 con 0x7f5f24003a60 2023-10-07T08:48:00.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.592+0000 7f5f2ffff700 1 --2- 172.21.15.81:0/2820883670 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5f18066f30 0x7f5f180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.592+0000 7f5f2ffff700 1 -- 172.21.15.81:0/2820883670 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f20085f20 con 0x7f5f24003a60 2023-10-07T08:48:00.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.592+0000 7f5f377fe700 1 --2- 172.21.15.81:0/2820883670 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5f18066f30 0x7f5f180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.593+0000 7f5f377fe700 1 --2- 172.21.15.81:0/2820883670 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5f18066f30 0x7f5f180693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5f38152b20 tx=0x7f5f28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.594+0000 7f5f47872b80 1 Processor -- start 2023-10-07T08:48:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.594+0000 7f5f47872b80 1 -- start start 2023-10-07T08:48:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.595+0000 7f5f47872b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x56233909d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.595+0000 7f5f47872b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5623390715f0 0x5623390be850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.595+0000 7f5f47872b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562339073b80 0x562339073ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.595+0000 7f5f47872b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562338fcaa70 con 0x5623390be480 2023-10-07T08:48:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.595+0000 7f5f47872b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562338fc8270 con 0x562339073b80 2023-10-07T08:48:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.595+0000 7f5f47872b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x562338fc4060 con 0x5623390715f0 2023-10-07T08:48:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.595+0000 7f5f37fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x56233909d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.595+0000 7f5f37fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x56233909d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43174/0 (socket says 172.21.15.81:43174) 2023-10-07T08:48:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.595+0000 7f5f37fff700 1 -- 172.21.15.81:0/2181345783 learned_addr learned my addr 172.21.15.81:0/2181345783 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.595+0000 7f5f3cb17700 1 --2- 172.21.15.81:0/2181345783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562339073b80 0x562339073ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.595+0000 7f5f377fe700 1 --2- 172.21.15.81:0/2181345783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5623390715f0 0x5623390be850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.596+0000 7f5f37fff700 1 -- 172.21.15.81:0/2181345783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5623390715f0 msgr2=0x5623390be850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.596+0000 7f5f37fff700 1 --2- 172.21.15.81:0/2181345783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5623390715f0 0x5623390be850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.596+0000 7f5f37fff700 1 -- 172.21.15.81:0/2181345783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562339073b80 msgr2=0x562339073ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.596+0000 7f5f37fff700 1 --2- 172.21.15.81:0/2181345783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562339073b80 0x562339073ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.596+0000 7f5f37fff700 1 -- 172.21.15.81:0/2181345783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562338e5e270 con 0x5623390be480 2023-10-07T08:48:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.596+0000 7f5f37fff700 1 --2- 172.21.15.81:0/2181345783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x56233909d7d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5f20056e00 tx=0x7f5f20084300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d8b1ec4bb33e13 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.596+0000 7f5f2d7fa700 1 -- 172.21.15.81:0/2181345783 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20056ed0 con 0x5623390be480 2023-10-07T08:48:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.596+0000 7f5f2d7fa700 1 -- 172.21.15.81:0/2181345783 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f20058e90 con 0x5623390be480 2023-10-07T08:48:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.596+0000 7f5f2d7fa700 1 -- 172.21.15.81:0/2181345783 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2005a0c0 con 0x5623390be480 2023-10-07T08:48:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.596+0000 7f5f47872b80 1 -- 172.21.15.81:0/2181345783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 msgr2=0x56233909d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.597+0000 7f5f47872b80 1 --2- 172.21.15.81:0/2181345783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x56233909d7d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5f20056e00 tx=0x7f5f20084300 comp rx=0 tx=0).stop 2023-10-07T08:48:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.597+0000 7f5f47872b80 1 -- 172.21.15.81:0/2181345783 shutdown_connections 2023-10-07T08:48:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.597+0000 7f5f47872b80 1 --2- 172.21.15.81:0/2181345783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562339073b80 0x562339073ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.597+0000 7f5f47872b80 1 --2- 172.21.15.81:0/2181345783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x56233909d7d0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.597+0000 7f5f47872b80 1 --2- 172.21.15.81:0/2181345783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5623390715f0 0x5623390be850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.597+0000 7f5f47872b80 1 -- 172.21.15.81:0/2181345783 >> 172.21.15.81:0/2181345783 conn(0x5623390750c0 msgr2=0x5623390758f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.597+0000 7f5f47872b80 1 -- 172.21.15.81:0/2181345783 shutdown_connections 2023-10-07T08:48:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.597+0000 7f5f47872b80 1 -- 172.21.15.81:0/2181345783 wait complete. 2023-10-07T08:48:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.597+0000 7f5f47872b80 1 -- start start 2023-10-07T08:48:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.597+0000 7f5f47872b80 1 Processor -- start 2023-10-07T08:48:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f47872b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5623390715f0 0x562339097980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f47872b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562339073b80 0x5623390ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f47872b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x56233906a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f47872b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562338f6f890 con 0x5623390be480 2023-10-07T08:48:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f47872b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562338f8aea0 con 0x562339073b80 2023-10-07T08:48:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f47872b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x562338e46e30 con 0x5623390715f0 2023-10-07T08:48:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f47872b80 10 client.0 _ll_register_callbacks cb 0x5623390372c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:48:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f3cb17700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x56233906a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f3cb17700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x56233906a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43184/0 (socket says 172.21.15.81:43184) 2023-10-07T08:48:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f3cb17700 1 -- 172.21.15.81:0/1441565815 learned_addr learned my addr 172.21.15.81:0/1441565815 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f377fe700 1 --2- 172.21.15.81:0/1441565815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562339073b80 0x5623390ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f37fff700 1 --2- 172.21.15.81:0/1441565815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5623390715f0 0x562339097980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f3cb17700 1 -- 172.21.15.81:0/1441565815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5623390715f0 msgr2=0x562339097980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f3cb17700 1 --2- 172.21.15.81:0/1441565815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5623390715f0 0x562339097980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f3cb17700 1 -- 172.21.15.81:0/1441565815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562339073b80 msgr2=0x5623390ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f3cb17700 1 --2- 172.21.15.81:0/1441565815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562339073b80 0x5623390ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.598+0000 7f5f3cb17700 1 -- 172.21.15.81:0/1441565815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3815d480 con 0x5623390be480 2023-10-07T08:48:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f3cb17700 1 --2- 172.21.15.81:0/1441565815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x56233906a8a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5f380b0850 tx=0x7f5f380ccf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e55dde955625b6b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f167fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:48:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f167fc700 1 -- 172.21.15.81:0/1441565815 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30011db0 con 0x5623390be480 2023-10-07T08:48:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f167fc700 1 -- 172.21.15.81:0/1441565815 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f30016450 con 0x5623390be480 2023-10-07T08:48:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f47872b80 1 -- 172.21.15.81:0/1441565815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562339068cd0 con 0x5623390be480 2023-10-07T08:48:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f167fc700 1 -- 172.21.15.81:0/1441565815 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f30016820 con 0x5623390be480 2023-10-07T08:48:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f47872b80 10 client.6501 fetch_fsmap learned FSMap version 50 2023-10-07T08:48:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f47872b80 1 -- 172.21.15.81:0/1441565815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x562338e00fe0 con 0x5623390be480 2023-10-07T08:48:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f167fc700 1 -- 172.21.15.81:0/1441565815 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562339068cd0 con 0x5623390be480 2023-10-07T08:48:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f167fc700 1 -- 172.21.15.81:0/1441565815 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 50) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5f30016980 con 0x5623390be480 2023-10-07T08:48:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f47872b80 10 client.6501 fetch_fsmap finished waiting for FSMap version 50 2023-10-07T08:48:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f47872b80 10 client.6501 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T08:48:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f47872b80 20 client.6501 populate_metadata read hostname 'smithi081' 2023-10-07T08:48:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f47872b80 1 --2- 172.21.15.81:0/1441565815 >> [v2:172.21.15.81:6835/3696879604,v1:172.21.15.81:6837/3696879604] conn(0x5623390ca660 0x5623390cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f47872b80 4 client.6501 mds_command: new command op to 6336 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T08:48:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f47872b80 1 -- 172.21.15.81:0/1441565815 --> [v2:172.21.15.81:6835/3696879604,v1:172.21.15.81:6837/3696879604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562339045aa0 con 0x5623390ca660 2023-10-07T08:48:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.599+0000 7f5f37fff700 1 --2- 172.21.15.81:0/1441565815 >> [v2:172.21.15.81:6835/3696879604,v1:172.21.15.81:6837/3696879604] conn(0x5623390ca660 0x5623390cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f167fc700 10 client.6501 ms_handle_connect on v2:172.21.15.81:6835/3696879604 2023-10-07T08:48:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f37fff700 1 --2- 172.21.15.81:0/1441565815 >> [v2:172.21.15.81:6835/3696879604,v1:172.21.15.81:6837/3696879604] conn(0x5623390ca660 0x5623390cb430 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=517373821f7c43b9 server_cookie=2c6982d35472bc7e in_seq=0 out_seq=0 2023-10-07T08:48:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f167fc700 1 -- 172.21.15.81:0/1441565815 <== mds.0 v2:172.21.15.81:6835/3696879604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x562339045aa0 con 0x5623390ca660 2023-10-07T08:48:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f167fc700 10 client.6501 handle_command_reply: tid=0 2023-10-07T08:48:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f47872b80 1 client.6501 shutdown 2023-10-07T08:48:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f47872b80 1 -- 172.21.15.81:0/1441565815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 msgr2=0x56233906a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f47872b80 1 --2- 172.21.15.81:0/1441565815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x56233906a8a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5f380b0850 tx=0x7f5f380ccf20 comp rx=0 tx=0).stop 2023-10-07T08:48:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f47872b80 1 -- 172.21.15.81:0/1441565815 shutdown_connections 2023-10-07T08:48:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f47872b80 1 --2- 172.21.15.81:0/1441565815 >> [v2:172.21.15.81:6835/3696879604,v1:172.21.15.81:6837/3696879604] conn(0x5623390ca660 0x5623390cb430 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f47872b80 1 --2- 172.21.15.81:0/1441565815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x56233906a8a0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f167fc700 0 client.6501 ms_handle_reset on v2:172.21.15.81:6835/3696879604 2023-10-07T08:48:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f47872b80 1 --2- 172.21.15.81:0/1441565815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5623390715f0 0x562339097980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f47872b80 1 --2- 172.21.15.81:0/1441565815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562339073b80 0x5623390ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f47872b80 1 -- 172.21.15.81:0/1441565815 >> 172.21.15.81:0/1441565815 conn(0x5623390750c0 msgr2=0x562339070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f47872b80 1 -- 172.21.15.81:0/1441565815 shutdown_connections 2023-10-07T08:48:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f47872b80 1 -- 172.21.15.81:0/1441565815 wait complete. 2023-10-07T08:48:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.600+0000 7f5f47872b80 20 client.6501 trim_cache size 0 max 16384 2023-10-07T08:48:00.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.617+0000 7f5f47872b80 1 Processor -- start 2023-10-07T08:48:00.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.617+0000 7f5f47872b80 1 -- start start 2023-10-07T08:48:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f47872b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5623390715f0 0x5623390969e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f47872b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562339073b80 0x562339096f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f47872b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x5623390a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f47872b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562339074850 con 0x5623390be480 2023-10-07T08:48:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f47872b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562339073590 con 0x5623390715f0 2023-10-07T08:48:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f47872b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56233909da20 con 0x562339073b80 2023-10-07T08:48:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f3cb17700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x5623390a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f3cb17700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x5623390a04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43186/0 (socket says 172.21.15.81:43186) 2023-10-07T08:48:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f3cb17700 1 -- 172.21.15.81:0/22477877 learned_addr learned my addr 172.21.15.81:0/22477877 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f37fff700 1 --2- 172.21.15.81:0/22477877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5623390715f0 0x5623390969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f377fe700 1 --2- 172.21.15.81:0/22477877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562339073b80 0x562339096f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f3cb17700 1 -- 172.21.15.81:0/22477877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562339073b80 msgr2=0x562339096f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f3cb17700 1 --2- 172.21.15.81:0/22477877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562339073b80 0x562339096f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f3cb17700 1 -- 172.21.15.81:0/22477877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5623390715f0 msgr2=0x5623390969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f3cb17700 1 --2- 172.21.15.81:0/22477877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5623390715f0 0x5623390969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f3cb17700 1 -- 172.21.15.81:0/22477877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562338f92780 con 0x5623390be480 2023-10-07T08:48:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f377fe700 1 --2- 172.21.15.81:0/22477877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562339073b80 0x562339096f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.618+0000 7f5f3cb17700 1 --2- 172.21.15.81:0/22477877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x5623390a04c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5f30002250 tx=0x7f5f3001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc1098581adc9ea server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.619+0000 7f5f2dffb700 1 -- 172.21.15.81:0/22477877 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30016da0 con 0x5623390be480 2023-10-07T08:48:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.619+0000 7f5f2dffb700 1 -- 172.21.15.81:0/22477877 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3000b020 con 0x5623390be480 2023-10-07T08:48:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.619+0000 7f5f2dffb700 1 -- 172.21.15.81:0/22477877 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30000f40 con 0x5623390be480 2023-10-07T08:48:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.619+0000 7f5f47872b80 1 -- 172.21.15.81:0/22477877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 msgr2=0x5623390a04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.619+0000 7f5f47872b80 1 --2- 172.21.15.81:0/22477877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x5623390a04c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5f30002250 tx=0x7f5f3001c000 comp rx=0 tx=0).stop 2023-10-07T08:48:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.619+0000 7f5f47872b80 1 -- 172.21.15.81:0/22477877 shutdown_connections 2023-10-07T08:48:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.619+0000 7f5f47872b80 1 --2- 172.21.15.81:0/22477877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623390be480 0x5623390a04c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.619+0000 7f5f47872b80 1 --2- 172.21.15.81:0/22477877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5623390715f0 0x5623390969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.619+0000 7f5f47872b80 1 --2- 172.21.15.81:0/22477877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562339073b80 0x562339096f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.619+0000 7f5f47872b80 1 -- 172.21.15.81:0/22477877 >> 172.21.15.81:0/22477877 conn(0x5623390750c0 msgr2=0x56233906a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.619+0000 7f5f47872b80 1 -- 172.21.15.81:0/22477877 shutdown_connections 2023-10-07T08:48:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.619+0000 7f5f47872b80 1 -- 172.21.15.81:0/22477877 wait complete. 2023-10-07T08:48:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.620+0000 7f5f47872b80 1 -- start start 2023-10-07T08:48:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.620+0000 7f5f47872b80 1 Processor -- start 2023-10-07T08:48:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f47872b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5623390715f0 0x562339116860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f47872b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562339073b80 0x56233909a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f47872b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5623390be480 0x5623390d9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f47872b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562339116da0 con 0x562339073b80 2023-10-07T08:48:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f47872b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623390da2f0 con 0x5623390be480 2023-10-07T08:48:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f47872b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x562339098110 con 0x5623390715f0 2023-10-07T08:48:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f47872b80 10 client.0 _ll_register_callbacks cb 0x5623390372c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:48:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562339073b80 0x56233909a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562339073b80 0x56233909a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43190/0 (socket says 172.21.15.81:43190) 2023-10-07T08:48:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f377fe700 1 -- 172.21.15.81:0/3730694516 learned_addr learned my addr 172.21.15.81:0/3730694516 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f37fff700 1 --2- 172.21.15.81:0/3730694516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5623390715f0 0x562339116860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f3cb17700 1 --2- 172.21.15.81:0/3730694516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5623390be480 0x5623390d9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f377fe700 1 -- 172.21.15.81:0/3730694516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5623390715f0 msgr2=0x562339116860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f377fe700 1 --2- 172.21.15.81:0/3730694516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5623390715f0 0x562339116860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f377fe700 1 -- 172.21.15.81:0/3730694516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5623390be480 msgr2=0x5623390d9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f377fe700 1 --2- 172.21.15.81:0/3730694516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5623390be480 0x5623390d9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f377fe700 1 -- 172.21.15.81:0/3730694516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562338e00fe0 con 0x562339073b80 2023-10-07T08:48:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f377fe700 1 --2- 172.21.15.81:0/3730694516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562339073b80 0x56233909a420 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5f38153440 tx=0x7f5f28019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa485b375fd4856 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f167fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:48:00.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f167fc700 1 -- 172.21.15.81:0/3730694516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f280128a0 con 0x562339073b80 2023-10-07T08:48:00.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f167fc700 1 -- 172.21.15.81:0/3730694516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f28023650 con 0x562339073b80 2023-10-07T08:48:00.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f47872b80 1 -- 172.21.15.81:0/3730694516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f20058e90 con 0x562339073b80 2023-10-07T08:48:00.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f167fc700 1 -- 172.21.15.81:0/3730694516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f28023a20 con 0x562339073b80 2023-10-07T08:48:00.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f47872b80 10 client.6507 fetch_fsmap learned FSMap version 50 2023-10-07T08:48:00.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.621+0000 7f5f47872b80 1 -- 172.21.15.81:0/3730694516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x562338f79470 con 0x562339073b80 2023-10-07T08:48:00.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f167fc700 1 -- 172.21.15.81:0/3730694516 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f20058e90 con 0x562339073b80 2023-10-07T08:48:00.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f167fc700 1 -- 172.21.15.81:0/3730694516 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 50) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5f28023b80 con 0x562339073b80 2023-10-07T08:48:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 10 client.6507 fetch_fsmap finished waiting for FSMap version 50 2023-10-07T08:48:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 10 client.6507 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T08:48:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 20 client.6507 populate_metadata read hostname 'smithi081' 2023-10-07T08:48:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 1 --2- 172.21.15.81:0/3730694516 >> [v2:172.21.15.81:6835/3696879604,v1:172.21.15.81:6837/3696879604] conn(0x5623390a04c0 0x5623390a0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 4 client.6507 mds_command: new command op to 6336 tid=0[{"prefix": "status"}] 2023-10-07T08:48:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 1 -- 172.21.15.81:0/3730694516 --> [v2:172.21.15.81:6835/3696879604,v1:172.21.15.81:6837/3696879604] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562338f66e00 con 0x5623390a04c0 2023-10-07T08:48:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f37fff700 1 --2- 172.21.15.81:0/3730694516 >> [v2:172.21.15.81:6835/3696879604,v1:172.21.15.81:6837/3696879604] conn(0x5623390a04c0 0x5623390a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f167fc700 10 client.6507 ms_handle_connect on v2:172.21.15.81:6835/3696879604 2023-10-07T08:48:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f37fff700 1 --2- 172.21.15.81:0/3730694516 >> [v2:172.21.15.81:6835/3696879604,v1:172.21.15.81:6837/3696879604] conn(0x5623390a04c0 0x5623390a0890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be54988c4e868cf server_cookie=a0cd090d66e8f6e3 in_seq=0 out_seq=0 2023-10-07T08:48:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f167fc700 1 -- 172.21.15.81:0/3730694516 <== mds.0 v2:172.21.15.81:6835/3696879604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x562338f66e00 con 0x5623390a04c0 2023-10-07T08:48:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f167fc700 10 client.6507 handle_command_reply: tid=0 2023-10-07T08:48:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 1 client.6507 shutdown 2023-10-07T08:48:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 1 -- 172.21.15.81:0/3730694516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562339073b80 msgr2=0x56233909a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 1 --2- 172.21.15.81:0/3730694516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562339073b80 0x56233909a420 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5f38153440 tx=0x7f5f28019000 comp rx=0 tx=0).stop 2023-10-07T08:48:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 1 -- 172.21.15.81:0/3730694516 shutdown_connections 2023-10-07T08:48:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 1 --2- 172.21.15.81:0/3730694516 >> [v2:172.21.15.81:6835/3696879604,v1:172.21.15.81:6837/3696879604] conn(0x5623390a04c0 0x5623390a0890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 1 --2- 172.21.15.81:0/3730694516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5623390be480 0x5623390d9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 1 --2- 172.21.15.81:0/3730694516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5623390715f0 0x562339116860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f167fc700 0 client.6507 ms_handle_reset on v2:172.21.15.81:6835/3696879604 2023-10-07T08:48:00.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 1 --2- 172.21.15.81:0/3730694516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562339073b80 0x56233909a420 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 1 -- 172.21.15.81:0/3730694516 >> 172.21.15.81:0/3730694516 conn(0x5623390750c0 msgr2=0x562339096bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:00.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 1 -- 172.21.15.81:0/3730694516 shutdown_connections 2023-10-07T08:48:00.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.622+0000 7f5f47872b80 1 -- 172.21.15.81:0/3730694516 wait complete. 2023-10-07T08:48:00.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.623+0000 7f5f47872b80 20 client.6507 trim_cache size 0 max 16384 2023-10-07T08:48:00.635 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:48:00.635 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:48:00.635 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-07T08:48:00.635 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6336, 2023-10-07T08:48:00.635 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-07T08:48:00.635 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-07T08:48:00.635 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-07T08:48:00.636 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 10.305546436, 2023-10-07T08:48:00.636 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 50, 2023-10-07T08:48:00.636 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 102, 2023-10-07T08:48:00.636 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 102, 2023-10-07T08:48:00.636 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 21.637510796000001 2023-10-07T08:48:00.636 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:48:00.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.623+0000 7f5f3d318700 1 -- 172.21.15.81:0/2820883670 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5f18066f30 msgr2=0x7f5f180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.623+0000 7f5f3d318700 1 --2- 172.21.15.81:0/2820883670 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5f18066f30 0x7f5f180693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5f38152b20 tx=0x7f5f28008040 comp rx=0 tx=0).stop 2023-10-07T08:48:00.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.623+0000 7f5f3d318700 1 -- 172.21.15.81:0/2820883670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f24003a60 msgr2=0x7f5f381484c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.623+0000 7f5f3d318700 1 --2- 172.21.15.81:0/2820883670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f24003a60 0x7f5f381484c0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f5f20007a70 tx=0x7f5f20015000 comp rx=0 tx=0).stop 2023-10-07T08:48:00.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.623+0000 7f5f3d318700 1 -- 172.21.15.81:0/2820883670 shutdown_connections 2023-10-07T08:48:00.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.623+0000 7f5f3d318700 1 --2- 172.21.15.81:0/2820883670 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5f18066f30 0x7f5f180693e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.623+0000 7f5f3d318700 1 --2- 172.21.15.81:0/2820883670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f3815b530 0x7f5f3806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.623+0000 7f5f3d318700 1 --2- 172.21.15.81:0/2820883670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f24003a60 0x7f5f381484c0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.623+0000 7f5f3d318700 1 --2- 172.21.15.81:0/2820883670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f38152750 0x7f5f3815cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.623+0000 7f5f3d318700 1 -- 172.21.15.81:0/2820883670 >> 172.21.15.81:0/2820883670 conn(0x7f5f38063230 msgr2=0x7f5f380cc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:00.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.623+0000 7f5f3d318700 1 -- 172.21.15.81:0/2820883670 shutdown_connections 2023-10-07T08:48:00.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.623+0000 7f5f3d318700 1 -- 172.21.15.81:0/2820883670 wait complete. 2023-10-07T08:48:00.639 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:48:00.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.752+0000 7f2f66aa7700 1 Processor -- start 2023-10-07T08:48:00.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.752+0000 7f2f66aa7700 1 -- start start 2023-10-07T08:48:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f66aa7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2f6015a2a0 0x7f2f600b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f66aa7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f600b0ca0 con 0x7f2f6006dd60 2023-10-07T08:48:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f66aa7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f600b00d0 con 0x7f2f600ceb30 2023-10-07T08:48:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f66aa7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6006e160 con 0x7f2f6015a2a0 2023-10-07T08:48:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f65044700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2f6006dd60 0x7f2f600b1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53730/0 (socket says 172.21.15.81:53730) 2023-10-07T08:48:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f65044700 1 -- 172.21.15.81:0/238248823 learned_addr learned my addr 172.21.15.81:0/238248823 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f64843700 1 --2- 172.21.15.81:0/238248823 >> v2:172.21.15.89:3300/0 conn(0x7f2f6015a2a0 0x7f2f600b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f5f7fe700 1 -- 172.21.15.81:0/238248823 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423151574 0 0) 0x7f2f600b0ca0 con 0x7f2f6006dd60 2023-10-07T08:48:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f5f7fe700 1 -- 172.21.15.81:0/238248823 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f4c003570 con 0x7f2f6006dd60 2023-10-07T08:48:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f5f7fe700 1 -- 172.21.15.81:0/238248823 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 814995512 0 0) 0x7f2f4c003570 con 0x7f2f6006dd60 2023-10-07T08:48:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f5f7fe700 1 -- 172.21.15.81:0/238248823 >> v2:172.21.15.89:3300/0 conn(0x7f2f6015a2a0 msgr2=0x7f2f600b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f5f7fe700 1 --2- 172.21.15.81:0/238248823 >> v2:172.21.15.89:3300/0 conn(0x7f2f6015a2a0 0x7f2f600b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f5f7fe700 1 -- 172.21.15.81:0/238248823 >> v1:172.21.15.89:6789/0 conn(0x7f2f600ceb30 legacy=0x7f2f6006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f5f7fe700 1 -- 172.21.15.81:0/238248823 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f600b0370 con 0x7f2f6006dd60 2023-10-07T08:48:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f5f7fe700 1 -- 172.21.15.81:0/238248823 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f2f48001470 con 0x7f2f6006dd60 2023-10-07T08:48:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f5f7fe700 1 -- 172.21.15.81:0/238248823 >> v1:172.21.15.81:6789/0 conn(0x7f2f6006dd60 legacy=0x7f2f600b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f5f7fe700 1 --2- 172.21.15.81:0/238248823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f4c003a60 0x7f2f4c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.753+0000 7f2f5f7fe700 1 --2- 172.21.15.81:0/238248823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f4c004810 0x7f2f4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f5f7fe700 1 --2- 172.21.15.81:0/238248823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f4c0051c0 0x7f2f4c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f5f7fe700 1 -- 172.21.15.81:0/238248823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6006e160 con 0x7f2f4c004810 2023-10-07T08:48:00.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f5f7fe700 1 -- 172.21.15.81:0/238248823 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c00c0d0 con 0x7f2f4c0051c0 2023-10-07T08:48:00.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f5f7fe700 1 -- 172.21.15.81:0/238248823 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c00c290 con 0x7f2f4c003a60 2023-10-07T08:48:00.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f5ffff700 1 --2- 172.21.15.81:0/238248823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f4c004810 0x7f2f4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f65044700 1 --2- 172.21.15.81:0/238248823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f4c0051c0 0x7f2f4c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f64843700 1 --2- 172.21.15.81:0/238248823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f4c003a60 0x7f2f4c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f5ffff700 1 -- 172.21.15.81:0/238248823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f4c003a60 msgr2=0x7f2f4c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:00.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f5ffff700 1 --2- 172.21.15.81:0/238248823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f4c003a60 0x7f2f4c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f5ffff700 1 -- 172.21.15.81:0/238248823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f4c0051c0 msgr2=0x7f2f4c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:00.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f5ffff700 1 --2- 172.21.15.81:0/238248823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f4c0051c0 0x7f2f4c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f65044700 1 -- 172.21.15.81:0/238248823 reap_dead start 2023-10-07T08:48:00.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f5ffff700 1 -- 172.21.15.81:0/238248823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c003570 con 0x7f2f4c004810 2023-10-07T08:48:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f5ffff700 1 --2- 172.21.15.81:0/238248823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f4c004810 0x7f2f4c004c80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2f50001fc0 tx=0x7f2f50001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd8a805529e3411 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f5f7fe700 1 -- 172.21.15.81:0/238248823 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50001950 con 0x7f2f4c004810 2023-10-07T08:48:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f5f7fe700 1 -- 172.21.15.81:0/238248823 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5000c8b0 con 0x7f2f4c004810 2023-10-07T08:48:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.754+0000 7f2f5f7fe700 1 -- 172.21.15.81:0/238248823 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5000cc50 con 0x7f2f4c004810 2023-10-07T08:48:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.755+0000 7f2f66aa7700 1 -- 172.21.15.81:0/238248823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f4c004810 msgr2=0x7f2f4c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.755+0000 7f2f66aa7700 1 --2- 172.21.15.81:0/238248823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f4c004810 0x7f2f4c004c80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2f50001fc0 tx=0x7f2f50001640 comp rx=0 tx=0).stop 2023-10-07T08:48:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.755+0000 7f2f66aa7700 1 -- 172.21.15.81:0/238248823 shutdown_connections 2023-10-07T08:48:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.755+0000 7f2f66aa7700 1 --2- 172.21.15.81:0/238248823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f4c004810 0x7f2f4c004c80 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.755+0000 7f2f66aa7700 1 -- 172.21.15.81:0/238248823 >> 172.21.15.81:0/238248823 conn(0x7f2f60067640 msgr2=0x7f2f60067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.755+0000 7f2f66aa7700 1 -- 172.21.15.81:0/238248823 shutdown_connections 2023-10-07T08:48:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.755+0000 7f2f66aa7700 1 -- 172.21.15.81:0/238248823 wait complete. 2023-10-07T08:48:00.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.756+0000 7f2f66aa7700 1 Processor -- start 2023-10-07T08:48:00.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.756+0000 7f2f66aa7700 1 -- start start 2023-10-07T08:48:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f66aa7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f4c004810 0x7f2f60155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f66aa7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6015d130 0x7f2f6015d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f66aa7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f6015efd0 0x7f2f6015f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f66aa7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6016a340 con 0x7f2f6015d130 2023-10-07T08:48:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f66aa7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6015dae0 con 0x7f2f4c004810 2023-10-07T08:48:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f66aa7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6016b130 con 0x7f2f6015efd0 2023-10-07T08:48:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f5ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6015d130 0x7f2f6015d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f5ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6015d130 0x7f2f6015d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43206/0 (socket says 172.21.15.81:43206) 2023-10-07T08:48:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f5ffff700 1 -- 172.21.15.81:0/186891067 learned_addr learned my addr 172.21.15.81:0/186891067 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f65044700 1 --2- 172.21.15.81:0/186891067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f6015efd0 0x7f2f6015f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f64843700 1 --2- 172.21.15.81:0/186891067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f4c004810 0x7f2f60155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f5ffff700 1 -- 172.21.15.81:0/186891067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f6015efd0 msgr2=0x7f2f6015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f5ffff700 1 --2- 172.21.15.81:0/186891067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f6015efd0 0x7f2f6015f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f5ffff700 1 -- 172.21.15.81:0/186891067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f4c004810 msgr2=0x7f2f60155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f5ffff700 1 --2- 172.21.15.81:0/186891067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f4c004810 0x7f2f60155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f5ffff700 1 -- 172.21.15.81:0/186891067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6016a520 con 0x7f2f6015d130 2023-10-07T08:48:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f5ffff700 1 --2- 172.21.15.81:0/186891067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6015d130 0x7f2f6015d5a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000c6a0 tx=0x7f2f50015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f5cff9700 1 -- 172.21.15.81:0/186891067 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50001950 con 0x7f2f6015d130 2023-10-07T08:48:00.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f5cff9700 1 -- 172.21.15.81:0/186891067 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5000c6d0 con 0x7f2f6015d130 2023-10-07T08:48:00.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f66aa7700 1 -- 172.21.15.81:0/186891067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6016a800 con 0x7f2f6015d130 2023-10-07T08:48:00.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f5cff9700 1 -- 172.21.15.81:0/186891067 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50026630 con 0x7f2f6015d130 2023-10-07T08:48:00.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.757+0000 7f2f66aa7700 1 -- 172.21.15.81:0/186891067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6016adc0 con 0x7f2f6015d130 2023-10-07T08:48:00.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.758+0000 7f2f66aa7700 1 -- 172.21.15.81:0/186891067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f60069e40 con 0x7f2f6015d130 2023-10-07T08:48:00.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.759+0000 7f2f5cff9700 1 -- 172.21.15.81:0/186891067 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f50019030 con 0x7f2f6015d130 2023-10-07T08:48:00.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.759+0000 7f2f5cff9700 1 --2- 172.21.15.81:0/186891067 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f40066f30 0x7f2f400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:00.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.759+0000 7f2f5cff9700 1 -- 172.21.15.81:0/186891067 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f50085fb0 con 0x7f2f6015d130 2023-10-07T08:48:00.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.759+0000 7f2f64843700 1 --2- 172.21.15.81:0/186891067 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f40066f30 0x7f2f400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:00.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.759+0000 7f2f64843700 1 --2- 172.21.15.81:0/186891067 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f40066f30 0x7f2f400693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2f58006f00 tx=0x7f2f580091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:00.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.763+0000 7f2f5cff9700 1 -- 172.21.15.81:0/186891067 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f500b75a0 con 0x7f2f6015d130 2023-10-07T08:48:00.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.989+0000 7f2f66aa7700 1 -- 172.21.15.81:0/186891067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2f6016b270 con 0x7f2f6015d130 2023-10-07T08:48:00.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.989+0000 7f2f5cff9700 1 -- 172.21.15.81:0/186891067 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2f50017070 con 0x7f2f6015d130 2023-10-07T08:48:00.991 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:48:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.991+0000 7f2f66aa7700 1 -- 172.21.15.81:0/186891067 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f40066f30 msgr2=0x7f2f400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.991+0000 7f2f66aa7700 1 --2- 172.21.15.81:0/186891067 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f40066f30 0x7f2f400693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2f58006f00 tx=0x7f2f580091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.991+0000 7f2f66aa7700 1 -- 172.21.15.81:0/186891067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6015d130 msgr2=0x7f2f6015d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.991+0000 7f2f66aa7700 1 --2- 172.21.15.81:0/186891067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6015d130 0x7f2f6015d5a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000c6a0 tx=0x7f2f50015000 comp rx=0 tx=0).stop 2023-10-07T08:48:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.991+0000 7f2f66aa7700 1 -- 172.21.15.81:0/186891067 shutdown_connections 2023-10-07T08:48:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.991+0000 7f2f66aa7700 1 --2- 172.21.15.81:0/186891067 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2f40066f30 0x7f2f400693e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.991+0000 7f2f66aa7700 1 --2- 172.21.15.81:0/186891067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f6015efd0 0x7f2f6015f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.991+0000 7f2f66aa7700 1 --2- 172.21.15.81:0/186891067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f4c004810 0x7f2f60155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.991+0000 7f2f66aa7700 1 --2- 172.21.15.81:0/186891067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f6015d130 0x7f2f6015d5a0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.991+0000 7f2f66aa7700 1 -- 172.21.15.81:0/186891067 >> 172.21.15.81:0/186891067 conn(0x7f2f60067640 msgr2=0x7f2f60157f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.991+0000 7f2f66aa7700 1 -- 172.21.15.81:0/186891067 shutdown_connections 2023-10-07T08:48:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:00.991+0000 7f2f66aa7700 1 -- 172.21.15.81:0/186891067 wait complete. 2023-10-07T08:48:01.004 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:48:01.004 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:48:01.004 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-07T08:48:01.004 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T08:48:01.005 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T08:48:01.005 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:48:01.005 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:48:01.005 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:48:01.005 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:48:01.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:01.005 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-07T08:48:01.020 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:48:01.021 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:48:01.021 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:48:01.021 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:01.021 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-07T08:48:01.021 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:01.021 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:48:01.021 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:01.021 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-07T08:48:01.021 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:48:01.021 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:01.022 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-07T08:48:01.022 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:48:01.022 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:01.022 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:48:01.022 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:01.022 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:48:01.022 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42247sec preferred_lft 42247sec 2023-10-07T08:48:01.022 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-10-07T08:48:01.022 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:01.022 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:48:01.022 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:01.023 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:48:01.023 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:01.023 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::8c72:9ff:fe74:8c7e/64 scope link 2023-10-07T08:48:01.023 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:01.023 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:48:01.023 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:fe:81:9d:9c:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T08:48:01.023 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8fe:81ff:fe9d:9c0a/64 scope link 2023-10-07T08:48:01.023 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:01.023 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:48:01.023 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T08:48:01.023 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d838:b7ff:fe6e:914d/64 scope link 2023-10-07T08:48:01.023 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:01.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:01.024 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:48:01.084 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-07T08:48:01.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:01.085 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-07T08:48:01.141 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-07T08:48:01.141 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:48:01.142 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:48:01.142 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:48:01.142 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:48:01.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:01.142 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:48:01.142 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:48:01.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:48:01.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:48:01.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:48:01.143 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:48:01.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:01.242 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-07T08:48:01.256 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T08:48:01.256 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T08:48:01.257 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:48:01.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:01.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-07T08:48:01.321 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:48:01.321 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T08:48:01.375 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:48:01.376 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:48:01.376 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:48:01.431 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:48:01.431 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:48:01.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:48:01.511 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:48:01.511 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:48:01.511 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:48:01.519 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:48:01.519 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:48:01.520 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:48:01.520 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:48:01.520 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:48:01.542 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:48:01.542 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:48:01.542 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:48:01.542 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:48:01.542 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:48:01.542 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:48:01.542 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:48:01.542 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:48:01.544 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:48:01.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:01.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:48:01.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:48:01.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.763+0000 7ff1bb59e700 1 Processor -- start 2023-10-07T08:48:01.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.763+0000 7ff1bb59e700 1 -- start start 2023-10-07T08:48:01.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.764+0000 7ff1bb59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1bc159b40 0x7ff1bc0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:01.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.764+0000 7ff1bb59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1bc159f10 0x7ff1bc068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.764+0000 7ff1bb59e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff1bc0ccb40 0x7ff1bc068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.764+0000 7ff1bb59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1bc0cee10 con 0x7ff1bc159b40 2023-10-07T08:48:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.764+0000 7ff1bb59e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1bc0cd040 con 0x7ff1bc0ccb40 2023-10-07T08:48:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.764+0000 7ff1bb59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc0cd320 con 0x7ff1bc159f10 2023-10-07T08:48:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.764+0000 7ff1ba59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1bc159b40 0x7ff1bc0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.764+0000 7ff1ba59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1bc159b40 0x7ff1bc0cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43222/0 (socket says 172.21.15.81:43222) 2023-10-07T08:48:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.764+0000 7ff1ba59c700 1 -- 172.21.15.81:0/2453454498 learned_addr learned my addr 172.21.15.81:0/2453454498 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.765+0000 7ff1b9d9b700 1 --2- 172.21.15.81:0/2453454498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1bc159f10 0x7ff1bc068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.765+0000 7ff1bad9d700 1 --2- 172.21.15.81:0/2453454498 >> v2:172.21.15.89:3300/0 conn(0x7ff1bc0ccb40 0x7ff1bc068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.765+0000 7ff1ba59c700 1 -- 172.21.15.81:0/2453454498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1bc159f10 msgr2=0x7ff1bc068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.765+0000 7ff1ba59c700 1 --2- 172.21.15.81:0/2453454498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1bc159f10 0x7ff1bc068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.765+0000 7ff1ba59c700 1 -- 172.21.15.81:0/2453454498 >> v2:172.21.15.89:3300/0 conn(0x7ff1bc0ccb40 msgr2=0x7ff1bc068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.765+0000 7ff1ba59c700 1 --2- 172.21.15.81:0/2453454498 >> v2:172.21.15.89:3300/0 conn(0x7ff1bc0ccb40 0x7ff1bc068cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.765+0000 7ff1ba59c700 1 -- 172.21.15.81:0/2453454498 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc0ce7c0 con 0x7ff1bc159b40 2023-10-07T08:48:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.765+0000 7ff1b9d9b700 1 --2- 172.21.15.81:0/2453454498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1bc159f10 0x7ff1bc068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.765+0000 7ff1bad9d700 1 --2- 172.21.15.81:0/2453454498 >> v2:172.21.15.89:3300/0 conn(0x7ff1bc0ccb40 0x7ff1bc068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.765+0000 7ff1ba59c700 1 --2- 172.21.15.81:0/2453454498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc159b40 0x7ff1bc0cc600 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0b6bf0 tx=0x7ff1ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57118533a23b3b4b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.765+0000 7ff1b959a700 1 -- 172.21.15.81:0/2453454498 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac00e070 con 0x7ff1bc159b40 2023-10-07T08:48:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.765+0000 7ff1b959a700 1 -- 172.21.15.81:0/2453454498 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac00ba50 con 0x7ff1bc159b40 2023-10-07T08:48:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.765+0000 7ff1b959a700 1 -- 172.21.15.81:0/2453454498 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac0092e0 con 0x7ff1bc159b40 2023-10-07T08:48:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.765+0000 7ff1bb59e700 1 -- 172.21.15.81:0/2453454498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc159b40 msgr2=0x7ff1bc0cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.765+0000 7ff1bb59e700 1 --2- 172.21.15.81:0/2453454498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc159b40 0x7ff1bc0cc600 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0b6bf0 tx=0x7ff1ac009840 comp rx=0 tx=0).stop 2023-10-07T08:48:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.766+0000 7ff1bb59e700 1 -- 172.21.15.81:0/2453454498 shutdown_connections 2023-10-07T08:48:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.766+0000 7ff1bb59e700 1 --2- 172.21.15.81:0/2453454498 >> v2:172.21.15.89:3300/0 conn(0x7ff1bc0ccb40 0x7ff1bc068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.766+0000 7ff1bb59e700 1 --2- 172.21.15.81:0/2453454498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc159b40 0x7ff1bc0cc600 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.766+0000 7ff1bb59e700 1 --2- 172.21.15.81:0/2453454498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1bc159f10 0x7ff1bc068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.766+0000 7ff1bb59e700 1 -- 172.21.15.81:0/2453454498 >> 172.21.15.81:0/2453454498 conn(0x7ff1bc0cd660 msgr2=0x7ff1bc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.766+0000 7ff1bb59e700 1 -- 172.21.15.81:0/2453454498 shutdown_connections 2023-10-07T08:48:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.766+0000 7ff1bb59e700 1 -- 172.21.15.81:0/2453454498 wait complete. 2023-10-07T08:48:01.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.767+0000 7ff1bb59e700 1 Processor -- start 2023-10-07T08:48:01.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.767+0000 7ff1bb59e700 1 -- start start 2023-10-07T08:48:01.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bb59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1bc0ccb40 0x7ff1bc15cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:01.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bb59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1bc159b40 0x7ff1bc157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:01.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bb59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc159f10 0x7ff1bc147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:01.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bb59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc157eb0 con 0x7ff1bc159f10 2023-10-07T08:48:01.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bb59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc158190 con 0x7ff1bc0ccb40 2023-10-07T08:48:01.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bb59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc158470 con 0x7ff1bc159b40 2023-10-07T08:48:01.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc159f10 0x7ff1bc147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:01.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc159f10 0x7ff1bc147830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43228/0 (socket says 172.21.15.81:43228) 2023-10-07T08:48:01.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bad9d700 1 -- 172.21.15.81:0/2401023465 learned_addr learned my addr 172.21.15.81:0/2401023465 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:01.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1ba59c700 1 --2- 172.21.15.81:0/2401023465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1bc0ccb40 0x7ff1bc15cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1b9d9b700 1 --2- 172.21.15.81:0/2401023465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1bc159b40 0x7ff1bc157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bad9d700 1 -- 172.21.15.81:0/2401023465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1bc159b40 msgr2=0x7ff1bc157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bad9d700 1 --2- 172.21.15.81:0/2401023465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1bc159b40 0x7ff1bc157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bad9d700 1 -- 172.21.15.81:0/2401023465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1bc0ccb40 msgr2=0x7ff1bc15cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bad9d700 1 --2- 172.21.15.81:0/2401023465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1bc0ccb40 0x7ff1bc15cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bad9d700 1 -- 172.21.15.81:0/2401023465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac009ae0 con 0x7ff1bc159f10 2023-10-07T08:48:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bad9d700 1 --2- 172.21.15.81:0/2401023465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc159f10 0x7ff1bc147830 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400c880 tx=0x7ff1b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1aa7fc700 1 -- 172.21.15.81:0/2401023465 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4011600 con 0x7ff1bc159f10 2023-10-07T08:48:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1aa7fc700 1 -- 172.21.15.81:0/2401023465 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b4011780 con 0x7ff1bc159f10 2023-10-07T08:48:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bb59e700 1 -- 172.21.15.81:0/2401023465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1bc158750 con 0x7ff1bc159f10 2023-10-07T08:48:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1aa7fc700 1 -- 172.21.15.81:0/2401023465 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4011b40 con 0x7ff1bc159f10 2023-10-07T08:48:01.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.768+0000 7ff1bb59e700 1 -- 172.21.15.81:0/2401023465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1bc157b80 con 0x7ff1bc159f10 2023-10-07T08:48:01.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.769+0000 7ff1bb59e700 1 -- 172.21.15.81:0/2401023465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1bc0cb890 con 0x7ff1bc159f10 2023-10-07T08:48:01.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.770+0000 7ff1aa7fc700 1 -- 172.21.15.81:0/2401023465 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1b4018350 con 0x7ff1bc159f10 2023-10-07T08:48:01.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.770+0000 7ff1aa7fc700 1 --2- 172.21.15.81:0/2401023465 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff19c066f30 0x7ff19c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:01.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.770+0000 7ff1aa7fc700 1 -- 172.21.15.81:0/2401023465 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff1b40844f0 con 0x7ff1bc159f10 2023-10-07T08:48:01.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.770+0000 7ff1ba59c700 1 --2- 172.21.15.81:0/2401023465 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff19c066f30 0x7ff19c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:01.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.771+0000 7ff1ba59c700 1 --2- 172.21.15.81:0/2401023465 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff19c066f30 0x7ff19c0693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac009880 tx=0x7ff1ac018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:01.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:01.774+0000 7ff1aa7fc700 1 -- 172.21.15.81:0/2401023465 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1b40551f0 con 0x7ff1bc159f10 2023-10-07T08:48:02.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.000+0000 7ff1bb59e700 1 -- 172.21.15.81:0/2401023465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff1bc0ceaa0 con 0x7ff1bc159f10 2023-10-07T08:48:02.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.000+0000 7ff1aa7fc700 1 -- 172.21.15.81:0/2401023465 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff1b4054d80 con 0x7ff1bc159f10 2023-10-07T08:48:02.002 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:48:02.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.002+0000 7ff1bb59e700 1 -- 172.21.15.81:0/2401023465 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff19c066f30 msgr2=0x7ff19c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:02.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.002+0000 7ff1bb59e700 1 --2- 172.21.15.81:0/2401023465 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff19c066f30 0x7ff19c0693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac009880 tx=0x7ff1ac018000 comp rx=0 tx=0).stop 2023-10-07T08:48:02.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.002+0000 7ff1bb59e700 1 -- 172.21.15.81:0/2401023465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc159f10 msgr2=0x7ff1bc147830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:02.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.002+0000 7ff1bb59e700 1 --2- 172.21.15.81:0/2401023465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc159f10 0x7ff1bc147830 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400c880 tx=0x7ff1b4008040 comp rx=0 tx=0).stop 2023-10-07T08:48:02.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.003+0000 7ff1bb59e700 1 -- 172.21.15.81:0/2401023465 shutdown_connections 2023-10-07T08:48:02.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.003+0000 7ff1bb59e700 1 --2- 172.21.15.81:0/2401023465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc159f10 0x7ff1bc147830 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:02.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.003+0000 7ff1bb59e700 1 --2- 172.21.15.81:0/2401023465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1bc0ccb40 0x7ff1bc15cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:02.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.003+0000 7ff1bb59e700 1 --2- 172.21.15.81:0/2401023465 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff19c066f30 0x7ff19c0693e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:02.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.003+0000 7ff1bb59e700 1 --2- 172.21.15.81:0/2401023465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1bc159b40 0x7ff1bc157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:02.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.003+0000 7ff1bb59e700 1 -- 172.21.15.81:0/2401023465 >> 172.21.15.81:0/2401023465 conn(0x7ff1bc0cd660 msgr2=0x7ff1bc06e310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:02.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.003+0000 7ff1bb59e700 1 -- 172.21.15.81:0/2401023465 shutdown_connections 2023-10-07T08:48:02.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.003+0000 7ff1bb59e700 1 -- 172.21.15.81:0/2401023465 wait complete. 2023-10-07T08:48:02.018 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:48:02.018 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:48:02.018 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-07T08:48:02.018 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T08:48:02.018 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T08:48:02.018 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:48:02.018 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:48:02.019 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:48:02.019 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:48:02.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:02.019 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-07T08:48:02.038 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:48:02.038 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:48:02.038 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:48:02.038 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:02.038 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-07T08:48:02.039 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:02.039 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:48:02.039 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:02.039 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-10-07T08:48:02.039 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:48:02.039 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:02.039 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-10-07T08:48:02.039 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:48:02.039 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:02.039 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:48:02.039 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:02.039 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:48:02.040 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42246sec preferred_lft 42246sec 2023-10-07T08:48:02.040 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2023-10-07T08:48:02.040 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:02.040 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:48:02.040 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:02.040 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:48:02.040 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:02.040 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::74d7:a9ff:fe87:ed9/64 scope link 2023-10-07T08:48:02.040 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:02.041 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:48:02.041 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T08:48:02.041 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6c40:c5ff:fe3a:a57/64 scope link 2023-10-07T08:48:02.041 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:02.041 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:48:02.041 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether de:db:cd:68:b1:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T08:48:02.041 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::dcdb:cdff:fe68:b178/64 scope link 2023-10-07T08:48:02.041 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:02.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:02.042 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:48:02.105 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-07T08:48:02.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:02.106 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-07T08:48:02.164 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-07T08:48:02.164 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:48:02.164 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:48:02.164 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:48:02.165 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:48:02.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:02.165 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:48:02.165 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:48:02.165 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:48:02.165 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:48:02.165 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:48:02.165 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:48:02.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:02.268 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-07T08:48:02.283 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T08:48:02.283 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T08:48:02.284 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:48:02.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:02.284 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-07T08:48:02.348 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:48:02.349 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T08:48:02.403 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:48:02.404 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:48:02.404 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:48:02.457 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:48:02.458 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:48:02.458 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:48:02.537 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:48:02.537 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:48:02.537 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:48:02.545 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:48:02.546 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:48:02.546 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:48:02.546 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:48:02.546 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:48:02.566 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:48:02.567 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:48:02.567 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:48:02.567 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:48:02.567 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:48:02.567 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:48:02.567 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:48:02.567 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:48:02.568 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:48:02.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:02.569 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:48:02.633 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:48:02.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.746+0000 7fd768988700 1 Processor -- start 2023-10-07T08:48:02.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.746+0000 7fd768988700 1 -- start start 2023-10-07T08:48:02.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.747+0000 7fd768988700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd764159b40 0x7fd7640cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:02.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.747+0000 7fd768988700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd764159f10 0x7fd764068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:02.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.747+0000 7fd768988700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7640cee10 con 0x7fd7640ccb40 2023-10-07T08:48:02.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.747+0000 7fd768988700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7640cd040 con 0x7fd764159b40 2023-10-07T08:48:02.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.747+0000 7fd768988700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7640cd320 con 0x7fd764159f10 2023-10-07T08:48:02.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.747+0000 7fd7637fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd764159b40 0x7fd7640cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:02.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.747+0000 7fd763fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd7640ccb40 0x7fd76415d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44468/0 (socket says 172.21.15.81:44468) 2023-10-07T08:48:02.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.747+0000 7fd763fff700 1 -- 172.21.15.81:0/762954547 learned_addr learned my addr 172.21.15.81:0/762954547 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:02.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.747+0000 7fd762ffd700 1 --2- 172.21.15.81:0/762954547 >> v2:172.21.15.89:3300/0 conn(0x7fd764159f10 0x7fd764068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:02.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.747+0000 7fd7637fe700 1 -- 172.21.15.81:0/762954547 >> v2:172.21.15.89:3300/0 conn(0x7fd764159f10 msgr2=0x7fd764068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:02.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.747+0000 7fd7637fe700 1 --2- 172.21.15.81:0/762954547 >> v2:172.21.15.89:3300/0 conn(0x7fd764159f10 0x7fd764068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:02.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.747+0000 7fd7637fe700 1 -- 172.21.15.81:0/762954547 >> v1:172.21.15.81:6789/0 conn(0x7fd7640ccb40 legacy=0x7fd76415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:02.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.747+0000 7fd7637fe700 1 -- 172.21.15.81:0/762954547 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7640ce7c0 con 0x7fd764159b40 2023-10-07T08:48:02.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.747+0000 7fd7627fc700 1 -- 172.21.15.81:0/762954547 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757954351 0 0) 0x7fd7640cee10 con 0x7fd7640ccb40 2023-10-07T08:48:02.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.747+0000 7fd7637fe700 1 --2- 172.21.15.81:0/762954547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd764159b40 0x7fd7640cc600 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd76406fd80 tx=0x7fd754009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d8ffbc5397c65c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:02.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.748+0000 7fd7627fc700 1 -- 172.21.15.81:0/762954547 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75400e070 con 0x7fd764159b40 2023-10-07T08:48:02.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.748+0000 7fd7627fc700 1 -- 172.21.15.81:0/762954547 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75400bb60 con 0x7fd764159b40 2023-10-07T08:48:02.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.748+0000 7fd7627fc700 1 -- 172.21.15.81:0/762954547 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754012430 con 0x7fd764159b40 2023-10-07T08:48:02.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.748+0000 7fd768988700 1 -- 172.21.15.81:0/762954547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd764159b40 msgr2=0x7fd7640cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:02.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.748+0000 7fd768988700 1 --2- 172.21.15.81:0/762954547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd764159b40 0x7fd7640cc600 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd76406fd80 tx=0x7fd754009780 comp rx=0 tx=0).stop 2023-10-07T08:48:02.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.748+0000 7fd768988700 1 -- 172.21.15.81:0/762954547 shutdown_connections 2023-10-07T08:48:02.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.748+0000 7fd768988700 1 --2- 172.21.15.81:0/762954547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd764159b40 0x7fd7640cc600 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:02.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.748+0000 7fd768988700 1 --2- 172.21.15.81:0/762954547 >> v2:172.21.15.89:3300/0 conn(0x7fd764159f10 0x7fd764068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:02.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.748+0000 7fd768988700 1 -- 172.21.15.81:0/762954547 >> 172.21.15.81:0/762954547 conn(0x7fd7640cd660 msgr2=0x7fd7640cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:02.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.748+0000 7fd768988700 1 -- 172.21.15.81:0/762954547 shutdown_connections 2023-10-07T08:48:02.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.748+0000 7fd768988700 1 -- 172.21.15.81:0/762954547 wait complete. 2023-10-07T08:48:02.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.749+0000 7fd768988700 1 Processor -- start 2023-10-07T08:48:02.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.750+0000 7fd768988700 1 -- start start 2023-10-07T08:48:02.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.750+0000 7fd768988700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7640ccb40 0x7fd7641446d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:02.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.750+0000 7fd768988700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd764159b40 0x7fd764157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:02.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.750+0000 7fd768988700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd764159f10 0x7fd76406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:02.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.750+0000 7fd768988700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd764158cf0 con 0x7fd7640ccb40 2023-10-07T08:48:02.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.750+0000 7fd768988700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd764157c50 con 0x7fd764159f10 2023-10-07T08:48:02.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.750+0000 7fd768988700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd764157f30 con 0x7fd764159b40 2023-10-07T08:48:02.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.750+0000 7fd7637fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7640ccb40 0x7fd7641446d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:02.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.750+0000 7fd7637fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7640ccb40 0x7fd7641446d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48674/0 (socket says 172.21.15.81:48674) 2023-10-07T08:48:02.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.750+0000 7fd7637fe700 1 -- 172.21.15.81:0/1707013242 learned_addr learned my addr 172.21.15.81:0/1707013242 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:02.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.751+0000 7fd7637fe700 1 -- 172.21.15.81:0/1707013242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd764159b40 msgr2=0x7fd764157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:02.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.751+0000 7fd763fff700 1 --2- 172.21.15.81:0/1707013242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd764159f10 0x7fd76406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:02.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.751+0000 7fd7637fe700 1 --2- 172.21.15.81:0/1707013242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd764159b40 0x7fd764157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:02.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.751+0000 7fd7637fe700 1 -- 172.21.15.81:0/1707013242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd764159f10 msgr2=0x7fd76406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:02.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.751+0000 7fd7637fe700 1 --2- 172.21.15.81:0/1707013242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd764159f10 0x7fd76406ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:02.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.751+0000 7fd7637fe700 1 -- 172.21.15.81:0/1707013242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd754009a20 con 0x7fd7640ccb40 2023-10-07T08:48:02.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.751+0000 7fd7637fe700 1 --2- 172.21.15.81:0/1707013242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7640ccb40 0x7fd7641446d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd754009fd0 tx=0x7fd754019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:02.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.751+0000 7fd74b7fe700 1 -- 172.21.15.81:0/1707013242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754012df0 con 0x7fd7640ccb40 2023-10-07T08:48:02.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.751+0000 7fd74b7fe700 1 -- 172.21.15.81:0/1707013242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd754027470 con 0x7fd7640ccb40 2023-10-07T08:48:02.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.751+0000 7fd74b7fe700 1 -- 172.21.15.81:0/1707013242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754027830 con 0x7fd7640ccb40 2023-10-07T08:48:02.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.751+0000 7fd768988700 1 -- 172.21.15.81:0/1707013242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd764158210 con 0x7fd7640ccb40 2023-10-07T08:48:02.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.751+0000 7fd768988700 1 -- 172.21.15.81:0/1707013242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7641587d0 con 0x7fd7640ccb40 2023-10-07T08:48:02.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.752+0000 7fd768988700 1 -- 172.21.15.81:0/1707013242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7640cc0e0 con 0x7fd7640ccb40 2023-10-07T08:48:02.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.752+0000 7fd74b7fe700 1 -- 172.21.15.81:0/1707013242 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd754024070 con 0x7fd7640ccb40 2023-10-07T08:48:02.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.753+0000 7fd74b7fe700 1 --2- 172.21.15.81:0/1707013242 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd750066f30 0x7fd7500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:02.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.753+0000 7fd74b7fe700 1 -- 172.21.15.81:0/1707013242 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd754086f30 con 0x7fd7640ccb40 2023-10-07T08:48:02.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.753+0000 7fd762ffd700 1 --2- 172.21.15.81:0/1707013242 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd750066f30 0x7fd7500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:02.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.753+0000 7fd762ffd700 1 --2- 172.21.15.81:0/1707013242 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd750066f30 0x7fd7500693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd76415a400 tx=0x7fd7580091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:02.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.757+0000 7fd74b7fe700 1 -- 172.21.15.81:0/1707013242 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7540541a0 con 0x7fd7640ccb40 2023-10-07T08:48:02.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.980+0000 7fd768988700 1 -- 172.21.15.81:0/1707013242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7640ceaa0 con 0x7fd7640ccb40 2023-10-07T08:48:02.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.981+0000 7fd74b7fe700 1 -- 172.21.15.81:0/1707013242 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fd7540577c0 con 0x7fd7640ccb40 2023-10-07T08:48:02.982 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:02.983 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1015639142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1015639142},{"type":"v1","addr":"172.21.15.89:6833","nonce":1015639142}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2650972762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2650972762},{"type":"v1","addr":"172.21.15.89:6835","nonce":2650972762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2058286084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2058286084},{"type":"v1","addr":"172.21.15.81:6836","nonce":2058286084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:47:49.671409+0000","modified":"2023-10-07T08:47:53.341944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6837/3696879604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3696879604},{"type":"v1","addr":"172.21.15.81:6837","nonce":3696879604}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-07T08:48:02.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.983+0000 7fd768988700 1 -- 172.21.15.81:0/1707013242 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd750066f30 msgr2=0x7fd7500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:02.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.983+0000 7fd768988700 1 --2- 172.21.15.81:0/1707013242 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd750066f30 0x7fd7500693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd76415a400 tx=0x7fd7580091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:02.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.983+0000 7fd768988700 1 -- 172.21.15.81:0/1707013242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7640ccb40 msgr2=0x7fd7641446d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:02.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.983+0000 7fd768988700 1 --2- 172.21.15.81:0/1707013242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7640ccb40 0x7fd7641446d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd754009fd0 tx=0x7fd754019000 comp rx=0 tx=0).stop 2023-10-07T08:48:02.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.983+0000 7fd768988700 1 -- 172.21.15.81:0/1707013242 shutdown_connections 2023-10-07T08:48:02.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.983+0000 7fd768988700 1 --2- 172.21.15.81:0/1707013242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd764159f10 0x7fd76406ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:02.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.983+0000 7fd768988700 1 --2- 172.21.15.81:0/1707013242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7640ccb40 0x7fd7641446d0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:02.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.983+0000 7fd768988700 1 --2- 172.21.15.81:0/1707013242 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd750066f30 0x7fd7500693e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:02.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.983+0000 7fd768988700 1 --2- 172.21.15.81:0/1707013242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd764159b40 0x7fd764157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:02.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.983+0000 7fd768988700 1 -- 172.21.15.81:0/1707013242 >> 172.21.15.81:0/1707013242 conn(0x7fd7640cd660 msgr2=0x7fd76406dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:02.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.983+0000 7fd768988700 1 -- 172.21.15.81:0/1707013242 shutdown_connections 2023-10-07T08:48:02.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:02.983+0000 7fd768988700 1 -- 172.21.15.81:0/1707013242 wait complete. 2023-10-07T08:48:02.986 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 50 2023-10-07T08:48:02.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-07T08:48:03.129 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":6336,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":12.801131095000001,"mdsmap_epoch":50,"osdmap_epoch":102,"osdmap_epoch_barrier":102,"uptime":24.133101404000001} 2023-10-07T08:48:03.129 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 6336, "mdsmap_epoch": 50, "osdmap_epoch": 102, "osdmap_epoch_barrier": 102, "rank_uptime": 12.801131095, "state": "up:active", "uptime": 24.133101404, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:48:03.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-07T08:48:03.259 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_mon_report_interval":"5"} 2023-10-07T08:48:03.260 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-07T08:48:03.260 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-10-07T08:48:03.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:48:03.260 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-10-07T08:48:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:265+0 records in 2023-10-07T08:48:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:265+0 records out 2023-10-07T08:48:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.35621 s, 205 MB/s 2023-10-07T08:48:04.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:48:04.635 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-10-07T08:48:06.160 INFO:teuthology.orchestra.run.smithi081.stderr:292+0 records in 2023-10-07T08:48:06.160 INFO:teuthology.orchestra.run.smithi081.stderr:292+0 records out 2023-10-07T08:48:06.160 INFO:teuthology.orchestra.run.smithi081.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.50958 s, 203 MB/s 2023-10-07T08:48:06.161 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-07T08:48:06.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:48:06.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.273+0000 7fb22c0bd700 1 Processor -- start 2023-10-07T08:48:06.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.273+0000 7fb22c0bd700 1 -- start start 2023-10-07T08:48:06.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.274+0000 7fb22c0bd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb22406d830 0x7fb2240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:06.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.274+0000 7fb22c0bd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2240d07c0 con 0x7fb2241578d0 2023-10-07T08:48:06.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.274+0000 7fb22c0bd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2240cfbb0 con 0x7fb224157ca0 2023-10-07T08:48:06.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.274+0000 7fb22c0bd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2240cfe90 con 0x7fb22406d830 2023-10-07T08:48:06.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.274+0000 7fb22a65a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb22406d830 0x7fb2240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:06.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.274+0000 7fb229e59700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb2241578d0 0x7fb22415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44476/0 (socket says 172.21.15.81:44476) 2023-10-07T08:48:06.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.274+0000 7fb229e59700 1 -- 172.21.15.81:0/1672046057 learned_addr learned my addr 172.21.15.81:0/1672046057 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:06.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.274+0000 7fb22a65a700 1 -- 172.21.15.81:0/1672046057 >> v1:172.21.15.89:6789/0 conn(0x7fb224157ca0 legacy=0x7fb22406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:06.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.274+0000 7fb22a65a700 1 -- 172.21.15.81:0/1672046057 >> v1:172.21.15.81:6789/0 conn(0x7fb2241578d0 legacy=0x7fb22415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:06.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.274+0000 7fb228e57700 1 -- 172.21.15.81:0/1672046057 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053328929 0 0) 0x7fb2240d07c0 con 0x7fb2241578d0 2023-10-07T08:48:06.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.274+0000 7fb22a65a700 1 -- 172.21.15.81:0/1672046057 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240d0170 con 0x7fb22406d830 2023-10-07T08:48:06.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.274+0000 7fb22a65a700 1 --2- 172.21.15.81:0/1672046057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22406d830 0x7fb2240cf4f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009e60 tx=0x7fb21c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add59df70f97cde6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:06.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.274+0000 7fb228e57700 1 -- 172.21.15.81:0/1672046057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c00e070 con 0x7fb22406d830 2023-10-07T08:48:06.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.274+0000 7fb228e57700 1 -- 172.21.15.81:0/1672046057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c00bbf0 con 0x7fb22406d830 2023-10-07T08:48:06.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.274+0000 7fb228e57700 1 -- 172.21.15.81:0/1672046057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c012430 con 0x7fb22406d830 2023-10-07T08:48:06.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.275+0000 7fb22c0bd700 1 -- 172.21.15.81:0/1672046057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22406d830 msgr2=0x7fb2240cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:06.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.275+0000 7fb22c0bd700 1 --2- 172.21.15.81:0/1672046057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22406d830 0x7fb2240cf4f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009e60 tx=0x7fb21c009780 comp rx=0 tx=0).stop 2023-10-07T08:48:06.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.275+0000 7fb22c0bd700 1 -- 172.21.15.81:0/1672046057 shutdown_connections 2023-10-07T08:48:06.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.275+0000 7fb22c0bd700 1 --2- 172.21.15.81:0/1672046057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22406d830 0x7fb2240cf4f0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:06.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.275+0000 7fb22c0bd700 1 -- 172.21.15.81:0/1672046057 >> 172.21.15.81:0/1672046057 conn(0x7fb22406bb90 msgr2=0x7fb22406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:06.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.275+0000 7fb22c0bd700 1 -- 172.21.15.81:0/1672046057 shutdown_connections 2023-10-07T08:48:06.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.275+0000 7fb22c0bd700 1 -- 172.21.15.81:0/1672046057 wait complete. 2023-10-07T08:48:06.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.276+0000 7fb22c0bd700 1 Processor -- start 2023-10-07T08:48:06.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.276+0000 7fb22c0bd700 1 -- start start 2023-10-07T08:48:06.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb22c0bd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb22406d830 0x7fb2241549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:06.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb22c0bd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2241578d0 0x7fb22415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:06.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb22c0bd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224157ca0 0x7fb22415cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:06.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb22c0bd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240b6290 con 0x7fb224157ca0 2023-10-07T08:48:06.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb22c0bd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240b4a90 con 0x7fb2241578d0 2023-10-07T08:48:06.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb22c0bd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22408ac00 con 0x7fb22406d830 2023-10-07T08:48:06.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb22a65a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224157ca0 0x7fb22415cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:06.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb22a65a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224157ca0 0x7fb22415cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48692/0 (socket says 172.21.15.81:48692) 2023-10-07T08:48:06.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb22a65a700 1 -- 172.21.15.81:0/2246150613 learned_addr learned my addr 172.21.15.81:0/2246150613 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:06.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb229e59700 1 --2- 172.21.15.81:0/2246150613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb22406d830 0x7fb2241549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:06.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb229658700 1 --2- 172.21.15.81:0/2246150613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2241578d0 0x7fb22415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:06.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb22a65a700 1 -- 172.21.15.81:0/2246150613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb22406d830 msgr2=0x7fb2241549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:06.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb22a65a700 1 --2- 172.21.15.81:0/2246150613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb22406d830 0x7fb2241549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:06.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb22a65a700 1 -- 172.21.15.81:0/2246150613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2241578d0 msgr2=0x7fb22415c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:06.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb22a65a700 1 --2- 172.21.15.81:0/2246150613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2241578d0 0x7fb22415c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:06.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb22a65a700 1 -- 172.21.15.81:0/2246150613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c009a20 con 0x7fb224157ca0 2023-10-07T08:48:06.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.277+0000 7fb22a65a700 1 --2- 172.21.15.81:0/2246150613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224157ca0 0x7fb22415cd20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00b6c0 tx=0x7fb21c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:06.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.278+0000 7fb219ffb700 1 -- 172.21.15.81:0/2246150613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c01e640 con 0x7fb224157ca0 2023-10-07T08:48:06.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.278+0000 7fb219ffb700 1 -- 172.21.15.81:0/2246150613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c01e7c0 con 0x7fb224157ca0 2023-10-07T08:48:06.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.278+0000 7fb22c0bd700 1 -- 172.21.15.81:0/2246150613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2240b47b0 con 0x7fb224157ca0 2023-10-07T08:48:06.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.278+0000 7fb219ffb700 1 -- 172.21.15.81:0/2246150613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c01eb80 con 0x7fb224157ca0 2023-10-07T08:48:06.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.278+0000 7fb22c0bd700 1 -- 172.21.15.81:0/2246150613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22408a890 con 0x7fb224157ca0 2023-10-07T08:48:06.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.279+0000 7fb22c0bd700 1 -- 172.21.15.81:0/2246150613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22408a410 con 0x7fb224157ca0 2023-10-07T08:48:06.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.279+0000 7fb219ffb700 1 -- 172.21.15.81:0/2246150613 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb21c024070 con 0x7fb224157ca0 2023-10-07T08:48:06.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.279+0000 7fb219ffb700 1 --2- 172.21.15.81:0/2246150613 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb208066f30 0x7fb2080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:06.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.279+0000 7fb219ffb700 1 -- 172.21.15.81:0/2246150613 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb21c086f90 con 0x7fb224157ca0 2023-10-07T08:48:06.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.280+0000 7fb229e59700 1 --2- 172.21.15.81:0/2246150613 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb208066f30 0x7fb2080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:06.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.280+0000 7fb229e59700 1 --2- 172.21.15.81:0/2246150613 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb208066f30 0x7fb2080693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb220007fd0 tx=0x7fb220007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:06.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.284+0000 7fb219ffb700 1 -- 172.21.15.81:0/2246150613 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb21c0b85a0 con 0x7fb224157ca0 2023-10-07T08:48:06.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.472+0000 7fb22c0bd700 1 -- 172.21.15.81:0/2246150613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb22408ad40 con 0x7fb224157ca0 2023-10-07T08:48:06.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.473+0000 7fb219ffb700 1 -- 172.21.15.81:0/2246150613 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v102) v1 ==== 81+0+32226 (secure 0 0 0) 0x7fb22408a410 con 0x7fb224157ca0 2023-10-07T08:48:06.475 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:06.475 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:48:06.475 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 102, 2023-10-07T08:48:06.475 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:48:06.475 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:48:06.475 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:47:51.300911+0000", 2023-10-07T08:48:06.475 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:48:06.475 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:48:06.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:48:06.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:48:06.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:48:06.476 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:48:06.476 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:48:06.476 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:48:06.476 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:48:06.476 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:06.476 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:48:06.476 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:48:06.476 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:48:06.476 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:48:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:48:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 13, 2023-10-07T08:48:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:48:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:48:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:48:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:48:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:48:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:48:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:48:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:48:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:48:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:48:06.478 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:06.478 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:06.478 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:06.478 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:06.478 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:06.478 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:06.478 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:06.478 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:06.478 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:06.478 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:06.478 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:48:06.480 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:48:06.480 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:48:06.480 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:48:06.480 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:48:06.480 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "91", 2023-10-07T08:48:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:48:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:48:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:48:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 12, 2023-10-07T08:48:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:48:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:47:47.993754+0000", 2023-10-07T08:48:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:48:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:48:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:48:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:48:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:48:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:48:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:48:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "101", 2023-10-07T08:48:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:48:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:48:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:48:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:48:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:48:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 13, 2023-10-07T08:48:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:48:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:47:48.631797+0000", 2023-10-07T08:48:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:48:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:48:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:06.494 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:06.494 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:06.494 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:48:06.494 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:48:06.494 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:48:06.494 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:48:06.495 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:48:06.495 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:06.495 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:06.495 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:06.495 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:06.495 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:06.495 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:06.495 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:06.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.495 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "102", 2023-10-07T08:48:06.495 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:06.496 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:06.496 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:06.496 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:06.496 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:06.496 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:06.496 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:06.496 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:06.496 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:06.496 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:06.496 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:06.497 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:06.497 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:06.497 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:06.497 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:06.497 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:06.497 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:06.497 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:06.497 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:06.497 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:06.497 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:06.497 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:06.497 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:06.497 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:06.498 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:06.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:06.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.498 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:06.498 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:06.498 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:06.498 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:06.498 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:06.498 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:06.498 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:06.498 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:06.498 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:06.499 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:06.499 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:06.499 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:06.499 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:48:06.499 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:48:06.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.499 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:06.499 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:48:06.499 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:48:06.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.500 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:06.500 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:48:06.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.500 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:48:06.500 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:06.500 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:06.500 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:06.500 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:06.500 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:06.500 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:06.500 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:06.500 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:06.501 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:06.501 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:06.501 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:06.501 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:06.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:48:06.501 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:06.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:48:06.502 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:06.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.502 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.502 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:06.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:48:06.502 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:06.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:48:06.503 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:06.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.503 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.503 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:06.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:48:06.504 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:06.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:48:06.504 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:06.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.504 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.504 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:06.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:48:06.505 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:06.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:48:06.505 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:06.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.505 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.505 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:48:06.505 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:48:06.506 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:48:06.506 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:48:06.506 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:06.506 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:06.506 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:06.506 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.506 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:48:06.506 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:06.506 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:06.506 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:06.506 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:06.507 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:06.507 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:06.507 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:06.507 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:06.507 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:06.507 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:06.507 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:06.507 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:06.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:48:06.509 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:06.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.509 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:48:06.509 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:06.509 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.509 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.509 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:06.510 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.510 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:48:06.510 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:06.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.510 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:48:06.510 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:06.510 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.510 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.511 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:06.511 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.511 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:48:06.511 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:06.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.511 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:48:06.511 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:06.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.512 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.512 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:06.512 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.512 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:48:06.512 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:06.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.513 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:48:06.513 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:06.513 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.513 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.513 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:48:06.513 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:48:06.513 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:48:06.513 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:48:06.513 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:06.513 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:06.513 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:06.513 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.514 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:48:06.514 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:06.514 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:06.514 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:06.514 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:06.514 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:06.514 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:06.514 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:06.514 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:06.514 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:06.515 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:06.515 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:06.515 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:06.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:48:06.515 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:06.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:48:06.515 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:06.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.516 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.516 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:06.516 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.516 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:48:06.516 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:06.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:48:06.517 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:06.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.517 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.517 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:06.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:48:06.517 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:06.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.518 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:48:06.518 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:06.518 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.518 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.518 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:06.518 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.518 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:48:06.518 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:06.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:48:06.519 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:06.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.519 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.519 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:48:06.519 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:48:06.519 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:48:06.519 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:48:06.520 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:06.520 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:06.520 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:06.520 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.520 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:48:06.520 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:06.520 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:06.520 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:06.520 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:06.520 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:06.520 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:06.521 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:06.521 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:06.521 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:06.521 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:06.521 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:06.521 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:06.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:48:06.521 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:06.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:48:06.522 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:06.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.522 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.522 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:06.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:48:06.522 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:06.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:48:06.523 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:06.523 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.523 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.523 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:06.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.524 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:48:06.524 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:06.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.524 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:48:06.524 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:06.524 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.524 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.524 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:06.524 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.525 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:48:06.525 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:06.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.525 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:48:06.525 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:06.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.525 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.525 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:48:06.526 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:48:06.526 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:48:06.526 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:48:06.526 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:06.526 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:06.526 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:06.526 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.526 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:48:06.526 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:06.526 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:48:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:48:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:48:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:48:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.530 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:06.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:48:06.530 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:06.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:48:06.530 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:06.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.531 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.531 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:06.531 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.531 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:48:06.531 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:06.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:48:06.532 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:06.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.532 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.532 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:48:06.532 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:48:06.532 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:48:06.532 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:48:06.532 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:06.532 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:06.532 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:06.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.533 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:48:06.533 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:06.533 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:06.533 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:06.533 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:06.533 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:06.533 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:06.534 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:06.534 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:06.534 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:06.534 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:06.534 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:06.534 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:06.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:48:06.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:06.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:48:06.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:06.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.535 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.535 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:06.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:48:06.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:06.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:48:06.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:06.536 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.536 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.536 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:06.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:48:06.537 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:06.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:48:06.537 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:06.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.538 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:06.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:48:06.538 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:06.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:48:06.538 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:06.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.539 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.539 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:48:06.539 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:48:06.539 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:48:06.539 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:48:06.539 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:06.539 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:06.539 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:06.539 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.540 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:48:06.540 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:06.540 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:06.540 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:06.540 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:06.540 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:06.540 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:06.540 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:06.540 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:06.540 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:06.540 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:06.541 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:06.541 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:06.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:48:06.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:06.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:48:06.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:06.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.542 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.542 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:06.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:48:06.542 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:06.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:48:06.543 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:06.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.543 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:06.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:48:06.543 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:06.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:48:06.544 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:06.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.544 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.544 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:06.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:48:06.545 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:06.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:48:06.545 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:06.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.545 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:48:06.545 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:48:06.545 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:48:06.546 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:48:06.546 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:06.546 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:06.546 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:06.546 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.546 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:48:06.546 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:06.546 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:06.546 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:06.546 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:06.547 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:06.547 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:06.547 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:06.547 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:06.547 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:06.547 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:06.547 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:06.547 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:06.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:48:06.548 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:06.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:48:06.548 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:06.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.548 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.548 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:06.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:48:06.549 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:06.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:48:06.549 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:06.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.549 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.550 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:06.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:48:06.550 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:06.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:48:06.550 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:06.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.551 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:06.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:06.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:06.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:48:06.551 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:06.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:06.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:48:06.551 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:06.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.552 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.552 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:48:06.552 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:48:06.552 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:48:06.552 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:48:06.552 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:06.552 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:06.552 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:06.552 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:06.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.553 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:06.553 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:48:06.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.553 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:48:06.553 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:06.553 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:06.553 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:06.553 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:06.553 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:06.553 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:48:06.554 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:06.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.554 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:48:06.554 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:06.554 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:06.554 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:06.554 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:06.554 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:06.554 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:48:06.554 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:06.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.555 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:48:06.555 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:06.555 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:06.555 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:06.555 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:06.555 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:06.555 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:48:06.555 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:06.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.556 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:48:06.556 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:06.556 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:06.556 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:06.556 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:06.556 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:06.556 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:48:06.556 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:06.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.556 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:48:06.556 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:06.556 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:06.557 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:06.557 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:06.557 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:06.557 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:48:06.557 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:06.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.557 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:48:06.557 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:06.557 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:06.557 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:06.557 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:06.558 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:06.558 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:48:06.558 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:06.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.558 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:48:06.558 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:06.558 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:06.558 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:06.559 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:06.559 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:06.559 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:48:06.559 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:06.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:06.559 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:48:06.559 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:06.559 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:06.559 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:06.559 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:06.559 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:06.560 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:48:06.560 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:06.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.560 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:06.560 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:48:06.560 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:48:06.560 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:48:06.560 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:48:06.560 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:48:06.560 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:48:06.560 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:48:06.560 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:48:06.560 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:48:06.561 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:48:06.561 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:48:06.561 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:48:06.561 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:48:06.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:06.561 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:48:06.561 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:48:06.561 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:48:06.561 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:48:06.561 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:48:06.561 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:48:06.562 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:48:06.562 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:48:06.562 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:48:06.562 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:48:06.562 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:48:06.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:06.562 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:48:06.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.475+0000 7fb22c0bd700 1 -- 172.21.15.81:0/2246150613 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb208066f30 msgr2=0x7fb2080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:06.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.475+0000 7fb22c0bd700 1 --2- 172.21.15.81:0/2246150613 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb208066f30 0x7fb2080693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb220007fd0 tx=0x7fb220007d30 comp rx=0 tx=0).stop 2023-10-07T08:48:06.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.475+0000 7fb22c0bd700 1 -- 172.21.15.81:0/2246150613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224157ca0 msgr2=0x7fb22415cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:06.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.475+0000 7fb22c0bd700 1 --2- 172.21.15.81:0/2246150613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224157ca0 0x7fb22415cd20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00b6c0 tx=0x7fb21c018000 comp rx=0 tx=0).stop 2023-10-07T08:48:06.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.475+0000 7fb22c0bd700 1 -- 172.21.15.81:0/2246150613 shutdown_connections 2023-10-07T08:48:06.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.475+0000 7fb22c0bd700 1 --2- 172.21.15.81:0/2246150613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224157ca0 0x7fb22415cd20 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:06.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.475+0000 7fb22c0bd700 1 --2- 172.21.15.81:0/2246150613 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb208066f30 0x7fb2080693e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:06.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.475+0000 7fb22c0bd700 1 --2- 172.21.15.81:0/2246150613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb22406d830 0x7fb2241549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:06.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.475+0000 7fb22c0bd700 1 --2- 172.21.15.81:0/2246150613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2241578d0 0x7fb22415c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:06.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.475+0000 7fb22c0bd700 1 -- 172.21.15.81:0/2246150613 >> 172.21.15.81:0/2246150613 conn(0x7fb22406bb90 msgr2=0x7fb22406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:06.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.475+0000 7fb22c0bd700 1 -- 172.21.15.81:0/2246150613 shutdown_connections 2023-10-07T08:48:06.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:06.475+0000 7fb22c0bd700 1 -- 172.21.15.81:0/2246150613 wait complete. 2023-10-07T08:48:06.565 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-07T08:48:07.376 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:48:07.375+0000 7f43c6f32700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-07T08:48:11.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:48:11.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.690+0000 7f4cd4afc700 1 Processor -- start 2023-10-07T08:48:11.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.690+0000 7f4cd4afc700 1 -- start start 2023-10-07T08:48:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4cd4afc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4cd0157ca0 0x7f4cd00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4cd4afc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd00d07c0 con 0x7f4cd006d120 2023-10-07T08:48:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4cd4afc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd00cfbb0 con 0x7f4cd01578d0 2023-10-07T08:48:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4cd4afc700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd00cfe90 con 0x7f4cd0157ca0 2023-10-07T08:48:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4cced9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4cd006d120 0x7f4cd006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44486/0 (socket says 172.21.15.81:44486) 2023-10-07T08:48:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4cced9d700 1 -- 172.21.15.81:0/1492009365 learned_addr learned my addr 172.21.15.81:0/1492009365 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4cc5d9b700 1 --2- 172.21.15.81:0/1492009365 >> v2:172.21.15.89:3300/0 conn(0x7f4cd0157ca0 0x7f4cd00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4ccdd9b700 1 -- 172.21.15.81:0/1492009365 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677221375 0 0) 0x7f4cd00d07c0 con 0x7f4cd006d120 2023-10-07T08:48:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4ccdd9b700 1 -- 172.21.15.81:0/1492009365 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cbc003570 con 0x7f4cd006d120 2023-10-07T08:48:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4ccdd9b700 1 -- 172.21.15.81:0/1492009365 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1908925989 0 0) 0x7f4cbc003570 con 0x7f4cd006d120 2023-10-07T08:48:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4ccdd9b700 1 -- 172.21.15.81:0/1492009365 >> v2:172.21.15.89:3300/0 conn(0x7f4cd0157ca0 msgr2=0x7f4cd00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4ccdd9b700 1 --2- 172.21.15.81:0/1492009365 >> v2:172.21.15.89:3300/0 conn(0x7f4cd0157ca0 0x7f4cd00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4ccdd9b700 1 -- 172.21.15.81:0/1492009365 >> v1:172.21.15.89:6789/0 conn(0x7f4cd01578d0 legacy=0x7f4cd015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4ccdd9b700 1 -- 172.21.15.81:0/1492009365 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd00d0170 con 0x7f4cd006d120 2023-10-07T08:48:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4ccdd9b700 1 -- 172.21.15.81:0/1492009365 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f4cc80017f0 con 0x7f4cd006d120 2023-10-07T08:48:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4ccdd9b700 1 -- 172.21.15.81:0/1492009365 >> v1:172.21.15.81:6789/0 conn(0x7f4cd006d120 legacy=0x7f4cd006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4ccdd9b700 1 --2- 172.21.15.81:0/1492009365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cbc003a60 0x7f4cbc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4ccdd9b700 1 --2- 172.21.15.81:0/1492009365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cbc004810 0x7f4cbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4ccdd9b700 1 --2- 172.21.15.81:0/1492009365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cbc0051c0 0x7f4cbc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4ccdd9b700 1 -- 172.21.15.81:0/1492009365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd00cfe90 con 0x7f4cbc0051c0 2023-10-07T08:48:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4ccdd9b700 1 -- 172.21.15.81:0/1492009365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cbc00c0d0 con 0x7f4cbc004810 2023-10-07T08:48:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.691+0000 7f4ccdd9b700 1 -- 172.21.15.81:0/1492009365 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cbc00c290 con 0x7f4cbc003a60 2023-10-07T08:48:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.692+0000 7f4cced9d700 1 --2- 172.21.15.81:0/1492009365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cbc0051c0 0x7f4cbc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.692+0000 7f4cce59c700 1 --2- 172.21.15.81:0/1492009365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cbc003a60 0x7f4cbc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.692+0000 7f4cc5d9b700 1 --2- 172.21.15.81:0/1492009365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cbc004810 0x7f4cbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.692+0000 7f4cced9d700 1 -- 172.21.15.81:0/1492009365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cbc003a60 msgr2=0x7f4cbc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.692+0000 7f4cced9d700 1 --2- 172.21.15.81:0/1492009365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cbc003a60 0x7f4cbc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.692+0000 7f4cced9d700 1 -- 172.21.15.81:0/1492009365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cbc004810 msgr2=0x7f4cbc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.692+0000 7f4cced9d700 1 --2- 172.21.15.81:0/1492009365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cbc004810 0x7f4cbc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:11.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.692+0000 7f4cced9d700 1 -- 172.21.15.81:0/1492009365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cbc003570 con 0x7f4cbc0051c0 2023-10-07T08:48:11.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.692+0000 7f4cced9d700 1 -- 172.21.15.81:0/1492009365 reap_dead start 2023-10-07T08:48:11.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.692+0000 7f4cced9d700 1 --2- 172.21.15.81:0/1492009365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cbc0051c0 0x7f4cbc00ba60 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800a930 tx=0x7f4cc80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb502601a8a0cfe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:11.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.692+0000 7f4ccdd9b700 1 -- 172.21.15.81:0/1492009365 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80070d0 con 0x7f4cbc0051c0 2023-10-07T08:48:11.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.692+0000 7f4ccdd9b700 1 -- 172.21.15.81:0/1492009365 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc8007230 con 0x7f4cbc0051c0 2023-10-07T08:48:11.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.692+0000 7f4ccdd9b700 1 -- 172.21.15.81:0/1492009365 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80075d0 con 0x7f4cbc0051c0 2023-10-07T08:48:11.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.692+0000 7f4cd4afc700 1 -- 172.21.15.81:0/1492009365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cbc0051c0 msgr2=0x7f4cbc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:11.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.692+0000 7f4cd4afc700 1 --2- 172.21.15.81:0/1492009365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cbc0051c0 0x7f4cbc00ba60 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800a930 tx=0x7f4cc80021d0 comp rx=0 tx=0).stop 2023-10-07T08:48:11.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.693+0000 7f4cd4afc700 1 -- 172.21.15.81:0/1492009365 shutdown_connections 2023-10-07T08:48:11.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.693+0000 7f4cd4afc700 1 --2- 172.21.15.81:0/1492009365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cbc0051c0 0x7f4cbc00ba60 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:11.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.693+0000 7f4cd4afc700 1 -- 172.21.15.81:0/1492009365 >> 172.21.15.81:0/1492009365 conn(0x7f4cd006bb90 msgr2=0x7f4cd006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.693+0000 7f4cd4afc700 1 -- 172.21.15.81:0/1492009365 shutdown_connections 2023-10-07T08:48:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.693+0000 7f4cd4afc700 1 -- 172.21.15.81:0/1492009365 wait complete. 2023-10-07T08:48:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.694+0000 7f4cd4afc700 1 Processor -- start 2023-10-07T08:48:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.694+0000 7f4cd4afc700 1 -- start start 2023-10-07T08:48:11.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cd4afc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cbc0051c0 0x7f4cd0154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:11.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cd4afc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cd0155240 0x7f4cd01556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cd4afc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd016a7d0 0x7f4cd016ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cd4afc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd0155bf0 con 0x7f4cd016a7d0 2023-10-07T08:48:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cd4afc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd016daf0 con 0x7f4cbc0051c0 2023-10-07T08:48:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cd4afc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd016e670 con 0x7f4cd0155240 2023-10-07T08:48:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cced9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd016a7d0 0x7f4cd016ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cced9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd016a7d0 0x7f4cd016ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48714/0 (socket says 172.21.15.81:48714) 2023-10-07T08:48:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cced9d700 1 -- 172.21.15.81:0/436425833 learned_addr learned my addr 172.21.15.81:0/436425833 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cce59c700 1 --2- 172.21.15.81:0/436425833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cbc0051c0 0x7f4cd0154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cc5d9b700 1 --2- 172.21.15.81:0/436425833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cd0155240 0x7f4cd01556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cced9d700 1 -- 172.21.15.81:0/436425833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cd0155240 msgr2=0x7f4cd01556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cced9d700 1 --2- 172.21.15.81:0/436425833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cd0155240 0x7f4cd01556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:11.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cced9d700 1 -- 172.21.15.81:0/436425833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cbc0051c0 msgr2=0x7f4cd0154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:11.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cced9d700 1 --2- 172.21.15.81:0/436425833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cbc0051c0 0x7f4cd0154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:11.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cced9d700 1 -- 172.21.15.81:0/436425833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd016dd40 con 0x7f4cd016a7d0 2023-10-07T08:48:11.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cced9d700 1 --2- 172.21.15.81:0/436425833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd016a7d0 0x7f4cd016ac40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800a3f0 tx=0x7f4cc8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:11.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cc6ffd700 1 -- 172.21.15.81:0/436425833 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80075b0 con 0x7f4cd016a7d0 2023-10-07T08:48:11.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cc6ffd700 1 -- 172.21.15.81:0/436425833 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc801d420 con 0x7f4cd016a7d0 2023-10-07T08:48:11.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cc6ffd700 1 -- 172.21.15.81:0/436425833 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc801d800 con 0x7f4cd016a7d0 2023-10-07T08:48:11.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cd4afc700 1 -- 172.21.15.81:0/436425833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd016e020 con 0x7f4cd016a7d0 2023-10-07T08:48:11.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.695+0000 7f4cd4afc700 1 -- 172.21.15.81:0/436425833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd016b180 con 0x7f4cd016a7d0 2023-10-07T08:48:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.696+0000 7f4cd4afc700 1 -- 172.21.15.81:0/436425833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd016e820 con 0x7f4cd016a7d0 2023-10-07T08:48:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.697+0000 7f4cc6ffd700 1 -- 172.21.15.81:0/436425833 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4cc801db70 con 0x7f4cd016a7d0 2023-10-07T08:48:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.697+0000 7f4cc6ffd700 1 --2- 172.21.15.81:0/436425833 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4cb0066f30 0x7f4cb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.697+0000 7f4cc6ffd700 1 -- 172.21.15.81:0/436425833 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4cc8086050 con 0x7f4cd016a7d0 2023-10-07T08:48:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.697+0000 7f4cce59c700 1 --2- 172.21.15.81:0/436425833 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4cb0066f30 0x7f4cb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.697+0000 7f4cc6ffd700 1 -- 172.21.15.81:0/436425833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=107}) v3 -- 0x7f4cb006ea50 con 0x7f4cd016a7d0 2023-10-07T08:48:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.698+0000 7f4cce59c700 1 --2- 172.21.15.81:0/436425833 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4cb0066f30 0x7f4cb00693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0000c00 tx=0x7f4cc0007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:11.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.701+0000 7f4cc6ffd700 1 -- 172.21.15.81:0/436425833 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4cd016e820 con 0x7f4cd016a7d0 2023-10-07T08:48:11.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.886+0000 7f4cd4afc700 1 -- 172.21.15.81:0/436425833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4cd016ea00 con 0x7f4cd016a7d0 2023-10-07T08:48:11.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.887+0000 7f4cc6ffd700 1 -- 172.21.15.81:0/436425833 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v106) v1 ==== 81+0+32394 (secure 0 0 0) 0x7f4cc8066ea0 con 0x7f4cd016a7d0 2023-10-07T08:48:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:11.889 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:48:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 106, 2023-10-07T08:48:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:48:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:48:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:48:10.402954+0000", 2023-10-07T08:48:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:48:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:48:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:48:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:48:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:48:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:48:11.891 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:48:11.891 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:48:11.891 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:48:11.891 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:11.891 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:48:11.891 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:48:11.891 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:48:11.892 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:48:11.892 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:48:11.892 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 13, 2023-10-07T08:48:11.892 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:48:11.892 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:48:11.892 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:48:11.892 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:48:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:48:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:48:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:48:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:48:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:48:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:48:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:48:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:48:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:48:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:48:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:48:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "103", 2023-10-07T08:48:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:11.899 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:11.899 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:11.899 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:11.899 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:11.899 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:11.899 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:11.899 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:11.899 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:11.899 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:48:11.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:48:11.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.900 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:11.900 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:48:11.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 12, 2023-10-07T08:48:11.901 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:48:11.901 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:47:47.993754+0000", 2023-10-07T08:48:11.901 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:48:11.901 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:48:11.901 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:11.901 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:11.901 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:11.902 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:11.902 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:11.902 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:11.902 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:11.902 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:11.902 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:11.902 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:11.902 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:48:11.903 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:48:11.903 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:48:11.903 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:48:11.903 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:48:11.903 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:11.903 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:11.903 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:11.904 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:11.904 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:11.904 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:11.904 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:11.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.904 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "103", 2023-10-07T08:48:11.905 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:11.905 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:11.905 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:11.905 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:11.905 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:11.905 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:11.906 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:11.906 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:11.906 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:11.906 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:11.906 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:11.906 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:11.906 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:11.907 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:11.907 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:11.907 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:11.907 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:11.907 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:11.907 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:11.907 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:11.908 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:11.908 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:11.908 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:11.908 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:11.908 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:11.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:11.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.909 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:11.909 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:11.909 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:11.909 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:11.910 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:11.910 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:11.910 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:11.910 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:11.910 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:11.910 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:11.910 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:48:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:48:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:48:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:48:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:48:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 13, 2023-10-07T08:48:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:48:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:47:48.631797+0000", 2023-10-07T08:48:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:48:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:48:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:11.913 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:11.913 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:11.913 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:11.913 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:48:11.913 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:48:11.913 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:48:11.913 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:48:11.913 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:48:11.913 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:11.913 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:11.913 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:11.914 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:11.914 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:11.914 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:11.914 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:11.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.914 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "103", 2023-10-07T08:48:11.914 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:11.914 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:11.914 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:11.914 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:11.914 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:48:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:48:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:48:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:48:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:48:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:48:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:48:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:48:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:48:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:48:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:48:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:48:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:48:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:48:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:48:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:48:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:48:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:48:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:48:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.927 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:48:11.927 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:11.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.927 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:48:11.927 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:11.927 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.927 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.927 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:11.927 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.928 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.928 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:48:11.928 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:11.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.928 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.928 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:48:11.928 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:11.928 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.928 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.928 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:11.929 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.929 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:48:11.929 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:11.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.929 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:48:11.929 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:11.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.929 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.930 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:11.930 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.930 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:48:11.930 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:11.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.930 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:48:11.930 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:11.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.931 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.931 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:48:11.931 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:48:11.931 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:48:11.931 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:48:11.931 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:11.931 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:11.931 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:11.931 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:11.931 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.932 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:48:11.932 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:11.932 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:11.932 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:11.932 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:11.932 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:11.932 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:11.932 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:11.932 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:11.932 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:11.932 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:11.933 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:11.933 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:11.933 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.933 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:48:11.933 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:11.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.933 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:48:11.933 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:11.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.934 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.934 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:11.934 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.934 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.934 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:48:11.934 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:11.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.934 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.934 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:48:11.934 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:11.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.935 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.935 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:11.935 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.935 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:48:11.935 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:11.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.935 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:48:11.936 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:11.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.936 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.936 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:11.936 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.936 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.936 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:48:11.936 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:11.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.937 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:48:11.937 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:11.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.937 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.937 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:48:11.937 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:48:11.937 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:48:11.937 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:48:11.937 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:11.938 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:11.938 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:11.938 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:11.938 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.938 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:48:11.938 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:11.938 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:11.938 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:11.938 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:48:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:48:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.941 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:48:11.941 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:11.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.941 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:48:11.941 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:11.941 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.941 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.941 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:11.941 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.942 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:48:11.942 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:11.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.942 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:48:11.942 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:11.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.942 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.943 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:11.943 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.943 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:48:11.943 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:11.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.943 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:48:11.943 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:48:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:48:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:48:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:48:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:48:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:48:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:48:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:48:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:48:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:48:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:48:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:48:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:48:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:48:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:48:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:48:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:48:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:48:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:48:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:48:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:48:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:48:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:48:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:48:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:48:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:48:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:48:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:48:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:48:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:48:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:48:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:48:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:48:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:48:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:48:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:48:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:48:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:48:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:48:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:48:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:48:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:48:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:48:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:48:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:48:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:48:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:48:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:48:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:48:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:48:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:48:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:48:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:48:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:48:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:48:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:48:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull", 2023-10-07T08:48:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:48:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:48:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:48:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:48:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:48:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:48:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:48:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:48:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:48:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:48:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:48:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:48:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:48:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:48:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:48:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:48:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:48:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:48:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:48:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:48:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:48:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:48:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:48:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:48:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:48:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:48:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:48:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:48:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:48:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:48:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:48:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:48:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:48:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:48:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:48:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:48:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:48:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:48:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:48:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:48:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:48:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:11.979 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:48:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.889+0000 7f4cd4afc700 1 -- 172.21.15.81:0/436425833 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4cb0066f30 msgr2=0x7f4cb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.889+0000 7f4cd4afc700 1 --2- 172.21.15.81:0/436425833 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4cb0066f30 0x7f4cb00693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0000c00 tx=0x7f4cc0007d30 comp rx=0 tx=0).stop 2023-10-07T08:48:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.889+0000 7f4cd4afc700 1 -- 172.21.15.81:0/436425833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd016a7d0 msgr2=0x7f4cd016ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.889+0000 7f4cd4afc700 1 --2- 172.21.15.81:0/436425833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd016a7d0 0x7f4cd016ac40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800a3f0 tx=0x7f4cc8016000 comp rx=0 tx=0).stop 2023-10-07T08:48:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.889+0000 7f4cd4afc700 1 -- 172.21.15.81:0/436425833 shutdown_connections 2023-10-07T08:48:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.889+0000 7f4cd4afc700 1 --2- 172.21.15.81:0/436425833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cd016a7d0 0x7f4cd016ac40 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.889+0000 7f4cd4afc700 1 --2- 172.21.15.81:0/436425833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cbc0051c0 0x7f4cd0154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.889+0000 7f4cd4afc700 1 --2- 172.21.15.81:0/436425833 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4cb0066f30 0x7f4cb00693e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.889+0000 7f4cd4afc700 1 --2- 172.21.15.81:0/436425833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cd0155240 0x7f4cd01556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:11.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.889+0000 7f4cd4afc700 1 -- 172.21.15.81:0/436425833 >> 172.21.15.81:0/436425833 conn(0x7f4cd006bb90 msgr2=0x7f4cd006a260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:11.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.889+0000 7f4cd4afc700 1 -- 172.21.15.81:0/436425833 shutdown_connections 2023-10-07T08:48:11.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:11.889+0000 7f4cd4afc700 1 -- 172.21.15.81:0/436425833 wait complete. 2023-10-07T08:48:11.982 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-07T08:48:11.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:48:11.983 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-10-07T08:48:12.237 INFO:teuthology.orchestra.run.smithi081.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-07T08:48:12.237 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records in 2023-10-07T08:48:12.237 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records out 2023-10-07T08:48:12.237 INFO:teuthology.orchestra.run.smithi081.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.234522 s, 224 MB/s 2023-10-07T08:48:12.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:48:12.238 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:48:12.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.352+0000 7fc73ddf5700 1 Processor -- start 2023-10-07T08:48:12.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.352+0000 7fc73ddf5700 1 -- start start 2023-10-07T08:48:12.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.353+0000 7fc73ddf5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc738157ca0 0x7fc7380cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:12.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.353+0000 7fc73ddf5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc73806d120 0x7fc73806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:12.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.353+0000 7fc73ddf5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7380d07c0 con 0x7fc7381578d0 2023-10-07T08:48:12.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.353+0000 7fc73ddf5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc73806da50 con 0x7fc738157ca0 2023-10-07T08:48:12.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.353+0000 7fc73ddf5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7380cfbb0 con 0x7fc73806d120 2023-10-07T08:48:12.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.353+0000 7fc736ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc738157ca0 0x7fc7380cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:12.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.353+0000 7fc7377fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc7381578d0 0x7fc73815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39282/0 (socket says 172.21.15.81:39282) 2023-10-07T08:48:12.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.353+0000 7fc7377fe700 1 -- 172.21.15.81:0/2524485401 learned_addr learned my addr 172.21.15.81:0/2524485401 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:12.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.353+0000 7fc736ffd700 1 -- 172.21.15.81:0/2524485401 >> v2:172.21.15.89:3300/0 conn(0x7fc73806d120 msgr2=0x7fc73806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.353+0000 7fc736ffd700 1 --2- 172.21.15.81:0/2524485401 >> v2:172.21.15.89:3300/0 conn(0x7fc73806d120 0x7fc73806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.353+0000 7fc736ffd700 1 -- 172.21.15.81:0/2524485401 >> v1:172.21.15.81:6789/0 conn(0x7fc7381578d0 legacy=0x7fc73815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.353+0000 7fc7367fc700 1 -- 172.21.15.81:0/2524485401 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908914139 0 0) 0x7fc7380d07c0 con 0x7fc7381578d0 2023-10-07T08:48:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.353+0000 7fc736ffd700 1 -- 172.21.15.81:0/2524485401 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7380cfe90 con 0x7fc738157ca0 2023-10-07T08:48:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.354+0000 7fc736ffd700 1 --2- 172.21.15.81:0/2524485401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc738157ca0 0x7fc7380cf4f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc738068300 tx=0x7fc72c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55186cc898bb6957 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.354+0000 7fc7367fc700 1 -- 172.21.15.81:0/2524485401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c00b6b0 con 0x7fc738157ca0 2023-10-07T08:48:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.354+0000 7fc7367fc700 1 -- 172.21.15.81:0/2524485401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c00b810 con 0x7fc738157ca0 2023-10-07T08:48:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.354+0000 7fc7367fc700 1 -- 172.21.15.81:0/2524485401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c00bbb0 con 0x7fc738157ca0 2023-10-07T08:48:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.354+0000 7fc73ddf5700 1 -- 172.21.15.81:0/2524485401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc738157ca0 msgr2=0x7fc7380cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.354+0000 7fc73ddf5700 1 --2- 172.21.15.81:0/2524485401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc738157ca0 0x7fc7380cf4f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc738068300 tx=0x7fc72c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.354+0000 7fc73ddf5700 1 -- 172.21.15.81:0/2524485401 shutdown_connections 2023-10-07T08:48:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.354+0000 7fc73ddf5700 1 --2- 172.21.15.81:0/2524485401 >> v2:172.21.15.89:3300/0 conn(0x7fc73806d120 0x7fc73806d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.354+0000 7fc73ddf5700 1 --2- 172.21.15.81:0/2524485401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc738157ca0 0x7fc7380cf4f0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.354+0000 7fc73ddf5700 1 -- 172.21.15.81:0/2524485401 >> 172.21.15.81:0/2524485401 conn(0x7fc73806bb90 msgr2=0x7fc73806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:12.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.354+0000 7fc73ddf5700 1 -- 172.21.15.81:0/2524485401 shutdown_connections 2023-10-07T08:48:12.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.354+0000 7fc73ddf5700 1 -- 172.21.15.81:0/2524485401 wait complete. 2023-10-07T08:48:12.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.355+0000 7fc73ddf5700 1 Processor -- start 2023-10-07T08:48:12.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.355+0000 7fc73ddf5700 1 -- start start 2023-10-07T08:48:12.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.356+0000 7fc73ddf5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc73806d120 0x7fc7380abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:12.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.356+0000 7fc73ddf5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7381578d0 0x7fc7380ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:12.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.356+0000 7fc73ddf5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc738157ca0 0x7fc7380ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:12.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.356+0000 7fc73ddf5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73816a4d0 con 0x7fc73806d120 2023-10-07T08:48:12.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.356+0000 7fc73ddf5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73816df20 con 0x7fc738157ca0 2023-10-07T08:48:12.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.356+0000 7fc73ddf5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73816e200 con 0x7fc7381578d0 2023-10-07T08:48:12.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.356+0000 7fc7377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc73806d120 0x7fc7380abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:12.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.356+0000 7fc7377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc73806d120 0x7fc7380abd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59842/0 (socket says 172.21.15.81:59842) 2023-10-07T08:48:12.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.356+0000 7fc7377fe700 1 -- 172.21.15.81:0/3119780883 learned_addr learned my addr 172.21.15.81:0/3119780883 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:12.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.356+0000 7fc737fff700 1 --2- 172.21.15.81:0/3119780883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc738157ca0 0x7fc7380ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:12.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.356+0000 7fc736ffd700 1 --2- 172.21.15.81:0/3119780883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7381578d0 0x7fc7380ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:12.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.357+0000 7fc7377fe700 1 -- 172.21.15.81:0/3119780883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7381578d0 msgr2=0x7fc7380ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:12.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.357+0000 7fc7377fe700 1 --2- 172.21.15.81:0/3119780883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7381578d0 0x7fc7380ad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.357+0000 7fc7377fe700 1 -- 172.21.15.81:0/3119780883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc738157ca0 msgr2=0x7fc7380ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:12.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.357+0000 7fc7377fe700 1 --2- 172.21.15.81:0/3119780883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc738157ca0 0x7fc7380ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.357+0000 7fc7377fe700 1 -- 172.21.15.81:0/3119780883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c009420 con 0x7fc73806d120 2023-10-07T08:48:12.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.357+0000 7fc7377fe700 1 --2- 172.21.15.81:0/3119780883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc73806d120 0x7fc7380abd50 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc72800c7e0 tx=0x7fc728007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:12.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.357+0000 7fc71f7fe700 1 -- 172.21.15.81:0/3119780883 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728005b30 con 0x7fc73806d120 2023-10-07T08:48:12.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.357+0000 7fc71f7fe700 1 -- 172.21.15.81:0/3119780883 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc728005c90 con 0x7fc73806d120 2023-10-07T08:48:12.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.357+0000 7fc73ddf5700 1 -- 172.21.15.81:0/3119780883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc73816e4e0 con 0x7fc73806d120 2023-10-07T08:48:12.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.357+0000 7fc71f7fe700 1 -- 172.21.15.81:0/3119780883 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728007300 con 0x7fc73806d120 2023-10-07T08:48:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.357+0000 7fc73ddf5700 1 -- 172.21.15.81:0/3119780883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7380ac330 con 0x7fc73806d120 2023-10-07T08:48:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.358+0000 7fc73ddf5700 1 -- 172.21.15.81:0/3119780883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc738067ac0 con 0x7fc73806d120 2023-10-07T08:48:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.358+0000 7fc71f7fe700 1 -- 172.21.15.81:0/3119780883 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc72801b400 con 0x7fc73806d120 2023-10-07T08:48:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.358+0000 7fc71f7fe700 1 --2- 172.21.15.81:0/3119780883 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc724066f30 0x7fc7240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.359+0000 7fc71f7fe700 1 -- 172.21.15.81:0/3119780883 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc728084040 con 0x7fc73806d120 2023-10-07T08:48:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.359+0000 7fc736ffd700 1 --2- 172.21.15.81:0/3119780883 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc724066f30 0x7fc7240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.359+0000 7fc71f7fe700 1 -- 172.21.15.81:0/3119780883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=107}) v3 -- 0x7fc72406ea50 con 0x7fc73806d120 2023-10-07T08:48:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.359+0000 7fc736ffd700 1 --2- 172.21.15.81:0/3119780883 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc724066f30 0x7fc7240693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc7381580c0 tx=0x7fc72c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.363+0000 7fc71f7fe700 1 -- 172.21.15.81:0/3119780883 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc728051330 con 0x7fc73806d120 2023-10-07T08:48:12.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.547+0000 7fc73ddf5700 1 -- 172.21.15.81:0/3119780883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc7380d0170 con 0x7fc73806d120 2023-10-07T08:48:12.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.548+0000 7fc71f7fe700 1 -- 172.21.15.81:0/3119780883 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v106) v1 ==== 81+0+32394 (secure 0 0 0) 0x7fc728054950 con 0x7fc73806d120 2023-10-07T08:48:12.550 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:12.550 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:48:12.550 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 106, 2023-10-07T08:48:12.550 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:48:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:48:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:48:10.402954+0000", 2023-10-07T08:48:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:48:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:48:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:48:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:48:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:48:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:48:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:48:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:48:12.551 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:48:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:48:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:48:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:48:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:48:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:48:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 13, 2023-10-07T08:48:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:48:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:48:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:48:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:48:12.552 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:48:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:48:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:48:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:48:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:48:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:48:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:12.553 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:48:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:48:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:48:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:48:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:48:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:12.554 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "103", 2023-10-07T08:48:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:12.555 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:12.556 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:48:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:48:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:48:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 12, 2023-10-07T08:48:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:48:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:47:47.993754+0000", 2023-10-07T08:48:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:48:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:48:12.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:48:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:48:12.560 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:48:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:48:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:48:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "103", 2023-10-07T08:48:12.561 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:48:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:48:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:48:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:48:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:48:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 13, 2023-10-07T08:48:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:48:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:47:48.631797+0000", 2023-10-07T08:48:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:48:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:48:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:48:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:48:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:48:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:48:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:48:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "103", 2023-10-07T08:48:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:48:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:48:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:48:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:48:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:48:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:48:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:48:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:48:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:48:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:48:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:48:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:48:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:48:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:48:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:48:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:48:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:48:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:48:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:48:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:48:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:48:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:48:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:48:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:48:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:48:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:48:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:48:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:48:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:48:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:48:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:48:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:48:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:48:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:48:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:48:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:48:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:48:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:48:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:48:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:48:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:48:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:48:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:48:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:48:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:48:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:48:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:48:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:48:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:48:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:48:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:48:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:48:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:48:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:48:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:48:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:48:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:48:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:48:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:48:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:48:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:48:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:48:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:48:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:48:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:48:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:48:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:48:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:48:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:48:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:48:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:48:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:48:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:48:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:48:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:48:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:48:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:48:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:48:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:48:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:48:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:48:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:48:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:48:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:48:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:48:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:48:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:48:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:48:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:48:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:48:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:48:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:48:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:48:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:48:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:48:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:48:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:48:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:48:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:48:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:48:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:48:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:48:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:48:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:48:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:48:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:48:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:48:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:48:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:48:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull", 2023-10-07T08:48:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:48:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:48:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:48:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:48:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:48:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:48:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:48:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:48:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:48:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:48:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:48:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:48:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:48:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:48:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:48:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:48:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:48:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:48:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:48:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:48:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:48:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:48:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:48:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:48:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:48:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:48:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:48:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:48:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:48:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:48:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:48:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:48:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:48:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:48:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:48:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:48:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:48:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:48:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:48:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:48:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:48:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:12.636 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:48:12.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.551+0000 7fc73ddf5700 1 -- 172.21.15.81:0/3119780883 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc724066f30 msgr2=0x7fc7240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:12.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.551+0000 7fc73ddf5700 1 --2- 172.21.15.81:0/3119780883 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc724066f30 0x7fc7240693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc7381580c0 tx=0x7fc72c017000 comp rx=0 tx=0).stop 2023-10-07T08:48:12.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.551+0000 7fc73ddf5700 1 -- 172.21.15.81:0/3119780883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc73806d120 msgr2=0x7fc7380abd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:12.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.551+0000 7fc73ddf5700 1 --2- 172.21.15.81:0/3119780883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc73806d120 0x7fc7380abd50 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc72800c7e0 tx=0x7fc728007df0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.551+0000 7fc73ddf5700 1 -- 172.21.15.81:0/3119780883 shutdown_connections 2023-10-07T08:48:12.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.551+0000 7fc73ddf5700 1 --2- 172.21.15.81:0/3119780883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc738157ca0 0x7fc7380ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.551+0000 7fc73ddf5700 1 --2- 172.21.15.81:0/3119780883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc73806d120 0x7fc7380abd50 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.551+0000 7fc73ddf5700 1 --2- 172.21.15.81:0/3119780883 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc724066f30 0x7fc7240693e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.551+0000 7fc73ddf5700 1 --2- 172.21.15.81:0/3119780883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7381578d0 0x7fc7380ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.551+0000 7fc73ddf5700 1 -- 172.21.15.81:0/3119780883 >> 172.21.15.81:0/3119780883 conn(0x7fc73806bb90 msgr2=0x7fc73806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:12.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.551+0000 7fc73ddf5700 1 -- 172.21.15.81:0/3119780883 shutdown_connections 2023-10-07T08:48:12.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.551+0000 7fc73ddf5700 1 -- 172.21.15.81:0/3119780883 wait complete. 2023-10-07T08:48:12.639 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:48:12.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.751+0000 7f88ed1e6700 1 Processor -- start 2023-10-07T08:48:12.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.751+0000 7f88ed1e6700 1 -- start start 2023-10-07T08:48:12.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.752+0000 7f88ed1e6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f88e806d830 0x7f88e80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:12.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.752+0000 7f88ed1e6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e80d07c0 con 0x7f88e8157ca0 2023-10-07T08:48:12.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.752+0000 7f88ed1e6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e80cfbb0 con 0x7f88e81578d0 2023-10-07T08:48:12.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.752+0000 7f88ed1e6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e80cfe90 con 0x7f88e806d830 2023-10-07T08:48:12.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.752+0000 7f88de59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f88e8157ca0 0x7f88e806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39298/0 (socket says 172.21.15.81:39298) 2023-10-07T08:48:12.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.752+0000 7f88de59c700 1 -- 172.21.15.81:0/2818052472 learned_addr learned my addr 172.21.15.81:0/2818052472 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:12.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.752+0000 7f88e759e700 1 --2- 172.21.15.81:0/2818052472 >> v2:172.21.15.89:3300/0 conn(0x7f88e806d830 0x7f88e80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:12.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.752+0000 7f88e659c700 1 -- 172.21.15.81:0/2818052472 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014825774 0 0) 0x7f88e80d07c0 con 0x7f88e8157ca0 2023-10-07T08:48:12.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.752+0000 7f88e659c700 1 -- 172.21.15.81:0/2818052472 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88d4003570 con 0x7f88e8157ca0 2023-10-07T08:48:12.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e659c700 1 -- 172.21.15.81:0/2818052472 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1496746514 0 0) 0x7f88d4003570 con 0x7f88e8157ca0 2023-10-07T08:48:12.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e659c700 1 -- 172.21.15.81:0/2818052472 >> v2:172.21.15.89:3300/0 conn(0x7f88e806d830 msgr2=0x7f88e80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:12.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e659c700 1 --2- 172.21.15.81:0/2818052472 >> v2:172.21.15.89:3300/0 conn(0x7f88e806d830 0x7f88e80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e659c700 1 -- 172.21.15.81:0/2818052472 >> v1:172.21.15.89:6789/0 conn(0x7f88e81578d0 legacy=0x7f88e815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:12.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e659c700 1 -- 172.21.15.81:0/2818052472 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e80d0170 con 0x7f88e8157ca0 2023-10-07T08:48:12.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e659c700 1 -- 172.21.15.81:0/2818052472 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f88d0001470 con 0x7f88e8157ca0 2023-10-07T08:48:12.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e659c700 1 -- 172.21.15.81:0/2818052472 >> v1:172.21.15.81:6789/0 conn(0x7f88e8157ca0 legacy=0x7f88e806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:12.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e659c700 1 --2- 172.21.15.81:0/2818052472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88d4003a60 0x7f88d4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:12.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e659c700 1 --2- 172.21.15.81:0/2818052472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d4004810 0x7f88d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:12.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e659c700 1 --2- 172.21.15.81:0/2818052472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d40051c0 0x7f88d400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:12.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e659c700 1 -- 172.21.15.81:0/2818052472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e80cfe90 con 0x7f88d40051c0 2023-10-07T08:48:12.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e659c700 1 -- 172.21.15.81:0/2818052472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d400c0d0 con 0x7f88d4003a60 2023-10-07T08:48:12.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e659c700 1 -- 172.21.15.81:0/2818052472 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d400c290 con 0x7f88d4004810 2023-10-07T08:48:12.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e759e700 1 --2- 172.21.15.81:0/2818052472 >> v2:172.21.15.89:3300/0 conn(0x7f88e806d830 0x7f88e80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:48:12.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e759e700 1 --2- 172.21.15.81:0/2818052472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d40051c0 0x7f88d400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:12.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e6d9d700 1 --2- 172.21.15.81:0/2818052472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88d4003a60 0x7f88d4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:12.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88de59c700 1 --2- 172.21.15.81:0/2818052472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d4004810 0x7f88d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:12.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e759e700 1 -- 172.21.15.81:0/2818052472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d4004810 msgr2=0x7f88d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:12.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e759e700 1 --2- 172.21.15.81:0/2818052472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d4004810 0x7f88d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e759e700 1 -- 172.21.15.81:0/2818052472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88d4003a60 msgr2=0x7f88d4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:12.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e759e700 1 --2- 172.21.15.81:0/2818052472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88d4003a60 0x7f88d4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e759e700 1 -- 172.21.15.81:0/2818052472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d4003570 con 0x7f88d40051c0 2023-10-07T08:48:12.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e759e700 1 -- 172.21.15.81:0/2818052472 reap_dead start 2023-10-07T08:48:12.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e759e700 1 --2- 172.21.15.81:0/2818052472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d40051c0 0x7f88d400ba60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f88e000e3c0 tx=0x7f88e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f70090beb04235e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:12.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e659c700 1 -- 172.21.15.81:0/2818052472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0009c50 con 0x7f88d40051c0 2023-10-07T08:48:12.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e659c700 1 -- 172.21.15.81:0/2818052472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e000f040 con 0x7f88d40051c0 2023-10-07T08:48:12.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.753+0000 7f88e659c700 1 -- 172.21.15.81:0/2818052472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e000eea0 con 0x7f88d40051c0 2023-10-07T08:48:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.754+0000 7f88ed1e6700 1 -- 172.21.15.81:0/2818052472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d40051c0 msgr2=0x7f88d400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.754+0000 7f88ed1e6700 1 --2- 172.21.15.81:0/2818052472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d40051c0 0x7f88d400ba60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f88e000e3c0 tx=0x7f88e000b040 comp rx=0 tx=0).stop 2023-10-07T08:48:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.754+0000 7f88ed1e6700 1 -- 172.21.15.81:0/2818052472 shutdown_connections 2023-10-07T08:48:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.754+0000 7f88ed1e6700 1 --2- 172.21.15.81:0/2818052472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d40051c0 0x7f88d400ba60 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.754+0000 7f88ed1e6700 1 -- 172.21.15.81:0/2818052472 >> 172.21.15.81:0/2818052472 conn(0x7f88e806bb90 msgr2=0x7f88e806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.754+0000 7f88ed1e6700 1 -- 172.21.15.81:0/2818052472 shutdown_connections 2023-10-07T08:48:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.754+0000 7f88ed1e6700 1 -- 172.21.15.81:0/2818052472 wait complete. 2023-10-07T08:48:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.755+0000 7f88ed1e6700 1 Processor -- start 2023-10-07T08:48:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.755+0000 7f88ed1e6700 1 -- start start 2023-10-07T08:48:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88ed1e6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d40051c0 0x7f88e8144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88ed1e6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88e815c670 0x7f88e815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88ed1e6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88e80aa890 0x7f88e80aad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:12.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88ed1e6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e815d020 con 0x7f88e80aa890 2023-10-07T08:48:12.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88ed1e6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e8144b90 con 0x7f88e815c670 2023-10-07T08:48:12.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88ed1e6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e8145430 con 0x7f88d40051c0 2023-10-07T08:48:12.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88e759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88e80aa890 0x7f88e80aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:12.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88e759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88e80aa890 0x7f88e80aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59854/0 (socket says 172.21.15.81:59854) 2023-10-07T08:48:12.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88e759e700 1 -- 172.21.15.81:0/3820013919 learned_addr learned my addr 172.21.15.81:0/3820013919 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88e6d9d700 1 --2- 172.21.15.81:0/3820013919 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d40051c0 0x7f88e8144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88de59c700 1 --2- 172.21.15.81:0/3820013919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88e815c670 0x7f88e815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88e759e700 1 -- 172.21.15.81:0/3820013919 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d40051c0 msgr2=0x7f88e8144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88e759e700 1 --2- 172.21.15.81:0/3820013919 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d40051c0 0x7f88e8144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88e759e700 1 -- 172.21.15.81:0/3820013919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88e815c670 msgr2=0x7f88e815cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88e759e700 1 --2- 172.21.15.81:0/3820013919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88e815c670 0x7f88e815cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88e759e700 1 -- 172.21.15.81:0/3820013919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e80b2690 con 0x7f88e80aa890 2023-10-07T08:48:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.756+0000 7f88e759e700 1 --2- 172.21.15.81:0/3820013919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88e80aa890 0x7f88e80aad00 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f88e000afd0 tx=0x7f88e0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.757+0000 7f88df7fe700 1 -- 172.21.15.81:0/3820013919 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e001e720 con 0x7f88e80aa890 2023-10-07T08:48:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.757+0000 7f88df7fe700 1 -- 172.21.15.81:0/3820013919 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e001e8a0 con 0x7f88e80aa890 2023-10-07T08:48:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.757+0000 7f88ed1e6700 1 -- 172.21.15.81:0/3820013919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e8144de0 con 0x7f88e80aa890 2023-10-07T08:48:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.757+0000 7f88df7fe700 1 -- 172.21.15.81:0/3820013919 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e001ec60 con 0x7f88e80aa890 2023-10-07T08:48:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.757+0000 7f88ed1e6700 1 -- 172.21.15.81:0/3820013919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e80ab240 con 0x7f88e80aa890 2023-10-07T08:48:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.758+0000 7f88ed1e6700 1 -- 172.21.15.81:0/3820013919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e8067ac0 con 0x7f88e80aa890 2023-10-07T08:48:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.758+0000 7f88df7fe700 1 -- 172.21.15.81:0/3820013919 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f88e0028480 con 0x7f88e80aa890 2023-10-07T08:48:12.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.758+0000 7f88df7fe700 1 --2- 172.21.15.81:0/3820013919 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f88c8066f30 0x7f88c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:12.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.758+0000 7f88df7fe700 1 -- 172.21.15.81:0/3820013919 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f88e0086e00 con 0x7f88e80aa890 2023-10-07T08:48:12.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.758+0000 7f88e6d9d700 1 --2- 172.21.15.81:0/3820013919 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f88c8066f30 0x7f88c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:12.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.758+0000 7f88df7fe700 1 -- 172.21.15.81:0/3820013919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=107}) v3 -- 0x7f88c806ea50 con 0x7f88e80aa890 2023-10-07T08:48:12.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.759+0000 7f88e6d9d700 1 --2- 172.21.15.81:0/3820013919 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f88c8066f30 0x7f88c80693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f88d8007e40 tx=0x7f88d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:12.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.762+0000 7f88df7fe700 1 -- 172.21.15.81:0/3820013919 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88e0054070 con 0x7f88e80aa890 2023-10-07T08:48:12.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.984+0000 7f88ed1e6700 1 -- 172.21.15.81:0/3820013919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88e815d020 con 0x7f88e80aa890 2023-10-07T08:48:12.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.985+0000 7f88df7fe700 1 -- 172.21.15.81:0/3820013919 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f88e0057690 con 0x7f88e80aa890 2023-10-07T08:48:12.986 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:12.987 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1015639142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1015639142},{"type":"v1","addr":"172.21.15.89:6833","nonce":1015639142}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2650972762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2650972762},{"type":"v1","addr":"172.21.15.89:6835","nonce":2650972762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2058286084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2058286084},{"type":"v1","addr":"172.21.15.81:6836","nonce":2058286084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:47:49.671409+0000","modified":"2023-10-07T08:47:53.341944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6837/3696879604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3696879604},{"type":"v1","addr":"172.21.15.81:6837","nonce":3696879604}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-07T08:48:12.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.987+0000 7f88ed1e6700 1 -- 172.21.15.81:0/3820013919 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f88c8066f30 msgr2=0x7f88c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:12.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.987+0000 7f88ed1e6700 1 --2- 172.21.15.81:0/3820013919 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f88c8066f30 0x7f88c80693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f88d8007e40 tx=0x7f88d8009040 comp rx=0 tx=0).stop 2023-10-07T08:48:12.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.987+0000 7f88ed1e6700 1 -- 172.21.15.81:0/3820013919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88e80aa890 msgr2=0x7f88e80aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:12.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.987+0000 7f88ed1e6700 1 --2- 172.21.15.81:0/3820013919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88e80aa890 0x7f88e80aad00 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f88e000afd0 tx=0x7f88e0019000 comp rx=0 tx=0).stop 2023-10-07T08:48:12.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.987+0000 7f88ed1e6700 1 -- 172.21.15.81:0/3820013919 shutdown_connections 2023-10-07T08:48:12.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.987+0000 7f88ed1e6700 1 --2- 172.21.15.81:0/3820013919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88e80aa890 0x7f88e80aad00 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.987+0000 7f88ed1e6700 1 --2- 172.21.15.81:0/3820013919 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f88c8066f30 0x7f88c80693e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.987+0000 7f88ed1e6700 1 --2- 172.21.15.81:0/3820013919 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d40051c0 0x7f88e8144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.987+0000 7f88ed1e6700 1 --2- 172.21.15.81:0/3820013919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88e815c670 0x7f88e815cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:12.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.987+0000 7f88ed1e6700 1 -- 172.21.15.81:0/3820013919 >> 172.21.15.81:0/3820013919 conn(0x7f88e806bb90 msgr2=0x7f88e81568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:12.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.987+0000 7f88ed1e6700 1 -- 172.21.15.81:0/3820013919 shutdown_connections 2023-10-07T08:48:12.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:12.987+0000 7f88ed1e6700 1 -- 172.21.15.81:0/3820013919 wait complete. 2023-10-07T08:48:12.990 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 50 2023-10-07T08:48:13.000 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-07T08:48:13.134 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":6336,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":22.805348759000001,"mdsmap_epoch":50,"osdmap_epoch":106,"osdmap_epoch_barrier":106,"uptime":34.137315813000001} 2023-10-07T08:48:13.134 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 6336, "mdsmap_epoch": 50, "osdmap_epoch": 106, "osdmap_epoch_barrier": 106, "rank_uptime": 22.805348759, "state": "up:active", "uptime": 34.137315813, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:48:13.134 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-07T08:48:13.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:48:13.135 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-07T08:48:13.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:48:13.150 INFO:teuthology.orchestra.run.smithi081.stderr:dd: failed to open 'small_file_1': Permission denied 2023-10-07T08:48:13.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:48:13.151 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-07T08:48:13.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:48:13.207 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-07T08:48:13.270 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:48:13.269+0000 7f43c6f32700 -1 log_channel(cluster) log [ERR] : Health check update: 5 full osd(s) (OSD_FULL) 2023-10-07T08:48:13.284 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:48:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.438+0000 7f9f8cef3700 1 Processor -- start 2023-10-07T08:48:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.438+0000 7f9f8cef3700 1 -- start start 2023-10-07T08:48:13.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.438+0000 7f9f8cef3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f881578d0 0x7f9f880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.439+0000 7f9f8cef3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9f88157ca0 0x7f9f8815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.439+0000 7f9f8cef3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f880d07c0 con 0x7f9f8806d120 2023-10-07T08:48:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.439+0000 7f9f8cef3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f880cfbb0 con 0x7f9f881578d0 2023-10-07T08:48:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.439+0000 7f9f8cef3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f880cfe90 con 0x7f9f88157ca0 2023-10-07T08:48:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.439+0000 7f9f8659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f881578d0 0x7f9f880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.439+0000 7f9f8659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f881578d0 0x7f9f880cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59866/0 (socket says 172.21.15.81:59866) 2023-10-07T08:48:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.439+0000 7f9f8659c700 1 -- 172.21.15.81:0/2104022170 learned_addr learned my addr 172.21.15.81:0/2104022170 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.439+0000 7f9f7ffff700 1 --2- 172.21.15.81:0/2104022170 >> v2:172.21.15.89:3300/0 conn(0x7f9f88157ca0 0x7f9f8815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.439+0000 7f9f8659c700 1 -- 172.21.15.81:0/2104022170 >> v2:172.21.15.89:3300/0 conn(0x7f9f88157ca0 msgr2=0x7f9f8815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.439+0000 7f9f8659c700 1 --2- 172.21.15.81:0/2104022170 >> v2:172.21.15.89:3300/0 conn(0x7f9f88157ca0 0x7f9f8815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.439+0000 7f9f8659c700 1 -- 172.21.15.81:0/2104022170 >> v1:172.21.15.89:6789/0 conn(0x7f9f8806d120 legacy=0x7f9f8806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.439+0000 7f9f8659c700 1 -- 172.21.15.81:0/2104022170 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f880d0170 con 0x7f9f881578d0 2023-10-07T08:48:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.439+0000 7f9f8659c700 1 --2- 172.21.15.81:0/2104022170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f881578d0 0x7f9f880cf4f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f9f88068510 tx=0x7f9f78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f1aec13a4ae62a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.439+0000 7f9f85d9b700 1 -- 172.21.15.81:0/2104022170 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7800b820 con 0x7f9f881578d0 2023-10-07T08:48:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.439+0000 7f9f85d9b700 1 -- 172.21.15.81:0/2104022170 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7800b980 con 0x7f9f881578d0 2023-10-07T08:48:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.439+0000 7f9f85d9b700 1 -- 172.21.15.81:0/2104022170 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7800bd20 con 0x7f9f881578d0 2023-10-07T08:48:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.440+0000 7f9f8cef3700 1 -- 172.21.15.81:0/2104022170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f881578d0 msgr2=0x7f9f880cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.440+0000 7f9f8cef3700 1 --2- 172.21.15.81:0/2104022170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f881578d0 0x7f9f880cf4f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f9f88068510 tx=0x7f9f78009250 comp rx=0 tx=0).stop 2023-10-07T08:48:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.440+0000 7f9f8cef3700 1 -- 172.21.15.81:0/2104022170 shutdown_connections 2023-10-07T08:48:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.440+0000 7f9f8cef3700 1 --2- 172.21.15.81:0/2104022170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f881578d0 0x7f9f880cf4f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.440+0000 7f9f8cef3700 1 --2- 172.21.15.81:0/2104022170 >> v2:172.21.15.89:3300/0 conn(0x7f9f88157ca0 0x7f9f8815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.440+0000 7f9f8cef3700 1 -- 172.21.15.81:0/2104022170 >> 172.21.15.81:0/2104022170 conn(0x7f9f8806bb90 msgr2=0x7f9f8806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.440+0000 7f9f8cef3700 1 -- 172.21.15.81:0/2104022170 shutdown_connections 2023-10-07T08:48:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.440+0000 7f9f8cef3700 1 -- 172.21.15.81:0/2104022170 wait complete. 2023-10-07T08:48:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.441+0000 7f9f8cef3700 1 Processor -- start 2023-10-07T08:48:13.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.441+0000 7f9f8cef3700 1 -- start start 2023-10-07T08:48:13.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f8cef3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f8806d120 0x7f9f880c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:13.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f8cef3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f881578d0 0x7f9f880c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:13.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f8cef3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f88157ca0 0x7f9f88069ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:13.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f8cef3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f880c5b20 con 0x7f9f88157ca0 2023-10-07T08:48:13.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f8cef3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f880c63c0 con 0x7f9f8806d120 2023-10-07T08:48:13.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f8cef3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f880c8a90 con 0x7f9f881578d0 2023-10-07T08:48:13.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f86d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f88157ca0 0x7f9f88069ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:13.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f86d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f88157ca0 0x7f9f88069ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59878/0 (socket says 172.21.15.81:59878) 2023-10-07T08:48:13.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f86d9d700 1 -- 172.21.15.81:0/2865308286 learned_addr learned my addr 172.21.15.81:0/2865308286 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:13.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f8659c700 1 --2- 172.21.15.81:0/2865308286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f8806d120 0x7f9f880c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:13.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f7ffff700 1 --2- 172.21.15.81:0/2865308286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f881578d0 0x7f9f880c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:13.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f86d9d700 1 -- 172.21.15.81:0/2865308286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f881578d0 msgr2=0x7f9f880c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:13.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f86d9d700 1 --2- 172.21.15.81:0/2865308286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f881578d0 0x7f9f880c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:13.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f86d9d700 1 -- 172.21.15.81:0/2865308286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f8806d120 msgr2=0x7f9f880c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:13.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f86d9d700 1 --2- 172.21.15.81:0/2865308286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f8806d120 0x7f9f880c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:13.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f86d9d700 1 -- 172.21.15.81:0/2865308286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f780094f0 con 0x7f9f88157ca0 2023-10-07T08:48:13.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f7ffff700 1 --2- 172.21.15.81:0/2865308286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f881578d0 0x7f9f880c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:13.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f86d9d700 1 --2- 172.21.15.81:0/2865308286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f88157ca0 0x7f9f88069ca0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000bbe0 tx=0x7f9f80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:13.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f7e7fc700 1 -- 172.21.15.81:0/2865308286 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f800092e0 con 0x7f9f88157ca0 2023-10-07T08:48:13.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f7e7fc700 1 -- 172.21.15.81:0/2865308286 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8000c7a0 con 0x7f9f88157ca0 2023-10-07T08:48:13.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f8cef3700 1 -- 172.21.15.81:0/2865308286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8816ee10 con 0x7f9f88157ca0 2023-10-07T08:48:13.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f7e7fc700 1 -- 172.21.15.81:0/2865308286 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8000cb60 con 0x7f9f88157ca0 2023-10-07T08:48:13.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.442+0000 7f9f8cef3700 1 -- 172.21.15.81:0/2865308286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f880c6050 con 0x7f9f88157ca0 2023-10-07T08:48:13.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.443+0000 7f9f8cef3700 1 -- 172.21.15.81:0/2865308286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f880c6550 con 0x7f9f88157ca0 2023-10-07T08:48:13.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.444+0000 7f9f7e7fc700 1 -- 172.21.15.81:0/2865308286 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f80012070 con 0x7f9f88157ca0 2023-10-07T08:48:13.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.444+0000 7f9f7e7fc700 1 --2- 172.21.15.81:0/2865308286 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f68066f30 0x7f9f680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:13.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.444+0000 7f9f7e7fc700 1 -- 172.21.15.81:0/2865308286 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9f80084210 con 0x7f9f88157ca0 2023-10-07T08:48:13.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.444+0000 7f9f8659c700 1 --2- 172.21.15.81:0/2865308286 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f68066f30 0x7f9f680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:13.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.444+0000 7f9f7e7fc700 1 -- 172.21.15.81:0/2865308286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=107}) v3 -- 0x7f9f6806ea50 con 0x7f9f88157ca0 2023-10-07T08:48:13.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.445+0000 7f9f8659c700 1 --2- 172.21.15.81:0/2865308286 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f68066f30 0x7f9f680693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9f88068510 tx=0x7f9f78016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:13.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.448+0000 7f9f7e7fc700 1 -- 172.21.15.81:0/2865308286 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f80051530 con 0x7f9f88157ca0 2023-10-07T08:48:13.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.634+0000 7f9f8cef3700 1 -- 172.21.15.81:0/2865308286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9f880d0450 con 0x7f9f88157ca0 2023-10-07T08:48:13.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.635+0000 7f9f7e7fc700 1 -- 172.21.15.81:0/2865308286 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v106) v1 ==== 81+0+32394 (secure 0 0 0) 0x7f9f80054b50 con 0x7f9f88157ca0 2023-10-07T08:48:13.637 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:13.637 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:48:13.637 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 106, 2023-10-07T08:48:13.637 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:48:13.638 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:48:13.638 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:48:10.402954+0000", 2023-10-07T08:48:13.638 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:48:13.638 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:48:13.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:48:13.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:48:13.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:48:13.638 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:48:13.639 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:48:13.639 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:48:13.639 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:48:13.639 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:13.639 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:48:13.639 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:48:13.639 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:48:13.639 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:48:13.639 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:48:13.639 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 13, 2023-10-07T08:48:13.639 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:48:13.640 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:48:13.640 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:48:13.640 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:48:13.640 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:48:13.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.640 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:48:13.640 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:48:13.640 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:48:13.640 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:48:13.640 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:48:13.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:13.641 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:13.641 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:13.641 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:13.641 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:13.641 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:13.641 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:13.641 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:13.641 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:13.641 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:13.642 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:48:13.642 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:48:13.642 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:48:13.642 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:48:13.642 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:48:13.642 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:13.642 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:13.642 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:13.642 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:13.643 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:13.643 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:13.643 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:13.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.643 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "103", 2023-10-07T08:48:13.643 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:13.643 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:13.643 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:13.643 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:13.643 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:13.644 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:13.644 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:13.644 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:13.644 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:13.644 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:13.644 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:13.644 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:13.644 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:13.644 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:13.644 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:13.644 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:13.645 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:13.645 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:13.645 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:13.645 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:13.645 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:13.645 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:13.645 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:13.645 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:13.645 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:13.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:13.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.646 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:13.646 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:13.646 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:13.647 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:13.647 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:13.647 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:13.647 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:13.647 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:13.647 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:13.647 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:13.647 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:13.647 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:13.648 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:48:13.648 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:48:13.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.648 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:13.648 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:48:13.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.649 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 12, 2023-10-07T08:48:13.649 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:48:13.649 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:47:47.993754+0000", 2023-10-07T08:48:13.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:48:13.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:48:13.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:13.650 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:13.650 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:13.650 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:13.651 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:13.651 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:13.651 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:13.651 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:13.651 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:13.651 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:13.652 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:48:13.652 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:48:13.652 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:48:13.652 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:48:13.652 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:48:13.653 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:13.653 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:13.653 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:13.653 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:13.654 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:13.654 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:13.654 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:13.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.654 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "103", 2023-10-07T08:48:13.655 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:13.655 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:13.655 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:13.655 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:13.655 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:13.656 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:13.656 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:13.656 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:13.656 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:13.656 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:13.656 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:13.657 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:13.657 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:13.657 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:13.657 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:13.657 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:13.657 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:13.658 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:13.658 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:13.658 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:13.658 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:13.659 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:13.659 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:13.659 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:13.659 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:13.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:13.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.660 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:13.660 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:13.661 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:13.661 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:13.661 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:13.661 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:13.661 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:13.661 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:13.662 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:13.662 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:13.662 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:13.662 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:13.662 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:48:13.662 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:48:13.663 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:48:13.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.663 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:13.663 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:48:13.663 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:48:13.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.664 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 13, 2023-10-07T08:48:13.664 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:48:13.664 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:47:48.631797+0000", 2023-10-07T08:48:13.665 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:48:13.665 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:48:13.666 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:13.666 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:13.666 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:13.667 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:13.667 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:13.667 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:13.667 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:13.668 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:13.668 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:13.668 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:13.669 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:48:13.669 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:48:13.669 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:48:13.669 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:48:13.669 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:48:13.669 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:13.670 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:13.670 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:13.670 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:13.670 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:13.670 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:13.670 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:13.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.671 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "103", 2023-10-07T08:48:13.671 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:13.671 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:13.671 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:13.671 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:13.671 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:13.672 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:13.672 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:13.672 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:13.672 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:13.672 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:13.673 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:13.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:13.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:13.673 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:13.673 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:13.674 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:13.674 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:13.674 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:13.674 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:13.674 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:13.674 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:13.675 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:13.675 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:13.675 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:13.675 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:13.675 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:13.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.675 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:13.676 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:13.676 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:13.676 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:13.676 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:13.676 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:13.676 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:13.677 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:13.677 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:13.677 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:13.677 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:13.677 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:13.677 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:48:13.678 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:48:13.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.678 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:13.678 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:48:13.678 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:48:13.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.678 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:13.678 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:48:13.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.679 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:48:13.679 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:13.679 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:13.679 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:13.679 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:13.679 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:13.679 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:13.679 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:13.679 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:13.679 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:13.679 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:13.679 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:13.680 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:13.680 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.680 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.680 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:48:13.680 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:13.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.680 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.680 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:48:13.680 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:13.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.680 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.681 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:13.681 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.681 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:48:13.681 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:13.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.681 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:48:13.681 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:13.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.682 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.682 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:13.682 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.682 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.682 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:48:13.682 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:13.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.682 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.682 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:48:13.683 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:13.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.683 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.683 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:13.683 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.683 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:48:13.683 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:13.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.684 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.684 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:48:13.684 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:13.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.684 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.684 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:48:13.684 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:48:13.684 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:48:13.684 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:48:13.684 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:13.684 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:13.684 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:13.685 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:13.685 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.685 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:48:13.685 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:13.685 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:13.685 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:13.685 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:13.685 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:13.685 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:13.685 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:13.686 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:13.686 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:13.686 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:13.686 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:13.686 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:13.686 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.686 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:48:13.686 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:13.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.687 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.687 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:48:13.687 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:13.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.687 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.687 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:13.687 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.687 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.687 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:48:13.687 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:13.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.688 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:48:13.688 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:13.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.688 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.688 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:13.688 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.688 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:48:13.689 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:13.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.689 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.689 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:48:13.689 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:13.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.689 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.689 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:13.689 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.690 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:48:13.690 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:13.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.690 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:48:13.690 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:13.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.690 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.690 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:48:13.690 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:48:13.691 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:48:13.691 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:48:13.691 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:13.691 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:13.691 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:13.691 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:13.691 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.691 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:48:13.691 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:13.691 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:13.692 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:13.692 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:13.692 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:13.692 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:13.692 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:13.692 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:13.692 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:13.692 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:13.692 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:13.692 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:13.692 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.693 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:48:13.693 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:13.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.693 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:48:13.693 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:13.693 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.693 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.694 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:13.694 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.694 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.694 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:48:13.694 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:13.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.694 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.694 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:48:13.694 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:13.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.695 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:13.695 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.695 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:48:13.695 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:13.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.695 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:48:13.696 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:13.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.696 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.696 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:13.696 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.696 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.696 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:48:13.696 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:13.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.697 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:48:13.697 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:13.697 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.697 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.697 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:48:13.697 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:48:13.697 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:48:13.697 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:48:13.697 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:13.697 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:13.698 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:13.698 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:13.698 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.698 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:48:13.698 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:13.698 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:13.698 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:13.698 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:13.698 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:13.698 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:13.699 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:13.699 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:13.699 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:13.699 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:13.699 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:13.699 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:13.699 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.699 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.699 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:48:13.699 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:13.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.700 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.700 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:48:13.700 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:13.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.700 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.700 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:13.700 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.700 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.700 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:48:13.700 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:13.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.701 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:48:13.701 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:13.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.701 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.701 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:13.701 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.702 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:48:13.702 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:13.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.702 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.702 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:48:13.702 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:13.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.702 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.702 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:13.702 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.703 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:48:13.703 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:13.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.703 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:48:13.703 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:13.703 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.703 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.703 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:48:13.704 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:48:13.704 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:48:13.704 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:48:13.704 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:13.704 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:13.704 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:13.704 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.704 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:48:13.704 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:13.704 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:13.704 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:13.705 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:13.705 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:13.705 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:13.705 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:13.705 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:13.705 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:13.705 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:13.705 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:13.705 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:13.705 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.706 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:48:13.706 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:13.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.706 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:48:13.706 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:13.706 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.706 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.706 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:13.706 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.707 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.707 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:48:13.707 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:13.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.707 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.707 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:48:13.707 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:13.707 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.707 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.707 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:13.708 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.708 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:48:13.708 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:13.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.708 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:48:13.708 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:13.708 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.708 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.709 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:13.709 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.709 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.709 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:48:13.709 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:13.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.709 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.709 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:48:13.709 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:13.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.710 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.710 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:48:13.710 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:48:13.710 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:48:13.710 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:48:13.710 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:13.710 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:13.710 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:13.710 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:13.710 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.711 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:48:13.711 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:13.711 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:13.711 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:13.711 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:13.711 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:13.711 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:13.711 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:13.711 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:13.711 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:13.711 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:13.712 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:13.712 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:13.712 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.712 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:48:13.712 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:13.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.712 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:48:13.712 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:13.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.713 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.713 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:13.713 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.713 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:48:13.713 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:13.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.714 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:48:13.714 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:13.714 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.714 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.714 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:13.714 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.714 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:48:13.714 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:13.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.715 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.715 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:48:13.715 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:13.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.715 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.715 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:13.715 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.715 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.715 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:48:13.716 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:13.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.716 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.716 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:48:13.716 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:13.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.716 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.716 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:48:13.716 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:48:13.717 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:48:13.717 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:48:13.717 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:13.717 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:13.717 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:13.717 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.717 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:48:13.717 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:13.717 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:13.717 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.719 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:13.720 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.720 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.720 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:48:13.720 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:13.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.720 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.720 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:48:13.720 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:13.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.720 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.721 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:13.721 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.721 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:48:13.721 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:13.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.721 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:48:13.721 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:13.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.722 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.722 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:13.722 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.722 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:48:13.722 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:13.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.722 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:48:13.723 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:13.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.723 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.723 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:48:13.723 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:48:13.723 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:48:13.723 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:48:13.723 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:13.723 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:13.723 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:13.723 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:13.724 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.724 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:48:13.724 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:13.724 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:13.724 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:13.724 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:13.724 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:13.724 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:13.724 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:13.724 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:13.724 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:13.725 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:13.725 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:13.725 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:13.725 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.725 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:48:13.725 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:13.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.725 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:48:13.726 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:13.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.726 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.726 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:13.726 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.726 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:48:13.726 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:13.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.727 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:48:13.727 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:13.727 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.727 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.727 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:13.727 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.728 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.728 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:48:13.728 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:13.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.728 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.728 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:48:13.728 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:13.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.728 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.729 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:13.729 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:13.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:13.729 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:48:13.729 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:13.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:13.730 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:48:13.730 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:13.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.730 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.730 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:48:13.730 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:48:13.730 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:48:13.730 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:48:13.730 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:13.731 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull", 2023-10-07T08:48:13.731 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:13.731 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:13.731 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:13.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.731 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:13.731 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:48:13.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.731 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:48:13.731 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:13.731 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:13.732 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:13.732 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:13.732 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:13.732 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:48:13.732 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:13.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.732 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:48:13.732 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:13.732 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:13.732 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:13.732 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:13.733 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:13.733 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:48:13.733 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:13.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.733 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:48:13.733 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:13.733 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:13.733 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:13.733 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:13.733 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:13.733 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:48:13.734 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:13.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.734 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:48:13.734 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:13.734 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:13.734 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:13.734 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:13.734 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:13.734 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:48:13.734 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:13.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:48:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:48:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:48:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:48:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:48:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:13.737 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:13.737 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:13.737 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:48:13.737 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:13.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:13.737 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:48:13.737 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:13.737 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:13.737 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:13.737 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:13.737 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:13.738 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:48:13.738 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:13.738 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.738 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:13.738 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:48:13.738 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:48:13.738 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:48:13.738 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:48:13.738 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:48:13.738 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:48:13.738 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:48:13.738 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:48:13.739 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:48:13.739 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:48:13.739 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:48:13.739 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:48:13.739 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:48:13.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:13.739 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:48:13.739 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:48:13.739 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:48:13.739 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:48:13.739 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:48:13.740 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:48:13.740 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:48:13.740 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:48:13.740 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:48:13.740 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:48:13.740 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:48:13.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:13.740 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:48:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.637+0000 7f9f8cef3700 1 -- 172.21.15.81:0/2865308286 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f68066f30 msgr2=0x7f9f680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.637+0000 7f9f8cef3700 1 --2- 172.21.15.81:0/2865308286 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f68066f30 0x7f9f680693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9f88068510 tx=0x7f9f78016000 comp rx=0 tx=0).stop 2023-10-07T08:48:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.637+0000 7f9f8cef3700 1 -- 172.21.15.81:0/2865308286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f88157ca0 msgr2=0x7f9f88069ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.637+0000 7f9f8cef3700 1 --2- 172.21.15.81:0/2865308286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f88157ca0 0x7f9f88069ca0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000bbe0 tx=0x7f9f80009840 comp rx=0 tx=0).stop 2023-10-07T08:48:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.637+0000 7f9f8cef3700 1 -- 172.21.15.81:0/2865308286 shutdown_connections 2023-10-07T08:48:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.637+0000 7f9f8cef3700 1 --2- 172.21.15.81:0/2865308286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f88157ca0 0x7f9f88069ca0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.637+0000 7f9f8cef3700 1 --2- 172.21.15.81:0/2865308286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f8806d120 0x7f9f880c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.637+0000 7f9f8cef3700 1 --2- 172.21.15.81:0/2865308286 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9f68066f30 0x7f9f680693e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.637+0000 7f9f8cef3700 1 --2- 172.21.15.81:0/2865308286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f881578d0 0x7f9f880c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.637+0000 7f9f8cef3700 1 -- 172.21.15.81:0/2865308286 >> 172.21.15.81:0/2865308286 conn(0x7f9f8806bb90 msgr2=0x7f9f88155a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.638+0000 7f9f8cef3700 1 -- 172.21.15.81:0/2865308286 shutdown_connections 2023-10-07T08:48:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:13.638+0000 7f9f8cef3700 1 -- 172.21.15.81:0/2865308286 wait complete. 2023-10-07T08:48:13.743 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-07T08:48:18.271 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:48:18.270+0000 7f43c6f32700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-07T08:48:18.744 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:48:18.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.871+0000 7fa821287700 1 Processor -- start 2023-10-07T08:48:18.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.871+0000 7fa821287700 1 -- start start 2023-10-07T08:48:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.872+0000 7fa821287700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa81c159b40 0x7fa81c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.872+0000 7fa821287700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa81c068e90 0x7fa81c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.872+0000 7fa821287700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c0cee10 con 0x7fa81c159f10 2023-10-07T08:48:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.872+0000 7fa821287700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c0cd040 con 0x7fa81c159b40 2023-10-07T08:48:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.872+0000 7fa821287700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c0cd320 con 0x7fa81c068e90 2023-10-07T08:48:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.872+0000 7fa81bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa81c159b40 0x7fa81c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.872+0000 7fa81b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa81c159f10 0x7fa81c068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39308/0 (socket says 172.21.15.81:39308) 2023-10-07T08:48:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.872+0000 7fa81b7fe700 1 -- 172.21.15.81:0/437495684 learned_addr learned my addr 172.21.15.81:0/437495684 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.872+0000 7fa81bfff700 1 --2- 172.21.15.81:0/437495684 >> v2:172.21.15.81:3300/0 conn(0x7fa81c159b40 0x7fa81c0cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59890/0 (socket says 172.21.15.81:59890) 2023-10-07T08:48:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.872+0000 7fa820a86700 1 --2- 172.21.15.81:0/437495684 >> v2:172.21.15.89:3300/0 conn(0x7fa81c068e90 0x7fa81c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.872+0000 7fa81bfff700 1 -- 172.21.15.81:0/437495684 >> v2:172.21.15.89:3300/0 conn(0x7fa81c068e90 msgr2=0x7fa81c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.872+0000 7fa81bfff700 1 --2- 172.21.15.81:0/437495684 >> v2:172.21.15.89:3300/0 conn(0x7fa81c068e90 0x7fa81c0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.872+0000 7fa81bfff700 1 -- 172.21.15.81:0/437495684 >> v1:172.21.15.81:6789/0 conn(0x7fa81c159f10 legacy=0x7fa81c068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.873+0000 7fa81bfff700 1 -- 172.21.15.81:0/437495684 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c0ce7c0 con 0x7fa81c159b40 2023-10-07T08:48:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.873+0000 7fa81affd700 1 -- 172.21.15.81:0/437495684 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456653213 0 0) 0x7fa81c0cee10 con 0x7fa81c159f10 2023-10-07T08:48:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.873+0000 7fa81bfff700 1 --2- 172.21.15.81:0/437495684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa81c159b40 0x7fa81c0cc600 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0cae10 tx=0x7fa80c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899f6793da17057e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.873+0000 7fa81affd700 1 -- 172.21.15.81:0/437495684 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00b6b0 con 0x7fa81c159b40 2023-10-07T08:48:18.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.873+0000 7fa81affd700 1 -- 172.21.15.81:0/437495684 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c00b810 con 0x7fa81c159b40 2023-10-07T08:48:18.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.873+0000 7fa81affd700 1 -- 172.21.15.81:0/437495684 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00bbb0 con 0x7fa81c159b40 2023-10-07T08:48:18.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.873+0000 7fa821287700 1 -- 172.21.15.81:0/437495684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa81c159b40 msgr2=0x7fa81c0cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:18.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.873+0000 7fa821287700 1 --2- 172.21.15.81:0/437495684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa81c159b40 0x7fa81c0cc600 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0cae10 tx=0x7fa80c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:18.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.873+0000 7fa821287700 1 -- 172.21.15.81:0/437495684 shutdown_connections 2023-10-07T08:48:18.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.873+0000 7fa821287700 1 --2- 172.21.15.81:0/437495684 >> v2:172.21.15.89:3300/0 conn(0x7fa81c068e90 0x7fa81c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:18.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.873+0000 7fa821287700 1 --2- 172.21.15.81:0/437495684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa81c159b40 0x7fa81c0cc600 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:18.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.873+0000 7fa821287700 1 -- 172.21.15.81:0/437495684 >> 172.21.15.81:0/437495684 conn(0x7fa81c0cd660 msgr2=0x7fa81c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:18.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.873+0000 7fa821287700 1 -- 172.21.15.81:0/437495684 shutdown_connections 2023-10-07T08:48:18.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.873+0000 7fa821287700 1 -- 172.21.15.81:0/437495684 wait complete. 2023-10-07T08:48:18.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.874+0000 7fa821287700 1 Processor -- start 2023-10-07T08:48:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.875+0000 7fa821287700 1 -- start start 2023-10-07T08:48:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.875+0000 7fa821287700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa81c068e90 0x7fa81c16dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.875+0000 7fa821287700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa81c159b40 0x7fa81c0cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.875+0000 7fa821287700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa81c159f10 0x7fa81c0ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.875+0000 7fa821287700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0c9a40 con 0x7fa81c068e90 2023-10-07T08:48:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.875+0000 7fa821287700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0c8e30 con 0x7fa81c159f10 2023-10-07T08:48:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.875+0000 7fa821287700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0c9110 con 0x7fa81c159b40 2023-10-07T08:48:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa81bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa81c068e90 0x7fa81c16dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa81bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa81c068e90 0x7fa81c16dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59902/0 (socket says 172.21.15.81:59902) 2023-10-07T08:48:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa81bfff700 1 -- 172.21.15.81:0/3627705336 learned_addr learned my addr 172.21.15.81:0/3627705336 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa820a86700 1 --2- 172.21.15.81:0/3627705336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa81c159f10 0x7fa81c0ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa81b7fe700 1 --2- 172.21.15.81:0/3627705336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa81c159b40 0x7fa81c0cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa81bfff700 1 -- 172.21.15.81:0/3627705336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa81c159b40 msgr2=0x7fa81c0cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa81bfff700 1 --2- 172.21.15.81:0/3627705336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa81c159b40 0x7fa81c0cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa81bfff700 1 -- 172.21.15.81:0/3627705336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa81c159f10 msgr2=0x7fa81c0ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa81bfff700 1 --2- 172.21.15.81:0/3627705336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa81c159f10 0x7fa81c0ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa81bfff700 1 -- 172.21.15.81:0/3627705336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c009420 con 0x7fa81c068e90 2023-10-07T08:48:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa81b7fe700 1 --2- 172.21.15.81:0/3627705336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa81c159b40 0x7fa81c0cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa81bfff700 1 --2- 172.21.15.81:0/3627705336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa81c068e90 0x7fa81c16dad0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fa81c06fe10 tx=0x7fa80c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa803fff700 1 -- 172.21.15.81:0/3627705336 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c011420 con 0x7fa81c068e90 2023-10-07T08:48:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa803fff700 1 -- 172.21.15.81:0/3627705336 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c011580 con 0x7fa81c068e90 2023-10-07T08:48:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa821287700 1 -- 172.21.15.81:0/3627705336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81c0c93f0 con 0x7fa81c068e90 2023-10-07T08:48:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa803fff700 1 -- 172.21.15.81:0/3627705336 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c011940 con 0x7fa81c068e90 2023-10-07T08:48:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.876+0000 7fa821287700 1 -- 172.21.15.81:0/3627705336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c0cc230 con 0x7fa81c068e90 2023-10-07T08:48:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.877+0000 7fa821287700 1 -- 172.21.15.81:0/3627705336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c0cb890 con 0x7fa81c068e90 2023-10-07T08:48:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.878+0000 7fa803fff700 1 -- 172.21.15.81:0/3627705336 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa80c011d30 con 0x7fa81c068e90 2023-10-07T08:48:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.878+0000 7fa803fff700 1 --2- 172.21.15.81:0/3627705336 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa808066f30 0x7fa8080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.878+0000 7fa803fff700 1 -- 172.21.15.81:0/3627705336 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa80c085f70 con 0x7fa81c068e90 2023-10-07T08:48:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.878+0000 7fa81b7fe700 1 --2- 172.21.15.81:0/3627705336 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa808066f30 0x7fa8080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.878+0000 7fa803fff700 1 -- 172.21.15.81:0/3627705336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=108}) v3 -- 0x7fa80806ea50 con 0x7fa81c068e90 2023-10-07T08:48:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.879+0000 7fa81b7fe700 1 --2- 172.21.15.81:0/3627705336 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa808066f30 0x7fa8080693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa810001810 tx=0x7fa810009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:18.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:18.882+0000 7fa803fff700 1 -- 172.21.15.81:0/3627705336 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa80c0b75a0 con 0x7fa81c068e90 2023-10-07T08:48:19.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:19.067+0000 7fa821287700 1 -- 172.21.15.81:0/3627705336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa81c0ceaa0 con 0x7fa81c068e90 2023-10-07T08:48:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:19.068+0000 7fa803fff700 1 -- 172.21.15.81:0/3627705336 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v107) v1 ==== 81+0+32402 (secure 0 0 0) 0x7fa80c015030 con 0x7fa81c068e90 2023-10-07T08:48:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:19.070 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:48:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 107, 2023-10-07T08:48:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:48:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:48:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:48:17.424652+0000", 2023-10-07T08:48:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:48:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:48:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:48:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:48:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:48:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:48:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:48:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:48:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:48:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:48:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:48:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:48:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:48:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:48:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 13, 2023-10-07T08:48:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:48:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:48:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:48:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:48:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:48:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:48:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:48:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:48:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:48:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:48:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:48:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:48:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:48:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:48:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:48:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "103", 2023-10-07T08:48:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:48:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:48:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:48:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 12, 2023-10-07T08:48:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:48:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:47:47.993754+0000", 2023-10-07T08:48:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:48:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:48:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:48:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:48:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:48:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:48:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:48:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "103", 2023-10-07T08:48:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:48:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:48:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:48:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:48:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:48:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 13, 2023-10-07T08:48:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:48:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:47:48.631797+0000", 2023-10-07T08:48:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 3, 2023-10-07T08:48:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full", 2023-10-07T08:48:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:19.088 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:19.088 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:19.088 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:19.088 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:19.088 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:19.088 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:48:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:48:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:48:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:48:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:48:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "103", 2023-10-07T08:48:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:48:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:48:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:48:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:48:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:48:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:48:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:48:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:48:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:48:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:48:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:48:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:48:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:48:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:48:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:48:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:48:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:48:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:48:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:48:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:48:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:48:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:48:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:48:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:48:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:48:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:48:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:48:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:48:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:48:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:48:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:48:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:48:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:48:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:48:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:48:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:48:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:48:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:48:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:48:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:48:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:48:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:48:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:48:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:48:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:48:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:48:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:48:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:48:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:48:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:48:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:48:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:48:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:48:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:48:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:48:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:48:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:48:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:19.122 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:19.122 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.122 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:48:19.122 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:48:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:48:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:48:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:48:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:48:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:48:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:48:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:48:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:48:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:48:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:48:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:48:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull", 2023-10-07T08:48:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:48:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:48:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:48:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:48:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:48:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:48:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:48:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:48:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:48:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:48:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:48:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:48:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:48:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:48:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:48:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:48:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:48:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:48:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:48:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:48:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:48:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:48:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:48:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:48:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:48:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:48:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "full", 2023-10-07T08:48:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:48:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:48:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:48:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:48:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:48:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:48:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:48:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:48:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:48:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:48:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:48:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:48:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:48:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull", 2023-10-07T08:48:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:48:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:48:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:48:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:48:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:48:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:48:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:19.151 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:19.151 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:48:19.151 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:19.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.151 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:48:19.151 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:19.151 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:19.151 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:19.151 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:19.151 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:19.151 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:48:19.152 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:19.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.152 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:48:19.152 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:19.152 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:19.152 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:19.152 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:19.152 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:19.152 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:48:19.152 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:19.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.153 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:48:19.153 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:19.153 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:19.153 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:19.153 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:19.153 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:19.153 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:48:19.153 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:19.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.153 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:48:19.154 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:19.154 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:19.154 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:19.154 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:19.154 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:19.154 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:48:19.154 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:19.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:19.154 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:48:19.154 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:19.154 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:19.155 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:19.155 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:19.155 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:19.155 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:48:19.155 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:19.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.155 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:19.155 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:48:19.155 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:48:19.155 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:48:19.155 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:48:19.155 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:48:19.156 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:48:19.156 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:48:19.156 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:48:19.156 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:48:19.156 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:48:19.156 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:48:19.156 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:48:19.156 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:48:19.156 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:19.156 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:48:19.156 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:48:19.156 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:48:19.157 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:48:19.157 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:48:19.157 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:48:19.157 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:48:19.157 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:48:19.157 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:48:19.157 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:48:19.157 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:48:19.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:19.157 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:48:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:19.070+0000 7fa821287700 1 -- 172.21.15.81:0/3627705336 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa808066f30 msgr2=0x7fa8080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:19.070+0000 7fa821287700 1 --2- 172.21.15.81:0/3627705336 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa808066f30 0x7fa8080693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa810001810 tx=0x7fa810009040 comp rx=0 tx=0).stop 2023-10-07T08:48:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:19.070+0000 7fa821287700 1 -- 172.21.15.81:0/3627705336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa81c068e90 msgr2=0x7fa81c16dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:19.070+0000 7fa821287700 1 --2- 172.21.15.81:0/3627705336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa81c068e90 0x7fa81c16dad0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fa81c06fe10 tx=0x7fa80c017000 comp rx=0 tx=0).stop 2023-10-07T08:48:19.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:19.070+0000 7fa821287700 1 -- 172.21.15.81:0/3627705336 shutdown_connections 2023-10-07T08:48:19.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:19.070+0000 7fa821287700 1 --2- 172.21.15.81:0/3627705336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa81c159f10 0x7fa81c0ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:19.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:19.070+0000 7fa821287700 1 --2- 172.21.15.81:0/3627705336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa81c068e90 0x7fa81c16dad0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:19.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:19.070+0000 7fa821287700 1 --2- 172.21.15.81:0/3627705336 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa808066f30 0x7fa8080693e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:19.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:19.070+0000 7fa821287700 1 --2- 172.21.15.81:0/3627705336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa81c159b40 0x7fa81c0cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:19.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:19.070+0000 7fa821287700 1 -- 172.21.15.81:0/3627705336 >> 172.21.15.81:0/3627705336 conn(0x7fa81c0cd660 msgr2=0x7fa81c0b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:19.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:19.070+0000 7fa821287700 1 -- 172.21.15.81:0/3627705336 shutdown_connections 2023-10-07T08:48:19.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:19.070+0000 7fa821287700 1 -- 172.21.15.81:0/3627705336 wait complete. 2023-10-07T08:48:19.163 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-07T08:48:24.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:48:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.291+0000 7faaaa705700 1 Processor -- start 2023-10-07T08:48:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.291+0000 7faaaa705700 1 -- start start 2023-10-07T08:48:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faaaa705700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faaa4159f10 0x7faaa4068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faaaa705700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa4068cc0 0x7faaa40cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faaaa705700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa40cee10 con 0x7faaa4159b40 2023-10-07T08:48:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faaaa705700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa4069140 con 0x7faaa4159f10 2023-10-07T08:48:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faaaa705700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa40cd040 con 0x7faaa4068cc0 2023-10-07T08:48:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faaa9703700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faaa4159b40 0x7faaa40cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35418/0 (socket says 172.21.15.81:35418) 2023-10-07T08:48:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faaa9703700 1 -- 172.21.15.81:0/1330409643 learned_addr learned my addr 172.21.15.81:0/1330409643 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faaa8f02700 1 --2- 172.21.15.81:0/1330409643 >> v2:172.21.15.89:3300/0 conn(0x7faaa4159f10 0x7faaa4068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faaa9f04700 1 --2- 172.21.15.81:0/1330409643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa4068cc0 0x7faaa40cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faa9bfff700 1 -- 172.21.15.81:0/1330409643 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989894821 0 0) 0x7faaa40cee10 con 0x7faaa4159b40 2023-10-07T08:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faa9bfff700 1 -- 172.21.15.81:0/1330409643 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa90003570 con 0x7faaa4159b40 2023-10-07T08:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faaa8f02700 1 -- 172.21.15.81:0/1330409643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa4068cc0 msgr2=0x7faaa40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faaa8f02700 1 --2- 172.21.15.81:0/1330409643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa4068cc0 0x7faaa40cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faa9bfff700 1 -- 172.21.15.81:0/1330409643 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 643478374 0 0) 0x7faa90003570 con 0x7faaa4159b40 2023-10-07T08:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faaa8f02700 1 -- 172.21.15.81:0/1330409643 >> v1:172.21.15.81:6789/0 conn(0x7faaa4159b40 legacy=0x7faaa40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faaa8f02700 1 -- 172.21.15.81:0/1330409643 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa40cd320 con 0x7faaa4159f10 2023-10-07T08:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.292+0000 7faaa9f04700 1 --2- 172.21.15.81:0/1330409643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa4068cc0 0x7faaa40cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.293+0000 7faaa8f02700 1 --2- 172.21.15.81:0/1330409643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaa4159f10 0x7faaa4068780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7faa940098e0 tx=0x7faa940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=746668b98d32f1c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.293+0000 7faa9bfff700 1 -- 172.21.15.81:0/1330409643 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0001470 con 0x7faaa4159f10 2023-10-07T08:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.293+0000 7faa9bfff700 1 -- 172.21.15.81:0/1330409643 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa94011420 con 0x7faaa4159f10 2023-10-07T08:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.293+0000 7faa9bfff700 1 -- 172.21.15.81:0/1330409643 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940117c0 con 0x7faaa4159f10 2023-10-07T08:48:24.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.293+0000 7faaaa705700 1 -- 172.21.15.81:0/1330409643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaa4159f10 msgr2=0x7faaa4068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:24.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.293+0000 7faaaa705700 1 --2- 172.21.15.81:0/1330409643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaa4159f10 0x7faaa4068780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7faa940098e0 tx=0x7faa940091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.293+0000 7faaaa705700 1 -- 172.21.15.81:0/1330409643 shutdown_connections 2023-10-07T08:48:24.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.293+0000 7faaaa705700 1 --2- 172.21.15.81:0/1330409643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa4068cc0 0x7faaa40cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.293+0000 7faaaa705700 1 --2- 172.21.15.81:0/1330409643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaa4159f10 0x7faaa4068780 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.293+0000 7faaaa705700 1 -- 172.21.15.81:0/1330409643 >> 172.21.15.81:0/1330409643 conn(0x7faaa40cd660 msgr2=0x7faaa40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.293+0000 7faaaa705700 1 -- 172.21.15.81:0/1330409643 shutdown_connections 2023-10-07T08:48:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.293+0000 7faaaa705700 1 -- 172.21.15.81:0/1330409643 wait complete. 2023-10-07T08:48:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.294+0000 7faaaa705700 1 Processor -- start 2023-10-07T08:48:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.295+0000 7faaaa705700 1 -- start start 2023-10-07T08:48:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.295+0000 7faaaa705700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa4068cc0 0x7faaa415ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.295+0000 7faaaa705700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaa4159b40 0x7faaa4158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.295+0000 7faaaa705700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa4159f10 0x7faaa416a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.295+0000 7faaaa705700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415b5a0 con 0x7faaa4159f10 2023-10-07T08:48:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.295+0000 7faaaa705700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415b880 con 0x7faaa4159b40 2023-10-07T08:48:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.295+0000 7faaaa705700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415bb60 con 0x7faaa4068cc0 2023-10-07T08:48:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.296+0000 7faaa9f04700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa4159f10 0x7faaa416a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.296+0000 7faaa9f04700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa4159f10 0x7faaa416a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56948/0 (socket says 172.21.15.81:56948) 2023-10-07T08:48:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.296+0000 7faaa9f04700 1 -- 172.21.15.81:0/3615456585 learned_addr learned my addr 172.21.15.81:0/3615456585 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.296+0000 7faaa8f02700 1 --2- 172.21.15.81:0/3615456585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaa4159b40 0x7faaa4158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.296+0000 7faaa9703700 1 --2- 172.21.15.81:0/3615456585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa4068cc0 0x7faaa415ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.296+0000 7faaa9f04700 1 -- 172.21.15.81:0/3615456585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa4068cc0 msgr2=0x7faaa415ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.296+0000 7faaa9f04700 1 --2- 172.21.15.81:0/3615456585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa4068cc0 0x7faaa415ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.296+0000 7faaa9f04700 1 -- 172.21.15.81:0/3615456585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaa4159b40 msgr2=0x7faaa4158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.296+0000 7faaa9f04700 1 --2- 172.21.15.81:0/3615456585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaa4159b40 0x7faaa4158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.296+0000 7faaa9f04700 1 -- 172.21.15.81:0/3615456585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9c009a20 con 0x7faaa4159f10 2023-10-07T08:48:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.296+0000 7faaa9f04700 1 --2- 172.21.15.81:0/3615456585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa4159f10 0x7faaa416a650 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009fc0 tx=0x7faa9c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.296+0000 7faa997fa700 1 -- 172.21.15.81:0/3615456585 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00cd30 con 0x7faaa4159f10 2023-10-07T08:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.296+0000 7faa997fa700 1 -- 172.21.15.81:0/3615456585 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c00f040 con 0x7faaa4159f10 2023-10-07T08:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.296+0000 7faaaa705700 1 -- 172.21.15.81:0/3615456585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa94009420 con 0x7faaa4159f10 2023-10-07T08:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.296+0000 7faa997fa700 1 -- 172.21.15.81:0/3615456585 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c0146d0 con 0x7faaa4159f10 2023-10-07T08:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.296+0000 7faaaa705700 1 -- 172.21.15.81:0/3615456585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa415c120 con 0x7faaa4159f10 2023-10-07T08:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.297+0000 7faaaa705700 1 -- 172.21.15.81:0/3615456585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa40cb890 con 0x7faaa4159f10 2023-10-07T08:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.297+0000 7faa997fa700 1 -- 172.21.15.81:0/3615456585 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa9c003020 con 0x7faaa4159f10 2023-10-07T08:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.298+0000 7faa997fa700 1 --2- 172.21.15.81:0/3615456585 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faa88066f30 0x7faa880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.298+0000 7faa997fa700 1 -- 172.21.15.81:0/3615456585 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa9c084fc0 con 0x7faaa4159f10 2023-10-07T08:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.298+0000 7faaa9703700 1 --2- 172.21.15.81:0/3615456585 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faa88066f30 0x7faa880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.298+0000 7faaa9703700 1 --2- 172.21.15.81:0/3615456585 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faa88066f30 0x7faa880693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faaa00011e0 tx=0x7faaa0001490 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.302+0000 7faa997fa700 1 -- 172.21.15.81:0/3615456585 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa9c052230 con 0x7faaa4159f10 2023-10-07T08:48:24.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.486+0000 7faaaa705700 1 -- 172.21.15.81:0/3615456585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7faaa4069780 con 0x7faaa4159f10 2023-10-07T08:48:24.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.487+0000 7faa997fa700 1 -- 172.21.15.81:0/3615456585 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v111) v1 ==== 81+0+32227 (secure 0 0 0) 0x7faa9c055850 con 0x7faaa4159f10 2023-10-07T08:48:24.488 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:24.488 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:48:24.488 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 111, 2023-10-07T08:48:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:48:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:48:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:48:22.503045+0000", 2023-10-07T08:48:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:48:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:48:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:48:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:48:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:48:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:48:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:48:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:48:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:48:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:48:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:48:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:48:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:48:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:48:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 13, 2023-10-07T08:48:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:48:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:48:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:48:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:48:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:48:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:48:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:48:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:48:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:48:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:48:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:48:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:48:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:48:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:48:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:48:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:48:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:48:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:48:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:48:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 12, 2023-10-07T08:48:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:48:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:47:47.993754+0000", 2023-10-07T08:48:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:48:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:48:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:48:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:48:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:48:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:48:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:48:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:48:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:48:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:48:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:48:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:48:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:48:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 13, 2023-10-07T08:48:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:48:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:47:48.631797+0000", 2023-10-07T08:48:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:48:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:48:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:48:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:48:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:48:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:48:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:48:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:48:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:48:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:48:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:48:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:48:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:48:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:48:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:48:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:48:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:48:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:48:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:48:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:48:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:48:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:48:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:48:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:48:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:48:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:48:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:48:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:48:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:48:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:48:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:48:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:48:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:48:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:48:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:48:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:48:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:48:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:48:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:48:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:48:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:48:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:48:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:48:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:48:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:48:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:48:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:48:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:48:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:48:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:48:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:48:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:48:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:48:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:48:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:48:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:48:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:48:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:48:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:48:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:48:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:48:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:48:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:48:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:48:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:48:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:48:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:48:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:48:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:48:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:48:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:48:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:48:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:48:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:48:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:48:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:48:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:48:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:48:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:48:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:48:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:48:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:48:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:48:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:48:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:48:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:48:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:48:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:48:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:48:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:48:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:48:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:48:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:48:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:48:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:48:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:48:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:48:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:48:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:48:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:48:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:48:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:48:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:48:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:48:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:48:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:48:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:48:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:48:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:48:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:48:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:48:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:48:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:48:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:48:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:48:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:48:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:48:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:48:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:48:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:48:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:48:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:48:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:48:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:48:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:48:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:48:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:48:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:48:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:48:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:48:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:48:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:48:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:48:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:48:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:48:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:48:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:48:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:48:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:48:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:48:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:48:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:48:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:48:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:48:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:48:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:48:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:48:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:48:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:48:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:48:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:48:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:48:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:48:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:48:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:48:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:48:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:48:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:48:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.581 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:48:24.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.488+0000 7faaaa705700 1 -- 172.21.15.81:0/3615456585 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faa88066f30 msgr2=0x7faa880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:24.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.488+0000 7faaaa705700 1 --2- 172.21.15.81:0/3615456585 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faa88066f30 0x7faa880693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faaa00011e0 tx=0x7faaa0001490 comp rx=0 tx=0).stop 2023-10-07T08:48:24.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.488+0000 7faaaa705700 1 -- 172.21.15.81:0/3615456585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa4159f10 msgr2=0x7faaa416a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:24.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.488+0000 7faaaa705700 1 --2- 172.21.15.81:0/3615456585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa4159f10 0x7faaa416a650 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009fc0 tx=0x7faa9c00b040 comp rx=0 tx=0).stop 2023-10-07T08:48:24.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.489+0000 7faaaa705700 1 -- 172.21.15.81:0/3615456585 shutdown_connections 2023-10-07T08:48:24.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.489+0000 7faaaa705700 1 --2- 172.21.15.81:0/3615456585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa4159f10 0x7faaa416a650 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.489+0000 7faaaa705700 1 --2- 172.21.15.81:0/3615456585 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faa88066f30 0x7faa880693e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.489+0000 7faaaa705700 1 --2- 172.21.15.81:0/3615456585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa4068cc0 0x7faaa415ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.489+0000 7faaaa705700 1 --2- 172.21.15.81:0/3615456585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaa4159b40 0x7faaa4158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.489+0000 7faaaa705700 1 -- 172.21.15.81:0/3615456585 >> 172.21.15.81:0/3615456585 conn(0x7faaa40cd660 msgr2=0x7faaa40cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:24.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.489+0000 7faaaa705700 1 -- 172.21.15.81:0/3615456585 shutdown_connections 2023-10-07T08:48:24.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.489+0000 7faaaa705700 1 -- 172.21.15.81:0/3615456585 wait complete. 2023-10-07T08:48:24.584 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-07T08:48:24.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:48:24.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.697+0000 7f65b9d25700 1 Processor -- start 2023-10-07T08:48:24.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.697+0000 7f65b9d25700 1 -- start start 2023-10-07T08:48:24.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.698+0000 7f65b9d25700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b406d830 0x7f65b40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:24.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.698+0000 7f65b9d25700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b40d07c0 con 0x7f65b4157ca0 2023-10-07T08:48:24.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.698+0000 7f65b9d25700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b40cfbb0 con 0x7f65b41578d0 2023-10-07T08:48:24.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.698+0000 7f65b9d25700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40cfe90 con 0x7f65b406d830 2023-10-07T08:48:24.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.698+0000 7f65b2ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f65b4157ca0 0x7f65b406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35428/0 (socket says 172.21.15.81:35428) 2023-10-07T08:48:24.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.698+0000 7f65b2ffd700 1 -- 172.21.15.81:0/1158653017 learned_addr learned my addr 172.21.15.81:0/1158653017 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:24.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b3fff700 1 --2- 172.21.15.81:0/1158653017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b406d830 0x7f65b40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:24.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b27fc700 1 -- 172.21.15.81:0/1158653017 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764410586 0 0) 0x7f65b40d07c0 con 0x7f65b4157ca0 2023-10-07T08:48:24.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b27fc700 1 -- 172.21.15.81:0/1158653017 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f659c003570 con 0x7f65b4157ca0 2023-10-07T08:48:24.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b27fc700 1 -- 172.21.15.81:0/1158653017 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 17696217 0 0) 0x7f659c003570 con 0x7f65b4157ca0 2023-10-07T08:48:24.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b27fc700 1 -- 172.21.15.81:0/1158653017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b406d830 msgr2=0x7f65b40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:24.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b27fc700 1 --2- 172.21.15.81:0/1158653017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b406d830 0x7f65b40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b27fc700 1 -- 172.21.15.81:0/1158653017 >> v1:172.21.15.89:6789/0 conn(0x7f65b41578d0 legacy=0x7f65b415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:24.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b27fc700 1 -- 172.21.15.81:0/1158653017 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b40d0170 con 0x7f65b4157ca0 2023-10-07T08:48:24.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b27fc700 1 -- 172.21.15.81:0/1158653017 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f65a8001470 con 0x7f65b4157ca0 2023-10-07T08:48:24.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b27fc700 1 -- 172.21.15.81:0/1158653017 >> v1:172.21.15.81:6789/0 conn(0x7f65b4157ca0 legacy=0x7f65b406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:24.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b27fc700 1 --2- 172.21.15.81:0/1158653017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b406d830 0x7f659c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:24.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b27fc700 1 --2- 172.21.15.81:0/1158653017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f659c004010 0x7f659c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:24.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b27fc700 1 --2- 172.21.15.81:0/1158653017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659c004d50 0x7f659c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:24.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b27fc700 1 -- 172.21.15.81:0/1158653017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40cfe90 con 0x7f659c004d50 2023-10-07T08:48:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b27fc700 1 -- 172.21.15.81:0/1158653017 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c00bbf0 con 0x7f659c004010 2023-10-07T08:48:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b27fc700 1 -- 172.21.15.81:0/1158653017 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659c00bdb0 con 0x7f65b406d830 2023-10-07T08:48:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b3fff700 1 --2- 172.21.15.81:0/1158653017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659c004d50 0x7f659c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b2ffd700 1 --2- 172.21.15.81:0/1158653017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f659c004010 0x7f659c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b37fe700 1 --2- 172.21.15.81:0/1158653017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b406d830 0x7f659c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b3fff700 1 -- 172.21.15.81:0/1158653017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b406d830 msgr2=0x7f659c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b3fff700 1 --2- 172.21.15.81:0/1158653017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b406d830 0x7f659c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b3fff700 1 -- 172.21.15.81:0/1158653017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f659c004010 msgr2=0x7f659c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b3fff700 1 --2- 172.21.15.81:0/1158653017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f659c004010 0x7f659c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b3fff700 1 -- 172.21.15.81:0/1158653017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c003570 con 0x7f659c004d50 2023-10-07T08:48:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b2ffd700 1 --2- 172.21.15.81:0/1158653017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f659c004010 0x7f659c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b37fe700 1 --2- 172.21.15.81:0/1158653017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b406d830 0x7f659c003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:24.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.699+0000 7f65b3fff700 1 --2- 172.21.15.81:0/1158653017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659c004d50 0x7f659c0051c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f65ac006f00 tx=0x7f65ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f241b811aadb85 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.700+0000 7f65b27fc700 1 -- 172.21.15.81:0/1158653017 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00e6e0 con 0x7f659c004d50 2023-10-07T08:48:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.700+0000 7f65b27fc700 1 -- 172.21.15.81:0/1158653017 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac00e840 con 0x7f659c004d50 2023-10-07T08:48:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.700+0000 7f65b27fc700 1 -- 172.21.15.81:0/1158653017 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00ebe0 con 0x7f659c004d50 2023-10-07T08:48:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.700+0000 7f65b9d25700 1 -- 172.21.15.81:0/1158653017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659c004d50 msgr2=0x7f659c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.700+0000 7f65b9d25700 1 --2- 172.21.15.81:0/1158653017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659c004d50 0x7f659c0051c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f65ac006f00 tx=0x7f65ac0091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.700+0000 7f65b3fff700 1 -- 172.21.15.81:0/1158653017 reap_dead start 2023-10-07T08:48:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.700+0000 7f65b9d25700 1 -- 172.21.15.81:0/1158653017 shutdown_connections 2023-10-07T08:48:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.700+0000 7f65b9d25700 1 -- 172.21.15.81:0/1158653017 >> 172.21.15.81:0/1158653017 conn(0x7f65b406bb90 msgr2=0x7f65b406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.700+0000 7f65b9d25700 1 -- 172.21.15.81:0/1158653017 shutdown_connections 2023-10-07T08:48:24.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.700+0000 7f65b9d25700 1 -- 172.21.15.81:0/1158653017 wait complete. 2023-10-07T08:48:24.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.701+0000 7f65b9d25700 1 Processor -- start 2023-10-07T08:48:24.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.701+0000 7f65b9d25700 1 -- start start 2023-10-07T08:48:24.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.702+0000 7f65b9d25700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b415bed0 0x7f65b40c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:24.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.702+0000 7f65b9d25700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b415c2a0 0x7f65b40c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:24.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.702+0000 7f65b9d25700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65b41443d0 0x7f65b4144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:24.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.702+0000 7f65b9d25700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b4144d80 con 0x7f65b41443d0 2023-10-07T08:48:24.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.702+0000 7f65b9d25700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b416edd0 con 0x7f65b415bed0 2023-10-07T08:48:24.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.702+0000 7f65b9d25700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b416dee0 con 0x7f65b415c2a0 2023-10-07T08:48:24.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.702+0000 7f65b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65b41443d0 0x7f65b4144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:24.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.702+0000 7f65b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65b41443d0 0x7f65b4144840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56962/0 (socket says 172.21.15.81:56962) 2023-10-07T08:48:24.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.702+0000 7f65b3fff700 1 -- 172.21.15.81:0/1479402303 learned_addr learned my addr 172.21.15.81:0/1479402303 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:24.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.702+0000 7f65b37fe700 1 --2- 172.21.15.81:0/1479402303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b415bed0 0x7f65b40c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:24.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.702+0000 7f65b3fff700 1 -- 172.21.15.81:0/1479402303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b415c2a0 msgr2=0x7f65b40c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:24.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.702+0000 7f65b2ffd700 1 --2- 172.21.15.81:0/1479402303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b415c2a0 0x7f65b40c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:24.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.703+0000 7f65b3fff700 1 --2- 172.21.15.81:0/1479402303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b415c2a0 0x7f65b40c7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.703+0000 7f65b3fff700 1 -- 172.21.15.81:0/1479402303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b415bed0 msgr2=0x7f65b40c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:24.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.703+0000 7f65b3fff700 1 --2- 172.21.15.81:0/1479402303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b415bed0 0x7f65b40c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.703+0000 7f65b3fff700 1 -- 172.21.15.81:0/1479402303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b416e1c0 con 0x7f65b41443d0 2023-10-07T08:48:24.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.703+0000 7f65b37fe700 1 --2- 172.21.15.81:0/1479402303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b415bed0 0x7f65b40c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:24.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.703+0000 7f65b3fff700 1 --2- 172.21.15.81:0/1479402303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65b41443d0 0x7f65b4144840 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009720 tx=0x7f65ac01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:24.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.703+0000 7f659b7fe700 1 -- 172.21.15.81:0/1479402303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac022070 con 0x7f65b41443d0 2023-10-07T08:48:24.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.703+0000 7f659b7fe700 1 -- 172.21.15.81:0/1479402303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac00ebc0 con 0x7f65b41443d0 2023-10-07T08:48:24.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.703+0000 7f65b9d25700 1 -- 172.21.15.81:0/1479402303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b416e4a0 con 0x7f65b41443d0 2023-10-07T08:48:24.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.703+0000 7f659b7fe700 1 -- 172.21.15.81:0/1479402303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00e6e0 con 0x7f65b41443d0 2023-10-07T08:48:24.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.703+0000 7f65b9d25700 1 -- 172.21.15.81:0/1479402303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b416ea60 con 0x7f65b41443d0 2023-10-07T08:48:24.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.704+0000 7f65b9d25700 1 -- 172.21.15.81:0/1479402303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b4067ac0 con 0x7f65b41443d0 2023-10-07T08:48:24.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.704+0000 7f659b7fe700 1 -- 172.21.15.81:0/1479402303 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65ac01c910 con 0x7f65b41443d0 2023-10-07T08:48:24.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.705+0000 7f659b7fe700 1 --2- 172.21.15.81:0/1479402303 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f65a0066f30 0x7f65a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:24.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.705+0000 7f65b37fe700 1 --2- 172.21.15.81:0/1479402303 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f65a0066f30 0x7f65a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:24.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.705+0000 7f659b7fe700 1 -- 172.21.15.81:0/1479402303 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f65ac000e40 con 0x7f65b41443d0 2023-10-07T08:48:24.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.705+0000 7f65b37fe700 1 --2- 172.21.15.81:0/1479402303 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f65a0066f30 0x7f65a00693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f65a40012e0 tx=0x7f65a400c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:24.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.709+0000 7f659b7fe700 1 -- 172.21.15.81:0/1479402303 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65ac053040 con 0x7f65b41443d0 2023-10-07T08:48:24.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.893+0000 7f65b9d25700 1 -- 172.21.15.81:0/1479402303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f65b40d0450 con 0x7f65b41443d0 2023-10-07T08:48:24.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.894+0000 7f659b7fe700 1 -- 172.21.15.81:0/1479402303 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v111) v1 ==== 81+0+32227 (secure 0 0 0) 0x7f65ac056660 con 0x7f65b41443d0 2023-10-07T08:48:24.896 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:24.896 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:48:24.896 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 111, 2023-10-07T08:48:24.896 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:48:24.896 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:48:24.896 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:48:22.503045+0000", 2023-10-07T08:48:24.896 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:48:24.897 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:48:24.897 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:48:24.897 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:48:24.897 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:48:24.897 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:48:24.897 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:48:24.897 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:48:24.897 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:48:24.897 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:24.897 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:48:24.897 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:48:24.898 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:48:24.898 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:48:24.898 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:48:24.898 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 13, 2023-10-07T08:48:24.898 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:48:24.898 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:48:24.898 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:48:24.898 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:48:24.898 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:48:24.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.898 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:48:24.899 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:48:24.899 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:48:24.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:48:24.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:48:24.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:24.899 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:24.899 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:24.899 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:24.899 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:24.899 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:24.899 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:24.899 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:24.900 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:24.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:24.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:48:24.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:48:24.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:48:24.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:48:24.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:48:24.901 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:24.901 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:24.901 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:24.901 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:24.901 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:24.902 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:24.902 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:24.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.902 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:48:24.903 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:24.903 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:24.903 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:24.903 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:24.903 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:24.903 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:24.903 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:24.903 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:24.903 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:24.903 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:24.903 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:24.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:24.904 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:24.904 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:24.904 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:24.904 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:24.904 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:24.904 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:24.904 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:24.904 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:24.904 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:24.904 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:24.904 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:24.904 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:24.905 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:24.905 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:24.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.905 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:24.905 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:24.905 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:24.905 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:24.905 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:24.905 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:24.905 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:24.905 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:24.905 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:24.906 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:24.906 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:24.906 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:24.906 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:48:24.906 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:48:24.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.906 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:24.906 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:48:24.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.906 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 12, 2023-10-07T08:48:24.907 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:48:24.907 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:47:47.993754+0000", 2023-10-07T08:48:24.907 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:48:24.907 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:48:24.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:24.907 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:24.907 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:24.907 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:24.907 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:24.907 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:24.907 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:24.907 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:24.908 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:24.908 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:24.908 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:48:24.908 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:48:24.908 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:48:24.908 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:48:24.908 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:48:24.908 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:24.908 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:24.908 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:24.908 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:24.908 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:24.909 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:24.909 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:24.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.909 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:48:24.909 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:24.909 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:24.909 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:24.909 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:24.909 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:24.909 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:24.909 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:24.909 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:24.910 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:24.910 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:24.910 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:24.910 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:24.910 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:24.910 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:24.910 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:24.910 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:24.910 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:24.910 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:24.910 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:24.910 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:24.911 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:24.911 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:24.911 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:24.911 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:24.911 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:24.911 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:24.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.911 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:24.911 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:24.911 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:24.911 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:24.911 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:24.912 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:24.912 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:24.912 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:24.912 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:24.912 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:24.912 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:24.912 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:24.912 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:48:24.912 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:48:24.912 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:48:24.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.912 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:24.913 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:48:24.913 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:48:24.913 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.913 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.913 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 13, 2023-10-07T08:48:24.913 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:48:24.913 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:47:48.631797+0000", 2023-10-07T08:48:24.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:48:24.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:48:24.913 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:48:24.914 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:48:24.914 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:48:24.914 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:48:24.914 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:48:24.914 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:48:24.914 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:48:24.914 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:48:24.914 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:48:24.914 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:48:24.914 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:48:24.914 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:48:24.915 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:48:24.915 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:48:24.915 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:48:24.915 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:48:24.915 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:48:24.915 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:48:24.915 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:48:24.915 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:48:24.915 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:48:24.915 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:48:24.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.915 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:48:24.916 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:48:24.916 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:48:24.916 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:48:24.916 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:48:24.916 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:48:24.916 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:48:24.916 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:48:24.916 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:48:24.916 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:48:24.916 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:48:24.916 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:48:24.916 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:48:24.917 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:48:24.917 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:48:24.917 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:48:24.917 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:48:24.917 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:48:24.917 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:48:24.917 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:48:24.917 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:48:24.917 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:48:24.917 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:48:24.917 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:48:24.917 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:48:24.918 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:48:24.918 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:48:24.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.918 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:48:24.918 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:48:24.918 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:48:24.918 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:48:24.918 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:48:24.918 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:48:24.918 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:48:24.918 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:48:24.919 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:48:24.919 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:48:24.919 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:48:24.919 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:48:24.919 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:48:24.919 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:48:24.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.919 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:48:24.919 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:48:24.919 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:48:24.919 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.920 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:24.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:48:24.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:48:24.920 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:24.920 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:24.920 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:24.920 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:24.920 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:24.921 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:24.921 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:24.921 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:24.921 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:24.921 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:24.921 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:24.921 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:24.921 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.922 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:48:24.922 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:24.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.922 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:48:24.922 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:24.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.922 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.923 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:24.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:48:24.923 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:24.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:48:24.923 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:24.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.924 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.924 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:24.924 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.924 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.924 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:48:24.924 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:24.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.924 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.925 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:48:24.925 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:24.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.925 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.925 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:24.925 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.925 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.925 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:48:24.925 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:24.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.926 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:48:24.926 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:48:24.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.926 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.926 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:48:24.926 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:48:24.926 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:48:24.926 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:48:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:48:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:24.927 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:48:24.928 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:48:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:48:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:48:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:24.930 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:48:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:48:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.931 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:48:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:48:24.932 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:48:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:48:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:48:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:48:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:48:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:48:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:24.934 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:48:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.935 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:48:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:48:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:48:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:48:24.937 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:48:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:48:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:48:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:48:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:48:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:48:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:48:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:48:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:48:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:24.940 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:48:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:48:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.942 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:48:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:48:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.943 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:48:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:48:24.944 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:48:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:48:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:48:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:48:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:48:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:48:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:48:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:24.946 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:48:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:48:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:48:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:48:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:24.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:48:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:48:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:48:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:48:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:48:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:48:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.952 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:48:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:48:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:48:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:48:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:48:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:24.953 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:48:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:48:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:48:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:48:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:48:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:48:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:24.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:48:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.958 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:48:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:48:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:48:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:48:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:48:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:48:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:24.959 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:48:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:24.960 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:48:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:48:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:48:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:24.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:48:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:48:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:48:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:24.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:48:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:48:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:48:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:48:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:48:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:48:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:48:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:48:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:48:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:48:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:48:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:48:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:48:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:48:24.967 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:48:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:48:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 100, 2023-10-07T08:48:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:48:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:48:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:48:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:48:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:48:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:48:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:48:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:48:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:24.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:48:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:48:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.972 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:48:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:48:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:48:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:48:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:48:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:48:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:48:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:48:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:48:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:48:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:48:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:48:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:48:24.974 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:48:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:48:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:48:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:48:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:24.975 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:48:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:48:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:48:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:48:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:48:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.977 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:48:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:48:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:48:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:24.978 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:48:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:48:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:24.979 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:48:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:48:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:48:24.980 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:48:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:48:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:48:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:48:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:48:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:48:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:48:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:48:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.981 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:48:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:48:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:48:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:48:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:48:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:48:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:48:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:48:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:48:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:48:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:48:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:48:24.982 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:48:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:48:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:48:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:48:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:48:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:48:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:48:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:48:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:48:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:48:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:48:24.983 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:48:24.984 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:48:24.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:24.984 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:48:24.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.896+0000 7f65b9d25700 1 -- 172.21.15.81:0/1479402303 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f65a0066f30 msgr2=0x7f65a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:24.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.896+0000 7f65b9d25700 1 --2- 172.21.15.81:0/1479402303 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f65a0066f30 0x7f65a00693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f65a40012e0 tx=0x7f65a400c040 comp rx=0 tx=0).stop 2023-10-07T08:48:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.896+0000 7f65b9d25700 1 -- 172.21.15.81:0/1479402303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65b41443d0 msgr2=0x7f65b4144840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.896+0000 7f65b9d25700 1 --2- 172.21.15.81:0/1479402303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65b41443d0 0x7f65b4144840 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009720 tx=0x7f65ac01a000 comp rx=0 tx=0).stop 2023-10-07T08:48:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.896+0000 7f65b9d25700 1 -- 172.21.15.81:0/1479402303 shutdown_connections 2023-10-07T08:48:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.896+0000 7f65b9d25700 1 --2- 172.21.15.81:0/1479402303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65b41443d0 0x7f65b4144840 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.896+0000 7f65b9d25700 1 --2- 172.21.15.81:0/1479402303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b415bed0 0x7f65b40c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.896+0000 7f65b9d25700 1 --2- 172.21.15.81:0/1479402303 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f65a0066f30 0x7f65a00693e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.896+0000 7f65b9d25700 1 --2- 172.21.15.81:0/1479402303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b415c2a0 0x7f65b40c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.896+0000 7f65b9d25700 1 -- 172.21.15.81:0/1479402303 >> 172.21.15.81:0/1479402303 conn(0x7f65b406bb90 msgr2=0x7f65b41557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.896+0000 7f65b9d25700 1 -- 172.21.15.81:0/1479402303 shutdown_connections 2023-10-07T08:48:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:24.896+0000 7f65b9d25700 1 -- 172.21.15.81:0/1479402303 wait complete. 2023-10-07T08:48:24.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:48:25.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.100+0000 7fa4616e5700 1 Processor -- start 2023-10-07T08:48:25.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.100+0000 7fa4616e5700 1 -- start start 2023-10-07T08:48:25.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.101+0000 7fa4616e5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa45c06c190 0x7fa45c0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.101+0000 7fa4616e5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa45c0b3170 0x7fa45c06a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.101+0000 7fa4616e5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45c0b35d0 con 0x7fa45c157a60 2023-10-07T08:48:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.101+0000 7fa4616e5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45c069d10 con 0x7fa45c0b3170 2023-10-07T08:48:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.101+0000 7fa4616e5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c15c130 con 0x7fa45c06c190 2023-10-07T08:48:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.101+0000 7fa45b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa45c0b3170 0x7fa45c06a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.101+0000 7fa45b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa45c0b3170 0x7fa45c06a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56976/0 (socket says 172.21.15.81:56976) 2023-10-07T08:48:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.101+0000 7fa45b7fe700 1 -- 172.21.15.81:0/402061271 learned_addr learned my addr 172.21.15.81:0/402061271 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.102+0000 7fa4527fc700 1 --2- 172.21.15.81:0/402061271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa45c06c190 0x7fa45c0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.102+0000 7fa45b7fe700 1 -- 172.21.15.81:0/402061271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa45c06c190 msgr2=0x7fa45c0b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.102+0000 7fa45b7fe700 1 --2- 172.21.15.81:0/402061271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa45c06c190 0x7fa45c0b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.102+0000 7fa45b7fe700 1 -- 172.21.15.81:0/402061271 >> v1:172.21.15.89:6789/0 conn(0x7fa45c157a60 legacy=0x7fa45c15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:25.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.102+0000 7fa45b7fe700 1 -- 172.21.15.81:0/402061271 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c15c410 con 0x7fa45c0b3170 2023-10-07T08:48:25.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.102+0000 7fa45b7fe700 1 --2- 172.21.15.81:0/402061271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa45c0b3170 0x7fa45c06a1a0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa454009f20 tx=0x7fa454009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f947a865ba0097d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:25.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.102+0000 7fa45a7fc700 1 -- 172.21.15.81:0/402061271 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45400e070 con 0x7fa45c0b3170 2023-10-07T08:48:25.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.102+0000 7fa45a7fc700 1 -- 172.21.15.81:0/402061271 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45400ba80 con 0x7fa45c0b3170 2023-10-07T08:48:25.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.102+0000 7fa45a7fc700 1 -- 172.21.15.81:0/402061271 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4540092e0 con 0x7fa45c0b3170 2023-10-07T08:48:25.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.102+0000 7fa4616e5700 1 -- 172.21.15.81:0/402061271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa45c0b3170 msgr2=0x7fa45c06a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:25.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.102+0000 7fa4616e5700 1 --2- 172.21.15.81:0/402061271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa45c0b3170 0x7fa45c06a1a0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa454009f20 tx=0x7fa454009840 comp rx=0 tx=0).stop 2023-10-07T08:48:25.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.103+0000 7fa4616e5700 1 -- 172.21.15.81:0/402061271 shutdown_connections 2023-10-07T08:48:25.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.103+0000 7fa4616e5700 1 --2- 172.21.15.81:0/402061271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa45c0b3170 0x7fa45c06a1a0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:25.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.103+0000 7fa4616e5700 1 --2- 172.21.15.81:0/402061271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa45c06c190 0x7fa45c0b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:25.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.103+0000 7fa4616e5700 1 -- 172.21.15.81:0/402061271 >> 172.21.15.81:0/402061271 conn(0x7fa45c06cca0 msgr2=0x7fa45c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.103+0000 7fa4616e5700 1 -- 172.21.15.81:0/402061271 shutdown_connections 2023-10-07T08:48:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.103+0000 7fa4616e5700 1 -- 172.21.15.81:0/402061271 wait complete. 2023-10-07T08:48:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.104+0000 7fa4616e5700 1 Processor -- start 2023-10-07T08:48:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.104+0000 7fa4616e5700 1 -- start start 2023-10-07T08:48:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.104+0000 7fa4616e5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa45c06c190 0x7fa45c0ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa4616e5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa45c0b3170 0x7fa45c0cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa4616e5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa45c157a60 0x7fa45c15a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa4616e5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c159380 con 0x7fa45c157a60 2023-10-07T08:48:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa4616e5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c150f20 con 0x7fa45c0b3170 2023-10-07T08:48:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa4616e5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c167e00 con 0x7fa45c06c190 2023-10-07T08:48:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa45b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa45c157a60 0x7fa45c15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa45b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa45c157a60 0x7fa45c15a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56982/0 (socket says 172.21.15.81:56982) 2023-10-07T08:48:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa45b7fe700 1 -- 172.21.15.81:0/844455817 learned_addr learned my addr 172.21.15.81:0/844455817 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa45affd700 1 --2- 172.21.15.81:0/844455817 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa45c06c190 0x7fa45c0ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa4527fc700 1 --2- 172.21.15.81:0/844455817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa45c0b3170 0x7fa45c0cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa45b7fe700 1 -- 172.21.15.81:0/844455817 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa45c06c190 msgr2=0x7fa45c0ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa45b7fe700 1 --2- 172.21.15.81:0/844455817 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa45c06c190 0x7fa45c0ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa45b7fe700 1 -- 172.21.15.81:0/844455817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa45c0b3170 msgr2=0x7fa45c0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa45b7fe700 1 --2- 172.21.15.81:0/844455817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa45c0b3170 0x7fa45c0cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa45b7fe700 1 -- 172.21.15.81:0/844455817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa454009ae0 con 0x7fa45c157a60 2023-10-07T08:48:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa45affd700 1 --2- 172.21.15.81:0/844455817 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa45c06c190 0x7fa45c0ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa45b7fe700 1 --2- 172.21.15.81:0/844455817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa45c157a60 0x7fa45c15a750 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa45400b6c0 tx=0x7fa454018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa4537fe700 1 -- 172.21.15.81:0/844455817 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4540032f0 con 0x7fa45c157a60 2023-10-07T08:48:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa4537fe700 1 -- 172.21.15.81:0/844455817 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa454008dd0 con 0x7fa45c157a60 2023-10-07T08:48:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa4537fe700 1 -- 172.21.15.81:0/844455817 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa454026670 con 0x7fa45c157a60 2023-10-07T08:48:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa4616e5700 1 -- 172.21.15.81:0/844455817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45c0aecb0 con 0x7fa45c157a60 2023-10-07T08:48:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.105+0000 7fa4616e5700 1 -- 172.21.15.81:0/844455817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45c1682d0 con 0x7fa45c157a60 2023-10-07T08:48:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.106+0000 7fa4616e5700 1 -- 172.21.15.81:0/844455817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45c068900 con 0x7fa45c157a60 2023-10-07T08:48:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.107+0000 7fa4537fe700 1 -- 172.21.15.81:0/844455817 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa454003040 con 0x7fa45c157a60 2023-10-07T08:48:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.107+0000 7fa4537fe700 1 --2- 172.21.15.81:0/844455817 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa43c066f30 0x7fa43c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.107+0000 7fa4537fe700 1 -- 172.21.15.81:0/844455817 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa454085f70 con 0x7fa45c157a60 2023-10-07T08:48:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.107+0000 7fa45affd700 1 --2- 172.21.15.81:0/844455817 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa43c066f30 0x7fa43c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:25.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.107+0000 7fa45affd700 1 --2- 172.21.15.81:0/844455817 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa43c066f30 0x7fa43c0693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa44c007fd0 tx=0x7fa44c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:25.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.111+0000 7fa4537fe700 1 -- 172.21.15.81:0/844455817 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa454053290 con 0x7fa45c157a60 2023-10-07T08:48:25.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.334+0000 7fa4616e5700 1 -- 172.21.15.81:0/844455817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa45c04bb80 con 0x7fa45c157a60 2023-10-07T08:48:25.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.335+0000 7fa4537fe700 1 -- 172.21.15.81:0/844455817 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fa4540568b0 con 0x7fa45c157a60 2023-10-07T08:48:25.336 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:25.336 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1015639142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1015639142},{"type":"v1","addr":"172.21.15.89:6833","nonce":1015639142}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2650972762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2650972762},{"type":"v1","addr":"172.21.15.89:6835","nonce":2650972762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2058286084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2058286084},{"type":"v1","addr":"172.21.15.81:6836","nonce":2058286084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:47:49.671409+0000","modified":"2023-10-07T08:47:53.341944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6837/3696879604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3696879604},{"type":"v1","addr":"172.21.15.81:6837","nonce":3696879604}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-07T08:48:25.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.337+0000 7fa4616e5700 1 -- 172.21.15.81:0/844455817 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa43c066f30 msgr2=0x7fa43c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:25.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.337+0000 7fa4616e5700 1 --2- 172.21.15.81:0/844455817 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa43c066f30 0x7fa43c0693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa44c007fd0 tx=0x7fa44c009040 comp rx=0 tx=0).stop 2023-10-07T08:48:25.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.337+0000 7fa4616e5700 1 -- 172.21.15.81:0/844455817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa45c157a60 msgr2=0x7fa45c15a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:25.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.337+0000 7fa4616e5700 1 --2- 172.21.15.81:0/844455817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa45c157a60 0x7fa45c15a750 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa45400b6c0 tx=0x7fa454018000 comp rx=0 tx=0).stop 2023-10-07T08:48:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.337+0000 7fa4616e5700 1 -- 172.21.15.81:0/844455817 shutdown_connections 2023-10-07T08:48:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.337+0000 7fa4616e5700 1 --2- 172.21.15.81:0/844455817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa45c157a60 0x7fa45c15a750 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.337+0000 7fa4616e5700 1 --2- 172.21.15.81:0/844455817 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa43c066f30 0x7fa43c0693e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.337+0000 7fa4616e5700 1 --2- 172.21.15.81:0/844455817 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa45c06c190 0x7fa45c0ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.337+0000 7fa4616e5700 1 --2- 172.21.15.81:0/844455817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa45c0b3170 0x7fa45c0cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.337+0000 7fa4616e5700 1 -- 172.21.15.81:0/844455817 >> 172.21.15.81:0/844455817 conn(0x7fa45c06cca0 msgr2=0x7fa45c156290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.337+0000 7fa4616e5700 1 -- 172.21.15.81:0/844455817 shutdown_connections 2023-10-07T08:48:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:25.337+0000 7fa4616e5700 1 -- 172.21.15.81:0/844455817 wait complete. 2023-10-07T08:48:25.339 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 50 2023-10-07T08:48:25.351 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-07T08:48:25.485 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":6336,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":35.156673949000002,"mdsmap_epoch":50,"osdmap_epoch":111,"osdmap_epoch_barrier":106,"uptime":46.488640308000001} 2023-10-07T08:48:25.485 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 6336, "mdsmap_epoch": 50, "osdmap_epoch": 111, "osdmap_epoch_barrier": 106, "rank_uptime": 35.156673949, "state": "up:active", "uptime": 46.488640308, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:48:25.485 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-07T08:48:25.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:48:25.486 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-07T08:48:25.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:48:25.603 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:48:25.776 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records in 2023-10-07T08:48:25.776 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records out 2023-10-07T08:48:25.776 INFO:teuthology.orchestra.run.smithi081.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.273307 s, 192 MB/s 2023-10-07T08:48:25.777 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:48:25.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:48:25.823 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:48:25.863 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:48:25.863 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T08:48:25.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:48:25.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T08:48:25.930 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:48:25.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:25.930 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T08:48:25.945 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T08:48:25.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:48:25.946 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T08:48:25.985 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:48:25.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:25.985 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T08:48:26.040 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:48:26.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.154+0000 7f4401d4f700 1 Processor -- start 2023-10-07T08:48:26.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.154+0000 7f4401d4f700 1 -- start start 2023-10-07T08:48:26.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.155+0000 7f4401d4f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f43fc15a2a0 0x7f43fc0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.155+0000 7f4401d4f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43fc0b0ca0 con 0x7f43fc0ceb30 2023-10-07T08:48:26.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.155+0000 7f4401d4f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43fc0b00d0 con 0x7f43fc06dd60 2023-10-07T08:48:26.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.155+0000 7f4401d4f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43fc06e160 con 0x7f43fc15a2a0 2023-10-07T08:48:26.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.155+0000 7f43faffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f43fc0ceb30 0x7f43fc06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35442/0 (socket says 172.21.15.81:35442) 2023-10-07T08:48:26.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.155+0000 7f43faffd700 1 -- 172.21.15.81:0/4028713469 learned_addr learned my addr 172.21.15.81:0/4028713469 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:26.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fb7fe700 1 --2- 172.21.15.81:0/4028713469 >> v2:172.21.15.89:3300/0 conn(0x7f43fc15a2a0 0x7f43fc0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fa7fc700 1 -- 172.21.15.81:0/4028713469 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217118188 0 0) 0x7f43fc0b0ca0 con 0x7f43fc0ceb30 2023-10-07T08:48:26.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fa7fc700 1 -- 172.21.15.81:0/4028713469 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43e4003570 con 0x7f43fc0ceb30 2023-10-07T08:48:26.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fa7fc700 1 -- 172.21.15.81:0/4028713469 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 17062560 0 0) 0x7f43e4003570 con 0x7f43fc0ceb30 2023-10-07T08:48:26.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fa7fc700 1 -- 172.21.15.81:0/4028713469 >> v2:172.21.15.89:3300/0 conn(0x7f43fc15a2a0 msgr2=0x7f43fc0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:26.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fa7fc700 1 --2- 172.21.15.81:0/4028713469 >> v2:172.21.15.89:3300/0 conn(0x7f43fc15a2a0 0x7f43fc0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fa7fc700 1 -- 172.21.15.81:0/4028713469 >> v1:172.21.15.89:6789/0 conn(0x7f43fc06dd60 legacy=0x7f43fc0b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:26.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fa7fc700 1 -- 172.21.15.81:0/4028713469 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc0b0370 con 0x7f43fc0ceb30 2023-10-07T08:48:26.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fa7fc700 1 -- 172.21.15.81:0/4028713469 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f43f0001470 con 0x7f43fc0ceb30 2023-10-07T08:48:26.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fa7fc700 1 -- 172.21.15.81:0/4028713469 >> v1:172.21.15.81:6789/0 conn(0x7f43fc0ceb30 legacy=0x7f43fc06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:26.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fa7fc700 1 --2- 172.21.15.81:0/4028713469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e4003a60 0x7f43e4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fa7fc700 1 --2- 172.21.15.81:0/4028713469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e4004810 0x7f43e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fa7fc700 1 --2- 172.21.15.81:0/4028713469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e40051c0 0x7f43e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fa7fc700 1 -- 172.21.15.81:0/4028713469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc06e160 con 0x7f43e4004810 2023-10-07T08:48:26.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fa7fc700 1 -- 172.21.15.81:0/4028713469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e400c050 con 0x7f43e40051c0 2023-10-07T08:48:26.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fa7fc700 1 -- 172.21.15.81:0/4028713469 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e400c210 con 0x7f43e4003a60 2023-10-07T08:48:26.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43faffd700 1 --2- 172.21.15.81:0/4028713469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e4004810 0x7f43e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fb7fe700 1 --2- 172.21.15.81:0/4028713469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e4003a60 0x7f43e4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fbfff700 1 --2- 172.21.15.81:0/4028713469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e40051c0 0x7f43e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43faffd700 1 -- 172.21.15.81:0/4028713469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e4003a60 msgr2=0x7f43e4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:26.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43faffd700 1 --2- 172.21.15.81:0/4028713469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e4003a60 0x7f43e4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43faffd700 1 -- 172.21.15.81:0/4028713469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e40051c0 msgr2=0x7f43e400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:26.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43faffd700 1 --2- 172.21.15.81:0/4028713469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e40051c0 0x7f43e400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43faffd700 1 -- 172.21.15.81:0/4028713469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e4003570 con 0x7f43e4004810 2023-10-07T08:48:26.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fb7fe700 1 --2- 172.21.15.81:0/4028713469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e4003a60 0x7f43e4003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:26.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fbfff700 1 --2- 172.21.15.81:0/4028713469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e40051c0 0x7f43e400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fbfff700 1 -- 172.21.15.81:0/4028713469 reap_dead start 2023-10-07T08:48:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43faffd700 1 --2- 172.21.15.81:0/4028713469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e4004810 0x7f43e4004c80 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f43f000c390 tx=0x7f43fc0b0c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbd04ffde3428c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.156+0000 7f43fa7fc700 1 -- 172.21.15.81:0/4028713469 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f000cc60 con 0x7f43e4004810 2023-10-07T08:48:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.157+0000 7f43fa7fc700 1 -- 172.21.15.81:0/4028713469 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f000ce00 con 0x7f43e4004810 2023-10-07T08:48:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.157+0000 7f43fa7fc700 1 -- 172.21.15.81:0/4028713469 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0005b70 con 0x7f43e4004810 2023-10-07T08:48:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.157+0000 7f4401d4f700 1 -- 172.21.15.81:0/4028713469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e4004810 msgr2=0x7f43e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.157+0000 7f4401d4f700 1 --2- 172.21.15.81:0/4028713469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e4004810 0x7f43e4004c80 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f43f000c390 tx=0x7f43fc0b0c10 comp rx=0 tx=0).stop 2023-10-07T08:48:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.157+0000 7f4401d4f700 1 -- 172.21.15.81:0/4028713469 shutdown_connections 2023-10-07T08:48:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.157+0000 7f4401d4f700 1 --2- 172.21.15.81:0/4028713469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e4004810 0x7f43e4004c80 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.157+0000 7f4401d4f700 1 -- 172.21.15.81:0/4028713469 >> 172.21.15.81:0/4028713469 conn(0x7f43fc067640 msgr2=0x7f43fc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.157+0000 7f4401d4f700 1 -- 172.21.15.81:0/4028713469 shutdown_connections 2023-10-07T08:48:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.157+0000 7f4401d4f700 1 -- 172.21.15.81:0/4028713469 wait complete. 2023-10-07T08:48:26.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.158+0000 7f4401d4f700 1 Processor -- start 2023-10-07T08:48:26.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.158+0000 7f4401d4f700 1 -- start start 2023-10-07T08:48:26.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.159+0000 7f4401d4f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e4004810 0x7f43fc1400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.159+0000 7f4401d4f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43fc15f260 0x7f43fc15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.159+0000 7f4401d4f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43fc158be0 0x7f43fc159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.159+0000 7f4401d4f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc159590 con 0x7f43fc15f260 2023-10-07T08:48:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.159+0000 7f4401d4f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc0b2c90 con 0x7f43fc158be0 2023-10-07T08:48:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.159+0000 7f4401d4f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc140620 con 0x7f43e4004810 2023-10-07T08:48:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.159+0000 7f43faffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43fc15f260 0x7f43fc15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.159+0000 7f43faffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43fc15f260 0x7f43fc15f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56990/0 (socket says 172.21.15.81:56990) 2023-10-07T08:48:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.159+0000 7f43faffd700 1 -- 172.21.15.81:0/470646352 learned_addr learned my addr 172.21.15.81:0/470646352 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.159+0000 7f43fb7fe700 1 --2- 172.21.15.81:0/470646352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e4004810 0x7f43fc1400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.159+0000 7f43fbfff700 1 --2- 172.21.15.81:0/470646352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43fc158be0 0x7f43fc159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.159+0000 7f43faffd700 1 -- 172.21.15.81:0/470646352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e4004810 msgr2=0x7f43fc1400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.159+0000 7f43faffd700 1 --2- 172.21.15.81:0/470646352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e4004810 0x7f43fc1400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.159+0000 7f43faffd700 1 -- 172.21.15.81:0/470646352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43fc158be0 msgr2=0x7f43fc159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.159+0000 7f43faffd700 1 --2- 172.21.15.81:0/470646352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43fc158be0 0x7f43fc159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.159+0000 7f43faffd700 1 -- 172.21.15.81:0/470646352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc0b2080 con 0x7f43fc15f260 2023-10-07T08:48:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.160+0000 7f43faffd700 1 --2- 172.21.15.81:0/470646352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43fc15f260 0x7f43fc15f6d0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f43f0001940 tx=0x7f43f0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.160+0000 7f43e37fe700 1 -- 172.21.15.81:0/470646352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f00070d0 con 0x7f43fc15f260 2023-10-07T08:48:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.160+0000 7f43e37fe700 1 -- 172.21.15.81:0/470646352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f0007230 con 0x7f43fc15f260 2023-10-07T08:48:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.160+0000 7f4401d4f700 1 -- 172.21.15.81:0/470646352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43fc0b2360 con 0x7f43fc15f260 2023-10-07T08:48:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.160+0000 7f43e37fe700 1 -- 172.21.15.81:0/470646352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f00075f0 con 0x7f43fc15f260 2023-10-07T08:48:26.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.160+0000 7f4401d4f700 1 -- 172.21.15.81:0/470646352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43fc0b2920 con 0x7f43fc15f260 2023-10-07T08:48:26.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.161+0000 7f4401d4f700 1 -- 172.21.15.81:0/470646352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43fc0b2e00 con 0x7f43fc15f260 2023-10-07T08:48:26.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.161+0000 7f43e37fe700 1 -- 172.21.15.81:0/470646352 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43f001e430 con 0x7f43fc15f260 2023-10-07T08:48:26.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.161+0000 7f43e37fe700 1 --2- 172.21.15.81:0/470646352 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f43e8066f30 0x7f43e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.161+0000 7f43e37fe700 1 -- 172.21.15.81:0/470646352 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43f00850c0 con 0x7f43fc15f260 2023-10-07T08:48:26.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.161+0000 7f43fb7fe700 1 --2- 172.21.15.81:0/470646352 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f43e8066f30 0x7f43e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.162+0000 7f43fb7fe700 1 --2- 172.21.15.81:0/470646352 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f43e8066f30 0x7f43e80693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009fd0 tx=0x7f43ec00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:26.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.166+0000 7f43e37fe700 1 -- 172.21.15.81:0/470646352 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43f00523f0 con 0x7f43fc15f260 2023-10-07T08:48:26.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.389+0000 7f4401d4f700 1 -- 172.21.15.81:0/470646352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43fc04bb80 con 0x7f43fc15f260 2023-10-07T08:48:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.389+0000 7f43e37fe700 1 -- 172.21.15.81:0/470646352 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f43f0001b90 con 0x7f43fc15f260 2023-10-07T08:48:26.391 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:26.391 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1015639142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1015639142},{"type":"v1","addr":"172.21.15.89:6833","nonce":1015639142}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2650972762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2650972762},{"type":"v1","addr":"172.21.15.89:6835","nonce":2650972762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2058286084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2058286084},{"type":"v1","addr":"172.21.15.81:6836","nonce":2058286084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:47:49.671409+0000","modified":"2023-10-07T08:47:53.341944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6837/3696879604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3696879604},{"type":"v1","addr":"172.21.15.81:6837","nonce":3696879604}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-07T08:48:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.391+0000 7f4401d4f700 1 -- 172.21.15.81:0/470646352 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f43e8066f30 msgr2=0x7f43e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.391+0000 7f4401d4f700 1 --2- 172.21.15.81:0/470646352 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f43e8066f30 0x7f43e80693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009fd0 tx=0x7f43ec00b040 comp rx=0 tx=0).stop 2023-10-07T08:48:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.391+0000 7f4401d4f700 1 -- 172.21.15.81:0/470646352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43fc15f260 msgr2=0x7f43fc15f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.391+0000 7f4401d4f700 1 --2- 172.21.15.81:0/470646352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43fc15f260 0x7f43fc15f6d0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f43f0001940 tx=0x7f43f0015000 comp rx=0 tx=0).stop 2023-10-07T08:48:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.391+0000 7f4401d4f700 1 -- 172.21.15.81:0/470646352 shutdown_connections 2023-10-07T08:48:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.391+0000 7f4401d4f700 1 --2- 172.21.15.81:0/470646352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43fc158be0 0x7f43fc159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.391+0000 7f4401d4f700 1 --2- 172.21.15.81:0/470646352 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f43e8066f30 0x7f43e80693e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.391+0000 7f4401d4f700 1 --2- 172.21.15.81:0/470646352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e4004810 0x7f43fc1400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.391+0000 7f4401d4f700 1 --2- 172.21.15.81:0/470646352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43fc15f260 0x7f43fc15f6d0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.391+0000 7f4401d4f700 1 -- 172.21.15.81:0/470646352 >> 172.21.15.81:0/470646352 conn(0x7f43fc067640 msgr2=0x7f43fc158110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.391+0000 7f4401d4f700 1 -- 172.21.15.81:0/470646352 shutdown_connections 2023-10-07T08:48:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.391+0000 7f4401d4f700 1 -- 172.21.15.81:0/470646352 wait complete. 2023-10-07T08:48:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 50 2023-10-07T08:48:26.405 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:48:26.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.518+0000 7f6f5f015700 1 Processor -- start 2023-10-07T08:48:26.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.518+0000 7f6f5f015700 1 -- start start 2023-10-07T08:48:26.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.519+0000 7f6f5f015700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f581578d0 0x7f6f580cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.519+0000 7f6f5f015700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6f58157ca0 0x7f6f5815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.519+0000 7f6f5f015700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f580d07c0 con 0x7f6f5806d120 2023-10-07T08:48:26.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.519+0000 7f6f5f015700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f580cfbb0 con 0x7f6f58157ca0 2023-10-07T08:48:26.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.519+0000 7f6f5f015700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f580cfe90 con 0x7f6f581578d0 2023-10-07T08:48:26.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.519+0000 7f6f57fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6f58157ca0 0x7f6f5815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.519+0000 7f6f5d5b2700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6f5806d120 0x7f6f5815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35448/0 (socket says 172.21.15.81:35448) 2023-10-07T08:48:26.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.519+0000 7f6f5d5b2700 1 -- 172.21.15.81:0/3722926529 learned_addr learned my addr 172.21.15.81:0/3722926529 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:26.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.519+0000 7f6f5cdb1700 1 --2- 172.21.15.81:0/3722926529 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f581578d0 0x7f6f580cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.519+0000 7f6f57fff700 1 -- 172.21.15.81:0/3722926529 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f581578d0 msgr2=0x7f6f580cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:26.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.519+0000 7f6f57fff700 1 --2- 172.21.15.81:0/3722926529 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f581578d0 0x7f6f580cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.519+0000 7f6f57fff700 1 -- 172.21.15.81:0/3722926529 >> v1:172.21.15.81:6789/0 conn(0x7f6f5806d120 legacy=0x7f6f5815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.519+0000 7f6f577fe700 1 -- 172.21.15.81:0/3722926529 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544233486 0 0) 0x7f6f580d07c0 con 0x7f6f5806d120 2023-10-07T08:48:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.519+0000 7f6f57fff700 1 -- 172.21.15.81:0/3722926529 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f580d0170 con 0x7f6f58157ca0 2023-10-07T08:48:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.519+0000 7f6f57fff700 1 --2- 172.21.15.81:0/3722926529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f58157ca0 0x7f6f5815af00 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6f480098e0 tx=0x7f6f480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405268cdc374bc7a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.520+0000 7f6f577fe700 1 -- 172.21.15.81:0/3722926529 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4800b640 con 0x7f6f58157ca0 2023-10-07T08:48:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.520+0000 7f6f577fe700 1 -- 172.21.15.81:0/3722926529 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4800b7a0 con 0x7f6f58157ca0 2023-10-07T08:48:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.520+0000 7f6f577fe700 1 -- 172.21.15.81:0/3722926529 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4800bb40 con 0x7f6f58157ca0 2023-10-07T08:48:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.520+0000 7f6f5f015700 1 -- 172.21.15.81:0/3722926529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f58157ca0 msgr2=0x7f6f5815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:26.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.520+0000 7f6f5f015700 1 --2- 172.21.15.81:0/3722926529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f58157ca0 0x7f6f5815af00 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6f480098e0 tx=0x7f6f480091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.520+0000 7f6f5f015700 1 -- 172.21.15.81:0/3722926529 shutdown_connections 2023-10-07T08:48:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.520+0000 7f6f5f015700 1 --2- 172.21.15.81:0/3722926529 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f581578d0 0x7f6f580cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.520+0000 7f6f5f015700 1 --2- 172.21.15.81:0/3722926529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f58157ca0 0x7f6f5815af00 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.520+0000 7f6f5f015700 1 -- 172.21.15.81:0/3722926529 >> 172.21.15.81:0/3722926529 conn(0x7f6f5806bb90 msgr2=0x7f6f5806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.520+0000 7f6f5f015700 1 -- 172.21.15.81:0/3722926529 shutdown_connections 2023-10-07T08:48:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.520+0000 7f6f5f015700 1 -- 172.21.15.81:0/3722926529 wait complete. 2023-10-07T08:48:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.521+0000 7f6f5f015700 1 Processor -- start 2023-10-07T08:48:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.521+0000 7f6f5f015700 1 -- start start 2023-10-07T08:48:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.522+0000 7f6f5f015700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f5806d120 0x7f6f580b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.522+0000 7f6f5f015700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f581578d0 0x7f6f580c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.522+0000 7f6f5f015700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f58157ca0 0x7f6f580c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.522+0000 7f6f5f015700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f58155550 con 0x7f6f58157ca0 2023-10-07T08:48:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.522+0000 7f6f5f015700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f580b5cf0 con 0x7f6f5806d120 2023-10-07T08:48:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.522+0000 7f6f5f015700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f580b50e0 con 0x7f6f581578d0 2023-10-07T08:48:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.522+0000 7f6f5d5b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f58157ca0 0x7f6f580c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.522+0000 7f6f5d5b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f58157ca0 0x7f6f580c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56998/0 (socket says 172.21.15.81:56998) 2023-10-07T08:48:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.522+0000 7f6f5d5b2700 1 -- 172.21.15.81:0/925695223 learned_addr learned my addr 172.21.15.81:0/925695223 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.522+0000 7f6f5cdb1700 1 --2- 172.21.15.81:0/925695223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f5806d120 0x7f6f580b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.522+0000 7f6f5d5b2700 1 -- 172.21.15.81:0/925695223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f581578d0 msgr2=0x7f6f580c6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.523+0000 7f6f5d5b2700 1 --2- 172.21.15.81:0/925695223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f581578d0 0x7f6f580c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.523+0000 7f6f5d5b2700 1 -- 172.21.15.81:0/925695223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f5806d120 msgr2=0x7f6f580b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.523+0000 7f6f5d5b2700 1 --2- 172.21.15.81:0/925695223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f5806d120 0x7f6f580b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.523+0000 7f6f5d5b2700 1 -- 172.21.15.81:0/925695223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f48009420 con 0x7f6f58157ca0 2023-10-07T08:48:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.523+0000 7f6f5cdb1700 1 --2- 172.21.15.81:0/925695223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f5806d120 0x7f6f580b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.523+0000 7f6f5d5b2700 1 --2- 172.21.15.81:0/925695223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f58157ca0 0x7f6f580c8110 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000c7e0 tx=0x7f6f40007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.523+0000 7f6f54ff9700 1 -- 172.21.15.81:0/925695223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40005c00 con 0x7f6f58157ca0 2023-10-07T08:48:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.523+0000 7f6f54ff9700 1 -- 172.21.15.81:0/925695223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f40005d60 con 0x7f6f58157ca0 2023-10-07T08:48:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.523+0000 7f6f5f015700 1 -- 172.21.15.81:0/925695223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f580b53c0 con 0x7f6f58157ca0 2023-10-07T08:48:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.523+0000 7f6f54ff9700 1 -- 172.21.15.81:0/925695223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40004a80 con 0x7f6f58157ca0 2023-10-07T08:48:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.523+0000 7f6f5f015700 1 -- 172.21.15.81:0/925695223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f580b5980 con 0x7f6f58157ca0 2023-10-07T08:48:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.524+0000 7f6f5f015700 1 -- 172.21.15.81:0/925695223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f580b5e60 con 0x7f6f58157ca0 2023-10-07T08:48:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.524+0000 7f6f54ff9700 1 -- 172.21.15.81:0/925695223 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f40005030 con 0x7f6f58157ca0 2023-10-07T08:48:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.524+0000 7f6f54ff9700 1 --2- 172.21.15.81:0/925695223 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6f38066f30 0x7f6f380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.525+0000 7f6f54ff9700 1 -- 172.21.15.81:0/925695223 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f400839a0 con 0x7f6f58157ca0 2023-10-07T08:48:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.525+0000 7f6f5cdb1700 1 --2- 172.21.15.81:0/925695223 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6f38066f30 0x7f6f380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.525+0000 7f6f5cdb1700 1 --2- 172.21.15.81:0/925695223 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6f38066f30 0x7f6f380693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6f50007780 tx=0x7f6f5000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.529+0000 7f6f54ff9700 1 -- 172.21.15.81:0/925695223 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f4004b5a0 con 0x7f6f58157ca0 2023-10-07T08:48:26.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.710+0000 7f6f5f015700 1 -- 172.21.15.81:0/925695223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f580d0450 con 0x7f6f58157ca0 2023-10-07T08:48:26.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.711+0000 7f6f54ff9700 1 -- 172.21.15.81:0/925695223 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+15317 (secure 0 0 0) 0x7f6f40050c10 con 0x7f6f58157ca0 2023-10-07T08:48:26.712 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:26.713 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":111,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:48:22.503045+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:47:47.993754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-07T08:47:48.631797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:48:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.713+0000 7f6f5f015700 1 -- 172.21.15.81:0/925695223 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6f38066f30 msgr2=0x7f6f380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.713+0000 7f6f5f015700 1 --2- 172.21.15.81:0/925695223 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6f38066f30 0x7f6f380693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6f50007780 tx=0x7f6f5000b040 comp rx=0 tx=0).stop 2023-10-07T08:48:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.713+0000 7f6f5f015700 1 -- 172.21.15.81:0/925695223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f58157ca0 msgr2=0x7f6f580c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.713+0000 7f6f5f015700 1 --2- 172.21.15.81:0/925695223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f58157ca0 0x7f6f580c8110 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000c7e0 tx=0x7f6f40007d90 comp rx=0 tx=0).stop 2023-10-07T08:48:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.713+0000 7f6f5f015700 1 -- 172.21.15.81:0/925695223 shutdown_connections 2023-10-07T08:48:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.713+0000 7f6f5f015700 1 --2- 172.21.15.81:0/925695223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f58157ca0 0x7f6f580c8110 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.713+0000 7f6f5f015700 1 --2- 172.21.15.81:0/925695223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f5806d120 0x7f6f580b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.713+0000 7f6f5f015700 1 --2- 172.21.15.81:0/925695223 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6f38066f30 0x7f6f380693e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.713+0000 7f6f5f015700 1 --2- 172.21.15.81:0/925695223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f581578d0 0x7f6f580c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.713+0000 7f6f5f015700 1 -- 172.21.15.81:0/925695223 >> 172.21.15.81:0/925695223 conn(0x7f6f5806bb90 msgr2=0x7f6f58155d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.713+0000 7f6f5f015700 1 -- 172.21.15.81:0/925695223 shutdown_connections 2023-10-07T08:48:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.713+0000 7f6f5f015700 1 -- 172.21.15.81:0/925695223 wait complete. 2023-10-07T08:48:26.727 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:47:47.993754+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:47:48.631797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:48:26.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:48:26.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.843+0000 7f4cb4f8c700 1 Processor -- start 2023-10-07T08:48:26.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.843+0000 7f4cb4f8c700 1 -- start start 2023-10-07T08:48:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.844+0000 7f4cb4f8c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4cb00d0b80 0x7f4cb00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.844+0000 7f4cb4f8c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cb006d700 0x7f4cb015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.844+0000 7f4cb4f8c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb00cf2d0 con 0x7f4cb00d02b0 2023-10-07T08:48:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.844+0000 7f4cb4f8c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb015a690 con 0x7f4cb00d0b80 2023-10-07T08:48:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.844+0000 7f4cb4f8c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb006dc00 con 0x7f4cb006d700 2023-10-07T08:48:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.844+0000 7f4caf7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4cb00d0b80 0x7f4cb00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.844+0000 7f4caf7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4cb00d0b80 0x7f4cb00cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57000/0 (socket says 172.21.15.81:57000) 2023-10-07T08:48:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.844+0000 7f4caf7fe700 1 -- 172.21.15.81:0/1854180600 learned_addr learned my addr 172.21.15.81:0/1854180600 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.844+0000 7f4caffff700 1 --2- 172.21.15.81:0/1854180600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cb006d700 0x7f4cb015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.844+0000 7f4caf7fe700 1 -- 172.21.15.81:0/1854180600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cb006d700 msgr2=0x7f4cb015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.844+0000 7f4caf7fe700 1 --2- 172.21.15.81:0/1854180600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cb006d700 0x7f4cb015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.844+0000 7f4caf7fe700 1 -- 172.21.15.81:0/1854180600 >> v1:172.21.15.89:6789/0 conn(0x7f4cb00d02b0 legacy=0x7f4cb006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.844+0000 7f4caf7fe700 1 -- 172.21.15.81:0/1854180600 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb00cf570 con 0x7f4cb00d0b80 2023-10-07T08:48:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.844+0000 7f4caffff700 1 --2- 172.21.15.81:0/1854180600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cb006d700 0x7f4cb015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.844+0000 7f4caf7fe700 1 --2- 172.21.15.81:0/1854180600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cb00d0b80 0x7f4cb00cfd70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009f20 tx=0x7f4ca0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518e215e4e2a5b12 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.845+0000 7f4cae7fc700 1 -- 172.21.15.81:0/1854180600 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca000e070 con 0x7f4cb00d0b80 2023-10-07T08:48:26.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.845+0000 7f4cae7fc700 1 -- 172.21.15.81:0/1854180600 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca000ba40 con 0x7f4cb00d0b80 2023-10-07T08:48:26.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.845+0000 7f4cae7fc700 1 -- 172.21.15.81:0/1854180600 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00092e0 con 0x7f4cb00d0b80 2023-10-07T08:48:26.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.845+0000 7f4cb4f8c700 1 -- 172.21.15.81:0/1854180600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cb00d0b80 msgr2=0x7f4cb00cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:26.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.845+0000 7f4cb4f8c700 1 --2- 172.21.15.81:0/1854180600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cb00d0b80 0x7f4cb00cfd70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009f20 tx=0x7f4ca0009840 comp rx=0 tx=0).stop 2023-10-07T08:48:26.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.845+0000 7f4cb4f8c700 1 -- 172.21.15.81:0/1854180600 shutdown_connections 2023-10-07T08:48:26.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.845+0000 7f4cb4f8c700 1 --2- 172.21.15.81:0/1854180600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cb006d700 0x7f4cb015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.845+0000 7f4cb4f8c700 1 --2- 172.21.15.81:0/1854180600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cb00d0b80 0x7f4cb00cfd70 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.845+0000 7f4cb4f8c700 1 -- 172.21.15.81:0/1854180600 >> 172.21.15.81:0/1854180600 conn(0x7f4cb0063230 msgr2=0x7f4cb0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:26.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.845+0000 7f4cb4f8c700 1 -- 172.21.15.81:0/1854180600 shutdown_connections 2023-10-07T08:48:26.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.845+0000 7f4cb4f8c700 1 -- 172.21.15.81:0/1854180600 wait complete. 2023-10-07T08:48:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.846+0000 7f4cb4f8c700 1 Processor -- start 2023-10-07T08:48:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.846+0000 7f4cb4f8c700 1 -- start start 2023-10-07T08:48:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.847+0000 7f4cb4f8c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cb006d700 0x7f4cb00b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.847+0000 7f4cb4f8c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cb00d02b0 0x7f4cb00ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.847+0000 7f4cb4f8c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cb00d0b80 0x7f4cb006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.847+0000 7f4cb4f8c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb00afe60 con 0x7f4cb00d02b0 2023-10-07T08:48:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.847+0000 7f4cb4f8c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb00af250 con 0x7f4cb00d0b80 2023-10-07T08:48:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.847+0000 7f4cb4f8c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb00af530 con 0x7f4cb006d700 2023-10-07T08:48:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.847+0000 7f4caeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cb00d02b0 0x7f4cb00ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.847+0000 7f4caeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cb00d02b0 0x7f4cb00ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57004/0 (socket says 172.21.15.81:57004) 2023-10-07T08:48:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.847+0000 7f4caeffd700 1 -- 172.21.15.81:0/294523293 learned_addr learned my addr 172.21.15.81:0/294523293 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.847+0000 7f4caf7fe700 1 --2- 172.21.15.81:0/294523293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cb006d700 0x7f4cb00b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.848+0000 7f4caffff700 1 --2- 172.21.15.81:0/294523293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cb00d0b80 0x7f4cb006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.848+0000 7f4caeffd700 1 -- 172.21.15.81:0/294523293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cb006d700 msgr2=0x7f4cb00b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.848+0000 7f4caeffd700 1 --2- 172.21.15.81:0/294523293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cb006d700 0x7f4cb00b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.848+0000 7f4caeffd700 1 -- 172.21.15.81:0/294523293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cb00d0b80 msgr2=0x7f4cb006bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.848+0000 7f4caeffd700 1 --2- 172.21.15.81:0/294523293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cb00d0b80 0x7f4cb006bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.848+0000 7f4caeffd700 1 -- 172.21.15.81:0/294523293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca0009ae0 con 0x7f4cb00d02b0 2023-10-07T08:48:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.848+0000 7f4caffff700 1 --2- 172.21.15.81:0/294523293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cb00d0b80 0x7f4cb006bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.848+0000 7f4caeffd700 1 --2- 172.21.15.81:0/294523293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cb00d02b0 0x7f4cb00ae8e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400c5d0 tx=0x7f4ca4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.848+0000 7f4c977fe700 1 -- 172.21.15.81:0/294523293 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4011590 con 0x7f4cb00d02b0 2023-10-07T08:48:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.848+0000 7f4c977fe700 1 -- 172.21.15.81:0/294523293 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca4011710 con 0x7f4cb00d02b0 2023-10-07T08:48:26.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.848+0000 7f4cb4f8c700 1 -- 172.21.15.81:0/294523293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb00af810 con 0x7f4cb00d02b0 2023-10-07T08:48:26.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.848+0000 7f4c977fe700 1 -- 172.21.15.81:0/294523293 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4011ad0 con 0x7f4cb00d02b0 2023-10-07T08:48:26.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.848+0000 7f4cb4f8c700 1 -- 172.21.15.81:0/294523293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb00aee20 con 0x7f4cb00d02b0 2023-10-07T08:48:26.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.849+0000 7f4cb4f8c700 1 -- 172.21.15.81:0/294523293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb00affd0 con 0x7f4cb00d02b0 2023-10-07T08:48:26.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.849+0000 7f4c977fe700 1 -- 172.21.15.81:0/294523293 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ca401c460 con 0x7f4cb00d02b0 2023-10-07T08:48:26.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.849+0000 7f4c977fe700 1 --2- 172.21.15.81:0/294523293 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4c9c066f30 0x7f4c9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:26.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.850+0000 7f4c977fe700 1 -- 172.21.15.81:0/294523293 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ca4084330 con 0x7f4cb00d02b0 2023-10-07T08:48:26.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.850+0000 7f4caf7fe700 1 --2- 172.21.15.81:0/294523293 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4c9c066f30 0x7f4c9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:26.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.850+0000 7f4caf7fe700 1 --2- 172.21.15.81:0/294523293 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4c9c066f30 0x7f4c9c0693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009880 tx=0x7f4ca0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:26.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:26.854+0000 7f4c977fe700 1 -- 172.21.15.81:0/294523293 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ca40515a0 con 0x7f4cb00d02b0 2023-10-07T08:48:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.034+0000 7f4cb4f8c700 1 -- 172.21.15.81:0/294523293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4cb00676e0 con 0x7f4cb00d02b0 2023-10-07T08:48:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.035+0000 7f4c977fe700 1 -- 172.21.15.81:0/294523293 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ca4054bc0 con 0x7f4cb00d02b0 2023-10-07T08:48:27.036 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:48:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.037+0000 7f4cb4f8c700 1 -- 172.21.15.81:0/294523293 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4c9c066f30 msgr2=0x7f4c9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.037+0000 7f4cb4f8c700 1 --2- 172.21.15.81:0/294523293 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4c9c066f30 0x7f4c9c0693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009880 tx=0x7f4ca0017000 comp rx=0 tx=0).stop 2023-10-07T08:48:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.037+0000 7f4cb4f8c700 1 -- 172.21.15.81:0/294523293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cb00d02b0 msgr2=0x7f4cb00ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.037+0000 7f4cb4f8c700 1 --2- 172.21.15.81:0/294523293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cb00d02b0 0x7f4cb00ae8e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400c5d0 tx=0x7f4ca4007f60 comp rx=0 tx=0).stop 2023-10-07T08:48:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.037+0000 7f4cb4f8c700 1 -- 172.21.15.81:0/294523293 shutdown_connections 2023-10-07T08:48:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.037+0000 7f4cb4f8c700 1 --2- 172.21.15.81:0/294523293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cb00d0b80 0x7f4cb006bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.037+0000 7f4cb4f8c700 1 --2- 172.21.15.81:0/294523293 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4c9c066f30 0x7f4c9c0693e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.037+0000 7f4cb4f8c700 1 --2- 172.21.15.81:0/294523293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cb006d700 0x7f4cb00b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.037+0000 7f4cb4f8c700 1 --2- 172.21.15.81:0/294523293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cb00d02b0 0x7f4cb00ae8e0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.037+0000 7f4cb4f8c700 1 -- 172.21.15.81:0/294523293 >> 172.21.15.81:0/294523293 conn(0x7f4cb0063230 msgr2=0x7f4cb015c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.037+0000 7f4cb4f8c700 1 -- 172.21.15.81:0/294523293 shutdown_connections 2023-10-07T08:48:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.037+0000 7f4cb4f8c700 1 -- 172.21.15.81:0/294523293 wait complete. 2023-10-07T08:48:27.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:48:27.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.165+0000 7f34f2635700 1 Processor -- start 2023-10-07T08:48:27.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.165+0000 7f34f2635700 1 -- start start 2023-10-07T08:48:27.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.166+0000 7f34f2635700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34ec0d0b80 0x7f34ec0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.166+0000 7f34f2635700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ec0cf2d0 con 0x7f34ec06d700 2023-10-07T08:48:27.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.166+0000 7f34f2635700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ec06dc00 con 0x7f34ec0d02b0 2023-10-07T08:48:27.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.166+0000 7f34f2635700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ec15a690 con 0x7f34ec0d0b80 2023-10-07T08:48:27.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.166+0000 7f34f1e34700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f34ec06d700 0x7f34ec15b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35464/0 (socket says 172.21.15.81:35464) 2023-10-07T08:48:27.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.166+0000 7f34f1e34700 1 -- 172.21.15.81:0/546689632 learned_addr learned my addr 172.21.15.81:0/546689632 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:27.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.166+0000 7f34e3fff700 1 -- 172.21.15.81:0/546689632 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670611716 0 0) 0x7f34ec0cf2d0 con 0x7f34ec06d700 2023-10-07T08:48:27.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.166+0000 7f34f1633700 1 --2- 172.21.15.81:0/546689632 >> v2:172.21.15.89:3300/0 conn(0x7f34ec0d0b80 0x7f34ec0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.166+0000 7f34e3fff700 1 -- 172.21.15.81:0/546689632 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d8003570 con 0x7f34ec06d700 2023-10-07T08:48:27.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34e3fff700 1 -- 172.21.15.81:0/546689632 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1127662656 0 0) 0x7f34d8003570 con 0x7f34ec06d700 2023-10-07T08:48:27.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34e3fff700 1 -- 172.21.15.81:0/546689632 >> v2:172.21.15.89:3300/0 conn(0x7f34ec0d0b80 msgr2=0x7f34ec0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:27.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34e3fff700 1 --2- 172.21.15.81:0/546689632 >> v2:172.21.15.89:3300/0 conn(0x7f34ec0d0b80 0x7f34ec0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34e3fff700 1 -- 172.21.15.81:0/546689632 >> v1:172.21.15.89:6789/0 conn(0x7f34ec0d02b0 legacy=0x7f34ec06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34e3fff700 1 -- 172.21.15.81:0/546689632 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec0cf570 con 0x7f34ec06d700 2023-10-07T08:48:27.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34e3fff700 1 -- 172.21.15.81:0/546689632 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f34e4001470 con 0x7f34ec06d700 2023-10-07T08:48:27.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34e3fff700 1 -- 172.21.15.81:0/546689632 >> v1:172.21.15.81:6789/0 conn(0x7f34ec06d700 legacy=0x7f34ec15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34e3fff700 1 --2- 172.21.15.81:0/546689632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d8003a60 0x7f34d8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34e3fff700 1 --2- 172.21.15.81:0/546689632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d8004810 0x7f34d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34e3fff700 1 --2- 172.21.15.81:0/546689632 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d80051c0 0x7f34d800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34e3fff700 1 -- 172.21.15.81:0/546689632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec15a690 con 0x7f34d8003a60 2023-10-07T08:48:27.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34e3fff700 1 -- 172.21.15.81:0/546689632 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d800c160 con 0x7f34d8004810 2023-10-07T08:48:27.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34e3fff700 1 -- 172.21.15.81:0/546689632 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d800c320 con 0x7f34d80051c0 2023-10-07T08:48:27.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34f1633700 1 --2- 172.21.15.81:0/546689632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d8003a60 0x7f34d8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34f0e32700 1 --2- 172.21.15.81:0/546689632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d8004810 0x7f34d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34f1e34700 1 --2- 172.21.15.81:0/546689632 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d80051c0 0x7f34d800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34f1633700 1 -- 172.21.15.81:0/546689632 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d80051c0 msgr2=0x7f34d800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:27.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34f1633700 1 --2- 172.21.15.81:0/546689632 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d80051c0 0x7f34d800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34f1633700 1 -- 172.21.15.81:0/546689632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d8004810 msgr2=0x7f34d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:27.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34f1633700 1 --2- 172.21.15.81:0/546689632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d8004810 0x7f34d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34f1e34700 1 -- 172.21.15.81:0/546689632 reap_dead start 2023-10-07T08:48:27.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34f1633700 1 -- 172.21.15.81:0/546689632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d8003570 con 0x7f34d8003a60 2023-10-07T08:48:27.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34f1633700 1 --2- 172.21.15.81:0/546689632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d8003a60 0x7f34d8003e70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f34e800e210 tx=0x7f34e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d132b8036f3a82 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34e3fff700 1 -- 172.21.15.81:0/546689632 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e800eac0 con 0x7f34d8003a60 2023-10-07T08:48:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34e3fff700 1 -- 172.21.15.81:0/546689632 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e800f040 con 0x7f34d8003a60 2023-10-07T08:48:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.167+0000 7f34e3fff700 1 -- 172.21.15.81:0/546689632 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e800ee50 con 0x7f34d8003a60 2023-10-07T08:48:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.168+0000 7f34f2635700 1 -- 172.21.15.81:0/546689632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d8003a60 msgr2=0x7f34d8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.168+0000 7f34f2635700 1 --2- 172.21.15.81:0/546689632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d8003a60 0x7f34d8003e70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f34e800e210 tx=0x7f34e800b040 comp rx=0 tx=0).stop 2023-10-07T08:48:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.168+0000 7f34f2635700 1 -- 172.21.15.81:0/546689632 shutdown_connections 2023-10-07T08:48:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.168+0000 7f34f2635700 1 --2- 172.21.15.81:0/546689632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d8003a60 0x7f34d8003e70 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.168+0000 7f34f2635700 1 -- 172.21.15.81:0/546689632 >> 172.21.15.81:0/546689632 conn(0x7f34ec063230 msgr2=0x7f34ec063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.168+0000 7f34f2635700 1 -- 172.21.15.81:0/546689632 shutdown_connections 2023-10-07T08:48:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.168+0000 7f34f2635700 1 -- 172.21.15.81:0/546689632 wait complete. 2023-10-07T08:48:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.169+0000 7f34f2635700 1 Processor -- start 2023-10-07T08:48:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.169+0000 7f34f2635700 1 -- start start 2023-10-07T08:48:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f2635700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d8003a60 0x7f34ec0aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f2635700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec06a230 0x7f34ec0ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f2635700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34ec146ea0 0x7f34ec15b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f2635700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec0add20 con 0x7f34ec06a230 2023-10-07T08:48:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f2635700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec06a6a0 con 0x7f34d8003a60 2023-10-07T08:48:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f2635700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec0aaf50 con 0x7f34ec146ea0 2023-10-07T08:48:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f0e32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec06a230 0x7f34ec0ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f0e32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec06a230 0x7f34ec0ad7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57020/0 (socket says 172.21.15.81:57020) 2023-10-07T08:48:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f1633700 1 --2- 172.21.15.81:0/3510798717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d8003a60 0x7f34ec0aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f0e32700 1 -- 172.21.15.81:0/3510798717 learned_addr learned my addr 172.21.15.81:0/3510798717 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f1e34700 1 --2- 172.21.15.81:0/3510798717 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34ec146ea0 0x7f34ec15b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f0e32700 1 -- 172.21.15.81:0/3510798717 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34ec146ea0 msgr2=0x7f34ec15b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f0e32700 1 --2- 172.21.15.81:0/3510798717 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34ec146ea0 0x7f34ec15b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f0e32700 1 -- 172.21.15.81:0/3510798717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d8003a60 msgr2=0x7f34ec0aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f0e32700 1 --2- 172.21.15.81:0/3510798717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d8003a60 0x7f34ec0aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f0e32700 1 -- 172.21.15.81:0/3510798717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec0ab230 con 0x7f34ec06a230 2023-10-07T08:48:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.170+0000 7f34f0e32700 1 --2- 172.21.15.81:0/3510798717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec06a230 0x7f34ec0ad7e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f34dc002920 tx=0x7f34dc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.171+0000 7f34e17fa700 1 -- 172.21.15.81:0/3510798717 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc011590 con 0x7f34ec06a230 2023-10-07T08:48:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.171+0000 7f34e17fa700 1 -- 172.21.15.81:0/3510798717 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc0116f0 con 0x7f34ec06a230 2023-10-07T08:48:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.171+0000 7f34f2635700 1 -- 172.21.15.81:0/3510798717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ec0ab510 con 0x7f34ec06a230 2023-10-07T08:48:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.171+0000 7f34e17fa700 1 -- 172.21.15.81:0/3510798717 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc011a90 con 0x7f34ec06a230 2023-10-07T08:48:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.171+0000 7f34f2635700 1 -- 172.21.15.81:0/3510798717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ec0abad0 con 0x7f34ec06a230 2023-10-07T08:48:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.171+0000 7f34f2635700 1 -- 172.21.15.81:0/3510798717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ec0abe40 con 0x7f34ec06a230 2023-10-07T08:48:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.172+0000 7f34e17fa700 1 -- 172.21.15.81:0/3510798717 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34dc01d460 con 0x7f34ec06a230 2023-10-07T08:48:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.172+0000 7f34e17fa700 1 --2- 172.21.15.81:0/3510798717 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f34d0066f30 0x7f34d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.172+0000 7f34e17fa700 1 -- 172.21.15.81:0/3510798717 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34dc084620 con 0x7f34ec06a230 2023-10-07T08:48:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.172+0000 7f34f1633700 1 --2- 172.21.15.81:0/3510798717 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f34d0066f30 0x7f34d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.173+0000 7f34f1633700 1 --2- 172.21.15.81:0/3510798717 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f34d0066f30 0x7f34d00693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f34e800afd0 tx=0x7f34e801a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:27.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.176+0000 7f34e17fa700 1 -- 172.21.15.81:0/3510798717 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34dc051890 con 0x7f34ec06a230 2023-10-07T08:48:27.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.358+0000 7f34f2635700 1 -- 172.21.15.81:0/3510798717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34ec0676e0 con 0x7f34ec06a230 2023-10-07T08:48:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.359+0000 7f34e17fa700 1 -- 172.21.15.81:0/3510798717 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7f34dc054eb0 con 0x7f34ec06a230 2023-10-07T08:48:27.360 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:48:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.360+0000 7f34f2635700 1 -- 172.21.15.81:0/3510798717 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f34d0066f30 msgr2=0x7f34d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.360+0000 7f34f2635700 1 --2- 172.21.15.81:0/3510798717 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f34d0066f30 0x7f34d00693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f34e800afd0 tx=0x7f34e801a000 comp rx=0 tx=0).stop 2023-10-07T08:48:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.360+0000 7f34f2635700 1 -- 172.21.15.81:0/3510798717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec06a230 msgr2=0x7f34ec0ad7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.360+0000 7f34f2635700 1 --2- 172.21.15.81:0/3510798717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec06a230 0x7f34ec0ad7e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f34dc002920 tx=0x7f34dc007d30 comp rx=0 tx=0).stop 2023-10-07T08:48:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.361+0000 7f34f2635700 1 -- 172.21.15.81:0/3510798717 shutdown_connections 2023-10-07T08:48:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.361+0000 7f34f2635700 1 --2- 172.21.15.81:0/3510798717 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f34d0066f30 0x7f34d00693e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.361+0000 7f34f2635700 1 --2- 172.21.15.81:0/3510798717 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34ec146ea0 0x7f34ec15b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.361+0000 7f34f2635700 1 --2- 172.21.15.81:0/3510798717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d8003a60 0x7f34ec0aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.361+0000 7f34f2635700 1 --2- 172.21.15.81:0/3510798717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec06a230 0x7f34ec0ad7e0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.361+0000 7f34f2635700 1 -- 172.21.15.81:0/3510798717 >> 172.21.15.81:0/3510798717 conn(0x7f34ec063230 msgr2=0x7f34ec0b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.361+0000 7f34f2635700 1 -- 172.21.15.81:0/3510798717 shutdown_connections 2023-10-07T08:48:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.361+0000 7f34f2635700 1 -- 172.21.15.81:0/3510798717 wait complete. 2023-10-07T08:48:27.373 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:48:27.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.489+0000 7f975ccce700 1 Processor -- start 2023-10-07T08:48:27.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.489+0000 7f975ccce700 1 -- start start 2023-10-07T08:48:27.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.489+0000 7f975ccce700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97580cf080 0x7f975806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.489+0000 7f975ccce700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97580aaf40 con 0x7f975806e4e0 2023-10-07T08:48:27.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.489+0000 7f975ccce700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975806c570 con 0x7f9758159cb0 2023-10-07T08:48:27.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.489+0000 7f975ccce700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97580aa930 con 0x7f97580cf080 2023-10-07T08:48:27.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.490+0000 7f9757fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97580cf080 0x7f975806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.490+0000 7f9756ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f975806e4e0 0x7f975806cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35474/0 (socket says 172.21.15.81:35474) 2023-10-07T08:48:27.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.490+0000 7f9757fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97580cf080 0x7f975806d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57036/0 (socket says 172.21.15.81:57036) 2023-10-07T08:48:27.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.490+0000 7f9756ffd700 1 -- 172.21.15.81:0/3651480124 learned_addr learned my addr 172.21.15.81:0/3651480124 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:27.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.490+0000 7f9757fff700 1 -- 172.21.15.81:0/3651480124 >> v1:172.21.15.89:6789/0 conn(0x7f9758159cb0 legacy=0x7f97580ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:27.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.490+0000 7f9757fff700 1 -- 172.21.15.81:0/3651480124 >> v1:172.21.15.81:6789/0 conn(0x7f975806e4e0 legacy=0x7f975806cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.490+0000 7f9757fff700 1 -- 172.21.15.81:0/3651480124 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975806e970 con 0x7f97580cf080 2023-10-07T08:48:27.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.490+0000 7f9757fff700 1 --2- 172.21.15.81:0/3651480124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97580cf080 0x7f975806d3b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f97500098e0 tx=0x7f97500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d3f9a64806b5ac server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:27.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.490+0000 7f97567fc700 1 -- 172.21.15.81:0/3651480124 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750009e80 con 0x7f97580cf080 2023-10-07T08:48:27.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.490+0000 7f97567fc700 1 -- 172.21.15.81:0/3651480124 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975000b820 con 0x7f97580cf080 2023-10-07T08:48:27.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.490+0000 7f97567fc700 1 -- 172.21.15.81:0/3651480124 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975000bba0 con 0x7f97580cf080 2023-10-07T08:48:27.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.491+0000 7f975ccce700 1 -- 172.21.15.81:0/3651480124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97580cf080 msgr2=0x7f975806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.491+0000 7f975ccce700 1 --2- 172.21.15.81:0/3651480124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97580cf080 0x7f975806d3b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f97500098e0 tx=0x7f97500091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.491+0000 7f975ccce700 1 -- 172.21.15.81:0/3651480124 shutdown_connections 2023-10-07T08:48:27.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.491+0000 7f975ccce700 1 --2- 172.21.15.81:0/3651480124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97580cf080 0x7f975806d3b0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.491+0000 7f975ccce700 1 -- 172.21.15.81:0/3651480124 >> 172.21.15.81:0/3651480124 conn(0x7f9758068110 msgr2=0x7f975806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:27.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.491+0000 7f975ccce700 1 -- 172.21.15.81:0/3651480124 shutdown_connections 2023-10-07T08:48:27.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.491+0000 7f975ccce700 1 -- 172.21.15.81:0/3651480124 wait complete. 2023-10-07T08:48:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.492+0000 7f975ccce700 1 Processor -- start 2023-10-07T08:48:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.492+0000 7f975ccce700 1 -- start start 2023-10-07T08:48:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f975ccce700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f975806e4e0 0x7f97580c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f975ccce700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97580cf080 0x7f97580c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f975ccce700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9758159cb0 0x7f97580c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f975ccce700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9758148a70 con 0x7f9758159cb0 2023-10-07T08:48:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f975ccce700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97580ac070 con 0x7f97580cf080 2023-10-07T08:48:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f975ccce700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97580c8230 con 0x7f975806e4e0 2023-10-07T08:48:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f9757fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9758159cb0 0x7f97580c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f9757fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9758159cb0 0x7f97580c6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57046/0 (socket says 172.21.15.81:57046) 2023-10-07T08:48:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f9757fff700 1 -- 172.21.15.81:0/536226775 learned_addr learned my addr 172.21.15.81:0/536226775 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f9756ffd700 1 --2- 172.21.15.81:0/536226775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97580cf080 0x7f97580c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f97577fe700 1 --2- 172.21.15.81:0/536226775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f975806e4e0 0x7f97580c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f9757fff700 1 -- 172.21.15.81:0/536226775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f975806e4e0 msgr2=0x7f97580c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f9757fff700 1 --2- 172.21.15.81:0/536226775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f975806e4e0 0x7f97580c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f9757fff700 1 -- 172.21.15.81:0/536226775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97580cf080 msgr2=0x7f97580c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f9757fff700 1 --2- 172.21.15.81:0/536226775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97580cf080 0x7f97580c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f9757fff700 1 -- 172.21.15.81:0/536226775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9750009420 con 0x7f9758159cb0 2023-10-07T08:48:27.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f9757fff700 1 --2- 172.21.15.81:0/536226775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9758159cb0 0x7f97580c6f80 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f97500093f0 tx=0x7f9750016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:27.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f973f7fe700 1 -- 172.21.15.81:0/536226775 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975000bb60 con 0x7f9758159cb0 2023-10-07T08:48:27.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f973f7fe700 1 -- 172.21.15.81:0/536226775 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9750020070 con 0x7f9758159cb0 2023-10-07T08:48:27.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.493+0000 7f973f7fe700 1 -- 172.21.15.81:0/536226775 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975001b6a0 con 0x7f9758159cb0 2023-10-07T08:48:27.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.494+0000 7f975ccce700 1 -- 172.21.15.81:0/536226775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97580c7620 con 0x7f9758159cb0 2023-10-07T08:48:27.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.494+0000 7f975ccce700 1 -- 172.21.15.81:0/536226775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97580c7be0 con 0x7f9758159cb0 2023-10-07T08:48:27.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.494+0000 7f975ccce700 1 -- 172.21.15.81:0/536226775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97580c83e0 con 0x7f9758159cb0 2023-10-07T08:48:27.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.495+0000 7f973f7fe700 1 -- 172.21.15.81:0/536226775 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9750022030 con 0x7f9758159cb0 2023-10-07T08:48:27.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.495+0000 7f973f7fe700 1 --2- 172.21.15.81:0/536226775 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9744066f30 0x7f97440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.495+0000 7f973f7fe700 1 -- 172.21.15.81:0/536226775 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97500865c0 con 0x7f9758159cb0 2023-10-07T08:48:27.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.495+0000 7f97577fe700 1 --2- 172.21.15.81:0/536226775 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9744066f30 0x7f97440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.496+0000 7f97577fe700 1 --2- 172.21.15.81:0/536226775 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9744066f30 0x7f97440693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9748007560 tx=0x7f9748009760 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:27.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.499+0000 7f973f7fe700 1 -- 172.21.15.81:0/536226775 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97580c83e0 con 0x7f9758159cb0 2023-10-07T08:48:27.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.683+0000 7f975ccce700 1 -- 172.21.15.81:0/536226775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97580c83a0 con 0x7f9758159cb0 2023-10-07T08:48:27.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.683+0000 7f973f7fe700 1 -- 172.21.15.81:0/536226775 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9750053830 con 0x7f9758159cb0 2023-10-07T08:48:27.685 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:48:27.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.685+0000 7f975ccce700 1 -- 172.21.15.81:0/536226775 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9744066f30 msgr2=0x7f97440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.685+0000 7f975ccce700 1 --2- 172.21.15.81:0/536226775 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9744066f30 0x7f97440693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9748007560 tx=0x7f9748009760 comp rx=0 tx=0).stop 2023-10-07T08:48:27.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.685+0000 7f975ccce700 1 -- 172.21.15.81:0/536226775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9758159cb0 msgr2=0x7f97580c6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.685+0000 7f975ccce700 1 --2- 172.21.15.81:0/536226775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9758159cb0 0x7f97580c6f80 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f97500093f0 tx=0x7f9750016000 comp rx=0 tx=0).stop 2023-10-07T08:48:27.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.685+0000 7f975ccce700 1 -- 172.21.15.81:0/536226775 shutdown_connections 2023-10-07T08:48:27.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.685+0000 7f975ccce700 1 --2- 172.21.15.81:0/536226775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9758159cb0 0x7f97580c6f80 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.685+0000 7f975ccce700 1 --2- 172.21.15.81:0/536226775 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9744066f30 0x7f97440693e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.685+0000 7f975ccce700 1 --2- 172.21.15.81:0/536226775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f975806e4e0 0x7f97580c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.685+0000 7f975ccce700 1 --2- 172.21.15.81:0/536226775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97580cf080 0x7f97580c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.685+0000 7f975ccce700 1 -- 172.21.15.81:0/536226775 >> 172.21.15.81:0/536226775 conn(0x7f9758068110 msgr2=0x7f97580b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:27.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.685+0000 7f975ccce700 1 -- 172.21.15.81:0/536226775 shutdown_connections 2023-10-07T08:48:27.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.685+0000 7f975ccce700 1 -- 172.21.15.81:0/536226775 wait complete. 2023-10-07T08:48:27.698 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:48:27.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.810+0000 7f0781421700 1 Processor -- start 2023-10-07T08:48:27.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.811+0000 7f0781421700 1 -- start start 2023-10-07T08:48:27.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.811+0000 7f0781421700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f077c157fe0 0x7f077c0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.811+0000 7f0781421700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f077c0cf240 0x7f077c0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.811+0000 7f0781421700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0b2890 con 0x7f077c1583b0 2023-10-07T08:48:27.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.811+0000 7f0781421700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c0b4070 con 0x7f077c0cf240 2023-10-07T08:48:27.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.811+0000 7f0781421700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0b4350 con 0x7f077c157fe0 2023-10-07T08:48:27.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.812+0000 7f07727fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f077c1583b0 0x7f077c0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35476/0 (socket says 172.21.15.81:35476) 2023-10-07T08:48:27.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.812+0000 7f07727fc700 1 -- 172.21.15.81:0/4182614232 learned_addr learned my addr 172.21.15.81:0/4182614232 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:27.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.812+0000 7f077affd700 1 --2- 172.21.15.81:0/4182614232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f077c157fe0 0x7f077c0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.812+0000 7f077b7fe700 1 --2- 172.21.15.81:0/4182614232 >> v2:172.21.15.89:3300/0 conn(0x7f077c0cf240 0x7f077c0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.812+0000 7f077a7fc700 1 -- 172.21.15.81:0/4182614232 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243394204 0 0) 0x7f077c0b2890 con 0x7f077c1583b0 2023-10-07T08:48:27.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.812+0000 7f077a7fc700 1 -- 172.21.15.81:0/4182614232 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0768003570 con 0x7f077c1583b0 2023-10-07T08:48:27.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.812+0000 7f077affd700 1 -- 172.21.15.81:0/4182614232 >> v2:172.21.15.89:3300/0 conn(0x7f077c0cf240 msgr2=0x7f077c0b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:27.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.812+0000 7f077affd700 1 --2- 172.21.15.81:0/4182614232 >> v2:172.21.15.89:3300/0 conn(0x7f077c0cf240 0x7f077c0b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.812+0000 7f077affd700 1 -- 172.21.15.81:0/4182614232 >> v1:172.21.15.81:6789/0 conn(0x7f077c1583b0 legacy=0x7f077c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.812+0000 7f077affd700 1 -- 172.21.15.81:0/4182614232 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0b4630 con 0x7f077c157fe0 2023-10-07T08:48:27.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.812+0000 7f077b7fe700 1 --2- 172.21.15.81:0/4182614232 >> v2:172.21.15.89:3300/0 conn(0x7f077c0cf240 0x7f077c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:48:27.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.812+0000 7f077affd700 1 --2- 172.21.15.81:0/4182614232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f077c157fe0 0x7f077c0b34c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f076c0098e0 tx=0x7f076c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6240b01300ce4b85 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:27.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.812+0000 7f077a7fc700 1 -- 172.21.15.81:0/4182614232 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c011630 con 0x7f077c157fe0 2023-10-07T08:48:27.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.812+0000 7f077a7fc700 1 -- 172.21.15.81:0/4182614232 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c011790 con 0x7f077c157fe0 2023-10-07T08:48:27.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.812+0000 7f077a7fc700 1 -- 172.21.15.81:0/4182614232 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c011b30 con 0x7f077c157fe0 2023-10-07T08:48:27.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.813+0000 7f0781421700 1 -- 172.21.15.81:0/4182614232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f077c157fe0 msgr2=0x7f077c0b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.813+0000 7f0781421700 1 --2- 172.21.15.81:0/4182614232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f077c157fe0 0x7f077c0b34c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f076c0098e0 tx=0x7f076c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.813+0000 7f0781421700 1 -- 172.21.15.81:0/4182614232 shutdown_connections 2023-10-07T08:48:27.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.813+0000 7f0781421700 1 --2- 172.21.15.81:0/4182614232 >> v2:172.21.15.89:3300/0 conn(0x7f077c0cf240 0x7f077c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.813+0000 7f0781421700 1 --2- 172.21.15.81:0/4182614232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f077c157fe0 0x7f077c0b34c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.813+0000 7f0781421700 1 -- 172.21.15.81:0/4182614232 >> 172.21.15.81:0/4182614232 conn(0x7f077c067640 msgr2=0x7f077c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:27.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.813+0000 7f0781421700 1 -- 172.21.15.81:0/4182614232 shutdown_connections 2023-10-07T08:48:27.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.813+0000 7f0781421700 1 -- 172.21.15.81:0/4182614232 wait complete. 2023-10-07T08:48:27.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.814+0000 7f0781421700 1 Processor -- start 2023-10-07T08:48:27.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.814+0000 7f0781421700 1 -- start start 2023-10-07T08:48:27.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f0781421700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f077c0cf240 0x7f077c14ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f0781421700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f077c157fe0 0x7f077c152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f0781421700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f077c1583b0 0x7f077c154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f0781421700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c153110 con 0x7f077c0cf240 2023-10-07T08:48:27.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f0781421700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c14f690 con 0x7f077c157fe0 2023-10-07T08:48:27.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f0781421700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c1536f0 con 0x7f077c1583b0 2023-10-07T08:48:27.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f077affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f077c0cf240 0x7f077c14ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f077affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f077c0cf240 0x7f077c14ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57052/0 (socket says 172.21.15.81:57052) 2023-10-07T08:48:27.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f077affd700 1 -- 172.21.15.81:0/2407491283 learned_addr learned my addr 172.21.15.81:0/2407491283 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:27.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f07727fc700 1 --2- 172.21.15.81:0/2407491283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f077c157fe0 0x7f077c152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f077b7fe700 1 --2- 172.21.15.81:0/2407491283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f077c1583b0 0x7f077c154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f077affd700 1 -- 172.21.15.81:0/2407491283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f077c1583b0 msgr2=0x7f077c154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f077affd700 1 --2- 172.21.15.81:0/2407491283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f077c1583b0 0x7f077c154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f077affd700 1 -- 172.21.15.81:0/2407491283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f077c157fe0 msgr2=0x7f077c152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:27.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f077affd700 1 --2- 172.21.15.81:0/2407491283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f077c157fe0 0x7f077c152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:27.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f077affd700 1 -- 172.21.15.81:0/2407491283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0774009a20 con 0x7f077c0cf240 2023-10-07T08:48:27.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.815+0000 7f07727fc700 1 --2- 172.21.15.81:0/2407491283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f077c157fe0 0x7f077c152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:27.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.816+0000 7f077affd700 1 --2- 172.21.15.81:0/2407491283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f077c0cf240 0x7f077c14ad80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f076c009ed0 tx=0x7f076c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:27.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.816+0000 7f07737fe700 1 -- 172.21.15.81:0/2407491283 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c011b10 con 0x7f077c0cf240 2023-10-07T08:48:27.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.816+0000 7f07737fe700 1 -- 172.21.15.81:0/2407491283 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c006af0 con 0x7f077c0cf240 2023-10-07T08:48:27.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.816+0000 7f07737fe700 1 -- 172.21.15.81:0/2407491283 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c025640 con 0x7f077c0cf240 2023-10-07T08:48:27.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.816+0000 7f0781421700 1 -- 172.21.15.81:0/2407491283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076c009420 con 0x7f077c0cf240 2023-10-07T08:48:27.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.816+0000 7f0781421700 1 -- 172.21.15.81:0/2407491283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c16c1d0 con 0x7f077c0cf240 2023-10-07T08:48:27.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.817+0000 7f0781421700 1 -- 172.21.15.81:0/2407491283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c069e40 con 0x7f077c0cf240 2023-10-07T08:48:27.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.817+0000 7f07737fe700 1 -- 172.21.15.81:0/2407491283 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f076c025a70 con 0x7f077c0cf240 2023-10-07T08:48:27.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.817+0000 7f07737fe700 1 --2- 172.21.15.81:0/2407491283 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f075c066f30 0x7f075c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:27.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.817+0000 7f07737fe700 1 -- 172.21.15.81:0/2407491283 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f076c085bd0 con 0x7f077c0cf240 2023-10-07T08:48:27.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.817+0000 7f07727fc700 1 --2- 172.21.15.81:0/2407491283 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f075c066f30 0x7f075c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:27.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.818+0000 7f07727fc700 1 --2- 172.21.15.81:0/2407491283 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f075c066f30 0x7f075c0693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f077c156f90 tx=0x7f0764009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:27.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:27.822+0000 7f07737fe700 1 -- 172.21.15.81:0/2407491283 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f076c052f00 con 0x7f077c0cf240 2023-10-07T08:48:28.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.042+0000 7f0781421700 1 -- 172.21.15.81:0/2407491283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f077c0cc6b0 con 0x7f077c0cf240 2023-10-07T08:48:28.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.043+0000 7f07737fe700 1 -- 172.21.15.81:0/2407491283 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f076c015090 con 0x7f077c0cf240 2023-10-07T08:48:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:28.045 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1015639142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1015639142},{"type":"v1","addr":"172.21.15.89:6833","nonce":1015639142}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2650972762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2650972762},{"type":"v1","addr":"172.21.15.89:6835","nonce":2650972762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2058286084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2058286084},{"type":"v1","addr":"172.21.15.81:6836","nonce":2058286084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:47:49.671409+0000","modified":"2023-10-07T08:47:53.341944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6837/3696879604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3696879604},{"type":"v1","addr":"172.21.15.81:6837","nonce":3696879604}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-07T08:48:28.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.045+0000 7f0781421700 1 -- 172.21.15.81:0/2407491283 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f075c066f30 msgr2=0x7f075c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.045+0000 7f0781421700 1 --2- 172.21.15.81:0/2407491283 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f075c066f30 0x7f075c0693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f077c156f90 tx=0x7f0764009040 comp rx=0 tx=0).stop 2023-10-07T08:48:28.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.045+0000 7f0781421700 1 -- 172.21.15.81:0/2407491283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f077c0cf240 msgr2=0x7f077c14ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.045+0000 7f0781421700 1 --2- 172.21.15.81:0/2407491283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f077c0cf240 0x7f077c14ad80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f076c009ed0 tx=0x7f076c017000 comp rx=0 tx=0).stop 2023-10-07T08:48:28.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.045+0000 7f0781421700 1 -- 172.21.15.81:0/2407491283 shutdown_connections 2023-10-07T08:48:28.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.045+0000 7f0781421700 1 --2- 172.21.15.81:0/2407491283 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f075c066f30 0x7f075c0693e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.045+0000 7f0781421700 1 --2- 172.21.15.81:0/2407491283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f077c1583b0 0x7f077c154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.045+0000 7f0781421700 1 --2- 172.21.15.81:0/2407491283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f077c0cf240 0x7f077c14ad80 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.045+0000 7f0781421700 1 --2- 172.21.15.81:0/2407491283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f077c157fe0 0x7f077c152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.045+0000 7f0781421700 1 -- 172.21.15.81:0/2407491283 >> 172.21.15.81:0/2407491283 conn(0x7f077c067640 msgr2=0x7f077c0cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:28.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.045+0000 7f0781421700 1 -- 172.21.15.81:0/2407491283 shutdown_connections 2023-10-07T08:48:28.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.045+0000 7f0781421700 1 -- 172.21.15.81:0/2407491283 wait complete. 2023-10-07T08:48:28.049 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 50 2023-10-07T08:48:28.058 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:48:28.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.170+0000 7ff1056bf700 1 Processor -- start 2023-10-07T08:48:28.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.170+0000 7ff1056bf700 1 -- start start 2023-10-07T08:48:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.171+0000 7ff1056bf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff100069440 0x7ff1000698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.171+0000 7ff1056bf700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1000cb880 con 0x7ff1000c71d0 2023-10-07T08:48:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.171+0000 7ff1056bf700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1000cac70 con 0x7ff100156420 2023-10-07T08:48:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.171+0000 7ff1056bf700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10006aa10 con 0x7ff100069440 2023-10-07T08:48:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.171+0000 7ff0ff7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff1000c71d0 0x7ff1000c1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35490/0 (socket says 172.21.15.81:35490) 2023-10-07T08:48:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.171+0000 7ff0ff7fe700 1 -- 172.21.15.81:0/1426034785 learned_addr learned my addr 172.21.15.81:0/1426034785 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.171+0000 7ff0fe7fc700 1 --2- 172.21.15.81:0/1426034785 >> v2:172.21.15.89:3300/0 conn(0x7ff100069440 0x7ff1000698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.171+0000 7ff0fdffb700 1 -- 172.21.15.81:0/1426034785 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120103391 0 0) 0x7ff1000cb880 con 0x7ff1000c71d0 2023-10-07T08:48:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.172+0000 7ff0fdffb700 1 -- 172.21.15.81:0/1426034785 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e8003570 con 0x7ff1000c71d0 2023-10-07T08:48:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.172+0000 7ff0fdffb700 1 -- 172.21.15.81:0/1426034785 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587398360 0 0) 0x7ff1000cac70 con 0x7ff100156420 2023-10-07T08:48:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.172+0000 7ff0fdffb700 1 -- 172.21.15.81:0/1426034785 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1000cb880 con 0x7ff100156420 2023-10-07T08:48:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.172+0000 7ff0fe7fc700 1 -- 172.21.15.81:0/1426034785 >> v1:172.21.15.89:6789/0 conn(0x7ff100156420 legacy=0x7ff1000cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.172+0000 7ff0fdffb700 1 -- 172.21.15.81:0/1426034785 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3661904075 0 0) 0x7ff0e8003570 con 0x7ff1000c71d0 2023-10-07T08:48:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.172+0000 7ff0fe7fc700 1 -- 172.21.15.81:0/1426034785 >> v1:172.21.15.81:6789/0 conn(0x7ff1000c71d0 legacy=0x7ff1000c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.172+0000 7ff0fe7fc700 1 -- 172.21.15.81:0/1426034785 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1000caf50 con 0x7ff100069440 2023-10-07T08:48:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.172+0000 7ff0fe7fc700 1 --2- 172.21.15.81:0/1426034785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff100069440 0x7ff1000698b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40098e0 tx=0x7ff0f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85385fe0db5dec96 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.172+0000 7ff0fdffb700 1 -- 172.21.15.81:0/1426034785 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8001470 con 0x7ff100069440 2023-10-07T08:48:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.172+0000 7ff0fdffb700 1 -- 172.21.15.81:0/1426034785 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f4011420 con 0x7ff100069440 2023-10-07T08:48:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.172+0000 7ff0fdffb700 1 -- 172.21.15.81:0/1426034785 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f40117a0 con 0x7ff100069440 2023-10-07T08:48:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.173+0000 7ff1056bf700 1 -- 172.21.15.81:0/1426034785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff100069440 msgr2=0x7ff1000698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.173+0000 7ff1056bf700 1 --2- 172.21.15.81:0/1426034785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff100069440 0x7ff1000698b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40098e0 tx=0x7ff0f40091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.173+0000 7ff1056bf700 1 -- 172.21.15.81:0/1426034785 shutdown_connections 2023-10-07T08:48:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.173+0000 7ff1056bf700 1 --2- 172.21.15.81:0/1426034785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff100069440 0x7ff1000698b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.173+0000 7ff1056bf700 1 -- 172.21.15.81:0/1426034785 >> 172.21.15.81:0/1426034785 conn(0x7ff10006c660 msgr2=0x7ff1000cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.173+0000 7ff1056bf700 1 -- 172.21.15.81:0/1426034785 shutdown_connections 2023-10-07T08:48:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.173+0000 7ff1056bf700 1 -- 172.21.15.81:0/1426034785 wait complete. 2023-10-07T08:48:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.174+0000 7ff1056bf700 1 Processor -- start 2023-10-07T08:48:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.174+0000 7ff1056bf700 1 -- start start 2023-10-07T08:48:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff1056bf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100069440 0x7ff100144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff1056bf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1000c71d0 0x7ff100158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff1056bf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff100156420 0x7ff1001586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff1056bf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff100167150 con 0x7ff100069440 2023-10-07T08:48:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff1056bf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff100153070 con 0x7ff100156420 2023-10-07T08:48:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff1056bf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff100153350 con 0x7ff1000c71d0 2023-10-07T08:48:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff0feffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100069440 0x7ff100144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff0feffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100069440 0x7ff100144300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57068/0 (socket says 172.21.15.81:57068) 2023-10-07T08:48:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff0feffd700 1 -- 172.21.15.81:0/3586382077 learned_addr learned my addr 172.21.15.81:0/3586382077 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff0feffd700 1 -- 172.21.15.81:0/3586382077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1000c71d0 msgr2=0x7ff100158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff0feffd700 1 --2- 172.21.15.81:0/3586382077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1000c71d0 0x7ff100158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff0feffd700 1 -- 172.21.15.81:0/3586382077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff100156420 msgr2=0x7ff1001586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff0feffd700 1 --2- 172.21.15.81:0/3586382077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff100156420 0x7ff1001586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff0feffd700 1 -- 172.21.15.81:0/3586382077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f4009420 con 0x7ff100069440 2023-10-07T08:48:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff0feffd700 1 --2- 172.21.15.81:0/3586382077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100069440 0x7ff100144300 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000cb10 tx=0x7ff0f0002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff0e6ffd700 1 -- 172.21.15.81:0/3586382077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000a760 con 0x7ff100069440 2023-10-07T08:48:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff0e6ffd700 1 -- 172.21.15.81:0/3586382077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f000a8c0 con 0x7ff100069440 2023-10-07T08:48:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff1056bf700 1 -- 172.21.15.81:0/3586382077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff100153630 con 0x7ff100069440 2023-10-07T08:48:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff0e6ffd700 1 -- 172.21.15.81:0/3586382077 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000ac60 con 0x7ff100069440 2023-10-07T08:48:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.175+0000 7ff1056bf700 1 -- 172.21.15.81:0/3586382077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff100144840 con 0x7ff100069440 2023-10-07T08:48:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.176+0000 7ff1056bf700 1 -- 172.21.15.81:0/3586382077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff100067bc0 con 0x7ff100069440 2023-10-07T08:48:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.177+0000 7ff0e6ffd700 1 -- 172.21.15.81:0/3586382077 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0f0012630 con 0x7ff100069440 2023-10-07T08:48:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.177+0000 7ff0e6ffd700 1 --2- 172.21.15.81:0/3586382077 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff0ec066f30 0x7ff0ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.177+0000 7ff0fe7fc700 1 --2- 172.21.15.81:0/3586382077 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff0ec066f30 0x7ff0ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.177+0000 7ff0e6ffd700 1 -- 172.21.15.81:0/3586382077 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff0f0084900 con 0x7ff100069440 2023-10-07T08:48:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.177+0000 7ff0fe7fc700 1 --2- 172.21.15.81:0/3586382077 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff0ec066f30 0x7ff0ec0693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff1000b26f0 tx=0x7ff0f4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.181+0000 7ff0e6ffd700 1 -- 172.21.15.81:0/3586382077 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0f0051b70 con 0x7ff100069440 2023-10-07T08:48:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.366+0000 7ff1056bf700 1 -- 172.21.15.81:0/3586382077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1000cb230 con 0x7ff100069440 2023-10-07T08:48:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.367+0000 7ff0e6ffd700 1 -- 172.21.15.81:0/3586382077 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+15317 (secure 0 0 0) 0x7ff0f0055190 con 0x7ff100069440 2023-10-07T08:48:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:28.369 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":111,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:48:22.503045+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:47:47.993754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-07T08:47:48.631797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:48:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.369+0000 7ff1056bf700 1 -- 172.21.15.81:0/3586382077 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff0ec066f30 msgr2=0x7ff0ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.369+0000 7ff1056bf700 1 --2- 172.21.15.81:0/3586382077 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff0ec066f30 0x7ff0ec0693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff1000b26f0 tx=0x7ff0f4016000 comp rx=0 tx=0).stop 2023-10-07T08:48:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.369+0000 7ff1056bf700 1 -- 172.21.15.81:0/3586382077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100069440 msgr2=0x7ff100144300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.369+0000 7ff1056bf700 1 --2- 172.21.15.81:0/3586382077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100069440 0x7ff100144300 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000cb10 tx=0x7ff0f0002820 comp rx=0 tx=0).stop 2023-10-07T08:48:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.369+0000 7ff1056bf700 1 -- 172.21.15.81:0/3586382077 shutdown_connections 2023-10-07T08:48:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.369+0000 7ff1056bf700 1 --2- 172.21.15.81:0/3586382077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff100156420 0x7ff1001586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.369+0000 7ff1056bf700 1 --2- 172.21.15.81:0/3586382077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100069440 0x7ff100144300 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.369+0000 7ff1056bf700 1 --2- 172.21.15.81:0/3586382077 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff0ec066f30 0x7ff0ec0693e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.369+0000 7ff1056bf700 1 --2- 172.21.15.81:0/3586382077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1000c71d0 0x7ff100158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.369+0000 7ff1056bf700 1 -- 172.21.15.81:0/3586382077 >> 172.21.15.81:0/3586382077 conn(0x7ff10006c660 msgr2=0x7ff100068960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.369+0000 7ff1056bf700 1 -- 172.21.15.81:0/3586382077 shutdown_connections 2023-10-07T08:48:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.369+0000 7ff1056bf700 1 -- 172.21.15.81:0/3586382077 wait complete. 2023-10-07T08:48:28.383 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T08:48:28.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:48:28.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.494+0000 7fb8c80d7700 1 Processor -- start 2023-10-07T08:48:28.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.494+0000 7fb8c80d7700 1 -- start start 2023-10-07T08:48:28.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.495+0000 7fb8c80d7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb8c006d830 0x7fb8c00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.495+0000 7fb8c80d7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c00d07c0 con 0x7fb8c01578d0 2023-10-07T08:48:28.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.495+0000 7fb8c80d7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c00cfbb0 con 0x7fb8c0157ca0 2023-10-07T08:48:28.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.495+0000 7fb8c80d7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c00cfe90 con 0x7fb8c006d830 2023-10-07T08:48:28.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.495+0000 7fb8c6674700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb8c006d830 0x7fb8c00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:28.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.495+0000 7fb8c5e73700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb8c01578d0 0x7fb8c015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35504/0 (socket says 172.21.15.81:35504) 2023-10-07T08:48:28.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.495+0000 7fb8c5e73700 1 -- 172.21.15.81:0/3007107734 learned_addr learned my addr 172.21.15.81:0/3007107734 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:28.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.496+0000 7fb8c6674700 1 -- 172.21.15.81:0/3007107734 >> v1:172.21.15.89:6789/0 conn(0x7fb8c0157ca0 legacy=0x7fb8c006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.496+0000 7fb8c6674700 1 -- 172.21.15.81:0/3007107734 >> v1:172.21.15.81:6789/0 conn(0x7fb8c01578d0 legacy=0x7fb8c015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.496+0000 7fb8c6674700 1 -- 172.21.15.81:0/3007107734 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c00d0170 con 0x7fb8c006d830 2023-10-07T08:48:28.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.496+0000 7fb8c4e71700 1 -- 172.21.15.81:0/3007107734 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224062666 0 0) 0x7fb8c00d07c0 con 0x7fb8c01578d0 2023-10-07T08:48:28.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.496+0000 7fb8c6674700 1 --2- 172.21.15.81:0/3007107734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c006d830 0x7fb8c00cf4f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80098e0 tx=0x7fb8b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5809d7d37c4afe8a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:28.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.496+0000 7fb8c4e71700 1 -- 172.21.15.81:0/3007107734 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8009e80 con 0x7fb8c006d830 2023-10-07T08:48:28.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.496+0000 7fb8c4e71700 1 -- 172.21.15.81:0/3007107734 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b800b860 con 0x7fb8c006d830 2023-10-07T08:48:28.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.496+0000 7fb8c4e71700 1 -- 172.21.15.81:0/3007107734 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b800bbe0 con 0x7fb8c006d830 2023-10-07T08:48:28.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.496+0000 7fb8c80d7700 1 -- 172.21.15.81:0/3007107734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c006d830 msgr2=0x7fb8c00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.496+0000 7fb8c80d7700 1 --2- 172.21.15.81:0/3007107734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c006d830 0x7fb8c00cf4f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80098e0 tx=0x7fb8b80091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.496+0000 7fb8c80d7700 1 -- 172.21.15.81:0/3007107734 shutdown_connections 2023-10-07T08:48:28.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.496+0000 7fb8c80d7700 1 --2- 172.21.15.81:0/3007107734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c006d830 0x7fb8c00cf4f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.496+0000 7fb8c80d7700 1 -- 172.21.15.81:0/3007107734 >> 172.21.15.81:0/3007107734 conn(0x7fb8c006bb90 msgr2=0x7fb8c006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:28.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.496+0000 7fb8c80d7700 1 -- 172.21.15.81:0/3007107734 shutdown_connections 2023-10-07T08:48:28.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.496+0000 7fb8c80d7700 1 -- 172.21.15.81:0/3007107734 wait complete. 2023-10-07T08:48:28.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.497+0000 7fb8c80d7700 1 Processor -- start 2023-10-07T08:48:28.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.498+0000 7fb8c80d7700 1 -- start start 2023-10-07T08:48:28.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.498+0000 7fb8c80d7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8c006d830 0x7fb8c0154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.498+0000 7fb8c80d7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c01578d0 0x7fb8c00b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.498+0000 7fb8c80d7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c0157ca0 0x7fb8c00ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.498+0000 7fb8c80d7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c016a210 con 0x7fb8c0157ca0 2023-10-07T08:48:28.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.498+0000 7fb8c80d7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c01550c0 con 0x7fb8c01578d0 2023-10-07T08:48:28.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.498+0000 7fb8c80d7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00b4ee0 con 0x7fb8c006d830 2023-10-07T08:48:28.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.498+0000 7fb8c6674700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c0157ca0 0x7fb8c00ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:28.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.498+0000 7fb8c6674700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c0157ca0 0x7fb8c00ac0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57076/0 (socket says 172.21.15.81:57076) 2023-10-07T08:48:28.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.498+0000 7fb8c6674700 1 -- 172.21.15.81:0/1531232360 learned_addr learned my addr 172.21.15.81:0/1531232360 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:28.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.499+0000 7fb8c6674700 1 -- 172.21.15.81:0/1531232360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8c006d830 msgr2=0x7fb8c0154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.499+0000 7fb8c6674700 1 --2- 172.21.15.81:0/1531232360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8c006d830 0x7fb8c0154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.499+0000 7fb8c6674700 1 -- 172.21.15.81:0/1531232360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c01578d0 msgr2=0x7fb8c00b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.499+0000 7fb8c6674700 1 --2- 172.21.15.81:0/1531232360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c01578d0 0x7fb8c00b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.499+0000 7fb8c6674700 1 -- 172.21.15.81:0/1531232360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b8009420 con 0x7fb8c0157ca0 2023-10-07T08:48:28.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.499+0000 7fb8c6674700 1 --2- 172.21.15.81:0/1531232360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c0157ca0 0x7fb8c00ac0b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb8c006fe20 tx=0x7fb8b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:28.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.499+0000 7fb8b5ffb700 1 -- 172.21.15.81:0/1531232360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b801f070 con 0x7fb8c0157ca0 2023-10-07T08:48:28.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.499+0000 7fb8b5ffb700 1 -- 172.21.15.81:0/1531232360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b800baa0 con 0x7fb8c0157ca0 2023-10-07T08:48:28.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.499+0000 7fb8b5ffb700 1 -- 172.21.15.81:0/1531232360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8025670 con 0x7fb8c0157ca0 2023-10-07T08:48:28.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.499+0000 7fb8c80d7700 1 -- 172.21.15.81:0/1531232360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c00b51c0 con 0x7fb8c0157ca0 2023-10-07T08:48:28.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.499+0000 7fb8c80d7700 1 -- 172.21.15.81:0/1531232360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c00b5780 con 0x7fb8c0157ca0 2023-10-07T08:48:28.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.500+0000 7fb8c80d7700 1 -- 172.21.15.81:0/1531232360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c0067ac0 con 0x7fb8c0157ca0 2023-10-07T08:48:28.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.500+0000 7fb8b5ffb700 1 -- 172.21.15.81:0/1531232360 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8b8023070 con 0x7fb8c0157ca0 2023-10-07T08:48:28.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.501+0000 7fb8b5ffb700 1 --2- 172.21.15.81:0/1531232360 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb8a4066f30 0x7fb8a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.501+0000 7fb8b5ffb700 1 -- 172.21.15.81:0/1531232360 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb8b8085d90 con 0x7fb8c0157ca0 2023-10-07T08:48:28.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.501+0000 7fb8c5e73700 1 --2- 172.21.15.81:0/1531232360 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb8a4066f30 0x7fb8a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:28.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.501+0000 7fb8c5e73700 1 --2- 172.21.15.81:0/1531232360 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb8a4066f30 0x7fb8a40693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc001560 tx=0x7fb8bc0016c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:28.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.505+0000 7fb8b5ffb700 1 -- 172.21.15.81:0/1531232360 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8b8053040 con 0x7fb8c0157ca0 2023-10-07T08:48:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.729+0000 7fb8c80d7700 1 -- 172.21.15.81:0/1531232360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8c016a350 con 0x7fb8c0157ca0 2023-10-07T08:48:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.730+0000 7fb8b5ffb700 1 -- 172.21.15.81:0/1531232360 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fb8b8056620 con 0x7fb8c0157ca0 2023-10-07T08:48:28.731 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:28.731 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1015639142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1015639142},{"type":"v1","addr":"172.21.15.89:6833","nonce":1015639142}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2650972762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2650972762},{"type":"v1","addr":"172.21.15.89:6835","nonce":2650972762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2058286084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2058286084},{"type":"v1","addr":"172.21.15.81:6836","nonce":2058286084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:47:49.671409+0000","modified":"2023-10-07T08:47:53.341944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6837/3696879604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3696879604},{"type":"v1","addr":"172.21.15.81:6837","nonce":3696879604}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-07T08:48:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.731+0000 7fb8c80d7700 1 -- 172.21.15.81:0/1531232360 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb8a4066f30 msgr2=0x7fb8a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.731+0000 7fb8c80d7700 1 --2- 172.21.15.81:0/1531232360 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb8a4066f30 0x7fb8a40693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc001560 tx=0x7fb8bc0016c0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.731+0000 7fb8c80d7700 1 -- 172.21.15.81:0/1531232360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c0157ca0 msgr2=0x7fb8c00ac0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.731+0000 7fb8c80d7700 1 --2- 172.21.15.81:0/1531232360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c0157ca0 0x7fb8c00ac0b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb8c006fe20 tx=0x7fb8b8017000 comp rx=0 tx=0).stop 2023-10-07T08:48:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.731+0000 7fb8c80d7700 1 -- 172.21.15.81:0/1531232360 shutdown_connections 2023-10-07T08:48:28.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.732+0000 7fb8c80d7700 1 --2- 172.21.15.81:0/1531232360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c0157ca0 0x7fb8c00ac0b0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.732+0000 7fb8c80d7700 1 --2- 172.21.15.81:0/1531232360 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb8a4066f30 0x7fb8a40693e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.732+0000 7fb8c80d7700 1 --2- 172.21.15.81:0/1531232360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8c006d830 0x7fb8c0154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.732+0000 7fb8c80d7700 1 --2- 172.21.15.81:0/1531232360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c01578d0 0x7fb8c00b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.732+0000 7fb8c80d7700 1 -- 172.21.15.81:0/1531232360 >> 172.21.15.81:0/1531232360 conn(0x7fb8c006bb90 msgr2=0x7fb8c0156980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:28.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.732+0000 7fb8c80d7700 1 -- 172.21.15.81:0/1531232360 shutdown_connections 2023-10-07T08:48:28.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.732+0000 7fb8c80d7700 1 -- 172.21.15.81:0/1531232360 wait complete. 2023-10-07T08:48:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 50 2023-10-07T08:48:28.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:48:28.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.857+0000 7f724592e700 1 Processor -- start 2023-10-07T08:48:28.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.857+0000 7f724592e700 1 -- start start 2023-10-07T08:48:28.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.858+0000 7f724592e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72400ce1f0 0x7f72400aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.858+0000 7f724592e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72400ce5c0 0x7f724015e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.858+0000 7f724592e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f72400ac570 0x7f724006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.858+0000 7f724592e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f724015dfb0 con 0x7f72400ce5c0 2023-10-07T08:48:28.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.858+0000 7f724592e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72400acec0 con 0x7f72400ac570 2023-10-07T08:48:28.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.858+0000 7f724592e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72400ad1a0 con 0x7f72400ce1f0 2023-10-07T08:48:28.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.858+0000 7f72367fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72400ce5c0 0x7f724015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:28.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.858+0000 7f72367fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72400ce5c0 0x7f724015e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57080/0 (socket says 172.21.15.81:57080) 2023-10-07T08:48:28.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.858+0000 7f72367fc700 1 -- 172.21.15.81:0/1809803987 learned_addr learned my addr 172.21.15.81:0/1809803987 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:28.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.859+0000 7f723f7fe700 1 --2- 172.21.15.81:0/1809803987 >> v2:172.21.15.89:3300/0 conn(0x7f72400ac570 0x7f724006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:28.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.859+0000 7f723effd700 1 --2- 172.21.15.81:0/1809803987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72400ce1f0 0x7f72400aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:28.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.859+0000 7f72367fc700 1 -- 172.21.15.81:0/1809803987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72400ce1f0 msgr2=0x7f72400aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:28.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.859+0000 7f72367fc700 1 --2- 172.21.15.81:0/1809803987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72400ce1f0 0x7f72400aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.859+0000 7f72367fc700 1 -- 172.21.15.81:0/1809803987 >> v2:172.21.15.89:3300/0 conn(0x7f72400ac570 msgr2=0x7f724006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:28.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.859+0000 7f72367fc700 1 --2- 172.21.15.81:0/1809803987 >> v2:172.21.15.89:3300/0 conn(0x7f72400ac570 0x7f724006e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.859+0000 7f72367fc700 1 -- 172.21.15.81:0/1809803987 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724015dc40 con 0x7f72400ce5c0 2023-10-07T08:48:28.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.859+0000 7f723effd700 1 --2- 172.21.15.81:0/1809803987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72400ce1f0 0x7f72400aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:28.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.859+0000 7f72367fc700 1 --2- 172.21.15.81:0/1809803987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72400ce5c0 0x7f724015e440 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f72400695d0 tx=0x7f7228009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd88ce5b0b32f39 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:28.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.859+0000 7f723e7fc700 1 -- 172.21.15.81:0/1809803987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722800b860 con 0x7f72400ce5c0 2023-10-07T08:48:28.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.859+0000 7f723e7fc700 1 -- 172.21.15.81:0/1809803987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722800b9c0 con 0x7f72400ce5c0 2023-10-07T08:48:28.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.859+0000 7f723e7fc700 1 -- 172.21.15.81:0/1809803987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722800bd60 con 0x7f72400ce5c0 2023-10-07T08:48:28.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.859+0000 7f724592e700 1 -- 172.21.15.81:0/1809803987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72400ce5c0 msgr2=0x7f724015e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.859+0000 7f724592e700 1 --2- 172.21.15.81:0/1809803987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72400ce5c0 0x7f724015e440 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f72400695d0 tx=0x7f7228009250 comp rx=0 tx=0).stop 2023-10-07T08:48:28.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.860+0000 7f724592e700 1 -- 172.21.15.81:0/1809803987 shutdown_connections 2023-10-07T08:48:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.860+0000 7f724592e700 1 --2- 172.21.15.81:0/1809803987 >> v2:172.21.15.89:3300/0 conn(0x7f72400ac570 0x7f724006e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.860+0000 7f724592e700 1 --2- 172.21.15.81:0/1809803987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72400ce1f0 0x7f72400aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.860+0000 7f724592e700 1 --2- 172.21.15.81:0/1809803987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72400ce5c0 0x7f724015e440 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.860+0000 7f724592e700 1 -- 172.21.15.81:0/1809803987 >> 172.21.15.81:0/1809803987 conn(0x7f724006cca0 msgr2=0x7f724006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.860+0000 7f724592e700 1 -- 172.21.15.81:0/1809803987 shutdown_connections 2023-10-07T08:48:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.860+0000 7f724592e700 1 -- 172.21.15.81:0/1809803987 wait complete. 2023-10-07T08:48:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.861+0000 7f724592e700 1 Processor -- start 2023-10-07T08:48:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.861+0000 7f724592e700 1 -- start start 2023-10-07T08:48:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f724592e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72400ac570 0x7f72400afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f724592e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72400ce1f0 0x7f72401556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f724592e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72400ce5c0 0x7f7240155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f724592e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7240156150 con 0x7f72400ce5c0 2023-10-07T08:48:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f724592e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724015b7e0 con 0x7f72400ce1f0 2023-10-07T08:48:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f724592e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724016e780 con 0x7f72400ac570 2023-10-07T08:48:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f723f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72400ce5c0 0x7f7240155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f723f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72400ce5c0 0x7f7240155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57088/0 (socket says 172.21.15.81:57088) 2023-10-07T08:48:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f723f7fe700 1 -- 172.21.15.81:0/3044602409 learned_addr learned my addr 172.21.15.81:0/3044602409 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f72367fc700 1 --2- 172.21.15.81:0/3044602409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72400ce1f0 0x7f72401556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f723effd700 1 --2- 172.21.15.81:0/3044602409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72400ac570 0x7f72400afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f723f7fe700 1 -- 172.21.15.81:0/3044602409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72400ac570 msgr2=0x7f72400afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f723f7fe700 1 --2- 172.21.15.81:0/3044602409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72400ac570 0x7f72400afcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f723f7fe700 1 -- 172.21.15.81:0/3044602409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72400ce1f0 msgr2=0x7f72401556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f723f7fe700 1 --2- 172.21.15.81:0/3044602409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72400ce1f0 0x7f72401556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f723f7fe700 1 -- 172.21.15.81:0/3044602409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72280094f0 con 0x7f72400ce5c0 2023-10-07T08:48:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f723f7fe700 1 --2- 172.21.15.81:0/3044602409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72400ce5c0 0x7f7240155c10 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7238007f50 tx=0x7f7238009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f72377fe700 1 -- 172.21.15.81:0/3044602409 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723800eb70 con 0x7f72400ce5c0 2023-10-07T08:48:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f72377fe700 1 -- 172.21.15.81:0/3044602409 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723800ecf0 con 0x7f72400ce5c0 2023-10-07T08:48:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f72377fe700 1 -- 172.21.15.81:0/3044602409 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7238014670 con 0x7f72400ce5c0 2023-10-07T08:48:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f724592e700 1 -- 172.21.15.81:0/3044602409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724015ba30 con 0x7f72400ce5c0 2023-10-07T08:48:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.862+0000 7f724592e700 1 -- 172.21.15.81:0/3044602409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724015bff0 con 0x7f72400ce5c0 2023-10-07T08:48:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.863+0000 7f724592e700 1 -- 172.21.15.81:0/3044602409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72400ab2b0 con 0x7f72400ce5c0 2023-10-07T08:48:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.864+0000 7f72377fe700 1 -- 172.21.15.81:0/3044602409 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72380149e0 con 0x7f72400ce5c0 2023-10-07T08:48:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.864+0000 7f72377fe700 1 --2- 172.21.15.81:0/3044602409 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7220066f30 0x7f72200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.864+0000 7f72377fe700 1 -- 172.21.15.81:0/3044602409 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7238084b20 con 0x7f72400ce5c0 2023-10-07T08:48:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.864+0000 7f723effd700 1 --2- 172.21.15.81:0/3044602409 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7220066f30 0x7f72200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.864+0000 7f723effd700 1 --2- 172.21.15.81:0/3044602409 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7220066f30 0x7f72200693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f723000adc0 tx=0x7f7230006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:28.868+0000 7f72377fe700 1 -- 172.21.15.81:0/3044602409 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7238051d90 con 0x7f72400ce5c0 2023-10-07T08:48:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.091+0000 7f724592e700 1 -- 172.21.15.81:0/3044602409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f724015c1e0 con 0x7f72400ce5c0 2023-10-07T08:48:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.091+0000 7f72377fe700 1 -- 172.21.15.81:0/3044602409 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f72380553b0 con 0x7f72400ce5c0 2023-10-07T08:48:29.093 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:29.093 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1015639142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1015639142},{"type":"v1","addr":"172.21.15.89:6833","nonce":1015639142}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2650972762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2650972762},{"type":"v1","addr":"172.21.15.89:6835","nonce":2650972762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2058286084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2058286084},{"type":"v1","addr":"172.21.15.81:6836","nonce":2058286084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:47:49.671409+0000","modified":"2023-10-07T08:47:53.341944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6837/3696879604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3696879604},{"type":"v1","addr":"172.21.15.81:6837","nonce":3696879604}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-07T08:48:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.093+0000 7f724592e700 1 -- 172.21.15.81:0/3044602409 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7220066f30 msgr2=0x7f72200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.093+0000 7f724592e700 1 --2- 172.21.15.81:0/3044602409 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7220066f30 0x7f72200693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f723000adc0 tx=0x7f7230006f90 comp rx=0 tx=0).stop 2023-10-07T08:48:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.093+0000 7f724592e700 1 -- 172.21.15.81:0/3044602409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72400ce5c0 msgr2=0x7f7240155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.093+0000 7f724592e700 1 --2- 172.21.15.81:0/3044602409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72400ce5c0 0x7f7240155c10 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7238007f50 tx=0x7f7238009860 comp rx=0 tx=0).stop 2023-10-07T08:48:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.093+0000 7f724592e700 1 -- 172.21.15.81:0/3044602409 shutdown_connections 2023-10-07T08:48:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.093+0000 7f724592e700 1 --2- 172.21.15.81:0/3044602409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72400ce5c0 0x7f7240155c10 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.093+0000 7f724592e700 1 --2- 172.21.15.81:0/3044602409 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7220066f30 0x7f72200693e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.093+0000 7f724592e700 1 --2- 172.21.15.81:0/3044602409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72400ac570 0x7f72400afcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.093+0000 7f724592e700 1 --2- 172.21.15.81:0/3044602409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72400ce1f0 0x7f72401556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.093+0000 7f724592e700 1 -- 172.21.15.81:0/3044602409 >> 172.21.15.81:0/3044602409 conn(0x7f724006cca0 msgr2=0x7f72401571b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.093+0000 7f724592e700 1 -- 172.21.15.81:0/3044602409 shutdown_connections 2023-10-07T08:48:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.093+0000 7f724592e700 1 -- 172.21.15.81:0/3044602409 wait complete. 2023-10-07T08:48:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 50 2023-10-07T08:48:29.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:48:29.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.219+0000 7f976c127700 1 Processor -- start 2023-10-07T08:48:29.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.219+0000 7f976c127700 1 -- start start 2023-10-07T08:48:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.220+0000 7f976c127700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97641578d0 0x7f97640cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.220+0000 7f976c127700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97640d07c0 con 0x7f9764157ca0 2023-10-07T08:48:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.220+0000 7f976c127700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97640cfbb0 con 0x7f976406d120 2023-10-07T08:48:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.220+0000 7f976c127700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97640cfe90 con 0x7f97641578d0 2023-10-07T08:48:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.220+0000 7f9769ec3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97641578d0 0x7f97640cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.220+0000 7f97696c2700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9764157ca0 0x7f976415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35518/0 (socket says 172.21.15.81:35518) 2023-10-07T08:48:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.220+0000 7f97696c2700 1 -- 172.21.15.81:0/708031803 learned_addr learned my addr 172.21.15.81:0/708031803 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.221+0000 7f9769ec3700 1 -- 172.21.15.81:0/708031803 >> v1:172.21.15.89:6789/0 conn(0x7f976406d120 legacy=0x7f976406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.221+0000 7f9769ec3700 1 -- 172.21.15.81:0/708031803 >> v1:172.21.15.81:6789/0 conn(0x7f9764157ca0 legacy=0x7f976415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.221+0000 7f9769ec3700 1 -- 172.21.15.81:0/708031803 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97640d0170 con 0x7f97641578d0 2023-10-07T08:48:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.221+0000 7f9769ec3700 1 --2- 172.21.15.81:0/708031803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97641578d0 0x7f97640cf4f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9760009e60 tx=0x7f9760009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323e05c4c2e230c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.221+0000 7f9768ec1700 1 -- 172.21.15.81:0/708031803 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976000e070 con 0x7f97641578d0 2023-10-07T08:48:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.221+0000 7f9768ec1700 1 -- 172.21.15.81:0/708031803 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976000bbf0 con 0x7f97641578d0 2023-10-07T08:48:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.221+0000 7f9768ec1700 1 -- 172.21.15.81:0/708031803 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760012430 con 0x7f97641578d0 2023-10-07T08:48:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.221+0000 7f976c127700 1 -- 172.21.15.81:0/708031803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97641578d0 msgr2=0x7f97640cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.221+0000 7f976c127700 1 --2- 172.21.15.81:0/708031803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97641578d0 0x7f97640cf4f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9760009e60 tx=0x7f9760009780 comp rx=0 tx=0).stop 2023-10-07T08:48:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.221+0000 7f976c127700 1 -- 172.21.15.81:0/708031803 shutdown_connections 2023-10-07T08:48:29.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.221+0000 7f976c127700 1 --2- 172.21.15.81:0/708031803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97641578d0 0x7f97640cf4f0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.221+0000 7f976c127700 1 -- 172.21.15.81:0/708031803 >> 172.21.15.81:0/708031803 conn(0x7f976406bb90 msgr2=0x7f976406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:29.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.222+0000 7f976c127700 1 -- 172.21.15.81:0/708031803 shutdown_connections 2023-10-07T08:48:29.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.222+0000 7f976c127700 1 -- 172.21.15.81:0/708031803 wait complete. 2023-10-07T08:48:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.223+0000 7f976c127700 1 Processor -- start 2023-10-07T08:48:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.223+0000 7f976c127700 1 -- start start 2023-10-07T08:48:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.223+0000 7f976c127700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f976406d120 0x7f97641534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.223+0000 7f976c127700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97641578d0 0x7f97640b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.223+0000 7f976c127700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9764157ca0 0x7f976414ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.223+0000 7f976c127700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97640b61a0 con 0x7f976406d120 2023-10-07T08:48:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.223+0000 7f976c127700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97640b3e60 con 0x7f9764157ca0 2023-10-07T08:48:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.223+0000 7f976c127700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9764152410 con 0x7f97641578d0 2023-10-07T08:48:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.223+0000 7f9769ec3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f976406d120 0x7f97641534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.223+0000 7f9769ec3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f976406d120 0x7f97641534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57096/0 (socket says 172.21.15.81:57096) 2023-10-07T08:48:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.223+0000 7f9769ec3700 1 -- 172.21.15.81:0/2402893873 learned_addr learned my addr 172.21.15.81:0/2402893873 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.223+0000 7f976a6c4700 1 --2- 172.21.15.81:0/2402893873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9764157ca0 0x7f976414ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.223+0000 7f97696c2700 1 --2- 172.21.15.81:0/2402893873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97641578d0 0x7f97640b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.224+0000 7f9769ec3700 1 -- 172.21.15.81:0/2402893873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97641578d0 msgr2=0x7f97640b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.224+0000 7f9769ec3700 1 --2- 172.21.15.81:0/2402893873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97641578d0 0x7f97640b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.224+0000 7f9769ec3700 1 -- 172.21.15.81:0/2402893873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9764157ca0 msgr2=0x7f976414ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.224+0000 7f9769ec3700 1 --2- 172.21.15.81:0/2402893873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9764157ca0 0x7f976414ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.224+0000 7f9769ec3700 1 -- 172.21.15.81:0/2402893873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9760009a20 con 0x7f976406d120 2023-10-07T08:48:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.224+0000 7f97696c2700 1 --2- 172.21.15.81:0/2402893873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97641578d0 0x7f97640b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.224+0000 7f976a6c4700 1 --2- 172.21.15.81:0/2402893873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9764157ca0 0x7f976414ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.224+0000 7f9769ec3700 1 --2- 172.21.15.81:0/2402893873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f976406d120 0x7f97641534b0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f976406fe20 tx=0x7f9760018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.224+0000 7f9759ffb700 1 -- 172.21.15.81:0/2402893873 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976001e640 con 0x7f976406d120 2023-10-07T08:48:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.224+0000 7f9759ffb700 1 -- 172.21.15.81:0/2402893873 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976001e7a0 con 0x7f976406d120 2023-10-07T08:48:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.224+0000 7f976c127700 1 -- 172.21.15.81:0/2402893873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97641526f0 con 0x7f976406d120 2023-10-07T08:48:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.224+0000 7f9759ffb700 1 -- 172.21.15.81:0/2402893873 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976001eb60 con 0x7f976406d120 2023-10-07T08:48:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.224+0000 7f976c127700 1 -- 172.21.15.81:0/2402893873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9764152cb0 con 0x7f976406d120 2023-10-07T08:48:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.225+0000 7f976c127700 1 -- 172.21.15.81:0/2402893873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9764067ac0 con 0x7f976406d120 2023-10-07T08:48:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.225+0000 7f9759ffb700 1 -- 172.21.15.81:0/2402893873 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9760024070 con 0x7f976406d120 2023-10-07T08:48:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.226+0000 7f9759ffb700 1 --2- 172.21.15.81:0/2402893873 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9748066f30 0x7f97480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.226+0000 7f9759ffb700 1 -- 172.21.15.81:0/2402893873 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9760086e60 con 0x7f976406d120 2023-10-07T08:48:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.226+0000 7f97696c2700 1 --2- 172.21.15.81:0/2402893873 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9748066f30 0x7f97480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.226+0000 7f97696c2700 1 --2- 172.21.15.81:0/2402893873 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9748066f30 0x7f97480693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9764154150 tx=0x7f9754009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.230+0000 7f9759ffb700 1 -- 172.21.15.81:0/2402893873 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97600540d0 con 0x7f976406d120 2023-10-07T08:48:29.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.416+0000 7f976c127700 1 -- 172.21.15.81:0/2402893873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97640d0450 con 0x7f976406d120 2023-10-07T08:48:29.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.417+0000 7f9759ffb700 1 -- 172.21.15.81:0/2402893873 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+15317 (secure 0 0 0) 0x7f97600576f0 con 0x7f976406d120 2023-10-07T08:48:29.418 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:29.418 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":111,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:48:22.503045+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:47:47.993754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-07T08:47:48.631797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:48:29.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.418+0000 7f976c127700 1 -- 172.21.15.81:0/2402893873 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9748066f30 msgr2=0x7f97480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.418+0000 7f976c127700 1 --2- 172.21.15.81:0/2402893873 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9748066f30 0x7f97480693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9764154150 tx=0x7f9754009040 comp rx=0 tx=0).stop 2023-10-07T08:48:29.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.418+0000 7f976c127700 1 -- 172.21.15.81:0/2402893873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f976406d120 msgr2=0x7f97641534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.418+0000 7f976c127700 1 --2- 172.21.15.81:0/2402893873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f976406d120 0x7f97641534b0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f976406fe20 tx=0x7f9760018000 comp rx=0 tx=0).stop 2023-10-07T08:48:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.419+0000 7f976c127700 1 -- 172.21.15.81:0/2402893873 shutdown_connections 2023-10-07T08:48:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.419+0000 7f976c127700 1 --2- 172.21.15.81:0/2402893873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9764157ca0 0x7f976414ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.419+0000 7f976c127700 1 --2- 172.21.15.81:0/2402893873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f976406d120 0x7f97641534b0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.419+0000 7f976c127700 1 --2- 172.21.15.81:0/2402893873 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9748066f30 0x7f97480693e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.419+0000 7f976c127700 1 --2- 172.21.15.81:0/2402893873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97641578d0 0x7f97640b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.419+0000 7f976c127700 1 -- 172.21.15.81:0/2402893873 >> 172.21.15.81:0/2402893873 conn(0x7f976406bb90 msgr2=0x7f97641567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.419+0000 7f976c127700 1 -- 172.21.15.81:0/2402893873 shutdown_connections 2023-10-07T08:48:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.419+0000 7f976c127700 1 -- 172.21.15.81:0/2402893873 wait complete. 2023-10-07T08:48:29.432 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T08:48:29.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.546+0000 7f74a1e3d700 1 Processor -- start 2023-10-07T08:48:29.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.546+0000 7f74a1e3d700 1 -- start start 2023-10-07T08:48:29.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.547+0000 7f74a1e3d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f749c0add30 0x7f749c0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.547+0000 7f74a1e3d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f749c0cefa0 0x7f749c067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.547+0000 7f74a1e3d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f749c067ff0 con 0x7f749c067640 2023-10-07T08:48:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.547+0000 7f74a1e3d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749c0b37b0 con 0x7f749c0cefa0 2023-10-07T08:48:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.547+0000 7f74a1e3d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749c0b17c0 con 0x7f749c0add30 2023-10-07T08:48:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.547+0000 7f74a163c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f749c0cefa0 0x7f749c067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.547+0000 7f749bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f749c067640 0x7f749c0ce890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35534/0 (socket says 172.21.15.81:35534) 2023-10-07T08:48:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.547+0000 7f749bfff700 1 -- 172.21.15.81:0/4227913053 learned_addr learned my addr 172.21.15.81:0/4227913053 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.547+0000 7f74a163c700 1 -- 172.21.15.81:0/4227913053 >> v2:172.21.15.89:3300/0 conn(0x7f749c0add30 msgr2=0x7f749c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.547+0000 7f74a163c700 1 --2- 172.21.15.81:0/4227913053 >> v2:172.21.15.89:3300/0 conn(0x7f749c0add30 0x7f749c0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.547+0000 7f74a163c700 1 -- 172.21.15.81:0/4227913053 >> v1:172.21.15.81:6789/0 conn(0x7f749c067640 legacy=0x7f749c0ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.547+0000 7f749b7fe700 1 -- 172.21.15.81:0/4227913053 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102774147 0 0) 0x7f749c067ff0 con 0x7f749c067640 2023-10-07T08:48:29.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.547+0000 7f74a163c700 1 -- 172.21.15.81:0/4227913053 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749c0b1d80 con 0x7f749c0cefa0 2023-10-07T08:48:29.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.547+0000 7f74a163c700 1 --2- 172.21.15.81:0/4227913053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c0cefa0 0x7f749c067ab0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f749c06a0f0 tx=0x7f748c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31608c9dadddf3f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:29.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.548+0000 7f749b7fe700 1 -- 172.21.15.81:0/4227913053 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c00b6b0 con 0x7f749c0cefa0 2023-10-07T08:48:29.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.548+0000 7f749b7fe700 1 -- 172.21.15.81:0/4227913053 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c00b810 con 0x7f749c0cefa0 2023-10-07T08:48:29.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.548+0000 7f749b7fe700 1 -- 172.21.15.81:0/4227913053 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c00bbb0 con 0x7f749c0cefa0 2023-10-07T08:48:29.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.548+0000 7f74a1e3d700 1 -- 172.21.15.81:0/4227913053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c0cefa0 msgr2=0x7f749c067ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.548+0000 7f74a1e3d700 1 --2- 172.21.15.81:0/4227913053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c0cefa0 0x7f749c067ab0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f749c06a0f0 tx=0x7f748c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.548+0000 7f74a1e3d700 1 -- 172.21.15.81:0/4227913053 shutdown_connections 2023-10-07T08:48:29.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.548+0000 7f74a1e3d700 1 --2- 172.21.15.81:0/4227913053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c0cefa0 0x7f749c067ab0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.548+0000 7f74a1e3d700 1 --2- 172.21.15.81:0/4227913053 >> v2:172.21.15.89:3300/0 conn(0x7f749c0add30 0x7f749c0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.548+0000 7f74a1e3d700 1 -- 172.21.15.81:0/4227913053 >> 172.21.15.81:0/4227913053 conn(0x7f749c06c620 msgr2=0x7f749c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:29.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.548+0000 7f74a1e3d700 1 -- 172.21.15.81:0/4227913053 shutdown_connections 2023-10-07T08:48:29.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.548+0000 7f74a1e3d700 1 -- 172.21.15.81:0/4227913053 wait complete. 2023-10-07T08:48:29.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.549+0000 7f74a1e3d700 1 Processor -- start 2023-10-07T08:48:29.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.549+0000 7f74a1e3d700 1 -- start start 2023-10-07T08:48:29.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.550+0000 7f74a1e3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c067640 0x7f749c14b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.550+0000 7f74a1e3d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f749c0add30 0x7f749c16a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.550+0000 7f74a1e3d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f749c0cefa0 0x7f749c1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.550+0000 7f74a1e3d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c16a8c0 con 0x7f749c067640 2023-10-07T08:48:29.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.550+0000 7f74a1e3d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c16aba0 con 0x7f749c0add30 2023-10-07T08:48:29.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.550+0000 7f74a1e3d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749c16ae80 con 0x7f749c0cefa0 2023-10-07T08:48:29.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.550+0000 7f74a0e3b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c067640 0x7f749c14b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:29.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.550+0000 7f74a0e3b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c067640 0x7f749c14b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57116/0 (socket says 172.21.15.81:57116) 2023-10-07T08:48:29.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.550+0000 7f74a0e3b700 1 -- 172.21.15.81:0/3440763389 learned_addr learned my addr 172.21.15.81:0/3440763389 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:29.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.551+0000 7f74a0e3b700 1 -- 172.21.15.81:0/3440763389 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f749c0cefa0 msgr2=0x7f749c1590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.551+0000 7f74a0e3b700 1 --2- 172.21.15.81:0/3440763389 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f749c0cefa0 0x7f749c1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.551+0000 7f74a0e3b700 1 -- 172.21.15.81:0/3440763389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f749c0add30 msgr2=0x7f749c16a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.551+0000 7f74a0e3b700 1 --2- 172.21.15.81:0/3440763389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f749c0add30 0x7f749c16a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.551+0000 7f74a0e3b700 1 -- 172.21.15.81:0/3440763389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c009420 con 0x7f749c067640 2023-10-07T08:48:29.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.551+0000 7f74a0e3b700 1 --2- 172.21.15.81:0/3440763389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c067640 0x7f749c14b720 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f749400bc30 tx=0x7f7494009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:29.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.551+0000 7f7498ff9700 1 -- 172.21.15.81:0/3440763389 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74940092e0 con 0x7f749c067640 2023-10-07T08:48:29.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.551+0000 7f7498ff9700 1 -- 172.21.15.81:0/3440763389 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749400c7a0 con 0x7f749c067640 2023-10-07T08:48:29.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.551+0000 7f74a1e3d700 1 -- 172.21.15.81:0/3440763389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749c06d5a0 con 0x7f749c067640 2023-10-07T08:48:29.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.551+0000 7f7498ff9700 1 -- 172.21.15.81:0/3440763389 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749400cb80 con 0x7f749c067640 2023-10-07T08:48:29.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.551+0000 7f74a1e3d700 1 -- 172.21.15.81:0/3440763389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749c16a540 con 0x7f749c067640 2023-10-07T08:48:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.552+0000 7f74a1e3d700 1 -- 172.21.15.81:0/3440763389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749c06dac0 con 0x7f749c067640 2023-10-07T08:48:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.552+0000 7f7498ff9700 1 -- 172.21.15.81:0/3440763389 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7494012070 con 0x7f749c067640 2023-10-07T08:48:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.553+0000 7f7498ff9700 1 --2- 172.21.15.81:0/3440763389 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7488066f30 0x7f74880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.553+0000 7f749bfff700 1 --2- 172.21.15.81:0/3440763389 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7488066f30 0x7f74880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.553+0000 7f7498ff9700 1 -- 172.21.15.81:0/3440763389 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7494084190 con 0x7f749c067640 2023-10-07T08:48:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.553+0000 7f749bfff700 1 --2- 172.21.15.81:0/3440763389 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7488066f30 0x7f74880693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f74900011e0 tx=0x7f74900079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.557+0000 7f7498ff9700 1 -- 172.21.15.81:0/3440763389 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7494051400 con 0x7f749c067640 2023-10-07T08:48:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.780+0000 7f74a1e3d700 1 -- 172.21.15.81:0/3440763389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f749c068220 con 0x7f749c067640 2023-10-07T08:48:29.781 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:48:29.780+0000 7f43c472d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T08:48:29.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.787+0000 7f7498ff9700 1 -- 172.21.15.81:0/3440763389 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v51) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7494054a20 con 0x7f749c067640 2023-10-07T08:48:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.789+0000 7f74a1e3d700 1 -- 172.21.15.81:0/3440763389 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7488066f30 msgr2=0x7f74880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.789+0000 7f74a1e3d700 1 --2- 172.21.15.81:0/3440763389 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7488066f30 0x7f74880693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f74900011e0 tx=0x7f74900079d0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.789+0000 7f74a1e3d700 1 -- 172.21.15.81:0/3440763389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c067640 msgr2=0x7f749c14b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.789+0000 7f74a1e3d700 1 --2- 172.21.15.81:0/3440763389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c067640 0x7f749c14b720 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f749400bc30 tx=0x7f7494009840 comp rx=0 tx=0).stop 2023-10-07T08:48:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.789+0000 7f74a1e3d700 1 -- 172.21.15.81:0/3440763389 shutdown_connections 2023-10-07T08:48:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.789+0000 7f74a1e3d700 1 --2- 172.21.15.81:0/3440763389 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7488066f30 0x7f74880693e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.789+0000 7f74a1e3d700 1 --2- 172.21.15.81:0/3440763389 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f749c0cefa0 0x7f749c1590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.789+0000 7f74a1e3d700 1 --2- 172.21.15.81:0/3440763389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c067640 0x7f749c14b720 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.789+0000 7f74a1e3d700 1 --2- 172.21.15.81:0/3440763389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f749c0add30 0x7f749c16a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.789+0000 7f74a1e3d700 1 -- 172.21.15.81:0/3440763389 >> 172.21.15.81:0/3440763389 conn(0x7f749c06c620 msgr2=0x7f749c1574e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.790+0000 7f74a1e3d700 1 -- 172.21.15.81:0/3440763389 shutdown_connections 2023-10-07T08:48:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.790+0000 7f74a1e3d700 1 -- 172.21.15.81:0/3440763389 wait complete. 2023-10-07T08:48:29.792 INFO:tasks.ceph.mds.a.smithi081.stderr: -9163> 2023-10-07T08:47:54.956+0000 7fa4cca2c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:48:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T08:48:29.803 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T08:48:29.821 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-07T08:48:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.920+0000 7fb625cfc700 1 Processor -- start 2023-10-07T08:48:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.920+0000 7fb625cfc700 1 -- start start 2023-10-07T08:48:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.920+0000 7fb625cfc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb620157ab0 0x7fb62015c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.920+0000 7fb625cfc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb62015c5e0 0x7fb62006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.920+0000 7fb625cfc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62015bc10 con 0x7fb620069120 2023-10-07T08:48:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.920+0000 7fb625cfc700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb620158ba0 con 0x7fb620157ab0 2023-10-07T08:48:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.920+0000 7fb625cfc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb620158e80 con 0x7fb62015c5e0 2023-10-07T08:48:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.921+0000 7fb61f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb620157ab0 0x7fb62015c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.921+0000 7fb61f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb620157ab0 0x7fb62015c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57136/0 (socket says 172.21.15.81:57136) 2023-10-07T08:48:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.921+0000 7fb61f7fe700 1 -- 172.21.15.81:0/3305950135 learned_addr learned my addr 172.21.15.81:0/3305950135 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.921+0000 7fb61effd700 1 --2- 172.21.15.81:0/3305950135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb62015c5e0 0x7fb62006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.921+0000 7fb61f7fe700 1 -- 172.21.15.81:0/3305950135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb62015c5e0 msgr2=0x7fb62006bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.921+0000 7fb61f7fe700 1 --2- 172.21.15.81:0/3305950135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb62015c5e0 0x7fb62006bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.921+0000 7fb61f7fe700 1 -- 172.21.15.81:0/3305950135 >> v1:172.21.15.89:6789/0 conn(0x7fb620069120 legacy=0x7fb62006a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.921+0000 7fb61f7fe700 1 -- 172.21.15.81:0/3305950135 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb620159160 con 0x7fb620157ab0 2023-10-07T08:48:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.921+0000 7fb61f7fe700 1 --2- 172.21.15.81:0/3305950135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb620157ab0 0x7fb62015c0a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb6100099b0 tx=0x7fb610009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea8444a3798ef8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.921+0000 7fb61e7fc700 1 -- 172.21.15.81:0/3305950135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61000b860 con 0x7fb620157ab0 2023-10-07T08:48:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.921+0000 7fb61e7fc700 1 -- 172.21.15.81:0/3305950135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61000b9c0 con 0x7fb620157ab0 2023-10-07T08:48:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.921+0000 7fb61e7fc700 1 -- 172.21.15.81:0/3305950135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61000bd60 con 0x7fb620157ab0 2023-10-07T08:48:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.922+0000 7fb625cfc700 1 -- 172.21.15.81:0/3305950135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb620157ab0 msgr2=0x7fb62015c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.922+0000 7fb625cfc700 1 --2- 172.21.15.81:0/3305950135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb620157ab0 0x7fb62015c0a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb6100099b0 tx=0x7fb610009250 comp rx=0 tx=0).stop 2023-10-07T08:48:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.922+0000 7fb625cfc700 1 -- 172.21.15.81:0/3305950135 shutdown_connections 2023-10-07T08:48:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.922+0000 7fb625cfc700 1 --2- 172.21.15.81:0/3305950135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb620157ab0 0x7fb62015c0a0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.922+0000 7fb625cfc700 1 --2- 172.21.15.81:0/3305950135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb62015c5e0 0x7fb62006bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.922+0000 7fb625cfc700 1 -- 172.21.15.81:0/3305950135 >> 172.21.15.81:0/3305950135 conn(0x7fb6200c9ca0 msgr2=0x7fb6200ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.922+0000 7fb625cfc700 1 -- 172.21.15.81:0/3305950135 shutdown_connections 2023-10-07T08:48:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.922+0000 7fb625cfc700 1 -- 172.21.15.81:0/3305950135 wait complete. 2023-10-07T08:48:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.923+0000 7fb625cfc700 1 Processor -- start 2023-10-07T08:48:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.923+0000 7fb625cfc700 1 -- start start 2023-10-07T08:48:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb625cfc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb620069120 0x7fb62016c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb625cfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb620157ab0 0x7fb6200b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb625cfc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb62015c5e0 0x7fb6200b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb625cfc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62016c1c0 con 0x7fb620157ab0 2023-10-07T08:48:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb625cfc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6201696b0 con 0x7fb62015c5e0 2023-10-07T08:48:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb625cfc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62016be20 con 0x7fb620069120 2023-10-07T08:48:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb61effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb620157ab0 0x7fb6200b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb61effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb620157ab0 0x7fb6200b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57152/0 (socket says 172.21.15.81:57152) 2023-10-07T08:48:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb61effd700 1 -- 172.21.15.81:0/1825628952 learned_addr learned my addr 172.21.15.81:0/1825628952 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb61ffff700 1 --2- 172.21.15.81:0/1825628952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb62015c5e0 0x7fb6200b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb61f7fe700 1 --2- 172.21.15.81:0/1825628952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb620069120 0x7fb62016c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb61effd700 1 -- 172.21.15.81:0/1825628952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb620069120 msgr2=0x7fb62016c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb61effd700 1 --2- 172.21.15.81:0/1825628952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb620069120 0x7fb62016c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb61effd700 1 -- 172.21.15.81:0/1825628952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb62015c5e0 msgr2=0x7fb6200b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb61effd700 1 --2- 172.21.15.81:0/1825628952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb62015c5e0 0x7fb6200b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb61effd700 1 -- 172.21.15.81:0/1825628952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6100094f0 con 0x7fb620157ab0 2023-10-07T08:48:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb61effd700 1 --2- 172.21.15.81:0/1825628952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb620157ab0 0x7fb6200b2440 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb61400d890 tx=0x7fb614008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb6077fe700 1 -- 172.21.15.81:0/1825628952 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140125f0 con 0x7fb620157ab0 2023-10-07T08:48:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb6077fe700 1 -- 172.21.15.81:0/1825628952 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb614012750 con 0x7fb620157ab0 2023-10-07T08:48:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.924+0000 7fb6077fe700 1 -- 172.21.15.81:0/1825628952 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614012b10 con 0x7fb620157ab0 2023-10-07T08:48:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.925+0000 7fb625cfc700 1 -- 172.21.15.81:0/1825628952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6201690f0 con 0x7fb620157ab0 2023-10-07T08:48:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.925+0000 7fb625cfc700 1 -- 172.21.15.81:0/1825628952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62016cb20 con 0x7fb620157ab0 2023-10-07T08:48:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.925+0000 7fb625cfc700 1 -- 172.21.15.81:0/1825628952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62016bc80 con 0x7fb620157ab0 2023-10-07T08:48:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.926+0000 7fb6077fe700 1 -- 172.21.15.81:0/1825628952 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb61401e460 con 0x7fb620157ab0 2023-10-07T08:48:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.926+0000 7fb6077fe700 1 --2- 172.21.15.81:0/1825628952 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb60c066f30 0x7fb60c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.926+0000 7fb6077fe700 1 -- 172.21.15.81:0/1825628952 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fb6140849c0 con 0x7fb620157ab0 2023-10-07T08:48:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.926+0000 7fb61f7fe700 1 --2- 172.21.15.81:0/1825628952 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb60c066f30 0x7fb60c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.927+0000 7fb61f7fe700 1 --2- 172.21.15.81:0/1825628952 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb60c066f30 0x7fb60c0693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb6100099b0 tx=0x7fb610017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:29.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:29.930+0000 7fb6077fe700 1 -- 172.21.15.81:0/1825628952 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb62016bc80 con 0x7fb620157ab0 2023-10-07T08:48:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.156+0000 7fb625cfc700 1 -- 172.21.15.81:0/1825628952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb62016bc80 con 0x7fb620157ab0 2023-10-07T08:48:30.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.790+0000 7fb6077fe700 1 -- 172.21.15.81:0/1825628952 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v52) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb62016bc80 con 0x7fb620157ab0 2023-10-07T08:48:30.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.792+0000 7fb625cfc700 1 -- 172.21.15.81:0/1825628952 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb60c066f30 msgr2=0x7fb60c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:30.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.792+0000 7fb625cfc700 1 --2- 172.21.15.81:0/1825628952 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb60c066f30 0x7fb60c0693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb6100099b0 tx=0x7fb610017000 comp rx=0 tx=0).stop 2023-10-07T08:48:30.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.792+0000 7fb625cfc700 1 -- 172.21.15.81:0/1825628952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb620157ab0 msgr2=0x7fb6200b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:30.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.792+0000 7fb625cfc700 1 --2- 172.21.15.81:0/1825628952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb620157ab0 0x7fb6200b2440 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb61400d890 tx=0x7fb614008040 comp rx=0 tx=0).stop 2023-10-07T08:48:30.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.792+0000 7fb625cfc700 1 -- 172.21.15.81:0/1825628952 shutdown_connections 2023-10-07T08:48:30.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.792+0000 7fb625cfc700 1 --2- 172.21.15.81:0/1825628952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb62015c5e0 0x7fb6200b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:30.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.792+0000 7fb625cfc700 1 --2- 172.21.15.81:0/1825628952 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb60c066f30 0x7fb60c0693e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:30.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.792+0000 7fb625cfc700 1 --2- 172.21.15.81:0/1825628952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb620069120 0x7fb62016c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:30.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.792+0000 7fb625cfc700 1 --2- 172.21.15.81:0/1825628952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb620157ab0 0x7fb6200b2440 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:30.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.792+0000 7fb625cfc700 1 -- 172.21.15.81:0/1825628952 >> 172.21.15.81:0/1825628952 conn(0x7fb6200c9ca0 msgr2=0x7fb6200ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:30.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.792+0000 7fb625cfc700 1 -- 172.21.15.81:0/1825628952 shutdown_connections 2023-10-07T08:48:30.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.792+0000 7fb625cfc700 1 -- 172.21.15.81:0/1825628952 wait complete. 2023-10-07T08:48:30.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T08:48:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.964+0000 7fc7567b8700 1 Processor -- start 2023-10-07T08:48:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.964+0000 7fc7567b8700 1 -- start start 2023-10-07T08:48:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.965+0000 7fc7567b8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc7500d0f50 0x7fc75006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.965+0000 7fc7567b8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75006d990 con 0x7fc75006d530 2023-10-07T08:48:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.965+0000 7fc7567b8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7500cf2d0 con 0x7fc7500d0b80 2023-10-07T08:48:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.965+0000 7fc7567b8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75015a690 con 0x7fc7500d0f50 2023-10-07T08:48:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.965+0000 7fc755fb7700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc75006d530 0x7fc75015b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35538/0 (socket says 172.21.15.81:35538) 2023-10-07T08:48:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.965+0000 7fc755fb7700 1 -- 172.21.15.81:0/4014818378 learned_addr learned my addr 172.21.15.81:0/4014818378 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.965+0000 7fc754fb5700 1 --2- 172.21.15.81:0/4014818378 >> v2:172.21.15.81:3300/0 conn(0x7fc7500d0f50 0x7fc75006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.965+0000 7fc747fff700 1 -- 172.21.15.81:0/4014818378 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288170775 0 0) 0x7fc75006d990 con 0x7fc75006d530 2023-10-07T08:48:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.965+0000 7fc747fff700 1 -- 172.21.15.81:0/4014818378 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc73c003570 con 0x7fc75006d530 2023-10-07T08:48:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.965+0000 7fc754fb5700 1 -- 172.21.15.81:0/4014818378 >> v1:172.21.15.89:6789/0 conn(0x7fc7500d0b80 legacy=0x7fc7500cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.965+0000 7fc754fb5700 1 -- 172.21.15.81:0/4014818378 >> v1:172.21.15.81:6789/0 conn(0x7fc75006d530 legacy=0x7fc75015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.965+0000 7fc754fb5700 1 -- 172.21.15.81:0/4014818378 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7500d0480 con 0x7fc7500d0f50 2023-10-07T08:48:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.966+0000 7fc754fb5700 1 --2- 172.21.15.81:0/4014818378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0f50 0x7fc75006cff0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fc7400098e0 tx=0x7fc7400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ebd62398c37ebb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.966+0000 7fc747fff700 1 -- 172.21.15.81:0/4014818378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740011630 con 0x7fc7500d0f50 2023-10-07T08:48:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.966+0000 7fc747fff700 1 -- 172.21.15.81:0/4014818378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc740011790 con 0x7fc7500d0f50 2023-10-07T08:48:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.966+0000 7fc747fff700 1 -- 172.21.15.81:0/4014818378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740011b30 con 0x7fc7500d0f50 2023-10-07T08:48:30.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.966+0000 7fc7567b8700 1 -- 172.21.15.81:0/4014818378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0f50 msgr2=0x7fc75006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:30.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.966+0000 7fc7567b8700 1 --2- 172.21.15.81:0/4014818378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0f50 0x7fc75006cff0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fc7400098e0 tx=0x7fc7400091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:30.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.966+0000 7fc7567b8700 1 -- 172.21.15.81:0/4014818378 shutdown_connections 2023-10-07T08:48:30.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.966+0000 7fc7567b8700 1 --2- 172.21.15.81:0/4014818378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0f50 0x7fc75006cff0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:30.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.966+0000 7fc7567b8700 1 -- 172.21.15.81:0/4014818378 >> 172.21.15.81:0/4014818378 conn(0x7fc750063230 msgr2=0x7fc750063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:30.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.966+0000 7fc7567b8700 1 -- 172.21.15.81:0/4014818378 shutdown_connections 2023-10-07T08:48:30.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.966+0000 7fc7567b8700 1 -- 172.21.15.81:0/4014818378 wait complete. 2023-10-07T08:48:30.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.967+0000 7fc7567b8700 1 Processor -- start 2023-10-07T08:48:30.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.967+0000 7fc7567b8700 1 -- start start 2023-10-07T08:48:30.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.968+0000 7fc7567b8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75006d530 0x7fc75014e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:30.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.968+0000 7fc7567b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0b80 0x7fc75014fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.968+0000 7fc7567b8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7500d0f50 0x7fc7501505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.968+0000 7fc7567b8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75014ef40 con 0x7fc7500d0b80 2023-10-07T08:48:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.968+0000 7fc7567b8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc750150f90 con 0x7fc7500d0f50 2023-10-07T08:48:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.968+0000 7fc7567b8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75014f190 con 0x7fc75006d530 2023-10-07T08:48:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.968+0000 7fc754fb5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0b80 0x7fc75014fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.968+0000 7fc754fb5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0b80 0x7fc75014fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57170/0 (socket says 172.21.15.81:57170) 2023-10-07T08:48:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.968+0000 7fc754fb5700 1 -- 172.21.15.81:0/4224438760 learned_addr learned my addr 172.21.15.81:0/4224438760 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:30.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.969+0000 7fc755fb7700 1 --2- 172.21.15.81:0/4224438760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7500d0f50 0x7fc7501505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:30.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.969+0000 7fc7557b6700 1 --2- 172.21.15.81:0/4224438760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75006d530 0x7fc75014e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:30.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.969+0000 7fc754fb5700 1 -- 172.21.15.81:0/4224438760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75006d530 msgr2=0x7fc75014e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:30.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.969+0000 7fc754fb5700 1 --2- 172.21.15.81:0/4224438760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75006d530 0x7fc75014e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:30.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.969+0000 7fc754fb5700 1 -- 172.21.15.81:0/4224438760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7500d0f50 msgr2=0x7fc7501505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:30.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.969+0000 7fc754fb5700 1 --2- 172.21.15.81:0/4224438760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7500d0f50 0x7fc7501505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:30.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.969+0000 7fc754fb5700 1 -- 172.21.15.81:0/4224438760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc740009420 con 0x7fc7500d0b80 2023-10-07T08:48:30.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.969+0000 7fc7557b6700 1 --2- 172.21.15.81:0/4224438760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75006d530 0x7fc75014e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:30.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.969+0000 7fc754fb5700 1 --2- 172.21.15.81:0/4224438760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0b80 0x7fc75014fc70 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc7400030c0 tx=0x7fc740016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:30.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.969+0000 7fc7457fa700 1 -- 172.21.15.81:0/4224438760 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740000d10 con 0x7fc7500d0b80 2023-10-07T08:48:30.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.969+0000 7fc7457fa700 1 -- 172.21.15.81:0/4224438760 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc740020070 con 0x7fc7500d0b80 2023-10-07T08:48:30.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.969+0000 7fc7567b8700 1 -- 172.21.15.81:0/4224438760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75014f470 con 0x7fc7500d0b80 2023-10-07T08:48:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.969+0000 7fc7457fa700 1 -- 172.21.15.81:0/4224438760 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7400276b0 con 0x7fc7500d0b80 2023-10-07T08:48:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.969+0000 7fc7567b8700 1 -- 172.21.15.81:0/4224438760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7501501b0 con 0x7fc7500d0b80 2023-10-07T08:48:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.970+0000 7fc7567b8700 1 -- 172.21.15.81:0/4224438760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7500676e0 con 0x7fc7500d0b80 2023-10-07T08:48:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.970+0000 7fc7457fa700 1 -- 172.21.15.81:0/4224438760 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc740027ae0 con 0x7fc7500d0b80 2023-10-07T08:48:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.971+0000 7fc7457fa700 1 --2- 172.21.15.81:0/4224438760 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc734066f30 0x7fc7340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.971+0000 7fc7457fa700 1 -- 172.21.15.81:0/4224438760 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fc740022070 con 0x7fc7500d0b80 2023-10-07T08:48:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.971+0000 7fc7557b6700 1 --2- 172.21.15.81:0/4224438760 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc734066f30 0x7fc7340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.971+0000 7fc7557b6700 1 --2- 172.21.15.81:0/4224438760 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc734066f30 0x7fc7340693e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc74c007fd0 tx=0x7fc74c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:30.975+0000 7fc7457fa700 1 -- 172.21.15.81:0/4224438760 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc740053860 con 0x7fc7500d0b80 2023-10-07T08:48:31.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.158+0000 7fc7567b8700 1 -- 172.21.15.81:0/4224438760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc75006dc00 con 0x7fc7500d0b80 2023-10-07T08:48:31.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.793+0000 7fc7457fa700 1 -- 172.21.15.81:0/4224438760 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v113) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc740056e80 con 0x7fc7500d0b80 2023-10-07T08:48:31.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.795+0000 7fc7567b8700 1 -- 172.21.15.81:0/4224438760 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc734066f30 msgr2=0x7fc7340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:31.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.795+0000 7fc7567b8700 1 --2- 172.21.15.81:0/4224438760 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc734066f30 0x7fc7340693e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc74c007fd0 tx=0x7fc74c009040 comp rx=0 tx=0).stop 2023-10-07T08:48:31.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.795+0000 7fc7567b8700 1 -- 172.21.15.81:0/4224438760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0b80 msgr2=0x7fc75014fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:31.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.796+0000 7fc7567b8700 1 --2- 172.21.15.81:0/4224438760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0b80 0x7fc75014fc70 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc7400030c0 tx=0x7fc740016000 comp rx=0 tx=0).stop 2023-10-07T08:48:31.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.796+0000 7fc7567b8700 1 -- 172.21.15.81:0/4224438760 shutdown_connections 2023-10-07T08:48:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.796+0000 7fc7567b8700 1 --2- 172.21.15.81:0/4224438760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7500d0f50 0x7fc7501505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.796+0000 7fc7567b8700 1 --2- 172.21.15.81:0/4224438760 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc734066f30 0x7fc7340693e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.796+0000 7fc7567b8700 1 --2- 172.21.15.81:0/4224438760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc75006d530 0x7fc75014e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.796+0000 7fc7567b8700 1 --2- 172.21.15.81:0/4224438760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7500d0b80 0x7fc75014fc70 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.796+0000 7fc7567b8700 1 -- 172.21.15.81:0/4224438760 >> 172.21.15.81:0/4224438760 conn(0x7fc750063230 msgr2=0x7fc75015c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.796+0000 7fc7567b8700 1 -- 172.21.15.81:0/4224438760 shutdown_connections 2023-10-07T08:48:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.796+0000 7fc7567b8700 1 -- 172.21.15.81:0/4224438760 wait complete. 2023-10-07T08:48:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-07T08:48:31.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T08:48:31.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.926+0000 7fad0f59e700 1 Processor -- start 2023-10-07T08:48:31.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.926+0000 7fad0f59e700 1 -- start start 2023-10-07T08:48:31.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.927+0000 7fad0f59e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fad100d0b80 0x7fad100cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:31.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.927+0000 7fad0f59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad1006d700 0x7fad1015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:31.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.927+0000 7fad0f59e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad100cf2d0 con 0x7fad100d02b0 2023-10-07T08:48:31.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.927+0000 7fad0f59e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1015a690 con 0x7fad100d0b80 2023-10-07T08:48:31.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.927+0000 7fad0f59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1006dc00 con 0x7fad1006d700 2023-10-07T08:48:31.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.927+0000 7fad0ed9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad1006d700 0x7fad1015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:31.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.927+0000 7fad0e59c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fad100d0b80 0x7fad100cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:31.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.927+0000 7fad0ed9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad1006d700 0x7fad1015b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:44574/0 (socket says 172.21.15.81:44574) 2023-10-07T08:48:31.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.927+0000 7fad0e59c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fad100d0b80 0x7fad100cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:38294/0 (socket says 172.21.15.81:38294) 2023-10-07T08:48:31.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.927+0000 7fad0ed9d700 1 -- 172.21.15.81:0/3187023501 learned_addr learned my addr 172.21.15.81:0/3187023501 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:31.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.927+0000 7fad0dd9b700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fad100d02b0 0x7fad1006cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:44630/0 (socket says 172.21.15.81:44630) 2023-10-07T08:48:31.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.928+0000 7fad0ed9d700 1 -- 172.21.15.81:0/3187023501 >> v2:172.21.15.89:3300/0 conn(0x7fad100d0b80 msgr2=0x7fad100cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:31.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.928+0000 7fad0ed9d700 1 --2- 172.21.15.81:0/3187023501 >> v2:172.21.15.89:3300/0 conn(0x7fad100d0b80 0x7fad100cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:31.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.928+0000 7fad0ed9d700 1 -- 172.21.15.81:0/3187023501 >> v1:172.21.15.89:6789/0 conn(0x7fad100d02b0 legacy=0x7fad1006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:31.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.928+0000 7fad0d59a700 1 -- 172.21.15.81:0/3187023501 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822191241 0 0) 0x7fad100cf2d0 con 0x7fad100d02b0 2023-10-07T08:48:31.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.928+0000 7fad0ed9d700 1 -- 172.21.15.81:0/3187023501 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad100cf570 con 0x7fad1006d700 2023-10-07T08:48:31.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.928+0000 7fad0e59c700 1 --2- 172.21.15.81:0/3187023501 >> v2:172.21.15.89:3300/0 conn(0x7fad100d0b80 0x7fad100cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:48:31.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.928+0000 7fad0ed9d700 1 --2- 172.21.15.81:0/3187023501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad1006d700 0x7fad1015b320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fad080099b0 tx=0x7fad08009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34d6071acb81984d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:31.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.928+0000 7fad0d59a700 1 -- 172.21.15.81:0/3187023501 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad08009ea0 con 0x7fad1006d700 2023-10-07T08:48:31.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.928+0000 7fad0d59a700 1 -- 172.21.15.81:0/3187023501 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0800b860 con 0x7fad1006d700 2023-10-07T08:48:31.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.928+0000 7fad0d59a700 1 -- 172.21.15.81:0/3187023501 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0800bc00 con 0x7fad1006d700 2023-10-07T08:48:31.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.928+0000 7fad0f59e700 1 -- 172.21.15.81:0/3187023501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad1006d700 msgr2=0x7fad1015b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:31.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.928+0000 7fad0f59e700 1 --2- 172.21.15.81:0/3187023501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad1006d700 0x7fad1015b320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fad080099b0 tx=0x7fad08009250 comp rx=0 tx=0).stop 2023-10-07T08:48:31.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.929+0000 7fad0f59e700 1 -- 172.21.15.81:0/3187023501 shutdown_connections 2023-10-07T08:48:31.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.929+0000 7fad0f59e700 1 --2- 172.21.15.81:0/3187023501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad1006d700 0x7fad1015b320 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:31.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.929+0000 7fad0f59e700 1 --2- 172.21.15.81:0/3187023501 >> v2:172.21.15.89:3300/0 conn(0x7fad100d0b80 0x7fad100cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:31.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.929+0000 7fad0f59e700 1 -- 172.21.15.81:0/3187023501 >> 172.21.15.81:0/3187023501 conn(0x7fad10063230 msgr2=0x7fad10063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:31.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.929+0000 7fad0f59e700 1 -- 172.21.15.81:0/3187023501 shutdown_connections 2023-10-07T08:48:31.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.929+0000 7fad0f59e700 1 -- 172.21.15.81:0/3187023501 wait complete. 2023-10-07T08:48:31.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.930+0000 7fad0f59e700 1 Processor -- start 2023-10-07T08:48:31.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.930+0000 7fad0f59e700 1 -- start start 2023-10-07T08:48:31.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.930+0000 7fad0f59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad1006d700 0x7fad1016a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:31.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.930+0000 7fad0f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad100d02b0 0x7fad10154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:31.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.930+0000 7fad0f59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad100d0b80 0x7fad100ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:31.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.930+0000 7fad0f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1016aee0 con 0x7fad100d02b0 2023-10-07T08:48:31.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.930+0000 7fad0f59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad100aa890 con 0x7fad100d0b80 2023-10-07T08:48:31.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.930+0000 7fad0f59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad100ab130 con 0x7fad1006d700 2023-10-07T08:48:31.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.930+0000 7fad0dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad100d02b0 0x7fad10154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:31.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.930+0000 7fad0dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad100d02b0 0x7fad10154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57180/0 (socket says 172.21.15.81:57180) 2023-10-07T08:48:31.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.930+0000 7fad0dd9b700 1 -- 172.21.15.81:0/106154068 learned_addr learned my addr 172.21.15.81:0/106154068 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:31.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.931+0000 7fad0ed9d700 1 --2- 172.21.15.81:0/106154068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad100d0b80 0x7fad100ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:31.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.931+0000 7fad0e59c700 1 --2- 172.21.15.81:0/106154068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad1006d700 0x7fad1016a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:31.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.931+0000 7fad0dd9b700 1 -- 172.21.15.81:0/106154068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad1006d700 msgr2=0x7fad1016a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:31.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.931+0000 7fad0dd9b700 1 --2- 172.21.15.81:0/106154068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad1006d700 0x7fad1016a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:31.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.931+0000 7fad0dd9b700 1 -- 172.21.15.81:0/106154068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad100d0b80 msgr2=0x7fad100ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:31.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.931+0000 7fad0dd9b700 1 --2- 172.21.15.81:0/106154068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad100d0b80 0x7fad100ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:31.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.931+0000 7fad0dd9b700 1 -- 172.21.15.81:0/106154068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad00009a20 con 0x7fad100d02b0 2023-10-07T08:48:31.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.931+0000 7fad0dd9b700 1 --2- 172.21.15.81:0/106154068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad100d02b0 0x7fad10154b80 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fad040011e0 tx=0x7fad04007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.931+0000 7facfe7fc700 1 -- 172.21.15.81:0/106154068 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad04005a70 con 0x7fad100d02b0 2023-10-07T08:48:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.931+0000 7facfe7fc700 1 -- 172.21.15.81:0/106154068 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad04005bd0 con 0x7fad100d02b0 2023-10-07T08:48:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.931+0000 7fad0f59e700 1 -- 172.21.15.81:0/106154068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad080094f0 con 0x7fad100d02b0 2023-10-07T08:48:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.931+0000 7facfe7fc700 1 -- 172.21.15.81:0/106154068 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad040070d0 con 0x7fad100d02b0 2023-10-07T08:48:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.931+0000 7fad0f59e700 1 -- 172.21.15.81:0/106154068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad100b6360 con 0x7fad100d02b0 2023-10-07T08:48:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.932+0000 7fad0f59e700 1 -- 172.21.15.81:0/106154068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad100ab2a0 con 0x7fad100d02b0 2023-10-07T08:48:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.932+0000 7facfe7fc700 1 -- 172.21.15.81:0/106154068 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad04007480 con 0x7fad100d02b0 2023-10-07T08:48:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.933+0000 7facfe7fc700 1 --2- 172.21.15.81:0/106154068 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facf0066f30 0x7facf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.933+0000 7facfe7fc700 1 -- 172.21.15.81:0/106154068 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fad04083880 con 0x7fad100d02b0 2023-10-07T08:48:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.933+0000 7fad0e59c700 1 --2- 172.21.15.81:0/106154068 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facf0066f30 0x7facf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.933+0000 7fad0e59c700 1 --2- 172.21.15.81:0/106154068 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facf0066f30 0x7facf00693e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fad0000f650 tx=0x7fad0000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:31.937+0000 7facfe7fc700 1 -- 172.21.15.81:0/106154068 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad04050c50 con 0x7fad100d02b0 2023-10-07T08:48:32.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.117+0000 7fad0f59e700 1 -- 172.21.15.81:0/106154068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fad100676e0 con 0x7fad100d02b0 2023-10-07T08:48:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.798+0000 7facfe7fc700 1 -- 172.21.15.81:0/106154068 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v114) v1 ==== 169+0+0 (secure 0 0 0) 0x7fad04017070 con 0x7fad100d02b0 2023-10-07T08:48:32.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.802+0000 7fad0f59e700 1 -- 172.21.15.81:0/106154068 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facf0066f30 msgr2=0x7facf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.802+0000 7fad0f59e700 1 --2- 172.21.15.81:0/106154068 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facf0066f30 0x7facf00693e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fad0000f650 tx=0x7fad0000b040 comp rx=0 tx=0).stop 2023-10-07T08:48:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.802+0000 7fad0f59e700 1 -- 172.21.15.81:0/106154068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad100d02b0 msgr2=0x7fad10154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.802+0000 7fad0f59e700 1 --2- 172.21.15.81:0/106154068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad100d02b0 0x7fad10154b80 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fad040011e0 tx=0x7fad04007e10 comp rx=0 tx=0).stop 2023-10-07T08:48:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.802+0000 7fad0f59e700 1 -- 172.21.15.81:0/106154068 shutdown_connections 2023-10-07T08:48:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.802+0000 7fad0f59e700 1 --2- 172.21.15.81:0/106154068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad100d0b80 0x7fad100ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.802+0000 7fad0f59e700 1 --2- 172.21.15.81:0/106154068 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facf0066f30 0x7facf00693e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.802+0000 7fad0f59e700 1 --2- 172.21.15.81:0/106154068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad1006d700 0x7fad1016a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.802+0000 7fad0f59e700 1 --2- 172.21.15.81:0/106154068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad100d02b0 0x7fad10154b80 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.802+0000 7fad0f59e700 1 -- 172.21.15.81:0/106154068 >> 172.21.15.81:0/106154068 conn(0x7fad10063230 msgr2=0x7fad10157540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.802+0000 7fad0f59e700 1 -- 172.21.15.81:0/106154068 shutdown_connections 2023-10-07T08:48:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.802+0000 7fad0f59e700 1 -- 172.21.15.81:0/106154068 wait complete. 2023-10-07T08:48:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-07T08:48:32.816 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T08:48:32.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.933+0000 7f334b9e6700 1 Processor -- start 2023-10-07T08:48:32.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.933+0000 7f334b9e6700 1 -- start start 2023-10-07T08:48:32.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.934+0000 7f334b9e6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f33441578d0 0x7f33440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:32.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.934+0000 7f334b9e6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3344157ca0 0x7f334415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:32.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.934+0000 7f334b9e6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33440d07c0 con 0x7f334406d120 2023-10-07T08:48:32.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.934+0000 7f334b9e6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33440cfbb0 con 0x7f3344157ca0 2023-10-07T08:48:32.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.934+0000 7f334b9e6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33440cfe90 con 0x7f33441578d0 2023-10-07T08:48:32.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.934+0000 7f3348f81700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3344157ca0 0x7f334415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:32.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.934+0000 7f3348f81700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3344157ca0 0x7f334415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41872/0 (socket says 172.21.15.81:41872) 2023-10-07T08:48:32.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.934+0000 7f3348f81700 1 -- 172.21.15.81:0/539321064 learned_addr learned my addr 172.21.15.81:0/539321064 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:32.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.935+0000 7f3349782700 1 --2- 172.21.15.81:0/539321064 >> v2:172.21.15.89:3300/0 conn(0x7f33441578d0 0x7f33440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:32.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.935+0000 7f3348f81700 1 -- 172.21.15.81:0/539321064 >> v2:172.21.15.89:3300/0 conn(0x7f33441578d0 msgr2=0x7f33440cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:32.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.935+0000 7f3348f81700 1 --2- 172.21.15.81:0/539321064 >> v2:172.21.15.89:3300/0 conn(0x7f33441578d0 0x7f33440cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:32.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.935+0000 7f3348f81700 1 -- 172.21.15.81:0/539321064 >> v1:172.21.15.89:6789/0 conn(0x7f334406d120 legacy=0x7f334406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:32.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.935+0000 7f3348f81700 1 -- 172.21.15.81:0/539321064 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440d0170 con 0x7f3344157ca0 2023-10-07T08:48:32.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.935+0000 7f3348f81700 1 --2- 172.21.15.81:0/539321064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3344157ca0 0x7f334415af00 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f33440646b0 tx=0x7f3334009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e468ea13b61edd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:32.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.935+0000 7f333bfff700 1 -- 172.21.15.81:0/539321064 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400b820 con 0x7f3344157ca0 2023-10-07T08:48:32.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.935+0000 7f333bfff700 1 -- 172.21.15.81:0/539321064 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333400b980 con 0x7f3344157ca0 2023-10-07T08:48:32.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.935+0000 7f333bfff700 1 -- 172.21.15.81:0/539321064 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400bd20 con 0x7f3344157ca0 2023-10-07T08:48:32.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.935+0000 7f334b9e6700 1 -- 172.21.15.81:0/539321064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3344157ca0 msgr2=0x7f334415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:32.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.935+0000 7f334b9e6700 1 --2- 172.21.15.81:0/539321064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3344157ca0 0x7f334415af00 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f33440646b0 tx=0x7f3334009250 comp rx=0 tx=0).stop 2023-10-07T08:48:32.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.935+0000 7f334b9e6700 1 -- 172.21.15.81:0/539321064 shutdown_connections 2023-10-07T08:48:32.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.935+0000 7f334b9e6700 1 --2- 172.21.15.81:0/539321064 >> v2:172.21.15.89:3300/0 conn(0x7f33441578d0 0x7f33440cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:32.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.935+0000 7f334b9e6700 1 --2- 172.21.15.81:0/539321064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3344157ca0 0x7f334415af00 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:32.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.935+0000 7f334b9e6700 1 -- 172.21.15.81:0/539321064 >> 172.21.15.81:0/539321064 conn(0x7f334406bb90 msgr2=0x7f334406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:32.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.936+0000 7f334b9e6700 1 -- 172.21.15.81:0/539321064 shutdown_connections 2023-10-07T08:48:32.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.936+0000 7f334b9e6700 1 -- 172.21.15.81:0/539321064 wait complete. 2023-10-07T08:48:32.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.937+0000 7f334b9e6700 1 Processor -- start 2023-10-07T08:48:32.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.937+0000 7f334b9e6700 1 -- start start 2023-10-07T08:48:32.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.937+0000 7f334b9e6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f334406d120 0x7f3344154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:32.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.937+0000 7f334b9e6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33441578d0 0x7f33440abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:32.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.937+0000 7f334b9e6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3344157ca0 0x7f3344069ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:32.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.937+0000 7f334b9e6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33440ac530 con 0x7f3344157ca0 2023-10-07T08:48:32.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.937+0000 7f334b9e6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33440ac810 con 0x7f33441578d0 2023-10-07T08:48:32.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.937+0000 7f334b9e6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33440acaf0 con 0x7f334406d120 2023-10-07T08:48:32.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.938+0000 7f3349f83700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3344157ca0 0x7f3344069ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:32.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.938+0000 7f3349f83700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3344157ca0 0x7f3344069ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41884/0 (socket says 172.21.15.81:41884) 2023-10-07T08:48:32.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.938+0000 7f3349f83700 1 -- 172.21.15.81:0/4051722656 learned_addr learned my addr 172.21.15.81:0/4051722656 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:32.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.938+0000 7f3349782700 1 --2- 172.21.15.81:0/4051722656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f334406d120 0x7f3344154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:32.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.938+0000 7f3348f81700 1 --2- 172.21.15.81:0/4051722656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33441578d0 0x7f33440abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:32.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.938+0000 7f3349f83700 1 -- 172.21.15.81:0/4051722656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f334406d120 msgr2=0x7f3344154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:32.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.938+0000 7f3349f83700 1 --2- 172.21.15.81:0/4051722656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f334406d120 0x7f3344154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:32.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.938+0000 7f3349f83700 1 -- 172.21.15.81:0/4051722656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33441578d0 msgr2=0x7f33440abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:32.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.938+0000 7f3349f83700 1 --2- 172.21.15.81:0/4051722656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33441578d0 0x7f33440abbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:32.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.938+0000 7f3349f83700 1 -- 172.21.15.81:0/4051722656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33340094f0 con 0x7f3344157ca0 2023-10-07T08:48:32.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.938+0000 7f3349f83700 1 --2- 172.21.15.81:0/4051722656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3344157ca0 0x7f3344069ce0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f333c00c5b0 tx=0x7f333c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:32.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.938+0000 7f33397fa700 1 -- 172.21.15.81:0/4051722656 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c011590 con 0x7f3344157ca0 2023-10-07T08:48:32.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.938+0000 7f33397fa700 1 -- 172.21.15.81:0/4051722656 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333c011710 con 0x7f3344157ca0 2023-10-07T08:48:32.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.938+0000 7f334b9e6700 1 -- 172.21.15.81:0/4051722656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33440acdd0 con 0x7f3344157ca0 2023-10-07T08:48:32.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.938+0000 7f33397fa700 1 -- 172.21.15.81:0/4051722656 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c011ad0 con 0x7f3344157ca0 2023-10-07T08:48:32.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.938+0000 7f334b9e6700 1 -- 172.21.15.81:0/4051722656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3344154790 con 0x7f3344157ca0 2023-10-07T08:48:32.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.939+0000 7f334b9e6700 1 -- 172.21.15.81:0/4051722656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3344067ac0 con 0x7f3344157ca0 2023-10-07T08:48:32.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.940+0000 7f33397fa700 1 -- 172.21.15.81:0/4051722656 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f333c01c460 con 0x7f3344157ca0 2023-10-07T08:48:32.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.940+0000 7f33397fa700 1 --2- 172.21.15.81:0/4051722656 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3328066f30 0x7f33280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:32.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.940+0000 7f3349782700 1 --2- 172.21.15.81:0/4051722656 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3328066f30 0x7f33280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:32.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.940+0000 7f33397fa700 1 -- 172.21.15.81:0/4051722656 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f333c083e20 con 0x7f3344157ca0 2023-10-07T08:48:32.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.940+0000 7f3349782700 1 --2- 172.21.15.81:0/4051722656 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3328066f30 0x7f33280693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3340009fd0 tx=0x7f3340009880 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:32.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:32.944+0000 7f33397fa700 1 -- 172.21.15.81:0/4051722656 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f333c0512f0 con 0x7f3344157ca0 2023-10-07T08:48:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.127+0000 7f334b9e6700 1 -- 172.21.15.81:0/4051722656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f33440d0450 con 0x7f3344157ca0 2023-10-07T08:48:33.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.131+0000 7f33397fa700 1 -- 172.21.15.81:0/4051722656 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f333c054910 con 0x7f3344157ca0 2023-10-07T08:48:33.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.133+0000 7f334b9e6700 1 -- 172.21.15.81:0/4051722656 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3328066f30 msgr2=0x7f33280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:33.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.133+0000 7f334b9e6700 1 --2- 172.21.15.81:0/4051722656 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3328066f30 0x7f33280693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3340009fd0 tx=0x7f3340009880 comp rx=0 tx=0).stop 2023-10-07T08:48:33.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.133+0000 7f334b9e6700 1 -- 172.21.15.81:0/4051722656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3344157ca0 msgr2=0x7f3344069ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:33.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.133+0000 7f334b9e6700 1 --2- 172.21.15.81:0/4051722656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3344157ca0 0x7f3344069ce0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f333c00c5b0 tx=0x7f333c007f60 comp rx=0 tx=0).stop 2023-10-07T08:48:33.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.133+0000 7f334b9e6700 1 -- 172.21.15.81:0/4051722656 shutdown_connections 2023-10-07T08:48:33.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.133+0000 7f334b9e6700 1 --2- 172.21.15.81:0/4051722656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3344157ca0 0x7f3344069ce0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.133+0000 7f334b9e6700 1 --2- 172.21.15.81:0/4051722656 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3328066f30 0x7f33280693e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.133+0000 7f334b9e6700 1 --2- 172.21.15.81:0/4051722656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f334406d120 0x7f3344154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.133+0000 7f334b9e6700 1 --2- 172.21.15.81:0/4051722656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33441578d0 0x7f33440abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.133+0000 7f334b9e6700 1 -- 172.21.15.81:0/4051722656 >> 172.21.15.81:0/4051722656 conn(0x7f334406bb90 msgr2=0x7f33441568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:33.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.133+0000 7f334b9e6700 1 -- 172.21.15.81:0/4051722656 shutdown_connections 2023-10-07T08:48:33.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.133+0000 7f334b9e6700 1 -- 172.21.15.81:0/4051722656 wait complete. 2023-10-07T08:48:33.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-10-07T08:48:33.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.258+0000 7f56ec8d6700 1 Processor -- start 2023-10-07T08:48:33.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.258+0000 7f56ec8d6700 1 -- start start 2023-10-07T08:48:33.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.259+0000 7f56ec8d6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56e806c190 0x7f56e80b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:33.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.259+0000 7f56ec8d6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f56e80b3170 0x7f56e806a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:33.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.259+0000 7f56ec8d6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e80b35d0 con 0x7f56e8157a60 2023-10-07T08:48:33.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.259+0000 7f56ec8d6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e8069d10 con 0x7f56e80b3170 2023-10-07T08:48:33.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.259+0000 7f56ec8d6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e815c130 con 0x7f56e806c190 2023-10-07T08:48:33.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.259+0000 7f56e6d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f56e80b3170 0x7f56e806a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:33.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.259+0000 7f56e659c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f56e8157a60 0x7f56e815b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45618/0 (socket says 172.21.15.81:45618) 2023-10-07T08:48:33.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.259+0000 7f56e659c700 1 -- 172.21.15.81:0/4046320200 learned_addr learned my addr 172.21.15.81:0/4046320200 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:33.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.260+0000 7f56e5d9b700 1 --2- 172.21.15.81:0/4046320200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56e806c190 0x7f56e80b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:33.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.260+0000 7f56e6d9d700 1 -- 172.21.15.81:0/4046320200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56e806c190 msgr2=0x7f56e80b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:33.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.260+0000 7f56e6d9d700 1 --2- 172.21.15.81:0/4046320200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56e806c190 0x7f56e80b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.260+0000 7f56e6d9d700 1 -- 172.21.15.81:0/4046320200 >> v1:172.21.15.81:6789/0 conn(0x7f56e8157a60 legacy=0x7f56e815b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:33.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.260+0000 7f56e6d9d700 1 -- 172.21.15.81:0/4046320200 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e815c410 con 0x7f56e80b3170 2023-10-07T08:48:33.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.260+0000 7f56e559a700 1 -- 172.21.15.81:0/4046320200 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463083714 0 0) 0x7f56e0001110 con 0x7f56e8157a60 2023-10-07T08:48:33.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.260+0000 7f56e5d9b700 1 --2- 172.21.15.81:0/4046320200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56e806c190 0x7f56e80b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:33.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.260+0000 7f56e6d9d700 1 --2- 172.21.15.81:0/4046320200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e80b3170 0x7f56e806a1a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009e60 tx=0x7f56d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1a9defca83e437 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:33.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.260+0000 7f56e559a700 1 -- 172.21.15.81:0/4046320200 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d800e070 con 0x7f56e80b3170 2023-10-07T08:48:33.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.260+0000 7f56e559a700 1 -- 172.21.15.81:0/4046320200 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d800bc30 con 0x7f56e80b3170 2023-10-07T08:48:33.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.260+0000 7f56e559a700 1 -- 172.21.15.81:0/4046320200 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8012430 con 0x7f56e80b3170 2023-10-07T08:48:33.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.261+0000 7f56ec8d6700 1 -- 172.21.15.81:0/4046320200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e80b3170 msgr2=0x7f56e806a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:33.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.261+0000 7f56ec8d6700 1 --2- 172.21.15.81:0/4046320200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e80b3170 0x7f56e806a1a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009e60 tx=0x7f56d8009780 comp rx=0 tx=0).stop 2023-10-07T08:48:33.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.261+0000 7f56ec8d6700 1 -- 172.21.15.81:0/4046320200 shutdown_connections 2023-10-07T08:48:33.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.261+0000 7f56ec8d6700 1 --2- 172.21.15.81:0/4046320200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e80b3170 0x7f56e806a1a0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.261+0000 7f56ec8d6700 1 --2- 172.21.15.81:0/4046320200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56e806c190 0x7f56e80b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.261+0000 7f56ec8d6700 1 -- 172.21.15.81:0/4046320200 >> 172.21.15.81:0/4046320200 conn(0x7f56e806cca0 msgr2=0x7f56e806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:33.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.261+0000 7f56ec8d6700 1 -- 172.21.15.81:0/4046320200 shutdown_connections 2023-10-07T08:48:33.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.261+0000 7f56ec8d6700 1 -- 172.21.15.81:0/4046320200 wait complete. 2023-10-07T08:48:33.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.262+0000 7f56ec8d6700 1 Processor -- start 2023-10-07T08:48:33.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.262+0000 7f56ec8d6700 1 -- start start 2023-10-07T08:48:33.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56ec8d6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56e806c190 0x7f56e80aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:33.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56ec8d6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e80b3170 0x7f56e8152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:33.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56ec8d6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56e8157a60 0x7f56e80ab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:33.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56ec8d6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e8153420 con 0x7f56e80b3170 2023-10-07T08:48:33.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56ec8d6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80aff30 con 0x7f56e8157a60 2023-10-07T08:48:33.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56ec8d6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80af320 con 0x7f56e806c190 2023-10-07T08:48:33.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56e5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e80b3170 0x7f56e8152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:33.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56e5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e80b3170 0x7f56e8152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41896/0 (socket says 172.21.15.81:41896) 2023-10-07T08:48:33.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56e5d9b700 1 -- 172.21.15.81:0/3965965892 learned_addr learned my addr 172.21.15.81:0/3965965892 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:33.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56e5d9b700 1 -- 172.21.15.81:0/3965965892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56e806c190 msgr2=0x7f56e80aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:33.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56e659c700 1 --2- 172.21.15.81:0/3965965892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56e806c190 0x7f56e80aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:33.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56e6d9d700 1 --2- 172.21.15.81:0/3965965892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56e8157a60 0x7f56e80ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:33.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56e5d9b700 1 --2- 172.21.15.81:0/3965965892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56e806c190 0x7f56e80aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56e5d9b700 1 -- 172.21.15.81:0/3965965892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56e8157a60 msgr2=0x7f56e80ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56e5d9b700 1 --2- 172.21.15.81:0/3965965892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56e8157a60 0x7f56e80ab270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56e5d9b700 1 -- 172.21.15.81:0/3965965892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d8009a20 con 0x7f56e80b3170 2023-10-07T08:48:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56e659c700 1 --2- 172.21.15.81:0/3965965892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56e806c190 0x7f56e80aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56e5d9b700 1 --2- 172.21.15.81:0/3965965892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e80b3170 0x7f56e8152ee0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f56d000c830 tx=0x7f56d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56de7fc700 1 -- 172.21.15.81:0/3965965892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0011600 con 0x7f56e80b3170 2023-10-07T08:48:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56de7fc700 1 -- 172.21.15.81:0/3965965892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d0011760 con 0x7f56e80b3170 2023-10-07T08:48:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56ec8d6700 1 -- 172.21.15.81:0/3965965892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e80af600 con 0x7f56e80b3170 2023-10-07T08:48:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56de7fc700 1 -- 172.21.15.81:0/3965965892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0011b20 con 0x7f56e80b3170 2023-10-07T08:48:33.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.263+0000 7f56ec8d6700 1 -- 172.21.15.81:0/3965965892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e80afbc0 con 0x7f56e80b3170 2023-10-07T08:48:33.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.264+0000 7f56ec8d6700 1 -- 172.21.15.81:0/3965965892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e80b0c30 con 0x7f56e80b3170 2023-10-07T08:48:33.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.265+0000 7f56de7fc700 1 -- 172.21.15.81:0/3965965892 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f56d000a3e0 con 0x7f56e80b3170 2023-10-07T08:48:33.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.265+0000 7f56de7fc700 1 --2- 172.21.15.81:0/3965965892 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f56c8066f30 0x7f56c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:33.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.265+0000 7f56de7fc700 1 -- 172.21.15.81:0/3965965892 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f56d00846f0 con 0x7f56e80b3170 2023-10-07T08:48:33.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.265+0000 7f56e659c700 1 --2- 172.21.15.81:0/3965965892 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f56c8066f30 0x7f56c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:33.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.265+0000 7f56e659c700 1 --2- 172.21.15.81:0/3965965892 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f56c8066f30 0x7f56c80693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f56e80ad2e0 tx=0x7f56e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:33.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.269+0000 7f56de7fc700 1 -- 172.21.15.81:0/3965965892 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56e80b0c30 con 0x7f56e80b3170 2023-10-07T08:48:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.530+0000 7f56ec8d6700 1 -- 172.21.15.81:0/3965965892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f56e80b0c30 con 0x7f56e80b3170 2023-10-07T08:48:33.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.798+0000 7f56de7fc700 1 -- 172.21.15.81:0/3965965892 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v288) v1 ==== 137+0+0 (secure 0 0 0) 0x7f56e80b0c30 con 0x7f56e80b3170 2023-10-07T08:48:33.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.800+0000 7f56ec8d6700 1 -- 172.21.15.81:0/3965965892 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f56c8066f30 msgr2=0x7f56c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:33.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.800+0000 7f56ec8d6700 1 --2- 172.21.15.81:0/3965965892 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f56c8066f30 0x7f56c80693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f56e80ad2e0 tx=0x7f56e0009040 comp rx=0 tx=0).stop 2023-10-07T08:48:33.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.800+0000 7f56ec8d6700 1 -- 172.21.15.81:0/3965965892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e80b3170 msgr2=0x7f56e8152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:33.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.800+0000 7f56ec8d6700 1 --2- 172.21.15.81:0/3965965892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e80b3170 0x7f56e8152ee0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f56d000c830 tx=0x7f56d0008040 comp rx=0 tx=0).stop 2023-10-07T08:48:33.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.800+0000 7f56ec8d6700 1 -- 172.21.15.81:0/3965965892 shutdown_connections 2023-10-07T08:48:33.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.800+0000 7f56ec8d6700 1 --2- 172.21.15.81:0/3965965892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56e8157a60 0x7f56e80ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.800+0000 7f56ec8d6700 1 --2- 172.21.15.81:0/3965965892 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f56c8066f30 0x7f56c80693e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.800+0000 7f56ec8d6700 1 --2- 172.21.15.81:0/3965965892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56e806c190 0x7f56e80aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.800+0000 7f56ec8d6700 1 --2- 172.21.15.81:0/3965965892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56e80b3170 0x7f56e8152ee0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.800+0000 7f56ec8d6700 1 -- 172.21.15.81:0/3965965892 >> 172.21.15.81:0/3965965892 conn(0x7f56e806cca0 msgr2=0x7f56e8154860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:33.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.800+0000 7f56ec8d6700 1 -- 172.21.15.81:0/3965965892 shutdown_connections 2023-10-07T08:48:33.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.800+0000 7f56ec8d6700 1 -- 172.21.15.81:0/3965965892 wait complete. 2023-10-07T08:48:33.813 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-07T08:48:33.814 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-07T08:48:33.814 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-10-07T08:48:33.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-10-07T08:48:33.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.926+0000 7facf4098700 1 Processor -- start 2023-10-07T08:48:33.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.926+0000 7facf4098700 1 -- start start 2023-10-07T08:48:33.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.927+0000 7facf4098700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facec0ce1f0 0x7facec0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:33.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.927+0000 7facf4098700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facec15dfb0 con 0x7facec0ac570 2023-10-07T08:48:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.927+0000 7facf4098700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facec0acec0 con 0x7facec0ce5c0 2023-10-07T08:48:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.927+0000 7facf4098700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facec0ad1a0 con 0x7facec0ce1f0 2023-10-07T08:48:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.927+0000 7facf2635700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7facec0ac570 0x7facec06e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45626/0 (socket says 172.21.15.81:45626) 2023-10-07T08:48:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.927+0000 7facf2635700 1 -- 172.21.15.81:0/1289773970 learned_addr learned my addr 172.21.15.81:0/1289773970 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf0e32700 1 -- 172.21.15.81:0/1289773970 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649136834 0 0) 0x7facec15dfb0 con 0x7facec0ac570 2023-10-07T08:48:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf1e34700 1 --2- 172.21.15.81:0/1289773970 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facec0ce1f0 0x7facec0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf0e32700 1 -- 172.21.15.81:0/1289773970 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facd8003570 con 0x7facec0ac570 2023-10-07T08:48:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf0e32700 1 -- 172.21.15.81:0/1289773970 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1715279387 0 0) 0x7facd8003570 con 0x7facec0ac570 2023-10-07T08:48:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf0e32700 1 -- 172.21.15.81:0/1289773970 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facec0ce1f0 msgr2=0x7facec0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf0e32700 1 --2- 172.21.15.81:0/1289773970 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facec0ce1f0 0x7facec0aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf0e32700 1 -- 172.21.15.81:0/1289773970 >> v1:172.21.15.89:6789/0 conn(0x7facec0ce5c0 legacy=0x7facec15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:33.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf0e32700 1 -- 172.21.15.81:0/1289773970 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec15dc40 con 0x7facec0ac570 2023-10-07T08:48:33.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf0e32700 1 -- 172.21.15.81:0/1289773970 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7face4001470 con 0x7facec0ac570 2023-10-07T08:48:33.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf0e32700 1 -- 172.21.15.81:0/1289773970 >> v1:172.21.15.81:6789/0 conn(0x7facec0ac570 legacy=0x7facec06e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:33.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf0e32700 1 --2- 172.21.15.81:0/1289773970 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facec0ce1f0 0x7facd8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:33.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf0e32700 1 --2- 172.21.15.81:0/1289773970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd8004010 0x7facd8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:33.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf0e32700 1 --2- 172.21.15.81:0/1289773970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd8004d50 0x7facd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:33.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf0e32700 1 -- 172.21.15.81:0/1289773970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec0ad1a0 con 0x7facd8004010 2023-10-07T08:48:33.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf0e32700 1 -- 172.21.15.81:0/1289773970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd800bbf0 con 0x7facd8004d50 2023-10-07T08:48:33.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf0e32700 1 -- 172.21.15.81:0/1289773970 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd800bdb0 con 0x7facec0ce1f0 2023-10-07T08:48:33.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf1633700 1 --2- 172.21.15.81:0/1289773970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd8004010 0x7facd8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:33.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf1e34700 1 --2- 172.21.15.81:0/1289773970 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facec0ce1f0 0x7facd8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:33.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf2635700 1 --2- 172.21.15.81:0/1289773970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd8004d50 0x7facd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:33.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf1633700 1 -- 172.21.15.81:0/1289773970 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facec0ce1f0 msgr2=0x7facd8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:33.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf1633700 1 --2- 172.21.15.81:0/1289773970 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facec0ce1f0 0x7facd8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf1633700 1 -- 172.21.15.81:0/1289773970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd8004d50 msgr2=0x7facd80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:33.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf1633700 1 --2- 172.21.15.81:0/1289773970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd8004d50 0x7facd80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.928+0000 7facf1633700 1 -- 172.21.15.81:0/1289773970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd8003570 con 0x7facd8004010 2023-10-07T08:48:33.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.929+0000 7facf1633700 1 --2- 172.21.15.81:0/1289773970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd8004010 0x7facd8004810 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7facdc001880 tx=0x7facdc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc109c119cadc56d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:33.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.929+0000 7facf0e32700 1 -- 172.21.15.81:0/1289773970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc012420 con 0x7facd8004010 2023-10-07T08:48:33.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.929+0000 7facf0e32700 1 -- 172.21.15.81:0/1289773970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facdc012580 con 0x7facd8004010 2023-10-07T08:48:33.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.929+0000 7facf0e32700 1 -- 172.21.15.81:0/1289773970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc012920 con 0x7facd8004010 2023-10-07T08:48:33.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.929+0000 7facf4098700 1 -- 172.21.15.81:0/1289773970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd8004010 msgr2=0x7facd8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:33.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.929+0000 7facf4098700 1 --2- 172.21.15.81:0/1289773970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd8004010 0x7facd8004810 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7facdc001880 tx=0x7facdc007d30 comp rx=0 tx=0).stop 2023-10-07T08:48:33.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.929+0000 7facf2635700 1 -- 172.21.15.81:0/1289773970 reap_dead start 2023-10-07T08:48:33.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.929+0000 7facf4098700 1 -- 172.21.15.81:0/1289773970 shutdown_connections 2023-10-07T08:48:33.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.929+0000 7facf4098700 1 -- 172.21.15.81:0/1289773970 >> 172.21.15.81:0/1289773970 conn(0x7facec06cca0 msgr2=0x7facec06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:33.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.929+0000 7facf4098700 1 -- 172.21.15.81:0/1289773970 shutdown_connections 2023-10-07T08:48:33.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.929+0000 7facf4098700 1 -- 172.21.15.81:0/1289773970 wait complete. 2023-10-07T08:48:33.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.930+0000 7facf4098700 1 Processor -- start 2023-10-07T08:48:33.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.930+0000 7facf4098700 1 -- start start 2023-10-07T08:48:33.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.931+0000 7facf4098700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd8004010 0x7facec15c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:33.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.931+0000 7facf4098700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facec13ce00 0x7facec15a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:33.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.931+0000 7facf4098700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facec0b22d0 0x7facec15a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:33.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.931+0000 7facf4098700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec15d610 con 0x7facec0b22d0 2023-10-07T08:48:33.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.931+0000 7facf4098700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec0b1e40 con 0x7facd8004010 2023-10-07T08:48:33.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.931+0000 7facf4098700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facec0b1230 con 0x7facec13ce00 2023-10-07T08:48:33.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.931+0000 7facf2635700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facec0b22d0 0x7facec15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:33.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.931+0000 7facf2635700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facec0b22d0 0x7facec15a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41926/0 (socket says 172.21.15.81:41926) 2023-10-07T08:48:33.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.931+0000 7facf2635700 1 -- 172.21.15.81:0/1346440437 learned_addr learned my addr 172.21.15.81:0/1346440437 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:33.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.931+0000 7facf1633700 1 --2- 172.21.15.81:0/1346440437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facec13ce00 0x7facec15a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:33.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.931+0000 7facf1e34700 1 --2- 172.21.15.81:0/1346440437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd8004010 0x7facec15c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:33.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.931+0000 7facf2635700 1 -- 172.21.15.81:0/1346440437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facec13ce00 msgr2=0x7facec15a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:33.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.931+0000 7facf2635700 1 --2- 172.21.15.81:0/1346440437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facec13ce00 0x7facec15a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.931+0000 7facf2635700 1 -- 172.21.15.81:0/1346440437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd8004010 msgr2=0x7facec15c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:33.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.931+0000 7facf2635700 1 --2- 172.21.15.81:0/1346440437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd8004010 0x7facec15c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:33.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.932+0000 7facf2635700 1 -- 172.21.15.81:0/1346440437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec0b1510 con 0x7facec0b22d0 2023-10-07T08:48:33.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.932+0000 7facf1633700 1 --2- 172.21.15.81:0/1346440437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facec13ce00 0x7facec15a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:33.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.932+0000 7facf1e34700 1 --2- 172.21.15.81:0/1346440437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd8004010 0x7facec15c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:33.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.932+0000 7facf2635700 1 --2- 172.21.15.81:0/1346440437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facec0b22d0 0x7facec15a870 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7facec06b2e0 tx=0x7face4001520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:33.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.932+0000 7face1ffb700 1 -- 172.21.15.81:0/1346440437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400eed0 con 0x7facec0b22d0 2023-10-07T08:48:33.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.932+0000 7face1ffb700 1 -- 172.21.15.81:0/1346440437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face400c750 con 0x7facec0b22d0 2023-10-07T08:48:33.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.932+0000 7facf4098700 1 -- 172.21.15.81:0/1346440437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facec0b17f0 con 0x7facec0b22d0 2023-10-07T08:48:33.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.932+0000 7face1ffb700 1 -- 172.21.15.81:0/1346440437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400caf0 con 0x7facec0b22d0 2023-10-07T08:48:33.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.932+0000 7facf4098700 1 -- 172.21.15.81:0/1346440437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facec0adc40 con 0x7facec0b22d0 2023-10-07T08:48:33.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.933+0000 7facf4098700 1 -- 172.21.15.81:0/1346440437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facec068900 con 0x7facec0b22d0 2023-10-07T08:48:33.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.933+0000 7face1ffb700 1 -- 172.21.15.81:0/1346440437 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7face40133e0 con 0x7facec0b22d0 2023-10-07T08:48:33.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.934+0000 7face1ffb700 1 --2- 172.21.15.81:0/1346440437 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facd0066f30 0x7facd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:33.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.934+0000 7face1ffb700 1 -- 172.21.15.81:0/1346440437 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4939+0+0 (secure 0 0 0) 0x7face4083bb0 con 0x7facec0b22d0 2023-10-07T08:48:33.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.934+0000 7facf1e34700 1 --2- 172.21.15.81:0/1346440437 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facd0066f30 0x7facd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:33.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.934+0000 7facf1e34700 1 --2- 172.21.15.81:0/1346440437 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facd0066f30 0x7facd00693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7face80099f0 tx=0x7face800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:33.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:33.938+0000 7face1ffb700 1 -- 172.21.15.81:0/1346440437 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7face40511a0 con 0x7facec0b22d0 2023-10-07T08:48:34.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.196+0000 7facf4098700 1 -- 172.21.15.81:0/1346440437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7facec0b1f80 con 0x7facec0b22d0 2023-10-07T08:48:34.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.802+0000 7face1ffb700 1 -- 172.21.15.81:0/1346440437 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v289) v1 ==== 131+0+0 (secure 0 0 0) 0x7face400cea0 con 0x7facec0b22d0 2023-10-07T08:48:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.805+0000 7facf4098700 1 -- 172.21.15.81:0/1346440437 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facd0066f30 msgr2=0x7facd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.805+0000 7facf4098700 1 --2- 172.21.15.81:0/1346440437 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facd0066f30 0x7facd00693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7face80099f0 tx=0x7face800b040 comp rx=0 tx=0).stop 2023-10-07T08:48:34.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.805+0000 7facf4098700 1 -- 172.21.15.81:0/1346440437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facec0b22d0 msgr2=0x7facec15a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:34.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.805+0000 7facf4098700 1 --2- 172.21.15.81:0/1346440437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facec0b22d0 0x7facec15a870 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7facec06b2e0 tx=0x7face4001520 comp rx=0 tx=0).stop 2023-10-07T08:48:34.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.805+0000 7facf4098700 1 -- 172.21.15.81:0/1346440437 shutdown_connections 2023-10-07T08:48:34.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.805+0000 7facf4098700 1 --2- 172.21.15.81:0/1346440437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facec0b22d0 0x7facec15a870 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:34.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.805+0000 7facf4098700 1 --2- 172.21.15.81:0/1346440437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd8004010 0x7facec15c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:34.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.805+0000 7facf4098700 1 --2- 172.21.15.81:0/1346440437 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7facd0066f30 0x7facd00693e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:34.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.805+0000 7facf4098700 1 --2- 172.21.15.81:0/1346440437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facec13ce00 0x7facec15a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:34.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.805+0000 7facf4098700 1 -- 172.21.15.81:0/1346440437 >> 172.21.15.81:0/1346440437 conn(0x7facec06cca0 msgr2=0x7facec14f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:34.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.805+0000 7facf4098700 1 -- 172.21.15.81:0/1346440437 shutdown_connections 2023-10-07T08:48:34.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.805+0000 7facf4098700 1 -- 172.21.15.81:0/1346440437 wait complete. 2023-10-07T08:48:34.819 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T08:48:34.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.936+0000 7f84a7fff700 1 Processor -- start 2023-10-07T08:48:34.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.936+0000 7f84a7fff700 1 -- start start 2023-10-07T08:48:34.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.937+0000 7f84a7fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f84a80d0b80 0x7f84a80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:34.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.937+0000 7f84a7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a806d700 0x7f84a815b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:34.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.937+0000 7f84a7fff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a80cf2d0 con 0x7f84a80d02b0 2023-10-07T08:48:34.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.937+0000 7f84a7fff700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a815a690 con 0x7f84a80d0b80 2023-10-07T08:48:34.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.937+0000 7f84a7fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a806dc00 con 0x7f84a806d700 2023-10-07T08:48:34.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.937+0000 7f84a77fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a806d700 0x7f84a815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:34.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.937+0000 7f84a6ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f84a80d0b80 0x7f84a80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:34.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.937+0000 7f84a6ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f84a80d0b80 0x7f84a80cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:49530/0 (socket says 172.21.15.81:49530) 2023-10-07T08:48:34.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.937+0000 7f84a77fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a806d700 0x7f84a815b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:50564/0 (socket says 172.21.15.81:50564) 2023-10-07T08:48:34.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.937+0000 7f84a6ffd700 1 -- 172.21.15.81:0/2531963681 learned_addr learned my addr 172.21.15.81:0/2531963681 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:34.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.937+0000 7f84a6ffd700 1 -- 172.21.15.81:0/2531963681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a806d700 msgr2=0x7f84a815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:34.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.937+0000 7f84a6ffd700 1 --2- 172.21.15.81:0/2531963681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a806d700 0x7f84a815b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:34.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.937+0000 7f84a6ffd700 1 -- 172.21.15.81:0/2531963681 >> v1:172.21.15.89:6789/0 conn(0x7f84a80d02b0 legacy=0x7f84a806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:34.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.937+0000 7f84a6ffd700 1 -- 172.21.15.81:0/2531963681 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a80cf570 con 0x7f84a80d0b80 2023-10-07T08:48:34.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.937+0000 7f84a5ffb700 1 -- 172.21.15.81:0/2531963681 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857986337 0 0) 0x7f84a80cf2d0 con 0x7f84a80d02b0 2023-10-07T08:48:34.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.937+0000 7f84a77fe700 1 --2- 172.21.15.81:0/2531963681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a806d700 0x7f84a815b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:48:34.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.938+0000 7f84a6ffd700 1 --2- 172.21.15.81:0/2531963681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a80d0b80 0x7f84a80cfd70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009f20 tx=0x7f84a0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7457d37492d05d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:34.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.938+0000 7f84a5ffb700 1 -- 172.21.15.81:0/2531963681 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a000e070 con 0x7f84a80d0b80 2023-10-07T08:48:34.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.938+0000 7f84a5ffb700 1 -- 172.21.15.81:0/2531963681 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a000b9d0 con 0x7f84a80d0b80 2023-10-07T08:48:34.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.938+0000 7f84a5ffb700 1 -- 172.21.15.81:0/2531963681 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a00092e0 con 0x7f84a80d0b80 2023-10-07T08:48:34.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.938+0000 7f84a7fff700 1 -- 172.21.15.81:0/2531963681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a80d0b80 msgr2=0x7f84a80cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:34.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.938+0000 7f84a7fff700 1 --2- 172.21.15.81:0/2531963681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a80d0b80 0x7f84a80cfd70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009f20 tx=0x7f84a0009840 comp rx=0 tx=0).stop 2023-10-07T08:48:34.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.938+0000 7f84a7fff700 1 -- 172.21.15.81:0/2531963681 shutdown_connections 2023-10-07T08:48:34.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.938+0000 7f84a7fff700 1 --2- 172.21.15.81:0/2531963681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a806d700 0x7f84a815b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:34.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.938+0000 7f84a7fff700 1 --2- 172.21.15.81:0/2531963681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a80d0b80 0x7f84a80cfd70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:34.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.938+0000 7f84a7fff700 1 -- 172.21.15.81:0/2531963681 >> 172.21.15.81:0/2531963681 conn(0x7f84a8063230 msgr2=0x7f84a8063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:34.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.938+0000 7f84a7fff700 1 -- 172.21.15.81:0/2531963681 shutdown_connections 2023-10-07T08:48:34.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.938+0000 7f84a7fff700 1 -- 172.21.15.81:0/2531963681 wait complete. 2023-10-07T08:48:34.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.939+0000 7f84a7fff700 1 Processor -- start 2023-10-07T08:48:34.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.939+0000 7f84a7fff700 1 -- start start 2023-10-07T08:48:34.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.940+0000 7f84a7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a806d700 0x7f84a816a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:34.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.940+0000 7f84a7fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a80d02b0 0x7f84a80adc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:34.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.940+0000 7f84a7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84a80d0b80 0x7f84a80cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:34.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.940+0000 7f84a7fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80af5a0 con 0x7f84a80d0b80 2023-10-07T08:48:34.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.940+0000 7f84a7fff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a816e590 con 0x7f84a80d02b0 2023-10-07T08:48:34.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.940+0000 7f84a7fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a816a660 con 0x7f84a806d700 2023-10-07T08:48:34.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.940+0000 7f84a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84a80d0b80 0x7f84a80cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:34.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.940+0000 7f84a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84a80d0b80 0x7f84a80cd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41942/0 (socket says 172.21.15.81:41942) 2023-10-07T08:48:34.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.940+0000 7f84a77fe700 1 -- 172.21.15.81:0/3128704764 learned_addr learned my addr 172.21.15.81:0/3128704764 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:34.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.941+0000 7f84a67fc700 1 --2- 172.21.15.81:0/3128704764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a80d02b0 0x7f84a80adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:34.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.941+0000 7f84a6ffd700 1 --2- 172.21.15.81:0/3128704764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a806d700 0x7f84a816a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:34.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.941+0000 7f84a77fe700 1 -- 172.21.15.81:0/3128704764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a806d700 msgr2=0x7f84a816a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:34.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.941+0000 7f84a77fe700 1 --2- 172.21.15.81:0/3128704764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a806d700 0x7f84a816a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:34.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.941+0000 7f84a77fe700 1 -- 172.21.15.81:0/3128704764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a80d02b0 msgr2=0x7f84a80adc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:34.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.941+0000 7f84a77fe700 1 --2- 172.21.15.81:0/3128704764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a80d02b0 0x7f84a80adc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:34.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.941+0000 7f84a77fe700 1 -- 172.21.15.81:0/3128704764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8498009420 con 0x7f84a80d0b80 2023-10-07T08:48:34.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.941+0000 7f84a67fc700 1 --2- 172.21.15.81:0/3128704764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a80d02b0 0x7f84a80adc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:34.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.941+0000 7f84a6ffd700 1 --2- 172.21.15.81:0/3128704764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a806d700 0x7f84a816a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:34.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.941+0000 7f84a77fe700 1 --2- 172.21.15.81:0/3128704764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84a80d0b80 0x7f84a80cd3d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f849800ec50 tx=0x7f84980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:34.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.941+0000 7f848effd700 1 -- 172.21.15.81:0/3128704764 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849800c9d0 con 0x7f84a80d0b80 2023-10-07T08:48:34.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.941+0000 7f848effd700 1 -- 172.21.15.81:0/3128704764 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849800cb50 con 0x7f84a80d0b80 2023-10-07T08:48:34.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.941+0000 7f848effd700 1 -- 172.21.15.81:0/3128704764 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8498013470 con 0x7f84a80d0b80 2023-10-07T08:48:34.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.941+0000 7f84a7fff700 1 -- 172.21.15.81:0/3128704764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a0009ae0 con 0x7f84a80d0b80 2023-10-07T08:48:34.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.941+0000 7f84a7fff700 1 -- 172.21.15.81:0/3128704764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a8157270 con 0x7f84a80d0b80 2023-10-07T08:48:34.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.942+0000 7f84a7fff700 1 -- 172.21.15.81:0/3128704764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a80676e0 con 0x7f84a80d0b80 2023-10-07T08:48:34.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.942+0000 7f848effd700 1 -- 172.21.15.81:0/3128704764 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84980137e0 con 0x7f84a80d0b80 2023-10-07T08:48:34.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.943+0000 7f848effd700 1 --2- 172.21.15.81:0/3128704764 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8494066f30 0x7f84940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:34.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.943+0000 7f848effd700 1 -- 172.21.15.81:0/3128704764 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8498084440 con 0x7f84a80d0b80 2023-10-07T08:48:34.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.943+0000 7f84a6ffd700 1 --2- 172.21.15.81:0/3128704764 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8494066f30 0x7f84940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:34.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.943+0000 7f84a6ffd700 1 --2- 172.21.15.81:0/3128704764 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8494066f30 0x7f84940693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009880 tx=0x7f84a0018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:34.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:34.947+0000 7f848effd700 1 -- 172.21.15.81:0/3128704764 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84980519b0 con 0x7f84a80d0b80 2023-10-07T08:48:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.130+0000 7f84a7fff700 1 -- 172.21.15.81:0/3128704764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f84a8157270 con 0x7f84a80d0b80 2023-10-07T08:48:35.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.134+0000 7f848effd700 1 -- 172.21.15.81:0/3128704764 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f84a8157270 con 0x7f84a80d0b80 2023-10-07T08:48:35.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.136+0000 7f84a7fff700 1 -- 172.21.15.81:0/3128704764 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8494066f30 msgr2=0x7f84940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:35.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.136+0000 7f84a7fff700 1 --2- 172.21.15.81:0/3128704764 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8494066f30 0x7f84940693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009880 tx=0x7f84a0018000 comp rx=0 tx=0).stop 2023-10-07T08:48:35.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.136+0000 7f84a7fff700 1 -- 172.21.15.81:0/3128704764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84a80d0b80 msgr2=0x7f84a80cd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:35.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.136+0000 7f84a7fff700 1 --2- 172.21.15.81:0/3128704764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84a80d0b80 0x7f84a80cd3d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f849800ec50 tx=0x7f84980091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.136+0000 7f84a7fff700 1 -- 172.21.15.81:0/3128704764 shutdown_connections 2023-10-07T08:48:35.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.136+0000 7f84a7fff700 1 --2- 172.21.15.81:0/3128704764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84a80d0b80 0x7f84a80cd3d0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.136+0000 7f84a7fff700 1 --2- 172.21.15.81:0/3128704764 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8494066f30 0x7f84940693e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.136+0000 7f84a7fff700 1 --2- 172.21.15.81:0/3128704764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84a806d700 0x7f84a816a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.136+0000 7f84a7fff700 1 --2- 172.21.15.81:0/3128704764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84a80d02b0 0x7f84a80adc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.136+0000 7f84a7fff700 1 -- 172.21.15.81:0/3128704764 >> 172.21.15.81:0/3128704764 conn(0x7f84a8063230 msgr2=0x7f84a815cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:35.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.136+0000 7f84a7fff700 1 -- 172.21.15.81:0/3128704764 shutdown_connections 2023-10-07T08:48:35.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.136+0000 7f84a7fff700 1 -- 172.21.15.81:0/3128704764 wait complete. 2023-10-07T08:48:35.149 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:48:35.150 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:48:35.186 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:48:35.229 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:48:35.229 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T08:48:35.229 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:48:35.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.341+0000 7f57e9f59700 1 Processor -- start 2023-10-07T08:48:35.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.341+0000 7f57e9f59700 1 -- start start 2023-10-07T08:48:35.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.342+0000 7f57e9f59700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57e4159b40 0x7f57e40cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:35.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.342+0000 7f57e9f59700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f57e4159f10 0x7f57e4068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:35.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.342+0000 7f57e9f59700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e40cee10 con 0x7f57e40ccb40 2023-10-07T08:48:35.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.342+0000 7f57e9f59700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e40cd040 con 0x7f57e4159b40 2023-10-07T08:48:35.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.342+0000 7f57e9f59700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e40cd320 con 0x7f57e4159f10 2023-10-07T08:48:35.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.342+0000 7f57e8f57700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57e4159b40 0x7f57e40cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:35.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.342+0000 7f57e8f57700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57e4159b40 0x7f57e40cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41952/0 (socket says 172.21.15.81:41952) 2023-10-07T08:48:35.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.342+0000 7f57e8f57700 1 -- 172.21.15.81:0/2346140117 learned_addr learned my addr 172.21.15.81:0/2346140117 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:35.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.342+0000 7f57e8f57700 1 -- 172.21.15.81:0/2346140117 >> v2:172.21.15.89:3300/0 conn(0x7f57e4159f10 msgr2=0x7f57e4068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:35.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.342+0000 7f57e8f57700 1 --2- 172.21.15.81:0/2346140117 >> v2:172.21.15.89:3300/0 conn(0x7f57e4159f10 0x7f57e4068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.342+0000 7f57e8f57700 1 -- 172.21.15.81:0/2346140117 >> v1:172.21.15.89:6789/0 conn(0x7f57e40ccb40 legacy=0x7f57e415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:35.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.342+0000 7f57e8f57700 1 -- 172.21.15.81:0/2346140117 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e40ce7c0 con 0x7f57e4159b40 2023-10-07T08:48:35.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.342+0000 7f57e8f57700 1 --2- 172.21.15.81:0/2346140117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57e4159b40 0x7f57e40cc600 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f57e406fd80 tx=0x7f57d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd3bebe05d10d2d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:35.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.342+0000 7f57e37fe700 1 -- 172.21.15.81:0/2346140117 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d400e070 con 0x7f57e4159b40 2023-10-07T08:48:35.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.343+0000 7f57e37fe700 1 -- 172.21.15.81:0/2346140117 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d400ba10 con 0x7f57e4159b40 2023-10-07T08:48:35.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.343+0000 7f57e37fe700 1 -- 172.21.15.81:0/2346140117 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d40092e0 con 0x7f57e4159b40 2023-10-07T08:48:35.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.343+0000 7f57e9f59700 1 -- 172.21.15.81:0/2346140117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57e4159b40 msgr2=0x7f57e40cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:35.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.343+0000 7f57e9f59700 1 --2- 172.21.15.81:0/2346140117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57e4159b40 0x7f57e40cc600 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f57e406fd80 tx=0x7f57d4009840 comp rx=0 tx=0).stop 2023-10-07T08:48:35.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.343+0000 7f57e9f59700 1 -- 172.21.15.81:0/2346140117 shutdown_connections 2023-10-07T08:48:35.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.343+0000 7f57e9f59700 1 --2- 172.21.15.81:0/2346140117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57e4159b40 0x7f57e40cc600 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.343+0000 7f57e9f59700 1 --2- 172.21.15.81:0/2346140117 >> v2:172.21.15.89:3300/0 conn(0x7f57e4159f10 0x7f57e4068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.343+0000 7f57e9f59700 1 -- 172.21.15.81:0/2346140117 >> 172.21.15.81:0/2346140117 conn(0x7f57e40cd660 msgr2=0x7f57e40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:35.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.343+0000 7f57e9f59700 1 -- 172.21.15.81:0/2346140117 shutdown_connections 2023-10-07T08:48:35.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.343+0000 7f57e9f59700 1 -- 172.21.15.81:0/2346140117 wait complete. 2023-10-07T08:48:35.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.344+0000 7f57e9f59700 1 Processor -- start 2023-10-07T08:48:35.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.344+0000 7f57e9f59700 1 -- start start 2023-10-07T08:48:35.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e9f59700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57e40ccb40 0x7f57e416a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:35.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e9f59700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e4159b40 0x7f57e406f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:35.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e9f59700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57e4159f10 0x7f57e406f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:35.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e9f59700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e40c7e20 con 0x7f57e4159f10 2023-10-07T08:48:35.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e9f59700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e40c8100 con 0x7f57e4159b40 2023-10-07T08:48:35.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e9f59700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e40c83e0 con 0x7f57e40ccb40 2023-10-07T08:48:35.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e9758700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57e4159f10 0x7f57e406f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:35.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e9758700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57e4159f10 0x7f57e406f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41968/0 (socket says 172.21.15.81:41968) 2023-10-07T08:48:35.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e9758700 1 -- 172.21.15.81:0/3717811097 learned_addr learned my addr 172.21.15.81:0/3717811097 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:35.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e3fff700 1 --2- 172.21.15.81:0/3717811097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e4159b40 0x7f57e406f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:35.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e8f57700 1 --2- 172.21.15.81:0/3717811097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57e40ccb40 0x7f57e416a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:35.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e9758700 1 -- 172.21.15.81:0/3717811097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57e40ccb40 msgr2=0x7f57e416a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:35.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e9758700 1 --2- 172.21.15.81:0/3717811097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57e40ccb40 0x7f57e416a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e9758700 1 -- 172.21.15.81:0/3717811097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e4159b40 msgr2=0x7f57e406f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:35.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e9758700 1 --2- 172.21.15.81:0/3717811097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e4159b40 0x7f57e406f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e9758700 1 -- 172.21.15.81:0/3717811097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d4009ae0 con 0x7f57e4159f10 2023-10-07T08:48:35.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e3fff700 1 --2- 172.21.15.81:0/3717811097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e4159b40 0x7f57e406f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:35.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.345+0000 7f57e9758700 1 --2- 172.21.15.81:0/3717811097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57e4159f10 0x7f57e406f550 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00b5e0 tx=0x7f57dc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:35.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.346+0000 7f57e0ff9700 1 -- 172.21.15.81:0/3717811097 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc00f510 con 0x7f57e4159f10 2023-10-07T08:48:35.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.346+0000 7f57e0ff9700 1 -- 172.21.15.81:0/3717811097 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57dc00f690 con 0x7f57e4159f10 2023-10-07T08:48:35.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.346+0000 7f57e9f59700 1 -- 172.21.15.81:0/3717811097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e40c86c0 con 0x7f57e4159f10 2023-10-07T08:48:35.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.346+0000 7f57e0ff9700 1 -- 172.21.15.81:0/3717811097 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc00fa50 con 0x7f57e4159f10 2023-10-07T08:48:35.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.346+0000 7f57e9f59700 1 -- 172.21.15.81:0/3717811097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e4157c60 con 0x7f57e4159f10 2023-10-07T08:48:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.347+0000 7f57e9f59700 1 -- 172.21.15.81:0/3717811097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e40c8900 con 0x7f57e4159f10 2023-10-07T08:48:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.347+0000 7f57e0ff9700 1 -- 172.21.15.81:0/3717811097 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57dc01a400 con 0x7f57e4159f10 2023-10-07T08:48:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.347+0000 7f57e0ff9700 1 --2- 172.21.15.81:0/3717811097 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f57c4066f30 0x7f57c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.347+0000 7f57e0ff9700 1 -- 172.21.15.81:0/3717811097 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f57dc083d00 con 0x7f57e4159f10 2023-10-07T08:48:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.347+0000 7f57e8f57700 1 --2- 172.21.15.81:0/3717811097 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f57c4066f30 0x7f57c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.348+0000 7f57e8f57700 1 --2- 172.21.15.81:0/3717811097 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f57c4066f30 0x7f57c40693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f57d4009ab0 tx=0x7f57d4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.352+0000 7f57e0ff9700 1 -- 172.21.15.81:0/3717811097 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57e40c8900 con 0x7f57e4159f10 2023-10-07T08:48:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.576+0000 7f57e9f59700 1 -- 172.21.15.81:0/3717811097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57e40c8900 con 0x7f57e4159f10 2023-10-07T08:48:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.576+0000 7f57e0ff9700 1 -- 172.21.15.81:0/3717811097 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f57e40c8900 con 0x7f57e4159f10 2023-10-07T08:48:35.578 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:35.578 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/1015639142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1015639142},{"type":"v1","addr":"172.21.15.89:6833","nonce":1015639142}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2650972762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2650972762},{"type":"v1","addr":"172.21.15.89:6835","nonce":2650972762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2058286084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2058286084},{"type":"v1","addr":"172.21.15.81:6836","nonce":2058286084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6675,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/521513692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":521513692},{"type":"v1","addr":"172.21.15.81:6837","nonce":521513692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[]} 2023-10-07T08:48:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.578+0000 7f57e9f59700 1 -- 172.21.15.81:0/3717811097 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f57c4066f30 msgr2=0x7f57c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.578+0000 7f57e9f59700 1 --2- 172.21.15.81:0/3717811097 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f57c4066f30 0x7f57c40693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f57d4009ab0 tx=0x7f57d4017000 comp rx=0 tx=0).stop 2023-10-07T08:48:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.578+0000 7f57e9f59700 1 -- 172.21.15.81:0/3717811097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57e4159f10 msgr2=0x7f57e406f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.578+0000 7f57e9f59700 1 --2- 172.21.15.81:0/3717811097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57e4159f10 0x7f57e406f550 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00b5e0 tx=0x7f57dc009120 comp rx=0 tx=0).stop 2023-10-07T08:48:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.578+0000 7f57e9f59700 1 -- 172.21.15.81:0/3717811097 shutdown_connections 2023-10-07T08:48:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.578+0000 7f57e9f59700 1 --2- 172.21.15.81:0/3717811097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57e4159f10 0x7f57e406f550 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.578+0000 7f57e9f59700 1 --2- 172.21.15.81:0/3717811097 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f57c4066f30 0x7f57c40693e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.578+0000 7f57e9f59700 1 --2- 172.21.15.81:0/3717811097 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57e40ccb40 0x7f57e416a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.578+0000 7f57e9f59700 1 --2- 172.21.15.81:0/3717811097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e4159b40 0x7f57e406f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.578+0000 7f57e9f59700 1 -- 172.21.15.81:0/3717811097 >> 172.21.15.81:0/3717811097 conn(0x7f57e40cd660 msgr2=0x7f57e40c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.578+0000 7f57e9f59700 1 -- 172.21.15.81:0/3717811097 shutdown_connections 2023-10-07T08:48:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.578+0000 7f57e9f59700 1 -- 172.21.15.81:0/3717811097 wait complete. 2023-10-07T08:48:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2023-10-07T08:48:35.591 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T08:48:35.592 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T08:48:35.592 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T08:48:35.592 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:48:35.592 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T08:48:35.592 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T08:48:35.592 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T08:48:35.592 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:48:35.593 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T08:48:35.593 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T08:48:35.593 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T08:48:35.593 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:48:35.593 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T08:48:35.593 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T08:48:35.594 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T08:48:35.594 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:48:35.601 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T08:48:35.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T08:48:35.602 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T08:48:35.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T08:48:35.604 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T08:48:35.604 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T08:48:35.605 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T08:48:35.605 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T08:48:35.643 INFO:tasks.ceph.mds.a:Started 2023-10-07T08:48:35.644 DEBUG:teuthology.parallel:result is None 2023-10-07T08:48:35.644 INFO:tasks.ceph.mds.c:Started 2023-10-07T08:48:35.644 DEBUG:teuthology.parallel:result is None 2023-10-07T08:48:35.646 INFO:tasks.ceph.mds.b:Started 2023-10-07T08:48:35.647 DEBUG:teuthology.parallel:result is None 2023-10-07T08:48:35.647 INFO:tasks.ceph.mds.d:Started 2023-10-07T08:48:35.647 DEBUG:teuthology.parallel:result is None 2023-10-07T08:48:35.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T08:48:35.727 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-07T08:48:35.728 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-07T08:48:35.728 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-10-07T08:48:35.728 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-10-07T08:48:35.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.766+0000 7fbe8d4f8700 1 Processor -- start 2023-10-07T08:48:35.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.766+0000 7fbe8d4f8700 1 -- start start 2023-10-07T08:48:35.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.767+0000 7fbe8d4f8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbe88157ca0 0x7fbe880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:35.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.767+0000 7fbe8d4f8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe880d07c0 con 0x7fbe8806d120 2023-10-07T08:48:35.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.767+0000 7fbe8d4f8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe880cfbb0 con 0x7fbe881578d0 2023-10-07T08:48:35.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.767+0000 7fbe8d4f8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe880cfe90 con 0x7fbe88157ca0 2023-10-07T08:48:35.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.767+0000 7fbe867fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbe88157ca0 0x7fbe880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:35.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.767+0000 7fbe877fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbe8806d120 0x7fbe8806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45652/0 (socket says 172.21.15.81:45652) 2023-10-07T08:48:35.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.767+0000 7fbe877fe700 1 -- 172.21.15.81:0/3576259974 learned_addr learned my addr 172.21.15.81:0/3576259974 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:35.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.768+0000 7fbe867fc700 1 -- 172.21.15.81:0/3576259974 >> v1:172.21.15.89:6789/0 conn(0x7fbe881578d0 legacy=0x7fbe8815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:35.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.768+0000 7fbe867fc700 1 -- 172.21.15.81:0/3576259974 >> v1:172.21.15.81:6789/0 conn(0x7fbe8806d120 legacy=0x7fbe8806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:35.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.768+0000 7fbe867fc700 1 -- 172.21.15.81:0/3576259974 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe880d0170 con 0x7fbe88157ca0 2023-10-07T08:48:35.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.768+0000 7fbe867fc700 1 --2- 172.21.15.81:0/3576259974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe88157ca0 0x7fbe880cf4f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0098e0 tx=0x7fbe7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745d9732876e4bb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:35.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.768+0000 7fbe85ffb700 1 -- 172.21.15.81:0/3576259974 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c009e80 con 0x7fbe88157ca0 2023-10-07T08:48:35.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.768+0000 7fbe85ffb700 1 -- 172.21.15.81:0/3576259974 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c00b820 con 0x7fbe88157ca0 2023-10-07T08:48:35.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.768+0000 7fbe85ffb700 1 -- 172.21.15.81:0/3576259974 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c00bba0 con 0x7fbe88157ca0 2023-10-07T08:48:35.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.768+0000 7fbe8d4f8700 1 -- 172.21.15.81:0/3576259974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe88157ca0 msgr2=0x7fbe880cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:35.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.768+0000 7fbe8d4f8700 1 --2- 172.21.15.81:0/3576259974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe88157ca0 0x7fbe880cf4f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0098e0 tx=0x7fbe7c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.769+0000 7fbe8d4f8700 1 -- 172.21.15.81:0/3576259974 shutdown_connections 2023-10-07T08:48:35.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.769+0000 7fbe8d4f8700 1 --2- 172.21.15.81:0/3576259974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe88157ca0 0x7fbe880cf4f0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.769+0000 7fbe8d4f8700 1 -- 172.21.15.81:0/3576259974 >> 172.21.15.81:0/3576259974 conn(0x7fbe8806bb90 msgr2=0x7fbe8806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:35.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.769+0000 7fbe8d4f8700 1 -- 172.21.15.81:0/3576259974 shutdown_connections 2023-10-07T08:48:35.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.769+0000 7fbe8d4f8700 1 -- 172.21.15.81:0/3576259974 wait complete. 2023-10-07T08:48:35.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.770+0000 7fbe8d4f8700 1 Processor -- start 2023-10-07T08:48:35.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.770+0000 7fbe8d4f8700 1 -- start start 2023-10-07T08:48:35.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.770+0000 7fbe8d4f8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe8806d120 0x7fbe8816b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:35.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.770+0000 7fbe8d4f8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe881578d0 0x7fbe880c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:35.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe8d4f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe88157ca0 0x7fbe880c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe8d4f8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8816c940 con 0x7fbe88157ca0 2023-10-07T08:48:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe8d4f8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8816bd30 con 0x7fbe881578d0 2023-10-07T08:48:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe8d4f8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8816c010 con 0x7fbe8806d120 2023-10-07T08:48:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe88157ca0 0x7fbe880c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe88157ca0 0x7fbe880c6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42034/0 (socket says 172.21.15.81:42034) 2023-10-07T08:48:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe877fe700 1 -- 172.21.15.81:0/1340432590 learned_addr learned my addr 172.21.15.81:0/1340432590 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe867fc700 1 --2- 172.21.15.81:0/1340432590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe881578d0 0x7fbe880c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe86ffd700 1 --2- 172.21.15.81:0/1340432590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe8806d120 0x7fbe8816b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe877fe700 1 -- 172.21.15.81:0/1340432590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe8806d120 msgr2=0x7fbe8816b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe877fe700 1 --2- 172.21.15.81:0/1340432590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe8806d120 0x7fbe8816b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe877fe700 1 -- 172.21.15.81:0/1340432590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe881578d0 msgr2=0x7fbe880c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe877fe700 1 --2- 172.21.15.81:0/1340432590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe881578d0 0x7fbe880c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:35.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe877fe700 1 -- 172.21.15.81:0/1340432590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c009420 con 0x7fbe88157ca0 2023-10-07T08:48:35.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe877fe700 1 --2- 172.21.15.81:0/1340432590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe88157ca0 0x7fbe880c6060 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000cc40 tx=0x7fbe80001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:35.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe6effd700 1 -- 172.21.15.81:0/1340432590 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000a8b0 con 0x7fbe88157ca0 2023-10-07T08:48:35.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe6effd700 1 -- 172.21.15.81:0/1340432590 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8000aa10 con 0x7fbe88157ca0 2023-10-07T08:48:35.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe6effd700 1 -- 172.21.15.81:0/1340432590 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000add0 con 0x7fbe88157ca0 2023-10-07T08:48:35.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe8d4f8700 1 -- 172.21.15.81:0/1340432590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8816c2f0 con 0x7fbe88157ca0 2023-10-07T08:48:35.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.771+0000 7fbe8d4f8700 1 -- 172.21.15.81:0/1340432590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe881412a0 con 0x7fbe88157ca0 2023-10-07T08:48:35.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.772+0000 7fbe8d4f8700 1 -- 172.21.15.81:0/1340432590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8806a7f0 con 0x7fbe88157ca0 2023-10-07T08:48:35.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.773+0000 7fbe6effd700 1 -- 172.21.15.81:0/1340432590 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe80007300 con 0x7fbe88157ca0 2023-10-07T08:48:35.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.773+0000 7fbe6effd700 1 --2- 172.21.15.81:0/1340432590 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbe74066f30 0x7fbe740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:35.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.773+0000 7fbe6effd700 1 -- 172.21.15.81:0/1340432590 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbe80084520 con 0x7fbe88157ca0 2023-10-07T08:48:35.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.773+0000 7fbe86ffd700 1 --2- 172.21.15.81:0/1340432590 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbe74066f30 0x7fbe740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:35.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.773+0000 7fbe86ffd700 1 --2- 172.21.15.81:0/1340432590 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbe74066f30 0x7fbe740693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbe88155af0 tx=0x7fbe78007ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:35.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.777+0000 7fbe6effd700 1 -- 172.21.15.81:0/1340432590 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe80051a90 con 0x7fbe88157ca0 2023-10-07T08:48:35.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:35.978+0000 7fbe8d4f8700 1 -- 172.21.15.81:0/1340432590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbe8816ca80 con 0x7fbe88157ca0 2023-10-07T08:48:36.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.825+0000 7fbe6effd700 1 -- 172.21.15.81:0/1340432590 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v119) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbe800550b0 con 0x7fbe88157ca0 2023-10-07T08:48:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.828+0000 7fbe8d4f8700 1 -- 172.21.15.81:0/1340432590 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbe74066f30 msgr2=0x7fbe740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.828+0000 7fbe8d4f8700 1 --2- 172.21.15.81:0/1340432590 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbe74066f30 0x7fbe740693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbe88155af0 tx=0x7fbe78007ea0 comp rx=0 tx=0).stop 2023-10-07T08:48:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.828+0000 7fbe8d4f8700 1 -- 172.21.15.81:0/1340432590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe88157ca0 msgr2=0x7fbe880c6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.828+0000 7fbe8d4f8700 1 --2- 172.21.15.81:0/1340432590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe88157ca0 0x7fbe880c6060 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000cc40 tx=0x7fbe80001a50 comp rx=0 tx=0).stop 2023-10-07T08:48:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.828+0000 7fbe8d4f8700 1 -- 172.21.15.81:0/1340432590 shutdown_connections 2023-10-07T08:48:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.828+0000 7fbe8d4f8700 1 --2- 172.21.15.81:0/1340432590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe88157ca0 0x7fbe880c6060 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.828+0000 7fbe8d4f8700 1 --2- 172.21.15.81:0/1340432590 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbe74066f30 0x7fbe740693e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.828+0000 7fbe8d4f8700 1 --2- 172.21.15.81:0/1340432590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe8806d120 0x7fbe8816b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.828+0000 7fbe8d4f8700 1 --2- 172.21.15.81:0/1340432590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe881578d0 0x7fbe880c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.828+0000 7fbe8d4f8700 1 -- 172.21.15.81:0/1340432590 >> 172.21.15.81:0/1340432590 conn(0x7fbe8806bb90 msgr2=0x7fbe8806a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.828+0000 7fbe8d4f8700 1 -- 172.21.15.81:0/1340432590 shutdown_connections 2023-10-07T08:48:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.828+0000 7fbe8d4f8700 1 -- 172.21.15.81:0/1340432590 wait complete. 2023-10-07T08:48:36.831 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-07T08:48:36.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T08:48:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.955+0000 7fbb2ad80700 1 Processor -- start 2023-10-07T08:48:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.955+0000 7fbb2ad80700 1 -- start start 2023-10-07T08:48:36.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.956+0000 7fbb2ad80700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb24157ca0 0x7fbb240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:36.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.956+0000 7fbb2ad80700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb240d07c0 con 0x7fbb241578d0 2023-10-07T08:48:36.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.956+0000 7fbb2ad80700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb240cfbb0 con 0x7fbb2406d120 2023-10-07T08:48:36.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.956+0000 7fbb2ad80700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240cfe90 con 0x7fbb24157ca0 2023-10-07T08:48:36.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.956+0000 7fbb28b1c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbb241578d0 0x7fbb2415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45654/0 (socket says 172.21.15.81:45654) 2023-10-07T08:48:36.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.956+0000 7fbb28b1c700 1 -- 172.21.15.81:0/1277999449 learned_addr learned my addr 172.21.15.81:0/1277999449 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:36.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.956+0000 7fbb237fe700 1 -- 172.21.15.81:0/1277999449 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327115668 0 0) 0x7fbb240d07c0 con 0x7fbb241578d0 2023-10-07T08:48:36.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.956+0000 7fbb237fe700 1 -- 172.21.15.81:0/1277999449 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb14003570 con 0x7fbb241578d0 2023-10-07T08:48:36.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.956+0000 7fbb23fff700 1 --2- 172.21.15.81:0/1277999449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb24157ca0 0x7fbb240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:36.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.956+0000 7fbb237fe700 1 -- 172.21.15.81:0/1277999449 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3177292138 0 0) 0x7fbb14003570 con 0x7fbb241578d0 2023-10-07T08:48:36.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.956+0000 7fbb237fe700 1 -- 172.21.15.81:0/1277999449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb24157ca0 msgr2=0x7fbb240cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:36.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.956+0000 7fbb237fe700 1 --2- 172.21.15.81:0/1277999449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb24157ca0 0x7fbb240cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:36.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.956+0000 7fbb237fe700 1 -- 172.21.15.81:0/1277999449 >> v1:172.21.15.89:6789/0 conn(0x7fbb2406d120 legacy=0x7fbb2415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:36.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.956+0000 7fbb237fe700 1 -- 172.21.15.81:0/1277999449 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb240d0170 con 0x7fbb241578d0 2023-10-07T08:48:36.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.956+0000 7fbb237fe700 1 -- 172.21.15.81:0/1277999449 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fbb18001470 con 0x7fbb241578d0 2023-10-07T08:48:36.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.956+0000 7fbb237fe700 1 -- 172.21.15.81:0/1277999449 >> v1:172.21.15.81:6789/0 conn(0x7fbb241578d0 legacy=0x7fbb2415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:36.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb237fe700 1 --2- 172.21.15.81:0/1277999449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb14003a90 0x7fbb14003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:36.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb237fe700 1 --2- 172.21.15.81:0/1277999449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb14004810 0x7fbb14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:36.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb237fe700 1 --2- 172.21.15.81:0/1277999449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb24157ca0 0x7fbb140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:36.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb237fe700 1 -- 172.21.15.81:0/1277999449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240cfe90 con 0x7fbb14004810 2023-10-07T08:48:36.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb237fe700 1 -- 172.21.15.81:0/1277999449 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1400bb10 con 0x7fbb14003a90 2023-10-07T08:48:36.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb237fe700 1 -- 172.21.15.81:0/1277999449 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1400bcd0 con 0x7fbb24157ca0 2023-10-07T08:48:36.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb28b1c700 1 --2- 172.21.15.81:0/1277999449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb14003a90 0x7fbb14003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:36.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb23fff700 1 --2- 172.21.15.81:0/1277999449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb14004810 0x7fbb14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:36.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb2931d700 1 --2- 172.21.15.81:0/1277999449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb24157ca0 0x7fbb140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:36.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb28b1c700 1 -- 172.21.15.81:0/1277999449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb24157ca0 msgr2=0x7fbb140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:36.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb28b1c700 1 --2- 172.21.15.81:0/1277999449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb24157ca0 0x7fbb140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:36.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb28b1c700 1 -- 172.21.15.81:0/1277999449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb14004810 msgr2=0x7fbb14004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:36.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb28b1c700 1 --2- 172.21.15.81:0/1277999449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb14004810 0x7fbb14004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:36.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb28b1c700 1 -- 172.21.15.81:0/1277999449 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb14003570 con 0x7fbb14003a90 2023-10-07T08:48:36.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb23fff700 1 --2- 172.21.15.81:0/1277999449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb14004810 0x7fbb14004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:48:36.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb28b1c700 1 --2- 172.21.15.81:0/1277999449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb14003a90 0x7fbb14003e60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c390 tx=0x7fbb2415b610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99c0bbb111c43d6b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:36.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb237fe700 1 -- 172.21.15.81:0/1277999449 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1800cc60 con 0x7fbb14003a90 2023-10-07T08:48:36.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb237fe700 1 -- 172.21.15.81:0/1277999449 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1800cde0 con 0x7fbb14003a90 2023-10-07T08:48:36.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.957+0000 7fbb237fe700 1 -- 172.21.15.81:0/1277999449 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18005b70 con 0x7fbb14003a90 2023-10-07T08:48:36.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.958+0000 7fbb2ad80700 1 -- 172.21.15.81:0/1277999449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb14003a90 msgr2=0x7fbb14003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:36.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.958+0000 7fbb2ad80700 1 --2- 172.21.15.81:0/1277999449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb14003a90 0x7fbb14003e60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c390 tx=0x7fbb2415b610 comp rx=0 tx=0).stop 2023-10-07T08:48:36.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.958+0000 7fbb2931d700 1 -- 172.21.15.81:0/1277999449 reap_dead start 2023-10-07T08:48:36.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.958+0000 7fbb2ad80700 1 -- 172.21.15.81:0/1277999449 shutdown_connections 2023-10-07T08:48:36.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.958+0000 7fbb2ad80700 1 -- 172.21.15.81:0/1277999449 >> 172.21.15.81:0/1277999449 conn(0x7fbb2406bb90 msgr2=0x7fbb2406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:36.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.958+0000 7fbb2ad80700 1 -- 172.21.15.81:0/1277999449 shutdown_connections 2023-10-07T08:48:36.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.958+0000 7fbb2ad80700 1 -- 172.21.15.81:0/1277999449 wait complete. 2023-10-07T08:48:36.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.959+0000 7fbb2ad80700 1 Processor -- start 2023-10-07T08:48:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.959+0000 7fbb2ad80700 1 -- start start 2023-10-07T08:48:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb2ad80700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb14003a90 0x7fbb2413f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb2ad80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb2416d930 0x7fbb2416dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb2ad80700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb240b60b0 0x7fbb240b6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb2ad80700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2416e2e0 con 0x7fbb2416d930 2023-10-07T08:48:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb2ad80700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb24151120 con 0x7fbb240b60b0 2023-10-07T08:48:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb2ad80700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240b6a90 con 0x7fbb14003a90 2023-10-07T08:48:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb23fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb2416d930 0x7fbb2416dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb23fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb2416d930 0x7fbb2416dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42050/0 (socket says 172.21.15.81:42050) 2023-10-07T08:48:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb23fff700 1 -- 172.21.15.81:0/1966041236 learned_addr learned my addr 172.21.15.81:0/1966041236 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb28b1c700 1 --2- 172.21.15.81:0/1966041236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb14003a90 0x7fbb2413f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb2931d700 1 --2- 172.21.15.81:0/1966041236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb240b60b0 0x7fbb240b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb23fff700 1 -- 172.21.15.81:0/1966041236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb14003a90 msgr2=0x7fbb2413f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb23fff700 1 --2- 172.21.15.81:0/1966041236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb14003a90 0x7fbb2413f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb23fff700 1 -- 172.21.15.81:0/1966041236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb240b60b0 msgr2=0x7fbb240b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb23fff700 1 --2- 172.21.15.81:0/1966041236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb240b60b0 0x7fbb240b6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb23fff700 1 -- 172.21.15.81:0/1966041236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2414e4a0 con 0x7fbb2416d930 2023-10-07T08:48:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb28b1c700 1 --2- 172.21.15.81:0/1966041236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb14003a90 0x7fbb2413f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:48:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb23fff700 1 --2- 172.21.15.81:0/1966041236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb2416d930 0x7fbb2416dda0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fbb10011da0 tx=0x7fbb100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb20ff9700 1 -- 172.21.15.81:0/1966041236 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1000fbc0 con 0x7fbb2416d930 2023-10-07T08:48:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb20ff9700 1 -- 172.21.15.81:0/1966041236 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1000fd20 con 0x7fbb2416d930 2023-10-07T08:48:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb2ad80700 1 -- 172.21.15.81:0/1966041236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2416e4d0 con 0x7fbb2416d930 2023-10-07T08:48:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.960+0000 7fbb20ff9700 1 -- 172.21.15.81:0/1966041236 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1001d6b0 con 0x7fbb2416d930 2023-10-07T08:48:36.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.961+0000 7fbb2ad80700 1 -- 172.21.15.81:0/1966041236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb24150db0 con 0x7fbb2416d930 2023-10-07T08:48:36.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.961+0000 7fbb2ad80700 1 -- 172.21.15.81:0/1966041236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb241512d0 con 0x7fbb2416d930 2023-10-07T08:48:36.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.962+0000 7fbb20ff9700 1 -- 172.21.15.81:0/1966041236 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb1001daa0 con 0x7fbb2416d930 2023-10-07T08:48:36.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.962+0000 7fbb20ff9700 1 --2- 172.21.15.81:0/1966041236 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbb08066f30 0x7fbb080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:36.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.962+0000 7fbb20ff9700 1 -- 172.21.15.81:0/1966041236 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbb10018070 con 0x7fbb2416d930 2023-10-07T08:48:36.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.962+0000 7fbb28b1c700 1 --2- 172.21.15.81:0/1966041236 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbb08066f30 0x7fbb080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:36.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.963+0000 7fbb28b1c700 1 --2- 172.21.15.81:0/1966041236 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbb08066f30 0x7fbb080693e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbb18007d10 tx=0x7fbb18015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:36.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:36.967+0000 7fbb20ff9700 1 -- 172.21.15.81:0/1966041236 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb100b65a0 con 0x7fbb2416d930 2023-10-07T08:48:37.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.223+0000 7fbb2ad80700 1 -- 172.21.15.81:0/1966041236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbb240d0450 con 0x7fbb2416d930 2023-10-07T08:48:37.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.223+0000 7fbb20ff9700 1 -- 172.21.15.81:0/1966041236 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fbb10022090 con 0x7fbb2416d930 2023-10-07T08:48:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:37.225 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:48:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-07T08:48:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-07T08:48:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlK8v0EhAAyj+l+ifyEevPT96HbuWzkw==", 2023-10-07T08:48:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:48:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:48:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:48:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:48:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-07T08:48:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlN0UcHhAA0o1jHEL9Ow40VDezKTunOw==", 2023-10-07T08:48:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:48:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:48:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:48:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:48:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-07T08:48:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlvsm6GRAApZehzqt3HugU+h9RGWQh8g==", 2023-10-07T08:48:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:48:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:48:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:48:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:48:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-07T08:48:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8XLiJBAAMBqSo/+NZuuL/pPnTitAUw==", 2023-10-07T08:48:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:48:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:48:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:48:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:48:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-07T08:48:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD2GSFlwYNOOBAAMpoFTAZdRERvqFbI4Lno9g==", 2023-10-07T08:48:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:48:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:48:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:48:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-07T08:48:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlejEnBBAAsnZCgsTTMWvqr2n4FfgWCQ==", 2023-10-07T08:48:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:48:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:48:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:48:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-07T08:48:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlDjS3DRAAfyBS9XSkAY6Se+RNw9jwWw==", 2023-10-07T08:48:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:48:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:48:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:48:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-07T08:48:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlnLaEFxAAtQ3AxrEGCcXYvJF2/wP1yw==", 2023-10-07T08:48:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:48:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:48:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:48:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-07T08:48:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlllNdIRAAXgD+PAR1Piya6p94xfGbXA==", 2023-10-07T08:48:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:48:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:48:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:48:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-07T08:48:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFleIM7KBAAIz+WlbgsmtAuSMPO+kh/Xw==", 2023-10-07T08:48:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:48:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:48:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:48:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-07T08:48:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlFNlEMRAAt7dpMTylOj0KsJy/law6Nw==", 2023-10-07T08:48:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:48:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:48:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:48:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-07T08:48:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFloCRbOhAA8XzXVwVYYYZIJV+F84EiDQ==", 2023-10-07T08:48:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:48:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:48:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:48:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-07T08:48:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl7cS0KBAA2K6kkFjyEZYa0xYx53Nf7g==", 2023-10-07T08:48:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:48:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-07T08:48:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T08:48:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-07T08:48:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlP3EBMRAAWXcQeEkoEzBCSQzvz/AzBQ==", 2023-10-07T08:48:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:48:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:48:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:48:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:48:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-07T08:48:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFldtgKLhAAX8L0S1NgyHsOj4cUljxH/A==", 2023-10-07T08:48:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:48:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:48:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:48:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:48:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-07T08:48:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlJ+VXNhAA9sXFpdOEIZxQLiS8LJwa3A==", 2023-10-07T08:48:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:48:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:48:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:48:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:48:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-07T08:48:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDyGSFle021MxAA39oudTkATALz6ZklfA0QQA==", 2023-10-07T08:48:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:48:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:48:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:48:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:48:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-07T08:48:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8c3zDxAAKU/DHPPZhFJ1MKw48C6lJQ==", 2023-10-07T08:48:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:48:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:48:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:48:37.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:48:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-07T08:48:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlByYuDBAA2xkiT3FNBRXjSMlu+GdRjg==", 2023-10-07T08:48:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:48:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:48:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:48:37.241 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:48:37.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:37.242 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:48:37.242 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:48:37.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.225+0000 7fbb2ad80700 1 -- 172.21.15.81:0/1966041236 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbb08066f30 msgr2=0x7fbb080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:37.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.225+0000 7fbb2ad80700 1 --2- 172.21.15.81:0/1966041236 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbb08066f30 0x7fbb080693e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbb18007d10 tx=0x7fbb18015000 comp rx=0 tx=0).stop 2023-10-07T08:48:37.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.225+0000 7fbb2ad80700 1 -- 172.21.15.81:0/1966041236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb2416d930 msgr2=0x7fbb2416dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:37.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.225+0000 7fbb2ad80700 1 --2- 172.21.15.81:0/1966041236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb2416d930 0x7fbb2416dda0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fbb10011da0 tx=0x7fbb100091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.225+0000 7fbb2ad80700 1 -- 172.21.15.81:0/1966041236 shutdown_connections 2023-10-07T08:48:37.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.225+0000 7fbb2ad80700 1 --2- 172.21.15.81:0/1966041236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb240b60b0 0x7fbb240b6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.225+0000 7fbb2ad80700 1 --2- 172.21.15.81:0/1966041236 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbb08066f30 0x7fbb080693e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.225+0000 7fbb2ad80700 1 --2- 172.21.15.81:0/1966041236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb14003a90 0x7fbb2413f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.225+0000 7fbb2ad80700 1 --2- 172.21.15.81:0/1966041236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb2416d930 0x7fbb2416dda0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.225+0000 7fbb2ad80700 1 -- 172.21.15.81:0/1966041236 >> 172.21.15.81:0/1966041236 conn(0x7fbb2406bb90 msgr2=0x7fbb2406d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:37.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.225+0000 7fbb2ad80700 1 -- 172.21.15.81:0/1966041236 shutdown_connections 2023-10-07T08:48:37.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.225+0000 7fbb2ad80700 1 -- 172.21.15.81:0/1966041236 wait complete. 2023-10-07T08:48:37.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:48:37.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.358+0000 7fdb882c2700 1 Processor -- start 2023-10-07T08:48:37.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.358+0000 7fdb882c2700 1 -- start start 2023-10-07T08:48:37.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.359+0000 7fdb882c2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb8006dd60 0x7fdb800b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:37.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.359+0000 7fdb882c2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb800b0ca0 con 0x7fdb8015a2a0 2023-10-07T08:48:37.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.359+0000 7fdb882c2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb800b00d0 con 0x7fdb800cf240 2023-10-07T08:48:37.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.359+0000 7fdb882c2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8006ea90 con 0x7fdb8006dd60 2023-10-07T08:48:37.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.359+0000 7fdb8605e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdb8015a2a0 0x7fdb800ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45660/0 (socket says 172.21.15.81:45660) 2023-10-07T08:48:37.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.359+0000 7fdb8605e700 1 -- 172.21.15.81:0/3758447194 learned_addr learned my addr 172.21.15.81:0/3758447194 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:37.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8685f700 1 --2- 172.21.15.81:0/3758447194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb8006dd60 0x7fdb800b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:37.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8505c700 1 -- 172.21.15.81:0/3758447194 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2952123464 0 0) 0x7fdb800b0ca0 con 0x7fdb8015a2a0 2023-10-07T08:48:37.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8505c700 1 -- 172.21.15.81:0/3758447194 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb68003570 con 0x7fdb8015a2a0 2023-10-07T08:48:37.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8505c700 1 -- 172.21.15.81:0/3758447194 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 751929980 0 0) 0x7fdb68003570 con 0x7fdb8015a2a0 2023-10-07T08:48:37.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8505c700 1 -- 172.21.15.81:0/3758447194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb8006dd60 msgr2=0x7fdb800b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:37.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8505c700 1 --2- 172.21.15.81:0/3758447194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb8006dd60 0x7fdb800b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8505c700 1 -- 172.21.15.81:0/3758447194 >> v1:172.21.15.89:6789/0 conn(0x7fdb800cf240 legacy=0x7fdb8006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:37.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8505c700 1 -- 172.21.15.81:0/3758447194 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb800b0370 con 0x7fdb8015a2a0 2023-10-07T08:48:37.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8505c700 1 -- 172.21.15.81:0/3758447194 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fdb700017f0 con 0x7fdb8015a2a0 2023-10-07T08:48:37.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8505c700 1 -- 172.21.15.81:0/3758447194 >> v1:172.21.15.81:6789/0 conn(0x7fdb8015a2a0 legacy=0x7fdb800ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:37.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8505c700 1 --2- 172.21.15.81:0/3758447194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb8006dd60 0x7fdb68003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:37.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8505c700 1 --2- 172.21.15.81:0/3758447194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb68004010 0x7fdb68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:37.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8505c700 1 --2- 172.21.15.81:0/3758447194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb68004d50 0x7fdb680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:37.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8505c700 1 -- 172.21.15.81:0/3758447194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8006ea90 con 0x7fdb68004010 2023-10-07T08:48:37.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8505c700 1 -- 172.21.15.81:0/3758447194 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6800bbf0 con 0x7fdb68004d50 2023-10-07T08:48:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8505c700 1 -- 172.21.15.81:0/3758447194 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6800bdb0 con 0x7fdb8006dd60 2023-10-07T08:48:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8585d700 1 --2- 172.21.15.81:0/3758447194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb68004010 0x7fdb68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8605e700 1 --2- 172.21.15.81:0/3758447194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb8006dd60 0x7fdb68003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8685f700 1 --2- 172.21.15.81:0/3758447194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb68004d50 0x7fdb680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8585d700 1 -- 172.21.15.81:0/3758447194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb8006dd60 msgr2=0x7fdb68003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8585d700 1 --2- 172.21.15.81:0/3758447194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb8006dd60 0x7fdb68003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8585d700 1 -- 172.21.15.81:0/3758447194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb68004d50 msgr2=0x7fdb680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8585d700 1 --2- 172.21.15.81:0/3758447194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb68004d50 0x7fdb680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8585d700 1 -- 172.21.15.81:0/3758447194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb68003570 con 0x7fdb68004010 2023-10-07T08:48:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8605e700 1 --2- 172.21.15.81:0/3758447194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb8006dd60 0x7fdb68003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:48:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.360+0000 7fdb8585d700 1 --2- 172.21.15.81:0/3758447194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb68004010 0x7fdb68004810 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fdb800cf640 tx=0x7fdb74007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9e17a415cd7a17 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.361+0000 7fdb8505c700 1 -- 172.21.15.81:0/3758447194 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74012420 con 0x7fdb68004010 2023-10-07T08:48:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.361+0000 7fdb8505c700 1 -- 172.21.15.81:0/3758447194 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb74012580 con 0x7fdb68004010 2023-10-07T08:48:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.361+0000 7fdb8505c700 1 -- 172.21.15.81:0/3758447194 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74012920 con 0x7fdb68004010 2023-10-07T08:48:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.361+0000 7fdb882c2700 1 -- 172.21.15.81:0/3758447194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb68004010 msgr2=0x7fdb68004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.361+0000 7fdb882c2700 1 --2- 172.21.15.81:0/3758447194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb68004010 0x7fdb68004810 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fdb800cf640 tx=0x7fdb74007d30 comp rx=0 tx=0).stop 2023-10-07T08:48:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.361+0000 7fdb8685f700 1 -- 172.21.15.81:0/3758447194 reap_dead start 2023-10-07T08:48:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.361+0000 7fdb882c2700 1 -- 172.21.15.81:0/3758447194 shutdown_connections 2023-10-07T08:48:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.361+0000 7fdb882c2700 1 -- 172.21.15.81:0/3758447194 >> 172.21.15.81:0/3758447194 conn(0x7fdb80067640 msgr2=0x7fdb80067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.361+0000 7fdb882c2700 1 -- 172.21.15.81:0/3758447194 shutdown_connections 2023-10-07T08:48:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.361+0000 7fdb882c2700 1 -- 172.21.15.81:0/3758447194 wait complete. 2023-10-07T08:48:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.362+0000 7fdb882c2700 1 Processor -- start 2023-10-07T08:48:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.362+0000 7fdb882c2700 1 -- start start 2023-10-07T08:48:37.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb882c2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb68004010 0x7fdb8014bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:37.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb882c2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb8015d220 0x7fdb8015d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:37.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb882c2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb801552a0 0x7fdb80155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:37.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb882c2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb80155c60 con 0x7fdb68004010 2023-10-07T08:48:37.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb882c2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8015e2a0 con 0x7fdb8015d220 2023-10-07T08:48:37.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb882c2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800b3170 con 0x7fdb801552a0 2023-10-07T08:48:37.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb8605e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb68004010 0x7fdb8014bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:37.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb8605e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb68004010 0x7fdb8014bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42072/0 (socket says 172.21.15.81:42072) 2023-10-07T08:48:37.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb8605e700 1 -- 172.21.15.81:0/4145815925 learned_addr learned my addr 172.21.15.81:0/4145815925 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:37.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb8585d700 1 --2- 172.21.15.81:0/4145815925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb8015d220 0x7fdb8015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:37.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb8685f700 1 --2- 172.21.15.81:0/4145815925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb801552a0 0x7fdb80155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:37.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb8605e700 1 -- 172.21.15.81:0/4145815925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb801552a0 msgr2=0x7fdb80155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:37.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb8605e700 1 --2- 172.21.15.81:0/4145815925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb801552a0 0x7fdb80155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb8605e700 1 -- 172.21.15.81:0/4145815925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb8015d220 msgr2=0x7fdb8015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:37.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb8605e700 1 --2- 172.21.15.81:0/4145815925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb8015d220 0x7fdb8015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb8605e700 1 -- 172.21.15.81:0/4145815925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8015dce0 con 0x7fdb68004010 2023-10-07T08:48:37.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.363+0000 7fdb8585d700 1 --2- 172.21.15.81:0/4145815925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb8015d220 0x7fdb8015d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:37.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.364+0000 7fdb8605e700 1 --2- 172.21.15.81:0/4145815925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb68004010 0x7fdb8014bc50 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000afc0 tx=0x7fdb700021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:37.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.364+0000 7fdb7e7fc700 1 -- 172.21.15.81:0/4145815925 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb700133f0 con 0x7fdb68004010 2023-10-07T08:48:37.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.364+0000 7fdb7e7fc700 1 -- 172.21.15.81:0/4145815925 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb70013550 con 0x7fdb68004010 2023-10-07T08:48:37.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.364+0000 7fdb7e7fc700 1 -- 172.21.15.81:0/4145815925 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb700138f0 con 0x7fdb68004010 2023-10-07T08:48:37.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.364+0000 7fdb882c2700 1 -- 172.21.15.81:0/4145815925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8015dfc0 con 0x7fdb68004010 2023-10-07T08:48:37.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.364+0000 7fdb882c2700 1 -- 172.21.15.81:0/4145815925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8015fb00 con 0x7fdb68004010 2023-10-07T08:48:37.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.365+0000 7fdb882c2700 1 -- 172.21.15.81:0/4145815925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb8006b6d0 con 0x7fdb68004010 2023-10-07T08:48:37.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.365+0000 7fdb7e7fc700 1 -- 172.21.15.81:0/4145815925 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb70013ce0 con 0x7fdb68004010 2023-10-07T08:48:37.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.365+0000 7fdb7e7fc700 1 --2- 172.21.15.81:0/4145815925 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb6c066f30 0x7fdb6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:37.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.365+0000 7fdb7e7fc700 1 -- 172.21.15.81:0/4145815925 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdb70084f50 con 0x7fdb68004010 2023-10-07T08:48:37.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.365+0000 7fdb8585d700 1 --2- 172.21.15.81:0/4145815925 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb6c066f30 0x7fdb6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:37.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.366+0000 7fdb8585d700 1 --2- 172.21.15.81:0/4145815925 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb6c066f30 0x7fdb6c0693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdb80154680 tx=0x7fdb74015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:37.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.369+0000 7fdb7e7fc700 1 -- 172.21.15.81:0/4145815925 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb70052510 con 0x7fdb68004010 2023-10-07T08:48:37.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.554+0000 7fdb882c2700 1 -- 172.21.15.81:0/4145815925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb8004bb80 con 0x7fdb68004010 2023-10-07T08:48:37.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.554+0000 7fdb7e7fc700 1 -- 172.21.15.81:0/4145815925 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+12097 (secure 0 0 0) 0x7fdb70055b30 con 0x7fdb68004010 2023-10-07T08:48:37.556 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:37.556 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":119,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:48:36.821126+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:48:37.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.556+0000 7fdb882c2700 1 -- 172.21.15.81:0/4145815925 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb6c066f30 msgr2=0x7fdb6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:37.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.556+0000 7fdb882c2700 1 --2- 172.21.15.81:0/4145815925 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb6c066f30 0x7fdb6c0693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdb80154680 tx=0x7fdb74015000 comp rx=0 tx=0).stop 2023-10-07T08:48:37.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.556+0000 7fdb882c2700 1 -- 172.21.15.81:0/4145815925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb68004010 msgr2=0x7fdb8014bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:37.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.556+0000 7fdb882c2700 1 --2- 172.21.15.81:0/4145815925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb68004010 0x7fdb8014bc50 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000afc0 tx=0x7fdb700021d0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.556+0000 7fdb882c2700 1 -- 172.21.15.81:0/4145815925 shutdown_connections 2023-10-07T08:48:37.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.556+0000 7fdb882c2700 1 --2- 172.21.15.81:0/4145815925 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb6c066f30 0x7fdb6c0693e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.556+0000 7fdb882c2700 1 --2- 172.21.15.81:0/4145815925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb801552a0 0x7fdb80155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.556+0000 7fdb882c2700 1 --2- 172.21.15.81:0/4145815925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb68004010 0x7fdb8014bc50 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.556+0000 7fdb882c2700 1 --2- 172.21.15.81:0/4145815925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb8015d220 0x7fdb8015d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.556+0000 7fdb882c2700 1 -- 172.21.15.81:0/4145815925 >> 172.21.15.81:0/4145815925 conn(0x7fdb80067640 msgr2=0x7fdb800cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:37.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.557+0000 7fdb882c2700 1 -- 172.21.15.81:0/4145815925 shutdown_connections 2023-10-07T08:48:37.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.557+0000 7fdb882c2700 1 -- 172.21.15.81:0/4145815925 wait complete. 2023-10-07T08:48:37.570 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T08:48:37.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:48:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.686+0000 7fd782045700 1 Processor -- start 2023-10-07T08:48:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.686+0000 7fd782045700 1 -- start start 2023-10-07T08:48:37.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.687+0000 7fd782045700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd77c0b3bd0 0x7fd77c0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:37.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.687+0000 7fd782045700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd77c1583b0 0x7fd77c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.687+0000 7fd782045700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77c0b2890 con 0x7fd77c157fe0 2023-10-07T08:48:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.687+0000 7fd782045700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77c0b4070 con 0x7fd77c1583b0 2023-10-07T08:48:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.687+0000 7fd782045700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c0b4350 con 0x7fd77c0b3bd0 2023-10-07T08:48:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.687+0000 7fd77b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd77c157fe0 0x7fd77c0b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45674/0 (socket says 172.21.15.81:45674) 2023-10-07T08:48:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.687+0000 7fd77b7fe700 1 -- 172.21.15.81:0/567962162 learned_addr learned my addr 172.21.15.81:0/567962162 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.687+0000 7fd77bfff700 1 --2- 172.21.15.81:0/567962162 >> v2:172.21.15.89:3300/0 conn(0x7fd77c1583b0 0x7fd77c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.687+0000 7fd77affd700 1 --2- 172.21.15.81:0/567962162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd77c0b3bd0 0x7fd77c0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.688+0000 7fd77a7fc700 1 -- 172.21.15.81:0/567962162 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007447715 0 0) 0x7fd77c0b2890 con 0x7fd77c157fe0 2023-10-07T08:48:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.688+0000 7fd77a7fc700 1 -- 172.21.15.81:0/567962162 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd764003570 con 0x7fd77c157fe0 2023-10-07T08:48:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.688+0000 7fd77bfff700 1 -- 172.21.15.81:0/567962162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd77c0b3bd0 msgr2=0x7fd77c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:37.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.688+0000 7fd77bfff700 1 --2- 172.21.15.81:0/567962162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd77c0b3bd0 0x7fd77c0ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.688+0000 7fd77bfff700 1 -- 172.21.15.81:0/567962162 >> v1:172.21.15.81:6789/0 conn(0x7fd77c157fe0 legacy=0x7fd77c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:37.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.688+0000 7fd77bfff700 1 -- 172.21.15.81:0/567962162 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c0b4630 con 0x7fd77c1583b0 2023-10-07T08:48:37.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.688+0000 7fd77affd700 1 --2- 172.21.15.81:0/567962162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd77c0b3bd0 0x7fd77c0ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:48:37.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.688+0000 7fd77bfff700 1 --2- 172.21.15.81:0/567962162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd77c1583b0 0x7fd77c0cf070 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd7740098e0 tx=0x7fd7740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee3666afb24943b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:37.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.688+0000 7fd77a7fc700 1 -- 172.21.15.81:0/567962162 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774011630 con 0x7fd77c1583b0 2023-10-07T08:48:37.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.688+0000 7fd77a7fc700 1 -- 172.21.15.81:0/567962162 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd774011790 con 0x7fd77c1583b0 2023-10-07T08:48:37.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.688+0000 7fd77a7fc700 1 -- 172.21.15.81:0/567962162 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774011b30 con 0x7fd77c1583b0 2023-10-07T08:48:37.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.689+0000 7fd782045700 1 -- 172.21.15.81:0/567962162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd77c1583b0 msgr2=0x7fd77c0cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:37.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.689+0000 7fd782045700 1 --2- 172.21.15.81:0/567962162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd77c1583b0 0x7fd77c0cf070 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd7740098e0 tx=0x7fd7740091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.689+0000 7fd782045700 1 -- 172.21.15.81:0/567962162 shutdown_connections 2023-10-07T08:48:37.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.689+0000 7fd782045700 1 --2- 172.21.15.81:0/567962162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd77c1583b0 0x7fd77c0cf070 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.689+0000 7fd782045700 1 --2- 172.21.15.81:0/567962162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd77c0b3bd0 0x7fd77c0ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.689+0000 7fd782045700 1 -- 172.21.15.81:0/567962162 >> 172.21.15.81:0/567962162 conn(0x7fd77c067640 msgr2=0x7fd77c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:37.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.689+0000 7fd782045700 1 -- 172.21.15.81:0/567962162 shutdown_connections 2023-10-07T08:48:37.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.689+0000 7fd782045700 1 -- 172.21.15.81:0/567962162 wait complete. 2023-10-07T08:48:37.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.690+0000 7fd782045700 1 Processor -- start 2023-10-07T08:48:37.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.690+0000 7fd782045700 1 -- start start 2023-10-07T08:48:37.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd782045700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd77c0b3bd0 0x7fd77c06e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd782045700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd77c157fe0 0x7fd77c15a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd782045700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd77c1583b0 0x7fd77c14d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd782045700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c06ec90 con 0x7fd77c0b3bd0 2023-10-07T08:48:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd782045700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c06d240 con 0x7fd77c157fe0 2023-10-07T08:48:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd782045700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c06d520 con 0x7fd77c1583b0 2023-10-07T08:48:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd77b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd77c0b3bd0 0x7fd77c06e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd77b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd77c0b3bd0 0x7fd77c06e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42082/0 (socket says 172.21.15.81:42082) 2023-10-07T08:48:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd77b7fe700 1 -- 172.21.15.81:0/2460547447 learned_addr learned my addr 172.21.15.81:0/2460547447 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd77affd700 1 --2- 172.21.15.81:0/2460547447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd77c157fe0 0x7fd77c15a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd77bfff700 1 --2- 172.21.15.81:0/2460547447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd77c1583b0 0x7fd77c14d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd77b7fe700 1 -- 172.21.15.81:0/2460547447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd77c1583b0 msgr2=0x7fd77c14d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd77b7fe700 1 --2- 172.21.15.81:0/2460547447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd77c1583b0 0x7fd77c14d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd77b7fe700 1 -- 172.21.15.81:0/2460547447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd77c157fe0 msgr2=0x7fd77c15a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd77b7fe700 1 --2- 172.21.15.81:0/2460547447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd77c157fe0 0x7fd77c15a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd77b7fe700 1 -- 172.21.15.81:0/2460547447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd770009420 con 0x7fd77c0b3bd0 2023-10-07T08:48:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd77affd700 1 --2- 172.21.15.81:0/2460547447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd77c157fe0 0x7fd77c15a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd77b7fe700 1 --2- 172.21.15.81:0/2460547447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd77c0b3bd0 0x7fd77c06e750 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00cd30 tx=0x7fd76c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd7637fe700 1 -- 172.21.15.81:0/2460547447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c00ce90 con 0x7fd77c0b3bd0 2023-10-07T08:48:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd7637fe700 1 -- 172.21.15.81:0/2460547447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c00ab70 con 0x7fd77c0b3bd0 2023-10-07T08:48:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd7637fe700 1 -- 172.21.15.81:0/2460547447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c0070f0 con 0x7fd77c0b3bd0 2023-10-07T08:48:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd782045700 1 -- 172.21.15.81:0/2460547447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd774009420 con 0x7fd77c0b3bd0 2023-10-07T08:48:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.691+0000 7fd782045700 1 -- 172.21.15.81:0/2460547447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77c06dae0 con 0x7fd77c0b3bd0 2023-10-07T08:48:37.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.692+0000 7fd782045700 1 -- 172.21.15.81:0/2460547447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77c069e40 con 0x7fd77c0b3bd0 2023-10-07T08:48:37.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.693+0000 7fd7637fe700 1 -- 172.21.15.81:0/2460547447 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd76c007520 con 0x7fd77c0b3bd0 2023-10-07T08:48:37.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.693+0000 7fd7637fe700 1 --2- 172.21.15.81:0/2460547447 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd768066f30 0x7fd7680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:37.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.693+0000 7fd7637fe700 1 -- 172.21.15.81:0/2460547447 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd76c0846a0 con 0x7fd77c0b3bd0 2023-10-07T08:48:37.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.693+0000 7fd77affd700 1 --2- 172.21.15.81:0/2460547447 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd768066f30 0x7fd7680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:37.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.694+0000 7fd77affd700 1 --2- 172.21.15.81:0/2460547447 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd768066f30 0x7fd7680693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd7700093f0 tx=0x7fd770008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:37.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.698+0000 7fd7637fe700 1 -- 172.21.15.81:0/2460547447 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd76c051ce0 con 0x7fd77c0b3bd0 2023-10-07T08:48:37.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.879+0000 7fd782045700 1 -- 172.21.15.81:0/2460547447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd77c071b10 con 0x7fd77c0b3bd0 2023-10-07T08:48:37.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.879+0000 7fd7637fe700 1 -- 172.21.15.81:0/2460547447 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd76c055300 con 0x7fd77c0b3bd0 2023-10-07T08:48:37.881 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:48:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.882+0000 7fd782045700 1 -- 172.21.15.81:0/2460547447 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd768066f30 msgr2=0x7fd7680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.882+0000 7fd782045700 1 --2- 172.21.15.81:0/2460547447 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd768066f30 0x7fd7680693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd7700093f0 tx=0x7fd770008040 comp rx=0 tx=0).stop 2023-10-07T08:48:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.882+0000 7fd782045700 1 -- 172.21.15.81:0/2460547447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd77c0b3bd0 msgr2=0x7fd77c06e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.882+0000 7fd782045700 1 --2- 172.21.15.81:0/2460547447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd77c0b3bd0 0x7fd77c06e750 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00cd30 tx=0x7fd76c001b10 comp rx=0 tx=0).stop 2023-10-07T08:48:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.882+0000 7fd782045700 1 -- 172.21.15.81:0/2460547447 shutdown_connections 2023-10-07T08:48:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.882+0000 7fd782045700 1 --2- 172.21.15.81:0/2460547447 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd768066f30 0x7fd7680693e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.882+0000 7fd782045700 1 --2- 172.21.15.81:0/2460547447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd77c1583b0 0x7fd77c14d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.882+0000 7fd782045700 1 --2- 172.21.15.81:0/2460547447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd77c0b3bd0 0x7fd77c06e750 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.882+0000 7fd782045700 1 --2- 172.21.15.81:0/2460547447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd77c157fe0 0x7fd77c15a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:37.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.882+0000 7fd782045700 1 -- 172.21.15.81:0/2460547447 >> 172.21.15.81:0/2460547447 conn(0x7fd77c067640 msgr2=0x7fd77c1545c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:37.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.882+0000 7fd782045700 1 -- 172.21.15.81:0/2460547447 shutdown_connections 2023-10-07T08:48:37.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:37.882+0000 7fd782045700 1 -- 172.21.15.81:0/2460547447 wait complete. 2023-10-07T08:48:37.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T08:48:38.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.008+0000 7feec80c2700 1 Processor -- start 2023-10-07T08:48:38.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.008+0000 7feec80c2700 1 -- start start 2023-10-07T08:48:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.009+0000 7feec80c2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec01578d0 0x7feec00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.009+0000 7feec80c2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec00d07c0 con 0x7feec0157ca0 2023-10-07T08:48:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.009+0000 7feec80c2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec00cfbb0 con 0x7feec006d120 2023-10-07T08:48:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.009+0000 7feec80c2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec00cfe90 con 0x7feec01578d0 2023-10-07T08:48:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.009+0000 7feec565d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feec0157ca0 0x7feec015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45684/0 (socket says 172.21.15.81:45684) 2023-10-07T08:48:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.009+0000 7feec565d700 1 -- 172.21.15.81:0/1018567910 learned_addr learned my addr 172.21.15.81:0/1018567910 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.009+0000 7feec5e5e700 1 --2- 172.21.15.81:0/1018567910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec01578d0 0x7feec00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.010+0000 7feec4e5c700 1 -- 172.21.15.81:0/1018567910 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924705312 0 0) 0x7feec00d07c0 con 0x7feec0157ca0 2023-10-07T08:48:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.010+0000 7feec4e5c700 1 -- 172.21.15.81:0/1018567910 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeac003570 con 0x7feec0157ca0 2023-10-07T08:48:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.010+0000 7feec4e5c700 1 -- 172.21.15.81:0/1018567910 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970068867 0 0) 0x7feec00cfbb0 con 0x7feec006d120 2023-10-07T08:48:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.010+0000 7feec4e5c700 1 -- 172.21.15.81:0/1018567910 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feec00d07c0 con 0x7feec006d120 2023-10-07T08:48:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.010+0000 7feec5e5e700 1 -- 172.21.15.81:0/1018567910 >> v1:172.21.15.89:6789/0 conn(0x7feec006d120 legacy=0x7feec015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.010+0000 7feec5e5e700 1 -- 172.21.15.81:0/1018567910 >> v1:172.21.15.81:6789/0 conn(0x7feec0157ca0 legacy=0x7feec015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.010+0000 7feec5e5e700 1 -- 172.21.15.81:0/1018567910 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec00d0170 con 0x7feec01578d0 2023-10-07T08:48:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.010+0000 7feec5e5e700 1 --2- 172.21.15.81:0/1018567910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec01578d0 0x7feec00cf4f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feebc009910 tx=0x7feebc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=417dc8724bef90ba server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.010+0000 7feec4e5c700 1 -- 172.21.15.81:0/1018567910 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc011630 con 0x7feec01578d0 2023-10-07T08:48:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.010+0000 7feec4e5c700 1 -- 172.21.15.81:0/1018567910 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc011790 con 0x7feec01578d0 2023-10-07T08:48:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.010+0000 7feec4e5c700 1 -- 172.21.15.81:0/1018567910 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc011b30 con 0x7feec01578d0 2023-10-07T08:48:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.011+0000 7feec80c2700 1 -- 172.21.15.81:0/1018567910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec01578d0 msgr2=0x7feec00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.011+0000 7feec80c2700 1 --2- 172.21.15.81:0/1018567910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec01578d0 0x7feec00cf4f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feebc009910 tx=0x7feebc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.011+0000 7feec80c2700 1 -- 172.21.15.81:0/1018567910 shutdown_connections 2023-10-07T08:48:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.011+0000 7feec80c2700 1 --2- 172.21.15.81:0/1018567910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec01578d0 0x7feec00cf4f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.011+0000 7feec80c2700 1 -- 172.21.15.81:0/1018567910 >> 172.21.15.81:0/1018567910 conn(0x7feec006bb90 msgr2=0x7feec006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.011+0000 7feec80c2700 1 -- 172.21.15.81:0/1018567910 shutdown_connections 2023-10-07T08:48:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.011+0000 7feec80c2700 1 -- 172.21.15.81:0/1018567910 wait complete. 2023-10-07T08:48:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.012+0000 7feec80c2700 1 Processor -- start 2023-10-07T08:48:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.012+0000 7feec80c2700 1 -- start start 2023-10-07T08:48:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec80c2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec006d120 0x7feec0156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec80c2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec01578d0 0x7feec00b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec80c2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec0157ca0 0x7feec00c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec80c2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec00b50b0 con 0x7feec01578d0 2023-10-07T08:48:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec80c2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec00c7830 con 0x7feec0157ca0 2023-10-07T08:48:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec80c2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec00b52e0 con 0x7feec006d120 2023-10-07T08:48:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec565d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec01578d0 0x7feec00b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec565d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec01578d0 0x7feec00b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42090/0 (socket says 172.21.15.81:42090) 2023-10-07T08:48:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec565d700 1 -- 172.21.15.81:0/648241490 learned_addr learned my addr 172.21.15.81:0/648241490 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec5e5e700 1 --2- 172.21.15.81:0/648241490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec006d120 0x7feec0156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec665f700 1 --2- 172.21.15.81:0/648241490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec0157ca0 0x7feec00c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec565d700 1 -- 172.21.15.81:0/648241490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec006d120 msgr2=0x7feec0156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec565d700 1 --2- 172.21.15.81:0/648241490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec006d120 0x7feec0156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec565d700 1 -- 172.21.15.81:0/648241490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec0157ca0 msgr2=0x7feec00c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec565d700 1 --2- 172.21.15.81:0/648241490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec0157ca0 0x7feec00c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec565d700 1 -- 172.21.15.81:0/648241490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc009420 con 0x7feec01578d0 2023-10-07T08:48:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec565d700 1 --2- 172.21.15.81:0/648241490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec01578d0 0x7feec00b4b70 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7feeb000c790 tx=0x7feeb0007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feeb5ffb700 1 -- 172.21.15.81:0/648241490 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0005b30 con 0x7feec01578d0 2023-10-07T08:48:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feeb5ffb700 1 -- 172.21.15.81:0/648241490 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb0005c90 con 0x7feec01578d0 2023-10-07T08:48:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feec80c2700 1 -- 172.21.15.81:0/648241490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec00b55c0 con 0x7feec01578d0 2023-10-07T08:48:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.013+0000 7feeb5ffb700 1 -- 172.21.15.81:0/648241490 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0007300 con 0x7feec01578d0 2023-10-07T08:48:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.014+0000 7feec80c2700 1 -- 172.21.15.81:0/648241490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec00b5b80 con 0x7feec01578d0 2023-10-07T08:48:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.014+0000 7feec80c2700 1 -- 172.21.15.81:0/648241490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec0067ac0 con 0x7feec01578d0 2023-10-07T08:48:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.015+0000 7feeb5ffb700 1 -- 172.21.15.81:0/648241490 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feeb001b3b0 con 0x7feec01578d0 2023-10-07T08:48:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.015+0000 7feeb5ffb700 1 --2- 172.21.15.81:0/648241490 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feea4066fb0 0x7feea4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.015+0000 7feeb5ffb700 1 -- 172.21.15.81:0/648241490 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4853+0+0 (secure 0 0 0) 0x7feeb00836b0 con 0x7feec01578d0 2023-10-07T08:48:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.015+0000 7feec5e5e700 1 --2- 172.21.15.81:0/648241490 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feea4066fb0 0x7feea4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.016+0000 7feec5e5e700 1 --2- 172.21.15.81:0/648241490 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feea4066fb0 0x7feea4069460 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7feebc009860 tx=0x7feebc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.019+0000 7feeb5ffb700 1 -- 172.21.15.81:0/648241490 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feeb0054660 con 0x7feec01578d0 2023-10-07T08:48:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.205+0000 7feec80c2700 1 -- 172.21.15.81:0/648241490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7feec00d0450 con 0x7feec01578d0 2023-10-07T08:48:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.206+0000 7feeb5ffb700 1 -- 172.21.15.81:0/648241490 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v119) v1 ==== 84+0+65 (secure 0 0 0) 0x7feeb0017090 con 0x7feec01578d0 2023-10-07T08:48:38.207 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:38.207 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-07T08:48:38.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:48:38.208 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-07T08:48:38.208 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-07T08:48:38.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:48:38.208 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-07T08:48:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.208+0000 7feec80c2700 1 -- 172.21.15.81:0/648241490 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feea4066fb0 msgr2=0x7feea4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.208+0000 7feec80c2700 1 --2- 172.21.15.81:0/648241490 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feea4066fb0 0x7feea4069460 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7feebc009860 tx=0x7feebc017000 comp rx=0 tx=0).stop 2023-10-07T08:48:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.208+0000 7feec80c2700 1 -- 172.21.15.81:0/648241490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec01578d0 msgr2=0x7feec00b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.208+0000 7feec80c2700 1 --2- 172.21.15.81:0/648241490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec01578d0 0x7feec00b4b70 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7feeb000c790 tx=0x7feeb0007ea0 comp rx=0 tx=0).stop 2023-10-07T08:48:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.208+0000 7feec80c2700 1 -- 172.21.15.81:0/648241490 shutdown_connections 2023-10-07T08:48:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.208+0000 7feec80c2700 1 --2- 172.21.15.81:0/648241490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec0157ca0 0x7feec00c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.208+0000 7feec80c2700 1 --2- 172.21.15.81:0/648241490 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feea4066fb0 0x7feea4069460 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.208+0000 7feec80c2700 1 --2- 172.21.15.81:0/648241490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec006d120 0x7feec0156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.208+0000 7feec80c2700 1 --2- 172.21.15.81:0/648241490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec01578d0 0x7feec00b4b70 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.208+0000 7feec80c2700 1 -- 172.21.15.81:0/648241490 >> 172.21.15.81:0/648241490 conn(0x7feec006bb90 msgr2=0x7feec0155d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.208+0000 7feec80c2700 1 -- 172.21.15.81:0/648241490 shutdown_connections 2023-10-07T08:48:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.208+0000 7feec80c2700 1 -- 172.21.15.81:0/648241490 wait complete. 2023-10-07T08:48:38.221 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T08:48:38.221 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T08:48:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.340+0000 7f0245c47700 1 Processor -- start 2023-10-07T08:48:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.340+0000 7f0245c47700 1 -- start start 2023-10-07T08:48:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.340+0000 7f0245c47700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02400ce1f0 0x7f02400aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.340+0000 7f0245c47700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f02400ce5c0 0x7f024015e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f0245c47700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f02400ac570 0x7f024006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f0245c47700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f024015dfb0 con 0x7f02400ce5c0 2023-10-07T08:48:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f0245c47700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02400acec0 con 0x7f02400ac570 2023-10-07T08:48:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f0245c47700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02400ad1a0 con 0x7f02400ce1f0 2023-10-07T08:48:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f023effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f02400ce5c0 0x7f024015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f023effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f02400ce5c0 0x7f024015e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42096/0 (socket says 172.21.15.81:42096) 2023-10-07T08:48:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f023effd700 1 -- 172.21.15.81:0/33652670 learned_addr learned my addr 172.21.15.81:0/33652670 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f023ffff700 1 --2- 172.21.15.81:0/33652670 >> v2:172.21.15.89:3300/0 conn(0x7f02400ac570 0x7f024006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f023f7fe700 1 --2- 172.21.15.81:0/33652670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02400ce1f0 0x7f02400aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f023effd700 1 -- 172.21.15.81:0/33652670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02400ce1f0 msgr2=0x7f02400aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f023effd700 1 --2- 172.21.15.81:0/33652670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02400ce1f0 0x7f02400aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f023effd700 1 -- 172.21.15.81:0/33652670 >> v2:172.21.15.89:3300/0 conn(0x7f02400ac570 msgr2=0x7f024006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f023effd700 1 --2- 172.21.15.81:0/33652670 >> v2:172.21.15.89:3300/0 conn(0x7f02400ac570 0x7f024006e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f023effd700 1 -- 172.21.15.81:0/33652670 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024015dc40 con 0x7f02400ce5c0 2023-10-07T08:48:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f023effd700 1 --2- 172.21.15.81:0/33652670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02400ce5c0 0x7f024015e440 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f02400695d0 tx=0x7f0234009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed18ce03ba9b1cd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f023e7fc700 1 -- 172.21.15.81:0/33652670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023400b860 con 0x7f02400ce5c0 2023-10-07T08:48:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f023e7fc700 1 -- 172.21.15.81:0/33652670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023400b9c0 con 0x7f02400ce5c0 2023-10-07T08:48:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.341+0000 7f023e7fc700 1 -- 172.21.15.81:0/33652670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023400bd60 con 0x7f02400ce5c0 2023-10-07T08:48:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.342+0000 7f0245c47700 1 -- 172.21.15.81:0/33652670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02400ce5c0 msgr2=0x7f024015e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.342+0000 7f0245c47700 1 --2- 172.21.15.81:0/33652670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02400ce5c0 0x7f024015e440 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f02400695d0 tx=0x7f0234009250 comp rx=0 tx=0).stop 2023-10-07T08:48:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.342+0000 7f0245c47700 1 -- 172.21.15.81:0/33652670 shutdown_connections 2023-10-07T08:48:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.342+0000 7f0245c47700 1 --2- 172.21.15.81:0/33652670 >> v2:172.21.15.89:3300/0 conn(0x7f02400ac570 0x7f024006e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.342+0000 7f0245c47700 1 --2- 172.21.15.81:0/33652670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02400ce1f0 0x7f02400aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.342+0000 7f0245c47700 1 --2- 172.21.15.81:0/33652670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02400ce5c0 0x7f024015e440 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.342+0000 7f0245c47700 1 -- 172.21.15.81:0/33652670 >> 172.21.15.81:0/33652670 conn(0x7f024006cca0 msgr2=0x7f024006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.342+0000 7f0245c47700 1 -- 172.21.15.81:0/33652670 shutdown_connections 2023-10-07T08:48:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.342+0000 7f0245c47700 1 -- 172.21.15.81:0/33652670 wait complete. 2023-10-07T08:48:38.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.343+0000 7f0245c47700 1 Processor -- start 2023-10-07T08:48:38.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.343+0000 7f0245c47700 1 -- start start 2023-10-07T08:48:38.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f0245c47700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02400ac570 0x7f024015bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:38.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f0245c47700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02400ce1f0 0x7f024006e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:38.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f0245c47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02400ce5c0 0x7f024014a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:38.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f0245c47700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0240156060 con 0x7f02400ce5c0 2023-10-07T08:48:38.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f0245c47700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024015d180 con 0x7f02400ce1f0 2023-10-07T08:48:38.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f0245c47700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024015c2f0 con 0x7f02400ac570 2023-10-07T08:48:38.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f023ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02400ce5c0 0x7f024014a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:38.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f023ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02400ce5c0 0x7f024014a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42104/0 (socket says 172.21.15.81:42104) 2023-10-07T08:48:38.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f023ffff700 1 -- 172.21.15.81:0/1578838449 learned_addr learned my addr 172.21.15.81:0/1578838449 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:38.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f023f7fe700 1 --2- 172.21.15.81:0/1578838449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02400ac570 0x7f024015bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:38.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f023effd700 1 --2- 172.21.15.81:0/1578838449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02400ce1f0 0x7f024006e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:38.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f023ffff700 1 -- 172.21.15.81:0/1578838449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02400ac570 msgr2=0x7f024015bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:38.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f023ffff700 1 --2- 172.21.15.81:0/1578838449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02400ac570 0x7f024015bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:38.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f023ffff700 1 -- 172.21.15.81:0/1578838449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02400ce1f0 msgr2=0x7f024006e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:38.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f023ffff700 1 --2- 172.21.15.81:0/1578838449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02400ce1f0 0x7f024006e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:38.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f023ffff700 1 -- 172.21.15.81:0/1578838449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02340094f0 con 0x7f02400ce5c0 2023-10-07T08:48:38.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.344+0000 7f023ffff700 1 --2- 172.21.15.81:0/1578838449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02400ce5c0 0x7f024014a210 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f023800c880 tx=0x7f0238008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:38.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.345+0000 7f02277fe700 1 -- 172.21.15.81:0/1578838449 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0238011600 con 0x7f02400ce5c0 2023-10-07T08:48:38.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.345+0000 7f02277fe700 1 -- 172.21.15.81:0/1578838449 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0238011760 con 0x7f02400ce5c0 2023-10-07T08:48:38.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.345+0000 7f0245c47700 1 -- 172.21.15.81:0/1578838449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f024015c570 con 0x7f02400ce5c0 2023-10-07T08:48:38.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.345+0000 7f02277fe700 1 -- 172.21.15.81:0/1578838449 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0238011b20 con 0x7f02400ce5c0 2023-10-07T08:48:38.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.345+0000 7f0245c47700 1 -- 172.21.15.81:0/1578838449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024015cb30 con 0x7f02400ce5c0 2023-10-07T08:48:38.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.346+0000 7f0245c47700 1 -- 172.21.15.81:0/1578838449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0240068900 con 0x7f02400ce5c0 2023-10-07T08:48:38.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.346+0000 7f02277fe700 1 -- 172.21.15.81:0/1578838449 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0238018360 con 0x7f02400ce5c0 2023-10-07T08:48:38.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.346+0000 7f02277fe700 1 --2- 172.21.15.81:0/1578838449 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f022c066f30 0x7f022c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:38.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.346+0000 7f02277fe700 1 -- 172.21.15.81:0/1578838449 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0238083ce0 con 0x7f02400ce5c0 2023-10-07T08:48:38.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.346+0000 7f023f7fe700 1 --2- 172.21.15.81:0/1578838449 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f022c066f30 0x7f022c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:38.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.347+0000 7f023f7fe700 1 --2- 172.21.15.81:0/1578838449 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f022c066f30 0x7f022c0693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f023000f610 tx=0x7f02300077f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:38.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.351+0000 7f02277fe700 1 -- 172.21.15.81:0/1578838449 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0238054d30 con 0x7f02400ce5c0 2023-10-07T08:48:38.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:38.534+0000 7f0245c47700 1 -- 172.21.15.81:0/1578838449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f024004bb80 con 0x7f02400ce5c0 2023-10-07T08:48:39.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.279+0000 7f02277fe700 1 -- 172.21.15.81:0/1578838449 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v120) v1 ==== 138+0+0 (secure 0 0 0) 0x7f02380548c0 con 0x7f02400ce5c0 2023-10-07T08:48:39.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.282+0000 7f0245c47700 1 -- 172.21.15.81:0/1578838449 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f022c066f30 msgr2=0x7f022c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:39.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.282+0000 7f0245c47700 1 --2- 172.21.15.81:0/1578838449 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f022c066f30 0x7f022c0693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f023000f610 tx=0x7f02300077f0 comp rx=0 tx=0).stop 2023-10-07T08:48:39.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.282+0000 7f0245c47700 1 -- 172.21.15.81:0/1578838449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02400ce5c0 msgr2=0x7f024014a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:39.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.282+0000 7f0245c47700 1 --2- 172.21.15.81:0/1578838449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02400ce5c0 0x7f024014a210 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f023800c880 tx=0x7f0238008040 comp rx=0 tx=0).stop 2023-10-07T08:48:39.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.282+0000 7f0245c47700 1 -- 172.21.15.81:0/1578838449 shutdown_connections 2023-10-07T08:48:39.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.282+0000 7f0245c47700 1 --2- 172.21.15.81:0/1578838449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02400ce5c0 0x7f024014a210 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:39.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.282+0000 7f0245c47700 1 --2- 172.21.15.81:0/1578838449 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f022c066f30 0x7f022c0693e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:39.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.282+0000 7f0245c47700 1 --2- 172.21.15.81:0/1578838449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02400ac570 0x7f024015bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:39.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.282+0000 7f0245c47700 1 --2- 172.21.15.81:0/1578838449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02400ce1f0 0x7f024006e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:39.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.282+0000 7f0245c47700 1 -- 172.21.15.81:0/1578838449 >> 172.21.15.81:0/1578838449 conn(0x7f024006cca0 msgr2=0x7f02401599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:39.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.282+0000 7f0245c47700 1 -- 172.21.15.81:0/1578838449 shutdown_connections 2023-10-07T08:48:39.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.282+0000 7f0245c47700 1 -- 172.21.15.81:0/1578838449 wait complete. 2023-10-07T08:48:39.287 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-07T08:48:39.296 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T08:48:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.418+0000 7f7c38a76700 1 Processor -- start 2023-10-07T08:48:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.418+0000 7f7c38a76700 1 -- start start 2023-10-07T08:48:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.419+0000 7f7c38a76700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341577c0 0x7f7c34068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.419+0000 7f7c38a76700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7c34157b90 0x7f7c34068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.419+0000 7f7c38a76700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c340cca80 con 0x7f7c340cb790 2023-10-07T08:48:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.419+0000 7f7c38a76700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c340cedd0 con 0x7f7c34157b90 2023-10-07T08:48:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.419+0000 7f7c38a76700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340cc4c0 con 0x7f7c341577c0 2023-10-07T08:48:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.419+0000 7f7c32d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7c340cb790 0x7f7c340cbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45700/0 (socket says 172.21.15.81:45700) 2023-10-07T08:48:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.419+0000 7f7c32d9d700 1 -- 172.21.15.81:0/4189969071 learned_addr learned my addr 172.21.15.81:0/4189969071 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.419+0000 7f7c31d9b700 1 -- 172.21.15.81:0/4189969071 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143902747 0 0) 0x7f7c340cca80 con 0x7f7c340cb790 2023-10-07T08:48:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c29d9b700 1 --2- 172.21.15.81:0/4189969071 >> v2:172.21.15.89:3300/0 conn(0x7f7c34157b90 0x7f7c34068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c3259c700 1 --2- 172.21.15.81:0/4189969071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341577c0 0x7f7c34068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c31d9b700 1 -- 172.21.15.81:0/4189969071 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c20003570 con 0x7f7c340cb790 2023-10-07T08:48:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c31d9b700 1 -- 172.21.15.81:0/4189969071 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 841204006 0 0) 0x7f7c20003570 con 0x7f7c340cb790 2023-10-07T08:48:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c31d9b700 1 -- 172.21.15.81:0/4189969071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341577c0 msgr2=0x7f7c34068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c31d9b700 1 --2- 172.21.15.81:0/4189969071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341577c0 0x7f7c34068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c31d9b700 1 -- 172.21.15.81:0/4189969071 >> v2:172.21.15.89:3300/0 conn(0x7f7c34157b90 msgr2=0x7f7c34068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c31d9b700 1 --2- 172.21.15.81:0/4189969071 >> v2:172.21.15.89:3300/0 conn(0x7f7c34157b90 0x7f7c34068d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c31d9b700 1 -- 172.21.15.81:0/4189969071 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c340cc7a0 con 0x7f7c340cb790 2023-10-07T08:48:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c31d9b700 1 -- 172.21.15.81:0/4189969071 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f7c2c0017f0 con 0x7f7c340cb790 2023-10-07T08:48:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c31d9b700 1 -- 172.21.15.81:0/4189969071 >> v1:172.21.15.81:6789/0 conn(0x7f7c340cb790 legacy=0x7f7c340cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c31d9b700 1 --2- 172.21.15.81:0/4189969071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c20003a60 0x7f7c20003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c31d9b700 1 --2- 172.21.15.81:0/4189969071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341577c0 0x7f7c20004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c31d9b700 1 --2- 172.21.15.81:0/4189969071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c20004d50 0x7f7c200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c31d9b700 1 -- 172.21.15.81:0/4189969071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340cedd0 con 0x7f7c20003a60 2023-10-07T08:48:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c31d9b700 1 -- 172.21.15.81:0/4189969071 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340cc4c0 con 0x7f7c20004d50 2023-10-07T08:48:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c31d9b700 1 -- 172.21.15.81:0/4189969071 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2000ba60 con 0x7f7c341577c0 2023-10-07T08:48:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c3259c700 1 --2- 172.21.15.81:0/4189969071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c20003a60 0x7f7c20003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c29d9b700 1 --2- 172.21.15.81:0/4189969071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341577c0 0x7f7c20004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c32d9d700 1 --2- 172.21.15.81:0/4189969071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c20004d50 0x7f7c200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c3259c700 1 -- 172.21.15.81:0/4189969071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341577c0 msgr2=0x7f7c20004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c3259c700 1 --2- 172.21.15.81:0/4189969071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c341577c0 0x7f7c20004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c3259c700 1 -- 172.21.15.81:0/4189969071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c20004d50 msgr2=0x7f7c200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c3259c700 1 --2- 172.21.15.81:0/4189969071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c20004d50 0x7f7c200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c3259c700 1 -- 172.21.15.81:0/4189969071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c20003570 con 0x7f7c20003a60 2023-10-07T08:48:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.420+0000 7f7c3259c700 1 --2- 172.21.15.81:0/4189969071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c20003a60 0x7f7c20003e70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009c00 tx=0x7f7c240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5b404dc248e25d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.421+0000 7f7c31d9b700 1 -- 172.21.15.81:0/4189969071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400e6b0 con 0x7f7c20003a60 2023-10-07T08:48:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.421+0000 7f7c31d9b700 1 -- 172.21.15.81:0/4189969071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2400e810 con 0x7f7c20003a60 2023-10-07T08:48:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.421+0000 7f7c31d9b700 1 -- 172.21.15.81:0/4189969071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400ebd0 con 0x7f7c20003a60 2023-10-07T08:48:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.421+0000 7f7c38a76700 1 -- 172.21.15.81:0/4189969071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c20003a60 msgr2=0x7f7c20003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.421+0000 7f7c38a76700 1 --2- 172.21.15.81:0/4189969071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c20003a60 0x7f7c20003e70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009c00 tx=0x7f7c240091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.421+0000 7f7c32d9d700 1 -- 172.21.15.81:0/4189969071 reap_dead start 2023-10-07T08:48:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.421+0000 7f7c38a76700 1 -- 172.21.15.81:0/4189969071 shutdown_connections 2023-10-07T08:48:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.421+0000 7f7c38a76700 1 -- 172.21.15.81:0/4189969071 >> 172.21.15.81:0/4189969071 conn(0x7f7c340d0df0 msgr2=0x7f7c340d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.421+0000 7f7c38a76700 1 -- 172.21.15.81:0/4189969071 shutdown_connections 2023-10-07T08:48:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.421+0000 7f7c38a76700 1 -- 172.21.15.81:0/4189969071 wait complete. 2023-10-07T08:48:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.422+0000 7f7c38a76700 1 Processor -- start 2023-10-07T08:48:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.422+0000 7f7c38a76700 1 -- start start 2023-10-07T08:48:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.423+0000 7f7c38a76700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c20003a60 0x7f7c340b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.423+0000 7f7c38a76700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c340b69f0 0x7f7c3415bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.423+0000 7f7c38a76700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c34159180 0x7f7c34145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.423+0000 7f7c38a76700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340b6560 con 0x7f7c340b69f0 2023-10-07T08:48:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.423+0000 7f7c38a76700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3415c0e0 con 0x7f7c34159180 2023-10-07T08:48:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.423+0000 7f7c38a76700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340b5950 con 0x7f7c20003a60 2023-10-07T08:48:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.423+0000 7f7c29d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c340b69f0 0x7f7c3415bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.423+0000 7f7c29d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c340b69f0 0x7f7c3415bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42126/0 (socket says 172.21.15.81:42126) 2023-10-07T08:48:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.423+0000 7f7c29d9b700 1 -- 172.21.15.81:0/3464670848 learned_addr learned my addr 172.21.15.81:0/3464670848 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.423+0000 7f7c3259c700 1 --2- 172.21.15.81:0/3464670848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c20003a60 0x7f7c340b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.423+0000 7f7c32d9d700 1 --2- 172.21.15.81:0/3464670848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c34159180 0x7f7c34145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.424+0000 7f7c29d9b700 1 -- 172.21.15.81:0/3464670848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c20003a60 msgr2=0x7f7c340b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.424+0000 7f7c29d9b700 1 --2- 172.21.15.81:0/3464670848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c20003a60 0x7f7c340b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.424+0000 7f7c29d9b700 1 -- 172.21.15.81:0/3464670848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c34159180 msgr2=0x7f7c34145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.424+0000 7f7c29d9b700 1 --2- 172.21.15.81:0/3464670848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c34159180 0x7f7c34145450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.424+0000 7f7c29d9b700 1 -- 172.21.15.81:0/3464670848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c340b5c30 con 0x7f7c340b69f0 2023-10-07T08:48:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.424+0000 7f7c29d9b700 1 --2- 172.21.15.81:0/3464670848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c340b69f0 0x7f7c3415bba0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c011d40 tx=0x7f7c1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.424+0000 7f7c2affd700 1 -- 172.21.15.81:0/3464670848 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00fa10 con 0x7f7c340b69f0 2023-10-07T08:48:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.424+0000 7f7c2affd700 1 -- 172.21.15.81:0/3464670848 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c00fb70 con 0x7f7c340b69f0 2023-10-07T08:48:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.424+0000 7f7c38a76700 1 -- 172.21.15.81:0/3464670848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c340b5f10 con 0x7f7c340b69f0 2023-10-07T08:48:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.424+0000 7f7c2affd700 1 -- 172.21.15.81:0/3464670848 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c014440 con 0x7f7c340b69f0 2023-10-07T08:48:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.424+0000 7f7c38a76700 1 -- 172.21.15.81:0/3464670848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c341595e0 con 0x7f7c340b69f0 2023-10-07T08:48:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.425+0000 7f7c38a76700 1 -- 172.21.15.81:0/3464670848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c340b6710 con 0x7f7c340b69f0 2023-10-07T08:48:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.425+0000 7f7c2affd700 1 -- 172.21.15.81:0/3464670848 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c1c014870 con 0x7f7c340b69f0 2023-10-07T08:48:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.426+0000 7f7c2affd700 1 --2- 172.21.15.81:0/3464670848 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7c14066f30 0x7f7c140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.426+0000 7f7c2affd700 1 -- 172.21.15.81:0/3464670848 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f7c1c018030 con 0x7f7c340b69f0 2023-10-07T08:48:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.426+0000 7f7c3259c700 1 --2- 172.21.15.81:0/3464670848 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7c14066f30 0x7f7c140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:39.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.426+0000 7f7c3259c700 1 --2- 172.21.15.81:0/3464670848 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7c14066f30 0x7f7c140693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7c240091e0 tx=0x7f7c2401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:39.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.430+0000 7f7c2affd700 1 -- 172.21.15.81:0/3464670848 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c340b6710 con 0x7f7c340b69f0 2023-10-07T08:48:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:39.610+0000 7f7c38a76700 1 -- 172.21.15.81:0/3464670848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7c34159860 con 0x7f7c340b69f0 2023-10-07T08:48:40.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.294+0000 7f7c2affd700 1 -- 172.21.15.81:0/3464670848 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v121) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7c1c0220d0 con 0x7f7c340b69f0 2023-10-07T08:48:40.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.297+0000 7f7c38a76700 1 -- 172.21.15.81:0/3464670848 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7c14066f30 msgr2=0x7f7c140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:40.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.297+0000 7f7c38a76700 1 --2- 172.21.15.81:0/3464670848 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7c14066f30 0x7f7c140693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7c240091e0 tx=0x7f7c2401a000 comp rx=0 tx=0).stop 2023-10-07T08:48:40.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.297+0000 7f7c38a76700 1 -- 172.21.15.81:0/3464670848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c340b69f0 msgr2=0x7f7c3415bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:40.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.297+0000 7f7c38a76700 1 --2- 172.21.15.81:0/3464670848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c340b69f0 0x7f7c3415bba0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c011d40 tx=0x7f7c1c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.299+0000 7f7c38a76700 1 -- 172.21.15.81:0/3464670848 shutdown_connections 2023-10-07T08:48:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.299+0000 7f7c38a76700 1 --2- 172.21.15.81:0/3464670848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c34159180 0x7f7c34145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.299+0000 7f7c38a76700 1 --2- 172.21.15.81:0/3464670848 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7c14066f30 0x7f7c140693e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.299+0000 7f7c38a76700 1 --2- 172.21.15.81:0/3464670848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c20003a60 0x7f7c340b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.299+0000 7f7c38a76700 1 --2- 172.21.15.81:0/3464670848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c340b69f0 0x7f7c3415bba0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.299+0000 7f7c38a76700 1 -- 172.21.15.81:0/3464670848 >> 172.21.15.81:0/3464670848 conn(0x7f7c340d0df0 msgr2=0x7f7c340c7440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:40.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.299+0000 7f7c38a76700 1 -- 172.21.15.81:0/3464670848 shutdown_connections 2023-10-07T08:48:40.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.299+0000 7f7c38a76700 1 -- 172.21.15.81:0/3464670848 wait complete. 2023-10-07T08:48:40.300 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-07T08:48:40.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T08:48:40.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.427+0000 7fdaa57a6700 1 Processor -- start 2023-10-07T08:48:40.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.427+0000 7fdaa57a6700 1 -- start start 2023-10-07T08:48:40.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fdaa57a6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdaa01578d0 0x7fdaa00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fdaa57a6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdaa0157ca0 0x7fdaa015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fdaa57a6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa00d07c0 con 0x7fdaa006d120 2023-10-07T08:48:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fdaa57a6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa00cfbb0 con 0x7fdaa0157ca0 2023-10-07T08:48:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fdaa57a6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa00cfe90 con 0x7fdaa01578d0 2023-10-07T08:48:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fda9e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdaa0157ca0 0x7fdaa015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fda9f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdaa006d120 0x7fdaa006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45706/0 (socket says 172.21.15.81:45706) 2023-10-07T08:48:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fda9f7fe700 1 -- 172.21.15.81:0/1735401587 learned_addr learned my addr 172.21.15.81:0/1735401587 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fda9dffb700 1 -- 172.21.15.81:0/1735401587 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729901204 0 0) 0x7fdaa00d07c0 con 0x7fdaa006d120 2023-10-07T08:48:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fda9effd700 1 --2- 172.21.15.81:0/1735401587 >> v2:172.21.15.89:3300/0 conn(0x7fdaa01578d0 0x7fdaa00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fda9dffb700 1 -- 172.21.15.81:0/1735401587 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda88003570 con 0x7fdaa006d120 2023-10-07T08:48:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fda9e7fc700 1 -- 172.21.15.81:0/1735401587 >> v2:172.21.15.89:3300/0 conn(0x7fdaa01578d0 msgr2=0x7fdaa00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fda9e7fc700 1 --2- 172.21.15.81:0/1735401587 >> v2:172.21.15.89:3300/0 conn(0x7fdaa01578d0 0x7fdaa00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fda9e7fc700 1 -- 172.21.15.81:0/1735401587 >> v1:172.21.15.81:6789/0 conn(0x7fdaa006d120 legacy=0x7fdaa006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fda9e7fc700 1 -- 172.21.15.81:0/1735401587 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa00d0170 con 0x7fdaa0157ca0 2023-10-07T08:48:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fda9e7fc700 1 --2- 172.21.15.81:0/1735401587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa0157ca0 0x7fdaa015af00 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00646b0 tx=0x7fda940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628f757866960a07 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fda9dffb700 1 -- 172.21.15.81:0/1735401587 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94011630 con 0x7fdaa0157ca0 2023-10-07T08:48:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fda9dffb700 1 -- 172.21.15.81:0/1735401587 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda94011790 con 0x7fdaa0157ca0 2023-10-07T08:48:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.428+0000 7fda9dffb700 1 -- 172.21.15.81:0/1735401587 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94011b30 con 0x7fdaa0157ca0 2023-10-07T08:48:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.429+0000 7fdaa57a6700 1 -- 172.21.15.81:0/1735401587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa0157ca0 msgr2=0x7fdaa015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.429+0000 7fdaa57a6700 1 --2- 172.21.15.81:0/1735401587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa0157ca0 0x7fdaa015af00 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00646b0 tx=0x7fda940091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.429+0000 7fdaa57a6700 1 -- 172.21.15.81:0/1735401587 shutdown_connections 2023-10-07T08:48:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.429+0000 7fdaa57a6700 1 --2- 172.21.15.81:0/1735401587 >> v2:172.21.15.89:3300/0 conn(0x7fdaa01578d0 0x7fdaa00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:40.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.429+0000 7fdaa57a6700 1 --2- 172.21.15.81:0/1735401587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa0157ca0 0x7fdaa015af00 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:40.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.429+0000 7fdaa57a6700 1 -- 172.21.15.81:0/1735401587 >> 172.21.15.81:0/1735401587 conn(0x7fdaa006bb90 msgr2=0x7fdaa006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:40.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.429+0000 7fdaa57a6700 1 -- 172.21.15.81:0/1735401587 shutdown_connections 2023-10-07T08:48:40.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.429+0000 7fdaa57a6700 1 -- 172.21.15.81:0/1735401587 wait complete. 2023-10-07T08:48:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.430+0000 7fdaa57a6700 1 Processor -- start 2023-10-07T08:48:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.430+0000 7fdaa57a6700 1 -- start start 2023-10-07T08:48:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fdaa57a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa006d120 0x7fdaa00ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fdaa57a6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdaa01578d0 0x7fdaa0152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fdaa57a6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdaa0157ca0 0x7fdaa01554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fdaa57a6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa016a700 con 0x7fdaa006d120 2023-10-07T08:48:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fdaa57a6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa016a9e0 con 0x7fdaa0157ca0 2023-10-07T08:48:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fdaa57a6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa016acc0 con 0x7fdaa01578d0 2023-10-07T08:48:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fda9effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa006d120 0x7fdaa00ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fda9effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa006d120 0x7fdaa00ab2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42142/0 (socket says 172.21.15.81:42142) 2023-10-07T08:48:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fda9effd700 1 -- 172.21.15.81:0/1239771475 learned_addr learned my addr 172.21.15.81:0/1239771475 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fda9f7fe700 1 --2- 172.21.15.81:0/1239771475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdaa0157ca0 0x7fdaa01554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fda9e7fc700 1 --2- 172.21.15.81:0/1239771475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdaa01578d0 0x7fdaa0152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fda9effd700 1 -- 172.21.15.81:0/1239771475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdaa01578d0 msgr2=0x7fdaa0152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fda9effd700 1 --2- 172.21.15.81:0/1239771475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdaa01578d0 0x7fdaa0152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fda9effd700 1 -- 172.21.15.81:0/1239771475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdaa0157ca0 msgr2=0x7fdaa01554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fda9effd700 1 --2- 172.21.15.81:0/1239771475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdaa0157ca0 0x7fdaa01554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fda9effd700 1 -- 172.21.15.81:0/1239771475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda94009420 con 0x7fdaa006d120 2023-10-07T08:48:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.431+0000 7fda9f7fe700 1 --2- 172.21.15.81:0/1239771475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdaa0157ca0 0x7fdaa01554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.432+0000 7fda9effd700 1 --2- 172.21.15.81:0/1239771475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa006d120 0x7fdaa00ab2a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fda9800c7d0 tx=0x7fda98008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.432+0000 7fda86ffd700 1 -- 172.21.15.81:0/1239771475 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98011600 con 0x7fdaa006d120 2023-10-07T08:48:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.432+0000 7fda86ffd700 1 -- 172.21.15.81:0/1239771475 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda98011760 con 0x7fdaa006d120 2023-10-07T08:48:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.432+0000 7fdaa57a6700 1 -- 172.21.15.81:0/1239771475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa016afa0 con 0x7fdaa006d120 2023-10-07T08:48:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.432+0000 7fda86ffd700 1 -- 172.21.15.81:0/1239771475 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98011b20 con 0x7fdaa006d120 2023-10-07T08:48:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.432+0000 7fdaa57a6700 1 -- 172.21.15.81:0/1239771475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa0153530 con 0x7fdaa006d120 2023-10-07T08:48:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.433+0000 7fdaa57a6700 1 -- 172.21.15.81:0/1239771475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa0067ac0 con 0x7fdaa006d120 2023-10-07T08:48:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.433+0000 7fda86ffd700 1 -- 172.21.15.81:0/1239771475 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda980193f0 con 0x7fdaa006d120 2023-10-07T08:48:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.433+0000 7fda86ffd700 1 --2- 172.21.15.81:0/1239771475 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fda8c066f30 0x7fda8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.434+0000 7fda86ffd700 1 -- 172.21.15.81:0/1239771475 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fda980848e0 con 0x7fdaa006d120 2023-10-07T08:48:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.434+0000 7fda9e7fc700 1 --2- 172.21.15.81:0/1239771475 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fda8c066f30 0x7fda8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.434+0000 7fda9e7fc700 1 --2- 172.21.15.81:0/1239771475 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fda8c066f30 0x7fda8c0693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdaa01580c0 tx=0x7fda94017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:40.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.438+0000 7fda86ffd700 1 -- 172.21.15.81:0/1239771475 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda98051bb0 con 0x7fdaa006d120 2023-10-07T08:48:40.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:40.667+0000 7fdaa57a6700 1 -- 172.21.15.81:0/1239771475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdaa00b4810 con 0x7fdaa006d120 2023-10-07T08:48:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.291+0000 7fda86ffd700 1 -- 172.21.15.81:0/1239771475 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v54) v1 ==== 174+0+0 (secure 0 0 0) 0x7fda980551d0 con 0x7fdaa006d120 2023-10-07T08:48:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.300+0000 7fdaa57a6700 1 -- 172.21.15.81:0/1239771475 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fda8c066f30 msgr2=0x7fda8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.300+0000 7fdaa57a6700 1 --2- 172.21.15.81:0/1239771475 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fda8c066f30 0x7fda8c0693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdaa01580c0 tx=0x7fda94017000 comp rx=0 tx=0).stop 2023-10-07T08:48:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.300+0000 7fdaa57a6700 1 -- 172.21.15.81:0/1239771475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa006d120 msgr2=0x7fdaa00ab2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.300+0000 7fdaa57a6700 1 --2- 172.21.15.81:0/1239771475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa006d120 0x7fdaa00ab2a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fda9800c7d0 tx=0x7fda98008040 comp rx=0 tx=0).stop 2023-10-07T08:48:41.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.307+0000 7fdaa57a6700 1 -- 172.21.15.81:0/1239771475 shutdown_connections 2023-10-07T08:48:41.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.307+0000 7fdaa57a6700 1 --2- 172.21.15.81:0/1239771475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdaa0157ca0 0x7fdaa01554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.307+0000 7fdaa57a6700 1 --2- 172.21.15.81:0/1239771475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa006d120 0x7fdaa00ab2a0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.307+0000 7fdaa57a6700 1 --2- 172.21.15.81:0/1239771475 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fda8c066f30 0x7fda8c0693e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.307+0000 7fdaa57a6700 1 --2- 172.21.15.81:0/1239771475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdaa01578d0 0x7fdaa0152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.307+0000 7fdaa57a6700 1 -- 172.21.15.81:0/1239771475 >> 172.21.15.81:0/1239771475 conn(0x7fdaa006bb90 msgr2=0x7fdaa015b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.307+0000 7fdaa57a6700 1 -- 172.21.15.81:0/1239771475 shutdown_connections 2023-10-07T08:48:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.307+0000 7fdaa57a6700 1 -- 172.21.15.81:0/1239771475 wait complete. 2023-10-07T08:48:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 14 and data pool 15 2023-10-07T08:48:41.321 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:48:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.435+0000 7f5797cd7700 1 Processor -- start 2023-10-07T08:48:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.435+0000 7f5797cd7700 1 -- start start 2023-10-07T08:48:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.436+0000 7f5797cd7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57901578d0 0x7f57900cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.436+0000 7f5797cd7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5790157ca0 0x7f579015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.436+0000 7f5797cd7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57900d07c0 con 0x7f579006d120 2023-10-07T08:48:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.436+0000 7f5797cd7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57900cfbb0 con 0x7f57901578d0 2023-10-07T08:48:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.436+0000 7f5797cd7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57900cfe90 con 0x7f5790157ca0 2023-10-07T08:48:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.436+0000 7f5795a73700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57901578d0 0x7f57900cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.436+0000 7f5796274700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f579006d120 0x7f579006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45716/0 (socket says 172.21.15.81:45716) 2023-10-07T08:48:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.436+0000 7f5796274700 1 -- 172.21.15.81:0/1069533901 learned_addr learned my addr 172.21.15.81:0/1069533901 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.436+0000 7f5795a73700 1 -- 172.21.15.81:0/1069533901 >> v2:172.21.15.89:3300/0 conn(0x7f5790157ca0 msgr2=0x7f579015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.436+0000 7f5795272700 1 --2- 172.21.15.81:0/1069533901 >> v2:172.21.15.89:3300/0 conn(0x7f5790157ca0 0x7f579015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.436+0000 7f5795a73700 1 --2- 172.21.15.81:0/1069533901 >> v2:172.21.15.89:3300/0 conn(0x7f5790157ca0 0x7f579015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.436+0000 7f5795a73700 1 -- 172.21.15.81:0/1069533901 >> v1:172.21.15.81:6789/0 conn(0x7f579006d120 legacy=0x7f579006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.436+0000 7f5794a71700 1 -- 172.21.15.81:0/1069533901 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103638411 0 0) 0x7f57900d07c0 con 0x7f579006d120 2023-10-07T08:48:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.436+0000 7f5795a73700 1 -- 172.21.15.81:0/1069533901 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57900d0170 con 0x7f57901578d0 2023-10-07T08:48:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.437+0000 7f5795a73700 1 --2- 172.21.15.81:0/1069533901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57901578d0 0x7f57900cf4f0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f5790068510 tx=0x7f578c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64a6971457a577c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.437+0000 7f5794a71700 1 -- 172.21.15.81:0/1069533901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c00e070 con 0x7f57901578d0 2023-10-07T08:48:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.437+0000 7f5794a71700 1 -- 172.21.15.81:0/1069533901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c00bc30 con 0x7f57901578d0 2023-10-07T08:48:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.437+0000 7f5794a71700 1 -- 172.21.15.81:0/1069533901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c012430 con 0x7f57901578d0 2023-10-07T08:48:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.437+0000 7f5797cd7700 1 -- 172.21.15.81:0/1069533901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57901578d0 msgr2=0x7f57900cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.437+0000 7f5797cd7700 1 --2- 172.21.15.81:0/1069533901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57901578d0 0x7f57900cf4f0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f5790068510 tx=0x7f578c009780 comp rx=0 tx=0).stop 2023-10-07T08:48:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.437+0000 7f5797cd7700 1 -- 172.21.15.81:0/1069533901 shutdown_connections 2023-10-07T08:48:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.437+0000 7f5797cd7700 1 --2- 172.21.15.81:0/1069533901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57901578d0 0x7f57900cf4f0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.437+0000 7f5797cd7700 1 --2- 172.21.15.81:0/1069533901 >> v2:172.21.15.89:3300/0 conn(0x7f5790157ca0 0x7f579015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.437+0000 7f5797cd7700 1 -- 172.21.15.81:0/1069533901 >> 172.21.15.81:0/1069533901 conn(0x7f579006bb90 msgr2=0x7f579006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.437+0000 7f5797cd7700 1 -- 172.21.15.81:0/1069533901 shutdown_connections 2023-10-07T08:48:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.437+0000 7f5797cd7700 1 -- 172.21.15.81:0/1069533901 wait complete. 2023-10-07T08:48:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.438+0000 7f5797cd7700 1 Processor -- start 2023-10-07T08:48:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.439+0000 7f5797cd7700 1 -- start start 2023-10-07T08:48:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.439+0000 7f5797cd7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f579006d120 0x7f57900c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.439+0000 7f5797cd7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57901578d0 0x7f57900b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.439+0000 7f5797cd7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790157ca0 0x7f5790069b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.439+0000 7f5797cd7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900b5af0 con 0x7f5790157ca0 2023-10-07T08:48:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.439+0000 7f5797cd7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579016bbc0 con 0x7f57901578d0 2023-10-07T08:48:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.439+0000 7f5797cd7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57900c89f0 con 0x7f579006d120 2023-10-07T08:48:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.439+0000 7f5796274700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790157ca0 0x7f5790069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.439+0000 7f5796274700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790157ca0 0x7f5790069b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42170/0 (socket says 172.21.15.81:42170) 2023-10-07T08:48:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.439+0000 7f5796274700 1 -- 172.21.15.81:0/1185319132 learned_addr learned my addr 172.21.15.81:0/1185319132 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.439+0000 7f5795272700 1 --2- 172.21.15.81:0/1185319132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57901578d0 0x7f57900b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.439+0000 7f5795a73700 1 --2- 172.21.15.81:0/1185319132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f579006d120 0x7f57900c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.440+0000 7f5796274700 1 -- 172.21.15.81:0/1185319132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f579006d120 msgr2=0x7f57900c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.440+0000 7f5796274700 1 --2- 172.21.15.81:0/1185319132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f579006d120 0x7f57900c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.440+0000 7f5796274700 1 -- 172.21.15.81:0/1185319132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57901578d0 msgr2=0x7f57900b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.440+0000 7f5796274700 1 --2- 172.21.15.81:0/1185319132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57901578d0 0x7f57900b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.440+0000 7f5796274700 1 -- 172.21.15.81:0/1185319132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c009a20 con 0x7f5790157ca0 2023-10-07T08:48:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.440+0000 7f5795a73700 1 --2- 172.21.15.81:0/1185319132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f579006d120 0x7f57900c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.440+0000 7f5796274700 1 --2- 172.21.15.81:0/1185319132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790157ca0 0x7f5790069b30 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f578800c810 tx=0x7f5788007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.440+0000 7f5785ffb700 1 -- 172.21.15.81:0/1185319132 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788005c00 con 0x7f5790157ca0 2023-10-07T08:48:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.440+0000 7f5785ffb700 1 -- 172.21.15.81:0/1185319132 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5788005d80 con 0x7f5790157ca0 2023-10-07T08:48:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.440+0000 7f5797cd7700 1 -- 172.21.15.81:0/1185319132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57900b5530 con 0x7f5790157ca0 2023-10-07T08:48:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.440+0000 7f5785ffb700 1 -- 172.21.15.81:0/1185319132 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788007320 con 0x7f5790157ca0 2023-10-07T08:48:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.440+0000 7f5797cd7700 1 -- 172.21.15.81:0/1185319132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579016b850 con 0x7f5790157ca0 2023-10-07T08:48:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.441+0000 7f5797cd7700 1 -- 172.21.15.81:0/1185319132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57900cf0d0 con 0x7f5790157ca0 2023-10-07T08:48:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.442+0000 7f5785ffb700 1 -- 172.21.15.81:0/1185319132 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f578801b3b0 con 0x7f5790157ca0 2023-10-07T08:48:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.442+0000 7f5785ffb700 1 --2- 172.21.15.81:0/1185319132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5774066f30 0x7f57740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.442+0000 7f5785ffb700 1 -- 172.21.15.81:0/1185319132 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5788083e50 con 0x7f5790157ca0 2023-10-07T08:48:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.442+0000 7f5795a73700 1 --2- 172.21.15.81:0/1185319132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5774066f30 0x7f57740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.443+0000 7f5795a73700 1 --2- 172.21.15.81:0/1185319132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5774066f30 0x7f57740693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5790068510 tx=0x7f578c019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.446+0000 7f5785ffb700 1 -- 172.21.15.81:0/1185319132 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5788051140 con 0x7f5790157ca0 2023-10-07T08:48:41.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.628+0000 7f5797cd7700 1 -- 172.21.15.81:0/1185319132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57900d0450 con 0x7f5790157ca0 2023-10-07T08:48:41.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.629+0000 7f5785ffb700 1 -- 172.21.15.81:0/1185319132 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+15330 (secure 0 0 0) 0x7f5788017090 con 0x7f5790157ca0 2023-10-07T08:48:41.630 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:41.630 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":122,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:48:40.667583+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:48:38.552036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-07T08:48:39.627974+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:48:41.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.631+0000 7f5797cd7700 1 -- 172.21.15.81:0/1185319132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5774066f30 msgr2=0x7f57740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:41.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.631+0000 7f5797cd7700 1 --2- 172.21.15.81:0/1185319132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5774066f30 0x7f57740693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5790068510 tx=0x7f578c019000 comp rx=0 tx=0).stop 2023-10-07T08:48:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.631+0000 7f5797cd7700 1 -- 172.21.15.81:0/1185319132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790157ca0 msgr2=0x7f5790069b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.631+0000 7f5797cd7700 1 --2- 172.21.15.81:0/1185319132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790157ca0 0x7f5790069b30 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f578800c810 tx=0x7f5788007d90 comp rx=0 tx=0).stop 2023-10-07T08:48:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.631+0000 7f5797cd7700 1 -- 172.21.15.81:0/1185319132 shutdown_connections 2023-10-07T08:48:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.631+0000 7f5797cd7700 1 --2- 172.21.15.81:0/1185319132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790157ca0 0x7f5790069b30 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.631+0000 7f5797cd7700 1 --2- 172.21.15.81:0/1185319132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5774066f30 0x7f57740693e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.631+0000 7f5797cd7700 1 --2- 172.21.15.81:0/1185319132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f579006d120 0x7f57900c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.631+0000 7f5797cd7700 1 --2- 172.21.15.81:0/1185319132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57901578d0 0x7f57900b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.631+0000 7f5797cd7700 1 -- 172.21.15.81:0/1185319132 >> 172.21.15.81:0/1185319132 conn(0x7f579006bb90 msgr2=0x7f5790154930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.631+0000 7f5797cd7700 1 -- 172.21.15.81:0/1185319132 shutdown_connections 2023-10-07T08:48:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.631+0000 7f5797cd7700 1 -- 172.21.15.81:0/1185319132 wait complete. 2023-10-07T08:48:41.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:48:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.758+0000 7f34d4ff1700 1 Processor -- start 2023-10-07T08:48:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.758+0000 7f34d4ff1700 1 -- start start 2023-10-07T08:48:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.759+0000 7f34d4ff1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34d0157ca0 0x7f34d00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.759+0000 7f34d4ff1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34d006d120 0x7f34d006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.759+0000 7f34d4ff1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d00d07c0 con 0x7f34d01578d0 2023-10-07T08:48:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.759+0000 7f34d4ff1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d006da50 con 0x7f34d006d120 2023-10-07T08:48:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.759+0000 7f34d4ff1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d00cfbb0 con 0x7f34d0157ca0 2023-10-07T08:48:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.759+0000 7f34ced9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34d006d120 0x7f34d006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.759+0000 7f34ced9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34d006d120 0x7f34d006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42176/0 (socket says 172.21.15.81:42176) 2023-10-07T08:48:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.759+0000 7f34ced9d700 1 -- 172.21.15.81:0/1461352989 learned_addr learned my addr 172.21.15.81:0/1461352989 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.759+0000 7f34cdd9b700 1 --2- 172.21.15.81:0/1461352989 >> v2:172.21.15.89:3300/0 conn(0x7f34d0157ca0 0x7f34d00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.759+0000 7f34ced9d700 1 -- 172.21.15.81:0/1461352989 >> v2:172.21.15.89:3300/0 conn(0x7f34d0157ca0 msgr2=0x7f34d00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.759+0000 7f34ced9d700 1 --2- 172.21.15.81:0/1461352989 >> v2:172.21.15.89:3300/0 conn(0x7f34d0157ca0 0x7f34d00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.759+0000 7f34ced9d700 1 -- 172.21.15.81:0/1461352989 >> v1:172.21.15.89:6789/0 conn(0x7f34d01578d0 legacy=0x7f34d015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.759+0000 7f34ced9d700 1 -- 172.21.15.81:0/1461352989 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d00cfe90 con 0x7f34d006d120 2023-10-07T08:48:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.759+0000 7f34cdd9b700 1 --2- 172.21.15.81:0/1461352989 >> v2:172.21.15.89:3300/0 conn(0x7f34d0157ca0 0x7f34d00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.759+0000 7f34ced9d700 1 --2- 172.21.15.81:0/1461352989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d006d120 0x7f34d006d510 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f34d0068510 tx=0x7f34c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c800ead24af565 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.760+0000 7f34cd59a700 1 -- 172.21.15.81:0/1461352989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c000e070 con 0x7f34d006d120 2023-10-07T08:48:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.760+0000 7f34cd59a700 1 -- 172.21.15.81:0/1461352989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c000ba50 con 0x7f34d006d120 2023-10-07T08:48:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.760+0000 7f34cd59a700 1 -- 172.21.15.81:0/1461352989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c00092e0 con 0x7f34d006d120 2023-10-07T08:48:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.760+0000 7f34d4ff1700 1 -- 172.21.15.81:0/1461352989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d006d120 msgr2=0x7f34d006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.760+0000 7f34d4ff1700 1 --2- 172.21.15.81:0/1461352989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d006d120 0x7f34d006d510 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f34d0068510 tx=0x7f34c0009840 comp rx=0 tx=0).stop 2023-10-07T08:48:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.760+0000 7f34d4ff1700 1 -- 172.21.15.81:0/1461352989 shutdown_connections 2023-10-07T08:48:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.760+0000 7f34d4ff1700 1 --2- 172.21.15.81:0/1461352989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d006d120 0x7f34d006d510 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.760+0000 7f34d4ff1700 1 --2- 172.21.15.81:0/1461352989 >> v2:172.21.15.89:3300/0 conn(0x7f34d0157ca0 0x7f34d00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.760+0000 7f34d4ff1700 1 -- 172.21.15.81:0/1461352989 >> 172.21.15.81:0/1461352989 conn(0x7f34d006bb90 msgr2=0x7f34d006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.760+0000 7f34d4ff1700 1 -- 172.21.15.81:0/1461352989 shutdown_connections 2023-10-07T08:48:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.760+0000 7f34d4ff1700 1 -- 172.21.15.81:0/1461352989 wait complete. 2023-10-07T08:48:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.761+0000 7f34d4ff1700 1 Processor -- start 2023-10-07T08:48:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.761+0000 7f34d4ff1700 1 -- start start 2023-10-07T08:48:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.762+0000 7f34d4ff1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d006d120 0x7f34d0154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.762+0000 7f34d4ff1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d01578d0 0x7f34d01593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.762+0000 7f34d4ff1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d0157ca0 0x7f34d0159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.762+0000 7f34d4ff1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d00ad4e0 con 0x7f34d01578d0 2023-10-07T08:48:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.762+0000 7f34d4ff1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d00ad050 con 0x7f34d0157ca0 2023-10-07T08:48:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.762+0000 7f34d4ff1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d0154ec0 con 0x7f34d006d120 2023-10-07T08:48:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.762+0000 7f34cdd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d01578d0 0x7f34d01593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.762+0000 7f34cdd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d01578d0 0x7f34d01593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42192/0 (socket says 172.21.15.81:42192) 2023-10-07T08:48:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.762+0000 7f34cdd9b700 1 -- 172.21.15.81:0/1631958760 learned_addr learned my addr 172.21.15.81:0/1631958760 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.762+0000 7f34ce59c700 1 --2- 172.21.15.81:0/1631958760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d006d120 0x7f34d0154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.762+0000 7f34ced9d700 1 --2- 172.21.15.81:0/1631958760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d0157ca0 0x7f34d0159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.763+0000 7f34cdd9b700 1 -- 172.21.15.81:0/1631958760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d006d120 msgr2=0x7f34d0154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.763+0000 7f34cdd9b700 1 --2- 172.21.15.81:0/1631958760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d006d120 0x7f34d0154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.763+0000 7f34cdd9b700 1 -- 172.21.15.81:0/1631958760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d0157ca0 msgr2=0x7f34d0159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.763+0000 7f34cdd9b700 1 --2- 172.21.15.81:0/1631958760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d0157ca0 0x7f34d0159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.763+0000 7f34cdd9b700 1 -- 172.21.15.81:0/1631958760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c0009ae0 con 0x7f34d01578d0 2023-10-07T08:48:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.763+0000 7f34cdd9b700 1 --2- 172.21.15.81:0/1631958760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d01578d0 0x7f34d01593e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f34c400d890 tx=0x7f34c4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.763+0000 7f34be7fc700 1 -- 172.21.15.81:0/1631958760 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c40125f0 con 0x7f34d01578d0 2023-10-07T08:48:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.763+0000 7f34be7fc700 1 -- 172.21.15.81:0/1631958760 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c4012750 con 0x7f34d01578d0 2023-10-07T08:48:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.763+0000 7f34d4ff1700 1 -- 172.21.15.81:0/1631958760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d00aca00 con 0x7f34d01578d0 2023-10-07T08:48:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.763+0000 7f34be7fc700 1 -- 172.21.15.81:0/1631958760 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c4012b10 con 0x7f34d01578d0 2023-10-07T08:48:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.763+0000 7f34d4ff1700 1 -- 172.21.15.81:0/1631958760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d016a2e0 con 0x7f34d01578d0 2023-10-07T08:48:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.764+0000 7f34d4ff1700 1 -- 172.21.15.81:0/1631958760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d00ad1e0 con 0x7f34d01578d0 2023-10-07T08:48:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.764+0000 7f34be7fc700 1 -- 172.21.15.81:0/1631958760 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34c4014430 con 0x7f34d01578d0 2023-10-07T08:48:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.765+0000 7f34be7fc700 1 --2- 172.21.15.81:0/1631958760 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f34b0066f30 0x7f34b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.765+0000 7f34be7fc700 1 -- 172.21.15.81:0/1631958760 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34c40847d0 con 0x7f34d01578d0 2023-10-07T08:48:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.765+0000 7f34ce59c700 1 --2- 172.21.15.81:0/1631958760 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f34b0066f30 0x7f34b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.765+0000 7f34ce59c700 1 --2- 172.21.15.81:0/1631958760 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f34b0066f30 0x7f34b00693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f34c8003a80 tx=0x7f34c8007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.769+0000 7f34be7fc700 1 -- 172.21.15.81:0/1631958760 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34c40554d0 con 0x7f34d01578d0 2023-10-07T08:48:41.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.952+0000 7f34d4ff1700 1 -- 172.21.15.81:0/1631958760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34d00d0170 con 0x7f34d01578d0 2023-10-07T08:48:41.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.953+0000 7f34be7fc700 1 -- 172.21.15.81:0/1631958760 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+15330 (secure 0 0 0) 0x7f34c4055060 con 0x7f34d01578d0 2023-10-07T08:48:41.953 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:41.953 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":122,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:48:40.667583+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:48:38.552036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-07T08:48:39.627974+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:48:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.955+0000 7f34d4ff1700 1 -- 172.21.15.81:0/1631958760 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f34b0066f30 msgr2=0x7f34b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.955+0000 7f34d4ff1700 1 --2- 172.21.15.81:0/1631958760 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f34b0066f30 0x7f34b00693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f34c8003a80 tx=0x7f34c8007ec0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.955+0000 7f34d4ff1700 1 -- 172.21.15.81:0/1631958760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d01578d0 msgr2=0x7f34d01593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.955+0000 7f34d4ff1700 1 --2- 172.21.15.81:0/1631958760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d01578d0 0x7f34d01593e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f34c400d890 tx=0x7f34c4008040 comp rx=0 tx=0).stop 2023-10-07T08:48:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.955+0000 7f34d4ff1700 1 -- 172.21.15.81:0/1631958760 shutdown_connections 2023-10-07T08:48:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.955+0000 7f34d4ff1700 1 --2- 172.21.15.81:0/1631958760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d0157ca0 0x7f34d0159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.955+0000 7f34d4ff1700 1 --2- 172.21.15.81:0/1631958760 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f34b0066f30 0x7f34b00693e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.955+0000 7f34d4ff1700 1 --2- 172.21.15.81:0/1631958760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d006d120 0x7f34d0154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.955+0000 7f34d4ff1700 1 --2- 172.21.15.81:0/1631958760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d01578d0 0x7f34d01593e0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.955+0000 7f34d4ff1700 1 -- 172.21.15.81:0/1631958760 >> 172.21.15.81:0/1631958760 conn(0x7f34d006bb90 msgr2=0x7f34d0155470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.955+0000 7f34d4ff1700 1 -- 172.21.15.81:0/1631958760 shutdown_connections 2023-10-07T08:48:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:41.955+0000 7f34d4ff1700 1 -- 172.21.15.81:0/1631958760 wait complete. 2023-10-07T08:48:41.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T08:48:42.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.085+0000 7fabe1c11700 1 Processor -- start 2023-10-07T08:48:42.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.085+0000 7fabe1c11700 1 -- start start 2023-10-07T08:48:42.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabe1c11700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabdc157ca0 0x7fabdc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:42.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabe1c11700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabdc0d07c0 con 0x7fabdc1578d0 2023-10-07T08:48:42.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabe1c11700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabdc0cfbb0 con 0x7fabdc06d120 2023-10-07T08:48:42.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabe1c11700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0cfe90 con 0x7fabdc157ca0 2023-10-07T08:48:42.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabdb7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fabdc1578d0 0x7fabdc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45732/0 (socket says 172.21.15.81:45732) 2023-10-07T08:48:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabdb7fe700 1 -- 172.21.15.81:0/880269830 learned_addr learned my addr 172.21.15.81:0/880269830 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabda7fc700 1 -- 172.21.15.81:0/880269830 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889121894 0 0) 0x7fabdc0d07c0 con 0x7fabdc1578d0 2023-10-07T08:48:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabda7fc700 1 -- 172.21.15.81:0/880269830 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabc4003570 con 0x7fabdc1578d0 2023-10-07T08:48:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabdaffd700 1 --2- 172.21.15.81:0/880269830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabdc157ca0 0x7fabdc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabda7fc700 1 -- 172.21.15.81:0/880269830 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2566045871 0 0) 0x7fabc4003570 con 0x7fabdc1578d0 2023-10-07T08:48:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabda7fc700 1 -- 172.21.15.81:0/880269830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabdc157ca0 msgr2=0x7fabdc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabda7fc700 1 --2- 172.21.15.81:0/880269830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabdc157ca0 0x7fabdc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabda7fc700 1 -- 172.21.15.81:0/880269830 >> v1:172.21.15.89:6789/0 conn(0x7fabdc06d120 legacy=0x7fabdc15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabda7fc700 1 -- 172.21.15.81:0/880269830 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc0d0170 con 0x7fabdc1578d0 2023-10-07T08:48:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabda7fc700 1 -- 172.21.15.81:0/880269830 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fabcc001470 con 0x7fabdc1578d0 2023-10-07T08:48:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabda7fc700 1 -- 172.21.15.81:0/880269830 >> v1:172.21.15.81:6789/0 conn(0x7fabdc1578d0 legacy=0x7fabdc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabda7fc700 1 --2- 172.21.15.81:0/880269830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabdc157ca0 0x7fabc4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabda7fc700 1 --2- 172.21.15.81:0/880269830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4004010 0x7fabc4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabda7fc700 1 --2- 172.21.15.81:0/880269830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabc4004d50 0x7fabc40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabda7fc700 1 -- 172.21.15.81:0/880269830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0cfe90 con 0x7fabc4004010 2023-10-07T08:48:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabda7fc700 1 -- 172.21.15.81:0/880269830 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc400bbf0 con 0x7fabc4004d50 2023-10-07T08:48:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.086+0000 7fabda7fc700 1 -- 172.21.15.81:0/880269830 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc400bdb0 con 0x7fabdc157ca0 2023-10-07T08:48:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.087+0000 7fabdaffd700 1 --2- 172.21.15.81:0/880269830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4004010 0x7fabc4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.087+0000 7fabdb7fe700 1 --2- 172.21.15.81:0/880269830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabdc157ca0 0x7fabc4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.087+0000 7fabdbfff700 1 --2- 172.21.15.81:0/880269830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabc4004d50 0x7fabc40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.087+0000 7fabdaffd700 1 -- 172.21.15.81:0/880269830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabdc157ca0 msgr2=0x7fabc4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.087+0000 7fabdaffd700 1 --2- 172.21.15.81:0/880269830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabdc157ca0 0x7fabc4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.087+0000 7fabdaffd700 1 -- 172.21.15.81:0/880269830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabc4004d50 msgr2=0x7fabc40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.087+0000 7fabdaffd700 1 --2- 172.21.15.81:0/880269830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabc4004d50 0x7fabc40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.087+0000 7fabdaffd700 1 -- 172.21.15.81:0/880269830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc4003570 con 0x7fabc4004010 2023-10-07T08:48:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.087+0000 7fabdbfff700 1 --2- 172.21.15.81:0/880269830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabc4004d50 0x7fabc40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.087+0000 7fabdaffd700 1 --2- 172.21.15.81:0/880269830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4004010 0x7fabc4004810 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fabd0006f00 tx=0x7fabd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868b11070debd693 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.087+0000 7fabda7fc700 1 -- 172.21.15.81:0/880269830 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd000e710 con 0x7fabc4004010 2023-10-07T08:48:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.087+0000 7fabda7fc700 1 -- 172.21.15.81:0/880269830 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd000e870 con 0x7fabc4004010 2023-10-07T08:48:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.087+0000 7fabda7fc700 1 -- 172.21.15.81:0/880269830 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd000ec30 con 0x7fabc4004010 2023-10-07T08:48:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.087+0000 7fabe1c11700 1 -- 172.21.15.81:0/880269830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4004010 msgr2=0x7fabc4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.087+0000 7fabe1c11700 1 --2- 172.21.15.81:0/880269830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4004010 0x7fabc4004810 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fabd0006f00 tx=0x7fabd00091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.087+0000 7fabdbfff700 1 -- 172.21.15.81:0/880269830 reap_dead start 2023-10-07T08:48:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.088+0000 7fabe1c11700 1 -- 172.21.15.81:0/880269830 shutdown_connections 2023-10-07T08:48:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.088+0000 7fabe1c11700 1 -- 172.21.15.81:0/880269830 >> 172.21.15.81:0/880269830 conn(0x7fabdc06bb90 msgr2=0x7fabdc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.088+0000 7fabe1c11700 1 -- 172.21.15.81:0/880269830 shutdown_connections 2023-10-07T08:48:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.088+0000 7fabe1c11700 1 -- 172.21.15.81:0/880269830 wait complete. 2023-10-07T08:48:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.089+0000 7fabe1c11700 1 Processor -- start 2023-10-07T08:48:42.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.089+0000 7fabe1c11700 1 -- start start 2023-10-07T08:48:42.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.089+0000 7fabe1c11700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4004010 0x7fabdc16a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:42.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.089+0000 7fabe1c11700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabdc14e720 0x7fabdc14eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:42.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.089+0000 7fabe1c11700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabdc1551c0 0x7fabdc155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:42.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.089+0000 7fabe1c11700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc16a7a0 con 0x7fabc4004010 2023-10-07T08:48:42.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.089+0000 7fabe1c11700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc155b70 con 0x7fabdc14e720 2023-10-07T08:48:42.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.089+0000 7fabe1c11700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0b3d30 con 0x7fabdc1551c0 2023-10-07T08:48:42.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.090+0000 7fabdb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4004010 0x7fabdc16a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:42.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.090+0000 7fabdb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4004010 0x7fabdc16a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42206/0 (socket says 172.21.15.81:42206) 2023-10-07T08:48:42.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.090+0000 7fabdb7fe700 1 -- 172.21.15.81:0/3731661971 learned_addr learned my addr 172.21.15.81:0/3731661971 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:42.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.090+0000 7fabdaffd700 1 --2- 172.21.15.81:0/3731661971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabdc14e720 0x7fabdc14eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:42.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.090+0000 7fabdbfff700 1 --2- 172.21.15.81:0/3731661971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabdc1551c0 0x7fabdc155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:42.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.090+0000 7fabdb7fe700 1 -- 172.21.15.81:0/3731661971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabdc1551c0 msgr2=0x7fabdc155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:42.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.090+0000 7fabdb7fe700 1 --2- 172.21.15.81:0/3731661971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabdc1551c0 0x7fabdc155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:42.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.090+0000 7fabdb7fe700 1 -- 172.21.15.81:0/3731661971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabdc14e720 msgr2=0x7fabdc14eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:42.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.090+0000 7fabdb7fe700 1 --2- 172.21.15.81:0/3731661971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabdc14e720 0x7fabdc14eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:42.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.090+0000 7fabdb7fe700 1 -- 172.21.15.81:0/3731661971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc14c350 con 0x7fabc4004010 2023-10-07T08:48:42.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.090+0000 7fabdb7fe700 1 --2- 172.21.15.81:0/3731661971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4004010 0x7fabdc16a260 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0073f0 tx=0x7fabdc15b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:42.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.090+0000 7fabc37fe700 1 -- 172.21.15.81:0/3731661971 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc018030 con 0x7fabc4004010 2023-10-07T08:48:42.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.090+0000 7fabc37fe700 1 -- 172.21.15.81:0/3731661971 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc00f8d0 con 0x7fabc4004010 2023-10-07T08:48:42.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.090+0000 7fabe1c11700 1 -- 172.21.15.81:0/3731661971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabdc14f290 con 0x7fabc4004010 2023-10-07T08:48:42.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.090+0000 7fabc37fe700 1 -- 172.21.15.81:0/3731661971 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc00fc70 con 0x7fabc4004010 2023-10-07T08:48:42.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.090+0000 7fabe1c11700 1 -- 172.21.15.81:0/3731661971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabdc0b4260 con 0x7fabc4004010 2023-10-07T08:48:42.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.091+0000 7fabe1c11700 1 -- 172.21.15.81:0/3731661971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabdc067ac0 con 0x7fabc4004010 2023-10-07T08:48:42.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.091+0000 7fabc37fe700 1 -- 172.21.15.81:0/3731661971 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabcc01b070 con 0x7fabc4004010 2023-10-07T08:48:42.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.092+0000 7fabc37fe700 1 --2- 172.21.15.81:0/3731661971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fabc8066f30 0x7fabc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:42.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.092+0000 7fabc37fe700 1 -- 172.21.15.81:0/3731661971 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fabcc019070 con 0x7fabc4004010 2023-10-07T08:48:42.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.092+0000 7fabdaffd700 1 --2- 172.21.15.81:0/3731661971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fabc8066f30 0x7fabc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:42.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.092+0000 7fabdaffd700 1 --2- 172.21.15.81:0/3731661971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fabc8066f30 0x7fabc80693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fabd00091e0 tx=0x7fabd001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:42.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.096+0000 7fabc37fe700 1 -- 172.21.15.81:0/3731661971 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabcc051700 con 0x7fabc4004010 2023-10-07T08:48:42.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:42.328+0000 7fabe1c11700 1 -- 172.21.15.81:0/3731661971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fabdc0d0450 con 0x7fabc4004010 2023-10-07T08:48:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.309+0000 7fabc37fe700 1 -- 172.21.15.81:0/3731661971 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v57) v1 ==== 118+0+0 (secure 0 0 0) 0x7fabcc054d20 con 0x7fabc4004010 2023-10-07T08:48:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.311+0000 7fabe1c11700 1 -- 172.21.15.81:0/3731661971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fabc8066f30 msgr2=0x7fabc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.311+0000 7fabe1c11700 1 --2- 172.21.15.81:0/3731661971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fabc8066f30 0x7fabc80693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fabd00091e0 tx=0x7fabd001a000 comp rx=0 tx=0).stop 2023-10-07T08:48:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.311+0000 7fabe1c11700 1 -- 172.21.15.81:0/3731661971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4004010 msgr2=0x7fabdc16a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.311+0000 7fabe1c11700 1 --2- 172.21.15.81:0/3731661971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4004010 0x7fabdc16a260 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0073f0 tx=0x7fabdc15b610 comp rx=0 tx=0).stop 2023-10-07T08:48:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.311+0000 7fabe1c11700 1 -- 172.21.15.81:0/3731661971 shutdown_connections 2023-10-07T08:48:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.311+0000 7fabe1c11700 1 --2- 172.21.15.81:0/3731661971 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fabc8066f30 0x7fabc80693e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.311+0000 7fabe1c11700 1 --2- 172.21.15.81:0/3731661971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabdc1551c0 0x7fabdc155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.311+0000 7fabe1c11700 1 --2- 172.21.15.81:0/3731661971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4004010 0x7fabdc16a260 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.311+0000 7fabe1c11700 1 --2- 172.21.15.81:0/3731661971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabdc14e720 0x7fabdc14eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.311+0000 7fabe1c11700 1 -- 172.21.15.81:0/3731661971 >> 172.21.15.81:0/3731661971 conn(0x7fabdc06bb90 msgr2=0x7fabdc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.311+0000 7fabe1c11700 1 -- 172.21.15.81:0/3731661971 shutdown_connections 2023-10-07T08:48:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.311+0000 7fabe1c11700 1 -- 172.21.15.81:0/3731661971 wait complete. 2023-10-07T08:48:43.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T08:48:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.444+0000 7f4dd20a2700 1 Processor -- start 2023-10-07T08:48:43.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.444+0000 7f4dd20a2700 1 -- start start 2023-10-07T08:48:43.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.445+0000 7f4dd20a2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4dcc1578d0 0x7f4dcc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:43.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.445+0000 7f4dd20a2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4dcc06d120 0x7f4dcc06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:43.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.445+0000 7f4dd20a2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dcc0d07c0 con 0x7f4dcc157ca0 2023-10-07T08:48:43.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.445+0000 7f4dd20a2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dcc06da50 con 0x7f4dcc06d120 2023-10-07T08:48:43.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.445+0000 7f4dd20a2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dcc0cfbb0 con 0x7f4dcc1578d0 2023-10-07T08:48:43.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.445+0000 7f4dcbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4dcc06d120 0x7f4dcc06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:43.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.445+0000 7f4dcbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4dcc06d120 0x7f4dcc06d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44712/0 (socket says 172.21.15.81:44712) 2023-10-07T08:48:43.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.445+0000 7f4dcbfff700 1 -- 172.21.15.81:0/392482431 learned_addr learned my addr 172.21.15.81:0/392482431 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:43.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.445+0000 7f4dcb7fe700 1 --2- 172.21.15.81:0/392482431 >> v2:172.21.15.89:3300/0 conn(0x7f4dcc1578d0 0x7f4dcc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.445+0000 7f4dcbfff700 1 -- 172.21.15.81:0/392482431 >> v2:172.21.15.89:3300/0 conn(0x7f4dcc1578d0 msgr2=0x7f4dcc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.445+0000 7f4dcbfff700 1 --2- 172.21.15.81:0/392482431 >> v2:172.21.15.89:3300/0 conn(0x7f4dcc1578d0 0x7f4dcc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.445+0000 7f4dcbfff700 1 -- 172.21.15.81:0/392482431 >> v1:172.21.15.89:6789/0 conn(0x7f4dcc157ca0 legacy=0x7f4dcc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.445+0000 7f4dcbfff700 1 -- 172.21.15.81:0/392482431 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc0cfe90 con 0x7f4dcc06d120 2023-10-07T08:48:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.446+0000 7f4dcbfff700 1 --2- 172.21.15.81:0/392482431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc06d120 0x7f4dcc06d510 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0646b0 tx=0x7f4dc4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bf416f5bc77057 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.446+0000 7f4dca7fc700 1 -- 172.21.15.81:0/392482431 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc400e070 con 0x7f4dcc06d120 2023-10-07T08:48:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.446+0000 7f4dca7fc700 1 -- 172.21.15.81:0/392482431 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc400ba50 con 0x7f4dcc06d120 2023-10-07T08:48:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.446+0000 7f4dca7fc700 1 -- 172.21.15.81:0/392482431 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc40092e0 con 0x7f4dcc06d120 2023-10-07T08:48:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.446+0000 7f4dd20a2700 1 -- 172.21.15.81:0/392482431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc06d120 msgr2=0x7f4dcc06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.446+0000 7f4dd20a2700 1 --2- 172.21.15.81:0/392482431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc06d120 0x7f4dcc06d510 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0646b0 tx=0x7f4dc4009840 comp rx=0 tx=0).stop 2023-10-07T08:48:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.446+0000 7f4dd20a2700 1 -- 172.21.15.81:0/392482431 shutdown_connections 2023-10-07T08:48:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.446+0000 7f4dd20a2700 1 --2- 172.21.15.81:0/392482431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc06d120 0x7f4dcc06d510 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:43.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.446+0000 7f4dd20a2700 1 --2- 172.21.15.81:0/392482431 >> v2:172.21.15.89:3300/0 conn(0x7f4dcc1578d0 0x7f4dcc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:43.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.446+0000 7f4dd20a2700 1 -- 172.21.15.81:0/392482431 >> 172.21.15.81:0/392482431 conn(0x7f4dcc06bb90 msgr2=0x7f4dcc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:43.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.446+0000 7f4dd20a2700 1 -- 172.21.15.81:0/392482431 shutdown_connections 2023-10-07T08:48:43.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.446+0000 7f4dd20a2700 1 -- 172.21.15.81:0/392482431 wait complete. 2023-10-07T08:48:43.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.447+0000 7f4dd20a2700 1 Processor -- start 2023-10-07T08:48:43.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.448+0000 7f4dd20a2700 1 -- start start 2023-10-07T08:48:43.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.448+0000 7f4dd20a2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dcc06d120 0x7f4dcc153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:43.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.448+0000 7f4dd20a2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4dcc1578d0 0x7f4dcc152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.448+0000 7f4dd20a2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc157ca0 0x7f4dcc14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.448+0000 7f4dd20a2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc0b6010 con 0x7f4dcc157ca0 2023-10-07T08:48:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.448+0000 7f4dd20a2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc14ad10 con 0x7f4dcc06d120 2023-10-07T08:48:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.448+0000 7f4dd20a2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc14a6f0 con 0x7f4dcc1578d0 2023-10-07T08:48:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.448+0000 7f4dcbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc157ca0 0x7f4dcc14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.448+0000 7f4dcbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc157ca0 0x7f4dcc14a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44728/0 (socket says 172.21.15.81:44728) 2023-10-07T08:48:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.448+0000 7f4dcbfff700 1 -- 172.21.15.81:0/473378963 learned_addr learned my addr 172.21.15.81:0/473378963 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.448+0000 7f4dcb7fe700 1 --2- 172.21.15.81:0/473378963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dcc06d120 0x7f4dcc153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.448+0000 7f4dcaffd700 1 --2- 172.21.15.81:0/473378963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4dcc1578d0 0x7f4dcc152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.449+0000 7f4dcbfff700 1 -- 172.21.15.81:0/473378963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4dcc1578d0 msgr2=0x7f4dcc152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.449+0000 7f4dcbfff700 1 --2- 172.21.15.81:0/473378963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4dcc1578d0 0x7f4dcc152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.449+0000 7f4dcbfff700 1 -- 172.21.15.81:0/473378963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dcc06d120 msgr2=0x7f4dcc153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.449+0000 7f4dcbfff700 1 --2- 172.21.15.81:0/473378963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dcc06d120 0x7f4dcc153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.449+0000 7f4dcbfff700 1 -- 172.21.15.81:0/473378963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc4009ae0 con 0x7f4dcc157ca0 2023-10-07T08:48:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.449+0000 7f4dcbfff700 1 --2- 172.21.15.81:0/473378963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc157ca0 0x7f4dcc14a1b0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc06fe20 tx=0x7f4dc4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.449+0000 7f4dc37fe700 1 -- 172.21.15.81:0/473378963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4008e80 con 0x7f4dcc157ca0 2023-10-07T08:48:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.449+0000 7f4dc37fe700 1 -- 172.21.15.81:0/473378963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc400be60 con 0x7f4dcc157ca0 2023-10-07T08:48:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.449+0000 7f4dd20a2700 1 -- 172.21.15.81:0/473378963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dcc16a5e0 con 0x7f4dcc157ca0 2023-10-07T08:48:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.449+0000 7f4dc37fe700 1 -- 172.21.15.81:0/473378963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4026690 con 0x7f4dcc157ca0 2023-10-07T08:48:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.449+0000 7f4dd20a2700 1 -- 172.21.15.81:0/473378963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dcc16aba0 con 0x7f4dcc157ca0 2023-10-07T08:48:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.450+0000 7f4dd20a2700 1 -- 172.21.15.81:0/473378963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dcc067ac0 con 0x7f4dcc157ca0 2023-10-07T08:48:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.450+0000 7f4dc37fe700 1 -- 172.21.15.81:0/473378963 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4dc4003040 con 0x7f4dcc157ca0 2023-10-07T08:48:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.451+0000 7f4dc37fe700 1 --2- 172.21.15.81:0/473378963 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4dac066f30 0x7f4dac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.451+0000 7f4dc37fe700 1 -- 172.21.15.81:0/473378963 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4dc4086500 con 0x7f4dcc157ca0 2023-10-07T08:48:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.451+0000 7f4dcb7fe700 1 --2- 172.21.15.81:0/473378963 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4dac066f30 0x7f4dac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.451+0000 7f4dcb7fe700 1 --2- 172.21.15.81:0/473378963 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4dac066f30 0x7f4dac0693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc006fd0 tx=0x7f4dbc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.455+0000 7f4dc37fe700 1 -- 172.21.15.81:0/473378963 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4dc4053770 con 0x7f4dcc157ca0 2023-10-07T08:48:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:43.679+0000 7f4dd20a2700 1 -- 172.21.15.81:0/473378963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4dcc0d0170 con 0x7f4dcc157ca0 2023-10-07T08:48:44.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.313+0000 7f4dc37fe700 1 -- 172.21.15.81:0/473378963 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4dc4009940 con 0x7f4dcc157ca0 2023-10-07T08:48:44.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.316+0000 7f4dd20a2700 1 -- 172.21.15.81:0/473378963 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4dac066f30 msgr2=0x7f4dac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:44.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.316+0000 7f4dd20a2700 1 --2- 172.21.15.81:0/473378963 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4dac066f30 0x7f4dac0693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc006fd0 tx=0x7f4dbc008040 comp rx=0 tx=0).stop 2023-10-07T08:48:44.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.316+0000 7f4dd20a2700 1 -- 172.21.15.81:0/473378963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc157ca0 msgr2=0x7f4dcc14a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.316+0000 7f4dd20a2700 1 --2- 172.21.15.81:0/473378963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc157ca0 0x7f4dcc14a1b0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc06fe20 tx=0x7f4dc4018000 comp rx=0 tx=0).stop 2023-10-07T08:48:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.316+0000 7f4dd20a2700 1 -- 172.21.15.81:0/473378963 shutdown_connections 2023-10-07T08:48:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.316+0000 7f4dd20a2700 1 --2- 172.21.15.81:0/473378963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dcc157ca0 0x7f4dcc14a1b0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.316+0000 7f4dd20a2700 1 --2- 172.21.15.81:0/473378963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dcc06d120 0x7f4dcc153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.316+0000 7f4dd20a2700 1 --2- 172.21.15.81:0/473378963 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4dac066f30 0x7f4dac0693e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.316+0000 7f4dd20a2700 1 --2- 172.21.15.81:0/473378963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4dcc1578d0 0x7f4dcc152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.316+0000 7f4dd20a2700 1 -- 172.21.15.81:0/473378963 >> 172.21.15.81:0/473378963 conn(0x7f4dcc06bb90 msgr2=0x7f4dcc155720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.316+0000 7f4dd20a2700 1 -- 172.21.15.81:0/473378963 shutdown_connections 2023-10-07T08:48:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.316+0000 7f4dd20a2700 1 -- 172.21.15.81:0/473378963 wait complete. 2023-10-07T08:48:44.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:48:44.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.443+0000 7f0786eff700 1 Processor -- start 2023-10-07T08:48:44.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.443+0000 7f0786eff700 1 -- start start 2023-10-07T08:48:44.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.444+0000 7f0786eff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0780159f10 0x7f0780068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:44.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.444+0000 7f0786eff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0780069120 con 0x7f0780068cc0 2023-10-07T08:48:44.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.444+0000 7f0786eff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07800cee10 con 0x7f0780159b40 2023-10-07T08:48:44.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.444+0000 7f0786eff700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07800cd040 con 0x7f0780159f10 2023-10-07T08:48:44.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.444+0000 7f07866fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0780068cc0 0x7f07800cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46490/0 (socket says 172.21.15.81:46490) 2023-10-07T08:48:44.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.444+0000 7f07866fe700 1 -- 172.21.15.81:0/2043360978 learned_addr learned my addr 172.21.15.81:0/2043360978 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:44.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.444+0000 7f0784efb700 1 -- 172.21.15.81:0/2043360978 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301472228 0 0) 0x7f0778001490 con 0x7f0780068cc0 2023-10-07T08:48:44.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.444+0000 7f0784efb700 1 -- 172.21.15.81:0/2043360978 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f076c003570 con 0x7f0780068cc0 2023-10-07T08:48:44.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.444+0000 7f07856fc700 1 --2- 172.21.15.81:0/2043360978 >> v2:172.21.15.89:3300/0 conn(0x7f0780159f10 0x7f0780068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:44.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.444+0000 7f0784efb700 1 -- 172.21.15.81:0/2043360978 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1108375996 0 0) 0x7f076c003570 con 0x7f0780068cc0 2023-10-07T08:48:44.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.444+0000 7f0784efb700 1 -- 172.21.15.81:0/2043360978 >> v2:172.21.15.89:3300/0 conn(0x7f0780159f10 msgr2=0x7f0780068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:44.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.444+0000 7f0784efb700 1 --2- 172.21.15.81:0/2043360978 >> v2:172.21.15.89:3300/0 conn(0x7f0780159f10 0x7f0780068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f0784efb700 1 -- 172.21.15.81:0/2043360978 >> v1:172.21.15.89:6789/0 conn(0x7f0780159b40 legacy=0x7f07800cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:44.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f0784efb700 1 -- 172.21.15.81:0/2043360978 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07800cd320 con 0x7f0780068cc0 2023-10-07T08:48:44.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f0784efb700 1 -- 172.21.15.81:0/2043360978 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f0778001980 con 0x7f0780068cc0 2023-10-07T08:48:44.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f07856fc700 1 --2- 172.21.15.81:0/2043360978 >> v2:172.21.15.89:3300/0 conn(0x7f0780159f10 0x7f0780068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:44.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f0784efb700 1 -- 172.21.15.81:0/2043360978 >> v1:172.21.15.81:6789/0 conn(0x7f0780068cc0 legacy=0x7f07800cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:44.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f0784efb700 1 --2- 172.21.15.81:0/2043360978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f076c003a60 0x7f076c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:44.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f0784efb700 1 --2- 172.21.15.81:0/2043360978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f076c004810 0x7f076c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:44.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f0784efb700 1 --2- 172.21.15.81:0/2043360978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f076c0052e0 0x7f076c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:44.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f0784efb700 1 -- 172.21.15.81:0/2043360978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07800cd040 con 0x7f076c0052e0 2023-10-07T08:48:44.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f0784efb700 1 -- 172.21.15.81:0/2043360978 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c00c190 con 0x7f076c004810 2023-10-07T08:48:44.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f0784efb700 1 -- 172.21.15.81:0/2043360978 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c00c350 con 0x7f076c003a60 2023-10-07T08:48:44.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f07866fe700 1 --2- 172.21.15.81:0/2043360978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f076c0052e0 0x7f076c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:44.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f0785efd700 1 --2- 172.21.15.81:0/2043360978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f076c003a60 0x7f076c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:44.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f07856fc700 1 --2- 172.21.15.81:0/2043360978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f076c004810 0x7f076c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:44.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f07866fe700 1 -- 172.21.15.81:0/2043360978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f076c003a60 msgr2=0x7f076c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:44.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f07866fe700 1 --2- 172.21.15.81:0/2043360978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f076c003a60 0x7f076c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f07866fe700 1 -- 172.21.15.81:0/2043360978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f076c004810 msgr2=0x7f076c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:44.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f07866fe700 1 --2- 172.21.15.81:0/2043360978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f076c004810 0x7f076c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f07866fe700 1 -- 172.21.15.81:0/2043360978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c003570 con 0x7f076c0052e0 2023-10-07T08:48:44.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f0785efd700 1 --2- 172.21.15.81:0/2043360978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f076c003a60 0x7f076c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:44.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f07856fc700 1 --2- 172.21.15.81:0/2043360978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f076c004810 0x7f076c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:44.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f07866fe700 1 -- 172.21.15.81:0/2043360978 reap_dead start 2023-10-07T08:48:44.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f07866fe700 1 --2- 172.21.15.81:0/2043360978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f076c0052e0 0x7f076c00ba60 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f077800aaa0 tx=0x7f077800a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cbf9d76fd0eabb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:44.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f0784efb700 1 -- 172.21.15.81:0/2043360978 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077800c5d0 con 0x7f076c0052e0 2023-10-07T08:48:44.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f0784efb700 1 -- 172.21.15.81:0/2043360978 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077800c730 con 0x7f076c0052e0 2023-10-07T08:48:44.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.445+0000 7f0784efb700 1 -- 172.21.15.81:0/2043360978 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077800caf0 con 0x7f076c0052e0 2023-10-07T08:48:44.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.446+0000 7f0786eff700 1 -- 172.21.15.81:0/2043360978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f076c0052e0 msgr2=0x7f076c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:44.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.446+0000 7f0786eff700 1 --2- 172.21.15.81:0/2043360978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f076c0052e0 0x7f076c00ba60 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f077800aaa0 tx=0x7f077800a170 comp rx=0 tx=0).stop 2023-10-07T08:48:44.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.446+0000 7f0786eff700 1 -- 172.21.15.81:0/2043360978 shutdown_connections 2023-10-07T08:48:44.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.446+0000 7f0786eff700 1 --2- 172.21.15.81:0/2043360978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f076c0052e0 0x7f076c00ba60 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.446+0000 7f0786eff700 1 -- 172.21.15.81:0/2043360978 >> 172.21.15.81:0/2043360978 conn(0x7f07800cd660 msgr2=0x7f07800cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:44.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.446+0000 7f0786eff700 1 -- 172.21.15.81:0/2043360978 shutdown_connections 2023-10-07T08:48:44.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.446+0000 7f0786eff700 1 -- 172.21.15.81:0/2043360978 wait complete. 2023-10-07T08:48:44.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.447+0000 7f0786eff700 1 Processor -- start 2023-10-07T08:48:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.447+0000 7f0786eff700 1 -- start start 2023-10-07T08:48:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f0786eff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f076c0052e0 0x7f078015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f0786eff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0780148700 0x7f07800c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f0786eff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07800ca330 0x7f078015b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f0786eff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07800ca7d0 con 0x7f07800ca330 2023-10-07T08:48:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f0786eff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078015cf50 con 0x7f0780148700 2023-10-07T08:48:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f0786eff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078015c340 con 0x7f076c0052e0 2023-10-07T08:48:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f07866fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07800ca330 0x7f078015b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f07866fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07800ca330 0x7f078015b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44744/0 (socket says 172.21.15.81:44744) 2023-10-07T08:48:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f07866fe700 1 -- 172.21.15.81:0/3503055989 learned_addr learned my addr 172.21.15.81:0/3503055989 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f0785efd700 1 --2- 172.21.15.81:0/3503055989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f076c0052e0 0x7f078015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f07856fc700 1 --2- 172.21.15.81:0/3503055989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0780148700 0x7f07800c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f07866fe700 1 -- 172.21.15.81:0/3503055989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f076c0052e0 msgr2=0x7f078015d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f07866fe700 1 --2- 172.21.15.81:0/3503055989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f076c0052e0 0x7f078015d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f07866fe700 1 -- 172.21.15.81:0/3503055989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0780148700 msgr2=0x7f07800c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f07866fe700 1 --2- 172.21.15.81:0/3503055989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0780148700 0x7f07800c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f07866fe700 1 -- 172.21.15.81:0/3503055989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078015c620 con 0x7f07800ca330 2023-10-07T08:48:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f0785efd700 1 --2- 172.21.15.81:0/3503055989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f076c0052e0 0x7f078015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f07866fe700 1 --2- 172.21.15.81:0/3503055989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07800ca330 0x7f078015b5e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f0778002250 tx=0x7f0778016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f0775ffb700 1 -- 172.21.15.81:0/3503055989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077800ce60 con 0x7f07800ca330 2023-10-07T08:48:44.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f0775ffb700 1 -- 172.21.15.81:0/3503055989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0778001460 con 0x7f07800ca330 2023-10-07T08:48:44.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f0786eff700 1 -- 172.21.15.81:0/3503055989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078015c900 con 0x7f07800ca330 2023-10-07T08:48:44.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.448+0000 7f0775ffb700 1 -- 172.21.15.81:0/3503055989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077801d670 con 0x7f07800ca330 2023-10-07T08:48:44.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.449+0000 7f0786eff700 1 -- 172.21.15.81:0/3503055989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0780148b70 con 0x7f07800ca330 2023-10-07T08:48:44.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.450+0000 7f0786eff700 1 -- 172.21.15.81:0/3503055989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078015cda0 con 0x7f07800ca330 2023-10-07T08:48:44.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.450+0000 7f0775ffb700 1 -- 172.21.15.81:0/3503055989 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f077801d9e0 con 0x7f07800ca330 2023-10-07T08:48:44.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.450+0000 7f0775ffb700 1 --2- 172.21.15.81:0/3503055989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0764066f30 0x7f07640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:44.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.450+0000 7f0775ffb700 1 -- 172.21.15.81:0/3503055989 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0778086580 con 0x7f07800ca330 2023-10-07T08:48:44.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.450+0000 7f0785efd700 1 --2- 172.21.15.81:0/3503055989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0764066f30 0x7f07640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.451+0000 7f0785efd700 1 --2- 172.21.15.81:0/3503055989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0764066f30 0x7f07640693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f077c000c00 tx=0x7f077c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.455+0000 7f0775ffb700 1 -- 172.21.15.81:0/3503055989 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07780537f0 con 0x7f07800ca330 2023-10-07T08:48:44.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.677+0000 7f0786eff700 1 -- 172.21.15.81:0/3503055989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0780069120 con 0x7f07800ca330 2023-10-07T08:48:44.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.677+0000 7f0775ffb700 1 -- 172.21.15.81:0/3503055989 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f0780069120 con 0x7f07800ca330 2023-10-07T08:48:44.678 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:44.678 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/2384735966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2384735966},{"type":"v1","addr":"172.21.15.89:6834","nonce":2384735966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1456306972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1456306972},{"type":"v1","addr":"172.21.15.89:6835","nonce":1456306972}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3356050793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3356050793},{"type":"v1","addr":"172.21.15.81:6836","nonce":3356050793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:48:40.667880+0000","modified":"2023-10-07T08:48:44.308458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6741":{"gid":6741,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2231384962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2231384962},{"type":"v1","addr":"172.21.15.81:6837","nonce":2231384962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-07T08:48:44.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.679+0000 7f0786eff700 1 -- 172.21.15.81:0/3503055989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0764066f30 msgr2=0x7f07640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:44.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.679+0000 7f0786eff700 1 --2- 172.21.15.81:0/3503055989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0764066f30 0x7f07640693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f077c000c00 tx=0x7f077c009040 comp rx=0 tx=0).stop 2023-10-07T08:48:44.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.679+0000 7f0786eff700 1 -- 172.21.15.81:0/3503055989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07800ca330 msgr2=0x7f078015b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:44.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.679+0000 7f0786eff700 1 --2- 172.21.15.81:0/3503055989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07800ca330 0x7f078015b5e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f0778002250 tx=0x7f0778016000 comp rx=0 tx=0).stop 2023-10-07T08:48:44.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.679+0000 7f0786eff700 1 -- 172.21.15.81:0/3503055989 shutdown_connections 2023-10-07T08:48:44.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.679+0000 7f0786eff700 1 --2- 172.21.15.81:0/3503055989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07800ca330 0x7f078015b5e0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.679+0000 7f0786eff700 1 --2- 172.21.15.81:0/3503055989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0764066f30 0x7f07640693e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.679+0000 7f0786eff700 1 --2- 172.21.15.81:0/3503055989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f076c0052e0 0x7f078015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.679+0000 7f0786eff700 1 --2- 172.21.15.81:0/3503055989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0780148700 0x7f07800c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.679+0000 7f0786eff700 1 -- 172.21.15.81:0/3503055989 >> 172.21.15.81:0/3503055989 conn(0x7f07800cd660 msgr2=0x7f07800c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.679+0000 7f0786eff700 1 -- 172.21.15.81:0/3503055989 shutdown_connections 2023-10-07T08:48:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.680+0000 7f0786eff700 1 -- 172.21.15.81:0/3503055989 wait complete. 2023-10-07T08:48:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 58 2023-10-07T08:48:44.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:48:44.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.806+0000 7f1695868700 1 Processor -- start 2023-10-07T08:48:44.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.806+0000 7f1695868700 1 -- start start 2023-10-07T08:48:44.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f1695868700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1690159b40 0x7f16900cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:44.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f1695868700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1690159f10 0x7f1690068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:44.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f1695868700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f16900ccb40 0x7f1690068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:44.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f1695868700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16900cee10 con 0x7f1690159f10 2023-10-07T08:48:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f1695868700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16900cd040 con 0x7f16900ccb40 2023-10-07T08:48:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f1695868700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16900cd320 con 0x7f1690159b40 2023-10-07T08:48:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f168ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1690159f10 0x7f1690068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f168ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1690159f10 0x7f1690068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44750/0 (socket says 172.21.15.81:44750) 2023-10-07T08:48:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f168ffff700 1 -- 172.21.15.81:0/854921555 learned_addr learned my addr 172.21.15.81:0/854921555 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f1694866700 1 --2- 172.21.15.81:0/854921555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1690159b40 0x7f16900cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f1695067700 1 --2- 172.21.15.81:0/854921555 >> v2:172.21.15.89:3300/0 conn(0x7f16900ccb40 0x7f1690068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f168ffff700 1 -- 172.21.15.81:0/854921555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1690159b40 msgr2=0x7f16900cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f168ffff700 1 --2- 172.21.15.81:0/854921555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1690159b40 0x7f16900cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f168ffff700 1 -- 172.21.15.81:0/854921555 >> v2:172.21.15.89:3300/0 conn(0x7f16900ccb40 msgr2=0x7f1690068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f168ffff700 1 --2- 172.21.15.81:0/854921555 >> v2:172.21.15.89:3300/0 conn(0x7f16900ccb40 0x7f1690068cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f168ffff700 1 -- 172.21.15.81:0/854921555 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16900ce7c0 con 0x7f1690159f10 2023-10-07T08:48:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.807+0000 7f168ffff700 1 --2- 172.21.15.81:0/854921555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1690159f10 0x7f1690068780 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f16900b6bf0 tx=0x7f1680009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d757808e86178211 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.808+0000 7f168f7fe700 1 -- 172.21.15.81:0/854921555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168000e070 con 0x7f1690159f10 2023-10-07T08:48:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.808+0000 7f168f7fe700 1 -- 172.21.15.81:0/854921555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168000ba50 con 0x7f1690159f10 2023-10-07T08:48:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.808+0000 7f168f7fe700 1 -- 172.21.15.81:0/854921555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16800092e0 con 0x7f1690159f10 2023-10-07T08:48:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.808+0000 7f1695868700 1 -- 172.21.15.81:0/854921555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1690159f10 msgr2=0x7f1690068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.808+0000 7f1695868700 1 --2- 172.21.15.81:0/854921555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1690159f10 0x7f1690068780 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f16900b6bf0 tx=0x7f1680009840 comp rx=0 tx=0).stop 2023-10-07T08:48:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.808+0000 7f1695868700 1 -- 172.21.15.81:0/854921555 shutdown_connections 2023-10-07T08:48:44.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.808+0000 7f1695868700 1 --2- 172.21.15.81:0/854921555 >> v2:172.21.15.89:3300/0 conn(0x7f16900ccb40 0x7f1690068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.808+0000 7f1695868700 1 --2- 172.21.15.81:0/854921555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1690159b40 0x7f16900cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.808+0000 7f1695868700 1 --2- 172.21.15.81:0/854921555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1690159f10 0x7f1690068780 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.808+0000 7f1695868700 1 -- 172.21.15.81:0/854921555 >> 172.21.15.81:0/854921555 conn(0x7f16900cd660 msgr2=0x7f16900cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:44.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.808+0000 7f1695868700 1 -- 172.21.15.81:0/854921555 shutdown_connections 2023-10-07T08:48:44.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.808+0000 7f1695868700 1 -- 172.21.15.81:0/854921555 wait complete. 2023-10-07T08:48:44.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.809+0000 7f1695868700 1 Processor -- start 2023-10-07T08:48:44.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.809+0000 7f1695868700 1 -- start start 2023-10-07T08:48:44.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f1695868700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16900ccb40 0x7f1690158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:44.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f1695868700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1690159b40 0x7f16901575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:44.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f1695868700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1690159f10 0x7f1690154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f1695868700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1690158a70 con 0x7f1690159f10 2023-10-07T08:48:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f1695868700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1690157e60 con 0x7f16900ccb40 2023-10-07T08:48:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f1695868700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1690158140 con 0x7f1690159b40 2023-10-07T08:48:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f1695067700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1690159f10 0x7f1690154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f1695067700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1690159f10 0x7f1690154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44760/0 (socket says 172.21.15.81:44760) 2023-10-07T08:48:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f1695067700 1 -- 172.21.15.81:0/1857278000 learned_addr learned my addr 172.21.15.81:0/1857278000 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f1694866700 1 --2- 172.21.15.81:0/1857278000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16900ccb40 0x7f1690158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f168ffff700 1 --2- 172.21.15.81:0/1857278000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1690159b40 0x7f16901575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f1695067700 1 -- 172.21.15.81:0/1857278000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1690159b40 msgr2=0x7f16901575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f1695067700 1 --2- 172.21.15.81:0/1857278000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1690159b40 0x7f16901575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f1695067700 1 -- 172.21.15.81:0/1857278000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16900ccb40 msgr2=0x7f1690158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f1695067700 1 --2- 172.21.15.81:0/1857278000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16900ccb40 0x7f1690158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f1695067700 1 -- 172.21.15.81:0/1857278000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1680009ae0 con 0x7f1690159f10 2023-10-07T08:48:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.810+0000 7f1694866700 1 --2- 172.21.15.81:0/1857278000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16900ccb40 0x7f1690158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.811+0000 7f1695067700 1 --2- 172.21.15.81:0/1857278000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1690159f10 0x7f1690154380 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f167800d890 tx=0x7f1678008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.811+0000 7f168cff9700 1 -- 172.21.15.81:0/1857278000 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16780125f0 con 0x7f1690159f10 2023-10-07T08:48:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.811+0000 7f168cff9700 1 -- 172.21.15.81:0/1857278000 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1678012770 con 0x7f1690159f10 2023-10-07T08:48:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.811+0000 7f1695868700 1 -- 172.21.15.81:0/1857278000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1690158420 con 0x7f1690159f10 2023-10-07T08:48:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.811+0000 7f168cff9700 1 -- 172.21.15.81:0/1857278000 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678012b30 con 0x7f1690159f10 2023-10-07T08:48:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.811+0000 7f1695868700 1 -- 172.21.15.81:0/1857278000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1690157b20 con 0x7f1690159f10 2023-10-07T08:48:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.812+0000 7f1695868700 1 -- 172.21.15.81:0/1857278000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1690158be0 con 0x7f1690159f10 2023-10-07T08:48:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.812+0000 7f168cff9700 1 -- 172.21.15.81:0/1857278000 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f167801e460 con 0x7f1690159f10 2023-10-07T08:48:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.812+0000 7f168cff9700 1 --2- 172.21.15.81:0/1857278000 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1670066f30 0x7f16700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.813+0000 7f168cff9700 1 -- 172.21.15.81:0/1857278000 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1678084c10 con 0x7f1690159f10 2023-10-07T08:48:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.813+0000 7f1694866700 1 --2- 172.21.15.81:0/1857278000 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1670066f30 0x7f16700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.813+0000 7f1694866700 1 --2- 172.21.15.81:0/1857278000 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1670066f30 0x7f16700693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1688006fd0 tx=0x7f1688008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:44.817+0000 7f168cff9700 1 -- 172.21.15.81:0/1857278000 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1678051e80 con 0x7f1690159f10 2023-10-07T08:48:45.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.000+0000 7f1695868700 1 -- 172.21.15.81:0/1857278000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16900cc060 con 0x7f1690159f10 2023-10-07T08:48:45.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.001+0000 7f168cff9700 1 -- 172.21.15.81:0/1857278000 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+15317 (secure 0 0 0) 0x7f16780554a0 con 0x7f1690159f10 2023-10-07T08:48:45.002 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:45.002 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":123,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:48:42.284854+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:48:38.552036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-07T08:48:39.627974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:48:45.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.003+0000 7f1695868700 1 -- 172.21.15.81:0/1857278000 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1670066f30 msgr2=0x7f16700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.003+0000 7f1695868700 1 --2- 172.21.15.81:0/1857278000 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1670066f30 0x7f16700693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1688006fd0 tx=0x7f1688008040 comp rx=0 tx=0).stop 2023-10-07T08:48:45.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.003+0000 7f1695868700 1 -- 172.21.15.81:0/1857278000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1690159f10 msgr2=0x7f1690154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.003+0000 7f1695868700 1 --2- 172.21.15.81:0/1857278000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1690159f10 0x7f1690154380 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f167800d890 tx=0x7f1678008040 comp rx=0 tx=0).stop 2023-10-07T08:48:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.003+0000 7f1695868700 1 -- 172.21.15.81:0/1857278000 shutdown_connections 2023-10-07T08:48:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.003+0000 7f1695868700 1 --2- 172.21.15.81:0/1857278000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1690159f10 0x7f1690154380 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.003+0000 7f1695868700 1 --2- 172.21.15.81:0/1857278000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16900ccb40 0x7f1690158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.003+0000 7f1695868700 1 --2- 172.21.15.81:0/1857278000 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1670066f30 0x7f16700693e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.003+0000 7f1695868700 1 --2- 172.21.15.81:0/1857278000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1690159b40 0x7f16901575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.003+0000 7f1695868700 1 -- 172.21.15.81:0/1857278000 >> 172.21.15.81:0/1857278000 conn(0x7f16900cd660 msgr2=0x7f16900b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.004+0000 7f1695868700 1 -- 172.21.15.81:0/1857278000 shutdown_connections 2023-10-07T08:48:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.004+0000 7f1695868700 1 -- 172.21.15.81:0/1857278000 wait complete. 2023-10-07T08:48:45.016 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T08:48:45.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:48:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.130+0000 7fd880a3d700 1 Processor -- start 2023-10-07T08:48:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.130+0000 7fd880a3d700 1 -- start start 2023-10-07T08:48:45.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.131+0000 7fd880a3d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd87c1578d0 0x7fd87c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.131+0000 7fd880a3d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd87c157ca0 0x7fd87c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.131+0000 7fd880a3d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c0d07c0 con 0x7fd87c06d120 2023-10-07T08:48:45.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.131+0000 7fd880a3d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c0cfbb0 con 0x7fd87c157ca0 2023-10-07T08:48:45.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.131+0000 7fd880a3d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c0cfe90 con 0x7fd87c1578d0 2023-10-07T08:48:45.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.131+0000 7fd871d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd87c157ca0 0x7fd87c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.131+0000 7fd87ad9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd87c06d120 0x7fd87c06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46496/0 (socket says 172.21.15.81:46496) 2023-10-07T08:48:45.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.131+0000 7fd87ad9d700 1 -- 172.21.15.81:0/4051188426 learned_addr learned my addr 172.21.15.81:0/4051188426 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:45.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.131+0000 7fd87a59c700 1 --2- 172.21.15.81:0/4051188426 >> v2:172.21.15.89:3300/0 conn(0x7fd87c1578d0 0x7fd87c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.131+0000 7fd871d9b700 1 -- 172.21.15.81:0/4051188426 >> v2:172.21.15.89:3300/0 conn(0x7fd87c1578d0 msgr2=0x7fd87c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:45.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.131+0000 7fd871d9b700 1 --2- 172.21.15.81:0/4051188426 >> v2:172.21.15.89:3300/0 conn(0x7fd87c1578d0 0x7fd87c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.131+0000 7fd871d9b700 1 -- 172.21.15.81:0/4051188426 >> v1:172.21.15.81:6789/0 conn(0x7fd87c06d120 legacy=0x7fd87c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.131+0000 7fd871d9b700 1 -- 172.21.15.81:0/4051188426 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c0d0170 con 0x7fd87c157ca0 2023-10-07T08:48:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.131+0000 7fd879d9b700 1 -- 172.21.15.81:0/4051188426 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370471782 0 0) 0x7fd87c0d07c0 con 0x7fd87c06d120 2023-10-07T08:48:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.131+0000 7fd87a59c700 1 --2- 172.21.15.81:0/4051188426 >> v2:172.21.15.89:3300/0 conn(0x7fd87c1578d0 0x7fd87c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.132+0000 7fd871d9b700 1 --2- 172.21.15.81:0/4051188426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c157ca0 0x7fd87c15af00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0646b0 tx=0x7fd8640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a808a32afe1d1a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.132+0000 7fd879d9b700 1 -- 172.21.15.81:0/4051188426 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86400b6b0 con 0x7fd87c157ca0 2023-10-07T08:48:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.132+0000 7fd879d9b700 1 -- 172.21.15.81:0/4051188426 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86400b810 con 0x7fd87c157ca0 2023-10-07T08:48:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.132+0000 7fd879d9b700 1 -- 172.21.15.81:0/4051188426 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86400bbb0 con 0x7fd87c157ca0 2023-10-07T08:48:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.132+0000 7fd880a3d700 1 -- 172.21.15.81:0/4051188426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c157ca0 msgr2=0x7fd87c15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.132+0000 7fd880a3d700 1 --2- 172.21.15.81:0/4051188426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c157ca0 0x7fd87c15af00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0646b0 tx=0x7fd8640091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.132+0000 7fd880a3d700 1 -- 172.21.15.81:0/4051188426 shutdown_connections 2023-10-07T08:48:45.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.132+0000 7fd880a3d700 1 --2- 172.21.15.81:0/4051188426 >> v2:172.21.15.89:3300/0 conn(0x7fd87c1578d0 0x7fd87c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.132+0000 7fd880a3d700 1 --2- 172.21.15.81:0/4051188426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c157ca0 0x7fd87c15af00 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.132+0000 7fd880a3d700 1 -- 172.21.15.81:0/4051188426 >> 172.21.15.81:0/4051188426 conn(0x7fd87c06bb90 msgr2=0x7fd87c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:45.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.132+0000 7fd880a3d700 1 -- 172.21.15.81:0/4051188426 shutdown_connections 2023-10-07T08:48:45.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.132+0000 7fd880a3d700 1 -- 172.21.15.81:0/4051188426 wait complete. 2023-10-07T08:48:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.133+0000 7fd880a3d700 1 Processor -- start 2023-10-07T08:48:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.134+0000 7fd880a3d700 1 -- start start 2023-10-07T08:48:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.134+0000 7fd880a3d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd87c06d120 0x7fd87c16e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.134+0000 7fd880a3d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd87c1578d0 0x7fd87c0ad100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.134+0000 7fd880a3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c157ca0 0x7fd87c16cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.134+0000 7fd880a3d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0ae4f0 con 0x7fd87c157ca0 2023-10-07T08:48:45.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.134+0000 7fd880a3d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0ad640 con 0x7fd87c1578d0 2023-10-07T08:48:45.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.134+0000 7fd880a3d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0ad8e0 con 0x7fd87c06d120 2023-10-07T08:48:45.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.134+0000 7fd87ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c157ca0 0x7fd87c16cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.134+0000 7fd87ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c157ca0 0x7fd87c16cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44784/0 (socket says 172.21.15.81:44784) 2023-10-07T08:48:45.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.134+0000 7fd87ad9d700 1 -- 172.21.15.81:0/1631165693 learned_addr learned my addr 172.21.15.81:0/1631165693 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:45.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.135+0000 7fd871d9b700 1 --2- 172.21.15.81:0/1631165693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd87c1578d0 0x7fd87c0ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.135+0000 7fd87a59c700 1 --2- 172.21.15.81:0/1631165693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd87c06d120 0x7fd87c16e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.135+0000 7fd87ad9d700 1 -- 172.21.15.81:0/1631165693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd87c06d120 msgr2=0x7fd87c16e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.135+0000 7fd87ad9d700 1 --2- 172.21.15.81:0/1631165693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd87c06d120 0x7fd87c16e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.135+0000 7fd87ad9d700 1 -- 172.21.15.81:0/1631165693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd87c1578d0 msgr2=0x7fd87c0ad100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.135+0000 7fd87ad9d700 1 --2- 172.21.15.81:0/1631165693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd87c1578d0 0x7fd87c0ad100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.135+0000 7fd87ad9d700 1 -- 172.21.15.81:0/1631165693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd864009420 con 0x7fd87c157ca0 2023-10-07T08:48:45.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.135+0000 7fd871d9b700 1 --2- 172.21.15.81:0/1631165693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd87c1578d0 0x7fd87c0ad100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:45.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.135+0000 7fd87ad9d700 1 --2- 172.21.15.81:0/1631165693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c157ca0 0x7fd87c16cfc0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fd87400cc90 tx=0x7fd874001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:45.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.135+0000 7fd872ffd700 1 -- 172.21.15.81:0/1631165693 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87400cea0 con 0x7fd87c157ca0 2023-10-07T08:48:45.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.135+0000 7fd872ffd700 1 -- 172.21.15.81:0/1631165693 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87400ab70 con 0x7fd87c157ca0 2023-10-07T08:48:45.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.135+0000 7fd880a3d700 1 -- 172.21.15.81:0/1631165693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87c0adbc0 con 0x7fd87c157ca0 2023-10-07T08:48:45.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.135+0000 7fd872ffd700 1 -- 172.21.15.81:0/1631165693 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8740070f0 con 0x7fd87c157ca0 2023-10-07T08:48:45.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.135+0000 7fd880a3d700 1 -- 172.21.15.81:0/1631165693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87c0ae180 con 0x7fd87c157ca0 2023-10-07T08:48:45.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.136+0000 7fd880a3d700 1 -- 172.21.15.81:0/1631165693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87c16b550 con 0x7fd87c157ca0 2023-10-07T08:48:45.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.136+0000 7fd872ffd700 1 -- 172.21.15.81:0/1631165693 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd874007460 con 0x7fd87c157ca0 2023-10-07T08:48:45.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.137+0000 7fd872ffd700 1 --2- 172.21.15.81:0/1631165693 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd85c066f30 0x7fd85c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.137+0000 7fd87a59c700 1 --2- 172.21.15.81:0/1631165693 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd85c066f30 0x7fd85c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.137+0000 7fd872ffd700 1 -- 172.21.15.81:0/1631165693 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd874084970 con 0x7fd87c157ca0 2023-10-07T08:48:45.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.137+0000 7fd87a59c700 1 --2- 172.21.15.81:0/1631165693 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd85c066f30 0x7fd85c0693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd86c006f00 tx=0x7fd86c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:45.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.141+0000 7fd872ffd700 1 -- 172.21.15.81:0/1631165693 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd87c16b550 con 0x7fd87c157ca0 2023-10-07T08:48:45.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.318+0000 7fd880a3d700 1 -- 172.21.15.81:0/1631165693 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd87c16b550 con 0x7fd85c066f30 2023-10-07T08:48:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.325+0000 7fd872ffd700 1 -- 172.21.15.81:0/1631165693 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276131 (secure 0 0 0) 0x7fd87c16b550 con 0x7fd85c066f30 2023-10-07T08:48:45.329 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.328+0000 7fd880a3d700 1 -- 172.21.15.81:0/1631165693 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd85c066f30 msgr2=0x7fd85c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.328+0000 7fd880a3d700 1 --2- 172.21.15.81:0/1631165693 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd85c066f30 0x7fd85c0693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd86c006f00 tx=0x7fd86c008040 comp rx=0 tx=0).stop 2023-10-07T08:48:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.328+0000 7fd880a3d700 1 -- 172.21.15.81:0/1631165693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c157ca0 msgr2=0x7fd87c16cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.328+0000 7fd880a3d700 1 --2- 172.21.15.81:0/1631165693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c157ca0 0x7fd87c16cfc0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fd87400cc90 tx=0x7fd874001a80 comp rx=0 tx=0).stop 2023-10-07T08:48:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.328+0000 7fd880a3d700 1 -- 172.21.15.81:0/1631165693 shutdown_connections 2023-10-07T08:48:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.328+0000 7fd880a3d700 1 --2- 172.21.15.81:0/1631165693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd87c157ca0 0x7fd87c16cfc0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.328+0000 7fd880a3d700 1 --2- 172.21.15.81:0/1631165693 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd85c066f30 0x7fd85c0693e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.328+0000 7fd880a3d700 1 --2- 172.21.15.81:0/1631165693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd87c06d120 0x7fd87c16e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.328+0000 7fd880a3d700 1 --2- 172.21.15.81:0/1631165693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd87c1578d0 0x7fd87c0ad100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.328+0000 7fd880a3d700 1 -- 172.21.15.81:0/1631165693 >> 172.21.15.81:0/1631165693 conn(0x7fd87c06bb90 msgr2=0x7fd87c06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.328+0000 7fd880a3d700 1 -- 172.21.15.81:0/1631165693 shutdown_connections 2023-10-07T08:48:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.328+0000 7fd880a3d700 1 -- 172.21.15.81:0/1631165693 wait complete. 2023-10-07T08:48:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:48:45.341 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2023-10-07T08:48:44.080588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6230,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556269,"statfs":{"total":1600000000,"available":1593619612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.801879"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.282487+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:09.660818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.286478+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:20:11.641491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281476+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:56:55.954668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.282136+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:20:11.641491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284377+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:31:11.513599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.282062+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:24:24.553384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284162+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:04:30.313866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284381+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:56:35.607018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.283891+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:40:59.258281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.280557+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:07.308237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.285900+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:07.308237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284061+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:03:05.654180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.283879+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:41:55.655777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.283801+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:59:14.096601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284425+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:36:07.526999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284343+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:42:54.190885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.283973+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:22.814037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284426+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:05.208561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281332+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:03:05.654180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281742+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:53:14.493858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284592+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:56:55.954668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284106+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:36:07.526999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281813+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:07.308237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284460+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:40:43.985905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281367+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:40:43.985905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281332+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:36:07.526999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284054+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:39.683818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281508+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:27.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284717+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:15:34.746855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.280503+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:53:14.493858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.283788+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:52:57.933341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.285958+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:24:24.553384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":245,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-07T08:48:37.761440+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:48:37.761440+0000","last_peered":"2023-10-07T08:48:37.761440+0000","last_clean":"2023-10-07T08:48:37.761440+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:48:37.761440+0000","last_undegraded":"2023-10-07T08:48:37.761440+0000","last_fullsized":"2023-10-07T08:48:37.761440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194104,"statfs":{"total":200000000,"available":198762578,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.5},"min":{"1min":0.36599999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.48699999999999999},"min":{"1min":0.379,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68000000000000005,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.46600000000000003}]},{"osd":1,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.41799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.435},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.40500000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.54500000000000004}]},{"osd":2,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51400000000000001,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.75},"last":0.59999999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.629,"15min":0.80700000000000005},"min":{"1min":0.38800000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.68400000000000005,"5min":6.8570000000000002,"15min":6.8570000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.749,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.67200000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.28799999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66400000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.627},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.502,"15min":0.53300000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69499999999999995,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.61899999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":0.751,"15min":0.751},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54200000000000004,"15min":0.56999999999999995},"min":{"1min":0.318,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73299999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56899999999999995,"15min":0.59199999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72999999999999998,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71599999999999997,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.66200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194680,"statfs":{"total":200000000,"available":199352946,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.495,"15min":0.47299999999999998},"min":{"1min":0.316,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.39600000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.44600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.55500000000000005,"15min":0.53200000000000003},"min":{"1min":0.495,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.52700000000000002,"15min":0.48199999999999998},"min":{"1min":0.38200000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.435,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78100000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.50800000000000001},"min":{"1min":0.40899999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.32900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.44900000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.40600000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73899999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.42699999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.40100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.503},{"interface":"front","average":{"1min":0.622,"5min":0.59599999999999997,"15min":0.58199999999999996},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89100000000000001,"5min":1.052,"15min":1.052},"last":0.56999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194680,"statfs":{"total":200000000,"available":199352946,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34599999999999997,"15min":0.312},"min":{"1min":0.22500000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.56699999999999995,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.35499999999999998,"15min":0.32800000000000001},"min":{"1min":0.22500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.255}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.318},"min":{"1min":0.26200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70399999999999996,"5min":1.639,"15min":1.639},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.38800000000000001,"15min":0.33200000000000002},"min":{"1min":0.28699999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.47399999999999998,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.311}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40000000000000002,"15min":0.35899999999999999},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.52800000000000002,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.34799999999999998},"min":{"1min":0.28599999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.29899999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.52200000000000002},"min":{"1min":0.35699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79100000000000004,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.42899999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.49299999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.52600000000000002},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73099999999999998,"5min":0.87,"15min":0.87},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.443},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.58199999999999996},"min":{"1min":0.51800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79100000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194104,"statfs":{"total":200000000,"available":198762578,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.371},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.377,"15min":0.39500000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.67400000000000004,"5min":1.079,"15min":1.079},"last":0.47899999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.39100000000000001},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":1.464,"15min":1.464},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.432,"5min":0.40200000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67900000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":1.341,"15min":1.341},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.42099999999999999,"15min":0.435},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68600000000000005,"5min":1.532,"15min":1.532},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90200000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.60999999999999999},"min":{"1min":0.36199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80100000000000005,"5min":1.51,"15min":1.51},"last":0.46500000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83299999999999996,"5min":1.25,"15min":1.25},"last":0.42599999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.92900000000000005,"5min":1.488,"15min":1.488},"last":0.501},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":1.024,"15min":1.024},"last":0.50900000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.438},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.90300000000000002,"5min":1.288,"15min":1.288},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194674,"statfs":{"total":200000000,"available":199347141,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.34300000000000003},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.49299999999999999,"5min":1.665,"15min":1.665},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.35799999999999998,"15min":0.36299999999999999},"min":{"1min":0.23499999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.50900000000000001,"5min":1.579,"15min":1.579},"last":0.441}]},{"osd":1,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.38400000000000001,"15min":0.38100000000000001},"min":{"1min":0.218,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.26600000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.48199999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.26100000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":1.454,"15min":1.454},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.39100000000000001},"min":{"1min":0.28100000000000003,"5min":0.224,"15min":0.224},"max":{"1min":0.56599999999999995,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.40500000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.40600000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81999999999999995,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.874,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.86599999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.36799999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83499999999999996,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.38600000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.76900000000000002,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.876}]},{"osd":6,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77600000000000002,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.85899999999999999,"5min":1.637,"15min":1.637},"last":0.752}]},{"osd":7,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":1.49,"15min":1.49},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81299999999999994,"5min":1.375,"15min":1.375},"last":0.89700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194674,"statfs":{"total":200000000,"available":199347141,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35499999999999998,"15min":0.33100000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.90200000000000002,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34899999999999998,"15min":0.32100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.504,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.33200000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38100000000000001,"15min":0.35999999999999999},"min":{"1min":0.245,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.61599999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41999999999999998,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70099999999999996,"5min":1.885,"15min":1.885},"last":0.41799999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.38100000000000001},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57699999999999996,"5min":1.274,"15min":1.274},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.40300000000000002},"min":{"1min":0.32100000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.97699999999999998,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.36799999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.503},"min":{"1min":0.36699999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78500000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57399999999999995,"15min":0.53500000000000003},"min":{"1min":0.45200000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80800000000000005,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.70799999999999996}]},{"osd":5,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.42799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79400000000000004,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.59699999999999998,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.038,"5min":1.851,"15min":1.851},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60299999999999998,"15min":0.55900000000000005},"min":{"1min":0.45100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77200000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.58599999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84199999999999997,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.746}]},{"osd":7,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.57699999999999996},"min":{"1min":0.45600000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0089999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.59299999999999997,"15min":0.55700000000000005},"min":{"1min":0.42699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80000000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194674,"statfs":{"total":200000000,"available":199347141,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.72199999999999998,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.71099999999999997,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.35199999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.501},"min":{"1min":0.29499999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.70099999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68799999999999994,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.39200000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.53100000000000003},"min":{"1min":0.45200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68400000000000005,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53900000000000003,"15min":0.50800000000000001},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69099999999999995,"5min":1.29,"15min":1.29},"last":0.51600000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.52700000000000002},"min":{"1min":0.38400000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":2.052,"15min":2.052},"last":0.503},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71199999999999997,"5min":1.369,"15min":1.369},"last":0.47499999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.75700000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.495,"15min":0.495},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76500000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45200000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.32800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.372},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.75900000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.48999999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54000000000000004,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85099999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79300000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.54600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194674,"statfs":{"total":200000000,"available":199347141,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.51600000000000001},"min":{"1min":0.314,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.48299999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.51700000000000002,"15min":0.49099999999999999},"min":{"1min":0.34999999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.46600000000000003}]},{"osd":2,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76800000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.374},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.73399999999999999,"5min":0.754,"15min":0.754},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78900000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.44600000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.47899999999999998},"min":{"1min":0.31,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57299999999999995,"15min":0.59599999999999997},"min":{"1min":0.40300000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.754,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.54400000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71399999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.501},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.63}]},{"osd":7,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54900000000000004,"15min":0.57699999999999996},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.59699999999999998},"min":{"1min":0.39200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80100000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.72899999999999998}]}]}],"pool_statfs":[]}} 2023-10-07T08:48:45.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:48:45.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.495+0000 7fac5728d700 1 Processor -- start 2023-10-07T08:48:45.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.495+0000 7fac5728d700 1 -- start start 2023-10-07T08:48:45.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.496+0000 7fac5728d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac501578d0 0x7fac500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.496+0000 7fac5728d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fac50157ca0 0x7fac5015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.496+0000 7fac5728d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac500d07c0 con 0x7fac5006d120 2023-10-07T08:48:45.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.496+0000 7fac5728d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac500cfbb0 con 0x7fac501578d0 2023-10-07T08:48:45.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.496+0000 7fac5728d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac500cfe90 con 0x7fac50157ca0 2023-10-07T08:48:45.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.496+0000 7fac5582a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fac5006d120 0x7fac5006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46508/0 (socket says 172.21.15.81:46508) 2023-10-07T08:48:45.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.496+0000 7fac5582a700 1 -- 172.21.15.81:0/1838453858 learned_addr learned my addr 172.21.15.81:0/1838453858 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:45.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.496+0000 7fac55029700 1 --2- 172.21.15.81:0/1838453858 >> v2:172.21.15.81:3300/0 conn(0x7fac501578d0 0x7fac500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.496+0000 7fac54828700 1 --2- 172.21.15.81:0/1838453858 >> v2:172.21.15.89:3300/0 conn(0x7fac50157ca0 0x7fac5015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.496+0000 7fac47fff700 1 -- 172.21.15.81:0/1838453858 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262787845 0 0) 0x7fac500d07c0 con 0x7fac5006d120 2023-10-07T08:48:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.496+0000 7fac47fff700 1 -- 172.21.15.81:0/1838453858 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac3c003570 con 0x7fac5006d120 2023-10-07T08:48:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.497+0000 7fac55029700 1 -- 172.21.15.81:0/1838453858 >> v2:172.21.15.89:3300/0 conn(0x7fac50157ca0 msgr2=0x7fac5015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.497+0000 7fac55029700 1 --2- 172.21.15.81:0/1838453858 >> v2:172.21.15.89:3300/0 conn(0x7fac50157ca0 0x7fac5015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.497+0000 7fac55029700 1 -- 172.21.15.81:0/1838453858 >> v1:172.21.15.81:6789/0 conn(0x7fac5006d120 legacy=0x7fac5006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.497+0000 7fac55029700 1 -- 172.21.15.81:0/1838453858 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac500d0170 con 0x7fac501578d0 2023-10-07T08:48:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.497+0000 7fac55029700 1 --2- 172.21.15.81:0/1838453858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac501578d0 0x7fac500cf4f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fac50068510 tx=0x7fac4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfd535be2e58f5a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.497+0000 7fac47fff700 1 -- 172.21.15.81:0/1838453858 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c011630 con 0x7fac501578d0 2023-10-07T08:48:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.497+0000 7fac47fff700 1 -- 172.21.15.81:0/1838453858 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c0117b0 con 0x7fac501578d0 2023-10-07T08:48:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.497+0000 7fac47fff700 1 -- 172.21.15.81:0/1838453858 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c011b70 con 0x7fac501578d0 2023-10-07T08:48:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.497+0000 7fac5728d700 1 -- 172.21.15.81:0/1838453858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac501578d0 msgr2=0x7fac500cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.497+0000 7fac5728d700 1 --2- 172.21.15.81:0/1838453858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac501578d0 0x7fac500cf4f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fac50068510 tx=0x7fac4c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.497+0000 7fac5728d700 1 -- 172.21.15.81:0/1838453858 shutdown_connections 2023-10-07T08:48:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.497+0000 7fac5728d700 1 --2- 172.21.15.81:0/1838453858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac501578d0 0x7fac500cf4f0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.497+0000 7fac5728d700 1 --2- 172.21.15.81:0/1838453858 >> v2:172.21.15.89:3300/0 conn(0x7fac50157ca0 0x7fac5015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.497+0000 7fac5728d700 1 -- 172.21.15.81:0/1838453858 >> 172.21.15.81:0/1838453858 conn(0x7fac5006bb90 msgr2=0x7fac5006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.498+0000 7fac5728d700 1 -- 172.21.15.81:0/1838453858 shutdown_connections 2023-10-07T08:48:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.498+0000 7fac5728d700 1 -- 172.21.15.81:0/1838453858 wait complete. 2023-10-07T08:48:45.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.499+0000 7fac5728d700 1 Processor -- start 2023-10-07T08:48:45.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.499+0000 7fac5728d700 1 -- start start 2023-10-07T08:48:45.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.499+0000 7fac5728d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5006d120 0x7fac501523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.499+0000 7fac5728d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac501578d0 0x7fac5014dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.499+0000 7fac5728d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac50157ca0 0x7fac50158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.499+0000 7fac5728d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac500b6140 con 0x7fac5006d120 2023-10-07T08:48:45.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.499+0000 7fac5728d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac500b5cb0 con 0x7fac501578d0 2023-10-07T08:48:45.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.499+0000 7fac5728d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac500b4dc0 con 0x7fac50157ca0 2023-10-07T08:48:45.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.499+0000 7fac55029700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5006d120 0x7fac501523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac55029700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5006d120 0x7fac501523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44804/0 (socket says 172.21.15.81:44804) 2023-10-07T08:48:45.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac55029700 1 -- 172.21.15.81:0/3950942606 learned_addr learned my addr 172.21.15.81:0/3950942606 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:45.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac54828700 1 --2- 172.21.15.81:0/3950942606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac501578d0 0x7fac5014dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac5582a700 1 --2- 172.21.15.81:0/3950942606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac50157ca0 0x7fac50158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac55029700 1 -- 172.21.15.81:0/3950942606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac50157ca0 msgr2=0x7fac50158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac55029700 1 --2- 172.21.15.81:0/3950942606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac50157ca0 0x7fac50158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac55029700 1 -- 172.21.15.81:0/3950942606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac501578d0 msgr2=0x7fac5014dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac55029700 1 --2- 172.21.15.81:0/3950942606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac501578d0 0x7fac5014dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac55029700 1 -- 172.21.15.81:0/3950942606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c009420 con 0x7fac5006d120 2023-10-07T08:48:45.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac54828700 1 --2- 172.21.15.81:0/3950942606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac501578d0 0x7fac5014dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:45.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac5582a700 1 --2- 172.21.15.81:0/3950942606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac50157ca0 0x7fac50158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:45.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac55029700 1 --2- 172.21.15.81:0/3950942606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5006d120 0x7fac501523c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fac4c013000 tx=0x7fac4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:45.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac457fa700 1 -- 172.21.15.81:0/3950942606 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c01f070 con 0x7fac5006d120 2023-10-07T08:48:45.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac457fa700 1 -- 172.21.15.81:0/3950942606 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c000bc0 con 0x7fac5006d120 2023-10-07T08:48:45.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac5728d700 1 -- 172.21.15.81:0/3950942606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac500b50a0 con 0x7fac5006d120 2023-10-07T08:48:45.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac457fa700 1 -- 172.21.15.81:0/3950942606 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c011b70 con 0x7fac5006d120 2023-10-07T08:48:45.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.500+0000 7fac5728d700 1 -- 172.21.15.81:0/3950942606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac500b5940 con 0x7fac5006d120 2023-10-07T08:48:45.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.501+0000 7fac5728d700 1 -- 172.21.15.81:0/3950942606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac50067ac0 con 0x7fac5006d120 2023-10-07T08:48:45.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.501+0000 7fac457fa700 1 -- 172.21.15.81:0/3950942606 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac4c023070 con 0x7fac5006d120 2023-10-07T08:48:45.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.502+0000 7fac457fa700 1 --2- 172.21.15.81:0/3950942606 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fac34066f30 0x7fac340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.502+0000 7fac457fa700 1 -- 172.21.15.81:0/3950942606 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fac4c085870 con 0x7fac5006d120 2023-10-07T08:48:45.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.502+0000 7fac54828700 1 --2- 172.21.15.81:0/3950942606 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fac34066f30 0x7fac340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.502+0000 7fac54828700 1 --2- 172.21.15.81:0/3950942606 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fac34066f30 0x7fac340693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fac5016dbc0 tx=0x7fac40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:45.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.506+0000 7fac457fa700 1 -- 172.21.15.81:0/3950942606 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac4c052b20 con 0x7fac5006d120 2023-10-07T08:48:45.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.684+0000 7fac5728d700 1 -- 172.21.15.81:0/3950942606 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac500b5df0 con 0x7fac34066f30 2023-10-07T08:48:45.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.691+0000 7fac457fa700 1 -- 172.21.15.81:0/3950942606 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276131 (secure 0 0 0) 0x7fac40009df0 con 0x7fac34066f30 2023-10-07T08:48:45.694 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.694+0000 7fac5728d700 1 -- 172.21.15.81:0/3950942606 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fac34066f30 msgr2=0x7fac340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.694+0000 7fac5728d700 1 --2- 172.21.15.81:0/3950942606 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fac34066f30 0x7fac340693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fac5016dbc0 tx=0x7fac40008040 comp rx=0 tx=0).stop 2023-10-07T08:48:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.694+0000 7fac5728d700 1 -- 172.21.15.81:0/3950942606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5006d120 msgr2=0x7fac501523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.694+0000 7fac5728d700 1 --2- 172.21.15.81:0/3950942606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5006d120 0x7fac501523c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fac4c013000 tx=0x7fac4c017000 comp rx=0 tx=0).stop 2023-10-07T08:48:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.694+0000 7fac5728d700 1 -- 172.21.15.81:0/3950942606 shutdown_connections 2023-10-07T08:48:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.694+0000 7fac5728d700 1 --2- 172.21.15.81:0/3950942606 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fac34066f30 0x7fac340693e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.694+0000 7fac5728d700 1 --2- 172.21.15.81:0/3950942606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac50157ca0 0x7fac50158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.694+0000 7fac5728d700 1 --2- 172.21.15.81:0/3950942606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5006d120 0x7fac501523c0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.694+0000 7fac5728d700 1 --2- 172.21.15.81:0/3950942606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac501578d0 0x7fac5014dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.694+0000 7fac5728d700 1 -- 172.21.15.81:0/3950942606 >> 172.21.15.81:0/3950942606 conn(0x7fac5006bb90 msgr2=0x7fac5015cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.694+0000 7fac5728d700 1 -- 172.21.15.81:0/3950942606 shutdown_connections 2023-10-07T08:48:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.694+0000 7fac5728d700 1 -- 172.21.15.81:0/3950942606 wait complete. 2023-10-07T08:48:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:48:45.706 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2023-10-07T08:48:44.080588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6230,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556269,"statfs":{"total":1600000000,"available":1593619612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.801879"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.282487+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:09.660818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.286478+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:20:11.641491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281476+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:56:55.954668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.282136+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:20:11.641491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284377+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:31:11.513599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.282062+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:24:24.553384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284162+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:04:30.313866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284381+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:56:35.607018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.283891+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:40:59.258281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.280557+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:07.308237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.285900+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:07.308237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284061+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:03:05.654180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.283879+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:41:55.655777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.283801+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:59:14.096601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284425+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:36:07.526999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284343+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:42:54.190885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.283973+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:22.814037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284426+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:05.208561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281332+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:03:05.654180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281742+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:53:14.493858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284592+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:56:55.954668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284106+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:36:07.526999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281813+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:07.308237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284460+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:40:43.985905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281367+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:40:43.985905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281332+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:36:07.526999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284054+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:39.683818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281508+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:27.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284717+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:15:34.746855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.280503+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:53:14.493858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.283788+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:52:57.933341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.285958+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:24:24.553384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":245,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-07T08:48:37.761440+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:48:37.761440+0000","last_peered":"2023-10-07T08:48:37.761440+0000","last_clean":"2023-10-07T08:48:37.761440+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:48:37.761440+0000","last_undegraded":"2023-10-07T08:48:37.761440+0000","last_fullsized":"2023-10-07T08:48:37.761440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194104,"statfs":{"total":200000000,"available":198762578,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.5},"min":{"1min":0.36599999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.48699999999999999},"min":{"1min":0.379,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68000000000000005,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.46600000000000003}]},{"osd":1,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.41799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.435},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.40500000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.54500000000000004}]},{"osd":2,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51400000000000001,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.75},"last":0.59999999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.629,"15min":0.80700000000000005},"min":{"1min":0.38800000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.68400000000000005,"5min":6.8570000000000002,"15min":6.8570000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.749,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.67200000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.28799999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66400000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.627},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.502,"15min":0.53300000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69499999999999995,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.61899999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":0.751,"15min":0.751},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54200000000000004,"15min":0.56999999999999995},"min":{"1min":0.318,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73299999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56899999999999995,"15min":0.59199999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72999999999999998,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71599999999999997,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.66200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194680,"statfs":{"total":200000000,"available":199352946,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.495,"15min":0.47299999999999998},"min":{"1min":0.316,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.39600000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.44600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.55500000000000005,"15min":0.53200000000000003},"min":{"1min":0.495,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.52700000000000002,"15min":0.48199999999999998},"min":{"1min":0.38200000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.435,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78100000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.50800000000000001},"min":{"1min":0.40899999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.32900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.44900000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.40600000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73899999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.42699999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.40100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.503},{"interface":"front","average":{"1min":0.622,"5min":0.59599999999999997,"15min":0.58199999999999996},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89100000000000001,"5min":1.052,"15min":1.052},"last":0.56999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194680,"statfs":{"total":200000000,"available":199352946,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34599999999999997,"15min":0.312},"min":{"1min":0.22500000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.56699999999999995,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.35499999999999998,"15min":0.32800000000000001},"min":{"1min":0.22500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.255}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.318},"min":{"1min":0.26200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70399999999999996,"5min":1.639,"15min":1.639},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.38800000000000001,"15min":0.33200000000000002},"min":{"1min":0.28699999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.47399999999999998,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.311}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40000000000000002,"15min":0.35899999999999999},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.52800000000000002,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.34799999999999998},"min":{"1min":0.28599999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.29899999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.52200000000000002},"min":{"1min":0.35699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79100000000000004,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.42899999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.49299999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.52600000000000002},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73099999999999998,"5min":0.87,"15min":0.87},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.443},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.58199999999999996},"min":{"1min":0.51800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79100000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194104,"statfs":{"total":200000000,"available":198762578,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.371},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.377,"15min":0.39500000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.67400000000000004,"5min":1.079,"15min":1.079},"last":0.47899999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.39100000000000001},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":1.464,"15min":1.464},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.432,"5min":0.40200000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67900000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":1.341,"15min":1.341},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.42099999999999999,"15min":0.435},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68600000000000005,"5min":1.532,"15min":1.532},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90200000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.60999999999999999},"min":{"1min":0.36199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80100000000000005,"5min":1.51,"15min":1.51},"last":0.46500000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83299999999999996,"5min":1.25,"15min":1.25},"last":0.42599999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.92900000000000005,"5min":1.488,"15min":1.488},"last":0.501},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":1.024,"15min":1.024},"last":0.50900000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.438},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.90300000000000002,"5min":1.288,"15min":1.288},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194674,"statfs":{"total":200000000,"available":199347141,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.34300000000000003},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.49299999999999999,"5min":1.665,"15min":1.665},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.35799999999999998,"15min":0.36299999999999999},"min":{"1min":0.23499999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.50900000000000001,"5min":1.579,"15min":1.579},"last":0.441}]},{"osd":1,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.38400000000000001,"15min":0.38100000000000001},"min":{"1min":0.218,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.26600000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.48199999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.26100000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":1.454,"15min":1.454},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.39100000000000001},"min":{"1min":0.28100000000000003,"5min":0.224,"15min":0.224},"max":{"1min":0.56599999999999995,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.40500000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.40600000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81999999999999995,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.874,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.86599999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.36799999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83499999999999996,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.38600000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.76900000000000002,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.876}]},{"osd":6,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77600000000000002,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.85899999999999999,"5min":1.637,"15min":1.637},"last":0.752}]},{"osd":7,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":1.49,"15min":1.49},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81299999999999994,"5min":1.375,"15min":1.375},"last":0.89700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194674,"statfs":{"total":200000000,"available":199347141,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35499999999999998,"15min":0.33100000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.90200000000000002,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34899999999999998,"15min":0.32100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.504,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.33200000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38100000000000001,"15min":0.35999999999999999},"min":{"1min":0.245,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.61599999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41999999999999998,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70099999999999996,"5min":1.885,"15min":1.885},"last":0.41799999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.38100000000000001},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57699999999999996,"5min":1.274,"15min":1.274},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.40300000000000002},"min":{"1min":0.32100000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.97699999999999998,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.36799999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.503},"min":{"1min":0.36699999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78500000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57399999999999995,"15min":0.53500000000000003},"min":{"1min":0.45200000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80800000000000005,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.70799999999999996}]},{"osd":5,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.42799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79400000000000004,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.59699999999999998,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.038,"5min":1.851,"15min":1.851},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60299999999999998,"15min":0.55900000000000005},"min":{"1min":0.45100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77200000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.58599999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84199999999999997,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.746}]},{"osd":7,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.57699999999999996},"min":{"1min":0.45600000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0089999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.59299999999999997,"15min":0.55700000000000005},"min":{"1min":0.42699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80000000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194674,"statfs":{"total":200000000,"available":199347141,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.72199999999999998,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.71099999999999997,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.35199999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.501},"min":{"1min":0.29499999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.70099999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68799999999999994,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.39200000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.53100000000000003},"min":{"1min":0.45200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68400000000000005,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53900000000000003,"15min":0.50800000000000001},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69099999999999995,"5min":1.29,"15min":1.29},"last":0.51600000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.52700000000000002},"min":{"1min":0.38400000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":2.052,"15min":2.052},"last":0.503},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71199999999999997,"5min":1.369,"15min":1.369},"last":0.47499999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.75700000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.495,"15min":0.495},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76500000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45200000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.32800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.372},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.75900000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.48999999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54000000000000004,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85099999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79300000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.54600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194674,"statfs":{"total":200000000,"available":199347141,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.51600000000000001},"min":{"1min":0.314,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.48299999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.51700000000000002,"15min":0.49099999999999999},"min":{"1min":0.34999999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.46600000000000003}]},{"osd":2,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76800000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.374},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.73399999999999999,"5min":0.754,"15min":0.754},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78900000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.44600000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.47899999999999998},"min":{"1min":0.31,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57299999999999995,"15min":0.59599999999999997},"min":{"1min":0.40300000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.754,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.54400000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71399999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.501},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.63}]},{"osd":7,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54900000000000004,"15min":0.57699999999999996},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.59699999999999998},"min":{"1min":0.39200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80100000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.72899999999999998}]}]}],"pool_statfs":[]}} 2023-10-07T08:48:45.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:48:45.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.860+0000 7fdf20fb4700 1 Processor -- start 2023-10-07T08:48:45.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.860+0000 7fdf20fb4700 1 -- start start 2023-10-07T08:48:45.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.861+0000 7fdf20fb4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdf1c154350 0x7fdf1c0cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.861+0000 7fdf20fb4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf1c06f200 0x7fdf1c15a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.861+0000 7fdf20fb4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf1c154720 0x7fdf1c0cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.861+0000 7fdf20fb4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1c157010 con 0x7fdf1c06f200 2023-10-07T08:48:45.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.861+0000 7fdf20fb4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1c0b2c20 con 0x7fdf1c154350 2023-10-07T08:48:45.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.861+0000 7fdf20fb4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0b2f00 con 0x7fdf1c154720 2023-10-07T08:48:45.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.861+0000 7fdf1affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf1c06f200 0x7fdf1c15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.861+0000 7fdf1affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf1c06f200 0x7fdf1c15a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44816/0 (socket says 172.21.15.81:44816) 2023-10-07T08:48:45.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.861+0000 7fdf1affd700 1 -- 172.21.15.81:0/3652251510 learned_addr learned my addr 172.21.15.81:0/3652251510 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:45.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.861+0000 7fdf1b7fe700 1 --2- 172.21.15.81:0/3652251510 >> v2:172.21.15.89:3300/0 conn(0x7fdf1c154350 0x7fdf1c0cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.861+0000 7fdf1bfff700 1 --2- 172.21.15.81:0/3652251510 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf1c154720 0x7fdf1c0cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf1affd700 1 -- 172.21.15.81:0/3652251510 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf1c154720 msgr2=0x7fdf1c0cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:45.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf1affd700 1 --2- 172.21.15.81:0/3652251510 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf1c154720 0x7fdf1c0cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf1affd700 1 -- 172.21.15.81:0/3652251510 >> v2:172.21.15.89:3300/0 conn(0x7fdf1c154350 msgr2=0x7fdf1c0cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:45.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf1affd700 1 --2- 172.21.15.81:0/3652251510 >> v2:172.21.15.89:3300/0 conn(0x7fdf1c154350 0x7fdf1c0cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf1affd700 1 -- 172.21.15.81:0/3652251510 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c0b31e0 con 0x7fdf1c06f200 2023-10-07T08:48:45.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf1b7fe700 1 --2- 172.21.15.81:0/3652251510 >> v2:172.21.15.89:3300/0 conn(0x7fdf1c154350 0x7fdf1c0cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:48:45.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf1affd700 1 --2- 172.21.15.81:0/3652251510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c06f200 0x7fdf1c15a610 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c063e00 tx=0x7fdf10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9013eca5da249d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf1a7fc700 1 -- 172.21.15.81:0/3652251510 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1000b640 con 0x7fdf1c06f200 2023-10-07T08:48:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf1a7fc700 1 -- 172.21.15.81:0/3652251510 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1000b7a0 con 0x7fdf1c06f200 2023-10-07T08:48:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf1a7fc700 1 -- 172.21.15.81:0/3652251510 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1000bb40 con 0x7fdf1c06f200 2023-10-07T08:48:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf20fb4700 1 -- 172.21.15.81:0/3652251510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c06f200 msgr2=0x7fdf1c15a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf20fb4700 1 --2- 172.21.15.81:0/3652251510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c06f200 0x7fdf1c15a610 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c063e00 tx=0x7fdf10009250 comp rx=0 tx=0).stop 2023-10-07T08:48:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf20fb4700 1 -- 172.21.15.81:0/3652251510 shutdown_connections 2023-10-07T08:48:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf20fb4700 1 --2- 172.21.15.81:0/3652251510 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf1c154720 0x7fdf1c0cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf20fb4700 1 --2- 172.21.15.81:0/3652251510 >> v2:172.21.15.89:3300/0 conn(0x7fdf1c154350 0x7fdf1c0cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf20fb4700 1 --2- 172.21.15.81:0/3652251510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c06f200 0x7fdf1c15a610 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf20fb4700 1 -- 172.21.15.81:0/3652251510 >> 172.21.15.81:0/3652251510 conn(0x7fdf1c063230 msgr2=0x7fdf1c063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf20fb4700 1 -- 172.21.15.81:0/3652251510 shutdown_connections 2023-10-07T08:48:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.862+0000 7fdf20fb4700 1 -- 172.21.15.81:0/3652251510 wait complete. 2023-10-07T08:48:45.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.864+0000 7fdf20fb4700 1 Processor -- start 2023-10-07T08:48:45.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.864+0000 7fdf20fb4700 1 -- start start 2023-10-07T08:48:45.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.864+0000 7fdf20fb4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf1c06f200 0x7fdf1c150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.864+0000 7fdf20fb4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf1c154350 0x7fdf1c0c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.864+0000 7fdf20fb4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c154720 0x7fdf1c0b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.864+0000 7fdf20fb4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0c96f0 con 0x7fdf1c154720 2023-10-07T08:48:45.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.864+0000 7fdf20fb4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0c4150 con 0x7fdf1c06f200 2023-10-07T08:48:45.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.864+0000 7fdf20fb4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0c3820 con 0x7fdf1c154350 2023-10-07T08:48:45.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.865+0000 7fdf1bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c154720 0x7fdf1c0b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.865+0000 7fdf1bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c154720 0x7fdf1c0b0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44830/0 (socket says 172.21.15.81:44830) 2023-10-07T08:48:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.865+0000 7fdf1bfff700 1 -- 172.21.15.81:0/3471980244 learned_addr learned my addr 172.21.15.81:0/3471980244 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.865+0000 7fdf1affd700 1 --2- 172.21.15.81:0/3471980244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf1c154350 0x7fdf1c0c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.865+0000 7fdf1b7fe700 1 --2- 172.21.15.81:0/3471980244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf1c06f200 0x7fdf1c150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.865+0000 7fdf1bfff700 1 -- 172.21.15.81:0/3471980244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf1c154350 msgr2=0x7fdf1c0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.865+0000 7fdf1bfff700 1 --2- 172.21.15.81:0/3471980244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf1c154350 0x7fdf1c0c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.865+0000 7fdf1bfff700 1 -- 172.21.15.81:0/3471980244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf1c06f200 msgr2=0x7fdf1c150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.865+0000 7fdf1bfff700 1 --2- 172.21.15.81:0/3471980244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf1c06f200 0x7fdf1c150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.865+0000 7fdf1bfff700 1 -- 172.21.15.81:0/3471980244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c009a20 con 0x7fdf1c154720 2023-10-07T08:48:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.865+0000 7fdf1bfff700 1 --2- 172.21.15.81:0/3471980244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c154720 0x7fdf1c0b0df0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400e8d0 tx=0x7fdf140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.865+0000 7fdf037fe700 1 -- 172.21.15.81:0/3471980244 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14013680 con 0x7fdf1c154720 2023-10-07T08:48:45.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.865+0000 7fdf037fe700 1 -- 172.21.15.81:0/3471980244 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf14013800 con 0x7fdf1c154720 2023-10-07T08:48:45.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.865+0000 7fdf20fb4700 1 -- 172.21.15.81:0/3471980244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf100094f0 con 0x7fdf1c154720 2023-10-07T08:48:45.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.865+0000 7fdf037fe700 1 -- 172.21.15.81:0/3471980244 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14013bc0 con 0x7fdf1c154720 2023-10-07T08:48:45.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.865+0000 7fdf20fb4700 1 -- 172.21.15.81:0/3471980244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c0c3de0 con 0x7fdf1c154720 2023-10-07T08:48:45.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.866+0000 7fdf20fb4700 1 -- 172.21.15.81:0/3471980244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1c0c42c0 con 0x7fdf1c154720 2023-10-07T08:48:45.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.867+0000 7fdf037fe700 1 -- 172.21.15.81:0/3471980244 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf140123d0 con 0x7fdf1c154720 2023-10-07T08:48:45.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.867+0000 7fdf037fe700 1 --2- 172.21.15.81:0/3471980244 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf08066f30 0x7fdf080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:45.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.867+0000 7fdf037fe700 1 -- 172.21.15.81:0/3471980244 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf140844c0 con 0x7fdf1c154720 2023-10-07T08:48:45.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.867+0000 7fdf1b7fe700 1 --2- 172.21.15.81:0/3471980244 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf08066f30 0x7fdf080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:45.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.867+0000 7fdf1b7fe700 1 --2- 172.21.15.81:0/3471980244 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf08066f30 0x7fdf080693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009fd0 tx=0x7fdf0c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:45.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:45.871+0000 7fdf037fe700 1 -- 172.21.15.81:0/3471980244 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf14051730 con 0x7fdf1c154720 2023-10-07T08:48:46.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.051+0000 7fdf20fb4700 1 -- 172.21.15.81:0/3471980244 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf1c0b34c0 con 0x7fdf08066f30 2023-10-07T08:48:46.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.058+0000 7fdf037fe700 1 -- 172.21.15.81:0/3471980244 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276131 (secure 0 0 0) 0x7fdf1c0b34c0 con 0x7fdf08066f30 2023-10-07T08:48:46.061 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.061+0000 7fdf20fb4700 1 -- 172.21.15.81:0/3471980244 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf08066f30 msgr2=0x7fdf080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.061+0000 7fdf20fb4700 1 --2- 172.21.15.81:0/3471980244 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf08066f30 0x7fdf080693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009fd0 tx=0x7fdf0c00b040 comp rx=0 tx=0).stop 2023-10-07T08:48:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.061+0000 7fdf20fb4700 1 -- 172.21.15.81:0/3471980244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c154720 msgr2=0x7fdf1c0b0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.061+0000 7fdf20fb4700 1 --2- 172.21.15.81:0/3471980244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c154720 0x7fdf1c0b0df0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400e8d0 tx=0x7fdf140091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.061+0000 7fdf20fb4700 1 -- 172.21.15.81:0/3471980244 shutdown_connections 2023-10-07T08:48:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.061+0000 7fdf20fb4700 1 --2- 172.21.15.81:0/3471980244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c154720 0x7fdf1c0b0df0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.061+0000 7fdf20fb4700 1 --2- 172.21.15.81:0/3471980244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf1c06f200 0x7fdf1c150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.061+0000 7fdf20fb4700 1 --2- 172.21.15.81:0/3471980244 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf08066f30 0x7fdf080693e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.061+0000 7fdf20fb4700 1 --2- 172.21.15.81:0/3471980244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf1c154350 0x7fdf1c0c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.061+0000 7fdf20fb4700 1 -- 172.21.15.81:0/3471980244 >> 172.21.15.81:0/3471980244 conn(0x7fdf1c063230 msgr2=0x7fdf1c0b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.061+0000 7fdf20fb4700 1 -- 172.21.15.81:0/3471980244 shutdown_connections 2023-10-07T08:48:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.061+0000 7fdf20fb4700 1 -- 172.21.15.81:0/3471980244 wait complete. 2023-10-07T08:48:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:48:46.074 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2023-10-07T08:48:44.080588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6230,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556269,"statfs":{"total":1600000000,"available":1593619612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.801879"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.282487+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:09.660818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.286478+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:20:11.641491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281476+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:56:55.954668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.282136+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:20:11.641491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284377+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:31:11.513599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.282062+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:24:24.553384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284162+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:04:30.313866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284381+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:56:35.607018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.283891+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:40:59.258281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.280557+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:07.308237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.285900+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:07.308237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284061+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:03:05.654180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.283879+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:41:55.655777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.283801+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:59:14.096601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284425+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:36:07.526999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284343+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:42:54.190885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.283973+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:22.814037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284426+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:44:05.208561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281332+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:03:05.654180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281742+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:53:14.493858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284592+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:56:55.954668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284106+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:36:07.526999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281813+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:07.308237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284460+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:40:43.985905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281367+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:40:43.985905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281332+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:36:07.526999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284054+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:39.683818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.281508+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:27.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.284717+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:15:34.746855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.280503+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:53:14.493858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.283788+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:52:57.933341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-07T08:48:40.278787+0000","last_change":"2023-10-07T08:48:40.278787+0000","last_active":"2023-10-07T08:48:40.278787+0000","last_peered":"2023-10-07T08:48:40.278787+0000","last_clean":"2023-10-07T08:48:40.278787+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:40.278787+0000","last_undegraded":"2023-10-07T08:48:40.278787+0000","last_fullsized":"2023-10-07T08:48:40.278787+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-07T08:48:39.277032+0000","last_change":"2023-10-07T08:48:39.285958+0000","last_active":"2023-10-07T08:48:39.277032+0000","last_peered":"2023-10-07T08:48:39.277032+0000","last_clean":"2023-10-07T08:48:39.277032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-07T08:48:39.277032+0000","last_undegraded":"2023-10-07T08:48:39.277032+0000","last_fullsized":"2023-10-07T08:48:39.277032+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:24:24.553384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":245,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-07T08:48:37.761440+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:48:37.761440+0000","last_peered":"2023-10-07T08:48:37.761440+0000","last_clean":"2023-10-07T08:48:37.761440+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:48:37.761440+0000","last_undegraded":"2023-10-07T08:48:37.761440+0000","last_fullsized":"2023-10-07T08:48:37.761440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194104,"statfs":{"total":200000000,"available":198762578,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.5},"min":{"1min":0.36599999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.48699999999999999},"min":{"1min":0.379,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68000000000000005,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.46600000000000003}]},{"osd":1,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.41799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.435},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.40500000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.54500000000000004}]},{"osd":2,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51400000000000001,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.75},"last":0.59999999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.629,"15min":0.80700000000000005},"min":{"1min":0.38800000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.68400000000000005,"5min":6.8570000000000002,"15min":6.8570000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.749,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.67200000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.28799999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66400000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.627},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.502,"15min":0.53300000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69499999999999995,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.61899999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":0.751,"15min":0.751},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54200000000000004,"15min":0.56999999999999995},"min":{"1min":0.318,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73299999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56899999999999995,"15min":0.59199999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72999999999999998,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71599999999999997,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.66200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194680,"statfs":{"total":200000000,"available":199352946,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.495,"15min":0.47299999999999998},"min":{"1min":0.316,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.39600000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.44600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.55500000000000005,"15min":0.53200000000000003},"min":{"1min":0.495,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.52700000000000002,"15min":0.48199999999999998},"min":{"1min":0.38200000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.435,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78100000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.50800000000000001},"min":{"1min":0.40899999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.32900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.44900000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.40600000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73899999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.42699999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.40100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.503},{"interface":"front","average":{"1min":0.622,"5min":0.59599999999999997,"15min":0.58199999999999996},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89100000000000001,"5min":1.052,"15min":1.052},"last":0.56999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194680,"statfs":{"total":200000000,"available":199352946,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34599999999999997,"15min":0.312},"min":{"1min":0.22500000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.56699999999999995,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.35499999999999998,"15min":0.32800000000000001},"min":{"1min":0.22500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.255}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.318},"min":{"1min":0.26200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70399999999999996,"5min":1.639,"15min":1.639},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.38800000000000001,"15min":0.33200000000000002},"min":{"1min":0.28699999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.47399999999999998,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.311}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40000000000000002,"15min":0.35899999999999999},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.52800000000000002,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.34799999999999998},"min":{"1min":0.28599999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.29899999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.52200000000000002},"min":{"1min":0.35699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79100000000000004,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.42899999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.49299999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.52600000000000002},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73099999999999998,"5min":0.87,"15min":0.87},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.443},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.58199999999999996},"min":{"1min":0.51800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79100000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194104,"statfs":{"total":200000000,"available":198762578,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.371},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.377,"15min":0.39500000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.67400000000000004,"5min":1.079,"15min":1.079},"last":0.47899999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.39100000000000001},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":1.464,"15min":1.464},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.432,"5min":0.40200000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67900000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":1.341,"15min":1.341},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.42099999999999999,"15min":0.435},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68600000000000005,"5min":1.532,"15min":1.532},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90200000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.60999999999999999},"min":{"1min":0.36199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80100000000000005,"5min":1.51,"15min":1.51},"last":0.46500000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83299999999999996,"5min":1.25,"15min":1.25},"last":0.42599999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.92900000000000005,"5min":1.488,"15min":1.488},"last":0.501},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":1.024,"15min":1.024},"last":0.50900000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.438},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.90300000000000002,"5min":1.288,"15min":1.288},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194674,"statfs":{"total":200000000,"available":199347141,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.34300000000000003},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.49299999999999999,"5min":1.665,"15min":1.665},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.35799999999999998,"15min":0.36299999999999999},"min":{"1min":0.23499999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.50900000000000001,"5min":1.579,"15min":1.579},"last":0.441}]},{"osd":1,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.38400000000000001,"15min":0.38100000000000001},"min":{"1min":0.218,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.26600000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.48199999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.26100000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":1.454,"15min":1.454},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.39100000000000001},"min":{"1min":0.28100000000000003,"5min":0.224,"15min":0.224},"max":{"1min":0.56599999999999995,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.40500000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.40600000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81999999999999995,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.874,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.86599999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.36799999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83499999999999996,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.38600000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.76900000000000002,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.876}]},{"osd":6,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77600000000000002,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.85899999999999999,"5min":1.637,"15min":1.637},"last":0.752}]},{"osd":7,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":1.49,"15min":1.49},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81299999999999994,"5min":1.375,"15min":1.375},"last":0.89700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194674,"statfs":{"total":200000000,"available":199347141,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35499999999999998,"15min":0.33100000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.90200000000000002,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34899999999999998,"15min":0.32100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.504,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.33200000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38100000000000001,"15min":0.35999999999999999},"min":{"1min":0.245,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.61599999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41999999999999998,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70099999999999996,"5min":1.885,"15min":1.885},"last":0.41799999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.38100000000000001},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57699999999999996,"5min":1.274,"15min":1.274},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.40300000000000002},"min":{"1min":0.32100000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.97699999999999998,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.36799999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.503},"min":{"1min":0.36699999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78500000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57399999999999995,"15min":0.53500000000000003},"min":{"1min":0.45200000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80800000000000005,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.70799999999999996}]},{"osd":5,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.42799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79400000000000004,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.59699999999999998,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.038,"5min":1.851,"15min":1.851},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60299999999999998,"15min":0.55900000000000005},"min":{"1min":0.45100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77200000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.58599999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84199999999999997,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.746}]},{"osd":7,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.57699999999999996},"min":{"1min":0.45600000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0089999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.59299999999999997,"15min":0.55700000000000005},"min":{"1min":0.42699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80000000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194674,"statfs":{"total":200000000,"available":199347141,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.72199999999999998,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.71099999999999997,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.35199999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.501},"min":{"1min":0.29499999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.70099999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68799999999999994,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.39200000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.53100000000000003},"min":{"1min":0.45200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68400000000000005,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53900000000000003,"15min":0.50800000000000001},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69099999999999995,"5min":1.29,"15min":1.29},"last":0.51600000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.52700000000000002},"min":{"1min":0.38400000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":2.052,"15min":2.052},"last":0.503},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71199999999999997,"5min":1.369,"15min":1.369},"last":0.47499999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.75700000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.495,"15min":0.495},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76500000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45200000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.32800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.372},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.75900000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.48999999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54000000000000004,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85099999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79300000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.54600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194674,"statfs":{"total":200000000,"available":199347141,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.51600000000000001},"min":{"1min":0.314,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.48299999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.51700000000000002,"15min":0.49099999999999999},"min":{"1min":0.34999999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.46600000000000003}]},{"osd":2,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76800000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.374},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.73399999999999999,"5min":0.754,"15min":0.754},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78900000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.44600000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.47899999999999998},"min":{"1min":0.31,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57299999999999995,"15min":0.59599999999999997},"min":{"1min":0.40300000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.754,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.54400000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71399999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.501},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.63}]},{"osd":7,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54900000000000004,"15min":0.57699999999999996},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.59699999999999998},"min":{"1min":0.39200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80100000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.72899999999999998}]}]}],"pool_statfs":[]}} 2023-10-07T08:48:46.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2023-10-07T08:48:46.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2023-10-07T08:48:46.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2023-10-07T08:48:46.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2023-10-07T08:48:46.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2023-10-07T08:48:46.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2023-10-07T08:48:46.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2023-10-07T08:48:46.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2023-10-07T08:48:46.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2023-10-07T08:48:46.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2023-10-07T08:48:46.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2023-10-07T08:48:46.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2023-10-07T08:48:46.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2023-10-07T08:48:46.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2023-10-07T08:48:46.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2023-10-07T08:48:46.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2023-10-07T08:48:46.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2023-10-07T08:48:46.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2023-10-07T08:48:46.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2023-10-07T08:48:46.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2023-10-07T08:48:46.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2023-10-07T08:48:46.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2023-10-07T08:48:46.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2023-10-07T08:48:46.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2023-10-07T08:48:46.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2023-10-07T08:48:46.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2023-10-07T08:48:46.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2023-10-07T08:48:46.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2023-10-07T08:48:46.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2023-10-07T08:48:46.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2023-10-07T08:48:46.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2023-10-07T08:48:46.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2023-10-07T08:48:46.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2023-10-07T08:48:46.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2023-10-07T08:48:46.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.282487+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:32:09.660818+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T08:48:46.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2023-10-07T08:48:46.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2023-10-07T08:48:46.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.286478+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T10:20:11.641491+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T08:48:46.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2023-10-07T08:48:46.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2023-10-07T08:48:46.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.281476+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:56:55.954668+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T08:48:46.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2023-10-07T08:48:46.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2023-10-07T08:48:46.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.282136+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T10:20:11.641491+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T08:48:46.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2023-10-07T08:48:46.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2023-10-07T08:48:46.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.284377+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:31:11.513599+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T08:48:46.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2023-10-07T08:48:46.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2023-10-07T08:48:46.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.282062+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:24:24.553384+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T08:48:46.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2023-10-07T08:48:46.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-10-07T08:48:46.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.284162+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T10:04:30.313866+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T08:48:46.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2023-10-07T08:48:46.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2023-10-07T08:48:46.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.284381+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T08:56:35.607018+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T08:48:46.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2023-10-07T08:48:46.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2023-10-07T08:48:46.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.283891+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T10:40:59.258281+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T08:48:46.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2023-10-07T08:48:46.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2023-10-07T08:48:46.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.280557+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T12:43:07.308237+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-07T08:48:46.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2023-10-07T08:48:46.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-10-07T08:48:46.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.285900+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T12:43:07.308237+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T08:48:46.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2023-10-07T08:48:46.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-10-07T08:48:46.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.284061+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T20:03:05.654180+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T08:48:46.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2023-10-07T08:48:46.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-10-07T08:48:46.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.283879+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T19:41:55.655777+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T08:48:46.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2023-10-07T08:48:46.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2023-10-07T08:48:46.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.283801+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:59:14.096601+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T08:48:46.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2023-10-07T08:48:46.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-10-07T08:48:46.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.284425+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:36:07.526999+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T08:48:46.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2023-10-07T08:48:46.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2023-10-07T08:48:46.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.284343+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T19:42:54.190885+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-07T08:48:46.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2023-10-07T08:48:46.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-10-07T08:48:46.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.283973+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T09:16:22.814037+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-07T08:48:46.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2023-10-07T08:48:46.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-10-07T08:48:46.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.284426+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T09:44:05.208561+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T08:48:46.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2023-10-07T08:48:46.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2023-10-07T08:48:46.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.281332+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T20:03:05.654180+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T08:48:46.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2023-10-07T08:48:46.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2023-10-07T08:48:46.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.281742+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T19:53:14.493858+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T08:48:46.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2023-10-07T08:48:46.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-10-07T08:48:46.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.284592+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:56:55.954668+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T08:48:46.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2023-10-07T08:48:46.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-10-07T08:48:46.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.284106+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:36:07.526999+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T08:48:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2023-10-07T08:48:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2023-10-07T08:48:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.281813+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T12:43:07.308237+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T08:48:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2023-10-07T08:48:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-10-07T08:48:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.284460+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:40:43.985905+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-07T08:48:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2023-10-07T08:48:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2023-10-07T08:48:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.281367+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T15:40:43.985905+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T08:48:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2023-10-07T08:48:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2023-10-07T08:48:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.281332+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T18:36:07.526999+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T08:48:46.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2023-10-07T08:48:46.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-10-07T08:48:46.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.284054+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T19:15:39.683818+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T08:48:46.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2023-10-07T08:48:46.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2023-10-07T08:48:46.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.281508+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T17:12:27.856597+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-07T08:48:46.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2023-10-07T08:48:46.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-10-07T08:48:46.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.284717+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T10:15:34.746855+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-07T08:48:46.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2023-10-07T08:48:46.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2023-10-07T08:48:46.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.280503+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T19:53:14.493858+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-07T08:48:46.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2023-10-07T08:48:46.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2023-10-07T08:48:46.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.283788+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T10:52:57.933341+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-07T08:48:46.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2023-10-07T08:48:46.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-07T08:48:40.278787+0000', 'last_change': '2023-10-07T08:48:40.278787+0000', 'last_active': '2023-10-07T08:48:40.278787+0000', 'last_peered': '2023-10-07T08:48:40.278787+0000', 'last_clean': '2023-10-07T08:48:40.278787+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:40.278787+0000', 'last_undegraded': '2023-10-07T08:48:40.278787+0000', 'last_fullsized': '2023-10-07T08:48:40.278787+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:40.278787+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-07T08:48:46.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-10-07T08:48:46.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-07T08:48:39.277032+0000', 'last_change': '2023-10-07T08:48:39.285958+0000', 'last_active': '2023-10-07T08:48:39.277032+0000', 'last_peered': '2023-10-07T08:48:39.277032+0000', 'last_clean': '2023-10-07T08:48:39.277032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-07T08:48:39.277032+0000', 'last_undegraded': '2023-10-07T08:48:39.277032+0000', 'last_fullsized': '2023-10-07T08:48:39.277032+0000', 'mapping_epoch': 120, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 120, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'last_clean_scrub_stamp': '2023-10-07T08:48:39.277032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-08T11:24:24.553384+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-07T08:48:46.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-07T08:48:46.142 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-10-07T08:48:46.142+0000 7f2374ceb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:48:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.228+0000 7ffbb3e45700 1 Processor -- start 2023-10-07T08:48:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.228+0000 7ffbb3e45700 1 -- start start 2023-10-07T08:48:46.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.229+0000 7ffbb3e45700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffbac1577e0 0x7ffbac15b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:46.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.229+0000 7ffbb3e45700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffbac06d240 0x7ffbac06d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:46.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.229+0000 7ffbb3e45700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbac06dba0 con 0x7ffbac157bb0 2023-10-07T08:48:46.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.229+0000 7ffbb3e45700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbac0cfdd0 con 0x7ffbac06d240 2023-10-07T08:48:46.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.229+0000 7ffbb3e45700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbac0d00b0 con 0x7ffbac1577e0 2023-10-07T08:48:46.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.229+0000 7ffbb23e2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffbac06d240 0x7ffbac06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:46.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.229+0000 7ffbb13e0700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ffbac157bb0 0x7ffbac0cf510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46516/0 (socket says 172.21.15.81:46516) 2023-10-07T08:48:46.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.229+0000 7ffbb13e0700 1 -- 172.21.15.81:0/571592877 learned_addr learned my addr 172.21.15.81:0/571592877 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:46.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.229+0000 7ffbb1be1700 1 --2- 172.21.15.81:0/571592877 >> v2:172.21.15.89:3300/0 conn(0x7ffbac1577e0 0x7ffbac15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:46.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.229+0000 7ffbb23e2700 1 -- 172.21.15.81:0/571592877 >> v2:172.21.15.89:3300/0 conn(0x7ffbac1577e0 msgr2=0x7ffbac15b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:46.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.229+0000 7ffbb23e2700 1 --2- 172.21.15.81:0/571592877 >> v2:172.21.15.89:3300/0 conn(0x7ffbac1577e0 0x7ffbac15b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.229+0000 7ffbb23e2700 1 -- 172.21.15.81:0/571592877 >> v1:172.21.15.81:6789/0 conn(0x7ffbac157bb0 legacy=0x7ffbac0cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:46.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.229+0000 7ffbb23e2700 1 -- 172.21.15.81:0/571592877 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac0d0390 con 0x7ffbac06d240 2023-10-07T08:48:46.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.230+0000 7ffbb23e2700 1 --2- 172.21.15.81:0/571592877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac06d240 0x7ffbac06d660 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ffbac064ac0 tx=0x7ffba40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161139df31987165 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:46.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.230+0000 7ffbb0bdf700 1 -- 172.21.15.81:0/571592877 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4011630 con 0x7ffbac06d240 2023-10-07T08:48:46.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.230+0000 7ffbb0bdf700 1 -- 172.21.15.81:0/571592877 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba4011790 con 0x7ffbac06d240 2023-10-07T08:48:46.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.230+0000 7ffbb0bdf700 1 -- 172.21.15.81:0/571592877 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4011b30 con 0x7ffbac06d240 2023-10-07T08:48:46.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.230+0000 7ffbb3e45700 1 -- 172.21.15.81:0/571592877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac06d240 msgr2=0x7ffbac06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:46.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.230+0000 7ffbb3e45700 1 --2- 172.21.15.81:0/571592877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac06d240 0x7ffbac06d660 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ffbac064ac0 tx=0x7ffba40091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.230+0000 7ffbb3e45700 1 -- 172.21.15.81:0/571592877 shutdown_connections 2023-10-07T08:48:46.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.230+0000 7ffbb3e45700 1 --2- 172.21.15.81:0/571592877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac06d240 0x7ffbac06d660 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.230+0000 7ffbb3e45700 1 --2- 172.21.15.81:0/571592877 >> v2:172.21.15.89:3300/0 conn(0x7ffbac1577e0 0x7ffbac15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.230+0000 7ffbb3e45700 1 -- 172.21.15.81:0/571592877 >> 172.21.15.81:0/571592877 conn(0x7ffbac06bb90 msgr2=0x7ffbac06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:46.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.230+0000 7ffbb3e45700 1 -- 172.21.15.81:0/571592877 shutdown_connections 2023-10-07T08:48:46.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.230+0000 7ffbb3e45700 1 -- 172.21.15.81:0/571592877 wait complete. 2023-10-07T08:48:46.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.232+0000 7ffbb3e45700 1 Processor -- start 2023-10-07T08:48:46.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.232+0000 7ffbb3e45700 1 -- start start 2023-10-07T08:48:46.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.232+0000 7ffbb3e45700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac06d240 0x7ffbac155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:46.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.232+0000 7ffbb3e45700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbac1577e0 0x7ffbac0c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:46.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.232+0000 7ffbb3e45700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbac157bb0 0x7ffbac0c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:46.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.232+0000 7ffbb3e45700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac15d430 con 0x7ffbac06d240 2023-10-07T08:48:46.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.232+0000 7ffbb3e45700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac15dfb0 con 0x7ffbac157bb0 2023-10-07T08:48:46.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.232+0000 7ffbb3e45700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac15d680 con 0x7ffbac1577e0 2023-10-07T08:48:46.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.232+0000 7ffbb1be1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac06d240 0x7ffbac155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:46.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.232+0000 7ffbb1be1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac06d240 0x7ffbac155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44838/0 (socket says 172.21.15.81:44838) 2023-10-07T08:48:46.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.232+0000 7ffbb1be1700 1 -- 172.21.15.81:0/1028130039 learned_addr learned my addr 172.21.15.81:0/1028130039 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:46.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.233+0000 7ffbb13e0700 1 --2- 172.21.15.81:0/1028130039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbac1577e0 0x7ffbac0c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:46.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.233+0000 7ffbb23e2700 1 --2- 172.21.15.81:0/1028130039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbac157bb0 0x7ffbac0c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:46.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.233+0000 7ffbb1be1700 1 -- 172.21.15.81:0/1028130039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbac1577e0 msgr2=0x7ffbac0c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:46.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.233+0000 7ffbb1be1700 1 --2- 172.21.15.81:0/1028130039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbac1577e0 0x7ffbac0c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.233+0000 7ffbb1be1700 1 -- 172.21.15.81:0/1028130039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbac157bb0 msgr2=0x7ffbac0c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:46.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.233+0000 7ffbb1be1700 1 --2- 172.21.15.81:0/1028130039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbac157bb0 0x7ffbac0c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.233+0000 7ffbb1be1700 1 -- 172.21.15.81:0/1028130039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba4009420 con 0x7ffbac06d240 2023-10-07T08:48:46.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.233+0000 7ffbb1be1700 1 --2- 172.21.15.81:0/1028130039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac06d240 0x7ffbac155bb0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009ef0 tx=0x7ffba800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:46.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.233+0000 7ffba1ffb700 1 -- 172.21.15.81:0/1028130039 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba800cc50 con 0x7ffbac06d240 2023-10-07T08:48:46.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.233+0000 7ffba1ffb700 1 -- 172.21.15.81:0/1028130039 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba800f040 con 0x7ffbac06d240 2023-10-07T08:48:46.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.233+0000 7ffbb3e45700 1 -- 172.21.15.81:0/1028130039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbac15d960 con 0x7ffbac06d240 2023-10-07T08:48:46.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.233+0000 7ffba1ffb700 1 -- 172.21.15.81:0/1028130039 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8014480 con 0x7ffbac06d240 2023-10-07T08:48:46.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.233+0000 7ffbb3e45700 1 -- 172.21.15.81:0/1028130039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbac1560f0 con 0x7ffbac06d240 2023-10-07T08:48:46.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.234+0000 7ffbb3e45700 1 -- 172.21.15.81:0/1028130039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbac15e290 con 0x7ffbac06d240 2023-10-07T08:48:46.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.234+0000 7ffba1ffb700 1 -- 172.21.15.81:0/1028130039 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffba80147f0 con 0x7ffbac06d240 2023-10-07T08:48:46.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.235+0000 7ffba1ffb700 1 --2- 172.21.15.81:0/1028130039 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffb90066f30 0x7ffb900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:46.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.235+0000 7ffba1ffb700 1 -- 172.21.15.81:0/1028130039 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffba8084f70 con 0x7ffbac06d240 2023-10-07T08:48:46.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.235+0000 7ffbb13e0700 1 --2- 172.21.15.81:0/1028130039 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffb90066f30 0x7ffb900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:46.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.235+0000 7ffbb13e0700 1 --2- 172.21.15.81:0/1028130039 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffb90066f30 0x7ffb900693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c001820 tx=0x7ffb9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:46.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.239+0000 7ffba1ffb700 1 -- 172.21.15.81:0/1028130039 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffba80521e0 con 0x7ffbac06d240 2023-10-07T08:48:46.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.498+0000 7ffbb3e45700 1 -- 172.21.15.81:0/1028130039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ffbac06bf60 con 0x7ffbac06d240 2023-10-07T08:48:46.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.499+0000 7ffba1ffb700 1 -- 172.21.15.81:0/1028130039 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1428 (secure 0 0 0) 0x7ffba8055800 con 0x7ffbac06d240 2023-10-07T08:48:46.500 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:46.500 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":368,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":123,"num_osds":8,"num_up_osds":8,"osd_up_since":1696668164,"num_in_osds":8,"osd_in_since":1696668161,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":6562732,"bytes_avail":1593437268,"bytes_total":1600000000,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":58,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":6741}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-10-07T08:48:30.078356+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-07T08:48:46.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.501+0000 7ffbb3e45700 1 -- 172.21.15.81:0/1028130039 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffb90066f30 msgr2=0x7ffb900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:46.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.501+0000 7ffbb3e45700 1 --2- 172.21.15.81:0/1028130039 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffb90066f30 0x7ffb900693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c001820 tx=0x7ffb9c009040 comp rx=0 tx=0).stop 2023-10-07T08:48:46.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.501+0000 7ffbb3e45700 1 -- 172.21.15.81:0/1028130039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac06d240 msgr2=0x7ffbac155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:46.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.501+0000 7ffbb3e45700 1 --2- 172.21.15.81:0/1028130039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac06d240 0x7ffbac155bb0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009ef0 tx=0x7ffba800b040 comp rx=0 tx=0).stop 2023-10-07T08:48:46.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.501+0000 7ffbb3e45700 1 -- 172.21.15.81:0/1028130039 shutdown_connections 2023-10-07T08:48:46.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.501+0000 7ffbb3e45700 1 --2- 172.21.15.81:0/1028130039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbac157bb0 0x7ffbac0c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.501+0000 7ffbb3e45700 1 --2- 172.21.15.81:0/1028130039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbac06d240 0x7ffbac155bb0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.501+0000 7ffbb3e45700 1 --2- 172.21.15.81:0/1028130039 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffb90066f30 0x7ffb900693e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.501+0000 7ffbb3e45700 1 --2- 172.21.15.81:0/1028130039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbac1577e0 0x7ffbac0c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.501+0000 7ffbb3e45700 1 -- 172.21.15.81:0/1028130039 >> 172.21.15.81:0/1028130039 conn(0x7ffbac06bb90 msgr2=0x7ffbac06a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:46.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.501+0000 7ffbb3e45700 1 -- 172.21.15.81:0/1028130039 shutdown_connections 2023-10-07T08:48:46.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.501+0000 7ffbb3e45700 1 -- 172.21.15.81:0/1028130039 wait complete. 2023-10-07T08:48:46.513 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-07T08:48:46.513 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:48:46.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.667+0000 7fa0c54f6700 1 Processor -- start 2023-10-07T08:48:46.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.667+0000 7fa0c54f6700 1 -- start start 2023-10-07T08:48:46.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.668+0000 7fa0c54f6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c0159f10 0x7fa0c0068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:46.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.668+0000 7fa0c54f6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c00cee10 con 0x7fa0c0159b40 2023-10-07T08:48:46.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.668+0000 7fa0c54f6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c00cd040 con 0x7fa0c0068cc0 2023-10-07T08:48:46.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.668+0000 7fa0c54f6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c0069140 con 0x7fa0c0159f10 2023-10-07T08:48:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.668+0000 7fa0bffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa0c0159b40 0x7fa0c00cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46526/0 (socket says 172.21.15.81:46526) 2023-10-07T08:48:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.668+0000 7fa0bffff700 1 -- 172.21.15.81:0/3913843608 learned_addr learned my addr 172.21.15.81:0/3913843608 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.668+0000 7fa0beffd700 1 -- 172.21.15.81:0/3913843608 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1350179937 0 0) 0x7fa0c00cee10 con 0x7fa0c0159b40 2023-10-07T08:48:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.668+0000 7fa0bf7fe700 1 --2- 172.21.15.81:0/3913843608 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c0159f10 0x7fa0c0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.668+0000 7fa0beffd700 1 -- 172.21.15.81:0/3913843608 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0a8003570 con 0x7fa0c0159b40 2023-10-07T08:48:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.668+0000 7fa0beffd700 1 -- 172.21.15.81:0/3913843608 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3248477849 0 0) 0x7fa0a8003570 con 0x7fa0c0159b40 2023-10-07T08:48:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.668+0000 7fa0beffd700 1 -- 172.21.15.81:0/3913843608 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c0159f10 msgr2=0x7fa0c0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.668+0000 7fa0beffd700 1 --2- 172.21.15.81:0/3913843608 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c0159f10 0x7fa0c0068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.668+0000 7fa0beffd700 1 -- 172.21.15.81:0/3913843608 >> v1:172.21.15.89:6789/0 conn(0x7fa0c0068cc0 legacy=0x7fa0c00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.668+0000 7fa0beffd700 1 -- 172.21.15.81:0/3913843608 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c00cd320 con 0x7fa0c0159b40 2023-10-07T08:48:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.668+0000 7fa0beffd700 1 -- 172.21.15.81:0/3913843608 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fa0b0001470 con 0x7fa0c0159b40 2023-10-07T08:48:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0beffd700 1 -- 172.21.15.81:0/3913843608 >> v1:172.21.15.81:6789/0 conn(0x7fa0c0159b40 legacy=0x7fa0c00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0beffd700 1 --2- 172.21.15.81:0/3913843608 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c0159f10 0x7fa0a8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:46.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0beffd700 1 --2- 172.21.15.81:0/3913843608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0a8003fd0 0x7fa0a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:46.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0beffd700 1 --2- 172.21.15.81:0/3913843608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a8004d50 0x7fa0a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:46.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0beffd700 1 -- 172.21.15.81:0/3913843608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c0069140 con 0x7fa0a8003fd0 2023-10-07T08:48:46.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0beffd700 1 -- 172.21.15.81:0/3913843608 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a800bb40 con 0x7fa0a8004d50 2023-10-07T08:48:46.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0beffd700 1 -- 172.21.15.81:0/3913843608 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a800bd00 con 0x7fa0c0159f10 2023-10-07T08:48:46.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0bf7fe700 1 --2- 172.21.15.81:0/3913843608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0a8003fd0 0x7fa0a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:46.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0bffff700 1 --2- 172.21.15.81:0/3913843608 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c0159f10 0x7fa0a8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:46.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0c4cf5700 1 --2- 172.21.15.81:0/3913843608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a8004d50 0x7fa0a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:46.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0bf7fe700 1 -- 172.21.15.81:0/3913843608 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c0159f10 msgr2=0x7fa0a8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:46.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0bf7fe700 1 --2- 172.21.15.81:0/3913843608 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c0159f10 0x7fa0a8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0bf7fe700 1 -- 172.21.15.81:0/3913843608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a8004d50 msgr2=0x7fa0a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:46.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0bf7fe700 1 --2- 172.21.15.81:0/3913843608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a8004d50 0x7fa0a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0bf7fe700 1 -- 172.21.15.81:0/3913843608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a8003570 con 0x7fa0a8003fd0 2023-10-07T08:48:46.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0bf7fe700 1 --2- 172.21.15.81:0/3913843608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0a8003fd0 0x7fa0a8004810 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009c00 tx=0x7fa0b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eaa197ee839ca01 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:46.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0beffd700 1 -- 172.21.15.81:0/3913843608 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b400e710 con 0x7fa0a8003fd0 2023-10-07T08:48:46.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0beffd700 1 -- 172.21.15.81:0/3913843608 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b400e870 con 0x7fa0a8003fd0 2023-10-07T08:48:46.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.669+0000 7fa0beffd700 1 -- 172.21.15.81:0/3913843608 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b400ec30 con 0x7fa0a8003fd0 2023-10-07T08:48:46.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.670+0000 7fa0c54f6700 1 -- 172.21.15.81:0/3913843608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0a8003fd0 msgr2=0x7fa0a8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:46.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.670+0000 7fa0c54f6700 1 --2- 172.21.15.81:0/3913843608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0a8003fd0 0x7fa0a8004810 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009c00 tx=0x7fa0b40091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.670+0000 7fa0c4cf5700 1 -- 172.21.15.81:0/3913843608 reap_dead start 2023-10-07T08:48:46.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.670+0000 7fa0c54f6700 1 -- 172.21.15.81:0/3913843608 shutdown_connections 2023-10-07T08:48:46.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.670+0000 7fa0c54f6700 1 -- 172.21.15.81:0/3913843608 >> 172.21.15.81:0/3913843608 conn(0x7fa0c00cd660 msgr2=0x7fa0c00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:46.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.670+0000 7fa0c54f6700 1 -- 172.21.15.81:0/3913843608 shutdown_connections 2023-10-07T08:48:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.670+0000 7fa0c54f6700 1 -- 172.21.15.81:0/3913843608 wait complete. 2023-10-07T08:48:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.671+0000 7fa0c54f6700 1 Processor -- start 2023-10-07T08:48:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.671+0000 7fa0c54f6700 1 -- start start 2023-10-07T08:48:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0c54f6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a8003fd0 0x7fa0c014b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:46.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0c54f6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c015ab80 0x7fa0c015aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:46.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0c54f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0c00b5a40 0x7fa0c00b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:46.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0c54f6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c015b530 con 0x7fa0c00b5a40 2023-10-07T08:48:46.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0c54f6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c015ffa0 con 0x7fa0a8003fd0 2023-10-07T08:48:46.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0c54f6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c015f6b0 con 0x7fa0c015ab80 2023-10-07T08:48:46.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0c4cf5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0c00b5a40 0x7fa0c00b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:46.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0c4cf5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0c00b5a40 0x7fa0c00b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44850/0 (socket says 172.21.15.81:44850) 2023-10-07T08:48:46.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0c4cf5700 1 -- 172.21.15.81:0/904928214 learned_addr learned my addr 172.21.15.81:0/904928214 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0bf7fe700 1 --2- 172.21.15.81:0/904928214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c015ab80 0x7fa0c015aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0bffff700 1 --2- 172.21.15.81:0/904928214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a8003fd0 0x7fa0c014b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0c4cf5700 1 -- 172.21.15.81:0/904928214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c015ab80 msgr2=0x7fa0c015aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0c4cf5700 1 --2- 172.21.15.81:0/904928214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c015ab80 0x7fa0c015aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0c4cf5700 1 -- 172.21.15.81:0/904928214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a8003fd0 msgr2=0x7fa0c014b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0c4cf5700 1 --2- 172.21.15.81:0/904928214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a8003fd0 0x7fa0c014b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0c4cf5700 1 -- 172.21.15.81:0/904928214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c015f950 con 0x7fa0c00b5a40 2023-10-07T08:48:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.672+0000 7fa0c4cf5700 1 --2- 172.21.15.81:0/904928214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0c00b5a40 0x7fa0c00b5eb0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0067a80 tx=0x7fa0b80016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.673+0000 7fa0a7fff700 1 -- 172.21.15.81:0/904928214 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8019070 con 0x7fa0c00b5a40 2023-10-07T08:48:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.673+0000 7fa0a7fff700 1 -- 172.21.15.81:0/904928214 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b800eec0 con 0x7fa0c00b5a40 2023-10-07T08:48:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.673+0000 7fa0c54f6700 1 -- 172.21.15.81:0/904928214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c015fc30 con 0x7fa0c00b5a40 2023-10-07T08:48:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.673+0000 7fa0a7fff700 1 -- 172.21.15.81:0/904928214 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8006df0 con 0x7fa0c00b5a40 2023-10-07T08:48:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.673+0000 7fa0c54f6700 1 -- 172.21.15.81:0/904928214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c014bae0 con 0x7fa0c00b5a40 2023-10-07T08:48:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.674+0000 7fa0c54f6700 1 -- 172.21.15.81:0/904928214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c0160110 con 0x7fa0c00b5a40 2023-10-07T08:48:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.674+0000 7fa0a7fff700 1 -- 172.21.15.81:0/904928214 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa0b800c9c0 con 0x7fa0c00b5a40 2023-10-07T08:48:46.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.674+0000 7fa0a7fff700 1 --2- 172.21.15.81:0/904928214 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa0ac066f30 0x7fa0ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:46.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.675+0000 7fa0a7fff700 1 -- 172.21.15.81:0/904928214 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa0b80845d0 con 0x7fa0c00b5a40 2023-10-07T08:48:46.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.675+0000 7fa0bffff700 1 --2- 172.21.15.81:0/904928214 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa0ac066f30 0x7fa0ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:46.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.675+0000 7fa0bffff700 1 --2- 172.21.15.81:0/904928214 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa0ac066f30 0x7fa0ac0693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0007f50 tx=0x7fa0b0001e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:46.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.679+0000 7fa0a7fff700 1 -- 172.21.15.81:0/904928214 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0b8051840 con 0x7fa0c00b5a40 2023-10-07T08:48:46.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.857+0000 7fa0c54f6700 1 -- 172.21.15.81:0/904928214 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0c00b32d0 con 0x7fa0ac066f30 2023-10-07T08:48:46.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.865+0000 7fa0a7fff700 1 -- 172.21.15.81:0/904928214 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285286 (secure 0 0 0) 0x7fa0c00b32d0 con 0x7fa0ac066f30 2023-10-07T08:48:46.868 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.868+0000 7fa0c54f6700 1 -- 172.21.15.81:0/904928214 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa0ac066f30 msgr2=0x7fa0ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.868+0000 7fa0c54f6700 1 --2- 172.21.15.81:0/904928214 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa0ac066f30 0x7fa0ac0693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0007f50 tx=0x7fa0b0001e70 comp rx=0 tx=0).stop 2023-10-07T08:48:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.868+0000 7fa0c54f6700 1 -- 172.21.15.81:0/904928214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0c00b5a40 msgr2=0x7fa0c00b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.868+0000 7fa0c54f6700 1 --2- 172.21.15.81:0/904928214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0c00b5a40 0x7fa0c00b5eb0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0067a80 tx=0x7fa0b80016d0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.868+0000 7fa0c54f6700 1 -- 172.21.15.81:0/904928214 shutdown_connections 2023-10-07T08:48:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.868+0000 7fa0c54f6700 1 --2- 172.21.15.81:0/904928214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0c00b5a40 0x7fa0c00b5eb0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.868+0000 7fa0c54f6700 1 --2- 172.21.15.81:0/904928214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a8003fd0 0x7fa0c014b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.868+0000 7fa0c54f6700 1 --2- 172.21.15.81:0/904928214 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa0ac066f30 0x7fa0ac0693e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.868+0000 7fa0c54f6700 1 --2- 172.21.15.81:0/904928214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c015ab80 0x7fa0c015aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:46.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.868+0000 7fa0c54f6700 1 -- 172.21.15.81:0/904928214 >> 172.21.15.81:0/904928214 conn(0x7fa0c00cd660 msgr2=0x7fa0c00cc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:46.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.868+0000 7fa0c54f6700 1 -- 172.21.15.81:0/904928214 shutdown_connections 2023-10-07T08:48:46.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:46.868+0000 7fa0c54f6700 1 -- 172.21.15.81:0/904928214 wait complete. 2023-10-07T08:48:46.872 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:48:46.880 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2023-10-07T08:48:46.081103+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556091,"statfs":{"total":1600000000,"available":1593437268,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001203"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.306157+0000","last_change":"2023-10-07T08:48:41.306101+0000","last_active":"2023-10-07T08:48:41.306157+0000","last_peered":"2023-10-07T08:48:41.306157+0000","last_clean":"2023-10-07T08:48:41.306157+0000","last_became_active":"2023-10-07T08:48:41.305658+0000","last_became_peered":"2023-10-07T08:48:41.305658+0000","last_unstale":"2023-10-07T08:48:41.306157+0000","last_undegraded":"2023-10-07T08:48:41.306157+0000","last_fullsized":"2023-10-07T08:48:41.306157+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:40:44.987659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.305970+0000","last_change":"2023-10-07T08:48:41.305902+0000","last_active":"2023-10-07T08:48:41.305970+0000","last_peered":"2023-10-07T08:48:41.305970+0000","last_clean":"2023-10-07T08:48:41.305970+0000","last_became_active":"2023-10-07T08:48:41.305563+0000","last_became_peered":"2023-10-07T08:48:41.305563+0000","last_unstale":"2023-10-07T08:48:41.305970+0000","last_undegraded":"2023-10-07T08:48:41.305970+0000","last_fullsized":"2023-10-07T08:48:41.305970+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:03.549345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.307746+0000","last_change":"2023-10-07T08:48:41.306956+0000","last_active":"2023-10-07T08:48:41.307746+0000","last_peered":"2023-10-07T08:48:41.307746+0000","last_clean":"2023-10-07T08:48:41.307746+0000","last_became_active":"2023-10-07T08:48:41.306718+0000","last_became_peered":"2023-10-07T08:48:41.306718+0000","last_unstale":"2023-10-07T08:48:41.307746+0000","last_undegraded":"2023-10-07T08:48:41.307746+0000","last_fullsized":"2023-10-07T08:48:41.307746+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:36:08.528753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.298389+0000","last_change":"2023-10-07T08:48:41.298344+0000","last_active":"2023-10-07T08:48:41.298389+0000","last_peered":"2023-10-07T08:48:41.298389+0000","last_clean":"2023-10-07T08:48:41.298389+0000","last_became_active":"2023-10-07T08:48:41.298036+0000","last_became_peered":"2023-10-07T08:48:41.298036+0000","last_unstale":"2023-10-07T08:48:41.298389+0000","last_undegraded":"2023-10-07T08:48:41.298389+0000","last_fullsized":"2023-10-07T08:48:41.298389+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:54:45.660712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.308779+0000","last_change":"2023-10-07T08:48:41.308713+0000","last_active":"2023-10-07T08:48:41.308779+0000","last_peered":"2023-10-07T08:48:41.308779+0000","last_clean":"2023-10-07T08:48:41.308779+0000","last_became_active":"2023-10-07T08:48:41.308482+0000","last_became_peered":"2023-10-07T08:48:41.308482+0000","last_unstale":"2023-10-07T08:48:41.308779+0000","last_undegraded":"2023-10-07T08:48:41.308779+0000","last_fullsized":"2023-10-07T08:48:41.308779+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:30:14.226005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.298143+0000","last_change":"2023-10-07T08:48:41.298067+0000","last_active":"2023-10-07T08:48:41.298143+0000","last_peered":"2023-10-07T08:48:41.298143+0000","last_clean":"2023-10-07T08:48:41.298143+0000","last_became_active":"2023-10-07T08:48:41.297839+0000","last_became_peered":"2023-10-07T08:48:41.297839+0000","last_unstale":"2023-10-07T08:48:41.298143+0000","last_undegraded":"2023-10-07T08:48:41.298143+0000","last_fullsized":"2023-10-07T08:48:41.298143+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:35:42.561475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.307071+0000","last_change":"2023-10-07T08:48:41.307004+0000","last_active":"2023-10-07T08:48:41.307071+0000","last_peered":"2023-10-07T08:48:41.307071+0000","last_clean":"2023-10-07T08:48:41.307071+0000","last_became_active":"2023-10-07T08:48:41.306748+0000","last_became_peered":"2023-10-07T08:48:41.306748+0000","last_unstale":"2023-10-07T08:48:41.307071+0000","last_undegraded":"2023-10-07T08:48:41.307071+0000","last_fullsized":"2023-10-07T08:48:41.307071+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:54:45.660712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.294960+0000","last_change":"2023-10-07T08:48:41.294840+0000","last_active":"2023-10-07T08:48:41.294960+0000","last_peered":"2023-10-07T08:48:41.294960+0000","last_clean":"2023-10-07T08:48:41.294960+0000","last_became_active":"2023-10-07T08:48:41.294589+0000","last_became_peered":"2023-10-07T08:48:41.294589+0000","last_unstale":"2023-10-07T08:48:41.294960+0000","last_undegraded":"2023-10-07T08:48:41.294960+0000","last_fullsized":"2023-10-07T08:48:41.294960+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:45:03.409425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.301185+0000","last_change":"2023-10-07T08:48:41.300826+0000","last_active":"2023-10-07T08:48:41.301185+0000","last_peered":"2023-10-07T08:48:41.301185+0000","last_clean":"2023-10-07T08:48:41.301185+0000","last_became_active":"2023-10-07T08:48:41.300237+0000","last_became_peered":"2023-10-07T08:48:41.300237+0000","last_unstale":"2023-10-07T08:48:41.301185+0000","last_undegraded":"2023-10-07T08:48:41.301185+0000","last_fullsized":"2023-10-07T08:48:41.301185+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:30:14.226005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.305909+0000","last_change":"2023-10-07T08:48:41.305860+0000","last_active":"2023-10-07T08:48:41.305909+0000","last_peered":"2023-10-07T08:48:41.305909+0000","last_clean":"2023-10-07T08:48:41.305909+0000","last_became_active":"2023-10-07T08:48:41.305490+0000","last_became_peered":"2023-10-07T08:48:41.305490+0000","last_unstale":"2023-10-07T08:48:41.305909+0000","last_undegraded":"2023-10-07T08:48:41.305909+0000","last_fullsized":"2023-10-07T08:48:41.305909+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:58:26.919520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297247+0000","last_change":"2023-10-07T08:48:41.296625+0000","last_active":"2023-10-07T08:48:41.297247+0000","last_peered":"2023-10-07T08:48:41.297247+0000","last_clean":"2023-10-07T08:48:41.297247+0000","last_became_active":"2023-10-07T08:48:41.296166+0000","last_became_peered":"2023-10-07T08:48:41.296166+0000","last_unstale":"2023-10-07T08:48:41.297247+0000","last_undegraded":"2023-10-07T08:48:41.297247+0000","last_fullsized":"2023-10-07T08:48:41.297247+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:20.494602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.300641+0000","last_change":"2023-10-07T08:48:41.300457+0000","last_active":"2023-10-07T08:48:41.300641+0000","last_peered":"2023-10-07T08:48:41.300641+0000","last_clean":"2023-10-07T08:48:41.300641+0000","last_became_active":"2023-10-07T08:48:41.300191+0000","last_became_peered":"2023-10-07T08:48:41.300191+0000","last_unstale":"2023-10-07T08:48:41.300641+0000","last_undegraded":"2023-10-07T08:48:41.300641+0000","last_fullsized":"2023-10-07T08:48:41.300641+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:38:54.623898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.307394+0000","last_change":"2023-10-07T08:48:41.307241+0000","last_active":"2023-10-07T08:48:41.307394+0000","last_peered":"2023-10-07T08:48:41.307394+0000","last_clean":"2023-10-07T08:48:41.307394+0000","last_became_active":"2023-10-07T08:48:41.300038+0000","last_became_peered":"2023-10-07T08:48:41.300038+0000","last_unstale":"2023-10-07T08:48:41.307394+0000","last_undegraded":"2023-10-07T08:48:41.307394+0000","last_fullsized":"2023-10-07T08:48:41.307394+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:38:54.623898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.308982+0000","last_change":"2023-10-07T08:48:41.308917+0000","last_active":"2023-10-07T08:48:41.308982+0000","last_peered":"2023-10-07T08:48:41.308982+0000","last_clean":"2023-10-07T08:48:41.308982+0000","last_became_active":"2023-10-07T08:48:41.308703+0000","last_became_peered":"2023-10-07T08:48:41.308703+0000","last_unstale":"2023-10-07T08:48:41.308982+0000","last_undegraded":"2023-10-07T08:48:41.308982+0000","last_fullsized":"2023-10-07T08:48:41.308982+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:47:43.881310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.305226+0000","last_change":"2023-10-07T08:48:41.305111+0000","last_active":"2023-10-07T08:48:41.305226+0000","last_peered":"2023-10-07T08:48:41.305226+0000","last_clean":"2023-10-07T08:48:41.305226+0000","last_became_active":"2023-10-07T08:48:41.304459+0000","last_became_peered":"2023-10-07T08:48:41.304459+0000","last_unstale":"2023-10-07T08:48:41.305226+0000","last_undegraded":"2023-10-07T08:48:41.305226+0000","last_fullsized":"2023-10-07T08:48:41.305226+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:52:12.836356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.301452+0000","last_change":"2023-10-07T08:48:41.301186+0000","last_active":"2023-10-07T08:48:41.301452+0000","last_peered":"2023-10-07T08:48:41.301452+0000","last_clean":"2023-10-07T08:48:41.301452+0000","last_became_active":"2023-10-07T08:48:41.300941+0000","last_became_peered":"2023-10-07T08:48:41.300941+0000","last_unstale":"2023-10-07T08:48:41.301452+0000","last_undegraded":"2023-10-07T08:48:41.301452+0000","last_fullsized":"2023-10-07T08:48:41.301452+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:38:52.458095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.296329+0000","last_change":"2023-10-07T08:48:41.296242+0000","last_active":"2023-10-07T08:48:41.296329+0000","last_peered":"2023-10-07T08:48:41.296329+0000","last_clean":"2023-10-07T08:48:41.296329+0000","last_became_active":"2023-10-07T08:48:41.295958+0000","last_became_peered":"2023-10-07T08:48:41.295958+0000","last_unstale":"2023-10-07T08:48:41.296329+0000","last_undegraded":"2023-10-07T08:48:41.296329+0000","last_fullsized":"2023-10-07T08:48:41.296329+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:37:31.580569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.300249+0000","last_change":"2023-10-07T08:48:41.300185+0000","last_active":"2023-10-07T08:48:41.300249+0000","last_peered":"2023-10-07T08:48:41.300249+0000","last_clean":"2023-10-07T08:48:41.300249+0000","last_became_active":"2023-10-07T08:48:41.299452+0000","last_became_peered":"2023-10-07T08:48:41.299452+0000","last_unstale":"2023-10-07T08:48:41.300249+0000","last_undegraded":"2023-10-07T08:48:41.300249+0000","last_fullsized":"2023-10-07T08:48:41.300249+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:54:08.463584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.303966+0000","last_change":"2023-10-07T08:48:41.303862+0000","last_active":"2023-10-07T08:48:41.303966+0000","last_peered":"2023-10-07T08:48:41.303966+0000","last_clean":"2023-10-07T08:48:41.303966+0000","last_became_active":"2023-10-07T08:48:41.303709+0000","last_became_peered":"2023-10-07T08:48:41.303709+0000","last_unstale":"2023-10-07T08:48:41.303966+0000","last_undegraded":"2023-10-07T08:48:41.303966+0000","last_fullsized":"2023-10-07T08:48:41.303966+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:56:25.386220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.298520+0000","last_change":"2023-10-07T08:48:41.298383+0000","last_active":"2023-10-07T08:48:41.298520+0000","last_peered":"2023-10-07T08:48:41.298520+0000","last_clean":"2023-10-07T08:48:41.298520+0000","last_became_active":"2023-10-07T08:48:41.295873+0000","last_became_peered":"2023-10-07T08:48:41.295873+0000","last_unstale":"2023-10-07T08:48:41.298520+0000","last_undegraded":"2023-10-07T08:48:41.298520+0000","last_fullsized":"2023-10-07T08:48:41.298520+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:36.227017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297325+0000","last_change":"2023-10-07T08:48:41.297275+0000","last_active":"2023-10-07T08:48:41.297325+0000","last_peered":"2023-10-07T08:48:41.297325+0000","last_clean":"2023-10-07T08:48:41.297325+0000","last_became_active":"2023-10-07T08:48:41.297038+0000","last_became_peered":"2023-10-07T08:48:41.297038+0000","last_unstale":"2023-10-07T08:48:41.297325+0000","last_undegraded":"2023-10-07T08:48:41.297325+0000","last_fullsized":"2023-10-07T08:48:41.297325+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:42:30.579295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.305953+0000","last_change":"2023-10-07T08:48:41.305771+0000","last_active":"2023-10-07T08:48:41.305953+0000","last_peered":"2023-10-07T08:48:41.305953+0000","last_clean":"2023-10-07T08:48:41.305953+0000","last_became_active":"2023-10-07T08:48:41.305277+0000","last_became_peered":"2023-10-07T08:48:41.305277+0000","last_unstale":"2023-10-07T08:48:41.305953+0000","last_undegraded":"2023-10-07T08:48:41.305953+0000","last_fullsized":"2023-10-07T08:48:41.305953+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:30:57.166967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297074+0000","last_change":"2023-10-07T08:48:41.297015+0000","last_active":"2023-10-07T08:48:41.297074+0000","last_peered":"2023-10-07T08:48:41.297074+0000","last_clean":"2023-10-07T08:48:41.297074+0000","last_became_active":"2023-10-07T08:48:41.296504+0000","last_became_peered":"2023-10-07T08:48:41.296504+0000","last_unstale":"2023-10-07T08:48:41.297074+0000","last_undegraded":"2023-10-07T08:48:41.297074+0000","last_fullsized":"2023-10-07T08:48:41.297074+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:34:46.871730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.306038+0000","last_change":"2023-10-07T08:48:41.305950+0000","last_active":"2023-10-07T08:48:41.306038+0000","last_peered":"2023-10-07T08:48:41.306038+0000","last_clean":"2023-10-07T08:48:41.306038+0000","last_became_active":"2023-10-07T08:48:41.305702+0000","last_became_peered":"2023-10-07T08:48:41.305702+0000","last_unstale":"2023-10-07T08:48:41.306038+0000","last_undegraded":"2023-10-07T08:48:41.306038+0000","last_fullsized":"2023-10-07T08:48:41.306038+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:52:12.836356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.304004+0000","last_change":"2023-10-07T08:48:41.303922+0000","last_active":"2023-10-07T08:48:41.304004+0000","last_peered":"2023-10-07T08:48:41.304004+0000","last_clean":"2023-10-07T08:48:41.304004+0000","last_became_active":"2023-10-07T08:48:41.303252+0000","last_became_peered":"2023-10-07T08:48:41.303252+0000","last_unstale":"2023-10-07T08:48:41.304004+0000","last_undegraded":"2023-10-07T08:48:41.304004+0000","last_fullsized":"2023-10-07T08:48:41.304004+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:50:30.589534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.304944+0000","last_change":"2023-10-07T08:48:41.304885+0000","last_active":"2023-10-07T08:48:41.304944+0000","last_peered":"2023-10-07T08:48:41.304944+0000","last_clean":"2023-10-07T08:48:41.304944+0000","last_became_active":"2023-10-07T08:48:41.304678+0000","last_became_peered":"2023-10-07T08:48:41.304678+0000","last_unstale":"2023-10-07T08:48:41.304944+0000","last_undegraded":"2023-10-07T08:48:41.304944+0000","last_fullsized":"2023-10-07T08:48:41.304944+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:35:32.383772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.294375+0000","last_change":"2023-10-07T08:48:41.294304+0000","last_active":"2023-10-07T08:48:41.294375+0000","last_peered":"2023-10-07T08:48:41.294375+0000","last_clean":"2023-10-07T08:48:41.294375+0000","last_became_active":"2023-10-07T08:48:41.294053+0000","last_became_peered":"2023-10-07T08:48:41.294053+0000","last_unstale":"2023-10-07T08:48:41.294375+0000","last_undegraded":"2023-10-07T08:48:41.294375+0000","last_fullsized":"2023-10-07T08:48:41.294375+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:38:54.623898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.296647+0000","last_change":"2023-10-07T08:48:41.296601+0000","last_active":"2023-10-07T08:48:41.296647+0000","last_peered":"2023-10-07T08:48:41.296647+0000","last_clean":"2023-10-07T08:48:41.296647+0000","last_became_active":"2023-10-07T08:48:41.296176+0000","last_became_peered":"2023-10-07T08:48:41.296176+0000","last_unstale":"2023-10-07T08:48:41.296647+0000","last_undegraded":"2023-10-07T08:48:41.296647+0000","last_fullsized":"2023-10-07T08:48:41.296647+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:10.662572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.303945+0000","last_change":"2023-10-07T08:48:41.303878+0000","last_active":"2023-10-07T08:48:41.303945+0000","last_peered":"2023-10-07T08:48:41.303945+0000","last_clean":"2023-10-07T08:48:41.303945+0000","last_became_active":"2023-10-07T08:48:41.303648+0000","last_became_peered":"2023-10-07T08:48:41.303648+0000","last_unstale":"2023-10-07T08:48:41.303945+0000","last_undegraded":"2023-10-07T08:48:41.303945+0000","last_fullsized":"2023-10-07T08:48:41.303945+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:44:37.265322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.302011+0000","last_change":"2023-10-07T08:48:41.301845+0000","last_active":"2023-10-07T08:48:41.302011+0000","last_peered":"2023-10-07T08:48:41.302011+0000","last_clean":"2023-10-07T08:48:41.302011+0000","last_became_active":"2023-10-07T08:48:41.301201+0000","last_became_peered":"2023-10-07T08:48:41.301201+0000","last_unstale":"2023-10-07T08:48:41.302011+0000","last_undegraded":"2023-10-07T08:48:41.302011+0000","last_fullsized":"2023-10-07T08:48:41.302011+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:12:56.451703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.296150+0000","last_change":"2023-10-07T08:48:41.295977+0000","last_active":"2023-10-07T08:48:41.296150+0000","last_peered":"2023-10-07T08:48:41.296150+0000","last_clean":"2023-10-07T08:48:41.296150+0000","last_became_active":"2023-10-07T08:48:41.295776+0000","last_became_peered":"2023-10-07T08:48:41.295776+0000","last_unstale":"2023-10-07T08:48:41.296150+0000","last_undegraded":"2023-10-07T08:48:41.296150+0000","last_fullsized":"2023-10-07T08:48:41.296150+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:55:00.570540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.299796+0000","last_change":"2023-10-07T08:48:41.299736+0000","last_active":"2023-10-07T08:48:41.299796+0000","last_peered":"2023-10-07T08:48:41.299796+0000","last_clean":"2023-10-07T08:48:41.299796+0000","last_became_active":"2023-10-07T08:48:41.299496+0000","last_became_peered":"2023-10-07T08:48:41.299496+0000","last_unstale":"2023-10-07T08:48:41.299796+0000","last_undegraded":"2023-10-07T08:48:41.299796+0000","last_fullsized":"2023-10-07T08:48:41.299796+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:23.815791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.294297+0000","last_change":"2023-10-07T08:48:41.294234+0000","last_active":"2023-10-07T08:48:41.294297+0000","last_peered":"2023-10-07T08:48:41.294297+0000","last_clean":"2023-10-07T08:48:41.294297+0000","last_became_active":"2023-10-07T08:48:41.294006+0000","last_became_peered":"2023-10-07T08:48:41.294006+0000","last_unstale":"2023-10-07T08:48:41.294297+0000","last_undegraded":"2023-10-07T08:48:41.294297+0000","last_fullsized":"2023-10-07T08:48:41.294297+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:17:15.108031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"122'4","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.303795+0000","last_change":"2023-10-07T08:48:40.294585+0000","last_active":"2023-10-07T08:48:41.303795+0000","last_peered":"2023-10-07T08:48:41.303795+0000","last_clean":"2023-10-07T08:48:41.303795+0000","last_became_active":"2023-10-07T08:48:40.294333+0000","last_became_peered":"2023-10-07T08:48:40.294333+0000","last_unstale":"2023-10-07T08:48:41.303795+0000","last_undegraded":"2023-10-07T08:48:41.303795+0000","last_fullsized":"2023-10-07T08:48:41.303795+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:27:59.162000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.307376+0000","last_change":"2023-10-07T08:48:41.300295+0000","last_active":"2023-10-07T08:48:41.307376+0000","last_peered":"2023-10-07T08:48:41.307376+0000","last_clean":"2023-10-07T08:48:41.307376+0000","last_became_active":"2023-10-07T08:48:41.299764+0000","last_became_peered":"2023-10-07T08:48:41.299764+0000","last_unstale":"2023-10-07T08:48:41.307376+0000","last_undegraded":"2023-10-07T08:48:41.307376+0000","last_fullsized":"2023-10-07T08:48:41.307376+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:28:00.163755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.305359+0000","last_change":"2023-10-07T08:48:40.295617+0000","last_active":"2023-10-07T08:48:41.305359+0000","last_peered":"2023-10-07T08:48:41.305359+0000","last_clean":"2023-10-07T08:48:41.305359+0000","last_became_active":"2023-10-07T08:48:40.295175+0000","last_became_peered":"2023-10-07T08:48:40.295175+0000","last_unstale":"2023-10-07T08:48:41.305359+0000","last_undegraded":"2023-10-07T08:48:41.305359+0000","last_fullsized":"2023-10-07T08:48:41.305359+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:15.244014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.304166+0000","last_change":"2023-10-07T08:48:41.303184+0000","last_active":"2023-10-07T08:48:41.304166+0000","last_peered":"2023-10-07T08:48:41.304166+0000","last_clean":"2023-10-07T08:48:41.304166+0000","last_became_active":"2023-10-07T08:48:41.302925+0000","last_became_peered":"2023-10-07T08:48:41.302925+0000","last_unstale":"2023-10-07T08:48:41.304166+0000","last_undegraded":"2023-10-07T08:48:41.304166+0000","last_fullsized":"2023-10-07T08:48:41.304166+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:28.858352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.302135+0000","last_change":"2023-10-07T08:48:40.290015+0000","last_active":"2023-10-07T08:48:41.302135+0000","last_peered":"2023-10-07T08:48:41.302135+0000","last_clean":"2023-10-07T08:48:41.302135+0000","last_became_active":"2023-10-07T08:48:40.289798+0000","last_became_peered":"2023-10-07T08:48:40.289798+0000","last_unstale":"2023-10-07T08:48:41.302135+0000","last_undegraded":"2023-10-07T08:48:41.302135+0000","last_fullsized":"2023-10-07T08:48:41.302135+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:15.244014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.299660+0000","last_change":"2023-10-07T08:48:41.299413+0000","last_active":"2023-10-07T08:48:41.299660+0000","last_peered":"2023-10-07T08:48:41.299660+0000","last_clean":"2023-10-07T08:48:41.299660+0000","last_became_active":"2023-10-07T08:48:41.299158+0000","last_became_peered":"2023-10-07T08:48:41.299158+0000","last_unstale":"2023-10-07T08:48:41.299660+0000","last_undegraded":"2023-10-07T08:48:41.299660+0000","last_fullsized":"2023-10-07T08:48:41.299660+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:33.830868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.304472+0000","last_change":"2023-10-07T08:48:40.292645+0000","last_active":"2023-10-07T08:48:41.304472+0000","last_peered":"2023-10-07T08:48:41.304472+0000","last_clean":"2023-10-07T08:48:41.304472+0000","last_became_active":"2023-10-07T08:48:40.291776+0000","last_became_peered":"2023-10-07T08:48:40.291776+0000","last_unstale":"2023-10-07T08:48:41.304472+0000","last_undegraded":"2023-10-07T08:48:41.304472+0000","last_fullsized":"2023-10-07T08:48:41.304472+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:30:13.224250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297633+0000","last_change":"2023-10-07T08:48:41.297551+0000","last_active":"2023-10-07T08:48:41.297633+0000","last_peered":"2023-10-07T08:48:41.297633+0000","last_clean":"2023-10-07T08:48:41.297633+0000","last_became_active":"2023-10-07T08:48:41.297045+0000","last_became_peered":"2023-10-07T08:48:41.297045+0000","last_unstale":"2023-10-07T08:48:41.297633+0000","last_undegraded":"2023-10-07T08:48:41.297633+0000","last_fullsized":"2023-10-07T08:48:41.297633+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:10.662572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.306104+0000","last_change":"2023-10-07T08:48:40.292775+0000","last_active":"2023-10-07T08:48:41.306104+0000","last_peered":"2023-10-07T08:48:41.306104+0000","last_clean":"2023-10-07T08:48:41.306104+0000","last_became_active":"2023-10-07T08:48:40.292592+0000","last_became_peered":"2023-10-07T08:48:40.292592+0000","last_unstale":"2023-10-07T08:48:41.306104+0000","last_undegraded":"2023-10-07T08:48:41.306104+0000","last_fullsized":"2023-10-07T08:48:41.306104+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:25.437346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.300179+0000","last_change":"2023-10-07T08:48:41.299968+0000","last_active":"2023-10-07T08:48:41.300179+0000","last_peered":"2023-10-07T08:48:41.300179+0000","last_clean":"2023-10-07T08:48:41.300179+0000","last_became_active":"2023-10-07T08:48:41.299732+0000","last_became_peered":"2023-10-07T08:48:41.299732+0000","last_unstale":"2023-10-07T08:48:41.300179+0000","last_undegraded":"2023-10-07T08:48:41.300179+0000","last_fullsized":"2023-10-07T08:48:41.300179+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:29.300690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.306465+0000","last_change":"2023-10-07T08:48:40.292017+0000","last_active":"2023-10-07T08:48:41.306465+0000","last_peered":"2023-10-07T08:48:41.306465+0000","last_clean":"2023-10-07T08:48:41.306465+0000","last_became_active":"2023-10-07T08:48:40.291503+0000","last_became_peered":"2023-10-07T08:48:40.291503+0000","last_unstale":"2023-10-07T08:48:41.306465+0000","last_undegraded":"2023-10-07T08:48:41.306465+0000","last_fullsized":"2023-10-07T08:48:41.306465+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:50:29.587780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.305201+0000","last_change":"2023-10-07T08:48:41.304981+0000","last_active":"2023-10-07T08:48:41.305201+0000","last_peered":"2023-10-07T08:48:41.305201+0000","last_clean":"2023-10-07T08:48:41.305201+0000","last_became_active":"2023-10-07T08:48:41.300105+0000","last_became_peered":"2023-10-07T08:48:41.300105+0000","last_unstale":"2023-10-07T08:48:41.305201+0000","last_undegraded":"2023-10-07T08:48:41.305201+0000","last_fullsized":"2023-10-07T08:48:41.305201+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:32:55.232219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.304478+0000","last_change":"2023-10-07T08:48:40.295054+0000","last_active":"2023-10-07T08:48:41.304478+0000","last_peered":"2023-10-07T08:48:41.304478+0000","last_clean":"2023-10-07T08:48:41.304478+0000","last_became_active":"2023-10-07T08:48:40.294315+0000","last_became_peered":"2023-10-07T08:48:40.294315+0000","last_unstale":"2023-10-07T08:48:41.304478+0000","last_undegraded":"2023-10-07T08:48:41.304478+0000","last_fullsized":"2023-10-07T08:48:41.304478+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:26:52.965903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.301243+0000","last_change":"2023-10-07T08:48:41.300979+0000","last_active":"2023-10-07T08:48:41.301243+0000","last_peered":"2023-10-07T08:48:41.301243+0000","last_clean":"2023-10-07T08:48:41.301243+0000","last_became_active":"2023-10-07T08:48:41.300565+0000","last_became_peered":"2023-10-07T08:48:41.300565+0000","last_unstale":"2023-10-07T08:48:41.301243+0000","last_undegraded":"2023-10-07T08:48:41.301243+0000","last_fullsized":"2023-10-07T08:48:41.301243+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:54:08.463584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297386+0000","last_change":"2023-10-07T08:48:40.291872+0000","last_active":"2023-10-07T08:48:41.297386+0000","last_peered":"2023-10-07T08:48:41.297386+0000","last_clean":"2023-10-07T08:48:41.297386+0000","last_became_active":"2023-10-07T08:48:40.291633+0000","last_became_peered":"2023-10-07T08:48:40.291633+0000","last_unstale":"2023-10-07T08:48:41.297386+0000","last_undegraded":"2023-10-07T08:48:41.297386+0000","last_fullsized":"2023-10-07T08:48:41.297386+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:28:58.881915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.291712+0000","last_change":"2023-10-07T08:48:41.291651+0000","last_active":"2023-10-07T08:48:41.291712+0000","last_peered":"2023-10-07T08:48:41.291712+0000","last_clean":"2023-10-07T08:48:41.291712+0000","last_became_active":"2023-10-07T08:48:41.291430+0000","last_became_peered":"2023-10-07T08:48:41.291430+0000","last_unstale":"2023-10-07T08:48:41.291712+0000","last_undegraded":"2023-10-07T08:48:41.291712+0000","last_fullsized":"2023-10-07T08:48:41.291712+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:08:51.988970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.302772+0000","last_change":"2023-10-07T08:48:40.289679+0000","last_active":"2023-10-07T08:48:41.302772+0000","last_peered":"2023-10-07T08:48:41.302772+0000","last_clean":"2023-10-07T08:48:41.302772+0000","last_became_active":"2023-10-07T08:48:40.289419+0000","last_became_peered":"2023-10-07T08:48:40.289419+0000","last_unstale":"2023-10-07T08:48:41.302772+0000","last_undegraded":"2023-10-07T08:48:41.302772+0000","last_fullsized":"2023-10-07T08:48:41.302772+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:12.521247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297771+0000","last_change":"2023-10-07T08:48:41.297647+0000","last_active":"2023-10-07T08:48:41.297771+0000","last_peered":"2023-10-07T08:48:41.297771+0000","last_clean":"2023-10-07T08:48:41.297771+0000","last_became_active":"2023-10-07T08:48:41.297397+0000","last_became_peered":"2023-10-07T08:48:41.297397+0000","last_unstale":"2023-10-07T08:48:41.297771+0000","last_undegraded":"2023-10-07T08:48:41.297771+0000","last_fullsized":"2023-10-07T08:48:41.297771+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:28:00.163755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.294808+0000","last_change":"2023-10-07T08:48:40.289671+0000","last_active":"2023-10-07T08:48:41.294808+0000","last_peered":"2023-10-07T08:48:41.294808+0000","last_clean":"2023-10-07T08:48:41.294808+0000","last_became_active":"2023-10-07T08:48:40.289457+0000","last_became_peered":"2023-10-07T08:48:40.289457+0000","last_unstale":"2023-10-07T08:48:41.294808+0000","last_undegraded":"2023-10-07T08:48:41.294808+0000","last_fullsized":"2023-10-07T08:48:41.294808+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:20:11.641491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.308146+0000","last_change":"2023-10-07T08:48:41.307908+0000","last_active":"2023-10-07T08:48:41.308146+0000","last_peered":"2023-10-07T08:48:41.308146+0000","last_clean":"2023-10-07T08:48:41.308146+0000","last_became_active":"2023-10-07T08:48:41.307140+0000","last_became_peered":"2023-10-07T08:48:41.307140+0000","last_unstale":"2023-10-07T08:48:41.308146+0000","last_undegraded":"2023-10-07T08:48:41.308146+0000","last_fullsized":"2023-10-07T08:48:41.308146+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:35:59.312152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"122'3","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.302111+0000","last_change":"2023-10-07T08:48:40.294080+0000","last_active":"2023-10-07T08:48:41.302111+0000","last_peered":"2023-10-07T08:48:41.302111+0000","last_clean":"2023-10-07T08:48:41.302111+0000","last_became_active":"2023-10-07T08:48:40.293834+0000","last_became_peered":"2023-10-07T08:48:40.293834+0000","last_unstale":"2023-10-07T08:48:41.302111+0000","last_undegraded":"2023-10-07T08:48:41.302111+0000","last_fullsized":"2023-10-07T08:48:41.302111+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:07:23.481173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.298937+0000","last_change":"2023-10-07T08:48:41.298243+0000","last_active":"2023-10-07T08:48:41.298937+0000","last_peered":"2023-10-07T08:48:41.298937+0000","last_clean":"2023-10-07T08:48:41.298937+0000","last_became_active":"2023-10-07T08:48:41.297991+0000","last_became_peered":"2023-10-07T08:48:41.297991+0000","last_unstale":"2023-10-07T08:48:41.298937+0000","last_undegraded":"2023-10-07T08:48:41.298937+0000","last_fullsized":"2023-10-07T08:48:41.298937+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:57:35.159459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"122'6","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.309788+0000","last_change":"2023-10-07T08:48:40.289057+0000","last_active":"2023-10-07T08:48:41.309788+0000","last_peered":"2023-10-07T08:48:41.309788+0000","last_clean":"2023-10-07T08:48:41.309788+0000","last_became_active":"2023-10-07T08:48:40.288579+0000","last_became_peered":"2023-10-07T08:48:40.288579+0000","last_unstale":"2023-10-07T08:48:41.309788+0000","last_undegraded":"2023-10-07T08:48:41.309788+0000","last_fullsized":"2023-10-07T08:48:41.309788+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:56:55.954668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.298713+0000","last_change":"2023-10-07T08:48:41.298475+0000","last_active":"2023-10-07T08:48:41.298713+0000","last_peered":"2023-10-07T08:48:41.298713+0000","last_clean":"2023-10-07T08:48:41.298713+0000","last_became_active":"2023-10-07T08:48:41.298231+0000","last_became_peered":"2023-10-07T08:48:41.298231+0000","last_unstale":"2023-10-07T08:48:41.298713+0000","last_undegraded":"2023-10-07T08:48:41.298713+0000","last_fullsized":"2023-10-07T08:48:41.298713+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:30:14.226005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.301508+0000","last_change":"2023-10-07T08:48:40.291451+0000","last_active":"2023-10-07T08:48:41.301508+0000","last_peered":"2023-10-07T08:48:41.301508+0000","last_clean":"2023-10-07T08:48:41.301508+0000","last_became_active":"2023-10-07T08:48:40.291241+0000","last_became_peered":"2023-10-07T08:48:40.291241+0000","last_unstale":"2023-10-07T08:48:41.301508+0000","last_undegraded":"2023-10-07T08:48:41.301508+0000","last_fullsized":"2023-10-07T08:48:41.301508+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:38:51.532351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.304956+0000","last_change":"2023-10-07T08:48:41.304897+0000","last_active":"2023-10-07T08:48:41.304956+0000","last_peered":"2023-10-07T08:48:41.304956+0000","last_clean":"2023-10-07T08:48:41.304956+0000","last_became_active":"2023-10-07T08:48:41.304537+0000","last_became_peered":"2023-10-07T08:48:41.304537+0000","last_unstale":"2023-10-07T08:48:41.304956+0000","last_undegraded":"2023-10-07T08:48:41.304956+0000","last_fullsized":"2023-10-07T08:48:41.304956+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:56:56.956422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.287739+0000","last_change":"2023-10-07T08:48:40.290717+0000","last_active":"2023-10-07T08:48:41.287739+0000","last_peered":"2023-10-07T08:48:41.287739+0000","last_clean":"2023-10-07T08:48:41.287739+0000","last_became_active":"2023-10-07T08:48:40.290580+0000","last_became_peered":"2023-10-07T08:48:40.290580+0000","last_unstale":"2023-10-07T08:48:41.287739+0000","last_undegraded":"2023-10-07T08:48:41.287739+0000","last_fullsized":"2023-10-07T08:48:41.287739+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:19.361640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297426+0000","last_change":"2023-10-07T08:48:41.297341+0000","last_active":"2023-10-07T08:48:41.297426+0000","last_peered":"2023-10-07T08:48:41.297426+0000","last_clean":"2023-10-07T08:48:41.297426+0000","last_became_active":"2023-10-07T08:48:41.297113+0000","last_became_peered":"2023-10-07T08:48:41.297113+0000","last_unstale":"2023-10-07T08:48:41.297426+0000","last_undegraded":"2023-10-07T08:48:41.297426+0000","last_fullsized":"2023-10-07T08:48:41.297426+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:58:26.919520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.288328+0000","last_change":"2023-10-07T08:48:40.293813+0000","last_active":"2023-10-07T08:48:41.288328+0000","last_peered":"2023-10-07T08:48:41.288328+0000","last_clean":"2023-10-07T08:48:41.288328+0000","last_became_active":"2023-10-07T08:48:40.293345+0000","last_became_peered":"2023-10-07T08:48:40.293345+0000","last_unstale":"2023-10-07T08:48:41.288328+0000","last_undegraded":"2023-10-07T08:48:41.288328+0000","last_fullsized":"2023-10-07T08:48:41.288328+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:27.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.290534+0000","last_change":"2023-10-07T08:48:41.290473+0000","last_active":"2023-10-07T08:48:41.290534+0000","last_peered":"2023-10-07T08:48:41.290534+0000","last_clean":"2023-10-07T08:48:41.290534+0000","last_became_active":"2023-10-07T08:48:41.290010+0000","last_became_peered":"2023-10-07T08:48:41.290010+0000","last_unstale":"2023-10-07T08:48:41.290534+0000","last_undegraded":"2023-10-07T08:48:41.290534+0000","last_fullsized":"2023-10-07T08:48:41.290534+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:37.426440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"122'8","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.308670+0000","last_change":"2023-10-07T08:48:40.292695+0000","last_active":"2023-10-07T08:48:41.308670+0000","last_peered":"2023-10-07T08:48:41.308670+0000","last_clean":"2023-10-07T08:48:41.308670+0000","last_became_active":"2023-10-07T08:48:40.292466+0000","last_became_peered":"2023-10-07T08:48:40.292466+0000","last_unstale":"2023-10-07T08:48:41.308670+0000","last_undegraded":"2023-10-07T08:48:41.308670+0000","last_fullsized":"2023-10-07T08:48:41.308670+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:15:34.746855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.308172+0000","last_change":"2023-10-07T08:48:41.308059+0000","last_active":"2023-10-07T08:48:41.308172+0000","last_peered":"2023-10-07T08:48:41.308172+0000","last_clean":"2023-10-07T08:48:41.308172+0000","last_became_active":"2023-10-07T08:48:41.307549+0000","last_became_peered":"2023-10-07T08:48:41.307549+0000","last_unstale":"2023-10-07T08:48:41.308172+0000","last_undegraded":"2023-10-07T08:48:41.308172+0000","last_fullsized":"2023-10-07T08:48:41.308172+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:36.227017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.302943+0000","last_change":"2023-10-07T08:48:40.293349+0000","last_active":"2023-10-07T08:48:41.302943+0000","last_peered":"2023-10-07T08:48:41.302943+0000","last_clean":"2023-10-07T08:48:41.302943+0000","last_became_active":"2023-10-07T08:48:40.292932+0000","last_became_peered":"2023-10-07T08:48:40.292932+0000","last_unstale":"2023-10-07T08:48:41.302943+0000","last_undegraded":"2023-10-07T08:48:41.302943+0000","last_fullsized":"2023-10-07T08:48:41.302943+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:40:43.985905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.300995+0000","last_change":"2023-10-07T08:48:41.300872+0000","last_active":"2023-10-07T08:48:41.300995+0000","last_peered":"2023-10-07T08:48:41.300995+0000","last_clean":"2023-10-07T08:48:41.300995+0000","last_became_active":"2023-10-07T08:48:41.300658+0000","last_became_peered":"2023-10-07T08:48:41.300658+0000","last_unstale":"2023-10-07T08:48:41.300995+0000","last_undegraded":"2023-10-07T08:48:41.300995+0000","last_fullsized":"2023-10-07T08:48:41.300995+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:16.245769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.305054+0000","last_change":"2023-10-07T08:48:40.291471+0000","last_active":"2023-10-07T08:48:41.305054+0000","last_peered":"2023-10-07T08:48:41.305054+0000","last_clean":"2023-10-07T08:48:41.305054+0000","last_became_active":"2023-10-07T08:48:40.291202+0000","last_became_peered":"2023-10-07T08:48:40.291202+0000","last_unstale":"2023-10-07T08:48:41.305054+0000","last_undegraded":"2023-10-07T08:48:41.305054+0000","last_fullsized":"2023-10-07T08:48:41.305054+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:29:36.177775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297279+0000","last_change":"2023-10-07T08:48:41.297181+0000","last_active":"2023-10-07T08:48:41.297279+0000","last_peered":"2023-10-07T08:48:41.297279+0000","last_clean":"2023-10-07T08:48:41.297279+0000","last_became_active":"2023-10-07T08:48:41.296439+0000","last_became_peered":"2023-10-07T08:48:41.296439+0000","last_unstale":"2023-10-07T08:48:41.297279+0000","last_undegraded":"2023-10-07T08:48:41.297279+0000","last_fullsized":"2023-10-07T08:48:41.297279+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:08.921090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.290692+0000","last_change":"2023-10-07T08:48:40.294547+0000","last_active":"2023-10-07T08:48:41.290692+0000","last_peered":"2023-10-07T08:48:41.290692+0000","last_clean":"2023-10-07T08:48:41.290692+0000","last_became_active":"2023-10-07T08:48:40.293902+0000","last_became_peered":"2023-10-07T08:48:40.293902+0000","last_unstale":"2023-10-07T08:48:41.290692+0000","last_undegraded":"2023-10-07T08:48:41.290692+0000","last_fullsized":"2023-10-07T08:48:41.290692+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:35.225263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297307+0000","last_change":"2023-10-07T08:48:41.297246+0000","last_active":"2023-10-07T08:48:41.297307+0000","last_peered":"2023-10-07T08:48:41.297307+0000","last_clean":"2023-10-07T08:48:41.297307+0000","last_became_active":"2023-10-07T08:48:41.296953+0000","last_became_peered":"2023-10-07T08:48:41.296953+0000","last_unstale":"2023-10-07T08:48:41.297307+0000","last_undegraded":"2023-10-07T08:48:41.297307+0000","last_fullsized":"2023-10-07T08:48:41.297307+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:01:10.786719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.302396+0000","last_change":"2023-10-07T08:48:40.291746+0000","last_active":"2023-10-07T08:48:41.302396+0000","last_peered":"2023-10-07T08:48:41.302396+0000","last_clean":"2023-10-07T08:48:41.302396+0000","last_became_active":"2023-10-07T08:48:40.290920+0000","last_became_peered":"2023-10-07T08:48:40.290920+0000","last_unstale":"2023-10-07T08:48:41.302396+0000","last_undegraded":"2023-10-07T08:48:41.302396+0000","last_fullsized":"2023-10-07T08:48:41.302396+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:32.829113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.291126+0000","last_change":"2023-10-07T08:48:41.291069+0000","last_active":"2023-10-07T08:48:41.291126+0000","last_peered":"2023-10-07T08:48:41.291126+0000","last_clean":"2023-10-07T08:48:41.291126+0000","last_became_active":"2023-10-07T08:48:41.290864+0000","last_became_peered":"2023-10-07T08:48:41.290864+0000","last_unstale":"2023-10-07T08:48:41.291126+0000","last_undegraded":"2023-10-07T08:48:41.291126+0000","last_fullsized":"2023-10-07T08:48:41.291126+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:15.930749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.295053+0000","last_change":"2023-10-07T08:48:40.290894+0000","last_active":"2023-10-07T08:48:41.295053+0000","last_peered":"2023-10-07T08:48:41.295053+0000","last_clean":"2023-10-07T08:48:41.295053+0000","last_became_active":"2023-10-07T08:48:40.290652+0000","last_became_peered":"2023-10-07T08:48:40.290652+0000","last_unstale":"2023-10-07T08:48:41.295053+0000","last_undegraded":"2023-10-07T08:48:41.295053+0000","last_fullsized":"2023-10-07T08:48:41.295053+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:53:14.493858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297876+0000","last_change":"2023-10-07T08:48:41.297819+0000","last_active":"2023-10-07T08:48:41.297876+0000","last_peered":"2023-10-07T08:48:41.297876+0000","last_clean":"2023-10-07T08:48:41.297876+0000","last_became_active":"2023-10-07T08:48:41.297609+0000","last_became_peered":"2023-10-07T08:48:41.297609+0000","last_unstale":"2023-10-07T08:48:41.297876+0000","last_undegraded":"2023-10-07T08:48:41.297876+0000","last_fullsized":"2023-10-07T08:48:41.297876+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:38:10.126941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.294925+0000","last_change":"2023-10-07T08:48:40.292088+0000","last_active":"2023-10-07T08:48:41.294925+0000","last_peered":"2023-10-07T08:48:41.294925+0000","last_clean":"2023-10-07T08:48:41.294925+0000","last_became_active":"2023-10-07T08:48:40.291857+0000","last_became_peered":"2023-10-07T08:48:40.291857+0000","last_unstale":"2023-10-07T08:48:41.294925+0000","last_undegraded":"2023-10-07T08:48:41.294925+0000","last_fullsized":"2023-10-07T08:48:41.294925+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:27.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.303987+0000","last_change":"2023-10-07T08:48:41.303722+0000","last_active":"2023-10-07T08:48:41.303987+0000","last_peered":"2023-10-07T08:48:41.303987+0000","last_clean":"2023-10-07T08:48:41.303987+0000","last_became_active":"2023-10-07T08:48:41.303005+0000","last_became_peered":"2023-10-07T08:48:41.303005+0000","last_unstale":"2023-10-07T08:48:41.303987+0000","last_undegraded":"2023-10-07T08:48:41.303987+0000","last_fullsized":"2023-10-07T08:48:41.303987+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:16.245769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.289367+0000","last_change":"2023-10-07T08:48:40.292781+0000","last_active":"2023-10-07T08:48:41.289367+0000","last_peered":"2023-10-07T08:48:41.289367+0000","last_clean":"2023-10-07T08:48:41.289367+0000","last_became_active":"2023-10-07T08:48:40.292136+0000","last_became_peered":"2023-10-07T08:48:40.292136+0000","last_unstale":"2023-10-07T08:48:41.289367+0000","last_undegraded":"2023-10-07T08:48:41.289367+0000","last_fullsized":"2023-10-07T08:48:41.289367+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:35:58.310397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297217+0000","last_change":"2023-10-07T08:48:41.297158+0000","last_active":"2023-10-07T08:48:41.297217+0000","last_peered":"2023-10-07T08:48:41.297217+0000","last_clean":"2023-10-07T08:48:41.297217+0000","last_became_active":"2023-10-07T08:48:41.296801+0000","last_became_peered":"2023-10-07T08:48:41.296801+0000","last_unstale":"2023-10-07T08:48:41.297217+0000","last_undegraded":"2023-10-07T08:48:41.297217+0000","last_fullsized":"2023-10-07T08:48:41.297217+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:38:52.458095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.308027+0000","last_change":"2023-10-07T08:48:40.293015+0000","last_active":"2023-10-07T08:48:41.308027+0000","last_peered":"2023-10-07T08:48:41.308027+0000","last_clean":"2023-10-07T08:48:41.308027+0000","last_became_active":"2023-10-07T08:48:40.292767+0000","last_became_peered":"2023-10-07T08:48:40.292767+0000","last_unstale":"2023-10-07T08:48:41.308027+0000","last_undegraded":"2023-10-07T08:48:41.308027+0000","last_fullsized":"2023-10-07T08:48:41.308027+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:07.308237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.304814+0000","last_change":"2023-10-07T08:48:41.304757+0000","last_active":"2023-10-07T08:48:41.304814+0000","last_peered":"2023-10-07T08:48:41.304814+0000","last_clean":"2023-10-07T08:48:41.304814+0000","last_became_active":"2023-10-07T08:48:41.304550+0000","last_became_peered":"2023-10-07T08:48:41.304550+0000","last_unstale":"2023-10-07T08:48:41.304814+0000","last_undegraded":"2023-10-07T08:48:41.304814+0000","last_fullsized":"2023-10-07T08:48:41.304814+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:03:06.655934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.290015+0000","last_change":"2023-10-07T08:48:40.291885+0000","last_active":"2023-10-07T08:48:41.290015+0000","last_peered":"2023-10-07T08:48:41.290015+0000","last_clean":"2023-10-07T08:48:41.290015+0000","last_became_active":"2023-10-07T08:48:40.291214+0000","last_became_peered":"2023-10-07T08:48:40.291214+0000","last_unstale":"2023-10-07T08:48:41.290015+0000","last_undegraded":"2023-10-07T08:48:41.290015+0000","last_fullsized":"2023-10-07T08:48:41.290015+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:58:25.917765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.305667+0000","last_change":"2023-10-07T08:48:41.305534+0000","last_active":"2023-10-07T08:48:41.305667+0000","last_peered":"2023-10-07T08:48:41.305667+0000","last_clean":"2023-10-07T08:48:41.305667+0000","last_became_active":"2023-10-07T08:48:41.305143+0000","last_became_peered":"2023-10-07T08:48:41.305143+0000","last_unstale":"2023-10-07T08:48:41.305667+0000","last_undegraded":"2023-10-07T08:48:41.305667+0000","last_fullsized":"2023-10-07T08:48:41.305667+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:53:15.495612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.289338+0000","last_change":"2023-10-07T08:48:40.290648+0000","last_active":"2023-10-07T08:48:41.289338+0000","last_peered":"2023-10-07T08:48:41.289338+0000","last_clean":"2023-10-07T08:48:41.289338+0000","last_became_active":"2023-10-07T08:48:40.290421+0000","last_became_peered":"2023-10-07T08:48:40.290421+0000","last_unstale":"2023-10-07T08:48:41.289338+0000","last_undegraded":"2023-10-07T08:48:41.289338+0000","last_fullsized":"2023-10-07T08:48:41.289338+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:54:07.461829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.308130+0000","last_change":"2023-10-07T08:48:41.307762+0000","last_active":"2023-10-07T08:48:41.308130+0000","last_peered":"2023-10-07T08:48:41.308130+0000","last_clean":"2023-10-07T08:48:41.308130+0000","last_became_active":"2023-10-07T08:48:41.306837+0000","last_became_peered":"2023-10-07T08:48:41.306837+0000","last_unstale":"2023-10-07T08:48:41.308130+0000","last_undegraded":"2023-10-07T08:48:41.308130+0000","last_fullsized":"2023-10-07T08:48:41.308130+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:24:25.555139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.298730+0000","last_change":"2023-10-07T08:48:40.294343+0000","last_active":"2023-10-07T08:48:41.298730+0000","last_peered":"2023-10-07T08:48:41.298730+0000","last_clean":"2023-10-07T08:48:41.298730+0000","last_became_active":"2023-10-07T08:48:40.293902+0000","last_became_peered":"2023-10-07T08:48:40.293902+0000","last_unstale":"2023-10-07T08:48:41.298730+0000","last_undegraded":"2023-10-07T08:48:41.298730+0000","last_fullsized":"2023-10-07T08:48:41.298730+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:46.935278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.290309+0000","last_change":"2023-10-07T08:48:41.290251+0000","last_active":"2023-10-07T08:48:41.290309+0000","last_peered":"2023-10-07T08:48:41.290309+0000","last_clean":"2023-10-07T08:48:41.290309+0000","last_became_active":"2023-10-07T08:48:41.289696+0000","last_became_peered":"2023-10-07T08:48:41.289696+0000","last_unstale":"2023-10-07T08:48:41.290309+0000","last_undegraded":"2023-10-07T08:48:41.290309+0000","last_fullsized":"2023-10-07T08:48:41.290309+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:34:51.632376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.289460+0000","last_change":"2023-10-07T08:48:40.292913+0000","last_active":"2023-10-07T08:48:41.289460+0000","last_peered":"2023-10-07T08:48:41.289460+0000","last_clean":"2023-10-07T08:48:41.289460+0000","last_became_active":"2023-10-07T08:48:40.292435+0000","last_became_peered":"2023-10-07T08:48:40.292435+0000","last_unstale":"2023-10-07T08:48:41.289460+0000","last_undegraded":"2023-10-07T08:48:41.289460+0000","last_fullsized":"2023-10-07T08:48:41.289460+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:07:23.481173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.300661+0000","last_change":"2023-10-07T08:48:41.300488+0000","last_active":"2023-10-07T08:48:41.300661+0000","last_peered":"2023-10-07T08:48:41.300661+0000","last_clean":"2023-10-07T08:48:41.300661+0000","last_became_active":"2023-10-07T08:48:41.300180+0000","last_became_peered":"2023-10-07T08:48:41.300180+0000","last_unstale":"2023-10-07T08:48:41.300661+0000","last_undegraded":"2023-10-07T08:48:41.300661+0000","last_fullsized":"2023-10-07T08:48:41.300661+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:29.300690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.295269+0000","last_change":"2023-10-07T08:48:40.291491+0000","last_active":"2023-10-07T08:48:41.295269+0000","last_peered":"2023-10-07T08:48:41.295269+0000","last_clean":"2023-10-07T08:48:41.295269+0000","last_became_active":"2023-10-07T08:48:40.291224+0000","last_became_peered":"2023-10-07T08:48:40.291224+0000","last_unstale":"2023-10-07T08:48:41.295269+0000","last_undegraded":"2023-10-07T08:48:41.295269+0000","last_fullsized":"2023-10-07T08:48:41.295269+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:51.542869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.289670+0000","last_change":"2023-10-07T08:48:41.289606+0000","last_active":"2023-10-07T08:48:41.289670+0000","last_peered":"2023-10-07T08:48:41.289670+0000","last_clean":"2023-10-07T08:48:41.289670+0000","last_became_active":"2023-10-07T08:48:41.289381+0000","last_became_peered":"2023-10-07T08:48:41.289381+0000","last_unstale":"2023-10-07T08:48:41.289670+0000","last_undegraded":"2023-10-07T08:48:41.289670+0000","last_fullsized":"2023-10-07T08:48:41.289670+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:00:36.975594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.294935+0000","last_change":"2023-10-07T08:48:40.290718+0000","last_active":"2023-10-07T08:48:41.294935+0000","last_peered":"2023-10-07T08:48:41.294935+0000","last_clean":"2023-10-07T08:48:41.294935+0000","last_became_active":"2023-10-07T08:48:40.290487+0000","last_became_peered":"2023-10-07T08:48:40.290487+0000","last_unstale":"2023-10-07T08:48:41.294935+0000","last_undegraded":"2023-10-07T08:48:41.294935+0000","last_fullsized":"2023-10-07T08:48:41.294935+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:24:24.553384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.296625+0000","last_change":"2023-10-07T08:48:41.296425+0000","last_active":"2023-10-07T08:48:41.296625+0000","last_peered":"2023-10-07T08:48:41.296625+0000","last_clean":"2023-10-07T08:48:41.296625+0000","last_became_active":"2023-10-07T08:48:41.295869+0000","last_became_peered":"2023-10-07T08:48:41.295869+0000","last_unstale":"2023-10-07T08:48:41.296625+0000","last_undegraded":"2023-10-07T08:48:41.296625+0000","last_fullsized":"2023-10-07T08:48:41.296625+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:20:12.643245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.286396+0000","last_change":"2023-10-07T08:48:40.290171+0000","last_active":"2023-10-07T08:48:41.286396+0000","last_peered":"2023-10-07T08:48:41.286396+0000","last_clean":"2023-10-07T08:48:41.286396+0000","last_became_active":"2023-10-07T08:48:40.289763+0000","last_became_peered":"2023-10-07T08:48:40.289763+0000","last_unstale":"2023-10-07T08:48:41.286396+0000","last_undegraded":"2023-10-07T08:48:41.286396+0000","last_fullsized":"2023-10-07T08:48:41.286396+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:38:15.680036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.295858+0000","last_change":"2023-10-07T08:48:41.295800+0000","last_active":"2023-10-07T08:48:41.295858+0000","last_peered":"2023-10-07T08:48:41.295858+0000","last_clean":"2023-10-07T08:48:41.295858+0000","last_became_active":"2023-10-07T08:48:41.295569+0000","last_became_peered":"2023-10-07T08:48:41.295569+0000","last_unstale":"2023-10-07T08:48:41.295858+0000","last_undegraded":"2023-10-07T08:48:41.295858+0000","last_fullsized":"2023-10-07T08:48:41.295858+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:34:58.997688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.300344+0000","last_change":"2023-10-07T08:48:40.295349+0000","last_active":"2023-10-07T08:48:41.300344+0000","last_peered":"2023-10-07T08:48:41.300344+0000","last_clean":"2023-10-07T08:48:41.300344+0000","last_became_active":"2023-10-07T08:48:40.294859+0000","last_became_peered":"2023-10-07T08:48:40.294859+0000","last_unstale":"2023-10-07T08:48:41.300344+0000","last_undegraded":"2023-10-07T08:48:41.300344+0000","last_fullsized":"2023-10-07T08:48:41.300344+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:09.660818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":248,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.292912+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:48:41.292912+0000","last_peered":"2023-10-07T08:48:41.292912+0000","last_clean":"2023-10-07T08:48:41.292912+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:48:41.292912+0000","last_undegraded":"2023-10-07T08:48:41.292912+0000","last_fullsized":"2023-10-07T08:48:41.292912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1233,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194079,"statfs":{"total":200000000,"available":198737347,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.5},"min":{"1min":0.36599999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.48699999999999999},"min":{"1min":0.379,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68000000000000005,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.48499999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.41799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.40500000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.439}]},{"osd":2,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51400000000000001,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.75},"last":0.34499999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.629,"15min":0.80700000000000005},"min":{"1min":0.38800000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.68400000000000005,"5min":6.8570000000000002,"15min":6.8570000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.749,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.499}]},{"osd":4,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.28799999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66400000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.377},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.502,"15min":0.53300000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69499999999999995,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.51100000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":0.751,"15min":0.751},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54200000000000004,"15min":0.56999999999999995},"min":{"1min":0.318,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73299999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56899999999999995,"15min":0.59199999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72999999999999998,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71599999999999997,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.56399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":657,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194655,"statfs":{"total":200000000,"available":199327203,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.495,"15min":0.47299999999999998},"min":{"1min":0.316,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.40100000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.44600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.55500000000000005,"15min":0.53200000000000003},"min":{"1min":0.495,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.52700000000000002,"15min":0.48199999999999998},"min":{"1min":0.38200000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.435,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78100000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.42399999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.50800000000000001},"min":{"1min":0.40899999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.504},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.32900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.625},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.40600000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73899999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.40100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.59599999999999997,"15min":0.58199999999999996},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89100000000000001,"5min":1.052,"15min":1.052},"last":0.65400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":656,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194656,"statfs":{"total":200000000,"available":199327827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34599999999999997,"15min":0.312},"min":{"1min":0.22500000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.56699999999999995,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.371,"5min":0.35499999999999998,"15min":0.32800000000000001},"min":{"1min":0.22500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.441}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.318},"min":{"1min":0.26200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70399999999999996,"5min":1.639,"15min":1.639},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.38800000000000001,"15min":0.33200000000000002},"min":{"1min":0.28699999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.47399999999999998,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.49199999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40000000000000002,"15min":0.35899999999999999},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.52800000000000002,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.34799999999999998},"min":{"1min":0.28599999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.378}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.52200000000000002},"min":{"1min":0.35699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79100000000000004,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.60599999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.52600000000000002},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73099999999999998,"5min":0.87,"15min":0.87},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.58199999999999996},"min":{"1min":0.51800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79100000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.58399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1233,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194079,"statfs":{"total":200000000,"available":198736905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.371},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.251},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.377,"15min":0.39500000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.67400000000000004,"5min":1.079,"15min":1.079},"last":0.28999999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.39100000000000001},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":1.464,"15min":1.464},"last":0.216},{"interface":"front","average":{"1min":0.432,"5min":0.40200000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67900000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.35899999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":1.341,"15min":1.341},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.42099999999999999,"15min":0.435},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68600000000000005,"5min":1.532,"15min":1.532},"last":0.28000000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90200000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.60999999999999999},"min":{"1min":0.36199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80100000000000005,"5min":1.51,"15min":1.51},"last":0.40300000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83299999999999996,"5min":1.25,"15min":1.25},"last":0.41299999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.92900000000000005,"5min":1.488,"15min":1.488},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":1.024,"15min":1.024},"last":0.45000000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.90300000000000002,"5min":1.288,"15min":1.288},"last":0.375}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":656,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194656,"statfs":{"total":200000000,"available":199327793,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.34300000000000003},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.49299999999999999,"5min":1.665,"15min":1.665},"last":0.192},{"interface":"front","average":{"1min":0.375,"5min":0.35799999999999998,"15min":0.36299999999999999},"min":{"1min":0.23499999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.50900000000000001,"5min":1.579,"15min":1.579},"last":0.26300000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.38400000000000001,"15min":0.38100000000000001},"min":{"1min":0.218,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.26600000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.20999999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.26100000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":1.454,"15min":1.454},"last":0.248},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.39100000000000001},"min":{"1min":0.28100000000000003,"5min":0.224,"15min":0.224},"max":{"1min":0.56599999999999995,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.27700000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.40600000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81999999999999995,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.874,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.41999999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.36799999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83499999999999996,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.38600000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.76900000000000002,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.47599999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77600000000000002,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.85899999999999999,"5min":1.637,"15min":1.637},"last":0.49299999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":1.49,"15min":1.49},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81299999999999994,"5min":1.375,"15min":1.375},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":657,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194654,"statfs":{"total":200000000,"available":199326269,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35499999999999998,"15min":0.33100000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.90200000000000002,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.246},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34899999999999998,"15min":0.32100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.504,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.35099999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38100000000000001,"15min":0.35999999999999999},"min":{"1min":0.245,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.61599999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41999999999999998,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70099999999999996,"5min":1.885,"15min":1.885},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.38100000000000001},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57699999999999996,"5min":1.274,"15min":1.274},"last":0.313},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.40300000000000002},"min":{"1min":0.32100000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.97699999999999998,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.33900000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.503},"min":{"1min":0.36699999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78500000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57399999999999995,"15min":0.53500000000000003},"min":{"1min":0.45200000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80800000000000005,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.48399999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.42799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79400000000000004,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.59699999999999998,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.038,"5min":1.851,"15min":1.851},"last":0.46999999999999997}]},{"osd":6,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60299999999999998,"15min":0.55900000000000005},"min":{"1min":0.45100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77200000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.58599999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84199999999999997,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.57699999999999996},"min":{"1min":0.45600000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0089999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.59299999999999997,"15min":0.55700000000000005},"min":{"1min":0.42699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80000000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194654,"statfs":{"total":200000000,"available":199326167,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.72199999999999998,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.71099999999999997,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.501},"min":{"1min":0.29499999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.70099999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68799999999999994,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.61599999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.53100000000000003},"min":{"1min":0.45200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68400000000000005,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53900000000000003,"15min":0.50800000000000001},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69099999999999995,"5min":1.29,"15min":1.29},"last":0.64400000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.52700000000000002},"min":{"1min":0.38400000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":2.052,"15min":2.052},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71199999999999997,"5min":1.369,"15min":1.369},"last":0.59699999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.75700000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.495,"15min":0.495},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76500000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.374}]},{"osd":6,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.32800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.75900000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.439}]},{"osd":7,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54000000000000004,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85099999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79300000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.46100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":656,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194656,"statfs":{"total":200000000,"available":199327757,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.51600000000000001},"min":{"1min":0.314,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.432},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.41399999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.51700000000000002,"15min":0.49099999999999999},"min":{"1min":0.34999999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53700000000000003}]},{"osd":2,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76800000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.73399999999999999,"5min":0.754,"15min":0.754},"last":0.624}]},{"osd":3,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78900000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52000000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.47899999999999998},"min":{"1min":0.31,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57299999999999995,"15min":0.59599999999999997},"min":{"1min":0.40300000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.754,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.64700000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71399999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.86399999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54900000000000004,"15min":0.57699999999999996},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.59699999999999998},"min":{"1min":0.39200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80100000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.84299999999999997}]}]}],"pool_statfs":[]}} 2023-10-07T08:48:49.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:48:50.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.022+0000 7f7d3f778700 1 Processor -- start 2023-10-07T08:48:50.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.023+0000 7f7d3f778700 1 -- start start 2023-10-07T08:48:50.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.023+0000 7f7d3f778700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d381578d0 0x7f7d380cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.023+0000 7f7d3f778700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d3806d120 0x7f7d3806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.023+0000 7f7d3f778700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3806dac0 con 0x7f7d38157ca0 2023-10-07T08:48:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.023+0000 7f7d3f778700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d380d07c0 con 0x7f7d3806d120 2023-10-07T08:48:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.023+0000 7f7d3f778700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380cfbb0 con 0x7f7d381578d0 2023-10-07T08:48:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.024+0000 7f7d3dd15700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d3806d120 0x7f7d3806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.024+0000 7f7d3cd13700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7d38157ca0 0x7f7d3815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46536/0 (socket says 172.21.15.81:46536) 2023-10-07T08:48:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.024+0000 7f7d3cd13700 1 -- 172.21.15.81:0/2162098292 learned_addr learned my addr 172.21.15.81:0/2162098292 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.024+0000 7f7d3d514700 1 --2- 172.21.15.81:0/2162098292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d381578d0 0x7f7d380cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.024+0000 7f7d3dd15700 1 -- 172.21.15.81:0/2162098292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d381578d0 msgr2=0x7f7d380cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.024+0000 7f7d3dd15700 1 --2- 172.21.15.81:0/2162098292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d381578d0 0x7f7d380cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.024+0000 7f7d3dd15700 1 -- 172.21.15.81:0/2162098292 >> v1:172.21.15.81:6789/0 conn(0x7f7d38157ca0 legacy=0x7f7d3815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.024+0000 7f7d2ffff700 1 -- 172.21.15.81:0/2162098292 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106039501 0 0) 0x7f7d28001110 con 0x7f7d38157ca0 2023-10-07T08:48:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.024+0000 7f7d3dd15700 1 -- 172.21.15.81:0/2162098292 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d380cfe90 con 0x7f7d3806d120 2023-10-07T08:48:50.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.024+0000 7f7d3dd15700 1 --2- 172.21.15.81:0/2162098292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3806d120 0x7f7d3806d580 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7d300098e0 tx=0x7f7d300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdebc00d096f3c68 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:50.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.024+0000 7f7d2ffff700 1 -- 172.21.15.81:0/2162098292 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3000b640 con 0x7f7d3806d120 2023-10-07T08:48:50.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.024+0000 7f7d2ffff700 1 -- 172.21.15.81:0/2162098292 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3000b7a0 con 0x7f7d3806d120 2023-10-07T08:48:50.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.024+0000 7f7d2ffff700 1 -- 172.21.15.81:0/2162098292 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3000bb40 con 0x7f7d3806d120 2023-10-07T08:48:50.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.025+0000 7f7d3f778700 1 -- 172.21.15.81:0/2162098292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3806d120 msgr2=0x7f7d3806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:50.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.025+0000 7f7d3f778700 1 --2- 172.21.15.81:0/2162098292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3806d120 0x7f7d3806d580 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7d300098e0 tx=0x7f7d300091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.025+0000 7f7d3f778700 1 -- 172.21.15.81:0/2162098292 shutdown_connections 2023-10-07T08:48:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.025+0000 7f7d3f778700 1 --2- 172.21.15.81:0/2162098292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3806d120 0x7f7d3806d580 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.025+0000 7f7d3f778700 1 --2- 172.21.15.81:0/2162098292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d381578d0 0x7f7d380cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.025+0000 7f7d3f778700 1 -- 172.21.15.81:0/2162098292 >> 172.21.15.81:0/2162098292 conn(0x7f7d3806bb90 msgr2=0x7f7d3806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.025+0000 7f7d3f778700 1 -- 172.21.15.81:0/2162098292 shutdown_connections 2023-10-07T08:48:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.025+0000 7f7d3f778700 1 -- 172.21.15.81:0/2162098292 wait complete. 2023-10-07T08:48:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.026+0000 7f7d3f778700 1 Processor -- start 2023-10-07T08:48:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.026+0000 7f7d3f778700 1 -- start start 2023-10-07T08:48:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.027+0000 7f7d3f778700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3806d120 0x7f7d381537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.027+0000 7f7d3f778700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d381578d0 0x7f7d380b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.027+0000 7f7d3f778700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d38157ca0 0x7f7d38159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.027+0000 7f7d3f778700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380b4e90 con 0x7f7d3806d120 2023-10-07T08:48:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.027+0000 7f7d3f778700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3816a220 con 0x7f7d38157ca0 2023-10-07T08:48:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.027+0000 7f7d3f778700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3816a4a0 con 0x7f7d381578d0 2023-10-07T08:48:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.027+0000 7f7d3d514700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3806d120 0x7f7d381537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.027+0000 7f7d3d514700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3806d120 0x7f7d381537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44868/0 (socket says 172.21.15.81:44868) 2023-10-07T08:48:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.027+0000 7f7d3d514700 1 -- 172.21.15.81:0/2646413875 learned_addr learned my addr 172.21.15.81:0/2646413875 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.027+0000 7f7d3cd13700 1 --2- 172.21.15.81:0/2646413875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d381578d0 0x7f7d380b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.027+0000 7f7d3dd15700 1 --2- 172.21.15.81:0/2646413875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d38157ca0 0x7f7d38159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.027+0000 7f7d3d514700 1 -- 172.21.15.81:0/2646413875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d381578d0 msgr2=0x7f7d380b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.027+0000 7f7d3d514700 1 --2- 172.21.15.81:0/2646413875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d381578d0 0x7f7d380b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.027+0000 7f7d3d514700 1 -- 172.21.15.81:0/2646413875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d38157ca0 msgr2=0x7f7d38159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.027+0000 7f7d3d514700 1 --2- 172.21.15.81:0/2646413875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d38157ca0 0x7f7d38159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.028+0000 7f7d3d514700 1 -- 172.21.15.81:0/2646413875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d30009420 con 0x7f7d3806d120 2023-10-07T08:48:50.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.028+0000 7f7d3d514700 1 --2- 172.21.15.81:0/2646413875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3806d120 0x7f7d381537a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009ef0 tx=0x7f7d3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:50.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.028+0000 7f7d2d7fa700 1 -- 172.21.15.81:0/2646413875 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3400cb70 con 0x7f7d3806d120 2023-10-07T08:48:50.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.028+0000 7f7d2d7fa700 1 -- 172.21.15.81:0/2646413875 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3400f040 con 0x7f7d3806d120 2023-10-07T08:48:50.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.028+0000 7f7d3f778700 1 -- 172.21.15.81:0/2646413875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d380b45f0 con 0x7f7d3806d120 2023-10-07T08:48:50.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.028+0000 7f7d2d7fa700 1 -- 172.21.15.81:0/2646413875 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34014480 con 0x7f7d3806d120 2023-10-07T08:48:50.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.028+0000 7f7d3f778700 1 -- 172.21.15.81:0/2646413875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d380b4bb0 con 0x7f7d3806d120 2023-10-07T08:48:50.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.029+0000 7f7d3f778700 1 -- 172.21.15.81:0/2646413875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d38067ac0 con 0x7f7d3806d120 2023-10-07T08:48:50.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.029+0000 7f7d2d7fa700 1 -- 172.21.15.81:0/2646413875 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d340147f0 con 0x7f7d3806d120 2023-10-07T08:48:50.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.030+0000 7f7d2d7fa700 1 --2- 172.21.15.81:0/2646413875 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7d1c066f30 0x7f7d1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.030+0000 7f7d2d7fa700 1 -- 172.21.15.81:0/2646413875 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7d34084ed0 con 0x7f7d3806d120 2023-10-07T08:48:50.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.030+0000 7f7d3cd13700 1 --2- 172.21.15.81:0/2646413875 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7d1c066f30 0x7f7d1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.030+0000 7f7d3cd13700 1 --2- 172.21.15.81:0/2646413875 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7d1c066f30 0x7f7d1c0693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7d28007160 tx=0x7f7d28007f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:50.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.034+0000 7f7d2d7fa700 1 -- 172.21.15.81:0/2646413875 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d34052140 con 0x7f7d3806d120 2023-10-07T08:48:50.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.212+0000 7f7d3f778700 1 -- 172.21.15.81:0/2646413875 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d3816a5e0 con 0x7f7d1c066f30 2023-10-07T08:48:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.220+0000 7f7d2d7fa700 1 -- 172.21.15.81:0/2646413875 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285342 (secure 0 0 0) 0x7f7d280058a0 con 0x7f7d1c066f30 2023-10-07T08:48:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:50.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.223+0000 7f7d3f778700 1 -- 172.21.15.81:0/2646413875 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7d1c066f30 msgr2=0x7f7d1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:50.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.223+0000 7f7d3f778700 1 --2- 172.21.15.81:0/2646413875 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7d1c066f30 0x7f7d1c0693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7d28007160 tx=0x7f7d28007f50 comp rx=0 tx=0).stop 2023-10-07T08:48:50.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.223+0000 7f7d3f778700 1 -- 172.21.15.81:0/2646413875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3806d120 msgr2=0x7f7d381537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:50.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.223+0000 7f7d3f778700 1 --2- 172.21.15.81:0/2646413875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3806d120 0x7f7d381537a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009ef0 tx=0x7f7d3400b040 comp rx=0 tx=0).stop 2023-10-07T08:48:50.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.223+0000 7f7d3f778700 1 -- 172.21.15.81:0/2646413875 shutdown_connections 2023-10-07T08:48:50.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.223+0000 7f7d3f778700 1 --2- 172.21.15.81:0/2646413875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d38157ca0 0x7f7d38159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.223+0000 7f7d3f778700 1 --2- 172.21.15.81:0/2646413875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3806d120 0x7f7d381537a0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.223+0000 7f7d3f778700 1 --2- 172.21.15.81:0/2646413875 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7d1c066f30 0x7f7d1c0693e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.223+0000 7f7d3f778700 1 --2- 172.21.15.81:0/2646413875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d381578d0 0x7f7d380b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.223+0000 7f7d3f778700 1 -- 172.21.15.81:0/2646413875 >> 172.21.15.81:0/2646413875 conn(0x7f7d3806bb90 msgr2=0x7f7d3815b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:50.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.223+0000 7f7d3f778700 1 -- 172.21.15.81:0/2646413875 shutdown_connections 2023-10-07T08:48:50.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.223+0000 7f7d3f778700 1 -- 172.21.15.81:0/2646413875 wait complete. 2023-10-07T08:48:50.228 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:48:50.236 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2023-10-07T08:48:50.082111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556091,"statfs":{"total":1600000000,"available":1593437268,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.793883"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.306157+0000","last_change":"2023-10-07T08:48:41.306101+0000","last_active":"2023-10-07T08:48:41.306157+0000","last_peered":"2023-10-07T08:48:41.306157+0000","last_clean":"2023-10-07T08:48:41.306157+0000","last_became_active":"2023-10-07T08:48:41.305658+0000","last_became_peered":"2023-10-07T08:48:41.305658+0000","last_unstale":"2023-10-07T08:48:41.306157+0000","last_undegraded":"2023-10-07T08:48:41.306157+0000","last_fullsized":"2023-10-07T08:48:41.306157+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:40:44.987659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.305970+0000","last_change":"2023-10-07T08:48:41.305902+0000","last_active":"2023-10-07T08:48:41.305970+0000","last_peered":"2023-10-07T08:48:41.305970+0000","last_clean":"2023-10-07T08:48:41.305970+0000","last_became_active":"2023-10-07T08:48:41.305563+0000","last_became_peered":"2023-10-07T08:48:41.305563+0000","last_unstale":"2023-10-07T08:48:41.305970+0000","last_undegraded":"2023-10-07T08:48:41.305970+0000","last_fullsized":"2023-10-07T08:48:41.305970+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:03.549345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.307746+0000","last_change":"2023-10-07T08:48:41.306956+0000","last_active":"2023-10-07T08:48:41.307746+0000","last_peered":"2023-10-07T08:48:41.307746+0000","last_clean":"2023-10-07T08:48:41.307746+0000","last_became_active":"2023-10-07T08:48:41.306718+0000","last_became_peered":"2023-10-07T08:48:41.306718+0000","last_unstale":"2023-10-07T08:48:41.307746+0000","last_undegraded":"2023-10-07T08:48:41.307746+0000","last_fullsized":"2023-10-07T08:48:41.307746+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:36:08.528753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.298389+0000","last_change":"2023-10-07T08:48:41.298344+0000","last_active":"2023-10-07T08:48:41.298389+0000","last_peered":"2023-10-07T08:48:41.298389+0000","last_clean":"2023-10-07T08:48:41.298389+0000","last_became_active":"2023-10-07T08:48:41.298036+0000","last_became_peered":"2023-10-07T08:48:41.298036+0000","last_unstale":"2023-10-07T08:48:41.298389+0000","last_undegraded":"2023-10-07T08:48:41.298389+0000","last_fullsized":"2023-10-07T08:48:41.298389+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:54:45.660712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.308779+0000","last_change":"2023-10-07T08:48:41.308713+0000","last_active":"2023-10-07T08:48:41.308779+0000","last_peered":"2023-10-07T08:48:41.308779+0000","last_clean":"2023-10-07T08:48:41.308779+0000","last_became_active":"2023-10-07T08:48:41.308482+0000","last_became_peered":"2023-10-07T08:48:41.308482+0000","last_unstale":"2023-10-07T08:48:41.308779+0000","last_undegraded":"2023-10-07T08:48:41.308779+0000","last_fullsized":"2023-10-07T08:48:41.308779+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:30:14.226005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.298143+0000","last_change":"2023-10-07T08:48:41.298067+0000","last_active":"2023-10-07T08:48:41.298143+0000","last_peered":"2023-10-07T08:48:41.298143+0000","last_clean":"2023-10-07T08:48:41.298143+0000","last_became_active":"2023-10-07T08:48:41.297839+0000","last_became_peered":"2023-10-07T08:48:41.297839+0000","last_unstale":"2023-10-07T08:48:41.298143+0000","last_undegraded":"2023-10-07T08:48:41.298143+0000","last_fullsized":"2023-10-07T08:48:41.298143+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:35:42.561475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.307071+0000","last_change":"2023-10-07T08:48:41.307004+0000","last_active":"2023-10-07T08:48:41.307071+0000","last_peered":"2023-10-07T08:48:41.307071+0000","last_clean":"2023-10-07T08:48:41.307071+0000","last_became_active":"2023-10-07T08:48:41.306748+0000","last_became_peered":"2023-10-07T08:48:41.306748+0000","last_unstale":"2023-10-07T08:48:41.307071+0000","last_undegraded":"2023-10-07T08:48:41.307071+0000","last_fullsized":"2023-10-07T08:48:41.307071+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:54:45.660712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.294960+0000","last_change":"2023-10-07T08:48:41.294840+0000","last_active":"2023-10-07T08:48:41.294960+0000","last_peered":"2023-10-07T08:48:41.294960+0000","last_clean":"2023-10-07T08:48:41.294960+0000","last_became_active":"2023-10-07T08:48:41.294589+0000","last_became_peered":"2023-10-07T08:48:41.294589+0000","last_unstale":"2023-10-07T08:48:41.294960+0000","last_undegraded":"2023-10-07T08:48:41.294960+0000","last_fullsized":"2023-10-07T08:48:41.294960+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:45:03.409425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.301185+0000","last_change":"2023-10-07T08:48:41.300826+0000","last_active":"2023-10-07T08:48:41.301185+0000","last_peered":"2023-10-07T08:48:41.301185+0000","last_clean":"2023-10-07T08:48:41.301185+0000","last_became_active":"2023-10-07T08:48:41.300237+0000","last_became_peered":"2023-10-07T08:48:41.300237+0000","last_unstale":"2023-10-07T08:48:41.301185+0000","last_undegraded":"2023-10-07T08:48:41.301185+0000","last_fullsized":"2023-10-07T08:48:41.301185+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:30:14.226005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.305909+0000","last_change":"2023-10-07T08:48:41.305860+0000","last_active":"2023-10-07T08:48:41.305909+0000","last_peered":"2023-10-07T08:48:41.305909+0000","last_clean":"2023-10-07T08:48:41.305909+0000","last_became_active":"2023-10-07T08:48:41.305490+0000","last_became_peered":"2023-10-07T08:48:41.305490+0000","last_unstale":"2023-10-07T08:48:41.305909+0000","last_undegraded":"2023-10-07T08:48:41.305909+0000","last_fullsized":"2023-10-07T08:48:41.305909+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:58:26.919520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297247+0000","last_change":"2023-10-07T08:48:41.296625+0000","last_active":"2023-10-07T08:48:41.297247+0000","last_peered":"2023-10-07T08:48:41.297247+0000","last_clean":"2023-10-07T08:48:41.297247+0000","last_became_active":"2023-10-07T08:48:41.296166+0000","last_became_peered":"2023-10-07T08:48:41.296166+0000","last_unstale":"2023-10-07T08:48:41.297247+0000","last_undegraded":"2023-10-07T08:48:41.297247+0000","last_fullsized":"2023-10-07T08:48:41.297247+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:20:20.494602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.300641+0000","last_change":"2023-10-07T08:48:41.300457+0000","last_active":"2023-10-07T08:48:41.300641+0000","last_peered":"2023-10-07T08:48:41.300641+0000","last_clean":"2023-10-07T08:48:41.300641+0000","last_became_active":"2023-10-07T08:48:41.300191+0000","last_became_peered":"2023-10-07T08:48:41.300191+0000","last_unstale":"2023-10-07T08:48:41.300641+0000","last_undegraded":"2023-10-07T08:48:41.300641+0000","last_fullsized":"2023-10-07T08:48:41.300641+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:38:54.623898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.307394+0000","last_change":"2023-10-07T08:48:41.307241+0000","last_active":"2023-10-07T08:48:41.307394+0000","last_peered":"2023-10-07T08:48:41.307394+0000","last_clean":"2023-10-07T08:48:41.307394+0000","last_became_active":"2023-10-07T08:48:41.300038+0000","last_became_peered":"2023-10-07T08:48:41.300038+0000","last_unstale":"2023-10-07T08:48:41.307394+0000","last_undegraded":"2023-10-07T08:48:41.307394+0000","last_fullsized":"2023-10-07T08:48:41.307394+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:38:54.623898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.308982+0000","last_change":"2023-10-07T08:48:41.308917+0000","last_active":"2023-10-07T08:48:41.308982+0000","last_peered":"2023-10-07T08:48:41.308982+0000","last_clean":"2023-10-07T08:48:41.308982+0000","last_became_active":"2023-10-07T08:48:41.308703+0000","last_became_peered":"2023-10-07T08:48:41.308703+0000","last_unstale":"2023-10-07T08:48:41.308982+0000","last_undegraded":"2023-10-07T08:48:41.308982+0000","last_fullsized":"2023-10-07T08:48:41.308982+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:47:43.881310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.305226+0000","last_change":"2023-10-07T08:48:41.305111+0000","last_active":"2023-10-07T08:48:41.305226+0000","last_peered":"2023-10-07T08:48:41.305226+0000","last_clean":"2023-10-07T08:48:41.305226+0000","last_became_active":"2023-10-07T08:48:41.304459+0000","last_became_peered":"2023-10-07T08:48:41.304459+0000","last_unstale":"2023-10-07T08:48:41.305226+0000","last_undegraded":"2023-10-07T08:48:41.305226+0000","last_fullsized":"2023-10-07T08:48:41.305226+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:52:12.836356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.301452+0000","last_change":"2023-10-07T08:48:41.301186+0000","last_active":"2023-10-07T08:48:41.301452+0000","last_peered":"2023-10-07T08:48:41.301452+0000","last_clean":"2023-10-07T08:48:41.301452+0000","last_became_active":"2023-10-07T08:48:41.300941+0000","last_became_peered":"2023-10-07T08:48:41.300941+0000","last_unstale":"2023-10-07T08:48:41.301452+0000","last_undegraded":"2023-10-07T08:48:41.301452+0000","last_fullsized":"2023-10-07T08:48:41.301452+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:38:52.458095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.296329+0000","last_change":"2023-10-07T08:48:41.296242+0000","last_active":"2023-10-07T08:48:41.296329+0000","last_peered":"2023-10-07T08:48:41.296329+0000","last_clean":"2023-10-07T08:48:41.296329+0000","last_became_active":"2023-10-07T08:48:41.295958+0000","last_became_peered":"2023-10-07T08:48:41.295958+0000","last_unstale":"2023-10-07T08:48:41.296329+0000","last_undegraded":"2023-10-07T08:48:41.296329+0000","last_fullsized":"2023-10-07T08:48:41.296329+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:37:31.580569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.300249+0000","last_change":"2023-10-07T08:48:41.300185+0000","last_active":"2023-10-07T08:48:41.300249+0000","last_peered":"2023-10-07T08:48:41.300249+0000","last_clean":"2023-10-07T08:48:41.300249+0000","last_became_active":"2023-10-07T08:48:41.299452+0000","last_became_peered":"2023-10-07T08:48:41.299452+0000","last_unstale":"2023-10-07T08:48:41.300249+0000","last_undegraded":"2023-10-07T08:48:41.300249+0000","last_fullsized":"2023-10-07T08:48:41.300249+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:54:08.463584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.303966+0000","last_change":"2023-10-07T08:48:41.303862+0000","last_active":"2023-10-07T08:48:41.303966+0000","last_peered":"2023-10-07T08:48:41.303966+0000","last_clean":"2023-10-07T08:48:41.303966+0000","last_became_active":"2023-10-07T08:48:41.303709+0000","last_became_peered":"2023-10-07T08:48:41.303709+0000","last_unstale":"2023-10-07T08:48:41.303966+0000","last_undegraded":"2023-10-07T08:48:41.303966+0000","last_fullsized":"2023-10-07T08:48:41.303966+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:56:25.386220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.298520+0000","last_change":"2023-10-07T08:48:41.298383+0000","last_active":"2023-10-07T08:48:41.298520+0000","last_peered":"2023-10-07T08:48:41.298520+0000","last_clean":"2023-10-07T08:48:41.298520+0000","last_became_active":"2023-10-07T08:48:41.295873+0000","last_became_peered":"2023-10-07T08:48:41.295873+0000","last_unstale":"2023-10-07T08:48:41.298520+0000","last_undegraded":"2023-10-07T08:48:41.298520+0000","last_fullsized":"2023-10-07T08:48:41.298520+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:36.227017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297325+0000","last_change":"2023-10-07T08:48:41.297275+0000","last_active":"2023-10-07T08:48:41.297325+0000","last_peered":"2023-10-07T08:48:41.297325+0000","last_clean":"2023-10-07T08:48:41.297325+0000","last_became_active":"2023-10-07T08:48:41.297038+0000","last_became_peered":"2023-10-07T08:48:41.297038+0000","last_unstale":"2023-10-07T08:48:41.297325+0000","last_undegraded":"2023-10-07T08:48:41.297325+0000","last_fullsized":"2023-10-07T08:48:41.297325+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:42:30.579295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.305953+0000","last_change":"2023-10-07T08:48:41.305771+0000","last_active":"2023-10-07T08:48:41.305953+0000","last_peered":"2023-10-07T08:48:41.305953+0000","last_clean":"2023-10-07T08:48:41.305953+0000","last_became_active":"2023-10-07T08:48:41.305277+0000","last_became_peered":"2023-10-07T08:48:41.305277+0000","last_unstale":"2023-10-07T08:48:41.305953+0000","last_undegraded":"2023-10-07T08:48:41.305953+0000","last_fullsized":"2023-10-07T08:48:41.305953+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:30:57.166967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297074+0000","last_change":"2023-10-07T08:48:41.297015+0000","last_active":"2023-10-07T08:48:41.297074+0000","last_peered":"2023-10-07T08:48:41.297074+0000","last_clean":"2023-10-07T08:48:41.297074+0000","last_became_active":"2023-10-07T08:48:41.296504+0000","last_became_peered":"2023-10-07T08:48:41.296504+0000","last_unstale":"2023-10-07T08:48:41.297074+0000","last_undegraded":"2023-10-07T08:48:41.297074+0000","last_fullsized":"2023-10-07T08:48:41.297074+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:34:46.871730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.306038+0000","last_change":"2023-10-07T08:48:41.305950+0000","last_active":"2023-10-07T08:48:41.306038+0000","last_peered":"2023-10-07T08:48:41.306038+0000","last_clean":"2023-10-07T08:48:41.306038+0000","last_became_active":"2023-10-07T08:48:41.305702+0000","last_became_peered":"2023-10-07T08:48:41.305702+0000","last_unstale":"2023-10-07T08:48:41.306038+0000","last_undegraded":"2023-10-07T08:48:41.306038+0000","last_fullsized":"2023-10-07T08:48:41.306038+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:52:12.836356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.304004+0000","last_change":"2023-10-07T08:48:41.303922+0000","last_active":"2023-10-07T08:48:41.304004+0000","last_peered":"2023-10-07T08:48:41.304004+0000","last_clean":"2023-10-07T08:48:41.304004+0000","last_became_active":"2023-10-07T08:48:41.303252+0000","last_became_peered":"2023-10-07T08:48:41.303252+0000","last_unstale":"2023-10-07T08:48:41.304004+0000","last_undegraded":"2023-10-07T08:48:41.304004+0000","last_fullsized":"2023-10-07T08:48:41.304004+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:50:30.589534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.304944+0000","last_change":"2023-10-07T08:48:41.304885+0000","last_active":"2023-10-07T08:48:41.304944+0000","last_peered":"2023-10-07T08:48:41.304944+0000","last_clean":"2023-10-07T08:48:41.304944+0000","last_became_active":"2023-10-07T08:48:41.304678+0000","last_became_peered":"2023-10-07T08:48:41.304678+0000","last_unstale":"2023-10-07T08:48:41.304944+0000","last_undegraded":"2023-10-07T08:48:41.304944+0000","last_fullsized":"2023-10-07T08:48:41.304944+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:35:32.383772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.294375+0000","last_change":"2023-10-07T08:48:41.294304+0000","last_active":"2023-10-07T08:48:41.294375+0000","last_peered":"2023-10-07T08:48:41.294375+0000","last_clean":"2023-10-07T08:48:41.294375+0000","last_became_active":"2023-10-07T08:48:41.294053+0000","last_became_peered":"2023-10-07T08:48:41.294053+0000","last_unstale":"2023-10-07T08:48:41.294375+0000","last_undegraded":"2023-10-07T08:48:41.294375+0000","last_fullsized":"2023-10-07T08:48:41.294375+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:38:54.623898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.296647+0000","last_change":"2023-10-07T08:48:41.296601+0000","last_active":"2023-10-07T08:48:41.296647+0000","last_peered":"2023-10-07T08:48:41.296647+0000","last_clean":"2023-10-07T08:48:41.296647+0000","last_became_active":"2023-10-07T08:48:41.296176+0000","last_became_peered":"2023-10-07T08:48:41.296176+0000","last_unstale":"2023-10-07T08:48:41.296647+0000","last_undegraded":"2023-10-07T08:48:41.296647+0000","last_fullsized":"2023-10-07T08:48:41.296647+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:10.662572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.303945+0000","last_change":"2023-10-07T08:48:41.303878+0000","last_active":"2023-10-07T08:48:41.303945+0000","last_peered":"2023-10-07T08:48:41.303945+0000","last_clean":"2023-10-07T08:48:41.303945+0000","last_became_active":"2023-10-07T08:48:41.303648+0000","last_became_peered":"2023-10-07T08:48:41.303648+0000","last_unstale":"2023-10-07T08:48:41.303945+0000","last_undegraded":"2023-10-07T08:48:41.303945+0000","last_fullsized":"2023-10-07T08:48:41.303945+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:44:37.265322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.302011+0000","last_change":"2023-10-07T08:48:41.301845+0000","last_active":"2023-10-07T08:48:41.302011+0000","last_peered":"2023-10-07T08:48:41.302011+0000","last_clean":"2023-10-07T08:48:41.302011+0000","last_became_active":"2023-10-07T08:48:41.301201+0000","last_became_peered":"2023-10-07T08:48:41.301201+0000","last_unstale":"2023-10-07T08:48:41.302011+0000","last_undegraded":"2023-10-07T08:48:41.302011+0000","last_fullsized":"2023-10-07T08:48:41.302011+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:12:56.451703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.296150+0000","last_change":"2023-10-07T08:48:41.295977+0000","last_active":"2023-10-07T08:48:41.296150+0000","last_peered":"2023-10-07T08:48:41.296150+0000","last_clean":"2023-10-07T08:48:41.296150+0000","last_became_active":"2023-10-07T08:48:41.295776+0000","last_became_peered":"2023-10-07T08:48:41.295776+0000","last_unstale":"2023-10-07T08:48:41.296150+0000","last_undegraded":"2023-10-07T08:48:41.296150+0000","last_fullsized":"2023-10-07T08:48:41.296150+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:55:00.570540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.299796+0000","last_change":"2023-10-07T08:48:41.299736+0000","last_active":"2023-10-07T08:48:41.299796+0000","last_peered":"2023-10-07T08:48:41.299796+0000","last_clean":"2023-10-07T08:48:41.299796+0000","last_became_active":"2023-10-07T08:48:41.299496+0000","last_became_peered":"2023-10-07T08:48:41.299496+0000","last_unstale":"2023-10-07T08:48:41.299796+0000","last_undegraded":"2023-10-07T08:48:41.299796+0000","last_fullsized":"2023-10-07T08:48:41.299796+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:16:23.815791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.294297+0000","last_change":"2023-10-07T08:48:41.294234+0000","last_active":"2023-10-07T08:48:41.294297+0000","last_peered":"2023-10-07T08:48:41.294297+0000","last_clean":"2023-10-07T08:48:41.294297+0000","last_became_active":"2023-10-07T08:48:41.294006+0000","last_became_peered":"2023-10-07T08:48:41.294006+0000","last_unstale":"2023-10-07T08:48:41.294297+0000","last_undegraded":"2023-10-07T08:48:41.294297+0000","last_fullsized":"2023-10-07T08:48:41.294297+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:17:15.108031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"122'4","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.303795+0000","last_change":"2023-10-07T08:48:40.294585+0000","last_active":"2023-10-07T08:48:41.303795+0000","last_peered":"2023-10-07T08:48:41.303795+0000","last_clean":"2023-10-07T08:48:41.303795+0000","last_became_active":"2023-10-07T08:48:40.294333+0000","last_became_peered":"2023-10-07T08:48:40.294333+0000","last_unstale":"2023-10-07T08:48:41.303795+0000","last_undegraded":"2023-10-07T08:48:41.303795+0000","last_fullsized":"2023-10-07T08:48:41.303795+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:27:59.162000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.307376+0000","last_change":"2023-10-07T08:48:41.300295+0000","last_active":"2023-10-07T08:48:41.307376+0000","last_peered":"2023-10-07T08:48:41.307376+0000","last_clean":"2023-10-07T08:48:41.307376+0000","last_became_active":"2023-10-07T08:48:41.299764+0000","last_became_peered":"2023-10-07T08:48:41.299764+0000","last_unstale":"2023-10-07T08:48:41.307376+0000","last_undegraded":"2023-10-07T08:48:41.307376+0000","last_fullsized":"2023-10-07T08:48:41.307376+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:28:00.163755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.305359+0000","last_change":"2023-10-07T08:48:40.295617+0000","last_active":"2023-10-07T08:48:41.305359+0000","last_peered":"2023-10-07T08:48:41.305359+0000","last_clean":"2023-10-07T08:48:41.305359+0000","last_became_active":"2023-10-07T08:48:40.295175+0000","last_became_peered":"2023-10-07T08:48:40.295175+0000","last_unstale":"2023-10-07T08:48:41.305359+0000","last_undegraded":"2023-10-07T08:48:41.305359+0000","last_fullsized":"2023-10-07T08:48:41.305359+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:15.244014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.304166+0000","last_change":"2023-10-07T08:48:41.303184+0000","last_active":"2023-10-07T08:48:41.304166+0000","last_peered":"2023-10-07T08:48:41.304166+0000","last_clean":"2023-10-07T08:48:41.304166+0000","last_became_active":"2023-10-07T08:48:41.302925+0000","last_became_peered":"2023-10-07T08:48:41.302925+0000","last_unstale":"2023-10-07T08:48:41.304166+0000","last_undegraded":"2023-10-07T08:48:41.304166+0000","last_fullsized":"2023-10-07T08:48:41.304166+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:28.858352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.302135+0000","last_change":"2023-10-07T08:48:40.290015+0000","last_active":"2023-10-07T08:48:41.302135+0000","last_peered":"2023-10-07T08:48:41.302135+0000","last_clean":"2023-10-07T08:48:41.302135+0000","last_became_active":"2023-10-07T08:48:40.289798+0000","last_became_peered":"2023-10-07T08:48:40.289798+0000","last_unstale":"2023-10-07T08:48:41.302135+0000","last_undegraded":"2023-10-07T08:48:41.302135+0000","last_fullsized":"2023-10-07T08:48:41.302135+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:15.244014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.299660+0000","last_change":"2023-10-07T08:48:41.299413+0000","last_active":"2023-10-07T08:48:41.299660+0000","last_peered":"2023-10-07T08:48:41.299660+0000","last_clean":"2023-10-07T08:48:41.299660+0000","last_became_active":"2023-10-07T08:48:41.299158+0000","last_became_peered":"2023-10-07T08:48:41.299158+0000","last_unstale":"2023-10-07T08:48:41.299660+0000","last_undegraded":"2023-10-07T08:48:41.299660+0000","last_fullsized":"2023-10-07T08:48:41.299660+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:33.830868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.304472+0000","last_change":"2023-10-07T08:48:40.292645+0000","last_active":"2023-10-07T08:48:41.304472+0000","last_peered":"2023-10-07T08:48:41.304472+0000","last_clean":"2023-10-07T08:48:41.304472+0000","last_became_active":"2023-10-07T08:48:40.291776+0000","last_became_peered":"2023-10-07T08:48:40.291776+0000","last_unstale":"2023-10-07T08:48:41.304472+0000","last_undegraded":"2023-10-07T08:48:41.304472+0000","last_fullsized":"2023-10-07T08:48:41.304472+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:30:13.224250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297633+0000","last_change":"2023-10-07T08:48:41.297551+0000","last_active":"2023-10-07T08:48:41.297633+0000","last_peered":"2023-10-07T08:48:41.297633+0000","last_clean":"2023-10-07T08:48:41.297633+0000","last_became_active":"2023-10-07T08:48:41.297045+0000","last_became_peered":"2023-10-07T08:48:41.297045+0000","last_unstale":"2023-10-07T08:48:41.297633+0000","last_undegraded":"2023-10-07T08:48:41.297633+0000","last_fullsized":"2023-10-07T08:48:41.297633+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:10.662572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.306104+0000","last_change":"2023-10-07T08:48:40.292775+0000","last_active":"2023-10-07T08:48:41.306104+0000","last_peered":"2023-10-07T08:48:41.306104+0000","last_clean":"2023-10-07T08:48:41.306104+0000","last_became_active":"2023-10-07T08:48:40.292592+0000","last_became_peered":"2023-10-07T08:48:40.292592+0000","last_unstale":"2023-10-07T08:48:41.306104+0000","last_undegraded":"2023-10-07T08:48:41.306104+0000","last_fullsized":"2023-10-07T08:48:41.306104+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:33:25.437346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.300179+0000","last_change":"2023-10-07T08:48:41.299968+0000","last_active":"2023-10-07T08:48:41.300179+0000","last_peered":"2023-10-07T08:48:41.300179+0000","last_clean":"2023-10-07T08:48:41.300179+0000","last_became_active":"2023-10-07T08:48:41.299732+0000","last_became_peered":"2023-10-07T08:48:41.299732+0000","last_unstale":"2023-10-07T08:48:41.300179+0000","last_undegraded":"2023-10-07T08:48:41.300179+0000","last_fullsized":"2023-10-07T08:48:41.300179+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:29.300690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.306465+0000","last_change":"2023-10-07T08:48:40.292017+0000","last_active":"2023-10-07T08:48:41.306465+0000","last_peered":"2023-10-07T08:48:41.306465+0000","last_clean":"2023-10-07T08:48:41.306465+0000","last_became_active":"2023-10-07T08:48:40.291503+0000","last_became_peered":"2023-10-07T08:48:40.291503+0000","last_unstale":"2023-10-07T08:48:41.306465+0000","last_undegraded":"2023-10-07T08:48:41.306465+0000","last_fullsized":"2023-10-07T08:48:41.306465+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:50:29.587780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.305201+0000","last_change":"2023-10-07T08:48:41.304981+0000","last_active":"2023-10-07T08:48:41.305201+0000","last_peered":"2023-10-07T08:48:41.305201+0000","last_clean":"2023-10-07T08:48:41.305201+0000","last_became_active":"2023-10-07T08:48:41.300105+0000","last_became_peered":"2023-10-07T08:48:41.300105+0000","last_unstale":"2023-10-07T08:48:41.305201+0000","last_undegraded":"2023-10-07T08:48:41.305201+0000","last_fullsized":"2023-10-07T08:48:41.305201+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:32:55.232219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.304478+0000","last_change":"2023-10-07T08:48:40.295054+0000","last_active":"2023-10-07T08:48:41.304478+0000","last_peered":"2023-10-07T08:48:41.304478+0000","last_clean":"2023-10-07T08:48:41.304478+0000","last_became_active":"2023-10-07T08:48:40.294315+0000","last_became_peered":"2023-10-07T08:48:40.294315+0000","last_unstale":"2023-10-07T08:48:41.304478+0000","last_undegraded":"2023-10-07T08:48:41.304478+0000","last_fullsized":"2023-10-07T08:48:41.304478+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:26:52.965903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.301243+0000","last_change":"2023-10-07T08:48:41.300979+0000","last_active":"2023-10-07T08:48:41.301243+0000","last_peered":"2023-10-07T08:48:41.301243+0000","last_clean":"2023-10-07T08:48:41.301243+0000","last_became_active":"2023-10-07T08:48:41.300565+0000","last_became_peered":"2023-10-07T08:48:41.300565+0000","last_unstale":"2023-10-07T08:48:41.301243+0000","last_undegraded":"2023-10-07T08:48:41.301243+0000","last_fullsized":"2023-10-07T08:48:41.301243+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:54:08.463584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297386+0000","last_change":"2023-10-07T08:48:40.291872+0000","last_active":"2023-10-07T08:48:41.297386+0000","last_peered":"2023-10-07T08:48:41.297386+0000","last_clean":"2023-10-07T08:48:41.297386+0000","last_became_active":"2023-10-07T08:48:40.291633+0000","last_became_peered":"2023-10-07T08:48:40.291633+0000","last_unstale":"2023-10-07T08:48:41.297386+0000","last_undegraded":"2023-10-07T08:48:41.297386+0000","last_fullsized":"2023-10-07T08:48:41.297386+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:28:58.881915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.291712+0000","last_change":"2023-10-07T08:48:41.291651+0000","last_active":"2023-10-07T08:48:41.291712+0000","last_peered":"2023-10-07T08:48:41.291712+0000","last_clean":"2023-10-07T08:48:41.291712+0000","last_became_active":"2023-10-07T08:48:41.291430+0000","last_became_peered":"2023-10-07T08:48:41.291430+0000","last_unstale":"2023-10-07T08:48:41.291712+0000","last_undegraded":"2023-10-07T08:48:41.291712+0000","last_fullsized":"2023-10-07T08:48:41.291712+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:08:51.988970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.302772+0000","last_change":"2023-10-07T08:48:40.289679+0000","last_active":"2023-10-07T08:48:41.302772+0000","last_peered":"2023-10-07T08:48:41.302772+0000","last_clean":"2023-10-07T08:48:41.302772+0000","last_became_active":"2023-10-07T08:48:40.289419+0000","last_became_peered":"2023-10-07T08:48:40.289419+0000","last_unstale":"2023-10-07T08:48:41.302772+0000","last_undegraded":"2023-10-07T08:48:41.302772+0000","last_fullsized":"2023-10-07T08:48:41.302772+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:18:12.521247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297771+0000","last_change":"2023-10-07T08:48:41.297647+0000","last_active":"2023-10-07T08:48:41.297771+0000","last_peered":"2023-10-07T08:48:41.297771+0000","last_clean":"2023-10-07T08:48:41.297771+0000","last_became_active":"2023-10-07T08:48:41.297397+0000","last_became_peered":"2023-10-07T08:48:41.297397+0000","last_unstale":"2023-10-07T08:48:41.297771+0000","last_undegraded":"2023-10-07T08:48:41.297771+0000","last_fullsized":"2023-10-07T08:48:41.297771+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:28:00.163755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.294808+0000","last_change":"2023-10-07T08:48:40.289671+0000","last_active":"2023-10-07T08:48:41.294808+0000","last_peered":"2023-10-07T08:48:41.294808+0000","last_clean":"2023-10-07T08:48:41.294808+0000","last_became_active":"2023-10-07T08:48:40.289457+0000","last_became_peered":"2023-10-07T08:48:40.289457+0000","last_unstale":"2023-10-07T08:48:41.294808+0000","last_undegraded":"2023-10-07T08:48:41.294808+0000","last_fullsized":"2023-10-07T08:48:41.294808+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:20:11.641491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.308146+0000","last_change":"2023-10-07T08:48:41.307908+0000","last_active":"2023-10-07T08:48:41.308146+0000","last_peered":"2023-10-07T08:48:41.308146+0000","last_clean":"2023-10-07T08:48:41.308146+0000","last_became_active":"2023-10-07T08:48:41.307140+0000","last_became_peered":"2023-10-07T08:48:41.307140+0000","last_unstale":"2023-10-07T08:48:41.308146+0000","last_undegraded":"2023-10-07T08:48:41.308146+0000","last_fullsized":"2023-10-07T08:48:41.308146+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:35:59.312152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"122'3","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.302111+0000","last_change":"2023-10-07T08:48:40.294080+0000","last_active":"2023-10-07T08:48:41.302111+0000","last_peered":"2023-10-07T08:48:41.302111+0000","last_clean":"2023-10-07T08:48:41.302111+0000","last_became_active":"2023-10-07T08:48:40.293834+0000","last_became_peered":"2023-10-07T08:48:40.293834+0000","last_unstale":"2023-10-07T08:48:41.302111+0000","last_undegraded":"2023-10-07T08:48:41.302111+0000","last_fullsized":"2023-10-07T08:48:41.302111+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:07:23.481173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.298937+0000","last_change":"2023-10-07T08:48:41.298243+0000","last_active":"2023-10-07T08:48:41.298937+0000","last_peered":"2023-10-07T08:48:41.298937+0000","last_clean":"2023-10-07T08:48:41.298937+0000","last_became_active":"2023-10-07T08:48:41.297991+0000","last_became_peered":"2023-10-07T08:48:41.297991+0000","last_unstale":"2023-10-07T08:48:41.298937+0000","last_undegraded":"2023-10-07T08:48:41.298937+0000","last_fullsized":"2023-10-07T08:48:41.298937+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:57:35.159459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"122'6","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.309788+0000","last_change":"2023-10-07T08:48:40.289057+0000","last_active":"2023-10-07T08:48:41.309788+0000","last_peered":"2023-10-07T08:48:41.309788+0000","last_clean":"2023-10-07T08:48:41.309788+0000","last_became_active":"2023-10-07T08:48:40.288579+0000","last_became_peered":"2023-10-07T08:48:40.288579+0000","last_unstale":"2023-10-07T08:48:41.309788+0000","last_undegraded":"2023-10-07T08:48:41.309788+0000","last_fullsized":"2023-10-07T08:48:41.309788+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:56:55.954668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.298713+0000","last_change":"2023-10-07T08:48:41.298475+0000","last_active":"2023-10-07T08:48:41.298713+0000","last_peered":"2023-10-07T08:48:41.298713+0000","last_clean":"2023-10-07T08:48:41.298713+0000","last_became_active":"2023-10-07T08:48:41.298231+0000","last_became_peered":"2023-10-07T08:48:41.298231+0000","last_unstale":"2023-10-07T08:48:41.298713+0000","last_undegraded":"2023-10-07T08:48:41.298713+0000","last_fullsized":"2023-10-07T08:48:41.298713+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:30:14.226005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.301508+0000","last_change":"2023-10-07T08:48:40.291451+0000","last_active":"2023-10-07T08:48:41.301508+0000","last_peered":"2023-10-07T08:48:41.301508+0000","last_clean":"2023-10-07T08:48:41.301508+0000","last_became_active":"2023-10-07T08:48:40.291241+0000","last_became_peered":"2023-10-07T08:48:40.291241+0000","last_unstale":"2023-10-07T08:48:41.301508+0000","last_undegraded":"2023-10-07T08:48:41.301508+0000","last_fullsized":"2023-10-07T08:48:41.301508+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:38:51.532351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.304956+0000","last_change":"2023-10-07T08:48:41.304897+0000","last_active":"2023-10-07T08:48:41.304956+0000","last_peered":"2023-10-07T08:48:41.304956+0000","last_clean":"2023-10-07T08:48:41.304956+0000","last_became_active":"2023-10-07T08:48:41.304537+0000","last_became_peered":"2023-10-07T08:48:41.304537+0000","last_unstale":"2023-10-07T08:48:41.304956+0000","last_undegraded":"2023-10-07T08:48:41.304956+0000","last_fullsized":"2023-10-07T08:48:41.304956+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:56:56.956422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.287739+0000","last_change":"2023-10-07T08:48:40.290717+0000","last_active":"2023-10-07T08:48:41.287739+0000","last_peered":"2023-10-07T08:48:41.287739+0000","last_clean":"2023-10-07T08:48:41.287739+0000","last_became_active":"2023-10-07T08:48:40.290580+0000","last_became_peered":"2023-10-07T08:48:40.290580+0000","last_unstale":"2023-10-07T08:48:41.287739+0000","last_undegraded":"2023-10-07T08:48:41.287739+0000","last_fullsized":"2023-10-07T08:48:41.287739+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:19.361640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297426+0000","last_change":"2023-10-07T08:48:41.297341+0000","last_active":"2023-10-07T08:48:41.297426+0000","last_peered":"2023-10-07T08:48:41.297426+0000","last_clean":"2023-10-07T08:48:41.297426+0000","last_became_active":"2023-10-07T08:48:41.297113+0000","last_became_peered":"2023-10-07T08:48:41.297113+0000","last_unstale":"2023-10-07T08:48:41.297426+0000","last_undegraded":"2023-10-07T08:48:41.297426+0000","last_fullsized":"2023-10-07T08:48:41.297426+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:58:26.919520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.288328+0000","last_change":"2023-10-07T08:48:40.293813+0000","last_active":"2023-10-07T08:48:41.288328+0000","last_peered":"2023-10-07T08:48:41.288328+0000","last_clean":"2023-10-07T08:48:41.288328+0000","last_became_active":"2023-10-07T08:48:40.293345+0000","last_became_peered":"2023-10-07T08:48:40.293345+0000","last_unstale":"2023-10-07T08:48:41.288328+0000","last_undegraded":"2023-10-07T08:48:41.288328+0000","last_fullsized":"2023-10-07T08:48:41.288328+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:27.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.290534+0000","last_change":"2023-10-07T08:48:41.290473+0000","last_active":"2023-10-07T08:48:41.290534+0000","last_peered":"2023-10-07T08:48:41.290534+0000","last_clean":"2023-10-07T08:48:41.290534+0000","last_became_active":"2023-10-07T08:48:41.290010+0000","last_became_peered":"2023-10-07T08:48:41.290010+0000","last_unstale":"2023-10-07T08:48:41.290534+0000","last_undegraded":"2023-10-07T08:48:41.290534+0000","last_fullsized":"2023-10-07T08:48:41.290534+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:37.426440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"122'8","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.308670+0000","last_change":"2023-10-07T08:48:40.292695+0000","last_active":"2023-10-07T08:48:41.308670+0000","last_peered":"2023-10-07T08:48:41.308670+0000","last_clean":"2023-10-07T08:48:41.308670+0000","last_became_active":"2023-10-07T08:48:40.292466+0000","last_became_peered":"2023-10-07T08:48:40.292466+0000","last_unstale":"2023-10-07T08:48:41.308670+0000","last_undegraded":"2023-10-07T08:48:41.308670+0000","last_fullsized":"2023-10-07T08:48:41.308670+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:15:34.746855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.308172+0000","last_change":"2023-10-07T08:48:41.308059+0000","last_active":"2023-10-07T08:48:41.308172+0000","last_peered":"2023-10-07T08:48:41.308172+0000","last_clean":"2023-10-07T08:48:41.308172+0000","last_became_active":"2023-10-07T08:48:41.307549+0000","last_became_peered":"2023-10-07T08:48:41.307549+0000","last_unstale":"2023-10-07T08:48:41.308172+0000","last_undegraded":"2023-10-07T08:48:41.308172+0000","last_fullsized":"2023-10-07T08:48:41.308172+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:36.227017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.302943+0000","last_change":"2023-10-07T08:48:40.293349+0000","last_active":"2023-10-07T08:48:41.302943+0000","last_peered":"2023-10-07T08:48:41.302943+0000","last_clean":"2023-10-07T08:48:41.302943+0000","last_became_active":"2023-10-07T08:48:40.292932+0000","last_became_peered":"2023-10-07T08:48:40.292932+0000","last_unstale":"2023-10-07T08:48:41.302943+0000","last_undegraded":"2023-10-07T08:48:41.302943+0000","last_fullsized":"2023-10-07T08:48:41.302943+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:40:43.985905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.300995+0000","last_change":"2023-10-07T08:48:41.300872+0000","last_active":"2023-10-07T08:48:41.300995+0000","last_peered":"2023-10-07T08:48:41.300995+0000","last_clean":"2023-10-07T08:48:41.300995+0000","last_became_active":"2023-10-07T08:48:41.300658+0000","last_became_peered":"2023-10-07T08:48:41.300658+0000","last_unstale":"2023-10-07T08:48:41.300995+0000","last_undegraded":"2023-10-07T08:48:41.300995+0000","last_fullsized":"2023-10-07T08:48:41.300995+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:16.245769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.305054+0000","last_change":"2023-10-07T08:48:40.291471+0000","last_active":"2023-10-07T08:48:41.305054+0000","last_peered":"2023-10-07T08:48:41.305054+0000","last_clean":"2023-10-07T08:48:41.305054+0000","last_became_active":"2023-10-07T08:48:40.291202+0000","last_became_peered":"2023-10-07T08:48:40.291202+0000","last_unstale":"2023-10-07T08:48:41.305054+0000","last_undegraded":"2023-10-07T08:48:41.305054+0000","last_fullsized":"2023-10-07T08:48:41.305054+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:29:36.177775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297279+0000","last_change":"2023-10-07T08:48:41.297181+0000","last_active":"2023-10-07T08:48:41.297279+0000","last_peered":"2023-10-07T08:48:41.297279+0000","last_clean":"2023-10-07T08:48:41.297279+0000","last_became_active":"2023-10-07T08:48:41.296439+0000","last_became_peered":"2023-10-07T08:48:41.296439+0000","last_unstale":"2023-10-07T08:48:41.297279+0000","last_undegraded":"2023-10-07T08:48:41.297279+0000","last_fullsized":"2023-10-07T08:48:41.297279+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:08.921090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.290692+0000","last_change":"2023-10-07T08:48:40.294547+0000","last_active":"2023-10-07T08:48:41.290692+0000","last_peered":"2023-10-07T08:48:41.290692+0000","last_clean":"2023-10-07T08:48:41.290692+0000","last_became_active":"2023-10-07T08:48:40.293902+0000","last_became_peered":"2023-10-07T08:48:40.293902+0000","last_unstale":"2023-10-07T08:48:41.290692+0000","last_undegraded":"2023-10-07T08:48:41.290692+0000","last_fullsized":"2023-10-07T08:48:41.290692+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:11:35.225263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297307+0000","last_change":"2023-10-07T08:48:41.297246+0000","last_active":"2023-10-07T08:48:41.297307+0000","last_peered":"2023-10-07T08:48:41.297307+0000","last_clean":"2023-10-07T08:48:41.297307+0000","last_became_active":"2023-10-07T08:48:41.296953+0000","last_became_peered":"2023-10-07T08:48:41.296953+0000","last_unstale":"2023-10-07T08:48:41.297307+0000","last_undegraded":"2023-10-07T08:48:41.297307+0000","last_fullsized":"2023-10-07T08:48:41.297307+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:01:10.786719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.302396+0000","last_change":"2023-10-07T08:48:40.291746+0000","last_active":"2023-10-07T08:48:41.302396+0000","last_peered":"2023-10-07T08:48:41.302396+0000","last_clean":"2023-10-07T08:48:41.302396+0000","last_became_active":"2023-10-07T08:48:40.290920+0000","last_became_peered":"2023-10-07T08:48:40.290920+0000","last_unstale":"2023-10-07T08:48:41.302396+0000","last_undegraded":"2023-10-07T08:48:41.302396+0000","last_fullsized":"2023-10-07T08:48:41.302396+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:10:32.829113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.291126+0000","last_change":"2023-10-07T08:48:41.291069+0000","last_active":"2023-10-07T08:48:41.291126+0000","last_peered":"2023-10-07T08:48:41.291126+0000","last_clean":"2023-10-07T08:48:41.291126+0000","last_became_active":"2023-10-07T08:48:41.290864+0000","last_became_peered":"2023-10-07T08:48:41.290864+0000","last_unstale":"2023-10-07T08:48:41.291126+0000","last_undegraded":"2023-10-07T08:48:41.291126+0000","last_fullsized":"2023-10-07T08:48:41.291126+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:14:15.930749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.295053+0000","last_change":"2023-10-07T08:48:40.290894+0000","last_active":"2023-10-07T08:48:41.295053+0000","last_peered":"2023-10-07T08:48:41.295053+0000","last_clean":"2023-10-07T08:48:41.295053+0000","last_became_active":"2023-10-07T08:48:40.290652+0000","last_became_peered":"2023-10-07T08:48:40.290652+0000","last_unstale":"2023-10-07T08:48:41.295053+0000","last_undegraded":"2023-10-07T08:48:41.295053+0000","last_fullsized":"2023-10-07T08:48:41.295053+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:53:14.493858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297876+0000","last_change":"2023-10-07T08:48:41.297819+0000","last_active":"2023-10-07T08:48:41.297876+0000","last_peered":"2023-10-07T08:48:41.297876+0000","last_clean":"2023-10-07T08:48:41.297876+0000","last_became_active":"2023-10-07T08:48:41.297609+0000","last_became_peered":"2023-10-07T08:48:41.297609+0000","last_unstale":"2023-10-07T08:48:41.297876+0000","last_undegraded":"2023-10-07T08:48:41.297876+0000","last_fullsized":"2023-10-07T08:48:41.297876+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:38:10.126941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.294925+0000","last_change":"2023-10-07T08:48:40.292088+0000","last_active":"2023-10-07T08:48:41.294925+0000","last_peered":"2023-10-07T08:48:41.294925+0000","last_clean":"2023-10-07T08:48:41.294925+0000","last_became_active":"2023-10-07T08:48:40.291857+0000","last_became_peered":"2023-10-07T08:48:40.291857+0000","last_unstale":"2023-10-07T08:48:41.294925+0000","last_undegraded":"2023-10-07T08:48:41.294925+0000","last_fullsized":"2023-10-07T08:48:41.294925+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:27.856597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.303987+0000","last_change":"2023-10-07T08:48:41.303722+0000","last_active":"2023-10-07T08:48:41.303987+0000","last_peered":"2023-10-07T08:48:41.303987+0000","last_clean":"2023-10-07T08:48:41.303987+0000","last_became_active":"2023-10-07T08:48:41.303005+0000","last_became_peered":"2023-10-07T08:48:41.303005+0000","last_unstale":"2023-10-07T08:48:41.303987+0000","last_undegraded":"2023-10-07T08:48:41.303987+0000","last_fullsized":"2023-10-07T08:48:41.303987+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:19:16.245769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.289367+0000","last_change":"2023-10-07T08:48:40.292781+0000","last_active":"2023-10-07T08:48:41.289367+0000","last_peered":"2023-10-07T08:48:41.289367+0000","last_clean":"2023-10-07T08:48:41.289367+0000","last_became_active":"2023-10-07T08:48:40.292136+0000","last_became_peered":"2023-10-07T08:48:40.292136+0000","last_unstale":"2023-10-07T08:48:41.289367+0000","last_undegraded":"2023-10-07T08:48:41.289367+0000","last_fullsized":"2023-10-07T08:48:41.289367+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:35:58.310397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.297217+0000","last_change":"2023-10-07T08:48:41.297158+0000","last_active":"2023-10-07T08:48:41.297217+0000","last_peered":"2023-10-07T08:48:41.297217+0000","last_clean":"2023-10-07T08:48:41.297217+0000","last_became_active":"2023-10-07T08:48:41.296801+0000","last_became_peered":"2023-10-07T08:48:41.296801+0000","last_unstale":"2023-10-07T08:48:41.297217+0000","last_undegraded":"2023-10-07T08:48:41.297217+0000","last_fullsized":"2023-10-07T08:48:41.297217+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:38:52.458095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.308027+0000","last_change":"2023-10-07T08:48:40.293015+0000","last_active":"2023-10-07T08:48:41.308027+0000","last_peered":"2023-10-07T08:48:41.308027+0000","last_clean":"2023-10-07T08:48:41.308027+0000","last_became_active":"2023-10-07T08:48:40.292767+0000","last_became_peered":"2023-10-07T08:48:40.292767+0000","last_unstale":"2023-10-07T08:48:41.308027+0000","last_undegraded":"2023-10-07T08:48:41.308027+0000","last_fullsized":"2023-10-07T08:48:41.308027+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:07.308237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.304814+0000","last_change":"2023-10-07T08:48:41.304757+0000","last_active":"2023-10-07T08:48:41.304814+0000","last_peered":"2023-10-07T08:48:41.304814+0000","last_clean":"2023-10-07T08:48:41.304814+0000","last_became_active":"2023-10-07T08:48:41.304550+0000","last_became_peered":"2023-10-07T08:48:41.304550+0000","last_unstale":"2023-10-07T08:48:41.304814+0000","last_undegraded":"2023-10-07T08:48:41.304814+0000","last_fullsized":"2023-10-07T08:48:41.304814+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:03:06.655934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-07T08:48:42.290136+0000","last_change":"2023-10-07T08:48:40.291885+0000","last_active":"2023-10-07T08:48:42.290136+0000","last_peered":"2023-10-07T08:48:42.290136+0000","last_clean":"2023-10-07T08:48:42.290136+0000","last_became_active":"2023-10-07T08:48:40.291214+0000","last_became_peered":"2023-10-07T08:48:40.291214+0000","last_unstale":"2023-10-07T08:48:42.290136+0000","last_undegraded":"2023-10-07T08:48:42.290136+0000","last_fullsized":"2023-10-07T08:48:42.290136+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:58:25.917765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.305667+0000","last_change":"2023-10-07T08:48:41.305534+0000","last_active":"2023-10-07T08:48:41.305667+0000","last_peered":"2023-10-07T08:48:41.305667+0000","last_clean":"2023-10-07T08:48:41.305667+0000","last_became_active":"2023-10-07T08:48:41.305143+0000","last_became_peered":"2023-10-07T08:48:41.305143+0000","last_unstale":"2023-10-07T08:48:41.305667+0000","last_undegraded":"2023-10-07T08:48:41.305667+0000","last_fullsized":"2023-10-07T08:48:41.305667+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:53:15.495612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.289338+0000","last_change":"2023-10-07T08:48:40.290648+0000","last_active":"2023-10-07T08:48:41.289338+0000","last_peered":"2023-10-07T08:48:41.289338+0000","last_clean":"2023-10-07T08:48:41.289338+0000","last_became_active":"2023-10-07T08:48:40.290421+0000","last_became_peered":"2023-10-07T08:48:40.290421+0000","last_unstale":"2023-10-07T08:48:41.289338+0000","last_undegraded":"2023-10-07T08:48:41.289338+0000","last_fullsized":"2023-10-07T08:48:41.289338+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:54:07.461829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.308130+0000","last_change":"2023-10-07T08:48:41.307762+0000","last_active":"2023-10-07T08:48:41.308130+0000","last_peered":"2023-10-07T08:48:41.308130+0000","last_clean":"2023-10-07T08:48:41.308130+0000","last_became_active":"2023-10-07T08:48:41.306837+0000","last_became_peered":"2023-10-07T08:48:41.306837+0000","last_unstale":"2023-10-07T08:48:41.308130+0000","last_undegraded":"2023-10-07T08:48:41.308130+0000","last_fullsized":"2023-10-07T08:48:41.308130+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:24:25.555139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.298730+0000","last_change":"2023-10-07T08:48:40.294343+0000","last_active":"2023-10-07T08:48:41.298730+0000","last_peered":"2023-10-07T08:48:41.298730+0000","last_clean":"2023-10-07T08:48:41.298730+0000","last_became_active":"2023-10-07T08:48:40.293902+0000","last_became_peered":"2023-10-07T08:48:40.293902+0000","last_unstale":"2023-10-07T08:48:41.298730+0000","last_undegraded":"2023-10-07T08:48:41.298730+0000","last_fullsized":"2023-10-07T08:48:41.298730+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:46.935278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.290309+0000","last_change":"2023-10-07T08:48:41.290251+0000","last_active":"2023-10-07T08:48:41.290309+0000","last_peered":"2023-10-07T08:48:41.290309+0000","last_clean":"2023-10-07T08:48:41.290309+0000","last_became_active":"2023-10-07T08:48:41.289696+0000","last_became_peered":"2023-10-07T08:48:41.289696+0000","last_unstale":"2023-10-07T08:48:41.290309+0000","last_undegraded":"2023-10-07T08:48:41.290309+0000","last_fullsized":"2023-10-07T08:48:41.290309+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:34:51.632376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.289460+0000","last_change":"2023-10-07T08:48:40.292913+0000","last_active":"2023-10-07T08:48:41.289460+0000","last_peered":"2023-10-07T08:48:41.289460+0000","last_clean":"2023-10-07T08:48:41.289460+0000","last_became_active":"2023-10-07T08:48:40.292435+0000","last_became_peered":"2023-10-07T08:48:40.292435+0000","last_unstale":"2023-10-07T08:48:41.289460+0000","last_undegraded":"2023-10-07T08:48:41.289460+0000","last_fullsized":"2023-10-07T08:48:41.289460+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:07:23.481173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.300661+0000","last_change":"2023-10-07T08:48:41.300488+0000","last_active":"2023-10-07T08:48:41.300661+0000","last_peered":"2023-10-07T08:48:41.300661+0000","last_clean":"2023-10-07T08:48:41.300661+0000","last_became_active":"2023-10-07T08:48:41.300180+0000","last_became_peered":"2023-10-07T08:48:41.300180+0000","last_unstale":"2023-10-07T08:48:41.300661+0000","last_undegraded":"2023-10-07T08:48:41.300661+0000","last_fullsized":"2023-10-07T08:48:41.300661+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:37:29.300690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.295269+0000","last_change":"2023-10-07T08:48:40.291491+0000","last_active":"2023-10-07T08:48:41.295269+0000","last_peered":"2023-10-07T08:48:41.295269+0000","last_clean":"2023-10-07T08:48:41.295269+0000","last_became_active":"2023-10-07T08:48:40.291224+0000","last_became_peered":"2023-10-07T08:48:40.291224+0000","last_unstale":"2023-10-07T08:48:41.295269+0000","last_undegraded":"2023-10-07T08:48:41.295269+0000","last_fullsized":"2023-10-07T08:48:41.295269+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:45:51.542869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.289670+0000","last_change":"2023-10-07T08:48:41.289606+0000","last_active":"2023-10-07T08:48:41.289670+0000","last_peered":"2023-10-07T08:48:41.289670+0000","last_clean":"2023-10-07T08:48:41.289670+0000","last_became_active":"2023-10-07T08:48:41.289381+0000","last_became_peered":"2023-10-07T08:48:41.289381+0000","last_unstale":"2023-10-07T08:48:41.289670+0000","last_undegraded":"2023-10-07T08:48:41.289670+0000","last_fullsized":"2023-10-07T08:48:41.289670+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:00:36.975594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.294935+0000","last_change":"2023-10-07T08:48:40.290718+0000","last_active":"2023-10-07T08:48:41.294935+0000","last_peered":"2023-10-07T08:48:41.294935+0000","last_clean":"2023-10-07T08:48:41.294935+0000","last_became_active":"2023-10-07T08:48:40.290487+0000","last_became_peered":"2023-10-07T08:48:40.290487+0000","last_unstale":"2023-10-07T08:48:41.294935+0000","last_undegraded":"2023-10-07T08:48:41.294935+0000","last_fullsized":"2023-10-07T08:48:41.294935+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:24:24.553384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.296625+0000","last_change":"2023-10-07T08:48:41.296425+0000","last_active":"2023-10-07T08:48:41.296625+0000","last_peered":"2023-10-07T08:48:41.296625+0000","last_clean":"2023-10-07T08:48:41.296625+0000","last_became_active":"2023-10-07T08:48:41.295869+0000","last_became_peered":"2023-10-07T08:48:41.295869+0000","last_unstale":"2023-10-07T08:48:41.296625+0000","last_undegraded":"2023-10-07T08:48:41.296625+0000","last_fullsized":"2023-10-07T08:48:41.296625+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:20:12.643245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.286396+0000","last_change":"2023-10-07T08:48:40.290171+0000","last_active":"2023-10-07T08:48:41.286396+0000","last_peered":"2023-10-07T08:48:41.286396+0000","last_clean":"2023-10-07T08:48:41.286396+0000","last_became_active":"2023-10-07T08:48:40.289763+0000","last_became_peered":"2023-10-07T08:48:40.289763+0000","last_unstale":"2023-10-07T08:48:41.286396+0000","last_undegraded":"2023-10-07T08:48:41.286396+0000","last_fullsized":"2023-10-07T08:48:41.286396+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:38:15.680036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.295858+0000","last_change":"2023-10-07T08:48:41.295800+0000","last_active":"2023-10-07T08:48:41.295858+0000","last_peered":"2023-10-07T08:48:41.295858+0000","last_clean":"2023-10-07T08:48:41.295858+0000","last_became_active":"2023-10-07T08:48:41.295569+0000","last_became_peered":"2023-10-07T08:48:41.295569+0000","last_unstale":"2023-10-07T08:48:41.295858+0000","last_undegraded":"2023-10-07T08:48:41.295858+0000","last_fullsized":"2023-10-07T08:48:41.295858+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:40.278787+0000","last_clean_scrub_stamp":"2023-10-07T08:48:40.278787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:34:58.997688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.300344+0000","last_change":"2023-10-07T08:48:40.295349+0000","last_active":"2023-10-07T08:48:41.300344+0000","last_peered":"2023-10-07T08:48:41.300344+0000","last_clean":"2023-10-07T08:48:41.300344+0000","last_became_active":"2023-10-07T08:48:40.294859+0000","last_became_peered":"2023-10-07T08:48:40.294859+0000","last_unstale":"2023-10-07T08:48:41.300344+0000","last_undegraded":"2023-10-07T08:48:41.300344+0000","last_fullsized":"2023-10-07T08:48:41.300344+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:48:39.277032+0000","last_clean_scrub_stamp":"2023-10-07T08:48:39.277032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:32:09.660818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":248,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-07T08:48:41.292912+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:48:41.292912+0000","last_peered":"2023-10-07T08:48:41.292912+0000","last_clean":"2023-10-07T08:48:41.292912+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:48:41.292912+0000","last_undegraded":"2023-10-07T08:48:41.292912+0000","last_fullsized":"2023-10-07T08:48:41.292912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1233,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194079,"statfs":{"total":200000000,"available":198737347,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.5},"min":{"1min":0.36599999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.48699999999999999},"min":{"1min":0.379,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68000000000000005,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.61799999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.41799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.40500000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81999999999999995,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51400000000000001,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.75},"last":0.52200000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.629,"15min":0.80700000000000005},"min":{"1min":0.38800000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.68400000000000005,"5min":6.8570000000000002,"15min":6.8570000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.749,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.28799999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66400000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.502,"15min":0.53300000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69499999999999995,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42999999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":0.751,"15min":0.751},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54200000000000004,"15min":0.56999999999999995},"min":{"1min":0.318,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73299999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.53900000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56899999999999995,"15min":0.59199999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72999999999999998,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71599999999999997,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.63800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":657,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194655,"statfs":{"total":200000000,"available":199327203,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.495,"15min":0.47299999999999998},"min":{"1min":0.316,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.57399999999999995}]},{"osd":1,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.44600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.55500000000000005,"15min":0.53200000000000003},"min":{"1min":0.495,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.52700000000000002,"15min":0.48199999999999998},"min":{"1min":0.38200000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.435,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78100000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.50800000000000001},"min":{"1min":0.40899999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.45800000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48199999999999998,"15min":0.47899999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.32900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48599999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.505},"min":{"1min":0.33600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.40600000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73899999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.442}]},{"osd":7,"last update":"Sat Oct 7 08:47:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.40100000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.59599999999999997,"15min":0.58199999999999996},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89100000000000001,"5min":1.052,"15min":1.052},"last":0.42599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":656,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194656,"statfs":{"total":200000000,"available":199327827,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34599999999999997,"15min":0.312},"min":{"1min":0.22500000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.56699999999999995,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.311},{"interface":"front","average":{"1min":0.371,"5min":0.35499999999999998,"15min":0.32800000000000001},"min":{"1min":0.22500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.61599999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.318},"min":{"1min":0.26200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70399999999999996,"5min":1.639,"15min":1.639},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.38800000000000001,"15min":0.33200000000000002},"min":{"1min":0.28699999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.47399999999999998,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.33500000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40000000000000002,"15min":0.35899999999999999},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.52800000000000002,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.34799999999999998},"min":{"1min":0.28599999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.5},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.52200000000000002},"min":{"1min":0.35699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79100000000000004,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.56999999999999995}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.47899999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57099999999999995,"15min":0.54400000000000004},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.52600000000000002},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73099999999999998,"5min":0.87,"15min":0.87},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.58199999999999996},"min":{"1min":0.51800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79100000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.55900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1233,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194079,"statfs":{"total":200000000,"available":198736905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.371},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.377,"15min":0.39500000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.67400000000000004,"5min":1.079,"15min":1.079},"last":0.41699999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.39100000000000001},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63200000000000001,"5min":1.464,"15min":1.464},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.40200000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67900000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.47199999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.37,"15min":0.38500000000000001},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":1.341,"15min":1.341},"last":0.436},{"interface":"front","average":{"1min":0.432,"5min":0.42099999999999999,"15min":0.435},"min":{"1min":0.28699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68600000000000005,"5min":1.532,"15min":1.532},"last":0.48999999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90200000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.60999999999999999},"min":{"1min":0.36199999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80100000000000005,"5min":1.51,"15min":1.51},"last":0.76400000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83299999999999996,"5min":1.25,"15min":1.25},"last":0.61599999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.92900000000000005,"5min":1.488,"15min":1.488},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":1.024,"15min":1.024},"last":0.78000000000000003}]},{"osd":7,"last update":"Sat Oct 7 08:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.745},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.45700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.90300000000000002,"5min":1.288,"15min":1.288},"last":0.65200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":656,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194656,"statfs":{"total":200000000,"available":199327793,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.34300000000000003},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.49299999999999999,"5min":1.665,"15min":1.665},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.35799999999999998,"15min":0.36299999999999999},"min":{"1min":0.23499999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.50900000000000001,"5min":1.579,"15min":1.579},"last":0.40600000000000003}]},{"osd":1,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.38400000000000001,"15min":0.38100000000000001},"min":{"1min":0.218,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.26600000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.51200000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.26100000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58999999999999997,"5min":1.454,"15min":1.454},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.39100000000000001},"min":{"1min":0.28100000000000003,"5min":0.224,"15min":0.224},"max":{"1min":0.56599999999999995,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.47899999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.40600000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81999999999999995,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.625},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.874,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.36799999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83499999999999996,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.38600000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.76900000000000002,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.66500000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77600000000000002,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.85899999999999999,"5min":1.637,"15min":1.637},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:47:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":1.49,"15min":1.49},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81299999999999994,"5min":1.375,"15min":1.375},"last":0.64400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574923,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":657,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194654,"statfs":{"total":200000000,"available":199326269,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35499999999999998,"15min":0.33100000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.90200000000000002,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34899999999999998,"15min":0.32100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.504,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.29199999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38100000000000001,"15min":0.35999999999999999},"min":{"1min":0.245,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.61599999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41999999999999998,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70099999999999996,"5min":1.885,"15min":1.885},"last":0.315}]},{"osd":2,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.38100000000000001},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57699999999999996,"5min":1.274,"15min":1.274},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.40300000000000002},"min":{"1min":0.32100000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.97699999999999998,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.40699999999999997}]},{"osd":4,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.503},"min":{"1min":0.36699999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78500000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.436},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57399999999999995,"15min":0.53500000000000003},"min":{"1min":0.45200000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80800000000000005,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.42899999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.42799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79400000000000004,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.59699999999999998,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.038,"5min":1.851,"15min":1.851},"last":0.56000000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60299999999999998,"15min":0.55900000000000005},"min":{"1min":0.45100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77200000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.58599999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84199999999999997,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.495}]},{"osd":7,"last update":"Sat Oct 7 08:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.57699999999999996},"min":{"1min":0.45600000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0089999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.59299999999999997,"15min":0.55700000000000005},"min":{"1min":0.42699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80000000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194654,"statfs":{"total":200000000,"available":199326167,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.72199999999999998,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.441},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.71099999999999997,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.46500000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.501},"min":{"1min":0.29499999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.70099999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68799999999999994,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.53100000000000003},"min":{"1min":0.45200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68400000000000005,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53900000000000003,"15min":0.50800000000000001},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69099999999999995,"5min":1.29,"15min":1.29},"last":0.45500000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.52700000000000002},"min":{"1min":0.38400000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":2.052,"15min":2.052},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71199999999999997,"5min":1.369,"15min":1.369},"last":0.51900000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.75700000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.495,"15min":0.495},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76500000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.39500000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.32800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.75900000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.35799999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54000000000000004,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85099999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79300000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.379}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":656,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194656,"statfs":{"total":200000000,"available":199327757,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.51600000000000001},"min":{"1min":0.314,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.63900000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.51700000000000002,"15min":0.49099999999999999},"min":{"1min":0.34999999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.45000000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76800000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.73399999999999999,"5min":0.754,"15min":0.754},"last":0.64800000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.495},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78900000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.66300000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.47899999999999998},"min":{"1min":0.31,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.251},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57299999999999995,"15min":0.59599999999999997},"min":{"1min":0.40300000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.754,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.38300000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.71399999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.34799999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54900000000000004,"15min":0.57699999999999996},"min":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.313},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.59699999999999998},"min":{"1min":0.39200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80100000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.35999999999999999}]}]}],"pool_statfs":[]}} 2023-10-07T08:48:50.243 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T08:48:50.243 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T08:48:50.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.397+0000 7f2663fff700 1 Processor -- start 2023-10-07T08:48:50.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.397+0000 7f2663fff700 1 -- start start 2023-10-07T08:48:50.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.398+0000 7f2663fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f266415d0a0 0x7f26640b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.398+0000 7f2663fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f266415a2e0 0x7f266415d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.398+0000 7f2663fff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26640b37f0 con 0x7f266406e940 2023-10-07T08:48:50.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.398+0000 7f2663fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266406d750 con 0x7f266415d0a0 2023-10-07T08:48:50.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.398+0000 7f2663fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266406da30 con 0x7f266415a2e0 2023-10-07T08:48:50.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.398+0000 7f2662ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f266415d0a0 0x7f26640b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.398+0000 7f2662ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f266415d0a0 0x7f26640b1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44874/0 (socket says 172.21.15.81:44874) 2023-10-07T08:48:50.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.398+0000 7f2662ffd700 1 -- 172.21.15.81:0/1557081057 learned_addr learned my addr 172.21.15.81:0/1557081057 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:50.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.398+0000 7f265a7fc700 1 --2- 172.21.15.81:0/1557081057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f266415a2e0 0x7f266415d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.398+0000 7f2662ffd700 1 -- 172.21.15.81:0/1557081057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f266415a2e0 msgr2=0x7f266415d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:50.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.398+0000 7f2662ffd700 1 --2- 172.21.15.81:0/1557081057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f266415a2e0 0x7f266415d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.398+0000 7f2662ffd700 1 -- 172.21.15.81:0/1557081057 >> v1:172.21.15.89:6789/0 conn(0x7f266406e940 legacy=0x7f26640b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.398+0000 7f2662ffd700 1 -- 172.21.15.81:0/1557081057 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26640b3480 con 0x7f266415d0a0 2023-10-07T08:48:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.398+0000 7f265a7fc700 1 --2- 172.21.15.81:0/1557081057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f266415a2e0 0x7f266415d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.398+0000 7f2662ffd700 1 --2- 172.21.15.81:0/1557081057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266415d0a0 0x7f26640b1780 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f26540099b0 tx=0x7f2654009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8dd1783d2f4c718 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.399+0000 7f26627fc700 1 -- 172.21.15.81:0/1557081057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265400b860 con 0x7f266415d0a0 2023-10-07T08:48:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.399+0000 7f26627fc700 1 -- 172.21.15.81:0/1557081057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265400b9c0 con 0x7f266415d0a0 2023-10-07T08:48:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.399+0000 7f26627fc700 1 -- 172.21.15.81:0/1557081057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265400bd60 con 0x7f266415d0a0 2023-10-07T08:48:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.399+0000 7f2663fff700 1 -- 172.21.15.81:0/1557081057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266415d0a0 msgr2=0x7f26640b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.399+0000 7f2663fff700 1 --2- 172.21.15.81:0/1557081057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266415d0a0 0x7f26640b1780 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f26540099b0 tx=0x7f2654009250 comp rx=0 tx=0).stop 2023-10-07T08:48:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.399+0000 7f2663fff700 1 -- 172.21.15.81:0/1557081057 shutdown_connections 2023-10-07T08:48:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.399+0000 7f2663fff700 1 --2- 172.21.15.81:0/1557081057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266415d0a0 0x7f26640b1780 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.399+0000 7f2663fff700 1 --2- 172.21.15.81:0/1557081057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f266415a2e0 0x7f266415d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.399+0000 7f2663fff700 1 -- 172.21.15.81:0/1557081057 >> 172.21.15.81:0/1557081057 conn(0x7f26640680b0 msgr2=0x7f266406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:50.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.399+0000 7f2663fff700 1 -- 172.21.15.81:0/1557081057 shutdown_connections 2023-10-07T08:48:50.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.399+0000 7f2663fff700 1 -- 172.21.15.81:0/1557081057 wait complete. 2023-10-07T08:48:50.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.400+0000 7f2663fff700 1 Processor -- start 2023-10-07T08:48:50.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.400+0000 7f2663fff700 1 -- start start 2023-10-07T08:48:50.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.401+0000 7f2663fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f266406e940 0x7f2664157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.401+0000 7f2663fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266415a2e0 0x7f26640a7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.401+0000 7f2663fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f266415d0a0 0x7f266416a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.401+0000 7f2663fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26640b0200 con 0x7f266415a2e0 2023-10-07T08:48:50.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.401+0000 7f2663fff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26640a6480 con 0x7f266406e940 2023-10-07T08:48:50.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.401+0000 7f2663fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26640a6760 con 0x7f266415d0a0 2023-10-07T08:48:50.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.401+0000 7f265a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266415a2e0 0x7f26640a7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.401+0000 7f265a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266415a2e0 0x7f26640a7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44890/0 (socket says 172.21.15.81:44890) 2023-10-07T08:48:50.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.401+0000 7f265a7fc700 1 -- 172.21.15.81:0/2581736358 learned_addr learned my addr 172.21.15.81:0/2581736358 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:50.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.401+0000 7f2662ffd700 1 --2- 172.21.15.81:0/2581736358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f266406e940 0x7f2664157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.401+0000 7f26637fe700 1 --2- 172.21.15.81:0/2581736358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f266415d0a0 0x7f266416a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.402+0000 7f265a7fc700 1 -- 172.21.15.81:0/2581736358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f266415d0a0 msgr2=0x7f266416a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:50.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.402+0000 7f265a7fc700 1 --2- 172.21.15.81:0/2581736358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f266415d0a0 0x7f266416a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.402+0000 7f265a7fc700 1 -- 172.21.15.81:0/2581736358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f266406e940 msgr2=0x7f2664157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:50.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.402+0000 7f265a7fc700 1 --2- 172.21.15.81:0/2581736358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f266406e940 0x7f2664157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.402+0000 7f265a7fc700 1 -- 172.21.15.81:0/2581736358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26540094f0 con 0x7f266415a2e0 2023-10-07T08:48:50.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.402+0000 7f265a7fc700 1 --2- 172.21.15.81:0/2581736358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266415a2e0 0x7f26640a7f30 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f264c00e8d0 tx=0x7f264c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:50.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.402+0000 7f265b7fe700 1 -- 172.21.15.81:0/2581736358 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c013410 con 0x7f266415a2e0 2023-10-07T08:48:50.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.402+0000 7f265b7fe700 1 -- 172.21.15.81:0/2581736358 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c013570 con 0x7f266415a2e0 2023-10-07T08:48:50.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.402+0000 7f265b7fe700 1 -- 172.21.15.81:0/2581736358 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c013910 con 0x7f266415a2e0 2023-10-07T08:48:50.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.402+0000 7f2663fff700 1 -- 172.21.15.81:0/2581736358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2664158430 con 0x7f266415a2e0 2023-10-07T08:48:50.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.402+0000 7f2663fff700 1 -- 172.21.15.81:0/2581736358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26640a8740 con 0x7f266415a2e0 2023-10-07T08:48:50.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.403+0000 7f2663fff700 1 -- 172.21.15.81:0/2581736358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26640b4510 con 0x7f266415a2e0 2023-10-07T08:48:50.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.403+0000 7f265b7fe700 1 -- 172.21.15.81:0/2581736358 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f264c013d40 con 0x7f266415a2e0 2023-10-07T08:48:50.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.404+0000 7f265b7fe700 1 --2- 172.21.15.81:0/2581736358 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2644066f30 0x7f26440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.404+0000 7f265b7fe700 1 -- 172.21.15.81:0/2581736358 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f264c084280 con 0x7f266415a2e0 2023-10-07T08:48:50.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.404+0000 7f2662ffd700 1 --2- 172.21.15.81:0/2581736358 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2644066f30 0x7f26440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.404+0000 7f2662ffd700 1 --2- 172.21.15.81:0/2581736358 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2644066f30 0x7f26440693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f26540099b0 tx=0x7f2654017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:50.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.408+0000 7f265b7fe700 1 -- 172.21.15.81:0/2581736358 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f264c0514f0 con 0x7f266415a2e0 2023-10-07T08:48:50.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.664+0000 7f2663fff700 1 -- 172.21.15.81:0/2581736358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f266406dd10 con 0x7f266415a2e0 2023-10-07T08:48:50.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.670+0000 7f265b7fe700 1 -- 172.21.15.81:0/2581736358 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f264c054b10 con 0x7f266415a2e0 2023-10-07T08:48:50.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.672+0000 7f2663fff700 1 -- 172.21.15.81:0/2581736358 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2644066f30 msgr2=0x7f26440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:50.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.672+0000 7f2663fff700 1 --2- 172.21.15.81:0/2581736358 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2644066f30 0x7f26440693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f26540099b0 tx=0x7f2654017000 comp rx=0 tx=0).stop 2023-10-07T08:48:50.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.672+0000 7f2663fff700 1 -- 172.21.15.81:0/2581736358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266415a2e0 msgr2=0x7f26640a7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:50.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.672+0000 7f2663fff700 1 --2- 172.21.15.81:0/2581736358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266415a2e0 0x7f26640a7f30 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f264c00e8d0 tx=0x7f264c008040 comp rx=0 tx=0).stop 2023-10-07T08:48:50.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.672+0000 7f2663fff700 1 -- 172.21.15.81:0/2581736358 shutdown_connections 2023-10-07T08:48:50.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.672+0000 7f2663fff700 1 --2- 172.21.15.81:0/2581736358 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2644066f30 0x7f26440693e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.672+0000 7f2663fff700 1 --2- 172.21.15.81:0/2581736358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f266415d0a0 0x7f266416a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.672+0000 7f2663fff700 1 --2- 172.21.15.81:0/2581736358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f266406e940 0x7f2664157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.672+0000 7f2663fff700 1 --2- 172.21.15.81:0/2581736358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266415a2e0 0x7f26640a7f30 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.672+0000 7f2663fff700 1 -- 172.21.15.81:0/2581736358 >> 172.21.15.81:0/2581736358 conn(0x7f26640680b0 msgr2=0x7f266406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.672+0000 7f2663fff700 1 -- 172.21.15.81:0/2581736358 shutdown_connections 2023-10-07T08:48:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.672+0000 7f2663fff700 1 -- 172.21.15.81:0/2581736358 wait complete. 2023-10-07T08:48:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-07T08:48:50.686 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:48:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.798+0000 7f795ade4700 1 Processor -- start 2023-10-07T08:48:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.798+0000 7f795ade4700 1 -- start start 2023-10-07T08:48:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.798+0000 7f795ade4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f795415a2a0 0x7f79540b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.798+0000 7f795ade4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f795406dd60 0x7f79540cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.798+0000 7f795ade4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79540cf4e0 con 0x7f79540ceb30 2023-10-07T08:48:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.798+0000 7f795ade4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795406ea90 con 0x7f795406dd60 2023-10-07T08:48:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.798+0000 7f795ade4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79540b0ca0 con 0x7f795415a2a0 2023-10-07T08:48:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.799+0000 7f7953fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f79540ceb30 0x7f795406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46552/0 (socket says 172.21.15.81:46552) 2023-10-07T08:48:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.798+0000 7f7959381700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f795406dd60 0x7f79540cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.799+0000 7f7953fff700 1 -- 172.21.15.81:0/4281621891 learned_addr learned my addr 172.21.15.81:0/4281621891 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.799+0000 7f7958b80700 1 --2- 172.21.15.81:0/4281621891 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f795415a2a0 0x7f79540b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.799+0000 7f7959381700 1 -- 172.21.15.81:0/4281621891 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f795415a2a0 msgr2=0x7f79540b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.799+0000 7f7959381700 1 --2- 172.21.15.81:0/4281621891 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f795415a2a0 0x7f79540b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.799+0000 7f7959381700 1 -- 172.21.15.81:0/4281621891 >> v1:172.21.15.81:6789/0 conn(0x7f79540ceb30 legacy=0x7f795406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.799+0000 7f79537fe700 1 -- 172.21.15.81:0/4281621891 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864142538 0 0) 0x7f79540cf4e0 con 0x7f79540ceb30 2023-10-07T08:48:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.799+0000 7f7959381700 1 -- 172.21.15.81:0/4281621891 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79540b00d0 con 0x7f795406dd60 2023-10-07T08:48:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.799+0000 7f7959381700 1 --2- 172.21.15.81:0/4281621891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f795406dd60 0x7f79540cefa0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f794c009e60 tx=0x7f794c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bc6ff7b3c6be50 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.799+0000 7f79537fe700 1 -- 172.21.15.81:0/4281621891 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c00e070 con 0x7f795406dd60 2023-10-07T08:48:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.799+0000 7f79537fe700 1 -- 172.21.15.81:0/4281621891 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c00bc30 con 0x7f795406dd60 2023-10-07T08:48:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.799+0000 7f79537fe700 1 -- 172.21.15.81:0/4281621891 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c012430 con 0x7f795406dd60 2023-10-07T08:48:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.800+0000 7f795ade4700 1 -- 172.21.15.81:0/4281621891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f795406dd60 msgr2=0x7f79540cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.800+0000 7f795ade4700 1 --2- 172.21.15.81:0/4281621891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f795406dd60 0x7f79540cefa0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f794c009e60 tx=0x7f794c009780 comp rx=0 tx=0).stop 2023-10-07T08:48:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.800+0000 7f795ade4700 1 -- 172.21.15.81:0/4281621891 shutdown_connections 2023-10-07T08:48:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.800+0000 7f795ade4700 1 --2- 172.21.15.81:0/4281621891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f795406dd60 0x7f79540cefa0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.800+0000 7f795ade4700 1 --2- 172.21.15.81:0/4281621891 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f795415a2a0 0x7f79540b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.800+0000 7f795ade4700 1 -- 172.21.15.81:0/4281621891 >> 172.21.15.81:0/4281621891 conn(0x7f7954067640 msgr2=0x7f7954067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.800+0000 7f795ade4700 1 -- 172.21.15.81:0/4281621891 shutdown_connections 2023-10-07T08:48:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.800+0000 7f795ade4700 1 -- 172.21.15.81:0/4281621891 wait complete. 2023-10-07T08:48:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.801+0000 7f795ade4700 1 Processor -- start 2023-10-07T08:48:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.801+0000 7f795ade4700 1 -- start start 2023-10-07T08:48:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f795ade4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f795406dd60 0x7f79540c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f795ade4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79540ceb30 0x7f795415ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f795ade4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f795415a2a0 0x7f79540cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f795ade4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795415dde0 con 0x7f79540ceb30 2023-10-07T08:48:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f795ade4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795415cf50 con 0x7f795415a2a0 2023-10-07T08:48:50.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f795ade4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795415d1d0 con 0x7f795406dd60 2023-10-07T08:48:50.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f7953fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79540ceb30 0x7f795415ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f7953fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79540ceb30 0x7f795415ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44904/0 (socket says 172.21.15.81:44904) 2023-10-07T08:48:50.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f7953fff700 1 -- 172.21.15.81:0/2003023514 learned_addr learned my addr 172.21.15.81:0/2003023514 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:50.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f7958b80700 1 --2- 172.21.15.81:0/2003023514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f795406dd60 0x7f79540c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f7959381700 1 --2- 172.21.15.81:0/2003023514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f795415a2a0 0x7f79540cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f7953fff700 1 -- 172.21.15.81:0/2003023514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f795406dd60 msgr2=0x7f79540c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:50.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f7953fff700 1 --2- 172.21.15.81:0/2003023514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f795406dd60 0x7f79540c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f7953fff700 1 -- 172.21.15.81:0/2003023514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f795415a2a0 msgr2=0x7f79540cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:50.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f7953fff700 1 --2- 172.21.15.81:0/2003023514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f795415a2a0 0x7f79540cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:50.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f7953fff700 1 -- 172.21.15.81:0/2003023514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c009a20 con 0x7f79540ceb30 2023-10-07T08:48:50.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f7953fff700 1 --2- 172.21.15.81:0/2003023514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79540ceb30 0x7f795415ca10 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f793c00c7e0 tx=0x7f793c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f7950ff9700 1 -- 172.21.15.81:0/2003023514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c005b30 con 0x7f79540ceb30 2023-10-07T08:48:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f7950ff9700 1 -- 172.21.15.81:0/2003023514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c005c90 con 0x7f79540ceb30 2023-10-07T08:48:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f795ade4700 1 -- 172.21.15.81:0/2003023514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795415d4b0 con 0x7f79540ceb30 2023-10-07T08:48:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f7950ff9700 1 -- 172.21.15.81:0/2003023514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c007300 con 0x7f79540ceb30 2023-10-07T08:48:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.802+0000 7f795ade4700 1 -- 172.21.15.81:0/2003023514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795415da70 con 0x7f79540ceb30 2023-10-07T08:48:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.803+0000 7f795ade4700 1 -- 172.21.15.81:0/2003023514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7954069e40 con 0x7f79540ceb30 2023-10-07T08:48:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.804+0000 7f7950ff9700 1 -- 172.21.15.81:0/2003023514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f793c01b400 con 0x7f79540ceb30 2023-10-07T08:48:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.804+0000 7f7950ff9700 1 --2- 172.21.15.81:0/2003023514 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7934066f30 0x7f79340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.804+0000 7f7950ff9700 1 -- 172.21.15.81:0/2003023514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f793c084060 con 0x7f79540ceb30 2023-10-07T08:48:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.804+0000 7f7958b80700 1 --2- 172.21.15.81:0/2003023514 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7934066f30 0x7f79340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.804+0000 7f7958b80700 1 --2- 172.21.15.81:0/2003023514 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7934066f30 0x7f79340693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7944006fd0 tx=0x7f7944008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:50.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:50.808+0000 7f7950ff9700 1 -- 172.21.15.81:0/2003023514 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f793c054de0 con 0x7f79540ceb30 2023-10-07T08:48:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.034+0000 7f795ade4700 1 -- 172.21.15.81:0/2003023514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7954158070 con 0x7f79540ceb30 2023-10-07T08:48:51.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.035+0000 7f7950ff9700 1 -- 172.21.15.81:0/2003023514 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f793c054970 con 0x7f79540ceb30 2023-10-07T08:48:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:51.036 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/2384735966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2384735966},{"type":"v1","addr":"172.21.15.89:6834","nonce":2384735966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1456306972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1456306972},{"type":"v1","addr":"172.21.15.89:6835","nonce":1456306972}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3356050793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3356050793},{"type":"v1","addr":"172.21.15.81:6836","nonce":3356050793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:48:40.667880+0000","modified":"2023-10-07T08:48:44.308458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6741":{"gid":6741,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2231384962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2231384962},{"type":"v1","addr":"172.21.15.81:6837","nonce":2231384962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-07T08:48:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.037+0000 7f795ade4700 1 -- 172.21.15.81:0/2003023514 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7934066f30 msgr2=0x7f79340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.037+0000 7f795ade4700 1 --2- 172.21.15.81:0/2003023514 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7934066f30 0x7f79340693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7944006fd0 tx=0x7f7944008040 comp rx=0 tx=0).stop 2023-10-07T08:48:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.037+0000 7f795ade4700 1 -- 172.21.15.81:0/2003023514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79540ceb30 msgr2=0x7f795415ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.037+0000 7f795ade4700 1 --2- 172.21.15.81:0/2003023514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79540ceb30 0x7f795415ca10 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f793c00c7e0 tx=0x7f793c007df0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.037+0000 7f795ade4700 1 -- 172.21.15.81:0/2003023514 shutdown_connections 2023-10-07T08:48:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.037+0000 7f795ade4700 1 --2- 172.21.15.81:0/2003023514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f795415a2a0 0x7f79540cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.037+0000 7f795ade4700 1 --2- 172.21.15.81:0/2003023514 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7934066f30 0x7f79340693e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.037+0000 7f795ade4700 1 --2- 172.21.15.81:0/2003023514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f795406dd60 0x7f79540c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.037+0000 7f795ade4700 1 --2- 172.21.15.81:0/2003023514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79540ceb30 0x7f795415ca10 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.037+0000 7f795ade4700 1 -- 172.21.15.81:0/2003023514 >> 172.21.15.81:0/2003023514 conn(0x7f7954067640 msgr2=0x7f79541578a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.037+0000 7f795ade4700 1 -- 172.21.15.81:0/2003023514 shutdown_connections 2023-10-07T08:48:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.037+0000 7f795ade4700 1 -- 172.21.15.81:0/2003023514 wait complete. 2023-10-07T08:48:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 58 2023-10-07T08:48:51.452 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T08:48:40.667880+0000', 'modified': '2023-10-07T08:48:44.308458+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6741}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6741': {'gid': 6741, 'name': 'c', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/2231384962', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 2231384962}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2231384962}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T08:48:51.452 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T08:48:51.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-07T08:48:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.568+0000 7f6ab31ad700 1 Processor -- start 2023-10-07T08:48:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.568+0000 7f6ab31ad700 1 -- start start 2023-10-07T08:48:51.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.569+0000 7f6ab31ad700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6aac1578d0 0x7f6aac0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.569+0000 7f6ab31ad700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6aac157ca0 0x7f6aac15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.569+0000 7f6ab31ad700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aac0d07c0 con 0x7f6aac06d120 2023-10-07T08:48:51.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.569+0000 7f6ab31ad700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aac0cfbb0 con 0x7f6aac157ca0 2023-10-07T08:48:51.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.569+0000 7f6ab31ad700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aac0cfe90 con 0x7f6aac1578d0 2023-10-07T08:48:51.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.569+0000 7f6aa3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6aac157ca0 0x7f6aac15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.569+0000 7f6ab174a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6aac06d120 0x7f6aac06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46564/0 (socket says 172.21.15.81:46564) 2023-10-07T08:48:51.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.569+0000 7f6ab174a700 1 -- 172.21.15.81:0/3809055739 learned_addr learned my addr 172.21.15.81:0/3809055739 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:51.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.569+0000 7f6ab0f49700 1 --2- 172.21.15.81:0/3809055739 >> v2:172.21.15.89:3300/0 conn(0x7f6aac1578d0 0x7f6aac0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6aa3fff700 1 -- 172.21.15.81:0/3809055739 >> v2:172.21.15.89:3300/0 conn(0x7f6aac1578d0 msgr2=0x7f6aac0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6aa3fff700 1 --2- 172.21.15.81:0/3809055739 >> v2:172.21.15.89:3300/0 conn(0x7f6aac1578d0 0x7f6aac0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6aa3fff700 1 -- 172.21.15.81:0/3809055739 >> v1:172.21.15.81:6789/0 conn(0x7f6aac06d120 legacy=0x7f6aac06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6aa3fff700 1 -- 172.21.15.81:0/3809055739 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac0d0170 con 0x7f6aac157ca0 2023-10-07T08:48:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6aa37fe700 1 -- 172.21.15.81:0/3809055739 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206406077 0 0) 0x7f6aac0d07c0 con 0x7f6aac06d120 2023-10-07T08:48:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6ab0f49700 1 --2- 172.21.15.81:0/3809055739 >> v2:172.21.15.89:3300/0 conn(0x7f6aac1578d0 0x7f6aac0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6aa3fff700 1 --2- 172.21.15.81:0/3809055739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aac157ca0 0x7f6aac15af00 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0646b0 tx=0x7f6a9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964c2fa26e68522f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6aa37fe700 1 -- 172.21.15.81:0/3809055739 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00b6b0 con 0x7f6aac157ca0 2023-10-07T08:48:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6aa37fe700 1 -- 172.21.15.81:0/3809055739 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c00b810 con 0x7f6aac157ca0 2023-10-07T08:48:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6aa37fe700 1 -- 172.21.15.81:0/3809055739 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00bbb0 con 0x7f6aac157ca0 2023-10-07T08:48:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6ab31ad700 1 -- 172.21.15.81:0/3809055739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aac157ca0 msgr2=0x7f6aac15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6ab31ad700 1 --2- 172.21.15.81:0/3809055739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aac157ca0 0x7f6aac15af00 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0646b0 tx=0x7f6a9c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6ab31ad700 1 -- 172.21.15.81:0/3809055739 shutdown_connections 2023-10-07T08:48:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6ab31ad700 1 --2- 172.21.15.81:0/3809055739 >> v2:172.21.15.89:3300/0 conn(0x7f6aac1578d0 0x7f6aac0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6ab31ad700 1 --2- 172.21.15.81:0/3809055739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aac157ca0 0x7f6aac15af00 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6ab31ad700 1 -- 172.21.15.81:0/3809055739 >> 172.21.15.81:0/3809055739 conn(0x7f6aac06bb90 msgr2=0x7f6aac06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6ab31ad700 1 -- 172.21.15.81:0/3809055739 shutdown_connections 2023-10-07T08:48:51.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.570+0000 7f6ab31ad700 1 -- 172.21.15.81:0/3809055739 wait complete. 2023-10-07T08:48:51.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.572+0000 7f6ab31ad700 1 Processor -- start 2023-10-07T08:48:51.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.572+0000 7f6ab31ad700 1 -- start start 2023-10-07T08:48:51.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.572+0000 7f6ab31ad700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aac06d120 0x7f6aac16e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.572+0000 7f6ab31ad700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aac1578d0 0x7f6aac0ad100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.572+0000 7f6ab31ad700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6aac157ca0 0x7f6aac16cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.572+0000 7f6ab31ad700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac0ae4f0 con 0x7f6aac06d120 2023-10-07T08:48:51.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.572+0000 7f6ab31ad700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac0ad640 con 0x7f6aac1578d0 2023-10-07T08:48:51.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.572+0000 7f6ab31ad700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac0ad8e0 con 0x7f6aac157ca0 2023-10-07T08:48:51.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.573+0000 7f6ab0f49700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aac06d120 0x7f6aac16e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.573+0000 7f6ab0f49700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aac06d120 0x7f6aac16e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44928/0 (socket says 172.21.15.81:44928) 2023-10-07T08:48:51.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.573+0000 7f6ab0f49700 1 -- 172.21.15.81:0/182385217 learned_addr learned my addr 172.21.15.81:0/182385217 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:51.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.573+0000 7f6ab174a700 1 --2- 172.21.15.81:0/182385217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6aac157ca0 0x7f6aac16cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.573+0000 7f6aa3fff700 1 --2- 172.21.15.81:0/182385217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aac1578d0 0x7f6aac0ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.573+0000 7f6ab0f49700 1 -- 172.21.15.81:0/182385217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6aac157ca0 msgr2=0x7f6aac16cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:51.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.573+0000 7f6ab0f49700 1 --2- 172.21.15.81:0/182385217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6aac157ca0 0x7f6aac16cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.573+0000 7f6ab0f49700 1 -- 172.21.15.81:0/182385217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aac1578d0 msgr2=0x7f6aac0ad100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:51.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.573+0000 7f6ab0f49700 1 --2- 172.21.15.81:0/182385217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aac1578d0 0x7f6aac0ad100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.573+0000 7f6ab0f49700 1 -- 172.21.15.81:0/182385217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c009420 con 0x7f6aac06d120 2023-10-07T08:48:51.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.573+0000 7f6ab0f49700 1 --2- 172.21.15.81:0/182385217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aac06d120 0x7f6aac16e470 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f6aa800d1d0 tx=0x7f6aa8009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:51.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.573+0000 7f6aa0ff9700 1 -- 172.21.15.81:0/182385217 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa800de70 con 0x7f6aac06d120 2023-10-07T08:48:51.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.573+0000 7f6aa0ff9700 1 -- 172.21.15.81:0/182385217 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa800f040 con 0x7f6aac06d120 2023-10-07T08:48:51.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.573+0000 7f6ab31ad700 1 -- 172.21.15.81:0/182385217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aac0adbc0 con 0x7f6aac06d120 2023-10-07T08:48:51.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.573+0000 7f6aa0ff9700 1 -- 172.21.15.81:0/182385217 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8015670 con 0x7f6aac06d120 2023-10-07T08:48:51.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.573+0000 7f6ab31ad700 1 -- 172.21.15.81:0/182385217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aac0ae180 con 0x7f6aac06d120 2023-10-07T08:48:51.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.574+0000 7f6aa0ff9700 1 -- 172.21.15.81:0/182385217 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6aa8015a20 con 0x7f6aac06d120 2023-10-07T08:48:51.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.575+0000 7f6aa0ff9700 1 --2- 172.21.15.81:0/182385217 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a98066f30 0x7f6a980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.575+0000 7f6aa0ff9700 1 -- 172.21.15.81:0/182385217 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6aa8084aa0 con 0x7f6aac06d120 2023-10-07T08:48:51.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.575+0000 7f6aa3fff700 1 --2- 172.21.15.81:0/182385217 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a98066f30 0x7f6a980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.575+0000 7f6aa3fff700 1 --2- 172.21.15.81:0/182385217 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a98066f30 0x7f6a980693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6aac1580c0 tx=0x7f6a9c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:51.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.577+0000 7f6abc4a5b80 1 Processor -- start 2023-10-07T08:48:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.577+0000 7f6abc4a5b80 1 -- start start 2023-10-07T08:48:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.577+0000 7f6abc4a5b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051209a50 0x55c051209e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.577+0000 7f6abc4a5b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051253d00 0x55c051232a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.577+0000 7f6abc4a5b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051232f60 0x55c051205cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6abc4a5b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c051160a70 con 0x55c051253d00 2023-10-07T08:48:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6abc4a5b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05115e270 con 0x55c051232f60 2023-10-07T08:48:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6abc4a5b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c05115a060 con 0x55c051209a50 2023-10-07T08:48:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6aa3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051253d00 0x55c051232a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6aa3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051253d00 0x55c051232a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44932/0 (socket says 172.21.15.81:44932) 2023-10-07T08:48:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6aa3fff700 1 -- 172.21.15.81:0/3180959229 learned_addr learned my addr 172.21.15.81:0/3180959229 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6ab0f49700 1 --2- 172.21.15.81:0/3180959229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051209a50 0x55c051209e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6ab174a700 1 --2- 172.21.15.81:0/3180959229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051232f60 0x55c051205cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6aa3fff700 1 -- 172.21.15.81:0/3180959229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051209a50 msgr2=0x55c051209e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6aa3fff700 1 --2- 172.21.15.81:0/3180959229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051209a50 0x55c051209e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6aa3fff700 1 -- 172.21.15.81:0/3180959229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051232f60 msgr2=0x55c051205cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6aa3fff700 1 --2- 172.21.15.81:0/3180959229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051232f60 0x55c051205cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6aa3fff700 1 -- 172.21.15.81:0/3180959229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c050ff4270 con 0x55c051253d00 2023-10-07T08:48:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6aa3fff700 1 --2- 172.21.15.81:0/3180959229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051253d00 0x55c051232a20 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00ba00 tx=0x7f6a9c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e54c900c778fb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6a91ffb700 1 -- 172.21.15.81:0/3180959229 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c020070 con 0x55c051253d00 2023-10-07T08:48:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6a91ffb700 1 -- 172.21.15.81:0/3180959229 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c029a40 con 0x55c051253d00 2023-10-07T08:48:51.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.578+0000 7f6a91ffb700 1 -- 172.21.15.81:0/3180959229 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c029bb0 con 0x55c051253d00 2023-10-07T08:48:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.579+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/3180959229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051253d00 msgr2=0x55c051232a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.579+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/3180959229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051253d00 0x55c051232a20 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00ba00 tx=0x7f6a9c020000 comp rx=0 tx=0).stop 2023-10-07T08:48:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.579+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/3180959229 shutdown_connections 2023-10-07T08:48:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.579+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/3180959229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051232f60 0x55c051205cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.579+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/3180959229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051209a50 0x55c051209e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.579+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/3180959229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051253d00 0x55c051232a20 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.579+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/3180959229 >> 172.21.15.81:0/3180959229 conn(0x55c05120b370 msgr2=0x55c05120b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.579+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/3180959229 shutdown_connections 2023-10-07T08:48:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.579+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/3180959229 wait complete. 2023-10-07T08:48:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.579+0000 7f6abc4a5b80 1 -- start start 2023-10-07T08:48:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.580+0000 7f6abc4a5b80 1 Processor -- start 2023-10-07T08:48:51.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.580+0000 7f6abc4a5b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051209a50 0x55c051260930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.580+0000 7f6abc4a5b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051232f60 0x55c051249e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.580+0000 7f6abc4a5b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051253d00 0x55c05124a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.580+0000 7f6abc4a5b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c051105890 con 0x55c051209a50 2023-10-07T08:48:51.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.580+0000 7f6abc4a5b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c051120ea0 con 0x55c051253d00 2023-10-07T08:48:51.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.580+0000 7f6abc4a5b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c050fdce30 con 0x55c051232f60 2023-10-07T08:48:51.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.580+0000 7f6abc4a5b80 10 client.0 _ll_register_callbacks cb 0x55c0511cd110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:48:51.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6ab0f49700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051209a50 0x55c051260930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6ab0f49700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051209a50 0x55c051260930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44940/0 (socket says 172.21.15.81:44940) 2023-10-07T08:48:51.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6ab0f49700 1 -- 172.21.15.81:0/3450144743 learned_addr learned my addr 172.21.15.81:0/3450144743 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:51.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6aa3fff700 1 --2- 172.21.15.81:0/3450144743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051232f60 0x55c051249e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6ab174a700 1 --2- 172.21.15.81:0/3450144743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051253d00 0x55c05124a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6ab0f49700 1 -- 172.21.15.81:0/3450144743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051232f60 msgr2=0x55c051249e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:51.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6ab0f49700 1 --2- 172.21.15.81:0/3450144743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051232f60 0x55c051249e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6ab0f49700 1 -- 172.21.15.81:0/3450144743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051253d00 msgr2=0x55c05124a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:51.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6ab0f49700 1 --2- 172.21.15.81:0/3450144743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051253d00 0x55c05124a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6ab0f49700 1 -- 172.21.15.81:0/3450144743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aac0d0170 con 0x55c051209a50 2023-10-07T08:48:51.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6ab174a700 1 --2- 172.21.15.81:0/3450144743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051253d00 0x55c05124a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6ab0f49700 1 --2- 172.21.15.81:0/3450144743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051209a50 0x55c051260930 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8051ee0 tx=0x7f6aa8082e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6b38c9a10f3c26 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6a8affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:48:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6a8affd700 1 -- 172.21.15.81:0/3450144743 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8053e60 con 0x55c051209a50 2023-10-07T08:48:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6a8affd700 1 -- 172.21.15.81:0/3450144743 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6aa8055e50 con 0x55c051209a50 2023-10-07T08:48:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/3450144743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0511feb70 con 0x55c051209a50 2023-10-07T08:48:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6a8affd700 1 -- 172.21.15.81:0/3450144743 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6aa80550e0 con 0x55c051209a50 2023-10-07T08:48:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6abc4a5b80 10 client.6918 fetch_fsmap learned FSMap version 58 2023-10-07T08:48:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/3450144743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55c050f96fe0 con 0x55c051209a50 2023-10-07T08:48:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6a8affd700 1 -- 172.21.15.81:0/3450144743 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa8060020 con 0x55c051209a50 2023-10-07T08:48:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.581+0000 7f6a8affd700 1 -- 172.21.15.81:0/3450144743 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 58) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6aa805c440 con 0x55c051209a50 2023-10-07T08:48:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.582+0000 7f6abc4a5b80 10 client.6918 fetch_fsmap finished waiting for FSMap version 58 2023-10-07T08:48:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.582+0000 7f6abc4a5b80 10 client.6918 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-07T08:48:51.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.582+0000 7f6abc4a5b80 20 client.6918 populate_metadata read hostname 'smithi081' 2023-10-07T08:48:51.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.582+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/3450144743 >> [v2:172.21.15.81:6835/2231384962,v1:172.21.15.81:6837/2231384962] conn(0x55c05124bc80 0x55c05126d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.582+0000 7f6abc4a5b80 4 client.6918 mds_command: new command op to 6741 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T08:48:51.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.582+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/3450144743 --> [v2:172.21.15.81:6835/2231384962,v1:172.21.15.81:6837/2231384962] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0511dbaa0 con 0x55c05124bc80 2023-10-07T08:48:51.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.582+0000 7f6aa3fff700 1 --2- 172.21.15.81:0/3450144743 >> [v2:172.21.15.81:6835/2231384962,v1:172.21.15.81:6837/2231384962] conn(0x55c05124bc80 0x55c05126d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.582+0000 7f6aa3fff700 1 --2- 172.21.15.81:0/3450144743 >> [v2:172.21.15.81:6835/2231384962,v1:172.21.15.81:6837/2231384962] conn(0x55c05124bc80 0x55c05126d7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70efe35266aca970 server_cookie=d5847a1882ca886 in_seq=0 out_seq=0 2023-10-07T08:48:51.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.582+0000 7f6a8affd700 10 client.6918 ms_handle_connect on v2:172.21.15.81:6835/2231384962 2023-10-07T08:48:51.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.582+0000 7f6a8affd700 1 -- 172.21.15.81:0/3450144743 <== mds.0 v2:172.21.15.81:6835/2231384962 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c0511dbaa0 con 0x55c05124bc80 2023-10-07T08:48:51.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.582+0000 7f6a8affd700 10 client.6918 handle_command_reply: tid=0 2023-10-07T08:48:51.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.582+0000 7f6abc4a5b80 1 client.6918 shutdown 2023-10-07T08:48:51.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.583+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/3450144743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051209a50 msgr2=0x55c051260930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:51.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.583+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/3450144743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051209a50 0x55c051260930 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8051ee0 tx=0x7f6aa8082e80 comp rx=0 tx=0).stop 2023-10-07T08:48:51.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.583+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/3450144743 shutdown_connections 2023-10-07T08:48:51.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.583+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/3450144743 >> [v2:172.21.15.81:6835/2231384962,v1:172.21.15.81:6837/2231384962] conn(0x55c05124bc80 0x55c05126d7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.583+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/3450144743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051253d00 0x55c05124a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.583+0000 7f6a8affd700 0 client.6918 ms_handle_reset on v2:172.21.15.81:6835/2231384962 2023-10-07T08:48:51.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.583+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/3450144743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051209a50 0x55c051260930 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.583+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/3450144743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051232f60 0x55c051249e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.583+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/3450144743 >> 172.21.15.81:0/3450144743 conn(0x55c05120b370 msgr2=0x55c051206980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:51.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.583+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/3450144743 shutdown_connections 2023-10-07T08:48:51.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.583+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/3450144743 wait complete. 2023-10-07T08:48:51.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.583+0000 7f6abc4a5b80 20 client.6918 trim_cache size 0 max 16384 2023-10-07T08:48:51.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.599+0000 7f6abc4a5b80 1 Processor -- start 2023-10-07T08:48:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.599+0000 7f6abc4a5b80 1 -- start start 2023-10-07T08:48:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.600+0000 7f6abc4a5b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051209a50 0x55c051231a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.600+0000 7f6abc4a5b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051232f60 0x55c051249c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.600+0000 7f6abc4a5b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051253d00 0x55c05124a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.600+0000 7f6abc4a5b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c051252760 con 0x55c051232f60 2023-10-07T08:48:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.600+0000 7f6abc4a5b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0511fe8e0 con 0x55c051209a50 2023-10-07T08:48:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.600+0000 7f6abc4a5b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0512045a0 con 0x55c051253d00 2023-10-07T08:48:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.600+0000 7f6aa3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051232f60 0x55c051249c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.600+0000 7f6aa3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051232f60 0x55c051249c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44948/0 (socket says 172.21.15.81:44948) 2023-10-07T08:48:51.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.600+0000 7f6aa3fff700 1 -- 172.21.15.81:0/186296886 learned_addr learned my addr 172.21.15.81:0/186296886 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:51.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.600+0000 7f6aa3fff700 1 -- 172.21.15.81:0/186296886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051253d00 msgr2=0x55c05124a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:51.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.600+0000 7f6aa3fff700 1 --2- 172.21.15.81:0/186296886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051253d00 0x55c05124a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.600+0000 7f6aa3fff700 1 -- 172.21.15.81:0/186296886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051209a50 msgr2=0x55c051231a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:51.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.600+0000 7f6aa3fff700 1 --2- 172.21.15.81:0/186296886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051209a50 0x55c051231a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.600+0000 7f6aa3fff700 1 -- 172.21.15.81:0/186296886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c051128780 con 0x55c051232f60 2023-10-07T08:48:51.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.601+0000 7f6aa3fff700 1 --2- 172.21.15.81:0/186296886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051232f60 0x55c051249c30 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0030c0 tx=0x7f6a9c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb88262ae122df5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.601+0000 7f6a927fc700 1 -- 172.21.15.81:0/186296886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c044070 con 0x55c051232f60 2023-10-07T08:48:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.601+0000 7f6a927fc700 1 -- 172.21.15.81:0/186296886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c029bb0 con 0x55c051232f60 2023-10-07T08:48:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.601+0000 7f6a927fc700 1 -- 172.21.15.81:0/186296886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c020040 con 0x55c051232f60 2023-10-07T08:48:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.601+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/186296886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051232f60 msgr2=0x55c051249c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.601+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/186296886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051232f60 0x55c051249c30 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0030c0 tx=0x7f6a9c014000 comp rx=0 tx=0).stop 2023-10-07T08:48:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.601+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/186296886 shutdown_connections 2023-10-07T08:48:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.601+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/186296886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051253d00 0x55c05124a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.601+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/186296886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051209a50 0x55c051231a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.601+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/186296886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051232f60 0x55c051249c30 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.601+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/186296886 >> 172.21.15.81:0/186296886 conn(0x55c05120b370 msgr2=0x55c0512506b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.601+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/186296886 shutdown_connections 2023-10-07T08:48:51.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.601+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/186296886 wait complete. 2023-10-07T08:48:51.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.602+0000 7f6abc4a5b80 1 -- start start 2023-10-07T08:48:51.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.602+0000 7f6abc4a5b80 1 Processor -- start 2023-10-07T08:48:51.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6abc4a5b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051209a50 0x55c05124f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6abc4a5b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051232f60 0x55c05124f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6abc4a5b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051253d00 0x55c0512b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6abc4a5b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05124a340 con 0x55c051253d00 2023-10-07T08:48:51.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6abc4a5b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c051267d90 con 0x55c051232f60 2023-10-07T08:48:51.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6abc4a5b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c05124a540 con 0x55c051209a50 2023-10-07T08:48:51.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6abc4a5b80 10 client.0 _ll_register_callbacks cb 0x55c0511cd110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:48:51.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6ab174a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051253d00 0x55c0512b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6ab174a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051253d00 0x55c0512b6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44956/0 (socket says 172.21.15.81:44956) 2023-10-07T08:48:51.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6ab174a700 1 -- 172.21.15.81:0/2177351185 learned_addr learned my addr 172.21.15.81:0/2177351185 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:51.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6aa3fff700 1 --2- 172.21.15.81:0/2177351185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051232f60 0x55c05124f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6ab0f49700 1 --2- 172.21.15.81:0/2177351185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051209a50 0x55c05124f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6ab174a700 1 -- 172.21.15.81:0/2177351185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051209a50 msgr2=0x55c05124f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:51.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6ab174a700 1 --2- 172.21.15.81:0/2177351185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051209a50 0x55c05124f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6ab174a700 1 -- 172.21.15.81:0/2177351185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051232f60 msgr2=0x55c05124f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:51.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6ab174a700 1 --2- 172.21.15.81:0/2177351185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051232f60 0x55c05124f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6ab174a700 1 -- 172.21.15.81:0/2177351185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c050ff4270 con 0x55c051253d00 2023-10-07T08:48:51.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6ab174a700 1 --2- 172.21.15.81:0/2177351185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051253d00 0x55c0512b6b30 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40011e0 tx=0x7f6aa4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70cdb46b5ecae587 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:51.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6a8affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:48:51.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6a8affd700 1 -- 172.21.15.81:0/2177351185 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa401b030 con 0x55c051253d00 2023-10-07T08:48:51.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6a8affd700 1 -- 172.21.15.81:0/2177351185 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6aa401c070 con 0x55c051253d00 2023-10-07T08:48:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.603+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/2177351185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a9c029a40 con 0x55c051253d00 2023-10-07T08:48:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6a8affd700 1 -- 172.21.15.81:0/2177351185 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6aa4007720 con 0x55c051253d00 2023-10-07T08:48:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6abc4a5b80 10 client.6924 fetch_fsmap learned FSMap version 58 2023-10-07T08:48:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/2177351185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55c05110f470 con 0x55c051253d00 2023-10-07T08:48:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6a8affd700 1 -- 172.21.15.81:0/2177351185 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa4026020 con 0x55c051253d00 2023-10-07T08:48:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6a8affd700 1 -- 172.21.15.81:0/2177351185 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 58) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6aa4004830 con 0x55c051253d00 2023-10-07T08:48:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6abc4a5b80 10 client.6924 fetch_fsmap finished waiting for FSMap version 58 2023-10-07T08:48:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6abc4a5b80 10 client.6924 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-07T08:48:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6abc4a5b80 20 client.6924 populate_metadata read hostname 'smithi081' 2023-10-07T08:48:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/2177351185 >> [v2:172.21.15.81:6835/2231384962,v1:172.21.15.81:6837/2231384962] conn(0x55c0512b70e0 0x55c05124ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6abc4a5b80 4 client.6924 mds_command: new command op to 6741 tid=0[{"prefix": "status"}] 2023-10-07T08:48:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/2177351185 --> [v2:172.21.15.81:6835/2231384962,v1:172.21.15.81:6837/2231384962] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c0510fce00 con 0x55c0512b70e0 2023-10-07T08:48:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6ab0f49700 1 --2- 172.21.15.81:0/2177351185 >> [v2:172.21.15.81:6835/2231384962,v1:172.21.15.81:6837/2231384962] conn(0x55c0512b70e0 0x55c05124ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6a8affd700 10 client.6924 ms_handle_connect on v2:172.21.15.81:6835/2231384962 2023-10-07T08:48:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6ab0f49700 1 --2- 172.21.15.81:0/2177351185 >> [v2:172.21.15.81:6835/2231384962,v1:172.21.15.81:6837/2231384962] conn(0x55c0512b70e0 0x55c05124ce70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa1bfcac1e67220d server_cookie=5ed8ec446b9cc130 in_seq=0 out_seq=0 2023-10-07T08:48:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6a8affd700 1 -- 172.21.15.81:0/2177351185 <== mds.0 v2:172.21.15.81:6835/2231384962 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55c0510fce00 con 0x55c0512b70e0 2023-10-07T08:48:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6a8affd700 10 client.6924 handle_command_reply: tid=0 2023-10-07T08:48:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.604+0000 7f6abc4a5b80 1 client.6924 shutdown 2023-10-07T08:48:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/2177351185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051253d00 msgr2=0x55c0512b6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/2177351185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051253d00 0x55c0512b6b30 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40011e0 tx=0x7f6aa4009040 comp rx=0 tx=0).stop 2023-10-07T08:48:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/2177351185 shutdown_connections 2023-10-07T08:48:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/2177351185 >> [v2:172.21.15.81:6835/2231384962,v1:172.21.15.81:6837/2231384962] conn(0x55c0512b70e0 0x55c05124ce70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/2177351185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c051253d00 0x55c0512b6b30 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6a8affd700 0 client.6924 ms_handle_reset on v2:172.21.15.81:6835/2231384962 2023-10-07T08:48:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/2177351185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c051209a50 0x55c05124f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6abc4a5b80 1 --2- 172.21.15.81:0/2177351185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c051232f60 0x55c05124f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/2177351185 >> 172.21.15.81:0/2177351185 conn(0x55c05120b370 msgr2=0x55c051249c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:51.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/2177351185 shutdown_connections 2023-10-07T08:48:51.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6abc4a5b80 1 -- 172.21.15.81:0/2177351185 wait complete. 2023-10-07T08:48:51.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6abc4a5b80 20 client.6924 trim_cache size 0 max 16384 2023-10-07T08:48:51.654 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:48:51.654 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:48:51.654 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-07T08:48:51.655 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6741, 2023-10-07T08:48:51.655 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-07T08:48:51.655 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-07T08:48:51.655 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-07T08:48:51.655 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 10.320881642, 2023-10-07T08:48:51.655 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 58, 2023-10-07T08:48:51.655 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 123, 2023-10-07T08:48:51.655 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 123, 2023-10-07T08:48:51.655 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 15.876776402000001 2023-10-07T08:48:51.655 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:48:51.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6ab31ad700 1 -- 172.21.15.81:0/182385217 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a98066f30 msgr2=0x7f6a980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:51.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6ab31ad700 1 --2- 172.21.15.81:0/182385217 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a98066f30 0x7f6a980693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6aac1580c0 tx=0x7f6a9c017000 comp rx=0 tx=0).stop 2023-10-07T08:48:51.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6ab31ad700 1 -- 172.21.15.81:0/182385217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aac06d120 msgr2=0x7f6aac16e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:51.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6ab31ad700 1 --2- 172.21.15.81:0/182385217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aac06d120 0x7f6aac16e470 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f6aa800d1d0 tx=0x7f6aa8009a90 comp rx=0 tx=0).stop 2023-10-07T08:48:51.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6ab31ad700 1 -- 172.21.15.81:0/182385217 shutdown_connections 2023-10-07T08:48:51.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6ab31ad700 1 --2- 172.21.15.81:0/182385217 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6a98066f30 0x7f6a980693e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6ab31ad700 1 --2- 172.21.15.81:0/182385217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6aac157ca0 0x7f6aac16cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6ab31ad700 1 --2- 172.21.15.81:0/182385217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aac06d120 0x7f6aac16e470 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6ab31ad700 1 --2- 172.21.15.81:0/182385217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6aac1578d0 0x7f6aac0ad100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6ab31ad700 1 -- 172.21.15.81:0/182385217 >> 172.21.15.81:0/182385217 conn(0x7f6aac06bb90 msgr2=0x7f6aac06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:51.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.605+0000 7f6ab31ad700 1 -- 172.21.15.81:0/182385217 shutdown_connections 2023-10-07T08:48:51.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.606+0000 7f6ab31ad700 1 -- 172.21.15.81:0/182385217 wait complete. 2023-10-07T08:48:51.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:48:51.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.771+0000 7fbcbe6ac700 1 Processor -- start 2023-10-07T08:48:51.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.771+0000 7fbcbe6ac700 1 -- start start 2023-10-07T08:48:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.772+0000 7fbcbe6ac700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb8159b40 0x7fbcb80cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.772+0000 7fbcbe6ac700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbcb8068e90 0x7fbcb80cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.772+0000 7fbcbe6ac700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb80cee10 con 0x7fbcb8159f10 2023-10-07T08:48:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.772+0000 7fbcbe6ac700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb80cd040 con 0x7fbcb8068e90 2023-10-07T08:48:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.772+0000 7fbcbe6ac700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb80cd320 con 0x7fbcb8159b40 2023-10-07T08:48:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.772+0000 7fbcbd6aa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb8159b40 0x7fbcb80cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.772+0000 7fbcbdeab700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbcb8068e90 0x7fbcb80cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.772+0000 7fbcbcea9700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fbcb8159f10 0x7fbcb8068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:36774/0 (socket says 172.21.15.81:36774) 2023-10-07T08:48:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.772+0000 7fbcbcea9700 1 -- 172.21.15.81:0/4000663979 learned_addr learned my addr 172.21.15.81:0/4000663979 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.773+0000 7fbcaffff700 1 -- 172.21.15.81:0/4000663979 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233868055 0 0) 0x7fbcb80cee10 con 0x7fbcb8159f10 2023-10-07T08:48:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.773+0000 7fbcaffff700 1 -- 172.21.15.81:0/4000663979 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbca4003570 con 0x7fbcb8159f10 2023-10-07T08:48:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.773+0000 7fbcbdeab700 1 -- 172.21.15.81:0/4000663979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb8159b40 msgr2=0x7fbcb80cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.773+0000 7fbcbdeab700 1 --2- 172.21.15.81:0/4000663979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb8159b40 0x7fbcb80cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.773+0000 7fbcbdeab700 1 -- 172.21.15.81:0/4000663979 >> v1:172.21.15.89:6789/0 conn(0x7fbcb8159f10 legacy=0x7fbcb8068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.773+0000 7fbcbdeab700 1 -- 172.21.15.81:0/4000663979 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb80ce7c0 con 0x7fbcb8068e90 2023-10-07T08:48:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.773+0000 7fbcbd6aa700 1 --2- 172.21.15.81:0/4000663979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb8159b40 0x7fbcb80cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:48:51.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.773+0000 7fbcbdeab700 1 --2- 172.21.15.81:0/4000663979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8068e90 0x7fbcb80cf2a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00098e0 tx=0x7fbcb00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=946c1519b60ccb4e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.773+0000 7fbcaffff700 1 -- 172.21.15.81:0/4000663979 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0011630 con 0x7fbcb8068e90 2023-10-07T08:48:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.773+0000 7fbcaffff700 1 -- 172.21.15.81:0/4000663979 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb0011790 con 0x7fbcb8068e90 2023-10-07T08:48:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.773+0000 7fbcaffff700 1 -- 172.21.15.81:0/4000663979 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0011b10 con 0x7fbcb8068e90 2023-10-07T08:48:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.774+0000 7fbcbe6ac700 1 -- 172.21.15.81:0/4000663979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8068e90 msgr2=0x7fbcb80cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.774+0000 7fbcbe6ac700 1 --2- 172.21.15.81:0/4000663979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8068e90 0x7fbcb80cf2a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00098e0 tx=0x7fbcb00091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.774+0000 7fbcbe6ac700 1 -- 172.21.15.81:0/4000663979 shutdown_connections 2023-10-07T08:48:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.774+0000 7fbcbe6ac700 1 --2- 172.21.15.81:0/4000663979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8068e90 0x7fbcb80cf2a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.774+0000 7fbcbe6ac700 1 --2- 172.21.15.81:0/4000663979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb8159b40 0x7fbcb80cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.774+0000 7fbcbe6ac700 1 -- 172.21.15.81:0/4000663979 >> 172.21.15.81:0/4000663979 conn(0x7fbcb80cd660 msgr2=0x7fbcb80cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.774+0000 7fbcbe6ac700 1 -- 172.21.15.81:0/4000663979 shutdown_connections 2023-10-07T08:48:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.774+0000 7fbcbe6ac700 1 -- 172.21.15.81:0/4000663979 wait complete. 2023-10-07T08:48:51.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.775+0000 7fbcbe6ac700 1 Processor -- start 2023-10-07T08:48:51.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.775+0000 7fbcbe6ac700 1 -- start start 2023-10-07T08:48:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbe6ac700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb8068e90 0x7fbcb81475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbe6ac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcb8159b40 0x7fbcb80c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbe6ac700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8159f10 0x7fbcb80c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbe6ac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb80b61e0 con 0x7fbcb8159b40 2023-10-07T08:48:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbe6ac700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb80b3990 con 0x7fbcb8159f10 2023-10-07T08:48:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbe6ac700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb80c9220 con 0x7fbcb8068e90 2023-10-07T08:48:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbcea9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcb8159b40 0x7fbcb80c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbcea9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcb8159b40 0x7fbcb80c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44960/0 (socket says 172.21.15.81:44960) 2023-10-07T08:48:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbcea9700 1 -- 172.21.15.81:0/98283811 learned_addr learned my addr 172.21.15.81:0/98283811 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbdeab700 1 --2- 172.21.15.81:0/98283811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8159f10 0x7fbcb80c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbd6aa700 1 --2- 172.21.15.81:0/98283811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb8068e90 0x7fbcb81475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbcea9700 1 -- 172.21.15.81:0/98283811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb8068e90 msgr2=0x7fbcb81475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbcea9700 1 --2- 172.21.15.81:0/98283811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb8068e90 0x7fbcb81475f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbcea9700 1 -- 172.21.15.81:0/98283811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8159f10 msgr2=0x7fbcb80c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbcea9700 1 --2- 172.21.15.81:0/98283811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8159f10 0x7fbcb80c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbcea9700 1 -- 172.21.15.81:0/98283811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb4009a20 con 0x7fbcb8159b40 2023-10-07T08:48:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbdeab700 1 --2- 172.21.15.81:0/98283811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8159f10 0x7fbcb80c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbcea9700 1 --2- 172.21.15.81:0/98283811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcb8159b40 0x7fbcb80c8660 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fbca80011e0 tx=0x7fbca8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcad7fa700 1 -- 172.21.15.81:0/98283811 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8005b30 con 0x7fbcb8159b40 2023-10-07T08:48:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcad7fa700 1 -- 172.21.15.81:0/98283811 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca8005c90 con 0x7fbcb8159b40 2023-10-07T08:48:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcad7fa700 1 -- 172.21.15.81:0/98283811 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8007320 con 0x7fbcb8159b40 2023-10-07T08:48:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbe6ac700 1 -- 172.21.15.81:0/98283811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb0009420 con 0x7fbcb8159b40 2023-10-07T08:48:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.776+0000 7fbcbe6ac700 1 -- 172.21.15.81:0/98283811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb80b3c30 con 0x7fbcb8159b40 2023-10-07T08:48:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.777+0000 7fbcbe6ac700 1 -- 172.21.15.81:0/98283811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb8063e90 con 0x7fbcb8159b40 2023-10-07T08:48:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.778+0000 7fbcad7fa700 1 -- 172.21.15.81:0/98283811 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbca8007690 con 0x7fbcb8159b40 2023-10-07T08:48:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.778+0000 7fbcad7fa700 1 --2- 172.21.15.81:0/98283811 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbc9c066f30 0x7fbc9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.778+0000 7fbcad7fa700 1 -- 172.21.15.81:0/98283811 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbca8083a20 con 0x7fbcb8159b40 2023-10-07T08:48:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.778+0000 7fbcbd6aa700 1 --2- 172.21.15.81:0/98283811 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbc9c066f30 0x7fbc9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.779+0000 7fbcbd6aa700 1 --2- 172.21.15.81:0/98283811 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbc9c066f30 0x7fbc9c0693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40099f0 tx=0x7fbcb400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:51.782+0000 7fbcad7fa700 1 -- 172.21.15.81:0/98283811 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbca8050c90 con 0x7fbcb8159b40 2023-10-07T08:48:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.007+0000 7fbcbe6ac700 1 -- 172.21.15.81:0/98283811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbcb80ceaa0 con 0x7fbcb8159b40 2023-10-07T08:48:52.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.007+0000 7fbcad7fa700 1 -- 172.21.15.81:0/98283811 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbca8017020 con 0x7fbcb8159b40 2023-10-07T08:48:52.014 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:48:52.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.009+0000 7fbcbe6ac700 1 -- 172.21.15.81:0/98283811 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbc9c066f30 msgr2=0x7fbc9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:52.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.009+0000 7fbcbe6ac700 1 --2- 172.21.15.81:0/98283811 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbc9c066f30 0x7fbc9c0693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40099f0 tx=0x7fbcb400b040 comp rx=0 tx=0).stop 2023-10-07T08:48:52.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.009+0000 7fbcbe6ac700 1 -- 172.21.15.81:0/98283811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcb8159b40 msgr2=0x7fbcb80c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:52.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.009+0000 7fbcbe6ac700 1 --2- 172.21.15.81:0/98283811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcb8159b40 0x7fbcb80c8660 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fbca80011e0 tx=0x7fbca8007df0 comp rx=0 tx=0).stop 2023-10-07T08:48:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.009+0000 7fbcbe6ac700 1 -- 172.21.15.81:0/98283811 shutdown_connections 2023-10-07T08:48:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.009+0000 7fbcbe6ac700 1 --2- 172.21.15.81:0/98283811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8159f10 0x7fbcb80c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.009+0000 7fbcbe6ac700 1 --2- 172.21.15.81:0/98283811 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbc9c066f30 0x7fbc9c0693e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.009+0000 7fbcbe6ac700 1 --2- 172.21.15.81:0/98283811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb8068e90 0x7fbcb81475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.009+0000 7fbcbe6ac700 1 --2- 172.21.15.81:0/98283811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcb8159b40 0x7fbcb80c8660 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.009+0000 7fbcbe6ac700 1 -- 172.21.15.81:0/98283811 >> 172.21.15.81:0/98283811 conn(0x7fbcb80cd660 msgr2=0x7fbcb8158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.009+0000 7fbcbe6ac700 1 -- 172.21.15.81:0/98283811 shutdown_connections 2023-10-07T08:48:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.009+0000 7fbcbe6ac700 1 -- 172.21.15.81:0/98283811 wait complete. 2023-10-07T08:48:52.022 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:48:52.022 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:48:52.022 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-07T08:48:52.022 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T08:48:52.022 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T08:48:52.022 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:48:52.022 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:48:52.022 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:48:52.023 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:48:52.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:52.024 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-07T08:48:52.040 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:48:52.040 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:48:52.040 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:48:52.040 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:52.040 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-07T08:48:52.041 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:52.041 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:48:52.041 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:52.041 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-07T08:48:52.041 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:48:52.041 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:52.041 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-07T08:48:52.042 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:48:52.042 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:52.042 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:48:52.042 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:52.042 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:48:52.042 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42196sec preferred_lft 42196sec 2023-10-07T08:48:52.042 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-10-07T08:48:52.042 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:52.042 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:48:52.043 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:52.043 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:48:52.043 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:52.043 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::8c72:9ff:fe74:8c7e/64 scope link 2023-10-07T08:48:52.043 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:52.043 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:48:52.043 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:fe:81:9d:9c:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T08:48:52.043 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8fe:81ff:fe9d:9c0a/64 scope link 2023-10-07T08:48:52.043 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:52.043 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:48:52.044 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T08:48:52.044 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d838:b7ff:fe6e:914d/64 scope link 2023-10-07T08:48:52.044 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:52.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:52.044 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:48:52.103 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-07T08:48:52.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:52.105 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-07T08:48:52.162 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-07T08:48:52.162 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:48:52.162 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:48:52.162 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:48:52.162 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:48:52.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:52.163 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:48:52.163 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:48:52.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:48:52.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:48:52.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:48:52.164 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:48:52.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:52.262 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-07T08:48:52.276 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T08:48:52.276 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T08:48:52.277 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:48:52.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:52.277 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-07T08:48:52.341 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:48:52.341 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T08:48:52.396 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:48:52.396 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:48:52.396 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:48:52.451 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:48:52.451 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:48:52.451 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:48:52.531 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:48:52.531 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:48:52.531 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:48:52.539 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:48:52.540 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:48:52.540 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:48:52.540 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:48:52.540 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:48:52.561 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:48:52.561 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:48:52.562 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:48:52.562 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:48:52.562 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:48:52.562 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:48:52.562 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:48:52.562 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:48:52.563 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:48:52.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:52.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:48:52.628 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:48:52.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.781+0000 7f82db69a700 1 Processor -- start 2023-10-07T08:48:52.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.781+0000 7f82db69a700 1 -- start start 2023-10-07T08:48:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82db69a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f82d41578d0 0x7f82d40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82db69a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d40d07c0 con 0x7f82d4157ca0 2023-10-07T08:48:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82db69a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d40cfbb0 con 0x7f82d406d120 2023-10-07T08:48:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82db69a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d40cfe90 con 0x7f82d41578d0 2023-10-07T08:48:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82d8c35700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f82d4157ca0 0x7f82d415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34290/0 (socket says 172.21.15.81:34290) 2023-10-07T08:48:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82d8c35700 1 -- 172.21.15.81:0/1001657881 learned_addr learned my addr 172.21.15.81:0/1001657881 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82d9436700 1 --2- 172.21.15.81:0/1001657881 >> v2:172.21.15.89:3300/0 conn(0x7f82d41578d0 0x7f82d40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82cbfff700 1 -- 172.21.15.81:0/1001657881 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274536520 0 0) 0x7f82d40d07c0 con 0x7f82d4157ca0 2023-10-07T08:48:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82cbfff700 1 -- 172.21.15.81:0/1001657881 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82c0003570 con 0x7f82d4157ca0 2023-10-07T08:48:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82cbfff700 1 -- 172.21.15.81:0/1001657881 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3734399064 0 0) 0x7f82c0003570 con 0x7f82d4157ca0 2023-10-07T08:48:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82cbfff700 1 -- 172.21.15.81:0/1001657881 >> v2:172.21.15.89:3300/0 conn(0x7f82d41578d0 msgr2=0x7f82d40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82cbfff700 1 --2- 172.21.15.81:0/1001657881 >> v2:172.21.15.89:3300/0 conn(0x7f82d41578d0 0x7f82d40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82cbfff700 1 -- 172.21.15.81:0/1001657881 >> v1:172.21.15.89:6789/0 conn(0x7f82d406d120 legacy=0x7f82d406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82cbfff700 1 -- 172.21.15.81:0/1001657881 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d40d0170 con 0x7f82d4157ca0 2023-10-07T08:48:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82cbfff700 1 -- 172.21.15.81:0/1001657881 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f82c4001470 con 0x7f82d4157ca0 2023-10-07T08:48:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82cbfff700 1 -- 172.21.15.81:0/1001657881 >> v1:172.21.15.81:6789/0 conn(0x7f82d4157ca0 legacy=0x7f82d415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82cbfff700 1 --2- 172.21.15.81:0/1001657881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82c0003a60 0x7f82c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82cbfff700 1 --2- 172.21.15.81:0/1001657881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82c0004810 0x7f82c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.782+0000 7f82cbfff700 1 --2- 172.21.15.81:0/1001657881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82c00051c0 0x7f82c000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82cbfff700 1 -- 172.21.15.81:0/1001657881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d40cfe90 con 0x7f82c00051c0 2023-10-07T08:48:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82cbfff700 1 -- 172.21.15.81:0/1001657881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c000c0d0 con 0x7f82c0004810 2023-10-07T08:48:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82cbfff700 1 -- 172.21.15.81:0/1001657881 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c000c290 con 0x7f82c0003a60 2023-10-07T08:48:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82d9436700 1 --2- 172.21.15.81:0/1001657881 >> v2:172.21.15.89:3300/0 conn(0x7f82d41578d0 0x7f82d40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:48:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82d9c37700 1 --2- 172.21.15.81:0/1001657881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82c00051c0 0x7f82c000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82d8c35700 1 --2- 172.21.15.81:0/1001657881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82c0004810 0x7f82c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82d9436700 1 --2- 172.21.15.81:0/1001657881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82c0003a60 0x7f82c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:52.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82d9c37700 1 -- 172.21.15.81:0/1001657881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82c0003a60 msgr2=0x7f82c0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:52.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82d9c37700 1 --2- 172.21.15.81:0/1001657881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82c0003a60 0x7f82c0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:52.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82d9c37700 1 -- 172.21.15.81:0/1001657881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82c0004810 msgr2=0x7f82c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:52.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82d9c37700 1 --2- 172.21.15.81:0/1001657881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82c0004810 0x7f82c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:52.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82d9c37700 1 -- 172.21.15.81:0/1001657881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c0003570 con 0x7f82c00051c0 2023-10-07T08:48:52.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82d9c37700 1 -- 172.21.15.81:0/1001657881 reap_dead start 2023-10-07T08:48:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82d9c37700 1 --2- 172.21.15.81:0/1001657881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82c00051c0 0x7f82c000ba60 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f82cc001fc0 tx=0x7f82cc001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb3bf1a06c360dc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82cbfff700 1 -- 172.21.15.81:0/1001657881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc001950 con 0x7f82c00051c0 2023-10-07T08:48:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82cbfff700 1 -- 172.21.15.81:0/1001657881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc00c8b0 con 0x7f82c00051c0 2023-10-07T08:48:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.783+0000 7f82cbfff700 1 -- 172.21.15.81:0/1001657881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc00cc90 con 0x7f82c00051c0 2023-10-07T08:48:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.784+0000 7f82db69a700 1 -- 172.21.15.81:0/1001657881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82c00051c0 msgr2=0x7f82c000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.784+0000 7f82db69a700 1 --2- 172.21.15.81:0/1001657881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82c00051c0 0x7f82c000ba60 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f82cc001fc0 tx=0x7f82cc001640 comp rx=0 tx=0).stop 2023-10-07T08:48:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.784+0000 7f82db69a700 1 -- 172.21.15.81:0/1001657881 shutdown_connections 2023-10-07T08:48:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.784+0000 7f82db69a700 1 --2- 172.21.15.81:0/1001657881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82c00051c0 0x7f82c000ba60 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.784+0000 7f82db69a700 1 -- 172.21.15.81:0/1001657881 >> 172.21.15.81:0/1001657881 conn(0x7f82d406bb90 msgr2=0x7f82d406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.784+0000 7f82db69a700 1 -- 172.21.15.81:0/1001657881 shutdown_connections 2023-10-07T08:48:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.784+0000 7f82db69a700 1 -- 172.21.15.81:0/1001657881 wait complete. 2023-10-07T08:48:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.785+0000 7f82db69a700 1 Processor -- start 2023-10-07T08:48:52.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.785+0000 7f82db69a700 1 -- start start 2023-10-07T08:48:52.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82db69a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82c00051c0 0x7f82d41466d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:52.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82db69a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d40b4070 0x7f82d4069820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:52.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82db69a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d40b44e0 0x7f82d4069d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:52.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82db69a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d40b4aa0 con 0x7f82c00051c0 2023-10-07T08:48:52.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82db69a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d40b4d80 con 0x7f82d40b44e0 2023-10-07T08:48:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82db69a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d40b5060 con 0x7f82d40b4070 2023-10-07T08:48:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82d9436700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82c00051c0 0x7f82d41466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82d9436700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82c00051c0 0x7f82d41466d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52848/0 (socket says 172.21.15.81:52848) 2023-10-07T08:48:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82d9436700 1 -- 172.21.15.81:0/695193593 learned_addr learned my addr 172.21.15.81:0/695193593 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82d9c37700 1 --2- 172.21.15.81:0/695193593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d40b44e0 0x7f82d4069d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82d8c35700 1 --2- 172.21.15.81:0/695193593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d40b4070 0x7f82d4069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82d9436700 1 -- 172.21.15.81:0/695193593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d40b4070 msgr2=0x7f82d4069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82d9436700 1 --2- 172.21.15.81:0/695193593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d40b4070 0x7f82d4069820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82d9436700 1 -- 172.21.15.81:0/695193593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d40b44e0 msgr2=0x7f82d4069d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82d9436700 1 --2- 172.21.15.81:0/695193593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d40b44e0 0x7f82d4069d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82d9436700 1 -- 172.21.15.81:0/695193593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d40b5340 con 0x7f82c00051c0 2023-10-07T08:48:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82d9c37700 1 --2- 172.21.15.81:0/695193593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d40b44e0 0x7f82d4069d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82d9436700 1 --2- 172.21.15.81:0/695193593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82c00051c0 0x7f82d41466d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f82d0011960 tx=0x7f82d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82c97fa700 1 -- 172.21.15.81:0/695193593 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0011ea0 con 0x7f82c00051c0 2023-10-07T08:48:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82c97fa700 1 -- 172.21.15.81:0/695193593 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d000f8e0 con 0x7f82c00051c0 2023-10-07T08:48:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82db69a700 1 -- 172.21.15.81:0/695193593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d415cf40 con 0x7f82c00051c0 2023-10-07T08:48:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82c97fa700 1 -- 172.21.15.81:0/695193593 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d000fc60 con 0x7f82c00051c0 2023-10-07T08:48:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.786+0000 7f82db69a700 1 -- 172.21.15.81:0/695193593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d415b6a0 con 0x7f82c00051c0 2023-10-07T08:48:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.787+0000 7f82db69a700 1 -- 172.21.15.81:0/695193593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d4067ac0 con 0x7f82c00051c0 2023-10-07T08:48:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.788+0000 7f82c97fa700 1 -- 172.21.15.81:0/695193593 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82d0015460 con 0x7f82c00051c0 2023-10-07T08:48:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.788+0000 7f82c97fa700 1 --2- 172.21.15.81:0/695193593 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f82b8066f30 0x7f82b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.788+0000 7f82c97fa700 1 -- 172.21.15.81:0/695193593 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82d0084e80 con 0x7f82c00051c0 2023-10-07T08:48:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.788+0000 7f82d8c35700 1 --2- 172.21.15.81:0/695193593 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f82b8066f30 0x7f82b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.789+0000 7f82d8c35700 1 --2- 172.21.15.81:0/695193593 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f82b8066f30 0x7f82b80693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f82c40015a0 tx=0x7f82c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:52.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:52.792+0000 7f82c97fa700 1 -- 172.21.15.81:0/695193593 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82d0055b80 con 0x7f82c00051c0 2023-10-07T08:48:53.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.017+0000 7f82db69a700 1 -- 172.21.15.81:0/695193593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f82d416a360 con 0x7f82c00051c0 2023-10-07T08:48:53.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.017+0000 7f82c97fa700 1 -- 172.21.15.81:0/695193593 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7f82d0055710 con 0x7f82c00051c0 2023-10-07T08:48:53.018 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:48:53.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.019+0000 7f82db69a700 1 -- 172.21.15.81:0/695193593 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f82b8066f30 msgr2=0x7f82b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:53.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.019+0000 7f82db69a700 1 --2- 172.21.15.81:0/695193593 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f82b8066f30 0x7f82b80693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f82c40015a0 tx=0x7f82c4009040 comp rx=0 tx=0).stop 2023-10-07T08:48:53.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.019+0000 7f82db69a700 1 -- 172.21.15.81:0/695193593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82c00051c0 msgr2=0x7f82d41466d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.019+0000 7f82db69a700 1 --2- 172.21.15.81:0/695193593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82c00051c0 0x7f82d41466d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f82d0011960 tx=0x7f82d0008040 comp rx=0 tx=0).stop 2023-10-07T08:48:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.019+0000 7f82db69a700 1 -- 172.21.15.81:0/695193593 shutdown_connections 2023-10-07T08:48:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.019+0000 7f82db69a700 1 --2- 172.21.15.81:0/695193593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d40b44e0 0x7f82d4069d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.019+0000 7f82db69a700 1 --2- 172.21.15.81:0/695193593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82c00051c0 0x7f82d41466d0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.019+0000 7f82db69a700 1 --2- 172.21.15.81:0/695193593 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f82b8066f30 0x7f82b80693e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.019+0000 7f82db69a700 1 --2- 172.21.15.81:0/695193593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d40b4070 0x7f82d4069820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.019+0000 7f82db69a700 1 -- 172.21.15.81:0/695193593 >> 172.21.15.81:0/695193593 conn(0x7f82d406bb90 msgr2=0x7f82d406d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.019+0000 7f82db69a700 1 -- 172.21.15.81:0/695193593 shutdown_connections 2023-10-07T08:48:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.019+0000 7f82db69a700 1 -- 172.21.15.81:0/695193593 wait complete. 2023-10-07T08:48:53.034 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:48:53.034 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:48:53.034 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-07T08:48:53.034 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T08:48:53.034 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T08:48:53.034 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:48:53.034 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:48:53.034 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:48:53.034 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:48:53.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:53.035 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-07T08:48:53.053 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:48:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:48:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:48:53.053 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-07T08:48:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:53.054 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:48:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-10-07T08:48:53.054 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:48:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-10-07T08:48:53.054 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:48:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:53.054 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:48:53.054 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:48:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42195sec preferred_lft 42195sec 2023-10-07T08:48:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2023-10-07T08:48:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:53.055 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:48:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:48:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:48:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::74d7:a9ff:fe87:ed9/64 scope link 2023-10-07T08:48:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:53.055 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:48:53.055 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T08:48:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6c40:c5ff:fe3a:a57/64 scope link 2023-10-07T08:48:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:53.056 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:48:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether de:db:cd:68:b1:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T08:48:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::dcdb:cdff:fe68:b178/64 scope link 2023-10-07T08:48:53.056 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:48:53.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:53.056 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:48:53.121 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-07T08:48:53.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:53.122 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-07T08:48:53.180 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-07T08:48:53.180 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:48:53.180 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:48:53.180 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:48:53.181 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:48:53.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:53.181 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:48:53.181 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:48:53.181 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:48:53.181 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:48:53.181 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:48:53.181 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:48:53.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:53.287 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-07T08:48:53.302 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T08:48:53.302 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T08:48:53.302 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:48:53.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:53.302 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-07T08:48:53.368 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:48:53.368 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T08:48:53.423 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:48:53.423 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:48:53.424 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:48:53.478 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:48:53.478 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:48:53.478 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:48:53.559 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:48:53.559 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:48:53.559 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:48:53.567 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:48:53.567 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:48:53.567 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:48:53.567 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:48:53.567 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:48:53.588 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:48:53.589 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:48:53.589 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:48:53.589 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:48:53.589 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:48:53.589 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:48:53.589 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:48:53.589 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:48:53.590 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:48:53.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:53.591 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:48:53.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:48:53.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.769+0000 7fe564d53700 1 Processor -- start 2023-10-07T08:48:53.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.769+0000 7fe564d53700 1 -- start start 2023-10-07T08:48:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe564d53700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe56006d830 0x7fe5600cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe564d53700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5600d07c0 con 0x7fe5601578d0 2023-10-07T08:48:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe564d53700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5600cfbb0 con 0x7fe560157ca0 2023-10-07T08:48:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe564d53700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5600cfe90 con 0x7fe56006d830 2023-10-07T08:48:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55e59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe5601578d0 0x7fe56015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34302/0 (socket says 172.21.15.81:34302) 2023-10-07T08:48:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55e59c700 1 -- 172.21.15.81:0/1858251759 learned_addr learned my addr 172.21.15.81:0/1858251759 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55ed9d700 1 --2- 172.21.15.81:0/1858251759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe56006d830 0x7fe5600cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 -- 172.21.15.81:0/1858251759 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990325392 0 0) 0x7fe5600d07c0 con 0x7fe5601578d0 2023-10-07T08:48:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 -- 172.21.15.81:0/1858251759 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe54c003570 con 0x7fe5601578d0 2023-10-07T08:48:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 -- 172.21.15.81:0/1858251759 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246042705 0 0) 0x7fe5600cfbb0 con 0x7fe560157ca0 2023-10-07T08:48:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 -- 172.21.15.81:0/1858251759 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5600d07c0 con 0x7fe560157ca0 2023-10-07T08:48:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 -- 172.21.15.81:0/1858251759 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 342294991 0 0) 0x7fe54c003570 con 0x7fe5601578d0 2023-10-07T08:48:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 -- 172.21.15.81:0/1858251759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe56006d830 msgr2=0x7fe5600cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 --2- 172.21.15.81:0/1858251759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe56006d830 0x7fe5600cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 -- 172.21.15.81:0/1858251759 >> v1:172.21.15.89:6789/0 conn(0x7fe560157ca0 legacy=0x7fe56006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 -- 172.21.15.81:0/1858251759 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5600d0170 con 0x7fe5601578d0 2023-10-07T08:48:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 -- 172.21.15.81:0/1858251759 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fe5580017f0 con 0x7fe5601578d0 2023-10-07T08:48:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 -- 172.21.15.81:0/1858251759 >> v1:172.21.15.81:6789/0 conn(0x7fe5601578d0 legacy=0x7fe56015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 --2- 172.21.15.81:0/1858251759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe54c003c20 0x7fe54c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 --2- 172.21.15.81:0/1858251759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe54c004810 0x7fe54c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 --2- 172.21.15.81:0/1858251759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe56006d830 0x7fe54c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 -- 172.21.15.81:0/1858251759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5600cfe90 con 0x7fe54c003c20 2023-10-07T08:48:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 -- 172.21.15.81:0/1858251759 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c00bbf0 con 0x7fe54c004810 2023-10-07T08:48:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.770+0000 7fe55d59a700 1 -- 172.21.15.81:0/1858251759 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c00bdb0 con 0x7fe56006d830 2023-10-07T08:48:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.771+0000 7fe55e59c700 1 --2- 172.21.15.81:0/1858251759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe54c003c20 0x7fe54c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.771+0000 7fe55dd9b700 1 --2- 172.21.15.81:0/1858251759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe54c004810 0x7fe54c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.771+0000 7fe55ed9d700 1 --2- 172.21.15.81:0/1858251759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe56006d830 0x7fe54c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.771+0000 7fe55e59c700 1 -- 172.21.15.81:0/1858251759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe56006d830 msgr2=0x7fe54c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.771+0000 7fe55e59c700 1 --2- 172.21.15.81:0/1858251759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe56006d830 0x7fe54c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.771+0000 7fe55e59c700 1 -- 172.21.15.81:0/1858251759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe54c004810 msgr2=0x7fe54c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.771+0000 7fe55e59c700 1 --2- 172.21.15.81:0/1858251759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe54c004810 0x7fe54c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.771+0000 7fe55e59c700 1 -- 172.21.15.81:0/1858251759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c003570 con 0x7fe54c003c20 2023-10-07T08:48:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.771+0000 7fe55e59c700 1 --2- 172.21.15.81:0/1858251759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe54c003c20 0x7fe54c004010 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fe55800a800 tx=0x7fe56015b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26701e09fbc8779e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.771+0000 7fe55d59a700 1 -- 172.21.15.81:0/1858251759 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5580071a0 con 0x7fe54c003c20 2023-10-07T08:48:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.771+0000 7fe55d59a700 1 -- 172.21.15.81:0/1858251759 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe558007300 con 0x7fe54c003c20 2023-10-07T08:48:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.771+0000 7fe55d59a700 1 -- 172.21.15.81:0/1858251759 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5580076c0 con 0x7fe54c003c20 2023-10-07T08:48:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.772+0000 7fe564d53700 1 -- 172.21.15.81:0/1858251759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe54c003c20 msgr2=0x7fe54c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.772+0000 7fe564d53700 1 --2- 172.21.15.81:0/1858251759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe54c003c20 0x7fe54c004010 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fe55800a800 tx=0x7fe56015b610 comp rx=0 tx=0).stop 2023-10-07T08:48:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.772+0000 7fe55ed9d700 1 -- 172.21.15.81:0/1858251759 reap_dead start 2023-10-07T08:48:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.772+0000 7fe564d53700 1 -- 172.21.15.81:0/1858251759 shutdown_connections 2023-10-07T08:48:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.772+0000 7fe564d53700 1 -- 172.21.15.81:0/1858251759 >> 172.21.15.81:0/1858251759 conn(0x7fe56006bb90 msgr2=0x7fe56006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.772+0000 7fe564d53700 1 -- 172.21.15.81:0/1858251759 shutdown_connections 2023-10-07T08:48:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.772+0000 7fe564d53700 1 -- 172.21.15.81:0/1858251759 wait complete. 2023-10-07T08:48:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.773+0000 7fe564d53700 1 Processor -- start 2023-10-07T08:48:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.773+0000 7fe564d53700 1 -- start start 2023-10-07T08:48:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.773+0000 7fe564d53700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe54c003c20 0x7fe56016adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.773+0000 7fe564d53700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5601595e0 0x7fe560159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.773+0000 7fe564d53700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5600aebd0 0x7fe5600af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.773+0000 7fe564d53700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5601553e0 con 0x7fe5601595e0 2023-10-07T08:48:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.773+0000 7fe564d53700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe560159f90 con 0x7fe5600aebd0 2023-10-07T08:48:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe564d53700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5600aa9a0 con 0x7fe54c003c20 2023-10-07T08:48:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe55dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5601595e0 0x7fe560159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe55dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5601595e0 0x7fe560159a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52864/0 (socket says 172.21.15.81:52864) 2023-10-07T08:48:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe55dd9b700 1 -- 172.21.15.81:0/1695320195 learned_addr learned my addr 172.21.15.81:0/1695320195 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe55ed9d700 1 --2- 172.21.15.81:0/1695320195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5600aebd0 0x7fe5600af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe55e59c700 1 --2- 172.21.15.81:0/1695320195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe54c003c20 0x7fe56016adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe55dd9b700 1 -- 172.21.15.81:0/1695320195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe54c003c20 msgr2=0x7fe56016adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe55dd9b700 1 --2- 172.21.15.81:0/1695320195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe54c003c20 0x7fe56016adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe55dd9b700 1 -- 172.21.15.81:0/1695320195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5600aebd0 msgr2=0x7fe5600af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe55dd9b700 1 --2- 172.21.15.81:0/1695320195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5600aebd0 0x7fe5600af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe55dd9b700 1 -- 172.21.15.81:0/1695320195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5600aac80 con 0x7fe5601595e0 2023-10-07T08:48:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe55dd9b700 1 --2- 172.21.15.81:0/1695320195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5601595e0 0x7fe560159a50 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fe54800f8b0 tx=0x7fe548007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe5567fc700 1 -- 172.21.15.81:0/1695320195 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548006a30 con 0x7fe5601595e0 2023-10-07T08:48:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe5567fc700 1 -- 172.21.15.81:0/1695320195 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe548006b90 con 0x7fe5601595e0 2023-10-07T08:48:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe564d53700 1 -- 172.21.15.81:0/1695320195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5600aaf60 con 0x7fe5601595e0 2023-10-07T08:48:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe5567fc700 1 -- 172.21.15.81:0/1695320195 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548007050 con 0x7fe5601595e0 2023-10-07T08:48:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.774+0000 7fe564d53700 1 -- 172.21.15.81:0/1695320195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5600af590 con 0x7fe5601595e0 2023-10-07T08:48:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.775+0000 7fe564d53700 1 -- 172.21.15.81:0/1695320195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5600b1f00 con 0x7fe5601595e0 2023-10-07T08:48:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.776+0000 7fe5567fc700 1 -- 172.21.15.81:0/1695320195 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe548007440 con 0x7fe5601595e0 2023-10-07T08:48:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.776+0000 7fe5567fc700 1 --2- 172.21.15.81:0/1695320195 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe540066f30 0x7fe5400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.776+0000 7fe5567fc700 1 -- 172.21.15.81:0/1695320195 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5480844c0 con 0x7fe5601595e0 2023-10-07T08:48:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.776+0000 7fe55e59c700 1 --2- 172.21.15.81:0/1695320195 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe540066f30 0x7fe5400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.776+0000 7fe55e59c700 1 --2- 172.21.15.81:0/1695320195 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe540066f30 0x7fe5400693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe55800a800 tx=0x7fe558016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:53.780+0000 7fe5567fc700 1 -- 172.21.15.81:0/1695320195 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe548051730 con 0x7fe5601595e0 2023-10-07T08:48:54.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.003+0000 7fe564d53700 1 -- 172.21.15.81:0/1695320195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5600ab480 con 0x7fe5601595e0 2023-10-07T08:48:54.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.004+0000 7fe5567fc700 1 -- 172.21.15.81:0/1695320195 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fe5600ab480 con 0x7fe5601595e0 2023-10-07T08:48:54.005 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:54.005 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/2384735966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2384735966},{"type":"v1","addr":"172.21.15.89:6834","nonce":2384735966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1456306972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1456306972},{"type":"v1","addr":"172.21.15.89:6835","nonce":1456306972}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3356050793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3356050793},{"type":"v1","addr":"172.21.15.81:6836","nonce":3356050793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:48:40.667880+0000","modified":"2023-10-07T08:48:44.308458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6741":{"gid":6741,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2231384962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2231384962},{"type":"v1","addr":"172.21.15.81:6837","nonce":2231384962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-07T08:48:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.005+0000 7fe564d53700 1 -- 172.21.15.81:0/1695320195 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe540066f30 msgr2=0x7fe5400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.005+0000 7fe564d53700 1 --2- 172.21.15.81:0/1695320195 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe540066f30 0x7fe5400693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe55800a800 tx=0x7fe558016000 comp rx=0 tx=0).stop 2023-10-07T08:48:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.005+0000 7fe564d53700 1 -- 172.21.15.81:0/1695320195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5601595e0 msgr2=0x7fe560159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.005+0000 7fe564d53700 1 --2- 172.21.15.81:0/1695320195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5601595e0 0x7fe560159a50 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fe54800f8b0 tx=0x7fe548007d30 comp rx=0 tx=0).stop 2023-10-07T08:48:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.005+0000 7fe564d53700 1 -- 172.21.15.81:0/1695320195 shutdown_connections 2023-10-07T08:48:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.005+0000 7fe564d53700 1 --2- 172.21.15.81:0/1695320195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5600aebd0 0x7fe5600af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.005+0000 7fe564d53700 1 --2- 172.21.15.81:0/1695320195 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe540066f30 0x7fe5400693e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:54.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.005+0000 7fe564d53700 1 --2- 172.21.15.81:0/1695320195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe54c003c20 0x7fe56016adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:54.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.005+0000 7fe564d53700 1 --2- 172.21.15.81:0/1695320195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5601595e0 0x7fe560159a50 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:54.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.005+0000 7fe564d53700 1 -- 172.21.15.81:0/1695320195 >> 172.21.15.81:0/1695320195 conn(0x7fe56006bb90 msgr2=0x7fe56006d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:54.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.006+0000 7fe564d53700 1 -- 172.21.15.81:0/1695320195 shutdown_connections 2023-10-07T08:48:54.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.006+0000 7fe564d53700 1 -- 172.21.15.81:0/1695320195 wait complete. 2023-10-07T08:48:54.008 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 58 2023-10-07T08:48:54.019 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-07T08:48:54.152 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":6741,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":12.857106294999999,"mdsmap_epoch":58,"osdmap_epoch":123,"osdmap_epoch_barrier":123,"uptime":18.413004634} 2023-10-07T08:48:54.152 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 6741, "mdsmap_epoch": 58, "osdmap_epoch": 123, "osdmap_epoch_barrier": 123, "rank_uptime": 12.857106295, "state": "up:active", "uptime": 18.413004634, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:48:54.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-07T08:48:54.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.269+0000 7f739359e700 1 Processor -- start 2023-10-07T08:48:54.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.269+0000 7f739359e700 1 -- start start 2023-10-07T08:48:54.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.270+0000 7f739359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73940d0b80 0x7f73940cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:54.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.270+0000 7f739359e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f739406d700 0x7f739415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:54.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.270+0000 7f739359e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73940cf2d0 con 0x7f73940d02b0 2023-10-07T08:48:54.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.270+0000 7f739359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739415a690 con 0x7f73940d0b80 2023-10-07T08:48:54.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.270+0000 7f739359e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739406dc00 con 0x7f739406d700 2023-10-07T08:48:54.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.270+0000 7f739259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73940d0b80 0x7f73940cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:54.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.270+0000 7f739259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73940d0b80 0x7f73940cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52872/0 (socket says 172.21.15.81:52872) 2023-10-07T08:48:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.270+0000 7f739259c700 1 -- 172.21.15.81:0/2644917184 learned_addr learned my addr 172.21.15.81:0/2644917184 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.270+0000 7f7392d9d700 1 --2- 172.21.15.81:0/2644917184 >> v2:172.21.15.89:3300/0 conn(0x7f739406d700 0x7f739415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.270+0000 7f739259c700 1 -- 172.21.15.81:0/2644917184 >> v2:172.21.15.89:3300/0 conn(0x7f739406d700 msgr2=0x7f739415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.270+0000 7f739259c700 1 --2- 172.21.15.81:0/2644917184 >> v2:172.21.15.89:3300/0 conn(0x7f739406d700 0x7f739415b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.270+0000 7f739259c700 1 -- 172.21.15.81:0/2644917184 >> v1:172.21.15.89:6789/0 conn(0x7f73940d02b0 legacy=0x7f739406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.270+0000 7f739259c700 1 -- 172.21.15.81:0/2644917184 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73940cf570 con 0x7f73940d0b80 2023-10-07T08:48:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.270+0000 7f7391d9b700 1 -- 172.21.15.81:0/2644917184 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681969795 0 0) 0x7f73940cf2d0 con 0x7f73940d02b0 2023-10-07T08:48:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.270+0000 7f7392d9d700 1 --2- 172.21.15.81:0/2644917184 >> v2:172.21.15.89:3300/0 conn(0x7f739406d700 0x7f739415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:48:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.270+0000 7f739259c700 1 --2- 172.21.15.81:0/2644917184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73940d0b80 0x7f73940cfd70 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f73840099b0 tx=0x7f7384009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03bb6b75fc7f9a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.271+0000 7f7391d9b700 1 -- 172.21.15.81:0/2644917184 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384009ea0 con 0x7f73940d0b80 2023-10-07T08:48:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.271+0000 7f7391d9b700 1 -- 172.21.15.81:0/2644917184 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738400b820 con 0x7f73940d0b80 2023-10-07T08:48:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.271+0000 7f7391d9b700 1 -- 172.21.15.81:0/2644917184 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400bbc0 con 0x7f73940d0b80 2023-10-07T08:48:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.271+0000 7f739359e700 1 -- 172.21.15.81:0/2644917184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73940d0b80 msgr2=0x7f73940cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.271+0000 7f739359e700 1 --2- 172.21.15.81:0/2644917184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73940d0b80 0x7f73940cfd70 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f73840099b0 tx=0x7f7384009250 comp rx=0 tx=0).stop 2023-10-07T08:48:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.271+0000 7f739359e700 1 -- 172.21.15.81:0/2644917184 shutdown_connections 2023-10-07T08:48:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.271+0000 7f739359e700 1 --2- 172.21.15.81:0/2644917184 >> v2:172.21.15.89:3300/0 conn(0x7f739406d700 0x7f739415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.271+0000 7f739359e700 1 --2- 172.21.15.81:0/2644917184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73940d0b80 0x7f73940cfd70 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.271+0000 7f739359e700 1 -- 172.21.15.81:0/2644917184 >> 172.21.15.81:0/2644917184 conn(0x7f7394063230 msgr2=0x7f7394063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.271+0000 7f739359e700 1 -- 172.21.15.81:0/2644917184 shutdown_connections 2023-10-07T08:48:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.271+0000 7f739359e700 1 -- 172.21.15.81:0/2644917184 wait complete. 2023-10-07T08:48:54.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.272+0000 7f739359e700 1 Processor -- start 2023-10-07T08:48:54.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.272+0000 7f739359e700 1 -- start start 2023-10-07T08:48:54.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.273+0000 7f739359e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f739406d700 0x7f73940af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:54.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.273+0000 7f739359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73940d02b0 0x7f739416a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:54.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.273+0000 7f739359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73940d0b80 0x7f739416b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:54.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.273+0000 7f739359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7394157300 con 0x7f73940d0b80 2023-10-07T08:48:54.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.273+0000 7f739359e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73940c5c30 con 0x7f739406d700 2023-10-07T08:48:54.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.273+0000 7f739359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73940aefd0 con 0x7f73940d02b0 2023-10-07T08:48:54.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.273+0000 7f7392d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73940d0b80 0x7f739416b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:54.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.273+0000 7f7392d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73940d0b80 0x7f739416b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52878/0 (socket says 172.21.15.81:52878) 2023-10-07T08:48:54.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.273+0000 7f7392d9d700 1 -- 172.21.15.81:0/895555385 learned_addr learned my addr 172.21.15.81:0/895555385 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:54.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.273+0000 7f739259c700 1 --2- 172.21.15.81:0/895555385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f739406d700 0x7f73940af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:54.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.273+0000 7f7389d9b700 1 --2- 172.21.15.81:0/895555385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73940d02b0 0x7f739416a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:54.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.273+0000 7f7392d9d700 1 -- 172.21.15.81:0/895555385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73940d02b0 msgr2=0x7f739416a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:54.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.273+0000 7f7392d9d700 1 --2- 172.21.15.81:0/895555385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73940d02b0 0x7f739416a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:54.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.273+0000 7f7392d9d700 1 -- 172.21.15.81:0/895555385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f739406d700 msgr2=0x7f73940af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:54.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.273+0000 7f7392d9d700 1 --2- 172.21.15.81:0/895555385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f739406d700 0x7f73940af460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.273+0000 7f7392d9d700 1 -- 172.21.15.81:0/895555385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c009a20 con 0x7f73940d0b80 2023-10-07T08:48:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.274+0000 7f7392d9d700 1 --2- 172.21.15.81:0/895555385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73940d0b80 0x7f739416b820 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f738c00c0f0 tx=0x7f738c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.274+0000 7f738affd700 1 -- 172.21.15.81:0/895555385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c00ce20 con 0x7f73940d0b80 2023-10-07T08:48:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.274+0000 7f738affd700 1 -- 172.21.15.81:0/895555385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c00f040 con 0x7f73940d0b80 2023-10-07T08:48:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.274+0000 7f739359e700 1 -- 172.21.15.81:0/895555385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73840094f0 con 0x7f73940d0b80 2023-10-07T08:48:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.274+0000 7f738affd700 1 -- 172.21.15.81:0/895555385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0146d0 con 0x7f73940d0b80 2023-10-07T08:48:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.274+0000 7f739359e700 1 -- 172.21.15.81:0/895555385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739416b3f0 con 0x7f73940d0b80 2023-10-07T08:48:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.275+0000 7f739359e700 1 -- 172.21.15.81:0/895555385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73940676e0 con 0x7f73940d0b80 2023-10-07T08:48:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.275+0000 7f738affd700 1 -- 172.21.15.81:0/895555385 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f738c003020 con 0x7f73940d0b80 2023-10-07T08:48:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.275+0000 7f738affd700 1 --2- 172.21.15.81:0/895555385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7374066f30 0x7f73740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.276+0000 7f738affd700 1 -- 172.21.15.81:0/895555385 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f738c085090 con 0x7f73940d0b80 2023-10-07T08:48:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.276+0000 7f739259c700 1 --2- 172.21.15.81:0/895555385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7374066f30 0x7f73740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.276+0000 7f739259c700 1 --2- 172.21.15.81:0/895555385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7374066f30 0x7f73740693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f73840099b0 tx=0x7f7384017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.280+0000 7f738affd700 1 -- 172.21.15.81:0/895555385 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f738c052300 con 0x7f73940d0b80 2023-10-07T08:48:54.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:54.463+0000 7f739359e700 1 -- 172.21.15.81:0/895555385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f73940af110 con 0x7f73940d0b80 2023-10-07T08:48:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.352+0000 7f738affd700 1 -- 172.21.15.81:0/895555385 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v124) v1 ==== 181+0+0 (secure 0 0 0) 0x7f738c055920 con 0x7f73940d0b80 2023-10-07T08:48:55.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.354+0000 7f739359e700 1 -- 172.21.15.81:0/895555385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7374066f30 msgr2=0x7f73740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:55.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.354+0000 7f739359e700 1 --2- 172.21.15.81:0/895555385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7374066f30 0x7f73740693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f73840099b0 tx=0x7f7384017000 comp rx=0 tx=0).stop 2023-10-07T08:48:55.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.354+0000 7f739359e700 1 -- 172.21.15.81:0/895555385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73940d0b80 msgr2=0x7f739416b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:55.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.354+0000 7f739359e700 1 --2- 172.21.15.81:0/895555385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73940d0b80 0x7f739416b820 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f738c00c0f0 tx=0x7f738c00b040 comp rx=0 tx=0).stop 2023-10-07T08:48:55.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.354+0000 7f739359e700 1 -- 172.21.15.81:0/895555385 shutdown_connections 2023-10-07T08:48:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.354+0000 7f739359e700 1 --2- 172.21.15.81:0/895555385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73940d0b80 0x7f739416b820 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.354+0000 7f739359e700 1 --2- 172.21.15.81:0/895555385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f739406d700 0x7f73940af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.354+0000 7f739359e700 1 --2- 172.21.15.81:0/895555385 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7374066f30 0x7f73740693e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.354+0000 7f739359e700 1 --2- 172.21.15.81:0/895555385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73940d02b0 0x7f739416a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.355+0000 7f739359e700 1 -- 172.21.15.81:0/895555385 >> 172.21.15.81:0/895555385 conn(0x7f7394063230 msgr2=0x7f73940b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.355+0000 7f739359e700 1 -- 172.21.15.81:0/895555385 shutdown_connections 2023-10-07T08:48:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.355+0000 7f739359e700 1 -- 172.21.15.81:0/895555385 wait complete. 2023-10-07T08:48:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-07T08:48:55.369 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-07T08:48:55.369 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-07T08:48:55.369 DEBUG:teuthology.orchestra.run.smithi081:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-07T08:48:55.369 DEBUG:teuthology.orchestra.run.smithi081:> os.fchmod(fd, 0O666) 2023-10-07T08:48:55.369 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(fd) 2023-10-07T08:48:55.369 DEBUG:teuthology.orchestra.run.smithi081:> os.close(fd) 2023-10-07T08:48:55.369 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-07T08:48:55.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:48:55.624 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-07T08:48:55.672 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:48:55.693 INFO:teuthology.orchestra.run.smithi081.stdout:client6930 2023-10-07T08:48:55.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:55.694 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f2fc6535-cadc-4a0b-bdad-da2d602c784a.client6930/osdmap') 2023-10-07T08:48:55.694 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:48:55.770 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 123 barrier 123 flags 0x588000 2023-10-07T08:48:55.770 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:48:55.770 INFO:teuthology.orchestra.run.smithi081.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:48:55.770 INFO:teuthology.orchestra.run.smithi081.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:48:55.770 INFO:teuthology.orchestra.run.smithi081.stdout:osd0 (1)172.21.15.81:6801 100% (exists, up) 100% -1 2023-10-07T08:48:55.770 INFO:teuthology.orchestra.run.smithi081.stdout:osd1 (1)172.21.15.81:6819 100% (exists, up) 100% -1 2023-10-07T08:48:55.771 INFO:teuthology.orchestra.run.smithi081.stdout:osd2 (1)172.21.15.81:6818 100% (exists, up) 100% -1 2023-10-07T08:48:55.771 INFO:teuthology.orchestra.run.smithi081.stdout:osd3 (1)172.21.15.81:6809 100% (exists, up) 100% -1 2023-10-07T08:48:55.771 INFO:teuthology.orchestra.run.smithi081.stdout:osd4 (1)172.21.15.89:6801 100% (exists, up) 100% -1 2023-10-07T08:48:55.771 INFO:teuthology.orchestra.run.smithi081.stdout:osd5 (1)172.21.15.89:6817 100% (exists, up) 100% -1 2023-10-07T08:48:55.771 INFO:teuthology.orchestra.run.smithi081.stdout:osd6 (1)172.21.15.89:6824 100% (exists, up) 100% -1 2023-10-07T08:48:55.772 INFO:teuthology.orchestra.run.smithi081.stdout:osd7 (1)172.21.15.89:6809 100% (exists, up) 100% -1 2023-10-07T08:48:55.772 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records in 2023-10-07T08:48:55.773 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records out 2023-10-07T08:48:55.773 INFO:teuthology.orchestra.run.smithi081.stderr:795 bytes copied, 3.3096e-05 s, 24.0 MB/s 2023-10-07T08:48:55.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-10-07T08:48:55.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.928+0000 7f40faf05700 1 Processor -- start 2023-10-07T08:48:55.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.928+0000 7f40faf05700 1 -- start start 2023-10-07T08:48:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.929+0000 7f40faf05700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40f41578d0 0x7f40f40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.929+0000 7f40faf05700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f40d07c0 con 0x7f40f406d120 2023-10-07T08:48:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.929+0000 7f40faf05700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f40cfbb0 con 0x7f40f4157ca0 2023-10-07T08:48:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.929+0000 7f40faf05700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40cfe90 con 0x7f40f41578d0 2023-10-07T08:48:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.929+0000 7f40f94a2700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f40f406d120 0x7f40f415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34318/0 (socket says 172.21.15.81:34318) 2023-10-07T08:48:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.929+0000 7f40f94a2700 1 -- 172.21.15.81:0/2835673333 learned_addr learned my addr 172.21.15.81:0/2835673333 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.929+0000 7f40eb7fe700 1 -- 172.21.15.81:0/2835673333 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289644337 0 0) 0x7f40f40d07c0 con 0x7f40f406d120 2023-10-07T08:48:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.929+0000 7f40eb7fe700 1 -- 172.21.15.81:0/2835673333 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40dc003570 con 0x7f40f406d120 2023-10-07T08:48:55.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.929+0000 7f40f8ca1700 1 --2- 172.21.15.81:0/2835673333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40f41578d0 0x7f40f40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:55.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40eb7fe700 1 -- 172.21.15.81:0/2835673333 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 103013842 0 0) 0x7f40dc003570 con 0x7f40f406d120 2023-10-07T08:48:55.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40eb7fe700 1 -- 172.21.15.81:0/2835673333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40f41578d0 msgr2=0x7f40f40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:55.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40eb7fe700 1 --2- 172.21.15.81:0/2835673333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40f41578d0 0x7f40f40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:55.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40eb7fe700 1 -- 172.21.15.81:0/2835673333 >> v1:172.21.15.89:6789/0 conn(0x7f40f4157ca0 legacy=0x7f40f415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:55.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40eb7fe700 1 -- 172.21.15.81:0/2835673333 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f40d0170 con 0x7f40f406d120 2023-10-07T08:48:55.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40eb7fe700 1 -- 172.21.15.81:0/2835673333 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f40ec0017f0 con 0x7f40f406d120 2023-10-07T08:48:55.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40eb7fe700 1 -- 172.21.15.81:0/2835673333 >> v1:172.21.15.81:6789/0 conn(0x7f40f406d120 legacy=0x7f40f415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:55.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40eb7fe700 1 --2- 172.21.15.81:0/2835673333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc003a90 0x7f40dc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:55.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40eb7fe700 1 --2- 172.21.15.81:0/2835673333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40f41578d0 0x7f40dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:55.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40eb7fe700 1 --2- 172.21.15.81:0/2835673333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40dc004da0 0x7f40dc0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:55.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40eb7fe700 1 -- 172.21.15.81:0/2835673333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40cfe90 con 0x7f40dc004da0 2023-10-07T08:48:55.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40eb7fe700 1 -- 172.21.15.81:0/2835673333 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc00bc20 con 0x7f40dc003a90 2023-10-07T08:48:55.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40eb7fe700 1 -- 172.21.15.81:0/2835673333 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc00bde0 con 0x7f40f41578d0 2023-10-07T08:48:55.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40f94a2700 1 --2- 172.21.15.81:0/2835673333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40dc004da0 0x7f40dc0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:55.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40f8ca1700 1 --2- 172.21.15.81:0/2835673333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc003a90 0x7f40dc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:55.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40ebfff700 1 --2- 172.21.15.81:0/2835673333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40f41578d0 0x7f40dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:55.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40f94a2700 1 -- 172.21.15.81:0/2835673333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40f41578d0 msgr2=0x7f40dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:55.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40f94a2700 1 --2- 172.21.15.81:0/2835673333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40f41578d0 0x7f40dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:55.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40f94a2700 1 -- 172.21.15.81:0/2835673333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc003a90 msgr2=0x7f40dc003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:55.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40f94a2700 1 --2- 172.21.15.81:0/2835673333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc003a90 0x7f40dc003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:55.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40f94a2700 1 -- 172.21.15.81:0/2835673333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc003570 con 0x7f40dc004da0 2023-10-07T08:48:55.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40f94a2700 1 --2- 172.21.15.81:0/2835673333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40dc004da0 0x7f40dc0051f0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f40ec002250 tx=0x7f40f415b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b51f6cd3703781 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:55.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40eb7fe700 1 -- 172.21.15.81:0/2835673333 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec0070d0 con 0x7f40dc004da0 2023-10-07T08:48:55.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40eb7fe700 1 -- 172.21.15.81:0/2835673333 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ec007230 con 0x7f40dc004da0 2023-10-07T08:48:55.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.930+0000 7f40eb7fe700 1 -- 172.21.15.81:0/2835673333 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec0075f0 con 0x7f40dc004da0 2023-10-07T08:48:55.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.931+0000 7f40faf05700 1 -- 172.21.15.81:0/2835673333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40dc004da0 msgr2=0x7f40dc0051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:55.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.931+0000 7f40faf05700 1 --2- 172.21.15.81:0/2835673333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40dc004da0 0x7f40dc0051f0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f40ec002250 tx=0x7f40f415b610 comp rx=0 tx=0).stop 2023-10-07T08:48:55.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.931+0000 7f40f94a2700 1 -- 172.21.15.81:0/2835673333 reap_dead start 2023-10-07T08:48:55.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.931+0000 7f40faf05700 1 -- 172.21.15.81:0/2835673333 shutdown_connections 2023-10-07T08:48:55.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.931+0000 7f40faf05700 1 -- 172.21.15.81:0/2835673333 >> 172.21.15.81:0/2835673333 conn(0x7f40f406bb90 msgr2=0x7f40f406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:55.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.931+0000 7f40faf05700 1 -- 172.21.15.81:0/2835673333 shutdown_connections 2023-10-07T08:48:55.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.931+0000 7f40faf05700 1 -- 172.21.15.81:0/2835673333 wait complete. 2023-10-07T08:48:55.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.932+0000 7f40faf05700 1 Processor -- start 2023-10-07T08:48:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.932+0000 7f40faf05700 1 -- start start 2023-10-07T08:48:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.933+0000 7f40faf05700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc004da0 0x7f40f4154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.933+0000 7f40faf05700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f40ac400 0x7f40f40b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.933+0000 7f40faf05700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40f40b5cc0 0x7f40f40ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.933+0000 7f40faf05700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40abf70 con 0x7f40f40ac400 2023-10-07T08:48:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.933+0000 7f40faf05700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40ab360 con 0x7f40f40b5cc0 2023-10-07T08:48:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.933+0000 7f40faf05700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40ab640 con 0x7f40dc004da0 2023-10-07T08:48:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.933+0000 7f40ebfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f40ac400 0x7f40f40b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.933+0000 7f40ebfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f40ac400 0x7f40f40b5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52900/0 (socket says 172.21.15.81:52900) 2023-10-07T08:48:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.933+0000 7f40ebfff700 1 -- 172.21.15.81:0/1791558917 learned_addr learned my addr 172.21.15.81:0/1791558917 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:55.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.933+0000 7f40f8ca1700 1 --2- 172.21.15.81:0/1791558917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc004da0 0x7f40f4154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.933+0000 7f40f94a2700 1 --2- 172.21.15.81:0/1791558917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40f40b5cc0 0x7f40f40ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.933+0000 7f40ebfff700 1 -- 172.21.15.81:0/1791558917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc004da0 msgr2=0x7f40f4154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.933+0000 7f40ebfff700 1 --2- 172.21.15.81:0/1791558917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc004da0 0x7f40f4154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.933+0000 7f40ebfff700 1 -- 172.21.15.81:0/1791558917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40f40b5cc0 msgr2=0x7f40f40ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.933+0000 7f40ebfff700 1 --2- 172.21.15.81:0/1791558917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40f40b5cc0 0x7f40f40ad740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.933+0000 7f40ebfff700 1 -- 172.21.15.81:0/1791558917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f40ab920 con 0x7f40f40ac400 2023-10-07T08:48:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.934+0000 7f40ebfff700 1 --2- 172.21.15.81:0/1791558917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f40ac400 0x7f40f40b5780 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f40e400e7b0 tx=0x7f40e4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.934+0000 7f40e8ff9700 1 -- 172.21.15.81:0/1791558917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4012500 con 0x7f40f40ac400 2023-10-07T08:48:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.934+0000 7f40e8ff9700 1 -- 172.21.15.81:0/1791558917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e4010040 con 0x7f40f40ac400 2023-10-07T08:48:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.934+0000 7f40faf05700 1 -- 172.21.15.81:0/1791558917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f40abc00 con 0x7f40f40ac400 2023-10-07T08:48:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.934+0000 7f40e8ff9700 1 -- 172.21.15.81:0/1791558917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4012890 con 0x7f40f40ac400 2023-10-07T08:48:55.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.934+0000 7f40faf05700 1 -- 172.21.15.81:0/1791558917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f40aaff0 con 0x7f40f40ac400 2023-10-07T08:48:55.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.935+0000 7f40faf05700 1 -- 172.21.15.81:0/1791558917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f4067ac0 con 0x7f40f40ac400 2023-10-07T08:48:55.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.935+0000 7f40e8ff9700 1 -- 172.21.15.81:0/1791558917 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40e4012c00 con 0x7f40f40ac400 2023-10-07T08:48:55.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.935+0000 7f40e8ff9700 1 --2- 172.21.15.81:0/1791558917 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f40e0066f30 0x7f40e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:55.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.936+0000 7f40f8ca1700 1 --2- 172.21.15.81:0/1791558917 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f40e0066f30 0x7f40e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:55.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.936+0000 7f40e8ff9700 1 -- 172.21.15.81:0/1791558917 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40e4083f40 con 0x7f40f40ac400 2023-10-07T08:48:55.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.936+0000 7f40f8ca1700 1 --2- 172.21.15.81:0/1791558917 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f40e0066f30 0x7f40e00693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f40f0006fd0 tx=0x7f40f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:55.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:55.940+0000 7f40e8ff9700 1 -- 172.21.15.81:0/1791558917 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40e4051260 con 0x7f40f40ac400 2023-10-07T08:48:56.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.134+0000 7f40faf05700 1 -- 172.21.15.81:0/1791558917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f40f40d0450 con 0x7f40f40ac400 2023-10-07T08:48:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.356+0000 7f40e8ff9700 1 -- 172.21.15.81:0/1791558917 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v125) v1 ==== 93+0+0 (secure 0 0 0) 0x7f40e4054880 con 0x7f40f40ac400 2023-10-07T08:48:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.359+0000 7f40faf05700 1 -- 172.21.15.81:0/1791558917 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f40e0066f30 msgr2=0x7f40e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.359+0000 7f40faf05700 1 --2- 172.21.15.81:0/1791558917 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f40e0066f30 0x7f40e00693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f40f0006fd0 tx=0x7f40f0008040 comp rx=0 tx=0).stop 2023-10-07T08:48:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.359+0000 7f40faf05700 1 -- 172.21.15.81:0/1791558917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f40ac400 msgr2=0x7f40f40b5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.359+0000 7f40faf05700 1 --2- 172.21.15.81:0/1791558917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f40ac400 0x7f40f40b5780 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f40e400e7b0 tx=0x7f40e4009040 comp rx=0 tx=0).stop 2023-10-07T08:48:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.359+0000 7f40faf05700 1 -- 172.21.15.81:0/1791558917 shutdown_connections 2023-10-07T08:48:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.359+0000 7f40faf05700 1 --2- 172.21.15.81:0/1791558917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40f40b5cc0 0x7f40f40ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.359+0000 7f40faf05700 1 --2- 172.21.15.81:0/1791558917 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f40e0066f30 0x7f40e00693e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.359+0000 7f40faf05700 1 --2- 172.21.15.81:0/1791558917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc004da0 0x7f40f4154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.359+0000 7f40faf05700 1 --2- 172.21.15.81:0/1791558917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f40ac400 0x7f40f40b5780 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.359+0000 7f40faf05700 1 -- 172.21.15.81:0/1791558917 >> 172.21.15.81:0/1791558917 conn(0x7f40f406bb90 msgr2=0x7f40f4155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.359+0000 7f40faf05700 1 -- 172.21.15.81:0/1791558917 shutdown_connections 2023-10-07T08:48:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.359+0000 7f40faf05700 1 -- 172.21.15.81:0/1791558917 wait complete. 2023-10-07T08:48:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:pauserd,pausewr is set 2023-10-07T08:48:56.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-10-07T08:48:56.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.487+0000 7f1ec333d700 1 Processor -- start 2023-10-07T08:48:56.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.487+0000 7f1ec333d700 1 -- start start 2023-10-07T08:48:56.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.488+0000 7f1ec333d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06c190 0x7f1ebc0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:56.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.488+0000 7f1ec333d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ebc0b35d0 con 0x7f1ebc0b3170 2023-10-07T08:48:56.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.488+0000 7f1ec333d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ebc069d10 con 0x7f1ebc157a60 2023-10-07T08:48:56.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.488+0000 7f1ec333d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc15c130 con 0x7f1ebc06c190 2023-10-07T08:48:56.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.488+0000 7f1ec18da700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1ebc0b3170 0x7f1ebc06a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34324/0 (socket says 172.21.15.81:34324) 2023-10-07T08:48:56.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.488+0000 7f1ec18da700 1 -- 172.21.15.81:0/2352184245 learned_addr learned my addr 172.21.15.81:0/2352184245 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:56.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.488+0000 7f1ec08d8700 1 --2- 172.21.15.81:0/2352184245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06c190 0x7f1ebc0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:56.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.488+0000 7f1eb3fff700 1 -- 172.21.15.81:0/2352184245 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461205271 0 0) 0x7f1eb4001490 con 0x7f1ebc0b3170 2023-10-07T08:48:56.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.488+0000 7f1eb3fff700 1 -- 172.21.15.81:0/2352184245 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ea8003570 con 0x7f1ebc0b3170 2023-10-07T08:48:56.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.488+0000 7f1eb3fff700 1 -- 172.21.15.81:0/2352184245 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760657952 0 0) 0x7f1ebc069d10 con 0x7f1ebc157a60 2023-10-07T08:48:56.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.488+0000 7f1eb3fff700 1 -- 172.21.15.81:0/2352184245 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eb4001490 con 0x7f1ebc157a60 2023-10-07T08:48:56.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.488+0000 7f1ec08d8700 1 -- 172.21.15.81:0/2352184245 >> v1:172.21.15.89:6789/0 conn(0x7f1ebc157a60 legacy=0x7f1ebc15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:56.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.488+0000 7f1ec08d8700 1 -- 172.21.15.81:0/2352184245 >> v1:172.21.15.81:6789/0 conn(0x7f1ebc0b3170 legacy=0x7f1ebc06a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:56.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.488+0000 7f1ec08d8700 1 -- 172.21.15.81:0/2352184245 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ebc15c410 con 0x7f1ebc06c190 2023-10-07T08:48:56.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.488+0000 7f1ec08d8700 1 --2- 172.21.15.81:0/2352184245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06c190 0x7f1ebc0b2c30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009910 tx=0x7f1eac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8be7639dd91ac0d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:56.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.489+0000 7f1eb3fff700 1 -- 172.21.15.81:0/2352184245 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac011630 con 0x7f1ebc06c190 2023-10-07T08:48:56.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.489+0000 7f1eb3fff700 1 -- 172.21.15.81:0/2352184245 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eac011790 con 0x7f1ebc06c190 2023-10-07T08:48:56.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.489+0000 7f1eb3fff700 1 -- 172.21.15.81:0/2352184245 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac011b30 con 0x7f1ebc06c190 2023-10-07T08:48:56.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.489+0000 7f1ec333d700 1 -- 172.21.15.81:0/2352184245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06c190 msgr2=0x7f1ebc0b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:56.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.489+0000 7f1ec333d700 1 --2- 172.21.15.81:0/2352184245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06c190 0x7f1ebc0b2c30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009910 tx=0x7f1eac0091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:56.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.489+0000 7f1ec333d700 1 -- 172.21.15.81:0/2352184245 shutdown_connections 2023-10-07T08:48:56.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.489+0000 7f1ec333d700 1 --2- 172.21.15.81:0/2352184245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06c190 0x7f1ebc0b2c30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:56.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.489+0000 7f1ec333d700 1 -- 172.21.15.81:0/2352184245 >> 172.21.15.81:0/2352184245 conn(0x7f1ebc06cca0 msgr2=0x7f1ebc06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:56.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.489+0000 7f1ec333d700 1 -- 172.21.15.81:0/2352184245 shutdown_connections 2023-10-07T08:48:56.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.489+0000 7f1ec333d700 1 -- 172.21.15.81:0/2352184245 wait complete. 2023-10-07T08:48:56.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.490+0000 7f1ec333d700 1 Processor -- start 2023-10-07T08:48:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.490+0000 7f1ec333d700 1 -- start start 2023-10-07T08:48:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.491+0000 7f1ec333d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06c190 0x7f1ebc146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.491+0000 7f1ec333d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ebc0b3170 0x7f1ebc0aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.491+0000 7f1ec333d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ebc157a60 0x7f1ebc1510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.491+0000 7f1ec333d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc146ad0 con 0x7f1ebc157a60 2023-10-07T08:48:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.491+0000 7f1ec333d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc0b0d90 con 0x7f1ebc0b3170 2023-10-07T08:48:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.491+0000 7f1ec333d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc0ab0e0 con 0x7f1ebc06c190 2023-10-07T08:48:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.491+0000 7f1ec18da700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ebc157a60 0x7f1ebc1510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.491+0000 7f1ec18da700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ebc157a60 0x7f1ebc1510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52904/0 (socket says 172.21.15.81:52904) 2023-10-07T08:48:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.491+0000 7f1ec18da700 1 -- 172.21.15.81:0/1362229818 learned_addr learned my addr 172.21.15.81:0/1362229818 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.491+0000 7f1ec08d8700 1 --2- 172.21.15.81:0/1362229818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ebc0b3170 0x7f1ebc0aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:56.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.491+0000 7f1ec10d9700 1 --2- 172.21.15.81:0/1362229818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06c190 0x7f1ebc146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:56.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.492+0000 7f1ec18da700 1 -- 172.21.15.81:0/1362229818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06c190 msgr2=0x7f1ebc146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:56.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.492+0000 7f1ec18da700 1 --2- 172.21.15.81:0/1362229818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06c190 0x7f1ebc146590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:56.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.492+0000 7f1ec18da700 1 -- 172.21.15.81:0/1362229818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ebc0b3170 msgr2=0x7f1ebc0aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:56.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.492+0000 7f1ec18da700 1 --2- 172.21.15.81:0/1362229818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ebc0b3170 0x7f1ebc0aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:56.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.492+0000 7f1ec18da700 1 -- 172.21.15.81:0/1362229818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac009420 con 0x7f1ebc157a60 2023-10-07T08:48:56.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.492+0000 7f1ec18da700 1 --2- 172.21.15.81:0/1362229818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ebc157a60 0x7f1ebc1510a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4002070 tx=0x7f1eb4001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:56.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.492+0000 7f1eb17fa700 1 -- 172.21.15.81:0/1362229818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb400aac0 con 0x7f1ebc157a60 2023-10-07T08:48:56.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.492+0000 7f1eb17fa700 1 -- 172.21.15.81:0/1362229818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb400ac40 con 0x7f1ebc157a60 2023-10-07T08:48:56.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.492+0000 7f1ec333d700 1 -- 172.21.15.81:0/1362229818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ebc0ab3c0 con 0x7f1ebc157a60 2023-10-07T08:48:56.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.492+0000 7f1eb17fa700 1 -- 172.21.15.81:0/1362229818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb40070f0 con 0x7f1ebc157a60 2023-10-07T08:48:56.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.492+0000 7f1ec333d700 1 -- 172.21.15.81:0/1362229818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ebc0b0a20 con 0x7f1ebc157a60 2023-10-07T08:48:56.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.493+0000 7f1ec333d700 1 -- 172.21.15.81:0/1362229818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ebc063d20 con 0x7f1ebc157a60 2023-10-07T08:48:56.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.493+0000 7f1eb17fa700 1 -- 172.21.15.81:0/1362229818 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1eb40074a0 con 0x7f1ebc157a60 2023-10-07T08:48:56.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.494+0000 7f1eb17fa700 1 --2- 172.21.15.81:0/1362229818 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1ea0066f30 0x7f1ea00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:56.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.494+0000 7f1ec10d9700 1 --2- 172.21.15.81:0/1362229818 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1ea0066f30 0x7f1ea00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.494+0000 7f1eb17fa700 1 -- 172.21.15.81:0/1362229818 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1eb4084870 con 0x7f1ebc157a60 2023-10-07T08:48:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.494+0000 7f1eb17fa700 1 -- 172.21.15.81:0/1362229818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=126+}) v3 -- 0x7f1ea006ea50 con 0x7f1ebc157a60 2023-10-07T08:48:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.494+0000 7f1ec10d9700 1 --2- 172.21.15.81:0/1362229818 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1ea0066f30 0x7f1ea00693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc06d0e0 tx=0x7f1eb8007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.498+0000 7f1eb17fa700 1 -- 172.21.15.81:0/1362229818 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ebc063d20 con 0x7f1ebc157a60 2023-10-07T08:48:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:56.692+0000 7f1ec333d700 1 -- 172.21.15.81:0/1362229818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f1ebc0b35d0 con 0x7f1ebc157a60 2023-10-07T08:48:57.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.356+0000 7f1eb17fa700 1 -- 172.21.15.81:0/1362229818 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(126..126 src has 1..126) v4 ==== 280+0+0 (secure 0 0 0) 0x7f1eb4055f20 con 0x7f1ebc157a60 2023-10-07T08:48:57.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.356+0000 7f1eb17fa700 1 -- 172.21.15.81:0/1362229818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=127}) v3 -- 0x7f1ea006f340 con 0x7f1ebc157a60 2023-10-07T08:48:57.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.358+0000 7f1eb17fa700 1 -- 172.21.15.81:0/1362229818 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v126) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1ebc0b35d0 con 0x7f1ebc157a60 2023-10-07T08:48:57.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.361+0000 7f1ec333d700 1 -- 172.21.15.81:0/1362229818 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1ea0066f30 msgr2=0x7f1ea00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:57.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.361+0000 7f1ec333d700 1 --2- 172.21.15.81:0/1362229818 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1ea0066f30 0x7f1ea00693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc06d0e0 tx=0x7f1eb8007d50 comp rx=0 tx=0).stop 2023-10-07T08:48:57.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.361+0000 7f1ec333d700 1 -- 172.21.15.81:0/1362229818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ebc157a60 msgr2=0x7f1ebc1510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:57.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.361+0000 7f1ec333d700 1 --2- 172.21.15.81:0/1362229818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ebc157a60 0x7f1ebc1510a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4002070 tx=0x7f1eb4001c70 comp rx=0 tx=0).stop 2023-10-07T08:48:57.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.361+0000 7f1ec333d700 1 -- 172.21.15.81:0/1362229818 shutdown_connections 2023-10-07T08:48:57.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.361+0000 7f1ec333d700 1 --2- 172.21.15.81:0/1362229818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ebc157a60 0x7f1ebc1510a0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:57.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.361+0000 7f1ec333d700 1 --2- 172.21.15.81:0/1362229818 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1ea0066f30 0x7f1ea00693e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:57.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.361+0000 7f1ec333d700 1 --2- 172.21.15.81:0/1362229818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc06c190 0x7f1ebc146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:57.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.361+0000 7f1ec333d700 1 --2- 172.21.15.81:0/1362229818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ebc0b3170 0x7f1ebc0aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:57.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.361+0000 7f1ec333d700 1 -- 172.21.15.81:0/1362229818 >> 172.21.15.81:0/1362229818 conn(0x7f1ebc06cca0 msgr2=0x7f1ebc15d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:57.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.361+0000 7f1ec333d700 1 -- 172.21.15.81:0/1362229818 shutdown_connections 2023-10-07T08:48:57.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.361+0000 7f1ec333d700 1 -- 172.21.15.81:0/1362229818 wait complete. 2023-10-07T08:48:57.364 INFO:teuthology.orchestra.run.smithi081.stderr:pauserd,pausewr is unset 2023-10-07T08:48:57.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:48:57.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.487+0000 7f93c2de8700 1 Processor -- start 2023-10-07T08:48:57.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.487+0000 7f93c2de8700 1 -- start start 2023-10-07T08:48:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.488+0000 7f93c2de8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f93bc1578d0 0x7f93bc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.488+0000 7f93c2de8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93bc0d07c0 con 0x7f93bc06d120 2023-10-07T08:48:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.488+0000 7f93c2de8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93bc0cfbb0 con 0x7f93bc157ca0 2023-10-07T08:48:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.488+0000 7f93c2de8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93bc0cfe90 con 0x7f93bc1578d0 2023-10-07T08:48:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.488+0000 7f93c0b84700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f93bc1578d0 0x7f93bc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.488+0000 7f93c0b84700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f93bc1578d0 0x7f93bc0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52908/0 (socket says 172.21.15.81:52908) 2023-10-07T08:48:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.488+0000 7f93c1385700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f93bc06d120 0x7f93bc06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34326/0 (socket says 172.21.15.81:34326) 2023-10-07T08:48:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.488+0000 7f93c0b84700 1 -- 172.21.15.81:0/2468166266 learned_addr learned my addr 172.21.15.81:0/2468166266 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.488+0000 7f93c0b84700 1 -- 172.21.15.81:0/2468166266 >> v1:172.21.15.89:6789/0 conn(0x7f93bc157ca0 legacy=0x7f93bc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:57.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.488+0000 7f93c0b84700 1 -- 172.21.15.81:0/2468166266 >> v1:172.21.15.81:6789/0 conn(0x7f93bc06d120 legacy=0x7f93bc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:57.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.488+0000 7f93c0b84700 1 -- 172.21.15.81:0/2468166266 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc0d0170 con 0x7f93bc1578d0 2023-10-07T08:48:57.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.488+0000 7f93b37fe700 1 -- 172.21.15.81:0/2468166266 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793026505 0 0) 0x7f93bc0d07c0 con 0x7f93bc06d120 2023-10-07T08:48:57.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.489+0000 7f93c0b84700 1 --2- 172.21.15.81:0/2468166266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc1578d0 0x7f93bc0cf4f0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f93b80099b0 tx=0x7f93b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26987656aca12364 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:57.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.489+0000 7f93b37fe700 1 -- 172.21.15.81:0/2468166266 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b800b860 con 0x7f93bc1578d0 2023-10-07T08:48:57.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.489+0000 7f93b37fe700 1 -- 172.21.15.81:0/2468166266 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b800b9c0 con 0x7f93bc1578d0 2023-10-07T08:48:57.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.489+0000 7f93b37fe700 1 -- 172.21.15.81:0/2468166266 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b800bd60 con 0x7f93bc1578d0 2023-10-07T08:48:57.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.489+0000 7f93c2de8700 1 -- 172.21.15.81:0/2468166266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc1578d0 msgr2=0x7f93bc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:57.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.489+0000 7f93c2de8700 1 --2- 172.21.15.81:0/2468166266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc1578d0 0x7f93bc0cf4f0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f93b80099b0 tx=0x7f93b8009250 comp rx=0 tx=0).stop 2023-10-07T08:48:57.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.489+0000 7f93c2de8700 1 -- 172.21.15.81:0/2468166266 shutdown_connections 2023-10-07T08:48:57.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.489+0000 7f93c2de8700 1 --2- 172.21.15.81:0/2468166266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc1578d0 0x7f93bc0cf4f0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:57.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.489+0000 7f93c2de8700 1 -- 172.21.15.81:0/2468166266 >> 172.21.15.81:0/2468166266 conn(0x7f93bc06bb90 msgr2=0x7f93bc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:57.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.489+0000 7f93c2de8700 1 -- 172.21.15.81:0/2468166266 shutdown_connections 2023-10-07T08:48:57.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.489+0000 7f93c2de8700 1 -- 172.21.15.81:0/2468166266 wait complete. 2023-10-07T08:48:57.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.490+0000 7f93c2de8700 1 Processor -- start 2023-10-07T08:48:57.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.491+0000 7f93c2de8700 1 -- start start 2023-10-07T08:48:57.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.491+0000 7f93c2de8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93bc06d120 0x7f93bc0cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.491+0000 7f93c2de8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93bc1578d0 0x7f93bc16e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.491+0000 7f93c2de8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc157ca0 0x7f93bc152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.491+0000 7f93c2de8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc0b5360 con 0x7f93bc157ca0 2023-10-07T08:48:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.491+0000 7f93c2de8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc16ea20 con 0x7f93bc1578d0 2023-10-07T08:48:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.491+0000 7f93c2de8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc0cdc40 con 0x7f93bc06d120 2023-10-07T08:48:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.491+0000 7f93c1385700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc157ca0 0x7f93bc152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.491+0000 7f93c1385700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc157ca0 0x7f93bc152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52924/0 (socket says 172.21.15.81:52924) 2023-10-07T08:48:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.491+0000 7f93c1385700 1 -- 172.21.15.81:0/2829872900 learned_addr learned my addr 172.21.15.81:0/2829872900 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.492+0000 7f93c0b84700 1 --2- 172.21.15.81:0/2829872900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93bc06d120 0x7f93bc0cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.492+0000 7f93b3fff700 1 --2- 172.21.15.81:0/2829872900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93bc1578d0 0x7f93bc16e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.492+0000 7f93c1385700 1 -- 172.21.15.81:0/2829872900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93bc06d120 msgr2=0x7f93bc0cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.492+0000 7f93c1385700 1 --2- 172.21.15.81:0/2829872900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93bc06d120 0x7f93bc0cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.492+0000 7f93c1385700 1 -- 172.21.15.81:0/2829872900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93bc1578d0 msgr2=0x7f93bc16e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.492+0000 7f93c1385700 1 --2- 172.21.15.81:0/2829872900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93bc1578d0 0x7f93bc16e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.492+0000 7f93c1385700 1 -- 172.21.15.81:0/2829872900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b80094f0 con 0x7f93bc157ca0 2023-10-07T08:48:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.492+0000 7f93c0b84700 1 --2- 172.21.15.81:0/2829872900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93bc06d120 0x7f93bc0cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:48:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.492+0000 7f93c1385700 1 --2- 172.21.15.81:0/2829872900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc157ca0 0x7f93bc152a60 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f93b400cd80 tx=0x7f93b4001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.492+0000 7f93b0ff9700 1 -- 172.21.15.81:0/2829872900 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4005df0 con 0x7f93bc157ca0 2023-10-07T08:48:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.492+0000 7f93b0ff9700 1 -- 172.21.15.81:0/2829872900 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b400a960 con 0x7f93bc157ca0 2023-10-07T08:48:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.492+0000 7f93c2de8700 1 -- 172.21.15.81:0/2829872900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93bc0b4d10 con 0x7f93bc157ca0 2023-10-07T08:48:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.492+0000 7f93b0ff9700 1 -- 172.21.15.81:0/2829872900 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b400ad00 con 0x7f93bc157ca0 2023-10-07T08:48:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.492+0000 7f93c2de8700 1 -- 172.21.15.81:0/2829872900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93bc152fa0 con 0x7f93bc157ca0 2023-10-07T08:48:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.493+0000 7f93c2de8700 1 -- 172.21.15.81:0/2829872900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93bc0b4b70 con 0x7f93bc157ca0 2023-10-07T08:48:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.493+0000 7f93b0ff9700 1 -- 172.21.15.81:0/2829872900 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93b4007300 con 0x7f93bc157ca0 2023-10-07T08:48:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.494+0000 7f93b0ff9700 1 --2- 172.21.15.81:0/2829872900 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93a8066fb0 0x7f93a8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.494+0000 7f93b0ff9700 1 -- 172.21.15.81:0/2829872900 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f93b4084830 con 0x7f93bc157ca0 2023-10-07T08:48:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.494+0000 7f93c0b84700 1 --2- 172.21.15.81:0/2829872900 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93a8066fb0 0x7f93a8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.494+0000 7f93c0b84700 1 --2- 172.21.15.81:0/2829872900 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93a8066fb0 0x7f93a8069460 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f93b80099b0 tx=0x7f93b8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.498+0000 7f93b0ff9700 1 -- 172.21.15.81:0/2829872900 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93bc0b4b70 con 0x7f93bc157ca0 2023-10-07T08:48:57.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.683+0000 7f93c2de8700 1 -- 172.21.15.81:0/2829872900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93bc0b4b70 con 0x7f93bc157ca0 2023-10-07T08:48:57.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.684+0000 7f93b0ff9700 1 -- 172.21.15.81:0/2829872900 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+15324 (secure 0 0 0) 0x7f93bc0b4b70 con 0x7f93bc157ca0 2023-10-07T08:48:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:57.685 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":126,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:48:57.355708+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:48:38.552036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-07T08:48:39.627974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:48:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.686+0000 7f93c2de8700 1 -- 172.21.15.81:0/2829872900 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93a8066fb0 msgr2=0x7f93a8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.686+0000 7f93c2de8700 1 --2- 172.21.15.81:0/2829872900 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93a8066fb0 0x7f93a8069460 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f93b80099b0 tx=0x7f93b8017000 comp rx=0 tx=0).stop 2023-10-07T08:48:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.686+0000 7f93c2de8700 1 -- 172.21.15.81:0/2829872900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc157ca0 msgr2=0x7f93bc152a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.686+0000 7f93c2de8700 1 --2- 172.21.15.81:0/2829872900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc157ca0 0x7f93bc152a60 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f93b400cd80 tx=0x7f93b4001b40 comp rx=0 tx=0).stop 2023-10-07T08:48:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.686+0000 7f93c2de8700 1 -- 172.21.15.81:0/2829872900 shutdown_connections 2023-10-07T08:48:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.686+0000 7f93c2de8700 1 --2- 172.21.15.81:0/2829872900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc157ca0 0x7f93bc152a60 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.686+0000 7f93c2de8700 1 --2- 172.21.15.81:0/2829872900 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93a8066fb0 0x7f93a8069460 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.686+0000 7f93c2de8700 1 --2- 172.21.15.81:0/2829872900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93bc06d120 0x7f93bc0cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.686+0000 7f93c2de8700 1 --2- 172.21.15.81:0/2829872900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93bc1578d0 0x7f93bc16e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.686+0000 7f93c2de8700 1 -- 172.21.15.81:0/2829872900 >> 172.21.15.81:0/2829872900 conn(0x7f93bc06bb90 msgr2=0x7f93bc15a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:57.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.686+0000 7f93c2de8700 1 -- 172.21.15.81:0/2829872900 shutdown_connections 2023-10-07T08:48:57.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:57.686+0000 7f93c2de8700 1 -- 172.21.15.81:0/2829872900 wait complete. 2023-10-07T08:48:57.699 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-07T08:48:57.699 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-07T08:48:57.700 DEBUG:teuthology.orchestra.run.smithi081:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-07T08:48:57.700 DEBUG:teuthology.orchestra.run.smithi081:> os.fchmod(fd, 0O666) 2023-10-07T08:48:57.700 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(fd) 2023-10-07T08:48:57.700 DEBUG:teuthology.orchestra.run.smithi081:> os.close(fd) 2023-10-07T08:48:57.700 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-07T08:48:57.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:48:57.953 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-07T08:48:58.021 INFO:teuthology.orchestra.run.smithi081.stdout:client6930 2023-10-07T08:48:58.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:58.022 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f2fc6535-cadc-4a0b-bdad-da2d602c784a.client6930/osdmap') 2023-10-07T08:48:58.096 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 123 barrier 123 flags 0x588000 2023-10-07T08:48:58.096 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:48:58.097 INFO:teuthology.orchestra.run.smithi081.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:48:58.097 INFO:teuthology.orchestra.run.smithi081.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:48:58.097 INFO:teuthology.orchestra.run.smithi081.stdout:osd0 (1)172.21.15.81:6801 100% (exists, up) 100% -1 2023-10-07T08:48:58.097 INFO:teuthology.orchestra.run.smithi081.stdout:osd1 (1)172.21.15.81:6819 100% (exists, up) 100% -1 2023-10-07T08:48:58.097 INFO:teuthology.orchestra.run.smithi081.stdout:osd2 (1)172.21.15.81:6818 100% (exists, up) 100% -1 2023-10-07T08:48:58.097 INFO:teuthology.orchestra.run.smithi081.stdout:osd3 (1)172.21.15.81:6809 100% (exists, up) 100% -1 2023-10-07T08:48:58.097 INFO:teuthology.orchestra.run.smithi081.stdout:osd4 (1)172.21.15.89:6801 100% (exists, up) 100% -1 2023-10-07T08:48:58.097 INFO:teuthology.orchestra.run.smithi081.stdout:osd5 (1)172.21.15.89:6817 100% (exists, up) 100% -1 2023-10-07T08:48:58.097 INFO:teuthology.orchestra.run.smithi081.stdout:osd6 (1)172.21.15.89:6824 100% (exists, up) 100% -1 2023-10-07T08:48:58.097 INFO:teuthology.orchestra.run.smithi081.stdout:osd7 (1)172.21.15.89:6809 100% (exists, up) 100% -1 2023-10-07T08:48:58.098 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records in 2023-10-07T08:48:58.098 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records out 2023-10-07T08:48:58.098 INFO:teuthology.orchestra.run.smithi081.stderr:795 bytes copied, 5.0515e-05 s, 15.7 MB/s 2023-10-07T08:48:58.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:48:58.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.252+0000 7f69ecbce700 1 Processor -- start 2023-10-07T08:48:58.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.252+0000 7f69ecbce700 1 -- start start 2023-10-07T08:48:58.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.253+0000 7f69ecbce700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f69e8157ca0 0x7f69e80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:58.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.253+0000 7f69ecbce700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69e806d120 0x7f69e806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:58.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.253+0000 7f69ecbce700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e80d07c0 con 0x7f69e81578d0 2023-10-07T08:48:58.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.253+0000 7f69ecbce700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e806da50 con 0x7f69e806d120 2023-10-07T08:48:58.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.253+0000 7f69ecbce700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e80cfbb0 con 0x7f69e8157ca0 2023-10-07T08:48:58.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.253+0000 7f69e6d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69e806d120 0x7f69e806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:58.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.253+0000 7f69e659c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f69e81578d0 0x7f69e815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34338/0 (socket says 172.21.15.81:34338) 2023-10-07T08:48:58.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.253+0000 7f69e659c700 1 -- 172.21.15.81:0/1862073367 learned_addr learned my addr 172.21.15.81:0/1862073367 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:58.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.253+0000 7f69e6d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69e806d120 0x7f69e806d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52930/0 (socket says 172.21.15.81:52930) 2023-10-07T08:48:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.253+0000 7f69ddd9b700 1 --2- 172.21.15.81:0/1862073367 >> v2:172.21.15.89:3300/0 conn(0x7f69e8157ca0 0x7f69e80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.253+0000 7f69e6d9d700 1 -- 172.21.15.81:0/1862073367 >> v2:172.21.15.89:3300/0 conn(0x7f69e8157ca0 msgr2=0x7f69e80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.253+0000 7f69e6d9d700 1 --2- 172.21.15.81:0/1862073367 >> v2:172.21.15.89:3300/0 conn(0x7f69e8157ca0 0x7f69e80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.253+0000 7f69e6d9d700 1 -- 172.21.15.81:0/1862073367 >> v1:172.21.15.81:6789/0 conn(0x7f69e81578d0 legacy=0x7f69e815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.254+0000 7f69e5d9b700 1 -- 172.21.15.81:0/1862073367 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019374695 0 0) 0x7f69e80d07c0 con 0x7f69e81578d0 2023-10-07T08:48:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.254+0000 7f69e6d9d700 1 -- 172.21.15.81:0/1862073367 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e80cfe90 con 0x7f69e806d120 2023-10-07T08:48:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.254+0000 7f69e6d9d700 1 --2- 172.21.15.81:0/1862073367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e806d120 0x7f69e806d510 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f69e8068510 tx=0x7f69e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24476b640899df6b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.254+0000 7f69e5d9b700 1 -- 172.21.15.81:0/1862073367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000e070 con 0x7f69e806d120 2023-10-07T08:48:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.254+0000 7f69e5d9b700 1 -- 172.21.15.81:0/1862073367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e000bc30 con 0x7f69e806d120 2023-10-07T08:48:58.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.254+0000 7f69e5d9b700 1 -- 172.21.15.81:0/1862073367 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0012430 con 0x7f69e806d120 2023-10-07T08:48:58.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.254+0000 7f69ecbce700 1 -- 172.21.15.81:0/1862073367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e806d120 msgr2=0x7f69e806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:58.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.254+0000 7f69ecbce700 1 --2- 172.21.15.81:0/1862073367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e806d120 0x7f69e806d510 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f69e8068510 tx=0x7f69e0009780 comp rx=0 tx=0).stop 2023-10-07T08:48:58.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.254+0000 7f69ecbce700 1 -- 172.21.15.81:0/1862073367 shutdown_connections 2023-10-07T08:48:58.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.254+0000 7f69ecbce700 1 --2- 172.21.15.81:0/1862073367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e806d120 0x7f69e806d510 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:58.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.254+0000 7f69ecbce700 1 --2- 172.21.15.81:0/1862073367 >> v2:172.21.15.89:3300/0 conn(0x7f69e8157ca0 0x7f69e80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:58.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.254+0000 7f69ecbce700 1 -- 172.21.15.81:0/1862073367 >> 172.21.15.81:0/1862073367 conn(0x7f69e806bb90 msgr2=0x7f69e806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:58.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.254+0000 7f69ecbce700 1 -- 172.21.15.81:0/1862073367 shutdown_connections 2023-10-07T08:48:58.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.254+0000 7f69ecbce700 1 -- 172.21.15.81:0/1862073367 wait complete. 2023-10-07T08:48:58.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.256+0000 7f69ecbce700 1 Processor -- start 2023-10-07T08:48:58.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.256+0000 7f69ecbce700 1 -- start start 2023-10-07T08:48:58.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.256+0000 7f69ecbce700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e806d120 0x7f69e80b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:58.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.256+0000 7f69ecbce700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e81578d0 0x7f69e80ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:58.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.256+0000 7f69ecbce700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e8157ca0 0x7f69e8159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:58.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.256+0000 7f69ecbce700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80b6240 con 0x7f69e8157ca0 2023-10-07T08:48:58.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.256+0000 7f69ecbce700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80b6490 con 0x7f69e81578d0 2023-10-07T08:48:58.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.256+0000 7f69ecbce700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80b6770 con 0x7f69e806d120 2023-10-07T08:48:58.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.256+0000 7f69e6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e8157ca0 0x7f69e8159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:58.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.256+0000 7f69e6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e8157ca0 0x7f69e8159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52940/0 (socket says 172.21.15.81:52940) 2023-10-07T08:48:58.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.256+0000 7f69e6d9d700 1 -- 172.21.15.81:0/190579560 learned_addr learned my addr 172.21.15.81:0/190579560 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:58.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.257+0000 7f69ddd9b700 1 --2- 172.21.15.81:0/190579560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e81578d0 0x7f69e80ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:58.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.257+0000 7f69e6d9d700 1 -- 172.21.15.81:0/190579560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e806d120 msgr2=0x7f69e80b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:58.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.257+0000 7f69e6d9d700 1 --2- 172.21.15.81:0/190579560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e806d120 0x7f69e80b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:58.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.257+0000 7f69e6d9d700 1 -- 172.21.15.81:0/190579560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e81578d0 msgr2=0x7f69e80ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:58.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.257+0000 7f69e6d9d700 1 --2- 172.21.15.81:0/190579560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e81578d0 0x7f69e80ab350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:58.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.257+0000 7f69e6d9d700 1 -- 172.21.15.81:0/190579560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e0009a20 con 0x7f69e8157ca0 2023-10-07T08:48:58.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.257+0000 7f69ddd9b700 1 --2- 172.21.15.81:0/190579560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e81578d0 0x7f69e80ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:48:58.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.257+0000 7f69e6d9d700 1 --2- 172.21.15.81:0/190579560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e8157ca0 0x7f69e8159380 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f69e806fe20 tx=0x7f69e0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:58.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.257+0000 7f69deffd700 1 -- 172.21.15.81:0/190579560 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0012ea0 con 0x7f69e8157ca0 2023-10-07T08:48:58.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.257+0000 7f69deffd700 1 -- 172.21.15.81:0/190579560 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e001d630 con 0x7f69e8157ca0 2023-10-07T08:48:58.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.257+0000 7f69ecbce700 1 -- 172.21.15.81:0/190579560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e80b6a50 con 0x7f69e8157ca0 2023-10-07T08:48:58.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.257+0000 7f69deffd700 1 -- 172.21.15.81:0/190579560 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e001d9f0 con 0x7f69e8157ca0 2023-10-07T08:48:58.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.257+0000 7f69ecbce700 1 -- 172.21.15.81:0/190579560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e80ab910 con 0x7f69e8157ca0 2023-10-07T08:48:58.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.258+0000 7f69ecbce700 1 -- 172.21.15.81:0/190579560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e8067ac0 con 0x7f69e8157ca0 2023-10-07T08:48:58.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.258+0000 7f69deffd700 1 -- 172.21.15.81:0/190579560 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69e0024070 con 0x7f69e8157ca0 2023-10-07T08:48:58.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.259+0000 7f69deffd700 1 --2- 172.21.15.81:0/190579560 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f69c8066f30 0x7f69c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:58.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.259+0000 7f69deffd700 1 -- 172.21.15.81:0/190579560 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f69e0086d30 con 0x7f69e8157ca0 2023-10-07T08:48:58.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.259+0000 7f69e659c700 1 --2- 172.21.15.81:0/190579560 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f69c8066f30 0x7f69c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:58.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.259+0000 7f69e659c700 1 --2- 172.21.15.81:0/190579560 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f69c8066f30 0x7f69c80693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f69d80011e0 tx=0x7f69d80079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:58.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.263+0000 7f69deffd700 1 -- 172.21.15.81:0/190579560 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69e0053fa0 con 0x7f69e8157ca0 2023-10-07T08:48:58.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.488+0000 7f69ecbce700 1 -- 172.21.15.81:0/190579560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69e80d0170 con 0x7f69e8157ca0 2023-10-07T08:48:58.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.489+0000 7f69deffd700 1 -- 172.21.15.81:0/190579560 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f69e00575c0 con 0x7f69e8157ca0 2023-10-07T08:48:58.491 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:58.491 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/2384735966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2384735966},{"type":"v1","addr":"172.21.15.89:6834","nonce":2384735966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1456306972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1456306972},{"type":"v1","addr":"172.21.15.89:6835","nonce":1456306972}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3356050793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3356050793},{"type":"v1","addr":"172.21.15.81:6836","nonce":3356050793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:48:40.667880+0000","modified":"2023-10-07T08:48:44.308458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6741":{"gid":6741,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2231384962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2231384962},{"type":"v1","addr":"172.21.15.81:6837","nonce":2231384962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-07T08:48:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.491+0000 7f69ecbce700 1 -- 172.21.15.81:0/190579560 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f69c8066f30 msgr2=0x7f69c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.491+0000 7f69ecbce700 1 --2- 172.21.15.81:0/190579560 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f69c8066f30 0x7f69c80693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f69d80011e0 tx=0x7f69d80079d0 comp rx=0 tx=0).stop 2023-10-07T08:48:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.491+0000 7f69ecbce700 1 -- 172.21.15.81:0/190579560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e8157ca0 msgr2=0x7f69e8159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.491+0000 7f69ecbce700 1 --2- 172.21.15.81:0/190579560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e8157ca0 0x7f69e8159380 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f69e806fe20 tx=0x7f69e0019000 comp rx=0 tx=0).stop 2023-10-07T08:48:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.491+0000 7f69ecbce700 1 -- 172.21.15.81:0/190579560 shutdown_connections 2023-10-07T08:48:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.491+0000 7f69ecbce700 1 --2- 172.21.15.81:0/190579560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e8157ca0 0x7f69e8159380 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.491+0000 7f69ecbce700 1 --2- 172.21.15.81:0/190579560 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f69c8066f30 0x7f69c80693e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.491+0000 7f69ecbce700 1 --2- 172.21.15.81:0/190579560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69e806d120 0x7f69e80b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.491+0000 7f69ecbce700 1 --2- 172.21.15.81:0/190579560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e81578d0 0x7f69e80ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.491+0000 7f69ecbce700 1 -- 172.21.15.81:0/190579560 >> 172.21.15.81:0/190579560 conn(0x7f69e806bb90 msgr2=0x7f69e81554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.491+0000 7f69ecbce700 1 -- 172.21.15.81:0/190579560 shutdown_connections 2023-10-07T08:48:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:58.491+0000 7f69ecbce700 1 -- 172.21.15.81:0/190579560 wait complete. 2023-10-07T08:48:58.496 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 58 2023-10-07T08:48:58.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 126 2023-10-07T08:48:58.635 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-07T08:48:58.635 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-07T08:48:58.635 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-07T08:48:58.635 DEBUG:teuthology.orchestra.run.smithi081:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-07T08:48:58.636 DEBUG:teuthology.orchestra.run.smithi081:> os.fchmod(fd, 0O666) 2023-10-07T08:48:58.636 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(fd) 2023-10-07T08:48:58.636 DEBUG:teuthology.orchestra.run.smithi081:> os.close(fd) 2023-10-07T08:48:58.636 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-07T08:48:58.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:48:58.889 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-07T08:48:58.957 INFO:teuthology.orchestra.run.smithi081.stdout:client6930 2023-10-07T08:48:58.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:58.958 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f2fc6535-cadc-4a0b-bdad-da2d602c784a.client6930/osdmap') 2023-10-07T08:48:59.033 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 126 barrier 126 flags 0x588000 2023-10-07T08:48:59.034 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:48:59.034 INFO:teuthology.orchestra.run.smithi081.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:48:59.034 INFO:teuthology.orchestra.run.smithi081.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:48:59.034 INFO:teuthology.orchestra.run.smithi081.stdout:osd0 (1)172.21.15.81:6801 100% (exists, up) 100% -1 2023-10-07T08:48:59.034 INFO:teuthology.orchestra.run.smithi081.stdout:osd1 (1)172.21.15.81:6819 100% (exists, up) 100% -1 2023-10-07T08:48:59.034 INFO:teuthology.orchestra.run.smithi081.stdout:osd2 (1)172.21.15.81:6818 100% (exists, up) 100% -1 2023-10-07T08:48:59.034 INFO:teuthology.orchestra.run.smithi081.stdout:osd3 (1)172.21.15.81:6809 100% (exists, up) 100% -1 2023-10-07T08:48:59.034 INFO:teuthology.orchestra.run.smithi081.stdout:osd4 (1)172.21.15.89:6801 100% (exists, up) 100% -1 2023-10-07T08:48:59.034 INFO:teuthology.orchestra.run.smithi081.stdout:osd5 (1)172.21.15.89:6817 100% (exists, up) 100% -1 2023-10-07T08:48:59.034 INFO:teuthology.orchestra.run.smithi081.stdout:osd6 (1)172.21.15.89:6824 100% (exists, up) 100% -1 2023-10-07T08:48:59.035 INFO:teuthology.orchestra.run.smithi081.stdout:osd7 (1)172.21.15.89:6809 100% (exists, up) 100% -1 2023-10-07T08:48:59.035 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records in 2023-10-07T08:48:59.035 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records out 2023-10-07T08:48:59.036 INFO:teuthology.orchestra.run.smithi081.stderr:795 bytes copied, 3.6492e-05 s, 21.8 MB/s 2023-10-07T08:48:59.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:48:59.036 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-07T08:48:59.103 INFO:teuthology.orchestra.run.smithi081.stdout:client6930 2023-10-07T08:48:59.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:59.104 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f2fc6535-cadc-4a0b-bdad-da2d602c784a.client6930/osdmap') 2023-10-07T08:48:59.179 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 126 barrier 126 flags 0x588000 2023-10-07T08:48:59.180 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:48:59.180 INFO:teuthology.orchestra.run.smithi081.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:48:59.180 INFO:teuthology.orchestra.run.smithi081.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-07T08:48:59.180 INFO:teuthology.orchestra.run.smithi081.stdout:osd0 (1)172.21.15.81:6801 100% (exists, up) 100% -1 2023-10-07T08:48:59.180 INFO:teuthology.orchestra.run.smithi081.stdout:osd1 (1)172.21.15.81:6819 100% (exists, up) 100% -1 2023-10-07T08:48:59.180 INFO:teuthology.orchestra.run.smithi081.stdout:osd2 (1)172.21.15.81:6818 100% (exists, up) 100% -1 2023-10-07T08:48:59.180 INFO:teuthology.orchestra.run.smithi081.stdout:osd3 (1)172.21.15.81:6809 100% (exists, up) 100% -1 2023-10-07T08:48:59.180 INFO:teuthology.orchestra.run.smithi081.stdout:osd4 (1)172.21.15.89:6801 100% (exists, up) 100% -1 2023-10-07T08:48:59.180 INFO:teuthology.orchestra.run.smithi081.stdout:osd5 (1)172.21.15.89:6817 100% (exists, up) 100% -1 2023-10-07T08:48:59.180 INFO:teuthology.orchestra.run.smithi081.stdout:osd6 (1)172.21.15.89:6824 100% (exists, up) 100% -1 2023-10-07T08:48:59.181 INFO:teuthology.orchestra.run.smithi081.stdout:osd7 (1)172.21.15.89:6809 100% (exists, up) 100% -1 2023-10-07T08:48:59.181 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records in 2023-10-07T08:48:59.181 INFO:teuthology.orchestra.run.smithi081.stderr:1+1 records out 2023-10-07T08:48:59.182 INFO:teuthology.orchestra.run.smithi081.stderr:795 bytes copied, 3.4042e-05 s, 23.4 MB/s 2023-10-07T08:48:59.182 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-07T08:48:59.182 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:48:59.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:48:59.256 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:48:59.298 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:48:59.298 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T08:48:59.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:48:59.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T08:48:59.370 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:48:59.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:59.371 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T08:48:59.385 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T08:48:59.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:48:59.385 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T08:48:59.423 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:48:59.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:48:59.423 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T08:48:59.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:48:59.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.592+0000 7f5849bf4700 1 Processor -- start 2023-10-07T08:48:59.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.592+0000 7f5849bf4700 1 -- start start 2023-10-07T08:48:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f5849bf4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58441578d0 0x7f58440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f5849bf4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5844157ca0 0x7f584415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f5849bf4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f584406d120 0x7f584406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f5849bf4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584406dac0 con 0x7f584406d120 2023-10-07T08:48:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f5849bf4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58440d07c0 con 0x7f5844157ca0 2023-10-07T08:48:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f5849bf4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58440cfbb0 con 0x7f58441578d0 2023-10-07T08:48:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f5843fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f584406d120 0x7f584406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:59.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f5843fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f584406d120 0x7f584406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52942/0 (socket says 172.21.15.81:52942) 2023-10-07T08:48:59.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f5843fff700 1 -- 172.21.15.81:0/2597485059 learned_addr learned my addr 172.21.15.81:0/2597485059 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:59.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f58437fe700 1 --2- 172.21.15.81:0/2597485059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58441578d0 0x7f58440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:59.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f5842ffd700 1 --2- 172.21.15.81:0/2597485059 >> v2:172.21.15.89:3300/0 conn(0x7f5844157ca0 0x7f584415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:59.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f5843fff700 1 -- 172.21.15.81:0/2597485059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58441578d0 msgr2=0x7f58440cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:59.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f5843fff700 1 --2- 172.21.15.81:0/2597485059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58441578d0 0x7f58440cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:59.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f5843fff700 1 -- 172.21.15.81:0/2597485059 >> v2:172.21.15.89:3300/0 conn(0x7f5844157ca0 msgr2=0x7f584415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:48:59.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f5843fff700 1 --2- 172.21.15.81:0/2597485059 >> v2:172.21.15.89:3300/0 conn(0x7f5844157ca0 0x7f584415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:59.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f5843fff700 1 -- 172.21.15.81:0/2597485059 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58440cfe90 con 0x7f584406d120 2023-10-07T08:48:59.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f5843fff700 1 --2- 172.21.15.81:0/2597485059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f584406d120 0x7f584406d580 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f584406cb70 tx=0x7f583c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a255e6bd61ea1d56 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:59.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f58427fc700 1 -- 172.21.15.81:0/2597485059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c00e070 con 0x7f584406d120 2023-10-07T08:48:59.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f58427fc700 1 -- 172.21.15.81:0/2597485059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c00ba50 con 0x7f584406d120 2023-10-07T08:48:59.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.593+0000 7f58427fc700 1 -- 172.21.15.81:0/2597485059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c0092e0 con 0x7f584406d120 2023-10-07T08:48:59.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.594+0000 7f5849bf4700 1 -- 172.21.15.81:0/2597485059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f584406d120 msgr2=0x7f584406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:59.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.594+0000 7f5849bf4700 1 --2- 172.21.15.81:0/2597485059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f584406d120 0x7f584406d580 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f584406cb70 tx=0x7f583c009840 comp rx=0 tx=0).stop 2023-10-07T08:48:59.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.594+0000 7f5849bf4700 1 -- 172.21.15.81:0/2597485059 shutdown_connections 2023-10-07T08:48:59.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.594+0000 7f5849bf4700 1 --2- 172.21.15.81:0/2597485059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f584406d120 0x7f584406d580 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:59.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.594+0000 7f5849bf4700 1 --2- 172.21.15.81:0/2597485059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58441578d0 0x7f58440cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.594+0000 7f5849bf4700 1 --2- 172.21.15.81:0/2597485059 >> v2:172.21.15.89:3300/0 conn(0x7f5844157ca0 0x7f584415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.594+0000 7f5849bf4700 1 -- 172.21.15.81:0/2597485059 >> 172.21.15.81:0/2597485059 conn(0x7f584406bb90 msgr2=0x7f584406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.594+0000 7f5849bf4700 1 -- 172.21.15.81:0/2597485059 shutdown_connections 2023-10-07T08:48:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.594+0000 7f5849bf4700 1 -- 172.21.15.81:0/2597485059 wait complete. 2023-10-07T08:48:59.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.595+0000 7f5849bf4700 1 Processor -- start 2023-10-07T08:48:59.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.595+0000 7f5849bf4700 1 -- start start 2023-10-07T08:48:59.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f5849bf4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f584406d120 0x7f5844154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:59.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f5849bf4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58441578d0 0x7f584415ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:59.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f5849bf4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5844157ca0 0x7f58440b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:59.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f5849bf4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5844155050 con 0x7f5844157ca0 2023-10-07T08:48:59.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f5849bf4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5844160520 con 0x7f58441578d0 2023-10-07T08:48:59.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f5849bf4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584415ef40 con 0x7f584406d120 2023-10-07T08:48:59.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f5843fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5844157ca0 0x7f58440b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:59.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f5843fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5844157ca0 0x7f58440b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52958/0 (socket says 172.21.15.81:52958) 2023-10-07T08:48:59.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f5843fff700 1 -- 172.21.15.81:0/1365077898 learned_addr learned my addr 172.21.15.81:0/1365077898 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:59.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f58437fe700 1 --2- 172.21.15.81:0/1365077898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f584406d120 0x7f5844154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:59.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f5842ffd700 1 --2- 172.21.15.81:0/1365077898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58441578d0 0x7f584415ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:59.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f5843fff700 1 -- 172.21.15.81:0/1365077898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f584406d120 msgr2=0x7f5844154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:59.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f5843fff700 1 --2- 172.21.15.81:0/1365077898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f584406d120 0x7f5844154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:59.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f5843fff700 1 -- 172.21.15.81:0/1365077898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58441578d0 msgr2=0x7f584415ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:59.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f5843fff700 1 --2- 172.21.15.81:0/1365077898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58441578d0 0x7f584415ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:59.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f5843fff700 1 -- 172.21.15.81:0/1365077898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c009ae0 con 0x7f5844157ca0 2023-10-07T08:48:59.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.596+0000 7f5843fff700 1 --2- 172.21.15.81:0/1365077898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5844157ca0 0x7f58440b59a0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f584406fe20 tx=0x7f583c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:59.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.597+0000 7f582b7fe700 1 -- 172.21.15.81:0/1365077898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c0032f0 con 0x7f5844157ca0 2023-10-07T08:48:59.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.597+0000 7f582b7fe700 1 -- 172.21.15.81:0/1365077898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c008d20 con 0x7f5844157ca0 2023-10-07T08:48:59.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.597+0000 7f5849bf4700 1 -- 172.21.15.81:0/1365077898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584415f220 con 0x7f5844157ca0 2023-10-07T08:48:59.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.597+0000 7f582b7fe700 1 -- 172.21.15.81:0/1365077898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c0266b0 con 0x7f5844157ca0 2023-10-07T08:48:59.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.597+0000 7f5849bf4700 1 -- 172.21.15.81:0/1365077898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584415f7e0 con 0x7f5844157ca0 2023-10-07T08:48:59.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.598+0000 7f5849bf4700 1 -- 172.21.15.81:0/1365077898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5844067ac0 con 0x7f5844157ca0 2023-10-07T08:48:59.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.598+0000 7f582b7fe700 1 -- 172.21.15.81:0/1365077898 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f583c003040 con 0x7f5844157ca0 2023-10-07T08:48:59.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.598+0000 7f582b7fe700 1 --2- 172.21.15.81:0/1365077898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5830066f30 0x7f58300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:59.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.598+0000 7f582b7fe700 1 -- 172.21.15.81:0/1365077898 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f583c085f50 con 0x7f5844157ca0 2023-10-07T08:48:59.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.598+0000 7f58437fe700 1 --2- 172.21.15.81:0/1365077898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5830066f30 0x7f58300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:59.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.599+0000 7f58437fe700 1 --2- 172.21.15.81:0/1365077898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5830066f30 0x7f58300693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5838006fd0 tx=0x7f5838008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:59.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.603+0000 7f582b7fe700 1 -- 172.21.15.81:0/1365077898 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f583c053270 con 0x7f5844157ca0 2023-10-07T08:48:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.829+0000 7f5849bf4700 1 -- 172.21.15.81:0/1365077898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58440d0170 con 0x7f5844157ca0 2023-10-07T08:48:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.829+0000 7f582b7fe700 1 -- 172.21.15.81:0/1365077898 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f583c021090 con 0x7f5844157ca0 2023-10-07T08:48:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:48:59.831 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/2384735966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2384735966},{"type":"v1","addr":"172.21.15.89:6834","nonce":2384735966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1456306972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1456306972},{"type":"v1","addr":"172.21.15.89:6835","nonce":1456306972}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3356050793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3356050793},{"type":"v1","addr":"172.21.15.81:6836","nonce":3356050793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:48:40.667880+0000","modified":"2023-10-07T08:48:44.308458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6741":{"gid":6741,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2231384962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2231384962},{"type":"v1","addr":"172.21.15.81:6837","nonce":2231384962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-07T08:48:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.832+0000 7f5849bf4700 1 -- 172.21.15.81:0/1365077898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5830066f30 msgr2=0x7f58300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.832+0000 7f5849bf4700 1 --2- 172.21.15.81:0/1365077898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5830066f30 0x7f58300693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5838006fd0 tx=0x7f5838008040 comp rx=0 tx=0).stop 2023-10-07T08:48:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.832+0000 7f5849bf4700 1 -- 172.21.15.81:0/1365077898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5844157ca0 msgr2=0x7f58440b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.832+0000 7f5849bf4700 1 --2- 172.21.15.81:0/1365077898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5844157ca0 0x7f58440b59a0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f584406fe20 tx=0x7f583c018000 comp rx=0 tx=0).stop 2023-10-07T08:48:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.832+0000 7f5849bf4700 1 -- 172.21.15.81:0/1365077898 shutdown_connections 2023-10-07T08:48:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.832+0000 7f5849bf4700 1 --2- 172.21.15.81:0/1365077898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5844157ca0 0x7f58440b59a0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.832+0000 7f5849bf4700 1 --2- 172.21.15.81:0/1365077898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5830066f30 0x7f58300693e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.832+0000 7f5849bf4700 1 --2- 172.21.15.81:0/1365077898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f584406d120 0x7f5844154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:59.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.832+0000 7f5849bf4700 1 --2- 172.21.15.81:0/1365077898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58441578d0 0x7f584415ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:59.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.832+0000 7f5849bf4700 1 -- 172.21.15.81:0/1365077898 >> 172.21.15.81:0/1365077898 conn(0x7f584406bb90 msgr2=0x7f584415baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:59.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.832+0000 7f5849bf4700 1 -- 172.21.15.81:0/1365077898 shutdown_connections 2023-10-07T08:48:59.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.832+0000 7f5849bf4700 1 -- 172.21.15.81:0/1365077898 wait complete. 2023-10-07T08:48:59.835 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 58 2023-10-07T08:48:59.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:48:59.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.958+0000 7f266d16a700 1 Processor -- start 2023-10-07T08:48:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.958+0000 7f266d16a700 1 -- start start 2023-10-07T08:48:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.959+0000 7f266d16a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2668157ca0 0x7f26680cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.959+0000 7f266d16a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26680d07c0 con 0x7f266806d120 2023-10-07T08:48:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.959+0000 7f266d16a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26680cfbb0 con 0x7f26681578d0 2023-10-07T08:48:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.959+0000 7f266d16a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26680cfe90 con 0x7f2668157ca0 2023-10-07T08:48:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.959+0000 7f266759e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f266806d120 0x7f266806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34352/0 (socket says 172.21.15.81:34352) 2023-10-07T08:48:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.959+0000 7f266759e700 1 -- 172.21.15.81:0/2886649993 learned_addr learned my addr 172.21.15.81:0/2886649993 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:48:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.959+0000 7f265e59c700 1 --2- 172.21.15.81:0/2886649993 >> v2:172.21.15.89:3300/0 conn(0x7f2668157ca0 0x7f26680cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.959+0000 7f266659c700 1 -- 172.21.15.81:0/2886649993 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894312517 0 0) 0x7f26680d07c0 con 0x7f266806d120 2023-10-07T08:48:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.959+0000 7f266659c700 1 -- 172.21.15.81:0/2886649993 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2654003570 con 0x7f266806d120 2023-10-07T08:48:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.959+0000 7f266659c700 1 -- 172.21.15.81:0/2886649993 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544883319 0 0) 0x7f26680cfbb0 con 0x7f26681578d0 2023-10-07T08:48:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.959+0000 7f266659c700 1 -- 172.21.15.81:0/2886649993 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26680d07c0 con 0x7f26681578d0 2023-10-07T08:48:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.960+0000 7f265e59c700 1 -- 172.21.15.81:0/2886649993 >> v1:172.21.15.89:6789/0 conn(0x7f26681578d0 legacy=0x7f266815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.960+0000 7f265e59c700 1 -- 172.21.15.81:0/2886649993 >> v1:172.21.15.81:6789/0 conn(0x7f266806d120 legacy=0x7f266806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.960+0000 7f265e59c700 1 -- 172.21.15.81:0/2886649993 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26680d0170 con 0x7f2668157ca0 2023-10-07T08:48:59.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.960+0000 7f265e59c700 1 --2- 172.21.15.81:0/2886649993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2668157ca0 0x7f26680cf4f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f26500098e0 tx=0x7f26500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=390b0671217caf1f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:59.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.960+0000 7f266659c700 1 -- 172.21.15.81:0/2886649993 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650011630 con 0x7f2668157ca0 2023-10-07T08:48:59.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.960+0000 7f266659c700 1 -- 172.21.15.81:0/2886649993 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2650011790 con 0x7f2668157ca0 2023-10-07T08:48:59.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.960+0000 7f266659c700 1 -- 172.21.15.81:0/2886649993 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650011b30 con 0x7f2668157ca0 2023-10-07T08:48:59.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.960+0000 7f266d16a700 1 -- 172.21.15.81:0/2886649993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2668157ca0 msgr2=0x7f26680cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:59.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.960+0000 7f266d16a700 1 --2- 172.21.15.81:0/2886649993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2668157ca0 0x7f26680cf4f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f26500098e0 tx=0x7f26500091a0 comp rx=0 tx=0).stop 2023-10-07T08:48:59.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.960+0000 7f266d16a700 1 -- 172.21.15.81:0/2886649993 shutdown_connections 2023-10-07T08:48:59.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.960+0000 7f266d16a700 1 --2- 172.21.15.81:0/2886649993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2668157ca0 0x7f26680cf4f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:59.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.960+0000 7f266d16a700 1 -- 172.21.15.81:0/2886649993 >> 172.21.15.81:0/2886649993 conn(0x7f266806bb90 msgr2=0x7f266806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:48:59.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.960+0000 7f266d16a700 1 -- 172.21.15.81:0/2886649993 shutdown_connections 2023-10-07T08:48:59.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.960+0000 7f266d16a700 1 -- 172.21.15.81:0/2886649993 wait complete. 2023-10-07T08:48:59.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.962+0000 7f266d16a700 1 Processor -- start 2023-10-07T08:48:59.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.962+0000 7f266d16a700 1 -- start start 2023-10-07T08:48:59.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.962+0000 7f266d16a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266806d120 0x7f26680ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:59.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.962+0000 7f266d16a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26681578d0 0x7f26680b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:59.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.962+0000 7f266d16a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2668157ca0 0x7f2668154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:59.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.962+0000 7f266d16a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26680b2640 con 0x7f266806d120 2023-10-07T08:48:59.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.962+0000 7f266d16a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26680b1060 con 0x7f26681578d0 2023-10-07T08:48:59.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.962+0000 7f266d16a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26680b1340 con 0x7f2668157ca0 2023-10-07T08:48:59.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.962+0000 7f2666d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266806d120 0x7f26680ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:59.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.962+0000 7f2666d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266806d120 0x7f26680ad810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52964/0 (socket says 172.21.15.81:52964) 2023-10-07T08:48:59.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.962+0000 7f2666d9d700 1 -- 172.21.15.81:0/5656745 learned_addr learned my addr 172.21.15.81:0/5656745 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:48:59.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.963+0000 7f266759e700 1 --2- 172.21.15.81:0/5656745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2668157ca0 0x7f2668154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:59.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.963+0000 7f265e59c700 1 --2- 172.21.15.81:0/5656745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26681578d0 0x7f26680b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:59.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.963+0000 7f2666d9d700 1 -- 172.21.15.81:0/5656745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2668157ca0 msgr2=0x7f2668154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:59.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.963+0000 7f2666d9d700 1 --2- 172.21.15.81:0/5656745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2668157ca0 0x7f2668154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:59.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.963+0000 7f2666d9d700 1 -- 172.21.15.81:0/5656745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26681578d0 msgr2=0x7f26680b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:48:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.963+0000 7f2666d9d700 1 --2- 172.21.15.81:0/5656745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26681578d0 0x7f26680b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:48:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.963+0000 7f2666d9d700 1 -- 172.21.15.81:0/5656745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2650009420 con 0x7f266806d120 2023-10-07T08:48:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.963+0000 7f2666d9d700 1 --2- 172.21.15.81:0/5656745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266806d120 0x7f26680ad810 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f265800c790 tx=0x7f2658007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.963+0000 7f265f7fe700 1 -- 172.21.15.81:0/5656745 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658010510 con 0x7f266806d120 2023-10-07T08:48:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.963+0000 7f265f7fe700 1 -- 172.21.15.81:0/5656745 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2658010670 con 0x7f266806d120 2023-10-07T08:48:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.963+0000 7f266d16a700 1 -- 172.21.15.81:0/5656745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26680b1620 con 0x7f266806d120 2023-10-07T08:48:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.963+0000 7f265f7fe700 1 -- 172.21.15.81:0/5656745 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658010a10 con 0x7f266806d120 2023-10-07T08:48:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.963+0000 7f266d16a700 1 -- 172.21.15.81:0/5656745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26680b1be0 con 0x7f266806d120 2023-10-07T08:48:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.964+0000 7f266d16a700 1 -- 172.21.15.81:0/5656745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26680b1dd0 con 0x7f266806d120 2023-10-07T08:48:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.964+0000 7f265f7fe700 1 -- 172.21.15.81:0/5656745 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f265801b400 con 0x7f266806d120 2023-10-07T08:48:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.965+0000 7f265f7fe700 1 --2- 172.21.15.81:0/5656745 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2648066f30 0x7f26480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:48:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.965+0000 7f265e59c700 1 --2- 172.21.15.81:0/5656745 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2648066f30 0x7f26480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:48:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.965+0000 7f265f7fe700 1 -- 172.21.15.81:0/5656745 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2658084300 con 0x7f266806d120 2023-10-07T08:48:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.965+0000 7f265e59c700 1 --2- 172.21.15.81:0/5656745 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2648066f30 0x7f26480693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f26681580c0 tx=0x7f2650017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:48:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:48:59.969+0000 7f265f7fe700 1 -- 172.21.15.81:0/5656745 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2658051570 con 0x7f266806d120 2023-10-07T08:49:00.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.152+0000 7f266d16a700 1 -- 172.21.15.81:0/5656745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26680d0450 con 0x7f266806d120 2023-10-07T08:49:00.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.153+0000 7f265f7fe700 1 -- 172.21.15.81:0/5656745 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+15324 (secure 0 0 0) 0x7f2658054b90 con 0x7f266806d120 2023-10-07T08:49:00.154 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:00.154 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":126,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:48:57.355708+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:48:38.552036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-07T08:48:39.627974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:49:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.155+0000 7f266d16a700 1 -- 172.21.15.81:0/5656745 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2648066f30 msgr2=0x7f26480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.155+0000 7f266d16a700 1 --2- 172.21.15.81:0/5656745 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2648066f30 0x7f26480693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f26681580c0 tx=0x7f2650017000 comp rx=0 tx=0).stop 2023-10-07T08:49:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.155+0000 7f266d16a700 1 -- 172.21.15.81:0/5656745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266806d120 msgr2=0x7f26680ad810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.155+0000 7f266d16a700 1 --2- 172.21.15.81:0/5656745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266806d120 0x7f26680ad810 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f265800c790 tx=0x7f2658007e10 comp rx=0 tx=0).stop 2023-10-07T08:49:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.155+0000 7f266d16a700 1 -- 172.21.15.81:0/5656745 shutdown_connections 2023-10-07T08:49:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.155+0000 7f266d16a700 1 --2- 172.21.15.81:0/5656745 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2648066f30 0x7f26480693e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.155+0000 7f266d16a700 1 --2- 172.21.15.81:0/5656745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2668157ca0 0x7f2668154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.155+0000 7f266d16a700 1 --2- 172.21.15.81:0/5656745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f266806d120 0x7f26680ad810 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.155+0000 7f266d16a700 1 --2- 172.21.15.81:0/5656745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26681578d0 0x7f26680b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.155+0000 7f266d16a700 1 -- 172.21.15.81:0/5656745 >> 172.21.15.81:0/5656745 conn(0x7f266806bb90 msgr2=0x7f266806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.155+0000 7f266d16a700 1 -- 172.21.15.81:0/5656745 shutdown_connections 2023-10-07T08:49:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.155+0000 7f266d16a700 1 -- 172.21.15.81:0/5656745 wait complete. 2023-10-07T08:49:00.168 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:48:38.552036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:48:39.627974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:49:00.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:49:00.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.285+0000 7f66310b1700 1 Processor -- start 2023-10-07T08:49:00.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.285+0000 7f66310b1700 1 -- start start 2023-10-07T08:49:00.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.286+0000 7f66310b1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f662c156d50 0x7f662c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.286+0000 7f66310b1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f662c0af930 con 0x7f662c156980 2023-10-07T08:49:00.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.286+0000 7f66310b1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f662c0ca160 con 0x7f662c0b1d00 2023-10-07T08:49:00.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.286+0000 7f66310b1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662c0ca440 con 0x7f662c156d50 2023-10-07T08:49:00.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.286+0000 7f662bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f662c156980 0x7f662c0b15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34354/0 (socket says 172.21.15.81:34354) 2023-10-07T08:49:00.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.286+0000 7f662bfff700 1 -- 172.21.15.81:0/283993602 learned_addr learned my addr 172.21.15.81:0/283993602 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:00.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.286+0000 7f66308b0700 1 --2- 172.21.15.81:0/283993602 >> v2:172.21.15.89:3300/0 conn(0x7f662c156d50 0x7f662c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.286+0000 7f662affd700 1 -- 172.21.15.81:0/283993602 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369887335 0 0) 0x7f662c0af930 con 0x7f662c156980 2023-10-07T08:49:00.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.286+0000 7f662affd700 1 -- 172.21.15.81:0/283993602 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6614003570 con 0x7f662c156980 2023-10-07T08:49:00.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.286+0000 7f662affd700 1 -- 172.21.15.81:0/283993602 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007577725 0 0) 0x7f662c0ca160 con 0x7f662c0b1d00 2023-10-07T08:49:00.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.286+0000 7f662affd700 1 -- 172.21.15.81:0/283993602 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f662c0af930 con 0x7f662c0b1d00 2023-10-07T08:49:00.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.286+0000 7f66308b0700 1 -- 172.21.15.81:0/283993602 >> v1:172.21.15.89:6789/0 conn(0x7f662c0b1d00 legacy=0x7f662c0afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.286+0000 7f66308b0700 1 -- 172.21.15.81:0/283993602 >> v1:172.21.15.81:6789/0 conn(0x7f662c156980 legacy=0x7f662c0b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.286+0000 7f66308b0700 1 -- 172.21.15.81:0/283993602 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c0ca720 con 0x7f662c156d50 2023-10-07T08:49:00.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.287+0000 7f66308b0700 1 --2- 172.21.15.81:0/283993602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f662c156d50 0x7f662c0cc0d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6624009e60 tx=0x7f6624009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43c5457c8996179a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:00.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.287+0000 7f662affd700 1 -- 172.21.15.81:0/283993602 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662400e070 con 0x7f662c156d50 2023-10-07T08:49:00.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.287+0000 7f662affd700 1 -- 172.21.15.81:0/283993602 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662400bab0 con 0x7f662c156d50 2023-10-07T08:49:00.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.287+0000 7f662affd700 1 -- 172.21.15.81:0/283993602 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662400be70 con 0x7f662c156d50 2023-10-07T08:49:00.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.287+0000 7f66310b1700 1 -- 172.21.15.81:0/283993602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f662c156d50 msgr2=0x7f662c0cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.287+0000 7f66310b1700 1 --2- 172.21.15.81:0/283993602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f662c156d50 0x7f662c0cc0d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6624009e60 tx=0x7f6624009780 comp rx=0 tx=0).stop 2023-10-07T08:49:00.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.287+0000 7f66310b1700 1 -- 172.21.15.81:0/283993602 shutdown_connections 2023-10-07T08:49:00.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.287+0000 7f66310b1700 1 --2- 172.21.15.81:0/283993602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f662c156d50 0x7f662c0cc0d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.287+0000 7f66310b1700 1 -- 172.21.15.81:0/283993602 >> 172.21.15.81:0/283993602 conn(0x7f662c06bb90 msgr2=0x7f662c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:00.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.287+0000 7f66310b1700 1 -- 172.21.15.81:0/283993602 shutdown_connections 2023-10-07T08:49:00.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.287+0000 7f66310b1700 1 -- 172.21.15.81:0/283993602 wait complete. 2023-10-07T08:49:00.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.288+0000 7f66310b1700 1 Processor -- start 2023-10-07T08:49:00.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.289+0000 7f66310b1700 1 -- start start 2023-10-07T08:49:00.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.289+0000 7f66310b1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f662c0b1d00 0x7f662c164e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.289+0000 7f66310b1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c156980 0x7f662c16ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.289+0000 7f66310b1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f662c156d50 0x7f662c0c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.289+0000 7f66310b1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c16fba0 con 0x7f662c156980 2023-10-07T08:49:00.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.289+0000 7f66310b1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c1653b0 con 0x7f662c156d50 2023-10-07T08:49:00.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.289+0000 7f66310b1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662c0c1710 con 0x7f662c0b1d00 2023-10-07T08:49:00.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.289+0000 7f662b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c156980 0x7f662c16ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.289+0000 7f662b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c156980 0x7f662c16ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52972/0 (socket says 172.21.15.81:52972) 2023-10-07T08:49:00.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.289+0000 7f662b7fe700 1 -- 172.21.15.81:0/2837963578 learned_addr learned my addr 172.21.15.81:0/2837963578 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:00.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.289+0000 7f662bfff700 1 --2- 172.21.15.81:0/2837963578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f662c0b1d00 0x7f662c164e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.290+0000 7f66308b0700 1 --2- 172.21.15.81:0/2837963578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f662c156d50 0x7f662c0c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.290+0000 7f662b7fe700 1 -- 172.21.15.81:0/2837963578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f662c0b1d00 msgr2=0x7f662c164e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.290+0000 7f662b7fe700 1 --2- 172.21.15.81:0/2837963578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f662c0b1d00 0x7f662c164e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.290+0000 7f662b7fe700 1 -- 172.21.15.81:0/2837963578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f662c156d50 msgr2=0x7f662c0c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.290+0000 7f662b7fe700 1 --2- 172.21.15.81:0/2837963578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f662c156d50 0x7f662c0c23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.290+0000 7f662b7fe700 1 -- 172.21.15.81:0/2837963578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6624009a20 con 0x7f662c156980 2023-10-07T08:49:00.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.290+0000 7f662b7fe700 1 --2- 172.21.15.81:0/2837963578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c156980 0x7f662c16ef00 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f662000c580 tx=0x7f6620007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:00.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.290+0000 7f6613fff700 1 -- 172.21.15.81:0/2837963578 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620010510 con 0x7f662c156980 2023-10-07T08:49:00.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.290+0000 7f6613fff700 1 -- 172.21.15.81:0/2837963578 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6620010670 con 0x7f662c156980 2023-10-07T08:49:00.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.290+0000 7f66310b1700 1 -- 172.21.15.81:0/2837963578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662c0c19f0 con 0x7f662c156980 2023-10-07T08:49:00.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.290+0000 7f6613fff700 1 -- 172.21.15.81:0/2837963578 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620010a30 con 0x7f662c156980 2023-10-07T08:49:00.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.290+0000 7f66310b1700 1 -- 172.21.15.81:0/2837963578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662c16f830 con 0x7f662c156980 2023-10-07T08:49:00.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.291+0000 7f66310b1700 1 -- 172.21.15.81:0/2837963578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662c16fd10 con 0x7f662c156980 2023-10-07T08:49:00.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.291+0000 7f6613fff700 1 -- 172.21.15.81:0/2837963578 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f662001b400 con 0x7f662c156980 2023-10-07T08:49:00.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.292+0000 7f6613fff700 1 --2- 172.21.15.81:0/2837963578 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6618066f30 0x7f66180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.292+0000 7f662bfff700 1 --2- 172.21.15.81:0/2837963578 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6618066f30 0x7f66180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.292+0000 7f6613fff700 1 -- 172.21.15.81:0/2837963578 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6620084060 con 0x7f662c156980 2023-10-07T08:49:00.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.292+0000 7f662bfff700 1 --2- 172.21.15.81:0/2837963578 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6618066f30 0x7f66180693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f661c007fd0 tx=0x7f661c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:00.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.296+0000 7f6613fff700 1 -- 172.21.15.81:0/2837963578 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66200512d0 con 0x7f662c156980 2023-10-07T08:49:00.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.480+0000 7f66310b1700 1 -- 172.21.15.81:0/2837963578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f662c0676e0 con 0x7f662c156980 2023-10-07T08:49:00.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.480+0000 7f6613fff700 1 -- 172.21.15.81:0/2837963578 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66200548f0 con 0x7f662c156980 2023-10-07T08:49:00.481 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:49:00.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.482+0000 7f66310b1700 1 -- 172.21.15.81:0/2837963578 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6618066f30 msgr2=0x7f66180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.482+0000 7f66310b1700 1 --2- 172.21.15.81:0/2837963578 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6618066f30 0x7f66180693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f661c007fd0 tx=0x7f661c009040 comp rx=0 tx=0).stop 2023-10-07T08:49:00.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.482+0000 7f66310b1700 1 -- 172.21.15.81:0/2837963578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c156980 msgr2=0x7f662c16ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.482+0000 7f66310b1700 1 --2- 172.21.15.81:0/2837963578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c156980 0x7f662c16ef00 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f662000c580 tx=0x7f6620007e10 comp rx=0 tx=0).stop 2023-10-07T08:49:00.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.482+0000 7f66310b1700 1 -- 172.21.15.81:0/2837963578 shutdown_connections 2023-10-07T08:49:00.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.482+0000 7f66310b1700 1 --2- 172.21.15.81:0/2837963578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f662c156d50 0x7f662c0c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.482+0000 7f66310b1700 1 --2- 172.21.15.81:0/2837963578 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6618066f30 0x7f66180693e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.482+0000 7f66310b1700 1 --2- 172.21.15.81:0/2837963578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f662c0b1d00 0x7f662c164e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.482+0000 7f66310b1700 1 --2- 172.21.15.81:0/2837963578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c156980 0x7f662c16ef00 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.482+0000 7f66310b1700 1 -- 172.21.15.81:0/2837963578 >> 172.21.15.81:0/2837963578 conn(0x7f662c06bb90 msgr2=0x7f662c154c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:00.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.482+0000 7f66310b1700 1 -- 172.21.15.81:0/2837963578 shutdown_connections 2023-10-07T08:49:00.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.482+0000 7f66310b1700 1 -- 172.21.15.81:0/2837963578 wait complete. 2023-10-07T08:49:00.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:49:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.610+0000 7fc135a48700 1 Processor -- start 2023-10-07T08:49:00.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.610+0000 7fc135a48700 1 -- start start 2023-10-07T08:49:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.611+0000 7fc135a48700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1301578d0 0x7fc1300cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.611+0000 7fc135a48700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc130157ca0 0x7fc13015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.611+0000 7fc135a48700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1300d07c0 con 0x7fc13006d120 2023-10-07T08:49:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.611+0000 7fc135a48700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1300cfbb0 con 0x7fc130157ca0 2023-10-07T08:49:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.611+0000 7fc135a48700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1300cfe90 con 0x7fc1301578d0 2023-10-07T08:49:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.611+0000 7fc1267fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc130157ca0 0x7fc13015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.611+0000 7fc12f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc13006d120 0x7fc13015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34366/0 (socket says 172.21.15.81:34366) 2023-10-07T08:49:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.611+0000 7fc12f7fe700 1 -- 172.21.15.81:0/1826928027 learned_addr learned my addr 172.21.15.81:0/1826928027 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.611+0000 7fc12effd700 1 --2- 172.21.15.81:0/1826928027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1301578d0 0x7fc1300cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.611+0000 7fc1267fc700 1 -- 172.21.15.81:0/1826928027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1301578d0 msgr2=0x7fc1300cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc1267fc700 1 --2- 172.21.15.81:0/1826928027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1301578d0 0x7fc1300cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc12e7fc700 1 -- 172.21.15.81:0/1826928027 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185552953 0 0) 0x7fc1300d07c0 con 0x7fc13006d120 2023-10-07T08:49:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc1267fc700 1 -- 172.21.15.81:0/1826928027 >> v1:172.21.15.81:6789/0 conn(0x7fc13006d120 legacy=0x7fc13015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc1267fc700 1 -- 172.21.15.81:0/1826928027 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1300d0170 con 0x7fc130157ca0 2023-10-07T08:49:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc12effd700 1 --2- 172.21.15.81:0/1826928027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1301578d0 0x7fc1300cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc1267fc700 1 --2- 172.21.15.81:0/1826928027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc130157ca0 0x7fc13015af00 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fc1180098e0 tx=0x7fc1180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69145a8bca6b860 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc12e7fc700 1 -- 172.21.15.81:0/1826928027 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118009e80 con 0x7fc130157ca0 2023-10-07T08:49:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc12e7fc700 1 -- 172.21.15.81:0/1826928027 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11800b860 con 0x7fc130157ca0 2023-10-07T08:49:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc12e7fc700 1 -- 172.21.15.81:0/1826928027 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11800bbe0 con 0x7fc130157ca0 2023-10-07T08:49:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc135a48700 1 -- 172.21.15.81:0/1826928027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc130157ca0 msgr2=0x7fc13015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc135a48700 1 --2- 172.21.15.81:0/1826928027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc130157ca0 0x7fc13015af00 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fc1180098e0 tx=0x7fc1180091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc135a48700 1 -- 172.21.15.81:0/1826928027 shutdown_connections 2023-10-07T08:49:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc135a48700 1 --2- 172.21.15.81:0/1826928027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1301578d0 0x7fc1300cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc135a48700 1 --2- 172.21.15.81:0/1826928027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc130157ca0 0x7fc13015af00 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc135a48700 1 -- 172.21.15.81:0/1826928027 >> 172.21.15.81:0/1826928027 conn(0x7fc13006bb90 msgr2=0x7fc13006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc135a48700 1 -- 172.21.15.81:0/1826928027 shutdown_connections 2023-10-07T08:49:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.612+0000 7fc135a48700 1 -- 172.21.15.81:0/1826928027 wait complete. 2023-10-07T08:49:00.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.614+0000 7fc135a48700 1 Processor -- start 2023-10-07T08:49:00.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.614+0000 7fc135a48700 1 -- start start 2023-10-07T08:49:00.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.614+0000 7fc135a48700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13006d120 0x7fc1300b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.614+0000 7fc135a48700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301578d0 0x7fc1300ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.614+0000 7fc135a48700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc130157ca0 0x7fc1300ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.614+0000 7fc135a48700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1300aac20 con 0x7fc1301578d0 2023-10-07T08:49:00.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.614+0000 7fc135a48700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1300aaf00 con 0x7fc13006d120 2023-10-07T08:49:00.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.614+0000 7fc135a48700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1300ab1e0 con 0x7fc130157ca0 2023-10-07T08:49:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc1267fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301578d0 0x7fc1300ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc1267fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301578d0 0x7fc1300ad4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52978/0 (socket says 172.21.15.81:52978) 2023-10-07T08:49:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc1267fc700 1 -- 172.21.15.81:0/2532385973 learned_addr learned my addr 172.21.15.81:0/2532385973 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc12f7fe700 1 --2- 172.21.15.81:0/2532385973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc130157ca0 0x7fc1300ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc1267fc700 1 -- 172.21.15.81:0/2532385973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc130157ca0 msgr2=0x7fc1300ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc12effd700 1 --2- 172.21.15.81:0/2532385973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13006d120 0x7fc1300b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc1267fc700 1 --2- 172.21.15.81:0/2532385973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc130157ca0 0x7fc1300ab9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc1267fc700 1 -- 172.21.15.81:0/2532385973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13006d120 msgr2=0x7fc1300b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc1267fc700 1 --2- 172.21.15.81:0/2532385973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13006d120 0x7fc1300b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc1267fc700 1 -- 172.21.15.81:0/2532385973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc118009420 con 0x7fc1301578d0 2023-10-07T08:49:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc12effd700 1 --2- 172.21.15.81:0/2532385973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13006d120 0x7fc1300b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc1267fc700 1 --2- 172.21.15.81:0/2532385973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301578d0 0x7fc1300ad4b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fc13006fe20 tx=0x7fc118017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc1277fe700 1 -- 172.21.15.81:0/2532385973 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11800bbe0 con 0x7fc1301578d0 2023-10-07T08:49:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc1277fe700 1 -- 172.21.15.81:0/2532385973 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc118011420 con 0x7fc1301578d0 2023-10-07T08:49:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc135a48700 1 -- 172.21.15.81:0/2532385973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1300ab4c0 con 0x7fc1301578d0 2023-10-07T08:49:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc1277fe700 1 -- 172.21.15.81:0/2532385973 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1180117c0 con 0x7fc1301578d0 2023-10-07T08:49:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.615+0000 7fc135a48700 1 -- 172.21.15.81:0/2532385973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc130154f90 con 0x7fc1301578d0 2023-10-07T08:49:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.616+0000 7fc135a48700 1 -- 172.21.15.81:0/2532385973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1300ab6b0 con 0x7fc1301578d0 2023-10-07T08:49:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.616+0000 7fc1277fe700 1 -- 172.21.15.81:0/2532385973 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc118011bb0 con 0x7fc1301578d0 2023-10-07T08:49:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.617+0000 7fc1277fe700 1 --2- 172.21.15.81:0/2532385973 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc110066f30 0x7fc1100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.617+0000 7fc1277fe700 1 -- 172.21.15.81:0/2532385973 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc118085c40 con 0x7fc1301578d0 2023-10-07T08:49:00.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.617+0000 7fc12effd700 1 --2- 172.21.15.81:0/2532385973 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc110066f30 0x7fc1100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.617+0000 7fc12effd700 1 --2- 172.21.15.81:0/2532385973 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc110066f30 0x7fc1100693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc120008b20 tx=0x7fc120008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:00.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.621+0000 7fc1277fe700 1 -- 172.21.15.81:0/2532385973 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc118052eb0 con 0x7fc1301578d0 2023-10-07T08:49:00.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.804+0000 7fc135a48700 1 -- 172.21.15.81:0/2532385973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc1300d0450 con 0x7fc1301578d0 2023-10-07T08:49:00.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.804+0000 7fc1277fe700 1 -- 172.21.15.81:0/2532385973 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v126) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc118011e60 con 0x7fc1301578d0 2023-10-07T08:49:00.806 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:49:00.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.806+0000 7fc135a48700 1 -- 172.21.15.81:0/2532385973 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc110066f30 msgr2=0x7fc1100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.806+0000 7fc135a48700 1 --2- 172.21.15.81:0/2532385973 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc110066f30 0x7fc1100693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc120008b20 tx=0x7fc120008040 comp rx=0 tx=0).stop 2023-10-07T08:49:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.806+0000 7fc135a48700 1 -- 172.21.15.81:0/2532385973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301578d0 msgr2=0x7fc1300ad4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.806+0000 7fc135a48700 1 --2- 172.21.15.81:0/2532385973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301578d0 0x7fc1300ad4b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fc13006fe20 tx=0x7fc118017000 comp rx=0 tx=0).stop 2023-10-07T08:49:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.806+0000 7fc135a48700 1 -- 172.21.15.81:0/2532385973 shutdown_connections 2023-10-07T08:49:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.806+0000 7fc135a48700 1 --2- 172.21.15.81:0/2532385973 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc110066f30 0x7fc1100693e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.806+0000 7fc135a48700 1 --2- 172.21.15.81:0/2532385973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc130157ca0 0x7fc1300ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.806+0000 7fc135a48700 1 --2- 172.21.15.81:0/2532385973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13006d120 0x7fc1300b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.806+0000 7fc135a48700 1 --2- 172.21.15.81:0/2532385973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301578d0 0x7fc1300ad4b0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.806+0000 7fc135a48700 1 -- 172.21.15.81:0/2532385973 >> 172.21.15.81:0/2532385973 conn(0x7fc13006bb90 msgr2=0x7fc130155b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.806+0000 7fc135a48700 1 -- 172.21.15.81:0/2532385973 shutdown_connections 2023-10-07T08:49:00.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.806+0000 7fc135a48700 1 -- 172.21.15.81:0/2532385973 wait complete. 2023-10-07T08:49:00.819 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:49:00.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.934+0000 7f25fffff700 1 Processor -- start 2023-10-07T08:49:00.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.934+0000 7f25fffff700 1 -- start start 2023-10-07T08:49:00.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.935+0000 7f25fffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f26000d0b80 0x7f26000cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.935+0000 7f25fffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f260006d700 0x7f260015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.935+0000 7f25fffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26000cf2d0 con 0x7f26000d02b0 2023-10-07T08:49:00.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.935+0000 7f25fffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260015a690 con 0x7f26000d0b80 2023-10-07T08:49:00.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.935+0000 7f25fffff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260006dc00 con 0x7f260006d700 2023-10-07T08:49:00.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.935+0000 7f25feffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f26000d0b80 0x7f26000cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.935+0000 7f25f67fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f26000d02b0 0x7f260006cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34370/0 (socket says 172.21.15.81:34370) 2023-10-07T08:49:00.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.935+0000 7f25f67fc700 1 -- 172.21.15.81:0/597638406 learned_addr learned my addr 172.21.15.81:0/597638406 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:00.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.935+0000 7f25ff7fe700 1 --2- 172.21.15.81:0/597638406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f260006d700 0x7f260015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.935+0000 7f25feffd700 1 -- 172.21.15.81:0/597638406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f260006d700 msgr2=0x7f260015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:00.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.935+0000 7f25feffd700 1 --2- 172.21.15.81:0/597638406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f260006d700 0x7f260015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.935+0000 7f25feffd700 1 -- 172.21.15.81:0/597638406 >> v1:172.21.15.81:6789/0 conn(0x7f26000d02b0 legacy=0x7f260006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.935+0000 7f25fe7fc700 1 -- 172.21.15.81:0/597638406 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783911433 0 0) 0x7f26000cf2d0 con 0x7f26000d02b0 2023-10-07T08:49:00.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.935+0000 7f25feffd700 1 -- 172.21.15.81:0/597638406 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26000cf570 con 0x7f26000d0b80 2023-10-07T08:49:00.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.935+0000 7f25feffd700 1 --2- 172.21.15.81:0/597638406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26000d0b80 0x7f26000cfd70 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f25f00098e0 tx=0x7f25f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30ad08089d56f9c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:00.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.936+0000 7f25fe7fc700 1 -- 172.21.15.81:0/597638406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0009e80 con 0x7f26000d0b80 2023-10-07T08:49:00.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.936+0000 7f25fe7fc700 1 -- 172.21.15.81:0/597638406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f000b860 con 0x7f26000d0b80 2023-10-07T08:49:00.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.936+0000 7f25fe7fc700 1 -- 172.21.15.81:0/597638406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f000bbe0 con 0x7f26000d0b80 2023-10-07T08:49:00.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.936+0000 7f25fffff700 1 -- 172.21.15.81:0/597638406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26000d0b80 msgr2=0x7f26000cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.936+0000 7f25fffff700 1 --2- 172.21.15.81:0/597638406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26000d0b80 0x7f26000cfd70 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f25f00098e0 tx=0x7f25f00091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.936+0000 7f25fffff700 1 -- 172.21.15.81:0/597638406 shutdown_connections 2023-10-07T08:49:00.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.936+0000 7f25fffff700 1 --2- 172.21.15.81:0/597638406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26000d0b80 0x7f26000cfd70 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.936+0000 7f25fffff700 1 --2- 172.21.15.81:0/597638406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f260006d700 0x7f260015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.936+0000 7f25fffff700 1 -- 172.21.15.81:0/597638406 >> 172.21.15.81:0/597638406 conn(0x7f2600063230 msgr2=0x7f2600063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:00.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.936+0000 7f25fffff700 1 -- 172.21.15.81:0/597638406 shutdown_connections 2023-10-07T08:49:00.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.936+0000 7f25fffff700 1 -- 172.21.15.81:0/597638406 wait complete. 2023-10-07T08:49:00.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.937+0000 7f25fffff700 1 Processor -- start 2023-10-07T08:49:00.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.937+0000 7f25fffff700 1 -- start start 2023-10-07T08:49:00.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.938+0000 7f25fffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f260006d700 0x7f26000ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.938+0000 7f25fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26000d02b0 0x7f260016af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.938+0000 7f25fffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26000d0b80 0x7f2600156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.938+0000 7f25fffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26000c9d20 con 0x7f26000d02b0 2023-10-07T08:49:00.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.938+0000 7f25fffff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26000c9110 con 0x7f260006d700 2023-10-07T08:49:00.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.938+0000 7f25fffff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26000c93f0 con 0x7f26000d0b80 2023-10-07T08:49:00.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.938+0000 7f25f67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26000d02b0 0x7f260016af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.938+0000 7f25f67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26000d02b0 0x7f260016af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53002/0 (socket says 172.21.15.81:53002) 2023-10-07T08:49:00.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.938+0000 7f25f67fc700 1 -- 172.21.15.81:0/3839967378 learned_addr learned my addr 172.21.15.81:0/3839967378 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:00.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.938+0000 7f25feffd700 1 --2- 172.21.15.81:0/3839967378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f260006d700 0x7f26000ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.938+0000 7f25ff7fe700 1 --2- 172.21.15.81:0/3839967378 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26000d0b80 0x7f2600156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.939+0000 7f25f67fc700 1 -- 172.21.15.81:0/3839967378 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26000d0b80 msgr2=0x7f2600156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.939+0000 7f25f67fc700 1 --2- 172.21.15.81:0/3839967378 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26000d0b80 0x7f2600156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.939+0000 7f25f67fc700 1 -- 172.21.15.81:0/3839967378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f260006d700 msgr2=0x7f26000ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:00.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.939+0000 7f25f67fc700 1 --2- 172.21.15.81:0/3839967378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f260006d700 0x7f26000ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:00.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.939+0000 7f25f67fc700 1 -- 172.21.15.81:0/3839967378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0009420 con 0x7f26000d02b0 2023-10-07T08:49:00.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.939+0000 7f25feffd700 1 --2- 172.21.15.81:0/3839967378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f260006d700 0x7f26000ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.939+0000 7f25f67fc700 1 --2- 172.21.15.81:0/3839967378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26000d02b0 0x7f260016af80 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f25e800c7e0 tx=0x7f25e8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.939+0000 7f25f77fe700 1 -- 172.21.15.81:0/3839967378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8005b30 con 0x7f26000d02b0 2023-10-07T08:49:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.939+0000 7f25f77fe700 1 -- 172.21.15.81:0/3839967378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e8005c90 con 0x7f26000d02b0 2023-10-07T08:49:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.939+0000 7f25fffff700 1 -- 172.21.15.81:0/3839967378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26000c96d0 con 0x7f26000d02b0 2023-10-07T08:49:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.939+0000 7f25f77fe700 1 -- 172.21.15.81:0/3839967378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8007300 con 0x7f26000d02b0 2023-10-07T08:49:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.939+0000 7f25fffff700 1 -- 172.21.15.81:0/3839967378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260016b4c0 con 0x7f26000d02b0 2023-10-07T08:49:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.940+0000 7f25fffff700 1 -- 172.21.15.81:0/3839967378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26000676e0 con 0x7f26000d02b0 2023-10-07T08:49:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.940+0000 7f25f77fe700 1 -- 172.21.15.81:0/3839967378 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25e801b400 con 0x7f26000d02b0 2023-10-07T08:49:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.940+0000 7f25f77fe700 1 --2- 172.21.15.81:0/3839967378 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f25e0066f30 0x7f25e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.941+0000 7f25f77fe700 1 -- 172.21.15.81:0/3839967378 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f25e8084050 con 0x7f26000d02b0 2023-10-07T08:49:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.941+0000 7f25feffd700 1 --2- 172.21.15.81:0/3839967378 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f25e0066f30 0x7f25e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.941+0000 7f25feffd700 1 --2- 172.21.15.81:0/3839967378 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f25e0066f30 0x7f25e00693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f25f00091e0 tx=0x7f25f0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:00.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:00.945+0000 7f25f77fe700 1 -- 172.21.15.81:0/3839967378 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25e8051340 con 0x7f26000d02b0 2023-10-07T08:49:01.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.125+0000 7f25fffff700 1 -- 172.21.15.81:0/3839967378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2600071b10 con 0x7f26000d02b0 2023-10-07T08:49:01.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.125+0000 7f25f77fe700 1 -- 172.21.15.81:0/3839967378 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v126) v1 ==== 100+0+11 (secure 0 0 0) 0x7f25e8054960 con 0x7f26000d02b0 2023-10-07T08:49:01.126 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:49:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.127+0000 7f25fffff700 1 -- 172.21.15.81:0/3839967378 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f25e0066f30 msgr2=0x7f25e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.127+0000 7f25fffff700 1 --2- 172.21.15.81:0/3839967378 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f25e0066f30 0x7f25e00693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f25f00091e0 tx=0x7f25f0017000 comp rx=0 tx=0).stop 2023-10-07T08:49:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.127+0000 7f25fffff700 1 -- 172.21.15.81:0/3839967378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26000d02b0 msgr2=0x7f260016af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.127+0000 7f25fffff700 1 --2- 172.21.15.81:0/3839967378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26000d02b0 0x7f260016af80 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f25e800c7e0 tx=0x7f25e8007df0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.127+0000 7f25fffff700 1 -- 172.21.15.81:0/3839967378 shutdown_connections 2023-10-07T08:49:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.127+0000 7f25fffff700 1 --2- 172.21.15.81:0/3839967378 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f25e0066f30 0x7f25e00693e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.127+0000 7f25fffff700 1 --2- 172.21.15.81:0/3839967378 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26000d0b80 0x7f2600156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.127+0000 7f25fffff700 1 --2- 172.21.15.81:0/3839967378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f260006d700 0x7f26000ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.127+0000 7f25fffff700 1 --2- 172.21.15.81:0/3839967378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26000d02b0 0x7f260016af80 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.127+0000 7f25fffff700 1 -- 172.21.15.81:0/3839967378 >> 172.21.15.81:0/3839967378 conn(0x7f2600063230 msgr2=0x7f26000b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.127+0000 7f25fffff700 1 -- 172.21.15.81:0/3839967378 shutdown_connections 2023-10-07T08:49:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.127+0000 7f25fffff700 1 -- 172.21.15.81:0/3839967378 wait complete. 2023-10-07T08:49:01.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:49:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.252+0000 7f9e0d5c9700 1 Processor -- start 2023-10-07T08:49:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.253+0000 7f9e0d5c9700 1 -- start start 2023-10-07T08:49:01.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.253+0000 7f9e0d5c9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9e08157ca0 0x7f9e080cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.253+0000 7f9e0d5c9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e0806d120 0x7f9e0806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.253+0000 7f9e0d5c9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e080d07c0 con 0x7f9e081578d0 2023-10-07T08:49:01.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.253+0000 7f9e0d5c9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0806daa0 con 0x7f9e08157ca0 2023-10-07T08:49:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.253+0000 7f9e0d5c9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080cfbb0 con 0x7f9e0806d120 2023-10-07T08:49:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.253+0000 7f9e06ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9e081578d0 0x7f9e0815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34372/0 (socket says 172.21.15.81:34372) 2023-10-07T08:49:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.253+0000 7f9e06ffd700 1 -- 172.21.15.81:0/3012100022 learned_addr learned my addr 172.21.15.81:0/3012100022 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e077fe700 1 --2- 172.21.15.81:0/3012100022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e0806d120 0x7f9e0806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e067fc700 1 --2- 172.21.15.81:0/3012100022 >> v2:172.21.15.89:3300/0 conn(0x7f9e08157ca0 0x7f9e080cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e05ffb700 1 -- 172.21.15.81:0/3012100022 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063821470 0 0) 0x7f9e080d07c0 con 0x7f9e081578d0 2023-10-07T08:49:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e05ffb700 1 -- 172.21.15.81:0/3012100022 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df4003570 con 0x7f9e081578d0 2023-10-07T08:49:01.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e05ffb700 1 -- 172.21.15.81:0/3012100022 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3659705935 0 0) 0x7f9df4003570 con 0x7f9e081578d0 2023-10-07T08:49:01.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e05ffb700 1 -- 172.21.15.81:0/3012100022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e0806d120 msgr2=0x7f9e0806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:01.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e05ffb700 1 --2- 172.21.15.81:0/3012100022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e0806d120 0x7f9e0806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e05ffb700 1 -- 172.21.15.81:0/3012100022 >> v2:172.21.15.89:3300/0 conn(0x7f9e08157ca0 msgr2=0x7f9e080cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:01.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e05ffb700 1 --2- 172.21.15.81:0/3012100022 >> v2:172.21.15.89:3300/0 conn(0x7f9e08157ca0 0x7f9e080cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e05ffb700 1 -- 172.21.15.81:0/3012100022 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e080cfe90 con 0x7f9e081578d0 2023-10-07T08:49:01.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e05ffb700 1 -- 172.21.15.81:0/3012100022 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f9df80017f0 con 0x7f9e081578d0 2023-10-07T08:49:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e05ffb700 1 -- 172.21.15.81:0/3012100022 >> v1:172.21.15.81:6789/0 conn(0x7f9e081578d0 legacy=0x7f9e0815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e05ffb700 1 --2- 172.21.15.81:0/3012100022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9df4003a60 0x7f9df4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e05ffb700 1 --2- 172.21.15.81:0/3012100022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e0806d120 0x7f9df4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e05ffb700 1 --2- 172.21.15.81:0/3012100022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9df4004d50 0x7f9df40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e05ffb700 1 -- 172.21.15.81:0/3012100022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0806daa0 con 0x7f9df4003a60 2023-10-07T08:49:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e05ffb700 1 -- 172.21.15.81:0/3012100022 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080cfbb0 con 0x7f9df4004d50 2023-10-07T08:49:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e05ffb700 1 -- 172.21.15.81:0/3012100022 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df400ba60 con 0x7f9e0806d120 2023-10-07T08:49:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e067fc700 1 --2- 172.21.15.81:0/3012100022 >> v2:172.21.15.89:3300/0 conn(0x7f9e08157ca0 0x7f9e080cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:49:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e06ffd700 1 --2- 172.21.15.81:0/3012100022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9df4003a60 0x7f9df4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e077fe700 1 --2- 172.21.15.81:0/3012100022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9df4004d50 0x7f9df40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e067fc700 1 --2- 172.21.15.81:0/3012100022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e0806d120 0x7f9df4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e06ffd700 1 -- 172.21.15.81:0/3012100022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e0806d120 msgr2=0x7f9df4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e06ffd700 1 --2- 172.21.15.81:0/3012100022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e0806d120 0x7f9df4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e06ffd700 1 -- 172.21.15.81:0/3012100022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9df4004d50 msgr2=0x7f9df40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e06ffd700 1 --2- 172.21.15.81:0/3012100022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9df4004d50 0x7f9df40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e06ffd700 1 -- 172.21.15.81:0/3012100022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df4003570 con 0x7f9df4003a60 2023-10-07T08:49:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.254+0000 7f9e067fc700 1 --2- 172.21.15.81:0/3012100022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e0806d120 0x7f9df4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.255+0000 7f9e06ffd700 1 --2- 172.21.15.81:0/3012100022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9df4003a60 0x7f9df4003e70 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f9df800a970 tx=0x7f9e080d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6e04725015f87d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.255+0000 7f9e05ffb700 1 -- 172.21.15.81:0/3012100022 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df80070d0 con 0x7f9df4003a60 2023-10-07T08:49:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.255+0000 7f9e05ffb700 1 -- 172.21.15.81:0/3012100022 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df8007230 con 0x7f9df4003a60 2023-10-07T08:49:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.255+0000 7f9e05ffb700 1 -- 172.21.15.81:0/3012100022 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df80075f0 con 0x7f9df4003a60 2023-10-07T08:49:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.255+0000 7f9e0d5c9700 1 -- 172.21.15.81:0/3012100022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9df4003a60 msgr2=0x7f9df4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.255+0000 7f9e0d5c9700 1 --2- 172.21.15.81:0/3012100022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9df4003a60 0x7f9df4003e70 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f9df800a970 tx=0x7f9e080d0730 comp rx=0 tx=0).stop 2023-10-07T08:49:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.255+0000 7f9e077fe700 1 -- 172.21.15.81:0/3012100022 reap_dead start 2023-10-07T08:49:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.255+0000 7f9e0d5c9700 1 -- 172.21.15.81:0/3012100022 shutdown_connections 2023-10-07T08:49:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.255+0000 7f9e0d5c9700 1 -- 172.21.15.81:0/3012100022 >> 172.21.15.81:0/3012100022 conn(0x7f9e0806bb90 msgr2=0x7f9e0806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.255+0000 7f9e0d5c9700 1 -- 172.21.15.81:0/3012100022 shutdown_connections 2023-10-07T08:49:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.255+0000 7f9e0d5c9700 1 -- 172.21.15.81:0/3012100022 wait complete. 2023-10-07T08:49:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.256+0000 7f9e0d5c9700 1 Processor -- start 2023-10-07T08:49:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.257+0000 7f9e0d5c9700 1 -- start start 2023-10-07T08:49:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.257+0000 7f9e0d5c9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9df4003a60 0x7f9e081554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.257+0000 7f9e0d5c9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e08158600 0x7f9e08158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.257+0000 7f9e0d5c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e080aae50 0x7f9e080ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.257+0000 7f9e0d5c9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e08158fb0 con 0x7f9e080aae50 2023-10-07T08:49:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.257+0000 7f9e0d5c9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080b2750 con 0x7f9e08158600 2023-10-07T08:49:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.257+0000 7f9e0d5c9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080aa9c0 con 0x7f9df4003a60 2023-10-07T08:49:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.257+0000 7f9e077fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e080aae50 0x7f9e080ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.257+0000 7f9e077fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e080aae50 0x7f9e080ab2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53018/0 (socket says 172.21.15.81:53018) 2023-10-07T08:49:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.257+0000 7f9e077fe700 1 -- 172.21.15.81:0/1255323132 learned_addr learned my addr 172.21.15.81:0/1255323132 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.258+0000 7f9e06ffd700 1 --2- 172.21.15.81:0/1255323132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9df4003a60 0x7f9e081554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.258+0000 7f9e077fe700 1 -- 172.21.15.81:0/1255323132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9df4003a60 msgr2=0x7f9e081554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.258+0000 7f9e067fc700 1 --2- 172.21.15.81:0/1255323132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e08158600 0x7f9e08158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.258+0000 7f9e077fe700 1 --2- 172.21.15.81:0/1255323132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9df4003a60 0x7f9e081554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.258+0000 7f9e077fe700 1 -- 172.21.15.81:0/1255323132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e08158600 msgr2=0x7f9e08158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.258+0000 7f9e077fe700 1 --2- 172.21.15.81:0/1255323132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e08158600 0x7f9e08158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.258+0000 7f9e077fe700 1 -- 172.21.15.81:0/1255323132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e080b1eb0 con 0x7f9e080aae50 2023-10-07T08:49:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.258+0000 7f9e077fe700 1 --2- 172.21.15.81:0/1255323132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e080aae50 0x7f9e080ab2d0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f9e08063f70 tx=0x7f9e00008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.258+0000 7f9dfeffd700 1 -- 172.21.15.81:0/1255323132 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e00015740 con 0x7f9e080aae50 2023-10-07T08:49:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.258+0000 7f9dfeffd700 1 -- 172.21.15.81:0/1255323132 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e000158a0 con 0x7f9e080aae50 2023-10-07T08:49:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.258+0000 7f9e0d5c9700 1 -- 172.21.15.81:0/1255323132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e080b2190 con 0x7f9e080aae50 2023-10-07T08:49:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.258+0000 7f9dfeffd700 1 -- 172.21.15.81:0/1255323132 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e00015ca0 con 0x7f9e080aae50 2023-10-07T08:49:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.258+0000 7f9e0d5c9700 1 -- 172.21.15.81:0/1255323132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e081559e0 con 0x7f9e080aae50 2023-10-07T08:49:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.259+0000 7f9e0d5c9700 1 -- 172.21.15.81:0/1255323132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e080aab50 con 0x7f9e080aae50 2023-10-07T08:49:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.259+0000 7f9dfeffd700 1 -- 172.21.15.81:0/1255323132 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e000145f0 con 0x7f9e080aae50 2023-10-07T08:49:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.260+0000 7f9dfeffd700 1 --2- 172.21.15.81:0/1255323132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9de8066f30 0x7f9de80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.260+0000 7f9dfeffd700 1 -- 172.21.15.81:0/1255323132 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e000846c0 con 0x7f9e080aae50 2023-10-07T08:49:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.260+0000 7f9e06ffd700 1 --2- 172.21.15.81:0/1255323132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9de8066f30 0x7f9de80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.260+0000 7f9e06ffd700 1 --2- 172.21.15.81:0/1255323132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9de8066f30 0x7f9de80693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9e08070c50 tx=0x7f9df8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.264+0000 7f9dfeffd700 1 -- 172.21.15.81:0/1255323132 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e000553c0 con 0x7f9e080aae50 2023-10-07T08:49:01.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.489+0000 7f9e0d5c9700 1 -- 172.21.15.81:0/1255323132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e080d0170 con 0x7f9e080aae50 2023-10-07T08:49:01.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.490+0000 7f9dfeffd700 1 -- 172.21.15.81:0/1255323132 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f9e00054f50 con 0x7f9e080aae50 2023-10-07T08:49:01.491 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:01.492 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/2384735966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2384735966},{"type":"v1","addr":"172.21.15.89:6834","nonce":2384735966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1456306972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1456306972},{"type":"v1","addr":"172.21.15.89:6835","nonce":1456306972}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3356050793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3356050793},{"type":"v1","addr":"172.21.15.81:6836","nonce":3356050793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:48:40.667880+0000","modified":"2023-10-07T08:48:44.308458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6741":{"gid":6741,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2231384962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2231384962},{"type":"v1","addr":"172.21.15.81:6837","nonce":2231384962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-07T08:49:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.492+0000 7f9e0d5c9700 1 -- 172.21.15.81:0/1255323132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9de8066f30 msgr2=0x7f9de80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.492+0000 7f9e0d5c9700 1 --2- 172.21.15.81:0/1255323132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9de8066f30 0x7f9de80693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9e08070c50 tx=0x7f9df8016000 comp rx=0 tx=0).stop 2023-10-07T08:49:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.492+0000 7f9e0d5c9700 1 -- 172.21.15.81:0/1255323132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e080aae50 msgr2=0x7f9e080ab2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.492+0000 7f9e0d5c9700 1 --2- 172.21.15.81:0/1255323132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e080aae50 0x7f9e080ab2d0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f9e08063f70 tx=0x7f9e00008040 comp rx=0 tx=0).stop 2023-10-07T08:49:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.492+0000 7f9e0d5c9700 1 -- 172.21.15.81:0/1255323132 shutdown_connections 2023-10-07T08:49:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.492+0000 7f9e0d5c9700 1 --2- 172.21.15.81:0/1255323132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e080aae50 0x7f9e080ab2d0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.492+0000 7f9e0d5c9700 1 --2- 172.21.15.81:0/1255323132 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9de8066f30 0x7f9de80693e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.492+0000 7f9e0d5c9700 1 --2- 172.21.15.81:0/1255323132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9df4003a60 0x7f9e081554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.492+0000 7f9e0d5c9700 1 --2- 172.21.15.81:0/1255323132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e08158600 0x7f9e08158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.492+0000 7f9e0d5c9700 1 -- 172.21.15.81:0/1255323132 >> 172.21.15.81:0/1255323132 conn(0x7f9e0806bb90 msgr2=0x7f9e08156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.492+0000 7f9e0d5c9700 1 -- 172.21.15.81:0/1255323132 shutdown_connections 2023-10-07T08:49:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.492+0000 7f9e0d5c9700 1 -- 172.21.15.81:0/1255323132 wait complete. 2023-10-07T08:49:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 58 2023-10-07T08:49:01.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:49:01.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.619+0000 7f47afc58700 1 Processor -- start 2023-10-07T08:49:01.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.620+0000 7f47afc58700 1 -- start start 2023-10-07T08:49:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.620+0000 7f47afc58700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47a8069440 0x7f47a80698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.620+0000 7f47afc58700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f47a80c71d0 0x7f47a80c7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.620+0000 7f47afc58700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a80cb880 con 0x7f47a8156420 2023-10-07T08:49:01.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.620+0000 7f47afc58700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a806aa10 con 0x7f47a8069440 2023-10-07T08:49:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.620+0000 7f47afc58700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a80c7b50 con 0x7f47a80c71d0 2023-10-07T08:49:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.620+0000 7f47ad1f3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47a8069440 0x7f47a80698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.620+0000 7f47ad1f3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47a8069440 0x7f47a80698b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53026/0 (socket says 172.21.15.81:53026) 2023-10-07T08:49:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.621+0000 7f47ad1f3700 1 -- 172.21.15.81:0/663519772 learned_addr learned my addr 172.21.15.81:0/663519772 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.621+0000 7f47ad1f3700 1 -- 172.21.15.81:0/663519772 >> v2:172.21.15.89:3300/0 conn(0x7f47a80c71d0 msgr2=0x7f47a80c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.621+0000 7f47ae1f5700 1 --2- 172.21.15.81:0/663519772 >> v2:172.21.15.89:3300/0 conn(0x7f47a80c71d0 0x7f47a80c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.621+0000 7f47ad1f3700 1 --2- 172.21.15.81:0/663519772 >> v2:172.21.15.89:3300/0 conn(0x7f47a80c71d0 0x7f47a80c7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.621+0000 7f47ad1f3700 1 -- 172.21.15.81:0/663519772 >> v1:172.21.15.89:6789/0 conn(0x7f47a8156420 legacy=0x7f47a80cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.621+0000 7f47ad1f3700 1 -- 172.21.15.81:0/663519772 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a80cac70 con 0x7f47a8069440 2023-10-07T08:49:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.621+0000 7f47ae1f5700 1 --2- 172.21.15.81:0/663519772 >> v2:172.21.15.89:3300/0 conn(0x7f47a80c71d0 0x7f47a80c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.621+0000 7f47ad1f3700 1 --2- 172.21.15.81:0/663519772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a8069440 0x7f47a80698b0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f47a80c3680 tx=0x7f4798009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2b48bf1ec2250 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.621+0000 7f47ac9f2700 1 -- 172.21.15.81:0/663519772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800b820 con 0x7f47a8069440 2023-10-07T08:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.621+0000 7f47ac9f2700 1 -- 172.21.15.81:0/663519772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479800b980 con 0x7f47a8069440 2023-10-07T08:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.621+0000 7f47ac9f2700 1 -- 172.21.15.81:0/663519772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800bd20 con 0x7f47a8069440 2023-10-07T08:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.622+0000 7f47afc58700 1 -- 172.21.15.81:0/663519772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a8069440 msgr2=0x7f47a80698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.622+0000 7f47afc58700 1 --2- 172.21.15.81:0/663519772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a8069440 0x7f47a80698b0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f47a80c3680 tx=0x7f4798009250 comp rx=0 tx=0).stop 2023-10-07T08:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.622+0000 7f47afc58700 1 -- 172.21.15.81:0/663519772 shutdown_connections 2023-10-07T08:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.622+0000 7f47afc58700 1 --2- 172.21.15.81:0/663519772 >> v2:172.21.15.89:3300/0 conn(0x7f47a80c71d0 0x7f47a80c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.622+0000 7f47afc58700 1 --2- 172.21.15.81:0/663519772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a8069440 0x7f47a80698b0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.622+0000 7f47afc58700 1 -- 172.21.15.81:0/663519772 >> 172.21.15.81:0/663519772 conn(0x7f47a806c660 msgr2=0x7f47a80cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.622+0000 7f47afc58700 1 -- 172.21.15.81:0/663519772 shutdown_connections 2023-10-07T08:49:01.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.622+0000 7f47afc58700 1 -- 172.21.15.81:0/663519772 wait complete. 2023-10-07T08:49:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.623+0000 7f47afc58700 1 Processor -- start 2023-10-07T08:49:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.623+0000 7f47afc58700 1 -- start start 2023-10-07T08:49:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47afc58700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a8069440 0x7f47a80c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47afc58700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47a80c71d0 0x7f47a80aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47afc58700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a8156420 0x7f47a80c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47afc58700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80c6990 con 0x7f47a8069440 2023-10-07T08:49:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47afc58700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8155c20 con 0x7f47a8156420 2023-10-07T08:49:01.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47afc58700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8146e80 con 0x7f47a80c71d0 2023-10-07T08:49:01.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47ad9f4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a8069440 0x7f47a80c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47ad9f4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a8069440 0x7f47a80c3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53040/0 (socket says 172.21.15.81:53040) 2023-10-07T08:49:01.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47ad9f4700 1 -- 172.21.15.81:0/1130350524 learned_addr learned my addr 172.21.15.81:0/1130350524 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:01.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47ae1f5700 1 --2- 172.21.15.81:0/1130350524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a8156420 0x7f47a80c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47ad1f3700 1 --2- 172.21.15.81:0/1130350524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47a80c71d0 0x7f47a80aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47ad9f4700 1 -- 172.21.15.81:0/1130350524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47a80c71d0 msgr2=0x7f47a80aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47ad9f4700 1 --2- 172.21.15.81:0/1130350524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47a80c71d0 0x7f47a80aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47ad9f4700 1 -- 172.21.15.81:0/1130350524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a8156420 msgr2=0x7f47a80c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47ad9f4700 1 --2- 172.21.15.81:0/1130350524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a8156420 0x7f47a80c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47ad9f4700 1 -- 172.21.15.81:0/1130350524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47980094f0 con 0x7f47a8069440 2023-10-07T08:49:01.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47ae1f5700 1 --2- 172.21.15.81:0/1130350524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a8156420 0x7f47a80c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47ad9f4700 1 --2- 172.21.15.81:0/1130350524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a8069440 0x7f47a80c3d70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f47a400bc30 tx=0x7f47a4009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f479dffb700 1 -- 172.21.15.81:0/1130350524 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a400c900 con 0x7f47a8069440 2023-10-07T08:49:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f479dffb700 1 -- 172.21.15.81:0/1130350524 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a400caa0 con 0x7f47a8069440 2023-10-07T08:49:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f47afc58700 1 -- 172.21.15.81:0/1130350524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a8146300 con 0x7f47a8069440 2023-10-07T08:49:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.624+0000 7f479dffb700 1 -- 172.21.15.81:0/1130350524 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a400ce60 con 0x7f47a8069440 2023-10-07T08:49:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.625+0000 7f47afc58700 1 -- 172.21.15.81:0/1130350524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a81468c0 con 0x7f47a8069440 2023-10-07T08:49:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.626+0000 7f47afc58700 1 -- 172.21.15.81:0/1130350524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a8067bc0 con 0x7f47a8069440 2023-10-07T08:49:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.626+0000 7f479dffb700 1 -- 172.21.15.81:0/1130350524 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47a4014620 con 0x7f47a8069440 2023-10-07T08:49:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.626+0000 7f479dffb700 1 --2- 172.21.15.81:0/1130350524 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f478c066f30 0x7f478c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.626+0000 7f479dffb700 1 -- 172.21.15.81:0/1130350524 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47a4084570 con 0x7f47a8069440 2023-10-07T08:49:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.626+0000 7f47ad1f3700 1 --2- 172.21.15.81:0/1130350524 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f478c066f30 0x7f478c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.626+0000 7f47ad1f3700 1 --2- 172.21.15.81:0/1130350524 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f478c066f30 0x7f478c0693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f47a80c3680 tx=0x7f4798016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.630+0000 7f479dffb700 1 -- 172.21.15.81:0/1130350524 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47a40517e0 con 0x7f47a8069440 2023-10-07T08:49:01.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.813+0000 7f47afc58700 1 -- 172.21.15.81:0/1130350524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47a80caf80 con 0x7f47a8069440 2023-10-07T08:49:01.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.814+0000 7f479dffb700 1 -- 172.21.15.81:0/1130350524 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+15324 (secure 0 0 0) 0x7f47a4054e00 con 0x7f47a8069440 2023-10-07T08:49:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:01.816 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":126,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:48:57.355708+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:48:38.552036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-07T08:48:39.627974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:49:01.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.816+0000 7f47afc58700 1 -- 172.21.15.81:0/1130350524 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f478c066f30 msgr2=0x7f478c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.816+0000 7f47afc58700 1 --2- 172.21.15.81:0/1130350524 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f478c066f30 0x7f478c0693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f47a80c3680 tx=0x7f4798016000 comp rx=0 tx=0).stop 2023-10-07T08:49:01.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.816+0000 7f47afc58700 1 -- 172.21.15.81:0/1130350524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a8069440 msgr2=0x7f47a80c3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.816+0000 7f47afc58700 1 --2- 172.21.15.81:0/1130350524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a8069440 0x7f47a80c3d70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f47a400bc30 tx=0x7f47a4009820 comp rx=0 tx=0).stop 2023-10-07T08:49:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.816+0000 7f47afc58700 1 -- 172.21.15.81:0/1130350524 shutdown_connections 2023-10-07T08:49:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.816+0000 7f47afc58700 1 --2- 172.21.15.81:0/1130350524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a8156420 0x7f47a80c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.816+0000 7f47afc58700 1 --2- 172.21.15.81:0/1130350524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47a8069440 0x7f47a80c3d70 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.816+0000 7f47afc58700 1 --2- 172.21.15.81:0/1130350524 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f478c066f30 0x7f478c0693e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.816+0000 7f47afc58700 1 --2- 172.21.15.81:0/1130350524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47a80c71d0 0x7f47a80aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.816+0000 7f47afc58700 1 -- 172.21.15.81:0/1130350524 >> 172.21.15.81:0/1130350524 conn(0x7f47a806c660 msgr2=0x7f47a80b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:01.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.816+0000 7f47afc58700 1 -- 172.21.15.81:0/1130350524 shutdown_connections 2023-10-07T08:49:01.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.817+0000 7f47afc58700 1 -- 172.21.15.81:0/1130350524 wait complete. 2023-10-07T08:49:01.830 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T08:49:01.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:49:01.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.943+0000 7fb0b6e31700 1 Processor -- start 2023-10-07T08:49:01.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.943+0000 7fb0b6e31700 1 -- start start 2023-10-07T08:49:01.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.944+0000 7fb0b6e31700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b01578d0 0x7fb0b00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.944+0000 7fb0b6e31700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb0b0157ca0 0x7fb0b015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.944+0000 7fb0b6e31700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b00d07c0 con 0x7fb0b006d120 2023-10-07T08:49:01.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.944+0000 7fb0b6e31700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b00cfbb0 con 0x7fb0b0157ca0 2023-10-07T08:49:01.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.944+0000 7fb0b6e31700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00cfe90 con 0x7fb0b01578d0 2023-10-07T08:49:01.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.944+0000 7fb0a7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb0b0157ca0 0x7fb0b015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.944+0000 7fb0a7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb0b0157ca0 0x7fb0b015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53042/0 (socket says 172.21.15.81:53042) 2023-10-07T08:49:01.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.944+0000 7fb0a7fff700 1 -- 172.21.15.81:0/2685097292 learned_addr learned my addr 172.21.15.81:0/2685097292 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:01.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.945+0000 7fb0b4bcd700 1 --2- 172.21.15.81:0/2685097292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b01578d0 0x7fb0b00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.945+0000 7fb0a7fff700 1 -- 172.21.15.81:0/2685097292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b01578d0 msgr2=0x7fb0b00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:01.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.945+0000 7fb0a7fff700 1 --2- 172.21.15.81:0/2685097292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b01578d0 0x7fb0b00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.945+0000 7fb0a7fff700 1 -- 172.21.15.81:0/2685097292 >> v1:172.21.15.89:6789/0 conn(0x7fb0b006d120 legacy=0x7fb0b015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.945+0000 7fb0a7fff700 1 -- 172.21.15.81:0/2685097292 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b00d0170 con 0x7fb0b0157ca0 2023-10-07T08:49:01.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.945+0000 7fb0a7fff700 1 --2- 172.21.15.81:0/2685097292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b0157ca0 0x7fb0b015af00 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00099b0 tx=0x7fb0a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca38d7e98af5327 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:01.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.945+0000 7fb0a77fe700 1 -- 172.21.15.81:0/2685097292 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a000b860 con 0x7fb0b0157ca0 2023-10-07T08:49:01.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.945+0000 7fb0a77fe700 1 -- 172.21.15.81:0/2685097292 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a000b9c0 con 0x7fb0b0157ca0 2023-10-07T08:49:01.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.945+0000 7fb0a77fe700 1 -- 172.21.15.81:0/2685097292 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a000bd60 con 0x7fb0b0157ca0 2023-10-07T08:49:01.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.945+0000 7fb0b6e31700 1 -- 172.21.15.81:0/2685097292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b0157ca0 msgr2=0x7fb0b015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.945+0000 7fb0b6e31700 1 --2- 172.21.15.81:0/2685097292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b0157ca0 0x7fb0b015af00 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00099b0 tx=0x7fb0a0009250 comp rx=0 tx=0).stop 2023-10-07T08:49:01.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.946+0000 7fb0b6e31700 1 -- 172.21.15.81:0/2685097292 shutdown_connections 2023-10-07T08:49:01.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.946+0000 7fb0b6e31700 1 --2- 172.21.15.81:0/2685097292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b01578d0 0x7fb0b00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.946+0000 7fb0b6e31700 1 --2- 172.21.15.81:0/2685097292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b0157ca0 0x7fb0b015af00 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.946+0000 7fb0b6e31700 1 -- 172.21.15.81:0/2685097292 >> 172.21.15.81:0/2685097292 conn(0x7fb0b006bb90 msgr2=0x7fb0b006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:01.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.946+0000 7fb0b6e31700 1 -- 172.21.15.81:0/2685097292 shutdown_connections 2023-10-07T08:49:01.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.946+0000 7fb0b6e31700 1 -- 172.21.15.81:0/2685097292 wait complete. 2023-10-07T08:49:01.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.947+0000 7fb0b6e31700 1 Processor -- start 2023-10-07T08:49:01.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.947+0000 7fb0b6e31700 1 -- start start 2023-10-07T08:49:01.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b6e31700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b006d120 0x7fb0b0153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b6e31700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0b01578d0 0x7fb0b00c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b6e31700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b0157ca0 0x7fb0b015b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b6e31700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00b6aa0 con 0x7fb0b0157ca0 2023-10-07T08:49:01.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b6e31700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00b5e90 con 0x7fb0b01578d0 2023-10-07T08:49:01.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b6e31700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00b6170 con 0x7fb0b006d120 2023-10-07T08:49:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b53ce700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b0157ca0 0x7fb0b015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b53ce700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b0157ca0 0x7fb0b015b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53048/0 (socket says 172.21.15.81:53048) 2023-10-07T08:49:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b53ce700 1 -- 172.21.15.81:0/4011921873 learned_addr learned my addr 172.21.15.81:0/4011921873 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b4bcd700 1 --2- 172.21.15.81:0/4011921873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b006d120 0x7fb0b0153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0a7fff700 1 --2- 172.21.15.81:0/4011921873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0b01578d0 0x7fb0b00c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b53ce700 1 -- 172.21.15.81:0/4011921873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b006d120 msgr2=0x7fb0b0153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b53ce700 1 --2- 172.21.15.81:0/4011921873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b006d120 0x7fb0b0153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b53ce700 1 -- 172.21.15.81:0/4011921873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0b01578d0 msgr2=0x7fb0b00c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b53ce700 1 --2- 172.21.15.81:0/4011921873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0b01578d0 0x7fb0b00c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b53ce700 1 -- 172.21.15.81:0/4011921873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a00094f0 con 0x7fb0b0157ca0 2023-10-07T08:49:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b53ce700 1 --2- 172.21.15.81:0/4011921873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b0157ca0 0x7fb0b015b810 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800c560 tx=0x7fb0a8007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0a4ff9700 1 -- 172.21.15.81:0/4011921873 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8011590 con 0x7fb0b0157ca0 2023-10-07T08:49:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0a4ff9700 1 -- 172.21.15.81:0/4011921873 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a80116f0 con 0x7fb0b0157ca0 2023-10-07T08:49:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b6e31700 1 -- 172.21.15.81:0/4011921873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b00b6450 con 0x7fb0b0157ca0 2023-10-07T08:49:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0a4ff9700 1 -- 172.21.15.81:0/4011921873 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8011ab0 con 0x7fb0b0157ca0 2023-10-07T08:49:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.948+0000 7fb0b6e31700 1 -- 172.21.15.81:0/4011921873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b0153a50 con 0x7fb0b0157ca0 2023-10-07T08:49:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.949+0000 7fb0b6e31700 1 -- 172.21.15.81:0/4011921873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b0067ac0 con 0x7fb0b0157ca0 2023-10-07T08:49:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.950+0000 7fb0a4ff9700 1 -- 172.21.15.81:0/4011921873 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0a801b3b0 con 0x7fb0b0157ca0 2023-10-07T08:49:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.950+0000 7fb0a4ff9700 1 --2- 172.21.15.81:0/4011921873 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb09c066f30 0x7fb09c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.950+0000 7fb0a4ff9700 1 -- 172.21.15.81:0/4011921873 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb0a80838f0 con 0x7fb0b0157ca0 2023-10-07T08:49:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.950+0000 7fb0b4bcd700 1 --2- 172.21.15.81:0/4011921873 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb09c066f30 0x7fb09c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:01.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.950+0000 7fb0b4bcd700 1 --2- 172.21.15.81:0/4011921873 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb09c066f30 0x7fb09c0693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac009fd0 tx=0x7fb0ac009880 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:01.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:01.954+0000 7fb0a4ff9700 1 -- 172.21.15.81:0/4011921873 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0a8050b60 con 0x7fb0b0157ca0 2023-10-07T08:49:02.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.180+0000 7fb0b6e31700 1 -- 172.21.15.81:0/4011921873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0b00d0450 con 0x7fb0b0157ca0 2023-10-07T08:49:02.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.181+0000 7fb0a4ff9700 1 -- 172.21.15.81:0/4011921873 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fb0a8017070 con 0x7fb0b0157ca0 2023-10-07T08:49:02.182 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:02.182 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/2384735966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2384735966},{"type":"v1","addr":"172.21.15.89:6834","nonce":2384735966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1456306972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1456306972},{"type":"v1","addr":"172.21.15.89:6835","nonce":1456306972}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3356050793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3356050793},{"type":"v1","addr":"172.21.15.81:6836","nonce":3356050793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:48:40.667880+0000","modified":"2023-10-07T08:48:44.308458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6741":{"gid":6741,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2231384962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2231384962},{"type":"v1","addr":"172.21.15.81:6837","nonce":2231384962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-07T08:49:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.183+0000 7fb0b6e31700 1 -- 172.21.15.81:0/4011921873 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb09c066f30 msgr2=0x7fb09c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.183+0000 7fb0b6e31700 1 --2- 172.21.15.81:0/4011921873 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb09c066f30 0x7fb09c0693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac009fd0 tx=0x7fb0ac009880 comp rx=0 tx=0).stop 2023-10-07T08:49:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.183+0000 7fb0b6e31700 1 -- 172.21.15.81:0/4011921873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b0157ca0 msgr2=0x7fb0b015b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.183+0000 7fb0b6e31700 1 --2- 172.21.15.81:0/4011921873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b0157ca0 0x7fb0b015b810 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800c560 tx=0x7fb0a8007ef0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.183+0000 7fb0b6e31700 1 -- 172.21.15.81:0/4011921873 shutdown_connections 2023-10-07T08:49:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.183+0000 7fb0b6e31700 1 --2- 172.21.15.81:0/4011921873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b0157ca0 0x7fb0b015b810 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.183+0000 7fb0b6e31700 1 --2- 172.21.15.81:0/4011921873 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb09c066f30 0x7fb09c0693e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.183+0000 7fb0b6e31700 1 --2- 172.21.15.81:0/4011921873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b006d120 0x7fb0b0153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.183+0000 7fb0b6e31700 1 --2- 172.21.15.81:0/4011921873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0b01578d0 0x7fb0b00c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.183+0000 7fb0b6e31700 1 -- 172.21.15.81:0/4011921873 >> 172.21.15.81:0/4011921873 conn(0x7fb0b006bb90 msgr2=0x7fb0b0155730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.183+0000 7fb0b6e31700 1 -- 172.21.15.81:0/4011921873 shutdown_connections 2023-10-07T08:49:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.183+0000 7fb0b6e31700 1 -- 172.21.15.81:0/4011921873 wait complete. 2023-10-07T08:49:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 58 2023-10-07T08:49:02.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:49:02.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.308+0000 7fb15c1ec700 1 Processor -- start 2023-10-07T08:49:02.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.309+0000 7fb15c1ec700 1 -- start start 2023-10-07T08:49:02.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb15c1ec700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb1540cf240 0x7fb1540b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:02.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb15c1ec700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb15406d650 0x7fb15406da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:02.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb15c1ec700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1540b0ca0 con 0x7fb15415a2a0 2023-10-07T08:49:02.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb15c1ec700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb15406ea90 con 0x7fb15406d650 2023-10-07T08:49:02.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb15c1ec700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1540b00d0 con 0x7fb1540cf240 2023-10-07T08:49:02.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb15a789700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb15406d650 0x7fb15406da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:02.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb159f88700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb15415a2a0 0x7fb1540ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34384/0 (socket says 172.21.15.81:34384) 2023-10-07T08:49:02.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb159f88700 1 -- 172.21.15.81:0/3742378680 learned_addr learned my addr 172.21.15.81:0/3742378680 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:02.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb159787700 1 --2- 172.21.15.81:0/3742378680 >> v2:172.21.15.89:3300/0 conn(0x7fb1540cf240 0x7fb1540b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:02.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb15a789700 1 -- 172.21.15.81:0/3742378680 >> v2:172.21.15.89:3300/0 conn(0x7fb1540cf240 msgr2=0x7fb1540b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:02.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb15a789700 1 --2- 172.21.15.81:0/3742378680 >> v2:172.21.15.89:3300/0 conn(0x7fb1540cf240 0x7fb1540b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb15a789700 1 -- 172.21.15.81:0/3742378680 >> v1:172.21.15.81:6789/0 conn(0x7fb15415a2a0 legacy=0x7fb1540ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb15a789700 1 -- 172.21.15.81:0/3742378680 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1540b0370 con 0x7fb15406d650 2023-10-07T08:49:02.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb158f86700 1 -- 172.21.15.81:0/3742378680 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474777671 0 0) 0x7fb1540b0ca0 con 0x7fb15415a2a0 2023-10-07T08:49:02.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb159787700 1 --2- 172.21.15.81:0/3742378680 >> v2:172.21.15.89:3300/0 conn(0x7fb1540cf240 0x7fb1540b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:02.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb15a789700 1 --2- 172.21.15.81:0/3742378680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb15406d650 0x7fb15406da20 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fb1540713b0 tx=0x7fb14c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff245bd15b8296e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:02.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb158f86700 1 -- 172.21.15.81:0/3742378680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c00b6b0 con 0x7fb15406d650 2023-10-07T08:49:02.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb158f86700 1 -- 172.21.15.81:0/3742378680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14c00b810 con 0x7fb15406d650 2023-10-07T08:49:02.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.310+0000 7fb158f86700 1 -- 172.21.15.81:0/3742378680 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c00bbb0 con 0x7fb15406d650 2023-10-07T08:49:02.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.311+0000 7fb15c1ec700 1 -- 172.21.15.81:0/3742378680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb15406d650 msgr2=0x7fb15406da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.311+0000 7fb15c1ec700 1 --2- 172.21.15.81:0/3742378680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb15406d650 0x7fb15406da20 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fb1540713b0 tx=0x7fb14c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.311+0000 7fb15c1ec700 1 -- 172.21.15.81:0/3742378680 shutdown_connections 2023-10-07T08:49:02.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.311+0000 7fb15c1ec700 1 --2- 172.21.15.81:0/3742378680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb15406d650 0x7fb15406da20 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.311+0000 7fb15c1ec700 1 --2- 172.21.15.81:0/3742378680 >> v2:172.21.15.89:3300/0 conn(0x7fb1540cf240 0x7fb1540b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.311+0000 7fb15c1ec700 1 -- 172.21.15.81:0/3742378680 >> 172.21.15.81:0/3742378680 conn(0x7fb154067640 msgr2=0x7fb154067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:02.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.311+0000 7fb15c1ec700 1 -- 172.21.15.81:0/3742378680 shutdown_connections 2023-10-07T08:49:02.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.311+0000 7fb15c1ec700 1 -- 172.21.15.81:0/3742378680 wait complete. 2023-10-07T08:49:02.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.312+0000 7fb15c1ec700 1 Processor -- start 2023-10-07T08:49:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.312+0000 7fb15c1ec700 1 -- start start 2023-10-07T08:49:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb15c1ec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb15406d650 0x7fb1540cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb15c1ec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1540cf240 0x7fb154146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb15c1ec700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb15415a2a0 0x7fb1540addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb15c1ec700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1540c8eb0 con 0x7fb15406d650 2023-10-07T08:49:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb15c1ec700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1540c7ff0 con 0x7fb15415a2a0 2023-10-07T08:49:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb15c1ec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1540cc620 con 0x7fb1540cf240 2023-10-07T08:49:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb159f88700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb15406d650 0x7fb1540cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb159f88700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb15406d650 0x7fb1540cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53062/0 (socket says 172.21.15.81:53062) 2023-10-07T08:49:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb159f88700 1 -- 172.21.15.81:0/3215206169 learned_addr learned my addr 172.21.15.81:0/3215206169 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb159f88700 1 -- 172.21.15.81:0/3215206169 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1540cf240 msgr2=0x7fb154146750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb159f88700 1 --2- 172.21.15.81:0/3215206169 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1540cf240 0x7fb154146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb159f88700 1 -- 172.21.15.81:0/3215206169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb15415a2a0 msgr2=0x7fb1540addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb159f88700 1 --2- 172.21.15.81:0/3215206169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb15415a2a0 0x7fb1540addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb159f88700 1 -- 172.21.15.81:0/3215206169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c009420 con 0x7fb15406d650 2023-10-07T08:49:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb159f88700 1 --2- 172.21.15.81:0/3215206169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb15406d650 0x7fb1540cc0e0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb14400cc70 tx=0x7fb144001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb151ffb700 1 -- 172.21.15.81:0/3215206169 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14400ce80 con 0x7fb15406d650 2023-10-07T08:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb151ffb700 1 -- 172.21.15.81:0/3215206169 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14400ab70 con 0x7fb15406d650 2023-10-07T08:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb15c1ec700 1 -- 172.21.15.81:0/3215206169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1540c82a0 con 0x7fb15406d650 2023-10-07T08:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.313+0000 7fb151ffb700 1 -- 172.21.15.81:0/3215206169 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1440070f0 con 0x7fb15406d650 2023-10-07T08:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.314+0000 7fb15c1ec700 1 -- 172.21.15.81:0/3215206169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1540c88e0 con 0x7fb15406d650 2023-10-07T08:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.314+0000 7fb15c1ec700 1 -- 172.21.15.81:0/3215206169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1540cc7e0 con 0x7fb15406d650 2023-10-07T08:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.315+0000 7fb151ffb700 1 -- 172.21.15.81:0/3215206169 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1440074e0 con 0x7fb15406d650 2023-10-07T08:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.315+0000 7fb151ffb700 1 --2- 172.21.15.81:0/3215206169 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb140066f30 0x7fb1400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.316+0000 7fb159787700 1 --2- 172.21.15.81:0/3215206169 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb140066f30 0x7fb1400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.316+0000 7fb151ffb700 1 -- 172.21.15.81:0/3215206169 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb1440849b0 con 0x7fb15406d650 2023-10-07T08:49:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.316+0000 7fb159787700 1 --2- 172.21.15.81:0/3215206169 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb140066f30 0x7fb1400693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb15415f9f0 tx=0x7fb148008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.320+0000 7fb151ffb700 1 -- 172.21.15.81:0/3215206169 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1540cc7e0 con 0x7fb15406d650 2023-10-07T08:49:02.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.543+0000 7fb15c1ec700 1 -- 172.21.15.81:0/3215206169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1540cc7e0 con 0x7fb15406d650 2023-10-07T08:49:02.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.544+0000 7fb151ffb700 1 -- 172.21.15.81:0/3215206169 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fb1540cc7e0 con 0x7fb15406d650 2023-10-07T08:49:02.545 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:02.545 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/2384735966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2384735966},{"type":"v1","addr":"172.21.15.89:6834","nonce":2384735966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1456306972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1456306972},{"type":"v1","addr":"172.21.15.89:6835","nonce":1456306972}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3356050793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3356050793},{"type":"v1","addr":"172.21.15.81:6836","nonce":3356050793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:48:40.667880+0000","modified":"2023-10-07T08:48:44.308458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6741":{"gid":6741,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2231384962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2231384962},{"type":"v1","addr":"172.21.15.81:6837","nonce":2231384962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-07T08:49:02.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.546+0000 7fb15c1ec700 1 -- 172.21.15.81:0/3215206169 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb140066f30 msgr2=0x7fb1400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.546+0000 7fb15c1ec700 1 --2- 172.21.15.81:0/3215206169 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb140066f30 0x7fb1400693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb15415f9f0 tx=0x7fb148008040 comp rx=0 tx=0).stop 2023-10-07T08:49:02.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.546+0000 7fb15c1ec700 1 -- 172.21.15.81:0/3215206169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb15406d650 msgr2=0x7fb1540cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.546+0000 7fb15c1ec700 1 --2- 172.21.15.81:0/3215206169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb15406d650 0x7fb1540cc0e0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb14400cc70 tx=0x7fb144001a30 comp rx=0 tx=0).stop 2023-10-07T08:49:02.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.546+0000 7fb15c1ec700 1 -- 172.21.15.81:0/3215206169 shutdown_connections 2023-10-07T08:49:02.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.546+0000 7fb15c1ec700 1 --2- 172.21.15.81:0/3215206169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb15415a2a0 0x7fb1540addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.546+0000 7fb15c1ec700 1 --2- 172.21.15.81:0/3215206169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb15406d650 0x7fb1540cc0e0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.546+0000 7fb15c1ec700 1 --2- 172.21.15.81:0/3215206169 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb140066f30 0x7fb1400693e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.546+0000 7fb15c1ec700 1 --2- 172.21.15.81:0/3215206169 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1540cf240 0x7fb154146750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.546+0000 7fb15c1ec700 1 -- 172.21.15.81:0/3215206169 >> 172.21.15.81:0/3215206169 conn(0x7fb154067640 msgr2=0x7fb154158360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:02.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.546+0000 7fb15c1ec700 1 -- 172.21.15.81:0/3215206169 shutdown_connections 2023-10-07T08:49:02.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.546+0000 7fb15c1ec700 1 -- 172.21.15.81:0/3215206169 wait complete. 2023-10-07T08:49:02.548 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 58 2023-10-07T08:49:02.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:49:02.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.670+0000 7fb74cec0700 1 Processor -- start 2023-10-07T08:49:02.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.670+0000 7fb74cec0700 1 -- start start 2023-10-07T08:49:02.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.671+0000 7fb74cec0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb748156db0 0x7fb74806e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:02.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.671+0000 7fb74cec0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7480b2290 con 0x7fb7481569e0 2023-10-07T08:49:02.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.671+0000 7fb74cec0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb748157c00 con 0x7fb74806e770 2023-10-07T08:49:02.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.671+0000 7fb74cec0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74806ebf0 con 0x7fb748156db0 2023-10-07T08:49:02.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.671+0000 7fb74659c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb7481569e0 0x7fb7480b17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42784/0 (socket says 172.21.15.81:42784) 2023-10-07T08:49:02.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.671+0000 7fb74659c700 1 -- 172.21.15.81:0/674002052 learned_addr learned my addr 172.21.15.81:0/674002052 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:02.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb745d9b700 1 --2- 172.21.15.81:0/674002052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb748156db0 0x7fb74806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:02.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.671+0000 7fb74559a700 1 -- 172.21.15.81:0/674002052 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770330661 0 0) 0x7fb7480b2290 con 0x7fb7481569e0 2023-10-07T08:49:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 -- 172.21.15.81:0/674002052 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb734003570 con 0x7fb7481569e0 2023-10-07T08:49:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 -- 172.21.15.81:0/674002052 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2646551444 0 0) 0x7fb734003570 con 0x7fb7481569e0 2023-10-07T08:49:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 -- 172.21.15.81:0/674002052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb748156db0 msgr2=0x7fb74806e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 --2- 172.21.15.81:0/674002052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb748156db0 0x7fb74806e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 -- 172.21.15.81:0/674002052 >> v1:172.21.15.89:6789/0 conn(0x7fb74806e770 legacy=0x7fb7480cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 -- 172.21.15.81:0/674002052 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7481572d0 con 0x7fb7481569e0 2023-10-07T08:49:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 -- 172.21.15.81:0/674002052 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fb7380017f0 con 0x7fb7481569e0 2023-10-07T08:49:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 -- 172.21.15.81:0/674002052 >> v1:172.21.15.81:6789/0 conn(0x7fb7481569e0 legacy=0x7fb7480b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 --2- 172.21.15.81:0/674002052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb748156db0 0x7fb734003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 --2- 172.21.15.81:0/674002052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7340040c0 0x7fb734004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 --2- 172.21.15.81:0/674002052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb734004da0 0x7fb7340051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 -- 172.21.15.81:0/674002052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74806ebf0 con 0x7fb7340040c0 2023-10-07T08:49:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 -- 172.21.15.81:0/674002052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73400bc70 con 0x7fb734004da0 2023-10-07T08:49:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 -- 172.21.15.81:0/674002052 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73400be30 con 0x7fb748156db0 2023-10-07T08:49:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb745d9b700 1 --2- 172.21.15.81:0/674002052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7340040c0 0x7fb734004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74659c700 1 --2- 172.21.15.81:0/674002052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb748156db0 0x7fb734003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb746d9d700 1 --2- 172.21.15.81:0/674002052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb734004da0 0x7fb7340051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb745d9b700 1 -- 172.21.15.81:0/674002052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb748156db0 msgr2=0x7fb734003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb745d9b700 1 --2- 172.21.15.81:0/674002052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb748156db0 0x7fb734003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb745d9b700 1 -- 172.21.15.81:0/674002052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb734004da0 msgr2=0x7fb7340051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb745d9b700 1 --2- 172.21.15.81:0/674002052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb734004da0 0x7fb7340051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb745d9b700 1 -- 172.21.15.81:0/674002052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb734003570 con 0x7fb7340040c0 2023-10-07T08:49:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb745d9b700 1 --2- 172.21.15.81:0/674002052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7340040c0 0x7fb734004810 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fb73000bb60 tx=0x7fb730008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d95dea81e72db server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 -- 172.21.15.81:0/674002052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73000d5d0 con 0x7fb7340040c0 2023-10-07T08:49:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 -- 172.21.15.81:0/674002052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73000d730 con 0x7fb7340040c0 2023-10-07T08:49:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.672+0000 7fb74559a700 1 -- 172.21.15.81:0/674002052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73000daf0 con 0x7fb7340040c0 2023-10-07T08:49:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.673+0000 7fb74cec0700 1 -- 172.21.15.81:0/674002052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7340040c0 msgr2=0x7fb734004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.673+0000 7fb74cec0700 1 --2- 172.21.15.81:0/674002052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7340040c0 0x7fb734004810 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fb73000bb60 tx=0x7fb730008040 comp rx=0 tx=0).stop 2023-10-07T08:49:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.673+0000 7fb746d9d700 1 -- 172.21.15.81:0/674002052 reap_dead start 2023-10-07T08:49:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.673+0000 7fb74cec0700 1 -- 172.21.15.81:0/674002052 shutdown_connections 2023-10-07T08:49:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.673+0000 7fb74cec0700 1 -- 172.21.15.81:0/674002052 >> 172.21.15.81:0/674002052 conn(0x7fb74806cca0 msgr2=0x7fb74806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.673+0000 7fb74cec0700 1 -- 172.21.15.81:0/674002052 shutdown_connections 2023-10-07T08:49:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.673+0000 7fb74cec0700 1 -- 172.21.15.81:0/674002052 wait complete. 2023-10-07T08:49:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.674+0000 7fb74cec0700 1 Processor -- start 2023-10-07T08:49:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.674+0000 7fb74cec0700 1 -- start start 2023-10-07T08:49:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb74cec0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7340040c0 0x7fb74815a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb74cec0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7480af9f0 0x7fb7480c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb74cec0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb74816e860 0x7fb74806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb74cec0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7481582a0 con 0x7fb74816e860 2023-10-07T08:49:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb74cec0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb748158580 con 0x7fb7480af9f0 2023-10-07T08:49:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb74cec0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb748158860 con 0x7fb7340040c0 2023-10-07T08:49:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb746d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb74816e860 0x7fb74806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb746d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb74816e860 0x7fb74806bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39834/0 (socket says 172.21.15.81:39834) 2023-10-07T08:49:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb746d9d700 1 -- 172.21.15.81:0/1849253243 learned_addr learned my addr 172.21.15.81:0/1849253243 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb745d9b700 1 --2- 172.21.15.81:0/1849253243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7480af9f0 0x7fb7480c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb74659c700 1 --2- 172.21.15.81:0/1849253243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7340040c0 0x7fb74815a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb746d9d700 1 -- 172.21.15.81:0/1849253243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7340040c0 msgr2=0x7fb74815a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb746d9d700 1 --2- 172.21.15.81:0/1849253243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7340040c0 0x7fb74815a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb746d9d700 1 -- 172.21.15.81:0/1849253243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7480af9f0 msgr2=0x7fb7480c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb746d9d700 1 --2- 172.21.15.81:0/1849253243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7480af9f0 0x7fb7480c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb746d9d700 1 -- 172.21.15.81:0/1849253243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb748158b40 con 0x7fb74816e860 2023-10-07T08:49:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb745d9b700 1 --2- 172.21.15.81:0/1849253243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7480af9f0 0x7fb7480c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb746d9d700 1 --2- 172.21.15.81:0/1849253243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb74816e860 0x7fb74806bb90 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fb748071450 tx=0x7fb740009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb73e7fc700 1 -- 172.21.15.81:0/1849253243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74000ee60 con 0x7fb74816e860 2023-10-07T08:49:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb73e7fc700 1 -- 172.21.15.81:0/1849253243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb740012590 con 0x7fb74816e860 2023-10-07T08:49:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb74cec0700 1 -- 172.21.15.81:0/1849253243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb748158e20 con 0x7fb74816e860 2023-10-07T08:49:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.675+0000 7fb73e7fc700 1 -- 172.21.15.81:0/1849253243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb740012950 con 0x7fb74816e860 2023-10-07T08:49:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.676+0000 7fb74cec0700 1 -- 172.21.15.81:0/1849253243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7480ca020 con 0x7fb74816e860 2023-10-07T08:49:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.676+0000 7fb74cec0700 1 -- 172.21.15.81:0/1849253243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb748068900 con 0x7fb74816e860 2023-10-07T08:49:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.677+0000 7fb73e7fc700 1 -- 172.21.15.81:0/1849253243 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb740012d00 con 0x7fb74816e860 2023-10-07T08:49:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.677+0000 7fb73e7fc700 1 --2- 172.21.15.81:0/1849253243 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb728066f30 0x7fb7280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.677+0000 7fb73e7fc700 1 -- 172.21.15.81:0/1849253243 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb740084330 con 0x7fb74816e860 2023-10-07T08:49:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.677+0000 7fb74659c700 1 --2- 172.21.15.81:0/1849253243 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb728066f30 0x7fb7280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.678+0000 7fb74659c700 1 --2- 172.21.15.81:0/1849253243 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb728066f30 0x7fb7280693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb738001190 tx=0x7fb738006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.681+0000 7fb73e7fc700 1 -- 172.21.15.81:0/1849253243 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7400515a0 con 0x7fb74816e860 2023-10-07T08:49:02.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.865+0000 7fb74cec0700 1 -- 172.21.15.81:0/1849253243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7481575b0 con 0x7fb74816e860 2023-10-07T08:49:02.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.866+0000 7fb73e7fc700 1 -- 172.21.15.81:0/1849253243 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+15324 (secure 0 0 0) 0x7fb740054bc0 con 0x7fb74816e860 2023-10-07T08:49:02.868 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:02.868 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":126,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:48:57.355708+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:48:38.552036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-07T08:48:39.627974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:49:02.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.868+0000 7fb74cec0700 1 -- 172.21.15.81:0/1849253243 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb728066f30 msgr2=0x7fb7280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.868+0000 7fb74cec0700 1 --2- 172.21.15.81:0/1849253243 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb728066f30 0x7fb7280693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb738001190 tx=0x7fb738006040 comp rx=0 tx=0).stop 2023-10-07T08:49:02.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.868+0000 7fb74cec0700 1 -- 172.21.15.81:0/1849253243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb74816e860 msgr2=0x7fb74806bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.868+0000 7fb74cec0700 1 --2- 172.21.15.81:0/1849253243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb74816e860 0x7fb74806bb90 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fb748071450 tx=0x7fb740009040 comp rx=0 tx=0).stop 2023-10-07T08:49:02.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.868+0000 7fb74cec0700 1 -- 172.21.15.81:0/1849253243 shutdown_connections 2023-10-07T08:49:02.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.868+0000 7fb74cec0700 1 --2- 172.21.15.81:0/1849253243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb74816e860 0x7fb74806bb90 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.868+0000 7fb74cec0700 1 --2- 172.21.15.81:0/1849253243 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb728066f30 0x7fb7280693e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.868+0000 7fb74cec0700 1 --2- 172.21.15.81:0/1849253243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7340040c0 0x7fb74815a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.868+0000 7fb74cec0700 1 --2- 172.21.15.81:0/1849253243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7480af9f0 0x7fb7480c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.868+0000 7fb74cec0700 1 -- 172.21.15.81:0/1849253243 >> 172.21.15.81:0/1849253243 conn(0x7fb74806cca0 msgr2=0x7fb7480cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:02.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.868+0000 7fb74cec0700 1 -- 172.21.15.81:0/1849253243 shutdown_connections 2023-10-07T08:49:02.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.868+0000 7fb74cec0700 1 -- 172.21.15.81:0/1849253243 wait complete. 2023-10-07T08:49:02.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T08:49:02.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.994+0000 7f5a2a8a7700 1 Processor -- start 2023-10-07T08:49:02.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.994+0000 7f5a2a8a7700 1 -- start start 2023-10-07T08:49:02.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.995+0000 7f5a2a8a7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a241578d0 0x7f5a240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:02.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.995+0000 7f5a2a8a7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a2406d120 0x7f5a2406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:02.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.995+0000 7f5a2a8a7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a240d07c0 con 0x7f5a24157ca0 2023-10-07T08:49:02.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.995+0000 7f5a2a8a7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2406daa0 con 0x7f5a241578d0 2023-10-07T08:49:02.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.995+0000 7f5a2a8a7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240cfbb0 con 0x7f5a2406d120 2023-10-07T08:49:02.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.995+0000 7f5a23fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a241578d0 0x7f5a240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:02.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.995+0000 7f5a23fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a241578d0 0x7f5a240cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39846/0 (socket says 172.21.15.81:39846) 2023-10-07T08:49:02.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.995+0000 7f5a23fff700 1 -- 172.21.15.81:0/3540908132 learned_addr learned my addr 172.21.15.81:0/3540908132 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:02.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.995+0000 7f5a28e44700 1 --2- 172.21.15.81:0/3540908132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a2406d120 0x7f5a2406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:02.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.995+0000 7f5a23fff700 1 -- 172.21.15.81:0/3540908132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a2406d120 msgr2=0x7f5a2406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:02.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.995+0000 7f5a23fff700 1 --2- 172.21.15.81:0/3540908132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a2406d120 0x7f5a2406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:02.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.995+0000 7f5a23fff700 1 -- 172.21.15.81:0/3540908132 >> v1:172.21.15.89:6789/0 conn(0x7f5a24157ca0 legacy=0x7f5a2415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.995+0000 7f5a23fff700 1 -- 172.21.15.81:0/3540908132 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a240cfe90 con 0x7f5a241578d0 2023-10-07T08:49:02.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.996+0000 7f5a23fff700 1 --2- 172.21.15.81:0/3540908132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a241578d0 0x7f5a240cf4f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f5a140099b0 tx=0x7f5a14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611b43fc05ad46b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:02.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.996+0000 7f5a22ffd700 1 -- 172.21.15.81:0/3540908132 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14009ea0 con 0x7f5a241578d0 2023-10-07T08:49:02.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.996+0000 7f5a22ffd700 1 -- 172.21.15.81:0/3540908132 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1400b860 con 0x7f5a241578d0 2023-10-07T08:49:02.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.996+0000 7f5a22ffd700 1 -- 172.21.15.81:0/3540908132 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1400bc00 con 0x7f5a241578d0 2023-10-07T08:49:02.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.996+0000 7f5a2a8a7700 1 -- 172.21.15.81:0/3540908132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a241578d0 msgr2=0x7f5a240cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:02.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.996+0000 7f5a2a8a7700 1 --2- 172.21.15.81:0/3540908132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a241578d0 0x7f5a240cf4f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f5a140099b0 tx=0x7f5a14009250 comp rx=0 tx=0).stop 2023-10-07T08:49:02.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.996+0000 7f5a2a8a7700 1 -- 172.21.15.81:0/3540908132 shutdown_connections 2023-10-07T08:49:02.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.996+0000 7f5a2a8a7700 1 --2- 172.21.15.81:0/3540908132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a2406d120 0x7f5a2406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:03.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.996+0000 7f5a2a8a7700 1 --2- 172.21.15.81:0/3540908132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a241578d0 0x7f5a240cf4f0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:03.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.996+0000 7f5a2a8a7700 1 -- 172.21.15.81:0/3540908132 >> 172.21.15.81:0/3540908132 conn(0x7f5a2406bb90 msgr2=0x7f5a2406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:03.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.996+0000 7f5a2a8a7700 1 -- 172.21.15.81:0/3540908132 shutdown_connections 2023-10-07T08:49:03.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.996+0000 7f5a2a8a7700 1 -- 172.21.15.81:0/3540908132 wait complete. 2023-10-07T08:49:03.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.997+0000 7f5a2a8a7700 1 Processor -- start 2023-10-07T08:49:03.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.998+0000 7f5a2a8a7700 1 -- start start 2023-10-07T08:49:03.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.998+0000 7f5a2a8a7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a2406d120 0x7f5a241596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:03.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.998+0000 7f5a2a8a7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a241578d0 0x7f5a240ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:03.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.998+0000 7f5a2a8a7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a24157ca0 0x7f5a240adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:03.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.998+0000 7f5a2a8a7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240ab9c0 con 0x7f5a241578d0 2023-10-07T08:49:03.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.998+0000 7f5a2a8a7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240acee0 con 0x7f5a2406d120 2023-10-07T08:49:03.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.998+0000 7f5a2a8a7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240ac7d0 con 0x7f5a24157ca0 2023-10-07T08:49:03.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.998+0000 7f5a237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a241578d0 0x7f5a240ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:03.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.998+0000 7f5a237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a241578d0 0x7f5a240ad6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39862/0 (socket says 172.21.15.81:39862) 2023-10-07T08:49:03.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.999+0000 7f5a237fe700 1 -- 172.21.15.81:0/3599305610 learned_addr learned my addr 172.21.15.81:0/3599305610 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:03.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.999+0000 7f5a28e44700 1 --2- 172.21.15.81:0/3599305610 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a24157ca0 0x7f5a240adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:03.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.999+0000 7f5a23fff700 1 --2- 172.21.15.81:0/3599305610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a2406d120 0x7f5a241596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:03.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.999+0000 7f5a237fe700 1 -- 172.21.15.81:0/3599305610 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a24157ca0 msgr2=0x7f5a240adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.999+0000 7f5a237fe700 1 --2- 172.21.15.81:0/3599305610 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a24157ca0 0x7f5a240adbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.999+0000 7f5a237fe700 1 -- 172.21.15.81:0/3599305610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a2406d120 msgr2=0x7f5a241596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.999+0000 7f5a237fe700 1 --2- 172.21.15.81:0/3599305610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a2406d120 0x7f5a241596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.999+0000 7f5a237fe700 1 -- 172.21.15.81:0/3599305610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a140094f0 con 0x7f5a241578d0 2023-10-07T08:49:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.999+0000 7f5a237fe700 1 --2- 172.21.15.81:0/3599305610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a241578d0 0x7f5a240ad6a0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800c590 tx=0x7f5a18007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.999+0000 7f5a0bfff700 1 -- 172.21.15.81:0/3599305610 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18011590 con 0x7f5a241578d0 2023-10-07T08:49:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.999+0000 7f5a0bfff700 1 -- 172.21.15.81:0/3599305610 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a18011710 con 0x7f5a241578d0 2023-10-07T08:49:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.999+0000 7f5a2a8a7700 1 -- 172.21.15.81:0/3599305610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a240ab400 con 0x7f5a241578d0 2023-10-07T08:49:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.999+0000 7f5a0bfff700 1 -- 172.21.15.81:0/3599305610 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18011ad0 con 0x7f5a241578d0 2023-10-07T08:49:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:02.999+0000 7f5a2a8a7700 1 -- 172.21.15.81:0/3599305610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a240ad180 con 0x7f5a241578d0 2023-10-07T08:49:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.000+0000 7f5a2a8a7700 1 -- 172.21.15.81:0/3599305610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a240ad3a0 con 0x7f5a241578d0 2023-10-07T08:49:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.000+0000 7f5a0bfff700 1 -- 172.21.15.81:0/3599305610 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a1801b3b0 con 0x7f5a241578d0 2023-10-07T08:49:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.001+0000 7f5a0bfff700 1 --2- 172.21.15.81:0/3599305610 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5a10066f30 0x7f5a100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:03.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.001+0000 7f5a0bfff700 1 -- 172.21.15.81:0/3599305610 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5a18083830 con 0x7f5a241578d0 2023-10-07T08:49:03.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.001+0000 7f5a23fff700 1 --2- 172.21.15.81:0/3599305610 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5a10066f30 0x7f5a100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:03.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.001+0000 7f5a23fff700 1 --2- 172.21.15.81:0/3599305610 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5a10066f30 0x7f5a100693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5a140099b0 tx=0x7f5a14017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:03.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.005+0000 7f5a0bfff700 1 -- 172.21.15.81:0/3599305610 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a18050aa0 con 0x7f5a241578d0 2023-10-07T08:49:03.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.229+0000 7f5a2a8a7700 1 -- 172.21.15.81:0/3599305610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5a240d0170 con 0x7f5a241578d0 2023-10-07T08:49:03.231 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:49:03.230+0000 7f43c472d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T08:49:03.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.234+0000 7f5a0bfff700 1 -- 172.21.15.81:0/3599305610 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5a18017070 con 0x7f5a241578d0 2023-10-07T08:49:03.237 INFO:tasks.ceph.mds.c.smithi081.stderr: -3441> 2023-10-07T08:48:46.142+0000 7f2374ceb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:49:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.240+0000 7f5a2a8a7700 1 -- 172.21.15.81:0/3599305610 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5a10066f30 msgr2=0x7f5a100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.240+0000 7f5a2a8a7700 1 --2- 172.21.15.81:0/3599305610 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5a10066f30 0x7f5a100693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5a140099b0 tx=0x7f5a14017000 comp rx=0 tx=0).stop 2023-10-07T08:49:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.240+0000 7f5a2a8a7700 1 -- 172.21.15.81:0/3599305610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a241578d0 msgr2=0x7f5a240ad6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.240+0000 7f5a2a8a7700 1 --2- 172.21.15.81:0/3599305610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a241578d0 0x7f5a240ad6a0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800c590 tx=0x7f5a18007f50 comp rx=0 tx=0).stop 2023-10-07T08:49:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.240+0000 7f5a2a8a7700 1 -- 172.21.15.81:0/3599305610 shutdown_connections 2023-10-07T08:49:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.240+0000 7f5a2a8a7700 1 --2- 172.21.15.81:0/3599305610 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5a10066f30 0x7f5a100693e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.240+0000 7f5a2a8a7700 1 --2- 172.21.15.81:0/3599305610 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a24157ca0 0x7f5a240adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.240+0000 7f5a2a8a7700 1 --2- 172.21.15.81:0/3599305610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a2406d120 0x7f5a241596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.240+0000 7f5a2a8a7700 1 --2- 172.21.15.81:0/3599305610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a241578d0 0x7f5a240ad6a0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.240+0000 7f5a2a8a7700 1 -- 172.21.15.81:0/3599305610 >> 172.21.15.81:0/3599305610 conn(0x7f5a2406bb90 msgr2=0x7f5a240697a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.240+0000 7f5a2a8a7700 1 -- 172.21.15.81:0/3599305610 shutdown_connections 2023-10-07T08:49:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.240+0000 7f5a2a8a7700 1 -- 172.21.15.81:0/3599305610 wait complete. 2023-10-07T08:49:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T08:49:03.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T08:49:03.265 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-07T08:49:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.369+0000 7fdb7eb64700 1 Processor -- start 2023-10-07T08:49:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.369+0000 7fdb7eb64700 1 -- start start 2023-10-07T08:49:03.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.370+0000 7fdb7eb64700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdb781578d0 0x7fdb780cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:03.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.370+0000 7fdb7eb64700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdb78157ca0 0x7fdb7815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.370+0000 7fdb7eb64700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb7806d120 0x7fdb7806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.370+0000 7fdb7eb64700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb780d07c0 con 0x7fdb781578d0 2023-10-07T08:49:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.370+0000 7fdb7eb64700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7806daa0 con 0x7fdb78157ca0 2023-10-07T08:49:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.370+0000 7fdb7eb64700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb780cfbb0 con 0x7fdb7806d120 2023-10-07T08:49:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.370+0000 7fdb7c900700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdb781578d0 0x7fdb780cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.370+0000 7fdb7c900700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdb781578d0 0x7fdb780cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39882/0 (socket says 172.21.15.81:39882) 2023-10-07T08:49:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.370+0000 7fdb7c900700 1 -- 172.21.15.81:0/2139141486 learned_addr learned my addr 172.21.15.81:0/2139141486 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb7d101700 1 --2- 172.21.15.81:0/2139141486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb7806d120 0x7fdb7806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb6ffff700 1 --2- 172.21.15.81:0/2139141486 >> v2:172.21.15.89:3300/0 conn(0x7fdb78157ca0 0x7fdb7815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb7c900700 1 -- 172.21.15.81:0/2139141486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb7806d120 msgr2=0x7fdb7806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb7c900700 1 --2- 172.21.15.81:0/2139141486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb7806d120 0x7fdb7806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb7c900700 1 -- 172.21.15.81:0/2139141486 >> v2:172.21.15.89:3300/0 conn(0x7fdb78157ca0 msgr2=0x7fdb7815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb7c900700 1 --2- 172.21.15.81:0/2139141486 >> v2:172.21.15.89:3300/0 conn(0x7fdb78157ca0 0x7fdb7815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb7c900700 1 -- 172.21.15.81:0/2139141486 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb780cfe90 con 0x7fdb781578d0 2023-10-07T08:49:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb7c900700 1 --2- 172.21.15.81:0/2139141486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb781578d0 0x7fdb780cf4f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fdb78068510 tx=0x7fdb74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f22866f8ac84918 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb6f7fe700 1 -- 172.21.15.81:0/2139141486 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400b860 con 0x7fdb781578d0 2023-10-07T08:49:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb6f7fe700 1 -- 172.21.15.81:0/2139141486 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7400b9c0 con 0x7fdb781578d0 2023-10-07T08:49:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb6f7fe700 1 -- 172.21.15.81:0/2139141486 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400bd60 con 0x7fdb781578d0 2023-10-07T08:49:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb7eb64700 1 -- 172.21.15.81:0/2139141486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb781578d0 msgr2=0x7fdb780cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb7eb64700 1 --2- 172.21.15.81:0/2139141486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb781578d0 0x7fdb780cf4f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fdb78068510 tx=0x7fdb74009250 comp rx=0 tx=0).stop 2023-10-07T08:49:03.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb7eb64700 1 -- 172.21.15.81:0/2139141486 shutdown_connections 2023-10-07T08:49:03.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb7eb64700 1 --2- 172.21.15.81:0/2139141486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb7806d120 0x7fdb7806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:03.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb7eb64700 1 --2- 172.21.15.81:0/2139141486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb781578d0 0x7fdb780cf4f0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:03.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb7eb64700 1 --2- 172.21.15.81:0/2139141486 >> v2:172.21.15.89:3300/0 conn(0x7fdb78157ca0 0x7fdb7815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:03.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.371+0000 7fdb7eb64700 1 -- 172.21.15.81:0/2139141486 >> 172.21.15.81:0/2139141486 conn(0x7fdb7806bb90 msgr2=0x7fdb7806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:03.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.372+0000 7fdb7eb64700 1 -- 172.21.15.81:0/2139141486 shutdown_connections 2023-10-07T08:49:03.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.372+0000 7fdb7eb64700 1 -- 172.21.15.81:0/2139141486 wait complete. 2023-10-07T08:49:03.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.373+0000 7fdb7eb64700 1 Processor -- start 2023-10-07T08:49:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.373+0000 7fdb7eb64700 1 -- start start 2023-10-07T08:49:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.373+0000 7fdb7eb64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb7806d120 0x7fdb7814cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.373+0000 7fdb7eb64700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb781578d0 0x7fdb780cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.373+0000 7fdb7eb64700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb78157ca0 0x7fdb780cd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.373+0000 7fdb7eb64700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb781508f0 con 0x7fdb7806d120 2023-10-07T08:49:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.373+0000 7fdb7eb64700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7814d4d0 con 0x7fdb78157ca0 2023-10-07T08:49:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.373+0000 7fdb7eb64700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7814fce0 con 0x7fdb781578d0 2023-10-07T08:49:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.374+0000 7fdb7c900700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb7806d120 0x7fdb7814cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.374+0000 7fdb7c900700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb7806d120 0x7fdb7814cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39890/0 (socket says 172.21.15.81:39890) 2023-10-07T08:49:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.374+0000 7fdb7c900700 1 -- 172.21.15.81:0/2515385502 learned_addr learned my addr 172.21.15.81:0/2515385502 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.374+0000 7fdb7d101700 1 --2- 172.21.15.81:0/2515385502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb78157ca0 0x7fdb780cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.374+0000 7fdb6ffff700 1 --2- 172.21.15.81:0/2515385502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb781578d0 0x7fdb780cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.374+0000 7fdb7c900700 1 -- 172.21.15.81:0/2515385502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb781578d0 msgr2=0x7fdb780cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.374+0000 7fdb7c900700 1 --2- 172.21.15.81:0/2515385502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb781578d0 0x7fdb780cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.374+0000 7fdb7c900700 1 -- 172.21.15.81:0/2515385502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb78157ca0 msgr2=0x7fdb780cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.374+0000 7fdb7c900700 1 --2- 172.21.15.81:0/2515385502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb78157ca0 0x7fdb780cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.374+0000 7fdb7c900700 1 -- 172.21.15.81:0/2515385502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb740094f0 con 0x7fdb7806d120 2023-10-07T08:49:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.374+0000 7fdb7c900700 1 --2- 172.21.15.81:0/2515385502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb7806d120 0x7fdb7814cf90 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fdb7806fe20 tx=0x7fdb74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.374+0000 7fdb6cff9700 1 -- 172.21.15.81:0/2515385502 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74024440 con 0x7fdb7806d120 2023-10-07T08:49:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.374+0000 7fdb6cff9700 1 -- 172.21.15.81:0/2515385502 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb740245a0 con 0x7fdb7806d120 2023-10-07T08:49:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.374+0000 7fdb6cff9700 1 -- 172.21.15.81:0/2515385502 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74024960 con 0x7fdb7806d120 2023-10-07T08:49:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.374+0000 7fdb7eb64700 1 -- 172.21.15.81:0/2515385502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7814ffc0 con 0x7fdb7806d120 2023-10-07T08:49:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.374+0000 7fdb7eb64700 1 -- 172.21.15.81:0/2515385502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb78150580 con 0x7fdb7806d120 2023-10-07T08:49:03.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.375+0000 7fdb7eb64700 1 -- 172.21.15.81:0/2515385502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb78067ac0 con 0x7fdb7806d120 2023-10-07T08:49:03.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.375+0000 7fdb6cff9700 1 -- 172.21.15.81:0/2515385502 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb7401a420 con 0x7fdb7806d120 2023-10-07T08:49:03.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.376+0000 7fdb6cff9700 1 --2- 172.21.15.81:0/2515385502 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb64066f30 0x7fdb640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:03.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.376+0000 7fdb6ffff700 1 --2- 172.21.15.81:0/2515385502 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb64066f30 0x7fdb640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:03.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.376+0000 7fdb6cff9700 1 -- 172.21.15.81:0/2515385502 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fdb74086410 con 0x7fdb7806d120 2023-10-07T08:49:03.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.376+0000 7fdb6ffff700 1 --2- 172.21.15.81:0/2515385502 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb64066f30 0x7fdb640693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fdb7806c0b0 tx=0x7fdb68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:03.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.380+0000 7fdb6cff9700 1 -- 172.21.15.81:0/2515385502 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb74053630 con 0x7fdb7806d120 2023-10-07T08:49:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:03.610+0000 7fdb7eb64700 1 -- 172.21.15.81:0/2515385502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdb780d0170 con 0x7fdb7806d120 2023-10-07T08:49:04.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.234+0000 7fdb6cff9700 1 -- 172.21.15.81:0/2515385502 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdb74056c50 con 0x7fdb7806d120 2023-10-07T08:49:04.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.236+0000 7fdb7eb64700 1 -- 172.21.15.81:0/2515385502 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb64066f30 msgr2=0x7fdb640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:04.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.236+0000 7fdb7eb64700 1 --2- 172.21.15.81:0/2515385502 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb64066f30 0x7fdb640693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fdb7806c0b0 tx=0x7fdb68008040 comp rx=0 tx=0).stop 2023-10-07T08:49:04.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.236+0000 7fdb7eb64700 1 -- 172.21.15.81:0/2515385502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb7806d120 msgr2=0x7fdb7814cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:04.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.236+0000 7fdb7eb64700 1 --2- 172.21.15.81:0/2515385502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb7806d120 0x7fdb7814cf90 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fdb7806fe20 tx=0x7fdb74017000 comp rx=0 tx=0).stop 2023-10-07T08:49:04.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.237+0000 7fdb7eb64700 1 -- 172.21.15.81:0/2515385502 shutdown_connections 2023-10-07T08:49:04.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.237+0000 7fdb7eb64700 1 --2- 172.21.15.81:0/2515385502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb78157ca0 0x7fdb780cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:04.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.237+0000 7fdb7eb64700 1 --2- 172.21.15.81:0/2515385502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb7806d120 0x7fdb7814cf90 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:04.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.237+0000 7fdb7eb64700 1 --2- 172.21.15.81:0/2515385502 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb64066f30 0x7fdb640693e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:04.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.237+0000 7fdb7eb64700 1 --2- 172.21.15.81:0/2515385502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb781578d0 0x7fdb780cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:04.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.237+0000 7fdb7eb64700 1 -- 172.21.15.81:0/2515385502 >> 172.21.15.81:0/2515385502 conn(0x7fdb7806bb90 msgr2=0x7fdb78156b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:04.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.237+0000 7fdb7eb64700 1 -- 172.21.15.81:0/2515385502 shutdown_connections 2023-10-07T08:49:04.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.237+0000 7fdb7eb64700 1 -- 172.21.15.81:0/2515385502 wait complete. 2023-10-07T08:49:04.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T08:49:04.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.411+0000 7fb1cae72700 1 Processor -- start 2023-10-07T08:49:04.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.411+0000 7fb1cae72700 1 -- start start 2023-10-07T08:49:04.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.412+0000 7fb1cae72700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1c41578d0 0x7fb1c40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:04.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.412+0000 7fb1cae72700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb1c406d120 0x7fb1c406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:04.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.412+0000 7fb1cae72700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c40d07c0 con 0x7fb1c4157ca0 2023-10-07T08:49:04.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.412+0000 7fb1cae72700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c406da50 con 0x7fb1c41578d0 2023-10-07T08:49:04.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.412+0000 7fb1cae72700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c40cfbb0 con 0x7fb1c406d120 2023-10-07T08:49:04.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.412+0000 7fb1c3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb1c4157ca0 0x7fb1c415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42802/0 (socket says 172.21.15.81:42802) 2023-10-07T08:49:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.412+0000 7fb1c8c0e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1c41578d0 0x7fb1c40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.412+0000 7fb1c3fff700 1 -- 172.21.15.81:0/2277123206 learned_addr learned my addr 172.21.15.81:0/2277123206 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.413+0000 7fb1c940f700 1 --2- 172.21.15.81:0/2277123206 >> v2:172.21.15.89:3300/0 conn(0x7fb1c406d120 0x7fb1c406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.413+0000 7fb1c8c0e700 1 -- 172.21.15.81:0/2277123206 >> v2:172.21.15.89:3300/0 conn(0x7fb1c406d120 msgr2=0x7fb1c406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.413+0000 7fb1c8c0e700 1 --2- 172.21.15.81:0/2277123206 >> v2:172.21.15.89:3300/0 conn(0x7fb1c406d120 0x7fb1c406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.413+0000 7fb1c8c0e700 1 -- 172.21.15.81:0/2277123206 >> v1:172.21.15.81:6789/0 conn(0x7fb1c4157ca0 legacy=0x7fb1c415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.413+0000 7fb1c8c0e700 1 -- 172.21.15.81:0/2277123206 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c40cfe90 con 0x7fb1c41578d0 2023-10-07T08:49:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.413+0000 7fb1c37fe700 1 -- 172.21.15.81:0/2277123206 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389886582 0 0) 0x7fb1c40d07c0 con 0x7fb1c4157ca0 2023-10-07T08:49:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.413+0000 7fb1c940f700 1 --2- 172.21.15.81:0/2277123206 >> v2:172.21.15.89:3300/0 conn(0x7fb1c406d120 0x7fb1c406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.413+0000 7fb1c8c0e700 1 --2- 172.21.15.81:0/2277123206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c41578d0 0x7fb1c40cf4f0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4068300 tx=0x7fb1b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edef2786285ec4ee server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.413+0000 7fb1c37fe700 1 -- 172.21.15.81:0/2277123206 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800b6b0 con 0x7fb1c41578d0 2023-10-07T08:49:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.413+0000 7fb1c37fe700 1 -- 172.21.15.81:0/2277123206 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b800b810 con 0x7fb1c41578d0 2023-10-07T08:49:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.413+0000 7fb1c37fe700 1 -- 172.21.15.81:0/2277123206 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800bbb0 con 0x7fb1c41578d0 2023-10-07T08:49:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.414+0000 7fb1cae72700 1 -- 172.21.15.81:0/2277123206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c41578d0 msgr2=0x7fb1c40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.414+0000 7fb1cae72700 1 --2- 172.21.15.81:0/2277123206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c41578d0 0x7fb1c40cf4f0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4068300 tx=0x7fb1b80091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.414+0000 7fb1cae72700 1 -- 172.21.15.81:0/2277123206 shutdown_connections 2023-10-07T08:49:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.414+0000 7fb1cae72700 1 --2- 172.21.15.81:0/2277123206 >> v2:172.21.15.89:3300/0 conn(0x7fb1c406d120 0x7fb1c406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.414+0000 7fb1cae72700 1 --2- 172.21.15.81:0/2277123206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c41578d0 0x7fb1c40cf4f0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.414+0000 7fb1cae72700 1 -- 172.21.15.81:0/2277123206 >> 172.21.15.81:0/2277123206 conn(0x7fb1c406bb90 msgr2=0x7fb1c406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.414+0000 7fb1cae72700 1 -- 172.21.15.81:0/2277123206 shutdown_connections 2023-10-07T08:49:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.414+0000 7fb1cae72700 1 -- 172.21.15.81:0/2277123206 wait complete. 2023-10-07T08:49:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.415+0000 7fb1cae72700 1 Processor -- start 2023-10-07T08:49:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.415+0000 7fb1cae72700 1 -- start start 2023-10-07T08:49:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1cae72700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c406d120 0x7fb1c40c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1cae72700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1c41578d0 0x7fb1c40b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1cae72700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c4157ca0 0x7fb1c40c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1cae72700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c40c7010 con 0x7fb1c406d120 2023-10-07T08:49:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1cae72700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c40c6440 con 0x7fb1c4157ca0 2023-10-07T08:49:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1cae72700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c40c66e0 con 0x7fb1c41578d0 2023-10-07T08:49:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1c8c0e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c406d120 0x7fb1c40c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1c8c0e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c406d120 0x7fb1c40c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39904/0 (socket says 172.21.15.81:39904) 2023-10-07T08:49:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1c8c0e700 1 -- 172.21.15.81:0/1032082917 learned_addr learned my addr 172.21.15.81:0/1032082917 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1c3fff700 1 --2- 172.21.15.81:0/1032082917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1c41578d0 0x7fb1c40b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1c940f700 1 --2- 172.21.15.81:0/1032082917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c4157ca0 0x7fb1c40c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1c8c0e700 1 -- 172.21.15.81:0/1032082917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1c41578d0 msgr2=0x7fb1c40b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1c8c0e700 1 --2- 172.21.15.81:0/1032082917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1c41578d0 0x7fb1c40b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1c8c0e700 1 -- 172.21.15.81:0/1032082917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c4157ca0 msgr2=0x7fb1c40c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1c8c0e700 1 --2- 172.21.15.81:0/1032082917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c4157ca0 0x7fb1c40c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1c8c0e700 1 -- 172.21.15.81:0/1032082917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b8009420 con 0x7fb1c406d120 2023-10-07T08:49:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1c940f700 1 --2- 172.21.15.81:0/1032082917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c4157ca0 0x7fb1c40c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1c8c0e700 1 --2- 172.21.15.81:0/1032082917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c406d120 0x7fb1c40c74a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80093f0 tx=0x7fb1b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1c0ff9700 1 -- 172.21.15.81:0/1032082917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800bb90 con 0x7fb1c406d120 2023-10-07T08:49:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1c0ff9700 1 -- 172.21.15.81:0/1032082917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b8011420 con 0x7fb1c406d120 2023-10-07T08:49:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1cae72700 1 -- 172.21.15.81:0/1032082917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c40c69c0 con 0x7fb1c406d120 2023-10-07T08:49:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1c0ff9700 1 -- 172.21.15.81:0/1032082917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80117c0 con 0x7fb1c406d120 2023-10-07T08:49:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.416+0000 7fb1cae72700 1 -- 172.21.15.81:0/1032082917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c40c79e0 con 0x7fb1c406d120 2023-10-07T08:49:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.417+0000 7fb1cae72700 1 -- 172.21.15.81:0/1032082917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c40c72f0 con 0x7fb1c406d120 2023-10-07T08:49:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.418+0000 7fb1c0ff9700 1 -- 172.21.15.81:0/1032082917 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1b8011b70 con 0x7fb1c406d120 2023-10-07T08:49:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.418+0000 7fb1c0ff9700 1 --2- 172.21.15.81:0/1032082917 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb1a8066f30 0x7fb1a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.418+0000 7fb1c0ff9700 1 -- 172.21.15.81:0/1032082917 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fb1b8085bd0 con 0x7fb1c406d120 2023-10-07T08:49:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.418+0000 7fb1c3fff700 1 --2- 172.21.15.81:0/1032082917 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb1a8066f30 0x7fb1a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.419+0000 7fb1c3fff700 1 --2- 172.21.15.81:0/1032082917 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb1a8066f30 0x7fb1a80693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40b2cb0 tx=0x7fb1b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:04.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.422+0000 7fb1c0ff9700 1 -- 172.21.15.81:0/1032082917 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1b8052df0 con 0x7fb1c406d120 2023-10-07T08:49:04.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:04.605+0000 7fb1cae72700 1 -- 172.21.15.81:0/1032082917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb1c40d0170 con 0x7fb1c406d120 2023-10-07T08:49:05.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.395+0000 7fb1c0ff9700 1 -- 172.21.15.81:0/1032082917 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v128) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb1b8056410 con 0x7fb1c406d120 2023-10-07T08:49:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.399+0000 7fb1cae72700 1 -- 172.21.15.81:0/1032082917 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb1a8066f30 msgr2=0x7fb1a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.399+0000 7fb1cae72700 1 --2- 172.21.15.81:0/1032082917 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb1a8066f30 0x7fb1a80693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40b2cb0 tx=0x7fb1b0009040 comp rx=0 tx=0).stop 2023-10-07T08:49:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.399+0000 7fb1cae72700 1 -- 172.21.15.81:0/1032082917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c406d120 msgr2=0x7fb1c40c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:05.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.399+0000 7fb1cae72700 1 --2- 172.21.15.81:0/1032082917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c406d120 0x7fb1c40c74a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80093f0 tx=0x7fb1b8017000 comp rx=0 tx=0).stop 2023-10-07T08:49:05.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.399+0000 7fb1cae72700 1 -- 172.21.15.81:0/1032082917 shutdown_connections 2023-10-07T08:49:05.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.399+0000 7fb1cae72700 1 --2- 172.21.15.81:0/1032082917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c4157ca0 0x7fb1c40c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:05.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.399+0000 7fb1cae72700 1 --2- 172.21.15.81:0/1032082917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c406d120 0x7fb1c40c74a0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:05.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.399+0000 7fb1cae72700 1 --2- 172.21.15.81:0/1032082917 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb1a8066f30 0x7fb1a80693e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:05.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.399+0000 7fb1cae72700 1 --2- 172.21.15.81:0/1032082917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1c41578d0 0x7fb1c40b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:05.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.399+0000 7fb1cae72700 1 -- 172.21.15.81:0/1032082917 >> 172.21.15.81:0/1032082917 conn(0x7fb1c406bb90 msgr2=0x7fb1c4068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:05.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.399+0000 7fb1cae72700 1 -- 172.21.15.81:0/1032082917 shutdown_connections 2023-10-07T08:49:05.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.399+0000 7fb1cae72700 1 -- 172.21.15.81:0/1032082917 wait complete. 2023-10-07T08:49:05.402 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-07T08:49:05.414 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T08:49:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.533+0000 7f2f0cfad700 1 Processor -- start 2023-10-07T08:49:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.533+0000 7f2f0cfad700 1 -- start start 2023-10-07T08:49:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.534+0000 7f2f0cfad700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f081578d0 0x7f2f080cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.534+0000 7f2f0cfad700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2f08157ca0 0x7f2f0815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.534+0000 7f2f0cfad700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f080d07c0 con 0x7f2f0806d120 2023-10-07T08:49:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.534+0000 7f2f0cfad700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f080cfbb0 con 0x7f2f08157ca0 2023-10-07T08:49:05.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.534+0000 7f2f0cfad700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f080cfe90 con 0x7f2f081578d0 2023-10-07T08:49:05.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.535+0000 7f2f06d9d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2f0806d120 0x7f2f0815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:41204/0 (socket says 172.21.15.81:41204) 2023-10-07T08:49:05.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.535+0000 7f2f06d9d700 1 -- 172.21.15.81:0/3705195463 learned_addr learned my addr 172.21.15.81:0/3705195463 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:05.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.535+0000 7f2f0659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f081578d0 0x7f2f080cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:05.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.535+0000 7f2efdd9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2f08157ca0 0x7f2f0815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:05.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.535+0000 7f2f05d9b700 1 -- 172.21.15.81:0/3705195463 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617316801 0 0) 0x7f2f080d07c0 con 0x7f2f0806d120 2023-10-07T08:49:05.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.535+0000 7f2f05d9b700 1 -- 172.21.15.81:0/3705195463 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ef4003570 con 0x7f2f0806d120 2023-10-07T08:49:05.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.535+0000 7f2f0659c700 1 -- 172.21.15.81:0/3705195463 >> v2:172.21.15.89:3300/0 conn(0x7f2f08157ca0 msgr2=0x7f2f0815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:05.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.535+0000 7f2f0659c700 1 --2- 172.21.15.81:0/3705195463 >> v2:172.21.15.89:3300/0 conn(0x7f2f08157ca0 0x7f2f0815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:05.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.535+0000 7f2f0659c700 1 -- 172.21.15.81:0/3705195463 >> v1:172.21.15.89:6789/0 conn(0x7f2f0806d120 legacy=0x7f2f0815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:05.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.535+0000 7f2f0659c700 1 -- 172.21.15.81:0/3705195463 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f080d0170 con 0x7f2f081578d0 2023-10-07T08:49:05.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.535+0000 7f2efdd9b700 1 --2- 172.21.15.81:0/3705195463 >> v2:172.21.15.89:3300/0 conn(0x7f2f08157ca0 0x7f2f0815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:49:05.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.535+0000 7f2f0659c700 1 --2- 172.21.15.81:0/3705195463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f081578d0 0x7f2f080cf4f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80098e0 tx=0x7f2ef80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcf3cb4a9f8397d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:05.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.535+0000 7f2f05d9b700 1 -- 172.21.15.81:0/3705195463 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8011630 con 0x7f2f081578d0 2023-10-07T08:49:05.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.535+0000 7f2f05d9b700 1 -- 172.21.15.81:0/3705195463 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef8011790 con 0x7f2f081578d0 2023-10-07T08:49:05.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.535+0000 7f2f05d9b700 1 -- 172.21.15.81:0/3705195463 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8011b10 con 0x7f2f081578d0 2023-10-07T08:49:05.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.536+0000 7f2f0cfad700 1 -- 172.21.15.81:0/3705195463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f081578d0 msgr2=0x7f2f080cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:05.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.536+0000 7f2f0cfad700 1 --2- 172.21.15.81:0/3705195463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f081578d0 0x7f2f080cf4f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80098e0 tx=0x7f2ef80091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:05.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.536+0000 7f2f0cfad700 1 -- 172.21.15.81:0/3705195463 shutdown_connections 2023-10-07T08:49:05.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.536+0000 7f2f0cfad700 1 --2- 172.21.15.81:0/3705195463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f081578d0 0x7f2f080cf4f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:05.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.536+0000 7f2f0cfad700 1 --2- 172.21.15.81:0/3705195463 >> v2:172.21.15.89:3300/0 conn(0x7f2f08157ca0 0x7f2f0815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:05.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.536+0000 7f2f0cfad700 1 -- 172.21.15.81:0/3705195463 >> 172.21.15.81:0/3705195463 conn(0x7f2f0806bb90 msgr2=0x7f2f0806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:05.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.536+0000 7f2f0cfad700 1 -- 172.21.15.81:0/3705195463 shutdown_connections 2023-10-07T08:49:05.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.536+0000 7f2f0cfad700 1 -- 172.21.15.81:0/3705195463 wait complete. 2023-10-07T08:49:05.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.537+0000 7f2f0cfad700 1 Processor -- start 2023-10-07T08:49:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.537+0000 7f2f0cfad700 1 -- start start 2023-10-07T08:49:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.538+0000 7f2f0cfad700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f0806d120 0x7f2f0816df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.538+0000 7f2f0cfad700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f081578d0 0x7f2f081535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.538+0000 7f2f0cfad700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f08157ca0 0x7f2f0814a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.538+0000 7f2f0cfad700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0816daa0 con 0x7f2f081578d0 2023-10-07T08:49:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.538+0000 7f2f0cfad700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f08152780 con 0x7f2f08157ca0 2023-10-07T08:49:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.538+0000 7f2f0cfad700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f081529f0 con 0x7f2f0806d120 2023-10-07T08:49:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.538+0000 7f2efdd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f081578d0 0x7f2f081535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.538+0000 7f2efdd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f081578d0 0x7f2f081535f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39918/0 (socket says 172.21.15.81:39918) 2023-10-07T08:49:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.538+0000 7f2efdd9b700 1 -- 172.21.15.81:0/2896685607 learned_addr learned my addr 172.21.15.81:0/2896685607 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:05.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.538+0000 7f2f0659c700 1 --2- 172.21.15.81:0/2896685607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f0806d120 0x7f2f0816df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:05.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.538+0000 7f2f06d9d700 1 --2- 172.21.15.81:0/2896685607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f08157ca0 0x7f2f0814a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:05.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.538+0000 7f2efdd9b700 1 -- 172.21.15.81:0/2896685607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f0806d120 msgr2=0x7f2f0816df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:05.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.538+0000 7f2efdd9b700 1 --2- 172.21.15.81:0/2896685607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f0806d120 0x7f2f0816df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:05.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.538+0000 7f2efdd9b700 1 -- 172.21.15.81:0/2896685607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f08157ca0 msgr2=0x7f2f0814a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:05.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.538+0000 7f2efdd9b700 1 --2- 172.21.15.81:0/2896685607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f08157ca0 0x7f2f0814a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:05.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.538+0000 7f2efdd9b700 1 -- 172.21.15.81:0/2896685607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef0009420 con 0x7f2f081578d0 2023-10-07T08:49:05.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.539+0000 7f2efdd9b700 1 --2- 172.21.15.81:0/2896685607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f081578d0 0x7f2f081535f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000ec80 tx=0x7f2ef00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:05.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.539+0000 7f2efeffd700 1 -- 172.21.15.81:0/2896685607 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000c850 con 0x7f2f081578d0 2023-10-07T08:49:05.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.539+0000 7f2efeffd700 1 -- 172.21.15.81:0/2896685607 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef000c9b0 con 0x7f2f081578d0 2023-10-07T08:49:05.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.539+0000 7f2f0cfad700 1 -- 172.21.15.81:0/2896685607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef8009420 con 0x7f2f081578d0 2023-10-07T08:49:05.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.539+0000 7f2efeffd700 1 -- 172.21.15.81:0/2896685607 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000cd30 con 0x7f2f081578d0 2023-10-07T08:49:05.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.539+0000 7f2f0cfad700 1 -- 172.21.15.81:0/2896685607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0816d730 con 0x7f2f081578d0 2023-10-07T08:49:05.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.540+0000 7f2f0cfad700 1 -- 172.21.15.81:0/2896685607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f08067ac0 con 0x7f2f081578d0 2023-10-07T08:49:05.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.540+0000 7f2efeffd700 1 -- 172.21.15.81:0/2896685607 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ef0013680 con 0x7f2f081578d0 2023-10-07T08:49:05.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.540+0000 7f2efeffd700 1 --2- 172.21.15.81:0/2896685607 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2ee8066f30 0x7f2ee80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:05.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.541+0000 7f2efeffd700 1 -- 172.21.15.81:0/2896685607 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f2ef0084610 con 0x7f2f081578d0 2023-10-07T08:49:05.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.541+0000 7f2f0659c700 1 --2- 172.21.15.81:0/2896685607 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2ee8066f30 0x7f2ee80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:05.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.541+0000 7f2f0659c700 1 --2- 172.21.15.81:0/2896685607 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2ee8066f30 0x7f2ee80693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80091e0 tx=0x7f2ef8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:05.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.545+0000 7f2efeffd700 1 -- 172.21.15.81:0/2896685607 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ef0055470 con 0x7f2f081578d0 2023-10-07T08:49:05.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:05.726+0000 7f2f0cfad700 1 -- 172.21.15.81:0/2896685607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2f0816dbe0 con 0x7f2f081578d0 2023-10-07T08:49:06.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.416+0000 7f2efeffd700 1 -- 172.21.15.81:0/2896685607 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v129) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2ef0055000 con 0x7f2f081578d0 2023-10-07T08:49:06.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.419+0000 7f2f0cfad700 1 -- 172.21.15.81:0/2896685607 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2ee8066f30 msgr2=0x7f2ee80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:06.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.419+0000 7f2f0cfad700 1 --2- 172.21.15.81:0/2896685607 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2ee8066f30 0x7f2ee80693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80091e0 tx=0x7f2ef8017000 comp rx=0 tx=0).stop 2023-10-07T08:49:06.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.419+0000 7f2f0cfad700 1 -- 172.21.15.81:0/2896685607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f081578d0 msgr2=0x7f2f081535f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:06.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.419+0000 7f2f0cfad700 1 --2- 172.21.15.81:0/2896685607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f081578d0 0x7f2f081535f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000ec80 tx=0x7f2ef00091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.419+0000 7f2f0cfad700 1 -- 172.21.15.81:0/2896685607 shutdown_connections 2023-10-07T08:49:06.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.419+0000 7f2f0cfad700 1 --2- 172.21.15.81:0/2896685607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f08157ca0 0x7f2f0814a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.419+0000 7f2f0cfad700 1 --2- 172.21.15.81:0/2896685607 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2ee8066f30 0x7f2ee80693e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.419+0000 7f2f0cfad700 1 --2- 172.21.15.81:0/2896685607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f0806d120 0x7f2f0816df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.419+0000 7f2f0cfad700 1 --2- 172.21.15.81:0/2896685607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f081578d0 0x7f2f081535f0 secure :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000ec80 tx=0x7f2ef00091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.419+0000 7f2f0cfad700 1 -- 172.21.15.81:0/2896685607 >> 172.21.15.81:0/2896685607 conn(0x7f2f0806bb90 msgr2=0x7f2f08155620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:06.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.420+0000 7f2f0cfad700 1 -- 172.21.15.81:0/2896685607 shutdown_connections 2023-10-07T08:49:06.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.420+0000 7f2f0cfad700 1 -- 172.21.15.81:0/2896685607 wait complete. 2023-10-07T08:49:06.423 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-07T08:49:06.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T08:49:06.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.555+0000 7fe75373f700 1 Processor -- start 2023-10-07T08:49:06.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.555+0000 7fe75373f700 1 -- start start 2023-10-07T08:49:06.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.555+0000 7fe75373f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe74c06d830 0x7fe74c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:06.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe75373f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74c0d07c0 con 0x7fe74c1578d0 2023-10-07T08:49:06.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe75373f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74c0cfbb0 con 0x7fe74c157ca0 2023-10-07T08:49:06.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe75373f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c0cfe90 con 0x7fe74c06d830 2023-10-07T08:49:06.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe7514db700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe74c1578d0 0x7fe74c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42804/0 (socket says 172.21.15.81:42804) 2023-10-07T08:49:06.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe7514db700 1 -- 172.21.15.81:0/1413844364 learned_addr learned my addr 172.21.15.81:0/1413844364 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:06.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe743fff700 1 -- 172.21.15.81:0/1413844364 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3977766856 0 0) 0x7fe74c0d07c0 con 0x7fe74c1578d0 2023-10-07T08:49:06.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe743fff700 1 -- 172.21.15.81:0/1413844364 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe738003570 con 0x7fe74c1578d0 2023-10-07T08:49:06.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe751cdc700 1 --2- 172.21.15.81:0/1413844364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe74c06d830 0x7fe74c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:06.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe743fff700 1 -- 172.21.15.81:0/1413844364 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2987649039 0 0) 0x7fe738003570 con 0x7fe74c1578d0 2023-10-07T08:49:06.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe743fff700 1 -- 172.21.15.81:0/1413844364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe74c06d830 msgr2=0x7fe74c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:06.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe743fff700 1 --2- 172.21.15.81:0/1413844364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe74c06d830 0x7fe74c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe743fff700 1 -- 172.21.15.81:0/1413844364 >> v1:172.21.15.89:6789/0 conn(0x7fe74c157ca0 legacy=0x7fe74c06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:06.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe743fff700 1 -- 172.21.15.81:0/1413844364 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c0d0170 con 0x7fe74c1578d0 2023-10-07T08:49:06.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe743fff700 1 -- 172.21.15.81:0/1413844364 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fe748001470 con 0x7fe74c1578d0 2023-10-07T08:49:06.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe743fff700 1 -- 172.21.15.81:0/1413844364 >> v1:172.21.15.81:6789/0 conn(0x7fe74c1578d0 legacy=0x7fe74c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:06.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe743fff700 1 --2- 172.21.15.81:0/1413844364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe74c06d830 0x7fe738003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:06.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe743fff700 1 --2- 172.21.15.81:0/1413844364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7380040c0 0x7fe738004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:06.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe743fff700 1 --2- 172.21.15.81:0/1413844364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe738004da0 0x7fe7380051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:06.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe743fff700 1 -- 172.21.15.81:0/1413844364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c0cfe90 con 0x7fe7380040c0 2023-10-07T08:49:06.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe743fff700 1 -- 172.21.15.81:0/1413844364 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73800bc70 con 0x7fe738004da0 2023-10-07T08:49:06.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe743fff700 1 -- 172.21.15.81:0/1413844364 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73800be30 con 0x7fe74c06d830 2023-10-07T08:49:06.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe750cda700 1 --2- 172.21.15.81:0/1413844364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7380040c0 0x7fe738004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:06.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe7514db700 1 --2- 172.21.15.81:0/1413844364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe74c06d830 0x7fe738003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:06.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.556+0000 7fe751cdc700 1 --2- 172.21.15.81:0/1413844364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe738004da0 0x7fe7380051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:06.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.557+0000 7fe750cda700 1 -- 172.21.15.81:0/1413844364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe74c06d830 msgr2=0x7fe738003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:06.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.557+0000 7fe750cda700 1 --2- 172.21.15.81:0/1413844364 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe74c06d830 0x7fe738003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.557+0000 7fe750cda700 1 -- 172.21.15.81:0/1413844364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe738004da0 msgr2=0x7fe7380051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:06.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.557+0000 7fe750cda700 1 --2- 172.21.15.81:0/1413844364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe738004da0 0x7fe7380051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.557+0000 7fe750cda700 1 -- 172.21.15.81:0/1413844364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe738003570 con 0x7fe7380040c0 2023-10-07T08:49:06.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.557+0000 7fe750cda700 1 --2- 172.21.15.81:0/1413844364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7380040c0 0x7fe738004810 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0018b0 tx=0x7fe73c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54bc96caffdc7aa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:06.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.557+0000 7fe743fff700 1 -- 172.21.15.81:0/1413844364 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c012420 con 0x7fe7380040c0 2023-10-07T08:49:06.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.557+0000 7fe743fff700 1 -- 172.21.15.81:0/1413844364 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c012580 con 0x7fe7380040c0 2023-10-07T08:49:06.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.557+0000 7fe743fff700 1 -- 172.21.15.81:0/1413844364 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c012920 con 0x7fe7380040c0 2023-10-07T08:49:06.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.557+0000 7fe75373f700 1 -- 172.21.15.81:0/1413844364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7380040c0 msgr2=0x7fe738004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:06.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.557+0000 7fe75373f700 1 --2- 172.21.15.81:0/1413844364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7380040c0 0x7fe738004810 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0018b0 tx=0x7fe73c007d30 comp rx=0 tx=0).stop 2023-10-07T08:49:06.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.557+0000 7fe751cdc700 1 -- 172.21.15.81:0/1413844364 reap_dead start 2023-10-07T08:49:06.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.558+0000 7fe75373f700 1 -- 172.21.15.81:0/1413844364 shutdown_connections 2023-10-07T08:49:06.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.558+0000 7fe75373f700 1 -- 172.21.15.81:0/1413844364 >> 172.21.15.81:0/1413844364 conn(0x7fe74c06bb90 msgr2=0x7fe74c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:06.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.558+0000 7fe75373f700 1 -- 172.21.15.81:0/1413844364 shutdown_connections 2023-10-07T08:49:06.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.558+0000 7fe75373f700 1 -- 172.21.15.81:0/1413844364 wait complete. 2023-10-07T08:49:06.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.559+0000 7fe75373f700 1 Processor -- start 2023-10-07T08:49:06.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.559+0000 7fe75373f700 1 -- start start 2023-10-07T08:49:06.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe75373f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7380040c0 0x7fe74c1580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:06.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe75373f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74c158630 0x7fe74c0b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:06.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe75373f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe74c0b60f0 0x7fe74c0b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:06.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe75373f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c146100 con 0x7fe74c158630 2023-10-07T08:49:06.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe75373f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c158aa0 con 0x7fe7380040c0 2023-10-07T08:49:06.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe75373f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c1454f0 con 0x7fe74c0b60f0 2023-10-07T08:49:06.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe750cda700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74c158630 0x7fe74c0b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:06.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe750cda700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74c158630 0x7fe74c0b5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39936/0 (socket says 172.21.15.81:39936) 2023-10-07T08:49:06.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe750cda700 1 -- 172.21.15.81:0/1369662110 learned_addr learned my addr 172.21.15.81:0/1369662110 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:06.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe7514db700 1 --2- 172.21.15.81:0/1369662110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7380040c0 0x7fe74c1580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:06.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe751cdc700 1 --2- 172.21.15.81:0/1369662110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe74c0b60f0 0x7fe74c0b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:06.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe750cda700 1 -- 172.21.15.81:0/1369662110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe74c0b60f0 msgr2=0x7fe74c0b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:06.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe750cda700 1 --2- 172.21.15.81:0/1369662110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe74c0b60f0 0x7fe74c0b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe750cda700 1 -- 172.21.15.81:0/1369662110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7380040c0 msgr2=0x7fe74c1580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:06.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe750cda700 1 --2- 172.21.15.81:0/1369662110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7380040c0 0x7fe74c1580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe750cda700 1 -- 172.21.15.81:0/1369662110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c1457d0 con 0x7fe74c158630 2023-10-07T08:49:06.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe750cda700 1 --2- 172.21.15.81:0/1369662110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74c158630 0x7fe74c0b5bb0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00c3f0 tx=0x7fe73c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:06.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe7417fa700 1 -- 172.21.15.81:0/1369662110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c012420 con 0x7fe74c158630 2023-10-07T08:49:06.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe7417fa700 1 -- 172.21.15.81:0/1369662110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c001230 con 0x7fe74c158630 2023-10-07T08:49:06.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe75373f700 1 -- 172.21.15.81:0/1369662110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74c145ab0 con 0x7fe74c158630 2023-10-07T08:49:06.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe7417fa700 1 -- 172.21.15.81:0/1369662110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c012ea0 con 0x7fe74c158630 2023-10-07T08:49:06.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.560+0000 7fe75373f700 1 -- 172.21.15.81:0/1369662110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74c169cc0 con 0x7fe74c158630 2023-10-07T08:49:06.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.561+0000 7fe75373f700 1 -- 172.21.15.81:0/1369662110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74c067ac0 con 0x7fe74c158630 2023-10-07T08:49:06.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.562+0000 7fe7417fa700 1 -- 172.21.15.81:0/1369662110 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe73c01f620 con 0x7fe74c158630 2023-10-07T08:49:06.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.562+0000 7fe7417fa700 1 --2- 172.21.15.81:0/1369662110 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe730066f30 0x7fe7300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:06.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.562+0000 7fe7417fa700 1 -- 172.21.15.81:0/1369662110 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe73c085a30 con 0x7fe74c158630 2023-10-07T08:49:06.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.562+0000 7fe7514db700 1 --2- 172.21.15.81:0/1369662110 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe730066f30 0x7fe7300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:06.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.562+0000 7fe7514db700 1 --2- 172.21.15.81:0/1369662110 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe730066f30 0x7fe7300693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe748001ed0 tx=0x7fe74c15b610 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:06.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.566+0000 7fe7417fa700 1 -- 172.21.15.81:0/1369662110 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe73c052fa0 con 0x7fe74c158630 2023-10-07T08:49:06.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.750+0000 7fe75373f700 1 -- 172.21.15.81:0/1369662110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe74c0d0450 con 0x7fe74c158630 2023-10-07T08:49:06.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.755+0000 7fe7417fa700 1 -- 172.21.15.81:0/1369662110 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe73c0565c0 con 0x7fe74c158630 2023-10-07T08:49:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.758+0000 7fe75373f700 1 -- 172.21.15.81:0/1369662110 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe730066f30 msgr2=0x7fe7300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.758+0000 7fe75373f700 1 --2- 172.21.15.81:0/1369662110 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe730066f30 0x7fe7300693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe748001ed0 tx=0x7fe74c15b610 comp rx=0 tx=0).stop 2023-10-07T08:49:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.758+0000 7fe75373f700 1 -- 172.21.15.81:0/1369662110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74c158630 msgr2=0x7fe74c0b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.758+0000 7fe75373f700 1 --2- 172.21.15.81:0/1369662110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74c158630 0x7fe74c0b5bb0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00c3f0 tx=0x7fe73c015000 comp rx=0 tx=0).stop 2023-10-07T08:49:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.758+0000 7fe75373f700 1 -- 172.21.15.81:0/1369662110 shutdown_connections 2023-10-07T08:49:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.758+0000 7fe75373f700 1 --2- 172.21.15.81:0/1369662110 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe730066f30 0x7fe7300693e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.758+0000 7fe75373f700 1 --2- 172.21.15.81:0/1369662110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe74c0b60f0 0x7fe74c0b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.758+0000 7fe75373f700 1 --2- 172.21.15.81:0/1369662110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7380040c0 0x7fe74c1580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.758+0000 7fe75373f700 1 --2- 172.21.15.81:0/1369662110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74c158630 0x7fe74c0b5bb0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.758+0000 7fe75373f700 1 -- 172.21.15.81:0/1369662110 >> 172.21.15.81:0/1369662110 conn(0x7fe74c06bb90 msgr2=0x7fe74c15a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.758+0000 7fe75373f700 1 -- 172.21.15.81:0/1369662110 shutdown_connections 2023-10-07T08:49:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.758+0000 7fe75373f700 1 -- 172.21.15.81:0/1369662110 wait complete. 2023-10-07T08:49:06.771 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-10-07T08:49:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.883+0000 7f86b6ee5700 1 Processor -- start 2023-10-07T08:49:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.883+0000 7f86b6ee5700 1 -- start start 2023-10-07T08:49:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86b6ee5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86b0157ca0 0x7f86b00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86b6ee5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b00d07c0 con 0x7f86b01578d0 2023-10-07T08:49:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86b6ee5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b00cfbb0 con 0x7f86b006d120 2023-10-07T08:49:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86b6ee5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00cfe90 con 0x7f86b0157ca0 2023-10-07T08:49:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86b4c81700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f86b01578d0 0x7f86b015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42808/0 (socket says 172.21.15.81:42808) 2023-10-07T08:49:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86b4c81700 1 -- 172.21.15.81:0/1358895518 learned_addr learned my addr 172.21.15.81:0/1358895518 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86af7fe700 1 -- 172.21.15.81:0/1358895518 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116278433 0 0) 0x7f86b00d07c0 con 0x7f86b01578d0 2023-10-07T08:49:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86af7fe700 1 -- 172.21.15.81:0/1358895518 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86a0003570 con 0x7f86b01578d0 2023-10-07T08:49:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86affff700 1 --2- 172.21.15.81:0/1358895518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86b0157ca0 0x7f86b00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86af7fe700 1 -- 172.21.15.81:0/1358895518 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 707645916 0 0) 0x7f86a0003570 con 0x7f86b01578d0 2023-10-07T08:49:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86af7fe700 1 -- 172.21.15.81:0/1358895518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86b0157ca0 msgr2=0x7f86b00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86af7fe700 1 --2- 172.21.15.81:0/1358895518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86b0157ca0 0x7f86b00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86af7fe700 1 -- 172.21.15.81:0/1358895518 >> v1:172.21.15.89:6789/0 conn(0x7f86b006d120 legacy=0x7f86b015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86af7fe700 1 -- 172.21.15.81:0/1358895518 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b00d0170 con 0x7f86b01578d0 2023-10-07T08:49:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86af7fe700 1 -- 172.21.15.81:0/1358895518 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f86a4001470 con 0x7f86b01578d0 2023-10-07T08:49:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86af7fe700 1 -- 172.21.15.81:0/1358895518 >> v1:172.21.15.81:6789/0 conn(0x7f86b01578d0 legacy=0x7f86b015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86af7fe700 1 --2- 172.21.15.81:0/1358895518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86a0003a90 0x7f86a0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86af7fe700 1 --2- 172.21.15.81:0/1358895518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a0004810 0x7f86a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:06.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86af7fe700 1 --2- 172.21.15.81:0/1358895518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86b0157ca0 0x7f86a00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:06.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86af7fe700 1 -- 172.21.15.81:0/1358895518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00cfe90 con 0x7f86a0004810 2023-10-07T08:49:06.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86af7fe700 1 -- 172.21.15.81:0/1358895518 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a000bb60 con 0x7f86a0003a90 2023-10-07T08:49:06.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.884+0000 7f86af7fe700 1 -- 172.21.15.81:0/1358895518 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a000bd20 con 0x7f86b0157ca0 2023-10-07T08:49:06.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.885+0000 7f86affff700 1 --2- 172.21.15.81:0/1358895518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a0004810 0x7f86a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:06.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.885+0000 7f86b4c81700 1 --2- 172.21.15.81:0/1358895518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86a0003a90 0x7f86a0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:06.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.885+0000 7f86b5482700 1 --2- 172.21.15.81:0/1358895518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86b0157ca0 0x7f86a00051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:06.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.885+0000 7f86affff700 1 -- 172.21.15.81:0/1358895518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86b0157ca0 msgr2=0x7f86a00051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:06.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.885+0000 7f86affff700 1 --2- 172.21.15.81:0/1358895518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86b0157ca0 0x7f86a00051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.885+0000 7f86affff700 1 -- 172.21.15.81:0/1358895518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86a0003a90 msgr2=0x7f86a0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:06.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.885+0000 7f86affff700 1 --2- 172.21.15.81:0/1358895518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86a0003a90 0x7f86a0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.885+0000 7f86affff700 1 -- 172.21.15.81:0/1358895518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a0003570 con 0x7f86a0004810 2023-10-07T08:49:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.885+0000 7f86affff700 1 --2- 172.21.15.81:0/1358895518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a0004810 0x7f86a0004c80 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f869c009c00 tx=0x7f869c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38f2f888cb94beb server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.885+0000 7f86af7fe700 1 -- 172.21.15.81:0/1358895518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c00e710 con 0x7f86a0004810 2023-10-07T08:49:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.885+0000 7f86af7fe700 1 -- 172.21.15.81:0/1358895518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c00e870 con 0x7f86a0004810 2023-10-07T08:49:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.885+0000 7f86af7fe700 1 -- 172.21.15.81:0/1358895518 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c00ec30 con 0x7f86a0004810 2023-10-07T08:49:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.886+0000 7f86b6ee5700 1 -- 172.21.15.81:0/1358895518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a0004810 msgr2=0x7f86a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.886+0000 7f86b6ee5700 1 --2- 172.21.15.81:0/1358895518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a0004810 0x7f86a0004c80 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f869c009c00 tx=0x7f869c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.886+0000 7f86b5482700 1 -- 172.21.15.81:0/1358895518 reap_dead start 2023-10-07T08:49:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.886+0000 7f86b6ee5700 1 -- 172.21.15.81:0/1358895518 shutdown_connections 2023-10-07T08:49:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.886+0000 7f86b6ee5700 1 -- 172.21.15.81:0/1358895518 >> 172.21.15.81:0/1358895518 conn(0x7f86b006bb90 msgr2=0x7f86b006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.886+0000 7f86b6ee5700 1 -- 172.21.15.81:0/1358895518 shutdown_connections 2023-10-07T08:49:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.886+0000 7f86b6ee5700 1 -- 172.21.15.81:0/1358895518 wait complete. 2023-10-07T08:49:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.887+0000 7f86b6ee5700 1 Processor -- start 2023-10-07T08:49:06.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.887+0000 7f86b6ee5700 1 -- start start 2023-10-07T08:49:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86b6ee5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86a0004810 0x7f86b00b6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86b6ee5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b00b65a0 0x7f86b016a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86b6ee5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86b016ac80 0x7f86b016b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86b6ee5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b016b660 con 0x7f86b00b65a0 2023-10-07T08:49:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86b6ee5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00b4650 con 0x7f86b016ac80 2023-10-07T08:49:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86b6ee5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00b4930 con 0x7f86a0004810 2023-10-07T08:49:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b00b65a0 0x7f86b016a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b00b65a0 0x7f86b016a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39958/0 (socket says 172.21.15.81:39958) 2023-10-07T08:49:06.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86affff700 1 -- 172.21.15.81:0/1846911634 learned_addr learned my addr 172.21.15.81:0/1846911634 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:06.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86b4c81700 1 --2- 172.21.15.81:0/1846911634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86a0004810 0x7f86b00b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:06.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86b5482700 1 --2- 172.21.15.81:0/1846911634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86b016ac80 0x7f86b016b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:06.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86affff700 1 -- 172.21.15.81:0/1846911634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86a0004810 msgr2=0x7f86b00b6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:06.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86affff700 1 --2- 172.21.15.81:0/1846911634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86a0004810 0x7f86b00b6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86affff700 1 -- 172.21.15.81:0/1846911634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86b016ac80 msgr2=0x7f86b016b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:06.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86affff700 1 --2- 172.21.15.81:0/1846911634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86b016ac80 0x7f86b016b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:06.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86affff700 1 -- 172.21.15.81:0/1846911634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b00b4c10 con 0x7f86b00b65a0 2023-10-07T08:49:06.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86b5482700 1 --2- 172.21.15.81:0/1846911634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86b016ac80 0x7f86b016b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:06.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86affff700 1 --2- 172.21.15.81:0/1846911634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b00b65a0 0x7f86b016a740 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f86a000bb30 tx=0x7f869c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:06.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86acff9700 1 -- 172.21.15.81:0/1846911634 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c022070 con 0x7f86b00b65a0 2023-10-07T08:49:06.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86acff9700 1 -- 172.21.15.81:0/1846911634 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c00e9e0 con 0x7f86b00b65a0 2023-10-07T08:49:06.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86b6ee5700 1 -- 172.21.15.81:0/1846911634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b00b4ef0 con 0x7f86b00b65a0 2023-10-07T08:49:06.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86acff9700 1 -- 172.21.15.81:0/1846911634 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c01c450 con 0x7f86b00b65a0 2023-10-07T08:49:06.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.888+0000 7f86b6ee5700 1 -- 172.21.15.81:0/1846911634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b014aea0 con 0x7f86b00b65a0 2023-10-07T08:49:06.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.889+0000 7f86b6ee5700 1 -- 172.21.15.81:0/1846911634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b0067ac0 con 0x7f86b00b65a0 2023-10-07T08:49:06.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.890+0000 7f86acff9700 1 -- 172.21.15.81:0/1846911634 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f869c01c860 con 0x7f86b00b65a0 2023-10-07T08:49:06.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.890+0000 7f86acff9700 1 --2- 172.21.15.81:0/1846911634 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8694066f30 0x7f86940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:06.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.890+0000 7f86acff9700 1 -- 172.21.15.81:0/1846911634 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f869c085a30 con 0x7f86b00b65a0 2023-10-07T08:49:06.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.890+0000 7f86b4c81700 1 --2- 172.21.15.81:0/1846911634 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8694066f30 0x7f86940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:06.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.890+0000 7f86b4c81700 1 --2- 172.21.15.81:0/1846911634 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8694066f30 0x7f86940693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f86a40015a0 tx=0x7f86b015b610 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:06.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:06.894+0000 7f86acff9700 1 -- 172.21.15.81:0/1846911634 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f869c052fa0 con 0x7f86b00b65a0 2023-10-07T08:49:07.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.149+0000 7f86b6ee5700 1 -- 172.21.15.81:0/1846911634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f86b014d5d0 con 0x7f86b00b65a0 2023-10-07T08:49:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.410+0000 7f86acff9700 1 -- 172.21.15.81:0/1846911634 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v320) v1 ==== 128+0+0 (secure 0 0 0) 0x7f869c02b0c0 con 0x7f86b00b65a0 2023-10-07T08:49:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.412+0000 7f86b6ee5700 1 -- 172.21.15.81:0/1846911634 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8694066f30 msgr2=0x7f86940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.412+0000 7f86b6ee5700 1 --2- 172.21.15.81:0/1846911634 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8694066f30 0x7f86940693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f86a40015a0 tx=0x7f86b015b610 comp rx=0 tx=0).stop 2023-10-07T08:49:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.412+0000 7f86b6ee5700 1 -- 172.21.15.81:0/1846911634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b00b65a0 msgr2=0x7f86b016a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.412+0000 7f86b6ee5700 1 --2- 172.21.15.81:0/1846911634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b00b65a0 0x7f86b016a740 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f86a000bb30 tx=0x7f869c01a000 comp rx=0 tx=0).stop 2023-10-07T08:49:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.412+0000 7f86b6ee5700 1 -- 172.21.15.81:0/1846911634 shutdown_connections 2023-10-07T08:49:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.412+0000 7f86b6ee5700 1 --2- 172.21.15.81:0/1846911634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86b016ac80 0x7f86b016b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.412+0000 7f86b6ee5700 1 --2- 172.21.15.81:0/1846911634 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8694066f30 0x7f86940693e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:07.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.412+0000 7f86b6ee5700 1 --2- 172.21.15.81:0/1846911634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86a0004810 0x7f86b00b6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:07.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.412+0000 7f86b6ee5700 1 --2- 172.21.15.81:0/1846911634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b00b65a0 0x7f86b016a740 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:07.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.412+0000 7f86b6ee5700 1 -- 172.21.15.81:0/1846911634 >> 172.21.15.81:0/1846911634 conn(0x7f86b006bb90 msgr2=0x7f86b00690c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:07.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.413+0000 7f86b6ee5700 1 -- 172.21.15.81:0/1846911634 shutdown_connections 2023-10-07T08:49:07.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.413+0000 7f86b6ee5700 1 -- 172.21.15.81:0/1846911634 wait complete. 2023-10-07T08:49:07.426 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-10-07T08:49:07.426 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-10-07T08:49:07.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-10-07T08:49:07.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.538+0000 7fe94c7ee700 1 Processor -- start 2023-10-07T08:49:07.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.538+0000 7fe94c7ee700 1 -- start start 2023-10-07T08:49:07.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.539+0000 7fe94c7ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe94406d830 0x7fe9440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:07.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.539+0000 7fe94c7ee700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9440d07c0 con 0x7fe944157ca0 2023-10-07T08:49:07.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.539+0000 7fe94c7ee700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9440cfbb0 con 0x7fe9441578d0 2023-10-07T08:49:07.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.539+0000 7fe94c7ee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440cfe90 con 0x7fe94406d830 2023-10-07T08:49:07.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.539+0000 7fe949d89700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe944157ca0 0x7fe94406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42816/0 (socket says 172.21.15.81:42816) 2023-10-07T08:49:07.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.539+0000 7fe949d89700 1 -- 172.21.15.81:0/3365113158 learned_addr learned my addr 172.21.15.81:0/3365113158 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:07.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949588700 1 -- 172.21.15.81:0/3365113158 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685362650 0 0) 0x7fe9440d07c0 con 0x7fe944157ca0 2023-10-07T08:49:07.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949588700 1 -- 172.21.15.81:0/3365113158 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe930003570 con 0x7fe944157ca0 2023-10-07T08:49:07.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe94ad8b700 1 --2- 172.21.15.81:0/3365113158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe94406d830 0x7fe9440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:07.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949588700 1 -- 172.21.15.81:0/3365113158 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3112013594 0 0) 0x7fe930003570 con 0x7fe944157ca0 2023-10-07T08:49:07.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949588700 1 -- 172.21.15.81:0/3365113158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe94406d830 msgr2=0x7fe9440cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:07.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949588700 1 --2- 172.21.15.81:0/3365113158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe94406d830 0x7fe9440cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:07.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949588700 1 -- 172.21.15.81:0/3365113158 >> v1:172.21.15.89:6789/0 conn(0x7fe9441578d0 legacy=0x7fe94415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:07.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949588700 1 -- 172.21.15.81:0/3365113158 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9440d0170 con 0x7fe944157ca0 2023-10-07T08:49:07.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949588700 1 -- 172.21.15.81:0/3365113158 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fe934001470 con 0x7fe944157ca0 2023-10-07T08:49:07.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949588700 1 -- 172.21.15.81:0/3365113158 >> v1:172.21.15.81:6789/0 conn(0x7fe944157ca0 legacy=0x7fe94406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:07.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949588700 1 --2- 172.21.15.81:0/3365113158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe94406d830 0x7fe930003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:07.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949588700 1 --2- 172.21.15.81:0/3365113158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe930004010 0x7fe930004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:07.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949588700 1 --2- 172.21.15.81:0/3365113158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe930004d50 0x7fe9300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:07.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949588700 1 -- 172.21.15.81:0/3365113158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440cfe90 con 0x7fe930004010 2023-10-07T08:49:07.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949588700 1 -- 172.21.15.81:0/3365113158 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93000bbf0 con 0x7fe930004d50 2023-10-07T08:49:07.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949588700 1 -- 172.21.15.81:0/3365113158 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93000bdb0 con 0x7fe94406d830 2023-10-07T08:49:07.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949d89700 1 --2- 172.21.15.81:0/3365113158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe930004010 0x7fe930004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:07.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe94a58a700 1 --2- 172.21.15.81:0/3365113158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe94406d830 0x7fe930003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:07.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe94ad8b700 1 --2- 172.21.15.81:0/3365113158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe930004d50 0x7fe9300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:07.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949d89700 1 -- 172.21.15.81:0/3365113158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe94406d830 msgr2=0x7fe930003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:07.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949d89700 1 --2- 172.21.15.81:0/3365113158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe94406d830 0x7fe930003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:07.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949d89700 1 -- 172.21.15.81:0/3365113158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe930004d50 msgr2=0x7fe9300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:07.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949d89700 1 --2- 172.21.15.81:0/3365113158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe930004d50 0x7fe9300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:07.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949d89700 1 -- 172.21.15.81:0/3365113158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe930003570 con 0x7fe930004010 2023-10-07T08:49:07.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe94ad8b700 1 --2- 172.21.15.81:0/3365113158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe930004d50 0x7fe9300051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:07.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.540+0000 7fe949d89700 1 --2- 172.21.15.81:0/3365113158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe930004010 0x7fe930004810 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe934001ed0 tx=0x7fe94415b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0017be64302699 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:07.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.541+0000 7fe949588700 1 -- 172.21.15.81:0/3365113158 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93400cc00 con 0x7fe930004010 2023-10-07T08:49:07.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.541+0000 7fe949588700 1 -- 172.21.15.81:0/3365113158 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93400cd60 con 0x7fe930004010 2023-10-07T08:49:07.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.541+0000 7fe949588700 1 -- 172.21.15.81:0/3365113158 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934005b70 con 0x7fe930004010 2023-10-07T08:49:07.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.541+0000 7fe94c7ee700 1 -- 172.21.15.81:0/3365113158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe930004010 msgr2=0x7fe930004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:07.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.541+0000 7fe94c7ee700 1 --2- 172.21.15.81:0/3365113158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe930004010 0x7fe930004810 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe934001ed0 tx=0x7fe94415b610 comp rx=0 tx=0).stop 2023-10-07T08:49:07.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.541+0000 7fe94ad8b700 1 -- 172.21.15.81:0/3365113158 reap_dead start 2023-10-07T08:49:07.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.541+0000 7fe94c7ee700 1 -- 172.21.15.81:0/3365113158 shutdown_connections 2023-10-07T08:49:07.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.541+0000 7fe94c7ee700 1 -- 172.21.15.81:0/3365113158 >> 172.21.15.81:0/3365113158 conn(0x7fe94406bb90 msgr2=0x7fe94406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:07.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.541+0000 7fe94c7ee700 1 -- 172.21.15.81:0/3365113158 shutdown_connections 2023-10-07T08:49:07.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.541+0000 7fe94c7ee700 1 -- 172.21.15.81:0/3365113158 wait complete. 2023-10-07T08:49:07.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.542+0000 7fe94c7ee700 1 Processor -- start 2023-10-07T08:49:07.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.542+0000 7fe94c7ee700 1 -- start start 2023-10-07T08:49:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.543+0000 7fe94c7ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe930004010 0x7fe94416d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.543+0000 7fe94c7ee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe94416a320 0x7fe9440c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.543+0000 7fe94c7ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9440c7f70 0x7fe9440c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.543+0000 7fe94c7ee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440b44d0 con 0x7fe9440c7f70 2023-10-07T08:49:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.543+0000 7fe94c7ee700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94416a790 con 0x7fe94416a320 2023-10-07T08:49:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.543+0000 7fe94c7ee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440c84d0 con 0x7fe930004010 2023-10-07T08:49:07.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.543+0000 7fe94ad8b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9440c7f70 0x7fe9440c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:07.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.543+0000 7fe94ad8b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9440c7f70 0x7fe9440c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39972/0 (socket says 172.21.15.81:39972) 2023-10-07T08:49:07.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.543+0000 7fe94ad8b700 1 -- 172.21.15.81:0/1469090347 learned_addr learned my addr 172.21.15.81:0/1469090347 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:07.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.543+0000 7fe949d89700 1 --2- 172.21.15.81:0/1469090347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe94416a320 0x7fe9440c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:07.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.543+0000 7fe94a58a700 1 --2- 172.21.15.81:0/1469090347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe930004010 0x7fe94416d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:07.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.543+0000 7fe94ad8b700 1 -- 172.21.15.81:0/1469090347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe930004010 msgr2=0x7fe94416d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:07.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.543+0000 7fe94ad8b700 1 --2- 172.21.15.81:0/1469090347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe930004010 0x7fe94416d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:07.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.543+0000 7fe94ad8b700 1 -- 172.21.15.81:0/1469090347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe94416a320 msgr2=0x7fe9440c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:07.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.543+0000 7fe94ad8b700 1 --2- 172.21.15.81:0/1469090347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe94416a320 0x7fe9440c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.543+0000 7fe94ad8b700 1 -- 172.21.15.81:0/1469090347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9440b3ba0 con 0x7fe9440c7f70 2023-10-07T08:49:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.544+0000 7fe94ad8b700 1 --2- 172.21.15.81:0/1469090347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9440c7f70 0x7fe9440c5b20 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe94406dc30 tx=0x7fe93c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.544+0000 7fe93a7fc700 1 -- 172.21.15.81:0/1469090347 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c00e030 con 0x7fe9440c7f70 2023-10-07T08:49:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.544+0000 7fe93a7fc700 1 -- 172.21.15.81:0/1469090347 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c011b80 con 0x7fe9440c7f70 2023-10-07T08:49:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.544+0000 7fe94c7ee700 1 -- 172.21.15.81:0/1469090347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9440b3e80 con 0x7fe9440c7f70 2023-10-07T08:49:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.544+0000 7fe93a7fc700 1 -- 172.21.15.81:0/1469090347 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c016470 con 0x7fe9440c7f70 2023-10-07T08:49:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.544+0000 7fe94c7ee700 1 -- 172.21.15.81:0/1469090347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9440b63f0 con 0x7fe9440c7f70 2023-10-07T08:49:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.545+0000 7fe94c7ee700 1 -- 172.21.15.81:0/1469090347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe944067ac0 con 0x7fe9440c7f70 2023-10-07T08:49:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.545+0000 7fe93a7fc700 1 -- 172.21.15.81:0/1469090347 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe93c016860 con 0x7fe9440c7f70 2023-10-07T08:49:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.545+0000 7fe93a7fc700 1 --2- 172.21.15.81:0/1469090347 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe928066f30 0x7fe9280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.546+0000 7fe93a7fc700 1 -- 172.21.15.81:0/1469090347 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe93c00f070 con 0x7fe9440c7f70 2023-10-07T08:49:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.546+0000 7fe94a58a700 1 --2- 172.21.15.81:0/1469090347 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe928066f30 0x7fe9280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.546+0000 7fe94a58a700 1 --2- 172.21.15.81:0/1469090347 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe928066f30 0x7fe9280693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe940003c30 tx=0x7fe940007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.550+0000 7fe93a7fc700 1 -- 172.21.15.81:0/1469090347 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe93c052040 con 0x7fe9440c7f70 2023-10-07T08:49:07.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:07.803+0000 7fe94c7ee700 1 -- 172.21.15.81:0/1469090347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7fe9440d0450 con 0x7fe9440c7f70 2023-10-07T08:49:08.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.419+0000 7fe93a7fc700 1 -- 172.21.15.81:0/1469090347 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v321) v1 ==== 143+0+0 (secure 0 0 0) 0x7fe93c055660 con 0x7fe9440c7f70 2023-10-07T08:49:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.421+0000 7fe94c7ee700 1 -- 172.21.15.81:0/1469090347 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe928066f30 msgr2=0x7fe9280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.421+0000 7fe94c7ee700 1 --2- 172.21.15.81:0/1469090347 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe928066f30 0x7fe9280693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe940003c30 tx=0x7fe940007d30 comp rx=0 tx=0).stop 2023-10-07T08:49:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.421+0000 7fe94c7ee700 1 -- 172.21.15.81:0/1469090347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9440c7f70 msgr2=0x7fe9440c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.421+0000 7fe94c7ee700 1 --2- 172.21.15.81:0/1469090347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9440c7f70 0x7fe9440c5b20 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe94406dc30 tx=0x7fe93c00b040 comp rx=0 tx=0).stop 2023-10-07T08:49:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.421+0000 7fe94c7ee700 1 -- 172.21.15.81:0/1469090347 shutdown_connections 2023-10-07T08:49:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.421+0000 7fe94c7ee700 1 --2- 172.21.15.81:0/1469090347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9440c7f70 0x7fe9440c5b20 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.421+0000 7fe94c7ee700 1 --2- 172.21.15.81:0/1469090347 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe928066f30 0x7fe9280693e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.421+0000 7fe94c7ee700 1 --2- 172.21.15.81:0/1469090347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe930004010 0x7fe94416d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.421+0000 7fe94c7ee700 1 --2- 172.21.15.81:0/1469090347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe94416a320 0x7fe9440c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.421+0000 7fe94c7ee700 1 -- 172.21.15.81:0/1469090347 >> 172.21.15.81:0/1469090347 conn(0x7fe94406bb90 msgr2=0x7fe9441568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:08.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.421+0000 7fe94c7ee700 1 -- 172.21.15.81:0/1469090347 shutdown_connections 2023-10-07T08:49:08.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.421+0000 7fe94c7ee700 1 -- 172.21.15.81:0/1469090347 wait complete. 2023-10-07T08:49:08.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T08:49:08.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.552+0000 7fa32d528700 1 Processor -- start 2023-10-07T08:49:08.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.553+0000 7fa32d528700 1 -- start start 2023-10-07T08:49:08.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.553+0000 7fa32d528700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa328156420 0x7fa3280cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:08.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.553+0000 7fa32d528700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa3280cc250 0x7fa328069440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:08.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.553+0000 7fa32d528700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa328069980 0x7fa3280c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:08.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.553+0000 7fa32d528700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32806aa10 con 0x7fa328156420 2023-10-07T08:49:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.553+0000 7fa32d528700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3280cb880 con 0x7fa3280cc250 2023-10-07T08:49:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.553+0000 7fa32d528700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280cac70 con 0x7fa328069980 2023-10-07T08:49:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.553+0000 7fa326ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa328156420 0x7fa3280cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.553+0000 7fa326ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa328156420 0x7fa3280cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39982/0 (socket says 172.21.15.81:39982) 2023-10-07T08:49:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.553+0000 7fa326ffd700 1 -- 172.21.15.81:0/621595772 learned_addr learned my addr 172.21.15.81:0/621595772 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.554+0000 7fa3277fe700 1 --2- 172.21.15.81:0/621595772 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa328069980 0x7fa3280c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.554+0000 7fa31e7fc700 1 --2- 172.21.15.81:0/621595772 >> v2:172.21.15.89:3300/0 conn(0x7fa3280cc250 0x7fa328069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.554+0000 7fa326ffd700 1 -- 172.21.15.81:0/621595772 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa328069980 msgr2=0x7fa3280c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.554+0000 7fa326ffd700 1 --2- 172.21.15.81:0/621595772 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa328069980 0x7fa3280c71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.554+0000 7fa326ffd700 1 -- 172.21.15.81:0/621595772 >> v2:172.21.15.89:3300/0 conn(0x7fa3280cc250 msgr2=0x7fa328069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.554+0000 7fa326ffd700 1 --2- 172.21.15.81:0/621595772 >> v2:172.21.15.89:3300/0 conn(0x7fa3280cc250 0x7fa328069440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.554+0000 7fa326ffd700 1 -- 172.21.15.81:0/621595772 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3280caf50 con 0x7fa328156420 2023-10-07T08:49:08.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.554+0000 7fa326ffd700 1 --2- 172.21.15.81:0/621595772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa328156420 0x7fa3280cbd10 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fa328159f00 tx=0x7fa318009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f45f92558b99daa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:08.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.554+0000 7fa3267fc700 1 -- 172.21.15.81:0/621595772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800b860 con 0x7fa328156420 2023-10-07T08:49:08.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.554+0000 7fa3267fc700 1 -- 172.21.15.81:0/621595772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31800b9c0 con 0x7fa328156420 2023-10-07T08:49:08.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.554+0000 7fa3267fc700 1 -- 172.21.15.81:0/621595772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800bd60 con 0x7fa328156420 2023-10-07T08:49:08.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.555+0000 7fa32d528700 1 -- 172.21.15.81:0/621595772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa328156420 msgr2=0x7fa3280cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:08.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.555+0000 7fa32d528700 1 --2- 172.21.15.81:0/621595772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa328156420 0x7fa3280cbd10 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fa328159f00 tx=0x7fa318009250 comp rx=0 tx=0).stop 2023-10-07T08:49:08.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.555+0000 7fa32d528700 1 -- 172.21.15.81:0/621595772 shutdown_connections 2023-10-07T08:49:08.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.555+0000 7fa32d528700 1 --2- 172.21.15.81:0/621595772 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa328069980 0x7fa3280c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.555+0000 7fa32d528700 1 --2- 172.21.15.81:0/621595772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa328156420 0x7fa3280cbd10 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.555+0000 7fa32d528700 1 --2- 172.21.15.81:0/621595772 >> v2:172.21.15.89:3300/0 conn(0x7fa3280cc250 0x7fa328069440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.555+0000 7fa32d528700 1 -- 172.21.15.81:0/621595772 >> 172.21.15.81:0/621595772 conn(0x7fa32806c660 msgr2=0x7fa3280cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:08.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.555+0000 7fa32d528700 1 -- 172.21.15.81:0/621595772 shutdown_connections 2023-10-07T08:49:08.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.555+0000 7fa32d528700 1 -- 172.21.15.81:0/621595772 wait complete. 2023-10-07T08:49:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.556+0000 7fa32d528700 1 Processor -- start 2023-10-07T08:49:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.556+0000 7fa32d528700 1 -- start start 2023-10-07T08:49:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa32d528700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa328069980 0x7fa328148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa32d528700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3280cc250 0x7fa3281586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa32d528700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa328156420 0x7fa328137000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa32d528700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3281490e0 con 0x7fa3280cc250 2023-10-07T08:49:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa32d528700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3281599f0 con 0x7fa328156420 2023-10-07T08:49:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa32d528700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa328149310 con 0x7fa328069980 2023-10-07T08:49:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa31e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3280cc250 0x7fa3281586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa31e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3280cc250 0x7fa3281586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39986/0 (socket says 172.21.15.81:39986) 2023-10-07T08:49:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa31e7fc700 1 -- 172.21.15.81:0/93412284 learned_addr learned my addr 172.21.15.81:0/93412284 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa326ffd700 1 --2- 172.21.15.81:0/93412284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa328069980 0x7fa328148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa3277fe700 1 --2- 172.21.15.81:0/93412284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa328156420 0x7fa328137000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa31e7fc700 1 -- 172.21.15.81:0/93412284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa328069980 msgr2=0x7fa328148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa31e7fc700 1 --2- 172.21.15.81:0/93412284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa328069980 0x7fa328148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa31e7fc700 1 -- 172.21.15.81:0/93412284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa328156420 msgr2=0x7fa328137000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa31e7fc700 1 --2- 172.21.15.81:0/93412284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa328156420 0x7fa328137000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa31e7fc700 1 -- 172.21.15.81:0/93412284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180094f0 con 0x7fa3280cc250 2023-10-07T08:49:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa326ffd700 1 --2- 172.21.15.81:0/93412284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa328069980 0x7fa328148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa3277fe700 1 --2- 172.21.15.81:0/93412284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa328156420 0x7fa328137000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa31e7fc700 1 --2- 172.21.15.81:0/93412284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3280cc250 0x7fa3281586a0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c7d0 tx=0x7fa310008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa31f7fe700 1 -- 172.21.15.81:0/93412284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310011600 con 0x7fa3280cc250 2023-10-07T08:49:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa31f7fe700 1 -- 172.21.15.81:0/93412284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa310011760 con 0x7fa3280cc250 2023-10-07T08:49:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa32d528700 1 -- 172.21.15.81:0/93412284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3281590c0 con 0x7fa3280cc250 2023-10-07T08:49:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa31f7fe700 1 -- 172.21.15.81:0/93412284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310011b20 con 0x7fa3280cc250 2023-10-07T08:49:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.557+0000 7fa32d528700 1 -- 172.21.15.81:0/93412284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa328159680 con 0x7fa3280cc250 2023-10-07T08:49:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.558+0000 7fa32d528700 1 -- 172.21.15.81:0/93412284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa328159ba0 con 0x7fa3280cc250 2023-10-07T08:49:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.559+0000 7fa31f7fe700 1 -- 172.21.15.81:0/93412284 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3100193f0 con 0x7fa3280cc250 2023-10-07T08:49:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.559+0000 7fa31f7fe700 1 --2- 172.21.15.81:0/93412284 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa308066f30 0x7fa3080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.559+0000 7fa31f7fe700 1 -- 172.21.15.81:0/93412284 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa310084640 con 0x7fa3280cc250 2023-10-07T08:49:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.559+0000 7fa326ffd700 1 --2- 172.21.15.81:0/93412284 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa308066f30 0x7fa3080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.559+0000 7fa326ffd700 1 --2- 172.21.15.81:0/93412284 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa308066f30 0x7fa3080693e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa328159f00 tx=0x7fa318017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.563+0000 7fa31f7fe700 1 -- 172.21.15.81:0/93412284 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa328159ba0 con 0x7fa3280cc250 2023-10-07T08:49:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.743+0000 7fa32d528700 1 -- 172.21.15.81:0/93412284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa328159b60 con 0x7fa3280cc250 2023-10-07T08:49:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.747+0000 7fa31f7fe700 1 -- 172.21.15.81:0/93412284 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa310051bb0 con 0x7fa3280cc250 2023-10-07T08:49:08.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.749+0000 7fa32d528700 1 -- 172.21.15.81:0/93412284 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa308066f30 msgr2=0x7fa3080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:08.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.749+0000 7fa32d528700 1 --2- 172.21.15.81:0/93412284 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa308066f30 0x7fa3080693e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa328159f00 tx=0x7fa318017000 comp rx=0 tx=0).stop 2023-10-07T08:49:08.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.749+0000 7fa32d528700 1 -- 172.21.15.81:0/93412284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3280cc250 msgr2=0x7fa3281586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:08.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.749+0000 7fa32d528700 1 --2- 172.21.15.81:0/93412284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3280cc250 0x7fa3281586a0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c7d0 tx=0x7fa310008040 comp rx=0 tx=0).stop 2023-10-07T08:49:08.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.749+0000 7fa32d528700 1 -- 172.21.15.81:0/93412284 shutdown_connections 2023-10-07T08:49:08.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.749+0000 7fa32d528700 1 --2- 172.21.15.81:0/93412284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa328156420 0x7fa328137000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.749+0000 7fa32d528700 1 --2- 172.21.15.81:0/93412284 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa308066f30 0x7fa3080693e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.749+0000 7fa32d528700 1 --2- 172.21.15.81:0/93412284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa328069980 0x7fa328148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.749+0000 7fa32d528700 1 --2- 172.21.15.81:0/93412284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3280cc250 0x7fa3281586a0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.749+0000 7fa32d528700 1 -- 172.21.15.81:0/93412284 >> 172.21.15.81:0/93412284 conn(0x7fa32806c660 msgr2=0x7fa3280c9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:08.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.750+0000 7fa32d528700 1 -- 172.21.15.81:0/93412284 shutdown_connections 2023-10-07T08:49:08.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.750+0000 7fa32d528700 1 -- 172.21.15.81:0/93412284 wait complete. 2023-10-07T08:49:08.763 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:49:08.763 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:49:08.809 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:49:08.850 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:49:08.850 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T08:49:08.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:49:08.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.963+0000 7f8956520700 1 Processor -- start 2023-10-07T08:49:08.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.963+0000 7f8956520700 1 -- start start 2023-10-07T08:49:08.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.964+0000 7f8956520700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89500b3bd0 0x7f89500ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:08.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.964+0000 7f8956520700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89500b2890 con 0x7f8950157fe0 2023-10-07T08:49:08.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.964+0000 7f8956520700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89500b4070 con 0x7f89501583b0 2023-10-07T08:49:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.964+0000 7f8956520700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89500b4350 con 0x7f89500b3bd0 2023-10-07T08:49:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.964+0000 7f894ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8950157fe0 0x7f89500b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42832/0 (socket says 172.21.15.81:42832) 2023-10-07T08:49:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.964+0000 7f894ffff700 1 -- 172.21.15.81:0/2384542838 learned_addr learned my addr 172.21.15.81:0/2384542838 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.964+0000 7f894f7fe700 1 --2- 172.21.15.81:0/2384542838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89500b3bd0 0x7f89500ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.964+0000 7f894effd700 1 -- 172.21.15.81:0/2384542838 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587572347 0 0) 0x7f89500b2890 con 0x7f8950157fe0 2023-10-07T08:49:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.964+0000 7f894effd700 1 -- 172.21.15.81:0/2384542838 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8938003570 con 0x7f8950157fe0 2023-10-07T08:49:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894effd700 1 -- 172.21.15.81:0/2384542838 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1471891980 0 0) 0x7f8938003570 con 0x7f8950157fe0 2023-10-07T08:49:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894effd700 1 -- 172.21.15.81:0/2384542838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89500b3bd0 msgr2=0x7f89500ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894effd700 1 --2- 172.21.15.81:0/2384542838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89500b3bd0 0x7f89500ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894effd700 1 -- 172.21.15.81:0/2384542838 >> v1:172.21.15.89:6789/0 conn(0x7f89501583b0 legacy=0x7f8950158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894effd700 1 -- 172.21.15.81:0/2384542838 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89500b4630 con 0x7f8950157fe0 2023-10-07T08:49:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894effd700 1 -- 172.21.15.81:0/2384542838 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f8940001470 con 0x7f8950157fe0 2023-10-07T08:49:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894effd700 1 -- 172.21.15.81:0/2384542838 >> v1:172.21.15.81:6789/0 conn(0x7f8950157fe0 legacy=0x7f89500b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894effd700 1 --2- 172.21.15.81:0/2384542838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8938003a90 0x7f8938003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894effd700 1 --2- 172.21.15.81:0/2384542838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8938004810 0x7f8938004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894effd700 1 --2- 172.21.15.81:0/2384542838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89500b3bd0 0x7f89380051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894effd700 1 -- 172.21.15.81:0/2384542838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89500b4350 con 0x7f8938003a90 2023-10-07T08:49:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894effd700 1 -- 172.21.15.81:0/2384542838 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893800bb60 con 0x7f8938004810 2023-10-07T08:49:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894effd700 1 -- 172.21.15.81:0/2384542838 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893800bd20 con 0x7f89500b3bd0 2023-10-07T08:49:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894ffff700 1 --2- 172.21.15.81:0/2384542838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8938003a90 0x7f8938003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f8954abd700 1 --2- 172.21.15.81:0/2384542838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89500b3bd0 0x7f89380051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894f7fe700 1 --2- 172.21.15.81:0/2384542838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8938004810 0x7f8938004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:08.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894ffff700 1 -- 172.21.15.81:0/2384542838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89500b3bd0 msgr2=0x7f89380051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:08.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894ffff700 1 --2- 172.21.15.81:0/2384542838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89500b3bd0 0x7f89380051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894ffff700 1 -- 172.21.15.81:0/2384542838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8938004810 msgr2=0x7f8938004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:08.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894ffff700 1 --2- 172.21.15.81:0/2384542838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8938004810 0x7f8938004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894ffff700 1 -- 172.21.15.81:0/2384542838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8938003570 con 0x7f8938003a90 2023-10-07T08:49:08.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894ffff700 1 --2- 172.21.15.81:0/2384542838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8938003a90 0x7f8938003ea0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f894000c3c0 tx=0x7f8940001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee694fa24e34f329 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:08.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894effd700 1 -- 172.21.15.81:0/2384542838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894000cc90 con 0x7f8938003a90 2023-10-07T08:49:08.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894effd700 1 -- 172.21.15.81:0/2384542838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894000cdf0 con 0x7f8938003a90 2023-10-07T08:49:08.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.965+0000 7f894effd700 1 -- 172.21.15.81:0/2384542838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8940005b50 con 0x7f8938003a90 2023-10-07T08:49:08.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.966+0000 7f8956520700 1 -- 172.21.15.81:0/2384542838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8938003a90 msgr2=0x7f8938003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:08.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.966+0000 7f8956520700 1 --2- 172.21.15.81:0/2384542838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8938003a90 0x7f8938003ea0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f894000c3c0 tx=0x7f8940001e50 comp rx=0 tx=0).stop 2023-10-07T08:49:08.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.966+0000 7f8954abd700 1 -- 172.21.15.81:0/2384542838 reap_dead start 2023-10-07T08:49:08.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.966+0000 7f8956520700 1 -- 172.21.15.81:0/2384542838 shutdown_connections 2023-10-07T08:49:08.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.966+0000 7f8956520700 1 -- 172.21.15.81:0/2384542838 >> 172.21.15.81:0/2384542838 conn(0x7f8950067640 msgr2=0x7f8950067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:08.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.966+0000 7f8956520700 1 -- 172.21.15.81:0/2384542838 shutdown_connections 2023-10-07T08:49:08.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.966+0000 7f8956520700 1 -- 172.21.15.81:0/2384542838 wait complete. 2023-10-07T08:49:08.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.967+0000 7f8956520700 1 Processor -- start 2023-10-07T08:49:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.967+0000 7f8956520700 1 -- start start 2023-10-07T08:49:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f8956520700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8938003a90 0x7f895014a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f8956520700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f895014d240 0x7f895014d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f8956520700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f895015cbf0 0x7f895015d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f8956520700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895015d5d0 con 0x7f895014d240 2023-10-07T08:49:08.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f8956520700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895015b3b0 con 0x7f8938003a90 2023-10-07T08:49:08.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f8956520700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895014dbf0 con 0x7f895015cbf0 2023-10-07T08:49:08.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f894f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f895014d240 0x7f895014d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:08.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f894f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f895014d240 0x7f895014d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40008/0 (socket says 172.21.15.81:40008) 2023-10-07T08:49:08.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f894f7fe700 1 -- 172.21.15.81:0/2374282986 learned_addr learned my addr 172.21.15.81:0/2374282986 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:08.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f894ffff700 1 --2- 172.21.15.81:0/2374282986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8938003a90 0x7f895014a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:08.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f8954abd700 1 --2- 172.21.15.81:0/2374282986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f895015cbf0 0x7f895015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:08.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f894f7fe700 1 -- 172.21.15.81:0/2374282986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f895015cbf0 msgr2=0x7f895015d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:08.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f894f7fe700 1 --2- 172.21.15.81:0/2374282986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f895015cbf0 0x7f895015d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f894f7fe700 1 -- 172.21.15.81:0/2374282986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8938003a90 msgr2=0x7f895014a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:08.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f894f7fe700 1 --2- 172.21.15.81:0/2374282986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8938003a90 0x7f895014a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f894f7fe700 1 -- 172.21.15.81:0/2374282986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8950159fb0 con 0x7f895014d240 2023-10-07T08:49:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.968+0000 7f894f7fe700 1 --2- 172.21.15.81:0/2374282986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f895014d240 0x7f895014d6b0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f8944011b40 tx=0x7f89440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.969+0000 7f8937fff700 1 -- 172.21.15.81:0/2374282986 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894400f940 con 0x7f895014d240 2023-10-07T08:49:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.969+0000 7f8937fff700 1 -- 172.21.15.81:0/2374282986 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894400faa0 con 0x7f895014d240 2023-10-07T08:49:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.969+0000 7f8956520700 1 -- 172.21.15.81:0/2374282986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8950159680 con 0x7f895014d240 2023-10-07T08:49:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.969+0000 7f8937fff700 1 -- 172.21.15.81:0/2374282986 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894400fe20 con 0x7f895014d240 2023-10-07T08:49:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.969+0000 7f8956520700 1 -- 172.21.15.81:0/2374282986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8950159c40 con 0x7f895014d240 2023-10-07T08:49:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.970+0000 7f8956520700 1 -- 172.21.15.81:0/2374282986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8950159e00 con 0x7f895014d240 2023-10-07T08:49:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.970+0000 7f8937fff700 1 -- 172.21.15.81:0/2374282986 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8944014650 con 0x7f895014d240 2023-10-07T08:49:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.970+0000 7f8937fff700 1 --2- 172.21.15.81:0/2374282986 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f893c066f30 0x7f893c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:08.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.970+0000 7f894ffff700 1 --2- 172.21.15.81:0/2374282986 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f893c066f30 0x7f893c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:08.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.971+0000 7f8937fff700 1 -- 172.21.15.81:0/2374282986 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8944018030 con 0x7f895014d240 2023-10-07T08:49:08.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.971+0000 7f894ffff700 1 --2- 172.21.15.81:0/2374282986 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f893c066f30 0x7f893c0693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8940007cd0 tx=0x7f8940015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:08.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:08.975+0000 7f8937fff700 1 -- 172.21.15.81:0/2374282986 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8944052080 con 0x7f895014d240 2023-10-07T08:49:09.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.199+0000 7f8956520700 1 -- 172.21.15.81:0/2374282986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f895015a140 con 0x7f895014d240 2023-10-07T08:49:09.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.199+0000 7f8937fff700 1 -- 172.21.15.81:0/2374282986 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f8944022090 con 0x7f895014d240 2023-10-07T08:49:09.202 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:09.202 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":60,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/2384735966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2384735966},{"type":"v1","addr":"172.21.15.89:6834","nonce":2384735966}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6124,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1456306972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":1456306972},{"type":"v1","addr":"172.21.15.89:6835","nonce":1456306972}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3356050793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3356050793},{"type":"v1","addr":"172.21.15.81:6836","nonce":3356050793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7059,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/690365665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":690365665},{"type":"v1","addr":"172.21.15.81:6837","nonce":690365665}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[]} 2023-10-07T08:49:09.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.201+0000 7f8956520700 1 -- 172.21.15.81:0/2374282986 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f893c066f30 msgr2=0x7f893c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:09.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.201+0000 7f8956520700 1 --2- 172.21.15.81:0/2374282986 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f893c066f30 0x7f893c0693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8940007cd0 tx=0x7f8940015000 comp rx=0 tx=0).stop 2023-10-07T08:49:09.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.201+0000 7f8956520700 1 -- 172.21.15.81:0/2374282986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f895014d240 msgr2=0x7f895014d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:09.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.201+0000 7f8956520700 1 --2- 172.21.15.81:0/2374282986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f895014d240 0x7f895014d6b0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f8944011b40 tx=0x7f89440091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:09.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.201+0000 7f8956520700 1 -- 172.21.15.81:0/2374282986 shutdown_connections 2023-10-07T08:49:09.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.201+0000 7f8956520700 1 --2- 172.21.15.81:0/2374282986 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f893c066f30 0x7f893c0693e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:09.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.201+0000 7f8956520700 1 --2- 172.21.15.81:0/2374282986 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f895015cbf0 0x7f895015d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:09.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.201+0000 7f8956520700 1 --2- 172.21.15.81:0/2374282986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8938003a90 0x7f895014a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:09.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.201+0000 7f8956520700 1 --2- 172.21.15.81:0/2374282986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f895014d240 0x7f895014d6b0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:09.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.201+0000 7f8956520700 1 -- 172.21.15.81:0/2374282986 >> 172.21.15.81:0/2374282986 conn(0x7f8950067640 msgr2=0x7f8950155fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:09.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.201+0000 7f8956520700 1 -- 172.21.15.81:0/2374282986 shutdown_connections 2023-10-07T08:49:09.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.201+0000 7f8956520700 1 -- 172.21.15.81:0/2374282986 wait complete. 2023-10-07T08:49:09.204 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 60 2023-10-07T08:49:09.215 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T08:49:09.215 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T08:49:09.215 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T08:49:09.215 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:49:09.216 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T08:49:09.216 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T08:49:09.216 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T08:49:09.216 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:49:09.216 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T08:49:09.216 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T08:49:09.217 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T08:49:09.217 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:49:09.217 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T08:49:09.217 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T08:49:09.217 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T08:49:09.217 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:49:09.224 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T08:49:09.224 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T08:49:09.225 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T08:49:09.225 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T08:49:09.228 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T08:49:09.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T08:49:09.229 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T08:49:09.229 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T08:49:09.266 INFO:tasks.ceph.mds.a:Started 2023-10-07T08:49:09.267 DEBUG:teuthology.parallel:result is None 2023-10-07T08:49:09.267 INFO:tasks.ceph.mds.c:Started 2023-10-07T08:49:09.267 DEBUG:teuthology.parallel:result is None 2023-10-07T08:49:09.269 INFO:tasks.ceph.mds.b:Started 2023-10-07T08:49:09.270 DEBUG:teuthology.parallel:result is None 2023-10-07T08:49:09.270 INFO:tasks.ceph.mds.d:Started 2023-10-07T08:49:09.270 DEBUG:teuthology.parallel:result is None 2023-10-07T08:49:09.271 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T08:49:09.340 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-07T08:49:09.340 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-07T08:49:09.350 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-10-07T08:49:09.350 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-10-07T08:49:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.390+0000 7f3002c9e700 1 Processor -- start 2023-10-07T08:49:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.390+0000 7f3002c9e700 1 -- start start 2023-10-07T08:49:09.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f3002c9e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ffc1578d0 0x7f2ffc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:09.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f3002c9e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ffc157ca0 0x7f2ffc15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:09.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f3002c9e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ffc0d07c0 con 0x7f2ffc06d120 2023-10-07T08:49:09.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f3002c9e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ffc0cfbb0 con 0x7f2ffc157ca0 2023-10-07T08:49:09.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f3002c9e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc0cfe90 con 0x7f2ffc1578d0 2023-10-07T08:49:09.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f2ffbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ffc157ca0 0x7f2ffc15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:09.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f300123b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2ffc06d120 0x7f2ffc15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42842/0 (socket says 172.21.15.81:42842) 2023-10-07T08:49:09.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f300123b700 1 -- 172.21.15.81:0/51047209 learned_addr learned my addr 172.21.15.81:0/51047209 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:09.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f3000a3a700 1 --2- 172.21.15.81:0/51047209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ffc1578d0 0x7f2ffc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:09.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f2ffbfff700 1 -- 172.21.15.81:0/51047209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ffc1578d0 msgr2=0x7f2ffc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:09.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f2ffbfff700 1 --2- 172.21.15.81:0/51047209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ffc1578d0 0x7f2ffc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:09.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f2ffbfff700 1 -- 172.21.15.81:0/51047209 >> v1:172.21.15.81:6789/0 conn(0x7f2ffc06d120 legacy=0x7f2ffc15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f2ffb7fe700 1 -- 172.21.15.81:0/51047209 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197826553 0 0) 0x7f2ffc0d07c0 con 0x7f2ffc06d120 2023-10-07T08:49:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f2ffbfff700 1 -- 172.21.15.81:0/51047209 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc0d0170 con 0x7f2ffc157ca0 2023-10-07T08:49:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f3000a3a700 1 --2- 172.21.15.81:0/51047209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ffc1578d0 0x7f2ffc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f2ffbfff700 1 --2- 172.21.15.81:0/51047209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc157ca0 0x7f2ffc15af00 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80098e0 tx=0x7f2fe80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1d9de2745c507a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f2ffb7fe700 1 -- 172.21.15.81:0/51047209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8009e80 con 0x7f2ffc157ca0 2023-10-07T08:49:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f2ffb7fe700 1 -- 172.21.15.81:0/51047209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe800b860 con 0x7f2ffc157ca0 2023-10-07T08:49:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.391+0000 7f2ffb7fe700 1 -- 172.21.15.81:0/51047209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe800bbe0 con 0x7f2ffc157ca0 2023-10-07T08:49:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.392+0000 7f3002c9e700 1 -- 172.21.15.81:0/51047209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc157ca0 msgr2=0x7f2ffc15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.392+0000 7f3002c9e700 1 --2- 172.21.15.81:0/51047209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc157ca0 0x7f2ffc15af00 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80098e0 tx=0x7f2fe80091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.392+0000 7f3002c9e700 1 -- 172.21.15.81:0/51047209 shutdown_connections 2023-10-07T08:49:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.392+0000 7f3002c9e700 1 --2- 172.21.15.81:0/51047209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ffc1578d0 0x7f2ffc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.392+0000 7f3002c9e700 1 --2- 172.21.15.81:0/51047209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc157ca0 0x7f2ffc15af00 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:09.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.392+0000 7f3002c9e700 1 -- 172.21.15.81:0/51047209 >> 172.21.15.81:0/51047209 conn(0x7f2ffc06bb90 msgr2=0x7f2ffc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:09.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.392+0000 7f3002c9e700 1 -- 172.21.15.81:0/51047209 shutdown_connections 2023-10-07T08:49:09.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.392+0000 7f3002c9e700 1 -- 172.21.15.81:0/51047209 wait complete. 2023-10-07T08:49:09.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.393+0000 7f3002c9e700 1 Processor -- start 2023-10-07T08:49:09.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.393+0000 7f3002c9e700 1 -- start start 2023-10-07T08:49:09.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f3002c9e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ffc06d120 0x7f2ffc0abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:09.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f3002c9e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc1578d0 0x7f2ffc0ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:09.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f3002c9e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ffc157ca0 0x7f2ffc16a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:09.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f3002c9e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc0ac230 con 0x7f2ffc1578d0 2023-10-07T08:49:09.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f3002c9e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc0ae920 con 0x7f2ffc06d120 2023-10-07T08:49:09.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f3002c9e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc1555c0 con 0x7f2ffc157ca0 2023-10-07T08:49:09.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f2ffbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc1578d0 0x7f2ffc0ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:09.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f2ffbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc1578d0 0x7f2ffc0ae3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40066/0 (socket says 172.21.15.81:40066) 2023-10-07T08:49:09.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f2ffbfff700 1 -- 172.21.15.81:0/531607384 learned_addr learned my addr 172.21.15.81:0/531607384 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:09.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f3000a3a700 1 --2- 172.21.15.81:0/531607384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ffc06d120 0x7f2ffc0abcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:09.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f300123b700 1 --2- 172.21.15.81:0/531607384 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ffc157ca0 0x7f2ffc16a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:09.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f2ffbfff700 1 -- 172.21.15.81:0/531607384 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ffc157ca0 msgr2=0x7f2ffc16a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:09.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f2ffbfff700 1 --2- 172.21.15.81:0/531607384 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ffc157ca0 0x7f2ffc16a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:09.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f2ffbfff700 1 -- 172.21.15.81:0/531607384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ffc06d120 msgr2=0x7f2ffc0abcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:09.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f2ffbfff700 1 --2- 172.21.15.81:0/531607384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ffc06d120 0x7f2ffc0abcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:09.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f2ffbfff700 1 -- 172.21.15.81:0/531607384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe8009420 con 0x7f2ffc1578d0 2023-10-07T08:49:09.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f3000a3a700 1 --2- 172.21.15.81:0/531607384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ffc06d120 0x7f2ffc0abcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:09.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.394+0000 7f2ffbfff700 1 --2- 172.21.15.81:0/531607384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc1578d0 0x7f2ffc0ae3e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc06fe20 tx=0x7f2fe8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:09.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.395+0000 7f2ff8ff9700 1 -- 172.21.15.81:0/531607384 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe800bbe0 con 0x7f2ffc1578d0 2023-10-07T08:49:09.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.395+0000 7f2ff8ff9700 1 -- 172.21.15.81:0/531607384 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe8011420 con 0x7f2ffc1578d0 2023-10-07T08:49:09.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.395+0000 7f3002c9e700 1 -- 172.21.15.81:0/531607384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ffc0ac420 con 0x7f2ffc1578d0 2023-10-07T08:49:09.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.395+0000 7f2ff8ff9700 1 -- 172.21.15.81:0/531607384 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80117c0 con 0x7f2ffc1578d0 2023-10-07T08:49:09.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.395+0000 7f3002c9e700 1 -- 172.21.15.81:0/531607384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ffc0ac9e0 con 0x7f2ffc1578d0 2023-10-07T08:49:09.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.396+0000 7f3002c9e700 1 -- 172.21.15.81:0/531607384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ffc067ac0 con 0x7f2ffc1578d0 2023-10-07T08:49:09.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.396+0000 7f2ff8ff9700 1 -- 172.21.15.81:0/531607384 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fe8011bf0 con 0x7f2ffc1578d0 2023-10-07T08:49:09.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.396+0000 7f2ff8ff9700 1 --2- 172.21.15.81:0/531607384 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2fe0066f30 0x7f2fe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:09.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.396+0000 7f2ff8ff9700 1 -- 172.21.15.81:0/531607384 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2fe8085bb0 con 0x7f2ffc1578d0 2023-10-07T08:49:09.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.396+0000 7f3000a3a700 1 --2- 172.21.15.81:0/531607384 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2fe0066f30 0x7f2fe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:09.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.397+0000 7f3000a3a700 1 --2- 172.21.15.81:0/531607384 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2fe0066f30 0x7f2fe00693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0006f00 tx=0x7f2ff0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:09.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.400+0000 7f2ff8ff9700 1 -- 172.21.15.81:0/531607384 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fe8053120 con 0x7f2ffc1578d0 2023-10-07T08:49:09.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:09.609+0000 7f3002c9e700 1 -- 172.21.15.81:0/531607384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2ffc0d0450 con 0x7f2ffc1578d0 2023-10-07T08:49:10.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.444+0000 7f2ff8ff9700 1 -- 172.21.15.81:0/531607384 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v134) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2fe8056740 con 0x7f2ffc1578d0 2023-10-07T08:49:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.446+0000 7f3002c9e700 1 -- 172.21.15.81:0/531607384 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2fe0066f30 msgr2=0x7f2fe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.446+0000 7f3002c9e700 1 --2- 172.21.15.81:0/531607384 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2fe0066f30 0x7f2fe00693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0006f00 tx=0x7f2ff0008040 comp rx=0 tx=0).stop 2023-10-07T08:49:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.446+0000 7f3002c9e700 1 -- 172.21.15.81:0/531607384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc1578d0 msgr2=0x7f2ffc0ae3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.446+0000 7f3002c9e700 1 --2- 172.21.15.81:0/531607384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc1578d0 0x7f2ffc0ae3e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc06fe20 tx=0x7f2fe8017000 comp rx=0 tx=0).stop 2023-10-07T08:49:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.447+0000 7f3002c9e700 1 -- 172.21.15.81:0/531607384 shutdown_connections 2023-10-07T08:49:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.447+0000 7f3002c9e700 1 --2- 172.21.15.81:0/531607384 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2fe0066f30 0x7f2fe00693e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.447+0000 7f3002c9e700 1 --2- 172.21.15.81:0/531607384 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ffc157ca0 0x7f2ffc16a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.447+0000 7f3002c9e700 1 --2- 172.21.15.81:0/531607384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ffc06d120 0x7f2ffc0abcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.447+0000 7f3002c9e700 1 --2- 172.21.15.81:0/531607384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc1578d0 0x7f2ffc0ae3e0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.447+0000 7f3002c9e700 1 -- 172.21.15.81:0/531607384 >> 172.21.15.81:0/531607384 conn(0x7f2ffc06bb90 msgr2=0x7f2ffc155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:10.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.447+0000 7f3002c9e700 1 -- 172.21.15.81:0/531607384 shutdown_connections 2023-10-07T08:49:10.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.447+0000 7f3002c9e700 1 -- 172.21.15.81:0/531607384 wait complete. 2023-10-07T08:49:10.449 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-07T08:49:10.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T08:49:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.575+0000 7fa44161b700 1 Processor -- start 2023-10-07T08:49:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.575+0000 7fa44161b700 1 -- start start 2023-10-07T08:49:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.576+0000 7fa44161b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa43c0aeea0 0x7fa43c0c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.576+0000 7fa44161b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa43c0af270 0x7fa43c0c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.576+0000 7fa44161b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43c06aae0 con 0x7fa43c0c7d00 2023-10-07T08:49:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.576+0000 7fa44161b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c069ed0 con 0x7fa43c0af270 2023-10-07T08:49:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.576+0000 7fa44161b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c06a1b0 con 0x7fa43c0aeea0 2023-10-07T08:49:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.577+0000 7fa43a7fc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa43c0af270 0x7fa43c0c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.577+0000 7fa43affd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa43c0aeea0 0x7fa43c0c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.577+0000 7fa43b7fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa43c0c7d00 0x7fa43c0c8140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:41260/0 (socket says 172.21.15.81:41260) 2023-10-07T08:49:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.577+0000 7fa43a7fc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa43c0af270 0x7fa43c0c2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:55088/0 (socket says 172.21.15.81:55088) 2023-10-07T08:49:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.577+0000 7fa43affd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa43c0aeea0 0x7fa43c0c2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:56190/0 (socket says 172.21.15.81:56190) 2023-10-07T08:49:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.577+0000 7fa43b7fe700 1 -- 172.21.15.81:0/2950380697 learned_addr learned my addr 172.21.15.81:0/2950380697 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.577+0000 7fa43a7fc700 1 -- 172.21.15.81:0/2950380697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa43c0aeea0 msgr2=0x7fa43c0c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.577+0000 7fa43a7fc700 1 --2- 172.21.15.81:0/2950380697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa43c0aeea0 0x7fa43c0c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.577+0000 7fa43a7fc700 1 -- 172.21.15.81:0/2950380697 >> v1:172.21.15.89:6789/0 conn(0x7fa43c0c7d00 legacy=0x7fa43c0c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.577+0000 7fa43a7fc700 1 -- 172.21.15.81:0/2950380697 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c06a490 con 0x7fa43c0af270 2023-10-07T08:49:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.577+0000 7fa43affd700 1 --2- 172.21.15.81:0/2950380697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa43c0aeea0 0x7fa43c0c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:49:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.577+0000 7fa43a7fc700 1 --2- 172.21.15.81:0/2950380697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa43c0af270 0x7fa43c0c2e60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa4300098e0 tx=0x7fa4300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5489ba386a1c1b25 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.577+0000 7fa439ffb700 1 -- 172.21.15.81:0/2950380697 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43000b6d0 con 0x7fa43c0af270 2023-10-07T08:49:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.577+0000 7fa439ffb700 1 -- 172.21.15.81:0/2950380697 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43000b830 con 0x7fa43c0af270 2023-10-07T08:49:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.577+0000 7fa439ffb700 1 -- 172.21.15.81:0/2950380697 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43000bbd0 con 0x7fa43c0af270 2023-10-07T08:49:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.578+0000 7fa44161b700 1 -- 172.21.15.81:0/2950380697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa43c0af270 msgr2=0x7fa43c0c2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.578+0000 7fa44161b700 1 --2- 172.21.15.81:0/2950380697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa43c0af270 0x7fa43c0c2e60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa4300098e0 tx=0x7fa4300091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.578+0000 7fa44161b700 1 -- 172.21.15.81:0/2950380697 shutdown_connections 2023-10-07T08:49:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.578+0000 7fa44161b700 1 --2- 172.21.15.81:0/2950380697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa43c0aeea0 0x7fa43c0c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.578+0000 7fa44161b700 1 --2- 172.21.15.81:0/2950380697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa43c0af270 0x7fa43c0c2e60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.578+0000 7fa44161b700 1 -- 172.21.15.81:0/2950380697 >> 172.21.15.81:0/2950380697 conn(0x7fa43c06c660 msgr2=0x7fa43c0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.578+0000 7fa44161b700 1 -- 172.21.15.81:0/2950380697 shutdown_connections 2023-10-07T08:49:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.578+0000 7fa44161b700 1 -- 172.21.15.81:0/2950380697 wait complete. 2023-10-07T08:49:10.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.579+0000 7fa44161b700 1 Processor -- start 2023-10-07T08:49:10.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.579+0000 7fa44161b700 1 -- start start 2023-10-07T08:49:10.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.580+0000 7fa44161b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa43c0aeea0 0x7fa43c151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:10.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.580+0000 7fa44161b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa43c0af270 0x7fa43c15aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:10.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.580+0000 7fa44161b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43c0c7d00 0x7fa43c15af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:10.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.580+0000 7fa44161b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c0c4bb0 con 0x7fa43c0c7d00 2023-10-07T08:49:10.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.580+0000 7fa44161b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c0c3fa0 con 0x7fa43c0aeea0 2023-10-07T08:49:10.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.580+0000 7fa44161b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c0c4280 con 0x7fa43c0af270 2023-10-07T08:49:10.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.580+0000 7fa43b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43c0c7d00 0x7fa43c15af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:10.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.580+0000 7fa43b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43c0c7d00 0x7fa43c15af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40070/0 (socket says 172.21.15.81:40070) 2023-10-07T08:49:10.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.580+0000 7fa43b7fe700 1 -- 172.21.15.81:0/3433050002 learned_addr learned my addr 172.21.15.81:0/3433050002 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:10.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.580+0000 7fa43affd700 1 --2- 172.21.15.81:0/3433050002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa43c0aeea0 0x7fa43c151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:10.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.580+0000 7fa43a7fc700 1 --2- 172.21.15.81:0/3433050002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa43c0af270 0x7fa43c15aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:10.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.580+0000 7fa43b7fe700 1 -- 172.21.15.81:0/3433050002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa43c0af270 msgr2=0x7fa43c15aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.580+0000 7fa43b7fe700 1 --2- 172.21.15.81:0/3433050002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa43c0af270 0x7fa43c15aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.580+0000 7fa43b7fe700 1 -- 172.21.15.81:0/3433050002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa43c0aeea0 msgr2=0x7fa43c151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.580+0000 7fa43b7fe700 1 --2- 172.21.15.81:0/3433050002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa43c0aeea0 0x7fa43c151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.580+0000 7fa43b7fe700 1 -- 172.21.15.81:0/3433050002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c009420 con 0x7fa43c0c7d00 2023-10-07T08:49:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.581+0000 7fa43b7fe700 1 --2- 172.21.15.81:0/3433050002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43c0c7d00 0x7fa43c15af50 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa43400cbc0 tx=0x7fa4340019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.581+0000 7fa422ffd700 1 -- 172.21.15.81:0/3433050002 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43400a890 con 0x7fa43c0c7d00 2023-10-07T08:49:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.581+0000 7fa422ffd700 1 -- 172.21.15.81:0/3433050002 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43400a9f0 con 0x7fa43c0c7d00 2023-10-07T08:49:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.581+0000 7fa422ffd700 1 -- 172.21.15.81:0/3433050002 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43400ad70 con 0x7fa43c0c7d00 2023-10-07T08:49:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.581+0000 7fa44161b700 1 -- 172.21.15.81:0/3433050002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa430009420 con 0x7fa43c0c7d00 2023-10-07T08:49:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.581+0000 7fa44161b700 1 -- 172.21.15.81:0/3433050002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43c0c4840 con 0x7fa43c0c7d00 2023-10-07T08:49:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.582+0000 7fa44161b700 1 -- 172.21.15.81:0/3433050002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43c0c4d20 con 0x7fa43c0c7d00 2023-10-07T08:49:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.582+0000 7fa422ffd700 1 -- 172.21.15.81:0/3433050002 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa434007300 con 0x7fa43c0c7d00 2023-10-07T08:49:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.582+0000 7fa422ffd700 1 --2- 172.21.15.81:0/3433050002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa428066f30 0x7fa4280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.582+0000 7fa422ffd700 1 -- 172.21.15.81:0/3433050002 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa434084560 con 0x7fa43c0c7d00 2023-10-07T08:49:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.583+0000 7fa43affd700 1 --2- 172.21.15.81:0/3433050002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa428066f30 0x7fa4280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.583+0000 7fa43affd700 1 --2- 172.21.15.81:0/3433050002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa428066f30 0x7fa4280693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009f40 tx=0x7fa42c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.587+0000 7fa422ffd700 1 -- 172.21.15.81:0/3433050002 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa434051b10 con 0x7fa43c0c7d00 2023-10-07T08:49:10.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.843+0000 7fa44161b700 1 -- 172.21.15.81:0/3433050002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa43c0ccf60 con 0x7fa43c0c7d00 2023-10-07T08:49:10.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.843+0000 7fa422ffd700 1 -- 172.21.15.81:0/3433050002 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa434055130 con 0x7fa43c0c7d00 2023-10-07T08:49:10.845 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:10.845 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:49:10.845 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-07T08:49:10.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.845 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-07T08:49:10.845 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlK8v0EhAAyj+l+ifyEevPT96HbuWzkw==", 2023-10-07T08:49:10.845 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.845 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:49:10.845 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:49:10.845 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:49:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-07T08:49:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlN0UcHhAA0o1jHEL9Ow40VDezKTunOw==", 2023-10-07T08:49:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:49:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:49:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:49:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-07T08:49:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlvsm6GRAApZehzqt3HugU+h9RGWQh8g==", 2023-10-07T08:49:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:49:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:49:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:49:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-07T08:49:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8XLiJBAAMBqSo/+NZuuL/pPnTitAUw==", 2023-10-07T08:49:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:49:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:49:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:49:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-07T08:49:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD2GSFlwYNOOBAAMpoFTAZdRERvqFbI4Lno9g==", 2023-10-07T08:49:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:49:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:49:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-07T08:49:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlejEnBBAAsnZCgsTTMWvqr2n4FfgWCQ==", 2023-10-07T08:49:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:49:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:49:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-07T08:49:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlDjS3DRAAfyBS9XSkAY6Se+RNw9jwWw==", 2023-10-07T08:49:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:49:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:49:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-07T08:49:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlnLaEFxAAtQ3AxrEGCcXYvJF2/wP1yw==", 2023-10-07T08:49:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:49:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:49:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-07T08:49:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlllNdIRAAXgD+PAR1Piya6p94xfGbXA==", 2023-10-07T08:49:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:49:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:49:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-07T08:49:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFleIM7KBAAIz+WlbgsmtAuSMPO+kh/Xw==", 2023-10-07T08:49:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:49:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:49:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-07T08:49:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlFNlEMRAAt7dpMTylOj0KsJy/law6Nw==", 2023-10-07T08:49:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:49:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:49:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-07T08:49:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFloCRbOhAA8XzXVwVYYYZIJV+F84EiDQ==", 2023-10-07T08:49:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:49:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:49:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-07T08:49:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl7cS0KBAA2K6kkFjyEZYa0xYx53Nf7g==", 2023-10-07T08:49:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:49:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-07T08:49:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T08:49:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-07T08:49:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlP3EBMRAAWXcQeEkoEzBCSQzvz/AzBQ==", 2023-10-07T08:49:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:49:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:49:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:49:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:49:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.857 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-07T08:49:10.857 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFldtgKLhAAX8L0S1NgyHsOj4cUljxH/A==", 2023-10-07T08:49:10.857 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.857 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:49:10.857 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:49:10.857 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:49:10.857 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:49:10.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-07T08:49:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlJ+VXNhAA9sXFpdOEIZxQLiS8LJwa3A==", 2023-10-07T08:49:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:49:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:49:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:49:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:49:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-07T08:49:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDyGSFle021MxAA39oudTkATALz6ZklfA0QQA==", 2023-10-07T08:49:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:49:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:49:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:49:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-07T08:49:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8c3zDxAAKU/DHPPZhFJ1MKw48C6lJQ==", 2023-10-07T08:49:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:49:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:49:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-07T08:49:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlByYuDBAA2xkiT3FNBRXjSMlu+GdRjg==", 2023-10-07T08:49:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:49:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:49:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:10.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:10.861 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:49:10.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.845+0000 7fa44161b700 1 -- 172.21.15.81:0/3433050002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa428066f30 msgr2=0x7fa4280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:10.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.845+0000 7fa44161b700 1 --2- 172.21.15.81:0/3433050002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa428066f30 0x7fa4280693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009f40 tx=0x7fa42c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.845+0000 7fa44161b700 1 -- 172.21.15.81:0/3433050002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43c0c7d00 msgr2=0x7fa43c15af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:10.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.845+0000 7fa44161b700 1 --2- 172.21.15.81:0/3433050002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43c0c7d00 0x7fa43c15af50 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa43400cbc0 tx=0x7fa4340019c0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.845+0000 7fa44161b700 1 -- 172.21.15.81:0/3433050002 shutdown_connections 2023-10-07T08:49:10.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.845+0000 7fa44161b700 1 --2- 172.21.15.81:0/3433050002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43c0c7d00 0x7fa43c15af50 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.845+0000 7fa44161b700 1 --2- 172.21.15.81:0/3433050002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa43c0aeea0 0x7fa43c151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.845+0000 7fa44161b700 1 --2- 172.21.15.81:0/3433050002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa428066f30 0x7fa4280693e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.845+0000 7fa44161b700 1 --2- 172.21.15.81:0/3433050002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa43c0af270 0x7fa43c15aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.845+0000 7fa44161b700 1 -- 172.21.15.81:0/3433050002 >> 172.21.15.81:0/3433050002 conn(0x7fa43c06c660 msgr2=0x7fa43c1530a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:10.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.845+0000 7fa44161b700 1 -- 172.21.15.81:0/3433050002 shutdown_connections 2023-10-07T08:49:10.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.845+0000 7fa44161b700 1 -- 172.21.15.81:0/3433050002 wait complete. 2023-10-07T08:49:10.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:49:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.976+0000 7fc6cc532700 1 Processor -- start 2023-10-07T08:49:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.976+0000 7fc6cc532700 1 -- start start 2023-10-07T08:49:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.977+0000 7fc6cc532700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6c41578d0 0x7fc6c40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.977+0000 7fc6cc532700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c40d07c0 con 0x7fc6c406d120 2023-10-07T08:49:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.977+0000 7fc6cc532700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c40cfbb0 con 0x7fc6c4157ca0 2023-10-07T08:49:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.977+0000 7fc6cc532700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c40cfe90 con 0x7fc6c41578d0 2023-10-07T08:49:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.977+0000 7fc6ca2ce700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6c41578d0 0x7fc6c40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.977+0000 7fc6caacf700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc6c406d120 0x7fc6c406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42858/0 (socket says 172.21.15.81:42858) 2023-10-07T08:49:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.977+0000 7fc6caacf700 1 -- 172.21.15.81:0/2474829309 learned_addr learned my addr 172.21.15.81:0/2474829309 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.977+0000 7fc6ca2ce700 1 -- 172.21.15.81:0/2474829309 >> v1:172.21.15.89:6789/0 conn(0x7fc6c4157ca0 legacy=0x7fc6c415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:10.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.977+0000 7fc6ca2ce700 1 -- 172.21.15.81:0/2474829309 >> v1:172.21.15.81:6789/0 conn(0x7fc6c406d120 legacy=0x7fc6c406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:10.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.977+0000 7fc6ca2ce700 1 -- 172.21.15.81:0/2474829309 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c40d0170 con 0x7fc6c41578d0 2023-10-07T08:49:10.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.977+0000 7fc6c92cc700 1 -- 172.21.15.81:0/2474829309 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669997800 0 0) 0x7fc6c40d07c0 con 0x7fc6c406d120 2023-10-07T08:49:10.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.977+0000 7fc6ca2ce700 1 --2- 172.21.15.81:0/2474829309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c41578d0 0x7fc6c40cf4f0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0098e0 tx=0x7fc6bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9abf2794903cc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:10.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.977+0000 7fc6c92cc700 1 -- 172.21.15.81:0/2474829309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc009e80 con 0x7fc6c41578d0 2023-10-07T08:49:10.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.977+0000 7fc6c92cc700 1 -- 172.21.15.81:0/2474829309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc00b860 con 0x7fc6c41578d0 2023-10-07T08:49:10.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.977+0000 7fc6c92cc700 1 -- 172.21.15.81:0/2474829309 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc00bbe0 con 0x7fc6c41578d0 2023-10-07T08:49:10.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.978+0000 7fc6cc532700 1 -- 172.21.15.81:0/2474829309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c41578d0 msgr2=0x7fc6c40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:10.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.978+0000 7fc6cc532700 1 --2- 172.21.15.81:0/2474829309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c41578d0 0x7fc6c40cf4f0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0098e0 tx=0x7fc6bc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.978+0000 7fc6cc532700 1 -- 172.21.15.81:0/2474829309 shutdown_connections 2023-10-07T08:49:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.978+0000 7fc6cc532700 1 --2- 172.21.15.81:0/2474829309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c41578d0 0x7fc6c40cf4f0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.978+0000 7fc6cc532700 1 -- 172.21.15.81:0/2474829309 >> 172.21.15.81:0/2474829309 conn(0x7fc6c406bb90 msgr2=0x7fc6c406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.978+0000 7fc6cc532700 1 -- 172.21.15.81:0/2474829309 shutdown_connections 2023-10-07T08:49:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.978+0000 7fc6cc532700 1 -- 172.21.15.81:0/2474829309 wait complete. 2023-10-07T08:49:10.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.979+0000 7fc6cc532700 1 Processor -- start 2023-10-07T08:49:10.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.979+0000 7fc6cc532700 1 -- start start 2023-10-07T08:49:10.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6cc532700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6c406d120 0x7fc6c40cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6cc532700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c41578d0 0x7fc6c416e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6cc532700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6c4157ca0 0x7fc6c4152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6cc532700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40b5360 con 0x7fc6c41578d0 2023-10-07T08:49:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6cc532700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c416ea20 con 0x7fc6c4157ca0 2023-10-07T08:49:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6cc532700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40cdc40 con 0x7fc6c406d120 2023-10-07T08:49:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6c9acd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c41578d0 0x7fc6c416e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6c9acd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c41578d0 0x7fc6c416e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40092/0 (socket says 172.21.15.81:40092) 2023-10-07T08:49:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6c9acd700 1 -- 172.21.15.81:0/1623495929 learned_addr learned my addr 172.21.15.81:0/1623495929 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6caacf700 1 --2- 172.21.15.81:0/1623495929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6c4157ca0 0x7fc6c4152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6ca2ce700 1 --2- 172.21.15.81:0/1623495929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6c406d120 0x7fc6c40cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6c9acd700 1 -- 172.21.15.81:0/1623495929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6c406d120 msgr2=0x7fc6c40cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6c9acd700 1 --2- 172.21.15.81:0/1623495929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6c406d120 0x7fc6c40cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6c9acd700 1 -- 172.21.15.81:0/1623495929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6c4157ca0 msgr2=0x7fc6c4152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6c9acd700 1 --2- 172.21.15.81:0/1623495929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6c4157ca0 0x7fc6c4152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6c9acd700 1 -- 172.21.15.81:0/1623495929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc009420 con 0x7fc6c41578d0 2023-10-07T08:49:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6ca2ce700 1 --2- 172.21.15.81:0/1623495929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6c406d120 0x7fc6c40cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6c9acd700 1 --2- 172.21.15.81:0/1623495929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c41578d0 0x7fc6c416e4e0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800c590 tx=0x7fc6b8007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6c27fc700 1 -- 172.21.15.81:0/1623495929 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8011590 con 0x7fc6c41578d0 2023-10-07T08:49:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6c27fc700 1 -- 172.21.15.81:0/1623495929 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b8011710 con 0x7fc6c41578d0 2023-10-07T08:49:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6cc532700 1 -- 172.21.15.81:0/1623495929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c40b4d10 con 0x7fc6c41578d0 2023-10-07T08:49:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.980+0000 7fc6c27fc700 1 -- 172.21.15.81:0/1623495929 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8011ad0 con 0x7fc6c41578d0 2023-10-07T08:49:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.981+0000 7fc6cc532700 1 -- 172.21.15.81:0/1623495929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c4152fa0 con 0x7fc6c41578d0 2023-10-07T08:49:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.981+0000 7fc6cc532700 1 -- 172.21.15.81:0/1623495929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c40b4b70 con 0x7fc6c41578d0 2023-10-07T08:49:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.982+0000 7fc6c27fc700 1 -- 172.21.15.81:0/1623495929 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6b801b3b0 con 0x7fc6c41578d0 2023-10-07T08:49:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.982+0000 7fc6c27fc700 1 --2- 172.21.15.81:0/1623495929 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6b0066f30 0x7fc6b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.982+0000 7fc6c27fc700 1 -- 172.21.15.81:0/1623495929 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc6b80835c0 con 0x7fc6c41578d0 2023-10-07T08:49:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.982+0000 7fc6ca2ce700 1 --2- 172.21.15.81:0/1623495929 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6b0066f30 0x7fc6b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.982+0000 7fc6ca2ce700 1 --2- 172.21.15.81:0/1623495929 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6b0066f30 0x7fc6b00693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0093f0 tx=0x7fc6bc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:10.986+0000 7fc6c27fc700 1 -- 172.21.15.81:0/1623495929 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6c40b4b70 con 0x7fc6c41578d0 2023-10-07T08:49:11.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.167+0000 7fc6cc532700 1 -- 172.21.15.81:0/1623495929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6c40b4b70 con 0x7fc6c41578d0 2023-10-07T08:49:11.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.168+0000 7fc6c27fc700 1 -- 172.21.15.81:0/1623495929 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+12097 (secure 0 0 0) 0x7fc6c40b4b70 con 0x7fc6c41578d0 2023-10-07T08:49:11.169 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:11.169 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":134,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:49:10.442612+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:49:11.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.170+0000 7fc6cc532700 1 -- 172.21.15.81:0/1623495929 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6b0066f30 msgr2=0x7fc6b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.170+0000 7fc6cc532700 1 --2- 172.21.15.81:0/1623495929 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6b0066f30 0x7fc6b00693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0093f0 tx=0x7fc6bc017000 comp rx=0 tx=0).stop 2023-10-07T08:49:11.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.170+0000 7fc6cc532700 1 -- 172.21.15.81:0/1623495929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c41578d0 msgr2=0x7fc6c416e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.170+0000 7fc6cc532700 1 --2- 172.21.15.81:0/1623495929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c41578d0 0x7fc6c416e4e0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800c590 tx=0x7fc6b8007f50 comp rx=0 tx=0).stop 2023-10-07T08:49:11.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.170+0000 7fc6cc532700 1 -- 172.21.15.81:0/1623495929 shutdown_connections 2023-10-07T08:49:11.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.170+0000 7fc6cc532700 1 --2- 172.21.15.81:0/1623495929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6c4157ca0 0x7fc6c4152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.170+0000 7fc6cc532700 1 --2- 172.21.15.81:0/1623495929 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6b0066f30 0x7fc6b00693e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.170+0000 7fc6cc532700 1 --2- 172.21.15.81:0/1623495929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6c406d120 0x7fc6c40cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.170+0000 7fc6cc532700 1 --2- 172.21.15.81:0/1623495929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c41578d0 0x7fc6c416e4e0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.170+0000 7fc6cc532700 1 -- 172.21.15.81:0/1623495929 >> 172.21.15.81:0/1623495929 conn(0x7fc6c406bb90 msgr2=0x7fc6c415a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:11.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.170+0000 7fc6cc532700 1 -- 172.21.15.81:0/1623495929 shutdown_connections 2023-10-07T08:49:11.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.170+0000 7fc6cc532700 1 -- 172.21.15.81:0/1623495929 wait complete. 2023-10-07T08:49:11.183 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T08:49:11.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:49:11.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.300+0000 7ff63f59e700 1 Processor -- start 2023-10-07T08:49:11.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.300+0000 7ff63f59e700 1 -- start start 2023-10-07T08:49:11.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63f59e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff6400d0b80 0x7ff6400cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63f59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff64006d700 0x7ff64015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63f59e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6400cf2d0 con 0x7ff6400d02b0 2023-10-07T08:49:11.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63f59e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64015a690 con 0x7ff6400d0b80 2023-10-07T08:49:11.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63f59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64006dc00 con 0x7ff64006d700 2023-10-07T08:49:11.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63ed9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff64006d700 0x7ff64015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63e59c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff6400d0b80 0x7ff6400cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63ed9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff64006d700 0x7ff64015b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:56220/0 (socket says 172.21.15.81:56220) 2023-10-07T08:49:11.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63e59c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff6400d0b80 0x7ff6400cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:55110/0 (socket says 172.21.15.81:55110) 2023-10-07T08:49:11.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63ed9d700 1 -- 172.21.15.81:0/302030538 learned_addr learned my addr 172.21.15.81:0/302030538 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:11.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63dd9b700 1 --1- 172.21.15.81:0/302030538 >> v1:172.21.15.89:6789/0 conn(0x7ff6400d02b0 0x7ff64006cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:41288/0 (socket says 172.21.15.81:41288) 2023-10-07T08:49:11.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63e59c700 1 -- 172.21.15.81:0/302030538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff64006d700 msgr2=0x7ff64015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:11.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63e59c700 1 --2- 172.21.15.81:0/302030538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff64006d700 0x7ff64015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63e59c700 1 -- 172.21.15.81:0/302030538 >> v1:172.21.15.89:6789/0 conn(0x7ff6400d02b0 legacy=0x7ff64006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63e59c700 1 -- 172.21.15.81:0/302030538 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6400cf570 con 0x7ff6400d0b80 2023-10-07T08:49:11.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63d59a700 1 -- 172.21.15.81:0/302030538 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543982982 0 0) 0x7ff6400cf2d0 con 0x7ff6400d02b0 2023-10-07T08:49:11.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.301+0000 7ff63ed9d700 1 --2- 172.21.15.81:0/302030538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff64006d700 0x7ff64015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:49:11.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.302+0000 7ff63e59c700 1 --2- 172.21.15.81:0/302030538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6400d0b80 0x7ff6400cfd70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff6300098e0 tx=0x7ff6300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a133048734131690 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:11.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.302+0000 7ff63d59a700 1 -- 172.21.15.81:0/302030538 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63000b640 con 0x7ff6400d0b80 2023-10-07T08:49:11.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.302+0000 7ff63d59a700 1 -- 172.21.15.81:0/302030538 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63000b7a0 con 0x7ff6400d0b80 2023-10-07T08:49:11.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.302+0000 7ff63d59a700 1 -- 172.21.15.81:0/302030538 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63000bb40 con 0x7ff6400d0b80 2023-10-07T08:49:11.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.302+0000 7ff63f59e700 1 -- 172.21.15.81:0/302030538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6400d0b80 msgr2=0x7ff6400cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.302+0000 7ff63f59e700 1 --2- 172.21.15.81:0/302030538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6400d0b80 0x7ff6400cfd70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff6300098e0 tx=0x7ff6300091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.302+0000 7ff63f59e700 1 -- 172.21.15.81:0/302030538 shutdown_connections 2023-10-07T08:49:11.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.302+0000 7ff63f59e700 1 --2- 172.21.15.81:0/302030538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff64006d700 0x7ff64015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.302+0000 7ff63f59e700 1 --2- 172.21.15.81:0/302030538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6400d0b80 0x7ff6400cfd70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.302+0000 7ff63f59e700 1 -- 172.21.15.81:0/302030538 >> 172.21.15.81:0/302030538 conn(0x7ff640063230 msgr2=0x7ff640063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:11.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.303+0000 7ff63f59e700 1 -- 172.21.15.81:0/302030538 shutdown_connections 2023-10-07T08:49:11.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.303+0000 7ff63f59e700 1 -- 172.21.15.81:0/302030538 wait complete. 2023-10-07T08:49:11.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.304+0000 7ff63f59e700 1 Processor -- start 2023-10-07T08:49:11.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.304+0000 7ff63f59e700 1 -- start start 2023-10-07T08:49:11.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.304+0000 7ff63f59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff64006d700 0x7ff640146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.304+0000 7ff63f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6400d02b0 0x7ff6400b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.304+0000 7ff63f59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6400d0b80 0x7ff6400b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.304+0000 7ff63f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400ae5e0 con 0x7ff6400d02b0 2023-10-07T08:49:11.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.304+0000 7ff63f59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400adcb0 con 0x7ff6400d0b80 2023-10-07T08:49:11.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.304+0000 7ff63f59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400adf90 con 0x7ff64006d700 2023-10-07T08:49:11.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.304+0000 7ff63dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6400d02b0 0x7ff6400b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.304+0000 7ff63dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6400d02b0 0x7ff6400b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40102/0 (socket says 172.21.15.81:40102) 2023-10-07T08:49:11.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.304+0000 7ff63dd9b700 1 -- 172.21.15.81:0/85030755 learned_addr learned my addr 172.21.15.81:0/85030755 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:11.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.305+0000 7ff63e59c700 1 --2- 172.21.15.81:0/85030755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff64006d700 0x7ff640146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.305+0000 7ff63ed9d700 1 --2- 172.21.15.81:0/85030755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6400d0b80 0x7ff6400b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.305+0000 7ff63dd9b700 1 -- 172.21.15.81:0/85030755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff64006d700 msgr2=0x7ff640146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.305+0000 7ff63dd9b700 1 --2- 172.21.15.81:0/85030755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff64006d700 0x7ff640146600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.305+0000 7ff63dd9b700 1 -- 172.21.15.81:0/85030755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6400d0b80 msgr2=0x7ff6400b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.305+0000 7ff63dd9b700 1 --2- 172.21.15.81:0/85030755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6400d0b80 0x7ff6400b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.305+0000 7ff63dd9b700 1 -- 172.21.15.81:0/85030755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff638009ae0 con 0x7ff6400d02b0 2023-10-07T08:49:11.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.305+0000 7ff63dd9b700 1 --2- 172.21.15.81:0/85030755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6400d02b0 0x7ff6400b0530 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ff6340011e0 tx=0x7ff634007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:11.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.305+0000 7ff62e7fc700 1 -- 172.21.15.81:0/85030755 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff634005a70 con 0x7ff6400d02b0 2023-10-07T08:49:11.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.305+0000 7ff62e7fc700 1 -- 172.21.15.81:0/85030755 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff634005bd0 con 0x7ff6400d02b0 2023-10-07T08:49:11.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.305+0000 7ff63f59e700 1 -- 172.21.15.81:0/85030755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff630009420 con 0x7ff6400d02b0 2023-10-07T08:49:11.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.305+0000 7ff62e7fc700 1 -- 172.21.15.81:0/85030755 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6340070d0 con 0x7ff6400d02b0 2023-10-07T08:49:11.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.305+0000 7ff63f59e700 1 -- 172.21.15.81:0/85030755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff640146b40 con 0x7ff6400d02b0 2023-10-07T08:49:11.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.306+0000 7ff63f59e700 1 -- 172.21.15.81:0/85030755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6400ae750 con 0x7ff6400d02b0 2023-10-07T08:49:11.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.306+0000 7ff62e7fc700 1 -- 172.21.15.81:0/85030755 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff634007480 con 0x7ff6400d02b0 2023-10-07T08:49:11.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.307+0000 7ff62e7fc700 1 --2- 172.21.15.81:0/85030755 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff620066f30 0x7ff6200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.307+0000 7ff63e59c700 1 --2- 172.21.15.81:0/85030755 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff620066f30 0x7ff6200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.307+0000 7ff62e7fc700 1 -- 172.21.15.81:0/85030755 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff634083740 con 0x7ff6400d02b0 2023-10-07T08:49:11.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.307+0000 7ff63e59c700 1 --2- 172.21.15.81:0/85030755 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff620066f30 0x7ff6200693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff6300093f0 tx=0x7ff630017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:11.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.311+0000 7ff62e7fc700 1 -- 172.21.15.81:0/85030755 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff634050d00 con 0x7ff6400d02b0 2023-10-07T08:49:11.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.494+0000 7ff63f59e700 1 -- 172.21.15.81:0/85030755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6400676e0 con 0x7ff6400d02b0 2023-10-07T08:49:11.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.494+0000 7ff62e7fc700 1 -- 172.21.15.81:0/85030755 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v134) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff634017020 con 0x7ff6400d02b0 2023-10-07T08:49:11.496 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:49:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.496+0000 7ff63f59e700 1 -- 172.21.15.81:0/85030755 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff620066f30 msgr2=0x7ff6200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.496+0000 7ff63f59e700 1 --2- 172.21.15.81:0/85030755 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff620066f30 0x7ff6200693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff6300093f0 tx=0x7ff630017000 comp rx=0 tx=0).stop 2023-10-07T08:49:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.496+0000 7ff63f59e700 1 -- 172.21.15.81:0/85030755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6400d02b0 msgr2=0x7ff6400b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.496+0000 7ff63f59e700 1 --2- 172.21.15.81:0/85030755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6400d02b0 0x7ff6400b0530 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ff6340011e0 tx=0x7ff634007e10 comp rx=0 tx=0).stop 2023-10-07T08:49:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.496+0000 7ff63f59e700 1 -- 172.21.15.81:0/85030755 shutdown_connections 2023-10-07T08:49:11.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.496+0000 7ff63f59e700 1 --2- 172.21.15.81:0/85030755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6400d0b80 0x7ff6400b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.496+0000 7ff63f59e700 1 --2- 172.21.15.81:0/85030755 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff620066f30 0x7ff6200693e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.496+0000 7ff63f59e700 1 --2- 172.21.15.81:0/85030755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff64006d700 0x7ff640146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.496+0000 7ff63f59e700 1 --2- 172.21.15.81:0/85030755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6400d02b0 0x7ff6400b0530 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.496+0000 7ff63f59e700 1 -- 172.21.15.81:0/85030755 >> 172.21.15.81:0/85030755 conn(0x7ff640063230 msgr2=0x7ff6400b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:11.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.496+0000 7ff63f59e700 1 -- 172.21.15.81:0/85030755 shutdown_connections 2023-10-07T08:49:11.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.496+0000 7ff63f59e700 1 -- 172.21.15.81:0/85030755 wait complete. 2023-10-07T08:49:11.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T08:49:11.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.623+0000 7fd363ccd700 1 Processor -- start 2023-10-07T08:49:11.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.623+0000 7fd363ccd700 1 -- start start 2023-10-07T08:49:11.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.624+0000 7fd363ccd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd35c0aeea0 0x7fd35c0c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.624+0000 7fd363ccd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd35c0af270 0x7fd35c0c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.624+0000 7fd363ccd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35c06aae0 con 0x7fd35c0c7d00 2023-10-07T08:49:11.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.624+0000 7fd363ccd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35c069ed0 con 0x7fd35c0aeea0 2023-10-07T08:49:11.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.624+0000 7fd363ccd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c06a1b0 con 0x7fd35c0af270 2023-10-07T08:49:11.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.624+0000 7fd361268700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd35c0af270 0x7fd35c0c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.624+0000 7fd361a69700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd35c0aeea0 0x7fd35c0c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.624+0000 7fd361268700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd35c0af270 0x7fd35c0c2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:56230/0 (socket says 172.21.15.81:56230) 2023-10-07T08:49:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.624+0000 7fd361268700 1 -- 172.21.15.81:0/695536424 learned_addr learned my addr 172.21.15.81:0/695536424 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.624+0000 7fd36226a700 1 --1- 172.21.15.81:0/695536424 >> v1:172.21.15.89:6789/0 conn(0x7fd35c0c7d00 0x7fd35c0c8140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:41290/0 (socket says 172.21.15.81:41290) 2023-10-07T08:49:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.624+0000 7fd361a69700 1 -- 172.21.15.81:0/695536424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd35c0af270 msgr2=0x7fd35c0c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.624+0000 7fd361a69700 1 --2- 172.21.15.81:0/695536424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd35c0af270 0x7fd35c0c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.624+0000 7fd361a69700 1 -- 172.21.15.81:0/695536424 >> v1:172.21.15.89:6789/0 conn(0x7fd35c0c7d00 legacy=0x7fd35c0c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.624+0000 7fd361a69700 1 -- 172.21.15.81:0/695536424 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c06a490 con 0x7fd35c0aeea0 2023-10-07T08:49:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.624+0000 7fd360a67700 1 -- 172.21.15.81:0/695536424 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140372537 0 0) 0x7fd35c06aae0 con 0x7fd35c0c7d00 2023-10-07T08:49:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.625+0000 7fd361a69700 1 --2- 172.21.15.81:0/695536424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd35c0aeea0 0x7fd35c0c2920 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd3580098e0 tx=0x7fd3580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8843c32e10a39ca server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.625+0000 7fd360a67700 1 -- 172.21.15.81:0/695536424 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35800b6d0 con 0x7fd35c0aeea0 2023-10-07T08:49:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.625+0000 7fd360a67700 1 -- 172.21.15.81:0/695536424 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35800b830 con 0x7fd35c0aeea0 2023-10-07T08:49:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.625+0000 7fd360a67700 1 -- 172.21.15.81:0/695536424 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35800bbd0 con 0x7fd35c0aeea0 2023-10-07T08:49:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.625+0000 7fd363ccd700 1 -- 172.21.15.81:0/695536424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd35c0aeea0 msgr2=0x7fd35c0c2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.625+0000 7fd363ccd700 1 --2- 172.21.15.81:0/695536424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd35c0aeea0 0x7fd35c0c2920 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd3580098e0 tx=0x7fd3580091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.625+0000 7fd363ccd700 1 -- 172.21.15.81:0/695536424 shutdown_connections 2023-10-07T08:49:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.625+0000 7fd363ccd700 1 --2- 172.21.15.81:0/695536424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd35c0aeea0 0x7fd35c0c2920 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.625+0000 7fd363ccd700 1 --2- 172.21.15.81:0/695536424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd35c0af270 0x7fd35c0c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.625+0000 7fd363ccd700 1 -- 172.21.15.81:0/695536424 >> 172.21.15.81:0/695536424 conn(0x7fd35c06c660 msgr2=0x7fd35c0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.625+0000 7fd363ccd700 1 -- 172.21.15.81:0/695536424 shutdown_connections 2023-10-07T08:49:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.625+0000 7fd363ccd700 1 -- 172.21.15.81:0/695536424 wait complete. 2023-10-07T08:49:11.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.626+0000 7fd363ccd700 1 Processor -- start 2023-10-07T08:49:11.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.627+0000 7fd363ccd700 1 -- start start 2023-10-07T08:49:11.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.627+0000 7fd363ccd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd35c0aeea0 0x7fd35c146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.627+0000 7fd363ccd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd35c0af270 0x7fd35c156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.627+0000 7fd363ccd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd35c0c7d00 0x7fd35c144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.627+0000 7fd363ccd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c14d330 con 0x7fd35c0af270 2023-10-07T08:49:11.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.627+0000 7fd363ccd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c16ab40 con 0x7fd35c0c7d00 2023-10-07T08:49:11.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.627+0000 7fd363ccd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c16ae20 con 0x7fd35c0aeea0 2023-10-07T08:49:11.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.627+0000 7fd361268700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd35c0af270 0x7fd35c156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.627+0000 7fd361268700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd35c0af270 0x7fd35c156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40108/0 (socket says 172.21.15.81:40108) 2023-10-07T08:49:11.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.627+0000 7fd361268700 1 -- 172.21.15.81:0/475172234 learned_addr learned my addr 172.21.15.81:0/475172234 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:11.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.628+0000 7fd361a69700 1 --2- 172.21.15.81:0/475172234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd35c0aeea0 0x7fd35c146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.628+0000 7fd36226a700 1 --2- 172.21.15.81:0/475172234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd35c0c7d00 0x7fd35c144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.628+0000 7fd361268700 1 -- 172.21.15.81:0/475172234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd35c0aeea0 msgr2=0x7fd35c146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.628+0000 7fd361268700 1 --2- 172.21.15.81:0/475172234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd35c0aeea0 0x7fd35c146280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.628+0000 7fd361268700 1 -- 172.21.15.81:0/475172234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd35c0c7d00 msgr2=0x7fd35c144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.628+0000 7fd361268700 1 --2- 172.21.15.81:0/475172234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd35c0c7d00 0x7fd35c144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.628+0000 7fd361268700 1 -- 172.21.15.81:0/475172234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd358009420 con 0x7fd35c0af270 2023-10-07T08:49:11.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.628+0000 7fd36226a700 1 --2- 172.21.15.81:0/475172234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd35c0c7d00 0x7fd35c144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:11.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.628+0000 7fd361268700 1 --2- 172.21.15.81:0/475172234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd35c0af270 0x7fd35c156290 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00ea50 tx=0x7fd34c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:11.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.628+0000 7fd351ffb700 1 -- 172.21.15.81:0/475172234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c00c850 con 0x7fd35c0af270 2023-10-07T08:49:11.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.628+0000 7fd351ffb700 1 -- 172.21.15.81:0/475172234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c00c9b0 con 0x7fd35c0af270 2023-10-07T08:49:11.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.628+0000 7fd363ccd700 1 -- 172.21.15.81:0/475172234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35c16b100 con 0x7fd35c0af270 2023-10-07T08:49:11.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.628+0000 7fd351ffb700 1 -- 172.21.15.81:0/475172234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c00cd30 con 0x7fd35c0af270 2023-10-07T08:49:11.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.628+0000 7fd363ccd700 1 -- 172.21.15.81:0/475172234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35c16b6c0 con 0x7fd35c0af270 2023-10-07T08:49:11.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.629+0000 7fd363ccd700 1 -- 172.21.15.81:0/475172234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35c067bc0 con 0x7fd35c0af270 2023-10-07T08:49:11.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.630+0000 7fd351ffb700 1 -- 172.21.15.81:0/475172234 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd34c013680 con 0x7fd35c0af270 2023-10-07T08:49:11.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.630+0000 7fd351ffb700 1 --2- 172.21.15.81:0/475172234 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd340066f30 0x7fd3400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.630+0000 7fd351ffb700 1 -- 172.21.15.81:0/475172234 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd34c0844a0 con 0x7fd35c0af270 2023-10-07T08:49:11.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.630+0000 7fd361a69700 1 --2- 172.21.15.81:0/475172234 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd340066f30 0x7fd3400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.630+0000 7fd361a69700 1 --2- 172.21.15.81:0/475172234 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd340066f30 0x7fd3400693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd3580093f0 tx=0x7fd358017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:11.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.634+0000 7fd351ffb700 1 -- 172.21.15.81:0/475172234 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd34c051a60 con 0x7fd35c0af270 2023-10-07T08:49:11.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.818+0000 7fd363ccd700 1 -- 172.21.15.81:0/475172234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd35c04bb80 con 0x7fd35c0af270 2023-10-07T08:49:11.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.818+0000 7fd351ffb700 1 -- 172.21.15.81:0/475172234 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v134) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd34c055080 con 0x7fd35c0af270 2023-10-07T08:49:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:11.819 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-07T08:49:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-07T08:49:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-07T08:49:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:11.820 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-07T08:49:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.820+0000 7fd363ccd700 1 -- 172.21.15.81:0/475172234 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd340066f30 msgr2=0x7fd3400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.820+0000 7fd363ccd700 1 --2- 172.21.15.81:0/475172234 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd340066f30 0x7fd3400693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd3580093f0 tx=0x7fd358017000 comp rx=0 tx=0).stop 2023-10-07T08:49:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.820+0000 7fd363ccd700 1 -- 172.21.15.81:0/475172234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd35c0af270 msgr2=0x7fd35c156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.820+0000 7fd363ccd700 1 --2- 172.21.15.81:0/475172234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd35c0af270 0x7fd35c156290 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00ea50 tx=0x7fd34c009250 comp rx=0 tx=0).stop 2023-10-07T08:49:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.820+0000 7fd363ccd700 1 -- 172.21.15.81:0/475172234 shutdown_connections 2023-10-07T08:49:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.820+0000 7fd363ccd700 1 --2- 172.21.15.81:0/475172234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd35c0c7d00 0x7fd35c144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.820+0000 7fd363ccd700 1 --2- 172.21.15.81:0/475172234 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd340066f30 0x7fd3400693e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.820+0000 7fd363ccd700 1 --2- 172.21.15.81:0/475172234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd35c0aeea0 0x7fd35c146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.820+0000 7fd363ccd700 1 --2- 172.21.15.81:0/475172234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd35c0af270 0x7fd35c156290 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.820+0000 7fd363ccd700 1 -- 172.21.15.81:0/475172234 >> 172.21.15.81:0/475172234 conn(0x7fd35c06c660 msgr2=0x7fd35c0cb060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:11.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.820+0000 7fd363ccd700 1 -- 172.21.15.81:0/475172234 shutdown_connections 2023-10-07T08:49:11.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.820+0000 7fd363ccd700 1 -- 172.21.15.81:0/475172234 wait complete. 2023-10-07T08:49:11.834 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T08:49:11.834 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T08:49:11.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.951+0000 7f1f3058f700 1 Processor -- start 2023-10-07T08:49:11.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.951+0000 7f1f3058f700 1 -- start start 2023-10-07T08:49:11.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.952+0000 7f1f3058f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1f281578d0 0x7f1f280cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.952+0000 7f1f3058f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f28157ca0 0x7f1f2815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.952+0000 7f1f3058f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f280d07c0 con 0x7f1f2806d120 2023-10-07T08:49:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.952+0000 7f1f3058f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f280cfbb0 con 0x7f1f28157ca0 2023-10-07T08:49:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.952+0000 7f1f3058f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f280cfe90 con 0x7f1f281578d0 2023-10-07T08:49:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.952+0000 7f1f2db2a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f28157ca0 0x7f1f2815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.952+0000 7f1f2eb2c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1f2806d120 0x7f1f2806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42866/0 (socket says 172.21.15.81:42866) 2023-10-07T08:49:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.952+0000 7f1f2eb2c700 1 -- 172.21.15.81:0/447988439 learned_addr learned my addr 172.21.15.81:0/447988439 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:11.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.952+0000 7f1f2e32b700 1 --2- 172.21.15.81:0/447988439 >> v2:172.21.15.89:3300/0 conn(0x7f1f281578d0 0x7f1f280cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.952+0000 7f1f2db2a700 1 -- 172.21.15.81:0/447988439 >> v2:172.21.15.89:3300/0 conn(0x7f1f281578d0 msgr2=0x7f1f280cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:11.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.952+0000 7f1f2db2a700 1 --2- 172.21.15.81:0/447988439 >> v2:172.21.15.89:3300/0 conn(0x7f1f281578d0 0x7f1f280cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.952+0000 7f1f2db2a700 1 -- 172.21.15.81:0/447988439 >> v1:172.21.15.81:6789/0 conn(0x7f1f2806d120 legacy=0x7f1f2806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.952+0000 7f1f2db2a700 1 -- 172.21.15.81:0/447988439 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f280d0170 con 0x7f1f28157ca0 2023-10-07T08:49:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.952+0000 7f1f2d329700 1 -- 172.21.15.81:0/447988439 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179420054 0 0) 0x7f1f280d07c0 con 0x7f1f2806d120 2023-10-07T08:49:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.952+0000 7f1f2e32b700 1 --2- 172.21.15.81:0/447988439 >> v2:172.21.15.89:3300/0 conn(0x7f1f281578d0 0x7f1f280cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.952+0000 7f1f2db2a700 1 --2- 172.21.15.81:0/447988439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f28157ca0 0x7f1f2815af00 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1f280646b0 tx=0x7f1f180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4e97967c4d3609 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.953+0000 7f1f2d329700 1 -- 172.21.15.81:0/447988439 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1800b6b0 con 0x7f1f28157ca0 2023-10-07T08:49:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.953+0000 7f1f2d329700 1 -- 172.21.15.81:0/447988439 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1800b810 con 0x7f1f28157ca0 2023-10-07T08:49:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.953+0000 7f1f2d329700 1 -- 172.21.15.81:0/447988439 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1800bbb0 con 0x7f1f28157ca0 2023-10-07T08:49:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.953+0000 7f1f3058f700 1 -- 172.21.15.81:0/447988439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f28157ca0 msgr2=0x7f1f2815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.953+0000 7f1f3058f700 1 --2- 172.21.15.81:0/447988439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f28157ca0 0x7f1f2815af00 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1f280646b0 tx=0x7f1f180091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.953+0000 7f1f3058f700 1 -- 172.21.15.81:0/447988439 shutdown_connections 2023-10-07T08:49:11.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.953+0000 7f1f3058f700 1 --2- 172.21.15.81:0/447988439 >> v2:172.21.15.89:3300/0 conn(0x7f1f281578d0 0x7f1f280cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.953+0000 7f1f3058f700 1 --2- 172.21.15.81:0/447988439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f28157ca0 0x7f1f2815af00 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.953+0000 7f1f3058f700 1 -- 172.21.15.81:0/447988439 >> 172.21.15.81:0/447988439 conn(0x7f1f2806bb90 msgr2=0x7f1f2806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.953+0000 7f1f3058f700 1 -- 172.21.15.81:0/447988439 shutdown_connections 2023-10-07T08:49:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.953+0000 7f1f3058f700 1 -- 172.21.15.81:0/447988439 wait complete. 2023-10-07T08:49:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.954+0000 7f1f3058f700 1 Processor -- start 2023-10-07T08:49:11.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.954+0000 7f1f3058f700 1 -- start start 2023-10-07T08:49:11.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f3058f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f2806d120 0x7f1f28155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f3058f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f281578d0 0x7f1f280aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f3058f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f28157ca0 0x7f1f280b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f3058f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f280adf60 con 0x7f1f281578d0 2023-10-07T08:49:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f3058f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f280b1800 con 0x7f1f2806d120 2023-10-07T08:49:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f3058f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f280b0bf0 con 0x7f1f28157ca0 2023-10-07T08:49:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f2db2a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f281578d0 0x7f1f280aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f2db2a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f281578d0 0x7f1f280aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40134/0 (socket says 172.21.15.81:40134) 2023-10-07T08:49:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f2db2a700 1 -- 172.21.15.81:0/2698556002 learned_addr learned my addr 172.21.15.81:0/2698556002 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:11.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f2e32b700 1 --2- 172.21.15.81:0/2698556002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f2806d120 0x7f1f28155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f2eb2c700 1 --2- 172.21.15.81:0/2698556002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f28157ca0 0x7f1f280b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f2db2a700 1 -- 172.21.15.81:0/2698556002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f28157ca0 msgr2=0x7f1f280b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f2db2a700 1 --2- 172.21.15.81:0/2698556002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f28157ca0 0x7f1f280b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f2db2a700 1 -- 172.21.15.81:0/2698556002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f2806d120 msgr2=0x7f1f28155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f2db2a700 1 --2- 172.21.15.81:0/2698556002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f2806d120 0x7f1f28155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f2db2a700 1 -- 172.21.15.81:0/2698556002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f18009420 con 0x7f1f281578d0 2023-10-07T08:49:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.955+0000 7f1f2e32b700 1 --2- 172.21.15.81:0/2698556002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f2806d120 0x7f1f28155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.956+0000 7f1f2db2a700 1 --2- 172.21.15.81:0/2698556002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f281578d0 0x7f1f280aa890 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1f18013000 tx=0x7f1f18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.956+0000 7f1f1e7fc700 1 -- 172.21.15.81:0/2698556002 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1800bb90 con 0x7f1f281578d0 2023-10-07T08:49:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.956+0000 7f1f1e7fc700 1 -- 172.21.15.81:0/2698556002 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f18011420 con 0x7f1f281578d0 2023-10-07T08:49:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.956+0000 7f1f3058f700 1 -- 172.21.15.81:0/2698556002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f280b0ed0 con 0x7f1f281578d0 2023-10-07T08:49:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.956+0000 7f1f1e7fc700 1 -- 172.21.15.81:0/2698556002 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f180117c0 con 0x7f1f281578d0 2023-10-07T08:49:11.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.956+0000 7f1f3058f700 1 -- 172.21.15.81:0/2698556002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f280b1490 con 0x7f1f281578d0 2023-10-07T08:49:11.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.957+0000 7f1f3058f700 1 -- 172.21.15.81:0/2698556002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2815ea50 con 0x7f1f281578d0 2023-10-07T08:49:11.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.957+0000 7f1f1e7fc700 1 -- 172.21.15.81:0/2698556002 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f18011b70 con 0x7f1f281578d0 2023-10-07T08:49:11.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.957+0000 7f1f1e7fc700 1 --2- 172.21.15.81:0/2698556002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1f0c066f30 0x7f1f0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:11.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.957+0000 7f1f1e7fc700 1 -- 172.21.15.81:0/2698556002 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1f18085730 con 0x7f1f281578d0 2023-10-07T08:49:11.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.957+0000 7f1f2e32b700 1 --2- 172.21.15.81:0/2698556002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1f0c066f30 0x7f1f0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:11.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.958+0000 7f1f2e32b700 1 --2- 172.21.15.81:0/2698556002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1f0c066f30 0x7f1f0c0693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1f240076e0 tx=0x7f1f240098f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:11.962+0000 7f1f1e7fc700 1 -- 172.21.15.81:0/2698556002 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f18052cf0 con 0x7f1f281578d0 2023-10-07T08:49:12.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.144+0000 7f1f3058f700 1 -- 172.21.15.81:0/2698556002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1f280b1940 con 0x7f1f281578d0 2023-10-07T08:49:12.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.454+0000 7f1f1e7fc700 1 -- 172.21.15.81:0/2698556002 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v135) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1f18056310 con 0x7f1f281578d0 2023-10-07T08:49:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.458+0000 7f1f3058f700 1 -- 172.21.15.81:0/2698556002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1f0c066f30 msgr2=0x7f1f0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.458+0000 7f1f3058f700 1 --2- 172.21.15.81:0/2698556002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1f0c066f30 0x7f1f0c0693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1f240076e0 tx=0x7f1f240098f0 comp rx=0 tx=0).stop 2023-10-07T08:49:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.459+0000 7f1f3058f700 1 -- 172.21.15.81:0/2698556002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f281578d0 msgr2=0x7f1f280aa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:12.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.459+0000 7f1f3058f700 1 --2- 172.21.15.81:0/2698556002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f281578d0 0x7f1f280aa890 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1f18013000 tx=0x7f1f18017000 comp rx=0 tx=0).stop 2023-10-07T08:49:12.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.459+0000 7f1f3058f700 1 -- 172.21.15.81:0/2698556002 shutdown_connections 2023-10-07T08:49:12.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.459+0000 7f1f3058f700 1 --2- 172.21.15.81:0/2698556002 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1f0c066f30 0x7f1f0c0693e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:12.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.459+0000 7f1f3058f700 1 --2- 172.21.15.81:0/2698556002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f28157ca0 0x7f1f280b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:12.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.459+0000 7f1f3058f700 1 --2- 172.21.15.81:0/2698556002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f2806d120 0x7f1f28155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:12.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.459+0000 7f1f3058f700 1 --2- 172.21.15.81:0/2698556002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f281578d0 0x7f1f280aa890 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:12.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.459+0000 7f1f3058f700 1 -- 172.21.15.81:0/2698556002 >> 172.21.15.81:0/2698556002 conn(0x7f1f2806bb90 msgr2=0x7f1f28069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:12.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.459+0000 7f1f3058f700 1 -- 172.21.15.81:0/2698556002 shutdown_connections 2023-10-07T08:49:12.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.459+0000 7f1f3058f700 1 -- 172.21.15.81:0/2698556002 wait complete. 2023-10-07T08:49:12.462 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-07T08:49:12.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T08:49:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.593+0000 7f87cd8be700 1 Processor -- start 2023-10-07T08:49:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.593+0000 7f87cd8be700 1 -- start start 2023-10-07T08:49:12.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.594+0000 7f87cd8be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87c815a0f0 0x7f87c80c3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:12.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.594+0000 7f87cd8be700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87c80caaa0 0x7f87c80c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:12.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.594+0000 7f87cd8be700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c8069b30 con 0x7f87c815a4c0 2023-10-07T08:49:12.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.594+0000 7f87cd8be700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c806a970 con 0x7f87c80caaa0 2023-10-07T08:49:12.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.594+0000 7f87cd8be700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c8069d60 con 0x7f87c815a0f0 2023-10-07T08:49:12.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.594+0000 7f87cd0bd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87c80caaa0 0x7f87c80c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:12.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.594+0000 7f87c7fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f87c815a4c0 0x7f87c80ca390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34920/0 (socket says 172.21.15.81:34920) 2023-10-07T08:49:12.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.594+0000 7f87c7fff700 1 -- 172.21.15.81:0/1548688037 learned_addr learned my addr 172.21.15.81:0/1548688037 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:12.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.594+0000 7f87cc8bc700 1 --2- 172.21.15.81:0/1548688037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87c815a0f0 0x7f87c80c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.594+0000 7f87cd0bd700 1 -- 172.21.15.81:0/1548688037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87c815a0f0 msgr2=0x7f87c80c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.594+0000 7f87cd0bd700 1 --2- 172.21.15.81:0/1548688037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87c815a0f0 0x7f87c80c3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.594+0000 7f87cd0bd700 1 -- 172.21.15.81:0/1548688037 >> v1:172.21.15.81:6789/0 conn(0x7f87c815a4c0 legacy=0x7f87c80ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.594+0000 7f87cd0bd700 1 -- 172.21.15.81:0/1548688037 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c806a040 con 0x7f87c80caaa0 2023-10-07T08:49:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.594+0000 7f87c77fe700 1 -- 172.21.15.81:0/1548688037 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737770394 0 0) 0x7f87c8069b30 con 0x7f87c815a4c0 2023-10-07T08:49:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.594+0000 7f87cd0bd700 1 --2- 172.21.15.81:0/1548688037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c80caaa0 0x7f87c80c35a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f87b80098e0 tx=0x7f87b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c74dda2073255ab server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.595+0000 7f87c77fe700 1 -- 172.21.15.81:0/1548688037 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b8009e80 con 0x7f87c80caaa0 2023-10-07T08:49:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.595+0000 7f87c77fe700 1 -- 172.21.15.81:0/1548688037 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b800b860 con 0x7f87c80caaa0 2023-10-07T08:49:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.595+0000 7f87c77fe700 1 -- 172.21.15.81:0/1548688037 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800bbe0 con 0x7f87c80caaa0 2023-10-07T08:49:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.595+0000 7f87cd8be700 1 -- 172.21.15.81:0/1548688037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c80caaa0 msgr2=0x7f87c80c35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.595+0000 7f87cd8be700 1 --2- 172.21.15.81:0/1548688037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c80caaa0 0x7f87c80c35a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f87b80098e0 tx=0x7f87b80091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.595+0000 7f87cd8be700 1 -- 172.21.15.81:0/1548688037 shutdown_connections 2023-10-07T08:49:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.595+0000 7f87cd8be700 1 --2- 172.21.15.81:0/1548688037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c80caaa0 0x7f87c80c35a0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.595+0000 7f87cd8be700 1 --2- 172.21.15.81:0/1548688037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87c815a0f0 0x7f87c80c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.595+0000 7f87cd8be700 1 -- 172.21.15.81:0/1548688037 >> 172.21.15.81:0/1548688037 conn(0x7f87c806cca0 msgr2=0x7f87c806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.595+0000 7f87cd8be700 1 -- 172.21.15.81:0/1548688037 shutdown_connections 2023-10-07T08:49:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.595+0000 7f87cd8be700 1 -- 172.21.15.81:0/1548688037 wait complete. 2023-10-07T08:49:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.596+0000 7f87cd8be700 1 Processor -- start 2023-10-07T08:49:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.597+0000 7f87cd8be700 1 -- start start 2023-10-07T08:49:12.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.597+0000 7f87cd8be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87c80caaa0 0x7f87c8168a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:12.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.597+0000 7f87cd8be700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c815a0f0 0x7f87c816bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:12.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.597+0000 7f87cd8be700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87c815a4c0 0x7f87c806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:12.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.597+0000 7f87cd8be700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c816b5c0 con 0x7f87c815a0f0 2023-10-07T08:49:12.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.597+0000 7f87cd8be700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c8168fc0 con 0x7f87c815a4c0 2023-10-07T08:49:12.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.597+0000 7f87cd8be700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c816c510 con 0x7f87c80caaa0 2023-10-07T08:49:12.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.597+0000 7f87c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c815a0f0 0x7f87c816bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:12.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.597+0000 7f87c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c815a0f0 0x7f87c816bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34050/0 (socket says 172.21.15.81:34050) 2023-10-07T08:49:12.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.597+0000 7f87c7fff700 1 -- 172.21.15.81:0/3480910617 learned_addr learned my addr 172.21.15.81:0/3480910617 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:12.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.597+0000 7f87cd0bd700 1 --2- 172.21.15.81:0/3480910617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87c815a4c0 0x7f87c806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:12.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.597+0000 7f87cc8bc700 1 --2- 172.21.15.81:0/3480910617 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87c80caaa0 0x7f87c8168a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:12.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.598+0000 7f87c7fff700 1 -- 172.21.15.81:0/3480910617 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87c80caaa0 msgr2=0x7f87c8168a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:12.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.598+0000 7f87c7fff700 1 --2- 172.21.15.81:0/3480910617 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87c80caaa0 0x7f87c8168a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:12.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.598+0000 7f87c7fff700 1 -- 172.21.15.81:0/3480910617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87c815a4c0 msgr2=0x7f87c806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:12.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.598+0000 7f87c7fff700 1 --2- 172.21.15.81:0/3480910617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87c815a4c0 0x7f87c806bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:12.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.598+0000 7f87c7fff700 1 -- 172.21.15.81:0/3480910617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b8009420 con 0x7f87c815a0f0 2023-10-07T08:49:12.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.598+0000 7f87c7fff700 1 --2- 172.21.15.81:0/3480910617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c815a0f0 0x7f87c816bfd0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00c5e0 tx=0x7f87bc001000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:12.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.598+0000 7f87c4ff9700 1 -- 172.21.15.81:0/3480910617 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc005b30 con 0x7f87c815a0f0 2023-10-07T08:49:12.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.598+0000 7f87c4ff9700 1 -- 172.21.15.81:0/3480910617 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87bc005c90 con 0x7f87c815a0f0 2023-10-07T08:49:12.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.598+0000 7f87cd8be700 1 -- 172.21.15.81:0/3480910617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c80b2d90 con 0x7f87c815a0f0 2023-10-07T08:49:12.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.598+0000 7f87c4ff9700 1 -- 172.21.15.81:0/3480910617 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc007300 con 0x7f87c815a0f0 2023-10-07T08:49:12.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.598+0000 7f87cd8be700 1 -- 172.21.15.81:0/3480910617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c816b7d0 con 0x7f87c815a0f0 2023-10-07T08:49:12.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.599+0000 7f87cd8be700 1 -- 172.21.15.81:0/3480910617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c8068670 con 0x7f87c815a0f0 2023-10-07T08:49:12.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.599+0000 7f87c4ff9700 1 -- 172.21.15.81:0/3480910617 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87bc01b3b0 con 0x7f87c815a0f0 2023-10-07T08:49:12.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.600+0000 7f87c4ff9700 1 --2- 172.21.15.81:0/3480910617 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f87b4066f30 0x7f87b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:12.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.600+0000 7f87c4ff9700 1 -- 172.21.15.81:0/3480910617 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f87bc0835c0 con 0x7f87c815a0f0 2023-10-07T08:49:12.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.600+0000 7f87cc8bc700 1 --2- 172.21.15.81:0/3480910617 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f87b4066f30 0x7f87b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:12.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.600+0000 7f87cc8bc700 1 --2- 172.21.15.81:0/3480910617 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f87b4066f30 0x7f87b40693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f87c000f610 tx=0x7f87c00077f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:12.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.604+0000 7f87c4ff9700 1 -- 172.21.15.81:0/3480910617 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87bc050a10 con 0x7f87c815a0f0 2023-10-07T08:49:12.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:12.787+0000 7f87cd8be700 1 -- 172.21.15.81:0/3480910617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f87c80b2d90 con 0x7f87c815a0f0 2023-10-07T08:49:13.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.463+0000 7f87c4ff9700 1 -- 172.21.15.81:0/3480910617 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v136) v1 ==== 170+0+0 (secure 0 0 0) 0x7f87c80b2d90 con 0x7f87c815a0f0 2023-10-07T08:49:13.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.468+0000 7f87cd8be700 1 -- 172.21.15.81:0/3480910617 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f87b4066f30 msgr2=0x7f87b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:13.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.468+0000 7f87cd8be700 1 --2- 172.21.15.81:0/3480910617 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f87b4066f30 0x7f87b40693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f87c000f610 tx=0x7f87c00077f0 comp rx=0 tx=0).stop 2023-10-07T08:49:13.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.468+0000 7f87cd8be700 1 -- 172.21.15.81:0/3480910617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c815a0f0 msgr2=0x7f87c816bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:13.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.468+0000 7f87cd8be700 1 --2- 172.21.15.81:0/3480910617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c815a0f0 0x7f87c816bfd0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00c5e0 tx=0x7f87bc001000 comp rx=0 tx=0).stop 2023-10-07T08:49:13.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.470+0000 7f87cd8be700 1 -- 172.21.15.81:0/3480910617 shutdown_connections 2023-10-07T08:49:13.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.470+0000 7f87cd8be700 1 --2- 172.21.15.81:0/3480910617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87c815a4c0 0x7f87c806bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:13.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.470+0000 7f87cd8be700 1 --2- 172.21.15.81:0/3480910617 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f87b4066f30 0x7f87b40693e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:13.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.470+0000 7f87cd8be700 1 --2- 172.21.15.81:0/3480910617 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87c80caaa0 0x7f87c8168a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:13.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.470+0000 7f87cd8be700 1 --2- 172.21.15.81:0/3480910617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c815a0f0 0x7f87c816bfd0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:13.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.470+0000 7f87cd8be700 1 -- 172.21.15.81:0/3480910617 >> 172.21.15.81:0/3480910617 conn(0x7f87c806cca0 msgr2=0x7f87c8157110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:13.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.471+0000 7f87cd8be700 1 -- 172.21.15.81:0/3480910617 shutdown_connections 2023-10-07T08:49:13.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.471+0000 7f87cd8be700 1 -- 172.21.15.81:0/3480910617 wait complete. 2023-10-07T08:49:13.474 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-07T08:49:13.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T08:49:13.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.606+0000 7f80ff59e700 1 Processor -- start 2023-10-07T08:49:13.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.606+0000 7f80ff59e700 1 -- start start 2023-10-07T08:49:13.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.607+0000 7f80ff59e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f81000cddd0 0x7f81000cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:13.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.607+0000 7f80ff59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f81000cb240 0x7f81000cb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:13.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.607+0000 7f80ff59e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81000cadb0 con 0x7f81000b43c0 2023-10-07T08:49:13.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.607+0000 7f80ff59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81000cf000 con 0x7f81000cb240 2023-10-07T08:49:13.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.607+0000 7f80ff59e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81000cf2e0 con 0x7f81000cddd0 2023-10-07T08:49:13.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.607+0000 7f80fed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f81000cb240 0x7f81000cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.607+0000 7f80fed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f81000cb240 0x7f81000cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34060/0 (socket says 172.21.15.81:34060) 2023-10-07T08:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.607+0000 7f80fed9d700 1 -- 172.21.15.81:0/2324442486 learned_addr learned my addr 172.21.15.81:0/2324442486 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.607+0000 7f80fdd9b700 1 --2- 172.21.15.81:0/2324442486 >> v2:172.21.15.89:3300/0 conn(0x7f81000cddd0 0x7f81000cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.607+0000 7f80fed9d700 1 -- 172.21.15.81:0/2324442486 >> v2:172.21.15.89:3300/0 conn(0x7f81000cddd0 msgr2=0x7f81000cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.607+0000 7f80fed9d700 1 --2- 172.21.15.81:0/2324442486 >> v2:172.21.15.89:3300/0 conn(0x7f81000cddd0 0x7f81000cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.607+0000 7f80fed9d700 1 -- 172.21.15.81:0/2324442486 >> v1:172.21.15.89:6789/0 conn(0x7f81000b43c0 legacy=0x7f81000cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.607+0000 7f80fed9d700 1 -- 172.21.15.81:0/2324442486 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81000ca760 con 0x7f81000cb240 2023-10-07T08:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.607+0000 7f80fdd9b700 1 --2- 172.21.15.81:0/2324442486 >> v2:172.21.15.89:3300/0 conn(0x7f81000cddd0 0x7f81000cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.608+0000 7f80fed9d700 1 --2- 172.21.15.81:0/2324442486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81000cb240 0x7f81000cb680 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f8100064440 tx=0x7f80f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d8e2e68ece312c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.608+0000 7f80fd59a700 1 -- 172.21.15.81:0/2324442486 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f800b820 con 0x7f81000cb240 2023-10-07T08:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.608+0000 7f80fd59a700 1 -- 172.21.15.81:0/2324442486 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f800b980 con 0x7f81000cb240 2023-10-07T08:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.608+0000 7f80fd59a700 1 -- 172.21.15.81:0/2324442486 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f800bd20 con 0x7f81000cb240 2023-10-07T08:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.608+0000 7f80ff59e700 1 -- 172.21.15.81:0/2324442486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81000cb240 msgr2=0x7f81000cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.608+0000 7f80ff59e700 1 --2- 172.21.15.81:0/2324442486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81000cb240 0x7f81000cb680 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f8100064440 tx=0x7f80f8009250 comp rx=0 tx=0).stop 2023-10-07T08:49:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.608+0000 7f80ff59e700 1 -- 172.21.15.81:0/2324442486 shutdown_connections 2023-10-07T08:49:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.608+0000 7f80ff59e700 1 --2- 172.21.15.81:0/2324442486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81000cb240 0x7f81000cb680 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.608+0000 7f80ff59e700 1 --2- 172.21.15.81:0/2324442486 >> v2:172.21.15.89:3300/0 conn(0x7f81000cddd0 0x7f81000cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.608+0000 7f80ff59e700 1 -- 172.21.15.81:0/2324442486 >> 172.21.15.81:0/2324442486 conn(0x7f8100068110 msgr2=0x7f810006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.608+0000 7f80ff59e700 1 -- 172.21.15.81:0/2324442486 shutdown_connections 2023-10-07T08:49:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.608+0000 7f80ff59e700 1 -- 172.21.15.81:0/2324442486 wait complete. 2023-10-07T08:49:13.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.609+0000 7f80ff59e700 1 Processor -- start 2023-10-07T08:49:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.609+0000 7f80ff59e700 1 -- start start 2023-10-07T08:49:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80ff59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81000b43c0 0x7f8100169270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80ff59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81000cb240 0x7f810016af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80ff59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81000cddd0 0x7f81000c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80ff59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810016b4d0 con 0x7f81000b43c0 2023-10-07T08:49:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80ff59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810015aef0 con 0x7f81000cb240 2023-10-07T08:49:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80ff59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81000c6180 con 0x7f81000cddd0 2023-10-07T08:49:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80fe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81000b43c0 0x7f8100169270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80fe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81000b43c0 0x7f8100169270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34076/0 (socket says 172.21.15.81:34076) 2023-10-07T08:49:13.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80fe59c700 1 -- 172.21.15.81:0/1005384964 learned_addr learned my addr 172.21.15.81:0/1005384964 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:13.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80fdd9b700 1 --2- 172.21.15.81:0/1005384964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81000cb240 0x7f810016af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:13.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80fed9d700 1 --2- 172.21.15.81:0/1005384964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81000cddd0 0x7f81000c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:13.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80fe59c700 1 -- 172.21.15.81:0/1005384964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81000cddd0 msgr2=0x7f81000c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:13.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80fe59c700 1 --2- 172.21.15.81:0/1005384964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81000cddd0 0x7f81000c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:13.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80fe59c700 1 -- 172.21.15.81:0/1005384964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81000cb240 msgr2=0x7f810016af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:13.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80fe59c700 1 --2- 172.21.15.81:0/1005384964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81000cb240 0x7f810016af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:13.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80fe59c700 1 -- 172.21.15.81:0/1005384964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f80094f0 con 0x7f81000b43c0 2023-10-07T08:49:13.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.610+0000 7f80fdd9b700 1 --2- 172.21.15.81:0/1005384964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81000cb240 0x7f810016af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:13.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.611+0000 7f80fe59c700 1 --2- 172.21.15.81:0/1005384964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81000b43c0 0x7f8100169270 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f80f000c950 tx=0x7f80f0002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:13.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.611+0000 7f80ee7fc700 1 -- 172.21.15.81:0/1005384964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f000a7e0 con 0x7f81000b43c0 2023-10-07T08:49:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.611+0000 7f80ee7fc700 1 -- 172.21.15.81:0/1005384964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f000a940 con 0x7f81000b43c0 2023-10-07T08:49:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.611+0000 7f80ff59e700 1 -- 172.21.15.81:0/1005384964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8100169000 con 0x7f81000b43c0 2023-10-07T08:49:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.611+0000 7f80ee7fc700 1 -- 172.21.15.81:0/1005384964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f000ad00 con 0x7f81000b43c0 2023-10-07T08:49:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.611+0000 7f80ff59e700 1 -- 172.21.15.81:0/1005384964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81000c5b30 con 0x7f81000b43c0 2023-10-07T08:49:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.612+0000 7f80ff59e700 1 -- 172.21.15.81:0/1005384964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8100069c00 con 0x7f81000b43c0 2023-10-07T08:49:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.612+0000 7f80ee7fc700 1 -- 172.21.15.81:0/1005384964 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80f0012630 con 0x7f81000b43c0 2023-10-07T08:49:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.613+0000 7f80ee7fc700 1 --2- 172.21.15.81:0/1005384964 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80e0066f30 0x7f80e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.613+0000 7f80ee7fc700 1 -- 172.21.15.81:0/1005384964 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f80f0084a30 con 0x7f81000b43c0 2023-10-07T08:49:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.613+0000 7f80fdd9b700 1 --2- 172.21.15.81:0/1005384964 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80e0066f30 0x7f80e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.613+0000 7f80fdd9b700 1 --2- 172.21.15.81:0/1005384964 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80e0066f30 0x7f80e00693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f80f4006fd0 tx=0x7f80f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:13.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.617+0000 7f80ee7fc700 1 -- 172.21.15.81:0/1005384964 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80f0051db0 con 0x7f81000b43c0 2023-10-07T08:49:13.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:13.843+0000 7f80ff59e700 1 -- 172.21.15.81:0/1005384964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f810015b260 con 0x7f81000b43c0 2023-10-07T08:49:14.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.476+0000 7f80ee7fc700 1 -- 172.21.15.81:0/1005384964 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v62) v1 ==== 174+0+0 (secure 0 0 0) 0x7f80f000ae60 con 0x7f81000b43c0 2023-10-07T08:49:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.484+0000 7f80ff59e700 1 -- 172.21.15.81:0/1005384964 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80e0066f30 msgr2=0x7f80e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.484+0000 7f80ff59e700 1 --2- 172.21.15.81:0/1005384964 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80e0066f30 0x7f80e00693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f80f4006fd0 tx=0x7f80f4008040 comp rx=0 tx=0).stop 2023-10-07T08:49:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.484+0000 7f80ff59e700 1 -- 172.21.15.81:0/1005384964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81000b43c0 msgr2=0x7f8100169270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.484+0000 7f80ff59e700 1 --2- 172.21.15.81:0/1005384964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81000b43c0 0x7f8100169270 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f80f000c950 tx=0x7f80f0002760 comp rx=0 tx=0).stop 2023-10-07T08:49:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.484+0000 7f80ff59e700 1 -- 172.21.15.81:0/1005384964 shutdown_connections 2023-10-07T08:49:14.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.484+0000 7f80ff59e700 1 --2- 172.21.15.81:0/1005384964 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80e0066f30 0x7f80e00693e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.484+0000 7f80ff59e700 1 --2- 172.21.15.81:0/1005384964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81000cddd0 0x7f81000c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.485+0000 7f80ff59e700 1 --2- 172.21.15.81:0/1005384964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81000b43c0 0x7f8100169270 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.485+0000 7f80ff59e700 1 --2- 172.21.15.81:0/1005384964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81000cb240 0x7f810016af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.485+0000 7f80ff59e700 1 -- 172.21.15.81:0/1005384964 >> 172.21.15.81:0/1005384964 conn(0x7f8100068110 msgr2=0x7f81000b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:14.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.485+0000 7f80ff59e700 1 -- 172.21.15.81:0/1005384964 shutdown_connections 2023-10-07T08:49:14.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.485+0000 7f80ff59e700 1 -- 172.21.15.81:0/1005384964 wait complete. 2023-10-07T08:49:14.487 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 16 and data pool 17 2023-10-07T08:49:14.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:49:14.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.611+0000 7f2b66d5f700 1 Processor -- start 2023-10-07T08:49:14.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.611+0000 7f2b66d5f700 1 -- start start 2023-10-07T08:49:14.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.612+0000 7f2b66d5f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2b60157ca0 0x7f2b600cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:14.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.612+0000 7f2b66d5f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b600d07c0 con 0x7f2b6006d120 2023-10-07T08:49:14.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.612+0000 7f2b66d5f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b600cfbb0 con 0x7f2b601578d0 2023-10-07T08:49:14.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.612+0000 7f2b66d5f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b600cfe90 con 0x7f2b60157ca0 2023-10-07T08:49:14.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.612+0000 7f2b652fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2b6006d120 0x7f2b6006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34936/0 (socket says 172.21.15.81:34936) 2023-10-07T08:49:14.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.612+0000 7f2b652fc700 1 -- 172.21.15.81:0/3294804261 learned_addr learned my addr 172.21.15.81:0/3294804261 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:14.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.612+0000 7f2b57fff700 1 --2- 172.21.15.81:0/3294804261 >> v2:172.21.15.89:3300/0 conn(0x7f2b60157ca0 0x7f2b600cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:14.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.613+0000 7f2b577fe700 1 -- 172.21.15.81:0/3294804261 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833224692 0 0) 0x7f2b600d07c0 con 0x7f2b6006d120 2023-10-07T08:49:14.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.613+0000 7f2b577fe700 1 -- 172.21.15.81:0/3294804261 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b48003570 con 0x7f2b6006d120 2023-10-07T08:49:14.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.613+0000 7f2b57fff700 1 -- 172.21.15.81:0/3294804261 >> v1:172.21.15.89:6789/0 conn(0x7f2b601578d0 legacy=0x7f2b6015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:14.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.613+0000 7f2b577fe700 1 -- 172.21.15.81:0/3294804261 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194579614 0 0) 0x7f2b600cfbb0 con 0x7f2b601578d0 2023-10-07T08:49:14.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.613+0000 7f2b57fff700 1 -- 172.21.15.81:0/3294804261 >> v1:172.21.15.81:6789/0 conn(0x7f2b6006d120 legacy=0x7f2b6006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:14.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.613+0000 7f2b57fff700 1 -- 172.21.15.81:0/3294804261 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b600d0170 con 0x7f2b60157ca0 2023-10-07T08:49:14.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.613+0000 7f2b57fff700 1 --2- 172.21.15.81:0/3294804261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60157ca0 0x7f2b600cf4f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2b500098e0 tx=0x7f2b500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94218420784f3662 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:14.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.613+0000 7f2b577fe700 1 -- 172.21.15.81:0/3294804261 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5000b640 con 0x7f2b60157ca0 2023-10-07T08:49:14.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.613+0000 7f2b577fe700 1 -- 172.21.15.81:0/3294804261 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5000b7a0 con 0x7f2b60157ca0 2023-10-07T08:49:14.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.613+0000 7f2b577fe700 1 -- 172.21.15.81:0/3294804261 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5000bb40 con 0x7f2b60157ca0 2023-10-07T08:49:14.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.614+0000 7f2b66d5f700 1 -- 172.21.15.81:0/3294804261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60157ca0 msgr2=0x7f2b600cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:14.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.614+0000 7f2b66d5f700 1 --2- 172.21.15.81:0/3294804261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60157ca0 0x7f2b600cf4f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2b500098e0 tx=0x7f2b500091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.614+0000 7f2b66d5f700 1 -- 172.21.15.81:0/3294804261 shutdown_connections 2023-10-07T08:49:14.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.614+0000 7f2b66d5f700 1 --2- 172.21.15.81:0/3294804261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60157ca0 0x7f2b600cf4f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.614+0000 7f2b66d5f700 1 -- 172.21.15.81:0/3294804261 >> 172.21.15.81:0/3294804261 conn(0x7f2b6006bb90 msgr2=0x7f2b6006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:14.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.614+0000 7f2b66d5f700 1 -- 172.21.15.81:0/3294804261 shutdown_connections 2023-10-07T08:49:14.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.614+0000 7f2b66d5f700 1 -- 172.21.15.81:0/3294804261 wait complete. 2023-10-07T08:49:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.615+0000 7f2b66d5f700 1 Processor -- start 2023-10-07T08:49:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.615+0000 7f2b66d5f700 1 -- start start 2023-10-07T08:49:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b66d5f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b6006d120 0x7f2b601525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b66d5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b601578d0 0x7f2b60152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b66d5f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60157ca0 0x7f2b6016ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:14.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b66d5f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b60153dd0 con 0x7f2b601578d0 2023-10-07T08:49:14.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b66d5f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b600b5510 con 0x7f2b60157ca0 2023-10-07T08:49:14.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b66d5f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b600b45d0 con 0x7f2b6006d120 2023-10-07T08:49:14.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b57fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b601578d0 0x7f2b60152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:14.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b57fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b601578d0 0x7f2b60152b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34092/0 (socket says 172.21.15.81:34092) 2023-10-07T08:49:14.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b57fff700 1 -- 172.21.15.81:0/466955506 learned_addr learned my addr 172.21.15.81:0/466955506 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:14.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b64afb700 1 --2- 172.21.15.81:0/466955506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b6006d120 0x7f2b601525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:14.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b652fc700 1 --2- 172.21.15.81:0/466955506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60157ca0 0x7f2b6016ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:14.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b57fff700 1 -- 172.21.15.81:0/466955506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b6006d120 msgr2=0x7f2b601525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:14.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b57fff700 1 --2- 172.21.15.81:0/466955506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b6006d120 0x7f2b601525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b57fff700 1 -- 172.21.15.81:0/466955506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60157ca0 msgr2=0x7f2b6016ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b57fff700 1 --2- 172.21.15.81:0/466955506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60157ca0 0x7f2b6016ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b57fff700 1 -- 172.21.15.81:0/466955506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b50009420 con 0x7f2b601578d0 2023-10-07T08:49:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b64afb700 1 --2- 172.21.15.81:0/466955506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b6006d120 0x7f2b601525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b652fc700 1 --2- 172.21.15.81:0/466955506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60157ca0 0x7f2b6016ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b57fff700 1 --2- 172.21.15.81:0/466955506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b601578d0 0x7f2b60152b20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f2b6006fe20 tx=0x7f2b50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b54ff9700 1 -- 172.21.15.81:0/466955506 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5001f070 con 0x7f2b601578d0 2023-10-07T08:49:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b54ff9700 1 -- 172.21.15.81:0/466955506 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5000b910 con 0x7f2b601578d0 2023-10-07T08:49:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b66d5f700 1 -- 172.21.15.81:0/466955506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b601531c0 con 0x7f2b601578d0 2023-10-07T08:49:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b54ff9700 1 -- 172.21.15.81:0/466955506 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50011420 con 0x7f2b601578d0 2023-10-07T08:49:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.616+0000 7f2b66d5f700 1 -- 172.21.15.81:0/466955506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b60153780 con 0x7f2b601578d0 2023-10-07T08:49:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.617+0000 7f2b66d5f700 1 -- 172.21.15.81:0/466955506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b60067ac0 con 0x7f2b601578d0 2023-10-07T08:49:14.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.618+0000 7f2b54ff9700 1 -- 172.21.15.81:0/466955506 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b500117d0 con 0x7f2b601578d0 2023-10-07T08:49:14.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.618+0000 7f2b54ff9700 1 --2- 172.21.15.81:0/466955506 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2b4c066f30 0x7f2b4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:14.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.618+0000 7f2b54ff9700 1 -- 172.21.15.81:0/466955506 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2b50085880 con 0x7f2b601578d0 2023-10-07T08:49:14.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.618+0000 7f2b64afb700 1 --2- 172.21.15.81:0/466955506 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2b4c066f30 0x7f2b4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:14.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.619+0000 7f2b64afb700 1 --2- 172.21.15.81:0/466955506 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2b4c066f30 0x7f2b4c0693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2b60069ef0 tx=0x7f2b5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:14.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.622+0000 7f2b54ff9700 1 -- 172.21.15.81:0/466955506 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b50052af0 con 0x7f2b601578d0 2023-10-07T08:49:14.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.806+0000 7f2b66d5f700 1 -- 172.21.15.81:0/466955506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b60158330 con 0x7f2b601578d0 2023-10-07T08:49:14.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.807+0000 7f2b54ff9700 1 -- 172.21.15.81:0/466955506 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+15330 (secure 0 0 0) 0x7f2b50028090 con 0x7f2b601578d0 2023-10-07T08:49:14.808 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:14.808 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":137,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:49:13.844749+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:49:12.162742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-07T08:49:12.805348+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:49:14.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.809+0000 7f2b66d5f700 1 -- 172.21.15.81:0/466955506 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2b4c066f30 msgr2=0x7f2b4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:14.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.809+0000 7f2b66d5f700 1 --2- 172.21.15.81:0/466955506 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2b4c066f30 0x7f2b4c0693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2b60069ef0 tx=0x7f2b5c009040 comp rx=0 tx=0).stop 2023-10-07T08:49:14.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.809+0000 7f2b66d5f700 1 -- 172.21.15.81:0/466955506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b601578d0 msgr2=0x7f2b60152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:14.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.809+0000 7f2b66d5f700 1 --2- 172.21.15.81:0/466955506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b601578d0 0x7f2b60152b20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f2b6006fe20 tx=0x7f2b50017000 comp rx=0 tx=0).stop 2023-10-07T08:49:14.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.809+0000 7f2b66d5f700 1 -- 172.21.15.81:0/466955506 shutdown_connections 2023-10-07T08:49:14.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.809+0000 7f2b66d5f700 1 --2- 172.21.15.81:0/466955506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b60157ca0 0x7f2b6016ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.809+0000 7f2b66d5f700 1 --2- 172.21.15.81:0/466955506 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2b4c066f30 0x7f2b4c0693e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.809+0000 7f2b66d5f700 1 --2- 172.21.15.81:0/466955506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b6006d120 0x7f2b601525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.809+0000 7f2b66d5f700 1 --2- 172.21.15.81:0/466955506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b601578d0 0x7f2b60152b20 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.809+0000 7f2b66d5f700 1 -- 172.21.15.81:0/466955506 >> 172.21.15.81:0/466955506 conn(0x7f2b6006bb90 msgr2=0x7f2b601604d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:14.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.809+0000 7f2b66d5f700 1 -- 172.21.15.81:0/466955506 shutdown_connections 2023-10-07T08:49:14.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.810+0000 7f2b66d5f700 1 -- 172.21.15.81:0/466955506 wait complete. 2023-10-07T08:49:14.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:49:14.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.936+0000 7f52566b2700 1 Processor -- start 2023-10-07T08:49:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.936+0000 7f52566b2700 1 -- start start 2023-10-07T08:49:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.937+0000 7f52566b2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f52501578d0 0x7f52500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.937+0000 7f52566b2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5250157ca0 0x7f525015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.937+0000 7f52566b2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52500d07c0 con 0x7f525006d120 2023-10-07T08:49:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.937+0000 7f52566b2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52500cfbb0 con 0x7f52501578d0 2023-10-07T08:49:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.937+0000 7f52566b2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52500cfe90 con 0x7f5250157ca0 2023-10-07T08:49:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.937+0000 7f5254c4f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f525006d120 0x7f525006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34938/0 (socket says 172.21.15.81:34938) 2023-10-07T08:49:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.937+0000 7f524ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f52501578d0 0x7f52500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.937+0000 7f5254c4f700 1 -- 172.21.15.81:0/3190175165 learned_addr learned my addr 172.21.15.81:0/3190175165 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.937+0000 7f524f7fe700 1 --2- 172.21.15.81:0/3190175165 >> v2:172.21.15.89:3300/0 conn(0x7f5250157ca0 0x7f525015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f524ffff700 1 -- 172.21.15.81:0/3190175165 >> v2:172.21.15.89:3300/0 conn(0x7f5250157ca0 msgr2=0x7f525015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f524ffff700 1 --2- 172.21.15.81:0/3190175165 >> v2:172.21.15.89:3300/0 conn(0x7f5250157ca0 0x7f525015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f524ffff700 1 -- 172.21.15.81:0/3190175165 >> v1:172.21.15.81:6789/0 conn(0x7f525006d120 legacy=0x7f525006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f524ffff700 1 -- 172.21.15.81:0/3190175165 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52500d0170 con 0x7f52501578d0 2023-10-07T08:49:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f524f7fe700 1 --2- 172.21.15.81:0/3190175165 >> v2:172.21.15.89:3300/0 conn(0x7f5250157ca0 0x7f525015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f524effd700 1 -- 172.21.15.81:0/3190175165 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797632366 0 0) 0x7f52500d07c0 con 0x7f525006d120 2023-10-07T08:49:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f524ffff700 1 --2- 172.21.15.81:0/3190175165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52501578d0 0x7f52500cf4f0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f5250068510 tx=0x7f52400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9481d1695be4af5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f524effd700 1 -- 172.21.15.81:0/3190175165 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524000b6b0 con 0x7f52501578d0 2023-10-07T08:49:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f524effd700 1 -- 172.21.15.81:0/3190175165 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524000b810 con 0x7f52501578d0 2023-10-07T08:49:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f524effd700 1 -- 172.21.15.81:0/3190175165 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524000bbb0 con 0x7f52501578d0 2023-10-07T08:49:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f52566b2700 1 -- 172.21.15.81:0/3190175165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52501578d0 msgr2=0x7f52500cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f52566b2700 1 --2- 172.21.15.81:0/3190175165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52501578d0 0x7f52500cf4f0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f5250068510 tx=0x7f52400091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f52566b2700 1 -- 172.21.15.81:0/3190175165 shutdown_connections 2023-10-07T08:49:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f52566b2700 1 --2- 172.21.15.81:0/3190175165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52501578d0 0x7f52500cf4f0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f52566b2700 1 --2- 172.21.15.81:0/3190175165 >> v2:172.21.15.89:3300/0 conn(0x7f5250157ca0 0x7f525015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f52566b2700 1 -- 172.21.15.81:0/3190175165 >> 172.21.15.81:0/3190175165 conn(0x7f525006bb90 msgr2=0x7f525006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:14.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f52566b2700 1 -- 172.21.15.81:0/3190175165 shutdown_connections 2023-10-07T08:49:14.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.938+0000 7f52566b2700 1 -- 172.21.15.81:0/3190175165 wait complete. 2023-10-07T08:49:14.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.939+0000 7f52566b2700 1 Processor -- start 2023-10-07T08:49:14.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.940+0000 7f52566b2700 1 -- start start 2023-10-07T08:49:14.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.940+0000 7f52566b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525006d120 0x7f52500c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:14.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.940+0000 7f52566b2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52501578d0 0x7f5250068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:14.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.940+0000 7f52566b2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5250157ca0 0x7f52500c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:14.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.940+0000 7f52566b2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525016dc20 con 0x7f525006d120 2023-10-07T08:49:14.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.940+0000 7f52566b2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525016ab30 con 0x7f5250157ca0 2023-10-07T08:49:14.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.940+0000 7f52566b2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525016ae10 con 0x7f52501578d0 2023-10-07T08:49:14.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.940+0000 7f524ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525006d120 0x7f52500c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:14.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.940+0000 7f524ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525006d120 0x7f52500c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34116/0 (socket says 172.21.15.81:34116) 2023-10-07T08:49:14.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.940+0000 7f524ffff700 1 -- 172.21.15.81:0/255939331 learned_addr learned my addr 172.21.15.81:0/255939331 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:14.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.941+0000 7f5254c4f700 1 --2- 172.21.15.81:0/255939331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5250157ca0 0x7f52500c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:14.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.941+0000 7f524f7fe700 1 --2- 172.21.15.81:0/255939331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52501578d0 0x7f5250068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:14.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.941+0000 7f524ffff700 1 -- 172.21.15.81:0/255939331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52501578d0 msgr2=0x7f5250068b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:14.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.941+0000 7f524ffff700 1 --2- 172.21.15.81:0/255939331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52501578d0 0x7f5250068b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.941+0000 7f524ffff700 1 -- 172.21.15.81:0/255939331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5250157ca0 msgr2=0x7f52500c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:14.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.941+0000 7f524ffff700 1 --2- 172.21.15.81:0/255939331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5250157ca0 0x7f52500c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:14.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.941+0000 7f524ffff700 1 -- 172.21.15.81:0/255939331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5240009420 con 0x7f525006d120 2023-10-07T08:49:14.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.941+0000 7f5254c4f700 1 --2- 172.21.15.81:0/255939331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5250157ca0 0x7f52500c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:14.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.941+0000 7f524f7fe700 1 --2- 172.21.15.81:0/255939331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52501578d0 0x7f5250068b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:14.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.941+0000 7f524ffff700 1 --2- 172.21.15.81:0/255939331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525006d120 0x7f52500c87a0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f52400093f0 tx=0x7f5240017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:14.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.941+0000 7f5237fff700 1 -- 172.21.15.81:0/255939331 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524000bb90 con 0x7f525006d120 2023-10-07T08:49:14.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.941+0000 7f5237fff700 1 -- 172.21.15.81:0/255939331 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5240011420 con 0x7f525006d120 2023-10-07T08:49:14.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.941+0000 7f52566b2700 1 -- 172.21.15.81:0/255939331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525016b0f0 con 0x7f525006d120 2023-10-07T08:49:14.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.941+0000 7f5237fff700 1 -- 172.21.15.81:0/255939331 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52400117c0 con 0x7f525006d120 2023-10-07T08:49:14.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.941+0000 7f52566b2700 1 -- 172.21.15.81:0/255939331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5250159d40 con 0x7f525006d120 2023-10-07T08:49:14.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.942+0000 7f52566b2700 1 -- 172.21.15.81:0/255939331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5250155ee0 con 0x7f525006d120 2023-10-07T08:49:14.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.942+0000 7f5237fff700 1 -- 172.21.15.81:0/255939331 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5240011b30 con 0x7f525006d120 2023-10-07T08:49:14.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.943+0000 7f5237fff700 1 --2- 172.21.15.81:0/255939331 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f523c066f30 0x7f523c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:14.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.943+0000 7f5237fff700 1 -- 172.21.15.81:0/255939331 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5240085b30 con 0x7f525006d120 2023-10-07T08:49:14.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.943+0000 7f524f7fe700 1 --2- 172.21.15.81:0/255939331 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f523c066f30 0x7f523c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:14.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.943+0000 7f524f7fe700 1 --2- 172.21.15.81:0/255939331 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f523c066f30 0x7f523c0693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5244006f00 tx=0x7f5244008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:14.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:14.947+0000 7f5237fff700 1 -- 172.21.15.81:0/255939331 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5240052da0 con 0x7f525006d120 2023-10-07T08:49:15.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.130+0000 7f52566b2700 1 -- 172.21.15.81:0/255939331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52500d0450 con 0x7f525006d120 2023-10-07T08:49:15.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.131+0000 7f5237fff700 1 -- 172.21.15.81:0/255939331 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+15330 (secure 0 0 0) 0x7f5240006cb0 con 0x7f525006d120 2023-10-07T08:49:15.133 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:15.133 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":137,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:49:13.844749+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:49:12.162742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-07T08:49:12.805348+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:49:15.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.133+0000 7f52566b2700 1 -- 172.21.15.81:0/255939331 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f523c066f30 msgr2=0x7f523c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:15.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.133+0000 7f52566b2700 1 --2- 172.21.15.81:0/255939331 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f523c066f30 0x7f523c0693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5244006f00 tx=0x7f5244008040 comp rx=0 tx=0).stop 2023-10-07T08:49:15.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.133+0000 7f52566b2700 1 -- 172.21.15.81:0/255939331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525006d120 msgr2=0x7f52500c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:15.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.133+0000 7f52566b2700 1 --2- 172.21.15.81:0/255939331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525006d120 0x7f52500c87a0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f52400093f0 tx=0x7f5240017000 comp rx=0 tx=0).stop 2023-10-07T08:49:15.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.133+0000 7f52566b2700 1 -- 172.21.15.81:0/255939331 shutdown_connections 2023-10-07T08:49:15.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.133+0000 7f52566b2700 1 --2- 172.21.15.81:0/255939331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5250157ca0 0x7f52500c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:15.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.133+0000 7f52566b2700 1 --2- 172.21.15.81:0/255939331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525006d120 0x7f52500c87a0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:15.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.133+0000 7f52566b2700 1 --2- 172.21.15.81:0/255939331 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f523c066f30 0x7f523c0693e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:15.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.133+0000 7f52566b2700 1 --2- 172.21.15.81:0/255939331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52501578d0 0x7f5250068b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:15.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.133+0000 7f52566b2700 1 -- 172.21.15.81:0/255939331 >> 172.21.15.81:0/255939331 conn(0x7f525006bb90 msgr2=0x7f525006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:15.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.134+0000 7f52566b2700 1 -- 172.21.15.81:0/255939331 shutdown_connections 2023-10-07T08:49:15.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.134+0000 7f52566b2700 1 -- 172.21.15.81:0/255939331 wait complete. 2023-10-07T08:49:15.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T08:49:15.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.263+0000 7f13a359e700 1 Processor -- start 2023-10-07T08:49:15.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.263+0000 7f13a359e700 1 -- start start 2023-10-07T08:49:15.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.264+0000 7f13a359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13a40d0b80 0x7f13a40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.264+0000 7f13a359e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f13a406d700 0x7f13a415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.264+0000 7f13a359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a40cf2d0 con 0x7f13a40d02b0 2023-10-07T08:49:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.264+0000 7f13a359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a415a690 con 0x7f13a40d0b80 2023-10-07T08:49:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.264+0000 7f13a359e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a406dc00 con 0x7f13a406d700 2023-10-07T08:49:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.264+0000 7f13a259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13a40d0b80 0x7f13a40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.264+0000 7f13a1d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f13a40d02b0 0x7f13a406cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34940/0 (socket says 172.21.15.81:34940) 2023-10-07T08:49:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.264+0000 7f13a1d9b700 1 -- 172.21.15.81:0/729558369 learned_addr learned my addr 172.21.15.81:0/729558369 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.264+0000 7f13a2d9d700 1 --2- 172.21.15.81:0/729558369 >> v2:172.21.15.89:3300/0 conn(0x7f13a406d700 0x7f13a415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.264+0000 7f13a259c700 1 -- 172.21.15.81:0/729558369 >> v2:172.21.15.89:3300/0 conn(0x7f13a406d700 msgr2=0x7f13a415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.264+0000 7f13a259c700 1 --2- 172.21.15.81:0/729558369 >> v2:172.21.15.89:3300/0 conn(0x7f13a406d700 0x7f13a415b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.264+0000 7f13a259c700 1 -- 172.21.15.81:0/729558369 >> v1:172.21.15.81:6789/0 conn(0x7f13a40d02b0 legacy=0x7f13a406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.264+0000 7f13a259c700 1 -- 172.21.15.81:0/729558369 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a40cf570 con 0x7f13a40d0b80 2023-10-07T08:49:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.264+0000 7f13a159a700 1 -- 172.21.15.81:0/729558369 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736270883 0 0) 0x7f13a40cf2d0 con 0x7f13a40d02b0 2023-10-07T08:49:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.264+0000 7f13a259c700 1 --2- 172.21.15.81:0/729558369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a40d0b80 0x7f13a40cfd70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f13940098e0 tx=0x7f13940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66ed4dc72fa2c27 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.265+0000 7f13a159a700 1 -- 172.21.15.81:0/729558369 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394009e80 con 0x7f13a40d0b80 2023-10-07T08:49:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.265+0000 7f13a159a700 1 -- 172.21.15.81:0/729558369 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139400b820 con 0x7f13a40d0b80 2023-10-07T08:49:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.265+0000 7f13a159a700 1 -- 172.21.15.81:0/729558369 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400bba0 con 0x7f13a40d0b80 2023-10-07T08:49:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.265+0000 7f13a359e700 1 -- 172.21.15.81:0/729558369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a40d0b80 msgr2=0x7f13a40cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.265+0000 7f13a359e700 1 --2- 172.21.15.81:0/729558369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a40d0b80 0x7f13a40cfd70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f13940098e0 tx=0x7f13940091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.265+0000 7f13a359e700 1 -- 172.21.15.81:0/729558369 shutdown_connections 2023-10-07T08:49:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.265+0000 7f13a359e700 1 --2- 172.21.15.81:0/729558369 >> v2:172.21.15.89:3300/0 conn(0x7f13a406d700 0x7f13a415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.265+0000 7f13a359e700 1 --2- 172.21.15.81:0/729558369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a40d0b80 0x7f13a40cfd70 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.265+0000 7f13a359e700 1 -- 172.21.15.81:0/729558369 >> 172.21.15.81:0/729558369 conn(0x7f13a4063230 msgr2=0x7f13a4063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.265+0000 7f13a359e700 1 -- 172.21.15.81:0/729558369 shutdown_connections 2023-10-07T08:49:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.265+0000 7f13a359e700 1 -- 172.21.15.81:0/729558369 wait complete. 2023-10-07T08:49:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.266+0000 7f13a359e700 1 Processor -- start 2023-10-07T08:49:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.266+0000 7f13a359e700 1 -- start start 2023-10-07T08:49:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13a406d700 0x7f13a415e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a359e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13a40d02b0 0x7f13a4155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a40d0b80 0x7f13a40b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a415e700 con 0x7f13a40d0b80 2023-10-07T08:49:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a359e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a416a570 con 0x7f13a40d02b0 2023-10-07T08:49:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a40c6de0 con 0x7f13a406d700 2023-10-07T08:49:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a40d0b80 0x7f13a40b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a40d0b80 0x7f13a40b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34134/0 (socket says 172.21.15.81:34134) 2023-10-07T08:49:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a2d9d700 1 -- 172.21.15.81:0/1482410828 learned_addr learned my addr 172.21.15.81:0/1482410828 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a1d9b700 1 --2- 172.21.15.81:0/1482410828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13a40d02b0 0x7f13a4155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a259c700 1 --2- 172.21.15.81:0/1482410828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13a406d700 0x7f13a415e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a2d9d700 1 -- 172.21.15.81:0/1482410828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13a406d700 msgr2=0x7f13a415e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a2d9d700 1 --2- 172.21.15.81:0/1482410828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13a406d700 0x7f13a415e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a2d9d700 1 -- 172.21.15.81:0/1482410828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13a40d02b0 msgr2=0x7f13a4155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a2d9d700 1 --2- 172.21.15.81:0/1482410828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13a40d02b0 0x7f13a4155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a2d9d700 1 -- 172.21.15.81:0/1482410828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1394009420 con 0x7f13a40d0b80 2023-10-07T08:49:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.267+0000 7f13a2d9d700 1 --2- 172.21.15.81:0/1482410828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a40d0b80 0x7f13a40b4330 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f139c009fd0 tx=0x7f139c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.268+0000 7f13927fc700 1 -- 172.21.15.81:0/1482410828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c00ebf0 con 0x7f13a40d0b80 2023-10-07T08:49:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.268+0000 7f13927fc700 1 -- 172.21.15.81:0/1482410828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c00ed50 con 0x7f13a40d0b80 2023-10-07T08:49:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.268+0000 7f13a359e700 1 -- 172.21.15.81:0/1482410828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a415f880 con 0x7f13a40d0b80 2023-10-07T08:49:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.268+0000 7f13927fc700 1 -- 172.21.15.81:0/1482410828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c014670 con 0x7f13a40d0b80 2023-10-07T08:49:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.268+0000 7f13a359e700 1 -- 172.21.15.81:0/1482410828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a416e390 con 0x7f13a40d0b80 2023-10-07T08:49:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.268+0000 7f13a359e700 1 -- 172.21.15.81:0/1482410828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a40676e0 con 0x7f13a40d0b80 2023-10-07T08:49:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.269+0000 7f13927fc700 1 -- 172.21.15.81:0/1482410828 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f139c0149e0 con 0x7f13a40d0b80 2023-10-07T08:49:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.269+0000 7f13927fc700 1 --2- 172.21.15.81:0/1482410828 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1384066f30 0x7f13840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.269+0000 7f13927fc700 1 -- 172.21.15.81:0/1482410828 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f139c084b80 con 0x7f13a40d0b80 2023-10-07T08:49:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.269+0000 7f13a259c700 1 --2- 172.21.15.81:0/1482410828 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1384066f30 0x7f13840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.270+0000 7f13a259c700 1 --2- 172.21.15.81:0/1482410828 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1384066f30 0x7f13840693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f13940093f0 tx=0x7f1394017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.273+0000 7f13927fc700 1 -- 172.21.15.81:0/1482410828 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f139c051df0 con 0x7f13a40d0b80 2023-10-07T08:49:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:15.504+0000 7f13a359e700 1 -- 172.21.15.81:0/1482410828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f13a40c6f20 con 0x7f13a40d0b80 2023-10-07T08:49:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.485+0000 7f13927fc700 1 -- 172.21.15.81:0/1482410828 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v65) v1 ==== 118+0+0 (secure 0 0 0) 0x7f139c055410 con 0x7f13a40d0b80 2023-10-07T08:49:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.488+0000 7f13a359e700 1 -- 172.21.15.81:0/1482410828 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1384066f30 msgr2=0x7f13840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.488+0000 7f13a359e700 1 --2- 172.21.15.81:0/1482410828 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1384066f30 0x7f13840693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f13940093f0 tx=0x7f1394017000 comp rx=0 tx=0).stop 2023-10-07T08:49:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.488+0000 7f13a359e700 1 -- 172.21.15.81:0/1482410828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a40d0b80 msgr2=0x7f13a40b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.488+0000 7f13a359e700 1 --2- 172.21.15.81:0/1482410828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a40d0b80 0x7f13a40b4330 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f139c009fd0 tx=0x7f139c009900 comp rx=0 tx=0).stop 2023-10-07T08:49:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.488+0000 7f13a359e700 1 -- 172.21.15.81:0/1482410828 shutdown_connections 2023-10-07T08:49:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.488+0000 7f13a359e700 1 --2- 172.21.15.81:0/1482410828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13a40d0b80 0x7f13a40b4330 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.488+0000 7f13a359e700 1 --2- 172.21.15.81:0/1482410828 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1384066f30 0x7f13840693e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.488+0000 7f13a359e700 1 --2- 172.21.15.81:0/1482410828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13a406d700 0x7f13a415e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.488+0000 7f13a359e700 1 --2- 172.21.15.81:0/1482410828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13a40d02b0 0x7f13a4155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.488+0000 7f13a359e700 1 -- 172.21.15.81:0/1482410828 >> 172.21.15.81:0/1482410828 conn(0x7f13a4063230 msgr2=0x7f13a40b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.488+0000 7f13a359e700 1 -- 172.21.15.81:0/1482410828 shutdown_connections 2023-10-07T08:49:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.488+0000 7f13a359e700 1 -- 172.21.15.81:0/1482410828 wait complete. 2023-10-07T08:49:16.502 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T08:49:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.620+0000 7f60bb89a700 1 Processor -- start 2023-10-07T08:49:16.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.620+0000 7f60bb89a700 1 -- start start 2023-10-07T08:49:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.621+0000 7f60bb89a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60b41578d0 0x7f60b40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.621+0000 7f60bb89a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f60b4157ca0 0x7f60b415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.621+0000 7f60bb89a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f60b406d120 0x7f60b406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.621+0000 7f60bb89a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b406dac0 con 0x7f60b4157ca0 2023-10-07T08:49:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.621+0000 7f60bb89a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b40d07c0 con 0x7f60b406d120 2023-10-07T08:49:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.621+0000 7f60bb89a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b40cfbb0 con 0x7f60b41578d0 2023-10-07T08:49:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.621+0000 7f60b8e35700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f60b4157ca0 0x7f60b415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.621+0000 7f60b8e35700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f60b4157ca0 0x7f60b415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34136/0 (socket says 172.21.15.81:34136) 2023-10-07T08:49:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.621+0000 7f60b8e35700 1 -- 172.21.15.81:0/3844898140 learned_addr learned my addr 172.21.15.81:0/3844898140 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.621+0000 7f60b9e37700 1 --2- 172.21.15.81:0/3844898140 >> v2:172.21.15.89:3300/0 conn(0x7f60b406d120 0x7f60b406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.621+0000 7f60b9636700 1 --2- 172.21.15.81:0/3844898140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60b41578d0 0x7f60b40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60b8e35700 1 -- 172.21.15.81:0/3844898140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60b41578d0 msgr2=0x7f60b40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60b8e35700 1 --2- 172.21.15.81:0/3844898140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60b41578d0 0x7f60b40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60b8e35700 1 -- 172.21.15.81:0/3844898140 >> v2:172.21.15.89:3300/0 conn(0x7f60b406d120 msgr2=0x7f60b406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60b8e35700 1 --2- 172.21.15.81:0/3844898140 >> v2:172.21.15.89:3300/0 conn(0x7f60b406d120 0x7f60b406d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60b8e35700 1 -- 172.21.15.81:0/3844898140 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b40cfe90 con 0x7f60b4157ca0 2023-10-07T08:49:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60b9e37700 1 --2- 172.21.15.81:0/3844898140 >> v2:172.21.15.89:3300/0 conn(0x7f60b406d120 0x7f60b406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60b8e35700 1 --2- 172.21.15.81:0/3844898140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60b4157ca0 0x7f60b415af00 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f60b40b3940 tx=0x7f60a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec68f2490a5528bc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60abfff700 1 -- 172.21.15.81:0/3844898140 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a400b860 con 0x7f60b4157ca0 2023-10-07T08:49:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60abfff700 1 -- 172.21.15.81:0/3844898140 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a400b9c0 con 0x7f60b4157ca0 2023-10-07T08:49:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60abfff700 1 -- 172.21.15.81:0/3844898140 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a400bd60 con 0x7f60b4157ca0 2023-10-07T08:49:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60bb89a700 1 -- 172.21.15.81:0/3844898140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60b4157ca0 msgr2=0x7f60b415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60bb89a700 1 --2- 172.21.15.81:0/3844898140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60b4157ca0 0x7f60b415af00 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f60b40b3940 tx=0x7f60a4009250 comp rx=0 tx=0).stop 2023-10-07T08:49:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60bb89a700 1 -- 172.21.15.81:0/3844898140 shutdown_connections 2023-10-07T08:49:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60bb89a700 1 --2- 172.21.15.81:0/3844898140 >> v2:172.21.15.89:3300/0 conn(0x7f60b406d120 0x7f60b406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60bb89a700 1 --2- 172.21.15.81:0/3844898140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60b41578d0 0x7f60b40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60bb89a700 1 --2- 172.21.15.81:0/3844898140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60b4157ca0 0x7f60b415af00 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.622+0000 7f60bb89a700 1 -- 172.21.15.81:0/3844898140 >> 172.21.15.81:0/3844898140 conn(0x7f60b406bb90 msgr2=0x7f60b406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.623+0000 7f60bb89a700 1 -- 172.21.15.81:0/3844898140 shutdown_connections 2023-10-07T08:49:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.623+0000 7f60bb89a700 1 -- 172.21.15.81:0/3844898140 wait complete. 2023-10-07T08:49:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.624+0000 7f60bb89a700 1 Processor -- start 2023-10-07T08:49:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.624+0000 7f60bb89a700 1 -- start start 2023-10-07T08:49:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.624+0000 7f60bb89a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60b406d120 0x7f60b414ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.624+0000 7f60bb89a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60b41578d0 0x7f60b40b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.624+0000 7f60bb89a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60b4157ca0 0x7f60b4069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.624+0000 7f60bb89a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4151d90 con 0x7f60b406d120 2023-10-07T08:49:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.624+0000 7f60bb89a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4151180 con 0x7f60b4157ca0 2023-10-07T08:49:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.624+0000 7f60bb89a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4151460 con 0x7f60b41578d0 2023-10-07T08:49:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.625+0000 7f60b9636700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60b406d120 0x7f60b414ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.625+0000 7f60b9636700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60b406d120 0x7f60b414ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34142/0 (socket says 172.21.15.81:34142) 2023-10-07T08:49:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.625+0000 7f60b9636700 1 -- 172.21.15.81:0/2846985113 learned_addr learned my addr 172.21.15.81:0/2846985113 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.625+0000 7f60b9636700 1 -- 172.21.15.81:0/2846985113 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60b41578d0 msgr2=0x7f60b40b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.625+0000 7f60b9636700 1 --2- 172.21.15.81:0/2846985113 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60b41578d0 0x7f60b40b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.625+0000 7f60b9636700 1 -- 172.21.15.81:0/2846985113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60b4157ca0 msgr2=0x7f60b4069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:16.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.625+0000 7f60b9636700 1 --2- 172.21.15.81:0/2846985113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60b4157ca0 0x7f60b4069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:16.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.625+0000 7f60b9636700 1 -- 172.21.15.81:0/2846985113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a40094f0 con 0x7f60b406d120 2023-10-07T08:49:16.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.625+0000 7f60b9636700 1 --2- 172.21.15.81:0/2846985113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60b406d120 0x7f60b414ab70 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f60b000e190 tx=0x7f60b0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:16.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.625+0000 7f60a97fa700 1 -- 172.21.15.81:0/2846985113 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b000edd0 con 0x7f60b406d120 2023-10-07T08:49:16.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.625+0000 7f60a97fa700 1 -- 172.21.15.81:0/2846985113 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b0014420 con 0x7f60b406d120 2023-10-07T08:49:16.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.625+0000 7f60bb89a700 1 -- 172.21.15.81:0/2846985113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b4151740 con 0x7f60b406d120 2023-10-07T08:49:16.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.625+0000 7f60a97fa700 1 -- 172.21.15.81:0/2846985113 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b00147e0 con 0x7f60b406d120 2023-10-07T08:49:16.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.625+0000 7f60bb89a700 1 -- 172.21.15.81:0/2846985113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b414b0b0 con 0x7f60b406d120 2023-10-07T08:49:16.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.626+0000 7f60bb89a700 1 -- 172.21.15.81:0/2846985113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b4067ac0 con 0x7f60b406d120 2023-10-07T08:49:16.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.626+0000 7f60a97fa700 1 -- 172.21.15.81:0/2846985113 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60b0014b50 con 0x7f60b406d120 2023-10-07T08:49:16.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.627+0000 7f60a97fa700 1 --2- 172.21.15.81:0/2846985113 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6098066f30 0x7f60980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:16.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.627+0000 7f60a97fa700 1 -- 172.21.15.81:0/2846985113 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f60b0084d70 con 0x7f60b406d120 2023-10-07T08:49:16.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.627+0000 7f60b8e35700 1 --2- 172.21.15.81:0/2846985113 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6098066f30 0x7f60980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:16.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.627+0000 7f60b8e35700 1 --2- 172.21.15.81:0/2846985113 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6098066f30 0x7f60980693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f60b40b3940 tx=0x7f60a4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:16.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.631+0000 7f60a97fa700 1 -- 172.21.15.81:0/2846985113 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60b0051fe0 con 0x7f60b406d120 2023-10-07T08:49:16.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:16.853+0000 7f60bb89a700 1 -- 172.21.15.81:0/2846985113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f60b40d0170 con 0x7f60b406d120 2023-10-07T08:49:17.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.486+0000 7f60a97fa700 1 -- 172.21.15.81:0/2846985113 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v66) v1 ==== 122+0+0 (secure 0 0 0) 0x7f60b0055600 con 0x7f60b406d120 2023-10-07T08:49:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.489+0000 7f60bb89a700 1 -- 172.21.15.81:0/2846985113 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6098066f30 msgr2=0x7f60980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.489+0000 7f60bb89a700 1 --2- 172.21.15.81:0/2846985113 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6098066f30 0x7f60980693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f60b40b3940 tx=0x7f60a4017000 comp rx=0 tx=0).stop 2023-10-07T08:49:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.489+0000 7f60bb89a700 1 -- 172.21.15.81:0/2846985113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60b406d120 msgr2=0x7f60b414ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.489+0000 7f60bb89a700 1 --2- 172.21.15.81:0/2846985113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60b406d120 0x7f60b414ab70 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f60b000e190 tx=0x7f60b0009900 comp rx=0 tx=0).stop 2023-10-07T08:49:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.489+0000 7f60bb89a700 1 -- 172.21.15.81:0/2846985113 shutdown_connections 2023-10-07T08:49:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.489+0000 7f60bb89a700 1 --2- 172.21.15.81:0/2846985113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60b4157ca0 0x7f60b4069b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.489+0000 7f60bb89a700 1 --2- 172.21.15.81:0/2846985113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60b406d120 0x7f60b414ab70 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.489+0000 7f60bb89a700 1 --2- 172.21.15.81:0/2846985113 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6098066f30 0x7f60980693e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.489+0000 7f60bb89a700 1 --2- 172.21.15.81:0/2846985113 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60b41578d0 0x7f60b40b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.489+0000 7f60bb89a700 1 -- 172.21.15.81:0/2846985113 >> 172.21.15.81:0/2846985113 conn(0x7f60b406bb90 msgr2=0x7f60b406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.489+0000 7f60bb89a700 1 -- 172.21.15.81:0/2846985113 shutdown_connections 2023-10-07T08:49:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.489+0000 7f60bb89a700 1 -- 172.21.15.81:0/2846985113 wait complete. 2023-10-07T08:49:17.503 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:49:17.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.617+0000 7fca7e07f700 1 Processor -- start 2023-10-07T08:49:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.617+0000 7fca7e07f700 1 -- start start 2023-10-07T08:49:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.618+0000 7fca7e07f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca78159f10 0x7fca78068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.618+0000 7fca7e07f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fca78068cc0 0x7fca780cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.618+0000 7fca7e07f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca780cee10 con 0x7fca78159b40 2023-10-07T08:49:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.618+0000 7fca7e07f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca78069140 con 0x7fca78068cc0 2023-10-07T08:49:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.618+0000 7fca7e07f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca780cd040 con 0x7fca78159f10 2023-10-07T08:49:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.618+0000 7fca7d07d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fca78159b40 0x7fca780cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34948/0 (socket says 172.21.15.81:34948) 2023-10-07T08:49:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.618+0000 7fca7d07d700 1 -- 172.21.15.81:0/882545325 learned_addr learned my addr 172.21.15.81:0/882545325 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.618+0000 7fca7d87e700 1 --2- 172.21.15.81:0/882545325 >> v2:172.21.15.89:3300/0 conn(0x7fca78068cc0 0x7fca780cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.618+0000 7fca7c87c700 1 --2- 172.21.15.81:0/882545325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca78159f10 0x7fca78068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.618+0000 7fca6ffff700 1 -- 172.21.15.81:0/882545325 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895815186 0 0) 0x7fca780cee10 con 0x7fca78159b40 2023-10-07T08:49:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.618+0000 7fca6ffff700 1 -- 172.21.15.81:0/882545325 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca64003570 con 0x7fca78159b40 2023-10-07T08:49:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.618+0000 7fca7d87e700 1 -- 172.21.15.81:0/882545325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca78159f10 msgr2=0x7fca78068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.618+0000 7fca7d87e700 1 --2- 172.21.15.81:0/882545325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca78159f10 0x7fca78068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.618+0000 7fca7d87e700 1 -- 172.21.15.81:0/882545325 >> v1:172.21.15.81:6789/0 conn(0x7fca78159b40 legacy=0x7fca780cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.618+0000 7fca7d87e700 1 -- 172.21.15.81:0/882545325 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca780cd320 con 0x7fca78068cc0 2023-10-07T08:49:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.619+0000 7fca7d87e700 1 --2- 172.21.15.81:0/882545325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca78068cc0 0x7fca780cf2a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fca740098e0 tx=0x7fca740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e18042bbd13cf624 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.619+0000 7fca6ffff700 1 -- 172.21.15.81:0/882545325 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74011630 con 0x7fca78068cc0 2023-10-07T08:49:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.619+0000 7fca6ffff700 1 -- 172.21.15.81:0/882545325 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca74011790 con 0x7fca78068cc0 2023-10-07T08:49:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.619+0000 7fca6ffff700 1 -- 172.21.15.81:0/882545325 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74011b30 con 0x7fca78068cc0 2023-10-07T08:49:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.619+0000 7fca7e07f700 1 -- 172.21.15.81:0/882545325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca78068cc0 msgr2=0x7fca780cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.619+0000 7fca7e07f700 1 --2- 172.21.15.81:0/882545325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca78068cc0 0x7fca780cf2a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fca740098e0 tx=0x7fca740091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.619+0000 7fca7e07f700 1 -- 172.21.15.81:0/882545325 shutdown_connections 2023-10-07T08:49:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.619+0000 7fca7e07f700 1 --2- 172.21.15.81:0/882545325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca78068cc0 0x7fca780cf2a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.619+0000 7fca7e07f700 1 --2- 172.21.15.81:0/882545325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca78159f10 0x7fca78068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.619+0000 7fca7e07f700 1 -- 172.21.15.81:0/882545325 >> 172.21.15.81:0/882545325 conn(0x7fca780cd660 msgr2=0x7fca780cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.619+0000 7fca7e07f700 1 -- 172.21.15.81:0/882545325 shutdown_connections 2023-10-07T08:49:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.619+0000 7fca7e07f700 1 -- 172.21.15.81:0/882545325 wait complete. 2023-10-07T08:49:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.620+0000 7fca7e07f700 1 Processor -- start 2023-10-07T08:49:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.620+0000 7fca7e07f700 1 -- start start 2023-10-07T08:49:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.621+0000 7fca7e07f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca78068cc0 0x7fca780b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.621+0000 7fca7e07f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca78159b40 0x7fca7816b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.621+0000 7fca7e07f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca78159f10 0x7fca7816b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.621+0000 7fca7e07f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca780b5610 con 0x7fca78068cc0 2023-10-07T08:49:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.621+0000 7fca7e07f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca780b4a00 con 0x7fca78159b40 2023-10-07T08:49:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.621+0000 7fca7e07f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca780b4ce0 con 0x7fca78159f10 2023-10-07T08:49:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.621+0000 7fca7d07d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca78068cc0 0x7fca780b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.621+0000 7fca7d07d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca78068cc0 0x7fca780b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34144/0 (socket says 172.21.15.81:34144) 2023-10-07T08:49:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.621+0000 7fca7d07d700 1 -- 172.21.15.81:0/150046406 learned_addr learned my addr 172.21.15.81:0/150046406 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.622+0000 7fca7c87c700 1 --2- 172.21.15.81:0/150046406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca78159b40 0x7fca7816b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.622+0000 7fca7d87e700 1 --2- 172.21.15.81:0/150046406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca78159f10 0x7fca7816b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.622+0000 7fca7d07d700 1 -- 172.21.15.81:0/150046406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca78159f10 msgr2=0x7fca7816b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.622+0000 7fca7d07d700 1 --2- 172.21.15.81:0/150046406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca78159f10 0x7fca7816b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.622+0000 7fca7d07d700 1 -- 172.21.15.81:0/150046406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca78159b40 msgr2=0x7fca7816b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.622+0000 7fca7d07d700 1 --2- 172.21.15.81:0/150046406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca78159b40 0x7fca7816b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.622+0000 7fca7d07d700 1 -- 172.21.15.81:0/150046406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca74009420 con 0x7fca78068cc0 2023-10-07T08:49:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.622+0000 7fca7d07d700 1 --2- 172.21.15.81:0/150046406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca78068cc0 0x7fca780b5aa0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fca7000cd30 tx=0x7fca70001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.622+0000 7fca6d7fa700 1 -- 172.21.15.81:0/150046406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7000ab70 con 0x7fca78068cc0 2023-10-07T08:49:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.622+0000 7fca6d7fa700 1 -- 172.21.15.81:0/150046406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7000acf0 con 0x7fca78068cc0 2023-10-07T08:49:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.622+0000 7fca7e07f700 1 -- 172.21.15.81:0/150046406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca780b4fc0 con 0x7fca78068cc0 2023-10-07T08:49:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.622+0000 7fca6d7fa700 1 -- 172.21.15.81:0/150046406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70007340 con 0x7fca78068cc0 2023-10-07T08:49:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.622+0000 7fca7e07f700 1 -- 172.21.15.81:0/150046406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca780b5fe0 con 0x7fca78068cc0 2023-10-07T08:49:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.623+0000 7fca7e07f700 1 -- 172.21.15.81:0/150046406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca78063e90 con 0x7fca78068cc0 2023-10-07T08:49:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.623+0000 7fca6d7fa700 1 -- 172.21.15.81:0/150046406 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca70007770 con 0x7fca78068cc0 2023-10-07T08:49:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.624+0000 7fca6d7fa700 1 --2- 172.21.15.81:0/150046406 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fca5c066f30 0x7fca5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.624+0000 7fca7c87c700 1 --2- 172.21.15.81:0/150046406 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fca5c066f30 0x7fca5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.624+0000 7fca6d7fa700 1 -- 172.21.15.81:0/150046406 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fca70084a30 con 0x7fca78068cc0 2023-10-07T08:49:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.624+0000 7fca7c87c700 1 --2- 172.21.15.81:0/150046406 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fca5c066f30 0x7fca5c0693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fca68006f00 tx=0x7fca68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.628+0000 7fca6d7fa700 1 -- 172.21.15.81:0/150046406 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca70051d20 con 0x7fca78068cc0 2023-10-07T08:49:17.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.852+0000 7fca7e07f700 1 -- 172.21.15.81:0/150046406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca780ce7c0 con 0x7fca78068cc0 2023-10-07T08:49:17.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.852+0000 7fca6d7fa700 1 -- 172.21.15.81:0/150046406 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fca7000ae60 con 0x7fca78068cc0 2023-10-07T08:49:17.854 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:17.855 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1795695306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1795695306},{"type":"v1","addr":"172.21.15.89:6834","nonce":1795695306}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3856313795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3856313795},{"type":"v1","addr":"172.21.15.89:6835","nonce":3856313795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7119,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4143803144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4143803144},{"type":"v1","addr":"172.21.15.81:6836","nonce":4143803144}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:49:13.845110+0000","modified":"2023-10-07T08:49:17.485796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3151244734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3151244734},{"type":"v1","addr":"172.21.15.81:6837","nonce":3151244734}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-07T08:49:17.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.854+0000 7fca7e07f700 1 -- 172.21.15.81:0/150046406 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fca5c066f30 msgr2=0x7fca5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.854+0000 7fca7e07f700 1 --2- 172.21.15.81:0/150046406 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fca5c066f30 0x7fca5c0693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fca68006f00 tx=0x7fca68008040 comp rx=0 tx=0).stop 2023-10-07T08:49:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.854+0000 7fca7e07f700 1 -- 172.21.15.81:0/150046406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca78068cc0 msgr2=0x7fca780b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.854+0000 7fca7e07f700 1 --2- 172.21.15.81:0/150046406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca78068cc0 0x7fca780b5aa0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fca7000cd30 tx=0x7fca70001b10 comp rx=0 tx=0).stop 2023-10-07T08:49:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.854+0000 7fca7e07f700 1 -- 172.21.15.81:0/150046406 shutdown_connections 2023-10-07T08:49:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.854+0000 7fca7e07f700 1 --2- 172.21.15.81:0/150046406 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fca5c066f30 0x7fca5c0693e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.854+0000 7fca7e07f700 1 --2- 172.21.15.81:0/150046406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca78159f10 0x7fca7816b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.854+0000 7fca7e07f700 1 --2- 172.21.15.81:0/150046406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca78068cc0 0x7fca780b5aa0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.854+0000 7fca7e07f700 1 --2- 172.21.15.81:0/150046406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca78159b40 0x7fca7816b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.854+0000 7fca7e07f700 1 -- 172.21.15.81:0/150046406 >> 172.21.15.81:0/150046406 conn(0x7fca780cd660 msgr2=0x7fca7806f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:17.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.854+0000 7fca7e07f700 1 -- 172.21.15.81:0/150046406 shutdown_connections 2023-10-07T08:49:17.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.854+0000 7fca7e07f700 1 -- 172.21.15.81:0/150046406 wait complete. 2023-10-07T08:49:17.858 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2023-10-07T08:49:17.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:49:17.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.980+0000 7f93ffe47700 1 Processor -- start 2023-10-07T08:49:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.980+0000 7f93ffe47700 1 -- start start 2023-10-07T08:49:17.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.981+0000 7f93ffe47700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93f8157ca0 0x7f93f80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:17.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.981+0000 7f93ffe47700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93f806d120 0x7f93f806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:17.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.981+0000 7f93ffe47700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f80d07c0 con 0x7f93f81578d0 2023-10-07T08:49:17.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.981+0000 7f93ffe47700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f806daa0 con 0x7f93f8157ca0 2023-10-07T08:49:17.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.981+0000 7f93ffe47700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f80cfbb0 con 0x7f93f806d120 2023-10-07T08:49:17.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.981+0000 7f93fdbe3700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f93f81578d0 0x7f93f815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34952/0 (socket says 172.21.15.81:34952) 2023-10-07T08:49:17.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.981+0000 7f93fdbe3700 1 -- 172.21.15.81:0/1709911039 learned_addr learned my addr 172.21.15.81:0/1709911039 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:17.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.981+0000 7f93fd3e2700 1 --2- 172.21.15.81:0/1709911039 >> v2:172.21.15.89:3300/0 conn(0x7f93f8157ca0 0x7f93f80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:17.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.981+0000 7f93fcbe1700 1 -- 172.21.15.81:0/1709911039 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912431478 0 0) 0x7f93f80d07c0 con 0x7f93f81578d0 2023-10-07T08:49:17.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.981+0000 7f93fcbe1700 1 -- 172.21.15.81:0/1709911039 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93e4003570 con 0x7f93f81578d0 2023-10-07T08:49:17.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.981+0000 7f93fe3e4700 1 --2- 172.21.15.81:0/1709911039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93f806d120 0x7f93f806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:17.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 -- 172.21.15.81:0/1709911039 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1626729247 0 0) 0x7f93e4003570 con 0x7f93f81578d0 2023-10-07T08:49:17.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 -- 172.21.15.81:0/1709911039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93f806d120 msgr2=0x7f93f806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:17.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 --2- 172.21.15.81:0/1709911039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93f806d120 0x7f93f806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 -- 172.21.15.81:0/1709911039 >> v2:172.21.15.89:3300/0 conn(0x7f93f8157ca0 msgr2=0x7f93f80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:17.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 --2- 172.21.15.81:0/1709911039 >> v2:172.21.15.89:3300/0 conn(0x7f93f8157ca0 0x7f93f80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 -- 172.21.15.81:0/1709911039 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f80cfe90 con 0x7f93f81578d0 2023-10-07T08:49:17.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 -- 172.21.15.81:0/1709911039 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f93f40017f0 con 0x7f93f81578d0 2023-10-07T08:49:17.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 -- 172.21.15.81:0/1709911039 >> v1:172.21.15.81:6789/0 conn(0x7f93f81578d0 legacy=0x7f93f815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 --2- 172.21.15.81:0/1709911039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93e4003a60 0x7f93e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 --2- 172.21.15.81:0/1709911039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93f806d120 0x7f93e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 --2- 172.21.15.81:0/1709911039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4004d50 0x7f93e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 -- 172.21.15.81:0/1709911039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f806daa0 con 0x7f93e4004d50 2023-10-07T08:49:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 -- 172.21.15.81:0/1709911039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f80cfbb0 con 0x7f93e4003a60 2023-10-07T08:49:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 -- 172.21.15.81:0/1709911039 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e400ba60 con 0x7f93f806d120 2023-10-07T08:49:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fd3e2700 1 --2- 172.21.15.81:0/1709911039 >> v2:172.21.15.89:3300/0 conn(0x7f93f8157ca0 0x7f93f80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:49:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fe3e4700 1 --2- 172.21.15.81:0/1709911039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4004d50 0x7f93e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fdbe3700 1 --2- 172.21.15.81:0/1709911039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93e4003a60 0x7f93e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fd3e2700 1 --2- 172.21.15.81:0/1709911039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93f806d120 0x7f93e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fe3e4700 1 -- 172.21.15.81:0/1709911039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93f806d120 msgr2=0x7f93e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:17.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fe3e4700 1 --2- 172.21.15.81:0/1709911039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93f806d120 0x7f93e4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fe3e4700 1 -- 172.21.15.81:0/1709911039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93e4003a60 msgr2=0x7f93e4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:17.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fe3e4700 1 --2- 172.21.15.81:0/1709911039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93e4003a60 0x7f93e4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fe3e4700 1 -- 172.21.15.81:0/1709911039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e4003570 con 0x7f93e4004d50 2023-10-07T08:49:17.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fdbe3700 1 --2- 172.21.15.81:0/1709911039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93e4003a60 0x7f93e4003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:17.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fe3e4700 1 --2- 172.21.15.81:0/1709911039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4004d50 0x7f93e40051c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009c00 tx=0x7f93f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742d4f3944a51289 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:17.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 -- 172.21.15.81:0/1709911039 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f000e6b0 con 0x7f93e4004d50 2023-10-07T08:49:17.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 -- 172.21.15.81:0/1709911039 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f000e810 con 0x7f93e4004d50 2023-10-07T08:49:17.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.982+0000 7f93fcbe1700 1 -- 172.21.15.81:0/1709911039 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f000ebd0 con 0x7f93e4004d50 2023-10-07T08:49:17.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.983+0000 7f93ffe47700 1 -- 172.21.15.81:0/1709911039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4004d50 msgr2=0x7f93e40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:17.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.983+0000 7f93ffe47700 1 --2- 172.21.15.81:0/1709911039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4004d50 0x7f93e40051c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009c00 tx=0x7f93f00091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.983+0000 7f93fe3e4700 1 -- 172.21.15.81:0/1709911039 reap_dead start 2023-10-07T08:49:17.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.983+0000 7f93ffe47700 1 -- 172.21.15.81:0/1709911039 shutdown_connections 2023-10-07T08:49:17.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.983+0000 7f93ffe47700 1 -- 172.21.15.81:0/1709911039 >> 172.21.15.81:0/1709911039 conn(0x7f93f806bb90 msgr2=0x7f93f806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:17.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.983+0000 7f93ffe47700 1 -- 172.21.15.81:0/1709911039 shutdown_connections 2023-10-07T08:49:17.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.983+0000 7f93ffe47700 1 -- 172.21.15.81:0/1709911039 wait complete. 2023-10-07T08:49:17.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.984+0000 7f93ffe47700 1 Processor -- start 2023-10-07T08:49:17.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.984+0000 7f93ffe47700 1 -- start start 2023-10-07T08:49:17.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93ffe47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4004d50 0x7f93f80b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:17.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93ffe47700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93f80b44d0 0x7f93f8153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:17.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93ffe47700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8154120 0x7f93f8154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:17.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93ffe47700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f8154ab0 con 0x7f93e4004d50 2023-10-07T08:49:17.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93ffe47700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f80b55f0 con 0x7f93f8154120 2023-10-07T08:49:17.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93ffe47700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f80b49e0 con 0x7f93f80b44d0 2023-10-07T08:49:17.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93fdbe3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4004d50 0x7f93f80b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:17.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93fdbe3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4004d50 0x7f93f80b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34172/0 (socket says 172.21.15.81:34172) 2023-10-07T08:49:17.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93fdbe3700 1 -- 172.21.15.81:0/4230466598 learned_addr learned my addr 172.21.15.81:0/4230466598 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:17.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93fd3e2700 1 --2- 172.21.15.81:0/4230466598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93f80b44d0 0x7f93f8153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:17.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93fe3e4700 1 --2- 172.21.15.81:0/4230466598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8154120 0x7f93f8154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:17.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93fdbe3700 1 -- 172.21.15.81:0/4230466598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93f80b44d0 msgr2=0x7f93f8153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:17.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93fdbe3700 1 --2- 172.21.15.81:0/4230466598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93f80b44d0 0x7f93f8153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93fdbe3700 1 -- 172.21.15.81:0/4230466598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8154120 msgr2=0x7f93f8154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:17.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93fdbe3700 1 --2- 172.21.15.81:0/4230466598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8154120 0x7f93f8154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:17.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93fdbe3700 1 -- 172.21.15.81:0/4230466598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f80b4cc0 con 0x7f93e4004d50 2023-10-07T08:49:17.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.985+0000 7f93fdbe3700 1 --2- 172.21.15.81:0/4230466598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4004d50 0x7f93f80b3f90 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f93f4007c90 tx=0x7f93f80d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:17.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.986+0000 7f93edffb700 1 -- 172.21.15.81:0/4230466598 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4004bb0 con 0x7f93e4004d50 2023-10-07T08:49:17.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.986+0000 7f93edffb700 1 -- 172.21.15.81:0/4230466598 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f4010040 con 0x7f93e4004d50 2023-10-07T08:49:17.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.986+0000 7f93ffe47700 1 -- 172.21.15.81:0/4230466598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f80b4fa0 con 0x7f93e4004d50 2023-10-07T08:49:17.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.986+0000 7f93edffb700 1 -- 172.21.15.81:0/4230466598 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f400eb00 con 0x7f93e4004d50 2023-10-07T08:49:17.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.986+0000 7f93ffe47700 1 -- 172.21.15.81:0/4230466598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f8140540 con 0x7f93e4004d50 2023-10-07T08:49:17.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.987+0000 7f93ffe47700 1 -- 172.21.15.81:0/4230466598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f8067ac0 con 0x7f93e4004d50 2023-10-07T08:49:17.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.987+0000 7f93edffb700 1 -- 172.21.15.81:0/4230466598 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93f4005020 con 0x7f93e4004d50 2023-10-07T08:49:18.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.987+0000 7f93edffb700 1 --2- 172.21.15.81:0/4230466598 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93dc066f30 0x7f93dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:18.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.987+0000 7f93edffb700 1 -- 172.21.15.81:0/4230466598 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f93f4083dc0 con 0x7f93e4004d50 2023-10-07T08:49:18.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.987+0000 7f93fd3e2700 1 --2- 172.21.15.81:0/4230466598 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93dc066f30 0x7f93dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:18.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.988+0000 7f93fd3e2700 1 --2- 172.21.15.81:0/4230466598 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93dc066f30 0x7f93dc0693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f93f80cdda0 tx=0x7f93e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:18.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:17.991+0000 7f93edffb700 1 -- 172.21.15.81:0/4230466598 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93f404d5a0 con 0x7f93e4004d50 2023-10-07T08:49:18.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.175+0000 7f93ffe47700 1 -- 172.21.15.81:0/4230466598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93f80d0170 con 0x7f93e4004d50 2023-10-07T08:49:18.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.176+0000 7f93edffb700 1 -- 172.21.15.81:0/4230466598 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+15317 (secure 0 0 0) 0x7f93f4018090 con 0x7f93e4004d50 2023-10-07T08:49:18.177 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:18.178 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":138,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:49:15.459780+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:49:12.162742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-07T08:49:12.805348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:49:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.177+0000 7f93ffe47700 1 -- 172.21.15.81:0/4230466598 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93dc066f30 msgr2=0x7f93dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.177+0000 7f93ffe47700 1 --2- 172.21.15.81:0/4230466598 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93dc066f30 0x7f93dc0693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f93f80cdda0 tx=0x7f93e8008040 comp rx=0 tx=0).stop 2023-10-07T08:49:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.177+0000 7f93ffe47700 1 -- 172.21.15.81:0/4230466598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4004d50 msgr2=0x7f93f80b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.177+0000 7f93ffe47700 1 --2- 172.21.15.81:0/4230466598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4004d50 0x7f93f80b3f90 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f93f4007c90 tx=0x7f93f80d0730 comp rx=0 tx=0).stop 2023-10-07T08:49:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.178+0000 7f93ffe47700 1 -- 172.21.15.81:0/4230466598 shutdown_connections 2023-10-07T08:49:18.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.178+0000 7f93ffe47700 1 --2- 172.21.15.81:0/4230466598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93f8154120 0x7f93f8154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.178+0000 7f93ffe47700 1 --2- 172.21.15.81:0/4230466598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e4004d50 0x7f93f80b3f90 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.178+0000 7f93ffe47700 1 --2- 172.21.15.81:0/4230466598 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93dc066f30 0x7f93dc0693e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.178+0000 7f93ffe47700 1 --2- 172.21.15.81:0/4230466598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93f80b44d0 0x7f93f8153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.178+0000 7f93ffe47700 1 -- 172.21.15.81:0/4230466598 >> 172.21.15.81:0/4230466598 conn(0x7f93f806bb90 msgr2=0x7f93f8156820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:18.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.178+0000 7f93ffe47700 1 -- 172.21.15.81:0/4230466598 shutdown_connections 2023-10-07T08:49:18.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.178+0000 7f93ffe47700 1 -- 172.21.15.81:0/4230466598 wait complete. 2023-10-07T08:49:18.192 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T08:49:18.193 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:49:18.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.307+0000 7ff71759e700 1 Processor -- start 2023-10-07T08:49:18.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.307+0000 7ff71759e700 1 -- start start 2023-10-07T08:49:18.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.308+0000 7ff71759e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff7180add30 0x7ff7180b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.308+0000 7ff71759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff718067640 0x7ff718067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.308+0000 7ff71759e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff718067ff0 con 0x7ff7180ce890 2023-10-07T08:49:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.308+0000 7ff71759e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7180b37b0 con 0x7ff718067640 2023-10-07T08:49:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.308+0000 7ff71759e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7180b17c0 con 0x7ff7180add30 2023-10-07T08:49:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.308+0000 7ff715d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff718067640 0x7ff718067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.308+0000 7ff715d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff718067640 0x7ff718067ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34186/0 (socket says 172.21.15.81:34186) 2023-10-07T08:49:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.308+0000 7ff715d9b700 1 -- 172.21.15.81:0/1301749153 learned_addr learned my addr 172.21.15.81:0/1301749153 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.308+0000 7ff71659c700 1 --2- 172.21.15.81:0/1301749153 >> v2:172.21.15.89:3300/0 conn(0x7ff7180add30 0x7ff7180b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.308+0000 7ff715d9b700 1 -- 172.21.15.81:0/1301749153 >> v2:172.21.15.89:3300/0 conn(0x7ff7180add30 msgr2=0x7ff7180b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.308+0000 7ff715d9b700 1 --2- 172.21.15.81:0/1301749153 >> v2:172.21.15.89:3300/0 conn(0x7ff7180add30 0x7ff7180b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.308+0000 7ff715d9b700 1 -- 172.21.15.81:0/1301749153 >> v1:172.21.15.89:6789/0 conn(0x7ff7180ce890 legacy=0x7ff7180cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.308+0000 7ff715d9b700 1 -- 172.21.15.81:0/1301749153 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7180b1d80 con 0x7ff718067640 2023-10-07T08:49:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.309+0000 7ff715d9b700 1 --2- 172.21.15.81:0/1301749153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff718067640 0x7ff718067ab0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7ff71806a0f0 tx=0x7ff70c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160d90ea51143b8f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.309+0000 7ff71559a700 1 -- 172.21.15.81:0/1301749153 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c00b820 con 0x7ff718067640 2023-10-07T08:49:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.309+0000 7ff71559a700 1 -- 172.21.15.81:0/1301749153 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c00b980 con 0x7ff718067640 2023-10-07T08:49:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.309+0000 7ff71559a700 1 -- 172.21.15.81:0/1301749153 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c00bd20 con 0x7ff718067640 2023-10-07T08:49:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.309+0000 7ff71759e700 1 -- 172.21.15.81:0/1301749153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff718067640 msgr2=0x7ff718067ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.309+0000 7ff71759e700 1 --2- 172.21.15.81:0/1301749153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff718067640 0x7ff718067ab0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7ff71806a0f0 tx=0x7ff70c009250 comp rx=0 tx=0).stop 2023-10-07T08:49:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.309+0000 7ff71759e700 1 -- 172.21.15.81:0/1301749153 shutdown_connections 2023-10-07T08:49:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.309+0000 7ff71759e700 1 --2- 172.21.15.81:0/1301749153 >> v2:172.21.15.89:3300/0 conn(0x7ff7180add30 0x7ff7180b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.309+0000 7ff71759e700 1 --2- 172.21.15.81:0/1301749153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff718067640 0x7ff718067ab0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.309+0000 7ff71759e700 1 -- 172.21.15.81:0/1301749153 >> 172.21.15.81:0/1301749153 conn(0x7ff71806c620 msgr2=0x7ff71806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.309+0000 7ff71759e700 1 -- 172.21.15.81:0/1301749153 shutdown_connections 2023-10-07T08:49:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.309+0000 7ff71759e700 1 -- 172.21.15.81:0/1301749153 wait complete. 2023-10-07T08:49:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.310+0000 7ff71759e700 1 Processor -- start 2023-10-07T08:49:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.310+0000 7ff71759e700 1 -- start start 2023-10-07T08:49:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff71759e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff718067640 0x7ff7180aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff71759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7180add30 0x7ff7180c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff71759e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7180ce890 0x7ff7180c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff71759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7180abce0 con 0x7ff7180add30 2023-10-07T08:49:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff71759e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7180ab0d0 con 0x7ff7180ce890 2023-10-07T08:49:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff71759e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7180ab3b0 con 0x7ff718067640 2023-10-07T08:49:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff715d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7180add30 0x7ff7180c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff715d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7180add30 0x7ff7180c4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34192/0 (socket says 172.21.15.81:34192) 2023-10-07T08:49:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff715d9b700 1 -- 172.21.15.81:0/1794430417 learned_addr learned my addr 172.21.15.81:0/1794430417 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff71659c700 1 --2- 172.21.15.81:0/1794430417 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff718067640 0x7ff7180aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff716d9d700 1 --2- 172.21.15.81:0/1794430417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7180ce890 0x7ff7180c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff715d9b700 1 -- 172.21.15.81:0/1794430417 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff718067640 msgr2=0x7ff7180aaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff715d9b700 1 --2- 172.21.15.81:0/1794430417 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff718067640 0x7ff7180aaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff715d9b700 1 -- 172.21.15.81:0/1794430417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7180ce890 msgr2=0x7ff7180c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff715d9b700 1 --2- 172.21.15.81:0/1794430417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7180ce890 0x7ff7180c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff715d9b700 1 -- 172.21.15.81:0/1794430417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c0094f0 con 0x7ff7180add30 2023-10-07T08:49:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff716d9d700 1 --2- 172.21.15.81:0/1794430417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7180ce890 0x7ff7180c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.311+0000 7ff71659c700 1 --2- 172.21.15.81:0/1794430417 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff718067640 0x7ff7180aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.312+0000 7ff715d9b700 1 --2- 172.21.15.81:0/1794430417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7180add30 0x7ff7180c4f50 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0030c0 tx=0x7ff70c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.312+0000 7ff7067fc700 1 -- 172.21.15.81:0/1794430417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c011e60 con 0x7ff7180add30 2023-10-07T08:49:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.312+0000 7ff7067fc700 1 -- 172.21.15.81:0/1794430417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c020070 con 0x7ff7180add30 2023-10-07T08:49:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.312+0000 7ff71759e700 1 -- 172.21.15.81:0/1794430417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7180ab690 con 0x7ff7180add30 2023-10-07T08:49:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.312+0000 7ff7067fc700 1 -- 172.21.15.81:0/1794430417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c01b6a0 con 0x7ff7180add30 2023-10-07T08:49:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.312+0000 7ff71759e700 1 -- 172.21.15.81:0/1794430417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7180c5490 con 0x7ff7180add30 2023-10-07T08:49:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.313+0000 7ff71759e700 1 -- 172.21.15.81:0/1794430417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff718069920 con 0x7ff7180add30 2023-10-07T08:49:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.313+0000 7ff7067fc700 1 -- 172.21.15.81:0/1794430417 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff70c022030 con 0x7ff7180add30 2023-10-07T08:49:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.313+0000 7ff7067fc700 1 --2- 172.21.15.81:0/1794430417 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff6f8066f30 0x7ff6f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.314+0000 7ff7067fc700 1 -- 172.21.15.81:0/1794430417 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff70c086460 con 0x7ff7180add30 2023-10-07T08:49:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.314+0000 7ff71659c700 1 --2- 172.21.15.81:0/1794430417 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff6f8066f30 0x7ff6f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.314+0000 7ff71659c700 1 --2- 172.21.15.81:0/1794430417 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff6f8066f30 0x7ff6f80693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff70800e5a0 tx=0x7ff708007710 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.318+0000 7ff7067fc700 1 -- 172.21.15.81:0/1794430417 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff70c0536d0 con 0x7ff7180add30 2023-10-07T08:49:18.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.498+0000 7ff71759e700 1 -- 172.21.15.81:0/1794430417 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7180b4570 con 0x7ff6f8066f30 2023-10-07T08:49:18.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.506+0000 7ff7067fc700 1 -- 172.21.15.81:0/1794430417 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285258 (secure 0 0 0) 0x7ff7180b4570 con 0x7ff6f8066f30 2023-10-07T08:49:18.511 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:18.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.509+0000 7ff71759e700 1 -- 172.21.15.81:0/1794430417 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff6f8066f30 msgr2=0x7ff6f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:18.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.509+0000 7ff71759e700 1 --2- 172.21.15.81:0/1794430417 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff6f8066f30 0x7ff6f80693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff70800e5a0 tx=0x7ff708007710 comp rx=0 tx=0).stop 2023-10-07T08:49:18.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.509+0000 7ff71759e700 1 -- 172.21.15.81:0/1794430417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7180add30 msgr2=0x7ff7180c4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:18.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.509+0000 7ff71759e700 1 --2- 172.21.15.81:0/1794430417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7180add30 0x7ff7180c4f50 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0030c0 tx=0x7ff70c016000 comp rx=0 tx=0).stop 2023-10-07T08:49:18.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.509+0000 7ff71759e700 1 -- 172.21.15.81:0/1794430417 shutdown_connections 2023-10-07T08:49:18.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.509+0000 7ff71759e700 1 --2- 172.21.15.81:0/1794430417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7180ce890 0x7ff7180c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.509+0000 7ff71759e700 1 --2- 172.21.15.81:0/1794430417 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff6f8066f30 0x7ff6f80693e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.509+0000 7ff71759e700 1 --2- 172.21.15.81:0/1794430417 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff718067640 0x7ff7180aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.509+0000 7ff71759e700 1 --2- 172.21.15.81:0/1794430417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7180add30 0x7ff7180c4f50 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.509+0000 7ff71759e700 1 -- 172.21.15.81:0/1794430417 >> 172.21.15.81:0/1794430417 conn(0x7ff71806c620 msgr2=0x7ff7180ae100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:18.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.509+0000 7ff71759e700 1 -- 172.21.15.81:0/1794430417 shutdown_connections 2023-10-07T08:49:18.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.509+0000 7ff71759e700 1 -- 172.21.15.81:0/1794430417 wait complete. 2023-10-07T08:49:18.515 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:49:18.523 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2023-10-07T08:49:18.087428+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":87,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6999,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555500,"statfs":{"total":1600000000,"available":1592832081,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.633002"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.475120+0000","last_change":"2023-10-07T08:49:14.475120+0000","last_active":"2023-10-07T08:49:14.475120+0000","last_peered":"2023-10-07T08:49:14.475120+0000","last_clean":"2023-10-07T08:49:14.475120+0000","last_became_active":"2023-10-07T08:49:14.474814+0000","last_became_peered":"2023-10-07T08:49:14.474814+0000","last_unstale":"2023-10-07T08:49:14.475120+0000","last_undegraded":"2023-10-07T08:49:14.475120+0000","last_fullsized":"2023-10-07T08:49:14.475120+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:20:27.398850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.476788+0000","last_change":"2023-10-07T08:49:14.476788+0000","last_active":"2023-10-07T08:49:14.476788+0000","last_peered":"2023-10-07T08:49:14.476788+0000","last_clean":"2023-10-07T08:49:14.476788+0000","last_became_active":"2023-10-07T08:49:14.476376+0000","last_became_peered":"2023-10-07T08:49:14.476376+0000","last_unstale":"2023-10-07T08:49:14.476788+0000","last_undegraded":"2023-10-07T08:49:14.476788+0000","last_fullsized":"2023-10-07T08:49:14.476788+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:55:03.519826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.481035+0000","last_change":"2023-10-07T08:49:14.481035+0000","last_active":"2023-10-07T08:49:14.481035+0000","last_peered":"2023-10-07T08:49:14.481035+0000","last_clean":"2023-10-07T08:49:14.481035+0000","last_became_active":"2023-10-07T08:49:14.479959+0000","last_became_peered":"2023-10-07T08:49:14.479959+0000","last_unstale":"2023-10-07T08:49:14.481035+0000","last_undegraded":"2023-10-07T08:49:14.481035+0000","last_fullsized":"2023-10-07T08:49:14.481035+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:44:10.577541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.469931+0000","last_change":"2023-10-07T08:49:14.469931+0000","last_active":"2023-10-07T08:49:14.469931+0000","last_peered":"2023-10-07T08:49:14.469931+0000","last_clean":"2023-10-07T08:49:14.469931+0000","last_became_active":"2023-10-07T08:49:14.469709+0000","last_became_peered":"2023-10-07T08:49:14.469709+0000","last_unstale":"2023-10-07T08:49:14.469931+0000","last_undegraded":"2023-10-07T08:49:14.469931+0000","last_fullsized":"2023-10-07T08:49:14.469931+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:23.871449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.467315+0000","last_change":"2023-10-07T08:49:14.467315+0000","last_active":"2023-10-07T08:49:14.467315+0000","last_peered":"2023-10-07T08:49:14.467315+0000","last_clean":"2023-10-07T08:49:14.467315+0000","last_became_active":"2023-10-07T08:49:14.467071+0000","last_became_peered":"2023-10-07T08:49:14.467071+0000","last_unstale":"2023-10-07T08:49:14.467315+0000","last_undegraded":"2023-10-07T08:49:14.467315+0000","last_fullsized":"2023-10-07T08:49:14.467315+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:38:13.888526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.473261+0000","last_change":"2023-10-07T08:49:14.473261+0000","last_active":"2023-10-07T08:49:14.473261+0000","last_peered":"2023-10-07T08:49:14.473261+0000","last_clean":"2023-10-07T08:49:14.473261+0000","last_became_active":"2023-10-07T08:49:14.472926+0000","last_became_peered":"2023-10-07T08:49:14.472926+0000","last_unstale":"2023-10-07T08:49:14.473261+0000","last_undegraded":"2023-10-07T08:49:14.473261+0000","last_fullsized":"2023-10-07T08:49:14.473261+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:47:17.316931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.475506+0000","last_change":"2023-10-07T08:49:14.475506+0000","last_active":"2023-10-07T08:49:14.475506+0000","last_peered":"2023-10-07T08:49:14.475506+0000","last_clean":"2023-10-07T08:49:14.475506+0000","last_became_active":"2023-10-07T08:49:14.475175+0000","last_became_peered":"2023-10-07T08:49:14.475175+0000","last_unstale":"2023-10-07T08:49:14.475506+0000","last_undegraded":"2023-10-07T08:49:14.475506+0000","last_fullsized":"2023-10-07T08:49:14.475506+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:54.186570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.479608+0000","last_change":"2023-10-07T08:49:14.479608+0000","last_active":"2023-10-07T08:49:14.479608+0000","last_peered":"2023-10-07T08:49:14.479608+0000","last_clean":"2023-10-07T08:49:14.479608+0000","last_became_active":"2023-10-07T08:49:14.477809+0000","last_became_peered":"2023-10-07T08:49:14.477809+0000","last_unstale":"2023-10-07T08:49:14.479608+0000","last_undegraded":"2023-10-07T08:49:14.479608+0000","last_fullsized":"2023-10-07T08:49:14.479608+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:20:43.010381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.465667+0000","last_change":"2023-10-07T08:49:14.465667+0000","last_active":"2023-10-07T08:49:14.465667+0000","last_peered":"2023-10-07T08:49:14.465667+0000","last_clean":"2023-10-07T08:49:14.465667+0000","last_became_active":"2023-10-07T08:49:14.465444+0000","last_became_peered":"2023-10-07T08:49:14.465444+0000","last_unstale":"2023-10-07T08:49:14.465667+0000","last_undegraded":"2023-10-07T08:49:14.465667+0000","last_fullsized":"2023-10-07T08:49:14.465667+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:35:41.444656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.468321+0000","last_change":"2023-10-07T08:49:14.468321+0000","last_active":"2023-10-07T08:49:14.468321+0000","last_peered":"2023-10-07T08:49:14.468321+0000","last_clean":"2023-10-07T08:49:14.468321+0000","last_became_active":"2023-10-07T08:49:14.468013+0000","last_became_peered":"2023-10-07T08:49:14.468013+0000","last_unstale":"2023-10-07T08:49:14.468321+0000","last_undegraded":"2023-10-07T08:49:14.468321+0000","last_fullsized":"2023-10-07T08:49:14.468321+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:28:49.091702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.475790+0000","last_change":"2023-10-07T08:49:14.475790+0000","last_active":"2023-10-07T08:49:14.475790+0000","last_peered":"2023-10-07T08:49:14.475790+0000","last_clean":"2023-10-07T08:49:14.475790+0000","last_became_active":"2023-10-07T08:49:14.475553+0000","last_became_peered":"2023-10-07T08:49:14.475553+0000","last_unstale":"2023-10-07T08:49:14.475790+0000","last_undegraded":"2023-10-07T08:49:14.475790+0000","last_fullsized":"2023-10-07T08:49:14.475790+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:22:39.145551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.467159+0000","last_change":"2023-10-07T08:49:14.467159+0000","last_active":"2023-10-07T08:49:14.467159+0000","last_peered":"2023-10-07T08:49:14.467159+0000","last_clean":"2023-10-07T08:49:14.467159+0000","last_became_active":"2023-10-07T08:49:14.466933+0000","last_became_peered":"2023-10-07T08:49:14.466933+0000","last_unstale":"2023-10-07T08:49:14.467159+0000","last_undegraded":"2023-10-07T08:49:14.467159+0000","last_fullsized":"2023-10-07T08:49:14.467159+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:06:06.984382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.478046+0000","last_change":"2023-10-07T08:49:14.478046+0000","last_active":"2023-10-07T08:49:14.478046+0000","last_peered":"2023-10-07T08:49:14.478046+0000","last_clean":"2023-10-07T08:49:14.478046+0000","last_became_active":"2023-10-07T08:49:14.477430+0000","last_became_peered":"2023-10-07T08:49:14.477430+0000","last_unstale":"2023-10-07T08:49:14.478046+0000","last_undegraded":"2023-10-07T08:49:14.478046+0000","last_fullsized":"2023-10-07T08:49:14.478046+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:28.582922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.478278+0000","last_change":"2023-10-07T08:49:14.478278+0000","last_active":"2023-10-07T08:49:14.478278+0000","last_peered":"2023-10-07T08:49:14.478278+0000","last_clean":"2023-10-07T08:49:14.478278+0000","last_became_active":"2023-10-07T08:49:14.477819+0000","last_became_peered":"2023-10-07T08:49:14.477819+0000","last_unstale":"2023-10-07T08:49:14.478278+0000","last_undegraded":"2023-10-07T08:49:14.478278+0000","last_fullsized":"2023-10-07T08:49:14.478278+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:11:06.390522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.475036+0000","last_change":"2023-10-07T08:49:14.475036+0000","last_active":"2023-10-07T08:49:14.475036+0000","last_peered":"2023-10-07T08:49:14.475036+0000","last_clean":"2023-10-07T08:49:14.475036+0000","last_became_active":"2023-10-07T08:49:14.474704+0000","last_became_peered":"2023-10-07T08:49:14.474704+0000","last_unstale":"2023-10-07T08:49:14.475036+0000","last_undegraded":"2023-10-07T08:49:14.475036+0000","last_fullsized":"2023-10-07T08:49:14.475036+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:37.175734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472683+0000","last_change":"2023-10-07T08:49:14.472683+0000","last_active":"2023-10-07T08:49:14.472683+0000","last_peered":"2023-10-07T08:49:14.472683+0000","last_clean":"2023-10-07T08:49:14.472683+0000","last_became_active":"2023-10-07T08:49:14.472314+0000","last_became_peered":"2023-10-07T08:49:14.472314+0000","last_unstale":"2023-10-07T08:49:14.472683+0000","last_undegraded":"2023-10-07T08:49:14.472683+0000","last_fullsized":"2023-10-07T08:49:14.472683+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:56:51.020724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472926+0000","last_change":"2023-10-07T08:49:14.472926+0000","last_active":"2023-10-07T08:49:14.472926+0000","last_peered":"2023-10-07T08:49:14.472926+0000","last_clean":"2023-10-07T08:49:14.472926+0000","last_became_active":"2023-10-07T08:49:14.472623+0000","last_became_peered":"2023-10-07T08:49:14.472623+0000","last_unstale":"2023-10-07T08:49:14.472926+0000","last_undegraded":"2023-10-07T08:49:14.472926+0000","last_fullsized":"2023-10-07T08:49:14.472926+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:39:15.140640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.474938+0000","last_change":"2023-10-07T08:49:14.474938+0000","last_active":"2023-10-07T08:49:14.474938+0000","last_peered":"2023-10-07T08:49:14.474938+0000","last_clean":"2023-10-07T08:49:14.474938+0000","last_became_active":"2023-10-07T08:49:14.474470+0000","last_became_peered":"2023-10-07T08:49:14.474470+0000","last_unstale":"2023-10-07T08:49:14.474938+0000","last_undegraded":"2023-10-07T08:49:14.474938+0000","last_fullsized":"2023-10-07T08:49:14.474938+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:50.571206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472816+0000","last_change":"2023-10-07T08:49:14.472816+0000","last_active":"2023-10-07T08:49:14.472816+0000","last_peered":"2023-10-07T08:49:14.472816+0000","last_clean":"2023-10-07T08:49:14.472816+0000","last_became_active":"2023-10-07T08:49:14.471610+0000","last_became_peered":"2023-10-07T08:49:14.471610+0000","last_unstale":"2023-10-07T08:49:14.472816+0000","last_undegraded":"2023-10-07T08:49:14.472816+0000","last_fullsized":"2023-10-07T08:49:14.472816+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:54.748921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.477094+0000","last_change":"2023-10-07T08:49:14.477094+0000","last_active":"2023-10-07T08:49:14.477094+0000","last_peered":"2023-10-07T08:49:14.477094+0000","last_clean":"2023-10-07T08:49:14.477094+0000","last_became_active":"2023-10-07T08:49:14.476873+0000","last_became_peered":"2023-10-07T08:49:14.476873+0000","last_unstale":"2023-10-07T08:49:14.477094+0000","last_undegraded":"2023-10-07T08:49:14.477094+0000","last_fullsized":"2023-10-07T08:49:14.477094+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:30:24.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.467345+0000","last_change":"2023-10-07T08:49:14.467345+0000","last_active":"2023-10-07T08:49:14.467345+0000","last_peered":"2023-10-07T08:49:14.467345+0000","last_clean":"2023-10-07T08:49:14.467345+0000","last_became_active":"2023-10-07T08:49:14.466744+0000","last_became_peered":"2023-10-07T08:49:14.466744+0000","last_unstale":"2023-10-07T08:49:14.467345+0000","last_undegraded":"2023-10-07T08:49:14.467345+0000","last_fullsized":"2023-10-07T08:49:14.467345+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:41.873663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.470013+0000","last_change":"2023-10-07T08:49:14.470013+0000","last_active":"2023-10-07T08:49:14.470013+0000","last_peered":"2023-10-07T08:49:14.470013+0000","last_clean":"2023-10-07T08:49:14.470013+0000","last_became_active":"2023-10-07T08:49:14.469816+0000","last_became_peered":"2023-10-07T08:49:14.469816+0000","last_unstale":"2023-10-07T08:49:14.470013+0000","last_undegraded":"2023-10-07T08:49:14.470013+0000","last_fullsized":"2023-10-07T08:49:14.470013+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:20:43.010381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.477861+0000","last_change":"2023-10-07T08:49:14.477861+0000","last_active":"2023-10-07T08:49:14.477861+0000","last_peered":"2023-10-07T08:49:14.477861+0000","last_clean":"2023-10-07T08:49:14.477861+0000","last_became_active":"2023-10-07T08:49:14.477677+0000","last_became_peered":"2023-10-07T08:49:14.477677+0000","last_unstale":"2023-10-07T08:49:14.477861+0000","last_undegraded":"2023-10-07T08:49:14.477861+0000","last_fullsized":"2023-10-07T08:49:14.477861+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:26:29.533708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.476702+0000","last_change":"2023-10-07T08:49:14.476702+0000","last_active":"2023-10-07T08:49:14.476702+0000","last_peered":"2023-10-07T08:49:14.476702+0000","last_clean":"2023-10-07T08:49:14.476702+0000","last_became_active":"2023-10-07T08:49:14.476450+0000","last_became_peered":"2023-10-07T08:49:14.476450+0000","last_unstale":"2023-10-07T08:49:14.476702+0000","last_undegraded":"2023-10-07T08:49:14.476702+0000","last_fullsized":"2023-10-07T08:49:14.476702+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:54.748921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472922+0000","last_change":"2023-10-07T08:49:14.472922+0000","last_active":"2023-10-07T08:49:14.472922+0000","last_peered":"2023-10-07T08:49:14.472922+0000","last_clean":"2023-10-07T08:49:14.472922+0000","last_became_active":"2023-10-07T08:49:14.472638+0000","last_became_peered":"2023-10-07T08:49:14.472638+0000","last_unstale":"2023-10-07T08:49:14.472922+0000","last_undegraded":"2023-10-07T08:49:14.472922+0000","last_fullsized":"2023-10-07T08:49:14.472922+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:11.790537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472546+0000","last_change":"2023-10-07T08:49:14.472546+0000","last_active":"2023-10-07T08:49:14.472546+0000","last_peered":"2023-10-07T08:49:14.472546+0000","last_clean":"2023-10-07T08:49:14.472546+0000","last_became_active":"2023-10-07T08:49:14.471996+0000","last_became_peered":"2023-10-07T08:49:14.471996+0000","last_unstale":"2023-10-07T08:49:14.472546+0000","last_undegraded":"2023-10-07T08:49:14.472546+0000","last_fullsized":"2023-10-07T08:49:14.472546+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:42:20.337252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.474292+0000","last_change":"2023-10-07T08:49:14.474292+0000","last_active":"2023-10-07T08:49:14.474292+0000","last_peered":"2023-10-07T08:49:14.474292+0000","last_clean":"2023-10-07T08:49:14.474292+0000","last_became_active":"2023-10-07T08:49:14.473924+0000","last_became_peered":"2023-10-07T08:49:14.473924+0000","last_unstale":"2023-10-07T08:49:14.474292+0000","last_undegraded":"2023-10-07T08:49:14.474292+0000","last_fullsized":"2023-10-07T08:49:14.474292+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:02:29.280720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.466136+0000","last_change":"2023-10-07T08:49:14.466136+0000","last_active":"2023-10-07T08:49:14.466136+0000","last_peered":"2023-10-07T08:49:14.466136+0000","last_clean":"2023-10-07T08:49:14.466136+0000","last_became_active":"2023-10-07T08:49:14.465914+0000","last_became_peered":"2023-10-07T08:49:14.465914+0000","last_unstale":"2023-10-07T08:49:14.466136+0000","last_undegraded":"2023-10-07T08:49:14.466136+0000","last_fullsized":"2023-10-07T08:49:14.466136+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:43:27.281523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.471978+0000","last_change":"2023-10-07T08:49:14.471978+0000","last_active":"2023-10-07T08:49:14.471978+0000","last_peered":"2023-10-07T08:49:14.471978+0000","last_clean":"2023-10-07T08:49:14.471978+0000","last_became_active":"2023-10-07T08:49:14.471744+0000","last_became_peered":"2023-10-07T08:49:14.471744+0000","last_unstale":"2023-10-07T08:49:14.471978+0000","last_undegraded":"2023-10-07T08:49:14.471978+0000","last_fullsized":"2023-10-07T08:49:14.471978+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:01:24.930712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.471188+0000","last_change":"2023-10-07T08:49:14.471188+0000","last_active":"2023-10-07T08:49:14.471188+0000","last_peered":"2023-10-07T08:49:14.471188+0000","last_clean":"2023-10-07T08:49:14.471188+0000","last_became_active":"2023-10-07T08:49:14.470962+0000","last_became_peered":"2023-10-07T08:49:14.470962+0000","last_unstale":"2023-10-07T08:49:14.471188+0000","last_undegraded":"2023-10-07T08:49:14.471188+0000","last_fullsized":"2023-10-07T08:49:14.471188+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:33:01.934423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.471024+0000","last_change":"2023-10-07T08:49:14.471024+0000","last_active":"2023-10-07T08:49:14.471024+0000","last_peered":"2023-10-07T08:49:14.471024+0000","last_clean":"2023-10-07T08:49:14.471024+0000","last_became_active":"2023-10-07T08:49:14.470802+0000","last_became_peered":"2023-10-07T08:49:14.470802+0000","last_unstale":"2023-10-07T08:49:14.471024+0000","last_undegraded":"2023-10-07T08:49:14.471024+0000","last_fullsized":"2023-10-07T08:49:14.471024+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:04:54.572186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.474139+0000","last_change":"2023-10-07T08:49:14.474139+0000","last_active":"2023-10-07T08:49:14.474139+0000","last_peered":"2023-10-07T08:49:14.474139+0000","last_clean":"2023-10-07T08:49:14.474139+0000","last_became_active":"2023-10-07T08:49:14.473676+0000","last_became_peered":"2023-10-07T08:49:14.473676+0000","last_unstale":"2023-10-07T08:49:14.474139+0000","last_undegraded":"2023-10-07T08:49:14.474139+0000","last_fullsized":"2023-10-07T08:49:14.474139+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:18.042529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.474772+0000","last_change":"2023-10-07T08:49:14.474772+0000","last_active":"2023-10-07T08:49:14.474772+0000","last_peered":"2023-10-07T08:49:14.474772+0000","last_clean":"2023-10-07T08:49:14.474772+0000","last_became_active":"2023-10-07T08:49:14.474429+0000","last_became_peered":"2023-10-07T08:49:14.474429+0000","last_unstale":"2023-10-07T08:49:14.474772+0000","last_undegraded":"2023-10-07T08:49:14.474772+0000","last_fullsized":"2023-10-07T08:49:14.474772+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:41:40.587489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"137'4","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.483333+0000","last_change":"2023-10-07T08:49:13.469655+0000","last_active":"2023-10-07T08:49:14.483333+0000","last_peered":"2023-10-07T08:49:14.483333+0000","last_clean":"2023-10-07T08:49:14.483333+0000","last_became_active":"2023-10-07T08:49:13.469432+0000","last_became_peered":"2023-10-07T08:49:13.469432+0000","last_unstale":"2023-10-07T08:49:14.483333+0000","last_undegraded":"2023-10-07T08:49:14.483333+0000","last_fullsized":"2023-10-07T08:49:14.483333+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:19.281326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.479296+0000","last_change":"2023-10-07T08:49:14.479296+0000","last_active":"2023-10-07T08:49:14.479296+0000","last_peered":"2023-10-07T08:49:14.479296+0000","last_clean":"2023-10-07T08:49:14.479296+0000","last_became_active":"2023-10-07T08:49:14.478933+0000","last_became_peered":"2023-10-07T08:49:14.478933+0000","last_unstale":"2023-10-07T08:49:14.479296+0000","last_undegraded":"2023-10-07T08:49:14.479296+0000","last_fullsized":"2023-10-07T08:49:14.479296+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:11.790537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.470134+0000","last_change":"2023-10-07T08:49:13.471412+0000","last_active":"2023-10-07T08:49:14.470134+0000","last_peered":"2023-10-07T08:49:14.470134+0000","last_clean":"2023-10-07T08:49:14.470134+0000","last_became_active":"2023-10-07T08:49:13.470870+0000","last_became_peered":"2023-10-07T08:49:13.470870+0000","last_unstale":"2023-10-07T08:49:14.470134+0000","last_undegraded":"2023-10-07T08:49:14.470134+0000","last_fullsized":"2023-10-07T08:49:14.470134+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:10.784309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.473138+0000","last_change":"2023-10-07T08:49:14.473138+0000","last_active":"2023-10-07T08:49:14.473138+0000","last_peered":"2023-10-07T08:49:14.473138+0000","last_clean":"2023-10-07T08:49:14.473138+0000","last_became_active":"2023-10-07T08:49:14.472657+0000","last_became_peered":"2023-10-07T08:49:14.472657+0000","last_unstale":"2023-10-07T08:49:14.473138+0000","last_undegraded":"2023-10-07T08:49:14.473138+0000","last_fullsized":"2023-10-07T08:49:14.473138+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:20.287554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.480718+0000","last_change":"2023-10-07T08:49:13.467031+0000","last_active":"2023-10-07T08:49:14.480718+0000","last_peered":"2023-10-07T08:49:14.480718+0000","last_clean":"2023-10-07T08:49:14.480718+0000","last_became_active":"2023-10-07T08:49:13.466614+0000","last_became_peered":"2023-10-07T08:49:13.466614+0000","last_unstale":"2023-10-07T08:49:14.480718+0000","last_undegraded":"2023-10-07T08:49:14.480718+0000","last_fullsized":"2023-10-07T08:49:14.480718+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:35.716431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.475815+0000","last_change":"2023-10-07T08:49:14.475815+0000","last_active":"2023-10-07T08:49:14.475815+0000","last_peered":"2023-10-07T08:49:14.475815+0000","last_clean":"2023-10-07T08:49:14.475815+0000","last_became_active":"2023-10-07T08:49:14.475591+0000","last_became_peered":"2023-10-07T08:49:14.475591+0000","last_unstale":"2023-10-07T08:49:14.475815+0000","last_undegraded":"2023-10-07T08:49:14.475815+0000","last_fullsized":"2023-10-07T08:49:14.475815+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:10.980930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.480721+0000","last_change":"2023-10-07T08:49:13.466067+0000","last_active":"2023-10-07T08:49:14.480721+0000","last_peered":"2023-10-07T08:49:14.480721+0000","last_clean":"2023-10-07T08:49:14.480721+0000","last_became_active":"2023-10-07T08:49:13.465488+0000","last_became_peered":"2023-10-07T08:49:13.465488+0000","last_unstale":"2023-10-07T08:49:14.480721+0000","last_undegraded":"2023-10-07T08:49:14.480721+0000","last_fullsized":"2023-10-07T08:49:14.480721+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:36:04.550858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.466636+0000","last_change":"2023-10-07T08:49:14.466636+0000","last_active":"2023-10-07T08:49:14.466636+0000","last_peered":"2023-10-07T08:49:14.466636+0000","last_clean":"2023-10-07T08:49:14.466636+0000","last_became_active":"2023-10-07T08:49:14.466410+0000","last_became_peered":"2023-10-07T08:49:14.466410+0000","last_unstale":"2023-10-07T08:49:14.466636+0000","last_undegraded":"2023-10-07T08:49:14.466636+0000","last_fullsized":"2023-10-07T08:49:14.466636+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:36:24.130466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472679+0000","last_change":"2023-10-07T08:49:13.472482+0000","last_active":"2023-10-07T08:49:14.472679+0000","last_peered":"2023-10-07T08:49:14.472679+0000","last_clean":"2023-10-07T08:49:14.472679+0000","last_became_active":"2023-10-07T08:49:13.472256+0000","last_became_peered":"2023-10-07T08:49:13.472256+0000","last_unstale":"2023-10-07T08:49:14.472679+0000","last_undegraded":"2023-10-07T08:49:14.472679+0000","last_fullsized":"2023-10-07T08:49:14.472679+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:47:16.310703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.476635+0000","last_change":"2023-10-07T08:49:14.476635+0000","last_active":"2023-10-07T08:49:14.476635+0000","last_peered":"2023-10-07T08:49:14.476635+0000","last_clean":"2023-10-07T08:49:14.476635+0000","last_became_active":"2023-10-07T08:49:14.476064+0000","last_became_peered":"2023-10-07T08:49:14.476064+0000","last_unstale":"2023-10-07T08:49:14.476635+0000","last_undegraded":"2023-10-07T08:49:14.476635+0000","last_fullsized":"2023-10-07T08:49:14.476635+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:53:40.319088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.461356+0000","last_change":"2023-10-07T08:49:13.474162+0000","last_active":"2023-10-07T08:49:14.461356+0000","last_peered":"2023-10-07T08:49:14.461356+0000","last_clean":"2023-10-07T08:49:14.461356+0000","last_became_active":"2023-10-07T08:49:13.474041+0000","last_became_peered":"2023-10-07T08:49:13.474041+0000","last_unstale":"2023-10-07T08:49:14.461356+0000","last_undegraded":"2023-10-07T08:49:14.461356+0000","last_fullsized":"2023-10-07T08:49:14.461356+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:23:15.106111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.476060+0000","last_change":"2023-10-07T08:49:14.476060+0000","last_active":"2023-10-07T08:49:14.476060+0000","last_peered":"2023-10-07T08:49:14.476060+0000","last_clean":"2023-10-07T08:49:14.476060+0000","last_became_active":"2023-10-07T08:49:14.475705+0000","last_became_peered":"2023-10-07T08:49:14.475705+0000","last_unstale":"2023-10-07T08:49:14.476060+0000","last_undegraded":"2023-10-07T08:49:14.476060+0000","last_fullsized":"2023-10-07T08:49:14.476060+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:08:15.920218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.475967+0000","last_change":"2023-10-07T08:49:13.475920+0000","last_active":"2023-10-07T08:49:13.475967+0000","last_peered":"2023-10-07T08:49:13.475967+0000","last_clean":"2023-10-07T08:49:13.475967+0000","last_became_active":"2023-10-07T08:49:13.475784+0000","last_became_peered":"2023-10-07T08:49:13.475784+0000","last_unstale":"2023-10-07T08:49:13.475967+0000","last_undegraded":"2023-10-07T08:49:13.475967+0000","last_fullsized":"2023-10-07T08:49:13.475967+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:02:28.274492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.470735+0000","last_change":"2023-10-07T08:49:14.470735+0000","last_active":"2023-10-07T08:49:14.470735+0000","last_peered":"2023-10-07T08:49:14.470735+0000","last_clean":"2023-10-07T08:49:14.470735+0000","last_became_active":"2023-10-07T08:49:14.470494+0000","last_became_peered":"2023-10-07T08:49:14.470494+0000","last_unstale":"2023-10-07T08:49:14.470735+0000","last_undegraded":"2023-10-07T08:49:14.470735+0000","last_fullsized":"2023-10-07T08:49:14.470735+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:50:54.109509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.464357+0000","last_change":"2023-10-07T08:49:13.464231+0000","last_active":"2023-10-07T08:49:13.464357+0000","last_peered":"2023-10-07T08:49:13.464357+0000","last_clean":"2023-10-07T08:49:13.464357+0000","last_became_active":"2023-10-07T08:49:13.463992+0000","last_became_peered":"2023-10-07T08:49:13.463992+0000","last_unstale":"2023-10-07T08:49:13.464357+0000","last_undegraded":"2023-10-07T08:49:13.464357+0000","last_fullsized":"2023-10-07T08:49:13.464357+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:26:28.527480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.473353+0000","last_change":"2023-10-07T08:49:14.473353+0000","last_active":"2023-10-07T08:49:14.473353+0000","last_peered":"2023-10-07T08:49:14.473353+0000","last_clean":"2023-10-07T08:49:14.473353+0000","last_became_active":"2023-10-07T08:49:14.473037+0000","last_became_peered":"2023-10-07T08:49:14.473037+0000","last_unstale":"2023-10-07T08:49:14.473353+0000","last_undegraded":"2023-10-07T08:49:14.473353+0000","last_fullsized":"2023-10-07T08:49:14.473353+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:38:07.395155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.466272+0000","last_change":"2023-10-07T08:49:13.466212+0000","last_active":"2023-10-07T08:49:13.466272+0000","last_peered":"2023-10-07T08:49:13.466272+0000","last_clean":"2023-10-07T08:49:13.466272+0000","last_became_active":"2023-10-07T08:49:13.465828+0000","last_became_peered":"2023-10-07T08:49:13.465828+0000","last_unstale":"2023-10-07T08:49:13.466272+0000","last_undegraded":"2023-10-07T08:49:13.466272+0000","last_fullsized":"2023-10-07T08:49:13.466272+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:09:24.156056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.479370+0000","last_change":"2023-10-07T08:49:14.479370+0000","last_active":"2023-10-07T08:49:14.479370+0000","last_peered":"2023-10-07T08:49:14.479370+0000","last_clean":"2023-10-07T08:49:14.479370+0000","last_became_active":"2023-10-07T08:49:14.479155+0000","last_became_peered":"2023-10-07T08:49:14.479155+0000","last_unstale":"2023-10-07T08:49:14.479370+0000","last_undegraded":"2023-10-07T08:49:14.479370+0000","last_fullsized":"2023-10-07T08:49:14.479370+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:54.186570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.469316+0000","last_change":"2023-10-07T08:49:13.468900+0000","last_active":"2023-10-07T08:49:13.469316+0000","last_peered":"2023-10-07T08:49:13.469316+0000","last_clean":"2023-10-07T08:49:13.469316+0000","last_became_active":"2023-10-07T08:49:13.468675+0000","last_became_peered":"2023-10-07T08:49:13.468675+0000","last_unstale":"2023-10-07T08:49:13.469316+0000","last_undegraded":"2023-10-07T08:49:13.469316+0000","last_fullsized":"2023-10-07T08:49:13.469316+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:09:29.414661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.469371+0000","last_change":"2023-10-07T08:49:14.469371+0000","last_active":"2023-10-07T08:49:14.469371+0000","last_peered":"2023-10-07T08:49:14.469371+0000","last_clean":"2023-10-07T08:49:14.469371+0000","last_became_active":"2023-10-07T08:49:14.469196+0000","last_became_peered":"2023-10-07T08:49:14.469196+0000","last_unstale":"2023-10-07T08:49:14.469371+0000","last_undegraded":"2023-10-07T08:49:14.469371+0000","last_fullsized":"2023-10-07T08:49:14.469371+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:10.980930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"137'3","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.485902+0000","last_change":"2023-10-07T08:49:13.468031+0000","last_active":"2023-10-07T08:49:14.485902+0000","last_peered":"2023-10-07T08:49:14.485902+0000","last_clean":"2023-10-07T08:49:14.485902+0000","last_became_active":"2023-10-07T08:49:13.467786+0000","last_became_peered":"2023-10-07T08:49:13.467786+0000","last_unstale":"2023-10-07T08:49:14.485902+0000","last_undegraded":"2023-10-07T08:49:14.485902+0000","last_fullsized":"2023-10-07T08:49:14.485902+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:11:05.384294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.478609+0000","last_change":"2023-10-07T08:49:14.478609+0000","last_active":"2023-10-07T08:49:14.478609+0000","last_peered":"2023-10-07T08:49:14.478609+0000","last_clean":"2023-10-07T08:49:14.478609+0000","last_became_active":"2023-10-07T08:49:14.478380+0000","last_became_peered":"2023-10-07T08:49:14.478380+0000","last_unstale":"2023-10-07T08:49:14.478609+0000","last_undegraded":"2023-10-07T08:49:14.478609+0000","last_fullsized":"2023-10-07T08:49:14.478609+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:53.750164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"137'6","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.486037+0000","last_change":"2023-10-07T08:49:13.464837+0000","last_active":"2023-10-07T08:49:14.486037+0000","last_peered":"2023-10-07T08:49:14.486037+0000","last_clean":"2023-10-07T08:49:14.486037+0000","last_became_active":"2023-10-07T08:49:13.464586+0000","last_became_peered":"2023-10-07T08:49:13.464586+0000","last_unstale":"2023-10-07T08:49:14.486037+0000","last_undegraded":"2023-10-07T08:49:14.486037+0000","last_fullsized":"2023-10-07T08:49:14.486037+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:04:30.019059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.470543+0000","last_change":"2023-10-07T08:49:14.470543+0000","last_active":"2023-10-07T08:49:14.470543+0000","last_peered":"2023-10-07T08:49:14.470543+0000","last_clean":"2023-10-07T08:49:14.470543+0000","last_became_active":"2023-10-07T08:49:14.470342+0000","last_became_peered":"2023-10-07T08:49:14.470342+0000","last_unstale":"2023-10-07T08:49:14.470543+0000","last_undegraded":"2023-10-07T08:49:14.470543+0000","last_fullsized":"2023-10-07T08:49:14.470543+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:13:10.145770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.482245+0000","last_change":"2023-10-07T08:49:13.471165+0000","last_active":"2023-10-07T08:49:14.482245+0000","last_peered":"2023-10-07T08:49:14.482245+0000","last_clean":"2023-10-07T08:49:14.482245+0000","last_became_active":"2023-10-07T08:49:13.470927+0000","last_became_peered":"2023-10-07T08:49:13.470927+0000","last_unstale":"2023-10-07T08:49:14.482245+0000","last_undegraded":"2023-10-07T08:49:14.482245+0000","last_fullsized":"2023-10-07T08:49:14.482245+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:36.652642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.476665+0000","last_change":"2023-10-07T08:49:14.476665+0000","last_active":"2023-10-07T08:49:14.476665+0000","last_peered":"2023-10-07T08:49:14.476665+0000","last_clean":"2023-10-07T08:49:14.476665+0000","last_became_active":"2023-10-07T08:49:14.476437+0000","last_became_peered":"2023-10-07T08:49:14.476437+0000","last_unstale":"2023-10-07T08:49:14.476665+0000","last_undegraded":"2023-10-07T08:49:14.476665+0000","last_fullsized":"2023-10-07T08:49:14.476665+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:24.189834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.469684+0000","last_change":"2023-10-07T08:49:13.469622+0000","last_active":"2023-10-07T08:49:13.469684+0000","last_peered":"2023-10-07T08:49:13.469684+0000","last_clean":"2023-10-07T08:49:13.469684+0000","last_became_active":"2023-10-07T08:49:13.468996+0000","last_became_peered":"2023-10-07T08:49:13.468996+0000","last_unstale":"2023-10-07T08:49:13.469684+0000","last_undegraded":"2023-10-07T08:49:13.469684+0000","last_fullsized":"2023-10-07T08:49:13.469684+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:17.036301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.467807+0000","last_change":"2023-10-07T08:49:14.467807+0000","last_active":"2023-10-07T08:49:14.467807+0000","last_peered":"2023-10-07T08:49:14.467807+0000","last_clean":"2023-10-07T08:49:14.467807+0000","last_became_active":"2023-10-07T08:49:14.467591+0000","last_became_peered":"2023-10-07T08:49:14.467591+0000","last_unstale":"2023-10-07T08:49:14.467807+0000","last_undegraded":"2023-10-07T08:49:14.467807+0000","last_fullsized":"2023-10-07T08:49:14.467807+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:04:31.025287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"137'8","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.484063+0000","last_change":"2023-10-07T08:49:13.465326+0000","last_active":"2023-10-07T08:49:14.484063+0000","last_peered":"2023-10-07T08:49:14.484063+0000","last_clean":"2023-10-07T08:49:14.484063+0000","last_became_active":"2023-10-07T08:49:13.464257+0000","last_became_peered":"2023-10-07T08:49:13.464257+0000","last_unstale":"2023-10-07T08:49:14.484063+0000","last_undegraded":"2023-10-07T08:49:14.484063+0000","last_fullsized":"2023-10-07T08:49:14.484063+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:39:24.625180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472299+0000","last_change":"2023-10-07T08:49:14.472299+0000","last_active":"2023-10-07T08:49:14.472299+0000","last_peered":"2023-10-07T08:49:14.472299+0000","last_clean":"2023-10-07T08:49:14.472299+0000","last_became_active":"2023-10-07T08:49:14.471954+0000","last_became_peered":"2023-10-07T08:49:14.471954+0000","last_unstale":"2023-10-07T08:49:14.472299+0000","last_undegraded":"2023-10-07T08:49:14.472299+0000","last_fullsized":"2023-10-07T08:49:14.472299+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:28:40.822401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.463489+0000","last_change":"2023-10-07T08:49:13.469646+0000","last_active":"2023-10-07T08:49:14.463489+0000","last_peered":"2023-10-07T08:49:14.463489+0000","last_clean":"2023-10-07T08:49:14.463489+0000","last_became_active":"2023-10-07T08:49:13.468726+0000","last_became_peered":"2023-10-07T08:49:13.468726+0000","last_unstale":"2023-10-07T08:49:14.463489+0000","last_undegraded":"2023-10-07T08:49:14.463489+0000","last_fullsized":"2023-10-07T08:49:14.463489+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:22:38.139323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.474640+0000","last_change":"2023-10-07T08:49:14.474640+0000","last_active":"2023-10-07T08:49:14.474640+0000","last_peered":"2023-10-07T08:49:14.474640+0000","last_clean":"2023-10-07T08:49:14.474640+0000","last_became_active":"2023-10-07T08:49:14.474174+0000","last_became_peered":"2023-10-07T08:49:14.474174+0000","last_unstale":"2023-10-07T08:49:14.474640+0000","last_undegraded":"2023-10-07T08:49:14.474640+0000","last_fullsized":"2023-10-07T08:49:14.474640+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:15:29.752692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.481547+0000","last_change":"2023-10-07T08:49:13.472087+0000","last_active":"2023-10-07T08:49:14.481547+0000","last_peered":"2023-10-07T08:49:14.481547+0000","last_clean":"2023-10-07T08:49:14.481547+0000","last_became_active":"2023-10-07T08:49:13.471881+0000","last_became_peered":"2023-10-07T08:49:13.471881+0000","last_unstale":"2023-10-07T08:49:14.481547+0000","last_undegraded":"2023-10-07T08:49:14.481547+0000","last_fullsized":"2023-10-07T08:49:14.481547+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:35:19.038815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472489+0000","last_change":"2023-10-07T08:49:14.472489+0000","last_active":"2023-10-07T08:49:14.472489+0000","last_peered":"2023-10-07T08:49:14.472489+0000","last_clean":"2023-10-07T08:49:14.472489+0000","last_became_active":"2023-10-07T08:49:14.472263+0000","last_became_peered":"2023-10-07T08:49:14.472263+0000","last_unstale":"2023-10-07T08:49:14.472489+0000","last_undegraded":"2023-10-07T08:49:14.472489+0000","last_fullsized":"2023-10-07T08:49:14.472489+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:24.189834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.471076+0000","last_change":"2023-10-07T08:49:13.474366+0000","last_active":"2023-10-07T08:49:14.471076+0000","last_peered":"2023-10-07T08:49:14.471076+0000","last_clean":"2023-10-07T08:49:14.471076+0000","last_became_active":"2023-10-07T08:49:13.474160+0000","last_became_peered":"2023-10-07T08:49:13.474160+0000","last_unstale":"2023-10-07T08:49:14.471076+0000","last_undegraded":"2023-10-07T08:49:14.471076+0000","last_fullsized":"2023-10-07T08:49:14.471076+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:47:16.310703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.474180+0000","last_change":"2023-10-07T08:49:14.474180+0000","last_active":"2023-10-07T08:49:14.474180+0000","last_peered":"2023-10-07T08:49:14.474180+0000","last_clean":"2023-10-07T08:49:14.474180+0000","last_became_active":"2023-10-07T08:49:14.473891+0000","last_became_peered":"2023-10-07T08:49:14.473891+0000","last_unstale":"2023-10-07T08:49:14.474180+0000","last_undegraded":"2023-10-07T08:49:14.474180+0000","last_fullsized":"2023-10-07T08:49:14.474180+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:22:39.145551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.471917+0000","last_change":"2023-10-07T08:49:13.471851+0000","last_active":"2023-10-07T08:49:13.471917+0000","last_peered":"2023-10-07T08:49:13.471917+0000","last_clean":"2023-10-07T08:49:13.471917+0000","last_became_active":"2023-10-07T08:49:13.471276+0000","last_became_peered":"2023-10-07T08:49:13.471276+0000","last_unstale":"2023-10-07T08:49:13.471917+0000","last_undegraded":"2023-10-07T08:49:13.471917+0000","last_fullsized":"2023-10-07T08:49:13.471917+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:01:09.717760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.473109+0000","last_change":"2023-10-07T08:49:14.473109+0000","last_active":"2023-10-07T08:49:14.473109+0000","last_peered":"2023-10-07T08:49:14.473109+0000","last_clean":"2023-10-07T08:49:14.473109+0000","last_became_active":"2023-10-07T08:49:14.471896+0000","last_became_peered":"2023-10-07T08:49:14.471896+0000","last_unstale":"2023-10-07T08:49:14.473109+0000","last_undegraded":"2023-10-07T08:49:14.473109+0000","last_fullsized":"2023-10-07T08:49:14.473109+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:43:27.281523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.483667+0000","last_change":"2023-10-07T08:49:13.465865+0000","last_active":"2023-10-07T08:49:14.483667+0000","last_peered":"2023-10-07T08:49:14.483667+0000","last_clean":"2023-10-07T08:49:14.483667+0000","last_became_active":"2023-10-07T08:49:13.465244+0000","last_became_peered":"2023-10-07T08:49:13.465244+0000","last_unstale":"2023-10-07T08:49:14.483667+0000","last_undegraded":"2023-10-07T08:49:14.483667+0000","last_fullsized":"2023-10-07T08:49:14.483667+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:36:23.506302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.478063+0000","last_change":"2023-10-07T08:49:14.478063+0000","last_active":"2023-10-07T08:49:14.478063+0000","last_peered":"2023-10-07T08:49:14.478063+0000","last_clean":"2023-10-07T08:49:14.478063+0000","last_became_active":"2023-10-07T08:49:14.477844+0000","last_became_peered":"2023-10-07T08:49:14.477844+0000","last_unstale":"2023-10-07T08:49:14.478063+0000","last_undegraded":"2023-10-07T08:49:14.478063+0000","last_fullsized":"2023-10-07T08:49:14.478063+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:31:28.878755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.465990+0000","last_change":"2023-10-07T08:49:13.465746+0000","last_active":"2023-10-07T08:49:13.465990+0000","last_peered":"2023-10-07T08:49:13.465990+0000","last_clean":"2023-10-07T08:49:13.465990+0000","last_became_active":"2023-10-07T08:49:13.465504+0000","last_became_peered":"2023-10-07T08:49:13.465504+0000","last_unstale":"2023-10-07T08:49:13.465990+0000","last_undegraded":"2023-10-07T08:49:13.465990+0000","last_fullsized":"2023-10-07T08:49:13.465990+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:31:29.334053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.473334+0000","last_change":"2023-10-07T08:49:14.473334+0000","last_active":"2023-10-07T08:49:14.473334+0000","last_peered":"2023-10-07T08:49:14.473334+0000","last_clean":"2023-10-07T08:49:14.473334+0000","last_became_active":"2023-10-07T08:49:14.473051+0000","last_became_peered":"2023-10-07T08:49:14.473051+0000","last_unstale":"2023-10-07T08:49:14.473334+0000","last_undegraded":"2023-10-07T08:49:14.473334+0000","last_fullsized":"2023-10-07T08:49:14.473334+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:13:10.145770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.463957+0000","last_change":"2023-10-07T08:49:13.463478+0000","last_active":"2023-10-07T08:49:13.463957+0000","last_peered":"2023-10-07T08:49:13.463957+0000","last_clean":"2023-10-07T08:49:13.463957+0000","last_became_active":"2023-10-07T08:49:13.463246+0000","last_became_peered":"2023-10-07T08:49:13.463246+0000","last_unstale":"2023-10-07T08:49:13.463957+0000","last_undegraded":"2023-10-07T08:49:13.463957+0000","last_fullsized":"2023-10-07T08:49:13.463957+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:56:51.360397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.464853+0000","last_change":"2023-10-07T08:49:14.464853+0000","last_active":"2023-10-07T08:49:14.464853+0000","last_peered":"2023-10-07T08:49:14.464853+0000","last_clean":"2023-10-07T08:49:14.464853+0000","last_became_active":"2023-10-07T08:49:14.464620+0000","last_became_peered":"2023-10-07T08:49:14.464620+0000","last_unstale":"2023-10-07T08:49:14.464853+0000","last_undegraded":"2023-10-07T08:49:14.464853+0000","last_fullsized":"2023-10-07T08:49:14.464853+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:11:06.390522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.467978+0000","last_change":"2023-10-07T08:49:13.467893+0000","last_active":"2023-10-07T08:49:13.467978+0000","last_peered":"2023-10-07T08:49:13.467978+0000","last_clean":"2023-10-07T08:49:13.467978+0000","last_became_active":"2023-10-07T08:49:13.467613+0000","last_became_peered":"2023-10-07T08:49:13.467613+0000","last_unstale":"2023-10-07T08:49:13.467978+0000","last_undegraded":"2023-10-07T08:49:13.467978+0000","last_fullsized":"2023-10-07T08:49:13.467978+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:20:42.004153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.475082+0000","last_change":"2023-10-07T08:49:14.475082+0000","last_active":"2023-10-07T08:49:14.475082+0000","last_peered":"2023-10-07T08:49:14.475082+0000","last_clean":"2023-10-07T08:49:14.475082+0000","last_became_active":"2023-10-07T08:49:14.474730+0000","last_became_peered":"2023-10-07T08:49:14.474730+0000","last_unstale":"2023-10-07T08:49:14.475082+0000","last_undegraded":"2023-10-07T08:49:14.475082+0000","last_fullsized":"2023-10-07T08:49:14.475082+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:33:01.934423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.482665+0000","last_change":"2023-10-07T08:49:13.466482+0000","last_active":"2023-10-07T08:49:14.482665+0000","last_peered":"2023-10-07T08:49:14.482665+0000","last_clean":"2023-10-07T08:49:14.482665+0000","last_became_active":"2023-10-07T08:49:13.466265+0000","last_became_peered":"2023-10-07T08:49:13.466265+0000","last_unstale":"2023-10-07T08:49:14.482665+0000","last_undegraded":"2023-10-07T08:49:14.482665+0000","last_fullsized":"2023-10-07T08:49:14.482665+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:10.784309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.468189+0000","last_change":"2023-10-07T08:49:14.468189+0000","last_active":"2023-10-07T08:49:14.468189+0000","last_peered":"2023-10-07T08:49:14.468189+0000","last_clean":"2023-10-07T08:49:14.468189+0000","last_became_active":"2023-10-07T08:49:14.467784+0000","last_became_peered":"2023-10-07T08:49:14.467784+0000","last_unstale":"2023-10-07T08:49:14.468189+0000","last_undegraded":"2023-10-07T08:49:14.468189+0000","last_fullsized":"2023-10-07T08:49:14.468189+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:11:57.052128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.473753+0000","last_change":"2023-10-07T08:49:13.473655+0000","last_active":"2023-10-07T08:49:13.473753+0000","last_peered":"2023-10-07T08:49:13.473753+0000","last_clean":"2023-10-07T08:49:13.473753+0000","last_became_active":"2023-10-07T08:49:13.473204+0000","last_became_peered":"2023-10-07T08:49:13.473204+0000","last_unstale":"2023-10-07T08:49:13.473753+0000","last_undegraded":"2023-10-07T08:49:13.473753+0000","last_fullsized":"2023-10-07T08:49:13.473753+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:19.281326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.475925+0000","last_change":"2023-10-07T08:49:14.475925+0000","last_active":"2023-10-07T08:49:14.475925+0000","last_peered":"2023-10-07T08:49:14.475925+0000","last_clean":"2023-10-07T08:49:14.475925+0000","last_became_active":"2023-10-07T08:49:14.475401+0000","last_became_peered":"2023-10-07T08:49:14.475401+0000","last_unstale":"2023-10-07T08:49:14.475925+0000","last_undegraded":"2023-10-07T08:49:14.475925+0000","last_fullsized":"2023-10-07T08:49:14.475925+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:10:00.457193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.472761+0000","last_change":"2023-10-07T08:49:13.472709+0000","last_active":"2023-10-07T08:49:13.472761+0000","last_peered":"2023-10-07T08:49:13.472761+0000","last_clean":"2023-10-07T08:49:13.472761+0000","last_became_active":"2023-10-07T08:49:13.472492+0000","last_became_peered":"2023-10-07T08:49:13.472492+0000","last_unstale":"2023-10-07T08:49:13.472761+0000","last_undegraded":"2023-10-07T08:49:13.472761+0000","last_fullsized":"2023-10-07T08:49:13.472761+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:53.742693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472701+0000","last_change":"2023-10-07T08:49:14.472701+0000","last_active":"2023-10-07T08:49:14.472701+0000","last_peered":"2023-10-07T08:49:14.472701+0000","last_clean":"2023-10-07T08:49:14.472701+0000","last_became_active":"2023-10-07T08:49:14.472429+0000","last_became_peered":"2023-10-07T08:49:14.472429+0000","last_unstale":"2023-10-07T08:49:14.472701+0000","last_undegraded":"2023-10-07T08:49:14.472701+0000","last_fullsized":"2023-10-07T08:49:14.472701+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:50:54.109509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.466615+0000","last_change":"2023-10-07T08:49:13.466521+0000","last_active":"2023-10-07T08:49:13.466615+0000","last_peered":"2023-10-07T08:49:13.466615+0000","last_clean":"2023-10-07T08:49:13.466615+0000","last_became_active":"2023-10-07T08:49:13.466290+0000","last_became_peered":"2023-10-07T08:49:13.466290+0000","last_unstale":"2023-10-07T08:49:13.466615+0000","last_undegraded":"2023-10-07T08:49:13.466615+0000","last_fullsized":"2023-10-07T08:49:13.466615+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:49.564978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.474431+0000","last_change":"2023-10-07T08:49:14.474431+0000","last_active":"2023-10-07T08:49:14.474431+0000","last_peered":"2023-10-07T08:49:14.474431+0000","last_clean":"2023-10-07T08:49:14.474431+0000","last_became_active":"2023-10-07T08:49:14.474217+0000","last_became_peered":"2023-10-07T08:49:14.474217+0000","last_unstale":"2023-10-07T08:49:14.474431+0000","last_undegraded":"2023-10-07T08:49:14.474431+0000","last_fullsized":"2023-10-07T08:49:14.474431+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:24.189834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.473400+0000","last_change":"2023-10-07T08:49:13.473079+0000","last_active":"2023-10-07T08:49:13.473400+0000","last_peered":"2023-10-07T08:49:13.473400+0000","last_clean":"2023-10-07T08:49:13.473400+0000","last_became_active":"2023-10-07T08:49:13.472849+0000","last_became_peered":"2023-10-07T08:49:13.472849+0000","last_unstale":"2023-10-07T08:49:13.473400+0000","last_undegraded":"2023-10-07T08:49:13.473400+0000","last_fullsized":"2023-10-07T08:49:13.473400+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:43:07.102018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.467051+0000","last_change":"2023-10-07T08:49:14.467051+0000","last_active":"2023-10-07T08:49:14.467051+0000","last_peered":"2023-10-07T08:49:14.467051+0000","last_clean":"2023-10-07T08:49:14.467051+0000","last_became_active":"2023-10-07T08:49:14.466434+0000","last_became_peered":"2023-10-07T08:49:14.466434+0000","last_unstale":"2023-10-07T08:49:14.467051+0000","last_undegraded":"2023-10-07T08:49:14.467051+0000","last_fullsized":"2023-10-07T08:49:14.467051+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:00:38.351594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.472888+0000","last_change":"2023-10-07T08:49:13.472827+0000","last_active":"2023-10-07T08:49:13.472888+0000","last_peered":"2023-10-07T08:49:13.472888+0000","last_clean":"2023-10-07T08:49:13.472888+0000","last_became_active":"2023-10-07T08:49:13.472535+0000","last_became_peered":"2023-10-07T08:49:13.472535+0000","last_unstale":"2023-10-07T08:49:13.472888+0000","last_undegraded":"2023-10-07T08:49:13.472888+0000","last_fullsized":"2023-10-07T08:49:13.472888+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:15:28.746464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.476703+0000","last_change":"2023-10-07T08:49:14.476703+0000","last_active":"2023-10-07T08:49:14.476703+0000","last_peered":"2023-10-07T08:49:14.476703+0000","last_clean":"2023-10-07T08:49:14.476703+0000","last_became_active":"2023-10-07T08:49:14.476436+0000","last_became_peered":"2023-10-07T08:49:14.476436+0000","last_unstale":"2023-10-07T08:49:14.476703+0000","last_undegraded":"2023-10-07T08:49:14.476703+0000","last_fullsized":"2023-10-07T08:49:14.476703+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:04:31.025287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.467307+0000","last_change":"2023-10-07T08:49:13.467161+0000","last_active":"2023-10-07T08:49:13.467307+0000","last_peered":"2023-10-07T08:49:13.467307+0000","last_clean":"2023-10-07T08:49:13.467307+0000","last_became_active":"2023-10-07T08:49:13.466871+0000","last_became_peered":"2023-10-07T08:49:13.466871+0000","last_unstale":"2023-10-07T08:49:13.467307+0000","last_undegraded":"2023-10-07T08:49:13.467307+0000","last_fullsized":"2023-10-07T08:49:13.467307+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:45:35.576511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.473969+0000","last_change":"2023-10-07T08:49:14.473969+0000","last_active":"2023-10-07T08:49:14.473969+0000","last_peered":"2023-10-07T08:49:14.473969+0000","last_clean":"2023-10-07T08:49:14.473969+0000","last_became_active":"2023-10-07T08:49:14.473365+0000","last_became_peered":"2023-10-07T08:49:14.473365+0000","last_unstale":"2023-10-07T08:49:14.473969+0000","last_undegraded":"2023-10-07T08:49:14.473969+0000","last_fullsized":"2023-10-07T08:49:14.473969+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:49:13.133736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.469853+0000","last_change":"2023-10-07T08:49:13.469784+0000","last_active":"2023-10-07T08:49:13.469853+0000","last_peered":"2023-10-07T08:49:13.469853+0000","last_clean":"2023-10-07T08:49:13.469853+0000","last_became_active":"2023-10-07T08:49:13.469425+0000","last_became_peered":"2023-10-07T08:49:13.469425+0000","last_unstale":"2023-10-07T08:49:13.469853+0000","last_undegraded":"2023-10-07T08:49:13.469853+0000","last_fullsized":"2023-10-07T08:49:13.469853+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:09.974702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.478866+0000","last_change":"2023-10-07T08:49:14.478866+0000","last_active":"2023-10-07T08:49:14.478866+0000","last_peered":"2023-10-07T08:49:14.478866+0000","last_clean":"2023-10-07T08:49:14.478866+0000","last_became_active":"2023-10-07T08:49:14.478628+0000","last_became_peered":"2023-10-07T08:49:14.478628+0000","last_unstale":"2023-10-07T08:49:14.478866+0000","last_undegraded":"2023-10-07T08:49:14.478866+0000","last_fullsized":"2023-10-07T08:49:14.478866+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:22:39.145551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.472558+0000","last_change":"2023-10-07T08:49:13.472006+0000","last_active":"2023-10-07T08:49:13.472558+0000","last_peered":"2023-10-07T08:49:13.472558+0000","last_clean":"2023-10-07T08:49:13.472558+0000","last_became_active":"2023-10-07T08:49:13.471618+0000","last_became_peered":"2023-10-07T08:49:13.471618+0000","last_unstale":"2023-10-07T08:49:13.472558+0000","last_undegraded":"2023-10-07T08:49:13.472558+0000","last_fullsized":"2023-10-07T08:49:13.472558+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:58:53.905682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":260,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.469461+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:49:13.469461+0000","last_peered":"2023-10-07T08:49:13.469461+0000","last_clean":"2023-10-07T08:49:13.469461+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:49:13.469461+0000","last_undegraded":"2023-10-07T08:49:13.469461+0000","last_fullsized":"2023-10-07T08:49:13.469461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1304,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194007,"statfs":{"total":200000000,"available":198664057,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.51500000000000001,"15min":0.499},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70799999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.51600000000000001,"15min":0.48799999999999999},"min":{"1min":0.376,"5min":0.35099999999999998,"15min":0.27700000000000002},"max":{"1min":0.70899999999999996,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.38600000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73199999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.505},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56699999999999995,"15min":0.54300000000000004},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.746,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.46100000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.40200000000000002,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.69799999999999995,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.439},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51500000000000001,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":0.63700000000000001,"5min":0.75,"15min":0.75},"last":0.41899999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55500000000000005,"15min":0.78200000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.66700000000000004,"5min":0.77200000000000002,"15min":6.8570000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.41599999999999998,"5min":0.39500000000000002,"15min":0.37},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.98999999999999999},"last":0.55200000000000005}]},{"osd":4,"last update":"Sat Oct 7 08:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46200000000000002,"15min":0.47899999999999998},"min":{"1min":0.32600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65200000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.495,"15min":0.53100000000000003},"min":{"1min":0.33400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66600000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.51900000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48099999999999998,"15min":0.503},"min":{"1min":0.33800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68400000000000005,"5min":0.751,"15min":0.751},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78300000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80600000000000005,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.307,"15min":0.307},"max":{"1min":0.72299999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":734,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194577,"statfs":{"total":200000000,"available":199247592,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.499,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.25700000000000001},"max":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.441},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.45300000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69099999999999995,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55900000000000005,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.754,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.48699999999999999},"min":{"1min":0.36899999999999999,"5min":0.313,"15min":0.29399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53500000000000003,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70999999999999996}]},{"osd":3,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.35699999999999998},"max":{"1min":0.69899999999999995,"5min":0.752,"15min":0.752},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.58699999999999997,"15min":0.53700000000000003},"min":{"1min":0.40899999999999997,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72499999999999998,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.41299999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71699999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.496},"min":{"1min":0.41999999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76300000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.39100000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52300000000000002,"15min":0.505},"min":{"1min":0.36399999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73899999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70399999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.377}]},{"osd":7,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54400000000000004,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.73999999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79000000000000004,"5min":1.052,"15min":1.052},"last":0.50900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194584,"statfs":{"total":200000000,"available":199254425,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35499999999999998,"15min":0.315},"min":{"1min":0.224,"5min":0.19400000000000001,"15min":0.17499999999999999},"max":{"1min":0.49199999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.37,"15min":0.33300000000000002},"min":{"1min":0.255,"5min":0.221,"15min":0.192},"max":{"1min":0.61599999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.251}]},{"osd":2,"last update":"Sat Oct 7 08:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36499999999999999,"15min":0.32200000000000001},"min":{"1min":0.27200000000000002,"5min":0.22700000000000001,"15min":0.19600000000000001},"max":{"1min":0.47199999999999998,"5min":1.639,"15min":1.639},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.40200000000000002,"15min":0.33700000000000002},"min":{"1min":0.25600000000000001,"5min":0.23599999999999999,"15min":0.22500000000000001},"max":{"1min":0.57099999999999995,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.28399999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.40999999999999998,"15min":0.36199999999999999},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.249},"max":{"1min":0.55600000000000005,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39600000000000002,"15min":0.35199999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55900000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.33300000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.41899999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76700000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.52700000000000002},"min":{"1min":0.41499999999999998,"5min":0.30099999999999999,"15min":0.28599999999999998},"max":{"1min":0.71499999999999997,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.502}]},{"osd":5,"last update":"Sat Oct 7 08:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.57599999999999996},"min":{"1min":0.46100000000000002,"5min":0.40100000000000002,"15min":0.371},"max":{"1min":0.82199999999999995,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.61499999999999999,"15min":0.57299999999999995},"min":{"1min":0.47899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83399999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.56899999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.54800000000000004},"min":{"1min":0.40999999999999998,"5min":0.38500000000000001,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.53300000000000003},"min":{"1min":0.44800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.75900000000000001,"5min":0.87,"15min":0.87},"last":0.627}]},{"osd":7,"last update":"Sat Oct 7 08:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.443,"5min":0.39500000000000002,"15min":0.35699999999999998},"max":{"1min":0.86299999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.628,"15min":0.58599999999999997},"min":{"1min":0.47799999999999998,"5min":0.41199999999999998,"15min":0.40799999999999997},"max":{"1min":0.72699999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1312,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193999,"statfs":{"total":200000000,"available":198655646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33300000000000002,"15min":0.36799999999999999},"min":{"1min":0.223,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46600000000000003,"5min":0.55600000000000005,"15min":1.4339999999999999},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.372,"15min":0.39300000000000002},"min":{"1min":0.28100000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51400000000000001,"5min":0.67400000000000004,"15min":1.079},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.37,"15min":0.39000000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.58599999999999997,"5min":0.63200000000000001,"15min":1.464},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.28499999999999998,"5min":0.26000000000000001,"15min":0.21299999999999999},"max":{"1min":0.58599999999999997,"5min":0.67900000000000005,"15min":1.1060000000000001},"last":0.29299999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.36399999999999999,"15min":0.38300000000000001},"min":{"1min":0.27300000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":1.341},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41599999999999998,"15min":0.434},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.25700000000000001},"max":{"1min":0.63600000000000001,"5min":0.68600000000000005,"15min":1.532},"last":0.37}]},{"osd":4,"last update":"Sat Oct 7 08:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83299999999999996,"5min":0.90200000000000002,"15min":1.3169999999999999},"last":0.5},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.60699999999999998},"min":{"1min":0.40300000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":1.51},"last":0.42599999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81499999999999995,"5min":0.89100000000000001,"15min":1.0529999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.41299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77500000000000002,"5min":0.90100000000000002,"15min":1.25},"last":0.41199999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.38600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.84199999999999997,"5min":0.92900000000000005,"15min":1.488},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60399999999999998,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.875,"5min":0.875,"15min":1.024},"last":0.48799999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.62,"15min":0.59999999999999998},"min":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84599999999999997,"5min":0.94799999999999995,"15min":0.98499999999999999},"last":0.44},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.375,"5min":0.374,"15min":0.374},"max":{"1min":0.80500000000000005,"5min":0.90300000000000002,"15min":1.288},"last":0.47699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194584,"statfs":{"total":200000000,"available":199254425,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32300000000000001,"15min":0.34100000000000003},"min":{"1min":0.192,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.495,"5min":0.52800000000000002,"15min":1.665},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35599999999999998,"15min":0.36199999999999999},"min":{"1min":0.23799999999999999,"5min":0.22800000000000001,"15min":0.22600000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":1.579},"last":0.377}]},{"osd":1,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.378,"15min":0.379},"min":{"1min":0.223,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51700000000000002,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.41799999999999998,"15min":0.42499999999999999},"min":{"1min":0.20999999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.624,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.439}]},{"osd":3,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38900000000000001,"15min":0.39200000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.55900000000000005,"5min":0.60199999999999998,"15min":1.454},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.38,"15min":0.38900000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":1.6919999999999999},"last":0.309}]},{"osd":4,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.33500000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":1.7210000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86599999999999999,"5min":0.874,"15min":1.5549999999999999},"last":0.46600000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.747,"5min":0.94399999999999995,"15min":1.5269999999999999},"last":0.495},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.46300000000000002,"5min":0.35099999999999998,"15min":0.311},"max":{"1min":0.876,"5min":0.876,"15min":1.4039999999999999},"last":0.44800000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.442,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.3380000000000001},"last":0.505},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78000000000000003,"5min":0.85899999999999999,"15min":1.637},"last":0.54800000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.434,"5min":0.379,"15min":0.379},"max":{"1min":0.76800000000000002,"5min":0.81499999999999995,"15min":1.49},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":1.375},"last":0.47699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194584,"statfs":{"total":200000000,"available":199254425,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.34799999999999998,"15min":0.32800000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.5,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.34899999999999998,"15min":0.32100000000000001},"min":{"1min":0.246,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53600000000000003,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.23899999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.375,"15min":0.35799999999999998},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.52200000000000002,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.41099999999999998,"15min":0.39600000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.22500000000000001},"max":{"1min":0.59199999999999997,"5min":1.885,"15min":1.885},"last":0.312}]},{"osd":2,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.38900000000000001,"15min":0.379},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.45500000000000002,"5min":1.274,"15min":1.274},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.41699999999999998,"15min":0.40100000000000002},"min":{"1min":0.28699999999999998,"5min":0.27400000000000002,"15min":0.25800000000000001},"max":{"1min":0.61899999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.34200000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55800000000000005,"15min":0.50700000000000001},"min":{"1min":0.36499999999999999,"5min":0.35399999999999998,"15min":0.29999999999999999},"max":{"1min":0.77600000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58299999999999996,"15min":0.53800000000000003},"min":{"1min":0.39400000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90000000000000002,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.51200000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57899999999999996,"15min":0.54700000000000004},"min":{"1min":0.39600000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.85799999999999998,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.57199999999999995},"min":{"1min":0.42299999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.876,"5min":1.851,"15min":1.851},"last":0.58999999999999997}]},{"osd":6,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61199999999999999,"15min":0.56200000000000006},"min":{"1min":0.45800000000000002,"5min":0.36899999999999999,"15min":0.34899999999999998},"max":{"1min":0.749,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.503},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.621,"15min":0.58799999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.94399999999999995,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.57899999999999996},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93200000000000005,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59699999999999998,"15min":0.55900000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83999999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.63200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194584,"statfs":{"total":200000000,"available":199254425,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.89300000000000002,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53900000000000003,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.69299999999999995,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.504},"min":{"1min":0.36499999999999999,"5min":0.248,"15min":0.248},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52900000000000003,"15min":0.501},"min":{"1min":0.34000000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81100000000000005,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.46500000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55100000000000005,"15min":0.53000000000000003},"min":{"1min":0.311,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66000000000000003,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.51100000000000001},"min":{"1min":0.42899999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":1.29,"15min":1.29},"last":0.38}]},{"osd":3,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.53000000000000003},"min":{"1min":0.39000000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.91400000000000003,"5min":2.052,"15min":2.052},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78700000000000003,"5min":1.369,"15min":1.369},"last":0.44900000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.29499999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.75800000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.36399999999999999,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.434}]},{"osd":6,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.52700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":0.85899999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.502},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.69799999999999995,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.59599999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53000000000000003,"15min":0.55600000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.30099999999999999},"max":{"1min":0.83899999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.379,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.90200000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":735,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194577,"statfs":{"total":200000000,"available":199247086,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54000000000000004,"15min":0.51900000000000002},"min":{"1min":0.311,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53300000000000003,"15min":0.51300000000000001},"min":{"1min":0.35399999999999998,"5min":0.33500000000000002,"15min":0.32900000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.79500000000000004},"last":0.59799999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.25,"15min":0.25},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":2.0499999999999998,"5min":0.84599999999999997,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":29.143999999999998,"5min":29.143999999999998,"15min":29.143999999999998},"last":0.501}]},{"osd":2,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.41899999999999998,"5min":0.31,"15min":0.309},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.64900000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.378,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.40400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.49199999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.80700000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77300000000000002,"5min":0.79400000000000004,"15min":0.80900000000000005},"last":0.42999999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51200000000000001,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79100000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86399999999999999,"5min":1.022,"15min":1.022},"last":0.39900000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53500000000000003,"15min":0.57199999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70799999999999996,"5min":0.81599999999999995,"15min":0.93100000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.59299999999999997},"min":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.91100000000000003},"last":0.41299999999999998}]}]}],"pool_statfs":[]}} 2023-10-07T08:49:18.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:49:18.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.676+0000 7f8a4087d700 1 Processor -- start 2023-10-07T08:49:18.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.676+0000 7f8a4087d700 1 -- start start 2023-10-07T08:49:18.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a4087d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8a3c1578d0 0x7f8a3c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:18.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a4087d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3c0d07c0 con 0x7f8a3c157ca0 2023-10-07T08:49:18.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a4087d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3c0cfbb0 con 0x7f8a3c06d120 2023-10-07T08:49:18.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a4087d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3c0cfe90 con 0x7f8a3c1578d0 2023-10-07T08:49:18.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a39d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8a3c157ca0 0x7f8a3c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34964/0 (socket says 172.21.15.81:34964) 2023-10-07T08:49:18.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a39d9b700 1 -- 172.21.15.81:0/3335712255 learned_addr learned my addr 172.21.15.81:0/3335712255 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:18.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a3a59c700 1 --2- 172.21.15.81:0/3335712255 >> v2:172.21.15.89:3300/0 conn(0x7f8a3c1578d0 0x7f8a3c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:18.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a3959a700 1 -- 172.21.15.81:0/3335712255 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108616982 0 0) 0x7f8a3c0d07c0 con 0x7f8a3c157ca0 2023-10-07T08:49:18.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a3959a700 1 -- 172.21.15.81:0/3335712255 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a24003570 con 0x7f8a3c157ca0 2023-10-07T08:49:18.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a3959a700 1 -- 172.21.15.81:0/3335712255 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3560662846 0 0) 0x7f8a24003570 con 0x7f8a3c157ca0 2023-10-07T08:49:18.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a3959a700 1 -- 172.21.15.81:0/3335712255 >> v2:172.21.15.89:3300/0 conn(0x7f8a3c1578d0 msgr2=0x7f8a3c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:18.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a3959a700 1 --2- 172.21.15.81:0/3335712255 >> v2:172.21.15.89:3300/0 conn(0x7f8a3c1578d0 0x7f8a3c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a3959a700 1 -- 172.21.15.81:0/3335712255 >> v1:172.21.15.89:6789/0 conn(0x7f8a3c06d120 legacy=0x7f8a3c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:18.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a3959a700 1 -- 172.21.15.81:0/3335712255 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c0d0170 con 0x7f8a3c157ca0 2023-10-07T08:49:18.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a3959a700 1 -- 172.21.15.81:0/3335712255 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f8a30001470 con 0x7f8a3c157ca0 2023-10-07T08:49:18.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a3959a700 1 -- 172.21.15.81:0/3335712255 >> v1:172.21.15.81:6789/0 conn(0x7f8a3c157ca0 legacy=0x7f8a3c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:18.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a3959a700 1 --2- 172.21.15.81:0/3335712255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a24003a60 0x7f8a24003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:18.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a3959a700 1 --2- 172.21.15.81:0/3335712255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a24004810 0x7f8a24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:18.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a3959a700 1 --2- 172.21.15.81:0/3335712255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a240051c0 0x7f8a2400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:18.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a3959a700 1 -- 172.21.15.81:0/3335712255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0cfe90 con 0x7f8a24003a60 2023-10-07T08:49:18.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a3959a700 1 -- 172.21.15.81:0/3335712255 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2400c0d0 con 0x7f8a24004810 2023-10-07T08:49:18.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.677+0000 7f8a3959a700 1 -- 172.21.15.81:0/3335712255 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2400c290 con 0x7f8a240051c0 2023-10-07T08:49:18.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.678+0000 7f8a3a59c700 1 --2- 172.21.15.81:0/3335712255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a24003a60 0x7f8a24003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:18.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.678+0000 7f8a39d9b700 1 --2- 172.21.15.81:0/3335712255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a24004810 0x7f8a24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:18.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.678+0000 7f8a3ad9d700 1 --2- 172.21.15.81:0/3335712255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a240051c0 0x7f8a2400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.678+0000 7f8a3a59c700 1 -- 172.21.15.81:0/3335712255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a240051c0 msgr2=0x7f8a2400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.678+0000 7f8a3a59c700 1 --2- 172.21.15.81:0/3335712255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a240051c0 0x7f8a2400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.678+0000 7f8a3a59c700 1 -- 172.21.15.81:0/3335712255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a24004810 msgr2=0x7f8a24004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.678+0000 7f8a3a59c700 1 --2- 172.21.15.81:0/3335712255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a24004810 0x7f8a24004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.678+0000 7f8a3ad9d700 1 -- 172.21.15.81:0/3335712255 reap_dead start 2023-10-07T08:49:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.678+0000 7f8a3a59c700 1 -- 172.21.15.81:0/3335712255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a24003570 con 0x7f8a24003a60 2023-10-07T08:49:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.678+0000 7f8a3a59c700 1 --2- 172.21.15.81:0/3335712255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a24003a60 0x7f8a24003e70 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400e210 tx=0x7f8a3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d783ae42ae4015ec server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.678+0000 7f8a3959a700 1 -- 172.21.15.81:0/3335712255 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3400eac0 con 0x7f8a24003a60 2023-10-07T08:49:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.678+0000 7f8a3959a700 1 -- 172.21.15.81:0/3335712255 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3400f040 con 0x7f8a24003a60 2023-10-07T08:49:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.678+0000 7f8a3959a700 1 -- 172.21.15.81:0/3335712255 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3400ee70 con 0x7f8a24003a60 2023-10-07T08:49:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.678+0000 7f8a4087d700 1 -- 172.21.15.81:0/3335712255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a24003a60 msgr2=0x7f8a24003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.679+0000 7f8a4087d700 1 --2- 172.21.15.81:0/3335712255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a24003a60 0x7f8a24003e70 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400e210 tx=0x7f8a3400b040 comp rx=0 tx=0).stop 2023-10-07T08:49:18.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.679+0000 7f8a4087d700 1 -- 172.21.15.81:0/3335712255 shutdown_connections 2023-10-07T08:49:18.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.679+0000 7f8a4087d700 1 --2- 172.21.15.81:0/3335712255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a24003a60 0x7f8a24003e70 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.679+0000 7f8a4087d700 1 -- 172.21.15.81:0/3335712255 >> 172.21.15.81:0/3335712255 conn(0x7f8a3c06bb90 msgr2=0x7f8a3c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:18.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.679+0000 7f8a4087d700 1 -- 172.21.15.81:0/3335712255 shutdown_connections 2023-10-07T08:49:18.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.679+0000 7f8a4087d700 1 -- 172.21.15.81:0/3335712255 wait complete. 2023-10-07T08:49:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.680+0000 7f8a4087d700 1 Processor -- start 2023-10-07T08:49:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.680+0000 7f8a4087d700 1 -- start start 2023-10-07T08:49:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.680+0000 7f8a4087d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a24003a60 0x7f8a3c16b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.680+0000 7f8a4087d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3c069d30 0x7f8a3c06a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.680+0000 7f8a4087d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c16bc20 0x7f8a3c16c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.680+0000 7f8a4087d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c16b8f0 con 0x7f8a3c069d30 2023-10-07T08:49:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.680+0000 7f8a4087d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c06a6e0 con 0x7f8a3c16bc20 2023-10-07T08:49:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.680+0000 7f8a4087d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c16d580 con 0x7f8a24003a60 2023-10-07T08:49:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.681+0000 7f8a39d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3c069d30 0x7f8a3c06a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.681+0000 7f8a39d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3c069d30 0x7f8a3c06a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34214/0 (socket says 172.21.15.81:34214) 2023-10-07T08:49:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.681+0000 7f8a39d9b700 1 -- 172.21.15.81:0/1932646349 learned_addr learned my addr 172.21.15.81:0/1932646349 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.681+0000 7f8a3ad9d700 1 --2- 172.21.15.81:0/1932646349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c16bc20 0x7f8a3c16c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.681+0000 7f8a3a59c700 1 --2- 172.21.15.81:0/1932646349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a24003a60 0x7f8a3c16b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.681+0000 7f8a39d9b700 1 -- 172.21.15.81:0/1932646349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a24003a60 msgr2=0x7f8a3c16b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.681+0000 7f8a39d9b700 1 --2- 172.21.15.81:0/1932646349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a24003a60 0x7f8a3c16b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.681+0000 7f8a39d9b700 1 -- 172.21.15.81:0/1932646349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c16bc20 msgr2=0x7f8a3c16c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.681+0000 7f8a39d9b700 1 --2- 172.21.15.81:0/1932646349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c16bc20 0x7f8a3c16c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.681+0000 7f8a39d9b700 1 -- 172.21.15.81:0/1932646349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c16c970 con 0x7f8a3c069d30 2023-10-07T08:49:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.681+0000 7f8a39d9b700 1 --2- 172.21.15.81:0/1932646349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3c069d30 0x7f8a3c06a1a0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f8a300073c0 tx=0x7f8a30001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.681+0000 7f8a2a7fc700 1 -- 172.21.15.81:0/1932646349 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30018030 con 0x7f8a3c069d30 2023-10-07T08:49:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.681+0000 7f8a2a7fc700 1 -- 172.21.15.81:0/1932646349 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3000f6c0 con 0x7f8a3c069d30 2023-10-07T08:49:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.681+0000 7f8a4087d700 1 -- 172.21.15.81:0/1932646349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c16cc50 con 0x7f8a3c069d30 2023-10-07T08:49:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.681+0000 7f8a2a7fc700 1 -- 172.21.15.81:0/1932646349 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3000fa80 con 0x7f8a3c069d30 2023-10-07T08:49:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.681+0000 7f8a4087d700 1 -- 172.21.15.81:0/1932646349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c16d210 con 0x7f8a3c069d30 2023-10-07T08:49:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.682+0000 7f8a4087d700 1 -- 172.21.15.81:0/1932646349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3c16d730 con 0x7f8a3c069d30 2023-10-07T08:49:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.683+0000 7f8a2a7fc700 1 -- 172.21.15.81:0/1932646349 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a3001b070 con 0x7f8a3c069d30 2023-10-07T08:49:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.683+0000 7f8a2a7fc700 1 --2- 172.21.15.81:0/1932646349 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8a1c066f30 0x7f8a1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.683+0000 7f8a2a7fc700 1 -- 172.21.15.81:0/1932646349 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a30019070 con 0x7f8a3c069d30 2023-10-07T08:49:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.683+0000 7f8a3a59c700 1 --2- 172.21.15.81:0/1932646349 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8a1c066f30 0x7f8a1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.683+0000 7f8a3a59c700 1 --2- 172.21.15.81:0/1932646349 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8a1c066f30 0x7f8a1c0693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400afd0 tx=0x7f8a3401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.687+0000 7f8a2a7fc700 1 -- 172.21.15.81:0/1932646349 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a3c16d730 con 0x7f8a3c069d30 2023-10-07T08:49:18.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.864+0000 7f8a4087d700 1 -- 172.21.15.81:0/1932646349 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a3c16d6f0 con 0x7f8a1c066f30 2023-10-07T08:49:18.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.872+0000 7f8a2a7fc700 1 -- 172.21.15.81:0/1932646349 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285258 (secure 0 0 0) 0x7f8a3c16d6f0 con 0x7f8a1c066f30 2023-10-07T08:49:18.877 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:18.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.875+0000 7f8a4087d700 1 -- 172.21.15.81:0/1932646349 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8a1c066f30 msgr2=0x7f8a1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:18.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.875+0000 7f8a4087d700 1 --2- 172.21.15.81:0/1932646349 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8a1c066f30 0x7f8a1c0693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400afd0 tx=0x7f8a3401a000 comp rx=0 tx=0).stop 2023-10-07T08:49:18.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.875+0000 7f8a4087d700 1 -- 172.21.15.81:0/1932646349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3c069d30 msgr2=0x7f8a3c06a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:18.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.875+0000 7f8a4087d700 1 --2- 172.21.15.81:0/1932646349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3c069d30 0x7f8a3c06a1a0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f8a300073c0 tx=0x7f8a30001e50 comp rx=0 tx=0).stop 2023-10-07T08:49:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.875+0000 7f8a4087d700 1 -- 172.21.15.81:0/1932646349 shutdown_connections 2023-10-07T08:49:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.875+0000 7f8a4087d700 1 --2- 172.21.15.81:0/1932646349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a3c16bc20 0x7f8a3c16c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.875+0000 7f8a4087d700 1 --2- 172.21.15.81:0/1932646349 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8a1c066f30 0x7f8a1c0693e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.875+0000 7f8a4087d700 1 --2- 172.21.15.81:0/1932646349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a24003a60 0x7f8a3c16b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.875+0000 7f8a4087d700 1 --2- 172.21.15.81:0/1932646349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3c069d30 0x7f8a3c06a1a0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.875+0000 7f8a4087d700 1 -- 172.21.15.81:0/1932646349 >> 172.21.15.81:0/1932646349 conn(0x7f8a3c06bb90 msgr2=0x7f8a3c156950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.875+0000 7f8a4087d700 1 -- 172.21.15.81:0/1932646349 shutdown_connections 2023-10-07T08:49:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:18.875+0000 7f8a4087d700 1 -- 172.21.15.81:0/1932646349 wait complete. 2023-10-07T08:49:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:49:18.889 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2023-10-07T08:49:18.087428+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":87,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6999,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555500,"statfs":{"total":1600000000,"available":1592832081,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.633002"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.475120+0000","last_change":"2023-10-07T08:49:14.475120+0000","last_active":"2023-10-07T08:49:14.475120+0000","last_peered":"2023-10-07T08:49:14.475120+0000","last_clean":"2023-10-07T08:49:14.475120+0000","last_became_active":"2023-10-07T08:49:14.474814+0000","last_became_peered":"2023-10-07T08:49:14.474814+0000","last_unstale":"2023-10-07T08:49:14.475120+0000","last_undegraded":"2023-10-07T08:49:14.475120+0000","last_fullsized":"2023-10-07T08:49:14.475120+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:20:27.398850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.476788+0000","last_change":"2023-10-07T08:49:14.476788+0000","last_active":"2023-10-07T08:49:14.476788+0000","last_peered":"2023-10-07T08:49:14.476788+0000","last_clean":"2023-10-07T08:49:14.476788+0000","last_became_active":"2023-10-07T08:49:14.476376+0000","last_became_peered":"2023-10-07T08:49:14.476376+0000","last_unstale":"2023-10-07T08:49:14.476788+0000","last_undegraded":"2023-10-07T08:49:14.476788+0000","last_fullsized":"2023-10-07T08:49:14.476788+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:55:03.519826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.481035+0000","last_change":"2023-10-07T08:49:14.481035+0000","last_active":"2023-10-07T08:49:14.481035+0000","last_peered":"2023-10-07T08:49:14.481035+0000","last_clean":"2023-10-07T08:49:14.481035+0000","last_became_active":"2023-10-07T08:49:14.479959+0000","last_became_peered":"2023-10-07T08:49:14.479959+0000","last_unstale":"2023-10-07T08:49:14.481035+0000","last_undegraded":"2023-10-07T08:49:14.481035+0000","last_fullsized":"2023-10-07T08:49:14.481035+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:44:10.577541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.469931+0000","last_change":"2023-10-07T08:49:14.469931+0000","last_active":"2023-10-07T08:49:14.469931+0000","last_peered":"2023-10-07T08:49:14.469931+0000","last_clean":"2023-10-07T08:49:14.469931+0000","last_became_active":"2023-10-07T08:49:14.469709+0000","last_became_peered":"2023-10-07T08:49:14.469709+0000","last_unstale":"2023-10-07T08:49:14.469931+0000","last_undegraded":"2023-10-07T08:49:14.469931+0000","last_fullsized":"2023-10-07T08:49:14.469931+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:23.871449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.467315+0000","last_change":"2023-10-07T08:49:14.467315+0000","last_active":"2023-10-07T08:49:14.467315+0000","last_peered":"2023-10-07T08:49:14.467315+0000","last_clean":"2023-10-07T08:49:14.467315+0000","last_became_active":"2023-10-07T08:49:14.467071+0000","last_became_peered":"2023-10-07T08:49:14.467071+0000","last_unstale":"2023-10-07T08:49:14.467315+0000","last_undegraded":"2023-10-07T08:49:14.467315+0000","last_fullsized":"2023-10-07T08:49:14.467315+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:38:13.888526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.473261+0000","last_change":"2023-10-07T08:49:14.473261+0000","last_active":"2023-10-07T08:49:14.473261+0000","last_peered":"2023-10-07T08:49:14.473261+0000","last_clean":"2023-10-07T08:49:14.473261+0000","last_became_active":"2023-10-07T08:49:14.472926+0000","last_became_peered":"2023-10-07T08:49:14.472926+0000","last_unstale":"2023-10-07T08:49:14.473261+0000","last_undegraded":"2023-10-07T08:49:14.473261+0000","last_fullsized":"2023-10-07T08:49:14.473261+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:47:17.316931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.475506+0000","last_change":"2023-10-07T08:49:14.475506+0000","last_active":"2023-10-07T08:49:14.475506+0000","last_peered":"2023-10-07T08:49:14.475506+0000","last_clean":"2023-10-07T08:49:14.475506+0000","last_became_active":"2023-10-07T08:49:14.475175+0000","last_became_peered":"2023-10-07T08:49:14.475175+0000","last_unstale":"2023-10-07T08:49:14.475506+0000","last_undegraded":"2023-10-07T08:49:14.475506+0000","last_fullsized":"2023-10-07T08:49:14.475506+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:54.186570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.479608+0000","last_change":"2023-10-07T08:49:14.479608+0000","last_active":"2023-10-07T08:49:14.479608+0000","last_peered":"2023-10-07T08:49:14.479608+0000","last_clean":"2023-10-07T08:49:14.479608+0000","last_became_active":"2023-10-07T08:49:14.477809+0000","last_became_peered":"2023-10-07T08:49:14.477809+0000","last_unstale":"2023-10-07T08:49:14.479608+0000","last_undegraded":"2023-10-07T08:49:14.479608+0000","last_fullsized":"2023-10-07T08:49:14.479608+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:20:43.010381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.465667+0000","last_change":"2023-10-07T08:49:14.465667+0000","last_active":"2023-10-07T08:49:14.465667+0000","last_peered":"2023-10-07T08:49:14.465667+0000","last_clean":"2023-10-07T08:49:14.465667+0000","last_became_active":"2023-10-07T08:49:14.465444+0000","last_became_peered":"2023-10-07T08:49:14.465444+0000","last_unstale":"2023-10-07T08:49:14.465667+0000","last_undegraded":"2023-10-07T08:49:14.465667+0000","last_fullsized":"2023-10-07T08:49:14.465667+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:35:41.444656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.468321+0000","last_change":"2023-10-07T08:49:14.468321+0000","last_active":"2023-10-07T08:49:14.468321+0000","last_peered":"2023-10-07T08:49:14.468321+0000","last_clean":"2023-10-07T08:49:14.468321+0000","last_became_active":"2023-10-07T08:49:14.468013+0000","last_became_peered":"2023-10-07T08:49:14.468013+0000","last_unstale":"2023-10-07T08:49:14.468321+0000","last_undegraded":"2023-10-07T08:49:14.468321+0000","last_fullsized":"2023-10-07T08:49:14.468321+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:28:49.091702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.475790+0000","last_change":"2023-10-07T08:49:14.475790+0000","last_active":"2023-10-07T08:49:14.475790+0000","last_peered":"2023-10-07T08:49:14.475790+0000","last_clean":"2023-10-07T08:49:14.475790+0000","last_became_active":"2023-10-07T08:49:14.475553+0000","last_became_peered":"2023-10-07T08:49:14.475553+0000","last_unstale":"2023-10-07T08:49:14.475790+0000","last_undegraded":"2023-10-07T08:49:14.475790+0000","last_fullsized":"2023-10-07T08:49:14.475790+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:22:39.145551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.467159+0000","last_change":"2023-10-07T08:49:14.467159+0000","last_active":"2023-10-07T08:49:14.467159+0000","last_peered":"2023-10-07T08:49:14.467159+0000","last_clean":"2023-10-07T08:49:14.467159+0000","last_became_active":"2023-10-07T08:49:14.466933+0000","last_became_peered":"2023-10-07T08:49:14.466933+0000","last_unstale":"2023-10-07T08:49:14.467159+0000","last_undegraded":"2023-10-07T08:49:14.467159+0000","last_fullsized":"2023-10-07T08:49:14.467159+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:06:06.984382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.478046+0000","last_change":"2023-10-07T08:49:14.478046+0000","last_active":"2023-10-07T08:49:14.478046+0000","last_peered":"2023-10-07T08:49:14.478046+0000","last_clean":"2023-10-07T08:49:14.478046+0000","last_became_active":"2023-10-07T08:49:14.477430+0000","last_became_peered":"2023-10-07T08:49:14.477430+0000","last_unstale":"2023-10-07T08:49:14.478046+0000","last_undegraded":"2023-10-07T08:49:14.478046+0000","last_fullsized":"2023-10-07T08:49:14.478046+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:54:28.582922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.478278+0000","last_change":"2023-10-07T08:49:14.478278+0000","last_active":"2023-10-07T08:49:14.478278+0000","last_peered":"2023-10-07T08:49:14.478278+0000","last_clean":"2023-10-07T08:49:14.478278+0000","last_became_active":"2023-10-07T08:49:14.477819+0000","last_became_peered":"2023-10-07T08:49:14.477819+0000","last_unstale":"2023-10-07T08:49:14.478278+0000","last_undegraded":"2023-10-07T08:49:14.478278+0000","last_fullsized":"2023-10-07T08:49:14.478278+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:11:06.390522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.475036+0000","last_change":"2023-10-07T08:49:14.475036+0000","last_active":"2023-10-07T08:49:14.475036+0000","last_peered":"2023-10-07T08:49:14.475036+0000","last_clean":"2023-10-07T08:49:14.475036+0000","last_became_active":"2023-10-07T08:49:14.474704+0000","last_became_peered":"2023-10-07T08:49:14.474704+0000","last_unstale":"2023-10-07T08:49:14.475036+0000","last_undegraded":"2023-10-07T08:49:14.475036+0000","last_fullsized":"2023-10-07T08:49:14.475036+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:15:37.175734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472683+0000","last_change":"2023-10-07T08:49:14.472683+0000","last_active":"2023-10-07T08:49:14.472683+0000","last_peered":"2023-10-07T08:49:14.472683+0000","last_clean":"2023-10-07T08:49:14.472683+0000","last_became_active":"2023-10-07T08:49:14.472314+0000","last_became_peered":"2023-10-07T08:49:14.472314+0000","last_unstale":"2023-10-07T08:49:14.472683+0000","last_undegraded":"2023-10-07T08:49:14.472683+0000","last_fullsized":"2023-10-07T08:49:14.472683+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:56:51.020724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472926+0000","last_change":"2023-10-07T08:49:14.472926+0000","last_active":"2023-10-07T08:49:14.472926+0000","last_peered":"2023-10-07T08:49:14.472926+0000","last_clean":"2023-10-07T08:49:14.472926+0000","last_became_active":"2023-10-07T08:49:14.472623+0000","last_became_peered":"2023-10-07T08:49:14.472623+0000","last_unstale":"2023-10-07T08:49:14.472926+0000","last_undegraded":"2023-10-07T08:49:14.472926+0000","last_fullsized":"2023-10-07T08:49:14.472926+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:39:15.140640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.474938+0000","last_change":"2023-10-07T08:49:14.474938+0000","last_active":"2023-10-07T08:49:14.474938+0000","last_peered":"2023-10-07T08:49:14.474938+0000","last_clean":"2023-10-07T08:49:14.474938+0000","last_became_active":"2023-10-07T08:49:14.474470+0000","last_became_peered":"2023-10-07T08:49:14.474470+0000","last_unstale":"2023-10-07T08:49:14.474938+0000","last_undegraded":"2023-10-07T08:49:14.474938+0000","last_fullsized":"2023-10-07T08:49:14.474938+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:50.571206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472816+0000","last_change":"2023-10-07T08:49:14.472816+0000","last_active":"2023-10-07T08:49:14.472816+0000","last_peered":"2023-10-07T08:49:14.472816+0000","last_clean":"2023-10-07T08:49:14.472816+0000","last_became_active":"2023-10-07T08:49:14.471610+0000","last_became_peered":"2023-10-07T08:49:14.471610+0000","last_unstale":"2023-10-07T08:49:14.472816+0000","last_undegraded":"2023-10-07T08:49:14.472816+0000","last_fullsized":"2023-10-07T08:49:14.472816+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:54.748921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.477094+0000","last_change":"2023-10-07T08:49:14.477094+0000","last_active":"2023-10-07T08:49:14.477094+0000","last_peered":"2023-10-07T08:49:14.477094+0000","last_clean":"2023-10-07T08:49:14.477094+0000","last_became_active":"2023-10-07T08:49:14.476873+0000","last_became_peered":"2023-10-07T08:49:14.476873+0000","last_unstale":"2023-10-07T08:49:14.477094+0000","last_undegraded":"2023-10-07T08:49:14.477094+0000","last_fullsized":"2023-10-07T08:49:14.477094+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:30:24.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.467345+0000","last_change":"2023-10-07T08:49:14.467345+0000","last_active":"2023-10-07T08:49:14.467345+0000","last_peered":"2023-10-07T08:49:14.467345+0000","last_clean":"2023-10-07T08:49:14.467345+0000","last_became_active":"2023-10-07T08:49:14.466744+0000","last_became_peered":"2023-10-07T08:49:14.466744+0000","last_unstale":"2023-10-07T08:49:14.467345+0000","last_undegraded":"2023-10-07T08:49:14.467345+0000","last_fullsized":"2023-10-07T08:49:14.467345+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:10:41.873663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.470013+0000","last_change":"2023-10-07T08:49:14.470013+0000","last_active":"2023-10-07T08:49:14.470013+0000","last_peered":"2023-10-07T08:49:14.470013+0000","last_clean":"2023-10-07T08:49:14.470013+0000","last_became_active":"2023-10-07T08:49:14.469816+0000","last_became_peered":"2023-10-07T08:49:14.469816+0000","last_unstale":"2023-10-07T08:49:14.470013+0000","last_undegraded":"2023-10-07T08:49:14.470013+0000","last_fullsized":"2023-10-07T08:49:14.470013+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:20:43.010381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.477861+0000","last_change":"2023-10-07T08:49:14.477861+0000","last_active":"2023-10-07T08:49:14.477861+0000","last_peered":"2023-10-07T08:49:14.477861+0000","last_clean":"2023-10-07T08:49:14.477861+0000","last_became_active":"2023-10-07T08:49:14.477677+0000","last_became_peered":"2023-10-07T08:49:14.477677+0000","last_unstale":"2023-10-07T08:49:14.477861+0000","last_undegraded":"2023-10-07T08:49:14.477861+0000","last_fullsized":"2023-10-07T08:49:14.477861+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:26:29.533708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.476702+0000","last_change":"2023-10-07T08:49:14.476702+0000","last_active":"2023-10-07T08:49:14.476702+0000","last_peered":"2023-10-07T08:49:14.476702+0000","last_clean":"2023-10-07T08:49:14.476702+0000","last_became_active":"2023-10-07T08:49:14.476450+0000","last_became_peered":"2023-10-07T08:49:14.476450+0000","last_unstale":"2023-10-07T08:49:14.476702+0000","last_undegraded":"2023-10-07T08:49:14.476702+0000","last_fullsized":"2023-10-07T08:49:14.476702+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:54.748921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472922+0000","last_change":"2023-10-07T08:49:14.472922+0000","last_active":"2023-10-07T08:49:14.472922+0000","last_peered":"2023-10-07T08:49:14.472922+0000","last_clean":"2023-10-07T08:49:14.472922+0000","last_became_active":"2023-10-07T08:49:14.472638+0000","last_became_peered":"2023-10-07T08:49:14.472638+0000","last_unstale":"2023-10-07T08:49:14.472922+0000","last_undegraded":"2023-10-07T08:49:14.472922+0000","last_fullsized":"2023-10-07T08:49:14.472922+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:11.790537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472546+0000","last_change":"2023-10-07T08:49:14.472546+0000","last_active":"2023-10-07T08:49:14.472546+0000","last_peered":"2023-10-07T08:49:14.472546+0000","last_clean":"2023-10-07T08:49:14.472546+0000","last_became_active":"2023-10-07T08:49:14.471996+0000","last_became_peered":"2023-10-07T08:49:14.471996+0000","last_unstale":"2023-10-07T08:49:14.472546+0000","last_undegraded":"2023-10-07T08:49:14.472546+0000","last_fullsized":"2023-10-07T08:49:14.472546+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:42:20.337252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.474292+0000","last_change":"2023-10-07T08:49:14.474292+0000","last_active":"2023-10-07T08:49:14.474292+0000","last_peered":"2023-10-07T08:49:14.474292+0000","last_clean":"2023-10-07T08:49:14.474292+0000","last_became_active":"2023-10-07T08:49:14.473924+0000","last_became_peered":"2023-10-07T08:49:14.473924+0000","last_unstale":"2023-10-07T08:49:14.474292+0000","last_undegraded":"2023-10-07T08:49:14.474292+0000","last_fullsized":"2023-10-07T08:49:14.474292+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:02:29.280720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.466136+0000","last_change":"2023-10-07T08:49:14.466136+0000","last_active":"2023-10-07T08:49:14.466136+0000","last_peered":"2023-10-07T08:49:14.466136+0000","last_clean":"2023-10-07T08:49:14.466136+0000","last_became_active":"2023-10-07T08:49:14.465914+0000","last_became_peered":"2023-10-07T08:49:14.465914+0000","last_unstale":"2023-10-07T08:49:14.466136+0000","last_undegraded":"2023-10-07T08:49:14.466136+0000","last_fullsized":"2023-10-07T08:49:14.466136+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:43:27.281523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.471978+0000","last_change":"2023-10-07T08:49:14.471978+0000","last_active":"2023-10-07T08:49:14.471978+0000","last_peered":"2023-10-07T08:49:14.471978+0000","last_clean":"2023-10-07T08:49:14.471978+0000","last_became_active":"2023-10-07T08:49:14.471744+0000","last_became_peered":"2023-10-07T08:49:14.471744+0000","last_unstale":"2023-10-07T08:49:14.471978+0000","last_undegraded":"2023-10-07T08:49:14.471978+0000","last_fullsized":"2023-10-07T08:49:14.471978+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:01:24.930712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.471188+0000","last_change":"2023-10-07T08:49:14.471188+0000","last_active":"2023-10-07T08:49:14.471188+0000","last_peered":"2023-10-07T08:49:14.471188+0000","last_clean":"2023-10-07T08:49:14.471188+0000","last_became_active":"2023-10-07T08:49:14.470962+0000","last_became_peered":"2023-10-07T08:49:14.470962+0000","last_unstale":"2023-10-07T08:49:14.471188+0000","last_undegraded":"2023-10-07T08:49:14.471188+0000","last_fullsized":"2023-10-07T08:49:14.471188+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:33:01.934423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.471024+0000","last_change":"2023-10-07T08:49:14.471024+0000","last_active":"2023-10-07T08:49:14.471024+0000","last_peered":"2023-10-07T08:49:14.471024+0000","last_clean":"2023-10-07T08:49:14.471024+0000","last_became_active":"2023-10-07T08:49:14.470802+0000","last_became_peered":"2023-10-07T08:49:14.470802+0000","last_unstale":"2023-10-07T08:49:14.471024+0000","last_undegraded":"2023-10-07T08:49:14.471024+0000","last_fullsized":"2023-10-07T08:49:14.471024+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:04:54.572186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.474139+0000","last_change":"2023-10-07T08:49:14.474139+0000","last_active":"2023-10-07T08:49:14.474139+0000","last_peered":"2023-10-07T08:49:14.474139+0000","last_clean":"2023-10-07T08:49:14.474139+0000","last_became_active":"2023-10-07T08:49:14.473676+0000","last_became_peered":"2023-10-07T08:49:14.473676+0000","last_unstale":"2023-10-07T08:49:14.474139+0000","last_undegraded":"2023-10-07T08:49:14.474139+0000","last_fullsized":"2023-10-07T08:49:14.474139+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:18.042529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.474772+0000","last_change":"2023-10-07T08:49:14.474772+0000","last_active":"2023-10-07T08:49:14.474772+0000","last_peered":"2023-10-07T08:49:14.474772+0000","last_clean":"2023-10-07T08:49:14.474772+0000","last_became_active":"2023-10-07T08:49:14.474429+0000","last_became_peered":"2023-10-07T08:49:14.474429+0000","last_unstale":"2023-10-07T08:49:14.474772+0000","last_undegraded":"2023-10-07T08:49:14.474772+0000","last_fullsized":"2023-10-07T08:49:14.474772+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:41:40.587489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"137'4","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.483333+0000","last_change":"2023-10-07T08:49:13.469655+0000","last_active":"2023-10-07T08:49:14.483333+0000","last_peered":"2023-10-07T08:49:14.483333+0000","last_clean":"2023-10-07T08:49:14.483333+0000","last_became_active":"2023-10-07T08:49:13.469432+0000","last_became_peered":"2023-10-07T08:49:13.469432+0000","last_unstale":"2023-10-07T08:49:14.483333+0000","last_undegraded":"2023-10-07T08:49:14.483333+0000","last_fullsized":"2023-10-07T08:49:14.483333+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:19.281326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.479296+0000","last_change":"2023-10-07T08:49:14.479296+0000","last_active":"2023-10-07T08:49:14.479296+0000","last_peered":"2023-10-07T08:49:14.479296+0000","last_clean":"2023-10-07T08:49:14.479296+0000","last_became_active":"2023-10-07T08:49:14.478933+0000","last_became_peered":"2023-10-07T08:49:14.478933+0000","last_unstale":"2023-10-07T08:49:14.479296+0000","last_undegraded":"2023-10-07T08:49:14.479296+0000","last_fullsized":"2023-10-07T08:49:14.479296+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:11.790537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.470134+0000","last_change":"2023-10-07T08:49:13.471412+0000","last_active":"2023-10-07T08:49:14.470134+0000","last_peered":"2023-10-07T08:49:14.470134+0000","last_clean":"2023-10-07T08:49:14.470134+0000","last_became_active":"2023-10-07T08:49:13.470870+0000","last_became_peered":"2023-10-07T08:49:13.470870+0000","last_unstale":"2023-10-07T08:49:14.470134+0000","last_undegraded":"2023-10-07T08:49:14.470134+0000","last_fullsized":"2023-10-07T08:49:14.470134+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:10.784309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.473138+0000","last_change":"2023-10-07T08:49:14.473138+0000","last_active":"2023-10-07T08:49:14.473138+0000","last_peered":"2023-10-07T08:49:14.473138+0000","last_clean":"2023-10-07T08:49:14.473138+0000","last_became_active":"2023-10-07T08:49:14.472657+0000","last_became_peered":"2023-10-07T08:49:14.472657+0000","last_unstale":"2023-10-07T08:49:14.473138+0000","last_undegraded":"2023-10-07T08:49:14.473138+0000","last_fullsized":"2023-10-07T08:49:14.473138+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:20.287554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.480718+0000","last_change":"2023-10-07T08:49:13.467031+0000","last_active":"2023-10-07T08:49:14.480718+0000","last_peered":"2023-10-07T08:49:14.480718+0000","last_clean":"2023-10-07T08:49:14.480718+0000","last_became_active":"2023-10-07T08:49:13.466614+0000","last_became_peered":"2023-10-07T08:49:13.466614+0000","last_unstale":"2023-10-07T08:49:14.480718+0000","last_undegraded":"2023-10-07T08:49:14.480718+0000","last_fullsized":"2023-10-07T08:49:14.480718+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:43:35.716431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.475815+0000","last_change":"2023-10-07T08:49:14.475815+0000","last_active":"2023-10-07T08:49:14.475815+0000","last_peered":"2023-10-07T08:49:14.475815+0000","last_clean":"2023-10-07T08:49:14.475815+0000","last_became_active":"2023-10-07T08:49:14.475591+0000","last_became_peered":"2023-10-07T08:49:14.475591+0000","last_unstale":"2023-10-07T08:49:14.475815+0000","last_undegraded":"2023-10-07T08:49:14.475815+0000","last_fullsized":"2023-10-07T08:49:14.475815+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:10.980930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.480721+0000","last_change":"2023-10-07T08:49:13.466067+0000","last_active":"2023-10-07T08:49:14.480721+0000","last_peered":"2023-10-07T08:49:14.480721+0000","last_clean":"2023-10-07T08:49:14.480721+0000","last_became_active":"2023-10-07T08:49:13.465488+0000","last_became_peered":"2023-10-07T08:49:13.465488+0000","last_unstale":"2023-10-07T08:49:14.480721+0000","last_undegraded":"2023-10-07T08:49:14.480721+0000","last_fullsized":"2023-10-07T08:49:14.480721+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:36:04.550858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.466636+0000","last_change":"2023-10-07T08:49:14.466636+0000","last_active":"2023-10-07T08:49:14.466636+0000","last_peered":"2023-10-07T08:49:14.466636+0000","last_clean":"2023-10-07T08:49:14.466636+0000","last_became_active":"2023-10-07T08:49:14.466410+0000","last_became_peered":"2023-10-07T08:49:14.466410+0000","last_unstale":"2023-10-07T08:49:14.466636+0000","last_undegraded":"2023-10-07T08:49:14.466636+0000","last_fullsized":"2023-10-07T08:49:14.466636+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:36:24.130466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472679+0000","last_change":"2023-10-07T08:49:13.472482+0000","last_active":"2023-10-07T08:49:14.472679+0000","last_peered":"2023-10-07T08:49:14.472679+0000","last_clean":"2023-10-07T08:49:14.472679+0000","last_became_active":"2023-10-07T08:49:13.472256+0000","last_became_peered":"2023-10-07T08:49:13.472256+0000","last_unstale":"2023-10-07T08:49:14.472679+0000","last_undegraded":"2023-10-07T08:49:14.472679+0000","last_fullsized":"2023-10-07T08:49:14.472679+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:47:16.310703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.476635+0000","last_change":"2023-10-07T08:49:14.476635+0000","last_active":"2023-10-07T08:49:14.476635+0000","last_peered":"2023-10-07T08:49:14.476635+0000","last_clean":"2023-10-07T08:49:14.476635+0000","last_became_active":"2023-10-07T08:49:14.476064+0000","last_became_peered":"2023-10-07T08:49:14.476064+0000","last_unstale":"2023-10-07T08:49:14.476635+0000","last_undegraded":"2023-10-07T08:49:14.476635+0000","last_fullsized":"2023-10-07T08:49:14.476635+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:53:40.319088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.461356+0000","last_change":"2023-10-07T08:49:13.474162+0000","last_active":"2023-10-07T08:49:14.461356+0000","last_peered":"2023-10-07T08:49:14.461356+0000","last_clean":"2023-10-07T08:49:14.461356+0000","last_became_active":"2023-10-07T08:49:13.474041+0000","last_became_peered":"2023-10-07T08:49:13.474041+0000","last_unstale":"2023-10-07T08:49:14.461356+0000","last_undegraded":"2023-10-07T08:49:14.461356+0000","last_fullsized":"2023-10-07T08:49:14.461356+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:23:15.106111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.476060+0000","last_change":"2023-10-07T08:49:14.476060+0000","last_active":"2023-10-07T08:49:14.476060+0000","last_peered":"2023-10-07T08:49:14.476060+0000","last_clean":"2023-10-07T08:49:14.476060+0000","last_became_active":"2023-10-07T08:49:14.475705+0000","last_became_peered":"2023-10-07T08:49:14.475705+0000","last_unstale":"2023-10-07T08:49:14.476060+0000","last_undegraded":"2023-10-07T08:49:14.476060+0000","last_fullsized":"2023-10-07T08:49:14.476060+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:08:15.920218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.475967+0000","last_change":"2023-10-07T08:49:13.475920+0000","last_active":"2023-10-07T08:49:13.475967+0000","last_peered":"2023-10-07T08:49:13.475967+0000","last_clean":"2023-10-07T08:49:13.475967+0000","last_became_active":"2023-10-07T08:49:13.475784+0000","last_became_peered":"2023-10-07T08:49:13.475784+0000","last_unstale":"2023-10-07T08:49:13.475967+0000","last_undegraded":"2023-10-07T08:49:13.475967+0000","last_fullsized":"2023-10-07T08:49:13.475967+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:02:28.274492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.470735+0000","last_change":"2023-10-07T08:49:14.470735+0000","last_active":"2023-10-07T08:49:14.470735+0000","last_peered":"2023-10-07T08:49:14.470735+0000","last_clean":"2023-10-07T08:49:14.470735+0000","last_became_active":"2023-10-07T08:49:14.470494+0000","last_became_peered":"2023-10-07T08:49:14.470494+0000","last_unstale":"2023-10-07T08:49:14.470735+0000","last_undegraded":"2023-10-07T08:49:14.470735+0000","last_fullsized":"2023-10-07T08:49:14.470735+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:50:54.109509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.464357+0000","last_change":"2023-10-07T08:49:13.464231+0000","last_active":"2023-10-07T08:49:13.464357+0000","last_peered":"2023-10-07T08:49:13.464357+0000","last_clean":"2023-10-07T08:49:13.464357+0000","last_became_active":"2023-10-07T08:49:13.463992+0000","last_became_peered":"2023-10-07T08:49:13.463992+0000","last_unstale":"2023-10-07T08:49:13.464357+0000","last_undegraded":"2023-10-07T08:49:13.464357+0000","last_fullsized":"2023-10-07T08:49:13.464357+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:26:28.527480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.473353+0000","last_change":"2023-10-07T08:49:14.473353+0000","last_active":"2023-10-07T08:49:14.473353+0000","last_peered":"2023-10-07T08:49:14.473353+0000","last_clean":"2023-10-07T08:49:14.473353+0000","last_became_active":"2023-10-07T08:49:14.473037+0000","last_became_peered":"2023-10-07T08:49:14.473037+0000","last_unstale":"2023-10-07T08:49:14.473353+0000","last_undegraded":"2023-10-07T08:49:14.473353+0000","last_fullsized":"2023-10-07T08:49:14.473353+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:38:07.395155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.466272+0000","last_change":"2023-10-07T08:49:13.466212+0000","last_active":"2023-10-07T08:49:13.466272+0000","last_peered":"2023-10-07T08:49:13.466272+0000","last_clean":"2023-10-07T08:49:13.466272+0000","last_became_active":"2023-10-07T08:49:13.465828+0000","last_became_peered":"2023-10-07T08:49:13.465828+0000","last_unstale":"2023-10-07T08:49:13.466272+0000","last_undegraded":"2023-10-07T08:49:13.466272+0000","last_fullsized":"2023-10-07T08:49:13.466272+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:09:24.156056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.479370+0000","last_change":"2023-10-07T08:49:14.479370+0000","last_active":"2023-10-07T08:49:14.479370+0000","last_peered":"2023-10-07T08:49:14.479370+0000","last_clean":"2023-10-07T08:49:14.479370+0000","last_became_active":"2023-10-07T08:49:14.479155+0000","last_became_peered":"2023-10-07T08:49:14.479155+0000","last_unstale":"2023-10-07T08:49:14.479370+0000","last_undegraded":"2023-10-07T08:49:14.479370+0000","last_fullsized":"2023-10-07T08:49:14.479370+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:54.186570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.469316+0000","last_change":"2023-10-07T08:49:13.468900+0000","last_active":"2023-10-07T08:49:13.469316+0000","last_peered":"2023-10-07T08:49:13.469316+0000","last_clean":"2023-10-07T08:49:13.469316+0000","last_became_active":"2023-10-07T08:49:13.468675+0000","last_became_peered":"2023-10-07T08:49:13.468675+0000","last_unstale":"2023-10-07T08:49:13.469316+0000","last_undegraded":"2023-10-07T08:49:13.469316+0000","last_fullsized":"2023-10-07T08:49:13.469316+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:09:29.414661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.469371+0000","last_change":"2023-10-07T08:49:14.469371+0000","last_active":"2023-10-07T08:49:14.469371+0000","last_peered":"2023-10-07T08:49:14.469371+0000","last_clean":"2023-10-07T08:49:14.469371+0000","last_became_active":"2023-10-07T08:49:14.469196+0000","last_became_peered":"2023-10-07T08:49:14.469196+0000","last_unstale":"2023-10-07T08:49:14.469371+0000","last_undegraded":"2023-10-07T08:49:14.469371+0000","last_fullsized":"2023-10-07T08:49:14.469371+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:10.980930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"137'3","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.485902+0000","last_change":"2023-10-07T08:49:13.468031+0000","last_active":"2023-10-07T08:49:14.485902+0000","last_peered":"2023-10-07T08:49:14.485902+0000","last_clean":"2023-10-07T08:49:14.485902+0000","last_became_active":"2023-10-07T08:49:13.467786+0000","last_became_peered":"2023-10-07T08:49:13.467786+0000","last_unstale":"2023-10-07T08:49:14.485902+0000","last_undegraded":"2023-10-07T08:49:14.485902+0000","last_fullsized":"2023-10-07T08:49:14.485902+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:11:05.384294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.478609+0000","last_change":"2023-10-07T08:49:14.478609+0000","last_active":"2023-10-07T08:49:14.478609+0000","last_peered":"2023-10-07T08:49:14.478609+0000","last_clean":"2023-10-07T08:49:14.478609+0000","last_became_active":"2023-10-07T08:49:14.478380+0000","last_became_peered":"2023-10-07T08:49:14.478380+0000","last_unstale":"2023-10-07T08:49:14.478609+0000","last_undegraded":"2023-10-07T08:49:14.478609+0000","last_fullsized":"2023-10-07T08:49:14.478609+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:53.750164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"137'6","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.486037+0000","last_change":"2023-10-07T08:49:13.464837+0000","last_active":"2023-10-07T08:49:14.486037+0000","last_peered":"2023-10-07T08:49:14.486037+0000","last_clean":"2023-10-07T08:49:14.486037+0000","last_became_active":"2023-10-07T08:49:13.464586+0000","last_became_peered":"2023-10-07T08:49:13.464586+0000","last_unstale":"2023-10-07T08:49:14.486037+0000","last_undegraded":"2023-10-07T08:49:14.486037+0000","last_fullsized":"2023-10-07T08:49:14.486037+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:04:30.019059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.470543+0000","last_change":"2023-10-07T08:49:14.470543+0000","last_active":"2023-10-07T08:49:14.470543+0000","last_peered":"2023-10-07T08:49:14.470543+0000","last_clean":"2023-10-07T08:49:14.470543+0000","last_became_active":"2023-10-07T08:49:14.470342+0000","last_became_peered":"2023-10-07T08:49:14.470342+0000","last_unstale":"2023-10-07T08:49:14.470543+0000","last_undegraded":"2023-10-07T08:49:14.470543+0000","last_fullsized":"2023-10-07T08:49:14.470543+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:13:10.145770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.482245+0000","last_change":"2023-10-07T08:49:13.471165+0000","last_active":"2023-10-07T08:49:14.482245+0000","last_peered":"2023-10-07T08:49:14.482245+0000","last_clean":"2023-10-07T08:49:14.482245+0000","last_became_active":"2023-10-07T08:49:13.470927+0000","last_became_peered":"2023-10-07T08:49:13.470927+0000","last_unstale":"2023-10-07T08:49:14.482245+0000","last_undegraded":"2023-10-07T08:49:14.482245+0000","last_fullsized":"2023-10-07T08:49:14.482245+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:36.652642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.476665+0000","last_change":"2023-10-07T08:49:14.476665+0000","last_active":"2023-10-07T08:49:14.476665+0000","last_peered":"2023-10-07T08:49:14.476665+0000","last_clean":"2023-10-07T08:49:14.476665+0000","last_became_active":"2023-10-07T08:49:14.476437+0000","last_became_peered":"2023-10-07T08:49:14.476437+0000","last_unstale":"2023-10-07T08:49:14.476665+0000","last_undegraded":"2023-10-07T08:49:14.476665+0000","last_fullsized":"2023-10-07T08:49:14.476665+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:24.189834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.469684+0000","last_change":"2023-10-07T08:49:13.469622+0000","last_active":"2023-10-07T08:49:13.469684+0000","last_peered":"2023-10-07T08:49:13.469684+0000","last_clean":"2023-10-07T08:49:13.469684+0000","last_became_active":"2023-10-07T08:49:13.468996+0000","last_became_peered":"2023-10-07T08:49:13.468996+0000","last_unstale":"2023-10-07T08:49:13.469684+0000","last_undegraded":"2023-10-07T08:49:13.469684+0000","last_fullsized":"2023-10-07T08:49:13.469684+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:55:17.036301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.467807+0000","last_change":"2023-10-07T08:49:14.467807+0000","last_active":"2023-10-07T08:49:14.467807+0000","last_peered":"2023-10-07T08:49:14.467807+0000","last_clean":"2023-10-07T08:49:14.467807+0000","last_became_active":"2023-10-07T08:49:14.467591+0000","last_became_peered":"2023-10-07T08:49:14.467591+0000","last_unstale":"2023-10-07T08:49:14.467807+0000","last_undegraded":"2023-10-07T08:49:14.467807+0000","last_fullsized":"2023-10-07T08:49:14.467807+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:04:31.025287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"137'8","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.484063+0000","last_change":"2023-10-07T08:49:13.465326+0000","last_active":"2023-10-07T08:49:14.484063+0000","last_peered":"2023-10-07T08:49:14.484063+0000","last_clean":"2023-10-07T08:49:14.484063+0000","last_became_active":"2023-10-07T08:49:13.464257+0000","last_became_peered":"2023-10-07T08:49:13.464257+0000","last_unstale":"2023-10-07T08:49:14.484063+0000","last_undegraded":"2023-10-07T08:49:14.484063+0000","last_fullsized":"2023-10-07T08:49:14.484063+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:39:24.625180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472299+0000","last_change":"2023-10-07T08:49:14.472299+0000","last_active":"2023-10-07T08:49:14.472299+0000","last_peered":"2023-10-07T08:49:14.472299+0000","last_clean":"2023-10-07T08:49:14.472299+0000","last_became_active":"2023-10-07T08:49:14.471954+0000","last_became_peered":"2023-10-07T08:49:14.471954+0000","last_unstale":"2023-10-07T08:49:14.472299+0000","last_undegraded":"2023-10-07T08:49:14.472299+0000","last_fullsized":"2023-10-07T08:49:14.472299+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:28:40.822401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.463489+0000","last_change":"2023-10-07T08:49:13.469646+0000","last_active":"2023-10-07T08:49:14.463489+0000","last_peered":"2023-10-07T08:49:14.463489+0000","last_clean":"2023-10-07T08:49:14.463489+0000","last_became_active":"2023-10-07T08:49:13.468726+0000","last_became_peered":"2023-10-07T08:49:13.468726+0000","last_unstale":"2023-10-07T08:49:14.463489+0000","last_undegraded":"2023-10-07T08:49:14.463489+0000","last_fullsized":"2023-10-07T08:49:14.463489+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:22:38.139323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.474640+0000","last_change":"2023-10-07T08:49:14.474640+0000","last_active":"2023-10-07T08:49:14.474640+0000","last_peered":"2023-10-07T08:49:14.474640+0000","last_clean":"2023-10-07T08:49:14.474640+0000","last_became_active":"2023-10-07T08:49:14.474174+0000","last_became_peered":"2023-10-07T08:49:14.474174+0000","last_unstale":"2023-10-07T08:49:14.474640+0000","last_undegraded":"2023-10-07T08:49:14.474640+0000","last_fullsized":"2023-10-07T08:49:14.474640+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:15:29.752692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.481547+0000","last_change":"2023-10-07T08:49:13.472087+0000","last_active":"2023-10-07T08:49:14.481547+0000","last_peered":"2023-10-07T08:49:14.481547+0000","last_clean":"2023-10-07T08:49:14.481547+0000","last_became_active":"2023-10-07T08:49:13.471881+0000","last_became_peered":"2023-10-07T08:49:13.471881+0000","last_unstale":"2023-10-07T08:49:14.481547+0000","last_undegraded":"2023-10-07T08:49:14.481547+0000","last_fullsized":"2023-10-07T08:49:14.481547+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:35:19.038815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472489+0000","last_change":"2023-10-07T08:49:14.472489+0000","last_active":"2023-10-07T08:49:14.472489+0000","last_peered":"2023-10-07T08:49:14.472489+0000","last_clean":"2023-10-07T08:49:14.472489+0000","last_became_active":"2023-10-07T08:49:14.472263+0000","last_became_peered":"2023-10-07T08:49:14.472263+0000","last_unstale":"2023-10-07T08:49:14.472489+0000","last_undegraded":"2023-10-07T08:49:14.472489+0000","last_fullsized":"2023-10-07T08:49:14.472489+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:24.189834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.471076+0000","last_change":"2023-10-07T08:49:13.474366+0000","last_active":"2023-10-07T08:49:14.471076+0000","last_peered":"2023-10-07T08:49:14.471076+0000","last_clean":"2023-10-07T08:49:14.471076+0000","last_became_active":"2023-10-07T08:49:13.474160+0000","last_became_peered":"2023-10-07T08:49:13.474160+0000","last_unstale":"2023-10-07T08:49:14.471076+0000","last_undegraded":"2023-10-07T08:49:14.471076+0000","last_fullsized":"2023-10-07T08:49:14.471076+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:47:16.310703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.474180+0000","last_change":"2023-10-07T08:49:14.474180+0000","last_active":"2023-10-07T08:49:14.474180+0000","last_peered":"2023-10-07T08:49:14.474180+0000","last_clean":"2023-10-07T08:49:14.474180+0000","last_became_active":"2023-10-07T08:49:14.473891+0000","last_became_peered":"2023-10-07T08:49:14.473891+0000","last_unstale":"2023-10-07T08:49:14.474180+0000","last_undegraded":"2023-10-07T08:49:14.474180+0000","last_fullsized":"2023-10-07T08:49:14.474180+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:22:39.145551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.471917+0000","last_change":"2023-10-07T08:49:13.471851+0000","last_active":"2023-10-07T08:49:13.471917+0000","last_peered":"2023-10-07T08:49:13.471917+0000","last_clean":"2023-10-07T08:49:13.471917+0000","last_became_active":"2023-10-07T08:49:13.471276+0000","last_became_peered":"2023-10-07T08:49:13.471276+0000","last_unstale":"2023-10-07T08:49:13.471917+0000","last_undegraded":"2023-10-07T08:49:13.471917+0000","last_fullsized":"2023-10-07T08:49:13.471917+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:01:09.717760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.473109+0000","last_change":"2023-10-07T08:49:14.473109+0000","last_active":"2023-10-07T08:49:14.473109+0000","last_peered":"2023-10-07T08:49:14.473109+0000","last_clean":"2023-10-07T08:49:14.473109+0000","last_became_active":"2023-10-07T08:49:14.471896+0000","last_became_peered":"2023-10-07T08:49:14.471896+0000","last_unstale":"2023-10-07T08:49:14.473109+0000","last_undegraded":"2023-10-07T08:49:14.473109+0000","last_fullsized":"2023-10-07T08:49:14.473109+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:43:27.281523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.483667+0000","last_change":"2023-10-07T08:49:13.465865+0000","last_active":"2023-10-07T08:49:14.483667+0000","last_peered":"2023-10-07T08:49:14.483667+0000","last_clean":"2023-10-07T08:49:14.483667+0000","last_became_active":"2023-10-07T08:49:13.465244+0000","last_became_peered":"2023-10-07T08:49:13.465244+0000","last_unstale":"2023-10-07T08:49:14.483667+0000","last_undegraded":"2023-10-07T08:49:14.483667+0000","last_fullsized":"2023-10-07T08:49:14.483667+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:36:23.506302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.478063+0000","last_change":"2023-10-07T08:49:14.478063+0000","last_active":"2023-10-07T08:49:14.478063+0000","last_peered":"2023-10-07T08:49:14.478063+0000","last_clean":"2023-10-07T08:49:14.478063+0000","last_became_active":"2023-10-07T08:49:14.477844+0000","last_became_peered":"2023-10-07T08:49:14.477844+0000","last_unstale":"2023-10-07T08:49:14.478063+0000","last_undegraded":"2023-10-07T08:49:14.478063+0000","last_fullsized":"2023-10-07T08:49:14.478063+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:31:28.878755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.465990+0000","last_change":"2023-10-07T08:49:13.465746+0000","last_active":"2023-10-07T08:49:13.465990+0000","last_peered":"2023-10-07T08:49:13.465990+0000","last_clean":"2023-10-07T08:49:13.465990+0000","last_became_active":"2023-10-07T08:49:13.465504+0000","last_became_peered":"2023-10-07T08:49:13.465504+0000","last_unstale":"2023-10-07T08:49:13.465990+0000","last_undegraded":"2023-10-07T08:49:13.465990+0000","last_fullsized":"2023-10-07T08:49:13.465990+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:31:29.334053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.473334+0000","last_change":"2023-10-07T08:49:14.473334+0000","last_active":"2023-10-07T08:49:14.473334+0000","last_peered":"2023-10-07T08:49:14.473334+0000","last_clean":"2023-10-07T08:49:14.473334+0000","last_became_active":"2023-10-07T08:49:14.473051+0000","last_became_peered":"2023-10-07T08:49:14.473051+0000","last_unstale":"2023-10-07T08:49:14.473334+0000","last_undegraded":"2023-10-07T08:49:14.473334+0000","last_fullsized":"2023-10-07T08:49:14.473334+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:13:10.145770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.463957+0000","last_change":"2023-10-07T08:49:13.463478+0000","last_active":"2023-10-07T08:49:13.463957+0000","last_peered":"2023-10-07T08:49:13.463957+0000","last_clean":"2023-10-07T08:49:13.463957+0000","last_became_active":"2023-10-07T08:49:13.463246+0000","last_became_peered":"2023-10-07T08:49:13.463246+0000","last_unstale":"2023-10-07T08:49:13.463957+0000","last_undegraded":"2023-10-07T08:49:13.463957+0000","last_fullsized":"2023-10-07T08:49:13.463957+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:56:51.360397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.464853+0000","last_change":"2023-10-07T08:49:14.464853+0000","last_active":"2023-10-07T08:49:14.464853+0000","last_peered":"2023-10-07T08:49:14.464853+0000","last_clean":"2023-10-07T08:49:14.464853+0000","last_became_active":"2023-10-07T08:49:14.464620+0000","last_became_peered":"2023-10-07T08:49:14.464620+0000","last_unstale":"2023-10-07T08:49:14.464853+0000","last_undegraded":"2023-10-07T08:49:14.464853+0000","last_fullsized":"2023-10-07T08:49:14.464853+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:11:06.390522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.467978+0000","last_change":"2023-10-07T08:49:13.467893+0000","last_active":"2023-10-07T08:49:13.467978+0000","last_peered":"2023-10-07T08:49:13.467978+0000","last_clean":"2023-10-07T08:49:13.467978+0000","last_became_active":"2023-10-07T08:49:13.467613+0000","last_became_peered":"2023-10-07T08:49:13.467613+0000","last_unstale":"2023-10-07T08:49:13.467978+0000","last_undegraded":"2023-10-07T08:49:13.467978+0000","last_fullsized":"2023-10-07T08:49:13.467978+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:20:42.004153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.475082+0000","last_change":"2023-10-07T08:49:14.475082+0000","last_active":"2023-10-07T08:49:14.475082+0000","last_peered":"2023-10-07T08:49:14.475082+0000","last_clean":"2023-10-07T08:49:14.475082+0000","last_became_active":"2023-10-07T08:49:14.474730+0000","last_became_peered":"2023-10-07T08:49:14.474730+0000","last_unstale":"2023-10-07T08:49:14.475082+0000","last_undegraded":"2023-10-07T08:49:14.475082+0000","last_fullsized":"2023-10-07T08:49:14.475082+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:33:01.934423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.482665+0000","last_change":"2023-10-07T08:49:13.466482+0000","last_active":"2023-10-07T08:49:14.482665+0000","last_peered":"2023-10-07T08:49:14.482665+0000","last_clean":"2023-10-07T08:49:14.482665+0000","last_became_active":"2023-10-07T08:49:13.466265+0000","last_became_peered":"2023-10-07T08:49:13.466265+0000","last_unstale":"2023-10-07T08:49:14.482665+0000","last_undegraded":"2023-10-07T08:49:14.482665+0000","last_fullsized":"2023-10-07T08:49:14.482665+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:10.784309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.468189+0000","last_change":"2023-10-07T08:49:14.468189+0000","last_active":"2023-10-07T08:49:14.468189+0000","last_peered":"2023-10-07T08:49:14.468189+0000","last_clean":"2023-10-07T08:49:14.468189+0000","last_became_active":"2023-10-07T08:49:14.467784+0000","last_became_peered":"2023-10-07T08:49:14.467784+0000","last_unstale":"2023-10-07T08:49:14.468189+0000","last_undegraded":"2023-10-07T08:49:14.468189+0000","last_fullsized":"2023-10-07T08:49:14.468189+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:11:57.052128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.473753+0000","last_change":"2023-10-07T08:49:13.473655+0000","last_active":"2023-10-07T08:49:13.473753+0000","last_peered":"2023-10-07T08:49:13.473753+0000","last_clean":"2023-10-07T08:49:13.473753+0000","last_became_active":"2023-10-07T08:49:13.473204+0000","last_became_peered":"2023-10-07T08:49:13.473204+0000","last_unstale":"2023-10-07T08:49:13.473753+0000","last_undegraded":"2023-10-07T08:49:13.473753+0000","last_fullsized":"2023-10-07T08:49:13.473753+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:33:19.281326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.475925+0000","last_change":"2023-10-07T08:49:14.475925+0000","last_active":"2023-10-07T08:49:14.475925+0000","last_peered":"2023-10-07T08:49:14.475925+0000","last_clean":"2023-10-07T08:49:14.475925+0000","last_became_active":"2023-10-07T08:49:14.475401+0000","last_became_peered":"2023-10-07T08:49:14.475401+0000","last_unstale":"2023-10-07T08:49:14.475925+0000","last_undegraded":"2023-10-07T08:49:14.475925+0000","last_fullsized":"2023-10-07T08:49:14.475925+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:10:00.457193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.472761+0000","last_change":"2023-10-07T08:49:13.472709+0000","last_active":"2023-10-07T08:49:13.472761+0000","last_peered":"2023-10-07T08:49:13.472761+0000","last_clean":"2023-10-07T08:49:13.472761+0000","last_became_active":"2023-10-07T08:49:13.472492+0000","last_became_peered":"2023-10-07T08:49:13.472492+0000","last_unstale":"2023-10-07T08:49:13.472761+0000","last_undegraded":"2023-10-07T08:49:13.472761+0000","last_fullsized":"2023-10-07T08:49:13.472761+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:53.742693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.472701+0000","last_change":"2023-10-07T08:49:14.472701+0000","last_active":"2023-10-07T08:49:14.472701+0000","last_peered":"2023-10-07T08:49:14.472701+0000","last_clean":"2023-10-07T08:49:14.472701+0000","last_became_active":"2023-10-07T08:49:14.472429+0000","last_became_peered":"2023-10-07T08:49:14.472429+0000","last_unstale":"2023-10-07T08:49:14.472701+0000","last_undegraded":"2023-10-07T08:49:14.472701+0000","last_fullsized":"2023-10-07T08:49:14.472701+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:50:54.109509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.466615+0000","last_change":"2023-10-07T08:49:13.466521+0000","last_active":"2023-10-07T08:49:13.466615+0000","last_peered":"2023-10-07T08:49:13.466615+0000","last_clean":"2023-10-07T08:49:13.466615+0000","last_became_active":"2023-10-07T08:49:13.466290+0000","last_became_peered":"2023-10-07T08:49:13.466290+0000","last_unstale":"2023-10-07T08:49:13.466615+0000","last_undegraded":"2023-10-07T08:49:13.466615+0000","last_fullsized":"2023-10-07T08:49:13.466615+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:21:49.564978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.474431+0000","last_change":"2023-10-07T08:49:14.474431+0000","last_active":"2023-10-07T08:49:14.474431+0000","last_peered":"2023-10-07T08:49:14.474431+0000","last_clean":"2023-10-07T08:49:14.474431+0000","last_became_active":"2023-10-07T08:49:14.474217+0000","last_became_peered":"2023-10-07T08:49:14.474217+0000","last_unstale":"2023-10-07T08:49:14.474431+0000","last_undegraded":"2023-10-07T08:49:14.474431+0000","last_fullsized":"2023-10-07T08:49:14.474431+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:20:24.189834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.473400+0000","last_change":"2023-10-07T08:49:13.473079+0000","last_active":"2023-10-07T08:49:13.473400+0000","last_peered":"2023-10-07T08:49:13.473400+0000","last_clean":"2023-10-07T08:49:13.473400+0000","last_became_active":"2023-10-07T08:49:13.472849+0000","last_became_peered":"2023-10-07T08:49:13.472849+0000","last_unstale":"2023-10-07T08:49:13.473400+0000","last_undegraded":"2023-10-07T08:49:13.473400+0000","last_fullsized":"2023-10-07T08:49:13.473400+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:43:07.102018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.467051+0000","last_change":"2023-10-07T08:49:14.467051+0000","last_active":"2023-10-07T08:49:14.467051+0000","last_peered":"2023-10-07T08:49:14.467051+0000","last_clean":"2023-10-07T08:49:14.467051+0000","last_became_active":"2023-10-07T08:49:14.466434+0000","last_became_peered":"2023-10-07T08:49:14.466434+0000","last_unstale":"2023-10-07T08:49:14.467051+0000","last_undegraded":"2023-10-07T08:49:14.467051+0000","last_fullsized":"2023-10-07T08:49:14.467051+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:00:38.351594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.472888+0000","last_change":"2023-10-07T08:49:13.472827+0000","last_active":"2023-10-07T08:49:13.472888+0000","last_peered":"2023-10-07T08:49:13.472888+0000","last_clean":"2023-10-07T08:49:13.472888+0000","last_became_active":"2023-10-07T08:49:13.472535+0000","last_became_peered":"2023-10-07T08:49:13.472535+0000","last_unstale":"2023-10-07T08:49:13.472888+0000","last_undegraded":"2023-10-07T08:49:13.472888+0000","last_fullsized":"2023-10-07T08:49:13.472888+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:15:28.746464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.476703+0000","last_change":"2023-10-07T08:49:14.476703+0000","last_active":"2023-10-07T08:49:14.476703+0000","last_peered":"2023-10-07T08:49:14.476703+0000","last_clean":"2023-10-07T08:49:14.476703+0000","last_became_active":"2023-10-07T08:49:14.476436+0000","last_became_peered":"2023-10-07T08:49:14.476436+0000","last_unstale":"2023-10-07T08:49:14.476703+0000","last_undegraded":"2023-10-07T08:49:14.476703+0000","last_fullsized":"2023-10-07T08:49:14.476703+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:04:31.025287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.467307+0000","last_change":"2023-10-07T08:49:13.467161+0000","last_active":"2023-10-07T08:49:13.467307+0000","last_peered":"2023-10-07T08:49:13.467307+0000","last_clean":"2023-10-07T08:49:13.467307+0000","last_became_active":"2023-10-07T08:49:13.466871+0000","last_became_peered":"2023-10-07T08:49:13.466871+0000","last_unstale":"2023-10-07T08:49:13.467307+0000","last_undegraded":"2023-10-07T08:49:13.467307+0000","last_fullsized":"2023-10-07T08:49:13.467307+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:45:35.576511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.473969+0000","last_change":"2023-10-07T08:49:14.473969+0000","last_active":"2023-10-07T08:49:14.473969+0000","last_peered":"2023-10-07T08:49:14.473969+0000","last_clean":"2023-10-07T08:49:14.473969+0000","last_became_active":"2023-10-07T08:49:14.473365+0000","last_became_peered":"2023-10-07T08:49:14.473365+0000","last_unstale":"2023-10-07T08:49:14.473969+0000","last_undegraded":"2023-10-07T08:49:14.473969+0000","last_fullsized":"2023-10-07T08:49:14.473969+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:49:13.133736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.469853+0000","last_change":"2023-10-07T08:49:13.469784+0000","last_active":"2023-10-07T08:49:13.469853+0000","last_peered":"2023-10-07T08:49:13.469853+0000","last_clean":"2023-10-07T08:49:13.469853+0000","last_became_active":"2023-10-07T08:49:13.469425+0000","last_became_peered":"2023-10-07T08:49:13.469425+0000","last_unstale":"2023-10-07T08:49:13.469853+0000","last_undegraded":"2023-10-07T08:49:13.469853+0000","last_fullsized":"2023-10-07T08:49:13.469853+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:17:09.974702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-07T08:49:14.478866+0000","last_change":"2023-10-07T08:49:14.478866+0000","last_active":"2023-10-07T08:49:14.478866+0000","last_peered":"2023-10-07T08:49:14.478866+0000","last_clean":"2023-10-07T08:49:14.478866+0000","last_became_active":"2023-10-07T08:49:14.478628+0000","last_became_peered":"2023-10-07T08:49:14.478628+0000","last_unstale":"2023-10-07T08:49:14.478866+0000","last_undegraded":"2023-10-07T08:49:14.478866+0000","last_fullsized":"2023-10-07T08:49:14.478866+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:13.452100+0000","last_clean_scrub_stamp":"2023-10-07T08:49:13.452100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:22:39.145551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.472558+0000","last_change":"2023-10-07T08:49:13.472006+0000","last_active":"2023-10-07T08:49:13.472558+0000","last_peered":"2023-10-07T08:49:13.472558+0000","last_clean":"2023-10-07T08:49:13.472558+0000","last_became_active":"2023-10-07T08:49:13.471618+0000","last_became_peered":"2023-10-07T08:49:13.471618+0000","last_unstale":"2023-10-07T08:49:13.472558+0000","last_undegraded":"2023-10-07T08:49:13.472558+0000","last_fullsized":"2023-10-07T08:49:13.472558+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:12.445872+0000","last_clean_scrub_stamp":"2023-10-07T08:49:12.445872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:58:53.905682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":260,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-07T08:49:13.469461+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:49:13.469461+0000","last_peered":"2023-10-07T08:49:13.469461+0000","last_clean":"2023-10-07T08:49:13.469461+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:49:13.469461+0000","last_undegraded":"2023-10-07T08:49:13.469461+0000","last_fullsized":"2023-10-07T08:49:13.469461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1304,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194007,"statfs":{"total":200000000,"available":198664057,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.51500000000000001,"15min":0.499},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70799999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.51600000000000001,"15min":0.48799999999999999},"min":{"1min":0.376,"5min":0.35099999999999998,"15min":0.27700000000000002},"max":{"1min":0.70899999999999996,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.38600000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73199999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.505},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56699999999999995,"15min":0.54300000000000004},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.746,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.46100000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.40200000000000002,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.69799999999999995,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.439},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51500000000000001,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":0.63700000000000001,"5min":0.75,"15min":0.75},"last":0.41899999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55500000000000005,"15min":0.78200000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.66700000000000004,"5min":0.77200000000000002,"15min":6.8570000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.41599999999999998,"5min":0.39500000000000002,"15min":0.37},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.98999999999999999},"last":0.55200000000000005}]},{"osd":4,"last update":"Sat Oct 7 08:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46200000000000002,"15min":0.47899999999999998},"min":{"1min":0.32600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65200000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.495,"15min":0.53100000000000003},"min":{"1min":0.33400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66600000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.51900000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48099999999999998,"15min":0.503},"min":{"1min":0.33800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68400000000000005,"5min":0.751,"15min":0.751},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78300000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80600000000000005,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.307,"15min":0.307},"max":{"1min":0.72299999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":734,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194577,"statfs":{"total":200000000,"available":199247592,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.499,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.25700000000000001},"max":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.441},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.45300000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69099999999999995,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55900000000000005,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.754,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.48699999999999999},"min":{"1min":0.36899999999999999,"5min":0.313,"15min":0.29399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53500000000000003,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70999999999999996}]},{"osd":3,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.35699999999999998},"max":{"1min":0.69899999999999995,"5min":0.752,"15min":0.752},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.58699999999999997,"15min":0.53700000000000003},"min":{"1min":0.40899999999999997,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72499999999999998,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.41299999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71699999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.496},"min":{"1min":0.41999999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76300000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.39100000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52300000000000002,"15min":0.505},"min":{"1min":0.36399999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73899999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70399999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.377}]},{"osd":7,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54400000000000004,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.73999999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79000000000000004,"5min":1.052,"15min":1.052},"last":0.50900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194584,"statfs":{"total":200000000,"available":199254425,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35499999999999998,"15min":0.315},"min":{"1min":0.224,"5min":0.19400000000000001,"15min":0.17499999999999999},"max":{"1min":0.49199999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.37,"15min":0.33300000000000002},"min":{"1min":0.255,"5min":0.221,"15min":0.192},"max":{"1min":0.61599999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.251}]},{"osd":2,"last update":"Sat Oct 7 08:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36499999999999999,"15min":0.32200000000000001},"min":{"1min":0.27200000000000002,"5min":0.22700000000000001,"15min":0.19600000000000001},"max":{"1min":0.47199999999999998,"5min":1.639,"15min":1.639},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.40200000000000002,"15min":0.33700000000000002},"min":{"1min":0.25600000000000001,"5min":0.23599999999999999,"15min":0.22500000000000001},"max":{"1min":0.57099999999999995,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.28399999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.40999999999999998,"15min":0.36199999999999999},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.249},"max":{"1min":0.55600000000000005,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39600000000000002,"15min":0.35199999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55900000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.33300000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.41899999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76700000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.52700000000000002},"min":{"1min":0.41499999999999998,"5min":0.30099999999999999,"15min":0.28599999999999998},"max":{"1min":0.71499999999999997,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.502}]},{"osd":5,"last update":"Sat Oct 7 08:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.57599999999999996},"min":{"1min":0.46100000000000002,"5min":0.40100000000000002,"15min":0.371},"max":{"1min":0.82199999999999995,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.61499999999999999,"15min":0.57299999999999995},"min":{"1min":0.47899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83399999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.56899999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.54800000000000004},"min":{"1min":0.40999999999999998,"5min":0.38500000000000001,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.53300000000000003},"min":{"1min":0.44800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.75900000000000001,"5min":0.87,"15min":0.87},"last":0.627}]},{"osd":7,"last update":"Sat Oct 7 08:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.443,"5min":0.39500000000000002,"15min":0.35699999999999998},"max":{"1min":0.86299999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.628,"15min":0.58599999999999997},"min":{"1min":0.47799999999999998,"5min":0.41199999999999998,"15min":0.40799999999999997},"max":{"1min":0.72699999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1312,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193999,"statfs":{"total":200000000,"available":198655646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33300000000000002,"15min":0.36799999999999999},"min":{"1min":0.223,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46600000000000003,"5min":0.55600000000000005,"15min":1.4339999999999999},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.372,"15min":0.39300000000000002},"min":{"1min":0.28100000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51400000000000001,"5min":0.67400000000000004,"15min":1.079},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.37,"15min":0.39000000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.58599999999999997,"5min":0.63200000000000001,"15min":1.464},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.28499999999999998,"5min":0.26000000000000001,"15min":0.21299999999999999},"max":{"1min":0.58599999999999997,"5min":0.67900000000000005,"15min":1.1060000000000001},"last":0.29299999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.36399999999999999,"15min":0.38300000000000001},"min":{"1min":0.27300000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":1.341},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41599999999999998,"15min":0.434},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.25700000000000001},"max":{"1min":0.63600000000000001,"5min":0.68600000000000005,"15min":1.532},"last":0.37}]},{"osd":4,"last update":"Sat Oct 7 08:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83299999999999996,"5min":0.90200000000000002,"15min":1.3169999999999999},"last":0.5},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.60699999999999998},"min":{"1min":0.40300000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":1.51},"last":0.42599999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81499999999999995,"5min":0.89100000000000001,"15min":1.0529999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.41299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77500000000000002,"5min":0.90100000000000002,"15min":1.25},"last":0.41199999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.38600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.84199999999999997,"5min":0.92900000000000005,"15min":1.488},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60399999999999998,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.875,"5min":0.875,"15min":1.024},"last":0.48799999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.62,"15min":0.59999999999999998},"min":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84599999999999997,"5min":0.94799999999999995,"15min":0.98499999999999999},"last":0.44},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.375,"5min":0.374,"15min":0.374},"max":{"1min":0.80500000000000005,"5min":0.90300000000000002,"15min":1.288},"last":0.47699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194584,"statfs":{"total":200000000,"available":199254425,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32300000000000001,"15min":0.34100000000000003},"min":{"1min":0.192,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.495,"5min":0.52800000000000002,"15min":1.665},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35599999999999998,"15min":0.36199999999999999},"min":{"1min":0.23799999999999999,"5min":0.22800000000000001,"15min":0.22600000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":1.579},"last":0.377}]},{"osd":1,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.378,"15min":0.379},"min":{"1min":0.223,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51700000000000002,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.41799999999999998,"15min":0.42499999999999999},"min":{"1min":0.20999999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.624,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.439}]},{"osd":3,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38900000000000001,"15min":0.39200000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.55900000000000005,"5min":0.60199999999999998,"15min":1.454},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.38,"15min":0.38900000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":1.6919999999999999},"last":0.309}]},{"osd":4,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.33500000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":1.7210000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86599999999999999,"5min":0.874,"15min":1.5549999999999999},"last":0.46600000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.747,"5min":0.94399999999999995,"15min":1.5269999999999999},"last":0.495},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.46300000000000002,"5min":0.35099999999999998,"15min":0.311},"max":{"1min":0.876,"5min":0.876,"15min":1.4039999999999999},"last":0.44800000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.442,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.3380000000000001},"last":0.505},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78000000000000003,"5min":0.85899999999999999,"15min":1.637},"last":0.54800000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.434,"5min":0.379,"15min":0.379},"max":{"1min":0.76800000000000002,"5min":0.81499999999999995,"15min":1.49},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":1.375},"last":0.47699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194584,"statfs":{"total":200000000,"available":199254425,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.34799999999999998,"15min":0.32800000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.5,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.34899999999999998,"15min":0.32100000000000001},"min":{"1min":0.246,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53600000000000003,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.23899999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.375,"15min":0.35799999999999998},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.52200000000000002,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.41099999999999998,"15min":0.39600000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.22500000000000001},"max":{"1min":0.59199999999999997,"5min":1.885,"15min":1.885},"last":0.312}]},{"osd":2,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.38900000000000001,"15min":0.379},"min":{"1min":0.28499999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.45500000000000002,"5min":1.274,"15min":1.274},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.41699999999999998,"15min":0.40100000000000002},"min":{"1min":0.28699999999999998,"5min":0.27400000000000002,"15min":0.25800000000000001},"max":{"1min":0.61899999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.34200000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55800000000000005,"15min":0.50700000000000001},"min":{"1min":0.36499999999999999,"5min":0.35399999999999998,"15min":0.29999999999999999},"max":{"1min":0.77600000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58299999999999996,"15min":0.53800000000000003},"min":{"1min":0.39400000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90000000000000002,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.51200000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.57899999999999996,"15min":0.54700000000000004},"min":{"1min":0.39600000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.85799999999999998,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.57199999999999995},"min":{"1min":0.42299999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.876,"5min":1.851,"15min":1.851},"last":0.58999999999999997}]},{"osd":6,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61199999999999999,"15min":0.56200000000000006},"min":{"1min":0.45800000000000002,"5min":0.36899999999999999,"15min":0.34899999999999998},"max":{"1min":0.749,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.503},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.621,"15min":0.58799999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.94399999999999995,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61899999999999999,"15min":0.57899999999999996},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93200000000000005,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59699999999999998,"15min":0.55900000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83999999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.63200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194584,"statfs":{"total":200000000,"available":199254425,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.89300000000000002,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53900000000000003,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.69299999999999995,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.504},"min":{"1min":0.36499999999999999,"5min":0.248,"15min":0.248},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52900000000000003,"15min":0.501},"min":{"1min":0.34000000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81100000000000005,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.46500000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55100000000000005,"15min":0.53000000000000003},"min":{"1min":0.311,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66000000000000003,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.51100000000000001},"min":{"1min":0.42899999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":1.29,"15min":1.29},"last":0.38}]},{"osd":3,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.53000000000000003},"min":{"1min":0.39000000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.91400000000000003,"5min":2.052,"15min":2.052},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78700000000000003,"5min":1.369,"15min":1.369},"last":0.44900000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.29499999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.75800000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.36399999999999999,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.434}]},{"osd":6,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.52700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":0.85899999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.502},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.69799999999999995,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.59599999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53000000000000003,"15min":0.55600000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.30099999999999999},"max":{"1min":0.83899999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.379,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.90200000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":735,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194577,"statfs":{"total":200000000,"available":199247086,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54000000000000004,"15min":0.51900000000000002},"min":{"1min":0.311,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53300000000000003,"15min":0.51300000000000001},"min":{"1min":0.35399999999999998,"5min":0.33500000000000002,"15min":0.32900000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.79500000000000004},"last":0.59799999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.25,"15min":0.25},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":2.0499999999999998,"5min":0.84599999999999997,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":29.143999999999998,"5min":29.143999999999998,"15min":29.143999999999998},"last":0.501}]},{"osd":2,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.41899999999999998,"5min":0.31,"15min":0.309},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.64900000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.378,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.40400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.49199999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.80700000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77300000000000002,"5min":0.79400000000000004,"15min":0.80900000000000005},"last":0.42999999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51200000000000001,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79100000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86399999999999999,"5min":1.022,"15min":1.022},"last":0.39900000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53500000000000003,"15min":0.57199999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70799999999999996,"5min":0.81599999999999995,"15min":0.93100000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.59299999999999997},"min":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.91100000000000003},"last":0.41299999999999998}]}]}],"pool_statfs":[]}} 2023-10-07T08:49:18.896 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T08:49:18.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T08:49:19.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.048+0000 7f08aa485700 1 Processor -- start 2023-10-07T08:49:19.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.048+0000 7f08aa485700 1 -- start start 2023-10-07T08:49:19.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.049+0000 7f08aa485700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f08a4068f20 0x7f08a40cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:19.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.049+0000 7f08aa485700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a40cca80 con 0x7f08a41577c0 2023-10-07T08:49:19.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.049+0000 7f08aa485700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a40cedd0 con 0x7f08a4157b90 2023-10-07T08:49:19.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.049+0000 7f08aa485700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a40cc4c0 con 0x7f08a4068f20 2023-10-07T08:49:19.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.049+0000 7f08a3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f08a41577c0 0x7f08a4068810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34968/0 (socket says 172.21.15.81:34968) 2023-10-07T08:49:19.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.049+0000 7f08a3fff700 1 -- 172.21.15.81:0/1922538084 learned_addr learned my addr 172.21.15.81:0/1922538084 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:19.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.049+0000 7f08a37fe700 1 --2- 172.21.15.81:0/1922538084 >> v2:172.21.15.89:3300/0 conn(0x7f08a4068f20 0x7f08a40cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:19.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 -- 172.21.15.81:0/1922538084 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168194426 0 0) 0x7f08a40cca80 con 0x7f08a41577c0 2023-10-07T08:49:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 -- 172.21.15.81:0/1922538084 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f088c003570 con 0x7f08a41577c0 2023-10-07T08:49:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 -- 172.21.15.81:0/1922538084 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535870827 0 0) 0x7f08a40cedd0 con 0x7f08a4157b90 2023-10-07T08:49:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 -- 172.21.15.81:0/1922538084 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08a40cca80 con 0x7f08a4157b90 2023-10-07T08:49:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 -- 172.21.15.81:0/1922538084 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4277356415 0 0) 0x7f088c003570 con 0x7f08a41577c0 2023-10-07T08:49:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 -- 172.21.15.81:0/1922538084 >> v2:172.21.15.89:3300/0 conn(0x7f08a4068f20 msgr2=0x7f08a40cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 --2- 172.21.15.81:0/1922538084 >> v2:172.21.15.89:3300/0 conn(0x7f08a4068f20 0x7f08a40cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 -- 172.21.15.81:0/1922538084 >> v1:172.21.15.89:6789/0 conn(0x7f08a4157b90 legacy=0x7f08a40cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 -- 172.21.15.81:0/1922538084 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a40cc7a0 con 0x7f08a41577c0 2023-10-07T08:49:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 -- 172.21.15.81:0/1922538084 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f0894001470 con 0x7f08a41577c0 2023-10-07T08:49:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a37fe700 1 --2- 172.21.15.81:0/1922538084 >> v2:172.21.15.89:3300/0 conn(0x7f08a4068f20 0x7f08a40cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:49:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 -- 172.21.15.81:0/1922538084 >> v1:172.21.15.81:6789/0 conn(0x7f08a41577c0 legacy=0x7f08a4068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 --2- 172.21.15.81:0/1922538084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f088c003c40 0x7f088c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 --2- 172.21.15.81:0/1922538084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f088c004810 0x7f088c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 --2- 172.21.15.81:0/1922538084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c005210 0x7f088c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 -- 172.21.15.81:0/1922538084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a40cc4c0 con 0x7f088c004810 2023-10-07T08:49:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 -- 172.21.15.81:0/1922538084 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c00c130 con 0x7f088c003c40 2023-10-07T08:49:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a2ffd700 1 -- 172.21.15.81:0/1922538084 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c00c2c0 con 0x7f088c005210 2023-10-07T08:49:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a37fe700 1 --2- 172.21.15.81:0/1922538084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f088c004810 0x7f088c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a3fff700 1 --2- 172.21.15.81:0/1922538084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f088c003c40 0x7f088c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a8a22700 1 --2- 172.21.15.81:0/1922538084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c005210 0x7f088c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a37fe700 1 -- 172.21.15.81:0/1922538084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c005210 msgr2=0x7f088c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a37fe700 1 --2- 172.21.15.81:0/1922538084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c005210 0x7f088c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a37fe700 1 -- 172.21.15.81:0/1922538084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f088c003c40 msgr2=0x7f088c004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a37fe700 1 --2- 172.21.15.81:0/1922538084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f088c003c40 0x7f088c004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a37fe700 1 -- 172.21.15.81:0/1922538084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c003570 con 0x7f088c004810 2023-10-07T08:49:19.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a8a22700 1 --2- 172.21.15.81:0/1922538084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c005210 0x7f088c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:19.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a8a22700 1 -- 172.21.15.81:0/1922538084 reap_dead start 2023-10-07T08:49:19.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.050+0000 7f08a37fe700 1 --2- 172.21.15.81:0/1922538084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f088c004810 0x7f088c004c80 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f0898009df0 tx=0x7f08980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a86cc4c85ab463 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:19.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.051+0000 7f08a2ffd700 1 -- 172.21.15.81:0/1922538084 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0898009740 con 0x7f088c004810 2023-10-07T08:49:19.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.051+0000 7f08a2ffd700 1 -- 172.21.15.81:0/1922538084 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089800e920 con 0x7f088c004810 2023-10-07T08:49:19.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.051+0000 7f08a2ffd700 1 -- 172.21.15.81:0/1922538084 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089800ece0 con 0x7f088c004810 2023-10-07T08:49:19.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.051+0000 7f08aa485700 1 -- 172.21.15.81:0/1922538084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f088c004810 msgr2=0x7f088c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:19.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.051+0000 7f08aa485700 1 --2- 172.21.15.81:0/1922538084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f088c004810 0x7f088c004c80 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f0898009df0 tx=0x7f08980091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.051+0000 7f08aa485700 1 -- 172.21.15.81:0/1922538084 shutdown_connections 2023-10-07T08:49:19.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.051+0000 7f08aa485700 1 --2- 172.21.15.81:0/1922538084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f088c004810 0x7f088c004c80 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.051+0000 7f08aa485700 1 -- 172.21.15.81:0/1922538084 >> 172.21.15.81:0/1922538084 conn(0x7f08a40d0df0 msgr2=0x7f08a40d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.051+0000 7f08aa485700 1 -- 172.21.15.81:0/1922538084 shutdown_connections 2023-10-07T08:49:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.051+0000 7f08aa485700 1 -- 172.21.15.81:0/1922538084 wait complete. 2023-10-07T08:49:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.052+0000 7f08aa485700 1 Processor -- start 2023-10-07T08:49:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.052+0000 7f08aa485700 1 -- start start 2023-10-07T08:49:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.053+0000 7f08aa485700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c004810 0x7f08a40ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.053+0000 7f08aa485700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a416b3a0 0x7f08a4154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.053+0000 7f08aa485700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08a40b46b0 0x7f08a40b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.053+0000 7f08aa485700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a40b5060 con 0x7f08a416b3a0 2023-10-07T08:49:19.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.053+0000 7f08aa485700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a40b3cd0 con 0x7f08a40b46b0 2023-10-07T08:49:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.053+0000 7f08aa485700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a40b3fb0 con 0x7f088c004810 2023-10-07T08:49:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.053+0000 7f08a37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a416b3a0 0x7f08a4154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.053+0000 7f08a37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a416b3a0 0x7f08a4154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34234/0 (socket says 172.21.15.81:34234) 2023-10-07T08:49:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.053+0000 7f08a37fe700 1 -- 172.21.15.81:0/1845568768 learned_addr learned my addr 172.21.15.81:0/1845568768 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.053+0000 7f08a3fff700 1 --2- 172.21.15.81:0/1845568768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c004810 0x7f08a40ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.053+0000 7f08a8a22700 1 --2- 172.21.15.81:0/1845568768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08a40b46b0 0x7f08a40b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.053+0000 7f08a37fe700 1 -- 172.21.15.81:0/1845568768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c004810 msgr2=0x7f08a40ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.053+0000 7f08a37fe700 1 --2- 172.21.15.81:0/1845568768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c004810 0x7f08a40ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.054+0000 7f08a37fe700 1 -- 172.21.15.81:0/1845568768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08a40b46b0 msgr2=0x7f08a40b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.054+0000 7f08a37fe700 1 --2- 172.21.15.81:0/1845568768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08a40b46b0 0x7f08a40b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.054+0000 7f08a37fe700 1 -- 172.21.15.81:0/1845568768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a40b4290 con 0x7f08a416b3a0 2023-10-07T08:49:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.054+0000 7f08a8a22700 1 --2- 172.21.15.81:0/1845568768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08a40b46b0 0x7f08a40b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.054+0000 7f08a3fff700 1 --2- 172.21.15.81:0/1845568768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c004810 0x7f08a40ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.054+0000 7f08a37fe700 1 --2- 172.21.15.81:0/1845568768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a416b3a0 0x7f08a4154590 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f088c0057b0 tx=0x7f089801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.054+0000 7f088bfff700 1 -- 172.21.15.81:0/1845568768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0898022070 con 0x7f08a416b3a0 2023-10-07T08:49:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.054+0000 7f088bfff700 1 -- 172.21.15.81:0/1845568768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0898013be0 con 0x7f08a416b3a0 2023-10-07T08:49:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.054+0000 7f088bfff700 1 -- 172.21.15.81:0/1845568768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089801c450 con 0x7f08a416b3a0 2023-10-07T08:49:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.054+0000 7f08aa485700 1 -- 172.21.15.81:0/1845568768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a416b810 con 0x7f08a416b3a0 2023-10-07T08:49:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.054+0000 7f08aa485700 1 -- 172.21.15.81:0/1845568768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a4154ad0 con 0x7f08a416b3a0 2023-10-07T08:49:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.055+0000 7f08aa485700 1 -- 172.21.15.81:0/1845568768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a40b4420 con 0x7f08a416b3a0 2023-10-07T08:49:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.055+0000 7f088bfff700 1 -- 172.21.15.81:0/1845568768 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0898026070 con 0x7f08a416b3a0 2023-10-07T08:49:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.055+0000 7f088bfff700 1 --2- 172.21.15.81:0/1845568768 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0890066f60 0x7f0890069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.056+0000 7f088bfff700 1 -- 172.21.15.81:0/1845568768 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0898085d80 con 0x7f08a416b3a0 2023-10-07T08:49:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.056+0000 7f08a3fff700 1 --2- 172.21.15.81:0/1845568768 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0890066f60 0x7f0890069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.056+0000 7f08a3fff700 1 --2- 172.21.15.81:0/1845568768 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0890066f60 0x7f0890069410 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0894000e10 tx=0x7f0894009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.060+0000 7f088bfff700 1 -- 172.21.15.81:0/1845568768 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0898053030 con 0x7f08a416b3a0 2023-10-07T08:49:19.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.315+0000 7f08aa485700 1 -- 172.21.15.81:0/1845568768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f08a40b5060 con 0x7f08a416b3a0 2023-10-07T08:49:19.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.319+0000 7f088bfff700 1 -- 172.21.15.81:0/1845568768 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f08980170e0 con 0x7f08a416b3a0 2023-10-07T08:49:19.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.321+0000 7f08aa485700 1 -- 172.21.15.81:0/1845568768 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0890066f60 msgr2=0x7f0890069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:19.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.321+0000 7f08aa485700 1 --2- 172.21.15.81:0/1845568768 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0890066f60 0x7f0890069410 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0894000e10 tx=0x7f0894009040 comp rx=0 tx=0).stop 2023-10-07T08:49:19.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.321+0000 7f08aa485700 1 -- 172.21.15.81:0/1845568768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a416b3a0 msgr2=0x7f08a4154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:19.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.321+0000 7f08aa485700 1 --2- 172.21.15.81:0/1845568768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a416b3a0 0x7f08a4154590 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f088c0057b0 tx=0x7f089801a000 comp rx=0 tx=0).stop 2023-10-07T08:49:19.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.321+0000 7f08aa485700 1 -- 172.21.15.81:0/1845568768 shutdown_connections 2023-10-07T08:49:19.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.321+0000 7f08aa485700 1 --2- 172.21.15.81:0/1845568768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08a40b46b0 0x7f08a40b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.321+0000 7f08aa485700 1 --2- 172.21.15.81:0/1845568768 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0890066f60 0x7f0890069410 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.321+0000 7f08aa485700 1 --2- 172.21.15.81:0/1845568768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c004810 0x7f08a40ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.321+0000 7f08aa485700 1 --2- 172.21.15.81:0/1845568768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a416b3a0 0x7f08a4154590 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.321+0000 7f08aa485700 1 -- 172.21.15.81:0/1845568768 >> 172.21.15.81:0/1845568768 conn(0x7f08a40d0df0 msgr2=0x7f08a41567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:19.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.322+0000 7f08aa485700 1 -- 172.21.15.81:0/1845568768 shutdown_connections 2023-10-07T08:49:19.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.322+0000 7f08aa485700 1 -- 172.21.15.81:0/1845568768 wait complete. 2023-10-07T08:49:19.324 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-07T08:49:19.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:49:19.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.447+0000 7f4da53fb700 1 Processor -- start 2023-10-07T08:49:19.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.447+0000 7f4da53fb700 1 -- start start 2023-10-07T08:49:19.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.448+0000 7f4da53fb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4da0156420 0x7f4da00cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:19.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.448+0000 7f4da53fb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4da00cc250 0x7f4da0069440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:19.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.448+0000 7f4da53fb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da0069980 0x7f4da00cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:19.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.448+0000 7f4da53fb700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da006aa10 con 0x7f4da0156420 2023-10-07T08:49:19.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.448+0000 7f4da53fb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da00cb880 con 0x7f4da00cc250 2023-10-07T08:49:19.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.448+0000 7f4da53fb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da00cac70 con 0x7f4da0069980 2023-10-07T08:49:19.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.448+0000 7f4d9effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4da0156420 0x7f4da00cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:19.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.448+0000 7f4d9effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4da0156420 0x7f4da00cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34246/0 (socket says 172.21.15.81:34246) 2023-10-07T08:49:19.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.448+0000 7f4d9effd700 1 -- 172.21.15.81:0/275350882 learned_addr learned my addr 172.21.15.81:0/275350882 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:19.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.448+0000 7f4d967fc700 1 --2- 172.21.15.81:0/275350882 >> v2:172.21.15.89:3300/0 conn(0x7f4da00cc250 0x7f4da0069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:19.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.448+0000 7f4d9f7fe700 1 --2- 172.21.15.81:0/275350882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da0069980 0x7f4da00cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:19.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4d9effd700 1 -- 172.21.15.81:0/275350882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da0069980 msgr2=0x7f4da00cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:19.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4d9effd700 1 --2- 172.21.15.81:0/275350882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da0069980 0x7f4da00cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4d9effd700 1 -- 172.21.15.81:0/275350882 >> v2:172.21.15.89:3300/0 conn(0x7f4da00cc250 msgr2=0x7f4da0069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:19.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4d9effd700 1 --2- 172.21.15.81:0/275350882 >> v2:172.21.15.89:3300/0 conn(0x7f4da00cc250 0x7f4da0069440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4d9effd700 1 -- 172.21.15.81:0/275350882 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da00caf50 con 0x7f4da0156420 2023-10-07T08:49:19.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4d967fc700 1 --2- 172.21.15.81:0/275350882 >> v2:172.21.15.89:3300/0 conn(0x7f4da00cc250 0x7f4da0069440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:19.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4d9effd700 1 --2- 172.21.15.81:0/275350882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4da0156420 0x7f4da00cbd10 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f4da0159f00 tx=0x7f4d90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c68b133a91a2b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:19.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4d9e7fc700 1 -- 172.21.15.81:0/275350882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000b860 con 0x7f4da0156420 2023-10-07T08:49:19.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4d9e7fc700 1 -- 172.21.15.81:0/275350882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9000b9c0 con 0x7f4da0156420 2023-10-07T08:49:19.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4d9e7fc700 1 -- 172.21.15.81:0/275350882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000bd60 con 0x7f4da0156420 2023-10-07T08:49:19.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4da53fb700 1 -- 172.21.15.81:0/275350882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4da0156420 msgr2=0x7f4da00cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:19.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4da53fb700 1 --2- 172.21.15.81:0/275350882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4da0156420 0x7f4da00cbd10 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f4da0159f00 tx=0x7f4d90009250 comp rx=0 tx=0).stop 2023-10-07T08:49:19.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4da53fb700 1 -- 172.21.15.81:0/275350882 shutdown_connections 2023-10-07T08:49:19.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4da53fb700 1 --2- 172.21.15.81:0/275350882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da0069980 0x7f4da00cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4da53fb700 1 --2- 172.21.15.81:0/275350882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4da0156420 0x7f4da00cbd10 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4da53fb700 1 --2- 172.21.15.81:0/275350882 >> v2:172.21.15.89:3300/0 conn(0x7f4da00cc250 0x7f4da0069440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.449+0000 7f4da53fb700 1 -- 172.21.15.81:0/275350882 >> 172.21.15.81:0/275350882 conn(0x7f4da006c660 msgr2=0x7f4da00cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:19.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.450+0000 7f4da53fb700 1 -- 172.21.15.81:0/275350882 shutdown_connections 2023-10-07T08:49:19.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.450+0000 7f4da53fb700 1 -- 172.21.15.81:0/275350882 wait complete. 2023-10-07T08:49:19.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.451+0000 7f4da53fb700 1 Processor -- start 2023-10-07T08:49:19.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.451+0000 7f4da53fb700 1 -- start start 2023-10-07T08:49:19.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.451+0000 7f4da53fb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da0069980 0x7f4da0143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:19.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4da53fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4da00cc250 0x7f4da0142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:19.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4da53fb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da0156420 0x7f4da00c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:19.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4da53fb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da00c3a70 con 0x7f4da00cc250 2023-10-07T08:49:19.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4da53fb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da00c3d50 con 0x7f4da0156420 2023-10-07T08:49:19.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4da53fb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da00b20a0 con 0x7f4da0069980 2023-10-07T08:49:19.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4d967fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4da00cc250 0x7f4da0142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:19.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4d967fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4da00cc250 0x7f4da0142920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34248/0 (socket says 172.21.15.81:34248) 2023-10-07T08:49:19.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4d967fc700 1 -- 172.21.15.81:0/284047594 learned_addr learned my addr 172.21.15.81:0/284047594 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:19.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4d9effd700 1 --2- 172.21.15.81:0/284047594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da0069980 0x7f4da0143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:19.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4d967fc700 1 -- 172.21.15.81:0/284047594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da0069980 msgr2=0x7f4da0143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:19.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4d9f7fe700 1 --2- 172.21.15.81:0/284047594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da0156420 0x7f4da00c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:19.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4d967fc700 1 --2- 172.21.15.81:0/284047594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da0069980 0x7f4da0143360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4d967fc700 1 -- 172.21.15.81:0/284047594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da0156420 msgr2=0x7f4da00c2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:19.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4d967fc700 1 --2- 172.21.15.81:0/284047594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da0156420 0x7f4da00c2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4d967fc700 1 -- 172.21.15.81:0/284047594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d900094f0 con 0x7f4da00cc250 2023-10-07T08:49:19.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4d9effd700 1 --2- 172.21.15.81:0/284047594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da0069980 0x7f4da0143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:19.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4d9f7fe700 1 --2- 172.21.15.81:0/284047594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da0156420 0x7f4da00c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:19.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4d967fc700 1 --2- 172.21.15.81:0/284047594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4da00cc250 0x7f4da0142920 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800e900 tx=0x7f4d88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:19.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4d977fe700 1 -- 172.21.15.81:0/284047594 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8800eea0 con 0x7f4da00cc250 2023-10-07T08:49:19.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4d977fe700 1 -- 172.21.15.81:0/284047594 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8800c5e0 con 0x7f4da00cc250 2023-10-07T08:49:19.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4da53fb700 1 -- 172.21.15.81:0/284047594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da00b2380 con 0x7f4da00cc250 2023-10-07T08:49:19.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4d977fe700 1 -- 172.21.15.81:0/284047594 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8800c980 con 0x7f4da00cc250 2023-10-07T08:49:19.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.452+0000 7f4da53fb700 1 -- 172.21.15.81:0/284047594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da00b1c70 con 0x7f4da00cc250 2023-10-07T08:49:19.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.453+0000 7f4da53fb700 1 -- 172.21.15.81:0/284047594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da0067bc0 con 0x7f4da00cc250 2023-10-07T08:49:19.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.453+0000 7f4d977fe700 1 -- 172.21.15.81:0/284047594 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d8800cd30 con 0x7f4da00cc250 2023-10-07T08:49:19.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.454+0000 7f4d977fe700 1 --2- 172.21.15.81:0/284047594 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4d80066f30 0x7f4d800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:19.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.454+0000 7f4d977fe700 1 -- 172.21.15.81:0/284047594 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4d88084350 con 0x7f4da00cc250 2023-10-07T08:49:19.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.454+0000 7f4d9effd700 1 --2- 172.21.15.81:0/284047594 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4d80066f30 0x7f4d800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:19.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.454+0000 7f4d9effd700 1 --2- 172.21.15.81:0/284047594 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4d80066f30 0x7f4d800693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4da0159f00 tx=0x7f4d90017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:19.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.458+0000 7f4d977fe700 1 -- 172.21.15.81:0/284047594 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d88055050 con 0x7f4da00cc250 2023-10-07T08:49:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.685+0000 7f4da53fb700 1 -- 172.21.15.81:0/284047594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4da00cb230 con 0x7f4da00cc250 2023-10-07T08:49:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.685+0000 7f4d977fe700 1 -- 172.21.15.81:0/284047594 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f4d88054be0 con 0x7f4da00cc250 2023-10-07T08:49:19.687 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:19.687 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1795695306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1795695306},{"type":"v1","addr":"172.21.15.89:6834","nonce":1795695306}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3856313795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3856313795},{"type":"v1","addr":"172.21.15.89:6835","nonce":3856313795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7119,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4143803144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4143803144},{"type":"v1","addr":"172.21.15.81:6836","nonce":4143803144}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:49:13.845110+0000","modified":"2023-10-07T08:49:17.485796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3151244734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3151244734},{"type":"v1","addr":"172.21.15.81:6837","nonce":3151244734}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-07T08:49:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.687+0000 7f4da53fb700 1 -- 172.21.15.81:0/284047594 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4d80066f30 msgr2=0x7f4d800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.687+0000 7f4da53fb700 1 --2- 172.21.15.81:0/284047594 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4d80066f30 0x7f4d800693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4da0159f00 tx=0x7f4d90017000 comp rx=0 tx=0).stop 2023-10-07T08:49:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.687+0000 7f4da53fb700 1 -- 172.21.15.81:0/284047594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4da00cc250 msgr2=0x7f4da0142920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.687+0000 7f4da53fb700 1 --2- 172.21.15.81:0/284047594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4da00cc250 0x7f4da0142920 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800e900 tx=0x7f4d88008040 comp rx=0 tx=0).stop 2023-10-07T08:49:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.687+0000 7f4da53fb700 1 -- 172.21.15.81:0/284047594 shutdown_connections 2023-10-07T08:49:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.687+0000 7f4da53fb700 1 --2- 172.21.15.81:0/284047594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da0156420 0x7f4da00c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.687+0000 7f4da53fb700 1 --2- 172.21.15.81:0/284047594 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4d80066f30 0x7f4d800693e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.687+0000 7f4da53fb700 1 --2- 172.21.15.81:0/284047594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da0069980 0x7f4da0143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.687+0000 7f4da53fb700 1 --2- 172.21.15.81:0/284047594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4da00cc250 0x7f4da0142920 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.687+0000 7f4da53fb700 1 -- 172.21.15.81:0/284047594 >> 172.21.15.81:0/284047594 conn(0x7f4da006c660 msgr2=0x7f4da006d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.687+0000 7f4da53fb700 1 -- 172.21.15.81:0/284047594 shutdown_connections 2023-10-07T08:49:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:19.687+0000 7f4da53fb700 1 -- 172.21.15.81:0/284047594 wait complete. 2023-10-07T08:49:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2023-10-07T08:49:19.753 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-10-07T08:49:19.753+0000 7fc6f282c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:49:20.104 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T08:49:13.845110+0000', 'modified': '2023-10-07T08:49:17.485796+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7122}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7122': {'gid': 7122, 'name': 'c', 'rank': 0, 'incarnation': 62, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/3151244734', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 3151244734}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3151244734}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T08:49:20.104 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T08:49:20.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-07T08:49:20.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.219+0000 7fc124979700 1 Processor -- start 2023-10-07T08:49:20.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.219+0000 7fc124979700 1 -- start start 2023-10-07T08:49:20.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.220+0000 7fc124979700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1201578d0 0x7fc1200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.220+0000 7fc124979700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc12006d120 0x7fc12006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.220+0000 7fc124979700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1200d07c0 con 0x7fc120157ca0 2023-10-07T08:49:20.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.220+0000 7fc124979700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12006da50 con 0x7fc1201578d0 2023-10-07T08:49:20.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.220+0000 7fc124979700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1200cfbb0 con 0x7fc12006d120 2023-10-07T08:49:20.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.220+0000 7fc11e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1201578d0 0x7fc1200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.220+0000 7fc11e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1201578d0 0x7fc1200cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34262/0 (socket says 172.21.15.81:34262) 2023-10-07T08:49:20.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.220+0000 7fc11e59c700 1 -- 172.21.15.81:0/691141769 learned_addr learned my addr 172.21.15.81:0/691141769 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:20.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.220+0000 7fc11ed9d700 1 --2- 172.21.15.81:0/691141769 >> v2:172.21.15.89:3300/0 conn(0x7fc12006d120 0x7fc12006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.220+0000 7fc11e59c700 1 -- 172.21.15.81:0/691141769 >> v2:172.21.15.89:3300/0 conn(0x7fc12006d120 msgr2=0x7fc12006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:20.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.220+0000 7fc11e59c700 1 --2- 172.21.15.81:0/691141769 >> v2:172.21.15.89:3300/0 conn(0x7fc12006d120 0x7fc12006d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.220+0000 7fc11e59c700 1 -- 172.21.15.81:0/691141769 >> v1:172.21.15.89:6789/0 conn(0x7fc120157ca0 legacy=0x7fc12015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:20.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.220+0000 7fc11e59c700 1 -- 172.21.15.81:0/691141769 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1200cfe90 con 0x7fc1201578d0 2023-10-07T08:49:20.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.220+0000 7fc11ed9d700 1 --2- 172.21.15.81:0/691141769 >> v2:172.21.15.89:3300/0 conn(0x7fc12006d120 0x7fc12006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:20.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.220+0000 7fc11e59c700 1 --2- 172.21.15.81:0/691141769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1201578d0 0x7fc1200cf4f0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fc120068300 tx=0x7fc118009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3430c3500a0b1df5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:20.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.220+0000 7fc11d59a700 1 -- 172.21.15.81:0/691141769 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11800b820 con 0x7fc1201578d0 2023-10-07T08:49:20.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.221+0000 7fc11d59a700 1 -- 172.21.15.81:0/691141769 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11800b980 con 0x7fc1201578d0 2023-10-07T08:49:20.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.221+0000 7fc11d59a700 1 -- 172.21.15.81:0/691141769 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11800bd20 con 0x7fc1201578d0 2023-10-07T08:49:20.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.221+0000 7fc124979700 1 -- 172.21.15.81:0/691141769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1201578d0 msgr2=0x7fc1200cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:20.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.221+0000 7fc124979700 1 --2- 172.21.15.81:0/691141769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1201578d0 0x7fc1200cf4f0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fc120068300 tx=0x7fc118009250 comp rx=0 tx=0).stop 2023-10-07T08:49:20.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.221+0000 7fc124979700 1 -- 172.21.15.81:0/691141769 shutdown_connections 2023-10-07T08:49:20.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.221+0000 7fc124979700 1 --2- 172.21.15.81:0/691141769 >> v2:172.21.15.89:3300/0 conn(0x7fc12006d120 0x7fc12006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.221+0000 7fc124979700 1 --2- 172.21.15.81:0/691141769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1201578d0 0x7fc1200cf4f0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.221+0000 7fc124979700 1 -- 172.21.15.81:0/691141769 >> 172.21.15.81:0/691141769 conn(0x7fc12006bb90 msgr2=0x7fc12006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:20.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.221+0000 7fc124979700 1 -- 172.21.15.81:0/691141769 shutdown_connections 2023-10-07T08:49:20.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.221+0000 7fc124979700 1 -- 172.21.15.81:0/691141769 wait complete. 2023-10-07T08:49:20.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.222+0000 7fc124979700 1 Processor -- start 2023-10-07T08:49:20.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.222+0000 7fc124979700 1 -- start start 2023-10-07T08:49:20.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.223+0000 7fc124979700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc12006d120 0x7fc1200c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.223+0000 7fc124979700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1201578d0 0x7fc1201580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.223+0000 7fc124979700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc120157ca0 0x7fc1200cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.223+0000 7fc124979700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc120158630 con 0x7fc1201578d0 2023-10-07T08:49:20.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.223+0000 7fc124979700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1200cd9f0 con 0x7fc12006d120 2023-10-07T08:49:20.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.223+0000 7fc124979700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12016a960 con 0x7fc120157ca0 2023-10-07T08:49:20.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.223+0000 7fc11dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1201578d0 0x7fc1201580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.223+0000 7fc11dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1201578d0 0x7fc1201580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34268/0 (socket says 172.21.15.81:34268) 2023-10-07T08:49:20.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.223+0000 7fc11dd9b700 1 -- 172.21.15.81:0/2630283164 learned_addr learned my addr 172.21.15.81:0/2630283164 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:20.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.223+0000 7fc11dd9b700 1 -- 172.21.15.81:0/2630283164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc120157ca0 msgr2=0x7fc1200cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:20.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.223+0000 7fc11dd9b700 1 --2- 172.21.15.81:0/2630283164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc120157ca0 0x7fc1200cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.223+0000 7fc11dd9b700 1 -- 172.21.15.81:0/2630283164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc12006d120 msgr2=0x7fc1200c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:20.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.223+0000 7fc11dd9b700 1 --2- 172.21.15.81:0/2630283164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc12006d120 0x7fc1200c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.223+0000 7fc11dd9b700 1 -- 172.21.15.81:0/2630283164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1180094f0 con 0x7fc1201578d0 2023-10-07T08:49:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.223+0000 7fc11dd9b700 1 --2- 172.21.15.81:0/2630283164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1201578d0 0x7fc1201580f0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fc10800b5e0 tx=0x7fc1080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.224+0000 7fc1167fc700 1 -- 172.21.15.81:0/2630283164 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10800f510 con 0x7fc1201578d0 2023-10-07T08:49:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.224+0000 7fc1167fc700 1 -- 172.21.15.81:0/2630283164 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10800f6b0 con 0x7fc1201578d0 2023-10-07T08:49:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.224+0000 7fc124979700 1 -- 172.21.15.81:0/2630283164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc120158840 con 0x7fc1201578d0 2023-10-07T08:49:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.224+0000 7fc1167fc700 1 -- 172.21.15.81:0/2630283164 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10800fa70 con 0x7fc1201578d0 2023-10-07T08:49:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.224+0000 7fc124979700 1 -- 172.21.15.81:0/2630283164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc120158e00 con 0x7fc1201578d0 2023-10-07T08:49:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.225+0000 7fc1167fc700 1 -- 172.21.15.81:0/2630283164 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc10801a400 con 0x7fc1201578d0 2023-10-07T08:49:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.226+0000 7fc1167fc700 1 --2- 172.21.15.81:0/2630283164 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc100066f60 0x7fc100069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.226+0000 7fc1167fc700 1 -- 172.21.15.81:0/2630283164 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc1080840b0 con 0x7fc1201578d0 2023-10-07T08:49:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.226+0000 7fc11e59c700 1 --2- 172.21.15.81:0/2630283164 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc100066f60 0x7fc100069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.226+0000 7fc11e59c700 1 --2- 172.21.15.81:0/2630283164 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc100066f60 0x7fc100069410 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc120068300 tx=0x7fc118016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.228+0000 7fc12dc71b80 1 Processor -- start 2023-10-07T08:49:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.228+0000 7fc12dc71b80 1 -- start start 2023-10-07T08:49:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.228+0000 7fc12dc71b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162feb2a50 0x56162feb2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.228+0000 7fc12dc71b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162fefcd00 0x56162fedba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.228+0000 7fc12dc71b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fedbf60 0x56162feaecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.228+0000 7fc12dc71b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162fe09a70 con 0x56162feb2a50 2023-10-07T08:49:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.228+0000 7fc12dc71b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162fe07270 con 0x56162fedbf60 2023-10-07T08:49:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.228+0000 7fc12dc71b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56162fe03060 con 0x56162fefcd00 2023-10-07T08:49:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.229+0000 7fc11e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162feb2a50 0x56162feb2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.229+0000 7fc11e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162feb2a50 0x56162feb2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34272/0 (socket says 172.21.15.81:34272) 2023-10-07T08:49:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.229+0000 7fc11e59c700 1 -- 172.21.15.81:0/3474656116 learned_addr learned my addr 172.21.15.81:0/3474656116 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.229+0000 7fc11e59c700 1 -- 172.21.15.81:0/3474656116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162fefcd00 msgr2=0x56162fedba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.229+0000 7fc11e59c700 1 --2- 172.21.15.81:0/3474656116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162fefcd00 0x56162fedba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.229+0000 7fc11e59c700 1 -- 172.21.15.81:0/3474656116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fedbf60 msgr2=0x56162feaecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.229+0000 7fc11e59c700 1 --2- 172.21.15.81:0/3474656116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fedbf60 0x56162feaecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.229+0000 7fc11e59c700 1 -- 172.21.15.81:0/3474656116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56162fc9d270 con 0x56162feb2a50 2023-10-07T08:49:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.229+0000 7fc11e59c700 1 --2- 172.21.15.81:0/3474656116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162feb2a50 0x56162feb2e20 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fc11800bb70 tx=0x7fc11801e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bf077afe0e7157 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.229+0000 7fc0ff7fe700 1 -- 172.21.15.81:0/3474656116 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118011630 con 0x56162feb2a50 2023-10-07T08:49:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.229+0000 7fc0ff7fe700 1 -- 172.21.15.81:0/3474656116 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc118020070 con 0x56162feb2a50 2023-10-07T08:49:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.229+0000 7fc0ff7fe700 1 -- 172.21.15.81:0/3474656116 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1180119c0 con 0x56162feb2a50 2023-10-07T08:49:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.230+0000 7fc12dc71b80 1 -- 172.21.15.81:0/3474656116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162feb2a50 msgr2=0x56162feb2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:20.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.230+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/3474656116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162feb2a50 0x56162feb2e20 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fc11800bb70 tx=0x7fc11801e070 comp rx=0 tx=0).stop 2023-10-07T08:49:20.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.230+0000 7fc12dc71b80 1 -- 172.21.15.81:0/3474656116 shutdown_connections 2023-10-07T08:49:20.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.230+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/3474656116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fedbf60 0x56162feaecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.230+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/3474656116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162feb2a50 0x56162feb2e20 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.230+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/3474656116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162fefcd00 0x56162fedba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.230+0000 7fc12dc71b80 1 -- 172.21.15.81:0/3474656116 >> 172.21.15.81:0/3474656116 conn(0x56162feb4370 msgr2=0x56162feb4740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:20.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.230+0000 7fc12dc71b80 1 -- 172.21.15.81:0/3474656116 shutdown_connections 2023-10-07T08:49:20.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.230+0000 7fc12dc71b80 1 -- 172.21.15.81:0/3474656116 wait complete. 2023-10-07T08:49:20.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.230+0000 7fc12dc71b80 1 -- start start 2023-10-07T08:49:20.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.230+0000 7fc12dc71b80 1 Processor -- start 2023-10-07T08:49:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.231+0000 7fc12dc71b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162feb2a50 0x56162feae080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.231+0000 7fc12dc71b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fedbf60 0x56162fef0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.231+0000 7fc12dc71b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162fefcd00 0x56162ff0b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.231+0000 7fc12dc71b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162fdae890 con 0x56162fefcd00 2023-10-07T08:49:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.231+0000 7fc12dc71b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162fdc9ea0 con 0x56162fedbf60 2023-10-07T08:49:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.231+0000 7fc12dc71b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56162fc85e30 con 0x56162feb2a50 2023-10-07T08:49:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.231+0000 7fc12dc71b80 10 client.0 _ll_register_callbacks cb 0x56162fe76110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:49:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.231+0000 7fc11ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162fefcd00 0x56162ff0b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc11ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162fefcd00 0x56162ff0b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34276/0 (socket says 172.21.15.81:34276) 2023-10-07T08:49:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc11ed9d700 1 -- 172.21.15.81:0/2152380285 learned_addr learned my addr 172.21.15.81:0/2152380285 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc11dd9b700 1 --2- 172.21.15.81:0/2152380285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fedbf60 0x56162fef0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc11e59c700 1 --2- 172.21.15.81:0/2152380285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162feb2a50 0x56162feae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc11ed9d700 1 -- 172.21.15.81:0/2152380285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162feb2a50 msgr2=0x56162feae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc11ed9d700 1 --2- 172.21.15.81:0/2152380285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162feb2a50 0x56162feae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc11ed9d700 1 -- 172.21.15.81:0/2152380285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fedbf60 msgr2=0x56162fef0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc11ed9d700 1 --2- 172.21.15.81:0/2152380285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fedbf60 0x56162fef0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc11ed9d700 1 -- 172.21.15.81:0/2152380285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1200cfe90 con 0x56162fefcd00 2023-10-07T08:49:20.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc11ed9d700 1 --2- 172.21.15.81:0/2152380285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162fefcd00 0x56162ff0b960 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fc11000cae0 tx=0x7fc1100078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be06253692d4b702 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:20.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc0fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:49:20.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc0fcff9700 1 -- 172.21.15.81:0/2152380285 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11000aa90 con 0x56162fefcd00 2023-10-07T08:49:20.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc0fcff9700 1 -- 172.21.15.81:0/2152380285 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc11000abf0 con 0x56162fefcd00 2023-10-07T08:49:20.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc12dc71b80 1 -- 172.21.15.81:0/2152380285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56162fea7b70 con 0x56162fefcd00 2023-10-07T08:49:20.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc0fcff9700 1 -- 172.21.15.81:0/2152380285 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc110015440 con 0x56162fefcd00 2023-10-07T08:49:20.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc12dc71b80 10 client.7263 fetch_fsmap learned FSMap version 66 2023-10-07T08:49:20.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc12dc71b80 1 -- 172.21.15.81:0/2152380285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x56162fc3ffe0 con 0x56162fefcd00 2023-10-07T08:49:20.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc0fcff9700 1 -- 172.21.15.81:0/2152380285 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56162fea7b70 con 0x56162fefcd00 2023-10-07T08:49:20.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc0fcff9700 1 -- 172.21.15.81:0/2152380285 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 66) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc11000d440 con 0x56162fefcd00 2023-10-07T08:49:20.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.232+0000 7fc12dc71b80 10 client.7263 fetch_fsmap finished waiting for FSMap version 66 2023-10-07T08:49:20.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.233+0000 7fc12dc71b80 10 client.7263 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-07T08:49:20.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.233+0000 7fc12dc71b80 20 client.7263 populate_metadata read hostname 'smithi081' 2023-10-07T08:49:20.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.233+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/2152380285 >> [v2:172.21.15.81:6835/3151244734,v1:172.21.15.81:6837/3151244734] conn(0x56162ff0cc70 0x56162ff167b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.233+0000 7fc12dc71b80 4 client.7263 mds_command: new command op to 7122 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T08:49:20.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.233+0000 7fc12dc71b80 1 -- 172.21.15.81:0/2152380285 --> [v2:172.21.15.81:6835/3151244734,v1:172.21.15.81:6837/3151244734] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56162fe84aa0 con 0x56162ff0cc70 2023-10-07T08:49:20.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.233+0000 7fc11e59c700 1 --2- 172.21.15.81:0/2152380285 >> [v2:172.21.15.81:6835/3151244734,v1:172.21.15.81:6837/3151244734] conn(0x56162ff0cc70 0x56162ff167b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.233+0000 7fc0fcff9700 10 client.7263 ms_handle_connect on v2:172.21.15.81:6835/3151244734 2023-10-07T08:49:20.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.233+0000 7fc11e59c700 1 --2- 172.21.15.81:0/2152380285 >> [v2:172.21.15.81:6835/3151244734,v1:172.21.15.81:6837/3151244734] conn(0x56162ff0cc70 0x56162ff167b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a4fa26edb252452 server_cookie=22c624bdf2143e3e in_seq=0 out_seq=0 2023-10-07T08:49:20.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.234+0000 7fc0fcff9700 1 -- 172.21.15.81:0/2152380285 <== mds.0 v2:172.21.15.81:6835/3151244734 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56162fe84aa0 con 0x56162ff0cc70 2023-10-07T08:49:20.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.234+0000 7fc0fcff9700 10 client.7263 handle_command_reply: tid=0 2023-10-07T08:49:20.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.234+0000 7fc12dc71b80 1 client.7263 shutdown 2023-10-07T08:49:20.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.234+0000 7fc12dc71b80 1 -- 172.21.15.81:0/2152380285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162fefcd00 msgr2=0x56162ff0b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:20.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.234+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/2152380285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162fefcd00 0x56162ff0b960 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fc11000cae0 tx=0x7fc1100078a0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.234+0000 7fc12dc71b80 1 -- 172.21.15.81:0/2152380285 shutdown_connections 2023-10-07T08:49:20.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.234+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/2152380285 >> [v2:172.21.15.81:6835/3151244734,v1:172.21.15.81:6837/3151244734] conn(0x56162ff0cc70 0x56162ff167b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.234+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/2152380285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162fefcd00 0x56162ff0b960 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.234+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/2152380285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162feb2a50 0x56162feae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.234+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/2152380285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fedbf60 0x56162fef0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.234+0000 7fc0fcff9700 0 client.7263 ms_handle_reset on v2:172.21.15.81:6835/3151244734 2023-10-07T08:49:20.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.234+0000 7fc12dc71b80 1 -- 172.21.15.81:0/2152380285 >> 172.21.15.81:0/2152380285 conn(0x56162feb4370 msgr2=0x56162fef8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:20.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.234+0000 7fc12dc71b80 1 -- 172.21.15.81:0/2152380285 shutdown_connections 2023-10-07T08:49:20.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.234+0000 7fc12dc71b80 1 -- 172.21.15.81:0/2152380285 wait complete. 2023-10-07T08:49:20.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.234+0000 7fc12dc71b80 20 client.7263 trim_cache size 0 max 16384 2023-10-07T08:49:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.250+0000 7fc12dc71b80 1 Processor -- start 2023-10-07T08:49:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.251+0000 7fc12dc71b80 1 -- start start 2023-10-07T08:49:20.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.251+0000 7fc12dc71b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162feb2a50 0x56162ff0b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.251+0000 7fc12dc71b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162fedbf60 0x56162feb5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.251+0000 7fc12dc71b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fefcd00 0x56162feb60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.251+0000 7fc12dc71b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162fef4060 con 0x56162feb2a50 2023-10-07T08:49:20.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.251+0000 7fc12dc71b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162fef7610 con 0x56162fefcd00 2023-10-07T08:49:20.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.251+0000 7fc12dc71b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56162fef8e50 con 0x56162fedbf60 2023-10-07T08:49:20.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.251+0000 7fc11e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162feb2a50 0x56162ff0b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.251+0000 7fc11e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162feb2a50 0x56162ff0b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34290/0 (socket says 172.21.15.81:34290) 2023-10-07T08:49:20.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.251+0000 7fc11e59c700 1 -- 172.21.15.81:0/381412908 learned_addr learned my addr 172.21.15.81:0/381412908 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:20.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc11dd9b700 1 --2- 172.21.15.81:0/381412908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162fedbf60 0x56162feb5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc11e59c700 1 -- 172.21.15.81:0/381412908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162fedbf60 msgr2=0x56162feb5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:20.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc11ed9d700 1 --2- 172.21.15.81:0/381412908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fefcd00 0x56162feb60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc11e59c700 1 --2- 172.21.15.81:0/381412908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162fedbf60 0x56162feb5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc11e59c700 1 -- 172.21.15.81:0/381412908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fefcd00 msgr2=0x56162feb60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc11e59c700 1 --2- 172.21.15.81:0/381412908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fefcd00 0x56162feb60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc11e59c700 1 -- 172.21.15.81:0/381412908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56162fdd1780 con 0x56162feb2a50 2023-10-07T08:49:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc11e59c700 1 --2- 172.21.15.81:0/381412908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162feb2a50 0x56162ff0b4d0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fc11800b3c0 tx=0x7fc118032040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944b620ef0fa68fe server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc0fffff700 1 -- 172.21.15.81:0/381412908 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118035030 con 0x56162feb2a50 2023-10-07T08:49:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc0fffff700 1 -- 172.21.15.81:0/381412908 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc118036040 con 0x56162feb2a50 2023-10-07T08:49:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc0fffff700 1 -- 172.21.15.81:0/381412908 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118011420 con 0x56162feb2a50 2023-10-07T08:49:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc12dc71b80 1 -- 172.21.15.81:0/381412908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162feb2a50 msgr2=0x56162ff0b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/381412908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162feb2a50 0x56162ff0b4d0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fc11800b3c0 tx=0x7fc118032040 comp rx=0 tx=0).stop 2023-10-07T08:49:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc12dc71b80 1 -- 172.21.15.81:0/381412908 shutdown_connections 2023-10-07T08:49:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/381412908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fefcd00 0x56162feb60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/381412908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162feb2a50 0x56162ff0b4d0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/381412908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162fedbf60 0x56162feb5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc12dc71b80 1 -- 172.21.15.81:0/381412908 >> 172.21.15.81:0/381412908 conn(0x56162feb4370 msgr2=0x56162feab4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.252+0000 7fc12dc71b80 1 -- 172.21.15.81:0/381412908 shutdown_connections 2023-10-07T08:49:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.253+0000 7fc12dc71b80 1 -- 172.21.15.81:0/381412908 wait complete. 2023-10-07T08:49:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.253+0000 7fc12dc71b80 1 -- start start 2023-10-07T08:49:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.253+0000 7fc12dc71b80 1 Processor -- start 2023-10-07T08:49:20.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc12dc71b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162feb2a50 0x56162fef4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc12dc71b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fedbf60 0x56162ff5f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc12dc71b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162fefcd00 0x56162feb5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc12dc71b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162fedb290 con 0x56162fefcd00 2023-10-07T08:49:20.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc12dc71b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162ff60040 con 0x56162fedbf60 2023-10-07T08:49:20.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc12dc71b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56162fef43e0 con 0x56162feb2a50 2023-10-07T08:49:20.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc12dc71b80 10 client.0 _ll_register_callbacks cb 0x56162fe76110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:49:20.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc11ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162fefcd00 0x56162feb5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc11ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162fefcd00 0x56162feb5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34306/0 (socket says 172.21.15.81:34306) 2023-10-07T08:49:20.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc11ed9d700 1 -- 172.21.15.81:0/3613423303 learned_addr learned my addr 172.21.15.81:0/3613423303 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:20.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc11e59c700 1 --2- 172.21.15.81:0/3613423303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162feb2a50 0x56162fef4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc11dd9b700 1 --2- 172.21.15.81:0/3613423303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fedbf60 0x56162ff5f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc11ed9d700 1 -- 172.21.15.81:0/3613423303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162feb2a50 msgr2=0x56162fef4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:20.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc11ed9d700 1 --2- 172.21.15.81:0/3613423303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162feb2a50 0x56162fef4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc11ed9d700 1 -- 172.21.15.81:0/3613423303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fedbf60 msgr2=0x56162ff5f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:20.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc11ed9d700 1 --2- 172.21.15.81:0/3613423303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fedbf60 0x56162ff5f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc11ed9d700 1 -- 172.21.15.81:0/3613423303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56162fc9d270 con 0x56162fefcd00 2023-10-07T08:49:20.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc11ed9d700 1 --2- 172.21.15.81:0/3613423303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162fefcd00 0x56162feb5bb0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc1100032c0 tx=0x7fc110018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7ed94f0fdff665 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:20.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.254+0000 7fc0fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:49:20.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc0fcff9700 1 -- 172.21.15.81:0/3613423303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11000d440 con 0x56162fefcd00 2023-10-07T08:49:20.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc0fcff9700 1 -- 172.21.15.81:0/3613423303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc110007810 con 0x56162fefcd00 2023-10-07T08:49:20.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc12dc71b80 1 -- 172.21.15.81:0/3613423303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc118020070 con 0x56162fefcd00 2023-10-07T08:49:20.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc0fcff9700 1 -- 172.21.15.81:0/3613423303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc11000d5a0 con 0x56162fefcd00 2023-10-07T08:49:20.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc12dc71b80 10 client.7269 fetch_fsmap learned FSMap version 66 2023-10-07T08:49:20.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc12dc71b80 1 -- 172.21.15.81:0/3613423303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x56162fdb8470 con 0x56162fefcd00 2023-10-07T08:49:20.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc0fcff9700 1 -- 172.21.15.81:0/3613423303 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc118020070 con 0x56162fefcd00 2023-10-07T08:49:20.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc0fcff9700 1 -- 172.21.15.81:0/3613423303 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 66) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc110015440 con 0x56162fefcd00 2023-10-07T08:49:20.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc12dc71b80 10 client.7269 fetch_fsmap finished waiting for FSMap version 66 2023-10-07T08:49:20.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc12dc71b80 10 client.7269 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-07T08:49:20.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc12dc71b80 20 client.7269 populate_metadata read hostname 'smithi081' 2023-10-07T08:49:20.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/3613423303 >> [v2:172.21.15.81:6835/3151244734,v1:172.21.15.81:6837/3151244734] conn(0x56162ff0b4d0 0x56162feb60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc12dc71b80 4 client.7269 mds_command: new command op to 7122 tid=0[{"prefix": "status"}] 2023-10-07T08:49:20.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc12dc71b80 1 -- 172.21.15.81:0/3613423303 --> [v2:172.21.15.81:6835/3151244734,v1:172.21.15.81:6837/3151244734] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56162fda5e00 con 0x56162ff0b4d0 2023-10-07T08:49:20.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc11e59c700 1 --2- 172.21.15.81:0/3613423303 >> [v2:172.21.15.81:6835/3151244734,v1:172.21.15.81:6837/3151244734] conn(0x56162ff0b4d0 0x56162feb60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc0fcff9700 10 client.7269 ms_handle_connect on v2:172.21.15.81:6835/3151244734 2023-10-07T08:49:20.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.255+0000 7fc11e59c700 1 --2- 172.21.15.81:0/3613423303 >> [v2:172.21.15.81:6835/3151244734,v1:172.21.15.81:6837/3151244734] conn(0x56162ff0b4d0 0x56162feb60f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9511653f7dd9274e server_cookie=291925463f5845b0 in_seq=0 out_seq=0 2023-10-07T08:49:20.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc0fcff9700 1 -- 172.21.15.81:0/3613423303 <== mds.0 v2:172.21.15.81:6835/3151244734 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x56162fda5e00 con 0x56162ff0b4d0 2023-10-07T08:49:20.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc0fcff9700 10 client.7269 handle_command_reply: tid=0 2023-10-07T08:49:20.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc12dc71b80 1 client.7269 shutdown 2023-10-07T08:49:20.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc12dc71b80 1 -- 172.21.15.81:0/3613423303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162fefcd00 msgr2=0x56162feb5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:20.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/3613423303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162fefcd00 0x56162feb5bb0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc1100032c0 tx=0x7fc110018000 comp rx=0 tx=0).stop 2023-10-07T08:49:20.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc12dc71b80 1 -- 172.21.15.81:0/3613423303 shutdown_connections 2023-10-07T08:49:20.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/3613423303 >> [v2:172.21.15.81:6835/3151244734,v1:172.21.15.81:6837/3151244734] conn(0x56162ff0b4d0 0x56162feb60f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/3613423303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56162fefcd00 0x56162feb5bb0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc0fcff9700 0 client.7269 ms_handle_reset on v2:172.21.15.81:6835/3151244734 2023-10-07T08:49:20.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/3613423303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56162feb2a50 0x56162fef4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc12dc71b80 1 --2- 172.21.15.81:0/3613423303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56162fedbf60 0x56162ff5f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc12dc71b80 1 -- 172.21.15.81:0/3613423303 >> 172.21.15.81:0/3613423303 conn(0x56162feb4370 msgr2=0x56162feaeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:20.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc12dc71b80 1 -- 172.21.15.81:0/3613423303 shutdown_connections 2023-10-07T08:49:20.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc12dc71b80 1 -- 172.21.15.81:0/3613423303 wait complete. 2023-10-07T08:49:20.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc12dc71b80 20 client.7269 trim_cache size 0 max 16384 2023-10-07T08:49:20.265 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:49:20.265 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:49:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-07T08:49:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7122, 2023-10-07T08:49:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-07T08:49:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-07T08:49:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-07T08:49:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.783731102, 2023-10-07T08:49:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 66, 2023-10-07T08:49:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 138, 2023-10-07T08:49:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 138, 2023-10-07T08:49:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 10.916273892 2023-10-07T08:49:20.267 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:49:20.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc124979700 1 -- 172.21.15.81:0/2630283164 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc100066f60 msgr2=0x7fc100069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:20.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc124979700 1 --2- 172.21.15.81:0/2630283164 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc100066f60 0x7fc100069410 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc120068300 tx=0x7fc118016000 comp rx=0 tx=0).stop 2023-10-07T08:49:20.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc124979700 1 -- 172.21.15.81:0/2630283164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1201578d0 msgr2=0x7fc1201580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:20.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.256+0000 7fc124979700 1 --2- 172.21.15.81:0/2630283164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1201578d0 0x7fc1201580f0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fc10800b5e0 tx=0x7fc1080090f0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.257+0000 7fc124979700 1 -- 172.21.15.81:0/2630283164 shutdown_connections 2023-10-07T08:49:20.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.257+0000 7fc124979700 1 --2- 172.21.15.81:0/2630283164 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc100066f60 0x7fc100069410 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.257+0000 7fc124979700 1 --2- 172.21.15.81:0/2630283164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc120157ca0 0x7fc1200cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.257+0000 7fc124979700 1 --2- 172.21.15.81:0/2630283164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc12006d120 0x7fc1200c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.257+0000 7fc124979700 1 --2- 172.21.15.81:0/2630283164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1201578d0 0x7fc1201580f0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.257+0000 7fc124979700 1 -- 172.21.15.81:0/2630283164 >> 172.21.15.81:0/2630283164 conn(0x7fc12006bb90 msgr2=0x7fc120156720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:20.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.257+0000 7fc124979700 1 -- 172.21.15.81:0/2630283164 shutdown_connections 2023-10-07T08:49:20.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.257+0000 7fc124979700 1 -- 172.21.15.81:0/2630283164 wait complete. 2023-10-07T08:49:20.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:49:20.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.382+0000 7f2a410dc700 1 Processor -- start 2023-10-07T08:49:20.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.382+0000 7f2a410dc700 1 -- start start 2023-10-07T08:49:20.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.383+0000 7f2a410dc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a3c0b3bd0 0x7f2a3c0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.383+0000 7f2a410dc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2a3c1583b0 0x7f2a3c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.383+0000 7f2a410dc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3c0b2890 con 0x7f2a3c157fe0 2023-10-07T08:49:20.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.383+0000 7f2a410dc700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3c0b4070 con 0x7f2a3c1583b0 2023-10-07T08:49:20.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.383+0000 7f2a410dc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0b4350 con 0x7f2a3c0b3bd0 2023-10-07T08:49:20.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.383+0000 7f2a3ad9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2a3c157fe0 0x7f2a3c0b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34984/0 (socket says 172.21.15.81:34984) 2023-10-07T08:49:20.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.383+0000 7f2a3ad9d700 1 -- 172.21.15.81:0/2542449981 learned_addr learned my addr 172.21.15.81:0/2542449981 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:20.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.383+0000 7f2a3b59e700 1 --2- 172.21.15.81:0/2542449981 >> v2:172.21.15.89:3300/0 conn(0x7f2a3c1583b0 0x7f2a3c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.383+0000 7f2a3a59c700 1 --2- 172.21.15.81:0/2542449981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a3c0b3bd0 0x7f2a3c0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.384+0000 7f2a39d9b700 1 -- 172.21.15.81:0/2542449981 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496209771 0 0) 0x7f2a3c0b2890 con 0x7f2a3c157fe0 2023-10-07T08:49:20.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.384+0000 7f2a39d9b700 1 -- 172.21.15.81:0/2542449981 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a24003570 con 0x7f2a3c157fe0 2023-10-07T08:49:20.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.384+0000 7f2a3b59e700 1 -- 172.21.15.81:0/2542449981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a3c0b3bd0 msgr2=0x7f2a3c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:20.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.384+0000 7f2a3b59e700 1 --2- 172.21.15.81:0/2542449981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a3c0b3bd0 0x7f2a3c0ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.384+0000 7f2a3b59e700 1 -- 172.21.15.81:0/2542449981 >> v1:172.21.15.81:6789/0 conn(0x7f2a3c157fe0 legacy=0x7f2a3c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:20.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.384+0000 7f2a39d9b700 1 -- 172.21.15.81:0/2542449981 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2125308096 0 0) 0x7f2a24003570 con 0x7f2a3c157fe0 2023-10-07T08:49:20.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.384+0000 7f2a3b59e700 1 -- 172.21.15.81:0/2542449981 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c0b4630 con 0x7f2a3c1583b0 2023-10-07T08:49:20.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.384+0000 7f2a3b59e700 1 --2- 172.21.15.81:0/2542449981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c1583b0 0x7f2a3c0cf070 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2a340098e0 tx=0x7f2a340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de66c9e6630ac4bf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:20.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.384+0000 7f2a39d9b700 1 -- 172.21.15.81:0/2542449981 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0017f0 con 0x7f2a3c1583b0 2023-10-07T08:49:20.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.384+0000 7f2a39d9b700 1 -- 172.21.15.81:0/2542449981 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a34011420 con 0x7f2a3c1583b0 2023-10-07T08:49:20.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.384+0000 7f2a39d9b700 1 -- 172.21.15.81:0/2542449981 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a340117c0 con 0x7f2a3c1583b0 2023-10-07T08:49:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.385+0000 7f2a410dc700 1 -- 172.21.15.81:0/2542449981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c1583b0 msgr2=0x7f2a3c0cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.385+0000 7f2a410dc700 1 --2- 172.21.15.81:0/2542449981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c1583b0 0x7f2a3c0cf070 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2a340098e0 tx=0x7f2a340091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.385+0000 7f2a410dc700 1 -- 172.21.15.81:0/2542449981 shutdown_connections 2023-10-07T08:49:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.385+0000 7f2a410dc700 1 --2- 172.21.15.81:0/2542449981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c1583b0 0x7f2a3c0cf070 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.385+0000 7f2a410dc700 1 --2- 172.21.15.81:0/2542449981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a3c0b3bd0 0x7f2a3c0ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.385+0000 7f2a410dc700 1 -- 172.21.15.81:0/2542449981 >> 172.21.15.81:0/2542449981 conn(0x7f2a3c067640 msgr2=0x7f2a3c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.385+0000 7f2a410dc700 1 -- 172.21.15.81:0/2542449981 shutdown_connections 2023-10-07T08:49:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.385+0000 7f2a410dc700 1 -- 172.21.15.81:0/2542449981 wait complete. 2023-10-07T08:49:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.386+0000 7f2a410dc700 1 Processor -- start 2023-10-07T08:49:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.386+0000 7f2a410dc700 1 -- start start 2023-10-07T08:49:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a410dc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a3c0b3bd0 0x7f2a3c14eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a410dc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a3c157fe0 0x7f2a3c0b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a410dc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c1583b0 0x7f2a3c16ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a410dc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c168f60 con 0x7f2a3c0b3bd0 2023-10-07T08:49:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a410dc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c168630 con 0x7f2a3c1583b0 2023-10-07T08:49:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a410dc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c168910 con 0x7f2a3c157fe0 2023-10-07T08:49:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a3ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a3c0b3bd0 0x7f2a3c14eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a3ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a3c0b3bd0 0x7f2a3c14eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34320/0 (socket says 172.21.15.81:34320) 2023-10-07T08:49:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a3ad9d700 1 -- 172.21.15.81:0/3177817527 learned_addr learned my addr 172.21.15.81:0/3177817527 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a3b59e700 1 --2- 172.21.15.81:0/3177817527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c1583b0 0x7f2a3c16ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a3a59c700 1 --2- 172.21.15.81:0/3177817527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a3c157fe0 0x7f2a3c0b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a3ad9d700 1 -- 172.21.15.81:0/3177817527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a3c157fe0 msgr2=0x7f2a3c0b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a3ad9d700 1 --2- 172.21.15.81:0/3177817527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a3c157fe0 0x7f2a3c0b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a3ad9d700 1 -- 172.21.15.81:0/3177817527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c1583b0 msgr2=0x7f2a3c16ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a3ad9d700 1 --2- 172.21.15.81:0/3177817527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c1583b0 0x7f2a3c16ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a3ad9d700 1 -- 172.21.15.81:0/3177817527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a34009420 con 0x7f2a3c0b3bd0 2023-10-07T08:49:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a3ad9d700 1 --2- 172.21.15.81:0/3177817527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a3c0b3bd0 0x7f2a3c14eb80 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c00ccd0 tx=0x7f2a2c0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a22ffd700 1 -- 172.21.15.81:0/3177817527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c004dc0 con 0x7f2a3c0b3bd0 2023-10-07T08:49:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a22ffd700 1 -- 172.21.15.81:0/3177817527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c00a920 con 0x7f2a3c0b3bd0 2023-10-07T08:49:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a410dc700 1 -- 172.21.15.81:0/3177817527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3c168bf0 con 0x7f2a3c0b3bd0 2023-10-07T08:49:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a22ffd700 1 -- 172.21.15.81:0/3177817527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00ace0 con 0x7f2a3c0b3bd0 2023-10-07T08:49:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.387+0000 7f2a410dc700 1 -- 172.21.15.81:0/3177817527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c14f0c0 con 0x7f2a3c0b3bd0 2023-10-07T08:49:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.388+0000 7f2a410dc700 1 -- 172.21.15.81:0/3177817527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3c069e40 con 0x7f2a3c0b3bd0 2023-10-07T08:49:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.389+0000 7f2a22ffd700 1 -- 172.21.15.81:0/3177817527 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a2c007360 con 0x7f2a3c0b3bd0 2023-10-07T08:49:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.389+0000 7f2a22ffd700 1 --2- 172.21.15.81:0/3177817527 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2a28066f30 0x7f2a280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.389+0000 7f2a22ffd700 1 -- 172.21.15.81:0/3177817527 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2a2c084180 con 0x7f2a3c0b3bd0 2023-10-07T08:49:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.389+0000 7f2a3a59c700 1 --2- 172.21.15.81:0/3177817527 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2a28066f30 0x7f2a280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.390+0000 7f2a3a59c700 1 --2- 172.21.15.81:0/3177817527 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2a28066f30 0x7f2a280693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c15b700 tx=0x7f2a30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:20.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.393+0000 7f2a22ffd700 1 -- 172.21.15.81:0/3177817527 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a2c051470 con 0x7f2a3c0b3bd0 2023-10-07T08:49:20.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.620+0000 7f2a410dc700 1 -- 172.21.15.81:0/3177817527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2a3c071b10 con 0x7f2a3c0b3bd0 2023-10-07T08:49:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.621+0000 7f2a22ffd700 1 -- 172.21.15.81:0/3177817527 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2a2c018070 con 0x7f2a3c0b3bd0 2023-10-07T08:49:20.622 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:49:20.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.622+0000 7f2a410dc700 1 -- 172.21.15.81:0/3177817527 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2a28066f30 msgr2=0x7f2a280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:20.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.622+0000 7f2a410dc700 1 --2- 172.21.15.81:0/3177817527 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2a28066f30 0x7f2a280693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c15b700 tx=0x7f2a30008040 comp rx=0 tx=0).stop 2023-10-07T08:49:20.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.622+0000 7f2a410dc700 1 -- 172.21.15.81:0/3177817527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a3c0b3bd0 msgr2=0x7f2a3c14eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:20.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.622+0000 7f2a410dc700 1 --2- 172.21.15.81:0/3177817527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a3c0b3bd0 0x7f2a3c14eb80 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c00ccd0 tx=0x7f2a2c0016f0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.622+0000 7f2a410dc700 1 -- 172.21.15.81:0/3177817527 shutdown_connections 2023-10-07T08:49:20.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.622+0000 7f2a410dc700 1 --2- 172.21.15.81:0/3177817527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c1583b0 0x7f2a3c16ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.622+0000 7f2a410dc700 1 --2- 172.21.15.81:0/3177817527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a3c0b3bd0 0x7f2a3c14eb80 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.622+0000 7f2a410dc700 1 --2- 172.21.15.81:0/3177817527 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2a28066f30 0x7f2a280693e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.622+0000 7f2a410dc700 1 --2- 172.21.15.81:0/3177817527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a3c157fe0 0x7f2a3c0b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.622+0000 7f2a410dc700 1 -- 172.21.15.81:0/3177817527 >> 172.21.15.81:0/3177817527 conn(0x7f2a3c067640 msgr2=0x7f2a3c0cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.622+0000 7f2a410dc700 1 -- 172.21.15.81:0/3177817527 shutdown_connections 2023-10-07T08:49:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:20.622+0000 7f2a410dc700 1 -- 172.21.15.81:0/3177817527 wait complete. 2023-10-07T08:49:20.636 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:49:20.636 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:49:20.636 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-07T08:49:20.636 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T08:49:20.636 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T08:49:20.636 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:49:20.636 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:49:20.636 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:49:20.636 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:49:20.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:49:20.637 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-07T08:49:20.652 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:49:20.652 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:49:20.652 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:49:20.652 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:49:20.652 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-07T08:49:20.653 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:49:20.653 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:49:20.653 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:49:20.653 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-07T08:49:20.653 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:49:20.653 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:49:20.653 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-07T08:49:20.653 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:49:20.654 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:49:20.654 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:49:20.654 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:49:20.654 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:49:20.654 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42168sec preferred_lft 42168sec 2023-10-07T08:49:20.654 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-10-07T08:49:20.654 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:49:20.654 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:49:20.654 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff 2023-10-07T08:49:20.654 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:49:20.655 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:49:20.655 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::8c72:9ff:fe74:8c7e/64 scope link 2023-10-07T08:49:20.655 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:49:20.655 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:49:20.655 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:fe:81:9d:9c:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T08:49:20.655 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8fe:81ff:fe9d:9c0a/64 scope link 2023-10-07T08:49:20.655 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:49:20.655 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:49:20.655 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T08:49:20.655 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d838:b7ff:fe6e:914d/64 scope link 2023-10-07T08:49:20.655 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:49:20.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:49:20.656 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:49:20.715 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-07T08:49:20.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:49:20.716 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-07T08:49:20.773 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-07T08:49:20.773 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:49:20.773 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:49:20.774 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:49:20.774 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:49:20.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:49:20.774 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:49:20.774 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:49:20.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:49:20.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:49:20.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:49:20.775 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:49:20.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:49:20.873 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-07T08:49:20.887 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T08:49:20.887 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T08:49:20.888 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:49:20.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:49:20.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-07T08:49:20.952 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:49:20.953 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T08:49:21.008 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:49:21.008 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:49:21.008 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:49:21.062 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:49:21.062 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:49:21.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:49:21.141 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:49:21.142 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:49:21.142 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:49:21.150 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:49:21.150 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:49:21.150 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:49:21.150 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:49:21.150 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:49:21.171 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:49:21.171 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:49:21.171 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:49:21.172 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:49:21.172 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:49:21.172 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:49:21.172 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:49:21.172 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:49:21.173 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:49:21.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:49:21.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:49:21.239 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:49:21.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.393+0000 7f3d8ed0e700 1 Processor -- start 2023-10-07T08:49:21.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.393+0000 7f3d8ed0e700 1 -- start start 2023-10-07T08:49:21.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.394+0000 7f3d8ed0e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d880ce1f0 0x7f3d880aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:21.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.394+0000 7f3d8ed0e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d880ce5c0 0x7f3d8815e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:21.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.394+0000 7f3d8ed0e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8815dfb0 con 0x7f3d880ac570 2023-10-07T08:49:21.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.394+0000 7f3d8ed0e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d880acec0 con 0x7f3d880ce1f0 2023-10-07T08:49:21.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.394+0000 7f3d8ed0e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880ad1a0 con 0x7f3d880ce5c0 2023-10-07T08:49:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.394+0000 7f3d8caaa700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d880ce1f0 0x7f3d880aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.394+0000 7f3d8d2ab700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3d880ac570 0x7f3d8806e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34986/0 (socket says 172.21.15.81:34986) 2023-10-07T08:49:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.394+0000 7f3d8d2ab700 1 -- 172.21.15.81:0/3593639046 learned_addr learned my addr 172.21.15.81:0/3593639046 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.394+0000 7f3d7ffff700 1 --2- 172.21.15.81:0/3593639046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d880ce5c0 0x7f3d8815e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.395+0000 7f3d8caaa700 1 -- 172.21.15.81:0/3593639046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d880ce5c0 msgr2=0x7f3d8815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.395+0000 7f3d8caaa700 1 --2- 172.21.15.81:0/3593639046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d880ce5c0 0x7f3d8815e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.395+0000 7f3d8caaa700 1 -- 172.21.15.81:0/3593639046 >> v1:172.21.15.81:6789/0 conn(0x7f3d880ac570 legacy=0x7f3d8806e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.395+0000 7f3d8caaa700 1 -- 172.21.15.81:0/3593639046 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8815dc40 con 0x7f3d880ce1f0 2023-10-07T08:49:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.395+0000 7f3d8caaa700 1 --2- 172.21.15.81:0/3593639046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d880ce1f0 0x7f3d880aacf0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009e60 tx=0x7f3d84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990cfeaae41586f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:21.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.395+0000 7f3d7f7fe700 1 -- 172.21.15.81:0/3593639046 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400e070 con 0x7f3d880ce1f0 2023-10-07T08:49:21.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.395+0000 7f3d7f7fe700 1 -- 172.21.15.81:0/3593639046 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8400bb60 con 0x7f3d880ce1f0 2023-10-07T08:49:21.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.395+0000 7f3d7f7fe700 1 -- 172.21.15.81:0/3593639046 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84012430 con 0x7f3d880ce1f0 2023-10-07T08:49:21.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.395+0000 7f3d8ed0e700 1 -- 172.21.15.81:0/3593639046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d880ce1f0 msgr2=0x7f3d880aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:21.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.395+0000 7f3d8ed0e700 1 --2- 172.21.15.81:0/3593639046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d880ce1f0 0x7f3d880aacf0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009e60 tx=0x7f3d84009780 comp rx=0 tx=0).stop 2023-10-07T08:49:21.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.395+0000 7f3d8ed0e700 1 -- 172.21.15.81:0/3593639046 shutdown_connections 2023-10-07T08:49:21.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.395+0000 7f3d8ed0e700 1 --2- 172.21.15.81:0/3593639046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d880ce1f0 0x7f3d880aacf0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:21.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.395+0000 7f3d8ed0e700 1 --2- 172.21.15.81:0/3593639046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d880ce5c0 0x7f3d8815e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:21.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.395+0000 7f3d8ed0e700 1 -- 172.21.15.81:0/3593639046 >> 172.21.15.81:0/3593639046 conn(0x7f3d8806cca0 msgr2=0x7f3d8806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:21.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.395+0000 7f3d8ed0e700 1 -- 172.21.15.81:0/3593639046 shutdown_connections 2023-10-07T08:49:21.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.396+0000 7f3d8ed0e700 1 -- 172.21.15.81:0/3593639046 wait complete. 2023-10-07T08:49:21.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.397+0000 7f3d8ed0e700 1 Processor -- start 2023-10-07T08:49:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.397+0000 7f3d8ed0e700 1 -- start start 2023-10-07T08:49:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.397+0000 7f3d8ed0e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d880ac570 0x7f3d8816be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.397+0000 7f3d8ed0e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d880ce1f0 0x7f3d8815b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.397+0000 7f3d8ed0e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d880ce5c0 0x7f3d8815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.397+0000 7f3d8ed0e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8815bbf0 con 0x7f3d880ce5c0 2023-10-07T08:49:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.397+0000 7f3d8ed0e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880aef40 con 0x7f3d880ce1f0 2023-10-07T08:49:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.397+0000 7f3d8ed0e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880ae610 con 0x7f3d880ac570 2023-10-07T08:49:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.398+0000 7f3d8d2ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d880ce5c0 0x7f3d8815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.398+0000 7f3d8d2ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d880ce5c0 0x7f3d8815c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34334/0 (socket says 172.21.15.81:34334) 2023-10-07T08:49:21.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.398+0000 7f3d8d2ab700 1 -- 172.21.15.81:0/296820835 learned_addr learned my addr 172.21.15.81:0/296820835 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:21.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.398+0000 7f3d7ffff700 1 --2- 172.21.15.81:0/296820835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d880ce1f0 0x7f3d8815b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:21.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.398+0000 7f3d8caaa700 1 --2- 172.21.15.81:0/296820835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d880ac570 0x7f3d8816be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:21.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.398+0000 7f3d8d2ab700 1 -- 172.21.15.81:0/296820835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d880ac570 msgr2=0x7f3d8816be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:21.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.398+0000 7f3d8d2ab700 1 --2- 172.21.15.81:0/296820835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d880ac570 0x7f3d8816be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:21.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.398+0000 7f3d8d2ab700 1 -- 172.21.15.81:0/296820835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d880ce1f0 msgr2=0x7f3d8815b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:21.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.398+0000 7f3d8d2ab700 1 --2- 172.21.15.81:0/296820835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d880ce1f0 0x7f3d8815b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:21.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.398+0000 7f3d8d2ab700 1 -- 172.21.15.81:0/296820835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d84009a20 con 0x7f3d880ce5c0 2023-10-07T08:49:21.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.398+0000 7f3d8d2ab700 1 --2- 172.21.15.81:0/296820835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d880ce5c0 0x7f3d8815c5b0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000c560 tx=0x7f3d80007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.398+0000 7f3d7cff9700 1 -- 172.21.15.81:0/296820835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80005b30 con 0x7f3d880ce5c0 2023-10-07T08:49:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.398+0000 7f3d7cff9700 1 -- 172.21.15.81:0/296820835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d80005c90 con 0x7f3d880ce5c0 2023-10-07T08:49:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.398+0000 7f3d7cff9700 1 -- 172.21.15.81:0/296820835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d800072e0 con 0x7f3d880ce5c0 2023-10-07T08:49:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.398+0000 7f3d8ed0e700 1 -- 172.21.15.81:0/296820835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d880ae8f0 con 0x7f3d880ce5c0 2023-10-07T08:49:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.398+0000 7f3d8ed0e700 1 -- 172.21.15.81:0/296820835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8816c340 con 0x7f3d880ce5c0 2023-10-07T08:49:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.399+0000 7f3d8ed0e700 1 -- 172.21.15.81:0/296820835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d880af0f0 con 0x7f3d880ce5c0 2023-10-07T08:49:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.399+0000 7f3d7cff9700 1 -- 172.21.15.81:0/296820835 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d80007690 con 0x7f3d880ce5c0 2023-10-07T08:49:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.400+0000 7f3d7cff9700 1 --2- 172.21.15.81:0/296820835 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3d74066f30 0x7f3d740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.400+0000 7f3d7cff9700 1 -- 172.21.15.81:0/296820835 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d800837e0 con 0x7f3d880ce5c0 2023-10-07T08:49:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.400+0000 7f3d8caaa700 1 --2- 172.21.15.81:0/296820835 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3d74066f30 0x7f3d740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.400+0000 7f3d8caaa700 1 --2- 172.21.15.81:0/296820835 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3d74066f30 0x7f3d740693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3d840097c0 tx=0x7f3d84019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:21.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.404+0000 7f3d7cff9700 1 -- 172.21.15.81:0/296820835 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d8004b5a0 con 0x7f3d880ce5c0 2023-10-07T08:49:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.630+0000 7f3d8ed0e700 1 -- 172.21.15.81:0/296820835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3d8815e980 con 0x7f3d880ce5c0 2023-10-07T08:49:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.631+0000 7f3d7cff9700 1 -- 172.21.15.81:0/296820835 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3d80017020 con 0x7f3d880ce5c0 2023-10-07T08:49:21.632 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:49:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.633+0000 7f3d8ed0e700 1 -- 172.21.15.81:0/296820835 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3d74066f30 msgr2=0x7f3d740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.633+0000 7f3d8ed0e700 1 --2- 172.21.15.81:0/296820835 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3d74066f30 0x7f3d740693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3d840097c0 tx=0x7f3d84019000 comp rx=0 tx=0).stop 2023-10-07T08:49:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.633+0000 7f3d8ed0e700 1 -- 172.21.15.81:0/296820835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d880ce5c0 msgr2=0x7f3d8815c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:21.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.633+0000 7f3d8ed0e700 1 --2- 172.21.15.81:0/296820835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d880ce5c0 0x7f3d8815c5b0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000c560 tx=0x7f3d80007f60 comp rx=0 tx=0).stop 2023-10-07T08:49:21.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.633+0000 7f3d8ed0e700 1 -- 172.21.15.81:0/296820835 shutdown_connections 2023-10-07T08:49:21.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.633+0000 7f3d8ed0e700 1 --2- 172.21.15.81:0/296820835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d880ce5c0 0x7f3d8815c5b0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:21.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.633+0000 7f3d8ed0e700 1 --2- 172.21.15.81:0/296820835 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3d74066f30 0x7f3d740693e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:21.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.633+0000 7f3d8ed0e700 1 --2- 172.21.15.81:0/296820835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d880ac570 0x7f3d8816be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:21.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.633+0000 7f3d8ed0e700 1 --2- 172.21.15.81:0/296820835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d880ce1f0 0x7f3d8815b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:21.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.633+0000 7f3d8ed0e700 1 -- 172.21.15.81:0/296820835 >> 172.21.15.81:0/296820835 conn(0x7f3d8806cca0 msgr2=0x7f3d8806e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:21.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.633+0000 7f3d8ed0e700 1 -- 172.21.15.81:0/296820835 shutdown_connections 2023-10-07T08:49:21.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:21.633+0000 7f3d8ed0e700 1 -- 172.21.15.81:0/296820835 wait complete. 2023-10-07T08:49:21.646 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:49:21.646 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:49:21.646 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-07T08:49:21.646 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T08:49:21.646 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T08:49:21.646 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:49:21.646 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:49:21.646 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:49:21.646 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:49:21.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:49:21.647 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-07T08:49:21.664 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:49:21.665 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:49:21.665 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:49:21.665 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:49:21.665 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-07T08:49:21.665 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:49:21.665 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:49:21.665 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:49:21.665 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-10-07T08:49:21.665 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:49:21.665 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:49:21.665 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-10-07T08:49:21.665 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:49:21.666 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:49:21.666 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:49:21.666 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:49:21.666 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:49:21.666 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42167sec preferred_lft 42167sec 2023-10-07T08:49:21.666 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2023-10-07T08:49:21.666 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:49:21.666 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:49:21.666 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:49:21.666 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:49:21.666 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:49:21.667 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::74d7:a9ff:fe87:ed9/64 scope link 2023-10-07T08:49:21.667 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:49:21.667 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:49:21.667 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T08:49:21.667 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6c40:c5ff:fe3a:a57/64 scope link 2023-10-07T08:49:21.667 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:49:21.667 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:49:21.667 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether de:db:cd:68:b1:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T08:49:21.668 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::dcdb:cdff:fe68:b178/64 scope link 2023-10-07T08:49:21.668 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:49:21.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:49:21.668 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:49:21.730 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-07T08:49:21.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:49:21.732 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-07T08:49:21.790 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-07T08:49:21.790 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:49:21.790 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:49:21.791 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:49:21.791 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:49:21.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:49:21.791 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:49:21.791 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:49:21.791 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:49:21.791 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:49:21.791 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:49:21.792 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:49:21.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:49:21.896 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-07T08:49:21.910 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T08:49:21.911 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T08:49:21.911 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:49:21.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:49:21.911 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-07T08:49:21.975 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:49:21.976 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T08:49:22.030 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:49:22.030 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:49:22.030 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:49:22.084 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:49:22.085 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:49:22.085 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:49:22.166 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:49:22.166 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:49:22.166 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:49:22.172 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:49:22.173 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:49:22.173 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:49:22.173 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:49:22.173 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:49:22.194 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:49:22.194 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:49:22.194 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:49:22.194 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:49:22.194 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:49:22.194 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:49:22.194 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:49:22.195 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:49:22.196 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:49:22.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:49:22.196 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:49:22.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:49:22.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.378+0000 7fddb14a1700 1 Processor -- start 2023-10-07T08:49:22.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.378+0000 7fddb14a1700 1 -- start start 2023-10-07T08:49:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.379+0000 7fddb14a1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fddac0ce1f0 0x7fddac0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.379+0000 7fddb14a1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddac15dfb0 con 0x7fddac0ce5c0 2023-10-07T08:49:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.379+0000 7fddb14a1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddac0acec0 con 0x7fddac0ac570 2023-10-07T08:49:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.379+0000 7fddb14a1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddac0ad1a0 con 0x7fddac0ce1f0 2023-10-07T08:49:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.379+0000 7fdda27fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fddac0ce5c0 0x7fddac15e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47048/0 (socket says 172.21.15.81:47048) 2023-10-07T08:49:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.379+0000 7fdda27fc700 1 -- 172.21.15.81:0/1969510091 learned_addr learned my addr 172.21.15.81:0/1969510091 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaaffd700 1 --2- 172.21.15.81:0/1969510091 >> v2:172.21.15.89:3300/0 conn(0x7fddac0ce1f0 0x7fddac0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 -- 172.21.15.81:0/1969510091 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036758036 0 0) 0x7fddac15dfb0 con 0x7fddac0ce5c0 2023-10-07T08:49:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 -- 172.21.15.81:0/1969510091 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd98003570 con 0x7fddac0ce5c0 2023-10-07T08:49:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 -- 172.21.15.81:0/1969510091 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041827859 0 0) 0x7fddac0acec0 con 0x7fddac0ac570 2023-10-07T08:49:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 -- 172.21.15.81:0/1969510091 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddac15dfb0 con 0x7fddac0ac570 2023-10-07T08:49:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 -- 172.21.15.81:0/1969510091 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2306493600 0 0) 0x7fdd98003570 con 0x7fddac0ce5c0 2023-10-07T08:49:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 -- 172.21.15.81:0/1969510091 >> v2:172.21.15.89:3300/0 conn(0x7fddac0ce1f0 msgr2=0x7fddac0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 --2- 172.21.15.81:0/1969510091 >> v2:172.21.15.89:3300/0 conn(0x7fddac0ce1f0 0x7fddac0aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 -- 172.21.15.81:0/1969510091 >> v1:172.21.15.89:6789/0 conn(0x7fddac0ac570 legacy=0x7fddac06e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 -- 172.21.15.81:0/1969510091 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac15dc40 con 0x7fddac0ce5c0 2023-10-07T08:49:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 -- 172.21.15.81:0/1969510091 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fdd94001470 con 0x7fddac0ce5c0 2023-10-07T08:49:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 -- 172.21.15.81:0/1969510091 >> v1:172.21.15.81:6789/0 conn(0x7fddac0ce5c0 legacy=0x7fddac15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 --2- 172.21.15.81:0/1969510091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd98003bf0 0x7fdd98003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 --2- 172.21.15.81:0/1969510091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd98004810 0x7fdd98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 --2- 172.21.15.81:0/1969510091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd980051c0 0x7fdd9800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 -- 172.21.15.81:0/1969510091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac0ad1a0 con 0x7fdd98003bf0 2023-10-07T08:49:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 -- 172.21.15.81:0/1969510091 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9800c0b0 con 0x7fdd980051c0 2023-10-07T08:49:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaa7fc700 1 -- 172.21.15.81:0/1969510091 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9800c270 con 0x7fdd98004810 2023-10-07T08:49:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaaffd700 1 --2- 172.21.15.81:0/1969510091 >> v2:172.21.15.89:3300/0 conn(0x7fddac0ce1f0 0x7fddac0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:49:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fdda27fc700 1 --2- 172.21.15.81:0/1969510091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd98004810 0x7fdd98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaaffd700 1 --2- 172.21.15.81:0/1969510091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd98003bf0 0x7fdd98003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddab7fe700 1 --2- 172.21.15.81:0/1969510091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd980051c0 0x7fdd9800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaaffd700 1 -- 172.21.15.81:0/1969510091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd98004810 msgr2=0x7fdd98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaaffd700 1 --2- 172.21.15.81:0/1969510091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd98004810 0x7fdd98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaaffd700 1 -- 172.21.15.81:0/1969510091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd980051c0 msgr2=0x7fdd9800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaaffd700 1 --2- 172.21.15.81:0/1969510091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd980051c0 0x7fdd9800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddaaffd700 1 -- 172.21.15.81:0/1969510091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd98003570 con 0x7fdd98003bf0 2023-10-07T08:49:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.380+0000 7fddab7fe700 1 -- 172.21.15.81:0/1969510091 reap_dead start 2023-10-07T08:49:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.381+0000 7fddaaffd700 1 --2- 172.21.15.81:0/1969510091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd98003bf0 0x7fdd98003fe0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009db0 tx=0x7fdd9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b9db9f2f1f3237 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.381+0000 7fddaa7fc700 1 -- 172.21.15.81:0/1969510091 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c009740 con 0x7fdd98003bf0 2023-10-07T08:49:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.381+0000 7fddaa7fc700 1 -- 172.21.15.81:0/1969510091 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c00e920 con 0x7fdd98003bf0 2023-10-07T08:49:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.381+0000 7fddaa7fc700 1 -- 172.21.15.81:0/1969510091 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c00eca0 con 0x7fdd98003bf0 2023-10-07T08:49:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.381+0000 7fddb14a1700 1 -- 172.21.15.81:0/1969510091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd98003bf0 msgr2=0x7fdd98003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.381+0000 7fddb14a1700 1 --2- 172.21.15.81:0/1969510091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd98003bf0 0x7fdd98003fe0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009db0 tx=0x7fdd9c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.381+0000 7fddb14a1700 1 -- 172.21.15.81:0/1969510091 shutdown_connections 2023-10-07T08:49:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.381+0000 7fddb14a1700 1 --2- 172.21.15.81:0/1969510091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd98003bf0 0x7fdd98003fe0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.381+0000 7fddb14a1700 1 -- 172.21.15.81:0/1969510091 >> 172.21.15.81:0/1969510091 conn(0x7fddac06cca0 msgr2=0x7fddac06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.381+0000 7fddb14a1700 1 -- 172.21.15.81:0/1969510091 shutdown_connections 2023-10-07T08:49:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.381+0000 7fddb14a1700 1 -- 172.21.15.81:0/1969510091 wait complete. 2023-10-07T08:49:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.382+0000 7fddb14a1700 1 Processor -- start 2023-10-07T08:49:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.382+0000 7fddb14a1700 1 -- start start 2023-10-07T08:49:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.383+0000 7fddb14a1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd98003bf0 0x7fddac147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.383+0000 7fddb14a1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddac069d70 0x7fddac06a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.383+0000 7fddb14a1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddac0aed30 0x7fddac0af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.383+0000 7fddb14a1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac0c28a0 con 0x7fddac0aed30 2023-10-07T08:49:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.383+0000 7fddb14a1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac0c2e60 con 0x7fddac069d70 2023-10-07T08:49:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.383+0000 7fddb14a1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddac06a720 con 0x7fdd98003bf0 2023-10-07T08:49:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.383+0000 7fddab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddac0aed30 0x7fddac0af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.383+0000 7fddab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddac0aed30 0x7fddac0af1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56188/0 (socket says 172.21.15.81:56188) 2023-10-07T08:49:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.383+0000 7fddab7fe700 1 -- 172.21.15.81:0/1164675697 learned_addr learned my addr 172.21.15.81:0/1164675697 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.383+0000 7fddaaffd700 1 --2- 172.21.15.81:0/1164675697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd98003bf0 0x7fddac147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.383+0000 7fdda27fc700 1 --2- 172.21.15.81:0/1164675697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddac069d70 0x7fddac06a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.384+0000 7fddab7fe700 1 -- 172.21.15.81:0/1164675697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd98003bf0 msgr2=0x7fddac147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.384+0000 7fddab7fe700 1 --2- 172.21.15.81:0/1164675697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd98003bf0 0x7fddac147390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.384+0000 7fddab7fe700 1 -- 172.21.15.81:0/1164675697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddac069d70 msgr2=0x7fddac06a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.384+0000 7fddab7fe700 1 --2- 172.21.15.81:0/1164675697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddac069d70 0x7fddac06a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.384+0000 7fddab7fe700 1 -- 172.21.15.81:0/1164675697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac0af6f0 con 0x7fddac0aed30 2023-10-07T08:49:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.384+0000 7fddab7fe700 1 --2- 172.21.15.81:0/1164675697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddac0aed30 0x7fddac0af1b0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fddac06b2e0 tx=0x7fdda40017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.384+0000 7fdda37fe700 1 -- 172.21.15.81:0/1164675697 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda4006db0 con 0x7fddac0aed30 2023-10-07T08:49:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.384+0000 7fdda37fe700 1 -- 172.21.15.81:0/1164675697 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda400c5a0 con 0x7fddac0aed30 2023-10-07T08:49:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.384+0000 7fddb14a1700 1 -- 172.21.15.81:0/1164675697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddac0af9b0 con 0x7fddac0aed30 2023-10-07T08:49:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.384+0000 7fdda37fe700 1 -- 172.21.15.81:0/1164675697 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda400c960 con 0x7fddac0aed30 2023-10-07T08:49:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.384+0000 7fddb14a1700 1 -- 172.21.15.81:0/1164675697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddac0c2af0 con 0x7fddac0aed30 2023-10-07T08:49:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.385+0000 7fddb14a1700 1 -- 172.21.15.81:0/1164675697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddac068900 con 0x7fddac0aed30 2023-10-07T08:49:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.385+0000 7fdda37fe700 1 -- 172.21.15.81:0/1164675697 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdda40133e0 con 0x7fddac0aed30 2023-10-07T08:49:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.386+0000 7fdda37fe700 1 --2- 172.21.15.81:0/1164675697 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdd8c066f30 0x7fdd8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.386+0000 7fdda37fe700 1 -- 172.21.15.81:0/1164675697 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdda4083e40 con 0x7fddac0aed30 2023-10-07T08:49:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.386+0000 7fddaaffd700 1 --2- 172.21.15.81:0/1164675697 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdd8c066f30 0x7fdd8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.386+0000 7fddaaffd700 1 --2- 172.21.15.81:0/1164675697 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdd8c066f30 0x7fdd8c0693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0091e0 tx=0x7fdd9c019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:22.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.390+0000 7fdda37fe700 1 -- 172.21.15.81:0/1164675697 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdda4051090 con 0x7fddac0aed30 2023-10-07T08:49:22.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.618+0000 7fddb14a1700 1 -- 172.21.15.81:0/1164675697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddac0ac9d0 con 0x7fddac0aed30 2023-10-07T08:49:22.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.618+0000 7fdda37fe700 1 -- 172.21.15.81:0/1164675697 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fdda4019090 con 0x7fddac0aed30 2023-10-07T08:49:22.620 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:22.620 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1795695306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1795695306},{"type":"v1","addr":"172.21.15.89:6834","nonce":1795695306}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3856313795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3856313795},{"type":"v1","addr":"172.21.15.89:6835","nonce":3856313795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7119,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4143803144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4143803144},{"type":"v1","addr":"172.21.15.81:6836","nonce":4143803144}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:49:13.845110+0000","modified":"2023-10-07T08:49:17.485796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3151244734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3151244734},{"type":"v1","addr":"172.21.15.81:6837","nonce":3151244734}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-07T08:49:22.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.620+0000 7fddb14a1700 1 -- 172.21.15.81:0/1164675697 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdd8c066f30 msgr2=0x7fdd8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:22.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.620+0000 7fddb14a1700 1 --2- 172.21.15.81:0/1164675697 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdd8c066f30 0x7fdd8c0693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0091e0 tx=0x7fdd9c019000 comp rx=0 tx=0).stop 2023-10-07T08:49:22.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.620+0000 7fddb14a1700 1 -- 172.21.15.81:0/1164675697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddac0aed30 msgr2=0x7fddac0af1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:22.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.620+0000 7fddb14a1700 1 --2- 172.21.15.81:0/1164675697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddac0aed30 0x7fddac0af1b0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fddac06b2e0 tx=0x7fdda40017a0 comp rx=0 tx=0).stop 2023-10-07T08:49:22.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.620+0000 7fddb14a1700 1 -- 172.21.15.81:0/1164675697 shutdown_connections 2023-10-07T08:49:22.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.620+0000 7fddb14a1700 1 --2- 172.21.15.81:0/1164675697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddac0aed30 0x7fddac0af1b0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:22.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.620+0000 7fddb14a1700 1 --2- 172.21.15.81:0/1164675697 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdd8c066f30 0x7fdd8c0693e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:22.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.620+0000 7fddb14a1700 1 --2- 172.21.15.81:0/1164675697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd98003bf0 0x7fddac147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:22.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.620+0000 7fddb14a1700 1 --2- 172.21.15.81:0/1164675697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddac069d70 0x7fddac06a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:22.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.620+0000 7fddb14a1700 1 -- 172.21.15.81:0/1164675697 >> 172.21.15.81:0/1164675697 conn(0x7fddac06cca0 msgr2=0x7fddac06d070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:22.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.620+0000 7fddb14a1700 1 -- 172.21.15.81:0/1164675697 shutdown_connections 2023-10-07T08:49:22.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.620+0000 7fddb14a1700 1 -- 172.21.15.81:0/1164675697 wait complete. 2023-10-07T08:49:22.623 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2023-10-07T08:49:22.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-07T08:49:22.765 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":7122,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.2815421750000002,"mdsmap_epoch":66,"osdmap_epoch":138,"osdmap_epoch_barrier":138,"uptime":13.414087567999999} 2023-10-07T08:49:22.765 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 7122, "mdsmap_epoch": 66, "osdmap_epoch": 138, "osdmap_epoch_barrier": 138, "rank_uptime": 8.281542175, "state": "up:active", "uptime": 13.414087568, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:49:22.765 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-07T08:49:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.883+0000 7ff965c9d700 1 Processor -- start 2023-10-07T08:49:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.883+0000 7ff965c9d700 1 -- start start 2023-10-07T08:49:22.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.883+0000 7ff965c9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff96006d830 0x7ff9600cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:22.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.883+0000 7ff965c9d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9600d07c0 con 0x7ff9601578d0 2023-10-07T08:49:22.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.883+0000 7ff965c9d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9600cfbb0 con 0x7ff960157ca0 2023-10-07T08:49:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.883+0000 7ff965c9d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9600cfe90 con 0x7ff96006d830 2023-10-07T08:49:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.884+0000 7ff95f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff9601578d0 0x7ff96015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47050/0 (socket says 172.21.15.81:47050) 2023-10-07T08:49:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.884+0000 7ff95f7fe700 1 -- 172.21.15.81:0/2755678483 learned_addr learned my addr 172.21.15.81:0/2755678483 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.884+0000 7ff95ffff700 1 --2- 172.21.15.81:0/2755678483 >> v2:172.21.15.89:3300/0 conn(0x7ff96006d830 0x7ff9600cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.884+0000 7ff95e7fc700 1 -- 172.21.15.81:0/2755678483 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790414259 0 0) 0x7ff9600d07c0 con 0x7ff9601578d0 2023-10-07T08:49:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.884+0000 7ff95e7fc700 1 -- 172.21.15.81:0/2755678483 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff94c003570 con 0x7ff9601578d0 2023-10-07T08:49:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.884+0000 7ff95e7fc700 1 -- 172.21.15.81:0/2755678483 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022866675 0 0) 0x7ff9600cfbb0 con 0x7ff960157ca0 2023-10-07T08:49:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.884+0000 7ff95e7fc700 1 -- 172.21.15.81:0/2755678483 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9600d07c0 con 0x7ff960157ca0 2023-10-07T08:49:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.884+0000 7ff95ffff700 1 -- 172.21.15.81:0/2755678483 >> v1:172.21.15.89:6789/0 conn(0x7ff960157ca0 legacy=0x7ff96006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.884+0000 7ff95ffff700 1 -- 172.21.15.81:0/2755678483 >> v1:172.21.15.81:6789/0 conn(0x7ff9601578d0 legacy=0x7ff96015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.884+0000 7ff95ffff700 1 -- 172.21.15.81:0/2755678483 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9600d0170 con 0x7ff96006d830 2023-10-07T08:49:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.884+0000 7ff95ffff700 1 --2- 172.21.15.81:0/2755678483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff96006d830 0x7ff9600cf4f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff9580098e0 tx=0x7ff9580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=185fb100037dea server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.884+0000 7ff95e7fc700 1 -- 172.21.15.81:0/2755678483 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958011630 con 0x7ff96006d830 2023-10-07T08:49:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.884+0000 7ff95e7fc700 1 -- 172.21.15.81:0/2755678483 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff958011790 con 0x7ff96006d830 2023-10-07T08:49:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.884+0000 7ff95e7fc700 1 -- 172.21.15.81:0/2755678483 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958011b30 con 0x7ff96006d830 2023-10-07T08:49:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.885+0000 7ff965c9d700 1 -- 172.21.15.81:0/2755678483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff96006d830 msgr2=0x7ff9600cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.885+0000 7ff965c9d700 1 --2- 172.21.15.81:0/2755678483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff96006d830 0x7ff9600cf4f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff9580098e0 tx=0x7ff9580091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.885+0000 7ff965c9d700 1 -- 172.21.15.81:0/2755678483 shutdown_connections 2023-10-07T08:49:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.885+0000 7ff965c9d700 1 --2- 172.21.15.81:0/2755678483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff96006d830 0x7ff9600cf4f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.885+0000 7ff965c9d700 1 -- 172.21.15.81:0/2755678483 >> 172.21.15.81:0/2755678483 conn(0x7ff96006bb90 msgr2=0x7ff96006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.885+0000 7ff965c9d700 1 -- 172.21.15.81:0/2755678483 shutdown_connections 2023-10-07T08:49:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.885+0000 7ff965c9d700 1 -- 172.21.15.81:0/2755678483 wait complete. 2023-10-07T08:49:22.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.886+0000 7ff965c9d700 1 Processor -- start 2023-10-07T08:49:22.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.886+0000 7ff965c9d700 1 -- start start 2023-10-07T08:49:22.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff965c9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff96006d830 0x7ff960154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:22.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff965c9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9601578d0 0x7ff9600b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:22.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff965c9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff960157ca0 0x7ff9600b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:22.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff965c9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9601550c0 con 0x7ff96006d830 2023-10-07T08:49:22.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff965c9d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600aaa30 con 0x7ff9601578d0 2023-10-07T08:49:22.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff965c9d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600aad10 con 0x7ff960157ca0 2023-10-07T08:49:22.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff95f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff96006d830 0x7ff960154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:22.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff95f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff96006d830 0x7ff960154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56204/0 (socket says 172.21.15.81:56204) 2023-10-07T08:49:22.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff95f7fe700 1 -- 172.21.15.81:0/3225358841 learned_addr learned my addr 172.21.15.81:0/3225358841 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:22.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff95effd700 1 --2- 172.21.15.81:0/3225358841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9601578d0 0x7ff9600b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:22.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff95ffff700 1 --2- 172.21.15.81:0/3225358841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff960157ca0 0x7ff9600b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:22.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff95f7fe700 1 -- 172.21.15.81:0/3225358841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff960157ca0 msgr2=0x7ff9600b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:22.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff95f7fe700 1 --2- 172.21.15.81:0/3225358841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff960157ca0 0x7ff9600b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:22.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff95f7fe700 1 -- 172.21.15.81:0/3225358841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9601578d0 msgr2=0x7ff9600b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:22.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff95f7fe700 1 --2- 172.21.15.81:0/3225358841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9601578d0 0x7ff9600b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:22.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff95f7fe700 1 -- 172.21.15.81:0/3225358841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff958009420 con 0x7ff96006d830 2023-10-07T08:49:22.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.887+0000 7ff95f7fe700 1 --2- 172.21.15.81:0/3225358841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff96006d830 0x7ff960154b80 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff950002250 tx=0x7ff950001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:22.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.888+0000 7ff9577fe700 1 -- 172.21.15.81:0/3225358841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95000ce90 con 0x7ff96006d830 2023-10-07T08:49:22.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.888+0000 7ff9577fe700 1 -- 172.21.15.81:0/3225358841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95000ab30 con 0x7ff96006d830 2023-10-07T08:49:22.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.888+0000 7ff965c9d700 1 -- 172.21.15.81:0/3225358841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9600aaff0 con 0x7ff96006d830 2023-10-07T08:49:22.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.888+0000 7ff9577fe700 1 -- 172.21.15.81:0/3225358841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9500070f0 con 0x7ff96006d830 2023-10-07T08:49:22.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.888+0000 7ff965c9d700 1 -- 172.21.15.81:0/3225358841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9600ab5b0 con 0x7ff96006d830 2023-10-07T08:49:22.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.889+0000 7ff965c9d700 1 -- 172.21.15.81:0/3225358841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9600ab7d0 con 0x7ff96006d830 2023-10-07T08:49:22.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.889+0000 7ff9577fe700 1 -- 172.21.15.81:0/3225358841 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff950007520 con 0x7ff96006d830 2023-10-07T08:49:22.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.889+0000 7ff9577fe700 1 --2- 172.21.15.81:0/3225358841 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff940066f30 0x7ff9400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:22.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.890+0000 7ff95effd700 1 --2- 172.21.15.81:0/3225358841 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff940066f30 0x7ff9400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:22.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.890+0000 7ff9577fe700 1 -- 172.21.15.81:0/3225358841 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff950084940 con 0x7ff96006d830 2023-10-07T08:49:22.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.890+0000 7ff95effd700 1 --2- 172.21.15.81:0/3225358841 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff940066f30 0x7ff9400693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff96015f920 tx=0x7ff948007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:22.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:22.894+0000 7ff9577fe700 1 -- 172.21.15.81:0/3225358841 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff950051c30 con 0x7ff96006d830 2023-10-07T08:49:23.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:23.076+0000 7ff965c9d700 1 -- 172.21.15.81:0/3225358841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7ff9600d0450 con 0x7ff96006d830 2023-10-07T08:49:23.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:23.508+0000 7ff9577fe700 1 -- 172.21.15.81:0/3225358841 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v139) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff950055250 con 0x7ff96006d830 2023-10-07T08:49:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:23.510+0000 7ff965c9d700 1 -- 172.21.15.81:0/3225358841 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff940066f30 msgr2=0x7ff9400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:23.510+0000 7ff965c9d700 1 --2- 172.21.15.81:0/3225358841 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff940066f30 0x7ff9400693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff96015f920 tx=0x7ff948007d50 comp rx=0 tx=0).stop 2023-10-07T08:49:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:23.510+0000 7ff965c9d700 1 -- 172.21.15.81:0/3225358841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff96006d830 msgr2=0x7ff960154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:23.510+0000 7ff965c9d700 1 --2- 172.21.15.81:0/3225358841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff96006d830 0x7ff960154b80 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff950002250 tx=0x7ff950001bb0 comp rx=0 tx=0).stop 2023-10-07T08:49:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:23.510+0000 7ff965c9d700 1 -- 172.21.15.81:0/3225358841 shutdown_connections 2023-10-07T08:49:23.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:23.510+0000 7ff965c9d700 1 --2- 172.21.15.81:0/3225358841 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff940066f30 0x7ff9400693e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:23.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:23.510+0000 7ff965c9d700 1 --2- 172.21.15.81:0/3225358841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff960157ca0 0x7ff9600b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:23.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:23.510+0000 7ff965c9d700 1 --2- 172.21.15.81:0/3225358841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff96006d830 0x7ff960154b80 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:23.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:23.510+0000 7ff965c9d700 1 --2- 172.21.15.81:0/3225358841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9601578d0 0x7ff9600b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:23.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:23.510+0000 7ff965c9d700 1 -- 172.21.15.81:0/3225358841 >> 172.21.15.81:0/3225358841 conn(0x7ff96006bb90 msgr2=0x7ff9601568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:23.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:23.511+0000 7ff965c9d700 1 -- 172.21.15.81:0/3225358841 shutdown_connections 2023-10-07T08:49:23.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:23.511+0000 7ff965c9d700 1 -- 172.21.15.81:0/3225358841 wait complete. 2023-10-07T08:49:23.513 INFO:teuthology.orchestra.run.smithi081.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-07T08:49:23.525 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-07T08:49:23.653 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_mon_report_interval":"5"} 2023-10-07T08:49:23.653 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-07T08:49:23.654 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-10-07T08:49:23.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:49:23.654 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-10-07T08:49:23.768 INFO:teuthology.orchestra.run.smithi081.stderr:16+0 records in 2023-10-07T08:49:23.768 INFO:teuthology.orchestra.run.smithi081.stderr:16+0 records out 2023-10-07T08:49:23.768 INFO:teuthology.orchestra.run.smithi081.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0962899 s, 174 MB/s 2023-10-07T08:49:23.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:49:23.770 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-10-07T08:49:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:17+0 records in 2023-10-07T08:49:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:17+0 records out 2023-10-07T08:49:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.106754 s, 167 MB/s 2023-10-07T08:49:23.893 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-07T08:49:23.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:49:24.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.005+0000 7f55a0b83700 1 Processor -- start 2023-10-07T08:49:24.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.005+0000 7f55a0b83700 1 -- start start 2023-10-07T08:49:24.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.006+0000 7f55a0b83700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559c068e90 0x7f559c164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:24.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.006+0000 7f55a0b83700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559c0cee10 con 0x7f559c159b40 2023-10-07T08:49:24.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.006+0000 7f55a0b83700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559c0cd040 con 0x7f559c159f10 2023-10-07T08:49:24.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.006+0000 7f55a0b83700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c0cd320 con 0x7f559c068e90 2023-10-07T08:49:24.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.006+0000 7f559b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f559c159b40 0x7f559c0cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47058/0 (socket says 172.21.15.81:47058) 2023-10-07T08:49:24.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.006+0000 7f559b7fe700 1 -- 172.21.15.81:0/2312325156 learned_addr learned my addr 172.21.15.81:0/2312325156 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:24.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.006+0000 7f559bfff700 1 --2- 172.21.15.81:0/2312325156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559c068e90 0x7f559c164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:24.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.006+0000 7f559a7fc700 1 -- 172.21.15.81:0/2312325156 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282384005 0 0) 0x7f559c0cee10 con 0x7f559c159b40 2023-10-07T08:49:24.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.006+0000 7f559a7fc700 1 -- 172.21.15.81:0/2312325156 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5584003570 con 0x7f559c159b40 2023-10-07T08:49:24.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.006+0000 7f559a7fc700 1 -- 172.21.15.81:0/2312325156 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770306712 0 0) 0x7f559c0cd040 con 0x7f559c159f10 2023-10-07T08:49:24.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 -- 172.21.15.81:0/2312325156 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f559c0cee10 con 0x7f559c159f10 2023-10-07T08:49:24.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 -- 172.21.15.81:0/2312325156 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 860286866 0 0) 0x7f5584003570 con 0x7f559c159b40 2023-10-07T08:49:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 -- 172.21.15.81:0/2312325156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559c068e90 msgr2=0x7f559c164c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 --2- 172.21.15.81:0/2312325156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559c068e90 0x7f559c164c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 -- 172.21.15.81:0/2312325156 >> v1:172.21.15.89:6789/0 conn(0x7f559c159f10 legacy=0x7f559c068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 -- 172.21.15.81:0/2312325156 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c0ce7c0 con 0x7f559c159b40 2023-10-07T08:49:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 -- 172.21.15.81:0/2312325156 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f558c001470 con 0x7f559c159b40 2023-10-07T08:49:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 -- 172.21.15.81:0/2312325156 >> v1:172.21.15.81:6789/0 conn(0x7f559c159b40 legacy=0x7f559c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 --2- 172.21.15.81:0/2312325156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559c068e90 0x7f5584003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 --2- 172.21.15.81:0/2312325156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5584004180 0x7f5584004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 --2- 172.21.15.81:0/2312325156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5584004d50 0x7f55840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 -- 172.21.15.81:0/2312325156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c0cd320 con 0x7f5584004d50 2023-10-07T08:49:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 -- 172.21.15.81:0/2312325156 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558400bba0 con 0x7f5584004180 2023-10-07T08:49:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 -- 172.21.15.81:0/2312325156 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558400bd60 con 0x7f559c068e90 2023-10-07T08:49:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559bfff700 1 --2- 172.21.15.81:0/2312325156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5584004d50 0x7f55840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559b7fe700 1 --2- 172.21.15.81:0/2312325156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559c068e90 0x7f5584003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559affd700 1 --2- 172.21.15.81:0/2312325156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5584004180 0x7f5584004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559bfff700 1 -- 172.21.15.81:0/2312325156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559c068e90 msgr2=0x7f5584003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559bfff700 1 --2- 172.21.15.81:0/2312325156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559c068e90 0x7f5584003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559bfff700 1 -- 172.21.15.81:0/2312325156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5584004180 msgr2=0x7f5584004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559bfff700 1 --2- 172.21.15.81:0/2312325156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5584004180 0x7f5584004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559bfff700 1 -- 172.21.15.81:0/2312325156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5584003570 con 0x7f5584004d50 2023-10-07T08:49:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559bfff700 1 --2- 172.21.15.81:0/2312325156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5584004d50 0x7f55840051c0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f559c069290 tx=0x7f559400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486657f3cc9857bf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 -- 172.21.15.81:0/2312325156 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559400ea00 con 0x7f5584004d50 2023-10-07T08:49:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 -- 172.21.15.81:0/2312325156 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559400f040 con 0x7f5584004d50 2023-10-07T08:49:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.007+0000 7f559a7fc700 1 -- 172.21.15.81:0/2312325156 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559400edb0 con 0x7f5584004d50 2023-10-07T08:49:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.008+0000 7f55a0b83700 1 -- 172.21.15.81:0/2312325156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5584004d50 msgr2=0x7f55840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.008+0000 7f55a0b83700 1 --2- 172.21.15.81:0/2312325156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5584004d50 0x7f55840051c0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f559c069290 tx=0x7f559400b040 comp rx=0 tx=0).stop 2023-10-07T08:49:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.008+0000 7f559bfff700 1 -- 172.21.15.81:0/2312325156 reap_dead start 2023-10-07T08:49:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.008+0000 7f55a0b83700 1 -- 172.21.15.81:0/2312325156 shutdown_connections 2023-10-07T08:49:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.008+0000 7f55a0b83700 1 -- 172.21.15.81:0/2312325156 >> 172.21.15.81:0/2312325156 conn(0x7f559c0cd660 msgr2=0x7f559c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.008+0000 7f55a0b83700 1 -- 172.21.15.81:0/2312325156 shutdown_connections 2023-10-07T08:49:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.008+0000 7f55a0b83700 1 -- 172.21.15.81:0/2312325156 wait complete. 2023-10-07T08:49:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.009+0000 7f55a0b83700 1 Processor -- start 2023-10-07T08:49:24.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.009+0000 7f55a0b83700 1 -- start start 2023-10-07T08:49:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f55a0b83700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c158a30 0x7f559c16a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f55a0b83700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559c158e00 0x7f559c16a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f55a0b83700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c0ca260 0x7f559c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f55a0b83700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c0c9dd0 con 0x7f559c158a30 2023-10-07T08:49:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f55a0b83700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c0c91c0 con 0x7f559c0ca260 2023-10-07T08:49:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f55a0b83700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c0c94a0 con 0x7f559c158e00 2023-10-07T08:49:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f559b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c158a30 0x7f559c16a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f559b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c158a30 0x7f559c16a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56228/0 (socket says 172.21.15.81:56228) 2023-10-07T08:49:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f559b7fe700 1 -- 172.21.15.81:0/2940494968 learned_addr learned my addr 172.21.15.81:0/2940494968 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f559affd700 1 --2- 172.21.15.81:0/2940494968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559c158e00 0x7f559c16a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f559bfff700 1 --2- 172.21.15.81:0/2940494968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c0ca260 0x7f559c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f559b7fe700 1 -- 172.21.15.81:0/2940494968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559c158e00 msgr2=0x7f559c16a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f559b7fe700 1 --2- 172.21.15.81:0/2940494968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559c158e00 0x7f559c16a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f559b7fe700 1 -- 172.21.15.81:0/2940494968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c0ca260 msgr2=0x7f559c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f559b7fe700 1 --2- 172.21.15.81:0/2940494968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c0ca260 0x7f559c0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f559b7fe700 1 -- 172.21.15.81:0/2940494968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c0c9780 con 0x7f559c158a30 2023-10-07T08:49:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f559bfff700 1 --2- 172.21.15.81:0/2940494968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c0ca260 0x7f559c0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f559b7fe700 1 --2- 172.21.15.81:0/2940494968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c158a30 0x7f559c16a280 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f558c007390 tx=0x7f558c001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.010+0000 7f55837fe700 1 -- 172.21.15.81:0/2940494968 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c018030 con 0x7f559c158a30 2023-10-07T08:49:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.011+0000 7f55837fe700 1 -- 172.21.15.81:0/2940494968 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c007820 con 0x7f559c158a30 2023-10-07T08:49:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.011+0000 7f55837fe700 1 -- 172.21.15.81:0/2940494968 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c00fb00 con 0x7f559c158a30 2023-10-07T08:49:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.011+0000 7f55a0b83700 1 -- 172.21.15.81:0/2940494968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c0c9a60 con 0x7f559c158a30 2023-10-07T08:49:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.011+0000 7f55a0b83700 1 -- 172.21.15.81:0/2940494968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c16dac0 con 0x7f559c158a30 2023-10-07T08:49:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.011+0000 7f55a0b83700 1 -- 172.21.15.81:0/2940494968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559c0ca0b0 con 0x7f559c158a30 2023-10-07T08:49:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.012+0000 7f55837fe700 1 -- 172.21.15.81:0/2940494968 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f558c01b070 con 0x7f559c158a30 2023-10-07T08:49:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.012+0000 7f55837fe700 1 --2- 172.21.15.81:0/2940494968 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5588066f30 0x7f55880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.012+0000 7f55837fe700 1 -- 172.21.15.81:0/2940494968 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f558c019070 con 0x7f559c158a30 2023-10-07T08:49:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.012+0000 7f559affd700 1 --2- 172.21.15.81:0/2940494968 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5588066f30 0x7f55880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.013+0000 7f559affd700 1 --2- 172.21.15.81:0/2940494968 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5588066f30 0x7f55880693e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f559c15b4a0 tx=0x7f5590007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.016+0000 7f55837fe700 1 -- 172.21.15.81:0/2940494968 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f558c0516d0 con 0x7f559c158a30 2023-10-07T08:49:24.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.199+0000 7f55a0b83700 1 -- 172.21.15.81:0/2940494968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f559c063e90 con 0x7f559c158a30 2023-10-07T08:49:24.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.200+0000 7f55837fe700 1 -- 172.21.15.81:0/2940494968 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+32234 (secure 0 0 0) 0x7f558c054cf0 con 0x7f559c158a30 2023-10-07T08:49:24.202 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:24.202 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:49:24.202 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 139, 2023-10-07T08:49:24.202 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:49:24.202 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:49:24.203 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:49:23.503125+0000", 2023-10-07T08:49:24.203 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:49:24.203 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:49:24.203 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:49:24.203 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:49:24.203 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:49:24.203 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:49:24.203 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:49:24.203 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:49:24.203 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:49:24.203 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:24.204 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:49:24.204 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:49:24.204 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:49:24.204 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:49:24.204 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:49:24.204 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 17, 2023-10-07T08:49:24.204 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:49:24.204 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:49:24.204 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:49:24.204 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:49:24.204 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:49:24.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.205 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:49:24.205 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:49:24.205 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:49:24.205 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:24.205 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:24.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:24.205 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:24.205 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:24.205 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:24.205 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:24.205 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:24.205 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:24.206 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:24.206 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:24.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:24.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:49:24.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:49:24.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:49:24.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:49:24.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:49:24.206 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:24.206 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:24.207 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:24.207 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:24.207 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:24.207 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:24.207 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:24.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.207 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:49:24.208 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:24.208 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:24.208 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:24.208 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:24.208 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:24.208 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:24.208 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:24.208 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:24.208 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:24.208 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:49:24.208 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:24.209 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:24.209 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:24.209 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:24.209 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:24.209 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:24.209 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:24.209 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:24.209 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:24.209 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:24.209 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:24.209 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:24.209 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:24.210 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:24.210 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:24.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:24.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.210 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:24.210 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:24.210 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:24.210 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:24.210 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:24.210 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:24.210 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:24.210 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:24.211 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:24.211 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:24.211 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:24.211 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:24.211 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:49:24.211 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:49:24.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.211 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:24.211 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:49:24.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.212 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 16, 2023-10-07T08:49:24.212 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:49:24.212 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:49:12.162742+0000", 2023-10-07T08:49:24.212 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:24.212 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:24.212 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:24.212 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:24.212 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:24.212 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:24.212 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:24.212 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:24.213 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:24.213 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:24.213 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:24.213 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:24.213 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:49:24.213 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:49:24.213 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:49:24.213 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:49:24.213 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:49:24.213 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:24.214 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:24.214 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:24.214 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:24.214 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:24.214 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:24.214 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:24.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.214 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "137", 2023-10-07T08:49:24.214 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:24.214 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:24.214 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:24.215 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:24.215 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:24.215 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:24.215 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:24.215 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:24.215 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:24.215 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:49:24.215 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:24.215 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:24.215 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:24.215 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:24.216 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:24.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:24.216 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:24.216 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:24.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:24.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:24.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:24.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:24.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:24.216 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:24.216 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:24.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:24.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.217 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:24.217 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:24.217 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:24.217 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:24.217 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:24.217 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:24.217 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:24.217 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:24.217 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:24.217 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:24.217 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:24.218 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:24.218 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:49:24.218 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:49:24.218 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:49:24.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.218 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:24.218 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:49:24.218 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:49:24.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.219 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 17, 2023-10-07T08:49:24.219 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:49:24.219 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:49:12.805348+0000", 2023-10-07T08:49:24.219 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:24.219 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:24.219 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:24.219 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:24.219 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:24.219 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:24.219 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:24.220 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:24.220 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:24.220 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:24.220 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:24.220 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:24.220 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:49:24.220 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:49:24.220 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:49:24.220 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:49:24.220 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:49:24.220 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:24.220 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:24.221 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:24.221 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:24.221 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:24.221 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:24.221 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:24.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.221 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "139", 2023-10-07T08:49:24.221 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:24.221 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:24.221 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:24.221 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:24.221 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:24.222 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:24.222 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:24.222 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:24.222 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:24.222 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-07T08:49:24.222 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:24.222 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:24.222 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:24.222 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:24.222 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:24.222 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:24.223 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:24.223 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:24.223 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:24.223 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:24.223 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:24.223 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:24.223 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:24.223 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:24.223 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:24.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:24.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.224 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:24.224 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:24.224 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:24.224 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:24.224 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:24.224 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:24.224 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:24.224 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:24.224 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:24.224 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:24.224 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:24.224 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:24.225 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:49:24.225 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:49:24.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.225 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:24.225 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:49:24.225 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:49:24.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.225 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:24.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:49:24.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.226 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:49:24.226 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:24.226 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:24.226 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:24.226 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:24.226 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:24.226 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:24.226 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:24.226 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:24.226 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:24.226 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:24.227 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:24.227 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:24.227 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.227 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.227 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:49:24.227 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:24.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.227 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.227 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:49:24.227 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:24.228 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.228 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.228 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:24.228 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.228 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.228 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:49:24.228 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:24.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.228 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:49:24.229 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:24.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.229 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.229 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:24.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:49:24.229 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:24.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:49:24.230 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:24.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.230 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.230 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:24.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.231 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:49:24.231 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:24.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.231 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:49:24.231 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:24.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.231 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.231 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:49:24.231 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:49:24.232 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:49:24.232 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:49:24.232 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:24.232 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:24.232 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:24.232 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.232 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:49:24.232 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:24.232 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:24.232 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:24.233 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:24.233 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:24.233 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:24.233 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:24.233 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:24.233 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:24.233 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:24.233 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:24.233 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:24.233 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.234 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:49:24.234 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:24.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.234 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:49:24.234 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:24.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.234 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.234 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:24.234 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.235 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:49:24.235 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:24.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.235 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:49:24.235 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:24.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.236 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:24.236 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.236 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.236 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:49:24.236 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:24.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.236 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.236 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:49:24.236 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:24.236 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.237 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.237 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:24.237 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.237 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:49:24.237 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:24.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.237 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:49:24.238 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:24.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.238 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.238 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:49:24.238 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:49:24.238 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:49:24.238 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:49:24.238 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:24.238 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:24.238 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:24.238 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.239 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:49:24.239 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:24.239 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:24.239 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:24.239 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:24.239 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:24.239 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:24.239 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:24.239 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:24.240 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:24.240 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:24.240 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:24.240 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:24.240 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.240 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:49:24.240 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:24.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.241 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:49:24.241 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:24.241 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.241 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.241 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:24.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:49:24.242 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:24.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:49:24.242 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:24.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.242 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.243 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:24.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:49:24.243 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:24.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:49:24.243 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:24.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.244 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.244 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:24.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:49:24.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:24.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:49:24.245 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:24.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.245 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.245 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:49:24.245 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:49:24.245 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:49:24.245 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:49:24.245 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:24.245 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:24.246 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:24.246 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.246 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:49:24.246 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:24.246 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:24.246 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:24.246 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:24.246 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:24.246 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:24.246 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:24.247 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:24.247 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:24.247 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:24.247 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:24.247 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:24.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:49:24.247 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:24.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:49:24.248 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:24.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.248 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.248 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:24.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:49:24.248 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:24.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.249 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.249 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:49:24.249 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:24.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.249 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.249 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:24.249 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.249 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.250 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:49:24.250 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:24.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.250 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.250 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:49:24.250 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:24.250 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.250 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.250 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:24.250 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:49:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:49:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.252 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:49:24.252 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:49:24.252 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:49:24.252 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:49:24.252 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:24.252 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:24.252 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:24.252 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.252 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:49:24.253 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:24.253 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:24.253 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:24.253 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:24.253 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:24.253 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:24.253 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:24.253 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:24.253 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:24.253 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:24.253 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:24.253 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:24.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:49:24.254 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:24.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:49:24.254 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:24.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.255 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.255 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:24.255 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.255 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:49:24.255 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:24.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.255 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:49:24.256 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:24.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.256 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.256 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:24.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.256 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:49:24.256 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:24.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.257 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:49:24.257 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:24.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.257 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.257 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:24.257 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.257 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:49:24.258 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:24.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:49:24.258 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:24.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.258 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.258 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:49:24.258 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:49:24.258 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:49:24.259 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:49:24.259 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:24.259 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:24.259 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:24.259 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.259 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:49:24.259 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:24.259 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:24.259 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:24.259 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:24.260 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:24.260 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:24.260 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:24.260 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:24.260 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:24.260 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:24.260 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:24.260 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:24.260 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:49:24.261 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:24.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:49:24.261 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:24.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.261 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.262 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:24.262 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.262 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.262 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:49:24.262 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:24.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.262 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.262 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:49:24.262 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:24.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.263 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.263 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:24.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:49:24.263 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:24.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:49:24.264 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:24.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.264 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.264 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:24.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:49:24.264 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:24.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:49:24.265 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:24.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.265 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:49:24.265 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:49:24.265 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:49:24.265 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:49:24.266 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:24.266 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:24.266 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:24.266 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.266 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:49:24.266 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:24.266 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:24.266 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:24.266 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:24.266 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:24.267 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:24.267 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:24.267 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:24.267 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:24.267 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:24.267 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:24.267 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:24.267 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.267 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.267 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:49:24.267 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:24.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.268 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:49:24.268 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:24.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.268 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.268 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:24.268 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.269 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:49:24.269 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:24.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.269 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.269 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:49:24.269 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:24.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.269 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.269 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:24.269 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.270 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:49:24.270 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:24.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.270 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:49:24.270 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:24.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.270 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.271 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:24.271 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.271 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:49:24.271 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:24.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.271 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:49:24.271 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:24.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.272 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.272 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:49:24.272 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:49:24.272 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:49:24.272 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:49:24.272 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:24.272 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:24.272 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:24.272 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.273 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:49:24.273 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:24.273 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:24.273 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:24.273 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:24.273 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:24.273 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:24.273 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:24.273 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:24.273 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:24.273 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:24.274 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:24.274 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:24.274 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.274 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:49:24.274 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:24.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.274 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:49:24.274 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:24.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.275 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.275 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:24.275 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.275 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:49:24.275 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:24.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.276 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:49:24.276 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:24.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.276 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:24.276 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.276 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:49:24.276 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:24.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:49:24.277 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:24.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.277 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.277 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:24.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:24.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:24.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:49:24.278 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:24.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.278 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:24.278 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:49:24.278 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:24.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.278 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.278 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:49:24.278 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:49:24.279 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:49:24.279 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:49:24.279 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:24.279 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:24.279 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:24.279 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:24.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.279 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:24.279 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:49:24.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.280 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:49:24.280 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:24.280 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:24.280 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:24.280 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:24.280 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:24.280 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:49:24.280 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:24.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.281 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:49:24.281 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:24.281 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:24.281 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:24.281 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:24.281 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:24.281 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:49:24.281 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:24.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.281 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:49:24.282 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:24.282 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:24.282 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:24.282 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:24.282 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:24.282 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:49:24.282 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:24.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.283 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:49:24.283 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:24.283 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:24.283 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:24.283 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:24.283 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:24.283 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:49:24.283 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:24.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.283 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:49:24.284 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:24.284 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:24.284 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:24.284 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:24.284 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:24.284 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:49:24.284 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:24.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.284 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:49:24.285 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:24.285 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:24.285 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:24.285 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:24.285 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:24.285 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:49:24.285 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:24.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.285 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:49:24.285 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:24.285 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:24.286 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:24.286 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:24.286 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:24.286 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:49:24.286 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:24.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:24.286 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:49:24.286 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:24.286 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:24.286 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:24.286 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:24.287 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:24.287 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:49:24.287 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:24.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.287 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:24.287 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:49:24.287 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:49:24.287 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:49:24.287 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:49:24.287 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:49:24.287 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:49:24.287 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:49:24.288 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:49:24.288 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:49:24.288 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:49:24.288 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:49:24.288 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:49:24.288 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:49:24.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:24.288 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:49:24.288 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:49:24.288 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:49:24.289 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:49:24.289 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:49:24.289 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:49:24.289 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:49:24.289 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:49:24.289 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:49:24.289 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:49:24.289 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:49:24.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:24.289 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:49:24.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.202+0000 7f55a0b83700 1 -- 172.21.15.81:0/2940494968 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5588066f30 msgr2=0x7f55880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:24.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.202+0000 7f55a0b83700 1 --2- 172.21.15.81:0/2940494968 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5588066f30 0x7f55880693e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f559c15b4a0 tx=0x7f5590007d30 comp rx=0 tx=0).stop 2023-10-07T08:49:24.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.202+0000 7f55a0b83700 1 -- 172.21.15.81:0/2940494968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c158a30 msgr2=0x7f559c16a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:24.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.202+0000 7f55a0b83700 1 --2- 172.21.15.81:0/2940494968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c158a30 0x7f559c16a280 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f558c007390 tx=0x7f558c001e10 comp rx=0 tx=0).stop 2023-10-07T08:49:24.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.203+0000 7f55a0b83700 1 -- 172.21.15.81:0/2940494968 shutdown_connections 2023-10-07T08:49:24.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.203+0000 7f55a0b83700 1 --2- 172.21.15.81:0/2940494968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c0ca260 0x7f559c0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.203+0000 7f55a0b83700 1 --2- 172.21.15.81:0/2940494968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c158a30 0x7f559c16a280 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.203+0000 7f55a0b83700 1 --2- 172.21.15.81:0/2940494968 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5588066f30 0x7f55880693e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.203+0000 7f55a0b83700 1 --2- 172.21.15.81:0/2940494968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f559c158e00 0x7f559c16a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.203+0000 7f55a0b83700 1 -- 172.21.15.81:0/2940494968 >> 172.21.15.81:0/2940494968 conn(0x7f559c0cd660 msgr2=0x7f559c0c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.203+0000 7f55a0b83700 1 -- 172.21.15.81:0/2940494968 shutdown_connections 2023-10-07T08:49:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:24.203+0000 7f55a0b83700 1 -- 172.21.15.81:0/2940494968 wait complete. 2023-10-07T08:49:24.292 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-07T08:49:25.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:49:25.753 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:49:29.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:49:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.418+0000 7fa071a54700 1 Processor -- start 2023-10-07T08:49:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.418+0000 7fa071a54700 1 -- start start 2023-10-07T08:49:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.419+0000 7fa071a54700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa06c157ca0 0x7fa06c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.419+0000 7fa071a54700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06c0d07c0 con 0x7fa06c06d120 2023-10-07T08:49:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.419+0000 7fa071a54700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06c0cfbb0 con 0x7fa06c1578d0 2023-10-07T08:49:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.419+0000 7fa071a54700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa06c0cfe90 con 0x7fa06c157ca0 2023-10-07T08:49:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.419+0000 7fa06b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa06c06d120 0x7fa06c06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47066/0 (socket says 172.21.15.81:47066) 2023-10-07T08:49:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.419+0000 7fa06b7fe700 1 -- 172.21.15.81:0/2121683399 learned_addr learned my addr 172.21.15.81:0/2121683399 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.419+0000 7fa0627fc700 1 --2- 172.21.15.81:0/2121683399 >> v2:172.21.15.89:3300/0 conn(0x7fa06c157ca0 0x7fa06c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.419+0000 7fa06a7fc700 1 -- 172.21.15.81:0/2121683399 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773451747 0 0) 0x7fa06c0d07c0 con 0x7fa06c06d120 2023-10-07T08:49:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.419+0000 7fa06a7fc700 1 -- 172.21.15.81:0/2121683399 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa058003570 con 0x7fa06c06d120 2023-10-07T08:49:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.419+0000 7fa06a7fc700 1 -- 172.21.15.81:0/2121683399 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877381917 0 0) 0x7fa06c0cfbb0 con 0x7fa06c1578d0 2023-10-07T08:49:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.419+0000 7fa06a7fc700 1 -- 172.21.15.81:0/2121683399 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa06c0d07c0 con 0x7fa06c1578d0 2023-10-07T08:49:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.419+0000 7fa06a7fc700 1 -- 172.21.15.81:0/2121683399 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2889547805 0 0) 0x7fa058003570 con 0x7fa06c06d120 2023-10-07T08:49:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.419+0000 7fa0627fc700 1 -- 172.21.15.81:0/2121683399 >> v1:172.21.15.89:6789/0 conn(0x7fa06c1578d0 legacy=0x7fa06c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.419+0000 7fa0627fc700 1 -- 172.21.15.81:0/2121683399 >> v1:172.21.15.81:6789/0 conn(0x7fa06c06d120 legacy=0x7fa06c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.419+0000 7fa0627fc700 1 -- 172.21.15.81:0/2121683399 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c0d0170 con 0x7fa06c157ca0 2023-10-07T08:49:29.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.419+0000 7fa0627fc700 1 --2- 172.21.15.81:0/2121683399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa06c157ca0 0x7fa06c0cf4f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa0540098e0 tx=0x7fa0540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff12df5963c33426 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:29.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.420+0000 7fa06a7fc700 1 -- 172.21.15.81:0/2121683399 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0640017f0 con 0x7fa06c157ca0 2023-10-07T08:49:29.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.420+0000 7fa06a7fc700 1 -- 172.21.15.81:0/2121683399 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa054011420 con 0x7fa06c157ca0 2023-10-07T08:49:29.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.420+0000 7fa06a7fc700 1 -- 172.21.15.81:0/2121683399 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540117c0 con 0x7fa06c157ca0 2023-10-07T08:49:29.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.420+0000 7fa071a54700 1 -- 172.21.15.81:0/2121683399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa06c157ca0 msgr2=0x7fa06c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:29.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.420+0000 7fa071a54700 1 --2- 172.21.15.81:0/2121683399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa06c157ca0 0x7fa06c0cf4f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa0540098e0 tx=0x7fa0540091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:29.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.420+0000 7fa071a54700 1 -- 172.21.15.81:0/2121683399 shutdown_connections 2023-10-07T08:49:29.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.420+0000 7fa071a54700 1 --2- 172.21.15.81:0/2121683399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa06c157ca0 0x7fa06c0cf4f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:29.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.420+0000 7fa071a54700 1 -- 172.21.15.81:0/2121683399 >> 172.21.15.81:0/2121683399 conn(0x7fa06c06bb90 msgr2=0x7fa06c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:29.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.420+0000 7fa071a54700 1 -- 172.21.15.81:0/2121683399 shutdown_connections 2023-10-07T08:49:29.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.420+0000 7fa071a54700 1 -- 172.21.15.81:0/2121683399 wait complete. 2023-10-07T08:49:29.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.421+0000 7fa071a54700 1 Processor -- start 2023-10-07T08:49:29.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.422+0000 7fa071a54700 1 -- start start 2023-10-07T08:49:29.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.422+0000 7fa071a54700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06c06d120 0x7fa06c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:29.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.422+0000 7fa071a54700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa06c1578d0 0x7fa06c158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.422+0000 7fa071a54700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa06c157ca0 0x7fa06c1409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.422+0000 7fa071a54700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c1592f0 con 0x7fa06c06d120 2023-10-07T08:49:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.422+0000 7fa071a54700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c0b5560 con 0x7fa06c157ca0 2023-10-07T08:49:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.422+0000 7fa071a54700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c0b4950 con 0x7fa06c1578d0 2023-10-07T08:49:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.422+0000 7fa06affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06c06d120 0x7fa06c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.422+0000 7fa06affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06c06d120 0x7fa06c0b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56240/0 (socket says 172.21.15.81:56240) 2023-10-07T08:49:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.422+0000 7fa06affd700 1 -- 172.21.15.81:0/3739187834 learned_addr learned my addr 172.21.15.81:0/3739187834 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.423+0000 7fa06b7fe700 1 --2- 172.21.15.81:0/3739187834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa06c157ca0 0x7fa06c1409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.423+0000 7fa0627fc700 1 --2- 172.21.15.81:0/3739187834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa06c1578d0 0x7fa06c158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.423+0000 7fa06affd700 1 -- 172.21.15.81:0/3739187834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa06c1578d0 msgr2=0x7fa06c158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.423+0000 7fa06affd700 1 --2- 172.21.15.81:0/3739187834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa06c1578d0 0x7fa06c158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.423+0000 7fa06affd700 1 -- 172.21.15.81:0/3739187834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa06c157ca0 msgr2=0x7fa06c1409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.423+0000 7fa06affd700 1 --2- 172.21.15.81:0/3739187834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa06c157ca0 0x7fa06c1409e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.423+0000 7fa06affd700 1 -- 172.21.15.81:0/3739187834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa054009420 con 0x7fa06c06d120 2023-10-07T08:49:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.423+0000 7fa06affd700 1 --2- 172.21.15.81:0/3739187834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06c06d120 0x7fa06c0b4250 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00c790 tx=0x7fa05c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.423+0000 7fa0637fe700 1 -- 172.21.15.81:0/3739187834 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c010510 con 0x7fa06c06d120 2023-10-07T08:49:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.423+0000 7fa0637fe700 1 -- 172.21.15.81:0/3739187834 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c010670 con 0x7fa06c06d120 2023-10-07T08:49:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.423+0000 7fa071a54700 1 -- 172.21.15.81:0/3739187834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa06c0b4c30 con 0x7fa06c06d120 2023-10-07T08:49:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.423+0000 7fa0637fe700 1 -- 172.21.15.81:0/3739187834 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c010a30 con 0x7fa06c06d120 2023-10-07T08:49:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.423+0000 7fa071a54700 1 -- 172.21.15.81:0/3739187834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06c0b51f0 con 0x7fa06c06d120 2023-10-07T08:49:29.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.424+0000 7fa071a54700 1 -- 172.21.15.81:0/3739187834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa06c067ac0 con 0x7fa06c06d120 2023-10-07T08:49:29.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.424+0000 7fa0637fe700 1 -- 172.21.15.81:0/3739187834 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa05c01b3b0 con 0x7fa06c06d120 2023-10-07T08:49:29.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.425+0000 7fa0637fe700 1 --2- 172.21.15.81:0/3739187834 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa04c066f30 0x7fa04c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:29.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.425+0000 7fa0637fe700 1 -- 172.21.15.81:0/3739187834 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa05c083e50 con 0x7fa06c06d120 2023-10-07T08:49:29.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.425+0000 7fa0627fc700 1 --2- 172.21.15.81:0/3739187834 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa04c066f30 0x7fa04c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:29.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.425+0000 7fa0637fe700 1 -- 172.21.15.81:0/3739187834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7fa04c06ea50 con 0x7fa06c06d120 2023-10-07T08:49:29.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.425+0000 7fa0627fc700 1 --2- 172.21.15.81:0/3739187834 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa04c066f30 0x7fa04c0693e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa06c1580c0 tx=0x7fa054016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:29.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.429+0000 7fa0637fe700 1 -- 172.21.15.81:0/3739187834 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa05c017020 con 0x7fa06c06d120 2023-10-07T08:49:29.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.617+0000 7fa071a54700 1 -- 172.21.15.81:0/3739187834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa06c0d0450 con 0x7fa06c06d120 2023-10-07T08:49:29.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.618+0000 7fa0637fe700 1 -- 172.21.15.81:0/3739187834 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) v1 ==== 81+0+32253 (secure 0 0 0) 0x7fa05c0510c0 con 0x7fa06c06d120 2023-10-07T08:49:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:29.620 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:49:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 140, 2023-10-07T08:49:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:49:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:49:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:49:28.284415+0000", 2023-10-07T08:49:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:49:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:49:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:49:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:49:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:49:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:49:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:49:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:49:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:49:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:49:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:49:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:49:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:49:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:49:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 17, 2023-10-07T08:49:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:49:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:49:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:49:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:49:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:49:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:49:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:49:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:49:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:49:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:49:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:49:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:49:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:49:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:49:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:49:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:49:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:49:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:49:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 16, 2023-10-07T08:49:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:49:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:49:12.162742+0000", 2023-10-07T08:49:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:49:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:49:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:49:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:49:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:49:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "137", 2023-10-07T08:49:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:49:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:49:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:49:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:49:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:49:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:49:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 17, 2023-10-07T08:49:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:49:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:49:12.805348+0000", 2023-10-07T08:49:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1027, 2023-10-07T08:49:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-07T08:49:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:49:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:49:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:49:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:49:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:49:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "140", 2023-10-07T08:49:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-07T08:49:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:49:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:49:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:49:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:49:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:49:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:49:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:49:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:49:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:49:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:49:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:49:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:49:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:49:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:49:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:49:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:49:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:49:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:49:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:49:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:49:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:49:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:49:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:49:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:49:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:49:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:49:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:49:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:49:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:49:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:49:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:49:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:49:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:49:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:49:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:49:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:49:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:49:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:49:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:49:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:49:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:49:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:49:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:49:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:49:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:49:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:49:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:49:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:49:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:49:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:49:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:49:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:49:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:49:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:49:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:49:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:49:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:49:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:49:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:49:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:49:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:49:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:49:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:49:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:49:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:49:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:49:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:49:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:49:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:49:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:49:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:49:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:49:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:49:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:49:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:49:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:49:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:49:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:49:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:49:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:49:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:49:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:49:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:49:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:49:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:49:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:49:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:49:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:49:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:49:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:49:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:49:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:49:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:49:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:49:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:49:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:49:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:49:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:49:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:49:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:49:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:49:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:49:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:49:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:49:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:49:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:49:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:49:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:49:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:49:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:49:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:49:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:49:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:49:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:49:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:49:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:49:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:49:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:49:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:49:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:49:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:49:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:49:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:49:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:49:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:49:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:49:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:49:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:49:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:49:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:49:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:49:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:49:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:49:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:49:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:49:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:49:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:49:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:49:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:49:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:49:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:49:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:49:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:49:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:49:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:49:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:49:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:49:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:49:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:49:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:49:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:29.706 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:49:29.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.620+0000 7fa071a54700 1 -- 172.21.15.81:0/3739187834 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa04c066f30 msgr2=0x7fa04c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:29.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.620+0000 7fa071a54700 1 --2- 172.21.15.81:0/3739187834 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa04c066f30 0x7fa04c0693e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa06c1580c0 tx=0x7fa054016000 comp rx=0 tx=0).stop 2023-10-07T08:49:29.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.620+0000 7fa071a54700 1 -- 172.21.15.81:0/3739187834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06c06d120 msgr2=0x7fa06c0b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:29.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.620+0000 7fa071a54700 1 --2- 172.21.15.81:0/3739187834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06c06d120 0x7fa06c0b4250 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00c790 tx=0x7fa05c007e10 comp rx=0 tx=0).stop 2023-10-07T08:49:29.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.620+0000 7fa071a54700 1 -- 172.21.15.81:0/3739187834 shutdown_connections 2023-10-07T08:49:29.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.620+0000 7fa071a54700 1 --2- 172.21.15.81:0/3739187834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa06c157ca0 0x7fa06c1409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:29.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.620+0000 7fa071a54700 1 --2- 172.21.15.81:0/3739187834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06c06d120 0x7fa06c0b4250 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:29.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.620+0000 7fa071a54700 1 --2- 172.21.15.81:0/3739187834 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa04c066f30 0x7fa04c0693e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:29.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.620+0000 7fa071a54700 1 --2- 172.21.15.81:0/3739187834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa06c1578d0 0x7fa06c158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:29.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.620+0000 7fa071a54700 1 -- 172.21.15.81:0/3739187834 >> 172.21.15.81:0/3739187834 conn(0x7fa06c06bb90 msgr2=0x7fa06c069110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.620+0000 7fa071a54700 1 -- 172.21.15.81:0/3739187834 shutdown_connections 2023-10-07T08:49:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:29.620+0000 7fa071a54700 1 -- 172.21.15.81:0/3739187834 wait complete. 2023-10-07T08:49:29.709 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-07T08:49:29.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:49:29.710 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-10-07T08:49:29.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:49:29.959 INFO:teuthology.orchestra.run.smithi081.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-07T08:49:29.959 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records in 2023-10-07T08:49:29.959 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records out 2023-10-07T08:49:29.959 INFO:teuthology.orchestra.run.smithi081.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.231208 s, 227 MB/s 2023-10-07T08:49:29.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:49:30.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.072+0000 7f48bdfa4700 1 Processor -- start 2023-10-07T08:49:30.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.072+0000 7f48bdfa4700 1 -- start start 2023-10-07T08:49:30.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.073+0000 7f48bdfa4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f48b8157fe0 0x7f48b80b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:30.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.073+0000 7f48bdfa4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f48b81583b0 0x7f48b80b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:30.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.073+0000 7f48bdfa4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b80b2890 con 0x7f48b80ceb30 2023-10-07T08:49:30.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.073+0000 7f48bdfa4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b80b4070 con 0x7f48b8157fe0 2023-10-07T08:49:30.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.073+0000 7f48bdfa4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b80b4350 con 0x7f48b81583b0 2023-10-07T08:49:30.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.073+0000 7f48b77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f48b8157fe0 0x7f48b80b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:30.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.073+0000 7f48b7fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f48b80ceb30 0x7f48b80cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47078/0 (socket says 172.21.15.81:47078) 2023-10-07T08:49:30.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.073+0000 7f48b7fff700 1 -- 172.21.15.81:0/3926803085 learned_addr learned my addr 172.21.15.81:0/3926803085 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:30.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.073+0000 7f48b6ffd700 1 --2- 172.21.15.81:0/3926803085 >> v2:172.21.15.89:3300/0 conn(0x7f48b81583b0 0x7f48b80b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:30.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48b77fe700 1 -- 172.21.15.81:0/3926803085 >> v2:172.21.15.89:3300/0 conn(0x7f48b81583b0 msgr2=0x7f48b80b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:30.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48b77fe700 1 --2- 172.21.15.81:0/3926803085 >> v2:172.21.15.89:3300/0 conn(0x7f48b81583b0 0x7f48b80b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48b77fe700 1 -- 172.21.15.81:0/3926803085 >> v1:172.21.15.81:6789/0 conn(0x7f48b80ceb30 legacy=0x7f48b80cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:30.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48b77fe700 1 -- 172.21.15.81:0/3926803085 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b80b4630 con 0x7f48b8157fe0 2023-10-07T08:49:30.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48b67fc700 1 -- 172.21.15.81:0/3926803085 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194725502 0 0) 0x7f48b80b2890 con 0x7f48b80ceb30 2023-10-07T08:49:30.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48b77fe700 1 --2- 172.21.15.81:0/3926803085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b8157fe0 0x7f48b80b34c0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f48b804c150 tx=0x7f48a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8531cc88fc118ec5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:30.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48b67fc700 1 -- 172.21.15.81:0/3926803085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a800e070 con 0x7f48b8157fe0 2023-10-07T08:49:30.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48b67fc700 1 -- 172.21.15.81:0/3926803085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a800bc30 con 0x7f48b8157fe0 2023-10-07T08:49:30.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48b67fc700 1 -- 172.21.15.81:0/3926803085 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a8012430 con 0x7f48b8157fe0 2023-10-07T08:49:30.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48bdfa4700 1 -- 172.21.15.81:0/3926803085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b8157fe0 msgr2=0x7f48b80b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:30.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48bdfa4700 1 --2- 172.21.15.81:0/3926803085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b8157fe0 0x7f48b80b34c0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f48b804c150 tx=0x7f48a8009780 comp rx=0 tx=0).stop 2023-10-07T08:49:30.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48bdfa4700 1 -- 172.21.15.81:0/3926803085 shutdown_connections 2023-10-07T08:49:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48bdfa4700 1 --2- 172.21.15.81:0/3926803085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b8157fe0 0x7f48b80b34c0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48bdfa4700 1 --2- 172.21.15.81:0/3926803085 >> v2:172.21.15.89:3300/0 conn(0x7f48b81583b0 0x7f48b80b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48bdfa4700 1 -- 172.21.15.81:0/3926803085 >> 172.21.15.81:0/3926803085 conn(0x7f48b8067640 msgr2=0x7f48b8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48bdfa4700 1 -- 172.21.15.81:0/3926803085 shutdown_connections 2023-10-07T08:49:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.074+0000 7f48bdfa4700 1 -- 172.21.15.81:0/3926803085 wait complete. 2023-10-07T08:49:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.076+0000 7f48bdfa4700 1 Processor -- start 2023-10-07T08:49:30.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.076+0000 7f48bdfa4700 1 -- start start 2023-10-07T08:49:30.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.076+0000 7f48bdfa4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48b80ceb30 0x7f48b8146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:30.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.076+0000 7f48bdfa4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b8157fe0 0x7f48b815b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:30.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.076+0000 7f48bdfa4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48b81583b0 0x7f48b815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:30.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.076+0000 7f48bdfa4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b815a7c0 con 0x7f48b8157fe0 2023-10-07T08:49:30.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.076+0000 7f48bdfa4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b8159c40 con 0x7f48b81583b0 2023-10-07T08:49:30.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.076+0000 7f48bdfa4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b8159f20 con 0x7f48b80ceb30 2023-10-07T08:49:30.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.076+0000 7f48b6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b8157fe0 0x7f48b815b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:30.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.077+0000 7f48b6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b8157fe0 0x7f48b815b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56256/0 (socket says 172.21.15.81:56256) 2023-10-07T08:49:30.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.077+0000 7f48b6ffd700 1 -- 172.21.15.81:0/3710127730 learned_addr learned my addr 172.21.15.81:0/3710127730 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:30.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.077+0000 7f48b7fff700 1 --2- 172.21.15.81:0/3710127730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48b81583b0 0x7f48b815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:30.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.077+0000 7f48b77fe700 1 --2- 172.21.15.81:0/3710127730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48b80ceb30 0x7f48b8146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:30.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.077+0000 7f48b6ffd700 1 -- 172.21.15.81:0/3710127730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48b80ceb30 msgr2=0x7f48b8146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:30.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.077+0000 7f48b6ffd700 1 --2- 172.21.15.81:0/3710127730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48b80ceb30 0x7f48b8146730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.077+0000 7f48b6ffd700 1 -- 172.21.15.81:0/3710127730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48b81583b0 msgr2=0x7f48b815ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:30.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.077+0000 7f48b6ffd700 1 --2- 172.21.15.81:0/3710127730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48b81583b0 0x7f48b815ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.077+0000 7f48b6ffd700 1 -- 172.21.15.81:0/3710127730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a8009a20 con 0x7f48b8157fe0 2023-10-07T08:49:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.077+0000 7f48b77fe700 1 --2- 172.21.15.81:0/3710127730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48b80ceb30 0x7f48b8146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.077+0000 7f48b6ffd700 1 --2- 172.21.15.81:0/3710127730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b8157fe0 0x7f48b815b160 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00d890 tx=0x7f48ac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.077+0000 7f489f7fe700 1 -- 172.21.15.81:0/3710127730 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00b600 con 0x7f48b8157fe0 2023-10-07T08:49:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.077+0000 7f489f7fe700 1 -- 172.21.15.81:0/3710127730 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac00b760 con 0x7f48b8157fe0 2023-10-07T08:49:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.077+0000 7f48bdfa4700 1 -- 172.21.15.81:0/3710127730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b815a200 con 0x7f48b8157fe0 2023-10-07T08:49:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.077+0000 7f489f7fe700 1 -- 172.21.15.81:0/3710127730 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00bae0 con 0x7f48b8157fe0 2023-10-07T08:49:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.077+0000 7f48bdfa4700 1 -- 172.21.15.81:0/3710127730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b8146c70 con 0x7f48b8157fe0 2023-10-07T08:49:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.078+0000 7f48bdfa4700 1 -- 172.21.15.81:0/3710127730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b80c97d0 con 0x7f48b8157fe0 2023-10-07T08:49:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.078+0000 7f489f7fe700 1 -- 172.21.15.81:0/3710127730 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48ac01e460 con 0x7f48b8157fe0 2023-10-07T08:49:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.079+0000 7f489f7fe700 1 --2- 172.21.15.81:0/3710127730 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48a4066f30 0x7f48a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:30.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.079+0000 7f489f7fe700 1 -- 172.21.15.81:0/3710127730 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f48ac084c10 con 0x7f48b8157fe0 2023-10-07T08:49:30.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.079+0000 7f48b77fe700 1 --2- 172.21.15.81:0/3710127730 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48a4066f30 0x7f48a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:30.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.079+0000 7f489f7fe700 1 -- 172.21.15.81:0/3710127730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7f48a406ea50 con 0x7f48b8157fe0 2023-10-07T08:49:30.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.079+0000 7f48b77fe700 1 --2- 172.21.15.81:0/3710127730 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48a4066f30 0x7f48a40693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f48b804c150 tx=0x7f48a8019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:30.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.083+0000 7f489f7fe700 1 -- 172.21.15.81:0/3710127730 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48ac051e80 con 0x7f48b8157fe0 2023-10-07T08:49:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.264+0000 7f48bdfa4700 1 -- 172.21.15.81:0/3710127730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f48b80c95f0 con 0x7f48b8157fe0 2023-10-07T08:49:30.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.265+0000 7f489f7fe700 1 -- 172.21.15.81:0/3710127730 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) v1 ==== 81+0+32253 (secure 0 0 0) 0x7f48ac0554a0 con 0x7f48b8157fe0 2023-10-07T08:49:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:30.267 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:49:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 140, 2023-10-07T08:49:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:49:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:49:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:49:28.284415+0000", 2023-10-07T08:49:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:49:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:49:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:49:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:49:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:49:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:49:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:49:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:49:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:49:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:49:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:49:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:49:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:49:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:49:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 17, 2023-10-07T08:49:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:49:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:49:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:49:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:49:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:49:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:49:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:49:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:49:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:49:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:49:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:49:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:49:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:49:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:49:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:49:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:49:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:49:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:49:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 16, 2023-10-07T08:49:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:49:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:49:12.162742+0000", 2023-10-07T08:49:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:49:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:49:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:49:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:49:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:49:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "137", 2023-10-07T08:49:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:49:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:49:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:49:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:49:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:49:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:49:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 17, 2023-10-07T08:49:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:49:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:49:12.805348+0000", 2023-10-07T08:49:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1027, 2023-10-07T08:49:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-07T08:49:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:49:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:49:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:49:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:49:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:49:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "140", 2023-10-07T08:49:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-07T08:49:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:49:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:49:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:49:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:49:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:49:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:49:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:49:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:49:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:49:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:49:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:49:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:49:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:49:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:49:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:49:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:49:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:49:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:49:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:49:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:49:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:49:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:49:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:49:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:49:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:49:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:49:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:49:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:49:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:49:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:49:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:49:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:49:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:49:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:49:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:49:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:49:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:49:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:49:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:49:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:49:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:49:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:49:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:49:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:49:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:49:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:49:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:49:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:49:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:49:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:49:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:49:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:49:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:49:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:49:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:49:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:49:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:49:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:49:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:49:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:49:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:49:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:49:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:49:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:49:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:49:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:49:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:49:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:49:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:49:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:49:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:49:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:49:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:49:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:49:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:49:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:49:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:49:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:49:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:49:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:49:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:49:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:49:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:49:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:49:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:49:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:49:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:49:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:49:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:49:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:49:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:49:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:49:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:49:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:49:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:49:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:49:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:49:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:49:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:49:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:49:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:49:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:49:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:49:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:49:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:49:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:49:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:49:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:49:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:49:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:49:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:49:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:49:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:49:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:49:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:49:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:49:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:49:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:49:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:49:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:49:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:49:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:49:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:49:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:49:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:49:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:49:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:49:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:49:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:49:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:49:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:49:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:49:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:49:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:49:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:49:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:49:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:49:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:49:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:49:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:49:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:49:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:49:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:49:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:49:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:49:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:49:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:49:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:49:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:49:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:49:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:30.368 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:49:30.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.267+0000 7f48bdfa4700 1 -- 172.21.15.81:0/3710127730 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48a4066f30 msgr2=0x7f48a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:30.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.267+0000 7f48bdfa4700 1 --2- 172.21.15.81:0/3710127730 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48a4066f30 0x7f48a40693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f48b804c150 tx=0x7f48a8019000 comp rx=0 tx=0).stop 2023-10-07T08:49:30.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.267+0000 7f48bdfa4700 1 -- 172.21.15.81:0/3710127730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b8157fe0 msgr2=0x7f48b815b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:30.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.267+0000 7f48bdfa4700 1 --2- 172.21.15.81:0/3710127730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b8157fe0 0x7f48b815b160 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00d890 tx=0x7f48ac008040 comp rx=0 tx=0).stop 2023-10-07T08:49:30.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.267+0000 7f48bdfa4700 1 -- 172.21.15.81:0/3710127730 shutdown_connections 2023-10-07T08:49:30.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.267+0000 7f48bdfa4700 1 --2- 172.21.15.81:0/3710127730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48b81583b0 0x7f48b815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.267+0000 7f48bdfa4700 1 --2- 172.21.15.81:0/3710127730 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48a4066f30 0x7f48a40693e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.267+0000 7f48bdfa4700 1 --2- 172.21.15.81:0/3710127730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48b80ceb30 0x7f48b8146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.267+0000 7f48bdfa4700 1 --2- 172.21.15.81:0/3710127730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b8157fe0 0x7f48b815b160 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.267+0000 7f48bdfa4700 1 -- 172.21.15.81:0/3710127730 >> 172.21.15.81:0/3710127730 conn(0x7f48b8067640 msgr2=0x7f48b80cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:30.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.267+0000 7f48bdfa4700 1 -- 172.21.15.81:0/3710127730 shutdown_connections 2023-10-07T08:49:30.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.267+0000 7f48bdfa4700 1 -- 172.21.15.81:0/3710127730 wait complete. 2023-10-07T08:49:30.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:49:30.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.489+0000 7f839994a700 1 Processor -- start 2023-10-07T08:49:30.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.489+0000 7f839994a700 1 -- start start 2023-10-07T08:49:30.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.489+0000 7f839994a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f839406c190 0x7f83940b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:30.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.489+0000 7f839994a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83940b35d0 con 0x7f8394157a60 2023-10-07T08:49:30.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.489+0000 7f839994a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8394069d10 con 0x7f83940b3170 2023-10-07T08:49:30.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.489+0000 7f839994a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839415c130 con 0x7f839406c190 2023-10-07T08:49:30.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.489+0000 7f8392ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8394157a60 0x7f839415b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47080/0 (socket says 172.21.15.81:47080) 2023-10-07T08:49:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.489+0000 7f8392ffd700 1 -- 172.21.15.81:0/29946828 learned_addr learned my addr 172.21.15.81:0/29946828 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f83927fc700 1 -- 172.21.15.81:0/29946828 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153253535 0 0) 0x7f8384001110 con 0x7f8394157a60 2023-10-07T08:49:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f83927fc700 1 -- 172.21.15.81:0/29946828 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8380003570 con 0x7f8394157a60 2023-10-07T08:49:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f838bfff700 1 --2- 172.21.15.81:0/29946828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f839406c190 0x7f83940b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f83927fc700 1 -- 172.21.15.81:0/29946828 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1353258548 0 0) 0x7f8380003570 con 0x7f8394157a60 2023-10-07T08:49:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f83927fc700 1 -- 172.21.15.81:0/29946828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f839406c190 msgr2=0x7f83940b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f83927fc700 1 --2- 172.21.15.81:0/29946828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f839406c190 0x7f83940b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f83927fc700 1 -- 172.21.15.81:0/29946828 >> v1:172.21.15.89:6789/0 conn(0x7f83940b3170 legacy=0x7f839406a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f83927fc700 1 -- 172.21.15.81:0/29946828 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839415c410 con 0x7f8394157a60 2023-10-07T08:49:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f83927fc700 1 -- 172.21.15.81:0/29946828 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f8384001600 con 0x7f8394157a60 2023-10-07T08:49:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f83927fc700 1 -- 172.21.15.81:0/29946828 >> v1:172.21.15.81:6789/0 conn(0x7f8394157a60 legacy=0x7f839415b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:30.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f83927fc700 1 --2- 172.21.15.81:0/29946828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8380003a90 0x7f8380003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:30.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f83927fc700 1 --2- 172.21.15.81:0/29946828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8380004810 0x7f8380004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:30.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f83927fc700 1 --2- 172.21.15.81:0/29946828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f839406c190 0x7f83800051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:30.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f83927fc700 1 -- 172.21.15.81:0/29946828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839415c130 con 0x7f8380004810 2023-10-07T08:49:30.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f83927fc700 1 -- 172.21.15.81:0/29946828 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838000bb60 con 0x7f8380003a90 2023-10-07T08:49:30.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f83927fc700 1 -- 172.21.15.81:0/29946828 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838000bd20 con 0x7f839406c190 2023-10-07T08:49:30.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f838bfff700 1 --2- 172.21.15.81:0/29946828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8380004810 0x7f8380004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:30.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f8392ffd700 1 --2- 172.21.15.81:0/29946828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8380003a90 0x7f8380003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:30.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f83937fe700 1 --2- 172.21.15.81:0/29946828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f839406c190 0x7f83800051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:30.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f838bfff700 1 -- 172.21.15.81:0/29946828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f839406c190 msgr2=0x7f83800051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:30.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f838bfff700 1 --2- 172.21.15.81:0/29946828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f839406c190 0x7f83800051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f838bfff700 1 -- 172.21.15.81:0/29946828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8380003a90 msgr2=0x7f8380003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:30.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f838bfff700 1 --2- 172.21.15.81:0/29946828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8380003a90 0x7f8380003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.490+0000 7f838bfff700 1 -- 172.21.15.81:0/29946828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8380003570 con 0x7f8380004810 2023-10-07T08:49:30.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.491+0000 7f838bfff700 1 --2- 172.21.15.81:0/29946828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8380004810 0x7f8380004c80 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f837c009c00 tx=0x7f837c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8560baea0d9e19ff server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:30.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.491+0000 7f83927fc700 1 -- 172.21.15.81:0/29946828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c00e710 con 0x7f8380004810 2023-10-07T08:49:30.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.491+0000 7f83927fc700 1 -- 172.21.15.81:0/29946828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c00e870 con 0x7f8380004810 2023-10-07T08:49:30.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.491+0000 7f83927fc700 1 -- 172.21.15.81:0/29946828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c00ec30 con 0x7f8380004810 2023-10-07T08:49:30.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.491+0000 7f839994a700 1 -- 172.21.15.81:0/29946828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8380004810 msgr2=0x7f8380004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:30.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.491+0000 7f839994a700 1 --2- 172.21.15.81:0/29946828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8380004810 0x7f8380004c80 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f837c009c00 tx=0x7f837c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.491+0000 7f83937fe700 1 -- 172.21.15.81:0/29946828 reap_dead start 2023-10-07T08:49:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.491+0000 7f839994a700 1 -- 172.21.15.81:0/29946828 shutdown_connections 2023-10-07T08:49:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.491+0000 7f839994a700 1 -- 172.21.15.81:0/29946828 >> 172.21.15.81:0/29946828 conn(0x7f839406cca0 msgr2=0x7f839406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.491+0000 7f839994a700 1 -- 172.21.15.81:0/29946828 shutdown_connections 2023-10-07T08:49:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.491+0000 7f839994a700 1 -- 172.21.15.81:0/29946828 wait complete. 2023-10-07T08:49:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.492+0000 7f839994a700 1 Processor -- start 2023-10-07T08:49:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.492+0000 7f839994a700 1 -- start start 2023-10-07T08:49:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.493+0000 7f839994a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8380004810 0x7f839414b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.493+0000 7f839994a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839414eb60 0x7f839414efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.493+0000 7f839994a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83940cc820 0x7f83940ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.493+0000 7f839994a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839414f510 con 0x7f839414eb60 2023-10-07T08:49:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.493+0000 7f839994a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839414c790 con 0x7f83940cc820 2023-10-07T08:49:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.493+0000 7f839994a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83940cd5a0 con 0x7f8380004810 2023-10-07T08:49:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.493+0000 7f838bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839414eb60 0x7f839414efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.493+0000 7f838bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839414eb60 0x7f839414efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56282/0 (socket says 172.21.15.81:56282) 2023-10-07T08:49:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.493+0000 7f838bfff700 1 -- 172.21.15.81:0/1711093625 learned_addr learned my addr 172.21.15.81:0/1711093625 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.493+0000 7f83937fe700 1 --2- 172.21.15.81:0/1711093625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83940cc820 0x7f83940ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.493+0000 7f8392ffd700 1 --2- 172.21.15.81:0/1711093625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8380004810 0x7f839414b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.493+0000 7f838bfff700 1 -- 172.21.15.81:0/1711093625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8380004810 msgr2=0x7f839414b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.493+0000 7f838bfff700 1 --2- 172.21.15.81:0/1711093625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8380004810 0x7f839414b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.493+0000 7f838bfff700 1 -- 172.21.15.81:0/1711093625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83940cc820 msgr2=0x7f83940ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.494+0000 7f838bfff700 1 --2- 172.21.15.81:0/1711093625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83940cc820 0x7f83940ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.494+0000 7f838bfff700 1 -- 172.21.15.81:0/1711093625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83940cd880 con 0x7f839414eb60 2023-10-07T08:49:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.494+0000 7f838bfff700 1 --2- 172.21.15.81:0/1711093625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839414eb60 0x7f839414efd0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f838000bb30 tx=0x7f837c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.494+0000 7f838affd700 1 -- 172.21.15.81:0/1711093625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c022070 con 0x7f839414eb60 2023-10-07T08:49:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.494+0000 7f838affd700 1 -- 172.21.15.81:0/1711093625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c00e9e0 con 0x7f839414eb60 2023-10-07T08:49:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.494+0000 7f839994a700 1 -- 172.21.15.81:0/1711093625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839414c420 con 0x7f839414eb60 2023-10-07T08:49:30.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.494+0000 7f838affd700 1 -- 172.21.15.81:0/1711093625 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c01c450 con 0x7f839414eb60 2023-10-07T08:49:30.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.494+0000 7f839994a700 1 -- 172.21.15.81:0/1711093625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83940cd1d0 con 0x7f839414eb60 2023-10-07T08:49:30.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.495+0000 7f839994a700 1 -- 172.21.15.81:0/1711093625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839414c900 con 0x7f839414eb60 2023-10-07T08:49:30.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.495+0000 7f838affd700 1 -- 172.21.15.81:0/1711093625 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f837c01c860 con 0x7f839414eb60 2023-10-07T08:49:30.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.496+0000 7f838affd700 1 --2- 172.21.15.81:0/1711093625 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8374066f30 0x7f83740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:30.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.496+0000 7f838affd700 1 -- 172.21.15.81:0/1711093625 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f837c085c30 con 0x7f839414eb60 2023-10-07T08:49:30.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.496+0000 7f8392ffd700 1 --2- 172.21.15.81:0/1711093625 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8374066f30 0x7f83740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:30.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.496+0000 7f838affd700 1 -- 172.21.15.81:0/1711093625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7f837406ea50 con 0x7f839414eb60 2023-10-07T08:49:30.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.496+0000 7f8392ffd700 1 --2- 172.21.15.81:0/1711093625 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8374066f30 0x7f83740693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f83840012b0 tx=0x7f8384007a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:30.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.500+0000 7f838affd700 1 -- 172.21.15.81:0/1711093625 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f837c02b060 con 0x7f839414eb60 2023-10-07T08:49:30.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.726+0000 7f839994a700 1 -- 172.21.15.81:0/1711093625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f839415c6f0 con 0x7f839414eb60 2023-10-07T08:49:30.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.726+0000 7f838affd700 1 -- 172.21.15.81:0/1711093625 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f837c02b030 con 0x7f839414eb60 2023-10-07T08:49:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:30.728 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1795695306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1795695306},{"type":"v1","addr":"172.21.15.89:6834","nonce":1795695306}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3856313795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3856313795},{"type":"v1","addr":"172.21.15.89:6835","nonce":3856313795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7119,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4143803144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4143803144},{"type":"v1","addr":"172.21.15.81:6836","nonce":4143803144}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:49:13.845110+0000","modified":"2023-10-07T08:49:17.485796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3151244734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3151244734},{"type":"v1","addr":"172.21.15.81:6837","nonce":3151244734}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-07T08:49:30.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.728+0000 7f839994a700 1 -- 172.21.15.81:0/1711093625 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8374066f30 msgr2=0x7f83740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:30.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.728+0000 7f839994a700 1 --2- 172.21.15.81:0/1711093625 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8374066f30 0x7f83740693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f83840012b0 tx=0x7f8384007a50 comp rx=0 tx=0).stop 2023-10-07T08:49:30.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.728+0000 7f839994a700 1 -- 172.21.15.81:0/1711093625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839414eb60 msgr2=0x7f839414efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:30.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.728+0000 7f839994a700 1 --2- 172.21.15.81:0/1711093625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839414eb60 0x7f839414efd0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f838000bb30 tx=0x7f837c01a000 comp rx=0 tx=0).stop 2023-10-07T08:49:30.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.728+0000 7f839994a700 1 -- 172.21.15.81:0/1711093625 shutdown_connections 2023-10-07T08:49:30.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.728+0000 7f839994a700 1 --2- 172.21.15.81:0/1711093625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83940cc820 0x7f83940ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.728+0000 7f839994a700 1 --2- 172.21.15.81:0/1711093625 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8374066f30 0x7f83740693e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.728+0000 7f839994a700 1 --2- 172.21.15.81:0/1711093625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8380004810 0x7f839414b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.728+0000 7f839994a700 1 --2- 172.21.15.81:0/1711093625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839414eb60 0x7f839414efd0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:30.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.728+0000 7f839994a700 1 -- 172.21.15.81:0/1711093625 >> 172.21.15.81:0/1711093625 conn(0x7f839406cca0 msgr2=0x7f8394153390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:30.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.728+0000 7f839994a700 1 -- 172.21.15.81:0/1711093625 shutdown_connections 2023-10-07T08:49:30.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:30.728+0000 7f839994a700 1 -- 172.21.15.81:0/1711093625 wait complete. 2023-10-07T08:49:30.731 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2023-10-07T08:49:30.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-07T08:49:30.874 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":7122,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":16.391212398,"mdsmap_epoch":66,"osdmap_epoch":140,"osdmap_epoch_barrier":140,"uptime":21.523761672999999} 2023-10-07T08:49:30.875 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 7122, "mdsmap_epoch": 66, "osdmap_epoch": 140, "osdmap_epoch_barrier": 140, "rank_uptime": 16.391212398, "state": "up:active", "uptime": 21.523761673, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:49:30.875 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-07T08:49:30.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:49:30.876 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-07T08:49:30.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:49:30.892 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-07T08:49:30.950 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:49:31.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.103+0000 7f7280e64700 1 Processor -- start 2023-10-07T08:49:31.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.103+0000 7f7280e64700 1 -- start start 2023-10-07T08:49:31.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.103+0000 7f7280e64700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f727c157ca0 0x7f727c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:31.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.103+0000 7f7280e64700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727c0d07c0 con 0x7f727c1578d0 2023-10-07T08:49:31.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.103+0000 7f7280e64700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727c0cfbb0 con 0x7f727c06d120 2023-10-07T08:49:31.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.103+0000 7f7280e64700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c0cfe90 con 0x7f727c157ca0 2023-10-07T08:49:31.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.104+0000 7f7271d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f727c157ca0 0x7f727c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:31.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.104+0000 7f727a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f727c1578d0 0x7f727c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47092/0 (socket says 172.21.15.81:47092) 2023-10-07T08:49:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.104+0000 7f727a59c700 1 -- 172.21.15.81:0/3087341564 learned_addr learned my addr 172.21.15.81:0/3087341564 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.104+0000 7f7271d9b700 1 -- 172.21.15.81:0/3087341564 >> v1:172.21.15.89:6789/0 conn(0x7f727c06d120 legacy=0x7f727c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.104+0000 7f7271d9b700 1 -- 172.21.15.81:0/3087341564 >> v1:172.21.15.81:6789/0 conn(0x7f727c1578d0 legacy=0x7f727c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.104+0000 7f7271d9b700 1 -- 172.21.15.81:0/3087341564 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c0d0170 con 0x7f727c157ca0 2023-10-07T08:49:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.104+0000 7f7279d9b700 1 -- 172.21.15.81:0/3087341564 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681560231 0 0) 0x7f727c0d07c0 con 0x7f727c1578d0 2023-10-07T08:49:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.104+0000 7f7271d9b700 1 --2- 172.21.15.81:0/3087341564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f727c157ca0 0x7f727c0cf4f0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f72640098e0 tx=0x7f72640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8d68f43195d52b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.104+0000 7f7279d9b700 1 -- 172.21.15.81:0/3087341564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264009e80 con 0x7f727c157ca0 2023-10-07T08:49:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.104+0000 7f7279d9b700 1 -- 172.21.15.81:0/3087341564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726400b820 con 0x7f727c157ca0 2023-10-07T08:49:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.104+0000 7f7279d9b700 1 -- 172.21.15.81:0/3087341564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726400bba0 con 0x7f727c157ca0 2023-10-07T08:49:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.105+0000 7f7280e64700 1 -- 172.21.15.81:0/3087341564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f727c157ca0 msgr2=0x7f727c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.105+0000 7f7280e64700 1 --2- 172.21.15.81:0/3087341564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f727c157ca0 0x7f727c0cf4f0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f72640098e0 tx=0x7f72640091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:31.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.105+0000 7f7280e64700 1 -- 172.21.15.81:0/3087341564 shutdown_connections 2023-10-07T08:49:31.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.105+0000 7f7280e64700 1 --2- 172.21.15.81:0/3087341564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f727c157ca0 0x7f727c0cf4f0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:31.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.105+0000 7f7280e64700 1 -- 172.21.15.81:0/3087341564 >> 172.21.15.81:0/3087341564 conn(0x7f727c06bb90 msgr2=0x7f727c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:31.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.105+0000 7f7280e64700 1 -- 172.21.15.81:0/3087341564 shutdown_connections 2023-10-07T08:49:31.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.105+0000 7f7280e64700 1 -- 172.21.15.81:0/3087341564 wait complete. 2023-10-07T08:49:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.106+0000 7f7280e64700 1 Processor -- start 2023-10-07T08:49:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.106+0000 7f7280e64700 1 -- start start 2023-10-07T08:49:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7280e64700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f727c06d120 0x7f727c154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7280e64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f727c1578d0 0x7f727c16b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7280e64700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f727c157ca0 0x7f727c1590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7280e64700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c155150 con 0x7f727c1578d0 2023-10-07T08:49:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7280e64700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0ac420 con 0x7f727c06d120 2023-10-07T08:49:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7280e64700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c16b7b0 con 0x7f727c157ca0 2023-10-07T08:49:31.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7271d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f727c1578d0 0x7f727c16b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:31.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7271d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f727c1578d0 0x7f727c16b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56302/0 (socket says 172.21.15.81:56302) 2023-10-07T08:49:31.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7271d9b700 1 -- 172.21.15.81:0/1939393655 learned_addr learned my addr 172.21.15.81:0/1939393655 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:31.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f727a59c700 1 --2- 172.21.15.81:0/1939393655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f727c06d120 0x7f727c154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:31.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7271d9b700 1 -- 172.21.15.81:0/1939393655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f727c157ca0 msgr2=0x7f727c1590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:31.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7271d9b700 1 --2- 172.21.15.81:0/1939393655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f727c157ca0 0x7f727c1590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:31.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7271d9b700 1 -- 172.21.15.81:0/1939393655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f727c06d120 msgr2=0x7f727c154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:31.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7271d9b700 1 --2- 172.21.15.81:0/1939393655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f727c06d120 0x7f727c154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:31.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7271d9b700 1 -- 172.21.15.81:0/1939393655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264009420 con 0x7f727c1578d0 2023-10-07T08:49:31.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f727a59c700 1 --2- 172.21.15.81:0/1939393655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f727c06d120 0x7f727c154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:31.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7271d9b700 1 --2- 172.21.15.81:0/1939393655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f727c1578d0 0x7f727c16b9e0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f72640030c0 tx=0x7f7264016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:31.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7272ffd700 1 -- 172.21.15.81:0/1939393655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726400bae0 con 0x7f727c1578d0 2023-10-07T08:49:31.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7272ffd700 1 -- 172.21.15.81:0/1939393655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7264020070 con 0x7f727c1578d0 2023-10-07T08:49:31.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7272ffd700 1 -- 172.21.15.81:0/1939393655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726401b6a0 con 0x7f727c1578d0 2023-10-07T08:49:31.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7280e64700 1 -- 172.21.15.81:0/1939393655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727c0abaf0 con 0x7f727c1578d0 2023-10-07T08:49:31.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.107+0000 7f7280e64700 1 -- 172.21.15.81:0/1939393655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c0ac0b0 con 0x7f727c1578d0 2023-10-07T08:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.108+0000 7f7280e64700 1 -- 172.21.15.81:0/1939393655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727c0ac5d0 con 0x7f727c1578d0 2023-10-07T08:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.109+0000 7f7272ffd700 1 -- 172.21.15.81:0/1939393655 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7264022030 con 0x7f727c1578d0 2023-10-07T08:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.109+0000 7f7272ffd700 1 --2- 172.21.15.81:0/1939393655 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f725c066f30 0x7f725c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.109+0000 7f727a59c700 1 --2- 172.21.15.81:0/1939393655 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f725c066f30 0x7f725c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.109+0000 7f7272ffd700 1 -- 172.21.15.81:0/1939393655 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7264086410 con 0x7f727c1578d0 2023-10-07T08:49:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.109+0000 7f7272ffd700 1 -- 172.21.15.81:0/1939393655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7f725c06ea50 con 0x7f727c1578d0 2023-10-07T08:49:31.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.110+0000 7f727a59c700 1 --2- 172.21.15.81:0/1939393655 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f725c066f30 0x7f725c0693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f726c0018d0 tx=0x7f726c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:31.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.113+0000 7f7272ffd700 1 -- 172.21.15.81:0/1939393655 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f727c0ac5d0 con 0x7f727c1578d0 2023-10-07T08:49:31.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.298+0000 7f7280e64700 1 -- 172.21.15.81:0/1939393655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f727c15a180 con 0x7f727c1578d0 2023-10-07T08:49:31.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.299+0000 7f7272ffd700 1 -- 172.21.15.81:0/1939393655 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) v1 ==== 81+0+32253 (secure 0 0 0) 0x7f7264053680 con 0x7f727c1578d0 2023-10-07T08:49:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:31.301 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:49:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 140, 2023-10-07T08:49:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:49:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:49:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:49:28.284415+0000", 2023-10-07T08:49:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:49:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:49:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:49:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:49:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:49:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:49:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:49:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:49:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:49:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:49:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:49:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:49:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:49:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:49:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 17, 2023-10-07T08:49:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:49:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:49:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:49:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:49:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:49:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:49:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:49:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:49:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:49:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:49:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:49:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:49:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:49:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:49:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:49:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:31.308 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:49:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:49:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:49:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.310 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 16, 2023-10-07T08:49:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:49:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:49:12.162742+0000", 2023-10-07T08:49:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:31.311 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:49:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:49:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:49:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:49:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:49:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:31.312 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "137", 2023-10-07T08:49:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:31.313 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:49:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:31.314 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:31.315 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:49:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:49:31.316 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:49:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:49:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:49:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 17, 2023-10-07T08:49:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:49:31.317 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:49:12.805348+0000", 2023-10-07T08:49:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1027, 2023-10-07T08:49:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-07T08:49:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:31.318 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:49:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:49:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:49:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:49:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:49:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:31.319 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "140", 2023-10-07T08:49:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-07T08:49:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:31.321 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:31.322 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:31.323 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:49:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:49:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:49:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:49:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:31.324 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:49:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:49:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:31.325 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:49:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:49:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:49:31.327 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:49:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:49:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:49:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:31.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:49:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:49:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:49:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:49:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:49:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:49:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:49:31.331 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:31.332 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:49:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:49:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.333 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:49:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:49:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.334 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:49:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:49:31.335 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:49:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.336 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:49:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:49:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:49:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:49:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:49:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:31.337 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:49:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:31.338 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:49:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:49:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:49:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:49:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.341 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:49:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.342 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:49:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:49:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:31.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:49:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:49:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:49:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:49:31.344 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:49:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:49:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:31.345 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:49:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:49:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:49:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:49:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:31.348 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:49:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:49:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:49:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:49:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:31.350 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:49:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:49:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:49:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:49:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.351 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:49:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:31.352 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:49:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:49:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.353 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:49:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:49:31.354 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:49:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:49:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.356 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:49:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:49:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:49:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:49:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:49:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:49:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:49:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:31.361 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:49:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:49:31.362 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:49:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:49:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:49:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:31.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:49:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:49:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:49:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:49:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:49:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:49:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:49:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:49:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:31.367 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.368 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:49:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:49:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:49:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:49:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:49:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:49:31.371 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:49:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:49:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:49:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:49:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:49:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:49:31.373 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:49:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:31.374 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.375 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:49:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:49:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.377 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:31.377 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.377 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.377 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:49:31.377 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:49:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:49:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:49:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:49:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:31.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:49:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:49:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:49:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:49:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:49:31.381 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:49:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:49:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:31.382 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:49:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:49:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:49:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:49:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:31.384 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:49:31.385 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:31.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.386 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:49:31.386 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:31.386 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:31.386 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:31.386 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:31.386 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:31.386 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:49:31.386 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:31.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.387 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:49:31.387 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:31.387 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:31.387 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:31.387 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:31.387 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:31.387 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:49:31.387 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:31.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.387 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:49:31.388 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:31.388 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:31.388 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:31.388 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:31.388 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:31.388 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:49:31.388 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:31.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.388 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:49:31.388 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:31.389 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:31.389 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:31.389 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:31.389 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:31.389 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:49:31.389 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:31.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:31.389 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:49:31.389 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:31.389 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:31.390 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:31.390 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:31.390 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:31.390 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:49:31.390 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:31.390 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.391 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:31.391 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:49:31.391 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:49:31.391 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:49:31.391 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:49:31.391 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:49:31.391 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:49:31.391 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:49:31.391 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:49:31.391 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:49:31.391 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:49:31.392 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:49:31.392 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:49:31.392 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:49:31.392 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:31.392 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:49:31.392 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:49:31.392 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:49:31.392 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:49:31.392 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:49:31.392 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:49:31.392 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:49:31.393 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:49:31.393 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:49:31.393 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:49:31.393 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:49:31.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:31.393 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:49:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.301+0000 7f7280e64700 1 -- 172.21.15.81:0/1939393655 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f725c066f30 msgr2=0x7f725c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.301+0000 7f7280e64700 1 --2- 172.21.15.81:0/1939393655 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f725c066f30 0x7f725c0693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f726c0018d0 tx=0x7f726c009040 comp rx=0 tx=0).stop 2023-10-07T08:49:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.301+0000 7f7280e64700 1 -- 172.21.15.81:0/1939393655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f727c1578d0 msgr2=0x7f727c16b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.301+0000 7f7280e64700 1 --2- 172.21.15.81:0/1939393655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f727c1578d0 0x7f727c16b9e0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f72640030c0 tx=0x7f7264016000 comp rx=0 tx=0).stop 2023-10-07T08:49:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.302+0000 7f7280e64700 1 -- 172.21.15.81:0/1939393655 shutdown_connections 2023-10-07T08:49:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.302+0000 7f7280e64700 1 --2- 172.21.15.81:0/1939393655 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f725c066f30 0x7f725c0693e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.302+0000 7f7280e64700 1 --2- 172.21.15.81:0/1939393655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f727c157ca0 0x7f727c1590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.302+0000 7f7280e64700 1 --2- 172.21.15.81:0/1939393655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f727c06d120 0x7f727c154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:31.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.302+0000 7f7280e64700 1 --2- 172.21.15.81:0/1939393655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f727c1578d0 0x7f727c16b9e0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:31.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.302+0000 7f7280e64700 1 -- 172.21.15.81:0/1939393655 >> 172.21.15.81:0/1939393655 conn(0x7f727c06bb90 msgr2=0x7f727c069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:31.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.302+0000 7f7280e64700 1 -- 172.21.15.81:0/1939393655 shutdown_connections 2023-10-07T08:49:31.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:31.302+0000 7f7280e64700 1 -- 172.21.15.81:0/1939393655 wait complete. 2023-10-07T08:49:31.396 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-07T08:49:36.398 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:49:36.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.526+0000 7f54ca556700 1 Processor -- start 2023-10-07T08:49:36.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.526+0000 7f54ca556700 1 -- start start 2023-10-07T08:49:36.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54ca556700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f54c41578d0 0x7f54c40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54ca556700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40d07c0 con 0x7f54c406d120 2023-10-07T08:49:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54ca556700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40cfbb0 con 0x7f54c4157ca0 2023-10-07T08:49:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54ca556700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40cfe90 con 0x7f54c41578d0 2023-10-07T08:49:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c8af3700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f54c406d120 0x7f54c406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55660/0 (socket says 172.21.15.81:55660) 2023-10-07T08:49:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c8af3700 1 -- 172.21.15.81:0/2020584637 learned_addr learned my addr 172.21.15.81:0/2020584637 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c3fff700 1 --2- 172.21.15.81:0/2020584637 >> v2:172.21.15.89:3300/0 conn(0x7f54c41578d0 0x7f54c40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c2ffd700 1 -- 172.21.15.81:0/2020584637 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205697898 0 0) 0x7f54c40d07c0 con 0x7f54c406d120 2023-10-07T08:49:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c2ffd700 1 -- 172.21.15.81:0/2020584637 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54ac003570 con 0x7f54c406d120 2023-10-07T08:49:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c2ffd700 1 -- 172.21.15.81:0/2020584637 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3228627673 0 0) 0x7f54ac003570 con 0x7f54c406d120 2023-10-07T08:49:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c2ffd700 1 -- 172.21.15.81:0/2020584637 >> v2:172.21.15.89:3300/0 conn(0x7f54c41578d0 msgr2=0x7f54c40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c2ffd700 1 --2- 172.21.15.81:0/2020584637 >> v2:172.21.15.89:3300/0 conn(0x7f54c41578d0 0x7f54c40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:36.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c2ffd700 1 -- 172.21.15.81:0/2020584637 >> v1:172.21.15.89:6789/0 conn(0x7f54c4157ca0 legacy=0x7f54c415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:36.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c2ffd700 1 -- 172.21.15.81:0/2020584637 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c40d0170 con 0x7f54c406d120 2023-10-07T08:49:36.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c2ffd700 1 -- 172.21.15.81:0/2020584637 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f54bc0017f0 con 0x7f54c406d120 2023-10-07T08:49:36.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c2ffd700 1 -- 172.21.15.81:0/2020584637 >> v1:172.21.15.81:6789/0 conn(0x7f54c406d120 legacy=0x7f54c406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:36.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c2ffd700 1 --2- 172.21.15.81:0/2020584637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54ac003a60 0x7f54ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:36.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c2ffd700 1 --2- 172.21.15.81:0/2020584637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ac004810 0x7f54ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:36.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c2ffd700 1 --2- 172.21.15.81:0/2020584637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54ac0051c0 0x7f54ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:36.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c2ffd700 1 -- 172.21.15.81:0/2020584637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40cfe90 con 0x7f54ac004810 2023-10-07T08:49:36.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c2ffd700 1 -- 172.21.15.81:0/2020584637 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac00c0d0 con 0x7f54ac0051c0 2023-10-07T08:49:36.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.527+0000 7f54c2ffd700 1 -- 172.21.15.81:0/2020584637 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac00c290 con 0x7f54ac003a60 2023-10-07T08:49:36.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.528+0000 7f54c37fe700 1 --2- 172.21.15.81:0/2020584637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ac004810 0x7f54ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:36.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.528+0000 7f54c3fff700 1 --2- 172.21.15.81:0/2020584637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54ac003a60 0x7f54ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:36.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.528+0000 7f54c8af3700 1 --2- 172.21.15.81:0/2020584637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54ac0051c0 0x7f54ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:36.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.528+0000 7f54c37fe700 1 -- 172.21.15.81:0/2020584637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54ac003a60 msgr2=0x7f54ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:36.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.528+0000 7f54c37fe700 1 --2- 172.21.15.81:0/2020584637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54ac003a60 0x7f54ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:36.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.528+0000 7f54c37fe700 1 -- 172.21.15.81:0/2020584637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54ac0051c0 msgr2=0x7f54ac00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:36.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.528+0000 7f54c37fe700 1 --2- 172.21.15.81:0/2020584637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54ac0051c0 0x7f54ac00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:36.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.528+0000 7f54c8af3700 1 -- 172.21.15.81:0/2020584637 reap_dead start 2023-10-07T08:49:36.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.528+0000 7f54c37fe700 1 -- 172.21.15.81:0/2020584637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac003570 con 0x7f54ac004810 2023-10-07T08:49:36.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.528+0000 7f54c37fe700 1 --2- 172.21.15.81:0/2020584637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ac004810 0x7f54ac004c80 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f54b4001880 tx=0x7f54b4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f520b2f09a7ccd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:36.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.528+0000 7f54c2ffd700 1 -- 172.21.15.81:0/2020584637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4012420 con 0x7f54ac004810 2023-10-07T08:49:36.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.528+0000 7f54c2ffd700 1 -- 172.21.15.81:0/2020584637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b40125a0 con 0x7f54ac004810 2023-10-07T08:49:36.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.528+0000 7f54c2ffd700 1 -- 172.21.15.81:0/2020584637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4012960 con 0x7f54ac004810 2023-10-07T08:49:36.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.529+0000 7f54ca556700 1 -- 172.21.15.81:0/2020584637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ac004810 msgr2=0x7f54ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:36.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.529+0000 7f54ca556700 1 --2- 172.21.15.81:0/2020584637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ac004810 0x7f54ac004c80 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f54b4001880 tx=0x7f54b4007d30 comp rx=0 tx=0).stop 2023-10-07T08:49:36.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.529+0000 7f54ca556700 1 -- 172.21.15.81:0/2020584637 shutdown_connections 2023-10-07T08:49:36.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.529+0000 7f54ca556700 1 --2- 172.21.15.81:0/2020584637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ac004810 0x7f54ac004c80 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:36.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.529+0000 7f54ca556700 1 -- 172.21.15.81:0/2020584637 >> 172.21.15.81:0/2020584637 conn(0x7f54c406bb90 msgr2=0x7f54c406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:36.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.529+0000 7f54ca556700 1 -- 172.21.15.81:0/2020584637 shutdown_connections 2023-10-07T08:49:36.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.529+0000 7f54ca556700 1 -- 172.21.15.81:0/2020584637 wait complete. 2023-10-07T08:49:36.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.530+0000 7f54ca556700 1 Processor -- start 2023-10-07T08:49:36.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.530+0000 7f54ca556700 1 -- start start 2023-10-07T08:49:36.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54ca556700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54ac004810 0x7f54c4154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:36.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54ca556700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c40c7770 0x7f54c40c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:36.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54ca556700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54c415c670 0x7f54c415cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:36.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54ca556700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40c9370 con 0x7f54c415c670 2023-10-07T08:49:36.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54ca556700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c415d020 con 0x7f54c40c7770 2023-10-07T08:49:36.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54ca556700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40c8760 con 0x7f54ac004810 2023-10-07T08:49:36.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54c8af3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54c415c670 0x7f54c415cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:36.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54c8af3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54c415c670 0x7f54c415cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58740/0 (socket says 172.21.15.81:58740) 2023-10-07T08:49:36.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54c8af3700 1 -- 172.21.15.81:0/2901380801 learned_addr learned my addr 172.21.15.81:0/2901380801 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:36.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54c37fe700 1 --2- 172.21.15.81:0/2901380801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c40c7770 0x7f54c40c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:36.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54c3fff700 1 --2- 172.21.15.81:0/2901380801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54ac004810 0x7f54c4154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:36.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54c8af3700 1 -- 172.21.15.81:0/2901380801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54ac004810 msgr2=0x7f54c4154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:36.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54c8af3700 1 --2- 172.21.15.81:0/2901380801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54ac004810 0x7f54c4154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:36.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54c8af3700 1 -- 172.21.15.81:0/2901380801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c40c7770 msgr2=0x7f54c40c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:36.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54c8af3700 1 --2- 172.21.15.81:0/2901380801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c40c7770 0x7f54c40c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:36.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54c8af3700 1 -- 172.21.15.81:0/2901380801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c40c8a40 con 0x7f54c415c670 2023-10-07T08:49:36.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54c8af3700 1 --2- 172.21.15.81:0/2901380801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54c415c670 0x7f54c415cae0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f54c4063f70 tx=0x7f54bc0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:36.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.531+0000 7f54abfff700 1 -- 172.21.15.81:0/2901380801 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00ac90 con 0x7f54c415c670 2023-10-07T08:49:36.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.532+0000 7f54abfff700 1 -- 172.21.15.81:0/2901380801 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc00adf0 con 0x7f54c415c670 2023-10-07T08:49:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.532+0000 7f54ca556700 1 -- 172.21.15.81:0/2901380801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c40c8d20 con 0x7f54c415c670 2023-10-07T08:49:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.532+0000 7f54abfff700 1 -- 172.21.15.81:0/2901380801 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc013640 con 0x7f54c415c670 2023-10-07T08:49:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.532+0000 7f54ca556700 1 -- 172.21.15.81:0/2901380801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c40c8450 con 0x7f54c415c670 2023-10-07T08:49:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.532+0000 7f54ca556700 1 -- 172.21.15.81:0/2901380801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c40c9520 con 0x7f54c415c670 2023-10-07T08:49:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.533+0000 7f54abfff700 1 -- 172.21.15.81:0/2901380801 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54bc013a30 con 0x7f54c415c670 2023-10-07T08:49:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.533+0000 7f54abfff700 1 --2- 172.21.15.81:0/2901380801 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54b0066f30 0x7f54b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.533+0000 7f54abfff700 1 -- 172.21.15.81:0/2901380801 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f54bc084dc0 con 0x7f54c415c670 2023-10-07T08:49:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.533+0000 7f54c3fff700 1 --2- 172.21.15.81:0/2901380801 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54b0066f30 0x7f54b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:36.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.533+0000 7f54abfff700 1 -- 172.21.15.81:0/2901380801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7f54b006ea50 con 0x7f54c415c670 2023-10-07T08:49:36.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.534+0000 7f54c3fff700 1 --2- 172.21.15.81:0/2901380801 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54b0066f30 0x7f54b00693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f54b8006f00 tx=0x7f54b80091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:36.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.538+0000 7f54abfff700 1 -- 172.21.15.81:0/2901380801 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54c40c9520 con 0x7f54c415c670 2023-10-07T08:49:36.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.720+0000 7f54ca556700 1 -- 172.21.15.81:0/2901380801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f54c40d0450 con 0x7f54c415c670 2023-10-07T08:49:36.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.721+0000 7f54abfff700 1 -- 172.21.15.81:0/2901380801 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) v1 ==== 81+0+32253 (secure 0 0 0) 0x7f54bc052030 con 0x7f54c415c670 2023-10-07T08:49:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:36.722 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:49:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 140, 2023-10-07T08:49:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:49:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:49:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:49:28.284415+0000", 2023-10-07T08:49:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:49:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:49:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:49:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:49:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:49:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:49:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:49:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:49:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:49:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:49:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:49:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:49:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:49:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:49:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 17, 2023-10-07T08:49:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:49:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:49:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:49:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:49:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:49:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:49:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:49:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:49:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:49:36.726 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:49:36.726 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:49:36.726 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:49:36.726 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:49:36.726 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:36.726 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:36.726 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:36.727 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:36.727 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:36.727 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:36.727 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:36.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.727 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:49:36.727 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:36.727 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:36.727 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:36.727 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:36.727 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:36.728 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:36.728 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:36.728 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:36.728 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:36.728 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:49:36.728 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:36.728 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:36.728 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:36.728 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:36.728 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:36.729 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:36.729 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:36.729 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:36.729 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:36.729 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:36.729 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:36.729 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:36.730 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:36.730 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:36.730 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:36.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:36.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.730 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:36.730 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:36.730 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:36.730 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:36.730 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:36.730 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:36.731 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:36.731 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:36.731 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:36.731 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:36.731 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:36.731 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:36.731 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:49:36.731 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:49:36.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.731 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:36.731 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:49:36.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.732 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 16, 2023-10-07T08:49:36.732 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:49:36.732 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:49:12.162742+0000", 2023-10-07T08:49:36.732 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:36.733 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:36.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:36.733 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:36.733 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:36.733 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:36.733 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:36.733 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:36.733 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:36.733 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:36.733 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:36.733 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:36.734 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:49:36.734 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:49:36.734 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:49:36.734 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:49:36.734 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:49:36.734 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:36.734 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:36.734 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:36.734 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:36.734 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:36.735 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:36.735 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:36.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.735 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "137", 2023-10-07T08:49:36.735 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:36.735 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:36.735 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:36.735 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:36.735 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:36.735 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:36.735 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:36.736 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:36.736 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:36.736 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:49:36.736 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:36.736 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:36.736 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:36.736 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:36.736 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:36.736 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:36.736 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:36.736 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:36.737 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:36.737 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:36.737 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:36.737 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:36.737 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:36.737 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:36.737 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:36.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:36.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.737 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:36.737 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:36.738 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:36.738 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:36.738 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:36.738 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:36.738 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:36.738 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:36.738 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:36.738 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:36.738 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:36.738 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:36.738 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:49:36.739 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:49:36.739 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:49:36.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.739 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:36.739 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:49:36.739 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:49:36.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.739 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 17, 2023-10-07T08:49:36.739 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:49:36.740 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:49:12.805348+0000", 2023-10-07T08:49:36.740 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1027, 2023-10-07T08:49:36.740 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-07T08:49:36.740 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:36.740 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:36.740 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:36.740 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:36.740 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:36.740 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:36.740 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:36.740 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:36.741 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:36.741 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:36.741 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:49:36.741 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:49:36.741 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:49:36.741 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:49:36.741 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:49:36.742 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:36.742 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:36.742 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:36.742 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:36.742 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:36.742 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:36.742 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:36.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.743 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "140", 2023-10-07T08:49:36.743 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:36.743 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:36.743 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:36.743 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:36.743 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:36.743 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:36.743 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:36.744 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:36.744 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:36.744 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-07T08:49:36.744 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:36.744 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:36.744 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:36.744 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:36.744 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:36.744 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:36.744 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:36.745 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:36.745 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:36.745 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:36.745 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:36.745 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:36.745 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:36.745 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:36.745 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:36.745 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:36.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.746 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:36.746 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:36.746 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:36.746 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:36.746 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:36.746 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:36.746 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:36.746 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:36.746 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:36.747 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:36.747 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:36.747 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:36.747 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:49:36.747 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:49:36.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.747 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:36.747 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:49:36.748 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:49:36.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.748 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:36.748 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:49:36.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.748 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:49:36.749 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:36.749 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:36.749 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:36.749 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:36.749 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:36.749 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:36.749 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:36.749 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:36.749 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:36.749 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:36.750 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:36.750 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:36.750 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.750 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:49:36.750 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:36.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.751 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:49:36.751 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:36.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.751 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.751 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:36.751 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.752 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:49:36.752 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:36.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.752 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:49:36.752 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:36.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.752 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.753 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:36.753 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.753 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:49:36.753 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:36.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.753 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:49:36.754 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:36.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.754 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.754 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:36.754 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.754 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.754 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:49:36.754 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:36.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.755 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:49:36.755 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:36.755 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.755 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.755 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:49:36.755 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:49:36.755 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:49:36.756 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:49:36.756 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:36.756 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:36.756 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:36.756 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.757 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:49:36.757 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:36.757 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:36.758 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:36.758 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:36.758 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:36.758 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:36.758 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:36.758 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:36.758 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:36.758 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:36.758 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:36.758 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:36.758 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.759 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:49:36.759 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:36.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.759 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:49:36.759 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:36.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.759 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.760 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:36.760 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.760 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:49:36.760 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:36.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.760 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:49:36.760 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:36.760 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.761 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.761 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:36.761 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.761 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.761 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:49:36.761 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:36.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.761 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.761 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:49:36.762 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:36.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.762 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.762 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:36.762 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.762 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.762 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:49:36.762 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:36.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.763 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:49:36.763 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:36.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.763 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.763 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:49:36.763 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:49:36.763 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:49:36.763 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:49:36.763 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:36.763 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:36.764 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:36.764 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.764 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:49:36.764 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:36.764 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:36.764 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:36.764 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:36.764 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:36.764 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:36.764 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:36.765 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:36.765 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:36.765 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:36.765 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:36.765 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:36.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:49:36.765 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:36.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:49:36.766 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:36.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.766 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.766 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:36.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:49:36.766 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:36.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:49:36.767 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:36.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.767 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.767 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:36.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.768 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:49:36.768 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:36.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.768 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.768 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:49:36.768 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:36.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.768 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:36.768 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.769 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:49:36.769 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:36.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.769 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:49:36.769 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:36.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.769 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.770 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:49:36.770 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:49:36.770 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:49:36.770 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:49:36.770 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:36.770 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:36.770 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:36.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.770 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:49:36.770 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:36.771 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:36.771 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:36.771 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:36.771 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:36.771 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:36.771 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:36.771 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:36.771 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:36.771 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:36.771 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:36.771 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:36.771 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.772 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:49:36.772 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:36.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.772 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:49:36.772 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:36.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.772 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.773 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:36.773 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.773 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:49:36.773 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:36.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.773 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:49:36.773 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:36.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.774 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.774 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:36.774 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.774 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:49:36.774 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:36.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.774 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:49:36.775 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:36.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.775 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.775 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:36.775 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.776 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:49:36.776 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:36.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.777 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:49:36.777 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:36.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.777 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.777 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:49:36.777 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:49:36.778 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:49:36.778 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:49:36.778 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:36.778 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:36.778 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:36.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.778 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:49:36.778 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:36.779 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:36.779 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:36.779 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:36.779 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:36.779 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:36.779 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:36.779 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:36.779 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:36.779 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:36.779 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:36.780 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:36.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:49:36.780 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:36.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:49:36.781 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:36.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.781 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.781 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:36.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:49:36.781 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:36.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.782 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:49:36.782 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:36.782 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.782 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.782 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:36.782 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:49:36.783 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:36.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:49:36.783 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:36.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.783 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.783 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:36.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:49:36.784 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:36.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:49:36.784 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:36.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.785 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.785 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:49:36.785 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:49:36.785 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:49:36.785 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:49:36.785 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:36.785 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:36.785 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:36.785 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.786 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:49:36.786 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:36.786 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:36.786 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:36.786 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:36.786 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:36.786 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:36.786 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:36.786 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:36.786 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:36.786 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:36.787 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:36.787 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:36.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:49:36.787 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:36.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:49:36.787 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:36.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.788 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.788 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:36.788 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.788 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:49:36.788 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:36.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.789 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:49:36.789 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:36.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.789 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.789 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:36.789 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.789 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:49:36.790 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:36.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.790 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:49:36.791 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:36.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.792 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:36.792 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.792 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:49:36.792 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:36.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.793 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:49:36.794 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:36.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.794 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.794 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:49:36.794 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:49:36.794 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:49:36.794 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:49:36.794 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:36.794 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:36.794 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:36.795 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.795 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:49:36.795 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:36.795 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:36.795 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:36.795 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:36.795 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:36.795 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:36.795 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:36.796 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:36.796 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:36.796 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:36.796 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:36.796 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:36.796 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.796 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:49:36.796 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:36.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.797 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:49:36.797 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:36.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.797 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.797 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:36.797 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.797 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:49:36.797 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:36.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.798 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:49:36.798 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:36.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.798 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.798 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:36.798 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.799 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.799 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:49:36.799 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:36.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.799 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.799 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:49:36.799 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:36.799 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.799 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.799 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:36.800 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.800 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:49:36.800 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:36.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.800 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:49:36.800 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:36.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.800 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.801 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:49:36.801 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:49:36.801 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:49:36.801 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:49:36.801 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:36.801 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:36.801 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:36.801 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.801 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:49:36.802 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:36.802 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:36.802 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:36.802 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:36.802 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:36.802 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:36.802 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:36.802 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:36.802 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:36.802 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:36.802 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:36.802 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:36.802 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:49:36.803 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:36.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:49:36.803 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:36.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.803 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.804 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:36.804 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.804 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:49:36.804 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:36.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.804 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:49:36.804 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:36.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.805 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.805 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:36.805 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.805 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:49:36.805 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:36.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.805 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:49:36.805 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:36.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.806 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.806 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:36.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:36.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:36.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:49:36.806 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:36.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:36.807 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:49:36.807 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:36.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.807 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.807 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:49:36.807 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:49:36.807 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:49:36.807 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:49:36.807 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:36.807 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:36.807 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:36.808 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:36.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.808 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:36.808 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:49:36.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.808 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:49:36.808 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:36.808 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:36.808 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:36.808 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:36.808 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:36.808 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:49:36.809 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:36.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.809 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:49:36.809 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:36.809 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:36.809 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:36.809 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:36.809 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:36.810 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:49:36.810 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:36.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:49:36.810 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:36.810 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:36.810 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:36.810 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:36.810 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:36.810 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:49:36.811 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:36.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:49:36.811 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:36.811 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:36.811 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:36.811 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:36.811 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:36.811 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:49:36.811 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:36.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.812 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:49:36.812 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:36.812 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:36.812 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:36.812 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:36.812 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:36.812 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:49:36.812 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:36.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.812 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:49:36.812 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:36.812 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:36.813 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:36.813 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:36.813 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:36.813 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:49:36.813 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:36.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.813 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:49:36.813 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:36.813 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:36.813 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:36.813 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:36.814 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:36.814 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:49:36.814 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:36.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:36.814 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:49:36.814 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:36.814 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:36.814 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:36.814 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:36.814 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:36.814 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:49:36.814 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:36.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.815 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:36.815 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:49:36.815 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:49:36.815 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:49:36.815 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:49:36.815 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:49:36.815 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:49:36.815 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:49:36.815 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:49:36.815 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:49:36.816 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:49:36.816 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:49:36.816 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:49:36.816 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:49:36.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:36.816 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:49:36.816 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:49:36.816 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:49:36.816 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:49:36.816 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:49:36.816 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:49:36.817 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:49:36.817 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:49:36.817 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:49:36.817 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:49:36.817 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:49:36.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:36.817 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:49:36.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.723+0000 7f54ca556700 1 -- 172.21.15.81:0/2901380801 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54b0066f30 msgr2=0x7f54b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:36.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.723+0000 7f54ca556700 1 --2- 172.21.15.81:0/2901380801 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54b0066f30 0x7f54b00693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f54b8006f00 tx=0x7f54b80091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:36.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.723+0000 7f54ca556700 1 -- 172.21.15.81:0/2901380801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54c415c670 msgr2=0x7f54c415cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:36.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.723+0000 7f54ca556700 1 --2- 172.21.15.81:0/2901380801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54c415c670 0x7f54c415cae0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f54c4063f70 tx=0x7f54bc0021d0 comp rx=0 tx=0).stop 2023-10-07T08:49:36.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.723+0000 7f54ca556700 1 -- 172.21.15.81:0/2901380801 shutdown_connections 2023-10-07T08:49:36.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.723+0000 7f54ca556700 1 --2- 172.21.15.81:0/2901380801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54c415c670 0x7f54c415cae0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:36.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.723+0000 7f54ca556700 1 --2- 172.21.15.81:0/2901380801 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54b0066f30 0x7f54b00693e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:36.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.723+0000 7f54ca556700 1 --2- 172.21.15.81:0/2901380801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54ac004810 0x7f54c4154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:36.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.723+0000 7f54ca556700 1 --2- 172.21.15.81:0/2901380801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c40c7770 0x7f54c40c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:36.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.723+0000 7f54ca556700 1 -- 172.21.15.81:0/2901380801 >> 172.21.15.81:0/2901380801 conn(0x7f54c406bb90 msgr2=0x7f54c4155ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:36.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.723+0000 7f54ca556700 1 -- 172.21.15.81:0/2901380801 shutdown_connections 2023-10-07T08:49:36.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:36.724+0000 7f54ca556700 1 -- 172.21.15.81:0/2901380801 wait complete. 2023-10-07T08:49:36.820 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-07T08:49:41.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:49:41.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.948+0000 7f747d5f4700 1 Processor -- start 2023-10-07T08:49:41.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.948+0000 7f747d5f4700 1 -- start start 2023-10-07T08:49:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.949+0000 7f747d5f4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f747806d830 0x7f74780cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.949+0000 7f747d5f4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74780d07c0 con 0x7f74781578d0 2023-10-07T08:49:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.949+0000 7f747d5f4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74780cfbb0 con 0x7f7478157ca0 2023-10-07T08:49:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.949+0000 7f747d5f4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74780cfe90 con 0x7f747806d830 2023-10-07T08:49:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.949+0000 7f7476ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f74781578d0 0x7f747815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55674/0 (socket says 172.21.15.81:55674) 2023-10-07T08:49:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.949+0000 7f7476ffd700 1 -- 172.21.15.81:0/1054662298 learned_addr learned my addr 172.21.15.81:0/1054662298 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.949+0000 7f74767fc700 1 -- 172.21.15.81:0/1054662298 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182126384 0 0) 0x7f74780d07c0 con 0x7f74781578d0 2023-10-07T08:49:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.949+0000 7f74767fc700 1 -- 172.21.15.81:0/1054662298 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7464003570 con 0x7f74781578d0 2023-10-07T08:49:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.949+0000 7f74777fe700 1 --2- 172.21.15.81:0/1054662298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f747806d830 0x7f74780cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f74767fc700 1 -- 172.21.15.81:0/1054662298 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1563411427 0 0) 0x7f7464003570 con 0x7f74781578d0 2023-10-07T08:49:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f74767fc700 1 -- 172.21.15.81:0/1054662298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f747806d830 msgr2=0x7f74780cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f74767fc700 1 --2- 172.21.15.81:0/1054662298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f747806d830 0x7f74780cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f74767fc700 1 -- 172.21.15.81:0/1054662298 >> v1:172.21.15.89:6789/0 conn(0x7f7478157ca0 legacy=0x7f747806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f74767fc700 1 -- 172.21.15.81:0/1054662298 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74780d0170 con 0x7f74781578d0 2023-10-07T08:49:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f74767fc700 1 -- 172.21.15.81:0/1054662298 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f7468001470 con 0x7f74781578d0 2023-10-07T08:49:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f74767fc700 1 -- 172.21.15.81:0/1054662298 >> v1:172.21.15.81:6789/0 conn(0x7f74781578d0 legacy=0x7f747815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f74767fc700 1 --2- 172.21.15.81:0/1054662298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f747806d830 0x7f7464003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f74767fc700 1 --2- 172.21.15.81:0/1054662298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7464003fd0 0x7f7464004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f74767fc700 1 --2- 172.21.15.81:0/1054662298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7464004d50 0x7f74640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f74767fc700 1 -- 172.21.15.81:0/1054662298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74780cfe90 con 0x7f7464003fd0 2023-10-07T08:49:41.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f74767fc700 1 -- 172.21.15.81:0/1054662298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746400bb40 con 0x7f7464004d50 2023-10-07T08:49:41.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f74767fc700 1 -- 172.21.15.81:0/1054662298 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746400bd00 con 0x7f747806d830 2023-10-07T08:49:41.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f746e7fc700 1 --2- 172.21.15.81:0/1054662298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7464003fd0 0x7f7464004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:41.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f7476ffd700 1 --2- 172.21.15.81:0/1054662298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f747806d830 0x7f7464003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:41.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f74777fe700 1 --2- 172.21.15.81:0/1054662298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7464004d50 0x7f74640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:41.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f746e7fc700 1 -- 172.21.15.81:0/1054662298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f747806d830 msgr2=0x7f7464003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:41.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f746e7fc700 1 --2- 172.21.15.81:0/1054662298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f747806d830 0x7f7464003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:41.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f746e7fc700 1 -- 172.21.15.81:0/1054662298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7464004d50 msgr2=0x7f74640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f746e7fc700 1 --2- 172.21.15.81:0/1054662298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7464004d50 0x7f74640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f746e7fc700 1 -- 172.21.15.81:0/1054662298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7464003570 con 0x7f7464003fd0 2023-10-07T08:49:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.950+0000 7f746e7fc700 1 --2- 172.21.15.81:0/1054662298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7464003fd0 0x7f7464004810 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f7460001930 tx=0x7f7460007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dea326ebd832a7d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.951+0000 7f74767fc700 1 -- 172.21.15.81:0/1054662298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746000c5d0 con 0x7f7464003fd0 2023-10-07T08:49:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.951+0000 7f74767fc700 1 -- 172.21.15.81:0/1054662298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746000c750 con 0x7f7464003fd0 2023-10-07T08:49:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.951+0000 7f74767fc700 1 -- 172.21.15.81:0/1054662298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746000cb10 con 0x7f7464003fd0 2023-10-07T08:49:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.951+0000 7f747d5f4700 1 -- 172.21.15.81:0/1054662298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7464003fd0 msgr2=0x7f7464004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.951+0000 7f747d5f4700 1 --2- 172.21.15.81:0/1054662298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7464003fd0 0x7f7464004810 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f7460001930 tx=0x7f7460007d10 comp rx=0 tx=0).stop 2023-10-07T08:49:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.951+0000 7f74777fe700 1 -- 172.21.15.81:0/1054662298 reap_dead start 2023-10-07T08:49:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.951+0000 7f747d5f4700 1 -- 172.21.15.81:0/1054662298 shutdown_connections 2023-10-07T08:49:41.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.951+0000 7f747d5f4700 1 -- 172.21.15.81:0/1054662298 >> 172.21.15.81:0/1054662298 conn(0x7f747806bb90 msgr2=0x7f747806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:41.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.951+0000 7f747d5f4700 1 -- 172.21.15.81:0/1054662298 shutdown_connections 2023-10-07T08:49:41.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.951+0000 7f747d5f4700 1 -- 172.21.15.81:0/1054662298 wait complete. 2023-10-07T08:49:41.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.952+0000 7f747d5f4700 1 Processor -- start 2023-10-07T08:49:41.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.952+0000 7f747d5f4700 1 -- start start 2023-10-07T08:49:41.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.953+0000 7f747d5f4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7464003fd0 0x7f74780c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:41.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.953+0000 7f747d5f4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74780c5b20 0x7f747815c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:41.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.953+0000 7f747d5f4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74780c5f90 0x7f747815cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:41.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.953+0000 7f747d5f4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74780cbeb0 con 0x7f7464003fd0 2023-10-07T08:49:41.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.953+0000 7f747d5f4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74780c6530 con 0x7f74780c5b20 2023-10-07T08:49:41.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.953+0000 7f747d5f4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74780c6810 con 0x7f74780c5f90 2023-10-07T08:49:41.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.953+0000 7f7476ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7464003fd0 0x7f74780c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:41.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.953+0000 7f7476ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7464003fd0 0x7f74780c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58758/0 (socket says 172.21.15.81:58758) 2023-10-07T08:49:41.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.953+0000 7f7476ffd700 1 -- 172.21.15.81:0/4195350286 learned_addr learned my addr 172.21.15.81:0/4195350286 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:41.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.953+0000 7f746e7fc700 1 --2- 172.21.15.81:0/4195350286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74780c5b20 0x7f747815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:41.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.953+0000 7f74777fe700 1 --2- 172.21.15.81:0/4195350286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74780c5f90 0x7f747815cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:41.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.954+0000 7f7476ffd700 1 -- 172.21.15.81:0/4195350286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74780c5f90 msgr2=0x7f747815cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:41.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.954+0000 7f7476ffd700 1 --2- 172.21.15.81:0/4195350286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74780c5f90 0x7f747815cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:41.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.954+0000 7f7476ffd700 1 -- 172.21.15.81:0/4195350286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74780c5b20 msgr2=0x7f747815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:41.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.954+0000 7f7476ffd700 1 --2- 172.21.15.81:0/4195350286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74780c5b20 0x7f747815c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:41.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.954+0000 7f7476ffd700 1 -- 172.21.15.81:0/4195350286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74780c6af0 con 0x7f7464003fd0 2023-10-07T08:49:41.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.954+0000 7f746e7fc700 1 --2- 172.21.15.81:0/4195350286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74780c5b20 0x7f747815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:41.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.954+0000 7f74777fe700 1 --2- 172.21.15.81:0/4195350286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74780c5f90 0x7f747815cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:41.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.954+0000 7f7476ffd700 1 --2- 172.21.15.81:0/4195350286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7464003fd0 0x7f74780c9e30 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f7468001c20 tx=0x7f747815b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:41.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.954+0000 7f746f7fe700 1 -- 172.21.15.81:0/4195350286 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468018030 con 0x7f7464003fd0 2023-10-07T08:49:41.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.954+0000 7f746f7fe700 1 -- 172.21.15.81:0/4195350286 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74680077d0 con 0x7f7464003fd0 2023-10-07T08:49:41.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.954+0000 7f747d5f4700 1 -- 172.21.15.81:0/4195350286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74780cbb40 con 0x7f7464003fd0 2023-10-07T08:49:41.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.954+0000 7f746f7fe700 1 -- 172.21.15.81:0/4195350286 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746800fb00 con 0x7f7464003fd0 2023-10-07T08:49:41.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.954+0000 7f747d5f4700 1 -- 172.21.15.81:0/4195350286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74780ca370 con 0x7f7464003fd0 2023-10-07T08:49:41.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.955+0000 7f747d5f4700 1 -- 172.21.15.81:0/4195350286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74780ca590 con 0x7f7464003fd0 2023-10-07T08:49:41.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.955+0000 7f746f7fe700 1 -- 172.21.15.81:0/4195350286 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f746801b070 con 0x7f7464003fd0 2023-10-07T08:49:41.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.956+0000 7f746f7fe700 1 --2- 172.21.15.81:0/4195350286 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7458066f30 0x7f74580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:41.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.956+0000 7f746f7fe700 1 -- 172.21.15.81:0/4195350286 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7468019070 con 0x7f7464003fd0 2023-10-07T08:49:41.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.956+0000 7f746e7fc700 1 --2- 172.21.15.81:0/4195350286 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7458066f30 0x7f74580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:41.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.956+0000 7f746e7fc700 1 --2- 172.21.15.81:0/4195350286 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7458066f30 0x7f74580693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f747806c3e0 tx=0x7f7460015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:41.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:41.960+0000 7f746f7fe700 1 -- 172.21.15.81:0/4195350286 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74680516b0 con 0x7f7464003fd0 2023-10-07T08:49:42.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.145+0000 7f747d5f4700 1 -- 172.21.15.81:0/4195350286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f74780cb9a0 con 0x7f7464003fd0 2023-10-07T08:49:42.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.146+0000 7f746f7fe700 1 -- 172.21.15.81:0/4195350286 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v141) v1 ==== 81+0+32234 (secure 0 0 0) 0x7f74780cb9a0 con 0x7f7464003fd0 2023-10-07T08:49:42.147 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:42.147 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:49:42.147 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 141, 2023-10-07T08:49:42.147 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:49:42.147 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:49:42.147 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:49:38.286318+0000", 2023-10-07T08:49:42.147 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:49:42.148 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:49:42.148 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:49:42.148 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:49:42.148 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:49:42.148 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:49:42.148 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:49:42.148 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:49:42.148 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:49:42.148 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:42.149 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:49:42.149 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:49:42.149 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:49:42.149 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:49:42.149 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:49:42.149 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 17, 2023-10-07T08:49:42.149 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:49:42.149 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:49:42.150 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:49:42.150 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:49:42.150 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:49:42.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.150 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:49:42.150 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:49:42.150 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:49:42.151 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:42.151 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:42.151 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:42.151 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:42.151 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:42.151 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:42.151 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:42.151 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:42.151 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:42.151 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:42.152 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:42.152 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:42.152 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:49:42.152 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:49:42.152 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:49:42.152 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:49:42.152 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:49:42.152 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:42.152 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:42.153 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:42.153 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:42.153 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:42.153 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:42.153 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:42.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.153 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:49:42.153 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:42.153 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:42.153 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:42.154 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:42.154 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:42.154 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:42.154 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:42.154 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:42.154 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:42.154 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:49:42.154 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:42.154 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:42.155 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:42.155 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:42.155 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:42.155 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:42.155 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:42.155 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:42.156 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:42.156 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:42.156 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:42.156 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:42.156 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:42.156 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:42.156 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:42.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:42.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.156 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:42.157 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:42.157 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:42.158 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:42.158 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:42.158 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:42.158 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:42.158 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:42.158 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:42.158 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:42.158 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:42.158 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:42.159 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:49:42.159 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:49:42.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.159 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:42.159 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:49:42.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.159 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 16, 2023-10-07T08:49:42.160 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:49:42.160 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:49:12.162742+0000", 2023-10-07T08:49:42.160 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:42.160 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:42.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:42.160 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:42.160 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:42.160 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:42.160 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:42.160 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:42.161 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:42.161 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:42.161 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:42.161 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:42.161 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:49:42.161 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:49:42.161 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:49:42.161 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:49:42.161 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:49:42.161 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:42.162 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:42.162 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:42.162 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:42.162 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:42.162 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:42.162 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:42.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.163 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "137", 2023-10-07T08:49:42.163 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:42.163 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:42.163 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:42.163 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:42.163 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:42.163 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:42.164 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:42.164 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:42.164 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:42.164 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:49:42.164 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:42.164 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:42.164 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:42.164 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:42.164 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:42.165 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:42.165 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:42.165 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:42.165 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:42.165 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:42.165 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:42.165 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:42.165 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:42.165 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:42.166 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:42.166 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:42.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.166 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:42.166 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:42.166 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:42.166 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:42.166 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:42.166 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:42.167 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:42.167 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:42.167 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:42.167 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:42.167 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:42.167 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:42.167 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:49:42.167 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:49:42.167 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:49:42.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.168 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:42.168 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:49:42.168 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:49:42.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.168 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 17, 2023-10-07T08:49:42.168 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:49:42.169 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:49:12.805348+0000", 2023-10-07T08:49:42.169 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:42.169 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:42.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:42.169 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:42.169 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:42.169 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:42.169 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:42.169 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:42.169 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:42.170 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:42.170 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:42.170 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:42.170 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:49:42.170 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:49:42.170 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:49:42.170 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:49:42.170 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:49:42.170 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:42.171 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:42.171 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:42.171 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:42.171 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:42.171 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:42.171 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:42.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.171 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "141", 2023-10-07T08:49:42.172 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:42.172 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:42.172 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:42.172 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:42.172 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:42.172 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:42.172 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:42.172 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:42.172 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:42.172 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-07T08:49:42.173 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:42.173 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:42.173 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:42.173 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:42.173 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:42.173 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:42.173 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:42.173 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:42.173 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:42.174 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:42.174 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:42.174 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:42.174 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:42.174 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:42.174 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:42.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:42.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.174 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:42.175 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:42.175 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:42.175 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:42.175 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:42.175 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:42.175 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:42.175 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:42.175 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:42.175 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:42.175 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:42.176 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:42.176 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:49:42.176 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:49:42.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.176 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:42.176 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:49:42.176 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:49:42.176 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.176 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.177 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.177 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:42.177 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:49:42.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.177 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:49:42.177 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:42.177 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:42.177 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:42.177 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:42.177 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:42.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:42.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:42.178 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:42.178 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:42.178 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:42.178 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:42.178 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:42.178 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:49:42.179 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:42.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:49:42.179 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:42.179 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.179 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.180 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:42.180 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.180 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:49:42.180 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:42.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.181 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:49:42.181 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:42.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.181 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.181 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:42.181 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.181 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:49:42.182 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:42.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.182 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.182 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:49:42.182 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:42.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.182 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.182 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:42.183 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.183 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:49:42.183 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:42.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.183 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:49:42.184 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:42.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.184 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.184 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:49:42.184 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:49:42.184 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:49:42.184 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:49:42.184 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:42.184 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:42.185 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:42.185 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.185 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:49:42.185 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:42.185 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:42.185 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:42.185 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:42.185 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:42.186 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:42.186 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:42.186 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:42.186 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:42.186 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:42.186 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:42.186 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:42.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:49:42.187 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:42.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:49:42.187 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:42.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.188 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.188 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:42.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:49:42.188 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:42.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:49:42.189 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:42.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.189 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.189 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:42.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.190 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:49:42.190 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:42.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.190 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:49:42.190 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:42.191 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.191 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.191 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:42.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:49:42.191 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:42.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:49:42.192 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:42.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.192 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:49:42.192 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:49:42.193 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:49:42.193 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:49:42.193 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:42.193 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:42.193 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:42.193 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.193 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:49:42.193 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:42.194 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:42.194 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:42.194 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:42.194 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:42.194 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:42.194 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:42.194 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:42.194 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:42.194 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:42.195 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:42.195 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:42.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:49:42.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:42.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:49:42.196 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:42.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.196 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:42.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:49:42.197 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:42.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.197 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.197 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:49:42.197 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:42.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.197 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.197 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:42.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:49:42.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:42.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:49:42.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:42.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.199 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:42.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:49:42.199 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:42.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:49:42.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:42.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.200 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.200 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:49:42.201 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:49:42.201 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:49:42.201 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:49:42.201 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:42.201 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:42.201 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:42.201 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.202 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:49:42.202 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:42.202 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:42.202 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:42.202 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:42.202 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:42.202 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:42.202 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:42.202 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:42.202 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:42.203 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:42.203 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:42.203 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:42.203 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.203 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:49:42.203 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:42.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:49:42.204 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:42.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.204 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:42.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:49:42.205 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:42.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:49:42.205 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:42.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.206 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:42.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:49:42.206 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:42.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:49:42.207 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:42.207 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.207 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.207 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:42.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:49:42.208 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:42.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.208 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.208 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:49:42.208 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:42.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.208 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.208 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:49:42.209 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:49:42.209 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:49:42.209 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:49:42.209 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:42.209 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:42.209 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:42.209 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.209 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:49:42.210 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:42.210 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:42.210 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:42.210 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:42.210 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:42.210 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:42.210 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:42.210 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:42.210 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:42.211 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:42.211 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:42.211 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:42.211 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.211 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:49:42.211 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:42.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.212 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.212 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:49:42.212 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:42.212 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.212 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.212 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:42.212 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:49:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:49:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:49:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:49:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:49:42.216 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:42.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:49:42.216 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:42.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.217 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.217 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:49:42.217 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:49:42.217 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:49:42.217 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:49:42.217 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:42.217 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:42.217 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:42.218 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.218 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:49:42.218 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:42.218 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:42.218 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:42.218 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:42.218 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:42.219 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:42.219 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:42.219 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:42.219 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:42.219 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:42.219 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:49:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:49:42.221 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:42.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.221 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.221 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:42.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:49:42.222 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:42.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:49:42.222 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:42.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.223 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.223 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:42.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:49:42.224 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:42.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:49:42.224 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:42.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.224 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.224 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:42.225 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.225 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.225 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:49:42.225 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:42.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.225 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.225 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:49:42.225 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:42.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.226 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.226 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:49:42.226 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:49:42.226 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:49:42.226 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:49:42.226 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:42.226 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:42.226 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:42.227 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:49:42.227 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:42.227 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:42.227 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:42.227 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:42.227 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:42.228 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:42.228 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:42.228 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:42.228 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:42.228 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:42.228 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:42.228 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:42.228 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:49:42.229 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:42.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:49:42.229 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:42.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.230 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.230 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:42.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:49:42.230 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:42.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.231 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:49:42.231 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:42.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.231 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.231 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:42.231 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.232 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:49:42.232 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:42.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.232 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:49:42.232 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:42.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.233 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.233 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:42.233 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.233 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:49:42.233 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:42.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.234 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:49:42.234 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:42.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.234 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.234 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:49:42.234 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:49:42.235 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:49:42.235 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:49:42.235 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:42.235 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:42.235 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:42.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.235 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:49:42.235 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:42.236 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:42.236 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:42.236 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:42.236 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:42.236 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:42.236 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:42.236 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:42.236 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:42.236 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:42.237 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:42.237 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:42.237 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.237 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:49:42.237 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:42.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.238 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:49:42.238 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:42.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.238 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.238 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:42.238 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:49:42.239 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:42.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:49:42.239 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:42.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.239 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.240 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:42.240 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.240 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:49:42.240 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:42.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:49:42.241 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:42.241 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.241 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.241 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:42.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.241 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:49:42.242 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:42.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:49:42.242 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:42.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.242 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.243 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:49:42.243 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:49:42.243 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:49:42.243 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:49:42.243 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:42.243 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:42.243 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:42.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.243 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:42.244 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:49:42.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.244 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:49:42.244 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:42.244 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:42.244 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:42.244 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:42.244 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:42.244 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:49:42.244 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:42.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.245 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:49:42.245 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:42.245 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:42.245 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:42.245 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:42.245 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:42.245 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:49:42.245 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:42.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.246 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:49:42.246 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:42.246 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:42.246 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:42.246 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:42.246 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:42.246 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:49:42.247 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:42.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.247 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:49:42.247 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:42.247 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:42.247 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:42.247 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:42.247 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:42.247 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:49:42.247 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:42.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.248 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:49:42.248 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:42.248 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:42.248 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:42.248 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:42.248 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:42.248 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:49:42.248 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:42.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.249 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:49:42.249 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:42.249 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:42.249 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:42.249 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:42.249 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:42.249 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:49:42.250 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:42.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.250 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:49:42.250 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:42.250 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:42.250 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:42.250 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:42.250 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:42.250 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:49:42.250 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:42.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.251 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:49:42.251 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:42.251 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:42.251 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:42.251 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:42.251 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:42.251 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:49:42.251 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:42.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.252 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:42.252 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:49:42.252 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:49:42.252 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:49:42.252 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:49:42.252 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:49:42.252 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:49:42.252 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:49:42.252 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:49:42.253 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:49:42.253 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:49:42.253 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:49:42.253 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:49:42.253 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:49:42.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.253 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:49:42.253 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:49:42.253 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:49:42.254 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:49:42.254 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:49:42.254 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:49:42.254 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:49:42.254 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:49:42.254 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:49:42.254 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:49:42.254 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:49:42.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.254 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:49:42.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.148+0000 7f747d5f4700 1 -- 172.21.15.81:0/4195350286 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7458066f30 msgr2=0x7f74580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.148+0000 7f747d5f4700 1 --2- 172.21.15.81:0/4195350286 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7458066f30 0x7f74580693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f747806c3e0 tx=0x7f7460015000 comp rx=0 tx=0).stop 2023-10-07T08:49:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.148+0000 7f747d5f4700 1 -- 172.21.15.81:0/4195350286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7464003fd0 msgr2=0x7f74780c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.148+0000 7f747d5f4700 1 --2- 172.21.15.81:0/4195350286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7464003fd0 0x7f74780c9e30 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f7468001c20 tx=0x7f747815b610 comp rx=0 tx=0).stop 2023-10-07T08:49:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.148+0000 7f747d5f4700 1 -- 172.21.15.81:0/4195350286 shutdown_connections 2023-10-07T08:49:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.148+0000 7f747d5f4700 1 --2- 172.21.15.81:0/4195350286 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7458066f30 0x7f74580693e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.148+0000 7f747d5f4700 1 --2- 172.21.15.81:0/4195350286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74780c5f90 0x7f747815cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.148+0000 7f747d5f4700 1 --2- 172.21.15.81:0/4195350286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7464003fd0 0x7f74780c9e30 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.148+0000 7f747d5f4700 1 --2- 172.21.15.81:0/4195350286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74780c5b20 0x7f747815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.148+0000 7f747d5f4700 1 -- 172.21.15.81:0/4195350286 >> 172.21.15.81:0/4195350286 conn(0x7f747806bb90 msgr2=0x7f74781568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.148+0000 7f747d5f4700 1 -- 172.21.15.81:0/4195350286 shutdown_connections 2023-10-07T08:49:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.148+0000 7f747d5f4700 1 -- 172.21.15.81:0/4195350286 wait complete. 2023-10-07T08:49:42.260 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-07T08:49:42.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:49:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.374+0000 7fd4efe82700 1 Processor -- start 2023-10-07T08:49:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.374+0000 7fd4efe82700 1 -- start start 2023-10-07T08:49:42.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.375+0000 7fd4efe82700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4e8157ca0 0x7fd4e80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:42.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.375+0000 7fd4efe82700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e80d07c0 con 0x7fd4e81578d0 2023-10-07T08:49:42.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.375+0000 7fd4efe82700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e80cfbb0 con 0x7fd4e806d120 2023-10-07T08:49:42.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.375+0000 7fd4efe82700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e80cfe90 con 0x7fd4e8157ca0 2023-10-07T08:49:42.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.375+0000 7fd4ed41d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4e8157ca0 0x7fd4e80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.375+0000 7fd4edc1e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd4e81578d0 0x7fd4e815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41934/0 (socket says 172.21.15.81:41934) 2023-10-07T08:49:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.375+0000 7fd4edc1e700 1 -- 172.21.15.81:0/3666109644 learned_addr learned my addr 172.21.15.81:0/3666109644 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.375+0000 7fd4ed41d700 1 -- 172.21.15.81:0/3666109644 >> v1:172.21.15.89:6789/0 conn(0x7fd4e806d120 legacy=0x7fd4e806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.375+0000 7fd4ed41d700 1 -- 172.21.15.81:0/3666109644 >> v1:172.21.15.81:6789/0 conn(0x7fd4e81578d0 legacy=0x7fd4e815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.375+0000 7fd4ed41d700 1 -- 172.21.15.81:0/3666109644 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e80d0170 con 0x7fd4e8157ca0 2023-10-07T08:49:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.375+0000 7fd4ecc1c700 1 -- 172.21.15.81:0/3666109644 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3385332673 0 0) 0x7fd4e80d07c0 con 0x7fd4e81578d0 2023-10-07T08:49:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.375+0000 7fd4ed41d700 1 --2- 172.21.15.81:0/3666109644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4e8157ca0 0x7fd4e80cf4f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80098e0 tx=0x7fd4d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e91106e515850a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.375+0000 7fd4ecc1c700 1 -- 172.21.15.81:0/3666109644 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8009e80 con 0x7fd4e8157ca0 2023-10-07T08:49:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.376+0000 7fd4ecc1c700 1 -- 172.21.15.81:0/3666109644 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d800b860 con 0x7fd4e8157ca0 2023-10-07T08:49:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.376+0000 7fd4ecc1c700 1 -- 172.21.15.81:0/3666109644 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d800bbe0 con 0x7fd4e8157ca0 2023-10-07T08:49:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.376+0000 7fd4efe82700 1 -- 172.21.15.81:0/3666109644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4e8157ca0 msgr2=0x7fd4e80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.376+0000 7fd4efe82700 1 --2- 172.21.15.81:0/3666109644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4e8157ca0 0x7fd4e80cf4f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80098e0 tx=0x7fd4d80091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.376+0000 7fd4efe82700 1 -- 172.21.15.81:0/3666109644 shutdown_connections 2023-10-07T08:49:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.376+0000 7fd4efe82700 1 --2- 172.21.15.81:0/3666109644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4e8157ca0 0x7fd4e80cf4f0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.376+0000 7fd4efe82700 1 -- 172.21.15.81:0/3666109644 >> 172.21.15.81:0/3666109644 conn(0x7fd4e806bb90 msgr2=0x7fd4e806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.376+0000 7fd4efe82700 1 -- 172.21.15.81:0/3666109644 shutdown_connections 2023-10-07T08:49:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.376+0000 7fd4efe82700 1 -- 172.21.15.81:0/3666109644 wait complete. 2023-10-07T08:49:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.377+0000 7fd4efe82700 1 Processor -- start 2023-10-07T08:49:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.377+0000 7fd4efe82700 1 -- start start 2023-10-07T08:49:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4efe82700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4e806d120 0x7fd4e814b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4efe82700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4e81578d0 0x7fd4e80b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4efe82700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4e8157ca0 0x7fd4e80b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4efe82700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80b2570 con 0x7fd4e8157ca0 2023-10-07T08:49:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4efe82700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e814be00 con 0x7fd4e806d120 2023-10-07T08:49:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4efe82700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80b18f0 con 0x7fd4e81578d0 2023-10-07T08:49:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4ee41f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4e8157ca0 0x7fd4e80b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4ee41f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4e8157ca0 0x7fd4e80b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35774/0 (socket says 172.21.15.81:35774) 2023-10-07T08:49:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4ee41f700 1 -- 172.21.15.81:0/2346088578 learned_addr learned my addr 172.21.15.81:0/2346088578 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4edc1e700 1 --2- 172.21.15.81:0/2346088578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4e806d120 0x7fd4e814b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4ed41d700 1 --2- 172.21.15.81:0/2346088578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4e81578d0 0x7fd4e80b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4ee41f700 1 -- 172.21.15.81:0/2346088578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4e81578d0 msgr2=0x7fd4e80b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4ee41f700 1 --2- 172.21.15.81:0/2346088578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4e81578d0 0x7fd4e80b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4ee41f700 1 -- 172.21.15.81:0/2346088578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4e806d120 msgr2=0x7fd4e814b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4ee41f700 1 --2- 172.21.15.81:0/2346088578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4e806d120 0x7fd4e814b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4ee41f700 1 -- 172.21.15.81:0/2346088578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d8009420 con 0x7fd4e8157ca0 2023-10-07T08:49:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4edc1e700 1 --2- 172.21.15.81:0/2346088578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4e806d120 0x7fd4e814b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4ee41f700 1 --2- 172.21.15.81:0/2346088578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4e8157ca0 0x7fd4e80b1300 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000c910 tx=0x7fd4e0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4ddffb700 1 -- 172.21.15.81:0/2346088578 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e000a7a0 con 0x7fd4e8157ca0 2023-10-07T08:49:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.378+0000 7fd4ddffb700 1 -- 172.21.15.81:0/2346088578 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e000a900 con 0x7fd4e8157ca0 2023-10-07T08:49:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.379+0000 7fd4efe82700 1 -- 172.21.15.81:0/2346088578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e80b1bd0 con 0x7fd4e8157ca0 2023-10-07T08:49:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.379+0000 7fd4ddffb700 1 -- 172.21.15.81:0/2346088578 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e000acc0 con 0x7fd4e8157ca0 2023-10-07T08:49:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.379+0000 7fd4efe82700 1 -- 172.21.15.81:0/2346088578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e80b2190 con 0x7fd4e8157ca0 2023-10-07T08:49:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.380+0000 7fd4efe82700 1 -- 172.21.15.81:0/2346088578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e80b6c60 con 0x7fd4e8157ca0 2023-10-07T08:49:42.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.380+0000 7fd4ddffb700 1 -- 172.21.15.81:0/2346088578 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4e0012630 con 0x7fd4e8157ca0 2023-10-07T08:49:42.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.380+0000 7fd4ddffb700 1 --2- 172.21.15.81:0/2346088578 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd4cc066f30 0x7fd4cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:42.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.380+0000 7fd4ddffb700 1 -- 172.21.15.81:0/2346088578 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd4e00848c0 con 0x7fd4e8157ca0 2023-10-07T08:49:42.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.380+0000 7fd4edc1e700 1 --2- 172.21.15.81:0/2346088578 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd4cc066f30 0x7fd4cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:42.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.381+0000 7fd4edc1e700 1 --2- 172.21.15.81:0/2346088578 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd4cc066f30 0x7fd4cc0693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80ae6d0 tx=0x7fd4e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:42.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.385+0000 7fd4ddffb700 1 -- 172.21.15.81:0/2346088578 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4e0051a90 con 0x7fd4e8157ca0 2023-10-07T08:49:42.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.570+0000 7fd4efe82700 1 -- 172.21.15.81:0/2346088578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd4e80b26b0 con 0x7fd4e8157ca0 2023-10-07T08:49:42.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.571+0000 7fd4ddffb700 1 -- 172.21.15.81:0/2346088578 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v141) v1 ==== 81+0+32234 (secure 0 0 0) 0x7fd4e00550b0 con 0x7fd4e8157ca0 2023-10-07T08:49:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:42.572 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:49:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 141, 2023-10-07T08:49:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:49:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:49:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:49:38.286318+0000", 2023-10-07T08:49:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:49:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:49:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:49:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:49:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:49:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:49:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:49:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:49:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:49:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:49:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:49:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:49:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:49:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:49:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 17, 2023-10-07T08:49:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:49:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:49:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:49:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:49:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:49:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:49:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:49:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:49:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:49:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:49:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:49:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:49:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:49:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:49:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:49:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:49:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:49:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:49:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 16, 2023-10-07T08:49:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:49:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:49:12.162742+0000", 2023-10-07T08:49:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:49:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:49:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:49:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:49:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:49:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "137", 2023-10-07T08:49:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:49:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:49:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:49:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:49:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:49:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:49:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 17, 2023-10-07T08:49:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:49:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:49:12.805348+0000", 2023-10-07T08:49:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:49:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:49:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:49:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:49:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:49:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:49:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:49:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:49:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:49:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:49:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:49:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:49:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:49:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:49:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:49:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:49:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:49:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:49:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:49:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:49:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:49:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:49:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:49:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:49:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "141", 2023-10-07T08:49:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:49:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:49:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:49:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:49:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:49:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:49:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:49:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:49:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:49:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-07T08:49:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:49:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:49:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:49:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:49:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:49:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:49:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:49:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:49:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:49:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:49:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:49:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:49:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:49:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:49:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:49:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:49:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:49:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:49:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:49:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:49:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:49:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:49:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:49:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:49:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:49:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:49:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:49:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:49:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:49:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:49:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:49:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:49:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:49:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:49:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:49:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:49:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:49:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:49:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:49:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:49:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:49:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:49:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:49:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:49:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:49:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:49:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:49:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:49:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:49:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:49:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:49:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:49:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:49:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:49:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:49:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:49:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:49:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:49:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:49:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:49:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:49:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:49:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:49:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:49:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:49:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:49:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:49:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:49:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:49:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:49:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:49:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:49:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:49:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:49:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:49:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:49:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:49:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:49:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:49:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:49:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:49:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:49:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:49:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:49:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:49:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:49:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:49:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:49:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:49:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:49:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:49:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:49:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:49:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:49:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:49:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:49:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:49:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:49:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:49:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:49:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:49:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:49:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:49:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:49:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:49:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:49:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:49:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:49:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:49:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:49:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:49:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:49:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:49:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:49:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:49:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:49:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:49:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:49:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:49:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:49:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:49:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:49:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:49:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:49:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:49:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:49:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:49:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:49:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:49:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:49:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:49:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:49:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:49:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:49:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:49:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:49:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:49:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:49:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:49:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:49:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:49:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 136, 2023-10-07T08:49:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:49:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:49:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:49:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:49:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:49:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:49:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:49:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:49:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:49:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:49:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:49:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:49:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:49:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:49:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:49:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:49:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:49:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:49:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:49:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:49:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:49:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:49:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:49:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:49:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:49:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:49:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:49:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:49:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:49:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:49:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:49:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:49:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:49:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:49:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:49:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:49:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:49:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:49:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:49:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:49:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:49:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:49:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:49:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:49:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:49:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:49:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:49:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:49:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:49:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:49:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:49:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:49:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:49:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:49:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:49:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:49:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:49:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:49:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:49:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:49:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:49:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:49:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:49:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:49:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:49:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:49:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:49:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:49:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:49:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:49:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:49:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:49:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:49:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:42.656 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.573+0000 7fd4efe82700 1 -- 172.21.15.81:0/2346088578 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd4cc066f30 msgr2=0x7fd4cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.573+0000 7fd4efe82700 1 --2- 172.21.15.81:0/2346088578 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd4cc066f30 0x7fd4cc0693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80ae6d0 tx=0x7fd4e4009040 comp rx=0 tx=0).stop 2023-10-07T08:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.573+0000 7fd4efe82700 1 -- 172.21.15.81:0/2346088578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4e8157ca0 msgr2=0x7fd4e80b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.573+0000 7fd4efe82700 1 --2- 172.21.15.81:0/2346088578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4e8157ca0 0x7fd4e80b1300 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000c910 tx=0x7fd4e0001710 comp rx=0 tx=0).stop 2023-10-07T08:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.573+0000 7fd4efe82700 1 -- 172.21.15.81:0/2346088578 shutdown_connections 2023-10-07T08:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.573+0000 7fd4efe82700 1 --2- 172.21.15.81:0/2346088578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4e8157ca0 0x7fd4e80b1300 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.573+0000 7fd4efe82700 1 --2- 172.21.15.81:0/2346088578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4e806d120 0x7fd4e814b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.573+0000 7fd4efe82700 1 --2- 172.21.15.81:0/2346088578 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd4cc066f30 0x7fd4cc0693e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.573+0000 7fd4efe82700 1 --2- 172.21.15.81:0/2346088578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4e81578d0 0x7fd4e80b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.573+0000 7fd4efe82700 1 -- 172.21.15.81:0/2346088578 >> 172.21.15.81:0/2346088578 conn(0x7fd4e806bb90 msgr2=0x7fd4e806d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.573+0000 7fd4efe82700 1 -- 172.21.15.81:0/2346088578 shutdown_connections 2023-10-07T08:49:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.573+0000 7fd4efe82700 1 -- 172.21.15.81:0/2346088578 wait complete. 2023-10-07T08:49:42.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:49:42.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.773+0000 7feb2f584700 1 Processor -- start 2023-10-07T08:49:42.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.773+0000 7feb2f584700 1 -- start start 2023-10-07T08:49:42.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.774+0000 7feb2f584700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb2806d830 0x7feb280cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:42.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.774+0000 7feb2f584700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb280d07c0 con 0x7feb28157ca0 2023-10-07T08:49:42.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.774+0000 7feb2f584700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb280cfbb0 con 0x7feb281578d0 2023-10-07T08:49:42.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.774+0000 7feb2f584700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb280cfe90 con 0x7feb2806d830 2023-10-07T08:49:42.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.774+0000 7feb2db21700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb2806d830 0x7feb280cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:42.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.774+0000 7feb2cb1f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feb28157ca0 0x7feb2806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41950/0 (socket says 172.21.15.81:41950) 2023-10-07T08:49:42.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.774+0000 7feb2cb1f700 1 -- 172.21.15.81:0/2161717191 learned_addr learned my addr 172.21.15.81:0/2161717191 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:42.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.774+0000 7feb2db21700 1 -- 172.21.15.81:0/2161717191 >> v1:172.21.15.89:6789/0 conn(0x7feb281578d0 legacy=0x7feb2815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:42.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.774+0000 7feb2db21700 1 -- 172.21.15.81:0/2161717191 >> v1:172.21.15.81:6789/0 conn(0x7feb28157ca0 legacy=0x7feb2806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:42.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.774+0000 7feb2db21700 1 -- 172.21.15.81:0/2161717191 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb280d0170 con 0x7feb2806d830 2023-10-07T08:49:42.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.774+0000 7feb1ffff700 1 -- 172.21.15.81:0/2161717191 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035774037 0 0) 0x7feb280d07c0 con 0x7feb28157ca0 2023-10-07T08:49:42.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.775+0000 7feb2db21700 1 --2- 172.21.15.81:0/2161717191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb2806d830 0x7feb280cf4f0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7feb200098e0 tx=0x7feb200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b510aeafe1cb6f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:42.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.775+0000 7feb1ffff700 1 -- 172.21.15.81:0/2161717191 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb20009e80 con 0x7feb2806d830 2023-10-07T08:49:42.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.775+0000 7feb1ffff700 1 -- 172.21.15.81:0/2161717191 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2000b860 con 0x7feb2806d830 2023-10-07T08:49:42.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.775+0000 7feb1ffff700 1 -- 172.21.15.81:0/2161717191 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2000bbe0 con 0x7feb2806d830 2023-10-07T08:49:42.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.775+0000 7feb2f584700 1 -- 172.21.15.81:0/2161717191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb2806d830 msgr2=0x7feb280cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:42.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.775+0000 7feb2f584700 1 --2- 172.21.15.81:0/2161717191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb2806d830 0x7feb280cf4f0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7feb200098e0 tx=0x7feb200091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:42.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.775+0000 7feb2f584700 1 -- 172.21.15.81:0/2161717191 shutdown_connections 2023-10-07T08:49:42.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.775+0000 7feb2f584700 1 --2- 172.21.15.81:0/2161717191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb2806d830 0x7feb280cf4f0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:42.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.775+0000 7feb2f584700 1 -- 172.21.15.81:0/2161717191 >> 172.21.15.81:0/2161717191 conn(0x7feb2806bb90 msgr2=0x7feb2806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:42.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.775+0000 7feb2f584700 1 -- 172.21.15.81:0/2161717191 shutdown_connections 2023-10-07T08:49:42.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.775+0000 7feb2f584700 1 -- 172.21.15.81:0/2161717191 wait complete. 2023-10-07T08:49:42.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.777+0000 7feb2f584700 1 Processor -- start 2023-10-07T08:49:42.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.777+0000 7feb2f584700 1 -- start start 2023-10-07T08:49:42.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.777+0000 7feb2f584700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb2806d830 0x7feb2814dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.777+0000 7feb2f584700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb281578d0 0x7feb280b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.777+0000 7feb2f584700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb28157ca0 0x7feb28155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.777+0000 7feb2f584700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb280b55b0 con 0x7feb28157ca0 2023-10-07T08:49:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.777+0000 7feb2f584700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2814e280 con 0x7feb2806d830 2023-10-07T08:49:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.777+0000 7feb2f584700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb28152180 con 0x7feb281578d0 2023-10-07T08:49:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb2db21700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb28157ca0 0x7feb28155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb2db21700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb28157ca0 0x7feb28155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35780/0 (socket says 172.21.15.81:35780) 2023-10-07T08:49:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb2db21700 1 -- 172.21.15.81:0/667566623 learned_addr learned my addr 172.21.15.81:0/667566623 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb2d320700 1 --2- 172.21.15.81:0/667566623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb2806d830 0x7feb2814dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb2cb1f700 1 --2- 172.21.15.81:0/667566623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb281578d0 0x7feb280b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb2db21700 1 -- 172.21.15.81:0/667566623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb281578d0 msgr2=0x7feb280b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:42.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb2db21700 1 --2- 172.21.15.81:0/667566623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb281578d0 0x7feb280b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:42.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb2db21700 1 -- 172.21.15.81:0/667566623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb2806d830 msgr2=0x7feb2814dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:42.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb2db21700 1 --2- 172.21.15.81:0/667566623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb2806d830 0x7feb2814dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:42.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb2db21700 1 -- 172.21.15.81:0/667566623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb20009420 con 0x7feb28157ca0 2023-10-07T08:49:42.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb2cb1f700 1 --2- 172.21.15.81:0/667566623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb281578d0 0x7feb280b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:42.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb2db21700 1 --2- 172.21.15.81:0/667566623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb28157ca0 0x7feb28155480 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7feb2806fe20 tx=0x7feb20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:42.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb1d7fa700 1 -- 172.21.15.81:0/667566623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2001f070 con 0x7feb28157ca0 2023-10-07T08:49:42.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb1d7fa700 1 -- 172.21.15.81:0/667566623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2000baa0 con 0x7feb28157ca0 2023-10-07T08:49:42.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb1d7fa700 1 -- 172.21.15.81:0/667566623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb20025670 con 0x7feb28157ca0 2023-10-07T08:49:42.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb2f584700 1 -- 172.21.15.81:0/667566623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb280b52d0 con 0x7feb28157ca0 2023-10-07T08:49:42.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.778+0000 7feb2f584700 1 -- 172.21.15.81:0/667566623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb28151e10 con 0x7feb28157ca0 2023-10-07T08:49:42.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.779+0000 7feb2f584700 1 -- 172.21.15.81:0/667566623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb28151990 con 0x7feb28157ca0 2023-10-07T08:49:42.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.779+0000 7feb1d7fa700 1 -- 172.21.15.81:0/667566623 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb20023070 con 0x7feb28157ca0 2023-10-07T08:49:42.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.780+0000 7feb1d7fa700 1 --2- 172.21.15.81:0/667566623 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb0c066f30 0x7feb0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:42.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.780+0000 7feb1d7fa700 1 -- 172.21.15.81:0/667566623 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb20085cc0 con 0x7feb28157ca0 2023-10-07T08:49:42.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.780+0000 7feb2d320700 1 --2- 172.21.15.81:0/667566623 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb0c066f30 0x7feb0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:42.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.780+0000 7feb2d320700 1 --2- 172.21.15.81:0/667566623 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb0c066f30 0x7feb0c0693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7feb24007fd0 tx=0x7feb240016f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:42.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:42.784+0000 7feb1d7fa700 1 -- 172.21.15.81:0/667566623 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb28151990 con 0x7feb28157ca0 2023-10-07T08:49:43.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.006+0000 7feb2f584700 1 -- 172.21.15.81:0/667566623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb28151990 con 0x7feb28157ca0 2023-10-07T08:49:43.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.007+0000 7feb1d7fa700 1 -- 172.21.15.81:0/667566623 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4599 (secure 0 0 0) 0x7feb28151990 con 0x7feb28157ca0 2023-10-07T08:49:43.007 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:43.007 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1795695306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1795695306},{"type":"v1","addr":"172.21.15.89:6834","nonce":1795695306}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3856313795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3856313795},{"type":"v1","addr":"172.21.15.89:6835","nonce":3856313795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7119,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4143803144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4143803144},{"type":"v1","addr":"172.21.15.81:6836","nonce":4143803144}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:49:13.845110+0000","modified":"2023-10-07T08:49:17.485796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3151244734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3151244734},{"type":"v1","addr":"172.21.15.81:6837","nonce":3151244734}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-07T08:49:43.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.009+0000 7feb2f584700 1 -- 172.21.15.81:0/667566623 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb0c066f30 msgr2=0x7feb0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:43.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.009+0000 7feb2f584700 1 --2- 172.21.15.81:0/667566623 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb0c066f30 0x7feb0c0693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7feb24007fd0 tx=0x7feb240016f0 comp rx=0 tx=0).stop 2023-10-07T08:49:43.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.009+0000 7feb2f584700 1 -- 172.21.15.81:0/667566623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb28157ca0 msgr2=0x7feb28155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:43.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.009+0000 7feb2f584700 1 --2- 172.21.15.81:0/667566623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb28157ca0 0x7feb28155480 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7feb2806fe20 tx=0x7feb20017000 comp rx=0 tx=0).stop 2023-10-07T08:49:43.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.009+0000 7feb2f584700 1 -- 172.21.15.81:0/667566623 shutdown_connections 2023-10-07T08:49:43.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.009+0000 7feb2f584700 1 --2- 172.21.15.81:0/667566623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb28157ca0 0x7feb28155480 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:43.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.009+0000 7feb2f584700 1 --2- 172.21.15.81:0/667566623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb2806d830 0x7feb2814dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:43.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.009+0000 7feb2f584700 1 --2- 172.21.15.81:0/667566623 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb0c066f30 0x7feb0c0693e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:43.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.009+0000 7feb2f584700 1 --2- 172.21.15.81:0/667566623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb281578d0 0x7feb280b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:43.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.009+0000 7feb2f584700 1 -- 172.21.15.81:0/667566623 >> 172.21.15.81:0/667566623 conn(0x7feb2806bb90 msgr2=0x7feb28156090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:43.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.009+0000 7feb2f584700 1 -- 172.21.15.81:0/667566623 shutdown_connections 2023-10-07T08:49:43.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.009+0000 7feb2f584700 1 -- 172.21.15.81:0/667566623 wait complete. 2023-10-07T08:49:43.011 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2023-10-07T08:49:43.021 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-07T08:49:43.154 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":7122,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":28.67056049,"mdsmap_epoch":66,"osdmap_epoch":141,"osdmap_epoch_barrier":140,"uptime":33.803105844999997} 2023-10-07T08:49:43.154 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 7122, "mdsmap_epoch": 66, "osdmap_epoch": 141, "osdmap_epoch_barrier": 140, "rank_uptime": 28.67056049, "state": "up:active", "uptime": 33.803105845, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:49:43.154 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-07T08:49:43.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:49:43.155 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-07T08:49:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records in 2023-10-07T08:49:43.441 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records out 2023-10-07T08:49:43.441 INFO:teuthology.orchestra.run.smithi081.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.269632 s, 194 MB/s 2023-10-07T08:49:43.441 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:49:43.441 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:49:43.476 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:49:43.520 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:49:43.520 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T08:49:43.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:49:43.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T08:49:43.575 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:49:43.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:49:43.575 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T08:49:43.600 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T08:49:43.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:49:43.601 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T08:49:43.643 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:49:43.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:49:43.643 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T08:49:43.698 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:49:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.813+0000 7f7fab2bf700 1 Processor -- start 2023-10-07T08:49:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.813+0000 7f7fab2bf700 1 -- start start 2023-10-07T08:49:43.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fab2bf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa41578d0 0x7f7fa40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:43.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fab2bf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7fa4157ca0 0x7f7fa415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:43.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fab2bf700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa40d07c0 con 0x7f7fa406d120 2023-10-07T08:49:43.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fab2bf700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa40cfbb0 con 0x7f7fa4157ca0 2023-10-07T08:49:43.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fab2bf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa40cfe90 con 0x7f7fa41578d0 2023-10-07T08:49:43.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fa985c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7fa406d120 0x7f7fa415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41954/0 (socket says 172.21.15.81:41954) 2023-10-07T08:49:43.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fa985c700 1 -- 172.21.15.81:0/2568475899 learned_addr learned my addr 172.21.15.81:0/2568475899 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fa885a700 1 --2- 172.21.15.81:0/2568475899 >> v2:172.21.15.89:3300/0 conn(0x7f7fa4157ca0 0x7f7fa415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fa905b700 1 --2- 172.21.15.81:0/2568475899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa41578d0 0x7f7fa40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fa3fff700 1 -- 172.21.15.81:0/2568475899 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376110360 0 0) 0x7f7fa40d07c0 con 0x7f7fa406d120 2023-10-07T08:49:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fa3fff700 1 -- 172.21.15.81:0/2568475899 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f8c003570 con 0x7f7fa406d120 2023-10-07T08:49:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fa905b700 1 -- 172.21.15.81:0/2568475899 >> v2:172.21.15.89:3300/0 conn(0x7f7fa4157ca0 msgr2=0x7f7fa415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fa905b700 1 --2- 172.21.15.81:0/2568475899 >> v2:172.21.15.89:3300/0 conn(0x7f7fa4157ca0 0x7f7fa415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fa905b700 1 -- 172.21.15.81:0/2568475899 >> v1:172.21.15.81:6789/0 conn(0x7f7fa406d120 legacy=0x7f7fa415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fa3fff700 1 -- 172.21.15.81:0/2568475899 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1827534357 0 0) 0x7f7f8c003570 con 0x7f7fa406d120 2023-10-07T08:49:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fa905b700 1 -- 172.21.15.81:0/2568475899 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa40d0170 con 0x7f7fa41578d0 2023-10-07T08:49:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.814+0000 7f7fa885a700 1 --2- 172.21.15.81:0/2568475899 >> v2:172.21.15.89:3300/0 conn(0x7f7fa4157ca0 0x7f7fa415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:49:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.815+0000 7f7fa905b700 1 --2- 172.21.15.81:0/2568475899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa41578d0 0x7f7fa40cf4f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0098e0 tx=0x7f7f9c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6449ae2ab1a6b4e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.815+0000 7f7fa3fff700 1 -- 172.21.15.81:0/2568475899 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f94001470 con 0x7f7fa41578d0 2023-10-07T08:49:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.815+0000 7f7fa3fff700 1 -- 172.21.15.81:0/2568475899 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c011420 con 0x7f7fa41578d0 2023-10-07T08:49:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.815+0000 7f7fa3fff700 1 -- 172.21.15.81:0/2568475899 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0117c0 con 0x7f7fa41578d0 2023-10-07T08:49:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.815+0000 7f7fab2bf700 1 -- 172.21.15.81:0/2568475899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa41578d0 msgr2=0x7f7fa40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.815+0000 7f7fab2bf700 1 --2- 172.21.15.81:0/2568475899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa41578d0 0x7f7fa40cf4f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0098e0 tx=0x7f7f9c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.815+0000 7f7fab2bf700 1 -- 172.21.15.81:0/2568475899 shutdown_connections 2023-10-07T08:49:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.815+0000 7f7fab2bf700 1 --2- 172.21.15.81:0/2568475899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa41578d0 0x7f7fa40cf4f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.815+0000 7f7fab2bf700 1 --2- 172.21.15.81:0/2568475899 >> v2:172.21.15.89:3300/0 conn(0x7f7fa4157ca0 0x7f7fa415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.815+0000 7f7fab2bf700 1 -- 172.21.15.81:0/2568475899 >> 172.21.15.81:0/2568475899 conn(0x7f7fa406bb90 msgr2=0x7f7fa406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.815+0000 7f7fab2bf700 1 -- 172.21.15.81:0/2568475899 shutdown_connections 2023-10-07T08:49:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.815+0000 7f7fab2bf700 1 -- 172.21.15.81:0/2568475899 wait complete. 2023-10-07T08:49:43.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.816+0000 7f7fab2bf700 1 Processor -- start 2023-10-07T08:49:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.816+0000 7f7fab2bf700 1 -- start start 2023-10-07T08:49:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.817+0000 7f7fab2bf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fa406d120 0x7f7fa41478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.817+0000 7f7fab2bf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fa41578d0 0x7f7fa414a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.817+0000 7f7fab2bf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa4157ca0 0x7f7fa4069c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.817+0000 7f7fab2bf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa414a910 con 0x7f7fa41578d0 2023-10-07T08:49:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.817+0000 7f7fab2bf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa4147f40 con 0x7f7fa406d120 2023-10-07T08:49:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.817+0000 7f7fab2bf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa4148220 con 0x7f7fa4157ca0 2023-10-07T08:49:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.817+0000 7f7fa885a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fa41578d0 0x7f7fa414a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.817+0000 7f7fa885a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fa41578d0 0x7f7fa414a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35784/0 (socket says 172.21.15.81:35784) 2023-10-07T08:49:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.817+0000 7f7fa885a700 1 -- 172.21.15.81:0/3728963128 learned_addr learned my addr 172.21.15.81:0/3728963128 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.817+0000 7f7fa905b700 1 --2- 172.21.15.81:0/3728963128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fa406d120 0x7f7fa41478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.817+0000 7f7fa985c700 1 --2- 172.21.15.81:0/3728963128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa4157ca0 0x7f7fa4069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.818+0000 7f7fa885a700 1 -- 172.21.15.81:0/3728963128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa4157ca0 msgr2=0x7f7fa4069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.818+0000 7f7fa885a700 1 --2- 172.21.15.81:0/3728963128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa4157ca0 0x7f7fa4069c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.818+0000 7f7fa885a700 1 -- 172.21.15.81:0/3728963128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fa406d120 msgr2=0x7f7fa41478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.818+0000 7f7fa885a700 1 --2- 172.21.15.81:0/3728963128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fa406d120 0x7f7fa41478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.818+0000 7f7fa885a700 1 -- 172.21.15.81:0/3728963128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f98009a20 con 0x7f7fa41578d0 2023-10-07T08:49:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.818+0000 7f7fa885a700 1 --2- 172.21.15.81:0/3728963128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fa41578d0 0x7f7fa414a3d0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800c0c0 tx=0x7f7f9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.818+0000 7f7fa17fa700 1 -- 172.21.15.81:0/3728963128 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9800cc00 con 0x7f7fa41578d0 2023-10-07T08:49:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.818+0000 7f7fa17fa700 1 -- 172.21.15.81:0/3728963128 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9800f040 con 0x7f7fa41578d0 2023-10-07T08:49:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.818+0000 7f7fab2bf700 1 -- 172.21.15.81:0/3728963128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9c009420 con 0x7f7fa41578d0 2023-10-07T08:49:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.818+0000 7f7fa17fa700 1 -- 172.21.15.81:0/3728963128 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98014480 con 0x7f7fa41578d0 2023-10-07T08:49:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.818+0000 7f7fab2bf700 1 -- 172.21.15.81:0/3728963128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa41487e0 con 0x7f7fa41578d0 2023-10-07T08:49:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.819+0000 7f7fab2bf700 1 -- 172.21.15.81:0/3728963128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa4067ac0 con 0x7f7fa41578d0 2023-10-07T08:49:43.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.819+0000 7f7fa17fa700 1 -- 172.21.15.81:0/3728963128 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f980147f0 con 0x7f7fa41578d0 2023-10-07T08:49:43.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.820+0000 7f7fa17fa700 1 --2- 172.21.15.81:0/3728963128 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7f90066f30 0x7f7f900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:43.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.820+0000 7f7fa17fa700 1 -- 172.21.15.81:0/3728963128 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7f98085170 con 0x7f7fa41578d0 2023-10-07T08:49:43.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.820+0000 7f7fa905b700 1 --2- 172.21.15.81:0/3728963128 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7f90066f30 0x7f7f900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:43.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.820+0000 7f7fa905b700 1 --2- 172.21.15.81:0/3728963128 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7f90066f30 0x7f7f900693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0093f0 tx=0x7f7f9c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:43.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:43.824+0000 7f7fa17fa700 1 -- 172.21.15.81:0/3728963128 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f980523e0 con 0x7f7fa41578d0 2023-10-07T08:49:44.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.052+0000 7f7fab2bf700 1 -- 172.21.15.81:0/3728963128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fa40d0450 con 0x7f7fa41578d0 2023-10-07T08:49:44.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.053+0000 7f7fa17fa700 1 -- 172.21.15.81:0/3728963128 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f7f98055a00 con 0x7f7fa41578d0 2023-10-07T08:49:44.054 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:44.054 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1795695306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1795695306},{"type":"v1","addr":"172.21.15.89:6834","nonce":1795695306}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3856313795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3856313795},{"type":"v1","addr":"172.21.15.89:6835","nonce":3856313795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7119,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4143803144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4143803144},{"type":"v1","addr":"172.21.15.81:6836","nonce":4143803144}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:49:13.845110+0000","modified":"2023-10-07T08:49:17.485796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3151244734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3151244734},{"type":"v1","addr":"172.21.15.81:6837","nonce":3151244734}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-07T08:49:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.054+0000 7f7fab2bf700 1 -- 172.21.15.81:0/3728963128 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7f90066f30 msgr2=0x7f7f900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.055+0000 7f7fab2bf700 1 --2- 172.21.15.81:0/3728963128 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7f90066f30 0x7f7f900693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0093f0 tx=0x7f7f9c016000 comp rx=0 tx=0).stop 2023-10-07T08:49:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.055+0000 7f7fab2bf700 1 -- 172.21.15.81:0/3728963128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fa41578d0 msgr2=0x7f7fa414a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.055+0000 7f7fab2bf700 1 --2- 172.21.15.81:0/3728963128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fa41578d0 0x7f7fa414a3d0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800c0c0 tx=0x7f7f9800b040 comp rx=0 tx=0).stop 2023-10-07T08:49:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.055+0000 7f7fab2bf700 1 -- 172.21.15.81:0/3728963128 shutdown_connections 2023-10-07T08:49:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.055+0000 7f7fab2bf700 1 --2- 172.21.15.81:0/3728963128 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7f90066f30 0x7f7f900693e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.055+0000 7f7fab2bf700 1 --2- 172.21.15.81:0/3728963128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa4157ca0 0x7f7fa4069c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.055+0000 7f7fab2bf700 1 --2- 172.21.15.81:0/3728963128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fa406d120 0x7f7fa41478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.055+0000 7f7fab2bf700 1 --2- 172.21.15.81:0/3728963128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fa41578d0 0x7f7fa414a3d0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.055+0000 7f7fab2bf700 1 -- 172.21.15.81:0/3728963128 >> 172.21.15.81:0/3728963128 conn(0x7f7fa406bb90 msgr2=0x7f7fa4068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.055+0000 7f7fab2bf700 1 -- 172.21.15.81:0/3728963128 shutdown_connections 2023-10-07T08:49:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.055+0000 7f7fab2bf700 1 -- 172.21.15.81:0/3728963128 wait complete. 2023-10-07T08:49:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2023-10-07T08:49:44.068 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:49:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.182+0000 7fd83b7da700 1 Processor -- start 2023-10-07T08:49:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.182+0000 7fd83b7da700 1 -- start start 2023-10-07T08:49:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.183+0000 7fd83b7da700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd834157fe0 0x7fd8340b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.183+0000 7fd83b7da700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd8340cf240 0x7fd8340b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.183+0000 7fd83b7da700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8340b2890 con 0x7fd8341583b0 2023-10-07T08:49:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.183+0000 7fd83b7da700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8340b4070 con 0x7fd8340cf240 2023-10-07T08:49:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.183+0000 7fd83b7da700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340b4350 con 0x7fd834157fe0 2023-10-07T08:49:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.183+0000 7fd838d75700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd8341583b0 0x7fd8340ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41956/0 (socket says 172.21.15.81:41956) 2023-10-07T08:49:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.183+0000 7fd838d75700 1 -- 172.21.15.81:0/1294200758 learned_addr learned my addr 172.21.15.81:0/1294200758 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.183+0000 7fd839576700 1 --2- 172.21.15.81:0/1294200758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd834157fe0 0x7fd8340b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.183+0000 7fd839d77700 1 --2- 172.21.15.81:0/1294200758 >> v2:172.21.15.89:3300/0 conn(0x7fd8340cf240 0x7fd8340b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.183+0000 7fd82bfff700 1 -- 172.21.15.81:0/1294200758 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511930729 0 0) 0x7fd8340b2890 con 0x7fd8341583b0 2023-10-07T08:49:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.183+0000 7fd82bfff700 1 -- 172.21.15.81:0/1294200758 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd820003570 con 0x7fd8341583b0 2023-10-07T08:49:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.183+0000 7fd839576700 1 -- 172.21.15.81:0/1294200758 >> v2:172.21.15.89:3300/0 conn(0x7fd8340cf240 msgr2=0x7fd8340b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.183+0000 7fd839576700 1 --2- 172.21.15.81:0/1294200758 >> v2:172.21.15.89:3300/0 conn(0x7fd8340cf240 0x7fd8340b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.183+0000 7fd839576700 1 -- 172.21.15.81:0/1294200758 >> v1:172.21.15.81:6789/0 conn(0x7fd8341583b0 legacy=0x7fd8340ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.183+0000 7fd839576700 1 -- 172.21.15.81:0/1294200758 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340b4630 con 0x7fd834157fe0 2023-10-07T08:49:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.183+0000 7fd839576700 1 --2- 172.21.15.81:0/1294200758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd834157fe0 0x7fd8340b34c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd8300098e0 tx=0x7fd8300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16d94730ca3d0041 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.184+0000 7fd82bfff700 1 -- 172.21.15.81:0/1294200758 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830011630 con 0x7fd834157fe0 2023-10-07T08:49:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.184+0000 7fd82bfff700 1 -- 172.21.15.81:0/1294200758 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd830011790 con 0x7fd834157fe0 2023-10-07T08:49:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.184+0000 7fd82bfff700 1 -- 172.21.15.81:0/1294200758 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830011b30 con 0x7fd834157fe0 2023-10-07T08:49:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.184+0000 7fd83b7da700 1 -- 172.21.15.81:0/1294200758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd834157fe0 msgr2=0x7fd8340b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.184+0000 7fd83b7da700 1 --2- 172.21.15.81:0/1294200758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd834157fe0 0x7fd8340b34c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd8300098e0 tx=0x7fd8300091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.184+0000 7fd83b7da700 1 -- 172.21.15.81:0/1294200758 shutdown_connections 2023-10-07T08:49:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.184+0000 7fd83b7da700 1 --2- 172.21.15.81:0/1294200758 >> v2:172.21.15.89:3300/0 conn(0x7fd8340cf240 0x7fd8340b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.184+0000 7fd83b7da700 1 --2- 172.21.15.81:0/1294200758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd834157fe0 0x7fd8340b34c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.184+0000 7fd83b7da700 1 -- 172.21.15.81:0/1294200758 >> 172.21.15.81:0/1294200758 conn(0x7fd834067640 msgr2=0x7fd834067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.184+0000 7fd83b7da700 1 -- 172.21.15.81:0/1294200758 shutdown_connections 2023-10-07T08:49:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.184+0000 7fd83b7da700 1 -- 172.21.15.81:0/1294200758 wait complete. 2023-10-07T08:49:44.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.185+0000 7fd83b7da700 1 Processor -- start 2023-10-07T08:49:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.185+0000 7fd83b7da700 1 -- start start 2023-10-07T08:49:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.186+0000 7fd83b7da700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8340cf240 0x7fd8340c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.186+0000 7fd83b7da700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd834157fe0 0x7fd83414ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.186+0000 7fd83b7da700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8341583b0 0x7fd8340cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.186+0000 7fd83b7da700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340c5920 con 0x7fd8340cf240 2023-10-07T08:49:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.186+0000 7fd83b7da700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340c7520 con 0x7fd8341583b0 2023-10-07T08:49:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.186+0000 7fd83b7da700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340c4570 con 0x7fd834157fe0 2023-10-07T08:49:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.186+0000 7fd839576700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8340cf240 0x7fd8340c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.186+0000 7fd839576700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8340cf240 0x7fd8340c9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35796/0 (socket says 172.21.15.81:35796) 2023-10-07T08:49:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.186+0000 7fd839576700 1 -- 172.21.15.81:0/758119767 learned_addr learned my addr 172.21.15.81:0/758119767 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.186+0000 7fd839d77700 1 --2- 172.21.15.81:0/758119767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8341583b0 0x7fd8340cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.186+0000 7fd838d75700 1 --2- 172.21.15.81:0/758119767 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd834157fe0 0x7fd83414ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.187+0000 7fd839576700 1 -- 172.21.15.81:0/758119767 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd834157fe0 msgr2=0x7fd83414ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.187+0000 7fd839576700 1 --2- 172.21.15.81:0/758119767 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd834157fe0 0x7fd83414ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.187+0000 7fd839576700 1 -- 172.21.15.81:0/758119767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8341583b0 msgr2=0x7fd8340cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.187+0000 7fd839576700 1 --2- 172.21.15.81:0/758119767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8341583b0 0x7fd8340cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.187+0000 7fd839576700 1 -- 172.21.15.81:0/758119767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd830009420 con 0x7fd8340cf240 2023-10-07T08:49:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.187+0000 7fd838d75700 1 --2- 172.21.15.81:0/758119767 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd834157fe0 0x7fd83414ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.187+0000 7fd839576700 1 --2- 172.21.15.81:0/758119767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8340cf240 0x7fd8340c9f90 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd830009ed0 tx=0x7fd830017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.187+0000 7fd8297fa700 1 -- 172.21.15.81:0/758119767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830011b10 con 0x7fd8340cf240 2023-10-07T08:49:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.187+0000 7fd8297fa700 1 -- 172.21.15.81:0/758119767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8300253f0 con 0x7fd8340cf240 2023-10-07T08:49:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.187+0000 7fd8297fa700 1 -- 172.21.15.81:0/758119767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8300257b0 con 0x7fd8340cf240 2023-10-07T08:49:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.187+0000 7fd83b7da700 1 -- 172.21.15.81:0/758119767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8340c4850 con 0x7fd8340cf240 2023-10-07T08:49:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.187+0000 7fd83b7da700 1 -- 172.21.15.81:0/758119767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8340c4bb0 con 0x7fd8340cf240 2023-10-07T08:49:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.188+0000 7fd83b7da700 1 -- 172.21.15.81:0/758119767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8340c79e0 con 0x7fd8340cf240 2023-10-07T08:49:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.188+0000 7fd8297fa700 1 -- 172.21.15.81:0/758119767 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd830025b60 con 0x7fd8340cf240 2023-10-07T08:49:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.189+0000 7fd8297fa700 1 --2- 172.21.15.81:0/758119767 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd818066fb0 0x7fd818069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.189+0000 7fd838d75700 1 --2- 172.21.15.81:0/758119767 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd818066fb0 0x7fd818069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.189+0000 7fd8297fa700 1 -- 172.21.15.81:0/758119767 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd830085db0 con 0x7fd8340cf240 2023-10-07T08:49:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.189+0000 7fd838d75700 1 --2- 172.21.15.81:0/758119767 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd818066fb0 0x7fd818069460 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd824007fd0 tx=0x7fd824009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.193+0000 7fd8297fa700 1 -- 172.21.15.81:0/758119767 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd830052f80 con 0x7fd8340cf240 2023-10-07T08:49:44.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.377+0000 7fd83b7da700 1 -- 172.21.15.81:0/758119767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd834158bd0 con 0x7fd8340cf240 2023-10-07T08:49:44.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.378+0000 7fd8297fa700 1 -- 172.21.15.81:0/758119767 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+15324 (secure 0 0 0) 0x7fd830015090 con 0x7fd8340cf240 2023-10-07T08:49:44.379 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":141,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:49:38.286318+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:49:12.162742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-07T08:49:12.805348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:49:44.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.380+0000 7fd83b7da700 1 -- 172.21.15.81:0/758119767 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd818066fb0 msgr2=0x7fd818069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.380+0000 7fd83b7da700 1 --2- 172.21.15.81:0/758119767 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd818066fb0 0x7fd818069460 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd824007fd0 tx=0x7fd824009040 comp rx=0 tx=0).stop 2023-10-07T08:49:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.380+0000 7fd83b7da700 1 -- 172.21.15.81:0/758119767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8340cf240 msgr2=0x7fd8340c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.380+0000 7fd83b7da700 1 --2- 172.21.15.81:0/758119767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8340cf240 0x7fd8340c9f90 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd830009ed0 tx=0x7fd830017000 comp rx=0 tx=0).stop 2023-10-07T08:49:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.380+0000 7fd83b7da700 1 -- 172.21.15.81:0/758119767 shutdown_connections 2023-10-07T08:49:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.380+0000 7fd83b7da700 1 --2- 172.21.15.81:0/758119767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8341583b0 0x7fd8340cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.380+0000 7fd83b7da700 1 --2- 172.21.15.81:0/758119767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8340cf240 0x7fd8340c9f90 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.380+0000 7fd83b7da700 1 --2- 172.21.15.81:0/758119767 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd818066fb0 0x7fd818069460 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.380+0000 7fd83b7da700 1 --2- 172.21.15.81:0/758119767 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd834157fe0 0x7fd83414ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.380+0000 7fd83b7da700 1 -- 172.21.15.81:0/758119767 >> 172.21.15.81:0/758119767 conn(0x7fd834067640 msgr2=0x7fd8340cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.380+0000 7fd83b7da700 1 -- 172.21.15.81:0/758119767 shutdown_connections 2023-10-07T08:49:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.380+0000 7fd83b7da700 1 -- 172.21.15.81:0/758119767 wait complete. 2023-10-07T08:49:44.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:49:12.162742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:49:12.805348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:49:44.393 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:49:44.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.510+0000 7f385946a700 1 Processor -- start 2023-10-07T08:49:44.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.510+0000 7f385946a700 1 -- start start 2023-10-07T08:49:44.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.510+0000 7f385946a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f385415daa0 0x7f385415de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.510+0000 7f385946a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38540cae00 0x7f3854159540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.510+0000 7f385946a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f38540cb270 0x7f3854159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.510+0000 7f385946a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385406d350 con 0x7f38540cae00 2023-10-07T08:49:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.510+0000 7f385946a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38540c9ac0 con 0x7f38540cb270 2023-10-07T08:49:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.510+0000 7f385946a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385415e3b0 con 0x7f385415daa0 2023-10-07T08:49:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.511+0000 7f384a7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38540cae00 0x7f3854159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.511+0000 7f384a7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38540cae00 0x7f3854159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35806/0 (socket says 172.21.15.81:35806) 2023-10-07T08:49:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.511+0000 7f384a7fc700 1 -- 172.21.15.81:0/3187422119 learned_addr learned my addr 172.21.15.81:0/3187422119 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.511+0000 7f3852ffd700 1 --2- 172.21.15.81:0/3187422119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f385415daa0 0x7f385415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.511+0000 7f38537fe700 1 --2- 172.21.15.81:0/3187422119 >> v2:172.21.15.89:3300/0 conn(0x7f38540cb270 0x7f3854159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.511+0000 7f384a7fc700 1 -- 172.21.15.81:0/3187422119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f385415daa0 msgr2=0x7f385415de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.511+0000 7f384a7fc700 1 --2- 172.21.15.81:0/3187422119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f385415daa0 0x7f385415de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.511+0000 7f384a7fc700 1 -- 172.21.15.81:0/3187422119 >> v2:172.21.15.89:3300/0 conn(0x7f38540cb270 msgr2=0x7f3854159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.511+0000 7f384a7fc700 1 --2- 172.21.15.81:0/3187422119 >> v2:172.21.15.89:3300/0 conn(0x7f38540cb270 0x7f3854159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.511+0000 7f384a7fc700 1 -- 172.21.15.81:0/3187422119 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385406c740 con 0x7f38540cae00 2023-10-07T08:49:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.511+0000 7f384a7fc700 1 --2- 172.21.15.81:0/3187422119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38540cae00 0x7f3854159540 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f385406d980 tx=0x7f383c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da04fb461208e45b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.511+0000 7f38527fc700 1 -- 172.21.15.81:0/3187422119 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c00b640 con 0x7f38540cae00 2023-10-07T08:49:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.511+0000 7f38527fc700 1 -- 172.21.15.81:0/3187422119 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c00b7a0 con 0x7f38540cae00 2023-10-07T08:49:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.511+0000 7f38527fc700 1 -- 172.21.15.81:0/3187422119 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c00bb60 con 0x7f38540cae00 2023-10-07T08:49:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.512+0000 7f385946a700 1 -- 172.21.15.81:0/3187422119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38540cae00 msgr2=0x7f3854159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.512+0000 7f385946a700 1 --2- 172.21.15.81:0/3187422119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38540cae00 0x7f3854159540 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f385406d980 tx=0x7f383c009250 comp rx=0 tx=0).stop 2023-10-07T08:49:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.512+0000 7f385946a700 1 -- 172.21.15.81:0/3187422119 shutdown_connections 2023-10-07T08:49:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.512+0000 7f385946a700 1 --2- 172.21.15.81:0/3187422119 >> v2:172.21.15.89:3300/0 conn(0x7f38540cb270 0x7f3854159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.512+0000 7f385946a700 1 --2- 172.21.15.81:0/3187422119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f385415daa0 0x7f385415de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.512+0000 7f385946a700 1 --2- 172.21.15.81:0/3187422119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38540cae00 0x7f3854159540 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.512+0000 7f385946a700 1 -- 172.21.15.81:0/3187422119 >> 172.21.15.81:0/3187422119 conn(0x7f38540c9ca0 msgr2=0x7f38540ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:44.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.512+0000 7f385946a700 1 -- 172.21.15.81:0/3187422119 shutdown_connections 2023-10-07T08:49:44.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.512+0000 7f385946a700 1 -- 172.21.15.81:0/3187422119 wait complete. 2023-10-07T08:49:44.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.513+0000 7f385946a700 1 Processor -- start 2023-10-07T08:49:44.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.513+0000 7f385946a700 1 -- start start 2023-10-07T08:49:44.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f385946a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38540cae00 0x7f385416adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f385946a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38540cb270 0x7f38540af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f385946a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f385415daa0 0x7f38540c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f385946a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3854158900 con 0x7f38540cb270 2023-10-07T08:49:44.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f385946a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38540c4630 con 0x7f385415daa0 2023-10-07T08:49:44.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f385946a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38540c5a70 con 0x7f38540cae00 2023-10-07T08:49:44.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f384a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38540cb270 0x7f38540af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f384a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38540cb270 0x7f38540af360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35816/0 (socket says 172.21.15.81:35816) 2023-10-07T08:49:44.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f384a7fc700 1 -- 172.21.15.81:0/233829586 learned_addr learned my addr 172.21.15.81:0/233829586 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:44.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f38537fe700 1 --2- 172.21.15.81:0/233829586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f385415daa0 0x7f38540c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f3852ffd700 1 --2- 172.21.15.81:0/233829586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38540cae00 0x7f385416adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f384a7fc700 1 -- 172.21.15.81:0/233829586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38540cae00 msgr2=0x7f385416adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f384a7fc700 1 --2- 172.21.15.81:0/233829586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38540cae00 0x7f385416adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f384a7fc700 1 -- 172.21.15.81:0/233829586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f385415daa0 msgr2=0x7f38540c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f384a7fc700 1 --2- 172.21.15.81:0/233829586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f385415daa0 0x7f38540c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f384a7fc700 1 -- 172.21.15.81:0/233829586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c0094f0 con 0x7f38540cb270 2023-10-07T08:49:44.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f3852ffd700 1 --2- 172.21.15.81:0/233829586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38540cae00 0x7f385416adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:44.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f384a7fc700 1 --2- 172.21.15.81:0/233829586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38540cb270 0x7f38540af360 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f385406ebb0 tx=0x7f383c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:44.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f384b7fe700 1 -- 172.21.15.81:0/233829586 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c000d10 con 0x7f38540cb270 2023-10-07T08:49:44.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f384b7fe700 1 -- 172.21.15.81:0/233829586 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c00bb20 con 0x7f38540cb270 2023-10-07T08:49:44.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f384b7fe700 1 -- 172.21.15.81:0/233829586 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c011670 con 0x7f38540cb270 2023-10-07T08:49:44.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f385946a700 1 -- 172.21.15.81:0/233829586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385416b300 con 0x7f38540cb270 2023-10-07T08:49:44.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.514+0000 7f385946a700 1 -- 172.21.15.81:0/233829586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38540c51c0 con 0x7f38540cb270 2023-10-07T08:49:44.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.515+0000 7f385946a700 1 -- 172.21.15.81:0/233829586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3854068080 con 0x7f38540cb270 2023-10-07T08:49:44.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.516+0000 7f384b7fe700 1 -- 172.21.15.81:0/233829586 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f383c0119e0 con 0x7f38540cb270 2023-10-07T08:49:44.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.516+0000 7f384b7fe700 1 --2- 172.21.15.81:0/233829586 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3834066f30 0x7f38340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.516+0000 7f384b7fe700 1 -- 172.21.15.81:0/233829586 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f383c085c70 con 0x7f38540cb270 2023-10-07T08:49:44.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.516+0000 7f3852ffd700 1 --2- 172.21.15.81:0/233829586 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3834066f30 0x7f38340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.516+0000 7f3852ffd700 1 --2- 172.21.15.81:0/233829586 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3834066f30 0x7f38340693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f38540c78e0 tx=0x7f3844008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:44.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.520+0000 7f384b7fe700 1 -- 172.21.15.81:0/233829586 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f383c052ee0 con 0x7f38540cb270 2023-10-07T08:49:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.704+0000 7f385946a700 1 -- 172.21.15.81:0/233829586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f385404bb80 con 0x7f38540cb270 2023-10-07T08:49:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.704+0000 7f384b7fe700 1 -- 172.21.15.81:0/233829586 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v142) v1 ==== 93+0+10 (secure 0 0 0) 0x7f383c056500 con 0x7f38540cb270 2023-10-07T08:49:44.706 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:49:44.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.706+0000 7f385946a700 1 -- 172.21.15.81:0/233829586 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3834066f30 msgr2=0x7f38340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.706+0000 7f385946a700 1 --2- 172.21.15.81:0/233829586 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3834066f30 0x7f38340693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f38540c78e0 tx=0x7f3844008040 comp rx=0 tx=0).stop 2023-10-07T08:49:44.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.706+0000 7f385946a700 1 -- 172.21.15.81:0/233829586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38540cb270 msgr2=0x7f38540af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.706+0000 7f385946a700 1 --2- 172.21.15.81:0/233829586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38540cb270 0x7f38540af360 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f385406ebb0 tx=0x7f383c017000 comp rx=0 tx=0).stop 2023-10-07T08:49:44.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.706+0000 7f385946a700 1 -- 172.21.15.81:0/233829586 shutdown_connections 2023-10-07T08:49:44.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.706+0000 7f385946a700 1 --2- 172.21.15.81:0/233829586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f385415daa0 0x7f38540c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.706+0000 7f385946a700 1 --2- 172.21.15.81:0/233829586 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3834066f30 0x7f38340693e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.706+0000 7f385946a700 1 --2- 172.21.15.81:0/233829586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38540cae00 0x7f385416adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.706+0000 7f385946a700 1 --2- 172.21.15.81:0/233829586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38540cb270 0x7f38540af360 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.706+0000 7f385946a700 1 -- 172.21.15.81:0/233829586 >> 172.21.15.81:0/233829586 conn(0x7f38540c9ca0 msgr2=0x7f38540c8520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:44.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.706+0000 7f385946a700 1 -- 172.21.15.81:0/233829586 shutdown_connections 2023-10-07T08:49:44.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.706+0000 7f385946a700 1 -- 172.21.15.81:0/233829586 wait complete. 2023-10-07T08:49:44.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:49:44.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.837+0000 7f3fde405700 1 Processor -- start 2023-10-07T08:49:44.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.837+0000 7f3fde405700 1 -- start start 2023-10-07T08:49:44.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.838+0000 7f3fde405700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fd80d0b80 0x7f3fd80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.838+0000 7f3fde405700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3fd806d700 0x7f3fd815b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.838+0000 7f3fde405700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd80cf2d0 con 0x7f3fd80d02b0 2023-10-07T08:49:44.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.838+0000 7f3fde405700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd815a690 con 0x7f3fd806d700 2023-10-07T08:49:44.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.838+0000 7f3fde405700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd806dc00 con 0x7f3fd80d0b80 2023-10-07T08:49:44.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.838+0000 7f3fdcc02700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3fd80d02b0 0x7f3fd806cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41968/0 (socket says 172.21.15.81:41968) 2023-10-07T08:49:44.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.838+0000 7f3fdcc02700 1 -- 172.21.15.81:0/4026158546 learned_addr learned my addr 172.21.15.81:0/4026158546 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:44.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.838+0000 7f3fddc04700 1 --2- 172.21.15.81:0/4026158546 >> v2:172.21.15.89:3300/0 conn(0x7f3fd806d700 0x7f3fd815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.838+0000 7f3fdd403700 1 --2- 172.21.15.81:0/4026158546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fd80d0b80 0x7f3fd80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.839+0000 7f3fcffff700 1 -- 172.21.15.81:0/4026158546 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593849976 0 0) 0x7f3fd80cf2d0 con 0x7f3fd80d02b0 2023-10-07T08:49:44.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.839+0000 7f3fcffff700 1 -- 172.21.15.81:0/4026158546 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fc4003570 con 0x7f3fd80d02b0 2023-10-07T08:49:44.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.839+0000 7f3fddc04700 1 -- 172.21.15.81:0/4026158546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fd80d0b80 msgr2=0x7f3fd80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:44.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.839+0000 7f3fddc04700 1 --2- 172.21.15.81:0/4026158546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fd80d0b80 0x7f3fd80cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.839+0000 7f3fddc04700 1 -- 172.21.15.81:0/4026158546 >> v1:172.21.15.81:6789/0 conn(0x7f3fd80d02b0 legacy=0x7f3fd806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.839+0000 7f3fddc04700 1 -- 172.21.15.81:0/4026158546 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd80cf570 con 0x7f3fd806d700 2023-10-07T08:49:44.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.839+0000 7f3fdd403700 1 --2- 172.21.15.81:0/4026158546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fd80d0b80 0x7f3fd80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:49:44.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.839+0000 7f3fddc04700 1 --2- 172.21.15.81:0/4026158546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fd806d700 0x7f3fd815b320 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009e60 tx=0x7f3fd0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4fab2d0f9fb59d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:44.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.839+0000 7f3fcffff700 1 -- 172.21.15.81:0/4026158546 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000e070 con 0x7f3fd806d700 2023-10-07T08:49:44.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.839+0000 7f3fcffff700 1 -- 172.21.15.81:0/4026158546 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd000bab0 con 0x7f3fd806d700 2023-10-07T08:49:44.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.839+0000 7f3fcffff700 1 -- 172.21.15.81:0/4026158546 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000be70 con 0x7f3fd806d700 2023-10-07T08:49:44.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.840+0000 7f3fde405700 1 -- 172.21.15.81:0/4026158546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fd806d700 msgr2=0x7f3fd815b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.840+0000 7f3fde405700 1 --2- 172.21.15.81:0/4026158546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fd806d700 0x7f3fd815b320 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009e60 tx=0x7f3fd0009780 comp rx=0 tx=0).stop 2023-10-07T08:49:44.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.840+0000 7f3fde405700 1 -- 172.21.15.81:0/4026158546 shutdown_connections 2023-10-07T08:49:44.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.840+0000 7f3fde405700 1 --2- 172.21.15.81:0/4026158546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fd806d700 0x7f3fd815b320 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.840+0000 7f3fde405700 1 --2- 172.21.15.81:0/4026158546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fd80d0b80 0x7f3fd80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.840+0000 7f3fde405700 1 -- 172.21.15.81:0/4026158546 >> 172.21.15.81:0/4026158546 conn(0x7f3fd8063230 msgr2=0x7f3fd8063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:44.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.840+0000 7f3fde405700 1 -- 172.21.15.81:0/4026158546 shutdown_connections 2023-10-07T08:49:44.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.840+0000 7f3fde405700 1 -- 172.21.15.81:0/4026158546 wait complete. 2023-10-07T08:49:44.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.841+0000 7f3fde405700 1 Processor -- start 2023-10-07T08:49:44.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.841+0000 7f3fde405700 1 -- start start 2023-10-07T08:49:44.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fde405700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd806d700 0x7f3fd814a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fde405700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fd80d02b0 0x7f3fd814af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fde405700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fd80d0b80 0x7f3fd814b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fde405700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd80b1650 con 0x7f3fd806d700 2023-10-07T08:49:44.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fde405700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd8149c30 con 0x7f3fd80d02b0 2023-10-07T08:49:44.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fde405700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd8149020 con 0x7f3fd80d0b80 2023-10-07T08:49:44.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fdd403700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd806d700 0x7f3fd814a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fdd403700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd806d700 0x7f3fd814a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35818/0 (socket says 172.21.15.81:35818) 2023-10-07T08:49:44.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fdd403700 1 -- 172.21.15.81:0/2725009332 learned_addr learned my addr 172.21.15.81:0/2725009332 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:44.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fddc04700 1 --2- 172.21.15.81:0/2725009332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fd80d0b80 0x7f3fd814b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fdcc02700 1 --2- 172.21.15.81:0/2725009332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fd80d02b0 0x7f3fd814af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fdd403700 1 -- 172.21.15.81:0/2725009332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fd80d0b80 msgr2=0x7f3fd814b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fdd403700 1 --2- 172.21.15.81:0/2725009332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fd80d0b80 0x7f3fd814b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fdd403700 1 -- 172.21.15.81:0/2725009332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fd80d02b0 msgr2=0x7f3fd814af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:44.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fdd403700 1 --2- 172.21.15.81:0/2725009332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fd80d02b0 0x7f3fd814af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:44.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fdd403700 1 -- 172.21.15.81:0/2725009332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd4009420 con 0x7f3fd806d700 2023-10-07T08:49:44.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fdcc02700 1 --2- 172.21.15.81:0/2725009332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fd80d02b0 0x7f3fd814af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:44.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.842+0000 7f3fdd403700 1 --2- 172.21.15.81:0/2725009332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd806d700 0x7f3fd814a0c0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400ec80 tx=0x7f3fd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:44.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.843+0000 7f3fcd7fa700 1 -- 172.21.15.81:0/2725009332 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd400c850 con 0x7f3fd806d700 2023-10-07T08:49:44.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.843+0000 7f3fcd7fa700 1 -- 172.21.15.81:0/2725009332 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd400c9b0 con 0x7f3fd806d700 2023-10-07T08:49:44.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.843+0000 7f3fde405700 1 -- 172.21.15.81:0/2725009332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd0009a20 con 0x7f3fd806d700 2023-10-07T08:49:44.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.843+0000 7f3fcd7fa700 1 -- 172.21.15.81:0/2725009332 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd400cd30 con 0x7f3fd806d700 2023-10-07T08:49:44.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.843+0000 7f3fde405700 1 -- 172.21.15.81:0/2725009332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd81498c0 con 0x7f3fd806d700 2023-10-07T08:49:44.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.844+0000 7f3fde405700 1 -- 172.21.15.81:0/2725009332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd806e2d0 con 0x7f3fd806d700 2023-10-07T08:49:44.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.844+0000 7f3fcd7fa700 1 -- 172.21.15.81:0/2725009332 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fd4013680 con 0x7f3fd806d700 2023-10-07T08:49:44.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.844+0000 7f3fcd7fa700 1 --2- 172.21.15.81:0/2725009332 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3fbc066f30 0x7f3fbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:44.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.844+0000 7f3fcd7fa700 1 -- 172.21.15.81:0/2725009332 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f3fd4084830 con 0x7f3fd806d700 2023-10-07T08:49:44.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.844+0000 7f3fdcc02700 1 --2- 172.21.15.81:0/2725009332 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3fbc066f30 0x7f3fbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:44.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.845+0000 7f3fdcc02700 1 --2- 172.21.15.81:0/2725009332 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3fbc066f30 0x7f3fbc0693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80ce2e0 tx=0x7f3fc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:44.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:44.849+0000 7f3fcd7fa700 1 -- 172.21.15.81:0/2725009332 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fd40554f0 con 0x7f3fd806d700 2023-10-07T08:49:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.028+0000 7f3fde405700 1 -- 172.21.15.81:0/2725009332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3fd8149f10 con 0x7f3fd806d700 2023-10-07T08:49:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.028+0000 7f3fcd7fa700 1 -- 172.21.15.81:0/2725009332 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v142) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3fd4055080 con 0x7f3fd806d700 2023-10-07T08:49:45.029 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:49:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.030+0000 7f3fde405700 1 -- 172.21.15.81:0/2725009332 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3fbc066f30 msgr2=0x7f3fbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.030+0000 7f3fde405700 1 --2- 172.21.15.81:0/2725009332 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3fbc066f30 0x7f3fbc0693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80ce2e0 tx=0x7f3fc8009040 comp rx=0 tx=0).stop 2023-10-07T08:49:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.030+0000 7f3fde405700 1 -- 172.21.15.81:0/2725009332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd806d700 msgr2=0x7f3fd814a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.030+0000 7f3fde405700 1 --2- 172.21.15.81:0/2725009332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd806d700 0x7f3fd814a0c0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400ec80 tx=0x7f3fd40091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.030+0000 7f3fde405700 1 -- 172.21.15.81:0/2725009332 shutdown_connections 2023-10-07T08:49:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.030+0000 7f3fde405700 1 --2- 172.21.15.81:0/2725009332 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3fbc066f30 0x7f3fbc0693e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.030+0000 7f3fde405700 1 --2- 172.21.15.81:0/2725009332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fd80d0b80 0x7f3fd814b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.030+0000 7f3fde405700 1 --2- 172.21.15.81:0/2725009332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fd806d700 0x7f3fd814a0c0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.030+0000 7f3fde405700 1 --2- 172.21.15.81:0/2725009332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fd80d02b0 0x7f3fd814af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.030+0000 7f3fde405700 1 -- 172.21.15.81:0/2725009332 >> 172.21.15.81:0/2725009332 conn(0x7f3fd8063230 msgr2=0x7f3fd806cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.030+0000 7f3fde405700 1 -- 172.21.15.81:0/2725009332 shutdown_connections 2023-10-07T08:49:45.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.030+0000 7f3fde405700 1 -- 172.21.15.81:0/2725009332 wait complete. 2023-10-07T08:49:45.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:49:45.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.159+0000 7f799eb1c700 1 Processor -- start 2023-10-07T08:49:45.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.159+0000 7f799eb1c700 1 -- start start 2023-10-07T08:49:45.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f799eb1c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7998157ca0 0x7f79980cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f799eb1c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79980d07c0 con 0x7f79981578d0 2023-10-07T08:49:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f799eb1c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79980cfbb0 con 0x7f799806d120 2023-10-07T08:49:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f799eb1c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79980cfe90 con 0x7f7998157ca0 2023-10-07T08:49:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f799c8b8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f79981578d0 0x7f799815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41982/0 (socket says 172.21.15.81:41982) 2023-10-07T08:49:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f799c8b8700 1 -- 172.21.15.81:0/4191548268 learned_addr learned my addr 172.21.15.81:0/4191548268 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f79977fe700 1 -- 172.21.15.81:0/4191548268 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385723857 0 0) 0x7f79980d07c0 con 0x7f79981578d0 2023-10-07T08:49:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f79977fe700 1 -- 172.21.15.81:0/4191548268 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7988003570 con 0x7f79981578d0 2023-10-07T08:49:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f7997fff700 1 --2- 172.21.15.81:0/4191548268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7998157ca0 0x7f79980cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f79977fe700 1 -- 172.21.15.81:0/4191548268 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3116862809 0 0) 0x7f7988003570 con 0x7f79981578d0 2023-10-07T08:49:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f79977fe700 1 -- 172.21.15.81:0/4191548268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7998157ca0 msgr2=0x7f79980cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f79977fe700 1 --2- 172.21.15.81:0/4191548268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7998157ca0 0x7f79980cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f79977fe700 1 -- 172.21.15.81:0/4191548268 >> v1:172.21.15.89:6789/0 conn(0x7f799806d120 legacy=0x7f799815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f79977fe700 1 -- 172.21.15.81:0/4191548268 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79980d0170 con 0x7f79981578d0 2023-10-07T08:49:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f79977fe700 1 -- 172.21.15.81:0/4191548268 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f798c001470 con 0x7f79981578d0 2023-10-07T08:49:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f79977fe700 1 -- 172.21.15.81:0/4191548268 >> v1:172.21.15.81:6789/0 conn(0x7f79981578d0 legacy=0x7f799815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f79977fe700 1 --2- 172.21.15.81:0/4191548268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7998157ca0 0x7f7988003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f79977fe700 1 --2- 172.21.15.81:0/4191548268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7988004010 0x7f7988004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f79977fe700 1 --2- 172.21.15.81:0/4191548268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7988004d50 0x7f79880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f79977fe700 1 -- 172.21.15.81:0/4191548268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79980cfe90 con 0x7f7988004010 2023-10-07T08:49:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f79977fe700 1 -- 172.21.15.81:0/4191548268 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798800bbf0 con 0x7f7988004d50 2023-10-07T08:49:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f79977fe700 1 -- 172.21.15.81:0/4191548268 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798800bdb0 con 0x7f7998157ca0 2023-10-07T08:49:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f7997fff700 1 --2- 172.21.15.81:0/4191548268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7988004010 0x7f7988004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.160+0000 7f799c8b8700 1 --2- 172.21.15.81:0/4191548268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7998157ca0 0x7f7988003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.161+0000 7f799d0b9700 1 --2- 172.21.15.81:0/4191548268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7988004d50 0x7f79880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.161+0000 7f7997fff700 1 -- 172.21.15.81:0/4191548268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7998157ca0 msgr2=0x7f7988003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.161+0000 7f7997fff700 1 --2- 172.21.15.81:0/4191548268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7998157ca0 0x7f7988003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.161+0000 7f7997fff700 1 -- 172.21.15.81:0/4191548268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7988004d50 msgr2=0x7f79880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.161+0000 7f7997fff700 1 --2- 172.21.15.81:0/4191548268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7988004d50 0x7f79880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.161+0000 7f7997fff700 1 -- 172.21.15.81:0/4191548268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7988003570 con 0x7f7988004010 2023-10-07T08:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.161+0000 7f799d0b9700 1 --2- 172.21.15.81:0/4191548268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7988004d50 0x7f79880051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.161+0000 7f7997fff700 1 --2- 172.21.15.81:0/4191548268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7988004010 0x7f7988004810 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f7984006f00 tx=0x7f79840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3208d7c2fd2c2e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.161+0000 7f79977fe700 1 -- 172.21.15.81:0/4191548268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400e710 con 0x7f7988004010 2023-10-07T08:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.161+0000 7f79977fe700 1 -- 172.21.15.81:0/4191548268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798400e870 con 0x7f7988004010 2023-10-07T08:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.161+0000 7f79977fe700 1 -- 172.21.15.81:0/4191548268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400ec30 con 0x7f7988004010 2023-10-07T08:49:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.161+0000 7f799eb1c700 1 -- 172.21.15.81:0/4191548268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7988004010 msgr2=0x7f7988004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.161+0000 7f799eb1c700 1 --2- 172.21.15.81:0/4191548268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7988004010 0x7f7988004810 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f7984006f00 tx=0x7f79840091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.161+0000 7f799d0b9700 1 -- 172.21.15.81:0/4191548268 reap_dead start 2023-10-07T08:49:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.161+0000 7f799eb1c700 1 -- 172.21.15.81:0/4191548268 shutdown_connections 2023-10-07T08:49:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.161+0000 7f799eb1c700 1 -- 172.21.15.81:0/4191548268 >> 172.21.15.81:0/4191548268 conn(0x7f799806bb90 msgr2=0x7f799806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.162+0000 7f799eb1c700 1 -- 172.21.15.81:0/4191548268 shutdown_connections 2023-10-07T08:49:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.162+0000 7f799eb1c700 1 -- 172.21.15.81:0/4191548268 wait complete. 2023-10-07T08:49:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.163+0000 7f799eb1c700 1 Processor -- start 2023-10-07T08:49:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.163+0000 7f799eb1c700 1 -- start start 2023-10-07T08:49:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.163+0000 7f799eb1c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7988004010 0x7f799816a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.163+0000 7f799eb1c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f799814e720 0x7f799814eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.163+0000 7f799eb1c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79981551c0 0x7f7998155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.163+0000 7f799eb1c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799816a7a0 con 0x7f79981551c0 2023-10-07T08:49:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.163+0000 7f799eb1c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7998155b70 con 0x7f7988004010 2023-10-07T08:49:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.163+0000 7f799eb1c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79980b3d30 con 0x7f799814e720 2023-10-07T08:49:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.164+0000 7f799d0b9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79981551c0 0x7f7998155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.164+0000 7f799d0b9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79981551c0 0x7f7998155630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35822/0 (socket says 172.21.15.81:35822) 2023-10-07T08:49:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.164+0000 7f799d0b9700 1 -- 172.21.15.81:0/3110604996 learned_addr learned my addr 172.21.15.81:0/3110604996 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.164+0000 7f7997fff700 1 --2- 172.21.15.81:0/3110604996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f799814e720 0x7f799814eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.164+0000 7f799c8b8700 1 --2- 172.21.15.81:0/3110604996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7988004010 0x7f799816a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.164+0000 7f799d0b9700 1 -- 172.21.15.81:0/3110604996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f799814e720 msgr2=0x7f799814eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.164+0000 7f799d0b9700 1 --2- 172.21.15.81:0/3110604996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f799814e720 0x7f799814eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.164+0000 7f799d0b9700 1 -- 172.21.15.81:0/3110604996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7988004010 msgr2=0x7f799816a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.164+0000 7f799d0b9700 1 --2- 172.21.15.81:0/3110604996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7988004010 0x7f799816a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.164+0000 7f799d0b9700 1 -- 172.21.15.81:0/3110604996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799814c350 con 0x7f79981551c0 2023-10-07T08:49:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.164+0000 7f799d0b9700 1 --2- 172.21.15.81:0/3110604996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79981551c0 0x7f7998155630 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f799806fe20 tx=0x7f7990009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.164+0000 7f7994ff9700 1 -- 172.21.15.81:0/3110604996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990012590 con 0x7f79981551c0 2023-10-07T08:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.164+0000 7f7994ff9700 1 -- 172.21.15.81:0/3110604996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79900126f0 con 0x7f79981551c0 2023-10-07T08:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.164+0000 7f799eb1c700 1 -- 172.21.15.81:0/3110604996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799814f290 con 0x7f79981551c0 2023-10-07T08:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.164+0000 7f7994ff9700 1 -- 172.21.15.81:0/3110604996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990012ab0 con 0x7f79981551c0 2023-10-07T08:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.164+0000 7f799eb1c700 1 -- 172.21.15.81:0/3110604996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79980b4260 con 0x7f79981551c0 2023-10-07T08:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.165+0000 7f799eb1c700 1 -- 172.21.15.81:0/3110604996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7998067ac0 con 0x7f79981551c0 2023-10-07T08:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.165+0000 7f7994ff9700 1 -- 172.21.15.81:0/3110604996 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7990003030 con 0x7f79981551c0 2023-10-07T08:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.166+0000 7f7994ff9700 1 --2- 172.21.15.81:0/3110604996 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f797c066f30 0x7f797c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.166+0000 7f7994ff9700 1 -- 172.21.15.81:0/3110604996 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7990084330 con 0x7f79981551c0 2023-10-07T08:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.166+0000 7f799c8b8700 1 --2- 172.21.15.81:0/3110604996 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f797c066f30 0x7f797c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.166+0000 7f799c8b8700 1 --2- 172.21.15.81:0/3110604996 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f797c066f30 0x7f797c0693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f798c0015a0 tx=0x7f799815b610 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.170+0000 7f7994ff9700 1 -- 172.21.15.81:0/3110604996 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7990051560 con 0x7f79981551c0 2023-10-07T08:49:45.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.350+0000 7f799eb1c700 1 -- 172.21.15.81:0/3110604996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79980d0450 con 0x7f79981551c0 2023-10-07T08:49:45.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.351+0000 7f7994ff9700 1 -- 172.21.15.81:0/3110604996 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v142) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7990054b80 con 0x7f79981551c0 2023-10-07T08:49:45.352 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:49:45.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.353+0000 7f799eb1c700 1 -- 172.21.15.81:0/3110604996 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f797c066f30 msgr2=0x7f797c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.353+0000 7f799eb1c700 1 --2- 172.21.15.81:0/3110604996 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f797c066f30 0x7f797c0693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f798c0015a0 tx=0x7f799815b610 comp rx=0 tx=0).stop 2023-10-07T08:49:45.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.353+0000 7f799eb1c700 1 -- 172.21.15.81:0/3110604996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79981551c0 msgr2=0x7f7998155630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.353+0000 7f799eb1c700 1 --2- 172.21.15.81:0/3110604996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79981551c0 0x7f7998155630 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f799806fe20 tx=0x7f7990009040 comp rx=0 tx=0).stop 2023-10-07T08:49:45.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.353+0000 7f799eb1c700 1 -- 172.21.15.81:0/3110604996 shutdown_connections 2023-10-07T08:49:45.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.353+0000 7f799eb1c700 1 --2- 172.21.15.81:0/3110604996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79981551c0 0x7f7998155630 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.353+0000 7f799eb1c700 1 --2- 172.21.15.81:0/3110604996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7988004010 0x7f799816a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.353+0000 7f799eb1c700 1 --2- 172.21.15.81:0/3110604996 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f797c066f30 0x7f797c0693e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.353+0000 7f799eb1c700 1 --2- 172.21.15.81:0/3110604996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f799814e720 0x7f799814eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.353+0000 7f799eb1c700 1 -- 172.21.15.81:0/3110604996 >> 172.21.15.81:0/3110604996 conn(0x7f799806bb90 msgr2=0x7f7998068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:45.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.353+0000 7f799eb1c700 1 -- 172.21.15.81:0/3110604996 shutdown_connections 2023-10-07T08:49:45.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.353+0000 7f799eb1c700 1 -- 172.21.15.81:0/3110604996 wait complete. 2023-10-07T08:49:45.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:49:45.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.479+0000 7f27f22cd700 1 Processor -- start 2023-10-07T08:49:45.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.480+0000 7f27f22cd700 1 -- start start 2023-10-07T08:49:45.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.480+0000 7f27f22cd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f27ec159b40 0x7f27ec0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.480+0000 7f27f22cd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27ec068e90 0x7f27ec0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.480+0000 7f27f22cd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ec0cee10 con 0x7f27ec159f10 2023-10-07T08:49:45.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.480+0000 7f27f22cd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27ec0cd040 con 0x7f27ec068e90 2023-10-07T08:49:45.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.480+0000 7f27f22cd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27ec0cd320 con 0x7f27ec159b40 2023-10-07T08:49:45.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.480+0000 7f27f1acc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27ec068e90 0x7f27ec0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.481+0000 7f27f1acc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27ec068e90 0x7f27ec0cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35824/0 (socket says 172.21.15.81:35824) 2023-10-07T08:49:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.481+0000 7f27f1acc700 1 -- 172.21.15.81:0/599260909 learned_addr learned my addr 172.21.15.81:0/599260909 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.481+0000 7f27f1acc700 1 -- 172.21.15.81:0/599260909 >> v2:172.21.15.89:3300/0 conn(0x7f27ec159b40 msgr2=0x7f27ec0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.481+0000 7f27f12cb700 1 --2- 172.21.15.81:0/599260909 >> v2:172.21.15.89:3300/0 conn(0x7f27ec159b40 0x7f27ec0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.481+0000 7f27f1acc700 1 --2- 172.21.15.81:0/599260909 >> v2:172.21.15.89:3300/0 conn(0x7f27ec159b40 0x7f27ec0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.481+0000 7f27f1acc700 1 -- 172.21.15.81:0/599260909 >> v1:172.21.15.89:6789/0 conn(0x7f27ec159f10 legacy=0x7f27ec068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.481+0000 7f27f1acc700 1 -- 172.21.15.81:0/599260909 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec0ce7c0 con 0x7f27ec068e90 2023-10-07T08:49:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.481+0000 7f27f12cb700 1 --2- 172.21.15.81:0/599260909 >> v2:172.21.15.89:3300/0 conn(0x7f27ec159b40 0x7f27ec0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.481+0000 7f27f1acc700 1 --2- 172.21.15.81:0/599260909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec068e90 0x7f27ec0cf2a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0d0bc0 tx=0x7f27e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b010b831770f09 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.481+0000 7f27e3fff700 1 -- 172.21.15.81:0/599260909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e400e070 con 0x7f27ec068e90 2023-10-07T08:49:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.481+0000 7f27e3fff700 1 -- 172.21.15.81:0/599260909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e400ba10 con 0x7f27ec068e90 2023-10-07T08:49:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.481+0000 7f27e3fff700 1 -- 172.21.15.81:0/599260909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e40092e0 con 0x7f27ec068e90 2023-10-07T08:49:45.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.481+0000 7f27f22cd700 1 -- 172.21.15.81:0/599260909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec068e90 msgr2=0x7f27ec0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.481+0000 7f27f22cd700 1 --2- 172.21.15.81:0/599260909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec068e90 0x7f27ec0cf2a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0d0bc0 tx=0x7f27e4009840 comp rx=0 tx=0).stop 2023-10-07T08:49:45.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.482+0000 7f27f22cd700 1 -- 172.21.15.81:0/599260909 shutdown_connections 2023-10-07T08:49:45.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.482+0000 7f27f22cd700 1 --2- 172.21.15.81:0/599260909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec068e90 0x7f27ec0cf2a0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.482+0000 7f27f22cd700 1 --2- 172.21.15.81:0/599260909 >> v2:172.21.15.89:3300/0 conn(0x7f27ec159b40 0x7f27ec0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.482+0000 7f27f22cd700 1 -- 172.21.15.81:0/599260909 >> 172.21.15.81:0/599260909 conn(0x7f27ec0cd660 msgr2=0x7f27ec0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:45.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.482+0000 7f27f22cd700 1 -- 172.21.15.81:0/599260909 shutdown_connections 2023-10-07T08:49:45.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.482+0000 7f27f22cd700 1 -- 172.21.15.81:0/599260909 wait complete. 2023-10-07T08:49:45.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.483+0000 7f27f22cd700 1 Processor -- start 2023-10-07T08:49:45.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.483+0000 7f27f22cd700 1 -- start start 2023-10-07T08:49:45.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f22cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec068e90 0x7f27ec155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f22cd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27ec159b40 0x7f27ec16aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f22cd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27ec159f10 0x7f27ec154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f22cd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec16afd0 con 0x7f27ec068e90 2023-10-07T08:49:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f22cd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec0b4260 con 0x7f27ec159b40 2023-10-07T08:49:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f22cd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec154a60 con 0x7f27ec159f10 2023-10-07T08:49:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f12cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec068e90 0x7f27ec155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f12cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec068e90 0x7f27ec155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35840/0 (socket says 172.21.15.81:35840) 2023-10-07T08:49:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f12cb700 1 -- 172.21.15.81:0/2007030130 learned_addr learned my addr 172.21.15.81:0/2007030130 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f1acc700 1 --2- 172.21.15.81:0/2007030130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27ec159f10 0x7f27ec154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f0aca700 1 --2- 172.21.15.81:0/2007030130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27ec159b40 0x7f27ec16aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f12cb700 1 -- 172.21.15.81:0/2007030130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27ec159f10 msgr2=0x7f27ec154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f12cb700 1 --2- 172.21.15.81:0/2007030130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27ec159f10 0x7f27ec154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f12cb700 1 -- 172.21.15.81:0/2007030130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27ec159b40 msgr2=0x7f27ec16aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f12cb700 1 --2- 172.21.15.81:0/2007030130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27ec159b40 0x7f27ec16aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f12cb700 1 -- 172.21.15.81:0/2007030130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e4009ae0 con 0x7f27ec068e90 2023-10-07T08:49:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f12cb700 1 --2- 172.21.15.81:0/2007030130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec068e90 0x7f27ec155f00 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f27e800c860 tx=0x7f27e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27e17fa700 1 -- 172.21.15.81:0/2007030130 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8011600 con 0x7f27ec068e90 2023-10-07T08:49:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27e17fa700 1 -- 172.21.15.81:0/2007030130 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e8011760 con 0x7f27ec068e90 2023-10-07T08:49:45.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f22cd700 1 -- 172.21.15.81:0/2007030130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ec16d8a0 con 0x7f27ec068e90 2023-10-07T08:49:45.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27e17fa700 1 -- 172.21.15.81:0/2007030130 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8011b20 con 0x7f27ec068e90 2023-10-07T08:49:45.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.484+0000 7f27f22cd700 1 -- 172.21.15.81:0/2007030130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ec1564e0 con 0x7f27ec068e90 2023-10-07T08:49:45.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.485+0000 7f27f22cd700 1 -- 172.21.15.81:0/2007030130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ec063e90 con 0x7f27ec068e90 2023-10-07T08:49:45.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.486+0000 7f27e17fa700 1 -- 172.21.15.81:0/2007030130 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27e80193b0 con 0x7f27ec068e90 2023-10-07T08:49:45.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.486+0000 7f27e17fa700 1 --2- 172.21.15.81:0/2007030130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27d0066f30 0x7f27d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.486+0000 7f27e17fa700 1 -- 172.21.15.81:0/2007030130 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f27e80844a0 con 0x7f27ec068e90 2023-10-07T08:49:45.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.486+0000 7f27f0aca700 1 --2- 172.21.15.81:0/2007030130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27d0066f30 0x7f27d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.486+0000 7f27f0aca700 1 --2- 172.21.15.81:0/2007030130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27d0066f30 0x7f27d00693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f27ec15ce40 tx=0x7f27dc009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:45.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.490+0000 7f27e17fa700 1 -- 172.21.15.81:0/2007030130 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27e80516d0 con 0x7f27ec068e90 2023-10-07T08:49:45.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.717+0000 7f27f22cd700 1 -- 172.21.15.81:0/2007030130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27ec0ceaa0 con 0x7f27ec068e90 2023-10-07T08:49:45.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.717+0000 7f27e17fa700 1 -- 172.21.15.81:0/2007030130 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f27e8054cf0 con 0x7f27ec068e90 2023-10-07T08:49:45.719 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:45.719 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1795695306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1795695306},{"type":"v1","addr":"172.21.15.89:6834","nonce":1795695306}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3856313795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3856313795},{"type":"v1","addr":"172.21.15.89:6835","nonce":3856313795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7119,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4143803144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4143803144},{"type":"v1","addr":"172.21.15.81:6836","nonce":4143803144}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:49:13.845110+0000","modified":"2023-10-07T08:49:17.485796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3151244734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3151244734},{"type":"v1","addr":"172.21.15.81:6837","nonce":3151244734}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-07T08:49:45.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.719+0000 7f27f22cd700 1 -- 172.21.15.81:0/2007030130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27d0066f30 msgr2=0x7f27d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.719+0000 7f27f22cd700 1 --2- 172.21.15.81:0/2007030130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27d0066f30 0x7f27d00693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f27ec15ce40 tx=0x7f27dc009060 comp rx=0 tx=0).stop 2023-10-07T08:49:45.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.719+0000 7f27f22cd700 1 -- 172.21.15.81:0/2007030130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec068e90 msgr2=0x7f27ec155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.719+0000 7f27f22cd700 1 --2- 172.21.15.81:0/2007030130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec068e90 0x7f27ec155f00 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f27e800c860 tx=0x7f27e8008040 comp rx=0 tx=0).stop 2023-10-07T08:49:45.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.719+0000 7f27f22cd700 1 -- 172.21.15.81:0/2007030130 shutdown_connections 2023-10-07T08:49:45.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.719+0000 7f27f22cd700 1 --2- 172.21.15.81:0/2007030130 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27d0066f30 0x7f27d00693e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.719+0000 7f27f22cd700 1 --2- 172.21.15.81:0/2007030130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27ec159f10 0x7f27ec154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.719+0000 7f27f22cd700 1 --2- 172.21.15.81:0/2007030130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec068e90 0x7f27ec155f00 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.719+0000 7f27f22cd700 1 --2- 172.21.15.81:0/2007030130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27ec159b40 0x7f27ec16aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.720+0000 7f27f22cd700 1 -- 172.21.15.81:0/2007030130 >> 172.21.15.81:0/2007030130 conn(0x7f27ec0cd660 msgr2=0x7f27ec0cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:45.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.720+0000 7f27f22cd700 1 -- 172.21.15.81:0/2007030130 shutdown_connections 2023-10-07T08:49:45.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.720+0000 7f27f22cd700 1 -- 172.21.15.81:0/2007030130 wait complete. 2023-10-07T08:49:45.722 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2023-10-07T08:49:45.733 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:49:45.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.845+0000 7fc1bf80a700 1 Processor -- start 2023-10-07T08:49:45.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.845+0000 7fc1bf80a700 1 -- start start 2023-10-07T08:49:45.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.846+0000 7fc1bf80a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1b8157ca0 0x7fc1b80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.846+0000 7fc1bf80a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc1b806d120 0x7fc1b806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.846+0000 7fc1bf80a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b80d07c0 con 0x7fc1b81578d0 2023-10-07T08:49:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.846+0000 7fc1bf80a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b806da50 con 0x7fc1b8157ca0 2023-10-07T08:49:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.846+0000 7fc1bf80a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b80cfbb0 con 0x7fc1b806d120 2023-10-07T08:49:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.846+0000 7fc1bcda5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1b8157ca0 0x7fc1b80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.846+0000 7fc1bd5a6700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc1b81578d0 0x7fc1b815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41994/0 (socket says 172.21.15.81:41994) 2023-10-07T08:49:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.846+0000 7fc1bd5a6700 1 -- 172.21.15.81:0/1517391829 learned_addr learned my addr 172.21.15.81:0/1517391829 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.846+0000 7fc1bdda7700 1 --2- 172.21.15.81:0/1517391829 >> v2:172.21.15.89:3300/0 conn(0x7fc1b806d120 0x7fc1b806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.847+0000 7fc1bcda5700 1 -- 172.21.15.81:0/1517391829 >> v2:172.21.15.89:3300/0 conn(0x7fc1b806d120 msgr2=0x7fc1b806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.847+0000 7fc1bcda5700 1 --2- 172.21.15.81:0/1517391829 >> v2:172.21.15.89:3300/0 conn(0x7fc1b806d120 0x7fc1b806d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.847+0000 7fc1bcda5700 1 -- 172.21.15.81:0/1517391829 >> v1:172.21.15.81:6789/0 conn(0x7fc1b81578d0 legacy=0x7fc1b815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.847+0000 7fc1bcda5700 1 -- 172.21.15.81:0/1517391829 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b80cfe90 con 0x7fc1b8157ca0 2023-10-07T08:49:45.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.847+0000 7fc1bcda5700 1 --2- 172.21.15.81:0/1517391829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b8157ca0 0x7fc1b80cf4f0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8068300 tx=0x7fc1a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e489956878a157 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:45.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.847+0000 7fc1affff700 1 -- 172.21.15.81:0/1517391829 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8011630 con 0x7fc1b8157ca0 2023-10-07T08:49:45.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.847+0000 7fc1affff700 1 -- 172.21.15.81:0/1517391829 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a8011790 con 0x7fc1b8157ca0 2023-10-07T08:49:45.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.847+0000 7fc1affff700 1 -- 172.21.15.81:0/1517391829 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8011b30 con 0x7fc1b8157ca0 2023-10-07T08:49:45.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.847+0000 7fc1bf80a700 1 -- 172.21.15.81:0/1517391829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b8157ca0 msgr2=0x7fc1b80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.847+0000 7fc1bf80a700 1 --2- 172.21.15.81:0/1517391829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b8157ca0 0x7fc1b80cf4f0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8068300 tx=0x7fc1a80091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.847+0000 7fc1bf80a700 1 -- 172.21.15.81:0/1517391829 shutdown_connections 2023-10-07T08:49:45.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.847+0000 7fc1bf80a700 1 --2- 172.21.15.81:0/1517391829 >> v2:172.21.15.89:3300/0 conn(0x7fc1b806d120 0x7fc1b806d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.847+0000 7fc1bf80a700 1 --2- 172.21.15.81:0/1517391829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b8157ca0 0x7fc1b80cf4f0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.847+0000 7fc1bf80a700 1 -- 172.21.15.81:0/1517391829 >> 172.21.15.81:0/1517391829 conn(0x7fc1b806bb90 msgr2=0x7fc1b806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:45.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.847+0000 7fc1bf80a700 1 -- 172.21.15.81:0/1517391829 shutdown_connections 2023-10-07T08:49:45.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.847+0000 7fc1bf80a700 1 -- 172.21.15.81:0/1517391829 wait complete. 2023-10-07T08:49:45.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.848+0000 7fc1bf80a700 1 Processor -- start 2023-10-07T08:49:45.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.849+0000 7fc1bf80a700 1 -- start start 2023-10-07T08:49:45.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.849+0000 7fc1bf80a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b806d120 0x7fc1b8145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.849+0000 7fc1bf80a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1b81578d0 0x7fc1b80b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.849+0000 7fc1bf80a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1b8157ca0 0x7fc1b816e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.849+0000 7fc1bf80a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80b4c90 con 0x7fc1b806d120 2023-10-07T08:49:45.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.849+0000 7fc1bf80a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80b4080 con 0x7fc1b8157ca0 2023-10-07T08:49:45.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.849+0000 7fc1bf80a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80b4360 con 0x7fc1b81578d0 2023-10-07T08:49:45.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.849+0000 7fc1bd5a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b806d120 0x7fc1b8145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.849+0000 7fc1bd5a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b806d120 0x7fc1b8145f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35868/0 (socket says 172.21.15.81:35868) 2023-10-07T08:49:45.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.850+0000 7fc1bd5a6700 1 -- 172.21.15.81:0/626211694 learned_addr learned my addr 172.21.15.81:0/626211694 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:45.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.850+0000 7fc1bd5a6700 1 -- 172.21.15.81:0/626211694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1b81578d0 msgr2=0x7fc1b80b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.850+0000 7fc1bd5a6700 1 --2- 172.21.15.81:0/626211694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1b81578d0 0x7fc1b80b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.850+0000 7fc1bd5a6700 1 -- 172.21.15.81:0/626211694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1b8157ca0 msgr2=0x7fc1b816e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:45.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.850+0000 7fc1bd5a6700 1 --2- 172.21.15.81:0/626211694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1b8157ca0 0x7fc1b816e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:45.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.850+0000 7fc1bd5a6700 1 -- 172.21.15.81:0/626211694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a8009420 con 0x7fc1b806d120 2023-10-07T08:49:45.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.850+0000 7fc1bd5a6700 1 --2- 172.21.15.81:0/626211694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b806d120 0x7fc1b8145f60 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400cec0 tx=0x7fc1b4001c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:45.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.850+0000 7fc1ad7fa700 1 -- 172.21.15.81:0/626211694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b400aba0 con 0x7fc1b806d120 2023-10-07T08:49:45.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.850+0000 7fc1ad7fa700 1 -- 172.21.15.81:0/626211694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b400ad00 con 0x7fc1b806d120 2023-10-07T08:49:45.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.850+0000 7fc1ad7fa700 1 -- 172.21.15.81:0/626211694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4007340 con 0x7fc1b806d120 2023-10-07T08:49:45.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.850+0000 7fc1bf80a700 1 -- 172.21.15.81:0/626211694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b80b4640 con 0x7fc1b806d120 2023-10-07T08:49:45.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.850+0000 7fc1bf80a700 1 -- 172.21.15.81:0/626211694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b80b6880 con 0x7fc1b806d120 2023-10-07T08:49:45.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.851+0000 7fc1bf80a700 1 -- 172.21.15.81:0/626211694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b80b2fb0 con 0x7fc1b806d120 2023-10-07T08:49:45.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.852+0000 7fc1ad7fa700 1 -- 172.21.15.81:0/626211694 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1b40076f0 con 0x7fc1b806d120 2023-10-07T08:49:45.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.852+0000 7fc1ad7fa700 1 --2- 172.21.15.81:0/626211694 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc19c066f30 0x7fc19c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:45.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.852+0000 7fc1ad7fa700 1 -- 172.21.15.81:0/626211694 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fc1b4084ba0 con 0x7fc1b806d120 2023-10-07T08:49:45.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.852+0000 7fc1bcda5700 1 --2- 172.21.15.81:0/626211694 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc19c066f30 0x7fc19c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:45.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.852+0000 7fc1bcda5700 1 --2- 172.21.15.81:0/626211694 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc19c066f30 0x7fc19c0693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc1b81580c0 tx=0x7fc1a8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:45.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:45.856+0000 7fc1ad7fa700 1 -- 172.21.15.81:0/626211694 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1b4051e50 con 0x7fc1b806d120 2023-10-07T08:49:46.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.039+0000 7fc1bf80a700 1 -- 172.21.15.81:0/626211694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1b80d0170 con 0x7fc1b806d120 2023-10-07T08:49:46.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.040+0000 7fc1ad7fa700 1 -- 172.21.15.81:0/626211694 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+15422 (secure 0 0 0) 0x7fc1b4055470 con 0x7fc1b806d120 2023-10-07T08:49:46.041 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:46.042 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":143,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:49:45.565217+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:49:12.162742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-07T08:49:12.805348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.17","mappings":[{"from":0,"to":5}]},{"pgid":"17.3f","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:49:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.042+0000 7fc1bf80a700 1 -- 172.21.15.81:0/626211694 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc19c066f30 msgr2=0x7fc19c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.042+0000 7fc1bf80a700 1 --2- 172.21.15.81:0/626211694 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc19c066f30 0x7fc19c0693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc1b81580c0 tx=0x7fc1a8016000 comp rx=0 tx=0).stop 2023-10-07T08:49:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.042+0000 7fc1bf80a700 1 -- 172.21.15.81:0/626211694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b806d120 msgr2=0x7fc1b8145f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.042+0000 7fc1bf80a700 1 --2- 172.21.15.81:0/626211694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b806d120 0x7fc1b8145f60 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400cec0 tx=0x7fc1b4001c20 comp rx=0 tx=0).stop 2023-10-07T08:49:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.042+0000 7fc1bf80a700 1 -- 172.21.15.81:0/626211694 shutdown_connections 2023-10-07T08:49:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.042+0000 7fc1bf80a700 1 --2- 172.21.15.81:0/626211694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1b8157ca0 0x7fc1b816e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.042+0000 7fc1bf80a700 1 --2- 172.21.15.81:0/626211694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b806d120 0x7fc1b8145f60 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.042+0000 7fc1bf80a700 1 --2- 172.21.15.81:0/626211694 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc19c066f30 0x7fc19c0693e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.042+0000 7fc1bf80a700 1 --2- 172.21.15.81:0/626211694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1b81578d0 0x7fc1b80b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.042+0000 7fc1bf80a700 1 -- 172.21.15.81:0/626211694 >> 172.21.15.81:0/626211694 conn(0x7fc1b806bb90 msgr2=0x7fc1b81559d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.042+0000 7fc1bf80a700 1 -- 172.21.15.81:0/626211694 shutdown_connections 2023-10-07T08:49:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.042+0000 7fc1bf80a700 1 -- 172.21.15.81:0/626211694 wait complete. 2023-10-07T08:49:46.055 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T08:49:46.056 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:49:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.167+0000 7fe0f8aa3700 1 Processor -- start 2023-10-07T08:49:46.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.167+0000 7fe0f8aa3700 1 -- start start 2023-10-07T08:49:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.168+0000 7fe0f8aa3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0f41578d0 0x7fe0f40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.168+0000 7fe0f8aa3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe0f406d120 0x7fe0f406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.168+0000 7fe0f8aa3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f40d07c0 con 0x7fe0f4157ca0 2023-10-07T08:49:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.168+0000 7fe0f8aa3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f406da50 con 0x7fe0f41578d0 2023-10-07T08:49:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.168+0000 7fe0f8aa3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f40cfbb0 con 0x7fe0f406d120 2023-10-07T08:49:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.168+0000 7fe0f259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0f41578d0 0x7fe0f40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.168+0000 7fe0f259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0f41578d0 0x7fe0f40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35870/0 (socket says 172.21.15.81:35870) 2023-10-07T08:49:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.168+0000 7fe0f259c700 1 -- 172.21.15.81:0/612449523 learned_addr learned my addr 172.21.15.81:0/612449523 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.168+0000 7fe0f2d9d700 1 --2- 172.21.15.81:0/612449523 >> v2:172.21.15.89:3300/0 conn(0x7fe0f406d120 0x7fe0f406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.168+0000 7fe0f259c700 1 -- 172.21.15.81:0/612449523 >> v2:172.21.15.89:3300/0 conn(0x7fe0f406d120 msgr2=0x7fe0f406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.168+0000 7fe0f259c700 1 --2- 172.21.15.81:0/612449523 >> v2:172.21.15.89:3300/0 conn(0x7fe0f406d120 0x7fe0f406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.168+0000 7fe0f259c700 1 -- 172.21.15.81:0/612449523 >> v1:172.21.15.89:6789/0 conn(0x7fe0f4157ca0 legacy=0x7fe0f415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.169+0000 7fe0f259c700 1 -- 172.21.15.81:0/612449523 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f40cfe90 con 0x7fe0f41578d0 2023-10-07T08:49:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.169+0000 7fe0f2d9d700 1 --2- 172.21.15.81:0/612449523 >> v2:172.21.15.89:3300/0 conn(0x7fe0f406d120 0x7fe0f406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.169+0000 7fe0f259c700 1 --2- 172.21.15.81:0/612449523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f41578d0 0x7fe0f40cf4f0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4068300 tx=0x7fe0e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61b022195e91de1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.169+0000 7fe0f1d9b700 1 -- 172.21.15.81:0/612449523 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400b820 con 0x7fe0f41578d0 2023-10-07T08:49:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.169+0000 7fe0f1d9b700 1 -- 172.21.15.81:0/612449523 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e400b980 con 0x7fe0f41578d0 2023-10-07T08:49:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.169+0000 7fe0f1d9b700 1 -- 172.21.15.81:0/612449523 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400bd20 con 0x7fe0f41578d0 2023-10-07T08:49:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.169+0000 7fe0f8aa3700 1 -- 172.21.15.81:0/612449523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f41578d0 msgr2=0x7fe0f40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.169+0000 7fe0f8aa3700 1 --2- 172.21.15.81:0/612449523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f41578d0 0x7fe0f40cf4f0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4068300 tx=0x7fe0e4009250 comp rx=0 tx=0).stop 2023-10-07T08:49:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.169+0000 7fe0f8aa3700 1 -- 172.21.15.81:0/612449523 shutdown_connections 2023-10-07T08:49:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.169+0000 7fe0f8aa3700 1 --2- 172.21.15.81:0/612449523 >> v2:172.21.15.89:3300/0 conn(0x7fe0f406d120 0x7fe0f406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.169+0000 7fe0f8aa3700 1 --2- 172.21.15.81:0/612449523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f41578d0 0x7fe0f40cf4f0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.169+0000 7fe0f8aa3700 1 -- 172.21.15.81:0/612449523 >> 172.21.15.81:0/612449523 conn(0x7fe0f406bb90 msgr2=0x7fe0f406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:46.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.169+0000 7fe0f8aa3700 1 -- 172.21.15.81:0/612449523 shutdown_connections 2023-10-07T08:49:46.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.169+0000 7fe0f8aa3700 1 -- 172.21.15.81:0/612449523 wait complete. 2023-10-07T08:49:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.171+0000 7fe0f8aa3700 1 Processor -- start 2023-10-07T08:49:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.171+0000 7fe0f8aa3700 1 -- start start 2023-10-07T08:49:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.171+0000 7fe0f8aa3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0f406d120 0x7fe0f40c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.171+0000 7fe0f8aa3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f41578d0 0x7fe0f41580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.171+0000 7fe0f8aa3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f4157ca0 0x7fe0f40cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.171+0000 7fe0f8aa3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4158630 con 0x7fe0f4157ca0 2023-10-07T08:49:46.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.171+0000 7fe0f8aa3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f40cd9f0 con 0x7fe0f41578d0 2023-10-07T08:49:46.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.171+0000 7fe0f8aa3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f416a960 con 0x7fe0f406d120 2023-10-07T08:49:46.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.171+0000 7fe0f2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f4157ca0 0x7fe0f40cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:46.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.171+0000 7fe0f2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f4157ca0 0x7fe0f40cd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35884/0 (socket says 172.21.15.81:35884) 2023-10-07T08:49:46.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.171+0000 7fe0f2d9d700 1 -- 172.21.15.81:0/3529171989 learned_addr learned my addr 172.21.15.81:0/3529171989 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:46.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.172+0000 7fe0f259c700 1 --2- 172.21.15.81:0/3529171989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0f406d120 0x7fe0f40c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:46.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.171+0000 7fe0e9d9b700 1 --2- 172.21.15.81:0/3529171989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f41578d0 0x7fe0f41580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.172+0000 7fe0f2d9d700 1 -- 172.21.15.81:0/3529171989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0f406d120 msgr2=0x7fe0f40c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.172+0000 7fe0f2d9d700 1 --2- 172.21.15.81:0/3529171989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0f406d120 0x7fe0f40c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.172+0000 7fe0f2d9d700 1 -- 172.21.15.81:0/3529171989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f41578d0 msgr2=0x7fe0f41580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.172+0000 7fe0f2d9d700 1 --2- 172.21.15.81:0/3529171989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f41578d0 0x7fe0f41580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.172+0000 7fe0f2d9d700 1 -- 172.21.15.81:0/3529171989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e40094f0 con 0x7fe0f4157ca0 2023-10-07T08:49:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.172+0000 7fe0f259c700 1 --2- 172.21.15.81:0/3529171989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0f406d120 0x7fe0f40c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.172+0000 7fe0f2d9d700 1 --2- 172.21.15.81:0/3529171989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f4157ca0 0x7fe0f40cd4b0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00a380 tx=0x7fe0ec007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.172+0000 7fe0eaffd700 1 -- 172.21.15.81:0/3529171989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec015440 con 0x7fe0f4157ca0 2023-10-07T08:49:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.172+0000 7fe0eaffd700 1 -- 172.21.15.81:0/3529171989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec0155a0 con 0x7fe0f4157ca0 2023-10-07T08:49:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.172+0000 7fe0f8aa3700 1 -- 172.21.15.81:0/3529171989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f4158840 con 0x7fe0f4157ca0 2023-10-07T08:49:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.172+0000 7fe0eaffd700 1 -- 172.21.15.81:0/3529171989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec015960 con 0x7fe0f4157ca0 2023-10-07T08:49:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.172+0000 7fe0f8aa3700 1 -- 172.21.15.81:0/3529171989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f4158e00 con 0x7fe0f4157ca0 2023-10-07T08:49:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.173+0000 7fe0f8aa3700 1 -- 172.21.15.81:0/3529171989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f4067ac0 con 0x7fe0f4157ca0 2023-10-07T08:49:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.173+0000 7fe0eaffd700 1 -- 172.21.15.81:0/3529171989 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0ec00d440 con 0x7fe0f4157ca0 2023-10-07T08:49:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.174+0000 7fe0eaffd700 1 --2- 172.21.15.81:0/3529171989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0d4066f60 0x7fe0d4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.174+0000 7fe0eaffd700 1 -- 172.21.15.81:0/3529171989 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fe0ec0850c0 con 0x7fe0f4157ca0 2023-10-07T08:49:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.174+0000 7fe0f259c700 1 --2- 172.21.15.81:0/3529171989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0d4066f60 0x7fe0d4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.174+0000 7fe0f259c700 1 --2- 172.21.15.81:0/3529171989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0d4066f60 0x7fe0d4069410 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4068300 tx=0x7fe0e4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:46.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.178+0000 7fe0eaffd700 1 -- 172.21.15.81:0/3529171989 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0ec0522f0 con 0x7fe0f4157ca0 2023-10-07T08:49:46.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.401+0000 7fe0f8aa3700 1 -- 172.21.15.81:0/3529171989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0f40d0170 con 0x7fe0f4157ca0 2023-10-07T08:49:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.401+0000 7fe0eaffd700 1 -- 172.21.15.81:0/3529171989 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fe0ec055910 con 0x7fe0f4157ca0 2023-10-07T08:49:46.403 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:46.403 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1795695306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1795695306},{"type":"v1","addr":"172.21.15.89:6834","nonce":1795695306}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3856313795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3856313795},{"type":"v1","addr":"172.21.15.89:6835","nonce":3856313795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7119,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4143803144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4143803144},{"type":"v1","addr":"172.21.15.81:6836","nonce":4143803144}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:49:13.845110+0000","modified":"2023-10-07T08:49:17.485796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3151244734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3151244734},{"type":"v1","addr":"172.21.15.81:6837","nonce":3151244734}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-07T08:49:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.404+0000 7fe0f8aa3700 1 -- 172.21.15.81:0/3529171989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0d4066f60 msgr2=0x7fe0d4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.404+0000 7fe0f8aa3700 1 --2- 172.21.15.81:0/3529171989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0d4066f60 0x7fe0d4069410 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4068300 tx=0x7fe0e4016000 comp rx=0 tx=0).stop 2023-10-07T08:49:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.404+0000 7fe0f8aa3700 1 -- 172.21.15.81:0/3529171989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f4157ca0 msgr2=0x7fe0f40cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.404+0000 7fe0f8aa3700 1 --2- 172.21.15.81:0/3529171989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f4157ca0 0x7fe0f40cd4b0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00a380 tx=0x7fe0ec007900 comp rx=0 tx=0).stop 2023-10-07T08:49:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.404+0000 7fe0f8aa3700 1 -- 172.21.15.81:0/3529171989 shutdown_connections 2023-10-07T08:49:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.404+0000 7fe0f8aa3700 1 --2- 172.21.15.81:0/3529171989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0f4157ca0 0x7fe0f40cd4b0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.404+0000 7fe0f8aa3700 1 --2- 172.21.15.81:0/3529171989 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0d4066f60 0x7fe0d4069410 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.404+0000 7fe0f8aa3700 1 --2- 172.21.15.81:0/3529171989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0f406d120 0x7fe0f40c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.404+0000 7fe0f8aa3700 1 --2- 172.21.15.81:0/3529171989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f41578d0 0x7fe0f41580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.404+0000 7fe0f8aa3700 1 -- 172.21.15.81:0/3529171989 >> 172.21.15.81:0/3529171989 conn(0x7fe0f406bb90 msgr2=0x7fe0f4156720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:46.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.404+0000 7fe0f8aa3700 1 -- 172.21.15.81:0/3529171989 shutdown_connections 2023-10-07T08:49:46.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.404+0000 7fe0f8aa3700 1 -- 172.21.15.81:0/3529171989 wait complete. 2023-10-07T08:49:46.407 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2023-10-07T08:49:46.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:49:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.533+0000 7f96c1b28700 1 Processor -- start 2023-10-07T08:49:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.533+0000 7f96c1b28700 1 -- start start 2023-10-07T08:49:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.533+0000 7f96c1b28700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f96bc157fe0 0x7f96bc0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.533+0000 7f96c1b28700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96bc0cf240 0x7f96bc0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.533+0000 7f96c1b28700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc0b2890 con 0x7f96bc1583b0 2023-10-07T08:49:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.533+0000 7f96c1b28700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96bc0b4070 con 0x7f96bc0cf240 2023-10-07T08:49:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.533+0000 7f96c1b28700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96bc0b4350 con 0x7f96bc157fe0 2023-10-07T08:49:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.534+0000 7f96bbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96bc0cf240 0x7f96bc0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.534+0000 7f96b3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f96bc1583b0 0x7f96bc0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42006/0 (socket says 172.21.15.81:42006) 2023-10-07T08:49:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.534+0000 7f96b3fff700 1 -- 172.21.15.81:0/3087677768 learned_addr learned my addr 172.21.15.81:0/3087677768 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.534+0000 7f96bb7fe700 1 --2- 172.21.15.81:0/3087677768 >> v2:172.21.15.89:3300/0 conn(0x7f96bc157fe0 0x7f96bc0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.534+0000 7f96bbfff700 1 -- 172.21.15.81:0/3087677768 >> v2:172.21.15.89:3300/0 conn(0x7f96bc157fe0 msgr2=0x7f96bc0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:46.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.534+0000 7f96bbfff700 1 --2- 172.21.15.81:0/3087677768 >> v2:172.21.15.89:3300/0 conn(0x7f96bc157fe0 0x7f96bc0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.534+0000 7f96bbfff700 1 -- 172.21.15.81:0/3087677768 >> v1:172.21.15.81:6789/0 conn(0x7f96bc1583b0 legacy=0x7f96bc0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.534+0000 7f96bbfff700 1 -- 172.21.15.81:0/3087677768 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc0b4630 con 0x7f96bc0cf240 2023-10-07T08:49:46.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.534+0000 7f96bbfff700 1 --2- 172.21.15.81:0/3087677768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc0cf240 0x7f96bc0b3a00 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f96bc064d90 tx=0x7f96b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d357d40308e43b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:46.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.534+0000 7f96baffd700 1 -- 172.21.15.81:0/3087677768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b400e070 con 0x7f96bc0cf240 2023-10-07T08:49:46.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.534+0000 7f96baffd700 1 -- 172.21.15.81:0/3087677768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b400bb30 con 0x7f96bc0cf240 2023-10-07T08:49:46.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.534+0000 7f96baffd700 1 -- 172.21.15.81:0/3087677768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b400bed0 con 0x7f96bc0cf240 2023-10-07T08:49:46.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.535+0000 7f96c1b28700 1 -- 172.21.15.81:0/3087677768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc0cf240 msgr2=0x7f96bc0b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.535+0000 7f96c1b28700 1 --2- 172.21.15.81:0/3087677768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc0cf240 0x7f96bc0b3a00 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f96bc064d90 tx=0x7f96b4009780 comp rx=0 tx=0).stop 2023-10-07T08:49:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.535+0000 7f96c1b28700 1 -- 172.21.15.81:0/3087677768 shutdown_connections 2023-10-07T08:49:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.535+0000 7f96c1b28700 1 --2- 172.21.15.81:0/3087677768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc0cf240 0x7f96bc0b3a00 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.535+0000 7f96c1b28700 1 --2- 172.21.15.81:0/3087677768 >> v2:172.21.15.89:3300/0 conn(0x7f96bc157fe0 0x7f96bc0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.535+0000 7f96c1b28700 1 -- 172.21.15.81:0/3087677768 >> 172.21.15.81:0/3087677768 conn(0x7f96bc067640 msgr2=0x7f96bc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.535+0000 7f96c1b28700 1 -- 172.21.15.81:0/3087677768 shutdown_connections 2023-10-07T08:49:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.535+0000 7f96c1b28700 1 -- 172.21.15.81:0/3087677768 wait complete. 2023-10-07T08:49:46.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.536+0000 7f96c1b28700 1 Processor -- start 2023-10-07T08:49:46.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.536+0000 7f96c1b28700 1 -- start start 2023-10-07T08:49:46.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96c1b28700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96bc0cf240 0x7f96bc1599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96c1b28700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc157fe0 0x7f96bc159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96c1b28700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96bc1583b0 0x7f96bc0ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96c1b28700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc0cbb50 con 0x7f96bc157fe0 2023-10-07T08:49:46.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96c1b28700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc141fd0 con 0x7f96bc1583b0 2023-10-07T08:49:46.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96c1b28700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc15a890 con 0x7f96bc0cf240 2023-10-07T08:49:46.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc157fe0 0x7f96bc159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:46.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc157fe0 0x7f96bc159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35906/0 (socket says 172.21.15.81:35906) 2023-10-07T08:49:46.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96b3fff700 1 -- 172.21.15.81:0/837521262 learned_addr learned my addr 172.21.15.81:0/837521262 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:46.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96b3fff700 1 -- 172.21.15.81:0/837521262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96bc0cf240 msgr2=0x7f96bc1599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96b3fff700 1 --2- 172.21.15.81:0/837521262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96bc0cf240 0x7f96bc1599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96b3fff700 1 -- 172.21.15.81:0/837521262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96bc1583b0 msgr2=0x7f96bc0ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96b3fff700 1 --2- 172.21.15.81:0/837521262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96bc1583b0 0x7f96bc0ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96b3fff700 1 -- 172.21.15.81:0/837521262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b4009a20 con 0x7f96bc157fe0 2023-10-07T08:49:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96b3fff700 1 --2- 172.21.15.81:0/837521262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc157fe0 0x7f96bc159ee0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f96a400c760 tx=0x7f96a4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96b37fe700 1 -- 172.21.15.81:0/837521262 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4005b30 con 0x7f96bc157fe0 2023-10-07T08:49:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96b37fe700 1 -- 172.21.15.81:0/837521262 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a4005cb0 con 0x7f96bc157fe0 2023-10-07T08:49:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96c1b28700 1 -- 172.21.15.81:0/837521262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96bc15a5b0 con 0x7f96bc157fe0 2023-10-07T08:49:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96b37fe700 1 -- 172.21.15.81:0/837521262 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4007340 con 0x7f96bc157fe0 2023-10-07T08:49:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.537+0000 7f96c1b28700 1 -- 172.21.15.81:0/837521262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96bc141c60 con 0x7f96bc157fe0 2023-10-07T08:49:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.538+0000 7f96c1b28700 1 -- 172.21.15.81:0/837521262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96bc069e40 con 0x7f96bc157fe0 2023-10-07T08:49:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.539+0000 7f96b37fe700 1 -- 172.21.15.81:0/837521262 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96a401b400 con 0x7f96bc157fe0 2023-10-07T08:49:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.539+0000 7f96b37fe700 1 --2- 172.21.15.81:0/837521262 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f969c066f30 0x7f969c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.539+0000 7f96b37fe700 1 -- 172.21.15.81:0/837521262 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f96a4084150 con 0x7f96bc157fe0 2023-10-07T08:49:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.539+0000 7f96bb7fe700 1 --2- 172.21.15.81:0/837521262 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f969c066f30 0x7f969c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.539+0000 7f96bb7fe700 1 --2- 172.21.15.81:0/837521262 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f969c066f30 0x7f969c0693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f96ac009a60 tx=0x7f96ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.543+0000 7f96b37fe700 1 -- 172.21.15.81:0/837521262 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96a4051380 con 0x7f96bc157fe0 2023-10-07T08:49:46.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.769+0000 7f96c1b28700 1 -- 172.21.15.81:0/837521262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96bc142140 con 0x7f96bc157fe0 2023-10-07T08:49:46.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.770+0000 7f96b37fe700 1 -- 172.21.15.81:0/837521262 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f96a40549a0 con 0x7f96bc157fe0 2023-10-07T08:49:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:46.772 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1795695306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1795695306},{"type":"v1","addr":"172.21.15.89:6834","nonce":1795695306}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3856313795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3856313795},{"type":"v1","addr":"172.21.15.89:6835","nonce":3856313795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7119,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4143803144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4143803144},{"type":"v1","addr":"172.21.15.81:6836","nonce":4143803144}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:49:13.845110+0000","modified":"2023-10-07T08:49:17.485796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3151244734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3151244734},{"type":"v1","addr":"172.21.15.81:6837","nonce":3151244734}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-07T08:49:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.772+0000 7f96c1b28700 1 -- 172.21.15.81:0/837521262 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f969c066f30 msgr2=0x7f969c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.772+0000 7f96c1b28700 1 --2- 172.21.15.81:0/837521262 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f969c066f30 0x7f969c0693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f96ac009a60 tx=0x7f96ac008040 comp rx=0 tx=0).stop 2023-10-07T08:49:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.772+0000 7f96c1b28700 1 -- 172.21.15.81:0/837521262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc157fe0 msgr2=0x7f96bc159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.772+0000 7f96c1b28700 1 --2- 172.21.15.81:0/837521262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc157fe0 0x7f96bc159ee0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f96a400c760 tx=0x7f96a4007ef0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.772+0000 7f96c1b28700 1 -- 172.21.15.81:0/837521262 shutdown_connections 2023-10-07T08:49:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.772+0000 7f96c1b28700 1 --2- 172.21.15.81:0/837521262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96bc1583b0 0x7f96bc0ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.772+0000 7f96c1b28700 1 --2- 172.21.15.81:0/837521262 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f969c066f30 0x7f969c0693e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.772+0000 7f96c1b28700 1 --2- 172.21.15.81:0/837521262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96bc0cf240 0x7f96bc1599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.772+0000 7f96c1b28700 1 --2- 172.21.15.81:0/837521262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96bc157fe0 0x7f96bc159ee0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.772+0000 7f96c1b28700 1 -- 172.21.15.81:0/837521262 >> 172.21.15.81:0/837521262 conn(0x7f96bc067640 msgr2=0x7f96bc15d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.772+0000 7f96c1b28700 1 -- 172.21.15.81:0/837521262 shutdown_connections 2023-10-07T08:49:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.772+0000 7f96c1b28700 1 -- 172.21.15.81:0/837521262 wait complete. 2023-10-07T08:49:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2023-10-07T08:49:46.785 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:49:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.898+0000 7fa163b36700 1 Processor -- start 2023-10-07T08:49:46.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.898+0000 7fa163b36700 1 -- start start 2023-10-07T08:49:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa163b36700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa15c1578d0 0x7fa15c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa163b36700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa15c06d120 0x7fa15c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa163b36700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15c0d07c0 con 0x7fa15c157ca0 2023-10-07T08:49:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa163b36700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15c06daa0 con 0x7fa15c1578d0 2023-10-07T08:49:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa163b36700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c0cfbb0 con 0x7fa15c06d120 2023-10-07T08:49:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa1610d1700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa15c157ca0 0x7fa15c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42012/0 (socket says 172.21.15.81:42012) 2023-10-07T08:49:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa1610d1700 1 -- 172.21.15.81:0/1453983110 learned_addr learned my addr 172.21.15.81:0/1453983110 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa1620d3700 1 --2- 172.21.15.81:0/1453983110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa15c06d120 0x7fa15c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa1618d2700 1 --2- 172.21.15.81:0/1453983110 >> v2:172.21.15.89:3300/0 conn(0x7fa15c1578d0 0x7fa15c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa1608d0700 1 -- 172.21.15.81:0/1453983110 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035969502 0 0) 0x7fa15c0d07c0 con 0x7fa15c157ca0 2023-10-07T08:49:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa1608d0700 1 -- 172.21.15.81:0/1453983110 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa148003570 con 0x7fa15c157ca0 2023-10-07T08:49:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa1618d2700 1 -- 172.21.15.81:0/1453983110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa15c06d120 msgr2=0x7fa15c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa1618d2700 1 --2- 172.21.15.81:0/1453983110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa15c06d120 0x7fa15c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa1618d2700 1 -- 172.21.15.81:0/1453983110 >> v1:172.21.15.81:6789/0 conn(0x7fa15c157ca0 legacy=0x7fa15c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa1618d2700 1 -- 172.21.15.81:0/1453983110 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c0cfe90 con 0x7fa15c1578d0 2023-10-07T08:49:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa1620d3700 1 --2- 172.21.15.81:0/1453983110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa15c06d120 0x7fa15c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:49:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa1618d2700 1 --2- 172.21.15.81:0/1453983110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa15c1578d0 0x7fa15c0cf4f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa158009e60 tx=0x7fa158009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b620baef654481a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.899+0000 7fa1608d0700 1 -- 172.21.15.81:0/1453983110 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15800e070 con 0x7fa15c1578d0 2023-10-07T08:49:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.900+0000 7fa1608d0700 1 -- 172.21.15.81:0/1453983110 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15800bab0 con 0x7fa15c1578d0 2023-10-07T08:49:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.900+0000 7fa1608d0700 1 -- 172.21.15.81:0/1453983110 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15800be70 con 0x7fa15c1578d0 2023-10-07T08:49:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.900+0000 7fa163b36700 1 -- 172.21.15.81:0/1453983110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa15c1578d0 msgr2=0x7fa15c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.900+0000 7fa163b36700 1 --2- 172.21.15.81:0/1453983110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa15c1578d0 0x7fa15c0cf4f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa158009e60 tx=0x7fa158009780 comp rx=0 tx=0).stop 2023-10-07T08:49:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.900+0000 7fa163b36700 1 -- 172.21.15.81:0/1453983110 shutdown_connections 2023-10-07T08:49:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.900+0000 7fa163b36700 1 --2- 172.21.15.81:0/1453983110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa15c1578d0 0x7fa15c0cf4f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.900+0000 7fa163b36700 1 --2- 172.21.15.81:0/1453983110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa15c06d120 0x7fa15c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.900+0000 7fa163b36700 1 -- 172.21.15.81:0/1453983110 >> 172.21.15.81:0/1453983110 conn(0x7fa15c06bb90 msgr2=0x7fa15c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.900+0000 7fa163b36700 1 -- 172.21.15.81:0/1453983110 shutdown_connections 2023-10-07T08:49:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.900+0000 7fa163b36700 1 -- 172.21.15.81:0/1453983110 wait complete. 2023-10-07T08:49:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.901+0000 7fa163b36700 1 Processor -- start 2023-10-07T08:49:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.901+0000 7fa163b36700 1 -- start start 2023-10-07T08:49:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa163b36700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c06d120 0x7fa15c0c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa163b36700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa15c1578d0 0x7fa15c16a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa163b36700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa15c157ca0 0x7fa15c16aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa163b36700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c16c140 con 0x7fa15c06d120 2023-10-07T08:49:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa163b36700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c1553e0 con 0x7fa15c1578d0 2023-10-07T08:49:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa163b36700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c16bb60 con 0x7fa15c157ca0 2023-10-07T08:49:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa1618d2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c06d120 0x7fa15c0c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa1618d2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c06d120 0x7fa15c0c9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35914/0 (socket says 172.21.15.81:35914) 2023-10-07T08:49:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa1618d2700 1 -- 172.21.15.81:0/2213777487 learned_addr learned my addr 172.21.15.81:0/2213777487 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa1610d1700 1 --2- 172.21.15.81:0/2213777487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa15c1578d0 0x7fa15c16a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa1620d3700 1 --2- 172.21.15.81:0/2213777487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa15c157ca0 0x7fa15c16aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa1618d2700 1 -- 172.21.15.81:0/2213777487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa15c157ca0 msgr2=0x7fa15c16aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa1618d2700 1 --2- 172.21.15.81:0/2213777487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa15c157ca0 0x7fa15c16aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa1618d2700 1 -- 172.21.15.81:0/2213777487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa15c1578d0 msgr2=0x7fa15c16a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa1618d2700 1 --2- 172.21.15.81:0/2213777487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa15c1578d0 0x7fa15c16a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa1618d2700 1 -- 172.21.15.81:0/2213777487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa154009420 con 0x7fa15c06d120 2023-10-07T08:49:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.902+0000 7fa1618d2700 1 --2- 172.21.15.81:0/2213777487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c06d120 0x7fa15c0c9380 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fa15800b610 tx=0x7fa158019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.903+0000 7fa151ffb700 1 -- 172.21.15.81:0/2213777487 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158012e20 con 0x7fa15c06d120 2023-10-07T08:49:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.903+0000 7fa151ffb700 1 -- 172.21.15.81:0/2213777487 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa158027470 con 0x7fa15c06d120 2023-10-07T08:49:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.903+0000 7fa163b36700 1 -- 172.21.15.81:0/2213777487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa158009a20 con 0x7fa15c06d120 2023-10-07T08:49:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.903+0000 7fa151ffb700 1 -- 172.21.15.81:0/2213777487 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158027830 con 0x7fa15c06d120 2023-10-07T08:49:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.903+0000 7fa163b36700 1 -- 172.21.15.81:0/2213777487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15c16b7c0 con 0x7fa15c06d120 2023-10-07T08:49:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.904+0000 7fa163b36700 1 -- 172.21.15.81:0/2213777487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15c067ac0 con 0x7fa15c06d120 2023-10-07T08:49:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.904+0000 7fa151ffb700 1 -- 172.21.15.81:0/2213777487 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa158024070 con 0x7fa15c06d120 2023-10-07T08:49:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.904+0000 7fa151ffb700 1 --2- 172.21.15.81:0/2213777487 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa140066f30 0x7fa1400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.904+0000 7fa151ffb700 1 -- 172.21.15.81:0/2213777487 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fa1580869b0 con 0x7fa15c06d120 2023-10-07T08:49:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.905+0000 7fa1610d1700 1 --2- 172.21.15.81:0/2213777487 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa140066f30 0x7fa1400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:46.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.905+0000 7fa1610d1700 1 --2- 172.21.15.81:0/2213777487 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa140066f30 0x7fa1400693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa15c06a670 tx=0x7fa14c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:46.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:46.909+0000 7fa151ffb700 1 -- 172.21.15.81:0/2213777487 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa158053ca0 con 0x7fa15c06d120 2023-10-07T08:49:47.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.092+0000 7fa163b36700 1 -- 172.21.15.81:0/2213777487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa15c0d0170 con 0x7fa15c06d120 2023-10-07T08:49:47.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.093+0000 7fa151ffb700 1 -- 172.21.15.81:0/2213777487 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+15422 (secure 0 0 0) 0x7fa1580572c0 con 0x7fa15c06d120 2023-10-07T08:49:47.095 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:47.095 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":143,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:49:45.565217+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:49:12.162742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-07T08:49:12.805348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.17","mappings":[{"from":0,"to":5}]},{"pgid":"17.3f","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:49:47.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.095+0000 7fa163b36700 1 -- 172.21.15.81:0/2213777487 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa140066f30 msgr2=0x7fa1400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:47.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.095+0000 7fa163b36700 1 --2- 172.21.15.81:0/2213777487 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa140066f30 0x7fa1400693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa15c06a670 tx=0x7fa14c009040 comp rx=0 tx=0).stop 2023-10-07T08:49:47.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.095+0000 7fa163b36700 1 -- 172.21.15.81:0/2213777487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c06d120 msgr2=0x7fa15c0c9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:47.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.095+0000 7fa163b36700 1 --2- 172.21.15.81:0/2213777487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c06d120 0x7fa15c0c9380 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fa15800b610 tx=0x7fa158019000 comp rx=0 tx=0).stop 2023-10-07T08:49:47.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.095+0000 7fa163b36700 1 -- 172.21.15.81:0/2213777487 shutdown_connections 2023-10-07T08:49:47.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.095+0000 7fa163b36700 1 --2- 172.21.15.81:0/2213777487 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa140066f30 0x7fa1400693e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.095+0000 7fa163b36700 1 --2- 172.21.15.81:0/2213777487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa15c157ca0 0x7fa15c16aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.095+0000 7fa163b36700 1 --2- 172.21.15.81:0/2213777487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa15c06d120 0x7fa15c0c9380 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.095+0000 7fa163b36700 1 --2- 172.21.15.81:0/2213777487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa15c1578d0 0x7fa15c16a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.095+0000 7fa163b36700 1 -- 172.21.15.81:0/2213777487 >> 172.21.15.81:0/2213777487 conn(0x7fa15c06bb90 msgr2=0x7fa15c155ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:47.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.095+0000 7fa163b36700 1 -- 172.21.15.81:0/2213777487 shutdown_connections 2023-10-07T08:49:47.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.095+0000 7fa163b36700 1 -- 172.21.15.81:0/2213777487 wait complete. 2023-10-07T08:49:47.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T08:49:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.223+0000 7ffa586c3700 1 Processor -- start 2023-10-07T08:49:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.223+0000 7ffa586c3700 1 -- start start 2023-10-07T08:49:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.224+0000 7ffa586c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa50157ca0 0x7ffa500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.224+0000 7ffa586c3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa500d07c0 con 0x7ffa501578d0 2023-10-07T08:49:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.224+0000 7ffa586c3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa500cfbb0 con 0x7ffa5006d120 2023-10-07T08:49:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.224+0000 7ffa586c3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500cfe90 con 0x7ffa50157ca0 2023-10-07T08:49:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.224+0000 7ffa5645f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ffa501578d0 0x7ffa5015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42014/0 (socket says 172.21.15.81:42014) 2023-10-07T08:49:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.224+0000 7ffa5645f700 1 -- 172.21.15.81:0/4269148915 learned_addr learned my addr 172.21.15.81:0/4269148915 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa5545d700 1 -- 172.21.15.81:0/4269148915 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646919722 0 0) 0x7ffa500d07c0 con 0x7ffa501578d0 2023-10-07T08:49:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa5545d700 1 -- 172.21.15.81:0/4269148915 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa3c003570 con 0x7ffa501578d0 2023-10-07T08:49:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa55c5e700 1 --2- 172.21.15.81:0/4269148915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa50157ca0 0x7ffa500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa5545d700 1 -- 172.21.15.81:0/4269148915 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1203172297 0 0) 0x7ffa3c003570 con 0x7ffa501578d0 2023-10-07T08:49:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa5545d700 1 -- 172.21.15.81:0/4269148915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa50157ca0 msgr2=0x7ffa500cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa5545d700 1 --2- 172.21.15.81:0/4269148915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa50157ca0 0x7ffa500cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa5545d700 1 -- 172.21.15.81:0/4269148915 >> v1:172.21.15.89:6789/0 conn(0x7ffa5006d120 legacy=0x7ffa5015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa5545d700 1 -- 172.21.15.81:0/4269148915 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa500d0170 con 0x7ffa501578d0 2023-10-07T08:49:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa5545d700 1 -- 172.21.15.81:0/4269148915 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7ffa4c0017f0 con 0x7ffa501578d0 2023-10-07T08:49:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa5545d700 1 -- 172.21.15.81:0/4269148915 >> v1:172.21.15.81:6789/0 conn(0x7ffa501578d0 legacy=0x7ffa5015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa5545d700 1 --2- 172.21.15.81:0/4269148915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa50157ca0 0x7ffa3c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa5545d700 1 --2- 172.21.15.81:0/4269148915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa3c003fd0 0x7ffa3c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa5545d700 1 --2- 172.21.15.81:0/4269148915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa3c004d50 0x7ffa3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa5545d700 1 -- 172.21.15.81:0/4269148915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500cfe90 con 0x7ffa3c004d50 2023-10-07T08:49:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa5545d700 1 -- 172.21.15.81:0/4269148915 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c00bb40 con 0x7ffa3c003fd0 2023-10-07T08:49:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa5545d700 1 -- 172.21.15.81:0/4269148915 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c00bd00 con 0x7ffa50157ca0 2023-10-07T08:49:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa56c60700 1 --2- 172.21.15.81:0/4269148915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa3c004d50 0x7ffa3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa5645f700 1 --2- 172.21.15.81:0/4269148915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa50157ca0 0x7ffa3c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa55c5e700 1 --2- 172.21.15.81:0/4269148915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa3c003fd0 0x7ffa3c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa56c60700 1 -- 172.21.15.81:0/4269148915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa50157ca0 msgr2=0x7ffa3c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa56c60700 1 --2- 172.21.15.81:0/4269148915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa50157ca0 0x7ffa3c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa56c60700 1 -- 172.21.15.81:0/4269148915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa3c003fd0 msgr2=0x7ffa3c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa56c60700 1 --2- 172.21.15.81:0/4269148915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa3c003fd0 0x7ffa3c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa56c60700 1 -- 172.21.15.81:0/4269148915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c003570 con 0x7ffa3c004d50 2023-10-07T08:49:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.225+0000 7ffa56c60700 1 --2- 172.21.15.81:0/4269148915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa3c004d50 0x7ffa3c0051c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7ffa480019a0 tx=0x7ffa48007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98933067ec539e1c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.226+0000 7ffa5545d700 1 -- 172.21.15.81:0/4269148915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4800c5d0 con 0x7ffa3c004d50 2023-10-07T08:49:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.226+0000 7ffa5545d700 1 -- 172.21.15.81:0/4269148915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4800c750 con 0x7ffa3c004d50 2023-10-07T08:49:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.226+0000 7ffa5545d700 1 -- 172.21.15.81:0/4269148915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4800cb10 con 0x7ffa3c004d50 2023-10-07T08:49:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.226+0000 7ffa586c3700 1 -- 172.21.15.81:0/4269148915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa3c004d50 msgr2=0x7ffa3c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.226+0000 7ffa586c3700 1 --2- 172.21.15.81:0/4269148915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa3c004d50 0x7ffa3c0051c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7ffa480019a0 tx=0x7ffa48007d10 comp rx=0 tx=0).stop 2023-10-07T08:49:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.226+0000 7ffa56c60700 1 -- 172.21.15.81:0/4269148915 reap_dead start 2023-10-07T08:49:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.226+0000 7ffa586c3700 1 -- 172.21.15.81:0/4269148915 shutdown_connections 2023-10-07T08:49:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.226+0000 7ffa586c3700 1 -- 172.21.15.81:0/4269148915 >> 172.21.15.81:0/4269148915 conn(0x7ffa5006bb90 msgr2=0x7ffa5006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.226+0000 7ffa586c3700 1 -- 172.21.15.81:0/4269148915 shutdown_connections 2023-10-07T08:49:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.226+0000 7ffa586c3700 1 -- 172.21.15.81:0/4269148915 wait complete. 2023-10-07T08:49:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.227+0000 7ffa586c3700 1 Processor -- start 2023-10-07T08:49:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.227+0000 7ffa586c3700 1 -- start start 2023-10-07T08:49:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa586c3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa3c004d50 0x7ffa500c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa586c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa50154be0 0x7ffa50145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa586c3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa5016dba0 0x7ffa5015da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa586c3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500c78a0 con 0x7ffa3c004d50 2023-10-07T08:49:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa586c3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500c5c50 con 0x7ffa5016dba0 2023-10-07T08:49:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa586c3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500c8240 con 0x7ffa50154be0 2023-10-07T08:49:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa5645f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa3c004d50 0x7ffa500c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa5645f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa3c004d50 0x7ffa500c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35932/0 (socket says 172.21.15.81:35932) 2023-10-07T08:49:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa5645f700 1 -- 172.21.15.81:0/322843157 learned_addr learned my addr 172.21.15.81:0/322843157 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa56c60700 1 --2- 172.21.15.81:0/322843157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa5016dba0 0x7ffa5015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa55c5e700 1 --2- 172.21.15.81:0/322843157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa50154be0 0x7ffa50145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa5645f700 1 -- 172.21.15.81:0/322843157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa50154be0 msgr2=0x7ffa50145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa5645f700 1 --2- 172.21.15.81:0/322843157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa50154be0 0x7ffa50145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa5645f700 1 -- 172.21.15.81:0/322843157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa5016dba0 msgr2=0x7ffa5015da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa5645f700 1 --2- 172.21.15.81:0/322843157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa5016dba0 0x7ffa5015da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa5645f700 1 -- 172.21.15.81:0/322843157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5016e160 con 0x7ffa3c004d50 2023-10-07T08:49:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa56c60700 1 --2- 172.21.15.81:0/322843157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa5016dba0 0x7ffa5015da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.228+0000 7ffa5645f700 1 --2- 172.21.15.81:0/322843157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa3c004d50 0x7ffa500c7d00 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c007ac0 tx=0x7ffa5015b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.229+0000 7ffa467fc700 1 -- 172.21.15.81:0/322843157 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00ad50 con 0x7ffa3c004d50 2023-10-07T08:49:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.229+0000 7ffa467fc700 1 -- 172.21.15.81:0/322843157 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c0133f0 con 0x7ffa3c004d50 2023-10-07T08:49:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.229+0000 7ffa586c3700 1 -- 172.21.15.81:0/322843157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5016e440 con 0x7ffa3c004d50 2023-10-07T08:49:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.229+0000 7ffa467fc700 1 -- 172.21.15.81:0/322843157 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0137b0 con 0x7ffa3c004d50 2023-10-07T08:49:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.229+0000 7ffa586c3700 1 -- 172.21.15.81:0/322843157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5015df80 con 0x7ffa3c004d50 2023-10-07T08:49:47.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.230+0000 7ffa586c3700 1 -- 172.21.15.81:0/322843157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa50067ac0 con 0x7ffa3c004d50 2023-10-07T08:49:47.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.230+0000 7ffa467fc700 1 -- 172.21.15.81:0/322843157 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa4c013ba0 con 0x7ffa3c004d50 2023-10-07T08:49:47.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.230+0000 7ffa467fc700 1 --2- 172.21.15.81:0/322843157 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffa34066f30 0x7ffa340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:47.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.230+0000 7ffa467fc700 1 -- 172.21.15.81:0/322843157 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ffa4c085230 con 0x7ffa3c004d50 2023-10-07T08:49:47.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.231+0000 7ffa55c5e700 1 --2- 172.21.15.81:0/322843157 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffa34066f30 0x7ffa340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:47.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.231+0000 7ffa55c5e700 1 --2- 172.21.15.81:0/322843157 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffa34066f30 0x7ffa340693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ffa5006a0f0 tx=0x7ffa40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:47.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.235+0000 7ffa467fc700 1 -- 172.21.15.81:0/322843157 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa4c052460 con 0x7ffa3c004d50 2023-10-07T08:49:47.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.460+0000 7ffa586c3700 1 -- 172.21.15.81:0/322843157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ffa500d0450 con 0x7ffa3c004d50 2023-10-07T08:49:47.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:49:47.460+0000 7f43c472d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T08:49:47.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.465+0000 7ffa467fc700 1 -- 172.21.15.81:0/322843157 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7ffa4c055a80 con 0x7ffa3c004d50 2023-10-07T08:49:47.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.467+0000 7ffa586c3700 1 -- 172.21.15.81:0/322843157 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffa34066f30 msgr2=0x7ffa340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:47.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.467+0000 7ffa586c3700 1 --2- 172.21.15.81:0/322843157 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffa34066f30 0x7ffa340693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ffa5006a0f0 tx=0x7ffa40008040 comp rx=0 tx=0).stop 2023-10-07T08:49:47.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.467+0000 7ffa586c3700 1 -- 172.21.15.81:0/322843157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa3c004d50 msgr2=0x7ffa500c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:47.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.467+0000 7ffa586c3700 1 --2- 172.21.15.81:0/322843157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa3c004d50 0x7ffa500c7d00 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c007ac0 tx=0x7ffa5015b610 comp rx=0 tx=0).stop 2023-10-07T08:49:47.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.468+0000 7ffa586c3700 1 -- 172.21.15.81:0/322843157 shutdown_connections 2023-10-07T08:49:47.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.468+0000 7ffa586c3700 1 --2- 172.21.15.81:0/322843157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa5016dba0 0x7ffa5015da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.468+0000 7ffa586c3700 1 --2- 172.21.15.81:0/322843157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa3c004d50 0x7ffa500c7d00 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.468+0000 7ffa586c3700 1 --2- 172.21.15.81:0/322843157 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ffa34066f30 0x7ffa340693e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.468+0000 7ffa586c3700 1 --2- 172.21.15.81:0/322843157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa50154be0 0x7ffa50145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.468+0000 7ffa586c3700 1 -- 172.21.15.81:0/322843157 >> 172.21.15.81:0/322843157 conn(0x7ffa5006bb90 msgr2=0x7ffa50156a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:47.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.468+0000 7ffa586c3700 1 -- 172.21.15.81:0/322843157 shutdown_connections 2023-10-07T08:49:47.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.468+0000 7ffa586c3700 1 -- 172.21.15.81:0/322843157 wait complete. 2023-10-07T08:49:47.470 INFO:tasks.ceph.mds.c.smithi081.stderr: -7437> 2023-10-07T08:49:19.753+0000 7fc6f282c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:49:47.471 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T08:49:47.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T08:49:47.497 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-07T08:49:47.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.597+0000 7f648b59e700 1 Processor -- start 2023-10-07T08:49:47.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.597+0000 7f648b59e700 1 -- start start 2023-10-07T08:49:47.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f648b59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f648c0d0f50 0x7f648c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:47.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f648b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c06d9b0 con 0x7f648c0d0b80 2023-10-07T08:49:47.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f648b59e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c0cf2d0 con 0x7f648c06d530 2023-10-07T08:49:47.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f648b59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c15a690 con 0x7f648c0d0f50 2023-10-07T08:49:47.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f648a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f648c0d0b80 0x7f648c0cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42038/0 (socket says 172.21.15.81:42038) 2023-10-07T08:49:47.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f648a59c700 1 -- 172.21.15.81:0/3153556241 learned_addr learned my addr 172.21.15.81:0/3153556241 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:47.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f6489d9b700 1 -- 172.21.15.81:0/3153556241 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622139761 0 0) 0x7f648c06d9b0 con 0x7f648c0d0b80 2023-10-07T08:49:47.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f6489d9b700 1 -- 172.21.15.81:0/3153556241 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6478003570 con 0x7f648c0d0b80 2023-10-07T08:49:47.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f6481d9b700 1 --2- 172.21.15.81:0/3153556241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f648c0d0f50 0x7f648c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:47.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f6489d9b700 1 -- 172.21.15.81:0/3153556241 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3840369444 0 0) 0x7f6478003570 con 0x7f648c0d0b80 2023-10-07T08:49:47.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f6489d9b700 1 -- 172.21.15.81:0/3153556241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f648c0d0f50 msgr2=0x7f648c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:47.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f6489d9b700 1 --2- 172.21.15.81:0/3153556241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f648c0d0f50 0x7f648c06cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f6489d9b700 1 -- 172.21.15.81:0/3153556241 >> v1:172.21.15.89:6789/0 conn(0x7f648c06d530 legacy=0x7f648c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:47.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f6489d9b700 1 -- 172.21.15.81:0/3153556241 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c0d0480 con 0x7f648c0d0b80 2023-10-07T08:49:47.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f6489d9b700 1 -- 172.21.15.81:0/3153556241 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f647c001470 con 0x7f648c0d0b80 2023-10-07T08:49:47.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f6481d9b700 1 --2- 172.21.15.81:0/3153556241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f648c0d0f50 0x7f648c06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:47.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f6489d9b700 1 -- 172.21.15.81:0/3153556241 >> v1:172.21.15.81:6789/0 conn(0x7f648c0d0b80 legacy=0x7f648c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:47.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.598+0000 7f6489d9b700 1 --2- 172.21.15.81:0/3153556241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6478003a90 0x7f6478003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:47.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f6489d9b700 1 --2- 172.21.15.81:0/3153556241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f648c0d0f50 0x7f6478004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:47.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f6489d9b700 1 --2- 172.21.15.81:0/3153556241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6478004d50 0x7f64780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:47.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f6489d9b700 1 -- 172.21.15.81:0/3153556241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c15a690 con 0x7f6478004d50 2023-10-07T08:49:47.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f6489d9b700 1 -- 172.21.15.81:0/3153556241 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647800bc70 con 0x7f6478003a90 2023-10-07T08:49:47.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f6489d9b700 1 -- 172.21.15.81:0/3153556241 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647800be30 con 0x7f648c0d0f50 2023-10-07T08:49:47.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f648ad9d700 1 --2- 172.21.15.81:0/3153556241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6478004d50 0x7f64780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:47.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f648a59c700 1 --2- 172.21.15.81:0/3153556241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6478003a90 0x7f6478003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:47.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f6481d9b700 1 --2- 172.21.15.81:0/3153556241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f648c0d0f50 0x7f6478004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:47.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f648ad9d700 1 -- 172.21.15.81:0/3153556241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f648c0d0f50 msgr2=0x7f6478004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:47.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f648ad9d700 1 --2- 172.21.15.81:0/3153556241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f648c0d0f50 0x7f6478004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f648ad9d700 1 -- 172.21.15.81:0/3153556241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6478003a90 msgr2=0x7f6478003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:47.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f648ad9d700 1 --2- 172.21.15.81:0/3153556241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6478003a90 0x7f6478003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f648ad9d700 1 -- 172.21.15.81:0/3153556241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6478003570 con 0x7f6478004d50 2023-10-07T08:49:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f648ad9d700 1 --2- 172.21.15.81:0/3153556241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6478004d50 0x7f64780051c0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f6484001fc0 tx=0x7f6484001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e0de4312bf3a94 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f6489d9b700 1 -- 172.21.15.81:0/3153556241 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484001950 con 0x7f6478004d50 2023-10-07T08:49:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f6489d9b700 1 -- 172.21.15.81:0/3153556241 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648400c8b0 con 0x7f6478004d50 2023-10-07T08:49:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.599+0000 7f6489d9b700 1 -- 172.21.15.81:0/3153556241 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648400cc50 con 0x7f6478004d50 2023-10-07T08:49:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.600+0000 7f648b59e700 1 -- 172.21.15.81:0/3153556241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6478004d50 msgr2=0x7f64780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.600+0000 7f648b59e700 1 --2- 172.21.15.81:0/3153556241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6478004d50 0x7f64780051c0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f6484001fc0 tx=0x7f6484001640 comp rx=0 tx=0).stop 2023-10-07T08:49:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.600+0000 7f648ad9d700 1 -- 172.21.15.81:0/3153556241 reap_dead start 2023-10-07T08:49:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.600+0000 7f648b59e700 1 -- 172.21.15.81:0/3153556241 shutdown_connections 2023-10-07T08:49:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.600+0000 7f648b59e700 1 -- 172.21.15.81:0/3153556241 >> 172.21.15.81:0/3153556241 conn(0x7f648c063230 msgr2=0x7f648c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.600+0000 7f648b59e700 1 -- 172.21.15.81:0/3153556241 shutdown_connections 2023-10-07T08:49:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.600+0000 7f648b59e700 1 -- 172.21.15.81:0/3153556241 wait complete. 2023-10-07T08:49:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.601+0000 7f648b59e700 1 Processor -- start 2023-10-07T08:49:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.601+0000 7f648b59e700 1 -- start start 2023-10-07T08:49:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648b59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f648c154ac0 0x7f648c088fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648b59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f648c15dc20 0x7f648c15b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f648c154e90 0x7f648c15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c15ecc0 con 0x7f648c154e90 2023-10-07T08:49:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648b59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c15e0b0 con 0x7f648c154ac0 2023-10-07T08:49:47.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648b59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c15e390 con 0x7f648c15dc20 2023-10-07T08:49:47.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f648c154e90 0x7f648c15b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:47.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f648c154e90 0x7f648c15b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35968/0 (socket says 172.21.15.81:35968) 2023-10-07T08:49:47.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648ad9d700 1 -- 172.21.15.81:0/1065410189 learned_addr learned my addr 172.21.15.81:0/1065410189 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:47.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648a59c700 1 --2- 172.21.15.81:0/1065410189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f648c154ac0 0x7f648c088fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:47.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f6481d9b700 1 --2- 172.21.15.81:0/1065410189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f648c15dc20 0x7f648c15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:47.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648ad9d700 1 -- 172.21.15.81:0/1065410189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f648c15dc20 msgr2=0x7f648c15b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:47.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648ad9d700 1 --2- 172.21.15.81:0/1065410189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f648c15dc20 0x7f648c15b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648ad9d700 1 -- 172.21.15.81:0/1065410189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f648c154ac0 msgr2=0x7f648c088fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:47.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648ad9d700 1 --2- 172.21.15.81:0/1065410189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f648c154ac0 0x7f648c088fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:47.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648ad9d700 1 -- 172.21.15.81:0/1065410189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c15e670 con 0x7f648c154e90 2023-10-07T08:49:47.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648a59c700 1 --2- 172.21.15.81:0/1065410189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f648c154ac0 0x7f648c088fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:47.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f6481d9b700 1 --2- 172.21.15.81:0/1065410189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f648c15dc20 0x7f648c15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:47.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648ad9d700 1 --2- 172.21.15.81:0/1065410189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f648c154e90 0x7f648c15b7d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f647800bc40 tx=0x7f6484015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:47.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f6482ffd700 1 -- 172.21.15.81:0/1065410189 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484001950 con 0x7f648c154e90 2023-10-07T08:49:47.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f6482ffd700 1 -- 172.21.15.81:0/1065410189 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648400c6d0 con 0x7f648c154e90 2023-10-07T08:49:47.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648b59e700 1 -- 172.21.15.81:0/1065410189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648c15e950 con 0x7f648c154e90 2023-10-07T08:49:47.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f6482ffd700 1 -- 172.21.15.81:0/1065410189 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484006dd0 con 0x7f648c154e90 2023-10-07T08:49:47.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.602+0000 7f648b59e700 1 -- 172.21.15.81:0/1065410189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648c0b3eb0 con 0x7f648c154e90 2023-10-07T08:49:47.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.603+0000 7f648b59e700 1 -- 172.21.15.81:0/1065410189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648c15ee70 con 0x7f648c154e90 2023-10-07T08:49:47.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.604+0000 7f6482ffd700 1 -- 172.21.15.81:0/1065410189 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6484019070 con 0x7f648c154e90 2023-10-07T08:49:47.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.604+0000 7f6482ffd700 1 --2- 172.21.15.81:0/1065410189 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f646c066f30 0x7f646c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:47.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.604+0000 7f6482ffd700 1 -- 172.21.15.81:0/1065410189 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f6484086190 con 0x7f648c154e90 2023-10-07T08:49:47.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.604+0000 7f648a59c700 1 --2- 172.21.15.81:0/1065410189 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f646c066f30 0x7f646c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:47.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.604+0000 7f648a59c700 1 --2- 172.21.15.81:0/1065410189 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f646c066f30 0x7f646c0693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f647c001200 tx=0x7f647c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:47.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.608+0000 7f6482ffd700 1 -- 172.21.15.81:0/1065410189 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f648c15ee70 con 0x7f648c154e90 2023-10-07T08:49:47.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:47.830+0000 7f648b59e700 1 -- 172.21.15.81:0/1065410189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f648c15ee70 con 0x7f648c154e90 2023-10-07T08:49:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.465+0000 7f6482ffd700 1 -- 172.21.15.81:0/1065410189 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7f648c15ee70 con 0x7f648c154e90 2023-10-07T08:49:48.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.468+0000 7f648b59e700 1 -- 172.21.15.81:0/1065410189 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f646c066f30 msgr2=0x7f646c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:48.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.468+0000 7f648b59e700 1 --2- 172.21.15.81:0/1065410189 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f646c066f30 0x7f646c0693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f647c001200 tx=0x7f647c009040 comp rx=0 tx=0).stop 2023-10-07T08:49:48.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.468+0000 7f648b59e700 1 -- 172.21.15.81:0/1065410189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f648c154e90 msgr2=0x7f648c15b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:48.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.468+0000 7f648b59e700 1 --2- 172.21.15.81:0/1065410189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f648c154e90 0x7f648c15b7d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f647800bc40 tx=0x7f6484015000 comp rx=0 tx=0).stop 2023-10-07T08:49:48.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.468+0000 7f648b59e700 1 -- 172.21.15.81:0/1065410189 shutdown_connections 2023-10-07T08:49:48.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.468+0000 7f648b59e700 1 --2- 172.21.15.81:0/1065410189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f648c154e90 0x7f648c15b7d0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:48.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.468+0000 7f648b59e700 1 --2- 172.21.15.81:0/1065410189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f648c154ac0 0x7f648c088fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:48.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.468+0000 7f648b59e700 1 --2- 172.21.15.81:0/1065410189 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f646c066f30 0x7f646c0693e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:48.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.468+0000 7f648b59e700 1 --2- 172.21.15.81:0/1065410189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f648c15dc20 0x7f648c15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:48.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.468+0000 7f648b59e700 1 -- 172.21.15.81:0/1065410189 >> 172.21.15.81:0/1065410189 conn(0x7f648c063230 msgr2=0x7f648c158a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:48.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.468+0000 7f648b59e700 1 -- 172.21.15.81:0/1065410189 shutdown_connections 2023-10-07T08:49:48.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.468+0000 7f648b59e700 1 -- 172.21.15.81:0/1065410189 wait complete. 2023-10-07T08:49:48.482 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T08:49:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.641+0000 7f372c2f6700 1 Processor -- start 2023-10-07T08:49:48.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.641+0000 7f372c2f6700 1 -- start start 2023-10-07T08:49:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.642+0000 7f372c2f6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3724157ca0 0x7f37240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.642+0000 7f372c2f6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f372406d120 0x7f372406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.642+0000 7f372c2f6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37240d07c0 con 0x7f37241578d0 2023-10-07T08:49:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.642+0000 7f372c2f6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372406daa0 con 0x7f3724157ca0 2023-10-07T08:49:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.642+0000 7f372c2f6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37240cfbb0 con 0x7f372406d120 2023-10-07T08:49:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.642+0000 7f3729891700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3724157ca0 0x7f37240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.642+0000 7f372a893700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f372406d120 0x7f372406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:48.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.642+0000 7f372a092700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f37241578d0 0x7f372415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:43006/0 (socket says 172.21.15.81:43006) 2023-10-07T08:49:48.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.642+0000 7f3729891700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3724157ca0 0x7f37240cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:60554/0 (socket says 172.21.15.81:60554) 2023-10-07T08:49:48.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.642+0000 7f372a092700 1 -- 172.21.15.81:0/267789609 learned_addr learned my addr 172.21.15.81:0/267789609 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:48.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.643+0000 7f3729891700 1 -- 172.21.15.81:0/267789609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f372406d120 msgr2=0x7f372406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:48.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.643+0000 7f3729891700 1 --2- 172.21.15.81:0/267789609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f372406d120 0x7f372406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:48.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.643+0000 7f3729891700 1 -- 172.21.15.81:0/267789609 >> v1:172.21.15.89:6789/0 conn(0x7f37241578d0 legacy=0x7f372415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:48.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.643+0000 7f3729891700 1 -- 172.21.15.81:0/267789609 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37240cfe90 con 0x7f3724157ca0 2023-10-07T08:49:48.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.643+0000 7f3729891700 1 --2- 172.21.15.81:0/267789609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3724157ca0 0x7f37240cf4f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f37140098e0 tx=0x7f37140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ebc8398d9d6bd00 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:48.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.643+0000 7f3729090700 1 -- 172.21.15.81:0/267789609 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371400b640 con 0x7f3724157ca0 2023-10-07T08:49:48.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.643+0000 7f3729090700 1 -- 172.21.15.81:0/267789609 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371400b7a0 con 0x7f3724157ca0 2023-10-07T08:49:48.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.643+0000 7f3729090700 1 -- 172.21.15.81:0/267789609 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371400bb40 con 0x7f3724157ca0 2023-10-07T08:49:48.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.644+0000 7f372c2f6700 1 -- 172.21.15.81:0/267789609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3724157ca0 msgr2=0x7f37240cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:48.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.644+0000 7f372c2f6700 1 --2- 172.21.15.81:0/267789609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3724157ca0 0x7f37240cf4f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f37140098e0 tx=0x7f37140091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:48.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.644+0000 7f372c2f6700 1 -- 172.21.15.81:0/267789609 shutdown_connections 2023-10-07T08:49:48.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.644+0000 7f372c2f6700 1 --2- 172.21.15.81:0/267789609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f372406d120 0x7f372406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:48.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.644+0000 7f372c2f6700 1 --2- 172.21.15.81:0/267789609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3724157ca0 0x7f37240cf4f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:48.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.644+0000 7f372c2f6700 1 -- 172.21.15.81:0/267789609 >> 172.21.15.81:0/267789609 conn(0x7f372406bb90 msgr2=0x7f372406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:48.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.644+0000 7f372c2f6700 1 -- 172.21.15.81:0/267789609 shutdown_connections 2023-10-07T08:49:48.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.644+0000 7f372c2f6700 1 -- 172.21.15.81:0/267789609 wait complete. 2023-10-07T08:49:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.645+0000 7f372c2f6700 1 Processor -- start 2023-10-07T08:49:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.645+0000 7f372c2f6700 1 -- start start 2023-10-07T08:49:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.645+0000 7f372c2f6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f372406d120 0x7f37240cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.645+0000 7f372c2f6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37241578d0 0x7f372416afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.645+0000 7f372c2f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3724157ca0 0x7f3724154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.645+0000 7f372c2f6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372416a450 con 0x7f3724157ca0 2023-10-07T08:49:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.645+0000 7f372c2f6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240ccbf0 con 0x7f37241578d0 2023-10-07T08:49:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.645+0000 7f372c2f6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37240cced0 con 0x7f372406d120 2023-10-07T08:49:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.646+0000 7f372a893700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3724157ca0 0x7f3724154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.646+0000 7f372a893700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3724157ca0 0x7f3724154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35970/0 (socket says 172.21.15.81:35970) 2023-10-07T08:49:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.646+0000 7f372a893700 1 -- 172.21.15.81:0/2695725570 learned_addr learned my addr 172.21.15.81:0/2695725570 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.646+0000 7f372a092700 1 --2- 172.21.15.81:0/2695725570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f372406d120 0x7f37240cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.646+0000 7f3729891700 1 --2- 172.21.15.81:0/2695725570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37241578d0 0x7f372416afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.646+0000 7f372a893700 1 -- 172.21.15.81:0/2695725570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f372406d120 msgr2=0x7f37240cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.646+0000 7f372a893700 1 --2- 172.21.15.81:0/2695725570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f372406d120 0x7f37240cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.646+0000 7f372a893700 1 -- 172.21.15.81:0/2695725570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37241578d0 msgr2=0x7f372416afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.646+0000 7f372a893700 1 --2- 172.21.15.81:0/2695725570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37241578d0 0x7f372416afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.646+0000 7f372a893700 1 -- 172.21.15.81:0/2695725570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714009420 con 0x7f3724157ca0 2023-10-07T08:49:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.646+0000 7f372a893700 1 --2- 172.21.15.81:0/2695725570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3724157ca0 0x7f3724154eb0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f371c009e90 tx=0x7f371c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.646+0000 7f371a7fc700 1 -- 172.21.15.81:0/2695725570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c00cb70 con 0x7f3724157ca0 2023-10-07T08:49:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.646+0000 7f371a7fc700 1 -- 172.21.15.81:0/2695725570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c00f040 con 0x7f3724157ca0 2023-10-07T08:49:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.646+0000 7f372c2f6700 1 -- 172.21.15.81:0/2695725570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37240cd1b0 con 0x7f3724157ca0 2023-10-07T08:49:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.646+0000 7f371a7fc700 1 -- 172.21.15.81:0/2695725570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c014480 con 0x7f3724157ca0 2023-10-07T08:49:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.646+0000 7f372c2f6700 1 -- 172.21.15.81:0/2695725570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37240cd770 con 0x7f3724157ca0 2023-10-07T08:49:48.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.647+0000 7f372c2f6700 1 -- 172.21.15.81:0/2695725570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3724067ac0 con 0x7f3724157ca0 2023-10-07T08:49:48.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.647+0000 7f371a7fc700 1 -- 172.21.15.81:0/2695725570 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f371c014830 con 0x7f3724157ca0 2023-10-07T08:49:48.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.648+0000 7f371a7fc700 1 --2- 172.21.15.81:0/2695725570 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3708066f30 0x7f37080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:48.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.648+0000 7f371a7fc700 1 -- 172.21.15.81:0/2695725570 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f371c084f60 con 0x7f3724157ca0 2023-10-07T08:49:48.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.648+0000 7f372a092700 1 --2- 172.21.15.81:0/2695725570 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3708066f30 0x7f37080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:48.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.648+0000 7f371a7fc700 1 -- 172.21.15.81:0/2695725570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=146}) v3 -- 0x7f370806ebb0 con 0x7f3724157ca0 2023-10-07T08:49:48.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.648+0000 7f372a092700 1 --2- 172.21.15.81:0/2695725570 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3708066f30 0x7f37080693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3720004fc0 tx=0x7f3720007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:48.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.652+0000 7f371a7fc700 1 -- 172.21.15.81:0/2695725570 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f371c052140 con 0x7f3724157ca0 2023-10-07T08:49:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:48.835+0000 7f372c2f6700 1 -- 172.21.15.81:0/2695725570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f37240d0170 con 0x7f3724157ca0 2023-10-07T08:49:49.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.586+0000 7f371a7fc700 1 -- 172.21.15.81:0/2695725570 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(146..146 src has 1..146) v4 ==== 288+0+0 (secure 0 0 0) 0x7f371c056500 con 0x7f3724157ca0 2023-10-07T08:49:49.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.586+0000 7f371a7fc700 1 -- 172.21.15.81:0/2695725570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=147}) v3 -- 0x7f370806cfe0 con 0x7f3724157ca0 2023-10-07T08:49:49.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.588+0000 7f371a7fc700 1 -- 172.21.15.81:0/2695725570 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v146) v1 ==== 181+0+0 (secure 0 0 0) 0x7f371c018030 con 0x7f3724157ca0 2023-10-07T08:49:49.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.595+0000 7f372c2f6700 1 -- 172.21.15.81:0/2695725570 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3708066f30 msgr2=0x7f37080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:49.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.595+0000 7f372c2f6700 1 --2- 172.21.15.81:0/2695725570 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3708066f30 0x7f37080693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3720004fc0 tx=0x7f3720007eb0 comp rx=0 tx=0).stop 2023-10-07T08:49:49.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.595+0000 7f372c2f6700 1 -- 172.21.15.81:0/2695725570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3724157ca0 msgr2=0x7f3724154eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:49.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.595+0000 7f372c2f6700 1 --2- 172.21.15.81:0/2695725570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3724157ca0 0x7f3724154eb0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f371c009e90 tx=0x7f371c00b040 comp rx=0 tx=0).stop 2023-10-07T08:49:49.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.595+0000 7f372c2f6700 1 -- 172.21.15.81:0/2695725570 shutdown_connections 2023-10-07T08:49:49.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.595+0000 7f372c2f6700 1 --2- 172.21.15.81:0/2695725570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3724157ca0 0x7f3724154eb0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:49.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.595+0000 7f372c2f6700 1 --2- 172.21.15.81:0/2695725570 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3708066f30 0x7f37080693e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:49.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.595+0000 7f372c2f6700 1 --2- 172.21.15.81:0/2695725570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f372406d120 0x7f37240cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:49.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.595+0000 7f372c2f6700 1 --2- 172.21.15.81:0/2695725570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37241578d0 0x7f372416afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:49.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.595+0000 7f372c2f6700 1 -- 172.21.15.81:0/2695725570 >> 172.21.15.81:0/2695725570 conn(0x7f372406bb90 msgr2=0x7f3724069110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:49.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.596+0000 7f372c2f6700 1 -- 172.21.15.81:0/2695725570 shutdown_connections 2023-10-07T08:49:49.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.596+0000 7f372c2f6700 1 -- 172.21.15.81:0/2695725570 wait complete. 2023-10-07T08:49:49.599 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-07T08:49:49.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T08:49:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.729+0000 7f473719e700 1 Processor -- start 2023-10-07T08:49:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.729+0000 7f473719e700 1 -- start start 2023-10-07T08:49:49.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.730+0000 7f473719e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47300d0b80 0x7f47300cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:49.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.730+0000 7f473719e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473006d700 0x7f473015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:49.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.730+0000 7f473719e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47300cf2d0 con 0x7f47300d02b0 2023-10-07T08:49:49.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.730+0000 7f473719e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473015a690 con 0x7f47300d0b80 2023-10-07T08:49:49.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.730+0000 7f473719e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473006dc00 con 0x7f473006d700 2023-10-07T08:49:49.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.730+0000 7f473619c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47300d0b80 0x7f47300cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:49.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.730+0000 7f473599b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f47300d02b0 0x7f473006cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42054/0 (socket says 172.21.15.81:42054) 2023-10-07T08:49:49.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.730+0000 7f473599b700 1 -- 172.21.15.81:0/4104328414 learned_addr learned my addr 172.21.15.81:0/4104328414 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:49.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.731+0000 7f473699d700 1 --2- 172.21.15.81:0/4104328414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473006d700 0x7f473015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:49.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.731+0000 7f473619c700 1 -- 172.21.15.81:0/4104328414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473006d700 msgr2=0x7f473015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.731+0000 7f473619c700 1 --2- 172.21.15.81:0/4104328414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473006d700 0x7f473015b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.731+0000 7f473519a700 1 -- 172.21.15.81:0/4104328414 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912758083 0 0) 0x7f47300cf2d0 con 0x7f47300d02b0 2023-10-07T08:49:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.731+0000 7f473619c700 1 -- 172.21.15.81:0/4104328414 >> v1:172.21.15.81:6789/0 conn(0x7f47300d02b0 legacy=0x7f473006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.731+0000 7f473619c700 1 -- 172.21.15.81:0/4104328414 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47300cf570 con 0x7f47300d0b80 2023-10-07T08:49:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.731+0000 7f473619c700 1 --2- 172.21.15.81:0/4104328414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47300d0b80 0x7f47300cfd70 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f472c009e60 tx=0x7f472c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597d8f321e939e7e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.731+0000 7f473519a700 1 -- 172.21.15.81:0/4104328414 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c00e070 con 0x7f47300d0b80 2023-10-07T08:49:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.731+0000 7f473519a700 1 -- 172.21.15.81:0/4104328414 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c00bc30 con 0x7f47300d0b80 2023-10-07T08:49:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.731+0000 7f473519a700 1 -- 172.21.15.81:0/4104328414 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c012430 con 0x7f47300d0b80 2023-10-07T08:49:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.731+0000 7f473719e700 1 -- 172.21.15.81:0/4104328414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47300d0b80 msgr2=0x7f47300cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.731+0000 7f473719e700 1 --2- 172.21.15.81:0/4104328414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47300d0b80 0x7f47300cfd70 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f472c009e60 tx=0x7f472c009780 comp rx=0 tx=0).stop 2023-10-07T08:49:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.732+0000 7f473719e700 1 -- 172.21.15.81:0/4104328414 shutdown_connections 2023-10-07T08:49:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.732+0000 7f473719e700 1 --2- 172.21.15.81:0/4104328414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47300d0b80 0x7f47300cfd70 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.732+0000 7f473719e700 1 --2- 172.21.15.81:0/4104328414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473006d700 0x7f473015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.732+0000 7f473719e700 1 -- 172.21.15.81:0/4104328414 >> 172.21.15.81:0/4104328414 conn(0x7f4730063230 msgr2=0x7f4730063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.732+0000 7f473719e700 1 -- 172.21.15.81:0/4104328414 shutdown_connections 2023-10-07T08:49:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.732+0000 7f473719e700 1 -- 172.21.15.81:0/4104328414 wait complete. 2023-10-07T08:49:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.733+0000 7f473719e700 1 Processor -- start 2023-10-07T08:49:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.733+0000 7f473719e700 1 -- start start 2023-10-07T08:49:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.733+0000 7f473719e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f473006d700 0x7f4730146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.733+0000 7f473719e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47300d02b0 0x7f47300c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.733+0000 7f473719e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47300d0b80 0x7f47300cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.733+0000 7f473719e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47300ca4d0 con 0x7f473006d700 2023-10-07T08:49:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.733+0000 7f473719e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47300c98c0 con 0x7f47300d02b0 2023-10-07T08:49:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.733+0000 7f473719e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47300c9ba0 con 0x7f47300d0b80 2023-10-07T08:49:49.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.733+0000 7f473619c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f473006d700 0x7f4730146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:49.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.733+0000 7f473619c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f473006d700 0x7f4730146550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35990/0 (socket says 172.21.15.81:35990) 2023-10-07T08:49:49.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.733+0000 7f473619c700 1 -- 172.21.15.81:0/3360843197 learned_addr learned my addr 172.21.15.81:0/3360843197 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:49.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.734+0000 7f473619c700 1 -- 172.21.15.81:0/3360843197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47300d0b80 msgr2=0x7f47300cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:49.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.734+0000 7f473619c700 1 --2- 172.21.15.81:0/3360843197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47300d0b80 0x7f47300cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:49.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.734+0000 7f473619c700 1 -- 172.21.15.81:0/3360843197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47300d02b0 msgr2=0x7f47300c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:49.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.734+0000 7f473619c700 1 --2- 172.21.15.81:0/3360843197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47300d02b0 0x7f47300c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:49.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.734+0000 7f473619c700 1 -- 172.21.15.81:0/3360843197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c009a20 con 0x7f473006d700 2023-10-07T08:49:49.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.734+0000 7f473619c700 1 --2- 172.21.15.81:0/3360843197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f473006d700 0x7f4730146550 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f472c013000 tx=0x7f472c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:49.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.734+0000 7f47267fc700 1 -- 172.21.15.81:0/3360843197 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c027470 con 0x7f473006d700 2023-10-07T08:49:49.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.734+0000 7f47267fc700 1 -- 172.21.15.81:0/3360843197 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c0275d0 con 0x7f473006d700 2023-10-07T08:49:49.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.734+0000 7f473719e700 1 -- 172.21.15.81:0/3360843197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47300c9e80 con 0x7f473006d700 2023-10-07T08:49:49.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.734+0000 7f47267fc700 1 -- 172.21.15.81:0/3360843197 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c027990 con 0x7f473006d700 2023-10-07T08:49:49.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.734+0000 7f473719e700 1 -- 172.21.15.81:0/3360843197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4730146a90 con 0x7f473006d700 2023-10-07T08:49:49.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.735+0000 7f473719e700 1 -- 172.21.15.81:0/3360843197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47300676e0 con 0x7f473006d700 2023-10-07T08:49:49.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.735+0000 7f47267fc700 1 -- 172.21.15.81:0/3360843197 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f472c024070 con 0x7f473006d700 2023-10-07T08:49:49.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.736+0000 7f47267fc700 1 --2- 172.21.15.81:0/3360843197 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4714066f30 0x7f47140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:49.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.736+0000 7f47267fc700 1 -- 172.21.15.81:0/3360843197 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f472c086c90 con 0x7f473006d700 2023-10-07T08:49:49.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.736+0000 7f473599b700 1 --2- 172.21.15.81:0/3360843197 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4714066f30 0x7f47140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:49.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.736+0000 7f47267fc700 1 -- 172.21.15.81:0/3360843197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=147}) v3 -- 0x7f471406ddb0 con 0x7f473006d700 2023-10-07T08:49:49.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.736+0000 7f473599b700 1 --2- 172.21.15.81:0/3360843197 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4714066f30 0x7f47140693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f47200011e0 tx=0x7f47200079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:49.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.740+0000 7f47267fc700 1 -- 172.21.15.81:0/3360843197 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f472c054020 con 0x7f473006d700 2023-10-07T08:49:49.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:49.925+0000 7f473719e700 1 -- 172.21.15.81:0/3360843197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f47300cf850 con 0x7f473006d700 2023-10-07T08:49:50.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.589+0000 7f47267fc700 1 -- 172.21.15.81:0/3360843197 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(147..147 src has 1..147) v4 ==== 322+0+0 (secure 0 0 0) 0x7f472c0583e0 con 0x7f473006d700 2023-10-07T08:49:50.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.589+0000 7f47267fc700 1 -- 172.21.15.81:0/3360843197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7f471406cb40 con 0x7f473006d700 2023-10-07T08:49:50.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.594+0000 7f47267fc700 1 -- 172.21.15.81:0/3360843197 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v147) v1 ==== 169+0+0 (secure 0 0 0) 0x7f472c057640 con 0x7f473006d700 2023-10-07T08:49:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.600+0000 7f473719e700 1 -- 172.21.15.81:0/3360843197 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4714066f30 msgr2=0x7f47140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.600+0000 7f473719e700 1 --2- 172.21.15.81:0/3360843197 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4714066f30 0x7f47140693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f47200011e0 tx=0x7f47200079d0 comp rx=0 tx=0).stop 2023-10-07T08:49:50.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.600+0000 7f473719e700 1 -- 172.21.15.81:0/3360843197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f473006d700 msgr2=0x7f4730146550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:50.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.600+0000 7f473719e700 1 --2- 172.21.15.81:0/3360843197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f473006d700 0x7f4730146550 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f472c013000 tx=0x7f472c019000 comp rx=0 tx=0).stop 2023-10-07T08:49:50.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.600+0000 7f473719e700 1 -- 172.21.15.81:0/3360843197 shutdown_connections 2023-10-07T08:49:50.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.600+0000 7f473719e700 1 --2- 172.21.15.81:0/3360843197 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4714066f30 0x7f47140693e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:50.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.600+0000 7f473719e700 1 --2- 172.21.15.81:0/3360843197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47300d0b80 0x7f47300cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:50.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.600+0000 7f473719e700 1 --2- 172.21.15.81:0/3360843197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f473006d700 0x7f4730146550 secure :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f472c013000 tx=0x7f472c019000 comp rx=0 tx=0).stop 2023-10-07T08:49:50.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.600+0000 7f473719e700 1 --2- 172.21.15.81:0/3360843197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47300d02b0 0x7f47300c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:50.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.600+0000 7f473719e700 1 -- 172.21.15.81:0/3360843197 >> 172.21.15.81:0/3360843197 conn(0x7f4730063230 msgr2=0x7f4730157900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.601+0000 7f473719e700 1 -- 172.21.15.81:0/3360843197 shutdown_connections 2023-10-07T08:49:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.601+0000 7f473719e700 1 -- 172.21.15.81:0/3360843197 wait complete. 2023-10-07T08:49:50.607 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-07T08:49:50.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T08:49:50.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.735+0000 7ff066e57700 1 Processor -- start 2023-10-07T08:49:50.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.735+0000 7ff066e57700 1 -- start start 2023-10-07T08:49:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.736+0000 7ff066e57700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0601578d0 0x7ff0600cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.736+0000 7ff066e57700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0600d07c0 con 0x7ff06006d120 2023-10-07T08:49:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.736+0000 7ff066e57700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0600cfbb0 con 0x7ff060157ca0 2023-10-07T08:49:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.736+0000 7ff066e57700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0600cfe90 con 0x7ff0601578d0 2023-10-07T08:49:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.736+0000 7ff0653f4700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff06006d120 0x7ff06006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42066/0 (socket says 172.21.15.81:42066) 2023-10-07T08:49:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.736+0000 7ff0653f4700 1 -- 172.21.15.81:0/3020153442 learned_addr learned my addr 172.21.15.81:0/3020153442 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.736+0000 7ff05f7fe700 1 -- 172.21.15.81:0/3020153442 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794516346 0 0) 0x7ff0600d07c0 con 0x7ff06006d120 2023-10-07T08:49:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.736+0000 7ff05f7fe700 1 -- 172.21.15.81:0/3020153442 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff048003570 con 0x7ff06006d120 2023-10-07T08:49:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.736+0000 7ff064bf3700 1 --2- 172.21.15.81:0/3020153442 >> v2:172.21.15.89:3300/0 conn(0x7ff0601578d0 0x7ff0600cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05f7fe700 1 -- 172.21.15.81:0/3020153442 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2247163775 0 0) 0x7ff048003570 con 0x7ff06006d120 2023-10-07T08:49:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05f7fe700 1 -- 172.21.15.81:0/3020153442 >> v2:172.21.15.89:3300/0 conn(0x7ff0601578d0 msgr2=0x7ff0600cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05f7fe700 1 --2- 172.21.15.81:0/3020153442 >> v2:172.21.15.89:3300/0 conn(0x7ff0601578d0 0x7ff0600cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05f7fe700 1 -- 172.21.15.81:0/3020153442 >> v1:172.21.15.89:6789/0 conn(0x7ff060157ca0 legacy=0x7ff06015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05f7fe700 1 -- 172.21.15.81:0/3020153442 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0600d0170 con 0x7ff06006d120 2023-10-07T08:49:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05f7fe700 1 -- 172.21.15.81:0/3020153442 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7ff058001470 con 0x7ff06006d120 2023-10-07T08:49:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05f7fe700 1 -- 172.21.15.81:0/3020153442 >> v1:172.21.15.81:6789/0 conn(0x7ff06006d120 legacy=0x7ff06006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05f7fe700 1 --2- 172.21.15.81:0/3020153442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff048003a60 0x7ff048003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05f7fe700 1 --2- 172.21.15.81:0/3020153442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff048004810 0x7ff048004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05f7fe700 1 --2- 172.21.15.81:0/3020153442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0480051c0 0x7ff04800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05f7fe700 1 -- 172.21.15.81:0/3020153442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0600cfe90 con 0x7ff0480051c0 2023-10-07T08:49:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05f7fe700 1 -- 172.21.15.81:0/3020153442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04800c0d0 con 0x7ff048004810 2023-10-07T08:49:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05f7fe700 1 -- 172.21.15.81:0/3020153442 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04800c290 con 0x7ff048003a60 2023-10-07T08:49:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff0653f4700 1 --2- 172.21.15.81:0/3020153442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0480051c0 0x7ff04800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05ffff700 1 --2- 172.21.15.81:0/3020153442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff048004810 0x7ff048004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff064bf3700 1 --2- 172.21.15.81:0/3020153442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff048003a60 0x7ff048003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff0653f4700 1 -- 172.21.15.81:0/3020153442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff048003a60 msgr2=0x7ff048003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff0653f4700 1 --2- 172.21.15.81:0/3020153442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff048003a60 0x7ff048003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff0653f4700 1 -- 172.21.15.81:0/3020153442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff048004810 msgr2=0x7ff048004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff0653f4700 1 --2- 172.21.15.81:0/3020153442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff048004810 0x7ff048004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff0653f4700 1 -- 172.21.15.81:0/3020153442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff048003570 con 0x7ff0480051c0 2023-10-07T08:49:50.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff0653f4700 1 -- 172.21.15.81:0/3020153442 reap_dead start 2023-10-07T08:49:50.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff0653f4700 1 --2- 172.21.15.81:0/3020153442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0480051c0 0x7ff04800ba60 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff05800c3c0 tx=0x7ff058001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516899fe8f0b192b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:50.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05f7fe700 1 -- 172.21.15.81:0/3020153442 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800cc90 con 0x7ff0480051c0 2023-10-07T08:49:50.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05f7fe700 1 -- 172.21.15.81:0/3020153442 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05800cdf0 con 0x7ff0480051c0 2023-10-07T08:49:50.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.737+0000 7ff05f7fe700 1 -- 172.21.15.81:0/3020153442 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058005b50 con 0x7ff0480051c0 2023-10-07T08:49:50.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.738+0000 7ff066e57700 1 -- 172.21.15.81:0/3020153442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0480051c0 msgr2=0x7ff04800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:50.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.738+0000 7ff066e57700 1 --2- 172.21.15.81:0/3020153442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0480051c0 0x7ff04800ba60 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff05800c3c0 tx=0x7ff058001e50 comp rx=0 tx=0).stop 2023-10-07T08:49:50.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.738+0000 7ff066e57700 1 -- 172.21.15.81:0/3020153442 shutdown_connections 2023-10-07T08:49:50.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.738+0000 7ff066e57700 1 --2- 172.21.15.81:0/3020153442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0480051c0 0x7ff04800ba60 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:50.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.738+0000 7ff066e57700 1 -- 172.21.15.81:0/3020153442 >> 172.21.15.81:0/3020153442 conn(0x7ff06006bb90 msgr2=0x7ff06006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:50.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.738+0000 7ff066e57700 1 -- 172.21.15.81:0/3020153442 shutdown_connections 2023-10-07T08:49:50.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.738+0000 7ff066e57700 1 -- 172.21.15.81:0/3020153442 wait complete. 2023-10-07T08:49:50.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.739+0000 7ff066e57700 1 Processor -- start 2023-10-07T08:49:50.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.739+0000 7ff066e57700 1 -- start start 2023-10-07T08:49:50.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff066e57700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0480051c0 0x7ff06016a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:50.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff066e57700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06014e830 0x7ff06014eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:50.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff066e57700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff060151f80 0x7ff060152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:50.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff066e57700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff060152cd0 con 0x7ff06014e830 2023-10-07T08:49:50.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff066e57700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff060152fb0 con 0x7ff060151f80 2023-10-07T08:49:50.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff066e57700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff060153290 con 0x7ff0480051c0 2023-10-07T08:49:50.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff05ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06014e830 0x7ff06014eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:50.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff05ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06014e830 0x7ff06014eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36016/0 (socket says 172.21.15.81:36016) 2023-10-07T08:49:50.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff05ffff700 1 -- 172.21.15.81:0/663980588 learned_addr learned my addr 172.21.15.81:0/663980588 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:50.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff0653f4700 1 --2- 172.21.15.81:0/663980588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff060151f80 0x7ff060152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:50.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff064bf3700 1 --2- 172.21.15.81:0/663980588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0480051c0 0x7ff06016a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:50.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff05ffff700 1 -- 172.21.15.81:0/663980588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0480051c0 msgr2=0x7ff06016a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:50.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff05ffff700 1 --2- 172.21.15.81:0/663980588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0480051c0 0x7ff06016a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:50.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff05ffff700 1 -- 172.21.15.81:0/663980588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff060151f80 msgr2=0x7ff060152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:50.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff05ffff700 1 --2- 172.21.15.81:0/663980588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff060151f80 0x7ff060152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:50.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff05ffff700 1 -- 172.21.15.81:0/663980588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff060153570 con 0x7ff06014e830 2023-10-07T08:49:50.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff064bf3700 1 --2- 172.21.15.81:0/663980588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0480051c0 0x7ff06016a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:50.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.740+0000 7ff05ffff700 1 --2- 172.21.15.81:0/663980588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06014e830 0x7ff06014eca0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff054007a80 tx=0x7ff054007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:50.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.741+0000 7ff05cff9700 1 -- 172.21.15.81:0/663980588 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05400f690 con 0x7ff06014e830 2023-10-07T08:49:50.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.741+0000 7ff05cff9700 1 -- 172.21.15.81:0/663980588 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05400f7f0 con 0x7ff06014e830 2023-10-07T08:49:50.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.741+0000 7ff066e57700 1 -- 172.21.15.81:0/663980588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff060153850 con 0x7ff06014e830 2023-10-07T08:49:50.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.741+0000 7ff05cff9700 1 -- 172.21.15.81:0/663980588 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05400fb90 con 0x7ff06014e830 2023-10-07T08:49:50.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.741+0000 7ff066e57700 1 -- 172.21.15.81:0/663980588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff060152940 con 0x7ff06014e830 2023-10-07T08:49:50.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.742+0000 7ff066e57700 1 -- 172.21.15.81:0/663980588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff060067ac0 con 0x7ff06014e830 2023-10-07T08:49:50.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.742+0000 7ff05cff9700 1 -- 172.21.15.81:0/663980588 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff05401c400 con 0x7ff06014e830 2023-10-07T08:49:50.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.742+0000 7ff05cff9700 1 --2- 172.21.15.81:0/663980588 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff04c066f30 0x7ff04c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:50.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.742+0000 7ff05cff9700 1 -- 172.21.15.81:0/663980588 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff0540842d0 con 0x7ff06014e830 2023-10-07T08:49:50.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.742+0000 7ff064bf3700 1 --2- 172.21.15.81:0/663980588 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff04c066f30 0x7ff04c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:50.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.743+0000 7ff064bf3700 1 --2- 172.21.15.81:0/663980588 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff04c066f30 0x7ff04c0693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff0500094a0 tx=0x7ff05000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:50.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.746+0000 7ff05cff9700 1 -- 172.21.15.81:0/663980588 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff054051840 con 0x7ff06014e830 2023-10-07T08:49:50.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.931+0000 7ff066e57700 1 -- 172.21.15.81:0/663980588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff0600d0450 con 0x7ff06014e830 2023-10-07T08:49:50.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.934+0000 7ff05cff9700 1 -- 172.21.15.81:0/663980588 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff054054e60 con 0x7ff06014e830 2023-10-07T08:49:50.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.936+0000 7ff066e57700 1 -- 172.21.15.81:0/663980588 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff04c066f30 msgr2=0x7ff04c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:50.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.936+0000 7ff066e57700 1 --2- 172.21.15.81:0/663980588 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff04c066f30 0x7ff04c0693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff0500094a0 tx=0x7ff05000b040 comp rx=0 tx=0).stop 2023-10-07T08:49:50.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.936+0000 7ff066e57700 1 -- 172.21.15.81:0/663980588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06014e830 msgr2=0x7ff06014eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:50.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.936+0000 7ff066e57700 1 --2- 172.21.15.81:0/663980588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06014e830 0x7ff06014eca0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff054007a80 tx=0x7ff054007d30 comp rx=0 tx=0).stop 2023-10-07T08:49:50.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.936+0000 7ff066e57700 1 -- 172.21.15.81:0/663980588 shutdown_connections 2023-10-07T08:49:50.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.936+0000 7ff066e57700 1 --2- 172.21.15.81:0/663980588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff060151f80 0x7ff060152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:50.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.936+0000 7ff066e57700 1 --2- 172.21.15.81:0/663980588 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff04c066f30 0x7ff04c0693e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:50.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.936+0000 7ff066e57700 1 --2- 172.21.15.81:0/663980588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0480051c0 0x7ff06016a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:50.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.936+0000 7ff066e57700 1 --2- 172.21.15.81:0/663980588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06014e830 0x7ff06014eca0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:50.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.937+0000 7ff066e57700 1 -- 172.21.15.81:0/663980588 >> 172.21.15.81:0/663980588 conn(0x7ff06006bb90 msgr2=0x7ff06015a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:50.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.937+0000 7ff066e57700 1 -- 172.21.15.81:0/663980588 shutdown_connections 2023-10-07T08:49:50.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:50.937+0000 7ff066e57700 1 -- 172.21.15.81:0/663980588 wait complete. 2023-10-07T08:49:50.950 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-10-07T08:49:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.064+0000 7fed52cec700 1 Processor -- start 2023-10-07T08:49:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.064+0000 7fed52cec700 1 -- start start 2023-10-07T08:49:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.064+0000 7fed52cec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed4c15a2a0 0x7fed4c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.064+0000 7fed52cec700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fed4c06dd60 0x7fed4c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.064+0000 7fed52cec700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c0cf4e0 con 0x7fed4c0ceb30 2023-10-07T08:49:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.064+0000 7fed52cec700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c06ea90 con 0x7fed4c06dd60 2023-10-07T08:49:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.064+0000 7fed52cec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0b0ca0 con 0x7fed4c15a2a0 2023-10-07T08:49:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.064+0000 7fed4bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fed4c0ceb30 0x7fed4c06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42082/0 (socket says 172.21.15.81:42082) 2023-10-07T08:49:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.064+0000 7fed4bfff700 1 -- 172.21.15.81:0/1965647064 learned_addr learned my addr 172.21.15.81:0/1965647064 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed51289700 1 --2- 172.21.15.81:0/1965647064 >> v2:172.21.15.89:3300/0 conn(0x7fed4c06dd60 0x7fed4c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4b7fe700 1 -- 172.21.15.81:0/1965647064 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499279044 0 0) 0x7fed4c0cf4e0 con 0x7fed4c0ceb30 2023-10-07T08:49:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed50a88700 1 --2- 172.21.15.81:0/1965647064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed4c15a2a0 0x7fed4c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4b7fe700 1 -- 172.21.15.81:0/1965647064 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed38003570 con 0x7fed4c0ceb30 2023-10-07T08:49:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4b7fe700 1 -- 172.21.15.81:0/1965647064 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2136644333 0 0) 0x7fed38003570 con 0x7fed4c0ceb30 2023-10-07T08:49:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4b7fe700 1 -- 172.21.15.81:0/1965647064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed4c15a2a0 msgr2=0x7fed4c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4b7fe700 1 --2- 172.21.15.81:0/1965647064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed4c15a2a0 0x7fed4c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4b7fe700 1 -- 172.21.15.81:0/1965647064 >> v2:172.21.15.89:3300/0 conn(0x7fed4c06dd60 msgr2=0x7fed4c0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4b7fe700 1 --2- 172.21.15.81:0/1965647064 >> v2:172.21.15.89:3300/0 conn(0x7fed4c06dd60 0x7fed4c0cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4b7fe700 1 -- 172.21.15.81:0/1965647064 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c0b00d0 con 0x7fed4c0ceb30 2023-10-07T08:49:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4b7fe700 1 -- 172.21.15.81:0/1965647064 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fed34001470 con 0x7fed4c0ceb30 2023-10-07T08:49:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4b7fe700 1 -- 172.21.15.81:0/1965647064 >> v1:172.21.15.81:6789/0 conn(0x7fed4c0ceb30 legacy=0x7fed4c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4b7fe700 1 --2- 172.21.15.81:0/1965647064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed38003a60 0x7fed38003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4b7fe700 1 --2- 172.21.15.81:0/1965647064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed4c15a2a0 0x7fed38004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4b7fe700 1 --2- 172.21.15.81:0/1965647064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed38004d50 0x7fed380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4b7fe700 1 -- 172.21.15.81:0/1965647064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c06ea90 con 0x7fed38003a60 2023-10-07T08:49:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4b7fe700 1 -- 172.21.15.81:0/1965647064 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0b0ca0 con 0x7fed38004d50 2023-10-07T08:49:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4b7fe700 1 -- 172.21.15.81:0/1965647064 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3800bae0 con 0x7fed4c15a2a0 2023-10-07T08:49:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed50a88700 1 --2- 172.21.15.81:0/1965647064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed38003a60 0x7fed38003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4bfff700 1 --2- 172.21.15.81:0/1965647064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed4c15a2a0 0x7fed38004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed51289700 1 --2- 172.21.15.81:0/1965647064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed38004d50 0x7fed380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed50a88700 1 -- 172.21.15.81:0/1965647064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed4c15a2a0 msgr2=0x7fed38004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed50a88700 1 --2- 172.21.15.81:0/1965647064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed4c15a2a0 0x7fed38004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed50a88700 1 -- 172.21.15.81:0/1965647064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed38004d50 msgr2=0x7fed380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed50a88700 1 --2- 172.21.15.81:0/1965647064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed38004d50 0x7fed380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed50a88700 1 -- 172.21.15.81:0/1965647064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed38003570 con 0x7fed38003a60 2023-10-07T08:49:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.065+0000 7fed4bfff700 1 --2- 172.21.15.81:0/1965647064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed4c15a2a0 0x7fed38004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.066+0000 7fed50a88700 1 --2- 172.21.15.81:0/1965647064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed38003a60 0x7fed38003e70 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fed3c007440 tx=0x7fed3c009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ef7a6fa4e119dd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.066+0000 7fed4b7fe700 1 -- 172.21.15.81:0/1965647064 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c009a40 con 0x7fed38003a60 2023-10-07T08:49:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.066+0000 7fed4b7fe700 1 -- 172.21.15.81:0/1965647064 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c007cf0 con 0x7fed38003a60 2023-10-07T08:49:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.066+0000 7fed4b7fe700 1 -- 172.21.15.81:0/1965647064 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c014630 con 0x7fed38003a60 2023-10-07T08:49:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.066+0000 7fed52cec700 1 -- 172.21.15.81:0/1965647064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed38003a60 msgr2=0x7fed38003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.066+0000 7fed52cec700 1 --2- 172.21.15.81:0/1965647064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed38003a60 0x7fed38003e70 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fed3c007440 tx=0x7fed3c009710 comp rx=0 tx=0).stop 2023-10-07T08:49:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.066+0000 7fed51289700 1 -- 172.21.15.81:0/1965647064 reap_dead start 2023-10-07T08:49:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.066+0000 7fed52cec700 1 -- 172.21.15.81:0/1965647064 shutdown_connections 2023-10-07T08:49:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.066+0000 7fed52cec700 1 -- 172.21.15.81:0/1965647064 >> 172.21.15.81:0/1965647064 conn(0x7fed4c067640 msgr2=0x7fed4c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:51.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.066+0000 7fed52cec700 1 -- 172.21.15.81:0/1965647064 shutdown_connections 2023-10-07T08:49:51.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.066+0000 7fed52cec700 1 -- 172.21.15.81:0/1965647064 wait complete. 2023-10-07T08:49:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.067+0000 7fed52cec700 1 Processor -- start 2023-10-07T08:49:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.067+0000 7fed52cec700 1 -- start start 2023-10-07T08:49:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.068+0000 7fed52cec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed38003a60 0x7fed4c1477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.068+0000 7fed52cec700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed4c156790 0x7fed4c156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.068+0000 7fed52cec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c0b19b0 0x7fed4c0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.068+0000 7fed52cec700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0c7e60 con 0x7fed4c0b19b0 2023-10-07T08:49:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.068+0000 7fed52cec700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c157140 con 0x7fed4c156790 2023-10-07T08:49:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.068+0000 7fed52cec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0b2720 con 0x7fed38003a60 2023-10-07T08:49:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.068+0000 7fed51289700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c0b19b0 0x7fed4c0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.068+0000 7fed51289700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c0b19b0 0x7fed4c0b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36026/0 (socket says 172.21.15.81:36026) 2023-10-07T08:49:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.068+0000 7fed51289700 1 -- 172.21.15.81:0/3445058673 learned_addr learned my addr 172.21.15.81:0/3445058673 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.068+0000 7fed50a88700 1 --2- 172.21.15.81:0/3445058673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed38003a60 0x7fed4c1477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.068+0000 7fed4bfff700 1 --2- 172.21.15.81:0/3445058673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed4c156790 0x7fed4c156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.069+0000 7fed51289700 1 -- 172.21.15.81:0/3445058673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed38003a60 msgr2=0x7fed4c1477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.069+0000 7fed51289700 1 --2- 172.21.15.81:0/3445058673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed38003a60 0x7fed4c1477d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:51.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.069+0000 7fed51289700 1 -- 172.21.15.81:0/3445058673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed4c156790 msgr2=0x7fed4c156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:51.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.069+0000 7fed51289700 1 --2- 172.21.15.81:0/3445058673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed4c156790 0x7fed4c156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:51.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.069+0000 7fed51289700 1 -- 172.21.15.81:0/3445058673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c0b2a00 con 0x7fed4c0b19b0 2023-10-07T08:49:51.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.069+0000 7fed50a88700 1 --2- 172.21.15.81:0/3445058673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed38003a60 0x7fed4c1477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:51.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.069+0000 7fed4bfff700 1 --2- 172.21.15.81:0/3445058673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed4c156790 0x7fed4c156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:51.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.069+0000 7fed51289700 1 --2- 172.21.15.81:0/3445058673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c0b19b0 0x7fed4c0b1e20 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fed4c06f940 tx=0x7fed44008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:51.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.069+0000 7fed48ff9700 1 -- 172.21.15.81:0/3445058673 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44015670 con 0x7fed4c0b19b0 2023-10-07T08:49:51.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.069+0000 7fed48ff9700 1 -- 172.21.15.81:0/3445058673 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed440157d0 con 0x7fed4c0b19b0 2023-10-07T08:49:51.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.069+0000 7fed52cec700 1 -- 172.21.15.81:0/3445058673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c0b2ce0 con 0x7fed4c0b19b0 2023-10-07T08:49:51.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.069+0000 7fed48ff9700 1 -- 172.21.15.81:0/3445058673 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44015b90 con 0x7fed4c0b19b0 2023-10-07T08:49:51.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.069+0000 7fed52cec700 1 -- 172.21.15.81:0/3445058673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c0b32a0 con 0x7fed4c0b19b0 2023-10-07T08:49:51.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.070+0000 7fed52cec700 1 -- 172.21.15.81:0/3445058673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c0b34c0 con 0x7fed4c0b19b0 2023-10-07T08:49:51.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.070+0000 7fed48ff9700 1 -- 172.21.15.81:0/3445058673 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed4401f410 con 0x7fed4c0b19b0 2023-10-07T08:49:51.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.071+0000 7fed48ff9700 1 --2- 172.21.15.81:0/3445058673 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed2c066f30 0x7fed2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:51.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.071+0000 7fed48ff9700 1 -- 172.21.15.81:0/3445058673 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fed44083f70 con 0x7fed4c0b19b0 2023-10-07T08:49:51.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.071+0000 7fed50a88700 1 --2- 172.21.15.81:0/3445058673 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed2c066f30 0x7fed2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:51.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.071+0000 7fed50a88700 1 --2- 172.21.15.81:0/3445058673 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed2c066f30 0x7fed2c0693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fed3c007440 tx=0x7fed3c018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:51.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.075+0000 7fed48ff9700 1 -- 172.21.15.81:0/3445058673 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed440514e0 con 0x7fed4c0b19b0 2023-10-07T08:49:51.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.332+0000 7fed52cec700 1 -- 172.21.15.81:0/3445058673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7fed4c04bb80 con 0x7fed4c0b19b0 2023-10-07T08:49:51.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.592+0000 7fed48ff9700 1 -- 172.21.15.81:0/3445058673 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v359) v1 ==== 140+0+0 (secure 0 0 0) 0x7fed44054b00 con 0x7fed4c0b19b0 2023-10-07T08:49:51.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.595+0000 7fed52cec700 1 -- 172.21.15.81:0/3445058673 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed2c066f30 msgr2=0x7fed2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:51.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.595+0000 7fed52cec700 1 --2- 172.21.15.81:0/3445058673 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed2c066f30 0x7fed2c0693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fed3c007440 tx=0x7fed3c018000 comp rx=0 tx=0).stop 2023-10-07T08:49:51.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.595+0000 7fed52cec700 1 -- 172.21.15.81:0/3445058673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c0b19b0 msgr2=0x7fed4c0b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.595+0000 7fed52cec700 1 --2- 172.21.15.81:0/3445058673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c0b19b0 0x7fed4c0b1e20 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fed4c06f940 tx=0x7fed44008040 comp rx=0 tx=0).stop 2023-10-07T08:49:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.595+0000 7fed52cec700 1 -- 172.21.15.81:0/3445058673 shutdown_connections 2023-10-07T08:49:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.595+0000 7fed52cec700 1 --2- 172.21.15.81:0/3445058673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4c0b19b0 0x7fed4c0b1e20 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.595+0000 7fed52cec700 1 --2- 172.21.15.81:0/3445058673 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed2c066f30 0x7fed2c0693e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.595+0000 7fed52cec700 1 --2- 172.21.15.81:0/3445058673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed38003a60 0x7fed4c1477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.595+0000 7fed52cec700 1 --2- 172.21.15.81:0/3445058673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed4c156790 0x7fed4c156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.595+0000 7fed52cec700 1 -- 172.21.15.81:0/3445058673 >> 172.21.15.81:0/3445058673 conn(0x7fed4c067640 msgr2=0x7fed4c15d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.595+0000 7fed52cec700 1 -- 172.21.15.81:0/3445058673 shutdown_connections 2023-10-07T08:49:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.595+0000 7fed52cec700 1 -- 172.21.15.81:0/3445058673 wait complete. 2023-10-07T08:49:51.608 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-07T08:49:51.609 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-10-07T08:49:51.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-10-07T08:49:51.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.723+0000 7f64556fe700 1 Processor -- start 2023-10-07T08:49:51.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.723+0000 7f64556fe700 1 -- start start 2023-10-07T08:49:51.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.724+0000 7f64556fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f645013ffe0 0x7f64500c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:51.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.724+0000 7f64556fe700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64500698b0 con 0x7f645006ccb0 2023-10-07T08:49:51.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.724+0000 7f64556fe700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64500692a0 con 0x7f645013fc10 2023-10-07T08:49:51.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.724+0000 7f64556fe700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645006d180 con 0x7f645013ffe0 2023-10-07T08:49:51.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.724+0000 7f644e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f645013ffe0 0x7f64500c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:51.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.724+0000 7f644f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f645006ccb0 0x7f6450069d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42084/0 (socket says 172.21.15.81:42084) 2023-10-07T08:49:51.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.724+0000 7f644f7fe700 1 -- 172.21.15.81:0/1512832966 learned_addr learned my addr 172.21.15.81:0/1512832966 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:51.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.724+0000 7f644e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f645013ffe0 0x7f64500c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36042/0 (socket says 172.21.15.81:36042) 2023-10-07T08:49:51.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.725+0000 7f644e7fc700 1 -- 172.21.15.81:0/1512832966 >> v1:172.21.15.89:6789/0 conn(0x7f645013fc10 legacy=0x7f645006c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:51.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.725+0000 7f644e7fc700 1 -- 172.21.15.81:0/1512832966 >> v1:172.21.15.81:6789/0 conn(0x7f645006ccb0 legacy=0x7f6450069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:51.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.725+0000 7f644e7fc700 1 -- 172.21.15.81:0/1512832966 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6450069540 con 0x7f645013ffe0 2023-10-07T08:49:51.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.725+0000 7f644e7fc700 1 --2- 172.21.15.81:0/1512832966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645013ffe0 0x7f64500c7a80 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f643800aa90 tx=0x7f643800a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccda8cd70d64fe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:51.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.725+0000 7f644dffb700 1 -- 172.21.15.81:0/1512832966 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800ca40 con 0x7f645013ffe0 2023-10-07T08:49:51.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.725+0000 7f644dffb700 1 -- 172.21.15.81:0/1512832966 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643800cba0 con 0x7f645013ffe0 2023-10-07T08:49:51.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.725+0000 7f644dffb700 1 -- 172.21.15.81:0/1512832966 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6438018400 con 0x7f645013ffe0 2023-10-07T08:49:51.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.726+0000 7f64556fe700 1 -- 172.21.15.81:0/1512832966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645013ffe0 msgr2=0x7f64500c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:51.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.726+0000 7f64556fe700 1 --2- 172.21.15.81:0/1512832966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645013ffe0 0x7f64500c7a80 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f643800aa90 tx=0x7f643800a330 comp rx=0 tx=0).stop 2023-10-07T08:49:51.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.726+0000 7f64556fe700 1 -- 172.21.15.81:0/1512832966 shutdown_connections 2023-10-07T08:49:51.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.726+0000 7f64556fe700 1 --2- 172.21.15.81:0/1512832966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645013ffe0 0x7f64500c7a80 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:51.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.726+0000 7f64556fe700 1 -- 172.21.15.81:0/1512832966 >> 172.21.15.81:0/1512832966 conn(0x7f64500c9ca0 msgr2=0x7f64500ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.726+0000 7f64556fe700 1 -- 172.21.15.81:0/1512832966 shutdown_connections 2023-10-07T08:49:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.726+0000 7f64556fe700 1 -- 172.21.15.81:0/1512832966 wait complete. 2023-10-07T08:49:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.727+0000 7f64556fe700 1 Processor -- start 2023-10-07T08:49:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.727+0000 7f64556fe700 1 -- start start 2023-10-07T08:49:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f64556fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f645006ccb0 0x7f6450157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f64556fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645013fc10 0x7f6450158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:51.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f64556fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f645013ffe0 0x7f64500c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:51.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f64556fe700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6450158210 con 0x7f645013fc10 2023-10-07T08:49:51.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f64556fe700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6450157840 con 0x7f645013ffe0 2023-10-07T08:49:51.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f64556fe700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6450156c30 con 0x7f645006ccb0 2023-10-07T08:49:51.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f644e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645013fc10 0x7f6450158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:51.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f644e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645013fc10 0x7f6450158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36052/0 (socket says 172.21.15.81:36052) 2023-10-07T08:49:51.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f644e7fc700 1 -- 172.21.15.81:0/2985086464 learned_addr learned my addr 172.21.15.81:0/2985086464 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:51.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f644effd700 1 --2- 172.21.15.81:0/2985086464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f645006ccb0 0x7f6450157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f644f7fe700 1 --2- 172.21.15.81:0/2985086464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f645013ffe0 0x7f64500c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f644e7fc700 1 -- 172.21.15.81:0/2985086464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f645006ccb0 msgr2=0x7f6450157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f644e7fc700 1 --2- 172.21.15.81:0/2985086464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f645006ccb0 0x7f6450157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f644e7fc700 1 -- 172.21.15.81:0/2985086464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f645013ffe0 msgr2=0x7f64500c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f644e7fc700 1 --2- 172.21.15.81:0/2985086464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f645013ffe0 0x7f64500c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f644e7fc700 1 -- 172.21.15.81:0/2985086464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643800a5d0 con 0x7f645013fc10 2023-10-07T08:49:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f644effd700 1 --2- 172.21.15.81:0/2985086464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f645006ccb0 0x7f6450157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f644f7fe700 1 --2- 172.21.15.81:0/2985086464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f645013ffe0 0x7f64500c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f644e7fc700 1 --2- 172.21.15.81:0/2985086464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645013fc10 0x7f6450158d10 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f6438014000 tx=0x7f643801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f6446ffd700 1 -- 172.21.15.81:0/2985086464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64380106d0 con 0x7f645013fc10 2023-10-07T08:49:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f6446ffd700 1 -- 172.21.15.81:0/2985086464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6438010830 con 0x7f645013fc10 2023-10-07T08:49:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f64556fe700 1 -- 172.21.15.81:0/2985086464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6450156f10 con 0x7f645013fc10 2023-10-07T08:49:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f6446ffd700 1 -- 172.21.15.81:0/2985086464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6438010bf0 con 0x7f645013fc10 2023-10-07T08:49:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.728+0000 7f64556fe700 1 -- 172.21.15.81:0/2985086464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64501574d0 con 0x7f645013fc10 2023-10-07T08:49:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.729+0000 7f64556fe700 1 -- 172.21.15.81:0/2985086464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64501579d0 con 0x7f645013fc10 2023-10-07T08:49:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.730+0000 7f6446ffd700 1 -- 172.21.15.81:0/2985086464 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6438023440 con 0x7f645013fc10 2023-10-07T08:49:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.730+0000 7f6446ffd700 1 --2- 172.21.15.81:0/2985086464 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6430066f30 0x7f64300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.730+0000 7f644effd700 1 --2- 172.21.15.81:0/2985086464 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6430066f30 0x7f64300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.730+0000 7f6446ffd700 1 -- 172.21.15.81:0/2985086464 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6438085ed0 con 0x7f645013fc10 2023-10-07T08:49:51.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.731+0000 7f644effd700 1 --2- 172.21.15.81:0/2985086464 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6430066f30 0x7f64300693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6440007fd0 tx=0x7f6440009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:51.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.734+0000 7f6446ffd700 1 -- 172.21.15.81:0/2985086464 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6438053440 con 0x7f645013fc10 2023-10-07T08:49:51.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:51.990+0000 7f64556fe700 1 -- 172.21.15.81:0/2985086464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f645004bb80 con 0x7f645013fc10 2023-10-07T08:49:52.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.597+0000 7f6446ffd700 1 -- 172.21.15.81:0/2985086464 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v360) v1 ==== 135+0+0 (secure 0 0 0) 0x7f6438056a60 con 0x7f645013fc10 2023-10-07T08:49:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.599+0000 7f64556fe700 1 -- 172.21.15.81:0/2985086464 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6430066f30 msgr2=0x7f64300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.599+0000 7f64556fe700 1 --2- 172.21.15.81:0/2985086464 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6430066f30 0x7f64300693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6440007fd0 tx=0x7f6440009040 comp rx=0 tx=0).stop 2023-10-07T08:49:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.599+0000 7f64556fe700 1 -- 172.21.15.81:0/2985086464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645013fc10 msgr2=0x7f6450158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.599+0000 7f64556fe700 1 --2- 172.21.15.81:0/2985086464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645013fc10 0x7f6450158d10 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f6438014000 tx=0x7f643801a000 comp rx=0 tx=0).stop 2023-10-07T08:49:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.599+0000 7f64556fe700 1 -- 172.21.15.81:0/2985086464 shutdown_connections 2023-10-07T08:49:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.599+0000 7f64556fe700 1 --2- 172.21.15.81:0/2985086464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f645013ffe0 0x7f64500c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.599+0000 7f64556fe700 1 --2- 172.21.15.81:0/2985086464 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6430066f30 0x7f64300693e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.599+0000 7f64556fe700 1 --2- 172.21.15.81:0/2985086464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f645006ccb0 0x7f6450157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:52.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.599+0000 7f64556fe700 1 --2- 172.21.15.81:0/2985086464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645013fc10 0x7f6450158d10 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:52.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.599+0000 7f64556fe700 1 -- 172.21.15.81:0/2985086464 >> 172.21.15.81:0/2985086464 conn(0x7f64500c9ca0 msgr2=0x7f64500ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:52.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.599+0000 7f64556fe700 1 -- 172.21.15.81:0/2985086464 shutdown_connections 2023-10-07T08:49:52.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.599+0000 7f64556fe700 1 -- 172.21.15.81:0/2985086464 wait complete. 2023-10-07T08:49:52.613 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T08:49:52.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.728+0000 7f1cfc699700 1 Processor -- start 2023-10-07T08:49:52.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.728+0000 7f1cfc699700 1 -- start start 2023-10-07T08:49:52.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.729+0000 7f1cfc699700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1cf41578d0 0x7f1cf40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:52.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.729+0000 7f1cfc699700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1cf4157ca0 0x7f1cf415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:52.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.729+0000 7f1cfc699700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf40d07c0 con 0x7f1cf406d120 2023-10-07T08:49:52.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.729+0000 7f1cfc699700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf40cfbb0 con 0x7f1cf41578d0 2023-10-07T08:49:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.729+0000 7f1cfc699700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40cfe90 con 0x7f1cf4157ca0 2023-10-07T08:49:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.729+0000 7f1cfa435700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1cf41578d0 0x7f1cf40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.729+0000 7f1cfac36700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1cf406d120 0x7f1cf415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33300/0 (socket says 172.21.15.81:33300) 2023-10-07T08:49:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.729+0000 7f1cfac36700 1 -- 172.21.15.81:0/1226327464 learned_addr learned my addr 172.21.15.81:0/1226327464 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.730+0000 7f1cf9c34700 1 --2- 172.21.15.81:0/1226327464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1cf4157ca0 0x7f1cf415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.730+0000 7f1cfa435700 1 -- 172.21.15.81:0/1226327464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1cf4157ca0 msgr2=0x7f1cf415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.730+0000 7f1cfa435700 1 --2- 172.21.15.81:0/1226327464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1cf4157ca0 0x7f1cf415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.730+0000 7f1cfa435700 1 -- 172.21.15.81:0/1226327464 >> v1:172.21.15.81:6789/0 conn(0x7f1cf406d120 legacy=0x7f1cf415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.730+0000 7f1cf9433700 1 -- 172.21.15.81:0/1226327464 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183560996 0 0) 0x7f1cf40d07c0 con 0x7f1cf406d120 2023-10-07T08:49:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.730+0000 7f1cfa435700 1 -- 172.21.15.81:0/1226327464 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf40d0170 con 0x7f1cf41578d0 2023-10-07T08:49:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.730+0000 7f1cfa435700 1 --2- 172.21.15.81:0/1226327464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf41578d0 0x7f1cf40cf4f0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0009e60 tx=0x7f1cf0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a88ac581bb377f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.730+0000 7f1cf9433700 1 -- 172.21.15.81:0/1226327464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf000e070 con 0x7f1cf41578d0 2023-10-07T08:49:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.730+0000 7f1cf9433700 1 -- 172.21.15.81:0/1226327464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf000bc30 con 0x7f1cf41578d0 2023-10-07T08:49:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.730+0000 7f1cf9433700 1 -- 172.21.15.81:0/1226327464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0012430 con 0x7f1cf41578d0 2023-10-07T08:49:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.731+0000 7f1cfc699700 1 -- 172.21.15.81:0/1226327464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf41578d0 msgr2=0x7f1cf40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.731+0000 7f1cfc699700 1 --2- 172.21.15.81:0/1226327464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf41578d0 0x7f1cf40cf4f0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0009e60 tx=0x7f1cf0009780 comp rx=0 tx=0).stop 2023-10-07T08:49:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.731+0000 7f1cfc699700 1 -- 172.21.15.81:0/1226327464 shutdown_connections 2023-10-07T08:49:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.731+0000 7f1cfc699700 1 --2- 172.21.15.81:0/1226327464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf41578d0 0x7f1cf40cf4f0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.731+0000 7f1cfc699700 1 --2- 172.21.15.81:0/1226327464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1cf4157ca0 0x7f1cf415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.731+0000 7f1cfc699700 1 -- 172.21.15.81:0/1226327464 >> 172.21.15.81:0/1226327464 conn(0x7f1cf406bb90 msgr2=0x7f1cf406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.731+0000 7f1cfc699700 1 -- 172.21.15.81:0/1226327464 shutdown_connections 2023-10-07T08:49:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.731+0000 7f1cfc699700 1 -- 172.21.15.81:0/1226327464 wait complete. 2023-10-07T08:49:52.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.732+0000 7f1cfc699700 1 Processor -- start 2023-10-07T08:49:52.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.732+0000 7f1cfc699700 1 -- start start 2023-10-07T08:49:52.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.732+0000 7f1cfc699700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf406d120 0x7f1cf4143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:52.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.732+0000 7f1cfc699700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1cf41578d0 0x7f1cf40c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:52.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.732+0000 7f1cfc699700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cf4157ca0 0x7f1cf40c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:52.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.732+0000 7f1cfc699700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf415c770 con 0x7f1cf406d120 2023-10-07T08:49:52.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.732+0000 7f1cfc699700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf4143680 con 0x7f1cf4157ca0 2023-10-07T08:49:52.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.732+0000 7f1cfc699700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf415b9b0 con 0x7f1cf41578d0 2023-10-07T08:49:52.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.733+0000 7f1cfa435700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf406d120 0x7f1cf4143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:52.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.733+0000 7f1cfa435700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf406d120 0x7f1cf4143140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55242/0 (socket says 172.21.15.81:55242) 2023-10-07T08:49:52.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.733+0000 7f1cfa435700 1 -- 172.21.15.81:0/779635921 learned_addr learned my addr 172.21.15.81:0/779635921 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:52.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.733+0000 7f1cfac36700 1 --2- 172.21.15.81:0/779635921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cf4157ca0 0x7f1cf40c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:52.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.733+0000 7f1cf9c34700 1 --2- 172.21.15.81:0/779635921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1cf41578d0 0x7f1cf40c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:52.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.733+0000 7f1cfa435700 1 -- 172.21.15.81:0/779635921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1cf41578d0 msgr2=0x7f1cf40c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:52.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.733+0000 7f1cfa435700 1 --2- 172.21.15.81:0/779635921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1cf41578d0 0x7f1cf40c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:52.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.733+0000 7f1cfa435700 1 -- 172.21.15.81:0/779635921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cf4157ca0 msgr2=0x7f1cf40c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:52.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.733+0000 7f1cfa435700 1 --2- 172.21.15.81:0/779635921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cf4157ca0 0x7f1cf40c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:52.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.733+0000 7f1cfa435700 1 -- 172.21.15.81:0/779635921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf0009a20 con 0x7f1cf406d120 2023-10-07T08:49:52.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.733+0000 7f1cfa435700 1 --2- 172.21.15.81:0/779635921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf406d120 0x7f1cf4143140 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f1cf406fe20 tx=0x7f1cf0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:52.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.733+0000 7f1cea7fc700 1 -- 172.21.15.81:0/779635921 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0027470 con 0x7f1cf406d120 2023-10-07T08:49:52.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.733+0000 7f1cea7fc700 1 -- 172.21.15.81:0/779635921 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf00275f0 con 0x7f1cf406d120 2023-10-07T08:49:52.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.733+0000 7f1cea7fc700 1 -- 172.21.15.81:0/779635921 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00279b0 con 0x7f1cf406d120 2023-10-07T08:49:52.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.733+0000 7f1cfc699700 1 -- 172.21.15.81:0/779635921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf415bc90 con 0x7f1cf406d120 2023-10-07T08:49:52.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.733+0000 7f1cfc699700 1 -- 172.21.15.81:0/779635921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf415c250 con 0x7f1cf406d120 2023-10-07T08:49:52.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.734+0000 7f1cfc699700 1 -- 172.21.15.81:0/779635921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf4067ac0 con 0x7f1cf406d120 2023-10-07T08:49:52.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.735+0000 7f1cea7fc700 1 -- 172.21.15.81:0/779635921 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1cf0024070 con 0x7f1cf406d120 2023-10-07T08:49:52.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.735+0000 7f1cea7fc700 1 --2- 172.21.15.81:0/779635921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1cd8066f30 0x7f1cd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:52.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.735+0000 7f1cea7fc700 1 -- 172.21.15.81:0/779635921 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1cf0086960 con 0x7f1cf406d120 2023-10-07T08:49:52.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.735+0000 7f1cf9c34700 1 --2- 172.21.15.81:0/779635921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1cd8066f30 0x7f1cd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:52.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.735+0000 7f1cf9c34700 1 --2- 172.21.15.81:0/779635921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1cd8066f30 0x7f1cd80693e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1cf416d6b0 tx=0x7f1ce4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:52.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.739+0000 7f1cea7fc700 1 -- 172.21.15.81:0/779635921 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cf0053ed0 con 0x7f1cf406d120 2023-10-07T08:49:52.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.919+0000 7f1cfc699700 1 -- 172.21.15.81:0/779635921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1cf40d0450 con 0x7f1cf406d120 2023-10-07T08:49:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.923+0000 7f1cea7fc700 1 -- 172.21.15.81:0/779635921 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1cf002c0c0 con 0x7f1cf406d120 2023-10-07T08:49:52.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.925+0000 7f1cfc699700 1 -- 172.21.15.81:0/779635921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1cd8066f30 msgr2=0x7f1cd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:52.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.925+0000 7f1cfc699700 1 --2- 172.21.15.81:0/779635921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1cd8066f30 0x7f1cd80693e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1cf416d6b0 tx=0x7f1ce4008040 comp rx=0 tx=0).stop 2023-10-07T08:49:52.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.925+0000 7f1cfc699700 1 -- 172.21.15.81:0/779635921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf406d120 msgr2=0x7f1cf4143140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:52.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.925+0000 7f1cfc699700 1 --2- 172.21.15.81:0/779635921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf406d120 0x7f1cf4143140 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f1cf406fe20 tx=0x7f1cf0019000 comp rx=0 tx=0).stop 2023-10-07T08:49:52.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.925+0000 7f1cfc699700 1 -- 172.21.15.81:0/779635921 shutdown_connections 2023-10-07T08:49:52.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.925+0000 7f1cfc699700 1 --2- 172.21.15.81:0/779635921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cf4157ca0 0x7f1cf40c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:52.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.925+0000 7f1cfc699700 1 --2- 172.21.15.81:0/779635921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cf406d120 0x7f1cf4143140 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:52.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.925+0000 7f1cfc699700 1 --2- 172.21.15.81:0/779635921 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1cd8066f30 0x7f1cd80693e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:52.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.925+0000 7f1cfc699700 1 --2- 172.21.15.81:0/779635921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1cf41578d0 0x7f1cf40c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:52.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.925+0000 7f1cfc699700 1 -- 172.21.15.81:0/779635921 >> 172.21.15.81:0/779635921 conn(0x7f1cf406bb90 msgr2=0x7f1cf4068910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:52.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.925+0000 7f1cfc699700 1 -- 172.21.15.81:0/779635921 shutdown_connections 2023-10-07T08:49:52.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:52.925+0000 7f1cfc699700 1 -- 172.21.15.81:0/779635921 wait complete. 2023-10-07T08:49:52.938 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:49:52.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:49:52.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:49:53.022 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:49:53.022 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T08:49:53.022 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:49:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.135+0000 7f7557fff700 1 Processor -- start 2023-10-07T08:49:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.135+0000 7f7557fff700 1 -- start start 2023-10-07T08:49:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.136+0000 7f7557fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7558159f10 0x7f7558068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.136+0000 7f7557fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75580cee10 con 0x7f7558068cc0 2023-10-07T08:49:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.136+0000 7f7557fff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75580cd040 con 0x7f7558159b40 2023-10-07T08:49:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.136+0000 7f7557fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7558069140 con 0x7f7558159f10 2023-10-07T08:49:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.136+0000 7f75577fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7558068cc0 0x7f75580cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33306/0 (socket says 172.21.15.81:33306) 2023-10-07T08:49:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.136+0000 7f75577fe700 1 -- 172.21.15.81:0/1518283675 learned_addr learned my addr 172.21.15.81:0/1518283675 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.136+0000 7f754ffff700 1 --2- 172.21.15.81:0/1518283675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7558159f10 0x7f7558068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.136+0000 7f75567fc700 1 -- 172.21.15.81:0/1518283675 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028629172 0 0) 0x7f75580cee10 con 0x7f7558068cc0 2023-10-07T08:49:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.137+0000 7f75567fc700 1 -- 172.21.15.81:0/1518283675 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7544003570 con 0x7f7558068cc0 2023-10-07T08:49:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.137+0000 7f75567fc700 1 -- 172.21.15.81:0/1518283675 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422748736 0 0) 0x7f75580cd040 con 0x7f7558159b40 2023-10-07T08:49:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.137+0000 7f75567fc700 1 -- 172.21.15.81:0/1518283675 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75580cee10 con 0x7f7558159b40 2023-10-07T08:49:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.137+0000 7f754ffff700 1 -- 172.21.15.81:0/1518283675 >> v1:172.21.15.89:6789/0 conn(0x7f7558159b40 legacy=0x7f75580cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.137+0000 7f754ffff700 1 -- 172.21.15.81:0/1518283675 >> v1:172.21.15.81:6789/0 conn(0x7f7558068cc0 legacy=0x7f75580cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.137+0000 7f754ffff700 1 -- 172.21.15.81:0/1518283675 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75580cd320 con 0x7f7558159f10 2023-10-07T08:49:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.137+0000 7f754ffff700 1 --2- 172.21.15.81:0/1518283675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7558159f10 0x7f7558068780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7540009910 tx=0x7f75400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14d0684ca99da29d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.137+0000 7f75567fc700 1 -- 172.21.15.81:0/1518283675 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7540011630 con 0x7f7558159f10 2023-10-07T08:49:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.137+0000 7f75567fc700 1 -- 172.21.15.81:0/1518283675 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7540011790 con 0x7f7558159f10 2023-10-07T08:49:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.137+0000 7f75567fc700 1 -- 172.21.15.81:0/1518283675 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7540011b30 con 0x7f7558159f10 2023-10-07T08:49:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.137+0000 7f7557fff700 1 -- 172.21.15.81:0/1518283675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7558159f10 msgr2=0x7f7558068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.137+0000 7f7557fff700 1 --2- 172.21.15.81:0/1518283675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7558159f10 0x7f7558068780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7540009910 tx=0x7f75400091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.137+0000 7f7557fff700 1 -- 172.21.15.81:0/1518283675 shutdown_connections 2023-10-07T08:49:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.137+0000 7f7557fff700 1 --2- 172.21.15.81:0/1518283675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7558159f10 0x7f7558068780 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.137+0000 7f7557fff700 1 -- 172.21.15.81:0/1518283675 >> 172.21.15.81:0/1518283675 conn(0x7f75580cd660 msgr2=0x7f75580cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.138+0000 7f7557fff700 1 -- 172.21.15.81:0/1518283675 shutdown_connections 2023-10-07T08:49:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.138+0000 7f7557fff700 1 -- 172.21.15.81:0/1518283675 wait complete. 2023-10-07T08:49:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.139+0000 7f7557fff700 1 Processor -- start 2023-10-07T08:49:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.139+0000 7f7557fff700 1 -- start start 2023-10-07T08:49:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.139+0000 7f7557fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7558068cc0 0x7f755816a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.139+0000 7f7557fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7558159b40 0x7f755815c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.139+0000 7f7557fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7558159f10 0x7f755815d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.139+0000 7f7557fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755815bf00 con 0x7f7558159b40 2023-10-07T08:49:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.139+0000 7f7557fff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755816ae20 con 0x7f7558159f10 2023-10-07T08:49:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.139+0000 7f7557fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755815b2f0 con 0x7f7558068cc0 2023-10-07T08:49:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.139+0000 7f754ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7558159b40 0x7f755815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.139+0000 7f754ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7558159b40 0x7f755815c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55252/0 (socket says 172.21.15.81:55252) 2023-10-07T08:49:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.139+0000 7f754ffff700 1 -- 172.21.15.81:0/4124507498 learned_addr learned my addr 172.21.15.81:0/4124507498 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.140+0000 7f75577fe700 1 --2- 172.21.15.81:0/4124507498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7558159f10 0x7f755815d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.140+0000 7f7556ffd700 1 --2- 172.21.15.81:0/4124507498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7558068cc0 0x7f755816a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.140+0000 7f754ffff700 1 -- 172.21.15.81:0/4124507498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7558068cc0 msgr2=0x7f755816a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.140+0000 7f754ffff700 1 --2- 172.21.15.81:0/4124507498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7558068cc0 0x7f755816a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.140+0000 7f754ffff700 1 -- 172.21.15.81:0/4124507498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7558159f10 msgr2=0x7f755815d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.140+0000 7f754ffff700 1 --2- 172.21.15.81:0/4124507498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7558159f10 0x7f755815d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.140+0000 7f754ffff700 1 -- 172.21.15.81:0/4124507498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7540009420 con 0x7f7558159b40 2023-10-07T08:49:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.140+0000 7f754ffff700 1 --2- 172.21.15.81:0/4124507498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7558159b40 0x7f755815c390 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f7540009f00 tx=0x7f7540017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.140+0000 7f754effd700 1 -- 172.21.15.81:0/4124507498 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754001f070 con 0x7f7558159b40 2023-10-07T08:49:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.140+0000 7f754effd700 1 -- 172.21.15.81:0/4124507498 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7540000bc0 con 0x7f7558159b40 2023-10-07T08:49:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.140+0000 7f7557fff700 1 -- 172.21.15.81:0/4124507498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755815b5d0 con 0x7f7558159b40 2023-10-07T08:49:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.140+0000 7f754effd700 1 -- 172.21.15.81:0/4124507498 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7540025420 con 0x7f7558159b40 2023-10-07T08:49:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.140+0000 7f7557fff700 1 -- 172.21.15.81:0/4124507498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755815bb90 con 0x7f7558159b40 2023-10-07T08:49:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.141+0000 7f7557fff700 1 -- 172.21.15.81:0/4124507498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75580ce7c0 con 0x7f7558159b40 2023-10-07T08:49:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.141+0000 7f754effd700 1 -- 172.21.15.81:0/4124507498 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7540023070 con 0x7f7558159b40 2023-10-07T08:49:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.142+0000 7f754effd700 1 --2- 172.21.15.81:0/4124507498 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7538066f60 0x7f7538069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.142+0000 7f754effd700 1 -- 172.21.15.81:0/4124507498 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f75400855c0 con 0x7f7558159b40 2023-10-07T08:49:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.142+0000 7f7556ffd700 1 --2- 172.21.15.81:0/4124507498 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7538066f60 0x7f7538069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.142+0000 7f7556ffd700 1 --2- 172.21.15.81:0/4124507498 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7538066f60 0x7f7538069410 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f75480027d0 tx=0x7f7548009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.146+0000 7f754effd700 1 -- 172.21.15.81:0/4124507498 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7540052b30 con 0x7f7558159b40 2023-10-07T08:49:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.372+0000 7f7557fff700 1 -- 172.21.15.81:0/4124507498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7558071b10 con 0x7f7558159b40 2023-10-07T08:49:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.373+0000 7f754effd700 1 -- 172.21.15.81:0/4124507498 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f754002a090 con 0x7f7558159b40 2023-10-07T08:49:53.374 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:53.374 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5927,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1795695306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1795695306},{"type":"v1","addr":"172.21.15.89:6834","nonce":1795695306}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3856313795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3856313795},{"type":"v1","addr":"172.21.15.89:6835","nonce":3856313795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7119,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4143803144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4143803144},{"type":"v1","addr":"172.21.15.81:6836","nonce":4143803144}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7443,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1351610876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1351610876},{"type":"v1","addr":"172.21.15.81:6837","nonce":1351610876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[]} 2023-10-07T08:49:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.375+0000 7f7557fff700 1 -- 172.21.15.81:0/4124507498 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7538066f60 msgr2=0x7f7538069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.375+0000 7f7557fff700 1 --2- 172.21.15.81:0/4124507498 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7538066f60 0x7f7538069410 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f75480027d0 tx=0x7f7548009040 comp rx=0 tx=0).stop 2023-10-07T08:49:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.375+0000 7f7557fff700 1 -- 172.21.15.81:0/4124507498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7558159b40 msgr2=0x7f755815c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:53.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.375+0000 7f7557fff700 1 --2- 172.21.15.81:0/4124507498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7558159b40 0x7f755815c390 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f7540009f00 tx=0x7f7540017000 comp rx=0 tx=0).stop 2023-10-07T08:49:53.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.375+0000 7f7557fff700 1 -- 172.21.15.81:0/4124507498 shutdown_connections 2023-10-07T08:49:53.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.375+0000 7f7557fff700 1 --2- 172.21.15.81:0/4124507498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7558159f10 0x7f755815d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:53.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.375+0000 7f7557fff700 1 --2- 172.21.15.81:0/4124507498 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7538066f60 0x7f7538069410 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:53.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.375+0000 7f7557fff700 1 --2- 172.21.15.81:0/4124507498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7558068cc0 0x7f755816a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:53.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.375+0000 7f7557fff700 1 --2- 172.21.15.81:0/4124507498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7558159b40 0x7f755815c390 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:53.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.375+0000 7f7557fff700 1 -- 172.21.15.81:0/4124507498 >> 172.21.15.81:0/4124507498 conn(0x7f75580cd660 msgr2=0x7f75580b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:53.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.375+0000 7f7557fff700 1 -- 172.21.15.81:0/4124507498 shutdown_connections 2023-10-07T08:49:53.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.375+0000 7f7557fff700 1 -- 172.21.15.81:0/4124507498 wait complete. 2023-10-07T08:49:53.378 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 68 2023-10-07T08:49:53.388 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T08:49:53.389 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T08:49:53.389 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T08:49:53.389 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:49:53.389 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T08:49:53.389 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T08:49:53.390 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T08:49:53.390 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:49:53.390 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T08:49:53.390 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T08:49:53.390 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T08:49:53.390 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:49:53.391 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T08:49:53.391 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T08:49:53.391 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T08:49:53.391 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:49:53.399 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T08:49:53.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T08:49:53.400 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T08:49:53.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T08:49:53.401 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T08:49:53.402 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T08:49:53.403 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T08:49:53.403 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T08:49:53.442 INFO:tasks.ceph.mds.a:Started 2023-10-07T08:49:53.442 DEBUG:teuthology.parallel:result is None 2023-10-07T08:49:53.443 INFO:tasks.ceph.mds.c:Started 2023-10-07T08:49:53.444 DEBUG:teuthology.parallel:result is None 2023-10-07T08:49:53.444 INFO:tasks.ceph.mds.d:Started 2023-10-07T08:49:53.445 DEBUG:teuthology.parallel:result is None 2023-10-07T08:49:53.446 INFO:tasks.ceph.mds.b:Started 2023-10-07T08:49:53.446 DEBUG:teuthology.parallel:result is None 2023-10-07T08:49:53.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T08:49:53.515 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-07T08:49:53.516 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-07T08:49:53.528 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-10-07T08:49:53.528 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-10-07T08:49:53.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.565+0000 7f7d72cf4700 1 Processor -- start 2023-10-07T08:49:53.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.565+0000 7f7d72cf4700 1 -- start start 2023-10-07T08:49:53.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d72cf4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d6c1578d0 0x7f7d6c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:53.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d72cf4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d6c157ca0 0x7f7d6c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:53.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d72cf4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d6c06d120 0x7f7d6c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:53.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d72cf4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6c0d07c0 con 0x7f7d6c1578d0 2023-10-07T08:49:53.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d72cf4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6c06daa0 con 0x7f7d6c157ca0 2023-10-07T08:49:53.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d72cf4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0cfbb0 con 0x7f7d6c06d120 2023-10-07T08:49:53.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d70a90700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d6c1578d0 0x7f7d6c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:53.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d70a90700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d6c1578d0 0x7f7d6c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55274/0 (socket says 172.21.15.81:55274) 2023-10-07T08:49:53.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d70a90700 1 -- 172.21.15.81:0/4038668189 learned_addr learned my addr 172.21.15.81:0/4038668189 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:53.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d71291700 1 --2- 172.21.15.81:0/4038668189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d6c06d120 0x7f7d6c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:53.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d6bfff700 1 --2- 172.21.15.81:0/4038668189 >> v2:172.21.15.89:3300/0 conn(0x7f7d6c157ca0 0x7f7d6c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:53.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d70a90700 1 -- 172.21.15.81:0/4038668189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d6c06d120 msgr2=0x7f7d6c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:53.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d70a90700 1 --2- 172.21.15.81:0/4038668189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d6c06d120 0x7f7d6c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:53.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d70a90700 1 -- 172.21.15.81:0/4038668189 >> v2:172.21.15.89:3300/0 conn(0x7f7d6c157ca0 msgr2=0x7f7d6c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:53.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d70a90700 1 --2- 172.21.15.81:0/4038668189 >> v2:172.21.15.89:3300/0 conn(0x7f7d6c157ca0 0x7f7d6c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:53.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d70a90700 1 -- 172.21.15.81:0/4038668189 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c0cfe90 con 0x7f7d6c1578d0 2023-10-07T08:49:53.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d6bfff700 1 --2- 172.21.15.81:0/4038668189 >> v2:172.21.15.89:3300/0 conn(0x7f7d6c157ca0 0x7f7d6c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:53.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d71291700 1 --2- 172.21.15.81:0/4038668189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d6c06d120 0x7f7d6c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:53.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.566+0000 7f7d70a90700 1 --2- 172.21.15.81:0/4038668189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c1578d0 0x7f7d6c0cf4f0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c068510 tx=0x7f7d60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a021c1e3900290f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:53.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.567+0000 7f7d6b7fe700 1 -- 172.21.15.81:0/4038668189 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000b860 con 0x7f7d6c1578d0 2023-10-07T08:49:53.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.567+0000 7f7d6b7fe700 1 -- 172.21.15.81:0/4038668189 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6000b9c0 con 0x7f7d6c1578d0 2023-10-07T08:49:53.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.567+0000 7f7d6b7fe700 1 -- 172.21.15.81:0/4038668189 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000bd60 con 0x7f7d6c1578d0 2023-10-07T08:49:53.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.567+0000 7f7d72cf4700 1 -- 172.21.15.81:0/4038668189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c1578d0 msgr2=0x7f7d6c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:53.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.567+0000 7f7d72cf4700 1 --2- 172.21.15.81:0/4038668189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c1578d0 0x7f7d6c0cf4f0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c068510 tx=0x7f7d60009250 comp rx=0 tx=0).stop 2023-10-07T08:49:53.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.567+0000 7f7d72cf4700 1 -- 172.21.15.81:0/4038668189 shutdown_connections 2023-10-07T08:49:53.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.567+0000 7f7d72cf4700 1 --2- 172.21.15.81:0/4038668189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d6c06d120 0x7f7d6c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:53.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.567+0000 7f7d72cf4700 1 --2- 172.21.15.81:0/4038668189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c1578d0 0x7f7d6c0cf4f0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:53.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.567+0000 7f7d72cf4700 1 --2- 172.21.15.81:0/4038668189 >> v2:172.21.15.89:3300/0 conn(0x7f7d6c157ca0 0x7f7d6c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:53.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.567+0000 7f7d72cf4700 1 -- 172.21.15.81:0/4038668189 >> 172.21.15.81:0/4038668189 conn(0x7f7d6c06bb90 msgr2=0x7f7d6c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:53.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.567+0000 7f7d72cf4700 1 -- 172.21.15.81:0/4038668189 shutdown_connections 2023-10-07T08:49:53.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.567+0000 7f7d72cf4700 1 -- 172.21.15.81:0/4038668189 wait complete. 2023-10-07T08:49:53.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.568+0000 7f7d72cf4700 1 Processor -- start 2023-10-07T08:49:53.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.568+0000 7f7d72cf4700 1 -- start start 2023-10-07T08:49:53.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.569+0000 7f7d72cf4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d6c06d120 0x7f7d6c0c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:53.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.569+0000 7f7d72cf4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d6c1578d0 0x7f7d6c16dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.569+0000 7f7d72cf4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c157ca0 0x7f7d6c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.569+0000 7f7d72cf4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0c6020 con 0x7f7d6c157ca0 2023-10-07T08:49:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.569+0000 7f7d72cf4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0c6300 con 0x7f7d6c1578d0 2023-10-07T08:49:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.569+0000 7f7d72cf4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0c65e0 con 0x7f7d6c06d120 2023-10-07T08:49:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.569+0000 7f7d71291700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c157ca0 0x7f7d6c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.569+0000 7f7d71291700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c157ca0 0x7f7d6c0b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55288/0 (socket says 172.21.15.81:55288) 2023-10-07T08:49:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.569+0000 7f7d71291700 1 -- 172.21.15.81:0/2455290587 learned_addr learned my addr 172.21.15.81:0/2455290587 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.569+0000 7f7d6bfff700 1 --2- 172.21.15.81:0/2455290587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d6c1578d0 0x7f7d6c16dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.569+0000 7f7d70a90700 1 --2- 172.21.15.81:0/2455290587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d6c06d120 0x7f7d6c0c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.569+0000 7f7d71291700 1 -- 172.21.15.81:0/2455290587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d6c06d120 msgr2=0x7f7d6c0c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.569+0000 7f7d71291700 1 --2- 172.21.15.81:0/2455290587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d6c06d120 0x7f7d6c0c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.569+0000 7f7d71291700 1 -- 172.21.15.81:0/2455290587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d6c1578d0 msgr2=0x7f7d6c16dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.569+0000 7f7d71291700 1 --2- 172.21.15.81:0/2455290587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d6c1578d0 0x7f7d6c16dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.570+0000 7f7d71291700 1 -- 172.21.15.81:0/2455290587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d600094f0 con 0x7f7d6c157ca0 2023-10-07T08:49:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.570+0000 7f7d70a90700 1 --2- 172.21.15.81:0/2455290587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d6c06d120 0x7f7d6c0c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.570+0000 7f7d71291700 1 --2- 172.21.15.81:0/2455290587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c157ca0 0x7f7d6c0b4d20 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400d180 tx=0x7f7d64009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.570+0000 7f7d68ff9700 1 -- 172.21.15.81:0/2455290587 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6400de20 con 0x7f7d6c157ca0 2023-10-07T08:49:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.570+0000 7f7d68ff9700 1 -- 172.21.15.81:0/2455290587 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6400f040 con 0x7f7d6c157ca0 2023-10-07T08:49:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.570+0000 7f7d72cf4700 1 -- 172.21.15.81:0/2455290587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6c0c68c0 con 0x7f7d6c157ca0 2023-10-07T08:49:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.570+0000 7f7d68ff9700 1 -- 172.21.15.81:0/2455290587 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d64015690 con 0x7f7d6c157ca0 2023-10-07T08:49:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.570+0000 7f7d72cf4700 1 -- 172.21.15.81:0/2455290587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6c0c8f90 con 0x7f7d6c157ca0 2023-10-07T08:49:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.571+0000 7f7d72cf4700 1 -- 172.21.15.81:0/2455290587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d6c0c6ab0 con 0x7f7d6c157ca0 2023-10-07T08:49:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.571+0000 7f7d68ff9700 1 -- 172.21.15.81:0/2455290587 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d6401e3b0 con 0x7f7d6c157ca0 2023-10-07T08:49:53.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.571+0000 7f7d68ff9700 1 --2- 172.21.15.81:0/2455290587 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7d50066f30 0x7f7d500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:53.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.572+0000 7f7d68ff9700 1 -- 172.21.15.81:0/2455290587 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7d64084800 con 0x7f7d6c157ca0 2023-10-07T08:49:53.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.572+0000 7f7d70a90700 1 --2- 172.21.15.81:0/2455290587 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7d50066f30 0x7f7d500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:53.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.572+0000 7f7d70a90700 1 --2- 172.21.15.81:0/2455290587 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7d50066f30 0x7f7d500693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c068510 tx=0x7f7d60017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:53.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.576+0000 7f7d68ff9700 1 -- 172.21.15.81:0/2455290587 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d64051d70 con 0x7f7d6c157ca0 2023-10-07T08:49:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:53.776+0000 7f7d72cf4700 1 -- 172.21.15.81:0/2455290587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7d6c0d0170 con 0x7f7d6c157ca0 2023-10-07T08:49:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.623+0000 7f7d68ff9700 1 -- 172.21.15.81:0/2455290587 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v152) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7d6401a080 con 0x7f7d6c157ca0 2023-10-07T08:49:54.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.626+0000 7f7d72cf4700 1 -- 172.21.15.81:0/2455290587 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7d50066f30 msgr2=0x7f7d500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:54.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.626+0000 7f7d72cf4700 1 --2- 172.21.15.81:0/2455290587 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7d50066f30 0x7f7d500693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c068510 tx=0x7f7d60017000 comp rx=0 tx=0).stop 2023-10-07T08:49:54.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.626+0000 7f7d72cf4700 1 -- 172.21.15.81:0/2455290587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c157ca0 msgr2=0x7f7d6c0b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.626+0000 7f7d72cf4700 1 --2- 172.21.15.81:0/2455290587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c157ca0 0x7f7d6c0b4d20 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400d180 tx=0x7f7d64009a50 comp rx=0 tx=0).stop 2023-10-07T08:49:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.626+0000 7f7d72cf4700 1 -- 172.21.15.81:0/2455290587 shutdown_connections 2023-10-07T08:49:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.626+0000 7f7d72cf4700 1 --2- 172.21.15.81:0/2455290587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c157ca0 0x7f7d6c0b4d20 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.626+0000 7f7d72cf4700 1 --2- 172.21.15.81:0/2455290587 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7d50066f30 0x7f7d500693e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.626+0000 7f7d72cf4700 1 --2- 172.21.15.81:0/2455290587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d6c06d120 0x7f7d6c0c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.626+0000 7f7d72cf4700 1 --2- 172.21.15.81:0/2455290587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d6c1578d0 0x7f7d6c16dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.626+0000 7f7d72cf4700 1 -- 172.21.15.81:0/2455290587 >> 172.21.15.81:0/2455290587 conn(0x7f7d6c06bb90 msgr2=0x7f7d6c06bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.626+0000 7f7d72cf4700 1 -- 172.21.15.81:0/2455290587 shutdown_connections 2023-10-07T08:49:54.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.626+0000 7f7d72cf4700 1 -- 172.21.15.81:0/2455290587 wait complete. 2023-10-07T08:49:54.629 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-07T08:49:54.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T08:49:54.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.757+0000 7fb958837700 1 Processor -- start 2023-10-07T08:49:54.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.757+0000 7fb958837700 1 -- start start 2023-10-07T08:49:54.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb958837700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb954068e90 0x7fb954164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:54.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb958837700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9540cee10 con 0x7fb954159b40 2023-10-07T08:49:54.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb958837700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9540cd040 con 0x7fb954159f10 2023-10-07T08:49:54.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb958837700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9540cd320 con 0x7fb954068e90 2023-10-07T08:49:54.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb952d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb954159b40 0x7fb9540cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33338/0 (socket says 172.21.15.81:33338) 2023-10-07T08:49:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb952d9d700 1 -- 172.21.15.81:0/3625339989 learned_addr learned my addr 172.21.15.81:0/3625339989 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb95259c700 1 -- 172.21.15.81:0/3625339989 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53439465 0 0) 0x7fb9540cee10 con 0x7fb954159b40 2023-10-07T08:49:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb95259c700 1 -- 172.21.15.81:0/3625339989 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb940003570 con 0x7fb954159b40 2023-10-07T08:49:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb95359e700 1 --2- 172.21.15.81:0/3625339989 >> v2:172.21.15.89:3300/0 conn(0x7fb954068e90 0x7fb954164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb95259c700 1 -- 172.21.15.81:0/3625339989 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1887749963 0 0) 0x7fb940003570 con 0x7fb954159b40 2023-10-07T08:49:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb95259c700 1 -- 172.21.15.81:0/3625339989 >> v2:172.21.15.89:3300/0 conn(0x7fb954068e90 msgr2=0x7fb954164c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb95259c700 1 --2- 172.21.15.81:0/3625339989 >> v2:172.21.15.89:3300/0 conn(0x7fb954068e90 0x7fb954164c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb95259c700 1 -- 172.21.15.81:0/3625339989 >> v1:172.21.15.89:6789/0 conn(0x7fb954159f10 legacy=0x7fb954068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb95259c700 1 -- 172.21.15.81:0/3625339989 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9540ce7c0 con 0x7fb954159b40 2023-10-07T08:49:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb95259c700 1 -- 172.21.15.81:0/3625339989 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fb944001470 con 0x7fb954159b40 2023-10-07T08:49:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb95259c700 1 -- 172.21.15.81:0/3625339989 >> v1:172.21.15.81:6789/0 conn(0x7fb954159b40 legacy=0x7fb9540cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb95259c700 1 --2- 172.21.15.81:0/3625339989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb940003a60 0x7fb940003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb95259c700 1 --2- 172.21.15.81:0/3625339989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb940004810 0x7fb940004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb95259c700 1 --2- 172.21.15.81:0/3625339989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb940005230 0x7fb94000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb95259c700 1 -- 172.21.15.81:0/3625339989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9540cd320 con 0x7fb940003a60 2023-10-07T08:49:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb95259c700 1 -- 172.21.15.81:0/3625339989 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94000c160 con 0x7fb940004810 2023-10-07T08:49:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.758+0000 7fb95259c700 1 -- 172.21.15.81:0/3625339989 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94000c320 con 0x7fb940005230 2023-10-07T08:49:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.759+0000 7fb952d9d700 1 --2- 172.21.15.81:0/3625339989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb940003a60 0x7fb940003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.759+0000 7fb94a59c700 1 --2- 172.21.15.81:0/3625339989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb940004810 0x7fb940004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.759+0000 7fb95359e700 1 --2- 172.21.15.81:0/3625339989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb940005230 0x7fb94000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.759+0000 7fb952d9d700 1 -- 172.21.15.81:0/3625339989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb940005230 msgr2=0x7fb94000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.759+0000 7fb952d9d700 1 --2- 172.21.15.81:0/3625339989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb940005230 0x7fb94000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.759+0000 7fb952d9d700 1 -- 172.21.15.81:0/3625339989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb940004810 msgr2=0x7fb940004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:54.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.759+0000 7fb952d9d700 1 --2- 172.21.15.81:0/3625339989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb940004810 0x7fb940004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:54.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.759+0000 7fb952d9d700 1 -- 172.21.15.81:0/3625339989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb940003570 con 0x7fb940003a60 2023-10-07T08:49:54.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.759+0000 7fb95359e700 1 -- 172.21.15.81:0/3625339989 reap_dead start 2023-10-07T08:49:54.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.759+0000 7fb952d9d700 1 --2- 172.21.15.81:0/3625339989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb940003a60 0x7fb940003e50 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fb94400c3c0 tx=0x7fb944001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2d2c6fc2cf9ab6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:54.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.759+0000 7fb95259c700 1 -- 172.21.15.81:0/3625339989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94400cc90 con 0x7fb940003a60 2023-10-07T08:49:54.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.759+0000 7fb95259c700 1 -- 172.21.15.81:0/3625339989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94400ce10 con 0x7fb940003a60 2023-10-07T08:49:54.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.759+0000 7fb95259c700 1 -- 172.21.15.81:0/3625339989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944005b70 con 0x7fb940003a60 2023-10-07T08:49:54.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.760+0000 7fb958837700 1 -- 172.21.15.81:0/3625339989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb940003a60 msgr2=0x7fb940003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:54.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.760+0000 7fb958837700 1 --2- 172.21.15.81:0/3625339989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb940003a60 0x7fb940003e50 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fb94400c3c0 tx=0x7fb944001e70 comp rx=0 tx=0).stop 2023-10-07T08:49:54.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.760+0000 7fb958837700 1 -- 172.21.15.81:0/3625339989 shutdown_connections 2023-10-07T08:49:54.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.760+0000 7fb958837700 1 --2- 172.21.15.81:0/3625339989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb940003a60 0x7fb940003e50 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:54.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.760+0000 7fb958837700 1 -- 172.21.15.81:0/3625339989 >> 172.21.15.81:0/3625339989 conn(0x7fb9540cd660 msgr2=0x7fb9540cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:54.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.760+0000 7fb958837700 1 -- 172.21.15.81:0/3625339989 shutdown_connections 2023-10-07T08:49:54.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.760+0000 7fb958837700 1 -- 172.21.15.81:0/3625339989 wait complete. 2023-10-07T08:49:54.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.761+0000 7fb958837700 1 Processor -- start 2023-10-07T08:49:54.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.761+0000 7fb958837700 1 -- start start 2023-10-07T08:49:54.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.761+0000 7fb958837700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb940003a60 0x7fb9540c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:54.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb958837700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9540b4b10 0x7fb9541547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:54.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb958837700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9540cf720 0x7fb9540cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:54.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb958837700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9540d0100 con 0x7fb9540cf720 2023-10-07T08:49:54.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb958837700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9540b4f80 con 0x7fb940003a60 2023-10-07T08:49:54.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb958837700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb954156e20 con 0x7fb9540b4b10 2023-10-07T08:49:54.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb95359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9540cf720 0x7fb9540cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:54.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb95359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9540cf720 0x7fb9540cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55306/0 (socket says 172.21.15.81:55306) 2023-10-07T08:49:54.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb95359e700 1 -- 172.21.15.81:0/4174005070 learned_addr learned my addr 172.21.15.81:0/4174005070 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:54.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb94a59c700 1 --2- 172.21.15.81:0/4174005070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9540b4b10 0x7fb9541547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:54.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb952d9d700 1 --2- 172.21.15.81:0/4174005070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb940003a60 0x7fb9540c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:54.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb95359e700 1 -- 172.21.15.81:0/4174005070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9540b4b10 msgr2=0x7fb9541547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:54.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb95359e700 1 --2- 172.21.15.81:0/4174005070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9540b4b10 0x7fb9541547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:54.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb95359e700 1 -- 172.21.15.81:0/4174005070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb940003a60 msgr2=0x7fb9540c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:54.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb95359e700 1 --2- 172.21.15.81:0/4174005070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb940003a60 0x7fb9540c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:54.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb95359e700 1 -- 172.21.15.81:0/4174005070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9540b5200 con 0x7fb9540cf720 2023-10-07T08:49:54.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb94a59c700 1 --2- 172.21.15.81:0/4174005070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9540b4b10 0x7fb9541547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:54.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb95359e700 1 --2- 172.21.15.81:0/4174005070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9540cf720 0x7fb9540cfbc0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fb954069290 tx=0x7fb94c009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:54.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb94b7fe700 1 -- 172.21.15.81:0/4174005070 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c007ea0 con 0x7fb9540cf720 2023-10-07T08:49:54.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb94b7fe700 1 -- 172.21.15.81:0/4174005070 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c00f050 con 0x7fb9540cf720 2023-10-07T08:49:54.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb958837700 1 -- 172.21.15.81:0/4174005070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9540b54e0 con 0x7fb9540cf720 2023-10-07T08:49:54.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb94b7fe700 1 -- 172.21.15.81:0/4174005070 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c014410 con 0x7fb9540cf720 2023-10-07T08:49:54.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.762+0000 7fb958837700 1 -- 172.21.15.81:0/4174005070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9540b5aa0 con 0x7fb9540cf720 2023-10-07T08:49:54.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.763+0000 7fb958837700 1 -- 172.21.15.81:0/4174005070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9540cb890 con 0x7fb9540cf720 2023-10-07T08:49:54.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.763+0000 7fb94b7fe700 1 -- 172.21.15.81:0/4174005070 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb94c003040 con 0x7fb9540cf720 2023-10-07T08:49:54.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.764+0000 7fb94b7fe700 1 --2- 172.21.15.81:0/4174005070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb934066f30 0x7fb9340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:54.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.764+0000 7fb94b7fe700 1 -- 172.21.15.81:0/4174005070 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb94c084350 con 0x7fb9540cf720 2023-10-07T08:49:54.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.764+0000 7fb952d9d700 1 --2- 172.21.15.81:0/4174005070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb934066f30 0x7fb9340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:54.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.764+0000 7fb952d9d700 1 --2- 172.21.15.81:0/4174005070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb934066f30 0x7fb9340693e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb944001ed0 tx=0x7fb944015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:54.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:54.768+0000 7fb94b7fe700 1 -- 172.21.15.81:0/4174005070 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb94c051910 con 0x7fb9540cf720 2023-10-07T08:49:55.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.022+0000 7fb958837700 1 -- 172.21.15.81:0/4174005070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb9540ceaa0 con 0x7fb9540cf720 2023-10-07T08:49:55.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.022+0000 7fb94b7fe700 1 -- 172.21.15.81:0/4174005070 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb94c054f30 con 0x7fb9540cf720 2023-10-07T08:49:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:55.024 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:49:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-07T08:49:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-07T08:49:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlK8v0EhAAyj+l+ifyEevPT96HbuWzkw==", 2023-10-07T08:49:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:49:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:49:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:49:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-07T08:49:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlN0UcHhAA0o1jHEL9Ow40VDezKTunOw==", 2023-10-07T08:49:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:49:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:49:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:49:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-07T08:49:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlvsm6GRAApZehzqt3HugU+h9RGWQh8g==", 2023-10-07T08:49:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:49:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:49:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:49:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-07T08:49:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8XLiJBAAMBqSo/+NZuuL/pPnTitAUw==", 2023-10-07T08:49:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:49:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:49:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:49:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-07T08:49:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD2GSFlwYNOOBAAMpoFTAZdRERvqFbI4Lno9g==", 2023-10-07T08:49:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:49:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:49:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-07T08:49:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlejEnBBAAsnZCgsTTMWvqr2n4FfgWCQ==", 2023-10-07T08:49:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:49:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:49:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-07T08:49:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlDjS3DRAAfyBS9XSkAY6Se+RNw9jwWw==", 2023-10-07T08:49:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:49:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:49:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-07T08:49:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlnLaEFxAAtQ3AxrEGCcXYvJF2/wP1yw==", 2023-10-07T08:49:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:49:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:49:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-07T08:49:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlllNdIRAAXgD+PAR1Piya6p94xfGbXA==", 2023-10-07T08:49:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:49:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:49:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-07T08:49:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFleIM7KBAAIz+WlbgsmtAuSMPO+kh/Xw==", 2023-10-07T08:49:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:49:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:49:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-07T08:49:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlFNlEMRAAt7dpMTylOj0KsJy/law6Nw==", 2023-10-07T08:49:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:49:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:49:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-07T08:49:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFloCRbOhAA8XzXVwVYYYZIJV+F84EiDQ==", 2023-10-07T08:49:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:49:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:49:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-07T08:49:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl7cS0KBAA2K6kkFjyEZYa0xYx53Nf7g==", 2023-10-07T08:49:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:49:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-07T08:49:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T08:49:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-07T08:49:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlP3EBMRAAWXcQeEkoEzBCSQzvz/AzBQ==", 2023-10-07T08:49:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:49:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:49:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:49:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:49:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-07T08:49:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFldtgKLhAAX8L0S1NgyHsOj4cUljxH/A==", 2023-10-07T08:49:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:49:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:49:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:49:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:49:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-07T08:49:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlJ+VXNhAA9sXFpdOEIZxQLiS8LJwa3A==", 2023-10-07T08:49:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:49:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:49:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:49:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:49:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-07T08:49:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDyGSFle021MxAA39oudTkATALz6ZklfA0QQA==", 2023-10-07T08:49:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:49:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:49:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:49:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-07T08:49:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8c3zDxAAKU/DHPPZhFJ1MKw48C6lJQ==", 2023-10-07T08:49:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:49:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:49:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:49:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-07T08:49:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlByYuDBAA2xkiT3FNBRXjSMlu+GdRjg==", 2023-10-07T08:49:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:49:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:49:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:49:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:49:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:49:55.042 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:49:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.024+0000 7fb958837700 1 -- 172.21.15.81:0/4174005070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb934066f30 msgr2=0x7fb9340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.024+0000 7fb958837700 1 --2- 172.21.15.81:0/4174005070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb934066f30 0x7fb9340693e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb944001ed0 tx=0x7fb944015000 comp rx=0 tx=0).stop 2023-10-07T08:49:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.024+0000 7fb958837700 1 -- 172.21.15.81:0/4174005070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9540cf720 msgr2=0x7fb9540cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.024+0000 7fb958837700 1 --2- 172.21.15.81:0/4174005070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9540cf720 0x7fb9540cfbc0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fb954069290 tx=0x7fb94c009870 comp rx=0 tx=0).stop 2023-10-07T08:49:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.024+0000 7fb958837700 1 -- 172.21.15.81:0/4174005070 shutdown_connections 2023-10-07T08:49:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.024+0000 7fb958837700 1 --2- 172.21.15.81:0/4174005070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9540cf720 0x7fb9540cfbc0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.024+0000 7fb958837700 1 --2- 172.21.15.81:0/4174005070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb940003a60 0x7fb9540c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.024+0000 7fb958837700 1 --2- 172.21.15.81:0/4174005070 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb934066f30 0x7fb9340693e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.024+0000 7fb958837700 1 --2- 172.21.15.81:0/4174005070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9540b4b10 0x7fb9541547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.025+0000 7fb958837700 1 -- 172.21.15.81:0/4174005070 >> 172.21.15.81:0/4174005070 conn(0x7fb9540cd660 msgr2=0x7fb95406e670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.025+0000 7fb958837700 1 -- 172.21.15.81:0/4174005070 shutdown_connections 2023-10-07T08:49:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.025+0000 7fb958837700 1 -- 172.21.15.81:0/4174005070 wait complete. 2023-10-07T08:49:55.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:49:55.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.157+0000 7f93c4519700 1 Processor -- start 2023-10-07T08:49:55.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.157+0000 7f93c4519700 1 -- start start 2023-10-07T08:49:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.158+0000 7f93c4519700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93bc1578d0 0x7f93bc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.158+0000 7f93c4519700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f93bc06d120 0x7f93bc06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.158+0000 7f93c4519700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93bc0d07c0 con 0x7f93bc157ca0 2023-10-07T08:49:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.158+0000 7f93c4519700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93bc06da50 con 0x7f93bc06d120 2023-10-07T08:49:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.158+0000 7f93c4519700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93bc0cfbb0 con 0x7f93bc1578d0 2023-10-07T08:49:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.158+0000 7f93c2ab6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f93bc06d120 0x7f93bc06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.158+0000 7f93c1ab4700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f93bc157ca0 0x7f93bc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33348/0 (socket says 172.21.15.81:33348) 2023-10-07T08:49:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.158+0000 7f93c1ab4700 1 -- 172.21.15.81:0/1133174488 learned_addr learned my addr 172.21.15.81:0/1133174488 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.158+0000 7f93c22b5700 1 --2- 172.21.15.81:0/1133174488 >> v2:172.21.15.89:3300/0 conn(0x7f93bc1578d0 0x7f93bc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.158+0000 7f93c2ab6700 1 -- 172.21.15.81:0/1133174488 >> v2:172.21.15.89:3300/0 conn(0x7f93bc1578d0 msgr2=0x7f93bc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.158+0000 7f93c2ab6700 1 --2- 172.21.15.81:0/1133174488 >> v2:172.21.15.89:3300/0 conn(0x7f93bc1578d0 0x7f93bc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.159+0000 7f93c2ab6700 1 -- 172.21.15.81:0/1133174488 >> v1:172.21.15.81:6789/0 conn(0x7f93bc157ca0 legacy=0x7f93bc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.159+0000 7f93c2ab6700 1 -- 172.21.15.81:0/1133174488 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc0cfe90 con 0x7f93bc06d120 2023-10-07T08:49:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.159+0000 7f93c12b3700 1 -- 172.21.15.81:0/1133174488 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736631493 0 0) 0x7f93bc0d07c0 con 0x7f93bc157ca0 2023-10-07T08:49:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.159+0000 7f93c2ab6700 1 --2- 172.21.15.81:0/1133174488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc06d120 0x7f93bc06d510 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0646b0 tx=0x7f93b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5bf7bc605b3e772 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.159+0000 7f93c12b3700 1 -- 172.21.15.81:0/1133174488 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b400e070 con 0x7f93bc06d120 2023-10-07T08:49:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.159+0000 7f93c12b3700 1 -- 172.21.15.81:0/1133174488 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b400bb60 con 0x7f93bc06d120 2023-10-07T08:49:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.159+0000 7f93c12b3700 1 -- 172.21.15.81:0/1133174488 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4012430 con 0x7f93bc06d120 2023-10-07T08:49:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.159+0000 7f93c4519700 1 -- 172.21.15.81:0/1133174488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc06d120 msgr2=0x7f93bc06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.159+0000 7f93c4519700 1 --2- 172.21.15.81:0/1133174488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc06d120 0x7f93bc06d510 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0646b0 tx=0x7f93b4009780 comp rx=0 tx=0).stop 2023-10-07T08:49:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.159+0000 7f93c4519700 1 -- 172.21.15.81:0/1133174488 shutdown_connections 2023-10-07T08:49:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.159+0000 7f93c4519700 1 --2- 172.21.15.81:0/1133174488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc06d120 0x7f93bc06d510 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.159+0000 7f93c4519700 1 --2- 172.21.15.81:0/1133174488 >> v2:172.21.15.89:3300/0 conn(0x7f93bc1578d0 0x7f93bc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.159+0000 7f93c4519700 1 -- 172.21.15.81:0/1133174488 >> 172.21.15.81:0/1133174488 conn(0x7f93bc06bb90 msgr2=0x7f93bc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.159+0000 7f93c4519700 1 -- 172.21.15.81:0/1133174488 shutdown_connections 2023-10-07T08:49:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.159+0000 7f93c4519700 1 -- 172.21.15.81:0/1133174488 wait complete. 2023-10-07T08:49:55.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.160+0000 7f93c4519700 1 Processor -- start 2023-10-07T08:49:55.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.161+0000 7f93c4519700 1 -- start start 2023-10-07T08:49:55.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.161+0000 7f93c4519700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc06d120 0x7f93bc0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.161+0000 7f93c4519700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93bc1578d0 0x7f93bc0ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.161+0000 7f93c4519700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93bc157ca0 0x7f93bc159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.161+0000 7f93c4519700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc0b6240 con 0x7f93bc06d120 2023-10-07T08:49:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.161+0000 7f93c4519700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc0b6490 con 0x7f93bc1578d0 2023-10-07T08:49:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.161+0000 7f93c4519700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc0b6770 con 0x7f93bc157ca0 2023-10-07T08:49:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.161+0000 7f93c22b5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc06d120 0x7f93bc0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.161+0000 7f93c22b5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc06d120 0x7f93bc0b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55320/0 (socket says 172.21.15.81:55320) 2023-10-07T08:49:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.161+0000 7f93c22b5700 1 -- 172.21.15.81:0/1711057576 learned_addr learned my addr 172.21.15.81:0/1711057576 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.162+0000 7f93c1ab4700 1 --2- 172.21.15.81:0/1711057576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93bc1578d0 0x7f93bc0ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.162+0000 7f93c2ab6700 1 --2- 172.21.15.81:0/1711057576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93bc157ca0 0x7f93bc159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.162+0000 7f93c22b5700 1 -- 172.21.15.81:0/1711057576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93bc157ca0 msgr2=0x7f93bc159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.162+0000 7f93c22b5700 1 --2- 172.21.15.81:0/1711057576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93bc157ca0 0x7f93bc159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.162+0000 7f93c22b5700 1 -- 172.21.15.81:0/1711057576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93bc1578d0 msgr2=0x7f93bc0ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.162+0000 7f93c22b5700 1 --2- 172.21.15.81:0/1711057576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93bc1578d0 0x7f93bc0ab350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.162+0000 7f93c22b5700 1 -- 172.21.15.81:0/1711057576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b4009a20 con 0x7f93bc06d120 2023-10-07T08:49:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.162+0000 7f93c22b5700 1 --2- 172.21.15.81:0/1711057576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc06d120 0x7f93bc0b5b80 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f93b800ec80 tx=0x7f93b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.162+0000 7f93b27fc700 1 -- 172.21.15.81:0/1711057576 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b800c9d0 con 0x7f93bc06d120 2023-10-07T08:49:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.162+0000 7f93b27fc700 1 -- 172.21.15.81:0/1711057576 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b800cb30 con 0x7f93bc06d120 2023-10-07T08:49:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.162+0000 7f93c4519700 1 -- 172.21.15.81:0/1711057576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93bc0b6a50 con 0x7f93bc06d120 2023-10-07T08:49:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.162+0000 7f93b27fc700 1 -- 172.21.15.81:0/1711057576 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8013470 con 0x7f93bc06d120 2023-10-07T08:49:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.162+0000 7f93c4519700 1 -- 172.21.15.81:0/1711057576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93bc0ab910 con 0x7f93bc06d120 2023-10-07T08:49:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.163+0000 7f93c4519700 1 -- 172.21.15.81:0/1711057576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93bc16a740 con 0x7f93bc06d120 2023-10-07T08:49:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.163+0000 7f93b27fc700 1 -- 172.21.15.81:0/1711057576 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93b8013820 con 0x7f93bc06d120 2023-10-07T08:49:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.164+0000 7f93b27fc700 1 --2- 172.21.15.81:0/1711057576 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93a0066f30 0x7f93a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.164+0000 7f93b27fc700 1 -- 172.21.15.81:0/1711057576 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f93b8084570 con 0x7f93bc06d120 2023-10-07T08:49:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.164+0000 7f93c1ab4700 1 --2- 172.21.15.81:0/1711057576 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93a0066f30 0x7f93a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.164+0000 7f93c1ab4700 1 --2- 172.21.15.81:0/1711057576 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93a0066f30 0x7f93a00693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0b60e0 tx=0x7f93ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.168+0000 7f93b27fc700 1 -- 172.21.15.81:0/1711057576 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93b8051b30 con 0x7f93bc06d120 2023-10-07T08:49:55.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.350+0000 7f93c4519700 1 -- 172.21.15.81:0/1711057576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93bc0d0170 con 0x7f93bc06d120 2023-10-07T08:49:55.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.351+0000 7f93b27fc700 1 -- 172.21.15.81:0/1711057576 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+12097 (secure 0 0 0) 0x7f93b8055150 con 0x7f93bc06d120 2023-10-07T08:49:55.353 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:55.353 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":152,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:49:54.619141+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:49:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.353+0000 7f93c4519700 1 -- 172.21.15.81:0/1711057576 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93a0066f30 msgr2=0x7f93a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.353+0000 7f93c4519700 1 --2- 172.21.15.81:0/1711057576 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93a0066f30 0x7f93a00693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0b60e0 tx=0x7f93ac009040 comp rx=0 tx=0).stop 2023-10-07T08:49:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.353+0000 7f93c4519700 1 -- 172.21.15.81:0/1711057576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc06d120 msgr2=0x7f93bc0b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.353+0000 7f93c4519700 1 --2- 172.21.15.81:0/1711057576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc06d120 0x7f93bc0b5b80 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f93b800ec80 tx=0x7f93b80091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.353+0000 7f93c4519700 1 -- 172.21.15.81:0/1711057576 shutdown_connections 2023-10-07T08:49:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.353+0000 7f93c4519700 1 --2- 172.21.15.81:0/1711057576 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f93a0066f30 0x7f93a00693e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.353+0000 7f93c4519700 1 --2- 172.21.15.81:0/1711057576 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93bc157ca0 0x7f93bc159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.353+0000 7f93c4519700 1 --2- 172.21.15.81:0/1711057576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93bc06d120 0x7f93bc0b5b80 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.353+0000 7f93c4519700 1 --2- 172.21.15.81:0/1711057576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93bc1578d0 0x7f93bc0ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.353+0000 7f93c4519700 1 -- 172.21.15.81:0/1711057576 >> 172.21.15.81:0/1711057576 conn(0x7f93bc06bb90 msgr2=0x7f93bc1554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:55.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.354+0000 7f93c4519700 1 -- 172.21.15.81:0/1711057576 shutdown_connections 2023-10-07T08:49:55.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.354+0000 7f93c4519700 1 -- 172.21.15.81:0/1711057576 wait complete. 2023-10-07T08:49:55.367 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T08:49:55.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:49:55.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.483+0000 7fa12bfff700 1 Processor -- start 2023-10-07T08:49:55.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.483+0000 7fa12bfff700 1 -- start start 2023-10-07T08:49:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa12bfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa12c0d0b80 0x7fa12c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa12bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa12c0d02b0 0x7fa12c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa12bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa12c0d0f50 0x7fa12c06d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa12bfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12c15a690 con 0x7fa12c0d02b0 2023-10-07T08:49:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa12bfff700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12c0cf2d0 con 0x7fa12c0d0b80 2023-10-07T08:49:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa12bfff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c06dc00 con 0x7fa12c0d0f50 2023-10-07T08:49:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa1227fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa12c0d02b0 0x7fa12c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa1227fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa12c0d02b0 0x7fa12c06cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55326/0 (socket says 172.21.15.81:55326) 2023-10-07T08:49:55.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa1227fc700 1 -- 172.21.15.81:0/1651167662 learned_addr learned my addr 172.21.15.81:0/1651167662 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:55.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa12b7fe700 1 --2- 172.21.15.81:0/1651167662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa12c0d0f50 0x7fa12c06d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa1227fc700 1 -- 172.21.15.81:0/1651167662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa12c0d0f50 msgr2=0x7fa12c06d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:55.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa1227fc700 1 --2- 172.21.15.81:0/1651167662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa12c0d0f50 0x7fa12c06d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa1227fc700 1 -- 172.21.15.81:0/1651167662 >> v2:172.21.15.89:3300/0 conn(0x7fa12c0d0b80 msgr2=0x7fa12c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:55.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa1227fc700 1 --2- 172.21.15.81:0/1651167662 >> v2:172.21.15.89:3300/0 conn(0x7fa12c0d0b80 0x7fa12c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa1227fc700 1 -- 172.21.15.81:0/1651167662 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c0cf570 con 0x7fa12c0d02b0 2023-10-07T08:49:55.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa12b7fe700 1 --2- 172.21.15.81:0/1651167662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa12c0d0f50 0x7fa12c06d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:55.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.484+0000 7fa1227fc700 1 --2- 172.21.15.81:0/1651167662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c0d02b0 0x7fa12c06cff0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa12c06cd80 tx=0x7fa114009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffb2def8722386 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:55.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.485+0000 7fa12a7fc700 1 -- 172.21.15.81:0/1651167662 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11400b860 con 0x7fa12c0d02b0 2023-10-07T08:49:55.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.485+0000 7fa12a7fc700 1 -- 172.21.15.81:0/1651167662 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11400b9c0 con 0x7fa12c0d02b0 2023-10-07T08:49:55.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.485+0000 7fa12a7fc700 1 -- 172.21.15.81:0/1651167662 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11400bd60 con 0x7fa12c0d02b0 2023-10-07T08:49:55.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.485+0000 7fa12bfff700 1 -- 172.21.15.81:0/1651167662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c0d02b0 msgr2=0x7fa12c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.485+0000 7fa12bfff700 1 --2- 172.21.15.81:0/1651167662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c0d02b0 0x7fa12c06cff0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa12c06cd80 tx=0x7fa114009250 comp rx=0 tx=0).stop 2023-10-07T08:49:55.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.485+0000 7fa12bfff700 1 -- 172.21.15.81:0/1651167662 shutdown_connections 2023-10-07T08:49:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.485+0000 7fa12bfff700 1 --2- 172.21.15.81:0/1651167662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa12c0d0f50 0x7fa12c06d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.485+0000 7fa12bfff700 1 --2- 172.21.15.81:0/1651167662 >> v2:172.21.15.89:3300/0 conn(0x7fa12c0d0b80 0x7fa12c0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.485+0000 7fa12bfff700 1 --2- 172.21.15.81:0/1651167662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c0d02b0 0x7fa12c06cff0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.485+0000 7fa12bfff700 1 -- 172.21.15.81:0/1651167662 >> 172.21.15.81:0/1651167662 conn(0x7fa12c063230 msgr2=0x7fa12c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.485+0000 7fa12bfff700 1 -- 172.21.15.81:0/1651167662 shutdown_connections 2023-10-07T08:49:55.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.485+0000 7fa12bfff700 1 -- 172.21.15.81:0/1651167662 wait complete. 2023-10-07T08:49:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.486+0000 7fa12bfff700 1 Processor -- start 2023-10-07T08:49:55.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.486+0000 7fa12bfff700 1 -- start start 2023-10-07T08:49:55.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.487+0000 7fa12bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c0d02b0 0x7fa12c1476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.487+0000 7fa12bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa12c0d0b80 0x7fa12c0c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.487+0000 7fa12bfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa12c0d0f50 0x7fa12c0c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.487+0000 7fa12bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c147c30 con 0x7fa12c0d02b0 2023-10-07T08:49:55.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.487+0000 7fa12bfff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c15f680 con 0x7fa12c0d0f50 2023-10-07T08:49:55.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.487+0000 7fa12bfff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c15ea70 con 0x7fa12c0d0b80 2023-10-07T08:49:55.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.487+0000 7fa12affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c0d02b0 0x7fa12c1476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.487+0000 7fa12affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c0d02b0 0x7fa12c1476f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55332/0 (socket says 172.21.15.81:55332) 2023-10-07T08:49:55.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.487+0000 7fa12affd700 1 -- 172.21.15.81:0/3575678845 learned_addr learned my addr 172.21.15.81:0/3575678845 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.487+0000 7fa1227fc700 1 --2- 172.21.15.81:0/3575678845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa12c0d0b80 0x7fa12c0c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.487+0000 7fa12b7fe700 1 --2- 172.21.15.81:0/3575678845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa12c0d0f50 0x7fa12c0c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.487+0000 7fa12affd700 1 -- 172.21.15.81:0/3575678845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa12c0d0b80 msgr2=0x7fa12c0c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.487+0000 7fa12affd700 1 --2- 172.21.15.81:0/3575678845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa12c0d0b80 0x7fa12c0c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.487+0000 7fa12affd700 1 -- 172.21.15.81:0/3575678845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa12c0d0f50 msgr2=0x7fa12c0c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.487+0000 7fa12affd700 1 --2- 172.21.15.81:0/3575678845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa12c0d0f50 0x7fa12c0c6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.487+0000 7fa12affd700 1 -- 172.21.15.81:0/3575678845 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1140094f0 con 0x7fa12c0d02b0 2023-10-07T08:49:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.488+0000 7fa12affd700 1 --2- 172.21.15.81:0/3575678845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c0d02b0 0x7fa12c1476f0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00b810 tx=0x7fa11c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:55.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.488+0000 7fa1237fe700 1 -- 172.21.15.81:0/3575678845 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c00f5f0 con 0x7fa12c0d02b0 2023-10-07T08:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.488+0000 7fa1237fe700 1 -- 172.21.15.81:0/3575678845 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c00f770 con 0x7fa12c0d02b0 2023-10-07T08:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.488+0000 7fa12bfff700 1 -- 172.21.15.81:0/3575678845 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12c15ed50 con 0x7fa12c0d02b0 2023-10-07T08:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.488+0000 7fa1237fe700 1 -- 172.21.15.81:0/3575678845 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c00fb30 con 0x7fa12c0d02b0 2023-10-07T08:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.488+0000 7fa12bfff700 1 -- 172.21.15.81:0/3575678845 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12c15f310 con 0x7fa12c0d02b0 2023-10-07T08:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.489+0000 7fa12bfff700 1 -- 172.21.15.81:0/3575678845 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12c0676e0 con 0x7fa12c0d02b0 2023-10-07T08:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.489+0000 7fa1237fe700 1 -- 172.21.15.81:0/3575678845 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa11c010480 con 0x7fa12c0d02b0 2023-10-07T08:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.489+0000 7fa1237fe700 1 --2- 172.21.15.81:0/3575678845 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa10c066f30 0x7fa10c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.490+0000 7fa1227fc700 1 --2- 172.21.15.81:0/3575678845 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa10c066f30 0x7fa10c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.490+0000 7fa1237fe700 1 -- 172.21.15.81:0/3575678845 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa11c084140 con 0x7fa12c0d02b0 2023-10-07T08:49:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.490+0000 7fa1227fc700 1 --2- 172.21.15.81:0/3575678845 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa10c066f30 0x7fa10c0693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa12c06cd80 tx=0x7fa114017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.494+0000 7fa1237fe700 1 -- 172.21.15.81:0/3575678845 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa11c051780 con 0x7fa12c0d02b0 2023-10-07T08:49:55.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.678+0000 7fa12bfff700 1 -- 172.21.15.81:0/3575678845 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa12c0cf850 con 0x7fa12c0d02b0 2023-10-07T08:49:55.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.679+0000 7fa1237fe700 1 -- 172.21.15.81:0/3575678845 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v152) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa11c054da0 con 0x7fa12c0d02b0 2023-10-07T08:49:55.680 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:49:55.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.681+0000 7fa12bfff700 1 -- 172.21.15.81:0/3575678845 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa10c066f30 msgr2=0x7fa10c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.681+0000 7fa12bfff700 1 --2- 172.21.15.81:0/3575678845 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa10c066f30 0x7fa10c0693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa12c06cd80 tx=0x7fa114017000 comp rx=0 tx=0).stop 2023-10-07T08:49:55.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.681+0000 7fa12bfff700 1 -- 172.21.15.81:0/3575678845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c0d02b0 msgr2=0x7fa12c1476f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.681+0000 7fa12bfff700 1 --2- 172.21.15.81:0/3575678845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c0d02b0 0x7fa12c1476f0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00b810 tx=0x7fa11c009250 comp rx=0 tx=0).stop 2023-10-07T08:49:55.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.681+0000 7fa12bfff700 1 -- 172.21.15.81:0/3575678845 shutdown_connections 2023-10-07T08:49:55.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.681+0000 7fa12bfff700 1 --2- 172.21.15.81:0/3575678845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa12c0d0f50 0x7fa12c0c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.681+0000 7fa12bfff700 1 --2- 172.21.15.81:0/3575678845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c0d02b0 0x7fa12c1476f0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.681+0000 7fa12bfff700 1 --2- 172.21.15.81:0/3575678845 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa10c066f30 0x7fa10c0693e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.681+0000 7fa12bfff700 1 --2- 172.21.15.81:0/3575678845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa12c0d0b80 0x7fa12c0c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.681+0000 7fa12bfff700 1 -- 172.21.15.81:0/3575678845 >> 172.21.15.81:0/3575678845 conn(0x7fa12c063230 msgr2=0x7fa12c06d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:55.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.681+0000 7fa12bfff700 1 -- 172.21.15.81:0/3575678845 shutdown_connections 2023-10-07T08:49:55.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.681+0000 7fa12bfff700 1 -- 172.21.15.81:0/3575678845 wait complete. 2023-10-07T08:49:55.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T08:49:55.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.807+0000 7f4a2d666700 1 Processor -- start 2023-10-07T08:49:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.807+0000 7f4a2d666700 1 -- start start 2023-10-07T08:49:55.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.808+0000 7f4a2d666700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a28159b40 0x7f4a280cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.808+0000 7f4a2d666700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4a28068e90 0x7f4a280cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.808+0000 7f4a2d666700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a280cee10 con 0x7f4a28159f10 2023-10-07T08:49:55.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.808+0000 7f4a2d666700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a280cd040 con 0x7f4a28159b40 2023-10-07T08:49:55.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.808+0000 7f4a2d666700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a280cd320 con 0x7f4a28068e90 2023-10-07T08:49:55.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.808+0000 7f4a27fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a28159b40 0x7f4a280cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.808+0000 7f4a277fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4a28159f10 0x7f4a28068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33364/0 (socket says 172.21.15.81:33364) 2023-10-07T08:49:55.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.808+0000 7f4a277fe700 1 -- 172.21.15.81:0/2817538385 learned_addr learned my addr 172.21.15.81:0/2817538385 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:55.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.808+0000 7f4a2ce65700 1 --2- 172.21.15.81:0/2817538385 >> v2:172.21.15.89:3300/0 conn(0x7f4a28068e90 0x7f4a280cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.808+0000 7f4a27fff700 1 -- 172.21.15.81:0/2817538385 >> v2:172.21.15.89:3300/0 conn(0x7f4a28068e90 msgr2=0x7f4a280cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.808+0000 7f4a27fff700 1 --2- 172.21.15.81:0/2817538385 >> v2:172.21.15.89:3300/0 conn(0x7f4a28068e90 0x7f4a280cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.808+0000 7f4a27fff700 1 -- 172.21.15.81:0/2817538385 >> v1:172.21.15.81:6789/0 conn(0x7f4a28159f10 legacy=0x7f4a28068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.808+0000 7f4a27fff700 1 -- 172.21.15.81:0/2817538385 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a280ce7c0 con 0x7f4a28159b40 2023-10-07T08:49:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.808+0000 7f4a26ffd700 1 -- 172.21.15.81:0/2817538385 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676816824 0 0) 0x7f4a280cee10 con 0x7f4a28159f10 2023-10-07T08:49:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.808+0000 7f4a2ce65700 1 --2- 172.21.15.81:0/2817538385 >> v2:172.21.15.89:3300/0 conn(0x7f4a28068e90 0x7f4a280cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.809+0000 7f4a27fff700 1 --2- 172.21.15.81:0/2817538385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a28159b40 0x7f4a280cc600 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f4a280cae10 tx=0x7f4a180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941f7f03ef1c26a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.809+0000 7f4a26ffd700 1 -- 172.21.15.81:0/2817538385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800b6b0 con 0x7f4a28159b40 2023-10-07T08:49:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.809+0000 7f4a26ffd700 1 -- 172.21.15.81:0/2817538385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1800b810 con 0x7f4a28159b40 2023-10-07T08:49:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.809+0000 7f4a26ffd700 1 -- 172.21.15.81:0/2817538385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800bbb0 con 0x7f4a28159b40 2023-10-07T08:49:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.809+0000 7f4a2d666700 1 -- 172.21.15.81:0/2817538385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a28159b40 msgr2=0x7f4a280cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.809+0000 7f4a2d666700 1 --2- 172.21.15.81:0/2817538385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a28159b40 0x7f4a280cc600 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f4a280cae10 tx=0x7f4a180091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.809+0000 7f4a2d666700 1 -- 172.21.15.81:0/2817538385 shutdown_connections 2023-10-07T08:49:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.809+0000 7f4a2d666700 1 --2- 172.21.15.81:0/2817538385 >> v2:172.21.15.89:3300/0 conn(0x7f4a28068e90 0x7f4a280cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.809+0000 7f4a2d666700 1 --2- 172.21.15.81:0/2817538385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a28159b40 0x7f4a280cc600 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.809+0000 7f4a2d666700 1 -- 172.21.15.81:0/2817538385 >> 172.21.15.81:0/2817538385 conn(0x7f4a280cd660 msgr2=0x7f4a280cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.809+0000 7f4a2d666700 1 -- 172.21.15.81:0/2817538385 shutdown_connections 2023-10-07T08:49:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.809+0000 7f4a2d666700 1 -- 172.21.15.81:0/2817538385 wait complete. 2023-10-07T08:49:55.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:49:55.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.810+0000 7f4a2d666700 1 Processor -- start 2023-10-07T08:49:55.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.811+0000 7f4a2d666700 1 -- start start 2023-10-07T08:49:55.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.811+0000 7f4a2d666700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a28068e90 0x7f4a28154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.811+0000 7f4a2d666700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a28159b40 0x7f4a2815a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.811+0000 7f4a2d666700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a28159f10 0x7f4a2815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.811+0000 7f4a2d666700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280c8c70 con 0x7f4a28068e90 2023-10-07T08:49:55.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.811+0000 7f4a2d666700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280c97b0 con 0x7f4a28159f10 2023-10-07T08:49:55.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.811+0000 7f4a2d666700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280c8e80 con 0x7f4a28159b40 2023-10-07T08:49:55.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.811+0000 7f4a27fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a28068e90 0x7f4a28154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.811+0000 7f4a27fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a28068e90 0x7f4a28154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55352/0 (socket says 172.21.15.81:55352) 2023-10-07T08:49:55.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.811+0000 7f4a27fff700 1 -- 172.21.15.81:0/2321200338 learned_addr learned my addr 172.21.15.81:0/2321200338 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:55.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.812+0000 7f4a2ce65700 1 --2- 172.21.15.81:0/2321200338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a28159f10 0x7f4a2815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.812+0000 7f4a277fe700 1 --2- 172.21.15.81:0/2321200338 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a28159b40 0x7f4a2815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.812+0000 7f4a27fff700 1 -- 172.21.15.81:0/2321200338 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a28159b40 msgr2=0x7f4a2815a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.812+0000 7f4a27fff700 1 --2- 172.21.15.81:0/2321200338 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a28159b40 0x7f4a2815a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.812+0000 7f4a27fff700 1 -- 172.21.15.81:0/2321200338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a28159f10 msgr2=0x7f4a2815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:55.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.812+0000 7f4a27fff700 1 --2- 172.21.15.81:0/2321200338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a28159f10 0x7f4a2815cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:55.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.812+0000 7f4a27fff700 1 -- 172.21.15.81:0/2321200338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a18009420 con 0x7f4a28068e90 2023-10-07T08:49:55.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.812+0000 7f4a277fe700 1 --2- 172.21.15.81:0/2321200338 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a28159b40 0x7f4a2815a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:49:55.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.812+0000 7f4a27fff700 1 --2- 172.21.15.81:0/2321200338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a28068e90 0x7f4a28154c20 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f4a2806fe10 tx=0x7f4a18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:55.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.812+0000 7f4a0ffff700 1 -- 172.21.15.81:0/2321200338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18011420 con 0x7f4a28068e90 2023-10-07T08:49:55.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.812+0000 7f4a0ffff700 1 -- 172.21.15.81:0/2321200338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a18011580 con 0x7f4a28068e90 2023-10-07T08:49:55.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.812+0000 7f4a2d666700 1 -- 172.21.15.81:0/2321200338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a280c9160 con 0x7f4a28068e90 2023-10-07T08:49:55.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.812+0000 7f4a0ffff700 1 -- 172.21.15.81:0/2321200338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18011920 con 0x7f4a28068e90 2023-10-07T08:49:55.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.812+0000 7f4a2d666700 1 -- 172.21.15.81:0/2321200338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a28155160 con 0x7f4a28068e90 2023-10-07T08:49:55.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.813+0000 7f4a2d666700 1 -- 172.21.15.81:0/2321200338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a280cb890 con 0x7f4a28068e90 2023-10-07T08:49:55.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.813+0000 7f4a0ffff700 1 -- 172.21.15.81:0/2321200338 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a18011d10 con 0x7f4a28068e90 2023-10-07T08:49:55.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.814+0000 7f4a0ffff700 1 --2- 172.21.15.81:0/2321200338 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a14066f30 0x7f4a140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:55.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.814+0000 7f4a277fe700 1 --2- 172.21.15.81:0/2321200338 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a14066f30 0x7f4a140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:55.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.814+0000 7f4a0ffff700 1 -- 172.21.15.81:0/2321200338 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4a18085d40 con 0x7f4a28068e90 2023-10-07T08:49:55.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.814+0000 7f4a277fe700 1 --2- 172.21.15.81:0/2321200338 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a14066f30 0x7f4a140693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4a280cc250 tx=0x7f4a1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:55.819 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:49:55.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:55.818+0000 7f4a0ffff700 1 -- 172.21.15.81:0/2321200338 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a18053380 con 0x7f4a28068e90 2023-10-07T08:49:56.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.011+0000 7f4a2d666700 1 -- 172.21.15.81:0/2321200338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4a28071b10 con 0x7f4a28068e90 2023-10-07T08:49:56.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.012+0000 7f4a0ffff700 1 -- 172.21.15.81:0/2321200338 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v152) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4a180569a0 con 0x7f4a28068e90 2023-10-07T08:49:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:56.013 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-07T08:49:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:49:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-07T08:49:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-07T08:49:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:49:56.014 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-07T08:49:56.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.013+0000 7f4a2d666700 1 -- 172.21.15.81:0/2321200338 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a14066f30 msgr2=0x7f4a140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:56.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.013+0000 7f4a2d666700 1 --2- 172.21.15.81:0/2321200338 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a14066f30 0x7f4a140693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4a280cc250 tx=0x7f4a1c009040 comp rx=0 tx=0).stop 2023-10-07T08:49:56.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.013+0000 7f4a2d666700 1 -- 172.21.15.81:0/2321200338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a28068e90 msgr2=0x7f4a28154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:56.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.013+0000 7f4a2d666700 1 --2- 172.21.15.81:0/2321200338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a28068e90 0x7f4a28154c20 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f4a2806fe10 tx=0x7f4a18017000 comp rx=0 tx=0).stop 2023-10-07T08:49:56.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.013+0000 7f4a2d666700 1 -- 172.21.15.81:0/2321200338 shutdown_connections 2023-10-07T08:49:56.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.013+0000 7f4a2d666700 1 --2- 172.21.15.81:0/2321200338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a28159f10 0x7f4a2815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.013+0000 7f4a2d666700 1 --2- 172.21.15.81:0/2321200338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a28068e90 0x7f4a28154c20 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.013+0000 7f4a2d666700 1 --2- 172.21.15.81:0/2321200338 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a14066f30 0x7f4a140693e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.013+0000 7f4a2d666700 1 --2- 172.21.15.81:0/2321200338 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a28159b40 0x7f4a2815a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.013+0000 7f4a2d666700 1 -- 172.21.15.81:0/2321200338 >> 172.21.15.81:0/2321200338 conn(0x7f4a280cd660 msgr2=0x7f4a280b2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.014+0000 7f4a2d666700 1 -- 172.21.15.81:0/2321200338 shutdown_connections 2023-10-07T08:49:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.014+0000 7f4a2d666700 1 -- 172.21.15.81:0/2321200338 wait complete. 2023-10-07T08:49:56.027 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T08:49:56.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T08:49:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.144+0000 7f566dfb0700 1 Processor -- start 2023-10-07T08:49:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.144+0000 7f566dfb0700 1 -- start start 2023-10-07T08:49:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f566dfb0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56680d0b80 0x7f56680cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f566dfb0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f56680d02b0 0x7f566806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f566dfb0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56680cf2d0 con 0x7f56680d0f50 2023-10-07T08:49:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f566dfb0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566815a690 con 0x7f56680d02b0 2023-10-07T08:49:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f566dfb0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566806dc00 con 0x7f56680d0b80 2023-10-07T08:49:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f566d7af700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f56680d0f50 0x7f566815b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33378/0 (socket says 172.21.15.81:33378) 2023-10-07T08:49:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f566d7af700 1 -- 172.21.15.81:0/155691770 learned_addr learned my addr 172.21.15.81:0/155691770 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f5667fff700 1 --2- 172.21.15.81:0/155691770 >> v2:172.21.15.89:3300/0 conn(0x7f56680d02b0 0x7f566806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f566cfae700 1 --2- 172.21.15.81:0/155691770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56680d0b80 0x7f56680cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f56677fe700 1 -- 172.21.15.81:0/155691770 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159989104 0 0) 0x7f56680cf2d0 con 0x7f56680d0f50 2023-10-07T08:49:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f56677fe700 1 -- 172.21.15.81:0/155691770 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5658003570 con 0x7f56680d0f50 2023-10-07T08:49:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f56677fe700 1 -- 172.21.15.81:0/155691770 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2703783848 0 0) 0x7f5658003570 con 0x7f56680d0f50 2023-10-07T08:49:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f56677fe700 1 -- 172.21.15.81:0/155691770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56680d0b80 msgr2=0x7f56680cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f56677fe700 1 --2- 172.21.15.81:0/155691770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56680d0b80 0x7f56680cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f56677fe700 1 -- 172.21.15.81:0/155691770 >> v2:172.21.15.89:3300/0 conn(0x7f56680d02b0 msgr2=0x7f566806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f56677fe700 1 --2- 172.21.15.81:0/155691770 >> v2:172.21.15.89:3300/0 conn(0x7f56680d02b0 0x7f566806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f56677fe700 1 -- 172.21.15.81:0/155691770 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56680cf570 con 0x7f56680d0f50 2023-10-07T08:49:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.145+0000 7f56677fe700 1 -- 172.21.15.81:0/155691770 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f56600017f0 con 0x7f56680d0f50 2023-10-07T08:49:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f56677fe700 1 -- 172.21.15.81:0/155691770 >> v1:172.21.15.81:6789/0 conn(0x7f56680d0f50 legacy=0x7f566815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f56677fe700 1 --2- 172.21.15.81:0/155691770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658003a60 0x7f5658003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f56677fe700 1 --2- 172.21.15.81:0/155691770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5658004810 0x7f5658004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f56677fe700 1 --2- 172.21.15.81:0/155691770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56580051c0 0x7f565800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f56677fe700 1 -- 172.21.15.81:0/155691770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566815a690 con 0x7f5658004810 2023-10-07T08:49:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f56677fe700 1 -- 172.21.15.81:0/155691770 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566806dc00 con 0x7f5658003a60 2023-10-07T08:49:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f56677fe700 1 -- 172.21.15.81:0/155691770 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565800bfa0 con 0x7f56580051c0 2023-10-07T08:49:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f566cfae700 1 --2- 172.21.15.81:0/155691770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56680d0b80 0x7f56680cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:49:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f5667fff700 1 --2- 172.21.15.81:0/155691770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5658004810 0x7f5658004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f566d7af700 1 --2- 172.21.15.81:0/155691770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56580051c0 0x7f565800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f566cfae700 1 --2- 172.21.15.81:0/155691770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658003a60 0x7f5658003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f5667fff700 1 -- 172.21.15.81:0/155691770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56580051c0 msgr2=0x7f565800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f5667fff700 1 --2- 172.21.15.81:0/155691770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56580051c0 0x7f565800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f5667fff700 1 -- 172.21.15.81:0/155691770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658003a60 msgr2=0x7f5658003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f5667fff700 1 --2- 172.21.15.81:0/155691770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658003a60 0x7f5658003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f5667fff700 1 -- 172.21.15.81:0/155691770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5658003570 con 0x7f5658004810 2023-10-07T08:49:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f5667fff700 1 --2- 172.21.15.81:0/155691770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5658004810 0x7f5658004c80 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f5654009c00 tx=0x7f56540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472f8199e310a16 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f56677fe700 1 -- 172.21.15.81:0/155691770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565400e710 con 0x7f5658004810 2023-10-07T08:49:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f56677fe700 1 -- 172.21.15.81:0/155691770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565400e870 con 0x7f5658004810 2023-10-07T08:49:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.146+0000 7f56677fe700 1 -- 172.21.15.81:0/155691770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565400ec30 con 0x7f5658004810 2023-10-07T08:49:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.147+0000 7f566dfb0700 1 -- 172.21.15.81:0/155691770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5658004810 msgr2=0x7f5658004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.147+0000 7f566dfb0700 1 --2- 172.21.15.81:0/155691770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5658004810 0x7f5658004c80 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f5654009c00 tx=0x7f56540091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.147+0000 7f566d7af700 1 -- 172.21.15.81:0/155691770 reap_dead start 2023-10-07T08:49:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.147+0000 7f566dfb0700 1 -- 172.21.15.81:0/155691770 shutdown_connections 2023-10-07T08:49:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.147+0000 7f566dfb0700 1 -- 172.21.15.81:0/155691770 >> 172.21.15.81:0/155691770 conn(0x7f5668063230 msgr2=0x7f5668063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.147+0000 7f566dfb0700 1 -- 172.21.15.81:0/155691770 shutdown_connections 2023-10-07T08:49:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.147+0000 7f566dfb0700 1 -- 172.21.15.81:0/155691770 wait complete. 2023-10-07T08:49:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.148+0000 7f566dfb0700 1 Processor -- start 2023-10-07T08:49:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.148+0000 7f566dfb0700 1 -- start start 2023-10-07T08:49:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566dfb0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658004810 0x7f56681505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566dfb0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f566814fe30 0x7f566815f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566dfb0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566816a4b0 0x7f566816a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566dfb0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5668150ee0 con 0x7f566816a4b0 2023-10-07T08:49:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566dfb0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56681604c0 con 0x7f5658004810 2023-10-07T08:49:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566dfb0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566816ae90 con 0x7f566814fe30 2023-10-07T08:49:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566d7af700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566816a4b0 0x7f566816a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566d7af700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566816a4b0 0x7f566816a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55372/0 (socket says 172.21.15.81:55372) 2023-10-07T08:49:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566d7af700 1 -- 172.21.15.81:0/1117463377 learned_addr learned my addr 172.21.15.81:0/1117463377 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566cfae700 1 --2- 172.21.15.81:0/1117463377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658004810 0x7f56681505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f5667fff700 1 --2- 172.21.15.81:0/1117463377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f566814fe30 0x7f566815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566d7af700 1 -- 172.21.15.81:0/1117463377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f566814fe30 msgr2=0x7f566815f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566d7af700 1 --2- 172.21.15.81:0/1117463377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f566814fe30 0x7f566815f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566d7af700 1 -- 172.21.15.81:0/1117463377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658004810 msgr2=0x7f56681505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566d7af700 1 --2- 172.21.15.81:0/1117463377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658004810 0x7f56681505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566d7af700 1 -- 172.21.15.81:0/1117463377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566815f8b0 con 0x7f566816a4b0 2023-10-07T08:49:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566d7af700 1 --2- 172.21.15.81:0/1117463377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566816a4b0 0x7f566816a950 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f56680cece0 tx=0x7f56680cf460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f5664ff9700 1 -- 172.21.15.81:0/1117463377 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566000ad00 con 0x7f566816a4b0 2023-10-07T08:49:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f5664ff9700 1 -- 172.21.15.81:0/1117463377 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566000ae60 con 0x7f566816a4b0 2023-10-07T08:49:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566dfb0700 1 -- 172.21.15.81:0/1117463377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566815fb90 con 0x7f566816a4b0 2023-10-07T08:49:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f5664ff9700 1 -- 172.21.15.81:0/1117463377 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660013620 con 0x7f566816a4b0 2023-10-07T08:49:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.149+0000 7f566dfb0700 1 -- 172.21.15.81:0/1117463377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5668160150 con 0x7f566816a4b0 2023-10-07T08:49:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.150+0000 7f566dfb0700 1 -- 172.21.15.81:0/1117463377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56680676e0 con 0x7f566816a4b0 2023-10-07T08:49:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.151+0000 7f5664ff9700 1 -- 172.21.15.81:0/1117463377 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f56600139d0 con 0x7f566816a4b0 2023-10-07T08:49:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.151+0000 7f5664ff9700 1 --2- 172.21.15.81:0/1117463377 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f564c066f30 0x7f564c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.151+0000 7f5664ff9700 1 -- 172.21.15.81:0/1117463377 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5660084b00 con 0x7f566816a4b0 2023-10-07T08:49:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.151+0000 7f566cfae700 1 --2- 172.21.15.81:0/1117463377 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f564c066f30 0x7f564c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.152+0000 7f566cfae700 1 --2- 172.21.15.81:0/1117463377 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f564c066f30 0x7f564c0693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f566806cd80 tx=0x7f565c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:56.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.155+0000 7f5664ff9700 1 -- 172.21.15.81:0/1117463377 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56600520c0 con 0x7f566816a4b0 2023-10-07T08:49:56.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.338+0000 7f566dfb0700 1 -- 172.21.15.81:0/1117463377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5668160600 con 0x7f566816a4b0 2023-10-07T08:49:56.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.632+0000 7f5664ff9700 1 -- 172.21.15.81:0/1117463377 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v153) v1 ==== 138+0+0 (secure 0 0 0) 0x7f56600556e0 con 0x7f566816a4b0 2023-10-07T08:49:56.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.637+0000 7f566dfb0700 1 -- 172.21.15.81:0/1117463377 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f564c066f30 msgr2=0x7f564c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.637+0000 7f566dfb0700 1 --2- 172.21.15.81:0/1117463377 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f564c066f30 0x7f564c0693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f566806cd80 tx=0x7f565c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.637+0000 7f566dfb0700 1 -- 172.21.15.81:0/1117463377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566816a4b0 msgr2=0x7f566816a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.637+0000 7f566dfb0700 1 --2- 172.21.15.81:0/1117463377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566816a4b0 0x7f566816a950 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f56680cece0 tx=0x7f56680cf460 comp rx=0 tx=0).stop 2023-10-07T08:49:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.637+0000 7f566dfb0700 1 -- 172.21.15.81:0/1117463377 shutdown_connections 2023-10-07T08:49:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.637+0000 7f566dfb0700 1 --2- 172.21.15.81:0/1117463377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566816a4b0 0x7f566816a950 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.637+0000 7f566dfb0700 1 --2- 172.21.15.81:0/1117463377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658004810 0x7f56681505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.637+0000 7f566dfb0700 1 --2- 172.21.15.81:0/1117463377 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f564c066f30 0x7f564c0693e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.637+0000 7f566dfb0700 1 --2- 172.21.15.81:0/1117463377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f566814fe30 0x7f566815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.637+0000 7f566dfb0700 1 -- 172.21.15.81:0/1117463377 >> 172.21.15.81:0/1117463377 conn(0x7f5668063230 msgr2=0x7f56680b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.637+0000 7f566dfb0700 1 -- 172.21.15.81:0/1117463377 shutdown_connections 2023-10-07T08:49:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.637+0000 7f566dfb0700 1 -- 172.21.15.81:0/1117463377 wait complete. 2023-10-07T08:49:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-07T08:49:56.650 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T08:49:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.770+0000 7f28408a4700 1 Processor -- start 2023-10-07T08:49:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.770+0000 7f28408a4700 1 -- start start 2023-10-07T08:49:56.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.771+0000 7f28408a4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f283c068f20 0x7f283c0cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:56.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.771+0000 7f28408a4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f283c157b90 0x7f283c0cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:56.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.771+0000 7f28408a4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f283c0cca80 con 0x7f283c1577c0 2023-10-07T08:49:56.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.771+0000 7f28408a4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f283c0cedd0 con 0x7f283c068f20 2023-10-07T08:49:56.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.771+0000 7f28408a4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283c0cc210 con 0x7f283c157b90 2023-10-07T08:49:56.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.771+0000 7f2839d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f283c068f20 0x7f283c0cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:56.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.771+0000 7f283a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f283c1577c0 0x7f283c068810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33380/0 (socket says 172.21.15.81:33380) 2023-10-07T08:49:56.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.771+0000 7f283a59c700 1 -- 172.21.15.81:0/614638242 learned_addr learned my addr 172.21.15.81:0/614638242 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:56.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.771+0000 7f283ad9d700 1 --2- 172.21.15.81:0/614638242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f283c157b90 0x7f283c0cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:56.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.771+0000 7f2839d9b700 1 -- 172.21.15.81:0/614638242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f283c157b90 msgr2=0x7f283c0cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:56.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.771+0000 7f2839d9b700 1 --2- 172.21.15.81:0/614638242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f283c157b90 0x7f283c0cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.771+0000 7f2839d9b700 1 -- 172.21.15.81:0/614638242 >> v1:172.21.15.81:6789/0 conn(0x7f283c1577c0 legacy=0x7f283c068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.771+0000 7f283959a700 1 -- 172.21.15.81:0/614638242 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038832608 0 0) 0x7f283c0cca80 con 0x7f283c1577c0 2023-10-07T08:49:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.771+0000 7f2839d9b700 1 -- 172.21.15.81:0/614638242 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c0cc4c0 con 0x7f283c068f20 2023-10-07T08:49:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.772+0000 7f2839d9b700 1 --2- 172.21.15.81:0/614638242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c068f20 0x7f283c0cb790 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f28300098e0 tx=0x7f28300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c32673f1168cc70 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.772+0000 7f283959a700 1 -- 172.21.15.81:0/614638242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830009e80 con 0x7f283c068f20 2023-10-07T08:49:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.772+0000 7f283959a700 1 -- 172.21.15.81:0/614638242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283000b860 con 0x7f283c068f20 2023-10-07T08:49:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.772+0000 7f283959a700 1 -- 172.21.15.81:0/614638242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283000bbe0 con 0x7f283c068f20 2023-10-07T08:49:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.772+0000 7f28408a4700 1 -- 172.21.15.81:0/614638242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c068f20 msgr2=0x7f283c0cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.772+0000 7f28408a4700 1 --2- 172.21.15.81:0/614638242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c068f20 0x7f283c0cb790 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f28300098e0 tx=0x7f28300091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.772+0000 7f28408a4700 1 -- 172.21.15.81:0/614638242 shutdown_connections 2023-10-07T08:49:56.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.772+0000 7f28408a4700 1 --2- 172.21.15.81:0/614638242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f283c157b90 0x7f283c0cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.772+0000 7f28408a4700 1 --2- 172.21.15.81:0/614638242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c068f20 0x7f283c0cb790 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.772+0000 7f28408a4700 1 -- 172.21.15.81:0/614638242 >> 172.21.15.81:0/614638242 conn(0x7f283c0d0df0 msgr2=0x7f283c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:56.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.772+0000 7f28408a4700 1 -- 172.21.15.81:0/614638242 shutdown_connections 2023-10-07T08:49:56.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.772+0000 7f28408a4700 1 -- 172.21.15.81:0/614638242 wait complete. 2023-10-07T08:49:56.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.773+0000 7f28408a4700 1 Processor -- start 2023-10-07T08:49:56.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.773+0000 7f28408a4700 1 -- start start 2023-10-07T08:49:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.774+0000 7f28408a4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f283c068f20 0x7f283c1498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.774+0000 7f28408a4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f283c1577c0 0x7f283c06e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.774+0000 7f28408a4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c157b90 0x7f283c06e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.774+0000 7f28408a4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c16e3f0 con 0x7f283c157b90 2023-10-07T08:49:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.774+0000 7f28408a4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c15a280 con 0x7f283c1577c0 2023-10-07T08:49:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.774+0000 7f28408a4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283c16dac0 con 0x7f283c068f20 2023-10-07T08:49:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.774+0000 7f283ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c157b90 0x7f283c06e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.774+0000 7f283ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c157b90 0x7f283c06e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55396/0 (socket says 172.21.15.81:55396) 2023-10-07T08:49:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.774+0000 7f283ad9d700 1 -- 172.21.15.81:0/3367555575 learned_addr learned my addr 172.21.15.81:0/3367555575 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.774+0000 7f283a59c700 1 --2- 172.21.15.81:0/3367555575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f283c068f20 0x7f283c1498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:56.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.774+0000 7f2839d9b700 1 --2- 172.21.15.81:0/3367555575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f283c1577c0 0x7f283c06e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:56.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.774+0000 7f283ad9d700 1 -- 172.21.15.81:0/3367555575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f283c068f20 msgr2=0x7f283c1498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:56.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.774+0000 7f283ad9d700 1 --2- 172.21.15.81:0/3367555575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f283c068f20 0x7f283c1498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.774+0000 7f283ad9d700 1 -- 172.21.15.81:0/3367555575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f283c1577c0 msgr2=0x7f283c06e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:56.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.774+0000 7f283ad9d700 1 --2- 172.21.15.81:0/3367555575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f283c1577c0 0x7f283c06e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:56.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.775+0000 7f283ad9d700 1 -- 172.21.15.81:0/3367555575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2830009420 con 0x7f283c157b90 2023-10-07T08:49:56.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.775+0000 7f283ad9d700 1 --2- 172.21.15.81:0/3367555575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c157b90 0x7f283c06e5b0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f2834007f20 tx=0x7f2834009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:56.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.775+0000 7f282a7fc700 1 -- 172.21.15.81:0/3367555575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283400eb90 con 0x7f283c157b90 2023-10-07T08:49:56.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.775+0000 7f282a7fc700 1 -- 172.21.15.81:0/3367555575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283400ed10 con 0x7f283c157b90 2023-10-07T08:49:56.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.775+0000 7f28408a4700 1 -- 172.21.15.81:0/3367555575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283c16dda0 con 0x7f283c157b90 2023-10-07T08:49:56.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.775+0000 7f282a7fc700 1 -- 172.21.15.81:0/3367555575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2834014670 con 0x7f283c157b90 2023-10-07T08:49:56.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.775+0000 7f28408a4700 1 -- 172.21.15.81:0/3367555575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283c16e880 con 0x7f283c157b90 2023-10-07T08:49:56.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.776+0000 7f28408a4700 1 -- 172.21.15.81:0/3367555575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283c06f9b0 con 0x7f283c157b90 2023-10-07T08:49:56.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.776+0000 7f282a7fc700 1 -- 172.21.15.81:0/3367555575 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28340149e0 con 0x7f283c157b90 2023-10-07T08:49:56.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.776+0000 7f282a7fc700 1 --2- 172.21.15.81:0/3367555575 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f281c066f30 0x7f281c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:56.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.777+0000 7f282a7fc700 1 -- 172.21.15.81:0/3367555575 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f2834084950 con 0x7f283c157b90 2023-10-07T08:49:56.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.777+0000 7f283a59c700 1 --2- 172.21.15.81:0/3367555575 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f281c066f30 0x7f281c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:56.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.777+0000 7f283a59c700 1 --2- 172.21.15.81:0/3367555575 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f281c066f30 0x7f281c0693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f282c007fd0 tx=0x7f282c007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:56.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.781+0000 7f282a7fc700 1 -- 172.21.15.81:0/3367555575 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2834051da0 con 0x7f283c157b90 2023-10-07T08:49:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:56.962+0000 7f28408a4700 1 -- 172.21.15.81:0/3367555575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f283c16e530 con 0x7f283c157b90 2023-10-07T08:49:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.640+0000 7f282a7fc700 1 -- 172.21.15.81:0/3367555575 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v154) v1 ==== 170+0+0 (secure 0 0 0) 0x7f28340553c0 con 0x7f283c157b90 2023-10-07T08:49:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.646+0000 7f28408a4700 1 -- 172.21.15.81:0/3367555575 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f281c066f30 msgr2=0x7f281c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.646+0000 7f28408a4700 1 --2- 172.21.15.81:0/3367555575 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f281c066f30 0x7f281c0693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f282c007fd0 tx=0x7f282c007d30 comp rx=0 tx=0).stop 2023-10-07T08:49:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.646+0000 7f28408a4700 1 -- 172.21.15.81:0/3367555575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c157b90 msgr2=0x7f283c06e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.646+0000 7f28408a4700 1 --2- 172.21.15.81:0/3367555575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c157b90 0x7f283c06e5b0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f2834007f20 tx=0x7f2834009860 comp rx=0 tx=0).stop 2023-10-07T08:49:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.648+0000 7f28408a4700 1 -- 172.21.15.81:0/3367555575 shutdown_connections 2023-10-07T08:49:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.648+0000 7f28408a4700 1 --2- 172.21.15.81:0/3367555575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c157b90 0x7f283c06e5b0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.648+0000 7f28408a4700 1 --2- 172.21.15.81:0/3367555575 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f281c066f30 0x7f281c0693e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.648+0000 7f28408a4700 1 --2- 172.21.15.81:0/3367555575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f283c068f20 0x7f283c1498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.648+0000 7f28408a4700 1 --2- 172.21.15.81:0/3367555575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f283c1577c0 0x7f283c06e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.648+0000 7f28408a4700 1 -- 172.21.15.81:0/3367555575 >> 172.21.15.81:0/3367555575 conn(0x7f283c0d0df0 msgr2=0x7f283c15aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:57.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.650+0000 7f28408a4700 1 -- 172.21.15.81:0/3367555575 shutdown_connections 2023-10-07T08:49:57.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.650+0000 7f28408a4700 1 -- 172.21.15.81:0/3367555575 wait complete. 2023-10-07T08:49:57.653 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-07T08:49:57.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T08:49:57.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.785+0000 7f80ba948700 1 Processor -- start 2023-10-07T08:49:57.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.785+0000 7f80ba948700 1 -- start start 2023-10-07T08:49:57.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.786+0000 7f80ba948700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f80b41578d0 0x7f80b40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:57.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.786+0000 7f80ba948700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b40d07c0 con 0x7f80b406d120 2023-10-07T08:49:57.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.786+0000 7f80ba948700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b40cfbb0 con 0x7f80b4157ca0 2023-10-07T08:49:57.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.786+0000 7f80ba948700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b40cfe90 con 0x7f80b41578d0 2023-10-07T08:49:57.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.786+0000 7f80b8ee5700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f80b406d120 0x7f80b406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33390/0 (socket says 172.21.15.81:33390) 2023-10-07T08:49:57.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.786+0000 7f80b8ee5700 1 -- 172.21.15.81:0/1622888356 learned_addr learned my addr 172.21.15.81:0/1622888356 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:57.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1622888356 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833904763 0 0) 0x7f80b40d07c0 con 0x7f80b406d120 2023-10-07T08:49:57.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b3fff700 1 --2- 172.21.15.81:0/1622888356 >> v2:172.21.15.89:3300/0 conn(0x7f80b41578d0 0x7f80b40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:57.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1622888356 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f809c003570 con 0x7f80b406d120 2023-10-07T08:49:57.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1622888356 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 533963454 0 0) 0x7f809c003570 con 0x7f80b406d120 2023-10-07T08:49:57.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1622888356 >> v2:172.21.15.89:3300/0 conn(0x7f80b41578d0 msgr2=0x7f80b40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:57.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b2ffd700 1 --2- 172.21.15.81:0/1622888356 >> v2:172.21.15.89:3300/0 conn(0x7f80b41578d0 0x7f80b40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:57.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1622888356 >> v1:172.21.15.89:6789/0 conn(0x7f80b4157ca0 legacy=0x7f80b415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:57.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1622888356 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b40d0170 con 0x7f80b406d120 2023-10-07T08:49:57.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1622888356 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f80ac0017f0 con 0x7f80b406d120 2023-10-07T08:49:57.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1622888356 >> v1:172.21.15.81:6789/0 conn(0x7f80b406d120 legacy=0x7f80b406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:57.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b2ffd700 1 --2- 172.21.15.81:0/1622888356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c003a60 0x7f809c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b2ffd700 1 --2- 172.21.15.81:0/1622888356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f809c004810 0x7f809c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b2ffd700 1 --2- 172.21.15.81:0/1622888356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f809c0051c0 0x7f809c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1622888356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40cfe90 con 0x7f809c003a60 2023-10-07T08:49:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1622888356 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c00c0d0 con 0x7f809c0051c0 2023-10-07T08:49:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1622888356 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809c00c290 con 0x7f809c004810 2023-10-07T08:49:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b3fff700 1 --2- 172.21.15.81:0/1622888356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c003a60 0x7f809c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b8ee5700 1 --2- 172.21.15.81:0/1622888356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f809c0051c0 0x7f809c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b37fe700 1 --2- 172.21.15.81:0/1622888356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f809c004810 0x7f809c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b3fff700 1 -- 172.21.15.81:0/1622888356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f809c004810 msgr2=0x7f809c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b3fff700 1 --2- 172.21.15.81:0/1622888356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f809c004810 0x7f809c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b3fff700 1 -- 172.21.15.81:0/1622888356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f809c0051c0 msgr2=0x7f809c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b3fff700 1 --2- 172.21.15.81:0/1622888356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f809c0051c0 0x7f809c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b8ee5700 1 -- 172.21.15.81:0/1622888356 reap_dead start 2023-10-07T08:49:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b3fff700 1 -- 172.21.15.81:0/1622888356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c003570 con 0x7f809c003a60 2023-10-07T08:49:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b37fe700 1 --2- 172.21.15.81:0/1622888356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f809c004810 0x7f809c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:57.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.787+0000 7f80b3fff700 1 --2- 172.21.15.81:0/1622888356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c003a60 0x7f809c003e70 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009c00 tx=0x7f80a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bc4814a352abaa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:57.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.788+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1622888356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a400e710 con 0x7f809c003a60 2023-10-07T08:49:57.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.788+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1622888356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a400e870 con 0x7f809c003a60 2023-10-07T08:49:57.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.788+0000 7f80b2ffd700 1 -- 172.21.15.81:0/1622888356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a400ec30 con 0x7f809c003a60 2023-10-07T08:49:57.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.788+0000 7f80ba948700 1 -- 172.21.15.81:0/1622888356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c003a60 msgr2=0x7f809c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:57.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.788+0000 7f80ba948700 1 --2- 172.21.15.81:0/1622888356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c003a60 0x7f809c003e70 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009c00 tx=0x7f80a40091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:57.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.788+0000 7f80ba948700 1 -- 172.21.15.81:0/1622888356 shutdown_connections 2023-10-07T08:49:57.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.788+0000 7f80ba948700 1 --2- 172.21.15.81:0/1622888356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c003a60 0x7f809c003e70 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:57.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.788+0000 7f80ba948700 1 -- 172.21.15.81:0/1622888356 >> 172.21.15.81:0/1622888356 conn(0x7f80b406bb90 msgr2=0x7f80b406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:57.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.788+0000 7f80ba948700 1 -- 172.21.15.81:0/1622888356 shutdown_connections 2023-10-07T08:49:57.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.788+0000 7f80ba948700 1 -- 172.21.15.81:0/1622888356 wait complete. 2023-10-07T08:49:57.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.789+0000 7f80ba948700 1 Processor -- start 2023-10-07T08:49:57.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.789+0000 7f80ba948700 1 -- start start 2023-10-07T08:49:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.790+0000 7f80ba948700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c003a60 0x7f80b40b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.790+0000 7f80ba948700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80b416b420 0x7f80b40cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.790+0000 7f80ba948700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80b4069cf0 0x7f80b406a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.790+0000 7f80ba948700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b406a6d0 con 0x7f809c003a60 2023-10-07T08:49:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.790+0000 7f80ba948700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40b4180 con 0x7f80b416b420 2023-10-07T08:49:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.790+0000 7f80ba948700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40b4460 con 0x7f80b4069cf0 2023-10-07T08:49:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.790+0000 7f80b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c003a60 0x7f80b40b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.790+0000 7f80b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c003a60 0x7f80b40b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55416/0 (socket says 172.21.15.81:55416) 2023-10-07T08:49:57.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.790+0000 7f80b3fff700 1 -- 172.21.15.81:0/1215249335 learned_addr learned my addr 172.21.15.81:0/1215249335 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:57.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.790+0000 7f80b8ee5700 1 --2- 172.21.15.81:0/1215249335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80b4069cf0 0x7f80b406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:57.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.790+0000 7f80b37fe700 1 --2- 172.21.15.81:0/1215249335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80b416b420 0x7f80b40cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:57.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.790+0000 7f80b3fff700 1 -- 172.21.15.81:0/1215249335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80b4069cf0 msgr2=0x7f80b406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:57.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.790+0000 7f80b3fff700 1 --2- 172.21.15.81:0/1215249335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80b4069cf0 0x7f80b406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:57.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.790+0000 7f80b3fff700 1 -- 172.21.15.81:0/1215249335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80b416b420 msgr2=0x7f80b40cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:57.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.790+0000 7f80b3fff700 1 --2- 172.21.15.81:0/1215249335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80b416b420 0x7f80b40cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:57.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.790+0000 7f80b3fff700 1 -- 172.21.15.81:0/1215249335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b40b4740 con 0x7f809c003a60 2023-10-07T08:49:57.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.791+0000 7f80b3fff700 1 --2- 172.21.15.81:0/1215249335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c003a60 0x7f80b40b3ba0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f809c00c0a0 tx=0x7f80a401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:57.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.791+0000 7f809bfff700 1 -- 172.21.15.81:0/1215249335 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4022070 con 0x7f809c003a60 2023-10-07T08:49:57.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.791+0000 7f809bfff700 1 -- 172.21.15.81:0/1215249335 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a400e9e0 con 0x7f809c003a60 2023-10-07T08:49:57.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.791+0000 7f80ba948700 1 -- 172.21.15.81:0/1215249335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b40b4a20 con 0x7f809c003a60 2023-10-07T08:49:57.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.791+0000 7f809bfff700 1 -- 172.21.15.81:0/1215249335 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a401c450 con 0x7f809c003a60 2023-10-07T08:49:57.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.791+0000 7f80ba948700 1 -- 172.21.15.81:0/1215249335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b416b890 con 0x7f809c003a60 2023-10-07T08:49:57.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.792+0000 7f80ba948700 1 -- 172.21.15.81:0/1215249335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b406a6d0 con 0x7f809c003a60 2023-10-07T08:49:57.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.792+0000 7f809bfff700 1 -- 172.21.15.81:0/1215249335 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80a401c880 con 0x7f809c003a60 2023-10-07T08:49:57.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.792+0000 7f809bfff700 1 --2- 172.21.15.81:0/1215249335 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80a0066f30 0x7f80a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:57.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.793+0000 7f809bfff700 1 -- 172.21.15.81:0/1215249335 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f80a4085bd0 con 0x7f809c003a60 2023-10-07T08:49:57.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.793+0000 7f80b37fe700 1 --2- 172.21.15.81:0/1215249335 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80a0066f30 0x7f80a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:57.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.793+0000 7f80b37fe700 1 --2- 172.21.15.81:0/1215249335 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80a0066f30 0x7f80a00693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f80a8007bc0 tx=0x7f80a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:57.797+0000 7f809bfff700 1 -- 172.21.15.81:0/1215249335 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80a4052f50 con 0x7f809c003a60 2023-10-07T08:49:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.021+0000 7f80ba948700 1 -- 172.21.15.81:0/1215249335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f80b40d0450 con 0x7f809c003a60 2023-10-07T08:49:58.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.649+0000 7f809bfff700 1 -- 172.21.15.81:0/1215249335 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v70) v1 ==== 174+0+0 (secure 0 0 0) 0x7f80a40170c0 con 0x7f809c003a60 2023-10-07T08:49:58.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.651+0000 7f80ba948700 1 -- 172.21.15.81:0/1215249335 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80a0066f30 msgr2=0x7f80a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:58.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.651+0000 7f80ba948700 1 --2- 172.21.15.81:0/1215249335 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80a0066f30 0x7f80a00693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f80a8007bc0 tx=0x7f80a8009040 comp rx=0 tx=0).stop 2023-10-07T08:49:58.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.651+0000 7f80ba948700 1 -- 172.21.15.81:0/1215249335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c003a60 msgr2=0x7f80b40b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:58.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.651+0000 7f80ba948700 1 --2- 172.21.15.81:0/1215249335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c003a60 0x7f80b40b3ba0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f809c00c0a0 tx=0x7f80a401a000 comp rx=0 tx=0).stop 2023-10-07T08:49:58.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.651+0000 7f80ba948700 1 -- 172.21.15.81:0/1215249335 shutdown_connections 2023-10-07T08:49:58.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.651+0000 7f80ba948700 1 --2- 172.21.15.81:0/1215249335 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f80a0066f30 0x7f80a00693e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:58.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.651+0000 7f80ba948700 1 --2- 172.21.15.81:0/1215249335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80b4069cf0 0x7f80b406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:58.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.651+0000 7f80ba948700 1 --2- 172.21.15.81:0/1215249335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c003a60 0x7f80b40b3ba0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:58.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.651+0000 7f80ba948700 1 --2- 172.21.15.81:0/1215249335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80b416b420 0x7f80b40cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:58.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.652+0000 7f80ba948700 1 -- 172.21.15.81:0/1215249335 >> 172.21.15.81:0/1215249335 conn(0x7f80b406bb90 msgr2=0x7f80b4155fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:58.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.652+0000 7f80ba948700 1 -- 172.21.15.81:0/1215249335 shutdown_connections 2023-10-07T08:49:58.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.652+0000 7f80ba948700 1 -- 172.21.15.81:0/1215249335 wait complete. 2023-10-07T08:49:58.656 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 18 and data pool 19 2023-10-07T08:49:58.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:49:58.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.779+0000 7fc6f4b1b700 1 Processor -- start 2023-10-07T08:49:58.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.779+0000 7fc6f4b1b700 1 -- start start 2023-10-07T08:49:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.780+0000 7fc6f4b1b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc6f0159f10 0x7fc6f0068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.780+0000 7fc6f4b1b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6f0068cc0 0x7fc6f00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.780+0000 7fc6f4b1b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f00cee10 con 0x7fc6f0159b40 2023-10-07T08:49:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.780+0000 7fc6f4b1b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f0069140 con 0x7fc6f0159f10 2023-10-07T08:49:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.780+0000 7fc6f4b1b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f00cd040 con 0x7fc6f0068cc0 2023-10-07T08:49:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.780+0000 7fc6ef7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc6f0159b40 0x7fc6f00cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33398/0 (socket says 172.21.15.81:33398) 2023-10-07T08:49:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.780+0000 7fc6ef7fe700 1 -- 172.21.15.81:0/1696434769 learned_addr learned my addr 172.21.15.81:0/1696434769 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.780+0000 7fc6effff700 1 --2- 172.21.15.81:0/1696434769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6f0068cc0 0x7fc6f00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.780+0000 7fc6eeffd700 1 --2- 172.21.15.81:0/1696434769 >> v2:172.21.15.89:3300/0 conn(0x7fc6f0159f10 0x7fc6f0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.780+0000 7fc6ee7fc700 1 -- 172.21.15.81:0/1696434769 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315297012 0 0) 0x7fc6f00cee10 con 0x7fc6f0159b40 2023-10-07T08:49:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.780+0000 7fc6ee7fc700 1 -- 172.21.15.81:0/1696434769 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6d8003570 con 0x7fc6f0159b40 2023-10-07T08:49:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.780+0000 7fc6ee7fc700 1 -- 172.21.15.81:0/1696434769 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2404022226 0 0) 0x7fc6d8003570 con 0x7fc6f0159b40 2023-10-07T08:49:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ee7fc700 1 -- 172.21.15.81:0/1696434769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6f0068cc0 msgr2=0x7fc6f00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ee7fc700 1 --2- 172.21.15.81:0/1696434769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6f0068cc0 0x7fc6f00cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ee7fc700 1 -- 172.21.15.81:0/1696434769 >> v2:172.21.15.89:3300/0 conn(0x7fc6f0159f10 msgr2=0x7fc6f0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ee7fc700 1 --2- 172.21.15.81:0/1696434769 >> v2:172.21.15.89:3300/0 conn(0x7fc6f0159f10 0x7fc6f0068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ee7fc700 1 -- 172.21.15.81:0/1696434769 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f00cd320 con 0x7fc6f0159b40 2023-10-07T08:49:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ee7fc700 1 -- 172.21.15.81:0/1696434769 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fc6e00017f0 con 0x7fc6f0159b40 2023-10-07T08:49:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ee7fc700 1 -- 172.21.15.81:0/1696434769 >> v1:172.21.15.81:6789/0 conn(0x7fc6f0159b40 legacy=0x7fc6f00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ee7fc700 1 --2- 172.21.15.81:0/1696434769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d8003a60 0x7fc6d8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ee7fc700 1 --2- 172.21.15.81:0/1696434769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6d8004810 0x7fc6d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ee7fc700 1 --2- 172.21.15.81:0/1696434769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6f0068cc0 0x7fc6d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ee7fc700 1 -- 172.21.15.81:0/1696434769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f0069140 con 0x7fc6d8003a60 2023-10-07T08:49:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ee7fc700 1 -- 172.21.15.81:0/1696434769 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f00cd040 con 0x7fc6d8004810 2023-10-07T08:49:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ee7fc700 1 -- 172.21.15.81:0/1696434769 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d800ba60 con 0x7fc6f0068cc0 2023-10-07T08:49:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ef7fe700 1 --2- 172.21.15.81:0/1696434769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d8003a60 0x7fc6d8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6eeffd700 1 --2- 172.21.15.81:0/1696434769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6d8004810 0x7fc6d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6effff700 1 --2- 172.21.15.81:0/1696434769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6f0068cc0 0x7fc6d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ef7fe700 1 -- 172.21.15.81:0/1696434769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6f0068cc0 msgr2=0x7fc6d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ef7fe700 1 --2- 172.21.15.81:0/1696434769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6f0068cc0 0x7fc6d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ef7fe700 1 -- 172.21.15.81:0/1696434769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6d8004810 msgr2=0x7fc6d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ef7fe700 1 --2- 172.21.15.81:0/1696434769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6d8004810 0x7fc6d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ef7fe700 1 -- 172.21.15.81:0/1696434769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d8003570 con 0x7fc6d8003a60 2023-10-07T08:49:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6effff700 1 --2- 172.21.15.81:0/1696434769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6f0068cc0 0x7fc6d80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ef7fe700 1 --2- 172.21.15.81:0/1696434769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d8003a60 0x7fc6d8003e70 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000a9a0 tx=0x7fc6e0002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f410e98334659700 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ee7fc700 1 -- 172.21.15.81:0/1696434769 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0012440 con 0x7fc6d8003a60 2023-10-07T08:49:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ee7fc700 1 -- 172.21.15.81:0/1696434769 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e00125c0 con 0x7fc6d8003a60 2023-10-07T08:49:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.781+0000 7fc6ee7fc700 1 -- 172.21.15.81:0/1696434769 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0012980 con 0x7fc6d8003a60 2023-10-07T08:49:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.782+0000 7fc6f4b1b700 1 -- 172.21.15.81:0/1696434769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d8003a60 msgr2=0x7fc6d8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.782+0000 7fc6f4b1b700 1 --2- 172.21.15.81:0/1696434769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d8003a60 0x7fc6d8003e70 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000a9a0 tx=0x7fc6e0002210 comp rx=0 tx=0).stop 2023-10-07T08:49:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.782+0000 7fc6effff700 1 -- 172.21.15.81:0/1696434769 reap_dead start 2023-10-07T08:49:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.782+0000 7fc6f4b1b700 1 -- 172.21.15.81:0/1696434769 shutdown_connections 2023-10-07T08:49:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.782+0000 7fc6f4b1b700 1 -- 172.21.15.81:0/1696434769 >> 172.21.15.81:0/1696434769 conn(0x7fc6f00cd660 msgr2=0x7fc6f00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.782+0000 7fc6f4b1b700 1 -- 172.21.15.81:0/1696434769 shutdown_connections 2023-10-07T08:49:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.782+0000 7fc6f4b1b700 1 -- 172.21.15.81:0/1696434769 wait complete. 2023-10-07T08:49:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.783+0000 7fc6f4b1b700 1 Processor -- start 2023-10-07T08:49:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.783+0000 7fc6f4b1b700 1 -- start start 2023-10-07T08:49:58.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6f4b1b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6d8003a60 0x7fc6f016ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:58.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6f4b1b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6f015f5c0 0x7fc6f015fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:58.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6f4b1b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f00c5990 0x7fc6f00c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:58.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6f4b1b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f0160d20 con 0x7fc6f00c5990 2023-10-07T08:49:58.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6f4b1b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f00c6320 con 0x7fc6f015f5c0 2023-10-07T08:49:58.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6f4b1b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f0160110 con 0x7fc6d8003a60 2023-10-07T08:49:58.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6effff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f00c5990 0x7fc6f00c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:58.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6effff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f00c5990 0x7fc6f00c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55440/0 (socket says 172.21.15.81:55440) 2023-10-07T08:49:58.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6effff700 1 -- 172.21.15.81:0/2434125535 learned_addr learned my addr 172.21.15.81:0/2434125535 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:58.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6ef7fe700 1 --2- 172.21.15.81:0/2434125535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6d8003a60 0x7fc6f016ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:58.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6eeffd700 1 --2- 172.21.15.81:0/2434125535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6f015f5c0 0x7fc6f015fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:58.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6effff700 1 -- 172.21.15.81:0/2434125535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6d8003a60 msgr2=0x7fc6f016ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:58.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6effff700 1 --2- 172.21.15.81:0/2434125535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6d8003a60 0x7fc6f016ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:58.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6effff700 1 -- 172.21.15.81:0/2434125535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6f015f5c0 msgr2=0x7fc6f015fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:58.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6effff700 1 --2- 172.21.15.81:0/2434125535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6f015f5c0 0x7fc6f015fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:58.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6effff700 1 -- 172.21.15.81:0/2434125535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f01603f0 con 0x7fc6f00c5990 2023-10-07T08:49:58.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6effff700 1 --2- 172.21.15.81:0/2434125535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f00c5990 0x7fc6f00c5de0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00ce410 tx=0x7fc6e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:58.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6d77fe700 1 -- 172.21.15.81:0/2434125535 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8011ed0 con 0x7fc6f00c5990 2023-10-07T08:49:58.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.784+0000 7fc6d77fe700 1 -- 172.21.15.81:0/2434125535 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e8015670 con 0x7fc6f00c5990 2023-10-07T08:49:58.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.785+0000 7fc6f4b1b700 1 -- 172.21.15.81:0/2434125535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f01606d0 con 0x7fc6f00c5990 2023-10-07T08:49:58.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.785+0000 7fc6d77fe700 1 -- 172.21.15.81:0/2434125535 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8015a30 con 0x7fc6f00c5990 2023-10-07T08:49:58.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.785+0000 7fc6f4b1b700 1 -- 172.21.15.81:0/2434125535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f00ca730 con 0x7fc6f00c5990 2023-10-07T08:49:58.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.785+0000 7fc6f4b1b700 1 -- 172.21.15.81:0/2434125535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f0160ed0 con 0x7fc6f00c5990 2023-10-07T08:49:58.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.786+0000 7fc6d77fe700 1 -- 172.21.15.81:0/2434125535 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6e8020460 con 0x7fc6f00c5990 2023-10-07T08:49:58.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.786+0000 7fc6d77fe700 1 --2- 172.21.15.81:0/2434125535 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6dc066fb0 0x7fc6dc069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:58.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.786+0000 7fc6d77fe700 1 -- 172.21.15.81:0/2434125535 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc6e8084650 con 0x7fc6f00c5990 2023-10-07T08:49:58.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.786+0000 7fc6ef7fe700 1 --2- 172.21.15.81:0/2434125535 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6dc066fb0 0x7fc6dc069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:58.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.787+0000 7fc6ef7fe700 1 --2- 172.21.15.81:0/2434125535 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6dc066fb0 0x7fc6dc069460 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000a8c0 tx=0x7fc6e0015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:58.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.790+0000 7fc6d77fe700 1 -- 172.21.15.81:0/2434125535 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6f0160ed0 con 0x7fc6f00c5990 2023-10-07T08:49:58.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.975+0000 7fc6f4b1b700 1 -- 172.21.15.81:0/2434125535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6f00cb890 con 0x7fc6f00c5990 2023-10-07T08:49:58.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.975+0000 7fc6d77fe700 1 -- 172.21.15.81:0/2434125535 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+15330 (secure 0 0 0) 0x7fc6e8051820 con 0x7fc6f00c5990 2023-10-07T08:49:58.977 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:58.977 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":155,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:49:58.022742+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:49:56.356539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-07T08:49:56.981204+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:49:58.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.977+0000 7fc6f4b1b700 1 -- 172.21.15.81:0/2434125535 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6dc066fb0 msgr2=0x7fc6dc069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:58.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.977+0000 7fc6f4b1b700 1 --2- 172.21.15.81:0/2434125535 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6dc066fb0 0x7fc6dc069460 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000a8c0 tx=0x7fc6e0015000 comp rx=0 tx=0).stop 2023-10-07T08:49:58.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.977+0000 7fc6f4b1b700 1 -- 172.21.15.81:0/2434125535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f00c5990 msgr2=0x7fc6f00c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:58.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.977+0000 7fc6f4b1b700 1 --2- 172.21.15.81:0/2434125535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f00c5990 0x7fc6f00c5de0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00ce410 tx=0x7fc6e8008040 comp rx=0 tx=0).stop 2023-10-07T08:49:58.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.977+0000 7fc6f4b1b700 1 -- 172.21.15.81:0/2434125535 shutdown_connections 2023-10-07T08:49:58.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.977+0000 7fc6f4b1b700 1 --2- 172.21.15.81:0/2434125535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f00c5990 0x7fc6f00c5de0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:58.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.977+0000 7fc6f4b1b700 1 --2- 172.21.15.81:0/2434125535 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6dc066fb0 0x7fc6dc069460 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:58.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.977+0000 7fc6f4b1b700 1 --2- 172.21.15.81:0/2434125535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6d8003a60 0x7fc6f016ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:58.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.977+0000 7fc6f4b1b700 1 --2- 172.21.15.81:0/2434125535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6f015f5c0 0x7fc6f015fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:58.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.977+0000 7fc6f4b1b700 1 -- 172.21.15.81:0/2434125535 >> 172.21.15.81:0/2434125535 conn(0x7fc6f00cd660 msgr2=0x7fc6f006c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:58.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.977+0000 7fc6f4b1b700 1 -- 172.21.15.81:0/2434125535 shutdown_connections 2023-10-07T08:49:58.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:58.978+0000 7fc6f4b1b700 1 -- 172.21.15.81:0/2434125535 wait complete. 2023-10-07T08:49:58.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:49:59.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.103+0000 7f5ff4e9b700 1 Processor -- start 2023-10-07T08:49:59.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.103+0000 7f5ff4e9b700 1 -- start start 2023-10-07T08:49:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.104+0000 7f5ff4e9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ff015a2a0 0x7f5ff00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.104+0000 7f5ff4e9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ff00ceb30 0x7f5ff00cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.104+0000 7f5ff4e9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5ff006d650 0x7f5ff006da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:59.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.104+0000 7f5ff4e9b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff006ea90 con 0x7f5ff015a2a0 2023-10-07T08:49:59.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.104+0000 7f5ff4e9b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff00b0ca0 con 0x7f5ff006d650 2023-10-07T08:49:59.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.104+0000 7f5ff4e9b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00cf4c0 con 0x7f5ff00ceb30 2023-10-07T08:49:59.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.104+0000 7f5fee59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ff015a2a0 0x7f5ff00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:59.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.104+0000 7f5fee59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ff015a2a0 0x7f5ff00b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55448/0 (socket says 172.21.15.81:55448) 2023-10-07T08:49:59.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.104+0000 7f5fee59c700 1 -- 172.21.15.81:0/611304466 learned_addr learned my addr 172.21.15.81:0/611304466 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:59.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5fe5d9b700 1 --2- 172.21.15.81:0/611304466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ff00ceb30 0x7f5ff00cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5feed9d700 1 --2- 172.21.15.81:0/611304466 >> v2:172.21.15.89:3300/0 conn(0x7f5ff006d650 0x7f5ff006da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5fee59c700 1 -- 172.21.15.81:0/611304466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ff00ceb30 msgr2=0x7f5ff00cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5fee59c700 1 --2- 172.21.15.81:0/611304466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ff00ceb30 0x7f5ff00cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5fee59c700 1 -- 172.21.15.81:0/611304466 >> v2:172.21.15.89:3300/0 conn(0x7f5ff006d650 msgr2=0x7f5ff006da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5fee59c700 1 --2- 172.21.15.81:0/611304466 >> v2:172.21.15.89:3300/0 conn(0x7f5ff006d650 0x7f5ff006da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5fee59c700 1 -- 172.21.15.81:0/611304466 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff00b00d0 con 0x7f5ff015a2a0 2023-10-07T08:49:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5feed9d700 1 --2- 172.21.15.81:0/611304466 >> v2:172.21.15.89:3300/0 conn(0x7f5ff006d650 0x7f5ff006da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5fe5d9b700 1 --2- 172.21.15.81:0/611304466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ff00ceb30 0x7f5ff00cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:49:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5fee59c700 1 --2- 172.21.15.81:0/611304466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff015a2a0 0x7f5ff00b1130 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f5ff006b970 tx=0x7f5fe0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d245d9c6892751 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:59.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5fedd9b700 1 -- 172.21.15.81:0/611304466 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe000e070 con 0x7f5ff015a2a0 2023-10-07T08:49:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5fedd9b700 1 -- 172.21.15.81:0/611304466 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe000ba50 con 0x7f5ff015a2a0 2023-10-07T08:49:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5fedd9b700 1 -- 172.21.15.81:0/611304466 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00092e0 con 0x7f5ff015a2a0 2023-10-07T08:49:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5ff4e9b700 1 -- 172.21.15.81:0/611304466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff015a2a0 msgr2=0x7f5ff00b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5ff4e9b700 1 --2- 172.21.15.81:0/611304466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff015a2a0 0x7f5ff00b1130 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f5ff006b970 tx=0x7f5fe0009840 comp rx=0 tx=0).stop 2023-10-07T08:49:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5ff4e9b700 1 -- 172.21.15.81:0/611304466 shutdown_connections 2023-10-07T08:49:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5ff4e9b700 1 --2- 172.21.15.81:0/611304466 >> v2:172.21.15.89:3300/0 conn(0x7f5ff006d650 0x7f5ff006da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.105+0000 7f5ff4e9b700 1 --2- 172.21.15.81:0/611304466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff015a2a0 0x7f5ff00b1130 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.106+0000 7f5ff4e9b700 1 --2- 172.21.15.81:0/611304466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ff00ceb30 0x7f5ff00cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.106+0000 7f5ff4e9b700 1 -- 172.21.15.81:0/611304466 >> 172.21.15.81:0/611304466 conn(0x7f5ff0067640 msgr2=0x7f5ff0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.106+0000 7f5ff4e9b700 1 -- 172.21.15.81:0/611304466 shutdown_connections 2023-10-07T08:49:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.106+0000 7f5ff4e9b700 1 -- 172.21.15.81:0/611304466 wait complete. 2023-10-07T08:49:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.107+0000 7f5ff4e9b700 1 Processor -- start 2023-10-07T08:49:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.107+0000 7f5ff4e9b700 1 -- start start 2023-10-07T08:49:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.107+0000 7f5ff4e9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ff006d650 0x7f5ff0150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.107+0000 7f5ff4e9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff00ceb30 0x7f5ff015cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.107+0000 7f5ff4e9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ff015a2a0 0x7f5ff015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.107+0000 7f5ff4e9b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff01506a0 con 0x7f5ff00ceb30 2023-10-07T08:49:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5ff4e9b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00b3ae0 con 0x7f5ff015a2a0 2023-10-07T08:49:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5ff4e9b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff015fb40 con 0x7f5ff006d650 2023-10-07T08:49:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5fe5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff00ceb30 0x7f5ff015cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5fe5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff00ceb30 0x7f5ff015cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55454/0 (socket says 172.21.15.81:55454) 2023-10-07T08:49:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5fe5d9b700 1 -- 172.21.15.81:0/982604344 learned_addr learned my addr 172.21.15.81:0/982604344 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5fee59c700 1 --2- 172.21.15.81:0/982604344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ff006d650 0x7f5ff0150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5feed9d700 1 --2- 172.21.15.81:0/982604344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ff015a2a0 0x7f5ff015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5fe5d9b700 1 -- 172.21.15.81:0/982604344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ff006d650 msgr2=0x7f5ff0150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5fe5d9b700 1 --2- 172.21.15.81:0/982604344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ff006d650 0x7f5ff0150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5fe5d9b700 1 -- 172.21.15.81:0/982604344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ff015a2a0 msgr2=0x7f5ff015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5fe5d9b700 1 --2- 172.21.15.81:0/982604344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ff015a2a0 0x7f5ff015d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5fe5d9b700 1 -- 172.21.15.81:0/982604344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0009ae0 con 0x7f5ff00ceb30 2023-10-07T08:49:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5fe5d9b700 1 --2- 172.21.15.81:0/982604344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff00ceb30 0x7f5ff015cd80 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800d890 tx=0x7f5fd8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5fe6ffd700 1 -- 172.21.15.81:0/982604344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd80125f0 con 0x7f5ff00ceb30 2023-10-07T08:49:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5fe6ffd700 1 -- 172.21.15.81:0/982604344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd8012750 con 0x7f5ff00ceb30 2023-10-07T08:49:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5ff4e9b700 1 -- 172.21.15.81:0/982604344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff015f860 con 0x7f5ff00ceb30 2023-10-07T08:49:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5fe6ffd700 1 -- 172.21.15.81:0/982604344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8012af0 con 0x7f5ff00ceb30 2023-10-07T08:49:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.108+0000 7f5ff4e9b700 1 -- 172.21.15.81:0/982604344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff0153250 con 0x7f5ff00ceb30 2023-10-07T08:49:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.109+0000 7f5ff4e9b700 1 -- 172.21.15.81:0/982604344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff0069e40 con 0x7f5ff00ceb30 2023-10-07T08:49:59.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.109+0000 7f5fe6ffd700 1 -- 172.21.15.81:0/982604344 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fd8014430 con 0x7f5ff00ceb30 2023-10-07T08:49:59.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.110+0000 7f5fe6ffd700 1 --2- 172.21.15.81:0/982604344 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5fd0066f30 0x7f5fd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:59.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.110+0000 7f5fe6ffd700 1 -- 172.21.15.81:0/982604344 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5fd80847e0 con 0x7f5ff00ceb30 2023-10-07T08:49:59.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.110+0000 7f5fee59c700 1 --2- 172.21.15.81:0/982604344 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5fd0066f30 0x7f5fd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:59.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.110+0000 7f5fee59c700 1 --2- 172.21.15.81:0/982604344 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5fd0066f30 0x7f5fd00693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009880 tx=0x7f5fe0018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:59.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.114+0000 7f5fe6ffd700 1 -- 172.21.15.81:0/982604344 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fd80554e0 con 0x7f5ff00ceb30 2023-10-07T08:49:59.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.294+0000 7f5ff4e9b700 1 -- 172.21.15.81:0/982604344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ff00b4aa0 con 0x7f5ff00ceb30 2023-10-07T08:49:59.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.297+0000 7f5fe6ffd700 1 -- 172.21.15.81:0/982604344 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+15317 (secure 0 0 0) 0x7f5fd8055070 con 0x7f5ff00ceb30 2023-10-07T08:49:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:49:59.299 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":156,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:49:59.291975+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:49:56.356539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-07T08:49:56.981204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:49:59.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.299+0000 7f5ff4e9b700 1 -- 172.21.15.81:0/982604344 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5fd0066f30 msgr2=0x7f5fd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:59.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.299+0000 7f5ff4e9b700 1 --2- 172.21.15.81:0/982604344 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5fd0066f30 0x7f5fd00693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009880 tx=0x7f5fe0018000 comp rx=0 tx=0).stop 2023-10-07T08:49:59.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.299+0000 7f5ff4e9b700 1 -- 172.21.15.81:0/982604344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff00ceb30 msgr2=0x7f5ff015cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:59.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.299+0000 7f5ff4e9b700 1 --2- 172.21.15.81:0/982604344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff00ceb30 0x7f5ff015cd80 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800d890 tx=0x7f5fd8008040 comp rx=0 tx=0).stop 2023-10-07T08:49:59.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.299+0000 7f5ff4e9b700 1 -- 172.21.15.81:0/982604344 shutdown_connections 2023-10-07T08:49:59.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.299+0000 7f5ff4e9b700 1 --2- 172.21.15.81:0/982604344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ff015a2a0 0x7f5ff015d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.299+0000 7f5ff4e9b700 1 --2- 172.21.15.81:0/982604344 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5fd0066f30 0x7f5fd00693e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.299+0000 7f5ff4e9b700 1 --2- 172.21.15.81:0/982604344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ff006d650 0x7f5ff0150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.299+0000 7f5ff4e9b700 1 --2- 172.21.15.81:0/982604344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff00ceb30 0x7f5ff015cd80 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.299+0000 7f5ff4e9b700 1 -- 172.21.15.81:0/982604344 >> 172.21.15.81:0/982604344 conn(0x7f5ff0067640 msgr2=0x7f5ff00cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:59.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.299+0000 7f5ff4e9b700 1 -- 172.21.15.81:0/982604344 shutdown_connections 2023-10-07T08:49:59.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.299+0000 7f5ff4e9b700 1 -- 172.21.15.81:0/982604344 wait complete. 2023-10-07T08:49:59.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T08:49:59.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.429+0000 7f44757cd700 1 Processor -- start 2023-10-07T08:49:59.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.429+0000 7f44757cd700 1 -- start start 2023-10-07T08:49:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f44757cd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4470157860 0x7f447006dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f44757cd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f44700ce270 0x7f447015a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f44757cd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44700cbec0 con 0x7f447006a020 2023-10-07T08:49:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f44757cd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44700cb9d0 con 0x7f44700ce270 2023-10-07T08:49:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f44757cd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f447015b2d0 con 0x7f4470157860 2023-10-07T08:49:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f446f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f44700ce270 0x7f447015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f446e7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f447006a020 0x7f44700cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33402/0 (socket says 172.21.15.81:33402) 2023-10-07T08:49:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f446e7fc700 1 -- 172.21.15.81:0/2649044959 learned_addr learned my addr 172.21.15.81:0/2649044959 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:49:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f446f7fe700 1 -- 172.21.15.81:0/2649044959 >> v2:172.21.15.89:3300/0 conn(0x7f4470157860 msgr2=0x7f447006dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:49:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f446effd700 1 --2- 172.21.15.81:0/2649044959 >> v2:172.21.15.89:3300/0 conn(0x7f4470157860 0x7f447006dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f446f7fe700 1 --2- 172.21.15.81:0/2649044959 >> v2:172.21.15.89:3300/0 conn(0x7f4470157860 0x7f447006dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f446dffb700 1 -- 172.21.15.81:0/2649044959 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454029177 0 0) 0x7f44700cbec0 con 0x7f447006a020 2023-10-07T08:49:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f446f7fe700 1 -- 172.21.15.81:0/2649044959 >> v1:172.21.15.81:6789/0 conn(0x7f447006a020 legacy=0x7f44700cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f446f7fe700 1 -- 172.21.15.81:0/2649044959 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44700cc180 con 0x7f44700ce270 2023-10-07T08:49:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f446f7fe700 1 --2- 172.21.15.81:0/2649044959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44700ce270 0x7f447015a300 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f4470068620 tx=0x7f44600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616190e29359751b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f446dffb700 1 -- 172.21.15.81:0/2649044959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460009e80 con 0x7f44700ce270 2023-10-07T08:49:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f446dffb700 1 -- 172.21.15.81:0/2649044959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446000b820 con 0x7f44700ce270 2023-10-07T08:49:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.430+0000 7f446dffb700 1 -- 172.21.15.81:0/2649044959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446000bba0 con 0x7f44700ce270 2023-10-07T08:49:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.431+0000 7f44757cd700 1 -- 172.21.15.81:0/2649044959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44700ce270 msgr2=0x7f447015a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.431+0000 7f44757cd700 1 --2- 172.21.15.81:0/2649044959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44700ce270 0x7f447015a300 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f4470068620 tx=0x7f44600091a0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.431+0000 7f44757cd700 1 -- 172.21.15.81:0/2649044959 shutdown_connections 2023-10-07T08:49:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.431+0000 7f44757cd700 1 --2- 172.21.15.81:0/2649044959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44700ce270 0x7f447015a300 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.431+0000 7f44757cd700 1 --2- 172.21.15.81:0/2649044959 >> v2:172.21.15.89:3300/0 conn(0x7f4470157860 0x7f447006dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.431+0000 7f44757cd700 1 -- 172.21.15.81:0/2649044959 >> 172.21.15.81:0/2649044959 conn(0x7f4470063230 msgr2=0x7f4470063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:49:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.431+0000 7f44757cd700 1 -- 172.21.15.81:0/2649044959 shutdown_connections 2023-10-07T08:49:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.431+0000 7f44757cd700 1 -- 172.21.15.81:0/2649044959 wait complete. 2023-10-07T08:49:59.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.432+0000 7f44757cd700 1 Processor -- start 2023-10-07T08:49:59.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.432+0000 7f44757cd700 1 -- start start 2023-10-07T08:49:59.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f44757cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447006a020 0x7f447015f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:59.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f44757cd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44700ce270 0x7f447015d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:59.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f44757cd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4470157860 0x7f4470151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:59.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f44757cd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447015e470 con 0x7f447006a020 2023-10-07T08:49:59.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f44757cd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4470153be0 con 0x7f44700ce270 2023-10-07T08:49:59.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f44757cd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447015dbd0 con 0x7f4470157860 2023-10-07T08:49:59.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f446effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447006a020 0x7f447015f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:59.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f446effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447006a020 0x7f447015f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55468/0 (socket says 172.21.15.81:55468) 2023-10-07T08:49:59.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f446effd700 1 -- 172.21.15.81:0/522081072 learned_addr learned my addr 172.21.15.81:0/522081072 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:49:59.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f446e7fc700 1 --2- 172.21.15.81:0/522081072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44700ce270 0x7f447015d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:59.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f446f7fe700 1 --2- 172.21.15.81:0/522081072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4470157860 0x7f4470151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:59.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f446effd700 1 -- 172.21.15.81:0/522081072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4470157860 msgr2=0x7f4470151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:59.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f446effd700 1 --2- 172.21.15.81:0/522081072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4470157860 0x7f4470151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f446effd700 1 -- 172.21.15.81:0/522081072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44700ce270 msgr2=0x7f447015d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:49:59.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f446effd700 1 --2- 172.21.15.81:0/522081072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44700ce270 0x7f447015d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:49:59.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f446effd700 1 -- 172.21.15.81:0/522081072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4460009420 con 0x7f447006a020 2023-10-07T08:49:59.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.433+0000 7f446effd700 1 --2- 172.21.15.81:0/522081072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447006a020 0x7f447015f3a0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f446800ce10 tx=0x7f4468007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:59.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.434+0000 7f4456ffd700 1 -- 172.21.15.81:0/522081072 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446800ab90 con 0x7f447006a020 2023-10-07T08:49:59.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.434+0000 7f4456ffd700 1 -- 172.21.15.81:0/522081072 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446800acf0 con 0x7f447006a020 2023-10-07T08:49:59.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.434+0000 7f44757cd700 1 -- 172.21.15.81:0/522081072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447015deb0 con 0x7f447006a020 2023-10-07T08:49:59.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.434+0000 7f4456ffd700 1 -- 172.21.15.81:0/522081072 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468017680 con 0x7f447006a020 2023-10-07T08:49:59.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.434+0000 7f44757cd700 1 -- 172.21.15.81:0/522081072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447015d8c0 con 0x7f447006a020 2023-10-07T08:49:59.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.435+0000 7f44757cd700 1 -- 172.21.15.81:0/522081072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44700690d0 con 0x7f447006a020 2023-10-07T08:49:59.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.435+0000 7f4456ffd700 1 -- 172.21.15.81:0/522081072 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4468003020 con 0x7f447006a020 2023-10-07T08:49:59.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.435+0000 7f4456ffd700 1 --2- 172.21.15.81:0/522081072 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f445c066f30 0x7f445c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:49:59.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.436+0000 7f446e7fc700 1 --2- 172.21.15.81:0/522081072 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f445c066f30 0x7f445c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:49:59.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.436+0000 7f4456ffd700 1 -- 172.21.15.81:0/522081072 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4468013070 con 0x7f447006a020 2023-10-07T08:49:59.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.436+0000 7f446e7fc700 1 --2- 172.21.15.81:0/522081072 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f445c066f30 0x7f445c0693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f447015f8e0 tx=0x7f4464009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:49:59.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.440+0000 7f4456ffd700 1 -- 172.21.15.81:0/522081072 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4468051ca0 con 0x7f447006a020 2023-10-07T08:49:59.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:49:59.668+0000 7f44757cd700 1 -- 172.21.15.81:0/522081072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4470159d20 con 0x7f447006a020 2023-10-07T08:50:00.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.663+0000 7f4456ffd700 1 -- 172.21.15.81:0/522081072 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) v1 ==== 118+0+0 (secure 0 0 0) 0x7f446801c070 con 0x7f447006a020 2023-10-07T08:50:00.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.666+0000 7f44757cd700 1 -- 172.21.15.81:0/522081072 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f445c066f30 msgr2=0x7f445c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:00.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.666+0000 7f44757cd700 1 --2- 172.21.15.81:0/522081072 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f445c066f30 0x7f445c0693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f447015f8e0 tx=0x7f4464009040 comp rx=0 tx=0).stop 2023-10-07T08:50:00.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.666+0000 7f44757cd700 1 -- 172.21.15.81:0/522081072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447006a020 msgr2=0x7f447015f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:00.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.666+0000 7f44757cd700 1 --2- 172.21.15.81:0/522081072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447006a020 0x7f447015f3a0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f446800ce10 tx=0x7f4468007810 comp rx=0 tx=0).stop 2023-10-07T08:50:00.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.666+0000 7f44757cd700 1 -- 172.21.15.81:0/522081072 shutdown_connections 2023-10-07T08:50:00.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.666+0000 7f44757cd700 1 --2- 172.21.15.81:0/522081072 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f445c066f30 0x7f445c0693e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:00.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.666+0000 7f44757cd700 1 --2- 172.21.15.81:0/522081072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4470157860 0x7f4470151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:00.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.666+0000 7f44757cd700 1 --2- 172.21.15.81:0/522081072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f447006a020 0x7f447015f3a0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:00.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.666+0000 7f44757cd700 1 --2- 172.21.15.81:0/522081072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44700ce270 0x7f447015d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:00.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.666+0000 7f44757cd700 1 -- 172.21.15.81:0/522081072 >> 172.21.15.81:0/522081072 conn(0x7f4470063230 msgr2=0x7f4470153180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:00.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.666+0000 7f44757cd700 1 -- 172.21.15.81:0/522081072 shutdown_connections 2023-10-07T08:50:00.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.666+0000 7f44757cd700 1 -- 172.21.15.81:0/522081072 wait complete. 2023-10-07T08:50:00.698 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T08:50:00.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.825+0000 7f4a6679e700 1 Processor -- start 2023-10-07T08:50:00.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.825+0000 7f4a6679e700 1 -- start start 2023-10-07T08:50:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.826+0000 7f4a6679e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4a60151f00 0x7f4a60158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.826+0000 7f4a6679e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a601522d0 0x7f4a600ae710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.826+0000 7f4a6679e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a600cbad0 con 0x7f4a6006e6d0 2023-10-07T08:50:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.826+0000 7f4a6679e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6006d630 con 0x7f4a601522d0 2023-10-07T08:50:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.826+0000 7f4a6679e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6006d910 con 0x7f4a60151f00 2023-10-07T08:50:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.826+0000 7f4a64f9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a601522d0 0x7f4a600ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.826+0000 7f4a64f9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a601522d0 0x7f4a600ae710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55472/0 (socket says 172.21.15.81:55472) 2023-10-07T08:50:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.826+0000 7f4a64f9b700 1 -- 172.21.15.81:0/1421158056 learned_addr learned my addr 172.21.15.81:0/1421158056 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.827+0000 7f4a6579c700 1 --2- 172.21.15.81:0/1421158056 >> v2:172.21.15.89:3300/0 conn(0x7f4a60151f00 0x7f4a60158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.827+0000 7f4a64f9b700 1 -- 172.21.15.81:0/1421158056 >> v2:172.21.15.89:3300/0 conn(0x7f4a60151f00 msgr2=0x7f4a60158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.827+0000 7f4a64f9b700 1 --2- 172.21.15.81:0/1421158056 >> v2:172.21.15.89:3300/0 conn(0x7f4a60151f00 0x7f4a60158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.827+0000 7f4a64f9b700 1 -- 172.21.15.81:0/1421158056 >> v1:172.21.15.81:6789/0 conn(0x7f4a6006e6d0 legacy=0x7f4a6015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:00.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.827+0000 7f4a64f9b700 1 -- 172.21.15.81:0/1421158056 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6006dbf0 con 0x7f4a601522d0 2023-10-07T08:50:00.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.827+0000 7f4a5ffff700 1 -- 172.21.15.81:0/1421158056 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427681442 0 0) 0x7f4a600cbad0 con 0x7f4a6006e6d0 2023-10-07T08:50:00.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.827+0000 7f4a64f9b700 1 --2- 172.21.15.81:0/1421158056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a601522d0 0x7f4a600ae710 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f4a6006ac10 tx=0x7f4a54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86cf238d7714053a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:00.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.827+0000 7f4a5ffff700 1 -- 172.21.15.81:0/1421158056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54009e70 con 0x7f4a601522d0 2023-10-07T08:50:00.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.827+0000 7f4a5ffff700 1 -- 172.21.15.81:0/1421158056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5400b860 con 0x7f4a601522d0 2023-10-07T08:50:00.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.827+0000 7f4a5ffff700 1 -- 172.21.15.81:0/1421158056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5400bc00 con 0x7f4a601522d0 2023-10-07T08:50:00.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.827+0000 7f4a6679e700 1 -- 172.21.15.81:0/1421158056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a601522d0 msgr2=0x7f4a600ae710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:00.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.828+0000 7f4a6679e700 1 --2- 172.21.15.81:0/1421158056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a601522d0 0x7f4a600ae710 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f4a6006ac10 tx=0x7f4a54009250 comp rx=0 tx=0).stop 2023-10-07T08:50:00.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.828+0000 7f4a6679e700 1 -- 172.21.15.81:0/1421158056 shutdown_connections 2023-10-07T08:50:00.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.828+0000 7f4a6679e700 1 --2- 172.21.15.81:0/1421158056 >> v2:172.21.15.89:3300/0 conn(0x7f4a60151f00 0x7f4a60158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:00.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.828+0000 7f4a6679e700 1 --2- 172.21.15.81:0/1421158056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a601522d0 0x7f4a600ae710 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:00.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.828+0000 7f4a6679e700 1 -- 172.21.15.81:0/1421158056 >> 172.21.15.81:0/1421158056 conn(0x7f4a6006bb90 msgr2=0x7f4a6006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:00.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.828+0000 7f4a6679e700 1 -- 172.21.15.81:0/1421158056 shutdown_connections 2023-10-07T08:50:00.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.828+0000 7f4a6679e700 1 -- 172.21.15.81:0/1421158056 wait complete. 2023-10-07T08:50:00.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.829+0000 7f4a6679e700 1 Processor -- start 2023-10-07T08:50:00.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.829+0000 7f4a6679e700 1 -- start start 2023-10-07T08:50:00.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a6679e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6006e6d0 0x7f4a60169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:00.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a6679e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a60151f00 0x7f4a600b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:00.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a6679e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a601522d0 0x7f4a600c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:00.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a6679e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a600c7250 con 0x7f4a6006e6d0 2023-10-07T08:50:00.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a6679e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a600c7500 con 0x7f4a60151f00 2023-10-07T08:50:00.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a6679e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a600c77e0 con 0x7f4a601522d0 2023-10-07T08:50:00.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a6579c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6006e6d0 0x7f4a60169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:00.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a6579c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6006e6d0 0x7f4a60169fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55484/0 (socket says 172.21.15.81:55484) 2023-10-07T08:50:00.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a6579c700 1 -- 172.21.15.81:0/462723816 learned_addr learned my addr 172.21.15.81:0/462723816 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:00.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a64f9b700 1 --2- 172.21.15.81:0/462723816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a60151f00 0x7f4a600b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:00.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a65f9d700 1 --2- 172.21.15.81:0/462723816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a601522d0 0x7f4a600c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:00.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a6579c700 1 -- 172.21.15.81:0/462723816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a601522d0 msgr2=0x7f4a600c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:00.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a6579c700 1 --2- 172.21.15.81:0/462723816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a601522d0 0x7f4a600c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:00.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a6579c700 1 -- 172.21.15.81:0/462723816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a60151f00 msgr2=0x7f4a600b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:00.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a6579c700 1 --2- 172.21.15.81:0/462723816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a60151f00 0x7f4a600b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:00.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a6579c700 1 -- 172.21.15.81:0/462723816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a540094f0 con 0x7f4a6006e6d0 2023-10-07T08:50:00.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a6579c700 1 --2- 172.21.15.81:0/462723816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6006e6d0 0x7f4a60169fe0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000ec80 tx=0x7f4a500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:00.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a5d7fa700 1 -- 172.21.15.81:0/462723816 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5000c850 con 0x7f4a6006e6d0 2023-10-07T08:50:00.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a5d7fa700 1 -- 172.21.15.81:0/462723816 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5000c9b0 con 0x7f4a6006e6d0 2023-10-07T08:50:00.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a5d7fa700 1 -- 172.21.15.81:0/462723816 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5000cd50 con 0x7f4a6006e6d0 2023-10-07T08:50:00.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.830+0000 7f4a6679e700 1 -- 172.21.15.81:0/462723816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a600c7ac0 con 0x7f4a6006e6d0 2023-10-07T08:50:00.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.831+0000 7f4a6679e700 1 -- 172.21.15.81:0/462723816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a60153040 con 0x7f4a6006e6d0 2023-10-07T08:50:00.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.831+0000 7f4a6679e700 1 -- 172.21.15.81:0/462723816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a601534b0 con 0x7f4a6006e6d0 2023-10-07T08:50:00.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.832+0000 7f4a5d7fa700 1 -- 172.21.15.81:0/462723816 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a50013680 con 0x7f4a6006e6d0 2023-10-07T08:50:00.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.832+0000 7f4a5d7fa700 1 --2- 172.21.15.81:0/462723816 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a4c066f30 0x7f4a4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:00.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.832+0000 7f4a64f9b700 1 --2- 172.21.15.81:0/462723816 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a4c066f30 0x7f4a4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:00.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.832+0000 7f4a5d7fa700 1 -- 172.21.15.81:0/462723816 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a50084760 con 0x7f4a6006e6d0 2023-10-07T08:50:00.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.833+0000 7f4a64f9b700 1 --2- 172.21.15.81:0/462723816 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a4c066f30 0x7f4a4c0693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4a6006ac10 tx=0x7f4a54017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:00.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:00.836+0000 7f4a5d7fa700 1 -- 172.21.15.81:0/462723816 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a500519d0 con 0x7f4a6006e6d0 2023-10-07T08:50:01.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.062+0000 7f4a6679e700 1 -- 172.21.15.81:0/462723816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4a601532c0 con 0x7f4a6006e6d0 2023-10-07T08:50:01.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.664+0000 7f4a5d7fa700 1 -- 172.21.15.81:0/462723816 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4a50054ff0 con 0x7f4a6006e6d0 2023-10-07T08:50:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.666+0000 7f4a6679e700 1 -- 172.21.15.81:0/462723816 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a4c066f30 msgr2=0x7f4a4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.666+0000 7f4a6679e700 1 --2- 172.21.15.81:0/462723816 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a4c066f30 0x7f4a4c0693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4a6006ac10 tx=0x7f4a54017000 comp rx=0 tx=0).stop 2023-10-07T08:50:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.666+0000 7f4a6679e700 1 -- 172.21.15.81:0/462723816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6006e6d0 msgr2=0x7f4a60169fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.666+0000 7f4a6679e700 1 --2- 172.21.15.81:0/462723816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6006e6d0 0x7f4a60169fe0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000ec80 tx=0x7f4a500091a0 comp rx=0 tx=0).stop 2023-10-07T08:50:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.666+0000 7f4a6679e700 1 -- 172.21.15.81:0/462723816 shutdown_connections 2023-10-07T08:50:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.666+0000 7f4a6679e700 1 --2- 172.21.15.81:0/462723816 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4a4c066f30 0x7f4a4c0693e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.666+0000 7f4a6679e700 1 --2- 172.21.15.81:0/462723816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a601522d0 0x7f4a600c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.666+0000 7f4a6679e700 1 --2- 172.21.15.81:0/462723816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a6006e6d0 0x7f4a60169fe0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.666+0000 7f4a6679e700 1 --2- 172.21.15.81:0/462723816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a60151f00 0x7f4a600b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.666+0000 7f4a6679e700 1 -- 172.21.15.81:0/462723816 >> 172.21.15.81:0/462723816 conn(0x7f4a6006bb90 msgr2=0x7f4a60150470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:01.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.666+0000 7f4a6679e700 1 -- 172.21.15.81:0/462723816 shutdown_connections 2023-10-07T08:50:01.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.666+0000 7f4a6679e700 1 -- 172.21.15.81:0/462723816 wait complete. 2023-10-07T08:50:01.682 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:50:01.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.795+0000 7fb848056700 1 Processor -- start 2023-10-07T08:50:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.795+0000 7fb848056700 1 -- start start 2023-10-07T08:50:01.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.796+0000 7fb848056700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb8401578d0 0x7fb8400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:01.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.796+0000 7fb848056700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400d07c0 con 0x7fb840157ca0 2023-10-07T08:50:01.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.796+0000 7fb848056700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400cfbb0 con 0x7fb84006d120 2023-10-07T08:50:01.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.796+0000 7fb848056700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8400cfe90 con 0x7fb8401578d0 2023-10-07T08:50:01.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.796+0000 7fb8455f1700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb840157ca0 0x7fb84015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33410/0 (socket says 172.21.15.81:33410) 2023-10-07T08:50:01.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.796+0000 7fb8455f1700 1 -- 172.21.15.81:0/2870453039 learned_addr learned my addr 172.21.15.81:0/2870453039 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:50:01.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.796+0000 7fb844df0700 1 -- 172.21.15.81:0/2870453039 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253904467 0 0) 0x7fb8400d07c0 con 0x7fb840157ca0 2023-10-07T08:50:01.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 -- 172.21.15.81:0/2870453039 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb82c003570 con 0x7fb840157ca0 2023-10-07T08:50:01.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb845df2700 1 --2- 172.21.15.81:0/2870453039 >> v2:172.21.15.89:3300/0 conn(0x7fb8401578d0 0x7fb8400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:01.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 -- 172.21.15.81:0/2870453039 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1493160935 0 0) 0x7fb82c003570 con 0x7fb840157ca0 2023-10-07T08:50:01.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 -- 172.21.15.81:0/2870453039 >> v2:172.21.15.89:3300/0 conn(0x7fb8401578d0 msgr2=0x7fb8400cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:01.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 --2- 172.21.15.81:0/2870453039 >> v2:172.21.15.89:3300/0 conn(0x7fb8401578d0 0x7fb8400cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:01.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 -- 172.21.15.81:0/2870453039 >> v1:172.21.15.89:6789/0 conn(0x7fb84006d120 legacy=0x7fb84006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:01.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 -- 172.21.15.81:0/2870453039 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400d0170 con 0x7fb840157ca0 2023-10-07T08:50:01.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 -- 172.21.15.81:0/2870453039 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fb830001470 con 0x7fb840157ca0 2023-10-07T08:50:01.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 -- 172.21.15.81:0/2870453039 >> v1:172.21.15.81:6789/0 conn(0x7fb840157ca0 legacy=0x7fb84015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:01.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 --2- 172.21.15.81:0/2870453039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb82c003a60 0x7fb82c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:01.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 --2- 172.21.15.81:0/2870453039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb82c004810 0x7fb82c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:01.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 --2- 172.21.15.81:0/2870453039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82c0052e0 0x7fb82c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:01.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 -- 172.21.15.81:0/2870453039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400cfe90 con 0x7fb82c0052e0 2023-10-07T08:50:01.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 -- 172.21.15.81:0/2870453039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c00c190 con 0x7fb82c003a60 2023-10-07T08:50:01.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 -- 172.21.15.81:0/2870453039 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c00c350 con 0x7fb82c004810 2023-10-07T08:50:01.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb8465f3700 1 --2- 172.21.15.81:0/2870453039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82c0052e0 0x7fb82c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:01.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb845df2700 1 --2- 172.21.15.81:0/2870453039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb82c003a60 0x7fb82c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:01.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb8455f1700 1 --2- 172.21.15.81:0/2870453039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb82c004810 0x7fb82c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:01.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb8465f3700 1 -- 172.21.15.81:0/2870453039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb82c004810 msgr2=0x7fb82c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:01.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb8465f3700 1 --2- 172.21.15.81:0/2870453039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb82c004810 0x7fb82c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:01.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb8465f3700 1 -- 172.21.15.81:0/2870453039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb82c003a60 msgr2=0x7fb82c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb8465f3700 1 --2- 172.21.15.81:0/2870453039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb82c003a60 0x7fb82c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb8465f3700 1 -- 172.21.15.81:0/2870453039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c003570 con 0x7fb82c0052e0 2023-10-07T08:50:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb8455f1700 1 --2- 172.21.15.81:0/2870453039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb82c004810 0x7fb82c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:50:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb8465f3700 1 -- 172.21.15.81:0/2870453039 reap_dead start 2023-10-07T08:50:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb8465f3700 1 --2- 172.21.15.81:0/2870453039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82c0052e0 0x7fb82c00ba60 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fb8380018b0 tx=0x7fb838007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cfc749bf0b36f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 -- 172.21.15.81:0/2870453039 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838012420 con 0x7fb82c0052e0 2023-10-07T08:50:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 -- 172.21.15.81:0/2870453039 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8380125a0 con 0x7fb82c0052e0 2023-10-07T08:50:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.797+0000 7fb844df0700 1 -- 172.21.15.81:0/2870453039 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838012960 con 0x7fb82c0052e0 2023-10-07T08:50:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.798+0000 7fb848056700 1 -- 172.21.15.81:0/2870453039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82c0052e0 msgr2=0x7fb82c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:01.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.798+0000 7fb848056700 1 --2- 172.21.15.81:0/2870453039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82c0052e0 0x7fb82c00ba60 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fb8380018b0 tx=0x7fb838007d30 comp rx=0 tx=0).stop 2023-10-07T08:50:01.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.798+0000 7fb848056700 1 -- 172.21.15.81:0/2870453039 shutdown_connections 2023-10-07T08:50:01.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.798+0000 7fb848056700 1 --2- 172.21.15.81:0/2870453039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb82c0052e0 0x7fb82c00ba60 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:01.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.798+0000 7fb848056700 1 -- 172.21.15.81:0/2870453039 >> 172.21.15.81:0/2870453039 conn(0x7fb84006bb90 msgr2=0x7fb84006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:01.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.798+0000 7fb848056700 1 -- 172.21.15.81:0/2870453039 shutdown_connections 2023-10-07T08:50:01.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.798+0000 7fb848056700 1 -- 172.21.15.81:0/2870453039 wait complete. 2023-10-07T08:50:01.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.799+0000 7fb848056700 1 Processor -- start 2023-10-07T08:50:01.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.799+0000 7fb848056700 1 -- start start 2023-10-07T08:50:01.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb848056700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb82c0052e0 0x7fb840155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:01.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb848056700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8400b2040 0x7fb84016da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:01.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb848056700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400b24b0 0x7fb84015c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:01.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb848056700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84016e520 con 0x7fb8400b24b0 2023-10-07T08:50:01.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb848056700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84016e800 con 0x7fb82c0052e0 2023-10-07T08:50:01.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb848056700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400b1840 con 0x7fb8400b2040 2023-10-07T08:50:01.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb8465f3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400b24b0 0x7fb84015c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:01.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb8465f3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400b24b0 0x7fb84015c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55512/0 (socket says 172.21.15.81:55512) 2023-10-07T08:50:01.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb8465f3700 1 -- 172.21.15.81:0/241573265 learned_addr learned my addr 172.21.15.81:0/241573265 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:01.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb845df2700 1 --2- 172.21.15.81:0/241573265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb82c0052e0 0x7fb840155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:01.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb8455f1700 1 --2- 172.21.15.81:0/241573265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8400b2040 0x7fb84016da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:01.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb8465f3700 1 -- 172.21.15.81:0/241573265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8400b2040 msgr2=0x7fb84016da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:01.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb8465f3700 1 --2- 172.21.15.81:0/241573265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8400b2040 0x7fb84016da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:01.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb8465f3700 1 -- 172.21.15.81:0/241573265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb82c0052e0 msgr2=0x7fb840155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:01.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb8465f3700 1 --2- 172.21.15.81:0/241573265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb82c0052e0 0x7fb840155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:01.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb8465f3700 1 -- 172.21.15.81:0/241573265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400b1b20 con 0x7fb8400b24b0 2023-10-07T08:50:01.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb8465f3700 1 --2- 172.21.15.81:0/241573265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400b24b0 0x7fb84015c7b0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fb84015b610 tx=0x7fb838015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:01.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.800+0000 7fb835ffb700 1 -- 172.21.15.81:0/241573265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838012420 con 0x7fb8400b24b0 2023-10-07T08:50:01.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.801+0000 7fb835ffb700 1 -- 172.21.15.81:0/241573265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb838001200 con 0x7fb8400b24b0 2023-10-07T08:50:01.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.801+0000 7fb848056700 1 -- 172.21.15.81:0/241573265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb840156160 con 0x7fb8400b24b0 2023-10-07T08:50:01.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.801+0000 7fb835ffb700 1 -- 172.21.15.81:0/241573265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83800ccf0 con 0x7fb8400b24b0 2023-10-07T08:50:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.801+0000 7fb848056700 1 -- 172.21.15.81:0/241573265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb840155b70 con 0x7fb8400b24b0 2023-10-07T08:50:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.802+0000 7fb848056700 1 -- 172.21.15.81:0/241573265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb840067ac0 con 0x7fb8400b24b0 2023-10-07T08:50:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.802+0000 7fb835ffb700 1 -- 172.21.15.81:0/241573265 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb838019070 con 0x7fb8400b24b0 2023-10-07T08:50:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.802+0000 7fb835ffb700 1 --2- 172.21.15.81:0/241573265 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb824066f30 0x7fb8240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.802+0000 7fb835ffb700 1 -- 172.21.15.81:0/241573265 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb838085760 con 0x7fb8400b24b0 2023-10-07T08:50:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.803+0000 7fb845df2700 1 --2- 172.21.15.81:0/241573265 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb824066f30 0x7fb8240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.803+0000 7fb845df2700 1 --2- 172.21.15.81:0/241573265 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb824066f30 0x7fb8240693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009560 tx=0x7fb83c009710 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:01.807+0000 7fb835ffb700 1 -- 172.21.15.81:0/241573265 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8380529d0 con 0x7fb8400b24b0 2023-10-07T08:50:02.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.028+0000 7fb848056700 1 -- 172.21.15.81:0/241573265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8400d0450 con 0x7fb8400b24b0 2023-10-07T08:50:02.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.028+0000 7fb835ffb700 1 -- 172.21.15.81:0/241573265 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fb838017090 con 0x7fb8400b24b0 2023-10-07T08:50:02.030 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:50:02.030 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1419112520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1419112520},{"type":"v1","addr":"172.21.15.89:6834","nonce":1419112520}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":6140,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2310402815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2310402815},{"type":"v1","addr":"172.21.15.89:6835","nonce":2310402815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7509,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2709799872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2709799872},{"type":"v1","addr":"172.21.15.81:6836","nonce":2709799872}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:49:58.023106+0000","modified":"2023-10-07T08:50:01.662857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7512":{"gid":7512,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/510483669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":510483669},{"type":"v1","addr":"172.21.15.81:6837","nonce":510483669}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-07T08:50:02.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.030+0000 7fb848056700 1 -- 172.21.15.81:0/241573265 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb824066f30 msgr2=0x7fb8240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.030+0000 7fb848056700 1 --2- 172.21.15.81:0/241573265 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb824066f30 0x7fb8240693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009560 tx=0x7fb83c009710 comp rx=0 tx=0).stop 2023-10-07T08:50:02.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.030+0000 7fb848056700 1 -- 172.21.15.81:0/241573265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400b24b0 msgr2=0x7fb84015c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.030+0000 7fb848056700 1 --2- 172.21.15.81:0/241573265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400b24b0 0x7fb84015c7b0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fb84015b610 tx=0x7fb838015000 comp rx=0 tx=0).stop 2023-10-07T08:50:02.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.030+0000 7fb848056700 1 -- 172.21.15.81:0/241573265 shutdown_connections 2023-10-07T08:50:02.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.030+0000 7fb848056700 1 --2- 172.21.15.81:0/241573265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400b24b0 0x7fb84015c7b0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.030+0000 7fb848056700 1 --2- 172.21.15.81:0/241573265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb82c0052e0 0x7fb840155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.030+0000 7fb848056700 1 --2- 172.21.15.81:0/241573265 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb824066f30 0x7fb8240693e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.030+0000 7fb848056700 1 --2- 172.21.15.81:0/241573265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8400b2040 0x7fb84016da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.030+0000 7fb848056700 1 -- 172.21.15.81:0/241573265 >> 172.21.15.81:0/241573265 conn(0x7fb84006bb90 msgr2=0x7fb840156af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.031+0000 7fb848056700 1 -- 172.21.15.81:0/241573265 shutdown_connections 2023-10-07T08:50:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.031+0000 7fb848056700 1 -- 172.21.15.81:0/241573265 wait complete. 2023-10-07T08:50:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 74 2023-10-07T08:50:02.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:50:02.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.156+0000 7f5c22f0d700 1 Processor -- start 2023-10-07T08:50:02.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.156+0000 7f5c22f0d700 1 -- start start 2023-10-07T08:50:02.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.156+0000 7f5c22f0d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c1c0ce1f0 0x7f5c1c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.156+0000 7f5c22f0d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5c1c0ce5c0 0x7f5c1c15e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.156+0000 7f5c22f0d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c1c15dfb0 con 0x7f5c1c0ac570 2023-10-07T08:50:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.156+0000 7f5c22f0d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c1c0acec0 con 0x7f5c1c0ce5c0 2023-10-07T08:50:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.156+0000 7f5c22f0d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c0ad1a0 con 0x7f5c1c0ce1f0 2023-10-07T08:50:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.157+0000 7f5c214aa700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5c1c0ac570 0x7f5c1c06e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33422/0 (socket says 172.21.15.81:33422) 2023-10-07T08:50:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.157+0000 7f5c214aa700 1 -- 172.21.15.81:0/352530594 learned_addr learned my addr 172.21.15.81:0/352530594 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:50:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.157+0000 7f5c20ca9700 1 --2- 172.21.15.81:0/352530594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c1c0ce1f0 0x7f5c1c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.157+0000 7f5c13fff700 1 --2- 172.21.15.81:0/352530594 >> v2:172.21.15.89:3300/0 conn(0x7f5c1c0ce5c0 0x7f5c1c15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.157+0000 7f5c137fe700 1 -- 172.21.15.81:0/352530594 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936968438 0 0) 0x7f5c1c15dfb0 con 0x7f5c1c0ac570 2023-10-07T08:50:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.157+0000 7f5c137fe700 1 -- 172.21.15.81:0/352530594 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c04003570 con 0x7f5c1c0ac570 2023-10-07T08:50:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.157+0000 7f5c13fff700 1 -- 172.21.15.81:0/352530594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c1c0ce1f0 msgr2=0x7f5c1c0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.157+0000 7f5c13fff700 1 --2- 172.21.15.81:0/352530594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c1c0ce1f0 0x7f5c1c0aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.157+0000 7f5c13fff700 1 -- 172.21.15.81:0/352530594 >> v1:172.21.15.81:6789/0 conn(0x7f5c1c0ac570 legacy=0x7f5c1c06e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.157+0000 7f5c13fff700 1 -- 172.21.15.81:0/352530594 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c15dc40 con 0x7f5c1c0ce5c0 2023-10-07T08:50:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.157+0000 7f5c20ca9700 1 --2- 172.21.15.81:0/352530594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c1c0ce1f0 0x7f5c1c0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:50:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.157+0000 7f5c13fff700 1 --2- 172.21.15.81:0/352530594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c1c0ce5c0 0x7f5c1c15e440 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0098e0 tx=0x7f5c0c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65efd50431564ff6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.157+0000 7f5c137fe700 1 -- 172.21.15.81:0/352530594 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c011630 con 0x7f5c1c0ce5c0 2023-10-07T08:50:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.157+0000 7f5c137fe700 1 -- 172.21.15.81:0/352530594 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c011790 con 0x7f5c1c0ce5c0 2023-10-07T08:50:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.157+0000 7f5c137fe700 1 -- 172.21.15.81:0/352530594 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c011b10 con 0x7f5c1c0ce5c0 2023-10-07T08:50:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.158+0000 7f5c22f0d700 1 -- 172.21.15.81:0/352530594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c1c0ce5c0 msgr2=0x7f5c1c15e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.158+0000 7f5c22f0d700 1 --2- 172.21.15.81:0/352530594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c1c0ce5c0 0x7f5c1c15e440 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0098e0 tx=0x7f5c0c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.158+0000 7f5c22f0d700 1 -- 172.21.15.81:0/352530594 shutdown_connections 2023-10-07T08:50:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.158+0000 7f5c22f0d700 1 --2- 172.21.15.81:0/352530594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c1c0ce1f0 0x7f5c1c0aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.158+0000 7f5c22f0d700 1 --2- 172.21.15.81:0/352530594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c1c0ce5c0 0x7f5c1c15e440 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.158+0000 7f5c22f0d700 1 -- 172.21.15.81:0/352530594 >> 172.21.15.81:0/352530594 conn(0x7f5c1c06cca0 msgr2=0x7f5c1c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.158+0000 7f5c22f0d700 1 -- 172.21.15.81:0/352530594 shutdown_connections 2023-10-07T08:50:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.158+0000 7f5c22f0d700 1 -- 172.21.15.81:0/352530594 wait complete. 2023-10-07T08:50:02.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.159+0000 7f5c22f0d700 1 Processor -- start 2023-10-07T08:50:02.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.159+0000 7f5c22f0d700 1 -- start start 2023-10-07T08:50:02.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c22f0d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c1c0ac570 0x7f5c1c15b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c22f0d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c0ce1f0 0x7f5c1c14a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c22f0d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c1c0ce5c0 0x7f5c1c15bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c22f0d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c0b0f50 con 0x7f5c1c0ce1f0 2023-10-07T08:50:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c22f0d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c0b1ad0 con 0x7f5c1c0ac570 2023-10-07T08:50:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c22f0d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c14aaa0 con 0x7f5c1c0ce5c0 2023-10-07T08:50:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c13fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c0ce1f0 0x7f5c1c14a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c13fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c0ce1f0 0x7f5c1c14a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55514/0 (socket says 172.21.15.81:55514) 2023-10-07T08:50:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c13fff700 1 -- 172.21.15.81:0/291808241 learned_addr learned my addr 172.21.15.81:0/291808241 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c20ca9700 1 --2- 172.21.15.81:0/291808241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c1c0ac570 0x7f5c1c15b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c214aa700 1 --2- 172.21.15.81:0/291808241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c1c0ce5c0 0x7f5c1c15bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c13fff700 1 -- 172.21.15.81:0/291808241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c1c0ce5c0 msgr2=0x7f5c1c15bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c13fff700 1 --2- 172.21.15.81:0/291808241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c1c0ce5c0 0x7f5c1c15bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c13fff700 1 -- 172.21.15.81:0/291808241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c1c0ac570 msgr2=0x7f5c1c15b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c13fff700 1 --2- 172.21.15.81:0/291808241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c1c0ac570 0x7f5c1c15b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c13fff700 1 -- 172.21.15.81:0/291808241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c18009a20 con 0x7f5c1c0ce1f0 2023-10-07T08:50:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.160+0000 7f5c20ca9700 1 --2- 172.21.15.81:0/291808241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c1c0ac570 0x7f5c1c15b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:50:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.161+0000 7f5c13fff700 1 --2- 172.21.15.81:0/291808241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c0ce1f0 0x7f5c1c14a560 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009ed0 tx=0x7f5c0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.161+0000 7f5c10ff9700 1 -- 172.21.15.81:0/291808241 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c011b10 con 0x7f5c1c0ce1f0 2023-10-07T08:50:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.161+0000 7f5c10ff9700 1 -- 172.21.15.81:0/291808241 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c000cc0 con 0x7f5c1c0ce1f0 2023-10-07T08:50:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.161+0000 7f5c22f0d700 1 -- 172.21.15.81:0/291808241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0c009420 con 0x7f5c1c0ce1f0 2023-10-07T08:50:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.161+0000 7f5c10ff9700 1 -- 172.21.15.81:0/291808241 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c0276a0 con 0x7f5c1c0ce1f0 2023-10-07T08:50:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.161+0000 7f5c22f0d700 1 -- 172.21.15.81:0/291808241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1c0b1480 con 0x7f5c1c0ce1f0 2023-10-07T08:50:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.162+0000 7f5c22f0d700 1 -- 172.21.15.81:0/291808241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1c068900 con 0x7f5c1c0ce1f0 2023-10-07T08:50:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.162+0000 7f5c10ff9700 1 -- 172.21.15.81:0/291808241 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c0c027ad0 con 0x7f5c1c0ce1f0 2023-10-07T08:50:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.162+0000 7f5c10ff9700 1 --2- 172.21.15.81:0/291808241 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5c08066f30 0x7f5c080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.162+0000 7f5c10ff9700 1 -- 172.21.15.81:0/291808241 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c0c0864e0 con 0x7f5c1c0ce1f0 2023-10-07T08:50:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.163+0000 7f5c20ca9700 1 --2- 172.21.15.81:0/291808241 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5c08066f30 0x7f5c080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.163+0000 7f5c20ca9700 1 --2- 172.21.15.81:0/291808241 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5c08066f30 0x7f5c080693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5c180099f0 tx=0x7f5c1800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:02.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.167+0000 7f5c10ff9700 1 -- 172.21.15.81:0/291808241 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c0c053750 con 0x7f5c1c0ce1f0 2023-10-07T08:50:02.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.347+0000 7f5c22f0d700 1 -- 172.21.15.81:0/291808241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c1c15e980 con 0x7f5c1c0ce1f0 2023-10-07T08:50:02.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.348+0000 7f5c10ff9700 1 -- 172.21.15.81:0/291808241 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+15317 (secure 0 0 0) 0x7f5c0c056d70 con 0x7f5c1c0ce1f0 2023-10-07T08:50:02.349 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:50:02.349 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":156,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:49:59.291975+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:49:56.356539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-07T08:49:56.981204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:50:02.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.350+0000 7f5c22f0d700 1 -- 172.21.15.81:0/291808241 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5c08066f30 msgr2=0x7f5c080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.350+0000 7f5c22f0d700 1 --2- 172.21.15.81:0/291808241 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5c08066f30 0x7f5c080693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5c180099f0 tx=0x7f5c1800b040 comp rx=0 tx=0).stop 2023-10-07T08:50:02.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.350+0000 7f5c22f0d700 1 -- 172.21.15.81:0/291808241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c0ce1f0 msgr2=0x7f5c1c14a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.350+0000 7f5c22f0d700 1 --2- 172.21.15.81:0/291808241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c0ce1f0 0x7f5c1c14a560 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009ed0 tx=0x7f5c0c017000 comp rx=0 tx=0).stop 2023-10-07T08:50:02.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.350+0000 7f5c22f0d700 1 -- 172.21.15.81:0/291808241 shutdown_connections 2023-10-07T08:50:02.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.350+0000 7f5c22f0d700 1 --2- 172.21.15.81:0/291808241 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5c08066f30 0x7f5c080693e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.350+0000 7f5c22f0d700 1 --2- 172.21.15.81:0/291808241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c1c0ce5c0 0x7f5c1c15bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.350+0000 7f5c22f0d700 1 --2- 172.21.15.81:0/291808241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c1c0ac570 0x7f5c1c15b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.350+0000 7f5c22f0d700 1 --2- 172.21.15.81:0/291808241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c0ce1f0 0x7f5c1c14a560 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.350+0000 7f5c22f0d700 1 -- 172.21.15.81:0/291808241 >> 172.21.15.81:0/291808241 conn(0x7f5c1c06cca0 msgr2=0x7f5c1c156710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:02.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.350+0000 7f5c22f0d700 1 -- 172.21.15.81:0/291808241 shutdown_connections 2023-10-07T08:50:02.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.350+0000 7f5c22f0d700 1 -- 172.21.15.81:0/291808241 wait complete. 2023-10-07T08:50:02.363 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T08:50:02.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:50:02.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.476+0000 7fdca5091700 1 Processor -- start 2023-10-07T08:50:02.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.476+0000 7fdca5091700 1 -- start start 2023-10-07T08:50:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdca5091700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdca01578d0 0x7fdca00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdca5091700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca0157ca0 0x7fdca015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdca5091700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca00d07c0 con 0x7fdca006d120 2023-10-07T08:50:02.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdca5091700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca00cfbb0 con 0x7fdca01578d0 2023-10-07T08:50:02.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdca5091700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00cfe90 con 0x7fdca0157ca0 2023-10-07T08:50:02.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdc9ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdca01578d0 0x7fdca00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdc9ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdca01578d0 0x7fdca00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53388/0 (socket says 172.21.15.81:53388) 2023-10-07T08:50:02.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdc9ed9d700 1 -- 172.21.15.81:0/2865278119 learned_addr learned my addr 172.21.15.81:0/2865278119 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:02.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdc9e59c700 1 --2- 172.21.15.81:0/2865278119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca0157ca0 0x7fdca015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdc9ed9d700 1 -- 172.21.15.81:0/2865278119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca0157ca0 msgr2=0x7fdca015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:02.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdc9ed9d700 1 --2- 172.21.15.81:0/2865278119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca0157ca0 0x7fdca015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdc9ed9d700 1 -- 172.21.15.81:0/2865278119 >> v1:172.21.15.89:6789/0 conn(0x7fdca006d120 legacy=0x7fdca015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:02.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdc9ed9d700 1 -- 172.21.15.81:0/2865278119 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca00d0170 con 0x7fdca01578d0 2023-10-07T08:50:02.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdc9ed9d700 1 --2- 172.21.15.81:0/2865278119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca01578d0 0x7fdca00cf4f0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fdc900099b0 tx=0x7fdc90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5899e84661dbe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:02.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdc9dd9b700 1 -- 172.21.15.81:0/2865278119 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9000b820 con 0x7fdca01578d0 2023-10-07T08:50:02.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdc9dd9b700 1 -- 172.21.15.81:0/2865278119 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9000b980 con 0x7fdca01578d0 2023-10-07T08:50:02.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.477+0000 7fdc9dd9b700 1 -- 172.21.15.81:0/2865278119 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9000bd20 con 0x7fdca01578d0 2023-10-07T08:50:02.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.478+0000 7fdca5091700 1 -- 172.21.15.81:0/2865278119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca01578d0 msgr2=0x7fdca00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.478+0000 7fdca5091700 1 --2- 172.21.15.81:0/2865278119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca01578d0 0x7fdca00cf4f0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fdc900099b0 tx=0x7fdc90009250 comp rx=0 tx=0).stop 2023-10-07T08:50:02.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.478+0000 7fdca5091700 1 -- 172.21.15.81:0/2865278119 shutdown_connections 2023-10-07T08:50:02.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.478+0000 7fdca5091700 1 --2- 172.21.15.81:0/2865278119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca01578d0 0x7fdca00cf4f0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.478+0000 7fdca5091700 1 --2- 172.21.15.81:0/2865278119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca0157ca0 0x7fdca015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.478+0000 7fdca5091700 1 -- 172.21.15.81:0/2865278119 >> 172.21.15.81:0/2865278119 conn(0x7fdca006bb90 msgr2=0x7fdca006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:02.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.478+0000 7fdca5091700 1 -- 172.21.15.81:0/2865278119 shutdown_connections 2023-10-07T08:50:02.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.478+0000 7fdca5091700 1 -- 172.21.15.81:0/2865278119 wait complete. 2023-10-07T08:50:02.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.479+0000 7fdca5091700 1 Processor -- start 2023-10-07T08:50:02.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.479+0000 7fdca5091700 1 -- start start 2023-10-07T08:50:02.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdca5091700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca006d120 0x7fdca00c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdca5091700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdca01578d0 0x7fdca00c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdca5091700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca0157ca0 0x7fdca00b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdca5091700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00c6f80 con 0x7fdca0157ca0 2023-10-07T08:50:02.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdca5091700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00b4320 con 0x7fdca01578d0 2023-10-07T08:50:02.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdca5091700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00c6a20 con 0x7fdca006d120 2023-10-07T08:50:02.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdc9f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca0157ca0 0x7fdca00b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdc9f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca0157ca0 0x7fdca00b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53398/0 (socket says 172.21.15.81:53398) 2023-10-07T08:50:02.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdc9f59e700 1 -- 172.21.15.81:0/2187336200 learned_addr learned my addr 172.21.15.81:0/2187336200 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:02.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdc9e59c700 1 --2- 172.21.15.81:0/2187336200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdca01578d0 0x7fdca00c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdc9ed9d700 1 --2- 172.21.15.81:0/2187336200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca006d120 0x7fdca00c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdc9f59e700 1 -- 172.21.15.81:0/2187336200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca006d120 msgr2=0x7fdca00c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdc9f59e700 1 --2- 172.21.15.81:0/2187336200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca006d120 0x7fdca00c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdc9f59e700 1 -- 172.21.15.81:0/2187336200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdca01578d0 msgr2=0x7fdca00c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdc9f59e700 1 --2- 172.21.15.81:0/2187336200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdca01578d0 0x7fdca00c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdc9f59e700 1 -- 172.21.15.81:0/2187336200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc900094f0 con 0x7fdca0157ca0 2023-10-07T08:50:02.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.480+0000 7fdc9f59e700 1 --2- 172.21.15.81:0/2187336200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca0157ca0 0x7fdca00b5ee0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800c930 tx=0x7fdc980026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:02.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.481+0000 7fdc86ffd700 1 -- 172.21.15.81:0/2187336200 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98012630 con 0x7fdca0157ca0 2023-10-07T08:50:02.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.481+0000 7fdc86ffd700 1 -- 172.21.15.81:0/2187336200 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc980127d0 con 0x7fdca0157ca0 2023-10-07T08:50:02.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.481+0000 7fdca5091700 1 -- 172.21.15.81:0/2187336200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca00c6ca0 con 0x7fdca0157ca0 2023-10-07T08:50:02.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.481+0000 7fdc86ffd700 1 -- 172.21.15.81:0/2187336200 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98012b90 con 0x7fdca0157ca0 2023-10-07T08:50:02.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.481+0000 7fdca5091700 1 -- 172.21.15.81:0/2187336200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca00b3fb0 con 0x7fdca0157ca0 2023-10-07T08:50:02.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.482+0000 7fdca5091700 1 -- 172.21.15.81:0/2187336200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca00b44b0 con 0x7fdca0157ca0 2023-10-07T08:50:02.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.482+0000 7fdc86ffd700 1 -- 172.21.15.81:0/2187336200 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc9801b400 con 0x7fdca0157ca0 2023-10-07T08:50:02.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.482+0000 7fdc86ffd700 1 --2- 172.21.15.81:0/2187336200 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc8c066f30 0x7fdc8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.482+0000 7fdc86ffd700 1 -- 172.21.15.81:0/2187336200 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdc98084810 con 0x7fdca0157ca0 2023-10-07T08:50:02.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.482+0000 7fdc9ed9d700 1 --2- 172.21.15.81:0/2187336200 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc8c066f30 0x7fdc8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.483+0000 7fdc9ed9d700 1 --2- 172.21.15.81:0/2187336200 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc8c066f30 0x7fdc8c0693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdc900099b0 tx=0x7fdc90016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:02.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.486+0000 7fdc86ffd700 1 -- 172.21.15.81:0/2187336200 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc98051a80 con 0x7fdca0157ca0 2023-10-07T08:50:02.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.667+0000 7fdca5091700 1 -- 172.21.15.81:0/2187336200 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdca00d0450 con 0x7fdc8c066f30 2023-10-07T08:50:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.675+0000 7fdc86ffd700 1 -- 172.21.15.81:0/2187336200 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285392 (secure 0 0 0) 0x7fdca00d0450 con 0x7fdc8c066f30 2023-10-07T08:50:02.681 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:50:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.679+0000 7fdca5091700 1 -- 172.21.15.81:0/2187336200 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc8c066f30 msgr2=0x7fdc8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.679+0000 7fdca5091700 1 --2- 172.21.15.81:0/2187336200 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc8c066f30 0x7fdc8c0693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdc900099b0 tx=0x7fdc90016000 comp rx=0 tx=0).stop 2023-10-07T08:50:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.679+0000 7fdca5091700 1 -- 172.21.15.81:0/2187336200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca0157ca0 msgr2=0x7fdca00b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.679+0000 7fdca5091700 1 --2- 172.21.15.81:0/2187336200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca0157ca0 0x7fdca00b5ee0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800c930 tx=0x7fdc980026e0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.679+0000 7fdca5091700 1 -- 172.21.15.81:0/2187336200 shutdown_connections 2023-10-07T08:50:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.679+0000 7fdca5091700 1 --2- 172.21.15.81:0/2187336200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca0157ca0 0x7fdca00b5ee0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.679+0000 7fdca5091700 1 --2- 172.21.15.81:0/2187336200 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc8c066f30 0x7fdc8c0693e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.679+0000 7fdca5091700 1 --2- 172.21.15.81:0/2187336200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca006d120 0x7fdca00c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.679+0000 7fdca5091700 1 --2- 172.21.15.81:0/2187336200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdca01578d0 0x7fdca00c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.679+0000 7fdca5091700 1 -- 172.21.15.81:0/2187336200 >> 172.21.15.81:0/2187336200 conn(0x7fdca006bb90 msgr2=0x7fdca006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.679+0000 7fdca5091700 1 -- 172.21.15.81:0/2187336200 shutdown_connections 2023-10-07T08:50:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.679+0000 7fdca5091700 1 -- 172.21.15.81:0/2187336200 wait complete. 2023-10-07T08:50:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:50:02.692 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":366,"stamp":"2023-10-07T08:50:02.096641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554625,"statfs":{"total":1600000000,"available":1591936964,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.464448"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305750+0000","last_change":"2023-10-07T08:49:58.304602+0000","last_active":"2023-10-07T08:49:58.305750+0000","last_peered":"2023-10-07T08:49:58.305750+0000","last_clean":"2023-10-07T08:49:58.305750+0000","last_became_active":"2023-10-07T08:49:58.304146+0000","last_became_peered":"2023-10-07T08:49:58.304146+0000","last_unstale":"2023-10-07T08:49:58.305750+0000","last_undegraded":"2023-10-07T08:49:58.305750+0000","last_fullsized":"2023-10-07T08:49:58.305750+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:39:41.470438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.307029+0000","last_change":"2023-10-07T08:49:58.306967+0000","last_active":"2023-10-07T08:49:58.307029+0000","last_peered":"2023-10-07T08:49:58.307029+0000","last_clean":"2023-10-07T08:49:58.307029+0000","last_became_active":"2023-10-07T08:49:58.306741+0000","last_became_peered":"2023-10-07T08:49:58.306741+0000","last_unstale":"2023-10-07T08:49:58.307029+0000","last_undegraded":"2023-10-07T08:49:58.307029+0000","last_fullsized":"2023-10-07T08:49:58.307029+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:54:45.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.308123+0000","last_change":"2023-10-07T08:49:58.307753+0000","last_active":"2023-10-07T08:49:58.308123+0000","last_peered":"2023-10-07T08:49:58.308123+0000","last_clean":"2023-10-07T08:49:58.308123+0000","last_became_active":"2023-10-07T08:49:58.306938+0000","last_became_peered":"2023-10-07T08:49:58.306938+0000","last_unstale":"2023-10-07T08:49:58.308123+0000","last_undegraded":"2023-10-07T08:49:58.308123+0000","last_fullsized":"2023-10-07T08:49:58.308123+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:01:35.520777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.304496+0000","last_change":"2023-10-07T08:49:58.304341+0000","last_active":"2023-10-07T08:49:58.304496+0000","last_peered":"2023-10-07T08:49:58.304496+0000","last_clean":"2023-10-07T08:49:58.304496+0000","last_became_active":"2023-10-07T08:49:58.303104+0000","last_became_peered":"2023-10-07T08:49:58.303104+0000","last_unstale":"2023-10-07T08:49:58.304496+0000","last_undegraded":"2023-10-07T08:49:58.304496+0000","last_fullsized":"2023-10-07T08:49:58.304496+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:20.135014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305201+0000","last_change":"2023-10-07T08:49:58.304646+0000","last_active":"2023-10-07T08:49:58.305201+0000","last_peered":"2023-10-07T08:49:58.305201+0000","last_clean":"2023-10-07T08:49:58.305201+0000","last_became_active":"2023-10-07T08:49:58.304429+0000","last_became_peered":"2023-10-07T08:49:58.304429+0000","last_unstale":"2023-10-07T08:49:58.305201+0000","last_undegraded":"2023-10-07T08:49:58.305201+0000","last_fullsized":"2023-10-07T08:49:58.305201+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:46:38.979504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.304514+0000","last_change":"2023-10-07T08:49:58.304354+0000","last_active":"2023-10-07T08:49:58.304514+0000","last_peered":"2023-10-07T08:49:58.304514+0000","last_clean":"2023-10-07T08:49:58.304514+0000","last_became_active":"2023-10-07T08:49:58.303075+0000","last_became_peered":"2023-10-07T08:49:58.303075+0000","last_unstale":"2023-10-07T08:49:58.304514+0000","last_undegraded":"2023-10-07T08:49:58.304514+0000","last_fullsized":"2023-10-07T08:49:58.304514+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:51:58.054532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.311995+0000","last_change":"2023-10-07T08:49:58.311820+0000","last_active":"2023-10-07T08:49:58.311995+0000","last_peered":"2023-10-07T08:49:58.311995+0000","last_clean":"2023-10-07T08:49:58.311995+0000","last_became_active":"2023-10-07T08:49:58.311615+0000","last_became_peered":"2023-10-07T08:49:58.311615+0000","last_unstale":"2023-10-07T08:49:58.311995+0000","last_undegraded":"2023-10-07T08:49:58.311995+0000","last_fullsized":"2023-10-07T08:49:58.311995+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:39:36.972343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.308107+0000","last_change":"2023-10-07T08:49:58.307477+0000","last_active":"2023-10-07T08:49:58.308107+0000","last_peered":"2023-10-07T08:49:58.308107+0000","last_clean":"2023-10-07T08:49:58.308107+0000","last_became_active":"2023-10-07T08:49:58.306485+0000","last_became_peered":"2023-10-07T08:49:58.306485+0000","last_unstale":"2023-10-07T08:49:58.308107+0000","last_undegraded":"2023-10-07T08:49:58.308107+0000","last_fullsized":"2023-10-07T08:49:58.308107+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:57.153637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.309731+0000","last_change":"2023-10-07T08:49:58.309666+0000","last_active":"2023-10-07T08:49:58.309731+0000","last_peered":"2023-10-07T08:49:58.309731+0000","last_clean":"2023-10-07T08:49:58.309731+0000","last_became_active":"2023-10-07T08:49:58.309431+0000","last_became_peered":"2023-10-07T08:49:58.309431+0000","last_unstale":"2023-10-07T08:49:58.309731+0000","last_undegraded":"2023-10-07T08:49:58.309731+0000","last_fullsized":"2023-10-07T08:49:58.309731+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:14:24.842431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305908+0000","last_change":"2023-10-07T08:49:58.305239+0000","last_active":"2023-10-07T08:49:58.305908+0000","last_peered":"2023-10-07T08:49:58.305908+0000","last_clean":"2023-10-07T08:49:58.305908+0000","last_became_active":"2023-10-07T08:49:58.304806+0000","last_became_peered":"2023-10-07T08:49:58.304806+0000","last_unstale":"2023-10-07T08:49:58.305908+0000","last_undegraded":"2023-10-07T08:49:58.305908+0000","last_fullsized":"2023-10-07T08:49:58.305908+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:52.739655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303699+0000","last_change":"2023-10-07T08:49:58.303136+0000","last_active":"2023-10-07T08:49:58.303699+0000","last_peered":"2023-10-07T08:49:58.303699+0000","last_clean":"2023-10-07T08:49:58.303699+0000","last_became_active":"2023-10-07T08:49:58.302913+0000","last_became_peered":"2023-10-07T08:49:58.302913+0000","last_unstale":"2023-10-07T08:49:58.303699+0000","last_undegraded":"2023-10-07T08:49:58.303699+0000","last_fullsized":"2023-10-07T08:49:58.303699+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:11:39.031254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.310317+0000","last_change":"2023-10-07T08:49:58.310256+0000","last_active":"2023-10-07T08:49:58.310317+0000","last_peered":"2023-10-07T08:49:58.310317+0000","last_clean":"2023-10-07T08:49:58.310317+0000","last_became_active":"2023-10-07T08:49:58.308501+0000","last_became_peered":"2023-10-07T08:49:58.308501+0000","last_unstale":"2023-10-07T08:49:58.310317+0000","last_undegraded":"2023-10-07T08:49:58.310317+0000","last_fullsized":"2023-10-07T08:49:58.310317+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:33:56.515903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303642+0000","last_change":"2023-10-07T08:49:58.303533+0000","last_active":"2023-10-07T08:49:58.303642+0000","last_peered":"2023-10-07T08:49:58.303642+0000","last_clean":"2023-10-07T08:49:58.303642+0000","last_became_active":"2023-10-07T08:49:58.303323+0000","last_became_peered":"2023-10-07T08:49:58.303323+0000","last_unstale":"2023-10-07T08:49:58.303642+0000","last_undegraded":"2023-10-07T08:49:58.303642+0000","last_fullsized":"2023-10-07T08:49:58.303642+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:37:08.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303595+0000","last_change":"2023-10-07T08:49:58.303544+0000","last_active":"2023-10-07T08:49:58.303595+0000","last_peered":"2023-10-07T08:49:58.303595+0000","last_clean":"2023-10-07T08:49:58.303595+0000","last_became_active":"2023-10-07T08:49:58.303321+0000","last_became_peered":"2023-10-07T08:49:58.303321+0000","last_unstale":"2023-10-07T08:49:58.303595+0000","last_undegraded":"2023-10-07T08:49:58.303595+0000","last_fullsized":"2023-10-07T08:49:58.303595+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:16:28.295731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305780+0000","last_change":"2023-10-07T08:49:58.305480+0000","last_active":"2023-10-07T08:49:58.305780+0000","last_peered":"2023-10-07T08:49:58.305780+0000","last_clean":"2023-10-07T08:49:58.305780+0000","last_became_active":"2023-10-07T08:49:58.305118+0000","last_became_peered":"2023-10-07T08:49:58.305118+0000","last_unstale":"2023-10-07T08:49:58.305780+0000","last_undegraded":"2023-10-07T08:49:58.305780+0000","last_fullsized":"2023-10-07T08:49:58.305780+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:42.992130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.302607+0000","last_change":"2023-10-07T08:49:58.302376+0000","last_active":"2023-10-07T08:49:58.302607+0000","last_peered":"2023-10-07T08:49:58.302607+0000","last_clean":"2023-10-07T08:49:58.302607+0000","last_became_active":"2023-10-07T08:49:58.301824+0000","last_became_peered":"2023-10-07T08:49:58.301824+0000","last_unstale":"2023-10-07T08:49:58.302607+0000","last_undegraded":"2023-10-07T08:49:58.302607+0000","last_fullsized":"2023-10-07T08:49:58.302607+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:35:15.478012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.309196+0000","last_change":"2023-10-07T08:49:58.309028+0000","last_active":"2023-10-07T08:49:58.309196+0000","last_peered":"2023-10-07T08:49:58.309196+0000","last_clean":"2023-10-07T08:49:58.309196+0000","last_became_active":"2023-10-07T08:49:58.308525+0000","last_became_peered":"2023-10-07T08:49:58.308525+0000","last_unstale":"2023-10-07T08:49:58.309196+0000","last_undegraded":"2023-10-07T08:49:58.309196+0000","last_fullsized":"2023-10-07T08:49:58.309196+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:56.058297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303806+0000","last_change":"2023-10-07T08:49:58.303756+0000","last_active":"2023-10-07T08:49:58.303806+0000","last_peered":"2023-10-07T08:49:58.303806+0000","last_clean":"2023-10-07T08:49:58.303806+0000","last_became_active":"2023-10-07T08:49:58.303434+0000","last_became_peered":"2023-10-07T08:49:58.303434+0000","last_unstale":"2023-10-07T08:49:58.303806+0000","last_undegraded":"2023-10-07T08:49:58.303806+0000","last_fullsized":"2023-10-07T08:49:58.303806+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:55:49.566662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303719+0000","last_change":"2023-10-07T08:49:58.303597+0000","last_active":"2023-10-07T08:49:58.303719+0000","last_peered":"2023-10-07T08:49:58.303719+0000","last_clean":"2023-10-07T08:49:58.303719+0000","last_became_active":"2023-10-07T08:49:58.303367+0000","last_became_peered":"2023-10-07T08:49:58.303367+0000","last_unstale":"2023-10-07T08:49:58.303719+0000","last_undegraded":"2023-10-07T08:49:58.303719+0000","last_fullsized":"2023-10-07T08:49:58.303719+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:06:59.599657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.302328+0000","last_change":"2023-10-07T08:49:58.302222+0000","last_active":"2023-10-07T08:49:58.302328+0000","last_peered":"2023-10-07T08:49:58.302328+0000","last_clean":"2023-10-07T08:49:58.302328+0000","last_became_active":"2023-10-07T08:49:58.301997+0000","last_became_peered":"2023-10-07T08:49:58.301997+0000","last_unstale":"2023-10-07T08:49:58.302328+0000","last_undegraded":"2023-10-07T08:49:58.302328+0000","last_fullsized":"2023-10-07T08:49:58.302328+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:18:26.953352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.309295+0000","last_change":"2023-10-07T08:49:58.309207+0000","last_active":"2023-10-07T08:49:58.309295+0000","last_peered":"2023-10-07T08:49:58.309295+0000","last_clean":"2023-10-07T08:49:58.309295+0000","last_became_active":"2023-10-07T08:49:58.308449+0000","last_became_peered":"2023-10-07T08:49:58.308449+0000","last_unstale":"2023-10-07T08:49:58.309295+0000","last_undegraded":"2023-10-07T08:49:58.309295+0000","last_fullsized":"2023-10-07T08:49:58.309295+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:52:37.990301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.306168+0000","last_change":"2023-10-07T08:49:58.306102+0000","last_active":"2023-10-07T08:49:58.306168+0000","last_peered":"2023-10-07T08:49:58.306168+0000","last_clean":"2023-10-07T08:49:58.306168+0000","last_became_active":"2023-10-07T08:49:58.305155+0000","last_became_peered":"2023-10-07T08:49:58.305155+0000","last_unstale":"2023-10-07T08:49:58.306168+0000","last_undegraded":"2023-10-07T08:49:58.306168+0000","last_fullsized":"2023-10-07T08:49:58.306168+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:04:59.177322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.308138+0000","last_change":"2023-10-07T08:49:58.307994+0000","last_active":"2023-10-07T08:49:58.308138+0000","last_peered":"2023-10-07T08:49:58.308138+0000","last_clean":"2023-10-07T08:49:58.308138+0000","last_became_active":"2023-10-07T08:49:58.307230+0000","last_became_peered":"2023-10-07T08:49:58.307230+0000","last_unstale":"2023-10-07T08:49:58.308138+0000","last_undegraded":"2023-10-07T08:49:58.308138+0000","last_fullsized":"2023-10-07T08:49:58.308138+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:42.892793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.299919+0000","last_change":"2023-10-07T08:49:58.299861+0000","last_active":"2023-10-07T08:49:58.299919+0000","last_peered":"2023-10-07T08:49:58.299919+0000","last_clean":"2023-10-07T08:49:58.299919+0000","last_became_active":"2023-10-07T08:49:58.299577+0000","last_became_peered":"2023-10-07T08:49:58.299577+0000","last_unstale":"2023-10-07T08:49:58.299919+0000","last_undegraded":"2023-10-07T08:49:58.299919+0000","last_fullsized":"2023-10-07T08:49:58.299919+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:41:55.649395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.306272+0000","last_change":"2023-10-07T08:49:58.306211+0000","last_active":"2023-10-07T08:49:58.306272+0000","last_peered":"2023-10-07T08:49:58.306272+0000","last_clean":"2023-10-07T08:49:58.306272+0000","last_became_active":"2023-10-07T08:49:58.306031+0000","last_became_peered":"2023-10-07T08:49:58.306031+0000","last_unstale":"2023-10-07T08:49:58.306272+0000","last_undegraded":"2023-10-07T08:49:58.306272+0000","last_fullsized":"2023-10-07T08:49:58.306272+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:01:35.520777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.302623+0000","last_change":"2023-10-07T08:49:58.302512+0000","last_active":"2023-10-07T08:49:58.302623+0000","last_peered":"2023-10-07T08:49:58.302623+0000","last_clean":"2023-10-07T08:49:58.302623+0000","last_became_active":"2023-10-07T08:49:58.302125+0000","last_became_peered":"2023-10-07T08:49:58.302125+0000","last_unstale":"2023-10-07T08:49:58.302623+0000","last_undegraded":"2023-10-07T08:49:58.302623+0000","last_fullsized":"2023-10-07T08:49:58.302623+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:10:21.374121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.307174+0000","last_change":"2023-10-07T08:49:58.307124+0000","last_active":"2023-10-07T08:49:58.307174+0000","last_peered":"2023-10-07T08:49:58.307174+0000","last_clean":"2023-10-07T08:49:58.307174+0000","last_became_active":"2023-10-07T08:49:58.306927+0000","last_became_peered":"2023-10-07T08:49:58.306927+0000","last_unstale":"2023-10-07T08:49:58.307174+0000","last_undegraded":"2023-10-07T08:49:58.307174+0000","last_fullsized":"2023-10-07T08:49:58.307174+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:11:02.046178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303368+0000","last_change":"2023-10-07T08:49:58.303155+0000","last_active":"2023-10-07T08:49:58.303368+0000","last_peered":"2023-10-07T08:49:58.303368+0000","last_clean":"2023-10-07T08:49:58.303368+0000","last_became_active":"2023-10-07T08:49:58.301562+0000","last_became_peered":"2023-10-07T08:49:58.301562+0000","last_unstale":"2023-10-07T08:49:58.303368+0000","last_undegraded":"2023-10-07T08:49:58.303368+0000","last_fullsized":"2023-10-07T08:49:58.303368+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:47:28.523368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.309959+0000","last_change":"2023-10-07T08:49:58.309905+0000","last_active":"2023-10-07T08:49:58.309959+0000","last_peered":"2023-10-07T08:49:58.309959+0000","last_clean":"2023-10-07T08:49:58.309959+0000","last_became_active":"2023-10-07T08:49:58.309691+0000","last_became_peered":"2023-10-07T08:49:58.309691+0000","last_unstale":"2023-10-07T08:49:58.309959+0000","last_undegraded":"2023-10-07T08:49:58.309959+0000","last_fullsized":"2023-10-07T08:49:58.309959+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:01:05.004192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305764+0000","last_change":"2023-10-07T08:49:58.305322+0000","last_active":"2023-10-07T08:49:58.305764+0000","last_peered":"2023-10-07T08:49:58.305764+0000","last_clean":"2023-10-07T08:49:58.305764+0000","last_became_active":"2023-10-07T08:49:58.304842+0000","last_became_peered":"2023-10-07T08:49:58.304842+0000","last_unstale":"2023-10-07T08:49:58.305764+0000","last_undegraded":"2023-10-07T08:49:58.305764+0000","last_fullsized":"2023-10-07T08:49:58.305764+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:13:04.046973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.310072+0000","last_change":"2023-10-07T08:49:58.310012+0000","last_active":"2023-10-07T08:49:58.310072+0000","last_peered":"2023-10-07T08:49:58.310072+0000","last_clean":"2023-10-07T08:49:58.310072+0000","last_became_active":"2023-10-07T08:49:58.309452+0000","last_became_peered":"2023-10-07T08:49:58.309452+0000","last_unstale":"2023-10-07T08:49:58.310072+0000","last_undegraded":"2023-10-07T08:49:58.310072+0000","last_fullsized":"2023-10-07T08:49:58.310072+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:43:55.649718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.307138+0000","last_change":"2023-10-07T08:49:58.307077+0000","last_active":"2023-10-07T08:49:58.307138+0000","last_peered":"2023-10-07T08:49:58.307138+0000","last_clean":"2023-10-07T08:49:58.307138+0000","last_became_active":"2023-10-07T08:49:58.306847+0000","last_became_peered":"2023-10-07T08:49:58.306847+0000","last_unstale":"2023-10-07T08:49:58.307138+0000","last_undegraded":"2023-10-07T08:49:58.307138+0000","last_fullsized":"2023-10-07T08:49:58.307138+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:00.757014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.298838+0000","last_change":"2023-10-07T08:49:58.298625+0000","last_active":"2023-10-07T08:49:58.298838+0000","last_peered":"2023-10-07T08:49:58.298838+0000","last_clean":"2023-10-07T08:49:58.298838+0000","last_became_active":"2023-10-07T08:49:58.298440+0000","last_became_peered":"2023-10-07T08:49:58.298440+0000","last_unstale":"2023-10-07T08:49:58.298838+0000","last_undegraded":"2023-10-07T08:49:58.298838+0000","last_fullsized":"2023-10-07T08:49:58.298838+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:08.215403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"155'4","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.656472+0000","last_change":"2023-10-07T08:49:57.655686+0000","last_active":"2023-10-07T08:49:58.656472+0000","last_peered":"2023-10-07T08:49:58.656472+0000","last_clean":"2023-10-07T08:49:58.656472+0000","last_became_active":"2023-10-07T08:49:57.655420+0000","last_became_peered":"2023-10-07T08:49:57.655420+0000","last_unstale":"2023-10-07T08:49:58.656472+0000","last_undegraded":"2023-10-07T08:49:58.656472+0000","last_fullsized":"2023-10-07T08:49:58.656472+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:39:35.965036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.308088+0000","last_change":"2023-10-07T08:49:58.306713+0000","last_active":"2023-10-07T08:49:58.308088+0000","last_peered":"2023-10-07T08:49:58.308088+0000","last_clean":"2023-10-07T08:49:58.308088+0000","last_became_active":"2023-10-07T08:49:58.305923+0000","last_became_peered":"2023-10-07T08:49:58.305923+0000","last_unstale":"2023-10-07T08:49:58.308088+0000","last_undegraded":"2023-10-07T08:49:58.308088+0000","last_fullsized":"2023-10-07T08:49:58.308088+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:52.739655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.654894+0000","last_change":"2023-10-07T08:49:57.652337+0000","last_active":"2023-10-07T08:49:58.654894+0000","last_peered":"2023-10-07T08:49:58.654894+0000","last_clean":"2023-10-07T08:49:58.654894+0000","last_became_active":"2023-10-07T08:49:57.652071+0000","last_became_peered":"2023-10-07T08:49:57.652071+0000","last_unstale":"2023-10-07T08:49:58.654894+0000","last_undegraded":"2023-10-07T08:49:58.654894+0000","last_fullsized":"2023-10-07T08:49:58.654894+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:56:50.863745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.310778+0000","last_change":"2023-10-07T08:49:58.310714+0000","last_active":"2023-10-07T08:49:58.310778+0000","last_peered":"2023-10-07T08:49:58.310778+0000","last_clean":"2023-10-07T08:49:58.310778+0000","last_became_active":"2023-10-07T08:49:58.310476+0000","last_became_peered":"2023-10-07T08:49:58.310476+0000","last_unstale":"2023-10-07T08:49:58.310778+0000","last_undegraded":"2023-10-07T08:49:58.310778+0000","last_fullsized":"2023-10-07T08:49:58.310778+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:08.215403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.656021+0000","last_change":"2023-10-07T08:49:57.647522+0000","last_active":"2023-10-07T08:49:58.656021+0000","last_peered":"2023-10-07T08:49:58.656021+0000","last_clean":"2023-10-07T08:49:58.656021+0000","last_became_active":"2023-10-07T08:49:57.646962+0000","last_became_peered":"2023-10-07T08:49:57.646962+0000","last_unstale":"2023-10-07T08:49:58.656021+0000","last_undegraded":"2023-10-07T08:49:58.656021+0000","last_fullsized":"2023-10-07T08:49:58.656021+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:45.156036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305219+0000","last_change":"2023-10-07T08:49:58.305028+0000","last_active":"2023-10-07T08:49:58.305219+0000","last_peered":"2023-10-07T08:49:58.305219+0000","last_clean":"2023-10-07T08:49:58.305219+0000","last_became_active":"2023-10-07T08:49:58.304817+0000","last_became_peered":"2023-10-07T08:49:58.304817+0000","last_unstale":"2023-10-07T08:49:58.305219+0000","last_undegraded":"2023-10-07T08:49:58.305219+0000","last_fullsized":"2023-10-07T08:49:58.305219+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:48:43.872045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.656002+0000","last_change":"2023-10-07T08:49:57.650837+0000","last_active":"2023-10-07T08:49:58.656002+0000","last_peered":"2023-10-07T08:49:58.656002+0000","last_clean":"2023-10-07T08:49:58.656002+0000","last_became_active":"2023-10-07T08:49:57.650326+0000","last_became_peered":"2023-10-07T08:49:57.650326+0000","last_unstale":"2023-10-07T08:49:58.656002+0000","last_undegraded":"2023-10-07T08:49:58.656002+0000","last_fullsized":"2023-10-07T08:49:58.656002+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:28.201582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303655+0000","last_change":"2023-10-07T08:49:58.303599+0000","last_active":"2023-10-07T08:49:58.303655+0000","last_peered":"2023-10-07T08:49:58.303655+0000","last_clean":"2023-10-07T08:49:58.303655+0000","last_became_active":"2023-10-07T08:49:58.303204+0000","last_became_peered":"2023-10-07T08:49:58.303204+0000","last_unstale":"2023-10-07T08:49:58.303655+0000","last_undegraded":"2023-10-07T08:49:58.303655+0000","last_fullsized":"2023-10-07T08:49:58.303655+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:03:01.156015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.654383+0000","last_change":"2023-10-07T08:49:57.645525+0000","last_active":"2023-10-07T08:49:58.654383+0000","last_peered":"2023-10-07T08:49:58.654383+0000","last_clean":"2023-10-07T08:49:58.654383+0000","last_became_active":"2023-10-07T08:49:57.645312+0000","last_became_peered":"2023-10-07T08:49:57.645312+0000","last_unstale":"2023-10-07T08:49:58.654383+0000","last_undegraded":"2023-10-07T08:49:58.654383+0000","last_fullsized":"2023-10-07T08:49:58.654383+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:26:58.621105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.309182+0000","last_change":"2023-10-07T08:49:58.308896+0000","last_active":"2023-10-07T08:49:58.309182+0000","last_peered":"2023-10-07T08:49:58.309182+0000","last_clean":"2023-10-07T08:49:58.309182+0000","last_became_active":"2023-10-07T08:49:58.308195+0000","last_became_peered":"2023-10-07T08:49:58.308195+0000","last_unstale":"2023-10-07T08:49:58.309182+0000","last_undegraded":"2023-10-07T08:49:58.309182+0000","last_fullsized":"2023-10-07T08:49:58.309182+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:12.220036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.654344+0000","last_change":"2023-10-07T08:49:57.644895+0000","last_active":"2023-10-07T08:49:58.654344+0000","last_peered":"2023-10-07T08:49:58.654344+0000","last_clean":"2023-10-07T08:49:58.654344+0000","last_became_active":"2023-10-07T08:49:57.644709+0000","last_became_peered":"2023-10-07T08:49:57.644709+0000","last_unstale":"2023-10-07T08:49:58.654344+0000","last_undegraded":"2023-10-07T08:49:58.654344+0000","last_fullsized":"2023-10-07T08:49:58.654344+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:55:59.749707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303515+0000","last_change":"2023-10-07T08:49:58.303450+0000","last_active":"2023-10-07T08:49:58.303515+0000","last_peered":"2023-10-07T08:49:58.303515+0000","last_clean":"2023-10-07T08:49:58.303515+0000","last_became_active":"2023-10-07T08:49:58.303096+0000","last_became_peered":"2023-10-07T08:49:58.303096+0000","last_unstale":"2023-10-07T08:49:58.303515+0000","last_undegraded":"2023-10-07T08:49:58.303515+0000","last_fullsized":"2023-10-07T08:49:58.303515+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:47:28.523368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.302552+0000","last_change":"2023-10-07T08:49:57.655755+0000","last_active":"2023-10-07T08:49:58.302552+0000","last_peered":"2023-10-07T08:49:58.302552+0000","last_clean":"2023-10-07T08:49:58.302552+0000","last_became_active":"2023-10-07T08:49:57.655500+0000","last_became_peered":"2023-10-07T08:49:57.655500+0000","last_unstale":"2023-10-07T08:49:58.302552+0000","last_undegraded":"2023-10-07T08:49:58.302552+0000","last_fullsized":"2023-10-07T08:49:58.302552+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:14:23.835124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.304453+0000","last_change":"2023-10-07T08:49:58.304400+0000","last_active":"2023-10-07T08:49:58.304453+0000","last_peered":"2023-10-07T08:49:58.304453+0000","last_clean":"2023-10-07T08:49:58.304453+0000","last_became_active":"2023-10-07T08:49:58.304171+0000","last_became_peered":"2023-10-07T08:49:58.304171+0000","last_unstale":"2023-10-07T08:49:58.304453+0000","last_undegraded":"2023-10-07T08:49:58.304453+0000","last_fullsized":"2023-10-07T08:49:58.304453+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:18.422384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.301401+0000","last_change":"2023-10-07T08:49:57.653758+0000","last_active":"2023-10-07T08:49:58.301401+0000","last_peered":"2023-10-07T08:49:58.301401+0000","last_clean":"2023-10-07T08:49:58.301401+0000","last_became_active":"2023-10-07T08:49:57.653590+0000","last_became_peered":"2023-10-07T08:49:57.653590+0000","last_unstale":"2023-10-07T08:49:58.301401+0000","last_undegraded":"2023-10-07T08:49:58.301401+0000","last_fullsized":"2023-10-07T08:49:58.301401+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:41.984823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.302267+0000","last_change":"2023-10-07T08:49:58.301903+0000","last_active":"2023-10-07T08:49:58.302267+0000","last_peered":"2023-10-07T08:49:58.302267+0000","last_clean":"2023-10-07T08:49:58.302267+0000","last_became_active":"2023-10-07T08:49:58.301304+0000","last_became_peered":"2023-10-07T08:49:58.301304+0000","last_unstale":"2023-10-07T08:49:58.302267+0000","last_undegraded":"2023-10-07T08:49:58.302267+0000","last_fullsized":"2023-10-07T08:49:58.302267+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:36:25.624732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.297502+0000","last_change":"2023-10-07T08:49:57.656260+0000","last_active":"2023-10-07T08:49:58.297502+0000","last_peered":"2023-10-07T08:49:58.297502+0000","last_clean":"2023-10-07T08:49:58.297502+0000","last_became_active":"2023-10-07T08:49:57.656017+0000","last_became_peered":"2023-10-07T08:49:57.656017+0000","last_unstale":"2023-10-07T08:49:58.297502+0000","last_undegraded":"2023-10-07T08:49:58.297502+0000","last_fullsized":"2023-10-07T08:49:58.297502+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:36:40.282768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.298512+0000","last_change":"2023-10-07T08:49:58.298440+0000","last_active":"2023-10-07T08:49:58.298512+0000","last_peered":"2023-10-07T08:49:58.298512+0000","last_clean":"2023-10-07T08:49:58.298512+0000","last_became_active":"2023-10-07T08:49:58.298152+0000","last_became_peered":"2023-10-07T08:49:58.298152+0000","last_unstale":"2023-10-07T08:49:58.298512+0000","last_undegraded":"2023-10-07T08:49:58.298512+0000","last_fullsized":"2023-10-07T08:49:58.298512+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:58:43.722366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.295674+0000","last_change":"2023-10-07T08:49:57.649312+0000","last_active":"2023-10-07T08:49:58.295674+0000","last_peered":"2023-10-07T08:49:58.295674+0000","last_clean":"2023-10-07T08:49:58.295674+0000","last_became_active":"2023-10-07T08:49:57.649138+0000","last_became_peered":"2023-10-07T08:49:57.649138+0000","last_unstale":"2023-10-07T08:49:58.295674+0000","last_undegraded":"2023-10-07T08:49:58.295674+0000","last_fullsized":"2023-10-07T08:49:58.295674+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:11.212729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.306361+0000","last_change":"2023-10-07T08:49:58.306266+0000","last_active":"2023-10-07T08:49:58.306361+0000","last_peered":"2023-10-07T08:49:58.306361+0000","last_clean":"2023-10-07T08:49:58.306361+0000","last_became_active":"2023-10-07T08:49:58.306026+0000","last_became_peered":"2023-10-07T08:49:58.306026+0000","last_unstale":"2023-10-07T08:49:58.306361+0000","last_undegraded":"2023-10-07T08:49:58.306361+0000","last_fullsized":"2023-10-07T08:49:58.306361+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:10:21.374121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"155'3","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.657151+0000","last_change":"2023-10-07T08:49:57.654848+0000","last_active":"2023-10-07T08:49:58.657151+0000","last_peered":"2023-10-07T08:49:58.657151+0000","last_clean":"2023-10-07T08:49:58.657151+0000","last_became_active":"2023-10-07T08:49:57.654276+0000","last_became_peered":"2023-10-07T08:49:57.654276+0000","last_unstale":"2023-10-07T08:49:58.657151+0000","last_undegraded":"2023-10-07T08:49:58.657151+0000","last_fullsized":"2023-10-07T08:49:58.657151+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:46:53.898145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.308693+0000","last_change":"2023-10-07T08:49:58.308593+0000","last_active":"2023-10-07T08:49:58.308693+0000","last_peered":"2023-10-07T08:49:58.308693+0000","last_clean":"2023-10-07T08:49:58.308693+0000","last_became_active":"2023-10-07T08:49:58.308295+0000","last_became_peered":"2023-10-07T08:49:58.308295+0000","last_unstale":"2023-10-07T08:49:58.308693+0000","last_undegraded":"2023-10-07T08:49:58.308693+0000","last_fullsized":"2023-10-07T08:49:58.308693+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:08:28.778457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"155'6","reported_seq":16,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.658262+0000","last_change":"2023-10-07T08:49:57.656211+0000","last_active":"2023-10-07T08:49:58.658262+0000","last_peered":"2023-10-07T08:49:58.658262+0000","last_clean":"2023-10-07T08:49:58.658262+0000","last_became_active":"2023-10-07T08:49:57.655821+0000","last_became_peered":"2023-10-07T08:49:57.655821+0000","last_unstale":"2023-10-07T08:49:58.658262+0000","last_undegraded":"2023-10-07T08:49:58.658262+0000","last_fullsized":"2023-10-07T08:49:58.658262+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:36:40.282768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.302886+0000","last_change":"2023-10-07T08:49:58.302796+0000","last_active":"2023-10-07T08:49:58.302886+0000","last_peered":"2023-10-07T08:49:58.302886+0000","last_clean":"2023-10-07T08:49:58.302886+0000","last_became_active":"2023-10-07T08:49:58.301804+0000","last_became_peered":"2023-10-07T08:49:58.301804+0000","last_unstale":"2023-10-07T08:49:58.302886+0000","last_undegraded":"2023-10-07T08:49:58.302886+0000","last_fullsized":"2023-10-07T08:49:58.302886+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:05:15.875600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.296060+0000","last_change":"2023-10-07T08:49:57.645609+0000","last_active":"2023-10-07T08:49:58.296060+0000","last_peered":"2023-10-07T08:49:58.296060+0000","last_clean":"2023-10-07T08:49:58.296060+0000","last_became_active":"2023-10-07T08:49:57.645396+0000","last_became_peered":"2023-10-07T08:49:57.645396+0000","last_unstale":"2023-10-07T08:49:58.296060+0000","last_undegraded":"2023-10-07T08:49:58.296060+0000","last_fullsized":"2023-10-07T08:49:58.296060+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:09:51.901930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.306949+0000","last_change":"2023-10-07T08:49:58.306893+0000","last_active":"2023-10-07T08:49:58.306949+0000","last_peered":"2023-10-07T08:49:58.306949+0000","last_clean":"2023-10-07T08:49:58.306949+0000","last_became_active":"2023-10-07T08:49:58.306668+0000","last_became_peered":"2023-10-07T08:49:58.306668+0000","last_unstale":"2023-10-07T08:49:58.306949+0000","last_undegraded":"2023-10-07T08:49:58.306949+0000","last_fullsized":"2023-10-07T08:49:58.306949+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:02:05.805239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.299403+0000","last_change":"2023-10-07T08:49:57.654335+0000","last_active":"2023-10-07T08:49:58.299403+0000","last_peered":"2023-10-07T08:49:58.299403+0000","last_clean":"2023-10-07T08:49:58.299403+0000","last_became_active":"2023-10-07T08:49:57.654134+0000","last_became_peered":"2023-10-07T08:49:57.654134+0000","last_unstale":"2023-10-07T08:49:58.299403+0000","last_undegraded":"2023-10-07T08:49:58.299403+0000","last_fullsized":"2023-10-07T08:49:58.299403+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:39:40.463131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.310749+0000","last_change":"2023-10-07T08:49:58.310436+0000","last_active":"2023-10-07T08:49:58.310749+0000","last_peered":"2023-10-07T08:49:58.310749+0000","last_clean":"2023-10-07T08:49:58.310749+0000","last_became_active":"2023-10-07T08:49:58.308834+0000","last_became_peered":"2023-10-07T08:49:58.308834+0000","last_unstale":"2023-10-07T08:49:58.310749+0000","last_undegraded":"2023-10-07T08:49:58.310749+0000","last_fullsized":"2023-10-07T08:49:58.310749+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:02:05.805239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"155'8","reported_seq":18,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.658125+0000","last_change":"2023-10-07T08:49:57.656445+0000","last_active":"2023-10-07T08:49:58.658125+0000","last_peered":"2023-10-07T08:49:58.658125+0000","last_clean":"2023-10-07T08:49:58.658125+0000","last_became_active":"2023-10-07T08:49:57.655684+0000","last_became_peered":"2023-10-07T08:49:57.655684+0000","last_unstale":"2023-10-07T08:49:58.658125+0000","last_undegraded":"2023-10-07T08:49:58.658125+0000","last_fullsized":"2023-10-07T08:49:58.658125+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:46:53.898145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.309457+0000","last_change":"2023-10-07T08:49:58.309406+0000","last_active":"2023-10-07T08:49:58.309457+0000","last_peered":"2023-10-07T08:49:58.309457+0000","last_clean":"2023-10-07T08:49:58.309457+0000","last_became_active":"2023-10-07T08:49:58.308522+0000","last_became_peered":"2023-10-07T08:49:58.308522+0000","last_unstale":"2023-10-07T08:49:58.309457+0000","last_undegraded":"2023-10-07T08:49:58.309457+0000","last_fullsized":"2023-10-07T08:49:58.309457+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:16:28.295731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.654798+0000","last_change":"2023-10-07T08:49:57.657385+0000","last_active":"2023-10-07T08:49:58.654798+0000","last_peered":"2023-10-07T08:49:58.654798+0000","last_clean":"2023-10-07T08:49:58.654798+0000","last_became_active":"2023-10-07T08:49:57.657193+0000","last_became_peered":"2023-10-07T08:49:57.657193+0000","last_unstale":"2023-10-07T08:49:58.654798+0000","last_undegraded":"2023-10-07T08:49:58.654798+0000","last_fullsized":"2023-10-07T08:49:58.654798+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:53:33.815050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.301400+0000","last_change":"2023-10-07T08:49:58.301323+0000","last_active":"2023-10-07T08:49:58.301400+0000","last_peered":"2023-10-07T08:49:58.301400+0000","last_clean":"2023-10-07T08:49:58.301400+0000","last_became_active":"2023-10-07T08:49:58.301035+0000","last_became_peered":"2023-10-07T08:49:58.301035+0000","last_unstale":"2023-10-07T08:49:58.301400+0000","last_undegraded":"2023-10-07T08:49:58.301400+0000","last_fullsized":"2023-10-07T08:49:58.301400+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:54:45.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.656568+0000","last_change":"2023-10-07T08:49:57.651482+0000","last_active":"2023-10-07T08:49:58.656568+0000","last_peered":"2023-10-07T08:49:58.656568+0000","last_clean":"2023-10-07T08:49:58.656568+0000","last_became_active":"2023-10-07T08:49:57.650912+0000","last_became_peered":"2023-10-07T08:49:57.650912+0000","last_unstale":"2023-10-07T08:49:58.656568+0000","last_undegraded":"2023-10-07T08:49:58.656568+0000","last_fullsized":"2023-10-07T08:49:58.656568+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:05:37.493657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.301004+0000","last_change":"2023-10-07T08:49:58.300825+0000","last_active":"2023-10-07T08:49:58.301004+0000","last_peered":"2023-10-07T08:49:58.301004+0000","last_clean":"2023-10-07T08:49:58.301004+0000","last_became_active":"2023-10-07T08:49:58.300611+0000","last_became_peered":"2023-10-07T08:49:58.300611+0000","last_unstale":"2023-10-07T08:49:58.301004+0000","last_undegraded":"2023-10-07T08:49:58.301004+0000","last_fullsized":"2023-10-07T08:49:58.301004+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:08:44.814478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.654611+0000","last_change":"2023-10-07T08:49:57.653426+0000","last_active":"2023-10-07T08:49:58.654611+0000","last_peered":"2023-10-07T08:49:58.654611+0000","last_clean":"2023-10-07T08:49:58.654611+0000","last_became_active":"2023-10-07T08:49:57.653121+0000","last_became_peered":"2023-10-07T08:49:57.653121+0000","last_unstale":"2023-10-07T08:49:58.654611+0000","last_undegraded":"2023-10-07T08:49:58.654611+0000","last_fullsized":"2023-10-07T08:49:58.654611+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:47:27.516061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305944+0000","last_change":"2023-10-07T08:49:58.305847+0000","last_active":"2023-10-07T08:49:58.305944+0000","last_peered":"2023-10-07T08:49:58.305944+0000","last_clean":"2023-10-07T08:49:58.305944+0000","last_became_active":"2023-10-07T08:49:58.305415+0000","last_became_peered":"2023-10-07T08:49:58.305415+0000","last_unstale":"2023-10-07T08:49:58.305944+0000","last_undegraded":"2023-10-07T08:49:58.305944+0000","last_fullsized":"2023-10-07T08:49:58.305944+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:14:24.842431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.296327+0000","last_change":"2023-10-07T08:49:57.652161+0000","last_active":"2023-10-07T08:49:58.296327+0000","last_peered":"2023-10-07T08:49:58.296327+0000","last_clean":"2023-10-07T08:49:58.296327+0000","last_became_active":"2023-10-07T08:49:57.651903+0000","last_became_peered":"2023-10-07T08:49:57.651903+0000","last_unstale":"2023-10-07T08:49:58.296327+0000","last_undegraded":"2023-10-07T08:49:58.296327+0000","last_fullsized":"2023-10-07T08:49:58.296327+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:16:04.643751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305733+0000","last_change":"2023-10-07T08:49:58.304647+0000","last_active":"2023-10-07T08:49:58.305733+0000","last_peered":"2023-10-07T08:49:58.305733+0000","last_clean":"2023-10-07T08:49:58.305733+0000","last_became_active":"2023-10-07T08:49:58.304105+0000","last_became_peered":"2023-10-07T08:49:58.304105+0000","last_unstale":"2023-10-07T08:49:58.305733+0000","last_undegraded":"2023-10-07T08:49:58.305733+0000","last_fullsized":"2023-10-07T08:49:58.305733+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:43:04.517328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.657239+0000","last_change":"2023-10-07T08:49:57.655038+0000","last_active":"2023-10-07T08:49:58.657239+0000","last_peered":"2023-10-07T08:49:58.657239+0000","last_clean":"2023-10-07T08:49:58.657239+0000","last_became_active":"2023-10-07T08:49:57.654594+0000","last_became_peered":"2023-10-07T08:49:57.654594+0000","last_unstale":"2023-10-07T08:49:58.657239+0000","last_undegraded":"2023-10-07T08:49:58.657239+0000","last_fullsized":"2023-10-07T08:49:58.657239+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:55:40.283332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.309153+0000","last_change":"2023-10-07T08:49:58.308176+0000","last_active":"2023-10-07T08:49:58.309153+0000","last_peered":"2023-10-07T08:49:58.309153+0000","last_clean":"2023-10-07T08:49:58.309153+0000","last_became_active":"2023-10-07T08:49:58.307940+0000","last_became_peered":"2023-10-07T08:49:58.307940+0000","last_unstale":"2023-10-07T08:49:58.309153+0000","last_undegraded":"2023-10-07T08:49:58.309153+0000","last_fullsized":"2023-10-07T08:49:58.309153+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:48:55.327807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.295863+0000","last_change":"2023-10-07T08:49:57.650919+0000","last_active":"2023-10-07T08:49:58.295863+0000","last_peered":"2023-10-07T08:49:58.295863+0000","last_clean":"2023-10-07T08:49:58.295863+0000","last_became_active":"2023-10-07T08:49:57.650709+0000","last_became_peered":"2023-10-07T08:49:57.650709+0000","last_unstale":"2023-10-07T08:49:58.295863+0000","last_undegraded":"2023-10-07T08:49:58.295863+0000","last_fullsized":"2023-10-07T08:49:58.295863+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:55.050990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303507+0000","last_change":"2023-10-07T08:49:58.303447+0000","last_active":"2023-10-07T08:49:58.303507+0000","last_peered":"2023-10-07T08:49:58.303507+0000","last_clean":"2023-10-07T08:49:58.303507+0000","last_became_active":"2023-10-07T08:49:58.303236+0000","last_became_peered":"2023-10-07T08:49:58.303236+0000","last_unstale":"2023-10-07T08:49:58.303507+0000","last_undegraded":"2023-10-07T08:49:58.303507+0000","last_fullsized":"2023-10-07T08:49:58.303507+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:47:28.523368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.296434+0000","last_change":"2023-10-07T08:49:57.651647+0000","last_active":"2023-10-07T08:49:58.296434+0000","last_peered":"2023-10-07T08:49:58.296434+0000","last_clean":"2023-10-07T08:49:58.296434+0000","last_became_active":"2023-10-07T08:49:57.651444+0000","last_became_peered":"2023-10-07T08:49:57.651444+0000","last_unstale":"2023-10-07T08:49:58.296434+0000","last_undegraded":"2023-10-07T08:49:58.296434+0000","last_fullsized":"2023-10-07T08:49:58.296434+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:24:14.389754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305728+0000","last_change":"2023-10-07T08:49:58.305663+0000","last_active":"2023-10-07T08:49:58.305728+0000","last_peered":"2023-10-07T08:49:58.305728+0000","last_clean":"2023-10-07T08:49:58.305728+0000","last_became_active":"2023-10-07T08:49:58.305273+0000","last_became_peered":"2023-10-07T08:49:58.305273+0000","last_unstale":"2023-10-07T08:49:58.305728+0000","last_undegraded":"2023-10-07T08:49:58.305728+0000","last_fullsized":"2023-10-07T08:49:58.305728+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:01.568182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.299621+0000","last_change":"2023-10-07T08:49:57.651031+0000","last_active":"2023-10-07T08:49:58.299621+0000","last_peered":"2023-10-07T08:49:58.299621+0000","last_clean":"2023-10-07T08:49:58.299621+0000","last_became_active":"2023-10-07T08:49:57.650275+0000","last_became_peered":"2023-10-07T08:49:57.650275+0000","last_unstale":"2023-10-07T08:49:58.299621+0000","last_undegraded":"2023-10-07T08:49:58.299621+0000","last_fullsized":"2023-10-07T08:49:58.299621+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:52:36.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.306601+0000","last_change":"2023-10-07T08:49:58.306545+0000","last_active":"2023-10-07T08:49:58.306601+0000","last_peered":"2023-10-07T08:49:58.306601+0000","last_clean":"2023-10-07T08:49:58.306601+0000","last_became_active":"2023-10-07T08:49:58.306374+0000","last_became_peered":"2023-10-07T08:49:58.306374+0000","last_unstale":"2023-10-07T08:49:58.306601+0000","last_undegraded":"2023-10-07T08:49:58.306601+0000","last_fullsized":"2023-10-07T08:49:58.306601+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:36:53.137154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.654940+0000","last_change":"2023-10-07T08:49:57.656663+0000","last_active":"2023-10-07T08:49:58.654940+0000","last_peered":"2023-10-07T08:49:58.654940+0000","last_clean":"2023-10-07T08:49:58.654940+0000","last_became_active":"2023-10-07T08:49:57.656439+0000","last_became_peered":"2023-10-07T08:49:57.656439+0000","last_unstale":"2023-10-07T08:49:58.654940+0000","last_undegraded":"2023-10-07T08:49:58.654940+0000","last_fullsized":"2023-10-07T08:49:58.654940+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:48:11.149857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.308685+0000","last_change":"2023-10-07T08:49:58.308641+0000","last_active":"2023-10-07T08:49:58.308685+0000","last_peered":"2023-10-07T08:49:58.308685+0000","last_clean":"2023-10-07T08:49:58.308685+0000","last_became_active":"2023-10-07T08:49:58.308482+0000","last_became_peered":"2023-10-07T08:49:58.308482+0000","last_unstale":"2023-10-07T08:49:58.308685+0000","last_undegraded":"2023-10-07T08:49:58.308685+0000","last_fullsized":"2023-10-07T08:49:58.308685+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:18:06.921533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.301288+0000","last_change":"2023-10-07T08:49:57.657059+0000","last_active":"2023-10-07T08:49:58.301288+0000","last_peered":"2023-10-07T08:49:58.301288+0000","last_clean":"2023-10-07T08:49:58.301288+0000","last_became_active":"2023-10-07T08:49:57.656526+0000","last_became_peered":"2023-10-07T08:49:57.656526+0000","last_unstale":"2023-10-07T08:49:58.301288+0000","last_undegraded":"2023-10-07T08:49:58.301288+0000","last_fullsized":"2023-10-07T08:49:58.301288+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:55:59.749707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305929+0000","last_change":"2023-10-07T08:49:58.305491+0000","last_active":"2023-10-07T08:49:58.305929+0000","last_peered":"2023-10-07T08:49:58.305929+0000","last_clean":"2023-10-07T08:49:58.305929+0000","last_became_active":"2023-10-07T08:49:58.305065+0000","last_became_peered":"2023-10-07T08:49:58.305065+0000","last_unstale":"2023-10-07T08:49:58.305929+0000","last_undegraded":"2023-10-07T08:49:58.305929+0000","last_fullsized":"2023-10-07T08:49:58.305929+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:33:56.515903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.299450+0000","last_change":"2023-10-07T08:49:57.653767+0000","last_active":"2023-10-07T08:49:58.299450+0000","last_peered":"2023-10-07T08:49:58.299450+0000","last_clean":"2023-10-07T08:49:58.299450+0000","last_became_active":"2023-10-07T08:49:57.653572+0000","last_became_peered":"2023-10-07T08:49:57.653572+0000","last_unstale":"2023-10-07T08:49:58.299450+0000","last_undegraded":"2023-10-07T08:49:58.299450+0000","last_fullsized":"2023-10-07T08:49:58.299450+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:39:49.758762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305877+0000","last_change":"2023-10-07T08:49:58.305800+0000","last_active":"2023-10-07T08:49:58.305877+0000","last_peered":"2023-10-07T08:49:58.305877+0000","last_clean":"2023-10-07T08:49:58.305877+0000","last_became_active":"2023-10-07T08:49:58.305548+0000","last_became_peered":"2023-10-07T08:49:58.305548+0000","last_unstale":"2023-10-07T08:49:58.305877+0000","last_undegraded":"2023-10-07T08:49:58.305877+0000","last_fullsized":"2023-10-07T08:49:58.305877+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:28:06.105254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.299451+0000","last_change":"2023-10-07T08:49:57.647667+0000","last_active":"2023-10-07T08:49:58.299451+0000","last_peered":"2023-10-07T08:49:58.299451+0000","last_clean":"2023-10-07T08:49:58.299451+0000","last_became_active":"2023-10-07T08:49:57.647279+0000","last_became_peered":"2023-10-07T08:49:57.647279+0000","last_unstale":"2023-10-07T08:49:58.299451+0000","last_undegraded":"2023-10-07T08:49:58.299451+0000","last_fullsized":"2023-10-07T08:49:58.299451+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:20:05.659731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.307555+0000","last_change":"2023-10-07T08:49:58.307276+0000","last_active":"2023-10-07T08:49:58.307555+0000","last_peered":"2023-10-07T08:49:58.307555+0000","last_clean":"2023-10-07T08:49:58.307555+0000","last_became_active":"2023-10-07T08:49:58.307047+0000","last_became_peered":"2023-10-07T08:49:58.307047+0000","last_unstale":"2023-10-07T08:49:58.307555+0000","last_undegraded":"2023-10-07T08:49:58.307555+0000","last_fullsized":"2023-10-07T08:49:58.307555+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:08:39.106574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.299688+0000","last_change":"2023-10-07T08:49:57.654335+0000","last_active":"2023-10-07T08:49:58.299688+0000","last_peered":"2023-10-07T08:49:58.299688+0000","last_clean":"2023-10-07T08:49:58.299688+0000","last_became_active":"2023-10-07T08:49:57.654080+0000","last_became_peered":"2023-10-07T08:49:57.654080+0000","last_unstale":"2023-10-07T08:49:58.299688+0000","last_undegraded":"2023-10-07T08:49:58.299688+0000","last_fullsized":"2023-10-07T08:49:58.299688+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:25.757801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.302239+0000","last_change":"2023-10-07T08:49:58.302153+0000","last_active":"2023-10-07T08:49:58.302239+0000","last_peered":"2023-10-07T08:49:58.302239+0000","last_clean":"2023-10-07T08:49:58.302239+0000","last_became_active":"2023-10-07T08:49:58.301932+0000","last_became_peered":"2023-10-07T08:49:58.301932+0000","last_unstale":"2023-10-07T08:49:58.302239+0000","last_undegraded":"2023-10-07T08:49:58.302239+0000","last_fullsized":"2023-10-07T08:49:58.302239+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:14:24.842431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.300159+0000","last_change":"2023-10-07T08:49:57.657220+0000","last_active":"2023-10-07T08:49:58.300159+0000","last_peered":"2023-10-07T08:49:58.300159+0000","last_clean":"2023-10-07T08:49:58.300159+0000","last_became_active":"2023-10-07T08:49:57.656582+0000","last_became_peered":"2023-10-07T08:49:57.656582+0000","last_unstale":"2023-10-07T08:49:58.300159+0000","last_undegraded":"2023-10-07T08:49:58.300159+0000","last_fullsized":"2023-10-07T08:49:58.300159+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:55.050990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.309862+0000","last_change":"2023-10-07T08:49:58.309815+0000","last_active":"2023-10-07T08:49:58.309862+0000","last_peered":"2023-10-07T08:49:58.309862+0000","last_clean":"2023-10-07T08:49:58.309862+0000","last_became_active":"2023-10-07T08:49:58.309638+0000","last_became_peered":"2023-10-07T08:49:58.309638+0000","last_unstale":"2023-10-07T08:49:58.309862+0000","last_undegraded":"2023-10-07T08:49:58.309862+0000","last_fullsized":"2023-10-07T08:49:58.309862+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:01.568182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.296100+0000","last_change":"2023-10-07T08:49:57.655580+0000","last_active":"2023-10-07T08:49:58.296100+0000","last_peered":"2023-10-07T08:49:58.296100+0000","last_clean":"2023-10-07T08:49:58.296100+0000","last_became_active":"2023-10-07T08:49:57.655357+0000","last_became_peered":"2023-10-07T08:49:57.655357+0000","last_unstale":"2023-10-07T08:49:58.296100+0000","last_undegraded":"2023-10-07T08:49:58.296100+0000","last_fullsized":"2023-10-07T08:49:58.296100+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:04.388323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305216+0000","last_change":"2023-10-07T08:49:58.305151+0000","last_active":"2023-10-07T08:49:58.305216+0000","last_peered":"2023-10-07T08:49:58.305216+0000","last_clean":"2023-10-07T08:49:58.305216+0000","last_became_active":"2023-10-07T08:49:58.304982+0000","last_became_peered":"2023-10-07T08:49:58.304982+0000","last_unstale":"2023-10-07T08:49:58.305216+0000","last_undegraded":"2023-10-07T08:49:58.305216+0000","last_fullsized":"2023-10-07T08:49:58.305216+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:57.153637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.299299+0000","last_change":"2023-10-07T08:49:57.651799+0000","last_active":"2023-10-07T08:49:58.299299+0000","last_peered":"2023-10-07T08:49:58.299299+0000","last_clean":"2023-10-07T08:49:58.299299+0000","last_became_active":"2023-10-07T08:49:57.649307+0000","last_became_peered":"2023-10-07T08:49:57.649307+0000","last_unstale":"2023-10-07T08:49:58.299299+0000","last_undegraded":"2023-10-07T08:49:58.299299+0000","last_fullsized":"2023-10-07T08:49:58.299299+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:46:37.972197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.310207+0000","last_change":"2023-10-07T08:49:58.310154+0000","last_active":"2023-10-07T08:49:58.310207+0000","last_peered":"2023-10-07T08:49:58.310207+0000","last_clean":"2023-10-07T08:49:58.310207+0000","last_became_active":"2023-10-07T08:49:58.309758+0000","last_became_peered":"2023-10-07T08:49:58.309758+0000","last_unstale":"2023-10-07T08:49:58.310207+0000","last_undegraded":"2023-10-07T08:49:58.310207+0000","last_fullsized":"2023-10-07T08:49:58.310207+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:18:26.953352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.655005+0000","last_change":"2023-10-07T08:49:57.656894+0000","last_active":"2023-10-07T08:49:58.655005+0000","last_peered":"2023-10-07T08:49:58.655005+0000","last_clean":"2023-10-07T08:49:58.655005+0000","last_became_active":"2023-10-07T08:49:57.656503+0000","last_became_peered":"2023-10-07T08:49:57.656503+0000","last_unstale":"2023-10-07T08:49:58.655005+0000","last_undegraded":"2023-10-07T08:49:58.655005+0000","last_fullsized":"2023-10-07T08:49:58.655005+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:04.388323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":277,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.300086+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:49:58.300086+0000","last_peered":"2023-10-07T08:49:58.300086+0000","last_clean":"2023-10-07T08:49:58.300086+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:49:58.300086+0000","last_undegraded":"2023-10-07T08:49:58.300086+0000","last_fullsized":"2023-10-07T08:49:58.300086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1416,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193895,"statfs":{"total":200000000,"available":198549347,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.505,"15min":0.497},"min":{"1min":0.28399999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63300000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51100000000000001,"15min":0.48999999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.27700000000000002},"max":{"1min":0.65100000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53400000000000003,"15min":0.51800000000000002},"min":{"1min":0.39000000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67400000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56499999999999995,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.60299999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35599999999999998,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.66700000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.49099999999999999},"min":{"1min":0.36899999999999999,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":0.68600000000000005,"5min":0.75,"15min":0.75},"last":0.54300000000000004}]},{"osd":3,"last update":"Sat Oct 7 08:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.75800000000000001},"min":{"1min":0.38600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.77200000000000002,"15min":6.8570000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.37},"max":{"1min":0.76200000000000001,"5min":0.76700000000000002,"15min":0.98999999999999999},"last":0.623}]},{"osd":4,"last update":"Sat Oct 7 08:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46899999999999997,"15min":0.47899999999999998},"min":{"1min":0.32800000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.81299999999999994,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.496,"15min":0.52800000000000002},"min":{"1min":0.34599999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40200000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48699999999999999,"15min":0.502},"min":{"1min":0.35999999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64500000000000002,"5min":0.751,"15min":0.751},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54000000000000004,"15min":0.56599999999999995},"min":{"1min":0.41699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56599999999999995,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77800000000000002,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.57899999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":839,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194472,"statfs":{"total":200000000,"available":199140325,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.499,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.25700000000000001},"max":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.38}]},{"osd":1,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69099999999999995,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55900000000000005,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.754,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.33300000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.48699999999999999},"min":{"1min":0.36899999999999999,"5min":0.313,"15min":0.29399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53500000000000003,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.35699999999999998},"max":{"1min":0.69899999999999995,"5min":0.752,"15min":0.752},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.58699999999999997,"15min":0.53700000000000003},"min":{"1min":0.40899999999999997,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72499999999999998,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71699999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.496},"min":{"1min":0.41999999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76300000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.622}]},{"osd":5,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52300000000000002,"15min":0.505},"min":{"1min":0.36399999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73899999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70399999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54400000000000004,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.73999999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79000000000000004,"5min":1.052,"15min":1.052},"last":0.64000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":838,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194474,"statfs":{"total":200000000,"available":199141861,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.35399999999999998,"15min":0.316},"min":{"1min":0.193,"5min":0.193,"15min":0.17499999999999999},"max":{"1min":0.58899999999999997,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.36899999999999999,"15min":0.33400000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.192},"max":{"1min":0.61399999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.36899999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.36499999999999999,"15min":0.32300000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.19600000000000001},"max":{"1min":0.45800000000000002,"5min":1.639,"15min":1.639},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.39900000000000002,"15min":0.34100000000000003},"min":{"1min":0.26400000000000001,"5min":0.23599999999999999,"15min":0.22500000000000001},"max":{"1min":0.69599999999999995,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.27900000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40799999999999997,"15min":0.36499999999999999},"min":{"1min":0.27200000000000002,"5min":0.26500000000000001,"15min":0.249},"max":{"1min":0.64500000000000002,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.39700000000000002,"15min":0.35399999999999998},"min":{"1min":0.27900000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.56799999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.26500000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.55900000000000005,"15min":0.54100000000000004},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.33600000000000002},"max":{"1min":0.79300000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.53300000000000003},"min":{"1min":0.40500000000000003,"5min":0.35699999999999998,"15min":0.28599999999999998},"max":{"1min":0.80800000000000005,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.54700000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60899999999999999,"15min":0.57799999999999996},"min":{"1min":0.44400000000000001,"5min":0.40100000000000002,"15min":0.371},"max":{"1min":0.91600000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.624,"15min":0.57599999999999996},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.36599999999999999},"max":{"1min":0.89600000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58699999999999997,"15min":0.55000000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.34200000000000003},"max":{"1min":0.83999999999999997,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59199999999999997,"15min":0.53600000000000003},"min":{"1min":0.40300000000000002,"5min":0.38500000000000001,"15min":0.38200000000000001},"max":{"1min":0.752,"5min":0.87,"15min":0.87},"last":0.45700000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.59399999999999997},"min":{"1min":0.48299999999999998,"5min":0.40000000000000002,"15min":0.35699999999999998},"max":{"1min":0.88200000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.63500000000000001,"15min":0.58999999999999997},"min":{"1min":0.46100000000000002,"5min":0.45300000000000001,"15min":0.40799999999999997},"max":{"1min":0.85599999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.56100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574937,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1420,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193891,"statfs":{"total":200000000,"available":198545205,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.36499999999999999},"min":{"1min":0.23400000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.47899999999999998,"5min":0.55600000000000005,"15min":1.4339999999999999},"last":0.312},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.373,"15min":0.39100000000000001},"min":{"1min":0.25900000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52500000000000002,"5min":0.67400000000000004,"15min":1.079},"last":0.33500000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.371,"15min":0.38700000000000001},"min":{"1min":0.23300000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.49199999999999999,"5min":0.63200000000000001,"15min":1.464},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.21299999999999999},"max":{"1min":0.53700000000000003,"5min":0.67900000000000005,"15min":1.1060000000000001},"last":0.42499999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.36099999999999999,"15min":0.38},"min":{"1min":0.25600000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46500000000000002,"5min":0.59899999999999998,"15min":1.341},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.41599999999999998,"15min":0.43099999999999999},"min":{"1min":0.34100000000000003,"5min":0.28000000000000003,"15min":0.25700000000000001},"max":{"1min":0.52700000000000002,"5min":0.68600000000000005,"15min":1.532},"last":0.40500000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.45900000000000002,"5min":0.34799999999999998,"15min":0.32600000000000001},"max":{"1min":0.79200000000000004,"5min":0.90200000000000002,"15min":1.3169999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.60599999999999998},"min":{"1min":0.40899999999999997,"5min":0.36199999999999999,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":0.84999999999999998,"15min":1.51},"last":0.46200000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.47299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0529999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.38700000000000001,"15min":0.35299999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.25},"last":0.47599999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.80500000000000005,"5min":0.92900000000000005,"15min":1.488},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.024},"last":0.55300000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61899999999999999,"15min":0.60199999999999998},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88100000000000001,"5min":0.94799999999999995,"15min":0.98499999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.375,"15min":0.374},"max":{"1min":0.84099999999999997,"5min":0.90300000000000002,"15min":1.288},"last":0.59799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574937,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":844,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194467,"statfs":{"total":200000000,"available":199134985,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.32000000000000001,"15min":0.33800000000000002},"min":{"1min":0.23400000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.437,"5min":0.52800000000000002,"15min":1.665},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35599999999999998,"15min":0.36099999999999999},"min":{"1min":0.23499999999999999,"5min":0.22900000000000001,"15min":0.22600000000000001},"max":{"1min":0.47199999999999998,"5min":0.63400000000000001,"15min":1.579},"last":0.32200000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.375,"15min":0.377},"min":{"1min":0.23000000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.53300000000000003,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.41999999999999998,"15min":0.42299999999999999},"min":{"1min":0.25800000000000001,"5min":0.20999999999999999,"15min":0.20200000000000001},"max":{"1min":0.51300000000000001,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.36599999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39400000000000002,"15min":0.39100000000000001},"min":{"1min":0.28899999999999998,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.53700000000000003,"5min":0.58999999999999997,"15min":1.454},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38200000000000001,"15min":0.38700000000000001},"min":{"1min":0.28000000000000003,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.503,"5min":0.58999999999999997,"15min":1.6919999999999999},"last":0.376}]},{"osd":4,"last update":"Sat Oct 7 08:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.35499999999999998,"5min":0.33500000000000002,"15min":0.28199999999999997},"max":{"1min":0.70199999999999996,"5min":0.88900000000000001,"15min":1.7210000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.40000000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77700000000000002,"5min":0.874,"15min":1.5549999999999999},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79300000000000004,"5min":0.94399999999999995,"15min":1.5269999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.44800000000000001,"5min":0.35099999999999998,"15min":0.311},"max":{"1min":0.66200000000000003,"5min":0.876,"15min":1.4039999999999999},"last":0.51700000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.56699999999999995},"min":{"1min":0.433,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77300000000000002,"5min":0.92800000000000005,"15min":1.3380000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.438,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80400000000000005,"5min":0.85899999999999999,"15min":1.637},"last":0.56599999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.379},"max":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":1.49},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61499999999999999,"15min":0.60799999999999998},"min":{"1min":0.43099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.752,"5min":0.89700000000000002,"15min":1.375},"last":0.57899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574937,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":838,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194474,"statfs":{"total":200000000,"available":199141701,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.34499999999999997,"15min":0.32700000000000001},"min":{"1min":0.20599999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46800000000000003,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.34799999999999998,"15min":0.32300000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.502,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.29499999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:49:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.374,"15min":0.35899999999999999},"min":{"1min":0.23200000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.52500000000000002,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.253},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41099999999999998,"15min":0.39600000000000002},"min":{"1min":0.28799999999999998,"5min":0.23499999999999999,"15min":0.22500000000000001},"max":{"1min":0.59899999999999998,"5min":1.885,"15min":1.885},"last":0.36799999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:49:58 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38900000000000001,"15min":0.379},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56000000000000005,"5min":1.274,"15min":1.274},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41799999999999998,"15min":0.40000000000000002},"min":{"1min":0.29099999999999998,"5min":0.28699999999999998,"15min":0.25800000000000001},"max":{"1min":0.621,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.33900000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:49:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56499999999999995,"15min":0.51300000000000001},"min":{"1min":0.38500000000000001,"5min":0.36499999999999999,"15min":0.29999999999999999},"max":{"1min":0.76000000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59299999999999997,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84699999999999998,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:49:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58599999999999997,"15min":0.55200000000000005},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.35999999999999999},"max":{"1min":0.83099999999999996,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60399999999999998,"15min":0.57399999999999995},"min":{"1min":0.41599999999999998,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.83799999999999997,"5min":1.851,"15min":1.851},"last":0.59699999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:49:58 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61399999999999999,"15min":0.56699999999999995},"min":{"1min":0.44900000000000001,"5min":0.36899999999999999,"15min":0.34899999999999998},"max":{"1min":0.86199999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.629,"15min":0.59299999999999997},"min":{"1min":0.433,"5min":0.375,"15min":0.375},"max":{"1min":0.89200000000000002,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:49:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.621,"15min":0.58299999999999996},"min":{"1min":0.438,"5min":0.42399999999999999,"15min":0.39700000000000002},"max":{"1min":0.88,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60099999999999998,"15min":0.56299999999999994},"min":{"1min":0.42299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80900000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.55500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":838,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194474,"statfs":{"total":200000000,"available":199141791,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.89300000000000002,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53900000000000003,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.69299999999999995,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.25800000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.504},"min":{"1min":0.36499999999999999,"5min":0.248,"15min":0.248},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52900000000000003,"15min":0.501},"min":{"1min":0.34000000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81100000000000005,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.34599999999999997}]},{"osd":2,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55100000000000005,"15min":0.53000000000000003},"min":{"1min":0.311,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66000000000000003,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.51100000000000001},"min":{"1min":0.42899999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":1.29,"15min":1.29},"last":0.50700000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.53000000000000003},"min":{"1min":0.39000000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.91400000000000003,"5min":2.052,"15min":2.052},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78700000000000003,"5min":1.369,"15min":1.369},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.29499999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.75800000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.624},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.36399999999999999,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.61099999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.52700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":0.85899999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.69799999999999995,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.42999999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53000000000000003,"15min":0.55600000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.30099999999999999},"max":{"1min":0.83899999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.379,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.90200000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574937,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":838,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194474,"statfs":{"total":200000000,"available":199141749,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54000000000000004,"15min":0.51900000000000002},"min":{"1min":0.311,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53300000000000003,"15min":0.51300000000000001},"min":{"1min":0.35399999999999998,"5min":0.33500000000000002,"15min":0.32900000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.79500000000000004},"last":0.38200000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.25,"15min":0.25},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":0.495},{"interface":"front","average":{"1min":2.0499999999999998,"5min":0.84599999999999997,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":29.143999999999998,"5min":29.143999999999998,"15min":29.143999999999998},"last":0.505}]},{"osd":2,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.41899999999999998,"5min":0.31,"15min":0.309},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.36299999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.378,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.40400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51800000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.80700000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77300000000000002,"5min":0.79400000000000004,"15min":0.80900000000000005},"last":0.437}]},{"osd":6,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51200000000000001,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79100000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86399999999999999,"5min":1.022,"15min":1.022},"last":0.54300000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53500000000000003,"15min":0.57199999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70799999999999996,"5min":0.81599999999999995,"15min":0.93100000000000005},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.59299999999999997},"min":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.91100000000000003},"last":0.46400000000000002}]}]}],"pool_statfs":[]}} 2023-10-07T08:50:02.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:50:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.846+0000 7f140a7ac700 1 Processor -- start 2023-10-07T08:50:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.846+0000 7f140a7ac700 1 -- start start 2023-10-07T08:50:02.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f140a7ac700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1404157ca0 0x7f14040cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f140a7ac700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14040d07c0 con 0x7f140406d120 2023-10-07T08:50:02.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f140a7ac700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14040cfbb0 con 0x7f14041578d0 2023-10-07T08:50:02.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f140a7ac700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14040cfe90 con 0x7f1404157ca0 2023-10-07T08:50:02.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1408d49700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f140406d120 0x7f140406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52256/0 (socket says 172.21.15.81:52256) 2023-10-07T08:50:02.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1408d49700 1 -- 172.21.15.81:0/3113187084 learned_addr learned my addr 172.21.15.81:0/3113187084 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:50:02.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f14037fe700 1 --2- 172.21.15.81:0/3113187084 >> v2:172.21.15.89:3300/0 conn(0x7f1404157ca0 0x7f14040cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1402ffd700 1 -- 172.21.15.81:0/3113187084 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869446643 0 0) 0x7f14040d07c0 con 0x7f140406d120 2023-10-07T08:50:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1402ffd700 1 -- 172.21.15.81:0/3113187084 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13ec003570 con 0x7f140406d120 2023-10-07T08:50:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1402ffd700 1 -- 172.21.15.81:0/3113187084 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2646906887 0 0) 0x7f13ec003570 con 0x7f140406d120 2023-10-07T08:50:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1402ffd700 1 -- 172.21.15.81:0/3113187084 >> v2:172.21.15.89:3300/0 conn(0x7f1404157ca0 msgr2=0x7f14040cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1402ffd700 1 --2- 172.21.15.81:0/3113187084 >> v2:172.21.15.89:3300/0 conn(0x7f1404157ca0 0x7f14040cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1402ffd700 1 -- 172.21.15.81:0/3113187084 >> v1:172.21.15.89:6789/0 conn(0x7f14041578d0 legacy=0x7f140415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1402ffd700 1 -- 172.21.15.81:0/3113187084 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14040d0170 con 0x7f140406d120 2023-10-07T08:50:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1402ffd700 1 -- 172.21.15.81:0/3113187084 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f13fc0017f0 con 0x7f140406d120 2023-10-07T08:50:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1402ffd700 1 -- 172.21.15.81:0/3113187084 >> v1:172.21.15.81:6789/0 conn(0x7f140406d120 legacy=0x7f140406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1402ffd700 1 --2- 172.21.15.81:0/3113187084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13ec003a60 0x7f13ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1402ffd700 1 --2- 172.21.15.81:0/3113187084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13ec004810 0x7f13ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1402ffd700 1 --2- 172.21.15.81:0/3113187084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13ec0051c0 0x7f13ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1402ffd700 1 -- 172.21.15.81:0/3113187084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14040cfe90 con 0x7f13ec004810 2023-10-07T08:50:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1402ffd700 1 -- 172.21.15.81:0/3113187084 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec00c0d0 con 0x7f13ec0051c0 2023-10-07T08:50:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.847+0000 7f1402ffd700 1 -- 172.21.15.81:0/3113187084 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec00c290 con 0x7f13ec003a60 2023-10-07T08:50:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.848+0000 7f14037fe700 1 --2- 172.21.15.81:0/3113187084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13ec004810 0x7f13ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.848+0000 7f1408d49700 1 --2- 172.21.15.81:0/3113187084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13ec0051c0 0x7f13ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.848+0000 7f1403fff700 1 --2- 172.21.15.81:0/3113187084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13ec003a60 0x7f13ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.848+0000 7f14037fe700 1 -- 172.21.15.81:0/3113187084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13ec003a60 msgr2=0x7f13ec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.848+0000 7f14037fe700 1 --2- 172.21.15.81:0/3113187084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13ec003a60 0x7f13ec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.848+0000 7f14037fe700 1 -- 172.21.15.81:0/3113187084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13ec0051c0 msgr2=0x7f13ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.848+0000 7f14037fe700 1 --2- 172.21.15.81:0/3113187084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13ec0051c0 0x7f13ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.848+0000 7f1408d49700 1 -- 172.21.15.81:0/3113187084 reap_dead start 2023-10-07T08:50:02.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.848+0000 7f14037fe700 1 -- 172.21.15.81:0/3113187084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ec003570 con 0x7f13ec004810 2023-10-07T08:50:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.848+0000 7f14037fe700 1 --2- 172.21.15.81:0/3113187084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13ec004810 0x7f13ec004c80 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f14041580c0 tx=0x7f13f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1affcb5eb32f210 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.848+0000 7f1402ffd700 1 -- 172.21.15.81:0/3113187084 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f800e710 con 0x7f13ec004810 2023-10-07T08:50:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.848+0000 7f1402ffd700 1 -- 172.21.15.81:0/3113187084 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f800e870 con 0x7f13ec004810 2023-10-07T08:50:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.848+0000 7f1402ffd700 1 -- 172.21.15.81:0/3113187084 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f800ec30 con 0x7f13ec004810 2023-10-07T08:50:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.849+0000 7f140a7ac700 1 -- 172.21.15.81:0/3113187084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13ec004810 msgr2=0x7f13ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.849+0000 7f140a7ac700 1 --2- 172.21.15.81:0/3113187084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13ec004810 0x7f13ec004c80 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f14041580c0 tx=0x7f13f80091a0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.849+0000 7f140a7ac700 1 -- 172.21.15.81:0/3113187084 shutdown_connections 2023-10-07T08:50:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.849+0000 7f140a7ac700 1 --2- 172.21.15.81:0/3113187084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13ec004810 0x7f13ec004c80 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.849+0000 7f140a7ac700 1 -- 172.21.15.81:0/3113187084 >> 172.21.15.81:0/3113187084 conn(0x7f140406bb90 msgr2=0x7f140406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.849+0000 7f140a7ac700 1 -- 172.21.15.81:0/3113187084 shutdown_connections 2023-10-07T08:50:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.849+0000 7f140a7ac700 1 -- 172.21.15.81:0/3113187084 wait complete. 2023-10-07T08:50:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.850+0000 7f140a7ac700 1 Processor -- start 2023-10-07T08:50:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.850+0000 7f140a7ac700 1 -- start start 2023-10-07T08:50:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f140a7ac700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13ec004810 0x7f1404154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f140a7ac700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14040c8470 0x7f14040c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f140a7ac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14040cad60 0x7f1404068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f140a7ac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14040c6f80 con 0x7f14040cad60 2023-10-07T08:50:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f140a7ac700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14040c6370 con 0x7f13ec004810 2023-10-07T08:50:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f140a7ac700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14040c6650 con 0x7f14040c8470 2023-10-07T08:50:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f1408d49700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14040cad60 0x7f1404068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f1408d49700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14040cad60 0x7f1404068930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53416/0 (socket says 172.21.15.81:53416) 2023-10-07T08:50:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f1408d49700 1 -- 172.21.15.81:0/3418734079 learned_addr learned my addr 172.21.15.81:0/3418734079 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f1403fff700 1 --2- 172.21.15.81:0/3418734079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13ec004810 0x7f1404154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f14037fe700 1 --2- 172.21.15.81:0/3418734079 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14040c8470 0x7f14040c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f1408d49700 1 -- 172.21.15.81:0/3418734079 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14040c8470 msgr2=0x7f14040c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f1408d49700 1 --2- 172.21.15.81:0/3418734079 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14040c8470 0x7f14040c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f1408d49700 1 -- 172.21.15.81:0/3418734079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13ec004810 msgr2=0x7f1404154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f1408d49700 1 --2- 172.21.15.81:0/3418734079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13ec004810 0x7f1404154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f1408d49700 1 -- 172.21.15.81:0/3418734079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14040c6930 con 0x7f14040cad60 2023-10-07T08:50:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f1408d49700 1 --2- 172.21.15.81:0/3418734079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14040cad60 0x7f1404068930 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f1404063f70 tx=0x7f13fc0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f13ebfff700 1 -- 172.21.15.81:0/3418734079 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc00ae10 con 0x7f14040cad60 2023-10-07T08:50:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f13ebfff700 1 -- 172.21.15.81:0/3418734079 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc0133f0 con 0x7f14040cad60 2023-10-07T08:50:02.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f140a7ac700 1 -- 172.21.15.81:0/3418734079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14040c6c10 con 0x7f14040cad60 2023-10-07T08:50:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f13ebfff700 1 -- 172.21.15.81:0/3418734079 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc013790 con 0x7f14040cad60 2023-10-07T08:50:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.851+0000 7f140a7ac700 1 -- 172.21.15.81:0/3418734079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14040c6060 con 0x7f14040cad60 2023-10-07T08:50:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.852+0000 7f140a7ac700 1 -- 172.21.15.81:0/3418734079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1404067ac0 con 0x7f14040cad60 2023-10-07T08:50:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.853+0000 7f13ebfff700 1 -- 172.21.15.81:0/3418734079 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13fc013bc0 con 0x7f14040cad60 2023-10-07T08:50:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.853+0000 7f13ebfff700 1 --2- 172.21.15.81:0/3418734079 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f13f0066f30 0x7f13f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.853+0000 7f13ebfff700 1 -- 172.21.15.81:0/3418734079 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f13fc084d20 con 0x7f14040cad60 2023-10-07T08:50:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.853+0000 7f1403fff700 1 --2- 172.21.15.81:0/3418734079 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f13f0066f30 0x7f13f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.853+0000 7f1403fff700 1 --2- 172.21.15.81:0/3418734079 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f13f0066f30 0x7f13f00693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f13f4000c00 tx=0x7f13f4007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:02.857+0000 7f13ebfff700 1 -- 172.21.15.81:0/3418734079 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13fc052050 con 0x7f14040cad60 2023-10-07T08:50:03.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.037+0000 7f140a7ac700 1 -- 172.21.15.81:0/3418734079 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14040d0450 con 0x7f13f0066f30 2023-10-07T08:50:03.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.045+0000 7f13ebfff700 1 -- 172.21.15.81:0/3418734079 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285392 (secure 0 0 0) 0x7f14040d0450 con 0x7f13f0066f30 2023-10-07T08:50:03.049 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:50:03.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.048+0000 7f140a7ac700 1 -- 172.21.15.81:0/3418734079 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f13f0066f30 msgr2=0x7f13f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:03.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.048+0000 7f140a7ac700 1 --2- 172.21.15.81:0/3418734079 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f13f0066f30 0x7f13f00693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f13f4000c00 tx=0x7f13f4007d30 comp rx=0 tx=0).stop 2023-10-07T08:50:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.048+0000 7f140a7ac700 1 -- 172.21.15.81:0/3418734079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14040cad60 msgr2=0x7f1404068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.048+0000 7f140a7ac700 1 --2- 172.21.15.81:0/3418734079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14040cad60 0x7f1404068930 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f1404063f70 tx=0x7f13fc0021d0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.048+0000 7f140a7ac700 1 -- 172.21.15.81:0/3418734079 shutdown_connections 2023-10-07T08:50:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.048+0000 7f140a7ac700 1 --2- 172.21.15.81:0/3418734079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14040cad60 0x7f1404068930 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.048+0000 7f140a7ac700 1 --2- 172.21.15.81:0/3418734079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13ec004810 0x7f1404154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.048+0000 7f140a7ac700 1 --2- 172.21.15.81:0/3418734079 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f13f0066f30 0x7f13f00693e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.048+0000 7f140a7ac700 1 --2- 172.21.15.81:0/3418734079 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14040c8470 0x7f14040c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.048+0000 7f140a7ac700 1 -- 172.21.15.81:0/3418734079 >> 172.21.15.81:0/3418734079 conn(0x7f140406bb90 msgr2=0x7f140406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.048+0000 7f140a7ac700 1 -- 172.21.15.81:0/3418734079 shutdown_connections 2023-10-07T08:50:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.048+0000 7f140a7ac700 1 -- 172.21.15.81:0/3418734079 wait complete. 2023-10-07T08:50:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:50:03.061 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":366,"stamp":"2023-10-07T08:50:02.096641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554625,"statfs":{"total":1600000000,"available":1591936964,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.464448"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305750+0000","last_change":"2023-10-07T08:49:58.304602+0000","last_active":"2023-10-07T08:49:58.305750+0000","last_peered":"2023-10-07T08:49:58.305750+0000","last_clean":"2023-10-07T08:49:58.305750+0000","last_became_active":"2023-10-07T08:49:58.304146+0000","last_became_peered":"2023-10-07T08:49:58.304146+0000","last_unstale":"2023-10-07T08:49:58.305750+0000","last_undegraded":"2023-10-07T08:49:58.305750+0000","last_fullsized":"2023-10-07T08:49:58.305750+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:39:41.470438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.307029+0000","last_change":"2023-10-07T08:49:58.306967+0000","last_active":"2023-10-07T08:49:58.307029+0000","last_peered":"2023-10-07T08:49:58.307029+0000","last_clean":"2023-10-07T08:49:58.307029+0000","last_became_active":"2023-10-07T08:49:58.306741+0000","last_became_peered":"2023-10-07T08:49:58.306741+0000","last_unstale":"2023-10-07T08:49:58.307029+0000","last_undegraded":"2023-10-07T08:49:58.307029+0000","last_fullsized":"2023-10-07T08:49:58.307029+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:54:45.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.308123+0000","last_change":"2023-10-07T08:49:58.307753+0000","last_active":"2023-10-07T08:49:58.308123+0000","last_peered":"2023-10-07T08:49:58.308123+0000","last_clean":"2023-10-07T08:49:58.308123+0000","last_became_active":"2023-10-07T08:49:58.306938+0000","last_became_peered":"2023-10-07T08:49:58.306938+0000","last_unstale":"2023-10-07T08:49:58.308123+0000","last_undegraded":"2023-10-07T08:49:58.308123+0000","last_fullsized":"2023-10-07T08:49:58.308123+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:01:35.520777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.304496+0000","last_change":"2023-10-07T08:49:58.304341+0000","last_active":"2023-10-07T08:49:58.304496+0000","last_peered":"2023-10-07T08:49:58.304496+0000","last_clean":"2023-10-07T08:49:58.304496+0000","last_became_active":"2023-10-07T08:49:58.303104+0000","last_became_peered":"2023-10-07T08:49:58.303104+0000","last_unstale":"2023-10-07T08:49:58.304496+0000","last_undegraded":"2023-10-07T08:49:58.304496+0000","last_fullsized":"2023-10-07T08:49:58.304496+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:20.135014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305201+0000","last_change":"2023-10-07T08:49:58.304646+0000","last_active":"2023-10-07T08:49:58.305201+0000","last_peered":"2023-10-07T08:49:58.305201+0000","last_clean":"2023-10-07T08:49:58.305201+0000","last_became_active":"2023-10-07T08:49:58.304429+0000","last_became_peered":"2023-10-07T08:49:58.304429+0000","last_unstale":"2023-10-07T08:49:58.305201+0000","last_undegraded":"2023-10-07T08:49:58.305201+0000","last_fullsized":"2023-10-07T08:49:58.305201+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:46:38.979504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.304514+0000","last_change":"2023-10-07T08:49:58.304354+0000","last_active":"2023-10-07T08:49:58.304514+0000","last_peered":"2023-10-07T08:49:58.304514+0000","last_clean":"2023-10-07T08:49:58.304514+0000","last_became_active":"2023-10-07T08:49:58.303075+0000","last_became_peered":"2023-10-07T08:49:58.303075+0000","last_unstale":"2023-10-07T08:49:58.304514+0000","last_undegraded":"2023-10-07T08:49:58.304514+0000","last_fullsized":"2023-10-07T08:49:58.304514+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:51:58.054532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.311995+0000","last_change":"2023-10-07T08:49:58.311820+0000","last_active":"2023-10-07T08:49:58.311995+0000","last_peered":"2023-10-07T08:49:58.311995+0000","last_clean":"2023-10-07T08:49:58.311995+0000","last_became_active":"2023-10-07T08:49:58.311615+0000","last_became_peered":"2023-10-07T08:49:58.311615+0000","last_unstale":"2023-10-07T08:49:58.311995+0000","last_undegraded":"2023-10-07T08:49:58.311995+0000","last_fullsized":"2023-10-07T08:49:58.311995+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:39:36.972343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.308107+0000","last_change":"2023-10-07T08:49:58.307477+0000","last_active":"2023-10-07T08:49:58.308107+0000","last_peered":"2023-10-07T08:49:58.308107+0000","last_clean":"2023-10-07T08:49:58.308107+0000","last_became_active":"2023-10-07T08:49:58.306485+0000","last_became_peered":"2023-10-07T08:49:58.306485+0000","last_unstale":"2023-10-07T08:49:58.308107+0000","last_undegraded":"2023-10-07T08:49:58.308107+0000","last_fullsized":"2023-10-07T08:49:58.308107+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:57.153637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.309731+0000","last_change":"2023-10-07T08:49:58.309666+0000","last_active":"2023-10-07T08:49:58.309731+0000","last_peered":"2023-10-07T08:49:58.309731+0000","last_clean":"2023-10-07T08:49:58.309731+0000","last_became_active":"2023-10-07T08:49:58.309431+0000","last_became_peered":"2023-10-07T08:49:58.309431+0000","last_unstale":"2023-10-07T08:49:58.309731+0000","last_undegraded":"2023-10-07T08:49:58.309731+0000","last_fullsized":"2023-10-07T08:49:58.309731+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:14:24.842431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305908+0000","last_change":"2023-10-07T08:49:58.305239+0000","last_active":"2023-10-07T08:49:58.305908+0000","last_peered":"2023-10-07T08:49:58.305908+0000","last_clean":"2023-10-07T08:49:58.305908+0000","last_became_active":"2023-10-07T08:49:58.304806+0000","last_became_peered":"2023-10-07T08:49:58.304806+0000","last_unstale":"2023-10-07T08:49:58.305908+0000","last_undegraded":"2023-10-07T08:49:58.305908+0000","last_fullsized":"2023-10-07T08:49:58.305908+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:52.739655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303699+0000","last_change":"2023-10-07T08:49:58.303136+0000","last_active":"2023-10-07T08:49:58.303699+0000","last_peered":"2023-10-07T08:49:58.303699+0000","last_clean":"2023-10-07T08:49:58.303699+0000","last_became_active":"2023-10-07T08:49:58.302913+0000","last_became_peered":"2023-10-07T08:49:58.302913+0000","last_unstale":"2023-10-07T08:49:58.303699+0000","last_undegraded":"2023-10-07T08:49:58.303699+0000","last_fullsized":"2023-10-07T08:49:58.303699+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:11:39.031254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.310317+0000","last_change":"2023-10-07T08:49:58.310256+0000","last_active":"2023-10-07T08:49:58.310317+0000","last_peered":"2023-10-07T08:49:58.310317+0000","last_clean":"2023-10-07T08:49:58.310317+0000","last_became_active":"2023-10-07T08:49:58.308501+0000","last_became_peered":"2023-10-07T08:49:58.308501+0000","last_unstale":"2023-10-07T08:49:58.310317+0000","last_undegraded":"2023-10-07T08:49:58.310317+0000","last_fullsized":"2023-10-07T08:49:58.310317+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:33:56.515903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303642+0000","last_change":"2023-10-07T08:49:58.303533+0000","last_active":"2023-10-07T08:49:58.303642+0000","last_peered":"2023-10-07T08:49:58.303642+0000","last_clean":"2023-10-07T08:49:58.303642+0000","last_became_active":"2023-10-07T08:49:58.303323+0000","last_became_peered":"2023-10-07T08:49:58.303323+0000","last_unstale":"2023-10-07T08:49:58.303642+0000","last_undegraded":"2023-10-07T08:49:58.303642+0000","last_fullsized":"2023-10-07T08:49:58.303642+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:37:08.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303595+0000","last_change":"2023-10-07T08:49:58.303544+0000","last_active":"2023-10-07T08:49:58.303595+0000","last_peered":"2023-10-07T08:49:58.303595+0000","last_clean":"2023-10-07T08:49:58.303595+0000","last_became_active":"2023-10-07T08:49:58.303321+0000","last_became_peered":"2023-10-07T08:49:58.303321+0000","last_unstale":"2023-10-07T08:49:58.303595+0000","last_undegraded":"2023-10-07T08:49:58.303595+0000","last_fullsized":"2023-10-07T08:49:58.303595+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:16:28.295731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305780+0000","last_change":"2023-10-07T08:49:58.305480+0000","last_active":"2023-10-07T08:49:58.305780+0000","last_peered":"2023-10-07T08:49:58.305780+0000","last_clean":"2023-10-07T08:49:58.305780+0000","last_became_active":"2023-10-07T08:49:58.305118+0000","last_became_peered":"2023-10-07T08:49:58.305118+0000","last_unstale":"2023-10-07T08:49:58.305780+0000","last_undegraded":"2023-10-07T08:49:58.305780+0000","last_fullsized":"2023-10-07T08:49:58.305780+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:42.992130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.302607+0000","last_change":"2023-10-07T08:49:58.302376+0000","last_active":"2023-10-07T08:49:58.302607+0000","last_peered":"2023-10-07T08:49:58.302607+0000","last_clean":"2023-10-07T08:49:58.302607+0000","last_became_active":"2023-10-07T08:49:58.301824+0000","last_became_peered":"2023-10-07T08:49:58.301824+0000","last_unstale":"2023-10-07T08:49:58.302607+0000","last_undegraded":"2023-10-07T08:49:58.302607+0000","last_fullsized":"2023-10-07T08:49:58.302607+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:35:15.478012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.309196+0000","last_change":"2023-10-07T08:49:58.309028+0000","last_active":"2023-10-07T08:49:58.309196+0000","last_peered":"2023-10-07T08:49:58.309196+0000","last_clean":"2023-10-07T08:49:58.309196+0000","last_became_active":"2023-10-07T08:49:58.308525+0000","last_became_peered":"2023-10-07T08:49:58.308525+0000","last_unstale":"2023-10-07T08:49:58.309196+0000","last_undegraded":"2023-10-07T08:49:58.309196+0000","last_fullsized":"2023-10-07T08:49:58.309196+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:56.058297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303806+0000","last_change":"2023-10-07T08:49:58.303756+0000","last_active":"2023-10-07T08:49:58.303806+0000","last_peered":"2023-10-07T08:49:58.303806+0000","last_clean":"2023-10-07T08:49:58.303806+0000","last_became_active":"2023-10-07T08:49:58.303434+0000","last_became_peered":"2023-10-07T08:49:58.303434+0000","last_unstale":"2023-10-07T08:49:58.303806+0000","last_undegraded":"2023-10-07T08:49:58.303806+0000","last_fullsized":"2023-10-07T08:49:58.303806+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:55:49.566662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303719+0000","last_change":"2023-10-07T08:49:58.303597+0000","last_active":"2023-10-07T08:49:58.303719+0000","last_peered":"2023-10-07T08:49:58.303719+0000","last_clean":"2023-10-07T08:49:58.303719+0000","last_became_active":"2023-10-07T08:49:58.303367+0000","last_became_peered":"2023-10-07T08:49:58.303367+0000","last_unstale":"2023-10-07T08:49:58.303719+0000","last_undegraded":"2023-10-07T08:49:58.303719+0000","last_fullsized":"2023-10-07T08:49:58.303719+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:06:59.599657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.302328+0000","last_change":"2023-10-07T08:49:58.302222+0000","last_active":"2023-10-07T08:49:58.302328+0000","last_peered":"2023-10-07T08:49:58.302328+0000","last_clean":"2023-10-07T08:49:58.302328+0000","last_became_active":"2023-10-07T08:49:58.301997+0000","last_became_peered":"2023-10-07T08:49:58.301997+0000","last_unstale":"2023-10-07T08:49:58.302328+0000","last_undegraded":"2023-10-07T08:49:58.302328+0000","last_fullsized":"2023-10-07T08:49:58.302328+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:18:26.953352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.309295+0000","last_change":"2023-10-07T08:49:58.309207+0000","last_active":"2023-10-07T08:49:58.309295+0000","last_peered":"2023-10-07T08:49:58.309295+0000","last_clean":"2023-10-07T08:49:58.309295+0000","last_became_active":"2023-10-07T08:49:58.308449+0000","last_became_peered":"2023-10-07T08:49:58.308449+0000","last_unstale":"2023-10-07T08:49:58.309295+0000","last_undegraded":"2023-10-07T08:49:58.309295+0000","last_fullsized":"2023-10-07T08:49:58.309295+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:52:37.990301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.306168+0000","last_change":"2023-10-07T08:49:58.306102+0000","last_active":"2023-10-07T08:49:58.306168+0000","last_peered":"2023-10-07T08:49:58.306168+0000","last_clean":"2023-10-07T08:49:58.306168+0000","last_became_active":"2023-10-07T08:49:58.305155+0000","last_became_peered":"2023-10-07T08:49:58.305155+0000","last_unstale":"2023-10-07T08:49:58.306168+0000","last_undegraded":"2023-10-07T08:49:58.306168+0000","last_fullsized":"2023-10-07T08:49:58.306168+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:04:59.177322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.308138+0000","last_change":"2023-10-07T08:49:58.307994+0000","last_active":"2023-10-07T08:49:58.308138+0000","last_peered":"2023-10-07T08:49:58.308138+0000","last_clean":"2023-10-07T08:49:58.308138+0000","last_became_active":"2023-10-07T08:49:58.307230+0000","last_became_peered":"2023-10-07T08:49:58.307230+0000","last_unstale":"2023-10-07T08:49:58.308138+0000","last_undegraded":"2023-10-07T08:49:58.308138+0000","last_fullsized":"2023-10-07T08:49:58.308138+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:12:42.892793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.299919+0000","last_change":"2023-10-07T08:49:58.299861+0000","last_active":"2023-10-07T08:49:58.299919+0000","last_peered":"2023-10-07T08:49:58.299919+0000","last_clean":"2023-10-07T08:49:58.299919+0000","last_became_active":"2023-10-07T08:49:58.299577+0000","last_became_peered":"2023-10-07T08:49:58.299577+0000","last_unstale":"2023-10-07T08:49:58.299919+0000","last_undegraded":"2023-10-07T08:49:58.299919+0000","last_fullsized":"2023-10-07T08:49:58.299919+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:41:55.649395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.306272+0000","last_change":"2023-10-07T08:49:58.306211+0000","last_active":"2023-10-07T08:49:58.306272+0000","last_peered":"2023-10-07T08:49:58.306272+0000","last_clean":"2023-10-07T08:49:58.306272+0000","last_became_active":"2023-10-07T08:49:58.306031+0000","last_became_peered":"2023-10-07T08:49:58.306031+0000","last_unstale":"2023-10-07T08:49:58.306272+0000","last_undegraded":"2023-10-07T08:49:58.306272+0000","last_fullsized":"2023-10-07T08:49:58.306272+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:01:35.520777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.302623+0000","last_change":"2023-10-07T08:49:58.302512+0000","last_active":"2023-10-07T08:49:58.302623+0000","last_peered":"2023-10-07T08:49:58.302623+0000","last_clean":"2023-10-07T08:49:58.302623+0000","last_became_active":"2023-10-07T08:49:58.302125+0000","last_became_peered":"2023-10-07T08:49:58.302125+0000","last_unstale":"2023-10-07T08:49:58.302623+0000","last_undegraded":"2023-10-07T08:49:58.302623+0000","last_fullsized":"2023-10-07T08:49:58.302623+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:10:21.374121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.307174+0000","last_change":"2023-10-07T08:49:58.307124+0000","last_active":"2023-10-07T08:49:58.307174+0000","last_peered":"2023-10-07T08:49:58.307174+0000","last_clean":"2023-10-07T08:49:58.307174+0000","last_became_active":"2023-10-07T08:49:58.306927+0000","last_became_peered":"2023-10-07T08:49:58.306927+0000","last_unstale":"2023-10-07T08:49:58.307174+0000","last_undegraded":"2023-10-07T08:49:58.307174+0000","last_fullsized":"2023-10-07T08:49:58.307174+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:11:02.046178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303368+0000","last_change":"2023-10-07T08:49:58.303155+0000","last_active":"2023-10-07T08:49:58.303368+0000","last_peered":"2023-10-07T08:49:58.303368+0000","last_clean":"2023-10-07T08:49:58.303368+0000","last_became_active":"2023-10-07T08:49:58.301562+0000","last_became_peered":"2023-10-07T08:49:58.301562+0000","last_unstale":"2023-10-07T08:49:58.303368+0000","last_undegraded":"2023-10-07T08:49:58.303368+0000","last_fullsized":"2023-10-07T08:49:58.303368+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:47:28.523368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.309959+0000","last_change":"2023-10-07T08:49:58.309905+0000","last_active":"2023-10-07T08:49:58.309959+0000","last_peered":"2023-10-07T08:49:58.309959+0000","last_clean":"2023-10-07T08:49:58.309959+0000","last_became_active":"2023-10-07T08:49:58.309691+0000","last_became_peered":"2023-10-07T08:49:58.309691+0000","last_unstale":"2023-10-07T08:49:58.309959+0000","last_undegraded":"2023-10-07T08:49:58.309959+0000","last_fullsized":"2023-10-07T08:49:58.309959+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:01:05.004192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305764+0000","last_change":"2023-10-07T08:49:58.305322+0000","last_active":"2023-10-07T08:49:58.305764+0000","last_peered":"2023-10-07T08:49:58.305764+0000","last_clean":"2023-10-07T08:49:58.305764+0000","last_became_active":"2023-10-07T08:49:58.304842+0000","last_became_peered":"2023-10-07T08:49:58.304842+0000","last_unstale":"2023-10-07T08:49:58.305764+0000","last_undegraded":"2023-10-07T08:49:58.305764+0000","last_fullsized":"2023-10-07T08:49:58.305764+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:13:04.046973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.310072+0000","last_change":"2023-10-07T08:49:58.310012+0000","last_active":"2023-10-07T08:49:58.310072+0000","last_peered":"2023-10-07T08:49:58.310072+0000","last_clean":"2023-10-07T08:49:58.310072+0000","last_became_active":"2023-10-07T08:49:58.309452+0000","last_became_peered":"2023-10-07T08:49:58.309452+0000","last_unstale":"2023-10-07T08:49:58.310072+0000","last_undegraded":"2023-10-07T08:49:58.310072+0000","last_fullsized":"2023-10-07T08:49:58.310072+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:43:55.649718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.307138+0000","last_change":"2023-10-07T08:49:58.307077+0000","last_active":"2023-10-07T08:49:58.307138+0000","last_peered":"2023-10-07T08:49:58.307138+0000","last_clean":"2023-10-07T08:49:58.307138+0000","last_became_active":"2023-10-07T08:49:58.306847+0000","last_became_peered":"2023-10-07T08:49:58.306847+0000","last_unstale":"2023-10-07T08:49:58.307138+0000","last_undegraded":"2023-10-07T08:49:58.307138+0000","last_fullsized":"2023-10-07T08:49:58.307138+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:56:00.757014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.298838+0000","last_change":"2023-10-07T08:49:58.298625+0000","last_active":"2023-10-07T08:49:58.298838+0000","last_peered":"2023-10-07T08:49:58.298838+0000","last_clean":"2023-10-07T08:49:58.298838+0000","last_became_active":"2023-10-07T08:49:58.298440+0000","last_became_peered":"2023-10-07T08:49:58.298440+0000","last_unstale":"2023-10-07T08:49:58.298838+0000","last_undegraded":"2023-10-07T08:49:58.298838+0000","last_fullsized":"2023-10-07T08:49:58.298838+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:08.215403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"155'4","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.656472+0000","last_change":"2023-10-07T08:49:57.655686+0000","last_active":"2023-10-07T08:49:58.656472+0000","last_peered":"2023-10-07T08:49:58.656472+0000","last_clean":"2023-10-07T08:49:58.656472+0000","last_became_active":"2023-10-07T08:49:57.655420+0000","last_became_peered":"2023-10-07T08:49:57.655420+0000","last_unstale":"2023-10-07T08:49:58.656472+0000","last_undegraded":"2023-10-07T08:49:58.656472+0000","last_fullsized":"2023-10-07T08:49:58.656472+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:39:35.965036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.308088+0000","last_change":"2023-10-07T08:49:58.306713+0000","last_active":"2023-10-07T08:49:58.308088+0000","last_peered":"2023-10-07T08:49:58.308088+0000","last_clean":"2023-10-07T08:49:58.308088+0000","last_became_active":"2023-10-07T08:49:58.305923+0000","last_became_peered":"2023-10-07T08:49:58.305923+0000","last_unstale":"2023-10-07T08:49:58.308088+0000","last_undegraded":"2023-10-07T08:49:58.308088+0000","last_fullsized":"2023-10-07T08:49:58.308088+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:47:52.739655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.654894+0000","last_change":"2023-10-07T08:49:57.652337+0000","last_active":"2023-10-07T08:49:58.654894+0000","last_peered":"2023-10-07T08:49:58.654894+0000","last_clean":"2023-10-07T08:49:58.654894+0000","last_became_active":"2023-10-07T08:49:57.652071+0000","last_became_peered":"2023-10-07T08:49:57.652071+0000","last_unstale":"2023-10-07T08:49:58.654894+0000","last_undegraded":"2023-10-07T08:49:58.654894+0000","last_fullsized":"2023-10-07T08:49:58.654894+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:56:50.863745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.310778+0000","last_change":"2023-10-07T08:49:58.310714+0000","last_active":"2023-10-07T08:49:58.310778+0000","last_peered":"2023-10-07T08:49:58.310778+0000","last_clean":"2023-10-07T08:49:58.310778+0000","last_became_active":"2023-10-07T08:49:58.310476+0000","last_became_peered":"2023-10-07T08:49:58.310476+0000","last_unstale":"2023-10-07T08:49:58.310778+0000","last_undegraded":"2023-10-07T08:49:58.310778+0000","last_fullsized":"2023-10-07T08:49:58.310778+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:08.215403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.656021+0000","last_change":"2023-10-07T08:49:57.647522+0000","last_active":"2023-10-07T08:49:58.656021+0000","last_peered":"2023-10-07T08:49:58.656021+0000","last_clean":"2023-10-07T08:49:58.656021+0000","last_became_active":"2023-10-07T08:49:57.646962+0000","last_became_peered":"2023-10-07T08:49:57.646962+0000","last_unstale":"2023-10-07T08:49:58.656021+0000","last_undegraded":"2023-10-07T08:49:58.656021+0000","last_fullsized":"2023-10-07T08:49:58.656021+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:45.156036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305219+0000","last_change":"2023-10-07T08:49:58.305028+0000","last_active":"2023-10-07T08:49:58.305219+0000","last_peered":"2023-10-07T08:49:58.305219+0000","last_clean":"2023-10-07T08:49:58.305219+0000","last_became_active":"2023-10-07T08:49:58.304817+0000","last_became_peered":"2023-10-07T08:49:58.304817+0000","last_unstale":"2023-10-07T08:49:58.305219+0000","last_undegraded":"2023-10-07T08:49:58.305219+0000","last_fullsized":"2023-10-07T08:49:58.305219+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:48:43.872045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.656002+0000","last_change":"2023-10-07T08:49:57.650837+0000","last_active":"2023-10-07T08:49:58.656002+0000","last_peered":"2023-10-07T08:49:58.656002+0000","last_clean":"2023-10-07T08:49:58.656002+0000","last_became_active":"2023-10-07T08:49:57.650326+0000","last_became_peered":"2023-10-07T08:49:57.650326+0000","last_unstale":"2023-10-07T08:49:58.656002+0000","last_undegraded":"2023-10-07T08:49:58.656002+0000","last_fullsized":"2023-10-07T08:49:58.656002+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:28.201582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303655+0000","last_change":"2023-10-07T08:49:58.303599+0000","last_active":"2023-10-07T08:49:58.303655+0000","last_peered":"2023-10-07T08:49:58.303655+0000","last_clean":"2023-10-07T08:49:58.303655+0000","last_became_active":"2023-10-07T08:49:58.303204+0000","last_became_peered":"2023-10-07T08:49:58.303204+0000","last_unstale":"2023-10-07T08:49:58.303655+0000","last_undegraded":"2023-10-07T08:49:58.303655+0000","last_fullsized":"2023-10-07T08:49:58.303655+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:03:01.156015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.654383+0000","last_change":"2023-10-07T08:49:57.645525+0000","last_active":"2023-10-07T08:49:58.654383+0000","last_peered":"2023-10-07T08:49:58.654383+0000","last_clean":"2023-10-07T08:49:58.654383+0000","last_became_active":"2023-10-07T08:49:57.645312+0000","last_became_peered":"2023-10-07T08:49:57.645312+0000","last_unstale":"2023-10-07T08:49:58.654383+0000","last_undegraded":"2023-10-07T08:49:58.654383+0000","last_fullsized":"2023-10-07T08:49:58.654383+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:26:58.621105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.309182+0000","last_change":"2023-10-07T08:49:58.308896+0000","last_active":"2023-10-07T08:49:58.309182+0000","last_peered":"2023-10-07T08:49:58.309182+0000","last_clean":"2023-10-07T08:49:58.309182+0000","last_became_active":"2023-10-07T08:49:58.308195+0000","last_became_peered":"2023-10-07T08:49:58.308195+0000","last_unstale":"2023-10-07T08:49:58.309182+0000","last_undegraded":"2023-10-07T08:49:58.309182+0000","last_fullsized":"2023-10-07T08:49:58.309182+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:12.220036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.654344+0000","last_change":"2023-10-07T08:49:57.644895+0000","last_active":"2023-10-07T08:49:58.654344+0000","last_peered":"2023-10-07T08:49:58.654344+0000","last_clean":"2023-10-07T08:49:58.654344+0000","last_became_active":"2023-10-07T08:49:57.644709+0000","last_became_peered":"2023-10-07T08:49:57.644709+0000","last_unstale":"2023-10-07T08:49:58.654344+0000","last_undegraded":"2023-10-07T08:49:58.654344+0000","last_fullsized":"2023-10-07T08:49:58.654344+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:55:59.749707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303515+0000","last_change":"2023-10-07T08:49:58.303450+0000","last_active":"2023-10-07T08:49:58.303515+0000","last_peered":"2023-10-07T08:49:58.303515+0000","last_clean":"2023-10-07T08:49:58.303515+0000","last_became_active":"2023-10-07T08:49:58.303096+0000","last_became_peered":"2023-10-07T08:49:58.303096+0000","last_unstale":"2023-10-07T08:49:58.303515+0000","last_undegraded":"2023-10-07T08:49:58.303515+0000","last_fullsized":"2023-10-07T08:49:58.303515+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:47:28.523368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.302552+0000","last_change":"2023-10-07T08:49:57.655755+0000","last_active":"2023-10-07T08:49:58.302552+0000","last_peered":"2023-10-07T08:49:58.302552+0000","last_clean":"2023-10-07T08:49:58.302552+0000","last_became_active":"2023-10-07T08:49:57.655500+0000","last_became_peered":"2023-10-07T08:49:57.655500+0000","last_unstale":"2023-10-07T08:49:58.302552+0000","last_undegraded":"2023-10-07T08:49:58.302552+0000","last_fullsized":"2023-10-07T08:49:58.302552+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:14:23.835124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.304453+0000","last_change":"2023-10-07T08:49:58.304400+0000","last_active":"2023-10-07T08:49:58.304453+0000","last_peered":"2023-10-07T08:49:58.304453+0000","last_clean":"2023-10-07T08:49:58.304453+0000","last_became_active":"2023-10-07T08:49:58.304171+0000","last_became_peered":"2023-10-07T08:49:58.304171+0000","last_unstale":"2023-10-07T08:49:58.304453+0000","last_undegraded":"2023-10-07T08:49:58.304453+0000","last_fullsized":"2023-10-07T08:49:58.304453+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:18.422384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.301401+0000","last_change":"2023-10-07T08:49:57.653758+0000","last_active":"2023-10-07T08:49:58.301401+0000","last_peered":"2023-10-07T08:49:58.301401+0000","last_clean":"2023-10-07T08:49:58.301401+0000","last_became_active":"2023-10-07T08:49:57.653590+0000","last_became_peered":"2023-10-07T08:49:57.653590+0000","last_unstale":"2023-10-07T08:49:58.301401+0000","last_undegraded":"2023-10-07T08:49:58.301401+0000","last_fullsized":"2023-10-07T08:49:58.301401+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:41.984823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.302267+0000","last_change":"2023-10-07T08:49:58.301903+0000","last_active":"2023-10-07T08:49:58.302267+0000","last_peered":"2023-10-07T08:49:58.302267+0000","last_clean":"2023-10-07T08:49:58.302267+0000","last_became_active":"2023-10-07T08:49:58.301304+0000","last_became_peered":"2023-10-07T08:49:58.301304+0000","last_unstale":"2023-10-07T08:49:58.302267+0000","last_undegraded":"2023-10-07T08:49:58.302267+0000","last_fullsized":"2023-10-07T08:49:58.302267+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:36:25.624732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.297502+0000","last_change":"2023-10-07T08:49:57.656260+0000","last_active":"2023-10-07T08:49:58.297502+0000","last_peered":"2023-10-07T08:49:58.297502+0000","last_clean":"2023-10-07T08:49:58.297502+0000","last_became_active":"2023-10-07T08:49:57.656017+0000","last_became_peered":"2023-10-07T08:49:57.656017+0000","last_unstale":"2023-10-07T08:49:58.297502+0000","last_undegraded":"2023-10-07T08:49:58.297502+0000","last_fullsized":"2023-10-07T08:49:58.297502+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:36:40.282768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.298512+0000","last_change":"2023-10-07T08:49:58.298440+0000","last_active":"2023-10-07T08:49:58.298512+0000","last_peered":"2023-10-07T08:49:58.298512+0000","last_clean":"2023-10-07T08:49:58.298512+0000","last_became_active":"2023-10-07T08:49:58.298152+0000","last_became_peered":"2023-10-07T08:49:58.298152+0000","last_unstale":"2023-10-07T08:49:58.298512+0000","last_undegraded":"2023-10-07T08:49:58.298512+0000","last_fullsized":"2023-10-07T08:49:58.298512+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:58:43.722366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.295674+0000","last_change":"2023-10-07T08:49:57.649312+0000","last_active":"2023-10-07T08:49:58.295674+0000","last_peered":"2023-10-07T08:49:58.295674+0000","last_clean":"2023-10-07T08:49:58.295674+0000","last_became_active":"2023-10-07T08:49:57.649138+0000","last_became_peered":"2023-10-07T08:49:57.649138+0000","last_unstale":"2023-10-07T08:49:58.295674+0000","last_undegraded":"2023-10-07T08:49:58.295674+0000","last_fullsized":"2023-10-07T08:49:58.295674+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:25:11.212729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.306361+0000","last_change":"2023-10-07T08:49:58.306266+0000","last_active":"2023-10-07T08:49:58.306361+0000","last_peered":"2023-10-07T08:49:58.306361+0000","last_clean":"2023-10-07T08:49:58.306361+0000","last_became_active":"2023-10-07T08:49:58.306026+0000","last_became_peered":"2023-10-07T08:49:58.306026+0000","last_unstale":"2023-10-07T08:49:58.306361+0000","last_undegraded":"2023-10-07T08:49:58.306361+0000","last_fullsized":"2023-10-07T08:49:58.306361+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:10:21.374121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"155'3","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.657151+0000","last_change":"2023-10-07T08:49:57.654848+0000","last_active":"2023-10-07T08:49:58.657151+0000","last_peered":"2023-10-07T08:49:58.657151+0000","last_clean":"2023-10-07T08:49:58.657151+0000","last_became_active":"2023-10-07T08:49:57.654276+0000","last_became_peered":"2023-10-07T08:49:57.654276+0000","last_unstale":"2023-10-07T08:49:58.657151+0000","last_undegraded":"2023-10-07T08:49:58.657151+0000","last_fullsized":"2023-10-07T08:49:58.657151+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:46:53.898145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.308693+0000","last_change":"2023-10-07T08:49:58.308593+0000","last_active":"2023-10-07T08:49:58.308693+0000","last_peered":"2023-10-07T08:49:58.308693+0000","last_clean":"2023-10-07T08:49:58.308693+0000","last_became_active":"2023-10-07T08:49:58.308295+0000","last_became_peered":"2023-10-07T08:49:58.308295+0000","last_unstale":"2023-10-07T08:49:58.308693+0000","last_undegraded":"2023-10-07T08:49:58.308693+0000","last_fullsized":"2023-10-07T08:49:58.308693+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:08:28.778457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"155'6","reported_seq":16,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.658262+0000","last_change":"2023-10-07T08:49:57.656211+0000","last_active":"2023-10-07T08:49:58.658262+0000","last_peered":"2023-10-07T08:49:58.658262+0000","last_clean":"2023-10-07T08:49:58.658262+0000","last_became_active":"2023-10-07T08:49:57.655821+0000","last_became_peered":"2023-10-07T08:49:57.655821+0000","last_unstale":"2023-10-07T08:49:58.658262+0000","last_undegraded":"2023-10-07T08:49:58.658262+0000","last_fullsized":"2023-10-07T08:49:58.658262+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:36:40.282768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.302886+0000","last_change":"2023-10-07T08:49:58.302796+0000","last_active":"2023-10-07T08:49:58.302886+0000","last_peered":"2023-10-07T08:49:58.302886+0000","last_clean":"2023-10-07T08:49:58.302886+0000","last_became_active":"2023-10-07T08:49:58.301804+0000","last_became_peered":"2023-10-07T08:49:58.301804+0000","last_unstale":"2023-10-07T08:49:58.302886+0000","last_undegraded":"2023-10-07T08:49:58.302886+0000","last_fullsized":"2023-10-07T08:49:58.302886+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:05:15.875600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.296060+0000","last_change":"2023-10-07T08:49:57.645609+0000","last_active":"2023-10-07T08:49:58.296060+0000","last_peered":"2023-10-07T08:49:58.296060+0000","last_clean":"2023-10-07T08:49:58.296060+0000","last_became_active":"2023-10-07T08:49:57.645396+0000","last_became_peered":"2023-10-07T08:49:57.645396+0000","last_unstale":"2023-10-07T08:49:58.296060+0000","last_undegraded":"2023-10-07T08:49:58.296060+0000","last_fullsized":"2023-10-07T08:49:58.296060+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:09:51.901930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.306949+0000","last_change":"2023-10-07T08:49:58.306893+0000","last_active":"2023-10-07T08:49:58.306949+0000","last_peered":"2023-10-07T08:49:58.306949+0000","last_clean":"2023-10-07T08:49:58.306949+0000","last_became_active":"2023-10-07T08:49:58.306668+0000","last_became_peered":"2023-10-07T08:49:58.306668+0000","last_unstale":"2023-10-07T08:49:58.306949+0000","last_undegraded":"2023-10-07T08:49:58.306949+0000","last_fullsized":"2023-10-07T08:49:58.306949+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:02:05.805239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.299403+0000","last_change":"2023-10-07T08:49:57.654335+0000","last_active":"2023-10-07T08:49:58.299403+0000","last_peered":"2023-10-07T08:49:58.299403+0000","last_clean":"2023-10-07T08:49:58.299403+0000","last_became_active":"2023-10-07T08:49:57.654134+0000","last_became_peered":"2023-10-07T08:49:57.654134+0000","last_unstale":"2023-10-07T08:49:58.299403+0000","last_undegraded":"2023-10-07T08:49:58.299403+0000","last_fullsized":"2023-10-07T08:49:58.299403+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:39:40.463131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.310749+0000","last_change":"2023-10-07T08:49:58.310436+0000","last_active":"2023-10-07T08:49:58.310749+0000","last_peered":"2023-10-07T08:49:58.310749+0000","last_clean":"2023-10-07T08:49:58.310749+0000","last_became_active":"2023-10-07T08:49:58.308834+0000","last_became_peered":"2023-10-07T08:49:58.308834+0000","last_unstale":"2023-10-07T08:49:58.310749+0000","last_undegraded":"2023-10-07T08:49:58.310749+0000","last_fullsized":"2023-10-07T08:49:58.310749+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:02:05.805239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"155'8","reported_seq":18,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.658125+0000","last_change":"2023-10-07T08:49:57.656445+0000","last_active":"2023-10-07T08:49:58.658125+0000","last_peered":"2023-10-07T08:49:58.658125+0000","last_clean":"2023-10-07T08:49:58.658125+0000","last_became_active":"2023-10-07T08:49:57.655684+0000","last_became_peered":"2023-10-07T08:49:57.655684+0000","last_unstale":"2023-10-07T08:49:58.658125+0000","last_undegraded":"2023-10-07T08:49:58.658125+0000","last_fullsized":"2023-10-07T08:49:58.658125+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:46:53.898145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.309457+0000","last_change":"2023-10-07T08:49:58.309406+0000","last_active":"2023-10-07T08:49:58.309457+0000","last_peered":"2023-10-07T08:49:58.309457+0000","last_clean":"2023-10-07T08:49:58.309457+0000","last_became_active":"2023-10-07T08:49:58.308522+0000","last_became_peered":"2023-10-07T08:49:58.308522+0000","last_unstale":"2023-10-07T08:49:58.309457+0000","last_undegraded":"2023-10-07T08:49:58.309457+0000","last_fullsized":"2023-10-07T08:49:58.309457+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:16:28.295731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.654798+0000","last_change":"2023-10-07T08:49:57.657385+0000","last_active":"2023-10-07T08:49:58.654798+0000","last_peered":"2023-10-07T08:49:58.654798+0000","last_clean":"2023-10-07T08:49:58.654798+0000","last_became_active":"2023-10-07T08:49:57.657193+0000","last_became_peered":"2023-10-07T08:49:57.657193+0000","last_unstale":"2023-10-07T08:49:58.654798+0000","last_undegraded":"2023-10-07T08:49:58.654798+0000","last_fullsized":"2023-10-07T08:49:58.654798+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:53:33.815050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.301400+0000","last_change":"2023-10-07T08:49:58.301323+0000","last_active":"2023-10-07T08:49:58.301400+0000","last_peered":"2023-10-07T08:49:58.301400+0000","last_clean":"2023-10-07T08:49:58.301400+0000","last_became_active":"2023-10-07T08:49:58.301035+0000","last_became_peered":"2023-10-07T08:49:58.301035+0000","last_unstale":"2023-10-07T08:49:58.301400+0000","last_undegraded":"2023-10-07T08:49:58.301400+0000","last_fullsized":"2023-10-07T08:49:58.301400+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:54:45.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.656568+0000","last_change":"2023-10-07T08:49:57.651482+0000","last_active":"2023-10-07T08:49:58.656568+0000","last_peered":"2023-10-07T08:49:58.656568+0000","last_clean":"2023-10-07T08:49:58.656568+0000","last_became_active":"2023-10-07T08:49:57.650912+0000","last_became_peered":"2023-10-07T08:49:57.650912+0000","last_unstale":"2023-10-07T08:49:58.656568+0000","last_undegraded":"2023-10-07T08:49:58.656568+0000","last_fullsized":"2023-10-07T08:49:58.656568+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:05:37.493657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.301004+0000","last_change":"2023-10-07T08:49:58.300825+0000","last_active":"2023-10-07T08:49:58.301004+0000","last_peered":"2023-10-07T08:49:58.301004+0000","last_clean":"2023-10-07T08:49:58.301004+0000","last_became_active":"2023-10-07T08:49:58.300611+0000","last_became_peered":"2023-10-07T08:49:58.300611+0000","last_unstale":"2023-10-07T08:49:58.301004+0000","last_undegraded":"2023-10-07T08:49:58.301004+0000","last_fullsized":"2023-10-07T08:49:58.301004+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:08:44.814478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.654611+0000","last_change":"2023-10-07T08:49:57.653426+0000","last_active":"2023-10-07T08:49:58.654611+0000","last_peered":"2023-10-07T08:49:58.654611+0000","last_clean":"2023-10-07T08:49:58.654611+0000","last_became_active":"2023-10-07T08:49:57.653121+0000","last_became_peered":"2023-10-07T08:49:57.653121+0000","last_unstale":"2023-10-07T08:49:58.654611+0000","last_undegraded":"2023-10-07T08:49:58.654611+0000","last_fullsized":"2023-10-07T08:49:58.654611+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:47:27.516061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305944+0000","last_change":"2023-10-07T08:49:58.305847+0000","last_active":"2023-10-07T08:49:58.305944+0000","last_peered":"2023-10-07T08:49:58.305944+0000","last_clean":"2023-10-07T08:49:58.305944+0000","last_became_active":"2023-10-07T08:49:58.305415+0000","last_became_peered":"2023-10-07T08:49:58.305415+0000","last_unstale":"2023-10-07T08:49:58.305944+0000","last_undegraded":"2023-10-07T08:49:58.305944+0000","last_fullsized":"2023-10-07T08:49:58.305944+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:14:24.842431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.296327+0000","last_change":"2023-10-07T08:49:57.652161+0000","last_active":"2023-10-07T08:49:58.296327+0000","last_peered":"2023-10-07T08:49:58.296327+0000","last_clean":"2023-10-07T08:49:58.296327+0000","last_became_active":"2023-10-07T08:49:57.651903+0000","last_became_peered":"2023-10-07T08:49:57.651903+0000","last_unstale":"2023-10-07T08:49:58.296327+0000","last_undegraded":"2023-10-07T08:49:58.296327+0000","last_fullsized":"2023-10-07T08:49:58.296327+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:16:04.643751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305733+0000","last_change":"2023-10-07T08:49:58.304647+0000","last_active":"2023-10-07T08:49:58.305733+0000","last_peered":"2023-10-07T08:49:58.305733+0000","last_clean":"2023-10-07T08:49:58.305733+0000","last_became_active":"2023-10-07T08:49:58.304105+0000","last_became_peered":"2023-10-07T08:49:58.304105+0000","last_unstale":"2023-10-07T08:49:58.305733+0000","last_undegraded":"2023-10-07T08:49:58.305733+0000","last_fullsized":"2023-10-07T08:49:58.305733+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:43:04.517328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.657239+0000","last_change":"2023-10-07T08:49:57.655038+0000","last_active":"2023-10-07T08:49:58.657239+0000","last_peered":"2023-10-07T08:49:58.657239+0000","last_clean":"2023-10-07T08:49:58.657239+0000","last_became_active":"2023-10-07T08:49:57.654594+0000","last_became_peered":"2023-10-07T08:49:57.654594+0000","last_unstale":"2023-10-07T08:49:58.657239+0000","last_undegraded":"2023-10-07T08:49:58.657239+0000","last_fullsized":"2023-10-07T08:49:58.657239+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:55:40.283332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.309153+0000","last_change":"2023-10-07T08:49:58.308176+0000","last_active":"2023-10-07T08:49:58.309153+0000","last_peered":"2023-10-07T08:49:58.309153+0000","last_clean":"2023-10-07T08:49:58.309153+0000","last_became_active":"2023-10-07T08:49:58.307940+0000","last_became_peered":"2023-10-07T08:49:58.307940+0000","last_unstale":"2023-10-07T08:49:58.309153+0000","last_undegraded":"2023-10-07T08:49:58.309153+0000","last_fullsized":"2023-10-07T08:49:58.309153+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:48:55.327807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.295863+0000","last_change":"2023-10-07T08:49:57.650919+0000","last_active":"2023-10-07T08:49:58.295863+0000","last_peered":"2023-10-07T08:49:58.295863+0000","last_clean":"2023-10-07T08:49:58.295863+0000","last_became_active":"2023-10-07T08:49:57.650709+0000","last_became_peered":"2023-10-07T08:49:57.650709+0000","last_unstale":"2023-10-07T08:49:58.295863+0000","last_undegraded":"2023-10-07T08:49:58.295863+0000","last_fullsized":"2023-10-07T08:49:58.295863+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:55.050990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.303507+0000","last_change":"2023-10-07T08:49:58.303447+0000","last_active":"2023-10-07T08:49:58.303507+0000","last_peered":"2023-10-07T08:49:58.303507+0000","last_clean":"2023-10-07T08:49:58.303507+0000","last_became_active":"2023-10-07T08:49:58.303236+0000","last_became_peered":"2023-10-07T08:49:58.303236+0000","last_unstale":"2023-10-07T08:49:58.303507+0000","last_undegraded":"2023-10-07T08:49:58.303507+0000","last_fullsized":"2023-10-07T08:49:58.303507+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:47:28.523368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.296434+0000","last_change":"2023-10-07T08:49:57.651647+0000","last_active":"2023-10-07T08:49:58.296434+0000","last_peered":"2023-10-07T08:49:58.296434+0000","last_clean":"2023-10-07T08:49:58.296434+0000","last_became_active":"2023-10-07T08:49:57.651444+0000","last_became_peered":"2023-10-07T08:49:57.651444+0000","last_unstale":"2023-10-07T08:49:58.296434+0000","last_undegraded":"2023-10-07T08:49:58.296434+0000","last_fullsized":"2023-10-07T08:49:58.296434+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:24:14.389754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305728+0000","last_change":"2023-10-07T08:49:58.305663+0000","last_active":"2023-10-07T08:49:58.305728+0000","last_peered":"2023-10-07T08:49:58.305728+0000","last_clean":"2023-10-07T08:49:58.305728+0000","last_became_active":"2023-10-07T08:49:58.305273+0000","last_became_peered":"2023-10-07T08:49:58.305273+0000","last_unstale":"2023-10-07T08:49:58.305728+0000","last_undegraded":"2023-10-07T08:49:58.305728+0000","last_fullsized":"2023-10-07T08:49:58.305728+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:01.568182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.299621+0000","last_change":"2023-10-07T08:49:57.651031+0000","last_active":"2023-10-07T08:49:58.299621+0000","last_peered":"2023-10-07T08:49:58.299621+0000","last_clean":"2023-10-07T08:49:58.299621+0000","last_became_active":"2023-10-07T08:49:57.650275+0000","last_became_peered":"2023-10-07T08:49:57.650275+0000","last_unstale":"2023-10-07T08:49:58.299621+0000","last_undegraded":"2023-10-07T08:49:58.299621+0000","last_fullsized":"2023-10-07T08:49:58.299621+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:52:36.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.306601+0000","last_change":"2023-10-07T08:49:58.306545+0000","last_active":"2023-10-07T08:49:58.306601+0000","last_peered":"2023-10-07T08:49:58.306601+0000","last_clean":"2023-10-07T08:49:58.306601+0000","last_became_active":"2023-10-07T08:49:58.306374+0000","last_became_peered":"2023-10-07T08:49:58.306374+0000","last_unstale":"2023-10-07T08:49:58.306601+0000","last_undegraded":"2023-10-07T08:49:58.306601+0000","last_fullsized":"2023-10-07T08:49:58.306601+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:36:53.137154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.654940+0000","last_change":"2023-10-07T08:49:57.656663+0000","last_active":"2023-10-07T08:49:58.654940+0000","last_peered":"2023-10-07T08:49:58.654940+0000","last_clean":"2023-10-07T08:49:58.654940+0000","last_became_active":"2023-10-07T08:49:57.656439+0000","last_became_peered":"2023-10-07T08:49:57.656439+0000","last_unstale":"2023-10-07T08:49:58.654940+0000","last_undegraded":"2023-10-07T08:49:58.654940+0000","last_fullsized":"2023-10-07T08:49:58.654940+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:48:11.149857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.308685+0000","last_change":"2023-10-07T08:49:58.308641+0000","last_active":"2023-10-07T08:49:58.308685+0000","last_peered":"2023-10-07T08:49:58.308685+0000","last_clean":"2023-10-07T08:49:58.308685+0000","last_became_active":"2023-10-07T08:49:58.308482+0000","last_became_peered":"2023-10-07T08:49:58.308482+0000","last_unstale":"2023-10-07T08:49:58.308685+0000","last_undegraded":"2023-10-07T08:49:58.308685+0000","last_fullsized":"2023-10-07T08:49:58.308685+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:18:06.921533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.301288+0000","last_change":"2023-10-07T08:49:57.657059+0000","last_active":"2023-10-07T08:49:58.301288+0000","last_peered":"2023-10-07T08:49:58.301288+0000","last_clean":"2023-10-07T08:49:58.301288+0000","last_became_active":"2023-10-07T08:49:57.656526+0000","last_became_peered":"2023-10-07T08:49:57.656526+0000","last_unstale":"2023-10-07T08:49:58.301288+0000","last_undegraded":"2023-10-07T08:49:58.301288+0000","last_fullsized":"2023-10-07T08:49:58.301288+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:55:59.749707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305929+0000","last_change":"2023-10-07T08:49:58.305491+0000","last_active":"2023-10-07T08:49:58.305929+0000","last_peered":"2023-10-07T08:49:58.305929+0000","last_clean":"2023-10-07T08:49:58.305929+0000","last_became_active":"2023-10-07T08:49:58.305065+0000","last_became_peered":"2023-10-07T08:49:58.305065+0000","last_unstale":"2023-10-07T08:49:58.305929+0000","last_undegraded":"2023-10-07T08:49:58.305929+0000","last_fullsized":"2023-10-07T08:49:58.305929+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:33:56.515903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.299450+0000","last_change":"2023-10-07T08:49:57.653767+0000","last_active":"2023-10-07T08:49:58.299450+0000","last_peered":"2023-10-07T08:49:58.299450+0000","last_clean":"2023-10-07T08:49:58.299450+0000","last_became_active":"2023-10-07T08:49:57.653572+0000","last_became_peered":"2023-10-07T08:49:57.653572+0000","last_unstale":"2023-10-07T08:49:58.299450+0000","last_undegraded":"2023-10-07T08:49:58.299450+0000","last_fullsized":"2023-10-07T08:49:58.299450+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:39:49.758762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305877+0000","last_change":"2023-10-07T08:49:58.305800+0000","last_active":"2023-10-07T08:49:58.305877+0000","last_peered":"2023-10-07T08:49:58.305877+0000","last_clean":"2023-10-07T08:49:58.305877+0000","last_became_active":"2023-10-07T08:49:58.305548+0000","last_became_peered":"2023-10-07T08:49:58.305548+0000","last_unstale":"2023-10-07T08:49:58.305877+0000","last_undegraded":"2023-10-07T08:49:58.305877+0000","last_fullsized":"2023-10-07T08:49:58.305877+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:28:06.105254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.299451+0000","last_change":"2023-10-07T08:49:57.647667+0000","last_active":"2023-10-07T08:49:58.299451+0000","last_peered":"2023-10-07T08:49:58.299451+0000","last_clean":"2023-10-07T08:49:58.299451+0000","last_became_active":"2023-10-07T08:49:57.647279+0000","last_became_peered":"2023-10-07T08:49:57.647279+0000","last_unstale":"2023-10-07T08:49:58.299451+0000","last_undegraded":"2023-10-07T08:49:58.299451+0000","last_fullsized":"2023-10-07T08:49:58.299451+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:20:05.659731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.307555+0000","last_change":"2023-10-07T08:49:58.307276+0000","last_active":"2023-10-07T08:49:58.307555+0000","last_peered":"2023-10-07T08:49:58.307555+0000","last_clean":"2023-10-07T08:49:58.307555+0000","last_became_active":"2023-10-07T08:49:58.307047+0000","last_became_peered":"2023-10-07T08:49:58.307047+0000","last_unstale":"2023-10-07T08:49:58.307555+0000","last_undegraded":"2023-10-07T08:49:58.307555+0000","last_fullsized":"2023-10-07T08:49:58.307555+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:08:39.106574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.299688+0000","last_change":"2023-10-07T08:49:57.654335+0000","last_active":"2023-10-07T08:49:58.299688+0000","last_peered":"2023-10-07T08:49:58.299688+0000","last_clean":"2023-10-07T08:49:58.299688+0000","last_became_active":"2023-10-07T08:49:57.654080+0000","last_became_peered":"2023-10-07T08:49:57.654080+0000","last_unstale":"2023-10-07T08:49:58.299688+0000","last_undegraded":"2023-10-07T08:49:58.299688+0000","last_fullsized":"2023-10-07T08:49:58.299688+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:25.757801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.302239+0000","last_change":"2023-10-07T08:49:58.302153+0000","last_active":"2023-10-07T08:49:58.302239+0000","last_peered":"2023-10-07T08:49:58.302239+0000","last_clean":"2023-10-07T08:49:58.302239+0000","last_became_active":"2023-10-07T08:49:58.301932+0000","last_became_peered":"2023-10-07T08:49:58.301932+0000","last_unstale":"2023-10-07T08:49:58.302239+0000","last_undegraded":"2023-10-07T08:49:58.302239+0000","last_fullsized":"2023-10-07T08:49:58.302239+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:14:24.842431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.300159+0000","last_change":"2023-10-07T08:49:57.657220+0000","last_active":"2023-10-07T08:49:58.300159+0000","last_peered":"2023-10-07T08:49:58.300159+0000","last_clean":"2023-10-07T08:49:58.300159+0000","last_became_active":"2023-10-07T08:49:57.656582+0000","last_became_peered":"2023-10-07T08:49:57.656582+0000","last_unstale":"2023-10-07T08:49:58.300159+0000","last_undegraded":"2023-10-07T08:49:58.300159+0000","last_fullsized":"2023-10-07T08:49:58.300159+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:14:55.050990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.309862+0000","last_change":"2023-10-07T08:49:58.309815+0000","last_active":"2023-10-07T08:49:58.309862+0000","last_peered":"2023-10-07T08:49:58.309862+0000","last_clean":"2023-10-07T08:49:58.309862+0000","last_became_active":"2023-10-07T08:49:58.309638+0000","last_became_peered":"2023-10-07T08:49:58.309638+0000","last_unstale":"2023-10-07T08:49:58.309862+0000","last_undegraded":"2023-10-07T08:49:58.309862+0000","last_fullsized":"2023-10-07T08:49:58.309862+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:44:01.568182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.296100+0000","last_change":"2023-10-07T08:49:57.655580+0000","last_active":"2023-10-07T08:49:58.296100+0000","last_peered":"2023-10-07T08:49:58.296100+0000","last_clean":"2023-10-07T08:49:58.296100+0000","last_became_active":"2023-10-07T08:49:57.655357+0000","last_became_peered":"2023-10-07T08:49:57.655357+0000","last_unstale":"2023-10-07T08:49:58.296100+0000","last_undegraded":"2023-10-07T08:49:58.296100+0000","last_fullsized":"2023-10-07T08:49:58.296100+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:04.388323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.305216+0000","last_change":"2023-10-07T08:49:58.305151+0000","last_active":"2023-10-07T08:49:58.305216+0000","last_peered":"2023-10-07T08:49:58.305216+0000","last_clean":"2023-10-07T08:49:58.305216+0000","last_became_active":"2023-10-07T08:49:58.304982+0000","last_became_peered":"2023-10-07T08:49:58.304982+0000","last_unstale":"2023-10-07T08:49:58.305216+0000","last_undegraded":"2023-10-07T08:49:58.305216+0000","last_fullsized":"2023-10-07T08:49:58.305216+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:08:57.153637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.299299+0000","last_change":"2023-10-07T08:49:57.651799+0000","last_active":"2023-10-07T08:49:58.299299+0000","last_peered":"2023-10-07T08:49:58.299299+0000","last_clean":"2023-10-07T08:49:58.299299+0000","last_became_active":"2023-10-07T08:49:57.649307+0000","last_became_peered":"2023-10-07T08:49:57.649307+0000","last_unstale":"2023-10-07T08:49:58.299299+0000","last_undegraded":"2023-10-07T08:49:58.299299+0000","last_fullsized":"2023-10-07T08:49:58.299299+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:46:37.972197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.310207+0000","last_change":"2023-10-07T08:49:58.310154+0000","last_active":"2023-10-07T08:49:58.310207+0000","last_peered":"2023-10-07T08:49:58.310207+0000","last_clean":"2023-10-07T08:49:58.310207+0000","last_became_active":"2023-10-07T08:49:58.309758+0000","last_became_peered":"2023-10-07T08:49:58.309758+0000","last_unstale":"2023-10-07T08:49:58.310207+0000","last_undegraded":"2023-10-07T08:49:58.310207+0000","last_fullsized":"2023-10-07T08:49:58.310207+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:57.632177+0000","last_clean_scrub_stamp":"2023-10-07T08:49:57.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:18:26.953352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.655005+0000","last_change":"2023-10-07T08:49:57.656894+0000","last_active":"2023-10-07T08:49:58.655005+0000","last_peered":"2023-10-07T08:49:58.655005+0000","last_clean":"2023-10-07T08:49:58.655005+0000","last_became_active":"2023-10-07T08:49:57.656503+0000","last_became_peered":"2023-10-07T08:49:57.656503+0000","last_unstale":"2023-10-07T08:49:58.655005+0000","last_undegraded":"2023-10-07T08:49:58.655005+0000","last_fullsized":"2023-10-07T08:49:58.655005+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:49:56.624870+0000","last_clean_scrub_stamp":"2023-10-07T08:49:56.624870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:29:04.388323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":277,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-07T08:49:58.300086+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:49:58.300086+0000","last_peered":"2023-10-07T08:49:58.300086+0000","last_clean":"2023-10-07T08:49:58.300086+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:49:58.300086+0000","last_undegraded":"2023-10-07T08:49:58.300086+0000","last_fullsized":"2023-10-07T08:49:58.300086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1416,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193895,"statfs":{"total":200000000,"available":198549347,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.505,"15min":0.497},"min":{"1min":0.28399999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63300000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51100000000000001,"15min":0.48999999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.27700000000000002},"max":{"1min":0.65100000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53400000000000003,"15min":0.51800000000000002},"min":{"1min":0.39000000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67400000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56499999999999995,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.60299999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35599999999999998,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.66700000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.49099999999999999},"min":{"1min":0.36899999999999999,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":0.68600000000000005,"5min":0.75,"15min":0.75},"last":0.54300000000000004}]},{"osd":3,"last update":"Sat Oct 7 08:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55000000000000004,"15min":0.75800000000000001},"min":{"1min":0.38600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.77200000000000002,"15min":6.8570000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.37},"max":{"1min":0.76200000000000001,"5min":0.76700000000000002,"15min":0.98999999999999999},"last":0.623}]},{"osd":4,"last update":"Sat Oct 7 08:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46899999999999997,"15min":0.47899999999999998},"min":{"1min":0.32800000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.81299999999999994,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.496,"15min":0.52800000000000002},"min":{"1min":0.34599999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40200000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48699999999999999,"15min":0.502},"min":{"1min":0.35999999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64500000000000002,"5min":0.751,"15min":0.751},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54000000000000004,"15min":0.56599999999999995},"min":{"1min":0.41699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56599999999999995,"15min":0.58699999999999997},"min":{"1min":0.42999999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77800000000000002,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.57899999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":839,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194472,"statfs":{"total":200000000,"available":199140325,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.499,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.25700000000000001},"max":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.38}]},{"osd":1,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69099999999999995,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55900000000000005,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.754,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.33300000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.48699999999999999},"min":{"1min":0.36899999999999999,"5min":0.313,"15min":0.29399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53500000000000003,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.51100000000000001},"min":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.35699999999999998},"max":{"1min":0.69899999999999995,"5min":0.752,"15min":0.752},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.58699999999999997,"15min":0.53700000000000003},"min":{"1min":0.40899999999999997,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72499999999999998,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33000000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71699999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.496},"min":{"1min":0.41999999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76300000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.622}]},{"osd":5,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52300000000000002,"15min":0.505},"min":{"1min":0.36399999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73899999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70399999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54400000000000004,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.73999999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.42599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79000000000000004,"5min":1.052,"15min":1.052},"last":0.64000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":838,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194474,"statfs":{"total":200000000,"available":199141861,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.35399999999999998,"15min":0.316},"min":{"1min":0.193,"5min":0.193,"15min":0.17499999999999999},"max":{"1min":0.58899999999999997,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.36899999999999999,"15min":0.33400000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.192},"max":{"1min":0.61399999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.36899999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.36499999999999999,"15min":0.32300000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.19600000000000001},"max":{"1min":0.45800000000000002,"5min":1.639,"15min":1.639},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.39900000000000002,"15min":0.34100000000000003},"min":{"1min":0.26400000000000001,"5min":0.23599999999999999,"15min":0.22500000000000001},"max":{"1min":0.69599999999999995,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.27900000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40799999999999997,"15min":0.36499999999999999},"min":{"1min":0.27200000000000002,"5min":0.26500000000000001,"15min":0.249},"max":{"1min":0.64500000000000002,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.39700000000000002,"15min":0.35399999999999998},"min":{"1min":0.27900000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.56799999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.26500000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.55900000000000005,"15min":0.54100000000000004},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.33600000000000002},"max":{"1min":0.79300000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.53300000000000003},"min":{"1min":0.40500000000000003,"5min":0.35699999999999998,"15min":0.28599999999999998},"max":{"1min":0.80800000000000005,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.54700000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60899999999999999,"15min":0.57799999999999996},"min":{"1min":0.44400000000000001,"5min":0.40100000000000002,"15min":0.371},"max":{"1min":0.91600000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.624,"15min":0.57599999999999996},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.36599999999999999},"max":{"1min":0.89600000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58699999999999997,"15min":0.55000000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.34200000000000003},"max":{"1min":0.83999999999999997,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59199999999999997,"15min":0.53600000000000003},"min":{"1min":0.40300000000000002,"5min":0.38500000000000001,"15min":0.38200000000000001},"max":{"1min":0.752,"5min":0.87,"15min":0.87},"last":0.45700000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.59399999999999997},"min":{"1min":0.48299999999999998,"5min":0.40000000000000002,"15min":0.35699999999999998},"max":{"1min":0.88200000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.63500000000000001,"15min":0.58999999999999997},"min":{"1min":0.46100000000000002,"5min":0.45300000000000001,"15min":0.40799999999999997},"max":{"1min":0.85599999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.56100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574937,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1420,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193891,"statfs":{"total":200000000,"available":198545205,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.36499999999999999},"min":{"1min":0.23400000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.47899999999999998,"5min":0.55600000000000005,"15min":1.4339999999999999},"last":0.312},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.373,"15min":0.39100000000000001},"min":{"1min":0.25900000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52500000000000002,"5min":0.67400000000000004,"15min":1.079},"last":0.33500000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.371,"15min":0.38700000000000001},"min":{"1min":0.23300000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.49199999999999999,"5min":0.63200000000000001,"15min":1.464},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.21299999999999999},"max":{"1min":0.53700000000000003,"5min":0.67900000000000005,"15min":1.1060000000000001},"last":0.42499999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.36099999999999999,"15min":0.38},"min":{"1min":0.25600000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46500000000000002,"5min":0.59899999999999998,"15min":1.341},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.41599999999999998,"15min":0.43099999999999999},"min":{"1min":0.34100000000000003,"5min":0.28000000000000003,"15min":0.25700000000000001},"max":{"1min":0.52700000000000002,"5min":0.68600000000000005,"15min":1.532},"last":0.40500000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.45900000000000002,"5min":0.34799999999999998,"15min":0.32600000000000001},"max":{"1min":0.79200000000000004,"5min":0.90200000000000002,"15min":1.3169999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.60599999999999998},"min":{"1min":0.40899999999999997,"5min":0.36199999999999999,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":0.84999999999999998,"15min":1.51},"last":0.46200000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.47299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0529999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.38700000000000001,"15min":0.35299999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.25},"last":0.47599999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.80500000000000005,"5min":0.92900000000000005,"15min":1.488},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.024},"last":0.55300000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:49:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61899999999999999,"15min":0.60199999999999998},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88100000000000001,"5min":0.94799999999999995,"15min":0.98499999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.375,"15min":0.374},"max":{"1min":0.84099999999999997,"5min":0.90300000000000002,"15min":1.288},"last":0.59799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574937,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":844,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194467,"statfs":{"total":200000000,"available":199134985,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.32000000000000001,"15min":0.33800000000000002},"min":{"1min":0.23400000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.437,"5min":0.52800000000000002,"15min":1.665},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35599999999999998,"15min":0.36099999999999999},"min":{"1min":0.23499999999999999,"5min":0.22900000000000001,"15min":0.22600000000000001},"max":{"1min":0.47199999999999998,"5min":0.63400000000000001,"15min":1.579},"last":0.32200000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.375,"15min":0.377},"min":{"1min":0.23000000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.53300000000000003,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.41999999999999998,"15min":0.42299999999999999},"min":{"1min":0.25800000000000001,"5min":0.20999999999999999,"15min":0.20200000000000001},"max":{"1min":0.51300000000000001,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.36599999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39400000000000002,"15min":0.39100000000000001},"min":{"1min":0.28899999999999998,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.53700000000000003,"5min":0.58999999999999997,"15min":1.454},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38200000000000001,"15min":0.38700000000000001},"min":{"1min":0.28000000000000003,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.503,"5min":0.58999999999999997,"15min":1.6919999999999999},"last":0.376}]},{"osd":4,"last update":"Sat Oct 7 08:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.35499999999999998,"5min":0.33500000000000002,"15min":0.28199999999999997},"max":{"1min":0.70199999999999996,"5min":0.88900000000000001,"15min":1.7210000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.40000000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77700000000000002,"5min":0.874,"15min":1.5549999999999999},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79300000000000004,"5min":0.94399999999999995,"15min":1.5269999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.44800000000000001,"5min":0.35099999999999998,"15min":0.311},"max":{"1min":0.66200000000000003,"5min":0.876,"15min":1.4039999999999999},"last":0.51700000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.56699999999999995},"min":{"1min":0.433,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77300000000000002,"5min":0.92800000000000005,"15min":1.3380000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.438,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80400000000000005,"5min":0.85899999999999999,"15min":1.637},"last":0.56599999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.379},"max":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":1.49},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61499999999999999,"15min":0.60799999999999998},"min":{"1min":0.43099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.752,"5min":0.89700000000000002,"15min":1.375},"last":0.57899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574937,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":838,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194474,"statfs":{"total":200000000,"available":199141701,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.34499999999999997,"15min":0.32700000000000001},"min":{"1min":0.20599999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46800000000000003,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.34799999999999998,"15min":0.32300000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.502,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.29499999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:49:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.374,"15min":0.35899999999999999},"min":{"1min":0.23200000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.52500000000000002,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.253},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41099999999999998,"15min":0.39600000000000002},"min":{"1min":0.28799999999999998,"5min":0.23499999999999999,"15min":0.22500000000000001},"max":{"1min":0.59899999999999998,"5min":1.885,"15min":1.885},"last":0.36799999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:49:58 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38900000000000001,"15min":0.379},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56000000000000005,"5min":1.274,"15min":1.274},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41799999999999998,"15min":0.40000000000000002},"min":{"1min":0.29099999999999998,"5min":0.28699999999999998,"15min":0.25800000000000001},"max":{"1min":0.621,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.33900000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:49:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56499999999999995,"15min":0.51300000000000001},"min":{"1min":0.38500000000000001,"5min":0.36499999999999999,"15min":0.29999999999999999},"max":{"1min":0.76000000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59299999999999997,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84699999999999998,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:49:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58599999999999997,"15min":0.55200000000000005},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.35999999999999999},"max":{"1min":0.83099999999999996,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60399999999999998,"15min":0.57399999999999995},"min":{"1min":0.41599999999999998,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.83799999999999997,"5min":1.851,"15min":1.851},"last":0.59699999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:49:58 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61399999999999999,"15min":0.56699999999999995},"min":{"1min":0.44900000000000001,"5min":0.36899999999999999,"15min":0.34899999999999998},"max":{"1min":0.86199999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.629,"15min":0.59299999999999997},"min":{"1min":0.433,"5min":0.375,"15min":0.375},"max":{"1min":0.89200000000000002,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:49:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.621,"15min":0.58299999999999996},"min":{"1min":0.438,"5min":0.42399999999999999,"15min":0.39700000000000002},"max":{"1min":0.88,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60099999999999998,"15min":0.56299999999999994},"min":{"1min":0.42299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80900000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.55500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":838,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194474,"statfs":{"total":200000000,"available":199141791,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.89300000000000002,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53900000000000003,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.69299999999999995,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.25800000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.504},"min":{"1min":0.36499999999999999,"5min":0.248,"15min":0.248},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52900000000000003,"15min":0.501},"min":{"1min":0.34000000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81100000000000005,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.34599999999999997}]},{"osd":2,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55100000000000005,"15min":0.53000000000000003},"min":{"1min":0.311,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66000000000000003,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.51100000000000001},"min":{"1min":0.42899999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":1.29,"15min":1.29},"last":0.50700000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.53000000000000003},"min":{"1min":0.39000000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.91400000000000003,"5min":2.052,"15min":2.052},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78700000000000003,"5min":1.369,"15min":1.369},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.29499999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.75800000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.624},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.36399999999999999,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.61099999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.52700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":0.85899999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.69799999999999995,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.42999999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53000000000000003,"15min":0.55600000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.30099999999999999},"max":{"1min":0.83899999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.379,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.90200000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574937,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":838,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194474,"statfs":{"total":200000000,"available":199141749,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54000000000000004,"15min":0.51900000000000002},"min":{"1min":0.311,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53300000000000003,"15min":0.51300000000000001},"min":{"1min":0.35399999999999998,"5min":0.33500000000000002,"15min":0.32900000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.79500000000000004},"last":0.38200000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.499},"min":{"1min":0.33300000000000002,"5min":0.25,"15min":0.25},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":0.495},{"interface":"front","average":{"1min":2.0499999999999998,"5min":0.84599999999999997,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":29.143999999999998,"5min":29.143999999999998,"15min":29.143999999999998},"last":0.505}]},{"osd":2,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.41899999999999998,"5min":0.31,"15min":0.309},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.36299999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.378,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.40400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51800000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.80700000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77300000000000002,"5min":0.79400000000000004,"15min":0.80900000000000005},"last":0.437}]},{"osd":6,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51200000000000001,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79100000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86399999999999999,"5min":1.022,"15min":1.022},"last":0.54300000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53500000000000003,"15min":0.57199999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70799999999999996,"5min":0.81599999999999995,"15min":0.93100000000000005},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.59299999999999997},"min":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.91100000000000003},"last":0.46400000000000002}]}]}],"pool_statfs":[]}} 2023-10-07T08:50:03.070 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T08:50:03.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T08:50:03.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.221+0000 7f2447fff700 1 Processor -- start 2023-10-07T08:50:03.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.221+0000 7f2447fff700 1 -- start start 2023-10-07T08:50:03.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.221+0000 7f2447fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f244815dbd0 0x7f244815e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:03.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.221+0000 7f2447fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2448159980 0x7f2448159de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.222+0000 7f2447fff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24480cc4b0 con 0x7f244806a0e0 2023-10-07T08:50:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.222+0000 7f2447fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24480cca70 con 0x7f244815dbd0 2023-10-07T08:50:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.222+0000 7f2447fff700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244815e690 con 0x7f2448159980 2023-10-07T08:50:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.222+0000 7f24467fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f244815dbd0 0x7f244815e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.222+0000 7f24467fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f244815dbd0 0x7f244815e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53432/0 (socket says 172.21.15.81:53432) 2023-10-07T08:50:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.222+0000 7f24467fc700 1 -- 172.21.15.81:0/3134800599 learned_addr learned my addr 172.21.15.81:0/3134800599 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.222+0000 7f24467fc700 1 -- 172.21.15.81:0/3134800599 >> v2:172.21.15.89:3300/0 conn(0x7f2448159980 msgr2=0x7f2448159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.222+0000 7f24467fc700 1 --2- 172.21.15.81:0/3134800599 >> v2:172.21.15.89:3300/0 conn(0x7f2448159980 0x7f2448159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.222+0000 7f24467fc700 1 -- 172.21.15.81:0/3134800599 >> v1:172.21.15.89:6789/0 conn(0x7f244806a0e0 legacy=0x7f244806a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.222+0000 7f24467fc700 1 -- 172.21.15.81:0/3134800599 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244815e970 con 0x7f244815dbd0 2023-10-07T08:50:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.222+0000 7f24467fc700 1 --2- 172.21.15.81:0/3134800599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f244815dbd0 0x7f244815e040 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f244806d7c0 tx=0x7f243c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88f606f57ce0b4c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.222+0000 7f2445ffb700 1 -- 172.21.15.81:0/3134800599 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c00b820 con 0x7f244815dbd0 2023-10-07T08:50:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.222+0000 7f2445ffb700 1 -- 172.21.15.81:0/3134800599 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c00b980 con 0x7f244815dbd0 2023-10-07T08:50:03.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.222+0000 7f2445ffb700 1 -- 172.21.15.81:0/3134800599 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c00bd20 con 0x7f244815dbd0 2023-10-07T08:50:03.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.223+0000 7f2447fff700 1 -- 172.21.15.81:0/3134800599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f244815dbd0 msgr2=0x7f244815e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:03.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.223+0000 7f2447fff700 1 --2- 172.21.15.81:0/3134800599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f244815dbd0 0x7f244815e040 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f244806d7c0 tx=0x7f243c009250 comp rx=0 tx=0).stop 2023-10-07T08:50:03.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.223+0000 7f2447fff700 1 -- 172.21.15.81:0/3134800599 shutdown_connections 2023-10-07T08:50:03.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.223+0000 7f2447fff700 1 --2- 172.21.15.81:0/3134800599 >> v2:172.21.15.89:3300/0 conn(0x7f2448159980 0x7f2448159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.223+0000 7f2447fff700 1 --2- 172.21.15.81:0/3134800599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f244815dbd0 0x7f244815e040 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.223+0000 7f2447fff700 1 -- 172.21.15.81:0/3134800599 >> 172.21.15.81:0/3134800599 conn(0x7f2448063230 msgr2=0x7f2448063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:03.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.223+0000 7f2447fff700 1 -- 172.21.15.81:0/3134800599 shutdown_connections 2023-10-07T08:50:03.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.223+0000 7f2447fff700 1 -- 172.21.15.81:0/3134800599 wait complete. 2023-10-07T08:50:03.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.224+0000 7f2447fff700 1 Processor -- start 2023-10-07T08:50:03.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.224+0000 7f2447fff700 1 -- start start 2023-10-07T08:50:03.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f2447fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f244806a0e0 0x7f24480aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:03.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f2447fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2448159980 0x7f244815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:03.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f2447fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f244815dbd0 0x7f244815ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:03.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f2447fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24480ab0f0 con 0x7f244815dbd0 2023-10-07T08:50:03.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f2447fff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244815bc30 con 0x7f244806a0e0 2023-10-07T08:50:03.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f2447fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244815b300 con 0x7f2448159980 2023-10-07T08:50:03.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f24477fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f244815dbd0 0x7f244815ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:03.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f24477fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f244815dbd0 0x7f244815ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53446/0 (socket says 172.21.15.81:53446) 2023-10-07T08:50:03.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f24477fe700 1 -- 172.21.15.81:0/2819473401 learned_addr learned my addr 172.21.15.81:0/2819473401 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:03.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f2446ffd700 1 --2- 172.21.15.81:0/2819473401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f244806a0e0 0x7f24480aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:03.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f24467fc700 1 --2- 172.21.15.81:0/2819473401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2448159980 0x7f244815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:03.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f24477fe700 1 -- 172.21.15.81:0/2819473401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2448159980 msgr2=0x7f244815a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:03.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f24477fe700 1 --2- 172.21.15.81:0/2819473401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2448159980 0x7f244815a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f24477fe700 1 -- 172.21.15.81:0/2819473401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f244806a0e0 msgr2=0x7f24480aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:03.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f24477fe700 1 --2- 172.21.15.81:0/2819473401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f244806a0e0 0x7f24480aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f24477fe700 1 -- 172.21.15.81:0/2819473401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c0094f0 con 0x7f244815dbd0 2023-10-07T08:50:03.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f24477fe700 1 --2- 172.21.15.81:0/2819473401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f244815dbd0 0x7f244815ab00 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f244000b840 tx=0x7f24400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:03.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f242effd700 1 -- 172.21.15.81:0/2819473401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244000f510 con 0x7f244815dbd0 2023-10-07T08:50:03.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f242effd700 1 -- 172.21.15.81:0/2819473401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244000f670 con 0x7f244815dbd0 2023-10-07T08:50:03.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.225+0000 7f2447fff700 1 -- 172.21.15.81:0/2819473401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244815b5e0 con 0x7f244815dbd0 2023-10-07T08:50:03.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.226+0000 7f242effd700 1 -- 172.21.15.81:0/2819473401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244000fa30 con 0x7f244815dbd0 2023-10-07T08:50:03.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.226+0000 7f2447fff700 1 -- 172.21.15.81:0/2819473401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24480aade0 con 0x7f244815dbd0 2023-10-07T08:50:03.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.226+0000 7f2447fff700 1 -- 172.21.15.81:0/2819473401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2448067e50 con 0x7f244815dbd0 2023-10-07T08:50:03.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.227+0000 7f242effd700 1 -- 172.21.15.81:0/2819473401 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f244001a400 con 0x7f244815dbd0 2023-10-07T08:50:03.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.227+0000 7f242effd700 1 --2- 172.21.15.81:0/2819473401 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2434066f30 0x7f24340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:03.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.227+0000 7f2446ffd700 1 --2- 172.21.15.81:0/2819473401 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2434066f30 0x7f24340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:03.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.227+0000 7f242effd700 1 -- 172.21.15.81:0/2819473401 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2440083fa0 con 0x7f244815dbd0 2023-10-07T08:50:03.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.228+0000 7f2446ffd700 1 --2- 172.21.15.81:0/2819473401 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2434066f30 0x7f24340693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f24380075c0 tx=0x7f2438009780 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:03.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.232+0000 7f242effd700 1 -- 172.21.15.81:0/2819473401 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2440051290 con 0x7f244815dbd0 2023-10-07T08:50:03.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.488+0000 7f2447fff700 1 -- 172.21.15.81:0/2819473401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f24480cc700 con 0x7f244815dbd0 2023-10-07T08:50:03.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.493+0000 7f242effd700 1 -- 172.21.15.81:0/2819473401 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f24400548b0 con 0x7f244815dbd0 2023-10-07T08:50:03.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.495+0000 7f2447fff700 1 -- 172.21.15.81:0/2819473401 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2434066f30 msgr2=0x7f24340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:03.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.495+0000 7f2447fff700 1 --2- 172.21.15.81:0/2819473401 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2434066f30 0x7f24340693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f24380075c0 tx=0x7f2438009780 comp rx=0 tx=0).stop 2023-10-07T08:50:03.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.495+0000 7f2447fff700 1 -- 172.21.15.81:0/2819473401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f244815dbd0 msgr2=0x7f244815ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:03.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.495+0000 7f2447fff700 1 --2- 172.21.15.81:0/2819473401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f244815dbd0 0x7f244815ab00 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f244000b840 tx=0x7f24400091d0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.495+0000 7f2447fff700 1 -- 172.21.15.81:0/2819473401 shutdown_connections 2023-10-07T08:50:03.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.496+0000 7f2447fff700 1 --2- 172.21.15.81:0/2819473401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f244815dbd0 0x7f244815ab00 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.496+0000 7f2447fff700 1 --2- 172.21.15.81:0/2819473401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f244806a0e0 0x7f24480aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.496+0000 7f2447fff700 1 --2- 172.21.15.81:0/2819473401 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2434066f30 0x7f24340693e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.496+0000 7f2447fff700 1 --2- 172.21.15.81:0/2819473401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2448159980 0x7f244815a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.496+0000 7f2447fff700 1 -- 172.21.15.81:0/2819473401 >> 172.21.15.81:0/2819473401 conn(0x7f2448063230 msgr2=0x7f24480ce930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.496+0000 7f2447fff700 1 -- 172.21.15.81:0/2819473401 shutdown_connections 2023-10-07T08:50:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.496+0000 7f2447fff700 1 -- 172.21.15.81:0/2819473401 wait complete. 2023-10-07T08:50:03.499 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-07T08:50:03.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:50:03.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.622+0000 7f82e0717700 1 Processor -- start 2023-10-07T08:50:03.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.622+0000 7f82e0717700 1 -- start start 2023-10-07T08:50:03.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.623+0000 7f82e0717700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82d81578d0 0x7f82d80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.623+0000 7f82e0717700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d806d120 0x7f82d806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.623+0000 7f82e0717700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d80d07c0 con 0x7f82d8157ca0 2023-10-07T08:50:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.623+0000 7f82e0717700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d806daa0 con 0x7f82d81578d0 2023-10-07T08:50:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.623+0000 7f82e0717700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d80cfbb0 con 0x7f82d806d120 2023-10-07T08:50:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.623+0000 7f82de4b3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82d81578d0 0x7f82d80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.623+0000 7f82ddcb2700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f82d8157ca0 0x7f82d815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52258/0 (socket says 172.21.15.81:52258) 2023-10-07T08:50:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.623+0000 7f82ddcb2700 1 -- 172.21.15.81:0/3695232115 learned_addr learned my addr 172.21.15.81:0/3695232115 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:50:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.623+0000 7f82decb4700 1 --2- 172.21.15.81:0/3695232115 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d806d120 0x7f82d806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.623+0000 7f82de4b3700 1 -- 172.21.15.81:0/3695232115 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d806d120 msgr2=0x7f82d806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.623+0000 7f82de4b3700 1 --2- 172.21.15.81:0/3695232115 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d806d120 0x7f82d806d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.623+0000 7f82de4b3700 1 -- 172.21.15.81:0/3695232115 >> v1:172.21.15.81:6789/0 conn(0x7f82d8157ca0 legacy=0x7f82d815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:03.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.623+0000 7f82de4b3700 1 -- 172.21.15.81:0/3695232115 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d80cfe90 con 0x7f82d81578d0 2023-10-07T08:50:03.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.623+0000 7f82dd4b1700 1 -- 172.21.15.81:0/3695232115 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325617273 0 0) 0x7f82d80d07c0 con 0x7f82d8157ca0 2023-10-07T08:50:03.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.623+0000 7f82de4b3700 1 --2- 172.21.15.81:0/3695232115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d81578d0 0x7f82d80cf4f0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009e60 tx=0x7f82d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68be90704b00c40f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:03.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.623+0000 7f82dd4b1700 1 -- 172.21.15.81:0/3695232115 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d000e070 con 0x7f82d81578d0 2023-10-07T08:50:03.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.624+0000 7f82dd4b1700 1 -- 172.21.15.81:0/3695232115 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d000bc30 con 0x7f82d81578d0 2023-10-07T08:50:03.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.624+0000 7f82dd4b1700 1 -- 172.21.15.81:0/3695232115 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0012430 con 0x7f82d81578d0 2023-10-07T08:50:03.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.624+0000 7f82e0717700 1 -- 172.21.15.81:0/3695232115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d81578d0 msgr2=0x7f82d80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:03.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.624+0000 7f82e0717700 1 --2- 172.21.15.81:0/3695232115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d81578d0 0x7f82d80cf4f0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009e60 tx=0x7f82d0009780 comp rx=0 tx=0).stop 2023-10-07T08:50:03.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.624+0000 7f82e0717700 1 -- 172.21.15.81:0/3695232115 shutdown_connections 2023-10-07T08:50:03.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.624+0000 7f82e0717700 1 --2- 172.21.15.81:0/3695232115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d81578d0 0x7f82d80cf4f0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.624+0000 7f82e0717700 1 --2- 172.21.15.81:0/3695232115 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d806d120 0x7f82d806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.624+0000 7f82e0717700 1 -- 172.21.15.81:0/3695232115 >> 172.21.15.81:0/3695232115 conn(0x7f82d806bb90 msgr2=0x7f82d806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:03.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.624+0000 7f82e0717700 1 -- 172.21.15.81:0/3695232115 shutdown_connections 2023-10-07T08:50:03.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.624+0000 7f82e0717700 1 -- 172.21.15.81:0/3695232115 wait complete. 2023-10-07T08:50:03.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.625+0000 7f82e0717700 1 Processor -- start 2023-10-07T08:50:03.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.625+0000 7f82e0717700 1 -- start start 2023-10-07T08:50:03.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82e0717700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d806d120 0x7f82d814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:03.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82e0717700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d81578d0 0x7f82d80b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:03.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82e0717700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d8157ca0 0x7f82d816a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:03.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82e0717700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d814fed0 con 0x7f82d8157ca0 2023-10-07T08:50:03.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82e0717700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d8150d30 con 0x7f82d806d120 2023-10-07T08:50:03.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82e0717700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d814ce80 con 0x7f82d81578d0 2023-10-07T08:50:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82decb4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d8157ca0 0x7f82d816a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82decb4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d8157ca0 0x7f82d816a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53466/0 (socket says 172.21.15.81:53466) 2023-10-07T08:50:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82decb4700 1 -- 172.21.15.81:0/2106684461 learned_addr learned my addr 172.21.15.81:0/2106684461 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82ddcb2700 1 --2- 172.21.15.81:0/2106684461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d81578d0 0x7f82d80b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82de4b3700 1 --2- 172.21.15.81:0/2106684461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d806d120 0x7f82d814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82decb4700 1 -- 172.21.15.81:0/2106684461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d81578d0 msgr2=0x7f82d80b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82decb4700 1 --2- 172.21.15.81:0/2106684461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d81578d0 0x7f82d80b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82decb4700 1 -- 172.21.15.81:0/2106684461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d806d120 msgr2=0x7f82d814c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82decb4700 1 --2- 172.21.15.81:0/2106684461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d806d120 0x7f82d814c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82decb4700 1 -- 172.21.15.81:0/2106684461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d0009a20 con 0x7f82d8157ca0 2023-10-07T08:50:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82de4b3700 1 --2- 172.21.15.81:0/2106684461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d806d120 0x7f82d814c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:50:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.626+0000 7f82decb4700 1 --2- 172.21.15.81:0/2106684461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d8157ca0 0x7f82d816a390 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f82c800c8b0 tx=0x7f82c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.627+0000 7f82d67fc700 1 -- 172.21.15.81:0/2106684461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8011660 con 0x7f82d8157ca0 2023-10-07T08:50:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.627+0000 7f82d67fc700 1 -- 172.21.15.81:0/2106684461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c80117c0 con 0x7f82d8157ca0 2023-10-07T08:50:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.627+0000 7f82e0717700 1 -- 172.21.15.81:0/2106684461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d8150120 con 0x7f82d8157ca0 2023-10-07T08:50:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.627+0000 7f82d67fc700 1 -- 172.21.15.81:0/2106684461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8011b40 con 0x7f82d8157ca0 2023-10-07T08:50:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.627+0000 7f82e0717700 1 -- 172.21.15.81:0/2106684461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d8150760 con 0x7f82d8157ca0 2023-10-07T08:50:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.628+0000 7f82e0717700 1 -- 172.21.15.81:0/2106684461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d8150ee0 con 0x7f82d8157ca0 2023-10-07T08:50:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.628+0000 7f82d67fc700 1 -- 172.21.15.81:0/2106684461 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82c80193f0 con 0x7f82d8157ca0 2023-10-07T08:50:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.628+0000 7f82d67fc700 1 --2- 172.21.15.81:0/2106684461 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f82c4066f30 0x7f82c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.628+0000 7f82d67fc700 1 -- 172.21.15.81:0/2106684461 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82c8084890 con 0x7f82d8157ca0 2023-10-07T08:50:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.629+0000 7f82de4b3700 1 --2- 172.21.15.81:0/2106684461 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f82c4066f30 0x7f82c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.629+0000 7f82de4b3700 1 --2- 172.21.15.81:0/2106684461 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f82c4066f30 0x7f82c40693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009e60 tx=0x7f82d0019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.633+0000 7f82d67fc700 1 -- 172.21.15.81:0/2106684461 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82d8150ee0 con 0x7f82d8157ca0 2023-10-07T08:50:03.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.856+0000 7f82e0717700 1 -- 172.21.15.81:0/2106684461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82d806e7e0 con 0x7f82d8157ca0 2023-10-07T08:50:03.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.856+0000 7f82d67fc700 1 -- 172.21.15.81:0/2106684461 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f82c8055590 con 0x7f82d8157ca0 2023-10-07T08:50:03.857 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:50:03.858 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1419112520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1419112520},{"type":"v1","addr":"172.21.15.89:6834","nonce":1419112520}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":6140,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2310402815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2310402815},{"type":"v1","addr":"172.21.15.89:6835","nonce":2310402815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7509,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2709799872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2709799872},{"type":"v1","addr":"172.21.15.81:6836","nonce":2709799872}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:49:58.023106+0000","modified":"2023-10-07T08:50:01.662857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7512":{"gid":7512,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/510483669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":510483669},{"type":"v1","addr":"172.21.15.81:6837","nonce":510483669}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-07T08:50:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.858+0000 7f82e0717700 1 -- 172.21.15.81:0/2106684461 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f82c4066f30 msgr2=0x7f82c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.858+0000 7f82e0717700 1 --2- 172.21.15.81:0/2106684461 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f82c4066f30 0x7f82c40693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009e60 tx=0x7f82d0019000 comp rx=0 tx=0).stop 2023-10-07T08:50:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.858+0000 7f82e0717700 1 -- 172.21.15.81:0/2106684461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d8157ca0 msgr2=0x7f82d816a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.858+0000 7f82e0717700 1 --2- 172.21.15.81:0/2106684461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d8157ca0 0x7f82d816a390 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f82c800c8b0 tx=0x7f82c8008040 comp rx=0 tx=0).stop 2023-10-07T08:50:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.858+0000 7f82e0717700 1 -- 172.21.15.81:0/2106684461 shutdown_connections 2023-10-07T08:50:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.858+0000 7f82e0717700 1 --2- 172.21.15.81:0/2106684461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d8157ca0 0x7f82d816a390 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.858+0000 7f82e0717700 1 --2- 172.21.15.81:0/2106684461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d806d120 0x7f82d814c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.858+0000 7f82e0717700 1 --2- 172.21.15.81:0/2106684461 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f82c4066f30 0x7f82c40693e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.858+0000 7f82e0717700 1 --2- 172.21.15.81:0/2106684461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d81578d0 0x7f82d80b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.858+0000 7f82e0717700 1 -- 172.21.15.81:0/2106684461 >> 172.21.15.81:0/2106684461 conn(0x7f82d806bb90 msgr2=0x7f82d8156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.858+0000 7f82e0717700 1 -- 172.21.15.81:0/2106684461 shutdown_connections 2023-10-07T08:50:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:03.858+0000 7f82e0717700 1 -- 172.21.15.81:0/2106684461 wait complete. 2023-10-07T08:50:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 74 2023-10-07T08:50:04.275 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T08:49:58.023106+0000', 'modified': '2023-10-07T08:50:01.662857+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7512}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7512': {'gid': 7512, 'name': 'a', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/510483669', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 510483669}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 510483669}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T08:50:04.275 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T08:50:04.275 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-07T08:50:04.299 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-10-07T08:50:04.297+0000 7f59c6804700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:50:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.390+0000 7fd36cf95700 1 Processor -- start 2023-10-07T08:50:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.390+0000 7fd36cf95700 1 -- start start 2023-10-07T08:50:04.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.391+0000 7fd36cf95700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd3681578d0 0x7fd3680cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.391+0000 7fd36cf95700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd36806d120 0x7fd36806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.391+0000 7fd36cf95700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3680d07c0 con 0x7fd368157ca0 2023-10-07T08:50:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.391+0000 7fd36cf95700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36806da50 con 0x7fd36806d120 2023-10-07T08:50:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.391+0000 7fd36cf95700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3680cfbb0 con 0x7fd3681578d0 2023-10-07T08:50:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.391+0000 7fd366d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd36806d120 0x7fd36806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.391+0000 7fd366d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd36806d120 0x7fd36806d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53482/0 (socket says 172.21.15.81:53482) 2023-10-07T08:50:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.391+0000 7fd365d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd368157ca0 0x7fd36815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52272/0 (socket says 172.21.15.81:52272) 2023-10-07T08:50:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.391+0000 7fd366d9d700 1 -- 172.21.15.81:0/623701280 learned_addr learned my addr 172.21.15.81:0/623701280 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.391+0000 7fd36659c700 1 --2- 172.21.15.81:0/623701280 >> v2:172.21.15.89:3300/0 conn(0x7fd3681578d0 0x7fd3680cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.391+0000 7fd366d9d700 1 -- 172.21.15.81:0/623701280 >> v2:172.21.15.89:3300/0 conn(0x7fd3681578d0 msgr2=0x7fd3680cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.391+0000 7fd366d9d700 1 --2- 172.21.15.81:0/623701280 >> v2:172.21.15.89:3300/0 conn(0x7fd3681578d0 0x7fd3680cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.391+0000 7fd366d9d700 1 -- 172.21.15.81:0/623701280 >> v1:172.21.15.81:6789/0 conn(0x7fd368157ca0 legacy=0x7fd36815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.391+0000 7fd366d9d700 1 -- 172.21.15.81:0/623701280 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3680cfe90 con 0x7fd36806d120 2023-10-07T08:50:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.391+0000 7fd366d9d700 1 --2- 172.21.15.81:0/623701280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd36806d120 0x7fd36806d510 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fd3680646b0 tx=0x7fd360009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df846ee8e10cc01d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.391+0000 7fd36559a700 1 -- 172.21.15.81:0/623701280 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36000e070 con 0x7fd36806d120 2023-10-07T08:50:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.392+0000 7fd36559a700 1 -- 172.21.15.81:0/623701280 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36000ba50 con 0x7fd36806d120 2023-10-07T08:50:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.392+0000 7fd36559a700 1 -- 172.21.15.81:0/623701280 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3600092e0 con 0x7fd36806d120 2023-10-07T08:50:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.392+0000 7fd36cf95700 1 -- 172.21.15.81:0/623701280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd36806d120 msgr2=0x7fd36806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.392+0000 7fd36cf95700 1 --2- 172.21.15.81:0/623701280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd36806d120 0x7fd36806d510 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fd3680646b0 tx=0x7fd360009840 comp rx=0 tx=0).stop 2023-10-07T08:50:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.392+0000 7fd36cf95700 1 -- 172.21.15.81:0/623701280 shutdown_connections 2023-10-07T08:50:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.392+0000 7fd36cf95700 1 --2- 172.21.15.81:0/623701280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd36806d120 0x7fd36806d510 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.392+0000 7fd36cf95700 1 --2- 172.21.15.81:0/623701280 >> v2:172.21.15.89:3300/0 conn(0x7fd3681578d0 0x7fd3680cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.392+0000 7fd36cf95700 1 -- 172.21.15.81:0/623701280 >> 172.21.15.81:0/623701280 conn(0x7fd36806bb90 msgr2=0x7fd36806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.392+0000 7fd36cf95700 1 -- 172.21.15.81:0/623701280 shutdown_connections 2023-10-07T08:50:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.392+0000 7fd36cf95700 1 -- 172.21.15.81:0/623701280 wait complete. 2023-10-07T08:50:04.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.393+0000 7fd36cf95700 1 Processor -- start 2023-10-07T08:50:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.393+0000 7fd36cf95700 1 -- start start 2023-10-07T08:50:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd36cf95700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd36806d120 0x7fd368154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd36cf95700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3681578d0 0x7fd3680c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd36cf95700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd368157ca0 0x7fd3680b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd36cf95700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3680c90d0 con 0x7fd368157ca0 2023-10-07T08:50:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd36cf95700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3680b3f70 con 0x7fd36806d120 2023-10-07T08:50:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd36cf95700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36816b220 con 0x7fd3681578d0 2023-10-07T08:50:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd366d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd368157ca0 0x7fd3680b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd366d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd368157ca0 0x7fd3680b6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53496/0 (socket says 172.21.15.81:53496) 2023-10-07T08:50:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd366d9d700 1 -- 172.21.15.81:0/3972475431 learned_addr learned my addr 172.21.15.81:0/3972475431 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd36659c700 1 --2- 172.21.15.81:0/3972475431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd36806d120 0x7fd368154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd365d9b700 1 --2- 172.21.15.81:0/3972475431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3681578d0 0x7fd3680c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd366d9d700 1 -- 172.21.15.81:0/3972475431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3681578d0 msgr2=0x7fd3680c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd366d9d700 1 --2- 172.21.15.81:0/3972475431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3681578d0 0x7fd3680c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd366d9d700 1 -- 172.21.15.81:0/3972475431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd36806d120 msgr2=0x7fd368154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd366d9d700 1 --2- 172.21.15.81:0/3972475431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd36806d120 0x7fd368154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd366d9d700 1 -- 172.21.15.81:0/3972475431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd360009ae0 con 0x7fd368157ca0 2023-10-07T08:50:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.394+0000 7fd365d9b700 1 --2- 172.21.15.81:0/3972475431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3681578d0 0x7fd3680c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:50:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.395+0000 7fd366d9d700 1 --2- 172.21.15.81:0/3972475431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd368157ca0 0x7fd3680b6070 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fd36806fe20 tx=0x7fd360018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.395+0000 7fd3567fc700 1 -- 172.21.15.81:0/3972475431 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36000be60 con 0x7fd368157ca0 2023-10-07T08:50:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.395+0000 7fd3567fc700 1 -- 172.21.15.81:0/3972475431 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd360008dd0 con 0x7fd368157ca0 2023-10-07T08:50:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.395+0000 7fd3567fc700 1 -- 172.21.15.81:0/3972475431 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3600266b0 con 0x7fd368157ca0 2023-10-07T08:50:04.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.395+0000 7fd36cf95700 1 -- 172.21.15.81:0/3972475431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd368154960 con 0x7fd368157ca0 2023-10-07T08:50:04.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.395+0000 7fd36cf95700 1 -- 172.21.15.81:0/3972475431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3680c6500 con 0x7fd368157ca0 2023-10-07T08:50:04.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.396+0000 7fd3567fc700 1 -- 172.21.15.81:0/3972475431 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd360003040 con 0x7fd368157ca0 2023-10-07T08:50:04.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.396+0000 7fd3567fc700 1 --2- 172.21.15.81:0/3972475431 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd348066f30 0x7fd3480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.397+0000 7fd3567fc700 1 -- 172.21.15.81:0/3972475431 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd360086550 con 0x7fd368157ca0 2023-10-07T08:50:04.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.397+0000 7fd36659c700 1 --2- 172.21.15.81:0/3972475431 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd348066f30 0x7fd3480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.397+0000 7fd36659c700 1 --2- 172.21.15.81:0/3972475431 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd348066f30 0x7fd3480693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd358006fd0 tx=0x7fd358008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.399+0000 7fd37628db80 1 Processor -- start 2023-10-07T08:50:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.399+0000 7fd37628db80 1 -- start start 2023-10-07T08:50:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.399+0000 7fd37628db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bd7ca50 0x55cb8bd7ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.399+0000 7fd37628db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bdc6d00 0x55cb8bda5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.399+0000 7fd37628db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 0x55cb8bd78cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.399+0000 7fd37628db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb8bcd3a70 con 0x55cb8bdc6d00 2023-10-07T08:50:04.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.399+0000 7fd37628db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb8bcd1270 con 0x55cb8bd7ca50 2023-10-07T08:50:04.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.399+0000 7fd37628db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb8bccd060 con 0x55cb8bda5f60 2023-10-07T08:50:04.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.399+0000 7fd365d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bdc6d00 0x55cb8bda5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.399+0000 7fd365d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bdc6d00 0x55cb8bda5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53506/0 (socket says 172.21.15.81:53506) 2023-10-07T08:50:04.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.399+0000 7fd365d9b700 1 -- 172.21.15.81:0/1717178018 learned_addr learned my addr 172.21.15.81:0/1717178018 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:04.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.400+0000 7fd36659c700 1 --2- 172.21.15.81:0/1717178018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bd7ca50 0x55cb8bd7ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.400+0000 7fd366d9d700 1 --2- 172.21.15.81:0/1717178018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 0x55cb8bd78cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.400+0000 7fd365d9b700 1 -- 172.21.15.81:0/1717178018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 msgr2=0x55cb8bd78cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:04.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.400+0000 7fd365d9b700 1 --2- 172.21.15.81:0/1717178018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 0x55cb8bd78cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.400+0000 7fd365d9b700 1 -- 172.21.15.81:0/1717178018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bd7ca50 msgr2=0x55cb8bd7ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:04.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.400+0000 7fd365d9b700 1 --2- 172.21.15.81:0/1717178018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bd7ca50 0x55cb8bd7ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.400+0000 7fd365d9b700 1 -- 172.21.15.81:0/1717178018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb8bb67270 con 0x55cb8bdc6d00 2023-10-07T08:50:04.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.400+0000 7fd366d9d700 1 --2- 172.21.15.81:0/1717178018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 0x55cb8bd78cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:50:04.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.400+0000 7fd365d9b700 1 --2- 172.21.15.81:0/1717178018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bdc6d00 0x55cb8bda5a20 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fd35c005fa0 tx=0x7fd35c005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9811689eddc917c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:04.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.400+0000 7fd3477fe700 1 -- 172.21.15.81:0/1717178018 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0014a0 con 0x55cb8bdc6d00 2023-10-07T08:50:04.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.400+0000 7fd3477fe700 1 -- 172.21.15.81:0/1717178018 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35c001600 con 0x55cb8bdc6d00 2023-10-07T08:50:04.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.400+0000 7fd3477fe700 1 -- 172.21.15.81:0/1717178018 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c001980 con 0x55cb8bdc6d00 2023-10-07T08:50:04.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.401+0000 7fd37628db80 1 -- 172.21.15.81:0/1717178018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bdc6d00 msgr2=0x55cb8bda5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:04.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.401+0000 7fd37628db80 1 --2- 172.21.15.81:0/1717178018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bdc6d00 0x55cb8bda5a20 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fd35c005fa0 tx=0x7fd35c005a10 comp rx=0 tx=0).stop 2023-10-07T08:50:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.401+0000 7fd37628db80 1 -- 172.21.15.81:0/1717178018 shutdown_connections 2023-10-07T08:50:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.401+0000 7fd37628db80 1 --2- 172.21.15.81:0/1717178018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 0x55cb8bd78cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.401+0000 7fd37628db80 1 --2- 172.21.15.81:0/1717178018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bd7ca50 0x55cb8bd7ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.401+0000 7fd37628db80 1 --2- 172.21.15.81:0/1717178018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bdc6d00 0x55cb8bda5a20 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.401+0000 7fd37628db80 1 -- 172.21.15.81:0/1717178018 >> 172.21.15.81:0/1717178018 conn(0x55cb8bd7e370 msgr2=0x55cb8bd7e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.401+0000 7fd37628db80 1 -- 172.21.15.81:0/1717178018 shutdown_connections 2023-10-07T08:50:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.401+0000 7fd37628db80 1 -- 172.21.15.81:0/1717178018 wait complete. 2023-10-07T08:50:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.401+0000 7fd37628db80 1 -- start start 2023-10-07T08:50:04.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.401+0000 7fd37628db80 1 Processor -- start 2023-10-07T08:50:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.402+0000 7fd37628db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bd7ca50 0x55cb8bda2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.402+0000 7fd37628db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bda5f60 0x55cb8bdbe400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.402+0000 7fd37628db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bdc6d00 0x55cb8bd77c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.402+0000 7fd37628db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb8bc78890 con 0x55cb8bdc6d00 2023-10-07T08:50:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.402+0000 7fd37628db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb8bc93ea0 con 0x55cb8bda5f60 2023-10-07T08:50:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.402+0000 7fd37628db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb8bb4fe30 con 0x55cb8bd7ca50 2023-10-07T08:50:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.402+0000 7fd37628db80 10 client.0 _ll_register_callbacks cb 0x55cb8bd40110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:50:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.402+0000 7fd366d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bdc6d00 0x55cb8bd77c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.402+0000 7fd366d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bdc6d00 0x55cb8bd77c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53516/0 (socket says 172.21.15.81:53516) 2023-10-07T08:50:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.402+0000 7fd366d9d700 1 -- 172.21.15.81:0/1284540468 learned_addr learned my addr 172.21.15.81:0/1284540468 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.402+0000 7fd365d9b700 1 --2- 172.21.15.81:0/1284540468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bda5f60 0x55cb8bdbe400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.402+0000 7fd36659c700 1 --2- 172.21.15.81:0/1284540468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bd7ca50 0x55cb8bda2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd366d9d700 1 -- 172.21.15.81:0/1284540468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bd7ca50 msgr2=0x55cb8bda2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:04.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd366d9d700 1 --2- 172.21.15.81:0/1284540468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bd7ca50 0x55cb8bda2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd366d9d700 1 -- 172.21.15.81:0/1284540468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bda5f60 msgr2=0x55cb8bdbe400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:04.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd366d9d700 1 --2- 172.21.15.81:0/1284540468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bda5f60 0x55cb8bdbe400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd366d9d700 1 -- 172.21.15.81:0/1284540468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35c00f040 con 0x55cb8bdc6d00 2023-10-07T08:50:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd366d9d700 1 --2- 172.21.15.81:0/1284540468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bdc6d00 0x55cb8bd77c20 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fd360084a60 tx=0x7fd360084930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ab54ff06065bbf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd344ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:50:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd344ff9700 1 -- 172.21.15.81:0/1284540468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36000e040 con 0x55cb8bdc6d00 2023-10-07T08:50:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd344ff9700 1 -- 172.21.15.81:0/1284540468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3600573e0 con 0x55cb8bdc6d00 2023-10-07T08:50:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd37628db80 1 -- 172.21.15.81:0/1284540468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb8bd71b70 con 0x55cb8bdc6d00 2023-10-07T08:50:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd344ff9700 1 -- 172.21.15.81:0/1284540468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd360053720 con 0x55cb8bdc6d00 2023-10-07T08:50:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd37628db80 10 client.7662 fetch_fsmap learned FSMap version 74 2023-10-07T08:50:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd37628db80 1 -- 172.21.15.81:0/1284540468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x55cb8bb09fe0 con 0x55cb8bdc6d00 2023-10-07T08:50:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd344ff9700 1 -- 172.21.15.81:0/1284540468 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cb8bd71b70 con 0x55cb8bdc6d00 2023-10-07T08:50:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd344ff9700 1 -- 172.21.15.81:0/1284540468 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd3600568d0 con 0x55cb8bdc6d00 2023-10-07T08:50:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd37628db80 10 client.7662 fetch_fsmap finished waiting for FSMap version 74 2023-10-07T08:50:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd37628db80 10 client.7662 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T08:50:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd37628db80 20 client.7662 populate_metadata read hostname 'smithi081' 2023-10-07T08:50:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd37628db80 1 --2- 172.21.15.81:0/1284540468 >> [v2:172.21.15.81:6835/510483669,v1:172.21.15.81:6837/510483669] conn(0x55cb8bdc34c0 0x55cb8bdc3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd37628db80 4 client.7662 mds_command: new command op to 7512 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T08:50:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd37628db80 1 -- 172.21.15.81:0/1284540468 --> [v2:172.21.15.81:6835/510483669,v1:172.21.15.81:6837/510483669] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb8bd4eaa0 con 0x55cb8bdc34c0 2023-10-07T08:50:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.403+0000 7fd36659c700 1 --2- 172.21.15.81:0/1284540468 >> [v2:172.21.15.81:6835/510483669,v1:172.21.15.81:6837/510483669] conn(0x55cb8bdc34c0 0x55cb8bdc3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.404+0000 7fd344ff9700 10 client.7662 ms_handle_connect on v2:172.21.15.81:6835/510483669 2023-10-07T08:50:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.404+0000 7fd36659c700 1 --2- 172.21.15.81:0/1284540468 >> [v2:172.21.15.81:6835/510483669,v1:172.21.15.81:6837/510483669] conn(0x55cb8bdc34c0 0x55cb8bdc3890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=244a842c9f2eeb3 server_cookie=e031108369a586f7 in_seq=0 out_seq=0 2023-10-07T08:50:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.404+0000 7fd344ff9700 1 -- 172.21.15.81:0/1284540468 <== mds.0 v2:172.21.15.81:6835/510483669 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55cb8bd4eaa0 con 0x55cb8bdc34c0 2023-10-07T08:50:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.404+0000 7fd344ff9700 10 client.7662 handle_command_reply: tid=0 2023-10-07T08:50:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.404+0000 7fd37628db80 1 client.7662 shutdown 2023-10-07T08:50:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.404+0000 7fd37628db80 1 -- 172.21.15.81:0/1284540468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bdc6d00 msgr2=0x55cb8bd77c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.404+0000 7fd37628db80 1 --2- 172.21.15.81:0/1284540468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bdc6d00 0x55cb8bd77c20 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fd360084a60 tx=0x7fd360084930 comp rx=0 tx=0).stop 2023-10-07T08:50:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.404+0000 7fd37628db80 1 -- 172.21.15.81:0/1284540468 shutdown_connections 2023-10-07T08:50:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.404+0000 7fd37628db80 1 --2- 172.21.15.81:0/1284540468 >> [v2:172.21.15.81:6835/510483669,v1:172.21.15.81:6837/510483669] conn(0x55cb8bdc34c0 0x55cb8bdc3890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.404+0000 7fd37628db80 1 --2- 172.21.15.81:0/1284540468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bdc6d00 0x55cb8bd77c20 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.404+0000 7fd344ff9700 0 client.7662 ms_handle_reset on v2:172.21.15.81:6835/510483669 2023-10-07T08:50:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.404+0000 7fd37628db80 1 --2- 172.21.15.81:0/1284540468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bd7ca50 0x55cb8bda2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.404+0000 7fd37628db80 1 --2- 172.21.15.81:0/1284540468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bda5f60 0x55cb8bdbe400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.404+0000 7fd37628db80 1 -- 172.21.15.81:0/1284540468 >> 172.21.15.81:0/1284540468 conn(0x55cb8bd7e370 msgr2=0x55cb8bd7d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.405+0000 7fd37628db80 1 -- 172.21.15.81:0/1284540468 shutdown_connections 2023-10-07T08:50:04.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.405+0000 7fd37628db80 1 -- 172.21.15.81:0/1284540468 wait complete. 2023-10-07T08:50:04.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.405+0000 7fd37628db80 20 client.7662 trim_cache size 0 max 16384 2023-10-07T08:50:04.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.421+0000 7fd37628db80 1 Processor -- start 2023-10-07T08:50:04.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.421+0000 7fd37628db80 1 -- start start 2023-10-07T08:50:04.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd37628db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bd7e370 0x55cb8bdd5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd37628db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bd7ca50 0x55cb8bdc3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd37628db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 0x55cb8bdc3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd37628db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb8bdbd2e0 con 0x55cb8bd7e370 2023-10-07T08:50:04.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd37628db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb8bd78230 con 0x55cb8bd7ca50 2023-10-07T08:50:04.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd37628db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb8bda5950 con 0x55cb8bda5f60 2023-10-07T08:50:04.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd36659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bd7e370 0x55cb8bdd5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd36659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bd7e370 0x55cb8bdd5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53518/0 (socket says 172.21.15.81:53518) 2023-10-07T08:50:04.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd36659c700 1 -- 172.21.15.81:0/4142244279 learned_addr learned my addr 172.21.15.81:0/4142244279 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:04.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd365d9b700 1 --2- 172.21.15.81:0/4142244279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bd7ca50 0x55cb8bdc3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd366d9d700 1 --2- 172.21.15.81:0/4142244279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 0x55cb8bdc3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd36659c700 1 -- 172.21.15.81:0/4142244279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 msgr2=0x55cb8bdc3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd36659c700 1 --2- 172.21.15.81:0/4142244279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 0x55cb8bdc3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd36659c700 1 -- 172.21.15.81:0/4142244279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bd7ca50 msgr2=0x55cb8bdc3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd36659c700 1 --2- 172.21.15.81:0/4142244279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bd7ca50 0x55cb8bdc3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd36659c700 1 -- 172.21.15.81:0/4142244279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb8bc9b780 con 0x55cb8bd7e370 2023-10-07T08:50:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd365d9b700 1 --2- 172.21.15.81:0/4142244279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bd7ca50 0x55cb8bdc3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:50:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.422+0000 7fd366d9d700 1 --2- 172.21.15.81:0/4142244279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 0x55cb8bdc3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:50:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.423+0000 7fd36659c700 1 --2- 172.21.15.81:0/4142244279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bd7e370 0x55cb8bdd5a30 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x55cb8bdc6340 tx=0x7fd358014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1827d8415f5976d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.423+0000 7fd347fff700 1 -- 172.21.15.81:0/4142244279 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358015860 con 0x55cb8bd7e370 2023-10-07T08:50:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.423+0000 7fd347fff700 1 -- 172.21.15.81:0/4142244279 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3580159c0 con 0x55cb8bd7e370 2023-10-07T08:50:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.423+0000 7fd347fff700 1 -- 172.21.15.81:0/4142244279 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358015d40 con 0x55cb8bd7e370 2023-10-07T08:50:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.423+0000 7fd37628db80 1 -- 172.21.15.81:0/4142244279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bd7e370 msgr2=0x55cb8bdd5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:04.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.423+0000 7fd37628db80 1 --2- 172.21.15.81:0/4142244279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bd7e370 0x55cb8bdd5a30 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x55cb8bdc6340 tx=0x7fd358014000 comp rx=0 tx=0).stop 2023-10-07T08:50:04.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.423+0000 7fd37628db80 1 -- 172.21.15.81:0/4142244279 shutdown_connections 2023-10-07T08:50:04.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.423+0000 7fd37628db80 1 --2- 172.21.15.81:0/4142244279 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 0x55cb8bdc3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.423+0000 7fd37628db80 1 --2- 172.21.15.81:0/4142244279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bd7e370 0x55cb8bdd5a30 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.423+0000 7fd37628db80 1 --2- 172.21.15.81:0/4142244279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bd7ca50 0x55cb8bdc3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.423+0000 7fd37628db80 1 -- 172.21.15.81:0/4142244279 >> 172.21.15.81:0/4142244279 conn(0x55cb8bdc6930 msgr2=0x55cb8bdac850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:04.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.423+0000 7fd37628db80 1 -- 172.21.15.81:0/4142244279 shutdown_connections 2023-10-07T08:50:04.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.423+0000 7fd37628db80 1 -- 172.21.15.81:0/4142244279 wait complete. 2023-10-07T08:50:04.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.424+0000 7fd37628db80 1 -- start start 2023-10-07T08:50:04.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.424+0000 7fd37628db80 1 Processor -- start 2023-10-07T08:50:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd37628db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bd7ca50 0x55cb8be1f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd37628db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bd7e370 0x55cb8bd7d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd37628db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 0x55cb8bdc3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd37628db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb8bdac610 con 0x55cb8bd7e370 2023-10-07T08:50:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd37628db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb8be295a0 con 0x55cb8bd7ca50 2023-10-07T08:50:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd37628db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb8be28cb0 con 0x55cb8bda5f60 2023-10-07T08:50:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd37628db80 10 client.0 _ll_register_callbacks cb 0x55cb8bd40110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:50:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd365d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bd7e370 0x55cb8bd7d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd365d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bd7e370 0x55cb8bd7d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53522/0 (socket says 172.21.15.81:53522) 2023-10-07T08:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd365d9b700 1 -- 172.21.15.81:0/2194528196 learned_addr learned my addr 172.21.15.81:0/2194528196 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd36659c700 1 --2- 172.21.15.81:0/2194528196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bd7ca50 0x55cb8be1f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd366d9d700 1 --2- 172.21.15.81:0/2194528196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 0x55cb8bdc3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd365d9b700 1 -- 172.21.15.81:0/2194528196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 msgr2=0x55cb8bdc3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd365d9b700 1 --2- 172.21.15.81:0/2194528196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 0x55cb8bdc3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd365d9b700 1 -- 172.21.15.81:0/2194528196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bd7ca50 msgr2=0x55cb8be1f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd365d9b700 1 --2- 172.21.15.81:0/2194528196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bd7ca50 0x55cb8be1f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd365d9b700 1 -- 172.21.15.81:0/2194528196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35800e040 con 0x55cb8bd7e370 2023-10-07T08:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd365d9b700 1 --2- 172.21.15.81:0/2194528196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bd7e370 0x55cb8bd7d580 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fd35c007890 tx=0x7fd35c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d6520b0ff2c610 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd344ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:50:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd344ff9700 1 -- 172.21.15.81:0/2194528196 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c001770 con 0x55cb8bd7e370 2023-10-07T08:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd344ff9700 1 -- 172.21.15.81:0/2194528196 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd35c0018d0 con 0x55cb8bd7e370 2023-10-07T08:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.425+0000 7fd37628db80 1 -- 172.21.15.81:0/2194528196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd35c001600 con 0x55cb8bd7e370 2023-10-07T08:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd344ff9700 1 -- 172.21.15.81:0/2194528196 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd35c014690 con 0x55cb8bd7e370 2023-10-07T08:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd37628db80 10 client.7668 fetch_fsmap learned FSMap version 74 2023-10-07T08:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd37628db80 1 -- 172.21.15.81:0/2194528196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x55cb8bc82470 con 0x55cb8bd7e370 2023-10-07T08:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd344ff9700 1 -- 172.21.15.81:0/2194528196 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35c001600 con 0x55cb8bd7e370 2023-10-07T08:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd344ff9700 1 -- 172.21.15.81:0/2194528196 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd35c0147f0 con 0x55cb8bd7e370 2023-10-07T08:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd37628db80 10 client.7668 fetch_fsmap finished waiting for FSMap version 74 2023-10-07T08:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd37628db80 10 client.7668 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T08:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd37628db80 20 client.7668 populate_metadata read hostname 'smithi081' 2023-10-07T08:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd37628db80 1 --2- 172.21.15.81:0/2194528196 >> [v2:172.21.15.81:6835/510483669,v1:172.21.15.81:6837/510483669] conn(0x55cb8bdc6d00 0x55cb8be2c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd37628db80 4 client.7668 mds_command: new command op to 7512 tid=0[{"prefix": "status"}] 2023-10-07T08:50:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd37628db80 1 -- 172.21.15.81:0/2194528196 --> [v2:172.21.15.81:6835/510483669,v1:172.21.15.81:6837/510483669] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cb8bc6fe00 con 0x55cb8bdc6d00 2023-10-07T08:50:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd36659c700 1 --2- 172.21.15.81:0/2194528196 >> [v2:172.21.15.81:6835/510483669,v1:172.21.15.81:6837/510483669] conn(0x55cb8bdc6d00 0x55cb8be2c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd36659c700 1 --2- 172.21.15.81:0/2194528196 >> [v2:172.21.15.81:6835/510483669,v1:172.21.15.81:6837/510483669] conn(0x55cb8bdc6d00 0x55cb8be2c540 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=690ba2955190f210 server_cookie=abacbafa839ef932 in_seq=0 out_seq=0 2023-10-07T08:50:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd344ff9700 10 client.7668 ms_handle_connect on v2:172.21.15.81:6835/510483669 2023-10-07T08:50:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd344ff9700 1 -- 172.21.15.81:0/2194528196 <== mds.0 v2:172.21.15.81:6835/510483669 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x55cb8bc6fe00 con 0x55cb8bdc6d00 2023-10-07T08:50:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd344ff9700 10 client.7668 handle_command_reply: tid=0 2023-10-07T08:50:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd37628db80 1 client.7668 shutdown 2023-10-07T08:50:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd37628db80 1 -- 172.21.15.81:0/2194528196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bd7e370 msgr2=0x55cb8bd7d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.426+0000 7fd37628db80 1 --2- 172.21.15.81:0/2194528196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bd7e370 0x55cb8bd7d580 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fd35c007890 tx=0x7fd35c017000 comp rx=0 tx=0).stop 2023-10-07T08:50:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd37628db80 1 -- 172.21.15.81:0/2194528196 shutdown_connections 2023-10-07T08:50:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd37628db80 1 --2- 172.21.15.81:0/2194528196 >> [v2:172.21.15.81:6835/510483669,v1:172.21.15.81:6837/510483669] conn(0x55cb8bdc6d00 0x55cb8be2c540 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd37628db80 1 --2- 172.21.15.81:0/2194528196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cb8bda5f60 0x55cb8bdc3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd344ff9700 0 client.7668 ms_handle_reset on v2:172.21.15.81:6835/510483669 2023-10-07T08:50:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd37628db80 1 --2- 172.21.15.81:0/2194528196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cb8bd7ca50 0x55cb8be1f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd37628db80 1 --2- 172.21.15.81:0/2194528196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb8bd7e370 0x55cb8bd7d580 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd37628db80 1 -- 172.21.15.81:0/2194528196 >> 172.21.15.81:0/2194528196 conn(0x55cb8bdc6930 msgr2=0x55cb8bdc4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd37628db80 1 -- 172.21.15.81:0/2194528196 shutdown_connections 2023-10-07T08:50:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd37628db80 1 -- 172.21.15.81:0/2194528196 wait complete. 2023-10-07T08:50:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd37628db80 20 client.7668 trim_cache size 0 max 16384 2023-10-07T08:50:04.438 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:50:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:50:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-07T08:50:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7512, 2023-10-07T08:50:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-07T08:50:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-07T08:50:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-07T08:50:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.781648229, 2023-10-07T08:50:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 74, 2023-10-07T08:50:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 156, 2023-10-07T08:50:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 156, 2023-10-07T08:50:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 10.910390042 2023-10-07T08:50:04.439 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:50:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd36cf95700 1 -- 172.21.15.81:0/3972475431 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd348066f30 msgr2=0x7fd3480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd36cf95700 1 --2- 172.21.15.81:0/3972475431 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd348066f30 0x7fd3480693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd358006fd0 tx=0x7fd358008040 comp rx=0 tx=0).stop 2023-10-07T08:50:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd36cf95700 1 -- 172.21.15.81:0/3972475431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd368157ca0 msgr2=0x7fd3680b6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd36cf95700 1 --2- 172.21.15.81:0/3972475431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd368157ca0 0x7fd3680b6070 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fd36806fe20 tx=0x7fd360018000 comp rx=0 tx=0).stop 2023-10-07T08:50:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd36cf95700 1 -- 172.21.15.81:0/3972475431 shutdown_connections 2023-10-07T08:50:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd36cf95700 1 --2- 172.21.15.81:0/3972475431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd368157ca0 0x7fd3680b6070 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd36cf95700 1 --2- 172.21.15.81:0/3972475431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd36806d120 0x7fd368154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd36cf95700 1 --2- 172.21.15.81:0/3972475431 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd348066f30 0x7fd3480693e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd36cf95700 1 --2- 172.21.15.81:0/3972475431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3681578d0 0x7fd3680c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd36cf95700 1 -- 172.21.15.81:0/3972475431 >> 172.21.15.81:0/3972475431 conn(0x7fd36806bb90 msgr2=0x7fd368155570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd36cf95700 1 -- 172.21.15.81:0/3972475431 shutdown_connections 2023-10-07T08:50:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.427+0000 7fd36cf95700 1 -- 172.21.15.81:0/3972475431 wait complete. 2023-10-07T08:50:04.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:50:04.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.594+0000 7f1ac2151700 1 Processor -- start 2023-10-07T08:50:04.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.594+0000 7f1ac2151700 1 -- start start 2023-10-07T08:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.595+0000 7f1ac2151700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1abc157ca0 0x7f1abc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.595+0000 7f1ac2151700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1abc06d120 0x7f1abc06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.595+0000 7f1ac2151700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1abc0d07c0 con 0x7f1abc1578d0 2023-10-07T08:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.595+0000 7f1ac2151700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1abc06daa0 con 0x7f1abc157ca0 2023-10-07T08:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.595+0000 7f1ac2151700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc0cfbb0 con 0x7f1abc06d120 2023-10-07T08:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.595+0000 7f1abbfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1abc06d120 0x7f1abc06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.595+0000 7f1abaffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1abc157ca0 0x7f1abc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.595+0000 7f1abaffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1abc157ca0 0x7f1abc0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:46480/0 (socket says 172.21.15.81:46480) 2023-10-07T08:50:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.595+0000 7f1abbfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1abc06d120 0x7f1abc06d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:43540/0 (socket says 172.21.15.81:43540) 2023-10-07T08:50:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.595+0000 7f1abaffd700 1 -- 172.21.15.81:0/3360611094 learned_addr learned my addr 172.21.15.81:0/3360611094 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.596+0000 7f1abaffd700 1 -- 172.21.15.81:0/3360611094 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1abc06d120 msgr2=0x7f1abc06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.596+0000 7f1abaffd700 1 --2- 172.21.15.81:0/3360611094 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1abc06d120 0x7f1abc06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.596+0000 7f1abaffd700 1 -- 172.21.15.81:0/3360611094 >> v1:172.21.15.89:6789/0 conn(0x7f1abc1578d0 legacy=0x7f1abc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.596+0000 7f1abaffd700 1 -- 172.21.15.81:0/3360611094 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc0cfe90 con 0x7f1abc157ca0 2023-10-07T08:50:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.596+0000 7f1abbfff700 1 --2- 172.21.15.81:0/3360611094 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1abc06d120 0x7f1abc06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:50:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.596+0000 7f1abaffd700 1 --2- 172.21.15.81:0/3360611094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1abc157ca0 0x7f1abc0cf4f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00099b0 tx=0x7f1ab0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=513f6579ed421d34 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.596+0000 7f1aba7fc700 1 -- 172.21.15.81:0/3360611094 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0009ea0 con 0x7f1abc157ca0 2023-10-07T08:50:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.596+0000 7f1aba7fc700 1 -- 172.21.15.81:0/3360611094 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab000b860 con 0x7f1abc157ca0 2023-10-07T08:50:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.596+0000 7f1aba7fc700 1 -- 172.21.15.81:0/3360611094 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab000bc00 con 0x7f1abc157ca0 2023-10-07T08:50:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.597+0000 7f1ac2151700 1 -- 172.21.15.81:0/3360611094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1abc157ca0 msgr2=0x7f1abc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.597+0000 7f1ac2151700 1 --2- 172.21.15.81:0/3360611094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1abc157ca0 0x7f1abc0cf4f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00099b0 tx=0x7f1ab0009250 comp rx=0 tx=0).stop 2023-10-07T08:50:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.597+0000 7f1ac2151700 1 -- 172.21.15.81:0/3360611094 shutdown_connections 2023-10-07T08:50:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.597+0000 7f1ac2151700 1 --2- 172.21.15.81:0/3360611094 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1abc06d120 0x7f1abc06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.597+0000 7f1ac2151700 1 --2- 172.21.15.81:0/3360611094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1abc157ca0 0x7f1abc0cf4f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.597+0000 7f1ac2151700 1 -- 172.21.15.81:0/3360611094 >> 172.21.15.81:0/3360611094 conn(0x7f1abc06bb90 msgr2=0x7f1abc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.597+0000 7f1ac2151700 1 -- 172.21.15.81:0/3360611094 shutdown_connections 2023-10-07T08:50:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.597+0000 7f1ac2151700 1 -- 172.21.15.81:0/3360611094 wait complete. 2023-10-07T08:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.598+0000 7f1ac2151700 1 Processor -- start 2023-10-07T08:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.598+0000 7f1ac2151700 1 -- start start 2023-10-07T08:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1ac2151700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc06d120 0x7f1abc0b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1ac2151700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1abc1578d0 0x7f1abc0ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1ac2151700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1abc157ca0 0x7f1abc15c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1ac2151700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc153ef0 con 0x7f1abc06d120 2023-10-07T08:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1ac2151700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc0b4ee0 con 0x7f1abc157ca0 2023-10-07T08:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1ac2151700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc0b51c0 con 0x7f1abc1578d0 2023-10-07T08:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1abb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc06d120 0x7f1abc0b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1abb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc06d120 0x7f1abc0b66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53528/0 (socket says 172.21.15.81:53528) 2023-10-07T08:50:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1abb7fe700 1 -- 172.21.15.81:0/257683582 learned_addr learned my addr 172.21.15.81:0/257683582 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1abbfff700 1 --2- 172.21.15.81:0/257683582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1abc157ca0 0x7f1abc15c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1abaffd700 1 --2- 172.21.15.81:0/257683582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1abc1578d0 0x7f1abc0ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1abb7fe700 1 -- 172.21.15.81:0/257683582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1abc1578d0 msgr2=0x7f1abc0ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1abb7fe700 1 --2- 172.21.15.81:0/257683582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1abc1578d0 0x7f1abc0ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1abb7fe700 1 -- 172.21.15.81:0/257683582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1abc157ca0 msgr2=0x7f1abc15c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1abb7fe700 1 --2- 172.21.15.81:0/257683582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1abc157ca0 0x7f1abc15c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1abb7fe700 1 -- 172.21.15.81:0/257683582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab4009a20 con 0x7f1abc06d120 2023-10-07T08:50:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1abb7fe700 1 --2- 172.21.15.81:0/257683582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc06d120 0x7f1abc0b66e0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00c590 tx=0x7f1aac00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.599+0000 7f1aa37fe700 1 -- 172.21.15.81:0/257683582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac011590 con 0x7f1abc06d120 2023-10-07T08:50:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.600+0000 7f1aa37fe700 1 -- 172.21.15.81:0/257683582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac011710 con 0x7f1abc06d120 2023-10-07T08:50:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.600+0000 7f1ac2151700 1 -- 172.21.15.81:0/257683582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab00094f0 con 0x7f1abc06d120 2023-10-07T08:50:04.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.600+0000 7f1aa37fe700 1 -- 172.21.15.81:0/257683582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac011ad0 con 0x7f1abc06d120 2023-10-07T08:50:04.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.600+0000 7f1ac2151700 1 -- 172.21.15.81:0/257683582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1abc0b5780 con 0x7f1abc06d120 2023-10-07T08:50:04.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.601+0000 7f1ac2151700 1 -- 172.21.15.81:0/257683582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1abc16a110 con 0x7f1abc06d120 2023-10-07T08:50:04.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.601+0000 7f1aa37fe700 1 -- 172.21.15.81:0/257683582 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1aac01b3b0 con 0x7f1abc06d120 2023-10-07T08:50:04.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.601+0000 7f1aa37fe700 1 --2- 172.21.15.81:0/257683582 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1aa8066f30 0x7f1aa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:04.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.601+0000 7f1aa37fe700 1 -- 172.21.15.81:0/257683582 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1aac0839b0 con 0x7f1abc06d120 2023-10-07T08:50:04.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.601+0000 7f1abaffd700 1 --2- 172.21.15.81:0/257683582 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1aa8066f30 0x7f1aa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:04.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.602+0000 7f1abaffd700 1 --2- 172.21.15.81:0/257683582 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1aa8066f30 0x7f1aa80693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00099b0 tx=0x7f1ab0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:04.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.606+0000 7f1aa37fe700 1 -- 172.21.15.81:0/257683582 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1aac050ce0 con 0x7f1abc06d120 2023-10-07T08:50:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.829+0000 7f1ac2151700 1 -- 172.21.15.81:0/257683582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1abc0d0170 con 0x7f1abc06d120 2023-10-07T08:50:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.829+0000 7f1aa37fe700 1 -- 172.21.15.81:0/257683582 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1aac017070 con 0x7f1abc06d120 2023-10-07T08:50:04.831 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:50:04.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.831+0000 7f1ac2151700 1 -- 172.21.15.81:0/257683582 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1aa8066f30 msgr2=0x7f1aa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.831+0000 7f1ac2151700 1 --2- 172.21.15.81:0/257683582 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1aa8066f30 0x7f1aa80693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00099b0 tx=0x7f1ab0017000 comp rx=0 tx=0).stop 2023-10-07T08:50:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.831+0000 7f1ac2151700 1 -- 172.21.15.81:0/257683582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc06d120 msgr2=0x7f1abc0b66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.831+0000 7f1ac2151700 1 --2- 172.21.15.81:0/257683582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc06d120 0x7f1abc0b66e0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00c590 tx=0x7f1aac00c8a0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.831+0000 7f1ac2151700 1 -- 172.21.15.81:0/257683582 shutdown_connections 2023-10-07T08:50:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.831+0000 7f1ac2151700 1 --2- 172.21.15.81:0/257683582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1abc157ca0 0x7f1abc15c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.831+0000 7f1ac2151700 1 --2- 172.21.15.81:0/257683582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc06d120 0x7f1abc0b66e0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.831+0000 7f1ac2151700 1 --2- 172.21.15.81:0/257683582 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1aa8066f30 0x7f1aa80693e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.831+0000 7f1ac2151700 1 --2- 172.21.15.81:0/257683582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1abc1578d0 0x7f1abc0ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.831+0000 7f1ac2151700 1 -- 172.21.15.81:0/257683582 >> 172.21.15.81:0/257683582 conn(0x7f1abc06bb90 msgr2=0x7f1abc1547a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:04.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.831+0000 7f1ac2151700 1 -- 172.21.15.81:0/257683582 shutdown_connections 2023-10-07T08:50:04.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:04.831+0000 7f1ac2151700 1 -- 172.21.15.81:0/257683582 wait complete. 2023-10-07T08:50:04.844 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:50:04.844 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:50:04.844 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-07T08:50:04.845 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T08:50:04.845 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T08:50:04.845 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:50:04.845 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:50:04.845 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:50:04.845 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:50:04.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:50:04.845 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-07T08:50:04.860 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:50:04.861 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:50:04.861 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:50:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:50:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-07T08:50:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:50:04.862 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:50:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:50:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-07T08:50:04.862 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:50:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:50:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-07T08:50:04.863 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:50:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:50:04.863 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:50:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:50:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:50:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42123sec preferred_lft 42123sec 2023-10-07T08:50:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-10-07T08:50:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:50:04.863 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:50:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff 2023-10-07T08:50:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:50:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:50:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::8c72:9ff:fe74:8c7e/64 scope link 2023-10-07T08:50:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:50:04.864 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:50:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:fe:81:9d:9c:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T08:50:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8fe:81ff:fe9d:9c0a/64 scope link 2023-10-07T08:50:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:50:04.864 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:50:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T08:50:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d838:b7ff:fe6e:914d/64 scope link 2023-10-07T08:50:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:50:04.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:50:04.865 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:50:04.924 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-07T08:50:04.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:50:04.926 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-07T08:50:04.983 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-07T08:50:04.983 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:50:04.983 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:50:04.983 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:50:04.984 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:50:04.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:50:04.984 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:50:04.984 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:50:04.984 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:50:04.984 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:50:04.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:50:04.985 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:50:05.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:50:05.083 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-07T08:50:05.098 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T08:50:05.098 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T08:50:05.098 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:50:05.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:50:05.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-07T08:50:05.162 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:50:05.163 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T08:50:05.217 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:50:05.217 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:50:05.217 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:50:05.271 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:50:05.271 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:50:05.271 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:50:05.350 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:50:05.351 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:50:05.351 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:50:05.359 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:50:05.359 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:50:05.359 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:50:05.359 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:50:05.359 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:50:05.381 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:50:05.381 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:50:05.381 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:50:05.381 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:50:05.381 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:50:05.381 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:50:05.381 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:50:05.381 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:50:05.384 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:50:05.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:50:05.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:50:05.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:50:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.603+0000 7fe98d031700 1 Processor -- start 2023-10-07T08:50:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.603+0000 7fe98d031700 1 -- start start 2023-10-07T08:50:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.603+0000 7fe98d031700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe988157ca0 0x7fe9880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.604+0000 7fe98d031700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9880d07c0 con 0x7fe98806d120 2023-10-07T08:50:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.604+0000 7fe98d031700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9880cfbb0 con 0x7fe9881578d0 2023-10-07T08:50:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.604+0000 7fe98d031700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9880cfe90 con 0x7fe988157ca0 2023-10-07T08:50:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.604+0000 7fe98659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe988157ca0 0x7fe9880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.604+0000 7fe98759e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe98806d120 0x7fe98806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52286/0 (socket says 172.21.15.81:52286) 2023-10-07T08:50:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.604+0000 7fe98759e700 1 -- 172.21.15.81:0/3614824516 learned_addr learned my addr 172.21.15.81:0/3614824516 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:50:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.604+0000 7fe98659c700 1 -- 172.21.15.81:0/3614824516 >> v1:172.21.15.89:6789/0 conn(0x7fe9881578d0 legacy=0x7fe98815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.604+0000 7fe98659c700 1 -- 172.21.15.81:0/3614824516 >> v1:172.21.15.81:6789/0 conn(0x7fe98806d120 legacy=0x7fe98806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.604+0000 7fe98659c700 1 -- 172.21.15.81:0/3614824516 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9880d0170 con 0x7fe988157ca0 2023-10-07T08:50:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.604+0000 7fe985d9b700 1 -- 172.21.15.81:0/3614824516 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983306270 0 0) 0x7fe9880d07c0 con 0x7fe98806d120 2023-10-07T08:50:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.604+0000 7fe98659c700 1 --2- 172.21.15.81:0/3614824516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe988157ca0 0x7fe9880cf4f0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0098e0 tx=0x7fe97c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb22e18f719d90b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.604+0000 7fe985d9b700 1 -- 172.21.15.81:0/3614824516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c009e80 con 0x7fe988157ca0 2023-10-07T08:50:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.604+0000 7fe985d9b700 1 -- 172.21.15.81:0/3614824516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c00b820 con 0x7fe988157ca0 2023-10-07T08:50:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.604+0000 7fe985d9b700 1 -- 172.21.15.81:0/3614824516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c00bba0 con 0x7fe988157ca0 2023-10-07T08:50:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.605+0000 7fe98d031700 1 -- 172.21.15.81:0/3614824516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe988157ca0 msgr2=0x7fe9880cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:05.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.605+0000 7fe98d031700 1 --2- 172.21.15.81:0/3614824516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe988157ca0 0x7fe9880cf4f0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0098e0 tx=0x7fe97c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:50:05.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.605+0000 7fe98d031700 1 -- 172.21.15.81:0/3614824516 shutdown_connections 2023-10-07T08:50:05.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.605+0000 7fe98d031700 1 --2- 172.21.15.81:0/3614824516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe988157ca0 0x7fe9880cf4f0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:05.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.605+0000 7fe98d031700 1 -- 172.21.15.81:0/3614824516 >> 172.21.15.81:0/3614824516 conn(0x7fe98806bb90 msgr2=0x7fe98806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:05.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.605+0000 7fe98d031700 1 -- 172.21.15.81:0/3614824516 shutdown_connections 2023-10-07T08:50:05.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.605+0000 7fe98d031700 1 -- 172.21.15.81:0/3614824516 wait complete. 2023-10-07T08:50:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.606+0000 7fe98d031700 1 Processor -- start 2023-10-07T08:50:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.606+0000 7fe98d031700 1 -- start start 2023-10-07T08:50:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98d031700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe98806d120 0x7fe988143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98d031700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9881578d0 0x7fe988159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98d031700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe988157ca0 0x7fe9880aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98d031700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe988159ac0 con 0x7fe988157ca0 2023-10-07T08:50:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98d031700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9881432e0 con 0x7fe98806d120 2023-10-07T08:50:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98d031700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9880ac420 con 0x7fe9881578d0 2023-10-07T08:50:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe988157ca0 0x7fe9880aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:05.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe988157ca0 0x7fe9880aad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53538/0 (socket says 172.21.15.81:53538) 2023-10-07T08:50:05.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98759e700 1 -- 172.21.15.81:0/50296600 learned_addr learned my addr 172.21.15.81:0/50296600 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:05.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe986d9d700 1 --2- 172.21.15.81:0/50296600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe98806d120 0x7fe988143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:05.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98659c700 1 --2- 172.21.15.81:0/50296600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9881578d0 0x7fe988159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:05.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98759e700 1 -- 172.21.15.81:0/50296600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9881578d0 msgr2=0x7fe988159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:05.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98759e700 1 --2- 172.21.15.81:0/50296600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9881578d0 0x7fe988159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:05.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98759e700 1 -- 172.21.15.81:0/50296600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe98806d120 msgr2=0x7fe988143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:05.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98759e700 1 --2- 172.21.15.81:0/50296600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe98806d120 0x7fe988143570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:05.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98759e700 1 -- 172.21.15.81:0/50296600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c009420 con 0x7fe988157ca0 2023-10-07T08:50:05.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe986d9d700 1 --2- 172.21.15.81:0/50296600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe98806d120 0x7fe988143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:50:05.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98759e700 1 --2- 172.21.15.81:0/50296600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe988157ca0 0x7fe9880aad50 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fe98000cc90 tx=0x7fe980001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:05.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe96effd700 1 -- 172.21.15.81:0/50296600 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98000cea0 con 0x7fe988157ca0 2023-10-07T08:50:05.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe96effd700 1 -- 172.21.15.81:0/50296600 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98000ab70 con 0x7fe988157ca0 2023-10-07T08:50:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98d031700 1 -- 172.21.15.81:0/50296600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9880ab810 con 0x7fe988157ca0 2023-10-07T08:50:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe96effd700 1 -- 172.21.15.81:0/50296600 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9800070f0 con 0x7fe988157ca0 2023-10-07T08:50:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.607+0000 7fe98d031700 1 -- 172.21.15.81:0/50296600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9880abdd0 con 0x7fe988157ca0 2023-10-07T08:50:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.608+0000 7fe98d031700 1 -- 172.21.15.81:0/50296600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe988067ac0 con 0x7fe988157ca0 2023-10-07T08:50:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.609+0000 7fe96effd700 1 -- 172.21.15.81:0/50296600 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe980007460 con 0x7fe988157ca0 2023-10-07T08:50:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.609+0000 7fe96effd700 1 --2- 172.21.15.81:0/50296600 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe974066f30 0x7fe9740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.609+0000 7fe96effd700 1 -- 172.21.15.81:0/50296600 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe980084970 con 0x7fe988157ca0 2023-10-07T08:50:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.609+0000 7fe986d9d700 1 --2- 172.21.15.81:0/50296600 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe974066f30 0x7fe9740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.610+0000 7fe986d9d700 1 --2- 172.21.15.81:0/50296600 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe974066f30 0x7fe9740693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe98815a880 tx=0x7fe978009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.613+0000 7fe96effd700 1 -- 172.21.15.81:0/50296600 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe980051c60 con 0x7fe988157ca0 2023-10-07T08:50:05.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.840+0000 7fe98d031700 1 -- 172.21.15.81:0/50296600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe9880d0480 con 0x7fe988157ca0 2023-10-07T08:50:05.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.841+0000 7fe96effd700 1 -- 172.21.15.81:0/50296600 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe980055280 con 0x7fe988157ca0 2023-10-07T08:50:05.842 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:50:05.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.843+0000 7fe98d031700 1 -- 172.21.15.81:0/50296600 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe974066f30 msgr2=0x7fe9740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:05.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.843+0000 7fe98d031700 1 --2- 172.21.15.81:0/50296600 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe974066f30 0x7fe9740693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe98815a880 tx=0x7fe978009040 comp rx=0 tx=0).stop 2023-10-07T08:50:05.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.843+0000 7fe98d031700 1 -- 172.21.15.81:0/50296600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe988157ca0 msgr2=0x7fe9880aad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:05.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.843+0000 7fe98d031700 1 --2- 172.21.15.81:0/50296600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe988157ca0 0x7fe9880aad50 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fe98000cc90 tx=0x7fe980001a80 comp rx=0 tx=0).stop 2023-10-07T08:50:05.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.843+0000 7fe98d031700 1 -- 172.21.15.81:0/50296600 shutdown_connections 2023-10-07T08:50:05.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.843+0000 7fe98d031700 1 --2- 172.21.15.81:0/50296600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe988157ca0 0x7fe9880aad50 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:05.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.843+0000 7fe98d031700 1 --2- 172.21.15.81:0/50296600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe98806d120 0x7fe988143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:05.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.843+0000 7fe98d031700 1 --2- 172.21.15.81:0/50296600 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe974066f30 0x7fe9740693e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:05.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.843+0000 7fe98d031700 1 --2- 172.21.15.81:0/50296600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9881578d0 0x7fe988159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:05.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.843+0000 7fe98d031700 1 -- 172.21.15.81:0/50296600 >> 172.21.15.81:0/50296600 conn(0x7fe98806bb90 msgr2=0x7fe988155940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:05.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.843+0000 7fe98d031700 1 -- 172.21.15.81:0/50296600 shutdown_connections 2023-10-07T08:50:05.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:05.843+0000 7fe98d031700 1 -- 172.21.15.81:0/50296600 wait complete. 2023-10-07T08:50:05.856 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:50:05.856 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:50:05.856 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-07T08:50:05.856 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T08:50:05.856 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T08:50:05.856 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:50:05.856 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:50:05.856 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:50:05.856 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:50:05.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:50:05.857 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-07T08:50:05.876 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:50:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:50:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:50:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:50:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-07T08:50:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:50:05.876 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:50:05.876 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:50:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-10-07T08:50:05.877 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:50:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:50:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-10-07T08:50:05.877 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:50:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:50:05.877 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:50:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:50:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:50:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42122sec preferred_lft 42122sec 2023-10-07T08:50:05.877 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2023-10-07T08:50:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:50:05.878 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:50:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:50:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:50:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:50:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::74d7:a9ff:fe87:ed9/64 scope link 2023-10-07T08:50:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:50:05.878 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:50:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T08:50:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6c40:c5ff:fe3a:a57/64 scope link 2023-10-07T08:50:05.878 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:50:05.879 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:50:05.879 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether de:db:cd:68:b1:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T08:50:05.879 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::dcdb:cdff:fe68:b178/64 scope link 2023-10-07T08:50:05.879 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:50:05.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:50:05.879 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:50:05.943 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-07T08:50:05.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:50:05.945 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-07T08:50:06.002 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-07T08:50:06.003 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:50:06.003 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:50:06.003 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:50:06.003 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:50:06.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:50:06.003 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:50:06.003 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:50:06.003 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:50:06.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:50:06.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:50:06.004 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:50:06.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:50:06.106 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-07T08:50:06.120 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T08:50:06.121 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T08:50:06.121 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:50:06.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:50:06.121 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-07T08:50:06.186 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:50:06.186 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T08:50:06.242 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:50:06.242 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:50:06.243 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:50:06.296 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:50:06.296 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:50:06.296 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:50:06.376 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:50:06.376 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:50:06.377 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:50:06.385 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:50:06.385 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:50:06.385 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:50:06.385 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:50:06.385 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:50:06.407 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:50:06.407 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:50:06.407 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:50:06.407 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:50:06.407 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:50:06.407 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:50:06.407 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:50:06.407 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:50:06.409 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:50:06.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:50:06.409 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:50:06.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:50:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.589+0000 7f4fe8a44700 1 Processor -- start 2023-10-07T08:50:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.589+0000 7f4fe8a44700 1 -- start start 2023-10-07T08:50:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.590+0000 7f4fe8a44700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fe4068e90 0x7f4fe4164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.590+0000 7f4fe8a44700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe40cee10 con 0x7f4fe4159b40 2023-10-07T08:50:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.590+0000 7f4fe8a44700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe40cd040 con 0x7f4fe4159f10 2023-10-07T08:50:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.590+0000 7f4fe8a44700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40cd320 con 0x7f4fe4068e90 2023-10-07T08:50:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.590+0000 7f4fe37fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4fe4159b40 0x7f4fe40cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52298/0 (socket says 172.21.15.81:52298) 2023-10-07T08:50:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.590+0000 7f4fe37fe700 1 -- 172.21.15.81:0/2887994714 learned_addr learned my addr 172.21.15.81:0/2887994714 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:50:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.590+0000 7f4fe3fff700 1 --2- 172.21.15.81:0/2887994714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fe4068e90 0x7f4fe4164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:06.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.590+0000 7f4fe27fc700 1 -- 172.21.15.81:0/2887994714 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 850159219 0 0) 0x7f4fe40cee10 con 0x7f4fe4159b40 2023-10-07T08:50:06.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.590+0000 7f4fe27fc700 1 -- 172.21.15.81:0/2887994714 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fcc003570 con 0x7f4fe4159b40 2023-10-07T08:50:06.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.590+0000 7f4fe27fc700 1 -- 172.21.15.81:0/2887994714 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768197334 0 0) 0x7f4fe40cd040 con 0x7f4fe4159f10 2023-10-07T08:50:06.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.590+0000 7f4fe27fc700 1 -- 172.21.15.81:0/2887994714 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fe40cee10 con 0x7f4fe4159f10 2023-10-07T08:50:06.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.591+0000 7f4fe3fff700 1 -- 172.21.15.81:0/2887994714 >> v1:172.21.15.89:6789/0 conn(0x7f4fe4159f10 legacy=0x7f4fe4068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:06.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.591+0000 7f4fe3fff700 1 -- 172.21.15.81:0/2887994714 >> v1:172.21.15.81:6789/0 conn(0x7f4fe4159b40 legacy=0x7f4fe40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:06.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.591+0000 7f4fe3fff700 1 -- 172.21.15.81:0/2887994714 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe40ce7c0 con 0x7f4fe4068e90 2023-10-07T08:50:06.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.591+0000 7f4fe3fff700 1 --2- 172.21.15.81:0/2887994714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fe4068e90 0x7f4fe4164c70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009910 tx=0x7f4fdc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2950af6abb16e1f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:06.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.591+0000 7f4fe27fc700 1 -- 172.21.15.81:0/2887994714 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc011630 con 0x7f4fe4068e90 2023-10-07T08:50:06.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.591+0000 7f4fe27fc700 1 -- 172.21.15.81:0/2887994714 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fdc011790 con 0x7f4fe4068e90 2023-10-07T08:50:06.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.591+0000 7f4fe27fc700 1 -- 172.21.15.81:0/2887994714 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc011b30 con 0x7f4fe4068e90 2023-10-07T08:50:06.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.591+0000 7f4fe8a44700 1 -- 172.21.15.81:0/2887994714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fe4068e90 msgr2=0x7f4fe4164c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:06.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.591+0000 7f4fe8a44700 1 --2- 172.21.15.81:0/2887994714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fe4068e90 0x7f4fe4164c70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009910 tx=0x7f4fdc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:50:06.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.591+0000 7f4fe8a44700 1 -- 172.21.15.81:0/2887994714 shutdown_connections 2023-10-07T08:50:06.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.591+0000 7f4fe8a44700 1 --2- 172.21.15.81:0/2887994714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fe4068e90 0x7f4fe4164c70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:06.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.591+0000 7f4fe8a44700 1 -- 172.21.15.81:0/2887994714 >> 172.21.15.81:0/2887994714 conn(0x7f4fe40cd660 msgr2=0x7f4fe40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:06.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.591+0000 7f4fe8a44700 1 -- 172.21.15.81:0/2887994714 shutdown_connections 2023-10-07T08:50:06.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.591+0000 7f4fe8a44700 1 -- 172.21.15.81:0/2887994714 wait complete. 2023-10-07T08:50:06.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.593+0000 7f4fe8a44700 1 Processor -- start 2023-10-07T08:50:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.593+0000 7f4fe8a44700 1 -- start start 2023-10-07T08:50:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.593+0000 7f4fe8a44700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fe4068e90 0x7f4fe416d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.593+0000 7f4fe8a44700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fe4159b40 0x7f4fe416b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.593+0000 7f4fe8a44700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fe4159f10 0x7f4fe40c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.593+0000 7f4fe8a44700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40b52f0 con 0x7f4fe4159b40 2023-10-07T08:50:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.593+0000 7f4fe8a44700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40b4a00 con 0x7f4fe4159f10 2023-10-07T08:50:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.593+0000 7f4fe8a44700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe416d810 con 0x7f4fe4068e90 2023-10-07T08:50:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.594+0000 7f4fe2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fe4159b40 0x7f4fe416b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.594+0000 7f4fe37fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fe4068e90 0x7f4fe416d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.594+0000 7f4fe2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fe4159b40 0x7f4fe416b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53550/0 (socket says 172.21.15.81:53550) 2023-10-07T08:50:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.594+0000 7f4fe2ffd700 1 -- 172.21.15.81:0/651681153 learned_addr learned my addr 172.21.15.81:0/651681153 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.594+0000 7f4fe3fff700 1 --2- 172.21.15.81:0/651681153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fe4159f10 0x7f4fe40c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.594+0000 7f4fe2ffd700 1 -- 172.21.15.81:0/651681153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fe4068e90 msgr2=0x7f4fe416d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.594+0000 7f4fe2ffd700 1 --2- 172.21.15.81:0/651681153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fe4068e90 0x7f4fe416d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.594+0000 7f4fe2ffd700 1 -- 172.21.15.81:0/651681153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fe4159f10 msgr2=0x7f4fe40c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.594+0000 7f4fe2ffd700 1 --2- 172.21.15.81:0/651681153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fe4159f10 0x7f4fe40c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.594+0000 7f4fe2ffd700 1 -- 172.21.15.81:0/651681153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc009420 con 0x7f4fe4159b40 2023-10-07T08:50:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.594+0000 7f4fe2ffd700 1 --2- 172.21.15.81:0/651681153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fe4159b40 0x7f4fe416b590 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800c580 tx=0x7f4fd8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.594+0000 7f4fcb7fe700 1 -- 172.21.15.81:0/651681153 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8010510 con 0x7f4fe4159b40 2023-10-07T08:50:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.594+0000 7f4fcb7fe700 1 -- 172.21.15.81:0/651681153 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd8010670 con 0x7f4fe4159b40 2023-10-07T08:50:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.594+0000 7f4fe8a44700 1 -- 172.21.15.81:0/651681153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe40b4ca0 con 0x7f4fe4159b40 2023-10-07T08:50:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.594+0000 7f4fcb7fe700 1 -- 172.21.15.81:0/651681153 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8010a30 con 0x7f4fe4159b40 2023-10-07T08:50:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.594+0000 7f4fe8a44700 1 -- 172.21.15.81:0/651681153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe40cabd0 con 0x7f4fe4159b40 2023-10-07T08:50:06.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.595+0000 7f4fe8a44700 1 -- 172.21.15.81:0/651681153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe40b5460 con 0x7f4fe4159b40 2023-10-07T08:50:06.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.596+0000 7f4fcb7fe700 1 -- 172.21.15.81:0/651681153 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fd801b400 con 0x7f4fe4159b40 2023-10-07T08:50:06.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.596+0000 7f4fcb7fe700 1 --2- 172.21.15.81:0/651681153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4fd0066f30 0x7f4fd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:06.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.596+0000 7f4fcb7fe700 1 -- 172.21.15.81:0/651681153 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4fd8084060 con 0x7f4fe4159b40 2023-10-07T08:50:06.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.596+0000 7f4fe37fe700 1 --2- 172.21.15.81:0/651681153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4fd0066f30 0x7f4fd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:06.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.596+0000 7f4fe37fe700 1 --2- 172.21.15.81:0/651681153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4fd0066f30 0x7f4fd00693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40b6590 tx=0x7f4fd4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.600+0000 7f4fcb7fe700 1 -- 172.21.15.81:0/651681153 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fd80512d0 con 0x7f4fe4159b40 2023-10-07T08:50:06.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.827+0000 7f4fe8a44700 1 -- 172.21.15.81:0/651681153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fe4063e90 con 0x7f4fe4159b40 2023-10-07T08:50:06.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.828+0000 7f4fcb7fe700 1 -- 172.21.15.81:0/651681153 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f4fd80548f0 con 0x7f4fe4159b40 2023-10-07T08:50:06.829 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:50:06.829 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1419112520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1419112520},{"type":"v1","addr":"172.21.15.89:6834","nonce":1419112520}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":6140,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2310402815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2310402815},{"type":"v1","addr":"172.21.15.89:6835","nonce":2310402815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7509,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2709799872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2709799872},{"type":"v1","addr":"172.21.15.81:6836","nonce":2709799872}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:49:58.023106+0000","modified":"2023-10-07T08:50:01.662857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7512":{"gid":7512,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/510483669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":510483669},{"type":"v1","addr":"172.21.15.81:6837","nonce":510483669}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-07T08:50:06.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.829+0000 7f4fe8a44700 1 -- 172.21.15.81:0/651681153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4fd0066f30 msgr2=0x7f4fd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:06.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.829+0000 7f4fe8a44700 1 --2- 172.21.15.81:0/651681153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4fd0066f30 0x7f4fd00693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40b6590 tx=0x7f4fd4009040 comp rx=0 tx=0).stop 2023-10-07T08:50:06.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.829+0000 7f4fe8a44700 1 -- 172.21.15.81:0/651681153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fe4159b40 msgr2=0x7f4fe416b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:06.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.829+0000 7f4fe8a44700 1 --2- 172.21.15.81:0/651681153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fe4159b40 0x7f4fe416b590 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800c580 tx=0x7f4fd8007e10 comp rx=0 tx=0).stop 2023-10-07T08:50:06.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.829+0000 7f4fe8a44700 1 -- 172.21.15.81:0/651681153 shutdown_connections 2023-10-07T08:50:06.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.829+0000 7f4fe8a44700 1 --2- 172.21.15.81:0/651681153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fe4159f10 0x7f4fe40c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.829+0000 7f4fe8a44700 1 --2- 172.21.15.81:0/651681153 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4fd0066f30 0x7f4fd00693e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.829+0000 7f4fe8a44700 1 --2- 172.21.15.81:0/651681153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fe4068e90 0x7f4fe416d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.829+0000 7f4fe8a44700 1 --2- 172.21.15.81:0/651681153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fe4159b40 0x7f4fe416b590 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.829+0000 7f4fe8a44700 1 -- 172.21.15.81:0/651681153 >> 172.21.15.81:0/651681153 conn(0x7f4fe40cd660 msgr2=0x7f4fe406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.830+0000 7f4fe8a44700 1 -- 172.21.15.81:0/651681153 shutdown_connections 2023-10-07T08:50:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:06.830+0000 7f4fe8a44700 1 -- 172.21.15.81:0/651681153 wait complete. 2023-10-07T08:50:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 74 2023-10-07T08:50:06.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-07T08:50:06.976 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":7512,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3201250029999994,"mdsmap_epoch":74,"osdmap_epoch":156,"osdmap_epoch_barrier":156,"uptime":13.448867214} 2023-10-07T08:50:06.976 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 7512, "mdsmap_epoch": 74, "osdmap_epoch": 156, "osdmap_epoch_barrier": 156, "rank_uptime": 8.320125003, "state": "up:active", "uptime": 13.448867214, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:50:06.977 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-07T08:50:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.093+0000 7f21d171f700 1 Processor -- start 2023-10-07T08:50:07.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.093+0000 7f21d171f700 1 -- start start 2023-10-07T08:50:07.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.094+0000 7f21d171f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f21cc1578d0 0x7f21cc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:07.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.094+0000 7f21d171f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21cc157ca0 0x7f21cc15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:07.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.094+0000 7f21d171f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21cc0d07c0 con 0x7f21cc06d120 2023-10-07T08:50:07.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.094+0000 7f21d171f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21cc0cfbb0 con 0x7f21cc1578d0 2023-10-07T08:50:07.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.094+0000 7f21d171f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0cfe90 con 0x7f21cc157ca0 2023-10-07T08:50:07.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.094+0000 7f21caffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f21cc1578d0 0x7f21cc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:07.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.094+0000 7f21caffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f21cc1578d0 0x7f21cc0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53558/0 (socket says 172.21.15.81:53558) 2023-10-07T08:50:07.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.094+0000 7f21caffd700 1 -- 172.21.15.81:0/1138513643 learned_addr learned my addr 172.21.15.81:0/1138513643 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.094+0000 7f21ca7fc700 1 --2- 172.21.15.81:0/1138513643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21cc157ca0 0x7f21cc15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.094+0000 7f21caffd700 1 -- 172.21.15.81:0/1138513643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21cc157ca0 msgr2=0x7f21cc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:50:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.094+0000 7f21caffd700 1 --2- 172.21.15.81:0/1138513643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21cc157ca0 0x7f21cc15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.094+0000 7f21caffd700 1 -- 172.21.15.81:0/1138513643 >> v1:172.21.15.89:6789/0 conn(0x7f21cc06d120 legacy=0x7f21cc15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.094+0000 7f21caffd700 1 -- 172.21.15.81:0/1138513643 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc0d0170 con 0x7f21cc1578d0 2023-10-07T08:50:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.095+0000 7f21caffd700 1 --2- 172.21.15.81:0/1138513643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc1578d0 0x7f21cc0cf4f0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009f20 tx=0x7f21bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5abd70e12fee0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.095+0000 7f21c9ffb700 1 -- 172.21.15.81:0/1138513643 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc00e070 con 0x7f21cc1578d0 2023-10-07T08:50:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.095+0000 7f21c9ffb700 1 -- 172.21.15.81:0/1138513643 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc00b9d0 con 0x7f21cc1578d0 2023-10-07T08:50:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.095+0000 7f21c9ffb700 1 -- 172.21.15.81:0/1138513643 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc0092e0 con 0x7f21cc1578d0 2023-10-07T08:50:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.095+0000 7f21d171f700 1 -- 172.21.15.81:0/1138513643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc1578d0 msgr2=0x7f21cc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.095+0000 7f21d171f700 1 --2- 172.21.15.81:0/1138513643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc1578d0 0x7f21cc0cf4f0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009f20 tx=0x7f21bc009840 comp rx=0 tx=0).stop 2023-10-07T08:50:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.095+0000 7f21d171f700 1 -- 172.21.15.81:0/1138513643 shutdown_connections 2023-10-07T08:50:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.095+0000 7f21d171f700 1 --2- 172.21.15.81:0/1138513643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc1578d0 0x7f21cc0cf4f0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.095+0000 7f21d171f700 1 --2- 172.21.15.81:0/1138513643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21cc157ca0 0x7f21cc15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.095+0000 7f21d171f700 1 -- 172.21.15.81:0/1138513643 >> 172.21.15.81:0/1138513643 conn(0x7f21cc06bb90 msgr2=0x7f21cc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.095+0000 7f21d171f700 1 -- 172.21.15.81:0/1138513643 shutdown_connections 2023-10-07T08:50:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.095+0000 7f21d171f700 1 -- 172.21.15.81:0/1138513643 wait complete. 2023-10-07T08:50:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.096+0000 7f21d171f700 1 Processor -- start 2023-10-07T08:50:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.097+0000 7f21d171f700 1 -- start start 2023-10-07T08:50:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.097+0000 7f21d171f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc06d120 0x7f21cc14aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.097+0000 7f21d171f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21cc1578d0 0x7f21cc153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.097+0000 7f21d171f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21cc157ca0 0x7f21cc15b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.097+0000 7f21d171f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0b4ce0 con 0x7f21cc06d120 2023-10-07T08:50:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.097+0000 7f21d171f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0b4850 con 0x7f21cc1578d0 2023-10-07T08:50:07.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.097+0000 7f21d171f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0b3c40 con 0x7f21cc157ca0 2023-10-07T08:50:07.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.097+0000 7f21caffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc06d120 0x7f21cc14aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:07.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.097+0000 7f21caffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc06d120 0x7f21cc14aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53560/0 (socket says 172.21.15.81:53560) 2023-10-07T08:50:07.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.097+0000 7f21caffd700 1 -- 172.21.15.81:0/1044542098 learned_addr learned my addr 172.21.15.81:0/1044542098 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:50:07.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.098+0000 7f21caffd700 1 -- 172.21.15.81:0/1044542098 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21cc157ca0 msgr2=0x7f21cc15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:07.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.098+0000 7f21caffd700 1 --2- 172.21.15.81:0/1044542098 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21cc157ca0 0x7f21cc15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:07.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.098+0000 7f21caffd700 1 -- 172.21.15.81:0/1044542098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21cc1578d0 msgr2=0x7f21cc153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:07.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.098+0000 7f21caffd700 1 --2- 172.21.15.81:0/1044542098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21cc1578d0 0x7f21cc153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:07.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.098+0000 7f21caffd700 1 -- 172.21.15.81:0/1044542098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc009ae0 con 0x7f21cc06d120 2023-10-07T08:50:07.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.098+0000 7f21caffd700 1 --2- 172.21.15.81:0/1044542098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc06d120 0x7f21cc14aae0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00b610 tx=0x7f21bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:07.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.098+0000 7f21b2ffd700 1 -- 172.21.15.81:0/1044542098 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc008a50 con 0x7f21cc06d120 2023-10-07T08:50:07.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.098+0000 7f21b2ffd700 1 -- 172.21.15.81:0/1044542098 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc008bb0 con 0x7f21cc06d120 2023-10-07T08:50:07.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.098+0000 7f21b2ffd700 1 -- 172.21.15.81:0/1044542098 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc026460 con 0x7f21cc06d120 2023-10-07T08:50:07.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.098+0000 7f21d171f700 1 -- 172.21.15.81:0/1044542098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21cc0b3f20 con 0x7f21cc06d120 2023-10-07T08:50:07.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.098+0000 7f21d171f700 1 -- 172.21.15.81:0/1044542098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21cc0b44e0 con 0x7f21cc06d120 2023-10-07T08:50:07.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.099+0000 7f21d171f700 1 -- 172.21.15.81:0/1044542098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21cc067ac0 con 0x7f21cc06d120 2023-10-07T08:50:07.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.099+0000 7f21b2ffd700 1 -- 172.21.15.81:0/1044542098 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21bc003040 con 0x7f21cc06d120 2023-10-07T08:50:07.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.100+0000 7f21b2ffd700 1 --2- 172.21.15.81:0/1044542098 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f21b8066f30 0x7f21b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:50:07.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.100+0000 7f21b2ffd700 1 -- 172.21.15.81:0/1044542098 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21bc0860d0 con 0x7f21cc06d120 2023-10-07T08:50:07.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.100+0000 7f21ca7fc700 1 --2- 172.21.15.81:0/1044542098 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f21b8066f30 0x7f21b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:50:07.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.100+0000 7f21ca7fc700 1 --2- 172.21.15.81:0/1044542098 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f21b8066f30 0x7f21b80693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f21cc16dbb0 tx=0x7f21c00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:50:07.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.104+0000 7f21b2ffd700 1 -- 172.21.15.81:0/1044542098 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21bc0533f0 con 0x7f21cc06d120 2023-10-07T08:50:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.284+0000 7f21d171f700 1 -- 172.21.15.81:0/1044542098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f21cc0d0450 con 0x7f21cc06d120 2023-10-07T08:50:07.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.505+0000 7f21b2ffd700 1 -- 172.21.15.81:0/1044542098 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v157) v1 ==== 181+0+0 (secure 0 0 0) 0x7f21bc008f30 con 0x7f21cc06d120 2023-10-07T08:50:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.507+0000 7f21d171f700 1 -- 172.21.15.81:0/1044542098 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f21b8066f30 msgr2=0x7f21b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.507+0000 7f21d171f700 1 --2- 172.21.15.81:0/1044542098 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f21b8066f30 0x7f21b80693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f21cc16dbb0 tx=0x7f21c00091a0 comp rx=0 tx=0).stop 2023-10-07T08:50:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.507+0000 7f21d171f700 1 -- 172.21.15.81:0/1044542098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc06d120 msgr2=0x7f21cc14aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:50:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.507+0000 7f21d171f700 1 --2- 172.21.15.81:0/1044542098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc06d120 0x7f21cc14aae0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00b610 tx=0x7f21bc018000 comp rx=0 tx=0).stop 2023-10-07T08:50:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.507+0000 7f21d171f700 1 -- 172.21.15.81:0/1044542098 shutdown_connections 2023-10-07T08:50:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.507+0000 7f21d171f700 1 --2- 172.21.15.81:0/1044542098 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f21b8066f30 0x7f21b80693e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.507+0000 7f21d171f700 1 --2- 172.21.15.81:0/1044542098 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21cc157ca0 0x7f21cc15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.507+0000 7f21d171f700 1 --2- 172.21.15.81:0/1044542098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21cc06d120 0x7f21cc14aae0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.507+0000 7f21d171f700 1 --2- 172.21.15.81:0/1044542098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21cc1578d0 0x7f21cc153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:50:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.507+0000 7f21d171f700 1 -- 172.21.15.81:0/1044542098 >> 172.21.15.81:0/1044542098 conn(0x7f21cc06bb90 msgr2=0x7f21cc06a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:50:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.508+0000 7f21d171f700 1 -- 172.21.15.81:0/1044542098 shutdown_connections 2023-10-07T08:50:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:50:07.508+0000 7f21d171f700 1 -- 172.21.15.81:0/1044542098 wait complete. 2023-10-07T08:50:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-07T08:50:07.521 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-07T08:50:07.652 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_mon_report_interval":"5"} 2023-10-07T08:50:07.652 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-07T08:50:07.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-07T08:50:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:{"mon_tick_interval":"5"} 2023-10-07T08:50:07.775 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-07T08:50:07.775 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-10-07T08:50:07.775 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-07T08:50:07.775 DEBUG:teuthology.orchestra.run.smithi081:> import time 2023-10-07T08:50:07.775 DEBUG:teuthology.orchestra.run.smithi081:> import datetime 2023-10-07T08:50:07.775 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-10-07T08:50:07.775 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-07T08:50:07.775 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:50:07.776 DEBUG:teuthology.orchestra.run.smithi081:> # Write some buffered data through before going full, all should be well 2023-10-07T08:50:07.776 DEBUG:teuthology.orchestra.run.smithi081:> print("writing some data through which we expect to succeed") 2023-10-07T08:50:07.776 DEBUG:teuthology.orchestra.run.smithi081:> bytes = 0 2023-10-07T08:50:07.776 DEBUG:teuthology.orchestra.run.smithi081:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-07T08:50:07.776 DEBUG:teuthology.orchestra.run.smithi081:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-07T08:50:07.776 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-10-07T08:50:07.776 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f) 2023-10-07T08:50:07.776 DEBUG:teuthology.orchestra.run.smithi081:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-07T08:50:07.776 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:50:07.776 DEBUG:teuthology.orchestra.run.smithi081:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-07T08:50:07.776 DEBUG:teuthology.orchestra.run.smithi081:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-07T08:50:07.777 DEBUG:teuthology.orchestra.run.smithi081:> # buffered IO, the error should always only appear from fsync and not 2023-10-07T08:50:07.777 DEBUG:teuthology.orchestra.run.smithi081:> # from write 2023-10-07T08:50:07.777 DEBUG:teuthology.orchestra.run.smithi081:> full = False 2023-10-07T08:50:07.777 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:50:07.777 DEBUG:teuthology.orchestra.run.smithi081:> for n in range(0, int(32 * 0.9)): 2023-10-07T08:50:07.777 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-07T08:50:07.777 DEBUG:teuthology.orchestra.run.smithi081:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-10-07T08:50:07.777 DEBUG:teuthology.orchestra.run.smithi081:> print("done writing {0} bytes".format(bytes)) 2023-10-07T08:50:07.777 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:50:07.777 DEBUG:teuthology.orchestra.run.smithi081:> # OK, now we should sneak in under the full condition 2023-10-07T08:50:07.777 DEBUG:teuthology.orchestra.run.smithi081:> # due to the time it takes the OSDs to report to the 2023-10-07T08:50:07.777 DEBUG:teuthology.orchestra.run.smithi081:> # mons, and get a successful fsync on our full-making data 2023-10-07T08:50:07.778 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f) 2023-10-07T08:50:07.778 DEBUG:teuthology.orchestra.run.smithi081:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-10-07T08:50:07.778 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:50:07.778 DEBUG:teuthology.orchestra.run.smithi081:> # buffered write, add more dirty data to the buffer 2023-10-07T08:50:07.778 DEBUG:teuthology.orchestra.run.smithi081:> print("starting buffered write") 2023-10-07T08:50:07.778 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-07T08:50:07.778 DEBUG:teuthology.orchestra.run.smithi081:> for n in range(0, int(32 * 0.2)): 2023-10-07T08:50:07.778 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-07T08:50:07.778 DEBUG:teuthology.orchestra.run.smithi081:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-07T08:50:07.778 DEBUG:teuthology.orchestra.run.smithi081:> time.sleep(15.0) 2023-10-07T08:50:07.778 DEBUG:teuthology.orchestra.run.smithi081:> except OSError: 2023-10-07T08:50:07.778 DEBUG:teuthology.orchestra.run.smithi081:> pass; 2023-10-07T08:50:07.779 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:50:07.779 DEBUG:teuthology.orchestra.run.smithi081:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-10-07T08:50:07.779 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:50:07.779 DEBUG:teuthology.orchestra.run.smithi081:> # Wait long enough for a background flush that should fail 2023-10-07T08:50:07.779 DEBUG:teuthology.orchestra.run.smithi081:> time.sleep(30) 2023-10-07T08:50:07.779 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:50:07.779 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2023-10-07T08:50:07.779 DEBUG:teuthology.orchestra.run.smithi081:> # ...and check that the failed background flush is reflected in fclose 2023-10-07T08:50:07.780 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-07T08:50:07.780 DEBUG:teuthology.orchestra.run.smithi081:> os.close(f) 2023-10-07T08:50:07.780 DEBUG:teuthology.orchestra.run.smithi081:> except OSError: 2023-10-07T08:50:07.780 DEBUG:teuthology.orchestra.run.smithi081:> print("close() returned an error as expected") 2023-10-07T08:50:07.780 DEBUG:teuthology.orchestra.run.smithi081:> else: 2023-10-07T08:50:07.780 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("close() failed to raise error") 2023-10-07T08:50:07.780 DEBUG:teuthology.orchestra.run.smithi081:> else: 2023-10-07T08:50:07.780 DEBUG:teuthology.orchestra.run.smithi081:> # The kernel cephfs client does not raise errors on fclose 2023-10-07T08:50:07.781 DEBUG:teuthology.orchestra.run.smithi081:> os.close(f) 2023-10-07T08:50:07.781 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:50:07.781 DEBUG:teuthology.orchestra.run.smithi081:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-07T08:50:07.781 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-07T08:50:25.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:50:25.881 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:50:56.015 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:50:56.018 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:51:26.129 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:51:26.132 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:51:56.192 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:51:56.195 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:52:08.673 INFO:teuthology.orchestra.run.smithi081.stdout:writing some data through which we expect to succeed 2023-10-07T08:52:08.674 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-07T08:52:08.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-10-07T08:52:08.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-10-07T08:52:08.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-10-07T08:52:08.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-10-07T08:52:08.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-10-07T08:52:08.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-10-07T08:52:08.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-10-07T08:52:08.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-10-07T08:52:08.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-10-07T08:52:08.674 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-10-07T08:52:08.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-10-07T08:52:08.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-10-07T08:52:08.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-10-07T08:52:08.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-10-07T08:52:08.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-10-07T08:52:08.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-10-07T08:52:08.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-10-07T08:52:08.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-10-07T08:52:08.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-10-07T08:52:08.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-10-07T08:52:08.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-10-07T08:52:08.675 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-10-07T08:52:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-10-07T08:52:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-10-07T08:52:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-10-07T08:52:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-10-07T08:52:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-10-07T08:52:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-10-07T08:52:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:done writing 29884416 bytes 2023-10-07T08:52:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:successfully fsync'ed prior to getting full state reported 2023-10-07T08:52:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:starting buffered write 2023-10-07T08:52:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-07T08:52:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-07T08:52:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-07T08:52:08.676 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-07T08:52:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-07T08:52:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-07T08:52:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-10-07T08:52:08.804 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:52:08.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:52:08.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:52:08.895 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:52:08.895 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T08:52:08.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:52:08.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T08:52:08.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:52:08.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:52:08.937 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T08:52:08.993 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T08:52:08.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:52:08.994 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T08:52:09.039 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:52:09.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:52:09.039 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T08:52:09.056 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:52:09.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.176+0000 7fe0f0822700 1 Processor -- start 2023-10-07T08:52:09.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.176+0000 7fe0f0822700 1 -- start start 2023-10-07T08:52:09.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.177+0000 7fe0f0822700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec069440 0x7fe0ec0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.177+0000 7fe0f0822700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe0ec0c71d0 0x7fe0ec0c7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.177+0000 7fe0f0822700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ec0cb880 con 0x7fe0ec156420 2023-10-07T08:52:09.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.177+0000 7fe0f0822700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ec06aa10 con 0x7fe0ec0c71d0 2023-10-07T08:52:09.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.177+0000 7fe0f0822700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0c7b90 con 0x7fe0ec069440 2023-10-07T08:52:09.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.178+0000 7fe0ead9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe0ec0c71d0 0x7fe0ec0c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:09.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.178+0000 7fe0ead9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe0ec0c71d0 0x7fe0ec0c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:42376/0 (socket says 172.21.15.81:42376) 2023-10-07T08:52:09.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.178+0000 7fe0ea59c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe0ec156420 0x7fe0ec0cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:35324/0 (socket says 172.21.15.81:35324) 2023-10-07T08:52:09.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.178+0000 7fe0e9d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec069440 0x7fe0ec0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:09.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.178+0000 7fe0ead9d700 1 -- 172.21.15.81:0/2926015807 learned_addr learned my addr 172.21.15.81:0/2926015807 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:09.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.178+0000 7fe0ead9d700 1 -- 172.21.15.81:0/2926015807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec069440 msgr2=0x7fe0ec0698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:09.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.178+0000 7fe0ead9d700 1 --2- 172.21.15.81:0/2926015807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec069440 0x7fe0ec0698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.178+0000 7fe0ead9d700 1 -- 172.21.15.81:0/2926015807 >> v1:172.21.15.89:6789/0 conn(0x7fe0ec156420 legacy=0x7fe0ec0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:09.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.178+0000 7fe0ead9d700 1 -- 172.21.15.81:0/2926015807 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec0cac70 con 0x7fe0ec0c71d0 2023-10-07T08:52:09.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.178+0000 7fe0e959a700 1 -- 172.21.15.81:0/2926015807 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620185581 0 0) 0x7fe0ec0cb880 con 0x7fe0ec156420 2023-10-07T08:52:09.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.178+0000 7fe0e9d9b700 1 --2- 172.21.15.81:0/2926015807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec069440 0x7fe0ec0698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:52:09.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.178+0000 7fe0ead9d700 1 --2- 172.21.15.81:0/2926015807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0ec0c71d0 0x7fe0ec0c7650 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40099b0 tx=0x7fe0e4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c995da6d741a8b6b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:09.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.178+0000 7fe0e959a700 1 -- 172.21.15.81:0/2926015807 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4009ea0 con 0x7fe0ec0c71d0 2023-10-07T08:52:09.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.178+0000 7fe0e959a700 1 -- 172.21.15.81:0/2926015807 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e400b860 con 0x7fe0ec0c71d0 2023-10-07T08:52:09.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.178+0000 7fe0e959a700 1 -- 172.21.15.81:0/2926015807 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400bc00 con 0x7fe0ec0c71d0 2023-10-07T08:52:09.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.179+0000 7fe0f0822700 1 -- 172.21.15.81:0/2926015807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0ec0c71d0 msgr2=0x7fe0ec0c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:09.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.179+0000 7fe0f0822700 1 --2- 172.21.15.81:0/2926015807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0ec0c71d0 0x7fe0ec0c7650 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40099b0 tx=0x7fe0e4009250 comp rx=0 tx=0).stop 2023-10-07T08:52:09.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.179+0000 7fe0f0822700 1 -- 172.21.15.81:0/2926015807 shutdown_connections 2023-10-07T08:52:09.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.179+0000 7fe0f0822700 1 --2- 172.21.15.81:0/2926015807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0ec0c71d0 0x7fe0ec0c7650 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.179+0000 7fe0f0822700 1 --2- 172.21.15.81:0/2926015807 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec069440 0x7fe0ec0698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.179+0000 7fe0f0822700 1 -- 172.21.15.81:0/2926015807 >> 172.21.15.81:0/2926015807 conn(0x7fe0ec06c660 msgr2=0x7fe0ec0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:09.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.179+0000 7fe0f0822700 1 -- 172.21.15.81:0/2926015807 shutdown_connections 2023-10-07T08:52:09.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.179+0000 7fe0f0822700 1 -- 172.21.15.81:0/2926015807 wait complete. 2023-10-07T08:52:09.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.180+0000 7fe0f0822700 1 Processor -- start 2023-10-07T08:52:09.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.180+0000 7fe0f0822700 1 -- start start 2023-10-07T08:52:09.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0f0822700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec069440 0x7fe0ec0c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0f0822700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec0c71d0 0x7fe0ec1548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0f0822700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0ec156420 0x7fe0ec154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0f0822700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec141c60 con 0x7fe0ec0c71d0 2023-10-07T08:52:09.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0f0822700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec1410c0 con 0x7fe0ec156420 2023-10-07T08:52:09.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0f0822700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec141330 con 0x7fe0ec069440 2023-10-07T08:52:09.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0ea59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec069440 0x7fe0ec0c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:09.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0e9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec0c71d0 0x7fe0ec1548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:09.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0e9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec0c71d0 0x7fe0ec1548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50624/0 (socket says 172.21.15.81:50624) 2023-10-07T08:52:09.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0ea59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec069440 0x7fe0ec0c4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:49462/0 (socket says 172.21.15.81:49462) 2023-10-07T08:52:09.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0e9d9b700 1 -- 172.21.15.81:0/2985771616 learned_addr learned my addr 172.21.15.81:0/2985771616 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:09.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0ead9d700 1 --2- 172.21.15.81:0/2985771616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0ec156420 0x7fe0ec154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0ea59c700 1 -- 172.21.15.81:0/2985771616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0ec156420 msgr2=0x7fe0ec154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0ea59c700 1 --2- 172.21.15.81:0/2985771616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0ec156420 0x7fe0ec154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0ea59c700 1 -- 172.21.15.81:0/2985771616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec0c71d0 msgr2=0x7fe0ec1548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0ea59c700 1 --2- 172.21.15.81:0/2985771616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec0c71d0 0x7fe0ec1548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0ea59c700 1 -- 172.21.15.81:0/2985771616 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e0009420 con 0x7fe0ec069440 2023-10-07T08:52:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.181+0000 7fe0e9d9b700 1 --2- 172.21.15.81:0/2985771616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec0c71d0 0x7fe0ec1548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:52:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.182+0000 7fe0ea59c700 1 --2- 172.21.15.81:0/2985771616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec069440 0x7fe0ec0c4280 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00cc70 tx=0x7fe0dc001a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.182+0000 7fe0da7fc700 1 -- 172.21.15.81:0/2985771616 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc005df0 con 0x7fe0ec069440 2023-10-07T08:52:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.182+0000 7fe0da7fc700 1 -- 172.21.15.81:0/2985771616 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc00a680 con 0x7fe0ec069440 2023-10-07T08:52:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.182+0000 7fe0f0822700 1 -- 172.21.15.81:0/2985771616 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e40094f0 con 0x7fe0ec069440 2023-10-07T08:52:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.182+0000 7fe0da7fc700 1 -- 172.21.15.81:0/2985771616 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc00aa40 con 0x7fe0ec069440 2023-10-07T08:52:09.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.182+0000 7fe0f0822700 1 -- 172.21.15.81:0/2985771616 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ec1418f0 con 0x7fe0ec069440 2023-10-07T08:52:09.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.183+0000 7fe0f0822700 1 -- 172.21.15.81:0/2985771616 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ec067bc0 con 0x7fe0ec069440 2023-10-07T08:52:09.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.183+0000 7fe0da7fc700 1 -- 172.21.15.81:0/2985771616 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0dc0070f0 con 0x7fe0ec069440 2023-10-07T08:52:09.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.184+0000 7fe0da7fc700 1 --2- 172.21.15.81:0/2985771616 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0cc066f30 0x7fe0cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.184+0000 7fe0da7fc700 1 -- 172.21.15.81:0/2985771616 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fe0dc0846c0 con 0x7fe0ec069440 2023-10-07T08:52:09.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.184+0000 7fe0e9d9b700 1 --2- 172.21.15.81:0/2985771616 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0cc066f30 0x7fe0cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:09.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.184+0000 7fe0da7fc700 1 -- 172.21.15.81:0/2985771616 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7fe0cc06eb10 con 0x7fe0ec069440 2023-10-07T08:52:09.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.184+0000 7fe0e9d9b700 1 --2- 172.21.15.81:0/2985771616 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0cc066f30 0x7fe0cc0693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec16d270 tx=0x7fe0e00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:09.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.188+0000 7fe0da7fc700 1 -- 172.21.15.81:0/2985771616 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0dc051850 con 0x7fe0ec069440 2023-10-07T08:52:09.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.413+0000 7fe0f0822700 1 -- 172.21.15.81:0/2985771616 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0ec141470 con 0x7fe0ec069440 2023-10-07T08:52:09.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.414+0000 7fe0da7fc700 1 -- 172.21.15.81:0/2985771616 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fe0ec141470 con 0x7fe0ec069440 2023-10-07T08:52:09.415 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:09.415 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1419112520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1419112520},{"type":"v1","addr":"172.21.15.89:6834","nonce":1419112520}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":6140,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2310402815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2310402815},{"type":"v1","addr":"172.21.15.89:6835","nonce":2310402815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7509,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2709799872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2709799872},{"type":"v1","addr":"172.21.15.81:6836","nonce":2709799872}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:49:58.023106+0000","modified":"2023-10-07T08:50:01.662857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7512":{"gid":7512,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/510483669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":510483669},{"type":"v1","addr":"172.21.15.81:6837","nonce":510483669}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-07T08:52:09.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.416+0000 7fe0f0822700 1 -- 172.21.15.81:0/2985771616 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0cc066f30 msgr2=0x7fe0cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:09.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.416+0000 7fe0f0822700 1 --2- 172.21.15.81:0/2985771616 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0cc066f30 0x7fe0cc0693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec16d270 tx=0x7fe0e00091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.416+0000 7fe0f0822700 1 -- 172.21.15.81:0/2985771616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec069440 msgr2=0x7fe0ec0c4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:09.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.416+0000 7fe0f0822700 1 --2- 172.21.15.81:0/2985771616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec069440 0x7fe0ec0c4280 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00cc70 tx=0x7fe0dc001a30 comp rx=0 tx=0).stop 2023-10-07T08:52:09.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.416+0000 7fe0f0822700 1 -- 172.21.15.81:0/2985771616 shutdown_connections 2023-10-07T08:52:09.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.416+0000 7fe0f0822700 1 --2- 172.21.15.81:0/2985771616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0ec156420 0x7fe0ec154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.416+0000 7fe0f0822700 1 --2- 172.21.15.81:0/2985771616 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0cc066f30 0x7fe0cc0693e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.416+0000 7fe0f0822700 1 --2- 172.21.15.81:0/2985771616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec069440 0x7fe0ec0c4280 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.416+0000 7fe0f0822700 1 --2- 172.21.15.81:0/2985771616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec0c71d0 0x7fe0ec1548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.416+0000 7fe0f0822700 1 -- 172.21.15.81:0/2985771616 >> 172.21.15.81:0/2985771616 conn(0x7fe0ec06c660 msgr2=0x7fe0ec0c2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:09.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.416+0000 7fe0f0822700 1 -- 172.21.15.81:0/2985771616 shutdown_connections 2023-10-07T08:52:09.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.416+0000 7fe0f0822700 1 -- 172.21.15.81:0/2985771616 wait complete. 2023-10-07T08:52:09.419 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 74 2023-10-07T08:52:09.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:52:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.542+0000 7f54e58b8700 1 Processor -- start 2023-10-07T08:52:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.542+0000 7f54e58b8700 1 -- start start 2023-10-07T08:52:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.543+0000 7f54e58b8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f54e006dd60 0x7f54e00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.543+0000 7f54e58b8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e00b0ca0 con 0x7f54e015a2a0 2023-10-07T08:52:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.543+0000 7f54e58b8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e00b00d0 con 0x7f54e00cf240 2023-10-07T08:52:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.543+0000 7f54e58b8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e006ea90 con 0x7f54e006dd60 2023-10-07T08:52:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.543+0000 7f54df7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f54e006dd60 0x7f54e00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.543+0000 7f54deffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f54e015a2a0 0x7f54e00ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58270/0 (socket says 172.21.15.81:58270) 2023-10-07T08:52:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.543+0000 7f54deffd700 1 -- 172.21.15.81:0/2473752139 learned_addr learned my addr 172.21.15.81:0/2473752139 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.544+0000 7f54df7fe700 1 -- 172.21.15.81:0/2473752139 >> v1:172.21.15.89:6789/0 conn(0x7f54e00cf240 legacy=0x7f54e006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.544+0000 7f54df7fe700 1 -- 172.21.15.81:0/2473752139 >> v1:172.21.15.81:6789/0 conn(0x7f54e015a2a0 legacy=0x7f54e00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.544+0000 7f54de7fc700 1 -- 172.21.15.81:0/2473752139 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184527217 0 0) 0x7f54e00b0ca0 con 0x7f54e015a2a0 2023-10-07T08:52:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.544+0000 7f54df7fe700 1 -- 172.21.15.81:0/2473752139 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e00b0370 con 0x7f54e006dd60 2023-10-07T08:52:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.544+0000 7f54df7fe700 1 --2- 172.21.15.81:0/2473752139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e006dd60 0x7f54e00b1130 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f54d8009e60 tx=0x7f54d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e002a5de1bc1240 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.544+0000 7f54de7fc700 1 -- 172.21.15.81:0/2473752139 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d800e070 con 0x7f54e006dd60 2023-10-07T08:52:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.544+0000 7f54de7fc700 1 -- 172.21.15.81:0/2473752139 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d800bc30 con 0x7f54e006dd60 2023-10-07T08:52:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.544+0000 7f54de7fc700 1 -- 172.21.15.81:0/2473752139 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d8012430 con 0x7f54e006dd60 2023-10-07T08:52:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.544+0000 7f54e58b8700 1 -- 172.21.15.81:0/2473752139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e006dd60 msgr2=0x7f54e00b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.544+0000 7f54e58b8700 1 --2- 172.21.15.81:0/2473752139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e006dd60 0x7f54e00b1130 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f54d8009e60 tx=0x7f54d8009780 comp rx=0 tx=0).stop 2023-10-07T08:52:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.545+0000 7f54e58b8700 1 -- 172.21.15.81:0/2473752139 shutdown_connections 2023-10-07T08:52:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.545+0000 7f54e58b8700 1 --2- 172.21.15.81:0/2473752139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e006dd60 0x7f54e00b1130 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.545+0000 7f54e58b8700 1 -- 172.21.15.81:0/2473752139 >> 172.21.15.81:0/2473752139 conn(0x7f54e0067640 msgr2=0x7f54e0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.545+0000 7f54e58b8700 1 -- 172.21.15.81:0/2473752139 shutdown_connections 2023-10-07T08:52:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.545+0000 7f54e58b8700 1 -- 172.21.15.81:0/2473752139 wait complete. 2023-10-07T08:52:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.546+0000 7f54e58b8700 1 Processor -- start 2023-10-07T08:52:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.546+0000 7f54e58b8700 1 -- start start 2023-10-07T08:52:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54e58b8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54e006dd60 0x7f54e0153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54e58b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e00cf240 0x7f54e00b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54e58b8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54e015a2a0 0x7f54e015e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54e58b8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e00cc460 con 0x7f54e00cf240 2023-10-07T08:52:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54e58b8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e016b140 con 0x7f54e006dd60 2023-10-07T08:52:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54e58b8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e016b420 con 0x7f54e015a2a0 2023-10-07T08:52:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54d67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e00cf240 0x7f54e00b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54d67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e00cf240 0x7f54e00b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50634/0 (socket says 172.21.15.81:50634) 2023-10-07T08:52:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54d67fc700 1 -- 172.21.15.81:0/947626794 learned_addr learned my addr 172.21.15.81:0/947626794 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54deffd700 1 --2- 172.21.15.81:0/947626794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54e006dd60 0x7f54e0153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54d67fc700 1 -- 172.21.15.81:0/947626794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54e015a2a0 msgr2=0x7f54e015e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54d67fc700 1 --2- 172.21.15.81:0/947626794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54e015a2a0 0x7f54e015e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54d67fc700 1 -- 172.21.15.81:0/947626794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54e006dd60 msgr2=0x7f54e0153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54d67fc700 1 --2- 172.21.15.81:0/947626794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54e006dd60 0x7f54e0153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54d67fc700 1 -- 172.21.15.81:0/947626794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d8009a20 con 0x7f54e00cf240 2023-10-07T08:52:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54deffd700 1 --2- 172.21.15.81:0/947626794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54e006dd60 0x7f54e0153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54d67fc700 1 --2- 172.21.15.81:0/947626794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e00cf240 0x7f54e00b1940 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f54c800c790 tx=0x7f54c8007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54d77fe700 1 -- 172.21.15.81:0/947626794 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c8011590 con 0x7f54e00cf240 2023-10-07T08:52:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54d77fe700 1 -- 172.21.15.81:0/947626794 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c80116f0 con 0x7f54e00cf240 2023-10-07T08:52:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54e58b8700 1 -- 172.21.15.81:0/947626794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e015c810 con 0x7f54e00cf240 2023-10-07T08:52:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54d77fe700 1 -- 172.21.15.81:0/947626794 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c8011ab0 con 0x7f54e00cf240 2023-10-07T08:52:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.547+0000 7f54e58b8700 1 -- 172.21.15.81:0/947626794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e015cdd0 con 0x7f54e00cf240 2023-10-07T08:52:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.548+0000 7f54e58b8700 1 -- 172.21.15.81:0/947626794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e0064650 con 0x7f54e00cf240 2023-10-07T08:52:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.549+0000 7f54d77fe700 1 -- 172.21.15.81:0/947626794 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54c801b3b0 con 0x7f54e00cf240 2023-10-07T08:52:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.549+0000 7f54d77fe700 1 --2- 172.21.15.81:0/947626794 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54c0066f30 0x7f54c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.549+0000 7f54d77fe700 1 -- 172.21.15.81:0/947626794 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f54c8083a20 con 0x7f54e00cf240 2023-10-07T08:52:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.549+0000 7f54deffd700 1 --2- 172.21.15.81:0/947626794 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54c0066f30 0x7f54c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.549+0000 7f54d77fe700 1 -- 172.21.15.81:0/947626794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f54c006eb10 con 0x7f54e00cf240 2023-10-07T08:52:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.549+0000 7f54deffd700 1 --2- 172.21.15.81:0/947626794 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54c0066f30 0x7f54c00693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f54d0001810 tx=0x7f54d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.553+0000 7f54d77fe700 1 -- 172.21.15.81:0/947626794 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54c8017070 con 0x7f54e00cf240 2023-10-07T08:52:09.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.742+0000 7f54e58b8700 1 -- 172.21.15.81:0/947626794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54e01542f0 con 0x7f54e00cf240 2023-10-07T08:52:09.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.743+0000 7f54d77fe700 1 -- 172.21.15.81:0/947626794 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+15440 (secure 0 0 0) 0x7f54e0064650 con 0x7f54e00cf240 2023-10-07T08:52:09.745 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:09.745 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":160,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:51:28.310091+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:49:56.356539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-07T08:49:56.981204+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.a","mappings":[{"from":2,"to":0}]},{"pgid":"19.23","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:52:09.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.745+0000 7f54e58b8700 1 -- 172.21.15.81:0/947626794 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54c0066f30 msgr2=0x7f54c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:09.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.745+0000 7f54e58b8700 1 --2- 172.21.15.81:0/947626794 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54c0066f30 0x7f54c00693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f54d0001810 tx=0x7f54d0009040 comp rx=0 tx=0).stop 2023-10-07T08:52:09.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.745+0000 7f54e58b8700 1 -- 172.21.15.81:0/947626794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e00cf240 msgr2=0x7f54e00b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:09.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.745+0000 7f54e58b8700 1 --2- 172.21.15.81:0/947626794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e00cf240 0x7f54e00b1940 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f54c800c790 tx=0x7f54c8007f20 comp rx=0 tx=0).stop 2023-10-07T08:52:09.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.745+0000 7f54e58b8700 1 -- 172.21.15.81:0/947626794 shutdown_connections 2023-10-07T08:52:09.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.745+0000 7f54e58b8700 1 --2- 172.21.15.81:0/947626794 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f54c0066f30 0x7f54c00693e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.745+0000 7f54e58b8700 1 --2- 172.21.15.81:0/947626794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54e015a2a0 0x7f54e015e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.745+0000 7f54e58b8700 1 --2- 172.21.15.81:0/947626794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54e006dd60 0x7f54e0153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.745+0000 7f54e58b8700 1 --2- 172.21.15.81:0/947626794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e00cf240 0x7f54e00b1940 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.745+0000 7f54e58b8700 1 -- 172.21.15.81:0/947626794 >> 172.21.15.81:0/947626794 conn(0x7f54e0067640 msgr2=0x7f54e00ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:09.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.746+0000 7f54e58b8700 1 -- 172.21.15.81:0/947626794 shutdown_connections 2023-10-07T08:52:09.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.746+0000 7f54e58b8700 1 -- 172.21.15.81:0/947626794 wait complete. 2023-10-07T08:52:09.759 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:49:56.356539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:49:56.981204+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:52:09.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:52:09.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.874+0000 7fcb70fc3700 1 Processor -- start 2023-10-07T08:52:09.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.874+0000 7fcb70fc3700 1 -- start start 2023-10-07T08:52:09.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.875+0000 7fcb70fc3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb6c0cf240 0x7fcb6c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.875+0000 7fcb70fc3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb6c06d650 0x7fcb6c06da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.875+0000 7fcb70fc3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6c0b0ca0 con 0x7fcb6c15a2a0 2023-10-07T08:52:09.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.875+0000 7fcb70fc3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6c06ea90 con 0x7fcb6c0cf240 2023-10-07T08:52:09.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.875+0000 7fcb70fc3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6c0b00d0 con 0x7fcb6c06d650 2023-10-07T08:52:09.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.875+0000 7fcb69d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb6c0cf240 0x7fcb6c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:09.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.875+0000 7fcb69d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb6c0cf240 0x7fcb6c0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50646/0 (socket says 172.21.15.81:50646) 2023-10-07T08:52:09.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.875+0000 7fcb69d9b700 1 -- 172.21.15.81:0/673775050 learned_addr learned my addr 172.21.15.81:0/673775050 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:09.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.876+0000 7fcb69d9b700 1 -- 172.21.15.81:0/673775050 >> v2:172.21.15.89:3300/0 conn(0x7fcb6c06d650 msgr2=0x7fcb6c06da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:09.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.876+0000 7fcb69d9b700 1 --2- 172.21.15.81:0/673775050 >> v2:172.21.15.89:3300/0 conn(0x7fcb6c06d650 0x7fcb6c06da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.876+0000 7fcb69d9b700 1 -- 172.21.15.81:0/673775050 >> v1:172.21.15.89:6789/0 conn(0x7fcb6c15a2a0 legacy=0x7fcb6c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:09.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.876+0000 7fcb69d9b700 1 -- 172.21.15.81:0/673775050 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c0b0370 con 0x7fcb6c0cf240 2023-10-07T08:52:09.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.876+0000 7fcb69d9b700 1 --2- 172.21.15.81:0/673775050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c0cf240 0x7fcb6c0b1130 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c06a680 tx=0x7fcb54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238010124b3e82ea server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:09.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.876+0000 7fcb6959a700 1 -- 172.21.15.81:0/673775050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5400b820 con 0x7fcb6c0cf240 2023-10-07T08:52:09.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.876+0000 7fcb6959a700 1 -- 172.21.15.81:0/673775050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5400b980 con 0x7fcb6c0cf240 2023-10-07T08:52:09.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.876+0000 7fcb6959a700 1 -- 172.21.15.81:0/673775050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5400bd20 con 0x7fcb6c0cf240 2023-10-07T08:52:09.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.876+0000 7fcb70fc3700 1 -- 172.21.15.81:0/673775050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c0cf240 msgr2=0x7fcb6c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:09.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.876+0000 7fcb70fc3700 1 --2- 172.21.15.81:0/673775050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c0cf240 0x7fcb6c0b1130 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c06a680 tx=0x7fcb54009250 comp rx=0 tx=0).stop 2023-10-07T08:52:09.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.876+0000 7fcb70fc3700 1 -- 172.21.15.81:0/673775050 shutdown_connections 2023-10-07T08:52:09.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.876+0000 7fcb70fc3700 1 --2- 172.21.15.81:0/673775050 >> v2:172.21.15.89:3300/0 conn(0x7fcb6c06d650 0x7fcb6c06da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.877+0000 7fcb70fc3700 1 --2- 172.21.15.81:0/673775050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c0cf240 0x7fcb6c0b1130 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.877+0000 7fcb70fc3700 1 -- 172.21.15.81:0/673775050 >> 172.21.15.81:0/673775050 conn(0x7fcb6c067640 msgr2=0x7fcb6c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:09.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.877+0000 7fcb70fc3700 1 -- 172.21.15.81:0/673775050 shutdown_connections 2023-10-07T08:52:09.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.877+0000 7fcb70fc3700 1 -- 172.21.15.81:0/673775050 wait complete. 2023-10-07T08:52:09.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.878+0000 7fcb70fc3700 1 Processor -- start 2023-10-07T08:52:09.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.878+0000 7fcb70fc3700 1 -- start start 2023-10-07T08:52:09.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.878+0000 7fcb70fc3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6c06d650 0x7fcb6c154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.878+0000 7fcb70fc3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb6c0cf240 0x7fcb6c0b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.878+0000 7fcb70fc3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c15a2a0 0x7fcb6c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.878+0000 7fcb70fc3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c15cbb0 con 0x7fcb6c15a2a0 2023-10-07T08:52:09.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.878+0000 7fcb70fc3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c15fab0 con 0x7fcb6c06d650 2023-10-07T08:52:09.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.878+0000 7fcb70fc3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c15ce70 con 0x7fcb6c0cf240 2023-10-07T08:52:09.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.878+0000 7fcb6ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c15a2a0 0x7fcb6c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.879+0000 7fcb6ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c15a2a0 0x7fcb6c15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50658/0 (socket says 172.21.15.81:50658) 2023-10-07T08:52:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.879+0000 7fcb6ad9d700 1 -- 172.21.15.81:0/876484272 learned_addr learned my addr 172.21.15.81:0/876484272 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.879+0000 7fcb69d9b700 1 --2- 172.21.15.81:0/876484272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb6c0cf240 0x7fcb6c0b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.879+0000 7fcb6a59c700 1 --2- 172.21.15.81:0/876484272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6c06d650 0x7fcb6c154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.879+0000 7fcb6ad9d700 1 -- 172.21.15.81:0/876484272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb6c0cf240 msgr2=0x7fcb6c0b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.879+0000 7fcb6ad9d700 1 --2- 172.21.15.81:0/876484272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb6c0cf240 0x7fcb6c0b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.879+0000 7fcb6ad9d700 1 -- 172.21.15.81:0/876484272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6c06d650 msgr2=0x7fcb6c154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.879+0000 7fcb6ad9d700 1 --2- 172.21.15.81:0/876484272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6c06d650 0x7fcb6c154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.879+0000 7fcb6ad9d700 1 -- 172.21.15.81:0/876484272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb540094f0 con 0x7fcb6c15a2a0 2023-10-07T08:52:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.879+0000 7fcb6ad9d700 1 --2- 172.21.15.81:0/876484272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c15a2a0 0x7fcb6c15d950 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400b810 tx=0x7fcb640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.879+0000 7fcb627fc700 1 -- 172.21.15.81:0/876484272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6400f510 con 0x7fcb6c15a2a0 2023-10-07T08:52:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.879+0000 7fcb627fc700 1 -- 172.21.15.81:0/876484272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6400f670 con 0x7fcb6c15a2a0 2023-10-07T08:52:09.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.879+0000 7fcb627fc700 1 -- 172.21.15.81:0/876484272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6400fa30 con 0x7fcb6c15a2a0 2023-10-07T08:52:09.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.879+0000 7fcb70fc3700 1 -- 172.21.15.81:0/876484272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6c15d150 con 0x7fcb6c15a2a0 2023-10-07T08:52:09.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.879+0000 7fcb70fc3700 1 -- 172.21.15.81:0/876484272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6c154bc0 con 0x7fcb6c15a2a0 2023-10-07T08:52:09.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.880+0000 7fcb70fc3700 1 -- 172.21.15.81:0/876484272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6c069e40 con 0x7fcb6c15a2a0 2023-10-07T08:52:09.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.880+0000 7fcb627fc700 1 -- 172.21.15.81:0/876484272 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb6401a400 con 0x7fcb6c15a2a0 2023-10-07T08:52:09.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.881+0000 7fcb627fc700 1 --2- 172.21.15.81:0/876484272 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcb4c066f30 0x7fcb4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:09.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.881+0000 7fcb627fc700 1 -- 172.21.15.81:0/876484272 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fcb64084010 con 0x7fcb6c15a2a0 2023-10-07T08:52:09.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.881+0000 7fcb6a59c700 1 --2- 172.21.15.81:0/876484272 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcb4c066f30 0x7fcb4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:09.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.881+0000 7fcb627fc700 1 -- 172.21.15.81:0/876484272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7fcb4c06eb10 con 0x7fcb6c15a2a0 2023-10-07T08:52:09.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.881+0000 7fcb6a59c700 1 --2- 172.21.15.81:0/876484272 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcb4c066f30 0x7fcb4c0693e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c0075c0 tx=0x7fcb5c009780 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:09.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:09.885+0000 7fcb627fc700 1 -- 172.21.15.81:0/876484272 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb640512c0 con 0x7fcb6c15a2a0 2023-10-07T08:52:10.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.068+0000 7fcb70fc3700 1 -- 172.21.15.81:0/876484272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb6c04bb80 con 0x7fcb6c15a2a0 2023-10-07T08:52:10.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.069+0000 7fcb627fc700 1 -- 172.21.15.81:0/876484272 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v160) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb640548e0 con 0x7fcb6c15a2a0 2023-10-07T08:52:10.070 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:52:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.071+0000 7fcb70fc3700 1 -- 172.21.15.81:0/876484272 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcb4c066f30 msgr2=0x7fcb4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.071+0000 7fcb70fc3700 1 --2- 172.21.15.81:0/876484272 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcb4c066f30 0x7fcb4c0693e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c0075c0 tx=0x7fcb5c009780 comp rx=0 tx=0).stop 2023-10-07T08:52:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.071+0000 7fcb70fc3700 1 -- 172.21.15.81:0/876484272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c15a2a0 msgr2=0x7fcb6c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.071+0000 7fcb70fc3700 1 --2- 172.21.15.81:0/876484272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c15a2a0 0x7fcb6c15d950 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400b810 tx=0x7fcb640091d0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.071+0000 7fcb70fc3700 1 -- 172.21.15.81:0/876484272 shutdown_connections 2023-10-07T08:52:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.071+0000 7fcb70fc3700 1 --2- 172.21.15.81:0/876484272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb6c15a2a0 0x7fcb6c15d950 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.071+0000 7fcb70fc3700 1 --2- 172.21.15.81:0/876484272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6c06d650 0x7fcb6c154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.071+0000 7fcb70fc3700 1 --2- 172.21.15.81:0/876484272 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcb4c066f30 0x7fcb4c0693e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.071+0000 7fcb70fc3700 1 --2- 172.21.15.81:0/876484272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb6c0cf240 0x7fcb6c0b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.071+0000 7fcb70fc3700 1 -- 172.21.15.81:0/876484272 >> 172.21.15.81:0/876484272 conn(0x7fcb6c067640 msgr2=0x7fcb6c0ae0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.071+0000 7fcb70fc3700 1 -- 172.21.15.81:0/876484272 shutdown_connections 2023-10-07T08:52:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.071+0000 7fcb70fc3700 1 -- 172.21.15.81:0/876484272 wait complete. 2023-10-07T08:52:10.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:52:10.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.199+0000 7f72549be700 1 Processor -- start 2023-10-07T08:52:10.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.199+0000 7f72549be700 1 -- start start 2023-10-07T08:52:10.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.200+0000 7f72549be700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72500d0b80 0x7f72500cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.200+0000 7f72549be700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f725006d700 0x7f725015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.200+0000 7f72549be700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72500cf2d0 con 0x7f72500d02b0 2023-10-07T08:52:10.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.200+0000 7f72549be700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725015a690 con 0x7f72500d0b80 2023-10-07T08:52:10.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.200+0000 7f72549be700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725006dc00 con 0x7f725006d700 2023-10-07T08:52:10.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.200+0000 7f724f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72500d0b80 0x7f72500cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.200+0000 7f724effd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f72500d02b0 0x7f725006cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58278/0 (socket says 172.21.15.81:58278) 2023-10-07T08:52:10.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.200+0000 7f724effd700 1 -- 172.21.15.81:0/2946951870 learned_addr learned my addr 172.21.15.81:0/2946951870 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:10.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.200+0000 7f724ffff700 1 --2- 172.21.15.81:0/2946951870 >> v2:172.21.15.89:3300/0 conn(0x7f725006d700 0x7f725015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.200+0000 7f724f7fe700 1 -- 172.21.15.81:0/2946951870 >> v2:172.21.15.89:3300/0 conn(0x7f725006d700 msgr2=0x7f725015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.200+0000 7f724f7fe700 1 --2- 172.21.15.81:0/2946951870 >> v2:172.21.15.89:3300/0 conn(0x7f725006d700 0x7f725015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.200+0000 7f724f7fe700 1 -- 172.21.15.81:0/2946951870 >> v1:172.21.15.81:6789/0 conn(0x7f72500d02b0 legacy=0x7f725006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.200+0000 7f724f7fe700 1 -- 172.21.15.81:0/2946951870 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72500cf570 con 0x7f72500d0b80 2023-10-07T08:52:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.200+0000 7f724e7fc700 1 -- 172.21.15.81:0/2946951870 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169259159 0 0) 0x7f72500cf2d0 con 0x7f72500d02b0 2023-10-07T08:52:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.200+0000 7f724ffff700 1 --2- 172.21.15.81:0/2946951870 >> v2:172.21.15.89:3300/0 conn(0x7f725006d700 0x7f725015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.200+0000 7f724f7fe700 1 --2- 172.21.15.81:0/2946951870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72500d0b80 0x7f72500cfd70 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f7240009e60 tx=0x7f7240009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afdb647819e9ab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.201+0000 7f724e7fc700 1 -- 172.21.15.81:0/2946951870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724000e070 con 0x7f72500d0b80 2023-10-07T08:52:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.201+0000 7f724e7fc700 1 -- 172.21.15.81:0/2946951870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724000bbf0 con 0x7f72500d0b80 2023-10-07T08:52:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.201+0000 7f724e7fc700 1 -- 172.21.15.81:0/2946951870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7240012430 con 0x7f72500d0b80 2023-10-07T08:52:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.201+0000 7f72549be700 1 -- 172.21.15.81:0/2946951870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72500d0b80 msgr2=0x7f72500cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.201+0000 7f72549be700 1 --2- 172.21.15.81:0/2946951870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72500d0b80 0x7f72500cfd70 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f7240009e60 tx=0x7f7240009780 comp rx=0 tx=0).stop 2023-10-07T08:52:10.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.201+0000 7f72549be700 1 -- 172.21.15.81:0/2946951870 shutdown_connections 2023-10-07T08:52:10.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.201+0000 7f72549be700 1 --2- 172.21.15.81:0/2946951870 >> v2:172.21.15.89:3300/0 conn(0x7f725006d700 0x7f725015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.201+0000 7f72549be700 1 --2- 172.21.15.81:0/2946951870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72500d0b80 0x7f72500cfd70 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.201+0000 7f72549be700 1 -- 172.21.15.81:0/2946951870 >> 172.21.15.81:0/2946951870 conn(0x7f7250063230 msgr2=0x7f7250063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:10.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.201+0000 7f72549be700 1 -- 172.21.15.81:0/2946951870 shutdown_connections 2023-10-07T08:52:10.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.201+0000 7f72549be700 1 -- 172.21.15.81:0/2946951870 wait complete. 2023-10-07T08:52:10.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.202+0000 7f72549be700 1 Processor -- start 2023-10-07T08:52:10.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.202+0000 7f72549be700 1 -- start start 2023-10-07T08:52:10.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.203+0000 7f72549be700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725006d700 0x7f72501556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.203+0000 7f72549be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72500d02b0 0x7f725016a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.203+0000 7f72549be700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72500d0b80 0x7f72500b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.203+0000 7f72549be700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72500b4ac0 con 0x7f725006d700 2023-10-07T08:52:10.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.203+0000 7f72549be700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7250155c30 con 0x7f72500d0b80 2023-10-07T08:52:10.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.203+0000 7f72549be700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72500b3eb0 con 0x7f72500d02b0 2023-10-07T08:52:10.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.203+0000 7f724f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725006d700 0x7f72501556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.203+0000 7f724f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725006d700 0x7f72501556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50680/0 (socket says 172.21.15.81:50680) 2023-10-07T08:52:10.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.203+0000 7f724f7fe700 1 -- 172.21.15.81:0/4156172032 learned_addr learned my addr 172.21.15.81:0/4156172032 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.203+0000 7f724effd700 1 --2- 172.21.15.81:0/4156172032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72500d02b0 0x7f725016a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.203+0000 7f724ffff700 1 --2- 172.21.15.81:0/4156172032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72500d0b80 0x7f72500b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.203+0000 7f724f7fe700 1 -- 172.21.15.81:0/4156172032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72500d02b0 msgr2=0x7f725016a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.203+0000 7f724f7fe700 1 --2- 172.21.15.81:0/4156172032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72500d02b0 0x7f725016a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.203+0000 7f724f7fe700 1 -- 172.21.15.81:0/4156172032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72500d0b80 msgr2=0x7f72500b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.203+0000 7f724f7fe700 1 --2- 172.21.15.81:0/4156172032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72500d0b80 0x7f72500b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.203+0000 7f724f7fe700 1 -- 172.21.15.81:0/4156172032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7240009a20 con 0x7f725006d700 2023-10-07T08:52:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.204+0000 7f724effd700 1 --2- 172.21.15.81:0/4156172032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72500d02b0 0x7f725016a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.204+0000 7f724f7fe700 1 --2- 172.21.15.81:0/4156172032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725006d700 0x7f72501556f0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f725006fcc0 tx=0x7f7240019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.204+0000 7f72377fe700 1 -- 172.21.15.81:0/4156172032 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7240027470 con 0x7f725006d700 2023-10-07T08:52:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.204+0000 7f72377fe700 1 -- 172.21.15.81:0/4156172032 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72400275d0 con 0x7f725006d700 2023-10-07T08:52:10.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.204+0000 7f72549be700 1 -- 172.21.15.81:0/4156172032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72500b4190 con 0x7f725006d700 2023-10-07T08:52:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.204+0000 7f72377fe700 1 -- 172.21.15.81:0/4156172032 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7240027990 con 0x7f725006d700 2023-10-07T08:52:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.204+0000 7f72549be700 1 -- 172.21.15.81:0/4156172032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72500b4750 con 0x7f725006d700 2023-10-07T08:52:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.205+0000 7f72549be700 1 -- 172.21.15.81:0/4156172032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72500b4da0 con 0x7f725006d700 2023-10-07T08:52:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.205+0000 7f72377fe700 1 -- 172.21.15.81:0/4156172032 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7240024070 con 0x7f725006d700 2023-10-07T08:52:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.206+0000 7f72377fe700 1 --2- 172.21.15.81:0/4156172032 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f723c066f30 0x7f723c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.206+0000 7f72377fe700 1 -- 172.21.15.81:0/4156172032 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7240086b40 con 0x7f725006d700 2023-10-07T08:52:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.206+0000 7f724effd700 1 --2- 172.21.15.81:0/4156172032 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f723c066f30 0x7f723c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.206+0000 7f72377fe700 1 -- 172.21.15.81:0/4156172032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f723c06eb10 con 0x7f725006d700 2023-10-07T08:52:10.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.206+0000 7f724effd700 1 --2- 172.21.15.81:0/4156172032 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f723c066f30 0x7f723c0693e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7250069770 tx=0x7f7244009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:10.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.210+0000 7f72377fe700 1 -- 172.21.15.81:0/4156172032 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7240053d70 con 0x7f725006d700 2023-10-07T08:52:10.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.389+0000 7f72549be700 1 -- 172.21.15.81:0/4156172032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f72500676e0 con 0x7f725006d700 2023-10-07T08:52:10.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.390+0000 7f72377fe700 1 -- 172.21.15.81:0/4156172032 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v160) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7240057390 con 0x7f725006d700 2023-10-07T08:52:10.391 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:52:10.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.392+0000 7f72549be700 1 -- 172.21.15.81:0/4156172032 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f723c066f30 msgr2=0x7f723c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.392+0000 7f72549be700 1 --2- 172.21.15.81:0/4156172032 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f723c066f30 0x7f723c0693e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7250069770 tx=0x7f7244009040 comp rx=0 tx=0).stop 2023-10-07T08:52:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.392+0000 7f72549be700 1 -- 172.21.15.81:0/4156172032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725006d700 msgr2=0x7f72501556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.392+0000 7f72549be700 1 --2- 172.21.15.81:0/4156172032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725006d700 0x7f72501556f0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f725006fcc0 tx=0x7f7240019000 comp rx=0 tx=0).stop 2023-10-07T08:52:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.392+0000 7f72549be700 1 -- 172.21.15.81:0/4156172032 shutdown_connections 2023-10-07T08:52:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.392+0000 7f72549be700 1 --2- 172.21.15.81:0/4156172032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72500d0b80 0x7f72500b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.392+0000 7f72549be700 1 --2- 172.21.15.81:0/4156172032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725006d700 0x7f72501556f0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.392+0000 7f72549be700 1 --2- 172.21.15.81:0/4156172032 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f723c066f30 0x7f723c0693e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.392+0000 7f72549be700 1 --2- 172.21.15.81:0/4156172032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72500d02b0 0x7f725016a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.392+0000 7f72549be700 1 -- 172.21.15.81:0/4156172032 >> 172.21.15.81:0/4156172032 conn(0x7f7250063230 msgr2=0x7f725015b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.392+0000 7f72549be700 1 -- 172.21.15.81:0/4156172032 shutdown_connections 2023-10-07T08:52:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.392+0000 7f72549be700 1 -- 172.21.15.81:0/4156172032 wait complete. 2023-10-07T08:52:10.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:52:10.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.523+0000 7f49f8405700 1 Processor -- start 2023-10-07T08:52:10.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.523+0000 7f49f8405700 1 -- start start 2023-10-07T08:52:10.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.524+0000 7f49f8405700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49f00cf240 0x7f49f00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.524+0000 7f49f8405700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f49f006d650 0x7f49f006da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.524+0000 7f49f8405700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f00b0ca0 con 0x7f49f015a2a0 2023-10-07T08:52:10.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.524+0000 7f49f8405700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f006ea90 con 0x7f49f006d650 2023-10-07T08:52:10.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.524+0000 7f49f8405700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f00b00d0 con 0x7f49f00cf240 2023-10-07T08:52:10.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.524+0000 7f49f69a2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f49f006d650 0x7f49f006da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.524+0000 7f49f61a1700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f49f015a2a0 0x7f49f00ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58292/0 (socket says 172.21.15.81:58292) 2023-10-07T08:52:10.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.524+0000 7f49f61a1700 1 -- 172.21.15.81:0/607334707 learned_addr learned my addr 172.21.15.81:0/607334707 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:10.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.525+0000 7f49f59a0700 1 --2- 172.21.15.81:0/607334707 >> v2:172.21.15.89:3300/0 conn(0x7f49f00cf240 0x7f49f00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.525+0000 7f49f69a2700 1 -- 172.21.15.81:0/607334707 >> v2:172.21.15.89:3300/0 conn(0x7f49f00cf240 msgr2=0x7f49f00b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:10.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.525+0000 7f49f69a2700 1 --2- 172.21.15.81:0/607334707 >> v2:172.21.15.89:3300/0 conn(0x7f49f00cf240 0x7f49f00b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.525+0000 7f49f69a2700 1 -- 172.21.15.81:0/607334707 >> v1:172.21.15.81:6789/0 conn(0x7f49f015a2a0 legacy=0x7f49f00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.525+0000 7f49f69a2700 1 -- 172.21.15.81:0/607334707 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f00b0370 con 0x7f49f006d650 2023-10-07T08:52:10.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.525+0000 7f49f519f700 1 -- 172.21.15.81:0/607334707 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983659170 0 0) 0x7f49f00b0ca0 con 0x7f49f015a2a0 2023-10-07T08:52:10.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.525+0000 7f49f69a2700 1 --2- 172.21.15.81:0/607334707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f006d650 0x7f49f006da20 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f49f00713b0 tx=0x7f49e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d1880bbb30e88f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:10.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.525+0000 7f49f519f700 1 -- 172.21.15.81:0/607334707 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800e070 con 0x7f49f006d650 2023-10-07T08:52:10.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.525+0000 7f49f519f700 1 -- 172.21.15.81:0/607334707 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e800bc30 con 0x7f49f006d650 2023-10-07T08:52:10.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.525+0000 7f49f519f700 1 -- 172.21.15.81:0/607334707 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8012430 con 0x7f49f006d650 2023-10-07T08:52:10.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.525+0000 7f49f8405700 1 -- 172.21.15.81:0/607334707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f006d650 msgr2=0x7f49f006da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.525+0000 7f49f8405700 1 --2- 172.21.15.81:0/607334707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f006d650 0x7f49f006da20 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f49f00713b0 tx=0x7f49e8009780 comp rx=0 tx=0).stop 2023-10-07T08:52:10.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.526+0000 7f49f8405700 1 -- 172.21.15.81:0/607334707 shutdown_connections 2023-10-07T08:52:10.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.526+0000 7f49f8405700 1 --2- 172.21.15.81:0/607334707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f006d650 0x7f49f006da20 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.526+0000 7f49f8405700 1 --2- 172.21.15.81:0/607334707 >> v2:172.21.15.89:3300/0 conn(0x7f49f00cf240 0x7f49f00b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.526+0000 7f49f8405700 1 -- 172.21.15.81:0/607334707 >> 172.21.15.81:0/607334707 conn(0x7f49f0067640 msgr2=0x7f49f0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:10.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.526+0000 7f49f8405700 1 -- 172.21.15.81:0/607334707 shutdown_connections 2023-10-07T08:52:10.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.526+0000 7f49f8405700 1 -- 172.21.15.81:0/607334707 wait complete. 2023-10-07T08:52:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.527+0000 7f49f8405700 1 Processor -- start 2023-10-07T08:52:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.527+0000 7f49f8405700 1 -- start start 2023-10-07T08:52:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.527+0000 7f49f8405700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49f006d650 0x7f49f016b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.527+0000 7f49f8405700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49f00cf240 0x7f49f016d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.527+0000 7f49f8405700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f015a2a0 0x7f49f00cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.527+0000 7f49f8405700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f016c050 con 0x7f49f015a2a0 2023-10-07T08:52:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.527+0000 7f49f8405700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f016c330 con 0x7f49f00cf240 2023-10-07T08:52:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.527+0000 7f49f8405700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f016c610 con 0x7f49f006d650 2023-10-07T08:52:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.527+0000 7f49f69a2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f015a2a0 0x7f49f00cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.527+0000 7f49f69a2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f015a2a0 0x7f49f00cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50700/0 (socket says 172.21.15.81:50700) 2023-10-07T08:52:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.528+0000 7f49f69a2700 1 -- 172.21.15.81:0/3117610381 learned_addr learned my addr 172.21.15.81:0/3117610381 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.528+0000 7f49f59a0700 1 --2- 172.21.15.81:0/3117610381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49f00cf240 0x7f49f016d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.528+0000 7f49f61a1700 1 --2- 172.21.15.81:0/3117610381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49f006d650 0x7f49f016b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.528+0000 7f49f69a2700 1 -- 172.21.15.81:0/3117610381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49f006d650 msgr2=0x7f49f016b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.528+0000 7f49f69a2700 1 --2- 172.21.15.81:0/3117610381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49f006d650 0x7f49f016b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.528+0000 7f49f69a2700 1 -- 172.21.15.81:0/3117610381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49f00cf240 msgr2=0x7f49f016d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.528+0000 7f49f69a2700 1 --2- 172.21.15.81:0/3117610381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49f00cf240 0x7f49f016d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.528+0000 7f49f69a2700 1 -- 172.21.15.81:0/3117610381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8009a20 con 0x7f49f015a2a0 2023-10-07T08:52:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.528+0000 7f49f61a1700 1 --2- 172.21.15.81:0/3117610381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49f006d650 0x7f49f016b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.528+0000 7f49f69a2700 1 --2- 172.21.15.81:0/3117610381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f015a2a0 0x7f49f00cbdd0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f49e8013000 tx=0x7f49e8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.528+0000 7f49e67fc700 1 -- 172.21.15.81:0/3117610381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8012ea0 con 0x7f49f015a2a0 2023-10-07T08:52:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.528+0000 7f49e67fc700 1 -- 172.21.15.81:0/3117610381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e801d630 con 0x7f49f015a2a0 2023-10-07T08:52:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.528+0000 7f49f8405700 1 -- 172.21.15.81:0/3117610381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f016c8f0 con 0x7f49f015a2a0 2023-10-07T08:52:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.528+0000 7f49e67fc700 1 -- 172.21.15.81:0/3117610381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e801d9f0 con 0x7f49f015a2a0 2023-10-07T08:52:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.528+0000 7f49f8405700 1 -- 172.21.15.81:0/3117610381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f016bc90 con 0x7f49f015a2a0 2023-10-07T08:52:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.529+0000 7f49f8405700 1 -- 172.21.15.81:0/3117610381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f016ce10 con 0x7f49f015a2a0 2023-10-07T08:52:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.529+0000 7f49e67fc700 1 -- 172.21.15.81:0/3117610381 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49e8024070 con 0x7f49f015a2a0 2023-10-07T08:52:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.530+0000 7f49e67fc700 1 --2- 172.21.15.81:0/3117610381 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f49d4066f30 0x7f49d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.530+0000 7f49e67fc700 1 -- 172.21.15.81:0/3117610381 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f49e8086e10 con 0x7f49f015a2a0 2023-10-07T08:52:10.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.530+0000 7f49f61a1700 1 --2- 172.21.15.81:0/3117610381 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f49d4066f30 0x7f49d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.530+0000 7f49e67fc700 1 -- 172.21.15.81:0/3117610381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f49d406eb10 con 0x7f49f015a2a0 2023-10-07T08:52:10.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.530+0000 7f49f61a1700 1 --2- 172.21.15.81:0/3117610381 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f49d4066f30 0x7f49d40693e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f49ec001810 tx=0x7f49ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:10.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.534+0000 7f49e67fc700 1 -- 172.21.15.81:0/3117610381 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49f016ce10 con 0x7f49f015a2a0 2023-10-07T08:52:10.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.716+0000 7f49f8405700 1 -- 172.21.15.81:0/3117610381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49f016ce10 con 0x7f49f015a2a0 2023-10-07T08:52:10.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.716+0000 7f49e67fc700 1 -- 172.21.15.81:0/3117610381 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v160) v1 ==== 100+0+11 (secure 0 0 0) 0x7f49f016ce10 con 0x7f49f015a2a0 2023-10-07T08:52:10.718 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:52:10.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.718+0000 7f49f8405700 1 -- 172.21.15.81:0/3117610381 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f49d4066f30 msgr2=0x7f49d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.718+0000 7f49f8405700 1 --2- 172.21.15.81:0/3117610381 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f49d4066f30 0x7f49d40693e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f49ec001810 tx=0x7f49ec009040 comp rx=0 tx=0).stop 2023-10-07T08:52:10.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.718+0000 7f49f8405700 1 -- 172.21.15.81:0/3117610381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f015a2a0 msgr2=0x7f49f00cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.718+0000 7f49f8405700 1 --2- 172.21.15.81:0/3117610381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f015a2a0 0x7f49f00cbdd0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f49e8013000 tx=0x7f49e8019000 comp rx=0 tx=0).stop 2023-10-07T08:52:10.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.718+0000 7f49f8405700 1 -- 172.21.15.81:0/3117610381 shutdown_connections 2023-10-07T08:52:10.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.718+0000 7f49f8405700 1 --2- 172.21.15.81:0/3117610381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f015a2a0 0x7f49f00cbdd0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.718+0000 7f49f8405700 1 --2- 172.21.15.81:0/3117610381 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f49d4066f30 0x7f49d40693e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.718+0000 7f49f8405700 1 --2- 172.21.15.81:0/3117610381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49f006d650 0x7f49f016b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.718+0000 7f49f8405700 1 --2- 172.21.15.81:0/3117610381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49f00cf240 0x7f49f016d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.718+0000 7f49f8405700 1 -- 172.21.15.81:0/3117610381 >> 172.21.15.81:0/3117610381 conn(0x7f49f0067640 msgr2=0x7f49f00ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:10.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.718+0000 7f49f8405700 1 -- 172.21.15.81:0/3117610381 shutdown_connections 2023-10-07T08:52:10.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.718+0000 7f49f8405700 1 -- 172.21.15.81:0/3117610381 wait complete. 2023-10-07T08:52:10.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:52:10.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.843+0000 7fe1f02a8700 1 Processor -- start 2023-10-07T08:52:10.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.843+0000 7fe1f02a8700 1 -- start start 2023-10-07T08:52:10.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.844+0000 7fe1f02a8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e81578d0 0x7fe1e80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.844+0000 7fe1f02a8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe1e806d120 0x7fe1e806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.844+0000 7fe1f02a8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e806dac0 con 0x7fe1e8157ca0 2023-10-07T08:52:10.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.844+0000 7fe1f02a8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e80d07c0 con 0x7fe1e806d120 2023-10-07T08:52:10.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.844+0000 7fe1f02a8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80cfbb0 con 0x7fe1e81578d0 2023-10-07T08:52:10.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.844+0000 7fe1ed843700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe1e8157ca0 0x7fe1e815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58304/0 (socket says 172.21.15.81:58304) 2023-10-07T08:52:10.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.844+0000 7fe1ed843700 1 -- 172.21.15.81:0/585226673 learned_addr learned my addr 172.21.15.81:0/585226673 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:10.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.844+0000 7fe1ee845700 1 --2- 172.21.15.81:0/585226673 >> v2:172.21.15.89:3300/0 conn(0x7fe1e806d120 0x7fe1e806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.844+0000 7fe1ee044700 1 --2- 172.21.15.81:0/585226673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e81578d0 0x7fe1e80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.845+0000 7fe1ed042700 1 -- 172.21.15.81:0/585226673 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577357767 0 0) 0x7fe1d8001110 con 0x7fe1e8157ca0 2023-10-07T08:52:10.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.845+0000 7fe1ed042700 1 -- 172.21.15.81:0/585226673 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d4003570 con 0x7fe1e8157ca0 2023-10-07T08:52:10.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.845+0000 7fe1ee044700 1 -- 172.21.15.81:0/585226673 >> v2:172.21.15.89:3300/0 conn(0x7fe1e806d120 msgr2=0x7fe1e806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:10.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.845+0000 7fe1ee044700 1 --2- 172.21.15.81:0/585226673 >> v2:172.21.15.89:3300/0 conn(0x7fe1e806d120 0x7fe1e806d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.845+0000 7fe1ee044700 1 -- 172.21.15.81:0/585226673 >> v1:172.21.15.81:6789/0 conn(0x7fe1e8157ca0 legacy=0x7fe1e815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.845+0000 7fe1ee044700 1 -- 172.21.15.81:0/585226673 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e80cfe90 con 0x7fe1e81578d0 2023-10-07T08:52:10.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.845+0000 7fe1ee845700 1 --2- 172.21.15.81:0/585226673 >> v2:172.21.15.89:3300/0 conn(0x7fe1e806d120 0x7fe1e806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:52:10.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.845+0000 7fe1ee044700 1 --2- 172.21.15.81:0/585226673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e81578d0 0x7fe1e80cf4f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40098e0 tx=0x7fe1e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=101cf15477dc521b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:10.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.845+0000 7fe1ed042700 1 -- 172.21.15.81:0/585226673 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4011630 con 0x7fe1e81578d0 2023-10-07T08:52:10.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.845+0000 7fe1ed042700 1 -- 172.21.15.81:0/585226673 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e4011790 con 0x7fe1e81578d0 2023-10-07T08:52:10.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.845+0000 7fe1ed042700 1 -- 172.21.15.81:0/585226673 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4011b10 con 0x7fe1e81578d0 2023-10-07T08:52:10.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.846+0000 7fe1f02a8700 1 -- 172.21.15.81:0/585226673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e81578d0 msgr2=0x7fe1e80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.846+0000 7fe1f02a8700 1 --2- 172.21.15.81:0/585226673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e81578d0 0x7fe1e80cf4f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40098e0 tx=0x7fe1e40091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.846+0000 7fe1f02a8700 1 -- 172.21.15.81:0/585226673 shutdown_connections 2023-10-07T08:52:10.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.846+0000 7fe1f02a8700 1 --2- 172.21.15.81:0/585226673 >> v2:172.21.15.89:3300/0 conn(0x7fe1e806d120 0x7fe1e806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.846+0000 7fe1f02a8700 1 --2- 172.21.15.81:0/585226673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e81578d0 0x7fe1e80cf4f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.846+0000 7fe1f02a8700 1 -- 172.21.15.81:0/585226673 >> 172.21.15.81:0/585226673 conn(0x7fe1e806bb90 msgr2=0x7fe1e806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:10.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.846+0000 7fe1f02a8700 1 -- 172.21.15.81:0/585226673 shutdown_connections 2023-10-07T08:52:10.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.846+0000 7fe1f02a8700 1 -- 172.21.15.81:0/585226673 wait complete. 2023-10-07T08:52:10.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.847+0000 7fe1f02a8700 1 Processor -- start 2023-10-07T08:52:10.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.847+0000 7fe1f02a8700 1 -- start start 2023-10-07T08:52:10.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1f02a8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e806d120 0x7fe1e8155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1f02a8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e81578d0 0x7fe1e80afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1f02a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8157ca0 0x7fe1e80ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1f02a8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80abda0 con 0x7fe1e8157ca0 2023-10-07T08:52:10.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1f02a8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80ab190 con 0x7fe1e81578d0 2023-10-07T08:52:10.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1f02a8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80ab470 con 0x7fe1e806d120 2023-10-07T08:52:10.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1ee845700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8157ca0 0x7fe1e80ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1ee845700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8157ca0 0x7fe1e80ac230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50706/0 (socket says 172.21.15.81:50706) 2023-10-07T08:52:10.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1ee845700 1 -- 172.21.15.81:0/2643161191 learned_addr learned my addr 172.21.15.81:0/2643161191 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:10.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1ee044700 1 --2- 172.21.15.81:0/2643161191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e806d120 0x7fe1e8155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1ed843700 1 --2- 172.21.15.81:0/2643161191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e81578d0 0x7fe1e80afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1ee845700 1 -- 172.21.15.81:0/2643161191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e806d120 msgr2=0x7fe1e8155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1ee845700 1 --2- 172.21.15.81:0/2643161191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e806d120 0x7fe1e8155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1ee845700 1 -- 172.21.15.81:0/2643161191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e81578d0 msgr2=0x7fe1e80afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1ee845700 1 --2- 172.21.15.81:0/2643161191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e81578d0 0x7fe1e80afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1ee845700 1 -- 172.21.15.81:0/2643161191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e0009a20 con 0x7fe1e8157ca0 2023-10-07T08:52:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1ed843700 1 --2- 172.21.15.81:0/2643161191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e81578d0 0x7fe1e80afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1ee845700 1 --2- 172.21.15.81:0/2643161191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8157ca0 0x7fe1e80ac230 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009fc0 tx=0x7fe1e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1de7fc700 1 -- 172.21.15.81:0/2643161191 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000cc80 con 0x7fe1e8157ca0 2023-10-07T08:52:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1de7fc700 1 -- 172.21.15.81:0/2643161191 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e000f040 con 0x7fe1e8157ca0 2023-10-07T08:52:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1f02a8700 1 -- 172.21.15.81:0/2643161191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e4009420 con 0x7fe1e8157ca0 2023-10-07T08:52:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1de7fc700 1 -- 172.21.15.81:0/2643161191 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0014480 con 0x7fe1e8157ca0 2023-10-07T08:52:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.848+0000 7fe1f02a8700 1 -- 172.21.15.81:0/2643161191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e80aba30 con 0x7fe1e8157ca0 2023-10-07T08:52:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.849+0000 7fe1f02a8700 1 -- 172.21.15.81:0/2643161191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e8067ac0 con 0x7fe1e8157ca0 2023-10-07T08:52:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.850+0000 7fe1de7fc700 1 -- 172.21.15.81:0/2643161191 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1e0003020 con 0x7fe1e8157ca0 2023-10-07T08:52:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.850+0000 7fe1de7fc700 1 --2- 172.21.15.81:0/2643161191 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe1cc066f30 0x7fe1cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.850+0000 7fe1de7fc700 1 -- 172.21.15.81:0/2643161191 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fe1e0084fe0 con 0x7fe1e8157ca0 2023-10-07T08:52:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.850+0000 7fe1ee044700 1 --2- 172.21.15.81:0/2643161191 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe1cc066f30 0x7fe1cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.850+0000 7fe1de7fc700 1 -- 172.21.15.81:0/2643161191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7fe1cc06eb10 con 0x7fe1e8157ca0 2023-10-07T08:52:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.850+0000 7fe1ee044700 1 --2- 172.21.15.81:0/2643161191 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe1cc066f30 0x7fe1cc0693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40091e0 tx=0x7fe1e4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:10.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:10.854+0000 7fe1de7fc700 1 -- 172.21.15.81:0/2643161191 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1e0059e60 con 0x7fe1e8157ca0 2023-10-07T08:52:11.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.078+0000 7fe1f02a8700 1 -- 172.21.15.81:0/2643161191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1e80d0170 con 0x7fe1e8157ca0 2023-10-07T08:52:11.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.078+0000 7fe1de7fc700 1 -- 172.21.15.81:0/2643161191 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fe1e0018020 con 0x7fe1e8157ca0 2023-10-07T08:52:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:11.080 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1419112520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1419112520},{"type":"v1","addr":"172.21.15.89:6834","nonce":1419112520}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":6140,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2310402815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2310402815},{"type":"v1","addr":"172.21.15.89:6835","nonce":2310402815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7509,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2709799872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2709799872},{"type":"v1","addr":"172.21.15.81:6836","nonce":2709799872}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:49:58.023106+0000","modified":"2023-10-07T08:50:01.662857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7512":{"gid":7512,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/510483669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":510483669},{"type":"v1","addr":"172.21.15.81:6837","nonce":510483669}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-07T08:52:11.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.080+0000 7fe1f02a8700 1 -- 172.21.15.81:0/2643161191 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe1cc066f30 msgr2=0x7fe1cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.080+0000 7fe1f02a8700 1 --2- 172.21.15.81:0/2643161191 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe1cc066f30 0x7fe1cc0693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40091e0 tx=0x7fe1e4017000 comp rx=0 tx=0).stop 2023-10-07T08:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.080+0000 7fe1f02a8700 1 -- 172.21.15.81:0/2643161191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8157ca0 msgr2=0x7fe1e80ac230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.080+0000 7fe1f02a8700 1 --2- 172.21.15.81:0/2643161191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8157ca0 0x7fe1e80ac230 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009fc0 tx=0x7fe1e000b040 comp rx=0 tx=0).stop 2023-10-07T08:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.080+0000 7fe1f02a8700 1 -- 172.21.15.81:0/2643161191 shutdown_connections 2023-10-07T08:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.080+0000 7fe1f02a8700 1 --2- 172.21.15.81:0/2643161191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8157ca0 0x7fe1e80ac230 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.080+0000 7fe1f02a8700 1 --2- 172.21.15.81:0/2643161191 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe1cc066f30 0x7fe1cc0693e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.080+0000 7fe1f02a8700 1 --2- 172.21.15.81:0/2643161191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e806d120 0x7fe1e8155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.080+0000 7fe1f02a8700 1 --2- 172.21.15.81:0/2643161191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e81578d0 0x7fe1e80afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.080+0000 7fe1f02a8700 1 -- 172.21.15.81:0/2643161191 >> 172.21.15.81:0/2643161191 conn(0x7fe1e806bb90 msgr2=0x7fe1e81566b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.081+0000 7fe1f02a8700 1 -- 172.21.15.81:0/2643161191 shutdown_connections 2023-10-07T08:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.081+0000 7fe1f02a8700 1 -- 172.21.15.81:0/2643161191 wait complete. 2023-10-07T08:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 74 2023-10-07T08:52:11.095 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:52:11.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.207+0000 7f866d287700 1 Processor -- start 2023-10-07T08:52:11.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.207+0000 7f866d287700 1 -- start start 2023-10-07T08:52:11.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.208+0000 7f866d287700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f86681578d0 0x7f86680cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.208+0000 7f866d287700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f866806d120 0x7f866806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.208+0000 7f866d287700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86680d07c0 con 0x7f8668157ca0 2023-10-07T08:52:11.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.208+0000 7f866d287700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866806da50 con 0x7f866806d120 2023-10-07T08:52:11.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.208+0000 7f866d287700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86680cfbb0 con 0x7f86681578d0 2023-10-07T08:52:11.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.208+0000 7f86677fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f866806d120 0x7f866806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:11.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.208+0000 7f865e7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8668157ca0 0x7f866815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58320/0 (socket says 172.21.15.81:58320) 2023-10-07T08:52:11.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.208+0000 7f865e7fc700 1 -- 172.21.15.81:0/2621712207 learned_addr learned my addr 172.21.15.81:0/2621712207 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:11.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.208+0000 7f8666ffd700 1 --2- 172.21.15.81:0/2621712207 >> v2:172.21.15.89:3300/0 conn(0x7f86681578d0 0x7f86680cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:11.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.209+0000 7f86677fe700 1 -- 172.21.15.81:0/2621712207 >> v2:172.21.15.89:3300/0 conn(0x7f86681578d0 msgr2=0x7f86680cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:11.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.209+0000 7f86677fe700 1 --2- 172.21.15.81:0/2621712207 >> v2:172.21.15.89:3300/0 conn(0x7f86681578d0 0x7f86680cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.209+0000 7f86677fe700 1 -- 172.21.15.81:0/2621712207 >> v1:172.21.15.81:6789/0 conn(0x7f8668157ca0 legacy=0x7f866815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.209+0000 7f86667fc700 1 -- 172.21.15.81:0/2621712207 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418607849 0 0) 0x7f86680d07c0 con 0x7f8668157ca0 2023-10-07T08:52:11.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.209+0000 7f86677fe700 1 -- 172.21.15.81:0/2621712207 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86680cfe90 con 0x7f866806d120 2023-10-07T08:52:11.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.209+0000 7f86677fe700 1 --2- 172.21.15.81:0/2621712207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f866806d120 0x7f866806d510 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f86680646b0 tx=0x7f8660009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57839c2fa4f9163e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:11.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.209+0000 7f86667fc700 1 -- 172.21.15.81:0/2621712207 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866000e070 con 0x7f866806d120 2023-10-07T08:52:11.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.209+0000 7f86667fc700 1 -- 172.21.15.81:0/2621712207 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866000bb60 con 0x7f866806d120 2023-10-07T08:52:11.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.209+0000 7f86667fc700 1 -- 172.21.15.81:0/2621712207 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660012430 con 0x7f866806d120 2023-10-07T08:52:11.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.209+0000 7f866d287700 1 -- 172.21.15.81:0/2621712207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f866806d120 msgr2=0x7f866806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.209+0000 7f866d287700 1 --2- 172.21.15.81:0/2621712207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f866806d120 0x7f866806d510 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f86680646b0 tx=0x7f8660009780 comp rx=0 tx=0).stop 2023-10-07T08:52:11.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.209+0000 7f866d287700 1 -- 172.21.15.81:0/2621712207 shutdown_connections 2023-10-07T08:52:11.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.209+0000 7f866d287700 1 --2- 172.21.15.81:0/2621712207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f866806d120 0x7f866806d510 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.209+0000 7f866d287700 1 --2- 172.21.15.81:0/2621712207 >> v2:172.21.15.89:3300/0 conn(0x7f86681578d0 0x7f86680cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.209+0000 7f866d287700 1 -- 172.21.15.81:0/2621712207 >> 172.21.15.81:0/2621712207 conn(0x7f866806bb90 msgr2=0x7f866806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:11.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.209+0000 7f866d287700 1 -- 172.21.15.81:0/2621712207 shutdown_connections 2023-10-07T08:52:11.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.210+0000 7f866d287700 1 -- 172.21.15.81:0/2621712207 wait complete. 2023-10-07T08:52:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.211+0000 7f866d287700 1 Processor -- start 2023-10-07T08:52:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.211+0000 7f866d287700 1 -- start start 2023-10-07T08:52:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.211+0000 7f866d287700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f866806d120 0x7f8668155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.211+0000 7f866d287700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86681578d0 0x7f86680c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.211+0000 7f866d287700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8668157ca0 0x7f86680c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.211+0000 7f866d287700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8668156a80 con 0x7f866806d120 2023-10-07T08:52:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.211+0000 7f866d287700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86681567a0 con 0x7f86681578d0 2023-10-07T08:52:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.211+0000 7f866d287700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86680b4ff0 con 0x7f8668157ca0 2023-10-07T08:52:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.212+0000 7f8666ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f866806d120 0x7f8668155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.212+0000 7f8666ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f866806d120 0x7f8668155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50718/0 (socket says 172.21.15.81:50718) 2023-10-07T08:52:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.212+0000 7f8666ffd700 1 -- 172.21.15.81:0/3400861185 learned_addr learned my addr 172.21.15.81:0/3400861185 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.212+0000 7f8666ffd700 1 -- 172.21.15.81:0/3400861185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8668157ca0 msgr2=0x7f86680c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.212+0000 7f8666ffd700 1 --2- 172.21.15.81:0/3400861185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8668157ca0 0x7f86680c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.212+0000 7f865e7fc700 1 --2- 172.21.15.81:0/3400861185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86681578d0 0x7f86680c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.212+0000 7f8666ffd700 1 -- 172.21.15.81:0/3400861185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86681578d0 msgr2=0x7f86680c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.212+0000 7f8666ffd700 1 --2- 172.21.15.81:0/3400861185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86681578d0 0x7f86680c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.212+0000 7f8666ffd700 1 -- 172.21.15.81:0/3400861185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8660009a20 con 0x7f866806d120 2023-10-07T08:52:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.212+0000 7f865e7fc700 1 --2- 172.21.15.81:0/3400861185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86681578d0 0x7f86680c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.212+0000 7f8666ffd700 1 --2- 172.21.15.81:0/3400861185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f866806d120 0x7f8668155e50 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f865800ec80 tx=0x7f86580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.212+0000 7f865f7fe700 1 -- 172.21.15.81:0/3400861185 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865800c9d0 con 0x7f866806d120 2023-10-07T08:52:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.212+0000 7f865f7fe700 1 -- 172.21.15.81:0/3400861185 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865800cb30 con 0x7f866806d120 2023-10-07T08:52:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.212+0000 7f866d287700 1 -- 172.21.15.81:0/3400861185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86680b52d0 con 0x7f866806d120 2023-10-07T08:52:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.212+0000 7f865f7fe700 1 -- 172.21.15.81:0/3400861185 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658013470 con 0x7f866806d120 2023-10-07T08:52:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.212+0000 7f866d287700 1 -- 172.21.15.81:0/3400861185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8668156390 con 0x7f866806d120 2023-10-07T08:52:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.213+0000 7f866d287700 1 -- 172.21.15.81:0/3400861185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86680b57f0 con 0x7f866806d120 2023-10-07T08:52:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.213+0000 7f865f7fe700 1 -- 172.21.15.81:0/3400861185 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8658013820 con 0x7f866806d120 2023-10-07T08:52:11.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.214+0000 7f865f7fe700 1 --2- 172.21.15.81:0/3400861185 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8648066f30 0x7f86480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.214+0000 7f865f7fe700 1 -- 172.21.15.81:0/3400861185 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f86580848e0 con 0x7f866806d120 2023-10-07T08:52:11.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.214+0000 7f865e7fc700 1 --2- 172.21.15.81:0/3400861185 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8648066f30 0x7f86480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:11.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.214+0000 7f865f7fe700 1 -- 172.21.15.81:0/3400861185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f864806eb10 con 0x7f866806d120 2023-10-07T08:52:11.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.214+0000 7f865e7fc700 1 --2- 172.21.15.81:0/3400861185 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8648066f30 0x7f86480693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8668156e00 tx=0x7f8650009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:11.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.218+0000 7f865f7fe700 1 -- 172.21.15.81:0/3400861185 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8658017060 con 0x7f866806d120 2023-10-07T08:52:11.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.402+0000 7f866d287700 1 -- 172.21.15.81:0/3400861185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86680d0170 con 0x7f866806d120 2023-10-07T08:52:11.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.403+0000 7f865f7fe700 1 -- 172.21.15.81:0/3400861185 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+15440 (secure 0 0 0) 0x7f8658021090 con 0x7f866806d120 2023-10-07T08:52:11.404 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:11.404 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":160,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:51:28.310091+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:49:56.356539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-07T08:49:56.981204+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.a","mappings":[{"from":2,"to":0}]},{"pgid":"19.23","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:52:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.405+0000 7f866d287700 1 -- 172.21.15.81:0/3400861185 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8648066f30 msgr2=0x7f86480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.405+0000 7f866d287700 1 --2- 172.21.15.81:0/3400861185 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8648066f30 0x7f86480693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8668156e00 tx=0x7f8650009040 comp rx=0 tx=0).stop 2023-10-07T08:52:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.405+0000 7f866d287700 1 -- 172.21.15.81:0/3400861185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f866806d120 msgr2=0x7f8668155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.405+0000 7f866d287700 1 --2- 172.21.15.81:0/3400861185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f866806d120 0x7f8668155e50 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f865800ec80 tx=0x7f86580091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.405+0000 7f866d287700 1 -- 172.21.15.81:0/3400861185 shutdown_connections 2023-10-07T08:52:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.405+0000 7f866d287700 1 --2- 172.21.15.81:0/3400861185 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8648066f30 0x7f86480693e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.405+0000 7f866d287700 1 --2- 172.21.15.81:0/3400861185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8668157ca0 0x7f86680c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.405+0000 7f866d287700 1 --2- 172.21.15.81:0/3400861185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f866806d120 0x7f8668155e50 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.405+0000 7f866d287700 1 --2- 172.21.15.81:0/3400861185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86681578d0 0x7f86680c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.405+0000 7f866d287700 1 -- 172.21.15.81:0/3400861185 >> 172.21.15.81:0/3400861185 conn(0x7f866806bb90 msgr2=0x7f866815fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:11.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.405+0000 7f866d287700 1 -- 172.21.15.81:0/3400861185 shutdown_connections 2023-10-07T08:52:11.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.405+0000 7f866d287700 1 -- 172.21.15.81:0/3400861185 wait complete. 2023-10-07T08:52:11.419 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T08:52:11.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:52:11.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.532+0000 7f5806c5a700 1 Processor -- start 2023-10-07T08:52:11.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.532+0000 7f5806c5a700 1 -- start start 2023-10-07T08:52:11.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.533+0000 7f5806c5a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f58001578d0 0x7f58000cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.533+0000 7f5806c5a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f580006d120 0x7f580006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.533+0000 7f5806c5a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58000d07c0 con 0x7f5800157ca0 2023-10-07T08:52:11.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.533+0000 7f5806c5a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580006daa0 con 0x7f58001578d0 2023-10-07T08:52:11.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.533+0000 7f5806c5a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58000cfbb0 con 0x7f580006d120 2023-10-07T08:52:11.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.533+0000 7f58051f7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f580006d120 0x7f580006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:11.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.533+0000 7f58049f6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f58001578d0 0x7f58000cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:11.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.533+0000 7f57f7fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5800157ca0 0x7f580015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:35348/0 (socket says 172.21.15.81:35348) 2023-10-07T08:52:11.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.533+0000 7f57f7fff700 1 -- 172.21.15.81:0/279041832 learned_addr learned my addr 172.21.15.81:0/279041832 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:11.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.534+0000 7f57f77fe700 1 -- 172.21.15.81:0/279041832 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843921348 0 0) 0x7f58000d07c0 con 0x7f5800157ca0 2023-10-07T08:52:11.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.534+0000 7f57f77fe700 1 -- 172.21.15.81:0/279041832 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57e8003570 con 0x7f5800157ca0 2023-10-07T08:52:11.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.534+0000 7f58049f6700 1 -- 172.21.15.81:0/279041832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f580006d120 msgr2=0x7f580006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:11.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.534+0000 7f58049f6700 1 --2- 172.21.15.81:0/279041832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f580006d120 0x7f580006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.534+0000 7f58049f6700 1 -- 172.21.15.81:0/279041832 >> v1:172.21.15.89:6789/0 conn(0x7f5800157ca0 legacy=0x7f580015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.534+0000 7f58049f6700 1 -- 172.21.15.81:0/279041832 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58000cfe90 con 0x7f58001578d0 2023-10-07T08:52:11.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.534+0000 7f58051f7700 1 --2- 172.21.15.81:0/279041832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f580006d120 0x7f580006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:52:11.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.534+0000 7f58049f6700 1 --2- 172.21.15.81:0/279041832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58001578d0 0x7f58000cf4f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009e60 tx=0x7f57fc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8d01401e6659957 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:11.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.534+0000 7f57f77fe700 1 -- 172.21.15.81:0/279041832 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc00e070 con 0x7f58001578d0 2023-10-07T08:52:11.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.534+0000 7f57f77fe700 1 -- 172.21.15.81:0/279041832 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc00bab0 con 0x7f58001578d0 2023-10-07T08:52:11.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.534+0000 7f57f77fe700 1 -- 172.21.15.81:0/279041832 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc00be30 con 0x7f58001578d0 2023-10-07T08:52:11.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.535+0000 7f5806c5a700 1 -- 172.21.15.81:0/279041832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58001578d0 msgr2=0x7f58000cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.535+0000 7f5806c5a700 1 --2- 172.21.15.81:0/279041832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58001578d0 0x7f58000cf4f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009e60 tx=0x7f57fc009780 comp rx=0 tx=0).stop 2023-10-07T08:52:11.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.535+0000 7f5806c5a700 1 -- 172.21.15.81:0/279041832 shutdown_connections 2023-10-07T08:52:11.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.535+0000 7f5806c5a700 1 --2- 172.21.15.81:0/279041832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f580006d120 0x7f580006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.535+0000 7f5806c5a700 1 --2- 172.21.15.81:0/279041832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58001578d0 0x7f58000cf4f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.535+0000 7f5806c5a700 1 -- 172.21.15.81:0/279041832 >> 172.21.15.81:0/279041832 conn(0x7f580006bb90 msgr2=0x7f580006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:11.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.535+0000 7f5806c5a700 1 -- 172.21.15.81:0/279041832 shutdown_connections 2023-10-07T08:52:11.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.535+0000 7f5806c5a700 1 -- 172.21.15.81:0/279041832 wait complete. 2023-10-07T08:52:11.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.536+0000 7f5806c5a700 1 Processor -- start 2023-10-07T08:52:11.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.536+0000 7f5806c5a700 1 -- start start 2023-10-07T08:52:11.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f5806c5a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f580006d120 0x7f58000b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f5806c5a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58001578d0 0x7f580016a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f5806c5a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5800157ca0 0x7f5800145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f5806c5a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58000c5c50 con 0x7f58001578d0 2023-10-07T08:52:11.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f5806c5a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58000c7790 con 0x7f5800157ca0 2023-10-07T08:52:11.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f5806c5a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580016aea0 con 0x7f580006d120 2023-10-07T08:52:11.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f57f7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58001578d0 0x7f580016a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:11.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f57f7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58001578d0 0x7f580016a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50730/0 (socket says 172.21.15.81:50730) 2023-10-07T08:52:11.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f57f7fff700 1 -- 172.21.15.81:0/3476017997 learned_addr learned my addr 172.21.15.81:0/3476017997 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:11.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f58049f6700 1 --2- 172.21.15.81:0/3476017997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f580006d120 0x7f58000b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:11.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f58051f7700 1 --2- 172.21.15.81:0/3476017997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5800157ca0 0x7f5800145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:11.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f57f7fff700 1 -- 172.21.15.81:0/3476017997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f580006d120 msgr2=0x7f58000b66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f57f7fff700 1 --2- 172.21.15.81:0/3476017997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f580006d120 0x7f58000b66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f57f7fff700 1 -- 172.21.15.81:0/3476017997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5800157ca0 msgr2=0x7f5800145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f57f7fff700 1 --2- 172.21.15.81:0/3476017997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5800157ca0 0x7f5800145780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f57f7fff700 1 -- 172.21.15.81:0/3476017997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f8009420 con 0x7f58001578d0 2023-10-07T08:52:11.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f57f7fff700 1 --2- 172.21.15.81:0/3476017997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58001578d0 0x7f580016a800 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f57f000c590 tx=0x7f57f0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:11.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.537+0000 7f57f4ff9700 1 -- 172.21.15.81:0/3476017997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f0005c00 con 0x7f58001578d0 2023-10-07T08:52:11.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.538+0000 7f57f4ff9700 1 -- 172.21.15.81:0/3476017997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f0005d60 con 0x7f58001578d0 2023-10-07T08:52:11.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.538+0000 7f5806c5a700 1 -- 172.21.15.81:0/3476017997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57fc009a20 con 0x7f58001578d0 2023-10-07T08:52:11.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.538+0000 7f57f4ff9700 1 -- 172.21.15.81:0/3476017997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f0007300 con 0x7f58001578d0 2023-10-07T08:52:11.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.538+0000 7f5806c5a700 1 -- 172.21.15.81:0/3476017997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580016b460 con 0x7f58001578d0 2023-10-07T08:52:11.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.538+0000 7f5806c5a700 1 -- 172.21.15.81:0/3476017997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58000b6c60 con 0x7f58001578d0 2023-10-07T08:52:11.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.539+0000 7f57f4ff9700 1 -- 172.21.15.81:0/3476017997 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57f001a360 con 0x7f58001578d0 2023-10-07T08:52:11.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.539+0000 7f57f4ff9700 1 --2- 172.21.15.81:0/3476017997 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f57ec066f30 0x7f57ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.539+0000 7f57f4ff9700 1 -- 172.21.15.81:0/3476017997 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f57f0083830 con 0x7f58001578d0 2023-10-07T08:52:11.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.539+0000 7f58049f6700 1 --2- 172.21.15.81:0/3476017997 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f57ec066f30 0x7f57ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:11.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.539+0000 7f57f4ff9700 1 -- 172.21.15.81:0/3476017997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f57ec06eb10 con 0x7f58001578d0 2023-10-07T08:52:11.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.540+0000 7f58049f6700 1 --2- 172.21.15.81:0/3476017997 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f57ec066f30 0x7f57ec0693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0097c0 tx=0x7f57fc019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:11.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.543+0000 7f57f4ff9700 1 -- 172.21.15.81:0/3476017997 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57f0017020 con 0x7f58001578d0 2023-10-07T08:52:11.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.771+0000 7f5806c5a700 1 -- 172.21.15.81:0/3476017997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58000c5d90 con 0x7f58001578d0 2023-10-07T08:52:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.772+0000 7f57f4ff9700 1 -- 172.21.15.81:0/3476017997 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f57f0050b20 con 0x7f58001578d0 2023-10-07T08:52:11.773 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:11.773 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1419112520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1419112520},{"type":"v1","addr":"172.21.15.89:6834","nonce":1419112520}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":6140,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2310402815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2310402815},{"type":"v1","addr":"172.21.15.89:6835","nonce":2310402815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7509,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2709799872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2709799872},{"type":"v1","addr":"172.21.15.81:6836","nonce":2709799872}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:49:58.023106+0000","modified":"2023-10-07T08:50:01.662857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7512":{"gid":7512,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/510483669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":510483669},{"type":"v1","addr":"172.21.15.81:6837","nonce":510483669}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-07T08:52:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.774+0000 7f5806c5a700 1 -- 172.21.15.81:0/3476017997 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f57ec066f30 msgr2=0x7f57ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.774+0000 7f5806c5a700 1 --2- 172.21.15.81:0/3476017997 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f57ec066f30 0x7f57ec0693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0097c0 tx=0x7f57fc019000 comp rx=0 tx=0).stop 2023-10-07T08:52:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.774+0000 7f5806c5a700 1 -- 172.21.15.81:0/3476017997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58001578d0 msgr2=0x7f580016a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.774+0000 7f5806c5a700 1 --2- 172.21.15.81:0/3476017997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58001578d0 0x7f580016a800 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f57f000c590 tx=0x7f57f0007d90 comp rx=0 tx=0).stop 2023-10-07T08:52:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.774+0000 7f5806c5a700 1 -- 172.21.15.81:0/3476017997 shutdown_connections 2023-10-07T08:52:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.774+0000 7f5806c5a700 1 --2- 172.21.15.81:0/3476017997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5800157ca0 0x7f5800145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.774+0000 7f5806c5a700 1 --2- 172.21.15.81:0/3476017997 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f57ec066f30 0x7f57ec0693e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.774+0000 7f5806c5a700 1 --2- 172.21.15.81:0/3476017997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f580006d120 0x7f58000b66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.774+0000 7f5806c5a700 1 --2- 172.21.15.81:0/3476017997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58001578d0 0x7f580016a800 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.774+0000 7f5806c5a700 1 -- 172.21.15.81:0/3476017997 >> 172.21.15.81:0/3476017997 conn(0x7f580006bb90 msgr2=0x7f5800154730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.774+0000 7f5806c5a700 1 -- 172.21.15.81:0/3476017997 shutdown_connections 2023-10-07T08:52:11.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.774+0000 7f5806c5a700 1 -- 172.21.15.81:0/3476017997 wait complete. 2023-10-07T08:52:11.777 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 74 2023-10-07T08:52:11.788 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:52:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.900+0000 7f61c6294700 1 Processor -- start 2023-10-07T08:52:11.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.900+0000 7f61c6294700 1 -- start start 2023-10-07T08:52:11.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.901+0000 7f61c6294700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61c0157ca0 0x7f61c00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.901+0000 7f61c6294700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c00d07c0 con 0x7f61c01578d0 2023-10-07T08:52:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.901+0000 7f61c6294700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c00cfbb0 con 0x7f61c006d120 2023-10-07T08:52:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.901+0000 7f61c6294700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c00cfe90 con 0x7f61c0157ca0 2023-10-07T08:52:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.901+0000 7f61bf7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61c0157ca0 0x7f61c00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.901+0000 7f61bffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f61c01578d0 0x7f61c015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58332/0 (socket says 172.21.15.81:58332) 2023-10-07T08:52:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.901+0000 7f61bffff700 1 -- 172.21.15.81:0/197677905 learned_addr learned my addr 172.21.15.81:0/197677905 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.901+0000 7f61bf7fe700 1 -- 172.21.15.81:0/197677905 >> v1:172.21.15.89:6789/0 conn(0x7f61c006d120 legacy=0x7f61c006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.901+0000 7f61bf7fe700 1 -- 172.21.15.81:0/197677905 >> v1:172.21.15.81:6789/0 conn(0x7f61c01578d0 legacy=0x7f61c015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.902+0000 7f61bf7fe700 1 -- 172.21.15.81:0/197677905 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c00d0170 con 0x7f61c0157ca0 2023-10-07T08:52:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.901+0000 7f61beffd700 1 -- 172.21.15.81:0/197677905 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260278945 0 0) 0x7f61c00d07c0 con 0x7f61c01578d0 2023-10-07T08:52:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.902+0000 7f61bf7fe700 1 --2- 172.21.15.81:0/197677905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c0157ca0 0x7f61c00cf4f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f61b40098e0 tx=0x7f61b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f49a7d3bc4effa server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.902+0000 7f61beffd700 1 -- 172.21.15.81:0/197677905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b4009e80 con 0x7f61c0157ca0 2023-10-07T08:52:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.902+0000 7f61beffd700 1 -- 172.21.15.81:0/197677905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b400b820 con 0x7f61c0157ca0 2023-10-07T08:52:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.902+0000 7f61beffd700 1 -- 172.21.15.81:0/197677905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b400bba0 con 0x7f61c0157ca0 2023-10-07T08:52:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.902+0000 7f61c6294700 1 -- 172.21.15.81:0/197677905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c0157ca0 msgr2=0x7f61c00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.902+0000 7f61c6294700 1 --2- 172.21.15.81:0/197677905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c0157ca0 0x7f61c00cf4f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f61b40098e0 tx=0x7f61b40091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.902+0000 7f61c6294700 1 -- 172.21.15.81:0/197677905 shutdown_connections 2023-10-07T08:52:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.902+0000 7f61c6294700 1 --2- 172.21.15.81:0/197677905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c0157ca0 0x7f61c00cf4f0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.902+0000 7f61c6294700 1 -- 172.21.15.81:0/197677905 >> 172.21.15.81:0/197677905 conn(0x7f61c006bb90 msgr2=0x7f61c006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.902+0000 7f61c6294700 1 -- 172.21.15.81:0/197677905 shutdown_connections 2023-10-07T08:52:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.902+0000 7f61c6294700 1 -- 172.21.15.81:0/197677905 wait complete. 2023-10-07T08:52:11.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.903+0000 7f61c6294700 1 Processor -- start 2023-10-07T08:52:11.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.904+0000 7f61c6294700 1 -- start start 2023-10-07T08:52:11.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.904+0000 7f61c6294700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c006d120 0x7f61c0154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.904+0000 7f61c6294700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61c01578d0 0x7f61c016b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.904+0000 7f61c6294700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61c0157ca0 0x7f61c01590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.904+0000 7f61c6294700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c0155150 con 0x7f61c006d120 2023-10-07T08:52:11.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.904+0000 7f61c6294700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00ac420 con 0x7f61c0157ca0 2023-10-07T08:52:11.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.904+0000 7f61c6294700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c016b7b0 con 0x7f61c01578d0 2023-10-07T08:52:11.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.904+0000 7f61bffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c006d120 0x7f61c0154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:11.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.904+0000 7f61bffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c006d120 0x7f61c0154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50752/0 (socket says 172.21.15.81:50752) 2023-10-07T08:52:11.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.904+0000 7f61bffff700 1 -- 172.21.15.81:0/687919675 learned_addr learned my addr 172.21.15.81:0/687919675 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:11.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.905+0000 7f61c4831700 1 --2- 172.21.15.81:0/687919675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61c0157ca0 0x7f61c01590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:11.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.905+0000 7f61bf7fe700 1 --2- 172.21.15.81:0/687919675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61c01578d0 0x7f61c016b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:11.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.905+0000 7f61bffff700 1 -- 172.21.15.81:0/687919675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61c01578d0 msgr2=0x7f61c016b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.905+0000 7f61bffff700 1 --2- 172.21.15.81:0/687919675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61c01578d0 0x7f61c016b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.905+0000 7f61bffff700 1 -- 172.21.15.81:0/687919675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61c0157ca0 msgr2=0x7f61c01590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:11.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.905+0000 7f61bffff700 1 --2- 172.21.15.81:0/687919675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61c0157ca0 0x7f61c01590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:11.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.905+0000 7f61bffff700 1 -- 172.21.15.81:0/687919675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b4009420 con 0x7f61c006d120 2023-10-07T08:52:11.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.905+0000 7f61c4831700 1 --2- 172.21.15.81:0/687919675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61c0157ca0 0x7f61c01590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:11.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.905+0000 7f61bf7fe700 1 --2- 172.21.15.81:0/687919675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61c01578d0 0x7f61c016b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:11.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.905+0000 7f61bffff700 1 --2- 172.21.15.81:0/687919675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c006d120 0x7f61c0154c10 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f61b000c7e0 tx=0x7f61b0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:11.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.905+0000 7f61a7fff700 1 -- 172.21.15.81:0/687919675 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0005b30 con 0x7f61c006d120 2023-10-07T08:52:11.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.905+0000 7f61a7fff700 1 -- 172.21.15.81:0/687919675 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b0005c90 con 0x7f61c006d120 2023-10-07T08:52:11.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.905+0000 7f61c6294700 1 -- 172.21.15.81:0/687919675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c00abaf0 con 0x7f61c006d120 2023-10-07T08:52:11.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.905+0000 7f61a7fff700 1 -- 172.21.15.81:0/687919675 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0007300 con 0x7f61c006d120 2023-10-07T08:52:11.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.905+0000 7f61c6294700 1 -- 172.21.15.81:0/687919675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c00ac0b0 con 0x7f61c006d120 2023-10-07T08:52:11.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.906+0000 7f61c6294700 1 -- 172.21.15.81:0/687919675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c015a180 con 0x7f61c006d120 2023-10-07T08:52:11.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.906+0000 7f61a7fff700 1 -- 172.21.15.81:0/687919675 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61b001b400 con 0x7f61c006d120 2023-10-07T08:52:11.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.907+0000 7f61a7fff700 1 --2- 172.21.15.81:0/687919675 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f61ac066f30 0x7f61ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:11.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.907+0000 7f61bf7fe700 1 --2- 172.21.15.81:0/687919675 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f61ac066f30 0x7f61ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.907+0000 7f61a7fff700 1 -- 172.21.15.81:0/687919675 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f61b00840e0 con 0x7f61c006d120 2023-10-07T08:52:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.907+0000 7f61a7fff700 1 -- 172.21.15.81:0/687919675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f61ac06eb10 con 0x7f61c006d120 2023-10-07T08:52:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.907+0000 7f61bf7fe700 1 --2- 172.21.15.81:0/687919675 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f61ac066f30 0x7f61ac0693e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f61c01580c0 tx=0x7f61b4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:11.911+0000 7f61a7fff700 1 -- 172.21.15.81:0/687919675 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61b0051390 con 0x7f61c006d120 2023-10-07T08:52:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.134+0000 7f61c6294700 1 -- 172.21.15.81:0/687919675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61c00d0450 con 0x7f61c006d120 2023-10-07T08:52:12.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.135+0000 7f61a7fff700 1 -- 172.21.15.81:0/687919675 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f61b00549b0 con 0x7f61c006d120 2023-10-07T08:52:12.136 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:12.136 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1419112520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1419112520},{"type":"v1","addr":"172.21.15.89:6834","nonce":1419112520}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":6140,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2310402815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2310402815},{"type":"v1","addr":"172.21.15.89:6835","nonce":2310402815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7509,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2709799872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2709799872},{"type":"v1","addr":"172.21.15.81:6836","nonce":2709799872}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:49:58.023106+0000","modified":"2023-10-07T08:50:01.662857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7512},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7512":{"gid":7512,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/510483669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":510483669},{"type":"v1","addr":"172.21.15.81:6837","nonce":510483669}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-07T08:52:12.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.137+0000 7f61c6294700 1 -- 172.21.15.81:0/687919675 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f61ac066f30 msgr2=0x7f61ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.137+0000 7f61c6294700 1 --2- 172.21.15.81:0/687919675 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f61ac066f30 0x7f61ac0693e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f61c01580c0 tx=0x7f61b4016000 comp rx=0 tx=0).stop 2023-10-07T08:52:12.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.137+0000 7f61c6294700 1 -- 172.21.15.81:0/687919675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c006d120 msgr2=0x7f61c0154c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.137+0000 7f61c6294700 1 --2- 172.21.15.81:0/687919675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c006d120 0x7f61c0154c10 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f61b000c7e0 tx=0x7f61b0007df0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.137+0000 7f61c6294700 1 -- 172.21.15.81:0/687919675 shutdown_connections 2023-10-07T08:52:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.137+0000 7f61c6294700 1 --2- 172.21.15.81:0/687919675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61c0157ca0 0x7f61c01590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.137+0000 7f61c6294700 1 --2- 172.21.15.81:0/687919675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c006d120 0x7f61c0154c10 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.137+0000 7f61c6294700 1 --2- 172.21.15.81:0/687919675 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f61ac066f30 0x7f61ac0693e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.137+0000 7f61c6294700 1 --2- 172.21.15.81:0/687919675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61c01578d0 0x7f61c016b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.137+0000 7f61c6294700 1 -- 172.21.15.81:0/687919675 >> 172.21.15.81:0/687919675 conn(0x7f61c006bb90 msgr2=0x7f61c0069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.137+0000 7f61c6294700 1 -- 172.21.15.81:0/687919675 shutdown_connections 2023-10-07T08:52:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.137+0000 7f61c6294700 1 -- 172.21.15.81:0/687919675 wait complete. 2023-10-07T08:52:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 74 2023-10-07T08:52:12.150 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:52:12.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.262+0000 7f7e5584e700 1 Processor -- start 2023-10-07T08:52:12.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.262+0000 7f7e5584e700 1 -- start start 2023-10-07T08:52:12.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.263+0000 7f7e5584e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e500cf240 0x7f7e500b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.263+0000 7f7e5584e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e5006d650 0x7f7e5006da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.263+0000 7f7e5584e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e500b0ca0 con 0x7f7e5015a2a0 2023-10-07T08:52:12.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.263+0000 7f7e5584e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e5006ea90 con 0x7f7e5006d650 2023-10-07T08:52:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.263+0000 7f7e5584e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e500b00d0 con 0x7f7e500cf240 2023-10-07T08:52:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.263+0000 7f7e4f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e5006d650 0x7f7e5006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.263+0000 7f7e4f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e5006d650 0x7f7e5006da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50764/0 (socket says 172.21.15.81:50764) 2023-10-07T08:52:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.263+0000 7f7e4f7fe700 1 -- 172.21.15.81:0/1788949836 learned_addr learned my addr 172.21.15.81:0/1788949836 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.263+0000 7f7e4e7fc700 1 --2- 172.21.15.81:0/1788949836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e500cf240 0x7f7e500b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.264+0000 7f7e4f7fe700 1 -- 172.21.15.81:0/1788949836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e500cf240 msgr2=0x7f7e500b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.264+0000 7f7e4f7fe700 1 --2- 172.21.15.81:0/1788949836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e500cf240 0x7f7e500b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.264+0000 7f7e4f7fe700 1 -- 172.21.15.81:0/1788949836 >> v1:172.21.15.89:6789/0 conn(0x7f7e5015a2a0 legacy=0x7f7e500ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.264+0000 7f7e4f7fe700 1 -- 172.21.15.81:0/1788949836 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e500b0370 con 0x7f7e5006d650 2023-10-07T08:52:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.264+0000 7f7e4f7fe700 1 --2- 172.21.15.81:0/1788949836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e5006d650 0x7f7e5006da90 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f7e480099b0 tx=0x7f7e48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c506845d49a54ee server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.264+0000 7f7e4dffb700 1 -- 172.21.15.81:0/1788949836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4800b860 con 0x7f7e5006d650 2023-10-07T08:52:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.264+0000 7f7e4dffb700 1 -- 172.21.15.81:0/1788949836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4800b9c0 con 0x7f7e5006d650 2023-10-07T08:52:12.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.264+0000 7f7e4dffb700 1 -- 172.21.15.81:0/1788949836 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4800bd60 con 0x7f7e5006d650 2023-10-07T08:52:12.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.264+0000 7f7e5584e700 1 -- 172.21.15.81:0/1788949836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e5006d650 msgr2=0x7f7e5006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.264+0000 7f7e5584e700 1 --2- 172.21.15.81:0/1788949836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e5006d650 0x7f7e5006da90 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f7e480099b0 tx=0x7f7e48009250 comp rx=0 tx=0).stop 2023-10-07T08:52:12.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.264+0000 7f7e5584e700 1 -- 172.21.15.81:0/1788949836 shutdown_connections 2023-10-07T08:52:12.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.264+0000 7f7e5584e700 1 --2- 172.21.15.81:0/1788949836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e5006d650 0x7f7e5006da90 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.264+0000 7f7e5584e700 1 --2- 172.21.15.81:0/1788949836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e500cf240 0x7f7e500b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.264+0000 7f7e5584e700 1 -- 172.21.15.81:0/1788949836 >> 172.21.15.81:0/1788949836 conn(0x7f7e50067640 msgr2=0x7f7e50067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:12.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.264+0000 7f7e5584e700 1 -- 172.21.15.81:0/1788949836 shutdown_connections 2023-10-07T08:52:12.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.264+0000 7f7e5584e700 1 -- 172.21.15.81:0/1788949836 wait complete. 2023-10-07T08:52:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.266+0000 7f7e5584e700 1 Processor -- start 2023-10-07T08:52:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.266+0000 7f7e5584e700 1 -- start start 2023-10-07T08:52:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.266+0000 7f7e5584e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e5006d650 0x7f7e501424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.266+0000 7f7e5584e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500cf240 0x7f7e50142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.266+0000 7f7e5584e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e5015a2a0 0x7f7e5015e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.266+0000 7f7e5584e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5015e1d0 con 0x7f7e500cf240 2023-10-07T08:52:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.266+0000 7f7e5584e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e50142a20 con 0x7f7e5015a2a0 2023-10-07T08:52:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.266+0000 7f7e5584e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5015d5c0 con 0x7f7e5006d650 2023-10-07T08:52:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.266+0000 7f7e4e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500cf240 0x7f7e50142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.266+0000 7f7e4e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500cf240 0x7f7e50142d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50768/0 (socket says 172.21.15.81:50768) 2023-10-07T08:52:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.267+0000 7f7e4e7fc700 1 -- 172.21.15.81:0/2050236765 learned_addr learned my addr 172.21.15.81:0/2050236765 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.267+0000 7f7e4f7fe700 1 --2- 172.21.15.81:0/2050236765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e5015a2a0 0x7f7e5015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.267+0000 7f7e4effd700 1 --2- 172.21.15.81:0/2050236765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e5006d650 0x7f7e501424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.267+0000 7f7e4e7fc700 1 -- 172.21.15.81:0/2050236765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e5006d650 msgr2=0x7f7e501424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.267+0000 7f7e4e7fc700 1 --2- 172.21.15.81:0/2050236765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e5006d650 0x7f7e501424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.267+0000 7f7e4e7fc700 1 -- 172.21.15.81:0/2050236765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e5015a2a0 msgr2=0x7f7e5015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.267+0000 7f7e4e7fc700 1 --2- 172.21.15.81:0/2050236765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e5015a2a0 0x7f7e5015e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.267+0000 7f7e4e7fc700 1 -- 172.21.15.81:0/2050236765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e480094f0 con 0x7f7e500cf240 2023-10-07T08:52:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.267+0000 7f7e4f7fe700 1 --2- 172.21.15.81:0/2050236765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e5015a2a0 0x7f7e5015e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.267+0000 7f7e4effd700 1 --2- 172.21.15.81:0/2050236765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e5006d650 0x7f7e501424e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.267+0000 7f7e4e7fc700 1 --2- 172.21.15.81:0/2050236765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500cf240 0x7f7e50142d40 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800d890 tx=0x7f7e38008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.267+0000 7f7e46ffd700 1 -- 172.21.15.81:0/2050236765 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3800b600 con 0x7f7e500cf240 2023-10-07T08:52:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.267+0000 7f7e46ffd700 1 -- 172.21.15.81:0/2050236765 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3800b760 con 0x7f7e500cf240 2023-10-07T08:52:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.267+0000 7f7e5584e700 1 -- 172.21.15.81:0/2050236765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5015d8a0 con 0x7f7e500cf240 2023-10-07T08:52:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.267+0000 7f7e46ffd700 1 -- 172.21.15.81:0/2050236765 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3800bae0 con 0x7f7e500cf240 2023-10-07T08:52:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.267+0000 7f7e5584e700 1 -- 172.21.15.81:0/2050236765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5015de60 con 0x7f7e500cf240 2023-10-07T08:52:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.268+0000 7f7e5584e700 1 -- 172.21.15.81:0/2050236765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5015e340 con 0x7f7e500cf240 2023-10-07T08:52:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.268+0000 7f7e46ffd700 1 -- 172.21.15.81:0/2050236765 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e3801e460 con 0x7f7e500cf240 2023-10-07T08:52:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.269+0000 7f7e46ffd700 1 --2- 172.21.15.81:0/2050236765 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e30066f30 0x7f7e300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.269+0000 7f7e46ffd700 1 -- 172.21.15.81:0/2050236765 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7e38084c50 con 0x7f7e500cf240 2023-10-07T08:52:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.269+0000 7f7e4effd700 1 --2- 172.21.15.81:0/2050236765 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e30066f30 0x7f7e300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.269+0000 7f7e46ffd700 1 -- 172.21.15.81:0/2050236765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f7e3006eb10 con 0x7f7e500cf240 2023-10-07T08:52:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.269+0000 7f7e4effd700 1 --2- 172.21.15.81:0/2050236765 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e30066f30 0x7f7e300693e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f7e40007fd0 tx=0x7f7e40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.273+0000 7f7e46ffd700 1 -- 172.21.15.81:0/2050236765 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e3808a020 con 0x7f7e500cf240 2023-10-07T08:52:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.454+0000 7f7e5584e700 1 -- 172.21.15.81:0/2050236765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e50064650 con 0x7f7e500cf240 2023-10-07T08:52:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.455+0000 7f7e46ffd700 1 -- 172.21.15.81:0/2050236765 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+15440 (secure 0 0 0) 0x7f7e38051e80 con 0x7f7e500cf240 2023-10-07T08:52:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:12.458 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":160,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:51:28.310091+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:49:56.356539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-07T08:49:56.981204+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.a","mappings":[{"from":2,"to":0}]},{"pgid":"19.23","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:52:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.457+0000 7f7e5584e700 1 -- 172.21.15.81:0/2050236765 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e30066f30 msgr2=0x7f7e300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.457+0000 7f7e5584e700 1 --2- 172.21.15.81:0/2050236765 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e30066f30 0x7f7e300693e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f7e40007fd0 tx=0x7f7e40009040 comp rx=0 tx=0).stop 2023-10-07T08:52:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.457+0000 7f7e5584e700 1 -- 172.21.15.81:0/2050236765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500cf240 msgr2=0x7f7e50142d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.457+0000 7f7e5584e700 1 --2- 172.21.15.81:0/2050236765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500cf240 0x7f7e50142d40 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800d890 tx=0x7f7e38008040 comp rx=0 tx=0).stop 2023-10-07T08:52:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.457+0000 7f7e5584e700 1 -- 172.21.15.81:0/2050236765 shutdown_connections 2023-10-07T08:52:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.457+0000 7f7e5584e700 1 --2- 172.21.15.81:0/2050236765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e5015a2a0 0x7f7e5015e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.457+0000 7f7e5584e700 1 --2- 172.21.15.81:0/2050236765 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7e30066f30 0x7f7e300693e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.457+0000 7f7e5584e700 1 --2- 172.21.15.81:0/2050236765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e5006d650 0x7f7e501424e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.457+0000 7f7e5584e700 1 --2- 172.21.15.81:0/2050236765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500cf240 0x7f7e50142d40 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.457+0000 7f7e5584e700 1 -- 172.21.15.81:0/2050236765 >> 172.21.15.81:0/2050236765 conn(0x7f7e50067640 msgr2=0x7f7e50157d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.457+0000 7f7e5584e700 1 -- 172.21.15.81:0/2050236765 shutdown_connections 2023-10-07T08:52:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.457+0000 7f7e5584e700 1 -- 172.21.15.81:0/2050236765 wait complete. 2023-10-07T08:52:12.471 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T08:52:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.584+0000 7fe0f0014700 1 Processor -- start 2023-10-07T08:52:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.584+0000 7fe0f0014700 1 -- start start 2023-10-07T08:52:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.585+0000 7fe0f0014700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe0e81578d0 0x7fe0e80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.585+0000 7fe0f0014700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e80d07c0 con 0x7fe0e806d120 2023-10-07T08:52:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.585+0000 7fe0f0014700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e80cfbb0 con 0x7fe0e8157ca0 2023-10-07T08:52:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.585+0000 7fe0f0014700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e80cfe90 con 0x7fe0e81578d0 2023-10-07T08:52:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.585+0000 7fe0ee5b1700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe0e806d120 0x7fe0e806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45238/0 (socket says 172.21.15.81:45238) 2023-10-07T08:52:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.585+0000 7fe0ee5b1700 1 -- 172.21.15.81:0/2191581258 learned_addr learned my addr 172.21.15.81:0/2191581258 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0eddb0700 1 --2- 172.21.15.81:0/2191581258 >> v2:172.21.15.89:3300/0 conn(0x7fe0e81578d0 0x7fe0e80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ecdae700 1 -- 172.21.15.81:0/2191581258 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181845725 0 0) 0x7fe0e80d07c0 con 0x7fe0e806d120 2023-10-07T08:52:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ecdae700 1 -- 172.21.15.81:0/2191581258 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0d4003570 con 0x7fe0e806d120 2023-10-07T08:52:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ecdae700 1 -- 172.21.15.81:0/2191581258 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3400412350 0 0) 0x7fe0d4003570 con 0x7fe0e806d120 2023-10-07T08:52:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ecdae700 1 -- 172.21.15.81:0/2191581258 >> v2:172.21.15.89:3300/0 conn(0x7fe0e81578d0 msgr2=0x7fe0e80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ecdae700 1 --2- 172.21.15.81:0/2191581258 >> v2:172.21.15.89:3300/0 conn(0x7fe0e81578d0 0x7fe0e80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ecdae700 1 -- 172.21.15.81:0/2191581258 >> v1:172.21.15.89:6789/0 conn(0x7fe0e8157ca0 legacy=0x7fe0e815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ecdae700 1 -- 172.21.15.81:0/2191581258 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e80d0170 con 0x7fe0e806d120 2023-10-07T08:52:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ecdae700 1 -- 172.21.15.81:0/2191581258 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fe0e00017f0 con 0x7fe0e806d120 2023-10-07T08:52:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ecdae700 1 -- 172.21.15.81:0/2191581258 >> v1:172.21.15.81:6789/0 conn(0x7fe0e806d120 legacy=0x7fe0e806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ecdae700 1 --2- 172.21.15.81:0/2191581258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0d4003a60 0x7fe0d4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ecdae700 1 --2- 172.21.15.81:0/2191581258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d4004810 0x7fe0d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ecdae700 1 --2- 172.21.15.81:0/2191581258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0d40051c0 0x7fe0d400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ecdae700 1 -- 172.21.15.81:0/2191581258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80cfe90 con 0x7fe0d4004810 2023-10-07T08:52:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ecdae700 1 -- 172.21.15.81:0/2191581258 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d400c0d0 con 0x7fe0d4003a60 2023-10-07T08:52:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ecdae700 1 -- 172.21.15.81:0/2191581258 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d400c290 con 0x7fe0d40051c0 2023-10-07T08:52:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ed5af700 1 --2- 172.21.15.81:0/2191581258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d4004810 0x7fe0d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0eddb0700 1 --2- 172.21.15.81:0/2191581258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0d4003a60 0x7fe0d4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ee5b1700 1 --2- 172.21.15.81:0/2191581258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0d40051c0 0x7fe0d400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ed5af700 1 -- 172.21.15.81:0/2191581258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0d40051c0 msgr2=0x7fe0d400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ed5af700 1 --2- 172.21.15.81:0/2191581258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0d40051c0 0x7fe0d400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ed5af700 1 -- 172.21.15.81:0/2191581258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0d4003a60 msgr2=0x7fe0d4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ed5af700 1 --2- 172.21.15.81:0/2191581258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0d4003a60 0x7fe0d4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ed5af700 1 -- 172.21.15.81:0/2191581258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d4003570 con 0x7fe0d4004810 2023-10-07T08:52:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ee5b1700 1 --2- 172.21.15.81:0/2191581258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0d40051c0 0x7fe0d400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ee5b1700 1 -- 172.21.15.81:0/2191581258 reap_dead start 2023-10-07T08:52:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ed5af700 1 --2- 172.21.15.81:0/2191581258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d4004810 0x7fe0d4004c80 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8001880 tx=0x7fe0d8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f28787ab78db19 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.586+0000 7fe0ecdae700 1 -- 172.21.15.81:0/2191581258 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8012420 con 0x7fe0d4004810 2023-10-07T08:52:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.587+0000 7fe0ecdae700 1 -- 172.21.15.81:0/2191581258 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d80125a0 con 0x7fe0d4004810 2023-10-07T08:52:12.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.587+0000 7fe0ecdae700 1 -- 172.21.15.81:0/2191581258 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8012960 con 0x7fe0d4004810 2023-10-07T08:52:12.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.587+0000 7fe0f0014700 1 -- 172.21.15.81:0/2191581258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d4004810 msgr2=0x7fe0d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.587+0000 7fe0f0014700 1 --2- 172.21.15.81:0/2191581258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d4004810 0x7fe0d4004c80 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8001880 tx=0x7fe0d8007d30 comp rx=0 tx=0).stop 2023-10-07T08:52:12.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.587+0000 7fe0f0014700 1 -- 172.21.15.81:0/2191581258 shutdown_connections 2023-10-07T08:52:12.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.587+0000 7fe0f0014700 1 --2- 172.21.15.81:0/2191581258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d4004810 0x7fe0d4004c80 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.587+0000 7fe0f0014700 1 -- 172.21.15.81:0/2191581258 >> 172.21.15.81:0/2191581258 conn(0x7fe0e806bb90 msgr2=0x7fe0e806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.587+0000 7fe0f0014700 1 -- 172.21.15.81:0/2191581258 shutdown_connections 2023-10-07T08:52:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.587+0000 7fe0f0014700 1 -- 172.21.15.81:0/2191581258 wait complete. 2023-10-07T08:52:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.588+0000 7fe0f0014700 1 Processor -- start 2023-10-07T08:52:12.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.588+0000 7fe0f0014700 1 -- start start 2023-10-07T08:52:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0f0014700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0d4004810 0x7fe0e8154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0f0014700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e80c7770 0x7fe0e80c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0f0014700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0e815c670 0x7fe0e815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0f0014700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80c9370 con 0x7fe0e80c7770 2023-10-07T08:52:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0f0014700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e815d020 con 0x7fe0d4004810 2023-10-07T08:52:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0f0014700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80c8760 con 0x7fe0e815c670 2023-10-07T08:52:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0ed5af700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e80c7770 0x7fe0e80c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0ed5af700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e80c7770 0x7fe0e80c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55836/0 (socket says 172.21.15.81:55836) 2023-10-07T08:52:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0ed5af700 1 -- 172.21.15.81:0/2649149597 learned_addr learned my addr 172.21.15.81:0/2649149597 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0eddb0700 1 --2- 172.21.15.81:0/2649149597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0d4004810 0x7fe0e8154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0ee5b1700 1 --2- 172.21.15.81:0/2649149597 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0e815c670 0x7fe0e815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0ed5af700 1 -- 172.21.15.81:0/2649149597 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0e815c670 msgr2=0x7fe0e815cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0ed5af700 1 --2- 172.21.15.81:0/2649149597 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0e815c670 0x7fe0e815cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0ed5af700 1 -- 172.21.15.81:0/2649149597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0d4004810 msgr2=0x7fe0e8154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0ed5af700 1 --2- 172.21.15.81:0/2649149597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0d4004810 0x7fe0e8154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0ed5af700 1 -- 172.21.15.81:0/2649149597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e80c8a40 con 0x7fe0e80c7770 2023-10-07T08:52:12.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0ed5af700 1 --2- 172.21.15.81:0/2649149597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e80c7770 0x7fe0e80c7f10 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8001010 tx=0x7fe0d8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:12.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.589+0000 7fe0ddffb700 1 -- 172.21.15.81:0/2649149597 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8001200 con 0x7fe0e80c7770 2023-10-07T08:52:12.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.590+0000 7fe0ddffb700 1 -- 172.21.15.81:0/2649149597 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d8011e00 con 0x7fe0e80c7770 2023-10-07T08:52:12.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.590+0000 7fe0f0014700 1 -- 172.21.15.81:0/2649149597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e80c8d20 con 0x7fe0e80c7770 2023-10-07T08:52:12.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.590+0000 7fe0ddffb700 1 -- 172.21.15.81:0/2649149597 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8012710 con 0x7fe0e80c7770 2023-10-07T08:52:12.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.590+0000 7fe0f0014700 1 -- 172.21.15.81:0/2649149597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e80c8450 con 0x7fe0e80c7770 2023-10-07T08:52:12.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.591+0000 7fe0f0014700 1 -- 172.21.15.81:0/2649149597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e80c9520 con 0x7fe0e80c7770 2023-10-07T08:52:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.591+0000 7fe0ddffb700 1 -- 172.21.15.81:0/2649149597 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0d8019030 con 0x7fe0e80c7770 2023-10-07T08:52:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.591+0000 7fe0ddffb700 1 --2- 172.21.15.81:0/2649149597 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0cc066f30 0x7fe0cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.591+0000 7fe0ddffb700 1 -- 172.21.15.81:0/2649149597 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fe0d808dd90 con 0x7fe0e80c7770 2023-10-07T08:52:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.592+0000 7fe0eddb0700 1 --2- 172.21.15.81:0/2649149597 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0cc066f30 0x7fe0cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.592+0000 7fe0ddffb700 1 -- 172.21.15.81:0/2649149597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7fe0cc06eb10 con 0x7fe0e80c7770 2023-10-07T08:52:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.592+0000 7fe0eddb0700 1 --2- 172.21.15.81:0/2649149597 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0cc066f30 0x7fe0cc0693e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4006f00 tx=0x7fe0e40091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.596+0000 7fe0ddffb700 1 -- 172.21.15.81:0/2649149597 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0e80c9520 con 0x7fe0e80c7770 2023-10-07T08:52:12.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.820+0000 7fe0f0014700 1 -- 172.21.15.81:0/2649149597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe0e80d0450 con 0x7fe0e80c7770 2023-10-07T08:52:12.821 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:52:12.820+0000 7f43c472d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T08:52:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.822+0000 7fe0ddffb700 1 -- 172.21.15.81:0/2649149597 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(161..161 src has 1..161) v4 ==== 366+0+0 (secure 0 0 0) 0x7fe0d805f380 con 0x7fe0e80c7770 2023-10-07T08:52:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.822+0000 7fe0ddffb700 1 -- 172.21.15.81:0/2649149597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=162}) v3 -- 0x7fe0cc06f460 con 0x7fe0e80c7770 2023-10-07T08:52:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.824+0000 7fe0ddffb700 1 -- 172.21.15.81:0/2649149597 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe0d8033070 con 0x7fe0e80c7770 2023-10-07T08:52:12.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.827+0000 7fe0f0014700 1 -- 172.21.15.81:0/2649149597 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0cc066f30 msgr2=0x7fe0cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.827+0000 7fe0f0014700 1 --2- 172.21.15.81:0/2649149597 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0cc066f30 0x7fe0cc0693e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4006f00 tx=0x7fe0e40091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.827+0000 7fe0f0014700 1 -- 172.21.15.81:0/2649149597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e80c7770 msgr2=0x7fe0e80c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.827+0000 7fe0f0014700 1 --2- 172.21.15.81:0/2649149597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e80c7770 0x7fe0e80c7f10 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8001010 tx=0x7fe0d8015000 comp rx=0 tx=0).stop 2023-10-07T08:52:12.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.827+0000 7fe0f0014700 1 -- 172.21.15.81:0/2649149597 shutdown_connections 2023-10-07T08:52:12.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.827+0000 7fe0f0014700 1 --2- 172.21.15.81:0/2649149597 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe0cc066f30 0x7fe0cc0693e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.827+0000 7fe0f0014700 1 --2- 172.21.15.81:0/2649149597 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0e815c670 0x7fe0e815cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.827+0000 7fe0f0014700 1 --2- 172.21.15.81:0/2649149597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0d4004810 0x7fe0e8154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.827+0000 7fe0f0014700 1 --2- 172.21.15.81:0/2649149597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0e80c7770 0x7fe0e80c7f10 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.827+0000 7fe0f0014700 1 -- 172.21.15.81:0/2649149597 >> 172.21.15.81:0/2649149597 conn(0x7fe0e806bb90 msgr2=0x7fe0e8155ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:12.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.827+0000 7fe0f0014700 1 -- 172.21.15.81:0/2649149597 shutdown_connections 2023-10-07T08:52:12.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.827+0000 7fe0f0014700 1 -- 172.21.15.81:0/2649149597 wait complete. 2023-10-07T08:52:12.833 INFO:tasks.ceph.mds.a.smithi081.stderr: -8838> 2023-10-07T08:50:04.297+0000 7f59c6804700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:52:12.833 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T08:52:12.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T08:52:12.859 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-07T08:52:12.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.957+0000 7f89e9048700 1 Processor -- start 2023-10-07T08:52:12.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.957+0000 7f89e9048700 1 -- start start 2023-10-07T08:52:12.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.958+0000 7f89e9048700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89e4157ca0 0x7f89e40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.958+0000 7f89e9048700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e40d07c0 con 0x7f89e41578d0 2023-10-07T08:52:12.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.958+0000 7f89e9048700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e40cfbb0 con 0x7f89e406d120 2023-10-07T08:52:12.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.958+0000 7f89e9048700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e40cfe90 con 0x7f89e4157ca0 2023-10-07T08:52:12.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.958+0000 7f89e259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89e4157ca0 0x7f89e40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.958+0000 7f89e2d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f89e41578d0 0x7f89e415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45260/0 (socket says 172.21.15.81:45260) 2023-10-07T08:52:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.958+0000 7f89e2d9d700 1 -- 172.21.15.81:0/3206430293 learned_addr learned my addr 172.21.15.81:0/3206430293 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.958+0000 7f89e259c700 1 -- 172.21.15.81:0/3206430293 >> v1:172.21.15.89:6789/0 conn(0x7f89e406d120 legacy=0x7f89e406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.958+0000 7f89e259c700 1 -- 172.21.15.81:0/3206430293 >> v1:172.21.15.81:6789/0 conn(0x7f89e41578d0 legacy=0x7f89e415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.958+0000 7f89e259c700 1 -- 172.21.15.81:0/3206430293 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e40d0170 con 0x7f89e4157ca0 2023-10-07T08:52:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.958+0000 7f89e1d9b700 1 -- 172.21.15.81:0/3206430293 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860887248 0 0) 0x7f89e40d07c0 con 0x7f89e41578d0 2023-10-07T08:52:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.958+0000 7f89e259c700 1 --2- 172.21.15.81:0/3206430293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89e4157ca0 0x7f89e40cf4f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f89d80098e0 tx=0x7f89d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69eedaa8d8f164c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.958+0000 7f89e1d9b700 1 -- 172.21.15.81:0/3206430293 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8009e80 con 0x7f89e4157ca0 2023-10-07T08:52:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.958+0000 7f89e1d9b700 1 -- 172.21.15.81:0/3206430293 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d800b860 con 0x7f89e4157ca0 2023-10-07T08:52:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.958+0000 7f89e1d9b700 1 -- 172.21.15.81:0/3206430293 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800bbe0 con 0x7f89e4157ca0 2023-10-07T08:52:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.959+0000 7f89e9048700 1 -- 172.21.15.81:0/3206430293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89e4157ca0 msgr2=0x7f89e40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.959+0000 7f89e9048700 1 --2- 172.21.15.81:0/3206430293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89e4157ca0 0x7f89e40cf4f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f89d80098e0 tx=0x7f89d80091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.959+0000 7f89e9048700 1 -- 172.21.15.81:0/3206430293 shutdown_connections 2023-10-07T08:52:12.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.959+0000 7f89e9048700 1 --2- 172.21.15.81:0/3206430293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89e4157ca0 0x7f89e40cf4f0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.959+0000 7f89e9048700 1 -- 172.21.15.81:0/3206430293 >> 172.21.15.81:0/3206430293 conn(0x7f89e406bb90 msgr2=0x7f89e406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:12.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.959+0000 7f89e9048700 1 -- 172.21.15.81:0/3206430293 shutdown_connections 2023-10-07T08:52:12.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.959+0000 7f89e9048700 1 -- 172.21.15.81:0/3206430293 wait complete. 2023-10-07T08:52:12.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.960+0000 7f89e9048700 1 Processor -- start 2023-10-07T08:52:12.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.960+0000 7f89e9048700 1 -- start start 2023-10-07T08:52:12.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e9048700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e406d120 0x7f89e40af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e9048700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89e41578d0 0x7f89e416dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e9048700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89e4157ca0 0x7f89e416e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e9048700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e41450d0 con 0x7f89e4157ca0 2023-10-07T08:52:12.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e9048700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40b2220 con 0x7f89e406d120 2023-10-07T08:52:12.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e9048700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40b2500 con 0x7f89e41578d0 2023-10-07T08:52:12.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89e4157ca0 0x7f89e416e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89e4157ca0 0x7f89e416e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55858/0 (socket says 172.21.15.81:55858) 2023-10-07T08:52:12.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e359e700 1 -- 172.21.15.81:0/797497752 learned_addr learned my addr 172.21.15.81:0/797497752 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:12.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e259c700 1 --2- 172.21.15.81:0/797497752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89e41578d0 0x7f89e416dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e2d9d700 1 --2- 172.21.15.81:0/797497752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e406d120 0x7f89e40af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e359e700 1 -- 172.21.15.81:0/797497752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89e41578d0 msgr2=0x7f89e416dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e359e700 1 --2- 172.21.15.81:0/797497752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89e41578d0 0x7f89e416dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e359e700 1 -- 172.21.15.81:0/797497752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e406d120 msgr2=0x7f89e40af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:12.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e359e700 1 --2- 172.21.15.81:0/797497752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e406d120 0x7f89e40af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:12.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e359e700 1 -- 172.21.15.81:0/797497752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d8009420 con 0x7f89e4157ca0 2023-10-07T08:52:12.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.961+0000 7f89e359e700 1 --2- 172.21.15.81:0/797497752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89e4157ca0 0x7f89e416e170 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00c8e0 tx=0x7f89dc001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:12.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.962+0000 7f89caffd700 1 -- 172.21.15.81:0/797497752 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc012630 con 0x7f89e4157ca0 2023-10-07T08:52:12.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.962+0000 7f89caffd700 1 -- 172.21.15.81:0/797497752 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc012790 con 0x7f89e4157ca0 2023-10-07T08:52:12.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.962+0000 7f89e9048700 1 -- 172.21.15.81:0/797497752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e416b900 con 0x7f89e4157ca0 2023-10-07T08:52:12.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.962+0000 7f89caffd700 1 -- 172.21.15.81:0/797497752 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc012b50 con 0x7f89e4157ca0 2023-10-07T08:52:12.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.962+0000 7f89e9048700 1 -- 172.21.15.81:0/797497752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e40b14f0 con 0x7f89e4157ca0 2023-10-07T08:52:12.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.962+0000 7f89e9048700 1 -- 172.21.15.81:0/797497752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e416be20 con 0x7f89e4157ca0 2023-10-07T08:52:12.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.963+0000 7f89caffd700 1 -- 172.21.15.81:0/797497752 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89dc01a3a0 con 0x7f89e4157ca0 2023-10-07T08:52:12.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.963+0000 7f89caffd700 1 --2- 172.21.15.81:0/797497752 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89d0066f30 0x7f89d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:12.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.963+0000 7f89caffd700 1 -- 172.21.15.81:0/797497752 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f89dc084780 con 0x7f89e4157ca0 2023-10-07T08:52:12.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.963+0000 7f89e2d9d700 1 --2- 172.21.15.81:0/797497752 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89d0066f30 0x7f89d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:12.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.963+0000 7f89caffd700 1 -- 172.21.15.81:0/797497752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=162}) v3 -- 0x7f89d006ebb0 con 0x7f89e4157ca0 2023-10-07T08:52:12.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.964+0000 7f89e2d9d700 1 --2- 172.21.15.81:0/797497752 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89d0066f30 0x7f89d00693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f89d4007fd0 tx=0x7f89d4007d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:12.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:12.968+0000 7f89caffd700 1 -- 172.21.15.81:0/797497752 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89e416be20 con 0x7f89e4157ca0 2023-10-07T08:52:13.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.189+0000 7f89e9048700 1 -- 172.21.15.81:0/797497752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f89e416be20 con 0x7f89e4157ca0 2023-10-07T08:52:13.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.319+0000 7f89caffd700 1 -- 172.21.15.81:0/797497752 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(162..162 src has 1..162) v4 ==== 671+0+0 (secure 0 0 0) 0x7f89dc055d20 con 0x7f89e4157ca0 2023-10-07T08:52:13.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.319+0000 7f89caffd700 1 -- 172.21.15.81:0/797497752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7f89d006f7e0 con 0x7f89e4157ca0 2023-10-07T08:52:13.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.825+0000 7f89caffd700 1 -- 172.21.15.81:0/797497752 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) v1 ==== 104+0+0 (secure 0 0 0) 0x7f89e416be20 con 0x7f89e4157ca0 2023-10-07T08:52:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.827+0000 7f89e9048700 1 -- 172.21.15.81:0/797497752 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89d0066f30 msgr2=0x7f89d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.827+0000 7f89e9048700 1 --2- 172.21.15.81:0/797497752 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89d0066f30 0x7f89d00693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f89d4007fd0 tx=0x7f89d4007d10 comp rx=0 tx=0).stop 2023-10-07T08:52:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.827+0000 7f89e9048700 1 -- 172.21.15.81:0/797497752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89e4157ca0 msgr2=0x7f89e416e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.827+0000 7f89e9048700 1 --2- 172.21.15.81:0/797497752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89e4157ca0 0x7f89e416e170 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00c8e0 tx=0x7f89dc001710 comp rx=0 tx=0).stop 2023-10-07T08:52:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.827+0000 7f89e9048700 1 -- 172.21.15.81:0/797497752 shutdown_connections 2023-10-07T08:52:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.827+0000 7f89e9048700 1 --2- 172.21.15.81:0/797497752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89e4157ca0 0x7f89e416e170 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.827+0000 7f89e9048700 1 --2- 172.21.15.81:0/797497752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e406d120 0x7f89e40af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.827+0000 7f89e9048700 1 --2- 172.21.15.81:0/797497752 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89d0066f30 0x7f89d00693e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.827+0000 7f89e9048700 1 --2- 172.21.15.81:0/797497752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89e41578d0 0x7f89e416dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:13.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.827+0000 7f89e9048700 1 -- 172.21.15.81:0/797497752 >> 172.21.15.81:0/797497752 conn(0x7f89e406bb90 msgr2=0x7f89e406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:13.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.828+0000 7f89e9048700 1 -- 172.21.15.81:0/797497752 shutdown_connections 2023-10-07T08:52:13.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.828+0000 7f89e9048700 1 -- 172.21.15.81:0/797497752 wait complete. 2023-10-07T08:52:13.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T08:52:13.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.999+0000 7f977efec700 1 Processor -- start 2023-10-07T08:52:13.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:13.999+0000 7f977efec700 1 -- start start 2023-10-07T08:52:14.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977efec700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97780d0b80 0x7f97780cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:14.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977efec700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97780cf2d0 con 0x7f97780d02b0 2023-10-07T08:52:14.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977efec700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977806dc00 con 0x7f977806d700 2023-10-07T08:52:14.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977efec700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977815a690 con 0x7f97780d0b80 2023-10-07T08:52:14.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977dfea700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97780d0b80 0x7f97780cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:14.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977d7e9700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f97780d02b0 0x7f977806cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45270/0 (socket says 172.21.15.81:45270) 2023-10-07T08:52:14.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977d7e9700 1 -- 172.21.15.81:0/2247642608 learned_addr learned my addr 172.21.15.81:0/2247642608 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:14.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977dfea700 1 -- 172.21.15.81:0/2247642608 >> v1:172.21.15.89:6789/0 conn(0x7f977806d700 legacy=0x7f977815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:14.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977cfe8700 1 -- 172.21.15.81:0/2247642608 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735726865 0 0) 0x7f97780cf2d0 con 0x7f97780d02b0 2023-10-07T08:52:14.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977dfea700 1 -- 172.21.15.81:0/2247642608 >> v1:172.21.15.81:6789/0 conn(0x7f97780d02b0 legacy=0x7f977806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:14.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977dfea700 1 -- 172.21.15.81:0/2247642608 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97780cf570 con 0x7f97780d0b80 2023-10-07T08:52:14.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977dfea700 1 --2- 172.21.15.81:0/2247642608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97780d0b80 0x7f97780cfd70 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f9768009e90 tx=0x7f9768009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaecfaf8acf071d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:14.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977cfe8700 1 -- 172.21.15.81:0/2247642608 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976800e070 con 0x7f97780d0b80 2023-10-07T08:52:14.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977cfe8700 1 -- 172.21.15.81:0/2247642608 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976800bbb0 con 0x7f97780d0b80 2023-10-07T08:52:14.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977cfe8700 1 -- 172.21.15.81:0/2247642608 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768012430 con 0x7f97780d0b80 2023-10-07T08:52:14.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977efec700 1 -- 172.21.15.81:0/2247642608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97780d0b80 msgr2=0x7f97780cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977efec700 1 --2- 172.21.15.81:0/2247642608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97780d0b80 0x7f97780cfd70 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f9768009e90 tx=0x7f9768009780 comp rx=0 tx=0).stop 2023-10-07T08:52:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977efec700 1 -- 172.21.15.81:0/2247642608 shutdown_connections 2023-10-07T08:52:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977efec700 1 --2- 172.21.15.81:0/2247642608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97780d0b80 0x7f97780cfd70 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977efec700 1 -- 172.21.15.81:0/2247642608 >> 172.21.15.81:0/2247642608 conn(0x7f9778063230 msgr2=0x7f9778063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977efec700 1 -- 172.21.15.81:0/2247642608 shutdown_connections 2023-10-07T08:52:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.000+0000 7f977efec700 1 -- 172.21.15.81:0/2247642608 wait complete. 2023-10-07T08:52:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.001+0000 7f977efec700 1 Processor -- start 2023-10-07T08:52:14.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.002+0000 7f977efec700 1 -- start start 2023-10-07T08:52:14.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.002+0000 7f977efec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977806d700 0x7f97781431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:14.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.002+0000 7f977efec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97780d02b0 0x7f9778068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:14.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.002+0000 7f977efec700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97780d0b80 0x7f9778068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:14.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.002+0000 7f977efec700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977816b740 con 0x7f977806d700 2023-10-07T08:52:14.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.002+0000 7f977efec700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97780add60 con 0x7f97780d0b80 2023-10-07T08:52:14.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.002+0000 7f977efec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97780ab100 con 0x7f97780d02b0 2023-10-07T08:52:14.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.002+0000 7f977dfea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977806d700 0x7f97781431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:14.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.002+0000 7f977dfea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977806d700 0x7f97781431e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55874/0 (socket says 172.21.15.81:55874) 2023-10-07T08:52:14.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.002+0000 7f977dfea700 1 -- 172.21.15.81:0/1568326213 learned_addr learned my addr 172.21.15.81:0/1568326213 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:14.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.003+0000 7f977dfea700 1 -- 172.21.15.81:0/1568326213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97780d02b0 msgr2=0x7f9778068920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:14.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.003+0000 7f977dfea700 1 --2- 172.21.15.81:0/1568326213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97780d02b0 0x7f9778068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:14.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.003+0000 7f977dfea700 1 -- 172.21.15.81:0/1568326213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97780d0b80 msgr2=0x7f9778068e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:14.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.003+0000 7f977dfea700 1 --2- 172.21.15.81:0/1568326213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97780d0b80 0x7f9778068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:14.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.003+0000 7f977dfea700 1 -- 172.21.15.81:0/1568326213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9768009a20 con 0x7f977806d700 2023-10-07T08:52:14.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.003+0000 7f977dfea700 1 --2- 172.21.15.81:0/1568326213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977806d700 0x7f97781431e0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f97680099f0 tx=0x7f9768018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:14.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.003+0000 7f9775ffb700 1 -- 172.21.15.81:0/1568326213 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768001090 con 0x7f977806d700 2023-10-07T08:52:14.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.003+0000 7f9775ffb700 1 -- 172.21.15.81:0/1568326213 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9768012e60 con 0x7f977806d700 2023-10-07T08:52:14.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.003+0000 7f977efec700 1 -- 172.21.15.81:0/1568326213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97780ab9a0 con 0x7f977806d700 2023-10-07T08:52:14.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.003+0000 7f9775ffb700 1 -- 172.21.15.81:0/1568326213 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976801d890 con 0x7f977806d700 2023-10-07T08:52:14.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.003+0000 7f977efec700 1 -- 172.21.15.81:0/1568326213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97780ab350 con 0x7f977806d700 2023-10-07T08:52:14.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.004+0000 7f977efec700 1 -- 172.21.15.81:0/1568326213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97780676e0 con 0x7f977806d700 2023-10-07T08:52:14.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.004+0000 7f9775ffb700 1 -- 172.21.15.81:0/1568326213 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9768024070 con 0x7f977806d700 2023-10-07T08:52:14.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.006+0000 7f9775ffb700 1 --2- 172.21.15.81:0/1568326213 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9764066f30 0x7f97640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:14.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.006+0000 7f9775ffb700 1 -- 172.21.15.81:0/1568326213 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f9768086dd0 con 0x7f977806d700 2023-10-07T08:52:14.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.006+0000 7f977d7e9700 1 --2- 172.21.15.81:0/1568326213 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9764066f30 0x7f97640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:14.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.006+0000 7f977d7e9700 1 --2- 172.21.15.81:0/1568326213 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9764066f30 0x7f97640693e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f976c0011e0 tx=0x7f976c0079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:14.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.010+0000 7f9775ffb700 1 -- 172.21.15.81:0/1568326213 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9768053fb0 con 0x7f977806d700 2023-10-07T08:52:14.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.192+0000 7f977efec700 1 -- 172.21.15.81:0/1568326213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9778071b10 con 0x7f977806d700 2023-10-07T08:52:14.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.833+0000 7f9775ffb700 1 -- 172.21.15.81:0/1568326213 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v163) v1 ==== 181+0+0 (secure 0 0 0) 0x7f97680575d0 con 0x7f977806d700 2023-10-07T08:52:14.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.837+0000 7f977efec700 1 -- 172.21.15.81:0/1568326213 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9764066f30 msgr2=0x7f97640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:14.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.837+0000 7f977efec700 1 --2- 172.21.15.81:0/1568326213 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9764066f30 0x7f97640693e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f976c0011e0 tx=0x7f976c0079d0 comp rx=0 tx=0).stop 2023-10-07T08:52:14.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.837+0000 7f977efec700 1 -- 172.21.15.81:0/1568326213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977806d700 msgr2=0x7f97781431e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:14.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.837+0000 7f977efec700 1 --2- 172.21.15.81:0/1568326213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977806d700 0x7f97781431e0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f97680099f0 tx=0x7f9768018000 comp rx=0 tx=0).stop 2023-10-07T08:52:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.838+0000 7f977efec700 1 -- 172.21.15.81:0/1568326213 shutdown_connections 2023-10-07T08:52:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.838+0000 7f977efec700 1 --2- 172.21.15.81:0/1568326213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97780d0b80 0x7f9778068e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.838+0000 7f977efec700 1 --2- 172.21.15.81:0/1568326213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f977806d700 0x7f97781431e0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.838+0000 7f977efec700 1 --2- 172.21.15.81:0/1568326213 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9764066f30 0x7f97640693e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.838+0000 7f977efec700 1 --2- 172.21.15.81:0/1568326213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97780d02b0 0x7f9778068920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.838+0000 7f977efec700 1 -- 172.21.15.81:0/1568326213 >> 172.21.15.81:0/1568326213 conn(0x7f9778063230 msgr2=0x7f977815a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:14.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.838+0000 7f977efec700 1 -- 172.21.15.81:0/1568326213 shutdown_connections 2023-10-07T08:52:14.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.838+0000 7f977efec700 1 -- 172.21.15.81:0/1568326213 wait complete. 2023-10-07T08:52:14.841 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-07T08:52:14.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T08:52:14.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.971+0000 7fe95d480700 1 Processor -- start 2023-10-07T08:52:14.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.971+0000 7fe95d480700 1 -- start start 2023-10-07T08:52:14.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.972+0000 7fe95d480700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9580d0f50 0x7fe95806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:14.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.972+0000 7fe95d480700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe95806d530 0x7fe95815b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:14.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.972+0000 7fe95d480700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95806d990 con 0x7fe9580d0b80 2023-10-07T08:52:14.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.972+0000 7fe95d480700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95815a690 con 0x7fe9580d0f50 2023-10-07T08:52:14.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.972+0000 7fe95d480700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9580cf2d0 con 0x7fe95806d530 2023-10-07T08:52:14.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.972+0000 7fe9577fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9580d0f50 0x7fe95806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:14.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.972+0000 7fe9577fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9580d0f50 0x7fe95806cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55888/0 (socket says 172.21.15.81:55888) 2023-10-07T08:52:14.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.972+0000 7fe9577fe700 1 -- 172.21.15.81:0/2671360744 learned_addr learned my addr 172.21.15.81:0/2671360744 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:14.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.972+0000 7fe9577fe700 1 -- 172.21.15.81:0/2671360744 >> v2:172.21.15.89:3300/0 conn(0x7fe95806d530 msgr2=0x7fe95815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:14.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.972+0000 7fe9577fe700 1 --2- 172.21.15.81:0/2671360744 >> v2:172.21.15.89:3300/0 conn(0x7fe95806d530 0x7fe95815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:14.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.972+0000 7fe9577fe700 1 -- 172.21.15.81:0/2671360744 >> v1:172.21.15.89:6789/0 conn(0x7fe9580d0b80 legacy=0x7fe9580cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:14.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.972+0000 7fe9577fe700 1 -- 172.21.15.81:0/2671360744 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9580d0480 con 0x7fe9580d0f50 2023-10-07T08:52:14.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.972+0000 7fe9577fe700 1 --2- 172.21.15.81:0/2671360744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9580d0f50 0x7fe95806cff0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fe9580ce9b0 tx=0x7fe94c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62c1db4bbf6fd60 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:14.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.973+0000 7fe956ffd700 1 -- 172.21.15.81:0/2671360744 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c00b820 con 0x7fe9580d0f50 2023-10-07T08:52:14.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.973+0000 7fe956ffd700 1 -- 172.21.15.81:0/2671360744 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c00b980 con 0x7fe9580d0f50 2023-10-07T08:52:14.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.973+0000 7fe956ffd700 1 -- 172.21.15.81:0/2671360744 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c00bd20 con 0x7fe9580d0f50 2023-10-07T08:52:14.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.973+0000 7fe95d480700 1 -- 172.21.15.81:0/2671360744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9580d0f50 msgr2=0x7fe95806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:14.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.973+0000 7fe95d480700 1 --2- 172.21.15.81:0/2671360744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9580d0f50 0x7fe95806cff0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fe9580ce9b0 tx=0x7fe94c009250 comp rx=0 tx=0).stop 2023-10-07T08:52:14.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.973+0000 7fe95d480700 1 -- 172.21.15.81:0/2671360744 shutdown_connections 2023-10-07T08:52:14.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.973+0000 7fe95d480700 1 --2- 172.21.15.81:0/2671360744 >> v2:172.21.15.89:3300/0 conn(0x7fe95806d530 0x7fe95815b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:14.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.973+0000 7fe95d480700 1 --2- 172.21.15.81:0/2671360744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9580d0f50 0x7fe95806cff0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:14.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.973+0000 7fe95d480700 1 -- 172.21.15.81:0/2671360744 >> 172.21.15.81:0/2671360744 conn(0x7fe958063230 msgr2=0x7fe958063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:14.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.973+0000 7fe95d480700 1 -- 172.21.15.81:0/2671360744 shutdown_connections 2023-10-07T08:52:14.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.973+0000 7fe95d480700 1 -- 172.21.15.81:0/2671360744 wait complete. 2023-10-07T08:52:14.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.974+0000 7fe95d480700 1 Processor -- start 2023-10-07T08:52:14.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.974+0000 7fe95d480700 1 -- start start 2023-10-07T08:52:14.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.975+0000 7fe95d480700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95806d530 0x7fe9580c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:14.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.975+0000 7fe95d480700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9580d0b80 0x7fe9580c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:14.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.975+0000 7fe95d480700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9580d0f50 0x7fe95816d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:14.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.975+0000 7fe95d480700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9580c8540 con 0x7fe9580d0b80 2023-10-07T08:52:14.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.975+0000 7fe95d480700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9580c6c20 con 0x7fe95806d530 2023-10-07T08:52:14.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.975+0000 7fe95d480700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9580c6f00 con 0x7fe9580d0f50 2023-10-07T08:52:14.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.975+0000 7fe9577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9580d0b80 0x7fe9580c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:14.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.975+0000 7fe9577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9580d0b80 0x7fe9580c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55902/0 (socket says 172.21.15.81:55902) 2023-10-07T08:52:14.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.975+0000 7fe9577fe700 1 -- 172.21.15.81:0/1389126407 learned_addr learned my addr 172.21.15.81:0/1389126407 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:14.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.975+0000 7fe957fff700 1 --2- 172.21.15.81:0/1389126407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95806d530 0x7fe9580c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:14.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.975+0000 7fe95cc7f700 1 --2- 172.21.15.81:0/1389126407 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9580d0f50 0x7fe95816d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:14.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.975+0000 7fe9577fe700 1 -- 172.21.15.81:0/1389126407 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9580d0f50 msgr2=0x7fe95816d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:14.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.975+0000 7fe9577fe700 1 --2- 172.21.15.81:0/1389126407 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9580d0f50 0x7fe95816d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:14.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.975+0000 7fe9577fe700 1 -- 172.21.15.81:0/1389126407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95806d530 msgr2=0x7fe9580c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:14.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.975+0000 7fe9577fe700 1 --2- 172.21.15.81:0/1389126407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95806d530 0x7fe9580c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:14.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.975+0000 7fe9577fe700 1 -- 172.21.15.81:0/1389126407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c0094f0 con 0x7fe9580d0b80 2023-10-07T08:52:14.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.976+0000 7fe957fff700 1 --2- 172.21.15.81:0/1389126407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95806d530 0x7fe9580c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:14.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.976+0000 7fe9577fe700 1 --2- 172.21.15.81:0/1389126407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9580d0b80 0x7fe9580c6160 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009290 tx=0x7fe94c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:14.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.976+0000 7fe93ffff700 1 -- 172.21.15.81:0/1389126407 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c026480 con 0x7fe9580d0b80 2023-10-07T08:52:14.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.976+0000 7fe93ffff700 1 -- 172.21.15.81:0/1389126407 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c01f070 con 0x7fe9580d0b80 2023-10-07T08:52:14.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.976+0000 7fe95d480700 1 -- 172.21.15.81:0/1389126407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9580c71e0 con 0x7fe9580d0b80 2023-10-07T08:52:14.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.976+0000 7fe93ffff700 1 -- 172.21.15.81:0/1389126407 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c026850 con 0x7fe9580d0b80 2023-10-07T08:52:14.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.976+0000 7fe95d480700 1 -- 172.21.15.81:0/1389126407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9580c77a0 con 0x7fe9580d0b80 2023-10-07T08:52:14.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.977+0000 7fe95d480700 1 -- 172.21.15.81:0/1389126407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9580676e0 con 0x7fe9580d0b80 2023-10-07T08:52:14.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.977+0000 7fe93ffff700 1 -- 172.21.15.81:0/1389126407 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe94c01a440 con 0x7fe9580d0b80 2023-10-07T08:52:14.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.978+0000 7fe93ffff700 1 --2- 172.21.15.81:0/1389126407 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe944066f30 0x7fe9440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:14.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.978+0000 7fe957fff700 1 --2- 172.21.15.81:0/1389126407 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe944066f30 0x7fe9440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:14.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.978+0000 7fe93ffff700 1 -- 172.21.15.81:0/1389126407 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5411+0+0 (secure 0 0 0) 0x7fe94c021070 con 0x7fe9580d0b80 2023-10-07T08:52:14.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.978+0000 7fe957fff700 1 --2- 172.21.15.81:0/1389126407 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe944066f30 0x7fe9440693e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe948009a80 tx=0x7fe948008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:14.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:14.982+0000 7fe93ffff700 1 -- 172.21.15.81:0/1389126407 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe94c053d40 con 0x7fe9580d0b80 2023-10-07T08:52:15.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.166+0000 7fe95d480700 1 -- 172.21.15.81:0/1389126407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe95806dc00 con 0x7fe9580d0b80 2023-10-07T08:52:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.833+0000 7fe93ffff700 1 -- 172.21.15.81:0/1389126407 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v164) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe94c02b020 con 0x7fe9580d0b80 2023-10-07T08:52:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.836+0000 7fe95d480700 1 -- 172.21.15.81:0/1389126407 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe944066f30 msgr2=0x7fe9440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.836+0000 7fe95d480700 1 --2- 172.21.15.81:0/1389126407 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe944066f30 0x7fe9440693e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe948009a80 tx=0x7fe948008040 comp rx=0 tx=0).stop 2023-10-07T08:52:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.836+0000 7fe95d480700 1 -- 172.21.15.81:0/1389126407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9580d0b80 msgr2=0x7fe9580c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.836+0000 7fe95d480700 1 --2- 172.21.15.81:0/1389126407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9580d0b80 0x7fe9580c6160 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009290 tx=0x7fe94c016000 comp rx=0 tx=0).stop 2023-10-07T08:52:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.836+0000 7fe95d480700 1 -- 172.21.15.81:0/1389126407 shutdown_connections 2023-10-07T08:52:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.836+0000 7fe95d480700 1 --2- 172.21.15.81:0/1389126407 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe944066f30 0x7fe9440693e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.836+0000 7fe95d480700 1 --2- 172.21.15.81:0/1389126407 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9580d0f50 0x7fe95816d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.836+0000 7fe95d480700 1 --2- 172.21.15.81:0/1389126407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe95806d530 0x7fe9580c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.836+0000 7fe95d480700 1 --2- 172.21.15.81:0/1389126407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9580d0b80 0x7fe9580c6160 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.836+0000 7fe95d480700 1 -- 172.21.15.81:0/1389126407 >> 172.21.15.81:0/1389126407 conn(0x7fe958063230 msgr2=0x7fe958069130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.836+0000 7fe95d480700 1 -- 172.21.15.81:0/1389126407 shutdown_connections 2023-10-07T08:52:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.836+0000 7fe95d480700 1 -- 172.21.15.81:0/1389126407 wait complete. 2023-10-07T08:52:15.841 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-07T08:52:15.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T08:52:15.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.966+0000 7fe349e56700 1 Processor -- start 2023-10-07T08:52:15.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.966+0000 7fe349e56700 1 -- start start 2023-10-07T08:52:15.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.967+0000 7fe349e56700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe3441578d0 0x7fe3440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:15.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.967+0000 7fe349e56700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3440d07c0 con 0x7fe34406d120 2023-10-07T08:52:15.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.967+0000 7fe349e56700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3440cfbb0 con 0x7fe344157ca0 2023-10-07T08:52:15.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.967+0000 7fe349e56700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3440cfe90 con 0x7fe3441578d0 2023-10-07T08:52:15.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.967+0000 7fe343fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe34406d120 0x7fe34406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45278/0 (socket says 172.21.15.81:45278) 2023-10-07T08:52:15.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.967+0000 7fe343fff700 1 -- 172.21.15.81:0/2114548685 learned_addr learned my addr 172.21.15.81:0/2114548685 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:15.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.967+0000 7fe3427fc700 1 -- 172.21.15.81:0/2114548685 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705039494 0 0) 0x7fe3440d07c0 con 0x7fe34406d120 2023-10-07T08:52:15.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.967+0000 7fe3427fc700 1 -- 172.21.15.81:0/2114548685 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe32c003570 con 0x7fe34406d120 2023-10-07T08:52:15.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3437fe700 1 --2- 172.21.15.81:0/2114548685 >> v2:172.21.15.89:3300/0 conn(0x7fe3441578d0 0x7fe3440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:15.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3427fc700 1 -- 172.21.15.81:0/2114548685 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2889297469 0 0) 0x7fe32c003570 con 0x7fe34406d120 2023-10-07T08:52:15.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3427fc700 1 -- 172.21.15.81:0/2114548685 >> v2:172.21.15.89:3300/0 conn(0x7fe3441578d0 msgr2=0x7fe3440cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:15.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3427fc700 1 --2- 172.21.15.81:0/2114548685 >> v2:172.21.15.89:3300/0 conn(0x7fe3441578d0 0x7fe3440cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:15.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3427fc700 1 -- 172.21.15.81:0/2114548685 >> v1:172.21.15.89:6789/0 conn(0x7fe344157ca0 legacy=0x7fe34415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:15.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3427fc700 1 -- 172.21.15.81:0/2114548685 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3440d0170 con 0x7fe34406d120 2023-10-07T08:52:15.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3427fc700 1 -- 172.21.15.81:0/2114548685 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fe33c001470 con 0x7fe34406d120 2023-10-07T08:52:15.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3427fc700 1 -- 172.21.15.81:0/2114548685 >> v1:172.21.15.81:6789/0 conn(0x7fe34406d120 legacy=0x7fe34406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:15.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3427fc700 1 --2- 172.21.15.81:0/2114548685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe32c003a60 0x7fe32c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:15.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3427fc700 1 --2- 172.21.15.81:0/2114548685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe32c004810 0x7fe32c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:15.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3427fc700 1 --2- 172.21.15.81:0/2114548685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe32c0051c0 0x7fe32c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:15.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3427fc700 1 -- 172.21.15.81:0/2114548685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3440cfe90 con 0x7fe32c003a60 2023-10-07T08:52:15.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3427fc700 1 -- 172.21.15.81:0/2114548685 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c00c0d0 con 0x7fe32c0051c0 2023-10-07T08:52:15.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3427fc700 1 -- 172.21.15.81:0/2114548685 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c00c290 con 0x7fe32c004810 2023-10-07T08:52:15.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3437fe700 1 --2- 172.21.15.81:0/2114548685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe32c003a60 0x7fe32c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:15.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe343fff700 1 --2- 172.21.15.81:0/2114548685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe32c0051c0 0x7fe32c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:15.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe342ffd700 1 --2- 172.21.15.81:0/2114548685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe32c004810 0x7fe32c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:15.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3437fe700 1 -- 172.21.15.81:0/2114548685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe32c004810 msgr2=0x7fe32c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3437fe700 1 --2- 172.21.15.81:0/2114548685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe32c004810 0x7fe32c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3437fe700 1 -- 172.21.15.81:0/2114548685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe32c0051c0 msgr2=0x7fe32c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3437fe700 1 --2- 172.21.15.81:0/2114548685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe32c0051c0 0x7fe32c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe343fff700 1 -- 172.21.15.81:0/2114548685 reap_dead start 2023-10-07T08:52:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3437fe700 1 -- 172.21.15.81:0/2114548685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c003570 con 0x7fe32c003a60 2023-10-07T08:52:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe342ffd700 1 --2- 172.21.15.81:0/2114548685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe32c004810 0x7fe32c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:15.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3437fe700 1 --2- 172.21.15.81:0/2114548685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe32c003a60 0x7fe32c003e70 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fe33400e210 tx=0x7fe33400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822cc19308007e90 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:15.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.968+0000 7fe3427fc700 1 -- 172.21.15.81:0/2114548685 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33400eac0 con 0x7fe32c003a60 2023-10-07T08:52:15.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.969+0000 7fe3427fc700 1 -- 172.21.15.81:0/2114548685 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33400f040 con 0x7fe32c003a60 2023-10-07T08:52:15.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.969+0000 7fe3427fc700 1 -- 172.21.15.81:0/2114548685 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33400ee70 con 0x7fe32c003a60 2023-10-07T08:52:15.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.969+0000 7fe349e56700 1 -- 172.21.15.81:0/2114548685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe32c003a60 msgr2=0x7fe32c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.969+0000 7fe349e56700 1 --2- 172.21.15.81:0/2114548685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe32c003a60 0x7fe32c003e70 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fe33400e210 tx=0x7fe33400b040 comp rx=0 tx=0).stop 2023-10-07T08:52:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.969+0000 7fe349e56700 1 -- 172.21.15.81:0/2114548685 shutdown_connections 2023-10-07T08:52:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.969+0000 7fe349e56700 1 --2- 172.21.15.81:0/2114548685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe32c003a60 0x7fe32c003e70 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.969+0000 7fe349e56700 1 -- 172.21.15.81:0/2114548685 >> 172.21.15.81:0/2114548685 conn(0x7fe34406bb90 msgr2=0x7fe34406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.969+0000 7fe349e56700 1 -- 172.21.15.81:0/2114548685 shutdown_connections 2023-10-07T08:52:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.969+0000 7fe349e56700 1 -- 172.21.15.81:0/2114548685 wait complete. 2023-10-07T08:52:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.970+0000 7fe349e56700 1 Processor -- start 2023-10-07T08:52:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.970+0000 7fe349e56700 1 -- start start 2023-10-07T08:52:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.971+0000 7fe349e56700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe32c003a60 0x7fe344143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:15.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.971+0000 7fe349e56700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe34416d170 0x7fe34416b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:15.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.971+0000 7fe349e56700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe34416bbd0 0x7fe344168160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:15.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.971+0000 7fe349e56700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34416cce0 con 0x7fe34416d170 2023-10-07T08:52:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.971+0000 7fe349e56700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34416c0d0 con 0x7fe34416bbd0 2023-10-07T08:52:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.971+0000 7fe349e56700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34416c3b0 con 0x7fe32c003a60 2023-10-07T08:52:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.971+0000 7fe342ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe34416d170 0x7fe34416b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.971+0000 7fe342ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe34416d170 0x7fe34416b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55914/0 (socket says 172.21.15.81:55914) 2023-10-07T08:52:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.971+0000 7fe342ffd700 1 -- 172.21.15.81:0/1765755350 learned_addr learned my addr 172.21.15.81:0/1765755350 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.971+0000 7fe343fff700 1 --2- 172.21.15.81:0/1765755350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe34416bbd0 0x7fe344168160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.971+0000 7fe3437fe700 1 --2- 172.21.15.81:0/1765755350 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe32c003a60 0x7fe344143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.972+0000 7fe342ffd700 1 -- 172.21.15.81:0/1765755350 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe32c003a60 msgr2=0x7fe344143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.972+0000 7fe342ffd700 1 --2- 172.21.15.81:0/1765755350 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe32c003a60 0x7fe344143760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.972+0000 7fe342ffd700 1 -- 172.21.15.81:0/1765755350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe34416bbd0 msgr2=0x7fe344168160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.972+0000 7fe342ffd700 1 --2- 172.21.15.81:0/1765755350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe34416bbd0 0x7fe344168160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.972+0000 7fe342ffd700 1 -- 172.21.15.81:0/1765755350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34416c690 con 0x7fe34416d170 2023-10-07T08:52:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.972+0000 7fe342ffd700 1 --2- 172.21.15.81:0/1765755350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe34416d170 0x7fe34416b690 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fe338001eb0 tx=0x7fe338009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:15.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.972+0000 7fe32b7fe700 1 -- 172.21.15.81:0/1765755350 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3380114f0 con 0x7fe34416d170 2023-10-07T08:52:15.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.972+0000 7fe32b7fe700 1 -- 172.21.15.81:0/1765755350 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe338011650 con 0x7fe34416d170 2023-10-07T08:52:15.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.972+0000 7fe349e56700 1 -- 172.21.15.81:0/1765755350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34416c970 con 0x7fe34416d170 2023-10-07T08:52:15.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.972+0000 7fe32b7fe700 1 -- 172.21.15.81:0/1765755350 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe338011a10 con 0x7fe34416d170 2023-10-07T08:52:15.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.972+0000 7fe349e56700 1 -- 172.21.15.81:0/1765755350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3441550e0 con 0x7fe34416d170 2023-10-07T08:52:15.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.973+0000 7fe349e56700 1 -- 172.21.15.81:0/1765755350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe344067ac0 con 0x7fe34416d170 2023-10-07T08:52:15.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.973+0000 7fe32b7fe700 1 -- 172.21.15.81:0/1765755350 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe338014480 con 0x7fe34416d170 2023-10-07T08:52:15.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.973+0000 7fe32b7fe700 1 --2- 172.21.15.81:0/1765755350 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe330066f30 0x7fe3300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:15.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.974+0000 7fe32b7fe700 1 -- 172.21.15.81:0/1765755350 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe338083a10 con 0x7fe34416d170 2023-10-07T08:52:15.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.974+0000 7fe3437fe700 1 --2- 172.21.15.81:0/1765755350 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe330066f30 0x7fe3300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:15.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.974+0000 7fe3437fe700 1 --2- 172.21.15.81:0/1765755350 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe330066f30 0x7fe3300693e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe33400afd0 tx=0x7fe33401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:15.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:15.979+0000 7fe32b7fe700 1 -- 172.21.15.81:0/1765755350 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe33804d5a0 con 0x7fe34416d170 2023-10-07T08:52:16.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.160+0000 7fe349e56700 1 -- 172.21.15.81:0/1765755350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe3440d0450 con 0x7fe34416d170 2023-10-07T08:52:16.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.163+0000 7fe32b7fe700 1 -- 172.21.15.81:0/1765755350 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe3380190a0 con 0x7fe34416d170 2023-10-07T08:52:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.165+0000 7fe349e56700 1 -- 172.21.15.81:0/1765755350 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe330066f30 msgr2=0x7fe3300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.165+0000 7fe349e56700 1 --2- 172.21.15.81:0/1765755350 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe330066f30 0x7fe3300693e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe33400afd0 tx=0x7fe33401a000 comp rx=0 tx=0).stop 2023-10-07T08:52:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.165+0000 7fe349e56700 1 -- 172.21.15.81:0/1765755350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe34416d170 msgr2=0x7fe34416b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.165+0000 7fe349e56700 1 --2- 172.21.15.81:0/1765755350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe34416d170 0x7fe34416b690 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fe338001eb0 tx=0x7fe338009040 comp rx=0 tx=0).stop 2023-10-07T08:52:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.165+0000 7fe349e56700 1 -- 172.21.15.81:0/1765755350 shutdown_connections 2023-10-07T08:52:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.165+0000 7fe349e56700 1 --2- 172.21.15.81:0/1765755350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe34416bbd0 0x7fe344168160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.165+0000 7fe349e56700 1 --2- 172.21.15.81:0/1765755350 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe330066f30 0x7fe3300693e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.165+0000 7fe349e56700 1 --2- 172.21.15.81:0/1765755350 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe32c003a60 0x7fe344143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.165+0000 7fe349e56700 1 --2- 172.21.15.81:0/1765755350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe34416d170 0x7fe34416b690 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.165+0000 7fe349e56700 1 -- 172.21.15.81:0/1765755350 >> 172.21.15.81:0/1765755350 conn(0x7fe34406bb90 msgr2=0x7fe344155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:16.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.165+0000 7fe349e56700 1 -- 172.21.15.81:0/1765755350 shutdown_connections 2023-10-07T08:52:16.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.165+0000 7fe349e56700 1 -- 172.21.15.81:0/1765755350 wait complete. 2023-10-07T08:52:16.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-10-07T08:52:16.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.291+0000 7f0e57fe7700 1 Processor -- start 2023-10-07T08:52:16.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.291+0000 7f0e57fe7700 1 -- start start 2023-10-07T08:52:16.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.292+0000 7f0e57fe7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0e501578d0 0x7f0e500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:16.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.292+0000 7f0e57fe7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e500d07c0 con 0x7f0e50157ca0 2023-10-07T08:52:16.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.292+0000 7f0e57fe7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e500cfbb0 con 0x7f0e5006d120 2023-10-07T08:52:16.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.292+0000 7f0e57fe7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e500cfe90 con 0x7f0e501578d0 2023-10-07T08:52:16.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.292+0000 7f0e55582700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0e50157ca0 0x7f0e5015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45286/0 (socket says 172.21.15.81:45286) 2023-10-07T08:52:16.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.292+0000 7f0e55582700 1 -- 172.21.15.81:0/246318135 learned_addr learned my addr 172.21.15.81:0/246318135 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:16.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.292+0000 7f0e55d83700 1 --2- 172.21.15.81:0/246318135 >> v2:172.21.15.89:3300/0 conn(0x7f0e501578d0 0x7f0e500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:16.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.292+0000 7f0e54d81700 1 -- 172.21.15.81:0/246318135 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423461203 0 0) 0x7f0e500d07c0 con 0x7f0e50157ca0 2023-10-07T08:52:16.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.292+0000 7f0e54d81700 1 -- 172.21.15.81:0/246318135 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e38003570 con 0x7f0e50157ca0 2023-10-07T08:52:16.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.292+0000 7f0e54d81700 1 -- 172.21.15.81:0/246318135 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1424854628 0 0) 0x7f0e38003570 con 0x7f0e50157ca0 2023-10-07T08:52:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.292+0000 7f0e54d81700 1 -- 172.21.15.81:0/246318135 >> v2:172.21.15.89:3300/0 conn(0x7f0e501578d0 msgr2=0x7f0e500cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.292+0000 7f0e54d81700 1 --2- 172.21.15.81:0/246318135 >> v2:172.21.15.89:3300/0 conn(0x7f0e501578d0 0x7f0e500cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.292+0000 7f0e54d81700 1 -- 172.21.15.81:0/246318135 >> v1:172.21.15.89:6789/0 conn(0x7f0e5006d120 legacy=0x7f0e5006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.292+0000 7f0e54d81700 1 -- 172.21.15.81:0/246318135 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e500d0170 con 0x7f0e50157ca0 2023-10-07T08:52:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.292+0000 7f0e54d81700 1 -- 172.21.15.81:0/246318135 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f0e44001470 con 0x7f0e50157ca0 2023-10-07T08:52:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e54d81700 1 -- 172.21.15.81:0/246318135 >> v1:172.21.15.81:6789/0 conn(0x7f0e50157ca0 legacy=0x7f0e5015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e54d81700 1 --2- 172.21.15.81:0/246318135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38003a60 0x7f0e38003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e54d81700 1 --2- 172.21.15.81:0/246318135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e38004810 0x7f0e38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e54d81700 1 --2- 172.21.15.81:0/246318135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e380051c0 0x7f0e3800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e54d81700 1 -- 172.21.15.81:0/246318135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e500cfe90 con 0x7f0e38003a60 2023-10-07T08:52:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e54d81700 1 -- 172.21.15.81:0/246318135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3800c0d0 con 0x7f0e380051c0 2023-10-07T08:52:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e54d81700 1 -- 172.21.15.81:0/246318135 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3800c290 con 0x7f0e38004810 2023-10-07T08:52:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e55d83700 1 --2- 172.21.15.81:0/246318135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38003a60 0x7f0e38003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e56584700 1 --2- 172.21.15.81:0/246318135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e380051c0 0x7f0e3800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e55582700 1 --2- 172.21.15.81:0/246318135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e38004810 0x7f0e38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e55d83700 1 -- 172.21.15.81:0/246318135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e38004810 msgr2=0x7f0e38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e55d83700 1 --2- 172.21.15.81:0/246318135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e38004810 0x7f0e38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e55d83700 1 -- 172.21.15.81:0/246318135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e380051c0 msgr2=0x7f0e3800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e55d83700 1 --2- 172.21.15.81:0/246318135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e380051c0 0x7f0e3800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e55d83700 1 -- 172.21.15.81:0/246318135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e38003570 con 0x7f0e38003a60 2023-10-07T08:52:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e55582700 1 --2- 172.21.15.81:0/246318135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e38004810 0x7f0e38004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e56584700 1 --2- 172.21.15.81:0/246318135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e380051c0 0x7f0e3800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:16.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e56584700 1 -- 172.21.15.81:0/246318135 reap_dead start 2023-10-07T08:52:16.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e55d83700 1 --2- 172.21.15.81:0/246318135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38003a60 0x7f0e38003e70 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800e210 tx=0x7f0e4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b938b2820dbeeac2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:16.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e54d81700 1 -- 172.21.15.81:0/246318135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4800eac0 con 0x7f0e38003a60 2023-10-07T08:52:16.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e54d81700 1 -- 172.21.15.81:0/246318135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4800f040 con 0x7f0e38003a60 2023-10-07T08:52:16.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.293+0000 7f0e54d81700 1 -- 172.21.15.81:0/246318135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4800ee70 con 0x7f0e38003a60 2023-10-07T08:52:16.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.294+0000 7f0e57fe7700 1 -- 172.21.15.81:0/246318135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38003a60 msgr2=0x7f0e38003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:16.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.294+0000 7f0e57fe7700 1 --2- 172.21.15.81:0/246318135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38003a60 0x7f0e38003e70 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800e210 tx=0x7f0e4800b040 comp rx=0 tx=0).stop 2023-10-07T08:52:16.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.294+0000 7f0e57fe7700 1 -- 172.21.15.81:0/246318135 shutdown_connections 2023-10-07T08:52:16.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.294+0000 7f0e57fe7700 1 --2- 172.21.15.81:0/246318135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38003a60 0x7f0e38003e70 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.294+0000 7f0e57fe7700 1 -- 172.21.15.81:0/246318135 >> 172.21.15.81:0/246318135 conn(0x7f0e5006bb90 msgr2=0x7f0e5006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:16.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.294+0000 7f0e57fe7700 1 -- 172.21.15.81:0/246318135 shutdown_connections 2023-10-07T08:52:16.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.294+0000 7f0e57fe7700 1 -- 172.21.15.81:0/246318135 wait complete. 2023-10-07T08:52:16.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.295+0000 7f0e57fe7700 1 Processor -- start 2023-10-07T08:52:16.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.295+0000 7f0e57fe7700 1 -- start start 2023-10-07T08:52:16.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e57fe7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38003a60 0x7f0e500c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:16.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e57fe7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e500b6870 0x7f0e501446b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:16.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e57fe7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e50069ac0 0x7f0e50069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:16.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e57fe7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5006a460 con 0x7f0e38003a60 2023-10-07T08:52:16.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e57fe7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e500b63e0 con 0x7f0e50069ac0 2023-10-07T08:52:16.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e57fe7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e500c77b0 con 0x7f0e500b6870 2023-10-07T08:52:16.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e55d83700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38003a60 0x7f0e500c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:16.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e55d83700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38003a60 0x7f0e500c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55922/0 (socket says 172.21.15.81:55922) 2023-10-07T08:52:16.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e55d83700 1 -- 172.21.15.81:0/2679939442 learned_addr learned my addr 172.21.15.81:0/2679939442 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:16.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e56584700 1 --2- 172.21.15.81:0/2679939442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e50069ac0 0x7f0e50069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:16.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e55582700 1 --2- 172.21.15.81:0/2679939442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e500b6870 0x7f0e501446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:16.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e55d83700 1 -- 172.21.15.81:0/2679939442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e500b6870 msgr2=0x7f0e501446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:16.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e55d83700 1 --2- 172.21.15.81:0/2679939442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e500b6870 0x7f0e501446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e55d83700 1 -- 172.21.15.81:0/2679939442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e50069ac0 msgr2=0x7f0e50069f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:16.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e55d83700 1 --2- 172.21.15.81:0/2679939442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e50069ac0 0x7f0e50069f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e55d83700 1 -- 172.21.15.81:0/2679939442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e500b57d0 con 0x7f0e38003a60 2023-10-07T08:52:16.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e55582700 1 --2- 172.21.15.81:0/2679939442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e500b6870 0x7f0e501446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:16.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e56584700 1 --2- 172.21.15.81:0/2679939442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e50069ac0 0x7f0e50069f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:16.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e55d83700 1 --2- 172.21.15.81:0/2679939442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38003a60 0x7f0e500c7270 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800e800 tx=0x7f0e4801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:16.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e4dffb700 1 -- 172.21.15.81:0/2679939442 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4801d420 con 0x7f0e38003a60 2023-10-07T08:52:16.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e4dffb700 1 -- 172.21.15.81:0/2679939442 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4801d5a0 con 0x7f0e38003a60 2023-10-07T08:52:16.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e57fe7700 1 -- 172.21.15.81:0/2679939442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e500b5ab0 con 0x7f0e38003a60 2023-10-07T08:52:16.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.296+0000 7f0e4dffb700 1 -- 172.21.15.81:0/2679939442 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4801d9a0 con 0x7f0e38003a60 2023-10-07T08:52:16.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.297+0000 7f0e57fe7700 1 -- 172.21.15.81:0/2679939442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e500b6070 con 0x7f0e38003a60 2023-10-07T08:52:16.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.297+0000 7f0e57fe7700 1 -- 172.21.15.81:0/2679939442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e50067ac0 con 0x7f0e38003a60 2023-10-07T08:52:16.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.298+0000 7f0e4dffb700 1 -- 172.21.15.81:0/2679939442 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e48003040 con 0x7f0e38003a60 2023-10-07T08:52:16.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.298+0000 7f0e4dffb700 1 --2- 172.21.15.81:0/2679939442 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0e3c066f30 0x7f0e3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:16.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.298+0000 7f0e4dffb700 1 -- 172.21.15.81:0/2679939442 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0e480860f0 con 0x7f0e38003a60 2023-10-07T08:52:16.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.298+0000 7f0e55582700 1 --2- 172.21.15.81:0/2679939442 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0e3c066f30 0x7f0e3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:16.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.299+0000 7f0e55582700 1 --2- 172.21.15.81:0/2679939442 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0e3c066f30 0x7f0e3c0693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0e44001ce0 tx=0x7f0e44001500 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:16.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.302+0000 7f0e4dffb700 1 -- 172.21.15.81:0/2679939442 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e48053660 con 0x7f0e38003a60 2023-10-07T08:52:16.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.561+0000 7f0e57fe7700 1 -- 172.21.15.81:0/2679939442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f0e500d0450 con 0x7f0e38003a60 2023-10-07T08:52:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.837+0000 7f0e4dffb700 1 -- 172.21.15.81:0/2679939442 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v445) v1 ==== 132+0+0 (secure 0 0 0) 0x7f0e48056c80 con 0x7f0e38003a60 2023-10-07T08:52:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.839+0000 7f0e57fe7700 1 -- 172.21.15.81:0/2679939442 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0e3c066f30 msgr2=0x7f0e3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.839+0000 7f0e57fe7700 1 --2- 172.21.15.81:0/2679939442 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0e3c066f30 0x7f0e3c0693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0e44001ce0 tx=0x7f0e44001500 comp rx=0 tx=0).stop 2023-10-07T08:52:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.839+0000 7f0e57fe7700 1 -- 172.21.15.81:0/2679939442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38003a60 msgr2=0x7f0e500c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.839+0000 7f0e57fe7700 1 --2- 172.21.15.81:0/2679939442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38003a60 0x7f0e500c7270 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800e800 tx=0x7f0e4801a000 comp rx=0 tx=0).stop 2023-10-07T08:52:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.839+0000 7f0e57fe7700 1 -- 172.21.15.81:0/2679939442 shutdown_connections 2023-10-07T08:52:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.839+0000 7f0e57fe7700 1 --2- 172.21.15.81:0/2679939442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e50069ac0 0x7f0e50069f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.839+0000 7f0e57fe7700 1 --2- 172.21.15.81:0/2679939442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38003a60 0x7f0e500c7270 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.839+0000 7f0e57fe7700 1 --2- 172.21.15.81:0/2679939442 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f0e3c066f30 0x7f0e3c0693e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.839+0000 7f0e57fe7700 1 --2- 172.21.15.81:0/2679939442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e500b6870 0x7f0e501446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.839+0000 7f0e57fe7700 1 -- 172.21.15.81:0/2679939442 >> 172.21.15.81:0/2679939442 conn(0x7f0e5006bb90 msgr2=0x7f0e50155d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.839+0000 7f0e57fe7700 1 -- 172.21.15.81:0/2679939442 shutdown_connections 2023-10-07T08:52:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.840+0000 7f0e57fe7700 1 -- 172.21.15.81:0/2679939442 wait complete. 2023-10-07T08:52:16.852 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-07T08:52:16.852 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2023-10-07T08:52:16.852 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-10-07T08:52:16.853 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-10-07T08:52:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.966+0000 7fdd660c5700 1 Processor -- start 2023-10-07T08:52:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.966+0000 7fdd660c5700 1 -- start start 2023-10-07T08:52:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.967+0000 7fdd660c5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd60157ca0 0x7fdd600cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.967+0000 7fdd660c5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd600d07c0 con 0x7fdd601578d0 2023-10-07T08:52:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.967+0000 7fdd660c5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd600cfbb0 con 0x7fdd6006d120 2023-10-07T08:52:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.967+0000 7fdd660c5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600cfe90 con 0x7fdd60157ca0 2023-10-07T08:52:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.967+0000 7fdd5f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdd601578d0 0x7fdd6015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45288/0 (socket says 172.21.15.81:45288) 2023-10-07T08:52:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.967+0000 7fdd5f7fe700 1 -- 172.21.15.81:0/4202814605 learned_addr learned my addr 172.21.15.81:0/4202814605 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/4202814605 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510249647 0 0) 0x7fdd600d07c0 con 0x7fdd601578d0 2023-10-07T08:52:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/4202814605 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd48003570 con 0x7fdd601578d0 2023-10-07T08:52:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5effd700 1 --2- 172.21.15.81:0/4202814605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd60157ca0 0x7fdd600cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/4202814605 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4281226372 0 0) 0x7fdd48003570 con 0x7fdd601578d0 2023-10-07T08:52:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/4202814605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd60157ca0 msgr2=0x7fdd600cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5e7fc700 1 --2- 172.21.15.81:0/4202814605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd60157ca0 0x7fdd600cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/4202814605 >> v1:172.21.15.89:6789/0 conn(0x7fdd6006d120 legacy=0x7fdd6015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/4202814605 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd600d0170 con 0x7fdd601578d0 2023-10-07T08:52:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/4202814605 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fdd500017f0 con 0x7fdd601578d0 2023-10-07T08:52:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/4202814605 >> v1:172.21.15.81:6789/0 conn(0x7fdd601578d0 legacy=0x7fdd6015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5e7fc700 1 --2- 172.21.15.81:0/4202814605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd48003a90 0x7fdd48003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5e7fc700 1 --2- 172.21.15.81:0/4202814605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd60157ca0 0x7fdd48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5e7fc700 1 --2- 172.21.15.81:0/4202814605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd48004d50 0x7fdd480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/4202814605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600cfe90 con 0x7fdd48003a90 2023-10-07T08:52:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/4202814605 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4800bb70 con 0x7fdd48004d50 2023-10-07T08:52:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/4202814605 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4800bd30 con 0x7fdd60157ca0 2023-10-07T08:52:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5f7fe700 1 --2- 172.21.15.81:0/4202814605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd48003a90 0x7fdd48003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5effd700 1 --2- 172.21.15.81:0/4202814605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd60157ca0 0x7fdd48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.968+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/4202814605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd48004d50 0x7fdd480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd5f7fe700 1 -- 172.21.15.81:0/4202814605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd60157ca0 msgr2=0x7fdd48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd5f7fe700 1 --2- 172.21.15.81:0/4202814605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd60157ca0 0x7fdd48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd5f7fe700 1 -- 172.21.15.81:0/4202814605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd48004d50 msgr2=0x7fdd480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd5f7fe700 1 --2- 172.21.15.81:0/4202814605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd48004d50 0x7fdd480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd5f7fe700 1 -- 172.21.15.81:0/4202814605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd48003570 con 0x7fdd48003a90 2023-10-07T08:52:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/4202814605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd48004d50 0x7fdd480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd5f7fe700 1 --2- 172.21.15.81:0/4202814605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd48003a90 0x7fdd48003ea0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000a900 tx=0x7fdd6015b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13f01b75a1add14 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/4202814605 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd500070d0 con 0x7fdd48003a90 2023-10-07T08:52:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/4202814605 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd50007230 con 0x7fdd48003a90 2023-10-07T08:52:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/4202814605 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd500075f0 con 0x7fdd48003a90 2023-10-07T08:52:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd660c5700 1 -- 172.21.15.81:0/4202814605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd48003a90 msgr2=0x7fdd48003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd660c5700 1 --2- 172.21.15.81:0/4202814605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd48003a90 0x7fdd48003ea0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000a900 tx=0x7fdd6015b610 comp rx=0 tx=0).stop 2023-10-07T08:52:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd5ffff700 1 -- 172.21.15.81:0/4202814605 reap_dead start 2023-10-07T08:52:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd660c5700 1 -- 172.21.15.81:0/4202814605 shutdown_connections 2023-10-07T08:52:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd660c5700 1 -- 172.21.15.81:0/4202814605 >> 172.21.15.81:0/4202814605 conn(0x7fdd6006bb90 msgr2=0x7fdd6006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd660c5700 1 -- 172.21.15.81:0/4202814605 shutdown_connections 2023-10-07T08:52:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.969+0000 7fdd660c5700 1 -- 172.21.15.81:0/4202814605 wait complete. 2023-10-07T08:52:16.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.971+0000 7fdd660c5700 1 Processor -- start 2023-10-07T08:52:16.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.971+0000 7fdd660c5700 1 -- start start 2023-10-07T08:52:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.971+0000 7fdd660c5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd48003a90 0x7fdd600ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.971+0000 7fdd660c5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd600b6250 0x7fdd60156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.971+0000 7fdd660c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60148410 0x7fdd60148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.971+0000 7fdd660c5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600ac740 con 0x7fdd60148410 2023-10-07T08:52:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.971+0000 7fdd660c5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600abb30 con 0x7fdd600b6250 2023-10-07T08:52:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.971+0000 7fdd660c5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600abe10 con 0x7fdd48003a90 2023-10-07T08:52:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.971+0000 7fdd5ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60148410 0x7fdd60148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.971+0000 7fdd5ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60148410 0x7fdd60148890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55946/0 (socket says 172.21.15.81:55946) 2023-10-07T08:52:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.971+0000 7fdd5ffff700 1 -- 172.21.15.81:0/3633915412 learned_addr learned my addr 172.21.15.81:0/3633915412 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.972+0000 7fdd5ffff700 1 -- 172.21.15.81:0/3633915412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd48003a90 msgr2=0x7fdd600ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.972+0000 7fdd5effd700 1 --2- 172.21.15.81:0/3633915412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd600b6250 0x7fdd60156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.972+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/3633915412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd48003a90 0x7fdd600ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.972+0000 7fdd5ffff700 1 -- 172.21.15.81:0/3633915412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd600b6250 msgr2=0x7fdd60156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.972+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/3633915412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd600b6250 0x7fdd60156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.972+0000 7fdd5ffff700 1 -- 172.21.15.81:0/3633915412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd600ac0f0 con 0x7fdd60148410 2023-10-07T08:52:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.972+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/3633915412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60148410 0x7fdd60148890 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fdd58007a80 tx=0x7fdd58009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.972+0000 7fdd477fe700 1 -- 172.21.15.81:0/3633915412 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800ee60 con 0x7fdd60148410 2023-10-07T08:52:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.972+0000 7fdd477fe700 1 -- 172.21.15.81:0/3633915412 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd580114f0 con 0x7fdd60148410 2023-10-07T08:52:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.972+0000 7fdd660c5700 1 -- 172.21.15.81:0/3633915412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd600ac3d0 con 0x7fdd60148410 2023-10-07T08:52:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.972+0000 7fdd477fe700 1 -- 172.21.15.81:0/3633915412 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58011890 con 0x7fdd60148410 2023-10-07T08:52:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.972+0000 7fdd660c5700 1 -- 172.21.15.81:0/3633915412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd600ab7e0 con 0x7fdd60148410 2023-10-07T08:52:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.973+0000 7fdd660c5700 1 -- 172.21.15.81:0/3633915412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd60067ac0 con 0x7fdd60148410 2023-10-07T08:52:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.973+0000 7fdd477fe700 1 -- 172.21.15.81:0/3633915412 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd58011c80 con 0x7fdd60148410 2023-10-07T08:52:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.974+0000 7fdd477fe700 1 --2- 172.21.15.81:0/3633915412 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdd4c066f30 0x7fdd4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.974+0000 7fdd5f7fe700 1 --2- 172.21.15.81:0/3633915412 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdd4c066f30 0x7fdd4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.974+0000 7fdd477fe700 1 -- 172.21.15.81:0/3633915412 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fdd58083a10 con 0x7fdd60148410 2023-10-07T08:52:16.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.974+0000 7fdd5f7fe700 1 --2- 172.21.15.81:0/3633915412 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdd4c066f30 0x7fdd4c0693e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000a710 tx=0x7fdd50015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:16.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:16.978+0000 7fdd477fe700 1 -- 172.21.15.81:0/3633915412 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd58050f80 con 0x7fdd60148410 2023-10-07T08:52:17.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.234+0000 7fdd660c5700 1 -- 172.21.15.81:0/3633915412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7fdd600ac880 con 0x7fdd60148410 2023-10-07T08:52:17.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.839+0000 7fdd477fe700 1 -- 172.21.15.81:0/3633915412 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v446) v1 ==== 134+0+0 (secure 0 0 0) 0x7fdd600ac880 con 0x7fdd60148410 2023-10-07T08:52:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.841+0000 7fdd660c5700 1 -- 172.21.15.81:0/3633915412 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdd4c066f30 msgr2=0x7fdd4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.842+0000 7fdd660c5700 1 --2- 172.21.15.81:0/3633915412 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdd4c066f30 0x7fdd4c0693e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000a710 tx=0x7fdd50015000 comp rx=0 tx=0).stop 2023-10-07T08:52:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.842+0000 7fdd660c5700 1 -- 172.21.15.81:0/3633915412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60148410 msgr2=0x7fdd60148890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.842+0000 7fdd660c5700 1 --2- 172.21.15.81:0/3633915412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60148410 0x7fdd60148890 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fdd58007a80 tx=0x7fdd58009040 comp rx=0 tx=0).stop 2023-10-07T08:52:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.842+0000 7fdd660c5700 1 -- 172.21.15.81:0/3633915412 shutdown_connections 2023-10-07T08:52:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.842+0000 7fdd660c5700 1 --2- 172.21.15.81:0/3633915412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd60148410 0x7fdd60148890 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.842+0000 7fdd660c5700 1 --2- 172.21.15.81:0/3633915412 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdd4c066f30 0x7fdd4c0693e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.842+0000 7fdd660c5700 1 --2- 172.21.15.81:0/3633915412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd48003a90 0x7fdd600ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.842+0000 7fdd660c5700 1 --2- 172.21.15.81:0/3633915412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd600b6250 0x7fdd60156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.842+0000 7fdd660c5700 1 -- 172.21.15.81:0/3633915412 >> 172.21.15.81:0/3633915412 conn(0x7fdd6006bb90 msgr2=0x7fdd60154940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.842+0000 7fdd660c5700 1 -- 172.21.15.81:0/3633915412 shutdown_connections 2023-10-07T08:52:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.842+0000 7fdd660c5700 1 -- 172.21.15.81:0/3633915412 wait complete. 2023-10-07T08:52:17.855 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T08:52:17.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.974+0000 7f9350f9a700 1 Processor -- start 2023-10-07T08:52:17.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.974+0000 7f9350f9a700 1 -- start start 2023-10-07T08:52:17.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.975+0000 7f9350f9a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f934c0d0f50 0x7f934c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:17.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.975+0000 7f9350f9a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c06d990 con 0x7f934c06d530 2023-10-07T08:52:17.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.975+0000 7f9350f9a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c0cf2d0 con 0x7f934c0d0b80 2023-10-07T08:52:17.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.975+0000 7f9350f9a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c15a690 con 0x7f934c0d0f50 2023-10-07T08:52:17.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.975+0000 7f934affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f934c0d0f50 0x7f934c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:17.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.975+0000 7f934bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f934c06d530 0x7f934c15b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45290/0 (socket says 172.21.15.81:45290) 2023-10-07T08:52:17.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.975+0000 7f934bfff700 1 -- 172.21.15.81:0/2300564389 learned_addr learned my addr 172.21.15.81:0/2300564389 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:17.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.975+0000 7f934affd700 1 -- 172.21.15.81:0/2300564389 >> v1:172.21.15.89:6789/0 conn(0x7f934c0d0b80 legacy=0x7f934c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:17.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.975+0000 7f934affd700 1 -- 172.21.15.81:0/2300564389 >> v1:172.21.15.81:6789/0 conn(0x7f934c06d530 legacy=0x7f934c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:17.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.975+0000 7f934affd700 1 -- 172.21.15.81:0/2300564389 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c0d0480 con 0x7f934c0d0f50 2023-10-07T08:52:17.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.975+0000 7f934a7fc700 1 -- 172.21.15.81:0/2300564389 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742343993 0 0) 0x7f934c06d990 con 0x7f934c06d530 2023-10-07T08:52:17.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.976+0000 7f934affd700 1 --2- 172.21.15.81:0/2300564389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f934c0d0f50 0x7f934c06cff0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f93400098e0 tx=0x7f93400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec17a797599cbc9a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:17.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.976+0000 7f934a7fc700 1 -- 172.21.15.81:0/2300564389 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340009e80 con 0x7f934c0d0f50 2023-10-07T08:52:17.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.976+0000 7f934a7fc700 1 -- 172.21.15.81:0/2300564389 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934000b860 con 0x7f934c0d0f50 2023-10-07T08:52:17.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.976+0000 7f934a7fc700 1 -- 172.21.15.81:0/2300564389 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934000bbe0 con 0x7f934c0d0f50 2023-10-07T08:52:17.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.976+0000 7f9350f9a700 1 -- 172.21.15.81:0/2300564389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f934c0d0f50 msgr2=0x7f934c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:17.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.976+0000 7f9350f9a700 1 --2- 172.21.15.81:0/2300564389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f934c0d0f50 0x7f934c06cff0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f93400098e0 tx=0x7f93400091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:17.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.976+0000 7f9350f9a700 1 -- 172.21.15.81:0/2300564389 shutdown_connections 2023-10-07T08:52:17.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.976+0000 7f9350f9a700 1 --2- 172.21.15.81:0/2300564389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f934c0d0f50 0x7f934c06cff0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:17.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.976+0000 7f9350f9a700 1 -- 172.21.15.81:0/2300564389 >> 172.21.15.81:0/2300564389 conn(0x7f934c063230 msgr2=0x7f934c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:17.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.976+0000 7f9350f9a700 1 -- 172.21.15.81:0/2300564389 shutdown_connections 2023-10-07T08:52:17.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.976+0000 7f9350f9a700 1 -- 172.21.15.81:0/2300564389 wait complete. 2023-10-07T08:52:17.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.977+0000 7f9350f9a700 1 Processor -- start 2023-10-07T08:52:17.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.977+0000 7f9350f9a700 1 -- start start 2023-10-07T08:52:17.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.978+0000 7f9350f9a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f934c06d530 0x7f934c0b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:17.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.978+0000 7f9350f9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f934c0d0b80 0x7f934c14e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:17.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.978+0000 7f9350f9a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c0d0f50 0x7f934c154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:17.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.978+0000 7f9350f9a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c14f4d0 con 0x7f934c0d0b80 2023-10-07T08:52:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.978+0000 7f9350f9a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c154400 con 0x7f934c06d530 2023-10-07T08:52:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.978+0000 7f9350f9a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c1546e0 con 0x7f934c0d0f50 2023-10-07T08:52:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.978+0000 7f934affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f934c0d0b80 0x7f934c14e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.978+0000 7f934affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f934c0d0b80 0x7f934c14e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55974/0 (socket says 172.21.15.81:55974) 2023-10-07T08:52:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.978+0000 7f934affd700 1 -- 172.21.15.81:0/4014836892 learned_addr learned my addr 172.21.15.81:0/4014836892 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.978+0000 7f934bfff700 1 --2- 172.21.15.81:0/4014836892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c0d0f50 0x7f934c154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.978+0000 7f934b7fe700 1 --2- 172.21.15.81:0/4014836892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f934c06d530 0x7f934c0b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.978+0000 7f934affd700 1 -- 172.21.15.81:0/4014836892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c0d0f50 msgr2=0x7f934c154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.978+0000 7f934affd700 1 --2- 172.21.15.81:0/4014836892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c0d0f50 0x7f934c154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.978+0000 7f934affd700 1 -- 172.21.15.81:0/4014836892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f934c06d530 msgr2=0x7f934c0b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.978+0000 7f934affd700 1 --2- 172.21.15.81:0/4014836892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f934c06d530 0x7f934c0b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.979+0000 7f934affd700 1 -- 172.21.15.81:0/4014836892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9340009420 con 0x7f934c0d0b80 2023-10-07T08:52:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.979+0000 7f934affd700 1 --2- 172.21.15.81:0/4014836892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f934c0d0b80 0x7f934c14e5c0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f934c06fcc0 tx=0x7f9340017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.979+0000 7f93337fe700 1 -- 172.21.15.81:0/4014836892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934001f070 con 0x7f934c0d0b80 2023-10-07T08:52:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.979+0000 7f93337fe700 1 -- 172.21.15.81:0/4014836892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934000b9d0 con 0x7f934c0d0b80 2023-10-07T08:52:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.979+0000 7f9350f9a700 1 -- 172.21.15.81:0/4014836892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934c1549c0 con 0x7f934c0d0b80 2023-10-07T08:52:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.979+0000 7f93337fe700 1 -- 172.21.15.81:0/4014836892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340025670 con 0x7f934c0d0b80 2023-10-07T08:52:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.979+0000 7f9350f9a700 1 -- 172.21.15.81:0/4014836892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934c14eb00 con 0x7f934c0d0b80 2023-10-07T08:52:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.980+0000 7f9350f9a700 1 -- 172.21.15.81:0/4014836892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934c14f320 con 0x7f934c0d0b80 2023-10-07T08:52:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.980+0000 7f93337fe700 1 -- 172.21.15.81:0/4014836892 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9340023070 con 0x7f934c0d0b80 2023-10-07T08:52:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.980+0000 7f93337fe700 1 --2- 172.21.15.81:0/4014836892 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9338066f30 0x7f93380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.980+0000 7f93337fe700 1 -- 172.21.15.81:0/4014836892 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9340085820 con 0x7f934c0d0b80 2023-10-07T08:52:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.981+0000 7f934b7fe700 1 --2- 172.21.15.81:0/4014836892 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9338066f30 0x7f93380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:17.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.981+0000 7f934b7fe700 1 --2- 172.21.15.81:0/4014836892 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9338066f30 0x7f93380693e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f933c007fd0 tx=0x7f933c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:17.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:17.985+0000 7f93337fe700 1 -- 172.21.15.81:0/4014836892 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9340052d90 con 0x7f934c0d0b80 2023-10-07T08:52:18.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.168+0000 7f9350f9a700 1 -- 172.21.15.81:0/4014836892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f934c0676e0 con 0x7f934c0d0b80 2023-10-07T08:52:18.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.172+0000 7f93337fe700 1 -- 172.21.15.81:0/4014836892 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f934002a0c0 con 0x7f934c0d0b80 2023-10-07T08:52:18.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.174+0000 7f9350f9a700 1 -- 172.21.15.81:0/4014836892 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9338066f30 msgr2=0x7f93380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:18.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.174+0000 7f9350f9a700 1 --2- 172.21.15.81:0/4014836892 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9338066f30 0x7f93380693e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f933c007fd0 tx=0x7f933c009040 comp rx=0 tx=0).stop 2023-10-07T08:52:18.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.174+0000 7f9350f9a700 1 -- 172.21.15.81:0/4014836892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f934c0d0b80 msgr2=0x7f934c14e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:18.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.174+0000 7f9350f9a700 1 --2- 172.21.15.81:0/4014836892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f934c0d0b80 0x7f934c14e5c0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f934c06fcc0 tx=0x7f9340017000 comp rx=0 tx=0).stop 2023-10-07T08:52:18.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.174+0000 7f9350f9a700 1 -- 172.21.15.81:0/4014836892 shutdown_connections 2023-10-07T08:52:18.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.174+0000 7f9350f9a700 1 --2- 172.21.15.81:0/4014836892 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9338066f30 0x7f93380693e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.174+0000 7f9350f9a700 1 --2- 172.21.15.81:0/4014836892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c0d0f50 0x7f934c154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.174+0000 7f9350f9a700 1 --2- 172.21.15.81:0/4014836892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f934c06d530 0x7f934c0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.174+0000 7f9350f9a700 1 --2- 172.21.15.81:0/4014836892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f934c0d0b80 0x7f934c14e5c0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.174+0000 7f9350f9a700 1 -- 172.21.15.81:0/4014836892 >> 172.21.15.81:0/4014836892 conn(0x7f934c063230 msgr2=0x7f934c15f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.174+0000 7f9350f9a700 1 -- 172.21.15.81:0/4014836892 shutdown_connections 2023-10-07T08:52:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.174+0000 7f9350f9a700 1 -- 172.21.15.81:0/4014836892 wait complete. 2023-10-07T08:52:18.186 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:52:18.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:52:18.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:52:18.262 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:52:18.262 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T08:52:18.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:52:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.377+0000 7fc6d6b29700 1 Processor -- start 2023-10-07T08:52:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.377+0000 7fc6d6b29700 1 -- start start 2023-10-07T08:52:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.378+0000 7fc6d6b29700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc6d0157ca0 0x7fc6d00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.378+0000 7fc6d6b29700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6d006d120 0x7fc6d006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.378+0000 7fc6d6b29700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d00d07c0 con 0x7fc6d01578d0 2023-10-07T08:52:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.378+0000 7fc6d6b29700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d006da50 con 0x7fc6d006d120 2023-10-07T08:52:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.378+0000 7fc6d6b29700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d00cfbb0 con 0x7fc6d0157ca0 2023-10-07T08:52:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.378+0000 7fc6d50c6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6d006d120 0x7fc6d006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.378+0000 7fc6d50c6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6d006d120 0x7fc6d006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55986/0 (socket says 172.21.15.81:55986) 2023-10-07T08:52:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.378+0000 7fc6d50c6700 1 -- 172.21.15.81:0/3657561557 learned_addr learned my addr 172.21.15.81:0/3657561557 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.378+0000 7fc6c7fff700 1 --2- 172.21.15.81:0/3657561557 >> v2:172.21.15.89:3300/0 conn(0x7fc6d0157ca0 0x7fc6d00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.379+0000 7fc6d50c6700 1 -- 172.21.15.81:0/3657561557 >> v2:172.21.15.89:3300/0 conn(0x7fc6d0157ca0 msgr2=0x7fc6d00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.379+0000 7fc6d50c6700 1 --2- 172.21.15.81:0/3657561557 >> v2:172.21.15.89:3300/0 conn(0x7fc6d0157ca0 0x7fc6d00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.379+0000 7fc6d50c6700 1 -- 172.21.15.81:0/3657561557 >> v1:172.21.15.89:6789/0 conn(0x7fc6d01578d0 legacy=0x7fc6d015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.379+0000 7fc6d50c6700 1 -- 172.21.15.81:0/3657561557 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d00cfe90 con 0x7fc6d006d120 2023-10-07T08:52:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.379+0000 7fc6d50c6700 1 --2- 172.21.15.81:0/3657561557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d006d120 0x7fc6d006d510 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0068510 tx=0x7fc6c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86656aa0bf1cba9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.379+0000 7fc6c77fe700 1 -- 172.21.15.81:0/3657561557 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800b860 con 0x7fc6d006d120 2023-10-07T08:52:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.379+0000 7fc6c77fe700 1 -- 172.21.15.81:0/3657561557 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c800b9c0 con 0x7fc6d006d120 2023-10-07T08:52:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.379+0000 7fc6c77fe700 1 -- 172.21.15.81:0/3657561557 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800bd60 con 0x7fc6d006d120 2023-10-07T08:52:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.379+0000 7fc6d6b29700 1 -- 172.21.15.81:0/3657561557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d006d120 msgr2=0x7fc6d006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.379+0000 7fc6d6b29700 1 --2- 172.21.15.81:0/3657561557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d006d120 0x7fc6d006d510 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0068510 tx=0x7fc6c8009250 comp rx=0 tx=0).stop 2023-10-07T08:52:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.379+0000 7fc6d6b29700 1 -- 172.21.15.81:0/3657561557 shutdown_connections 2023-10-07T08:52:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.379+0000 7fc6d6b29700 1 --2- 172.21.15.81:0/3657561557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d006d120 0x7fc6d006d510 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.379+0000 7fc6d6b29700 1 --2- 172.21.15.81:0/3657561557 >> v2:172.21.15.89:3300/0 conn(0x7fc6d0157ca0 0x7fc6d00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.379+0000 7fc6d6b29700 1 -- 172.21.15.81:0/3657561557 >> 172.21.15.81:0/3657561557 conn(0x7fc6d006bb90 msgr2=0x7fc6d006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.379+0000 7fc6d6b29700 1 -- 172.21.15.81:0/3657561557 shutdown_connections 2023-10-07T08:52:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.379+0000 7fc6d6b29700 1 -- 172.21.15.81:0/3657561557 wait complete. 2023-10-07T08:52:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.380+0000 7fc6d6b29700 1 Processor -- start 2023-10-07T08:52:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.381+0000 7fc6d6b29700 1 -- start start 2023-10-07T08:52:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.381+0000 7fc6d6b29700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d006d120 0x7fc6d013fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.381+0000 7fc6d6b29700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6d01578d0 0x7fc6d0140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.381+0000 7fc6d6b29700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6d0157ca0 0x7fc6d0155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.381+0000 7fc6d6b29700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d00c66a0 con 0x7fc6d006d120 2023-10-07T08:52:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.381+0000 7fc6d6b29700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d0141070 con 0x7fc6d01578d0 2023-10-07T08:52:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.381+0000 7fc6d6b29700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d0141350 con 0x7fc6d0157ca0 2023-10-07T08:52:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.381+0000 7fc6d48c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d006d120 0x7fc6d013fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.382+0000 7fc6d48c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d006d120 0x7fc6d013fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55994/0 (socket says 172.21.15.81:55994) 2023-10-07T08:52:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.382+0000 7fc6d48c5700 1 -- 172.21.15.81:0/3656587203 learned_addr learned my addr 172.21.15.81:0/3656587203 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.382+0000 7fc6c7fff700 1 --2- 172.21.15.81:0/3656587203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6d01578d0 0x7fc6d0140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.382+0000 7fc6d48c5700 1 -- 172.21.15.81:0/3656587203 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6d0157ca0 msgr2=0x7fc6d0155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.382+0000 7fc6d50c6700 1 --2- 172.21.15.81:0/3656587203 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6d0157ca0 0x7fc6d0155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.382+0000 7fc6d48c5700 1 --2- 172.21.15.81:0/3656587203 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6d0157ca0 0x7fc6d0155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.382+0000 7fc6d48c5700 1 -- 172.21.15.81:0/3656587203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6d01578d0 msgr2=0x7fc6d0140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.382+0000 7fc6d48c5700 1 --2- 172.21.15.81:0/3656587203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6d01578d0 0x7fc6d0140770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.382+0000 7fc6d48c5700 1 -- 172.21.15.81:0/3656587203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c80094f0 con 0x7fc6d006d120 2023-10-07T08:52:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.382+0000 7fc6c7fff700 1 --2- 172.21.15.81:0/3656587203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6d01578d0 0x7fc6d0140770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.382+0000 7fc6d48c5700 1 --2- 172.21.15.81:0/3656587203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d006d120 0x7fc6d013fec0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00cb10 tx=0x7fc6cc0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.382+0000 7fc6c4ff9700 1 -- 172.21.15.81:0/3656587203 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc00a760 con 0x7fc6d006d120 2023-10-07T08:52:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.382+0000 7fc6c4ff9700 1 -- 172.21.15.81:0/3656587203 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6cc00a8e0 con 0x7fc6d006d120 2023-10-07T08:52:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.382+0000 7fc6d6b29700 1 -- 172.21.15.81:0/3656587203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d0141630 con 0x7fc6d006d120 2023-10-07T08:52:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.382+0000 7fc6c4ff9700 1 -- 172.21.15.81:0/3656587203 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc00aca0 con 0x7fc6d006d120 2023-10-07T08:52:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.382+0000 7fc6d6b29700 1 -- 172.21.15.81:0/3656587203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d0141bf0 con 0x7fc6d006d120 2023-10-07T08:52:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.383+0000 7fc6d6b29700 1 -- 172.21.15.81:0/3656587203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d0141e10 con 0x7fc6d006d120 2023-10-07T08:52:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.384+0000 7fc6c4ff9700 1 -- 172.21.15.81:0/3656587203 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6cc003030 con 0x7fc6d006d120 2023-10-07T08:52:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.384+0000 7fc6c4ff9700 1 --2- 172.21.15.81:0/3656587203 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6bc066f30 0x7fc6bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.384+0000 7fc6c4ff9700 1 -- 172.21.15.81:0/3656587203 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc6cc084330 con 0x7fc6d006d120 2023-10-07T08:52:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.384+0000 7fc6c7fff700 1 --2- 172.21.15.81:0/3656587203 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6bc066f30 0x7fc6bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.384+0000 7fc6c7fff700 1 --2- 172.21.15.81:0/3656587203 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6bc066f30 0x7fc6bc0693e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0146e00 tx=0x7fc6c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.388+0000 7fc6c4ff9700 1 -- 172.21.15.81:0/3656587203 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6cc0518a0 con 0x7fc6d006d120 2023-10-07T08:52:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.616+0000 7fc6d6b29700 1 -- 172.21.15.81:0/3656587203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6d0140460 con 0x7fc6d006d120 2023-10-07T08:52:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.617+0000 7fc6c4ff9700 1 -- 172.21.15.81:0/3656587203 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fc6cc054ec0 con 0x7fc6d006d120 2023-10-07T08:52:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:18.618 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":76,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/1419112520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1419112520},{"type":"v1","addr":"172.21.15.89:6834","nonce":1419112520}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":6140,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2310402815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2310402815},{"type":"v1","addr":"172.21.15.89:6835","nonce":2310402815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7509,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2709799872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2709799872},{"type":"v1","addr":"172.21.15.81:6836","nonce":2709799872}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7776,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3344904411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3344904411},{"type":"v1","addr":"172.21.15.81:6837","nonce":3344904411}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[]} 2023-10-07T08:52:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.619+0000 7fc6d6b29700 1 -- 172.21.15.81:0/3656587203 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6bc066f30 msgr2=0x7fc6bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.619+0000 7fc6d6b29700 1 --2- 172.21.15.81:0/3656587203 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6bc066f30 0x7fc6bc0693e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0146e00 tx=0x7fc6c0008040 comp rx=0 tx=0).stop 2023-10-07T08:52:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.619+0000 7fc6d6b29700 1 -- 172.21.15.81:0/3656587203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d006d120 msgr2=0x7fc6d013fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.619+0000 7fc6d6b29700 1 --2- 172.21.15.81:0/3656587203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d006d120 0x7fc6d013fec0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00cb10 tx=0x7fc6cc0017b0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.619+0000 7fc6d6b29700 1 -- 172.21.15.81:0/3656587203 shutdown_connections 2023-10-07T08:52:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.619+0000 7fc6d6b29700 1 --2- 172.21.15.81:0/3656587203 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc6bc066f30 0x7fc6bc0693e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.619+0000 7fc6d6b29700 1 --2- 172.21.15.81:0/3656587203 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6d0157ca0 0x7fc6d0155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.619+0000 7fc6d6b29700 1 --2- 172.21.15.81:0/3656587203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6d006d120 0x7fc6d013fec0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.619+0000 7fc6d6b29700 1 --2- 172.21.15.81:0/3656587203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6d01578d0 0x7fc6d0140770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.619+0000 7fc6d6b29700 1 -- 172.21.15.81:0/3656587203 >> 172.21.15.81:0/3656587203 conn(0x7fc6d006bb90 msgr2=0x7fc6d0156950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.619+0000 7fc6d6b29700 1 -- 172.21.15.81:0/3656587203 shutdown_connections 2023-10-07T08:52:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.619+0000 7fc6d6b29700 1 -- 172.21.15.81:0/3656587203 wait complete. 2023-10-07T08:52:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 76 2023-10-07T08:52:18.632 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T08:52:18.632 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T08:52:18.632 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T08:52:18.632 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:52:18.633 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T08:52:18.633 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T08:52:18.633 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T08:52:18.633 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:52:18.633 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T08:52:18.633 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T08:52:18.634 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T08:52:18.634 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:52:18.634 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T08:52:18.634 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T08:52:18.634 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T08:52:18.634 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:52:18.641 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T08:52:18.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T08:52:18.642 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T08:52:18.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T08:52:18.644 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T08:52:18.644 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T08:52:18.645 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T08:52:18.645 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T08:52:18.683 INFO:tasks.ceph.mds.a:Started 2023-10-07T08:52:18.684 DEBUG:teuthology.parallel:result is None 2023-10-07T08:52:18.684 INFO:tasks.ceph.mds.c:Started 2023-10-07T08:52:18.684 DEBUG:teuthology.parallel:result is None 2023-10-07T08:52:18.687 INFO:tasks.ceph.mds.b:Started 2023-10-07T08:52:18.688 DEBUG:teuthology.parallel:result is None 2023-10-07T08:52:18.689 INFO:tasks.ceph.mds.d:Started 2023-10-07T08:52:18.689 DEBUG:teuthology.parallel:result is None 2023-10-07T08:52:18.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T08:52:18.756 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-07T08:52:18.757 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-07T08:52:18.768 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-10-07T08:52:18.768 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-10-07T08:52:18.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.809+0000 7f82634fd700 1 Processor -- start 2023-10-07T08:52:18.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.809+0000 7f82634fd700 1 -- start start 2023-10-07T08:52:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.810+0000 7f82634fd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f825c156d60 0x7f825c06b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.810+0000 7f82634fd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c06ceb0 0x7f825c157130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.810+0000 7f82634fd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825c06ac50 con 0x7f825c157670 2023-10-07T08:52:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.810+0000 7f82634fd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825c06a400 con 0x7f825c156d60 2023-10-07T08:52:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.810+0000 7f82634fd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0c8fd0 con 0x7f825c06ceb0 2023-10-07T08:52:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.810+0000 7f8261a9a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f825c157670 0x7f825c0cae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45294/0 (socket says 172.21.15.81:45294) 2023-10-07T08:52:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.810+0000 7f8261a9a700 1 -- 172.21.15.81:0/263451883 learned_addr learned my addr 172.21.15.81:0/263451883 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8261299700 1 --2- 172.21.15.81:0/263451883 >> v2:172.21.15.89:3300/0 conn(0x7f825c156d60 0x7f825c06b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8260a98700 1 --2- 172.21.15.81:0/263451883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c06ceb0 0x7f825c157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8253fff700 1 -- 172.21.15.81:0/263451883 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332194778 0 0) 0x7f825c06ac50 con 0x7f825c157670 2023-10-07T08:52:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8253fff700 1 -- 172.21.15.81:0/263451883 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8248003570 con 0x7f825c157670 2023-10-07T08:52:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8253fff700 1 -- 172.21.15.81:0/263451883 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 766181652 0 0) 0x7f8248003570 con 0x7f825c157670 2023-10-07T08:52:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8253fff700 1 -- 172.21.15.81:0/263451883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c06ceb0 msgr2=0x7f825c157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8253fff700 1 --2- 172.21.15.81:0/263451883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c06ceb0 0x7f825c157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8253fff700 1 -- 172.21.15.81:0/263451883 >> v2:172.21.15.89:3300/0 conn(0x7f825c156d60 msgr2=0x7f825c06b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8253fff700 1 --2- 172.21.15.81:0/263451883 >> v2:172.21.15.89:3300/0 conn(0x7f825c156d60 0x7f825c06b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8253fff700 1 -- 172.21.15.81:0/263451883 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c0c8cf0 con 0x7f825c157670 2023-10-07T08:52:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8253fff700 1 -- 172.21.15.81:0/263451883 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f82540017f0 con 0x7f825c157670 2023-10-07T08:52:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8253fff700 1 -- 172.21.15.81:0/263451883 >> v1:172.21.15.81:6789/0 conn(0x7f825c157670 legacy=0x7f825c0cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8253fff700 1 --2- 172.21.15.81:0/263451883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8248003a60 0x7f8248003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8253fff700 1 --2- 172.21.15.81:0/263451883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8248004810 0x7f8248004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8253fff700 1 --2- 172.21.15.81:0/263451883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c06ceb0 0x7f82480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8253fff700 1 -- 172.21.15.81:0/263451883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c06a400 con 0x7f8248004810 2023-10-07T08:52:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8253fff700 1 -- 172.21.15.81:0/263451883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0c8fd0 con 0x7f8248003a60 2023-10-07T08:52:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8253fff700 1 -- 172.21.15.81:0/263451883 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824800ba60 con 0x7f825c06ceb0 2023-10-07T08:52:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8260a98700 1 --2- 172.21.15.81:0/263451883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8248004810 0x7f8248004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8261299700 1 --2- 172.21.15.81:0/263451883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8248003a60 0x7f8248003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8261a9a700 1 --2- 172.21.15.81:0/263451883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c06ceb0 0x7f82480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8260a98700 1 -- 172.21.15.81:0/263451883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c06ceb0 msgr2=0x7f82480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8260a98700 1 --2- 172.21.15.81:0/263451883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c06ceb0 0x7f82480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8260a98700 1 -- 172.21.15.81:0/263451883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8248003a60 msgr2=0x7f8248003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8260a98700 1 --2- 172.21.15.81:0/263451883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8248003a60 0x7f8248003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8260a98700 1 -- 172.21.15.81:0/263451883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8248003570 con 0x7f8248004810 2023-10-07T08:52:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8261a9a700 1 --2- 172.21.15.81:0/263451883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c06ceb0 0x7f82480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.811+0000 7f8260a98700 1 --2- 172.21.15.81:0/263451883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8248004810 0x7f8248004c80 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f824c009c30 tx=0x7f824c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4539e31f21f5d191 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.812+0000 7f8253fff700 1 -- 172.21.15.81:0/263451883 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c00e710 con 0x7f8248004810 2023-10-07T08:52:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.812+0000 7f8253fff700 1 -- 172.21.15.81:0/263451883 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824c00e870 con 0x7f8248004810 2023-10-07T08:52:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.812+0000 7f8253fff700 1 -- 172.21.15.81:0/263451883 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c00ec30 con 0x7f8248004810 2023-10-07T08:52:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.812+0000 7f82634fd700 1 -- 172.21.15.81:0/263451883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8248004810 msgr2=0x7f8248004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.812+0000 7f82634fd700 1 --2- 172.21.15.81:0/263451883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8248004810 0x7f8248004c80 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f824c009c30 tx=0x7f824c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.812+0000 7f8261a9a700 1 -- 172.21.15.81:0/263451883 reap_dead start 2023-10-07T08:52:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.812+0000 7f82634fd700 1 -- 172.21.15.81:0/263451883 shutdown_connections 2023-10-07T08:52:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.812+0000 7f82634fd700 1 -- 172.21.15.81:0/263451883 >> 172.21.15.81:0/263451883 conn(0x7f825c0c9ca0 msgr2=0x7f825c0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.812+0000 7f82634fd700 1 -- 172.21.15.81:0/263451883 shutdown_connections 2023-10-07T08:52:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.812+0000 7f82634fd700 1 -- 172.21.15.81:0/263451883 wait complete. 2023-10-07T08:52:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.813+0000 7f82634fd700 1 Processor -- start 2023-10-07T08:52:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.813+0000 7f82634fd700 1 -- start start 2023-10-07T08:52:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.814+0000 7f82634fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8248004810 0x7f825c14b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.814+0000 7f82634fd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f825c0c42e0 0x7f825c16a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.814+0000 7f82634fd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c0c4750 0x7f825c16a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.814+0000 7f82634fd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c140550 con 0x7f8248004810 2023-10-07T08:52:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.814+0000 7f82634fd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c154a70 con 0x7f825c0c42e0 2023-10-07T08:52:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.814+0000 7f82634fd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c14bd20 con 0x7f825c0c4750 2023-10-07T08:52:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.814+0000 7f8261299700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8248004810 0x7f825c14b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:18.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.814+0000 7f8261299700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8248004810 0x7f825c14b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56042/0 (socket says 172.21.15.81:56042) 2023-10-07T08:52:18.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.814+0000 7f8261299700 1 -- 172.21.15.81:0/1459588997 learned_addr learned my addr 172.21.15.81:0/1459588997 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:18.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.814+0000 7f8261a9a700 1 --2- 172.21.15.81:0/1459588997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c0c4750 0x7f825c16a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:18.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.814+0000 7f8260a98700 1 --2- 172.21.15.81:0/1459588997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f825c0c42e0 0x7f825c16a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:18.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.815+0000 7f8261299700 1 -- 172.21.15.81:0/1459588997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c0c4750 msgr2=0x7f825c16a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:18.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.815+0000 7f8261299700 1 --2- 172.21.15.81:0/1459588997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c0c4750 0x7f825c16a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.815+0000 7f8261299700 1 -- 172.21.15.81:0/1459588997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f825c0c42e0 msgr2=0x7f825c16a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:18.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.815+0000 7f8261299700 1 --2- 172.21.15.81:0/1459588997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f825c0c42e0 0x7f825c16a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:18.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.815+0000 7f8261299700 1 -- 172.21.15.81:0/1459588997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c0c6b50 con 0x7f8248004810 2023-10-07T08:52:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.815+0000 7f8261299700 1 --2- 172.21.15.81:0/1459588997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8248004810 0x7f825c14b7e0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f8258011d70 tx=0x7f82580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.815+0000 7f82517fa700 1 -- 172.21.15.81:0/1459588997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825800fac0 con 0x7f8248004810 2023-10-07T08:52:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.815+0000 7f82517fa700 1 -- 172.21.15.81:0/1459588997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825800fc20 con 0x7f8248004810 2023-10-07T08:52:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.815+0000 7f82634fd700 1 -- 172.21.15.81:0/1459588997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c0c6e30 con 0x7f8248004810 2023-10-07T08:52:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.815+0000 7f82517fa700 1 -- 172.21.15.81:0/1459588997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258014440 con 0x7f8248004810 2023-10-07T08:52:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.815+0000 7f82634fd700 1 -- 172.21.15.81:0/1459588997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c0c73f0 con 0x7f8248004810 2023-10-07T08:52:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.816+0000 7f82634fd700 1 -- 172.21.15.81:0/1459588997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825c068080 con 0x7f8248004810 2023-10-07T08:52:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.816+0000 7f82517fa700 1 -- 172.21.15.81:0/1459588997 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8258014870 con 0x7f8248004810 2023-10-07T08:52:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.817+0000 7f82517fa700 1 --2- 172.21.15.81:0/1459588997 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8240066f30 0x7f82400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:18.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.817+0000 7f82517fa700 1 -- 172.21.15.81:0/1459588997 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8258018030 con 0x7f8248004810 2023-10-07T08:52:18.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.817+0000 7f8260a98700 1 --2- 172.21.15.81:0/1459588997 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8240066f30 0x7f82400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:18.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.817+0000 7f8260a98700 1 --2- 172.21.15.81:0/1459588997 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8240066f30 0x7f82400693e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f825c06c370 tx=0x7f824c01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:18.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:18.821+0000 7f82517fa700 1 -- 172.21.15.81:0/1459588997 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8258052240 con 0x7f8248004810 2023-10-07T08:52:19.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.023+0000 7f82634fd700 1 -- 172.21.15.81:0/1459588997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f825c04bb80 con 0x7f8248004810 2023-10-07T08:52:19.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.863+0000 7f82517fa700 1 -- 172.21.15.81:0/1459588997 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v169) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8258022080 con 0x7f8248004810 2023-10-07T08:52:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.865+0000 7f82634fd700 1 -- 172.21.15.81:0/1459588997 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8240066f30 msgr2=0x7f82400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.865+0000 7f82634fd700 1 --2- 172.21.15.81:0/1459588997 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8240066f30 0x7f82400693e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f825c06c370 tx=0x7f824c01a000 comp rx=0 tx=0).stop 2023-10-07T08:52:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.865+0000 7f82634fd700 1 -- 172.21.15.81:0/1459588997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8248004810 msgr2=0x7f825c14b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.865+0000 7f82634fd700 1 --2- 172.21.15.81:0/1459588997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8248004810 0x7f825c14b7e0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f8258011d70 tx=0x7f82580091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.865+0000 7f82634fd700 1 -- 172.21.15.81:0/1459588997 shutdown_connections 2023-10-07T08:52:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.865+0000 7f82634fd700 1 --2- 172.21.15.81:0/1459588997 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8240066f30 0x7f82400693e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.865+0000 7f82634fd700 1 --2- 172.21.15.81:0/1459588997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c0c4750 0x7f825c16a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.865+0000 7f82634fd700 1 --2- 172.21.15.81:0/1459588997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8248004810 0x7f825c14b7e0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.865+0000 7f82634fd700 1 --2- 172.21.15.81:0/1459588997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f825c0c42e0 0x7f825c16a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.865+0000 7f82634fd700 1 -- 172.21.15.81:0/1459588997 >> 172.21.15.81:0/1459588997 conn(0x7f825c0c9ca0 msgr2=0x7f825c14f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.865+0000 7f82634fd700 1 -- 172.21.15.81:0/1459588997 shutdown_connections 2023-10-07T08:52:19.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.865+0000 7f82634fd700 1 -- 172.21.15.81:0/1459588997 wait complete. 2023-10-07T08:52:19.867 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-07T08:52:19.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T08:52:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.993+0000 7f53e8857700 1 Processor -- start 2023-10-07T08:52:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.993+0000 7f53e8857700 1 -- start start 2023-10-07T08:52:19.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e8857700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f53e4159b40 0x7f53e40cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:19.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e8857700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f53e4068e90 0x7f53e40cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e8857700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e40cee10 con 0x7f53e4159f10 2023-10-07T08:52:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e8857700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e40cd040 con 0x7f53e4068e90 2023-10-07T08:52:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e8857700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e40cd320 con 0x7f53e4159b40 2023-10-07T08:52:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f53e4068e90 0x7f53e40cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e259c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f53e4159f10 0x7f53e4068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45302/0 (socket says 172.21.15.81:45302) 2023-10-07T08:52:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e259c700 1 -- 172.21.15.81:0/665829478 learned_addr learned my addr 172.21.15.81:0/665829478 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e2d9d700 1 --2- 172.21.15.81:0/665829478 >> v2:172.21.15.89:3300/0 conn(0x7f53e4159b40 0x7f53e40cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e359e700 1 -- 172.21.15.81:0/665829478 >> v2:172.21.15.89:3300/0 conn(0x7f53e4159b40 msgr2=0x7f53e40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e359e700 1 --2- 172.21.15.81:0/665829478 >> v2:172.21.15.89:3300/0 conn(0x7f53e4159b40 0x7f53e40cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e359e700 1 -- 172.21.15.81:0/665829478 >> v1:172.21.15.81:6789/0 conn(0x7f53e4159f10 legacy=0x7f53e4068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e359e700 1 -- 172.21.15.81:0/665829478 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e40ce7c0 con 0x7f53e4068e90 2023-10-07T08:52:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e1d9b700 1 -- 172.21.15.81:0/665829478 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216430588 0 0) 0x7f53e40cee10 con 0x7f53e4159f10 2023-10-07T08:52:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e359e700 1 --2- 172.21.15.81:0/665829478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e4068e90 0x7f53e40cf2a0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f53e40d0bc0 tx=0x7f53dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c1b054f13a39b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e1d9b700 1 -- 172.21.15.81:0/665829478 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc00e070 con 0x7f53e4068e90 2023-10-07T08:52:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e1d9b700 1 -- 172.21.15.81:0/665829478 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc00bc30 con 0x7f53e4068e90 2023-10-07T08:52:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.994+0000 7f53e1d9b700 1 -- 172.21.15.81:0/665829478 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc012430 con 0x7f53e4068e90 2023-10-07T08:52:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.995+0000 7f53e8857700 1 -- 172.21.15.81:0/665829478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e4068e90 msgr2=0x7f53e40cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.995+0000 7f53e8857700 1 --2- 172.21.15.81:0/665829478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e4068e90 0x7f53e40cf2a0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f53e40d0bc0 tx=0x7f53dc009780 comp rx=0 tx=0).stop 2023-10-07T08:52:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.995+0000 7f53e8857700 1 -- 172.21.15.81:0/665829478 shutdown_connections 2023-10-07T08:52:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.995+0000 7f53e8857700 1 --2- 172.21.15.81:0/665829478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e4068e90 0x7f53e40cf2a0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.995+0000 7f53e8857700 1 --2- 172.21.15.81:0/665829478 >> v2:172.21.15.89:3300/0 conn(0x7f53e4159b40 0x7f53e40cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.995+0000 7f53e8857700 1 -- 172.21.15.81:0/665829478 >> 172.21.15.81:0/665829478 conn(0x7f53e40cd660 msgr2=0x7f53e40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.995+0000 7f53e8857700 1 -- 172.21.15.81:0/665829478 shutdown_connections 2023-10-07T08:52:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.995+0000 7f53e8857700 1 -- 172.21.15.81:0/665829478 wait complete. 2023-10-07T08:52:20.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.996+0000 7f53e8857700 1 Processor -- start 2023-10-07T08:52:20.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.996+0000 7f53e8857700 1 -- start start 2023-10-07T08:52:20.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e8857700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e4068e90 0x7f53e4155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:20.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e8857700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e4159b40 0x7f53e40cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:20.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e8857700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e4159f10 0x7f53e40cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:20.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e8857700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e414efc0 con 0x7f53e4159b40 2023-10-07T08:52:20.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e8857700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e4156440 con 0x7f53e4159f10 2023-10-07T08:52:20.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e8857700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e41590b0 con 0x7f53e4068e90 2023-10-07T08:52:20.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e4159b40 0x7f53e40cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:20.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e4159b40 0x7f53e40cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56064/0 (socket says 172.21.15.81:56064) 2023-10-07T08:52:20.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e259c700 1 -- 172.21.15.81:0/919706265 learned_addr learned my addr 172.21.15.81:0/919706265 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:20.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e2d9d700 1 --2- 172.21.15.81:0/919706265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e4068e90 0x7f53e4155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:20.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e359e700 1 --2- 172.21.15.81:0/919706265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e4159f10 0x7f53e40cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:20.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e259c700 1 -- 172.21.15.81:0/919706265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e4068e90 msgr2=0x7f53e4155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e259c700 1 --2- 172.21.15.81:0/919706265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e4068e90 0x7f53e4155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e259c700 1 -- 172.21.15.81:0/919706265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e4159f10 msgr2=0x7f53e40cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e259c700 1 --2- 172.21.15.81:0/919706265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e4159f10 0x7f53e40cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e259c700 1 -- 172.21.15.81:0/919706265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc009a20 con 0x7f53e4159b40 2023-10-07T08:52:20.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.997+0000 7f53e259c700 1 --2- 172.21.15.81:0/919706265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e4159b40 0x7f53e40cb6c0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f53d800c5b0 tx=0x7f53d8001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:20.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.998+0000 7f53caffd700 1 -- 172.21.15.81:0/919706265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8005b30 con 0x7f53e4159b40 2023-10-07T08:52:20.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.998+0000 7f53caffd700 1 -- 172.21.15.81:0/919706265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d8005c90 con 0x7f53e4159b40 2023-10-07T08:52:20.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.998+0000 7f53e8857700 1 -- 172.21.15.81:0/919706265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e40b6500 con 0x7f53e4159b40 2023-10-07T08:52:20.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.998+0000 7f53caffd700 1 -- 172.21.15.81:0/919706265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8007300 con 0x7f53e4159b40 2023-10-07T08:52:20.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.998+0000 7f53e8857700 1 -- 172.21.15.81:0/919706265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e4158a60 con 0x7f53e4159b40 2023-10-07T08:52:20.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.998+0000 7f53e8857700 1 -- 172.21.15.81:0/919706265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e4159220 con 0x7f53e4159b40 2023-10-07T08:52:20.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.999+0000 7f53caffd700 1 -- 172.21.15.81:0/919706265 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53d801b3b0 con 0x7f53e4159b40 2023-10-07T08:52:20.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.999+0000 7f53caffd700 1 --2- 172.21.15.81:0/919706265 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f53d0066f30 0x7f53d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.999+0000 7f53caffd700 1 -- 172.21.15.81:0/919706265 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f53d8083610 con 0x7f53e4159b40 2023-10-07T08:52:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:19.999+0000 7f53e2d9d700 1 --2- 172.21.15.81:0/919706265 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f53d0066f30 0x7f53d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.000+0000 7f53e2d9d700 1 --2- 172.21.15.81:0/919706265 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f53d0066f30 0x7f53d00693e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f53d4006fd0 tx=0x7f53d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.003+0000 7f53caffd700 1 -- 172.21.15.81:0/919706265 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53d8050bd0 con 0x7f53e4159b40 2023-10-07T08:52:20.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.258+0000 7f53e8857700 1 -- 172.21.15.81:0/919706265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f53e4063e90 con 0x7f53e4159b40 2023-10-07T08:52:20.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.259+0000 7f53caffd700 1 -- 172.21.15.81:0/919706265 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f53d80541f0 con 0x7f53e4159b40 2023-10-07T08:52:20.259 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:20.260 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:52:20.260 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-07T08:52:20.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.260 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-07T08:52:20.260 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlK8v0EhAAyj+l+ifyEevPT96HbuWzkw==", 2023-10-07T08:52:20.260 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:52:20.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:52:20.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:52:20.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:52:20.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.261 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-07T08:52:20.261 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlN0UcHhAA0o1jHEL9Ow40VDezKTunOw==", 2023-10-07T08:52:20.261 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:52:20.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:52:20.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:52:20.261 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:52:20.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.262 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-07T08:52:20.262 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlvsm6GRAApZehzqt3HugU+h9RGWQh8g==", 2023-10-07T08:52:20.262 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:52:20.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:52:20.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:52:20.262 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:52:20.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.262 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-07T08:52:20.263 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8XLiJBAAMBqSo/+NZuuL/pPnTitAUw==", 2023-10-07T08:52:20.263 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:52:20.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:52:20.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:52:20.263 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:52:20.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.263 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-07T08:52:20.263 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD2GSFlwYNOOBAAMpoFTAZdRERvqFbI4Lno9g==", 2023-10-07T08:52:20.263 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:52:20.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:52:20.264 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:52:20.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.264 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-07T08:52:20.264 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlejEnBBAAsnZCgsTTMWvqr2n4FfgWCQ==", 2023-10-07T08:52:20.264 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:52:20.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:52:20.264 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:52:20.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.265 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-07T08:52:20.265 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlDjS3DRAAfyBS9XSkAY6Se+RNw9jwWw==", 2023-10-07T08:52:20.265 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:52:20.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:52:20.265 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:52:20.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.265 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-07T08:52:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlnLaEFxAAtQ3AxrEGCcXYvJF2/wP1yw==", 2023-10-07T08:52:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:52:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:52:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:52:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-07T08:52:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlllNdIRAAXgD+PAR1Piya6p94xfGbXA==", 2023-10-07T08:52:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:52:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:52:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:52:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-07T08:52:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFleIM7KBAAIz+WlbgsmtAuSMPO+kh/Xw==", 2023-10-07T08:52:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:52:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:52:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:52:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-07T08:52:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlFNlEMRAAt7dpMTylOj0KsJy/law6Nw==", 2023-10-07T08:52:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:52:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:52:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:52:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-07T08:52:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFloCRbOhAA8XzXVwVYYYZIJV+F84EiDQ==", 2023-10-07T08:52:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:52:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:52:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:52:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-07T08:52:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl7cS0KBAA2K6kkFjyEZYa0xYx53Nf7g==", 2023-10-07T08:52:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:52:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-07T08:52:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T08:52:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-07T08:52:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlP3EBMRAAWXcQeEkoEzBCSQzvz/AzBQ==", 2023-10-07T08:52:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:52:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:52:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:52:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:52:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-07T08:52:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFldtgKLhAAX8L0S1NgyHsOj4cUljxH/A==", 2023-10-07T08:52:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:52:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:52:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:52:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:52:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-07T08:52:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlJ+VXNhAA9sXFpdOEIZxQLiS8LJwa3A==", 2023-10-07T08:52:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:52:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:52:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:52:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:52:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-07T08:52:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDyGSFle021MxAA39oudTkATALz6ZklfA0QQA==", 2023-10-07T08:52:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:52:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:52:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:52:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:52:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-07T08:52:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8c3zDxAAKU/DHPPZhFJ1MKw48C6lJQ==", 2023-10-07T08:52:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:52:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:52:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:52:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:52:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-07T08:52:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlByYuDBAA2xkiT3FNBRXjSMlu+GdRjg==", 2023-10-07T08:52:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:52:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:52:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:52:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:52:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:20.275 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:52:20.275 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:52:20.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.261+0000 7f53e8857700 1 -- 172.21.15.81:0/919706265 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f53d0066f30 msgr2=0x7f53d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.261+0000 7f53e8857700 1 --2- 172.21.15.81:0/919706265 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f53d0066f30 0x7f53d00693e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f53d4006fd0 tx=0x7f53d4008040 comp rx=0 tx=0).stop 2023-10-07T08:52:20.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.261+0000 7f53e8857700 1 -- 172.21.15.81:0/919706265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e4159b40 msgr2=0x7f53e40cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.261+0000 7f53e8857700 1 --2- 172.21.15.81:0/919706265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e4159b40 0x7f53e40cb6c0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f53d800c5b0 tx=0x7f53d8001070 comp rx=0 tx=0).stop 2023-10-07T08:52:20.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.261+0000 7f53e8857700 1 -- 172.21.15.81:0/919706265 shutdown_connections 2023-10-07T08:52:20.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.261+0000 7f53e8857700 1 --2- 172.21.15.81:0/919706265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e4159f10 0x7f53e40cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.261+0000 7f53e8857700 1 --2- 172.21.15.81:0/919706265 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f53d0066f30 0x7f53d00693e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.261+0000 7f53e8857700 1 --2- 172.21.15.81:0/919706265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e4068e90 0x7f53e4155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.261+0000 7f53e8857700 1 --2- 172.21.15.81:0/919706265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53e4159b40 0x7f53e40cb6c0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.261+0000 7f53e8857700 1 -- 172.21.15.81:0/919706265 >> 172.21.15.81:0/919706265 conn(0x7f53e40cd660 msgr2=0x7f53e40c6430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:20.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.261+0000 7f53e8857700 1 -- 172.21.15.81:0/919706265 shutdown_connections 2023-10-07T08:52:20.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.261+0000 7f53e8857700 1 -- 172.21.15.81:0/919706265 wait complete. 2023-10-07T08:52:20.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:52:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.391+0000 7f35f59c4700 1 Processor -- start 2023-10-07T08:52:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.391+0000 7f35f59c4700 1 -- start start 2023-10-07T08:52:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.392+0000 7f35f59c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35f006b0e0 0x7f35f0157840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.392+0000 7f35f59c4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f006ac50 con 0x7f35f00c8880 2023-10-07T08:52:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.392+0000 7f35f59c4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f00c8fd0 con 0x7f35f0156d60 2023-10-07T08:52:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.392+0000 7f35f59c4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f006a400 con 0x7f35f006b0e0 2023-10-07T08:52:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.392+0000 7f35e67fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f35f00c8880 0x7f35f0157130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45304/0 (socket says 172.21.15.81:45304) 2023-10-07T08:52:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.392+0000 7f35e67fc700 1 -- 172.21.15.81:0/1091017983 learned_addr learned my addr 172.21.15.81:0/1091017983 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.393+0000 7f35ef7fe700 1 --2- 172.21.15.81:0/1091017983 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35f006b0e0 0x7f35f0157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.393+0000 7f35ee7fc700 1 -- 172.21.15.81:0/1091017983 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893422028 0 0) 0x7f35f006ac50 con 0x7f35f00c8880 2023-10-07T08:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.393+0000 7f35ee7fc700 1 -- 172.21.15.81:0/1091017983 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35dc003570 con 0x7f35f00c8880 2023-10-07T08:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.393+0000 7f35ee7fc700 1 -- 172.21.15.81:0/1091017983 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992462770 0 0) 0x7f35f00c8fd0 con 0x7f35f0156d60 2023-10-07T08:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.393+0000 7f35ee7fc700 1 -- 172.21.15.81:0/1091017983 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35f006ac50 con 0x7f35f0156d60 2023-10-07T08:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.393+0000 7f35ef7fe700 1 -- 172.21.15.81:0/1091017983 >> v1:172.21.15.89:6789/0 conn(0x7f35f0156d60 legacy=0x7f35f006ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.393+0000 7f35ef7fe700 1 -- 172.21.15.81:0/1091017983 >> v1:172.21.15.81:6789/0 conn(0x7f35f00c8880 legacy=0x7f35f0157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.393+0000 7f35ef7fe700 1 -- 172.21.15.81:0/1091017983 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f0157d80 con 0x7f35f006b0e0 2023-10-07T08:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.393+0000 7f35ef7fe700 1 --2- 172.21.15.81:0/1091017983 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35f006b0e0 0x7f35f0157840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009e90 tx=0x7f35e8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=112a1455fe92361e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.393+0000 7f35ee7fc700 1 -- 172.21.15.81:0/1091017983 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e800e070 con 0x7f35f006b0e0 2023-10-07T08:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.393+0000 7f35ee7fc700 1 -- 172.21.15.81:0/1091017983 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e800bb80 con 0x7f35f006b0e0 2023-10-07T08:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.393+0000 7f35ee7fc700 1 -- 172.21.15.81:0/1091017983 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8012430 con 0x7f35f006b0e0 2023-10-07T08:52:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.394+0000 7f35f59c4700 1 -- 172.21.15.81:0/1091017983 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35f006b0e0 msgr2=0x7f35f0157840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.394+0000 7f35f59c4700 1 --2- 172.21.15.81:0/1091017983 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35f006b0e0 0x7f35f0157840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009e90 tx=0x7f35e8009780 comp rx=0 tx=0).stop 2023-10-07T08:52:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.394+0000 7f35f59c4700 1 -- 172.21.15.81:0/1091017983 shutdown_connections 2023-10-07T08:52:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.394+0000 7f35f59c4700 1 --2- 172.21.15.81:0/1091017983 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35f006b0e0 0x7f35f0157840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.394+0000 7f35f59c4700 1 -- 172.21.15.81:0/1091017983 >> 172.21.15.81:0/1091017983 conn(0x7f35f00c9ca0 msgr2=0x7f35f00ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.394+0000 7f35f59c4700 1 -- 172.21.15.81:0/1091017983 shutdown_connections 2023-10-07T08:52:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.394+0000 7f35f59c4700 1 -- 172.21.15.81:0/1091017983 wait complete. 2023-10-07T08:52:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.395+0000 7f35f59c4700 1 Processor -- start 2023-10-07T08:52:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.395+0000 7f35f59c4700 1 -- start start 2023-10-07T08:52:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35f59c4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35f006b0e0 0x7f35f00c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35f59c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35f00c8880 0x7f35f00c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35f59c4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35f0156d60 0x7f35f0144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35f59c4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f0155520 con 0x7f35f0156d60 2023-10-07T08:52:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35f59c4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f00c49e0 con 0x7f35f006b0e0 2023-10-07T08:52:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35f59c4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f016a4d0 con 0x7f35f00c8880 2023-10-07T08:52:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35ef7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35f0156d60 0x7f35f0144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35ef7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35f0156d60 0x7f35f0144bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56070/0 (socket says 172.21.15.81:56070) 2023-10-07T08:52:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35ef7fe700 1 -- 172.21.15.81:0/1594337177 learned_addr learned my addr 172.21.15.81:0/1594337177 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35e67fc700 1 --2- 172.21.15.81:0/1594337177 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35f00c8880 0x7f35f00c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35eeffd700 1 --2- 172.21.15.81:0/1594337177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35f006b0e0 0x7f35f00c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35ef7fe700 1 -- 172.21.15.81:0/1594337177 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35f00c8880 msgr2=0x7f35f00c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35ef7fe700 1 --2- 172.21.15.81:0/1594337177 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35f00c8880 0x7f35f00c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35ef7fe700 1 -- 172.21.15.81:0/1594337177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35f006b0e0 msgr2=0x7f35f00c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35ef7fe700 1 --2- 172.21.15.81:0/1594337177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35f006b0e0 0x7f35f00c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35ef7fe700 1 -- 172.21.15.81:0/1594337177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e8009a20 con 0x7f35f0156d60 2023-10-07T08:52:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35ef7fe700 1 --2- 172.21.15.81:0/1594337177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35f0156d60 0x7f35f0144bb0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f35f0068570 tx=0x7f35e8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.396+0000 7f35e77fe700 1 -- 172.21.15.81:0/1594337177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8022070 con 0x7f35f0156d60 2023-10-07T08:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.397+0000 7f35e77fe700 1 -- 172.21.15.81:0/1594337177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e8012e30 con 0x7f35f0156d60 2023-10-07T08:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.397+0000 7f35e77fe700 1 -- 172.21.15.81:0/1594337177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e801c7e0 con 0x7f35f0156d60 2023-10-07T08:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.397+0000 7f35f59c4700 1 -- 172.21.15.81:0/1594337177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f016a7b0 con 0x7f35f0156d60 2023-10-07T08:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.397+0000 7f35f59c4700 1 -- 172.21.15.81:0/1594337177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f016ad70 con 0x7f35f0156d60 2023-10-07T08:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.397+0000 7f35f59c4700 1 -- 172.21.15.81:0/1594337177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f016afb0 con 0x7f35f0156d60 2023-10-07T08:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.398+0000 7f35e77fe700 1 -- 172.21.15.81:0/1594337177 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35e801cb50 con 0x7f35f0156d60 2023-10-07T08:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.398+0000 7f35e77fe700 1 --2- 172.21.15.81:0/1594337177 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f35d0066f30 0x7f35d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.398+0000 7f35eeffd700 1 --2- 172.21.15.81:0/1594337177 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f35d0066f30 0x7f35d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.398+0000 7f35e77fe700 1 -- 172.21.15.81:0/1594337177 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f35e8087d50 con 0x7f35f0156d60 2023-10-07T08:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.399+0000 7f35eeffd700 1 --2- 172.21.15.81:0/1594337177 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f35d0066f30 0x7f35d00693e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f35e0007fd0 tx=0x7f35e0007d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:20.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.403+0000 7f35e77fe700 1 -- 172.21.15.81:0/1594337177 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35e808b030 con 0x7f35f0156d60 2023-10-07T08:52:20.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.586+0000 7f35f59c4700 1 -- 172.21.15.81:0/1594337177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35f0071b10 con 0x7f35f0156d60 2023-10-07T08:52:20.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.586+0000 7f35e77fe700 1 -- 172.21.15.81:0/1594337177 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) v1 ==== 74+0+12097 (secure 0 0 0) 0x7f35e8058da0 con 0x7f35f0156d60 2023-10-07T08:52:20.587 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:20.587 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":169,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:52:19.860490+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:52:20.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.588+0000 7f35f59c4700 1 -- 172.21.15.81:0/1594337177 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f35d0066f30 msgr2=0x7f35d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.588+0000 7f35f59c4700 1 --2- 172.21.15.81:0/1594337177 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f35d0066f30 0x7f35d00693e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f35e0007fd0 tx=0x7f35e0007d10 comp rx=0 tx=0).stop 2023-10-07T08:52:20.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.588+0000 7f35f59c4700 1 -- 172.21.15.81:0/1594337177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35f0156d60 msgr2=0x7f35f0144bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.588+0000 7f35f59c4700 1 --2- 172.21.15.81:0/1594337177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35f0156d60 0x7f35f0144bb0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f35f0068570 tx=0x7f35e8019000 comp rx=0 tx=0).stop 2023-10-07T08:52:20.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.588+0000 7f35f59c4700 1 -- 172.21.15.81:0/1594337177 shutdown_connections 2023-10-07T08:52:20.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.588+0000 7f35f59c4700 1 --2- 172.21.15.81:0/1594337177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35f0156d60 0x7f35f0144bb0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.588+0000 7f35f59c4700 1 --2- 172.21.15.81:0/1594337177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35f006b0e0 0x7f35f00c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.588+0000 7f35f59c4700 1 --2- 172.21.15.81:0/1594337177 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f35d0066f30 0x7f35d00693e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.588+0000 7f35f59c4700 1 --2- 172.21.15.81:0/1594337177 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35f00c8880 0x7f35f00c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.588+0000 7f35f59c4700 1 -- 172.21.15.81:0/1594337177 >> 172.21.15.81:0/1594337177 conn(0x7f35f00c9ca0 msgr2=0x7f35f00cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:20.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.588+0000 7f35f59c4700 1 -- 172.21.15.81:0/1594337177 shutdown_connections 2023-10-07T08:52:20.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.588+0000 7f35f59c4700 1 -- 172.21.15.81:0/1594337177 wait complete. 2023-10-07T08:52:20.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T08:52:20.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:52:20.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.718+0000 7f3ee9f68700 1 Processor -- start 2023-10-07T08:52:20.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.718+0000 7f3ee9f68700 1 -- start start 2023-10-07T08:52:20.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.719+0000 7f3ee9f68700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ee4151f00 0x7f3ee4158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:20.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.719+0000 7f3ee9f68700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee40cbad0 con 0x7f3ee40aee20 2023-10-07T08:52:20.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.719+0000 7f3ee9f68700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee406d630 con 0x7f3ee41522d0 2023-10-07T08:52:20.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.719+0000 7f3ee9f68700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee406d910 con 0x7f3ee4151f00 2023-10-07T08:52:20.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.719+0000 7f3ee8f66700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ee4151f00 0x7f3ee4158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:20.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.719+0000 7f3ee9767700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3ee40aee20 0x7f3ee4159270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45312/0 (socket says 172.21.15.81:45312) 2023-10-07T08:52:20.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.719+0000 7f3ee9767700 1 -- 172.21.15.81:0/737236338 learned_addr learned my addr 172.21.15.81:0/737236338 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:20.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.719+0000 7f3ee8f66700 1 -- 172.21.15.81:0/737236338 >> v1:172.21.15.89:6789/0 conn(0x7f3ee41522d0 legacy=0x7f3ee40ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.719+0000 7f3ee8f66700 1 -- 172.21.15.81:0/737236338 >> v1:172.21.15.81:6789/0 conn(0x7f3ee40aee20 legacy=0x7f3ee4159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.719+0000 7f3ee8f66700 1 -- 172.21.15.81:0/737236338 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee406dbf0 con 0x7f3ee4151f00 2023-10-07T08:52:20.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.719+0000 7f3ee37fe700 1 -- 172.21.15.81:0/737236338 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103899505 0 0) 0x7f3ee40cbad0 con 0x7f3ee40aee20 2023-10-07T08:52:20.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.719+0000 7f3ee8f66700 1 --2- 172.21.15.81:0/737236338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee4151f00 0x7f3ee4158ad0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40098e0 tx=0x7f3ed40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1475a10c1e30a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:20.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.719+0000 7f3ee37fe700 1 -- 172.21.15.81:0/737236338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4009e80 con 0x7f3ee4151f00 2023-10-07T08:52:20.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.719+0000 7f3ee37fe700 1 -- 172.21.15.81:0/737236338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed400b860 con 0x7f3ee4151f00 2023-10-07T08:52:20.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.719+0000 7f3ee37fe700 1 -- 172.21.15.81:0/737236338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed400bbe0 con 0x7f3ee4151f00 2023-10-07T08:52:20.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.720+0000 7f3ee9f68700 1 -- 172.21.15.81:0/737236338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee4151f00 msgr2=0x7f3ee4158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.720+0000 7f3ee9f68700 1 --2- 172.21.15.81:0/737236338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee4151f00 0x7f3ee4158ad0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40098e0 tx=0x7f3ed40091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.720+0000 7f3ee9f68700 1 -- 172.21.15.81:0/737236338 shutdown_connections 2023-10-07T08:52:20.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.720+0000 7f3ee9f68700 1 --2- 172.21.15.81:0/737236338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee4151f00 0x7f3ee4158ad0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.720+0000 7f3ee9f68700 1 -- 172.21.15.81:0/737236338 >> 172.21.15.81:0/737236338 conn(0x7f3ee406bb90 msgr2=0x7f3ee406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:20.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.720+0000 7f3ee9f68700 1 -- 172.21.15.81:0/737236338 shutdown_connections 2023-10-07T08:52:20.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.720+0000 7f3ee9f68700 1 -- 172.21.15.81:0/737236338 wait complete. 2023-10-07T08:52:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.721+0000 7f3ee9f68700 1 Processor -- start 2023-10-07T08:52:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.721+0000 7f3ee9f68700 1 -- start start 2023-10-07T08:52:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee9f68700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ee40aee20 0x7f3ee416b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee9f68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee4151f00 0x7f3ee40c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee9f68700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ee41522d0 0x7f3ee40c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:20.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee9f68700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40b05d0 con 0x7f3ee4151f00 2023-10-07T08:52:20.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee9f68700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee414ec80 con 0x7f3ee41522d0 2023-10-07T08:52:20.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee9f68700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee415a430 con 0x7f3ee40aee20 2023-10-07T08:52:20.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee4151f00 0x7f3ee40c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:20.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee4151f00 0x7f3ee40c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56092/0 (socket says 172.21.15.81:56092) 2023-10-07T08:52:20.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee3fff700 1 -- 172.21.15.81:0/2474595222 learned_addr learned my addr 172.21.15.81:0/2474595222 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:20.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee8f66700 1 --2- 172.21.15.81:0/2474595222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ee40aee20 0x7f3ee416b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:20.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee9767700 1 --2- 172.21.15.81:0/2474595222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ee41522d0 0x7f3ee40c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:20.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee3fff700 1 -- 172.21.15.81:0/2474595222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ee40aee20 msgr2=0x7f3ee416b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee3fff700 1 --2- 172.21.15.81:0/2474595222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ee40aee20 0x7f3ee416b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee3fff700 1 -- 172.21.15.81:0/2474595222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ee41522d0 msgr2=0x7f3ee40c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee3fff700 1 --2- 172.21.15.81:0/2474595222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ee41522d0 0x7f3ee40c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee3fff700 1 -- 172.21.15.81:0/2474595222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed4009420 con 0x7f3ee4151f00 2023-10-07T08:52:20.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.722+0000 7f3ee3fff700 1 --2- 172.21.15.81:0/2474595222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee4151f00 0x7f3ee40c6d00 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00c4e0 tx=0x7f3ecc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:20.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.723+0000 7f3ee0ff9700 1 -- 172.21.15.81:0/2474595222 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc011590 con 0x7f3ee4151f00 2023-10-07T08:52:20.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.723+0000 7f3ee0ff9700 1 -- 172.21.15.81:0/2474595222 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc011710 con 0x7f3ee4151f00 2023-10-07T08:52:20.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.723+0000 7f3ee9f68700 1 -- 172.21.15.81:0/2474595222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee41595a0 con 0x7f3ee4151f00 2023-10-07T08:52:20.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.723+0000 7f3ee0ff9700 1 -- 172.21.15.81:0/2474595222 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc011ad0 con 0x7f3ee4151f00 2023-10-07T08:52:20.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.723+0000 7f3ee9f68700 1 -- 172.21.15.81:0/2474595222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee4159de0 con 0x7f3ee4151f00 2023-10-07T08:52:20.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.724+0000 7f3ee9f68700 1 -- 172.21.15.81:0/2474595222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee40676e0 con 0x7f3ee4151f00 2023-10-07T08:52:20.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.724+0000 7f3ee0ff9700 1 -- 172.21.15.81:0/2474595222 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ecc01b3b0 con 0x7f3ee4151f00 2023-10-07T08:52:20.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.724+0000 7f3ee0ff9700 1 --2- 172.21.15.81:0/2474595222 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3ec4066f30 0x7f3ec40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:20.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.724+0000 7f3ee0ff9700 1 -- 172.21.15.81:0/2474595222 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3ecc083670 con 0x7f3ee4151f00 2023-10-07T08:52:20.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.724+0000 7f3ee8f66700 1 --2- 172.21.15.81:0/2474595222 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3ec4066f30 0x7f3ec40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:20.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.725+0000 7f3ee8f66700 1 --2- 172.21.15.81:0/2474595222 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3ec4066f30 0x7f3ec40693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40093f0 tx=0x7f3ed4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:20.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.728+0000 7f3ee0ff9700 1 -- 172.21.15.81:0/2474595222 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ecc050c30 con 0x7f3ee4151f00 2023-10-07T08:52:20.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.911+0000 7f3ee9f68700 1 -- 172.21.15.81:0/2474595222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3ee4155c90 con 0x7f3ee4151f00 2023-10-07T08:52:20.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.912+0000 7f3ee0ff9700 1 -- 172.21.15.81:0/2474595222 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v169) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ecc017020 con 0x7f3ee4151f00 2023-10-07T08:52:20.912 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:52:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.914+0000 7f3ee9f68700 1 -- 172.21.15.81:0/2474595222 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3ec4066f30 msgr2=0x7f3ec40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.914+0000 7f3ee9f68700 1 --2- 172.21.15.81:0/2474595222 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3ec4066f30 0x7f3ec40693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40093f0 tx=0x7f3ed4017000 comp rx=0 tx=0).stop 2023-10-07T08:52:20.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.914+0000 7f3ee9f68700 1 -- 172.21.15.81:0/2474595222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee4151f00 msgr2=0x7f3ee40c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:20.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.914+0000 7f3ee9f68700 1 --2- 172.21.15.81:0/2474595222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee4151f00 0x7f3ee40c6d00 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00c4e0 tx=0x7f3ecc00c7f0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.914+0000 7f3ee9f68700 1 -- 172.21.15.81:0/2474595222 shutdown_connections 2023-10-07T08:52:20.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.914+0000 7f3ee9f68700 1 --2- 172.21.15.81:0/2474595222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ee41522d0 0x7f3ee40c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.914+0000 7f3ee9f68700 1 --2- 172.21.15.81:0/2474595222 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3ec4066f30 0x7f3ec40693e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.914+0000 7f3ee9f68700 1 --2- 172.21.15.81:0/2474595222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ee40aee20 0x7f3ee416b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.914+0000 7f3ee9f68700 1 --2- 172.21.15.81:0/2474595222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee4151f00 0x7f3ee40c6d00 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:20.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.914+0000 7f3ee9f68700 1 -- 172.21.15.81:0/2474595222 >> 172.21.15.81:0/2474595222 conn(0x7f3ee406bb90 msgr2=0x7f3ee40ca6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:20.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.914+0000 7f3ee9f68700 1 -- 172.21.15.81:0/2474595222 shutdown_connections 2023-10-07T08:52:20.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:20.914+0000 7f3ee9f68700 1 -- 172.21.15.81:0/2474595222 wait complete. 2023-10-07T08:52:20.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T08:52:21.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.039+0000 7f3bbefdb700 1 Processor -- start 2023-10-07T08:52:21.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.039+0000 7f3bbefdb700 1 -- start start 2023-10-07T08:52:21.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bbefdb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb80cae00 0x7f3bb80aa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:21.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bbefdb700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb806d350 con 0x7f3bb815daa0 2023-10-07T08:52:21.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bbefdb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb80c9ac0 con 0x7f3bb80cb2a0 2023-10-07T08:52:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bbefdb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb806c740 con 0x7f3bb80cae00 2023-10-07T08:52:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bbcd77700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3bb815daa0 0x7f3bb815de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45322/0 (socket says 172.21.15.81:45322) 2023-10-07T08:52:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bbcd77700 1 -- 172.21.15.81:0/2802161053 learned_addr learned my addr 172.21.15.81:0/2802161053 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bb77fe700 1 -- 172.21.15.81:0/2802161053 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767865164 0 0) 0x7f3bb806d350 con 0x7f3bb815daa0 2023-10-07T08:52:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bb77fe700 1 -- 172.21.15.81:0/2802161053 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ba8003570 con 0x7f3bb815daa0 2023-10-07T08:52:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bb7fff700 1 --2- 172.21.15.81:0/2802161053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb80cae00 0x7f3bb80aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bb77fe700 1 -- 172.21.15.81:0/2802161053 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 323111404 0 0) 0x7f3ba8003570 con 0x7f3bb815daa0 2023-10-07T08:52:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bb77fe700 1 -- 172.21.15.81:0/2802161053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb80cae00 msgr2=0x7f3bb80aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bb77fe700 1 --2- 172.21.15.81:0/2802161053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb80cae00 0x7f3bb80aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bb77fe700 1 -- 172.21.15.81:0/2802161053 >> v1:172.21.15.89:6789/0 conn(0x7f3bb80cb2a0 legacy=0x7f3bb80aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bb77fe700 1 -- 172.21.15.81:0/2802161053 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb806ca20 con 0x7f3bb815daa0 2023-10-07T08:52:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bb77fe700 1 -- 172.21.15.81:0/2802161053 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f3bac001470 con 0x7f3bb815daa0 2023-10-07T08:52:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bb7fff700 1 --2- 172.21.15.81:0/2802161053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb80cae00 0x7f3bb80aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.040+0000 7f3bb77fe700 1 -- 172.21.15.81:0/2802161053 >> v1:172.21.15.81:6789/0 conn(0x7f3bb815daa0 legacy=0x7f3bb815de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bb77fe700 1 --2- 172.21.15.81:0/2802161053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8003a90 0x7f3ba8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bb77fe700 1 --2- 172.21.15.81:0/2802161053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb80cae00 0x7f3ba8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bb77fe700 1 --2- 172.21.15.81:0/2802161053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba8004d50 0x7f3ba80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bb77fe700 1 -- 172.21.15.81:0/2802161053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb806c740 con 0x7f3ba8003a90 2023-10-07T08:52:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bb77fe700 1 -- 172.21.15.81:0/2802161053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba800bc70 con 0x7f3ba8004d50 2023-10-07T08:52:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bb77fe700 1 -- 172.21.15.81:0/2802161053 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba800be30 con 0x7f3bb80cae00 2023-10-07T08:52:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bbcd77700 1 --2- 172.21.15.81:0/2802161053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8003a90 0x7f3ba8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bb7fff700 1 --2- 172.21.15.81:0/2802161053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb80cae00 0x7f3ba8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bbd578700 1 --2- 172.21.15.81:0/2802161053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba8004d50 0x7f3ba80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bbcd77700 1 -- 172.21.15.81:0/2802161053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb80cae00 msgr2=0x7f3ba8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:21.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bbcd77700 1 --2- 172.21.15.81:0/2802161053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb80cae00 0x7f3ba8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bbcd77700 1 -- 172.21.15.81:0/2802161053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba8004d50 msgr2=0x7f3ba80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:21.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bbcd77700 1 --2- 172.21.15.81:0/2802161053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba8004d50 0x7f3ba80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bbcd77700 1 -- 172.21.15.81:0/2802161053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba8003570 con 0x7f3ba8003a90 2023-10-07T08:52:21.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bb7fff700 1 --2- 172.21.15.81:0/2802161053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb80cae00 0x7f3ba8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:21.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bbd578700 1 --2- 172.21.15.81:0/2802161053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba8004d50 0x7f3ba80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:21.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bbcd77700 1 --2- 172.21.15.81:0/2802161053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8003a90 0x7f3ba8003ea0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00c3c0 tx=0x7f3bac001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1b54d54650da42 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:21.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bb77fe700 1 -- 172.21.15.81:0/2802161053 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00cc90 con 0x7f3ba8003a90 2023-10-07T08:52:21.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bb77fe700 1 -- 172.21.15.81:0/2802161053 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac00cdf0 con 0x7f3ba8003a90 2023-10-07T08:52:21.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.041+0000 7f3bb77fe700 1 -- 172.21.15.81:0/2802161053 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac005b50 con 0x7f3ba8003a90 2023-10-07T08:52:21.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.042+0000 7f3bbefdb700 1 -- 172.21.15.81:0/2802161053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8003a90 msgr2=0x7f3ba8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.042+0000 7f3bbefdb700 1 --2- 172.21.15.81:0/2802161053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8003a90 0x7f3ba8003ea0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00c3c0 tx=0x7f3bac001e50 comp rx=0 tx=0).stop 2023-10-07T08:52:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.042+0000 7f3bbd578700 1 -- 172.21.15.81:0/2802161053 reap_dead start 2023-10-07T08:52:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.042+0000 7f3bbefdb700 1 -- 172.21.15.81:0/2802161053 shutdown_connections 2023-10-07T08:52:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.042+0000 7f3bbefdb700 1 -- 172.21.15.81:0/2802161053 >> 172.21.15.81:0/2802161053 conn(0x7f3bb80c9ca0 msgr2=0x7f3bb80ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.042+0000 7f3bbefdb700 1 -- 172.21.15.81:0/2802161053 shutdown_connections 2023-10-07T08:52:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.042+0000 7f3bbefdb700 1 -- 172.21.15.81:0/2802161053 wait complete. 2023-10-07T08:52:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.043+0000 7f3bbefdb700 1 Processor -- start 2023-10-07T08:52:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.043+0000 7f3bbefdb700 1 -- start start 2023-10-07T08:52:21.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbefdb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8003a90 0x7f3bb815a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:21.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbefdb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb80c42e0 0x7f3bb816aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:21.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbefdb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bb80b2120 0x7f3bb80b2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:21.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbefdb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb816afd0 con 0x7f3ba8003a90 2023-10-07T08:52:21.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbefdb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80b2ad0 con 0x7f3bb80b2120 2023-10-07T08:52:21.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbefdb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80c4750 con 0x7f3bb80c42e0 2023-10-07T08:52:21.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbcd77700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8003a90 0x7f3bb815a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:21.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbcd77700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8003a90 0x7f3bb815a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56114/0 (socket says 172.21.15.81:56114) 2023-10-07T08:52:21.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbcd77700 1 -- 172.21.15.81:0/1633819838 learned_addr learned my addr 172.21.15.81:0/1633819838 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:21.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbd578700 1 --2- 172.21.15.81:0/1633819838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bb80b2120 0x7f3bb80b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:21.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bb7fff700 1 --2- 172.21.15.81:0/1633819838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb80c42e0 0x7f3bb816aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:21.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbcd77700 1 -- 172.21.15.81:0/1633819838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb80c42e0 msgr2=0x7f3bb816aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:21.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbcd77700 1 --2- 172.21.15.81:0/1633819838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb80c42e0 0x7f3bb816aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbcd77700 1 -- 172.21.15.81:0/1633819838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bb80b2120 msgr2=0x7f3bb80b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:21.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbcd77700 1 --2- 172.21.15.81:0/1633819838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bb80b2120 0x7f3bb80b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbcd77700 1 -- 172.21.15.81:0/1633819838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb80c49e0 con 0x7f3ba8003a90 2023-10-07T08:52:21.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbcd77700 1 --2- 172.21.15.81:0/1633819838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8003a90 0x7f3bb815a9d0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800bc40 tx=0x7f3bac015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:21.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bb4ff9700 1 -- 172.21.15.81:0/1633819838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac001530 con 0x7f3ba8003a90 2023-10-07T08:52:21.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bb4ff9700 1 -- 172.21.15.81:0/1633819838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac0072e0 con 0x7f3ba8003a90 2023-10-07T08:52:21.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbefdb700 1 -- 172.21.15.81:0/1633819838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb80c4cc0 con 0x7f3ba8003a90 2023-10-07T08:52:21.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bb4ff9700 1 -- 172.21.15.81:0/1633819838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0076a0 con 0x7f3ba8003a90 2023-10-07T08:52:21.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.044+0000 7f3bbefdb700 1 -- 172.21.15.81:0/1633819838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb80c5280 con 0x7f3ba8003a90 2023-10-07T08:52:21.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.045+0000 7f3bbefdb700 1 -- 172.21.15.81:0/1633819838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb8068080 con 0x7f3ba8003a90 2023-10-07T08:52:21.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.046+0000 7f3bb4ff9700 1 -- 172.21.15.81:0/1633819838 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bac019030 con 0x7f3ba8003a90 2023-10-07T08:52:21.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.046+0000 7f3bb4ff9700 1 --2- 172.21.15.81:0/1633819838 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3b9c066f30 0x7f3b9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:21.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.046+0000 7f3bb4ff9700 1 -- 172.21.15.81:0/1633819838 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3bac085670 con 0x7f3ba8003a90 2023-10-07T08:52:21.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.046+0000 7f3bb7fff700 1 --2- 172.21.15.81:0/1633819838 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3b9c066f30 0x7f3b9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:21.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.046+0000 7f3bb7fff700 1 --2- 172.21.15.81:0/1633819838 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3b9c066f30 0x7f3b9c0693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4006d60 tx=0x7f3ba4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:21.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.050+0000 7f3bb4ff9700 1 -- 172.21.15.81:0/1633819838 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bac052cf0 con 0x7f3ba8003a90 2023-10-07T08:52:21.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.234+0000 7f3bbefdb700 1 -- 172.21.15.81:0/1633819838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3bb816afd0 con 0x7f3ba8003a90 2023-10-07T08:52:21.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.234+0000 7f3bb4ff9700 1 -- 172.21.15.81:0/1633819838 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v169) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3bac056310 con 0x7f3ba8003a90 2023-10-07T08:52:21.234 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-07T08:52:21.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:52:21.235 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-07T08:52:21.235 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-07T08:52:21.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:52:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-07T08:52:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.236+0000 7f3bbefdb700 1 -- 172.21.15.81:0/1633819838 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3b9c066f30 msgr2=0x7f3b9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.236+0000 7f3bbefdb700 1 --2- 172.21.15.81:0/1633819838 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3b9c066f30 0x7f3b9c0693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4006d60 tx=0x7f3ba4008040 comp rx=0 tx=0).stop 2023-10-07T08:52:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.236+0000 7f3bbefdb700 1 -- 172.21.15.81:0/1633819838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8003a90 msgr2=0x7f3bb815a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.236+0000 7f3bbefdb700 1 --2- 172.21.15.81:0/1633819838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8003a90 0x7f3bb815a9d0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800bc40 tx=0x7f3bac015000 comp rx=0 tx=0).stop 2023-10-07T08:52:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.236+0000 7f3bbefdb700 1 -- 172.21.15.81:0/1633819838 shutdown_connections 2023-10-07T08:52:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.236+0000 7f3bbefdb700 1 --2- 172.21.15.81:0/1633819838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bb80b2120 0x7f3bb80b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.236+0000 7f3bbefdb700 1 --2- 172.21.15.81:0/1633819838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8003a90 0x7f3bb815a9d0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.236+0000 7f3bbefdb700 1 --2- 172.21.15.81:0/1633819838 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3b9c066f30 0x7f3b9c0693e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.236+0000 7f3bbefdb700 1 --2- 172.21.15.81:0/1633819838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb80c42e0 0x7f3bb816aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.236+0000 7f3bbefdb700 1 -- 172.21.15.81:0/1633819838 >> 172.21.15.81:0/1633819838 conn(0x7f3bb80c9ca0 msgr2=0x7f3bb815de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.236+0000 7f3bbefdb700 1 -- 172.21.15.81:0/1633819838 shutdown_connections 2023-10-07T08:52:21.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.236+0000 7f3bbefdb700 1 -- 172.21.15.81:0/1633819838 wait complete. 2023-10-07T08:52:21.248 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T08:52:21.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T08:52:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.366+0000 7fa4c2ec9700 1 Processor -- start 2023-10-07T08:52:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.366+0000 7fa4c2ec9700 1 -- start start 2023-10-07T08:52:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.367+0000 7fa4c2ec9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa4bc1578d0 0x7fa4bc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.367+0000 7fa4c2ec9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa4bc06d120 0x7fa4bc06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.367+0000 7fa4c2ec9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc0d07c0 con 0x7fa4bc157ca0 2023-10-07T08:52:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.367+0000 7fa4c2ec9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc06da50 con 0x7fa4bc06d120 2023-10-07T08:52:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.367+0000 7fa4c2ec9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc0cfbb0 con 0x7fa4bc1578d0 2023-10-07T08:52:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.367+0000 7fa4c1466700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa4bc06d120 0x7fa4bc06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.367+0000 7fa4c1466700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa4bc06d120 0x7fa4bc06d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56122/0 (socket says 172.21.15.81:56122) 2023-10-07T08:52:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.367+0000 7fa4b3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa4bc157ca0 0x7fa4bc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45328/0 (socket says 172.21.15.81:45328) 2023-10-07T08:52:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.367+0000 7fa4c1466700 1 -- 172.21.15.81:0/1154734056 learned_addr learned my addr 172.21.15.81:0/1154734056 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.367+0000 7fa4c0c65700 1 --2- 172.21.15.81:0/1154734056 >> v2:172.21.15.89:3300/0 conn(0x7fa4bc1578d0 0x7fa4bc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.368+0000 7fa4c1466700 1 -- 172.21.15.81:0/1154734056 >> v2:172.21.15.89:3300/0 conn(0x7fa4bc1578d0 msgr2=0x7fa4bc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.368+0000 7fa4c1466700 1 --2- 172.21.15.81:0/1154734056 >> v2:172.21.15.89:3300/0 conn(0x7fa4bc1578d0 0x7fa4bc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.368+0000 7fa4c1466700 1 -- 172.21.15.81:0/1154734056 >> v1:172.21.15.81:6789/0 conn(0x7fa4bc157ca0 legacy=0x7fa4bc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.368+0000 7fa4c1466700 1 -- 172.21.15.81:0/1154734056 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc0cfe90 con 0x7fa4bc06d120 2023-10-07T08:52:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.368+0000 7fa4b37fe700 1 -- 172.21.15.81:0/1154734056 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597099394 0 0) 0x7fa4bc0d07c0 con 0x7fa4bc157ca0 2023-10-07T08:52:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.368+0000 7fa4c1466700 1 --2- 172.21.15.81:0/1154734056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06d120 0x7fa4bc06d510 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0646b0 tx=0x7fa4b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba56affe395c243 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.368+0000 7fa4b37fe700 1 -- 172.21.15.81:0/1154734056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4009e70 con 0x7fa4bc06d120 2023-10-07T08:52:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.368+0000 7fa4b37fe700 1 -- 172.21.15.81:0/1154734056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b400b860 con 0x7fa4bc06d120 2023-10-07T08:52:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.368+0000 7fa4b37fe700 1 -- 172.21.15.81:0/1154734056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400bc00 con 0x7fa4bc06d120 2023-10-07T08:52:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.368+0000 7fa4c2ec9700 1 -- 172.21.15.81:0/1154734056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06d120 msgr2=0x7fa4bc06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.368+0000 7fa4c2ec9700 1 --2- 172.21.15.81:0/1154734056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06d120 0x7fa4bc06d510 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0646b0 tx=0x7fa4b4009250 comp rx=0 tx=0).stop 2023-10-07T08:52:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.368+0000 7fa4c2ec9700 1 -- 172.21.15.81:0/1154734056 shutdown_connections 2023-10-07T08:52:21.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.368+0000 7fa4c2ec9700 1 --2- 172.21.15.81:0/1154734056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06d120 0x7fa4bc06d510 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.368+0000 7fa4c2ec9700 1 --2- 172.21.15.81:0/1154734056 >> v2:172.21.15.89:3300/0 conn(0x7fa4bc1578d0 0x7fa4bc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.368+0000 7fa4c2ec9700 1 -- 172.21.15.81:0/1154734056 >> 172.21.15.81:0/1154734056 conn(0x7fa4bc06bb90 msgr2=0x7fa4bc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:21.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.369+0000 7fa4c2ec9700 1 -- 172.21.15.81:0/1154734056 shutdown_connections 2023-10-07T08:52:21.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.369+0000 7fa4c2ec9700 1 -- 172.21.15.81:0/1154734056 wait complete. 2023-10-07T08:52:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.370+0000 7fa4c2ec9700 1 Processor -- start 2023-10-07T08:52:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.370+0000 7fa4c2ec9700 1 -- start start 2023-10-07T08:52:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.370+0000 7fa4c2ec9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06d120 0x7fa4bc0c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.370+0000 7fa4c2ec9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4bc1578d0 0x7fa4bc0c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.370+0000 7fa4c2ec9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4bc157ca0 0x7fa4bc16d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.370+0000 7fa4c2ec9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc0c6490 con 0x7fa4bc06d120 2023-10-07T08:52:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.370+0000 7fa4c2ec9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc0c6770 con 0x7fa4bc1578d0 2023-10-07T08:52:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.370+0000 7fa4c2ec9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc0c6a50 con 0x7fa4bc157ca0 2023-10-07T08:52:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.370+0000 7fa4c0c65700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06d120 0x7fa4bc0c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.371+0000 7fa4c0c65700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06d120 0x7fa4bc0c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56132/0 (socket says 172.21.15.81:56132) 2023-10-07T08:52:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.371+0000 7fa4c0c65700 1 -- 172.21.15.81:0/357860059 learned_addr learned my addr 172.21.15.81:0/357860059 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.371+0000 7fa4c0c65700 1 -- 172.21.15.81:0/357860059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4bc157ca0 msgr2=0x7fa4bc16d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.371+0000 7fa4c0c65700 1 --2- 172.21.15.81:0/357860059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4bc157ca0 0x7fa4bc16d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.371+0000 7fa4c0c65700 1 -- 172.21.15.81:0/357860059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4bc1578d0 msgr2=0x7fa4bc0c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.371+0000 7fa4c0c65700 1 --2- 172.21.15.81:0/357860059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4bc1578d0 0x7fa4bc0c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.371+0000 7fa4c0c65700 1 -- 172.21.15.81:0/357860059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b40094f0 con 0x7fa4bc06d120 2023-10-07T08:52:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.371+0000 7fa4c0c65700 1 --2- 172.21.15.81:0/357860059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06d120 0x7fa4bc0c7530 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009ef0 tx=0x7fa4b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.371+0000 7fa4b0ff9700 1 -- 172.21.15.81:0/357860059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b800cc50 con 0x7fa4bc06d120 2023-10-07T08:52:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.371+0000 7fa4b0ff9700 1 -- 172.21.15.81:0/357860059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b800f040 con 0x7fa4bc06d120 2023-10-07T08:52:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.371+0000 7fa4c2ec9700 1 -- 172.21.15.81:0/357860059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc0c6d30 con 0x7fa4bc06d120 2023-10-07T08:52:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.371+0000 7fa4b0ff9700 1 -- 172.21.15.81:0/357860059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8014480 con 0x7fa4bc06d120 2023-10-07T08:52:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.371+0000 7fa4c2ec9700 1 -- 172.21.15.81:0/357860059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc0c70c0 con 0x7fa4bc06d120 2023-10-07T08:52:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.372+0000 7fa4c2ec9700 1 -- 172.21.15.81:0/357860059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4bc067ac0 con 0x7fa4bc06d120 2023-10-07T08:52:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.372+0000 7fa4b0ff9700 1 -- 172.21.15.81:0/357860059 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4b80147f0 con 0x7fa4bc06d120 2023-10-07T08:52:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.373+0000 7fa4b0ff9700 1 --2- 172.21.15.81:0/357860059 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa4a8066f30 0x7fa4a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.373+0000 7fa4b3fff700 1 --2- 172.21.15.81:0/357860059 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa4a8066f30 0x7fa4a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.373+0000 7fa4b0ff9700 1 -- 172.21.15.81:0/357860059 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa4b8084c90 con 0x7fa4bc06d120 2023-10-07T08:52:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.373+0000 7fa4b3fff700 1 --2- 172.21.15.81:0/357860059 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa4a8066f30 0x7fa4a80693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0b5770 tx=0x7fa4ac007b70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:21.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.377+0000 7fa4b0ff9700 1 -- 172.21.15.81:0/357860059 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4b8052250 con 0x7fa4bc06d120 2023-10-07T08:52:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.562+0000 7fa4c2ec9700 1 -- 172.21.15.81:0/357860059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa4bc0d0170 con 0x7fa4bc06d120 2023-10-07T08:52:21.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.883+0000 7fa4b0ff9700 1 -- 172.21.15.81:0/357860059 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v170) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa4b8055870 con 0x7fa4bc06d120 2023-10-07T08:52:21.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.886+0000 7fa4c2ec9700 1 -- 172.21.15.81:0/357860059 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa4a8066f30 msgr2=0x7fa4a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:21.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.886+0000 7fa4c2ec9700 1 --2- 172.21.15.81:0/357860059 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa4a8066f30 0x7fa4a80693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0b5770 tx=0x7fa4ac007b70 comp rx=0 tx=0).stop 2023-10-07T08:52:21.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.886+0000 7fa4c2ec9700 1 -- 172.21.15.81:0/357860059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06d120 msgr2=0x7fa4bc0c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:21.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.886+0000 7fa4c2ec9700 1 --2- 172.21.15.81:0/357860059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06d120 0x7fa4bc0c7530 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009ef0 tx=0x7fa4b800b040 comp rx=0 tx=0).stop 2023-10-07T08:52:21.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.886+0000 7fa4c2ec9700 1 -- 172.21.15.81:0/357860059 shutdown_connections 2023-10-07T08:52:21.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.886+0000 7fa4c2ec9700 1 --2- 172.21.15.81:0/357860059 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa4a8066f30 0x7fa4a80693e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.886+0000 7fa4c2ec9700 1 --2- 172.21.15.81:0/357860059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4bc157ca0 0x7fa4bc16d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.886+0000 7fa4c2ec9700 1 --2- 172.21.15.81:0/357860059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06d120 0x7fa4bc0c7530 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.886+0000 7fa4c2ec9700 1 --2- 172.21.15.81:0/357860059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4bc1578d0 0x7fa4bc0c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:21.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.886+0000 7fa4c2ec9700 1 -- 172.21.15.81:0/357860059 >> 172.21.15.81:0/357860059 conn(0x7fa4bc06bb90 msgr2=0x7fa4bc156570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:21.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.886+0000 7fa4c2ec9700 1 -- 172.21.15.81:0/357860059 shutdown_connections 2023-10-07T08:52:21.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:21.886+0000 7fa4c2ec9700 1 -- 172.21.15.81:0/357860059 wait complete. 2023-10-07T08:52:21.888 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-07T08:52:21.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T08:52:22.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.020+0000 7f267b004700 1 Processor -- start 2023-10-07T08:52:22.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.020+0000 7f267b004700 1 -- start start 2023-10-07T08:52:22.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.021+0000 7f267b004700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f267406f4f0 0x7f26740b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:22.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.021+0000 7f267b004700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26740b2800 0x7f2674163bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:22.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.021+0000 7f267b004700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2674068d40 con 0x7f26740b1ef0 2023-10-07T08:52:22.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.021+0000 7f267b004700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267415a520 con 0x7f267406f4f0 2023-10-07T08:52:22.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.021+0000 7f267b004700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267406a1e0 con 0x7f26740b2800 2023-10-07T08:52:22.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.021+0000 7f2679801700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f267406f4f0 0x7f26740b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:22.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.021+0000 7f267a002700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f26740b1ef0 0x7f267406da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:40214/0 (socket says 172.21.15.81:40214) 2023-10-07T08:52:22.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.021+0000 7f267a803700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26740b2800 0x7f2674163bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:22.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.021+0000 7f267a002700 1 -- 172.21.15.81:0/2619299172 learned_addr learned my addr 172.21.15.81:0/2619299172 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:22.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.022+0000 7f2679000700 1 -- 172.21.15.81:0/2619299172 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168102492 0 0) 0x7f2674068d40 con 0x7f26740b1ef0 2023-10-07T08:52:22.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.022+0000 7f2679000700 1 -- 172.21.15.81:0/2619299172 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2660003570 con 0x7f26740b1ef0 2023-10-07T08:52:22.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.022+0000 7f267a803700 1 -- 172.21.15.81:0/2619299172 >> v2:172.21.15.89:3300/0 conn(0x7f267406f4f0 msgr2=0x7f26740b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:22.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.022+0000 7f267a803700 1 --2- 172.21.15.81:0/2619299172 >> v2:172.21.15.89:3300/0 conn(0x7f267406f4f0 0x7f26740b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:22.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.022+0000 7f267a803700 1 -- 172.21.15.81:0/2619299172 >> v1:172.21.15.89:6789/0 conn(0x7f26740b1ef0 legacy=0x7f267406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:22.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.022+0000 7f267a803700 1 -- 172.21.15.81:0/2619299172 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267406e2d0 con 0x7f26740b2800 2023-10-07T08:52:22.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.022+0000 7f2679801700 1 --2- 172.21.15.81:0/2619299172 >> v2:172.21.15.89:3300/0 conn(0x7f267406f4f0 0x7f26740b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:52:22.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.022+0000 7f267a803700 1 --2- 172.21.15.81:0/2619299172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26740b2800 0x7f2674163bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2670009e60 tx=0x7f2670009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=242ea6add4c79f10 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:22.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.022+0000 7f2679000700 1 -- 172.21.15.81:0/2619299172 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000e070 con 0x7f26740b2800 2023-10-07T08:52:22.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.022+0000 7f2679000700 1 -- 172.21.15.81:0/2619299172 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267000bab0 con 0x7f26740b2800 2023-10-07T08:52:22.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.022+0000 7f2679000700 1 -- 172.21.15.81:0/2619299172 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000be70 con 0x7f26740b2800 2023-10-07T08:52:22.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.023+0000 7f267b004700 1 -- 172.21.15.81:0/2619299172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26740b2800 msgr2=0x7f2674163bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:22.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.023+0000 7f267b004700 1 --2- 172.21.15.81:0/2619299172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26740b2800 0x7f2674163bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2670009e60 tx=0x7f2670009780 comp rx=0 tx=0).stop 2023-10-07T08:52:22.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.023+0000 7f267b004700 1 -- 172.21.15.81:0/2619299172 shutdown_connections 2023-10-07T08:52:22.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.023+0000 7f267b004700 1 --2- 172.21.15.81:0/2619299172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26740b2800 0x7f2674163bf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:22.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.023+0000 7f267b004700 1 --2- 172.21.15.81:0/2619299172 >> v2:172.21.15.89:3300/0 conn(0x7f267406f4f0 0x7f26740b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:22.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.023+0000 7f267b004700 1 -- 172.21.15.81:0/2619299172 >> 172.21.15.81:0/2619299172 conn(0x7f26740d0bb0 msgr2=0x7f26740d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:22.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.023+0000 7f267b004700 1 -- 172.21.15.81:0/2619299172 shutdown_connections 2023-10-07T08:52:22.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.023+0000 7f267b004700 1 -- 172.21.15.81:0/2619299172 wait complete. 2023-10-07T08:52:22.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.024+0000 7f267b004700 1 Processor -- start 2023-10-07T08:52:22.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.024+0000 7f267b004700 1 -- start start 2023-10-07T08:52:22.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.025+0000 7f267b004700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f267406f4f0 0x7f2674154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:22.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.025+0000 7f267b004700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26740b1ef0 0x7f267416a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:22.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.025+0000 7f267b004700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26740b2800 0x7f26740b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:22.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.025+0000 7f267b004700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267416b970 con 0x7f26740b1ef0 2023-10-07T08:52:22.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.025+0000 7f267b004700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267416aa90 con 0x7f267406f4f0 2023-10-07T08:52:22.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.025+0000 7f267b004700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267416ad60 con 0x7f26740b2800 2023-10-07T08:52:22.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.025+0000 7f2679801700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26740b1ef0 0x7f267416a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:22.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.025+0000 7f2679801700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26740b1ef0 0x7f267416a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56148/0 (socket says 172.21.15.81:56148) 2023-10-07T08:52:22.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.025+0000 7f2679801700 1 -- 172.21.15.81:0/1063018375 learned_addr learned my addr 172.21.15.81:0/1063018375 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:22.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.025+0000 7f267a803700 1 --2- 172.21.15.81:0/1063018375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26740b2800 0x7f26740b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:22.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.025+0000 7f267a002700 1 --2- 172.21.15.81:0/1063018375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f267406f4f0 0x7f2674154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:22.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.026+0000 7f2679801700 1 -- 172.21.15.81:0/1063018375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26740b2800 msgr2=0x7f26740b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:22.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.026+0000 7f2679801700 1 --2- 172.21.15.81:0/1063018375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26740b2800 0x7f26740b0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:22.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.026+0000 7f2679801700 1 -- 172.21.15.81:0/1063018375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f267406f4f0 msgr2=0x7f2674154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:22.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.026+0000 7f2679801700 1 --2- 172.21.15.81:0/1063018375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f267406f4f0 0x7f2674154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:22.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.026+0000 7f2679801700 1 -- 172.21.15.81:0/1063018375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2664009420 con 0x7f26740b1ef0 2023-10-07T08:52:22.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.026+0000 7f2679801700 1 --2- 172.21.15.81:0/1063018375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26740b1ef0 0x7f267416a550 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f266400ec80 tx=0x7f26640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:22.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.026+0000 7f2669ffb700 1 -- 172.21.15.81:0/1063018375 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266400c920 con 0x7f26740b1ef0 2023-10-07T08:52:22.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.026+0000 7f2669ffb700 1 -- 172.21.15.81:0/1063018375 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266400ca80 con 0x7f26740b1ef0 2023-10-07T08:52:22.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.026+0000 7f267b004700 1 -- 172.21.15.81:0/1063018375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2670009a20 con 0x7f26740b1ef0 2023-10-07T08:52:22.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.026+0000 7f2669ffb700 1 -- 172.21.15.81:0/1063018375 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266400ce00 con 0x7f26740b1ef0 2023-10-07T08:52:22.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.026+0000 7f267b004700 1 -- 172.21.15.81:0/1063018375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267416b320 con 0x7f26740b1ef0 2023-10-07T08:52:22.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.027+0000 7f267b004700 1 -- 172.21.15.81:0/1063018375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267416bb20 con 0x7f26740b1ef0 2023-10-07T08:52:22.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.027+0000 7f2669ffb700 1 -- 172.21.15.81:0/1063018375 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2664013680 con 0x7f26740b1ef0 2023-10-07T08:52:22.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.028+0000 7f2669ffb700 1 --2- 172.21.15.81:0/1063018375 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2658066f30 0x7f26580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:22.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.028+0000 7f2669ffb700 1 -- 172.21.15.81:0/1063018375 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f2664084a40 con 0x7f26740b1ef0 2023-10-07T08:52:22.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.028+0000 7f267a002700 1 --2- 172.21.15.81:0/1063018375 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2658066f30 0x7f26580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:22.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.028+0000 7f267a002700 1 --2- 172.21.15.81:0/1063018375 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2658066f30 0x7f26580693e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f266c007fd0 tx=0x7f266c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:22.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.032+0000 7f2669ffb700 1 -- 172.21.15.81:0/1063018375 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f267416bb20 con 0x7f26740b1ef0 2023-10-07T08:52:22.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.214+0000 7f267b004700 1 -- 172.21.15.81:0/1063018375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f267416bb20 con 0x7f26740b1ef0 2023-10-07T08:52:22.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.894+0000 7f2669ffb700 1 -- 172.21.15.81:0/1063018375 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v171) v1 ==== 170+0+0 (secure 0 0 0) 0x7f267416bb20 con 0x7f26740b1ef0 2023-10-07T08:52:22.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.902+0000 7f267b004700 1 -- 172.21.15.81:0/1063018375 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2658066f30 msgr2=0x7f26580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:22.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.902+0000 7f267b004700 1 --2- 172.21.15.81:0/1063018375 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2658066f30 0x7f26580693e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f266c007fd0 tx=0x7f266c009040 comp rx=0 tx=0).stop 2023-10-07T08:52:22.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.902+0000 7f267b004700 1 -- 172.21.15.81:0/1063018375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26740b1ef0 msgr2=0x7f267416a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:22.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.902+0000 7f267b004700 1 --2- 172.21.15.81:0/1063018375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26740b1ef0 0x7f267416a550 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f266400ec80 tx=0x7f26640091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:22.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.902+0000 7f267b004700 1 -- 172.21.15.81:0/1063018375 shutdown_connections 2023-10-07T08:52:22.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.902+0000 7f267b004700 1 --2- 172.21.15.81:0/1063018375 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2658066f30 0x7f26580693e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:22.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.903+0000 7f267b004700 1 --2- 172.21.15.81:0/1063018375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26740b2800 0x7f26740b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:22.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.903+0000 7f267b004700 1 --2- 172.21.15.81:0/1063018375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f267406f4f0 0x7f2674154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:22.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.903+0000 7f267b004700 1 --2- 172.21.15.81:0/1063018375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26740b1ef0 0x7f267416a550 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:22.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.903+0000 7f267b004700 1 -- 172.21.15.81:0/1063018375 >> 172.21.15.81:0/1063018375 conn(0x7f26740d0bb0 msgr2=0x7f26740b5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:22.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.903+0000 7f267b004700 1 -- 172.21.15.81:0/1063018375 shutdown_connections 2023-10-07T08:52:22.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:22.903+0000 7f267b004700 1 -- 172.21.15.81:0/1063018375 wait complete. 2023-10-07T08:52:22.906 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-07T08:52:22.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T08:52:23.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.035+0000 7f78349ce700 1 Processor -- start 2023-10-07T08:52:23.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.035+0000 7f78349ce700 1 -- start start 2023-10-07T08:52:23.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.036+0000 7f78349ce700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f78301578d0 0x7f78300cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.036+0000 7f78349ce700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7830157ca0 0x7f783015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.036+0000 7f78349ce700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78300d07c0 con 0x7f783006d120 2023-10-07T08:52:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.036+0000 7f78349ce700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78300cfbb0 con 0x7f78301578d0 2023-10-07T08:52:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.036+0000 7f78349ce700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78300cfe90 con 0x7f7830157ca0 2023-10-07T08:52:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.036+0000 7f782e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f78301578d0 0x7f78300cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.036+0000 7f782ed9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f783006d120 0x7f783015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50406/0 (socket says 172.21.15.81:50406) 2023-10-07T08:52:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.036+0000 7f782e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f78301578d0 0x7f78300cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35646/0 (socket says 172.21.15.81:35646) 2023-10-07T08:52:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.036+0000 7f782ed9d700 1 -- 172.21.15.81:0/1303963445 learned_addr learned my addr 172.21.15.81:0/1303963445 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.036+0000 7f7825d9b700 1 --2- 172.21.15.81:0/1303963445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7830157ca0 0x7f783015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.036+0000 7f782e59c700 1 -- 172.21.15.81:0/1303963445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7830157ca0 msgr2=0x7f783015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.036+0000 7f782e59c700 1 --2- 172.21.15.81:0/1303963445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7830157ca0 0x7f783015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.036+0000 7f782e59c700 1 -- 172.21.15.81:0/1303963445 >> v1:172.21.15.81:6789/0 conn(0x7f783006d120 legacy=0x7f783015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.036+0000 7f782dd9b700 1 -- 172.21.15.81:0/1303963445 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228541942 0 0) 0x7f78300d07c0 con 0x7f783006d120 2023-10-07T08:52:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.036+0000 7f782e59c700 1 -- 172.21.15.81:0/1303963445 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78300d0170 con 0x7f78301578d0 2023-10-07T08:52:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.037+0000 7f782e59c700 1 --2- 172.21.15.81:0/1303963445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78301578d0 0x7f78300cf4f0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f78200098e0 tx=0x7f78200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9cc63128beb9f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.037+0000 7f782dd9b700 1 -- 172.21.15.81:0/1303963445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782000b640 con 0x7f78301578d0 2023-10-07T08:52:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.037+0000 7f782dd9b700 1 -- 172.21.15.81:0/1303963445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782000b7a0 con 0x7f78301578d0 2023-10-07T08:52:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.037+0000 7f782dd9b700 1 -- 172.21.15.81:0/1303963445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782000bb40 con 0x7f78301578d0 2023-10-07T08:52:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.037+0000 7f78349ce700 1 -- 172.21.15.81:0/1303963445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78301578d0 msgr2=0x7f78300cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.037+0000 7f78349ce700 1 --2- 172.21.15.81:0/1303963445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78301578d0 0x7f78300cf4f0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f78200098e0 tx=0x7f78200091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.037+0000 7f78349ce700 1 -- 172.21.15.81:0/1303963445 shutdown_connections 2023-10-07T08:52:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.037+0000 7f78349ce700 1 --2- 172.21.15.81:0/1303963445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78301578d0 0x7f78300cf4f0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:23.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.037+0000 7f78349ce700 1 --2- 172.21.15.81:0/1303963445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7830157ca0 0x7f783015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:23.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.037+0000 7f78349ce700 1 -- 172.21.15.81:0/1303963445 >> 172.21.15.81:0/1303963445 conn(0x7f783006bb90 msgr2=0x7f783006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:23.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.037+0000 7f78349ce700 1 -- 172.21.15.81:0/1303963445 shutdown_connections 2023-10-07T08:52:23.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.037+0000 7f78349ce700 1 -- 172.21.15.81:0/1303963445 wait complete. 2023-10-07T08:52:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.038+0000 7f78349ce700 1 Processor -- start 2023-10-07T08:52:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.038+0000 7f78349ce700 1 -- start start 2023-10-07T08:52:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.039+0000 7f78349ce700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783006d120 0x7f7830154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.039+0000 7f78349ce700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78301578d0 0x7f78300cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.039+0000 7f78349ce700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7830157ca0 0x7f7830069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.039+0000 7f78349ce700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78300b3f80 con 0x7f7830157ca0 2023-10-07T08:52:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.039+0000 7f78349ce700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78300b4260 con 0x7f78301578d0 2023-10-07T08:52:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.039+0000 7f78349ce700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78300b4540 con 0x7f783006d120 2023-10-07T08:52:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.039+0000 7f782ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7830157ca0 0x7f7830069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.039+0000 7f782ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7830157ca0 0x7f7830069b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35650/0 (socket says 172.21.15.81:35650) 2023-10-07T08:52:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.039+0000 7f782ed9d700 1 -- 172.21.15.81:0/3030735048 learned_addr learned my addr 172.21.15.81:0/3030735048 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.039+0000 7f7825d9b700 1 --2- 172.21.15.81:0/3030735048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78301578d0 0x7f78300cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.039+0000 7f782e59c700 1 --2- 172.21.15.81:0/3030735048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783006d120 0x7f7830154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.040+0000 7f782ed9d700 1 -- 172.21.15.81:0/3030735048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783006d120 msgr2=0x7f7830154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.040+0000 7f782ed9d700 1 --2- 172.21.15.81:0/3030735048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783006d120 0x7f7830154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.040+0000 7f782ed9d700 1 -- 172.21.15.81:0/3030735048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78301578d0 msgr2=0x7f78300cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.040+0000 7f782ed9d700 1 --2- 172.21.15.81:0/3030735048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78301578d0 0x7f78300cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.040+0000 7f782ed9d700 1 -- 172.21.15.81:0/3030735048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7820009420 con 0x7f7830157ca0 2023-10-07T08:52:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.040+0000 7f782e59c700 1 --2- 172.21.15.81:0/3030735048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783006d120 0x7f7830154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.040+0000 7f7825d9b700 1 --2- 172.21.15.81:0/3030735048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78301578d0 0x7f78300cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.040+0000 7f782ed9d700 1 --2- 172.21.15.81:0/3030735048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7830157ca0 0x7f7830069b70 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f782800cc90 tx=0x7f7828001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.040+0000 7f7826ffd700 1 -- 172.21.15.81:0/3030735048 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782800cea0 con 0x7f7830157ca0 2023-10-07T08:52:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.040+0000 7f7826ffd700 1 -- 172.21.15.81:0/3030735048 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782800ab70 con 0x7f7830157ca0 2023-10-07T08:52:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.040+0000 7f7826ffd700 1 -- 172.21.15.81:0/3030735048 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280070f0 con 0x7f7830157ca0 2023-10-07T08:52:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.040+0000 7f78349ce700 1 -- 172.21.15.81:0/3030735048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78300b4820 con 0x7f7830157ca0 2023-10-07T08:52:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.040+0000 7f78349ce700 1 -- 172.21.15.81:0/3030735048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78300b3ba0 con 0x7f7830157ca0 2023-10-07T08:52:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.041+0000 7f78349ce700 1 -- 172.21.15.81:0/3030735048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78300b4fc0 con 0x7f7830157ca0 2023-10-07T08:52:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.041+0000 7f7826ffd700 1 -- 172.21.15.81:0/3030735048 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78280074a0 con 0x7f7830157ca0 2023-10-07T08:52:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.042+0000 7f7826ffd700 1 --2- 172.21.15.81:0/3030735048 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7810066f30 0x7f78100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.042+0000 7f7826ffd700 1 -- 172.21.15.81:0/3030735048 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f78280849f0 con 0x7f7830157ca0 2023-10-07T08:52:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.042+0000 7f782e59c700 1 --2- 172.21.15.81:0/3030735048 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7810066f30 0x7f78100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.042+0000 7f782e59c700 1 --2- 172.21.15.81:0/3030735048 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7810066f30 0x7f78100693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f78200093f0 tx=0x7f7820017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.046+0000 7f7826ffd700 1 -- 172.21.15.81:0/3030735048 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78300b4fc0 con 0x7f7830157ca0 2023-10-07T08:52:23.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.270+0000 7f78349ce700 1 -- 172.21.15.81:0/3030735048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f78300b4fc0 con 0x7f7830157ca0 2023-10-07T08:52:23.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.888+0000 7f7826ffd700 1 -- 172.21.15.81:0/3030735048 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v78) v1 ==== 174+0+0 (secure 0 0 0) 0x7f78300b4fc0 con 0x7f7830157ca0 2023-10-07T08:52:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.890+0000 7f78349ce700 1 -- 172.21.15.81:0/3030735048 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7810066f30 msgr2=0x7f78100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.890+0000 7f78349ce700 1 --2- 172.21.15.81:0/3030735048 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7810066f30 0x7f78100693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f78200093f0 tx=0x7f7820017000 comp rx=0 tx=0).stop 2023-10-07T08:52:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.890+0000 7f78349ce700 1 -- 172.21.15.81:0/3030735048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7830157ca0 msgr2=0x7f7830069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.890+0000 7f78349ce700 1 --2- 172.21.15.81:0/3030735048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7830157ca0 0x7f7830069b70 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f782800cc90 tx=0x7f7828001a80 comp rx=0 tx=0).stop 2023-10-07T08:52:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.890+0000 7f78349ce700 1 -- 172.21.15.81:0/3030735048 shutdown_connections 2023-10-07T08:52:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.890+0000 7f78349ce700 1 --2- 172.21.15.81:0/3030735048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7830157ca0 0x7f7830069b70 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.890+0000 7f78349ce700 1 --2- 172.21.15.81:0/3030735048 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7810066f30 0x7f78100693e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.890+0000 7f78349ce700 1 --2- 172.21.15.81:0/3030735048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783006d120 0x7f7830154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.890+0000 7f78349ce700 1 --2- 172.21.15.81:0/3030735048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78301578d0 0x7f78300cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.890+0000 7f78349ce700 1 -- 172.21.15.81:0/3030735048 >> 172.21.15.81:0/3030735048 conn(0x7f783006bb90 msgr2=0x7f7830156740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.890+0000 7f78349ce700 1 -- 172.21.15.81:0/3030735048 shutdown_connections 2023-10-07T08:52:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:23.890+0000 7f78349ce700 1 -- 172.21.15.81:0/3030735048 wait complete. 2023-10-07T08:52:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 20 and data pool 21 2023-10-07T08:52:23.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:52:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.019+0000 7fe2f8ab0700 1 Processor -- start 2023-10-07T08:52:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.019+0000 7fe2f8ab0700 1 -- start start 2023-10-07T08:52:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.020+0000 7fe2f8ab0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f40aacf0 0x7fe2f406e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.020+0000 7fe2f8ab0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40acc80 con 0x7fe2f40ce1f0 2023-10-07T08:52:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.020+0000 7fe2f8ab0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f415dfb0 con 0x7fe2f40ce5c0 2023-10-07T08:52:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.020+0000 7fe2f8ab0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40ab190 con 0x7fe2f40aacf0 2023-10-07T08:52:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.020+0000 7fe2f259c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe2f40ce1f0 0x7fe2f415e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50412/0 (socket says 172.21.15.81:50412) 2023-10-07T08:52:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.020+0000 7fe2f259c700 1 -- 172.21.15.81:0/3787285798 learned_addr learned my addr 172.21.15.81:0/3787285798 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f2d9d700 1 --2- 172.21.15.81:0/3787285798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f40aacf0 0x7fe2f406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 -- 172.21.15.81:0/3787285798 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432254270 0 0) 0x7fe2e4001490 con 0x7fe2f40ce1f0 2023-10-07T08:52:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 -- 172.21.15.81:0/3787285798 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2dc003570 con 0x7fe2f40ce1f0 2023-10-07T08:52:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 -- 172.21.15.81:0/3787285798 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669037737 0 0) 0x7fe2f415dfb0 con 0x7fe2f40ce5c0 2023-10-07T08:52:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 -- 172.21.15.81:0/3787285798 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e4001490 con 0x7fe2f40ce5c0 2023-10-07T08:52:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 -- 172.21.15.81:0/3787285798 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4118256632 0 0) 0x7fe2dc003570 con 0x7fe2f40ce1f0 2023-10-07T08:52:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 -- 172.21.15.81:0/3787285798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f40aacf0 msgr2=0x7fe2f406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:24.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 --2- 172.21.15.81:0/3787285798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f40aacf0 0x7fe2f406e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 -- 172.21.15.81:0/3787285798 >> v1:172.21.15.89:6789/0 conn(0x7fe2f40ce5c0 legacy=0x7fe2f40ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 -- 172.21.15.81:0/3787285798 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40acec0 con 0x7fe2f40ce1f0 2023-10-07T08:52:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 -- 172.21.15.81:0/3787285798 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fe2e4001980 con 0x7fe2f40ce1f0 2023-10-07T08:52:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 -- 172.21.15.81:0/3787285798 >> v1:172.21.15.81:6789/0 conn(0x7fe2f40ce1f0 legacy=0x7fe2f415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 --2- 172.21.15.81:0/3787285798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f40aacf0 0x7fe2dc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 --2- 172.21.15.81:0/3787285798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2dc004180 0x7fe2dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 --2- 172.21.15.81:0/3787285798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2dc004d50 0x7fe2dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 -- 172.21.15.81:0/3787285798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40ab190 con 0x7fe2dc004d50 2023-10-07T08:52:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 -- 172.21.15.81:0/3787285798 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc00bba0 con 0x7fe2dc004180 2023-10-07T08:52:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f159a700 1 -- 172.21.15.81:0/3787285798 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc00bd60 con 0x7fe2f40aacf0 2023-10-07T08:52:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f2d9d700 1 --2- 172.21.15.81:0/3787285798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2dc004d50 0x7fe2dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f259c700 1 --2- 172.21.15.81:0/3787285798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f40aacf0 0x7fe2dc003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f1d9b700 1 --2- 172.21.15.81:0/3787285798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2dc004180 0x7fe2dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f2d9d700 1 -- 172.21.15.81:0/3787285798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f40aacf0 msgr2=0x7fe2dc003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:24.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f2d9d700 1 --2- 172.21.15.81:0/3787285798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f40aacf0 0x7fe2dc003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f2d9d700 1 -- 172.21.15.81:0/3787285798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2dc004180 msgr2=0x7fe2dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:24.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f2d9d700 1 --2- 172.21.15.81:0/3787285798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2dc004180 0x7fe2dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.021+0000 7fe2f2d9d700 1 -- 172.21.15.81:0/3787285798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc003570 con 0x7fe2dc004d50 2023-10-07T08:52:24.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.022+0000 7fe2f2d9d700 1 --2- 172.21.15.81:0/3787285798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2dc004d50 0x7fe2dc0051c0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009c00 tx=0x7fe2ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc0201529f7168b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:24.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.022+0000 7fe2f159a700 1 -- 172.21.15.81:0/3787285798 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00e710 con 0x7fe2dc004d50 2023-10-07T08:52:24.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.022+0000 7fe2f159a700 1 -- 172.21.15.81:0/3787285798 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec00e870 con 0x7fe2dc004d50 2023-10-07T08:52:24.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.022+0000 7fe2f159a700 1 -- 172.21.15.81:0/3787285798 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00ec30 con 0x7fe2dc004d50 2023-10-07T08:52:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.022+0000 7fe2f8ab0700 1 -- 172.21.15.81:0/3787285798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2dc004d50 msgr2=0x7fe2dc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.022+0000 7fe2f8ab0700 1 --2- 172.21.15.81:0/3787285798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2dc004d50 0x7fe2dc0051c0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009c00 tx=0x7fe2ec0091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.022+0000 7fe2f2d9d700 1 -- 172.21.15.81:0/3787285798 reap_dead start 2023-10-07T08:52:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.022+0000 7fe2f8ab0700 1 -- 172.21.15.81:0/3787285798 shutdown_connections 2023-10-07T08:52:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.022+0000 7fe2f8ab0700 1 -- 172.21.15.81:0/3787285798 >> 172.21.15.81:0/3787285798 conn(0x7fe2f406cca0 msgr2=0x7fe2f406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.022+0000 7fe2f8ab0700 1 -- 172.21.15.81:0/3787285798 shutdown_connections 2023-10-07T08:52:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.022+0000 7fe2f8ab0700 1 -- 172.21.15.81:0/3787285798 wait complete. 2023-10-07T08:52:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.023+0000 7fe2f8ab0700 1 Processor -- start 2023-10-07T08:52:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.023+0000 7fe2f8ab0700 1 -- start start 2023-10-07T08:52:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.024+0000 7fe2f8ab0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2dc004d50 0x7fe2f41551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.024+0000 7fe2f8ab0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2f415bcf0 0x7fe2f415c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.024+0000 7fe2f8ab0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f4169ce0 0x7fe2f416a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.024+0000 7fe2f8ab0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40ae770 con 0x7fe2f415bcf0 2023-10-07T08:52:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.024+0000 7fe2f8ab0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40cc7d0 con 0x7fe2dc004d50 2023-10-07T08:52:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.024+0000 7fe2f8ab0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f41556f0 con 0x7fe2f4169ce0 2023-10-07T08:52:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.024+0000 7fe2f1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2f415bcf0 0x7fe2f415c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.024+0000 7fe2f1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2f415bcf0 0x7fe2f415c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35668/0 (socket says 172.21.15.81:35668) 2023-10-07T08:52:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.024+0000 7fe2f1d9b700 1 -- 172.21.15.81:0/2284899021 learned_addr learned my addr 172.21.15.81:0/2284899021 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.024+0000 7fe2f2d9d700 1 --2- 172.21.15.81:0/2284899021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f4169ce0 0x7fe2f416a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.024+0000 7fe2f259c700 1 --2- 172.21.15.81:0/2284899021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2dc004d50 0x7fe2f41551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.024+0000 7fe2f1d9b700 1 -- 172.21.15.81:0/2284899021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f4169ce0 msgr2=0x7fe2f416a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.024+0000 7fe2f1d9b700 1 --2- 172.21.15.81:0/2284899021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f4169ce0 0x7fe2f416a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.024+0000 7fe2f1d9b700 1 -- 172.21.15.81:0/2284899021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2dc004d50 msgr2=0x7fe2f41551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.024+0000 7fe2f1d9b700 1 --2- 172.21.15.81:0/2284899021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2dc004d50 0x7fe2f41551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.025+0000 7fe2f1d9b700 1 -- 172.21.15.81:0/2284899021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f415ac50 con 0x7fe2f415bcf0 2023-10-07T08:52:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.025+0000 7fe2f1d9b700 1 --2- 172.21.15.81:0/2284899021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2f415bcf0 0x7fe2f415c160 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8002b30 tx=0x7fe2e8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.025+0000 7fe2e27fc700 1 -- 172.21.15.81:0/2284899021 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e800f940 con 0x7fe2f415bcf0 2023-10-07T08:52:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.025+0000 7fe2e27fc700 1 -- 172.21.15.81:0/2284899021 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e800fac0 con 0x7fe2f415bcf0 2023-10-07T08:52:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.025+0000 7fe2f8ab0700 1 -- 172.21.15.81:0/2284899021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f415af30 con 0x7fe2f415bcf0 2023-10-07T08:52:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.025+0000 7fe2e27fc700 1 -- 172.21.15.81:0/2284899021 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e800fe80 con 0x7fe2f415bcf0 2023-10-07T08:52:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.025+0000 7fe2f8ab0700 1 -- 172.21.15.81:0/2284899021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f415b4f0 con 0x7fe2f415bcf0 2023-10-07T08:52:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.026+0000 7fe2f8ab0700 1 -- 172.21.15.81:0/2284899021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f4068900 con 0x7fe2f415bcf0 2023-10-07T08:52:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.026+0000 7fe2e27fc700 1 -- 172.21.15.81:0/2284899021 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2e80133f0 con 0x7fe2f415bcf0 2023-10-07T08:52:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.026+0000 7fe2e27fc700 1 --2- 172.21.15.81:0/2284899021 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe2d4066f30 0x7fe2d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.027+0000 7fe2e27fc700 1 -- 172.21.15.81:0/2284899021 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2e8084790 con 0x7fe2f415bcf0 2023-10-07T08:52:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.027+0000 7fe2f259c700 1 --2- 172.21.15.81:0/2284899021 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe2d4066f30 0x7fe2d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.027+0000 7fe2f259c700 1 --2- 172.21.15.81:0/2284899021 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe2d4066f30 0x7fe2d40693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40021b0 tx=0x7fe2e4006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.031+0000 7fe2e27fc700 1 -- 172.21.15.81:0/2284899021 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2e8051a00 con 0x7fe2f415bcf0 2023-10-07T08:52:24.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.214+0000 7fe2f8ab0700 1 -- 172.21.15.81:0/2284899021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2f40ad1a0 con 0x7fe2f415bcf0 2023-10-07T08:52:24.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.215+0000 7fe2e27fc700 1 -- 172.21.15.81:0/2284899021 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+15330 (secure 0 0 0) 0x7fe2e8055020 con 0x7fe2f415bcf0 2023-10-07T08:52:24.215 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:24.215 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":172,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:52:23.270579+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:52:21.579591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-07T08:52:22.231614+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:52:24.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.217+0000 7fe2f8ab0700 1 -- 172.21.15.81:0/2284899021 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe2d4066f30 msgr2=0x7fe2d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.217+0000 7fe2f8ab0700 1 --2- 172.21.15.81:0/2284899021 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe2d4066f30 0x7fe2d40693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40021b0 tx=0x7fe2e4006040 comp rx=0 tx=0).stop 2023-10-07T08:52:24.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.217+0000 7fe2f8ab0700 1 -- 172.21.15.81:0/2284899021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2f415bcf0 msgr2=0x7fe2f415c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.217+0000 7fe2f8ab0700 1 --2- 172.21.15.81:0/2284899021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2f415bcf0 0x7fe2f415c160 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8002b30 tx=0x7fe2e8007d30 comp rx=0 tx=0).stop 2023-10-07T08:52:24.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.217+0000 7fe2f8ab0700 1 -- 172.21.15.81:0/2284899021 shutdown_connections 2023-10-07T08:52:24.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.217+0000 7fe2f8ab0700 1 --2- 172.21.15.81:0/2284899021 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe2d4066f30 0x7fe2d40693e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.217+0000 7fe2f8ab0700 1 --2- 172.21.15.81:0/2284899021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f4169ce0 0x7fe2f416a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.217+0000 7fe2f8ab0700 1 --2- 172.21.15.81:0/2284899021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2dc004d50 0x7fe2f41551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.217+0000 7fe2f8ab0700 1 --2- 172.21.15.81:0/2284899021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2f415bcf0 0x7fe2f415c160 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.217+0000 7fe2f8ab0700 1 -- 172.21.15.81:0/2284899021 >> 172.21.15.81:0/2284899021 conn(0x7fe2f406cca0 msgr2=0x7fe2f40b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:24.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.217+0000 7fe2f8ab0700 1 -- 172.21.15.81:0/2284899021 shutdown_connections 2023-10-07T08:52:24.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.217+0000 7fe2f8ab0700 1 -- 172.21.15.81:0/2284899021 wait complete. 2023-10-07T08:52:24.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:52:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.345+0000 7f51289e8700 1 Processor -- start 2023-10-07T08:52:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.345+0000 7f51289e8700 1 -- start start 2023-10-07T08:52:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f51289e8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5124157ca0 0x7f51240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f51289e8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f512406d120 0x7f512406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f51289e8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f512406dac0 con 0x7f51241578d0 2023-10-07T08:52:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f51289e8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51240d07c0 con 0x7f512406d120 2023-10-07T08:52:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f51289e8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51240cfbb0 con 0x7f5124157ca0 2023-10-07T08:52:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512259c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f51241578d0 0x7f512415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50418/0 (socket says 172.21.15.81:50418) 2023-10-07T08:52:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512259c700 1 -- 172.21.15.81:0/3571778327 learned_addr learned my addr 172.21.15.81:0/3571778327 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f5121d9b700 1 --2- 172.21.15.81:0/3571778327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5124157ca0 0x7f51240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f5122d9d700 1 --2- 172.21.15.81:0/3571778327 >> v2:172.21.15.89:3300/0 conn(0x7f512406d120 0x7f512406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512159a700 1 -- 172.21.15.81:0/3571778327 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036557045 0 0) 0x7f511c001490 con 0x7f51241578d0 2023-10-07T08:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512159a700 1 -- 172.21.15.81:0/3571778327 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5110003570 con 0x7f51241578d0 2023-10-07T08:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512159a700 1 -- 172.21.15.81:0/3571778327 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2893932670 0 0) 0x7f5110003570 con 0x7f51241578d0 2023-10-07T08:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512159a700 1 -- 172.21.15.81:0/3571778327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5124157ca0 msgr2=0x7f51240cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512159a700 1 --2- 172.21.15.81:0/3571778327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5124157ca0 0x7f51240cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512159a700 1 -- 172.21.15.81:0/3571778327 >> v2:172.21.15.89:3300/0 conn(0x7f512406d120 msgr2=0x7f512406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512159a700 1 --2- 172.21.15.81:0/3571778327 >> v2:172.21.15.89:3300/0 conn(0x7f512406d120 0x7f512406d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512159a700 1 -- 172.21.15.81:0/3571778327 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51240cfe90 con 0x7f51241578d0 2023-10-07T08:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512159a700 1 -- 172.21.15.81:0/3571778327 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f511c001980 con 0x7f51241578d0 2023-10-07T08:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512159a700 1 -- 172.21.15.81:0/3571778327 >> v1:172.21.15.81:6789/0 conn(0x7f51241578d0 legacy=0x7f512415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512159a700 1 --2- 172.21.15.81:0/3571778327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5124157ca0 0x7f5110003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512159a700 1 --2- 172.21.15.81:0/3571778327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110003fe0 0x7f5110004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512159a700 1 --2- 172.21.15.81:0/3571778327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5110004d50 0x7f51100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512159a700 1 -- 172.21.15.81:0/3571778327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51240d07c0 con 0x7f5110003fe0 2023-10-07T08:52:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512159a700 1 -- 172.21.15.81:0/3571778327 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51240cfbb0 con 0x7f5110004d50 2023-10-07T08:52:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f512159a700 1 -- 172.21.15.81:0/3571778327 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511000ba90 con 0x7f5124157ca0 2023-10-07T08:52:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.346+0000 7f5121d9b700 1 --2- 172.21.15.81:0/3571778327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110003fe0 0x7f5110004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.347+0000 7f512259c700 1 --2- 172.21.15.81:0/3571778327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5124157ca0 0x7f5110003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.347+0000 7f5122d9d700 1 --2- 172.21.15.81:0/3571778327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5110004d50 0x7f51100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.347+0000 7f5121d9b700 1 -- 172.21.15.81:0/3571778327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5124157ca0 msgr2=0x7f5110003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.347+0000 7f5121d9b700 1 --2- 172.21.15.81:0/3571778327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5124157ca0 0x7f5110003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.347+0000 7f5121d9b700 1 -- 172.21.15.81:0/3571778327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5110004d50 msgr2=0x7f51100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.347+0000 7f5121d9b700 1 --2- 172.21.15.81:0/3571778327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5110004d50 0x7f51100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.347+0000 7f5121d9b700 1 -- 172.21.15.81:0/3571778327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5110003570 con 0x7f5110003fe0 2023-10-07T08:52:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.347+0000 7f5121d9b700 1 --2- 172.21.15.81:0/3571778327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110003fe0 0x7f5110004810 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f510c009c00 tx=0x7f510c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad6e93f7b7baa82 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.347+0000 7f512159a700 1 -- 172.21.15.81:0/3571778327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c00e6b0 con 0x7f5110003fe0 2023-10-07T08:52:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.347+0000 7f512159a700 1 -- 172.21.15.81:0/3571778327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c00e810 con 0x7f5110003fe0 2023-10-07T08:52:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.347+0000 7f512159a700 1 -- 172.21.15.81:0/3571778327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c00ebd0 con 0x7f5110003fe0 2023-10-07T08:52:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.347+0000 7f51289e8700 1 -- 172.21.15.81:0/3571778327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110003fe0 msgr2=0x7f5110004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.347+0000 7f51289e8700 1 --2- 172.21.15.81:0/3571778327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110003fe0 0x7f5110004810 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f510c009c00 tx=0x7f510c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.347+0000 7f5122d9d700 1 -- 172.21.15.81:0/3571778327 reap_dead start 2023-10-07T08:52:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.348+0000 7f51289e8700 1 -- 172.21.15.81:0/3571778327 shutdown_connections 2023-10-07T08:52:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.348+0000 7f51289e8700 1 -- 172.21.15.81:0/3571778327 >> 172.21.15.81:0/3571778327 conn(0x7f512406bb90 msgr2=0x7f512406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.348+0000 7f51289e8700 1 -- 172.21.15.81:0/3571778327 shutdown_connections 2023-10-07T08:52:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.348+0000 7f51289e8700 1 -- 172.21.15.81:0/3571778327 wait complete. 2023-10-07T08:52:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.349+0000 7f51289e8700 1 Processor -- start 2023-10-07T08:52:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.349+0000 7f51289e8700 1 -- start start 2023-10-07T08:52:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.349+0000 7f51289e8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110003fe0 0x7f51240c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.349+0000 7f51289e8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51240c7ec0 0x7f512416a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.349+0000 7f51289e8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f512416a6d0 0x7f512415c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.349+0000 7f51289e8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512416ac30 con 0x7f5110003fe0 2023-10-07T08:52:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.349+0000 7f51289e8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51240c8bf0 con 0x7f512416a6d0 2023-10-07T08:52:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.349+0000 7f51289e8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512416c370 con 0x7f51240c7ec0 2023-10-07T08:52:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.349+0000 7f512259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110003fe0 0x7f51240c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.349+0000 7f512259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110003fe0 0x7f51240c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35684/0 (socket says 172.21.15.81:35684) 2023-10-07T08:52:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.349+0000 7f512259c700 1 -- 172.21.15.81:0/1153690859 learned_addr learned my addr 172.21.15.81:0/1153690859 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.350+0000 7f5122d9d700 1 --2- 172.21.15.81:0/1153690859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f512416a6d0 0x7f512415c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.350+0000 7f512259c700 1 -- 172.21.15.81:0/1153690859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51240c7ec0 msgr2=0x7f512416a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.350+0000 7f512259c700 1 --2- 172.21.15.81:0/1153690859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51240c7ec0 0x7f512416a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.350+0000 7f512259c700 1 -- 172.21.15.81:0/1153690859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f512416a6d0 msgr2=0x7f512415c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.350+0000 7f512259c700 1 --2- 172.21.15.81:0/1153690859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f512416a6d0 0x7f512415c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.350+0000 7f512259c700 1 -- 172.21.15.81:0/1153690859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51240c8350 con 0x7f5110003fe0 2023-10-07T08:52:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.350+0000 7f512259c700 1 --2- 172.21.15.81:0/1153690859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110003fe0 0x7f51240c6b90 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f511c00acd0 tx=0x7f51240d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.350+0000 7f511a7fc700 1 -- 172.21.15.81:0/1153690859 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c007a90 con 0x7f5110003fe0 2023-10-07T08:52:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.350+0000 7f511a7fc700 1 -- 172.21.15.81:0/1153690859 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c0133f0 con 0x7f5110003fe0 2023-10-07T08:52:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.350+0000 7f511a7fc700 1 -- 172.21.15.81:0/1153690859 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0137b0 con 0x7f5110003fe0 2023-10-07T08:52:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.350+0000 7f51289e8700 1 -- 172.21.15.81:0/1153690859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51240c8630 con 0x7f5110003fe0 2023-10-07T08:52:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.350+0000 7f51289e8700 1 -- 172.21.15.81:0/1153690859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51240c70d0 con 0x7f5110003fe0 2023-10-07T08:52:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.351+0000 7f51289e8700 1 -- 172.21.15.81:0/1153690859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5124067ac0 con 0x7f5110003fe0 2023-10-07T08:52:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.351+0000 7f511a7fc700 1 -- 172.21.15.81:0/1153690859 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f511c013b20 con 0x7f5110003fe0 2023-10-07T08:52:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.352+0000 7f511a7fc700 1 --2- 172.21.15.81:0/1153690859 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5104066f30 0x7f51040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.352+0000 7f511a7fc700 1 -- 172.21.15.81:0/1153690859 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f511c0851f0 con 0x7f5110003fe0 2023-10-07T08:52:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.352+0000 7f5121d9b700 1 --2- 172.21.15.81:0/1153690859 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5104066f30 0x7f51040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.352+0000 7f5121d9b700 1 --2- 172.21.15.81:0/1153690859 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5104066f30 0x7f51040693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f512406a890 tx=0x7f510c01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.356+0000 7f511a7fc700 1 -- 172.21.15.81:0/1153690859 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f511c052460 con 0x7f5110003fe0 2023-10-07T08:52:24.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.537+0000 7f51289e8700 1 -- 172.21.15.81:0/1153690859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f512406dac0 con 0x7f5110003fe0 2023-10-07T08:52:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.538+0000 7f511a7fc700 1 -- 172.21.15.81:0/1153690859 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+15317 (secure 0 0 0) 0x7f512406dac0 con 0x7f5110003fe0 2023-10-07T08:52:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:24.539 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":173,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:52:24.324059+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:52:21.579591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-07T08:52:22.231614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:52:24.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.540+0000 7f51289e8700 1 -- 172.21.15.81:0/1153690859 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5104066f30 msgr2=0x7f51040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.540+0000 7f51289e8700 1 --2- 172.21.15.81:0/1153690859 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5104066f30 0x7f51040693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f512406a890 tx=0x7f510c01a000 comp rx=0 tx=0).stop 2023-10-07T08:52:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.540+0000 7f51289e8700 1 -- 172.21.15.81:0/1153690859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110003fe0 msgr2=0x7f51240c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.540+0000 7f51289e8700 1 --2- 172.21.15.81:0/1153690859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110003fe0 0x7f51240c6b90 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f511c00acd0 tx=0x7f51240d0730 comp rx=0 tx=0).stop 2023-10-07T08:52:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.540+0000 7f51289e8700 1 -- 172.21.15.81:0/1153690859 shutdown_connections 2023-10-07T08:52:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.540+0000 7f51289e8700 1 --2- 172.21.15.81:0/1153690859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f512416a6d0 0x7f512415c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.540+0000 7f51289e8700 1 --2- 172.21.15.81:0/1153690859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110003fe0 0x7f51240c6b90 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.540+0000 7f51289e8700 1 --2- 172.21.15.81:0/1153690859 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5104066f30 0x7f51040693e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.540+0000 7f51289e8700 1 --2- 172.21.15.81:0/1153690859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51240c7ec0 0x7f512416a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.540+0000 7f51289e8700 1 -- 172.21.15.81:0/1153690859 >> 172.21.15.81:0/1153690859 conn(0x7f512406bb90 msgr2=0x7f51240688d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.540+0000 7f51289e8700 1 -- 172.21.15.81:0/1153690859 shutdown_connections 2023-10-07T08:52:24.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.540+0000 7f51289e8700 1 -- 172.21.15.81:0/1153690859 wait complete. 2023-10-07T08:52:24.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T08:52:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.670+0000 7f78137b4700 1 Processor -- start 2023-10-07T08:52:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.670+0000 7f78137b4700 1 -- start start 2023-10-07T08:52:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.671+0000 7f78137b4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f780c157ca0 0x7f780c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.671+0000 7f78137b4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c0d07c0 con 0x7f780c1578d0 2023-10-07T08:52:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.671+0000 7f78137b4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c0cfbb0 con 0x7f780c06d120 2023-10-07T08:52:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.671+0000 7f78137b4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0cfe90 con 0x7f780c157ca0 2023-10-07T08:52:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.671+0000 7f7811550700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f780c1578d0 0x7f780c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50430/0 (socket says 172.21.15.81:50430) 2023-10-07T08:52:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.671+0000 7f7811550700 1 -- 172.21.15.81:0/2986521904 learned_addr learned my addr 172.21.15.81:0/2986521904 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.671+0000 7f7810d4f700 1 --2- 172.21.15.81:0/2986521904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f780c157ca0 0x7f780c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.671+0000 7f780bfff700 1 -- 172.21.15.81:0/2986521904 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094077153 0 0) 0x7f780c0d07c0 con 0x7f780c1578d0 2023-10-07T08:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.671+0000 7f780bfff700 1 -- 172.21.15.81:0/2986521904 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f4003570 con 0x7f780c1578d0 2023-10-07T08:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.671+0000 7f780bfff700 1 -- 172.21.15.81:0/2986521904 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475048538 0 0) 0x7f780c0cfbb0 con 0x7f780c06d120 2023-10-07T08:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.671+0000 7f780bfff700 1 -- 172.21.15.81:0/2986521904 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f780c0d07c0 con 0x7f780c06d120 2023-10-07T08:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.671+0000 7f7810d4f700 1 -- 172.21.15.81:0/2986521904 >> v1:172.21.15.89:6789/0 conn(0x7f780c06d120 legacy=0x7f780c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.671+0000 7f780bfff700 1 -- 172.21.15.81:0/2986521904 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3950590147 0 0) 0x7f77f4003570 con 0x7f780c1578d0 2023-10-07T08:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.671+0000 7f7810d4f700 1 -- 172.21.15.81:0/2986521904 >> v1:172.21.15.81:6789/0 conn(0x7f780c1578d0 legacy=0x7f780c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.671+0000 7f7810d4f700 1 -- 172.21.15.81:0/2986521904 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c0d0170 con 0x7f780c157ca0 2023-10-07T08:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.672+0000 7f7810d4f700 1 --2- 172.21.15.81:0/2986521904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f780c157ca0 0x7f780c0cf4f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7800009910 tx=0x7f78000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bea956bb4457d576 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.672+0000 7f780bfff700 1 -- 172.21.15.81:0/2986521904 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78040017f0 con 0x7f780c157ca0 2023-10-07T08:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.672+0000 7f780bfff700 1 -- 172.21.15.81:0/2986521904 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7800011420 con 0x7f780c157ca0 2023-10-07T08:52:24.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.672+0000 7f780bfff700 1 -- 172.21.15.81:0/2986521904 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78000117c0 con 0x7f780c157ca0 2023-10-07T08:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.672+0000 7f78137b4700 1 -- 172.21.15.81:0/2986521904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f780c157ca0 msgr2=0x7f780c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.672+0000 7f78137b4700 1 --2- 172.21.15.81:0/2986521904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f780c157ca0 0x7f780c0cf4f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7800009910 tx=0x7f78000091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.672+0000 7f78137b4700 1 -- 172.21.15.81:0/2986521904 shutdown_connections 2023-10-07T08:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.672+0000 7f78137b4700 1 --2- 172.21.15.81:0/2986521904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f780c157ca0 0x7f780c0cf4f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.672+0000 7f78137b4700 1 -- 172.21.15.81:0/2986521904 >> 172.21.15.81:0/2986521904 conn(0x7f780c06bb90 msgr2=0x7f780c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.672+0000 7f78137b4700 1 -- 172.21.15.81:0/2986521904 shutdown_connections 2023-10-07T08:52:24.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.672+0000 7f78137b4700 1 -- 172.21.15.81:0/2986521904 wait complete. 2023-10-07T08:52:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.673+0000 7f78137b4700 1 Processor -- start 2023-10-07T08:52:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.673+0000 7f78137b4700 1 -- start start 2023-10-07T08:52:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.674+0000 7f78137b4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f780c06d120 0x7f780c154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.674+0000 7f78137b4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f780c1578d0 0x7f780c16b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.674+0000 7f78137b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f780c157ca0 0x7f780c15da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.674+0000 7f78137b4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0c6880 con 0x7f780c157ca0 2023-10-07T08:52:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.674+0000 7f78137b4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0c6270 con 0x7f780c06d120 2023-10-07T08:52:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.674+0000 7f78137b4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c1550e0 con 0x7f780c1578d0 2023-10-07T08:52:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.674+0000 7f7811d51700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f780c157ca0 0x7f780c15da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.674+0000 7f7811d51700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f780c157ca0 0x7f780c15da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35686/0 (socket says 172.21.15.81:35686) 2023-10-07T08:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.674+0000 7f7811d51700 1 -- 172.21.15.81:0/2058128725 learned_addr learned my addr 172.21.15.81:0/2058128725 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.675+0000 7f7810d4f700 1 --2- 172.21.15.81:0/2058128725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f780c1578d0 0x7f780c16b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.675+0000 7f7811550700 1 --2- 172.21.15.81:0/2058128725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f780c06d120 0x7f780c154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.675+0000 7f7811d51700 1 -- 172.21.15.81:0/2058128725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f780c1578d0 msgr2=0x7f780c16b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.675+0000 7f7811d51700 1 --2- 172.21.15.81:0/2058128725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f780c1578d0 0x7f780c16b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.675+0000 7f7811d51700 1 -- 172.21.15.81:0/2058128725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f780c06d120 msgr2=0x7f780c154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.675+0000 7f7811d51700 1 --2- 172.21.15.81:0/2058128725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f780c06d120 0x7f780c154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.675+0000 7f7811d51700 1 -- 172.21.15.81:0/2058128725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800009420 con 0x7f780c157ca0 2023-10-07T08:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.675+0000 7f7811d51700 1 --2- 172.21.15.81:0/2058128725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f780c157ca0 0x7f780c15da40 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00c590 tx=0x7f77fc007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.675+0000 7f78097fa700 1 -- 172.21.15.81:0/2058128725 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc016070 con 0x7f780c157ca0 2023-10-07T08:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.675+0000 7f78097fa700 1 -- 172.21.15.81:0/2058128725 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc011590 con 0x7f780c157ca0 2023-10-07T08:52:24.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.675+0000 7f78137b4700 1 -- 172.21.15.81:0/2058128725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c0c90b0 con 0x7f780c157ca0 2023-10-07T08:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.675+0000 7f78097fa700 1 -- 172.21.15.81:0/2058128725 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc011970 con 0x7f780c157ca0 2023-10-07T08:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.675+0000 7f78137b4700 1 -- 172.21.15.81:0/2058128725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c0c6510 con 0x7f780c157ca0 2023-10-07T08:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.676+0000 7f78137b4700 1 -- 172.21.15.81:0/2058128725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780c06a7f0 con 0x7f780c157ca0 2023-10-07T08:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.676+0000 7f78097fa700 1 -- 172.21.15.81:0/2058128725 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77fc012420 con 0x7f780c157ca0 2023-10-07T08:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.677+0000 7f78097fa700 1 --2- 172.21.15.81:0/2058128725 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f77f8066f30 0x7f77f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.677+0000 7f78097fa700 1 -- 172.21.15.81:0/2058128725 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f77fc084150 con 0x7f780c157ca0 2023-10-07T08:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.677+0000 7f7811550700 1 --2- 172.21.15.81:0/2058128725 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f77f8066f30 0x7f77f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:24.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.677+0000 7f7811550700 1 --2- 172.21.15.81:0/2058128725 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f77f8066f30 0x7f77f80693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7804001920 tx=0x7f7804000f40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:24.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.681+0000 7f78097fa700 1 -- 172.21.15.81:0/2058128725 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77fc0513c0 con 0x7f780c157ca0 2023-10-07T08:52:24.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:24.906+0000 7f78137b4700 1 -- 172.21.15.81:0/2058128725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f780c0d0450 con 0x7f780c157ca0 2023-10-07T08:52:25.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:25.901+0000 7f78097fa700 1 -- 172.21.15.81:0/2058128725 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v81) v1 ==== 118+0+0 (secure 0 0 0) 0x7f77fc0549e0 con 0x7f780c157ca0 2023-10-07T08:52:25.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:25.904+0000 7f78137b4700 1 -- 172.21.15.81:0/2058128725 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f77f8066f30 msgr2=0x7f77f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:25.904+0000 7f78137b4700 1 --2- 172.21.15.81:0/2058128725 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f77f8066f30 0x7f77f80693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7804001920 tx=0x7f7804000f40 comp rx=0 tx=0).stop 2023-10-07T08:52:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:25.904+0000 7f78137b4700 1 -- 172.21.15.81:0/2058128725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f780c157ca0 msgr2=0x7f780c15da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:25.904+0000 7f78137b4700 1 --2- 172.21.15.81:0/2058128725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f780c157ca0 0x7f780c15da40 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00c590 tx=0x7f77fc007d80 comp rx=0 tx=0).stop 2023-10-07T08:52:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:25.904+0000 7f78137b4700 1 -- 172.21.15.81:0/2058128725 shutdown_connections 2023-10-07T08:52:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:25.904+0000 7f78137b4700 1 --2- 172.21.15.81:0/2058128725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f780c157ca0 0x7f780c15da40 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:25.904+0000 7f78137b4700 1 --2- 172.21.15.81:0/2058128725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f780c06d120 0x7f780c154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:25.904+0000 7f78137b4700 1 --2- 172.21.15.81:0/2058128725 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f77f8066f30 0x7f77f80693e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:25.904+0000 7f78137b4700 1 --2- 172.21.15.81:0/2058128725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f780c1578d0 0x7f780c16b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:25.904+0000 7f78137b4700 1 -- 172.21.15.81:0/2058128725 >> 172.21.15.81:0/2058128725 conn(0x7f780c06bb90 msgr2=0x7f780c155970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:25.904+0000 7f78137b4700 1 -- 172.21.15.81:0/2058128725 shutdown_connections 2023-10-07T08:52:25.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:25.904+0000 7f78137b4700 1 -- 172.21.15.81:0/2058128725 wait complete. 2023-10-07T08:52:25.919 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T08:52:26.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.036+0000 7faf550f3700 1 Processor -- start 2023-10-07T08:52:26.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.036+0000 7faf550f3700 1 -- start start 2023-10-07T08:52:26.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.036+0000 7faf550f3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf500aeea0 0x7faf500c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:26.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.036+0000 7faf550f3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faf500c8410 0x7faf500c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:26.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.036+0000 7faf550f3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5006aae0 con 0x7faf500af270 2023-10-07T08:52:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.036+0000 7faf550f3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf50069ed0 con 0x7faf500c8410 2023-10-07T08:52:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.036+0000 7faf550f3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5006a1b0 con 0x7faf500aeea0 2023-10-07T08:52:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4e59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faf500af270 0x7faf500c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50434/0 (socket says 172.21.15.81:50434) 2023-10-07T08:52:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4e59c700 1 -- 172.21.15.81:0/870325289 learned_addr learned my addr 172.21.15.81:0/870325289 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4f59e700 1 --2- 172.21.15.81:0/870325289 >> v2:172.21.15.89:3300/0 conn(0x7faf500c8410 0x7faf500c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4dd9b700 1 -- 172.21.15.81:0/870325289 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587642847 0 0) 0x7faf5006aae0 con 0x7faf500af270 2023-10-07T08:52:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4ed9d700 1 --2- 172.21.15.81:0/870325289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf500aeea0 0x7faf500c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4dd9b700 1 -- 172.21.15.81:0/870325289 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf3c003570 con 0x7faf500af270 2023-10-07T08:52:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4dd9b700 1 -- 172.21.15.81:0/870325289 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2365662090 0 0) 0x7faf3c003570 con 0x7faf500af270 2023-10-07T08:52:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4dd9b700 1 -- 172.21.15.81:0/870325289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf500aeea0 msgr2=0x7faf500c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4dd9b700 1 --2- 172.21.15.81:0/870325289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf500aeea0 0x7faf500c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4dd9b700 1 -- 172.21.15.81:0/870325289 >> v2:172.21.15.89:3300/0 conn(0x7faf500c8410 msgr2=0x7faf500c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4dd9b700 1 --2- 172.21.15.81:0/870325289 >> v2:172.21.15.89:3300/0 conn(0x7faf500c8410 0x7faf500c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4dd9b700 1 -- 172.21.15.81:0/870325289 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5006a490 con 0x7faf500af270 2023-10-07T08:52:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4dd9b700 1 -- 172.21.15.81:0/870325289 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7faf38001470 con 0x7faf500af270 2023-10-07T08:52:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4dd9b700 1 -- 172.21.15.81:0/870325289 >> v1:172.21.15.81:6789/0 conn(0x7faf500af270 legacy=0x7faf500c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4dd9b700 1 --2- 172.21.15.81:0/870325289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf500aeea0 0x7faf3c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4dd9b700 1 --2- 172.21.15.81:0/870325289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf3c003fe0 0x7faf3c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4dd9b700 1 --2- 172.21.15.81:0/870325289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf3c004d50 0x7faf3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4dd9b700 1 -- 172.21.15.81:0/870325289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf50069ed0 con 0x7faf3c003fe0 2023-10-07T08:52:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4dd9b700 1 -- 172.21.15.81:0/870325289 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5006a1b0 con 0x7faf3c004d50 2023-10-07T08:52:26.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4dd9b700 1 -- 172.21.15.81:0/870325289 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c00ba90 con 0x7faf500aeea0 2023-10-07T08:52:26.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4e59c700 1 --2- 172.21.15.81:0/870325289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf3c003fe0 0x7faf3c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:26.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4ed9d700 1 --2- 172.21.15.81:0/870325289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf500aeea0 0x7faf3c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:26.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.037+0000 7faf4f59e700 1 --2- 172.21.15.81:0/870325289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf3c004d50 0x7faf3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:26.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.038+0000 7faf4e59c700 1 -- 172.21.15.81:0/870325289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf500aeea0 msgr2=0x7faf3c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:26.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.038+0000 7faf4e59c700 1 --2- 172.21.15.81:0/870325289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf500aeea0 0x7faf3c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:26.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.038+0000 7faf4e59c700 1 -- 172.21.15.81:0/870325289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf3c004d50 msgr2=0x7faf3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:26.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.038+0000 7faf4e59c700 1 --2- 172.21.15.81:0/870325289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf3c004d50 0x7faf3c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:26.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.038+0000 7faf4e59c700 1 -- 172.21.15.81:0/870325289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c003570 con 0x7faf3c003fe0 2023-10-07T08:52:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.038+0000 7faf4e59c700 1 --2- 172.21.15.81:0/870325289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf3c003fe0 0x7faf3c004810 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7faf3800c3c0 tx=0x7faf38001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321675d5f8cb4889 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.038+0000 7faf4dd9b700 1 -- 172.21.15.81:0/870325289 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3800cc30 con 0x7faf3c003fe0 2023-10-07T08:52:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.038+0000 7faf4dd9b700 1 -- 172.21.15.81:0/870325289 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3800cdb0 con 0x7faf3c003fe0 2023-10-07T08:52:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.038+0000 7faf4dd9b700 1 -- 172.21.15.81:0/870325289 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38005b70 con 0x7faf3c003fe0 2023-10-07T08:52:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.038+0000 7faf550f3700 1 -- 172.21.15.81:0/870325289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf3c003fe0 msgr2=0x7faf3c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.038+0000 7faf550f3700 1 --2- 172.21.15.81:0/870325289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf3c003fe0 0x7faf3c004810 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7faf3800c3c0 tx=0x7faf38001e90 comp rx=0 tx=0).stop 2023-10-07T08:52:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.038+0000 7faf4f59e700 1 -- 172.21.15.81:0/870325289 reap_dead start 2023-10-07T08:52:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.038+0000 7faf550f3700 1 -- 172.21.15.81:0/870325289 shutdown_connections 2023-10-07T08:52:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.039+0000 7faf550f3700 1 -- 172.21.15.81:0/870325289 >> 172.21.15.81:0/870325289 conn(0x7faf5006c660 msgr2=0x7faf500cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.039+0000 7faf550f3700 1 -- 172.21.15.81:0/870325289 shutdown_connections 2023-10-07T08:52:26.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.039+0000 7faf550f3700 1 -- 172.21.15.81:0/870325289 wait complete. 2023-10-07T08:52:26.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.040+0000 7faf550f3700 1 Processor -- start 2023-10-07T08:52:26.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.040+0000 7faf550f3700 1 -- start start 2023-10-07T08:52:26.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.040+0000 7faf550f3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf3c003fe0 0x7faf50159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:26.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.040+0000 7faf550f3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50157980 0x7faf500c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:26.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.040+0000 7faf550f3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf500c1810 0x7faf500c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:26.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf550f3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf500c21f0 con 0x7faf500c1810 2023-10-07T08:52:26.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf550f3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf500c4450 con 0x7faf3c003fe0 2023-10-07T08:52:26.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf550f3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5015a520 con 0x7faf50157980 2023-10-07T08:52:26.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf4f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf500c1810 0x7faf500c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:26.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf4f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf500c1810 0x7faf500c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35694/0 (socket says 172.21.15.81:35694) 2023-10-07T08:52:26.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf4f59e700 1 -- 172.21.15.81:0/3931733110 learned_addr learned my addr 172.21.15.81:0/3931733110 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:26.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf4ed9d700 1 --2- 172.21.15.81:0/3931733110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf3c003fe0 0x7faf50159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:26.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf4e59c700 1 --2- 172.21.15.81:0/3931733110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50157980 0x7faf500c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:26.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf4f59e700 1 -- 172.21.15.81:0/3931733110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50157980 msgr2=0x7faf500c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:26.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf4f59e700 1 --2- 172.21.15.81:0/3931733110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50157980 0x7faf500c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:26.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf4f59e700 1 -- 172.21.15.81:0/3931733110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf3c003fe0 msgr2=0x7faf50159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:26.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf4f59e700 1 --2- 172.21.15.81:0/3931733110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf3c003fe0 0x7faf50159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:26.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf4f59e700 1 -- 172.21.15.81:0/3931733110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5015a800 con 0x7faf500c1810 2023-10-07T08:52:26.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf4f59e700 1 --2- 172.21.15.81:0/3931733110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf500c1810 0x7faf500c1cb0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7faf500cda70 tx=0x7faf400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:26.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf46ffd700 1 -- 172.21.15.81:0/3931733110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf40013750 con 0x7faf500c1810 2023-10-07T08:52:26.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf46ffd700 1 -- 172.21.15.81:0/3931733110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf400138b0 con 0x7faf500c1810 2023-10-07T08:52:26.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf550f3700 1 -- 172.21.15.81:0/3931733110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5015aae0 con 0x7faf500c1810 2023-10-07T08:52:26.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf46ffd700 1 -- 172.21.15.81:0/3931733110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf40013c50 con 0x7faf500c1810 2023-10-07T08:52:26.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.041+0000 7faf550f3700 1 -- 172.21.15.81:0/3931733110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf50157df0 con 0x7faf500c1810 2023-10-07T08:52:26.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.042+0000 7faf550f3700 1 -- 172.21.15.81:0/3931733110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf500c4220 con 0x7faf500c1810 2023-10-07T08:52:26.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.043+0000 7faf46ffd700 1 -- 172.21.15.81:0/3931733110 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf40014440 con 0x7faf500c1810 2023-10-07T08:52:26.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.043+0000 7faf46ffd700 1 --2- 172.21.15.81:0/3931733110 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faf30066f30 0x7faf300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:26.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.043+0000 7faf46ffd700 1 -- 172.21.15.81:0/3931733110 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf40084a50 con 0x7faf500c1810 2023-10-07T08:52:26.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.043+0000 7faf4ed9d700 1 --2- 172.21.15.81:0/3931733110 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faf30066f30 0x7faf300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:26.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.043+0000 7faf4ed9d700 1 --2- 172.21.15.81:0/3931733110 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faf30066f30 0x7faf300693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7faf480094d0 tx=0x7faf4800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:26.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.047+0000 7faf46ffd700 1 -- 172.21.15.81:0/3931733110 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf500c4220 con 0x7faf500c1810 2023-10-07T08:52:26.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:52:26.259 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:52:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.277+0000 7faf550f3700 1 -- 172.21.15.81:0/3931733110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7faf500c4220 con 0x7faf500c1810 2023-10-07T08:52:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.907+0000 7faf46ffd700 1 -- 172.21.15.81:0/3931733110 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v82) v1 ==== 122+0+0 (secure 0 0 0) 0x7faf500c4220 con 0x7faf500c1810 2023-10-07T08:52:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.909+0000 7faf550f3700 1 -- 172.21.15.81:0/3931733110 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faf30066f30 msgr2=0x7faf300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.909+0000 7faf550f3700 1 --2- 172.21.15.81:0/3931733110 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faf30066f30 0x7faf300693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7faf480094d0 tx=0x7faf4800b040 comp rx=0 tx=0).stop 2023-10-07T08:52:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.909+0000 7faf550f3700 1 -- 172.21.15.81:0/3931733110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf500c1810 msgr2=0x7faf500c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.909+0000 7faf550f3700 1 --2- 172.21.15.81:0/3931733110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf500c1810 0x7faf500c1cb0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7faf500cda70 tx=0x7faf400091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.909+0000 7faf550f3700 1 -- 172.21.15.81:0/3931733110 shutdown_connections 2023-10-07T08:52:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.909+0000 7faf550f3700 1 --2- 172.21.15.81:0/3931733110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf500c1810 0x7faf500c1cb0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:26.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.909+0000 7faf550f3700 1 --2- 172.21.15.81:0/3931733110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf3c003fe0 0x7faf50159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:26.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.909+0000 7faf550f3700 1 --2- 172.21.15.81:0/3931733110 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7faf30066f30 0x7faf300693e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:26.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.909+0000 7faf550f3700 1 --2- 172.21.15.81:0/3931733110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50157980 0x7faf500c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:26.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.909+0000 7faf550f3700 1 -- 172.21.15.81:0/3931733110 >> 172.21.15.81:0/3931733110 conn(0x7faf5006c660 msgr2=0x7faf500cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:26.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.909+0000 7faf550f3700 1 -- 172.21.15.81:0/3931733110 shutdown_connections 2023-10-07T08:52:26.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:26.909+0000 7faf550f3700 1 -- 172.21.15.81:0/3931733110 wait complete. 2023-10-07T08:52:26.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:52:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.036+0000 7fb50ffff700 1 Processor -- start 2023-10-07T08:52:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.036+0000 7fb50ffff700 1 -- start start 2023-10-07T08:52:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb510159b40 0x7fb5100cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb510159f10 0x7fb510068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50ffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb5100ccb40 0x7fb510068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50ffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5100cee10 con 0x7fb510159f10 2023-10-07T08:52:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50ffff700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5100cd040 con 0x7fb5100ccb40 2023-10-07T08:52:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50ffff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5100cd320 con 0x7fb510159b40 2023-10-07T08:52:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb510159f10 0x7fb510068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb510159f10 0x7fb510068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35704/0 (socket says 172.21.15.81:35704) 2023-10-07T08:52:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50e7fc700 1 -- 172.21.15.81:0/810688987 learned_addr learned my addr 172.21.15.81:0/810688987 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50effd700 1 --2- 172.21.15.81:0/810688987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb510159b40 0x7fb5100cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50f7fe700 1 --2- 172.21.15.81:0/810688987 >> v2:172.21.15.89:3300/0 conn(0x7fb5100ccb40 0x7fb510068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50e7fc700 1 -- 172.21.15.81:0/810688987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb510159b40 msgr2=0x7fb5100cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50e7fc700 1 --2- 172.21.15.81:0/810688987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb510159b40 0x7fb5100cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50e7fc700 1 -- 172.21.15.81:0/810688987 >> v2:172.21.15.89:3300/0 conn(0x7fb5100ccb40 msgr2=0x7fb510068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50e7fc700 1 --2- 172.21.15.81:0/810688987 >> v2:172.21.15.89:3300/0 conn(0x7fb5100ccb40 0x7fb510068cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50e7fc700 1 -- 172.21.15.81:0/810688987 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5100ce7c0 con 0x7fb510159f10 2023-10-07T08:52:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50f7fe700 1 --2- 172.21.15.81:0/810688987 >> v2:172.21.15.89:3300/0 conn(0x7fb5100ccb40 0x7fb510068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:27.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50e7fc700 1 --2- 172.21.15.81:0/810688987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb510159f10 0x7fb510068780 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fb5100b6bf0 tx=0x7fb504009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad0e766c6cf1388 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:27.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50dffb700 1 -- 172.21.15.81:0/810688987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400b860 con 0x7fb510159f10 2023-10-07T08:52:27.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.037+0000 7fb50dffb700 1 -- 172.21.15.81:0/810688987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50400b9c0 con 0x7fb510159f10 2023-10-07T08:52:27.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.038+0000 7fb50dffb700 1 -- 172.21.15.81:0/810688987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400bd60 con 0x7fb510159f10 2023-10-07T08:52:27.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.038+0000 7fb50ffff700 1 -- 172.21.15.81:0/810688987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb510159f10 msgr2=0x7fb510068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:27.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.038+0000 7fb50ffff700 1 --2- 172.21.15.81:0/810688987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb510159f10 0x7fb510068780 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fb5100b6bf0 tx=0x7fb504009250 comp rx=0 tx=0).stop 2023-10-07T08:52:27.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.038+0000 7fb50ffff700 1 -- 172.21.15.81:0/810688987 shutdown_connections 2023-10-07T08:52:27.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.038+0000 7fb50ffff700 1 --2- 172.21.15.81:0/810688987 >> v2:172.21.15.89:3300/0 conn(0x7fb5100ccb40 0x7fb510068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.038+0000 7fb50ffff700 1 --2- 172.21.15.81:0/810688987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb510159b40 0x7fb5100cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.038+0000 7fb50ffff700 1 --2- 172.21.15.81:0/810688987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb510159f10 0x7fb510068780 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.038+0000 7fb50ffff700 1 -- 172.21.15.81:0/810688987 >> 172.21.15.81:0/810688987 conn(0x7fb5100cd660 msgr2=0x7fb5100cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.038+0000 7fb50ffff700 1 -- 172.21.15.81:0/810688987 shutdown_connections 2023-10-07T08:52:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.038+0000 7fb50ffff700 1 -- 172.21.15.81:0/810688987 wait complete. 2023-10-07T08:52:27.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.039+0000 7fb50ffff700 1 Processor -- start 2023-10-07T08:52:27.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.039+0000 7fb50ffff700 1 -- start start 2023-10-07T08:52:27.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.040+0000 7fb50ffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5100ccb40 0x7fb510154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.040+0000 7fb50ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb510159b40 0x7fb5100cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.040+0000 7fb50ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb510159f10 0x7fb5100cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.040+0000 7fb50ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51016a6b0 con 0x7fb510159b40 2023-10-07T08:52:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.040+0000 7fb50ffff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb510157660 con 0x7fb5100ccb40 2023-10-07T08:52:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.040+0000 7fb50ffff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb510157940 con 0x7fb510159f10 2023-10-07T08:52:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.040+0000 7fb50e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb510159b40 0x7fb5100cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.040+0000 7fb50e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb510159b40 0x7fb5100cf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35714/0 (socket says 172.21.15.81:35714) 2023-10-07T08:52:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.040+0000 7fb50e7fc700 1 -- 172.21.15.81:0/3101124213 learned_addr learned my addr 172.21.15.81:0/3101124213 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.040+0000 7fb50f7fe700 1 --2- 172.21.15.81:0/3101124213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb510159f10 0x7fb5100cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.040+0000 7fb50effd700 1 --2- 172.21.15.81:0/3101124213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5100ccb40 0x7fb510154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.040+0000 7fb50e7fc700 1 -- 172.21.15.81:0/3101124213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb510159f10 msgr2=0x7fb5100cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.040+0000 7fb50e7fc700 1 --2- 172.21.15.81:0/3101124213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb510159f10 0x7fb5100cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.040+0000 7fb50e7fc700 1 -- 172.21.15.81:0/3101124213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5100ccb40 msgr2=0x7fb510154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.040+0000 7fb50e7fc700 1 --2- 172.21.15.81:0/3101124213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5100ccb40 0x7fb510154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.040+0000 7fb50e7fc700 1 -- 172.21.15.81:0/3101124213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5040094f0 con 0x7fb510159b40 2023-10-07T08:52:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.041+0000 7fb50e7fc700 1 --2- 172.21.15.81:0/3101124213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb510159b40 0x7fb5100cf1a0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fb504009290 tx=0x7fb504017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.041+0000 7fb4f6ffd700 1 -- 172.21.15.81:0/3101124213 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb504026480 con 0x7fb510159b40 2023-10-07T08:52:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.041+0000 7fb4f6ffd700 1 -- 172.21.15.81:0/3101124213 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50401f070 con 0x7fb510159b40 2023-10-07T08:52:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.041+0000 7fb50ffff700 1 -- 172.21.15.81:0/3101124213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb510157c20 con 0x7fb510159b40 2023-10-07T08:52:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.041+0000 7fb4f6ffd700 1 -- 172.21.15.81:0/3101124213 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb504026830 con 0x7fb510159b40 2023-10-07T08:52:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.041+0000 7fb50ffff700 1 -- 172.21.15.81:0/3101124213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5100c6a50 con 0x7fb510159b40 2023-10-07T08:52:27.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.042+0000 7fb50ffff700 1 -- 172.21.15.81:0/3101124213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5100cb890 con 0x7fb510159b40 2023-10-07T08:52:27.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.042+0000 7fb4f6ffd700 1 -- 172.21.15.81:0/3101124213 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb504026ba0 con 0x7fb510159b40 2023-10-07T08:52:27.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.042+0000 7fb4f6ffd700 1 --2- 172.21.15.81:0/3101124213 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb4fc066f30 0x7fb4fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.043+0000 7fb50effd700 1 --2- 172.21.15.81:0/3101124213 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb4fc066f30 0x7fb4fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.043+0000 7fb4f6ffd700 1 -- 172.21.15.81:0/3101124213 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb504021070 con 0x7fb510159b40 2023-10-07T08:52:27.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.043+0000 7fb50effd700 1 --2- 172.21.15.81:0/3101124213 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb4fc066f30 0x7fb4fc0693e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb500006fd0 tx=0x7fb500008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:27.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.047+0000 7fb4f6ffd700 1 -- 172.21.15.81:0/3101124213 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5040536c0 con 0x7fb510159b40 2023-10-07T08:52:27.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.271+0000 7fb50ffff700 1 -- 172.21.15.81:0/3101124213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5100ceaa0 con 0x7fb510159b40 2023-10-07T08:52:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.271+0000 7fb4f6ffd700 1 -- 172.21.15.81:0/3101124213 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4598 (secure 0 0 0) 0x7fb504056ce0 con 0x7fb510159b40 2023-10-07T08:52:27.273 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:27.273 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3709604420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3709604420},{"type":"v1","addr":"172.21.15.89:6835","nonce":3709604420}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7842,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/517568220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":517568220},{"type":"v1","addr":"172.21.15.81:6836","nonce":517568220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7845,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2183069282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2183069282},{"type":"v1","addr":"172.21.15.81:6837","nonce":2183069282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:52:23.270892+0000","modified":"2023-10-07T08:52:26.901820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7851":{"gid":7851,"name":"b","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6834/3341511949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3341511949},{"type":"v1","addr":"172.21.15.89:6834","nonce":3341511949}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-07T08:52:27.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.273+0000 7fb50ffff700 1 -- 172.21.15.81:0/3101124213 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb4fc066f30 msgr2=0x7fb4fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:27.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.273+0000 7fb50ffff700 1 --2- 172.21.15.81:0/3101124213 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb4fc066f30 0x7fb4fc0693e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb500006fd0 tx=0x7fb500008040 comp rx=0 tx=0).stop 2023-10-07T08:52:27.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.273+0000 7fb50ffff700 1 -- 172.21.15.81:0/3101124213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb510159b40 msgr2=0x7fb5100cf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:27.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.273+0000 7fb50ffff700 1 --2- 172.21.15.81:0/3101124213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb510159b40 0x7fb5100cf1a0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fb504009290 tx=0x7fb504017000 comp rx=0 tx=0).stop 2023-10-07T08:52:27.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.273+0000 7fb50ffff700 1 -- 172.21.15.81:0/3101124213 shutdown_connections 2023-10-07T08:52:27.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.273+0000 7fb50ffff700 1 --2- 172.21.15.81:0/3101124213 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb4fc066f30 0x7fb4fc0693e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.273+0000 7fb50ffff700 1 --2- 172.21.15.81:0/3101124213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb510159f10 0x7fb5100cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.273+0000 7fb50ffff700 1 --2- 172.21.15.81:0/3101124213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5100ccb40 0x7fb510154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.273+0000 7fb50ffff700 1 --2- 172.21.15.81:0/3101124213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb510159b40 0x7fb5100cf1a0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.273+0000 7fb50ffff700 1 -- 172.21.15.81:0/3101124213 >> 172.21.15.81:0/3101124213 conn(0x7fb5100cd660 msgr2=0x7fb51006e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:27.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.274+0000 7fb50ffff700 1 -- 172.21.15.81:0/3101124213 shutdown_connections 2023-10-07T08:52:27.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.274+0000 7fb50ffff700 1 -- 172.21.15.81:0/3101124213 wait complete. 2023-10-07T08:52:27.277 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 82 2023-10-07T08:52:27.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:52:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.399+0000 7fa3354b1700 1 Processor -- start 2023-10-07T08:52:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.399+0000 7fa3354b1700 1 -- start start 2023-10-07T08:52:27.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.400+0000 7fa3354b1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa330159f10 0x7fa330068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.400+0000 7fa3354b1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa330068cc0 0x7fa3300cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.400+0000 7fa3354b1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3300cee10 con 0x7fa330159b40 2023-10-07T08:52:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.400+0000 7fa3354b1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa330069140 con 0x7fa330159f10 2023-10-07T08:52:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.400+0000 7fa3354b1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3300cd040 con 0x7fa330068cc0 2023-10-07T08:52:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.400+0000 7fa32f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa330159f10 0x7fa330068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.400+0000 7fa32f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa330159f10 0x7fa330068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35720/0 (socket says 172.21.15.81:35720) 2023-10-07T08:52:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.400+0000 7fa32f7fe700 1 -- 172.21.15.81:0/3231533056 learned_addr learned my addr 172.21.15.81:0/3231533056 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.400+0000 7fa32f7fe700 1 -- 172.21.15.81:0/3231533056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa330068cc0 msgr2=0x7fa3300cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.400+0000 7fa334cb0700 1 --2- 172.21.15.81:0/3231533056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa330068cc0 0x7fa3300cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.400+0000 7fa32f7fe700 1 --2- 172.21.15.81:0/3231533056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa330068cc0 0x7fa3300cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.400+0000 7fa32f7fe700 1 -- 172.21.15.81:0/3231533056 >> v1:172.21.15.89:6789/0 conn(0x7fa330159b40 legacy=0x7fa3300cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.400+0000 7fa32f7fe700 1 -- 172.21.15.81:0/3231533056 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3300cd320 con 0x7fa330159f10 2023-10-07T08:52:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.400+0000 7fa32f7fe700 1 --2- 172.21.15.81:0/3231533056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa330159f10 0x7fa330068780 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fa3240099b0 tx=0x7fa324009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca305ac330a5c2c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.400+0000 7fa32effd700 1 -- 172.21.15.81:0/3231533056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32400b820 con 0x7fa330159f10 2023-10-07T08:52:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.401+0000 7fa32effd700 1 -- 172.21.15.81:0/3231533056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32400b980 con 0x7fa330159f10 2023-10-07T08:52:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.401+0000 7fa32effd700 1 -- 172.21.15.81:0/3231533056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32400bd20 con 0x7fa330159f10 2023-10-07T08:52:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.401+0000 7fa3354b1700 1 -- 172.21.15.81:0/3231533056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa330159f10 msgr2=0x7fa330068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.401+0000 7fa3354b1700 1 --2- 172.21.15.81:0/3231533056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa330159f10 0x7fa330068780 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fa3240099b0 tx=0x7fa324009250 comp rx=0 tx=0).stop 2023-10-07T08:52:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.401+0000 7fa3354b1700 1 -- 172.21.15.81:0/3231533056 shutdown_connections 2023-10-07T08:52:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.401+0000 7fa3354b1700 1 --2- 172.21.15.81:0/3231533056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa330068cc0 0x7fa3300cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.401+0000 7fa3354b1700 1 --2- 172.21.15.81:0/3231533056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa330159f10 0x7fa330068780 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.401+0000 7fa3354b1700 1 -- 172.21.15.81:0/3231533056 >> 172.21.15.81:0/3231533056 conn(0x7fa3300cd660 msgr2=0x7fa3300cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:27.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.401+0000 7fa3354b1700 1 -- 172.21.15.81:0/3231533056 shutdown_connections 2023-10-07T08:52:27.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.401+0000 7fa3354b1700 1 -- 172.21.15.81:0/3231533056 wait complete. 2023-10-07T08:52:27.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.402+0000 7fa3354b1700 1 Processor -- start 2023-10-07T08:52:27.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.402+0000 7fa3354b1700 1 -- start start 2023-10-07T08:52:27.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.403+0000 7fa3354b1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa330068cc0 0x7fa33015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.403+0000 7fa3354b1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa330159b40 0x7fa33015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.403+0000 7fa3354b1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa330159f10 0x7fa33016ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.403+0000 7fa3354b1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33015c360 con 0x7fa330068cc0 2023-10-07T08:52:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.403+0000 7fa3354b1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3300c7ca0 con 0x7fa330159b40 2023-10-07T08:52:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.403+0000 7fa3354b1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3300c7f80 con 0x7fa330159f10 2023-10-07T08:52:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.403+0000 7fa32ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa330068cc0 0x7fa33015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.403+0000 7fa32ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa330068cc0 0x7fa33015bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35732/0 (socket says 172.21.15.81:35732) 2023-10-07T08:52:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.403+0000 7fa32ffff700 1 -- 172.21.15.81:0/543148065 learned_addr learned my addr 172.21.15.81:0/543148065 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.403+0000 7fa32f7fe700 1 --2- 172.21.15.81:0/543148065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa330159b40 0x7fa33015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.403+0000 7fa334cb0700 1 --2- 172.21.15.81:0/543148065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa330159f10 0x7fa33016ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.404+0000 7fa32ffff700 1 -- 172.21.15.81:0/543148065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa330159f10 msgr2=0x7fa33016ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.404+0000 7fa32ffff700 1 --2- 172.21.15.81:0/543148065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa330159f10 0x7fa33016ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.404+0000 7fa32ffff700 1 -- 172.21.15.81:0/543148065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa330159b40 msgr2=0x7fa33015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.404+0000 7fa32ffff700 1 --2- 172.21.15.81:0/543148065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa330159b40 0x7fa33015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.404+0000 7fa32ffff700 1 -- 172.21.15.81:0/543148065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3240094f0 con 0x7fa330068cc0 2023-10-07T08:52:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.404+0000 7fa334cb0700 1 --2- 172.21.15.81:0/543148065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa330159f10 0x7fa33016ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.404+0000 7fa32ffff700 1 --2- 172.21.15.81:0/543148065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa330068cc0 0x7fa33015bd80 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fa32000c5d0 tx=0x7fa320007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.404+0000 7fa317fff700 1 -- 172.21.15.81:0/543148065 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320011590 con 0x7fa330068cc0 2023-10-07T08:52:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.404+0000 7fa317fff700 1 -- 172.21.15.81:0/543148065 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa320011710 con 0x7fa330068cc0 2023-10-07T08:52:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.404+0000 7fa3354b1700 1 -- 172.21.15.81:0/543148065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3300c8260 con 0x7fa330068cc0 2023-10-07T08:52:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.404+0000 7fa317fff700 1 -- 172.21.15.81:0/543148065 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320011ad0 con 0x7fa330068cc0 2023-10-07T08:52:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.404+0000 7fa3354b1700 1 -- 172.21.15.81:0/543148065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33015b5e0 con 0x7fa330068cc0 2023-10-07T08:52:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.405+0000 7fa3354b1700 1 -- 172.21.15.81:0/543148065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3300c8780 con 0x7fa330068cc0 2023-10-07T08:52:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.405+0000 7fa317fff700 1 -- 172.21.15.81:0/543148065 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa32001c460 con 0x7fa330068cc0 2023-10-07T08:52:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.406+0000 7fa317fff700 1 --2- 172.21.15.81:0/543148065 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa31c066fb0 0x7fa31c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.406+0000 7fa317fff700 1 -- 172.21.15.81:0/543148065 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa320084330 con 0x7fa330068cc0 2023-10-07T08:52:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.406+0000 7fa32f7fe700 1 --2- 172.21.15.81:0/543148065 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa31c066fb0 0x7fa31c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.406+0000 7fa32f7fe700 1 --2- 172.21.15.81:0/543148065 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa31c066fb0 0x7fa31c069460 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa3240099b0 tx=0x7fa324016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.410+0000 7fa317fff700 1 -- 172.21.15.81:0/543148065 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa320051500 con 0x7fa330068cc0 2023-10-07T08:52:27.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.594+0000 7fa3354b1700 1 -- 172.21.15.81:0/543148065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3300cb890 con 0x7fa330068cc0 2023-10-07T08:52:27.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.595+0000 7fa317fff700 1 -- 172.21.15.81:0/543148065 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+15317 (secure 0 0 0) 0x7fa320054b20 con 0x7fa330068cc0 2023-10-07T08:52:27.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:27.596 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":173,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:52:24.324059+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:52:21.579591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-07T08:52:22.231614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:52:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.597+0000 7fa3354b1700 1 -- 172.21.15.81:0/543148065 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa31c066fb0 msgr2=0x7fa31c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.597+0000 7fa3354b1700 1 --2- 172.21.15.81:0/543148065 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa31c066fb0 0x7fa31c069460 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa3240099b0 tx=0x7fa324016000 comp rx=0 tx=0).stop 2023-10-07T08:52:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.597+0000 7fa3354b1700 1 -- 172.21.15.81:0/543148065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa330068cc0 msgr2=0x7fa33015bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.597+0000 7fa3354b1700 1 --2- 172.21.15.81:0/543148065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa330068cc0 0x7fa33015bd80 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fa32000c5d0 tx=0x7fa320007f60 comp rx=0 tx=0).stop 2023-10-07T08:52:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.597+0000 7fa3354b1700 1 -- 172.21.15.81:0/543148065 shutdown_connections 2023-10-07T08:52:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.597+0000 7fa3354b1700 1 --2- 172.21.15.81:0/543148065 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa31c066fb0 0x7fa31c069460 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.597+0000 7fa3354b1700 1 --2- 172.21.15.81:0/543148065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa330159f10 0x7fa33016ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.597+0000 7fa3354b1700 1 --2- 172.21.15.81:0/543148065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa330068cc0 0x7fa33015bd80 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.597+0000 7fa3354b1700 1 --2- 172.21.15.81:0/543148065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa330159b40 0x7fa33015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.597+0000 7fa3354b1700 1 -- 172.21.15.81:0/543148065 >> 172.21.15.81:0/543148065 conn(0x7fa3300cd660 msgr2=0x7fa3300c6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.597+0000 7fa3354b1700 1 -- 172.21.15.81:0/543148065 shutdown_connections 2023-10-07T08:52:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.597+0000 7fa3354b1700 1 -- 172.21.15.81:0/543148065 wait complete. 2023-10-07T08:52:27.610 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T08:52:27.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:52:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.723+0000 7f2737369700 1 Processor -- start 2023-10-07T08:52:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.724+0000 7f2737369700 1 -- start start 2023-10-07T08:52:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.724+0000 7f2737369700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27300b3bd0 0x7f27300ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.724+0000 7f2737369700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f27301583b0 0x7f27300cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.724+0000 7f2737369700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27300b2890 con 0x7f2730157fe0 2023-10-07T08:52:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.724+0000 7f2737369700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27300b4070 con 0x7f27300b3bd0 2023-10-07T08:52:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.724+0000 7f2737369700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27300b4350 con 0x7f27301583b0 2023-10-07T08:52:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.724+0000 7f2734904700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27300b3bd0 0x7f27300ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.725+0000 7f2734904700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27300b3bd0 0x7f27300ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35740/0 (socket says 172.21.15.81:35740) 2023-10-07T08:52:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.725+0000 7f2734904700 1 -- 172.21.15.81:0/2127040006 learned_addr learned my addr 172.21.15.81:0/2127040006 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.725+0000 7f2734904700 1 -- 172.21.15.81:0/2127040006 >> v2:172.21.15.89:3300/0 conn(0x7f27301583b0 msgr2=0x7f27300cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.725+0000 7f2735906700 1 --2- 172.21.15.81:0/2127040006 >> v2:172.21.15.89:3300/0 conn(0x7f27301583b0 0x7f27300cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.725+0000 7f2734904700 1 --2- 172.21.15.81:0/2127040006 >> v2:172.21.15.89:3300/0 conn(0x7f27301583b0 0x7f27300cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.725+0000 7f2734904700 1 -- 172.21.15.81:0/2127040006 >> v1:172.21.15.89:6789/0 conn(0x7f2730157fe0 legacy=0x7f27300b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.725+0000 7f2734904700 1 -- 172.21.15.81:0/2127040006 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300b4630 con 0x7f27300b3bd0 2023-10-07T08:52:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.725+0000 7f2734904700 1 --2- 172.21.15.81:0/2127040006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27300b3bd0 0x7f27300ceb30 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f27300cc640 tx=0x7f2724009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c45980928f55f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.725+0000 7f272ffff700 1 -- 172.21.15.81:0/2127040006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272400b820 con 0x7f27300b3bd0 2023-10-07T08:52:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.725+0000 7f272ffff700 1 -- 172.21.15.81:0/2127040006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272400b980 con 0x7f27300b3bd0 2023-10-07T08:52:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.725+0000 7f272ffff700 1 -- 172.21.15.81:0/2127040006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272400bd20 con 0x7f27300b3bd0 2023-10-07T08:52:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.726+0000 7f2737369700 1 -- 172.21.15.81:0/2127040006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27300b3bd0 msgr2=0x7f27300ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.726+0000 7f2737369700 1 --2- 172.21.15.81:0/2127040006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27300b3bd0 0x7f27300ceb30 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f27300cc640 tx=0x7f2724009250 comp rx=0 tx=0).stop 2023-10-07T08:52:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.726+0000 7f2737369700 1 -- 172.21.15.81:0/2127040006 shutdown_connections 2023-10-07T08:52:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.726+0000 7f2737369700 1 --2- 172.21.15.81:0/2127040006 >> v2:172.21.15.89:3300/0 conn(0x7f27301583b0 0x7f27300cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.726+0000 7f2737369700 1 --2- 172.21.15.81:0/2127040006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27300b3bd0 0x7f27300ceb30 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.726+0000 7f2737369700 1 -- 172.21.15.81:0/2127040006 >> 172.21.15.81:0/2127040006 conn(0x7f2730067640 msgr2=0x7f2730067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.726+0000 7f2737369700 1 -- 172.21.15.81:0/2127040006 shutdown_connections 2023-10-07T08:52:27.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.726+0000 7f2737369700 1 -- 172.21.15.81:0/2127040006 wait complete. 2023-10-07T08:52:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.727+0000 7f2737369700 1 Processor -- start 2023-10-07T08:52:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.727+0000 7f2737369700 1 -- start start 2023-10-07T08:52:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2737369700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27300b3bd0 0x7f2730147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2737369700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2730157fe0 0x7f27300ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2737369700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27301583b0 0x7f27300ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2737369700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273016ee50 con 0x7f27301583b0 2023-10-07T08:52:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2737369700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27300cb000 con 0x7f2730157fe0 2023-10-07T08:52:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2737369700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27300cb2e0 con 0x7f27300b3bd0 2023-10-07T08:52:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2735906700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27301583b0 0x7f27300ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2735906700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27301583b0 0x7f27300ca9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35748/0 (socket says 172.21.15.81:35748) 2023-10-07T08:52:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2735906700 1 -- 172.21.15.81:0/1120392633 learned_addr learned my addr 172.21.15.81:0/1120392633 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2735105700 1 --2- 172.21.15.81:0/1120392633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27300b3bd0 0x7f2730147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2734904700 1 --2- 172.21.15.81:0/1120392633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2730157fe0 0x7f27300ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2735906700 1 -- 172.21.15.81:0/1120392633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27300b3bd0 msgr2=0x7f2730147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2735906700 1 --2- 172.21.15.81:0/1120392633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27300b3bd0 0x7f2730147760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2735906700 1 -- 172.21.15.81:0/1120392633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2730157fe0 msgr2=0x7f27300ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2735906700 1 --2- 172.21.15.81:0/1120392633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2730157fe0 0x7f27300ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2735906700 1 -- 172.21.15.81:0/1120392633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27240094f0 con 0x7f27301583b0 2023-10-07T08:52:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2734904700 1 --2- 172.21.15.81:0/1120392633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2730157fe0 0x7f27300ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2735906700 1 --2- 172.21.15.81:0/1120392633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27301583b0 0x7f27300ca9c0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f272800c880 tx=0x7f2728008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f272d7fa700 1 -- 172.21.15.81:0/1120392633 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728011600 con 0x7f27301583b0 2023-10-07T08:52:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f272d7fa700 1 -- 172.21.15.81:0/1120392633 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2728011760 con 0x7f27301583b0 2023-10-07T08:52:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2737369700 1 -- 172.21.15.81:0/1120392633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27300cb5c0 con 0x7f27301583b0 2023-10-07T08:52:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f272d7fa700 1 -- 172.21.15.81:0/1120392633 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728011ae0 con 0x7f27301583b0 2023-10-07T08:52:27.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.728+0000 7f2737369700 1 -- 172.21.15.81:0/1120392633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273006cd40 con 0x7f27301583b0 2023-10-07T08:52:27.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.729+0000 7f2737369700 1 -- 172.21.15.81:0/1120392633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273006cf30 con 0x7f27301583b0 2023-10-07T08:52:27.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.730+0000 7f272d7fa700 1 -- 172.21.15.81:0/1120392633 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27280193f0 con 0x7f27301583b0 2023-10-07T08:52:27.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.730+0000 7f272d7fa700 1 --2- 172.21.15.81:0/1120392633 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f271c066f30 0x7f271c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:27.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.730+0000 7f272d7fa700 1 -- 172.21.15.81:0/1120392633 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2728084920 con 0x7f27301583b0 2023-10-07T08:52:27.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.730+0000 7f2735105700 1 --2- 172.21.15.81:0/1120392633 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f271c066f30 0x7f271c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:27.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.731+0000 7f2735105700 1 --2- 172.21.15.81:0/1120392633 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f271c066f30 0x7f271c0693e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2720007fd0 tx=0x7f2720009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:27.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.734+0000 7f272d7fa700 1 -- 172.21.15.81:0/1120392633 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2728055620 con 0x7f27301583b0 2023-10-07T08:52:27.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.911+0000 7f2737369700 1 -- 172.21.15.81:0/1120392633 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27300cb450 con 0x7f271c066f30 2023-10-07T08:52:27.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.919+0000 7f272d7fa700 1 -- 172.21.15.81:0/1120392633 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285555 (secure 0 0 0) 0x7f27300cb450 con 0x7f271c066f30 2023-10-07T08:52:27.924 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:27.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.923+0000 7f2737369700 1 -- 172.21.15.81:0/1120392633 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f271c066f30 msgr2=0x7f271c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:27.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.923+0000 7f2737369700 1 --2- 172.21.15.81:0/1120392633 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f271c066f30 0x7f271c0693e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2720007fd0 tx=0x7f2720009040 comp rx=0 tx=0).stop 2023-10-07T08:52:27.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.923+0000 7f2737369700 1 -- 172.21.15.81:0/1120392633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27301583b0 msgr2=0x7f27300ca9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:27.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.923+0000 7f2737369700 1 --2- 172.21.15.81:0/1120392633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27301583b0 0x7f27300ca9c0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f272800c880 tx=0x7f2728008040 comp rx=0 tx=0).stop 2023-10-07T08:52:27.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.923+0000 7f2737369700 1 -- 172.21.15.81:0/1120392633 shutdown_connections 2023-10-07T08:52:27.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.923+0000 7f2737369700 1 --2- 172.21.15.81:0/1120392633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27301583b0 0x7f27300ca9c0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.923+0000 7f2737369700 1 --2- 172.21.15.81:0/1120392633 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f271c066f30 0x7f271c0693e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.923+0000 7f2737369700 1 --2- 172.21.15.81:0/1120392633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27300b3bd0 0x7f2730147760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.923+0000 7f2737369700 1 --2- 172.21.15.81:0/1120392633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2730157fe0 0x7f27300ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:27.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.923+0000 7f2737369700 1 -- 172.21.15.81:0/1120392633 >> 172.21.15.81:0/1120392633 conn(0x7f2730067640 msgr2=0x7f2730067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:27.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.923+0000 7f2737369700 1 -- 172.21.15.81:0/1120392633 shutdown_connections 2023-10-07T08:52:27.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:27.923+0000 7f2737369700 1 -- 172.21.15.81:0/1120392633 wait complete. 2023-10-07T08:52:27.928 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:52:27.936 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":455,"stamp":"2023-10-07T08:52:26.130436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553841,"statfs":{"total":1600000000,"available":1591134172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,6],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.249316"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336234+0000","last_change":"2023-10-07T08:52:23.335133+0000","last_active":"2023-10-07T08:52:23.336234+0000","last_peered":"2023-10-07T08:52:23.336234+0000","last_clean":"2023-10-07T08:52:23.336234+0000","last_became_active":"2023-10-07T08:52:23.334699+0000","last_became_peered":"2023-10-07T08:52:23.334699+0000","last_unstale":"2023-10-07T08:52:23.336234+0000","last_undegraded":"2023-10-07T08:52:23.336234+0000","last_fullsized":"2023-10-07T08:52:23.336234+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:54:20.956904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.335215+0000","last_change":"2023-10-07T08:52:23.335215+0000","last_active":"2023-10-07T08:52:23.335215+0000","last_peered":"2023-10-07T08:52:23.335215+0000","last_clean":"2023-10-07T08:52:23.335215+0000","last_became_active":"2023-10-07T08:52:23.335006+0000","last_became_peered":"2023-10-07T08:52:23.335006+0000","last_unstale":"2023-10-07T08:52:23.335215+0000","last_undegraded":"2023-10-07T08:52:23.335215+0000","last_fullsized":"2023-10-07T08:52:23.335215+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:34:01.185477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.344789+0000","last_change":"2023-10-07T08:52:23.344789+0000","last_active":"2023-10-07T08:52:23.344789+0000","last_peered":"2023-10-07T08:52:23.344789+0000","last_clean":"2023-10-07T08:52:23.344789+0000","last_became_active":"2023-10-07T08:52:23.344062+0000","last_became_peered":"2023-10-07T08:52:23.344062+0000","last_unstale":"2023-10-07T08:52:23.344789+0000","last_undegraded":"2023-10-07T08:52:23.344789+0000","last_fullsized":"2023-10-07T08:52:23.344789+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:17:13.259446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.338177+0000","last_change":"2023-10-07T08:52:23.338177+0000","last_active":"2023-10-07T08:52:23.338177+0000","last_peered":"2023-10-07T08:52:23.338177+0000","last_clean":"2023-10-07T08:52:23.338177+0000","last_became_active":"2023-10-07T08:52:23.337773+0000","last_became_peered":"2023-10-07T08:52:23.337773+0000","last_unstale":"2023-10-07T08:52:23.338177+0000","last_undegraded":"2023-10-07T08:52:23.338177+0000","last_fullsized":"2023-10-07T08:52:23.338177+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:54:20.956904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336346+0000","last_change":"2023-10-07T08:52:23.336346+0000","last_active":"2023-10-07T08:52:23.336346+0000","last_peered":"2023-10-07T08:52:23.336346+0000","last_clean":"2023-10-07T08:52:23.336346+0000","last_became_active":"2023-10-07T08:52:23.336115+0000","last_became_peered":"2023-10-07T08:52:23.336115+0000","last_unstale":"2023-10-07T08:52:23.336346+0000","last_undegraded":"2023-10-07T08:52:23.336346+0000","last_fullsized":"2023-10-07T08:52:23.336346+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:48.833256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336789+0000","last_change":"2023-10-07T08:52:23.336709+0000","last_active":"2023-10-07T08:52:23.336789+0000","last_peered":"2023-10-07T08:52:23.336789+0000","last_clean":"2023-10-07T08:52:23.336789+0000","last_became_active":"2023-10-07T08:52:23.336212+0000","last_became_peered":"2023-10-07T08:52:23.336212+0000","last_unstale":"2023-10-07T08:52:23.336789+0000","last_undegraded":"2023-10-07T08:52:23.336789+0000","last_fullsized":"2023-10-07T08:52:23.336789+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:51.633336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334016+0000","last_change":"2023-10-07T08:52:23.333959+0000","last_active":"2023-10-07T08:52:23.334016+0000","last_peered":"2023-10-07T08:52:23.334016+0000","last_clean":"2023-10-07T08:52:23.334016+0000","last_became_active":"2023-10-07T08:52:23.333688+0000","last_became_peered":"2023-10-07T08:52:23.333688+0000","last_unstale":"2023-10-07T08:52:23.334016+0000","last_undegraded":"2023-10-07T08:52:23.334016+0000","last_fullsized":"2023-10-07T08:52:23.334016+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:15.564614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.338029+0000","last_change":"2023-10-07T08:52:23.337988+0000","last_active":"2023-10-07T08:52:23.338029+0000","last_peered":"2023-10-07T08:52:23.338029+0000","last_clean":"2023-10-07T08:52:23.338029+0000","last_became_active":"2023-10-07T08:52:23.337810+0000","last_became_peered":"2023-10-07T08:52:23.337810+0000","last_unstale":"2023-10-07T08:52:23.338029+0000","last_undegraded":"2023-10-07T08:52:23.338029+0000","last_fullsized":"2023-10-07T08:52:23.338029+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:55:01.102363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.332453+0000","last_change":"2023-10-07T08:52:23.332453+0000","last_active":"2023-10-07T08:52:23.332453+0000","last_peered":"2023-10-07T08:52:23.332453+0000","last_clean":"2023-10-07T08:52:23.332453+0000","last_became_active":"2023-10-07T08:52:23.332224+0000","last_became_peered":"2023-10-07T08:52:23.332224+0000","last_unstale":"2023-10-07T08:52:23.332453+0000","last_undegraded":"2023-10-07T08:52:23.332453+0000","last_fullsized":"2023-10-07T08:52:23.332453+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:26:37.307134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.343415+0000","last_change":"2023-10-07T08:52:23.343415+0000","last_active":"2023-10-07T08:52:23.343415+0000","last_peered":"2023-10-07T08:52:23.343415+0000","last_clean":"2023-10-07T08:52:23.343415+0000","last_became_active":"2023-10-07T08:52:23.343188+0000","last_became_peered":"2023-10-07T08:52:23.343188+0000","last_unstale":"2023-10-07T08:52:23.343415+0000","last_undegraded":"2023-10-07T08:52:23.343415+0000","last_fullsized":"2023-10-07T08:52:23.343415+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:33:25.418075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336758+0000","last_change":"2023-10-07T08:52:23.336445+0000","last_active":"2023-10-07T08:52:23.336758+0000","last_peered":"2023-10-07T08:52:23.336758+0000","last_clean":"2023-10-07T08:52:23.336758+0000","last_became_active":"2023-10-07T08:52:23.335353+0000","last_became_peered":"2023-10-07T08:52:23.335353+0000","last_unstale":"2023-10-07T08:52:23.336758+0000","last_undegraded":"2023-10-07T08:52:23.336758+0000","last_fullsized":"2023-10-07T08:52:23.336758+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:17:13.259446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.340989+0000","last_change":"2023-10-07T08:52:23.340989+0000","last_active":"2023-10-07T08:52:23.340989+0000","last_peered":"2023-10-07T08:52:23.340989+0000","last_clean":"2023-10-07T08:52:23.340989+0000","last_became_active":"2023-10-07T08:52:23.340760+0000","last_became_peered":"2023-10-07T08:52:23.340760+0000","last_unstale":"2023-10-07T08:52:23.340989+0000","last_undegraded":"2023-10-07T08:52:23.340989+0000","last_fullsized":"2023-10-07T08:52:23.340989+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:21:32.173851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.341819+0000","last_change":"2023-10-07T08:52:23.341819+0000","last_active":"2023-10-07T08:52:23.341819+0000","last_peered":"2023-10-07T08:52:23.341819+0000","last_clean":"2023-10-07T08:52:23.341819+0000","last_became_active":"2023-10-07T08:52:23.340757+0000","last_became_peered":"2023-10-07T08:52:23.340757+0000","last_unstale":"2023-10-07T08:52:23.341819+0000","last_undegraded":"2023-10-07T08:52:23.341819+0000","last_fullsized":"2023-10-07T08:52:23.341819+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:06.071802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.340891+0000","last_change":"2023-10-07T08:52:23.340891+0000","last_active":"2023-10-07T08:52:23.340891+0000","last_peered":"2023-10-07T08:52:23.340891+0000","last_clean":"2023-10-07T08:52:23.340891+0000","last_became_active":"2023-10-07T08:52:23.340329+0000","last_became_peered":"2023-10-07T08:52:23.340329+0000","last_unstale":"2023-10-07T08:52:23.340891+0000","last_undegraded":"2023-10-07T08:52:23.340891+0000","last_fullsized":"2023-10-07T08:52:23.340891+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:43:27.209113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.340175+0000","last_change":"2023-10-07T08:52:23.340175+0000","last_active":"2023-10-07T08:52:23.340175+0000","last_peered":"2023-10-07T08:52:23.340175+0000","last_clean":"2023-10-07T08:52:23.340175+0000","last_became_active":"2023-10-07T08:52:23.339928+0000","last_became_peered":"2023-10-07T08:52:23.339928+0000","last_unstale":"2023-10-07T08:52:23.340175+0000","last_undegraded":"2023-10-07T08:52:23.340175+0000","last_fullsized":"2023-10-07T08:52:23.340175+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:07:27.102265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334946+0000","last_change":"2023-10-07T08:52:23.334335+0000","last_active":"2023-10-07T08:52:23.334946+0000","last_peered":"2023-10-07T08:52:23.334946+0000","last_clean":"2023-10-07T08:52:23.334946+0000","last_became_active":"2023-10-07T08:52:23.334126+0000","last_became_peered":"2023-10-07T08:52:23.334126+0000","last_unstale":"2023-10-07T08:52:23.334946+0000","last_undegraded":"2023-10-07T08:52:23.334946+0000","last_fullsized":"2023-10-07T08:52:23.334946+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:20:04.281330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.335936+0000","last_change":"2023-10-07T08:52:23.335936+0000","last_active":"2023-10-07T08:52:23.335936+0000","last_peered":"2023-10-07T08:52:23.335936+0000","last_clean":"2023-10-07T08:52:23.335936+0000","last_became_active":"2023-10-07T08:52:23.335675+0000","last_became_peered":"2023-10-07T08:52:23.335675+0000","last_unstale":"2023-10-07T08:52:23.335936+0000","last_undegraded":"2023-10-07T08:52:23.335936+0000","last_fullsized":"2023-10-07T08:52:23.335936+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:47.194487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.344386+0000","last_change":"2023-10-07T08:52:23.344386+0000","last_active":"2023-10-07T08:52:23.344386+0000","last_peered":"2023-10-07T08:52:23.344386+0000","last_clean":"2023-10-07T08:52:23.344386+0000","last_became_active":"2023-10-07T08:52:23.343569+0000","last_became_peered":"2023-10-07T08:52:23.343569+0000","last_unstale":"2023-10-07T08:52:23.344386+0000","last_undegraded":"2023-10-07T08:52:23.344386+0000","last_fullsized":"2023-10-07T08:52:23.344386+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:51.633336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336269+0000","last_change":"2023-10-07T08:52:23.336067+0000","last_active":"2023-10-07T08:52:23.336269+0000","last_peered":"2023-10-07T08:52:23.336269+0000","last_clean":"2023-10-07T08:52:23.336269+0000","last_became_active":"2023-10-07T08:52:23.335801+0000","last_became_peered":"2023-10-07T08:52:23.335801+0000","last_unstale":"2023-10-07T08:52:23.336269+0000","last_undegraded":"2023-10-07T08:52:23.336269+0000","last_fullsized":"2023-10-07T08:52:23.336269+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:12:53.607520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.329018+0000","last_change":"2023-10-07T08:52:23.328974+0000","last_active":"2023-10-07T08:52:23.329018+0000","last_peered":"2023-10-07T08:52:23.329018+0000","last_clean":"2023-10-07T08:52:23.329018+0000","last_became_active":"2023-10-07T08:52:23.328801+0000","last_became_peered":"2023-10-07T08:52:23.328801+0000","last_unstale":"2023-10-07T08:52:23.329018+0000","last_undegraded":"2023-10-07T08:52:23.329018+0000","last_fullsized":"2023-10-07T08:52:23.329018+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:10:34.378847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.339821+0000","last_change":"2023-10-07T08:52:23.339821+0000","last_active":"2023-10-07T08:52:23.339821+0000","last_peered":"2023-10-07T08:52:23.339821+0000","last_clean":"2023-10-07T08:52:23.339821+0000","last_became_active":"2023-10-07T08:52:23.339582+0000","last_became_peered":"2023-10-07T08:52:23.339582+0000","last_unstale":"2023-10-07T08:52:23.339821+0000","last_undegraded":"2023-10-07T08:52:23.339821+0000","last_fullsized":"2023-10-07T08:52:23.339821+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:00:48.362886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.328538+0000","last_change":"2023-10-07T08:52:23.328538+0000","last_active":"2023-10-07T08:52:23.328538+0000","last_peered":"2023-10-07T08:52:23.328538+0000","last_clean":"2023-10-07T08:52:23.328538+0000","last_became_active":"2023-10-07T08:52:23.328205+0000","last_became_peered":"2023-10-07T08:52:23.328205+0000","last_unstale":"2023-10-07T08:52:23.328538+0000","last_undegraded":"2023-10-07T08:52:23.328538+0000","last_fullsized":"2023-10-07T08:52:23.328538+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:27:15.146656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.338001+0000","last_change":"2023-10-07T08:52:23.338001+0000","last_active":"2023-10-07T08:52:23.338001+0000","last_peered":"2023-10-07T08:52:23.338001+0000","last_clean":"2023-10-07T08:52:23.338001+0000","last_became_active":"2023-10-07T08:52:23.337779+0000","last_became_peered":"2023-10-07T08:52:23.337779+0000","last_unstale":"2023-10-07T08:52:23.338001+0000","last_undegraded":"2023-10-07T08:52:23.338001+0000","last_fullsized":"2023-10-07T08:52:23.338001+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:55:01.102363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.344386+0000","last_change":"2023-10-07T08:52:23.344386+0000","last_active":"2023-10-07T08:52:23.344386+0000","last_peered":"2023-10-07T08:52:23.344386+0000","last_clean":"2023-10-07T08:52:23.344386+0000","last_became_active":"2023-10-07T08:52:23.344129+0000","last_became_peered":"2023-10-07T08:52:23.344129+0000","last_unstale":"2023-10-07T08:52:23.344386+0000","last_undegraded":"2023-10-07T08:52:23.344386+0000","last_fullsized":"2023-10-07T08:52:23.344386+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:19.681662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334907+0000","last_change":"2023-10-07T08:52:23.333899+0000","last_active":"2023-10-07T08:52:23.334907+0000","last_peered":"2023-10-07T08:52:23.334907+0000","last_clean":"2023-10-07T08:52:23.334907+0000","last_became_active":"2023-10-07T08:52:23.333677+0000","last_became_peered":"2023-10-07T08:52:23.333677+0000","last_unstale":"2023-10-07T08:52:23.334907+0000","last_undegraded":"2023-10-07T08:52:23.334907+0000","last_fullsized":"2023-10-07T08:52:23.334907+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:28:08.413245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336774+0000","last_change":"2023-10-07T08:52:23.336568+0000","last_active":"2023-10-07T08:52:23.336774+0000","last_peered":"2023-10-07T08:52:23.336774+0000","last_clean":"2023-10-07T08:52:23.336774+0000","last_became_active":"2023-10-07T08:52:23.335936+0000","last_became_peered":"2023-10-07T08:52:23.335936+0000","last_unstale":"2023-10-07T08:52:23.336774+0000","last_undegraded":"2023-10-07T08:52:23.336774+0000","last_fullsized":"2023-10-07T08:52:23.336774+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:06:18.707462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334887+0000","last_change":"2023-10-07T08:52:23.333157+0000","last_active":"2023-10-07T08:52:23.334887+0000","last_peered":"2023-10-07T08:52:23.334887+0000","last_clean":"2023-10-07T08:52:23.334887+0000","last_became_active":"2023-10-07T08:52:23.333007+0000","last_became_peered":"2023-10-07T08:52:23.333007+0000","last_unstale":"2023-10-07T08:52:23.334887+0000","last_undegraded":"2023-10-07T08:52:23.334887+0000","last_fullsized":"2023-10-07T08:52:23.334887+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:24:36.923067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.343934+0000","last_change":"2023-10-07T08:52:23.343895+0000","last_active":"2023-10-07T08:52:23.343934+0000","last_peered":"2023-10-07T08:52:23.343934+0000","last_clean":"2023-10-07T08:52:23.343934+0000","last_became_active":"2023-10-07T08:52:23.343767+0000","last_became_peered":"2023-10-07T08:52:23.343767+0000","last_unstale":"2023-10-07T08:52:23.343934+0000","last_undegraded":"2023-10-07T08:52:23.343934+0000","last_fullsized":"2023-10-07T08:52:23.343934+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:28:50.602470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336261+0000","last_change":"2023-10-07T08:52:23.335976+0000","last_active":"2023-10-07T08:52:23.336261+0000","last_peered":"2023-10-07T08:52:23.336261+0000","last_clean":"2023-10-07T08:52:23.336261+0000","last_became_active":"2023-10-07T08:52:23.335535+0000","last_became_peered":"2023-10-07T08:52:23.335535+0000","last_unstale":"2023-10-07T08:52:23.336261+0000","last_undegraded":"2023-10-07T08:52:23.336261+0000","last_fullsized":"2023-10-07T08:52:23.336261+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:51:19.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.342568+0000","last_change":"2023-10-07T08:52:23.342568+0000","last_active":"2023-10-07T08:52:23.342568+0000","last_peered":"2023-10-07T08:52:23.342568+0000","last_clean":"2023-10-07T08:52:23.342568+0000","last_became_active":"2023-10-07T08:52:23.339619+0000","last_became_peered":"2023-10-07T08:52:23.339619+0000","last_unstale":"2023-10-07T08:52:23.342568+0000","last_undegraded":"2023-10-07T08:52:23.342568+0000","last_fullsized":"2023-10-07T08:52:23.342568+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:55:30.299396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336308+0000","last_change":"2023-10-07T08:52:23.336308+0000","last_active":"2023-10-07T08:52:23.336308+0000","last_peered":"2023-10-07T08:52:23.336308+0000","last_clean":"2023-10-07T08:52:23.336308+0000","last_became_active":"2023-10-07T08:52:23.336092+0000","last_became_peered":"2023-10-07T08:52:23.336092+0000","last_unstale":"2023-10-07T08:52:23.336308+0000","last_undegraded":"2023-10-07T08:52:23.336308+0000","last_fullsized":"2023-10-07T08:52:23.336308+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:58:50.284757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334869+0000","last_change":"2023-10-07T08:52:23.332727+0000","last_active":"2023-10-07T08:52:23.334869+0000","last_peered":"2023-10-07T08:52:23.334869+0000","last_clean":"2023-10-07T08:52:23.334869+0000","last_became_active":"2023-10-07T08:52:23.332504+0000","last_became_peered":"2023-10-07T08:52:23.332504+0000","last_unstale":"2023-10-07T08:52:23.334869+0000","last_undegraded":"2023-10-07T08:52:23.334869+0000","last_fullsized":"2023-10-07T08:52:23.334869+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:47:32.347841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.342437+0000","last_change":"2023-10-07T08:52:23.342437+0000","last_active":"2023-10-07T08:52:23.342437+0000","last_peered":"2023-10-07T08:52:23.342437+0000","last_clean":"2023-10-07T08:52:23.342437+0000","last_became_active":"2023-10-07T08:52:23.341201+0000","last_became_peered":"2023-10-07T08:52:23.341201+0000","last_unstale":"2023-10-07T08:52:23.342437+0000","last_undegraded":"2023-10-07T08:52:23.342437+0000","last_fullsized":"2023-10-07T08:52:23.342437+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:03:31.133745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"172'4","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.895560+0000","last_change":"2023-10-07T08:52:22.899468+0000","last_active":"2023-10-07T08:52:23.895560+0000","last_peered":"2023-10-07T08:52:23.895560+0000","last_clean":"2023-10-07T08:52:23.895560+0000","last_became_active":"2023-10-07T08:52:22.899176+0000","last_became_peered":"2023-10-07T08:52:22.899176+0000","last_unstale":"2023-10-07T08:52:23.895560+0000","last_undegraded":"2023-10-07T08:52:23.895560+0000","last_fullsized":"2023-10-07T08:52:23.895560+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:31:32.487019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334367+0000","last_change":"2023-10-07T08:52:23.334367+0000","last_active":"2023-10-07T08:52:23.334367+0000","last_peered":"2023-10-07T08:52:23.334367+0000","last_clean":"2023-10-07T08:52:23.334367+0000","last_became_active":"2023-10-07T08:52:23.334146+0000","last_became_peered":"2023-10-07T08:52:23.334146+0000","last_unstale":"2023-10-07T08:52:23.334367+0000","last_undegraded":"2023-10-07T08:52:23.334367+0000","last_fullsized":"2023-10-07T08:52:23.334367+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:50:52.295831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"172'1","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.327720+0000","last_change":"2023-10-07T08:52:22.899018+0000","last_active":"2023-10-07T08:52:23.327720+0000","last_peered":"2023-10-07T08:52:23.327720+0000","last_clean":"2023-10-07T08:52:23.327720+0000","last_became_active":"2023-10-07T08:52:22.898638+0000","last_became_peered":"2023-10-07T08:52:22.898638+0000","last_unstale":"2023-10-07T08:52:23.327720+0000","last_undegraded":"2023-10-07T08:52:23.327720+0000","last_fullsized":"2023-10-07T08:52:23.327720+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:31:32.487019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.339250+0000","last_change":"2023-10-07T08:52:23.339189+0000","last_active":"2023-10-07T08:52:23.339250+0000","last_peered":"2023-10-07T08:52:23.339250+0000","last_clean":"2023-10-07T08:52:23.339250+0000","last_became_active":"2023-10-07T08:52:23.339036+0000","last_became_peered":"2023-10-07T08:52:23.339036+0000","last_unstale":"2023-10-07T08:52:23.339250+0000","last_undegraded":"2023-10-07T08:52:23.339250+0000","last_fullsized":"2023-10-07T08:52:23.339250+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:41:40.133283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"172'2","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.894036+0000","last_change":"2023-10-07T08:52:22.893694+0000","last_active":"2023-10-07T08:52:23.894036+0000","last_peered":"2023-10-07T08:52:23.894036+0000","last_clean":"2023-10-07T08:52:23.894036+0000","last_became_active":"2023-10-07T08:52:22.893462+0000","last_became_peered":"2023-10-07T08:52:22.893462+0000","last_unstale":"2023-10-07T08:52:23.894036+0000","last_undegraded":"2023-10-07T08:52:23.894036+0000","last_fullsized":"2023-10-07T08:52:23.894036+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:32:07.177800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334794+0000","last_change":"2023-10-07T08:52:23.334794+0000","last_active":"2023-10-07T08:52:23.334794+0000","last_peered":"2023-10-07T08:52:23.334794+0000","last_clean":"2023-10-07T08:52:23.334794+0000","last_became_active":"2023-10-07T08:52:23.334526+0000","last_became_peered":"2023-10-07T08:52:23.334526+0000","last_unstale":"2023-10-07T08:52:23.334794+0000","last_undegraded":"2023-10-07T08:52:23.334794+0000","last_fullsized":"2023-10-07T08:52:23.334794+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:08:17.685917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"172'2","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.895992+0000","last_change":"2023-10-07T08:52:22.894486+0000","last_active":"2023-10-07T08:52:23.895992+0000","last_peered":"2023-10-07T08:52:23.895992+0000","last_clean":"2023-10-07T08:52:23.895992+0000","last_became_active":"2023-10-07T08:52:22.894267+0000","last_became_peered":"2023-10-07T08:52:22.894267+0000","last_unstale":"2023-10-07T08:52:23.895992+0000","last_undegraded":"2023-10-07T08:52:23.895992+0000","last_fullsized":"2023-10-07T08:52:23.895992+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:21:38.915092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.340367+0000","last_change":"2023-10-07T08:52:23.340367+0000","last_active":"2023-10-07T08:52:23.340367+0000","last_peered":"2023-10-07T08:52:23.340367+0000","last_clean":"2023-10-07T08:52:23.340367+0000","last_became_active":"2023-10-07T08:52:23.340124+0000","last_became_peered":"2023-10-07T08:52:23.340124+0000","last_unstale":"2023-10-07T08:52:23.340367+0000","last_undegraded":"2023-10-07T08:52:23.340367+0000","last_fullsized":"2023-10-07T08:52:23.340367+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:23:18.439945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.894741+0000","last_change":"2023-10-07T08:52:22.899541+0000","last_active":"2023-10-07T08:52:23.894741+0000","last_peered":"2023-10-07T08:52:23.894741+0000","last_clean":"2023-10-07T08:52:23.894741+0000","last_became_active":"2023-10-07T08:52:22.899313+0000","last_became_peered":"2023-10-07T08:52:22.899313+0000","last_unstale":"2023-10-07T08:52:23.894741+0000","last_undegraded":"2023-10-07T08:52:23.894741+0000","last_fullsized":"2023-10-07T08:52:23.894741+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:54:24.770106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.339303+0000","last_change":"2023-10-07T08:52:23.339303+0000","last_active":"2023-10-07T08:52:23.339303+0000","last_peered":"2023-10-07T08:52:23.339303+0000","last_clean":"2023-10-07T08:52:23.339303+0000","last_became_active":"2023-10-07T08:52:23.338486+0000","last_became_peered":"2023-10-07T08:52:23.338486+0000","last_unstale":"2023-10-07T08:52:23.339303+0000","last_undegraded":"2023-10-07T08:52:23.339303+0000","last_fullsized":"2023-10-07T08:52:23.339303+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:22:02.359460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"172'1","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.335627+0000","last_change":"2023-10-07T08:52:22.900063+0000","last_active":"2023-10-07T08:52:23.335627+0000","last_peered":"2023-10-07T08:52:23.335627+0000","last_clean":"2023-10-07T08:52:23.335627+0000","last_became_active":"2023-10-07T08:52:22.899569+0000","last_became_peered":"2023-10-07T08:52:22.899569+0000","last_unstale":"2023-10-07T08:52:23.335627+0000","last_undegraded":"2023-10-07T08:52:23.335627+0000","last_fullsized":"2023-10-07T08:52:23.335627+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:24:35.913351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.333309+0000","last_change":"2023-10-07T08:52:23.333309+0000","last_active":"2023-10-07T08:52:23.333309+0000","last_peered":"2023-10-07T08:52:23.333309+0000","last_clean":"2023-10-07T08:52:23.333309+0000","last_became_active":"2023-10-07T08:52:23.333084+0000","last_became_peered":"2023-10-07T08:52:23.333084+0000","last_unstale":"2023-10-07T08:52:23.333309+0000","last_undegraded":"2023-10-07T08:52:23.333309+0000","last_fullsized":"2023-10-07T08:52:23.333309+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:25:33.472323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.326180+0000","last_change":"2023-10-07T08:52:22.898986+0000","last_active":"2023-10-07T08:52:23.326180+0000","last_peered":"2023-10-07T08:52:23.326180+0000","last_clean":"2023-10-07T08:52:23.326180+0000","last_became_active":"2023-10-07T08:52:22.898768+0000","last_became_peered":"2023-10-07T08:52:22.898768+0000","last_unstale":"2023-10-07T08:52:23.326180+0000","last_undegraded":"2023-10-07T08:52:23.326180+0000","last_fullsized":"2023-10-07T08:52:23.326180+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:52:41.561967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.339163+0000","last_change":"2023-10-07T08:52:23.339163+0000","last_active":"2023-10-07T08:52:23.339163+0000","last_peered":"2023-10-07T08:52:23.339163+0000","last_clean":"2023-10-07T08:52:23.339163+0000","last_became_active":"2023-10-07T08:52:23.338921+0000","last_became_peered":"2023-10-07T08:52:23.338921+0000","last_unstale":"2023-10-07T08:52:23.339163+0000","last_undegraded":"2023-10-07T08:52:23.339163+0000","last_fullsized":"2023-10-07T08:52:23.339163+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:12:53.607520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.898044+0000","last_change":"2023-10-07T08:52:22.897945+0000","last_active":"2023-10-07T08:52:22.898044+0000","last_peered":"2023-10-07T08:52:22.898044+0000","last_clean":"2023-10-07T08:52:22.898044+0000","last_became_active":"2023-10-07T08:52:22.897695+0000","last_became_peered":"2023-10-07T08:52:22.897695+0000","last_unstale":"2023-10-07T08:52:22.898044+0000","last_undegraded":"2023-10-07T08:52:22.898044+0000","last_fullsized":"2023-10-07T08:52:22.898044+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:36:24.754975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.337652+0000","last_change":"2023-10-07T08:52:23.337652+0000","last_active":"2023-10-07T08:52:23.337652+0000","last_peered":"2023-10-07T08:52:23.337652+0000","last_clean":"2023-10-07T08:52:23.337652+0000","last_became_active":"2023-10-07T08:52:23.337390+0000","last_became_peered":"2023-10-07T08:52:23.337390+0000","last_unstale":"2023-10-07T08:52:23.337652+0000","last_undegraded":"2023-10-07T08:52:23.337652+0000","last_fullsized":"2023-10-07T08:52:23.337652+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:14:23.030732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.897258+0000","last_change":"2023-10-07T08:52:22.897153+0000","last_active":"2023-10-07T08:52:22.897258+0000","last_peered":"2023-10-07T08:52:22.897258+0000","last_clean":"2023-10-07T08:52:22.897258+0000","last_became_active":"2023-10-07T08:52:22.896936+0000","last_became_peered":"2023-10-07T08:52:22.896936+0000","last_unstale":"2023-10-07T08:52:22.897258+0000","last_undegraded":"2023-10-07T08:52:22.897258+0000","last_fullsized":"2023-10-07T08:52:22.897258+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:45:13.340367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.335090+0000","last_change":"2023-10-07T08:52:23.335090+0000","last_active":"2023-10-07T08:52:23.335090+0000","last_peered":"2023-10-07T08:52:23.335090+0000","last_clean":"2023-10-07T08:52:23.335090+0000","last_became_active":"2023-10-07T08:52:23.334826+0000","last_became_peered":"2023-10-07T08:52:23.334826+0000","last_unstale":"2023-10-07T08:52:23.335090+0000","last_undegraded":"2023-10-07T08:52:23.335090+0000","last_fullsized":"2023-10-07T08:52:23.335090+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:34:01.185477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.901036+0000","last_change":"2023-10-07T08:52:22.900968+0000","last_active":"2023-10-07T08:52:22.901036+0000","last_peered":"2023-10-07T08:52:22.901036+0000","last_clean":"2023-10-07T08:52:22.901036+0000","last_became_active":"2023-10-07T08:52:22.900609+0000","last_became_peered":"2023-10-07T08:52:22.900609+0000","last_unstale":"2023-10-07T08:52:22.901036+0000","last_undegraded":"2023-10-07T08:52:22.901036+0000","last_fullsized":"2023-10-07T08:52:22.901036+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:24:32.593685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334931+0000","last_change":"2023-10-07T08:52:23.334320+0000","last_active":"2023-10-07T08:52:23.334931+0000","last_peered":"2023-10-07T08:52:23.334931+0000","last_clean":"2023-10-07T08:52:23.334931+0000","last_became_active":"2023-10-07T08:52:23.334083+0000","last_became_peered":"2023-10-07T08:52:23.334083+0000","last_unstale":"2023-10-07T08:52:23.334931+0000","last_undegraded":"2023-10-07T08:52:23.334931+0000","last_fullsized":"2023-10-07T08:52:23.334931+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:03:17.430798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"172'6","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.897411+0000","last_change":"2023-10-07T08:52:22.893815+0000","last_active":"2023-10-07T08:52:23.897411+0000","last_peered":"2023-10-07T08:52:23.897411+0000","last_clean":"2023-10-07T08:52:23.897411+0000","last_became_active":"2023-10-07T08:52:22.893596+0000","last_became_peered":"2023-10-07T08:52:22.893596+0000","last_unstale":"2023-10-07T08:52:23.897411+0000","last_undegraded":"2023-10-07T08:52:23.897411+0000","last_fullsized":"2023-10-07T08:52:23.897411+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:30:26.833836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.344005+0000","last_change":"2023-10-07T08:52:23.344005+0000","last_active":"2023-10-07T08:52:23.344005+0000","last_peered":"2023-10-07T08:52:23.344005+0000","last_clean":"2023-10-07T08:52:23.344005+0000","last_became_active":"2023-10-07T08:52:23.343750+0000","last_became_peered":"2023-10-07T08:52:23.343750+0000","last_unstale":"2023-10-07T08:52:23.344005+0000","last_undegraded":"2023-10-07T08:52:23.344005+0000","last_fullsized":"2023-10-07T08:52:23.344005+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:32:34.004925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"172'2","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.893699+0000","last_change":"2023-10-07T08:52:22.897371+0000","last_active":"2023-10-07T08:52:23.893699+0000","last_peered":"2023-10-07T08:52:23.893699+0000","last_clean":"2023-10-07T08:52:23.893699+0000","last_became_active":"2023-10-07T08:52:22.897135+0000","last_became_peered":"2023-10-07T08:52:22.897135+0000","last_unstale":"2023-10-07T08:52:23.893699+0000","last_undegraded":"2023-10-07T08:52:23.893699+0000","last_fullsized":"2023-10-07T08:52:23.893699+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:36.014064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.335680+0000","last_change":"2023-10-07T08:52:23.335680+0000","last_active":"2023-10-07T08:52:23.335680+0000","last_peered":"2023-10-07T08:52:23.335680+0000","last_clean":"2023-10-07T08:52:23.335680+0000","last_became_active":"2023-10-07T08:52:23.335471+0000","last_became_peered":"2023-10-07T08:52:23.335471+0000","last_unstale":"2023-10-07T08:52:23.335680+0000","last_undegraded":"2023-10-07T08:52:23.335680+0000","last_fullsized":"2023-10-07T08:52:23.335680+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:37.741118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.899113+0000","last_change":"2023-10-07T08:52:22.899048+0000","last_active":"2023-10-07T08:52:22.899113+0000","last_peered":"2023-10-07T08:52:22.899113+0000","last_clean":"2023-10-07T08:52:22.899113+0000","last_became_active":"2023-10-07T08:52:22.898814+0000","last_became_peered":"2023-10-07T08:52:22.898814+0000","last_unstale":"2023-10-07T08:52:22.899113+0000","last_undegraded":"2023-10-07T08:52:22.899113+0000","last_fullsized":"2023-10-07T08:52:22.899113+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:47.823540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.342100+0000","last_change":"2023-10-07T08:52:23.342100+0000","last_active":"2023-10-07T08:52:23.342100+0000","last_peered":"2023-10-07T08:52:23.342100+0000","last_clean":"2023-10-07T08:52:23.342100+0000","last_became_active":"2023-10-07T08:52:23.341406+0000","last_became_peered":"2023-10-07T08:52:23.341406+0000","last_unstale":"2023-10-07T08:52:23.342100+0000","last_undegraded":"2023-10-07T08:52:23.342100+0000","last_fullsized":"2023-10-07T08:52:23.342100+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:36:25.764692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.331372+0000","last_change":"2023-10-07T08:52:22.894155+0000","last_active":"2023-10-07T08:52:23.331372+0000","last_peered":"2023-10-07T08:52:23.331372+0000","last_clean":"2023-10-07T08:52:23.331372+0000","last_became_active":"2023-10-07T08:52:22.893933+0000","last_became_peered":"2023-10-07T08:52:22.893933+0000","last_unstale":"2023-10-07T08:52:23.331372+0000","last_undegraded":"2023-10-07T08:52:23.331372+0000","last_fullsized":"2023-10-07T08:52:23.331372+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:41.015710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.337627+0000","last_change":"2023-10-07T08:52:23.337627+0000","last_active":"2023-10-07T08:52:23.337627+0000","last_peered":"2023-10-07T08:52:23.337627+0000","last_clean":"2023-10-07T08:52:23.337627+0000","last_became_active":"2023-10-07T08:52:23.337358+0000","last_became_peered":"2023-10-07T08:52:23.337358+0000","last_unstale":"2023-10-07T08:52:23.337627+0000","last_undegraded":"2023-10-07T08:52:23.337627+0000","last_fullsized":"2023-10-07T08:52:23.337627+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:54:20.956904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"172'8","reported_seq":18,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.896314+0000","last_change":"2023-10-07T08:52:22.901173+0000","last_active":"2023-10-07T08:52:23.896314+0000","last_peered":"2023-10-07T08:52:23.896314+0000","last_clean":"2023-10-07T08:52:23.896314+0000","last_became_active":"2023-10-07T08:52:22.900933+0000","last_became_peered":"2023-10-07T08:52:22.900933+0000","last_unstale":"2023-10-07T08:52:23.896314+0000","last_undegraded":"2023-10-07T08:52:23.896314+0000","last_fullsized":"2023-10-07T08:52:23.896314+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:26.005011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334129+0000","last_change":"2023-10-07T08:52:23.334129+0000","last_active":"2023-10-07T08:52:23.334129+0000","last_peered":"2023-10-07T08:52:23.334129+0000","last_clean":"2023-10-07T08:52:23.334129+0000","last_became_active":"2023-10-07T08:52:23.333894+0000","last_became_peered":"2023-10-07T08:52:23.333894+0000","last_unstale":"2023-10-07T08:52:23.334129+0000","last_undegraded":"2023-10-07T08:52:23.334129+0000","last_fullsized":"2023-10-07T08:52:23.334129+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:30:27.843552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"172'1","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.330854+0000","last_change":"2023-10-07T08:52:22.900602+0000","last_active":"2023-10-07T08:52:23.330854+0000","last_peered":"2023-10-07T08:52:23.330854+0000","last_clean":"2023-10-07T08:52:23.330854+0000","last_became_active":"2023-10-07T08:52:22.899086+0000","last_became_peered":"2023-10-07T08:52:22.899086+0000","last_unstale":"2023-10-07T08:52:23.330854+0000","last_undegraded":"2023-10-07T08:52:23.330854+0000","last_fullsized":"2023-10-07T08:52:23.330854+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:13:46.718731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.339641+0000","last_change":"2023-10-07T08:52:23.339578+0000","last_active":"2023-10-07T08:52:23.339641+0000","last_peered":"2023-10-07T08:52:23.339641+0000","last_clean":"2023-10-07T08:52:23.339641+0000","last_became_active":"2023-10-07T08:52:23.339334+0000","last_became_peered":"2023-10-07T08:52:23.339334+0000","last_unstale":"2023-10-07T08:52:23.339641+0000","last_undegraded":"2023-10-07T08:52:23.339641+0000","last_fullsized":"2023-10-07T08:52:23.339641+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:30:39.918745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"172'2","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.893591+0000","last_change":"2023-10-07T08:52:22.902060+0000","last_active":"2023-10-07T08:52:23.893591+0000","last_peered":"2023-10-07T08:52:23.893591+0000","last_clean":"2023-10-07T08:52:23.893591+0000","last_became_active":"2023-10-07T08:52:22.901885+0000","last_became_peered":"2023-10-07T08:52:22.901885+0000","last_unstale":"2023-10-07T08:52:23.893591+0000","last_undegraded":"2023-10-07T08:52:23.893591+0000","last_fullsized":"2023-10-07T08:52:23.893591+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:50:24.949763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.344805+0000","last_change":"2023-10-07T08:52:23.344805+0000","last_active":"2023-10-07T08:52:23.344805+0000","last_peered":"2023-10-07T08:52:23.344805+0000","last_clean":"2023-10-07T08:52:23.344805+0000","last_became_active":"2023-10-07T08:52:23.344113+0000","last_became_peered":"2023-10-07T08:52:23.344113+0000","last_unstale":"2023-10-07T08:52:23.344805+0000","last_undegraded":"2023-10-07T08:52:23.344805+0000","last_fullsized":"2023-10-07T08:52:23.344805+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:18:35.422453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.894919+0000","last_change":"2023-10-07T08:52:22.898165+0000","last_active":"2023-10-07T08:52:23.894919+0000","last_peered":"2023-10-07T08:52:23.894919+0000","last_clean":"2023-10-07T08:52:23.894919+0000","last_became_active":"2023-10-07T08:52:22.897935+0000","last_became_peered":"2023-10-07T08:52:22.897935+0000","last_unstale":"2023-10-07T08:52:23.894919+0000","last_undegraded":"2023-10-07T08:52:23.894919+0000","last_fullsized":"2023-10-07T08:52:23.894919+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:41:50.530066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336251+0000","last_change":"2023-10-07T08:52:23.335562+0000","last_active":"2023-10-07T08:52:23.336251+0000","last_peered":"2023-10-07T08:52:23.336251+0000","last_clean":"2023-10-07T08:52:23.336251+0000","last_became_active":"2023-10-07T08:52:23.334956+0000","last_became_peered":"2023-10-07T08:52:23.334956+0000","last_unstale":"2023-10-07T08:52:23.336251+0000","last_undegraded":"2023-10-07T08:52:23.336251+0000","last_fullsized":"2023-10-07T08:52:23.336251+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:18:35.422453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.893432+0000","last_change":"2023-10-07T08:52:22.893334+0000","last_active":"2023-10-07T08:52:22.893432+0000","last_peered":"2023-10-07T08:52:22.893432+0000","last_clean":"2023-10-07T08:52:22.893432+0000","last_became_active":"2023-10-07T08:52:22.893100+0000","last_became_peered":"2023-10-07T08:52:22.893100+0000","last_unstale":"2023-10-07T08:52:22.893432+0000","last_undegraded":"2023-10-07T08:52:22.893432+0000","last_fullsized":"2023-10-07T08:52:22.893432+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:48:25.900558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.340552+0000","last_change":"2023-10-07T08:52:23.340552+0000","last_active":"2023-10-07T08:52:23.340552+0000","last_peered":"2023-10-07T08:52:23.340552+0000","last_clean":"2023-10-07T08:52:23.340552+0000","last_became_active":"2023-10-07T08:52:23.339547+0000","last_became_peered":"2023-10-07T08:52:23.339547+0000","last_unstale":"2023-10-07T08:52:23.340552+0000","last_undegraded":"2023-10-07T08:52:23.340552+0000","last_fullsized":"2023-10-07T08:52:23.340552+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:51.633336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.894011+0000","last_change":"2023-10-07T08:52:22.899981+0000","last_active":"2023-10-07T08:52:23.894011+0000","last_peered":"2023-10-07T08:52:23.894011+0000","last_clean":"2023-10-07T08:52:23.894011+0000","last_became_active":"2023-10-07T08:52:22.899727+0000","last_became_peered":"2023-10-07T08:52:22.899727+0000","last_unstale":"2023-10-07T08:52:23.894011+0000","last_undegraded":"2023-10-07T08:52:23.894011+0000","last_fullsized":"2023-10-07T08:52:23.894011+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:07:26.092548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.337881+0000","last_change":"2023-10-07T08:52:23.337839+0000","last_active":"2023-10-07T08:52:23.337881+0000","last_peered":"2023-10-07T08:52:23.337881+0000","last_clean":"2023-10-07T08:52:23.337881+0000","last_became_active":"2023-10-07T08:52:23.337690+0000","last_became_peered":"2023-10-07T08:52:23.337690+0000","last_unstale":"2023-10-07T08:52:23.337881+0000","last_undegraded":"2023-10-07T08:52:23.337881+0000","last_fullsized":"2023-10-07T08:52:23.337881+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:02:07.114979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.898849+0000","last_change":"2023-10-07T08:52:22.898783+0000","last_active":"2023-10-07T08:52:22.898849+0000","last_peered":"2023-10-07T08:52:22.898849+0000","last_clean":"2023-10-07T08:52:22.898849+0000","last_became_active":"2023-10-07T08:52:22.898548+0000","last_became_peered":"2023-10-07T08:52:22.898548+0000","last_unstale":"2023-10-07T08:52:22.898849+0000","last_undegraded":"2023-10-07T08:52:22.898849+0000","last_fullsized":"2023-10-07T08:52:22.898849+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:06:54.305528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.338657+0000","last_change":"2023-10-07T08:52:23.338657+0000","last_active":"2023-10-07T08:52:23.338657+0000","last_peered":"2023-10-07T08:52:23.338657+0000","last_clean":"2023-10-07T08:52:23.338657+0000","last_became_active":"2023-10-07T08:52:23.338402+0000","last_became_peered":"2023-10-07T08:52:23.338402+0000","last_unstale":"2023-10-07T08:52:23.338657+0000","last_undegraded":"2023-10-07T08:52:23.338657+0000","last_fullsized":"2023-10-07T08:52:23.338657+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:17:13.259446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.900275+0000","last_change":"2023-10-07T08:52:22.900209+0000","last_active":"2023-10-07T08:52:22.900275+0000","last_peered":"2023-10-07T08:52:22.900275+0000","last_clean":"2023-10-07T08:52:22.900275+0000","last_became_active":"2023-10-07T08:52:22.899770+0000","last_became_peered":"2023-10-07T08:52:22.899770+0000","last_unstale":"2023-10-07T08:52:22.900275+0000","last_undegraded":"2023-10-07T08:52:22.900275+0000","last_fullsized":"2023-10-07T08:52:22.900275+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:18:47.125725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.339734+0000","last_change":"2023-10-07T08:52:23.339679+0000","last_active":"2023-10-07T08:52:23.339734+0000","last_peered":"2023-10-07T08:52:23.339734+0000","last_clean":"2023-10-07T08:52:23.339734+0000","last_became_active":"2023-10-07T08:52:23.339448+0000","last_became_peered":"2023-10-07T08:52:23.339448+0000","last_unstale":"2023-10-07T08:52:23.339734+0000","last_undegraded":"2023-10-07T08:52:23.339734+0000","last_fullsized":"2023-10-07T08:52:23.339734+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:54:52.211577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.898344+0000","last_change":"2023-10-07T08:52:22.897912+0000","last_active":"2023-10-07T08:52:22.898344+0000","last_peered":"2023-10-07T08:52:22.898344+0000","last_clean":"2023-10-07T08:52:22.898344+0000","last_became_active":"2023-10-07T08:52:22.897640+0000","last_became_peered":"2023-10-07T08:52:22.897640+0000","last_unstale":"2023-10-07T08:52:22.898344+0000","last_undegraded":"2023-10-07T08:52:22.898344+0000","last_fullsized":"2023-10-07T08:52:22.898344+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:27:43.687608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.341957+0000","last_change":"2023-10-07T08:52:23.341957+0000","last_active":"2023-10-07T08:52:23.341957+0000","last_peered":"2023-10-07T08:52:23.341957+0000","last_clean":"2023-10-07T08:52:23.341957+0000","last_became_active":"2023-10-07T08:52:23.341073+0000","last_became_peered":"2023-10-07T08:52:23.341073+0000","last_unstale":"2023-10-07T08:52:23.341957+0000","last_undegraded":"2023-10-07T08:52:23.341957+0000","last_fullsized":"2023-10-07T08:52:23.341957+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:21:39.924809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"172'2","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.896975+0000","last_change":"2023-10-07T08:52:22.903121+0000","last_active":"2023-10-07T08:52:23.896975+0000","last_peered":"2023-10-07T08:52:23.896975+0000","last_clean":"2023-10-07T08:52:23.896975+0000","last_became_active":"2023-10-07T08:52:22.902611+0000","last_became_peered":"2023-10-07T08:52:22.902611+0000","last_unstale":"2023-10-07T08:52:23.896975+0000","last_undegraded":"2023-10-07T08:52:23.896975+0000","last_fullsized":"2023-10-07T08:52:23.896975+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:34.088183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.344952+0000","last_change":"2023-10-07T08:52:23.344952+0000","last_active":"2023-10-07T08:52:23.344952+0000","last_peered":"2023-10-07T08:52:23.344952+0000","last_clean":"2023-10-07T08:52:23.344952+0000","last_became_active":"2023-10-07T08:52:23.344417+0000","last_became_peered":"2023-10-07T08:52:23.344417+0000","last_unstale":"2023-10-07T08:52:23.344952+0000","last_undegraded":"2023-10-07T08:52:23.344952+0000","last_fullsized":"2023-10-07T08:52:23.344952+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:06:18.707462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.331373+0000","last_change":"2023-10-07T08:52:22.898025+0000","last_active":"2023-10-07T08:52:23.331373+0000","last_peered":"2023-10-07T08:52:23.331373+0000","last_clean":"2023-10-07T08:52:23.331373+0000","last_became_active":"2023-10-07T08:52:22.897798+0000","last_became_peered":"2023-10-07T08:52:22.897798+0000","last_unstale":"2023-10-07T08:52:23.331373+0000","last_undegraded":"2023-10-07T08:52:23.331373+0000","last_fullsized":"2023-10-07T08:52:23.331373+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:34:16.862512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.329179+0000","last_change":"2023-10-07T08:52:23.329179+0000","last_active":"2023-10-07T08:52:23.329179+0000","last_peered":"2023-10-07T08:52:23.329179+0000","last_clean":"2023-10-07T08:52:23.329179+0000","last_became_active":"2023-10-07T08:52:23.328866+0000","last_became_peered":"2023-10-07T08:52:23.328866+0000","last_unstale":"2023-10-07T08:52:23.329179+0000","last_undegraded":"2023-10-07T08:52:23.329179+0000","last_fullsized":"2023-10-07T08:52:23.329179+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:52:26.614967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.331873+0000","last_change":"2023-10-07T08:52:22.893343+0000","last_active":"2023-10-07T08:52:23.331873+0000","last_peered":"2023-10-07T08:52:23.331873+0000","last_clean":"2023-10-07T08:52:23.331873+0000","last_became_active":"2023-10-07T08:52:22.892712+0000","last_became_peered":"2023-10-07T08:52:22.892712+0000","last_unstale":"2023-10-07T08:52:23.331873+0000","last_undegraded":"2023-10-07T08:52:23.331873+0000","last_fullsized":"2023-10-07T08:52:23.331873+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:28:28.562205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.339267+0000","last_change":"2023-10-07T08:52:23.339203+0000","last_active":"2023-10-07T08:52:23.339267+0000","last_peered":"2023-10-07T08:52:23.339267+0000","last_clean":"2023-10-07T08:52:23.339267+0000","last_became_active":"2023-10-07T08:52:23.339062+0000","last_became_peered":"2023-10-07T08:52:23.339062+0000","last_unstale":"2023-10-07T08:52:23.339267+0000","last_undegraded":"2023-10-07T08:52:23.339267+0000","last_fullsized":"2023-10-07T08:52:23.339267+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:32:34.004925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.331510+0000","last_change":"2023-10-07T08:52:22.894912+0000","last_active":"2023-10-07T08:52:23.331510+0000","last_peered":"2023-10-07T08:52:23.331510+0000","last_clean":"2023-10-07T08:52:23.331510+0000","last_became_active":"2023-10-07T08:52:22.894692+0000","last_became_peered":"2023-10-07T08:52:22.894692+0000","last_unstale":"2023-10-07T08:52:23.331510+0000","last_undegraded":"2023-10-07T08:52:23.331510+0000","last_fullsized":"2023-10-07T08:52:23.331510+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:59:20.619444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.328431+0000","last_change":"2023-10-07T08:52:23.328364+0000","last_active":"2023-10-07T08:52:23.328431+0000","last_peered":"2023-10-07T08:52:23.328431+0000","last_clean":"2023-10-07T08:52:23.328431+0000","last_became_active":"2023-10-07T08:52:23.328124+0000","last_became_peered":"2023-10-07T08:52:23.328124+0000","last_unstale":"2023-10-07T08:52:23.328431+0000","last_undegraded":"2023-10-07T08:52:23.328431+0000","last_fullsized":"2023-10-07T08:52:23.328431+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:07:22.542253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.333453+0000","last_change":"2023-10-07T08:52:22.894770+0000","last_active":"2023-10-07T08:52:23.333453+0000","last_peered":"2023-10-07T08:52:23.333453+0000","last_clean":"2023-10-07T08:52:23.333453+0000","last_became_active":"2023-10-07T08:52:22.894543+0000","last_became_peered":"2023-10-07T08:52:22.894543+0000","last_unstale":"2023-10-07T08:52:23.333453+0000","last_undegraded":"2023-10-07T08:52:23.333453+0000","last_fullsized":"2023-10-07T08:52:23.333453+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:08:16.676201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.339419+0000","last_change":"2023-10-07T08:52:23.339419+0000","last_active":"2023-10-07T08:52:23.339419+0000","last_peered":"2023-10-07T08:52:23.339419+0000","last_clean":"2023-10-07T08:52:23.339419+0000","last_became_active":"2023-10-07T08:52:23.338756+0000","last_became_peered":"2023-10-07T08:52:23.338756+0000","last_unstale":"2023-10-07T08:52:23.339419+0000","last_undegraded":"2023-10-07T08:52:23.339419+0000","last_fullsized":"2023-10-07T08:52:23.339419+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:32:08.187516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.903338+0000","last_change":"2023-10-07T08:52:22.903284+0000","last_active":"2023-10-07T08:52:22.903338+0000","last_peered":"2023-10-07T08:52:22.903338+0000","last_clean":"2023-10-07T08:52:22.903338+0000","last_became_active":"2023-10-07T08:52:22.902846+0000","last_became_peered":"2023-10-07T08:52:22.902846+0000","last_unstale":"2023-10-07T08:52:22.903338+0000","last_undegraded":"2023-10-07T08:52:22.903338+0000","last_fullsized":"2023-10-07T08:52:22.903338+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:32:19.943177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.342582+0000","last_change":"2023-10-07T08:52:23.342582+0000","last_active":"2023-10-07T08:52:23.342582+0000","last_peered":"2023-10-07T08:52:23.342582+0000","last_clean":"2023-10-07T08:52:23.342582+0000","last_became_active":"2023-10-07T08:52:23.342029+0000","last_became_peered":"2023-10-07T08:52:23.342029+0000","last_unstale":"2023-10-07T08:52:23.342582+0000","last_undegraded":"2023-10-07T08:52:23.342582+0000","last_fullsized":"2023-10-07T08:52:23.342582+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:01:09.157206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.898359+0000","last_change":"2023-10-07T08:52:22.897956+0000","last_active":"2023-10-07T08:52:22.898359+0000","last_peered":"2023-10-07T08:52:22.898359+0000","last_clean":"2023-10-07T08:52:22.898359+0000","last_became_active":"2023-10-07T08:52:22.897652+0000","last_became_peered":"2023-10-07T08:52:22.897652+0000","last_unstale":"2023-10-07T08:52:22.898359+0000","last_undegraded":"2023-10-07T08:52:22.898359+0000","last_fullsized":"2023-10-07T08:52:22.898359+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:05.062086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.341646+0000","last_change":"2023-10-07T08:52:23.341646+0000","last_active":"2023-10-07T08:52:23.341646+0000","last_peered":"2023-10-07T08:52:23.341646+0000","last_clean":"2023-10-07T08:52:23.341646+0000","last_became_active":"2023-10-07T08:52:23.340253+0000","last_became_peered":"2023-10-07T08:52:23.340253+0000","last_unstale":"2023-10-07T08:52:23.341646+0000","last_undegraded":"2023-10-07T08:52:23.341646+0000","last_fullsized":"2023-10-07T08:52:23.341646+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:58:15.279414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.899052+0000","last_change":"2023-10-07T08:52:22.898878+0000","last_active":"2023-10-07T08:52:22.899052+0000","last_peered":"2023-10-07T08:52:22.899052+0000","last_clean":"2023-10-07T08:52:22.899052+0000","last_became_active":"2023-10-07T08:52:22.898317+0000","last_became_peered":"2023-10-07T08:52:22.898317+0000","last_unstale":"2023-10-07T08:52:22.899052+0000","last_undegraded":"2023-10-07T08:52:22.899052+0000","last_fullsized":"2023-10-07T08:52:22.899052+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:24:32.593685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.333827+0000","last_change":"2023-10-07T08:52:23.333771+0000","last_active":"2023-10-07T08:52:23.333827+0000","last_peered":"2023-10-07T08:52:23.333827+0000","last_clean":"2023-10-07T08:52:23.333827+0000","last_became_active":"2023-10-07T08:52:23.333524+0000","last_became_peered":"2023-10-07T08:52:23.333524+0000","last_unstale":"2023-10-07T08:52:23.333827+0000","last_undegraded":"2023-10-07T08:52:23.333827+0000","last_fullsized":"2023-10-07T08:52:23.333827+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:45.547741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"172'3","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.894823+0000","last_change":"2023-10-07T08:52:22.902752+0000","last_active":"2023-10-07T08:52:23.894823+0000","last_peered":"2023-10-07T08:52:23.894823+0000","last_clean":"2023-10-07T08:52:23.894823+0000","last_became_active":"2023-10-07T08:52:22.902521+0000","last_became_peered":"2023-10-07T08:52:22.902521+0000","last_unstale":"2023-10-07T08:52:23.894823+0000","last_undegraded":"2023-10-07T08:52:23.894823+0000","last_fullsized":"2023-10-07T08:52:23.894823+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:21:38.915092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":290,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.895875+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:52:22.895875+0000","last_peered":"2023-10-07T08:52:22.895875+0000","last_clean":"2023-10-07T08:52:22.895875+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:52:22.895875+0000","last_undegraded":"2023-10-07T08:52:22.895875+0000","last_fullsized":"2023-10-07T08:52:22.895875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574966,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1512,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193800,"statfs":{"total":200000000,"available":198451306,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,6],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50700000000000001,"15min":0.502},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73899999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.50900000000000001,"15min":0.495},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.27700000000000002},"max":{"1min":0.70099999999999996,"5min":0.70899999999999996,"15min":1.2150000000000001},"last":0.63900000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73599999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55400000000000005,"15min":0.54700000000000004},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.33900000000000002},"max":{"1min":0.71099999999999997,"5min":0.81999999999999995,"15min":1.1659999999999999},"last":0.68799999999999994}]},{"osd":2,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.66600000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51200000000000001,"15min":0.499},"min":{"1min":0.38700000000000001,"5min":0.34499999999999997,"15min":0.33500000000000002},"max":{"1min":0.72099999999999997,"5min":0.74399999999999999,"15min":0.75},"last":0.496}]},{"osd":3,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54400000000000004,"15min":0.71199999999999997},"min":{"1min":0.42099999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70399999999999996,"5min":0.73299999999999998,"15min":6.8570000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.41599999999999998,"5min":0.39500000000000002,"15min":0.37},"max":{"1min":0.76500000000000001,"5min":0.76700000000000002,"15min":0.98999999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46200000000000002,"15min":0.47499999999999998},"min":{"1min":0.39200000000000002,"5min":0.28799999999999998,"15min":0.26600000000000001},"max":{"1min":0.59799999999999998,"5min":0.81299999999999994,"15min":0.98599999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.505,"15min":0.52400000000000002},"min":{"1min":0.42699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.70499999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56000000000000005}]},{"osd":5,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.48599999999999999,"15min":0.5},"min":{"1min":0.38600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66800000000000004,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.56100000000000005},"min":{"1min":0.436,"5min":0.318,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":0.78300000000000003,"15min":1.0669999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55500000000000005,"15min":0.57999999999999996},"min":{"1min":0.35599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67800000000000005,"5min":0.80600000000000005,"15min":1.1020000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.46600000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.72799999999999998,"5min":0.875,"15min":0.875},"last":0.93000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574966,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042152,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51200000000000001,"15min":0.48399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.25700000000000001},"max":{"1min":0.68600000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.503},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.497},"min":{"1min":0.37,"5min":0.316,"15min":0.30199999999999999},"max":{"1min":0.70699999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.51300000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57799999999999996,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.35399999999999998,"15min":0.32500000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57599999999999996,"15min":0.54300000000000004},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.29799999999999999},"max":{"1min":0.71899999999999997,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.50700000000000001},"min":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.29399999999999998},"max":{"1min":0.79100000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55800000000000005,"15min":0.52800000000000002},"min":{"1min":0.434,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":0.76500000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.372}]},{"osd":3,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54100000000000004,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.751,"5min":0.752,"15min":0.752},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.42699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83199999999999996,"5min":0.83399999999999996,"15min":2.3879999999999999},"last":0.439}]},{"osd":4,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45900000000000002,"15min":0.47099999999999997},"min":{"1min":0.34499999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66000000000000003,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.502,"15min":0.495},"min":{"1min":0.373,"5min":0.30499999999999999,"15min":0.27400000000000002},"max":{"1min":0.624,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.38700000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.495,"15min":0.502},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.30099999999999999},"max":{"1min":0.69199999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.33400000000000002},"max":{"1min":0.69499999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54800000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.39500000000000002,"5min":0.34699999999999998,"15min":0.312},"max":{"1min":0.78400000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.41599999999999998,"5min":0.36299999999999999,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":0.89100000000000001,"15min":1.052},"last":0.57499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":941,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194370,"statfs":{"total":200000000,"available":199035456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.32500000000000001},"min":{"1min":0.27200000000000002,"5min":0.193,"15min":0.17499999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":1.9359999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.376,"15min":0.34499999999999997},"min":{"1min":0.317,"5min":0.221,"15min":0.192},"max":{"1min":0.504,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.38400000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.33500000000000002},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.19600000000000001},"max":{"1min":0.57799999999999996,"5min":0.70399999999999996,"15min":1.639},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.39200000000000002,"15min":0.35699999999999998},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.22500000000000001},"max":{"1min":0.61599999999999999,"5min":0.69599999999999995,"15min":1.9039999999999999},"last":0.35599999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.40600000000000003,"15min":0.379},"min":{"1min":0.35399999999999998,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":0.55300000000000005,"5min":0.64500000000000002,"15min":1.6819999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.40999999999999998,"15min":0.36799999999999999},"min":{"1min":0.39500000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.63800000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.34000000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.51500000000000001,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.91600000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.58299999999999996,"15min":0.54700000000000004},"min":{"1min":0.52000000000000002,"5min":0.35699999999999998,"15min":0.28599999999999998},"max":{"1min":0.73099999999999998,"5min":0.86399999999999999,"15min":1.9570000000000001},"last":0.432}]},{"osd":5,"last update":"Sat Oct 7 08:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63,"15min":0.59099999999999997},"min":{"1min":0.55000000000000004,"5min":0.38300000000000001,"15min":0.371},"max":{"1min":0.79700000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63,"15min":0.58899999999999997},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.36599999999999999},"max":{"1min":0.85599999999999998,"5min":0.89600000000000002,"15min":0.97299999999999998},"last":0.51800000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.59799999999999998,"15min":0.56200000000000006},"min":{"1min":0.51100000000000001,"5min":0.379,"15min":0.34200000000000003},"max":{"1min":0.76100000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.60899999999999999,"15min":0.55500000000000005},"min":{"1min":0.51800000000000002,"5min":0.40300000000000002,"15min":0.38200000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.87},"last":0.46000000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63500000000000001,"15min":0.60499999999999998},"min":{"1min":0.55400000000000005,"5min":0.439,"15min":0.35699999999999998},"max":{"1min":0.76900000000000002,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.625},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65500000000000003,"15min":0.60599999999999998},"min":{"1min":0.52900000000000003,"5min":0.46100000000000002,"15min":0.40799999999999997},"max":{"1min":0.877,"5min":0.92700000000000005,"15min":0.94299999999999995},"last":0.501}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1519,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193793,"statfs":{"total":200000000,"available":198444072,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.35599999999999998,"15min":0.36299999999999999},"min":{"1min":0.23000000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.61799999999999999,"5min":0.71099999999999997,"15min":1.4339999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38300000000000001,"15min":0.38800000000000001},"min":{"1min":0.25700000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54000000000000004,"5min":0.67400000000000004,"15min":1.079},"last":0.40699999999999997}]},{"osd":2,"last update":"Sat Oct 7 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.378,"15min":0.38500000000000001},"min":{"1min":0.27700000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.55300000000000005,"5min":0.63200000000000001,"15min":1.464},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.39800000000000002},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.21299999999999999},"max":{"1min":0.627,"5min":0.67900000000000005,"15min":1.1060000000000001},"last":0.33700000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":0.59899999999999998,"15min":1.341},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.32900000000000001,"5min":0.28000000000000003,"15min":0.25700000000000001},"max":{"1min":0.65700000000000003,"5min":0.68600000000000005,"15min":1.532},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59499999999999997,"15min":0.58299999999999996},"min":{"1min":0.50900000000000001,"5min":0.34799999999999998,"15min":0.32600000000000001},"max":{"1min":0.876,"5min":0.90200000000000002,"15min":1.3169999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.50800000000000001,"5min":0.36199999999999999,"15min":0.34699999999999998},"max":{"1min":0.76300000000000001,"5min":0.84999999999999998,"15min":1.51},"last":0.504}]},{"osd":5,"last update":"Sat Oct 7 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.497,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89000000000000001,"5min":0.92300000000000004,"15min":1.0529999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59499999999999997,"15min":0.57999999999999996},"min":{"1min":0.501,"5min":0.40799999999999997,"15min":0.35299999999999998},"max":{"1min":0.77400000000000002,"5min":0.91000000000000003,"15min":1.25},"last":0.52900000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.48599999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.91000000000000003,"5min":0.92900000000000005,"15min":1.488},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.627,"15min":0.60599999999999998},"min":{"1min":0.50900000000000001,"5min":0.41999999999999998,"15min":0.39000000000000001},"max":{"1min":0.85299999999999998,"5min":0.94199999999999995,"15min":1.024},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.47699999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.98499999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.61199999999999999},"min":{"1min":0.50700000000000001,"5min":0.375,"15min":0.374},"max":{"1min":0.83999999999999997,"5min":0.90300000000000002,"15min":1.288},"last":0.55300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":942,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194369,"statfs":{"total":200000000,"available":199034404,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.32900000000000001,"15min":0.33700000000000002},"min":{"1min":0.23999999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":1.665},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36299999999999999},"min":{"1min":0.24399999999999999,"5min":0.23499999999999999,"15min":0.22600000000000001},"max":{"1min":0.54300000000000004,"5min":0.63400000000000001,"15min":1.579},"last":0.27000000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38700000000000001,"15min":0.376},"min":{"1min":0.26500000000000001,"5min":0.218,"15min":0.20499999999999999},"max":{"1min":0.46800000000000003,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.437,"15min":0.42499999999999999},"min":{"1min":0.28599999999999998,"5min":0.20999999999999999,"15min":0.20200000000000001},"max":{"1min":0.55200000000000005,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.30199999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.40999999999999998,"15min":0.39600000000000002},"min":{"1min":0.32600000000000001,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":1.454},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.39800000000000002,"15min":0.39000000000000001},"min":{"1min":0.33900000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":1.6919999999999999},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.28199999999999997},"max":{"1min":0.83099999999999996,"5min":0.90500000000000003,"15min":1.7210000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.5549999999999999},"last":0.57399999999999995}]},{"osd":5,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.5269999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.38600000000000001,"15min":0.311},"max":{"1min":0.83799999999999997,"5min":0.88900000000000001,"15min":1.4039999999999999},"last":0.53800000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.41499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.879,"5min":0.93999999999999995,"15min":1.3380000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60199999999999998,"15min":0.59099999999999997},"min":{"1min":0.49299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79400000000000004,"5min":0.86099999999999999,"15min":1.637},"last":0.56200000000000006}]},{"osd":7,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.59699999999999998},"min":{"1min":0.51300000000000001,"5min":0.40600000000000003,"15min":0.379},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.49},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64100000000000001,"15min":0.61599999999999999},"min":{"1min":0.47999999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86499999999999999,"5min":0.96999999999999997,"15min":1.375},"last":0.45600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574966,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:52:01 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32200000000000001,"15min":0.32800000000000001},"min":{"1min":0.25,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46100000000000002,"5min":0.90200000000000002,"15min":1.8220000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.34899999999999998,"15min":0.33200000000000002},"min":{"1min":0.23999999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.47799999999999998,"5min":0.57699999999999996,"15min":0.93500000000000005},"last":0.30599999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:52:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.36299999999999999},"min":{"1min":0.29799999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.49299999999999999,"5min":0.61599999999999999,"15min":1.6519999999999999},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.22500000000000001},"max":{"1min":0.57899999999999996,"5min":0.70099999999999996,"15min":1.885},"last":0.35199999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:52:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.38500000000000001,"15min":0.38300000000000001},"min":{"1min":0.32200000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.56200000000000006,"5min":0.57699999999999996,"15min":1.274},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40500000000000003,"15min":0.40300000000000002},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.25800000000000001},"max":{"1min":0.53800000000000003,"5min":0.97699999999999998,"15min":1.8999999999999999},"last":0.27400000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:52:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.52800000000000002},"min":{"1min":0.42099999999999999,"5min":0.36499999999999999,"15min":0.29999999999999999},"max":{"1min":0.80600000000000005,"5min":0.81699999999999995,"15min":0.82799999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.55300000000000005},"min":{"1min":0.41599999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.752,"5min":0.90000000000000002,"15min":1.3109999999999999},"last":0.46800000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:52:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.35999999999999999},"max":{"1min":0.70899999999999996,"5min":0.85799999999999998,"15min":1.1639999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59999999999999998,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.78900000000000003,"5min":1.038,"15min":1.851},"last":0.51200000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:52:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.57999999999999996},"min":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.91000000000000003,"15min":0.92700000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.622,"15min":0.60099999999999998},"min":{"1min":0.45400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.81299999999999994,"5min":0.94399999999999995,"15min":1.1930000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:52:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39700000000000002},"max":{"1min":0.77600000000000002,"5min":1.0089999999999999,"15min":1.8700000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60199999999999998,"15min":0.57199999999999995},"min":{"1min":0.42799999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84199999999999997,"5min":0.85099999999999998,"15min":0.88400000000000001},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042298,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.505,"15min":0.496},"min":{"1min":0.38500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.78200000000000003,"5min":0.89300000000000002,"15min":1.9419999999999999},"last":0.497},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53000000000000003,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":0.67800000000000005,"5min":0.73599999999999999,"15min":1.6879999999999999},"last":0.34899999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":0.65900000000000003,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52100000000000002,"15min":0.50700000000000001},"min":{"1min":0.39300000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.69799999999999995,"5min":0.81100000000000005,"15min":1.3580000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.311,"15min":0.27800000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":2.1520000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.40500000000000003,"5min":0.372,"15min":0.30599999999999999},"max":{"1min":0.67200000000000004,"5min":0.72699999999999998,"15min":1.29},"last":0.46700000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.38900000000000001,"5min":0.32500000000000001,"15min":0.29999999999999999},"max":{"1min":0.71899999999999997,"5min":0.91400000000000003,"15min":2.052},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70999999999999996,"5min":0.78700000000000003,"15min":1.369},"last":0.51500000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27000000000000002},"max":{"1min":0.66700000000000004,"5min":0.75800000000000001,"15min":0.89000000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.63300000000000001,"5min":0.88,"15min":0.88},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60699999999999998,"5min":0.85899999999999999,"15min":1.0049999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.309,"15min":0.309},"max":{"1min":0.73899999999999999,"5min":0.75900000000000001,"15min":0.95599999999999996},"last":0.58699999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.54600000000000004},"min":{"1min":0.34899999999999998,"5min":0.31,"15min":0.30099999999999999},"max":{"1min":0.67300000000000004,"5min":0.85099999999999998,"15min":0.98899999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33300000000000002},"max":{"1min":0.754,"5min":0.90200000000000002,"15min":0.91300000000000003},"last":0.57199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53300000000000003,"15min":0.52100000000000002},"min":{"1min":0.376,"5min":0.311,"15min":0.26200000000000001},"max":{"1min":0.71199999999999997,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.51900000000000002},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58299999999999996}]},{"osd":1,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55800000000000005,"15min":0.51100000000000001},"min":{"1min":0.378,"5min":0.33300000000000002,"15min":0.25},"max":{"1min":0.75700000000000001,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.85199999999999998,"15min":0.63800000000000001},"min":{"1min":0.438,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76200000000000001,"5min":29.143999999999998,"15min":29.143999999999998},"last":0.56999999999999995}]},{"osd":2,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.40500000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.73999999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.41399999999999998,"5min":0.34699999999999998,"15min":0.309},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.59399999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.40400000000000003,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.78600000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.45800000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73899999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54000000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47699999999999998,"15min":0.47599999999999998},"min":{"1min":0.29099999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.75,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55700000000000005,"15min":0.58299999999999996},"min":{"1min":0.41099999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77200000000000002,"5min":0.80800000000000005,"15min":0.80900000000000005},"last":0.41799999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.504,"15min":0.52800000000000002},"min":{"1min":0.32400000000000001,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":0.72999999999999998,"5min":0.79100000000000004,"15min":0.81399999999999995},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.36299999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72899999999999998,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.433}]},{"osd":7,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.56100000000000005},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.93100000000000005},"last":0.373},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78500000000000003,"5min":0.84299999999999997,"15min":0.91100000000000003},"last":0.48999999999999999}]}]}],"pool_statfs":[]}} 2023-10-07T08:52:27.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:52:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.089+0000 7fcd3f492700 1 Processor -- start 2023-10-07T08:52:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.089+0000 7fcd3f492700 1 -- start start 2023-10-07T08:52:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.090+0000 7fcd3f492700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd38157ca0 0x7fcd380cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.090+0000 7fcd3f492700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd3806d120 0x7fcd3806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.090+0000 7fcd3f492700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd380d07c0 con 0x7fcd381578d0 2023-10-07T08:52:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.090+0000 7fcd3f492700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3806daa0 con 0x7fcd38157ca0 2023-10-07T08:52:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.090+0000 7fcd3f492700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd380cfbb0 con 0x7fcd3806d120 2023-10-07T08:52:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.090+0000 7fcd3ca2d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd38157ca0 0x7fcd380cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.090+0000 7fcd3d22e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcd381578d0 0x7fcd3815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50440/0 (socket says 172.21.15.81:50440) 2023-10-07T08:52:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.090+0000 7fcd3d22e700 1 -- 172.21.15.81:0/2561981698 learned_addr learned my addr 172.21.15.81:0/2561981698 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.090+0000 7fcd3da2f700 1 --2- 172.21.15.81:0/2561981698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd3806d120 0x7fcd3806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd3ca2d700 1 -- 172.21.15.81:0/2561981698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd3806d120 msgr2=0x7fcd3806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd3ca2d700 1 --2- 172.21.15.81:0/2561981698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd3806d120 0x7fcd3806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd3ca2d700 1 -- 172.21.15.81:0/2561981698 >> v1:172.21.15.81:6789/0 conn(0x7fcd381578d0 legacy=0x7fcd3815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd3ca2d700 1 -- 172.21.15.81:0/2561981698 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd380cfe90 con 0x7fcd38157ca0 2023-10-07T08:52:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd2ffff700 1 -- 172.21.15.81:0/2561981698 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516578354 0 0) 0x7fcd380d07c0 con 0x7fcd381578d0 2023-10-07T08:52:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd3ca2d700 1 --2- 172.21.15.81:0/2561981698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38157ca0 0x7fcd380cf4f0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fcd280098e0 tx=0x7fcd280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83e176a07f1d369 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd2ffff700 1 -- 172.21.15.81:0/2561981698 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2800b640 con 0x7fcd38157ca0 2023-10-07T08:52:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd2ffff700 1 -- 172.21.15.81:0/2561981698 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2800b7a0 con 0x7fcd38157ca0 2023-10-07T08:52:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd2ffff700 1 -- 172.21.15.81:0/2561981698 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2800bb40 con 0x7fcd38157ca0 2023-10-07T08:52:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd3f492700 1 -- 172.21.15.81:0/2561981698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38157ca0 msgr2=0x7fcd380cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd3f492700 1 --2- 172.21.15.81:0/2561981698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38157ca0 0x7fcd380cf4f0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fcd280098e0 tx=0x7fcd280091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd3f492700 1 -- 172.21.15.81:0/2561981698 shutdown_connections 2023-10-07T08:52:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd3f492700 1 --2- 172.21.15.81:0/2561981698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd3806d120 0x7fcd3806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd3f492700 1 --2- 172.21.15.81:0/2561981698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38157ca0 0x7fcd380cf4f0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd3f492700 1 -- 172.21.15.81:0/2561981698 >> 172.21.15.81:0/2561981698 conn(0x7fcd3806bb90 msgr2=0x7fcd3806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd3f492700 1 -- 172.21.15.81:0/2561981698 shutdown_connections 2023-10-07T08:52:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.091+0000 7fcd3f492700 1 -- 172.21.15.81:0/2561981698 wait complete. 2023-10-07T08:52:28.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.092+0000 7fcd3f492700 1 Processor -- start 2023-10-07T08:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.092+0000 7fcd3f492700 1 -- start start 2023-10-07T08:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.093+0000 7fcd3f492700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd3806d120 0x7fcd380b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.093+0000 7fcd3f492700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd381578d0 0x7fcd38153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.093+0000 7fcd3f492700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38157ca0 0x7fcd38159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.093+0000 7fcd3f492700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3816b6d0 con 0x7fcd38157ca0 2023-10-07T08:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.093+0000 7fcd3f492700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd380b4320 con 0x7fcd3806d120 2023-10-07T08:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.093+0000 7fcd3f492700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3816b3f0 con 0x7fcd381578d0 2023-10-07T08:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.093+0000 7fcd3da2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38157ca0 0x7fcd38159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.093+0000 7fcd3da2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38157ca0 0x7fcd38159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35770/0 (socket says 172.21.15.81:35770) 2023-10-07T08:52:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.093+0000 7fcd3da2f700 1 -- 172.21.15.81:0/3858155829 learned_addr learned my addr 172.21.15.81:0/3858155829 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.094+0000 7fcd3d22e700 1 --2- 172.21.15.81:0/3858155829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd3806d120 0x7fcd380b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.094+0000 7fcd3ca2d700 1 --2- 172.21.15.81:0/3858155829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd381578d0 0x7fcd38153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.094+0000 7fcd3da2f700 1 -- 172.21.15.81:0/3858155829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd381578d0 msgr2=0x7fcd38153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.094+0000 7fcd3da2f700 1 --2- 172.21.15.81:0/3858155829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd381578d0 0x7fcd38153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.094+0000 7fcd3da2f700 1 -- 172.21.15.81:0/3858155829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd3806d120 msgr2=0x7fcd380b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.094+0000 7fcd3da2f700 1 --2- 172.21.15.81:0/3858155829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd3806d120 0x7fcd380b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.094+0000 7fcd3da2f700 1 -- 172.21.15.81:0/3858155829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd28009420 con 0x7fcd38157ca0 2023-10-07T08:52:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.094+0000 7fcd3d22e700 1 --2- 172.21.15.81:0/3858155829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd3806d120 0x7fcd380b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.094+0000 7fcd3ca2d700 1 --2- 172.21.15.81:0/3858155829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd381578d0 0x7fcd38153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.094+0000 7fcd3da2f700 1 --2- 172.21.15.81:0/3858155829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38157ca0 0x7fcd38159460 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000ea50 tx=0x7fcd300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.094+0000 7fcd2d7fa700 1 -- 172.21.15.81:0/3858155829 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000c920 con 0x7fcd38157ca0 2023-10-07T08:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.094+0000 7fcd2d7fa700 1 -- 172.21.15.81:0/3858155829 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3000caa0 con 0x7fcd38157ca0 2023-10-07T08:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.094+0000 7fcd3f492700 1 -- 172.21.15.81:0/3858155829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd380b3cd0 con 0x7fcd38157ca0 2023-10-07T08:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.094+0000 7fcd2d7fa700 1 -- 172.21.15.81:0/3858155829 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000ce60 con 0x7fcd38157ca0 2023-10-07T08:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.094+0000 7fcd3f492700 1 -- 172.21.15.81:0/3858155829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd38153fb0 con 0x7fcd38157ca0 2023-10-07T08:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.095+0000 7fcd3f492700 1 -- 172.21.15.81:0/3858155829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3806e700 con 0x7fcd38157ca0 2023-10-07T08:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.095+0000 7fcd2d7fa700 1 -- 172.21.15.81:0/3858155829 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd30013680 con 0x7fcd38157ca0 2023-10-07T08:52:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.096+0000 7fcd2d7fa700 1 --2- 172.21.15.81:0/3858155829 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcd1c066f00 0x7fcd1c0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.096+0000 7fcd2d7fa700 1 -- 172.21.15.81:0/3858155829 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd30084920 con 0x7fcd38157ca0 2023-10-07T08:52:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.096+0000 7fcd3d22e700 1 --2- 172.21.15.81:0/3858155829 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcd1c066f00 0x7fcd1c0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.096+0000 7fcd3d22e700 1 --2- 172.21.15.81:0/3858155829 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcd1c066f00 0x7fcd1c0693b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400d270 tx=0x7fcd34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.100+0000 7fcd2d7fa700 1 -- 172.21.15.81:0/3858155829 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd30051b90 con 0x7fcd38157ca0 2023-10-07T08:52:28.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.278+0000 7fcd3f492700 1 -- 172.21.15.81:0/3858155829 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd380b4490 con 0x7fcd1c066f00 2023-10-07T08:52:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.286+0000 7fcd2d7fa700 1 -- 172.21.15.81:0/3858155829 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285555 (secure 0 0 0) 0x7fcd380b4490 con 0x7fcd1c066f00 2023-10-07T08:52:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.289+0000 7fcd3f492700 1 -- 172.21.15.81:0/3858155829 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcd1c066f00 msgr2=0x7fcd1c0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.289+0000 7fcd3f492700 1 --2- 172.21.15.81:0/3858155829 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcd1c066f00 0x7fcd1c0693b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400d270 tx=0x7fcd34009040 comp rx=0 tx=0).stop 2023-10-07T08:52:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.289+0000 7fcd3f492700 1 -- 172.21.15.81:0/3858155829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38157ca0 msgr2=0x7fcd38159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.289+0000 7fcd3f492700 1 --2- 172.21.15.81:0/3858155829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38157ca0 0x7fcd38159460 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000ea50 tx=0x7fcd300091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.289+0000 7fcd3f492700 1 -- 172.21.15.81:0/3858155829 shutdown_connections 2023-10-07T08:52:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.289+0000 7fcd3f492700 1 --2- 172.21.15.81:0/3858155829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd38157ca0 0x7fcd38159460 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.289+0000 7fcd3f492700 1 --2- 172.21.15.81:0/3858155829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd3806d120 0x7fcd380b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.289+0000 7fcd3f492700 1 --2- 172.21.15.81:0/3858155829 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcd1c066f00 0x7fcd1c0693b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.289+0000 7fcd3f492700 1 --2- 172.21.15.81:0/3858155829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd381578d0 0x7fcd38153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.289+0000 7fcd3f492700 1 -- 172.21.15.81:0/3858155829 >> 172.21.15.81:0/3858155829 conn(0x7fcd3806bb90 msgr2=0x7fcd38156120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.289+0000 7fcd3f492700 1 -- 172.21.15.81:0/3858155829 shutdown_connections 2023-10-07T08:52:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.289+0000 7fcd3f492700 1 -- 172.21.15.81:0/3858155829 wait complete. 2023-10-07T08:52:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:52:28.302 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":456,"stamp":"2023-10-07T08:52:28.130852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553841,"statfs":{"total":1600000000,"available":1591134172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,6],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001043"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336234+0000","last_change":"2023-10-07T08:52:23.335133+0000","last_active":"2023-10-07T08:52:23.336234+0000","last_peered":"2023-10-07T08:52:23.336234+0000","last_clean":"2023-10-07T08:52:23.336234+0000","last_became_active":"2023-10-07T08:52:23.334699+0000","last_became_peered":"2023-10-07T08:52:23.334699+0000","last_unstale":"2023-10-07T08:52:23.336234+0000","last_undegraded":"2023-10-07T08:52:23.336234+0000","last_fullsized":"2023-10-07T08:52:23.336234+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:54:20.956904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.335215+0000","last_change":"2023-10-07T08:52:23.335215+0000","last_active":"2023-10-07T08:52:23.335215+0000","last_peered":"2023-10-07T08:52:23.335215+0000","last_clean":"2023-10-07T08:52:23.335215+0000","last_became_active":"2023-10-07T08:52:23.335006+0000","last_became_peered":"2023-10-07T08:52:23.335006+0000","last_unstale":"2023-10-07T08:52:23.335215+0000","last_undegraded":"2023-10-07T08:52:23.335215+0000","last_fullsized":"2023-10-07T08:52:23.335215+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:34:01.185477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.344789+0000","last_change":"2023-10-07T08:52:23.344789+0000","last_active":"2023-10-07T08:52:23.344789+0000","last_peered":"2023-10-07T08:52:23.344789+0000","last_clean":"2023-10-07T08:52:23.344789+0000","last_became_active":"2023-10-07T08:52:23.344062+0000","last_became_peered":"2023-10-07T08:52:23.344062+0000","last_unstale":"2023-10-07T08:52:23.344789+0000","last_undegraded":"2023-10-07T08:52:23.344789+0000","last_fullsized":"2023-10-07T08:52:23.344789+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:17:13.259446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.338177+0000","last_change":"2023-10-07T08:52:23.338177+0000","last_active":"2023-10-07T08:52:23.338177+0000","last_peered":"2023-10-07T08:52:23.338177+0000","last_clean":"2023-10-07T08:52:23.338177+0000","last_became_active":"2023-10-07T08:52:23.337773+0000","last_became_peered":"2023-10-07T08:52:23.337773+0000","last_unstale":"2023-10-07T08:52:23.338177+0000","last_undegraded":"2023-10-07T08:52:23.338177+0000","last_fullsized":"2023-10-07T08:52:23.338177+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:54:20.956904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336346+0000","last_change":"2023-10-07T08:52:23.336346+0000","last_active":"2023-10-07T08:52:23.336346+0000","last_peered":"2023-10-07T08:52:23.336346+0000","last_clean":"2023-10-07T08:52:23.336346+0000","last_became_active":"2023-10-07T08:52:23.336115+0000","last_became_peered":"2023-10-07T08:52:23.336115+0000","last_unstale":"2023-10-07T08:52:23.336346+0000","last_undegraded":"2023-10-07T08:52:23.336346+0000","last_fullsized":"2023-10-07T08:52:23.336346+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:48.833256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336789+0000","last_change":"2023-10-07T08:52:23.336709+0000","last_active":"2023-10-07T08:52:23.336789+0000","last_peered":"2023-10-07T08:52:23.336789+0000","last_clean":"2023-10-07T08:52:23.336789+0000","last_became_active":"2023-10-07T08:52:23.336212+0000","last_became_peered":"2023-10-07T08:52:23.336212+0000","last_unstale":"2023-10-07T08:52:23.336789+0000","last_undegraded":"2023-10-07T08:52:23.336789+0000","last_fullsized":"2023-10-07T08:52:23.336789+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:51.633336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334016+0000","last_change":"2023-10-07T08:52:23.333959+0000","last_active":"2023-10-07T08:52:23.334016+0000","last_peered":"2023-10-07T08:52:23.334016+0000","last_clean":"2023-10-07T08:52:23.334016+0000","last_became_active":"2023-10-07T08:52:23.333688+0000","last_became_peered":"2023-10-07T08:52:23.333688+0000","last_unstale":"2023-10-07T08:52:23.334016+0000","last_undegraded":"2023-10-07T08:52:23.334016+0000","last_fullsized":"2023-10-07T08:52:23.334016+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:12:15.564614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.338029+0000","last_change":"2023-10-07T08:52:23.337988+0000","last_active":"2023-10-07T08:52:23.338029+0000","last_peered":"2023-10-07T08:52:23.338029+0000","last_clean":"2023-10-07T08:52:23.338029+0000","last_became_active":"2023-10-07T08:52:23.337810+0000","last_became_peered":"2023-10-07T08:52:23.337810+0000","last_unstale":"2023-10-07T08:52:23.338029+0000","last_undegraded":"2023-10-07T08:52:23.338029+0000","last_fullsized":"2023-10-07T08:52:23.338029+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:55:01.102363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.332453+0000","last_change":"2023-10-07T08:52:23.332453+0000","last_active":"2023-10-07T08:52:23.332453+0000","last_peered":"2023-10-07T08:52:23.332453+0000","last_clean":"2023-10-07T08:52:23.332453+0000","last_became_active":"2023-10-07T08:52:23.332224+0000","last_became_peered":"2023-10-07T08:52:23.332224+0000","last_unstale":"2023-10-07T08:52:23.332453+0000","last_undegraded":"2023-10-07T08:52:23.332453+0000","last_fullsized":"2023-10-07T08:52:23.332453+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:26:37.307134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.343415+0000","last_change":"2023-10-07T08:52:23.343415+0000","last_active":"2023-10-07T08:52:23.343415+0000","last_peered":"2023-10-07T08:52:23.343415+0000","last_clean":"2023-10-07T08:52:23.343415+0000","last_became_active":"2023-10-07T08:52:23.343188+0000","last_became_peered":"2023-10-07T08:52:23.343188+0000","last_unstale":"2023-10-07T08:52:23.343415+0000","last_undegraded":"2023-10-07T08:52:23.343415+0000","last_fullsized":"2023-10-07T08:52:23.343415+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:33:25.418075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336758+0000","last_change":"2023-10-07T08:52:23.336445+0000","last_active":"2023-10-07T08:52:23.336758+0000","last_peered":"2023-10-07T08:52:23.336758+0000","last_clean":"2023-10-07T08:52:23.336758+0000","last_became_active":"2023-10-07T08:52:23.335353+0000","last_became_peered":"2023-10-07T08:52:23.335353+0000","last_unstale":"2023-10-07T08:52:23.336758+0000","last_undegraded":"2023-10-07T08:52:23.336758+0000","last_fullsized":"2023-10-07T08:52:23.336758+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:17:13.259446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.340989+0000","last_change":"2023-10-07T08:52:23.340989+0000","last_active":"2023-10-07T08:52:23.340989+0000","last_peered":"2023-10-07T08:52:23.340989+0000","last_clean":"2023-10-07T08:52:23.340989+0000","last_became_active":"2023-10-07T08:52:23.340760+0000","last_became_peered":"2023-10-07T08:52:23.340760+0000","last_unstale":"2023-10-07T08:52:23.340989+0000","last_undegraded":"2023-10-07T08:52:23.340989+0000","last_fullsized":"2023-10-07T08:52:23.340989+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:21:32.173851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.341819+0000","last_change":"2023-10-07T08:52:23.341819+0000","last_active":"2023-10-07T08:52:23.341819+0000","last_peered":"2023-10-07T08:52:23.341819+0000","last_clean":"2023-10-07T08:52:23.341819+0000","last_became_active":"2023-10-07T08:52:23.340757+0000","last_became_peered":"2023-10-07T08:52:23.340757+0000","last_unstale":"2023-10-07T08:52:23.341819+0000","last_undegraded":"2023-10-07T08:52:23.341819+0000","last_fullsized":"2023-10-07T08:52:23.341819+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:06.071802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.340891+0000","last_change":"2023-10-07T08:52:23.340891+0000","last_active":"2023-10-07T08:52:23.340891+0000","last_peered":"2023-10-07T08:52:23.340891+0000","last_clean":"2023-10-07T08:52:23.340891+0000","last_became_active":"2023-10-07T08:52:23.340329+0000","last_became_peered":"2023-10-07T08:52:23.340329+0000","last_unstale":"2023-10-07T08:52:23.340891+0000","last_undegraded":"2023-10-07T08:52:23.340891+0000","last_fullsized":"2023-10-07T08:52:23.340891+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:43:27.209113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.340175+0000","last_change":"2023-10-07T08:52:23.340175+0000","last_active":"2023-10-07T08:52:23.340175+0000","last_peered":"2023-10-07T08:52:23.340175+0000","last_clean":"2023-10-07T08:52:23.340175+0000","last_became_active":"2023-10-07T08:52:23.339928+0000","last_became_peered":"2023-10-07T08:52:23.339928+0000","last_unstale":"2023-10-07T08:52:23.340175+0000","last_undegraded":"2023-10-07T08:52:23.340175+0000","last_fullsized":"2023-10-07T08:52:23.340175+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:07:27.102265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334946+0000","last_change":"2023-10-07T08:52:23.334335+0000","last_active":"2023-10-07T08:52:23.334946+0000","last_peered":"2023-10-07T08:52:23.334946+0000","last_clean":"2023-10-07T08:52:23.334946+0000","last_became_active":"2023-10-07T08:52:23.334126+0000","last_became_peered":"2023-10-07T08:52:23.334126+0000","last_unstale":"2023-10-07T08:52:23.334946+0000","last_undegraded":"2023-10-07T08:52:23.334946+0000","last_fullsized":"2023-10-07T08:52:23.334946+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:20:04.281330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.335936+0000","last_change":"2023-10-07T08:52:23.335936+0000","last_active":"2023-10-07T08:52:23.335936+0000","last_peered":"2023-10-07T08:52:23.335936+0000","last_clean":"2023-10-07T08:52:23.335936+0000","last_became_active":"2023-10-07T08:52:23.335675+0000","last_became_peered":"2023-10-07T08:52:23.335675+0000","last_unstale":"2023-10-07T08:52:23.335936+0000","last_undegraded":"2023-10-07T08:52:23.335936+0000","last_fullsized":"2023-10-07T08:52:23.335936+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:30:47.194487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.344386+0000","last_change":"2023-10-07T08:52:23.344386+0000","last_active":"2023-10-07T08:52:23.344386+0000","last_peered":"2023-10-07T08:52:23.344386+0000","last_clean":"2023-10-07T08:52:23.344386+0000","last_became_active":"2023-10-07T08:52:23.343569+0000","last_became_peered":"2023-10-07T08:52:23.343569+0000","last_unstale":"2023-10-07T08:52:23.344386+0000","last_undegraded":"2023-10-07T08:52:23.344386+0000","last_fullsized":"2023-10-07T08:52:23.344386+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:51.633336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336269+0000","last_change":"2023-10-07T08:52:23.336067+0000","last_active":"2023-10-07T08:52:23.336269+0000","last_peered":"2023-10-07T08:52:23.336269+0000","last_clean":"2023-10-07T08:52:23.336269+0000","last_became_active":"2023-10-07T08:52:23.335801+0000","last_became_peered":"2023-10-07T08:52:23.335801+0000","last_unstale":"2023-10-07T08:52:23.336269+0000","last_undegraded":"2023-10-07T08:52:23.336269+0000","last_fullsized":"2023-10-07T08:52:23.336269+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:12:53.607520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.329018+0000","last_change":"2023-10-07T08:52:23.328974+0000","last_active":"2023-10-07T08:52:23.329018+0000","last_peered":"2023-10-07T08:52:23.329018+0000","last_clean":"2023-10-07T08:52:23.329018+0000","last_became_active":"2023-10-07T08:52:23.328801+0000","last_became_peered":"2023-10-07T08:52:23.328801+0000","last_unstale":"2023-10-07T08:52:23.329018+0000","last_undegraded":"2023-10-07T08:52:23.329018+0000","last_fullsized":"2023-10-07T08:52:23.329018+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:10:34.378847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.339821+0000","last_change":"2023-10-07T08:52:23.339821+0000","last_active":"2023-10-07T08:52:23.339821+0000","last_peered":"2023-10-07T08:52:23.339821+0000","last_clean":"2023-10-07T08:52:23.339821+0000","last_became_active":"2023-10-07T08:52:23.339582+0000","last_became_peered":"2023-10-07T08:52:23.339582+0000","last_unstale":"2023-10-07T08:52:23.339821+0000","last_undegraded":"2023-10-07T08:52:23.339821+0000","last_fullsized":"2023-10-07T08:52:23.339821+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:00:48.362886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.328538+0000","last_change":"2023-10-07T08:52:23.328538+0000","last_active":"2023-10-07T08:52:23.328538+0000","last_peered":"2023-10-07T08:52:23.328538+0000","last_clean":"2023-10-07T08:52:23.328538+0000","last_became_active":"2023-10-07T08:52:23.328205+0000","last_became_peered":"2023-10-07T08:52:23.328205+0000","last_unstale":"2023-10-07T08:52:23.328538+0000","last_undegraded":"2023-10-07T08:52:23.328538+0000","last_fullsized":"2023-10-07T08:52:23.328538+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:27:15.146656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.338001+0000","last_change":"2023-10-07T08:52:23.338001+0000","last_active":"2023-10-07T08:52:23.338001+0000","last_peered":"2023-10-07T08:52:23.338001+0000","last_clean":"2023-10-07T08:52:23.338001+0000","last_became_active":"2023-10-07T08:52:23.337779+0000","last_became_peered":"2023-10-07T08:52:23.337779+0000","last_unstale":"2023-10-07T08:52:23.338001+0000","last_undegraded":"2023-10-07T08:52:23.338001+0000","last_fullsized":"2023-10-07T08:52:23.338001+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:55:01.102363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.344386+0000","last_change":"2023-10-07T08:52:23.344386+0000","last_active":"2023-10-07T08:52:23.344386+0000","last_peered":"2023-10-07T08:52:23.344386+0000","last_clean":"2023-10-07T08:52:23.344386+0000","last_became_active":"2023-10-07T08:52:23.344129+0000","last_became_peered":"2023-10-07T08:52:23.344129+0000","last_unstale":"2023-10-07T08:52:23.344386+0000","last_undegraded":"2023-10-07T08:52:23.344386+0000","last_fullsized":"2023-10-07T08:52:23.344386+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:19.681662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334907+0000","last_change":"2023-10-07T08:52:23.333899+0000","last_active":"2023-10-07T08:52:23.334907+0000","last_peered":"2023-10-07T08:52:23.334907+0000","last_clean":"2023-10-07T08:52:23.334907+0000","last_became_active":"2023-10-07T08:52:23.333677+0000","last_became_peered":"2023-10-07T08:52:23.333677+0000","last_unstale":"2023-10-07T08:52:23.334907+0000","last_undegraded":"2023-10-07T08:52:23.334907+0000","last_fullsized":"2023-10-07T08:52:23.334907+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:28:08.413245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336774+0000","last_change":"2023-10-07T08:52:23.336568+0000","last_active":"2023-10-07T08:52:23.336774+0000","last_peered":"2023-10-07T08:52:23.336774+0000","last_clean":"2023-10-07T08:52:23.336774+0000","last_became_active":"2023-10-07T08:52:23.335936+0000","last_became_peered":"2023-10-07T08:52:23.335936+0000","last_unstale":"2023-10-07T08:52:23.336774+0000","last_undegraded":"2023-10-07T08:52:23.336774+0000","last_fullsized":"2023-10-07T08:52:23.336774+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:06:18.707462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334887+0000","last_change":"2023-10-07T08:52:23.333157+0000","last_active":"2023-10-07T08:52:23.334887+0000","last_peered":"2023-10-07T08:52:23.334887+0000","last_clean":"2023-10-07T08:52:23.334887+0000","last_became_active":"2023-10-07T08:52:23.333007+0000","last_became_peered":"2023-10-07T08:52:23.333007+0000","last_unstale":"2023-10-07T08:52:23.334887+0000","last_undegraded":"2023-10-07T08:52:23.334887+0000","last_fullsized":"2023-10-07T08:52:23.334887+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:24:36.923067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.343934+0000","last_change":"2023-10-07T08:52:23.343895+0000","last_active":"2023-10-07T08:52:23.343934+0000","last_peered":"2023-10-07T08:52:23.343934+0000","last_clean":"2023-10-07T08:52:23.343934+0000","last_became_active":"2023-10-07T08:52:23.343767+0000","last_became_peered":"2023-10-07T08:52:23.343767+0000","last_unstale":"2023-10-07T08:52:23.343934+0000","last_undegraded":"2023-10-07T08:52:23.343934+0000","last_fullsized":"2023-10-07T08:52:23.343934+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:28:50.602470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336261+0000","last_change":"2023-10-07T08:52:23.335976+0000","last_active":"2023-10-07T08:52:23.336261+0000","last_peered":"2023-10-07T08:52:23.336261+0000","last_clean":"2023-10-07T08:52:23.336261+0000","last_became_active":"2023-10-07T08:52:23.335535+0000","last_became_peered":"2023-10-07T08:52:23.335535+0000","last_unstale":"2023-10-07T08:52:23.336261+0000","last_undegraded":"2023-10-07T08:52:23.336261+0000","last_fullsized":"2023-10-07T08:52:23.336261+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:51:19.044003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.342568+0000","last_change":"2023-10-07T08:52:23.342568+0000","last_active":"2023-10-07T08:52:23.342568+0000","last_peered":"2023-10-07T08:52:23.342568+0000","last_clean":"2023-10-07T08:52:23.342568+0000","last_became_active":"2023-10-07T08:52:23.339619+0000","last_became_peered":"2023-10-07T08:52:23.339619+0000","last_unstale":"2023-10-07T08:52:23.342568+0000","last_undegraded":"2023-10-07T08:52:23.342568+0000","last_fullsized":"2023-10-07T08:52:23.342568+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:55:30.299396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336308+0000","last_change":"2023-10-07T08:52:23.336308+0000","last_active":"2023-10-07T08:52:23.336308+0000","last_peered":"2023-10-07T08:52:23.336308+0000","last_clean":"2023-10-07T08:52:23.336308+0000","last_became_active":"2023-10-07T08:52:23.336092+0000","last_became_peered":"2023-10-07T08:52:23.336092+0000","last_unstale":"2023-10-07T08:52:23.336308+0000","last_undegraded":"2023-10-07T08:52:23.336308+0000","last_fullsized":"2023-10-07T08:52:23.336308+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:58:50.284757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334869+0000","last_change":"2023-10-07T08:52:23.332727+0000","last_active":"2023-10-07T08:52:23.334869+0000","last_peered":"2023-10-07T08:52:23.334869+0000","last_clean":"2023-10-07T08:52:23.334869+0000","last_became_active":"2023-10-07T08:52:23.332504+0000","last_became_peered":"2023-10-07T08:52:23.332504+0000","last_unstale":"2023-10-07T08:52:23.334869+0000","last_undegraded":"2023-10-07T08:52:23.334869+0000","last_fullsized":"2023-10-07T08:52:23.334869+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:47:32.347841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.342437+0000","last_change":"2023-10-07T08:52:23.342437+0000","last_active":"2023-10-07T08:52:23.342437+0000","last_peered":"2023-10-07T08:52:23.342437+0000","last_clean":"2023-10-07T08:52:23.342437+0000","last_became_active":"2023-10-07T08:52:23.341201+0000","last_became_peered":"2023-10-07T08:52:23.341201+0000","last_unstale":"2023-10-07T08:52:23.342437+0000","last_undegraded":"2023-10-07T08:52:23.342437+0000","last_fullsized":"2023-10-07T08:52:23.342437+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:03:31.133745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"172'4","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.895560+0000","last_change":"2023-10-07T08:52:22.899468+0000","last_active":"2023-10-07T08:52:23.895560+0000","last_peered":"2023-10-07T08:52:23.895560+0000","last_clean":"2023-10-07T08:52:23.895560+0000","last_became_active":"2023-10-07T08:52:22.899176+0000","last_became_peered":"2023-10-07T08:52:22.899176+0000","last_unstale":"2023-10-07T08:52:23.895560+0000","last_undegraded":"2023-10-07T08:52:23.895560+0000","last_fullsized":"2023-10-07T08:52:23.895560+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:31:32.487019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334367+0000","last_change":"2023-10-07T08:52:23.334367+0000","last_active":"2023-10-07T08:52:23.334367+0000","last_peered":"2023-10-07T08:52:23.334367+0000","last_clean":"2023-10-07T08:52:23.334367+0000","last_became_active":"2023-10-07T08:52:23.334146+0000","last_became_peered":"2023-10-07T08:52:23.334146+0000","last_unstale":"2023-10-07T08:52:23.334367+0000","last_undegraded":"2023-10-07T08:52:23.334367+0000","last_fullsized":"2023-10-07T08:52:23.334367+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:50:52.295831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"172'1","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.327720+0000","last_change":"2023-10-07T08:52:22.899018+0000","last_active":"2023-10-07T08:52:23.327720+0000","last_peered":"2023-10-07T08:52:23.327720+0000","last_clean":"2023-10-07T08:52:23.327720+0000","last_became_active":"2023-10-07T08:52:22.898638+0000","last_became_peered":"2023-10-07T08:52:22.898638+0000","last_unstale":"2023-10-07T08:52:23.327720+0000","last_undegraded":"2023-10-07T08:52:23.327720+0000","last_fullsized":"2023-10-07T08:52:23.327720+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:31:32.487019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.339250+0000","last_change":"2023-10-07T08:52:23.339189+0000","last_active":"2023-10-07T08:52:23.339250+0000","last_peered":"2023-10-07T08:52:23.339250+0000","last_clean":"2023-10-07T08:52:23.339250+0000","last_became_active":"2023-10-07T08:52:23.339036+0000","last_became_peered":"2023-10-07T08:52:23.339036+0000","last_unstale":"2023-10-07T08:52:23.339250+0000","last_undegraded":"2023-10-07T08:52:23.339250+0000","last_fullsized":"2023-10-07T08:52:23.339250+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:41:40.133283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"172'2","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.894036+0000","last_change":"2023-10-07T08:52:22.893694+0000","last_active":"2023-10-07T08:52:23.894036+0000","last_peered":"2023-10-07T08:52:23.894036+0000","last_clean":"2023-10-07T08:52:23.894036+0000","last_became_active":"2023-10-07T08:52:22.893462+0000","last_became_peered":"2023-10-07T08:52:22.893462+0000","last_unstale":"2023-10-07T08:52:23.894036+0000","last_undegraded":"2023-10-07T08:52:23.894036+0000","last_fullsized":"2023-10-07T08:52:23.894036+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:32:07.177800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334794+0000","last_change":"2023-10-07T08:52:23.334794+0000","last_active":"2023-10-07T08:52:23.334794+0000","last_peered":"2023-10-07T08:52:23.334794+0000","last_clean":"2023-10-07T08:52:23.334794+0000","last_became_active":"2023-10-07T08:52:23.334526+0000","last_became_peered":"2023-10-07T08:52:23.334526+0000","last_unstale":"2023-10-07T08:52:23.334794+0000","last_undegraded":"2023-10-07T08:52:23.334794+0000","last_fullsized":"2023-10-07T08:52:23.334794+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:08:17.685917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"172'2","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.895992+0000","last_change":"2023-10-07T08:52:22.894486+0000","last_active":"2023-10-07T08:52:23.895992+0000","last_peered":"2023-10-07T08:52:23.895992+0000","last_clean":"2023-10-07T08:52:23.895992+0000","last_became_active":"2023-10-07T08:52:22.894267+0000","last_became_peered":"2023-10-07T08:52:22.894267+0000","last_unstale":"2023-10-07T08:52:23.895992+0000","last_undegraded":"2023-10-07T08:52:23.895992+0000","last_fullsized":"2023-10-07T08:52:23.895992+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:21:38.915092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.340367+0000","last_change":"2023-10-07T08:52:23.340367+0000","last_active":"2023-10-07T08:52:23.340367+0000","last_peered":"2023-10-07T08:52:23.340367+0000","last_clean":"2023-10-07T08:52:23.340367+0000","last_became_active":"2023-10-07T08:52:23.340124+0000","last_became_peered":"2023-10-07T08:52:23.340124+0000","last_unstale":"2023-10-07T08:52:23.340367+0000","last_undegraded":"2023-10-07T08:52:23.340367+0000","last_fullsized":"2023-10-07T08:52:23.340367+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:23:18.439945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.894741+0000","last_change":"2023-10-07T08:52:22.899541+0000","last_active":"2023-10-07T08:52:23.894741+0000","last_peered":"2023-10-07T08:52:23.894741+0000","last_clean":"2023-10-07T08:52:23.894741+0000","last_became_active":"2023-10-07T08:52:22.899313+0000","last_became_peered":"2023-10-07T08:52:22.899313+0000","last_unstale":"2023-10-07T08:52:23.894741+0000","last_undegraded":"2023-10-07T08:52:23.894741+0000","last_fullsized":"2023-10-07T08:52:23.894741+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:54:24.770106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.339303+0000","last_change":"2023-10-07T08:52:23.339303+0000","last_active":"2023-10-07T08:52:23.339303+0000","last_peered":"2023-10-07T08:52:23.339303+0000","last_clean":"2023-10-07T08:52:23.339303+0000","last_became_active":"2023-10-07T08:52:23.338486+0000","last_became_peered":"2023-10-07T08:52:23.338486+0000","last_unstale":"2023-10-07T08:52:23.339303+0000","last_undegraded":"2023-10-07T08:52:23.339303+0000","last_fullsized":"2023-10-07T08:52:23.339303+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:22:02.359460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"172'1","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.335627+0000","last_change":"2023-10-07T08:52:22.900063+0000","last_active":"2023-10-07T08:52:23.335627+0000","last_peered":"2023-10-07T08:52:23.335627+0000","last_clean":"2023-10-07T08:52:23.335627+0000","last_became_active":"2023-10-07T08:52:22.899569+0000","last_became_peered":"2023-10-07T08:52:22.899569+0000","last_unstale":"2023-10-07T08:52:23.335627+0000","last_undegraded":"2023-10-07T08:52:23.335627+0000","last_fullsized":"2023-10-07T08:52:23.335627+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:24:35.913351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.333309+0000","last_change":"2023-10-07T08:52:23.333309+0000","last_active":"2023-10-07T08:52:23.333309+0000","last_peered":"2023-10-07T08:52:23.333309+0000","last_clean":"2023-10-07T08:52:23.333309+0000","last_became_active":"2023-10-07T08:52:23.333084+0000","last_became_peered":"2023-10-07T08:52:23.333084+0000","last_unstale":"2023-10-07T08:52:23.333309+0000","last_undegraded":"2023-10-07T08:52:23.333309+0000","last_fullsized":"2023-10-07T08:52:23.333309+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:25:33.472323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.326180+0000","last_change":"2023-10-07T08:52:22.898986+0000","last_active":"2023-10-07T08:52:23.326180+0000","last_peered":"2023-10-07T08:52:23.326180+0000","last_clean":"2023-10-07T08:52:23.326180+0000","last_became_active":"2023-10-07T08:52:22.898768+0000","last_became_peered":"2023-10-07T08:52:22.898768+0000","last_unstale":"2023-10-07T08:52:23.326180+0000","last_undegraded":"2023-10-07T08:52:23.326180+0000","last_fullsized":"2023-10-07T08:52:23.326180+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:52:41.561967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.339163+0000","last_change":"2023-10-07T08:52:23.339163+0000","last_active":"2023-10-07T08:52:23.339163+0000","last_peered":"2023-10-07T08:52:23.339163+0000","last_clean":"2023-10-07T08:52:23.339163+0000","last_became_active":"2023-10-07T08:52:23.338921+0000","last_became_peered":"2023-10-07T08:52:23.338921+0000","last_unstale":"2023-10-07T08:52:23.339163+0000","last_undegraded":"2023-10-07T08:52:23.339163+0000","last_fullsized":"2023-10-07T08:52:23.339163+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:12:53.607520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.898044+0000","last_change":"2023-10-07T08:52:22.897945+0000","last_active":"2023-10-07T08:52:22.898044+0000","last_peered":"2023-10-07T08:52:22.898044+0000","last_clean":"2023-10-07T08:52:22.898044+0000","last_became_active":"2023-10-07T08:52:22.897695+0000","last_became_peered":"2023-10-07T08:52:22.897695+0000","last_unstale":"2023-10-07T08:52:22.898044+0000","last_undegraded":"2023-10-07T08:52:22.898044+0000","last_fullsized":"2023-10-07T08:52:22.898044+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:36:24.754975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.337652+0000","last_change":"2023-10-07T08:52:23.337652+0000","last_active":"2023-10-07T08:52:23.337652+0000","last_peered":"2023-10-07T08:52:23.337652+0000","last_clean":"2023-10-07T08:52:23.337652+0000","last_became_active":"2023-10-07T08:52:23.337390+0000","last_became_peered":"2023-10-07T08:52:23.337390+0000","last_unstale":"2023-10-07T08:52:23.337652+0000","last_undegraded":"2023-10-07T08:52:23.337652+0000","last_fullsized":"2023-10-07T08:52:23.337652+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:14:23.030732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.897258+0000","last_change":"2023-10-07T08:52:22.897153+0000","last_active":"2023-10-07T08:52:22.897258+0000","last_peered":"2023-10-07T08:52:22.897258+0000","last_clean":"2023-10-07T08:52:22.897258+0000","last_became_active":"2023-10-07T08:52:22.896936+0000","last_became_peered":"2023-10-07T08:52:22.896936+0000","last_unstale":"2023-10-07T08:52:22.897258+0000","last_undegraded":"2023-10-07T08:52:22.897258+0000","last_fullsized":"2023-10-07T08:52:22.897258+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:45:13.340367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.335090+0000","last_change":"2023-10-07T08:52:23.335090+0000","last_active":"2023-10-07T08:52:23.335090+0000","last_peered":"2023-10-07T08:52:23.335090+0000","last_clean":"2023-10-07T08:52:23.335090+0000","last_became_active":"2023-10-07T08:52:23.334826+0000","last_became_peered":"2023-10-07T08:52:23.334826+0000","last_unstale":"2023-10-07T08:52:23.335090+0000","last_undegraded":"2023-10-07T08:52:23.335090+0000","last_fullsized":"2023-10-07T08:52:23.335090+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:34:01.185477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.901036+0000","last_change":"2023-10-07T08:52:22.900968+0000","last_active":"2023-10-07T08:52:22.901036+0000","last_peered":"2023-10-07T08:52:22.901036+0000","last_clean":"2023-10-07T08:52:22.901036+0000","last_became_active":"2023-10-07T08:52:22.900609+0000","last_became_peered":"2023-10-07T08:52:22.900609+0000","last_unstale":"2023-10-07T08:52:22.901036+0000","last_undegraded":"2023-10-07T08:52:22.901036+0000","last_fullsized":"2023-10-07T08:52:22.901036+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:24:32.593685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334931+0000","last_change":"2023-10-07T08:52:23.334320+0000","last_active":"2023-10-07T08:52:23.334931+0000","last_peered":"2023-10-07T08:52:23.334931+0000","last_clean":"2023-10-07T08:52:23.334931+0000","last_became_active":"2023-10-07T08:52:23.334083+0000","last_became_peered":"2023-10-07T08:52:23.334083+0000","last_unstale":"2023-10-07T08:52:23.334931+0000","last_undegraded":"2023-10-07T08:52:23.334931+0000","last_fullsized":"2023-10-07T08:52:23.334931+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:03:17.430798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"172'6","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.897411+0000","last_change":"2023-10-07T08:52:22.893815+0000","last_active":"2023-10-07T08:52:23.897411+0000","last_peered":"2023-10-07T08:52:23.897411+0000","last_clean":"2023-10-07T08:52:23.897411+0000","last_became_active":"2023-10-07T08:52:22.893596+0000","last_became_peered":"2023-10-07T08:52:22.893596+0000","last_unstale":"2023-10-07T08:52:23.897411+0000","last_undegraded":"2023-10-07T08:52:23.897411+0000","last_fullsized":"2023-10-07T08:52:23.897411+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:30:26.833836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.344005+0000","last_change":"2023-10-07T08:52:23.344005+0000","last_active":"2023-10-07T08:52:23.344005+0000","last_peered":"2023-10-07T08:52:23.344005+0000","last_clean":"2023-10-07T08:52:23.344005+0000","last_became_active":"2023-10-07T08:52:23.343750+0000","last_became_peered":"2023-10-07T08:52:23.343750+0000","last_unstale":"2023-10-07T08:52:23.344005+0000","last_undegraded":"2023-10-07T08:52:23.344005+0000","last_fullsized":"2023-10-07T08:52:23.344005+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:32:34.004925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"172'2","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.893699+0000","last_change":"2023-10-07T08:52:22.897371+0000","last_active":"2023-10-07T08:52:23.893699+0000","last_peered":"2023-10-07T08:52:23.893699+0000","last_clean":"2023-10-07T08:52:23.893699+0000","last_became_active":"2023-10-07T08:52:22.897135+0000","last_became_peered":"2023-10-07T08:52:22.897135+0000","last_unstale":"2023-10-07T08:52:23.893699+0000","last_undegraded":"2023-10-07T08:52:23.893699+0000","last_fullsized":"2023-10-07T08:52:23.893699+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:19:36.014064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.335680+0000","last_change":"2023-10-07T08:52:23.335680+0000","last_active":"2023-10-07T08:52:23.335680+0000","last_peered":"2023-10-07T08:52:23.335680+0000","last_clean":"2023-10-07T08:52:23.335680+0000","last_became_active":"2023-10-07T08:52:23.335471+0000","last_became_peered":"2023-10-07T08:52:23.335471+0000","last_unstale":"2023-10-07T08:52:23.335680+0000","last_undegraded":"2023-10-07T08:52:23.335680+0000","last_fullsized":"2023-10-07T08:52:23.335680+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:32:37.741118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.899113+0000","last_change":"2023-10-07T08:52:22.899048+0000","last_active":"2023-10-07T08:52:22.899113+0000","last_peered":"2023-10-07T08:52:22.899113+0000","last_clean":"2023-10-07T08:52:22.899113+0000","last_became_active":"2023-10-07T08:52:22.898814+0000","last_became_peered":"2023-10-07T08:52:22.898814+0000","last_unstale":"2023-10-07T08:52:22.899113+0000","last_undegraded":"2023-10-07T08:52:22.899113+0000","last_fullsized":"2023-10-07T08:52:22.899113+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:11:47.823540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.342100+0000","last_change":"2023-10-07T08:52:23.342100+0000","last_active":"2023-10-07T08:52:23.342100+0000","last_peered":"2023-10-07T08:52:23.342100+0000","last_clean":"2023-10-07T08:52:23.342100+0000","last_became_active":"2023-10-07T08:52:23.341406+0000","last_became_peered":"2023-10-07T08:52:23.341406+0000","last_unstale":"2023-10-07T08:52:23.342100+0000","last_undegraded":"2023-10-07T08:52:23.342100+0000","last_fullsized":"2023-10-07T08:52:23.342100+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:36:25.764692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.331372+0000","last_change":"2023-10-07T08:52:22.894155+0000","last_active":"2023-10-07T08:52:23.331372+0000","last_peered":"2023-10-07T08:52:23.331372+0000","last_clean":"2023-10-07T08:52:23.331372+0000","last_became_active":"2023-10-07T08:52:22.893933+0000","last_became_peered":"2023-10-07T08:52:22.893933+0000","last_unstale":"2023-10-07T08:52:23.331372+0000","last_undegraded":"2023-10-07T08:52:23.331372+0000","last_fullsized":"2023-10-07T08:52:23.331372+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:38:41.015710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.337627+0000","last_change":"2023-10-07T08:52:23.337627+0000","last_active":"2023-10-07T08:52:23.337627+0000","last_peered":"2023-10-07T08:52:23.337627+0000","last_clean":"2023-10-07T08:52:23.337627+0000","last_became_active":"2023-10-07T08:52:23.337358+0000","last_became_peered":"2023-10-07T08:52:23.337358+0000","last_unstale":"2023-10-07T08:52:23.337627+0000","last_undegraded":"2023-10-07T08:52:23.337627+0000","last_fullsized":"2023-10-07T08:52:23.337627+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:54:20.956904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"172'8","reported_seq":18,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.896314+0000","last_change":"2023-10-07T08:52:22.901173+0000","last_active":"2023-10-07T08:52:23.896314+0000","last_peered":"2023-10-07T08:52:23.896314+0000","last_clean":"2023-10-07T08:52:23.896314+0000","last_became_active":"2023-10-07T08:52:22.900933+0000","last_became_peered":"2023-10-07T08:52:22.900933+0000","last_unstale":"2023-10-07T08:52:23.896314+0000","last_undegraded":"2023-10-07T08:52:23.896314+0000","last_fullsized":"2023-10-07T08:52:23.896314+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:36:26.005011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.334129+0000","last_change":"2023-10-07T08:52:23.334129+0000","last_active":"2023-10-07T08:52:23.334129+0000","last_peered":"2023-10-07T08:52:23.334129+0000","last_clean":"2023-10-07T08:52:23.334129+0000","last_became_active":"2023-10-07T08:52:23.333894+0000","last_became_peered":"2023-10-07T08:52:23.333894+0000","last_unstale":"2023-10-07T08:52:23.334129+0000","last_undegraded":"2023-10-07T08:52:23.334129+0000","last_fullsized":"2023-10-07T08:52:23.334129+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:30:27.843552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"172'1","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.330854+0000","last_change":"2023-10-07T08:52:22.900602+0000","last_active":"2023-10-07T08:52:23.330854+0000","last_peered":"2023-10-07T08:52:23.330854+0000","last_clean":"2023-10-07T08:52:23.330854+0000","last_became_active":"2023-10-07T08:52:22.899086+0000","last_became_peered":"2023-10-07T08:52:22.899086+0000","last_unstale":"2023-10-07T08:52:23.330854+0000","last_undegraded":"2023-10-07T08:52:23.330854+0000","last_fullsized":"2023-10-07T08:52:23.330854+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:13:46.718731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.339641+0000","last_change":"2023-10-07T08:52:23.339578+0000","last_active":"2023-10-07T08:52:23.339641+0000","last_peered":"2023-10-07T08:52:23.339641+0000","last_clean":"2023-10-07T08:52:23.339641+0000","last_became_active":"2023-10-07T08:52:23.339334+0000","last_became_peered":"2023-10-07T08:52:23.339334+0000","last_unstale":"2023-10-07T08:52:23.339641+0000","last_undegraded":"2023-10-07T08:52:23.339641+0000","last_fullsized":"2023-10-07T08:52:23.339641+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:30:39.918745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"172'2","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.893591+0000","last_change":"2023-10-07T08:52:22.902060+0000","last_active":"2023-10-07T08:52:23.893591+0000","last_peered":"2023-10-07T08:52:23.893591+0000","last_clean":"2023-10-07T08:52:23.893591+0000","last_became_active":"2023-10-07T08:52:22.901885+0000","last_became_peered":"2023-10-07T08:52:22.901885+0000","last_unstale":"2023-10-07T08:52:23.893591+0000","last_undegraded":"2023-10-07T08:52:23.893591+0000","last_fullsized":"2023-10-07T08:52:23.893591+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:50:24.949763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.344805+0000","last_change":"2023-10-07T08:52:23.344805+0000","last_active":"2023-10-07T08:52:23.344805+0000","last_peered":"2023-10-07T08:52:23.344805+0000","last_clean":"2023-10-07T08:52:23.344805+0000","last_became_active":"2023-10-07T08:52:23.344113+0000","last_became_peered":"2023-10-07T08:52:23.344113+0000","last_unstale":"2023-10-07T08:52:23.344805+0000","last_undegraded":"2023-10-07T08:52:23.344805+0000","last_fullsized":"2023-10-07T08:52:23.344805+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:18:35.422453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"172'1","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.894919+0000","last_change":"2023-10-07T08:52:22.898165+0000","last_active":"2023-10-07T08:52:23.894919+0000","last_peered":"2023-10-07T08:52:23.894919+0000","last_clean":"2023-10-07T08:52:23.894919+0000","last_became_active":"2023-10-07T08:52:22.897935+0000","last_became_peered":"2023-10-07T08:52:22.897935+0000","last_unstale":"2023-10-07T08:52:23.894919+0000","last_undegraded":"2023-10-07T08:52:23.894919+0000","last_fullsized":"2023-10-07T08:52:23.894919+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:41:50.530066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.336251+0000","last_change":"2023-10-07T08:52:23.335562+0000","last_active":"2023-10-07T08:52:23.336251+0000","last_peered":"2023-10-07T08:52:23.336251+0000","last_clean":"2023-10-07T08:52:23.336251+0000","last_became_active":"2023-10-07T08:52:23.334956+0000","last_became_peered":"2023-10-07T08:52:23.334956+0000","last_unstale":"2023-10-07T08:52:23.336251+0000","last_undegraded":"2023-10-07T08:52:23.336251+0000","last_fullsized":"2023-10-07T08:52:23.336251+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:18:35.422453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.893432+0000","last_change":"2023-10-07T08:52:22.893334+0000","last_active":"2023-10-07T08:52:22.893432+0000","last_peered":"2023-10-07T08:52:22.893432+0000","last_clean":"2023-10-07T08:52:22.893432+0000","last_became_active":"2023-10-07T08:52:22.893100+0000","last_became_peered":"2023-10-07T08:52:22.893100+0000","last_unstale":"2023-10-07T08:52:22.893432+0000","last_undegraded":"2023-10-07T08:52:22.893432+0000","last_fullsized":"2023-10-07T08:52:22.893432+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:48:25.900558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.340552+0000","last_change":"2023-10-07T08:52:23.340552+0000","last_active":"2023-10-07T08:52:23.340552+0000","last_peered":"2023-10-07T08:52:23.340552+0000","last_clean":"2023-10-07T08:52:23.340552+0000","last_became_active":"2023-10-07T08:52:23.339547+0000","last_became_peered":"2023-10-07T08:52:23.339547+0000","last_unstale":"2023-10-07T08:52:23.340552+0000","last_undegraded":"2023-10-07T08:52:23.340552+0000","last_fullsized":"2023-10-07T08:52:23.340552+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:51.633336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"172'2","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.894011+0000","last_change":"2023-10-07T08:52:22.899981+0000","last_active":"2023-10-07T08:52:23.894011+0000","last_peered":"2023-10-07T08:52:23.894011+0000","last_clean":"2023-10-07T08:52:23.894011+0000","last_became_active":"2023-10-07T08:52:22.899727+0000","last_became_peered":"2023-10-07T08:52:22.899727+0000","last_unstale":"2023-10-07T08:52:23.894011+0000","last_undegraded":"2023-10-07T08:52:23.894011+0000","last_fullsized":"2023-10-07T08:52:23.894011+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:07:26.092548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.337881+0000","last_change":"2023-10-07T08:52:23.337839+0000","last_active":"2023-10-07T08:52:23.337881+0000","last_peered":"2023-10-07T08:52:23.337881+0000","last_clean":"2023-10-07T08:52:23.337881+0000","last_became_active":"2023-10-07T08:52:23.337690+0000","last_became_peered":"2023-10-07T08:52:23.337690+0000","last_unstale":"2023-10-07T08:52:23.337881+0000","last_undegraded":"2023-10-07T08:52:23.337881+0000","last_fullsized":"2023-10-07T08:52:23.337881+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:02:07.114979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.898849+0000","last_change":"2023-10-07T08:52:22.898783+0000","last_active":"2023-10-07T08:52:22.898849+0000","last_peered":"2023-10-07T08:52:22.898849+0000","last_clean":"2023-10-07T08:52:22.898849+0000","last_became_active":"2023-10-07T08:52:22.898548+0000","last_became_peered":"2023-10-07T08:52:22.898548+0000","last_unstale":"2023-10-07T08:52:22.898849+0000","last_undegraded":"2023-10-07T08:52:22.898849+0000","last_fullsized":"2023-10-07T08:52:22.898849+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:06:54.305528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.338657+0000","last_change":"2023-10-07T08:52:23.338657+0000","last_active":"2023-10-07T08:52:23.338657+0000","last_peered":"2023-10-07T08:52:23.338657+0000","last_clean":"2023-10-07T08:52:23.338657+0000","last_became_active":"2023-10-07T08:52:23.338402+0000","last_became_peered":"2023-10-07T08:52:23.338402+0000","last_unstale":"2023-10-07T08:52:23.338657+0000","last_undegraded":"2023-10-07T08:52:23.338657+0000","last_fullsized":"2023-10-07T08:52:23.338657+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:17:13.259446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.900275+0000","last_change":"2023-10-07T08:52:22.900209+0000","last_active":"2023-10-07T08:52:22.900275+0000","last_peered":"2023-10-07T08:52:22.900275+0000","last_clean":"2023-10-07T08:52:22.900275+0000","last_became_active":"2023-10-07T08:52:22.899770+0000","last_became_peered":"2023-10-07T08:52:22.899770+0000","last_unstale":"2023-10-07T08:52:22.900275+0000","last_undegraded":"2023-10-07T08:52:22.900275+0000","last_fullsized":"2023-10-07T08:52:22.900275+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:18:47.125725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.339734+0000","last_change":"2023-10-07T08:52:23.339679+0000","last_active":"2023-10-07T08:52:23.339734+0000","last_peered":"2023-10-07T08:52:23.339734+0000","last_clean":"2023-10-07T08:52:23.339734+0000","last_became_active":"2023-10-07T08:52:23.339448+0000","last_became_peered":"2023-10-07T08:52:23.339448+0000","last_unstale":"2023-10-07T08:52:23.339734+0000","last_undegraded":"2023-10-07T08:52:23.339734+0000","last_fullsized":"2023-10-07T08:52:23.339734+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:54:52.211577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.898344+0000","last_change":"2023-10-07T08:52:22.897912+0000","last_active":"2023-10-07T08:52:22.898344+0000","last_peered":"2023-10-07T08:52:22.898344+0000","last_clean":"2023-10-07T08:52:22.898344+0000","last_became_active":"2023-10-07T08:52:22.897640+0000","last_became_peered":"2023-10-07T08:52:22.897640+0000","last_unstale":"2023-10-07T08:52:22.898344+0000","last_undegraded":"2023-10-07T08:52:22.898344+0000","last_fullsized":"2023-10-07T08:52:22.898344+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:27:43.687608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.341957+0000","last_change":"2023-10-07T08:52:23.341957+0000","last_active":"2023-10-07T08:52:23.341957+0000","last_peered":"2023-10-07T08:52:23.341957+0000","last_clean":"2023-10-07T08:52:23.341957+0000","last_became_active":"2023-10-07T08:52:23.341073+0000","last_became_peered":"2023-10-07T08:52:23.341073+0000","last_unstale":"2023-10-07T08:52:23.341957+0000","last_undegraded":"2023-10-07T08:52:23.341957+0000","last_fullsized":"2023-10-07T08:52:23.341957+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:21:39.924809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"172'2","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.896975+0000","last_change":"2023-10-07T08:52:22.903121+0000","last_active":"2023-10-07T08:52:23.896975+0000","last_peered":"2023-10-07T08:52:23.896975+0000","last_clean":"2023-10-07T08:52:23.896975+0000","last_became_active":"2023-10-07T08:52:22.902611+0000","last_became_peered":"2023-10-07T08:52:22.902611+0000","last_unstale":"2023-10-07T08:52:23.896975+0000","last_undegraded":"2023-10-07T08:52:23.896975+0000","last_fullsized":"2023-10-07T08:52:23.896975+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:34.088183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.344952+0000","last_change":"2023-10-07T08:52:23.344952+0000","last_active":"2023-10-07T08:52:23.344952+0000","last_peered":"2023-10-07T08:52:23.344952+0000","last_clean":"2023-10-07T08:52:23.344952+0000","last_became_active":"2023-10-07T08:52:23.344417+0000","last_became_peered":"2023-10-07T08:52:23.344417+0000","last_unstale":"2023-10-07T08:52:23.344952+0000","last_undegraded":"2023-10-07T08:52:23.344952+0000","last_fullsized":"2023-10-07T08:52:23.344952+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:06:18.707462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.331373+0000","last_change":"2023-10-07T08:52:22.898025+0000","last_active":"2023-10-07T08:52:23.331373+0000","last_peered":"2023-10-07T08:52:23.331373+0000","last_clean":"2023-10-07T08:52:23.331373+0000","last_became_active":"2023-10-07T08:52:22.897798+0000","last_became_peered":"2023-10-07T08:52:22.897798+0000","last_unstale":"2023-10-07T08:52:23.331373+0000","last_undegraded":"2023-10-07T08:52:23.331373+0000","last_fullsized":"2023-10-07T08:52:23.331373+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:34:16.862512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.329179+0000","last_change":"2023-10-07T08:52:23.329179+0000","last_active":"2023-10-07T08:52:23.329179+0000","last_peered":"2023-10-07T08:52:23.329179+0000","last_clean":"2023-10-07T08:52:23.329179+0000","last_became_active":"2023-10-07T08:52:23.328866+0000","last_became_peered":"2023-10-07T08:52:23.328866+0000","last_unstale":"2023-10-07T08:52:23.329179+0000","last_undegraded":"2023-10-07T08:52:23.329179+0000","last_fullsized":"2023-10-07T08:52:23.329179+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:52:26.614967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.331873+0000","last_change":"2023-10-07T08:52:22.893343+0000","last_active":"2023-10-07T08:52:23.331873+0000","last_peered":"2023-10-07T08:52:23.331873+0000","last_clean":"2023-10-07T08:52:23.331873+0000","last_became_active":"2023-10-07T08:52:22.892712+0000","last_became_peered":"2023-10-07T08:52:22.892712+0000","last_unstale":"2023-10-07T08:52:23.331873+0000","last_undegraded":"2023-10-07T08:52:23.331873+0000","last_fullsized":"2023-10-07T08:52:23.331873+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:28:28.562205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.339267+0000","last_change":"2023-10-07T08:52:23.339203+0000","last_active":"2023-10-07T08:52:23.339267+0000","last_peered":"2023-10-07T08:52:23.339267+0000","last_clean":"2023-10-07T08:52:23.339267+0000","last_became_active":"2023-10-07T08:52:23.339062+0000","last_became_peered":"2023-10-07T08:52:23.339062+0000","last_unstale":"2023-10-07T08:52:23.339267+0000","last_undegraded":"2023-10-07T08:52:23.339267+0000","last_fullsized":"2023-10-07T08:52:23.339267+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:32:34.004925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.331510+0000","last_change":"2023-10-07T08:52:22.894912+0000","last_active":"2023-10-07T08:52:23.331510+0000","last_peered":"2023-10-07T08:52:23.331510+0000","last_clean":"2023-10-07T08:52:23.331510+0000","last_became_active":"2023-10-07T08:52:22.894692+0000","last_became_peered":"2023-10-07T08:52:22.894692+0000","last_unstale":"2023-10-07T08:52:23.331510+0000","last_undegraded":"2023-10-07T08:52:23.331510+0000","last_fullsized":"2023-10-07T08:52:23.331510+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:59:20.619444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.328431+0000","last_change":"2023-10-07T08:52:23.328364+0000","last_active":"2023-10-07T08:52:23.328431+0000","last_peered":"2023-10-07T08:52:23.328431+0000","last_clean":"2023-10-07T08:52:23.328431+0000","last_became_active":"2023-10-07T08:52:23.328124+0000","last_became_peered":"2023-10-07T08:52:23.328124+0000","last_unstale":"2023-10-07T08:52:23.328431+0000","last_undegraded":"2023-10-07T08:52:23.328431+0000","last_fullsized":"2023-10-07T08:52:23.328431+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:07:22.542253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.333453+0000","last_change":"2023-10-07T08:52:22.894770+0000","last_active":"2023-10-07T08:52:23.333453+0000","last_peered":"2023-10-07T08:52:23.333453+0000","last_clean":"2023-10-07T08:52:23.333453+0000","last_became_active":"2023-10-07T08:52:22.894543+0000","last_became_peered":"2023-10-07T08:52:22.894543+0000","last_unstale":"2023-10-07T08:52:23.333453+0000","last_undegraded":"2023-10-07T08:52:23.333453+0000","last_fullsized":"2023-10-07T08:52:23.333453+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:08:16.676201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.339419+0000","last_change":"2023-10-07T08:52:23.339419+0000","last_active":"2023-10-07T08:52:23.339419+0000","last_peered":"2023-10-07T08:52:23.339419+0000","last_clean":"2023-10-07T08:52:23.339419+0000","last_became_active":"2023-10-07T08:52:23.338756+0000","last_became_peered":"2023-10-07T08:52:23.338756+0000","last_unstale":"2023-10-07T08:52:23.339419+0000","last_undegraded":"2023-10-07T08:52:23.339419+0000","last_fullsized":"2023-10-07T08:52:23.339419+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:32:08.187516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.903338+0000","last_change":"2023-10-07T08:52:22.903284+0000","last_active":"2023-10-07T08:52:22.903338+0000","last_peered":"2023-10-07T08:52:22.903338+0000","last_clean":"2023-10-07T08:52:22.903338+0000","last_became_active":"2023-10-07T08:52:22.902846+0000","last_became_peered":"2023-10-07T08:52:22.902846+0000","last_unstale":"2023-10-07T08:52:22.903338+0000","last_undegraded":"2023-10-07T08:52:22.903338+0000","last_fullsized":"2023-10-07T08:52:22.903338+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:32:19.943177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.342582+0000","last_change":"2023-10-07T08:52:23.342582+0000","last_active":"2023-10-07T08:52:23.342582+0000","last_peered":"2023-10-07T08:52:23.342582+0000","last_clean":"2023-10-07T08:52:23.342582+0000","last_became_active":"2023-10-07T08:52:23.342029+0000","last_became_peered":"2023-10-07T08:52:23.342029+0000","last_unstale":"2023-10-07T08:52:23.342582+0000","last_undegraded":"2023-10-07T08:52:23.342582+0000","last_fullsized":"2023-10-07T08:52:23.342582+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:01:09.157206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.898359+0000","last_change":"2023-10-07T08:52:22.897956+0000","last_active":"2023-10-07T08:52:22.898359+0000","last_peered":"2023-10-07T08:52:22.898359+0000","last_clean":"2023-10-07T08:52:22.898359+0000","last_became_active":"2023-10-07T08:52:22.897652+0000","last_became_peered":"2023-10-07T08:52:22.897652+0000","last_unstale":"2023-10-07T08:52:22.898359+0000","last_undegraded":"2023-10-07T08:52:22.898359+0000","last_fullsized":"2023-10-07T08:52:22.898359+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:05.062086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":8,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.341646+0000","last_change":"2023-10-07T08:52:23.341646+0000","last_active":"2023-10-07T08:52:23.341646+0000","last_peered":"2023-10-07T08:52:23.341646+0000","last_clean":"2023-10-07T08:52:23.341646+0000","last_became_active":"2023-10-07T08:52:23.340253+0000","last_became_peered":"2023-10-07T08:52:23.340253+0000","last_unstale":"2023-10-07T08:52:23.341646+0000","last_undegraded":"2023-10-07T08:52:23.341646+0000","last_fullsized":"2023-10-07T08:52:23.341646+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:58:15.279414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.899052+0000","last_change":"2023-10-07T08:52:22.898878+0000","last_active":"2023-10-07T08:52:22.899052+0000","last_peered":"2023-10-07T08:52:22.899052+0000","last_clean":"2023-10-07T08:52:22.899052+0000","last_became_active":"2023-10-07T08:52:22.898317+0000","last_became_peered":"2023-10-07T08:52:22.898317+0000","last_unstale":"2023-10-07T08:52:22.899052+0000","last_undegraded":"2023-10-07T08:52:22.899052+0000","last_fullsized":"2023-10-07T08:52:22.899052+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:24:32.593685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.333827+0000","last_change":"2023-10-07T08:52:23.333771+0000","last_active":"2023-10-07T08:52:23.333827+0000","last_peered":"2023-10-07T08:52:23.333827+0000","last_clean":"2023-10-07T08:52:23.333827+0000","last_became_active":"2023-10-07T08:52:23.333524+0000","last_became_peered":"2023-10-07T08:52:23.333524+0000","last_unstale":"2023-10-07T08:52:23.333827+0000","last_undegraded":"2023-10-07T08:52:23.333827+0000","last_fullsized":"2023-10-07T08:52:23.333827+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:22.878794+0000","last_clean_scrub_stamp":"2023-10-07T08:52:22.878794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:06:45.547741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"172'3","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-07T08:52:23.894823+0000","last_change":"2023-10-07T08:52:22.902752+0000","last_active":"2023-10-07T08:52:23.894823+0000","last_peered":"2023-10-07T08:52:23.894823+0000","last_clean":"2023-10-07T08:52:23.894823+0000","last_became_active":"2023-10-07T08:52:22.902521+0000","last_became_peered":"2023-10-07T08:52:22.902521+0000","last_unstale":"2023-10-07T08:52:23.894823+0000","last_undegraded":"2023-10-07T08:52:23.894823+0000","last_fullsized":"2023-10-07T08:52:23.894823+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:52:21.869078+0000","last_clean_scrub_stamp":"2023-10-07T08:52:21.869078+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:21:38.915092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":290,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-07T08:52:22.895875+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:52:22.895875+0000","last_peered":"2023-10-07T08:52:22.895875+0000","last_clean":"2023-10-07T08:52:22.895875+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:52:22.895875+0000","last_undegraded":"2023-10-07T08:52:22.895875+0000","last_fullsized":"2023-10-07T08:52:22.895875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574966,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1512,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193800,"statfs":{"total":200000000,"available":198451306,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,6],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50700000000000001,"15min":0.502},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73899999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.50900000000000001,"15min":0.495},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.27700000000000002},"max":{"1min":0.70099999999999996,"5min":0.70899999999999996,"15min":1.2150000000000001},"last":0.63900000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73599999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55400000000000005,"15min":0.54700000000000004},"min":{"1min":0.44400000000000001,"5min":0.38900000000000001,"15min":0.33900000000000002},"max":{"1min":0.71099999999999997,"5min":0.81999999999999995,"15min":1.1659999999999999},"last":0.68799999999999994}]},{"osd":2,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.66600000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51200000000000001,"15min":0.499},"min":{"1min":0.38700000000000001,"5min":0.34499999999999997,"15min":0.33500000000000002},"max":{"1min":0.72099999999999997,"5min":0.74399999999999999,"15min":0.75},"last":0.496}]},{"osd":3,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54400000000000004,"15min":0.71199999999999997},"min":{"1min":0.42099999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70399999999999996,"5min":0.73299999999999998,"15min":6.8570000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.41599999999999998,"5min":0.39500000000000002,"15min":0.37},"max":{"1min":0.76500000000000001,"5min":0.76700000000000002,"15min":0.98999999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46200000000000002,"15min":0.47499999999999998},"min":{"1min":0.39200000000000002,"5min":0.28799999999999998,"15min":0.26600000000000001},"max":{"1min":0.59799999999999998,"5min":0.81299999999999994,"15min":0.98599999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.505,"15min":0.52400000000000002},"min":{"1min":0.42699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.70499999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56000000000000005}]},{"osd":5,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.48599999999999999,"15min":0.5},"min":{"1min":0.38600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66800000000000004,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.56100000000000005},"min":{"1min":0.436,"5min":0.318,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":0.78300000000000003,"15min":1.0669999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55500000000000005,"15min":0.57999999999999996},"min":{"1min":0.35599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67800000000000005,"5min":0.80600000000000005,"15min":1.1020000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.46600000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.72799999999999998,"5min":0.875,"15min":0.875},"last":0.93000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574966,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042152,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51200000000000001,"15min":0.48399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.25700000000000001},"max":{"1min":0.68600000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.503},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.497},"min":{"1min":0.37,"5min":0.316,"15min":0.30199999999999999},"max":{"1min":0.70699999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.51300000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57799999999999996,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.35399999999999998,"15min":0.32500000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57599999999999996,"15min":0.54300000000000004},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.29799999999999999},"max":{"1min":0.71899999999999997,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.50700000000000001},"min":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.29399999999999998},"max":{"1min":0.79100000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55800000000000005,"15min":0.52800000000000002},"min":{"1min":0.434,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":0.76500000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.372}]},{"osd":3,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54100000000000004,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.751,"5min":0.752,"15min":0.752},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.42699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83199999999999996,"5min":0.83399999999999996,"15min":2.3879999999999999},"last":0.439}]},{"osd":4,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45900000000000002,"15min":0.47099999999999997},"min":{"1min":0.34499999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66000000000000003,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.502,"15min":0.495},"min":{"1min":0.373,"5min":0.30499999999999999,"15min":0.27400000000000002},"max":{"1min":0.624,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.38700000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.495,"15min":0.502},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.30099999999999999},"max":{"1min":0.69199999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.33400000000000002},"max":{"1min":0.69499999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54800000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.39500000000000002,"5min":0.34699999999999998,"15min":0.312},"max":{"1min":0.78400000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.41599999999999998,"5min":0.36299999999999999,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":0.89100000000000001,"15min":1.052},"last":0.57499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":941,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194370,"statfs":{"total":200000000,"available":199035456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.32500000000000001},"min":{"1min":0.27200000000000002,"5min":0.193,"15min":0.17499999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":1.9359999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.376,"15min":0.34499999999999997},"min":{"1min":0.317,"5min":0.221,"15min":0.192},"max":{"1min":0.504,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.38400000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.33500000000000002},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.19600000000000001},"max":{"1min":0.57799999999999996,"5min":0.70399999999999996,"15min":1.639},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.39200000000000002,"15min":0.35699999999999998},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.22500000000000001},"max":{"1min":0.61599999999999999,"5min":0.69599999999999995,"15min":1.9039999999999999},"last":0.35599999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.40600000000000003,"15min":0.379},"min":{"1min":0.35399999999999998,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":0.55300000000000005,"5min":0.64500000000000002,"15min":1.6819999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.40999999999999998,"15min":0.36799999999999999},"min":{"1min":0.39500000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.63800000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.34000000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.51500000000000001,"5min":0.35799999999999998,"15min":0.33600000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.91600000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.58299999999999996,"15min":0.54700000000000004},"min":{"1min":0.52000000000000002,"5min":0.35699999999999998,"15min":0.28599999999999998},"max":{"1min":0.73099999999999998,"5min":0.86399999999999999,"15min":1.9570000000000001},"last":0.432}]},{"osd":5,"last update":"Sat Oct 7 08:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63,"15min":0.59099999999999997},"min":{"1min":0.55000000000000004,"5min":0.38300000000000001,"15min":0.371},"max":{"1min":0.79700000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63,"15min":0.58899999999999997},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.36599999999999999},"max":{"1min":0.85599999999999998,"5min":0.89600000000000002,"15min":0.97299999999999998},"last":0.51800000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.59799999999999998,"15min":0.56200000000000006},"min":{"1min":0.51100000000000001,"5min":0.379,"15min":0.34200000000000003},"max":{"1min":0.76100000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.60899999999999999,"15min":0.55500000000000005},"min":{"1min":0.51800000000000002,"5min":0.40300000000000002,"15min":0.38200000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.87},"last":0.46000000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:51:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63500000000000001,"15min":0.60499999999999998},"min":{"1min":0.55400000000000005,"5min":0.439,"15min":0.35699999999999998},"max":{"1min":0.76900000000000002,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.625},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65500000000000003,"15min":0.60599999999999998},"min":{"1min":0.52900000000000003,"5min":0.46100000000000002,"15min":0.40799999999999997},"max":{"1min":0.877,"5min":0.92700000000000005,"15min":0.94299999999999995},"last":0.501}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1519,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193793,"statfs":{"total":200000000,"available":198444072,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.35599999999999998,"15min":0.36299999999999999},"min":{"1min":0.23000000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.61799999999999999,"5min":0.71099999999999997,"15min":1.4339999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38300000000000001,"15min":0.38800000000000001},"min":{"1min":0.25700000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54000000000000004,"5min":0.67400000000000004,"15min":1.079},"last":0.40699999999999997}]},{"osd":2,"last update":"Sat Oct 7 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.378,"15min":0.38500000000000001},"min":{"1min":0.27700000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.55300000000000005,"5min":0.63200000000000001,"15min":1.464},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.39800000000000002},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.21299999999999999},"max":{"1min":0.627,"5min":0.67900000000000005,"15min":1.1060000000000001},"last":0.33700000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.378,"15min":0.38200000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":0.59899999999999998,"15min":1.341},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.42699999999999999,"15min":0.43099999999999999},"min":{"1min":0.32900000000000001,"5min":0.28000000000000003,"15min":0.25700000000000001},"max":{"1min":0.65700000000000003,"5min":0.68600000000000005,"15min":1.532},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59499999999999997,"15min":0.58299999999999996},"min":{"1min":0.50900000000000001,"5min":0.34799999999999998,"15min":0.32600000000000001},"max":{"1min":0.876,"5min":0.90200000000000002,"15min":1.3169999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.50800000000000001,"5min":0.36199999999999999,"15min":0.34699999999999998},"max":{"1min":0.76300000000000001,"5min":0.84999999999999998,"15min":1.51},"last":0.504}]},{"osd":5,"last update":"Sat Oct 7 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.62,"15min":0.60399999999999998},"min":{"1min":0.497,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89000000000000001,"5min":0.92300000000000004,"15min":1.0529999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59499999999999997,"15min":0.57999999999999996},"min":{"1min":0.501,"5min":0.40799999999999997,"15min":0.35299999999999998},"max":{"1min":0.77400000000000002,"5min":0.91000000000000003,"15min":1.25},"last":0.52900000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.48599999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.91000000000000003,"5min":0.92900000000000005,"15min":1.488},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.627,"15min":0.60599999999999998},"min":{"1min":0.50900000000000001,"5min":0.41999999999999998,"15min":0.39000000000000001},"max":{"1min":0.85299999999999998,"5min":0.94199999999999995,"15min":1.024},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.47699999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.98499999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.61199999999999999},"min":{"1min":0.50700000000000001,"5min":0.375,"15min":0.374},"max":{"1min":0.83999999999999997,"5min":0.90300000000000002,"15min":1.288},"last":0.55300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":942,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194369,"statfs":{"total":200000000,"available":199034404,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.32900000000000001,"15min":0.33700000000000002},"min":{"1min":0.23999999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":1.665},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36299999999999999},"min":{"1min":0.24399999999999999,"5min":0.23499999999999999,"15min":0.22600000000000001},"max":{"1min":0.54300000000000004,"5min":0.63400000000000001,"15min":1.579},"last":0.27000000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38700000000000001,"15min":0.376},"min":{"1min":0.26500000000000001,"5min":0.218,"15min":0.20499999999999999},"max":{"1min":0.46800000000000003,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.437,"15min":0.42499999999999999},"min":{"1min":0.28599999999999998,"5min":0.20999999999999999,"15min":0.20200000000000001},"max":{"1min":0.55200000000000005,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":0.30199999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.40999999999999998,"15min":0.39600000000000002},"min":{"1min":0.32600000000000001,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":1.454},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.39800000000000002,"15min":0.39000000000000001},"min":{"1min":0.33900000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":1.6919999999999999},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.28199999999999997},"max":{"1min":0.83099999999999996,"5min":0.90500000000000003,"15min":1.7210000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.59999999999999998},"min":{"1min":0.42499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.5549999999999999},"last":0.57399999999999995}]},{"osd":5,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.5269999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.38600000000000001,"15min":0.311},"max":{"1min":0.83799999999999997,"5min":0.88900000000000001,"15min":1.4039999999999999},"last":0.53800000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.41499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.879,"5min":0.93999999999999995,"15min":1.3380000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60199999999999998,"15min":0.59099999999999997},"min":{"1min":0.49299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79400000000000004,"5min":0.86099999999999999,"15min":1.637},"last":0.56200000000000006}]},{"osd":7,"last update":"Sat Oct 7 08:52:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.59699999999999998},"min":{"1min":0.51300000000000001,"5min":0.40600000000000003,"15min":0.379},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.49},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64100000000000001,"15min":0.61599999999999999},"min":{"1min":0.47999999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86499999999999999,"5min":0.96999999999999997,"15min":1.375},"last":0.45600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574966,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:52:01 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32200000000000001,"15min":0.32800000000000001},"min":{"1min":0.25,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.46100000000000002,"5min":0.90200000000000002,"15min":1.8220000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.34899999999999998,"15min":0.33200000000000002},"min":{"1min":0.23999999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.47799999999999998,"5min":0.57699999999999996,"15min":0.93500000000000005},"last":0.30599999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:52:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.36299999999999999},"min":{"1min":0.29799999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.49299999999999999,"5min":0.61599999999999999,"15min":1.6519999999999999},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.22500000000000001},"max":{"1min":0.57899999999999996,"5min":0.70099999999999996,"15min":1.885},"last":0.35199999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:52:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.38500000000000001,"15min":0.38300000000000001},"min":{"1min":0.32200000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.56200000000000006,"5min":0.57699999999999996,"15min":1.274},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40500000000000003,"15min":0.40300000000000002},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.25800000000000001},"max":{"1min":0.53800000000000003,"5min":0.97699999999999998,"15min":1.8999999999999999},"last":0.27400000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:52:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.52800000000000002},"min":{"1min":0.42099999999999999,"5min":0.36499999999999999,"15min":0.29999999999999999},"max":{"1min":0.80600000000000005,"5min":0.81699999999999995,"15min":0.82799999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.55300000000000005},"min":{"1min":0.41599999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.752,"5min":0.90000000000000002,"15min":1.3109999999999999},"last":0.46800000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:52:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.35999999999999999},"max":{"1min":0.70899999999999996,"5min":0.85799999999999998,"15min":1.1639999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59999999999999998,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.78900000000000003,"5min":1.038,"15min":1.851},"last":0.51200000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:52:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.57999999999999996},"min":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.91000000000000003,"15min":0.92700000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.622,"15min":0.60099999999999998},"min":{"1min":0.45400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.81299999999999994,"5min":0.94399999999999995,"15min":1.1930000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:52:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.39700000000000002},"max":{"1min":0.77600000000000002,"5min":1.0089999999999999,"15min":1.8700000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60199999999999998,"15min":0.57199999999999995},"min":{"1min":0.42799999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84199999999999997,"5min":0.85099999999999998,"15min":0.88400000000000001},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042298,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.505,"15min":0.496},"min":{"1min":0.38500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.78200000000000003,"5min":0.89300000000000002,"15min":1.9419999999999999},"last":0.497},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53000000000000003,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":0.67800000000000005,"5min":0.73599999999999999,"15min":1.6879999999999999},"last":0.34899999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":0.65900000000000003,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52100000000000002,"15min":0.50700000000000001},"min":{"1min":0.39300000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.69799999999999995,"5min":0.81100000000000005,"15min":1.3580000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.311,"15min":0.27800000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":2.1520000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.40500000000000003,"5min":0.372,"15min":0.30599999999999999},"max":{"1min":0.67200000000000004,"5min":0.72699999999999998,"15min":1.29},"last":0.46700000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.38900000000000001,"5min":0.32500000000000001,"15min":0.29999999999999999},"max":{"1min":0.71899999999999997,"5min":0.91400000000000003,"15min":2.052},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70999999999999996,"5min":0.78700000000000003,"15min":1.369},"last":0.51500000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27000000000000002},"max":{"1min":0.66700000000000004,"5min":0.75800000000000001,"15min":0.89000000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.63300000000000001,"5min":0.88,"15min":0.88},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60699999999999998,"5min":0.85899999999999999,"15min":1.0049999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.309,"15min":0.309},"max":{"1min":0.73899999999999999,"5min":0.75900000000000001,"15min":0.95599999999999996},"last":0.58699999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:52:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.54600000000000004},"min":{"1min":0.34899999999999998,"5min":0.31,"15min":0.30099999999999999},"max":{"1min":0.67300000000000004,"5min":0.85099999999999998,"15min":0.98899999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33300000000000002},"max":{"1min":0.754,"5min":0.90200000000000002,"15min":0.91300000000000003},"last":0.57199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":935,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194377,"statfs":{"total":200000000,"available":199042276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53300000000000003,"15min":0.52100000000000002},"min":{"1min":0.376,"5min":0.311,"15min":0.26200000000000001},"max":{"1min":0.71199999999999997,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.51900000000000002},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58299999999999996}]},{"osd":1,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55800000000000005,"15min":0.51100000000000001},"min":{"1min":0.378,"5min":0.33300000000000002,"15min":0.25},"max":{"1min":0.75700000000000001,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.85199999999999998,"15min":0.63800000000000001},"min":{"1min":0.438,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76200000000000001,"5min":29.143999999999998,"15min":29.143999999999998},"last":0.56999999999999995}]},{"osd":2,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.40500000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.73999999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.41399999999999998,"5min":0.34699999999999998,"15min":0.309},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.59399999999999997}]},{"osd":3,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.40400000000000003,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.78600000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.45800000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73899999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54000000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47699999999999998,"15min":0.47599999999999998},"min":{"1min":0.29099999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.75,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55700000000000005,"15min":0.58299999999999996},"min":{"1min":0.41099999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77200000000000002,"5min":0.80800000000000005,"15min":0.80900000000000005},"last":0.41799999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.504,"15min":0.52800000000000002},"min":{"1min":0.32400000000000001,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":0.72999999999999998,"5min":0.79100000000000004,"15min":0.81399999999999995},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.36299999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72899999999999998,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.433}]},{"osd":7,"last update":"Sat Oct 7 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.56100000000000005},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.93100000000000005},"last":0.373},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78500000000000003,"5min":0.84299999999999997,"15min":0.91100000000000003},"last":0.48999999999999999}]}]}],"pool_statfs":[]}} 2023-10-07T08:52:28.309 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T08:52:28.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T08:52:28.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.461+0000 7ff99ceb4700 1 Processor -- start 2023-10-07T08:52:28.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.461+0000 7ff99ceb4700 1 -- start start 2023-10-07T08:52:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.462+0000 7ff99ceb4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff9981577c0 0x7ff998068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.462+0000 7ff99ceb4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff9980cbea0 0x7ff998068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.462+0000 7ff99ceb4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9980cca80 con 0x7ff998157b90 2023-10-07T08:52:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.462+0000 7ff99ceb4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9980cc2e0 con 0x7ff9981577c0 2023-10-07T08:52:28.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.462+0000 7ff99ceb4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9980cedd0 con 0x7ff9980cbea0 2023-10-07T08:52:28.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.462+0000 7ff99659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff9981577c0 0x7ff998068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.462+0000 7ff99659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff9981577c0 0x7ff998068810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35772/0 (socket says 172.21.15.81:35772) 2023-10-07T08:52:28.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.462+0000 7ff99659c700 1 -- 172.21.15.81:0/1702840047 learned_addr learned my addr 172.21.15.81:0/1702840047 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:28.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.462+0000 7ff996d9d700 1 --2- 172.21.15.81:0/1702840047 >> v2:172.21.15.89:3300/0 conn(0x7ff9980cbea0 0x7ff998068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.463+0000 7ff99659c700 1 -- 172.21.15.81:0/1702840047 >> v2:172.21.15.89:3300/0 conn(0x7ff9980cbea0 msgr2=0x7ff998068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:28.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.463+0000 7ff99659c700 1 --2- 172.21.15.81:0/1702840047 >> v2:172.21.15.89:3300/0 conn(0x7ff9980cbea0 0x7ff998068d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.463+0000 7ff99659c700 1 -- 172.21.15.81:0/1702840047 >> v1:172.21.15.89:6789/0 conn(0x7ff998157b90 legacy=0x7ff9980cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.463+0000 7ff99659c700 1 -- 172.21.15.81:0/1702840047 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9980cc4c0 con 0x7ff9981577c0 2023-10-07T08:52:28.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.463+0000 7ff99659c700 1 --2- 172.21.15.81:0/1702840047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9981577c0 0x7ff998068810 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7ff99806fc40 tx=0x7ff988009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6768f0439749b054 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:28.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.463+0000 7ff995d9b700 1 -- 172.21.15.81:0/1702840047 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988009e70 con 0x7ff9981577c0 2023-10-07T08:52:28.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.463+0000 7ff995d9b700 1 -- 172.21.15.81:0/1702840047 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98800b860 con 0x7ff9981577c0 2023-10-07T08:52:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.463+0000 7ff995d9b700 1 -- 172.21.15.81:0/1702840047 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98800bc00 con 0x7ff9981577c0 2023-10-07T08:52:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.463+0000 7ff99ceb4700 1 -- 172.21.15.81:0/1702840047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9981577c0 msgr2=0x7ff998068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.463+0000 7ff99ceb4700 1 --2- 172.21.15.81:0/1702840047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9981577c0 0x7ff998068810 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7ff99806fc40 tx=0x7ff988009250 comp rx=0 tx=0).stop 2023-10-07T08:52:28.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.463+0000 7ff99ceb4700 1 -- 172.21.15.81:0/1702840047 shutdown_connections 2023-10-07T08:52:28.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.463+0000 7ff99ceb4700 1 --2- 172.21.15.81:0/1702840047 >> v2:172.21.15.89:3300/0 conn(0x7ff9980cbea0 0x7ff998068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.463+0000 7ff99ceb4700 1 --2- 172.21.15.81:0/1702840047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9981577c0 0x7ff998068810 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.463+0000 7ff99ceb4700 1 -- 172.21.15.81:0/1702840047 >> 172.21.15.81:0/1702840047 conn(0x7ff9980d0df0 msgr2=0x7ff9980d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:28.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.463+0000 7ff99ceb4700 1 -- 172.21.15.81:0/1702840047 shutdown_connections 2023-10-07T08:52:28.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.464+0000 7ff99ceb4700 1 -- 172.21.15.81:0/1702840047 wait complete. 2023-10-07T08:52:28.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.465+0000 7ff99ceb4700 1 Processor -- start 2023-10-07T08:52:28.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.465+0000 7ff99ceb4700 1 -- start start 2023-10-07T08:52:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.465+0000 7ff99ceb4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9980cbea0 0x7ff99815eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.465+0000 7ff99ceb4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9981577c0 0x7ff9980b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.465+0000 7ff99ceb4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff998157b90 0x7ff998155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.465+0000 7ff99ceb4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99815f140 con 0x7ff9980cbea0 2023-10-07T08:52:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.465+0000 7ff99ceb4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99815f420 con 0x7ff998157b90 2023-10-07T08:52:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.465+0000 7ff99ceb4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99815f700 con 0x7ff9981577c0 2023-10-07T08:52:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff99659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9980cbea0 0x7ff99815eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff99659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9980cbea0 0x7ff99815eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35774/0 (socket says 172.21.15.81:35774) 2023-10-07T08:52:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff99659c700 1 -- 172.21.15.81:0/1678400247 learned_addr learned my addr 172.21.15.81:0/1678400247 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff996d9d700 1 --2- 172.21.15.81:0/1678400247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff998157b90 0x7ff998155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff98dd9b700 1 --2- 172.21.15.81:0/1678400247 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9981577c0 0x7ff9980b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff99659c700 1 -- 172.21.15.81:0/1678400247 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9981577c0 msgr2=0x7ff9980b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff99659c700 1 --2- 172.21.15.81:0/1678400247 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9981577c0 0x7ff9980b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff99659c700 1 -- 172.21.15.81:0/1678400247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff998157b90 msgr2=0x7ff998155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff99659c700 1 --2- 172.21.15.81:0/1678400247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff998157b90 0x7ff998155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff99659c700 1 -- 172.21.15.81:0/1678400247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9880094f0 con 0x7ff9980cbea0 2023-10-07T08:52:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff996d9d700 1 --2- 172.21.15.81:0/1678400247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff998157b90 0x7ff998155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff98dd9b700 1 --2- 172.21.15.81:0/1678400247 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9981577c0 0x7ff9980b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff99659c700 1 --2- 172.21.15.81:0/1678400247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9980cbea0 0x7ff99815eb60 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7ff99806fd60 tx=0x7ff988017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff98effd700 1 -- 172.21.15.81:0/1678400247 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988011420 con 0x7ff9980cbea0 2023-10-07T08:52:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff98effd700 1 -- 172.21.15.81:0/1678400247 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9880115a0 con 0x7ff9980cbea0 2023-10-07T08:52:28.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff98effd700 1 -- 172.21.15.81:0/1678400247 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988011960 con 0x7ff9980cbea0 2023-10-07T08:52:28.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff99ceb4700 1 -- 172.21.15.81:0/1678400247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99815f9e0 con 0x7ff9980cbea0 2023-10-07T08:52:28.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.466+0000 7ff99ceb4700 1 -- 172.21.15.81:0/1678400247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9980b6ac0 con 0x7ff9980cbea0 2023-10-07T08:52:28.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.467+0000 7ff99ceb4700 1 -- 172.21.15.81:0/1678400247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff998067a50 con 0x7ff9980cbea0 2023-10-07T08:52:28.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.467+0000 7ff98effd700 1 -- 172.21.15.81:0/1678400247 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9880253f0 con 0x7ff9980cbea0 2023-10-07T08:52:28.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.468+0000 7ff98effd700 1 --2- 172.21.15.81:0/1678400247 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff978066f30 0x7ff9780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.468+0000 7ff98effd700 1 -- 172.21.15.81:0/1678400247 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff988085ee0 con 0x7ff9980cbea0 2023-10-07T08:52:28.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.468+0000 7ff98dd9b700 1 --2- 172.21.15.81:0/1678400247 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff978066f30 0x7ff9780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.468+0000 7ff98dd9b700 1 --2- 172.21.15.81:0/1678400247 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff978066f30 0x7ff9780693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff99806f9f0 tx=0x7ff980009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.472+0000 7ff98effd700 1 -- 172.21.15.81:0/1678400247 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff988053150 con 0x7ff9980cbea0 2023-10-07T08:52:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.728+0000 7ff99ceb4700 1 -- 172.21.15.81:0/1678400247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff9980cc7a0 con 0x7ff9980cbea0 2023-10-07T08:52:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.734+0000 7ff98effd700 1 -- 172.21.15.81:0/1678400247 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff988056770 con 0x7ff9980cbea0 2023-10-07T08:52:28.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.736+0000 7ff99ceb4700 1 -- 172.21.15.81:0/1678400247 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff978066f30 msgr2=0x7ff9780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.736+0000 7ff99ceb4700 1 --2- 172.21.15.81:0/1678400247 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff978066f30 0x7ff9780693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff99806f9f0 tx=0x7ff980009040 comp rx=0 tx=0).stop 2023-10-07T08:52:28.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.736+0000 7ff99ceb4700 1 -- 172.21.15.81:0/1678400247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9980cbea0 msgr2=0x7ff99815eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.736+0000 7ff99ceb4700 1 --2- 172.21.15.81:0/1678400247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9980cbea0 0x7ff99815eb60 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7ff99806fd60 tx=0x7ff988017000 comp rx=0 tx=0).stop 2023-10-07T08:52:28.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.736+0000 7ff99ceb4700 1 -- 172.21.15.81:0/1678400247 shutdown_connections 2023-10-07T08:52:28.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.736+0000 7ff99ceb4700 1 --2- 172.21.15.81:0/1678400247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff998157b90 0x7ff998155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.736+0000 7ff99ceb4700 1 --2- 172.21.15.81:0/1678400247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9980cbea0 0x7ff99815eb60 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.736+0000 7ff99ceb4700 1 --2- 172.21.15.81:0/1678400247 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7ff978066f30 0x7ff9780693e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.736+0000 7ff99ceb4700 1 --2- 172.21.15.81:0/1678400247 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9981577c0 0x7ff9980b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.736+0000 7ff99ceb4700 1 -- 172.21.15.81:0/1678400247 >> 172.21.15.81:0/1678400247 conn(0x7ff9980d0df0 msgr2=0x7ff99815c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:28.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.736+0000 7ff99ceb4700 1 -- 172.21.15.81:0/1678400247 shutdown_connections 2023-10-07T08:52:28.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.736+0000 7ff99ceb4700 1 -- 172.21.15.81:0/1678400247 wait complete. 2023-10-07T08:52:28.739 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-07T08:52:28.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:52:28.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.861+0000 7f1c4d6d8700 1 Processor -- start 2023-10-07T08:52:28.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.861+0000 7f1c4d6d8700 1 -- start start 2023-10-07T08:52:28.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.862+0000 7f1c4d6d8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1c48159f10 0x7f1c48068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.862+0000 7f1c4d6d8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c48069120 con 0x7f1c48068cc0 2023-10-07T08:52:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.862+0000 7f1c4d6d8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c480cee10 con 0x7f1c48159b40 2023-10-07T08:52:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.862+0000 7f1c4d6d8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c480cd040 con 0x7f1c48159f10 2023-10-07T08:52:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.862+0000 7f1c4ced7700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1c48068cc0 0x7f1c480cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50452/0 (socket says 172.21.15.81:50452) 2023-10-07T08:52:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.862+0000 7f1c4ced7700 1 -- 172.21.15.81:0/1247290780 learned_addr learned my addr 172.21.15.81:0/1247290780 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.862+0000 7f1c477fe700 1 --2- 172.21.15.81:0/1247290780 >> v2:172.21.15.89:3300/0 conn(0x7f1c48159f10 0x7f1c48068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.862+0000 7f1c46ffd700 1 -- 172.21.15.81:0/1247290780 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086464135 0 0) 0x7f1c40001490 con 0x7f1c48068cc0 2023-10-07T08:52:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.862+0000 7f1c46ffd700 1 -- 172.21.15.81:0/1247290780 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c30003570 con 0x7f1c48068cc0 2023-10-07T08:52:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c46ffd700 1 -- 172.21.15.81:0/1247290780 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2106713941 0 0) 0x7f1c30003570 con 0x7f1c48068cc0 2023-10-07T08:52:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c46ffd700 1 -- 172.21.15.81:0/1247290780 >> v2:172.21.15.89:3300/0 conn(0x7f1c48159f10 msgr2=0x7f1c48068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c46ffd700 1 --2- 172.21.15.81:0/1247290780 >> v2:172.21.15.89:3300/0 conn(0x7f1c48159f10 0x7f1c48068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c46ffd700 1 -- 172.21.15.81:0/1247290780 >> v1:172.21.15.89:6789/0 conn(0x7f1c48159b40 legacy=0x7f1c480cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c46ffd700 1 -- 172.21.15.81:0/1247290780 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c480cd320 con 0x7f1c48068cc0 2023-10-07T08:52:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c46ffd700 1 -- 172.21.15.81:0/1247290780 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f1c40001980 con 0x7f1c48068cc0 2023-10-07T08:52:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c477fe700 1 --2- 172.21.15.81:0/1247290780 >> v2:172.21.15.89:3300/0 conn(0x7f1c48159f10 0x7f1c48068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:52:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c46ffd700 1 -- 172.21.15.81:0/1247290780 >> v1:172.21.15.81:6789/0 conn(0x7f1c48068cc0 legacy=0x7f1c480cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c46ffd700 1 --2- 172.21.15.81:0/1247290780 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c30003a60 0x7f1c30003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c46ffd700 1 --2- 172.21.15.81:0/1247290780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c30004810 0x7f1c30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c46ffd700 1 --2- 172.21.15.81:0/1247290780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c300051c0 0x7f1c3000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c46ffd700 1 -- 172.21.15.81:0/1247290780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c480cd040 con 0x7f1c300051c0 2023-10-07T08:52:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c46ffd700 1 -- 172.21.15.81:0/1247290780 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3000c050 con 0x7f1c30004810 2023-10-07T08:52:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c46ffd700 1 -- 172.21.15.81:0/1247290780 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3000c210 con 0x7f1c30003a60 2023-10-07T08:52:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c4ced7700 1 --2- 172.21.15.81:0/1247290780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c300051c0 0x7f1c3000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c47fff700 1 --2- 172.21.15.81:0/1247290780 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c30003a60 0x7f1c30003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c477fe700 1 --2- 172.21.15.81:0/1247290780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c30004810 0x7f1c30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c4ced7700 1 -- 172.21.15.81:0/1247290780 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c30003a60 msgr2=0x7f1c30003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c4ced7700 1 --2- 172.21.15.81:0/1247290780 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c30003a60 0x7f1c30003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c4ced7700 1 -- 172.21.15.81:0/1247290780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c30004810 msgr2=0x7f1c30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c4ced7700 1 --2- 172.21.15.81:0/1247290780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c30004810 0x7f1c30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c4ced7700 1 -- 172.21.15.81:0/1247290780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c30003570 con 0x7f1c300051c0 2023-10-07T08:52:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c477fe700 1 --2- 172.21.15.81:0/1247290780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c30004810 0x7f1c30004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c4ced7700 1 -- 172.21.15.81:0/1247290780 reap_dead start 2023-10-07T08:52:28.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c4ced7700 1 --2- 172.21.15.81:0/1247290780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c300051c0 0x7f1c3000ba60 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000aaf0 tx=0x7f1c4000a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d8966f0d980e50 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c46ffd700 1 -- 172.21.15.81:0/1247290780 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4000a480 con 0x7f1c300051c0 2023-10-07T08:52:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c46ffd700 1 -- 172.21.15.81:0/1247290780 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4000c5d0 con 0x7f1c300051c0 2023-10-07T08:52:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.863+0000 7f1c46ffd700 1 -- 172.21.15.81:0/1247290780 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4000c970 con 0x7f1c300051c0 2023-10-07T08:52:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.864+0000 7f1c4d6d8700 1 -- 172.21.15.81:0/1247290780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c300051c0 msgr2=0x7f1c3000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.864+0000 7f1c4d6d8700 1 --2- 172.21.15.81:0/1247290780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c300051c0 0x7f1c3000ba60 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000aaf0 tx=0x7f1c4000a170 comp rx=0 tx=0).stop 2023-10-07T08:52:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.864+0000 7f1c4d6d8700 1 -- 172.21.15.81:0/1247290780 shutdown_connections 2023-10-07T08:52:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.864+0000 7f1c4d6d8700 1 --2- 172.21.15.81:0/1247290780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c300051c0 0x7f1c3000ba60 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.864+0000 7f1c4d6d8700 1 -- 172.21.15.81:0/1247290780 >> 172.21.15.81:0/1247290780 conn(0x7f1c480cd660 msgr2=0x7f1c480cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.864+0000 7f1c4d6d8700 1 -- 172.21.15.81:0/1247290780 shutdown_connections 2023-10-07T08:52:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.864+0000 7f1c4d6d8700 1 -- 172.21.15.81:0/1247290780 wait complete. 2023-10-07T08:52:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.865+0000 7f1c4d6d8700 1 Processor -- start 2023-10-07T08:52:28.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.865+0000 7f1c4d6d8700 1 -- start start 2023-10-07T08:52:28.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c4d6d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c300051c0 0x7f1c48144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c4d6d8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4815d370 0x7f1c4815d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c4d6d8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c480b54d0 0x7f1c480b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c4d6d8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c48158d10 con 0x7f1c4815d370 2023-10-07T08:52:28.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c4d6d8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4815b150 con 0x7f1c480b54d0 2023-10-07T08:52:28.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c4d6d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c48144fc0 con 0x7f1c300051c0 2023-10-07T08:52:28.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c477fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4815d370 0x7f1c4815d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c477fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4815d370 0x7f1c4815d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35788/0 (socket says 172.21.15.81:35788) 2023-10-07T08:52:28.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c477fe700 1 -- 172.21.15.81:0/914781532 learned_addr learned my addr 172.21.15.81:0/914781532 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:28.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c4ced7700 1 --2- 172.21.15.81:0/914781532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c480b54d0 0x7f1c480b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c47fff700 1 --2- 172.21.15.81:0/914781532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c300051c0 0x7f1c48144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c477fe700 1 -- 172.21.15.81:0/914781532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c300051c0 msgr2=0x7f1c48144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c477fe700 1 --2- 172.21.15.81:0/914781532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c300051c0 0x7f1c48144a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c477fe700 1 -- 172.21.15.81:0/914781532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c480b54d0 msgr2=0x7f1c480b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:28.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c477fe700 1 --2- 172.21.15.81:0/914781532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c480b54d0 0x7f1c480b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:28.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c477fe700 1 -- 172.21.15.81:0/914781532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c480b6450 con 0x7f1c4815d370 2023-10-07T08:52:28.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.866+0000 7f1c47fff700 1 --2- 172.21.15.81:0/914781532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c300051c0 0x7f1c48144a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:28.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.867+0000 7f1c477fe700 1 --2- 172.21.15.81:0/914781532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4815d370 0x7f1c4815d7e0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c011910 tx=0x7f1c3c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:28.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.867+0000 7f1c2ffff700 1 -- 172.21.15.81:0/914781532 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c00f700 con 0x7f1c4815d370 2023-10-07T08:52:28.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.867+0000 7f1c2ffff700 1 -- 172.21.15.81:0/914781532 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c00f860 con 0x7f1c4815d370 2023-10-07T08:52:28.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.867+0000 7f1c4d6d8700 1 -- 172.21.15.81:0/914781532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4815dd20 con 0x7f1c4815d370 2023-10-07T08:52:28.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.867+0000 7f1c2ffff700 1 -- 172.21.15.81:0/914781532 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c00fbe0 con 0x7f1c4815d370 2023-10-07T08:52:28.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.867+0000 7f1c4d6d8700 1 -- 172.21.15.81:0/914781532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c480b6170 con 0x7f1c4815d370 2023-10-07T08:52:28.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.868+0000 7f1c4d6d8700 1 -- 172.21.15.81:0/914781532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c48063e90 con 0x7f1c4815d370 2023-10-07T08:52:28.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.868+0000 7f1c2ffff700 1 -- 172.21.15.81:0/914781532 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c3c015460 con 0x7f1c4815d370 2023-10-07T08:52:28.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.868+0000 7f1c2ffff700 1 --2- 172.21.15.81:0/914781532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c34066f30 0x7f1c340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:28.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.869+0000 7f1c47fff700 1 --2- 172.21.15.81:0/914781532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c34066f30 0x7f1c340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:28.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.869+0000 7f1c2ffff700 1 -- 172.21.15.81:0/914781532 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c3c084d40 con 0x7f1c4815d370 2023-10-07T08:52:28.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.869+0000 7f1c47fff700 1 --2- 172.21.15.81:0/914781532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c34066f30 0x7f1c340693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1c38003b10 tx=0x7f1c38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:28.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:28.873+0000 7f1c2ffff700 1 -- 172.21.15.81:0/914781532 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c3c052060 con 0x7f1c4815d370 2023-10-07T08:52:29.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.098+0000 7f1c4d6d8700 1 -- 172.21.15.81:0/914781532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c4815b290 con 0x7f1c4815d370 2023-10-07T08:52:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.098+0000 7f1c2ffff700 1 -- 172.21.15.81:0/914781532 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f1c3c055680 con 0x7f1c4815d370 2023-10-07T08:52:29.100 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:29.100 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3709604420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3709604420},{"type":"v1","addr":"172.21.15.89:6835","nonce":3709604420}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7842,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/517568220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":517568220},{"type":"v1","addr":"172.21.15.81:6836","nonce":517568220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7845,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2183069282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2183069282},{"type":"v1","addr":"172.21.15.81:6837","nonce":2183069282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:52:23.270892+0000","modified":"2023-10-07T08:52:26.901820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7851":{"gid":7851,"name":"b","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6834/3341511949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3341511949},{"type":"v1","addr":"172.21.15.89:6834","nonce":3341511949}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-07T08:52:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.100+0000 7f1c4d6d8700 1 -- 172.21.15.81:0/914781532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c34066f30 msgr2=0x7f1c340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.100+0000 7f1c4d6d8700 1 --2- 172.21.15.81:0/914781532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c34066f30 0x7f1c340693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1c38003b10 tx=0x7f1c38009040 comp rx=0 tx=0).stop 2023-10-07T08:52:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.100+0000 7f1c4d6d8700 1 -- 172.21.15.81:0/914781532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4815d370 msgr2=0x7f1c4815d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.100+0000 7f1c4d6d8700 1 --2- 172.21.15.81:0/914781532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4815d370 0x7f1c4815d7e0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c011910 tx=0x7f1c3c008040 comp rx=0 tx=0).stop 2023-10-07T08:52:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.100+0000 7f1c4d6d8700 1 -- 172.21.15.81:0/914781532 shutdown_connections 2023-10-07T08:52:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.100+0000 7f1c4d6d8700 1 --2- 172.21.15.81:0/914781532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c480b54d0 0x7f1c480b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.100+0000 7f1c4d6d8700 1 --2- 172.21.15.81:0/914781532 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c34066f30 0x7f1c340693e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.100+0000 7f1c4d6d8700 1 --2- 172.21.15.81:0/914781532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c300051c0 0x7f1c48144a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.100+0000 7f1c4d6d8700 1 --2- 172.21.15.81:0/914781532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4815d370 0x7f1c4815d7e0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.100+0000 7f1c4d6d8700 1 -- 172.21.15.81:0/914781532 >> 172.21.15.81:0/914781532 conn(0x7f1c480cd660 msgr2=0x7f1c4806d900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.101+0000 7f1c4d6d8700 1 -- 172.21.15.81:0/914781532 shutdown_connections 2023-10-07T08:52:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.101+0000 7f1c4d6d8700 1 -- 172.21.15.81:0/914781532 wait complete. 2023-10-07T08:52:29.105 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 82 2023-10-07T08:52:29.329 INFO:tasks.ceph.mds.b.smithi089.stderr:2023-10-07T08:52:29.329+0000 7fb73b936700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:52:29.516 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 82, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T08:52:23.270892+0000', 'modified': '2023-10-07T08:52:26.901820+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7851}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7851': {'gid': 7851, 'name': 'b', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6834/3341511949', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6832', 'nonce': 3341511949}, {'type': 'v1', 'addr': '172.21.15.89:6834', 'nonce': 3341511949}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T08:52:29.517 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T08:52:29.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-07T08:52:29.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.632+0000 7f5d2d8cb700 1 Processor -- start 2023-10-07T08:52:29.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.633+0000 7f5d2d8cb700 1 -- start start 2023-10-07T08:52:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.633+0000 7f5d2d8cb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d280cf060 0x7f5d280b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.633+0000 7f5d2d8cb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5d28159f90 0x7f5d2806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.633+0000 7f5d2d8cb700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d28067640 con 0x7f5d28159bc0 2023-10-07T08:52:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.633+0000 7f5d2d8cb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d280b1e50 con 0x7f5d28159f90 2023-10-07T08:52:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.633+0000 7f5d2d8cb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d28067890 con 0x7f5d280cf060 2023-10-07T08:52:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.633+0000 7f5d2c8c9700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5d28159bc0 0x7f5d280ce950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50454/0 (socket says 172.21.15.81:50454) 2023-10-07T08:52:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.633+0000 7f5d2c8c9700 1 -- 172.21.15.81:0/811516962 learned_addr learned my addr 172.21.15.81:0/811516962 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.634+0000 7f5d1ffff700 1 --2- 172.21.15.81:0/811516962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d280cf060 0x7f5d280b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.634+0000 7f5d2d0ca700 1 --2- 172.21.15.81:0/811516962 >> v2:172.21.15.89:3300/0 conn(0x7f5d28159f90 0x7f5d2806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.634+0000 7f5d1f7fe700 1 -- 172.21.15.81:0/811516962 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426072224 0 0) 0x7f5d28067640 con 0x7f5d28159bc0 2023-10-07T08:52:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.634+0000 7f5d1f7fe700 1 -- 172.21.15.81:0/811516962 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d10003570 con 0x7f5d28159bc0 2023-10-07T08:52:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.634+0000 7f5d1ffff700 1 -- 172.21.15.81:0/811516962 >> v2:172.21.15.89:3300/0 conn(0x7f5d28159f90 msgr2=0x7f5d2806b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.634+0000 7f5d1ffff700 1 --2- 172.21.15.81:0/811516962 >> v2:172.21.15.89:3300/0 conn(0x7f5d28159f90 0x7f5d2806b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.634+0000 7f5d1ffff700 1 -- 172.21.15.81:0/811516962 >> v1:172.21.15.81:6789/0 conn(0x7f5d28159bc0 legacy=0x7f5d280ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.634+0000 7f5d1f7fe700 1 -- 172.21.15.81:0/811516962 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3366941862 0 0) 0x7f5d10003570 con 0x7f5d28159bc0 2023-10-07T08:52:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.634+0000 7f5d1ffff700 1 -- 172.21.15.81:0/811516962 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d28067b70 con 0x7f5d280cf060 2023-10-07T08:52:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.634+0000 7f5d1ffff700 1 --2- 172.21.15.81:0/811516962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d280cf060 0x7f5d280b17c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5d180098e0 tx=0x7f5d180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=240af4b48663c1f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.634+0000 7f5d1f7fe700 1 -- 172.21.15.81:0/811516962 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d240017f0 con 0x7f5d280cf060 2023-10-07T08:52:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.634+0000 7f5d1f7fe700 1 -- 172.21.15.81:0/811516962 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d18011420 con 0x7f5d280cf060 2023-10-07T08:52:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.634+0000 7f5d1f7fe700 1 -- 172.21.15.81:0/811516962 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d180117c0 con 0x7f5d280cf060 2023-10-07T08:52:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.635+0000 7f5d2d8cb700 1 -- 172.21.15.81:0/811516962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d280cf060 msgr2=0x7f5d280b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.635+0000 7f5d2d8cb700 1 --2- 172.21.15.81:0/811516962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d280cf060 0x7f5d280b17c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5d180098e0 tx=0x7f5d180091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.635+0000 7f5d2d8cb700 1 -- 172.21.15.81:0/811516962 shutdown_connections 2023-10-07T08:52:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.635+0000 7f5d2d8cb700 1 --2- 172.21.15.81:0/811516962 >> v2:172.21.15.89:3300/0 conn(0x7f5d28159f90 0x7f5d2806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.635+0000 7f5d2d8cb700 1 --2- 172.21.15.81:0/811516962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d280cf060 0x7f5d280b17c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.635+0000 7f5d2d8cb700 1 -- 172.21.15.81:0/811516962 >> 172.21.15.81:0/811516962 conn(0x7f5d2806c620 msgr2=0x7f5d2806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.635+0000 7f5d2d8cb700 1 -- 172.21.15.81:0/811516962 shutdown_connections 2023-10-07T08:52:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.635+0000 7f5d2d8cb700 1 -- 172.21.15.81:0/811516962 wait complete. 2023-10-07T08:52:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.636+0000 7f5d2d8cb700 1 Processor -- start 2023-10-07T08:52:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.636+0000 7f5d2d8cb700 1 -- start start 2023-10-07T08:52:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.637+0000 7f5d2d8cb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d280cf060 0x7f5d28151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.637+0000 7f5d2d8cb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d28159bc0 0x7f5d280ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.637+0000 7f5d2d8cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d28159f90 0x7f5d280ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.637+0000 7f5d2d8cb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2815a470 con 0x7f5d28159f90 2023-10-07T08:52:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.637+0000 7f5d2d8cb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2815a6e0 con 0x7f5d28159bc0 2023-10-07T08:52:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.637+0000 7f5d2d8cb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2815a9c0 con 0x7f5d280cf060 2023-10-07T08:52:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.637+0000 7f5d2d0ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d28159f90 0x7f5d280ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.637+0000 7f5d1ffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d28159bc0 0x7f5d280ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.637+0000 7f5d2d0ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d28159f90 0x7f5d280ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35800/0 (socket says 172.21.15.81:35800) 2023-10-07T08:52:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.637+0000 7f5d2d0ca700 1 -- 172.21.15.81:0/1585479959 learned_addr learned my addr 172.21.15.81:0/1585479959 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.637+0000 7f5d2c8c9700 1 --2- 172.21.15.81:0/1585479959 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d280cf060 0x7f5d28151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.637+0000 7f5d2d0ca700 1 -- 172.21.15.81:0/1585479959 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d280cf060 msgr2=0x7f5d28151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.637+0000 7f5d2d0ca700 1 --2- 172.21.15.81:0/1585479959 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d280cf060 0x7f5d28151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.637+0000 7f5d2d0ca700 1 -- 172.21.15.81:0/1585479959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d28159bc0 msgr2=0x7f5d280ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.637+0000 7f5d2d0ca700 1 --2- 172.21.15.81:0/1585479959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d28159bc0 0x7f5d280ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.637+0000 7f5d2d0ca700 1 -- 172.21.15.81:0/1585479959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d18009420 con 0x7f5d28159f90 2023-10-07T08:52:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.638+0000 7f5d2d0ca700 1 --2- 172.21.15.81:0/1585479959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d28159f90 0x7f5d280ae8c0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f5d2000ea50 tx=0x7f5d200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:29.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.638+0000 7f5d1cff9700 1 -- 172.21.15.81:0/1585479959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000ee90 con 0x7f5d28159f90 2023-10-07T08:52:29.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.638+0000 7f5d1cff9700 1 -- 172.21.15.81:0/1585479959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2000c850 con 0x7f5d28159f90 2023-10-07T08:52:29.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.638+0000 7f5d2d8cb700 1 -- 172.21.15.81:0/1585479959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2815aca0 con 0x7f5d28159f90 2023-10-07T08:52:29.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.638+0000 7f5d1cff9700 1 -- 172.21.15.81:0/1585479959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000cc10 con 0x7f5d28159f90 2023-10-07T08:52:29.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.638+0000 7f5d2d8cb700 1 -- 172.21.15.81:0/1585479959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d280b0ab0 con 0x7f5d28159f90 2023-10-07T08:52:29.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.639+0000 7f5d1cff9700 1 -- 172.21.15.81:0/1585479959 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d20013470 con 0x7f5d28159f90 2023-10-07T08:52:29.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.639+0000 7f5d1cff9700 1 --2- 172.21.15.81:0/1585479959 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5d14066f30 0x7f5d140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.640+0000 7f5d1cff9700 1 -- 172.21.15.81:0/1585479959 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d20084890 con 0x7f5d28159f90 2023-10-07T08:52:29.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.640+0000 7f5d2c8c9700 1 --2- 172.21.15.81:0/1585479959 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5d14066f30 0x7f5d140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.640+0000 7f5d2c8c9700 1 --2- 172.21.15.81:0/1585479959 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5d14066f30 0x7f5d140693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5d280b1b70 tx=0x7f5d24001640 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:29.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.641+0000 7f5d37e25b80 1 Processor -- start 2023-10-07T08:52:29.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.641+0000 7f5d37e25b80 1 -- start start 2023-10-07T08:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.642+0000 7f5d37e25b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba8d480 0x561e3ba6c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.642+0000 7f5d37e25b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba8d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.642+0000 7f5d37e25b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba42b80 0x561e3ba42ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.642+0000 7f5d37e25b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3b999a70 con 0x561e3ba405f0 2023-10-07T08:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.642+0000 7f5d37e25b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3b997270 con 0x561e3ba8d480 2023-10-07T08:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.642+0000 7f5d37e25b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e3b993060 con 0x561e3ba42b80 2023-10-07T08:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.642+0000 7f5d1ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba8d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.642+0000 7f5d1ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba8d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35806/0 (socket says 172.21.15.81:35806) 2023-10-07T08:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.642+0000 7f5d1ffff700 1 -- 172.21.15.81:0/2156762395 learned_addr learned my addr 172.21.15.81:0/2156762395 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.642+0000 7f5d2c8c9700 1 --2- 172.21.15.81:0/2156762395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba8d480 0x561e3ba6c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.642+0000 7f5d2d0ca700 1 --2- 172.21.15.81:0/2156762395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba42b80 0x561e3ba42ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.642+0000 7f5d1ffff700 1 -- 172.21.15.81:0/2156762395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba42b80 msgr2=0x561e3ba42ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.642+0000 7f5d1ffff700 1 --2- 172.21.15.81:0/2156762395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba42b80 0x561e3ba42ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.642+0000 7f5d1ffff700 1 -- 172.21.15.81:0/2156762395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba8d480 msgr2=0x561e3ba6c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.642+0000 7f5d1ffff700 1 --2- 172.21.15.81:0/2156762395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba8d480 0x561e3ba6c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.642+0000 7f5d1ffff700 1 -- 172.21.15.81:0/2156762395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3b82d270 con 0x561e3ba405f0 2023-10-07T08:52:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.643+0000 7f5d1ffff700 1 --2- 172.21.15.81:0/2156762395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba8d850 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f5d2806dcb0 tx=0x7f5d18016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8fb48160eacca2 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.643+0000 7f5d0dffb700 1 -- 172.21.15.81:0/2156762395 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d18022070 con 0x561e3ba405f0 2023-10-07T08:52:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.643+0000 7f5d0dffb700 1 -- 172.21.15.81:0/2156762395 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d18011590 con 0x561e3ba405f0 2023-10-07T08:52:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.643+0000 7f5d0dffb700 1 -- 172.21.15.81:0/2156762395 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d18011b30 con 0x561e3ba405f0 2023-10-07T08:52:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.643+0000 7f5d37e25b80 1 -- 172.21.15.81:0/2156762395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 msgr2=0x561e3ba8d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.643+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/2156762395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba8d850 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f5d2806dcb0 tx=0x7f5d18016000 comp rx=0 tx=0).stop 2023-10-07T08:52:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.643+0000 7f5d37e25b80 1 -- 172.21.15.81:0/2156762395 shutdown_connections 2023-10-07T08:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.643+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/2156762395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba42b80 0x561e3ba42ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.643+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/2156762395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba8d480 0x561e3ba6c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.643+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/2156762395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba8d850 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.643+0000 7f5d37e25b80 1 -- 172.21.15.81:0/2156762395 >> 172.21.15.81:0/2156762395 conn(0x561e3ba440c0 msgr2=0x561e3ba448f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.643+0000 7f5d37e25b80 1 -- 172.21.15.81:0/2156762395 shutdown_connections 2023-10-07T08:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.643+0000 7f5d37e25b80 1 -- 172.21.15.81:0/2156762395 wait complete. 2023-10-07T08:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.644+0000 7f5d37e25b80 1 -- start start 2023-10-07T08:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.644+0000 7f5d37e25b80 1 Processor -- start 2023-10-07T08:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d37e25b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba67140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d37e25b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba42b80 0x561e3ba89980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d37e25b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba8d480 0x561e3ba724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d37e25b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3b93e890 con 0x561e3ba405f0 2023-10-07T08:52:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d37e25b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3b959ea0 con 0x561e3ba42b80 2023-10-07T08:52:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d37e25b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e3b815e30 con 0x561e3ba8d480 2023-10-07T08:52:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d37e25b80 10 client.0 _ll_register_callbacks cb 0x561e3ba062c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:52:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d2c8c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba67140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d2c8c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba67140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35818/0 (socket says 172.21.15.81:35818) 2023-10-07T08:52:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d2c8c9700 1 -- 172.21.15.81:0/226109747 learned_addr learned my addr 172.21.15.81:0/226109747 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d1ffff700 1 --2- 172.21.15.81:0/226109747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba42b80 0x561e3ba89980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d2d0ca700 1 --2- 172.21.15.81:0/226109747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba8d480 0x561e3ba724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d2c8c9700 1 -- 172.21.15.81:0/226109747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba8d480 msgr2=0x561e3ba724d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d2c8c9700 1 --2- 172.21.15.81:0/226109747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba8d480 0x561e3ba724d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d2c8c9700 1 -- 172.21.15.81:0/226109747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba42b80 msgr2=0x561e3ba89980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d2c8c9700 1 --2- 172.21.15.81:0/226109747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba42b80 0x561e3ba89980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d2c8c9700 1 -- 172.21.15.81:0/226109747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d28067b70 con 0x561e3ba405f0 2023-10-07T08:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d2c8c9700 1 --2- 172.21.15.81:0/226109747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba67140 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f5d240138f0 tx=0x7f5d24014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778155c9ba4cb8d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.645+0000 7f5d06ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.646+0000 7f5d06ffd700 1 -- 172.21.15.81:0/226109747 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24012350 con 0x561e3ba405f0 2023-10-07T08:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.646+0000 7f5d06ffd700 1 -- 172.21.15.81:0/226109747 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d2401b040 con 0x561e3ba405f0 2023-10-07T08:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.646+0000 7f5d37e25b80 1 -- 172.21.15.81:0/226109747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e3ba37cd0 con 0x561e3ba405f0 2023-10-07T08:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.646+0000 7f5d06ffd700 1 -- 172.21.15.81:0/226109747 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d24021d00 con 0x561e3ba405f0 2023-10-07T08:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.646+0000 7f5d37e25b80 10 client.7986 fetch_fsmap learned FSMap version 82 2023-10-07T08:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.646+0000 7f5d37e25b80 1 -- 172.21.15.81:0/226109747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) v3 -- 0x561e3b7cffe0 con 0x561e3ba405f0 2023-10-07T08:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.646+0000 7f5d06ffd700 1 -- 172.21.15.81:0/226109747 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561e3ba37cd0 con 0x561e3ba405f0 2023-10-07T08:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.646+0000 7f5d06ffd700 1 -- 172.21.15.81:0/226109747 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 82) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5d240124b0 con 0x561e3ba405f0 2023-10-07T08:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.646+0000 7f5d37e25b80 10 client.7986 fetch_fsmap finished waiting for FSMap version 82 2023-10-07T08:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.646+0000 7f5d37e25b80 10 client.7986 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-07T08:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.646+0000 7f5d37e25b80 20 client.7986 populate_metadata read hostname 'smithi081' 2023-10-07T08:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.646+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/226109747 >> [v2:172.21.15.89:6832/3341511949,v1:172.21.15.89:6834/3341511949] conn(0x561e3ba6ddb0 0x561e3ba6ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.646+0000 7f5d37e25b80 4 client.7986 mds_command: new command op to 7851 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T08:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.646+0000 7f5d37e25b80 1 -- 172.21.15.81:0/226109747 --> [v2:172.21.15.89:6832/3341511949,v1:172.21.15.89:6834/3341511949] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e3ba14aa0 con 0x561e3ba6ddb0 2023-10-07T08:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.646+0000 7f5d1ffff700 1 --2- 172.21.15.81:0/226109747 >> [v2:172.21.15.89:6832/3341511949,v1:172.21.15.89:6834/3341511949] conn(0x561e3ba6ddb0 0x561e3ba6ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.647+0000 7f5d06ffd700 10 client.7986 ms_handle_connect on v2:172.21.15.89:6832/3341511949 2023-10-07T08:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.647+0000 7f5d1ffff700 1 --2- 172.21.15.81:0/226109747 >> [v2:172.21.15.89:6832/3341511949,v1:172.21.15.89:6834/3341511949] conn(0x561e3ba6ddb0 0x561e3ba6ce00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8da51039690679f5 server_cookie=b7749add32f6e5e6 in_seq=0 out_seq=0 2023-10-07T08:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.647+0000 7f5d06ffd700 1 -- 172.21.15.81:0/226109747 <== mds.0 v2:172.21.15.89:6832/3341511949 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561e3ba14aa0 con 0x561e3ba6ddb0 2023-10-07T08:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.647+0000 7f5d06ffd700 10 client.7986 handle_command_reply: tid=0 2023-10-07T08:52:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.647+0000 7f5d37e25b80 1 client.7986 shutdown 2023-10-07T08:52:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.647+0000 7f5d37e25b80 1 -- 172.21.15.81:0/226109747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 msgr2=0x561e3ba67140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.647+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/226109747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba67140 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f5d240138f0 tx=0x7f5d24014000 comp rx=0 tx=0).stop 2023-10-07T08:52:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.648+0000 7f5d37e25b80 1 -- 172.21.15.81:0/226109747 shutdown_connections 2023-10-07T08:52:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.648+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/226109747 >> [v2:172.21.15.89:6832/3341511949,v1:172.21.15.89:6834/3341511949] conn(0x561e3ba6ddb0 0x561e3ba6ce00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.648+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/226109747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba8d480 0x561e3ba724d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.648+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/226109747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba67140 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.648+0000 7f5d06ffd700 0 client.7986 ms_handle_reset on v2:172.21.15.89:6832/3341511949 2023-10-07T08:52:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.648+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/226109747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba42b80 0x561e3ba89980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.648+0000 7f5d37e25b80 1 -- 172.21.15.81:0/226109747 >> 172.21.15.81:0/226109747 conn(0x561e3ba440c0 msgr2=0x561e3ba448d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.648+0000 7f5d37e25b80 1 -- 172.21.15.81:0/226109747 shutdown_connections 2023-10-07T08:52:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.648+0000 7f5d37e25b80 1 -- 172.21.15.81:0/226109747 wait complete. 2023-10-07T08:52:29.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.648+0000 7f5d37e25b80 20 client.7986 trim_cache size 0 max 16384 2023-10-07T08:52:29.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.664+0000 7f5d37e25b80 1 Processor -- start 2023-10-07T08:52:29.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.664+0000 7f5d37e25b80 1 -- start start 2023-10-07T08:52:29.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d37e25b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba6e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d37e25b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba42b80 0x561e3ba3fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d37e25b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba6ddb0 0x561e3ba3ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d37e25b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3ba38f40 con 0x561e3ba405f0 2023-10-07T08:52:29.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d37e25b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3ba708e0 con 0x561e3ba42b80 2023-10-07T08:52:29.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d37e25b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e3ba3b9e0 con 0x561e3ba6ddb0 2023-10-07T08:52:29.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d2c8c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba6e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d2c8c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba6e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35828/0 (socket says 172.21.15.81:35828) 2023-10-07T08:52:29.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d2c8c9700 1 -- 172.21.15.81:0/3430214996 learned_addr learned my addr 172.21.15.81:0/3430214996 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:29.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d2c8c9700 1 -- 172.21.15.81:0/3430214996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba6ddb0 msgr2=0x561e3ba3ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:29.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d2c8c9700 1 --2- 172.21.15.81:0/3430214996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba6ddb0 0x561e3ba3ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d2c8c9700 1 -- 172.21.15.81:0/3430214996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba42b80 msgr2=0x561e3ba3fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:29.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d2c8c9700 1 --2- 172.21.15.81:0/3430214996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba42b80 0x561e3ba3fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d2c8c9700 1 -- 172.21.15.81:0/3430214996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3b961780 con 0x561e3ba405f0 2023-10-07T08:52:29.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d2c8c9700 1 --2- 172.21.15.81:0/3430214996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba6e840 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f5d24004f80 tx=0x7f5d24019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d28db2ed62ea26 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:29.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d0e7fc700 1 -- 172.21.15.81:0/3430214996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24001ae0 con 0x561e3ba405f0 2023-10-07T08:52:29.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d0e7fc700 1 -- 172.21.15.81:0/3430214996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2400b030 con 0x561e3ba405f0 2023-10-07T08:52:29.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.665+0000 7f5d0e7fc700 1 -- 172.21.15.81:0/3430214996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24012c40 con 0x561e3ba405f0 2023-10-07T08:52:29.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.666+0000 7f5d37e25b80 1 -- 172.21.15.81:0/3430214996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 msgr2=0x561e3ba6e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:29.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.666+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/3430214996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba6e840 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f5d24004f80 tx=0x7f5d24019000 comp rx=0 tx=0).stop 2023-10-07T08:52:29.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.666+0000 7f5d37e25b80 1 -- 172.21.15.81:0/3430214996 shutdown_connections 2023-10-07T08:52:29.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.666+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/3430214996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba6ddb0 0x561e3ba3ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.666+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/3430214996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba6e840 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.666+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/3430214996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba42b80 0x561e3ba3fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.666+0000 7f5d37e25b80 1 -- 172.21.15.81:0/3430214996 >> 172.21.15.81:0/3430214996 conn(0x561e3ba440c0 msgr2=0x561e3ba42fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:29.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.666+0000 7f5d37e25b80 1 -- 172.21.15.81:0/3430214996 shutdown_connections 2023-10-07T08:52:29.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.666+0000 7f5d37e25b80 1 -- 172.21.15.81:0/3430214996 wait complete. 2023-10-07T08:52:29.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.666+0000 7f5d37e25b80 1 -- start start 2023-10-07T08:52:29.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.667+0000 7f5d37e25b80 1 Processor -- start 2023-10-07T08:52:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.667+0000 7f5d37e25b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba9b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.667+0000 7f5d37e25b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba42b80 0x561e3ba9b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.667+0000 7f5d37e25b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba6ddb0 0x561e3ba670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.667+0000 7f5d37e25b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3baef100 con 0x561e3ba405f0 2023-10-07T08:52:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.667+0000 7f5d37e25b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3ba6c970 con 0x561e3ba42b80 2023-10-07T08:52:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.667+0000 7f5d37e25b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e3ba87790 con 0x561e3ba6ddb0 2023-10-07T08:52:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.667+0000 7f5d37e25b80 10 client.0 _ll_register_callbacks cb 0x561e3ba062c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:52:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.667+0000 7f5d2c8c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba9b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.667+0000 7f5d2c8c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba9b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35844/0 (socket says 172.21.15.81:35844) 2023-10-07T08:52:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.667+0000 7f5d2c8c9700 1 -- 172.21.15.81:0/4260604656 learned_addr learned my addr 172.21.15.81:0/4260604656 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d1ffff700 1 --2- 172.21.15.81:0/4260604656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba42b80 0x561e3ba9b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d2d0ca700 1 --2- 172.21.15.81:0/4260604656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba6ddb0 0x561e3ba670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d2c8c9700 1 -- 172.21.15.81:0/4260604656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba6ddb0 msgr2=0x561e3ba670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d2c8c9700 1 --2- 172.21.15.81:0/4260604656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba6ddb0 0x561e3ba670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d2c8c9700 1 -- 172.21.15.81:0/4260604656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba42b80 msgr2=0x561e3ba9b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d2c8c9700 1 --2- 172.21.15.81:0/4260604656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba42b80 0x561e3ba9b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d2c8c9700 1 -- 172.21.15.81:0/4260604656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e3b7cffe0 con 0x561e3ba405f0 2023-10-07T08:52:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d2d0ca700 1 --2- 172.21.15.81:0/4260604656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba6ddb0 0x561e3ba670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d2c8c9700 1 --2- 172.21.15.81:0/4260604656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba9b210 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f5d24002160 tx=0x7f5d24033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ce0eb9491bf6d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d06ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:52:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d06ffd700 1 -- 172.21.15.81:0/4260604656 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24013540 con 0x561e3ba405f0 2023-10-07T08:52:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d06ffd700 1 -- 172.21.15.81:0/4260604656 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d2403eaf0 con 0x561e3ba405f0 2023-10-07T08:52:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d37e25b80 1 -- 172.21.15.81:0/4260604656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5d18011590 con 0x561e3ba405f0 2023-10-07T08:52:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d06ffd700 1 -- 172.21.15.81:0/4260604656 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d2403eec0 con 0x561e3ba405f0 2023-10-07T08:52:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d37e25b80 10 client.7992 fetch_fsmap learned FSMap version 82 2023-10-07T08:52:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d37e25b80 1 -- 172.21.15.81:0/4260604656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) v3 -- 0x561e3b948470 con 0x561e3ba405f0 2023-10-07T08:52:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d06ffd700 1 -- 172.21.15.81:0/4260604656 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d18011590 con 0x561e3ba405f0 2023-10-07T08:52:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d06ffd700 1 -- 172.21.15.81:0/4260604656 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 82) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5d24044020 con 0x561e3ba405f0 2023-10-07T08:52:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d37e25b80 10 client.7992 fetch_fsmap finished waiting for FSMap version 82 2023-10-07T08:52:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d37e25b80 10 client.7992 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-07T08:52:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d37e25b80 20 client.7992 populate_metadata read hostname 'smithi081' 2023-10-07T08:52:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/4260604656 >> [v2:172.21.15.89:6832/3341511949,v1:172.21.15.89:6834/3341511949] conn(0x561e3ba8d480 0x561e3ba67600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d37e25b80 4 client.7992 mds_command: new command op to 7851 tid=0[{"prefix": "status"}] 2023-10-07T08:52:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.668+0000 7f5d37e25b80 1 -- 172.21.15.81:0/4260604656 --> [v2:172.21.15.89:6832/3341511949,v1:172.21.15.89:6834/3341511949] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561e3b935e00 con 0x561e3ba8d480 2023-10-07T08:52:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d1ffff700 1 --2- 172.21.15.81:0/4260604656 >> [v2:172.21.15.89:6832/3341511949,v1:172.21.15.89:6834/3341511949] conn(0x561e3ba8d480 0x561e3ba67600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d06ffd700 10 client.7992 ms_handle_connect on v2:172.21.15.89:6832/3341511949 2023-10-07T08:52:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d1ffff700 1 --2- 172.21.15.81:0/4260604656 >> [v2:172.21.15.89:6832/3341511949,v1:172.21.15.89:6834/3341511949] conn(0x561e3ba8d480 0x561e3ba67600 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c119cc9e05477e6 server_cookie=2bb7ffbfcb0f9bff in_seq=0 out_seq=0 2023-10-07T08:52:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d06ffd700 1 -- 172.21.15.81:0/4260604656 <== mds.0 v2:172.21.15.89:6832/3341511949 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x561e3b935e00 con 0x561e3ba8d480 2023-10-07T08:52:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d06ffd700 10 client.7992 handle_command_reply: tid=0 2023-10-07T08:52:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d37e25b80 1 client.7992 shutdown 2023-10-07T08:52:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d37e25b80 1 -- 172.21.15.81:0/4260604656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 msgr2=0x561e3ba9b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/4260604656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba9b210 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f5d24002160 tx=0x7f5d24033000 comp rx=0 tx=0).stop 2023-10-07T08:52:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d37e25b80 1 -- 172.21.15.81:0/4260604656 shutdown_connections 2023-10-07T08:52:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/4260604656 >> [v2:172.21.15.89:6832/3341511949,v1:172.21.15.89:6834/3341511949] conn(0x561e3ba8d480 0x561e3ba67600 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/4260604656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x561e3ba6ddb0 0x561e3ba670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d06ffd700 0 client.7992 ms_handle_reset on v2:172.21.15.89:6832/3341511949 2023-10-07T08:52:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/4260604656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e3ba405f0 0x561e3ba9b210 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d37e25b80 1 --2- 172.21.15.81:0/4260604656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ba42b80 0x561e3ba9b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d37e25b80 1 -- 172.21.15.81:0/4260604656 >> 172.21.15.81:0/4260604656 conn(0x561e3ba440c0 msgr2=0x561e3ba39090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d37e25b80 1 -- 172.21.15.81:0/4260604656 shutdown_connections 2023-10-07T08:52:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d37e25b80 1 -- 172.21.15.81:0/4260604656 wait complete. 2023-10-07T08:52:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.669+0000 7f5d37e25b80 20 client.7992 trim_cache size 0 max 16384 2023-10-07T08:52:29.679 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:52:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:52:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-07T08:52:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7851, 2023-10-07T08:52:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-07T08:52:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-07T08:52:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-07T08:52:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.78374962, 2023-10-07T08:52:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 82, 2023-10-07T08:52:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 173, 2023-10-07T08:52:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 173, 2023-10-07T08:52:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 10.901241459 2023-10-07T08:52:29.680 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:52:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.670+0000 7f5d2d8cb700 1 -- 172.21.15.81:0/1585479959 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5d14066f30 msgr2=0x7f5d140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.670+0000 7f5d2d8cb700 1 --2- 172.21.15.81:0/1585479959 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5d14066f30 0x7f5d140693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5d280b1b70 tx=0x7f5d24001640 comp rx=0 tx=0).stop 2023-10-07T08:52:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.670+0000 7f5d2d8cb700 1 -- 172.21.15.81:0/1585479959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d28159f90 msgr2=0x7f5d280ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.670+0000 7f5d2d8cb700 1 --2- 172.21.15.81:0/1585479959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d28159f90 0x7f5d280ae8c0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f5d2000ea50 tx=0x7f5d200091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.670+0000 7f5d2d8cb700 1 -- 172.21.15.81:0/1585479959 shutdown_connections 2023-10-07T08:52:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.670+0000 7f5d2d8cb700 1 --2- 172.21.15.81:0/1585479959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d28159f90 0x7f5d280ae8c0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.670+0000 7f5d2d8cb700 1 --2- 172.21.15.81:0/1585479959 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5d14066f30 0x7f5d140693e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.670+0000 7f5d2d8cb700 1 --2- 172.21.15.81:0/1585479959 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d280cf060 0x7f5d28151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.670+0000 7f5d2d8cb700 1 --2- 172.21.15.81:0/1585479959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d28159bc0 0x7f5d280ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.670+0000 7f5d2d8cb700 1 -- 172.21.15.81:0/1585479959 >> 172.21.15.81:0/1585479959 conn(0x7f5d2806c620 msgr2=0x7f5d281543a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.670+0000 7f5d2d8cb700 1 -- 172.21.15.81:0/1585479959 shutdown_connections 2023-10-07T08:52:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.670+0000 7f5d2d8cb700 1 -- 172.21.15.81:0/1585479959 wait complete. 2023-10-07T08:52:29.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:52:29.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.795+0000 7fe3f52e5700 1 Processor -- start 2023-10-07T08:52:29.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.796+0000 7fe3f52e5700 1 -- start start 2023-10-07T08:52:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.796+0000 7fe3f52e5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe3f01578d0 0x7fe3f00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.796+0000 7fe3f52e5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe3f0157ca0 0x7fe3f015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.796+0000 7fe3f52e5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f00d07c0 con 0x7fe3f006d120 2023-10-07T08:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.796+0000 7fe3f52e5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f00cfbb0 con 0x7fe3f01578d0 2023-10-07T08:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.796+0000 7fe3f52e5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f00cfe90 con 0x7fe3f0157ca0 2023-10-07T08:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.796+0000 7fe3eeffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe3f01578d0 0x7fe3f00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.797+0000 7fe3eeffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe3f01578d0 0x7fe3f00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35858/0 (socket says 172.21.15.81:35858) 2023-10-07T08:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.797+0000 7fe3eeffd700 1 -- 172.21.15.81:0/3869753382 learned_addr learned my addr 172.21.15.81:0/3869753382 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.797+0000 7fe3ef7fe700 1 --1- 172.21.15.81:0/3869753382 >> v1:172.21.15.81:6789/0 conn(0x7fe3f006d120 0x7fe3f006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50466/0 (socket says 172.21.15.81:50466) 2023-10-07T08:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.797+0000 7fe3e7fff700 1 --2- 172.21.15.81:0/3869753382 >> v2:172.21.15.89:3300/0 conn(0x7fe3f0157ca0 0x7fe3f015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.797+0000 7fe3eeffd700 1 -- 172.21.15.81:0/3869753382 >> v2:172.21.15.89:3300/0 conn(0x7fe3f0157ca0 msgr2=0x7fe3f015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.797+0000 7fe3eeffd700 1 --2- 172.21.15.81:0/3869753382 >> v2:172.21.15.89:3300/0 conn(0x7fe3f0157ca0 0x7fe3f015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.797+0000 7fe3eeffd700 1 -- 172.21.15.81:0/3869753382 >> v1:172.21.15.81:6789/0 conn(0x7fe3f006d120 legacy=0x7fe3f006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.797+0000 7fe3eeffd700 1 -- 172.21.15.81:0/3869753382 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f00d0170 con 0x7fe3f01578d0 2023-10-07T08:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.797+0000 7fe3ee7fc700 1 -- 172.21.15.81:0/3869753382 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421012969 0 0) 0x7fe3f00d07c0 con 0x7fe3f006d120 2023-10-07T08:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.797+0000 7fe3eeffd700 1 --2- 172.21.15.81:0/3869753382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f01578d0 0x7fe3f00cf4f0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0068510 tx=0x7fe3e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dd7dc9f365137f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.797+0000 7fe3ee7fc700 1 -- 172.21.15.81:0/3869753382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0009e70 con 0x7fe3f01578d0 2023-10-07T08:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.797+0000 7fe3ee7fc700 1 -- 172.21.15.81:0/3869753382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e000b860 con 0x7fe3f01578d0 2023-10-07T08:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.797+0000 7fe3ee7fc700 1 -- 172.21.15.81:0/3869753382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e000bc00 con 0x7fe3f01578d0 2023-10-07T08:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.798+0000 7fe3f52e5700 1 -- 172.21.15.81:0/3869753382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f01578d0 msgr2=0x7fe3f00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.798+0000 7fe3f52e5700 1 --2- 172.21.15.81:0/3869753382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f01578d0 0x7fe3f00cf4f0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0068510 tx=0x7fe3e0009250 comp rx=0 tx=0).stop 2023-10-07T08:52:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.798+0000 7fe3f52e5700 1 -- 172.21.15.81:0/3869753382 shutdown_connections 2023-10-07T08:52:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.798+0000 7fe3f52e5700 1 --2- 172.21.15.81:0/3869753382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f01578d0 0x7fe3f00cf4f0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.798+0000 7fe3f52e5700 1 --2- 172.21.15.81:0/3869753382 >> v2:172.21.15.89:3300/0 conn(0x7fe3f0157ca0 0x7fe3f015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.798+0000 7fe3f52e5700 1 -- 172.21.15.81:0/3869753382 >> 172.21.15.81:0/3869753382 conn(0x7fe3f006bb90 msgr2=0x7fe3f006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.798+0000 7fe3f52e5700 1 -- 172.21.15.81:0/3869753382 shutdown_connections 2023-10-07T08:52:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.798+0000 7fe3f52e5700 1 -- 172.21.15.81:0/3869753382 wait complete. 2023-10-07T08:52:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.799+0000 7fe3f52e5700 1 Processor -- start 2023-10-07T08:52:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.799+0000 7fe3f52e5700 1 -- start start 2023-10-07T08:52:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3f52e5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3f006d120 0x7fe3f01539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3f52e5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f01578d0 0x7fe3f00c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3f52e5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3f0157ca0 0x7fe3f0069b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3f52e5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f016a1c0 con 0x7fe3f01578d0 2023-10-07T08:52:29.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3f52e5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f00c6400 con 0x7fe3f0157ca0 2023-10-07T08:52:29.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3f52e5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f00c66e0 con 0x7fe3f006d120 2023-10-07T08:52:29.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3e7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f01578d0 0x7fe3f00c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3e7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f01578d0 0x7fe3f00c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35866/0 (socket says 172.21.15.81:35866) 2023-10-07T08:52:29.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3e7fff700 1 -- 172.21.15.81:0/3671705164 learned_addr learned my addr 172.21.15.81:0/3671705164 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:29.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3eeffd700 1 --2- 172.21.15.81:0/3671705164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3f006d120 0x7fe3f01539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3ef7fe700 1 --2- 172.21.15.81:0/3671705164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3f0157ca0 0x7fe3f0069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3e7fff700 1 -- 172.21.15.81:0/3671705164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3f006d120 msgr2=0x7fe3f01539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:29.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3e7fff700 1 --2- 172.21.15.81:0/3671705164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3f006d120 0x7fe3f01539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3e7fff700 1 -- 172.21.15.81:0/3671705164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3f0157ca0 msgr2=0x7fe3f0069b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:29.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3e7fff700 1 --2- 172.21.15.81:0/3671705164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3f0157ca0 0x7fe3f0069b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:29.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3e7fff700 1 -- 172.21.15.81:0/3671705164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e00094f0 con 0x7fe3f01578d0 2023-10-07T08:52:29.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3ef7fe700 1 --2- 172.21.15.81:0/3671705164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3f0157ca0 0x7fe3f0069b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:29.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3e7fff700 1 --2- 172.21.15.81:0/3671705164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f01578d0 0x7fe3f00c5b20 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800e900 tx=0x7fe3d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:29.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3e6ffd700 1 -- 172.21.15.81:0/3671705164 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8013680 con 0x7fe3f01578d0 2023-10-07T08:52:29.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3e6ffd700 1 -- 172.21.15.81:0/3671705164 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d8013800 con 0x7fe3f01578d0 2023-10-07T08:52:29.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3f52e5700 1 -- 172.21.15.81:0/3671705164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f00c69c0 con 0x7fe3f01578d0 2023-10-07T08:52:29.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3e6ffd700 1 -- 172.21.15.81:0/3671705164 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8013bc0 con 0x7fe3f01578d0 2023-10-07T08:52:29.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.800+0000 7fe3f52e5700 1 -- 172.21.15.81:0/3671705164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f0153ef0 con 0x7fe3f01578d0 2023-10-07T08:52:29.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.801+0000 7fe3f52e5700 1 -- 172.21.15.81:0/3671705164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f016a370 con 0x7fe3f01578d0 2023-10-07T08:52:29.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.802+0000 7fe3e6ffd700 1 -- 172.21.15.81:0/3671705164 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3d800c460 con 0x7fe3f01578d0 2023-10-07T08:52:29.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.802+0000 7fe3e6ffd700 1 --2- 172.21.15.81:0/3671705164 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe3d0066f30 0x7fe3d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.802+0000 7fe3e6ffd700 1 -- 172.21.15.81:0/3671705164 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3d80846e0 con 0x7fe3f01578d0 2023-10-07T08:52:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.802+0000 7fe3eeffd700 1 --2- 172.21.15.81:0/3671705164 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe3d0066f30 0x7fe3d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.802+0000 7fe3eeffd700 1 --2- 172.21.15.81:0/3671705164 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe3d0066f30 0x7fe3d00693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0068510 tx=0x7fe3e0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:29.806+0000 7fe3e6ffd700 1 -- 172.21.15.81:0/3671705164 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3f016a370 con 0x7fe3f01578d0 2023-10-07T08:52:30.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.031+0000 7fe3f52e5700 1 -- 172.21.15.81:0/3671705164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe3f016a300 con 0x7fe3f01578d0 2023-10-07T08:52:30.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.032+0000 7fe3e6ffd700 1 -- 172.21.15.81:0/3671705164 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v82) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe3d8051950 con 0x7fe3f01578d0 2023-10-07T08:52:30.033 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:52:30.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.034+0000 7fe3f52e5700 1 -- 172.21.15.81:0/3671705164 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe3d0066f30 msgr2=0x7fe3d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:30.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.034+0000 7fe3f52e5700 1 --2- 172.21.15.81:0/3671705164 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe3d0066f30 0x7fe3d00693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0068510 tx=0x7fe3e0017000 comp rx=0 tx=0).stop 2023-10-07T08:52:30.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.034+0000 7fe3f52e5700 1 -- 172.21.15.81:0/3671705164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f01578d0 msgr2=0x7fe3f00c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:30.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.034+0000 7fe3f52e5700 1 --2- 172.21.15.81:0/3671705164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f01578d0 0x7fe3f00c5b20 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800e900 tx=0x7fe3d80091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:30.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.034+0000 7fe3f52e5700 1 -- 172.21.15.81:0/3671705164 shutdown_connections 2023-10-07T08:52:30.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.034+0000 7fe3f52e5700 1 --2- 172.21.15.81:0/3671705164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3f0157ca0 0x7fe3f0069b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:30.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.034+0000 7fe3f52e5700 1 --2- 172.21.15.81:0/3671705164 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe3d0066f30 0x7fe3d00693e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:30.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.034+0000 7fe3f52e5700 1 --2- 172.21.15.81:0/3671705164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3f006d120 0x7fe3f01539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:30.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.034+0000 7fe3f52e5700 1 --2- 172.21.15.81:0/3671705164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f01578d0 0x7fe3f00c5b20 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:30.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.034+0000 7fe3f52e5700 1 -- 172.21.15.81:0/3671705164 >> 172.21.15.81:0/3671705164 conn(0x7fe3f006bb90 msgr2=0x7fe3f0154820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:30.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.034+0000 7fe3f52e5700 1 -- 172.21.15.81:0/3671705164 shutdown_connections 2023-10-07T08:52:30.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.034+0000 7fe3f52e5700 1 -- 172.21.15.81:0/3671705164 wait complete. 2023-10-07T08:52:30.047 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:52:30.048 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:52:30.048 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-07T08:52:30.048 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T08:52:30.048 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T08:52:30.048 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:52:30.048 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:52:30.048 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:52:30.048 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:52:30.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:52:30.049 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-07T08:52:30.063 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:52:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:52:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:52:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:52:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-07T08:52:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:52:30.064 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:52:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:52:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-07T08:52:30.064 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:52:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:52:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-07T08:52:30.065 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:52:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:52:30.065 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:52:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:52:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:52:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 41978sec preferred_lft 41978sec 2023-10-07T08:52:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-10-07T08:52:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:52:30.065 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:52:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff 2023-10-07T08:52:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:52:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:52:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::8c72:9ff:fe74:8c7e/64 scope link 2023-10-07T08:52:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:52:30.066 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:52:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:fe:81:9d:9c:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T08:52:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8fe:81ff:fe9d:9c0a/64 scope link 2023-10-07T08:52:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:52:30.066 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:52:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T08:52:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d838:b7ff:fe6e:914d/64 scope link 2023-10-07T08:52:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:52:30.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:52:30.067 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:52:30.127 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-07T08:52:30.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:52:30.129 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-07T08:52:30.184 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-07T08:52:30.185 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:52:30.185 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:52:30.185 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:52:30.185 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:52:30.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:52:30.185 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:52:30.185 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:52:30.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:52:30.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:52:30.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:52:30.186 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:52:30.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:52:30.284 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-07T08:52:30.299 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T08:52:30.299 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T08:52:30.299 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:52:30.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:52:30.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-07T08:52:30.363 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:52:30.364 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T08:52:30.419 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:52:30.419 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:52:30.419 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:52:30.473 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:52:30.474 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:52:30.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:52:30.554 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:52:30.554 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:52:30.555 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:52:30.563 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:52:30.563 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:52:30.563 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:52:30.563 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:52:30.563 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:52:30.584 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:52:30.584 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:52:30.585 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:52:30.585 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:52:30.585 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:52:30.585 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:52:30.585 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:52:30.585 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:52:30.586 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:52:30.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:52:30.587 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:52:30.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:52:30.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.806+0000 7f082f94f700 1 Processor -- start 2023-10-07T08:52:30.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.806+0000 7f082f94f700 1 -- start start 2023-10-07T08:52:30.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.807+0000 7f082f94f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f082806dd60 0x7f08280b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:30.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.807+0000 7f082f94f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08280b0ca0 con 0x7f082815a2a0 2023-10-07T08:52:30.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.807+0000 7f082f94f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08280b00d0 con 0x7f08280cf240 2023-10-07T08:52:30.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.807+0000 7f082f94f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f082806ea90 con 0x7f082806dd60 2023-10-07T08:52:30.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.807+0000 7f082d6eb700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f082815a2a0 0x7f08280ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50476/0 (socket says 172.21.15.81:50476) 2023-10-07T08:52:30.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.807+0000 7f082d6eb700 1 -- 172.21.15.81:0/495224151 learned_addr learned my addr 172.21.15.81:0/495224151 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:30.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.807+0000 7f082deec700 1 --2- 172.21.15.81:0/495224151 >> v2:172.21.15.89:3300/0 conn(0x7f082806dd60 0x7f08280b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:30.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 -- 172.21.15.81:0/495224151 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125026995 0 0) 0x7f08280b0ca0 con 0x7f082815a2a0 2023-10-07T08:52:30.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 -- 172.21.15.81:0/495224151 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0814003570 con 0x7f082815a2a0 2023-10-07T08:52:30.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 -- 172.21.15.81:0/495224151 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541537631 0 0) 0x7f08280b00d0 con 0x7f08280cf240 2023-10-07T08:52:30.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 -- 172.21.15.81:0/495224151 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08280b0ca0 con 0x7f08280cf240 2023-10-07T08:52:30.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 -- 172.21.15.81:0/495224151 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 308192870 0 0) 0x7f0814003570 con 0x7f082815a2a0 2023-10-07T08:52:30.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 -- 172.21.15.81:0/495224151 >> v2:172.21.15.89:3300/0 conn(0x7f082806dd60 msgr2=0x7f08280b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:30.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 --2- 172.21.15.81:0/495224151 >> v2:172.21.15.89:3300/0 conn(0x7f082806dd60 0x7f08280b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:30.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 -- 172.21.15.81:0/495224151 >> v1:172.21.15.89:6789/0 conn(0x7f08280cf240 legacy=0x7f082806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:30.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 -- 172.21.15.81:0/495224151 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08280b0370 con 0x7f082815a2a0 2023-10-07T08:52:30.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 -- 172.21.15.81:0/495224151 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f08240017f0 con 0x7f082815a2a0 2023-10-07T08:52:30.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 -- 172.21.15.81:0/495224151 >> v1:172.21.15.81:6789/0 conn(0x7f082815a2a0 legacy=0x7f08280ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:30.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 --2- 172.21.15.81:0/495224151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0814003bf0 0x7f0814003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:30.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 --2- 172.21.15.81:0/495224151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0814004810 0x7f0814004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:30.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 --2- 172.21.15.81:0/495224151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08140051c0 0x7f081400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:30.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 -- 172.21.15.81:0/495224151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082806ea90 con 0x7f0814004810 2023-10-07T08:52:30.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 -- 172.21.15.81:0/495224151 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081400c0b0 con 0x7f08140051c0 2023-10-07T08:52:30.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f081ffff700 1 -- 172.21.15.81:0/495224151 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081400c270 con 0x7f0814003bf0 2023-10-07T08:52:30.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f082ceea700 1 --2- 172.21.15.81:0/495224151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0814004810 0x7f0814004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:30.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f082d6eb700 1 --2- 172.21.15.81:0/495224151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0814003bf0 0x7f0814003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:30.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f082deec700 1 --2- 172.21.15.81:0/495224151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08140051c0 0x7f081400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:30.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f082ceea700 1 -- 172.21.15.81:0/495224151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0814003bf0 msgr2=0x7f0814003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:30.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f082ceea700 1 --2- 172.21.15.81:0/495224151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0814003bf0 0x7f0814003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:30.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f082ceea700 1 -- 172.21.15.81:0/495224151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08140051c0 msgr2=0x7f081400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:30.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f082ceea700 1 --2- 172.21.15.81:0/495224151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08140051c0 0x7f081400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:30.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f082deec700 1 -- 172.21.15.81:0/495224151 reap_dead start 2023-10-07T08:52:30.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f082ceea700 1 -- 172.21.15.81:0/495224151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0814003570 con 0x7f0814004810 2023-10-07T08:52:30.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.808+0000 7f082ceea700 1 --2- 172.21.15.81:0/495224151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0814004810 0x7f0814004c80 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f082806f960 tx=0x7f0818007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7286b2c80897904 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:30.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.809+0000 7f081ffff700 1 -- 172.21.15.81:0/495224151 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081800c590 con 0x7f0814004810 2023-10-07T08:52:30.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.809+0000 7f081ffff700 1 -- 172.21.15.81:0/495224151 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081800c6f0 con 0x7f0814004810 2023-10-07T08:52:30.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.809+0000 7f081ffff700 1 -- 172.21.15.81:0/495224151 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081800c880 con 0x7f0814004810 2023-10-07T08:52:30.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.809+0000 7f082f94f700 1 -- 172.21.15.81:0/495224151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0814004810 msgr2=0x7f0814004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:30.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.809+0000 7f082f94f700 1 --2- 172.21.15.81:0/495224151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0814004810 0x7f0814004c80 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f082806f960 tx=0x7f0818007d30 comp rx=0 tx=0).stop 2023-10-07T08:52:30.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.809+0000 7f082f94f700 1 -- 172.21.15.81:0/495224151 shutdown_connections 2023-10-07T08:52:30.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.809+0000 7f082f94f700 1 --2- 172.21.15.81:0/495224151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0814004810 0x7f0814004c80 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:30.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.809+0000 7f082f94f700 1 -- 172.21.15.81:0/495224151 >> 172.21.15.81:0/495224151 conn(0x7f0828067640 msgr2=0x7f0828067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:30.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.809+0000 7f082f94f700 1 -- 172.21.15.81:0/495224151 shutdown_connections 2023-10-07T08:52:30.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.809+0000 7f082f94f700 1 -- 172.21.15.81:0/495224151 wait complete. 2023-10-07T08:52:30.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.810+0000 7f082f94f700 1 Processor -- start 2023-10-07T08:52:30.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.810+0000 7f082f94f700 1 -- start start 2023-10-07T08:52:30.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.811+0000 7f082f94f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0814004810 0x7f0828154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:30.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.811+0000 7f082f94f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0828160160 0x7f082815ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:30.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.811+0000 7f082f94f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082815f2b0 0x7f08280c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:30.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.811+0000 7f082f94f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082815e8e0 con 0x7f082815f2b0 2023-10-07T08:52:30.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.811+0000 7f082f94f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082815dcd0 con 0x7f0814004810 2023-10-07T08:52:30.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.811+0000 7f082f94f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082815dfb0 con 0x7f0828160160 2023-10-07T08:52:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.811+0000 7f082deec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082815f2b0 0x7f08280c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.811+0000 7f082deec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082815f2b0 0x7f08280c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35884/0 (socket says 172.21.15.81:35884) 2023-10-07T08:52:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.811+0000 7f082deec700 1 -- 172.21.15.81:0/1377578235 learned_addr learned my addr 172.21.15.81:0/1377578235 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.812+0000 7f082d6eb700 1 --2- 172.21.15.81:0/1377578235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0814004810 0x7f0828154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.812+0000 7f082ceea700 1 --2- 172.21.15.81:0/1377578235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0828160160 0x7f082815ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.812+0000 7f082deec700 1 -- 172.21.15.81:0/1377578235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0828160160 msgr2=0x7f082815ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.812+0000 7f082deec700 1 --2- 172.21.15.81:0/1377578235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0828160160 0x7f082815ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.812+0000 7f082deec700 1 -- 172.21.15.81:0/1377578235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0814004810 msgr2=0x7f0828154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.812+0000 7f082deec700 1 --2- 172.21.15.81:0/1377578235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0814004810 0x7f0828154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.812+0000 7f082deec700 1 -- 172.21.15.81:0/1377578235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082815e290 con 0x7f082815f2b0 2023-10-07T08:52:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.812+0000 7f082d6eb700 1 --2- 172.21.15.81:0/1377578235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0814004810 0x7f0828154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:30.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.812+0000 7f082ceea700 1 --2- 172.21.15.81:0/1377578235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0828160160 0x7f082815ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:52:30.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.812+0000 7f082deec700 1 --2- 172.21.15.81:0/1377578235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082815f2b0 0x7f08280c7d50 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f082806ab90 tx=0x7f08200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:30.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.812+0000 7f081d7fa700 1 -- 172.21.15.81:0/1377578235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082000f910 con 0x7f082815f2b0 2023-10-07T08:52:30.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.812+0000 7f081d7fa700 1 -- 172.21.15.81:0/1377578235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082000fa70 con 0x7f082815f2b0 2023-10-07T08:52:30.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.812+0000 7f082f94f700 1 -- 172.21.15.81:0/1377578235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082815e570 con 0x7f082815f2b0 2023-10-07T08:52:30.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.812+0000 7f081d7fa700 1 -- 172.21.15.81:0/1377578235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082000fe10 con 0x7f082815f2b0 2023-10-07T08:52:30.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.812+0000 7f082f94f700 1 -- 172.21.15.81:0/1377578235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0828154d50 con 0x7f082815f2b0 2023-10-07T08:52:30.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.813+0000 7f082f94f700 1 -- 172.21.15.81:0/1377578235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082815ea50 con 0x7f082815f2b0 2023-10-07T08:52:30.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.813+0000 7f081d7fa700 1 -- 172.21.15.81:0/1377578235 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0820014650 con 0x7f082815f2b0 2023-10-07T08:52:30.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.814+0000 7f081d7fa700 1 --2- 172.21.15.81:0/1377578235 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f080c066f60 0x7f080c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:30.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.814+0000 7f081d7fa700 1 -- 172.21.15.81:0/1377578235 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0820084b00 con 0x7f082815f2b0 2023-10-07T08:52:30.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.814+0000 7f082d6eb700 1 --2- 172.21.15.81:0/1377578235 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f080c066f60 0x7f080c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:30.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.814+0000 7f082d6eb700 1 --2- 172.21.15.81:0/1377578235 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f080c066f60 0x7f080c069410 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0824001920 tx=0x7f0824006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:30.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:30.818+0000 7f081d7fa700 1 -- 172.21.15.81:0/1377578235 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0820051df0 con 0x7f082815f2b0 2023-10-07T08:52:31.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.044+0000 7f082f94f700 1 -- 172.21.15.81:0/1377578235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f08280ae200 con 0x7f082815f2b0 2023-10-07T08:52:31.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.044+0000 7f081d7fa700 1 -- 172.21.15.81:0/1377578235 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v82) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0820022020 con 0x7f082815f2b0 2023-10-07T08:52:31.045 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:52:31.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.046+0000 7f082f94f700 1 -- 172.21.15.81:0/1377578235 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f080c066f60 msgr2=0x7f080c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:31.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.046+0000 7f082f94f700 1 --2- 172.21.15.81:0/1377578235 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f080c066f60 0x7f080c069410 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0824001920 tx=0x7f0824006040 comp rx=0 tx=0).stop 2023-10-07T08:52:31.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.046+0000 7f082f94f700 1 -- 172.21.15.81:0/1377578235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082815f2b0 msgr2=0x7f08280c7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:31.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.046+0000 7f082f94f700 1 --2- 172.21.15.81:0/1377578235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082815f2b0 0x7f08280c7d50 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f082806ab90 tx=0x7f08200091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:31.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.046+0000 7f082f94f700 1 -- 172.21.15.81:0/1377578235 shutdown_connections 2023-10-07T08:52:31.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.046+0000 7f082f94f700 1 --2- 172.21.15.81:0/1377578235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082815f2b0 0x7f08280c7d50 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:31.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.046+0000 7f082f94f700 1 --2- 172.21.15.81:0/1377578235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0814004810 0x7f0828154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:31.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.046+0000 7f082f94f700 1 --2- 172.21.15.81:0/1377578235 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f080c066f60 0x7f080c069410 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:31.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.046+0000 7f082f94f700 1 --2- 172.21.15.81:0/1377578235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0828160160 0x7f082815ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:31.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.046+0000 7f082f94f700 1 -- 172.21.15.81:0/1377578235 >> 172.21.15.81:0/1377578235 conn(0x7f0828067640 msgr2=0x7f08280ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:31.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.046+0000 7f082f94f700 1 -- 172.21.15.81:0/1377578235 shutdown_connections 2023-10-07T08:52:31.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.046+0000 7f082f94f700 1 -- 172.21.15.81:0/1377578235 wait complete. 2023-10-07T08:52:31.059 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:52:31.059 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:52:31.059 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-07T08:52:31.059 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T08:52:31.059 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T08:52:31.059 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:52:31.059 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:52:31.059 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:52:31.059 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:52:31.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:52:31.060 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-07T08:52:31.079 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:52:31.079 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:52:31.079 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:52:31.079 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:52:31.079 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-07T08:52:31.079 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:52:31.080 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:52:31.080 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:52:31.080 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-10-07T08:52:31.080 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:52:31.080 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:52:31.080 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-10-07T08:52:31.080 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:52:31.080 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:52:31.080 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:52:31.080 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:52:31.081 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:52:31.081 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 41977sec preferred_lft 41977sec 2023-10-07T08:52:31.081 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2023-10-07T08:52:31.081 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:52:31.081 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:52:31.081 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:52:31.081 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:52:31.081 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:52:31.081 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::74d7:a9ff:fe87:ed9/64 scope link 2023-10-07T08:52:31.081 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:52:31.082 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:52:31.082 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T08:52:31.082 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6c40:c5ff:fe3a:a57/64 scope link 2023-10-07T08:52:31.082 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:52:31.082 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:52:31.082 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether de:db:cd:68:b1:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T08:52:31.082 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::dcdb:cdff:fe68:b178/64 scope link 2023-10-07T08:52:31.082 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:52:31.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:52:31.083 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:52:31.147 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-07T08:52:31.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:52:31.148 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-07T08:52:31.207 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-07T08:52:31.208 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:52:31.208 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:52:31.208 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:52:31.208 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:52:31.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:52:31.208 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:52:31.209 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:52:31.209 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:52:31.209 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:52:31.209 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:52:31.209 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:52:31.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:52:31.313 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-07T08:52:31.329 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T08:52:31.329 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T08:52:31.329 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:52:31.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:52:31.329 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-07T08:52:31.394 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:52:31.395 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T08:52:31.449 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:52:31.449 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:52:31.450 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:52:31.503 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:52:31.504 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:52:31.504 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:52:31.583 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:52:31.583 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:52:31.583 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:52:31.591 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:52:31.592 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:52:31.592 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:52:31.592 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:52:31.592 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:52:31.613 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:52:31.613 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:52:31.613 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:52:31.613 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:52:31.613 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:52:31.613 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:52:31.613 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:52:31.613 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:52:31.615 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:52:31.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:52:31.615 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:52:31.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:52:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.797+0000 7f89cf32b700 1 Processor -- start 2023-10-07T08:52:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.797+0000 7f89cf32b700 1 -- start start 2023-10-07T08:52:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.798+0000 7f89cf32b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89c80ce1f0 0x7f89c80aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.798+0000 7f89cf32b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89c80ac570 0x7f89c806e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.798+0000 7f89cf32b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c815dfb0 con 0x7f89c80ce5c0 2023-10-07T08:52:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.798+0000 7f89cf32b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c80acec0 con 0x7f89c80ce1f0 2023-10-07T08:52:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.798+0000 7f89cf32b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c80ad1a0 con 0x7f89c80ac570 2023-10-07T08:52:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.798+0000 7f89cd0c7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89c80ce1f0 0x7f89c80aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.798+0000 7f89cd0c7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89c80ce1f0 0x7f89c80aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35892/0 (socket says 172.21.15.81:35892) 2023-10-07T08:52:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.798+0000 7f89cd0c7700 1 -- 172.21.15.81:0/4157373493 learned_addr learned my addr 172.21.15.81:0/4157373493 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.799+0000 7f89cd8c8700 1 --2- 172.21.15.81:0/4157373493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89c80ac570 0x7f89c806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.799+0000 7f89cd0c7700 1 -- 172.21.15.81:0/4157373493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89c80ac570 msgr2=0x7f89c806e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.799+0000 7f89cd0c7700 1 --2- 172.21.15.81:0/4157373493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89c80ac570 0x7f89c806e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.799+0000 7f89cd0c7700 1 -- 172.21.15.81:0/4157373493 >> v1:172.21.15.89:6789/0 conn(0x7f89c80ce5c0 legacy=0x7f89c815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.799+0000 7f89cd0c7700 1 -- 172.21.15.81:0/4157373493 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c815dc40 con 0x7f89c80ce1f0 2023-10-07T08:52:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.799+0000 7f89cd8c8700 1 --2- 172.21.15.81:0/4157373493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89c80ac570 0x7f89c806e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:52:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.799+0000 7f89cd0c7700 1 --2- 172.21.15.81:0/4157373493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c80ce1f0 0x7f89c80aacf0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f89c40099b0 tx=0x7f89c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8110c7b4e6953f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.799+0000 7f89bffff700 1 -- 172.21.15.81:0/4157373493 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c400b860 con 0x7f89c80ce1f0 2023-10-07T08:52:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.799+0000 7f89bffff700 1 -- 172.21.15.81:0/4157373493 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c400b9c0 con 0x7f89c80ce1f0 2023-10-07T08:52:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.799+0000 7f89bffff700 1 -- 172.21.15.81:0/4157373493 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c400bd60 con 0x7f89c80ce1f0 2023-10-07T08:52:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.800+0000 7f89cf32b700 1 -- 172.21.15.81:0/4157373493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c80ce1f0 msgr2=0x7f89c80aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:31.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.800+0000 7f89cf32b700 1 --2- 172.21.15.81:0/4157373493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c80ce1f0 0x7f89c80aacf0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f89c40099b0 tx=0x7f89c4009250 comp rx=0 tx=0).stop 2023-10-07T08:52:31.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.800+0000 7f89cf32b700 1 -- 172.21.15.81:0/4157373493 shutdown_connections 2023-10-07T08:52:31.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.800+0000 7f89cf32b700 1 --2- 172.21.15.81:0/4157373493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89c80ac570 0x7f89c806e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:31.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.800+0000 7f89cf32b700 1 --2- 172.21.15.81:0/4157373493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c80ce1f0 0x7f89c80aacf0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:31.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.800+0000 7f89cf32b700 1 -- 172.21.15.81:0/4157373493 >> 172.21.15.81:0/4157373493 conn(0x7f89c806cca0 msgr2=0x7f89c806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:31.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.800+0000 7f89cf32b700 1 -- 172.21.15.81:0/4157373493 shutdown_connections 2023-10-07T08:52:31.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.800+0000 7f89cf32b700 1 -- 172.21.15.81:0/4157373493 wait complete. 2023-10-07T08:52:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.801+0000 7f89cf32b700 1 Processor -- start 2023-10-07T08:52:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.801+0000 7f89cf32b700 1 -- start start 2023-10-07T08:52:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cf32b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c80ac570 0x7f89c815c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cf32b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89c80ce1f0 0x7f89c8155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cf32b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89c80ce5c0 0x7f89c81591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cf32b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c815cb90 con 0x7f89c80ac570 2023-10-07T08:52:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cf32b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c815d3a0 con 0x7f89c80ce1f0 2023-10-07T08:52:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cf32b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c815cde0 con 0x7f89c80ce5c0 2023-10-07T08:52:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cd0c7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c80ac570 0x7f89c815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cd0c7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c80ac570 0x7f89c815c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35898/0 (socket says 172.21.15.81:35898) 2023-10-07T08:52:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cc8c6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89c80ce1f0 0x7f89c8155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cd0c7700 1 -- 172.21.15.81:0/1376396214 learned_addr learned my addr 172.21.15.81:0/1376396214 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cd8c8700 1 --2- 172.21.15.81:0/1376396214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89c80ce5c0 0x7f89c81591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cd0c7700 1 -- 172.21.15.81:0/1376396214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89c80ce5c0 msgr2=0x7f89c81591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cd0c7700 1 --2- 172.21.15.81:0/1376396214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89c80ce5c0 0x7f89c81591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cd0c7700 1 -- 172.21.15.81:0/1376396214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89c80ce1f0 msgr2=0x7f89c8155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cd0c7700 1 --2- 172.21.15.81:0/1376396214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89c80ce1f0 0x7f89c8155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cd0c7700 1 -- 172.21.15.81:0/1376396214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c40094f0 con 0x7f89c80ac570 2023-10-07T08:52:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cd8c8700 1 --2- 172.21.15.81:0/1376396214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89c80ce5c0 0x7f89c81591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:52:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cc8c6700 1 --2- 172.21.15.81:0/1376396214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89c80ce1f0 0x7f89c8155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:52:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cd0c7700 1 --2- 172.21.15.81:0/1376396214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c80ac570 0x7f89c815c230 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f89c4009290 tx=0x7f89c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89bd7fa700 1 -- 172.21.15.81:0/1376396214 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c4011dc0 con 0x7f89c80ac570 2023-10-07T08:52:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89bd7fa700 1 -- 172.21.15.81:0/1376396214 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c401f070 con 0x7f89c80ac570 2023-10-07T08:52:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cf32b700 1 -- 172.21.15.81:0/1376396214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c815d0c0 con 0x7f89c80ac570 2023-10-07T08:52:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89bd7fa700 1 -- 172.21.15.81:0/1376396214 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c40266d0 con 0x7f89c80ac570 2023-10-07T08:52:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.802+0000 7f89cf32b700 1 -- 172.21.15.81:0/1376396214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c815c770 con 0x7f89c80ac570 2023-10-07T08:52:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.803+0000 7f89cf32b700 1 -- 172.21.15.81:0/1376396214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c8068900 con 0x7f89c80ac570 2023-10-07T08:52:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.804+0000 7f89bd7fa700 1 -- 172.21.15.81:0/1376396214 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89c401a430 con 0x7f89c80ac570 2023-10-07T08:52:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.804+0000 7f89bd7fa700 1 --2- 172.21.15.81:0/1376396214 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89ac066f30 0x7f89ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:31.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.804+0000 7f89bd7fa700 1 -- 172.21.15.81:0/1376396214 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f89c4021070 con 0x7f89c80ac570 2023-10-07T08:52:31.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.804+0000 7f89cc8c6700 1 --2- 172.21.15.81:0/1376396214 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89ac066f30 0x7f89ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:31.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.804+0000 7f89cc8c6700 1 --2- 172.21.15.81:0/1376396214 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89ac066f30 0x7f89ac0693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f89c80cd2c0 tx=0x7f89b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:31.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:31.808+0000 7f89bd7fa700 1 -- 172.21.15.81:0/1376396214 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89c4053600 con 0x7f89c80ac570 2023-10-07T08:52:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.030+0000 7f89cf32b700 1 -- 172.21.15.81:0/1376396214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89c80aca10 con 0x7f89c80ac570 2023-10-07T08:52:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.030+0000 7f89bd7fa700 1 -- 172.21.15.81:0/1376396214 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f89c4056c20 con 0x7f89c80ac570 2023-10-07T08:52:32.032 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:52:32.032 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3709604420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3709604420},{"type":"v1","addr":"172.21.15.89:6835","nonce":3709604420}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7842,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/517568220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":517568220},{"type":"v1","addr":"172.21.15.81:6836","nonce":517568220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7845,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2183069282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2183069282},{"type":"v1","addr":"172.21.15.81:6837","nonce":2183069282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:52:23.270892+0000","modified":"2023-10-07T08:52:26.901820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7851":{"gid":7851,"name":"b","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6834/3341511949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3341511949},{"type":"v1","addr":"172.21.15.89:6834","nonce":3341511949}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-07T08:52:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.032+0000 7f89cf32b700 1 -- 172.21.15.81:0/1376396214 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89ac066f30 msgr2=0x7f89ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.032+0000 7f89cf32b700 1 --2- 172.21.15.81:0/1376396214 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89ac066f30 0x7f89ac0693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f89c80cd2c0 tx=0x7f89b8009040 comp rx=0 tx=0).stop 2023-10-07T08:52:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.032+0000 7f89cf32b700 1 -- 172.21.15.81:0/1376396214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c80ac570 msgr2=0x7f89c815c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.032+0000 7f89cf32b700 1 --2- 172.21.15.81:0/1376396214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c80ac570 0x7f89c815c230 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f89c4009290 tx=0x7f89c4017000 comp rx=0 tx=0).stop 2023-10-07T08:52:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.032+0000 7f89cf32b700 1 -- 172.21.15.81:0/1376396214 shutdown_connections 2023-10-07T08:52:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.032+0000 7f89cf32b700 1 --2- 172.21.15.81:0/1376396214 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f89ac066f30 0x7f89ac0693e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.032+0000 7f89cf32b700 1 --2- 172.21.15.81:0/1376396214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89c80ce5c0 0x7f89c81591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.032+0000 7f89cf32b700 1 --2- 172.21.15.81:0/1376396214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c80ac570 0x7f89c815c230 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.032+0000 7f89cf32b700 1 --2- 172.21.15.81:0/1376396214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89c80ce1f0 0x7f89c8155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.032+0000 7f89cf32b700 1 -- 172.21.15.81:0/1376396214 >> 172.21.15.81:0/1376396214 conn(0x7f89c806cca0 msgr2=0x7f89c81580e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.032+0000 7f89cf32b700 1 -- 172.21.15.81:0/1376396214 shutdown_connections 2023-10-07T08:52:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.032+0000 7f89cf32b700 1 -- 172.21.15.81:0/1376396214 wait complete. 2023-10-07T08:52:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 82 2023-10-07T08:52:32.046 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-07T08:52:32.179 INFO:teuthology.orchestra.run.smithi089.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":7851,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.2818158270000009,"mdsmap_epoch":82,"osdmap_epoch":173,"osdmap_epoch_barrier":173,"uptime":13.399310095000001} 2023-10-07T08:52:32.179 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 7851, "mdsmap_epoch": 82, "osdmap_epoch": 173, "osdmap_epoch_barrier": 173, "rank_uptime": 8.281815827, "state": "up:active", "uptime": 13.399310095, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:52:32.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-07T08:52:32.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.296+0000 7fcf39ad6700 1 Processor -- start 2023-10-07T08:52:32.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.296+0000 7fcf39ad6700 1 -- start start 2023-10-07T08:52:32.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.297+0000 7fcf39ad6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf340d0b80 0x7fcf340cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:32.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.297+0000 7fcf39ad6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcf340d02b0 0x7fcf3406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:32.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.297+0000 7fcf39ad6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf340cf2d0 con 0x7fcf340d0f50 2023-10-07T08:52:32.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.297+0000 7fcf39ad6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3415a690 con 0x7fcf340d02b0 2023-10-07T08:52:32.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.297+0000 7fcf39ad6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3406dc00 con 0x7fcf340d0b80 2023-10-07T08:52:32.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.297+0000 7fcf392d5700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcf340d0f50 0x7fcf3415b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50484/0 (socket says 172.21.15.81:50484) 2023-10-07T08:52:32.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.297+0000 7fcf392d5700 1 -- 172.21.15.81:0/3729128310 learned_addr learned my addr 172.21.15.81:0/3729128310 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:52:32.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.297+0000 7fcf38ad4700 1 --2- 172.21.15.81:0/3729128310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf340d0b80 0x7fcf340cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:32.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.297+0000 7fcf33fff700 1 --2- 172.21.15.81:0/3729128310 >> v2:172.21.15.89:3300/0 conn(0x7fcf340d02b0 0x7fcf3406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:32.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.297+0000 7fcf337fe700 1 -- 172.21.15.81:0/3729128310 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308784204 0 0) 0x7fcf340cf2d0 con 0x7fcf340d0f50 2023-10-07T08:52:32.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.297+0000 7fcf337fe700 1 -- 172.21.15.81:0/3729128310 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf24003570 con 0x7fcf340d0f50 2023-10-07T08:52:32.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.297+0000 7fcf33fff700 1 -- 172.21.15.81:0/3729128310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf340d0b80 msgr2=0x7fcf340cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:52:32.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.297+0000 7fcf33fff700 1 --2- 172.21.15.81:0/3729128310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf340d0b80 0x7fcf340cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:32.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.297+0000 7fcf33fff700 1 -- 172.21.15.81:0/3729128310 >> v1:172.21.15.81:6789/0 conn(0x7fcf340d0f50 legacy=0x7fcf3415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:32.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.297+0000 7fcf33fff700 1 -- 172.21.15.81:0/3729128310 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf340cf570 con 0x7fcf340d02b0 2023-10-07T08:52:32.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.297+0000 7fcf38ad4700 1 --2- 172.21.15.81:0/3729128310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf340d0b80 0x7fcf340cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:52:32.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.298+0000 7fcf33fff700 1 --2- 172.21.15.81:0/3729128310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340d02b0 0x7fcf3406cff0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcf200098e0 tx=0x7fcf200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee682e1739b6de54 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:32.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.298+0000 7fcf337fe700 1 -- 172.21.15.81:0/3729128310 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20011630 con 0x7fcf340d02b0 2023-10-07T08:52:32.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.298+0000 7fcf337fe700 1 -- 172.21.15.81:0/3729128310 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf20011790 con 0x7fcf340d02b0 2023-10-07T08:52:32.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.298+0000 7fcf337fe700 1 -- 172.21.15.81:0/3729128310 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20011b30 con 0x7fcf340d02b0 2023-10-07T08:52:32.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.298+0000 7fcf39ad6700 1 -- 172.21.15.81:0/3729128310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340d02b0 msgr2=0x7fcf3406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.298+0000 7fcf39ad6700 1 --2- 172.21.15.81:0/3729128310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340d02b0 0x7fcf3406cff0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcf200098e0 tx=0x7fcf200091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.298+0000 7fcf39ad6700 1 -- 172.21.15.81:0/3729128310 shutdown_connections 2023-10-07T08:52:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.298+0000 7fcf39ad6700 1 --2- 172.21.15.81:0/3729128310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf340d0b80 0x7fcf340cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.298+0000 7fcf39ad6700 1 --2- 172.21.15.81:0/3729128310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340d02b0 0x7fcf3406cff0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.298+0000 7fcf39ad6700 1 -- 172.21.15.81:0/3729128310 >> 172.21.15.81:0/3729128310 conn(0x7fcf34063230 msgr2=0x7fcf34063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.298+0000 7fcf39ad6700 1 -- 172.21.15.81:0/3729128310 shutdown_connections 2023-10-07T08:52:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.298+0000 7fcf39ad6700 1 -- 172.21.15.81:0/3729128310 wait complete. 2023-10-07T08:52:32.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.299+0000 7fcf39ad6700 1 Processor -- start 2023-10-07T08:52:32.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.300+0000 7fcf39ad6700 1 -- start start 2023-10-07T08:52:32.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.300+0000 7fcf39ad6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf340d02b0 0x7fcf3415ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:32.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.300+0000 7fcf39ad6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340d0b80 0x7fcf340b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:32.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.300+0000 7fcf39ad6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340d0f50 0x7fcf3414f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:32.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.300+0000 7fcf39ad6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3415d7e0 con 0x7fcf340d0b80 2023-10-07T08:52:32.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.300+0000 7fcf39ad6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3415e600 con 0x7fcf340d0f50 2023-10-07T08:52:32.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.300+0000 7fcf39ad6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3415d9f0 con 0x7fcf340d02b0 2023-10-07T08:52:32.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.300+0000 7fcf33fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340d0b80 0x7fcf340b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:32.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.300+0000 7fcf33fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340d0b80 0x7fcf340b5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35914/0 (socket says 172.21.15.81:35914) 2023-10-07T08:52:32.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.300+0000 7fcf33fff700 1 -- 172.21.15.81:0/1970002261 learned_addr learned my addr 172.21.15.81:0/1970002261 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:52:32.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.300+0000 7fcf38ad4700 1 --2- 172.21.15.81:0/1970002261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf340d02b0 0x7fcf3415ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:32.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.300+0000 7fcf392d5700 1 --2- 172.21.15.81:0/1970002261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340d0f50 0x7fcf3414f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:32.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.301+0000 7fcf33fff700 1 -- 172.21.15.81:0/1970002261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf340d02b0 msgr2=0x7fcf3415ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:32.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.301+0000 7fcf33fff700 1 --2- 172.21.15.81:0/1970002261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf340d02b0 0x7fcf3415ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:32.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.301+0000 7fcf33fff700 1 -- 172.21.15.81:0/1970002261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340d0f50 msgr2=0x7fcf3414f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:32.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.301+0000 7fcf33fff700 1 --2- 172.21.15.81:0/1970002261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340d0f50 0x7fcf3414f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:32.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.301+0000 7fcf33fff700 1 -- 172.21.15.81:0/1970002261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf28009420 con 0x7fcf340d0b80 2023-10-07T08:52:32.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.301+0000 7fcf38ad4700 1 --2- 172.21.15.81:0/1970002261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf340d02b0 0x7fcf3415ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:52:32.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.301+0000 7fcf33fff700 1 --2- 172.21.15.81:0/1970002261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340d0b80 0x7fcf340b5ac0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fcf3406fcc0 tx=0x7fcf20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:32.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.301+0000 7fcf30ff9700 1 -- 172.21.15.81:0/1970002261 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20000d10 con 0x7fcf340d0b80 2023-10-07T08:52:32.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.301+0000 7fcf30ff9700 1 -- 172.21.15.81:0/1970002261 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf20011b10 con 0x7fcf340d0b80 2023-10-07T08:52:32.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.301+0000 7fcf39ad6700 1 -- 172.21.15.81:0/1970002261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf20009420 con 0x7fcf340d0b80 2023-10-07T08:52:32.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.301+0000 7fcf30ff9700 1 -- 172.21.15.81:0/1970002261 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20025660 con 0x7fcf340d0b80 2023-10-07T08:52:32.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.301+0000 7fcf39ad6700 1 -- 172.21.15.81:0/1970002261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3415dfb0 con 0x7fcf340d0b80 2023-10-07T08:52:32.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.302+0000 7fcf39ad6700 1 -- 172.21.15.81:0/1970002261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3415e790 con 0x7fcf340d0b80 2023-10-07T08:52:32.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.302+0000 7fcf30ff9700 1 -- 172.21.15.81:0/1970002261 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf20025a50 con 0x7fcf340d0b80 2023-10-07T08:52:32.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.303+0000 7fcf30ff9700 1 --2- 172.21.15.81:0/1970002261 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcf18066f30 0x7fcf180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:52:32.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.303+0000 7fcf30ff9700 1 -- 172.21.15.81:0/1970002261 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf20085dc0 con 0x7fcf340d0b80 2023-10-07T08:52:32.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.303+0000 7fcf38ad4700 1 --2- 172.21.15.81:0/1970002261 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcf18066f30 0x7fcf180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:52:32.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.303+0000 7fcf38ad4700 1 --2- 172.21.15.81:0/1970002261 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcf18066f30 0x7fcf180693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcf28011580 tx=0x7fcf280091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:52:32.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.307+0000 7fcf30ff9700 1 -- 172.21.15.81:0/1970002261 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf20052f90 con 0x7fcf340d0b80 2023-10-07T08:52:32.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:32.493+0000 7fcf39ad6700 1 -- 172.21.15.81:0/1970002261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fcf340676e0 con 0x7fcf340d0b80 2023-10-07T08:52:33.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:33.340+0000 7fcf30ff9700 1 -- 172.21.15.81:0/1970002261 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v174) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcf200565b0 con 0x7fcf340d0b80 2023-10-07T08:52:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:33.342+0000 7fcf39ad6700 1 -- 172.21.15.81:0/1970002261 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcf18066f30 msgr2=0x7fcf180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:33.342+0000 7fcf39ad6700 1 --2- 172.21.15.81:0/1970002261 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcf18066f30 0x7fcf180693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcf28011580 tx=0x7fcf280091a0 comp rx=0 tx=0).stop 2023-10-07T08:52:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:33.342+0000 7fcf39ad6700 1 -- 172.21.15.81:0/1970002261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340d0b80 msgr2=0x7fcf340b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:52:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:33.342+0000 7fcf39ad6700 1 --2- 172.21.15.81:0/1970002261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340d0b80 0x7fcf340b5ac0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fcf3406fcc0 tx=0x7fcf20017000 comp rx=0 tx=0).stop 2023-10-07T08:52:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:33.342+0000 7fcf39ad6700 1 -- 172.21.15.81:0/1970002261 shutdown_connections 2023-10-07T08:52:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:33.342+0000 7fcf39ad6700 1 --2- 172.21.15.81:0/1970002261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340d0f50 0x7fcf3414f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:33.342+0000 7fcf39ad6700 1 --2- 172.21.15.81:0/1970002261 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fcf18066f30 0x7fcf180693e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:33.342+0000 7fcf39ad6700 1 --2- 172.21.15.81:0/1970002261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf340d02b0 0x7fcf3415ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:33.343+0000 7fcf39ad6700 1 --2- 172.21.15.81:0/1970002261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf340d0b80 0x7fcf340b5ac0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:52:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:33.343+0000 7fcf39ad6700 1 -- 172.21.15.81:0/1970002261 >> 172.21.15.81:0/1970002261 conn(0x7fcf34063230 msgr2=0x7fcf3414e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:52:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:33.343+0000 7fcf39ad6700 1 -- 172.21.15.81:0/1970002261 shutdown_connections 2023-10-07T08:52:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:52:33.343+0000 7fcf39ad6700 1 -- 172.21.15.81:0/1970002261 wait complete. 2023-10-07T08:52:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-07T08:52:33.358 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-07T08:52:33.488 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_mon_report_interval":"5"} 2023-10-07T08:52:33.488 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-07T08:52:33.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-07T08:52:33.613 INFO:teuthology.orchestra.run.smithi081.stdout:{"mon_tick_interval":"5"} 2023-10-07T08:52:33.613 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-07T08:52:33.613 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-10-07T08:52:33.614 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-07T08:52:33.614 DEBUG:teuthology.orchestra.run.smithi081:> import time 2023-10-07T08:52:33.614 DEBUG:teuthology.orchestra.run.smithi081:> import datetime 2023-10-07T08:52:33.614 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-10-07T08:52:33.614 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-10-07T08:52:33.614 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:52:33.614 DEBUG:teuthology.orchestra.run.smithi081:> # Write some buffered data through before going full, all should be well 2023-10-07T08:52:33.614 DEBUG:teuthology.orchestra.run.smithi081:> print("writing some data through which we expect to succeed") 2023-10-07T08:52:33.614 DEBUG:teuthology.orchestra.run.smithi081:> bytes = 0 2023-10-07T08:52:33.614 DEBUG:teuthology.orchestra.run.smithi081:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-07T08:52:33.614 DEBUG:teuthology.orchestra.run.smithi081:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-07T08:52:33.614 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-10-07T08:52:33.615 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f) 2023-10-07T08:52:33.615 DEBUG:teuthology.orchestra.run.smithi081:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-07T08:52:33.615 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:52:33.615 DEBUG:teuthology.orchestra.run.smithi081:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-07T08:52:33.615 DEBUG:teuthology.orchestra.run.smithi081:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-07T08:52:33.615 DEBUG:teuthology.orchestra.run.smithi081:> # buffered IO, the error should always only appear from fsync and not 2023-10-07T08:52:33.615 DEBUG:teuthology.orchestra.run.smithi081:> # from write 2023-10-07T08:52:33.615 DEBUG:teuthology.orchestra.run.smithi081:> full = False 2023-10-07T08:52:33.615 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:52:33.615 DEBUG:teuthology.orchestra.run.smithi081:> for n in range(0, int(32 * 1.1)): 2023-10-07T08:52:33.615 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-07T08:52:33.615 DEBUG:teuthology.orchestra.run.smithi081:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-07T08:52:33.615 DEBUG:teuthology.orchestra.run.smithi081:> print("wrote bytes via buffered write, moving on to fsync") 2023-10-07T08:52:33.616 DEBUG:teuthology.orchestra.run.smithi081:> except OSError as e: 2023-10-07T08:52:33.616 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2023-10-07T08:52:33.616 DEBUG:teuthology.orchestra.run.smithi081:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-10-07T08:52:33.616 DEBUG:teuthology.orchestra.run.smithi081:> raise 2023-10-07T08:52:33.616 DEBUG:teuthology.orchestra.run.smithi081:> else: 2023-10-07T08:52:33.616 DEBUG:teuthology.orchestra.run.smithi081:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-07T08:52:33.616 DEBUG:teuthology.orchestra.run.smithi081:> full = True 2023-10-07T08:52:33.616 DEBUG:teuthology.orchestra.run.smithi081:> break 2023-10-07T08:52:33.616 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:52:33.616 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-10-07T08:52:33.616 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f) 2023-10-07T08:52:33.616 DEBUG:teuthology.orchestra.run.smithi081:> print("fsync'"'"'ed successfully") 2023-10-07T08:52:33.616 DEBUG:teuthology.orchestra.run.smithi081:> except OSError as e: 2023-10-07T08:52:33.617 DEBUG:teuthology.orchestra.run.smithi081:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-07T08:52:33.617 DEBUG:teuthology.orchestra.run.smithi081:> full = True 2023-10-07T08:52:33.617 DEBUG:teuthology.orchestra.run.smithi081:> break 2023-10-07T08:52:33.617 DEBUG:teuthology.orchestra.run.smithi081:> else: 2023-10-07T08:52:33.617 DEBUG:teuthology.orchestra.run.smithi081:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-07T08:52:33.617 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:52:33.617 DEBUG:teuthology.orchestra.run.smithi081:> if n > 32 * 0.9: 2023-10-07T08:52:33.617 DEBUG:teuthology.orchestra.run.smithi081:> # Be cautious in the last region where we expect to hit 2023-10-07T08:52:33.617 DEBUG:teuthology.orchestra.run.smithi081:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-10-07T08:52:33.617 DEBUG:teuthology.orchestra.run.smithi081:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-07T08:52:33.617 DEBUG:teuthology.orchestra.run.smithi081:> time.sleep(15.0) 2023-10-07T08:52:33.617 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:52:33.617 DEBUG:teuthology.orchestra.run.smithi081:> if not full: 2023-10-07T08:52:33.618 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-10-07T08:52:33.618 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:52:33.618 DEBUG:teuthology.orchestra.run.smithi081:> # close() should not raise an error because we already caught it in 2023-10-07T08:52:33.618 DEBUG:teuthology.orchestra.run.smithi081:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-10-07T08:52:33.618 DEBUG:teuthology.orchestra.run.smithi081:> # since then because all IOs got cancelled on the full flag. 2023-10-07T08:52:33.618 DEBUG:teuthology.orchestra.run.smithi081:> print("calling close") 2023-10-07T08:52:33.618 DEBUG:teuthology.orchestra.run.smithi081:> os.close(f) 2023-10-07T08:52:33.618 DEBUG:teuthology.orchestra.run.smithi081:> print("close() did not raise error") 2023-10-07T08:52:33.618 DEBUG:teuthology.orchestra.run.smithi081:> 2023-10-07T08:52:33.618 DEBUG:teuthology.orchestra.run.smithi081:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-07T08:52:33.618 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-10-07T08:52:56.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:52:56.340 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:53:26.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:53:26.410 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:53:33.935 INFO:teuthology.orchestra.run.smithi081.stdout:writing some data through which we expect to succeed 2023-10-07T08:53:33.935 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-07T08:53:33.935 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.935 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.935 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 1.00 MB 2023-10-07T08:53:33.935 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.935 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.935 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 2.00 MB 2023-10-07T08:53:33.936 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.936 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.936 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 3.00 MB 2023-10-07T08:53:33.936 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.936 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.936 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 4.00 MB 2023-10-07T08:53:33.936 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.936 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.936 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 5.00 MB 2023-10-07T08:53:33.936 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.936 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.936 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 6.00 MB 2023-10-07T08:53:33.937 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.937 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.937 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 7.00 MB 2023-10-07T08:53:33.937 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.937 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.937 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 8.00 MB 2023-10-07T08:53:33.937 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.937 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.937 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 9.00 MB 2023-10-07T08:53:33.937 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.937 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.937 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 10.00 MB 2023-10-07T08:53:33.938 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.938 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.938 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 11.00 MB 2023-10-07T08:53:33.938 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.938 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.938 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 12.00 MB 2023-10-07T08:53:33.938 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.938 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.938 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 13.00 MB 2023-10-07T08:53:33.938 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.938 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.939 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 14.00 MB 2023-10-07T08:53:33.939 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.939 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.939 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 15.00 MB 2023-10-07T08:53:33.939 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.939 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.939 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 16.00 MB 2023-10-07T08:53:33.939 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.939 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.939 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 17.00 MB 2023-10-07T08:53:33.939 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.939 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.939 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 18.00 MB 2023-10-07T08:53:33.940 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.940 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.940 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 19.00 MB 2023-10-07T08:53:33.940 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.940 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.940 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 20.00 MB 2023-10-07T08:53:33.940 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.940 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.940 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 21.00 MB 2023-10-07T08:53:33.940 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.940 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.940 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 22.00 MB 2023-10-07T08:53:33.941 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.941 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.941 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 23.00 MB 2023-10-07T08:53:33.941 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.941 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.941 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 24.00 MB 2023-10-07T08:53:33.941 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.941 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.941 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 25.00 MB 2023-10-07T08:53:33.941 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.941 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.941 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 26.00 MB 2023-10-07T08:53:33.941 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.942 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.942 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 27.00 MB 2023-10-07T08:53:33.942 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.942 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.942 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 28.00 MB 2023-10-07T08:53:33.942 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.942 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.942 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 29.00 MB 2023-10-07T08:53:33.942 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.942 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.942 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 30.00 MB 2023-10-07T08:53:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-07T08:53:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 31.00 MB 2023-10-07T08:53:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-07T08:53:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 32.00 MB 2023-10-07T08:53:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-07T08:53:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-07T08:53:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:fsync'ed successfully 2023-10-07T08:53:33.943 INFO:teuthology.orchestra.run.smithi081.stdout:Not full yet after 33.00 MB 2023-10-07T08:53:33.944 INFO:teuthology.orchestra.run.smithi081.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-07T08:53:33.944 INFO:teuthology.orchestra.run.smithi081.stdout:Reached fullness after 33.00 MB 2023-10-07T08:53:33.944 INFO:teuthology.orchestra.run.smithi081.stdout:calling close 2023-10-07T08:53:33.944 INFO:teuthology.orchestra.run.smithi081.stdout:close() did not raise error 2023-10-07T08:53:33.957 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:53:33.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:53:33.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:53:34.045 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:53:34.045 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T08:53:34.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:53:34.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T08:53:34.092 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:53:34.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:53:34.093 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T08:53:34.109 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T08:53:34.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:53:34.109 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T08:53:34.152 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:53:34.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:53:34.153 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T08:53:34.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:53:34.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.325+0000 7f768430c700 1 Processor -- start 2023-10-07T08:53:34.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.325+0000 7f768430c700 1 -- start start 2023-10-07T08:53:34.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.326+0000 7f768430c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f767c1578d0 0x7f767c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:34.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.326+0000 7f768430c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767c0d07c0 con 0x7f767c06d120 2023-10-07T08:53:34.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.326+0000 7f768430c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767c0cfbb0 con 0x7f767c157ca0 2023-10-07T08:53:34.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.326+0000 7f768430c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c0cfe90 con 0x7f767c1578d0 2023-10-07T08:53:34.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.326+0000 7f76828a9700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f767c06d120 0x7f767c15b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47624/0 (socket says 172.21.15.81:47624) 2023-10-07T08:53:34.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.326+0000 7f76828a9700 1 -- 172.21.15.81:0/4167178872 learned_addr learned my addr 172.21.15.81:0/4167178872 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:34.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.326+0000 7f76820a8700 1 --2- 172.21.15.81:0/4167178872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f767c1578d0 0x7f767c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:34.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.326+0000 7f76810a6700 1 -- 172.21.15.81:0/4167178872 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878106355 0 0) 0x7f767c0d07c0 con 0x7f767c06d120 2023-10-07T08:53:34.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.326+0000 7f76810a6700 1 -- 172.21.15.81:0/4167178872 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7668003570 con 0x7f767c06d120 2023-10-07T08:53:34.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.327+0000 7f76810a6700 1 -- 172.21.15.81:0/4167178872 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008471158 0 0) 0x7f767c0cfbb0 con 0x7f767c157ca0 2023-10-07T08:53:34.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.327+0000 7f76810a6700 1 -- 172.21.15.81:0/4167178872 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f767c0d07c0 con 0x7f767c157ca0 2023-10-07T08:53:34.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.327+0000 7f76810a6700 1 -- 172.21.15.81:0/4167178872 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3555679110 0 0) 0x7f7668003570 con 0x7f767c06d120 2023-10-07T08:53:34.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.327+0000 7f76820a8700 1 -- 172.21.15.81:0/4167178872 >> v1:172.21.15.89:6789/0 conn(0x7f767c157ca0 legacy=0x7f767c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:34.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.327+0000 7f76820a8700 1 -- 172.21.15.81:0/4167178872 >> v1:172.21.15.81:6789/0 conn(0x7f767c06d120 legacy=0x7f767c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:34.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.327+0000 7f76820a8700 1 -- 172.21.15.81:0/4167178872 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c0d0170 con 0x7f767c1578d0 2023-10-07T08:53:34.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.327+0000 7f76820a8700 1 --2- 172.21.15.81:0/4167178872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f767c1578d0 0x7f767c0cf4f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7678009e90 tx=0x7f7678009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29a588da3ee1cb08 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:34.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.327+0000 7f76810a6700 1 -- 172.21.15.81:0/4167178872 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767800e070 con 0x7f767c1578d0 2023-10-07T08:53:34.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.327+0000 7f76810a6700 1 -- 172.21.15.81:0/4167178872 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767800b870 con 0x7f767c1578d0 2023-10-07T08:53:34.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.327+0000 7f76810a6700 1 -- 172.21.15.81:0/4167178872 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674001470 con 0x7f767c1578d0 2023-10-07T08:53:34.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.327+0000 7f768430c700 1 -- 172.21.15.81:0/4167178872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f767c1578d0 msgr2=0x7f767c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:34.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.327+0000 7f768430c700 1 --2- 172.21.15.81:0/4167178872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f767c1578d0 0x7f767c0cf4f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7678009e90 tx=0x7f7678009780 comp rx=0 tx=0).stop 2023-10-07T08:53:34.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.328+0000 7f768430c700 1 -- 172.21.15.81:0/4167178872 shutdown_connections 2023-10-07T08:53:34.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.328+0000 7f768430c700 1 --2- 172.21.15.81:0/4167178872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f767c1578d0 0x7f767c0cf4f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.328+0000 7f768430c700 1 -- 172.21.15.81:0/4167178872 >> 172.21.15.81:0/4167178872 conn(0x7f767c06bb90 msgr2=0x7f767c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:34.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.328+0000 7f768430c700 1 -- 172.21.15.81:0/4167178872 shutdown_connections 2023-10-07T08:53:34.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.328+0000 7f768430c700 1 -- 172.21.15.81:0/4167178872 wait complete. 2023-10-07T08:53:34.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.329+0000 7f768430c700 1 Processor -- start 2023-10-07T08:53:34.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.329+0000 7f768430c700 1 -- start start 2023-10-07T08:53:34.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.329+0000 7f768430c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c06d120 0x7f767c0b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:34.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.329+0000 7f768430c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f767c1578d0 0x7f767c0b6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:34.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.329+0000 7f768430c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f767c157ca0 0x7f767c068a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:34.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.329+0000 7f768430c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c0b6280 con 0x7f767c06d120 2023-10-07T08:53:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.329+0000 7f768430c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c14e680 con 0x7f767c1578d0 2023-10-07T08:53:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.329+0000 7f768430c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c14e960 con 0x7f767c157ca0 2023-10-07T08:53:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.330+0000 7f76820a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c06d120 0x7f767c0b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.330+0000 7f76820a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c06d120 0x7f767c0b5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59826/0 (socket says 172.21.15.81:59826) 2023-10-07T08:53:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.330+0000 7f76820a8700 1 -- 172.21.15.81:0/2431402404 learned_addr learned my addr 172.21.15.81:0/2431402404 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.330+0000 7f76818a7700 1 --2- 172.21.15.81:0/2431402404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f767c1578d0 0x7f767c0b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.330+0000 7f76828a9700 1 --2- 172.21.15.81:0/2431402404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f767c157ca0 0x7f767c068a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.330+0000 7f76820a8700 1 -- 172.21.15.81:0/2431402404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f767c157ca0 msgr2=0x7f767c068a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.330+0000 7f76820a8700 1 --2- 172.21.15.81:0/2431402404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f767c157ca0 0x7f767c068a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.330+0000 7f76820a8700 1 -- 172.21.15.81:0/2431402404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f767c1578d0 msgr2=0x7f767c0b6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.330+0000 7f76820a8700 1 --2- 172.21.15.81:0/2431402404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f767c1578d0 0x7f767c0b6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.330+0000 7f76820a8700 1 -- 172.21.15.81:0/2431402404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7678009a20 con 0x7f767c06d120 2023-10-07T08:53:34.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.330+0000 7f76820a8700 1 --2- 172.21.15.81:0/2431402404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c06d120 0x7f767c0b5d40 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f76780097c0 tx=0x7f7678017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:34.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.330+0000 7f76727fc700 1 -- 172.21.15.81:0/2431402404 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7678001090 con 0x7f767c06d120 2023-10-07T08:53:34.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.330+0000 7f76727fc700 1 -- 172.21.15.81:0/2431402404 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7678012cd0 con 0x7f767c06d120 2023-10-07T08:53:34.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.330+0000 7f768430c700 1 -- 172.21.15.81:0/2431402404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767c14ec40 con 0x7f767c06d120 2023-10-07T08:53:34.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.330+0000 7f76727fc700 1 -- 172.21.15.81:0/2431402404 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767801e6a0 con 0x7f767c06d120 2023-10-07T08:53:34.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.330+0000 7f768430c700 1 -- 172.21.15.81:0/2431402404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767c0b3ba0 con 0x7f767c06d120 2023-10-07T08:53:34.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.331+0000 7f768430c700 1 -- 172.21.15.81:0/2431402404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767c067ac0 con 0x7f767c06d120 2023-10-07T08:53:34.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.331+0000 7f76727fc700 1 -- 172.21.15.81:0/2431402404 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f767801ea90 con 0x7f767c06d120 2023-10-07T08:53:34.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.332+0000 7f76727fc700 1 --2- 172.21.15.81:0/2431402404 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7660066f30 0x7f76600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:34.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.332+0000 7f76818a7700 1 --2- 172.21.15.81:0/2431402404 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7660066f30 0x7f76600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:34.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.332+0000 7f76727fc700 1 -- 172.21.15.81:0/2431402404 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f76780868c0 con 0x7f767c06d120 2023-10-07T08:53:34.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.332+0000 7f76727fc700 1 -- 172.21.15.81:0/2431402404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7f766006eab0 con 0x7f767c06d120 2023-10-07T08:53:34.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.332+0000 7f76818a7700 1 --2- 172.21.15.81:0/2431402404 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7660066f30 0x7f76600693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f767c1598c0 tx=0x7f766c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:34.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.336+0000 7f76727fc700 1 -- 172.21.15.81:0/2431402404 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7678016060 con 0x7f767c06d120 2023-10-07T08:53:34.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.562+0000 7f768430c700 1 -- 172.21.15.81:0/2431402404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f767c0d0450 con 0x7f767c06d120 2023-10-07T08:53:34.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.562+0000 7f76727fc700 1 -- 172.21.15.81:0/2431402404 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f767802b030 con 0x7f767c06d120 2023-10-07T08:53:34.564 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:34.564 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3709604420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3709604420},{"type":"v1","addr":"172.21.15.89:6835","nonce":3709604420}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7842,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/517568220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":517568220},{"type":"v1","addr":"172.21.15.81:6836","nonce":517568220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7845,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2183069282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2183069282},{"type":"v1","addr":"172.21.15.81:6837","nonce":2183069282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:52:23.270892+0000","modified":"2023-10-07T08:52:26.901820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7851":{"gid":7851,"name":"b","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6834/3341511949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3341511949},{"type":"v1","addr":"172.21.15.89:6834","nonce":3341511949}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-07T08:53:34.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.564+0000 7f768430c700 1 -- 172.21.15.81:0/2431402404 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7660066f30 msgr2=0x7f76600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:34.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.564+0000 7f768430c700 1 --2- 172.21.15.81:0/2431402404 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7660066f30 0x7f76600693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f767c1598c0 tx=0x7f766c009040 comp rx=0 tx=0).stop 2023-10-07T08:53:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.564+0000 7f768430c700 1 -- 172.21.15.81:0/2431402404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c06d120 msgr2=0x7f767c0b5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.564+0000 7f768430c700 1 --2- 172.21.15.81:0/2431402404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c06d120 0x7f767c0b5d40 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f76780097c0 tx=0x7f7678017000 comp rx=0 tx=0).stop 2023-10-07T08:53:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.564+0000 7f768430c700 1 -- 172.21.15.81:0/2431402404 shutdown_connections 2023-10-07T08:53:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.564+0000 7f768430c700 1 --2- 172.21.15.81:0/2431402404 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7660066f30 0x7f76600693e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.564+0000 7f768430c700 1 --2- 172.21.15.81:0/2431402404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f767c157ca0 0x7f767c068a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.564+0000 7f768430c700 1 --2- 172.21.15.81:0/2431402404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c06d120 0x7f767c0b5d40 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.564+0000 7f768430c700 1 --2- 172.21.15.81:0/2431402404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f767c1578d0 0x7f767c0b6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.564+0000 7f768430c700 1 -- 172.21.15.81:0/2431402404 >> 172.21.15.81:0/2431402404 conn(0x7f767c06bb90 msgr2=0x7f767c06d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.565+0000 7f768430c700 1 -- 172.21.15.81:0/2431402404 shutdown_connections 2023-10-07T08:53:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.565+0000 7f768430c700 1 -- 172.21.15.81:0/2431402404 wait complete. 2023-10-07T08:53:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 82 2023-10-07T08:53:34.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:53:34.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.691+0000 7fed71232700 1 Processor -- start 2023-10-07T08:53:34.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.691+0000 7fed71232700 1 -- start start 2023-10-07T08:53:34.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed71232700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fed6c157ca0 0x7fed6c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:34.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed71232700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed6c06d120 0x7fed6c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:34.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed71232700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6c0d07c0 con 0x7fed6c1578d0 2023-10-07T08:53:34.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed71232700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6c06daa0 con 0x7fed6c157ca0 2023-10-07T08:53:34.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed71232700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0cfbb0 con 0x7fed6c06d120 2023-10-07T08:53:34.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed6a59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fed6c157ca0 0x7fed6c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:34.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed6a59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fed6c157ca0 0x7fed6c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59840/0 (socket says 172.21.15.81:59840) 2023-10-07T08:53:34.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed6a59c700 1 -- 172.21.15.81:0/2101698545 learned_addr learned my addr 172.21.15.81:0/2101698545 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:34.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed6b59e700 1 --2- 172.21.15.81:0/2101698545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed6c06d120 0x7fed6c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:34.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed6a59c700 1 -- 172.21.15.81:0/2101698545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed6c06d120 msgr2=0x7fed6c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:34.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed6a59c700 1 --2- 172.21.15.81:0/2101698545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed6c06d120 0x7fed6c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed6a59c700 1 -- 172.21.15.81:0/2101698545 >> v1:172.21.15.89:6789/0 conn(0x7fed6c1578d0 legacy=0x7fed6c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:34.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed6a59c700 1 -- 172.21.15.81:0/2101698545 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c0cfe90 con 0x7fed6c157ca0 2023-10-07T08:53:34.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed6a59c700 1 --2- 172.21.15.81:0/2101698545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed6c157ca0 0x7fed6c0cf4f0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fed540099b0 tx=0x7fed54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68533c1c3fd36759 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:34.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed69d9b700 1 -- 172.21.15.81:0/2101698545 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5400b860 con 0x7fed6c157ca0 2023-10-07T08:53:34.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed69d9b700 1 -- 172.21.15.81:0/2101698545 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5400b9c0 con 0x7fed6c157ca0 2023-10-07T08:53:34.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.692+0000 7fed69d9b700 1 -- 172.21.15.81:0/2101698545 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5400bd60 con 0x7fed6c157ca0 2023-10-07T08:53:34.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.693+0000 7fed71232700 1 -- 172.21.15.81:0/2101698545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed6c157ca0 msgr2=0x7fed6c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:34.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.693+0000 7fed71232700 1 --2- 172.21.15.81:0/2101698545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed6c157ca0 0x7fed6c0cf4f0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fed540099b0 tx=0x7fed54009250 comp rx=0 tx=0).stop 2023-10-07T08:53:34.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.693+0000 7fed71232700 1 -- 172.21.15.81:0/2101698545 shutdown_connections 2023-10-07T08:53:34.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.693+0000 7fed71232700 1 --2- 172.21.15.81:0/2101698545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed6c06d120 0x7fed6c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.693+0000 7fed71232700 1 --2- 172.21.15.81:0/2101698545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed6c157ca0 0x7fed6c0cf4f0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.693+0000 7fed71232700 1 -- 172.21.15.81:0/2101698545 >> 172.21.15.81:0/2101698545 conn(0x7fed6c06bb90 msgr2=0x7fed6c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:34.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.693+0000 7fed71232700 1 -- 172.21.15.81:0/2101698545 shutdown_connections 2023-10-07T08:53:34.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.693+0000 7fed71232700 1 -- 172.21.15.81:0/2101698545 wait complete. 2023-10-07T08:53:34.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.694+0000 7fed71232700 1 Processor -- start 2023-10-07T08:53:34.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.694+0000 7fed71232700 1 -- start start 2023-10-07T08:53:34.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed71232700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed6c06d120 0x7fed6c153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:34.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed71232700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed6c1578d0 0x7fed6c0ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:34.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed71232700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed6c157ca0 0x7fed6c0aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:34.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed71232700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0ad260 con 0x7fed6c1578d0 2023-10-07T08:53:34.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed71232700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0acf80 con 0x7fed6c157ca0 2023-10-07T08:53:34.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed71232700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0b3d40 con 0x7fed6c06d120 2023-10-07T08:53:34.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed6a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed6c1578d0 0x7fed6c0ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:34.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed6a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed6c1578d0 0x7fed6c0ac470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59844/0 (socket says 172.21.15.81:59844) 2023-10-07T08:53:34.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed6a59c700 1 -- 172.21.15.81:0/4165901377 learned_addr learned my addr 172.21.15.81:0/4165901377 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:34.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed6b59e700 1 --2- 172.21.15.81:0/4165901377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed6c157ca0 0x7fed6c0aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:34.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed6ad9d700 1 --2- 172.21.15.81:0/4165901377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed6c06d120 0x7fed6c153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:34.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed6a59c700 1 -- 172.21.15.81:0/4165901377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed6c06d120 msgr2=0x7fed6c153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:34.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed6a59c700 1 --2- 172.21.15.81:0/4165901377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed6c06d120 0x7fed6c153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed6a59c700 1 -- 172.21.15.81:0/4165901377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed6c157ca0 msgr2=0x7fed6c0aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:34.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed6a59c700 1 --2- 172.21.15.81:0/4165901377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed6c157ca0 0x7fed6c0aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed6a59c700 1 -- 172.21.15.81:0/4165901377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed540094f0 con 0x7fed6c1578d0 2023-10-07T08:53:34.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed6a59c700 1 --2- 172.21.15.81:0/4165901377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed6c1578d0 0x7fed6c0ac470 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fed6c06fe20 tx=0x7fed54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:34.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed62ffd700 1 -- 172.21.15.81:0/4165901377 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54011e40 con 0x7fed6c1578d0 2023-10-07T08:53:34.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed62ffd700 1 -- 172.21.15.81:0/4165901377 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed54024440 con 0x7fed6c1578d0 2023-10-07T08:53:34.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed71232700 1 -- 172.21.15.81:0/4165901377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6c0b4020 con 0x7fed6c1578d0 2023-10-07T08:53:34.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.695+0000 7fed62ffd700 1 -- 172.21.15.81:0/4165901377 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54024800 con 0x7fed6c1578d0 2023-10-07T08:53:34.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.696+0000 7fed71232700 1 -- 172.21.15.81:0/4165901377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6c0b6620 con 0x7fed6c1578d0 2023-10-07T08:53:34.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.696+0000 7fed71232700 1 -- 172.21.15.81:0/4165901377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6c0b3ba0 con 0x7fed6c1578d0 2023-10-07T08:53:34.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.697+0000 7fed62ffd700 1 -- 172.21.15.81:0/4165901377 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed5401a420 con 0x7fed6c1578d0 2023-10-07T08:53:34.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.697+0000 7fed62ffd700 1 --2- 172.21.15.81:0/4165901377 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed4c066f30 0x7fed4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:34.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.697+0000 7fed62ffd700 1 -- 172.21.15.81:0/4165901377 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fed54086340 con 0x7fed6c1578d0 2023-10-07T08:53:34.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.697+0000 7fed6ad9d700 1 --2- 172.21.15.81:0/4165901377 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed4c066f30 0x7fed4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:34.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.697+0000 7fed62ffd700 1 -- 172.21.15.81:0/4165901377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7fed4c06eab0 con 0x7fed6c1578d0 2023-10-07T08:53:34.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.697+0000 7fed6ad9d700 1 --2- 172.21.15.81:0/4165901377 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed4c066f30 0x7fed4c0693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fed64007fd0 tx=0x7fed640016f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:34.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.701+0000 7fed62ffd700 1 -- 172.21.15.81:0/4165901377 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed6c0b3ba0 con 0x7fed6c1578d0 2023-10-07T08:53:34.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.886+0000 7fed71232700 1 -- 172.21.15.81:0/4165901377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed6c0b4540 con 0x7fed6c1578d0 2023-10-07T08:53:34.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.886+0000 7fed62ffd700 1 -- 172.21.15.81:0/4165901377 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+15393 (secure 0 0 0) 0x7fed6c0b4540 con 0x7fed6c1578d0 2023-10-07T08:53:34.888 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:34.888 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":177,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:53:08.329321+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:52:21.579591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-07T08:52:22.231614+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.1b","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:53:34.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.889+0000 7fed71232700 1 -- 172.21.15.81:0/4165901377 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed4c066f30 msgr2=0x7fed4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:34.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.889+0000 7fed71232700 1 --2- 172.21.15.81:0/4165901377 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed4c066f30 0x7fed4c0693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fed64007fd0 tx=0x7fed640016f0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.889+0000 7fed71232700 1 -- 172.21.15.81:0/4165901377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed6c1578d0 msgr2=0x7fed6c0ac470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:34.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.889+0000 7fed71232700 1 --2- 172.21.15.81:0/4165901377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed6c1578d0 0x7fed6c0ac470 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fed6c06fe20 tx=0x7fed54017000 comp rx=0 tx=0).stop 2023-10-07T08:53:34.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.889+0000 7fed71232700 1 -- 172.21.15.81:0/4165901377 shutdown_connections 2023-10-07T08:53:34.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.889+0000 7fed71232700 1 --2- 172.21.15.81:0/4165901377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed6c157ca0 0x7fed6c0aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.889+0000 7fed71232700 1 --2- 172.21.15.81:0/4165901377 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fed4c066f30 0x7fed4c0693e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.889+0000 7fed71232700 1 --2- 172.21.15.81:0/4165901377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed6c06d120 0x7fed6c153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.889+0000 7fed71232700 1 --2- 172.21.15.81:0/4165901377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed6c1578d0 0x7fed6c0ac470 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:34.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.889+0000 7fed71232700 1 -- 172.21.15.81:0/4165901377 >> 172.21.15.81:0/4165901377 conn(0x7fed6c06bb90 msgr2=0x7fed6c068da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:34.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.889+0000 7fed71232700 1 -- 172.21.15.81:0/4165901377 shutdown_connections 2023-10-07T08:53:34.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:34.889+0000 7fed71232700 1 -- 172.21.15.81:0/4165901377 wait complete. 2023-10-07T08:53:34.903 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:52:21.579591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:52:22.231614+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '177', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:53:34.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:53:35.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.022+0000 7f87248fc700 1 Processor -- start 2023-10-07T08:53:35.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.022+0000 7f87248fc700 1 -- start start 2023-10-07T08:53:35.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.023+0000 7f87248fc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f87200d0b80 0x7f87200cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.023+0000 7f87248fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f872006d700 0x7f872015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.023+0000 7f87248fc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87200cf2d0 con 0x7f87200d02b0 2023-10-07T08:53:35.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.023+0000 7f87248fc700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872015a690 con 0x7f87200d0b80 2023-10-07T08:53:35.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.023+0000 7f87248fc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872006dc00 con 0x7f872006d700 2023-10-07T08:53:35.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.023+0000 7f871effd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f87200d02b0 0x7f872006cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47640/0 (socket says 172.21.15.81:47640) 2023-10-07T08:53:35.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.023+0000 7f871effd700 1 -- 172.21.15.81:0/140305343 learned_addr learned my addr 172.21.15.81:0/140305343 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:35.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.023+0000 7f871f7fe700 1 --2- 172.21.15.81:0/140305343 >> v2:172.21.15.89:3300/0 conn(0x7f87200d0b80 0x7f87200cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.023+0000 7f871e7fc700 1 -- 172.21.15.81:0/140305343 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30703029 0 0) 0x7f87200cf2d0 con 0x7f87200d02b0 2023-10-07T08:53:35.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.023+0000 7f871e7fc700 1 -- 172.21.15.81:0/140305343 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8708003570 con 0x7f87200d02b0 2023-10-07T08:53:35.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.023+0000 7f871ffff700 1 --2- 172.21.15.81:0/140305343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f872006d700 0x7f872015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.023+0000 7f871e7fc700 1 -- 172.21.15.81:0/140305343 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2428284254 0 0) 0x7f8708003570 con 0x7f87200d02b0 2023-10-07T08:53:35.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871e7fc700 1 -- 172.21.15.81:0/140305343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f872006d700 msgr2=0x7f872015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:35.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871e7fc700 1 --2- 172.21.15.81:0/140305343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f872006d700 0x7f872015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871e7fc700 1 -- 172.21.15.81:0/140305343 >> v2:172.21.15.89:3300/0 conn(0x7f87200d0b80 msgr2=0x7f87200cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:35.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871e7fc700 1 --2- 172.21.15.81:0/140305343 >> v2:172.21.15.89:3300/0 conn(0x7f87200d0b80 0x7f87200cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871e7fc700 1 -- 172.21.15.81:0/140305343 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87200cf570 con 0x7f87200d02b0 2023-10-07T08:53:35.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871e7fc700 1 -- 172.21.15.81:0/140305343 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f8714001470 con 0x7f87200d02b0 2023-10-07T08:53:35.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871e7fc700 1 -- 172.21.15.81:0/140305343 >> v1:172.21.15.81:6789/0 conn(0x7f87200d02b0 legacy=0x7f872006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871e7fc700 1 --2- 172.21.15.81:0/140305343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8708003a60 0x7f8708003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871e7fc700 1 --2- 172.21.15.81:0/140305343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8708004810 0x7f8708004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871e7fc700 1 --2- 172.21.15.81:0/140305343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f872006d700 0x7f87080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871e7fc700 1 -- 172.21.15.81:0/140305343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872015a690 con 0x7f8708003a60 2023-10-07T08:53:35.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871e7fc700 1 -- 172.21.15.81:0/140305343 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872006dc00 con 0x7f8708004810 2023-10-07T08:53:35.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871e7fc700 1 -- 172.21.15.81:0/140305343 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870800ba60 con 0x7f872006d700 2023-10-07T08:53:35.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871f7fe700 1 --2- 172.21.15.81:0/140305343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8708003a60 0x7f8708003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871effd700 1 --2- 172.21.15.81:0/140305343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8708004810 0x7f8708004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871ffff700 1 --2- 172.21.15.81:0/140305343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f872006d700 0x7f87080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871f7fe700 1 -- 172.21.15.81:0/140305343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f872006d700 msgr2=0x7f87080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871f7fe700 1 --2- 172.21.15.81:0/140305343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f872006d700 0x7f87080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871f7fe700 1 -- 172.21.15.81:0/140305343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8708004810 msgr2=0x7f8708004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871f7fe700 1 --2- 172.21.15.81:0/140305343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8708004810 0x7f8708004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871f7fe700 1 -- 172.21.15.81:0/140305343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8708003570 con 0x7f8708003a60 2023-10-07T08:53:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871ffff700 1 --2- 172.21.15.81:0/140305343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f872006d700 0x7f87080051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:53:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871f7fe700 1 --2- 172.21.15.81:0/140305343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8708003a60 0x7f8708003e70 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f8710009c30 tx=0x7f87100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16c05c1102f3690 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871e7fc700 1 -- 172.21.15.81:0/140305343 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871000e710 con 0x7f8708003a60 2023-10-07T08:53:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871e7fc700 1 -- 172.21.15.81:0/140305343 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871000e870 con 0x7f8708003a60 2023-10-07T08:53:35.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.024+0000 7f871e7fc700 1 -- 172.21.15.81:0/140305343 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871000ec30 con 0x7f8708003a60 2023-10-07T08:53:35.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.025+0000 7f87248fc700 1 -- 172.21.15.81:0/140305343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8708003a60 msgr2=0x7f8708003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.025+0000 7f87248fc700 1 --2- 172.21.15.81:0/140305343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8708003a60 0x7f8708003e70 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f8710009c30 tx=0x7f87100091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.025+0000 7f871ffff700 1 -- 172.21.15.81:0/140305343 reap_dead start 2023-10-07T08:53:35.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.025+0000 7f87248fc700 1 -- 172.21.15.81:0/140305343 shutdown_connections 2023-10-07T08:53:35.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.025+0000 7f87248fc700 1 -- 172.21.15.81:0/140305343 >> 172.21.15.81:0/140305343 conn(0x7f8720063230 msgr2=0x7f8720063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:35.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.025+0000 7f87248fc700 1 -- 172.21.15.81:0/140305343 shutdown_connections 2023-10-07T08:53:35.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.025+0000 7f87248fc700 1 -- 172.21.15.81:0/140305343 wait complete. 2023-10-07T08:53:35.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.026+0000 7f87248fc700 1 Processor -- start 2023-10-07T08:53:35.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.026+0000 7f87248fc700 1 -- start start 2023-10-07T08:53:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f87248fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8708003a60 0x7f8720143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f87248fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87200ae010 0x7f87200ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f87248fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8720160300 0x7f8720160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f87248fc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87201610c0 con 0x7f87200ae010 2023-10-07T08:53:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f87248fc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8720144500 con 0x7f8708003a60 2023-10-07T08:53:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f87248fc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87200b0070 con 0x7f8720160300 2023-10-07T08:53:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f871effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87200ae010 0x7f87200ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f871effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87200ae010 0x7f87200ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59868/0 (socket says 172.21.15.81:59868) 2023-10-07T08:53:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f871effd700 1 -- 172.21.15.81:0/1571977663 learned_addr learned my addr 172.21.15.81:0/1571977663 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f871f7fe700 1 --2- 172.21.15.81:0/1571977663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8708003a60 0x7f8720143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f871ffff700 1 --2- 172.21.15.81:0/1571977663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8720160300 0x7f8720160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f871effd700 1 -- 172.21.15.81:0/1571977663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8720160300 msgr2=0x7f8720160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f871effd700 1 --2- 172.21.15.81:0/1571977663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8720160300 0x7f8720160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f871effd700 1 -- 172.21.15.81:0/1571977663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8708003a60 msgr2=0x7f8720143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f871effd700 1 --2- 172.21.15.81:0/1571977663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8708003a60 0x7f8720143fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f871effd700 1 -- 172.21.15.81:0/1571977663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87200ae9c0 con 0x7f87200ae010 2023-10-07T08:53:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f871effd700 1 --2- 172.21.15.81:0/1571977663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87200ae010 0x7f87200ae480 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f8714001c40 tx=0x7f87200cf460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f87077fe700 1 -- 172.21.15.81:0/1571977663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714018030 con 0x7f87200ae010 2023-10-07T08:53:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f87077fe700 1 -- 172.21.15.81:0/1571977663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871400f850 con 0x7f87200ae010 2023-10-07T08:53:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.027+0000 7f87248fc700 1 -- 172.21.15.81:0/1571977663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87200b0310 con 0x7f87200ae010 2023-10-07T08:53:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.028+0000 7f87077fe700 1 -- 172.21.15.81:0/1571977663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714007800 con 0x7f87200ae010 2023-10-07T08:53:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.028+0000 7f87248fc700 1 -- 172.21.15.81:0/1571977663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87200b08d0 con 0x7f87200ae010 2023-10-07T08:53:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.028+0000 7f87248fc700 1 -- 172.21.15.81:0/1571977663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87200676e0 con 0x7f87200ae010 2023-10-07T08:53:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.029+0000 7f87077fe700 1 -- 172.21.15.81:0/1571977663 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f871401b070 con 0x7f87200ae010 2023-10-07T08:53:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.029+0000 7f87077fe700 1 --2- 172.21.15.81:0/1571977663 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f870c066f30 0x7f870c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.029+0000 7f871f7fe700 1 --2- 172.21.15.81:0/1571977663 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f870c066f30 0x7f870c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.029+0000 7f87077fe700 1 -- 172.21.15.81:0/1571977663 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f8714019070 con 0x7f87200ae010 2023-10-07T08:53:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.030+0000 7f87077fe700 1 -- 172.21.15.81:0/1571977663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7f870c06eab0 con 0x7f87200ae010 2023-10-07T08:53:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.030+0000 7f871f7fe700 1 --2- 172.21.15.81:0/1571977663 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f870c066f30 0x7f870c0693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f87100091e0 tx=0x7f871001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.034+0000 7f87077fe700 1 -- 172.21.15.81:0/1571977663 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8714051640 con 0x7f87200ae010 2023-10-07T08:53:35.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.216+0000 7f87248fc700 1 -- 172.21.15.81:0/1571977663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8720071b10 con 0x7f87200ae010 2023-10-07T08:53:35.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.217+0000 7f87077fe700 1 -- 172.21.15.81:0/1571977663 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v177) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8714054c60 con 0x7f87200ae010 2023-10-07T08:53:35.218 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:53:35.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.219+0000 7f87248fc700 1 -- 172.21.15.81:0/1571977663 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f870c066f30 msgr2=0x7f870c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.219+0000 7f87248fc700 1 --2- 172.21.15.81:0/1571977663 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f870c066f30 0x7f870c0693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f87100091e0 tx=0x7f871001a000 comp rx=0 tx=0).stop 2023-10-07T08:53:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.219+0000 7f87248fc700 1 -- 172.21.15.81:0/1571977663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87200ae010 msgr2=0x7f87200ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.219+0000 7f87248fc700 1 --2- 172.21.15.81:0/1571977663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87200ae010 0x7f87200ae480 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f8714001c40 tx=0x7f87200cf460 comp rx=0 tx=0).stop 2023-10-07T08:53:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.219+0000 7f87248fc700 1 -- 172.21.15.81:0/1571977663 shutdown_connections 2023-10-07T08:53:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.219+0000 7f87248fc700 1 --2- 172.21.15.81:0/1571977663 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f870c066f30 0x7f870c0693e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.219+0000 7f87248fc700 1 --2- 172.21.15.81:0/1571977663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8720160300 0x7f8720160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.219+0000 7f87248fc700 1 --2- 172.21.15.81:0/1571977663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8708003a60 0x7f8720143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.219+0000 7f87248fc700 1 --2- 172.21.15.81:0/1571977663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87200ae010 0x7f87200ae480 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.219+0000 7f87248fc700 1 -- 172.21.15.81:0/1571977663 >> 172.21.15.81:0/1571977663 conn(0x7f8720063230 msgr2=0x7f87200b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.219+0000 7f87248fc700 1 -- 172.21.15.81:0/1571977663 shutdown_connections 2023-10-07T08:53:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.219+0000 7f87248fc700 1 -- 172.21.15.81:0/1571977663 wait complete. 2023-10-07T08:53:35.232 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:53:35.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.349+0000 7fe47759e700 1 Processor -- start 2023-10-07T08:53:35.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.349+0000 7fe47759e700 1 -- start start 2023-10-07T08:53:35.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.350+0000 7fe47759e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4780d0b80 0x7fe4780cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.350+0000 7fe47759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4780d02b0 0x7fe47806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.350+0000 7fe47759e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4780cf2d0 con 0x7fe4780d0f50 2023-10-07T08:53:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.350+0000 7fe47759e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47815a690 con 0x7fe4780d02b0 2023-10-07T08:53:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.350+0000 7fe47759e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47806dc00 con 0x7fe4780d0b80 2023-10-07T08:53:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.350+0000 7fe46dd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4780d02b0 0x7fe47806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.350+0000 7fe476d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe4780d0f50 0x7fe47815b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47652/0 (socket says 172.21.15.81:47652) 2023-10-07T08:53:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.350+0000 7fe476d9d700 1 -- 172.21.15.81:0/3530042359 learned_addr learned my addr 172.21.15.81:0/3530042359 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.350+0000 7fe47659c700 1 --2- 172.21.15.81:0/3530042359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4780d0b80 0x7fe4780cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.350+0000 7fe46dd9b700 1 -- 172.21.15.81:0/3530042359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4780d0b80 msgr2=0x7fe4780cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.350+0000 7fe46dd9b700 1 --2- 172.21.15.81:0/3530042359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4780d0b80 0x7fe4780cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.350+0000 7fe46dd9b700 1 -- 172.21.15.81:0/3530042359 >> v1:172.21.15.81:6789/0 conn(0x7fe4780d0f50 legacy=0x7fe47815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.350+0000 7fe46dd9b700 1 -- 172.21.15.81:0/3530042359 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4780cf570 con 0x7fe4780d02b0 2023-10-07T08:53:35.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.350+0000 7fe475d9b700 1 -- 172.21.15.81:0/3530042359 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848535553 0 0) 0x7fe4780cf2d0 con 0x7fe4780d0f50 2023-10-07T08:53:35.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.350+0000 7fe46dd9b700 1 --2- 172.21.15.81:0/3530042359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4780d02b0 0x7fe47806cff0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fe4600098e0 tx=0x7fe4600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e14e06720e9dff server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:35.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.351+0000 7fe475d9b700 1 -- 172.21.15.81:0/3530042359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46000b640 con 0x7fe4780d02b0 2023-10-07T08:53:35.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.351+0000 7fe475d9b700 1 -- 172.21.15.81:0/3530042359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46000b7a0 con 0x7fe4780d02b0 2023-10-07T08:53:35.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.351+0000 7fe475d9b700 1 -- 172.21.15.81:0/3530042359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46000bb40 con 0x7fe4780d02b0 2023-10-07T08:53:35.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.351+0000 7fe47759e700 1 -- 172.21.15.81:0/3530042359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4780d02b0 msgr2=0x7fe47806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.351+0000 7fe47759e700 1 --2- 172.21.15.81:0/3530042359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4780d02b0 0x7fe47806cff0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fe4600098e0 tx=0x7fe4600091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.351+0000 7fe47759e700 1 -- 172.21.15.81:0/3530042359 shutdown_connections 2023-10-07T08:53:35.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.351+0000 7fe47759e700 1 --2- 172.21.15.81:0/3530042359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4780d0b80 0x7fe4780cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.351+0000 7fe47759e700 1 --2- 172.21.15.81:0/3530042359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4780d02b0 0x7fe47806cff0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.351+0000 7fe47759e700 1 -- 172.21.15.81:0/3530042359 >> 172.21.15.81:0/3530042359 conn(0x7fe478063230 msgr2=0x7fe478063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:35.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.351+0000 7fe47759e700 1 -- 172.21.15.81:0/3530042359 shutdown_connections 2023-10-07T08:53:35.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.351+0000 7fe47759e700 1 -- 172.21.15.81:0/3530042359 wait complete. 2023-10-07T08:53:35.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.352+0000 7fe47759e700 1 Processor -- start 2023-10-07T08:53:35.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.352+0000 7fe47759e700 1 -- start start 2023-10-07T08:53:35.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.353+0000 7fe47759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4780d02b0 0x7fe478146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.353+0000 7fe47759e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4780d0b80 0x7fe478068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.353+0000 7fe47759e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4780d0f50 0x7fe478068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.353+0000 7fe47759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe478148d20 con 0x7fe4780d02b0 2023-10-07T08:53:35.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.353+0000 7fe47759e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe478148110 con 0x7fe4780d0b80 2023-10-07T08:53:35.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.353+0000 7fe47759e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4781483f0 con 0x7fe4780d0f50 2023-10-07T08:53:35.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.353+0000 7fe47659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4780d02b0 0x7fe478146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.353+0000 7fe47659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4780d02b0 0x7fe478146540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59896/0 (socket says 172.21.15.81:59896) 2023-10-07T08:53:35.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.353+0000 7fe47659c700 1 -- 172.21.15.81:0/2028566743 learned_addr learned my addr 172.21.15.81:0/2028566743 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:35.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.354+0000 7fe46dd9b700 1 --2- 172.21.15.81:0/2028566743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4780d0b80 0x7fe478068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.354+0000 7fe47659c700 1 -- 172.21.15.81:0/2028566743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4780d0f50 msgr2=0x7fe478068ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.354+0000 7fe47659c700 1 --2- 172.21.15.81:0/2028566743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4780d0f50 0x7fe478068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.354+0000 7fe47659c700 1 -- 172.21.15.81:0/2028566743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4780d0b80 msgr2=0x7fe478068990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.354+0000 7fe47659c700 1 --2- 172.21.15.81:0/2028566743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4780d0b80 0x7fe478068990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.354+0000 7fe47659c700 1 -- 172.21.15.81:0/2028566743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe460009420 con 0x7fe4780d02b0 2023-10-07T08:53:35.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.354+0000 7fe46dd9b700 1 --2- 172.21.15.81:0/2028566743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4780d0b80 0x7fe478068990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:35.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.354+0000 7fe47659c700 1 --2- 172.21.15.81:0/2028566743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4780d02b0 0x7fe478146540 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fe46800ec80 tx=0x7fe4680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:35.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.354+0000 7fe46effd700 1 -- 172.21.15.81:0/2028566743 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46800c9d0 con 0x7fe4780d02b0 2023-10-07T08:53:35.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.354+0000 7fe46effd700 1 -- 172.21.15.81:0/2028566743 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46800cb30 con 0x7fe4780d02b0 2023-10-07T08:53:35.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.354+0000 7fe47759e700 1 -- 172.21.15.81:0/2028566743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4781486d0 con 0x7fe4780d02b0 2023-10-07T08:53:35.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.354+0000 7fe46effd700 1 -- 172.21.15.81:0/2028566743 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468013470 con 0x7fe4780d02b0 2023-10-07T08:53:35.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.354+0000 7fe47759e700 1 -- 172.21.15.81:0/2028566743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe478146a80 con 0x7fe4780d02b0 2023-10-07T08:53:35.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.355+0000 7fe47759e700 1 -- 172.21.15.81:0/2028566743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47815adc0 con 0x7fe4780d02b0 2023-10-07T08:53:35.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.355+0000 7fe46effd700 1 -- 172.21.15.81:0/2028566743 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe468013820 con 0x7fe4780d02b0 2023-10-07T08:53:35.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.356+0000 7fe46effd700 1 --2- 172.21.15.81:0/2028566743 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe458066f30 0x7fe4580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.356+0000 7fe46effd700 1 -- 172.21.15.81:0/2028566743 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fe468084940 con 0x7fe4780d02b0 2023-10-07T08:53:35.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.356+0000 7fe46dd9b700 1 --2- 172.21.15.81:0/2028566743 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe458066f30 0x7fe4580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.356+0000 7fe46effd700 1 -- 172.21.15.81:0/2028566743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7fe45806eab0 con 0x7fe4780d02b0 2023-10-07T08:53:35.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.356+0000 7fe46dd9b700 1 --2- 172.21.15.81:0/2028566743 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe458066f30 0x7fe4580693e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe478156060 tx=0x7fe460017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:35.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.360+0000 7fe46effd700 1 -- 172.21.15.81:0/2028566743 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe468017060 con 0x7fe4780d02b0 2023-10-07T08:53:35.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.543+0000 7fe47759e700 1 -- 172.21.15.81:0/2028566743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe4780676e0 con 0x7fe4780d02b0 2023-10-07T08:53:35.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.543+0000 7fe46effd700 1 -- 172.21.15.81:0/2028566743 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v177) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe468021020 con 0x7fe4780d02b0 2023-10-07T08:53:35.544 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:53:35.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.545+0000 7fe47759e700 1 -- 172.21.15.81:0/2028566743 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe458066f30 msgr2=0x7fe4580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.545+0000 7fe47759e700 1 --2- 172.21.15.81:0/2028566743 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe458066f30 0x7fe4580693e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe478156060 tx=0x7fe460017000 comp rx=0 tx=0).stop 2023-10-07T08:53:35.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.545+0000 7fe47759e700 1 -- 172.21.15.81:0/2028566743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4780d02b0 msgr2=0x7fe478146540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.545+0000 7fe47759e700 1 --2- 172.21.15.81:0/2028566743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4780d02b0 0x7fe478146540 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fe46800ec80 tx=0x7fe4680091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.545+0000 7fe47759e700 1 -- 172.21.15.81:0/2028566743 shutdown_connections 2023-10-07T08:53:35.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.545+0000 7fe47759e700 1 --2- 172.21.15.81:0/2028566743 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe458066f30 0x7fe4580693e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.545+0000 7fe47759e700 1 --2- 172.21.15.81:0/2028566743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4780d0f50 0x7fe478068ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.545+0000 7fe47759e700 1 --2- 172.21.15.81:0/2028566743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4780d02b0 0x7fe478146540 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.545+0000 7fe47759e700 1 --2- 172.21.15.81:0/2028566743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4780d0b80 0x7fe478068990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.545+0000 7fe47759e700 1 -- 172.21.15.81:0/2028566743 >> 172.21.15.81:0/2028566743 conn(0x7fe478063230 msgr2=0x7fe478157730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:35.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.545+0000 7fe47759e700 1 -- 172.21.15.81:0/2028566743 shutdown_connections 2023-10-07T08:53:35.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.545+0000 7fe47759e700 1 -- 172.21.15.81:0/2028566743 wait complete. 2023-10-07T08:53:35.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:53:35.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.674+0000 7fe48cc2a700 1 Processor -- start 2023-10-07T08:53:35.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.674+0000 7fe48cc2a700 1 -- start start 2023-10-07T08:53:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.675+0000 7fe48cc2a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe48806d700 0x7fe48815b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.675+0000 7fe48cc2a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4880cf2d0 con 0x7fe4880d0b80 2023-10-07T08:53:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.675+0000 7fe48cc2a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4880d0480 con 0x7fe4880d0f50 2023-10-07T08:53:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.675+0000 7fe48cc2a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48815a690 con 0x7fe48806d700 2023-10-07T08:53:35.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.675+0000 7fe4877fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe4880d0b80 0x7fe4880cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47654/0 (socket says 172.21.15.81:47654) 2023-10-07T08:53:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.675+0000 7fe4877fe700 1 -- 172.21.15.81:0/2631387243 learned_addr learned my addr 172.21.15.81:0/2631387243 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.675+0000 7fe487fff700 1 --2- 172.21.15.81:0/2631387243 >> v2:172.21.15.81:3300/0 conn(0x7fe48806d700 0x7fe48815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.675+0000 7fe487fff700 1 -- 172.21.15.81:0/2631387243 >> v1:172.21.15.89:6789/0 conn(0x7fe4880d0f50 legacy=0x7fe48806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.675+0000 7fe487fff700 1 -- 172.21.15.81:0/2631387243 >> v1:172.21.15.81:6789/0 conn(0x7fe4880d0b80 legacy=0x7fe4880cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.675+0000 7fe487fff700 1 -- 172.21.15.81:0/2631387243 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48806dc00 con 0x7fe48806d700 2023-10-07T08:53:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.675+0000 7fe487fff700 1 --2- 172.21.15.81:0/2631387243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe48806d700 0x7fe48815b320 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fe480009e60 tx=0x7fe480009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947faf324391dff7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.675+0000 7fe4867fc700 1 -- 172.21.15.81:0/2631387243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48000e070 con 0x7fe48806d700 2023-10-07T08:53:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.676+0000 7fe4867fc700 1 -- 172.21.15.81:0/2631387243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48000bc30 con 0x7fe48806d700 2023-10-07T08:53:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.676+0000 7fe4867fc700 1 -- 172.21.15.81:0/2631387243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480012430 con 0x7fe48806d700 2023-10-07T08:53:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.676+0000 7fe48cc2a700 1 -- 172.21.15.81:0/2631387243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe48806d700 msgr2=0x7fe48815b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.676+0000 7fe48cc2a700 1 --2- 172.21.15.81:0/2631387243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe48806d700 0x7fe48815b320 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fe480009e60 tx=0x7fe480009780 comp rx=0 tx=0).stop 2023-10-07T08:53:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.676+0000 7fe48cc2a700 1 -- 172.21.15.81:0/2631387243 shutdown_connections 2023-10-07T08:53:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.676+0000 7fe48cc2a700 1 --2- 172.21.15.81:0/2631387243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe48806d700 0x7fe48815b320 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.676+0000 7fe48cc2a700 1 -- 172.21.15.81:0/2631387243 >> 172.21.15.81:0/2631387243 conn(0x7fe488063230 msgr2=0x7fe488063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.676+0000 7fe48cc2a700 1 -- 172.21.15.81:0/2631387243 shutdown_connections 2023-10-07T08:53:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.676+0000 7fe48cc2a700 1 -- 172.21.15.81:0/2631387243 wait complete. 2023-10-07T08:53:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.677+0000 7fe48cc2a700 1 Processor -- start 2023-10-07T08:53:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.677+0000 7fe48cc2a700 1 -- start start 2023-10-07T08:53:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.678+0000 7fe48cc2a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe48806d700 0x7fe4880ad660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.678+0000 7fe48cc2a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880d0b80 0x7fe4880b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.678+0000 7fe48cc2a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4880d0f50 0x7fe488069d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.678+0000 7fe48cc2a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48816b770 con 0x7fe4880d0b80 2023-10-07T08:53:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.678+0000 7fe48cc2a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48816b490 con 0x7fe48806d700 2023-10-07T08:53:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.678+0000 7fe48cc2a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880acb80 con 0x7fe4880d0f50 2023-10-07T08:53:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.678+0000 7fe486ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880d0b80 0x7fe4880b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.678+0000 7fe486ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880d0b80 0x7fe4880b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59916/0 (socket says 172.21.15.81:59916) 2023-10-07T08:53:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.678+0000 7fe486ffd700 1 -- 172.21.15.81:0/2647493776 learned_addr learned my addr 172.21.15.81:0/2647493776 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.678+0000 7fe4877fe700 1 --2- 172.21.15.81:0/2647493776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe48806d700 0x7fe4880ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.678+0000 7fe487fff700 1 --2- 172.21.15.81:0/2647493776 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4880d0f50 0x7fe488069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.678+0000 7fe486ffd700 1 -- 172.21.15.81:0/2647493776 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4880d0f50 msgr2=0x7fe488069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.678+0000 7fe486ffd700 1 --2- 172.21.15.81:0/2647493776 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4880d0f50 0x7fe488069d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.678+0000 7fe486ffd700 1 -- 172.21.15.81:0/2647493776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe48806d700 msgr2=0x7fe4880ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.678+0000 7fe486ffd700 1 --2- 172.21.15.81:0/2647493776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe48806d700 0x7fe4880ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.678+0000 7fe486ffd700 1 -- 172.21.15.81:0/2647493776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe480009a20 con 0x7fe4880d0b80 2023-10-07T08:53:35.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.679+0000 7fe486ffd700 1 --2- 172.21.15.81:0/2647493776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880d0b80 0x7fe4880b13a0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00c590 tx=0x7fe47c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:35.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.679+0000 7fe46f7fe700 1 -- 172.21.15.81:0/2647493776 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c011590 con 0x7fe4880d0b80 2023-10-07T08:53:35.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.679+0000 7fe46f7fe700 1 -- 172.21.15.81:0/2647493776 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c011730 con 0x7fe4880d0b80 2023-10-07T08:53:35.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.679+0000 7fe48cc2a700 1 -- 172.21.15.81:0/2647493776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4880ace60 con 0x7fe4880d0b80 2023-10-07T08:53:35.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.679+0000 7fe46f7fe700 1 -- 172.21.15.81:0/2647493776 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c011af0 con 0x7fe4880d0b80 2023-10-07T08:53:35.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.679+0000 7fe48cc2a700 1 -- 172.21.15.81:0/2647493776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4880b18e0 con 0x7fe4880d0b80 2023-10-07T08:53:35.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.680+0000 7fe48cc2a700 1 -- 172.21.15.81:0/2647493776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4880ad380 con 0x7fe4880d0b80 2023-10-07T08:53:35.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.680+0000 7fe46f7fe700 1 -- 172.21.15.81:0/2647493776 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe47c012420 con 0x7fe4880d0b80 2023-10-07T08:53:35.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.680+0000 7fe46f7fe700 1 --2- 172.21.15.81:0/2647493776 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe474066f30 0x7fe4740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:35.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.681+0000 7fe46f7fe700 1 -- 172.21.15.81:0/2647493776 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fe47c083720 con 0x7fe4880d0b80 2023-10-07T08:53:35.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.681+0000 7fe4877fe700 1 --2- 172.21.15.81:0/2647493776 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe474066f30 0x7fe4740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:35.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.681+0000 7fe46f7fe700 1 -- 172.21.15.81:0/2647493776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7fe47406eab0 con 0x7fe4880d0b80 2023-10-07T08:53:35.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.681+0000 7fe4877fe700 1 --2- 172.21.15.81:0/2647493776 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe474066f30 0x7fe4740693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe478007130 tx=0x7fe478007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:35.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.685+0000 7fe46f7fe700 1 -- 172.21.15.81:0/2647493776 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe47c04b5a0 con 0x7fe4880d0b80 2023-10-07T08:53:35.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.866+0000 7fe48cc2a700 1 -- 172.21.15.81:0/2647493776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe4880676e0 con 0x7fe4880d0b80 2023-10-07T08:53:35.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.867+0000 7fe46f7fe700 1 -- 172.21.15.81:0/2647493776 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v177) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe47c017070 con 0x7fe4880d0b80 2023-10-07T08:53:35.884 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:53:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.869+0000 7fe48cc2a700 1 -- 172.21.15.81:0/2647493776 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe474066f30 msgr2=0x7fe4740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.869+0000 7fe48cc2a700 1 --2- 172.21.15.81:0/2647493776 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe474066f30 0x7fe4740693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe478007130 tx=0x7fe478007eb0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.869+0000 7fe48cc2a700 1 -- 172.21.15.81:0/2647493776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880d0b80 msgr2=0x7fe4880b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.869+0000 7fe48cc2a700 1 --2- 172.21.15.81:0/2647493776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880d0b80 0x7fe4880b13a0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00c590 tx=0x7fe47c007f30 comp rx=0 tx=0).stop 2023-10-07T08:53:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.869+0000 7fe48cc2a700 1 -- 172.21.15.81:0/2647493776 shutdown_connections 2023-10-07T08:53:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.869+0000 7fe48cc2a700 1 --2- 172.21.15.81:0/2647493776 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe474066f30 0x7fe4740693e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.869+0000 7fe48cc2a700 1 --2- 172.21.15.81:0/2647493776 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4880d0f50 0x7fe488069d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.869+0000 7fe48cc2a700 1 --2- 172.21.15.81:0/2647493776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe48806d700 0x7fe4880ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.869+0000 7fe48cc2a700 1 --2- 172.21.15.81:0/2647493776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4880d0b80 0x7fe4880b13a0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:35.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.869+0000 7fe48cc2a700 1 -- 172.21.15.81:0/2647493776 >> 172.21.15.81:0/2647493776 conn(0x7fe488063230 msgr2=0x7fe4880b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:35.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.869+0000 7fe48cc2a700 1 -- 172.21.15.81:0/2647493776 shutdown_connections 2023-10-07T08:53:35.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:35.869+0000 7fe48cc2a700 1 -- 172.21.15.81:0/2647493776 wait complete. 2023-10-07T08:53:35.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:53:36.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.000+0000 7f67c05e6700 1 Processor -- start 2023-10-07T08:53:36.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.000+0000 7f67c05e6700 1 -- start start 2023-10-07T08:53:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.001+0000 7f67c05e6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f67b81578d0 0x7f67b80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.001+0000 7f67c05e6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b80d07c0 con 0x7f67b806d120 2023-10-07T08:53:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.001+0000 7f67c05e6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b80cfbb0 con 0x7f67b8157ca0 2023-10-07T08:53:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.001+0000 7f67c05e6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b80cfe90 con 0x7f67b81578d0 2023-10-07T08:53:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.001+0000 7f67be382700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f67b81578d0 0x7f67b80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.001+0000 7f67beb83700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f67b806d120 0x7f67b806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47670/0 (socket says 172.21.15.81:47670) 2023-10-07T08:53:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.001+0000 7f67be382700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f67b81578d0 0x7f67b80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59928/0 (socket says 172.21.15.81:59928) 2023-10-07T08:53:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.001+0000 7f67beb83700 1 -- 172.21.15.81:0/3822698676 learned_addr learned my addr 172.21.15.81:0/3822698676 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.001+0000 7f67be382700 1 -- 172.21.15.81:0/3822698676 >> v1:172.21.15.89:6789/0 conn(0x7f67b8157ca0 legacy=0x7f67b815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.001+0000 7f67be382700 1 -- 172.21.15.81:0/3822698676 >> v1:172.21.15.81:6789/0 conn(0x7f67b806d120 legacy=0x7f67b806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.001+0000 7f67bd380700 1 -- 172.21.15.81:0/3822698676 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82773046 0 0) 0x7f67b80d07c0 con 0x7f67b806d120 2023-10-07T08:53:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.001+0000 7f67be382700 1 -- 172.21.15.81:0/3822698676 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b80d0170 con 0x7f67b81578d0 2023-10-07T08:53:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.001+0000 7f67be382700 1 --2- 172.21.15.81:0/3822698676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b81578d0 0x7f67b80cf4f0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009e60 tx=0x7f67b0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5355985ee489c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.002+0000 7f67bd380700 1 -- 172.21.15.81:0/3822698676 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b000e070 con 0x7f67b81578d0 2023-10-07T08:53:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.002+0000 7f67bd380700 1 -- 172.21.15.81:0/3822698676 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b000bc30 con 0x7f67b81578d0 2023-10-07T08:53:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.002+0000 7f67bd380700 1 -- 172.21.15.81:0/3822698676 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0012430 con 0x7f67b81578d0 2023-10-07T08:53:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.002+0000 7f67c05e6700 1 -- 172.21.15.81:0/3822698676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b81578d0 msgr2=0x7f67b80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.002+0000 7f67c05e6700 1 --2- 172.21.15.81:0/3822698676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b81578d0 0x7f67b80cf4f0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009e60 tx=0x7f67b0009780 comp rx=0 tx=0).stop 2023-10-07T08:53:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.002+0000 7f67c05e6700 1 -- 172.21.15.81:0/3822698676 shutdown_connections 2023-10-07T08:53:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.002+0000 7f67c05e6700 1 --2- 172.21.15.81:0/3822698676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b81578d0 0x7f67b80cf4f0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.002+0000 7f67c05e6700 1 -- 172.21.15.81:0/3822698676 >> 172.21.15.81:0/3822698676 conn(0x7f67b806bb90 msgr2=0x7f67b806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.002+0000 7f67c05e6700 1 -- 172.21.15.81:0/3822698676 shutdown_connections 2023-10-07T08:53:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.002+0000 7f67c05e6700 1 -- 172.21.15.81:0/3822698676 wait complete. 2023-10-07T08:53:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.003+0000 7f67c05e6700 1 Processor -- start 2023-10-07T08:53:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.003+0000 7f67c05e6700 1 -- start start 2023-10-07T08:53:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67c05e6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b806d120 0x7f67b80cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67c05e6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67b81578d0 0x7f67b816e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67c05e6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b8157ca0 0x7f67b8152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67c05e6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b80b5360 con 0x7f67b806d120 2023-10-07T08:53:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67c05e6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b816ea20 con 0x7f67b81578d0 2023-10-07T08:53:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67c05e6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b80cdc40 con 0x7f67b8157ca0 2023-10-07T08:53:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67be382700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b806d120 0x7f67b80cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67be382700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b806d120 0x7f67b80cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59938/0 (socket says 172.21.15.81:59938) 2023-10-07T08:53:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67be382700 1 -- 172.21.15.81:0/453628722 learned_addr learned my addr 172.21.15.81:0/453628722 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67bdb81700 1 --2- 172.21.15.81:0/453628722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67b81578d0 0x7f67b816e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67beb83700 1 --2- 172.21.15.81:0/453628722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b8157ca0 0x7f67b8152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67be382700 1 -- 172.21.15.81:0/453628722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b8157ca0 msgr2=0x7f67b8152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67be382700 1 --2- 172.21.15.81:0/453628722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b8157ca0 0x7f67b8152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67be382700 1 -- 172.21.15.81:0/453628722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67b81578d0 msgr2=0x7f67b816e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67be382700 1 --2- 172.21.15.81:0/453628722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67b81578d0 0x7f67b816e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67be382700 1 -- 172.21.15.81:0/453628722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b0009a20 con 0x7f67b806d120 2023-10-07T08:53:36.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.004+0000 7f67beb83700 1 --2- 172.21.15.81:0/453628722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b8157ca0 0x7f67b8152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:53:36.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.005+0000 7f67be382700 1 --2- 172.21.15.81:0/453628722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b806d120 0x7f67b80cd5d0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f67b00099f0 tx=0x7f67b0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:36.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.005+0000 7f67ae7fc700 1 -- 172.21.15.81:0/453628722 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b001b420 con 0x7f67b806d120 2023-10-07T08:53:36.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.005+0000 7f67ae7fc700 1 -- 172.21.15.81:0/453628722 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b001b580 con 0x7f67b806d120 2023-10-07T08:53:36.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.005+0000 7f67c05e6700 1 -- 172.21.15.81:0/453628722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b80b4d10 con 0x7f67b806d120 2023-10-07T08:53:36.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.005+0000 7f67ae7fc700 1 -- 172.21.15.81:0/453628722 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b001b940 con 0x7f67b806d120 2023-10-07T08:53:36.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.005+0000 7f67c05e6700 1 -- 172.21.15.81:0/453628722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b8152fa0 con 0x7f67b806d120 2023-10-07T08:53:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.006+0000 7f67c05e6700 1 -- 172.21.15.81:0/453628722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b80b4b70 con 0x7f67b806d120 2023-10-07T08:53:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.006+0000 7f67ae7fc700 1 -- 172.21.15.81:0/453628722 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f67b001bcb0 con 0x7f67b806d120 2023-10-07T08:53:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.006+0000 7f67ae7fc700 1 --2- 172.21.15.81:0/453628722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f679c066f30 0x7f679c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.006+0000 7f67ae7fc700 1 -- 172.21.15.81:0/453628722 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f67b0086270 con 0x7f67b806d120 2023-10-07T08:53:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.007+0000 7f67bdb81700 1 --2- 172.21.15.81:0/453628722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f679c066f30 0x7f679c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.007+0000 7f67ae7fc700 1 -- 172.21.15.81:0/453628722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7f679c06eab0 con 0x7f67b806d120 2023-10-07T08:53:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.007+0000 7f67bdb81700 1 --2- 172.21.15.81:0/453628722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f679c066f30 0x7f679c0693e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f67b806e050 tx=0x7f67a8007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.011+0000 7f67ae7fc700 1 -- 172.21.15.81:0/453628722 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67b002a060 con 0x7f67b806d120 2023-10-07T08:53:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.232+0000 7f67c05e6700 1 -- 172.21.15.81:0/453628722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67b80d0450 con 0x7f67b806d120 2023-10-07T08:53:36.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.233+0000 7f67ae7fc700 1 -- 172.21.15.81:0/453628722 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f67b80b4b70 con 0x7f67b806d120 2023-10-07T08:53:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:36.240 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3709604420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3709604420},{"type":"v1","addr":"172.21.15.89:6835","nonce":3709604420}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7842,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/517568220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":517568220},{"type":"v1","addr":"172.21.15.81:6836","nonce":517568220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7845,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2183069282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2183069282},{"type":"v1","addr":"172.21.15.81:6837","nonce":2183069282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:52:23.270892+0000","modified":"2023-10-07T08:52:26.901820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7851":{"gid":7851,"name":"b","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6834/3341511949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3341511949},{"type":"v1","addr":"172.21.15.89:6834","nonce":3341511949}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-07T08:53:36.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.235+0000 7f67c05e6700 1 -- 172.21.15.81:0/453628722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f679c066f30 msgr2=0x7f679c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.235+0000 7f67c05e6700 1 --2- 172.21.15.81:0/453628722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f679c066f30 0x7f679c0693e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f67b806e050 tx=0x7f67a8007ec0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.235+0000 7f67c05e6700 1 -- 172.21.15.81:0/453628722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b806d120 msgr2=0x7f67b80cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.235+0000 7f67c05e6700 1 --2- 172.21.15.81:0/453628722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b806d120 0x7f67b80cd5d0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f67b00099f0 tx=0x7f67b0019000 comp rx=0 tx=0).stop 2023-10-07T08:53:36.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.235+0000 7f67c05e6700 1 -- 172.21.15.81:0/453628722 shutdown_connections 2023-10-07T08:53:36.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.235+0000 7f67c05e6700 1 --2- 172.21.15.81:0/453628722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f679c066f30 0x7f679c0693e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.235+0000 7f67c05e6700 1 --2- 172.21.15.81:0/453628722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67b8157ca0 0x7f67b8152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.235+0000 7f67c05e6700 1 --2- 172.21.15.81:0/453628722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b806d120 0x7f67b80cd5d0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.235+0000 7f67c05e6700 1 --2- 172.21.15.81:0/453628722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67b81578d0 0x7f67b816e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.235+0000 7f67c05e6700 1 -- 172.21.15.81:0/453628722 >> 172.21.15.81:0/453628722 conn(0x7f67b806bb90 msgr2=0x7f67b815a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:36.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.235+0000 7f67c05e6700 1 -- 172.21.15.81:0/453628722 shutdown_connections 2023-10-07T08:53:36.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.235+0000 7f67c05e6700 1 -- 172.21.15.81:0/453628722 wait complete. 2023-10-07T08:53:36.243 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 82 2023-10-07T08:53:36.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:53:36.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.361+0000 7f712f59e700 1 Processor -- start 2023-10-07T08:53:36.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.361+0000 7f712f59e700 1 -- start start 2023-10-07T08:53:36.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.362+0000 7f712f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7130068e90 0x7f7130164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:36.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.362+0000 7f712f59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71300cee10 con 0x7f7130159b40 2023-10-07T08:53:36.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.362+0000 7f712f59e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71300cd040 con 0x7f7130159f10 2023-10-07T08:53:36.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.362+0000 7f712f59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71300cd320 con 0x7f7130068e90 2023-10-07T08:53:36.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.362+0000 7f712ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7130068e90 0x7f7130164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:36.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.362+0000 7f712e59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7130159b40 0x7f71300cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47684/0 (socket says 172.21.15.81:47684) 2023-10-07T08:53:36.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.362+0000 7f712ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7130068e90 0x7f7130164c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59940/0 (socket says 172.21.15.81:59940) 2023-10-07T08:53:36.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.362+0000 7f712e59c700 1 -- 172.21.15.81:0/387722878 learned_addr learned my addr 172.21.15.81:0/387722878 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:36.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.362+0000 7f712ed9d700 1 -- 172.21.15.81:0/387722878 >> v1:172.21.15.89:6789/0 conn(0x7f7130159f10 legacy=0x7f7130068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:36.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.362+0000 7f712ed9d700 1 -- 172.21.15.81:0/387722878 >> v1:172.21.15.81:6789/0 conn(0x7f7130159b40 legacy=0x7f71300cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.362+0000 7f712ed9d700 1 -- 172.21.15.81:0/387722878 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71300ce7c0 con 0x7f7130068e90 2023-10-07T08:53:36.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.362+0000 7f712dd9b700 1 -- 172.21.15.81:0/387722878 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446312113 0 0) 0x7f71300cee10 con 0x7f7130159b40 2023-10-07T08:53:36.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.362+0000 7f712ed9d700 1 --2- 172.21.15.81:0/387722878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7130068e90 0x7f7130164c70 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f7128009e60 tx=0x7f7128009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a55e4be90e7184 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:36.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.363+0000 7f712dd9b700 1 -- 172.21.15.81:0/387722878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712800e070 con 0x7f7130068e90 2023-10-07T08:53:36.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.363+0000 7f712dd9b700 1 -- 172.21.15.81:0/387722878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712800bbf0 con 0x7f7130068e90 2023-10-07T08:53:36.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.363+0000 7f712dd9b700 1 -- 172.21.15.81:0/387722878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128012430 con 0x7f7130068e90 2023-10-07T08:53:36.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.363+0000 7f712f59e700 1 -- 172.21.15.81:0/387722878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7130068e90 msgr2=0x7f7130164c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.363+0000 7f712f59e700 1 --2- 172.21.15.81:0/387722878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7130068e90 0x7f7130164c70 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f7128009e60 tx=0x7f7128009780 comp rx=0 tx=0).stop 2023-10-07T08:53:36.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.363+0000 7f712f59e700 1 -- 172.21.15.81:0/387722878 shutdown_connections 2023-10-07T08:53:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.363+0000 7f712f59e700 1 --2- 172.21.15.81:0/387722878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7130068e90 0x7f7130164c70 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.363+0000 7f712f59e700 1 -- 172.21.15.81:0/387722878 >> 172.21.15.81:0/387722878 conn(0x7f71300cd660 msgr2=0x7f71300cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.363+0000 7f712f59e700 1 -- 172.21.15.81:0/387722878 shutdown_connections 2023-10-07T08:53:36.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.363+0000 7f712f59e700 1 -- 172.21.15.81:0/387722878 wait complete. 2023-10-07T08:53:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.364+0000 7f712f59e700 1 Processor -- start 2023-10-07T08:53:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.364+0000 7f712f59e700 1 -- start start 2023-10-07T08:53:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.365+0000 7f712f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7130068e90 0x7f713016e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.365+0000 7f712f59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7130159b40 0x7f71301474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.365+0000 7f712f59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7130159f10 0x7f713016a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.365+0000 7f712f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713016ddd0 con 0x7f7130068e90 2023-10-07T08:53:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.365+0000 7f712f59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713016b2d0 con 0x7f7130159b40 2023-10-07T08:53:36.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.365+0000 7f712f59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713016ad10 con 0x7f7130159f10 2023-10-07T08:53:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.365+0000 7f712e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7130068e90 0x7f713016e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.365+0000 7f712e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7130068e90 0x7f713016e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59956/0 (socket says 172.21.15.81:59956) 2023-10-07T08:53:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.365+0000 7f712e59c700 1 -- 172.21.15.81:0/4144040723 learned_addr learned my addr 172.21.15.81:0/4144040723 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.365+0000 7f7125d9b700 1 --2- 172.21.15.81:0/4144040723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7130159b40 0x7f71301474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.365+0000 7f712ed9d700 1 --2- 172.21.15.81:0/4144040723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7130159f10 0x7f713016a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.365+0000 7f712e59c700 1 -- 172.21.15.81:0/4144040723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7130159f10 msgr2=0x7f713016a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.365+0000 7f712e59c700 1 --2- 172.21.15.81:0/4144040723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7130159f10 0x7f713016a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.365+0000 7f712e59c700 1 -- 172.21.15.81:0/4144040723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7130159b40 msgr2=0x7f71301474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.365+0000 7f712e59c700 1 --2- 172.21.15.81:0/4144040723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7130159b40 0x7f71301474c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.366+0000 7f712e59c700 1 -- 172.21.15.81:0/4144040723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7128009a20 con 0x7f7130068e90 2023-10-07T08:53:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.366+0000 7f7125d9b700 1 --2- 172.21.15.81:0/4144040723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7130159b40 0x7f71301474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.366+0000 7f712ed9d700 1 --2- 172.21.15.81:0/4144040723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7130159f10 0x7f713016a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.366+0000 7f712e59c700 1 --2- 172.21.15.81:0/4144040723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7130068e90 0x7f713016e260 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f712000c7e0 tx=0x7f7120007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.366+0000 7f7126ffd700 1 -- 172.21.15.81:0/4144040723 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7120005b30 con 0x7f7130068e90 2023-10-07T08:53:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.366+0000 7f7126ffd700 1 -- 172.21.15.81:0/4144040723 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7120005c90 con 0x7f7130068e90 2023-10-07T08:53:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.366+0000 7f7126ffd700 1 -- 172.21.15.81:0/4144040723 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7120007300 con 0x7f7130068e90 2023-10-07T08:53:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.366+0000 7f712f59e700 1 -- 172.21.15.81:0/4144040723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713016aff0 con 0x7f7130068e90 2023-10-07T08:53:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.366+0000 7f712f59e700 1 -- 172.21.15.81:0/4144040723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713016e7a0 con 0x7f7130068e90 2023-10-07T08:53:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.367+0000 7f712f59e700 1 -- 172.21.15.81:0/4144040723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7130063e90 con 0x7f7130068e90 2023-10-07T08:53:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.367+0000 7f7126ffd700 1 -- 172.21.15.81:0/4144040723 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f712001b400 con 0x7f7130068e90 2023-10-07T08:53:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.367+0000 7f7126ffd700 1 --2- 172.21.15.81:0/4144040723 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7110066f30 0x7f71100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.368+0000 7f7126ffd700 1 -- 172.21.15.81:0/4144040723 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f7120084050 con 0x7f7130068e90 2023-10-07T08:53:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.368+0000 7f7125d9b700 1 --2- 172.21.15.81:0/4144040723 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7110066f30 0x7f71100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.368+0000 7f7126ffd700 1 -- 172.21.15.81:0/4144040723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7f711006eab0 con 0x7f7130068e90 2023-10-07T08:53:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.368+0000 7f7125d9b700 1 --2- 172.21.15.81:0/4144040723 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7110066f30 0x7f71100693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7118006fd0 tx=0x7f7118008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.372+0000 7f7126ffd700 1 -- 172.21.15.81:0/4144040723 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7120051320 con 0x7f7130068e90 2023-10-07T08:53:36.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.555+0000 7f712f59e700 1 -- 172.21.15.81:0/4144040723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71300ceaa0 con 0x7f7130068e90 2023-10-07T08:53:36.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.556+0000 7f7126ffd700 1 -- 172.21.15.81:0/4144040723 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+15393 (secure 0 0 0) 0x7f7120054940 con 0x7f7130068e90 2023-10-07T08:53:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:36.558 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":177,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:53:08.329321+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:52:21.579591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-07T08:52:22.231614+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.1b","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:53:36.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.558+0000 7f712f59e700 1 -- 172.21.15.81:0/4144040723 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7110066f30 msgr2=0x7f71100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.558+0000 7f712f59e700 1 --2- 172.21.15.81:0/4144040723 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7110066f30 0x7f71100693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7118006fd0 tx=0x7f7118008040 comp rx=0 tx=0).stop 2023-10-07T08:53:36.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.558+0000 7f712f59e700 1 -- 172.21.15.81:0/4144040723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7130068e90 msgr2=0x7f713016e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.558+0000 7f712f59e700 1 --2- 172.21.15.81:0/4144040723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7130068e90 0x7f713016e260 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f712000c7e0 tx=0x7f7120007df0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.558+0000 7f712f59e700 1 -- 172.21.15.81:0/4144040723 shutdown_connections 2023-10-07T08:53:36.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.558+0000 7f712f59e700 1 --2- 172.21.15.81:0/4144040723 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7110066f30 0x7f71100693e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.558+0000 7f712f59e700 1 --2- 172.21.15.81:0/4144040723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7130159f10 0x7f713016a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.558+0000 7f712f59e700 1 --2- 172.21.15.81:0/4144040723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7130068e90 0x7f713016e260 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.558+0000 7f712f59e700 1 --2- 172.21.15.81:0/4144040723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7130159b40 0x7f71301474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.558+0000 7f712f59e700 1 -- 172.21.15.81:0/4144040723 >> 172.21.15.81:0/4144040723 conn(0x7f71300cd660 msgr2=0x7f713006d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:36.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.559+0000 7f712f59e700 1 -- 172.21.15.81:0/4144040723 shutdown_connections 2023-10-07T08:53:36.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.559+0000 7f712f59e700 1 -- 172.21.15.81:0/4144040723 wait complete. 2023-10-07T08:53:36.572 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T08:53:36.572 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:53:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.684+0000 7fc19b477700 1 Processor -- start 2023-10-07T08:53:36.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.684+0000 7fc19b477700 1 -- start start 2023-10-07T08:53:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.685+0000 7fc19b477700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1941569e0 0x7fc1940b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:36.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.685+0000 7fc19b477700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1940b2290 con 0x7fc19406e940 2023-10-07T08:53:36.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.685+0000 7fc19b477700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc194157c00 con 0x7fc194156db0 2023-10-07T08:53:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.685+0000 7fc19b477700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1941572d0 con 0x7fc1941569e0 2023-10-07T08:53:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.685+0000 7fc199213700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1941569e0 0x7fc1940b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.685+0000 7fc199a14700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc19406e940 0x7fc1940cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47692/0 (socket says 172.21.15.81:47692) 2023-10-07T08:53:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.685+0000 7fc199213700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1941569e0 0x7fc1940b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59966/0 (socket says 172.21.15.81:59966) 2023-10-07T08:53:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.685+0000 7fc199a14700 1 -- 172.21.15.81:0/133603857 learned_addr learned my addr 172.21.15.81:0/133603857 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.686+0000 7fc199213700 1 -- 172.21.15.81:0/133603857 >> v1:172.21.15.89:6789/0 conn(0x7fc194156db0 legacy=0x7fc19406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.686+0000 7fc199213700 1 -- 172.21.15.81:0/133603857 >> v1:172.21.15.81:6789/0 conn(0x7fc19406e940 legacy=0x7fc1940cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.686+0000 7fc199213700 1 -- 172.21.15.81:0/133603857 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1941575b0 con 0x7fc1941569e0 2023-10-07T08:53:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.686+0000 7fc18bfff700 1 -- 172.21.15.81:0/133603857 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494026374 0 0) 0x7fc1940b2290 con 0x7fc19406e940 2023-10-07T08:53:36.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.686+0000 7fc199213700 1 --2- 172.21.15.81:0/133603857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1941569e0 0x7fc1940b17d0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fc19000bb90 tx=0x7fc19000b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71469d8b6109a943 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:36.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.686+0000 7fc18bfff700 1 -- 172.21.15.81:0/133603857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19000dba0 con 0x7fc1941569e0 2023-10-07T08:53:36.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.686+0000 7fc18bfff700 1 -- 172.21.15.81:0/133603857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19000dd00 con 0x7fc1941569e0 2023-10-07T08:53:36.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.686+0000 7fc18bfff700 1 -- 172.21.15.81:0/133603857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1900196b0 con 0x7fc1941569e0 2023-10-07T08:53:36.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.686+0000 7fc19b477700 1 -- 172.21.15.81:0/133603857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1941569e0 msgr2=0x7fc1940b17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.686+0000 7fc19b477700 1 --2- 172.21.15.81:0/133603857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1941569e0 0x7fc1940b17d0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fc19000bb90 tx=0x7fc19000b430 comp rx=0 tx=0).stop 2023-10-07T08:53:36.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.687+0000 7fc19b477700 1 -- 172.21.15.81:0/133603857 shutdown_connections 2023-10-07T08:53:36.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.687+0000 7fc19b477700 1 --2- 172.21.15.81:0/133603857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1941569e0 0x7fc1940b17d0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.687+0000 7fc19b477700 1 -- 172.21.15.81:0/133603857 >> 172.21.15.81:0/133603857 conn(0x7fc19406cca0 msgr2=0x7fc19406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.687+0000 7fc19b477700 1 -- 172.21.15.81:0/133603857 shutdown_connections 2023-10-07T08:53:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.687+0000 7fc19b477700 1 -- 172.21.15.81:0/133603857 wait complete. 2023-10-07T08:53:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.688+0000 7fc19b477700 1 Processor -- start 2023-10-07T08:53:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.688+0000 7fc19b477700 1 -- start start 2023-10-07T08:53:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.688+0000 7fc19b477700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc19406e940 0x7fc194159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.688+0000 7fc19b477700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1941569e0 0x7fc19416af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc19b477700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc194156db0 0x7fc1940b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:36.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc19b477700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc194158460 con 0x7fc19406e940 2023-10-07T08:53:36.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc19b477700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1940c9f20 con 0x7fc194156db0 2023-10-07T08:53:36.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc19b477700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19415b160 con 0x7fc1941569e0 2023-10-07T08:53:36.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc199213700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc19406e940 0x7fc194159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:36.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc199213700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc19406e940 0x7fc194159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59974/0 (socket says 172.21.15.81:59974) 2023-10-07T08:53:36.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc199213700 1 -- 172.21.15.81:0/3515339539 learned_addr learned my addr 172.21.15.81:0/3515339539 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:36.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc199a14700 1 --2- 172.21.15.81:0/3515339539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc194156db0 0x7fc1940b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:36.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc199213700 1 -- 172.21.15.81:0/3515339539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1941569e0 msgr2=0x7fc19416af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc199213700 1 --2- 172.21.15.81:0/3515339539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1941569e0 0x7fc19416af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc199213700 1 -- 172.21.15.81:0/3515339539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc194156db0 msgr2=0x7fc1940b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc199213700 1 --2- 172.21.15.81:0/3515339539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc194156db0 0x7fc1940b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc199213700 1 -- 172.21.15.81:0/3515339539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19000b6d0 con 0x7fc19406e940 2023-10-07T08:53:36.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc199a14700 1 --2- 172.21.15.81:0/3515339539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc194156db0 0x7fc1940b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:36.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc199213700 1 --2- 172.21.15.81:0/3515339539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc19406e940 0x7fc194159f00 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fc19000b2c0 tx=0x7fc19001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:36.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc1897fa700 1 -- 172.21.15.81:0/3515339539 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc190010570 con 0x7fc19406e940 2023-10-07T08:53:36.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc1897fa700 1 -- 172.21.15.81:0/3515339539 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1900106d0 con 0x7fc19406e940 2023-10-07T08:53:36.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc19b477700 1 -- 172.21.15.81:0/3515339539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19416b470 con 0x7fc19406e940 2023-10-07T08:53:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc1897fa700 1 -- 172.21.15.81:0/3515339539 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc190010a90 con 0x7fc19406e940 2023-10-07T08:53:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.689+0000 7fc19b477700 1 -- 172.21.15.81:0/3515339539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19415ab10 con 0x7fc19406e940 2023-10-07T08:53:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.690+0000 7fc19b477700 1 -- 172.21.15.81:0/3515339539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc194068900 con 0x7fc19406e940 2023-10-07T08:53:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.690+0000 7fc1897fa700 1 -- 172.21.15.81:0/3515339539 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc190024420 con 0x7fc19406e940 2023-10-07T08:53:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.691+0000 7fc1897fa700 1 --2- 172.21.15.81:0/3515339539 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc178066f30 0x7fc1780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.691+0000 7fc1897fa700 1 -- 172.21.15.81:0/3515339539 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fc190020070 con 0x7fc19406e940 2023-10-07T08:53:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.691+0000 7fc198a12700 1 --2- 172.21.15.81:0/3515339539 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc178066f30 0x7fc1780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:36.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.691+0000 7fc1897fa700 1 -- 172.21.15.81:0/3515339539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7fc17806eab0 con 0x7fc19406e940 2023-10-07T08:53:36.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.691+0000 7fc198a12700 1 --2- 172.21.15.81:0/3515339539 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc178066f30 0x7fc1780693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc194155e90 tx=0x7fc184007b40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:36.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.695+0000 7fc1897fa700 1 -- 172.21.15.81:0/3515339539 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc190053a60 con 0x7fc19406e940 2023-10-07T08:53:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.917+0000 7fc19b477700 1 -- 172.21.15.81:0/3515339539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc194157890 con 0x7fc19406e940 2023-10-07T08:53:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.917+0000 7fc1897fa700 1 -- 172.21.15.81:0/3515339539 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4598 (secure 0 0 0) 0x7fc190057080 con 0x7fc19406e940 2023-10-07T08:53:36.933 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:36.933 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3709604420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3709604420},{"type":"v1","addr":"172.21.15.89:6835","nonce":3709604420}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7842,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/517568220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":517568220},{"type":"v1","addr":"172.21.15.81:6836","nonce":517568220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7845,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2183069282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2183069282},{"type":"v1","addr":"172.21.15.81:6837","nonce":2183069282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:52:23.270892+0000","modified":"2023-10-07T08:52:26.901820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7851":{"gid":7851,"name":"b","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6834/3341511949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3341511949},{"type":"v1","addr":"172.21.15.89:6834","nonce":3341511949}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-07T08:53:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.920+0000 7fc19b477700 1 -- 172.21.15.81:0/3515339539 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc178066f30 msgr2=0x7fc1780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.920+0000 7fc19b477700 1 --2- 172.21.15.81:0/3515339539 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc178066f30 0x7fc1780693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc194155e90 tx=0x7fc184007b40 comp rx=0 tx=0).stop 2023-10-07T08:53:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.920+0000 7fc19b477700 1 -- 172.21.15.81:0/3515339539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc19406e940 msgr2=0x7fc194159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.920+0000 7fc19b477700 1 --2- 172.21.15.81:0/3515339539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc19406e940 0x7fc194159f00 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fc19000b2c0 tx=0x7fc19001b000 comp rx=0 tx=0).stop 2023-10-07T08:53:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.920+0000 7fc19b477700 1 -- 172.21.15.81:0/3515339539 shutdown_connections 2023-10-07T08:53:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.920+0000 7fc19b477700 1 --2- 172.21.15.81:0/3515339539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc194156db0 0x7fc1940b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.920+0000 7fc19b477700 1 --2- 172.21.15.81:0/3515339539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc19406e940 0x7fc194159f00 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.920+0000 7fc19b477700 1 --2- 172.21.15.81:0/3515339539 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc178066f30 0x7fc1780693e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.920+0000 7fc19b477700 1 --2- 172.21.15.81:0/3515339539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1941569e0 0x7fc19416af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:36.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.920+0000 7fc19b477700 1 -- 172.21.15.81:0/3515339539 >> 172.21.15.81:0/3515339539 conn(0x7fc19406cca0 msgr2=0x7fc1941547a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:36.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.920+0000 7fc19b477700 1 -- 172.21.15.81:0/3515339539 shutdown_connections 2023-10-07T08:53:36.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:36.920+0000 7fc19b477700 1 -- 172.21.15.81:0/3515339539 wait complete. 2023-10-07T08:53:36.936 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 82 2023-10-07T08:53:36.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:53:37.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.047+0000 7fd119794700 1 Processor -- start 2023-10-07T08:53:37.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.048+0000 7fd119794700 1 -- start start 2023-10-07T08:53:37.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.048+0000 7fd119794700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd11406d830 0x7fd1140cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.048+0000 7fd119794700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1140d07c0 con 0x7fd1141578d0 2023-10-07T08:53:37.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.048+0000 7fd119794700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1140cfbb0 con 0x7fd114157ca0 2023-10-07T08:53:37.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.048+0000 7fd119794700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1140cfe90 con 0x7fd11406d830 2023-10-07T08:53:37.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.048+0000 7fd1137fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd11406d830 0x7fd1140cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:37.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.049+0000 7fd112ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd1141578d0 0x7fd11415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47704/0 (socket says 172.21.15.81:47704) 2023-10-07T08:53:37.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.049+0000 7fd112ffd700 1 -- 172.21.15.81:0/373093511 learned_addr learned my addr 172.21.15.81:0/373093511 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:37.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.049+0000 7fd1137fe700 1 -- 172.21.15.81:0/373093511 >> v1:172.21.15.89:6789/0 conn(0x7fd114157ca0 legacy=0x7fd11406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:37.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.049+0000 7fd1137fe700 1 -- 172.21.15.81:0/373093511 >> v1:172.21.15.81:6789/0 conn(0x7fd1141578d0 legacy=0x7fd11415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:37.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.049+0000 7fd1137fe700 1 -- 172.21.15.81:0/373093511 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1140d0170 con 0x7fd11406d830 2023-10-07T08:53:37.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.049+0000 7fd111ffb700 1 -- 172.21.15.81:0/373093511 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764912613 0 0) 0x7fd1140d07c0 con 0x7fd1141578d0 2023-10-07T08:53:37.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.049+0000 7fd1137fe700 1 --2- 172.21.15.81:0/373093511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11406d830 0x7fd1140cf4f0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0098e0 tx=0x7fd10c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37cd4a4e2e8fe0f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:37.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.049+0000 7fd111ffb700 1 -- 172.21.15.81:0/373093511 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c009e80 con 0x7fd11406d830 2023-10-07T08:53:37.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.049+0000 7fd111ffb700 1 -- 172.21.15.81:0/373093511 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10c00b820 con 0x7fd11406d830 2023-10-07T08:53:37.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.049+0000 7fd111ffb700 1 -- 172.21.15.81:0/373093511 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c00bba0 con 0x7fd11406d830 2023-10-07T08:53:37.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.050+0000 7fd119794700 1 -- 172.21.15.81:0/373093511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11406d830 msgr2=0x7fd1140cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:37.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.050+0000 7fd119794700 1 --2- 172.21.15.81:0/373093511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11406d830 0x7fd1140cf4f0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0098e0 tx=0x7fd10c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.050+0000 7fd119794700 1 -- 172.21.15.81:0/373093511 shutdown_connections 2023-10-07T08:53:37.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.050+0000 7fd119794700 1 --2- 172.21.15.81:0/373093511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11406d830 0x7fd1140cf4f0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.050+0000 7fd119794700 1 -- 172.21.15.81:0/373093511 >> 172.21.15.81:0/373093511 conn(0x7fd11406bb90 msgr2=0x7fd11406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:37.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.050+0000 7fd119794700 1 -- 172.21.15.81:0/373093511 shutdown_connections 2023-10-07T08:53:37.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.050+0000 7fd119794700 1 -- 172.21.15.81:0/373093511 wait complete. 2023-10-07T08:53:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.051+0000 7fd119794700 1 Processor -- start 2023-10-07T08:53:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.051+0000 7fd119794700 1 -- start start 2023-10-07T08:53:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd119794700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11406d830 0x7fd114153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd119794700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1141578d0 0x7fd1140b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd119794700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd114157ca0 0x7fd11415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd119794700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140b6890 con 0x7fd11406d830 2023-10-07T08:53:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd119794700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140b4320 con 0x7fd1141578d0 2023-10-07T08:53:37.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd119794700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd114154400 con 0x7fd114157ca0 2023-10-07T08:53:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd112ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11406d830 0x7fd114153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd112ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11406d830 0x7fd114153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59988/0 (socket says 172.21.15.81:59988) 2023-10-07T08:53:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd112ffd700 1 -- 172.21.15.81:0/641655055 learned_addr learned my addr 172.21.15.81:0/641655055 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd1127fc700 1 --2- 172.21.15.81:0/641655055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1141578d0 0x7fd1140b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd1137fe700 1 --2- 172.21.15.81:0/641655055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd114157ca0 0x7fd11415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd112ffd700 1 -- 172.21.15.81:0/641655055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd114157ca0 msgr2=0x7fd11415c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd112ffd700 1 --2- 172.21.15.81:0/641655055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd114157ca0 0x7fd11415c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd112ffd700 1 -- 172.21.15.81:0/641655055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1141578d0 msgr2=0x7fd1140b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd112ffd700 1 --2- 172.21.15.81:0/641655055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1141578d0 0x7fd1140b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd112ffd700 1 -- 172.21.15.81:0/641655055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c009420 con 0x7fd11406d830 2023-10-07T08:53:37.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd1127fc700 1 --2- 172.21.15.81:0/641655055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1141578d0 0x7fd1140b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:37.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd112ffd700 1 --2- 172.21.15.81:0/641655055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11406d830 0x7fd114153ec0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fd10400cd80 tx=0x7fd104001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:37.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd10affd700 1 -- 172.21.15.81:0/641655055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10400ab10 con 0x7fd11406d830 2023-10-07T08:53:37.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd10affd700 1 -- 172.21.15.81:0/641655055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10400ac70 con 0x7fd11406d830 2023-10-07T08:53:37.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd119794700 1 -- 172.21.15.81:0/641655055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1140b65b0 con 0x7fd11406d830 2023-10-07T08:53:37.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd10affd700 1 -- 172.21.15.81:0/641655055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040070f0 con 0x7fd11406d830 2023-10-07T08:53:37.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.052+0000 7fd119794700 1 -- 172.21.15.81:0/641655055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1140b3fb0 con 0x7fd11406d830 2023-10-07T08:53:37.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.053+0000 7fd119794700 1 -- 172.21.15.81:0/641655055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1140cead0 con 0x7fd11406d830 2023-10-07T08:53:37.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.054+0000 7fd10affd700 1 -- 172.21.15.81:0/641655055 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1040074e0 con 0x7fd11406d830 2023-10-07T08:53:37.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.054+0000 7fd10affd700 1 --2- 172.21.15.81:0/641655055 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd0f4066f30 0x7fd0f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.054+0000 7fd10affd700 1 -- 172.21.15.81:0/641655055 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fd104084af0 con 0x7fd11406d830 2023-10-07T08:53:37.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.054+0000 7fd1127fc700 1 --2- 172.21.15.81:0/641655055 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd0f4066f30 0x7fd0f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:37.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.054+0000 7fd10affd700 1 -- 172.21.15.81:0/641655055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7fd0f406eab0 con 0x7fd11406d830 2023-10-07T08:53:37.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.055+0000 7fd1127fc700 1 --2- 172.21.15.81:0/641655055 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd0f4066f30 0x7fd0f40693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc006fd0 tx=0x7fd0fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:37.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.058+0000 7fd10affd700 1 -- 172.21.15.81:0/641655055 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd104051d20 con 0x7fd11406d830 2023-10-07T08:53:37.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.282+0000 7fd119794700 1 -- 172.21.15.81:0/641655055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1140d0450 con 0x7fd11406d830 2023-10-07T08:53:37.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.282+0000 7fd10affd700 1 -- 172.21.15.81:0/641655055 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4598 (secure 0 0 0) 0x7fd104055340 con 0x7fd11406d830 2023-10-07T08:53:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:37.295 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3709604420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3709604420},{"type":"v1","addr":"172.21.15.89:6835","nonce":3709604420}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7842,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/517568220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":517568220},{"type":"v1","addr":"172.21.15.81:6836","nonce":517568220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7845,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2183069282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2183069282},{"type":"v1","addr":"172.21.15.81:6837","nonce":2183069282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:52:23.270892+0000","modified":"2023-10-07T08:52:26.901820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7851":{"gid":7851,"name":"b","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6834/3341511949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3341511949},{"type":"v1","addr":"172.21.15.89:6834","nonce":3341511949}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-07T08:53:37.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.284+0000 7fd119794700 1 -- 172.21.15.81:0/641655055 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd0f4066f30 msgr2=0x7fd0f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.284+0000 7fd119794700 1 --2- 172.21.15.81:0/641655055 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd0f4066f30 0x7fd0f40693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc006fd0 tx=0x7fd0fc008040 comp rx=0 tx=0).stop 2023-10-07T08:53:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.284+0000 7fd119794700 1 -- 172.21.15.81:0/641655055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11406d830 msgr2=0x7fd114153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.284+0000 7fd119794700 1 --2- 172.21.15.81:0/641655055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11406d830 0x7fd114153ec0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fd10400cd80 tx=0x7fd104001ae0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.284+0000 7fd119794700 1 -- 172.21.15.81:0/641655055 shutdown_connections 2023-10-07T08:53:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.284+0000 7fd119794700 1 --2- 172.21.15.81:0/641655055 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd0f4066f30 0x7fd0f40693e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.284+0000 7fd119794700 1 --2- 172.21.15.81:0/641655055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd114157ca0 0x7fd11415c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.284+0000 7fd119794700 1 --2- 172.21.15.81:0/641655055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd11406d830 0x7fd114153ec0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.284+0000 7fd119794700 1 --2- 172.21.15.81:0/641655055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1141578d0 0x7fd1140b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.284+0000 7fd119794700 1 -- 172.21.15.81:0/641655055 >> 172.21.15.81:0/641655055 conn(0x7fd11406bb90 msgr2=0x7fd11406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.284+0000 7fd119794700 1 -- 172.21.15.81:0/641655055 shutdown_connections 2023-10-07T08:53:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.284+0000 7fd119794700 1 -- 172.21.15.81:0/641655055 wait complete. 2023-10-07T08:53:37.394 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 82 2023-10-07T08:53:37.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:53:37.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.510+0000 7f897d335700 1 Processor -- start 2023-10-07T08:53:37.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.510+0000 7f897d335700 1 -- start start 2023-10-07T08:53:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.511+0000 7f897d335700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8978157fe0 0x7f89780b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.511+0000 7f897d335700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f89780cf240 0x7f89780b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.511+0000 7f897d335700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89780b2890 con 0x7f89781583b0 2023-10-07T08:53:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.511+0000 7f897d335700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89780b4070 con 0x7f8978157fe0 2023-10-07T08:53:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.511+0000 7f897d335700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89780b4350 con 0x7f89780cf240 2023-10-07T08:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.511+0000 7f8976ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8978157fe0 0x7f89780b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.511+0000 7f8976ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8978157fe0 0x7f89780b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60002/0 (socket says 172.21.15.81:60002) 2023-10-07T08:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.511+0000 7f8976ffd700 1 -- 172.21.15.81:0/981212718 learned_addr learned my addr 172.21.15.81:0/981212718 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.512+0000 7f89777fe700 1 --2- 172.21.15.81:0/981212718 >> v2:172.21.15.89:3300/0 conn(0x7f89780cf240 0x7f89780b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.512+0000 7f8976ffd700 1 -- 172.21.15.81:0/981212718 >> v2:172.21.15.89:3300/0 conn(0x7f89780cf240 msgr2=0x7f89780b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.512+0000 7f8976ffd700 1 --2- 172.21.15.81:0/981212718 >> v2:172.21.15.89:3300/0 conn(0x7f89780cf240 0x7f89780b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.512+0000 7f8976ffd700 1 -- 172.21.15.81:0/981212718 >> v1:172.21.15.89:6789/0 conn(0x7f89781583b0 legacy=0x7f89780ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.512+0000 7f8976ffd700 1 -- 172.21.15.81:0/981212718 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89780b4630 con 0x7f8978157fe0 2023-10-07T08:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.512+0000 7f89777fe700 1 --2- 172.21.15.81:0/981212718 >> v2:172.21.15.89:3300/0 conn(0x7f89780cf240 0x7f89780b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.512+0000 7f8976ffd700 1 --2- 172.21.15.81:0/981212718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8978157fe0 0x7f89780b34c0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f8978069790 tx=0x7f8968009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b489763f07413196 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.512+0000 7f89767fc700 1 -- 172.21.15.81:0/981212718 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896800b820 con 0x7f8978157fe0 2023-10-07T08:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.512+0000 7f89767fc700 1 -- 172.21.15.81:0/981212718 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896800b980 con 0x7f8978157fe0 2023-10-07T08:53:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.512+0000 7f89767fc700 1 -- 172.21.15.81:0/981212718 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896800bd20 con 0x7f8978157fe0 2023-10-07T08:53:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.512+0000 7f897d335700 1 -- 172.21.15.81:0/981212718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8978157fe0 msgr2=0x7f89780b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.512+0000 7f897d335700 1 --2- 172.21.15.81:0/981212718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8978157fe0 0x7f89780b34c0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f8978069790 tx=0x7f8968009250 comp rx=0 tx=0).stop 2023-10-07T08:53:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.512+0000 7f897d335700 1 -- 172.21.15.81:0/981212718 shutdown_connections 2023-10-07T08:53:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.512+0000 7f897d335700 1 --2- 172.21.15.81:0/981212718 >> v2:172.21.15.89:3300/0 conn(0x7f89780cf240 0x7f89780b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.512+0000 7f897d335700 1 --2- 172.21.15.81:0/981212718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8978157fe0 0x7f89780b34c0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.513+0000 7f897d335700 1 -- 172.21.15.81:0/981212718 >> 172.21.15.81:0/981212718 conn(0x7f8978067640 msgr2=0x7f8978067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.513+0000 7f897d335700 1 -- 172.21.15.81:0/981212718 shutdown_connections 2023-10-07T08:53:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.513+0000 7f897d335700 1 -- 172.21.15.81:0/981212718 wait complete. 2023-10-07T08:53:37.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.514+0000 7f897d335700 1 Processor -- start 2023-10-07T08:53:37.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.514+0000 7f897d335700 1 -- start start 2023-10-07T08:53:37.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.514+0000 7f897d335700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89780cf240 0x7f8978151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.514+0000 7f897d335700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8978157fe0 0x7f897806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.514+0000 7f897d335700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89781583b0 0x7f89780c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f897d335700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89780b0140 con 0x7f89781583b0 2023-10-07T08:53:37.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f897d335700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89780c8cb0 con 0x7f8978157fe0 2023-10-07T08:53:37.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f897d335700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89780c80a0 con 0x7f89780cf240 2023-10-07T08:53:37.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f89777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89781583b0 0x7f89780c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:37.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f89777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89781583b0 0x7f89780c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60012/0 (socket says 172.21.15.81:60012) 2023-10-07T08:53:37.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f89777fe700 1 -- 172.21.15.81:0/843150080 learned_addr learned my addr 172.21.15.81:0/843150080 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:37.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f896e7fc700 1 --2- 172.21.15.81:0/843150080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8978157fe0 0x7f897806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:37.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f8976ffd700 1 --2- 172.21.15.81:0/843150080 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89780cf240 0x7f8978151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:37.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f89777fe700 1 -- 172.21.15.81:0/843150080 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89780cf240 msgr2=0x7f8978151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:37.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f89777fe700 1 --2- 172.21.15.81:0/843150080 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89780cf240 0x7f8978151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f89777fe700 1 -- 172.21.15.81:0/843150080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8978157fe0 msgr2=0x7f897806e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:37.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f89777fe700 1 --2- 172.21.15.81:0/843150080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8978157fe0 0x7f897806e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f89777fe700 1 -- 172.21.15.81:0/843150080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89680094f0 con 0x7f89781583b0 2023-10-07T08:53:37.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f896e7fc700 1 --2- 172.21.15.81:0/843150080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8978157fe0 0x7f897806e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:53:37.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f89777fe700 1 --2- 172.21.15.81:0/843150080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89781583b0 0x7f89780c9090 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f897000cef0 tx=0x7f8970007850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:37.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f896f7fe700 1 -- 172.21.15.81:0/843150080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897000ae00 con 0x7f89781583b0 2023-10-07T08:53:37.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f896f7fe700 1 -- 172.21.15.81:0/843150080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8970016430 con 0x7f89781583b0 2023-10-07T08:53:37.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f897d335700 1 -- 172.21.15.81:0/843150080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89780c8380 con 0x7f89781583b0 2023-10-07T08:53:37.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f896f7fe700 1 -- 172.21.15.81:0/843150080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89700167f0 con 0x7f89781583b0 2023-10-07T08:53:37.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.515+0000 7f897d335700 1 -- 172.21.15.81:0/843150080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89780c8940 con 0x7f89781583b0 2023-10-07T08:53:37.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.516+0000 7f897d335700 1 -- 172.21.15.81:0/843150080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89780c8e60 con 0x7f89781583b0 2023-10-07T08:53:37.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.517+0000 7f896f7fe700 1 -- 172.21.15.81:0/843150080 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8970003020 con 0x7f89781583b0 2023-10-07T08:53:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.517+0000 7f896f7fe700 1 --2- 172.21.15.81:0/843150080 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8958066f30 0x7f89580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.517+0000 7f896f7fe700 1 -- 172.21.15.81:0/843150080 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f8970012070 con 0x7f89781583b0 2023-10-07T08:53:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.517+0000 7f8976ffd700 1 --2- 172.21.15.81:0/843150080 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8958066f30 0x7f89580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.517+0000 7f896f7fe700 1 -- 172.21.15.81:0/843150080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7f895806eab0 con 0x7f89781583b0 2023-10-07T08:53:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.517+0000 7f8976ffd700 1 --2- 172.21.15.81:0/843150080 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8958066f30 0x7f89580693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8978069790 tx=0x7f8968016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.521+0000 7f896f7fe700 1 -- 172.21.15.81:0/843150080 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89780c8e60 con 0x7f89781583b0 2023-10-07T08:53:37.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.704+0000 7f897d335700 1 -- 172.21.15.81:0/843150080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8978063df0 con 0x7f89781583b0 2023-10-07T08:53:37.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.705+0000 7f896f7fe700 1 -- 172.21.15.81:0/843150080 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+15393 (secure 0 0 0) 0x7f89700560a0 con 0x7f89781583b0 2023-10-07T08:53:37.707 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:37.707 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":177,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:53:08.329321+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:52:21.579591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-07T08:52:22.231614+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.1b","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:53:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.707+0000 7f897d335700 1 -- 172.21.15.81:0/843150080 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8958066f30 msgr2=0x7f89580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.707+0000 7f897d335700 1 --2- 172.21.15.81:0/843150080 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8958066f30 0x7f89580693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8978069790 tx=0x7f8968016000 comp rx=0 tx=0).stop 2023-10-07T08:53:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.707+0000 7f897d335700 1 -- 172.21.15.81:0/843150080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89781583b0 msgr2=0x7f89780c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.707+0000 7f897d335700 1 --2- 172.21.15.81:0/843150080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89781583b0 0x7f89780c9090 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f897000cef0 tx=0x7f8970007850 comp rx=0 tx=0).stop 2023-10-07T08:53:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.707+0000 7f897d335700 1 -- 172.21.15.81:0/843150080 shutdown_connections 2023-10-07T08:53:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.707+0000 7f897d335700 1 --2- 172.21.15.81:0/843150080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89781583b0 0x7f89780c9090 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.707+0000 7f897d335700 1 --2- 172.21.15.81:0/843150080 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8958066f30 0x7f89580693e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.707+0000 7f897d335700 1 --2- 172.21.15.81:0/843150080 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89780cf240 0x7f8978151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.707+0000 7f897d335700 1 --2- 172.21.15.81:0/843150080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8978157fe0 0x7f897806e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.707+0000 7f897d335700 1 -- 172.21.15.81:0/843150080 >> 172.21.15.81:0/843150080 conn(0x7f8978067640 msgr2=0x7f8978155ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.707+0000 7f897d335700 1 -- 172.21.15.81:0/843150080 shutdown_connections 2023-10-07T08:53:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.707+0000 7f897d335700 1 -- 172.21.15.81:0/843150080 wait complete. 2023-10-07T08:53:37.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T08:53:37.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.834+0000 7f10a7339700 1 Processor -- start 2023-10-07T08:53:37.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.834+0000 7f10a7339700 1 -- start start 2023-10-07T08:53:37.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.835+0000 7f10a7339700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10a0157fe0 0x7f10a00b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.835+0000 7f10a7339700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10a01583b0 0x7f10a00b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.835+0000 7f10a7339700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a00b2890 con 0x7f10a00ceb30 2023-10-07T08:53:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.835+0000 7f10a7339700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a00b4070 con 0x7f10a0157fe0 2023-10-07T08:53:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.835+0000 7f10a7339700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00b4350 con 0x7f10a01583b0 2023-10-07T08:53:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.835+0000 7f10a50d5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10a0157fe0 0x7f10a00b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.835+0000 7f10a50d5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10a0157fe0 0x7f10a00b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60018/0 (socket says 172.21.15.81:60018) 2023-10-07T08:53:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.835+0000 7f10a50d5700 1 -- 172.21.15.81:0/2536448141 learned_addr learned my addr 172.21.15.81:0/2536448141 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.835+0000 7f10a50d5700 1 -- 172.21.15.81:0/2536448141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10a01583b0 msgr2=0x7f10a00b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:37.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.835+0000 7f10a50d5700 1 --2- 172.21.15.81:0/2536448141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10a01583b0 0x7f10a00b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.835+0000 7f10a50d5700 1 -- 172.21.15.81:0/2536448141 >> v1:172.21.15.89:6789/0 conn(0x7f10a00ceb30 legacy=0x7f10a00cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:37.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.835+0000 7f10a50d5700 1 -- 172.21.15.81:0/2536448141 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a00b4630 con 0x7f10a0157fe0 2023-10-07T08:53:37.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.835+0000 7f10a50d5700 1 --2- 172.21.15.81:0/2536448141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a0157fe0 0x7f10a00b34c0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f109c009f20 tx=0x7f109c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65253c3fca9998d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:37.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.835+0000 7f1097fff700 1 -- 172.21.15.81:0/2536448141 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c00e070 con 0x7f10a0157fe0 2023-10-07T08:53:37.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.835+0000 7f1097fff700 1 -- 172.21.15.81:0/2536448141 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c00ba40 con 0x7f10a0157fe0 2023-10-07T08:53:37.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.835+0000 7f1097fff700 1 -- 172.21.15.81:0/2536448141 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c0092e0 con 0x7f10a0157fe0 2023-10-07T08:53:37.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.836+0000 7f10a7339700 1 -- 172.21.15.81:0/2536448141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a0157fe0 msgr2=0x7f10a00b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:37.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.836+0000 7f10a7339700 1 --2- 172.21.15.81:0/2536448141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a0157fe0 0x7f10a00b34c0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f109c009f20 tx=0x7f109c009840 comp rx=0 tx=0).stop 2023-10-07T08:53:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.836+0000 7f10a7339700 1 -- 172.21.15.81:0/2536448141 shutdown_connections 2023-10-07T08:53:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.836+0000 7f10a7339700 1 --2- 172.21.15.81:0/2536448141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a0157fe0 0x7f10a00b34c0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.836+0000 7f10a7339700 1 --2- 172.21.15.81:0/2536448141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10a01583b0 0x7f10a00b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.836+0000 7f10a7339700 1 -- 172.21.15.81:0/2536448141 >> 172.21.15.81:0/2536448141 conn(0x7f10a0067640 msgr2=0x7f10a0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.836+0000 7f10a7339700 1 -- 172.21.15.81:0/2536448141 shutdown_connections 2023-10-07T08:53:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.836+0000 7f10a7339700 1 -- 172.21.15.81:0/2536448141 wait complete. 2023-10-07T08:53:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.837+0000 7f10a7339700 1 Processor -- start 2023-10-07T08:53:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.837+0000 7f10a7339700 1 -- start start 2023-10-07T08:53:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a7339700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a00ceb30 0x7f10a0166ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a7339700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10a0157fe0 0x7f10a016c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a7339700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10a01583b0 0x7f10a016caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a7339700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a013c070 con 0x7f10a00ceb30 2023-10-07T08:53:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a7339700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a0150950 con 0x7f10a0157fe0 2023-10-07T08:53:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a7339700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a015ad90 con 0x7f10a01583b0 2023-10-07T08:53:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a50d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a00ceb30 0x7f10a0166ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a50d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a00ceb30 0x7f10a0166ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60026/0 (socket says 172.21.15.81:60026) 2023-10-07T08:53:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a50d5700 1 -- 172.21.15.81:0/1549651942 learned_addr learned my addr 172.21.15.81:0/1549651942 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a48d4700 1 --2- 172.21.15.81:0/1549651942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10a0157fe0 0x7f10a016c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a58d6700 1 --2- 172.21.15.81:0/1549651942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10a01583b0 0x7f10a016caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a50d5700 1 -- 172.21.15.81:0/1549651942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10a01583b0 msgr2=0x7f10a016caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a50d5700 1 --2- 172.21.15.81:0/1549651942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10a01583b0 0x7f10a016caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a50d5700 1 -- 172.21.15.81:0/1549651942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10a0157fe0 msgr2=0x7f10a016c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a50d5700 1 --2- 172.21.15.81:0/1549651942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10a0157fe0 0x7f10a016c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a50d5700 1 -- 172.21.15.81:0/1549651942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c009ae0 con 0x7f10a00ceb30 2023-10-07T08:53:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a48d4700 1 --2- 172.21.15.81:0/1549651942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10a0157fe0 0x7f10a016c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:53:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.838+0000 7f10a50d5700 1 --2- 172.21.15.81:0/1549651942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a00ceb30 0x7f10a0166ba0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f109c00bee0 tx=0x7f109c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.839+0000 7f10957fa700 1 -- 172.21.15.81:0/1549651942 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c012b40 con 0x7f10a00ceb30 2023-10-07T08:53:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.839+0000 7f10957fa700 1 -- 172.21.15.81:0/1549651942 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c012ca0 con 0x7f10a00ceb30 2023-10-07T08:53:37.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.839+0000 7f10a7339700 1 -- 172.21.15.81:0/1549651942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a0150300 con 0x7f10a00ceb30 2023-10-07T08:53:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.839+0000 7f10957fa700 1 -- 172.21.15.81:0/1549651942 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c01e680 con 0x7f10a00ceb30 2023-10-07T08:53:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.839+0000 7f10a7339700 1 -- 172.21.15.81:0/1549651942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a014ff40 con 0x7f10a00ceb30 2023-10-07T08:53:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.840+0000 7f10a7339700 1 -- 172.21.15.81:0/1549651942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a0150130 con 0x7f10a00ceb30 2023-10-07T08:53:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.840+0000 7f10957fa700 1 -- 172.21.15.81:0/1549651942 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f109c01ea70 con 0x7f10a00ceb30 2023-10-07T08:53:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.840+0000 7f10957fa700 1 --2- 172.21.15.81:0/1549651942 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1084066f30 0x7f10840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.841+0000 7f10957fa700 1 -- 172.21.15.81:0/1549651942 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f109c085fa0 con 0x7f10a00ceb30 2023-10-07T08:53:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.841+0000 7f10a48d4700 1 --2- 172.21.15.81:0/1549651942 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1084066f30 0x7f10840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.841+0000 7f10957fa700 1 -- 172.21.15.81:0/1549651942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7f108406eab0 con 0x7f10a00ceb30 2023-10-07T08:53:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.841+0000 7f10a48d4700 1 --2- 172.21.15.81:0/1549651942 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1084066f30 0x7f10840693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f10a016c4c0 tx=0x7f1090008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:37.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:37.845+0000 7f10957fa700 1 -- 172.21.15.81:0/1549651942 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f109c0b75a0 con 0x7f10a00ceb30 2023-10-07T08:53:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.068+0000 7f10a7339700 1 -- 172.21.15.81:0/1549651942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f10a0157b40 con 0x7f10a00ceb30 2023-10-07T08:53:38.070 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:53:38.069+0000 7f43c472d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T08:53:38.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.070+0000 7f10957fa700 1 -- 172.21.15.81:0/1549651942 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(178..178 src has 1..178) v4 ==== 366+0+0 (secure 0 0 0) 0x7f109c05ae40 con 0x7f10a00ceb30 2023-10-07T08:53:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.070+0000 7f10957fa700 1 -- 172.21.15.81:0/1549651942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7f108406f290 con 0x7f10a00ceb30 2023-10-07T08:53:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.073+0000 7f10957fa700 1 -- 172.21.15.81:0/1549651942 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v83) v1 ==== 161+0+0 (secure 0 0 0) 0x7f109c0531f0 con 0x7f10a00ceb30 2023-10-07T08:53:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.075+0000 7f10a7339700 1 -- 172.21.15.81:0/1549651942 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1084066f30 msgr2=0x7f10840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.075+0000 7f10a7339700 1 --2- 172.21.15.81:0/1549651942 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1084066f30 0x7f10840693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f10a016c4c0 tx=0x7f1090008040 comp rx=0 tx=0).stop 2023-10-07T08:53:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.075+0000 7f10a7339700 1 -- 172.21.15.81:0/1549651942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a00ceb30 msgr2=0x7f10a0166ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.075+0000 7f10a7339700 1 --2- 172.21.15.81:0/1549651942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a00ceb30 0x7f10a0166ba0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f109c00bee0 tx=0x7f109c017000 comp rx=0 tx=0).stop 2023-10-07T08:53:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.075+0000 7f10a7339700 1 -- 172.21.15.81:0/1549651942 shutdown_connections 2023-10-07T08:53:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.075+0000 7f10a7339700 1 --2- 172.21.15.81:0/1549651942 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1084066f30 0x7f10840693e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.075+0000 7f10a7339700 1 --2- 172.21.15.81:0/1549651942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10a01583b0 0x7f10a016caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:38.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.075+0000 7f10a7339700 1 --2- 172.21.15.81:0/1549651942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a00ceb30 0x7f10a0166ba0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:38.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.075+0000 7f10a7339700 1 --2- 172.21.15.81:0/1549651942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10a0157fe0 0x7f10a016c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:38.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.075+0000 7f10a7339700 1 -- 172.21.15.81:0/1549651942 >> 172.21.15.81:0/1549651942 conn(0x7f10a0067640 msgr2=0x7f10a00cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:38.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.075+0000 7f10a7339700 1 -- 172.21.15.81:0/1549651942 shutdown_connections 2023-10-07T08:53:38.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.075+0000 7f10a7339700 1 -- 172.21.15.81:0/1549651942 wait complete. 2023-10-07T08:53:38.078 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T08:53:38.079 INFO:tasks.ceph.mds.b.smithi089.stderr: -8350> 2023-10-07T08:52:29.329+0000 7fb73b936700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:53:38.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T08:53:38.108 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-10-07T08:53:38.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.204+0000 7fa938fe0700 1 Processor -- start 2023-10-07T08:53:38.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.204+0000 7fa938fe0700 1 -- start start 2023-10-07T08:53:38.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.205+0000 7fa938fe0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9340d0f50 0x7fa93406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.205+0000 7fa938fe0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa93406d530 0x7fa93415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.205+0000 7fa938fe0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93406d9b0 con 0x7fa9340d0b80 2023-10-07T08:53:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.205+0000 7fa938fe0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93415a690 con 0x7fa93406d530 2023-10-07T08:53:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.205+0000 7fa938fe0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9340cf2d0 con 0x7fa9340d0f50 2023-10-07T08:53:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.205+0000 7fa9337fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa9340d0b80 0x7fa9340cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47706/0 (socket says 172.21.15.81:47706) 2023-10-07T08:53:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.205+0000 7fa9337fe700 1 -- 172.21.15.81:0/708115621 learned_addr learned my addr 172.21.15.81:0/708115621 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.205+0000 7fa933fff700 1 --2- 172.21.15.81:0/708115621 >> v2:172.21.15.89:3300/0 conn(0x7fa93406d530 0x7fa93415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.205+0000 7fa932ffd700 1 --2- 172.21.15.81:0/708115621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9340d0f50 0x7fa93406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.205+0000 7fa9327fc700 1 -- 172.21.15.81:0/708115621 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806553176 0 0) 0x7fa93406d9b0 con 0x7fa9340d0b80 2023-10-07T08:53:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.205+0000 7fa9327fc700 1 -- 172.21.15.81:0/708115621 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa91c003570 con 0x7fa9340d0b80 2023-10-07T08:53:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.206+0000 7fa932ffd700 1 -- 172.21.15.81:0/708115621 >> v2:172.21.15.89:3300/0 conn(0x7fa93406d530 msgr2=0x7fa93415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.206+0000 7fa932ffd700 1 --2- 172.21.15.81:0/708115621 >> v2:172.21.15.89:3300/0 conn(0x7fa93406d530 0x7fa93415b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.206+0000 7fa932ffd700 1 -- 172.21.15.81:0/708115621 >> v1:172.21.15.81:6789/0 conn(0x7fa9340d0b80 legacy=0x7fa9340cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:38.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.206+0000 7fa9327fc700 1 -- 172.21.15.81:0/708115621 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3499657574 0 0) 0x7fa91c003570 con 0x7fa9340d0b80 2023-10-07T08:53:38.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.206+0000 7fa932ffd700 1 -- 172.21.15.81:0/708115621 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9340d0480 con 0x7fa9340d0f50 2023-10-07T08:53:38.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.206+0000 7fa932ffd700 1 --2- 172.21.15.81:0/708115621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9340d0f50 0x7fa93406cff0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa9280098e0 tx=0x7fa9280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eea98b363f42a68d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:38.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.206+0000 7fa9327fc700 1 -- 172.21.15.81:0/708115621 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9240017f0 con 0x7fa9340d0f50 2023-10-07T08:53:38.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.206+0000 7fa9327fc700 1 -- 172.21.15.81:0/708115621 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa928011420 con 0x7fa9340d0f50 2023-10-07T08:53:38.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.206+0000 7fa9327fc700 1 -- 172.21.15.81:0/708115621 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9280117c0 con 0x7fa9340d0f50 2023-10-07T08:53:38.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.206+0000 7fa938fe0700 1 -- 172.21.15.81:0/708115621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9340d0f50 msgr2=0x7fa93406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:38.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.206+0000 7fa938fe0700 1 --2- 172.21.15.81:0/708115621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9340d0f50 0x7fa93406cff0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa9280098e0 tx=0x7fa9280091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:38.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.206+0000 7fa938fe0700 1 -- 172.21.15.81:0/708115621 shutdown_connections 2023-10-07T08:53:38.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.206+0000 7fa938fe0700 1 --2- 172.21.15.81:0/708115621 >> v2:172.21.15.89:3300/0 conn(0x7fa93406d530 0x7fa93415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:38.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.206+0000 7fa938fe0700 1 --2- 172.21.15.81:0/708115621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9340d0f50 0x7fa93406cff0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:38.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.207+0000 7fa938fe0700 1 -- 172.21.15.81:0/708115621 >> 172.21.15.81:0/708115621 conn(0x7fa934063230 msgr2=0x7fa934063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:38.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.207+0000 7fa938fe0700 1 -- 172.21.15.81:0/708115621 shutdown_connections 2023-10-07T08:53:38.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.207+0000 7fa938fe0700 1 -- 172.21.15.81:0/708115621 wait complete. 2023-10-07T08:53:38.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.208+0000 7fa938fe0700 1 Processor -- start 2023-10-07T08:53:38.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.208+0000 7fa938fe0700 1 -- start start 2023-10-07T08:53:38.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa938fe0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa93406d530 0x7fa93415ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:38.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa938fe0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9340d0b80 0x7fa934156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:38.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa938fe0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9340d0f50 0x7fa93416d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:38.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa938fe0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9340c9430 con 0x7fa9340d0b80 2023-10-07T08:53:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa938fe0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93416a310 con 0x7fa9340d0f50 2023-10-07T08:53:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa938fe0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9340c8820 con 0x7fa93406d530 2023-10-07T08:53:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa932ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9340d0b80 0x7fa934156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa932ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9340d0b80 0x7fa934156ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60030/0 (socket says 172.21.15.81:60030) 2023-10-07T08:53:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa932ffd700 1 -- 172.21.15.81:0/2949928515 learned_addr learned my addr 172.21.15.81:0/2949928515 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa9337fe700 1 --2- 172.21.15.81:0/2949928515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa93406d530 0x7fa93415ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa933fff700 1 --2- 172.21.15.81:0/2949928515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9340d0f50 0x7fa93416d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa932ffd700 1 -- 172.21.15.81:0/2949928515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa93406d530 msgr2=0x7fa93415ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa932ffd700 1 --2- 172.21.15.81:0/2949928515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa93406d530 0x7fa93415ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa932ffd700 1 -- 172.21.15.81:0/2949928515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9340d0f50 msgr2=0x7fa93416d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa932ffd700 1 --2- 172.21.15.81:0/2949928515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9340d0f50 0x7fa93416d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa932ffd700 1 -- 172.21.15.81:0/2949928515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa928009420 con 0x7fa9340d0b80 2023-10-07T08:53:38.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa932ffd700 1 --2- 172.21.15.81:0/2949928515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9340d0b80 0x7fa934156ea0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fa9280093f0 tx=0x7fa928016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:38.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa91b7fe700 1 -- 172.21.15.81:0/2949928515 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92801cb30 con 0x7fa9340d0b80 2023-10-07T08:53:38.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa91b7fe700 1 -- 172.21.15.81:0/2949928515 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92801cc90 con 0x7fa9340d0b80 2023-10-07T08:53:38.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa938fe0700 1 -- 172.21.15.81:0/2949928515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9340c8b00 con 0x7fa9340d0b80 2023-10-07T08:53:38.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa91b7fe700 1 -- 172.21.15.81:0/2949928515 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92801a660 con 0x7fa9340d0b80 2023-10-07T08:53:38.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.209+0000 7fa938fe0700 1 -- 172.21.15.81:0/2949928515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9340c90c0 con 0x7fa9340d0b80 2023-10-07T08:53:38.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.210+0000 7fa938fe0700 1 -- 172.21.15.81:0/2949928515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9340676e0 con 0x7fa9340d0b80 2023-10-07T08:53:38.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.211+0000 7fa91b7fe700 1 -- 172.21.15.81:0/2949928515 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa92801aa50 con 0x7fa9340d0b80 2023-10-07T08:53:38.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.211+0000 7fa91b7fe700 1 --2- 172.21.15.81:0/2949928515 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa920066f30 0x7fa9200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:38.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.211+0000 7fa91b7fe700 1 -- 172.21.15.81:0/2949928515 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5820+0+0 (secure 0 0 0) 0x7fa928085de0 con 0x7fa9340d0b80 2023-10-07T08:53:38.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.211+0000 7fa9337fe700 1 --2- 172.21.15.81:0/2949928515 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa920066f30 0x7fa9200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:38.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.211+0000 7fa91b7fe700 1 -- 172.21.15.81:0/2949928515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7fa92006eb50 con 0x7fa9340d0b80 2023-10-07T08:53:38.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.211+0000 7fa9337fe700 1 --2- 172.21.15.81:0/2949928515 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa920066f30 0x7fa9200693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa924001560 tx=0x7fa924001640 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:38.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.215+0000 7fa91b7fe700 1 -- 172.21.15.81:0/2949928515 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa928029020 con 0x7fa9340d0b80 2023-10-07T08:53:38.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.335+0000 7fa91b7fe700 1 -- 172.21.15.81:0/2949928515 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(179..179 src has 1..179) v4 ==== 671+0+0 (secure 0 0 0) 0x7fa928056d50 con 0x7fa9340d0b80 2023-10-07T08:53:38.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.335+0000 7fa91b7fe700 1 -- 172.21.15.81:0/2949928515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7fa92006f7d0 con 0x7fa9340d0b80 2023-10-07T08:53:38.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:38.441+0000 7fa938fe0700 1 -- 172.21.15.81:0/2949928515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa93406dc00 con 0x7fa9340d0b80 2023-10-07T08:53:39.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.076+0000 7fa91b7fe700 1 -- 172.21.15.81:0/2949928515 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v84) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa928053090 con 0x7fa9340d0b80 2023-10-07T08:53:39.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.078+0000 7fa938fe0700 1 -- 172.21.15.81:0/2949928515 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa920066f30 msgr2=0x7fa9200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:39.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.078+0000 7fa938fe0700 1 --2- 172.21.15.81:0/2949928515 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa920066f30 0x7fa9200693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa924001560 tx=0x7fa924001640 comp rx=0 tx=0).stop 2023-10-07T08:53:39.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.078+0000 7fa938fe0700 1 -- 172.21.15.81:0/2949928515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9340d0b80 msgr2=0x7fa934156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:39.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.078+0000 7fa938fe0700 1 --2- 172.21.15.81:0/2949928515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9340d0b80 0x7fa934156ea0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fa9280093f0 tx=0x7fa928016000 comp rx=0 tx=0).stop 2023-10-07T08:53:39.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.078+0000 7fa938fe0700 1 -- 172.21.15.81:0/2949928515 shutdown_connections 2023-10-07T08:53:39.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.078+0000 7fa938fe0700 1 --2- 172.21.15.81:0/2949928515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9340d0f50 0x7fa93416d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:39.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.078+0000 7fa938fe0700 1 --2- 172.21.15.81:0/2949928515 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa920066f30 0x7fa9200693e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:39.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.078+0000 7fa938fe0700 1 --2- 172.21.15.81:0/2949928515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa93406d530 0x7fa93415ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:39.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.078+0000 7fa938fe0700 1 --2- 172.21.15.81:0/2949928515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9340d0b80 0x7fa934156ea0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:39.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.078+0000 7fa938fe0700 1 -- 172.21.15.81:0/2949928515 >> 172.21.15.81:0/2949928515 conn(0x7fa934063230 msgr2=0x7fa934068ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:39.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.078+0000 7fa938fe0700 1 -- 172.21.15.81:0/2949928515 shutdown_connections 2023-10-07T08:53:39.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.078+0000 7fa938fe0700 1 -- 172.21.15.81:0/2949928515 wait complete. 2023-10-07T08:53:39.127 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T08:53:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.246+0000 7fd8f9bca700 1 Processor -- start 2023-10-07T08:53:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.246+0000 7fd8f9bca700 1 -- start start 2023-10-07T08:53:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.247+0000 7fd8f9bca700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8f40d0b80 0x7fd8f40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.247+0000 7fd8f9bca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8f40d02b0 0x7fd8f406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.247+0000 7fd8f9bca700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd8f40d0f50 0x7fd8f406d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.247+0000 7fd8f9bca700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f415a690 con 0x7fd8f40d0b80 2023-10-07T08:53:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.247+0000 7fd8f9bca700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f40cf2d0 con 0x7fd8f40d0f50 2023-10-07T08:53:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.247+0000 7fd8f9bca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f406dc00 con 0x7fd8f40d02b0 2023-10-07T08:53:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.247+0000 7fd8f8bc8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8f40d0b80 0x7fd8f40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.247+0000 7fd8f8bc8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8f40d0b80 0x7fd8f40cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60038/0 (socket says 172.21.15.81:60038) 2023-10-07T08:53:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.247+0000 7fd8f8bc8700 1 -- 172.21.15.81:0/4022562315 learned_addr learned my addr 172.21.15.81:0/4022562315 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.247+0000 7fd8f93c9700 1 --2- 172.21.15.81:0/4022562315 >> v2:172.21.15.89:3300/0 conn(0x7fd8f40d0f50 0x7fd8f406d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.247+0000 7fd8f3fff700 1 --2- 172.21.15.81:0/4022562315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8f40d02b0 0x7fd8f406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.247+0000 7fd8f8bc8700 1 -- 172.21.15.81:0/4022562315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8f40d02b0 msgr2=0x7fd8f406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.247+0000 7fd8f8bc8700 1 --2- 172.21.15.81:0/4022562315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8f40d02b0 0x7fd8f406cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.247+0000 7fd8f8bc8700 1 -- 172.21.15.81:0/4022562315 >> v2:172.21.15.89:3300/0 conn(0x7fd8f40d0f50 msgr2=0x7fd8f406d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.247+0000 7fd8f8bc8700 1 --2- 172.21.15.81:0/4022562315 >> v2:172.21.15.89:3300/0 conn(0x7fd8f40d0f50 0x7fd8f406d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.247+0000 7fd8f8bc8700 1 -- 172.21.15.81:0/4022562315 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f40cf570 con 0x7fd8f40d0b80 2023-10-07T08:53:39.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.248+0000 7fd8f8bc8700 1 --2- 172.21.15.81:0/4022562315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f40d0b80 0x7fd8f40cfd70 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40ce9e0 tx=0x7fd8e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbdb6fb2179a7594 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:39.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.248+0000 7fd8f37fe700 1 -- 172.21.15.81:0/4022562315 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e400e070 con 0x7fd8f40d0b80 2023-10-07T08:53:39.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.248+0000 7fd8f37fe700 1 -- 172.21.15.81:0/4022562315 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e400ba50 con 0x7fd8f40d0b80 2023-10-07T08:53:39.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.248+0000 7fd8f37fe700 1 -- 172.21.15.81:0/4022562315 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40092e0 con 0x7fd8f40d0b80 2023-10-07T08:53:39.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.248+0000 7fd8f9bca700 1 -- 172.21.15.81:0/4022562315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f40d0b80 msgr2=0x7fd8f40cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:39.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.248+0000 7fd8f9bca700 1 --2- 172.21.15.81:0/4022562315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f40d0b80 0x7fd8f40cfd70 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40ce9e0 tx=0x7fd8e4009840 comp rx=0 tx=0).stop 2023-10-07T08:53:39.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.248+0000 7fd8f9bca700 1 -- 172.21.15.81:0/4022562315 shutdown_connections 2023-10-07T08:53:39.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.248+0000 7fd8f9bca700 1 --2- 172.21.15.81:0/4022562315 >> v2:172.21.15.89:3300/0 conn(0x7fd8f40d0f50 0x7fd8f406d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:39.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.248+0000 7fd8f9bca700 1 --2- 172.21.15.81:0/4022562315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f40d0b80 0x7fd8f40cfd70 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:39.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.248+0000 7fd8f9bca700 1 --2- 172.21.15.81:0/4022562315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8f40d02b0 0x7fd8f406cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:39.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.248+0000 7fd8f9bca700 1 -- 172.21.15.81:0/4022562315 >> 172.21.15.81:0/4022562315 conn(0x7fd8f4063230 msgr2=0x7fd8f4063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:39.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.248+0000 7fd8f9bca700 1 -- 172.21.15.81:0/4022562315 shutdown_connections 2023-10-07T08:53:39.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.248+0000 7fd8f9bca700 1 -- 172.21.15.81:0/4022562315 wait complete. 2023-10-07T08:53:39.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.249+0000 7fd8f9bca700 1 Processor -- start 2023-10-07T08:53:39.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.250+0000 7fd8f9bca700 1 -- start start 2023-10-07T08:53:39.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.250+0000 7fd8f9bca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f40d02b0 0x7fd8f4157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:39.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.250+0000 7fd8f9bca700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8f40d0b80 0x7fd8f40c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:39.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.250+0000 7fd8f9bca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8f40d0f50 0x7fd8f40c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:39.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.250+0000 7fd8f9bca700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f416e310 con 0x7fd8f40d02b0 2023-10-07T08:53:39.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.250+0000 7fd8f9bca700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40c6690 con 0x7fd8f40d0b80 2023-10-07T08:53:39.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.250+0000 7fd8f9bca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40c6970 con 0x7fd8f40d0f50 2023-10-07T08:53:39.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.250+0000 7fd8f8bc8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f40d02b0 0x7fd8f4157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:39.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.250+0000 7fd8f8bc8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f40d02b0 0x7fd8f4157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60054/0 (socket says 172.21.15.81:60054) 2023-10-07T08:53:39.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.250+0000 7fd8f8bc8700 1 -- 172.21.15.81:0/2191314695 learned_addr learned my addr 172.21.15.81:0/2191314695 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:39.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.251+0000 7fd8f8bc8700 1 -- 172.21.15.81:0/2191314695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8f40d0f50 msgr2=0x7fd8f40c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:39.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.251+0000 7fd8f8bc8700 1 --2- 172.21.15.81:0/2191314695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8f40d0f50 0x7fd8f40c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:39.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.251+0000 7fd8f8bc8700 1 -- 172.21.15.81:0/2191314695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8f40d0b80 msgr2=0x7fd8f40c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:39.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.251+0000 7fd8f3fff700 1 --2- 172.21.15.81:0/2191314695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8f40d0b80 0x7fd8f40c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:39.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.251+0000 7fd8f8bc8700 1 --2- 172.21.15.81:0/2191314695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8f40d0b80 0x7fd8f40c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:39.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.251+0000 7fd8f8bc8700 1 -- 172.21.15.81:0/2191314695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e4009ae0 con 0x7fd8f40d02b0 2023-10-07T08:53:39.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.251+0000 7fd8f3fff700 1 --2- 172.21.15.81:0/2191314695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8f40d0b80 0x7fd8f40c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:39.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.251+0000 7fd8f8bc8700 1 --2- 172.21.15.81:0/2191314695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f40d02b0 0x7fd8f4157a40 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fd8f406fcc0 tx=0x7fd8e4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:39.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.251+0000 7fd8f0ff9700 1 -- 172.21.15.81:0/2191314695 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4008bb0 con 0x7fd8f40d02b0 2023-10-07T08:53:39.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.251+0000 7fd8f0ff9700 1 -- 172.21.15.81:0/2191314695 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e4008d50 con 0x7fd8f40d02b0 2023-10-07T08:53:39.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.251+0000 7fd8f9bca700 1 -- 172.21.15.81:0/2191314695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f40c6c50 con 0x7fd8f40d02b0 2023-10-07T08:53:39.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.251+0000 7fd8f0ff9700 1 -- 172.21.15.81:0/2191314695 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40266b0 con 0x7fd8f40d02b0 2023-10-07T08:53:39.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.251+0000 7fd8f9bca700 1 -- 172.21.15.81:0/2191314695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f4157f80 con 0x7fd8f40d02b0 2023-10-07T08:53:39.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.252+0000 7fd8f9bca700 1 -- 172.21.15.81:0/2191314695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f415d910 con 0x7fd8f40d02b0 2023-10-07T08:53:39.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.252+0000 7fd8f0ff9700 1 -- 172.21.15.81:0/2191314695 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8e4003040 con 0x7fd8f40d02b0 2023-10-07T08:53:39.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.253+0000 7fd8f0ff9700 1 --2- 172.21.15.81:0/2191314695 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd8e0066f30 0x7fd8e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.253+0000 7fd8f0ff9700 1 -- 172.21.15.81:0/2191314695 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5820+0+0 (secure 0 0 0) 0x7fd8e4086410 con 0x7fd8f40d02b0 2023-10-07T08:53:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.253+0000 7fd8f3fff700 1 --2- 172.21.15.81:0/2191314695 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd8e0066f30 0x7fd8e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.253+0000 7fd8f3fff700 1 --2- 172.21.15.81:0/2191314695 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd8e0066f30 0x7fd8e00693e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd8f415f5e0 tx=0x7fd8e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:39.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.257+0000 7fd8f0ff9700 1 -- 172.21.15.81:0/2191314695 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8f415d910 con 0x7fd8f40d02b0 2023-10-07T08:53:39.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:39.443+0000 7fd8f9bca700 1 -- 172.21.15.81:0/2191314695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd8f415d910 con 0x7fd8f40d02b0 2023-10-07T08:53:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.080+0000 7fd8f0ff9700 1 -- 172.21.15.81:0/2191314695 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v180) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd8f415d910 con 0x7fd8f40d02b0 2023-10-07T08:53:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.083+0000 7fd8f9bca700 1 -- 172.21.15.81:0/2191314695 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd8e0066f30 msgr2=0x7fd8e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.084+0000 7fd8f9bca700 1 --2- 172.21.15.81:0/2191314695 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd8e0066f30 0x7fd8e00693e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd8f415f5e0 tx=0x7fd8e8008040 comp rx=0 tx=0).stop 2023-10-07T08:53:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.084+0000 7fd8f9bca700 1 -- 172.21.15.81:0/2191314695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f40d02b0 msgr2=0x7fd8f4157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.084+0000 7fd8f9bca700 1 --2- 172.21.15.81:0/2191314695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f40d02b0 0x7fd8f4157a40 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fd8f406fcc0 tx=0x7fd8e4018000 comp rx=0 tx=0).stop 2023-10-07T08:53:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.084+0000 7fd8f9bca700 1 -- 172.21.15.81:0/2191314695 shutdown_connections 2023-10-07T08:53:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.084+0000 7fd8f9bca700 1 --2- 172.21.15.81:0/2191314695 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd8e0066f30 0x7fd8e00693e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.084+0000 7fd8f9bca700 1 --2- 172.21.15.81:0/2191314695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8f40d0f50 0x7fd8f40c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.084+0000 7fd8f9bca700 1 --2- 172.21.15.81:0/2191314695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f40d02b0 0x7fd8f4157a40 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.084+0000 7fd8f9bca700 1 --2- 172.21.15.81:0/2191314695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8f40d0b80 0x7fd8f40c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.084+0000 7fd8f9bca700 1 -- 172.21.15.81:0/2191314695 >> 172.21.15.81:0/2191314695 conn(0x7fd8f4063230 msgr2=0x7fd8f406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:40.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.084+0000 7fd8f9bca700 1 -- 172.21.15.81:0/2191314695 shutdown_connections 2023-10-07T08:53:40.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.084+0000 7fd8f9bca700 1 -- 172.21.15.81:0/2191314695 wait complete. 2023-10-07T08:53:40.088 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-07T08:53:40.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T08:53:40.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.216+0000 7f4fdcfe4700 1 Processor -- start 2023-10-07T08:53:40.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.216+0000 7f4fdcfe4700 1 -- start start 2023-10-07T08:53:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.217+0000 7f4fdcfe4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fd81578d0 0x7f4fd80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.217+0000 7f4fdcfe4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4fd8157ca0 0x7f4fd815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.217+0000 7f4fdcfe4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd80d07c0 con 0x7f4fd806d120 2023-10-07T08:53:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.217+0000 7f4fdcfe4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd80cfbb0 con 0x7f4fd8157ca0 2023-10-07T08:53:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.217+0000 7f4fdcfe4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80cfe90 con 0x7f4fd81578d0 2023-10-07T08:53:40.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.217+0000 7f4fd659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fd81578d0 0x7f4fd80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:40.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.217+0000 7f4fcdd9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4fd8157ca0 0x7f4fd815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:40.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.217+0000 7f4fd659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fd81578d0 0x7f4fd80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:49374/0 (socket says 172.21.15.81:49374) 2023-10-07T08:53:40.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.217+0000 7f4fcdd9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4fd8157ca0 0x7f4fd815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:43166/0 (socket says 172.21.15.81:43166) 2023-10-07T08:53:40.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.217+0000 7f4fd659c700 1 -- 172.21.15.81:0/3456732111 learned_addr learned my addr 172.21.15.81:0/3456732111 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:40.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.217+0000 7f4fd6d9d700 1 --1- 172.21.15.81:0/3456732111 >> v1:172.21.15.89:6789/0 conn(0x7f4fd806d120 0x7f4fd815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:57048/0 (socket says 172.21.15.81:57048) 2023-10-07T08:53:40.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.218+0000 7f4fd659c700 1 -- 172.21.15.81:0/3456732111 >> v2:172.21.15.89:3300/0 conn(0x7f4fd8157ca0 msgr2=0x7f4fd815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:40.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.218+0000 7f4fd659c700 1 --2- 172.21.15.81:0/3456732111 >> v2:172.21.15.89:3300/0 conn(0x7f4fd8157ca0 0x7f4fd815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:40.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.218+0000 7f4fd659c700 1 -- 172.21.15.81:0/3456732111 >> v1:172.21.15.89:6789/0 conn(0x7f4fd806d120 legacy=0x7f4fd815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:40.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.218+0000 7f4fd659c700 1 -- 172.21.15.81:0/3456732111 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80d0170 con 0x7f4fd81578d0 2023-10-07T08:53:40.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.218+0000 7f4fcdd9b700 1 --2- 172.21.15.81:0/3456732111 >> v2:172.21.15.89:3300/0 conn(0x7f4fd8157ca0 0x7f4fd815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:53:40.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.218+0000 7f4fd659c700 1 --2- 172.21.15.81:0/3456732111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fd81578d0 0x7f4fd80cf4f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80099b0 tx=0x7f4fc8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8511d1179527cb55 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:40.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.218+0000 7f4fd5d9b700 1 -- 172.21.15.81:0/3456732111 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8009ea0 con 0x7f4fd81578d0 2023-10-07T08:53:40.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.218+0000 7f4fd5d9b700 1 -- 172.21.15.81:0/3456732111 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc800b860 con 0x7f4fd81578d0 2023-10-07T08:53:40.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.218+0000 7f4fd5d9b700 1 -- 172.21.15.81:0/3456732111 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc800bc00 con 0x7f4fd81578d0 2023-10-07T08:53:40.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.219+0000 7f4fdcfe4700 1 -- 172.21.15.81:0/3456732111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fd81578d0 msgr2=0x7f4fd80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:40.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.219+0000 7f4fdcfe4700 1 --2- 172.21.15.81:0/3456732111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fd81578d0 0x7f4fd80cf4f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80099b0 tx=0x7f4fc8009250 comp rx=0 tx=0).stop 2023-10-07T08:53:40.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.219+0000 7f4fdcfe4700 1 -- 172.21.15.81:0/3456732111 shutdown_connections 2023-10-07T08:53:40.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.219+0000 7f4fdcfe4700 1 --2- 172.21.15.81:0/3456732111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fd81578d0 0x7f4fd80cf4f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:40.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.219+0000 7f4fdcfe4700 1 --2- 172.21.15.81:0/3456732111 >> v2:172.21.15.89:3300/0 conn(0x7f4fd8157ca0 0x7f4fd815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:40.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.219+0000 7f4fdcfe4700 1 -- 172.21.15.81:0/3456732111 >> 172.21.15.81:0/3456732111 conn(0x7f4fd806bb90 msgr2=0x7f4fd806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:40.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.219+0000 7f4fdcfe4700 1 -- 172.21.15.81:0/3456732111 shutdown_connections 2023-10-07T08:53:40.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.219+0000 7f4fdcfe4700 1 -- 172.21.15.81:0/3456732111 wait complete. 2023-10-07T08:53:40.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.220+0000 7f4fdcfe4700 1 Processor -- start 2023-10-07T08:53:40.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.220+0000 7f4fdcfe4700 1 -- start start 2023-10-07T08:53:40.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fdcfe4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fd806d120 0x7f4fd81476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:40.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fdcfe4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd81578d0 0x7f4fd815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:40.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fdcfe4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fd8157ca0 0x7f4fd80ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:40.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fdcfe4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80b6710 con 0x7f4fd81578d0 2023-10-07T08:53:40.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fdcfe4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80b5b00 con 0x7f4fd806d120 2023-10-07T08:53:40.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fdcfe4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80b5de0 con 0x7f4fd8157ca0 2023-10-07T08:53:40.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fcdd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd81578d0 0x7f4fd815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:40.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fcdd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd81578d0 0x7f4fd815ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60068/0 (socket says 172.21.15.81:60068) 2023-10-07T08:53:40.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fcdd9b700 1 -- 172.21.15.81:0/2448115324 learned_addr learned my addr 172.21.15.81:0/2448115324 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:40.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fd659c700 1 --2- 172.21.15.81:0/2448115324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fd806d120 0x7f4fd81476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:40.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fd6d9d700 1 --2- 172.21.15.81:0/2448115324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fd8157ca0 0x7f4fd80ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:40.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fcdd9b700 1 -- 172.21.15.81:0/2448115324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fd8157ca0 msgr2=0x7f4fd80ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:40.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fcdd9b700 1 --2- 172.21.15.81:0/2448115324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fd8157ca0 0x7f4fd80ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fcdd9b700 1 -- 172.21.15.81:0/2448115324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fd806d120 msgr2=0x7f4fd81476e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fcdd9b700 1 --2- 172.21.15.81:0/2448115324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fd806d120 0x7f4fd81476e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fcdd9b700 1 -- 172.21.15.81:0/2448115324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0009420 con 0x7f4fd81578d0 2023-10-07T08:53:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fd6d9d700 1 --2- 172.21.15.81:0/2448115324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fd8157ca0 0x7f4fd80ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fd659c700 1 --2- 172.21.15.81:0/2448115324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fd806d120 0x7f4fd81476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:53:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fcdd9b700 1 --2- 172.21.15.81:0/2448115324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd81578d0 0x7f4fd815ca40 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000ec80 tx=0x7f4fc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fceffd700 1 -- 172.21.15.81:0/2448115324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000c9d0 con 0x7f4fd81578d0 2023-10-07T08:53:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fceffd700 1 -- 172.21.15.81:0/2448115324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc000cb30 con 0x7f4fd81578d0 2023-10-07T08:53:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fdcfe4700 1 -- 172.21.15.81:0/2448115324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc80094f0 con 0x7f4fd81578d0 2023-10-07T08:53:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fceffd700 1 -- 172.21.15.81:0/2448115324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000ceb0 con 0x7f4fd81578d0 2023-10-07T08:53:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.221+0000 7f4fdcfe4700 1 -- 172.21.15.81:0/2448115324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd80b63a0 con 0x7f4fd81578d0 2023-10-07T08:53:40.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.222+0000 7f4fdcfe4700 1 -- 172.21.15.81:0/2448115324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd8067ac0 con 0x7f4fd81578d0 2023-10-07T08:53:40.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.223+0000 7f4fceffd700 1 -- 172.21.15.81:0/2448115324 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fc0013680 con 0x7f4fd81578d0 2023-10-07T08:53:40.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.223+0000 7f4fceffd700 1 --2- 172.21.15.81:0/2448115324 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4fb8066f30 0x7f4fb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.223+0000 7f4fceffd700 1 -- 172.21.15.81:0/2448115324 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4fc00847e0 con 0x7f4fd81578d0 2023-10-07T08:53:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.223+0000 7f4fd659c700 1 --2- 172.21.15.81:0/2448115324 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4fb8066f30 0x7f4fb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.223+0000 7f4fd659c700 1 --2- 172.21.15.81:0/2448115324 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4fb8066f30 0x7f4fb80693e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80099b0 tx=0x7f4fc8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.227+0000 7f4fceffd700 1 -- 172.21.15.81:0/2448115324 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fc0051b90 con 0x7f4fd81578d0 2023-10-07T08:53:40.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:40.410+0000 7f4fdcfe4700 1 -- 172.21.15.81:0/2448115324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4fd80b6850 con 0x7f4fd81578d0 2023-10-07T08:53:41.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.086+0000 7f4fceffd700 1 -- 172.21.15.81:0/2448115324 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v181) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4fc00551b0 con 0x7f4fd81578d0 2023-10-07T08:53:41.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.089+0000 7f4fdcfe4700 1 -- 172.21.15.81:0/2448115324 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4fb8066f30 msgr2=0x7f4fb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:41.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.089+0000 7f4fdcfe4700 1 --2- 172.21.15.81:0/2448115324 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4fb8066f30 0x7f4fb80693e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80099b0 tx=0x7f4fc8017000 comp rx=0 tx=0).stop 2023-10-07T08:53:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.089+0000 7f4fdcfe4700 1 -- 172.21.15.81:0/2448115324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd81578d0 msgr2=0x7f4fd815ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.089+0000 7f4fdcfe4700 1 --2- 172.21.15.81:0/2448115324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd81578d0 0x7f4fd815ca40 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000ec80 tx=0x7f4fc00091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.089+0000 7f4fdcfe4700 1 -- 172.21.15.81:0/2448115324 shutdown_connections 2023-10-07T08:53:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.089+0000 7f4fdcfe4700 1 --2- 172.21.15.81:0/2448115324 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4fb8066f30 0x7f4fb80693e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.089+0000 7f4fdcfe4700 1 --2- 172.21.15.81:0/2448115324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fd8157ca0 0x7f4fd80ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.089+0000 7f4fdcfe4700 1 --2- 172.21.15.81:0/2448115324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fd806d120 0x7f4fd81476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.089+0000 7f4fdcfe4700 1 --2- 172.21.15.81:0/2448115324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd81578d0 0x7f4fd815ca40 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.089+0000 7f4fdcfe4700 1 -- 172.21.15.81:0/2448115324 >> 172.21.15.81:0/2448115324 conn(0x7f4fd806bb90 msgr2=0x7f4fd8155970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.089+0000 7f4fdcfe4700 1 -- 172.21.15.81:0/2448115324 shutdown_connections 2023-10-07T08:53:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.089+0000 7f4fdcfe4700 1 -- 172.21.15.81:0/2448115324 wait complete. 2023-10-07T08:53:41.092 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-07T08:53:41.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T08:53:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.221+0000 7f5144b01700 1 Processor -- start 2023-10-07T08:53:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.221+0000 7f5144b01700 1 -- start start 2023-10-07T08:53:41.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.222+0000 7f5144b01700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f51400d0b80 0x7f51400cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:41.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.222+0000 7f5144b01700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51400cf2d0 con 0x7f514006d700 2023-10-07T08:53:41.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.222+0000 7f5144b01700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514006dc00 con 0x7f51400d02b0 2023-10-07T08:53:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.222+0000 7f5144b01700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514015a690 con 0x7f51400d0b80 2023-10-07T08:53:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.222+0000 7f513ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f514006d700 0x7f514015b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47714/0 (socket says 172.21.15.81:47714) 2023-10-07T08:53:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.222+0000 7f513ffff700 1 -- 172.21.15.81:0/2721332198 learned_addr learned my addr 172.21.15.81:0/2721332198 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.222+0000 7f513e7fc700 1 -- 172.21.15.81:0/2721332198 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676556427 0 0) 0x7f51400cf2d0 con 0x7f514006d700 2023-10-07T08:53:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.222+0000 7f513f7fe700 1 --2- 172.21.15.81:0/2721332198 >> v2:172.21.15.89:3300/0 conn(0x7f51400d0b80 0x7f51400cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.222+0000 7f513e7fc700 1 -- 172.21.15.81:0/2721332198 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5128003570 con 0x7f514006d700 2023-10-07T08:53:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513e7fc700 1 -- 172.21.15.81:0/2721332198 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 950334132 0 0) 0x7f5128003570 con 0x7f514006d700 2023-10-07T08:53:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513e7fc700 1 -- 172.21.15.81:0/2721332198 >> v2:172.21.15.89:3300/0 conn(0x7f51400d0b80 msgr2=0x7f51400cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513e7fc700 1 --2- 172.21.15.81:0/2721332198 >> v2:172.21.15.89:3300/0 conn(0x7f51400d0b80 0x7f51400cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513e7fc700 1 -- 172.21.15.81:0/2721332198 >> v1:172.21.15.89:6789/0 conn(0x7f51400d02b0 legacy=0x7f514006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513e7fc700 1 -- 172.21.15.81:0/2721332198 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51400cf570 con 0x7f514006d700 2023-10-07T08:53:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513e7fc700 1 -- 172.21.15.81:0/2721332198 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f51380017f0 con 0x7f514006d700 2023-10-07T08:53:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513e7fc700 1 -- 172.21.15.81:0/2721332198 >> v1:172.21.15.81:6789/0 conn(0x7f514006d700 legacy=0x7f514015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513e7fc700 1 --2- 172.21.15.81:0/2721332198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5128003a60 0x7f5128003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513e7fc700 1 --2- 172.21.15.81:0/2721332198 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5128004810 0x7f5128004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:41.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513e7fc700 1 --2- 172.21.15.81:0/2721332198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51280051c0 0x7f512800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:41.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513e7fc700 1 -- 172.21.15.81:0/2721332198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514015a690 con 0x7f5128003a60 2023-10-07T08:53:41.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513e7fc700 1 -- 172.21.15.81:0/2721332198 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512800c160 con 0x7f51280051c0 2023-10-07T08:53:41.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513e7fc700 1 -- 172.21.15.81:0/2721332198 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512800c320 con 0x7f5128004810 2023-10-07T08:53:41.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513f7fe700 1 --2- 172.21.15.81:0/2721332198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5128003a60 0x7f5128003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:41.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513ffff700 1 --2- 172.21.15.81:0/2721332198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51280051c0 0x7f512800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:41.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513effd700 1 --2- 172.21.15.81:0/2721332198 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5128004810 0x7f5128004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:41.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513f7fe700 1 -- 172.21.15.81:0/2721332198 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5128004810 msgr2=0x7f5128004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:41.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513f7fe700 1 --2- 172.21.15.81:0/2721332198 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5128004810 0x7f5128004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513f7fe700 1 -- 172.21.15.81:0/2721332198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51280051c0 msgr2=0x7f512800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:41.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513f7fe700 1 --2- 172.21.15.81:0/2721332198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51280051c0 0x7f512800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513f7fe700 1 -- 172.21.15.81:0/2721332198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5128003570 con 0x7f5128003a60 2023-10-07T08:53:41.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513ffff700 1 --2- 172.21.15.81:0/2721332198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51280051c0 0x7f512800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:53:41.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513ffff700 1 -- 172.21.15.81:0/2721332198 reap_dead start 2023-10-07T08:53:41.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513f7fe700 1 --2- 172.21.15.81:0/2721332198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5128003a60 0x7f5128003e70 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f5130009c00 tx=0x7f51300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461a16159cd8b138 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:41.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513e7fc700 1 -- 172.21.15.81:0/2721332198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513000e710 con 0x7f5128003a60 2023-10-07T08:53:41.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513e7fc700 1 -- 172.21.15.81:0/2721332198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513000e870 con 0x7f5128003a60 2023-10-07T08:53:41.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.223+0000 7f513e7fc700 1 -- 172.21.15.81:0/2721332198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513000ec30 con 0x7f5128003a60 2023-10-07T08:53:41.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.224+0000 7f5144b01700 1 -- 172.21.15.81:0/2721332198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5128003a60 msgr2=0x7f5128003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:41.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.224+0000 7f5144b01700 1 --2- 172.21.15.81:0/2721332198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5128003a60 0x7f5128003e70 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f5130009c00 tx=0x7f51300091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.224+0000 7f5144b01700 1 -- 172.21.15.81:0/2721332198 shutdown_connections 2023-10-07T08:53:41.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.224+0000 7f5144b01700 1 --2- 172.21.15.81:0/2721332198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5128003a60 0x7f5128003e70 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.224+0000 7f5144b01700 1 -- 172.21.15.81:0/2721332198 >> 172.21.15.81:0/2721332198 conn(0x7f5140063230 msgr2=0x7f5140063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:41.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.224+0000 7f5144b01700 1 -- 172.21.15.81:0/2721332198 shutdown_connections 2023-10-07T08:53:41.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.224+0000 7f5144b01700 1 -- 172.21.15.81:0/2721332198 wait complete. 2023-10-07T08:53:41.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.225+0000 7f5144b01700 1 Processor -- start 2023-10-07T08:53:41.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.225+0000 7f5144b01700 1 -- start start 2023-10-07T08:53:41.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f5144b01700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5128003a60 0x7f514016b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:41.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f5144b01700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51401418e0 0x7f514015cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:41.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f5144b01700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f514015cff0 0x7f5140151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:41.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f5144b01700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514016b1b0 con 0x7f51401418e0 2023-10-07T08:53:41.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f5144b01700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514015d440 con 0x7f5128003a60 2023-10-07T08:53:41.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f5144b01700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514016a8f0 con 0x7f514015cff0 2023-10-07T08:53:41.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f513effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51401418e0 0x7f514015cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:41.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f513effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51401418e0 0x7f514015cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60092/0 (socket says 172.21.15.81:60092) 2023-10-07T08:53:41.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f513effd700 1 -- 172.21.15.81:0/4204449609 learned_addr learned my addr 172.21.15.81:0/4204449609 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f513f7fe700 1 --2- 172.21.15.81:0/4204449609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5128003a60 0x7f514016b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f513ffff700 1 --2- 172.21.15.81:0/4204449609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f514015cff0 0x7f5140151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f513effd700 1 -- 172.21.15.81:0/4204449609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f514015cff0 msgr2=0x7f5140151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f513effd700 1 --2- 172.21.15.81:0/4204449609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f514015cff0 0x7f5140151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f513effd700 1 -- 172.21.15.81:0/4204449609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5128003a60 msgr2=0x7f514016b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f513effd700 1 --2- 172.21.15.81:0/4204449609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5128003a60 0x7f514016b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f513effd700 1 -- 172.21.15.81:0/4204449609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514016ab60 con 0x7f51401418e0 2023-10-07T08:53:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f513f7fe700 1 --2- 172.21.15.81:0/4204449609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5128003a60 0x7f514016b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:53:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.226+0000 7f513effd700 1 --2- 172.21.15.81:0/4204449609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51401418e0 0x7f514015cab0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f513400e650 tx=0x7f5134009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.227+0000 7f51277fe700 1 -- 172.21.15.81:0/4204449609 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134010520 con 0x7f51401418e0 2023-10-07T08:53:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.227+0000 7f51277fe700 1 -- 172.21.15.81:0/4204449609 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5134010680 con 0x7f51401418e0 2023-10-07T08:53:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.227+0000 7f5144b01700 1 -- 172.21.15.81:0/4204449609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514016ae40 con 0x7f51401418e0 2023-10-07T08:53:41.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.227+0000 7f51277fe700 1 -- 172.21.15.81:0/4204449609 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134010a20 con 0x7f51401418e0 2023-10-07T08:53:41.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.227+0000 7f5144b01700 1 -- 172.21.15.81:0/4204449609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5140141d50 con 0x7f51401418e0 2023-10-07T08:53:41.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.227+0000 7f5144b01700 1 -- 172.21.15.81:0/4204449609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514016b360 con 0x7f51401418e0 2023-10-07T08:53:41.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.228+0000 7f51277fe700 1 -- 172.21.15.81:0/4204449609 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5134014480 con 0x7f51401418e0 2023-10-07T08:53:41.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.228+0000 7f51277fe700 1 --2- 172.21.15.81:0/4204449609 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f512c066f30 0x7f512c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:41.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.228+0000 7f51277fe700 1 -- 172.21.15.81:0/4204449609 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5134083e30 con 0x7f51401418e0 2023-10-07T08:53:41.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.228+0000 7f513f7fe700 1 --2- 172.21.15.81:0/4204449609 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f512c066f30 0x7f512c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:41.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.229+0000 7f513f7fe700 1 --2- 172.21.15.81:0/4204449609 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f512c066f30 0x7f512c0693e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f51300091e0 tx=0x7f513001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:41.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.232+0000 7f51277fe700 1 -- 172.21.15.81:0/4204449609 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f513404d5a0 con 0x7f51401418e0 2023-10-07T08:53:41.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.414+0000 7f5144b01700 1 -- 172.21.15.81:0/4204449609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f51400676e0 con 0x7f51401418e0 2023-10-07T08:53:41.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.418+0000 7f51277fe700 1 -- 172.21.15.81:0/4204449609 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f51340190a0 con 0x7f51401418e0 2023-10-07T08:53:41.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.421+0000 7f5144b01700 1 -- 172.21.15.81:0/4204449609 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f512c066f30 msgr2=0x7f512c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:41.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.421+0000 7f5144b01700 1 --2- 172.21.15.81:0/4204449609 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f512c066f30 0x7f512c0693e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f51300091e0 tx=0x7f513001a000 comp rx=0 tx=0).stop 2023-10-07T08:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.421+0000 7f5144b01700 1 -- 172.21.15.81:0/4204449609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51401418e0 msgr2=0x7f514015cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.421+0000 7f5144b01700 1 --2- 172.21.15.81:0/4204449609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51401418e0 0x7f514015cab0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f513400e650 tx=0x7f5134009040 comp rx=0 tx=0).stop 2023-10-07T08:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.421+0000 7f5144b01700 1 -- 172.21.15.81:0/4204449609 shutdown_connections 2023-10-07T08:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.421+0000 7f5144b01700 1 --2- 172.21.15.81:0/4204449609 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f512c066f30 0x7f512c0693e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.421+0000 7f5144b01700 1 --2- 172.21.15.81:0/4204449609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f514015cff0 0x7f5140151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.421+0000 7f5144b01700 1 --2- 172.21.15.81:0/4204449609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5128003a60 0x7f514016b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.421+0000 7f5144b01700 1 --2- 172.21.15.81:0/4204449609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51401418e0 0x7f514015cab0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.421+0000 7f5144b01700 1 -- 172.21.15.81:0/4204449609 >> 172.21.15.81:0/4204449609 conn(0x7f5140063230 msgr2=0x7f51400b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.421+0000 7f5144b01700 1 -- 172.21.15.81:0/4204449609 shutdown_connections 2023-10-07T08:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.421+0000 7f5144b01700 1 -- 172.21.15.81:0/4204449609 wait complete. 2023-10-07T08:53:41.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-10-07T08:53:41.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.547+0000 7f2dcbfe4700 1 Processor -- start 2023-10-07T08:53:41.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.547+0000 7f2dcbfe4700 1 -- start start 2023-10-07T08:53:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.547+0000 7f2dcbfe4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2dc41578d0 0x7f2dc40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.547+0000 7f2dcbfe4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2dc406d120 0x7f2dc406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.547+0000 7f2dcbfe4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc40d07c0 con 0x7f2dc4157ca0 2023-10-07T08:53:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.547+0000 7f2dcbfe4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc406da50 con 0x7f2dc406d120 2023-10-07T08:53:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.547+0000 7f2dcbfe4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc40cfbb0 con 0x7f2dc41578d0 2023-10-07T08:53:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.548+0000 7f2dca581700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2dc406d120 0x7f2dc406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:41.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.548+0000 7f2dc957f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2dc4157ca0 0x7f2dc415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47726/0 (socket says 172.21.15.81:47726) 2023-10-07T08:53:41.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.548+0000 7f2dca581700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2dc406d120 0x7f2dc406d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60094/0 (socket says 172.21.15.81:60094) 2023-10-07T08:53:41.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.548+0000 7f2dc957f700 1 -- 172.21.15.81:0/419181693 learned_addr learned my addr 172.21.15.81:0/419181693 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:41.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.548+0000 7f2dc9d80700 1 --2- 172.21.15.81:0/419181693 >> v2:172.21.15.89:3300/0 conn(0x7f2dc41578d0 0x7f2dc40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:41.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.548+0000 7f2dca581700 1 -- 172.21.15.81:0/419181693 >> v2:172.21.15.89:3300/0 conn(0x7f2dc41578d0 msgr2=0x7f2dc40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:41.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.548+0000 7f2dca581700 1 --2- 172.21.15.81:0/419181693 >> v2:172.21.15.89:3300/0 conn(0x7f2dc41578d0 0x7f2dc40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.548+0000 7f2dca581700 1 -- 172.21.15.81:0/419181693 >> v1:172.21.15.81:6789/0 conn(0x7f2dc4157ca0 legacy=0x7f2dc415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:41.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.548+0000 7f2dca581700 1 -- 172.21.15.81:0/419181693 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc40cfe90 con 0x7f2dc406d120 2023-10-07T08:53:41.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.548+0000 7f2dc8d7e700 1 -- 172.21.15.81:0/419181693 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272288721 0 0) 0x7f2dc40d07c0 con 0x7f2dc4157ca0 2023-10-07T08:53:41.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.548+0000 7f2dc9d80700 1 --2- 172.21.15.81:0/419181693 >> v2:172.21.15.89:3300/0 conn(0x7f2dc41578d0 0x7f2dc40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:41.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.548+0000 7f2dca581700 1 --2- 172.21.15.81:0/419181693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc406d120 0x7f2dc406d510 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40646b0 tx=0x7f2dbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f20c1e562b23713 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.548+0000 7f2dc8d7e700 1 -- 172.21.15.81:0/419181693 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc00b6b0 con 0x7f2dc406d120 2023-10-07T08:53:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.548+0000 7f2dc8d7e700 1 -- 172.21.15.81:0/419181693 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc00b810 con 0x7f2dc406d120 2023-10-07T08:53:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.548+0000 7f2dc8d7e700 1 -- 172.21.15.81:0/419181693 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc00bbb0 con 0x7f2dc406d120 2023-10-07T08:53:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.549+0000 7f2dcbfe4700 1 -- 172.21.15.81:0/419181693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc406d120 msgr2=0x7f2dc406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.549+0000 7f2dcbfe4700 1 --2- 172.21.15.81:0/419181693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc406d120 0x7f2dc406d510 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40646b0 tx=0x7f2dbc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.549+0000 7f2dcbfe4700 1 -- 172.21.15.81:0/419181693 shutdown_connections 2023-10-07T08:53:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.549+0000 7f2dcbfe4700 1 --2- 172.21.15.81:0/419181693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc406d120 0x7f2dc406d510 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.549+0000 7f2dcbfe4700 1 --2- 172.21.15.81:0/419181693 >> v2:172.21.15.89:3300/0 conn(0x7f2dc41578d0 0x7f2dc40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.549+0000 7f2dcbfe4700 1 -- 172.21.15.81:0/419181693 >> 172.21.15.81:0/419181693 conn(0x7f2dc406bb90 msgr2=0x7f2dc406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.549+0000 7f2dcbfe4700 1 -- 172.21.15.81:0/419181693 shutdown_connections 2023-10-07T08:53:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.549+0000 7f2dcbfe4700 1 -- 172.21.15.81:0/419181693 wait complete. 2023-10-07T08:53:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.550+0000 7f2dcbfe4700 1 Processor -- start 2023-10-07T08:53:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.550+0000 7f2dcbfe4700 1 -- start start 2023-10-07T08:53:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dcbfe4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dc406d120 0x7f2dc4153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dcbfe4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc41578d0 0x7f2dc416df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dcbfe4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2dc4157ca0 0x7f2dc415f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dcbfe4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc416e450 con 0x7f2dc41578d0 2023-10-07T08:53:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dcbfe4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc4154960 con 0x7f2dc406d120 2023-10-07T08:53:41.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dcbfe4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40c6b80 con 0x7f2dc4157ca0 2023-10-07T08:53:41.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dc957f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc41578d0 0x7f2dc416df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:41.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dc957f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc41578d0 0x7f2dc416df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60098/0 (socket says 172.21.15.81:60098) 2023-10-07T08:53:41.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dc957f700 1 -- 172.21.15.81:0/1329399747 learned_addr learned my addr 172.21.15.81:0/1329399747 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:41.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dc9d80700 1 --2- 172.21.15.81:0/1329399747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dc406d120 0x7f2dc4153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:41.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dc957f700 1 -- 172.21.15.81:0/1329399747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2dc4157ca0 msgr2=0x7f2dc415f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:41.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dc957f700 1 --2- 172.21.15.81:0/1329399747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2dc4157ca0 0x7f2dc415f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dc957f700 1 -- 172.21.15.81:0/1329399747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dc406d120 msgr2=0x7f2dc4153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:41.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dc957f700 1 --2- 172.21.15.81:0/1329399747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dc406d120 0x7f2dc4153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:41.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dc957f700 1 -- 172.21.15.81:0/1329399747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc009420 con 0x7f2dc41578d0 2023-10-07T08:53:41.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dc9d80700 1 --2- 172.21.15.81:0/1329399747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dc406d120 0x7f2dc4153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:41.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dc957f700 1 --2- 172.21.15.81:0/1329399747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc41578d0 0x7f2dc416df10 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f2db800c560 tx=0x7f2db8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dc1ffb700 1 -- 172.21.15.81:0/1329399747 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8005b30 con 0x7f2dc41578d0 2023-10-07T08:53:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dc1ffb700 1 -- 172.21.15.81:0/1329399747 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db8005c90 con 0x7f2dc41578d0 2023-10-07T08:53:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dcbfe4700 1 -- 172.21.15.81:0/1329399747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc40c5f70 con 0x7f2dc41578d0 2023-10-07T08:53:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.551+0000 7f2dc1ffb700 1 -- 172.21.15.81:0/1329399747 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8007320 con 0x7f2dc41578d0 2023-10-07T08:53:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.552+0000 7f2dcbfe4700 1 -- 172.21.15.81:0/1329399747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc40c6530 con 0x7f2dc41578d0 2023-10-07T08:53:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.552+0000 7f2dcbfe4700 1 -- 172.21.15.81:0/1329399747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc4067ac0 con 0x7f2dc41578d0 2023-10-07T08:53:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.553+0000 7f2dc1ffb700 1 -- 172.21.15.81:0/1329399747 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2db801b3b0 con 0x7f2dc41578d0 2023-10-07T08:53:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.553+0000 7f2dc1ffb700 1 --2- 172.21.15.81:0/1329399747 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2db0066f30 0x7f2db00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.553+0000 7f2dc9d80700 1 --2- 172.21.15.81:0/1329399747 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2db0066f30 0x7f2db00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.553+0000 7f2dc1ffb700 1 -- 172.21.15.81:0/1329399747 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2db80837f0 con 0x7f2dc41578d0 2023-10-07T08:53:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.554+0000 7f2dc9d80700 1 --2- 172.21.15.81:0/1329399747 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2db0066f30 0x7f2db00693e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2db400d640 tx=0x7f2db4007670 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:41.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.557+0000 7f2dc1ffb700 1 -- 172.21.15.81:0/1329399747 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2db8050cc0 con 0x7f2dc41578d0 2023-10-07T08:53:41.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:41.813+0000 7f2dcbfe4700 1 -- 172.21.15.81:0/1329399747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f2dc40c6cc0 con 0x7f2dc41578d0 2023-10-07T08:53:42.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.083+0000 7f2dc1ffb700 1 -- 172.21.15.81:0/1329399747 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v502) v1 ==== 131+0+0 (secure 0 0 0) 0x7f2db80542e0 con 0x7f2dc41578d0 2023-10-07T08:53:42.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.086+0000 7f2dcbfe4700 1 -- 172.21.15.81:0/1329399747 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2db0066f30 msgr2=0x7f2db00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:42.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.086+0000 7f2dcbfe4700 1 --2- 172.21.15.81:0/1329399747 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2db0066f30 0x7f2db00693e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2db400d640 tx=0x7f2db4007670 comp rx=0 tx=0).stop 2023-10-07T08:53:42.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.086+0000 7f2dcbfe4700 1 -- 172.21.15.81:0/1329399747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc41578d0 msgr2=0x7f2dc416df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:42.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.086+0000 7f2dcbfe4700 1 --2- 172.21.15.81:0/1329399747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc41578d0 0x7f2dc416df10 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f2db800c560 tx=0x7f2db8007f90 comp rx=0 tx=0).stop 2023-10-07T08:53:42.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.086+0000 7f2dcbfe4700 1 -- 172.21.15.81:0/1329399747 shutdown_connections 2023-10-07T08:53:42.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.086+0000 7f2dcbfe4700 1 --2- 172.21.15.81:0/1329399747 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2db0066f30 0x7f2db00693e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:42.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.086+0000 7f2dcbfe4700 1 --2- 172.21.15.81:0/1329399747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2dc4157ca0 0x7f2dc415f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:42.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.086+0000 7f2dcbfe4700 1 --2- 172.21.15.81:0/1329399747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dc406d120 0x7f2dc4153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:42.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.086+0000 7f2dcbfe4700 1 --2- 172.21.15.81:0/1329399747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc41578d0 0x7f2dc416df10 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:42.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.086+0000 7f2dcbfe4700 1 -- 172.21.15.81:0/1329399747 >> 172.21.15.81:0/1329399747 conn(0x7f2dc406bb90 msgr2=0x7f2dc415fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:42.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.086+0000 7f2dcbfe4700 1 -- 172.21.15.81:0/1329399747 shutdown_connections 2023-10-07T08:53:42.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.086+0000 7f2dcbfe4700 1 -- 172.21.15.81:0/1329399747 wait complete. 2023-10-07T08:53:42.100 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-10-07T08:53:42.100 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-10-07T08:53:42.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-10-07T08:53:42.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.214+0000 7f687f79c700 1 Processor -- start 2023-10-07T08:53:42.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.215+0000 7f687f79c700 1 -- start start 2023-10-07T08:53:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.215+0000 7f687f79c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68781569e0 0x7f68780b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.215+0000 7f687f79c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6878156db0 0x7f687806e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.215+0000 7f687f79c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68780b2290 con 0x7f68780b1d10 2023-10-07T08:53:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.215+0000 7f687f79c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6878157c00 con 0x7f6878156db0 2023-10-07T08:53:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.215+0000 7f687f79c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68781572d0 con 0x7f68781569e0 2023-10-07T08:53:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.215+0000 7f687dd39700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f68780b1d10 0x7f687815a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47728/0 (socket says 172.21.15.81:47728) 2023-10-07T08:53:42.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.215+0000 7f687dd39700 1 -- 172.21.15.81:0/868520318 learned_addr learned my addr 172.21.15.81:0/868520318 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:42.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f687cd37700 1 --2- 172.21.15.81:0/868520318 >> v2:172.21.15.89:3300/0 conn(0x7f6878156db0 0x7f687806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:42.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f687d538700 1 --2- 172.21.15.81:0/868520318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68781569e0 0x7f68780b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:42.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f686ffff700 1 -- 172.21.15.81:0/868520318 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125810600 0 0) 0x7f68780b2290 con 0x7f68780b1d10 2023-10-07T08:53:42.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f686ffff700 1 -- 172.21.15.81:0/868520318 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6864003570 con 0x7f68780b1d10 2023-10-07T08:53:42.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f686ffff700 1 -- 172.21.15.81:0/868520318 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1854934060 0 0) 0x7f6864003570 con 0x7f68780b1d10 2023-10-07T08:53:42.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f686ffff700 1 -- 172.21.15.81:0/868520318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68781569e0 msgr2=0x7f68780b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:42.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f686ffff700 1 --2- 172.21.15.81:0/868520318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68781569e0 0x7f68780b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:42.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f686ffff700 1 -- 172.21.15.81:0/868520318 >> v2:172.21.15.89:3300/0 conn(0x7f6878156db0 msgr2=0x7f687806e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:42.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f686ffff700 1 --2- 172.21.15.81:0/868520318 >> v2:172.21.15.89:3300/0 conn(0x7f6878156db0 0x7f687806e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:42.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f686ffff700 1 -- 172.21.15.81:0/868520318 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68781575b0 con 0x7f68780b1d10 2023-10-07T08:53:42.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f686ffff700 1 -- 172.21.15.81:0/868520318 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f68700017f0 con 0x7f68780b1d10 2023-10-07T08:53:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f686ffff700 1 -- 172.21.15.81:0/868520318 >> v1:172.21.15.81:6789/0 conn(0x7f68780b1d10 legacy=0x7f687815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f686ffff700 1 --2- 172.21.15.81:0/868520318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68781569e0 0x7f6864003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f686ffff700 1 --2- 172.21.15.81:0/868520318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6864003fe0 0x7f6864004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f686ffff700 1 --2- 172.21.15.81:0/868520318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6864004d50 0x7f68640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f686ffff700 1 -- 172.21.15.81:0/868520318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6878157c00 con 0x7f6864003fe0 2023-10-07T08:53:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f686ffff700 1 -- 172.21.15.81:0/868520318 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68781572d0 con 0x7f6864004d50 2023-10-07T08:53:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f686ffff700 1 -- 172.21.15.81:0/868520318 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686400ba90 con 0x7f68781569e0 2023-10-07T08:53:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f687cd37700 1 --2- 172.21.15.81:0/868520318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6864003fe0 0x7f6864004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f687d538700 1 --2- 172.21.15.81:0/868520318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68781569e0 0x7f6864003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f687dd39700 1 --2- 172.21.15.81:0/868520318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6864004d50 0x7f68640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f687cd37700 1 -- 172.21.15.81:0/868520318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68781569e0 msgr2=0x7f6864003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:42.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f687cd37700 1 --2- 172.21.15.81:0/868520318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68781569e0 0x7f6864003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:42.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f687cd37700 1 -- 172.21.15.81:0/868520318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6864004d50 msgr2=0x7f68640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:42.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f687cd37700 1 --2- 172.21.15.81:0/868520318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6864004d50 0x7f68640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:42.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f687cd37700 1 -- 172.21.15.81:0/868520318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6864003570 con 0x7f6864003fe0 2023-10-07T08:53:42.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.216+0000 7f687dd39700 1 --2- 172.21.15.81:0/868520318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6864004d50 0x7f68640051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:53:42.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.217+0000 7f687cd37700 1 --2- 172.21.15.81:0/868520318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6864003fe0 0x7f6864004810 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f6878157200 tx=0x7f68680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238ce9a2624a1697 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:42.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.217+0000 7f686ffff700 1 -- 172.21.15.81:0/868520318 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686800e6b0 con 0x7f6864003fe0 2023-10-07T08:53:42.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.217+0000 7f686ffff700 1 -- 172.21.15.81:0/868520318 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686800e810 con 0x7f6864003fe0 2023-10-07T08:53:42.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.217+0000 7f686ffff700 1 -- 172.21.15.81:0/868520318 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686800ebd0 con 0x7f6864003fe0 2023-10-07T08:53:42.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.217+0000 7f687f79c700 1 -- 172.21.15.81:0/868520318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6864003fe0 msgr2=0x7f6864004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:42.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.217+0000 7f687f79c700 1 --2- 172.21.15.81:0/868520318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6864003fe0 0x7f6864004810 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f6878157200 tx=0x7f68680091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:42.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.217+0000 7f687dd39700 1 -- 172.21.15.81:0/868520318 reap_dead start 2023-10-07T08:53:42.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.217+0000 7f687f79c700 1 -- 172.21.15.81:0/868520318 shutdown_connections 2023-10-07T08:53:42.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.217+0000 7f687f79c700 1 -- 172.21.15.81:0/868520318 >> 172.21.15.81:0/868520318 conn(0x7f687806cca0 msgr2=0x7f687806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:42.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.217+0000 7f687f79c700 1 -- 172.21.15.81:0/868520318 shutdown_connections 2023-10-07T08:53:42.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.217+0000 7f687f79c700 1 -- 172.21.15.81:0/868520318 wait complete. 2023-10-07T08:53:42.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.218+0000 7f687f79c700 1 Processor -- start 2023-10-07T08:53:42.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.218+0000 7f687f79c700 1 -- start start 2023-10-07T08:53:42.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.219+0000 7f687f79c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6864003fe0 0x7f68781497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:42.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.219+0000 7f687f79c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780c9d50 0x7f687814f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.219+0000 7f687f79c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f687814f9a0 0x7f687815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.219+0000 7f687f79c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687814a9e0 con 0x7f687814f9a0 2023-10-07T08:53:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.219+0000 7f687f79c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6878147ef0 con 0x7f68780c9d50 2023-10-07T08:53:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.219+0000 7f687f79c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6878149dd0 con 0x7f6864003fe0 2023-10-07T08:53:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.219+0000 7f687dd39700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f687814f9a0 0x7f687815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.219+0000 7f687dd39700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f687814f9a0 0x7f687815a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60114/0 (socket says 172.21.15.81:60114) 2023-10-07T08:53:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.219+0000 7f687dd39700 1 -- 172.21.15.81:0/2441362937 learned_addr learned my addr 172.21.15.81:0/2441362937 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.220+0000 7f687d538700 1 --2- 172.21.15.81:0/2441362937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6864003fe0 0x7f68781497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.220+0000 7f687cd37700 1 --2- 172.21.15.81:0/2441362937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780c9d50 0x7f687814f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.220+0000 7f687dd39700 1 -- 172.21.15.81:0/2441362937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6864003fe0 msgr2=0x7f68781497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.220+0000 7f687dd39700 1 --2- 172.21.15.81:0/2441362937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6864003fe0 0x7f68781497f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.220+0000 7f687dd39700 1 -- 172.21.15.81:0/2441362937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780c9d50 msgr2=0x7f687814f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.220+0000 7f687dd39700 1 --2- 172.21.15.81:0/2441362937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780c9d50 0x7f687814f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.220+0000 7f687dd39700 1 -- 172.21.15.81:0/2441362937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687814a0b0 con 0x7f687814f9a0 2023-10-07T08:53:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.220+0000 7f687cd37700 1 --2- 172.21.15.81:0/2441362937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780c9d50 0x7f687814f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:53:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.220+0000 7f687dd39700 1 --2- 172.21.15.81:0/2441362937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f687814f9a0 0x7f687815a0e0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f6870000f80 tx=0x7f6870001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.220+0000 7f686d7fa700 1 -- 172.21.15.81:0/2441362937 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687000ebc0 con 0x7f687814f9a0 2023-10-07T08:53:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.220+0000 7f686d7fa700 1 -- 172.21.15.81:0/2441362937 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687000ed20 con 0x7f687814f9a0 2023-10-07T08:53:42.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.220+0000 7f686d7fa700 1 -- 172.21.15.81:0/2441362937 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6870013670 con 0x7f687814f9a0 2023-10-07T08:53:42.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.220+0000 7f687f79c700 1 -- 172.21.15.81:0/2441362937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687814a390 con 0x7f687814f9a0 2023-10-07T08:53:42.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.220+0000 7f687f79c700 1 -- 172.21.15.81:0/2441362937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687815a620 con 0x7f687814f9a0 2023-10-07T08:53:42.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.221+0000 7f687f79c700 1 -- 172.21.15.81:0/2441362937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687814ab50 con 0x7f687814f9a0 2023-10-07T08:53:42.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.221+0000 7f686d7fa700 1 -- 172.21.15.81:0/2441362937 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6870013a20 con 0x7f687814f9a0 2023-10-07T08:53:42.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.222+0000 7f686d7fa700 1 --2- 172.21.15.81:0/2441362937 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f685c066f30 0x7f685c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:42.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.222+0000 7f686d7fa700 1 -- 172.21.15.81:0/2441362937 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f68700847e0 con 0x7f687814f9a0 2023-10-07T08:53:42.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.222+0000 7f687d538700 1 --2- 172.21.15.81:0/2441362937 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f685c066f30 0x7f685c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:42.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.222+0000 7f687d538700 1 --2- 172.21.15.81:0/2441362937 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f685c066f30 0x7f685c0693e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6874006f00 tx=0x7f68740091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:42.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.226+0000 7f686d7fa700 1 -- 172.21.15.81:0/2441362937 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6870051d50 con 0x7f687814f9a0 2023-10-07T08:53:42.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:42.486+0000 7f687f79c700 1 -- 172.21.15.81:0/2441362937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f6878157890 con 0x7f687814f9a0 2023-10-07T08:53:43.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.087+0000 7f686d7fa700 1 -- 172.21.15.81:0/2441362937 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v503) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6870055370 con 0x7f687814f9a0 2023-10-07T08:53:43.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.089+0000 7f687f79c700 1 -- 172.21.15.81:0/2441362937 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f685c066f30 msgr2=0x7f685c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:43.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.089+0000 7f687f79c700 1 --2- 172.21.15.81:0/2441362937 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f685c066f30 0x7f685c0693e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6874006f00 tx=0x7f68740091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.089+0000 7f687f79c700 1 -- 172.21.15.81:0/2441362937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f687814f9a0 msgr2=0x7f687815a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:43.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.089+0000 7f687f79c700 1 --2- 172.21.15.81:0/2441362937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f687814f9a0 0x7f687815a0e0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f6870000f80 tx=0x7f6870001250 comp rx=0 tx=0).stop 2023-10-07T08:53:43.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.089+0000 7f687f79c700 1 -- 172.21.15.81:0/2441362937 shutdown_connections 2023-10-07T08:53:43.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.089+0000 7f687f79c700 1 --2- 172.21.15.81:0/2441362937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f687814f9a0 0x7f687815a0e0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.089+0000 7f687f79c700 1 --2- 172.21.15.81:0/2441362937 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f685c066f30 0x7f685c0693e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.089+0000 7f687f79c700 1 --2- 172.21.15.81:0/2441362937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6864003fe0 0x7f68781497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.089+0000 7f687f79c700 1 --2- 172.21.15.81:0/2441362937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780c9d50 0x7f687814f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.090+0000 7f687f79c700 1 -- 172.21.15.81:0/2441362937 >> 172.21.15.81:0/2441362937 conn(0x7f687806cca0 msgr2=0x7f6878154380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:43.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.090+0000 7f687f79c700 1 -- 172.21.15.81:0/2441362937 shutdown_connections 2023-10-07T08:53:43.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.090+0000 7f687f79c700 1 -- 172.21.15.81:0/2441362937 wait complete. 2023-10-07T08:53:43.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-07T08:53:43.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.221+0000 7fd1d5968700 1 Processor -- start 2023-10-07T08:53:43.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.221+0000 7fd1d5968700 1 -- start start 2023-10-07T08:53:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.222+0000 7fd1d5968700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd1d00d0b80 0x7fd1d00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.222+0000 7fd1d5968700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1d006d700 0x7fd1d015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:43.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.222+0000 7fd1d5968700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d00cf2d0 con 0x7fd1d00d02b0 2023-10-07T08:53:43.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.222+0000 7fd1d5968700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d015a690 con 0x7fd1d00d0b80 2023-10-07T08:53:43.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.222+0000 7fd1d5968700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d006dc00 con 0x7fd1d006d700 2023-10-07T08:53:43.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.222+0000 7fd1d4966700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd1d00d0b80 0x7fd1d00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:43.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.222+0000 7fd1d5167700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1d006d700 0x7fd1d015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:43.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.222+0000 7fd1d4966700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd1d00d0b80 0x7fd1d00cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:52316/0 (socket says 172.21.15.81:52316) 2023-10-07T08:53:43.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.222+0000 7fd1d4966700 1 -- 172.21.15.81:0/3498622153 learned_addr learned my addr 172.21.15.81:0/3498622153 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:43.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.222+0000 7fd1cffff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd1d00d02b0 0x7fd1d006cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:51226/0 (socket says 172.21.15.81:51226) 2023-10-07T08:53:43.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.222+0000 7fd1d5167700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1d006d700 0x7fd1d015b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:56062/0 (socket says 172.21.15.81:56062) 2023-10-07T08:53:43.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.222+0000 7fd1d5167700 1 -- 172.21.15.81:0/3498622153 >> v2:172.21.15.89:3300/0 conn(0x7fd1d00d0b80 msgr2=0x7fd1d00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:43.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.222+0000 7fd1d5167700 1 --2- 172.21.15.81:0/3498622153 >> v2:172.21.15.89:3300/0 conn(0x7fd1d00d0b80 0x7fd1d00cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.222+0000 7fd1d5167700 1 -- 172.21.15.81:0/3498622153 >> v1:172.21.15.89:6789/0 conn(0x7fd1d00d02b0 legacy=0x7fd1d006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:43.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.222+0000 7fd1d5167700 1 -- 172.21.15.81:0/3498622153 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d00cf570 con 0x7fd1d006d700 2023-10-07T08:53:43.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.222+0000 7fd1cf7fe700 1 -- 172.21.15.81:0/3498622153 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183221310 0 0) 0x7fd1d00cf2d0 con 0x7fd1d00d02b0 2023-10-07T08:53:43.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.223+0000 7fd1d4966700 1 --2- 172.21.15.81:0/3498622153 >> v2:172.21.15.89:3300/0 conn(0x7fd1d00d0b80 0x7fd1d00cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:53:43.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.223+0000 7fd1d5167700 1 --2- 172.21.15.81:0/3498622153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1d006d700 0x7fd1d015b320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80098e0 tx=0x7fd1b80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6367c6295667f10f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:43.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.223+0000 7fd1cf7fe700 1 -- 172.21.15.81:0/3498622153 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b800b640 con 0x7fd1d006d700 2023-10-07T08:53:43.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.223+0000 7fd1cf7fe700 1 -- 172.21.15.81:0/3498622153 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b800b7a0 con 0x7fd1d006d700 2023-10-07T08:53:43.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.223+0000 7fd1cf7fe700 1 -- 172.21.15.81:0/3498622153 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b800bb40 con 0x7fd1d006d700 2023-10-07T08:53:43.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.223+0000 7fd1d5968700 1 -- 172.21.15.81:0/3498622153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1d006d700 msgr2=0x7fd1d015b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:43.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.223+0000 7fd1d5968700 1 --2- 172.21.15.81:0/3498622153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1d006d700 0x7fd1d015b320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80098e0 tx=0x7fd1b80091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.223+0000 7fd1d5968700 1 -- 172.21.15.81:0/3498622153 shutdown_connections 2023-10-07T08:53:43.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.223+0000 7fd1d5968700 1 --2- 172.21.15.81:0/3498622153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1d006d700 0x7fd1d015b320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.223+0000 7fd1d5968700 1 --2- 172.21.15.81:0/3498622153 >> v2:172.21.15.89:3300/0 conn(0x7fd1d00d0b80 0x7fd1d00cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.223+0000 7fd1d5968700 1 -- 172.21.15.81:0/3498622153 >> 172.21.15.81:0/3498622153 conn(0x7fd1d0063230 msgr2=0x7fd1d0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:43.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.223+0000 7fd1d5968700 1 -- 172.21.15.81:0/3498622153 shutdown_connections 2023-10-07T08:53:43.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.223+0000 7fd1d5968700 1 -- 172.21.15.81:0/3498622153 wait complete. 2023-10-07T08:53:43.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.224+0000 7fd1d5968700 1 Processor -- start 2023-10-07T08:53:43.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.225+0000 7fd1d5968700 1 -- start start 2023-10-07T08:53:43.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.225+0000 7fd1d5968700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1d006d700 0x7fd1d013e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:43.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.225+0000 7fd1d5968700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1d00d02b0 0x7fd1d00b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:43.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.225+0000 7fd1d5968700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1d00d0b80 0x7fd1d016a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:43.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.225+0000 7fd1d5968700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d016b0c0 con 0x7fd1d00d0b80 2023-10-07T08:53:43.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.225+0000 7fd1d5968700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d016ab00 con 0x7fd1d00d02b0 2023-10-07T08:53:43.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.225+0000 7fd1d5968700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d016ade0 con 0x7fd1d006d700 2023-10-07T08:53:43.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.226+0000 7fd1d5167700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1d00d0b80 0x7fd1d016a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:43.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.226+0000 7fd1d5167700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1d00d0b80 0x7fd1d016a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52750/0 (socket says 172.21.15.81:52750) 2023-10-07T08:53:43.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.226+0000 7fd1d5167700 1 -- 172.21.15.81:0/4057519748 learned_addr learned my addr 172.21.15.81:0/4057519748 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.226+0000 7fd1cffff700 1 --2- 172.21.15.81:0/4057519748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1d00d02b0 0x7fd1d00b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.226+0000 7fd1d4966700 1 --2- 172.21.15.81:0/4057519748 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1d006d700 0x7fd1d013e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.226+0000 7fd1d5167700 1 -- 172.21.15.81:0/4057519748 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1d006d700 msgr2=0x7fd1d013e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.226+0000 7fd1d5167700 1 --2- 172.21.15.81:0/4057519748 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1d006d700 0x7fd1d013e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.226+0000 7fd1d5167700 1 -- 172.21.15.81:0/4057519748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1d00d02b0 msgr2=0x7fd1d00b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.226+0000 7fd1d5167700 1 --2- 172.21.15.81:0/4057519748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1d00d02b0 0x7fd1d00b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.226+0000 7fd1d5167700 1 -- 172.21.15.81:0/4057519748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c80094f0 con 0x7fd1d00d0b80 2023-10-07T08:53:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.226+0000 7fd1d5167700 1 --2- 172.21.15.81:0/4057519748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1d00d0b80 0x7fd1d016a100 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8013000 tx=0x7fd1b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.226+0000 7fd1ccff9700 1 -- 172.21.15.81:0/4057519748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b800b9e0 con 0x7fd1d00d0b80 2023-10-07T08:53:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.226+0000 7fd1d5968700 1 -- 172.21.15.81:0/4057519748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b8009420 con 0x7fd1d00d0b80 2023-10-07T08:53:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.226+0000 7fd1ccff9700 1 -- 172.21.15.81:0/4057519748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b8025420 con 0x7fd1d00d0b80 2023-10-07T08:53:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.226+0000 7fd1ccff9700 1 -- 172.21.15.81:0/4057519748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80257e0 con 0x7fd1d00d0b80 2023-10-07T08:53:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.226+0000 7fd1d5968700 1 -- 172.21.15.81:0/4057519748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d00b5570 con 0x7fd1d00d0b80 2023-10-07T08:53:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.227+0000 7fd1d5968700 1 -- 172.21.15.81:0/4057519748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d00b50f0 con 0x7fd1d00d0b80 2023-10-07T08:53:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.228+0000 7fd1ccff9700 1 -- 172.21.15.81:0/4057519748 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1b8023070 con 0x7fd1d00d0b80 2023-10-07T08:53:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.228+0000 7fd1ccff9700 1 --2- 172.21.15.81:0/4057519748 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd1b0066f30 0x7fd1b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.228+0000 7fd1ccff9700 1 -- 172.21.15.81:0/4057519748 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd1b80858d0 con 0x7fd1d00d0b80 2023-10-07T08:53:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.228+0000 7fd1d4966700 1 --2- 172.21.15.81:0/4057519748 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd1b0066f30 0x7fd1b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.228+0000 7fd1d4966700 1 --2- 172.21.15.81:0/4057519748 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd1b0066f30 0x7fd1b00693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8006fd0 tx=0x7fd1c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.232+0000 7fd1ccff9700 1 -- 172.21.15.81:0/4057519748 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1d00b50f0 con 0x7fd1d00d0b80 2023-10-07T08:53:43.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.415+0000 7fd1d5968700 1 -- 172.21.15.81:0/4057519748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd1d00b50f0 con 0x7fd1d00d0b80 2023-10-07T08:53:43.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.418+0000 7fd1ccff9700 1 -- 172.21.15.81:0/4057519748 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd1d00b50f0 con 0x7fd1d00d0b80 2023-10-07T08:53:43.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.420+0000 7fd1d5968700 1 -- 172.21.15.81:0/4057519748 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd1b0066f30 msgr2=0x7fd1b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:43.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.420+0000 7fd1d5968700 1 --2- 172.21.15.81:0/4057519748 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd1b0066f30 0x7fd1b00693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8006fd0 tx=0x7fd1c8008040 comp rx=0 tx=0).stop 2023-10-07T08:53:43.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.420+0000 7fd1d5968700 1 -- 172.21.15.81:0/4057519748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1d00d0b80 msgr2=0x7fd1d016a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:43.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.420+0000 7fd1d5968700 1 --2- 172.21.15.81:0/4057519748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1d00d0b80 0x7fd1d016a100 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8013000 tx=0x7fd1b8017000 comp rx=0 tx=0).stop 2023-10-07T08:53:43.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.420+0000 7fd1d5968700 1 -- 172.21.15.81:0/4057519748 shutdown_connections 2023-10-07T08:53:43.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.421+0000 7fd1d5968700 1 --2- 172.21.15.81:0/4057519748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1d00d0b80 0x7fd1d016a100 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.421+0000 7fd1d5968700 1 --2- 172.21.15.81:0/4057519748 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd1b0066f30 0x7fd1b00693e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.421+0000 7fd1d5968700 1 --2- 172.21.15.81:0/4057519748 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1d006d700 0x7fd1d013e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.421+0000 7fd1d5968700 1 --2- 172.21.15.81:0/4057519748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1d00d02b0 0x7fd1d00b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.421+0000 7fd1d5968700 1 -- 172.21.15.81:0/4057519748 >> 172.21.15.81:0/4057519748 conn(0x7fd1d0063230 msgr2=0x7fd1d015b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:43.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.421+0000 7fd1d5968700 1 -- 172.21.15.81:0/4057519748 shutdown_connections 2023-10-07T08:53:43.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.421+0000 7fd1d5968700 1 -- 172.21.15.81:0/4057519748 wait complete. 2023-10-07T08:53:43.434 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:53:43.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:53:43.471 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:53:43.524 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:53:43.524 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-07T08:53:43.525 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:53:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.639+0000 7f939cb7a700 1 Processor -- start 2023-10-07T08:53:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.639+0000 7f939cb7a700 1 -- start start 2023-10-07T08:53:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.640+0000 7f939cb7a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93980add30 0x7f93980b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.640+0000 7f939cb7a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9398067640 0x7f9398067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.640+0000 7f939cb7a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9398067ff0 con 0x7f93980ce890 2023-10-07T08:53:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.640+0000 7f939cb7a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93980b37b0 con 0x7f9398067640 2023-10-07T08:53:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.640+0000 7f939cb7a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93980b17c0 con 0x7f93980add30 2023-10-07T08:53:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.640+0000 7f93977fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93980add30 0x7f93980b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.640+0000 7f9396ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9398067640 0x7f9398067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.640+0000 7f9396ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9398067640 0x7f9398067ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:52340/0 (socket says 172.21.15.81:52340) 2023-10-07T08:53:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.640+0000 7f93977fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93980add30 0x7f93980b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:56070/0 (socket says 172.21.15.81:56070) 2023-10-07T08:53:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.640+0000 7f9396ffd700 1 -- 172.21.15.81:0/2780840251 learned_addr learned my addr 172.21.15.81:0/2780840251 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.640+0000 7f9397fff700 1 --1- 172.21.15.81:0/2780840251 >> v1:172.21.15.89:6789/0 conn(0x7f93980ce890 0x7f93980cc0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:51236/0 (socket says 172.21.15.81:51236) 2023-10-07T08:53:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.641+0000 7f93977fe700 1 -- 172.21.15.81:0/2780840251 >> v2:172.21.15.89:3300/0 conn(0x7f9398067640 msgr2=0x7f9398067ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.641+0000 7f93977fe700 1 --2- 172.21.15.81:0/2780840251 >> v2:172.21.15.89:3300/0 conn(0x7f9398067640 0x7f9398067ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.641+0000 7f93977fe700 1 -- 172.21.15.81:0/2780840251 >> v1:172.21.15.89:6789/0 conn(0x7f93980ce890 legacy=0x7f93980cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.641+0000 7f93977fe700 1 -- 172.21.15.81:0/2780840251 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93980b1d80 con 0x7f93980add30 2023-10-07T08:53:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.641+0000 7f9396ffd700 1 --2- 172.21.15.81:0/2780840251 >> v2:172.21.15.89:3300/0 conn(0x7f9398067640 0x7f9398067ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:53:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.641+0000 7f93977fe700 1 --2- 172.21.15.81:0/2780840251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93980add30 0x7f93980b2210 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9388009e60 tx=0x7f9388009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=190bd4614b19a407 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.641+0000 7f93967fc700 1 -- 172.21.15.81:0/2780840251 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938800e070 con 0x7f93980add30 2023-10-07T08:53:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.641+0000 7f93967fc700 1 -- 172.21.15.81:0/2780840251 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938800bb60 con 0x7f93980add30 2023-10-07T08:53:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.641+0000 7f93967fc700 1 -- 172.21.15.81:0/2780840251 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388012430 con 0x7f93980add30 2023-10-07T08:53:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.642+0000 7f939cb7a700 1 -- 172.21.15.81:0/2780840251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93980add30 msgr2=0x7f93980b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.642+0000 7f939cb7a700 1 --2- 172.21.15.81:0/2780840251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93980add30 0x7f93980b2210 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9388009e60 tx=0x7f9388009780 comp rx=0 tx=0).stop 2023-10-07T08:53:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.642+0000 7f939cb7a700 1 -- 172.21.15.81:0/2780840251 shutdown_connections 2023-10-07T08:53:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.642+0000 7f939cb7a700 1 --2- 172.21.15.81:0/2780840251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93980add30 0x7f93980b2210 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.642+0000 7f939cb7a700 1 --2- 172.21.15.81:0/2780840251 >> v2:172.21.15.89:3300/0 conn(0x7f9398067640 0x7f9398067ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.642+0000 7f939cb7a700 1 -- 172.21.15.81:0/2780840251 >> 172.21.15.81:0/2780840251 conn(0x7f939806c620 msgr2=0x7f939806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.642+0000 7f939cb7a700 1 -- 172.21.15.81:0/2780840251 shutdown_connections 2023-10-07T08:53:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.642+0000 7f939cb7a700 1 -- 172.21.15.81:0/2780840251 wait complete. 2023-10-07T08:53:43.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.643+0000 7f939cb7a700 1 Processor -- start 2023-10-07T08:53:43.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.643+0000 7f939cb7a700 1 -- start start 2023-10-07T08:53:43.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f939cb7a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9398067640 0x7f93980cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:43.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f939cb7a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93980add30 0x7f93980aa500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:43.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f939cb7a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93980ce890 0x7f939815a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:43.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f939cb7a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93980aaee0 con 0x7f9398067640 2023-10-07T08:53:43.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f939cb7a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93980ab1c0 con 0x7f93980ce890 2023-10-07T08:53:43.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f939cb7a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93980ab4a0 con 0x7f93980add30 2023-10-07T08:53:43.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f93977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9398067640 0x7f93980cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:43.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f93977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9398067640 0x7f93980cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52764/0 (socket says 172.21.15.81:52764) 2023-10-07T08:53:43.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f93977fe700 1 -- 172.21.15.81:0/3356422690 learned_addr learned my addr 172.21.15.81:0/3356422690 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:43.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f9396ffd700 1 --2- 172.21.15.81:0/3356422690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93980add30 0x7f93980aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:43.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f9397fff700 1 --2- 172.21.15.81:0/3356422690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93980ce890 0x7f939815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:43.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f93977fe700 1 -- 172.21.15.81:0/3356422690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93980add30 msgr2=0x7f93980aa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:43.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f93977fe700 1 --2- 172.21.15.81:0/3356422690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93980add30 0x7f93980aa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f93977fe700 1 -- 172.21.15.81:0/3356422690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93980ce890 msgr2=0x7f939815a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:43.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f93977fe700 1 --2- 172.21.15.81:0/3356422690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93980ce890 0x7f939815a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f93977fe700 1 -- 172.21.15.81:0/3356422690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c0094f0 con 0x7f9398067640 2023-10-07T08:53:43.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f93977fe700 1 --2- 172.21.15.81:0/3356422690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9398067640 0x7f93980cada0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f93980b1900 tx=0x7f9388019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:43.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f937f7fe700 1 -- 172.21.15.81:0/3356422690 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388012d00 con 0x7f9398067640 2023-10-07T08:53:43.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f937f7fe700 1 -- 172.21.15.81:0/3356422690 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9388012e60 con 0x7f9398067640 2023-10-07T08:53:43.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f939cb7a700 1 -- 172.21.15.81:0/3356422690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9388009a20 con 0x7f9398067640 2023-10-07T08:53:43.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f937f7fe700 1 -- 172.21.15.81:0/3356422690 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93880276c0 con 0x7f9398067640 2023-10-07T08:53:43.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.644+0000 7f939cb7a700 1 -- 172.21.15.81:0/3356422690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93980aba60 con 0x7f9398067640 2023-10-07T08:53:43.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.645+0000 7f939cb7a700 1 -- 172.21.15.81:0/3356422690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9398069920 con 0x7f9398067640 2023-10-07T08:53:43.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.646+0000 7f937f7fe700 1 -- 172.21.15.81:0/3356422690 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9388024070 con 0x7f9398067640 2023-10-07T08:53:43.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.646+0000 7f937f7fe700 1 --2- 172.21.15.81:0/3356422690 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9384066f30 0x7f93840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:43.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.646+0000 7f937f7fe700 1 -- 172.21.15.81:0/3356422690 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9388086830 con 0x7f9398067640 2023-10-07T08:53:43.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.646+0000 7f9396ffd700 1 --2- 172.21.15.81:0/3356422690 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9384066f30 0x7f93840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:43.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.646+0000 7f9396ffd700 1 --2- 172.21.15.81:0/3356422690 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9384066f30 0x7f93840693e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f93980cf5d0 tx=0x7f938c009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:43.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.650+0000 7f937f7fe700 1 -- 172.21.15.81:0/3356422690 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9388053da0 con 0x7f9398067640 2023-10-07T08:53:43.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.872+0000 7f939cb7a700 1 -- 172.21.15.81:0/3356422690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9398068220 con 0x7f9398067640 2023-10-07T08:53:43.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.873+0000 7f937f7fe700 1 -- 172.21.15.81:0/3356422690 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f93880573c0 con 0x7f9398067640 2023-10-07T08:53:43.875 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:43.875 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":84,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3709604420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3709604420},{"type":"v1","addr":"172.21.15.89:6835","nonce":3709604420}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7180,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/3081981460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3081981460},{"type":"v1","addr":"172.21.15.89:6834","nonce":3081981460}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":7842,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/517568220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":517568220},{"type":"v1","addr":"172.21.15.81:6836","nonce":517568220}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7845,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2183069282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2183069282},{"type":"v1","addr":"172.21.15.81:6837","nonce":2183069282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[]} 2023-10-07T08:53:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.875+0000 7f939cb7a700 1 -- 172.21.15.81:0/3356422690 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9384066f30 msgr2=0x7f93840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.875+0000 7f939cb7a700 1 --2- 172.21.15.81:0/3356422690 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9384066f30 0x7f93840693e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f93980cf5d0 tx=0x7f938c009250 comp rx=0 tx=0).stop 2023-10-07T08:53:43.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.875+0000 7f939cb7a700 1 -- 172.21.15.81:0/3356422690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9398067640 msgr2=0x7f93980cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:43.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.875+0000 7f939cb7a700 1 --2- 172.21.15.81:0/3356422690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9398067640 0x7f93980cada0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f93980b1900 tx=0x7f9388019000 comp rx=0 tx=0).stop 2023-10-07T08:53:43.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.875+0000 7f939cb7a700 1 -- 172.21.15.81:0/3356422690 shutdown_connections 2023-10-07T08:53:43.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.875+0000 7f939cb7a700 1 --2- 172.21.15.81:0/3356422690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93980ce890 0x7f939815a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.875+0000 7f939cb7a700 1 --2- 172.21.15.81:0/3356422690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9398067640 0x7f93980cada0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.875+0000 7f939cb7a700 1 --2- 172.21.15.81:0/3356422690 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9384066f30 0x7f93840693e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.875+0000 7f939cb7a700 1 --2- 172.21.15.81:0/3356422690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93980add30 0x7f93980aa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:43.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.875+0000 7f939cb7a700 1 -- 172.21.15.81:0/3356422690 >> 172.21.15.81:0/3356422690 conn(0x7f939806c620 msgr2=0x7f939815af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:43.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.875+0000 7f939cb7a700 1 -- 172.21.15.81:0/3356422690 shutdown_connections 2023-10-07T08:53:43.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:43.875+0000 7f939cb7a700 1 -- 172.21.15.81:0/3356422690 wait complete. 2023-10-07T08:53:43.878 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 84 2023-10-07T08:53:43.889 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-07T08:53:43.889 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-07T08:53:43.889 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T08:53:43.890 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:53:43.890 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-07T08:53:43.890 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-07T08:53:43.891 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T08:53:43.891 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:53:43.891 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-07T08:53:43.891 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-07T08:53:43.891 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T08:53:43.891 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:53:43.892 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-07T08:53:43.892 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-07T08:53:43.892 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T08:53:43.892 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:53:43.898 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T08:53:43.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-07T08:53:43.899 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T08:53:43.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-07T08:53:43.902 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T08:53:43.903 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-07T08:53:43.903 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T08:53:43.903 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-07T08:53:43.942 INFO:tasks.ceph.mds.a:Started 2023-10-07T08:53:43.943 DEBUG:teuthology.parallel:result is None 2023-10-07T08:53:43.944 INFO:tasks.ceph.mds.c:Started 2023-10-07T08:53:43.944 DEBUG:teuthology.parallel:result is None 2023-10-07T08:53:43.945 INFO:tasks.ceph.mds.b:Started 2023-10-07T08:53:43.945 DEBUG:teuthology.parallel:result is None 2023-10-07T08:53:43.946 INFO:tasks.ceph.mds.d:Started 2023-10-07T08:53:43.946 DEBUG:teuthology.parallel:result is None 2023-10-07T08:53:43.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-07T08:53:44.014 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-07T08:53:44.014 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-07T08:53:44.027 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-10-07T08:53:44.027 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-10-07T08:53:44.027 INFO:tasks.ceph.mds.d.smithi089.stderr:2023-10-07T08:53:44.026+0000 7f0e7813f700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-07T08:53:44.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.067+0000 7f97e4957700 1 Processor -- start 2023-10-07T08:53:44.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.067+0000 7f97e4957700 1 -- start start 2023-10-07T08:53:44.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.067+0000 7f97e4957700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f97e0159b40 0x7f97e00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:44.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.067+0000 7f97e4957700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97e0068e90 0x7f97e00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.067+0000 7f97e4957700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e00cee10 con 0x7f97e0159f10 2023-10-07T08:53:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.067+0000 7f97e4957700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e00cd040 con 0x7f97e0068e90 2023-10-07T08:53:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.067+0000 7f97e4957700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e00cd320 con 0x7f97e0159b40 2023-10-07T08:53:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.067+0000 7f97df59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97e0068e90 0x7f97e00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.068+0000 7f97de59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f97e0159f10 0x7f97e0068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42008/0 (socket says 172.21.15.81:42008) 2023-10-07T08:53:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.068+0000 7f97de59c700 1 -- 172.21.15.81:0/4055574704 learned_addr learned my addr 172.21.15.81:0/4055574704 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.068+0000 7f97ded9d700 1 --2- 172.21.15.81:0/4055574704 >> v2:172.21.15.89:3300/0 conn(0x7f97e0159b40 0x7f97e00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.068+0000 7f97df59e700 1 -- 172.21.15.81:0/4055574704 >> v2:172.21.15.89:3300/0 conn(0x7f97e0159b40 msgr2=0x7f97e00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.068+0000 7f97df59e700 1 --2- 172.21.15.81:0/4055574704 >> v2:172.21.15.89:3300/0 conn(0x7f97e0159b40 0x7f97e00cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.068+0000 7f97df59e700 1 -- 172.21.15.81:0/4055574704 >> v1:172.21.15.81:6789/0 conn(0x7f97e0159f10 legacy=0x7f97e0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.068+0000 7f97df59e700 1 -- 172.21.15.81:0/4055574704 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e00ce7c0 con 0x7f97e0068e90 2023-10-07T08:53:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.068+0000 7f97ddd9b700 1 -- 172.21.15.81:0/4055574704 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617744866 0 0) 0x7f97e00cee10 con 0x7f97e0159f10 2023-10-07T08:53:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.068+0000 7f97df59e700 1 --2- 172.21.15.81:0/4055574704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e0068e90 0x7f97e00cf2a0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f97e00d0bc0 tx=0x7f97d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77da6b0a69eb13b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.068+0000 7f97ddd9b700 1 -- 172.21.15.81:0/4055574704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800e070 con 0x7f97e0068e90 2023-10-07T08:53:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.068+0000 7f97ddd9b700 1 -- 172.21.15.81:0/4055574704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d800bb60 con 0x7f97e0068e90 2023-10-07T08:53:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.068+0000 7f97ddd9b700 1 -- 172.21.15.81:0/4055574704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8012430 con 0x7f97e0068e90 2023-10-07T08:53:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.069+0000 7f97e4957700 1 -- 172.21.15.81:0/4055574704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e0068e90 msgr2=0x7f97e00cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.069+0000 7f97e4957700 1 --2- 172.21.15.81:0/4055574704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e0068e90 0x7f97e00cf2a0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f97e00d0bc0 tx=0x7f97d8009780 comp rx=0 tx=0).stop 2023-10-07T08:53:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.069+0000 7f97e4957700 1 -- 172.21.15.81:0/4055574704 shutdown_connections 2023-10-07T08:53:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.069+0000 7f97e4957700 1 --2- 172.21.15.81:0/4055574704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e0068e90 0x7f97e00cf2a0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.069+0000 7f97e4957700 1 --2- 172.21.15.81:0/4055574704 >> v2:172.21.15.89:3300/0 conn(0x7f97e0159b40 0x7f97e00cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.069+0000 7f97e4957700 1 -- 172.21.15.81:0/4055574704 >> 172.21.15.81:0/4055574704 conn(0x7f97e00cd660 msgr2=0x7f97e00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.069+0000 7f97e4957700 1 -- 172.21.15.81:0/4055574704 shutdown_connections 2023-10-07T08:53:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.069+0000 7f97e4957700 1 -- 172.21.15.81:0/4055574704 wait complete. 2023-10-07T08:53:44.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.070+0000 7f97e4957700 1 Processor -- start 2023-10-07T08:53:44.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.070+0000 7f97e4957700 1 -- start start 2023-10-07T08:53:44.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97e4957700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e0068e90 0x7f97e016b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:44.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97e4957700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97e0159b40 0x7f97e0169f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:44.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97e4957700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97e0159f10 0x7f97e015c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:44.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97e4957700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e00cab30 con 0x7f97e0068e90 2023-10-07T08:53:44.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97e4957700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e016e9a0 con 0x7f97e0159f10 2023-10-07T08:53:44.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97e4957700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e016ddd0 con 0x7f97e0159b40 2023-10-07T08:53:44.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97ded9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e0068e90 0x7f97e016b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:44.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97ded9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e0068e90 0x7f97e016b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52816/0 (socket says 172.21.15.81:52816) 2023-10-07T08:53:44.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97ded9d700 1 -- 172.21.15.81:0/1665478935 learned_addr learned my addr 172.21.15.81:0/1665478935 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:44.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97df59e700 1 --2- 172.21.15.81:0/1665478935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97e0159f10 0x7f97e015c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:44.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97de59c700 1 --2- 172.21.15.81:0/1665478935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97e0159b40 0x7f97e0169f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:44.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97ded9d700 1 -- 172.21.15.81:0/1665478935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97e0159b40 msgr2=0x7f97e0169f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:44.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97ded9d700 1 --2- 172.21.15.81:0/1665478935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97e0159b40 0x7f97e0169f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:44.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97ded9d700 1 -- 172.21.15.81:0/1665478935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97e0159f10 msgr2=0x7f97e015c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:44.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97ded9d700 1 --2- 172.21.15.81:0/1665478935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97e0159f10 0x7f97e015c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:44.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97ded9d700 1 -- 172.21.15.81:0/1665478935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d8009a20 con 0x7f97e0068e90 2023-10-07T08:53:44.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97ded9d700 1 --2- 172.21.15.81:0/1665478935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e0068e90 0x7f97e016b180 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f97d000ec80 tx=0x7f97d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:44.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97c6ffd700 1 -- 172.21.15.81:0/1665478935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d000c850 con 0x7f97e0068e90 2023-10-07T08:53:44.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97c6ffd700 1 -- 172.21.15.81:0/1665478935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d000c9b0 con 0x7f97e0068e90 2023-10-07T08:53:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97e4957700 1 -- 172.21.15.81:0/1665478935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e016b6c0 con 0x7f97e0068e90 2023-10-07T08:53:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97c6ffd700 1 -- 172.21.15.81:0/1665478935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d000cd50 con 0x7f97e0068e90 2023-10-07T08:53:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.071+0000 7f97e4957700 1 -- 172.21.15.81:0/1665478935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e016e120 con 0x7f97e0068e90 2023-10-07T08:53:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.072+0000 7f97e4957700 1 -- 172.21.15.81:0/1665478935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e016ec80 con 0x7f97e0068e90 2023-10-07T08:53:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.073+0000 7f97c6ffd700 1 -- 172.21.15.81:0/1665478935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97d0013680 con 0x7f97e0068e90 2023-10-07T08:53:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.073+0000 7f97c6ffd700 1 --2- 172.21.15.81:0/1665478935 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f97cc066f30 0x7f97cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.073+0000 7f97c6ffd700 1 -- 172.21.15.81:0/1665478935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f97d0084460 con 0x7f97e0068e90 2023-10-07T08:53:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.073+0000 7f97de59c700 1 --2- 172.21.15.81:0/1665478935 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f97cc066f30 0x7f97cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.074+0000 7f97de59c700 1 --2- 172.21.15.81:0/1665478935 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f97cc066f30 0x7f97cc0693e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f97e00689d0 tx=0x7f97d4007f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:44.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.077+0000 7f97c6ffd700 1 -- 172.21.15.81:0/1665478935 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97d00519d0 con 0x7f97e0068e90 2023-10-07T08:53:44.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:44.275+0000 7f97e4957700 1 -- 172.21.15.81:0/1665478935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f97e0063e90 con 0x7f97e0068e90 2023-10-07T08:53:45.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.103+0000 7f97c6ffd700 1 -- 172.21.15.81:0/1665478935 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v186) v1 ==== 97+0+0 (secure 0 0 0) 0x7f97d0054ff0 con 0x7f97e0068e90 2023-10-07T08:53:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.105+0000 7f97e4957700 1 -- 172.21.15.81:0/1665478935 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f97cc066f30 msgr2=0x7f97cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.105+0000 7f97e4957700 1 --2- 172.21.15.81:0/1665478935 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f97cc066f30 0x7f97cc0693e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f97e00689d0 tx=0x7f97d4007f50 comp rx=0 tx=0).stop 2023-10-07T08:53:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.105+0000 7f97e4957700 1 -- 172.21.15.81:0/1665478935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e0068e90 msgr2=0x7f97e016b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.105+0000 7f97e4957700 1 --2- 172.21.15.81:0/1665478935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e0068e90 0x7f97e016b180 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f97d000ec80 tx=0x7f97d00091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.105+0000 7f97e4957700 1 -- 172.21.15.81:0/1665478935 shutdown_connections 2023-10-07T08:53:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.105+0000 7f97e4957700 1 --2- 172.21.15.81:0/1665478935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97e0159f10 0x7f97e015c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.105+0000 7f97e4957700 1 --2- 172.21.15.81:0/1665478935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e0068e90 0x7f97e016b180 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.105+0000 7f97e4957700 1 --2- 172.21.15.81:0/1665478935 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f97cc066f30 0x7f97cc0693e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.105+0000 7f97e4957700 1 --2- 172.21.15.81:0/1665478935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97e0159b40 0x7f97e0169f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.105+0000 7f97e4957700 1 -- 172.21.15.81:0/1665478935 >> 172.21.15.81:0/1665478935 conn(0x7f97e00cd660 msgr2=0x7f97e00c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.105+0000 7f97e4957700 1 -- 172.21.15.81:0/1665478935 shutdown_connections 2023-10-07T08:53:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.105+0000 7f97e4957700 1 -- 172.21.15.81:0/1665478935 wait complete. 2023-10-07T08:53:45.108 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-10-07T08:53:45.119 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-07T08:53:45.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.232+0000 7fb813fff700 1 Processor -- start 2023-10-07T08:53:45.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.232+0000 7fb813fff700 1 -- start start 2023-10-07T08:53:45.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.233+0000 7fb813fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb814159f10 0x7fb814068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.233+0000 7fb813fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb814068cc0 0x7fb8140cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.233+0000 7fb813fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8140cee10 con 0x7fb814159b40 2023-10-07T08:53:45.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.233+0000 7fb813fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb814069140 con 0x7fb814068cc0 2023-10-07T08:53:45.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.233+0000 7fb813fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140cd040 con 0x7fb814159f10 2023-10-07T08:53:45.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.233+0000 7fb8137fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb814068cc0 0x7fb8140cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.233+0000 7fb812ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb814159b40 0x7fb8140cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42022/0 (socket says 172.21.15.81:42022) 2023-10-07T08:53:45.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.233+0000 7fb812ffd700 1 -- 172.21.15.81:0/3580030615 learned_addr learned my addr 172.21.15.81:0/3580030615 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:45.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.233+0000 7fb80a7fc700 1 --2- 172.21.15.81:0/3580030615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb814159f10 0x7fb814068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.233+0000 7fb8137fe700 1 -- 172.21.15.81:0/3580030615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb814159f10 msgr2=0x7fb814068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:45.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.233+0000 7fb8137fe700 1 --2- 172.21.15.81:0/3580030615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb814159f10 0x7fb814068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.233+0000 7fb8137fe700 1 -- 172.21.15.81:0/3580030615 >> v1:172.21.15.81:6789/0 conn(0x7fb814159b40 legacy=0x7fb8140cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:45.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.233+0000 7fb8137fe700 1 -- 172.21.15.81:0/3580030615 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8140cd320 con 0x7fb814068cc0 2023-10-07T08:53:45.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.233+0000 7fb8127fc700 1 -- 172.21.15.81:0/3580030615 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138471535 0 0) 0x7fb8140cee10 con 0x7fb814159b40 2023-10-07T08:53:45.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.233+0000 7fb80a7fc700 1 --2- 172.21.15.81:0/3580030615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb814159f10 0x7fb814068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:53:45.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.234+0000 7fb8137fe700 1 --2- 172.21.15.81:0/3580030615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814068cc0 0x7fb8140cf2a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009e60 tx=0x7fb80c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1239e1b8e33d3ed3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:45.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.234+0000 7fb8127fc700 1 -- 172.21.15.81:0/3580030615 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c00e070 con 0x7fb814068cc0 2023-10-07T08:53:45.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.234+0000 7fb8127fc700 1 -- 172.21.15.81:0/3580030615 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c00bc30 con 0x7fb814068cc0 2023-10-07T08:53:45.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.234+0000 7fb8127fc700 1 -- 172.21.15.81:0/3580030615 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c012430 con 0x7fb814068cc0 2023-10-07T08:53:45.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.234+0000 7fb813fff700 1 -- 172.21.15.81:0/3580030615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814068cc0 msgr2=0x7fb8140cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:45.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.234+0000 7fb813fff700 1 --2- 172.21.15.81:0/3580030615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814068cc0 0x7fb8140cf2a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009e60 tx=0x7fb80c009780 comp rx=0 tx=0).stop 2023-10-07T08:53:45.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.234+0000 7fb813fff700 1 -- 172.21.15.81:0/3580030615 shutdown_connections 2023-10-07T08:53:45.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.234+0000 7fb813fff700 1 --2- 172.21.15.81:0/3580030615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814068cc0 0x7fb8140cf2a0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.234+0000 7fb813fff700 1 --2- 172.21.15.81:0/3580030615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb814159f10 0x7fb814068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.234+0000 7fb813fff700 1 -- 172.21.15.81:0/3580030615 >> 172.21.15.81:0/3580030615 conn(0x7fb8140cd660 msgr2=0x7fb8140cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:45.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.234+0000 7fb813fff700 1 -- 172.21.15.81:0/3580030615 shutdown_connections 2023-10-07T08:53:45.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.234+0000 7fb813fff700 1 -- 172.21.15.81:0/3580030615 wait complete. 2023-10-07T08:53:45.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.235+0000 7fb813fff700 1 Processor -- start 2023-10-07T08:53:45.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.236+0000 7fb813fff700 1 -- start start 2023-10-07T08:53:45.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.236+0000 7fb813fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814068cc0 0x7fb8141494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.236+0000 7fb813fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb814159b40 0x7fb81406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.236+0000 7fb813fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb814159f10 0x7fb81406dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.236+0000 7fb813fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81415b030 con 0x7fb814068cc0 2023-10-07T08:53:45.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.236+0000 7fb813fff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81415b310 con 0x7fb814159f10 2023-10-07T08:53:45.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.236+0000 7fb813fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140b3a30 con 0x7fb814159b40 2023-10-07T08:53:45.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.236+0000 7fb812ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814068cc0 0x7fb8141494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.236+0000 7fb812ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814068cc0 0x7fb8141494f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52840/0 (socket says 172.21.15.81:52840) 2023-10-07T08:53:45.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.236+0000 7fb812ffd700 1 -- 172.21.15.81:0/2324169616 learned_addr learned my addr 172.21.15.81:0/2324169616 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:45.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.236+0000 7fb80a7fc700 1 --2- 172.21.15.81:0/2324169616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb814159b40 0x7fb81406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.237+0000 7fb8137fe700 1 --2- 172.21.15.81:0/2324169616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb814159f10 0x7fb81406dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.237+0000 7fb812ffd700 1 -- 172.21.15.81:0/2324169616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb814159b40 msgr2=0x7fb81406d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:45.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.237+0000 7fb812ffd700 1 --2- 172.21.15.81:0/2324169616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb814159b40 0x7fb81406d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.237+0000 7fb812ffd700 1 -- 172.21.15.81:0/2324169616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb814159f10 msgr2=0x7fb81406dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:45.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.237+0000 7fb812ffd700 1 --2- 172.21.15.81:0/2324169616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb814159f10 0x7fb81406dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.237+0000 7fb812ffd700 1 -- 172.21.15.81:0/2324169616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c009a20 con 0x7fb814068cc0 2023-10-07T08:53:45.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.237+0000 7fb812ffd700 1 --2- 172.21.15.81:0/2324169616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814068cc0 0x7fb8141494f0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fb80400c7e0 tx=0x7fb804007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:45.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.237+0000 7fb80b7fe700 1 -- 172.21.15.81:0/2324169616 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb804005b30 con 0x7fb814068cc0 2023-10-07T08:53:45.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.237+0000 7fb80b7fe700 1 -- 172.21.15.81:0/2324169616 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb804005c90 con 0x7fb814068cc0 2023-10-07T08:53:45.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.237+0000 7fb80b7fe700 1 -- 172.21.15.81:0/2324169616 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb804007300 con 0x7fb814068cc0 2023-10-07T08:53:45.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.237+0000 7fb813fff700 1 -- 172.21.15.81:0/2324169616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8140b3d10 con 0x7fb814068cc0 2023-10-07T08:53:45.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.237+0000 7fb813fff700 1 -- 172.21.15.81:0/2324169616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb814149a30 con 0x7fb814068cc0 2023-10-07T08:53:45.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.238+0000 7fb813fff700 1 -- 172.21.15.81:0/2324169616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb814063e90 con 0x7fb814068cc0 2023-10-07T08:53:45.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.238+0000 7fb80b7fe700 1 -- 172.21.15.81:0/2324169616 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8040076b0 con 0x7fb814068cc0 2023-10-07T08:53:45.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.239+0000 7fb80b7fe700 1 --2- 172.21.15.81:0/2324169616 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb7f4066f60 0x7fb7f4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.239+0000 7fb80b7fe700 1 -- 172.21.15.81:0/2324169616 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb804083740 con 0x7fb814068cc0 2023-10-07T08:53:45.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.239+0000 7fb80a7fc700 1 --2- 172.21.15.81:0/2324169616 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb7f4066f60 0x7fb7f4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.239+0000 7fb80a7fc700 1 --2- 172.21.15.81:0/2324169616 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb7f4066f60 0x7fb7f4069410 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb8140d0610 tx=0x7fb7fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:45.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.243+0000 7fb80b7fe700 1 -- 172.21.15.81:0/2324169616 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb804050d00 con 0x7fb814068cc0 2023-10-07T08:53:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.498+0000 7fb813fff700 1 -- 172.21.15.81:0/2324169616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb8140ce7c0 con 0x7fb814068cc0 2023-10-07T08:53:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.498+0000 7fb80b7fe700 1 -- 172.21.15.81:0/2324169616 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb804054320 con 0x7fb814068cc0 2023-10-07T08:53:45.500 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:45.500 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:53:45.500 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-10-07T08:53:45.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.500 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-10-07T08:53:45.500 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlK8v0EhAAyj+l+ifyEevPT96HbuWzkw==", 2023-10-07T08:53:45.501 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.501 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:53:45.501 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:53:45.501 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:53:45.501 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:53:45.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.501 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-10-07T08:53:45.501 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlN0UcHhAA0o1jHEL9Ow40VDezKTunOw==", 2023-10-07T08:53:45.501 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:53:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:53:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:53:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:53:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-10-07T08:53:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlvsm6GRAApZehzqt3HugU+h9RGWQh8g==", 2023-10-07T08:53:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.502 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:53:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:53:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:53:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:53:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-10-07T08:53:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8XLiJBAAMBqSo/+NZuuL/pPnTitAUw==", 2023-10-07T08:53:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:53:45.503 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:53:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:53:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:53:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-10-07T08:53:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD2GSFlwYNOOBAAMpoFTAZdRERvqFbI4Lno9g==", 2023-10-07T08:53:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:53:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:53:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:53:45.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.505 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-10-07T08:53:45.505 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlejEnBBAAsnZCgsTTMWvqr2n4FfgWCQ==", 2023-10-07T08:53:45.505 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.505 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:53:45.505 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:53:45.505 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:53:45.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.505 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-10-07T08:53:45.506 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlDjS3DRAAfyBS9XSkAY6Se+RNw9jwWw==", 2023-10-07T08:53:45.506 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.506 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:53:45.506 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:53:45.506 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:53:45.506 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.506 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-10-07T08:53:45.506 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD3GSFlnLaEFxAAtQ3AxrEGCcXYvJF2/wP1yw==", 2023-10-07T08:53:45.506 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.507 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:53:45.507 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:53:45.507 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:53:45.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.507 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-10-07T08:53:45.507 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlllNdIRAAXgD+PAR1Piya6p94xfGbXA==", 2023-10-07T08:53:45.507 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.507 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:53:45.507 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:53:45.507 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:53:45.508 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.508 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-10-07T08:53:45.508 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFleIM7KBAAIz+WlbgsmtAuSMPO+kh/Xw==", 2023-10-07T08:53:45.508 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.508 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:53:45.508 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:53:45.508 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:53:45.508 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.509 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-10-07T08:53:45.509 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFlFNlEMRAAt7dpMTylOj0KsJy/law6Nw==", 2023-10-07T08:53:45.509 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.509 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:53:45.509 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:53:45.509 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:53:45.509 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.509 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-10-07T08:53:45.509 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6GSFloCRbOhAA8XzXVwVYYYZIJV+F84EiDQ==", 2023-10-07T08:53:45.509 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.509 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-10-07T08:53:45.510 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-10-07T08:53:45.510 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:53:45.510 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.510 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-10-07T08:53:45.510 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl7cS0KBAA2K6kkFjyEZYa0xYx53Nf7g==", 2023-10-07T08:53:45.510 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.510 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:53:45.510 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-10-07T08:53:45.510 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-07T08:53:45.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.511 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-10-07T08:53:45.511 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlP3EBMRAAWXcQeEkoEzBCSQzvz/AzBQ==", 2023-10-07T08:53:45.511 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.511 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:53:45.511 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:53:45.511 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:53:45.511 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:53:45.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.512 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-10-07T08:53:45.512 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFldtgKLhAAX8L0S1NgyHsOj4cUljxH/A==", 2023-10-07T08:53:45.512 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.512 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:53:45.512 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:53:45.512 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:53:45.512 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:53:45.512 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.513 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-10-07T08:53:45.513 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlJ+VXNhAA9sXFpdOEIZxQLiS8LJwa3A==", 2023-10-07T08:53:45.513 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.513 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-10-07T08:53:45.513 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-10-07T08:53:45.513 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-10-07T08:53:45.513 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-10-07T08:53:45.513 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.513 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-10-07T08:53:45.513 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDyGSFle021MxAA39oudTkATALz6ZklfA0QQA==", 2023-10-07T08:53:45.514 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.514 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:53:45.514 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-10-07T08:53:45.514 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-10-07T08:53:45.514 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:53:45.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.514 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-10-07T08:53:45.515 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFl8c3zDxAAKU/DHPPZhFJ1MKw48C6lJQ==", 2023-10-07T08:53:45.515 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.515 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:53:45.515 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:53:45.515 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:53:45.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:45.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:45.515 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-10-07T08:53:45.515 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDzGSFlByYuDBAA2xkiT3FNBRXjSMlu+GdRjg==", 2023-10-07T08:53:45.515 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-10-07T08:53:45.516 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-10-07T08:53:45.516 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-10-07T08:53:45.516 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-10-07T08:53:45.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:45.516 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:45.516 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:53:45.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.500+0000 7fb813fff700 1 -- 172.21.15.81:0/2324169616 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb7f4066f60 msgr2=0x7fb7f4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:45.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.500+0000 7fb813fff700 1 --2- 172.21.15.81:0/2324169616 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb7f4066f60 0x7fb7f4069410 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb8140d0610 tx=0x7fb7fc008040 comp rx=0 tx=0).stop 2023-10-07T08:53:45.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.500+0000 7fb813fff700 1 -- 172.21.15.81:0/2324169616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814068cc0 msgr2=0x7fb8141494f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:45.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.500+0000 7fb813fff700 1 --2- 172.21.15.81:0/2324169616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814068cc0 0x7fb8141494f0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fb80400c7e0 tx=0x7fb804007df0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.500+0000 7fb813fff700 1 -- 172.21.15.81:0/2324169616 shutdown_connections 2023-10-07T08:53:45.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.500+0000 7fb813fff700 1 --2- 172.21.15.81:0/2324169616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb814159f10 0x7fb81406dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.500+0000 7fb813fff700 1 --2- 172.21.15.81:0/2324169616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb814068cc0 0x7fb8141494f0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.500+0000 7fb813fff700 1 --2- 172.21.15.81:0/2324169616 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb7f4066f60 0x7fb7f4069410 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.500+0000 7fb813fff700 1 --2- 172.21.15.81:0/2324169616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb814159b40 0x7fb81406d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.500+0000 7fb813fff700 1 -- 172.21.15.81:0/2324169616 >> 172.21.15.81:0/2324169616 conn(0x7fb8140cd660 msgr2=0x7fb8140cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:45.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.500+0000 7fb813fff700 1 -- 172.21.15.81:0/2324169616 shutdown_connections 2023-10-07T08:53:45.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.500+0000 7fb813fff700 1 -- 172.21.15.81:0/2324169616 wait complete. 2023-10-07T08:53:45.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:53:45.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.632+0000 7f5afcde3700 1 Processor -- start 2023-10-07T08:53:45.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.632+0000 7f5afcde3700 1 -- start start 2023-10-07T08:53:45.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.633+0000 7f5afcde3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5af81578d0 0x7f5af80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.633+0000 7f5afcde3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5af806d120 0x7f5af806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.633+0000 7f5afcde3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af80d07c0 con 0x7f5af8157ca0 2023-10-07T08:53:45.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.633+0000 7f5afcde3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af806da50 con 0x7f5af81578d0 2023-10-07T08:53:45.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.633+0000 7f5afcde3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af80cfbb0 con 0x7f5af806d120 2023-10-07T08:53:45.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.633+0000 7f5af659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5af81578d0 0x7f5af80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.633+0000 7f5af659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5af81578d0 0x7f5af80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52844/0 (socket says 172.21.15.81:52844) 2023-10-07T08:53:45.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.633+0000 7f5af659c700 1 -- 172.21.15.81:0/663273813 learned_addr learned my addr 172.21.15.81:0/663273813 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:45.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.633+0000 7f5af659c700 1 -- 172.21.15.81:0/663273813 >> v2:172.21.15.89:3300/0 conn(0x7f5af806d120 msgr2=0x7f5af806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:45.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.633+0000 7f5af6d9d700 1 --2- 172.21.15.81:0/663273813 >> v2:172.21.15.89:3300/0 conn(0x7f5af806d120 0x7f5af806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.634+0000 7f5af659c700 1 --2- 172.21.15.81:0/663273813 >> v2:172.21.15.89:3300/0 conn(0x7f5af806d120 0x7f5af806d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.634+0000 7f5af659c700 1 -- 172.21.15.81:0/663273813 >> v1:172.21.15.89:6789/0 conn(0x7f5af8157ca0 legacy=0x7f5af815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:45.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.634+0000 7f5af659c700 1 -- 172.21.15.81:0/663273813 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af80cfe90 con 0x7f5af81578d0 2023-10-07T08:53:45.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.634+0000 7f5af6d9d700 1 --2- 172.21.15.81:0/663273813 >> v2:172.21.15.89:3300/0 conn(0x7f5af806d120 0x7f5af806d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:45.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.634+0000 7f5af659c700 1 --2- 172.21.15.81:0/663273813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af81578d0 0x7f5af80cf4f0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f5af8068300 tx=0x7f5ae8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954d28f1a443ceff server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:45.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.634+0000 7f5af559a700 1 -- 172.21.15.81:0/663273813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae800e070 con 0x7f5af81578d0 2023-10-07T08:53:45.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.634+0000 7f5af559a700 1 -- 172.21.15.81:0/663273813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae800ba10 con 0x7f5af81578d0 2023-10-07T08:53:45.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.634+0000 7f5af559a700 1 -- 172.21.15.81:0/663273813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80092e0 con 0x7f5af81578d0 2023-10-07T08:53:45.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.634+0000 7f5afcde3700 1 -- 172.21.15.81:0/663273813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af81578d0 msgr2=0x7f5af80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:45.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.634+0000 7f5afcde3700 1 --2- 172.21.15.81:0/663273813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af81578d0 0x7f5af80cf4f0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f5af8068300 tx=0x7f5ae8009840 comp rx=0 tx=0).stop 2023-10-07T08:53:45.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.634+0000 7f5afcde3700 1 -- 172.21.15.81:0/663273813 shutdown_connections 2023-10-07T08:53:45.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.634+0000 7f5afcde3700 1 --2- 172.21.15.81:0/663273813 >> v2:172.21.15.89:3300/0 conn(0x7f5af806d120 0x7f5af806d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.634+0000 7f5afcde3700 1 --2- 172.21.15.81:0/663273813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af81578d0 0x7f5af80cf4f0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.634+0000 7f5afcde3700 1 -- 172.21.15.81:0/663273813 >> 172.21.15.81:0/663273813 conn(0x7f5af806bb90 msgr2=0x7f5af806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:45.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.634+0000 7f5afcde3700 1 -- 172.21.15.81:0/663273813 shutdown_connections 2023-10-07T08:53:45.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.634+0000 7f5afcde3700 1 -- 172.21.15.81:0/663273813 wait complete. 2023-10-07T08:53:45.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.635+0000 7f5afcde3700 1 Processor -- start 2023-10-07T08:53:45.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.635+0000 7f5afcde3700 1 -- start start 2023-10-07T08:53:45.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.636+0000 7f5afcde3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af806d120 0x7f5af80ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.636+0000 7f5afcde3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5af81578d0 0x7f5af80ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.636+0000 7f5afcde3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5af8157ca0 0x7f5af816a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.636+0000 7f5afcde3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80aa890 con 0x7f5af806d120 2023-10-07T08:53:45.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.636+0000 7f5afcde3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80aae50 con 0x7f5af8157ca0 2023-10-07T08:53:45.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.636+0000 7f5afcde3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af816af90 con 0x7f5af81578d0 2023-10-07T08:53:45.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.636+0000 7f5af659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af806d120 0x7f5af80ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.636+0000 7f5af659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af806d120 0x7f5af80ac4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52846/0 (socket says 172.21.15.81:52846) 2023-10-07T08:53:45.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.636+0000 7f5af659c700 1 -- 172.21.15.81:0/3429356813 learned_addr learned my addr 172.21.15.81:0/3429356813 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:45.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.636+0000 7f5af6d9d700 1 --2- 172.21.15.81:0/3429356813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5af8157ca0 0x7f5af816a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.636+0000 7f5af5d9b700 1 --2- 172.21.15.81:0/3429356813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5af81578d0 0x7f5af80ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.637+0000 7f5af659c700 1 -- 172.21.15.81:0/3429356813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5af81578d0 msgr2=0x7f5af80ab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:45.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.637+0000 7f5af659c700 1 --2- 172.21.15.81:0/3429356813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5af81578d0 0x7f5af80ab2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.637+0000 7f5af659c700 1 -- 172.21.15.81:0/3429356813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5af8157ca0 msgr2=0x7f5af816a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.637+0000 7f5af659c700 1 --2- 172.21.15.81:0/3429356813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5af8157ca0 0x7f5af816a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.637+0000 7f5af659c700 1 -- 172.21.15.81:0/3429356813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae8009ae0 con 0x7f5af806d120 2023-10-07T08:53:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.637+0000 7f5af659c700 1 --2- 172.21.15.81:0/3429356813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af806d120 0x7f5af80ac4b0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f5af806fe20 tx=0x7f5ae8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.637+0000 7f5ae67fc700 1 -- 172.21.15.81:0/3429356813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80129a0 con 0x7f5af806d120 2023-10-07T08:53:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.637+0000 7f5ae67fc700 1 -- 172.21.15.81:0/3429356813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae8012b20 con 0x7f5af806d120 2023-10-07T08:53:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.637+0000 7f5afcde3700 1 -- 172.21.15.81:0/3429356813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af816b270 con 0x7f5af806d120 2023-10-07T08:53:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.637+0000 7f5ae67fc700 1 -- 172.21.15.81:0/3429356813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae801d420 con 0x7f5af806d120 2023-10-07T08:53:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.637+0000 7f5afcde3700 1 -- 172.21.15.81:0/3429356813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af8153d10 con 0x7f5af806d120 2023-10-07T08:53:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.638+0000 7f5afcde3700 1 -- 172.21.15.81:0/3429356813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af80ab130 con 0x7f5af806d120 2023-10-07T08:53:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.638+0000 7f5ae67fc700 1 -- 172.21.15.81:0/3429356813 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ae801d850 con 0x7f5af806d120 2023-10-07T08:53:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.639+0000 7f5ae67fc700 1 --2- 172.21.15.81:0/3429356813 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ad8066f30 0x7f5ad80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.639+0000 7f5af5d9b700 1 --2- 172.21.15.81:0/3429356813 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ad8066f30 0x7f5ad80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.639+0000 7f5ae67fc700 1 -- 172.21.15.81:0/3429356813 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5ae8085820 con 0x7f5af806d120 2023-10-07T08:53:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.639+0000 7f5af5d9b700 1 --2- 172.21.15.81:0/3429356813 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ad8066f30 0x7f5ad80693e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5af80688f0 tx=0x7f5aec009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.643+0000 7f5ae67fc700 1 -- 172.21.15.81:0/3429356813 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ae8052de0 con 0x7f5af806d120 2023-10-07T08:53:45.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.826+0000 7f5afcde3700 1 -- 172.21.15.81:0/3429356813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5af80d0170 con 0x7f5af806d120 2023-10-07T08:53:45.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.827+0000 7f5ae67fc700 1 -- 172.21.15.81:0/3429356813 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+12097 (secure 0 0 0) 0x7f5ae8056400 con 0x7f5af806d120 2023-10-07T08:53:45.828 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:45.828 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":186,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:53:45.098734+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:53:45.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.829+0000 7f5afcde3700 1 -- 172.21.15.81:0/3429356813 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ad8066f30 msgr2=0x7f5ad80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:45.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.829+0000 7f5afcde3700 1 --2- 172.21.15.81:0/3429356813 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ad8066f30 0x7f5ad80693e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5af80688f0 tx=0x7f5aec009060 comp rx=0 tx=0).stop 2023-10-07T08:53:45.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.829+0000 7f5afcde3700 1 -- 172.21.15.81:0/3429356813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af806d120 msgr2=0x7f5af80ac4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:45.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.829+0000 7f5afcde3700 1 --2- 172.21.15.81:0/3429356813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af806d120 0x7f5af80ac4b0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f5af806fe20 tx=0x7f5ae8017000 comp rx=0 tx=0).stop 2023-10-07T08:53:45.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.829+0000 7f5afcde3700 1 -- 172.21.15.81:0/3429356813 shutdown_connections 2023-10-07T08:53:45.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.829+0000 7f5afcde3700 1 --2- 172.21.15.81:0/3429356813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5af8157ca0 0x7f5af816a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.829+0000 7f5afcde3700 1 --2- 172.21.15.81:0/3429356813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af806d120 0x7f5af80ac4b0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.829+0000 7f5afcde3700 1 --2- 172.21.15.81:0/3429356813 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5ad8066f30 0x7f5ad80693e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.829+0000 7f5afcde3700 1 --2- 172.21.15.81:0/3429356813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5af81578d0 0x7f5af80ab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.829+0000 7f5afcde3700 1 -- 172.21.15.81:0/3429356813 >> 172.21.15.81:0/3429356813 conn(0x7f5af806bb90 msgr2=0x7f5af8154890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:45.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.829+0000 7f5afcde3700 1 -- 172.21.15.81:0/3429356813 shutdown_connections 2023-10-07T08:53:45.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.829+0000 7f5afcde3700 1 -- 172.21.15.81:0/3429356813 wait complete. 2023-10-07T08:53:45.843 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-07T08:53:45.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:53:45.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.959+0000 7f16ab59e700 1 Processor -- start 2023-10-07T08:53:45.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.959+0000 7f16ab59e700 1 -- start start 2023-10-07T08:53:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.960+0000 7f16ab59e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f16ac0d0b80 0x7f16ac0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.960+0000 7f16ab59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f16ac06d700 0x7f16ac15b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.960+0000 7f16ab59e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ac0cf2d0 con 0x7f16ac0d02b0 2023-10-07T08:53:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.960+0000 7f16ab59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ac15a690 con 0x7f16ac06d700 2023-10-07T08:53:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.960+0000 7f16ab59e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ac06dc00 con 0x7f16ac0d0b80 2023-10-07T08:53:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.960+0000 7f16aad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f16ac06d700 0x7f16ac15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.960+0000 7f16aad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f16ac06d700 0x7f16ac15b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52852/0 (socket says 172.21.15.81:52852) 2023-10-07T08:53:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.960+0000 7f16aad9d700 1 -- 172.21.15.81:0/2356090327 learned_addr learned my addr 172.21.15.81:0/2356090327 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.960+0000 7f16aad9d700 1 -- 172.21.15.81:0/2356090327 >> v2:172.21.15.89:3300/0 conn(0x7f16ac0d0b80 msgr2=0x7f16ac0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.960+0000 7f16aad9d700 1 --2- 172.21.15.81:0/2356090327 >> v2:172.21.15.89:3300/0 conn(0x7f16ac0d0b80 0x7f16ac0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.960+0000 7f16aad9d700 1 -- 172.21.15.81:0/2356090327 >> v1:172.21.15.89:6789/0 conn(0x7f16ac0d02b0 legacy=0x7f16ac06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:45.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.960+0000 7f16aad9d700 1 -- 172.21.15.81:0/2356090327 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac0cf570 con 0x7f16ac06d700 2023-10-07T08:53:45.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.960+0000 7f16aad9d700 1 --2- 172.21.15.81:0/2356090327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac06d700 0x7f16ac15b320 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f169c0099b0 tx=0x7f169c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b00f521abec20c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:45.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.960+0000 7f16a959a700 1 -- 172.21.15.81:0/2356090327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c00b7e0 con 0x7f16ac06d700 2023-10-07T08:53:45.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.960+0000 7f16a959a700 1 -- 172.21.15.81:0/2356090327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c00b940 con 0x7f16ac06d700 2023-10-07T08:53:45.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.961+0000 7f16a959a700 1 -- 172.21.15.81:0/2356090327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c00bce0 con 0x7f16ac06d700 2023-10-07T08:53:45.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.961+0000 7f16ab59e700 1 -- 172.21.15.81:0/2356090327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac06d700 msgr2=0x7f16ac15b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:45.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.961+0000 7f16ab59e700 1 --2- 172.21.15.81:0/2356090327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac06d700 0x7f16ac15b320 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f169c0099b0 tx=0x7f169c009250 comp rx=0 tx=0).stop 2023-10-07T08:53:45.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.961+0000 7f16ab59e700 1 -- 172.21.15.81:0/2356090327 shutdown_connections 2023-10-07T08:53:45.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.961+0000 7f16ab59e700 1 --2- 172.21.15.81:0/2356090327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac06d700 0x7f16ac15b320 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.961+0000 7f16ab59e700 1 --2- 172.21.15.81:0/2356090327 >> v2:172.21.15.89:3300/0 conn(0x7f16ac0d0b80 0x7f16ac0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.961+0000 7f16ab59e700 1 -- 172.21.15.81:0/2356090327 >> 172.21.15.81:0/2356090327 conn(0x7f16ac063230 msgr2=0x7f16ac063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:45.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.961+0000 7f16ab59e700 1 -- 172.21.15.81:0/2356090327 shutdown_connections 2023-10-07T08:53:45.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.961+0000 7f16ab59e700 1 -- 172.21.15.81:0/2356090327 wait complete. 2023-10-07T08:53:45.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.962+0000 7f16ab59e700 1 Processor -- start 2023-10-07T08:53:45.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.962+0000 7f16ab59e700 1 -- start start 2023-10-07T08:53:45.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.963+0000 7f16ab59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16ac06d700 0x7f16ac1576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.963+0000 7f16ab59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac0d02b0 0x7f16ac0b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.963+0000 7f16ab59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16ac0d0b80 0x7f16ac155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.963+0000 7f16ab59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac151cd0 con 0x7f16ac0d02b0 2023-10-07T08:53:45.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.963+0000 7f16ab59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac156650 con 0x7f16ac0d0b80 2023-10-07T08:53:45.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.963+0000 7f16ab59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac156930 con 0x7f16ac06d700 2023-10-07T08:53:45.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.963+0000 7f16a9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac0d02b0 0x7f16ac0b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.963+0000 7f16a9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac0d02b0 0x7f16ac0b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52868/0 (socket says 172.21.15.81:52868) 2023-10-07T08:53:45.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.963+0000 7f16a9d9b700 1 -- 172.21.15.81:0/1167780014 learned_addr learned my addr 172.21.15.81:0/1167780014 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:45.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.963+0000 7f16aa59c700 1 --2- 172.21.15.81:0/1167780014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16ac06d700 0x7f16ac1576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.963+0000 7f16aad9d700 1 --2- 172.21.15.81:0/1167780014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16ac0d0b80 0x7f16ac155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.963+0000 7f16a9d9b700 1 -- 172.21.15.81:0/1167780014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16ac06d700 msgr2=0x7f16ac1576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:45.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.963+0000 7f16a9d9b700 1 --2- 172.21.15.81:0/1167780014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16ac06d700 0x7f16ac1576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.963+0000 7f16a9d9b700 1 -- 172.21.15.81:0/1167780014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16ac0d0b80 msgr2=0x7f16ac155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:45.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.963+0000 7f16a9d9b700 1 --2- 172.21.15.81:0/1167780014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16ac0d0b80 0x7f16ac155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:45.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.963+0000 7f16a9d9b700 1 -- 172.21.15.81:0/1167780014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c0094f0 con 0x7f16ac0d02b0 2023-10-07T08:53:45.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.964+0000 7f16a9d9b700 1 --2- 172.21.15.81:0/1167780014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac0d02b0 0x7f16ac0b4aa0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f16a000bbb0 tx=0x7f16a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:45.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.964+0000 7f169a7fc700 1 -- 172.21.15.81:0/1167780014 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a000c630 con 0x7f16ac0d02b0 2023-10-07T08:53:45.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.964+0000 7f169a7fc700 1 -- 172.21.15.81:0/1167780014 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a000c7b0 con 0x7f16ac0d02b0 2023-10-07T08:53:45.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.964+0000 7f16ab59e700 1 -- 172.21.15.81:0/1167780014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ac156c10 con 0x7f16ac0d02b0 2023-10-07T08:53:45.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.964+0000 7f169a7fc700 1 -- 172.21.15.81:0/1167780014 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a000cb70 con 0x7f16ac0d02b0 2023-10-07T08:53:45.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.964+0000 7f16ab59e700 1 -- 172.21.15.81:0/1167780014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ac1571d0 con 0x7f16ac0d02b0 2023-10-07T08:53:45.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.965+0000 7f16ab59e700 1 -- 172.21.15.81:0/1167780014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ac157c30 con 0x7f16ac0d02b0 2023-10-07T08:53:45.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.965+0000 7f169a7fc700 1 -- 172.21.15.81:0/1167780014 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16a0012070 con 0x7f16ac0d02b0 2023-10-07T08:53:45.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.965+0000 7f169a7fc700 1 --2- 172.21.15.81:0/1167780014 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f168c066f30 0x7f168c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:45.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.966+0000 7f169a7fc700 1 -- 172.21.15.81:0/1167780014 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f16a0083ec0 con 0x7f16ac0d02b0 2023-10-07T08:53:45.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.966+0000 7f16aa59c700 1 --2- 172.21.15.81:0/1167780014 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f168c066f30 0x7f168c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:45.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.966+0000 7f16aa59c700 1 --2- 172.21.15.81:0/1167780014 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f168c066f30 0x7f168c0693e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009b40 tx=0x7f16a40090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:45.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:45.970+0000 7f169a7fc700 1 -- 172.21.15.81:0/1167780014 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16a0051490 con 0x7f16ac0d02b0 2023-10-07T08:53:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.153+0000 7f16ab59e700 1 -- 172.21.15.81:0/1167780014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16ac1573c0 con 0x7f16ac0d02b0 2023-10-07T08:53:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.153+0000 7f169a7fc700 1 -- 172.21.15.81:0/1167780014 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v186) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16a0054ab0 con 0x7f16ac0d02b0 2023-10-07T08:53:46.155 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:53:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.155+0000 7f16ab59e700 1 -- 172.21.15.81:0/1167780014 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f168c066f30 msgr2=0x7f168c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.155+0000 7f16ab59e700 1 --2- 172.21.15.81:0/1167780014 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f168c066f30 0x7f168c0693e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009b40 tx=0x7f16a40090f0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.155+0000 7f16ab59e700 1 -- 172.21.15.81:0/1167780014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac0d02b0 msgr2=0x7f16ac0b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.155+0000 7f16ab59e700 1 --2- 172.21.15.81:0/1167780014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac0d02b0 0x7f16ac0b4aa0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f16a000bbb0 tx=0x7f16a0009840 comp rx=0 tx=0).stop 2023-10-07T08:53:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.155+0000 7f16ab59e700 1 -- 172.21.15.81:0/1167780014 shutdown_connections 2023-10-07T08:53:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.155+0000 7f16ab59e700 1 --2- 172.21.15.81:0/1167780014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16ac0d0b80 0x7f16ac155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.155+0000 7f16ab59e700 1 --2- 172.21.15.81:0/1167780014 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f168c066f30 0x7f168c0693e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.155+0000 7f16ab59e700 1 --2- 172.21.15.81:0/1167780014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16ac06d700 0x7f16ac1576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.155+0000 7f16ab59e700 1 --2- 172.21.15.81:0/1167780014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac0d02b0 0x7f16ac0b4aa0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.155+0000 7f16ab59e700 1 -- 172.21.15.81:0/1167780014 >> 172.21.15.81:0/1167780014 conn(0x7f16ac063230 msgr2=0x7f16ac14e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.155+0000 7f16ab59e700 1 -- 172.21.15.81:0/1167780014 shutdown_connections 2023-10-07T08:53:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.155+0000 7f16ab59e700 1 -- 172.21.15.81:0/1167780014 wait complete. 2023-10-07T08:53:46.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-07T08:53:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.281+0000 7f68c5915700 1 Processor -- start 2023-10-07T08:53:46.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.281+0000 7f68c5915700 1 -- start start 2023-10-07T08:53:46.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.282+0000 7f68c5915700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f68c0159b40 0x7f68c00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:46.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.282+0000 7f68c5915700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0068e90 0x7f68c00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:46.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.282+0000 7f68c5915700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c00cee10 con 0x7f68c0159f10 2023-10-07T08:53:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.282+0000 7f68c5915700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c00cd040 con 0x7f68c0159b40 2023-10-07T08:53:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.282+0000 7f68c5915700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00cd320 con 0x7f68c0068e90 2023-10-07T08:53:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.282+0000 7f68b7fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f68c0159f10 0x7f68c0068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42026/0 (socket says 172.21.15.81:42026) 2023-10-07T08:53:46.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.282+0000 7f68b7fff700 1 -- 172.21.15.81:0/1346462204 learned_addr learned my addr 172.21.15.81:0/1346462204 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:46.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.282+0000 7f68c5114700 1 --2- 172.21.15.81:0/1346462204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0068e90 0x7f68c00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:46.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.282+0000 7f68c4913700 1 --2- 172.21.15.81:0/1346462204 >> v2:172.21.15.89:3300/0 conn(0x7f68c0159b40 0x7f68c00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:46.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.282+0000 7f68b77fe700 1 -- 172.21.15.81:0/1346462204 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706449450 0 0) 0x7f68c00cee10 con 0x7f68c0159f10 2023-10-07T08:53:46.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.282+0000 7f68b77fe700 1 -- 172.21.15.81:0/1346462204 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a8003570 con 0x7f68c0159f10 2023-10-07T08:53:46.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.283+0000 7f68c4913700 1 -- 172.21.15.81:0/1346462204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0068e90 msgr2=0x7f68c00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:46.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.283+0000 7f68c4913700 1 --2- 172.21.15.81:0/1346462204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0068e90 0x7f68c00cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.283+0000 7f68c4913700 1 -- 172.21.15.81:0/1346462204 >> v1:172.21.15.81:6789/0 conn(0x7f68c0159f10 legacy=0x7f68c0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:46.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.283+0000 7f68b77fe700 1 -- 172.21.15.81:0/1346462204 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3508745342 0 0) 0x7f68a8003570 con 0x7f68c0159f10 2023-10-07T08:53:46.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.283+0000 7f68c4913700 1 -- 172.21.15.81:0/1346462204 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00ce7c0 con 0x7f68c0159b40 2023-10-07T08:53:46.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.283+0000 7f68c5114700 1 --2- 172.21.15.81:0/1346462204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0068e90 0x7f68c00cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:53:46.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.283+0000 7f68c4913700 1 --2- 172.21.15.81:0/1346462204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68c0159b40 0x7f68c00cc600 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009e60 tx=0x7f68bc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76623c257d2e5504 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:46.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.283+0000 7f68b77fe700 1 -- 172.21.15.81:0/1346462204 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00e070 con 0x7f68c0159b40 2023-10-07T08:53:46.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.283+0000 7f68b77fe700 1 -- 172.21.15.81:0/1346462204 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68bc00b7a0 con 0x7f68c0159b40 2023-10-07T08:53:46.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.283+0000 7f68b77fe700 1 -- 172.21.15.81:0/1346462204 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0001470 con 0x7f68c0159b40 2023-10-07T08:53:46.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.284+0000 7f68c5915700 1 -- 172.21.15.81:0/1346462204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68c0159b40 msgr2=0x7f68c00cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:46.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.284+0000 7f68c5915700 1 --2- 172.21.15.81:0/1346462204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68c0159b40 0x7f68c00cc600 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009e60 tx=0x7f68bc009780 comp rx=0 tx=0).stop 2023-10-07T08:53:46.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.284+0000 7f68c5915700 1 -- 172.21.15.81:0/1346462204 shutdown_connections 2023-10-07T08:53:46.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.284+0000 7f68c5915700 1 --2- 172.21.15.81:0/1346462204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68c0159b40 0x7f68c00cc600 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.284+0000 7f68c5915700 1 --2- 172.21.15.81:0/1346462204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0068e90 0x7f68c00cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.284+0000 7f68c5915700 1 -- 172.21.15.81:0/1346462204 >> 172.21.15.81:0/1346462204 conn(0x7f68c00cd660 msgr2=0x7f68c00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:46.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.284+0000 7f68c5915700 1 -- 172.21.15.81:0/1346462204 shutdown_connections 2023-10-07T08:53:46.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.284+0000 7f68c5915700 1 -- 172.21.15.81:0/1346462204 wait complete. 2023-10-07T08:53:46.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.285+0000 7f68c5915700 1 Processor -- start 2023-10-07T08:53:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.285+0000 7f68c5915700 1 -- start start 2023-10-07T08:53:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.285+0000 7f68c5915700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0068e90 0x7f68c016ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c5915700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68c0159b40 0x7f68c016d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c5915700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c0159f10 0x7f68c00c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c5915700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c016a2a0 con 0x7f68c0159f10 2023-10-07T08:53:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c5915700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0158fe0 con 0x7f68c0159b40 2023-10-07T08:53:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c5915700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c016e810 con 0x7f68c0068e90 2023-10-07T08:53:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c5114700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c0159f10 0x7f68c00c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c5114700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c0159f10 0x7f68c00c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52884/0 (socket says 172.21.15.81:52884) 2023-10-07T08:53:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c5114700 1 -- 172.21.15.81:0/3600055897 learned_addr learned my addr 172.21.15.81:0/3600055897 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c4913700 1 --2- 172.21.15.81:0/3600055897 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0068e90 0x7f68c016ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68b7fff700 1 --2- 172.21.15.81:0/3600055897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68c0159b40 0x7f68c016d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c5114700 1 -- 172.21.15.81:0/3600055897 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0068e90 msgr2=0x7f68c016ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c5114700 1 --2- 172.21.15.81:0/3600055897 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0068e90 0x7f68c016ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c5114700 1 -- 172.21.15.81:0/3600055897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68c0159b40 msgr2=0x7f68c016d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c5114700 1 --2- 172.21.15.81:0/3600055897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68c0159b40 0x7f68c016d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c5114700 1 -- 172.21.15.81:0/3600055897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b8009420 con 0x7f68c0159f10 2023-10-07T08:53:46.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c5114700 1 --2- 172.21.15.81:0/3600055897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c0159f10 0x7f68c00c8f50 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f68b800ea70 tx=0x7f68b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:46.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68b4ff9700 1 -- 172.21.15.81:0/3600055897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b800eeb0 con 0x7f68c0159f10 2023-10-07T08:53:46.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68b4ff9700 1 -- 172.21.15.81:0/3600055897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b800c850 con 0x7f68c0159f10 2023-10-07T08:53:46.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c5915700 1 -- 172.21.15.81:0/3600055897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68bc009a20 con 0x7f68c0159f10 2023-10-07T08:53:46.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68b4ff9700 1 -- 172.21.15.81:0/3600055897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b800cc30 con 0x7f68c0159f10 2023-10-07T08:53:46.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.286+0000 7f68c5915700 1 -- 172.21.15.81:0/3600055897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c016a480 con 0x7f68c0159f10 2023-10-07T08:53:46.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.287+0000 7f68c5915700 1 -- 172.21.15.81:0/3600055897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c00cb890 con 0x7f68c0159f10 2023-10-07T08:53:46.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.288+0000 7f68b4ff9700 1 -- 172.21.15.81:0/3600055897 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68b8013470 con 0x7f68c0159f10 2023-10-07T08:53:46.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.288+0000 7f68b4ff9700 1 --2- 172.21.15.81:0/3600055897 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f68ac066f30 0x7f68ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:46.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.288+0000 7f68b4ff9700 1 -- 172.21.15.81:0/3600055897 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f68b8084410 con 0x7f68c0159f10 2023-10-07T08:53:46.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.288+0000 7f68c4913700 1 --2- 172.21.15.81:0/3600055897 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f68ac066f30 0x7f68ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:46.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.288+0000 7f68c4913700 1 --2- 172.21.15.81:0/3600055897 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f68ac066f30 0x7f68ac0693e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0097c0 tx=0x7f68bc018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:46.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.292+0000 7f68b4ff9700 1 -- 172.21.15.81:0/3600055897 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68b80519d0 con 0x7f68c0159f10 2023-10-07T08:53:46.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.474+0000 7f68c5915700 1 -- 172.21.15.81:0/3600055897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f68c00ceaa0 con 0x7f68c0159f10 2023-10-07T08:53:46.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.475+0000 7f68b4ff9700 1 -- 172.21.15.81:0/3600055897 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v186) v1 ==== 84+0+65 (secure 0 0 0) 0x7f68b8054ff0 con 0x7f68c0159f10 2023-10-07T08:53:46.476 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:46.476 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-07T08:53:46.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:46.477 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-07T08:53:46.477 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-07T08:53:46.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:46.477 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-07T08:53:46.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.477+0000 7f68c5915700 1 -- 172.21.15.81:0/3600055897 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f68ac066f30 msgr2=0x7f68ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:46.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.477+0000 7f68c5915700 1 --2- 172.21.15.81:0/3600055897 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f68ac066f30 0x7f68ac0693e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0097c0 tx=0x7f68bc018000 comp rx=0 tx=0).stop 2023-10-07T08:53:46.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.477+0000 7f68c5915700 1 -- 172.21.15.81:0/3600055897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c0159f10 msgr2=0x7f68c00c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:46.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.477+0000 7f68c5915700 1 --2- 172.21.15.81:0/3600055897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c0159f10 0x7f68c00c8f50 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f68b800ea70 tx=0x7f68b80091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.477+0000 7f68c5915700 1 -- 172.21.15.81:0/3600055897 shutdown_connections 2023-10-07T08:53:46.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.477+0000 7f68c5915700 1 --2- 172.21.15.81:0/3600055897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c0159f10 0x7f68c00c8f50 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.477+0000 7f68c5915700 1 --2- 172.21.15.81:0/3600055897 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f68ac066f30 0x7f68ac0693e0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.477+0000 7f68c5915700 1 --2- 172.21.15.81:0/3600055897 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68c0068e90 0x7f68c016ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.477+0000 7f68c5915700 1 --2- 172.21.15.81:0/3600055897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68c0159b40 0x7f68c016d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.477+0000 7f68c5915700 1 -- 172.21.15.81:0/3600055897 >> 172.21.15.81:0/3600055897 conn(0x7f68c00cd660 msgr2=0x7f68c006db30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:46.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.477+0000 7f68c5915700 1 -- 172.21.15.81:0/3600055897 shutdown_connections 2023-10-07T08:53:46.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.477+0000 7f68c5915700 1 -- 172.21.15.81:0/3600055897 wait complete. 2023-10-07T08:53:46.490 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-07T08:53:46.490 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-07T08:53:46.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.607+0000 7fb7f759e700 1 Processor -- start 2023-10-07T08:53:46.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.607+0000 7fb7f759e700 1 -- start start 2023-10-07T08:53:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.608+0000 7fb7f759e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7f8159cb0 0x7fb7f80ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.608+0000 7fb7f759e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb7f806e4e0 0x7fb7f80ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.608+0000 7fb7f759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7f815a080 0x7fb7f80ab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.608+0000 7fb7f759e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f80aaf40 con 0x7fb7f815a080 2023-10-07T08:53:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.608+0000 7fb7f759e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f806c570 con 0x7fb7f806e4e0 2023-10-07T08:53:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.608+0000 7fb7f759e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80aa930 con 0x7fb7f8159cb0 2023-10-07T08:53:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.608+0000 7fb7f6d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7f815a080 0x7fb7f80ab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.608+0000 7fb7f6d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7f815a080 0x7fb7f80ab3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52894/0 (socket says 172.21.15.81:52894) 2023-10-07T08:53:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.608+0000 7fb7f6d9d700 1 -- 172.21.15.81:0/1145001895 learned_addr learned my addr 172.21.15.81:0/1145001895 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.608+0000 7fb7f5d9b700 1 --2- 172.21.15.81:0/1145001895 >> v2:172.21.15.89:3300/0 conn(0x7fb7f806e4e0 0x7fb7f80ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.608+0000 7fb7f659c700 1 --2- 172.21.15.81:0/1145001895 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7f8159cb0 0x7fb7f80ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.609+0000 7fb7f6d9d700 1 -- 172.21.15.81:0/1145001895 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7f8159cb0 msgr2=0x7fb7f80ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.609+0000 7fb7f6d9d700 1 --2- 172.21.15.81:0/1145001895 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7f8159cb0 0x7fb7f80ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.609+0000 7fb7f6d9d700 1 -- 172.21.15.81:0/1145001895 >> v2:172.21.15.89:3300/0 conn(0x7fb7f806e4e0 msgr2=0x7fb7f80ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.609+0000 7fb7f6d9d700 1 --2- 172.21.15.81:0/1145001895 >> v2:172.21.15.89:3300/0 conn(0x7fb7f806e4e0 0x7fb7f80ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.609+0000 7fb7f6d9d700 1 -- 172.21.15.81:0/1145001895 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f806e970 con 0x7fb7f815a080 2023-10-07T08:53:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.609+0000 7fb7f5d9b700 1 --2- 172.21.15.81:0/1145001895 >> v2:172.21.15.89:3300/0 conn(0x7fb7f806e4e0 0x7fb7f80ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:53:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.609+0000 7fb7f6d9d700 1 --2- 172.21.15.81:0/1145001895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f815a080 0x7fb7f80ab3d0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8077c90 tx=0x7fb7f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996ffc3d2874cb36 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.609+0000 7fb7f559a700 1 -- 172.21.15.81:0/1145001895 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f000e070 con 0x7fb7f815a080 2023-10-07T08:53:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.609+0000 7fb7f559a700 1 -- 172.21.15.81:0/1145001895 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f000b970 con 0x7fb7f815a080 2023-10-07T08:53:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.609+0000 7fb7f559a700 1 -- 172.21.15.81:0/1145001895 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f00092e0 con 0x7fb7f815a080 2023-10-07T08:53:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.609+0000 7fb7f759e700 1 -- 172.21.15.81:0/1145001895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f815a080 msgr2=0x7fb7f80ab3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:46.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.609+0000 7fb7f759e700 1 --2- 172.21.15.81:0/1145001895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f815a080 0x7fb7f80ab3d0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8077c90 tx=0x7fb7f0009840 comp rx=0 tx=0).stop 2023-10-07T08:53:46.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.610+0000 7fb7f759e700 1 -- 172.21.15.81:0/1145001895 shutdown_connections 2023-10-07T08:53:46.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.610+0000 7fb7f759e700 1 --2- 172.21.15.81:0/1145001895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f815a080 0x7fb7f80ab3d0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.610+0000 7fb7f759e700 1 --2- 172.21.15.81:0/1145001895 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7f8159cb0 0x7fb7f80ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.610+0000 7fb7f759e700 1 --2- 172.21.15.81:0/1145001895 >> v2:172.21.15.89:3300/0 conn(0x7fb7f806e4e0 0x7fb7f80ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.610+0000 7fb7f759e700 1 -- 172.21.15.81:0/1145001895 >> 172.21.15.81:0/1145001895 conn(0x7fb7f8068110 msgr2=0x7fb7f806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:46.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.610+0000 7fb7f759e700 1 -- 172.21.15.81:0/1145001895 shutdown_connections 2023-10-07T08:53:46.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.610+0000 7fb7f759e700 1 -- 172.21.15.81:0/1145001895 wait complete. 2023-10-07T08:53:46.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.611+0000 7fb7f759e700 1 Processor -- start 2023-10-07T08:53:46.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.611+0000 7fb7f759e700 1 -- start start 2023-10-07T08:53:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.611+0000 7fb7f759e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7f806e4e0 0x7fb7f80c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.611+0000 7fb7f759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f8159cb0 0x7fb7f80b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.611+0000 7fb7f759e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7f815a080 0x7fb7f80b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.611+0000 7fb7f759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80c9000 con 0x7fb7f8159cb0 2023-10-07T08:53:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.611+0000 7fb7f759e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80c6fd0 con 0x7fb7f806e4e0 2023-10-07T08:53:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.611+0000 7fb7f759e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80b25f0 con 0x7fb7f815a080 2023-10-07T08:53:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.612+0000 7fb7f5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f8159cb0 0x7fb7f80b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.612+0000 7fb7f5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f8159cb0 0x7fb7f80b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52910/0 (socket says 172.21.15.81:52910) 2023-10-07T08:53:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.612+0000 7fb7f5d9b700 1 -- 172.21.15.81:0/2688148468 learned_addr learned my addr 172.21.15.81:0/2688148468 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.612+0000 7fb7f659c700 1 --2- 172.21.15.81:0/2688148468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7f806e4e0 0x7fb7f80c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.612+0000 7fb7f5d9b700 1 -- 172.21.15.81:0/2688148468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7f815a080 msgr2=0x7fb7f80b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.612+0000 7fb7f5d9b700 1 --2- 172.21.15.81:0/2688148468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7f815a080 0x7fb7f80b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.612+0000 7fb7f5d9b700 1 -- 172.21.15.81:0/2688148468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7f806e4e0 msgr2=0x7fb7f80c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.612+0000 7fb7f5d9b700 1 --2- 172.21.15.81:0/2688148468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7f806e4e0 0x7fb7f80c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.612+0000 7fb7f5d9b700 1 -- 172.21.15.81:0/2688148468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec009420 con 0x7fb7f8159cb0 2023-10-07T08:53:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.612+0000 7fb7f5d9b700 1 --2- 172.21.15.81:0/2688148468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f8159cb0 0x7fb7f80b1b70 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00ec80 tx=0x7fb7ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.612+0000 7fb7e67fc700 1 -- 172.21.15.81:0/2688148468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00c9d0 con 0x7fb7f8159cb0 2023-10-07T08:53:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.612+0000 7fb7e67fc700 1 -- 172.21.15.81:0/2688148468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec00cb30 con 0x7fb7f8159cb0 2023-10-07T08:53:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.612+0000 7fb7f759e700 1 -- 172.21.15.81:0/2688148468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f0009ae0 con 0x7fb7f8159cb0 2023-10-07T08:53:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.612+0000 7fb7e67fc700 1 -- 172.21.15.81:0/2688148468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00ceb0 con 0x7fb7f8159cb0 2023-10-07T08:53:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.612+0000 7fb7f759e700 1 -- 172.21.15.81:0/2688148468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f80c9860 con 0x7fb7f8159cb0 2023-10-07T08:53:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.613+0000 7fb7f759e700 1 -- 172.21.15.81:0/2688148468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f80c7140 con 0x7fb7f8159cb0 2023-10-07T08:53:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.614+0000 7fb7e67fc700 1 -- 172.21.15.81:0/2688148468 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7ec013680 con 0x7fb7f8159cb0 2023-10-07T08:53:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.614+0000 7fb7e67fc700 1 --2- 172.21.15.81:0/2688148468 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb7d8066f30 0x7fb7d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.614+0000 7fb7e67fc700 1 -- 172.21.15.81:0/2688148468 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb7ec084600 con 0x7fb7f8159cb0 2023-10-07T08:53:46.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.614+0000 7fb7f659c700 1 --2- 172.21.15.81:0/2688148468 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb7d8066f30 0x7fb7d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:46.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.614+0000 7fb7f659c700 1 --2- 172.21.15.81:0/2688148468 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb7d8066f30 0x7fb7d80693e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80093f0 tx=0x7fb7e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:46.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.618+0000 7fb7e67fc700 1 -- 172.21.15.81:0/2688148468 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7ec051bc0 con 0x7fb7f8159cb0 2023-10-07T08:53:46.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:46.800+0000 7fb7f759e700 1 -- 172.21.15.81:0/2688148468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb7f80aabd0 con 0x7fb7f8159cb0 2023-10-07T08:53:47.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.109+0000 7fb7e67fc700 1 -- 172.21.15.81:0/2688148468 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v187) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb7ec0551e0 con 0x7fb7f8159cb0 2023-10-07T08:53:47.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.112+0000 7fb7f759e700 1 -- 172.21.15.81:0/2688148468 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb7d8066f30 msgr2=0x7fb7d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:47.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.112+0000 7fb7f759e700 1 --2- 172.21.15.81:0/2688148468 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb7d8066f30 0x7fb7d80693e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80093f0 tx=0x7fb7e8008040 comp rx=0 tx=0).stop 2023-10-07T08:53:47.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.112+0000 7fb7f759e700 1 -- 172.21.15.81:0/2688148468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f8159cb0 msgr2=0x7fb7f80b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:47.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.112+0000 7fb7f759e700 1 --2- 172.21.15.81:0/2688148468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f8159cb0 0x7fb7f80b1b70 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00ec80 tx=0x7fb7ec0091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:47.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.113+0000 7fb7f759e700 1 -- 172.21.15.81:0/2688148468 shutdown_connections 2023-10-07T08:53:47.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.113+0000 7fb7f759e700 1 --2- 172.21.15.81:0/2688148468 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb7d8066f30 0x7fb7d80693e0 secure :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80093f0 tx=0x7fb7e8008040 comp rx=0 tx=0).stop 2023-10-07T08:53:47.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.113+0000 7fb7f759e700 1 --2- 172.21.15.81:0/2688148468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb7f815a080 0x7fb7f80b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:47.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.113+0000 7fb7f759e700 1 --2- 172.21.15.81:0/2688148468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7f806e4e0 0x7fb7f80c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:47.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.113+0000 7fb7f759e700 1 --2- 172.21.15.81:0/2688148468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f8159cb0 0x7fb7f80b1b70 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:47.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.113+0000 7fb7f759e700 1 -- 172.21.15.81:0/2688148468 >> 172.21.15.81:0/2688148468 conn(0x7fb7f8068110 msgr2=0x7fb7f81565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:47.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.113+0000 7fb7f759e700 1 -- 172.21.15.81:0/2688148468 shutdown_connections 2023-10-07T08:53:47.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.113+0000 7fb7f759e700 1 -- 172.21.15.81:0/2688148468 wait complete. 2023-10-07T08:53:47.115 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-07T08:53:47.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-07T08:53:47.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.249+0000 7f8adffff700 1 Processor -- start 2023-10-07T08:53:47.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.249+0000 7f8adffff700 1 -- start start 2023-10-07T08:53:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.250+0000 7f8adffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ae00b1ef0 0x7f8ae006da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.250+0000 7f8adffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae0068d40 con 0x7f8ae006f4f0 2023-10-07T08:53:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.250+0000 7f8adffff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae006a1e0 con 0x7f8ae00b29d0 2023-10-07T08:53:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.250+0000 7f8adffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae015a520 con 0x7f8ae00b1ef0 2023-10-07T08:53:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.250+0000 7f8adeffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ae00b1ef0 0x7f8ae006da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.250+0000 7f8adeffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ae00b1ef0 0x7f8ae006da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52924/0 (socket says 172.21.15.81:52924) 2023-10-07T08:53:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.250+0000 7f8ade7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8ae006f4f0 0x7f8ae00b22c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42038/0 (socket says 172.21.15.81:42038) 2023-10-07T08:53:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.250+0000 7f8adeffd700 1 -- 172.21.15.81:0/2045314505 learned_addr learned my addr 172.21.15.81:0/2045314505 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.250+0000 7f8adeffd700 1 -- 172.21.15.81:0/2045314505 >> v1:172.21.15.89:6789/0 conn(0x7f8ae00b29d0 legacy=0x7f8ae0163bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.250+0000 7f8adeffd700 1 -- 172.21.15.81:0/2045314505 >> v1:172.21.15.81:6789/0 conn(0x7f8ae006f4f0 legacy=0x7f8ae00b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.250+0000 7f8addffb700 1 -- 172.21.15.81:0/2045314505 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605352658 0 0) 0x7f8ae0068d40 con 0x7f8ae006f4f0 2023-10-07T08:53:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.250+0000 7f8adeffd700 1 -- 172.21.15.81:0/2045314505 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae006e2d0 con 0x7f8ae00b1ef0 2023-10-07T08:53:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.250+0000 7f8adeffd700 1 --2- 172.21.15.81:0/2045314505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae00b1ef0 0x7f8ae006da20 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009f20 tx=0x7f8ad0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50b68e92bfe96e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.250+0000 7f8addffb700 1 -- 172.21.15.81:0/2045314505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad000e070 con 0x7f8ae00b1ef0 2023-10-07T08:53:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.250+0000 7f8addffb700 1 -- 172.21.15.81:0/2045314505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad000ba40 con 0x7f8ae00b1ef0 2023-10-07T08:53:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.250+0000 7f8addffb700 1 -- 172.21.15.81:0/2045314505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00092e0 con 0x7f8ae00b1ef0 2023-10-07T08:53:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.251+0000 7f8adffff700 1 -- 172.21.15.81:0/2045314505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae00b1ef0 msgr2=0x7f8ae006da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.251+0000 7f8adffff700 1 --2- 172.21.15.81:0/2045314505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae00b1ef0 0x7f8ae006da20 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009f20 tx=0x7f8ad0009840 comp rx=0 tx=0).stop 2023-10-07T08:53:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.251+0000 7f8adffff700 1 -- 172.21.15.81:0/2045314505 shutdown_connections 2023-10-07T08:53:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.251+0000 7f8adffff700 1 --2- 172.21.15.81:0/2045314505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae00b1ef0 0x7f8ae006da20 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.251+0000 7f8adffff700 1 -- 172.21.15.81:0/2045314505 >> 172.21.15.81:0/2045314505 conn(0x7f8ae00d0bb0 msgr2=0x7f8ae00d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.251+0000 7f8adffff700 1 -- 172.21.15.81:0/2045314505 shutdown_connections 2023-10-07T08:53:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.251+0000 7f8adffff700 1 -- 172.21.15.81:0/2045314505 wait complete. 2023-10-07T08:53:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.252+0000 7f8adffff700 1 Processor -- start 2023-10-07T08:53:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.252+0000 7f8adffff700 1 -- start start 2023-10-07T08:53:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.253+0000 7f8adffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ae006f4f0 0x7f8ae0157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.253+0000 7f8adffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ae00b1ef0 0x7f8ae00af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.253+0000 7f8adffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae00b29d0 0x7f8ae016b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.253+0000 7f8adffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae016b730 con 0x7f8ae00b29d0 2023-10-07T08:53:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.253+0000 7f8adffff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae00afc40 con 0x7f8ae006f4f0 2023-10-07T08:53:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.253+0000 7f8adffff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae00aff20 con 0x7f8ae00b1ef0 2023-10-07T08:53:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.253+0000 7f8adf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae00b29d0 0x7f8ae016b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.253+0000 7f8adf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae00b29d0 0x7f8ae016b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52940/0 (socket says 172.21.15.81:52940) 2023-10-07T08:53:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.253+0000 7f8adf7fe700 1 -- 172.21.15.81:0/540011928 learned_addr learned my addr 172.21.15.81:0/540011928 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.253+0000 7f8adeffd700 1 --2- 172.21.15.81:0/540011928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ae006f4f0 0x7f8ae0157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.253+0000 7f8ade7fc700 1 --2- 172.21.15.81:0/540011928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ae00b1ef0 0x7f8ae00af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.253+0000 7f8adf7fe700 1 -- 172.21.15.81:0/540011928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ae00b1ef0 msgr2=0x7f8ae00af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.253+0000 7f8adf7fe700 1 --2- 172.21.15.81:0/540011928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ae00b1ef0 0x7f8ae00af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.253+0000 7f8adf7fe700 1 -- 172.21.15.81:0/540011928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ae006f4f0 msgr2=0x7f8ae0157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.253+0000 7f8adf7fe700 1 --2- 172.21.15.81:0/540011928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ae006f4f0 0x7f8ae0157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.253+0000 7f8adf7fe700 1 -- 172.21.15.81:0/540011928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad0009ae0 con 0x7f8ae00b29d0 2023-10-07T08:53:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.254+0000 7f8adf7fe700 1 --2- 172.21.15.81:0/540011928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae00b29d0 0x7f8ae016b1f0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800b5e0 tx=0x7f8ad8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.254+0000 7f8ac6ffd700 1 -- 172.21.15.81:0/540011928 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad800f510 con 0x7f8ae00b29d0 2023-10-07T08:53:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.254+0000 7f8ac6ffd700 1 -- 172.21.15.81:0/540011928 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad800f690 con 0x7f8ae00b29d0 2023-10-07T08:53:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.254+0000 7f8adffff700 1 -- 172.21.15.81:0/540011928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae00b0200 con 0x7f8ae00b29d0 2023-10-07T08:53:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.254+0000 7f8ac6ffd700 1 -- 172.21.15.81:0/540011928 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad800fa50 con 0x7f8ae00b29d0 2023-10-07T08:53:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.254+0000 7f8adffff700 1 -- 172.21.15.81:0/540011928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae00ad410 con 0x7f8ae00b29d0 2023-10-07T08:53:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.255+0000 7f8adffff700 1 -- 172.21.15.81:0/540011928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae0067b70 con 0x7f8ae00b29d0 2023-10-07T08:53:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.255+0000 7f8ac6ffd700 1 -- 172.21.15.81:0/540011928 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ad801a400 con 0x7f8ae00b29d0 2023-10-07T08:53:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.255+0000 7f8ac6ffd700 1 --2- 172.21.15.81:0/540011928 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8acc066f30 0x7f8acc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.256+0000 7f8ac6ffd700 1 -- 172.21.15.81:0/540011928 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f8ad8083c00 con 0x7f8ae00b29d0 2023-10-07T08:53:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.256+0000 7f8adeffd700 1 --2- 172.21.15.81:0/540011928 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8acc066f30 0x7f8acc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.256+0000 7f8adeffd700 1 --2- 172.21.15.81:0/540011928 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8acc066f30 0x7f8acc0693e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009880 tx=0x7f8ad0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.260+0000 7f8ac6ffd700 1 -- 172.21.15.81:0/540011928 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ad808a080 con 0x7f8ae00b29d0 2023-10-07T08:53:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:47.442+0000 7f8adffff700 1 -- 172.21.15.81:0/540011928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8ae00b6850 con 0x7f8ae00b29d0 2023-10-07T08:53:48.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.112+0000 7f8ac6ffd700 1 -- 172.21.15.81:0/540011928 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v188) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8ad80510d0 con 0x7f8ae00b29d0 2023-10-07T08:53:48.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.121+0000 7f8adffff700 1 -- 172.21.15.81:0/540011928 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8acc066f30 msgr2=0x7f8acc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:48.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.121+0000 7f8adffff700 1 --2- 172.21.15.81:0/540011928 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8acc066f30 0x7f8acc0693e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009880 tx=0x7f8ad0017000 comp rx=0 tx=0).stop 2023-10-07T08:53:48.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.121+0000 7f8adffff700 1 -- 172.21.15.81:0/540011928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae00b29d0 msgr2=0x7f8ae016b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:48.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.121+0000 7f8adffff700 1 --2- 172.21.15.81:0/540011928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae00b29d0 0x7f8ae016b1f0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800b5e0 tx=0x7f8ad8009120 comp rx=0 tx=0).stop 2023-10-07T08:53:48.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.123+0000 7f8adffff700 1 -- 172.21.15.81:0/540011928 shutdown_connections 2023-10-07T08:53:48.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.123+0000 7f8adffff700 1 --2- 172.21.15.81:0/540011928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae00b29d0 0x7f8ae016b1f0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:48.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.123+0000 7f8adffff700 1 --2- 172.21.15.81:0/540011928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ae006f4f0 0x7f8ae0157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:48.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.123+0000 7f8adffff700 1 --2- 172.21.15.81:0/540011928 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8acc066f30 0x7f8acc0693e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:48.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.123+0000 7f8adffff700 1 --2- 172.21.15.81:0/540011928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ae00b1ef0 0x7f8ae00af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:48.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.123+0000 7f8adffff700 1 -- 172.21.15.81:0/540011928 >> 172.21.15.81:0/540011928 conn(0x7f8ae00d0bb0 msgr2=0x7f8ae00d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:48.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.125+0000 7f8adffff700 1 -- 172.21.15.81:0/540011928 shutdown_connections 2023-10-07T08:53:48.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.125+0000 7f8adffff700 1 -- 172.21.15.81:0/540011928 wait complete. 2023-10-07T08:53:48.127 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-07T08:53:48.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-07T08:53:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.257+0000 7fe9bc4a7700 1 Processor -- start 2023-10-07T08:53:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.257+0000 7fe9bc4a7700 1 -- start start 2023-10-07T08:53:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.258+0000 7fe9bc4a7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b4157ca0 0x7fe9b40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.258+0000 7fe9bc4a7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9b406d120 0x7fe9b406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.258+0000 7fe9bc4a7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b406dac0 con 0x7fe9b41578d0 2023-10-07T08:53:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.258+0000 7fe9bc4a7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b40d07c0 con 0x7fe9b406d120 2023-10-07T08:53:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.258+0000 7fe9bc4a7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b40cfbb0 con 0x7fe9b4157ca0 2023-10-07T08:53:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.258+0000 7fe9baa44700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9b406d120 0x7fe9b406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.258+0000 7fe9ba243700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe9b41578d0 0x7fe9b415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42044/0 (socket says 172.21.15.81:42044) 2023-10-07T08:53:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.258+0000 7fe9ba243700 1 -- 172.21.15.81:0/2014997790 learned_addr learned my addr 172.21.15.81:0/2014997790 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.259+0000 7fe9b9a42700 1 --2- 172.21.15.81:0/2014997790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b4157ca0 0x7fe9b40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.259+0000 7fe9baa44700 1 -- 172.21.15.81:0/2014997790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b4157ca0 msgr2=0x7fe9b40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.259+0000 7fe9baa44700 1 --2- 172.21.15.81:0/2014997790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b4157ca0 0x7fe9b40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.259+0000 7fe9baa44700 1 -- 172.21.15.81:0/2014997790 >> v1:172.21.15.81:6789/0 conn(0x7fe9b41578d0 legacy=0x7fe9b415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.259+0000 7fe9baa44700 1 -- 172.21.15.81:0/2014997790 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b40cfe90 con 0x7fe9b406d120 2023-10-07T08:53:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.259+0000 7fe9b9241700 1 -- 172.21.15.81:0/2014997790 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645947108 0 0) 0x7fe9b0001490 con 0x7fe9b41578d0 2023-10-07T08:53:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.259+0000 7fe9baa44700 1 --2- 172.21.15.81:0/2014997790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b406d120 0x7fe9b406d580 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0098e0 tx=0x7fe9ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8057da3410a1c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.259+0000 7fe9b9241700 1 -- 172.21.15.81:0/2014997790 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac009e80 con 0x7fe9b406d120 2023-10-07T08:53:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.259+0000 7fe9b9241700 1 -- 172.21.15.81:0/2014997790 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac00b860 con 0x7fe9b406d120 2023-10-07T08:53:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.259+0000 7fe9b9241700 1 -- 172.21.15.81:0/2014997790 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac00bbe0 con 0x7fe9b406d120 2023-10-07T08:53:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.259+0000 7fe9bc4a7700 1 -- 172.21.15.81:0/2014997790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b406d120 msgr2=0x7fe9b406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.259+0000 7fe9bc4a7700 1 --2- 172.21.15.81:0/2014997790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b406d120 0x7fe9b406d580 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0098e0 tx=0x7fe9ac0091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.260+0000 7fe9bc4a7700 1 -- 172.21.15.81:0/2014997790 shutdown_connections 2023-10-07T08:53:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.260+0000 7fe9bc4a7700 1 --2- 172.21.15.81:0/2014997790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b406d120 0x7fe9b406d580 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.260+0000 7fe9bc4a7700 1 --2- 172.21.15.81:0/2014997790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b4157ca0 0x7fe9b40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.260+0000 7fe9bc4a7700 1 -- 172.21.15.81:0/2014997790 >> 172.21.15.81:0/2014997790 conn(0x7fe9b406bb90 msgr2=0x7fe9b406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.260+0000 7fe9bc4a7700 1 -- 172.21.15.81:0/2014997790 shutdown_connections 2023-10-07T08:53:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.260+0000 7fe9bc4a7700 1 -- 172.21.15.81:0/2014997790 wait complete. 2023-10-07T08:53:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.261+0000 7fe9bc4a7700 1 Processor -- start 2023-10-07T08:53:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.261+0000 7fe9bc4a7700 1 -- start start 2023-10-07T08:53:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.261+0000 7fe9bc4a7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b406d120 0x7fe9b40cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.261+0000 7fe9bc4a7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9b41578d0 0x7fe9b40c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.261+0000 7fe9bc4a7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4157ca0 0x7fe9b40c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.261+0000 7fe9bc4a7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b40c6f80 con 0x7fe9b4157ca0 2023-10-07T08:53:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.261+0000 7fe9bc4a7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b40c6370 con 0x7fe9b41578d0 2023-10-07T08:53:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.261+0000 7fe9bc4a7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b40c6650 con 0x7fe9b406d120 2023-10-07T08:53:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.261+0000 7fe9baa44700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4157ca0 0x7fe9b40c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.262+0000 7fe9baa44700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4157ca0 0x7fe9b40c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52958/0 (socket says 172.21.15.81:52958) 2023-10-07T08:53:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.262+0000 7fe9baa44700 1 -- 172.21.15.81:0/2246252117 learned_addr learned my addr 172.21.15.81:0/2246252117 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.262+0000 7fe9baa44700 1 -- 172.21.15.81:0/2246252117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b406d120 msgr2=0x7fe9b40cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.262+0000 7fe9baa44700 1 --2- 172.21.15.81:0/2246252117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b406d120 0x7fe9b40cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.262+0000 7fe9baa44700 1 -- 172.21.15.81:0/2246252117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9b41578d0 msgr2=0x7fe9b40c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.262+0000 7fe9baa44700 1 --2- 172.21.15.81:0/2246252117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9b41578d0 0x7fe9b40c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.262+0000 7fe9baa44700 1 -- 172.21.15.81:0/2246252117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac009420 con 0x7fe9b4157ca0 2023-10-07T08:53:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.262+0000 7fe9baa44700 1 --2- 172.21.15.81:0/2246252117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4157ca0 0x7fe9b40c5b20 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fe9b406fe20 tx=0x7fe9ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.262+0000 7fe9aa7fc700 1 -- 172.21.15.81:0/2246252117 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac00bad0 con 0x7fe9b4157ca0 2023-10-07T08:53:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.262+0000 7fe9aa7fc700 1 -- 172.21.15.81:0/2246252117 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac025420 con 0x7fe9b4157ca0 2023-10-07T08:53:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.262+0000 7fe9bc4a7700 1 -- 172.21.15.81:0/2246252117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b40c6930 con 0x7fe9b4157ca0 2023-10-07T08:53:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.262+0000 7fe9aa7fc700 1 -- 172.21.15.81:0/2246252117 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0257e0 con 0x7fe9b4157ca0 2023-10-07T08:53:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.262+0000 7fe9bc4a7700 1 -- 172.21.15.81:0/2246252117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b40c7950 con 0x7fe9b4157ca0 2023-10-07T08:53:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.263+0000 7fe9bc4a7700 1 -- 172.21.15.81:0/2246252117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b4067ac0 con 0x7fe9b4157ca0 2023-10-07T08:53:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.263+0000 7fe9aa7fc700 1 -- 172.21.15.81:0/2246252117 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9ac023070 con 0x7fe9b4157ca0 2023-10-07T08:53:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.264+0000 7fe9aa7fc700 1 --2- 172.21.15.81:0/2246252117 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe998066f30 0x7fe9980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.264+0000 7fe9aa7fc700 1 -- 172.21.15.81:0/2246252117 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fe9ac085c10 con 0x7fe9b4157ca0 2023-10-07T08:53:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.264+0000 7fe9ba243700 1 --2- 172.21.15.81:0/2246252117 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe998066f30 0x7fe9980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.264+0000 7fe9ba243700 1 --2- 172.21.15.81:0/2246252117 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe998066f30 0x7fe9980693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0002130 tx=0x7fe9b00015f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:48.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.268+0000 7fe9aa7fc700 1 -- 172.21.15.81:0/2246252117 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9ac052ee0 con 0x7fe9b4157ca0 2023-10-07T08:53:48.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:48.494+0000 7fe9bc4a7700 1 -- 172.21.15.81:0/2246252117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe9b40c70c0 con 0x7fe9b4157ca0 2023-10-07T08:53:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.341+0000 7fe9aa7fc700 1 -- 172.21.15.81:0/2246252117 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v86) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe9b40c70c0 con 0x7fe9b4157ca0 2023-10-07T08:53:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.344+0000 7fe9bc4a7700 1 -- 172.21.15.81:0/2246252117 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe998066f30 msgr2=0x7fe9980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.344+0000 7fe9bc4a7700 1 --2- 172.21.15.81:0/2246252117 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe998066f30 0x7fe9980693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0002130 tx=0x7fe9b00015f0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.344+0000 7fe9bc4a7700 1 -- 172.21.15.81:0/2246252117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4157ca0 msgr2=0x7fe9b40c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.344+0000 7fe9bc4a7700 1 --2- 172.21.15.81:0/2246252117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4157ca0 0x7fe9b40c5b20 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fe9b406fe20 tx=0x7fe9ac017000 comp rx=0 tx=0).stop 2023-10-07T08:53:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.344+0000 7fe9bc4a7700 1 -- 172.21.15.81:0/2246252117 shutdown_connections 2023-10-07T08:53:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.344+0000 7fe9bc4a7700 1 --2- 172.21.15.81:0/2246252117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4157ca0 0x7fe9b40c5b20 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.344+0000 7fe9bc4a7700 1 --2- 172.21.15.81:0/2246252117 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe998066f30 0x7fe9980693e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.344+0000 7fe9bc4a7700 1 --2- 172.21.15.81:0/2246252117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9b406d120 0x7fe9b40cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.344+0000 7fe9bc4a7700 1 --2- 172.21.15.81:0/2246252117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9b41578d0 0x7fe9b40c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.344+0000 7fe9bc4a7700 1 -- 172.21.15.81:0/2246252117 >> 172.21.15.81:0/2246252117 conn(0x7fe9b406bb90 msgr2=0x7fe9b4068dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.344+0000 7fe9bc4a7700 1 -- 172.21.15.81:0/2246252117 shutdown_connections 2023-10-07T08:53:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.344+0000 7fe9bc4a7700 1 -- 172.21.15.81:0/2246252117 wait complete. 2023-10-07T08:53:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 22 and data pool 23 2023-10-07T08:53:49.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:53:49.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.473+0000 7f87b4ca4700 1 Processor -- start 2023-10-07T08:53:49.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.473+0000 7f87b4ca4700 1 -- start start 2023-10-07T08:53:49.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.474+0000 7f87b4ca4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87b0157ca0 0x7f87b00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:49.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.474+0000 7f87b4ca4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b00d07c0 con 0x7f87b01578d0 2023-10-07T08:53:49.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.474+0000 7f87b4ca4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b00cfbb0 con 0x7f87b006d120 2023-10-07T08:53:49.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.474+0000 7f87b4ca4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b00cfe90 con 0x7f87b0157ca0 2023-10-07T08:53:49.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.474+0000 7f87add9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87b0157ca0 0x7f87b00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:49.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.474+0000 7f87ae59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f87b01578d0 0x7f87b015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42054/0 (socket says 172.21.15.81:42054) 2023-10-07T08:53:49.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.474+0000 7f87ae59c700 1 -- 172.21.15.81:0/398655862 learned_addr learned my addr 172.21.15.81:0/398655862 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:49.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.475+0000 7f87add9b700 1 -- 172.21.15.81:0/398655862 >> v1:172.21.15.89:6789/0 conn(0x7f87b006d120 legacy=0x7f87b006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:49.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.475+0000 7f87add9b700 1 -- 172.21.15.81:0/398655862 >> v1:172.21.15.81:6789/0 conn(0x7f87b01578d0 legacy=0x7f87b015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:49.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.475+0000 7f87ad59a700 1 -- 172.21.15.81:0/398655862 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690773012 0 0) 0x7f87b00d07c0 con 0x7f87b01578d0 2023-10-07T08:53:49.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.475+0000 7f87add9b700 1 -- 172.21.15.81:0/398655862 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b00d0170 con 0x7f87b0157ca0 2023-10-07T08:53:49.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.475+0000 7f87add9b700 1 --2- 172.21.15.81:0/398655862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87b0157ca0 0x7f87b00cf4f0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f87a40098e0 tx=0x7f87a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b69d8a256a918b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:49.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.475+0000 7f87ad59a700 1 -- 172.21.15.81:0/398655862 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4009e80 con 0x7f87b0157ca0 2023-10-07T08:53:49.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.475+0000 7f87ad59a700 1 -- 172.21.15.81:0/398655862 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a400b860 con 0x7f87b0157ca0 2023-10-07T08:53:49.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.475+0000 7f87ad59a700 1 -- 172.21.15.81:0/398655862 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a400bbe0 con 0x7f87b0157ca0 2023-10-07T08:53:49.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.475+0000 7f87b4ca4700 1 -- 172.21.15.81:0/398655862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87b0157ca0 msgr2=0x7f87b00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:49.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.475+0000 7f87b4ca4700 1 --2- 172.21.15.81:0/398655862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87b0157ca0 0x7f87b00cf4f0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f87a40098e0 tx=0x7f87a40091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.476+0000 7f87b4ca4700 1 -- 172.21.15.81:0/398655862 shutdown_connections 2023-10-07T08:53:49.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.476+0000 7f87b4ca4700 1 --2- 172.21.15.81:0/398655862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87b0157ca0 0x7f87b00cf4f0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.476+0000 7f87b4ca4700 1 -- 172.21.15.81:0/398655862 >> 172.21.15.81:0/398655862 conn(0x7f87b006bb90 msgr2=0x7f87b006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:49.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.476+0000 7f87b4ca4700 1 -- 172.21.15.81:0/398655862 shutdown_connections 2023-10-07T08:53:49.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.476+0000 7f87b4ca4700 1 -- 172.21.15.81:0/398655862 wait complete. 2023-10-07T08:53:49.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.477+0000 7f87b4ca4700 1 Processor -- start 2023-10-07T08:53:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.477+0000 7f87b4ca4700 1 -- start start 2023-10-07T08:53:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.477+0000 7f87b4ca4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87b006d120 0x7f87b014b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.477+0000 7f87b4ca4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87b01578d0 0x7f87b00b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.477+0000 7f87b4ca4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87b0157ca0 0x7f87b00b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.477+0000 7f87b4ca4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b00b2570 con 0x7f87b01578d0 2023-10-07T08:53:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.477+0000 7f87b4ca4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b014be00 con 0x7f87b0157ca0 2023-10-07T08:53:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.477+0000 7f87b4ca4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b00b18f0 con 0x7f87b006d120 2023-10-07T08:53:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.477+0000 7f87add9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87b01578d0 0x7f87b00b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.478+0000 7f87add9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87b01578d0 0x7f87b00b0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52976/0 (socket says 172.21.15.81:52976) 2023-10-07T08:53:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.478+0000 7f87add9b700 1 -- 172.21.15.81:0/2036318295 learned_addr learned my addr 172.21.15.81:0/2036318295 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.478+0000 7f87ae59c700 1 --2- 172.21.15.81:0/2036318295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87b006d120 0x7f87b014b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:49.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.478+0000 7f87aed9d700 1 --2- 172.21.15.81:0/2036318295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87b0157ca0 0x7f87b00b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:49.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.478+0000 7f87add9b700 1 -- 172.21.15.81:0/2036318295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87b006d120 msgr2=0x7f87b014b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:49.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.478+0000 7f87add9b700 1 --2- 172.21.15.81:0/2036318295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87b006d120 0x7f87b014b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.478+0000 7f87add9b700 1 -- 172.21.15.81:0/2036318295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87b0157ca0 msgr2=0x7f87b00b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:49.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.478+0000 7f87add9b700 1 --2- 172.21.15.81:0/2036318295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87b0157ca0 0x7f87b00b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.478+0000 7f87add9b700 1 -- 172.21.15.81:0/2036318295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a4009420 con 0x7f87b01578d0 2023-10-07T08:53:49.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.478+0000 7f87add9b700 1 --2- 172.21.15.81:0/2036318295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87b01578d0 0x7f87b00b0dc0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f87b006fe20 tx=0x7f87a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:49.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.478+0000 7f879e7fc700 1 -- 172.21.15.81:0/2036318295 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a401f070 con 0x7f87b01578d0 2023-10-07T08:53:49.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.478+0000 7f879e7fc700 1 -- 172.21.15.81:0/2036318295 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a4000c90 con 0x7f87b01578d0 2023-10-07T08:53:49.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.478+0000 7f87b4ca4700 1 -- 172.21.15.81:0/2036318295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b00b1bd0 con 0x7f87b01578d0 2023-10-07T08:53:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.478+0000 7f879e7fc700 1 -- 172.21.15.81:0/2036318295 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4025420 con 0x7f87b01578d0 2023-10-07T08:53:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.478+0000 7f87b4ca4700 1 -- 172.21.15.81:0/2036318295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b00b2190 con 0x7f87b01578d0 2023-10-07T08:53:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.479+0000 7f87b4ca4700 1 -- 172.21.15.81:0/2036318295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b00b26b0 con 0x7f87b01578d0 2023-10-07T08:53:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.480+0000 7f879e7fc700 1 -- 172.21.15.81:0/2036318295 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87a4023070 con 0x7f87b01578d0 2023-10-07T08:53:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.480+0000 7f879e7fc700 1 --2- 172.21.15.81:0/2036318295 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8790066f30 0x7f87900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.480+0000 7f879e7fc700 1 -- 172.21.15.81:0/2036318295 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87a4085960 con 0x7f87b01578d0 2023-10-07T08:53:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.480+0000 7f87ae59c700 1 --2- 172.21.15.81:0/2036318295 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8790066f30 0x7f87900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.480+0000 7f87ae59c700 1 --2- 172.21.15.81:0/2036318295 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8790066f30 0x7f87900693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f87a0002230 tx=0x7f87a0001a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.484+0000 7f879e7fc700 1 -- 172.21.15.81:0/2036318295 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87b00b26b0 con 0x7f87b01578d0 2023-10-07T08:53:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.665+0000 7f87b4ca4700 1 -- 172.21.15.81:0/2036318295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87b00b26b0 con 0x7f87b01578d0 2023-10-07T08:53:49.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.666+0000 7f879e7fc700 1 -- 172.21.15.81:0/2036318295 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+15330 (secure 0 0 0) 0x7f87b00b26b0 con 0x7f87b01578d0 2023-10-07T08:53:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:49.668 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":189,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:53:48.495683+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:53:46.818809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-07T08:53:47.460436+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:53:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.668+0000 7f87b4ca4700 1 -- 172.21.15.81:0/2036318295 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8790066f30 msgr2=0x7f87900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.668+0000 7f87b4ca4700 1 --2- 172.21.15.81:0/2036318295 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8790066f30 0x7f87900693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f87a0002230 tx=0x7f87a0001a00 comp rx=0 tx=0).stop 2023-10-07T08:53:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.668+0000 7f87b4ca4700 1 -- 172.21.15.81:0/2036318295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87b01578d0 msgr2=0x7f87b00b0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.668+0000 7f87b4ca4700 1 --2- 172.21.15.81:0/2036318295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87b01578d0 0x7f87b00b0dc0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f87b006fe20 tx=0x7f87a4017000 comp rx=0 tx=0).stop 2023-10-07T08:53:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.668+0000 7f87b4ca4700 1 -- 172.21.15.81:0/2036318295 shutdown_connections 2023-10-07T08:53:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.668+0000 7f87b4ca4700 1 --2- 172.21.15.81:0/2036318295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87b0157ca0 0x7f87b00b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.668+0000 7f87b4ca4700 1 --2- 172.21.15.81:0/2036318295 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8790066f30 0x7f87900693e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.668+0000 7f87b4ca4700 1 --2- 172.21.15.81:0/2036318295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87b006d120 0x7f87b014b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.668+0000 7f87b4ca4700 1 --2- 172.21.15.81:0/2036318295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87b01578d0 0x7f87b00b0dc0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.668+0000 7f87b4ca4700 1 -- 172.21.15.81:0/2036318295 >> 172.21.15.81:0/2036318295 conn(0x7f87b006bb90 msgr2=0x7f87b006d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:49.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.668+0000 7f87b4ca4700 1 -- 172.21.15.81:0/2036318295 shutdown_connections 2023-10-07T08:53:49.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.668+0000 7f87b4ca4700 1 -- 172.21.15.81:0/2036318295 wait complete. 2023-10-07T08:53:49.682 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:53:49.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.796+0000 7fad70579700 1 Processor -- start 2023-10-07T08:53:49.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.796+0000 7fad70579700 1 -- start start 2023-10-07T08:53:49.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.797+0000 7fad70579700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad681578d0 0x7fad680cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:49.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.797+0000 7fad70579700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad68157ca0 0x7fad6815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.797+0000 7fad70579700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad680d07c0 con 0x7fad6806d120 2023-10-07T08:53:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.797+0000 7fad70579700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad680cfbb0 con 0x7fad68157ca0 2023-10-07T08:53:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.797+0000 7fad70579700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad680cfe90 con 0x7fad681578d0 2023-10-07T08:53:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.797+0000 7fad6db14700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad68157ca0 0x7fad6815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.797+0000 7fad6db14700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad68157ca0 0x7fad6815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52980/0 (socket says 172.21.15.81:52980) 2023-10-07T08:53:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.797+0000 7fad6db14700 1 -- 172.21.15.81:0/375178648 learned_addr learned my addr 172.21.15.81:0/375178648 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.797+0000 7fad6e315700 1 --2- 172.21.15.81:0/375178648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad681578d0 0x7fad680cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.797+0000 7fad6db14700 1 -- 172.21.15.81:0/375178648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad681578d0 msgr2=0x7fad680cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.797+0000 7fad6db14700 1 --2- 172.21.15.81:0/375178648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad681578d0 0x7fad680cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.797+0000 7fad6db14700 1 -- 172.21.15.81:0/375178648 >> v1:172.21.15.89:6789/0 conn(0x7fad6806d120 legacy=0x7fad6815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.797+0000 7fad6db14700 1 -- 172.21.15.81:0/375178648 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad680d0170 con 0x7fad68157ca0 2023-10-07T08:53:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.797+0000 7fad6db14700 1 --2- 172.21.15.81:0/375178648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad68157ca0 0x7fad6815af00 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fad580099b0 tx=0x7fad58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a097407bd20cda server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.797+0000 7fad6d313700 1 -- 172.21.15.81:0/375178648 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5800b820 con 0x7fad68157ca0 2023-10-07T08:53:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.798+0000 7fad6d313700 1 -- 172.21.15.81:0/375178648 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5800b980 con 0x7fad68157ca0 2023-10-07T08:53:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.798+0000 7fad6d313700 1 -- 172.21.15.81:0/375178648 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5800bd20 con 0x7fad68157ca0 2023-10-07T08:53:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.798+0000 7fad70579700 1 -- 172.21.15.81:0/375178648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad68157ca0 msgr2=0x7fad6815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.798+0000 7fad70579700 1 --2- 172.21.15.81:0/375178648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad68157ca0 0x7fad6815af00 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fad580099b0 tx=0x7fad58009250 comp rx=0 tx=0).stop 2023-10-07T08:53:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.798+0000 7fad70579700 1 -- 172.21.15.81:0/375178648 shutdown_connections 2023-10-07T08:53:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.798+0000 7fad70579700 1 --2- 172.21.15.81:0/375178648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad681578d0 0x7fad680cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.798+0000 7fad70579700 1 --2- 172.21.15.81:0/375178648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad68157ca0 0x7fad6815af00 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.798+0000 7fad70579700 1 -- 172.21.15.81:0/375178648 >> 172.21.15.81:0/375178648 conn(0x7fad6806bb90 msgr2=0x7fad6806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:49.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.798+0000 7fad70579700 1 -- 172.21.15.81:0/375178648 shutdown_connections 2023-10-07T08:53:49.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.798+0000 7fad70579700 1 -- 172.21.15.81:0/375178648 wait complete. 2023-10-07T08:53:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.799+0000 7fad70579700 1 Processor -- start 2023-10-07T08:53:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.799+0000 7fad70579700 1 -- start start 2023-10-07T08:53:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad70579700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad6806d120 0x7fad6814ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad70579700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad681578d0 0x7fad6815c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad70579700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad68157ca0 0x7fad6815c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad70579700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6814b1b0 con 0x7fad68157ca0 2023-10-07T08:53:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad70579700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad680b69c0 con 0x7fad6806d120 2023-10-07T08:53:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad70579700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad680b5db0 con 0x7fad681578d0 2023-10-07T08:53:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad6eb16700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad68157ca0 0x7fad6815c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad6eb16700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad68157ca0 0x7fad6815c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52996/0 (socket says 172.21.15.81:52996) 2023-10-07T08:53:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad6eb16700 1 -- 172.21.15.81:0/799403678 learned_addr learned my addr 172.21.15.81:0/799403678 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad6db14700 1 --2- 172.21.15.81:0/799403678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad681578d0 0x7fad6815c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad6e315700 1 --2- 172.21.15.81:0/799403678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad6806d120 0x7fad6814ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad6eb16700 1 -- 172.21.15.81:0/799403678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad681578d0 msgr2=0x7fad6815c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad6eb16700 1 --2- 172.21.15.81:0/799403678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad681578d0 0x7fad6815c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad6eb16700 1 -- 172.21.15.81:0/799403678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad6806d120 msgr2=0x7fad6814ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad6eb16700 1 --2- 172.21.15.81:0/799403678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad6806d120 0x7fad6814ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad6eb16700 1 -- 172.21.15.81:0/799403678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad580094f0 con 0x7fad68157ca0 2023-10-07T08:53:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.800+0000 7fad6eb16700 1 --2- 172.21.15.81:0/799403678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad68157ca0 0x7fad6815c860 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fad6000c930 tx=0x7fad600026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.801+0000 7fad5e7fc700 1 -- 172.21.15.81:0/799403678 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60012630 con 0x7fad68157ca0 2023-10-07T08:53:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.801+0000 7fad5e7fc700 1 -- 172.21.15.81:0/799403678 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad600127d0 con 0x7fad68157ca0 2023-10-07T08:53:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.801+0000 7fad70579700 1 -- 172.21.15.81:0/799403678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad680b6090 con 0x7fad68157ca0 2023-10-07T08:53:49.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.801+0000 7fad5e7fc700 1 -- 172.21.15.81:0/799403678 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60012b90 con 0x7fad68157ca0 2023-10-07T08:53:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.801+0000 7fad70579700 1 -- 172.21.15.81:0/799403678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad680b6650 con 0x7fad68157ca0 2023-10-07T08:53:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.801+0000 7fad70579700 1 -- 172.21.15.81:0/799403678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad680b6b30 con 0x7fad68157ca0 2023-10-07T08:53:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.802+0000 7fad5e7fc700 1 -- 172.21.15.81:0/799403678 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad60006ba0 con 0x7fad68157ca0 2023-10-07T08:53:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.802+0000 7fad5e7fc700 1 --2- 172.21.15.81:0/799403678 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fad4c066f30 0x7fad4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.803+0000 7fad5e7fc700 1 -- 172.21.15.81:0/799403678 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fad60084290 con 0x7fad68157ca0 2023-10-07T08:53:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.803+0000 7fad6e315700 1 --2- 172.21.15.81:0/799403678 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fad4c066f30 0x7fad4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.803+0000 7fad6e315700 1 --2- 172.21.15.81:0/799403678 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fad4c066f30 0x7fad4c0693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fad6400acb0 tx=0x7fad64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.806+0000 7fad5e7fc700 1 -- 172.21.15.81:0/799403678 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad60055010 con 0x7fad68157ca0 2023-10-07T08:53:49.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.988+0000 7fad70579700 1 -- 172.21.15.81:0/799403678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad680d0450 con 0x7fad68157ca0 2023-10-07T08:53:49.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.989+0000 7fad5e7fc700 1 -- 172.21.15.81:0/799403678 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+15330 (secure 0 0 0) 0x7fad60054ba0 con 0x7fad68157ca0 2023-10-07T08:53:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:49.990 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":189,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:53:48.495683+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:53:46.818809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-07T08:53:47.460436+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:53:49.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.991+0000 7fad70579700 1 -- 172.21.15.81:0/799403678 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fad4c066f30 msgr2=0x7fad4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:49.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.991+0000 7fad70579700 1 --2- 172.21.15.81:0/799403678 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fad4c066f30 0x7fad4c0693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fad6400acb0 tx=0x7fad64008040 comp rx=0 tx=0).stop 2023-10-07T08:53:49.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.991+0000 7fad70579700 1 -- 172.21.15.81:0/799403678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad68157ca0 msgr2=0x7fad6815c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:49.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.991+0000 7fad70579700 1 --2- 172.21.15.81:0/799403678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad68157ca0 0x7fad6815c860 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fad6000c930 tx=0x7fad600026e0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.991+0000 7fad70579700 1 -- 172.21.15.81:0/799403678 shutdown_connections 2023-10-07T08:53:49.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.991+0000 7fad70579700 1 --2- 172.21.15.81:0/799403678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad68157ca0 0x7fad6815c860 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.991+0000 7fad70579700 1 --2- 172.21.15.81:0/799403678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad6806d120 0x7fad6814ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.991+0000 7fad70579700 1 --2- 172.21.15.81:0/799403678 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fad4c066f30 0x7fad4c0693e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.991+0000 7fad70579700 1 --2- 172.21.15.81:0/799403678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad681578d0 0x7fad6815c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:49.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.991+0000 7fad70579700 1 -- 172.21.15.81:0/799403678 >> 172.21.15.81:0/799403678 conn(0x7fad6806bb90 msgr2=0x7fad68156720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:49.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.991+0000 7fad70579700 1 -- 172.21.15.81:0/799403678 shutdown_connections 2023-10-07T08:53:49.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:49.991+0000 7fad70579700 1 -- 172.21.15.81:0/799403678 wait complete. 2023-10-07T08:53:50.005 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-07T08:53:50.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.120+0000 7eff3fcbf700 1 Processor -- start 2023-10-07T08:53:50.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.120+0000 7eff3fcbf700 1 -- start start 2023-10-07T08:53:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.121+0000 7eff3fcbf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff38157ca0 0x7eff380cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.121+0000 7eff3fcbf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7eff3806d120 0x7eff3806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.121+0000 7eff3fcbf700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3806dac0 con 0x7eff381578d0 2023-10-07T08:53:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.121+0000 7eff3fcbf700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff380d07c0 con 0x7eff3806d120 2023-10-07T08:53:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.121+0000 7eff3fcbf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff380cfbb0 con 0x7eff38157ca0 2023-10-07T08:53:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.121+0000 7eff3e25c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7eff3806d120 0x7eff3806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.121+0000 7eff3e25c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7eff3806d120 0x7eff3806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53006/0 (socket says 172.21.15.81:53006) 2023-10-07T08:53:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.121+0000 7eff3e25c700 1 -- 172.21.15.81:0/2567892611 learned_addr learned my addr 172.21.15.81:0/2567892611 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.121+0000 7eff3d25a700 1 --2- 172.21.15.81:0/2567892611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff38157ca0 0x7eff380cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.121+0000 7eff3e25c700 1 -- 172.21.15.81:0/2567892611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff38157ca0 msgr2=0x7eff380cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.121+0000 7eff3e25c700 1 --2- 172.21.15.81:0/2567892611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff38157ca0 0x7eff380cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.121+0000 7eff3e25c700 1 -- 172.21.15.81:0/2567892611 >> v1:172.21.15.89:6789/0 conn(0x7eff381578d0 legacy=0x7eff3815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.122+0000 7eff3e25c700 1 -- 172.21.15.81:0/2567892611 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff380cfe90 con 0x7eff3806d120 2023-10-07T08:53:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.122+0000 7eff3e25c700 1 --2- 172.21.15.81:0/2567892611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3806d120 0x7eff3806d580 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7eff300099b0 tx=0x7eff30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe10b70a7e831f47 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.122+0000 7eff3ca59700 1 -- 172.21.15.81:0/2567892611 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3000b860 con 0x7eff3806d120 2023-10-07T08:53:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.122+0000 7eff3ca59700 1 -- 172.21.15.81:0/2567892611 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3000b9c0 con 0x7eff3806d120 2023-10-07T08:53:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.122+0000 7eff3ca59700 1 -- 172.21.15.81:0/2567892611 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3000bd60 con 0x7eff3806d120 2023-10-07T08:53:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.122+0000 7eff3fcbf700 1 -- 172.21.15.81:0/2567892611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3806d120 msgr2=0x7eff3806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.122+0000 7eff3fcbf700 1 --2- 172.21.15.81:0/2567892611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3806d120 0x7eff3806d580 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7eff300099b0 tx=0x7eff30009250 comp rx=0 tx=0).stop 2023-10-07T08:53:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.122+0000 7eff3fcbf700 1 -- 172.21.15.81:0/2567892611 shutdown_connections 2023-10-07T08:53:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.122+0000 7eff3fcbf700 1 --2- 172.21.15.81:0/2567892611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3806d120 0x7eff3806d580 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.122+0000 7eff3fcbf700 1 --2- 172.21.15.81:0/2567892611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff38157ca0 0x7eff380cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.122+0000 7eff3fcbf700 1 -- 172.21.15.81:0/2567892611 >> 172.21.15.81:0/2567892611 conn(0x7eff3806bb90 msgr2=0x7eff3806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.122+0000 7eff3fcbf700 1 -- 172.21.15.81:0/2567892611 shutdown_connections 2023-10-07T08:53:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.122+0000 7eff3fcbf700 1 -- 172.21.15.81:0/2567892611 wait complete. 2023-10-07T08:53:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.123+0000 7eff3fcbf700 1 Processor -- start 2023-10-07T08:53:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.123+0000 7eff3fcbf700 1 -- start start 2023-10-07T08:53:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.124+0000 7eff3fcbf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff3806d120 0x7eff380b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.124+0000 7eff3fcbf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff381578d0 0x7eff380ab000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.124+0000 7eff3fcbf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff38157ca0 0x7eff3815fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.124+0000 7eff3fcbf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff380b55f0 con 0x7eff381578d0 2023-10-07T08:53:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.124+0000 7eff3fcbf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff380ab540 con 0x7eff38157ca0 2023-10-07T08:53:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.124+0000 7eff3fcbf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff380ab7a0 con 0x7eff3806d120 2023-10-07T08:53:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.124+0000 7eff3d25a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff381578d0 0x7eff380ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.124+0000 7eff3d25a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff381578d0 0x7eff380ab000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53014/0 (socket says 172.21.15.81:53014) 2023-10-07T08:53:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.124+0000 7eff3d25a700 1 -- 172.21.15.81:0/875449353 learned_addr learned my addr 172.21.15.81:0/875449353 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.124+0000 7eff3da5b700 1 --2- 172.21.15.81:0/875449353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff3806d120 0x7eff380b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.124+0000 7eff3e25c700 1 --2- 172.21.15.81:0/875449353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff38157ca0 0x7eff3815fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.125+0000 7eff3d25a700 1 -- 172.21.15.81:0/875449353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff3806d120 msgr2=0x7eff380b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.125+0000 7eff3d25a700 1 --2- 172.21.15.81:0/875449353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff3806d120 0x7eff380b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.125+0000 7eff3d25a700 1 -- 172.21.15.81:0/875449353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff38157ca0 msgr2=0x7eff3815fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.125+0000 7eff3d25a700 1 --2- 172.21.15.81:0/875449353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff38157ca0 0x7eff3815fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.125+0000 7eff3d25a700 1 -- 172.21.15.81:0/875449353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff300094f0 con 0x7eff381578d0 2023-10-07T08:53:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.125+0000 7eff3e25c700 1 --2- 172.21.15.81:0/875449353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff38157ca0 0x7eff3815fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:53:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.125+0000 7eff3d25a700 1 --2- 172.21.15.81:0/875449353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff381578d0 0x7eff380ab000 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00d860 tx=0x7eff2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.125+0000 7eff35ffb700 1 -- 172.21.15.81:0/875449353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c009610 con 0x7eff381578d0 2023-10-07T08:53:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.125+0000 7eff35ffb700 1 -- 172.21.15.81:0/875449353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c009770 con 0x7eff381578d0 2023-10-07T08:53:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.125+0000 7eff35ffb700 1 -- 172.21.15.81:0/875449353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c009b30 con 0x7eff381578d0 2023-10-07T08:53:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.125+0000 7eff3fcbf700 1 -- 172.21.15.81:0/875449353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff380aba80 con 0x7eff381578d0 2023-10-07T08:53:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.125+0000 7eff3fcbf700 1 -- 172.21.15.81:0/875449353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff38160370 con 0x7eff381578d0 2023-10-07T08:53:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.126+0000 7eff3fcbf700 1 -- 172.21.15.81:0/875449353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff380abcc0 con 0x7eff381578d0 2023-10-07T08:53:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.127+0000 7eff35ffb700 1 -- 172.21.15.81:0/875449353 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff2c01e460 con 0x7eff381578d0 2023-10-07T08:53:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.127+0000 7eff35ffb700 1 --2- 172.21.15.81:0/875449353 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff24066f30 0x7eff240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.127+0000 7eff35ffb700 1 -- 172.21.15.81:0/875449353 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff2c085480 con 0x7eff381578d0 2023-10-07T08:53:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.127+0000 7eff3da5b700 1 --2- 172.21.15.81:0/875449353 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff24066f30 0x7eff240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.128+0000 7eff3da5b700 1 --2- 172.21.15.81:0/875449353 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff24066f30 0x7eff240693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7eff28007fd0 tx=0x7eff28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.131+0000 7eff35ffb700 1 -- 172.21.15.81:0/875449353 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff2c052770 con 0x7eff381578d0 2023-10-07T08:53:50.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:50.357+0000 7eff3fcbf700 1 -- 172.21.15.81:0/875449353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7eff380b50e0 con 0x7eff381578d0 2023-10-07T08:53:51.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.345+0000 7eff35ffb700 1 -- 172.21.15.81:0/875449353 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v89) v1 ==== 118+0+0 (secure 0 0 0) 0x7eff380b50e0 con 0x7eff381578d0 2023-10-07T08:53:51.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.348+0000 7eff3fcbf700 1 -- 172.21.15.81:0/875449353 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff24066f30 msgr2=0x7eff240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:51.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.348+0000 7eff3fcbf700 1 --2- 172.21.15.81:0/875449353 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff24066f30 0x7eff240693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7eff28007fd0 tx=0x7eff28009040 comp rx=0 tx=0).stop 2023-10-07T08:53:51.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.348+0000 7eff3fcbf700 1 -- 172.21.15.81:0/875449353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff381578d0 msgr2=0x7eff380ab000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:51.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.348+0000 7eff3fcbf700 1 --2- 172.21.15.81:0/875449353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff381578d0 0x7eff380ab000 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00d860 tx=0x7eff2c008040 comp rx=0 tx=0).stop 2023-10-07T08:53:51.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.348+0000 7eff3fcbf700 1 -- 172.21.15.81:0/875449353 shutdown_connections 2023-10-07T08:53:51.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.348+0000 7eff3fcbf700 1 --2- 172.21.15.81:0/875449353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff38157ca0 0x7eff3815fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:51.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.348+0000 7eff3fcbf700 1 --2- 172.21.15.81:0/875449353 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7eff24066f30 0x7eff240693e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:51.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.348+0000 7eff3fcbf700 1 --2- 172.21.15.81:0/875449353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff3806d120 0x7eff380b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:51.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.348+0000 7eff3fcbf700 1 --2- 172.21.15.81:0/875449353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff381578d0 0x7eff380ab000 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:51.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.348+0000 7eff3fcbf700 1 -- 172.21.15.81:0/875449353 >> 172.21.15.81:0/875449353 conn(0x7eff3806bb90 msgr2=0x7eff38068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:51.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.348+0000 7eff3fcbf700 1 -- 172.21.15.81:0/875449353 shutdown_connections 2023-10-07T08:53:51.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.348+0000 7eff3fcbf700 1 -- 172.21.15.81:0/875449353 wait complete. 2023-10-07T08:53:51.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-07T08:53:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.481+0000 7f8d46718700 1 Processor -- start 2023-10-07T08:53:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.481+0000 7f8d46718700 1 -- start start 2023-10-07T08:53:51.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.482+0000 7f8d46718700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8d40157ca0 0x7f8d400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.482+0000 7f8d46718700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8d4006d120 0x7f8d4006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.482+0000 7f8d46718700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d400d07c0 con 0x7f8d401578d0 2023-10-07T08:53:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.482+0000 7f8d46718700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4006da50 con 0x7f8d4006d120 2023-10-07T08:53:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.482+0000 7f8d46718700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d400cfbb0 con 0x7f8d40157ca0 2023-10-07T08:53:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.482+0000 7f8d3ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8d401578d0 0x7f8d4015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42068/0 (socket says 172.21.15.81:42068) 2023-10-07T08:53:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.482+0000 7f8d3ffff700 1 -- 172.21.15.81:0/1146921089 learned_addr learned my addr 172.21.15.81:0/1146921089 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.482+0000 7f8d44cb5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8d4006d120 0x7f8d4006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d44cb5700 1 -- 172.21.15.81:0/1146921089 >> v2:172.21.15.89:3300/0 conn(0x7f8d40157ca0 msgr2=0x7f8d400cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d44cb5700 1 --2- 172.21.15.81:0/1146921089 >> v2:172.21.15.89:3300/0 conn(0x7f8d40157ca0 0x7f8d400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d44cb5700 1 -- 172.21.15.81:0/1146921089 >> v1:172.21.15.81:6789/0 conn(0x7f8d401578d0 legacy=0x7f8d4015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d44cb5700 1 -- 172.21.15.81:0/1146921089 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d400cfe90 con 0x7f8d4006d120 2023-10-07T08:53:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d3effd700 1 -- 172.21.15.81:0/1146921089 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099806902 0 0) 0x7f8d400d07c0 con 0x7f8d401578d0 2023-10-07T08:53:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d44cb5700 1 --2- 172.21.15.81:0/1146921089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d4006d120 0x7f8d4006d510 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f8d40068510 tx=0x7f8d38009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938e90591b15a7a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d3effd700 1 -- 172.21.15.81:0/1146921089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3800e070 con 0x7f8d4006d120 2023-10-07T08:53:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d3effd700 1 -- 172.21.15.81:0/1146921089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3800bc30 con 0x7f8d4006d120 2023-10-07T08:53:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d3effd700 1 -- 172.21.15.81:0/1146921089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38012430 con 0x7f8d4006d120 2023-10-07T08:53:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d46718700 1 -- 172.21.15.81:0/1146921089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d4006d120 msgr2=0x7f8d4006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d46718700 1 --2- 172.21.15.81:0/1146921089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d4006d120 0x7f8d4006d510 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f8d40068510 tx=0x7f8d38009780 comp rx=0 tx=0).stop 2023-10-07T08:53:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d46718700 1 -- 172.21.15.81:0/1146921089 shutdown_connections 2023-10-07T08:53:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d46718700 1 --2- 172.21.15.81:0/1146921089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d4006d120 0x7f8d4006d510 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d46718700 1 --2- 172.21.15.81:0/1146921089 >> v2:172.21.15.89:3300/0 conn(0x7f8d40157ca0 0x7f8d400cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d46718700 1 -- 172.21.15.81:0/1146921089 >> 172.21.15.81:0/1146921089 conn(0x7f8d4006bb90 msgr2=0x7f8d4006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d46718700 1 -- 172.21.15.81:0/1146921089 shutdown_connections 2023-10-07T08:53:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.483+0000 7f8d46718700 1 -- 172.21.15.81:0/1146921089 wait complete. 2023-10-07T08:53:51.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.484+0000 7f8d46718700 1 Processor -- start 2023-10-07T08:53:51.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.485+0000 7f8d46718700 1 -- start start 2023-10-07T08:53:51.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.485+0000 7f8d46718700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d4006d120 0x7f8d40153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:51.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.485+0000 7f8d46718700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d401578d0 0x7f8d40152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:51.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.485+0000 7f8d46718700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d40157ca0 0x7f8d400ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:51.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.485+0000 7f8d46718700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d400aa890 con 0x7f8d401578d0 2023-10-07T08:53:51.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.485+0000 7f8d46718700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d400aab70 con 0x7f8d40157ca0 2023-10-07T08:53:51.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.485+0000 7f8d46718700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d400b2120 con 0x7f8d4006d120 2023-10-07T08:53:51.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.485+0000 7f8d3f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d401578d0 0x7f8d40152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:51.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d3f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d401578d0 0x7f8d40152bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53028/0 (socket says 172.21.15.81:53028) 2023-10-07T08:53:51.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d3f7fe700 1 -- 172.21.15.81:0/1400252860 learned_addr learned my addr 172.21.15.81:0/1400252860 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:51.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d44cb5700 1 --2- 172.21.15.81:0/1400252860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d40157ca0 0x7f8d400ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d3ffff700 1 --2- 172.21.15.81:0/1400252860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d4006d120 0x7f8d40153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d3f7fe700 1 -- 172.21.15.81:0/1400252860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d4006d120 msgr2=0x7f8d40153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d3f7fe700 1 --2- 172.21.15.81:0/1400252860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d4006d120 0x7f8d40153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d3f7fe700 1 -- 172.21.15.81:0/1400252860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d40157ca0 msgr2=0x7f8d400ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d3f7fe700 1 --2- 172.21.15.81:0/1400252860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d40157ca0 0x7f8d400ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d3f7fe700 1 -- 172.21.15.81:0/1400252860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d38009a20 con 0x7f8d401578d0 2023-10-07T08:53:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d3ffff700 1 --2- 172.21.15.81:0/1400252860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d4006d120 0x7f8d40153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d44cb5700 1 --2- 172.21.15.81:0/1400252860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d40157ca0 0x7f8d400ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d3f7fe700 1 --2- 172.21.15.81:0/1400252860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d401578d0 0x7f8d40152bf0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400b5e0 tx=0x7f8d340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d27fff700 1 -- 172.21.15.81:0/1400252860 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3400f510 con 0x7f8d401578d0 2023-10-07T08:53:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d27fff700 1 -- 172.21.15.81:0/1400252860 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3400f670 con 0x7f8d401578d0 2023-10-07T08:53:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d46718700 1 -- 172.21.15.81:0/1400252860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d400b2400 con 0x7f8d401578d0 2023-10-07T08:53:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d27fff700 1 -- 172.21.15.81:0/1400252860 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3400fa30 con 0x7f8d401578d0 2023-10-07T08:53:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.486+0000 7f8d46718700 1 -- 172.21.15.81:0/1400252860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d40153990 con 0x7f8d401578d0 2023-10-07T08:53:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.487+0000 7f8d46718700 1 -- 172.21.15.81:0/1400252860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d40067ac0 con 0x7f8d401578d0 2023-10-07T08:53:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.488+0000 7f8d27fff700 1 -- 172.21.15.81:0/1400252860 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d3401a400 con 0x7f8d401578d0 2023-10-07T08:53:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.488+0000 7f8d27fff700 1 --2- 172.21.15.81:0/1400252860 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8d2c066f30 0x7f8d2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.488+0000 7f8d27fff700 1 -- 172.21.15.81:0/1400252860 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8d34084030 con 0x7f8d401578d0 2023-10-07T08:53:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.488+0000 7f8d3ffff700 1 --2- 172.21.15.81:0/1400252860 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8d2c066f30 0x7f8d2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.488+0000 7f8d3ffff700 1 --2- 172.21.15.81:0/1400252860 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8d2c066f30 0x7f8d2c0693e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8d300018d0 tx=0x7f8d30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.492+0000 7f8d27fff700 1 -- 172.21.15.81:0/1400252860 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d34051320 con 0x7f8d401578d0 2023-10-07T08:53:51.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:51.715+0000 7f8d46718700 1 -- 172.21.15.81:0/1400252860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8d400d0170 con 0x7f8d401578d0 2023-10-07T08:53:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.350+0000 7f8d27fff700 1 -- 172.21.15.81:0/1400252860 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v90) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8d34054940 con 0x7f8d401578d0 2023-10-07T08:53:52.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.352+0000 7f8d46718700 1 -- 172.21.15.81:0/1400252860 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8d2c066f30 msgr2=0x7f8d2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:52.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.352+0000 7f8d46718700 1 --2- 172.21.15.81:0/1400252860 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8d2c066f30 0x7f8d2c0693e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8d300018d0 tx=0x7f8d30009040 comp rx=0 tx=0).stop 2023-10-07T08:53:52.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.352+0000 7f8d46718700 1 -- 172.21.15.81:0/1400252860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d401578d0 msgr2=0x7f8d40152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:52.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.352+0000 7f8d46718700 1 --2- 172.21.15.81:0/1400252860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d401578d0 0x7f8d40152bf0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400b5e0 tx=0x7f8d340091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.352+0000 7f8d46718700 1 -- 172.21.15.81:0/1400252860 shutdown_connections 2023-10-07T08:53:52.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.352+0000 7f8d46718700 1 --2- 172.21.15.81:0/1400252860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d40157ca0 0x7f8d400ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.352+0000 7f8d46718700 1 --2- 172.21.15.81:0/1400252860 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8d2c066f30 0x7f8d2c0693e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.352+0000 7f8d46718700 1 --2- 172.21.15.81:0/1400252860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d4006d120 0x7f8d40153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.352+0000 7f8d46718700 1 --2- 172.21.15.81:0/1400252860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d401578d0 0x7f8d40152bf0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.352+0000 7f8d46718700 1 -- 172.21.15.81:0/1400252860 >> 172.21.15.81:0/1400252860 conn(0x7f8d4006bb90 msgr2=0x7f8d40069840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:52.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.352+0000 7f8d46718700 1 -- 172.21.15.81:0/1400252860 shutdown_connections 2023-10-07T08:53:52.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.352+0000 7f8d46718700 1 -- 172.21.15.81:0/1400252860 wait complete. 2023-10-07T08:53:52.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:53:52.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.481+0000 7f5386b2e700 1 Processor -- start 2023-10-07T08:53:52.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.481+0000 7f5386b2e700 1 -- start start 2023-10-07T08:53:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.482+0000 7f5386b2e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f53800cf240 0x7f5380162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.482+0000 7f5386b2e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53800b2890 con 0x7f5380157fe0 2023-10-07T08:53:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.482+0000 7f5386b2e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53800b4070 con 0x7f53800b3bd0 2023-10-07T08:53:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.482+0000 7f5386b2e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53800b4350 con 0x7f53800cf240 2023-10-07T08:53:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.482+0000 7f53848ca700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5380157fe0 0x7f53800b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58176/0 (socket says 172.21.15.81:58176) 2023-10-07T08:53:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.482+0000 7f53848ca700 1 -- 172.21.15.81:0/1907828892 learned_addr learned my addr 172.21.15.81:0/1907828892 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f53850cb700 1 --2- 172.21.15.81:0/1907828892 >> v2:172.21.15.89:3300/0 conn(0x7f53800cf240 0x7f5380162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 -- 172.21.15.81:0/1907828892 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051822466 0 0) 0x7f53800b2890 con 0x7f5380157fe0 2023-10-07T08:53:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 -- 172.21.15.81:0/1907828892 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f536c003570 con 0x7f5380157fe0 2023-10-07T08:53:52.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 -- 172.21.15.81:0/1907828892 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143811722 0 0) 0x7f53800b4070 con 0x7f53800b3bd0 2023-10-07T08:53:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 -- 172.21.15.81:0/1907828892 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53800b2890 con 0x7f53800b3bd0 2023-10-07T08:53:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 -- 172.21.15.81:0/1907828892 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 958367422 0 0) 0x7f536c003570 con 0x7f5380157fe0 2023-10-07T08:53:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 -- 172.21.15.81:0/1907828892 >> v2:172.21.15.89:3300/0 conn(0x7f53800cf240 msgr2=0x7f5380162cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 --2- 172.21.15.81:0/1907828892 >> v2:172.21.15.89:3300/0 conn(0x7f53800cf240 0x7f5380162cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 -- 172.21.15.81:0/1907828892 >> v1:172.21.15.89:6789/0 conn(0x7f53800b3bd0 legacy=0x7f53800ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 -- 172.21.15.81:0/1907828892 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53800b4630 con 0x7f5380157fe0 2023-10-07T08:53:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 -- 172.21.15.81:0/1907828892 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f53700017f0 con 0x7f5380157fe0 2023-10-07T08:53:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 -- 172.21.15.81:0/1907828892 >> v1:172.21.15.81:6789/0 conn(0x7f5380157fe0 legacy=0x7f53800b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 --2- 172.21.15.81:0/1907828892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f536c003c40 0x7f536c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 --2- 172.21.15.81:0/1907828892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f536c004810 0x7f536c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 --2- 172.21.15.81:0/1907828892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f536c005210 0x7f536c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:52.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 -- 172.21.15.81:0/1907828892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53800b4350 con 0x7f536c005210 2023-10-07T08:53:52.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 -- 172.21.15.81:0/1907828892 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c00c1b0 con 0x7f536c004810 2023-10-07T08:53:52.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537f7fe700 1 -- 172.21.15.81:0/1907828892 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536c00c370 con 0x7f536c003c40 2023-10-07T08:53:52.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f53850cb700 1 --2- 172.21.15.81:0/1907828892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f536c005210 0x7f536c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:52.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537ffff700 1 --2- 172.21.15.81:0/1907828892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f536c004810 0x7f536c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:52.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f53848ca700 1 --2- 172.21.15.81:0/1907828892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f536c003c40 0x7f536c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:52.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f53850cb700 1 -- 172.21.15.81:0/1907828892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f536c003c40 msgr2=0x7f536c004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:52.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f53850cb700 1 --2- 172.21.15.81:0/1907828892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f536c003c40 0x7f536c004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f53850cb700 1 -- 172.21.15.81:0/1907828892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f536c004810 msgr2=0x7f536c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:52.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f53850cb700 1 --2- 172.21.15.81:0/1907828892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f536c004810 0x7f536c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f53850cb700 1 -- 172.21.15.81:0/1907828892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536c003570 con 0x7f536c005210 2023-10-07T08:53:52.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f537ffff700 1 --2- 172.21.15.81:0/1907828892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f536c004810 0x7f536c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:53:52.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f53850cb700 1 -- 172.21.15.81:0/1907828892 reap_dead start 2023-10-07T08:53:52.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.483+0000 7f53850cb700 1 --2- 172.21.15.81:0/1907828892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f536c005210 0x7f536c00ba60 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f5378006f00 tx=0x7f53780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ee407d89e29ede server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:52.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.484+0000 7f537f7fe700 1 -- 172.21.15.81:0/1907828892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537800e6e0 con 0x7f536c005210 2023-10-07T08:53:52.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.484+0000 7f537f7fe700 1 -- 172.21.15.81:0/1907828892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537800e860 con 0x7f536c005210 2023-10-07T08:53:52.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.484+0000 7f537f7fe700 1 -- 172.21.15.81:0/1907828892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537800ec20 con 0x7f536c005210 2023-10-07T08:53:52.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.484+0000 7f5386b2e700 1 -- 172.21.15.81:0/1907828892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f536c005210 msgr2=0x7f536c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:52.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.484+0000 7f5386b2e700 1 --2- 172.21.15.81:0/1907828892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f536c005210 0x7f536c00ba60 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f5378006f00 tx=0x7f53780091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.484+0000 7f5386b2e700 1 -- 172.21.15.81:0/1907828892 shutdown_connections 2023-10-07T08:53:52.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.484+0000 7f5386b2e700 1 --2- 172.21.15.81:0/1907828892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f536c005210 0x7f536c00ba60 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.484+0000 7f5386b2e700 1 -- 172.21.15.81:0/1907828892 >> 172.21.15.81:0/1907828892 conn(0x7f5380067640 msgr2=0x7f5380067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:52.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.484+0000 7f5386b2e700 1 -- 172.21.15.81:0/1907828892 shutdown_connections 2023-10-07T08:53:52.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.484+0000 7f5386b2e700 1 -- 172.21.15.81:0/1907828892 wait complete. 2023-10-07T08:53:52.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.485+0000 7f5386b2e700 1 Processor -- start 2023-10-07T08:53:52.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.485+0000 7f5386b2e700 1 -- start start 2023-10-07T08:53:52.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.486+0000 7f5386b2e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f536c005210 0x7f53801457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:52.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.486+0000 7f5386b2e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5380152d20 0x7f53800c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:52.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.486+0000 7f5386b2e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f538015a160 0x7f538015a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:52.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.486+0000 7f5386b2e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538015aaf0 con 0x7f538015a160 2023-10-07T08:53:52.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.486+0000 7f5386b2e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53800c8800 con 0x7f5380152d20 2023-10-07T08:53:52.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.486+0000 7f5386b2e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53800c8ae0 con 0x7f536c005210 2023-10-07T08:53:52.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.486+0000 7f53850cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f538015a160 0x7f538015a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:52.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.486+0000 7f53850cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f538015a160 0x7f538015a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45146/0 (socket says 172.21.15.81:45146) 2023-10-07T08:53:52.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.486+0000 7f53850cb700 1 -- 172.21.15.81:0/3838022354 learned_addr learned my addr 172.21.15.81:0/3838022354 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:52.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.486+0000 7f53848ca700 1 --2- 172.21.15.81:0/3838022354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f536c005210 0x7f53801457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:52.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.486+0000 7f537ffff700 1 --2- 172.21.15.81:0/3838022354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5380152d20 0x7f53800c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:52.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.486+0000 7f53850cb700 1 -- 172.21.15.81:0/3838022354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f536c005210 msgr2=0x7f53801457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:52.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.486+0000 7f53850cb700 1 --2- 172.21.15.81:0/3838022354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f536c005210 0x7f53801457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.486+0000 7f53850cb700 1 -- 172.21.15.81:0/3838022354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5380152d20 msgr2=0x7f53800c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:52.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.487+0000 7f53850cb700 1 --2- 172.21.15.81:0/3838022354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5380152d20 0x7f53800c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.487+0000 7f53850cb700 1 -- 172.21.15.81:0/3838022354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53800c8dc0 con 0x7f538015a160 2023-10-07T08:53:52.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.487+0000 7f537ffff700 1 --2- 172.21.15.81:0/3838022354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5380152d20 0x7f53800c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:52.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.487+0000 7f53850cb700 1 --2- 172.21.15.81:0/3838022354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f538015a160 0x7f538015a5b0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f53800b1d40 tx=0x7f5378019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:52.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.487+0000 7f537cff9700 1 -- 172.21.15.81:0/3838022354 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5378009110 con 0x7f538015a160 2023-10-07T08:53:52.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.487+0000 7f537cff9700 1 -- 172.21.15.81:0/3838022354 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5378013e20 con 0x7f538015a160 2023-10-07T08:53:52.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.487+0000 7f5386b2e700 1 -- 172.21.15.81:0/3838022354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53800c90a0 con 0x7f538015a160 2023-10-07T08:53:52.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.487+0000 7f537cff9700 1 -- 172.21.15.81:0/3838022354 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537801c6c0 con 0x7f538015a160 2023-10-07T08:53:52.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.487+0000 7f5386b2e700 1 -- 172.21.15.81:0/3838022354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5380145d10 con 0x7f538015a160 2023-10-07T08:53:52.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.488+0000 7f5386b2e700 1 -- 172.21.15.81:0/3838022354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5380069e40 con 0x7f538015a160 2023-10-07T08:53:52.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.488+0000 7f537cff9700 1 -- 172.21.15.81:0/3838022354 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f537801caf0 con 0x7f538015a160 2023-10-07T08:53:52.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.488+0000 7f537cff9700 1 --2- 172.21.15.81:0/3838022354 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5360066f30 0x7f53600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:52.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.489+0000 7f537cff9700 1 -- 172.21.15.81:0/3838022354 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5378085830 con 0x7f538015a160 2023-10-07T08:53:52.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.489+0000 7f53848ca700 1 --2- 172.21.15.81:0/3838022354 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5360066f30 0x7f53600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:52.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.489+0000 7f53848ca700 1 --2- 172.21.15.81:0/3838022354 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5360066f30 0x7f53600693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5370002250 tx=0x7f5370009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:52.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.493+0000 7f537cff9700 1 -- 172.21.15.81:0/3838022354 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5378052a00 con 0x7f538015a160 2023-10-07T08:53:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.718+0000 7f5386b2e700 1 -- 172.21.15.81:0/3838022354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53800cc6b0 con 0x7f538015a160 2023-10-07T08:53:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.718+0000 7f537cff9700 1 -- 172.21.15.81:0/3838022354 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f5378017090 con 0x7f538015a160 2023-10-07T08:53:52.720 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:52.720 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1601080758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1601080758},{"type":"v1","addr":"172.21.15.81:6837","nonce":1601080758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2709611313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2709611313},{"type":"v1","addr":"172.21.15.89:6835","nonce":2709611313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/3085029167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3085029167},{"type":"v1","addr":"172.21.15.89:6834","nonce":3085029167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:53:48.496016+0000","modified":"2023-10-07T08:53:52.345717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6836/2531199109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2531199109},{"type":"v1","addr":"172.21.15.81:6836","nonce":2531199109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-07T08:53:52.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.720+0000 7f5386b2e700 1 -- 172.21.15.81:0/3838022354 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5360066f30 msgr2=0x7f53600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:52.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.720+0000 7f5386b2e700 1 --2- 172.21.15.81:0/3838022354 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5360066f30 0x7f53600693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5370002250 tx=0x7f5370009040 comp rx=0 tx=0).stop 2023-10-07T08:53:52.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.720+0000 7f5386b2e700 1 -- 172.21.15.81:0/3838022354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f538015a160 msgr2=0x7f538015a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:52.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.720+0000 7f5386b2e700 1 --2- 172.21.15.81:0/3838022354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f538015a160 0x7f538015a5b0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f53800b1d40 tx=0x7f5378019000 comp rx=0 tx=0).stop 2023-10-07T08:53:52.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.720+0000 7f5386b2e700 1 -- 172.21.15.81:0/3838022354 shutdown_connections 2023-10-07T08:53:52.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.720+0000 7f5386b2e700 1 --2- 172.21.15.81:0/3838022354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f538015a160 0x7f538015a5b0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.720+0000 7f5386b2e700 1 --2- 172.21.15.81:0/3838022354 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5360066f30 0x7f53600693e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.720+0000 7f5386b2e700 1 --2- 172.21.15.81:0/3838022354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f536c005210 0x7f53801457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.720+0000 7f5386b2e700 1 --2- 172.21.15.81:0/3838022354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5380152d20 0x7f53800c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.720+0000 7f5386b2e700 1 -- 172.21.15.81:0/3838022354 >> 172.21.15.81:0/3838022354 conn(0x7f5380067640 msgr2=0x7f53801549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:52.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.721+0000 7f5386b2e700 1 -- 172.21.15.81:0/3838022354 shutdown_connections 2023-10-07T08:53:52.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.721+0000 7f5386b2e700 1 -- 172.21.15.81:0/3838022354 wait complete. 2023-10-07T08:53:52.724 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-07T08:53:52.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:53:52.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.847+0000 7fdb9e9c5700 1 Processor -- start 2023-10-07T08:53:52.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.847+0000 7fdb9e9c5700 1 -- start start 2023-10-07T08:53:52.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb9e9c5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdb98157ca0 0x7fdb980cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:52.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb9e9c5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb9806d120 0x7fdb9806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:52.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb9e9c5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb980d07c0 con 0x7fdb981578d0 2023-10-07T08:53:52.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb9e9c5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9806daa0 con 0x7fdb98157ca0 2023-10-07T08:53:52.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb9e9c5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980cfbb0 con 0x7fdb9806d120 2023-10-07T08:53:52.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb977fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdb98157ca0 0x7fdb980cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:52.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb97fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdb981578d0 0x7fdb9815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58178/0 (socket says 172.21.15.81:58178) 2023-10-07T08:53:52.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb97fff700 1 -- 172.21.15.81:0/392492246 learned_addr learned my addr 172.21.15.81:0/392492246 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:52.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb977fe700 1 -- 172.21.15.81:0/392492246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb9806d120 msgr2=0x7fdb9806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:52.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb977fe700 1 --2- 172.21.15.81:0/392492246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb9806d120 0x7fdb9806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb977fe700 1 -- 172.21.15.81:0/392492246 >> v1:172.21.15.81:6789/0 conn(0x7fdb981578d0 legacy=0x7fdb9815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:52.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb977fe700 1 -- 172.21.15.81:0/392492246 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb980cfe90 con 0x7fdb98157ca0 2023-10-07T08:53:52.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb96ffd700 1 -- 172.21.15.81:0/392492246 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694037338 0 0) 0x7fdb980d07c0 con 0x7fdb981578d0 2023-10-07T08:53:52.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb977fe700 1 --2- 172.21.15.81:0/392492246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb98157ca0 0x7fdb980cf4f0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0098e0 tx=0x7fdb8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb14577d5cc46e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:52.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb96ffd700 1 -- 172.21.15.81:0/392492246 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c009e80 con 0x7fdb98157ca0 2023-10-07T08:53:52.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb96ffd700 1 -- 172.21.15.81:0/392492246 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c00b860 con 0x7fdb98157ca0 2023-10-07T08:53:52.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.848+0000 7fdb96ffd700 1 -- 172.21.15.81:0/392492246 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c00bbe0 con 0x7fdb98157ca0 2023-10-07T08:53:52.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.849+0000 7fdb9e9c5700 1 -- 172.21.15.81:0/392492246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb98157ca0 msgr2=0x7fdb980cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:52.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.849+0000 7fdb9e9c5700 1 --2- 172.21.15.81:0/392492246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb98157ca0 0x7fdb980cf4f0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0098e0 tx=0x7fdb8c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.849+0000 7fdb9e9c5700 1 -- 172.21.15.81:0/392492246 shutdown_connections 2023-10-07T08:53:52.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.849+0000 7fdb9e9c5700 1 --2- 172.21.15.81:0/392492246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb9806d120 0x7fdb9806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.849+0000 7fdb9e9c5700 1 --2- 172.21.15.81:0/392492246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb98157ca0 0x7fdb980cf4f0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.849+0000 7fdb9e9c5700 1 -- 172.21.15.81:0/392492246 >> 172.21.15.81:0/392492246 conn(0x7fdb9806bb90 msgr2=0x7fdb9806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:52.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.849+0000 7fdb9e9c5700 1 -- 172.21.15.81:0/392492246 shutdown_connections 2023-10-07T08:53:52.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.849+0000 7fdb9e9c5700 1 -- 172.21.15.81:0/392492246 wait complete. 2023-10-07T08:53:52.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.850+0000 7fdb9e9c5700 1 Processor -- start 2023-10-07T08:53:52.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.850+0000 7fdb9e9c5700 1 -- start start 2023-10-07T08:53:52.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb9e9c5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb9806d120 0x7fdb98144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:52.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb9e9c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb981578d0 0x7fdb980ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:52.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb9e9c5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb98157ca0 0x7fdb9815da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:52.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb9e9c5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980b1c20 con 0x7fdb981578d0 2023-10-07T08:53:52.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb9e9c5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980aec40 con 0x7fdb98157ca0 2023-10-07T08:53:52.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb9e9c5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980b1010 con 0x7fdb9806d120 2023-10-07T08:53:52.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb981578d0 0x7fdb980ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:52.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb981578d0 0x7fdb980ae700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45156/0 (socket says 172.21.15.81:45156) 2023-10-07T08:53:52.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb977fe700 1 -- 172.21.15.81:0/1163040754 learned_addr learned my addr 172.21.15.81:0/1163040754 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:52.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb97fff700 1 --2- 172.21.15.81:0/1163040754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb9806d120 0x7fdb98144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:52.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb9cf62700 1 --2- 172.21.15.81:0/1163040754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb98157ca0 0x7fdb9815da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb977fe700 1 -- 172.21.15.81:0/1163040754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb9806d120 msgr2=0x7fdb98144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb977fe700 1 --2- 172.21.15.81:0/1163040754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb9806d120 0x7fdb98144000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb977fe700 1 -- 172.21.15.81:0/1163040754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb98157ca0 msgr2=0x7fdb9815da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb977fe700 1 --2- 172.21.15.81:0/1163040754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb98157ca0 0x7fdb9815da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb977fe700 1 -- 172.21.15.81:0/1163040754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8c009420 con 0x7fdb981578d0 2023-10-07T08:53:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb97fff700 1 --2- 172.21.15.81:0/1163040754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb9806d120 0x7fdb98144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb9cf62700 1 --2- 172.21.15.81:0/1163040754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb98157ca0 0x7fdb9815da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.851+0000 7fdb977fe700 1 --2- 172.21.15.81:0/1163040754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb981578d0 0x7fdb980ae700 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c013000 tx=0x7fdb8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.852+0000 7fdb7ffff700 1 -- 172.21.15.81:0/1163040754 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c011420 con 0x7fdb981578d0 2023-10-07T08:53:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.852+0000 7fdb7ffff700 1 -- 172.21.15.81:0/1163040754 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c0115a0 con 0x7fdb981578d0 2023-10-07T08:53:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.852+0000 7fdb9e9c5700 1 -- 172.21.15.81:0/1163040754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb980b12f0 con 0x7fdb981578d0 2023-10-07T08:53:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.852+0000 7fdb7ffff700 1 -- 172.21.15.81:0/1163040754 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c011960 con 0x7fdb981578d0 2023-10-07T08:53:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.852+0000 7fdb9e9c5700 1 -- 172.21.15.81:0/1163040754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb980b18b0 con 0x7fdb981578d0 2023-10-07T08:53:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.853+0000 7fdb9e9c5700 1 -- 172.21.15.81:0/1163040754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb980b1d90 con 0x7fdb981578d0 2023-10-07T08:53:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.853+0000 7fdb7ffff700 1 -- 172.21.15.81:0/1163040754 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb8c02c3b0 con 0x7fdb981578d0 2023-10-07T08:53:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.853+0000 7fdb7ffff700 1 --2- 172.21.15.81:0/1163040754 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb84066f30 0x7fdb840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.853+0000 7fdb7ffff700 1 -- 172.21.15.81:0/1163040754 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdb8c085b80 con 0x7fdb981578d0 2023-10-07T08:53:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.853+0000 7fdb97fff700 1 --2- 172.21.15.81:0/1163040754 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb84066f30 0x7fdb840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.854+0000 7fdb97fff700 1 --2- 172.21.15.81:0/1163040754 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb84066f30 0x7fdb840693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fdb880018d0 tx=0x7fdb88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:52.857+0000 7fdb7ffff700 1 -- 172.21.15.81:0/1163040754 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb8c052e30 con 0x7fdb981578d0 2023-10-07T08:53:53.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.040+0000 7fdb9e9c5700 1 -- 172.21.15.81:0/1163040754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb980d0170 con 0x7fdb981578d0 2023-10-07T08:53:53.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.041+0000 7fdb7ffff700 1 -- 172.21.15.81:0/1163040754 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+15317 (secure 0 0 0) 0x7fdb8c056410 con 0x7fdb981578d0 2023-10-07T08:53:53.042 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:53.042 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":190,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:53:50.126729+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:53:46.818809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-07T08:53:47.460436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:53:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.043+0000 7fdb9e9c5700 1 -- 172.21.15.81:0/1163040754 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb84066f30 msgr2=0x7fdb840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.043+0000 7fdb9e9c5700 1 --2- 172.21.15.81:0/1163040754 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb84066f30 0x7fdb840693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fdb880018d0 tx=0x7fdb88009040 comp rx=0 tx=0).stop 2023-10-07T08:53:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.043+0000 7fdb9e9c5700 1 -- 172.21.15.81:0/1163040754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb981578d0 msgr2=0x7fdb980ae700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.043+0000 7fdb9e9c5700 1 --2- 172.21.15.81:0/1163040754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb981578d0 0x7fdb980ae700 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c013000 tx=0x7fdb8c017000 comp rx=0 tx=0).stop 2023-10-07T08:53:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.043+0000 7fdb9e9c5700 1 -- 172.21.15.81:0/1163040754 shutdown_connections 2023-10-07T08:53:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.043+0000 7fdb9e9c5700 1 --2- 172.21.15.81:0/1163040754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb98157ca0 0x7fdb9815da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.043+0000 7fdb9e9c5700 1 --2- 172.21.15.81:0/1163040754 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdb84066f30 0x7fdb840693e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.043+0000 7fdb9e9c5700 1 --2- 172.21.15.81:0/1163040754 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb9806d120 0x7fdb98144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.043+0000 7fdb9e9c5700 1 --2- 172.21.15.81:0/1163040754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb981578d0 0x7fdb980ae700 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.043+0000 7fdb9e9c5700 1 -- 172.21.15.81:0/1163040754 >> 172.21.15.81:0/1163040754 conn(0x7fdb9806bb90 msgr2=0x7fdb98070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.043+0000 7fdb9e9c5700 1 -- 172.21.15.81:0/1163040754 shutdown_connections 2023-10-07T08:53:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.043+0000 7fdb9e9c5700 1 -- 172.21.15.81:0/1163040754 wait complete. 2023-10-07T08:53:53.057 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-07T08:53:53.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:53:53.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.169+0000 7f9143fff700 1 Processor -- start 2023-10-07T08:53:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.169+0000 7f9143fff700 1 -- start start 2023-10-07T08:53:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.170+0000 7f9143fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9144159b40 0x7f91440cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.170+0000 7f9143fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9144068e90 0x7f91440cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.170+0000 7f9143fff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91440cee10 con 0x7f9144159f10 2023-10-07T08:53:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.170+0000 7f9143fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91440cd040 con 0x7f9144159b40 2023-10-07T08:53:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.170+0000 7f9143fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91440cd320 con 0x7f9144068e90 2023-10-07T08:53:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.170+0000 7f9142ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9144159b40 0x7f91440cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.170+0000 7f9142ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9144159b40 0x7f91440cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45160/0 (socket says 172.21.15.81:45160) 2023-10-07T08:53:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.170+0000 7f9142ffd700 1 -- 172.21.15.81:0/2174294213 learned_addr learned my addr 172.21.15.81:0/2174294213 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.170+0000 7f91437fe700 1 --2- 172.21.15.81:0/2174294213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9144068e90 0x7f91440cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.170+0000 7f9142ffd700 1 -- 172.21.15.81:0/2174294213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9144068e90 msgr2=0x7f91440cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.170+0000 7f9142ffd700 1 --2- 172.21.15.81:0/2174294213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9144068e90 0x7f91440cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.170+0000 7f9142ffd700 1 -- 172.21.15.81:0/2174294213 >> v1:172.21.15.89:6789/0 conn(0x7f9144159f10 legacy=0x7f9144068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.170+0000 7f9142ffd700 1 -- 172.21.15.81:0/2174294213 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91440ce7c0 con 0x7f9144159b40 2023-10-07T08:53:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.171+0000 7f9142ffd700 1 --2- 172.21.15.81:0/2174294213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144159b40 0x7f91440cc600 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f9134009f20 tx=0x7f9134009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a87a3eaf41ea0e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.171+0000 7f9141ffb700 1 -- 172.21.15.81:0/2174294213 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913400e070 con 0x7f9144159b40 2023-10-07T08:53:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.171+0000 7f9141ffb700 1 -- 172.21.15.81:0/2174294213 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913400ba80 con 0x7f9144159b40 2023-10-07T08:53:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.171+0000 7f9141ffb700 1 -- 172.21.15.81:0/2174294213 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91340092e0 con 0x7f9144159b40 2023-10-07T08:53:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.171+0000 7f9143fff700 1 -- 172.21.15.81:0/2174294213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144159b40 msgr2=0x7f91440cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.171+0000 7f9143fff700 1 --2- 172.21.15.81:0/2174294213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144159b40 0x7f91440cc600 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f9134009f20 tx=0x7f9134009840 comp rx=0 tx=0).stop 2023-10-07T08:53:53.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.171+0000 7f9143fff700 1 -- 172.21.15.81:0/2174294213 shutdown_connections 2023-10-07T08:53:53.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.171+0000 7f9143fff700 1 --2- 172.21.15.81:0/2174294213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9144068e90 0x7f91440cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.171+0000 7f9143fff700 1 --2- 172.21.15.81:0/2174294213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144159b40 0x7f91440cc600 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.171+0000 7f9143fff700 1 -- 172.21.15.81:0/2174294213 >> 172.21.15.81:0/2174294213 conn(0x7f91440cd660 msgr2=0x7f91440cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:53.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.171+0000 7f9143fff700 1 -- 172.21.15.81:0/2174294213 shutdown_connections 2023-10-07T08:53:53.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.171+0000 7f9143fff700 1 -- 172.21.15.81:0/2174294213 wait complete. 2023-10-07T08:53:53.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.172+0000 7f9143fff700 1 Processor -- start 2023-10-07T08:53:53.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.173+0000 7f9143fff700 1 -- start start 2023-10-07T08:53:53.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.173+0000 7f9143fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144068e90 0x7f91440ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.173+0000 7f9143fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9144159b40 0x7f914416da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.173+0000 7f9143fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9144159f10 0x7f914416dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.173+0000 7f9143fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144159210 con 0x7f9144068e90 2023-10-07T08:53:53.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.173+0000 7f9143fff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91440cac00 con 0x7f9144159b40 2023-10-07T08:53:53.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.173+0000 7f9143fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9144158600 con 0x7f9144159f10 2023-10-07T08:53:53.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.173+0000 7f9142ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144068e90 0x7f91440ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.173+0000 7f9142ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144068e90 0x7f91440ca6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45174/0 (socket says 172.21.15.81:45174) 2023-10-07T08:53:53.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.173+0000 7f9142ffd700 1 -- 172.21.15.81:0/2204566715 learned_addr learned my addr 172.21.15.81:0/2204566715 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:53.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.173+0000 7f91427fc700 1 --2- 172.21.15.81:0/2204566715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9144159b40 0x7f914416da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.173+0000 7f91437fe700 1 --2- 172.21.15.81:0/2204566715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9144159f10 0x7f914416dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.174+0000 7f9142ffd700 1 -- 172.21.15.81:0/2204566715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9144159f10 msgr2=0x7f914416dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.174+0000 7f9142ffd700 1 --2- 172.21.15.81:0/2204566715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9144159f10 0x7f914416dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.174+0000 7f9142ffd700 1 -- 172.21.15.81:0/2204566715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9144159b40 msgr2=0x7f914416da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.174+0000 7f9142ffd700 1 --2- 172.21.15.81:0/2204566715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9144159b40 0x7f914416da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.174+0000 7f9142ffd700 1 -- 172.21.15.81:0/2204566715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9134009ae0 con 0x7f9144068e90 2023-10-07T08:53:53.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.174+0000 7f91427fc700 1 --2- 172.21.15.81:0/2204566715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9144159b40 0x7f914416da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:53:53.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.174+0000 7f9142ffd700 1 --2- 172.21.15.81:0/2204566715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144068e90 0x7f91440ca6c0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f913400b6c0 tx=0x7f9134018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:53.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.174+0000 7f913affd700 1 -- 172.21.15.81:0/2204566715 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134008ae0 con 0x7f9144068e90 2023-10-07T08:53:53.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.174+0000 7f913affd700 1 -- 172.21.15.81:0/2204566715 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9134008c40 con 0x7f9144068e90 2023-10-07T08:53:53.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.174+0000 7f913affd700 1 -- 172.21.15.81:0/2204566715 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134026460 con 0x7f9144068e90 2023-10-07T08:53:53.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.174+0000 7f9143fff700 1 -- 172.21.15.81:0/2204566715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91441588e0 con 0x7f9144068e90 2023-10-07T08:53:53.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.174+0000 7f9143fff700 1 -- 172.21.15.81:0/2204566715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9144158ea0 con 0x7f9144068e90 2023-10-07T08:53:53.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.175+0000 7f9143fff700 1 -- 172.21.15.81:0/2204566715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91440cb910 con 0x7f9144068e90 2023-10-07T08:53:53.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.175+0000 7f913affd700 1 -- 172.21.15.81:0/2204566715 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9134003040 con 0x7f9144068e90 2023-10-07T08:53:53.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.176+0000 7f913affd700 1 --2- 172.21.15.81:0/2204566715 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9124066f30 0x7f91240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.176+0000 7f913affd700 1 -- 172.21.15.81:0/2204566715 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91340863a0 con 0x7f9144068e90 2023-10-07T08:53:53.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.176+0000 7f91427fc700 1 --2- 172.21.15.81:0/2204566715 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9124066f30 0x7f91240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.176+0000 7f91427fc700 1 --2- 172.21.15.81:0/2204566715 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9124066f30 0x7f91240693e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f91440cc6d0 tx=0x7f912c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:53.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.180+0000 7f913affd700 1 -- 172.21.15.81:0/2204566715 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9134053610 con 0x7f9144068e90 2023-10-07T08:53:53.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.358+0000 7f9143fff700 1 -- 172.21.15.81:0/2204566715 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91440ceaa0 con 0x7f9124066f30 2023-10-07T08:53:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.365+0000 7f913affd700 1 -- 172.21.15.81:0/2204566715 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285472 (secure 0 0 0) 0x7f91440ceaa0 con 0x7f9124066f30 2023-10-07T08:53:53.370 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.369+0000 7f9143fff700 1 -- 172.21.15.81:0/2204566715 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9124066f30 msgr2=0x7f91240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.369+0000 7f9143fff700 1 --2- 172.21.15.81:0/2204566715 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9124066f30 0x7f91240693e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f91440cc6d0 tx=0x7f912c009040 comp rx=0 tx=0).stop 2023-10-07T08:53:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.369+0000 7f9143fff700 1 -- 172.21.15.81:0/2204566715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144068e90 msgr2=0x7f91440ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.369+0000 7f9143fff700 1 --2- 172.21.15.81:0/2204566715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144068e90 0x7f91440ca6c0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f913400b6c0 tx=0x7f9134018000 comp rx=0 tx=0).stop 2023-10-07T08:53:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.369+0000 7f9143fff700 1 -- 172.21.15.81:0/2204566715 shutdown_connections 2023-10-07T08:53:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.369+0000 7f9143fff700 1 --2- 172.21.15.81:0/2204566715 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9124066f30 0x7f91240693e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.369+0000 7f9143fff700 1 --2- 172.21.15.81:0/2204566715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9144159f10 0x7f914416dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.369+0000 7f9143fff700 1 --2- 172.21.15.81:0/2204566715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144068e90 0x7f91440ca6c0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.369+0000 7f9143fff700 1 --2- 172.21.15.81:0/2204566715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9144159b40 0x7f914416da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.369+0000 7f9143fff700 1 -- 172.21.15.81:0/2204566715 >> 172.21.15.81:0/2204566715 conn(0x7f91440cd660 msgr2=0x7f914406da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.369+0000 7f9143fff700 1 -- 172.21.15.81:0/2204566715 shutdown_connections 2023-10-07T08:53:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.369+0000 7f9143fff700 1 -- 172.21.15.81:0/2204566715 wait complete. 2023-10-07T08:53:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:53:53.382 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":515,"stamp":"2023-10-07T08:53:52.150110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9409,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553090,"statfs":{"total":1600000000,"available":1590365055,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.040976"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.142154+0000","last_change":"2023-10-07T08:53:49.142154+0000","last_active":"2023-10-07T08:53:49.142154+0000","last_peered":"2023-10-07T08:53:49.142154+0000","last_clean":"2023-10-07T08:53:49.142154+0000","last_became_active":"2023-10-07T08:53:49.141782+0000","last_became_peered":"2023-10-07T08:53:49.141782+0000","last_unstale":"2023-10-07T08:53:49.142154+0000","last_undegraded":"2023-10-07T08:53:49.142154+0000","last_fullsized":"2023-10-07T08:53:49.142154+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:44.664036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.137456+0000","last_change":"2023-10-07T08:53:49.137456+0000","last_active":"2023-10-07T08:53:49.137456+0000","last_peered":"2023-10-07T08:53:49.137456+0000","last_clean":"2023-10-07T08:53:49.137456+0000","last_became_active":"2023-10-07T08:53:49.136292+0000","last_became_peered":"2023-10-07T08:53:49.136292+0000","last_unstale":"2023-10-07T08:53:49.137456+0000","last_undegraded":"2023-10-07T08:53:49.137456+0000","last_fullsized":"2023-10-07T08:53:49.137456+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:13:00.563376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.144423+0000","last_change":"2023-10-07T08:53:49.144423+0000","last_active":"2023-10-07T08:53:49.144423+0000","last_peered":"2023-10-07T08:53:49.144423+0000","last_clean":"2023-10-07T08:53:49.144423+0000","last_became_active":"2023-10-07T08:53:49.144040+0000","last_became_peered":"2023-10-07T08:53:49.144040+0000","last_unstale":"2023-10-07T08:53:49.144423+0000","last_undegraded":"2023-10-07T08:53:49.144423+0000","last_fullsized":"2023-10-07T08:53:49.144423+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:40:53.560121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.137318+0000","last_change":"2023-10-07T08:53:49.137318+0000","last_active":"2023-10-07T08:53:49.137318+0000","last_peered":"2023-10-07T08:53:49.137318+0000","last_clean":"2023-10-07T08:53:49.137318+0000","last_became_active":"2023-10-07T08:53:49.137099+0000","last_became_peered":"2023-10-07T08:53:49.137099+0000","last_unstale":"2023-10-07T08:53:49.137318+0000","last_undegraded":"2023-10-07T08:53:49.137318+0000","last_fullsized":"2023-10-07T08:53:49.137318+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:55.137729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.142805+0000","last_change":"2023-10-07T08:53:49.142805+0000","last_active":"2023-10-07T08:53:49.142805+0000","last_peered":"2023-10-07T08:53:49.142805+0000","last_clean":"2023-10-07T08:53:49.142805+0000","last_became_active":"2023-10-07T08:53:49.142591+0000","last_became_peered":"2023-10-07T08:53:49.142591+0000","last_unstale":"2023-10-07T08:53:49.142805+0000","last_undegraded":"2023-10-07T08:53:49.142805+0000","last_fullsized":"2023-10-07T08:53:49.142805+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:58.707774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.137172+0000","last_change":"2023-10-07T08:53:49.137172+0000","last_active":"2023-10-07T08:53:49.137172+0000","last_peered":"2023-10-07T08:53:49.137172+0000","last_clean":"2023-10-07T08:53:49.137172+0000","last_became_active":"2023-10-07T08:53:49.136924+0000","last_became_peered":"2023-10-07T08:53:49.136924+0000","last_unstale":"2023-10-07T08:53:49.137172+0000","last_undegraded":"2023-10-07T08:53:49.137172+0000","last_fullsized":"2023-10-07T08:53:49.137172+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:51:10.023724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.142233+0000","last_change":"2023-10-07T08:53:49.142233+0000","last_active":"2023-10-07T08:53:49.142233+0000","last_peered":"2023-10-07T08:53:49.142233+0000","last_clean":"2023-10-07T08:53:49.142233+0000","last_became_active":"2023-10-07T08:53:49.142090+0000","last_became_peered":"2023-10-07T08:53:49.142090+0000","last_unstale":"2023-10-07T08:53:49.142233+0000","last_undegraded":"2023-10-07T08:53:49.142233+0000","last_fullsized":"2023-10-07T08:53:49.142233+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:10.566791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.144718+0000","last_change":"2023-10-07T08:53:49.144718+0000","last_active":"2023-10-07T08:53:49.144718+0000","last_peered":"2023-10-07T08:53:49.144718+0000","last_clean":"2023-10-07T08:53:49.144718+0000","last_became_active":"2023-10-07T08:53:49.144457+0000","last_became_peered":"2023-10-07T08:53:49.144457+0000","last_unstale":"2023-10-07T08:53:49.144718+0000","last_undegraded":"2023-10-07T08:53:49.144718+0000","last_fullsized":"2023-10-07T08:53:49.144718+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:23.838230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.141519+0000","last_change":"2023-10-07T08:53:49.141519+0000","last_active":"2023-10-07T08:53:49.141519+0000","last_peered":"2023-10-07T08:53:49.141519+0000","last_clean":"2023-10-07T08:53:49.141519+0000","last_became_active":"2023-10-07T08:53:49.141313+0000","last_became_peered":"2023-10-07T08:53:49.141313+0000","last_unstale":"2023-10-07T08:53:49.141519+0000","last_undegraded":"2023-10-07T08:53:49.141519+0000","last_fullsized":"2023-10-07T08:53:49.141519+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:12:27.238944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.139739+0000","last_change":"2023-10-07T08:53:49.139739+0000","last_active":"2023-10-07T08:53:49.139739+0000","last_peered":"2023-10-07T08:53:49.139739+0000","last_clean":"2023-10-07T08:53:49.139739+0000","last_became_active":"2023-10-07T08:53:49.139495+0000","last_became_peered":"2023-10-07T08:53:49.139495+0000","last_unstale":"2023-10-07T08:53:49.139739+0000","last_undegraded":"2023-10-07T08:53:49.139739+0000","last_fullsized":"2023-10-07T08:53:49.139739+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:11.717602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.144562+0000","last_change":"2023-10-07T08:53:49.144562+0000","last_active":"2023-10-07T08:53:49.144562+0000","last_peered":"2023-10-07T08:53:49.144562+0000","last_clean":"2023-10-07T08:53:49.144562+0000","last_became_active":"2023-10-07T08:53:49.144326+0000","last_became_peered":"2023-10-07T08:53:49.144326+0000","last_unstale":"2023-10-07T08:53:49.144562+0000","last_undegraded":"2023-10-07T08:53:49.144562+0000","last_fullsized":"2023-10-07T08:53:49.144562+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:59:47.779223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.137669+0000","last_change":"2023-10-07T08:53:49.137669+0000","last_active":"2023-10-07T08:53:49.137669+0000","last_peered":"2023-10-07T08:53:49.137669+0000","last_clean":"2023-10-07T08:53:49.137669+0000","last_became_active":"2023-10-07T08:53:49.137056+0000","last_became_peered":"2023-10-07T08:53:49.137056+0000","last_unstale":"2023-10-07T08:53:49.137669+0000","last_undegraded":"2023-10-07T08:53:49.137669+0000","last_fullsized":"2023-10-07T08:53:49.137669+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:28:35.331231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.130858+0000","last_change":"2023-10-07T08:53:49.130858+0000","last_active":"2023-10-07T08:53:49.130858+0000","last_peered":"2023-10-07T08:53:49.130858+0000","last_clean":"2023-10-07T08:53:49.130858+0000","last_became_active":"2023-10-07T08:53:49.130607+0000","last_became_peered":"2023-10-07T08:53:49.130607+0000","last_unstale":"2023-10-07T08:53:49.130858+0000","last_undegraded":"2023-10-07T08:53:49.130858+0000","last_fullsized":"2023-10-07T08:53:49.130858+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:11.717602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.136662+0000","last_change":"2023-10-07T08:53:49.136662+0000","last_active":"2023-10-07T08:53:49.136662+0000","last_peered":"2023-10-07T08:53:49.136662+0000","last_clean":"2023-10-07T08:53:49.136662+0000","last_became_active":"2023-10-07T08:53:49.136420+0000","last_became_peered":"2023-10-07T08:53:49.136420+0000","last_unstale":"2023-10-07T08:53:49.136662+0000","last_undegraded":"2023-10-07T08:53:49.136662+0000","last_fullsized":"2023-10-07T08:53:49.136662+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:58.707774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.139939+0000","last_change":"2023-10-07T08:53:49.139939+0000","last_active":"2023-10-07T08:53:49.139939+0000","last_peered":"2023-10-07T08:53:49.139939+0000","last_clean":"2023-10-07T08:53:49.139939+0000","last_became_active":"2023-10-07T08:53:49.139710+0000","last_became_peered":"2023-10-07T08:53:49.139710+0000","last_unstale":"2023-10-07T08:53:49.139939+0000","last_undegraded":"2023-10-07T08:53:49.139939+0000","last_fullsized":"2023-10-07T08:53:49.139939+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:53:45.729909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.141798+0000","last_change":"2023-10-07T08:53:49.141798+0000","last_active":"2023-10-07T08:53:49.141798+0000","last_peered":"2023-10-07T08:53:49.141798+0000","last_clean":"2023-10-07T08:53:49.141798+0000","last_became_active":"2023-10-07T08:53:49.141612+0000","last_became_peered":"2023-10-07T08:53:49.141612+0000","last_unstale":"2023-10-07T08:53:49.141798+0000","last_undegraded":"2023-10-07T08:53:49.141798+0000","last_fullsized":"2023-10-07T08:53:49.141798+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:48.520380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.133320+0000","last_change":"2023-10-07T08:53:49.133320+0000","last_active":"2023-10-07T08:53:49.133320+0000","last_peered":"2023-10-07T08:53:49.133320+0000","last_clean":"2023-10-07T08:53:49.133320+0000","last_became_active":"2023-10-07T08:53:49.133102+0000","last_became_peered":"2023-10-07T08:53:49.133102+0000","last_unstale":"2023-10-07T08:53:49.133320+0000","last_undegraded":"2023-10-07T08:53:49.133320+0000","last_fullsized":"2023-10-07T08:53:49.133320+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:40:41.077885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.131199+0000","last_change":"2023-10-07T08:53:49.131199+0000","last_active":"2023-10-07T08:53:49.131199+0000","last_peered":"2023-10-07T08:53:49.131199+0000","last_clean":"2023-10-07T08:53:49.131199+0000","last_became_active":"2023-10-07T08:53:49.130897+0000","last_became_peered":"2023-10-07T08:53:49.130897+0000","last_unstale":"2023-10-07T08:53:49.131199+0000","last_undegraded":"2023-10-07T08:53:49.131199+0000","last_fullsized":"2023-10-07T08:53:49.131199+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:51.352867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.140131+0000","last_change":"2023-10-07T08:53:49.140131+0000","last_active":"2023-10-07T08:53:49.140131+0000","last_peered":"2023-10-07T08:53:49.140131+0000","last_clean":"2023-10-07T08:53:49.140131+0000","last_became_active":"2023-10-07T08:53:49.139883+0000","last_became_peered":"2023-10-07T08:53:49.139883+0000","last_unstale":"2023-10-07T08:53:49.140131+0000","last_undegraded":"2023-10-07T08:53:49.140131+0000","last_fullsized":"2023-10-07T08:53:49.140131+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:34:57.520427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.135132+0000","last_change":"2023-10-07T08:53:49.135132+0000","last_active":"2023-10-07T08:53:49.135132+0000","last_peered":"2023-10-07T08:53:49.135132+0000","last_clean":"2023-10-07T08:53:49.135132+0000","last_became_active":"2023-10-07T08:53:49.134851+0000","last_became_peered":"2023-10-07T08:53:49.134851+0000","last_unstale":"2023-10-07T08:53:49.135132+0000","last_undegraded":"2023-10-07T08:53:49.135132+0000","last_fullsized":"2023-10-07T08:53:49.135132+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:12:27.238944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.132433+0000","last_change":"2023-10-07T08:53:49.132433+0000","last_active":"2023-10-07T08:53:49.132433+0000","last_peered":"2023-10-07T08:53:49.132433+0000","last_clean":"2023-10-07T08:53:49.132433+0000","last_became_active":"2023-10-07T08:53:49.132214+0000","last_became_peered":"2023-10-07T08:53:49.132214+0000","last_unstale":"2023-10-07T08:53:49.132433+0000","last_undegraded":"2023-10-07T08:53:49.132433+0000","last_fullsized":"2023-10-07T08:53:49.132433+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:57:04.012976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.140309+0000","last_change":"2023-10-07T08:53:49.140309+0000","last_active":"2023-10-07T08:53:49.140309+0000","last_peered":"2023-10-07T08:53:49.140309+0000","last_clean":"2023-10-07T08:53:49.140309+0000","last_became_active":"2023-10-07T08:53:49.140072+0000","last_became_peered":"2023-10-07T08:53:49.140072+0000","last_unstale":"2023-10-07T08:53:49.140309+0000","last_undegraded":"2023-10-07T08:53:49.140309+0000","last_fullsized":"2023-10-07T08:53:49.140309+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:31:17.826847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.135217+0000","last_change":"2023-10-07T08:53:49.135217+0000","last_active":"2023-10-07T08:53:49.135217+0000","last_peered":"2023-10-07T08:53:49.135217+0000","last_clean":"2023-10-07T08:53:49.135217+0000","last_became_active":"2023-10-07T08:53:49.135006+0000","last_became_peered":"2023-10-07T08:53:49.135006+0000","last_unstale":"2023-10-07T08:53:49.135217+0000","last_undegraded":"2023-10-07T08:53:49.135217+0000","last_fullsized":"2023-10-07T08:53:49.135217+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:41:08.648610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.137585+0000","last_change":"2023-10-07T08:53:49.137585+0000","last_active":"2023-10-07T08:53:49.137585+0000","last_peered":"2023-10-07T08:53:49.137585+0000","last_clean":"2023-10-07T08:53:49.137585+0000","last_became_active":"2023-10-07T08:53:49.137339+0000","last_became_peered":"2023-10-07T08:53:49.137339+0000","last_unstale":"2023-10-07T08:53:49.137585+0000","last_undegraded":"2023-10-07T08:53:49.137585+0000","last_fullsized":"2023-10-07T08:53:49.137585+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:53.934432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.143120+0000","last_change":"2023-10-07T08:53:49.143120+0000","last_active":"2023-10-07T08:53:49.143120+0000","last_peered":"2023-10-07T08:53:49.143120+0000","last_clean":"2023-10-07T08:53:49.143120+0000","last_became_active":"2023-10-07T08:53:49.142907+0000","last_became_peered":"2023-10-07T08:53:49.142907+0000","last_unstale":"2023-10-07T08:53:49.143120+0000","last_undegraded":"2023-10-07T08:53:49.143120+0000","last_fullsized":"2023-10-07T08:53:49.143120+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:53.934432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.135414+0000","last_change":"2023-10-07T08:53:49.135414+0000","last_active":"2023-10-07T08:53:49.135414+0000","last_peered":"2023-10-07T08:53:49.135414+0000","last_clean":"2023-10-07T08:53:49.135414+0000","last_became_active":"2023-10-07T08:53:49.135152+0000","last_became_peered":"2023-10-07T08:53:49.135152+0000","last_unstale":"2023-10-07T08:53:49.135414+0000","last_undegraded":"2023-10-07T08:53:49.135414+0000","last_fullsized":"2023-10-07T08:53:49.135414+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:46:07.166742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138866+0000","last_change":"2023-10-07T08:53:49.138866+0000","last_active":"2023-10-07T08:53:49.138866+0000","last_peered":"2023-10-07T08:53:49.138866+0000","last_clean":"2023-10-07T08:53:49.138866+0000","last_became_active":"2023-10-07T08:53:49.138719+0000","last_became_peered":"2023-10-07T08:53:49.138719+0000","last_unstale":"2023-10-07T08:53:49.138866+0000","last_undegraded":"2023-10-07T08:53:49.138866+0000","last_fullsized":"2023-10-07T08:53:49.138866+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:59:47.779223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.144230+0000","last_change":"2023-10-07T08:53:49.144230+0000","last_active":"2023-10-07T08:53:49.144230+0000","last_peered":"2023-10-07T08:53:49.144230+0000","last_clean":"2023-10-07T08:53:49.144230+0000","last_became_active":"2023-10-07T08:53:49.143988+0000","last_became_peered":"2023-10-07T08:53:49.143988+0000","last_unstale":"2023-10-07T08:53:49.144230+0000","last_undegraded":"2023-10-07T08:53:49.144230+0000","last_fullsized":"2023-10-07T08:53:49.144230+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:10.569667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138873+0000","last_change":"2023-10-07T08:53:49.138873+0000","last_active":"2023-10-07T08:53:49.138873+0000","last_peered":"2023-10-07T08:53:49.138873+0000","last_clean":"2023-10-07T08:53:49.138873+0000","last_became_active":"2023-10-07T08:53:49.138711+0000","last_became_peered":"2023-10-07T08:53:49.138711+0000","last_unstale":"2023-10-07T08:53:49.138873+0000","last_undegraded":"2023-10-07T08:53:49.138873+0000","last_fullsized":"2023-10-07T08:53:49.138873+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:28:35.331231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.142252+0000","last_change":"2023-10-07T08:53:49.142252+0000","last_active":"2023-10-07T08:53:49.142252+0000","last_peered":"2023-10-07T08:53:49.142252+0000","last_clean":"2023-10-07T08:53:49.142252+0000","last_became_active":"2023-10-07T08:53:49.141924+0000","last_became_peered":"2023-10-07T08:53:49.141924+0000","last_unstale":"2023-10-07T08:53:49.142252+0000","last_undegraded":"2023-10-07T08:53:49.142252+0000","last_fullsized":"2023-10-07T08:53:49.142252+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:03:03.683868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.143108+0000","last_change":"2023-10-07T08:53:49.143108+0000","last_active":"2023-10-07T08:53:49.143108+0000","last_peered":"2023-10-07T08:53:49.143108+0000","last_clean":"2023-10-07T08:53:49.143108+0000","last_became_active":"2023-10-07T08:53:49.142551+0000","last_became_peered":"2023-10-07T08:53:49.142551+0000","last_unstale":"2023-10-07T08:53:49.143108+0000","last_undegraded":"2023-10-07T08:53:49.143108+0000","last_fullsized":"2023-10-07T08:53:49.143108+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:23:46.903986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.135215+0000","last_change":"2023-10-07T08:53:49.135215+0000","last_active":"2023-10-07T08:53:49.135215+0000","last_peered":"2023-10-07T08:53:49.135215+0000","last_clean":"2023-10-07T08:53:49.135215+0000","last_became_active":"2023-10-07T08:53:49.134705+0000","last_became_peered":"2023-10-07T08:53:49.134705+0000","last_unstale":"2023-10-07T08:53:49.135215+0000","last_undegraded":"2023-10-07T08:53:49.135215+0000","last_fullsized":"2023-10-07T08:53:49.135215+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:40.042299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.137763+0000","last_change":"2023-10-07T08:53:49.137763+0000","last_active":"2023-10-07T08:53:49.137763+0000","last_peered":"2023-10-07T08:53:49.137763+0000","last_clean":"2023-10-07T08:53:49.137763+0000","last_became_active":"2023-10-07T08:53:49.137551+0000","last_became_peered":"2023-10-07T08:53:49.137551+0000","last_unstale":"2023-10-07T08:53:49.137763+0000","last_undegraded":"2023-10-07T08:53:49.137763+0000","last_fullsized":"2023-10-07T08:53:49.137763+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:50:39.228275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"189'4","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.346340+0000","last_change":"2023-10-07T08:53:48.127647+0000","last_active":"2023-10-07T08:53:49.346340+0000","last_peered":"2023-10-07T08:53:49.346340+0000","last_clean":"2023-10-07T08:53:49.346340+0000","last_became_active":"2023-10-07T08:53:48.127412+0000","last_became_peered":"2023-10-07T08:53:48.127412+0000","last_unstale":"2023-10-07T08:53:49.346340+0000","last_undegraded":"2023-10-07T08:53:49.346340+0000","last_fullsized":"2023-10-07T08:53:49.346340+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:50.348494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.143985+0000","last_change":"2023-10-07T08:53:49.143985+0000","last_active":"2023-10-07T08:53:49.143985+0000","last_peered":"2023-10-07T08:53:49.143985+0000","last_clean":"2023-10-07T08:53:49.143985+0000","last_became_active":"2023-10-07T08:53:49.143456+0000","last_became_peered":"2023-10-07T08:53:49.143456+0000","last_unstale":"2023-10-07T08:53:49.143985+0000","last_undegraded":"2023-10-07T08:53:49.143985+0000","last_fullsized":"2023-10-07T08:53:49.143985+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:55.137729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"189'1","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.136668+0000","last_change":"2023-10-07T08:53:48.125594+0000","last_active":"2023-10-07T08:53:49.136668+0000","last_peered":"2023-10-07T08:53:49.136668+0000","last_clean":"2023-10-07T08:53:49.136668+0000","last_became_active":"2023-10-07T08:53:48.125216+0000","last_became_peered":"2023-10-07T08:53:48.125216+0000","last_unstale":"2023-10-07T08:53:49.136668+0000","last_undegraded":"2023-10-07T08:53:49.136668+0000","last_fullsized":"2023-10-07T08:53:49.136668+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:32:45.867627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.135186+0000","last_change":"2023-10-07T08:53:49.135186+0000","last_active":"2023-10-07T08:53:49.135186+0000","last_peered":"2023-10-07T08:53:49.135186+0000","last_clean":"2023-10-07T08:53:49.135186+0000","last_became_active":"2023-10-07T08:53:49.134970+0000","last_became_peered":"2023-10-07T08:53:49.134970+0000","last_unstale":"2023-10-07T08:53:49.135186+0000","last_undegraded":"2023-10-07T08:53:49.135186+0000","last_fullsized":"2023-10-07T08:53:49.135186+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:13.238807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"189'2","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.346980+0000","last_change":"2023-10-07T08:53:48.124180+0000","last_active":"2023-10-07T08:53:49.346980+0000","last_peered":"2023-10-07T08:53:49.346980+0000","last_clean":"2023-10-07T08:53:49.346980+0000","last_became_active":"2023-10-07T08:53:48.124031+0000","last_became_peered":"2023-10-07T08:53:48.124031+0000","last_unstale":"2023-10-07T08:53:49.346980+0000","last_undegraded":"2023-10-07T08:53:49.346980+0000","last_fullsized":"2023-10-07T08:53:49.346980+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:28:34.326859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.131473+0000","last_change":"2023-10-07T08:53:49.131473+0000","last_active":"2023-10-07T08:53:49.131473+0000","last_peered":"2023-10-07T08:53:49.131473+0000","last_clean":"2023-10-07T08:53:49.131473+0000","last_became_active":"2023-10-07T08:53:49.131081+0000","last_became_peered":"2023-10-07T08:53:49.131081+0000","last_unstale":"2023-10-07T08:53:49.131473+0000","last_undegraded":"2023-10-07T08:53:49.131473+0000","last_fullsized":"2023-10-07T08:53:49.131473+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:18:33.633016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"189'2","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.346750+0000","last_change":"2023-10-07T08:53:48.121963+0000","last_active":"2023-10-07T08:53:49.346750+0000","last_peered":"2023-10-07T08:53:49.346750+0000","last_clean":"2023-10-07T08:53:49.346750+0000","last_became_active":"2023-10-07T08:53:48.121742+0000","last_became_peered":"2023-10-07T08:53:48.121742+0000","last_unstale":"2023-10-07T08:53:49.346750+0000","last_undegraded":"2023-10-07T08:53:49.346750+0000","last_fullsized":"2023-10-07T08:53:49.346750+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:06:26.189247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.136940+0000","last_change":"2023-10-07T08:53:49.136940+0000","last_active":"2023-10-07T08:53:49.136940+0000","last_peered":"2023-10-07T08:53:49.136940+0000","last_clean":"2023-10-07T08:53:49.136940+0000","last_became_active":"2023-10-07T08:53:49.136588+0000","last_became_peered":"2023-10-07T08:53:49.136588+0000","last_unstale":"2023-10-07T08:53:49.136940+0000","last_undegraded":"2023-10-07T08:53:49.136940+0000","last_fullsized":"2023-10-07T08:53:49.136940+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:11:01.945691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"189'1","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.130325+0000","last_change":"2023-10-07T08:53:48.125438+0000","last_active":"2023-10-07T08:53:49.130325+0000","last_peered":"2023-10-07T08:53:49.130325+0000","last_clean":"2023-10-07T08:53:49.130325+0000","last_became_active":"2023-10-07T08:53:48.125141+0000","last_became_peered":"2023-10-07T08:53:48.125141+0000","last_unstale":"2023-10-07T08:53:49.130325+0000","last_undegraded":"2023-10-07T08:53:49.130325+0000","last_fullsized":"2023-10-07T08:53:49.130325+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:45:55.337701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138512+0000","last_change":"2023-10-07T08:53:49.138512+0000","last_active":"2023-10-07T08:53:49.138512+0000","last_peered":"2023-10-07T08:53:49.138512+0000","last_clean":"2023-10-07T08:53:49.138512+0000","last_became_active":"2023-10-07T08:53:49.138213+0000","last_became_peered":"2023-10-07T08:53:49.138213+0000","last_unstale":"2023-10-07T08:53:49.138512+0000","last_undegraded":"2023-10-07T08:53:49.138512+0000","last_fullsized":"2023-10-07T08:53:49.138512+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:11:03.665053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"189'1","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.133377+0000","last_change":"2023-10-07T08:53:48.124457+0000","last_active":"2023-10-07T08:53:49.133377+0000","last_peered":"2023-10-07T08:53:49.133377+0000","last_clean":"2023-10-07T08:53:49.133377+0000","last_became_active":"2023-10-07T08:53:48.123278+0000","last_became_peered":"2023-10-07T08:53:48.123278+0000","last_unstale":"2023-10-07T08:53:49.133377+0000","last_undegraded":"2023-10-07T08:53:49.133377+0000","last_fullsized":"2023-10-07T08:53:49.133377+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.718260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.137669+0000","last_change":"2023-10-07T08:53:49.137669+0000","last_active":"2023-10-07T08:53:49.137669+0000","last_peered":"2023-10-07T08:53:49.137669+0000","last_clean":"2023-10-07T08:53:49.137669+0000","last_became_active":"2023-10-07T08:53:49.137325+0000","last_became_peered":"2023-10-07T08:53:49.137325+0000","last_unstale":"2023-10-07T08:53:49.137669+0000","last_undegraded":"2023-10-07T08:53:49.137669+0000","last_fullsized":"2023-10-07T08:53:49.137669+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:13:18.357167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.126441+0000","last_change":"2023-10-07T08:53:48.126363+0000","last_active":"2023-10-07T08:53:48.126441+0000","last_peered":"2023-10-07T08:53:48.126441+0000","last_clean":"2023-10-07T08:53:48.126441+0000","last_became_active":"2023-10-07T08:53:48.125786+0000","last_became_peered":"2023-10-07T08:53:48.125786+0000","last_unstale":"2023-10-07T08:53:48.126441+0000","last_undegraded":"2023-10-07T08:53:48.126441+0000","last_fullsized":"2023-10-07T08:53:48.126441+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:21.657497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.134737+0000","last_change":"2023-10-07T08:53:49.134737+0000","last_active":"2023-10-07T08:53:49.134737+0000","last_peered":"2023-10-07T08:53:49.134737+0000","last_clean":"2023-10-07T08:53:49.134737+0000","last_became_active":"2023-10-07T08:53:49.134491+0000","last_became_peered":"2023-10-07T08:53:49.134491+0000","last_unstale":"2023-10-07T08:53:49.134737+0000","last_undegraded":"2023-10-07T08:53:49.134737+0000","last_fullsized":"2023-10-07T08:53:49.134737+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:49:48.482642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.119340+0000","last_change":"2023-10-07T08:53:48.119245+0000","last_active":"2023-10-07T08:53:48.119340+0000","last_peered":"2023-10-07T08:53:48.119340+0000","last_clean":"2023-10-07T08:53:48.119340+0000","last_became_active":"2023-10-07T08:53:48.119002+0000","last_became_peered":"2023-10-07T08:53:48.119002+0000","last_unstale":"2023-10-07T08:53:48.119340+0000","last_undegraded":"2023-10-07T08:53:48.119340+0000","last_fullsized":"2023-10-07T08:53:48.119340+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:09.057999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.134702+0000","last_change":"2023-10-07T08:53:49.134702+0000","last_active":"2023-10-07T08:53:49.134702+0000","last_peered":"2023-10-07T08:53:49.134702+0000","last_clean":"2023-10-07T08:53:49.134702+0000","last_became_active":"2023-10-07T08:53:49.134478+0000","last_became_peered":"2023-10-07T08:53:49.134478+0000","last_unstale":"2023-10-07T08:53:49.134702+0000","last_undegraded":"2023-10-07T08:53:49.134702+0000","last_fullsized":"2023-10-07T08:53:49.134702+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:44.664036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.127627+0000","last_change":"2023-10-07T08:53:48.127571+0000","last_active":"2023-10-07T08:53:48.127627+0000","last_peered":"2023-10-07T08:53:48.127627+0000","last_clean":"2023-10-07T08:53:48.127627+0000","last_became_active":"2023-10-07T08:53:48.127350+0000","last_became_peered":"2023-10-07T08:53:48.127350+0000","last_unstale":"2023-10-07T08:53:48.127627+0000","last_undegraded":"2023-10-07T08:53:48.127627+0000","last_fullsized":"2023-10-07T08:53:48.127627+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:18:57.936155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138585+0000","last_change":"2023-10-07T08:53:49.138585+0000","last_active":"2023-10-07T08:53:49.138585+0000","last_peered":"2023-10-07T08:53:49.138585+0000","last_clean":"2023-10-07T08:53:49.138585+0000","last_became_active":"2023-10-07T08:53:49.138023+0000","last_became_peered":"2023-10-07T08:53:49.138023+0000","last_unstale":"2023-10-07T08:53:49.138585+0000","last_undegraded":"2023-10-07T08:53:49.138585+0000","last_fullsized":"2023-10-07T08:53:49.138585+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:44:30.154371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"189'3","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.347286+0000","last_change":"2023-10-07T08:53:48.120026+0000","last_active":"2023-10-07T08:53:49.347286+0000","last_peered":"2023-10-07T08:53:49.347286+0000","last_clean":"2023-10-07T08:53:49.347286+0000","last_became_active":"2023-10-07T08:53:48.119785+0000","last_became_peered":"2023-10-07T08:53:48.119785+0000","last_unstale":"2023-10-07T08:53:49.347286+0000","last_undegraded":"2023-10-07T08:53:49.347286+0000","last_fullsized":"2023-10-07T08:53:49.347286+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:12:10.529919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.143838+0000","last_change":"2023-10-07T08:53:49.143838+0000","last_active":"2023-10-07T08:53:49.143838+0000","last_peered":"2023-10-07T08:53:49.143838+0000","last_clean":"2023-10-07T08:53:49.143838+0000","last_became_active":"2023-10-07T08:53:49.143137+0000","last_became_peered":"2023-10-07T08:53:49.143137+0000","last_unstale":"2023-10-07T08:53:49.143838+0000","last_undegraded":"2023-10-07T08:53:49.143838+0000","last_fullsized":"2023-10-07T08:53:49.143838+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:13:18.357167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"189'6","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.348038+0000","last_change":"2023-10-07T08:53:48.120278+0000","last_active":"2023-10-07T08:53:49.348038+0000","last_peered":"2023-10-07T08:53:49.348038+0000","last_clean":"2023-10-07T08:53:49.348038+0000","last_became_active":"2023-10-07T08:53:48.120025+0000","last_became_peered":"2023-10-07T08:53:48.120025+0000","last_unstale":"2023-10-07T08:53:49.348038+0000","last_undegraded":"2023-10-07T08:53:49.348038+0000","last_fullsized":"2023-10-07T08:53:49.348038+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:10.713230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.136429+0000","last_change":"2023-10-07T08:53:49.136429+0000","last_active":"2023-10-07T08:53:49.136429+0000","last_peered":"2023-10-07T08:53:49.136429+0000","last_clean":"2023-10-07T08:53:49.136429+0000","last_became_active":"2023-10-07T08:53:49.136181+0000","last_became_peered":"2023-10-07T08:53:49.136181+0000","last_unstale":"2023-10-07T08:53:49.136429+0000","last_undegraded":"2023-10-07T08:53:49.136429+0000","last_fullsized":"2023-10-07T08:53:49.136429+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:53:45.729909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"189'2","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.346633+0000","last_change":"2023-10-07T08:53:48.122717+0000","last_active":"2023-10-07T08:53:49.346633+0000","last_peered":"2023-10-07T08:53:49.346633+0000","last_clean":"2023-10-07T08:53:49.346633+0000","last_became_active":"2023-10-07T08:53:48.122555+0000","last_became_peered":"2023-10-07T08:53:48.122555+0000","last_unstale":"2023-10-07T08:53:49.346633+0000","last_undegraded":"2023-10-07T08:53:49.346633+0000","last_fullsized":"2023-10-07T08:53:49.346633+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:12:59.559004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138981+0000","last_change":"2023-10-07T08:53:49.138981+0000","last_active":"2023-10-07T08:53:49.138981+0000","last_peered":"2023-10-07T08:53:49.138981+0000","last_clean":"2023-10-07T08:53:49.138981+0000","last_became_active":"2023-10-07T08:53:49.138745+0000","last_became_peered":"2023-10-07T08:53:49.138745+0000","last_unstale":"2023-10-07T08:53:49.138981+0000","last_undegraded":"2023-10-07T08:53:49.138981+0000","last_fullsized":"2023-10-07T08:53:49.138981+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:49.152407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.120403+0000","last_change":"2023-10-07T08:53:48.119782+0000","last_active":"2023-10-07T08:53:48.120403+0000","last_peered":"2023-10-07T08:53:48.120403+0000","last_clean":"2023-10-07T08:53:48.120403+0000","last_became_active":"2023-10-07T08:53:48.119552+0000","last_became_peered":"2023-10-07T08:53:48.119552+0000","last_unstale":"2023-10-07T08:53:48.120403+0000","last_undegraded":"2023-10-07T08:53:48.120403+0000","last_fullsized":"2023-10-07T08:53:48.120403+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:30:09.150350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138671+0000","last_change":"2023-10-07T08:53:49.138671+0000","last_active":"2023-10-07T08:53:49.138671+0000","last_peered":"2023-10-07T08:53:49.138671+0000","last_clean":"2023-10-07T08:53:49.138671+0000","last_became_active":"2023-10-07T08:53:49.138470+0000","last_became_peered":"2023-10-07T08:53:49.138470+0000","last_unstale":"2023-10-07T08:53:49.138671+0000","last_undegraded":"2023-10-07T08:53:49.138671+0000","last_fullsized":"2023-10-07T08:53:49.138671+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:20:09.988221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.125507+0000","last_change":"2023-10-07T08:53:48.125472+0000","last_active":"2023-10-07T08:53:48.125507+0000","last_peered":"2023-10-07T08:53:48.125507+0000","last_clean":"2023-10-07T08:53:48.125507+0000","last_became_active":"2023-10-07T08:53:48.125240+0000","last_became_peered":"2023-10-07T08:53:48.125240+0000","last_unstale":"2023-10-07T08:53:48.125507+0000","last_undegraded":"2023-10-07T08:53:48.125507+0000","last_fullsized":"2023-10-07T08:53:48.125507+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:32:45.867627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.140688+0000","last_change":"2023-10-07T08:53:49.140688+0000","last_active":"2023-10-07T08:53:49.140688+0000","last_peered":"2023-10-07T08:53:49.140688+0000","last_clean":"2023-10-07T08:53:49.140688+0000","last_became_active":"2023-10-07T08:53:49.140469+0000","last_became_peered":"2023-10-07T08:53:49.140469+0000","last_unstale":"2023-10-07T08:53:49.140688+0000","last_undegraded":"2023-10-07T08:53:49.140688+0000","last_fullsized":"2023-10-07T08:53:49.140688+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:13:00.563376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"189'8","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.348093+0000","last_change":"2023-10-07T08:53:48.123719+0000","last_active":"2023-10-07T08:53:49.348093+0000","last_peered":"2023-10-07T08:53:49.348093+0000","last_clean":"2023-10-07T08:53:49.348093+0000","last_became_active":"2023-10-07T08:53:48.121628+0000","last_became_peered":"2023-10-07T08:53:48.121628+0000","last_unstale":"2023-10-07T08:53:49.348093+0000","last_undegraded":"2023-10-07T08:53:49.348093+0000","last_fullsized":"2023-10-07T08:53:49.348093+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:28:34.326859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.137547+0000","last_change":"2023-10-07T08:53:49.137547+0000","last_active":"2023-10-07T08:53:49.137547+0000","last_peered":"2023-10-07T08:53:49.137547+0000","last_clean":"2023-10-07T08:53:49.137547+0000","last_became_active":"2023-10-07T08:53:49.137048+0000","last_became_peered":"2023-10-07T08:53:49.137048+0000","last_unstale":"2023-10-07T08:53:49.137547+0000","last_undegraded":"2023-10-07T08:53:49.137547+0000","last_fullsized":"2023-10-07T08:53:49.137547+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:03:03.683868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"189'1","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.129693+0000","last_change":"2023-10-07T08:53:48.127611+0000","last_active":"2023-10-07T08:53:49.129693+0000","last_peered":"2023-10-07T08:53:49.129693+0000","last_clean":"2023-10-07T08:53:49.129693+0000","last_became_active":"2023-10-07T08:53:48.127287+0000","last_became_peered":"2023-10-07T08:53:48.127287+0000","last_unstale":"2023-10-07T08:53:49.129693+0000","last_undegraded":"2023-10-07T08:53:49.129693+0000","last_fullsized":"2023-10-07T08:53:49.129693+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:38.735033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.142810+0000","last_change":"2023-10-07T08:53:49.142810+0000","last_active":"2023-10-07T08:53:49.142810+0000","last_peered":"2023-10-07T08:53:49.142810+0000","last_clean":"2023-10-07T08:53:49.142810+0000","last_became_active":"2023-10-07T08:53:49.142564+0000","last_became_peered":"2023-10-07T08:53:49.142564+0000","last_unstale":"2023-10-07T08:53:49.142810+0000","last_undegraded":"2023-10-07T08:53:49.142810+0000","last_fullsized":"2023-10-07T08:53:49.142810+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:44:20.661794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"189'2","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.346890+0000","last_change":"2023-10-07T08:53:48.126251+0000","last_active":"2023-10-07T08:53:49.346890+0000","last_peered":"2023-10-07T08:53:49.346890+0000","last_clean":"2023-10-07T08:53:49.346890+0000","last_became_active":"2023-10-07T08:53:48.125962+0000","last_became_peered":"2023-10-07T08:53:48.125962+0000","last_unstale":"2023-10-07T08:53:49.346890+0000","last_undegraded":"2023-10-07T08:53:49.346890+0000","last_fullsized":"2023-10-07T08:53:49.346890+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:32:51.058791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138387+0000","last_change":"2023-10-07T08:53:49.138387+0000","last_active":"2023-10-07T08:53:49.138387+0000","last_peered":"2023-10-07T08:53:49.138387+0000","last_clean":"2023-10-07T08:53:49.138387+0000","last_became_active":"2023-10-07T08:53:49.137932+0000","last_became_peered":"2023-10-07T08:53:49.137932+0000","last_unstale":"2023-10-07T08:53:49.138387+0000","last_undegraded":"2023-10-07T08:53:49.138387+0000","last_fullsized":"2023-10-07T08:53:49.138387+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:07.638681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"189'1","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.134147+0000","last_change":"2023-10-07T08:53:48.126556+0000","last_active":"2023-10-07T08:53:49.134147+0000","last_peered":"2023-10-07T08:53:49.134147+0000","last_clean":"2023-10-07T08:53:49.134147+0000","last_became_active":"2023-10-07T08:53:48.126035+0000","last_became_peered":"2023-10-07T08:53:48.126035+0000","last_unstale":"2023-10-07T08:53:49.134147+0000","last_undegraded":"2023-10-07T08:53:49.134147+0000","last_fullsized":"2023-10-07T08:53:49.134147+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:39.037927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.144324+0000","last_change":"2023-10-07T08:53:49.144324+0000","last_active":"2023-10-07T08:53:49.144324+0000","last_peered":"2023-10-07T08:53:49.144324+0000","last_clean":"2023-10-07T08:53:49.144324+0000","last_became_active":"2023-10-07T08:53:49.143920+0000","last_became_peered":"2023-10-07T08:53:49.143920+0000","last_unstale":"2023-10-07T08:53:49.144324+0000","last_undegraded":"2023-10-07T08:53:49.144324+0000","last_fullsized":"2023-10-07T08:53:49.144324+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:49:32.229160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.121881+0000","last_change":"2023-10-07T08:53:48.121795+0000","last_active":"2023-10-07T08:53:48.121881+0000","last_peered":"2023-10-07T08:53:48.121881+0000","last_clean":"2023-10-07T08:53:48.121881+0000","last_became_active":"2023-10-07T08:53:48.121550+0000","last_became_peered":"2023-10-07T08:53:48.121550+0000","last_unstale":"2023-10-07T08:53:48.121881+0000","last_undegraded":"2023-10-07T08:53:48.121881+0000","last_fullsized":"2023-10-07T08:53:48.121881+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:11:23.533334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.130109+0000","last_change":"2023-10-07T08:53:49.130109+0000","last_active":"2023-10-07T08:53:49.130109+0000","last_peered":"2023-10-07T08:53:49.130109+0000","last_clean":"2023-10-07T08:53:49.130109+0000","last_became_active":"2023-10-07T08:53:49.129867+0000","last_became_peered":"2023-10-07T08:53:49.129867+0000","last_unstale":"2023-10-07T08:53:49.130109+0000","last_undegraded":"2023-10-07T08:53:49.130109+0000","last_fullsized":"2023-10-07T08:53:49.130109+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:31:17.826847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"189'2","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.347878+0000","last_change":"2023-10-07T08:53:48.123971+0000","last_active":"2023-10-07T08:53:49.347878+0000","last_peered":"2023-10-07T08:53:49.347878+0000","last_clean":"2023-10-07T08:53:49.347878+0000","last_became_active":"2023-10-07T08:53:48.122953+0000","last_became_peered":"2023-10-07T08:53:48.122953+0000","last_unstale":"2023-10-07T08:53:49.347878+0000","last_undegraded":"2023-10-07T08:53:49.347878+0000","last_fullsized":"2023-10-07T08:53:49.347878+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:10.713230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.136802+0000","last_change":"2023-10-07T08:53:49.136802+0000","last_active":"2023-10-07T08:53:49.136802+0000","last_peered":"2023-10-07T08:53:49.136802+0000","last_clean":"2023-10-07T08:53:49.136802+0000","last_became_active":"2023-10-07T08:53:49.136287+0000","last_became_peered":"2023-10-07T08:53:49.136287+0000","last_unstale":"2023-10-07T08:53:49.136802+0000","last_undegraded":"2023-10-07T08:53:49.136802+0000","last_fullsized":"2023-10-07T08:53:49.136802+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:59:20.816980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.121703+0000","last_change":"2023-10-07T08:53:48.121589+0000","last_active":"2023-10-07T08:53:48.121703+0000","last_peered":"2023-10-07T08:53:48.121703+0000","last_clean":"2023-10-07T08:53:48.121703+0000","last_became_active":"2023-10-07T08:53:48.121352+0000","last_became_peered":"2023-10-07T08:53:48.121352+0000","last_unstale":"2023-10-07T08:53:48.121703+0000","last_undegraded":"2023-10-07T08:53:48.121703+0000","last_fullsized":"2023-10-07T08:53:48.121703+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:59:33.586117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.142011+0000","last_change":"2023-10-07T08:53:49.142011+0000","last_active":"2023-10-07T08:53:49.142011+0000","last_peered":"2023-10-07T08:53:49.142011+0000","last_clean":"2023-10-07T08:53:49.142011+0000","last_became_active":"2023-10-07T08:53:49.141422+0000","last_became_peered":"2023-10-07T08:53:49.141422+0000","last_unstale":"2023-10-07T08:53:49.142011+0000","last_undegraded":"2023-10-07T08:53:49.142011+0000","last_fullsized":"2023-10-07T08:53:49.142011+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:56.391673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.126767+0000","last_change":"2023-10-07T08:53:48.126706+0000","last_active":"2023-10-07T08:53:48.126767+0000","last_peered":"2023-10-07T08:53:48.126767+0000","last_clean":"2023-10-07T08:53:48.126767+0000","last_became_active":"2023-10-07T08:53:48.126478+0000","last_became_peered":"2023-10-07T08:53:48.126478+0000","last_unstale":"2023-10-07T08:53:48.126767+0000","last_undegraded":"2023-10-07T08:53:48.126767+0000","last_fullsized":"2023-10-07T08:53:48.126767+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:05.678830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.135994+0000","last_change":"2023-10-07T08:53:49.135994+0000","last_active":"2023-10-07T08:53:49.135994+0000","last_peered":"2023-10-07T08:53:49.135994+0000","last_clean":"2023-10-07T08:53:49.135994+0000","last_became_active":"2023-10-07T08:53:49.135758+0000","last_became_peered":"2023-10-07T08:53:49.135758+0000","last_unstale":"2023-10-07T08:53:49.135994+0000","last_undegraded":"2023-10-07T08:53:49.135994+0000","last_fullsized":"2023-10-07T08:53:49.135994+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:47:42.627268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.126790+0000","last_change":"2023-10-07T08:53:48.126709+0000","last_active":"2023-10-07T08:53:48.126790+0000","last_peered":"2023-10-07T08:53:48.126790+0000","last_clean":"2023-10-07T08:53:48.126790+0000","last_became_active":"2023-10-07T08:53:48.126299+0000","last_became_peered":"2023-10-07T08:53:48.126299+0000","last_unstale":"2023-10-07T08:53:48.126790+0000","last_undegraded":"2023-10-07T08:53:48.126790+0000","last_fullsized":"2023-10-07T08:53:48.126790+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:09.057999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.136293+0000","last_change":"2023-10-07T08:53:49.136293+0000","last_active":"2023-10-07T08:53:49.136293+0000","last_peered":"2023-10-07T08:53:49.136293+0000","last_clean":"2023-10-07T08:53:49.136293+0000","last_became_active":"2023-10-07T08:53:49.135665+0000","last_became_peered":"2023-10-07T08:53:49.135665+0000","last_unstale":"2023-10-07T08:53:49.136293+0000","last_undegraded":"2023-10-07T08:53:49.136293+0000","last_fullsized":"2023-10-07T08:53:49.136293+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:45.868381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"189'2","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.346336+0000","last_change":"2023-10-07T08:53:48.123494+0000","last_active":"2023-10-07T08:53:49.346336+0000","last_peered":"2023-10-07T08:53:49.346336+0000","last_clean":"2023-10-07T08:53:49.346336+0000","last_became_active":"2023-10-07T08:53:48.123244+0000","last_became_peered":"2023-10-07T08:53:48.123244+0000","last_unstale":"2023-10-07T08:53:49.346336+0000","last_undegraded":"2023-10-07T08:53:49.346336+0000","last_fullsized":"2023-10-07T08:53:49.346336+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:37:53.546571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.135898+0000","last_change":"2023-10-07T08:53:49.135898+0000","last_active":"2023-10-07T08:53:49.135898+0000","last_peered":"2023-10-07T08:53:49.135898+0000","last_clean":"2023-10-07T08:53:49.135898+0000","last_became_active":"2023-10-07T08:53:49.135661+0000","last_became_peered":"2023-10-07T08:53:49.135661+0000","last_unstale":"2023-10-07T08:53:49.135898+0000","last_undegraded":"2023-10-07T08:53:49.135898+0000","last_fullsized":"2023-10-07T08:53:49.135898+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:20.597343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.126326+0000","last_change":"2023-10-07T08:53:48.125824+0000","last_active":"2023-10-07T08:53:48.126326+0000","last_peered":"2023-10-07T08:53:48.126326+0000","last_clean":"2023-10-07T08:53:48.126326+0000","last_became_active":"2023-10-07T08:53:48.125527+0000","last_became_peered":"2023-10-07T08:53:48.125527+0000","last_unstale":"2023-10-07T08:53:48.126326+0000","last_undegraded":"2023-10-07T08:53:48.126326+0000","last_fullsized":"2023-10-07T08:53:48.126326+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:47:41.622896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.139828+0000","last_change":"2023-10-07T08:53:49.139828+0000","last_active":"2023-10-07T08:53:49.139828+0000","last_peered":"2023-10-07T08:53:49.139828+0000","last_clean":"2023-10-07T08:53:49.139828+0000","last_became_active":"2023-10-07T08:53:49.139402+0000","last_became_peered":"2023-10-07T08:53:49.139402+0000","last_unstale":"2023-10-07T08:53:49.139828+0000","last_undegraded":"2023-10-07T08:53:49.139828+0000","last_fullsized":"2023-10-07T08:53:49.139828+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:45:56.342074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.126425+0000","last_change":"2023-10-07T08:53:48.126230+0000","last_active":"2023-10-07T08:53:48.126425+0000","last_peered":"2023-10-07T08:53:48.126425+0000","last_clean":"2023-10-07T08:53:48.126425+0000","last_became_active":"2023-10-07T08:53:48.125449+0000","last_became_peered":"2023-10-07T08:53:48.125449+0000","last_unstale":"2023-10-07T08:53:48.126425+0000","last_undegraded":"2023-10-07T08:53:48.126425+0000","last_fullsized":"2023-10-07T08:53:48.126425+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:27:31.085235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138438+0000","last_change":"2023-10-07T08:53:49.138438+0000","last_active":"2023-10-07T08:53:49.138438+0000","last_peered":"2023-10-07T08:53:49.138438+0000","last_clean":"2023-10-07T08:53:49.138438+0000","last_became_active":"2023-10-07T08:53:49.137724+0000","last_became_peered":"2023-10-07T08:53:49.137724+0000","last_unstale":"2023-10-07T08:53:49.138438+0000","last_undegraded":"2023-10-07T08:53:49.138438+0000","last_fullsized":"2023-10-07T08:53:49.138438+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:30.483480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.126757+0000","last_change":"2023-10-07T08:53:48.126686+0000","last_active":"2023-10-07T08:53:48.126757+0000","last_peered":"2023-10-07T08:53:48.126757+0000","last_clean":"2023-10-07T08:53:48.126757+0000","last_became_active":"2023-10-07T08:53:48.126293+0000","last_became_peered":"2023-10-07T08:53:48.126293+0000","last_unstale":"2023-10-07T08:53:48.126757+0000","last_undegraded":"2023-10-07T08:53:48.126757+0000","last_fullsized":"2023-10-07T08:53:48.126757+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:43:58.516138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.135350+0000","last_change":"2023-10-07T08:53:49.135350+0000","last_active":"2023-10-07T08:53:49.135350+0000","last_peered":"2023-10-07T08:53:49.135350+0000","last_clean":"2023-10-07T08:53:49.135350+0000","last_became_active":"2023-10-07T08:53:49.135000+0000","last_became_peered":"2023-10-07T08:53:49.135000+0000","last_unstale":"2023-10-07T08:53:49.135350+0000","last_undegraded":"2023-10-07T08:53:49.135350+0000","last_fullsized":"2023-10-07T08:53:49.135350+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:10.062371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.127171+0000","last_change":"2023-10-07T08:53:48.126920+0000","last_active":"2023-10-07T08:53:48.127171+0000","last_peered":"2023-10-07T08:53:48.127171+0000","last_clean":"2023-10-07T08:53:48.127171+0000","last_became_active":"2023-10-07T08:53:48.126670+0000","last_became_peered":"2023-10-07T08:53:48.126670+0000","last_unstale":"2023-10-07T08:53:48.127171+0000","last_undegraded":"2023-10-07T08:53:48.127171+0000","last_fullsized":"2023-10-07T08:53:48.127171+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:06:26.189247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.143250+0000","last_change":"2023-10-07T08:53:49.143250+0000","last_active":"2023-10-07T08:53:49.143250+0000","last_peered":"2023-10-07T08:53:49.143250+0000","last_clean":"2023-10-07T08:53:49.143250+0000","last_became_active":"2023-10-07T08:53:49.142808+0000","last_became_peered":"2023-10-07T08:53:49.142808+0000","last_unstale":"2023-10-07T08:53:49.143250+0000","last_undegraded":"2023-10-07T08:53:49.143250+0000","last_fullsized":"2023-10-07T08:53:49.143250+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:23.838230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.125432+0000","last_change":"2023-10-07T08:53:48.125375+0000","last_active":"2023-10-07T08:53:48.125432+0000","last_peered":"2023-10-07T08:53:48.125432+0000","last_clean":"2023-10-07T08:53:48.125432+0000","last_became_active":"2023-10-07T08:53:48.122435+0000","last_became_peered":"2023-10-07T08:53:48.122435+0000","last_unstale":"2023-10-07T08:53:48.125432+0000","last_undegraded":"2023-10-07T08:53:48.125432+0000","last_fullsized":"2023-10-07T08:53:48.125432+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:24:17.883037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138917+0000","last_change":"2023-10-07T08:53:49.138917+0000","last_active":"2023-10-07T08:53:49.138917+0000","last_peered":"2023-10-07T08:53:49.138917+0000","last_clean":"2023-10-07T08:53:49.138917+0000","last_became_active":"2023-10-07T08:53:49.138702+0000","last_became_peered":"2023-10-07T08:53:49.138702+0000","last_unstale":"2023-10-07T08:53:49.138917+0000","last_undegraded":"2023-10-07T08:53:49.138917+0000","last_fullsized":"2023-10-07T08:53:49.138917+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:32:14.154751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.123298+0000","last_change":"2023-10-07T08:53:48.123052+0000","last_active":"2023-10-07T08:53:48.123298+0000","last_peered":"2023-10-07T08:53:48.123298+0000","last_clean":"2023-10-07T08:53:48.123298+0000","last_became_active":"2023-10-07T08:53:48.122754+0000","last_became_peered":"2023-10-07T08:53:48.122754+0000","last_unstale":"2023-10-07T08:53:48.123298+0000","last_undegraded":"2023-10-07T08:53:48.123298+0000","last_fullsized":"2023-10-07T08:53:48.123298+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:26:42.959416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.131379+0000","last_change":"2023-10-07T08:53:49.131379+0000","last_active":"2023-10-07T08:53:49.131379+0000","last_peered":"2023-10-07T08:53:49.131379+0000","last_clean":"2023-10-07T08:53:49.131379+0000","last_became_active":"2023-10-07T08:53:49.131110+0000","last_became_peered":"2023-10-07T08:53:49.131110+0000","last_unstale":"2023-10-07T08:53:49.131379+0000","last_undegraded":"2023-10-07T08:53:49.131379+0000","last_fullsized":"2023-10-07T08:53:49.131379+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:06.683202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.125655+0000","last_change":"2023-10-07T08:53:48.125445+0000","last_active":"2023-10-07T08:53:48.125655+0000","last_peered":"2023-10-07T08:53:48.125655+0000","last_clean":"2023-10-07T08:53:48.125655+0000","last_became_active":"2023-10-07T08:53:48.124919+0000","last_became_peered":"2023-10-07T08:53:48.124919+0000","last_unstale":"2023-10-07T08:53:48.125655+0000","last_undegraded":"2023-10-07T08:53:48.125655+0000","last_fullsized":"2023-10-07T08:53:48.125655+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:12:59.559004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.139056+0000","last_change":"2023-10-07T08:53:49.139056+0000","last_active":"2023-10-07T08:53:49.139056+0000","last_peered":"2023-10-07T08:53:49.139056+0000","last_clean":"2023-10-07T08:53:49.139056+0000","last_became_active":"2023-10-07T08:53:49.138817+0000","last_became_peered":"2023-10-07T08:53:49.138817+0000","last_unstale":"2023-10-07T08:53:49.139056+0000","last_undegraded":"2023-10-07T08:53:49.139056+0000","last_fullsized":"2023-10-07T08:53:49.139056+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:56.391673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.125052+0000","last_change":"2023-10-07T08:53:48.124826+0000","last_active":"2023-10-07T08:53:48.125052+0000","last_peered":"2023-10-07T08:53:48.125052+0000","last_clean":"2023-10-07T08:53:48.125052+0000","last_became_active":"2023-10-07T08:53:48.124478+0000","last_became_peered":"2023-10-07T08:53:48.124478+0000","last_unstale":"2023-10-07T08:53:48.125052+0000","last_undegraded":"2023-10-07T08:53:48.125052+0000","last_fullsized":"2023-10-07T08:53:48.125052+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:05.678830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":304,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.119036+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:53:48.119036+0000","last_peered":"2023-10-07T08:53:48.119036+0000","last_clean":"2023-10-07T08:53:48.119036+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:53:48.119036+0000","last_undegraded":"2023-10-07T08:53:48.119036+0000","last_fullsized":"2023-10-07T08:53:48.119036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574983,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1610,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193701,"statfs":{"total":200000000,"available":198350337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:53:01 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.498,"15min":0.502},"min":{"1min":0.26200000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":1.2150000000000001},"last":0.52600000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:53:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.53600000000000003,"15min":0.52700000000000002},"min":{"1min":0.42399999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56000000000000005,"15min":0.55100000000000005},"min":{"1min":0.434,"5min":0.38900000000000001,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.77200000000000002,"15min":1.1659999999999999},"last":0.628}]},{"osd":2,"last update":"Sat Oct 7 08:53:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53600000000000003,"15min":0.53100000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75,"5min":0.75,"15min":0.80300000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52100000000000002,"15min":0.504},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.33500000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.75},"last":0.48299999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:53:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.55400000000000005,"15min":0.69299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":6.8570000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.41599999999999998,"15min":0.37},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.98999999999999999},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:53:01 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47299999999999998,"15min":0.47599999999999998},"min":{"1min":0.316,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.98599999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26700000000000002},"max":{"1min":0.746,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.49199999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:53:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.495,"15min":0.5},"min":{"1min":0.30599999999999999,"5min":0.30499999999999999,"15min":0.27800000000000002},"max":{"1min":0.71999999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.443},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55500000000000005,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.76400000000000001,"5min":0.78300000000000003,"15min":1.0669999999999999},"last":0.55900000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:53:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56599999999999995,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.34599999999999997},"max":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":1.1020000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57699999999999996,"15min":0.56499999999999995},"min":{"1min":0.39700000000000002,"5min":0.374,"15min":0.307},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.40600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574983,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1032,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194280,"statfs":{"total":200000000,"available":198942933,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51100000000000001,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.25700000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.76600000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51100000000000001,"15min":0.499},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.30199999999999999},"max":{"1min":0.65900000000000003,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57099999999999995}]},{"osd":1,"last update":"Sat Oct 7 08:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56399999999999995,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32500000000000001},"max":{"1min":0.67800000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.54600000000000004},"min":{"1min":0.46400000000000002,"5min":0.32100000000000001,"15min":0.29799999999999999},"max":{"1min":0.69999999999999996,"5min":0.754,"15min":1.0069999999999999},"last":0.54100000000000004}]},{"osd":2,"last update":"Sat Oct 7 08:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55000000000000004,"15min":0.51200000000000001},"min":{"1min":0.39800000000000002,"5min":0.36899999999999999,"15min":0.29399999999999998},"max":{"1min":0.72399999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":0.65700000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.56299999999999994}]},{"osd":3,"last update":"Sat Oct 7 08:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53400000000000003,"15min":0.51900000000000002},"min":{"1min":0.318,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70399999999999996,"5min":0.751,"15min":0.752},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64000000000000001,"5min":0.83199999999999996,"15min":2.3879999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Sat Oct 7 08:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45500000000000002,"15min":0.47099999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.73699999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48399999999999999,"15min":0.49299999999999999},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.27400000000000002},"max":{"1min":0.65900000000000003,"5min":0.76300000000000001,"15min":0.79900000000000004},"last":0.47699999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47999999999999998,"15min":0.5},"min":{"1min":0.34000000000000002,"5min":0.30399999999999999,"15min":0.30099999999999999},"max":{"1min":0.68500000000000005,"5min":0.73899999999999999,"15min":0.86799999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33400000000000002},"max":{"1min":0.74299999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.5}]},{"osd":7,"last update":"Sat Oct 7 08:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51900000000000002,"15min":0.52600000000000002},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.312},"max":{"1min":0.76500000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.36299999999999999,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.79000000000000004,"15min":1.052},"last":0.65900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1032,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194280,"statfs":{"total":200000000,"available":198942921,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.33800000000000002,"15min":0.32700000000000001},"min":{"1min":0.22700000000000001,"5min":0.193,"15min":0.17499999999999999},"max":{"1min":0.438,"5min":0.60399999999999998,"15min":1.9359999999999999},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.36799999999999999,"15min":0.34599999999999997},"min":{"1min":0.247,"5min":0.221,"15min":0.192},"max":{"1min":0.42699999999999999,"5min":0.61599999999999999,"15min":0.82999999999999996},"last":0.29999999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.35199999999999998,"15min":0.33600000000000002},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.19600000000000001},"max":{"1min":0.38400000000000001,"5min":0.57799999999999996,"15min":1.639},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.38600000000000001,"15min":0.35899999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.22500000000000001},"max":{"1min":0.45600000000000002,"5min":0.69599999999999995,"15min":1.9039999999999999},"last":0.316}]},{"osd":3,"last update":"Sat Oct 7 08:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40500000000000003,"15min":0.38100000000000001},"min":{"1min":0.29499999999999998,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":0.41799999999999998,"5min":0.64500000000000002,"15min":1.6819999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39600000000000002,"15min":0.37},"min":{"1min":0.27600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.44400000000000001,"5min":0.63800000000000001,"15min":0.97599999999999998},"last":0.33400000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56699999999999995,"15min":0.55100000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33600000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.91600000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.55100000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.28599999999999998},"max":{"1min":0.746,"5min":0.86399999999999999,"15min":1.9570000000000001},"last":0.629}]},{"osd":5,"last update":"Sat Oct 7 08:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.62,"15min":0.59199999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81499999999999995,"5min":0.98199999999999998,"15min":1.0409999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.623,"15min":0.59199999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36599999999999999},"max":{"1min":0.85999999999999999,"5min":0.89600000000000002,"15min":0.97299999999999998},"last":0.64200000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59299999999999997,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.379,"15min":0.34200000000000003},"max":{"1min":0.84399999999999997,"5min":0.94299999999999995,"15min":1.2150000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60199999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.87},"last":0.55000000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63400000000000001,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.35699999999999998},"max":{"1min":0.79400000000000004,"5min":1.004,"15min":1.0800000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.64300000000000002,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.46100000000000002,"15min":0.40799999999999997},"max":{"1min":0.90100000000000002,"5min":0.92700000000000005,"15min":0.94299999999999995},"last":0.66800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574983,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193710,"statfs":{"total":200000000,"available":198359350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.224,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.58299999999999996,"5min":0.71099999999999997,"15min":1.4339999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.376,"15min":0.38500000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":1.079},"last":0.32800000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":1.464},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39300000000000002,"15min":0.39700000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.21299999999999999},"max":{"1min":0.58199999999999996,"5min":0.627,"15min":1.1060000000000001},"last":0.375}]},{"osd":3,"last update":"Sat Oct 7 08:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.376,"15min":0.38},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.23300000000000001},"max":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":1.341},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42199999999999999,"15min":0.42899999999999999},"min":{"1min":0.313,"5min":0.28000000000000003,"15min":0.25700000000000001},"max":{"1min":0.55600000000000005,"5min":0.65700000000000003,"15min":1.532},"last":0.34899999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.3169999999999999},"last":0.496},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34699999999999998},"max":{"1min":0.77100000000000002,"5min":0.84999999999999998,"15min":1.51},"last":0.60299999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61499999999999999,"15min":0.60399999999999998},"min":{"1min":0.35799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91400000000000003,"5min":0.92300000000000004,"15min":1.0529999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.75700000000000001,"5min":0.91000000000000003,"15min":1.25},"last":0.54300000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60799999999999998,"15min":0.60699999999999998},"min":{"1min":0.39700000000000002,"5min":0.38600000000000001,"15min":0.376},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.488},"last":0.502},{"interface":"front","average":{"1min":0.624,"5min":0.625,"15min":0.60799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.39000000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.024},"last":0.61799999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.627,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.42599999999999999,"15min":0.41999999999999998},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":0.98499999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61799999999999999,"15min":0.61099999999999999},"min":{"1min":0.40899999999999997,"5min":0.375,"15min":0.374},"max":{"1min":0.81399999999999995,"5min":0.84099999999999997,"15min":1.288},"last":0.63400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1032,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194280,"statfs":{"total":200000000,"available":198942865,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.33000000000000002,"15min":0.33700000000000002},"min":{"1min":0.19400000000000001,"5min":0.192,"15min":0.17699999999999999},"max":{"1min":0.46899999999999997,"5min":0.55700000000000005,"15min":1.665},"last":0.251},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.35999999999999999,"15min":0.36099999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.497,"5min":0.63400000000000001,"15min":1.579},"last":0.30199999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35999999999999999,"15min":0.374},"min":{"1min":0.216,"5min":0.216,"15min":0.20499999999999999},"max":{"1min":0.48299999999999998,"5min":0.54800000000000004,"15min":2.4470000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41099999999999998,"15min":0.42299999999999999},"min":{"1min":0.27800000000000002,"5min":0.20999999999999999,"15min":0.20200000000000001},"max":{"1min":0.55400000000000005,"5min":0.65000000000000002,"15min":2.4620000000000002},"last":0.34899999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.40200000000000002,"15min":0.39500000000000002},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.53300000000000003,"5min":0.56999999999999995,"15min":1.454},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39100000000000001,"15min":0.39000000000000001},"min":{"1min":0.255,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.51800000000000002,"5min":0.59799999999999998,"15min":1.6919999999999999},"last":0.33600000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.58199999999999996},"min":{"1min":0.40899999999999997,"5min":0.33500000000000002,"15min":0.28199999999999997},"max":{"1min":0.81299999999999994,"5min":0.90500000000000003,"15min":1.7210000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.90200000000000002,"15min":1.5549999999999999},"last":0.56399999999999995}]},{"osd":5,"last update":"Sat Oct 7 08:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57599999999999996,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":0.95199999999999996,"15min":1.5269999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.311},"max":{"1min":0.78900000000000003,"5min":0.88900000000000001,"15min":1.4039999999999999},"last":0.5}]},{"osd":6,"last update":"Sat Oct 7 08:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59299999999999997,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.79000000000000004,"5min":0.93999999999999995,"15min":1.3380000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.59099999999999997},"min":{"1min":0.371,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85199999999999998,"5min":0.86099999999999999,"15min":1.637},"last":0.46500000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.379},"max":{"1min":0.86399999999999999,"5min":0.97499999999999998,"15min":1.49},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64100000000000001,"15min":0.61899999999999999},"min":{"1min":0.45600000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83099999999999996,"5min":0.96999999999999997,"15min":1.375},"last":0.45800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1032,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194280,"statfs":{"total":200000000,"available":198942921,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:53:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.312,"15min":0.32800000000000001},"min":{"1min":0.23799999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.49199999999999999,"5min":0.56499999999999995,"15min":1.8220000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.34599999999999997,"15min":0.33400000000000002},"min":{"1min":0.245,"5min":0.22,"15min":0.22},"max":{"1min":0.53600000000000003,"5min":0.57699999999999996,"15min":0.93500000000000005},"last":0.26200000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:53:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35999999999999999,"15min":0.36299999999999999},"min":{"1min":0.23200000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.6519999999999999},"last":0.25},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.40200000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.22500000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":1.885},"last":0.35699999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:53:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.28499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.54200000000000004,"5min":0.56200000000000006,"15min":1.274},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39400000000000002,"15min":0.40300000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":1.8999999999999999},"last":0.38300000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:53:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.53500000000000003},"min":{"1min":0.42199999999999999,"5min":0.36499999999999999,"15min":0.29999999999999999},"max":{"1min":0.81499999999999995,"5min":0.81699999999999995,"15min":0.82799999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58299999999999996,"15min":0.55800000000000005},"min":{"1min":0.434,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76100000000000001,"5min":0.90000000000000002,"15min":1.3109999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Sat Oct 7 08:53:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57599999999999996,"15min":0.56100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35999999999999999},"max":{"1min":0.72599999999999998,"5min":0.85799999999999998,"15min":1.1639999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.78900000000000003,"5min":0.89000000000000001,"15min":1.851},"last":0.56899999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:53:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61899999999999999,"15min":0.58599999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.34899999999999998},"max":{"1min":0.79200000000000004,"5min":0.91000000000000003,"15min":0.92700000000000005},"last":0.497},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.625,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.79500000000000004,"5min":0.94399999999999995,"15min":1.1930000000000001},"last":0.57699999999999996}]},{"osd":7,"last update":"Sat Oct 7 08:53:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.47299999999999998,"5min":0.41499999999999998,"15min":0.39700000000000002},"max":{"1min":0.81999999999999995,"5min":0.93200000000000005,"15min":1.8700000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59799999999999998,"15min":0.57699999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75600000000000001,"5min":0.85099999999999998,"15min":0.88400000000000001},"last":0.59299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574983,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1033,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198941349,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.247},"max":{"1min":0.67100000000000004,"5min":0.89300000000000002,"15min":1.9419999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53400000000000003,"15min":0.52200000000000002},"min":{"1min":0.34899999999999998,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":1.6879999999999999},"last":0.73499999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51800000000000002,"15min":0.51200000000000001},"min":{"1min":0.38400000000000001,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":0.68000000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28000000000000003},"max":{"1min":0.74199999999999999,"5min":0.81100000000000005,"15min":1.3580000000000001},"last":0.68600000000000005}]},{"osd":2,"last update":"Sat Oct 7 08:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.27800000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":2.1520000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.46700000000000003,"5min":0.376,"15min":0.30599999999999999},"max":{"1min":0.755,"5min":0.755,"15min":1.29},"last":0.746}]},{"osd":3,"last update":"Sat Oct 7 08:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.29999999999999999},"max":{"1min":0.77300000000000002,"5min":0.91400000000000003,"15min":2.052},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.55300000000000005},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78700000000000003,"15min":1.369},"last":0.71199999999999997}]},{"osd":5,"last update":"Sat Oct 7 08:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44600000000000001,"15min":0.44900000000000001},"min":{"1min":0.33700000000000002,"5min":0.29099999999999998,"15min":0.27000000000000002},"max":{"1min":0.628,"5min":0.75800000000000001,"15min":0.89000000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.33500000000000002,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.72599999999999998,"5min":0.88,"15min":0.88},"last":0.54300000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51000000000000001,"15min":0.52200000000000002},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71199999999999997,"5min":0.85899999999999999,"15min":1.0049999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53300000000000003,"15min":0.53800000000000003},"min":{"1min":0.40600000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.95599999999999996},"last":0.64200000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52200000000000002,"15min":0.54300000000000004},"min":{"1min":0.38,"5min":0.31,"15min":0.30099999999999999},"max":{"1min":0.63400000000000001,"5min":0.83899999999999997,"15min":0.98899999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.36599999999999999,"15min":0.33300000000000002},"max":{"1min":0.69399999999999995,"5min":0.90200000000000002,"15min":0.91300000000000003},"last":0.60199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574983,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1032,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194279,"statfs":{"total":200000000,"available":198942379,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.34200000000000003,"5min":0.311,"15min":0.26200000000000001},"max":{"1min":0.68600000000000005,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.68899999999999995}]},{"osd":1,"last update":"Sat Oct 7 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.51400000000000001},"min":{"1min":0.372,"5min":0.33300000000000002,"15min":0.25},"max":{"1min":0.63,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.84599999999999997,"15min":0.63700000000000001},"min":{"1min":0.39000000000000001,"5min":0.375,"15min":0.27000000000000002},"max":{"1min":0.64300000000000002,"5min":29.143999999999998,"15min":29.143999999999998},"last":0.70599999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.31,"15min":0.26800000000000002},"max":{"1min":0.70499999999999996,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53700000000000003,"15min":0.54000000000000004},"min":{"1min":0.42099999999999999,"5min":0.34699999999999998,"15min":0.309},"max":{"1min":0.68799999999999994,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.67600000000000005}]},{"osd":3,"last update":"Sat Oct 7 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.39000000000000001,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.68999999999999995,"5min":0.82099999999999995,"15min":0.90200000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78700000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.72899999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45800000000000002,"15min":0.47199999999999998},"min":{"1min":0.28999999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.65400000000000003,"5min":0.80700000000000005,"15min":0.93500000000000005},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55600000000000005,"15min":0.57899999999999996},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.748,"5min":0.80800000000000005,"15min":0.80900000000000005},"last":0.58899999999999997}]},{"osd":6,"last update":"Sat Oct 7 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.49299999999999999,"15min":0.52300000000000002},"min":{"1min":0.30599999999999999,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":0.70599999999999996,"5min":0.79100000000000004,"15min":0.81399999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.42899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.55600000000000005},"min":{"1min":0.33800000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.71199999999999997,"5min":0.73199999999999998,"15min":0.93100000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54500000000000004,"15min":0.57299999999999995},"min":{"1min":0.35999999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72099999999999997,"5min":0.84299999999999997,"15min":0.91100000000000003},"last":0.498}]}]}],"pool_statfs":[]}} 2023-10-07T08:53:53.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:53:53.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.537+0000 7f68b759e700 1 Processor -- start 2023-10-07T08:53:53.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.537+0000 7f68b759e700 1 -- start start 2023-10-07T08:53:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.538+0000 7f68b759e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b8159f10 0x7f68b8068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.538+0000 7f68b759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68b8068cc0 0x7f68b80cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.538+0000 7f68b759e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b80cee10 con 0x7f68b8159b40 2023-10-07T08:53:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.538+0000 7f68b759e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b8069140 con 0x7f68b8068cc0 2023-10-07T08:53:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.538+0000 7f68b759e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b80cd040 con 0x7f68b8159f10 2023-10-07T08:53:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.538+0000 7f68b6d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68b8068cc0 0x7f68b80cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.538+0000 7f68b659c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f68b8159b40 0x7f68b80cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58182/0 (socket says 172.21.15.81:58182) 2023-10-07T08:53:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.538+0000 7f68b659c700 1 -- 172.21.15.81:0/981572702 learned_addr learned my addr 172.21.15.81:0/981572702 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.538+0000 7f68add9b700 1 --2- 172.21.15.81:0/981572702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b8159f10 0x7f68b8068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.538+0000 7f68b6d9d700 1 -- 172.21.15.81:0/981572702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b8159f10 msgr2=0x7f68b8068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.538+0000 7f68b6d9d700 1 --2- 172.21.15.81:0/981572702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b8159f10 0x7f68b8068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.538+0000 7f68b6d9d700 1 -- 172.21.15.81:0/981572702 >> v1:172.21.15.81:6789/0 conn(0x7f68b8159b40 legacy=0x7f68b80cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.538+0000 7f68b5d9b700 1 -- 172.21.15.81:0/981572702 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076608256 0 0) 0x7f68b80cee10 con 0x7f68b8159b40 2023-10-07T08:53:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.538+0000 7f68b6d9d700 1 -- 172.21.15.81:0/981572702 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b80cd320 con 0x7f68b8068cc0 2023-10-07T08:53:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.538+0000 7f68b6d9d700 1 --2- 172.21.15.81:0/981572702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b8068cc0 0x7f68b80cf2a0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009e60 tx=0x7f68b0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a784c6675e4ab1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.539+0000 7f68b5d9b700 1 -- 172.21.15.81:0/981572702 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b000e070 con 0x7f68b8068cc0 2023-10-07T08:53:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.539+0000 7f68b5d9b700 1 -- 172.21.15.81:0/981572702 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b000bc30 con 0x7f68b8068cc0 2023-10-07T08:53:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.539+0000 7f68b5d9b700 1 -- 172.21.15.81:0/981572702 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0012430 con 0x7f68b8068cc0 2023-10-07T08:53:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.539+0000 7f68b759e700 1 -- 172.21.15.81:0/981572702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b8068cc0 msgr2=0x7f68b80cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.539+0000 7f68b759e700 1 --2- 172.21.15.81:0/981572702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b8068cc0 0x7f68b80cf2a0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009e60 tx=0x7f68b0009780 comp rx=0 tx=0).stop 2023-10-07T08:53:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.539+0000 7f68b759e700 1 -- 172.21.15.81:0/981572702 shutdown_connections 2023-10-07T08:53:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.539+0000 7f68b759e700 1 --2- 172.21.15.81:0/981572702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b8068cc0 0x7f68b80cf2a0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.539+0000 7f68b759e700 1 --2- 172.21.15.81:0/981572702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b8159f10 0x7f68b8068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.539+0000 7f68b759e700 1 -- 172.21.15.81:0/981572702 >> 172.21.15.81:0/981572702 conn(0x7f68b80cd660 msgr2=0x7f68b80cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.539+0000 7f68b759e700 1 -- 172.21.15.81:0/981572702 shutdown_connections 2023-10-07T08:53:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.539+0000 7f68b759e700 1 -- 172.21.15.81:0/981572702 wait complete. 2023-10-07T08:53:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.540+0000 7f68b759e700 1 Processor -- start 2023-10-07T08:53:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.540+0000 7f68b759e700 1 -- start start 2023-10-07T08:53:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.541+0000 7f68b759e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68b8068cc0 0x7f68b81538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.541+0000 7f68b759e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b8159b40 0x7f68b815cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.541+0000 7f68b759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b8159f10 0x7f68b80b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.541+0000 7f68b759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b80c8b90 con 0x7f68b8159f10 2023-10-07T08:53:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.541+0000 7f68b759e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b815c710 con 0x7f68b8068cc0 2023-10-07T08:53:53.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.541+0000 7f68b759e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b80c7ca0 con 0x7f68b8159b40 2023-10-07T08:53:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.541+0000 7f68b6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b8159f10 0x7f68b80b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.541+0000 7f68b6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b8159f10 0x7f68b80b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45194/0 (socket says 172.21.15.81:45194) 2023-10-07T08:53:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.541+0000 7f68b6d9d700 1 -- 172.21.15.81:0/2569477327 learned_addr learned my addr 172.21.15.81:0/2569477327 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.541+0000 7f68add9b700 1 --2- 172.21.15.81:0/2569477327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b8159b40 0x7f68b815cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.541+0000 7f68b659c700 1 --2- 172.21.15.81:0/2569477327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68b8068cc0 0x7f68b81538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.542+0000 7f68b6d9d700 1 -- 172.21.15.81:0/2569477327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b8159b40 msgr2=0x7f68b815cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.542+0000 7f68b6d9d700 1 --2- 172.21.15.81:0/2569477327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b8159b40 0x7f68b815cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.542+0000 7f68b6d9d700 1 -- 172.21.15.81:0/2569477327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68b8068cc0 msgr2=0x7f68b81538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.542+0000 7f68b6d9d700 1 --2- 172.21.15.81:0/2569477327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68b8068cc0 0x7f68b81538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.542+0000 7f68b6d9d700 1 -- 172.21.15.81:0/2569477327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b0009a20 con 0x7f68b8159f10 2023-10-07T08:53:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.542+0000 7f68b6d9d700 1 --2- 172.21.15.81:0/2569477327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b8159f10 0x7f68b80b59a0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f68b0013000 tx=0x7f68b0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:53.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.542+0000 7f68aeffd700 1 -- 172.21.15.81:0/2569477327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0027470 con 0x7f68b8159f10 2023-10-07T08:53:53.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.542+0000 7f68aeffd700 1 -- 172.21.15.81:0/2569477327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b0027610 con 0x7f68b8159f10 2023-10-07T08:53:53.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.542+0000 7f68aeffd700 1 -- 172.21.15.81:0/2569477327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b00279d0 con 0x7f68b8159f10 2023-10-07T08:53:53.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.542+0000 7f68b759e700 1 -- 172.21.15.81:0/2569477327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b80c7f80 con 0x7f68b8159f10 2023-10-07T08:53:53.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.542+0000 7f68b759e700 1 -- 172.21.15.81:0/2569477327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b80c8540 con 0x7f68b8159f10 2023-10-07T08:53:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.543+0000 7f68b759e700 1 -- 172.21.15.81:0/2569477327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b8063e90 con 0x7f68b8159f10 2023-10-07T08:53:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.543+0000 7f68aeffd700 1 -- 172.21.15.81:0/2569477327 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68b0024070 con 0x7f68b8159f10 2023-10-07T08:53:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.544+0000 7f68aeffd700 1 --2- 172.21.15.81:0/2569477327 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6898066f30 0x7f68980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.544+0000 7f68aeffd700 1 -- 172.21.15.81:0/2569477327 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f68b0086c00 con 0x7f68b8159f10 2023-10-07T08:53:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.544+0000 7f68b659c700 1 --2- 172.21.15.81:0/2569477327 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6898066f30 0x7f68980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.544+0000 7f68b659c700 1 --2- 172.21.15.81:0/2569477327 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6898066f30 0x7f68980693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f68a8007fd0 tx=0x7f68a8007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.548+0000 7f68aeffd700 1 -- 172.21.15.81:0/2569477327 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68b008d080 con 0x7f68b8159f10 2023-10-07T08:53:53.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.727+0000 7f68b759e700 1 -- 172.21.15.81:0/2569477327 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68b80b67c0 con 0x7f6898066f30 2023-10-07T08:53:53.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.735+0000 7f68aeffd700 1 -- 172.21.15.81:0/2569477327 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285472 (secure 0 0 0) 0x7f68b80b67c0 con 0x7f6898066f30 2023-10-07T08:53:53.741 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:53.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.738+0000 7f68b759e700 1 -- 172.21.15.81:0/2569477327 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6898066f30 msgr2=0x7f68980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.738+0000 7f68b759e700 1 --2- 172.21.15.81:0/2569477327 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6898066f30 0x7f68980693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f68a8007fd0 tx=0x7f68a8007d30 comp rx=0 tx=0).stop 2023-10-07T08:53:53.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.738+0000 7f68b759e700 1 -- 172.21.15.81:0/2569477327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b8159f10 msgr2=0x7f68b80b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.738+0000 7f68b759e700 1 --2- 172.21.15.81:0/2569477327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b8159f10 0x7f68b80b59a0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f68b0013000 tx=0x7f68b0019000 comp rx=0 tx=0).stop 2023-10-07T08:53:53.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.738+0000 7f68b759e700 1 -- 172.21.15.81:0/2569477327 shutdown_connections 2023-10-07T08:53:53.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.738+0000 7f68b759e700 1 --2- 172.21.15.81:0/2569477327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b8159f10 0x7f68b80b59a0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.738+0000 7f68b759e700 1 --2- 172.21.15.81:0/2569477327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68b8068cc0 0x7f68b81538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.738+0000 7f68b759e700 1 --2- 172.21.15.81:0/2569477327 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6898066f30 0x7f68980693e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.738+0000 7f68b759e700 1 --2- 172.21.15.81:0/2569477327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68b8159b40 0x7f68b815cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.738+0000 7f68b759e700 1 -- 172.21.15.81:0/2569477327 >> 172.21.15.81:0/2569477327 conn(0x7f68b80cd660 msgr2=0x7f68b80c6510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:53.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.738+0000 7f68b759e700 1 -- 172.21.15.81:0/2569477327 shutdown_connections 2023-10-07T08:53:53.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.738+0000 7f68b759e700 1 -- 172.21.15.81:0/2569477327 wait complete. 2023-10-07T08:53:53.745 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:53:53.751 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":515,"stamp":"2023-10-07T08:53:52.150110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9409,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553090,"statfs":{"total":1600000000,"available":1590365055,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.040976"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.142154+0000","last_change":"2023-10-07T08:53:49.142154+0000","last_active":"2023-10-07T08:53:49.142154+0000","last_peered":"2023-10-07T08:53:49.142154+0000","last_clean":"2023-10-07T08:53:49.142154+0000","last_became_active":"2023-10-07T08:53:49.141782+0000","last_became_peered":"2023-10-07T08:53:49.141782+0000","last_unstale":"2023-10-07T08:53:49.142154+0000","last_undegraded":"2023-10-07T08:53:49.142154+0000","last_fullsized":"2023-10-07T08:53:49.142154+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:44.664036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.137456+0000","last_change":"2023-10-07T08:53:49.137456+0000","last_active":"2023-10-07T08:53:49.137456+0000","last_peered":"2023-10-07T08:53:49.137456+0000","last_clean":"2023-10-07T08:53:49.137456+0000","last_became_active":"2023-10-07T08:53:49.136292+0000","last_became_peered":"2023-10-07T08:53:49.136292+0000","last_unstale":"2023-10-07T08:53:49.137456+0000","last_undegraded":"2023-10-07T08:53:49.137456+0000","last_fullsized":"2023-10-07T08:53:49.137456+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:13:00.563376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.144423+0000","last_change":"2023-10-07T08:53:49.144423+0000","last_active":"2023-10-07T08:53:49.144423+0000","last_peered":"2023-10-07T08:53:49.144423+0000","last_clean":"2023-10-07T08:53:49.144423+0000","last_became_active":"2023-10-07T08:53:49.144040+0000","last_became_peered":"2023-10-07T08:53:49.144040+0000","last_unstale":"2023-10-07T08:53:49.144423+0000","last_undegraded":"2023-10-07T08:53:49.144423+0000","last_fullsized":"2023-10-07T08:53:49.144423+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:40:53.560121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.137318+0000","last_change":"2023-10-07T08:53:49.137318+0000","last_active":"2023-10-07T08:53:49.137318+0000","last_peered":"2023-10-07T08:53:49.137318+0000","last_clean":"2023-10-07T08:53:49.137318+0000","last_became_active":"2023-10-07T08:53:49.137099+0000","last_became_peered":"2023-10-07T08:53:49.137099+0000","last_unstale":"2023-10-07T08:53:49.137318+0000","last_undegraded":"2023-10-07T08:53:49.137318+0000","last_fullsized":"2023-10-07T08:53:49.137318+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:55.137729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.142805+0000","last_change":"2023-10-07T08:53:49.142805+0000","last_active":"2023-10-07T08:53:49.142805+0000","last_peered":"2023-10-07T08:53:49.142805+0000","last_clean":"2023-10-07T08:53:49.142805+0000","last_became_active":"2023-10-07T08:53:49.142591+0000","last_became_peered":"2023-10-07T08:53:49.142591+0000","last_unstale":"2023-10-07T08:53:49.142805+0000","last_undegraded":"2023-10-07T08:53:49.142805+0000","last_fullsized":"2023-10-07T08:53:49.142805+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:58.707774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.137172+0000","last_change":"2023-10-07T08:53:49.137172+0000","last_active":"2023-10-07T08:53:49.137172+0000","last_peered":"2023-10-07T08:53:49.137172+0000","last_clean":"2023-10-07T08:53:49.137172+0000","last_became_active":"2023-10-07T08:53:49.136924+0000","last_became_peered":"2023-10-07T08:53:49.136924+0000","last_unstale":"2023-10-07T08:53:49.137172+0000","last_undegraded":"2023-10-07T08:53:49.137172+0000","last_fullsized":"2023-10-07T08:53:49.137172+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:51:10.023724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.142233+0000","last_change":"2023-10-07T08:53:49.142233+0000","last_active":"2023-10-07T08:53:49.142233+0000","last_peered":"2023-10-07T08:53:49.142233+0000","last_clean":"2023-10-07T08:53:49.142233+0000","last_became_active":"2023-10-07T08:53:49.142090+0000","last_became_peered":"2023-10-07T08:53:49.142090+0000","last_unstale":"2023-10-07T08:53:49.142233+0000","last_undegraded":"2023-10-07T08:53:49.142233+0000","last_fullsized":"2023-10-07T08:53:49.142233+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:32:10.566791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.144718+0000","last_change":"2023-10-07T08:53:49.144718+0000","last_active":"2023-10-07T08:53:49.144718+0000","last_peered":"2023-10-07T08:53:49.144718+0000","last_clean":"2023-10-07T08:53:49.144718+0000","last_became_active":"2023-10-07T08:53:49.144457+0000","last_became_peered":"2023-10-07T08:53:49.144457+0000","last_unstale":"2023-10-07T08:53:49.144718+0000","last_undegraded":"2023-10-07T08:53:49.144718+0000","last_fullsized":"2023-10-07T08:53:49.144718+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:23.838230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.141519+0000","last_change":"2023-10-07T08:53:49.141519+0000","last_active":"2023-10-07T08:53:49.141519+0000","last_peered":"2023-10-07T08:53:49.141519+0000","last_clean":"2023-10-07T08:53:49.141519+0000","last_became_active":"2023-10-07T08:53:49.141313+0000","last_became_peered":"2023-10-07T08:53:49.141313+0000","last_unstale":"2023-10-07T08:53:49.141519+0000","last_undegraded":"2023-10-07T08:53:49.141519+0000","last_fullsized":"2023-10-07T08:53:49.141519+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:12:27.238944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.139739+0000","last_change":"2023-10-07T08:53:49.139739+0000","last_active":"2023-10-07T08:53:49.139739+0000","last_peered":"2023-10-07T08:53:49.139739+0000","last_clean":"2023-10-07T08:53:49.139739+0000","last_became_active":"2023-10-07T08:53:49.139495+0000","last_became_peered":"2023-10-07T08:53:49.139495+0000","last_unstale":"2023-10-07T08:53:49.139739+0000","last_undegraded":"2023-10-07T08:53:49.139739+0000","last_fullsized":"2023-10-07T08:53:49.139739+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:11.717602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.144562+0000","last_change":"2023-10-07T08:53:49.144562+0000","last_active":"2023-10-07T08:53:49.144562+0000","last_peered":"2023-10-07T08:53:49.144562+0000","last_clean":"2023-10-07T08:53:49.144562+0000","last_became_active":"2023-10-07T08:53:49.144326+0000","last_became_peered":"2023-10-07T08:53:49.144326+0000","last_unstale":"2023-10-07T08:53:49.144562+0000","last_undegraded":"2023-10-07T08:53:49.144562+0000","last_fullsized":"2023-10-07T08:53:49.144562+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:59:47.779223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.137669+0000","last_change":"2023-10-07T08:53:49.137669+0000","last_active":"2023-10-07T08:53:49.137669+0000","last_peered":"2023-10-07T08:53:49.137669+0000","last_clean":"2023-10-07T08:53:49.137669+0000","last_became_active":"2023-10-07T08:53:49.137056+0000","last_became_peered":"2023-10-07T08:53:49.137056+0000","last_unstale":"2023-10-07T08:53:49.137669+0000","last_undegraded":"2023-10-07T08:53:49.137669+0000","last_fullsized":"2023-10-07T08:53:49.137669+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:28:35.331231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.130858+0000","last_change":"2023-10-07T08:53:49.130858+0000","last_active":"2023-10-07T08:53:49.130858+0000","last_peered":"2023-10-07T08:53:49.130858+0000","last_clean":"2023-10-07T08:53:49.130858+0000","last_became_active":"2023-10-07T08:53:49.130607+0000","last_became_peered":"2023-10-07T08:53:49.130607+0000","last_unstale":"2023-10-07T08:53:49.130858+0000","last_undegraded":"2023-10-07T08:53:49.130858+0000","last_fullsized":"2023-10-07T08:53:49.130858+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:11.717602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.136662+0000","last_change":"2023-10-07T08:53:49.136662+0000","last_active":"2023-10-07T08:53:49.136662+0000","last_peered":"2023-10-07T08:53:49.136662+0000","last_clean":"2023-10-07T08:53:49.136662+0000","last_became_active":"2023-10-07T08:53:49.136420+0000","last_became_peered":"2023-10-07T08:53:49.136420+0000","last_unstale":"2023-10-07T08:53:49.136662+0000","last_undegraded":"2023-10-07T08:53:49.136662+0000","last_fullsized":"2023-10-07T08:53:49.136662+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:01:58.707774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.139939+0000","last_change":"2023-10-07T08:53:49.139939+0000","last_active":"2023-10-07T08:53:49.139939+0000","last_peered":"2023-10-07T08:53:49.139939+0000","last_clean":"2023-10-07T08:53:49.139939+0000","last_became_active":"2023-10-07T08:53:49.139710+0000","last_became_peered":"2023-10-07T08:53:49.139710+0000","last_unstale":"2023-10-07T08:53:49.139939+0000","last_undegraded":"2023-10-07T08:53:49.139939+0000","last_fullsized":"2023-10-07T08:53:49.139939+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:53:45.729909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.141798+0000","last_change":"2023-10-07T08:53:49.141798+0000","last_active":"2023-10-07T08:53:49.141798+0000","last_peered":"2023-10-07T08:53:49.141798+0000","last_clean":"2023-10-07T08:53:49.141798+0000","last_became_active":"2023-10-07T08:53:49.141612+0000","last_became_peered":"2023-10-07T08:53:49.141612+0000","last_unstale":"2023-10-07T08:53:49.141798+0000","last_undegraded":"2023-10-07T08:53:49.141798+0000","last_fullsized":"2023-10-07T08:53:49.141798+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:55:48.520380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.133320+0000","last_change":"2023-10-07T08:53:49.133320+0000","last_active":"2023-10-07T08:53:49.133320+0000","last_peered":"2023-10-07T08:53:49.133320+0000","last_clean":"2023-10-07T08:53:49.133320+0000","last_became_active":"2023-10-07T08:53:49.133102+0000","last_became_peered":"2023-10-07T08:53:49.133102+0000","last_unstale":"2023-10-07T08:53:49.133320+0000","last_undegraded":"2023-10-07T08:53:49.133320+0000","last_fullsized":"2023-10-07T08:53:49.133320+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:40:41.077885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.131199+0000","last_change":"2023-10-07T08:53:49.131199+0000","last_active":"2023-10-07T08:53:49.131199+0000","last_peered":"2023-10-07T08:53:49.131199+0000","last_clean":"2023-10-07T08:53:49.131199+0000","last_became_active":"2023-10-07T08:53:49.130897+0000","last_became_peered":"2023-10-07T08:53:49.130897+0000","last_unstale":"2023-10-07T08:53:49.131199+0000","last_undegraded":"2023-10-07T08:53:49.131199+0000","last_fullsized":"2023-10-07T08:53:49.131199+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:51.352867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.140131+0000","last_change":"2023-10-07T08:53:49.140131+0000","last_active":"2023-10-07T08:53:49.140131+0000","last_peered":"2023-10-07T08:53:49.140131+0000","last_clean":"2023-10-07T08:53:49.140131+0000","last_became_active":"2023-10-07T08:53:49.139883+0000","last_became_peered":"2023-10-07T08:53:49.139883+0000","last_unstale":"2023-10-07T08:53:49.140131+0000","last_undegraded":"2023-10-07T08:53:49.140131+0000","last_fullsized":"2023-10-07T08:53:49.140131+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:34:57.520427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.135132+0000","last_change":"2023-10-07T08:53:49.135132+0000","last_active":"2023-10-07T08:53:49.135132+0000","last_peered":"2023-10-07T08:53:49.135132+0000","last_clean":"2023-10-07T08:53:49.135132+0000","last_became_active":"2023-10-07T08:53:49.134851+0000","last_became_peered":"2023-10-07T08:53:49.134851+0000","last_unstale":"2023-10-07T08:53:49.135132+0000","last_undegraded":"2023-10-07T08:53:49.135132+0000","last_fullsized":"2023-10-07T08:53:49.135132+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:12:27.238944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.132433+0000","last_change":"2023-10-07T08:53:49.132433+0000","last_active":"2023-10-07T08:53:49.132433+0000","last_peered":"2023-10-07T08:53:49.132433+0000","last_clean":"2023-10-07T08:53:49.132433+0000","last_became_active":"2023-10-07T08:53:49.132214+0000","last_became_peered":"2023-10-07T08:53:49.132214+0000","last_unstale":"2023-10-07T08:53:49.132433+0000","last_undegraded":"2023-10-07T08:53:49.132433+0000","last_fullsized":"2023-10-07T08:53:49.132433+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:57:04.012976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.140309+0000","last_change":"2023-10-07T08:53:49.140309+0000","last_active":"2023-10-07T08:53:49.140309+0000","last_peered":"2023-10-07T08:53:49.140309+0000","last_clean":"2023-10-07T08:53:49.140309+0000","last_became_active":"2023-10-07T08:53:49.140072+0000","last_became_peered":"2023-10-07T08:53:49.140072+0000","last_unstale":"2023-10-07T08:53:49.140309+0000","last_undegraded":"2023-10-07T08:53:49.140309+0000","last_fullsized":"2023-10-07T08:53:49.140309+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:31:17.826847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.135217+0000","last_change":"2023-10-07T08:53:49.135217+0000","last_active":"2023-10-07T08:53:49.135217+0000","last_peered":"2023-10-07T08:53:49.135217+0000","last_clean":"2023-10-07T08:53:49.135217+0000","last_became_active":"2023-10-07T08:53:49.135006+0000","last_became_peered":"2023-10-07T08:53:49.135006+0000","last_unstale":"2023-10-07T08:53:49.135217+0000","last_undegraded":"2023-10-07T08:53:49.135217+0000","last_fullsized":"2023-10-07T08:53:49.135217+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:41:08.648610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.137585+0000","last_change":"2023-10-07T08:53:49.137585+0000","last_active":"2023-10-07T08:53:49.137585+0000","last_peered":"2023-10-07T08:53:49.137585+0000","last_clean":"2023-10-07T08:53:49.137585+0000","last_became_active":"2023-10-07T08:53:49.137339+0000","last_became_peered":"2023-10-07T08:53:49.137339+0000","last_unstale":"2023-10-07T08:53:49.137585+0000","last_undegraded":"2023-10-07T08:53:49.137585+0000","last_fullsized":"2023-10-07T08:53:49.137585+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:53.934432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.143120+0000","last_change":"2023-10-07T08:53:49.143120+0000","last_active":"2023-10-07T08:53:49.143120+0000","last_peered":"2023-10-07T08:53:49.143120+0000","last_clean":"2023-10-07T08:53:49.143120+0000","last_became_active":"2023-10-07T08:53:49.142907+0000","last_became_peered":"2023-10-07T08:53:49.142907+0000","last_unstale":"2023-10-07T08:53:49.143120+0000","last_undegraded":"2023-10-07T08:53:49.143120+0000","last_fullsized":"2023-10-07T08:53:49.143120+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:53.934432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.135414+0000","last_change":"2023-10-07T08:53:49.135414+0000","last_active":"2023-10-07T08:53:49.135414+0000","last_peered":"2023-10-07T08:53:49.135414+0000","last_clean":"2023-10-07T08:53:49.135414+0000","last_became_active":"2023-10-07T08:53:49.135152+0000","last_became_peered":"2023-10-07T08:53:49.135152+0000","last_unstale":"2023-10-07T08:53:49.135414+0000","last_undegraded":"2023-10-07T08:53:49.135414+0000","last_fullsized":"2023-10-07T08:53:49.135414+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:46:07.166742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138866+0000","last_change":"2023-10-07T08:53:49.138866+0000","last_active":"2023-10-07T08:53:49.138866+0000","last_peered":"2023-10-07T08:53:49.138866+0000","last_clean":"2023-10-07T08:53:49.138866+0000","last_became_active":"2023-10-07T08:53:49.138719+0000","last_became_peered":"2023-10-07T08:53:49.138719+0000","last_unstale":"2023-10-07T08:53:49.138866+0000","last_undegraded":"2023-10-07T08:53:49.138866+0000","last_fullsized":"2023-10-07T08:53:49.138866+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T08:59:47.779223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.144230+0000","last_change":"2023-10-07T08:53:49.144230+0000","last_active":"2023-10-07T08:53:49.144230+0000","last_peered":"2023-10-07T08:53:49.144230+0000","last_clean":"2023-10-07T08:53:49.144230+0000","last_became_active":"2023-10-07T08:53:49.143988+0000","last_became_peered":"2023-10-07T08:53:49.143988+0000","last_unstale":"2023-10-07T08:53:49.144230+0000","last_undegraded":"2023-10-07T08:53:49.144230+0000","last_fullsized":"2023-10-07T08:53:49.144230+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:04:10.569667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138873+0000","last_change":"2023-10-07T08:53:49.138873+0000","last_active":"2023-10-07T08:53:49.138873+0000","last_peered":"2023-10-07T08:53:49.138873+0000","last_clean":"2023-10-07T08:53:49.138873+0000","last_became_active":"2023-10-07T08:53:49.138711+0000","last_became_peered":"2023-10-07T08:53:49.138711+0000","last_unstale":"2023-10-07T08:53:49.138873+0000","last_undegraded":"2023-10-07T08:53:49.138873+0000","last_fullsized":"2023-10-07T08:53:49.138873+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:28:35.331231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.142252+0000","last_change":"2023-10-07T08:53:49.142252+0000","last_active":"2023-10-07T08:53:49.142252+0000","last_peered":"2023-10-07T08:53:49.142252+0000","last_clean":"2023-10-07T08:53:49.142252+0000","last_became_active":"2023-10-07T08:53:49.141924+0000","last_became_peered":"2023-10-07T08:53:49.141924+0000","last_unstale":"2023-10-07T08:53:49.142252+0000","last_undegraded":"2023-10-07T08:53:49.142252+0000","last_fullsized":"2023-10-07T08:53:49.142252+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:03:03.683868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.143108+0000","last_change":"2023-10-07T08:53:49.143108+0000","last_active":"2023-10-07T08:53:49.143108+0000","last_peered":"2023-10-07T08:53:49.143108+0000","last_clean":"2023-10-07T08:53:49.143108+0000","last_became_active":"2023-10-07T08:53:49.142551+0000","last_became_peered":"2023-10-07T08:53:49.142551+0000","last_unstale":"2023-10-07T08:53:49.143108+0000","last_undegraded":"2023-10-07T08:53:49.143108+0000","last_fullsized":"2023-10-07T08:53:49.143108+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:23:46.903986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.135215+0000","last_change":"2023-10-07T08:53:49.135215+0000","last_active":"2023-10-07T08:53:49.135215+0000","last_peered":"2023-10-07T08:53:49.135215+0000","last_clean":"2023-10-07T08:53:49.135215+0000","last_became_active":"2023-10-07T08:53:49.134705+0000","last_became_peered":"2023-10-07T08:53:49.134705+0000","last_unstale":"2023-10-07T08:53:49.135215+0000","last_undegraded":"2023-10-07T08:53:49.135215+0000","last_fullsized":"2023-10-07T08:53:49.135215+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:40.042299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.137763+0000","last_change":"2023-10-07T08:53:49.137763+0000","last_active":"2023-10-07T08:53:49.137763+0000","last_peered":"2023-10-07T08:53:49.137763+0000","last_clean":"2023-10-07T08:53:49.137763+0000","last_became_active":"2023-10-07T08:53:49.137551+0000","last_became_peered":"2023-10-07T08:53:49.137551+0000","last_unstale":"2023-10-07T08:53:49.137763+0000","last_undegraded":"2023-10-07T08:53:49.137763+0000","last_fullsized":"2023-10-07T08:53:49.137763+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:50:39.228275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"189'4","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.346340+0000","last_change":"2023-10-07T08:53:48.127647+0000","last_active":"2023-10-07T08:53:49.346340+0000","last_peered":"2023-10-07T08:53:49.346340+0000","last_clean":"2023-10-07T08:53:49.346340+0000","last_became_active":"2023-10-07T08:53:48.127412+0000","last_became_peered":"2023-10-07T08:53:48.127412+0000","last_unstale":"2023-10-07T08:53:49.346340+0000","last_undegraded":"2023-10-07T08:53:49.346340+0000","last_fullsized":"2023-10-07T08:53:49.346340+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:50.348494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.143985+0000","last_change":"2023-10-07T08:53:49.143985+0000","last_active":"2023-10-07T08:53:49.143985+0000","last_peered":"2023-10-07T08:53:49.143985+0000","last_clean":"2023-10-07T08:53:49.143985+0000","last_became_active":"2023-10-07T08:53:49.143456+0000","last_became_peered":"2023-10-07T08:53:49.143456+0000","last_unstale":"2023-10-07T08:53:49.143985+0000","last_undegraded":"2023-10-07T08:53:49.143985+0000","last_fullsized":"2023-10-07T08:53:49.143985+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:15:55.137729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"189'1","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.136668+0000","last_change":"2023-10-07T08:53:48.125594+0000","last_active":"2023-10-07T08:53:49.136668+0000","last_peered":"2023-10-07T08:53:49.136668+0000","last_clean":"2023-10-07T08:53:49.136668+0000","last_became_active":"2023-10-07T08:53:48.125216+0000","last_became_peered":"2023-10-07T08:53:48.125216+0000","last_unstale":"2023-10-07T08:53:49.136668+0000","last_undegraded":"2023-10-07T08:53:49.136668+0000","last_fullsized":"2023-10-07T08:53:49.136668+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:32:45.867627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.135186+0000","last_change":"2023-10-07T08:53:49.135186+0000","last_active":"2023-10-07T08:53:49.135186+0000","last_peered":"2023-10-07T08:53:49.135186+0000","last_clean":"2023-10-07T08:53:49.135186+0000","last_became_active":"2023-10-07T08:53:49.134970+0000","last_became_peered":"2023-10-07T08:53:49.134970+0000","last_unstale":"2023-10-07T08:53:49.135186+0000","last_undegraded":"2023-10-07T08:53:49.135186+0000","last_fullsized":"2023-10-07T08:53:49.135186+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:11:13.238807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"189'2","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.346980+0000","last_change":"2023-10-07T08:53:48.124180+0000","last_active":"2023-10-07T08:53:49.346980+0000","last_peered":"2023-10-07T08:53:49.346980+0000","last_clean":"2023-10-07T08:53:49.346980+0000","last_became_active":"2023-10-07T08:53:48.124031+0000","last_became_peered":"2023-10-07T08:53:48.124031+0000","last_unstale":"2023-10-07T08:53:49.346980+0000","last_undegraded":"2023-10-07T08:53:49.346980+0000","last_fullsized":"2023-10-07T08:53:49.346980+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:28:34.326859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.131473+0000","last_change":"2023-10-07T08:53:49.131473+0000","last_active":"2023-10-07T08:53:49.131473+0000","last_peered":"2023-10-07T08:53:49.131473+0000","last_clean":"2023-10-07T08:53:49.131473+0000","last_became_active":"2023-10-07T08:53:49.131081+0000","last_became_peered":"2023-10-07T08:53:49.131081+0000","last_unstale":"2023-10-07T08:53:49.131473+0000","last_undegraded":"2023-10-07T08:53:49.131473+0000","last_fullsized":"2023-10-07T08:53:49.131473+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:18:33.633016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"189'2","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.346750+0000","last_change":"2023-10-07T08:53:48.121963+0000","last_active":"2023-10-07T08:53:49.346750+0000","last_peered":"2023-10-07T08:53:49.346750+0000","last_clean":"2023-10-07T08:53:49.346750+0000","last_became_active":"2023-10-07T08:53:48.121742+0000","last_became_peered":"2023-10-07T08:53:48.121742+0000","last_unstale":"2023-10-07T08:53:49.346750+0000","last_undegraded":"2023-10-07T08:53:49.346750+0000","last_fullsized":"2023-10-07T08:53:49.346750+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:06:26.189247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.136940+0000","last_change":"2023-10-07T08:53:49.136940+0000","last_active":"2023-10-07T08:53:49.136940+0000","last_peered":"2023-10-07T08:53:49.136940+0000","last_clean":"2023-10-07T08:53:49.136940+0000","last_became_active":"2023-10-07T08:53:49.136588+0000","last_became_peered":"2023-10-07T08:53:49.136588+0000","last_unstale":"2023-10-07T08:53:49.136940+0000","last_undegraded":"2023-10-07T08:53:49.136940+0000","last_fullsized":"2023-10-07T08:53:49.136940+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:11:01.945691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"189'1","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.130325+0000","last_change":"2023-10-07T08:53:48.125438+0000","last_active":"2023-10-07T08:53:49.130325+0000","last_peered":"2023-10-07T08:53:49.130325+0000","last_clean":"2023-10-07T08:53:49.130325+0000","last_became_active":"2023-10-07T08:53:48.125141+0000","last_became_peered":"2023-10-07T08:53:48.125141+0000","last_unstale":"2023-10-07T08:53:49.130325+0000","last_undegraded":"2023-10-07T08:53:49.130325+0000","last_fullsized":"2023-10-07T08:53:49.130325+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:45:55.337701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138512+0000","last_change":"2023-10-07T08:53:49.138512+0000","last_active":"2023-10-07T08:53:49.138512+0000","last_peered":"2023-10-07T08:53:49.138512+0000","last_clean":"2023-10-07T08:53:49.138512+0000","last_became_active":"2023-10-07T08:53:49.138213+0000","last_became_peered":"2023-10-07T08:53:49.138213+0000","last_unstale":"2023-10-07T08:53:49.138512+0000","last_undegraded":"2023-10-07T08:53:49.138512+0000","last_fullsized":"2023-10-07T08:53:49.138512+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:11:03.665053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"189'1","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.133377+0000","last_change":"2023-10-07T08:53:48.124457+0000","last_active":"2023-10-07T08:53:49.133377+0000","last_peered":"2023-10-07T08:53:49.133377+0000","last_clean":"2023-10-07T08:53:49.133377+0000","last_became_active":"2023-10-07T08:53:48.123278+0000","last_became_peered":"2023-10-07T08:53:48.123278+0000","last_unstale":"2023-10-07T08:53:49.133377+0000","last_undegraded":"2023-10-07T08:53:49.133377+0000","last_fullsized":"2023-10-07T08:53:49.133377+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:22.718260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.137669+0000","last_change":"2023-10-07T08:53:49.137669+0000","last_active":"2023-10-07T08:53:49.137669+0000","last_peered":"2023-10-07T08:53:49.137669+0000","last_clean":"2023-10-07T08:53:49.137669+0000","last_became_active":"2023-10-07T08:53:49.137325+0000","last_became_peered":"2023-10-07T08:53:49.137325+0000","last_unstale":"2023-10-07T08:53:49.137669+0000","last_undegraded":"2023-10-07T08:53:49.137669+0000","last_fullsized":"2023-10-07T08:53:49.137669+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:13:18.357167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.126441+0000","last_change":"2023-10-07T08:53:48.126363+0000","last_active":"2023-10-07T08:53:48.126441+0000","last_peered":"2023-10-07T08:53:48.126441+0000","last_clean":"2023-10-07T08:53:48.126441+0000","last_became_active":"2023-10-07T08:53:48.125786+0000","last_became_peered":"2023-10-07T08:53:48.125786+0000","last_unstale":"2023-10-07T08:53:48.126441+0000","last_undegraded":"2023-10-07T08:53:48.126441+0000","last_fullsized":"2023-10-07T08:53:48.126441+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:31:21.657497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.134737+0000","last_change":"2023-10-07T08:53:49.134737+0000","last_active":"2023-10-07T08:53:49.134737+0000","last_peered":"2023-10-07T08:53:49.134737+0000","last_clean":"2023-10-07T08:53:49.134737+0000","last_became_active":"2023-10-07T08:53:49.134491+0000","last_became_peered":"2023-10-07T08:53:49.134491+0000","last_unstale":"2023-10-07T08:53:49.134737+0000","last_undegraded":"2023-10-07T08:53:49.134737+0000","last_fullsized":"2023-10-07T08:53:49.134737+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:49:48.482642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.119340+0000","last_change":"2023-10-07T08:53:48.119245+0000","last_active":"2023-10-07T08:53:48.119340+0000","last_peered":"2023-10-07T08:53:48.119340+0000","last_clean":"2023-10-07T08:53:48.119340+0000","last_became_active":"2023-10-07T08:53:48.119002+0000","last_became_peered":"2023-10-07T08:53:48.119002+0000","last_unstale":"2023-10-07T08:53:48.119340+0000","last_undegraded":"2023-10-07T08:53:48.119340+0000","last_fullsized":"2023-10-07T08:53:48.119340+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:09.057999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.134702+0000","last_change":"2023-10-07T08:53:49.134702+0000","last_active":"2023-10-07T08:53:49.134702+0000","last_peered":"2023-10-07T08:53:49.134702+0000","last_clean":"2023-10-07T08:53:49.134702+0000","last_became_active":"2023-10-07T08:53:49.134478+0000","last_became_peered":"2023-10-07T08:53:49.134478+0000","last_unstale":"2023-10-07T08:53:49.134702+0000","last_undegraded":"2023-10-07T08:53:49.134702+0000","last_fullsized":"2023-10-07T08:53:49.134702+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:59:44.664036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.127627+0000","last_change":"2023-10-07T08:53:48.127571+0000","last_active":"2023-10-07T08:53:48.127627+0000","last_peered":"2023-10-07T08:53:48.127627+0000","last_clean":"2023-10-07T08:53:48.127627+0000","last_became_active":"2023-10-07T08:53:48.127350+0000","last_became_peered":"2023-10-07T08:53:48.127350+0000","last_unstale":"2023-10-07T08:53:48.127627+0000","last_undegraded":"2023-10-07T08:53:48.127627+0000","last_fullsized":"2023-10-07T08:53:48.127627+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:18:57.936155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138585+0000","last_change":"2023-10-07T08:53:49.138585+0000","last_active":"2023-10-07T08:53:49.138585+0000","last_peered":"2023-10-07T08:53:49.138585+0000","last_clean":"2023-10-07T08:53:49.138585+0000","last_became_active":"2023-10-07T08:53:49.138023+0000","last_became_peered":"2023-10-07T08:53:49.138023+0000","last_unstale":"2023-10-07T08:53:49.138585+0000","last_undegraded":"2023-10-07T08:53:49.138585+0000","last_fullsized":"2023-10-07T08:53:49.138585+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:44:30.154371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"189'3","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.347286+0000","last_change":"2023-10-07T08:53:48.120026+0000","last_active":"2023-10-07T08:53:49.347286+0000","last_peered":"2023-10-07T08:53:49.347286+0000","last_clean":"2023-10-07T08:53:49.347286+0000","last_became_active":"2023-10-07T08:53:48.119785+0000","last_became_peered":"2023-10-07T08:53:48.119785+0000","last_unstale":"2023-10-07T08:53:49.347286+0000","last_undegraded":"2023-10-07T08:53:49.347286+0000","last_fullsized":"2023-10-07T08:53:49.347286+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:12:10.529919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.143838+0000","last_change":"2023-10-07T08:53:49.143838+0000","last_active":"2023-10-07T08:53:49.143838+0000","last_peered":"2023-10-07T08:53:49.143838+0000","last_clean":"2023-10-07T08:53:49.143838+0000","last_became_active":"2023-10-07T08:53:49.143137+0000","last_became_peered":"2023-10-07T08:53:49.143137+0000","last_unstale":"2023-10-07T08:53:49.143838+0000","last_undegraded":"2023-10-07T08:53:49.143838+0000","last_fullsized":"2023-10-07T08:53:49.143838+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T19:13:18.357167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"189'6","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.348038+0000","last_change":"2023-10-07T08:53:48.120278+0000","last_active":"2023-10-07T08:53:49.348038+0000","last_peered":"2023-10-07T08:53:49.348038+0000","last_clean":"2023-10-07T08:53:49.348038+0000","last_became_active":"2023-10-07T08:53:48.120025+0000","last_became_peered":"2023-10-07T08:53:48.120025+0000","last_unstale":"2023-10-07T08:53:49.348038+0000","last_undegraded":"2023-10-07T08:53:49.348038+0000","last_fullsized":"2023-10-07T08:53:49.348038+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:10.713230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.136429+0000","last_change":"2023-10-07T08:53:49.136429+0000","last_active":"2023-10-07T08:53:49.136429+0000","last_peered":"2023-10-07T08:53:49.136429+0000","last_clean":"2023-10-07T08:53:49.136429+0000","last_became_active":"2023-10-07T08:53:49.136181+0000","last_became_peered":"2023-10-07T08:53:49.136181+0000","last_unstale":"2023-10-07T08:53:49.136429+0000","last_undegraded":"2023-10-07T08:53:49.136429+0000","last_fullsized":"2023-10-07T08:53:49.136429+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:53:45.729909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"189'2","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.346633+0000","last_change":"2023-10-07T08:53:48.122717+0000","last_active":"2023-10-07T08:53:49.346633+0000","last_peered":"2023-10-07T08:53:49.346633+0000","last_clean":"2023-10-07T08:53:49.346633+0000","last_became_active":"2023-10-07T08:53:48.122555+0000","last_became_peered":"2023-10-07T08:53:48.122555+0000","last_unstale":"2023-10-07T08:53:49.346633+0000","last_undegraded":"2023-10-07T08:53:49.346633+0000","last_fullsized":"2023-10-07T08:53:49.346633+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:12:59.559004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138981+0000","last_change":"2023-10-07T08:53:49.138981+0000","last_active":"2023-10-07T08:53:49.138981+0000","last_peered":"2023-10-07T08:53:49.138981+0000","last_clean":"2023-10-07T08:53:49.138981+0000","last_became_active":"2023-10-07T08:53:49.138745+0000","last_became_peered":"2023-10-07T08:53:49.138745+0000","last_unstale":"2023-10-07T08:53:49.138981+0000","last_undegraded":"2023-10-07T08:53:49.138981+0000","last_fullsized":"2023-10-07T08:53:49.138981+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:02:49.152407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.120403+0000","last_change":"2023-10-07T08:53:48.119782+0000","last_active":"2023-10-07T08:53:48.120403+0000","last_peered":"2023-10-07T08:53:48.120403+0000","last_clean":"2023-10-07T08:53:48.120403+0000","last_became_active":"2023-10-07T08:53:48.119552+0000","last_became_peered":"2023-10-07T08:53:48.119552+0000","last_unstale":"2023-10-07T08:53:48.120403+0000","last_undegraded":"2023-10-07T08:53:48.120403+0000","last_fullsized":"2023-10-07T08:53:48.120403+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:30:09.150350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138671+0000","last_change":"2023-10-07T08:53:49.138671+0000","last_active":"2023-10-07T08:53:49.138671+0000","last_peered":"2023-10-07T08:53:49.138671+0000","last_clean":"2023-10-07T08:53:49.138671+0000","last_became_active":"2023-10-07T08:53:49.138470+0000","last_became_peered":"2023-10-07T08:53:49.138470+0000","last_unstale":"2023-10-07T08:53:49.138671+0000","last_undegraded":"2023-10-07T08:53:49.138671+0000","last_fullsized":"2023-10-07T08:53:49.138671+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:20:09.988221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.125507+0000","last_change":"2023-10-07T08:53:48.125472+0000","last_active":"2023-10-07T08:53:48.125507+0000","last_peered":"2023-10-07T08:53:48.125507+0000","last_clean":"2023-10-07T08:53:48.125507+0000","last_became_active":"2023-10-07T08:53:48.125240+0000","last_became_peered":"2023-10-07T08:53:48.125240+0000","last_unstale":"2023-10-07T08:53:48.125507+0000","last_undegraded":"2023-10-07T08:53:48.125507+0000","last_fullsized":"2023-10-07T08:53:48.125507+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:32:45.867627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.140688+0000","last_change":"2023-10-07T08:53:49.140688+0000","last_active":"2023-10-07T08:53:49.140688+0000","last_peered":"2023-10-07T08:53:49.140688+0000","last_clean":"2023-10-07T08:53:49.140688+0000","last_became_active":"2023-10-07T08:53:49.140469+0000","last_became_peered":"2023-10-07T08:53:49.140469+0000","last_unstale":"2023-10-07T08:53:49.140688+0000","last_undegraded":"2023-10-07T08:53:49.140688+0000","last_fullsized":"2023-10-07T08:53:49.140688+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:13:00.563376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"189'8","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.348093+0000","last_change":"2023-10-07T08:53:48.123719+0000","last_active":"2023-10-07T08:53:49.348093+0000","last_peered":"2023-10-07T08:53:49.348093+0000","last_clean":"2023-10-07T08:53:49.348093+0000","last_became_active":"2023-10-07T08:53:48.121628+0000","last_became_peered":"2023-10-07T08:53:48.121628+0000","last_unstale":"2023-10-07T08:53:49.348093+0000","last_undegraded":"2023-10-07T08:53:49.348093+0000","last_fullsized":"2023-10-07T08:53:49.348093+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:28:34.326859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.137547+0000","last_change":"2023-10-07T08:53:49.137547+0000","last_active":"2023-10-07T08:53:49.137547+0000","last_peered":"2023-10-07T08:53:49.137547+0000","last_clean":"2023-10-07T08:53:49.137547+0000","last_became_active":"2023-10-07T08:53:49.137048+0000","last_became_peered":"2023-10-07T08:53:49.137048+0000","last_unstale":"2023-10-07T08:53:49.137547+0000","last_undegraded":"2023-10-07T08:53:49.137547+0000","last_fullsized":"2023-10-07T08:53:49.137547+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:03:03.683868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"189'1","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.129693+0000","last_change":"2023-10-07T08:53:48.127611+0000","last_active":"2023-10-07T08:53:49.129693+0000","last_peered":"2023-10-07T08:53:49.129693+0000","last_clean":"2023-10-07T08:53:49.129693+0000","last_became_active":"2023-10-07T08:53:48.127287+0000","last_became_peered":"2023-10-07T08:53:48.127287+0000","last_unstale":"2023-10-07T08:53:49.129693+0000","last_undegraded":"2023-10-07T08:53:49.129693+0000","last_fullsized":"2023-10-07T08:53:49.129693+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:00:38.735033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.142810+0000","last_change":"2023-10-07T08:53:49.142810+0000","last_active":"2023-10-07T08:53:49.142810+0000","last_peered":"2023-10-07T08:53:49.142810+0000","last_clean":"2023-10-07T08:53:49.142810+0000","last_became_active":"2023-10-07T08:53:49.142564+0000","last_became_peered":"2023-10-07T08:53:49.142564+0000","last_unstale":"2023-10-07T08:53:49.142810+0000","last_undegraded":"2023-10-07T08:53:49.142810+0000","last_fullsized":"2023-10-07T08:53:49.142810+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:44:20.661794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"189'2","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.346890+0000","last_change":"2023-10-07T08:53:48.126251+0000","last_active":"2023-10-07T08:53:49.346890+0000","last_peered":"2023-10-07T08:53:49.346890+0000","last_clean":"2023-10-07T08:53:49.346890+0000","last_became_active":"2023-10-07T08:53:48.125962+0000","last_became_peered":"2023-10-07T08:53:48.125962+0000","last_unstale":"2023-10-07T08:53:49.346890+0000","last_undegraded":"2023-10-07T08:53:49.346890+0000","last_fullsized":"2023-10-07T08:53:49.346890+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:32:51.058791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138387+0000","last_change":"2023-10-07T08:53:49.138387+0000","last_active":"2023-10-07T08:53:49.138387+0000","last_peered":"2023-10-07T08:53:49.138387+0000","last_clean":"2023-10-07T08:53:49.138387+0000","last_became_active":"2023-10-07T08:53:49.137932+0000","last_became_peered":"2023-10-07T08:53:49.137932+0000","last_unstale":"2023-10-07T08:53:49.138387+0000","last_undegraded":"2023-10-07T08:53:49.138387+0000","last_fullsized":"2023-10-07T08:53:49.138387+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:42:07.638681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"189'1","reported_seq":10,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.134147+0000","last_change":"2023-10-07T08:53:48.126556+0000","last_active":"2023-10-07T08:53:49.134147+0000","last_peered":"2023-10-07T08:53:49.134147+0000","last_clean":"2023-10-07T08:53:49.134147+0000","last_became_active":"2023-10-07T08:53:48.126035+0000","last_became_peered":"2023-10-07T08:53:48.126035+0000","last_unstale":"2023-10-07T08:53:49.134147+0000","last_undegraded":"2023-10-07T08:53:49.134147+0000","last_fullsized":"2023-10-07T08:53:49.134147+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:46:39.037927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.144324+0000","last_change":"2023-10-07T08:53:49.144324+0000","last_active":"2023-10-07T08:53:49.144324+0000","last_peered":"2023-10-07T08:53:49.144324+0000","last_clean":"2023-10-07T08:53:49.144324+0000","last_became_active":"2023-10-07T08:53:49.143920+0000","last_became_peered":"2023-10-07T08:53:49.143920+0000","last_unstale":"2023-10-07T08:53:49.144324+0000","last_undegraded":"2023-10-07T08:53:49.144324+0000","last_fullsized":"2023-10-07T08:53:49.144324+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:49:32.229160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.121881+0000","last_change":"2023-10-07T08:53:48.121795+0000","last_active":"2023-10-07T08:53:48.121881+0000","last_peered":"2023-10-07T08:53:48.121881+0000","last_clean":"2023-10-07T08:53:48.121881+0000","last_became_active":"2023-10-07T08:53:48.121550+0000","last_became_peered":"2023-10-07T08:53:48.121550+0000","last_unstale":"2023-10-07T08:53:48.121881+0000","last_undegraded":"2023-10-07T08:53:48.121881+0000","last_fullsized":"2023-10-07T08:53:48.121881+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:11:23.533334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.130109+0000","last_change":"2023-10-07T08:53:49.130109+0000","last_active":"2023-10-07T08:53:49.130109+0000","last_peered":"2023-10-07T08:53:49.130109+0000","last_clean":"2023-10-07T08:53:49.130109+0000","last_became_active":"2023-10-07T08:53:49.129867+0000","last_became_peered":"2023-10-07T08:53:49.129867+0000","last_unstale":"2023-10-07T08:53:49.130109+0000","last_undegraded":"2023-10-07T08:53:49.130109+0000","last_fullsized":"2023-10-07T08:53:49.130109+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:31:17.826847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"189'2","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.347878+0000","last_change":"2023-10-07T08:53:48.123971+0000","last_active":"2023-10-07T08:53:49.347878+0000","last_peered":"2023-10-07T08:53:49.347878+0000","last_clean":"2023-10-07T08:53:49.347878+0000","last_became_active":"2023-10-07T08:53:48.122953+0000","last_became_peered":"2023-10-07T08:53:48.122953+0000","last_unstale":"2023-10-07T08:53:49.347878+0000","last_undegraded":"2023-10-07T08:53:49.347878+0000","last_fullsized":"2023-10-07T08:53:49.347878+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:21:10.713230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.136802+0000","last_change":"2023-10-07T08:53:49.136802+0000","last_active":"2023-10-07T08:53:49.136802+0000","last_peered":"2023-10-07T08:53:49.136802+0000","last_clean":"2023-10-07T08:53:49.136802+0000","last_became_active":"2023-10-07T08:53:49.136287+0000","last_became_peered":"2023-10-07T08:53:49.136287+0000","last_unstale":"2023-10-07T08:53:49.136802+0000","last_undegraded":"2023-10-07T08:53:49.136802+0000","last_fullsized":"2023-10-07T08:53:49.136802+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:59:20.816980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.121703+0000","last_change":"2023-10-07T08:53:48.121589+0000","last_active":"2023-10-07T08:53:48.121703+0000","last_peered":"2023-10-07T08:53:48.121703+0000","last_clean":"2023-10-07T08:53:48.121703+0000","last_became_active":"2023-10-07T08:53:48.121352+0000","last_became_peered":"2023-10-07T08:53:48.121352+0000","last_unstale":"2023-10-07T08:53:48.121703+0000","last_undegraded":"2023-10-07T08:53:48.121703+0000","last_fullsized":"2023-10-07T08:53:48.121703+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:59:33.586117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.142011+0000","last_change":"2023-10-07T08:53:49.142011+0000","last_active":"2023-10-07T08:53:49.142011+0000","last_peered":"2023-10-07T08:53:49.142011+0000","last_clean":"2023-10-07T08:53:49.142011+0000","last_became_active":"2023-10-07T08:53:49.141422+0000","last_became_peered":"2023-10-07T08:53:49.141422+0000","last_unstale":"2023-10-07T08:53:49.142011+0000","last_undegraded":"2023-10-07T08:53:49.142011+0000","last_fullsized":"2023-10-07T08:53:49.142011+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:56.391673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.126767+0000","last_change":"2023-10-07T08:53:48.126706+0000","last_active":"2023-10-07T08:53:48.126767+0000","last_peered":"2023-10-07T08:53:48.126767+0000","last_clean":"2023-10-07T08:53:48.126767+0000","last_became_active":"2023-10-07T08:53:48.126478+0000","last_became_peered":"2023-10-07T08:53:48.126478+0000","last_unstale":"2023-10-07T08:53:48.126767+0000","last_undegraded":"2023-10-07T08:53:48.126767+0000","last_fullsized":"2023-10-07T08:53:48.126767+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:05.678830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.135994+0000","last_change":"2023-10-07T08:53:49.135994+0000","last_active":"2023-10-07T08:53:49.135994+0000","last_peered":"2023-10-07T08:53:49.135994+0000","last_clean":"2023-10-07T08:53:49.135994+0000","last_became_active":"2023-10-07T08:53:49.135758+0000","last_became_peered":"2023-10-07T08:53:49.135758+0000","last_unstale":"2023-10-07T08:53:49.135994+0000","last_undegraded":"2023-10-07T08:53:49.135994+0000","last_fullsized":"2023-10-07T08:53:49.135994+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:47:42.627268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.126790+0000","last_change":"2023-10-07T08:53:48.126709+0000","last_active":"2023-10-07T08:53:48.126790+0000","last_peered":"2023-10-07T08:53:48.126790+0000","last_clean":"2023-10-07T08:53:48.126790+0000","last_became_active":"2023-10-07T08:53:48.126299+0000","last_became_peered":"2023-10-07T08:53:48.126299+0000","last_unstale":"2023-10-07T08:53:48.126790+0000","last_undegraded":"2023-10-07T08:53:48.126790+0000","last_fullsized":"2023-10-07T08:53:48.126790+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:09.057999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.136293+0000","last_change":"2023-10-07T08:53:49.136293+0000","last_active":"2023-10-07T08:53:49.136293+0000","last_peered":"2023-10-07T08:53:49.136293+0000","last_clean":"2023-10-07T08:53:49.136293+0000","last_became_active":"2023-10-07T08:53:49.135665+0000","last_became_peered":"2023-10-07T08:53:49.135665+0000","last_unstale":"2023-10-07T08:53:49.136293+0000","last_undegraded":"2023-10-07T08:53:49.136293+0000","last_fullsized":"2023-10-07T08:53:49.136293+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:29:45.868381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"189'2","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.346336+0000","last_change":"2023-10-07T08:53:48.123494+0000","last_active":"2023-10-07T08:53:49.346336+0000","last_peered":"2023-10-07T08:53:49.346336+0000","last_clean":"2023-10-07T08:53:49.346336+0000","last_became_active":"2023-10-07T08:53:48.123244+0000","last_became_peered":"2023-10-07T08:53:48.123244+0000","last_unstale":"2023-10-07T08:53:49.346336+0000","last_undegraded":"2023-10-07T08:53:49.346336+0000","last_fullsized":"2023-10-07T08:53:49.346336+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:37:53.546571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.135898+0000","last_change":"2023-10-07T08:53:49.135898+0000","last_active":"2023-10-07T08:53:49.135898+0000","last_peered":"2023-10-07T08:53:49.135898+0000","last_clean":"2023-10-07T08:53:49.135898+0000","last_became_active":"2023-10-07T08:53:49.135661+0000","last_became_peered":"2023-10-07T08:53:49.135661+0000","last_unstale":"2023-10-07T08:53:49.135898+0000","last_undegraded":"2023-10-07T08:53:49.135898+0000","last_fullsized":"2023-10-07T08:53:49.135898+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:20.597343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.126326+0000","last_change":"2023-10-07T08:53:48.125824+0000","last_active":"2023-10-07T08:53:48.126326+0000","last_peered":"2023-10-07T08:53:48.126326+0000","last_clean":"2023-10-07T08:53:48.126326+0000","last_became_active":"2023-10-07T08:53:48.125527+0000","last_became_peered":"2023-10-07T08:53:48.125527+0000","last_unstale":"2023-10-07T08:53:48.126326+0000","last_undegraded":"2023-10-07T08:53:48.126326+0000","last_fullsized":"2023-10-07T08:53:48.126326+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:47:41.622896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.139828+0000","last_change":"2023-10-07T08:53:49.139828+0000","last_active":"2023-10-07T08:53:49.139828+0000","last_peered":"2023-10-07T08:53:49.139828+0000","last_clean":"2023-10-07T08:53:49.139828+0000","last_became_active":"2023-10-07T08:53:49.139402+0000","last_became_peered":"2023-10-07T08:53:49.139402+0000","last_unstale":"2023-10-07T08:53:49.139828+0000","last_undegraded":"2023-10-07T08:53:49.139828+0000","last_fullsized":"2023-10-07T08:53:49.139828+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T18:45:56.342074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.126425+0000","last_change":"2023-10-07T08:53:48.126230+0000","last_active":"2023-10-07T08:53:48.126425+0000","last_peered":"2023-10-07T08:53:48.126425+0000","last_clean":"2023-10-07T08:53:48.126425+0000","last_became_active":"2023-10-07T08:53:48.125449+0000","last_became_peered":"2023-10-07T08:53:48.125449+0000","last_unstale":"2023-10-07T08:53:48.126425+0000","last_undegraded":"2023-10-07T08:53:48.126425+0000","last_fullsized":"2023-10-07T08:53:48.126425+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:27:31.085235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138438+0000","last_change":"2023-10-07T08:53:49.138438+0000","last_active":"2023-10-07T08:53:49.138438+0000","last_peered":"2023-10-07T08:53:49.138438+0000","last_clean":"2023-10-07T08:53:49.138438+0000","last_became_active":"2023-10-07T08:53:49.137724+0000","last_became_peered":"2023-10-07T08:53:49.137724+0000","last_unstale":"2023-10-07T08:53:49.138438+0000","last_undegraded":"2023-10-07T08:53:49.138438+0000","last_fullsized":"2023-10-07T08:53:49.138438+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T11:38:30.483480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.126757+0000","last_change":"2023-10-07T08:53:48.126686+0000","last_active":"2023-10-07T08:53:48.126757+0000","last_peered":"2023-10-07T08:53:48.126757+0000","last_clean":"2023-10-07T08:53:48.126757+0000","last_became_active":"2023-10-07T08:53:48.126293+0000","last_became_peered":"2023-10-07T08:53:48.126293+0000","last_unstale":"2023-10-07T08:53:48.126757+0000","last_undegraded":"2023-10-07T08:53:48.126757+0000","last_fullsized":"2023-10-07T08:53:48.126757+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:43:58.516138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.135350+0000","last_change":"2023-10-07T08:53:49.135350+0000","last_active":"2023-10-07T08:53:49.135350+0000","last_peered":"2023-10-07T08:53:49.135350+0000","last_clean":"2023-10-07T08:53:49.135350+0000","last_became_active":"2023-10-07T08:53:49.135000+0000","last_became_peered":"2023-10-07T08:53:49.135000+0000","last_unstale":"2023-10-07T08:53:49.135350+0000","last_undegraded":"2023-10-07T08:53:49.135350+0000","last_fullsized":"2023-10-07T08:53:49.135350+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T13:36:10.062371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.127171+0000","last_change":"2023-10-07T08:53:48.126920+0000","last_active":"2023-10-07T08:53:48.127171+0000","last_peered":"2023-10-07T08:53:48.127171+0000","last_clean":"2023-10-07T08:53:48.127171+0000","last_became_active":"2023-10-07T08:53:48.126670+0000","last_became_peered":"2023-10-07T08:53:48.126670+0000","last_unstale":"2023-10-07T08:53:48.127171+0000","last_undegraded":"2023-10-07T08:53:48.127171+0000","last_fullsized":"2023-10-07T08:53:48.127171+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:06:26.189247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.143250+0000","last_change":"2023-10-07T08:53:49.143250+0000","last_active":"2023-10-07T08:53:49.143250+0000","last_peered":"2023-10-07T08:53:49.143250+0000","last_clean":"2023-10-07T08:53:49.143250+0000","last_became_active":"2023-10-07T08:53:49.142808+0000","last_became_peered":"2023-10-07T08:53:49.142808+0000","last_unstale":"2023-10-07T08:53:49.143250+0000","last_undegraded":"2023-10-07T08:53:49.143250+0000","last_fullsized":"2023-10-07T08:53:49.143250+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T17:19:23.838230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.125432+0000","last_change":"2023-10-07T08:53:48.125375+0000","last_active":"2023-10-07T08:53:48.125432+0000","last_peered":"2023-10-07T08:53:48.125432+0000","last_clean":"2023-10-07T08:53:48.125432+0000","last_became_active":"2023-10-07T08:53:48.122435+0000","last_became_peered":"2023-10-07T08:53:48.122435+0000","last_unstale":"2023-10-07T08:53:48.125432+0000","last_undegraded":"2023-10-07T08:53:48.125432+0000","last_fullsized":"2023-10-07T08:53:48.125432+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T20:24:17.883037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.138917+0000","last_change":"2023-10-07T08:53:49.138917+0000","last_active":"2023-10-07T08:53:49.138917+0000","last_peered":"2023-10-07T08:53:49.138917+0000","last_clean":"2023-10-07T08:53:49.138917+0000","last_became_active":"2023-10-07T08:53:49.138702+0000","last_became_peered":"2023-10-07T08:53:49.138702+0000","last_unstale":"2023-10-07T08:53:49.138917+0000","last_undegraded":"2023-10-07T08:53:49.138917+0000","last_fullsized":"2023-10-07T08:53:49.138917+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T12:32:14.154751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.123298+0000","last_change":"2023-10-07T08:53:48.123052+0000","last_active":"2023-10-07T08:53:48.123298+0000","last_peered":"2023-10-07T08:53:48.123298+0000","last_clean":"2023-10-07T08:53:48.123298+0000","last_became_active":"2023-10-07T08:53:48.122754+0000","last_became_peered":"2023-10-07T08:53:48.122754+0000","last_unstale":"2023-10-07T08:53:48.123298+0000","last_undegraded":"2023-10-07T08:53:48.123298+0000","last_fullsized":"2023-10-07T08:53:48.123298+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T15:26:42.959416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.131379+0000","last_change":"2023-10-07T08:53:49.131379+0000","last_active":"2023-10-07T08:53:49.131379+0000","last_peered":"2023-10-07T08:53:49.131379+0000","last_clean":"2023-10-07T08:53:49.131379+0000","last_became_active":"2023-10-07T08:53:49.131110+0000","last_became_peered":"2023-10-07T08:53:49.131110+0000","last_unstale":"2023-10-07T08:53:49.131379+0000","last_undegraded":"2023-10-07T08:53:49.131379+0000","last_fullsized":"2023-10-07T08:53:49.131379+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:06.683202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.125655+0000","last_change":"2023-10-07T08:53:48.125445+0000","last_active":"2023-10-07T08:53:48.125655+0000","last_peered":"2023-10-07T08:53:48.125655+0000","last_clean":"2023-10-07T08:53:48.125655+0000","last_became_active":"2023-10-07T08:53:48.124919+0000","last_became_peered":"2023-10-07T08:53:48.124919+0000","last_unstale":"2023-10-07T08:53:48.125655+0000","last_undegraded":"2023-10-07T08:53:48.125655+0000","last_fullsized":"2023-10-07T08:53:48.125655+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:12:59.559004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":8,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-07T08:53:49.139056+0000","last_change":"2023-10-07T08:53:49.139056+0000","last_active":"2023-10-07T08:53:49.139056+0000","last_peered":"2023-10-07T08:53:49.139056+0000","last_clean":"2023-10-07T08:53:49.139056+0000","last_became_active":"2023-10-07T08:53:49.138817+0000","last_became_peered":"2023-10-07T08:53:49.138817+0000","last_unstale":"2023-10-07T08:53:49.139056+0000","last_undegraded":"2023-10-07T08:53:49.139056+0000","last_fullsized":"2023-10-07T08:53:49.139056+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:48.108331+0000","last_clean_scrub_stamp":"2023-10-07T08:53:48.108331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T09:09:56.391673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.125052+0000","last_change":"2023-10-07T08:53:48.124826+0000","last_active":"2023-10-07T08:53:48.125052+0000","last_peered":"2023-10-07T08:53:48.125052+0000","last_clean":"2023-10-07T08:53:48.125052+0000","last_became_active":"2023-10-07T08:53:48.124478+0000","last_became_peered":"2023-10-07T08:53:48.124478+0000","last_unstale":"2023-10-07T08:53:48.125052+0000","last_undegraded":"2023-10-07T08:53:48.125052+0000","last_fullsized":"2023-10-07T08:53:48.125052+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:53:47.103959+0000","last_clean_scrub_stamp":"2023-10-07T08:53:47.103959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T14:01:05.678830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":304,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-07T08:53:48.119036+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:53:48.119036+0000","last_peered":"2023-10-07T08:53:48.119036+0000","last_clean":"2023-10-07T08:53:48.119036+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:53:48.119036+0000","last_undegraded":"2023-10-07T08:53:48.119036+0000","last_fullsized":"2023-10-07T08:53:48.119036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574983,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1610,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193701,"statfs":{"total":200000000,"available":198350337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:53:01 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.498,"15min":0.502},"min":{"1min":0.26200000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":1.2150000000000001},"last":0.52600000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:53:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.53600000000000003,"15min":0.52700000000000002},"min":{"1min":0.42399999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56000000000000005,"15min":0.55100000000000005},"min":{"1min":0.434,"5min":0.38900000000000001,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.77200000000000002,"15min":1.1659999999999999},"last":0.628}]},{"osd":2,"last update":"Sat Oct 7 08:53:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53600000000000003,"15min":0.53100000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75,"5min":0.75,"15min":0.80300000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52100000000000002,"15min":0.504},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.33500000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.75},"last":0.48299999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:53:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.55400000000000005,"15min":0.69299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":6.8570000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.41599999999999998,"15min":0.37},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.98999999999999999},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:53:01 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47299999999999998,"15min":0.47599999999999998},"min":{"1min":0.316,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.98599999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26700000000000002},"max":{"1min":0.746,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.49199999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:53:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.495,"15min":0.5},"min":{"1min":0.30599999999999999,"5min":0.30499999999999999,"15min":0.27800000000000002},"max":{"1min":0.71999999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.443},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55500000000000005,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.76400000000000001,"5min":0.78300000000000003,"15min":1.0669999999999999},"last":0.55900000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:53:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56599999999999995,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.34599999999999997},"max":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":1.1020000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57699999999999996,"15min":0.56499999999999995},"min":{"1min":0.39700000000000002,"5min":0.374,"15min":0.307},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.40600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574983,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1032,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194280,"statfs":{"total":200000000,"available":198942933,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51100000000000001,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.25700000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.76600000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51100000000000001,"15min":0.499},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.30199999999999999},"max":{"1min":0.65900000000000003,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57099999999999995}]},{"osd":1,"last update":"Sat Oct 7 08:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56399999999999995,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32500000000000001},"max":{"1min":0.67800000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.54600000000000004},"min":{"1min":0.46400000000000002,"5min":0.32100000000000001,"15min":0.29799999999999999},"max":{"1min":0.69999999999999996,"5min":0.754,"15min":1.0069999999999999},"last":0.54100000000000004}]},{"osd":2,"last update":"Sat Oct 7 08:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55000000000000004,"15min":0.51200000000000001},"min":{"1min":0.39800000000000002,"5min":0.36899999999999999,"15min":0.29399999999999998},"max":{"1min":0.72399999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":0.65700000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.56299999999999994}]},{"osd":3,"last update":"Sat Oct 7 08:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53400000000000003,"15min":0.51900000000000002},"min":{"1min":0.318,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70399999999999996,"5min":0.751,"15min":0.752},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64000000000000001,"5min":0.83199999999999996,"15min":2.3879999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Sat Oct 7 08:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45500000000000002,"15min":0.47099999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.73699999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48399999999999999,"15min":0.49299999999999999},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.27400000000000002},"max":{"1min":0.65900000000000003,"5min":0.76300000000000001,"15min":0.79900000000000004},"last":0.47699999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47999999999999998,"15min":0.5},"min":{"1min":0.34000000000000002,"5min":0.30399999999999999,"15min":0.30099999999999999},"max":{"1min":0.68500000000000005,"5min":0.73899999999999999,"15min":0.86799999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.53700000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33400000000000002},"max":{"1min":0.74299999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.5}]},{"osd":7,"last update":"Sat Oct 7 08:53:05 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51900000000000002,"15min":0.52600000000000002},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.312},"max":{"1min":0.76500000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.36299999999999999,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.79000000000000004,"15min":1.052},"last":0.65900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1032,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194280,"statfs":{"total":200000000,"available":198942921,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.33800000000000002,"15min":0.32700000000000001},"min":{"1min":0.22700000000000001,"5min":0.193,"15min":0.17499999999999999},"max":{"1min":0.438,"5min":0.60399999999999998,"15min":1.9359999999999999},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.36799999999999999,"15min":0.34599999999999997},"min":{"1min":0.247,"5min":0.221,"15min":0.192},"max":{"1min":0.42699999999999999,"5min":0.61599999999999999,"15min":0.82999999999999996},"last":0.29999999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.35199999999999998,"15min":0.33600000000000002},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.19600000000000001},"max":{"1min":0.38400000000000001,"5min":0.57799999999999996,"15min":1.639},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.38600000000000001,"15min":0.35899999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.22500000000000001},"max":{"1min":0.45600000000000002,"5min":0.69599999999999995,"15min":1.9039999999999999},"last":0.316}]},{"osd":3,"last update":"Sat Oct 7 08:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40500000000000003,"15min":0.38100000000000001},"min":{"1min":0.29499999999999998,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":0.41799999999999998,"5min":0.64500000000000002,"15min":1.6819999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39600000000000002,"15min":0.37},"min":{"1min":0.27600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.44400000000000001,"5min":0.63800000000000001,"15min":0.97599999999999998},"last":0.33400000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56699999999999995,"15min":0.55100000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33600000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.91600000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.55100000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.28599999999999998},"max":{"1min":0.746,"5min":0.86399999999999999,"15min":1.9570000000000001},"last":0.629}]},{"osd":5,"last update":"Sat Oct 7 08:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.62,"15min":0.59199999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81499999999999995,"5min":0.98199999999999998,"15min":1.0409999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.623,"15min":0.59199999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36599999999999999},"max":{"1min":0.85999999999999999,"5min":0.89600000000000002,"15min":0.97299999999999998},"last":0.64200000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59299999999999997,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.379,"15min":0.34200000000000003},"max":{"1min":0.84399999999999997,"5min":0.94299999999999995,"15min":1.2150000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60199999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.87},"last":0.55000000000000004}]},{"osd":7,"last update":"Sat Oct 7 08:53:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63400000000000001,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.35699999999999998},"max":{"1min":0.79400000000000004,"5min":1.004,"15min":1.0800000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.64300000000000002,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.46100000000000002,"15min":0.40799999999999997},"max":{"1min":0.90100000000000002,"5min":0.92700000000000005,"15min":0.94299999999999995},"last":0.66800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574983,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193710,"statfs":{"total":200000000,"available":198359350,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.224,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":0.58299999999999996,"5min":0.71099999999999997,"15min":1.4339999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.376,"15min":0.38500000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":1.079},"last":0.32800000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":1.464},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39300000000000002,"15min":0.39700000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.21299999999999999},"max":{"1min":0.58199999999999996,"5min":0.627,"15min":1.1060000000000001},"last":0.375}]},{"osd":3,"last update":"Sat Oct 7 08:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.376,"15min":0.38},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.23300000000000001},"max":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":1.341},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42199999999999999,"15min":0.42899999999999999},"min":{"1min":0.313,"5min":0.28000000000000003,"15min":0.25700000000000001},"max":{"1min":0.55600000000000005,"5min":0.65700000000000003,"15min":1.532},"last":0.34899999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.3169999999999999},"last":0.496},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34699999999999998},"max":{"1min":0.77100000000000002,"5min":0.84999999999999998,"15min":1.51},"last":0.60299999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61499999999999999,"15min":0.60399999999999998},"min":{"1min":0.35799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91400000000000003,"5min":0.92300000000000004,"15min":1.0529999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.75700000000000001,"5min":0.91000000000000003,"15min":1.25},"last":0.54300000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60799999999999998,"15min":0.60699999999999998},"min":{"1min":0.39700000000000002,"5min":0.38600000000000001,"15min":0.376},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.488},"last":0.502},{"interface":"front","average":{"1min":0.624,"5min":0.625,"15min":0.60799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.39000000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.024},"last":0.61799999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.627,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.42599999999999999,"15min":0.41999999999999998},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":0.98499999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61799999999999999,"15min":0.61099999999999999},"min":{"1min":0.40899999999999997,"5min":0.375,"15min":0.374},"max":{"1min":0.81399999999999995,"5min":0.84099999999999997,"15min":1.288},"last":0.63400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1032,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194280,"statfs":{"total":200000000,"available":198942865,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.33000000000000002,"15min":0.33700000000000002},"min":{"1min":0.19400000000000001,"5min":0.192,"15min":0.17699999999999999},"max":{"1min":0.46899999999999997,"5min":0.55700000000000005,"15min":1.665},"last":0.251},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.35999999999999999,"15min":0.36099999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.497,"5min":0.63400000000000001,"15min":1.579},"last":0.30199999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35999999999999999,"15min":0.374},"min":{"1min":0.216,"5min":0.216,"15min":0.20499999999999999},"max":{"1min":0.48299999999999998,"5min":0.54800000000000004,"15min":2.4470000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41099999999999998,"15min":0.42299999999999999},"min":{"1min":0.27800000000000002,"5min":0.20999999999999999,"15min":0.20200000000000001},"max":{"1min":0.55400000000000005,"5min":0.65000000000000002,"15min":2.4620000000000002},"last":0.34899999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.40200000000000002,"15min":0.39500000000000002},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.24199999999999999},"max":{"1min":0.53300000000000003,"5min":0.56999999999999995,"15min":1.454},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39100000000000001,"15min":0.39000000000000001},"min":{"1min":0.255,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.51800000000000002,"5min":0.59799999999999998,"15min":1.6919999999999999},"last":0.33600000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.58199999999999996},"min":{"1min":0.40899999999999997,"5min":0.33500000000000002,"15min":0.28199999999999997},"max":{"1min":0.81299999999999994,"5min":0.90500000000000003,"15min":1.7210000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.90200000000000002,"15min":1.5549999999999999},"last":0.56399999999999995}]},{"osd":5,"last update":"Sat Oct 7 08:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57599999999999996,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":0.95199999999999996,"15min":1.5269999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.46000000000000002,"5min":0.44800000000000001,"15min":0.311},"max":{"1min":0.78900000000000003,"5min":0.88900000000000001,"15min":1.4039999999999999},"last":0.5}]},{"osd":6,"last update":"Sat Oct 7 08:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59299999999999997,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.79000000000000004,"5min":0.93999999999999995,"15min":1.3380000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.59099999999999997},"min":{"1min":0.371,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85199999999999998,"5min":0.86099999999999999,"15min":1.637},"last":0.46500000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:53:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.379},"max":{"1min":0.86399999999999999,"5min":0.97499999999999998,"15min":1.49},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64100000000000001,"15min":0.61899999999999999},"min":{"1min":0.45600000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83099999999999996,"5min":0.96999999999999997,"15min":1.375},"last":0.45800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1032,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194280,"statfs":{"total":200000000,"available":198942921,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:53:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.312,"15min":0.32800000000000001},"min":{"1min":0.23799999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.49199999999999999,"5min":0.56499999999999995,"15min":1.8220000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.34599999999999997,"15min":0.33400000000000002},"min":{"1min":0.245,"5min":0.22,"15min":0.22},"max":{"1min":0.53600000000000003,"5min":0.57699999999999996,"15min":0.93500000000000005},"last":0.26200000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:53:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35999999999999999,"15min":0.36299999999999999},"min":{"1min":0.23200000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.6519999999999999},"last":0.25},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.40200000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.22500000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":1.885},"last":0.35699999999999998}]},{"osd":2,"last update":"Sat Oct 7 08:53:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.28499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.54200000000000004,"5min":0.56200000000000006,"15min":1.274},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39400000000000002,"15min":0.40300000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":1.8999999999999999},"last":0.38300000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:53:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.53500000000000003},"min":{"1min":0.42199999999999999,"5min":0.36499999999999999,"15min":0.29999999999999999},"max":{"1min":0.81499999999999995,"5min":0.81699999999999995,"15min":0.82799999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58299999999999996,"15min":0.55800000000000005},"min":{"1min":0.434,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76100000000000001,"5min":0.90000000000000002,"15min":1.3109999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Sat Oct 7 08:53:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57599999999999996,"15min":0.56100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35999999999999999},"max":{"1min":0.72599999999999998,"5min":0.85799999999999998,"15min":1.1639999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.78900000000000003,"5min":0.89000000000000001,"15min":1.851},"last":0.56899999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:53:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61899999999999999,"15min":0.58599999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.34899999999999998},"max":{"1min":0.79200000000000004,"5min":0.91000000000000003,"15min":0.92700000000000005},"last":0.497},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.625,"15min":0.60399999999999998},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.79500000000000004,"5min":0.94399999999999995,"15min":1.1930000000000001},"last":0.57699999999999996}]},{"osd":7,"last update":"Sat Oct 7 08:53:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.47299999999999998,"5min":0.41499999999999998,"15min":0.39700000000000002},"max":{"1min":0.81999999999999995,"5min":0.93200000000000005,"15min":1.8700000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59799999999999998,"15min":0.57699999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75600000000000001,"5min":0.85099999999999998,"15min":0.88400000000000001},"last":0.59299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574983,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1033,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198941349,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.247},"max":{"1min":0.67100000000000004,"5min":0.89300000000000002,"15min":1.9419999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53400000000000003,"15min":0.52200000000000002},"min":{"1min":0.34899999999999998,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":1.6879999999999999},"last":0.73499999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51800000000000002,"15min":0.51200000000000001},"min":{"1min":0.38400000000000001,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":0.68000000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28000000000000003},"max":{"1min":0.74199999999999999,"5min":0.81100000000000005,"15min":1.3580000000000001},"last":0.68600000000000005}]},{"osd":2,"last update":"Sat Oct 7 08:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.53200000000000003},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.27800000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":2.1520000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54600000000000004,"15min":0.52600000000000002},"min":{"1min":0.46700000000000003,"5min":0.376,"15min":0.30599999999999999},"max":{"1min":0.755,"5min":0.755,"15min":1.29},"last":0.746}]},{"osd":3,"last update":"Sat Oct 7 08:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.29999999999999999},"max":{"1min":0.77300000000000002,"5min":0.91400000000000003,"15min":2.052},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.55300000000000005},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78700000000000003,"15min":1.369},"last":0.71199999999999997}]},{"osd":5,"last update":"Sat Oct 7 08:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44600000000000001,"15min":0.44900000000000001},"min":{"1min":0.33700000000000002,"5min":0.29099999999999998,"15min":0.27000000000000002},"max":{"1min":0.628,"5min":0.75800000000000001,"15min":0.89000000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.33500000000000002,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.72599999999999998,"5min":0.88,"15min":0.88},"last":0.54300000000000004}]},{"osd":6,"last update":"Sat Oct 7 08:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51000000000000001,"15min":0.52200000000000002},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71199999999999997,"5min":0.85899999999999999,"15min":1.0049999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53300000000000003,"15min":0.53800000000000003},"min":{"1min":0.40600000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.95599999999999996},"last":0.64200000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:53:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52200000000000002,"15min":0.54300000000000004},"min":{"1min":0.38,"5min":0.31,"15min":0.30099999999999999},"max":{"1min":0.63400000000000001,"5min":0.83899999999999997,"15min":0.98899999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.36599999999999999,"15min":0.33300000000000002},"max":{"1min":0.69399999999999995,"5min":0.90200000000000002,"15min":0.91300000000000003},"last":0.60199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574983,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1032,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194279,"statfs":{"total":200000000,"available":198942379,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.34200000000000003,"5min":0.311,"15min":0.26200000000000001},"max":{"1min":0.68600000000000005,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.68899999999999995}]},{"osd":1,"last update":"Sat Oct 7 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.51400000000000001},"min":{"1min":0.372,"5min":0.33300000000000002,"15min":0.25},"max":{"1min":0.63,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.84599999999999997,"15min":0.63700000000000001},"min":{"1min":0.39000000000000001,"5min":0.375,"15min":0.27000000000000002},"max":{"1min":0.64300000000000002,"5min":29.143999999999998,"15min":29.143999999999998},"last":0.70599999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.31,"15min":0.26800000000000002},"max":{"1min":0.70499999999999996,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53700000000000003,"15min":0.54000000000000004},"min":{"1min":0.42099999999999999,"5min":0.34699999999999998,"15min":0.309},"max":{"1min":0.68799999999999994,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.67600000000000005}]},{"osd":3,"last update":"Sat Oct 7 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.39000000000000001,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.68999999999999995,"5min":0.82099999999999995,"15min":0.90200000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78700000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.72899999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45800000000000002,"15min":0.47199999999999998},"min":{"1min":0.28999999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.65400000000000003,"5min":0.80700000000000005,"15min":0.93500000000000005},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55600000000000005,"15min":0.57899999999999996},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.748,"5min":0.80800000000000005,"15min":0.80900000000000005},"last":0.58899999999999997}]},{"osd":6,"last update":"Sat Oct 7 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.49299999999999999,"15min":0.52300000000000002},"min":{"1min":0.30599999999999999,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":0.70599999999999996,"5min":0.79100000000000004,"15min":0.81399999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.42899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.55600000000000005},"min":{"1min":0.33800000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.71199999999999997,"5min":0.73199999999999998,"15min":0.93100000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54500000000000004,"15min":0.57299999999999995},"min":{"1min":0.35999999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72099999999999997,"5min":0.84299999999999997,"15min":0.91100000000000003},"last":0.498}]}]}],"pool_statfs":[]}} 2023-10-07T08:53:53.798 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-07T08:53:53.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-07T08:53:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.919+0000 7f4917fff700 1 Processor -- start 2023-10-07T08:53:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.919+0000 7f4917fff700 1 -- start start 2023-10-07T08:53:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f4917fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f49180b1ef0 0x7f491806da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f4917fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49180b29d0 0x7f4918163bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f4917fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4918068d40 con 0x7f491806f4f0 2023-10-07T08:53:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f4917fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491815a520 con 0x7f49180b1ef0 2023-10-07T08:53:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f4917fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491806a1e0 con 0x7f49180b29d0 2023-10-07T08:53:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f4916ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f49180b1ef0 0x7f491806da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f49167fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f491806f4f0 0x7f49180b22c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58198/0 (socket says 172.21.15.81:58198) 2023-10-07T08:53:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f49167fc700 1 -- 172.21.15.81:0/2254438318 learned_addr learned my addr 172.21.15.81:0/2254438318 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f4916ffd700 1 -- 172.21.15.81:0/2254438318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49180b29d0 msgr2=0x7f4918163bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f49177fe700 1 --2- 172.21.15.81:0/2254438318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49180b29d0 0x7f4918163bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f4916ffd700 1 --2- 172.21.15.81:0/2254438318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49180b29d0 0x7f4918163bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f4915ffb700 1 -- 172.21.15.81:0/2254438318 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812899267 0 0) 0x7f4918068d40 con 0x7f491806f4f0 2023-10-07T08:53:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f4916ffd700 1 -- 172.21.15.81:0/2254438318 >> v1:172.21.15.81:6789/0 conn(0x7f491806f4f0 legacy=0x7f49180b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f4916ffd700 1 -- 172.21.15.81:0/2254438318 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491806e2d0 con 0x7f49180b1ef0 2023-10-07T08:53:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f49177fe700 1 --2- 172.21.15.81:0/2254438318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49180b29d0 0x7f4918163bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:53.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f4916ffd700 1 --2- 172.21.15.81:0/2254438318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49180b1ef0 0x7f491806da20 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f49080098e0 tx=0x7f49080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662e44dcb69e6e4b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:53.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f4915ffb700 1 -- 172.21.15.81:0/2254438318 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908009e80 con 0x7f49180b1ef0 2023-10-07T08:53:53.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f4915ffb700 1 -- 172.21.15.81:0/2254438318 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490800b860 con 0x7f49180b1ef0 2023-10-07T08:53:53.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.920+0000 7f4915ffb700 1 -- 172.21.15.81:0/2254438318 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490800bbe0 con 0x7f49180b1ef0 2023-10-07T08:53:53.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.921+0000 7f4917fff700 1 -- 172.21.15.81:0/2254438318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49180b1ef0 msgr2=0x7f491806da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.921+0000 7f4917fff700 1 --2- 172.21.15.81:0/2254438318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49180b1ef0 0x7f491806da20 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f49080098e0 tx=0x7f49080091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.921+0000 7f4917fff700 1 -- 172.21.15.81:0/2254438318 shutdown_connections 2023-10-07T08:53:53.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.921+0000 7f4917fff700 1 --2- 172.21.15.81:0/2254438318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49180b1ef0 0x7f491806da20 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.921+0000 7f4917fff700 1 --2- 172.21.15.81:0/2254438318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49180b29d0 0x7f4918163bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.921+0000 7f4917fff700 1 -- 172.21.15.81:0/2254438318 >> 172.21.15.81:0/2254438318 conn(0x7f49180d0bb0 msgr2=0x7f49180d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:53.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.921+0000 7f4917fff700 1 -- 172.21.15.81:0/2254438318 shutdown_connections 2023-10-07T08:53:53.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.921+0000 7f4917fff700 1 -- 172.21.15.81:0/2254438318 wait complete. 2023-10-07T08:53:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.922+0000 7f4917fff700 1 Processor -- start 2023-10-07T08:53:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.922+0000 7f4917fff700 1 -- start start 2023-10-07T08:53:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.923+0000 7f4917fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491806f4f0 0x7f491816a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.923+0000 7f4917fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49180b1ef0 0x7f4918142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.923+0000 7f4917fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49180b29d0 0x7f491815ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.923+0000 7f4917fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4918156a30 con 0x7f49180b29d0 2023-10-07T08:53:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.923+0000 7f4917fff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4918156fb0 con 0x7f49180b1ef0 2023-10-07T08:53:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.923+0000 7f4917fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4918142d40 con 0x7f491806f4f0 2023-10-07T08:53:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.923+0000 7f49177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49180b29d0 0x7f491815ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.923+0000 7f49177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49180b29d0 0x7f491815ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45210/0 (socket says 172.21.15.81:45210) 2023-10-07T08:53:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.923+0000 7f49177fe700 1 -- 172.21.15.81:0/2330375294 learned_addr learned my addr 172.21.15.81:0/2330375294 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.923+0000 7f4916ffd700 1 --2- 172.21.15.81:0/2330375294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491806f4f0 0x7f491816a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.923+0000 7f49167fc700 1 --2- 172.21.15.81:0/2330375294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49180b1ef0 0x7f4918142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.923+0000 7f49177fe700 1 -- 172.21.15.81:0/2330375294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491806f4f0 msgr2=0x7f491816a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.923+0000 7f49177fe700 1 --2- 172.21.15.81:0/2330375294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491806f4f0 0x7f491816a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.923+0000 7f49177fe700 1 -- 172.21.15.81:0/2330375294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49180b1ef0 msgr2=0x7f4918142800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.923+0000 7f49177fe700 1 --2- 172.21.15.81:0/2330375294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49180b1ef0 0x7f4918142800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.923+0000 7f49177fe700 1 -- 172.21.15.81:0/2330375294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4908009420 con 0x7f49180b29d0 2023-10-07T08:53:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.924+0000 7f49177fe700 1 --2- 172.21.15.81:0/2330375294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49180b29d0 0x7f491815ecd0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f491000cef0 tx=0x7f4910007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.924+0000 7f48feffd700 1 -- 172.21.15.81:0/2330375294 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491000ad20 con 0x7f49180b29d0 2023-10-07T08:53:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.924+0000 7f48feffd700 1 -- 172.21.15.81:0/2330375294 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4910016420 con 0x7f49180b29d0 2023-10-07T08:53:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.924+0000 7f4917fff700 1 -- 172.21.15.81:0/2330375294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4918152e10 con 0x7f49180b29d0 2023-10-07T08:53:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.924+0000 7f48feffd700 1 -- 172.21.15.81:0/2330375294 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491000aea0 con 0x7f49180b29d0 2023-10-07T08:53:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.924+0000 7f4917fff700 1 -- 172.21.15.81:0/2330375294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4918156c40 con 0x7f49180b29d0 2023-10-07T08:53:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.925+0000 7f4917fff700 1 -- 172.21.15.81:0/2330375294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4918067b70 con 0x7f49180b29d0 2023-10-07T08:53:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.925+0000 7f48feffd700 1 -- 172.21.15.81:0/2330375294 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4910016a70 con 0x7f49180b29d0 2023-10-07T08:53:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.925+0000 7f48feffd700 1 --2- 172.21.15.81:0/2330375294 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4904066f30 0x7f49040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.925+0000 7f48feffd700 1 -- 172.21.15.81:0/2330375294 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4910012070 con 0x7f49180b29d0 2023-10-07T08:53:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.925+0000 7f4916ffd700 1 --2- 172.21.15.81:0/2330375294 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4904066f30 0x7f49040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.926+0000 7f4916ffd700 1 --2- 172.21.15.81:0/2330375294 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4904066f30 0x7f49040693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f49080091e0 tx=0x7f4908017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:53.929+0000 7f48feffd700 1 -- 172.21.15.81:0/2330375294 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4910052060 con 0x7f49180b29d0 2023-10-07T08:53:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.188+0000 7f4917fff700 1 -- 172.21.15.81:0/2330375294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4918071b10 con 0x7f49180b29d0 2023-10-07T08:53:54.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.192+0000 7f48feffd700 1 -- 172.21.15.81:0/2330375294 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4910055680 con 0x7f49180b29d0 2023-10-07T08:53:54.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.194+0000 7f4917fff700 1 -- 172.21.15.81:0/2330375294 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4904066f30 msgr2=0x7f49040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:54.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.194+0000 7f4917fff700 1 --2- 172.21.15.81:0/2330375294 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4904066f30 0x7f49040693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f49080091e0 tx=0x7f4908017000 comp rx=0 tx=0).stop 2023-10-07T08:53:54.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.194+0000 7f4917fff700 1 -- 172.21.15.81:0/2330375294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49180b29d0 msgr2=0x7f491815ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.194+0000 7f4917fff700 1 --2- 172.21.15.81:0/2330375294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49180b29d0 0x7f491815ecd0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f491000cef0 tx=0x7f4910007860 comp rx=0 tx=0).stop 2023-10-07T08:53:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.194+0000 7f4917fff700 1 -- 172.21.15.81:0/2330375294 shutdown_connections 2023-10-07T08:53:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.194+0000 7f4917fff700 1 --2- 172.21.15.81:0/2330375294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49180b29d0 0x7f491815ecd0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.194+0000 7f4917fff700 1 --2- 172.21.15.81:0/2330375294 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f4904066f30 0x7f49040693e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.194+0000 7f4917fff700 1 --2- 172.21.15.81:0/2330375294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491806f4f0 0x7f491816a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.194+0000 7f4917fff700 1 --2- 172.21.15.81:0/2330375294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49180b1ef0 0x7f4918142800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:54.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.194+0000 7f4917fff700 1 -- 172.21.15.81:0/2330375294 >> 172.21.15.81:0/2330375294 conn(0x7f49180d0bb0 msgr2=0x7f49180ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.194+0000 7f4917fff700 1 -- 172.21.15.81:0/2330375294 shutdown_connections 2023-10-07T08:53:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.194+0000 7f4917fff700 1 -- 172.21.15.81:0/2330375294 wait complete. 2023-10-07T08:53:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-10-07T08:53:54.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:53:54.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.319+0000 7f87213e3700 1 Processor -- start 2023-10-07T08:53:54.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.319+0000 7f87213e3700 1 -- start start 2023-10-07T08:53:54.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.320+0000 7f87213e3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f871c15daa0 0x7f871c15de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:54.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.320+0000 7f87213e3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f871c0cae00 0x7f871c159540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:54.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.320+0000 7f87213e3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0cb2a0 0x7f871c159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:54.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.320+0000 7f87213e3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871c06d350 con 0x7f871c15daa0 2023-10-07T08:53:54.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.320+0000 7f87213e3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871c0c9ac0 con 0x7f871c0cae00 2023-10-07T08:53:54.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.320+0000 7f87213e3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c15e3b0 con 0x7f871c0cb2a0 2023-10-07T08:53:54.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.320+0000 7f871affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f871c15daa0 0x7f871c15de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:54.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.320+0000 7f871affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f871c15daa0 0x7f871c15de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45212/0 (socket says 172.21.15.81:45212) 2023-10-07T08:53:54.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.320+0000 7f871affd700 1 -- 172.21.15.81:0/1505886834 learned_addr learned my addr 172.21.15.81:0/1505886834 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:54.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.321+0000 7f871b7fe700 1 --2- 172.21.15.81:0/1505886834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0cb2a0 0x7f871c159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:54.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.321+0000 7f87127fc700 1 --2- 172.21.15.81:0/1505886834 >> v2:172.21.15.89:3300/0 conn(0x7f871c0cae00 0x7f871c159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:54.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.321+0000 7f871affd700 1 -- 172.21.15.81:0/1505886834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0cb2a0 msgr2=0x7f871c159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:54.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.321+0000 7f871affd700 1 --2- 172.21.15.81:0/1505886834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0cb2a0 0x7f871c159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:54.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.321+0000 7f871affd700 1 -- 172.21.15.81:0/1505886834 >> v2:172.21.15.89:3300/0 conn(0x7f871c0cae00 msgr2=0x7f871c159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:54.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.321+0000 7f871affd700 1 --2- 172.21.15.81:0/1505886834 >> v2:172.21.15.89:3300/0 conn(0x7f871c0cae00 0x7f871c159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:54.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.321+0000 7f871affd700 1 -- 172.21.15.81:0/1505886834 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c06c740 con 0x7f871c15daa0 2023-10-07T08:53:54.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.321+0000 7f87127fc700 1 --2- 172.21.15.81:0/1505886834 >> v2:172.21.15.89:3300/0 conn(0x7f871c0cae00 0x7f871c159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:54.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.321+0000 7f871affd700 1 --2- 172.21.15.81:0/1505886834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871c15daa0 0x7f871c15de70 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f871c067cb0 tx=0x7f870c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4fc60fd76998f35 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:54.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.321+0000 7f871a7fc700 1 -- 172.21.15.81:0/1505886834 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c00b860 con 0x7f871c15daa0 2023-10-07T08:53:54.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.321+0000 7f871a7fc700 1 -- 172.21.15.81:0/1505886834 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c00b9c0 con 0x7f871c15daa0 2023-10-07T08:53:54.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.321+0000 7f871a7fc700 1 -- 172.21.15.81:0/1505886834 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c00bd60 con 0x7f871c15daa0 2023-10-07T08:53:54.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.321+0000 7f87213e3700 1 -- 172.21.15.81:0/1505886834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871c15daa0 msgr2=0x7f871c15de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:54.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.321+0000 7f87213e3700 1 --2- 172.21.15.81:0/1505886834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871c15daa0 0x7f871c15de70 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f871c067cb0 tx=0x7f870c009250 comp rx=0 tx=0).stop 2023-10-07T08:53:54.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.322+0000 7f87213e3700 1 -- 172.21.15.81:0/1505886834 shutdown_connections 2023-10-07T08:53:54.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.322+0000 7f87213e3700 1 --2- 172.21.15.81:0/1505886834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0cb2a0 0x7f871c159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:54.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.322+0000 7f87213e3700 1 --2- 172.21.15.81:0/1505886834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871c15daa0 0x7f871c15de70 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:54.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.322+0000 7f87213e3700 1 --2- 172.21.15.81:0/1505886834 >> v2:172.21.15.89:3300/0 conn(0x7f871c0cae00 0x7f871c159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:54.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.322+0000 7f87213e3700 1 -- 172.21.15.81:0/1505886834 >> 172.21.15.81:0/1505886834 conn(0x7f871c0c9ca0 msgr2=0x7f871c0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:54.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.322+0000 7f87213e3700 1 -- 172.21.15.81:0/1505886834 shutdown_connections 2023-10-07T08:53:54.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.322+0000 7f87213e3700 1 -- 172.21.15.81:0/1505886834 wait complete. 2023-10-07T08:53:54.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.323+0000 7f87213e3700 1 Processor -- start 2023-10-07T08:53:54.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.323+0000 7f87213e3700 1 -- start start 2023-10-07T08:53:54.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f87213e3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f871c0cae00 0x7f871c0af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:54.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f87213e3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0cb2a0 0x7f871c0aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:54.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f87213e3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871c15daa0 0x7f871c15c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:54.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f87213e3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c16d6b0 con 0x7f871c15daa0 2023-10-07T08:53:54.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f87213e3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c0afa10 con 0x7f871c0cae00 2023-10-07T08:53:54.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f87213e3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c16a570 con 0x7f871c0cb2a0 2023-10-07T08:53:54.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f871b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871c15daa0 0x7f871c15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:54.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f871b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871c15daa0 0x7f871c15c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45214/0 (socket says 172.21.15.81:45214) 2023-10-07T08:53:54.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f871b7fe700 1 -- 172.21.15.81:0/1799108752 learned_addr learned my addr 172.21.15.81:0/1799108752 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:54.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f871affd700 1 --2- 172.21.15.81:0/1799108752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f871c0cae00 0x7f871c0af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:54.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f87127fc700 1 --2- 172.21.15.81:0/1799108752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0cb2a0 0x7f871c0aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:54.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f871b7fe700 1 -- 172.21.15.81:0/1799108752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0cb2a0 msgr2=0x7f871c0aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:54.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f871b7fe700 1 --2- 172.21.15.81:0/1799108752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0cb2a0 0x7f871c0aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:54.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f871b7fe700 1 -- 172.21.15.81:0/1799108752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f871c0cae00 msgr2=0x7f871c0af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:54.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f871b7fe700 1 --2- 172.21.15.81:0/1799108752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f871c0cae00 0x7f871c0af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:54.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f871b7fe700 1 -- 172.21.15.81:0/1799108752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c0094f0 con 0x7f871c15daa0 2023-10-07T08:53:54.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f871b7fe700 1 --2- 172.21.15.81:0/1799108752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871c15daa0 0x7f871c15c020 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f8714009fa0 tx=0x7f8714009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:54.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f87137fe700 1 -- 172.21.15.81:0/1799108752 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871400ebc0 con 0x7f871c15daa0 2023-10-07T08:53:54.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f87137fe700 1 -- 172.21.15.81:0/1799108752 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871400ed20 con 0x7f871c15daa0 2023-10-07T08:53:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f87213e3700 1 -- 172.21.15.81:0/1799108752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871c16a850 con 0x7f871c15daa0 2023-10-07T08:53:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f87137fe700 1 -- 172.21.15.81:0/1799108752 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714014670 con 0x7f871c15daa0 2023-10-07T08:53:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.324+0000 7f87213e3700 1 -- 172.21.15.81:0/1799108752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871c16ae10 con 0x7f871c15daa0 2023-10-07T08:53:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.325+0000 7f87213e3700 1 -- 172.21.15.81:0/1799108752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871c068080 con 0x7f871c15daa0 2023-10-07T08:53:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.326+0000 7f87137fe700 1 -- 172.21.15.81:0/1799108752 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87140149e0 con 0x7f871c15daa0 2023-10-07T08:53:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.326+0000 7f87137fe700 1 --2- 172.21.15.81:0/1799108752 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f86fc066f30 0x7f86fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.326+0000 7f871affd700 1 --2- 172.21.15.81:0/1799108752 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f86fc066f30 0x7f86fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.326+0000 7f87137fe700 1 -- 172.21.15.81:0/1799108752 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8714084b90 con 0x7f871c15daa0 2023-10-07T08:53:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.327+0000 7f871affd700 1 --2- 172.21.15.81:0/1799108752 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f86fc066f30 0x7f86fc0693e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f871c067cb0 tx=0x7f870c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.330+0000 7f87137fe700 1 -- 172.21.15.81:0/1799108752 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8714051e00 con 0x7f871c15daa0 2023-10-07T08:53:54.425 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-10-07T08:53:54.424+0000 7f0c399b9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:53:54.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.558+0000 7f87213e3700 1 -- 172.21.15.81:0/1799108752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f871c04bb80 con 0x7f871c15daa0 2023-10-07T08:53:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.558+0000 7f87137fe700 1 -- 172.21.15.81:0/1799108752 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f8714055420 con 0x7f871c15daa0 2023-10-07T08:53:54.560 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:54.560 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1601080758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1601080758},{"type":"v1","addr":"172.21.15.81:6837","nonce":1601080758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2709611313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2709611313},{"type":"v1","addr":"172.21.15.89:6835","nonce":2709611313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/3085029167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3085029167},{"type":"v1","addr":"172.21.15.89:6834","nonce":3085029167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:53:48.496016+0000","modified":"2023-10-07T08:53:52.345717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6836/2531199109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2531199109},{"type":"v1","addr":"172.21.15.81:6836","nonce":2531199109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-07T08:53:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.560+0000 7f87213e3700 1 -- 172.21.15.81:0/1799108752 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f86fc066f30 msgr2=0x7f86fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.560+0000 7f87213e3700 1 --2- 172.21.15.81:0/1799108752 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f86fc066f30 0x7f86fc0693e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f871c067cb0 tx=0x7f870c017000 comp rx=0 tx=0).stop 2023-10-07T08:53:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.560+0000 7f87213e3700 1 -- 172.21.15.81:0/1799108752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871c15daa0 msgr2=0x7f871c15c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.560+0000 7f87213e3700 1 --2- 172.21.15.81:0/1799108752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871c15daa0 0x7f871c15c020 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f8714009fa0 tx=0x7f8714009900 comp rx=0 tx=0).stop 2023-10-07T08:53:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.560+0000 7f87213e3700 1 -- 172.21.15.81:0/1799108752 shutdown_connections 2023-10-07T08:53:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.560+0000 7f87213e3700 1 --2- 172.21.15.81:0/1799108752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f871c15daa0 0x7f871c15c020 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.560+0000 7f87213e3700 1 --2- 172.21.15.81:0/1799108752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f871c0cae00 0x7f871c0af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.560+0000 7f87213e3700 1 --2- 172.21.15.81:0/1799108752 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f86fc066f30 0x7f86fc0693e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.560+0000 7f87213e3700 1 --2- 172.21.15.81:0/1799108752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f871c0cb2a0 0x7f871c0aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.560+0000 7f87213e3700 1 -- 172.21.15.81:0/1799108752 >> 172.21.15.81:0/1799108752 conn(0x7f871c0c9ca0 msgr2=0x7f871c0c7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.560+0000 7f87213e3700 1 -- 172.21.15.81:0/1799108752 shutdown_connections 2023-10-07T08:53:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:54.560+0000 7f87213e3700 1 -- 172.21.15.81:0/1799108752 wait complete. 2023-10-07T08:53:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-07T08:53:54.976 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 90, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-07T08:53:48.496016+0000', 'modified': '2023-10-07T08:53:52.345717+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8160}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8160': {'gid': 8160, 'name': 'a', 'rank': 0, 'incarnation': 86, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6836/2531199109', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 2531199109}, {'type': 'v1', 'addr': '172.21.15.81:6836', 'nonce': 2531199109}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-07T08:53:54.976 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-07T08:53:54.977 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-07T08:53:55.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.092+0000 7f523d98d700 1 Processor -- start 2023-10-07T08:53:55.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.092+0000 7f523d98d700 1 -- start start 2023-10-07T08:53:55.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.093+0000 7f523d98d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52380cf240 0x7f52380b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.093+0000 7f523d98d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f523806d650 0x7f523806da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.093+0000 7f523d98d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52380b0ca0 con 0x7f523815a2a0 2023-10-07T08:53:55.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.093+0000 7f523d98d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523806ea90 con 0x7f523806d650 2023-10-07T08:53:55.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.093+0000 7f523d98d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52380b00d0 con 0x7f52380cf240 2023-10-07T08:53:55.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.093+0000 7f52377fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f523806d650 0x7f523806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.093+0000 7f52367fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52380cf240 0x7f52380b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.093+0000 7f52377fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f523806d650 0x7f523806da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:50630/0 (socket says 172.21.15.81:50630) 2023-10-07T08:53:55.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.093+0000 7f52377fe700 1 -- 172.21.15.81:0/1523671316 learned_addr learned my addr 172.21.15.81:0/1523671316 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:55.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.093+0000 7f5236ffd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f523815a2a0 0x7f52380ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:43550/0 (socket says 172.21.15.81:43550) 2023-10-07T08:53:55.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.094+0000 7f52377fe700 1 -- 172.21.15.81:0/1523671316 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52380cf240 msgr2=0x7f52380b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:55.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.094+0000 7f52377fe700 1 --2- 172.21.15.81:0/1523671316 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52380cf240 0x7f52380b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.094+0000 7f52377fe700 1 -- 172.21.15.81:0/1523671316 >> v1:172.21.15.89:6789/0 conn(0x7f523815a2a0 legacy=0x7f52380ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.094+0000 7f52377fe700 1 -- 172.21.15.81:0/1523671316 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380b0370 con 0x7f523806d650 2023-10-07T08:53:55.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.094+0000 7f52367fc700 1 --2- 172.21.15.81:0/1523671316 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52380cf240 0x7f52380b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:53:55.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.094+0000 7f52377fe700 1 --2- 172.21.15.81:0/1523671316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f523806d650 0x7f523806da90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f52300099b0 tx=0x7f5230009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d1f7aa486de0dd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:55.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.094+0000 7f5235ffb700 1 -- 172.21.15.81:0/1523671316 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230009ea0 con 0x7f523806d650 2023-10-07T08:53:55.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.094+0000 7f5235ffb700 1 -- 172.21.15.81:0/1523671316 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523000b860 con 0x7f523806d650 2023-10-07T08:53:55.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.094+0000 7f5235ffb700 1 -- 172.21.15.81:0/1523671316 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523000bc00 con 0x7f523806d650 2023-10-07T08:53:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.095+0000 7f523d98d700 1 -- 172.21.15.81:0/1523671316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f523806d650 msgr2=0x7f523806da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.095+0000 7f523d98d700 1 --2- 172.21.15.81:0/1523671316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f523806d650 0x7f523806da90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f52300099b0 tx=0x7f5230009250 comp rx=0 tx=0).stop 2023-10-07T08:53:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.095+0000 7f523d98d700 1 -- 172.21.15.81:0/1523671316 shutdown_connections 2023-10-07T08:53:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.095+0000 7f523d98d700 1 --2- 172.21.15.81:0/1523671316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f523806d650 0x7f523806da90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.095+0000 7f523d98d700 1 --2- 172.21.15.81:0/1523671316 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52380cf240 0x7f52380b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.095+0000 7f523d98d700 1 -- 172.21.15.81:0/1523671316 >> 172.21.15.81:0/1523671316 conn(0x7f5238067640 msgr2=0x7f5238067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.095+0000 7f523d98d700 1 -- 172.21.15.81:0/1523671316 shutdown_connections 2023-10-07T08:53:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.095+0000 7f523d98d700 1 -- 172.21.15.81:0/1523671316 wait complete. 2023-10-07T08:53:55.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.096+0000 7f523d98d700 1 Processor -- start 2023-10-07T08:53:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.096+0000 7f523d98d700 1 -- start start 2023-10-07T08:53:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f523d98d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523806d650 0x7f52381423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f523d98d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52380cf240 0x7f523815c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f523d98d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f523815a2a0 0x7f523816dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f523d98d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523815d1f0 con 0x7f523806d650 2023-10-07T08:53:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f523d98d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523815d4d0 con 0x7f523815a2a0 2023-10-07T08:53:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f523d98d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52380b3b30 con 0x7f52380cf240 2023-10-07T08:53:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f5236ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523806d650 0x7f52381423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f5236ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523806d650 0x7f52381423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45230/0 (socket says 172.21.15.81:45230) 2023-10-07T08:53:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f5236ffd700 1 -- 172.21.15.81:0/143958233 learned_addr learned my addr 172.21.15.81:0/143958233 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f52377fe700 1 --2- 172.21.15.81:0/143958233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f523815a2a0 0x7f523816dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f52367fc700 1 --2- 172.21.15.81:0/143958233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52380cf240 0x7f523815c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f5236ffd700 1 -- 172.21.15.81:0/143958233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52380cf240 msgr2=0x7f523815c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f5236ffd700 1 --2- 172.21.15.81:0/143958233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52380cf240 0x7f523815c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f5236ffd700 1 -- 172.21.15.81:0/143958233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f523815a2a0 msgr2=0x7f523816dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f5236ffd700 1 --2- 172.21.15.81:0/143958233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f523815a2a0 0x7f523816dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f5236ffd700 1 -- 172.21.15.81:0/143958233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c009420 con 0x7f523806d650 2023-10-07T08:53:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f5236ffd700 1 --2- 172.21.15.81:0/143958233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523806d650 0x7f52381423b0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f522800cd30 tx=0x7f5228001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f521effd700 1 -- 172.21.15.81:0/143958233 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800ce90 con 0x7f523806d650 2023-10-07T08:53:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f521effd700 1 -- 172.21.15.81:0/143958233 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5228005df0 con 0x7f523806d650 2023-10-07T08:53:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f523d98d700 1 -- 172.21.15.81:0/143958233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52300094f0 con 0x7f523806d650 2023-10-07T08:53:55.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f521effd700 1 -- 172.21.15.81:0/143958233 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800aae0 con 0x7f523806d650 2023-10-07T08:53:55.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.097+0000 7f523d98d700 1 -- 172.21.15.81:0/143958233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52380b40f0 con 0x7f523806d650 2023-10-07T08:53:55.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.099+0000 7f521effd700 1 -- 172.21.15.81:0/143958233 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52280070f0 con 0x7f523806d650 2023-10-07T08:53:55.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.099+0000 7f521effd700 1 --2- 172.21.15.81:0/143958233 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5224066f30 0x7f52240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.099+0000 7f521effd700 1 -- 172.21.15.81:0/143958233 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5228084530 con 0x7f523806d650 2023-10-07T08:53:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.099+0000 7f52367fc700 1 --2- 172.21.15.81:0/143958233 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5224066f30 0x7f52240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.100+0000 7f52367fc700 1 --2- 172.21.15.81:0/143958233 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5224066f30 0x7f52240693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f523816ece0 tx=0x7f522c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.101+0000 7f5246c85b80 1 Processor -- start 2023-10-07T08:53:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.101+0000 7f5246c85b80 1 -- start start 2023-10-07T08:53:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f5246c85b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb255a50 0x55cafb255e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f5246c85b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb29fd00 0x55cafb27ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f5246c85b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb27ef60 0x55cafb251cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f5246c85b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cafb1aca70 con 0x55cafb27ef60 2023-10-07T08:53:55.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f5246c85b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cafb1aa270 con 0x55cafb29fd00 2023-10-07T08:53:55.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f5246c85b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cafb1a6060 con 0x55cafb255a50 2023-10-07T08:53:55.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f52377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb27ef60 0x55cafb251cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f52377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb27ef60 0x55cafb251cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45244/0 (socket says 172.21.15.81:45244) 2023-10-07T08:53:55.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f52377fe700 1 -- 172.21.15.81:0/803152336 learned_addr learned my addr 172.21.15.81:0/803152336 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:55.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f52367fc700 1 --2- 172.21.15.81:0/803152336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb29fd00 0x55cafb27ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f5236ffd700 1 --2- 172.21.15.81:0/803152336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb255a50 0x55cafb255e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f52377fe700 1 -- 172.21.15.81:0/803152336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb255a50 msgr2=0x55cafb255e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:55.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f52377fe700 1 --2- 172.21.15.81:0/803152336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb255a50 0x55cafb255e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f52377fe700 1 -- 172.21.15.81:0/803152336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb29fd00 msgr2=0x55cafb27ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f52377fe700 1 --2- 172.21.15.81:0/803152336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb29fd00 0x55cafb27ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f52377fe700 1 -- 172.21.15.81:0/803152336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cafb040270 con 0x55cafb27ef60 2023-10-07T08:53:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.102+0000 7f52367fc700 1 --2- 172.21.15.81:0/803152336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb29fd00 0x55cafb27ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:53:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.103+0000 7f52377fe700 1 --2- 172.21.15.81:0/803152336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb27ef60 0x55cafb251cf0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f523000b3c0 tx=0x7f5230017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea365cf98586366 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.103+0000 7f5217fff700 1 -- 172.21.15.81:0/803152336 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230021070 con 0x55cafb27ef60 2023-10-07T08:53:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.103+0000 7f5217fff700 1 -- 172.21.15.81:0/803152336 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523000b9d0 con 0x55cafb27ef60 2023-10-07T08:53:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.103+0000 7f5217fff700 1 -- 172.21.15.81:0/803152336 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523001a420 con 0x55cafb27ef60 2023-10-07T08:53:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.103+0000 7f5246c85b80 1 -- 172.21.15.81:0/803152336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb27ef60 msgr2=0x55cafb251cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.103+0000 7f5246c85b80 1 --2- 172.21.15.81:0/803152336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb27ef60 0x55cafb251cf0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f523000b3c0 tx=0x7f5230017000 comp rx=0 tx=0).stop 2023-10-07T08:53:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.103+0000 7f5246c85b80 1 -- 172.21.15.81:0/803152336 shutdown_connections 2023-10-07T08:53:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.103+0000 7f5246c85b80 1 --2- 172.21.15.81:0/803152336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb27ef60 0x55cafb251cf0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.103+0000 7f5246c85b80 1 --2- 172.21.15.81:0/803152336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb255a50 0x55cafb255e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.103+0000 7f5246c85b80 1 --2- 172.21.15.81:0/803152336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb29fd00 0x55cafb27ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.103+0000 7f5246c85b80 1 -- 172.21.15.81:0/803152336 >> 172.21.15.81:0/803152336 conn(0x55cafb257370 msgr2=0x55cafb257740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.104+0000 7f5246c85b80 1 -- 172.21.15.81:0/803152336 shutdown_connections 2023-10-07T08:53:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.104+0000 7f5246c85b80 1 -- 172.21.15.81:0/803152336 wait complete. 2023-10-07T08:53:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.104+0000 7f5246c85b80 1 -- start start 2023-10-07T08:53:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.104+0000 7f5246c85b80 1 Processor -- start 2023-10-07T08:53:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f5246c85b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb255a50 0x55cafb2984c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f5246c85b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb27ef60 0x55cafb250c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f5246c85b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb29fd00 0x55cafb251160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f5246c85b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cafb151890 con 0x55cafb27ef60 2023-10-07T08:53:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f5246c85b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cafb16cea0 con 0x55cafb29fd00 2023-10-07T08:53:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f5246c85b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cafb028e30 con 0x55cafb255a50 2023-10-07T08:53:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f5246c85b80 10 client.0 _ll_register_callbacks cb 0x55cafb219110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:53:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f52367fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb27ef60 0x55cafb250c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f52367fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb27ef60 0x55cafb250c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45260/0 (socket says 172.21.15.81:45260) 2023-10-07T08:53:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f52367fc700 1 -- 172.21.15.81:0/3896664246 learned_addr learned my addr 172.21.15.81:0/3896664246 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f52377fe700 1 --2- 172.21.15.81:0/3896664246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb29fd00 0x55cafb251160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f5236ffd700 1 --2- 172.21.15.81:0/3896664246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb255a50 0x55cafb2984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f52367fc700 1 -- 172.21.15.81:0/3896664246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb255a50 msgr2=0x55cafb2984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f52367fc700 1 --2- 172.21.15.81:0/3896664246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb255a50 0x55cafb2984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f52367fc700 1 -- 172.21.15.81:0/3896664246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb29fd00 msgr2=0x55cafb251160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f52367fc700 1 --2- 172.21.15.81:0/3896664246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb29fd00 0x55cafb251160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.105+0000 7f52367fc700 1 -- 172.21.15.81:0/3896664246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52380b0370 con 0x55cafb27ef60 2023-10-07T08:53:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f52367fc700 1 --2- 172.21.15.81:0/3896664246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb27ef60 0x55cafb250c20 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f522c014ce0 tx=0x7f522c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da83d8b2a208ce6 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f52157fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:53:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f52157fa700 1 -- 172.21.15.81:0/3896664246 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c013bc0 con 0x55cafb27ef60 2023-10-07T08:53:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f52157fa700 1 -- 172.21.15.81:0/3896664246 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(190..190 src has 1..190) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f522c013d20 con 0x55cafb27ef60 2023-10-07T08:53:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f5246c85b80 1 -- 172.21.15.81:0/3896664246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cafb24ab70 con 0x55cafb27ef60 2023-10-07T08:53:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f52157fa700 1 -- 172.21.15.81:0/3896664246 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f522c005a00 con 0x55cafb27ef60 2023-10-07T08:53:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f5246c85b80 10 client.8319 fetch_fsmap learned FSMap version 90 2023-10-07T08:53:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f5246c85b80 1 -- 172.21.15.81:0/3896664246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x55cafafe2fe0 con 0x55cafb27ef60 2023-10-07T08:53:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f52157fa700 1 -- 172.21.15.81:0/3896664246 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cafb24ab70 con 0x55cafb27ef60 2023-10-07T08:53:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f52157fa700 1 -- 172.21.15.81:0/3896664246 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 90) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f522c005b60 con 0x55cafb27ef60 2023-10-07T08:53:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f5246c85b80 10 client.8319 fetch_fsmap finished waiting for FSMap version 90 2023-10-07T08:53:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f5246c85b80 10 client.8319 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T08:53:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f5246c85b80 20 client.8319 populate_metadata read hostname 'smithi081' 2023-10-07T08:53:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f5246c85b80 1 --2- 172.21.15.81:0/3896664246 >> [v2:172.21.15.81:6834/2531199109,v1:172.21.15.81:6836/2531199109] conn(0x55cafb2941f0 0x55cafb2945c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f5246c85b80 4 client.8319 mds_command: new command op to 8160 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-07T08:53:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f5246c85b80 1 -- 172.21.15.81:0/3896664246 --> [v2:172.21.15.81:6834/2531199109,v1:172.21.15.81:6836/2531199109] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cafb227aa0 con 0x55cafb2941f0 2023-10-07T08:53:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.106+0000 7f5236ffd700 1 --2- 172.21.15.81:0/3896664246 >> [v2:172.21.15.81:6834/2531199109,v1:172.21.15.81:6836/2531199109] conn(0x55cafb2941f0 0x55cafb2945c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.107+0000 7f52157fa700 10 client.8319 ms_handle_connect on v2:172.21.15.81:6834/2531199109 2023-10-07T08:53:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.107+0000 7f5236ffd700 1 --2- 172.21.15.81:0/3896664246 >> [v2:172.21.15.81:6834/2531199109,v1:172.21.15.81:6836/2531199109] conn(0x55cafb2941f0 0x55cafb2945c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc61d370837c7e71 server_cookie=a1cc2b2dbf1f76ce in_seq=0 out_seq=0 2023-10-07T08:53:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.107+0000 7f52157fa700 1 -- 172.21.15.81:0/3896664246 <== mds.0 v2:172.21.15.81:6834/2531199109 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55cafb227aa0 con 0x55cafb2941f0 2023-10-07T08:53:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.107+0000 7f52157fa700 10 client.8319 handle_command_reply: tid=0 2023-10-07T08:53:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.107+0000 7f5246c85b80 1 client.8319 shutdown 2023-10-07T08:53:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.107+0000 7f5246c85b80 1 -- 172.21.15.81:0/3896664246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb27ef60 msgr2=0x55cafb250c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.107+0000 7f5246c85b80 1 --2- 172.21.15.81:0/3896664246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb27ef60 0x55cafb250c20 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f522c014ce0 tx=0x7f522c016000 comp rx=0 tx=0).stop 2023-10-07T08:53:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.107+0000 7f5246c85b80 1 -- 172.21.15.81:0/3896664246 shutdown_connections 2023-10-07T08:53:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.107+0000 7f5246c85b80 1 --2- 172.21.15.81:0/3896664246 >> [v2:172.21.15.81:6834/2531199109,v1:172.21.15.81:6836/2531199109] conn(0x55cafb2941f0 0x55cafb2945c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.107+0000 7f5246c85b80 1 --2- 172.21.15.81:0/3896664246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb29fd00 0x55cafb251160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.107+0000 7f5246c85b80 1 --2- 172.21.15.81:0/3896664246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb255a50 0x55cafb2984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.107+0000 7f52157fa700 0 client.8319 ms_handle_reset on v2:172.21.15.81:6834/2531199109 2023-10-07T08:53:55.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.107+0000 7f5246c85b80 1 --2- 172.21.15.81:0/3896664246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb27ef60 0x55cafb250c20 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.107+0000 7f5246c85b80 1 -- 172.21.15.81:0/3896664246 >> 172.21.15.81:0/3896664246 conn(0x55cafb257370 msgr2=0x55cafb29b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:55.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.107+0000 7f5246c85b80 1 -- 172.21.15.81:0/3896664246 shutdown_connections 2023-10-07T08:53:55.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.107+0000 7f5246c85b80 1 -- 172.21.15.81:0/3896664246 wait complete. 2023-10-07T08:53:55.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.108+0000 7f5246c85b80 20 client.8319 trim_cache size 0 max 16384 2023-10-07T08:53:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.124+0000 7f5246c85b80 1 Processor -- start 2023-10-07T08:53:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.124+0000 7f5246c85b80 1 -- start start 2023-10-07T08:53:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f5246c85b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb255a50 0x55cafb2974f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f5246c85b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb27ef60 0x55cafb255e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f5246c85b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb29fd00 0x55cafb256360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f5246c85b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cafb29b2d0 con 0x55cafb255a50 2023-10-07T08:53:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f5246c85b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cafb282930 con 0x55cafb27ef60 2023-10-07T08:53:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f5246c85b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cafb29b0a0 con 0x55cafb29fd00 2023-10-07T08:53:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f5236ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb255a50 0x55cafb2974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f5236ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb255a50 0x55cafb2974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45268/0 (socket says 172.21.15.81:45268) 2023-10-07T08:53:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f5236ffd700 1 -- 172.21.15.81:0/2184919339 learned_addr learned my addr 172.21.15.81:0/2184919339 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f5236ffd700 1 -- 172.21.15.81:0/2184919339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb29fd00 msgr2=0x55cafb256360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:55.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f5236ffd700 1 --2- 172.21.15.81:0/2184919339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb29fd00 0x55cafb256360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f5236ffd700 1 -- 172.21.15.81:0/2184919339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb27ef60 msgr2=0x55cafb255e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:55.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f5236ffd700 1 --2- 172.21.15.81:0/2184919339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb27ef60 0x55cafb255e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f5236ffd700 1 -- 172.21.15.81:0/2184919339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cafb256c50 con 0x55cafb255a50 2023-10-07T08:53:55.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f5236ffd700 1 --2- 172.21.15.81:0/2184919339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb255a50 0x55cafb2974f0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f522800cd00 tx=0x7f522801d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d678e4d1dc0d0730 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:55.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f521cff9700 1 -- 172.21.15.81:0/2184919339 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228058730 con 0x55cafb255a50 2023-10-07T08:53:55.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f521cff9700 1 -- 172.21.15.81:0/2184919339 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522805c480 con 0x55cafb255a50 2023-10-07T08:53:55.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.125+0000 7f521cff9700 1 -- 172.21.15.81:0/2184919339 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228053620 con 0x55cafb255a50 2023-10-07T08:53:55.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.126+0000 7f5246c85b80 1 -- 172.21.15.81:0/2184919339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb255a50 msgr2=0x55cafb2974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.126+0000 7f5246c85b80 1 --2- 172.21.15.81:0/2184919339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb255a50 0x55cafb2974f0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f522800cd00 tx=0x7f522801d040 comp rx=0 tx=0).stop 2023-10-07T08:53:55.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.126+0000 7f5246c85b80 1 -- 172.21.15.81:0/2184919339 shutdown_connections 2023-10-07T08:53:55.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.126+0000 7f5246c85b80 1 --2- 172.21.15.81:0/2184919339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb29fd00 0x55cafb256360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.126+0000 7f5246c85b80 1 --2- 172.21.15.81:0/2184919339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb255a50 0x55cafb2974f0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.126+0000 7f5246c85b80 1 --2- 172.21.15.81:0/2184919339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb27ef60 0x55cafb255e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.126+0000 7f5246c85b80 1 -- 172.21.15.81:0/2184919339 >> 172.21.15.81:0/2184919339 conn(0x55cafb257370 msgr2=0x55cafb284aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:55.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.126+0000 7f5246c85b80 1 -- 172.21.15.81:0/2184919339 shutdown_connections 2023-10-07T08:53:55.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.126+0000 7f5246c85b80 1 -- 172.21.15.81:0/2184919339 wait complete. 2023-10-07T08:53:55.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.126+0000 7f5246c85b80 1 -- start start 2023-10-07T08:53:55.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.127+0000 7f5246c85b80 1 Processor -- start 2023-10-07T08:53:55.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.127+0000 7f5246c85b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb255a50 0x55cafb3016e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.127+0000 7f5246c85b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb27ef60 0x55cafb255e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.127+0000 7f5246c85b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb29fd00 0x55cafb256360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.127+0000 7f5246c85b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cafb302280 con 0x55cafb29fd00 2023-10-07T08:53:55.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.127+0000 7f5246c85b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cafb27e530 con 0x55cafb255a50 2023-10-07T08:53:55.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.127+0000 7f5246c85b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cafb29bd90 con 0x55cafb27ef60 2023-10-07T08:53:55.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.127+0000 7f5246c85b80 10 client.0 _ll_register_callbacks cb 0x55cafb219110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-07T08:53:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f52377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb29fd00 0x55cafb256360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f52377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb29fd00 0x55cafb256360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45270/0 (socket says 172.21.15.81:45270) 2023-10-07T08:53:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f52377fe700 1 -- 172.21.15.81:0/2030048392 learned_addr learned my addr 172.21.15.81:0/2030048392 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f5236ffd700 1 --2- 172.21.15.81:0/2030048392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb255a50 0x55cafb3016e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f52367fc700 1 --2- 172.21.15.81:0/2030048392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb27ef60 0x55cafb255e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f52377fe700 1 -- 172.21.15.81:0/2030048392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb27ef60 msgr2=0x55cafb255e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f52377fe700 1 --2- 172.21.15.81:0/2030048392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb27ef60 0x55cafb255e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f52377fe700 1 -- 172.21.15.81:0/2030048392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb255a50 msgr2=0x55cafb3016e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f52377fe700 1 --2- 172.21.15.81:0/2030048392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb255a50 0x55cafb3016e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f52377fe700 1 -- 172.21.15.81:0/2030048392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5228082e70 con 0x55cafb29fd00 2023-10-07T08:53:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f52377fe700 1 --2- 172.21.15.81:0/2030048392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb29fd00 0x55cafb256360 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f52300094c0 tx=0x7f5230021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413e9aff656a943b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f52157fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-07T08:53:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f52157fa700 1 -- 172.21.15.81:0/2030048392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523000bd50 con 0x55cafb29fd00 2023-10-07T08:53:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f52157fa700 1 -- 172.21.15.81:0/2030048392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(190..190 src has 1..190) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f523001a850 con 0x55cafb29fd00 2023-10-07T08:53:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f5246c85b80 1 -- 172.21.15.81:0/2030048392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f523000b9d0 con 0x55cafb29fd00 2023-10-07T08:53:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f52157fa700 1 -- 172.21.15.81:0/2030048392 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5230038430 con 0x55cafb29fd00 2023-10-07T08:53:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f5246c85b80 10 client.8325 fetch_fsmap learned FSMap version 90 2023-10-07T08:53:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f5246c85b80 1 -- 172.21.15.81:0/2030048392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x55cafb174780 con 0x55cafb29fd00 2023-10-07T08:53:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f52157fa700 1 -- 172.21.15.81:0/2030048392 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523000b9d0 con 0x55cafb29fd00 2023-10-07T08:53:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f52157fa700 1 -- 172.21.15.81:0/2030048392 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 90) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5230038590 con 0x55cafb29fd00 2023-10-07T08:53:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.128+0000 7f5246c85b80 10 client.8325 fetch_fsmap finished waiting for FSMap version 90 2023-10-07T08:53:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5246c85b80 10 client.8325 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-07T08:53:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5246c85b80 20 client.8325 populate_metadata read hostname 'smithi081' 2023-10-07T08:53:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5246c85b80 1 --2- 172.21.15.81:0/2030048392 >> [v2:172.21.15.81:6834/2531199109,v1:172.21.15.81:6836/2531199109] conn(0x55cafb2ab3a0 0x55cafb2ab770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5246c85b80 4 client.8325 mds_command: new command op to 8160 tid=0[{"prefix": "status"}] 2023-10-07T08:53:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5246c85b80 1 -- 172.21.15.81:0/2030048392 --> [v2:172.21.15.81:6834/2531199109,v1:172.21.15.81:6836/2531199109] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cafb148e00 con 0x55cafb2ab3a0 2023-10-07T08:53:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5236ffd700 1 --2- 172.21.15.81:0/2030048392 >> [v2:172.21.15.81:6834/2531199109,v1:172.21.15.81:6836/2531199109] conn(0x55cafb2ab3a0 0x55cafb2ab770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f52157fa700 10 client.8325 ms_handle_connect on v2:172.21.15.81:6834/2531199109 2023-10-07T08:53:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5236ffd700 1 --2- 172.21.15.81:0/2030048392 >> [v2:172.21.15.81:6834/2531199109,v1:172.21.15.81:6836/2531199109] conn(0x55cafb2ab3a0 0x55cafb2ab770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d151cc405d2d7358 server_cookie=bdb9abb85a8ddca2 in_seq=0 out_seq=0 2023-10-07T08:53:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f52157fa700 1 -- 172.21.15.81:0/2030048392 <== mds.0 v2:172.21.15.81:6834/2531199109 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55cafb148e00 con 0x55cafb2ab3a0 2023-10-07T08:53:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f52157fa700 10 client.8325 handle_command_reply: tid=0 2023-10-07T08:53:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5246c85b80 1 client.8325 shutdown 2023-10-07T08:53:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5246c85b80 1 -- 172.21.15.81:0/2030048392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb29fd00 msgr2=0x55cafb256360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5246c85b80 1 --2- 172.21.15.81:0/2030048392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb29fd00 0x55cafb256360 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f52300094c0 tx=0x7f5230021000 comp rx=0 tx=0).stop 2023-10-07T08:53:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5246c85b80 1 -- 172.21.15.81:0/2030048392 shutdown_connections 2023-10-07T08:53:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5246c85b80 1 --2- 172.21.15.81:0/2030048392 >> [v2:172.21.15.81:6834/2531199109,v1:172.21.15.81:6836/2531199109] conn(0x55cafb2ab3a0 0x55cafb2ab770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5246c85b80 1 --2- 172.21.15.81:0/2030048392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cafb29fd00 0x55cafb256360 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5246c85b80 1 --2- 172.21.15.81:0/2030048392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cafb255a50 0x55cafb3016e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5246c85b80 1 --2- 172.21.15.81:0/2030048392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55cafb27ef60 0x55cafb255e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f52157fa700 0 client.8325 ms_handle_reset on v2:172.21.15.81:6834/2531199109 2023-10-07T08:53:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5246c85b80 1 -- 172.21.15.81:0/2030048392 >> 172.21.15.81:0/2030048392 conn(0x55cafb257370 msgr2=0x55cafb298440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:55.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5246c85b80 1 -- 172.21.15.81:0/2030048392 shutdown_connections 2023-10-07T08:53:55.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.129+0000 7f5246c85b80 1 -- 172.21.15.81:0/2030048392 wait complete. 2023-10-07T08:53:55.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.130+0000 7f5246c85b80 20 client.8325 trim_cache size 0 max 16384 2023-10-07T08:53:55.140 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:53:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:53:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-07T08:53:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8160, 2023-10-07T08:53:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-07T08:53:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-07T08:53:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-07T08:53:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.7900082890000002, 2023-10-07T08:53:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 90, 2023-10-07T08:53:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 190, 2023-10-07T08:53:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 190, 2023-10-07T08:53:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 11.114617841999999 2023-10-07T08:53:55.141 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:53:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.130+0000 7f523d98d700 1 -- 172.21.15.81:0/143958233 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5224066f30 msgr2=0x7f52240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.130+0000 7f523d98d700 1 --2- 172.21.15.81:0/143958233 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5224066f30 0x7f52240693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f523816ece0 tx=0x7f522c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.130+0000 7f523d98d700 1 -- 172.21.15.81:0/143958233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523806d650 msgr2=0x7f52381423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.130+0000 7f523d98d700 1 --2- 172.21.15.81:0/143958233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523806d650 0x7f52381423b0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f522800cd30 tx=0x7f5228001af0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.130+0000 7f523d98d700 1 -- 172.21.15.81:0/143958233 shutdown_connections 2023-10-07T08:53:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.130+0000 7f523d98d700 1 --2- 172.21.15.81:0/143958233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f523815a2a0 0x7f523816dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.130+0000 7f523d98d700 1 --2- 172.21.15.81:0/143958233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523806d650 0x7f52381423b0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.130+0000 7f523d98d700 1 --2- 172.21.15.81:0/143958233 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5224066f30 0x7f52240693e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.130+0000 7f523d98d700 1 --2- 172.21.15.81:0/143958233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52380cf240 0x7f523815c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.130+0000 7f523d98d700 1 -- 172.21.15.81:0/143958233 >> 172.21.15.81:0/143958233 conn(0x7f5238067640 msgr2=0x7f52380cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.130+0000 7f523d98d700 1 -- 172.21.15.81:0/143958233 shutdown_connections 2023-10-07T08:53:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.130+0000 7f523d98d700 1 -- 172.21.15.81:0/143958233 wait complete. 2023-10-07T08:53:55.144 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:53:55.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.257+0000 7f3046ab2700 1 Processor -- start 2023-10-07T08:53:55.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.257+0000 7f3046ab2700 1 -- start start 2023-10-07T08:53:55.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.257+0000 7f3046ab2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f30401578d0 0x7f30400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.257+0000 7f3046ab2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30400d07c0 con 0x7f304006d120 2023-10-07T08:53:55.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f3046ab2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30400cfbb0 con 0x7f3040157ca0 2023-10-07T08:53:55.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f3046ab2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30400cfe90 con 0x7f30401578d0 2023-10-07T08:53:55.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f304504f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f304006d120 0x7f304006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58214/0 (socket says 172.21.15.81:58214) 2023-10-07T08:53:55.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f304504f700 1 -- 172.21.15.81:0/1993243249 learned_addr learned my addr 172.21.15.81:0/1993243249 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:55.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f303f7fe700 1 -- 172.21.15.81:0/1993243249 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175109619 0 0) 0x7f30400d07c0 con 0x7f304006d120 2023-10-07T08:53:55.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f304484e700 1 --2- 172.21.15.81:0/1993243249 >> v2:172.21.15.89:3300/0 conn(0x7f30401578d0 0x7f30400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f303f7fe700 1 -- 172.21.15.81:0/1993243249 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3028003570 con 0x7f304006d120 2023-10-07T08:53:55.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f303f7fe700 1 -- 172.21.15.81:0/1993243249 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1298271760 0 0) 0x7f3028003570 con 0x7f304006d120 2023-10-07T08:53:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f303f7fe700 1 -- 172.21.15.81:0/1993243249 >> v2:172.21.15.89:3300/0 conn(0x7f30401578d0 msgr2=0x7f30400cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f303f7fe700 1 --2- 172.21.15.81:0/1993243249 >> v2:172.21.15.89:3300/0 conn(0x7f30401578d0 0x7f30400cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f303f7fe700 1 -- 172.21.15.81:0/1993243249 >> v1:172.21.15.89:6789/0 conn(0x7f3040157ca0 legacy=0x7f304015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f303f7fe700 1 -- 172.21.15.81:0/1993243249 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30400d0170 con 0x7f304006d120 2023-10-07T08:53:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f303f7fe700 1 -- 172.21.15.81:0/1993243249 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f3038001470 con 0x7f304006d120 2023-10-07T08:53:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f303f7fe700 1 -- 172.21.15.81:0/1993243249 >> v1:172.21.15.81:6789/0 conn(0x7f304006d120 legacy=0x7f304006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f303f7fe700 1 --2- 172.21.15.81:0/1993243249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3028003a60 0x7f3028003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f303f7fe700 1 --2- 172.21.15.81:0/1993243249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3028004810 0x7f3028004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f303f7fe700 1 --2- 172.21.15.81:0/1993243249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30280051c0 0x7f302800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f303f7fe700 1 -- 172.21.15.81:0/1993243249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30400cfe90 con 0x7f3028003a60 2023-10-07T08:53:55.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f303f7fe700 1 -- 172.21.15.81:0/1993243249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302800c0d0 con 0x7f30280051c0 2023-10-07T08:53:55.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f303f7fe700 1 -- 172.21.15.81:0/1993243249 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302800c290 con 0x7f3028004810 2023-10-07T08:53:55.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f304484e700 1 --2- 172.21.15.81:0/1993243249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3028003a60 0x7f3028003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f304504f700 1 --2- 172.21.15.81:0/1993243249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30280051c0 0x7f302800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.258+0000 7f303ffff700 1 --2- 172.21.15.81:0/1993243249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3028004810 0x7f3028004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.259+0000 7f304484e700 1 -- 172.21.15.81:0/1993243249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3028004810 msgr2=0x7f3028004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:55.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.259+0000 7f304484e700 1 --2- 172.21.15.81:0/1993243249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3028004810 0x7f3028004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.259+0000 7f304484e700 1 -- 172.21.15.81:0/1993243249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30280051c0 msgr2=0x7f302800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:55.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.259+0000 7f304484e700 1 --2- 172.21.15.81:0/1993243249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30280051c0 0x7f302800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.259+0000 7f304484e700 1 -- 172.21.15.81:0/1993243249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3028003570 con 0x7f3028003a60 2023-10-07T08:53:55.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.259+0000 7f304504f700 1 -- 172.21.15.81:0/1993243249 reap_dead start 2023-10-07T08:53:55.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.259+0000 7f303ffff700 1 --2- 172.21.15.81:0/1993243249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3028004810 0x7f3028004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:53:55.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.259+0000 7f304484e700 1 --2- 172.21.15.81:0/1993243249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3028003a60 0x7f3028003e70 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f303000e210 tx=0x7f303000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e611cfada26792 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:55.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.259+0000 7f303f7fe700 1 -- 172.21.15.81:0/1993243249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303000eac0 con 0x7f3028003a60 2023-10-07T08:53:55.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.259+0000 7f303f7fe700 1 -- 172.21.15.81:0/1993243249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303000f040 con 0x7f3028003a60 2023-10-07T08:53:55.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.259+0000 7f303f7fe700 1 -- 172.21.15.81:0/1993243249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303000ee70 con 0x7f3028003a60 2023-10-07T08:53:55.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.259+0000 7f3046ab2700 1 -- 172.21.15.81:0/1993243249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3028003a60 msgr2=0x7f3028003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.259+0000 7f3046ab2700 1 --2- 172.21.15.81:0/1993243249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3028003a60 0x7f3028003e70 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f303000e210 tx=0x7f303000b040 comp rx=0 tx=0).stop 2023-10-07T08:53:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.259+0000 7f3046ab2700 1 -- 172.21.15.81:0/1993243249 shutdown_connections 2023-10-07T08:53:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.259+0000 7f3046ab2700 1 --2- 172.21.15.81:0/1993243249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3028003a60 0x7f3028003e70 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.259+0000 7f3046ab2700 1 -- 172.21.15.81:0/1993243249 >> 172.21.15.81:0/1993243249 conn(0x7f304006bb90 msgr2=0x7f304006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.260+0000 7f3046ab2700 1 -- 172.21.15.81:0/1993243249 shutdown_connections 2023-10-07T08:53:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.260+0000 7f3046ab2700 1 -- 172.21.15.81:0/1993243249 wait complete. 2023-10-07T08:53:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.261+0000 7f3046ab2700 1 Processor -- start 2023-10-07T08:53:55.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.261+0000 7f3046ab2700 1 -- start start 2023-10-07T08:53:55.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.261+0000 7f3046ab2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3028003a60 0x7f30400c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.261+0000 7f3046ab2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304016e530 0x7f3040156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.261+0000 7f3046ab2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30400c75e0 0x7f3040156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.261+0000 7f3046ab2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304016b320 con 0x7f304016e530 2023-10-07T08:53:55.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.261+0000 7f3046ab2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304016e0a0 con 0x7f3028003a60 2023-10-07T08:53:55.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.261+0000 7f3046ab2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304016da90 con 0x7f30400c75e0 2023-10-07T08:53:55.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f303ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304016e530 0x7f3040156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f303ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304016e530 0x7f3040156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45276/0 (socket says 172.21.15.81:45276) 2023-10-07T08:53:55.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f303ffff700 1 -- 172.21.15.81:0/3951558703 learned_addr learned my addr 172.21.15.81:0/3951558703 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:55.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f304504f700 1 --2- 172.21.15.81:0/3951558703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30400c75e0 0x7f3040156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f304484e700 1 --2- 172.21.15.81:0/3951558703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3028003a60 0x7f30400c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f303ffff700 1 -- 172.21.15.81:0/3951558703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30400c75e0 msgr2=0x7f3040156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f303ffff700 1 --2- 172.21.15.81:0/3951558703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30400c75e0 0x7f3040156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f303ffff700 1 -- 172.21.15.81:0/3951558703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3028003a60 msgr2=0x7f30400c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f303ffff700 1 --2- 172.21.15.81:0/3951558703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3028003a60 0x7f30400c70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f303ffff700 1 -- 172.21.15.81:0/3951558703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304016b040 con 0x7f304016e530 2023-10-07T08:53:55.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f304484e700 1 --2- 172.21.15.81:0/3951558703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3028003a60 0x7f30400c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:53:55.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f303ffff700 1 --2- 172.21.15.81:0/3951558703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304016e530 0x7f3040156580 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f3034001eb0 tx=0x7f3034009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:55.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f303cff9700 1 -- 172.21.15.81:0/3951558703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30340115c0 con 0x7f304016e530 2023-10-07T08:53:55.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f303cff9700 1 -- 172.21.15.81:0/3951558703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3034011720 con 0x7f304016e530 2023-10-07T08:53:55.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f3046ab2700 1 -- 172.21.15.81:0/3951558703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304016dd30 con 0x7f304016e530 2023-10-07T08:53:55.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f303cff9700 1 -- 172.21.15.81:0/3951558703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3034011ae0 con 0x7f304016e530 2023-10-07T08:53:55.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.262+0000 7f3046ab2700 1 -- 172.21.15.81:0/3951558703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304016a520 con 0x7f304016e530 2023-10-07T08:53:55.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.263+0000 7f3046ab2700 1 -- 172.21.15.81:0/3951558703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304016d8f0 con 0x7f304016e530 2023-10-07T08:53:55.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.263+0000 7f303cff9700 1 -- 172.21.15.81:0/3951558703 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3034014480 con 0x7f304016e530 2023-10-07T08:53:55.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.264+0000 7f303cff9700 1 --2- 172.21.15.81:0/3951558703 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f302c066f30 0x7f302c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:55.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.264+0000 7f304484e700 1 --2- 172.21.15.81:0/3951558703 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f302c066f30 0x7f302c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:55.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.264+0000 7f303cff9700 1 -- 172.21.15.81:0/3951558703 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3034083e50 con 0x7f304016e530 2023-10-07T08:53:55.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.264+0000 7f304484e700 1 --2- 172.21.15.81:0/3951558703 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f302c066f30 0x7f302c0693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f303000afd0 tx=0x7f303001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:55.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.268+0000 7f303cff9700 1 -- 172.21.15.81:0/3951558703 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f303404d5a0 con 0x7f304016e530 2023-10-07T08:53:55.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.493+0000 7f3046ab2700 1 -- 172.21.15.81:0/3951558703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f304016e210 con 0x7f304016e530 2023-10-07T08:53:55.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.493+0000 7f303cff9700 1 -- 172.21.15.81:0/3951558703 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v90) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3034019020 con 0x7f304016e530 2023-10-07T08:53:55.495 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:53:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.495+0000 7f3046ab2700 1 -- 172.21.15.81:0/3951558703 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f302c066f30 msgr2=0x7f302c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.495+0000 7f3046ab2700 1 --2- 172.21.15.81:0/3951558703 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f302c066f30 0x7f302c0693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f303000afd0 tx=0x7f303001a000 comp rx=0 tx=0).stop 2023-10-07T08:53:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.495+0000 7f3046ab2700 1 -- 172.21.15.81:0/3951558703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304016e530 msgr2=0x7f3040156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.495+0000 7f3046ab2700 1 --2- 172.21.15.81:0/3951558703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304016e530 0x7f3040156580 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f3034001eb0 tx=0x7f3034009040 comp rx=0 tx=0).stop 2023-10-07T08:53:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.495+0000 7f3046ab2700 1 -- 172.21.15.81:0/3951558703 shutdown_connections 2023-10-07T08:53:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.495+0000 7f3046ab2700 1 --2- 172.21.15.81:0/3951558703 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f302c066f30 0x7f302c0693e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.495+0000 7f3046ab2700 1 --2- 172.21.15.81:0/3951558703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30400c75e0 0x7f3040156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.495+0000 7f3046ab2700 1 --2- 172.21.15.81:0/3951558703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3028003a60 0x7f30400c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.495+0000 7f3046ab2700 1 --2- 172.21.15.81:0/3951558703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304016e530 0x7f3040156580 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.495+0000 7f3046ab2700 1 -- 172.21.15.81:0/3951558703 >> 172.21.15.81:0/3951558703 conn(0x7f304006bb90 msgr2=0x7f304006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:55.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.495+0000 7f3046ab2700 1 -- 172.21.15.81:0/3951558703 shutdown_connections 2023-10-07T08:53:55.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:55.495+0000 7f3046ab2700 1 -- 172.21.15.81:0/3951558703 wait complete. 2023-10-07T08:53:55.508 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:53:55.508 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:53:55.508 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-07T08:53:55.509 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-07T08:53:55.509 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-07T08:53:55.509 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:53:55.509 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:53:55.509 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:53:55.509 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:53:55.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:53:55.509 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-07T08:53:55.524 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:53:55.524 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:53:55.525 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:53:55.525 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:53:55.525 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-07T08:53:55.525 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:53:55.525 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:53:55.525 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:53:55.525 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-10-07T08:53:55.525 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:53:55.525 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:53:55.525 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-10-07T08:53:55.525 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:53:55.525 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:53:55.526 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:53:55.526 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:53:55.526 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:53:55.526 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 41893sec preferred_lft 41893sec 2023-10-07T08:53:55.526 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-10-07T08:53:55.526 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:53:55.526 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:53:55.526 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff 2023-10-07T08:53:55.526 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:53:55.526 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:53:55.526 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::8c72:9ff:fe74:8c7e/64 scope link 2023-10-07T08:53:55.527 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:53:55.527 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:53:55.527 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:fe:81:9d:9c:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T08:53:55.527 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8fe:81ff:fe9d:9c0a/64 scope link 2023-10-07T08:53:55.527 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:53:55.527 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:53:55.527 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:38:b7:6e:91:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T08:53:55.527 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d838:b7ff:fe6e:914d/64 scope link 2023-10-07T08:53:55.527 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:53:55.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:53:55.528 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:53:55.588 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-07T08:53:55.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:53:55.589 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-07T08:53:55.645 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-07T08:53:55.645 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:53:55.645 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:53:55.645 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:53:55.645 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:53:55.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:53:55.646 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-07T08:53:55.646 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-07T08:53:55.646 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:53:55.646 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:53:55.646 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:53:55.646 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-07T08:53:55.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:53:55.745 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-07T08:53:55.759 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T08:53:55.759 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T08:53:55.759 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:53:55.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:53:55.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-07T08:53:55.823 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:53:55.824 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-07T08:53:55.879 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-07T08:53:55.879 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:53:55.879 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:53:55.933 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:53:55.933 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:53:55.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:53:56.013 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:53:56.013 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:53:56.013 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:53:56.021 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:53:56.022 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:53:56.022 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:53:56.022 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:53:56.022 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:53:56.043 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-07T08:53:56.044 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-07T08:53:56.044 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-07T08:53:56.044 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:53:56.044 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:53:56.044 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:53:56.044 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:53:56.044 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:53:56.045 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:53:56.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:53:56.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-07T08:53:56.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-07T08:53:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.265+0000 7f1360839700 1 Processor -- start 2023-10-07T08:53:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.265+0000 7f1360839700 1 -- start start 2023-10-07T08:53:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.266+0000 7f1360839700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c0af270 0x7f135c0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.266+0000 7f1360839700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f135c0c3030 0x7f135c0c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.266+0000 7f1360839700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135c06aae0 con 0x7f135c0aeea0 2023-10-07T08:53:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.266+0000 7f1360839700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135c0c8780 con 0x7f135c0c3030 2023-10-07T08:53:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.266+0000 7f1360839700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c069ed0 con 0x7f135c0af270 2023-10-07T08:53:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.266+0000 7f135ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f135c0c3030 0x7f135c0c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.266+0000 7f135a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f135c0aeea0 0x7f135c0c2920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58226/0 (socket says 172.21.15.81:58226) 2023-10-07T08:53:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.266+0000 7f135a59c700 1 -- 172.21.15.81:0/1921663861 learned_addr learned my addr 172.21.15.81:0/1921663861 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.267+0000 7f1359d9b700 1 --2- 172.21.15.81:0/1921663861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c0af270 0x7f135c0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.267+0000 7f135ad9d700 1 -- 172.21.15.81:0/1921663861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c0af270 msgr2=0x7f135c0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.267+0000 7f135ad9d700 1 --2- 172.21.15.81:0/1921663861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c0af270 0x7f135c0c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.267+0000 7f135ad9d700 1 -- 172.21.15.81:0/1921663861 >> v1:172.21.15.81:6789/0 conn(0x7f135c0aeea0 legacy=0x7f135c0c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.267+0000 7f135ad9d700 1 -- 172.21.15.81:0/1921663861 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c06a1b0 con 0x7f135c0c3030 2023-10-07T08:53:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.267+0000 7f135959a700 1 -- 172.21.15.81:0/1921663861 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756266001 0 0) 0x7f135c06aae0 con 0x7f135c0aeea0 2023-10-07T08:53:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.267+0000 7f135ad9d700 1 --2- 172.21.15.81:0/1921663861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c0c3030 0x7f135c0c8240 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f13540098e0 tx=0x7f13540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6981a0e7d6950a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.267+0000 7f135959a700 1 -- 172.21.15.81:0/1921663861 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354009e80 con 0x7f135c0c3030 2023-10-07T08:53:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.267+0000 7f135959a700 1 -- 172.21.15.81:0/1921663861 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135400b8f0 con 0x7f135c0c3030 2023-10-07T08:53:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.267+0000 7f135959a700 1 -- 172.21.15.81:0/1921663861 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135400bc70 con 0x7f135c0c3030 2023-10-07T08:53:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.267+0000 7f1360839700 1 -- 172.21.15.81:0/1921663861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c0c3030 msgr2=0x7f135c0c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.267+0000 7f1360839700 1 --2- 172.21.15.81:0/1921663861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c0c3030 0x7f135c0c8240 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f13540098e0 tx=0x7f13540091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.268+0000 7f1360839700 1 -- 172.21.15.81:0/1921663861 shutdown_connections 2023-10-07T08:53:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.268+0000 7f1360839700 1 --2- 172.21.15.81:0/1921663861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c0c3030 0x7f135c0c8240 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.268+0000 7f1360839700 1 --2- 172.21.15.81:0/1921663861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c0af270 0x7f135c0c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.268+0000 7f1360839700 1 -- 172.21.15.81:0/1921663861 >> 172.21.15.81:0/1921663861 conn(0x7f135c06c660 msgr2=0x7f135c0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.268+0000 7f1360839700 1 -- 172.21.15.81:0/1921663861 shutdown_connections 2023-10-07T08:53:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.268+0000 7f1360839700 1 -- 172.21.15.81:0/1921663861 wait complete. 2023-10-07T08:53:56.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.269+0000 7f1360839700 1 Processor -- start 2023-10-07T08:53:56.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.269+0000 7f1360839700 1 -- start start 2023-10-07T08:53:56.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.269+0000 7f1360839700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c0aeea0 0x7f135c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:56.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.269+0000 7f1360839700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c0af270 0x7f135c155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:56.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.269+0000 7f1360839700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f135c0c3030 0x7f135c1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:56.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.269+0000 7f1360839700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0afaa0 con 0x7f135c0af270 2023-10-07T08:53:56.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.269+0000 7f1360839700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0c1f40 con 0x7f135c0c3030 2023-10-07T08:53:56.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.269+0000 7f1360839700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0c21a0 con 0x7f135c0aeea0 2023-10-07T08:53:56.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.270+0000 7f1359d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c0af270 0x7f135c155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:56.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.270+0000 7f1359d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c0af270 0x7f135c155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45298/0 (socket says 172.21.15.81:45298) 2023-10-07T08:53:56.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.270+0000 7f1359d9b700 1 -- 172.21.15.81:0/1185881898 learned_addr learned my addr 172.21.15.81:0/1185881898 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:56.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.270+0000 7f135a59c700 1 --2- 172.21.15.81:0/1185881898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c0aeea0 0x7f135c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:56.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.270+0000 7f135ad9d700 1 --2- 172.21.15.81:0/1185881898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f135c0c3030 0x7f135c1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:56.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.270+0000 7f1359d9b700 1 -- 172.21.15.81:0/1185881898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c0aeea0 msgr2=0x7f135c0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:56.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.270+0000 7f1359d9b700 1 --2- 172.21.15.81:0/1185881898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c0aeea0 0x7f135c0c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:56.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.270+0000 7f1359d9b700 1 -- 172.21.15.81:0/1185881898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f135c0c3030 msgr2=0x7f135c1561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:56.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.270+0000 7f1359d9b700 1 --2- 172.21.15.81:0/1185881898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f135c0c3030 0x7f135c1561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:56.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.270+0000 7f1359d9b700 1 -- 172.21.15.81:0/1185881898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1354009420 con 0x7f135c0af270 2023-10-07T08:53:56.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.270+0000 7f1359d9b700 1 --2- 172.21.15.81:0/1185881898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c0af270 0x7f135c155c80 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f135000d890 tx=0x7f1350008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:56.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.270+0000 7f134a7fc700 1 -- 172.21.15.81:0/1185881898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135000b600 con 0x7f135c0af270 2023-10-07T08:53:56.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.270+0000 7f134a7fc700 1 -- 172.21.15.81:0/1185881898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135000b760 con 0x7f135c0af270 2023-10-07T08:53:56.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.270+0000 7f1360839700 1 -- 172.21.15.81:0/1185881898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c0c2480 con 0x7f135c0af270 2023-10-07T08:53:56.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.270+0000 7f134a7fc700 1 -- 172.21.15.81:0/1185881898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135000bae0 con 0x7f135c0af270 2023-10-07T08:53:56.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.270+0000 7f1360839700 1 -- 172.21.15.81:0/1185881898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135c0afcf0 con 0x7f135c0af270 2023-10-07T08:53:56.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.271+0000 7f1360839700 1 -- 172.21.15.81:0/1185881898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135c067bc0 con 0x7f135c0af270 2023-10-07T08:53:56.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.271+0000 7f134a7fc700 1 -- 172.21.15.81:0/1185881898 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f135001e460 con 0x7f135c0af270 2023-10-07T08:53:56.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.272+0000 7f134a7fc700 1 --2- 172.21.15.81:0/1185881898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f133c066f30 0x7f133c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:56.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.272+0000 7f134a7fc700 1 -- 172.21.15.81:0/1185881898 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1350084bc0 con 0x7f135c0af270 2023-10-07T08:53:56.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.272+0000 7f135a59c700 1 --2- 172.21.15.81:0/1185881898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f133c066f30 0x7f133c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:56.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.272+0000 7f135a59c700 1 --2- 172.21.15.81:0/1185881898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f133c066f30 0x7f133c0693e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f135c156a30 tx=0x7f134c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:56.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.276+0000 7f134a7fc700 1 -- 172.21.15.81:0/1185881898 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1350051e30 con 0x7f135c0af270 2023-10-07T08:53:56.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:53:56.486 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:53:56.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.503+0000 7f1360839700 1 -- 172.21.15.81:0/1185881898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f135c06a490 con 0x7f135c0af270 2023-10-07T08:53:56.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.503+0000 7f134a7fc700 1 -- 172.21.15.81:0/1185881898 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v90) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1350055450 con 0x7f135c0af270 2023-10-07T08:53:56.505 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-07T08:53:56.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.506+0000 7f1360839700 1 -- 172.21.15.81:0/1185881898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f133c066f30 msgr2=0x7f133c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:56.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.506+0000 7f1360839700 1 --2- 172.21.15.81:0/1185881898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f133c066f30 0x7f133c0693e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f135c156a30 tx=0x7f134c009040 comp rx=0 tx=0).stop 2023-10-07T08:53:56.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.506+0000 7f1360839700 1 -- 172.21.15.81:0/1185881898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c0af270 msgr2=0x7f135c155c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:56.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.506+0000 7f1360839700 1 --2- 172.21.15.81:0/1185881898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c0af270 0x7f135c155c80 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f135000d890 tx=0x7f1350008040 comp rx=0 tx=0).stop 2023-10-07T08:53:56.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.506+0000 7f1360839700 1 -- 172.21.15.81:0/1185881898 shutdown_connections 2023-10-07T08:53:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.506+0000 7f1360839700 1 --2- 172.21.15.81:0/1185881898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f135c0c3030 0x7f135c1561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.506+0000 7f1360839700 1 --2- 172.21.15.81:0/1185881898 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f133c066f30 0x7f133c0693e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.506+0000 7f1360839700 1 --2- 172.21.15.81:0/1185881898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f135c0aeea0 0x7f135c0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.506+0000 7f1360839700 1 --2- 172.21.15.81:0/1185881898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135c0af270 0x7f135c155c80 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.506+0000 7f1360839700 1 -- 172.21.15.81:0/1185881898 >> 172.21.15.81:0/1185881898 conn(0x7f135c06c660 msgr2=0x7f135c14d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.506+0000 7f1360839700 1 -- 172.21.15.81:0/1185881898 shutdown_connections 2023-10-07T08:53:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:56.506+0000 7f1360839700 1 -- 172.21.15.81:0/1185881898 wait complete. 2023-10-07T08:53:56.519 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-07T08:53:56.519 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-07T08:53:56.519 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-07T08:53:56.519 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-07T08:53:56.520 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-07T08:53:56.520 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-07T08:53:56.520 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-07T08:53:56.520 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-07T08:53:56.520 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:53:56.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:53:56.521 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-07T08:53:56.553 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-07T08:53:56.553 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-07T08:53:56.553 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-07T08:53:56.553 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:53:56.553 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-07T08:53:56.553 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:53:56.554 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:53:56.554 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:53:56.554 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-10-07T08:53:56.554 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:53:56.554 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:53:56.554 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-10-07T08:53:56.554 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-07T08:53:56.554 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:53:56.554 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-07T08:53:56.555 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:53:56.555 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-07T08:53:56.555 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 41892sec preferred_lft 41892sec 2023-10-07T08:53:56.555 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2023-10-07T08:53:56.555 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:53:56.555 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-07T08:53:56.555 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff 2023-10-07T08:53:56.556 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-07T08:53:56.556 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:53:56.556 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::74d7:a9ff:fe87:ed9/64 scope link 2023-10-07T08:53:56.556 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:53:56.556 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:53:56.556 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 6e:40:c5:3a:0a:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T08:53:56.556 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6c40:c5ff:fe3a:a57/64 scope link 2023-10-07T08:53:56.556 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:53:56.557 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-07T08:53:56.557 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether de:db:cd:68:b1:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T08:53:56.557 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::dcdb:cdff:fe68:b178/64 scope link 2023-10-07T08:53:56.557 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-07T08:53:56.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:53:56.558 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-07T08:53:56.620 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-07T08:53:56.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:53:56.622 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-07T08:53:56.681 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-07T08:53:56.681 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-07T08:53:56.681 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-07T08:53:56.681 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-07T08:53:56.681 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-07T08:53:56.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:53:56.682 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-07T08:53:56.682 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-07T08:53:56.682 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-07T08:53:56.682 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-07T08:53:56.682 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-07T08:53:56.682 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-07T08:53:56.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:53:56.786 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-07T08:53:56.800 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T08:53:56.801 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T08:53:56.801 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:53:56.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:53:56.801 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-07T08:53:56.865 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:53:56.865 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-07T08:53:56.920 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-07T08:53:56.920 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-07T08:53:56.921 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:53:56.974 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-07T08:53:56.974 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-07T08:53:56.975 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:53:57.054 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:53:57.054 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:53:57.054 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:53:57.062 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:53:57.062 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:53:57.062 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:53:57.063 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:53:57.063 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:53:57.084 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-07T08:53:57.084 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-07T08:53:57.084 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-10-07T08:53:57.084 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-07T08:53:57.084 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-07T08:53:57.084 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-07T08:53:57.084 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-07T08:53:57.084 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f2fc6535-cadc-4a0b-bdad-da2d602c784a" will pass to kernel 2023-10-07T08:53:57.086 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-07T08:53:57.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:53:57.087 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-07T08:53:57.152 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:53:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.266+0000 7fa15d7aa700 1 Processor -- start 2023-10-07T08:53:57.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.266+0000 7fa15d7aa700 1 -- start start 2023-10-07T08:53:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.267+0000 7fa15d7aa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa158159f10 0x7fa158068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.267+0000 7fa15d7aa700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1580cee10 con 0x7fa158068cc0 2023-10-07T08:53:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.267+0000 7fa15d7aa700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1580cd040 con 0x7fa158159b40 2023-10-07T08:53:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.267+0000 7fa15d7aa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa158069140 con 0x7fa158159f10 2023-10-07T08:53:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.267+0000 7fa15cfa9700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa158068cc0 0x7fa1580cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58238/0 (socket says 172.21.15.81:58238) 2023-10-07T08:53:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.267+0000 7fa15cfa9700 1 -- 172.21.15.81:0/428172173 learned_addr learned my addr 172.21.15.81:0/428172173 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.267+0000 7fa1577fe700 1 --2- 172.21.15.81:0/428172173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa158159f10 0x7fa158068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.267+0000 7fa156ffd700 1 -- 172.21.15.81:0/428172173 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239458019 0 0) 0x7fa1580cee10 con 0x7fa158068cc0 2023-10-07T08:53:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.267+0000 7fa156ffd700 1 -- 172.21.15.81:0/428172173 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa140003570 con 0x7fa158068cc0 2023-10-07T08:53:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 -- 172.21.15.81:0/428172173 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327851282 0 0) 0x7fa1580cd040 con 0x7fa158159b40 2023-10-07T08:53:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 -- 172.21.15.81:0/428172173 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1580cee10 con 0x7fa158159b40 2023-10-07T08:53:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 -- 172.21.15.81:0/428172173 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1522320933 0 0) 0x7fa140003570 con 0x7fa158068cc0 2023-10-07T08:53:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 -- 172.21.15.81:0/428172173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa158159f10 msgr2=0x7fa158068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 --2- 172.21.15.81:0/428172173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa158159f10 0x7fa158068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 -- 172.21.15.81:0/428172173 >> v1:172.21.15.89:6789/0 conn(0x7fa158159b40 legacy=0x7fa1580cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 -- 172.21.15.81:0/428172173 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1580cd320 con 0x7fa158068cc0 2023-10-07T08:53:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 -- 172.21.15.81:0/428172173 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fa1500017f0 con 0x7fa158068cc0 2023-10-07T08:53:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 -- 172.21.15.81:0/428172173 >> v1:172.21.15.81:6789/0 conn(0x7fa158068cc0 legacy=0x7fa1580cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 --2- 172.21.15.81:0/428172173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa140003c20 0x7fa140004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 --2- 172.21.15.81:0/428172173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa158159f10 0x7fa140004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 --2- 172.21.15.81:0/428172173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140004d50 0x7fa1400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 -- 172.21.15.81:0/428172173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa158069140 con 0x7fa140003c20 2023-10-07T08:53:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 -- 172.21.15.81:0/428172173 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14000bb40 con 0x7fa140004d50 2023-10-07T08:53:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 -- 172.21.15.81:0/428172173 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14000bd00 con 0x7fa158159f10 2023-10-07T08:53:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa157fff700 1 --2- 172.21.15.81:0/428172173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa140003c20 0x7fa140004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa1577fe700 1 --2- 172.21.15.81:0/428172173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa158159f10 0x7fa140004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa15cfa9700 1 --2- 172.21.15.81:0/428172173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140004d50 0x7fa1400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa157fff700 1 -- 172.21.15.81:0/428172173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa158159f10 msgr2=0x7fa140004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa157fff700 1 --2- 172.21.15.81:0/428172173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa158159f10 0x7fa140004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa157fff700 1 -- 172.21.15.81:0/428172173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140004d50 msgr2=0x7fa1400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:53:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa157fff700 1 --2- 172.21.15.81:0/428172173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140004d50 0x7fa1400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa157fff700 1 -- 172.21.15.81:0/428172173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa140003570 con 0x7fa140003c20 2023-10-07T08:53:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa15cfa9700 1 --2- 172.21.15.81:0/428172173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140004d50 0x7fa1400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:53:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa157fff700 1 --2- 172.21.15.81:0/428172173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa140003c20 0x7fa140004010 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fa148001a10 tx=0x7fa148007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb33d404827d5a32 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 -- 172.21.15.81:0/428172173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14800c5d0 con 0x7fa140003c20 2023-10-07T08:53:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 -- 172.21.15.81:0/428172173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14800c730 con 0x7fa140003c20 2023-10-07T08:53:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.268+0000 7fa156ffd700 1 -- 172.21.15.81:0/428172173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14800cad0 con 0x7fa140003c20 2023-10-07T08:53:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.269+0000 7fa15d7aa700 1 -- 172.21.15.81:0/428172173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa140003c20 msgr2=0x7fa140004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.269+0000 7fa15d7aa700 1 --2- 172.21.15.81:0/428172173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa140003c20 0x7fa140004010 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fa148001a10 tx=0x7fa148007d30 comp rx=0 tx=0).stop 2023-10-07T08:53:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.269+0000 7fa15cfa9700 1 -- 172.21.15.81:0/428172173 reap_dead start 2023-10-07T08:53:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.269+0000 7fa15d7aa700 1 -- 172.21.15.81:0/428172173 shutdown_connections 2023-10-07T08:53:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.269+0000 7fa15d7aa700 1 -- 172.21.15.81:0/428172173 >> 172.21.15.81:0/428172173 conn(0x7fa1580cd660 msgr2=0x7fa1580cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:57.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.269+0000 7fa15d7aa700 1 -- 172.21.15.81:0/428172173 shutdown_connections 2023-10-07T08:53:57.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.269+0000 7fa15d7aa700 1 -- 172.21.15.81:0/428172173 wait complete. 2023-10-07T08:53:57.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.270+0000 7fa15d7aa700 1 Processor -- start 2023-10-07T08:53:57.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.270+0000 7fa15d7aa700 1 -- start start 2023-10-07T08:53:57.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa15d7aa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140003c20 0x7fa1580aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:57.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa15d7aa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1580adc10 0x7fa1580ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:57.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa15d7aa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa15814e550 0x7fa1580cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:57.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa15d7aa700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1580ad780 con 0x7fa1580adc10 2023-10-07T08:53:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa15d7aa700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1580ae080 con 0x7fa140003c20 2023-10-07T08:53:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa15d7aa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1580acb70 con 0x7fa15814e550 2023-10-07T08:53:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa1577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1580adc10 0x7fa1580ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa1577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1580adc10 0x7fa1580ac2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45320/0 (socket says 172.21.15.81:45320) 2023-10-07T08:53:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa1577fe700 1 -- 172.21.15.81:0/383453149 learned_addr learned my addr 172.21.15.81:0/383453149 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa157fff700 1 --2- 172.21.15.81:0/383453149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140003c20 0x7fa1580aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa15cfa9700 1 --2- 172.21.15.81:0/383453149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa15814e550 0x7fa1580cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa1577fe700 1 -- 172.21.15.81:0/383453149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa15814e550 msgr2=0x7fa1580cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa1577fe700 1 --2- 172.21.15.81:0/383453149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa15814e550 0x7fa1580cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa1577fe700 1 -- 172.21.15.81:0/383453149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140003c20 msgr2=0x7fa1580aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa1577fe700 1 --2- 172.21.15.81:0/383453149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140003c20 0x7fa1580aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa1577fe700 1 -- 172.21.15.81:0/383453149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1580ace50 con 0x7fa1580adc10 2023-10-07T08:53:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.271+0000 7fa1577fe700 1 --2- 172.21.15.81:0/383453149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1580adc10 0x7fa1580ac2f0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fa14c011d40 tx=0x7fa14c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.272+0000 7fa13ffff700 1 -- 172.21.15.81:0/383453149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c00fac0 con 0x7fa1580adc10 2023-10-07T08:53:57.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.272+0000 7fa13ffff700 1 -- 172.21.15.81:0/383453149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c00fc20 con 0x7fa1580adc10 2023-10-07T08:53:57.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.272+0000 7fa13ffff700 1 -- 172.21.15.81:0/383453149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c014440 con 0x7fa1580adc10 2023-10-07T08:53:57.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.272+0000 7fa15d7aa700 1 -- 172.21.15.81:0/383453149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1580ad130 con 0x7fa1580adc10 2023-10-07T08:53:57.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.272+0000 7fa15d7aa700 1 -- 172.21.15.81:0/383453149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1580ac830 con 0x7fa1580adc10 2023-10-07T08:53:57.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.273+0000 7fa15d7aa700 1 -- 172.21.15.81:0/383453149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1580ad8f0 con 0x7fa1580adc10 2023-10-07T08:53:57.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.273+0000 7fa13ffff700 1 -- 172.21.15.81:0/383453149 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa14c014870 con 0x7fa1580adc10 2023-10-07T08:53:57.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.273+0000 7fa13ffff700 1 --2- 172.21.15.81:0/383453149 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa144066f30 0x7fa1440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:57.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.274+0000 7fa13ffff700 1 -- 172.21.15.81:0/383453149 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa14c018030 con 0x7fa1580adc10 2023-10-07T08:53:57.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.274+0000 7fa157fff700 1 --2- 172.21.15.81:0/383453149 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa144066f30 0x7fa1440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:57.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.274+0000 7fa157fff700 1 --2- 172.21.15.81:0/383453149 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa144066f30 0x7fa1440693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa148000c00 tx=0x7fa148015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:57.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.278+0000 7fa13ffff700 1 -- 172.21.15.81:0/383453149 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa14c052280 con 0x7fa1580adc10 2023-10-07T08:53:57.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.502+0000 7fa15d7aa700 1 -- 172.21.15.81:0/383453149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1580ada80 con 0x7fa1580adc10 2023-10-07T08:53:57.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.502+0000 7fa13ffff700 1 -- 172.21.15.81:0/383453149 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fa14c022090 con 0x7fa1580adc10 2023-10-07T08:53:57.504 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:57.504 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1601080758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1601080758},{"type":"v1","addr":"172.21.15.81:6837","nonce":1601080758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2709611313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2709611313},{"type":"v1","addr":"172.21.15.89:6835","nonce":2709611313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/3085029167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3085029167},{"type":"v1","addr":"172.21.15.89:6834","nonce":3085029167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:53:48.496016+0000","modified":"2023-10-07T08:53:52.345717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6836/2531199109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2531199109},{"type":"v1","addr":"172.21.15.81:6836","nonce":2531199109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-07T08:53:57.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.504+0000 7fa15d7aa700 1 -- 172.21.15.81:0/383453149 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa144066f30 msgr2=0x7fa1440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:57.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.504+0000 7fa15d7aa700 1 --2- 172.21.15.81:0/383453149 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa144066f30 0x7fa1440693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa148000c00 tx=0x7fa148015000 comp rx=0 tx=0).stop 2023-10-07T08:53:57.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.504+0000 7fa15d7aa700 1 -- 172.21.15.81:0/383453149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1580adc10 msgr2=0x7fa1580ac2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:57.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.504+0000 7fa15d7aa700 1 --2- 172.21.15.81:0/383453149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1580adc10 0x7fa1580ac2f0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fa14c011d40 tx=0x7fa14c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:57.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.504+0000 7fa15d7aa700 1 -- 172.21.15.81:0/383453149 shutdown_connections 2023-10-07T08:53:57.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.504+0000 7fa15d7aa700 1 --2- 172.21.15.81:0/383453149 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa144066f30 0x7fa1440693e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:57.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.504+0000 7fa15d7aa700 1 --2- 172.21.15.81:0/383453149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa15814e550 0x7fa1580cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:57.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.504+0000 7fa15d7aa700 1 --2- 172.21.15.81:0/383453149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa140003c20 0x7fa1580aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:57.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.504+0000 7fa15d7aa700 1 --2- 172.21.15.81:0/383453149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1580adc10 0x7fa1580ac2f0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:57.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.504+0000 7fa15d7aa700 1 -- 172.21.15.81:0/383453149 >> 172.21.15.81:0/383453149 conn(0x7fa1580cd660 msgr2=0x7fa15806df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:57.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.504+0000 7fa15d7aa700 1 -- 172.21.15.81:0/383453149 shutdown_connections 2023-10-07T08:53:57.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.504+0000 7fa15d7aa700 1 -- 172.21.15.81:0/383453149 wait complete. 2023-10-07T08:53:57.507 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-07T08:53:57.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-07T08:53:57.651 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":8160,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3005400940000005,"mdsmap_epoch":90,"osdmap_epoch":190,"osdmap_epoch_barrier":190,"uptime":13.625151999} 2023-10-07T08:53:57.651 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 8160, "mdsmap_epoch": 90, "osdmap_epoch": 190, "osdmap_epoch_barrier": 190, "rank_uptime": 8.300540094, "state": "up:active", "uptime": 13.625151999, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:53:57.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-07T08:53:57.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.768+0000 7f67402d2700 1 Processor -- start 2023-10-07T08:53:57.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.768+0000 7f67402d2700 1 -- start start 2023-10-07T08:53:57.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.769+0000 7f67402d2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f67380c3030 0x7f67380c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:57.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.769+0000 7f67402d2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673806aae0 con 0x7f67380aeea0 2023-10-07T08:53:57.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.769+0000 7f67402d2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6738069ed0 con 0x7f67380af270 2023-10-07T08:53:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.769+0000 7f67402d2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673806a1b0 con 0x7f67380c3030 2023-10-07T08:53:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.769+0000 7f673e06e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f67380aeea0 0x7f67380c2920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58248/0 (socket says 172.21.15.81:58248) 2023-10-07T08:53:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.769+0000 7f673e06e700 1 -- 172.21.15.81:0/3606327390 learned_addr learned my addr 172.21.15.81:0/3606327390 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.769+0000 7f673e86f700 1 --2- 172.21.15.81:0/3606327390 >> v2:172.21.15.89:3300/0 conn(0x7f67380c3030 0x7f67380c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.769+0000 7f673d06c700 1 -- 172.21.15.81:0/3606327390 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144306832 0 0) 0x7f673806aae0 con 0x7f67380aeea0 2023-10-07T08:53:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.770+0000 7f673d06c700 1 -- 172.21.15.81:0/3606327390 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6724003570 con 0x7f67380aeea0 2023-10-07T08:53:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.770+0000 7f673e86f700 1 -- 172.21.15.81:0/3606327390 >> v1:172.21.15.89:6789/0 conn(0x7f67380af270 legacy=0x7f67380c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.770+0000 7f673e86f700 1 -- 172.21.15.81:0/3606327390 >> v1:172.21.15.81:6789/0 conn(0x7f67380aeea0 legacy=0x7f67380c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.770+0000 7f673e86f700 1 -- 172.21.15.81:0/3606327390 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673806a490 con 0x7f67380c3030 2023-10-07T08:53:57.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.770+0000 7f673d06c700 1 -- 172.21.15.81:0/3606327390 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3583145073 0 0) 0x7f6724003570 con 0x7f67380aeea0 2023-10-07T08:53:57.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.770+0000 7f673e86f700 1 --2- 172.21.15.81:0/3606327390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67380c3030 0x7f67380c8410 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6734009e60 tx=0x7f6734009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4db679b8d7452bf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:57.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.770+0000 7f673d06c700 1 -- 172.21.15.81:0/3606327390 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400e070 con 0x7f67380c3030 2023-10-07T08:53:57.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.770+0000 7f673d06c700 1 -- 172.21.15.81:0/3606327390 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673400bbf0 con 0x7f67380c3030 2023-10-07T08:53:57.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.770+0000 7f673d06c700 1 -- 172.21.15.81:0/3606327390 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6734012430 con 0x7f67380c3030 2023-10-07T08:53:57.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.770+0000 7f67402d2700 1 -- 172.21.15.81:0/3606327390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67380c3030 msgr2=0x7f67380c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:57.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.770+0000 7f67402d2700 1 --2- 172.21.15.81:0/3606327390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67380c3030 0x7f67380c8410 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6734009e60 tx=0x7f6734009780 comp rx=0 tx=0).stop 2023-10-07T08:53:57.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.771+0000 7f67402d2700 1 -- 172.21.15.81:0/3606327390 shutdown_connections 2023-10-07T08:53:57.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.771+0000 7f67402d2700 1 --2- 172.21.15.81:0/3606327390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67380c3030 0x7f67380c8410 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:57.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.771+0000 7f67402d2700 1 -- 172.21.15.81:0/3606327390 >> 172.21.15.81:0/3606327390 conn(0x7f673806c660 msgr2=0x7f67380cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:57.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.771+0000 7f67402d2700 1 -- 172.21.15.81:0/3606327390 shutdown_connections 2023-10-07T08:53:57.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.771+0000 7f67402d2700 1 -- 172.21.15.81:0/3606327390 wait complete. 2023-10-07T08:53:57.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.772+0000 7f67402d2700 1 Processor -- start 2023-10-07T08:53:57.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.772+0000 7f67402d2700 1 -- start start 2023-10-07T08:53:57.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.772+0000 7f67402d2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67380aeea0 0x7f673816c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:57.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.772+0000 7f67402d2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67380af270 0x7f67380afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:57.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.772+0000 7f67402d2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67380c3030 0x7f6738142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:57.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.772+0000 7f67402d2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673814ad80 con 0x7f67380aeea0 2023-10-07T08:53:57.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.772+0000 7f67402d2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673814b620 con 0x7f67380c3030 2023-10-07T08:53:57.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.772+0000 7f67402d2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67380b0350 con 0x7f67380af270 2023-10-07T08:53:57.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.773+0000 7f673e06e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67380aeea0 0x7f673816c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:57.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.773+0000 7f673e06e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67380aeea0 0x7f673816c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45332/0 (socket says 172.21.15.81:45332) 2023-10-07T08:53:57.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.773+0000 7f673e06e700 1 -- 172.21.15.81:0/3828168824 learned_addr learned my addr 172.21.15.81:0/3828168824 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:57.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.773+0000 7f673d86d700 1 --2- 172.21.15.81:0/3828168824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67380af270 0x7f67380afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:57.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.773+0000 7f673e06e700 1 -- 172.21.15.81:0/3828168824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67380af270 msgr2=0x7f67380afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:57.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.773+0000 7f673e86f700 1 --2- 172.21.15.81:0/3828168824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67380c3030 0x7f6738142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:57.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.773+0000 7f673e06e700 1 --2- 172.21.15.81:0/3828168824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67380af270 0x7f67380afe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:57.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.773+0000 7f673e06e700 1 -- 172.21.15.81:0/3828168824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67380c3030 msgr2=0x7f6738142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:57.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.773+0000 7f673e06e700 1 --2- 172.21.15.81:0/3828168824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67380c3030 0x7f6738142580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:57.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.773+0000 7f673e06e700 1 -- 172.21.15.81:0/3828168824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6734009a20 con 0x7f67380aeea0 2023-10-07T08:53:57.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.773+0000 7f673e06e700 1 --2- 172.21.15.81:0/3828168824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67380aeea0 0x7f673816c280 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f673000c7f0 tx=0x7f6730007b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:57.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.773+0000 7f672e7fc700 1 -- 172.21.15.81:0/3828168824 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6730007360 con 0x7f67380aeea0 2023-10-07T08:53:57.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.773+0000 7f672e7fc700 1 -- 172.21.15.81:0/3828168824 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67300074c0 con 0x7f67380aeea0 2023-10-07T08:53:57.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.773+0000 7f67402d2700 1 -- 172.21.15.81:0/3828168824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6738142ac0 con 0x7f67380aeea0 2023-10-07T08:53:57.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.773+0000 7f672e7fc700 1 -- 172.21.15.81:0/3828168824 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6730004830 con 0x7f67380aeea0 2023-10-07T08:53:57.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.773+0000 7f67402d2700 1 -- 172.21.15.81:0/3828168824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673814afd0 con 0x7f67380aeea0 2023-10-07T08:53:57.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.774+0000 7f67402d2700 1 -- 172.21.15.81:0/3828168824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6738068e00 con 0x7f67380aeea0 2023-10-07T08:53:57.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.774+0000 7f672e7fc700 1 -- 172.21.15.81:0/3828168824 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6730004c00 con 0x7f67380aeea0 2023-10-07T08:53:57.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.775+0000 7f672e7fc700 1 --2- 172.21.15.81:0/3828168824 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f671c066f30 0x7f671c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:57.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.775+0000 7f672e7fc700 1 -- 172.21.15.81:0/3828168824 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f67300843e0 con 0x7f67380aeea0 2023-10-07T08:53:57.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.775+0000 7f673d86d700 1 --2- 172.21.15.81:0/3828168824 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f671c066f30 0x7f671c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.775+0000 7f673d86d700 1 --2- 172.21.15.81:0/3828168824 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f671c066f30 0x7f671c0693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f673814ac00 tx=0x7f6728009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.779+0000 7f672e7fc700 1 -- 172.21.15.81:0/3828168824 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6730051650 con 0x7f67380aeea0 2023-10-07T08:53:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:57.961+0000 7f67402d2700 1 -- 172.21.15.81:0/3828168824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f673806a770 con 0x7f67380aeea0 2023-10-07T08:53:58.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.367+0000 7f672e7fc700 1 -- 172.21.15.81:0/3828168824 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v191) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6730054c70 con 0x7f67380aeea0 2023-10-07T08:53:58.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.369+0000 7f67402d2700 1 -- 172.21.15.81:0/3828168824 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f671c066f30 msgr2=0x7f671c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:58.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.369+0000 7f67402d2700 1 --2- 172.21.15.81:0/3828168824 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f671c066f30 0x7f671c0693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f673814ac00 tx=0x7f6728009040 comp rx=0 tx=0).stop 2023-10-07T08:53:58.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.369+0000 7f67402d2700 1 -- 172.21.15.81:0/3828168824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67380aeea0 msgr2=0x7f673816c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:58.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.369+0000 7f67402d2700 1 --2- 172.21.15.81:0/3828168824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67380aeea0 0x7f673816c280 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f673000c7f0 tx=0x7f6730007b90 comp rx=0 tx=0).stop 2023-10-07T08:53:58.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.369+0000 7f67402d2700 1 -- 172.21.15.81:0/3828168824 shutdown_connections 2023-10-07T08:53:58.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.369+0000 7f67402d2700 1 --2- 172.21.15.81:0/3828168824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67380c3030 0x7f6738142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:58.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.369+0000 7f67402d2700 1 --2- 172.21.15.81:0/3828168824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67380aeea0 0x7f673816c280 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:58.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.369+0000 7f67402d2700 1 --2- 172.21.15.81:0/3828168824 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f671c066f30 0x7f671c0693e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:58.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.369+0000 7f67402d2700 1 --2- 172.21.15.81:0/3828168824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67380af270 0x7f67380afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:58.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.369+0000 7f67402d2700 1 -- 172.21.15.81:0/3828168824 >> 172.21.15.81:0/3828168824 conn(0x7f673806c660 msgr2=0x7f67380cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:58.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.369+0000 7f67402d2700 1 -- 172.21.15.81:0/3828168824 shutdown_connections 2023-10-07T08:53:58.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.369+0000 7f67402d2700 1 -- 172.21.15.81:0/3828168824 wait complete. 2023-10-07T08:53:58.372 INFO:teuthology.orchestra.run.smithi081.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-07T08:53:58.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-07T08:53:58.511 INFO:teuthology.orchestra.run.smithi081.stdout:{"osd_mon_report_interval":"5"} 2023-10-07T08:53:58.512 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-07T08:53:58.512 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-10-07T08:53:58.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:53:58.512 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-10-07T08:53:58.627 INFO:teuthology.orchestra.run.smithi081.stderr:16+0 records in 2023-10-07T08:53:58.627 INFO:teuthology.orchestra.run.smithi081.stderr:16+0 records out 2023-10-07T08:53:58.627 INFO:teuthology.orchestra.run.smithi081.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0957833 s, 175 MB/s 2023-10-07T08:53:58.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:53:58.628 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-10-07T08:53:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:17+0 records in 2023-10-07T08:53:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:17+0 records out 2023-10-07T08:53:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.0941277 s, 189 MB/s 2023-10-07T08:53:58.739 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-07T08:53:58.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:53:58.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.851+0000 7f1c80e08700 1 Processor -- start 2023-10-07T08:53:58.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.851+0000 7f1c80e08700 1 -- start start 2023-10-07T08:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.852+0000 7f1c80e08700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c7c159f10 0x7f1c7c068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.852+0000 7f1c80e08700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7c0cee10 con 0x7f1c7c068cc0 2023-10-07T08:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.852+0000 7f1c80e08700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7c0cd040 con 0x7f1c7c159b40 2023-10-07T08:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.852+0000 7f1c80e08700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c069140 con 0x7f1c7c159f10 2023-10-07T08:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.852+0000 7f1c7bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1c7c068cc0 0x7f1c7c0cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58264/0 (socket says 172.21.15.81:58264) 2023-10-07T08:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.852+0000 7f1c7bfff700 1 -- 172.21.15.81:0/702107670 learned_addr learned my addr 172.21.15.81:0/702107670 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.852+0000 7f1c7affd700 1 --2- 172.21.15.81:0/702107670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c7c159f10 0x7f1c7c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.852+0000 7f1c7a7fc700 1 -- 172.21.15.81:0/702107670 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007692166 0 0) 0x7f1c7c0cee10 con 0x7f1c7c068cc0 2023-10-07T08:53:58.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.852+0000 7f1c7a7fc700 1 -- 172.21.15.81:0/702107670 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c64003570 con 0x7f1c7c068cc0 2023-10-07T08:53:58.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.852+0000 7f1c7affd700 1 -- 172.21.15.81:0/702107670 >> v1:172.21.15.89:6789/0 conn(0x7f1c7c159b40 legacy=0x7f1c7c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:58.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.852+0000 7f1c7affd700 1 -- 172.21.15.81:0/702107670 >> v1:172.21.15.81:6789/0 conn(0x7f1c7c068cc0 legacy=0x7f1c7c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:58.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.852+0000 7f1c7affd700 1 -- 172.21.15.81:0/702107670 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c0cd320 con 0x7f1c7c159f10 2023-10-07T08:53:58.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.853+0000 7f1c7affd700 1 --2- 172.21.15.81:0/702107670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c7c159f10 0x7f1c7c068780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009910 tx=0x7f1c700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=919c7fdc2cacea7f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:58.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.853+0000 7f1c7a7fc700 1 -- 172.21.15.81:0/702107670 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7000b680 con 0x7f1c7c159f10 2023-10-07T08:53:58.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.853+0000 7f1c7a7fc700 1 -- 172.21.15.81:0/702107670 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7000b7e0 con 0x7f1c7c159f10 2023-10-07T08:53:58.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.853+0000 7f1c7a7fc700 1 -- 172.21.15.81:0/702107670 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7000bb60 con 0x7f1c7c159f10 2023-10-07T08:53:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.853+0000 7f1c80e08700 1 -- 172.21.15.81:0/702107670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c7c159f10 msgr2=0x7f1c7c068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.853+0000 7f1c80e08700 1 --2- 172.21.15.81:0/702107670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c7c159f10 0x7f1c7c068780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009910 tx=0x7f1c700091a0 comp rx=0 tx=0).stop 2023-10-07T08:53:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.853+0000 7f1c80e08700 1 -- 172.21.15.81:0/702107670 shutdown_connections 2023-10-07T08:53:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.853+0000 7f1c80e08700 1 --2- 172.21.15.81:0/702107670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c7c159f10 0x7f1c7c068780 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.853+0000 7f1c80e08700 1 -- 172.21.15.81:0/702107670 >> 172.21.15.81:0/702107670 conn(0x7f1c7c0cd660 msgr2=0x7f1c7c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.853+0000 7f1c80e08700 1 -- 172.21.15.81:0/702107670 shutdown_connections 2023-10-07T08:53:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.853+0000 7f1c80e08700 1 -- 172.21.15.81:0/702107670 wait complete. 2023-10-07T08:53:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.855+0000 7f1c80e08700 1 Processor -- start 2023-10-07T08:53:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.855+0000 7f1c80e08700 1 -- start start 2023-10-07T08:53:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.855+0000 7f1c80e08700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c7c068cc0 0x7f1c7c158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.855+0000 7f1c80e08700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c7c159b40 0x7f1c7c16d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.855+0000 7f1c80e08700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c7c159f10 0x7f1c7c16b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.855+0000 7f1c80e08700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c1589b0 con 0x7f1c7c159f10 2023-10-07T08:53:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.855+0000 7f1c80e08700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c16dad0 con 0x7f1c7c159b40 2023-10-07T08:53:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.855+0000 7f1c80e08700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c16c4f0 con 0x7f1c7c068cc0 2023-10-07T08:53:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.855+0000 7f1c7bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c7c159f10 0x7f1c7c16b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.855+0000 7f1c7bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c7c159f10 0x7f1c7c16b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45342/0 (socket says 172.21.15.81:45342) 2023-10-07T08:53:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.855+0000 7f1c7bfff700 1 -- 172.21.15.81:0/870817861 learned_addr learned my addr 172.21.15.81:0/870817861 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:53:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.856+0000 7f1c7affd700 1 --2- 172.21.15.81:0/870817861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c7c159b40 0x7f1c7c16d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.856+0000 7f1c7b7fe700 1 --2- 172.21.15.81:0/870817861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c7c068cc0 0x7f1c7c158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.856+0000 7f1c7bfff700 1 -- 172.21.15.81:0/870817861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c7c068cc0 msgr2=0x7f1c7c158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.856+0000 7f1c7bfff700 1 --2- 172.21.15.81:0/870817861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c7c068cc0 0x7f1c7c158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.856+0000 7f1c7bfff700 1 -- 172.21.15.81:0/870817861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c7c159b40 msgr2=0x7f1c7c16d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.856+0000 7f1c7bfff700 1 --2- 172.21.15.81:0/870817861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c7c159b40 0x7f1c7c16d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.856+0000 7f1c7bfff700 1 -- 172.21.15.81:0/870817861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c70009420 con 0x7f1c7c159f10 2023-10-07T08:53:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.856+0000 7f1c7bfff700 1 --2- 172.21.15.81:0/870817861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c7c159f10 0x7f1c7c16b980 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0010e0 tx=0x7f1c6c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.856+0000 7f1c637fe700 1 -- 172.21.15.81:0/870817861 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c005c00 con 0x7f1c7c159f10 2023-10-07T08:53:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.856+0000 7f1c637fe700 1 -- 172.21.15.81:0/870817861 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6c005d60 con 0x7f1c7c159f10 2023-10-07T08:53:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.856+0000 7f1c80e08700 1 -- 172.21.15.81:0/870817861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7c16c7d0 con 0x7f1c7c159f10 2023-10-07T08:53:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.856+0000 7f1c637fe700 1 -- 172.21.15.81:0/870817861 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c0072e0 con 0x7f1c7c159f10 2023-10-07T08:53:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.856+0000 7f1c80e08700 1 -- 172.21.15.81:0/870817861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7c16cd90 con 0x7f1c7c159f10 2023-10-07T08:53:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.857+0000 7f1c80e08700 1 -- 172.21.15.81:0/870817861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7c0cb890 con 0x7f1c7c159f10 2023-10-07T08:53:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.857+0000 7f1c637fe700 1 -- 172.21.15.81:0/870817861 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c6c012400 con 0x7f1c7c159f10 2023-10-07T08:53:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.858+0000 7f1c637fe700 1 --2- 172.21.15.81:0/870817861 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c68066f30 0x7f1c680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:53:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.858+0000 7f1c637fe700 1 -- 172.21.15.81:0/870817861 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c6c0838f0 con 0x7f1c7c159f10 2023-10-07T08:53:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.858+0000 7f1c7b7fe700 1 --2- 172.21.15.81:0/870817861 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c68066f30 0x7f1c680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:53:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.858+0000 7f1c7b7fe700 1 --2- 172.21.15.81:0/870817861 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c68066f30 0x7f1c680693e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1c74007fd0 tx=0x7f1c74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:53:58.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:58.862+0000 7f1c637fe700 1 -- 172.21.15.81:0/870817861 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c6c050c10 con 0x7f1c7c159f10 2023-10-07T08:53:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:59.045+0000 7f1c80e08700 1 -- 172.21.15.81:0/870817861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1c7c0ce7c0 con 0x7f1c7c159f10 2023-10-07T08:53:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:59.046+0000 7f1c637fe700 1 -- 172.21.15.81:0/870817861 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v191) v1 ==== 81+0+32234 (secure 0 0 0) 0x7f1c6c017090 con 0x7f1c7c159f10 2023-10-07T08:53:59.048 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:53:59.048 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:53:59.048 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 191, 2023-10-07T08:53:59.048 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:53:59.048 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:53:59.048 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:53:58.360508+0000", 2023-10-07T08:53:59.048 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:53:59.048 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:53:59.048 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:53:59.049 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:53:59.049 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:53:59.049 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:53:59.049 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:53:59.049 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:53:59.049 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:53:59.049 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:53:59.049 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:53:59.049 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:53:59.049 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:53:59.049 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:53:59.050 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:53:59.050 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 23, 2023-10-07T08:53:59.050 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:53:59.050 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:53:59.050 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:53:59.050 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:53:59.050 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:53:59.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.050 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:53:59.050 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:53:59.050 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:53:59.051 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:53:59.051 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:53:59.051 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:53:59.051 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:53:59.051 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:53:59.051 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:53:59.051 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:53:59.051 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:53:59.051 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:53:59.051 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:53:59.051 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:53:59.051 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:53:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:53:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:53:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:53:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:53:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:53:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:53:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:53:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:53:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:53:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:53:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:53:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:53:59.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.053 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:53:59.053 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:53:59.053 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:53:59.053 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:53:59.053 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:53:59.053 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:53:59.053 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:53:59.053 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:53:59.053 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:53:59.054 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:53:59.054 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:53:59.054 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:53:59.054 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:53:59.054 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:53:59.054 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:53:59.054 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:53:59.054 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:53:59.054 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:53:59.054 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:53:59.054 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:53:59.054 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:53:59.055 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:53:59.055 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:53:59.055 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:53:59.055 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:53:59.055 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:53:59.055 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:53:59.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.055 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:53:59.055 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:53:59.055 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:53:59.055 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:53:59.056 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:53:59.056 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:53:59.056 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:53:59.056 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:53:59.056 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:53:59.056 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:53:59.056 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:53:59.056 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:53:59.056 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:53:59.056 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:53:59.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.057 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:53:59.057 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:53:59.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.057 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 22, 2023-10-07T08:53:59.057 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:53:59.057 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:53:46.818809+0000", 2023-10-07T08:53:59.057 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:53:59.057 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:53:59.057 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:53:59.058 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:53:59.058 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:53:59.058 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:53:59.058 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:53:59.058 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:53:59.058 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:53:59.058 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:53:59.058 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:53:59.058 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:53:59.058 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:53:59.059 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:53:59.059 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:53:59.059 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:53:59.059 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:53:59.059 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:53:59.059 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:53:59.059 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:53:59.059 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:53:59.059 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:53:59.059 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:53:59.060 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:53:59.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.060 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "189", 2023-10-07T08:53:59.060 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:53:59.060 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:53:59.060 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:53:59.060 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:53:59.060 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:53:59.060 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:53:59.060 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:53:59.061 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:53:59.061 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:53:59.061 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:53:59.061 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:53:59.061 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:53:59.061 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:53:59.061 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:53:59.061 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:53:59.061 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:53:59.061 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:53:59.062 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:53:59.062 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:53:59.062 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:53:59.062 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:53:59.062 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:53:59.062 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:53:59.062 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:53:59.062 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:53:59.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:53:59.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.062 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:53:59.063 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:53:59.063 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:53:59.063 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:53:59.063 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:53:59.063 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:53:59.063 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:53:59.063 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:53:59.063 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:53:59.063 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:53:59.063 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:53:59.063 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:53:59.064 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:53:59.064 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:53:59.064 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:53:59.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.064 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:53:59.064 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:53:59.064 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:53:59.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.065 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 23, 2023-10-07T08:53:59.065 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:53:59.065 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:53:47.460436+0000", 2023-10-07T08:53:59.065 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:53:59.065 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:53:59.065 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:53:59.065 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:53:59.065 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:53:59.065 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:53:59.065 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:53:59.065 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:53:59.065 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:53:59.066 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:53:59.066 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:53:59.066 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:53:59.066 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:53:59.066 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:53:59.066 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:53:59.066 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:53:59.066 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:53:59.066 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:53:59.066 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:53:59.066 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:53:59.067 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:53:59.067 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:53:59.067 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:53:59.067 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:53:59.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.067 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "191", 2023-10-07T08:53:59.067 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:53:59.067 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:53:59.067 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:53:59.067 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:53:59.067 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:53:59.068 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:53:59.068 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:53:59.068 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:53:59.068 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:53:59.068 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-07T08:53:59.068 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:53:59.068 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:53:59.068 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:53:59.068 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:53:59.068 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:53:59.069 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:53:59.069 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:53:59.069 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:53:59.069 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:53:59.069 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:53:59.069 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:53:59.069 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:53:59.069 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:53:59.069 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:53:59.069 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:53:59.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:53:59.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:53:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:53:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:53:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:53:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:53:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:53:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:53:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:53:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:53:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:53:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:53:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:53:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:53:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:53:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:53:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:53:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:53:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:53:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:53:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:53:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:53:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:53:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:53:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:53:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:53:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:53:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:53:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:53:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:53:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:53:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:53:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:53:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:53:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:53:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:53:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:53:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:53:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:53:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:53:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:53:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:53:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:53:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:53:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:53:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:53:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:53:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:53:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:53:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:53:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:53:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:53:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:53:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:53:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:53:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:53:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:53:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:53:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:53:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:53:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:53:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:53:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:53:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:53:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:53:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:53:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:53:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:53:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:53:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:53:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:53:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:53:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:53:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:53:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:53:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:53:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:53:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.082 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:53:59.082 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:53:59.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.082 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:53:59.082 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:53:59.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.083 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:53:59.083 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.083 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.083 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:53:59.083 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:53:59.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.083 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.083 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:53:59.083 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:53:59.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.084 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.084 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:53:59.084 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.084 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.084 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:53:59.084 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:53:59.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.085 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.085 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:53:59.085 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:53:59.085 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.085 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.085 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:53:59.085 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:53:59.085 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:53:59.085 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:53:59.085 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:53:59.085 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:53:59.086 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:53:59.086 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.086 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:53:59.086 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:53:59.086 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:53:59.086 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:53:59.086 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:53:59.086 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:53:59.087 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:53:59.087 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:53:59.087 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:53:59.087 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:53:59.087 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:53:59.087 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:53:59.087 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:53:59.087 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.087 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.087 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:53:59.087 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:53:59.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.088 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.088 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:53:59.088 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:53:59.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.088 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.088 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:53:59.088 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.088 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.089 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:53:59.089 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:53:59.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.089 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.089 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:53:59.089 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:53:59.089 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.089 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.089 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:53:59.089 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.090 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:53:59.090 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:53:59.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.090 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:53:59.090 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:53:59.090 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.090 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.091 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:53:59.091 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.091 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.091 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:53:59.091 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:53:59.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.091 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.091 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:53:59.091 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:53:59.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.092 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.092 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:53:59.092 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:53:59.092 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:53:59.092 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:53:59.092 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:53:59.092 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:53:59.092 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:53:59.092 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.093 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:53:59.093 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:53:59.093 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:53:59.093 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:53:59.093 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:53:59.093 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:53:59.093 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:53:59.093 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:53:59.093 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:53:59.093 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:53:59.093 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:53:59.093 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:53:59.093 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:53:59.094 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.094 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.094 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:53:59.094 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:53:59.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.094 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.094 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:53:59.094 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:53:59.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.095 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.095 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:53:59.095 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.095 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.095 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:53:59.095 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:53:59.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.095 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.095 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:53:59.095 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:53:59.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.096 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.096 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:53:59.096 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.096 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.096 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:53:59.096 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:53:59.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.097 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.097 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:53:59.097 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:53:59.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.097 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.097 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:53:59.097 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.097 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.097 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:53:59.097 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:53:59.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.098 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.098 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:53:59.098 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:53:59.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.098 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.098 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:53:59.098 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:53:59.098 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:53:59.099 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:53:59.099 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:53:59.099 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:53:59.099 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:53:59.099 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.099 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:53:59.099 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:53:59.099 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:53:59.099 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:53:59.099 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:53:59.099 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:53:59.100 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:53:59.100 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:53:59.100 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:53:59.100 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:53:59.100 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:53:59.100 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:53:59.100 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:53:59.100 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.101 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:53:59.101 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:53:59.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.101 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.101 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:53:59.101 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:53:59.101 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.101 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.102 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:53:59.102 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.102 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.102 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:53:59.102 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:53:59.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.102 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.102 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:53:59.102 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:53:59.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.103 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.103 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:53:59.103 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.103 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:53:59.103 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:53:59.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.103 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:53:59.104 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:53:59.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.104 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.104 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:53:59.104 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.104 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.104 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:53:59.104 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:53:59.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.105 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:53:59.105 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:53:59.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.105 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.105 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:53:59.105 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:53:59.105 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:53:59.105 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:53:59.105 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:53:59.106 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:53:59.106 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:53:59.106 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.106 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:53:59.106 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:53:59.106 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:53:59.106 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:53:59.106 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:53:59.106 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:53:59.107 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:53:59.107 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:53:59.107 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:53:59.107 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:53:59.107 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:53:59.107 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:53:59.107 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:53:59.107 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.107 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.107 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:53:59.108 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:53:59.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.108 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.108 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:53:59.108 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:53:59.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.108 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.108 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:53:59.108 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.109 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.109 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:53:59.109 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:53:59.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.109 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.109 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:53:59.109 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:53:59.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.110 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.110 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:53:59.110 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.110 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:53:59.110 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:53:59.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.110 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:53:59.111 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:53:59.111 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.111 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.111 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:53:59.111 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.111 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.111 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:53:59.111 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:53:59.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.112 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.112 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:53:59.112 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:53:59.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.112 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.112 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:53:59.112 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:53:59.112 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:53:59.112 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:53:59.113 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:53:59.113 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:53:59.113 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:53:59.113 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.113 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:53:59.113 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:53:59.113 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:53:59.113 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:53:59.113 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:53:59.113 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:53:59.113 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:53:59.114 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:53:59.114 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:53:59.114 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:53:59.114 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:53:59.114 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:53:59.114 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:53:59.114 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.114 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:53:59.114 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:53:59.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.115 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.115 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:53:59.115 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:53:59.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.115 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.115 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:53:59.115 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.116 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:53:59.116 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:53:59.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.116 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:53:59.116 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:53:59.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.116 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.116 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:53:59.117 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.117 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.117 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:53:59.117 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:53:59.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.117 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.117 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:53:59.117 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:53:59.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.117 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.118 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:53:59.118 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.118 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:53:59.118 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:53:59.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.119 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:53:59.119 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:53:59.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.119 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.119 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:53:59.119 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:53:59.119 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:53:59.119 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:53:59.119 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:53:59.119 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:53:59.122 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:53:59.122 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.122 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:53:59.123 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:53:59.123 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:53:59.123 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:53:59.123 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:53:59.123 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:53:59.123 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:53:59.123 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:53:59.123 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:53:59.123 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:53:59.123 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:53:59.123 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:53:59.124 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:53:59.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:53:59.124 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:53:59.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:53:59.124 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:53:59.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.125 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.125 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:53:59.125 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.125 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.125 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:53:59.125 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:53:59.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.126 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.126 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:53:59.126 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:53:59.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.126 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.126 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:53:59.126 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.126 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.126 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:53:59.127 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:53:59.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.127 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.127 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:53:59.127 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:53:59.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.127 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.128 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:53:59.128 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:53:59.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.128 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:53:59.128 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:53:59.128 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:53:59.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.128 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:53:59.129 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:53:59.129 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:53:59.129 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.129 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.129 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:53:59.129 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:53:59.129 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:53:59.129 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:53:59.129 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:53:59.130 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:53:59.130 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:53:59.130 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:53:59.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.130 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:53:59.130 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:53:59.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.130 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:53:59.130 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:53:59.131 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:53:59.131 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:53:59.131 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:53:59.131 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:53:59.131 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:53:59.131 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:53:59.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.131 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:53:59.131 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:53:59.132 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:53:59.132 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:53:59.132 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:53:59.132 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:53:59.132 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:53:59.132 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:53:59.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.132 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:53:59.132 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:53:59.133 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:53:59.133 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:53:59.133 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:53:59.133 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:53:59.133 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:53:59.133 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:53:59.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.133 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:53:59.133 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:53:59.133 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:53:59.134 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:53:59.134 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:53:59.134 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:53:59.134 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:53:59.134 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:53:59.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.134 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:53:59.134 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:53:59.134 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:53:59.134 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:53:59.135 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:53:59.135 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:53:59.135 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:53:59.135 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:53:59.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.135 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:53:59.135 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:53:59.135 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:53:59.135 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:53:59.135 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:53:59.135 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:53:59.136 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:53:59.136 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:53:59.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.136 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:53:59.136 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:53:59.136 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:53:59.136 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:53:59.136 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:53:59.136 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:53:59.136 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:53:59.136 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:53:59.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:53:59.137 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:53:59.137 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:53:59.137 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:53:59.137 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:53:59.137 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:53:59.137 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:53:59.137 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:53:59.137 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:53:59.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.138 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:53:59.138 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:53:59.138 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:53:59.138 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:53:59.138 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:53:59.138 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:53:59.138 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:53:59.138 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:53:59.138 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:53:59.138 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:53:59.138 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:53:59.139 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:53:59.139 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:53:59.139 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:53:59.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:53:59.139 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:53:59.139 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:53:59.139 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:53:59.139 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:53:59.139 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:53:59.139 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:53:59.139 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:53:59.139 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:53:59.140 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:53:59.140 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:53:59.140 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:53:59.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:53:59.140 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:53:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:59.048+0000 7f1c80e08700 1 -- 172.21.15.81:0/870817861 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c68066f30 msgr2=0x7f1c680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:59.048+0000 7f1c80e08700 1 --2- 172.21.15.81:0/870817861 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c68066f30 0x7f1c680693e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1c74007fd0 tx=0x7f1c74009040 comp rx=0 tx=0).stop 2023-10-07T08:53:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:59.048+0000 7f1c80e08700 1 -- 172.21.15.81:0/870817861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c7c159f10 msgr2=0x7f1c7c16b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:53:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:59.048+0000 7f1c80e08700 1 --2- 172.21.15.81:0/870817861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c7c159f10 0x7f1c7c16b980 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0010e0 tx=0x7f1c6c007dd0 comp rx=0 tx=0).stop 2023-10-07T08:53:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:59.048+0000 7f1c80e08700 1 -- 172.21.15.81:0/870817861 shutdown_connections 2023-10-07T08:53:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:59.048+0000 7f1c80e08700 1 --2- 172.21.15.81:0/870817861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c7c159f10 0x7f1c7c16b980 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:59.048+0000 7f1c80e08700 1 --2- 172.21.15.81:0/870817861 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1c68066f30 0x7f1c680693e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:59.048+0000 7f1c80e08700 1 --2- 172.21.15.81:0/870817861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c7c068cc0 0x7f1c7c158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:59.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:59.048+0000 7f1c80e08700 1 --2- 172.21.15.81:0/870817861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c7c159b40 0x7f1c7c16d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:53:59.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:59.048+0000 7f1c80e08700 1 -- 172.21.15.81:0/870817861 >> 172.21.15.81:0/870817861 conn(0x7f1c7c0cd660 msgr2=0x7f1c7c06dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:53:59.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:59.048+0000 7f1c80e08700 1 -- 172.21.15.81:0/870817861 shutdown_connections 2023-10-07T08:53:59.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:53:59.048+0000 7f1c80e08700 1 -- 172.21.15.81:0/870817861 wait complete. 2023-10-07T08:53:59.143 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-07T08:54:04.144 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:54:04.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.267+0000 7f19829a7700 1 Processor -- start 2023-10-07T08:54:04.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.267+0000 7f19829a7700 1 -- start start 2023-10-07T08:54:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.268+0000 7f19829a7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f197c06d830 0x7f197c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.268+0000 7f19829a7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f197c0d07c0 con 0x7f197c157ca0 2023-10-07T08:54:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.268+0000 7f19829a7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f197c0cfbb0 con 0x7f197c1578d0 2023-10-07T08:54:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.268+0000 7f19829a7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0cfe90 con 0x7f197c06d830 2023-10-07T08:54:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.268+0000 7f197b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f197c157ca0 0x7f197c06d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43570/0 (socket says 172.21.15.81:43570) 2023-10-07T08:54:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.268+0000 7f197b7fe700 1 -- 172.21.15.81:0/1501951814 learned_addr learned my addr 172.21.15.81:0/1501951814 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.268+0000 7f1980f44700 1 --2- 172.21.15.81:0/1501951814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f197c06d830 0x7f197c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.269+0000 7f197affd700 1 -- 172.21.15.81:0/1501951814 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852973067 0 0) 0x7f197c0d07c0 con 0x7f197c157ca0 2023-10-07T08:54:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.269+0000 7f197affd700 1 -- 172.21.15.81:0/1501951814 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1964003570 con 0x7f197c157ca0 2023-10-07T08:54:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.269+0000 7f197affd700 1 -- 172.21.15.81:0/1501951814 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411238730 0 0) 0x7f197c0cfbb0 con 0x7f197c1578d0 2023-10-07T08:54:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.269+0000 7f197affd700 1 -- 172.21.15.81:0/1501951814 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f197c0d07c0 con 0x7f197c1578d0 2023-10-07T08:54:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.269+0000 7f197affd700 1 -- 172.21.15.81:0/1501951814 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2848582020 0 0) 0x7f1964003570 con 0x7f197c157ca0 2023-10-07T08:54:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.269+0000 7f1980f44700 1 -- 172.21.15.81:0/1501951814 >> v1:172.21.15.89:6789/0 conn(0x7f197c1578d0 legacy=0x7f197c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.269+0000 7f1980f44700 1 -- 172.21.15.81:0/1501951814 >> v1:172.21.15.81:6789/0 conn(0x7f197c157ca0 legacy=0x7f197c06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.269+0000 7f1980f44700 1 -- 172.21.15.81:0/1501951814 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c0d0170 con 0x7f197c06d830 2023-10-07T08:54:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.269+0000 7f1980f44700 1 --2- 172.21.15.81:0/1501951814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f197c06d830 0x7f197c0cf4f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1974009e90 tx=0x7f1974009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f977c4ca66565410 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.269+0000 7f197affd700 1 -- 172.21.15.81:0/1501951814 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197400e070 con 0x7f197c06d830 2023-10-07T08:54:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.269+0000 7f197affd700 1 -- 172.21.15.81:0/1501951814 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197400b870 con 0x7f197c06d830 2023-10-07T08:54:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.269+0000 7f197affd700 1 -- 172.21.15.81:0/1501951814 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1970001470 con 0x7f197c06d830 2023-10-07T08:54:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.270+0000 7f19829a7700 1 -- 172.21.15.81:0/1501951814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f197c06d830 msgr2=0x7f197c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.270+0000 7f19829a7700 1 --2- 172.21.15.81:0/1501951814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f197c06d830 0x7f197c0cf4f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1974009e90 tx=0x7f1974009780 comp rx=0 tx=0).stop 2023-10-07T08:54:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.270+0000 7f19829a7700 1 -- 172.21.15.81:0/1501951814 shutdown_connections 2023-10-07T08:54:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.270+0000 7f19829a7700 1 --2- 172.21.15.81:0/1501951814 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f197c06d830 0x7f197c0cf4f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:04.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.270+0000 7f19829a7700 1 -- 172.21.15.81:0/1501951814 >> 172.21.15.81:0/1501951814 conn(0x7f197c06bb90 msgr2=0x7f197c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:04.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.270+0000 7f19829a7700 1 -- 172.21.15.81:0/1501951814 shutdown_connections 2023-10-07T08:54:04.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.270+0000 7f19829a7700 1 -- 172.21.15.81:0/1501951814 wait complete. 2023-10-07T08:54:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.271+0000 7f19829a7700 1 Processor -- start 2023-10-07T08:54:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.271+0000 7f19829a7700 1 -- start start 2023-10-07T08:54:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f19829a7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f197c06d830 0x7f197c1549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f19829a7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f197c1578d0 0x7f197c0aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f19829a7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f197c157ca0 0x7f197c0ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f19829a7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0adba0 con 0x7f197c1578d0 2023-10-07T08:54:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f19829a7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0ade40 con 0x7f197c06d830 2023-10-07T08:54:04.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f19829a7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0ae120 con 0x7f197c157ca0 2023-10-07T08:54:04.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f197b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f197c1578d0 0x7f197c0aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:04.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f197b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f197c1578d0 0x7f197c0aaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52112/0 (socket says 172.21.15.81:52112) 2023-10-07T08:54:04.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f197b7fe700 1 -- 172.21.15.81:0/3924899972 learned_addr learned my addr 172.21.15.81:0/3924899972 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:04.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f1980f44700 1 --2- 172.21.15.81:0/3924899972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f197c157ca0 0x7f197c0ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:04.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f197bfff700 1 --2- 172.21.15.81:0/3924899972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f197c06d830 0x7f197c1549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:04.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f197b7fe700 1 -- 172.21.15.81:0/3924899972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f197c157ca0 msgr2=0x7f197c0ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:04.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f197b7fe700 1 --2- 172.21.15.81:0/3924899972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f197c157ca0 0x7f197c0ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:04.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f197b7fe700 1 -- 172.21.15.81:0/3924899972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f197c06d830 msgr2=0x7f197c1549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:04.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f197b7fe700 1 --2- 172.21.15.81:0/3924899972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f197c06d830 0x7f197c1549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:04.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f197b7fe700 1 -- 172.21.15.81:0/3924899972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1974009a20 con 0x7f197c1578d0 2023-10-07T08:54:04.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f197b7fe700 1 --2- 172.21.15.81:0/3924899972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f197c1578d0 0x7f197c0aaff0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f197000c960 tx=0x7f19700019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:04.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f1963fff700 1 -- 172.21.15.81:0/3924899972 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197000cea0 con 0x7f197c1578d0 2023-10-07T08:54:04.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f1963fff700 1 -- 172.21.15.81:0/3924899972 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1970005b30 con 0x7f197c1578d0 2023-10-07T08:54:04.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f19829a7700 1 -- 172.21.15.81:0/3924899972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197c0ae400 con 0x7f197c1578d0 2023-10-07T08:54:04.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f1963fff700 1 -- 172.21.15.81:0/3924899972 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19700070f0 con 0x7f197c1578d0 2023-10-07T08:54:04.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.272+0000 7f19829a7700 1 -- 172.21.15.81:0/3924899972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197c158470 con 0x7f197c1578d0 2023-10-07T08:54:04.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.273+0000 7f19829a7700 1 -- 172.21.15.81:0/3924899972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197c158660 con 0x7f197c1578d0 2023-10-07T08:54:04.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.274+0000 7f1963fff700 1 -- 172.21.15.81:0/3924899972 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19700074a0 con 0x7f197c1578d0 2023-10-07T08:54:04.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.274+0000 7f1963fff700 1 --2- 172.21.15.81:0/3924899972 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1968066f30 0x7f19680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:04.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.274+0000 7f1963fff700 1 -- 172.21.15.81:0/3924899972 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1970084260 con 0x7f197c1578d0 2023-10-07T08:54:04.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.274+0000 7f197bfff700 1 --2- 172.21.15.81:0/3924899972 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1968066f30 0x7f19680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:04.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.274+0000 7f1963fff700 1 -- 172.21.15.81:0/3924899972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f196806ea50 con 0x7f197c1578d0 2023-10-07T08:54:04.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.275+0000 7f197bfff700 1 --2- 172.21.15.81:0/3924899972 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1968066f30 0x7f19680693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f197c155ba0 tx=0x7f196c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:04.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.278+0000 7f1963fff700 1 -- 172.21.15.81:0/3924899972 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1970051550 con 0x7f197c1578d0 2023-10-07T08:54:04.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.464+0000 7f19829a7700 1 -- 172.21.15.81:0/3924899972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f197c0d0450 con 0x7f197c1578d0 2023-10-07T08:54:04.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.465+0000 7f1963fff700 1 -- 172.21.15.81:0/3924899972 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v192) v1 ==== 81+0+32253 (secure 0 0 0) 0x7f1970054b70 con 0x7f197c1578d0 2023-10-07T08:54:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:04.466 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:54:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 192, 2023-10-07T08:54:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:54:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:54:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:54:03.339586+0000", 2023-10-07T08:54:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:54:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:54:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:54:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:54:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:54:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:54:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:54:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:54:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:54:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:54:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:54:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:54:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:54:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:54:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 23, 2023-10-07T08:54:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:54:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:54:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:54:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:54:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:54:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:54:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:54:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:54:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:54:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:54:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:54:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:54:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:54:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:54:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:54:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:54:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:54:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:54:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:54:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:54:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 22, 2023-10-07T08:54:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:54:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:53:46.818809+0000", 2023-10-07T08:54:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:54:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:54:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:54:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:54:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:54:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:54:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:54:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "189", 2023-10-07T08:54:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:54:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:54:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:54:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:54:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:54:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:54:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 23, 2023-10-07T08:54:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:54:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:53:47.460436+0000", 2023-10-07T08:54:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1027, 2023-10-07T08:54:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-07T08:54:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:54:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:54:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:54:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:54:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:54:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "192", 2023-10-07T08:54:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-07T08:54:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:54:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:54:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:54:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:54:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:54:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:54:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:54:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:54:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:54:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:54:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:54:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:54:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:54:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:54:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:54:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:54:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:54:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:54:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:54:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:54:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:54:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:54:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:54:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:54:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:54:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:54:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:54:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:54:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:54:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:54:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:54:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:54:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:54:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:54:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:54:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:54:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:54:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:54:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:54:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:54:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:54:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:54:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:54:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:54:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:54:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:54:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:54:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:54:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:54:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:54:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:54:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:54:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:54:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:54:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:54:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:54:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:54:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:54:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:54:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:54:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:54:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:54:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:54:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:54:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:54:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:54:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:54:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:54:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:54:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:54:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:54:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:54:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:54:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:54:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:54:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:54:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:54:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:54:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:54:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:54:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:54:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:54:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:54:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:54:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:54:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:54:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:54:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:54:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:54:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:54:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:54:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:54:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:54:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:54:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:54:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:54:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:54:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:54:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:54:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:54:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:54:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:54:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:54:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:54:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:54:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:54:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:54:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:54:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:54:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:54:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:54:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:54:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:54:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:54:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:54:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:54:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:54:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:54:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:54:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:54:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:54:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:54:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:54:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:54:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:54:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:54:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:54:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:54:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:54:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:54:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:54:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:54:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:54:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:54:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:54:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:54:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:54:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:54:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:54:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:54:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:54:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:54:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:54:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:54:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:54:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:54:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:54:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:54:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:54:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:54:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:04.562 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:54:04.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.468+0000 7f19829a7700 1 -- 172.21.15.81:0/3924899972 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1968066f30 msgr2=0x7f19680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:04.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.468+0000 7f19829a7700 1 --2- 172.21.15.81:0/3924899972 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1968066f30 0x7f19680693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f197c155ba0 tx=0x7f196c009040 comp rx=0 tx=0).stop 2023-10-07T08:54:04.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.468+0000 7f19829a7700 1 -- 172.21.15.81:0/3924899972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f197c1578d0 msgr2=0x7f197c0aaff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:04.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.468+0000 7f19829a7700 1 --2- 172.21.15.81:0/3924899972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f197c1578d0 0x7f197c0aaff0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f197000c960 tx=0x7f19700019b0 comp rx=0 tx=0).stop 2023-10-07T08:54:04.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.468+0000 7f19829a7700 1 -- 172.21.15.81:0/3924899972 shutdown_connections 2023-10-07T08:54:04.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.468+0000 7f19829a7700 1 --2- 172.21.15.81:0/3924899972 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1968066f30 0x7f19680693e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:04.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.468+0000 7f19829a7700 1 --2- 172.21.15.81:0/3924899972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f197c157ca0 0x7f197c0ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:04.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.468+0000 7f19829a7700 1 --2- 172.21.15.81:0/3924899972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f197c06d830 0x7f197c1549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:04.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.468+0000 7f19829a7700 1 --2- 172.21.15.81:0/3924899972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f197c1578d0 0x7f197c0aaff0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:04.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.468+0000 7f19829a7700 1 -- 172.21.15.81:0/3924899972 >> 172.21.15.81:0/3924899972 conn(0x7f197c06bb90 msgr2=0x7f197c15da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:04.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.468+0000 7f19829a7700 1 -- 172.21.15.81:0/3924899972 shutdown_connections 2023-10-07T08:54:04.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.468+0000 7f19829a7700 1 -- 172.21.15.81:0/3924899972 wait complete. 2023-10-07T08:54:04.566 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-07T08:54:04.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:54:04.566 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-10-07T08:54:04.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:54:04.818 INFO:teuthology.orchestra.run.smithi081.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-07T08:54:04.818 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records in 2023-10-07T08:54:04.818 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records out 2023-10-07T08:54:04.818 INFO:teuthology.orchestra.run.smithi081.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.233688 s, 224 MB/s 2023-10-07T08:54:04.819 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:54:04.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.931+0000 7fb500a05700 1 Processor -- start 2023-10-07T08:54:04.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.931+0000 7fb500a05700 1 -- start start 2023-10-07T08:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.932+0000 7fb500a05700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4fc157fe0 0x7fb4fc0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.932+0000 7fb500a05700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb4fc1583b0 0x7fb4fc0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.932+0000 7fb500a05700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4fc0ceb30 0x7fb4fc0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.932+0000 7fb500a05700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4fc0cf4b0 con 0x7fb4fc157fe0 2023-10-07T08:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.932+0000 7fb500a05700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4fc0b2890 con 0x7fb4fc1583b0 2023-10-07T08:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.932+0000 7fb500a05700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc0b4070 con 0x7fb4fc0ceb30 2023-10-07T08:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.932+0000 7fb4fa59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4fc157fe0 0x7fb4fc0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.932+0000 7fb4fa59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4fc157fe0 0x7fb4fc0b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52126/0 (socket says 172.21.15.81:52126) 2023-10-07T08:54:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.932+0000 7fb4fa59c700 1 -- 172.21.15.81:0/68492985 learned_addr learned my addr 172.21.15.81:0/68492985 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb4fa59c700 1 -- 172.21.15.81:0/68492985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4fc0ceb30 msgr2=0x7fb4fc0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb4fa59c700 1 --2- 172.21.15.81:0/68492985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4fc0ceb30 0x7fb4fc0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb4fa59c700 1 -- 172.21.15.81:0/68492985 >> v2:172.21.15.89:3300/0 conn(0x7fb4fc1583b0 msgr2=0x7fb4fc0b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb4fa59c700 1 --2- 172.21.15.81:0/68492985 >> v2:172.21.15.89:3300/0 conn(0x7fb4fc1583b0 0x7fb4fc0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb4fa59c700 1 -- 172.21.15.81:0/68492985 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc0b4350 con 0x7fb4fc157fe0 2023-10-07T08:54:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb4fa59c700 1 --2- 172.21.15.81:0/68492985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc157fe0 0x7fb4fc0b34c0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc04c150 tx=0x7fb4ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24733d9d81ffd04 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb4f959a700 1 -- 172.21.15.81:0/68492985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec00e070 con 0x7fb4fc157fe0 2023-10-07T08:54:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb4f959a700 1 -- 172.21.15.81:0/68492985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ec00ba50 con 0x7fb4fc157fe0 2023-10-07T08:54:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb4f959a700 1 -- 172.21.15.81:0/68492985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec0092e0 con 0x7fb4fc157fe0 2023-10-07T08:54:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb500a05700 1 -- 172.21.15.81:0/68492985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc157fe0 msgr2=0x7fb4fc0b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb500a05700 1 --2- 172.21.15.81:0/68492985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc157fe0 0x7fb4fc0b34c0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc04c150 tx=0x7fb4ec009840 comp rx=0 tx=0).stop 2023-10-07T08:54:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb500a05700 1 -- 172.21.15.81:0/68492985 shutdown_connections 2023-10-07T08:54:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb500a05700 1 --2- 172.21.15.81:0/68492985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4fc0ceb30 0x7fb4fc0cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb500a05700 1 --2- 172.21.15.81:0/68492985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc157fe0 0x7fb4fc0b34c0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb500a05700 1 --2- 172.21.15.81:0/68492985 >> v2:172.21.15.89:3300/0 conn(0x7fb4fc1583b0 0x7fb4fc0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb500a05700 1 -- 172.21.15.81:0/68492985 >> 172.21.15.81:0/68492985 conn(0x7fb4fc067640 msgr2=0x7fb4fc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb500a05700 1 -- 172.21.15.81:0/68492985 shutdown_connections 2023-10-07T08:54:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.933+0000 7fb500a05700 1 -- 172.21.15.81:0/68492985 wait complete. 2023-10-07T08:54:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.934+0000 7fb500a05700 1 Processor -- start 2023-10-07T08:54:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.935+0000 7fb500a05700 1 -- start start 2023-10-07T08:54:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.935+0000 7fb500a05700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4fc0ceb30 0x7fb4fc1507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.935+0000 7fb500a05700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4fc157fe0 0x7fb4fc15b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.935+0000 7fb500a05700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc1583b0 0x7fb4fc1681e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.935+0000 7fb500a05700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc15b9c0 con 0x7fb4fc1583b0 2023-10-07T08:54:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.935+0000 7fb500a05700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc15bd50 con 0x7fb4fc0ceb30 2023-10-07T08:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.935+0000 7fb500a05700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc15c030 con 0x7fb4fc157fe0 2023-10-07T08:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.935+0000 7fb4fad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc1583b0 0x7fb4fc1681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.935+0000 7fb4fad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc1583b0 0x7fb4fc1681e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52130/0 (socket says 172.21.15.81:52130) 2023-10-07T08:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.935+0000 7fb4fad9d700 1 -- 172.21.15.81:0/903124406 learned_addr learned my addr 172.21.15.81:0/903124406 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.936+0000 7fb4fa59c700 1 --2- 172.21.15.81:0/903124406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4fc0ceb30 0x7fb4fc1507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.936+0000 7fb4f9d9b700 1 --2- 172.21.15.81:0/903124406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4fc157fe0 0x7fb4fc15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.936+0000 7fb4fad9d700 1 -- 172.21.15.81:0/903124406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4fc157fe0 msgr2=0x7fb4fc15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.936+0000 7fb4fad9d700 1 --2- 172.21.15.81:0/903124406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4fc157fe0 0x7fb4fc15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.936+0000 7fb4fad9d700 1 -- 172.21.15.81:0/903124406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4fc0ceb30 msgr2=0x7fb4fc1507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.936+0000 7fb4fad9d700 1 --2- 172.21.15.81:0/903124406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4fc0ceb30 0x7fb4fc1507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.936+0000 7fb4fad9d700 1 -- 172.21.15.81:0/903124406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec009ae0 con 0x7fb4fc1583b0 2023-10-07T08:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.936+0000 7fb4fad9d700 1 --2- 172.21.15.81:0/903124406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc1583b0 0x7fb4fc1681e0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400b590 tx=0x7fb4f4006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.936+0000 7fb4f27fc700 1 -- 172.21.15.81:0/903124406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400f510 con 0x7fb4fc1583b0 2023-10-07T08:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.936+0000 7fb4f27fc700 1 -- 172.21.15.81:0/903124406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f400f670 con 0x7fb4fc1583b0 2023-10-07T08:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.936+0000 7fb500a05700 1 -- 172.21.15.81:0/903124406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4fc15c310 con 0x7fb4fc1583b0 2023-10-07T08:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.936+0000 7fb4f27fc700 1 -- 172.21.15.81:0/903124406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400fa30 con 0x7fb4fc1583b0 2023-10-07T08:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.936+0000 7fb500a05700 1 -- 172.21.15.81:0/903124406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4fc150ce0 con 0x7fb4fc1583b0 2023-10-07T08:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.937+0000 7fb500a05700 1 -- 172.21.15.81:0/903124406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4fc150f60 con 0x7fb4fc1583b0 2023-10-07T08:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.937+0000 7fb4f27fc700 1 -- 172.21.15.81:0/903124406 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4f401a400 con 0x7fb4fc1583b0 2023-10-07T08:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.938+0000 7fb4f27fc700 1 --2- 172.21.15.81:0/903124406 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb4dc066f30 0x7fb4dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.938+0000 7fb4fa59c700 1 --2- 172.21.15.81:0/903124406 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb4dc066f30 0x7fb4dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.938+0000 7fb4f27fc700 1 -- 172.21.15.81:0/903124406 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb4f4084020 con 0x7fb4fc1583b0 2023-10-07T08:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.938+0000 7fb4f27fc700 1 -- 172.21.15.81:0/903124406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7fb4dc06ea50 con 0x7fb4fc1583b0 2023-10-07T08:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.938+0000 7fb4fa59c700 1 --2- 172.21.15.81:0/903124406 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb4dc066f30 0x7fb4dc0693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc04c150 tx=0x7fb4ec018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:04.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:04.942+0000 7fb4f27fc700 1 -- 172.21.15.81:0/903124406 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4f4051310 con 0x7fb4fc1583b0 2023-10-07T08:54:05.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.126+0000 7fb500a05700 1 -- 172.21.15.81:0/903124406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb4fc0cc6b0 con 0x7fb4fc1583b0 2023-10-07T08:54:05.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.127+0000 7fb4f27fc700 1 -- 172.21.15.81:0/903124406 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v192) v1 ==== 81+0+32253 (secure 0 0 0) 0x7fb4f4054930 con 0x7fb4fc1583b0 2023-10-07T08:54:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:05.127 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:54:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 192, 2023-10-07T08:54:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:54:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:54:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:54:03.339586+0000", 2023-10-07T08:54:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:54:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:54:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:54:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:54:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:54:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:54:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:54:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:54:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:54:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:54:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:54:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:54:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:54:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:54:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 23, 2023-10-07T08:54:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:54:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:54:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:54:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:54:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:54:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:54:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:54:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:54:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:54:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:54:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:54:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:54:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:54:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:54:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:54:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:54:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:54:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:54:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:54:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:54:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 22, 2023-10-07T08:54:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:54:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:53:46.818809+0000", 2023-10-07T08:54:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:54:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:54:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:54:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:54:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:54:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:54:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:54:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "189", 2023-10-07T08:54:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:54:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:54:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:54:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:54:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:54:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:54:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 23, 2023-10-07T08:54:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:54:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:53:47.460436+0000", 2023-10-07T08:54:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1027, 2023-10-07T08:54:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-07T08:54:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:54:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:54:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:54:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:54:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:54:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "192", 2023-10-07T08:54:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-07T08:54:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:54:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:54:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:54:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:54:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:54:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:54:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:54:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:54:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:54:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:54:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:54:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:54:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:54:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:54:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:54:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:54:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:54:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:54:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:54:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:54:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:54:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:54:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:54:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:54:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:54:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:54:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:54:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:54:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:54:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:54:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:54:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:54:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:54:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:54:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:54:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:54:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:54:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:54:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:54:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:54:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:54:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:54:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:54:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:54:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:54:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:54:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:54:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:54:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:54:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:54:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:54:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:54:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:54:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:54:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:54:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:54:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:54:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:54:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:54:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:54:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:54:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:54:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:54:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:54:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:54:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:54:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:54:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:54:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:54:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:54:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:54:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:54:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:54:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:54:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:54:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:54:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:54:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:54:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:54:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:54:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:54:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:54:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:54:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:54:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:54:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:54:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:54:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:54:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:54:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:54:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:54:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:54:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:54:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:54:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:54:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:54:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:54:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:54:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:54:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:54:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:54:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:54:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:54:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:54:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:54:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:54:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:54:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:54:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:54:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:54:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:54:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:54:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:54:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:54:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:54:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:54:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:54:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:54:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:54:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:54:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:54:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:54:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:54:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:54:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:54:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:54:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:54:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:54:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:54:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:54:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:54:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:54:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:54:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:54:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:54:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:54:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:54:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:54:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:54:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:54:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:54:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:54:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:54:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:54:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:54:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:54:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:54:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:54:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:54:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:54:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:05.236 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:54:05.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.128+0000 7fb500a05700 1 -- 172.21.15.81:0/903124406 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb4dc066f30 msgr2=0x7fb4dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:05.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.128+0000 7fb500a05700 1 --2- 172.21.15.81:0/903124406 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb4dc066f30 0x7fb4dc0693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc04c150 tx=0x7fb4ec018000 comp rx=0 tx=0).stop 2023-10-07T08:54:05.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.128+0000 7fb500a05700 1 -- 172.21.15.81:0/903124406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc1583b0 msgr2=0x7fb4fc1681e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:05.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.128+0000 7fb500a05700 1 --2- 172.21.15.81:0/903124406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc1583b0 0x7fb4fc1681e0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400b590 tx=0x7fb4f4006f90 comp rx=0 tx=0).stop 2023-10-07T08:54:05.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.129+0000 7fb500a05700 1 -- 172.21.15.81:0/903124406 shutdown_connections 2023-10-07T08:54:05.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.129+0000 7fb500a05700 1 --2- 172.21.15.81:0/903124406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4fc1583b0 0x7fb4fc1681e0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.129+0000 7fb500a05700 1 --2- 172.21.15.81:0/903124406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4fc0ceb30 0x7fb4fc1507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.129+0000 7fb500a05700 1 --2- 172.21.15.81:0/903124406 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb4dc066f30 0x7fb4dc0693e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.129+0000 7fb500a05700 1 --2- 172.21.15.81:0/903124406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4fc157fe0 0x7fb4fc15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.129+0000 7fb500a05700 1 -- 172.21.15.81:0/903124406 >> 172.21.15.81:0/903124406 conn(0x7fb4fc067640 msgr2=0x7fb4fc151150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:05.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.129+0000 7fb500a05700 1 -- 172.21.15.81:0/903124406 shutdown_connections 2023-10-07T08:54:05.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.129+0000 7fb500a05700 1 -- 172.21.15.81:0/903124406 wait complete. 2023-10-07T08:54:05.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:54:05.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.354+0000 7f2a034a1700 1 Processor -- start 2023-10-07T08:54:05.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.354+0000 7f2a034a1700 1 -- start start 2023-10-07T08:54:05.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a034a1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29fc159f10 0x7f29fc068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a034a1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc0cee10 con 0x7f29fc159b40 2023-10-07T08:54:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a034a1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29fc0cd040 con 0x7f29fc068cc0 2023-10-07T08:54:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a034a1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc069140 con 0x7f29fc159f10 2023-10-07T08:54:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a0249f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f29fc159b40 0x7f29fc0cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43582/0 (socket says 172.21.15.81:43582) 2023-10-07T08:54:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a0249f700 1 -- 172.21.15.81:0/97274766 learned_addr learned my addr 172.21.15.81:0/97274766 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a01c9e700 1 --2- 172.21.15.81:0/97274766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29fc159f10 0x7f29fc068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a0149d700 1 -- 172.21.15.81:0/97274766 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924202858 0 0) 0x7f29fc0cee10 con 0x7f29fc159b40 2023-10-07T08:54:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a0149d700 1 -- 172.21.15.81:0/97274766 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29e8003570 con 0x7f29fc159b40 2023-10-07T08:54:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a0149d700 1 -- 172.21.15.81:0/97274766 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3774296685 0 0) 0x7f29e8003570 con 0x7f29fc159b40 2023-10-07T08:54:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a0149d700 1 -- 172.21.15.81:0/97274766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29fc159f10 msgr2=0x7f29fc068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a0149d700 1 --2- 172.21.15.81:0/97274766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29fc159f10 0x7f29fc068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a0149d700 1 -- 172.21.15.81:0/97274766 >> v1:172.21.15.89:6789/0 conn(0x7f29fc068cc0 legacy=0x7f29fc0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a0149d700 1 -- 172.21.15.81:0/97274766 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc0cd320 con 0x7f29fc159b40 2023-10-07T08:54:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a0149d700 1 -- 172.21.15.81:0/97274766 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f29f8001470 con 0x7f29fc159b40 2023-10-07T08:54:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a0149d700 1 -- 172.21.15.81:0/97274766 >> v1:172.21.15.81:6789/0 conn(0x7f29fc159b40 legacy=0x7f29fc0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a0149d700 1 --2- 172.21.15.81:0/97274766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e8003a90 0x7f29e8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a0149d700 1 --2- 172.21.15.81:0/97274766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29fc159f10 0x7f29e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.355+0000 7f2a0149d700 1 --2- 172.21.15.81:0/97274766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e8004d50 0x7f29e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.356+0000 7f2a0149d700 1 -- 172.21.15.81:0/97274766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc069140 con 0x7f29e8003a90 2023-10-07T08:54:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.356+0000 7f2a0149d700 1 -- 172.21.15.81:0/97274766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e800bb10 con 0x7f29e8004d50 2023-10-07T08:54:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.356+0000 7f2a0149d700 1 -- 172.21.15.81:0/97274766 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e800bcd0 con 0x7f29fc159f10 2023-10-07T08:54:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.356+0000 7f2a0249f700 1 --2- 172.21.15.81:0/97274766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e8003a90 0x7f29e8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.356+0000 7f2a01c9e700 1 --2- 172.21.15.81:0/97274766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29fc159f10 0x7f29e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.356+0000 7f2a02ca0700 1 --2- 172.21.15.81:0/97274766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e8004d50 0x7f29e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.356+0000 7f2a0249f700 1 -- 172.21.15.81:0/97274766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29fc159f10 msgr2=0x7f29e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.356+0000 7f2a0249f700 1 --2- 172.21.15.81:0/97274766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29fc159f10 0x7f29e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.356+0000 7f2a0249f700 1 -- 172.21.15.81:0/97274766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e8004d50 msgr2=0x7f29e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.356+0000 7f2a0249f700 1 --2- 172.21.15.81:0/97274766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e8004d50 0x7f29e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.356+0000 7f2a0249f700 1 -- 172.21.15.81:0/97274766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e8003570 con 0x7f29e8003a90 2023-10-07T08:54:05.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.356+0000 7f2a0249f700 1 --2- 172.21.15.81:0/97274766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e8003a90 0x7f29e8003e60 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c3c0 tx=0x7f29f8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a780f2f96a460 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:05.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.356+0000 7f2a0149d700 1 -- 172.21.15.81:0/97274766 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f800cc90 con 0x7f29e8003a90 2023-10-07T08:54:05.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.356+0000 7f2a0149d700 1 -- 172.21.15.81:0/97274766 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f800ce10 con 0x7f29e8003a90 2023-10-07T08:54:05.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.356+0000 7f2a0149d700 1 -- 172.21.15.81:0/97274766 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8005b70 con 0x7f29e8003a90 2023-10-07T08:54:05.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.357+0000 7f2a034a1700 1 -- 172.21.15.81:0/97274766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e8003a90 msgr2=0x7f29e8003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:05.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.357+0000 7f2a034a1700 1 --2- 172.21.15.81:0/97274766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e8003a90 0x7f29e8003e60 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c3c0 tx=0x7f29f8001e70 comp rx=0 tx=0).stop 2023-10-07T08:54:05.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.357+0000 7f2a02ca0700 1 -- 172.21.15.81:0/97274766 reap_dead start 2023-10-07T08:54:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.357+0000 7f2a034a1700 1 -- 172.21.15.81:0/97274766 shutdown_connections 2023-10-07T08:54:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.357+0000 7f2a034a1700 1 -- 172.21.15.81:0/97274766 >> 172.21.15.81:0/97274766 conn(0x7f29fc0cd660 msgr2=0x7f29fc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.357+0000 7f2a034a1700 1 -- 172.21.15.81:0/97274766 shutdown_connections 2023-10-07T08:54:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.357+0000 7f2a034a1700 1 -- 172.21.15.81:0/97274766 wait complete. 2023-10-07T08:54:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.358+0000 7f2a034a1700 1 Processor -- start 2023-10-07T08:54:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.358+0000 7f2a034a1700 1 -- start start 2023-10-07T08:54:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a034a1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e8003a90 0x7f29fc0ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a034a1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29fc1608d0 0x7f29fc16b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a034a1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29fc160d40 0x7f29fc16b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a034a1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc15fbe0 con 0x7f29fc160d40 2023-10-07T08:54:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a034a1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc15e410 con 0x7f29fc1608d0 2023-10-07T08:54:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a034a1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc15fdf0 con 0x7f29e8003a90 2023-10-07T08:54:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a02ca0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29fc160d40 0x7f29fc16b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a02ca0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29fc160d40 0x7f29fc16b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52156/0 (socket says 172.21.15.81:52156) 2023-10-07T08:54:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a02ca0700 1 -- 172.21.15.81:0/2992874572 learned_addr learned my addr 172.21.15.81:0/2992874572 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a01c9e700 1 --2- 172.21.15.81:0/2992874572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29fc1608d0 0x7f29fc16b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a0249f700 1 --2- 172.21.15.81:0/2992874572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e8003a90 0x7f29fc0ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a02ca0700 1 -- 172.21.15.81:0/2992874572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e8003a90 msgr2=0x7f29fc0ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a02ca0700 1 --2- 172.21.15.81:0/2992874572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e8003a90 0x7f29fc0ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a02ca0700 1 -- 172.21.15.81:0/2992874572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29fc1608d0 msgr2=0x7f29fc16b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a02ca0700 1 --2- 172.21.15.81:0/2992874572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29fc1608d0 0x7f29fc16b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a02ca0700 1 -- 172.21.15.81:0/2992874572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc1600d0 con 0x7f29fc160d40 2023-10-07T08:54:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a02ca0700 1 --2- 172.21.15.81:0/2992874572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29fc160d40 0x7f29fc16b770 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f29fc06fd80 tx=0x7f29f4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f29f27fc700 1 -- 172.21.15.81:0/2992874572 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f40032e0 con 0x7f29fc160d40 2023-10-07T08:54:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f29f27fc700 1 -- 172.21.15.81:0/2992874572 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f4003440 con 0x7f29fc160d40 2023-10-07T08:54:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a034a1700 1 -- 172.21.15.81:0/2992874572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29fc1603b0 con 0x7f29fc160d40 2023-10-07T08:54:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f29f27fc700 1 -- 172.21.15.81:0/2992874572 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4001890 con 0x7f29fc160d40 2023-10-07T08:54:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.359+0000 7f2a034a1700 1 -- 172.21.15.81:0/2992874572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29fc0ca580 con 0x7f29fc160d40 2023-10-07T08:54:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.360+0000 7f2a034a1700 1 -- 172.21.15.81:0/2992874572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29fc0ca770 con 0x7f29fc160d40 2023-10-07T08:54:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.361+0000 7f29f27fc700 1 -- 172.21.15.81:0/2992874572 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29f4001c80 con 0x7f29fc160d40 2023-10-07T08:54:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.361+0000 7f29f27fc700 1 --2- 172.21.15.81:0/2992874572 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f29e0066f30 0x7f29e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.361+0000 7f29f27fc700 1 -- 172.21.15.81:0/2992874572 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f29f4084400 con 0x7f29fc160d40 2023-10-07T08:54:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.361+0000 7f2a0249f700 1 --2- 172.21.15.81:0/2992874572 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f29e0066f30 0x7f29e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.361+0000 7f29f27fc700 1 -- 172.21.15.81:0/2992874572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f29e006ea50 con 0x7f29fc160d40 2023-10-07T08:54:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.361+0000 7f2a0249f700 1 --2- 172.21.15.81:0/2992874572 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f29e0066f30 0x7f29e00693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f29f8007cf0 tx=0x7f29f8015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.365+0000 7f29f27fc700 1 -- 172.21.15.81:0/2992874572 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29f4051670 con 0x7f29fc160d40 2023-10-07T08:54:05.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.589+0000 7f2a034a1700 1 -- 172.21.15.81:0/2992874572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29fc1605a0 con 0x7f29fc160d40 2023-10-07T08:54:05.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.589+0000 7f29f27fc700 1 -- 172.21.15.81:0/2992874572 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f29f4054c90 con 0x7f29fc160d40 2023-10-07T08:54:05.590 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:05.590 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1601080758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1601080758},{"type":"v1","addr":"172.21.15.81:6837","nonce":1601080758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2709611313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2709611313},{"type":"v1","addr":"172.21.15.89:6835","nonce":2709611313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/3085029167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3085029167},{"type":"v1","addr":"172.21.15.89:6834","nonce":3085029167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:53:48.496016+0000","modified":"2023-10-07T08:53:52.345717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6836/2531199109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2531199109},{"type":"v1","addr":"172.21.15.81:6836","nonce":2531199109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-07T08:54:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.591+0000 7f2a034a1700 1 -- 172.21.15.81:0/2992874572 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f29e0066f30 msgr2=0x7f29e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.591+0000 7f2a034a1700 1 --2- 172.21.15.81:0/2992874572 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f29e0066f30 0x7f29e00693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f29f8007cf0 tx=0x7f29f8015000 comp rx=0 tx=0).stop 2023-10-07T08:54:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.591+0000 7f2a034a1700 1 -- 172.21.15.81:0/2992874572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29fc160d40 msgr2=0x7f29fc16b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:05.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.591+0000 7f2a034a1700 1 --2- 172.21.15.81:0/2992874572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29fc160d40 0x7f29fc16b770 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f29fc06fd80 tx=0x7f29f4009040 comp rx=0 tx=0).stop 2023-10-07T08:54:05.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.591+0000 7f2a034a1700 1 -- 172.21.15.81:0/2992874572 shutdown_connections 2023-10-07T08:54:05.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.591+0000 7f2a034a1700 1 --2- 172.21.15.81:0/2992874572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29fc160d40 0x7f29fc16b770 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.591+0000 7f2a034a1700 1 --2- 172.21.15.81:0/2992874572 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f29e0066f30 0x7f29e00693e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.591+0000 7f2a034a1700 1 --2- 172.21.15.81:0/2992874572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e8003a90 0x7f29fc0ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.591+0000 7f2a034a1700 1 --2- 172.21.15.81:0/2992874572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29fc1608d0 0x7f29fc16b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.591+0000 7f2a034a1700 1 -- 172.21.15.81:0/2992874572 >> 172.21.15.81:0/2992874572 conn(0x7f29fc0cd660 msgr2=0x7f29fc0c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:05.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.591+0000 7f2a034a1700 1 -- 172.21.15.81:0/2992874572 shutdown_connections 2023-10-07T08:54:05.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.591+0000 7f2a034a1700 1 -- 172.21.15.81:0/2992874572 wait complete. 2023-10-07T08:54:05.593 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-07T08:54:05.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-07T08:54:05.735 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":8160,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":16.384648319,"mdsmap_epoch":90,"osdmap_epoch":192,"osdmap_epoch_barrier":192,"uptime":21.709262624000001} 2023-10-07T08:54:05.736 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 8160, "mdsmap_epoch": 90, "osdmap_epoch": 192, "osdmap_epoch_barrier": 192, "rank_uptime": 16.384648319, "state": "up:active", "uptime": 21.709262624, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:54:05.736 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-07T08:54:05.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:54:05.736 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-07T08:54:05.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:54:05.752 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-07T08:54:05.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:54:05.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.968+0000 7f6c0c2d5700 1 Processor -- start 2023-10-07T08:54:05.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.968+0000 7f6c0c2d5700 1 -- start start 2023-10-07T08:54:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.969+0000 7f6c0c2d5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c04157fe0 0x7f6c040b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.969+0000 7f6c0c2d5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6c040cf240 0x7f6c040b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.969+0000 7f6c0c2d5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c040b2890 con 0x7f6c041583b0 2023-10-07T08:54:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.969+0000 7f6c0c2d5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c040b4070 con 0x7f6c040cf240 2023-10-07T08:54:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.969+0000 7f6c0c2d5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040b4350 con 0x7f6c04157fe0 2023-10-07T08:54:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.969+0000 7f6c09870700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6c041583b0 0x7f6c040ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43592/0 (socket says 172.21.15.81:43592) 2023-10-07T08:54:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.969+0000 7f6c09870700 1 -- 172.21.15.81:0/1102907126 learned_addr learned my addr 172.21.15.81:0/1102907126 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0906f700 1 -- 172.21.15.81:0/1102907126 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146195396 0 0) 0x7f6c040b2890 con 0x7f6c041583b0 2023-10-07T08:54:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0a872700 1 --2- 172.21.15.81:0/1102907126 >> v2:172.21.15.89:3300/0 conn(0x7f6c040cf240 0x7f6c040b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0a071700 1 --2- 172.21.15.81:0/1102907126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c04157fe0 0x7f6c040b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0906f700 1 -- 172.21.15.81:0/1102907126 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bec003570 con 0x7f6c041583b0 2023-10-07T08:54:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0906f700 1 -- 172.21.15.81:0/1102907126 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2376090300 0 0) 0x7f6bec003570 con 0x7f6c041583b0 2023-10-07T08:54:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0906f700 1 -- 172.21.15.81:0/1102907126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c04157fe0 msgr2=0x7f6c040b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0906f700 1 --2- 172.21.15.81:0/1102907126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c04157fe0 0x7f6c040b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0906f700 1 -- 172.21.15.81:0/1102907126 >> v2:172.21.15.89:3300/0 conn(0x7f6c040cf240 msgr2=0x7f6c040b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0906f700 1 --2- 172.21.15.81:0/1102907126 >> v2:172.21.15.89:3300/0 conn(0x7f6c040cf240 0x7f6c040b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0906f700 1 -- 172.21.15.81:0/1102907126 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c040b4630 con 0x7f6c041583b0 2023-10-07T08:54:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0906f700 1 -- 172.21.15.81:0/1102907126 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f6bf8001470 con 0x7f6c041583b0 2023-10-07T08:54:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0906f700 1 -- 172.21.15.81:0/1102907126 >> v1:172.21.15.81:6789/0 conn(0x7f6c041583b0 legacy=0x7f6c040ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0906f700 1 --2- 172.21.15.81:0/1102907126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c04157fe0 0x7f6bec003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0906f700 1 --2- 172.21.15.81:0/1102907126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bec003fe0 0x7f6bec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0906f700 1 --2- 172.21.15.81:0/1102907126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bec004d50 0x7f6bec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0906f700 1 -- 172.21.15.81:0/1102907126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040b4070 con 0x7f6bec004d50 2023-10-07T08:54:05.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0906f700 1 -- 172.21.15.81:0/1102907126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040b4350 con 0x7f6bec003fe0 2023-10-07T08:54:05.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0906f700 1 -- 172.21.15.81:0/1102907126 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec00bb40 con 0x7f6c04157fe0 2023-10-07T08:54:05.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0a872700 1 --2- 172.21.15.81:0/1102907126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bec004d50 0x7f6bec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c09870700 1 --2- 172.21.15.81:0/1102907126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bec003fe0 0x7f6bec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0a071700 1 --2- 172.21.15.81:0/1102907126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c04157fe0 0x7f6bec003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0a872700 1 -- 172.21.15.81:0/1102907126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c04157fe0 msgr2=0x7f6bec003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:05.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0a872700 1 --2- 172.21.15.81:0/1102907126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c04157fe0 0x7f6bec003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0a872700 1 -- 172.21.15.81:0/1102907126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bec003fe0 msgr2=0x7f6bec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:05.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0a872700 1 --2- 172.21.15.81:0/1102907126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bec003fe0 0x7f6bec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.970+0000 7f6c0a872700 1 -- 172.21.15.81:0/1102907126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec003570 con 0x7f6bec004d50 2023-10-07T08:54:05.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.971+0000 7f6c0a872700 1 --2- 172.21.15.81:0/1102907126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bec004d50 0x7f6bec0051c0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0094d0 tx=0x7f6bfc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14f34a188d7425f server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:05.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.971+0000 7f6c0906f700 1 -- 172.21.15.81:0/1102907126 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc00ea60 con 0x7f6bec004d50 2023-10-07T08:54:05.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.971+0000 7f6c0906f700 1 -- 172.21.15.81:0/1102907126 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc00f040 con 0x7f6bec004d50 2023-10-07T08:54:05.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.971+0000 7f6c0906f700 1 -- 172.21.15.81:0/1102907126 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc00edf0 con 0x7f6bec004d50 2023-10-07T08:54:05.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.971+0000 7f6c0c2d5700 1 -- 172.21.15.81:0/1102907126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bec004d50 msgr2=0x7f6bec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:05.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.971+0000 7f6c0c2d5700 1 --2- 172.21.15.81:0/1102907126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bec004d50 0x7f6bec0051c0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0094d0 tx=0x7f6bfc00b040 comp rx=0 tx=0).stop 2023-10-07T08:54:05.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.971+0000 7f6c0a872700 1 -- 172.21.15.81:0/1102907126 reap_dead start 2023-10-07T08:54:05.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.971+0000 7f6c0c2d5700 1 -- 172.21.15.81:0/1102907126 shutdown_connections 2023-10-07T08:54:05.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.971+0000 7f6c0c2d5700 1 -- 172.21.15.81:0/1102907126 >> 172.21.15.81:0/1102907126 conn(0x7f6c04067640 msgr2=0x7f6c04067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:05.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.971+0000 7f6c0c2d5700 1 -- 172.21.15.81:0/1102907126 shutdown_connections 2023-10-07T08:54:05.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.971+0000 7f6c0c2d5700 1 -- 172.21.15.81:0/1102907126 wait complete. 2023-10-07T08:54:05.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.972+0000 7f6c0c2d5700 1 Processor -- start 2023-10-07T08:54:05.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.972+0000 7f6c0c2d5700 1 -- start start 2023-10-07T08:54:05.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c0c2d5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bec004d50 0x7f6c04168b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c0c2d5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c040c7ee0 0x7f6c040c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c0c2d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0415d4a0 0x7f6c0415d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c0c2d5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040ca120 con 0x7f6c0415d4a0 2023-10-07T08:54:05.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c0c2d5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0415e390 con 0x7f6c040c7ee0 2023-10-07T08:54:05.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c0c2d5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0415e670 con 0x7f6bec004d50 2023-10-07T08:54:05.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c0a872700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0415d4a0 0x7f6c0415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c0a872700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0415d4a0 0x7f6c0415d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52170/0 (socket says 172.21.15.81:52170) 2023-10-07T08:54:05.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c0a872700 1 -- 172.21.15.81:0/4105654966 learned_addr learned my addr 172.21.15.81:0/4105654966 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:05.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c0a071700 1 --2- 172.21.15.81:0/4105654966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bec004d50 0x7f6c04168b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c09870700 1 --2- 172.21.15.81:0/4105654966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c040c7ee0 0x7f6c040c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c0a872700 1 -- 172.21.15.81:0/4105654966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bec004d50 msgr2=0x7f6c04168b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:05.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c0a872700 1 --2- 172.21.15.81:0/4105654966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bec004d50 0x7f6c04168b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c0a872700 1 -- 172.21.15.81:0/4105654966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c040c7ee0 msgr2=0x7f6c040c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:05.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c0a872700 1 --2- 172.21.15.81:0/4105654966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c040c7ee0 0x7f6c040c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:05.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c0a872700 1 -- 172.21.15.81:0/4105654966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0415e950 con 0x7f6c0415d4a0 2023-10-07T08:54:05.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.973+0000 7f6c0a071700 1 --2- 172.21.15.81:0/4105654966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bec004d50 0x7f6c04168b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:05.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.974+0000 7f6c0a872700 1 --2- 172.21.15.81:0/4105654966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0415d4a0 0x7f6c0415d920 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f6c0406abb0 tx=0x7f6bfc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.974+0000 7f6c027fc700 1 -- 172.21.15.81:0/4105654966 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc00eee0 con 0x7f6c0415d4a0 2023-10-07T08:54:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.974+0000 7f6c027fc700 1 -- 172.21.15.81:0/4105654966 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc01e640 con 0x7f6c0415d4a0 2023-10-07T08:54:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.974+0000 7f6c0c2d5700 1 -- 172.21.15.81:0/4105654966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c040c8890 con 0x7f6c0415d4a0 2023-10-07T08:54:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.974+0000 7f6c027fc700 1 -- 172.21.15.81:0/4105654966 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc01ea40 con 0x7f6c0415d4a0 2023-10-07T08:54:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.974+0000 7f6c0c2d5700 1 -- 172.21.15.81:0/4105654966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0415de60 con 0x7f6c0415d4a0 2023-10-07T08:54:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.975+0000 7f6c0c2d5700 1 -- 172.21.15.81:0/4105654966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c040c9f80 con 0x7f6c0415d4a0 2023-10-07T08:54:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.975+0000 7f6c027fc700 1 -- 172.21.15.81:0/4105654966 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6bfc003040 con 0x7f6c0415d4a0 2023-10-07T08:54:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.976+0000 7f6c027fc700 1 --2- 172.21.15.81:0/4105654966 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6bf0066f30 0x7f6bf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.976+0000 7f6c0a071700 1 --2- 172.21.15.81:0/4105654966 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6bf0066f30 0x7f6bf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.976+0000 7f6c027fc700 1 -- 172.21.15.81:0/4105654966 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6bfc0865e0 con 0x7f6c0415d4a0 2023-10-07T08:54:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.976+0000 7f6c027fc700 1 -- 172.21.15.81:0/4105654966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f6bf006ea50 con 0x7f6c0415d4a0 2023-10-07T08:54:05.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.976+0000 7f6c0a071700 1 --2- 172.21.15.81:0/4105654966 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6bf0066f30 0x7f6bf00693e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6c0416b5a0 tx=0x7f6bf4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:05.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:05.980+0000 7f6c027fc700 1 -- 172.21.15.81:0/4105654966 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c040c9f80 con 0x7f6c0415d4a0 2023-10-07T08:54:06.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:06.165+0000 7f6c0c2d5700 1 -- 172.21.15.81:0/4105654966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6c040c9f80 con 0x7f6c0415d4a0 2023-10-07T08:54:06.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:06.166+0000 7f6c027fc700 1 -- 172.21.15.81:0/4105654966 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v192) v1 ==== 81+0+32253 (secure 0 0 0) 0x7f6c040c9f80 con 0x7f6c0415d4a0 2023-10-07T08:54:06.166 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:06.166 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:54:06.167 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 192, 2023-10-07T08:54:06.167 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:54:06.167 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:54:06.167 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:54:03.339586+0000", 2023-10-07T08:54:06.167 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:54:06.167 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:54:06.167 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:54:06.167 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:54:06.167 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:54:06.167 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:54:06.168 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:54:06.168 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:54:06.168 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:54:06.168 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:06.168 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:54:06.168 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:54:06.168 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:54:06.168 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:54:06.168 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:54:06.168 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 23, 2023-10-07T08:54:06.168 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:54:06.169 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:54:06.169 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:54:06.169 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:54:06.169 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:54:06.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.169 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:54:06.169 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:54:06.169 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:54:06.169 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:54:06.169 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:54:06.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:06.169 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:06.170 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:06.170 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:06.170 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:06.170 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:06.170 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:06.170 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:06.170 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:06.170 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:06.170 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:54:06.170 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:54:06.170 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:54:06.171 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:54:06.171 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:54:06.171 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:06.171 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:06.171 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:06.171 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:06.171 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:06.171 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:06.171 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:06.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.171 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:54:06.172 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:06.172 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:06.172 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:06.172 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:06.172 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:06.172 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:06.172 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:06.172 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:06.172 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:06.172 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:54:06.172 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:06.173 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:06.173 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:06.173 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:06.173 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:06.173 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:06.173 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:06.173 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:06.173 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:06.173 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:06.173 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:06.173 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:06.174 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:06.174 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:06.174 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:06.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:06.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.174 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:06.174 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:06.174 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:06.174 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:06.174 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:06.174 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:06.175 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:06.175 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:06.175 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:06.175 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:06.175 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:06.175 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:06.175 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:54:06.175 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:54:06.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.175 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:06.175 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:54:06.176 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.176 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 22, 2023-10-07T08:54:06.176 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:54:06.176 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:53:46.818809+0000", 2023-10-07T08:54:06.176 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:54:06.176 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:54:06.176 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:06.176 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:06.176 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:06.176 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:06.177 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:06.177 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:06.177 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:06.177 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:06.177 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:06.177 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:06.177 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:54:06.177 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:54:06.177 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:54:06.177 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:54:06.177 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:54:06.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:06.178 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:06.178 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:06.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:06.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:06.178 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:06.178 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:06.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "189", 2023-10-07T08:54:06.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:06.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:06.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:06.179 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:06.179 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:06.179 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:06.179 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:06.179 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:06.179 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:06.179 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:54:06.179 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:06.179 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:06.179 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:06.180 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:06.180 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:06.180 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:06.180 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:06.180 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:06.180 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:06.180 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:06.180 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:06.180 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:06.180 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:06.180 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:06.181 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:06.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:06.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.181 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:06.181 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:06.181 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:06.181 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:06.181 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:06.181 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:06.182 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:06.182 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:06.182 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:06.182 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:06.182 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:06.182 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:06.182 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:54:06.182 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:54:06.182 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:54:06.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.183 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:06.183 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:54:06.183 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:54:06.183 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.183 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.183 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 23, 2023-10-07T08:54:06.183 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:54:06.183 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:53:47.460436+0000", 2023-10-07T08:54:06.184 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1027, 2023-10-07T08:54:06.184 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-07T08:54:06.184 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:06.184 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:06.184 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:06.184 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:06.184 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:06.184 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:06.184 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:06.184 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:06.185 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:06.185 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:06.185 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:54:06.185 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:54:06.185 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:54:06.185 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:54:06.185 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:54:06.185 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:06.185 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:06.185 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:06.185 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:06.186 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:06.186 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:06.186 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:06.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.186 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "192", 2023-10-07T08:54:06.186 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:06.186 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:06.186 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:06.186 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:06.186 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:06.186 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:06.187 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:06.187 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:06.187 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:06.187 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-07T08:54:06.187 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:06.187 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:06.187 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:06.187 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:06.187 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:06.187 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:06.188 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:06.188 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:06.188 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:06.188 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:06.188 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:06.188 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:06.188 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:06.188 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:06.188 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:06.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:06.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.189 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:06.189 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:06.189 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:06.189 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:06.189 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:06.189 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:06.189 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:06.189 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:06.189 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:06.189 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:06.190 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:06.190 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:06.190 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:54:06.190 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:54:06.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.190 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:06.190 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:54:06.190 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:54:06.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.191 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.191 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:06.191 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:54:06.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.191 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:54:06.191 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:06.191 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:06.191 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:06.191 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:06.191 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:06.191 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:06.192 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:06.192 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:06.192 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:06.192 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:06.192 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:06.192 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:06.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:54:06.192 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:06.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:54:06.193 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:06.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.193 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.193 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:06.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:54:06.194 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:06.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:54:06.194 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:06.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.194 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.194 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:06.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:54:06.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:06.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:54:06.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:06.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.196 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:06.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:54:06.196 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:06.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.197 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:54:06.197 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:06.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.197 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.197 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:54:06.197 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:54:06.197 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:54:06.197 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:54:06.198 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:06.198 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:06.198 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:06.198 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.198 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:54:06.198 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:06.198 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:06.198 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:06.198 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:06.199 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:06.199 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:06.199 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:06.199 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:06.199 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:06.199 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:06.199 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:06.199 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:06.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:54:06.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:06.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:54:06.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:06.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.200 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.200 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:06.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:54:06.201 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:06.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:54:06.201 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:06.202 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.202 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.202 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:06.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:54:06.202 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:06.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.203 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:54:06.203 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:06.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.203 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.203 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:06.203 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.203 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:54:06.204 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:06.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:54:06.204 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:06.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.204 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:54:06.204 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:54:06.205 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:54:06.205 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:54:06.205 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:06.205 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:06.205 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:06.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.205 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:54:06.205 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:06.205 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:06.206 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:06.206 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:06.206 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:06.206 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:06.206 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:06.207 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:06.207 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:06.207 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:06.207 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:06.207 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:06.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:54:06.207 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:06.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.208 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.208 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:54:06.208 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:06.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.208 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.208 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:06.208 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.208 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:54:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:54:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:06.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:54:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:54:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.210 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:54:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:54:06.211 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:54:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:54:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:54:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:54:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:06.212 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:54:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:06.213 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:54:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:06.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:54:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:54:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:54:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.216 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:54:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:54:06.217 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:54:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:06.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:54:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:54:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:54:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:54:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:54:06.219 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:54:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:06.220 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:54:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:54:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:54:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:54:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:54:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:54:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:54:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:54:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.226 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:54:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:54:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:54:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:54:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:54:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:06.228 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:54:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:54:06.229 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:54:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:54:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.231 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:54:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:54:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.232 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:54:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.233 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:54:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:54:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:54:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:54:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:54:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:06.234 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:54:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:06.235 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:54:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:06.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:54:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:54:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:54:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.238 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:54:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:54:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:54:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:06.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:54:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:54:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:54:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:54:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:54:06.241 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:54:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:06.242 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:54:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:54:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:06.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:54:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:54:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:06.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:54:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.246 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:54:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:06.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:54:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:54:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.248 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:54:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:54:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:54:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:54:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:06.249 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:54:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:54:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:54:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:54:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:54:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.251 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:54:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:54:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:54:06.252 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:54:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:54:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:54:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:54:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:06.254 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:54:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:54:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:06.255 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:54:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:54:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:54:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:54:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:54:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:54:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:54:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:54:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:54:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:54:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:54:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:54:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:54:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:54:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:54:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:54:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:54:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:54:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:54:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:54:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:54:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:54:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:54:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:54:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:54:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:54:06.259 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:54:06.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:06.260 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:54:06.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:06.168+0000 7f6c0c2d5700 1 -- 172.21.15.81:0/4105654966 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6bf0066f30 msgr2=0x7f6bf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:06.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:06.168+0000 7f6c0c2d5700 1 --2- 172.21.15.81:0/4105654966 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6bf0066f30 0x7f6bf00693e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6c0416b5a0 tx=0x7f6bf4008040 comp rx=0 tx=0).stop 2023-10-07T08:54:06.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:06.168+0000 7f6c0c2d5700 1 -- 172.21.15.81:0/4105654966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0415d4a0 msgr2=0x7f6c0415d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:06.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:06.168+0000 7f6c0c2d5700 1 --2- 172.21.15.81:0/4105654966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0415d4a0 0x7f6c0415d920 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f6c0406abb0 tx=0x7f6bfc01a000 comp rx=0 tx=0).stop 2023-10-07T08:54:06.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:06.168+0000 7f6c0c2d5700 1 -- 172.21.15.81:0/4105654966 shutdown_connections 2023-10-07T08:54:06.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:06.168+0000 7f6c0c2d5700 1 --2- 172.21.15.81:0/4105654966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c0415d4a0 0x7f6c0415d920 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:06.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:06.168+0000 7f6c0c2d5700 1 --2- 172.21.15.81:0/4105654966 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6bf0066f30 0x7f6bf00693e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:06.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:06.168+0000 7f6c0c2d5700 1 --2- 172.21.15.81:0/4105654966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bec004d50 0x7f6c04168b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:06.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:06.168+0000 7f6c0c2d5700 1 --2- 172.21.15.81:0/4105654966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c040c7ee0 0x7f6c040c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:06.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:06.168+0000 7f6c0c2d5700 1 -- 172.21.15.81:0/4105654966 >> 172.21.15.81:0/4105654966 conn(0x7f6c04067640 msgr2=0x7f6c040ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:06.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:06.168+0000 7f6c0c2d5700 1 -- 172.21.15.81:0/4105654966 shutdown_connections 2023-10-07T08:54:06.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:06.168+0000 7f6c0c2d5700 1 -- 172.21.15.81:0/4105654966 wait complete. 2023-10-07T08:54:06.263 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-07T08:54:11.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:54:11.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.386+0000 7f6e73666700 1 Processor -- start 2023-10-07T08:54:11.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.387+0000 7f6e73666700 1 -- start start 2023-10-07T08:54:11.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.387+0000 7f6e73666700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e6c0cf240 0x7f6e6c162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:11.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.387+0000 7f6e73666700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e6c0b2890 con 0x7f6e6c0b3bd0 2023-10-07T08:54:11.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.387+0000 7f6e73666700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e6c0b4070 con 0x7f6e6c157fe0 2023-10-07T08:54:11.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.387+0000 7f6e73666700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e6c0b4350 con 0x7f6e6c0cf240 2023-10-07T08:54:11.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.388+0000 7f6e71402700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6e6c157fe0 0x7f6e6c0b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:57222/0 (socket says 172.21.15.81:57222) 2023-10-07T08:54:11.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.388+0000 7f6e71402700 1 -- 172.21.15.81:0/2093434302 learned_addr learned my addr 172.21.15.81:0/2093434302 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:11.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.388+0000 7f6e71c03700 1 --2- 172.21.15.81:0/2093434302 >> v2:172.21.15.81:3300/0 conn(0x7f6e6c0cf240 0x7f6e6c162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:11.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.388+0000 7f6e71c03700 1 -- 172.21.15.81:0/2093434302 >> v1:172.21.15.89:6789/0 conn(0x7f6e6c157fe0 legacy=0x7f6e6c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:11.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.388+0000 7f6e71c03700 1 -- 172.21.15.81:0/2093434302 >> v1:172.21.15.81:6789/0 conn(0x7f6e6c0b3bd0 legacy=0x7f6e6c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:11.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.388+0000 7f6e71c03700 1 -- 172.21.15.81:0/2093434302 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c0b4630 con 0x7f6e6c0cf240 2023-10-07T08:54:11.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.388+0000 7f6e71c03700 1 --2- 172.21.15.81:0/2093434302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c0cf240 0x7f6e6c162cd0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009e60 tx=0x7f6e68009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5155e2227784ca server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:11.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.389+0000 7f6e63fff700 1 -- 172.21.15.81:0/2093434302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6800e070 con 0x7f6e6c0cf240 2023-10-07T08:54:11.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.389+0000 7f6e63fff700 1 -- 172.21.15.81:0/2093434302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6800bc30 con 0x7f6e6c0cf240 2023-10-07T08:54:11.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.389+0000 7f6e63fff700 1 -- 172.21.15.81:0/2093434302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e68012430 con 0x7f6e6c0cf240 2023-10-07T08:54:11.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.389+0000 7f6e73666700 1 -- 172.21.15.81:0/2093434302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c0cf240 msgr2=0x7f6e6c162cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:11.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.389+0000 7f6e73666700 1 --2- 172.21.15.81:0/2093434302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c0cf240 0x7f6e6c162cd0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009e60 tx=0x7f6e68009780 comp rx=0 tx=0).stop 2023-10-07T08:54:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.390+0000 7f6e73666700 1 -- 172.21.15.81:0/2093434302 shutdown_connections 2023-10-07T08:54:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.390+0000 7f6e73666700 1 --2- 172.21.15.81:0/2093434302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c0cf240 0x7f6e6c162cd0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.390+0000 7f6e73666700 1 -- 172.21.15.81:0/2093434302 >> 172.21.15.81:0/2093434302 conn(0x7f6e6c067640 msgr2=0x7f6e6c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.390+0000 7f6e73666700 1 -- 172.21.15.81:0/2093434302 shutdown_connections 2023-10-07T08:54:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.390+0000 7f6e73666700 1 -- 172.21.15.81:0/2093434302 wait complete. 2023-10-07T08:54:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.391+0000 7f6e73666700 1 Processor -- start 2023-10-07T08:54:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.391+0000 7f6e73666700 1 -- start start 2023-10-07T08:54:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e73666700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e6c0b3bd0 0x7f6e6c0c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e73666700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e6c0cf240 0x7f6e6c0c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e73666700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c157fe0 0x7f6e6c152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e73666700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c0c9f10 con 0x7f6e6c157fe0 2023-10-07T08:54:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e73666700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c0ca0a0 con 0x7f6e6c0cf240 2023-10-07T08:54:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e73666700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c0c4040 con 0x7f6e6c0b3bd0 2023-10-07T08:54:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e71c03700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c157fe0 0x7f6e6c152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e71c03700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c157fe0 0x7f6e6c152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52188/0 (socket says 172.21.15.81:52188) 2023-10-07T08:54:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e71c03700 1 -- 172.21.15.81:0/4273553722 learned_addr learned my addr 172.21.15.81:0/4273553722 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e71402700 1 --2- 172.21.15.81:0/4273553722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e6c0b3bd0 0x7f6e6c0c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e70c01700 1 --2- 172.21.15.81:0/4273553722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e6c0cf240 0x7f6e6c0c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e71c03700 1 -- 172.21.15.81:0/4273553722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e6c0b3bd0 msgr2=0x7f6e6c0c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e71c03700 1 --2- 172.21.15.81:0/4273553722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e6c0b3bd0 0x7f6e6c0c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e71c03700 1 -- 172.21.15.81:0/4273553722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e6c0cf240 msgr2=0x7f6e6c0c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e71c03700 1 --2- 172.21.15.81:0/4273553722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e6c0cf240 0x7f6e6c0c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e71c03700 1 -- 172.21.15.81:0/4273553722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e68009a20 con 0x7f6e6c157fe0 2023-10-07T08:54:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e71c03700 1 --2- 172.21.15.81:0/4273553722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c157fe0 0x7f6e6c152e70 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f6e680097c0 tx=0x7f6e68019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e617fa700 1 -- 172.21.15.81:0/4273553722 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e68012e10 con 0x7f6e6c157fe0 2023-10-07T08:54:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e617fa700 1 -- 172.21.15.81:0/4273553722 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6801e630 con 0x7f6e6c157fe0 2023-10-07T08:54:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e73666700 1 -- 172.21.15.81:0/4273553722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6c0c4320 con 0x7f6e6c157fe0 2023-10-07T08:54:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.392+0000 7f6e617fa700 1 -- 172.21.15.81:0/4273553722 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6801e9f0 con 0x7f6e6c157fe0 2023-10-07T08:54:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.393+0000 7f6e73666700 1 -- 172.21.15.81:0/4273553722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6c0c48e0 con 0x7f6e6c157fe0 2023-10-07T08:54:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.393+0000 7f6e73666700 1 -- 172.21.15.81:0/4273553722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6c069e40 con 0x7f6e6c157fe0 2023-10-07T08:54:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.394+0000 7f6e617fa700 1 -- 172.21.15.81:0/4273553722 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e68024070 con 0x7f6e6c157fe0 2023-10-07T08:54:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.394+0000 7f6e617fa700 1 --2- 172.21.15.81:0/4273553722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e50066f30 0x7f6e500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.394+0000 7f6e71402700 1 --2- 172.21.15.81:0/4273553722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e50066f30 0x7f6e500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.394+0000 7f6e617fa700 1 -- 172.21.15.81:0/4273553722 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6e68086cc0 con 0x7f6e6c157fe0 2023-10-07T08:54:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.395+0000 7f6e617fa700 1 -- 172.21.15.81:0/4273553722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f6e5006ea50 con 0x7f6e6c157fe0 2023-10-07T08:54:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.395+0000 7f6e71402700 1 --2- 172.21.15.81:0/4273553722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e50066f30 0x7f6e500693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6e64007110 tx=0x7f6e64007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.399+0000 7f6e617fa700 1 -- 172.21.15.81:0/4273553722 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e68053f30 con 0x7f6e6c157fe0 2023-10-07T08:54:11.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.582+0000 7f6e73666700 1 -- 172.21.15.81:0/4273553722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6e6c0cc2c0 con 0x7f6e6c157fe0 2023-10-07T08:54:11.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.583+0000 7f6e617fa700 1 -- 172.21.15.81:0/4273553722 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v192) v1 ==== 81+0+32253 (secure 0 0 0) 0x7f6e68057550 con 0x7f6e6c157fe0 2023-10-07T08:54:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:11.584 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:54:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 192, 2023-10-07T08:54:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:54:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:54:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:54:03.339586+0000", 2023-10-07T08:54:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:54:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:54:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:54:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:54:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:54:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:54:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:54:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:54:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:54:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:54:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:54:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:54:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:54:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:54:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 23, 2023-10-07T08:54:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:54:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:54:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:54:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:54:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:54:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:54:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:54:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:54:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:54:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:54:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:54:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:54:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:54:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:54:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:54:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:54:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:54:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:54:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:54:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:54:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 22, 2023-10-07T08:54:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:54:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:53:46.818809+0000", 2023-10-07T08:54:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:54:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:54:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:54:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:54:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:54:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:54:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:54:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "189", 2023-10-07T08:54:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:54:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:54:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:54:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:54:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:54:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:54:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 23, 2023-10-07T08:54:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:54:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:53:47.460436+0000", 2023-10-07T08:54:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1027, 2023-10-07T08:54:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-07T08:54:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:54:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:54:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:54:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:54:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:54:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "192", 2023-10-07T08:54:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-07T08:54:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:54:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:54:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:54:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:54:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:54:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:54:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:54:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:54:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:54:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:54:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:54:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:54:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:54:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:54:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:54:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:54:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:54:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:54:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:54:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:54:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:54:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:54:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:54:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:54:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:54:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:54:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:54:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:54:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:54:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:54:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:54:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:54:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:54:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:54:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:54:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:54:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:54:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:54:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:54:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:54:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:54:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:54:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:54:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:54:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:54:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:54:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:54:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:54:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:54:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:54:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:54:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:54:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:54:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:54:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:54:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:54:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:54:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:54:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:54:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:54:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:54:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:54:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:54:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:54:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:54:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:54:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:54:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:54:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:54:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:54:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:54:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:54:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:54:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:54:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:54:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:54:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:54:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:54:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:54:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:54:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:54:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:54:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:54:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:54:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:54:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:54:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:54:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:54:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:54:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:54:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:54:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:54:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:54:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:54:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:54:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:54:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:54:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:54:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:54:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:54:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:54:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:54:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:54:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:54:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:54:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:54:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:54:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:54:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:54:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:54:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:54:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:54:11.659 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:11.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.659 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:54:11.659 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:11.659 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:11.659 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:11.659 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:11.659 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:11.659 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:54:11.659 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:11.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.660 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:54:11.660 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:11.660 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:11.660 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:11.660 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:11.660 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:11.660 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:54:11.660 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:11.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.660 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:54:11.661 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:11.661 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:11.661 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:11.661 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:11.661 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:11.661 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:54:11.661 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:11.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.661 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:54:11.661 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:11.661 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:11.661 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:11.662 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:11.662 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:11.662 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:54:11.662 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:11.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.662 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:54:11.662 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:11.662 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:11.662 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:11.662 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:11.662 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:11.663 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:54:11.663 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:11.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.663 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:54:11.663 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:11.663 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:11.663 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:11.663 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:11.663 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:11.663 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:54:11.663 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:11.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:11.664 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:54:11.664 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:11.664 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:11.664 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:11.664 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:11.664 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:11.664 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:54:11.664 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:11.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.664 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:11.665 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:54:11.665 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:54:11.665 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:54:11.665 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:54:11.665 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:54:11.665 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:54:11.665 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:54:11.665 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:54:11.665 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:54:11.665 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:54:11.665 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:54:11.665 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:54:11.666 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:54:11.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:11.666 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:54:11.666 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:54:11.666 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:54:11.666 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:54:11.666 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:54:11.666 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:54:11.666 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:54:11.666 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:54:11.666 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:54:11.667 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:54:11.667 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:54:11.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:11.667 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:54:11.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.585+0000 7f6e73666700 1 -- 172.21.15.81:0/4273553722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e50066f30 msgr2=0x7f6e500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:11.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.585+0000 7f6e73666700 1 --2- 172.21.15.81:0/4273553722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e50066f30 0x7f6e500693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6e64007110 tx=0x7f6e64007ef0 comp rx=0 tx=0).stop 2023-10-07T08:54:11.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.585+0000 7f6e73666700 1 -- 172.21.15.81:0/4273553722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c157fe0 msgr2=0x7f6e6c152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:11.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.585+0000 7f6e73666700 1 --2- 172.21.15.81:0/4273553722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c157fe0 0x7f6e6c152e70 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f6e680097c0 tx=0x7f6e68019000 comp rx=0 tx=0).stop 2023-10-07T08:54:11.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.585+0000 7f6e73666700 1 -- 172.21.15.81:0/4273553722 shutdown_connections 2023-10-07T08:54:11.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.585+0000 7f6e73666700 1 --2- 172.21.15.81:0/4273553722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e6c157fe0 0x7f6e6c152e70 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:11.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.585+0000 7f6e73666700 1 --2- 172.21.15.81:0/4273553722 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6e50066f30 0x7f6e500693e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:11.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.585+0000 7f6e73666700 1 --2- 172.21.15.81:0/4273553722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e6c0b3bd0 0x7f6e6c0c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:11.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.585+0000 7f6e73666700 1 --2- 172.21.15.81:0/4273553722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e6c0cf240 0x7f6e6c0c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:11.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.585+0000 7f6e73666700 1 -- 172.21.15.81:0/4273553722 >> 172.21.15.81:0/4273553722 conn(0x7f6e6c067640 msgr2=0x7f6e6c0b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:11.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.585+0000 7f6e73666700 1 -- 172.21.15.81:0/4273553722 shutdown_connections 2023-10-07T08:54:11.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:11.585+0000 7f6e73666700 1 -- 172.21.15.81:0/4273553722 wait complete. 2023-10-07T08:54:11.670 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-07T08:54:16.671 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:54:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.796+0000 7f07c51c2700 1 Processor -- start 2023-10-07T08:54:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.796+0000 7f07c51c2700 1 -- start start 2023-10-07T08:54:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.797+0000 7f07c51c2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c015a110 0x7f07c00d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.797+0000 7f07c51c2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c00ce290 con 0x7f07c0159d40 2023-10-07T08:54:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.797+0000 7f07c51c2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c00cda30 con 0x7f07c00b3230 2023-10-07T08:54:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.797+0000 7f07c51c2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00cdcd0 con 0x7f07c015a110 2023-10-07T08:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.797+0000 7f07bed9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f07c0159d40 0x7f07c00b2b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33696/0 (socket says 172.21.15.81:33696) 2023-10-07T08:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.797+0000 7f07bed9d700 1 -- 172.21.15.81:0/588309412 learned_addr learned my addr 172.21.15.81:0/588309412 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.797+0000 7f07bf59e700 1 --2- 172.21.15.81:0/588309412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c015a110 0x7f07c00d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.797+0000 7f07be59c700 1 -- 172.21.15.81:0/588309412 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826622270 0 0) 0x7f07c00ce290 con 0x7f07c0159d40 2023-10-07T08:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07be59c700 1 -- 172.21.15.81:0/588309412 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07ac003570 con 0x7f07c0159d40 2023-10-07T08:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07be59c700 1 -- 172.21.15.81:0/588309412 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165918557 0 0) 0x7f07c00cda30 con 0x7f07c00b3230 2023-10-07T08:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07be59c700 1 -- 172.21.15.81:0/588309412 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c00ce290 con 0x7f07c00b3230 2023-10-07T08:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07be59c700 1 -- 172.21.15.81:0/588309412 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2035848674 0 0) 0x7f07ac003570 con 0x7f07c0159d40 2023-10-07T08:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07be59c700 1 -- 172.21.15.81:0/588309412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c015a110 msgr2=0x7f07c00d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07be59c700 1 --2- 172.21.15.81:0/588309412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c015a110 0x7f07c00d06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07be59c700 1 -- 172.21.15.81:0/588309412 >> v1:172.21.15.89:6789/0 conn(0x7f07c00b3230 legacy=0x7f07c00ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07be59c700 1 -- 172.21.15.81:0/588309412 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c00cdfb0 con 0x7f07c0159d40 2023-10-07T08:54:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07bf59e700 1 --2- 172.21.15.81:0/588309412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c015a110 0x7f07c00d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:54:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07be59c700 1 -- 172.21.15.81:0/588309412 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f07b0001470 con 0x7f07c0159d40 2023-10-07T08:54:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07be59c700 1 -- 172.21.15.81:0/588309412 >> v1:172.21.15.81:6789/0 conn(0x7f07c0159d40 legacy=0x7f07c00b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07be59c700 1 --2- 172.21.15.81:0/588309412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07ac003c20 0x7f07ac004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07be59c700 1 --2- 172.21.15.81:0/588309412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07ac004810 0x7f07ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07be59c700 1 --2- 172.21.15.81:0/588309412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c015a110 0x7f07ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07be59c700 1 -- 172.21.15.81:0/588309412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00cdcd0 con 0x7f07ac003c20 2023-10-07T08:54:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07be59c700 1 -- 172.21.15.81:0/588309412 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac00bb10 con 0x7f07ac004810 2023-10-07T08:54:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07be59c700 1 -- 172.21.15.81:0/588309412 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac00bcd0 con 0x7f07c015a110 2023-10-07T08:54:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07bed9d700 1 --2- 172.21.15.81:0/588309412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07ac003c20 0x7f07ac004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07bf59e700 1 --2- 172.21.15.81:0/588309412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c015a110 0x7f07ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07b659c700 1 --2- 172.21.15.81:0/588309412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07ac004810 0x7f07ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07bed9d700 1 -- 172.21.15.81:0/588309412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c015a110 msgr2=0x7f07ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07bed9d700 1 --2- 172.21.15.81:0/588309412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c015a110 0x7f07ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07bed9d700 1 -- 172.21.15.81:0/588309412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07ac004810 msgr2=0x7f07ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07bed9d700 1 --2- 172.21.15.81:0/588309412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07ac004810 0x7f07ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07bed9d700 1 -- 172.21.15.81:0/588309412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b8009a20 con 0x7f07ac003c20 2023-10-07T08:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07b659c700 1 --2- 172.21.15.81:0/588309412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07ac004810 0x7f07ac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.798+0000 7f07bed9d700 1 --2- 172.21.15.81:0/588309412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07ac003c20 0x7f07ac004010 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f07b000c2d0 tx=0x7f07c00cdbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503c0dacec5cd3e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.799+0000 7f07be59c700 1 -- 172.21.15.81:0/588309412 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b000cc00 con 0x7f07ac003c20 2023-10-07T08:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.799+0000 7f07be59c700 1 -- 172.21.15.81:0/588309412 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b000cda0 con 0x7f07ac003c20 2023-10-07T08:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.799+0000 7f07be59c700 1 -- 172.21.15.81:0/588309412 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0005b70 con 0x7f07ac003c20 2023-10-07T08:54:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.799+0000 7f07c51c2700 1 -- 172.21.15.81:0/588309412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07ac003c20 msgr2=0x7f07ac004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.799+0000 7f07c51c2700 1 --2- 172.21.15.81:0/588309412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07ac003c20 0x7f07ac004010 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f07b000c2d0 tx=0x7f07c00cdbc0 comp rx=0 tx=0).stop 2023-10-07T08:54:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.799+0000 7f07bf59e700 1 -- 172.21.15.81:0/588309412 reap_dead start 2023-10-07T08:54:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.799+0000 7f07c51c2700 1 -- 172.21.15.81:0/588309412 shutdown_connections 2023-10-07T08:54:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.799+0000 7f07c51c2700 1 -- 172.21.15.81:0/588309412 >> 172.21.15.81:0/588309412 conn(0x7f07c006bb90 msgr2=0x7f07c006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.799+0000 7f07c51c2700 1 -- 172.21.15.81:0/588309412 shutdown_connections 2023-10-07T08:54:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.799+0000 7f07c51c2700 1 -- 172.21.15.81:0/588309412 wait complete. 2023-10-07T08:54:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.800+0000 7f07c51c2700 1 Processor -- start 2023-10-07T08:54:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.800+0000 7f07c51c2700 1 -- start start 2023-10-07T08:54:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.801+0000 7f07c51c2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07ac003c20 0x7f07c00c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.801+0000 7f07c51c2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c00ca910 0x7f07c01508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.801+0000 7f07c51c2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c00c64b0 0x7f07c00c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.801+0000 7f07c51c2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00c6e90 con 0x7f07c00c64b0 2023-10-07T08:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.801+0000 7f07c51c2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00b4540 con 0x7f07ac003c20 2023-10-07T08:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.801+0000 7f07c51c2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00b53a0 con 0x7f07c00ca910 2023-10-07T08:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.801+0000 7f07bf59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c00c64b0 0x7f07c00c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.801+0000 7f07bf59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c00c64b0 0x7f07c00c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55978/0 (socket says 172.21.15.81:55978) 2023-10-07T08:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.801+0000 7f07bf59e700 1 -- 172.21.15.81:0/534387553 learned_addr learned my addr 172.21.15.81:0/534387553 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.801+0000 7f07bed9d700 1 --2- 172.21.15.81:0/534387553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07ac003c20 0x7f07c00c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.801+0000 7f07b659c700 1 --2- 172.21.15.81:0/534387553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c00ca910 0x7f07c01508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.802+0000 7f07bf59e700 1 -- 172.21.15.81:0/534387553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c00ca910 msgr2=0x7f07c01508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.802+0000 7f07bf59e700 1 --2- 172.21.15.81:0/534387553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c00ca910 0x7f07c01508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.802+0000 7f07bf59e700 1 -- 172.21.15.81:0/534387553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07ac003c20 msgr2=0x7f07c00c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.802+0000 7f07bf59e700 1 --2- 172.21.15.81:0/534387553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07ac003c20 0x7f07c00c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.802+0000 7f07bf59e700 1 -- 172.21.15.81:0/534387553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c00b4790 con 0x7f07c00c64b0 2023-10-07T08:54:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.802+0000 7f07b659c700 1 --2- 172.21.15.81:0/534387553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c00ca910 0x7f07c01508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.802+0000 7f07bed9d700 1 --2- 172.21.15.81:0/534387553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07ac003c20 0x7f07c00c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.802+0000 7f07bf59e700 1 --2- 172.21.15.81:0/534387553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c00c64b0 0x7f07c00c6950 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f07b80094d0 tx=0x7f07b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.802+0000 7f07b77fe700 1 -- 172.21.15.81:0/534387553 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b800e040 con 0x7f07c00c64b0 2023-10-07T08:54:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.802+0000 7f07b77fe700 1 -- 172.21.15.81:0/534387553 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b800f040 con 0x7f07c00c64b0 2023-10-07T08:54:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.802+0000 7f07c51c2700 1 -- 172.21.15.81:0/534387553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c00b4a70 con 0x7f07c00c64b0 2023-10-07T08:54:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.802+0000 7f07b77fe700 1 -- 172.21.15.81:0/534387553 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8015430 con 0x7f07c00c64b0 2023-10-07T08:54:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.802+0000 7f07c51c2700 1 -- 172.21.15.81:0/534387553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c00b5030 con 0x7f07c00c64b0 2023-10-07T08:54:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.803+0000 7f07c51c2700 1 -- 172.21.15.81:0/534387553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c00b5530 con 0x7f07c00c64b0 2023-10-07T08:54:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.803+0000 7f07b77fe700 1 -- 172.21.15.81:0/534387553 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07b80157e0 con 0x7f07c00c64b0 2023-10-07T08:54:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.804+0000 7f07b77fe700 1 --2- 172.21.15.81:0/534387553 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f07a0066f30 0x7f07a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.804+0000 7f07b77fe700 1 -- 172.21.15.81:0/534387553 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f07b8085000 con 0x7f07c00c64b0 2023-10-07T08:54:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.804+0000 7f07bed9d700 1 --2- 172.21.15.81:0/534387553 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f07a0066f30 0x7f07a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.804+0000 7f07bed9d700 1 --2- 172.21.15.81:0/534387553 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f07a0066f30 0x7f07a00693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f07b000c2d0 tx=0x7f07b0015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.808+0000 7f07b77fe700 1 -- 172.21.15.81:0/534387553 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07b8055d00 con 0x7f07c00c64b0 2023-10-07T08:54:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.988+0000 7f07c51c2700 1 -- 172.21.15.81:0/534387553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f07c00cb900 con 0x7f07c00c64b0 2023-10-07T08:54:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.989+0000 7f07b77fe700 1 -- 172.21.15.81:0/534387553 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v193) v1 ==== 81+0+32234 (secure 0 0 0) 0x7f07b8055890 con 0x7f07c00c64b0 2023-10-07T08:54:16.991 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:16.991 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:54:16.991 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 193, 2023-10-07T08:54:16.991 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:54:16.991 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:54:16.991 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:54:13.341950+0000", 2023-10-07T08:54:16.992 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:54:16.992 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:54:16.992 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:54:16.992 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:54:16.992 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:54:16.992 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:54:16.992 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:54:16.992 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:54:16.992 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:54:16.992 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:16.992 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:54:16.993 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:54:16.993 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:54:16.993 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:54:16.993 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:54:16.993 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 23, 2023-10-07T08:54:16.993 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:54:16.993 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:54:16.993 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:54:16.993 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:54:16.993 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:54:16.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:16.993 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:54:16.993 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:54:16.994 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:54:16.994 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:54:16.994 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:54:16.994 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:16.994 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:16.994 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:16.994 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:16.994 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:16.994 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:16.994 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:16.994 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:16.994 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:16.995 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:16.995 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:54:16.995 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:54:16.995 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:54:16.995 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:54:16.995 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:54:16.995 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:16.995 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:16.995 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:16.995 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:16.995 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:16.995 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:16.996 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:16.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:16.996 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:54:16.996 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:16.996 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:16.996 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:16.996 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:16.996 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:16.996 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:16.996 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:16.996 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:16.996 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:16.997 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:54:16.997 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:16.997 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:16.997 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:16.997 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:16.997 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:16.997 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:16.997 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:16.997 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:16.997 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:16.997 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:16.997 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:16.997 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:16.998 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:16.998 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:16.998 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:16.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:16.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:16.998 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:16.998 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:16.998 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:16.998 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:16.998 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:16.998 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:16.998 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:16.999 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:16.999 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:16.999 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:16.999 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:16.999 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:16.999 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:54:16.999 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:54:16.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:16.999 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:16.999 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:54:16.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:16.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:16.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.000 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 22, 2023-10-07T08:54:17.000 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:54:17.000 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:53:46.818809+0000", 2023-10-07T08:54:17.000 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:54:17.000 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:54:17.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:17.000 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:17.000 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:17.000 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:17.000 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:17.000 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:17.000 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:17.001 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:17.001 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:17.001 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:17.001 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:54:17.001 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:54:17.001 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:54:17.001 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:54:17.001 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:54:17.001 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:17.001 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:17.001 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:17.001 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:17.002 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:17.002 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:17.002 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:17.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.002 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "189", 2023-10-07T08:54:17.002 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:17.002 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:17.002 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:17.002 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:17.002 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:17.002 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:17.003 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:17.003 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:17.003 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:17.003 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:54:17.003 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:17.003 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:17.003 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:17.003 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:17.003 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:17.003 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:17.003 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:17.003 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:17.003 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:17.004 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:17.004 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:17.004 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:17.004 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:17.004 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:17.004 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:17.004 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:17.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.004 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:17.004 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:17.004 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:17.004 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:17.005 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:17.005 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:17.005 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:17.005 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:17.005 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:17.005 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:17.005 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:17.005 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:17.005 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:54:17.005 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:54:17.005 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:54:17.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.006 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:17.006 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:54:17.006 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:54:17.006 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.006 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.006 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 23, 2023-10-07T08:54:17.006 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:54:17.006 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:53:47.460436+0000", 2023-10-07T08:54:17.006 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:54:17.006 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:54:17.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:17.007 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:17.007 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:17.007 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:17.007 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:17.007 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:17.007 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:17.007 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:17.007 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:17.007 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:17.007 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:54:17.007 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:54:17.008 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:54:17.008 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:54:17.008 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:54:17.008 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:17.008 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:17.008 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:17.008 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:17.008 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:17.008 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:17.008 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:17.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.008 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "193", 2023-10-07T08:54:17.009 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:17.009 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:17.009 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:17.009 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:17.009 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:17.009 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:17.009 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:17.009 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:17.009 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:17.009 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-07T08:54:17.009 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:17.009 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:17.010 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:17.010 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:17.010 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:17.010 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:17.010 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:17.010 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:17.010 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:17.010 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:17.010 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:17.010 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:17.010 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:17.011 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:17.011 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:17.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:17.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.011 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:17.011 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:17.011 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:17.011 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:17.011 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:17.011 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:17.011 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:17.011 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:17.012 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:17.012 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:17.012 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:17.012 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:17.012 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:54:17.012 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:54:17.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.012 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:17.012 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:54:17.012 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:54:17.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.013 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.013 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:17.013 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:54:17.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.013 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:54:17.013 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:17.013 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:17.013 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:17.013 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:17.013 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:17.013 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:17.013 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:17.014 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:17.014 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:17.014 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:17.014 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:17.014 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:17.014 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.014 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:54:17.014 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:17.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.015 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:54:17.015 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:17.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.015 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.015 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:17.015 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.015 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:54:17.015 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:17.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:54:17.016 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:17.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.016 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.016 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:17.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:54:17.017 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:17.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.017 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:54:17.017 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:17.017 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.017 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.018 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:17.018 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.018 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:54:17.018 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:17.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.018 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:54:17.018 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:17.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.019 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.019 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:54:17.019 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:54:17.019 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:54:17.019 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:54:17.019 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:17.019 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:17.019 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:17.019 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.020 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:54:17.020 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:17.020 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:17.020 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:17.020 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:17.020 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:17.020 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:17.020 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:17.020 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:17.020 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:17.020 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:17.020 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:17.021 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:17.021 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.021 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:54:17.021 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:17.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.021 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:54:17.021 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:17.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.022 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.022 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:17.022 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.022 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:54:17.022 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:17.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.022 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:54:17.023 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:17.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.023 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.023 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:17.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:54:17.023 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:17.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:54:17.024 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:17.024 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.024 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.024 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:17.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:54:17.024 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:17.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:54:17.025 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:17.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.025 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.025 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:54:17.025 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:54:17.025 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:54:17.025 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:54:17.026 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:17.026 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:17.026 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:17.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.026 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:54:17.026 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:17.026 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:17.026 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:17.026 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:17.026 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:17.026 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:17.027 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:17.027 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:17.027 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:17.027 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:17.027 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:17.027 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:17.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:54:17.027 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:17.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:54:17.028 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:17.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.028 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.028 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:17.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:54:17.028 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:17.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:54:17.029 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:17.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.029 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.029 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:17.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:54:17.030 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:17.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.030 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:54:17.030 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:17.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.030 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.030 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:17.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.031 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:54:17.031 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:17.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.031 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:54:17.031 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:17.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.031 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.032 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:54:17.032 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:54:17.032 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:54:17.032 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:54:17.032 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:17.032 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:17.032 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:17.032 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.032 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:54:17.032 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:17.033 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:17.033 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:17.033 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:17.033 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:17.033 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:17.033 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:17.033 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:17.033 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:17.033 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:17.033 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:17.033 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:17.033 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.034 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:54:17.034 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:17.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.034 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:54:17.034 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:17.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.034 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.034 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:17.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:54:17.035 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:17.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:54:17.035 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:17.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.035 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.036 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:17.036 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.036 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:54:17.036 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:17.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.036 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:54:17.036 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:17.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.037 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.037 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:17.037 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.037 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:54:17.037 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:17.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.037 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:54:17.038 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:17.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.038 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.038 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:54:17.038 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:54:17.038 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:54:17.038 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:54:17.038 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:17.038 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:17.038 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:17.038 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.039 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:54:17.039 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:17.039 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:17.039 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:17.039 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:17.039 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:17.039 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:17.039 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:17.039 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:17.039 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:17.040 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:17.040 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:17.040 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:17.040 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.040 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:54:17.040 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:17.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.040 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:54:17.040 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:17.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.041 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.041 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:17.041 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.041 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:54:17.041 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:17.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.042 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:54:17.042 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:17.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.042 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.042 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:17.042 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.042 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:54:17.042 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:17.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.043 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:54:17.043 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:17.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.043 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.043 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:17.043 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.043 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:54:17.043 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:17.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.044 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:54:17.044 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:17.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.044 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.044 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:54:17.044 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:54:17.044 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:54:17.044 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:54:17.045 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:17.045 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:17.045 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:17.045 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.045 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:54:17.045 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:17.045 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:17.045 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:17.045 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:17.045 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:17.046 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:17.046 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:17.046 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:17.046 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:17.046 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:17.046 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:17.046 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:17.046 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.046 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.046 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:54:17.046 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:17.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.047 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.047 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:54:17.047 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:17.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.047 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.047 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:17.047 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.047 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.047 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:54:17.048 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:17.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.048 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:54:17.048 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:17.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.048 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:17.048 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.049 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:54:17.049 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:17.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.049 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:54:17.049 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:17.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.049 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.049 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:17.049 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.050 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:54:17.050 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:17.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.050 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:54:17.050 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:17.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.050 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.051 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:54:17.051 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:54:17.051 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:54:17.051 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:54:17.051 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:17.051 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:17.051 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:17.051 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.051 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:54:17.051 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:17.052 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:17.052 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:17.052 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:17.052 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:17.052 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:17.052 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:17.052 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:17.052 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:17.052 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:17.052 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:17.052 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:17.052 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.053 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:54:17.053 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:17.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.053 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:54:17.053 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:17.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.053 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.054 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:17.054 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.054 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.054 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:54:17.054 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:17.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.054 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.054 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:54:17.054 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:17.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.055 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.055 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:17.055 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.055 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.055 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:54:17.055 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:17.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.055 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.055 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:54:17.055 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:17.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.056 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.056 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:17.056 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.056 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.056 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:54:17.056 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:17.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.056 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.057 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:54:17.057 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:17.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.057 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.057 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:54:17.057 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:54:17.057 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:54:17.057 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:54:17.057 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:17.057 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:17.057 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:17.058 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.058 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:54:17.058 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:17.058 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:17.058 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:17.058 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:17.058 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:17.058 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:17.058 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:17.058 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:17.058 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:17.059 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:17.059 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:17.059 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:17.059 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.059 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.059 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:54:17.059 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:17.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.059 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.059 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:54:17.060 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:17.060 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.060 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.060 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:17.060 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.060 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:54:17.060 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:17.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.061 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.061 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:54:17.061 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:17.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.061 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.061 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:17.061 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.061 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.061 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:54:17.061 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:17.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.062 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:54:17.062 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:17.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.062 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.062 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:17.062 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.062 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:54:17.063 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:17.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.063 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.063 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:54:17.063 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:17.063 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.063 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.063 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:54:17.063 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:54:17.063 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:54:17.064 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:54:17.064 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:17.064 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:17.064 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:17.064 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.064 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:17.064 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:54:17.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.064 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:54:17.064 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:17.064 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:17.065 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:17.065 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:17.065 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:17.065 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:54:17.065 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:17.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.065 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:54:17.065 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:17.065 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:17.065 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:17.065 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:17.065 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:17.066 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:54:17.066 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:17.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.066 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:54:17.066 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:17.066 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:17.066 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:17.066 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:17.066 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:17.066 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:54:17.066 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:17.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.067 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:54:17.067 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:17.067 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:17.067 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:17.067 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:17.067 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:17.067 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:54:17.067 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:17.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.068 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:54:17.068 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:17.068 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:17.068 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:17.068 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:17.068 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:17.068 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:54:17.068 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:17.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.068 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:54:17.068 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:17.069 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:17.069 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:17.069 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:17.069 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:17.069 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:54:17.069 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:17.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.069 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:54:17.069 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:17.069 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:17.069 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:17.070 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:17.070 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:17.070 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:54:17.070 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:17.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.070 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:54:17.070 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:17.070 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:17.070 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:17.070 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:17.070 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:17.071 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:54:17.071 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:17.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.071 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:17.071 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:54:17.071 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:54:17.071 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:54:17.071 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:54:17.071 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:54:17.071 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:54:17.071 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:54:17.071 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:54:17.072 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:54:17.072 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:54:17.072 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:54:17.072 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:54:17.072 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:54:17.072 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.072 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:54:17.072 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:54:17.072 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:54:17.072 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:54:17.072 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:54:17.072 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:54:17.073 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:54:17.073 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:54:17.073 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:54:17.073 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:54:17.073 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:54:17.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.073 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:54:17.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.991+0000 7f07c51c2700 1 -- 172.21.15.81:0/534387553 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f07a0066f30 msgr2=0x7f07a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:17.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.991+0000 7f07c51c2700 1 --2- 172.21.15.81:0/534387553 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f07a0066f30 0x7f07a00693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f07b000c2d0 tx=0x7f07b0015000 comp rx=0 tx=0).stop 2023-10-07T08:54:17.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.991+0000 7f07c51c2700 1 -- 172.21.15.81:0/534387553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c00c64b0 msgr2=0x7f07c00c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:17.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.991+0000 7f07c51c2700 1 --2- 172.21.15.81:0/534387553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c00c64b0 0x7f07c00c6950 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f07b80094d0 tx=0x7f07b800b040 comp rx=0 tx=0).stop 2023-10-07T08:54:17.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.991+0000 7f07c51c2700 1 -- 172.21.15.81:0/534387553 shutdown_connections 2023-10-07T08:54:17.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.991+0000 7f07c51c2700 1 --2- 172.21.15.81:0/534387553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c00c64b0 0x7f07c00c6950 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.991+0000 7f07c51c2700 1 --2- 172.21.15.81:0/534387553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07ac003c20 0x7f07c00c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.991+0000 7f07c51c2700 1 --2- 172.21.15.81:0/534387553 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f07a0066f30 0x7f07a00693e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.991+0000 7f07c51c2700 1 --2- 172.21.15.81:0/534387553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c00ca910 0x7f07c01508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.991+0000 7f07c51c2700 1 -- 172.21.15.81:0/534387553 >> 172.21.15.81:0/534387553 conn(0x7f07c006bb90 msgr2=0x7f07c00c7420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:17.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.992+0000 7f07c51c2700 1 -- 172.21.15.81:0/534387553 shutdown_connections 2023-10-07T08:54:17.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:16.992+0000 7f07c51c2700 1 -- 172.21.15.81:0/534387553 wait complete. 2023-10-07T08:54:17.076 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-07T08:54:17.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-07T08:54:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.189+0000 7f10c755d700 1 Processor -- start 2023-10-07T08:54:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.189+0000 7f10c755d700 1 -- start start 2023-10-07T08:54:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.190+0000 7f10c755d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f10c006d830 0x7f10c00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.190+0000 7f10c755d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c00d07c0 con 0x7f10c01578d0 2023-10-07T08:54:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.190+0000 7f10c755d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c00cfbb0 con 0x7f10c0157ca0 2023-10-07T08:54:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.190+0000 7f10c755d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c00cfe90 con 0x7f10c006d830 2023-10-07T08:54:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.190+0000 7f10c52f9700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f10c01578d0 0x7f10c015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33698/0 (socket says 172.21.15.81:33698) 2023-10-07T08:54:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.190+0000 7f10c52f9700 1 -- 172.21.15.81:0/3738464896 learned_addr learned my addr 172.21.15.81:0/3738464896 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.190+0000 7f10b7fff700 1 -- 172.21.15.81:0/3738464896 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373292925 0 0) 0x7f10c00d07c0 con 0x7f10c01578d0 2023-10-07T08:54:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.190+0000 7f10c5afa700 1 --2- 172.21.15.81:0/3738464896 >> v2:172.21.15.89:3300/0 conn(0x7f10c006d830 0x7f10c00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10b7fff700 1 -- 172.21.15.81:0/3738464896 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10ac003570 con 0x7f10c01578d0 2023-10-07T08:54:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10b7fff700 1 -- 172.21.15.81:0/3738464896 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 207318496 0 0) 0x7f10ac003570 con 0x7f10c01578d0 2023-10-07T08:54:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10b7fff700 1 -- 172.21.15.81:0/3738464896 >> v2:172.21.15.89:3300/0 conn(0x7f10c006d830 msgr2=0x7f10c00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10b7fff700 1 --2- 172.21.15.81:0/3738464896 >> v2:172.21.15.89:3300/0 conn(0x7f10c006d830 0x7f10c00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10b7fff700 1 -- 172.21.15.81:0/3738464896 >> v1:172.21.15.89:6789/0 conn(0x7f10c0157ca0 legacy=0x7f10c006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10b7fff700 1 -- 172.21.15.81:0/3738464896 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c00d0170 con 0x7f10c01578d0 2023-10-07T08:54:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10b7fff700 1 -- 172.21.15.81:0/3738464896 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f10bc0017f0 con 0x7f10c01578d0 2023-10-07T08:54:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10b7fff700 1 -- 172.21.15.81:0/3738464896 >> v1:172.21.15.81:6789/0 conn(0x7f10c01578d0 legacy=0x7f10c015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10b7fff700 1 --2- 172.21.15.81:0/3738464896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ac003a60 0x7f10ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10b7fff700 1 --2- 172.21.15.81:0/3738464896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10ac004810 0x7f10ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10b7fff700 1 --2- 172.21.15.81:0/3738464896 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10ac0051c0 0x7f10ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10b7fff700 1 -- 172.21.15.81:0/3738464896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c00cfe90 con 0x7f10ac004810 2023-10-07T08:54:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10b7fff700 1 -- 172.21.15.81:0/3738464896 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac00c0d0 con 0x7f10ac003a60 2023-10-07T08:54:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10b7fff700 1 -- 172.21.15.81:0/3738464896 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac00c290 con 0x7f10ac0051c0 2023-10-07T08:54:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10c4af8700 1 --2- 172.21.15.81:0/3738464896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10ac004810 0x7f10ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:17.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10c52f9700 1 --2- 172.21.15.81:0/3738464896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ac003a60 0x7f10ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:17.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10c5afa700 1 --2- 172.21.15.81:0/3738464896 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10ac0051c0 0x7f10ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:17.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10c4af8700 1 -- 172.21.15.81:0/3738464896 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10ac0051c0 msgr2=0x7f10ac00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:17.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10c4af8700 1 --2- 172.21.15.81:0/3738464896 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10ac0051c0 0x7f10ac00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10c4af8700 1 -- 172.21.15.81:0/3738464896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ac003a60 msgr2=0x7f10ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:17.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10c4af8700 1 --2- 172.21.15.81:0/3738464896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ac003a60 0x7f10ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10c5afa700 1 -- 172.21.15.81:0/3738464896 reap_dead start 2023-10-07T08:54:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10c4af8700 1 -- 172.21.15.81:0/3738464896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac003570 con 0x7f10ac004810 2023-10-07T08:54:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10c4af8700 1 --2- 172.21.15.81:0/3738464896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10ac004810 0x7f10ac004c80 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f10b0001880 tx=0x7f10b0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486a78636a64507 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.191+0000 7f10b7fff700 1 -- 172.21.15.81:0/3738464896 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b0012420 con 0x7f10ac004810 2023-10-07T08:54:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.192+0000 7f10b7fff700 1 -- 172.21.15.81:0/3738464896 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b0012580 con 0x7f10ac004810 2023-10-07T08:54:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.192+0000 7f10b7fff700 1 -- 172.21.15.81:0/3738464896 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b0012920 con 0x7f10ac004810 2023-10-07T08:54:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.192+0000 7f10c755d700 1 -- 172.21.15.81:0/3738464896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10ac004810 msgr2=0x7f10ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.192+0000 7f10c755d700 1 --2- 172.21.15.81:0/3738464896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10ac004810 0x7f10ac004c80 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f10b0001880 tx=0x7f10b0007d30 comp rx=0 tx=0).stop 2023-10-07T08:54:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.192+0000 7f10c755d700 1 -- 172.21.15.81:0/3738464896 shutdown_connections 2023-10-07T08:54:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.192+0000 7f10c755d700 1 --2- 172.21.15.81:0/3738464896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10ac004810 0x7f10ac004c80 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.192+0000 7f10c755d700 1 -- 172.21.15.81:0/3738464896 >> 172.21.15.81:0/3738464896 conn(0x7f10c006bb90 msgr2=0x7f10c006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.192+0000 7f10c755d700 1 -- 172.21.15.81:0/3738464896 shutdown_connections 2023-10-07T08:54:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.192+0000 7f10c755d700 1 -- 172.21.15.81:0/3738464896 wait complete. 2023-10-07T08:54:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.193+0000 7f10c755d700 1 Processor -- start 2023-10-07T08:54:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.193+0000 7f10c755d700 1 -- start start 2023-10-07T08:54:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.194+0000 7f10c755d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ac004810 0x7f10c0153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.194+0000 7f10c755d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10c00b4b70 0x7f10c00c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.194+0000 7f10c755d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c00b6110 0x7f10c00b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.194+0000 7f10c755d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c00b5c80 con 0x7f10c00b6110 2023-10-07T08:54:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.194+0000 7f10c755d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c00b5070 con 0x7f10ac004810 2023-10-07T08:54:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.194+0000 7f10c755d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c00b5350 con 0x7f10c00b4b70 2023-10-07T08:54:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.194+0000 7f10c5afa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c00b6110 0x7f10c00b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.194+0000 7f10c5afa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c00b6110 0x7f10c00b6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55994/0 (socket says 172.21.15.81:55994) 2023-10-07T08:54:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.194+0000 7f10c5afa700 1 -- 172.21.15.81:0/2029893551 learned_addr learned my addr 172.21.15.81:0/2029893551 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.194+0000 7f10c52f9700 1 --2- 172.21.15.81:0/2029893551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ac004810 0x7f10c0153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.194+0000 7f10c5afa700 1 -- 172.21.15.81:0/2029893551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10c00b4b70 msgr2=0x7f10c00c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.194+0000 7f10c5afa700 1 --2- 172.21.15.81:0/2029893551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10c00b4b70 0x7f10c00c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.194+0000 7f10c5afa700 1 -- 172.21.15.81:0/2029893551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ac004810 msgr2=0x7f10c0153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.194+0000 7f10c5afa700 1 --2- 172.21.15.81:0/2029893551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ac004810 0x7f10c0153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.194+0000 7f10c5afa700 1 -- 172.21.15.81:0/2029893551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c00b5630 con 0x7f10c00b6110 2023-10-07T08:54:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.194+0000 7f10c52f9700 1 --2- 172.21.15.81:0/2029893551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ac004810 0x7f10c0153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.195+0000 7f10c5afa700 1 --2- 172.21.15.81:0/2029893551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c00b6110 0x7f10c00b6560 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f10c015b610 tx=0x7f10b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.195+0000 7f10b57fa700 1 -- 172.21.15.81:0/2029893551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800f910 con 0x7f10c00b6110 2023-10-07T08:54:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.195+0000 7f10b57fa700 1 -- 172.21.15.81:0/2029893551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b800fa70 con 0x7f10c00b6110 2023-10-07T08:54:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.195+0000 7f10c755d700 1 -- 172.21.15.81:0/2029893551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c00b5910 con 0x7f10c00b6110 2023-10-07T08:54:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.195+0000 7f10b57fa700 1 -- 172.21.15.81:0/2029893551 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800fe10 con 0x7f10c00b6110 2023-10-07T08:54:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.195+0000 7f10c755d700 1 -- 172.21.15.81:0/2029893551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c00c7430 con 0x7f10c00b6110 2023-10-07T08:54:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.196+0000 7f10c755d700 1 -- 172.21.15.81:0/2029893551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c0067ac0 con 0x7f10c00b6110 2023-10-07T08:54:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.196+0000 7f10b57fa700 1 -- 172.21.15.81:0/2029893551 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10b8014650 con 0x7f10c00b6110 2023-10-07T08:54:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.196+0000 7f10b57fa700 1 --2- 172.21.15.81:0/2029893551 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f10a4066f30 0x7f10a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.197+0000 7f10b57fa700 1 -- 172.21.15.81:0/2029893551 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f10b8084c60 con 0x7f10c00b6110 2023-10-07T08:54:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.197+0000 7f10c52f9700 1 --2- 172.21.15.81:0/2029893551 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f10a4066f30 0x7f10a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.197+0000 7f10c52f9700 1 --2- 172.21.15.81:0/2029893551 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f10a4066f30 0x7f10a40693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f10bc001560 tx=0x7f10bc006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.200+0000 7f10b57fa700 1 -- 172.21.15.81:0/2029893551 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10b8051f50 con 0x7f10c00b6110 2023-10-07T08:54:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.384+0000 7f10c755d700 1 -- 172.21.15.81:0/2029893551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f10c00d0450 con 0x7f10c00b6110 2023-10-07T08:54:17.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.385+0000 7f10b57fa700 1 -- 172.21.15.81:0/2029893551 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v193) v1 ==== 81+0+32234 (secure 0 0 0) 0x7f10b8055570 con 0x7f10c00b6110 2023-10-07T08:54:17.386 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:17.386 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:54:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 193, 2023-10-07T08:54:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", 2023-10-07T08:54:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2023-10-07T08:42:38.479823+0000", 2023-10-07T08:54:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2023-10-07T08:54:13.341950+0000", 2023-10-07T08:54:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2023-10-07T08:42:44.280594+0000", 2023-10-07T08:54:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2023-10-07T08:42:41.275089+0000", 2023-10-07T08:54:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-07T08:54:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2023-10-07T08:54:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2023-10-07T08:54:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2023-10-07T08:54:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2023-10-07T08:54:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2023-10-07T08:54:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2023-10-07T08:54:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2023-10-07T08:54:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.69999998807907104, 2023-10-07T08:54:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-07T08:54:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-07T08:54:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2023-10-07T08:54:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 23, 2023-10-07T08:54:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2023-10-07T08:54:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2023-10-07T08:54:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2023-10-07T08:54:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "quincy", 2023-10-07T08:54:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2023-10-07T08:54:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2023-10-07T08:54:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2023-10-07T08:54:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:42:46.033308+0000", 2023-10-07T08:54:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:54:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:54:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2023-10-07T08:54:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2023-10-07T08:54:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2023-10-07T08:54:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2023-10-07T08:54:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2023-10-07T08:54:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "111", 2023-10-07T08:54:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:54:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2023-10-07T08:54:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2023-10-07T08:54:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2023-10-07T08:54:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 22, 2023-10-07T08:54:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_metadata", 2023-10-07T08:54:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:53:46.818809+0000", 2023-10-07T08:54:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:54:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:54:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2023-10-07T08:54:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2023-10-07T08:54:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2023-10-07T08:54:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2023-10-07T08:54:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2023-10-07T08:54:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "189", 2023-10-07T08:54:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2023-10-07T08:54:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_bias": 4, 2023-10-07T08:54:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 16, 2023-10-07T08:54:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_priority": 5 2023-10-07T08:54:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:54:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": "cephfs" 2023-10-07T08:54:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 23, 2023-10-07T08:54:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "cephfs_data", 2023-10-07T08:54:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2023-10-07T08:53:47.460436+0000", 2023-10-07T08:54:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2023-10-07T08:54:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2023-10-07T08:54:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2023-10-07T08:54:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2023-10-07T08:54:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2023-10-07T08:54:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2023-10-07T08:54:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2023-10-07T08:54:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2023-10-07T08:54:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2023-10-07T08:54:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-07T08:54:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2023-10-07T08:54:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2023-10-07T08:54:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 64, 2023-10-07T08:54:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 64, 2023-10-07T08:54:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 64, 2023-10-07T08:54:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 64, 2023-10-07T08:54:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 64, 2023-10-07T08:54:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2023-10-07T08:54:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2023-10-07T08:54:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2023-10-07T08:54:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2023-10-07T08:54:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2023-10-07T08:54:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2023-10-07T08:54:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2023-10-07T08:54:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "193", 2023-10-07T08:54:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2023-10-07T08:54:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-07T08:54:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2023-10-07T08:54:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2023-10-07T08:54:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2023-10-07T08:54:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2023-10-07T08:54:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2023-10-07T08:54:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2023-10-07T08:54:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2023-10-07T08:54:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 33554432, 2023-10-07T08:54:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2023-10-07T08:54:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2023-10-07T08:54:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2023-10-07T08:54:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2023-10-07T08:54:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2023-10-07T08:54:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2023-10-07T08:54:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2023-10-07T08:54:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2023-10-07T08:54:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-07T08:54:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-07T08:54:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-07T08:54:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2023-10-07T08:54:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2023-10-07T08:54:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2023-10-07T08:54:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2023-10-07T08:54:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2023-10-07T08:54:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2023-10-07T08:54:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2023-10-07T08:54:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2023-10-07T08:54:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2023-10-07T08:54:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2023-10-07T08:54:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2023-10-07T08:54:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2023-10-07T08:54:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2023-10-07T08:54:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2023-10-07T08:54:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2023-10-07T08:54:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2023-10-07T08:54:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2023-10-07T08:54:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 64, 2023-10-07T08:54:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "target_size_ratio": 0.89999997615814209 2023-10-07T08:54:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2023-10-07T08:54:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs": { 2023-10-07T08:54:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: "data": "cephfs" 2023-10-07T08:54:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2023-10-07T08:54:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:54:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2023-10-07T08:54:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2023-10-07T08:54:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2023-10-07T08:54:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2023-10-07T08:54:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2023-10-07T08:54:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2023-10-07T08:54:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2023-10-07T08:54:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2023-10-07T08:54:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86338 2023-10-07T08:54:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/86338", 2023-10-07T08:54:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/86338", 2023-10-07T08:54:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/86338", 2023-10-07T08:54:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/86338", 2023-10-07T08:54:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:54:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2023-10-07T08:54:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2023-10-07T08:54:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2023-10-07T08:54:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2023-10-07T08:54:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2023-10-07T08:54:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2023-10-07T08:54:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2023-10-07T08:54:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2023-10-07T08:54:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86348 2023-10-07T08:54:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/86348", 2023-10-07T08:54:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6823/86348", 2023-10-07T08:54:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/86348", 2023-10-07T08:54:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6827/86348", 2023-10-07T08:54:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:54:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2023-10-07T08:54:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2023-10-07T08:54:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2023-10-07T08:54:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2023-10-07T08:54:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2023-10-07T08:54:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2023-10-07T08:54:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2023-10-07T08:54:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2023-10-07T08:54:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86353 2023-10-07T08:54:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/86353", 2023-10-07T08:54:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6822/86353", 2023-10-07T08:54:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6830/86353", 2023-10-07T08:54:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6826/86353", 2023-10-07T08:54:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:54:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2023-10-07T08:54:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2023-10-07T08:54:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2023-10-07T08:54:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2023-10-07T08:54:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2023-10-07T08:54:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2023-10-07T08:54:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2023-10-07T08:54:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2023-10-07T08:54:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86339 2023-10-07T08:54:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/86339", 2023-10-07T08:54:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/86339", 2023-10-07T08:54:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/86339", 2023-10-07T08:54:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/86339", 2023-10-07T08:54:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:54:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6800", 2023-10-07T08:54:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6801", 2023-10-07T08:54:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6802", 2023-10-07T08:54:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6803", 2023-10-07T08:54:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6806", 2023-10-07T08:54:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6807", 2023-10-07T08:54:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6804", 2023-10-07T08:54:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6805", 2023-10-07T08:54:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86542 2023-10-07T08:54:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6801/86542", 2023-10-07T08:54:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6803/86542", 2023-10-07T08:54:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6807/86542", 2023-10-07T08:54:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6805/86542", 2023-10-07T08:54:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:54:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6816", 2023-10-07T08:54:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6817", 2023-10-07T08:54:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6818", 2023-10-07T08:54:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6819", 2023-10-07T08:54:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6823", 2023-10-07T08:54:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6825", 2023-10-07T08:54:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.450 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6820", 2023-10-07T08:54:17.450 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:17.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.450 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6821", 2023-10-07T08:54:17.450 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86566 2023-10-07T08:54:17.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.450 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.451 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6817/86566", 2023-10-07T08:54:17.451 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6819/86566", 2023-10-07T08:54:17.451 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6825/86566", 2023-10-07T08:54:17.451 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6821/86566", 2023-10-07T08:54:17.451 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:17.451 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:17.451 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:17.451 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.451 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:54:17.452 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:17.452 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:17.452 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:17.452 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:17.452 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:17.452 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:17.452 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:17.452 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:17.452 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:17.452 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:17.452 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:17.452 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:17.453 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.453 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.453 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6822", 2023-10-07T08:54:17.453 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:17.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.453 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.453 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6824", 2023-10-07T08:54:17.453 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:17.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.454 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.454 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:17.454 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.454 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.454 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6826", 2023-10-07T08:54:17.454 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:17.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.454 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.454 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6827", 2023-10-07T08:54:17.455 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:17.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.455 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.455 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:17.455 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.455 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.455 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6830", 2023-10-07T08:54:17.455 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:17.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.456 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6831", 2023-10-07T08:54:17.456 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:17.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.456 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.456 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:17.456 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.456 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6828", 2023-10-07T08:54:17.456 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:17.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.457 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.457 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6829", 2023-10-07T08:54:17.457 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86582 2023-10-07T08:54:17.457 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.457 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.457 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6824/86582", 2023-10-07T08:54:17.457 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6827/86582", 2023-10-07T08:54:17.457 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6831/86582", 2023-10-07T08:54:17.458 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6829/86582", 2023-10-07T08:54:17.458 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:17.458 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:17.458 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:17.458 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.458 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:54:17.458 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-07T08:54:17.458 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2023-10-07T08:54:17.458 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2023-10-07T08:54:17.458 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2023-10-07T08:54:17.459 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2023-10-07T08:54:17.459 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2023-10-07T08:54:17.459 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2023-10-07T08:54:17.459 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2023-10-07T08:54:17.459 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 188, 2023-10-07T08:54:17.459 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2023-10-07T08:54:17.459 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2023-10-07T08:54:17.459 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2023-10-07T08:54:17.459 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.459 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.459 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6808", 2023-10-07T08:54:17.460 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:17.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.460 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6809", 2023-10-07T08:54:17.460 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:17.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.460 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.460 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2023-10-07T08:54:17.460 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.461 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6810", 2023-10-07T08:54:17.461 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:17.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.461 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6811", 2023-10-07T08:54:17.461 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:17.461 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.461 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.461 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2023-10-07T08:54:17.461 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.462 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6814", 2023-10-07T08:54:17.462 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:17.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.462 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6815", 2023-10-07T08:54:17.462 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:17.462 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.462 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.463 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2023-10-07T08:54:17.463 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2023-10-07T08:54:17.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.463 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2023-10-07T08:54:17.463 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6812", 2023-10-07T08:54:17.463 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:17.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.463 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-10-07T08:54:17.463 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.89:6813", 2023-10-07T08:54:17.463 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 86544 2023-10-07T08:54:17.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.464 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.464 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.89:6809/86544", 2023-10-07T08:54:17.464 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.89:6811/86544", 2023-10-07T08:54:17.464 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.89:6815/86544", 2023-10-07T08:54:17.464 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.89:6813/86544", 2023-10-07T08:54:17.464 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2023-10-07T08:54:17.464 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2023-10-07T08:54:17.464 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2023-10-07T08:54:17.464 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-10-07T08:54:17.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.465 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:17.465 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2023-10-07T08:54:17.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.465 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2023-10-07T08:54:17.465 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:17.465 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:17.465 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:17.465 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:17.465 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:17.465 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.443306+0000", 2023-10-07T08:54:17.465 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:17.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.466 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2023-10-07T08:54:17.466 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:17.466 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:17.466 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:17.466 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:17.466 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:17.466 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.435414+0000", 2023-10-07T08:54:17.466 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:17.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.467 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2023-10-07T08:54:17.467 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:17.467 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:17.467 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:17.467 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:17.467 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:17.467 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.468623+0000", 2023-10-07T08:54:17.467 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:17.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.467 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2023-10-07T08:54:17.468 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:17.468 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:17.468 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:17.468 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:17.468 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:17.468 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.388413+0000", 2023-10-07T08:54:17.468 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:17.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.468 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2023-10-07T08:54:17.468 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:17.468 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:17.469 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:17.469 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:17.469 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:17.469 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.393480+0000", 2023-10-07T08:54:17.469 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:17.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.469 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2023-10-07T08:54:17.469 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:17.469 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:17.469 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:17.470 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:17.470 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:17.470 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.426564+0000", 2023-10-07T08:54:17.470 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:17.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.470 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2023-10-07T08:54:17.470 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:17.470 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:17.470 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:17.470 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:17.471 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:17.471 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.397337+0000", 2023-10-07T08:54:17.471 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:17.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-07T08:54:17.471 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2023-10-07T08:54:17.471 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2023-10-07T08:54:17.471 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2023-10-07T08:54:17.471 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2023-10-07T08:54:17.471 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138320759226367, 2023-10-07T08:54:17.471 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2023-10-07T08:54:17.471 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2023-10-07T08:42:42.457260+0000", 2023-10-07T08:54:17.471 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2023-10-07T08:54:17.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.472 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-10-07T08:54:17.472 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2023-10-07T08:54:17.472 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2023-10-07T08:54:17.472 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2023-10-07T08:54:17.472 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2023-10-07T08:54:17.472 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2023-10-07T08:54:17.472 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2023-10-07T08:54:17.472 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2023-10-07T08:54:17.472 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2023-10-07T08:54:17.472 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2023-10-07T08:54:17.472 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2023-10-07T08:54:17.473 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2023-10-07T08:54:17.473 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2023-10-07T08:54:17.473 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2023-10-07T08:54:17.473 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-10-07T08:54:17.473 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [], 2023-10-07T08:54:17.473 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2023-10-07T08:54:17.473 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2023-10-07T08:54:17.473 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2023-10-07T08:54:17.473 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2023-10-07T08:54:17.473 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2023-10-07T08:54:17.473 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2023-10-07T08:54:17.474 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2023-10-07T08:54:17.474 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2023-10-07T08:54:17.474 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2023-10-07T08:54:17.474 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2023-10-07T08:54:17.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-07T08:54:17.474 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:54:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.387+0000 7f10c755d700 1 -- 172.21.15.81:0/2029893551 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f10a4066f30 msgr2=0x7f10a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.387+0000 7f10c755d700 1 --2- 172.21.15.81:0/2029893551 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f10a4066f30 0x7f10a40693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f10bc001560 tx=0x7f10bc006040 comp rx=0 tx=0).stop 2023-10-07T08:54:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.387+0000 7f10c755d700 1 -- 172.21.15.81:0/2029893551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c00b6110 msgr2=0x7f10c00b6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.387+0000 7f10c755d700 1 --2- 172.21.15.81:0/2029893551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c00b6110 0x7f10c00b6560 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f10c015b610 tx=0x7f10b80091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.387+0000 7f10c755d700 1 -- 172.21.15.81:0/2029893551 shutdown_connections 2023-10-07T08:54:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.387+0000 7f10c755d700 1 --2- 172.21.15.81:0/2029893551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c00b6110 0x7f10c00b6560 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.387+0000 7f10c755d700 1 --2- 172.21.15.81:0/2029893551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ac004810 0x7f10c0153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.387+0000 7f10c755d700 1 --2- 172.21.15.81:0/2029893551 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f10a4066f30 0x7f10a40693e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.387+0000 7f10c755d700 1 --2- 172.21.15.81:0/2029893551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10c00b4b70 0x7f10c00c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.387+0000 7f10c755d700 1 -- 172.21.15.81:0/2029893551 >> 172.21.15.81:0/2029893551 conn(0x7f10c006bb90 msgr2=0x7f10c015da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.387+0000 7f10c755d700 1 -- 172.21.15.81:0/2029893551 shutdown_connections 2023-10-07T08:54:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.387+0000 7f10c755d700 1 -- 172.21.15.81:0/2029893551 wait complete. 2023-10-07T08:54:17.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:54:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.589+0000 7f630069c700 1 Processor -- start 2023-10-07T08:54:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.589+0000 7f630069c700 1 -- start start 2023-10-07T08:54:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.590+0000 7f630069c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f8157ca0 0x7f62f80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.590+0000 7f630069c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f62f806d120 0x7f62f806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.590+0000 7f630069c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f806dac0 con 0x7f62f81578d0 2023-10-07T08:54:17.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.590+0000 7f630069c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f80d07c0 con 0x7f62f806d120 2023-10-07T08:54:17.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.590+0000 7f630069c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f80cfbb0 con 0x7f62f8157ca0 2023-10-07T08:54:17.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.590+0000 7f62fec39700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f62f806d120 0x7f62f806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:17.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.590+0000 7f62fec39700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f62f806d120 0x7f62f806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:52182/0 (socket says 172.21.15.81:52182) 2023-10-07T08:54:17.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.590+0000 7f62fe438700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f62f81578d0 0x7f62f815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:56922/0 (socket says 172.21.15.81:56922) 2023-10-07T08:54:17.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.590+0000 7f62fec39700 1 -- 172.21.15.81:0/2821269973 learned_addr learned my addr 172.21.15.81:0/2821269973 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:17.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.590+0000 7f62fdc37700 1 --2- 172.21.15.81:0/2821269973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f8157ca0 0x7f62f80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:17.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.591+0000 7f62fec39700 1 -- 172.21.15.81:0/2821269973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f8157ca0 msgr2=0x7f62f80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.591+0000 7f62fec39700 1 --2- 172.21.15.81:0/2821269973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f8157ca0 0x7f62f80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.591+0000 7f62fec39700 1 -- 172.21.15.81:0/2821269973 >> v1:172.21.15.89:6789/0 conn(0x7f62f81578d0 legacy=0x7f62f815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.591+0000 7f62fec39700 1 -- 172.21.15.81:0/2821269973 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f80cfe90 con 0x7f62f806d120 2023-10-07T08:54:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.591+0000 7f62fd436700 1 -- 172.21.15.81:0/2821269973 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611409415 0 0) 0x7f62f4001490 con 0x7f62f81578d0 2023-10-07T08:54:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.591+0000 7f62fec39700 1 --2- 172.21.15.81:0/2821269973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f806d120 0x7f62f806d580 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f62f00099b0 tx=0x7f62f0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d93abb35d8e4571 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.591+0000 7f62fd436700 1 -- 172.21.15.81:0/2821269973 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0009ea0 con 0x7f62f806d120 2023-10-07T08:54:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.591+0000 7f62fd436700 1 -- 172.21.15.81:0/2821269973 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f000b860 con 0x7f62f806d120 2023-10-07T08:54:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.591+0000 7f62fd436700 1 -- 172.21.15.81:0/2821269973 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f000bc00 con 0x7f62f806d120 2023-10-07T08:54:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.592+0000 7f630069c700 1 -- 172.21.15.81:0/2821269973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f806d120 msgr2=0x7f62f806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.592+0000 7f630069c700 1 --2- 172.21.15.81:0/2821269973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f806d120 0x7f62f806d580 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f62f00099b0 tx=0x7f62f0009250 comp rx=0 tx=0).stop 2023-10-07T08:54:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.592+0000 7f630069c700 1 -- 172.21.15.81:0/2821269973 shutdown_connections 2023-10-07T08:54:17.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.592+0000 7f630069c700 1 --2- 172.21.15.81:0/2821269973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f806d120 0x7f62f806d580 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.592+0000 7f630069c700 1 --2- 172.21.15.81:0/2821269973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f8157ca0 0x7f62f80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.592+0000 7f630069c700 1 -- 172.21.15.81:0/2821269973 >> 172.21.15.81:0/2821269973 conn(0x7f62f806bb90 msgr2=0x7f62f806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:17.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.592+0000 7f630069c700 1 -- 172.21.15.81:0/2821269973 shutdown_connections 2023-10-07T08:54:17.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.592+0000 7f630069c700 1 -- 172.21.15.81:0/2821269973 wait complete. 2023-10-07T08:54:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.593+0000 7f630069c700 1 Processor -- start 2023-10-07T08:54:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.593+0000 7f630069c700 1 -- start start 2023-10-07T08:54:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.593+0000 7f630069c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f806d120 0x7f62f814b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.593+0000 7f630069c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f81578d0 0x7f62f80b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f630069c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f8157ca0 0x7f62f8152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f630069c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f80b47c0 con 0x7f62f8157ca0 2023-10-07T08:54:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f630069c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f814b930 con 0x7f62f81578d0 2023-10-07T08:54:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f630069c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f8153f10 con 0x7f62f806d120 2023-10-07T08:54:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f62fec39700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f8157ca0 0x7f62f8152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f62fec39700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f8157ca0 0x7f62f8152390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56000/0 (socket says 172.21.15.81:56000) 2023-10-07T08:54:17.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f62fec39700 1 -- 172.21.15.81:0/2988834405 learned_addr learned my addr 172.21.15.81:0/2988834405 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:17.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f62fdc37700 1 --2- 172.21.15.81:0/2988834405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f81578d0 0x7f62f80b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:17.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f62fe438700 1 --2- 172.21.15.81:0/2988834405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f806d120 0x7f62f814b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:17.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f62fec39700 1 -- 172.21.15.81:0/2988834405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f806d120 msgr2=0x7f62f814b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:17.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f62fec39700 1 --2- 172.21.15.81:0/2988834405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f806d120 0x7f62f814b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f62fec39700 1 -- 172.21.15.81:0/2988834405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f81578d0 msgr2=0x7f62f80b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:17.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f62fec39700 1 --2- 172.21.15.81:0/2988834405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f81578d0 0x7f62f80b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f62fec39700 1 -- 172.21.15.81:0/2988834405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f00094f0 con 0x7f62f8157ca0 2023-10-07T08:54:17.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f62fec39700 1 --2- 172.21.15.81:0/2988834405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f8157ca0 0x7f62f8152390 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f62f0006fd0 tx=0x7f62f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:17.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f62ee7fc700 1 -- 172.21.15.81:0/2988834405 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f000baa0 con 0x7f62f8157ca0 2023-10-07T08:54:17.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f62ee7fc700 1 -- 172.21.15.81:0/2988834405 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f0025420 con 0x7f62f8157ca0 2023-10-07T08:54:17.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f630069c700 1 -- 172.21.15.81:0/2988834405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f80b5040 con 0x7f62f8157ca0 2023-10-07T08:54:17.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f62ee7fc700 1 -- 172.21.15.81:0/2988834405 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00257e0 con 0x7f62f8157ca0 2023-10-07T08:54:17.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.594+0000 7f630069c700 1 -- 172.21.15.81:0/2988834405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f81535e0 con 0x7f62f8157ca0 2023-10-07T08:54:17.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.595+0000 7f630069c700 1 -- 172.21.15.81:0/2988834405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f8067ac0 con 0x7f62f8157ca0 2023-10-07T08:54:17.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.596+0000 7f62ee7fc700 1 -- 172.21.15.81:0/2988834405 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62f0023070 con 0x7f62f8157ca0 2023-10-07T08:54:17.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.596+0000 7f62ee7fc700 1 --2- 172.21.15.81:0/2988834405 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f62dc066f30 0x7f62dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.596+0000 7f62ee7fc700 1 -- 172.21.15.81:0/2988834405 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f62f0085ba0 con 0x7f62f8157ca0 2023-10-07T08:54:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.596+0000 7f62fe438700 1 --2- 172.21.15.81:0/2988834405 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f62dc066f30 0x7f62dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.596+0000 7f62fe438700 1 --2- 172.21.15.81:0/2988834405 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f62dc066f30 0x7f62dc0693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f62f4002130 tx=0x7f62f4001ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.600+0000 7f62ee7fc700 1 -- 172.21.15.81:0/2988834405 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62f0052e10 con 0x7f62f8157ca0 2023-10-07T08:54:17.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.825+0000 7f630069c700 1 -- 172.21.15.81:0/2988834405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62f804bb80 con 0x7f62f8157ca0 2023-10-07T08:54:17.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.826+0000 7f62ee7fc700 1 -- 172.21.15.81:0/2988834405 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f62f0056430 con 0x7f62f8157ca0 2023-10-07T08:54:17.828 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:17.828 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1601080758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1601080758},{"type":"v1","addr":"172.21.15.81:6837","nonce":1601080758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2709611313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2709611313},{"type":"v1","addr":"172.21.15.89:6835","nonce":2709611313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/3085029167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3085029167},{"type":"v1","addr":"172.21.15.89:6834","nonce":3085029167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:53:48.496016+0000","modified":"2023-10-07T08:53:52.345717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6836/2531199109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2531199109},{"type":"v1","addr":"172.21.15.81:6836","nonce":2531199109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-07T08:54:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.828+0000 7f630069c700 1 -- 172.21.15.81:0/2988834405 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f62dc066f30 msgr2=0x7f62dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.828+0000 7f630069c700 1 --2- 172.21.15.81:0/2988834405 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f62dc066f30 0x7f62dc0693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f62f4002130 tx=0x7f62f4001ad0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.828+0000 7f630069c700 1 -- 172.21.15.81:0/2988834405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f8157ca0 msgr2=0x7f62f8152390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.828+0000 7f630069c700 1 --2- 172.21.15.81:0/2988834405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f8157ca0 0x7f62f8152390 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f62f0006fd0 tx=0x7f62f0017000 comp rx=0 tx=0).stop 2023-10-07T08:54:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.828+0000 7f630069c700 1 -- 172.21.15.81:0/2988834405 shutdown_connections 2023-10-07T08:54:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.828+0000 7f630069c700 1 --2- 172.21.15.81:0/2988834405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f8157ca0 0x7f62f8152390 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.828+0000 7f630069c700 1 --2- 172.21.15.81:0/2988834405 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f62dc066f30 0x7f62dc0693e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.828+0000 7f630069c700 1 --2- 172.21.15.81:0/2988834405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f806d120 0x7f62f814b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.828+0000 7f630069c700 1 --2- 172.21.15.81:0/2988834405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f81578d0 0x7f62f80b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.828+0000 7f630069c700 1 -- 172.21.15.81:0/2988834405 >> 172.21.15.81:0/2988834405 conn(0x7f62f806bb90 msgr2=0x7f62f8155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.828+0000 7f630069c700 1 -- 172.21.15.81:0/2988834405 shutdown_connections 2023-10-07T08:54:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:17.828+0000 7f630069c700 1 -- 172.21.15.81:0/2988834405 wait complete. 2023-10-07T08:54:17.832 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-07T08:54:17.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-07T08:54:17.974 INFO:teuthology.orchestra.run.smithi081.stdout:{"cluster_fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","whoami":0,"id":8160,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":28.623939486000001,"mdsmap_epoch":90,"osdmap_epoch":193,"osdmap_epoch_barrier":192,"uptime":33.948551514999998} 2023-10-07T08:54:17.974 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "f2fc6535-cadc-4a0b-bdad-da2d602c784a", "fs_name": "cephfs", "id": 8160, "mdsmap_epoch": 90, "osdmap_epoch": 193, "osdmap_epoch_barrier": 192, "rank_uptime": 28.623939486, "state": "up:active", "uptime": 33.948551515, "want_state": "up:active", "whoami": 0 } 2023-10-07T08:54:17.974 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-07T08:54:17.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:54:17.975 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-07T08:54:18.263 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records in 2023-10-07T08:54:18.264 INFO:teuthology.orchestra.run.smithi081.stderr:50+0 records out 2023-10-07T08:54:18.264 INFO:teuthology.orchestra.run.smithi081.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.27337 s, 192 MB/s 2023-10-07T08:54:18.265 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-07T08:54:18.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:54:18.306 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-07T08:54:18.346 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-07T08:54:18.346 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-07T08:54:18.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:54:18.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-07T08:54:18.412 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:54:18.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:54:18.413 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-07T08:54:18.432 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-07T08:54:18.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-07T08:54:18.432 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-07T08:54:18.475 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:54:18.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:54:18.475 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-07T08:54:18.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:54:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.643+0000 7fdcd2c14700 1 Processor -- start 2023-10-07T08:54:18.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.643+0000 7fdcd2c14700 1 -- start start 2023-10-07T08:54:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.644+0000 7fdcd2c14700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdccc157ca0 0x7fdccc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.644+0000 7fdcd2c14700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdccc0d07c0 con 0x7fdccc1578d0 2023-10-07T08:54:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.644+0000 7fdcd2c14700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdccc0cfbb0 con 0x7fdccc06d120 2023-10-07T08:54:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.644+0000 7fdcd2c14700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0cfe90 con 0x7fdccc157ca0 2023-10-07T08:54:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.644+0000 7fdcd09b0700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdccc1578d0 0x7fdccc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33714/0 (socket says 172.21.15.81:33714) 2023-10-07T08:54:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.644+0000 7fdcd09b0700 1 -- 172.21.15.81:0/2446103805 learned_addr learned my addr 172.21.15.81:0/2446103805 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.644+0000 7fdcc3fff700 1 --2- 172.21.15.81:0/2446103805 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdccc157ca0 0x7fdccc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.644+0000 7fdcc37fe700 1 -- 172.21.15.81:0/2446103805 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179894430 0 0) 0x7fdccc0d07c0 con 0x7fdccc1578d0 2023-10-07T08:54:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.644+0000 7fdcc37fe700 1 -- 172.21.15.81:0/2446103805 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcb4003570 con 0x7fdccc1578d0 2023-10-07T08:54:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 -- 172.21.15.81:0/2446103805 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816147533 0 0) 0x7fdccc0cfbb0 con 0x7fdccc06d120 2023-10-07T08:54:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 -- 172.21.15.81:0/2446103805 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdccc0d07c0 con 0x7fdccc06d120 2023-10-07T08:54:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 -- 172.21.15.81:0/2446103805 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 668501527 0 0) 0x7fdcb4003570 con 0x7fdccc1578d0 2023-10-07T08:54:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 -- 172.21.15.81:0/2446103805 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdccc157ca0 msgr2=0x7fdccc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 --2- 172.21.15.81:0/2446103805 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdccc157ca0 0x7fdccc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 -- 172.21.15.81:0/2446103805 >> v1:172.21.15.89:6789/0 conn(0x7fdccc06d120 legacy=0x7fdccc15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 -- 172.21.15.81:0/2446103805 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc0d0170 con 0x7fdccc1578d0 2023-10-07T08:54:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 -- 172.21.15.81:0/2446103805 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fdcc80017f0 con 0x7fdccc1578d0 2023-10-07T08:54:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 -- 172.21.15.81:0/2446103805 >> v1:172.21.15.81:6789/0 conn(0x7fdccc1578d0 legacy=0x7fdccc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 --2- 172.21.15.81:0/2446103805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb4003c20 0x7fdcb4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 --2- 172.21.15.81:0/2446103805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb4004810 0x7fdcb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 --2- 172.21.15.81:0/2446103805 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdccc157ca0 0x7fdcb4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 -- 172.21.15.81:0/2446103805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0cfe90 con 0x7fdcb4003c20 2023-10-07T08:54:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 -- 172.21.15.81:0/2446103805 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb400bbf0 con 0x7fdcb4004810 2023-10-07T08:54:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 -- 172.21.15.81:0/2446103805 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb400bdb0 con 0x7fdccc157ca0 2023-10-07T08:54:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcd09b0700 1 --2- 172.21.15.81:0/2446103805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb4003c20 0x7fdcb4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc3fff700 1 --2- 172.21.15.81:0/2446103805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb4004810 0x7fdcb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcd11b1700 1 --2- 172.21.15.81:0/2446103805 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdccc157ca0 0x7fdcb4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcd09b0700 1 -- 172.21.15.81:0/2446103805 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdccc157ca0 msgr2=0x7fdcb4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcd09b0700 1 --2- 172.21.15.81:0/2446103805 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdccc157ca0 0x7fdcb4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcd09b0700 1 -- 172.21.15.81:0/2446103805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb4004810 msgr2=0x7fdcb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:18.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcd09b0700 1 --2- 172.21.15.81:0/2446103805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb4004810 0x7fdcb4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:18.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcd09b0700 1 -- 172.21.15.81:0/2446103805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb4003570 con 0x7fdcb4003c20 2023-10-07T08:54:18.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcd09b0700 1 --2- 172.21.15.81:0/2446103805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb4003c20 0x7fdcb4004010 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fdcc800a820 tx=0x7fdccc15b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7b355947ea973d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:18.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 -- 172.21.15.81:0/2446103805 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc80070f0 con 0x7fdcb4003c20 2023-10-07T08:54:18.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 -- 172.21.15.81:0/2446103805 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc8007270 con 0x7fdcb4003c20 2023-10-07T08:54:18.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.645+0000 7fdcc37fe700 1 -- 172.21.15.81:0/2446103805 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8007630 con 0x7fdcb4003c20 2023-10-07T08:54:18.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.646+0000 7fdcd2c14700 1 -- 172.21.15.81:0/2446103805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb4003c20 msgr2=0x7fdcb4004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:18.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.646+0000 7fdcd2c14700 1 --2- 172.21.15.81:0/2446103805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb4003c20 0x7fdcb4004010 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fdcc800a820 tx=0x7fdccc15b610 comp rx=0 tx=0).stop 2023-10-07T08:54:18.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.646+0000 7fdcd11b1700 1 -- 172.21.15.81:0/2446103805 reap_dead start 2023-10-07T08:54:18.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.646+0000 7fdcd2c14700 1 -- 172.21.15.81:0/2446103805 shutdown_connections 2023-10-07T08:54:18.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.646+0000 7fdcd2c14700 1 -- 172.21.15.81:0/2446103805 >> 172.21.15.81:0/2446103805 conn(0x7fdccc06bb90 msgr2=0x7fdccc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:18.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.646+0000 7fdcd2c14700 1 -- 172.21.15.81:0/2446103805 shutdown_connections 2023-10-07T08:54:18.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.646+0000 7fdcd2c14700 1 -- 172.21.15.81:0/2446103805 wait complete. 2023-10-07T08:54:18.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.647+0000 7fdcd2c14700 1 Processor -- start 2023-10-07T08:54:18.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.647+0000 7fdcd2c14700 1 -- start start 2023-10-07T08:54:18.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd2c14700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb4003c20 0x7fdccc15ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:18.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd2c14700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdccc15bfd0 0x7fdccc14e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd2c14700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdccc14edf0 0x7fdccc14c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd2c14700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc15c440 con 0x7fdcb4003c20 2023-10-07T08:54:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd2c14700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc16a4d0 con 0x7fdccc14edf0 2023-10-07T08:54:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd2c14700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc16a7b0 con 0x7fdccc15bfd0 2023-10-07T08:54:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd09b0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb4003c20 0x7fdccc15ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd09b0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb4003c20 0x7fdccc15ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56018/0 (socket says 172.21.15.81:56018) 2023-10-07T08:54:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd09b0700 1 -- 172.21.15.81:0/3457097724 learned_addr learned my addr 172.21.15.81:0/3457097724 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcc3fff700 1 --2- 172.21.15.81:0/3457097724 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdccc15bfd0 0x7fdccc14e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd11b1700 1 --2- 172.21.15.81:0/3457097724 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdccc14edf0 0x7fdccc14c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd09b0700 1 -- 172.21.15.81:0/3457097724 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdccc15bfd0 msgr2=0x7fdccc14e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd09b0700 1 --2- 172.21.15.81:0/3457097724 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdccc15bfd0 0x7fdccc14e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd09b0700 1 -- 172.21.15.81:0/3457097724 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdccc14edf0 msgr2=0x7fdccc14c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd09b0700 1 --2- 172.21.15.81:0/3457097724 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdccc14edf0 0x7fdccc14c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd09b0700 1 -- 172.21.15.81:0/3457097724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc16aa90 con 0x7fdcb4003c20 2023-10-07T08:54:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd09b0700 1 --2- 172.21.15.81:0/3457097724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb4003c20 0x7fdccc15ba90 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40057f0 tx=0x7fdcc8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcc0ff9700 1 -- 172.21.15.81:0/3457097724 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8007070 con 0x7fdcb4003c20 2023-10-07T08:54:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcc0ff9700 1 -- 172.21.15.81:0/3457097724 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc8000f40 con 0x7fdcb4003c20 2023-10-07T08:54:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcc0ff9700 1 -- 172.21.15.81:0/3457097724 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc80073e0 con 0x7fdcb4003c20 2023-10-07T08:54:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd2c14700 1 -- 172.21.15.81:0/3457097724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdccc16ad70 con 0x7fdcb4003c20 2023-10-07T08:54:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.648+0000 7fdcd2c14700 1 -- 172.21.15.81:0/3457097724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc14f290 con 0x7fdcb4003c20 2023-10-07T08:54:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.650+0000 7fdcd2c14700 1 -- 172.21.15.81:0/3457097724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdccc067ac0 con 0x7fdcb4003c20 2023-10-07T08:54:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.650+0000 7fdcc0ff9700 1 -- 172.21.15.81:0/3457097724 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdcc8004bb0 con 0x7fdcb4003c20 2023-10-07T08:54:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.650+0000 7fdcc0ff9700 1 --2- 172.21.15.81:0/3457097724 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdcb8066f30 0x7fdcb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:18.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.650+0000 7fdcc0ff9700 1 -- 172.21.15.81:0/3457097724 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdcc8086ee0 con 0x7fdcb4003c20 2023-10-07T08:54:18.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.650+0000 7fdcc3fff700 1 --2- 172.21.15.81:0/3457097724 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdcb8066f30 0x7fdcb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.651+0000 7fdcc3fff700 1 --2- 172.21.15.81:0/3457097724 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdcb8066f30 0x7fdcb80693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0cf2e0 tx=0x7fdcbc0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:18.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.654+0000 7fdcc0ff9700 1 -- 172.21.15.81:0/3457097724 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdcc8054150 con 0x7fdcb4003c20 2023-10-07T08:54:18.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.877+0000 7fdcd2c14700 1 -- 172.21.15.81:0/3457097724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdccc16b0e0 con 0x7fdcb4003c20 2023-10-07T08:54:18.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.878+0000 7fdcc0ff9700 1 -- 172.21.15.81:0/3457097724 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fdcc8004e60 con 0x7fdcb4003c20 2023-10-07T08:54:18.879 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:18.880 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1601080758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1601080758},{"type":"v1","addr":"172.21.15.81:6837","nonce":1601080758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2709611313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2709611313},{"type":"v1","addr":"172.21.15.89:6835","nonce":2709611313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/3085029167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3085029167},{"type":"v1","addr":"172.21.15.89:6834","nonce":3085029167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:53:48.496016+0000","modified":"2023-10-07T08:53:52.345717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6836/2531199109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2531199109},{"type":"v1","addr":"172.21.15.81:6836","nonce":2531199109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-07T08:54:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.880+0000 7fdcd2c14700 1 -- 172.21.15.81:0/3457097724 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdcb8066f30 msgr2=0x7fdcb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.880+0000 7fdcd2c14700 1 --2- 172.21.15.81:0/3457097724 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdcb8066f30 0x7fdcb80693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0cf2e0 tx=0x7fdcbc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.880+0000 7fdcd2c14700 1 -- 172.21.15.81:0/3457097724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb4003c20 msgr2=0x7fdccc15ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.880+0000 7fdcd2c14700 1 --2- 172.21.15.81:0/3457097724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb4003c20 0x7fdccc15ba90 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40057f0 tx=0x7fdcc8016000 comp rx=0 tx=0).stop 2023-10-07T08:54:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.880+0000 7fdcd2c14700 1 -- 172.21.15.81:0/3457097724 shutdown_connections 2023-10-07T08:54:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.880+0000 7fdcd2c14700 1 --2- 172.21.15.81:0/3457097724 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdccc14edf0 0x7fdccc14c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.880+0000 7fdcd2c14700 1 --2- 172.21.15.81:0/3457097724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb4003c20 0x7fdccc15ba90 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.880+0000 7fdcd2c14700 1 --2- 172.21.15.81:0/3457097724 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdcb8066f30 0x7fdcb80693e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.880+0000 7fdcd2c14700 1 --2- 172.21.15.81:0/3457097724 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdccc15bfd0 0x7fdccc14e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.880+0000 7fdcd2c14700 1 -- 172.21.15.81:0/3457097724 >> 172.21.15.81:0/3457097724 conn(0x7fdccc06bb90 msgr2=0x7fdccc156750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.880+0000 7fdcd2c14700 1 -- 172.21.15.81:0/3457097724 shutdown_connections 2023-10-07T08:54:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:18.880+0000 7fdcd2c14700 1 -- 172.21.15.81:0/3457097724 wait complete. 2023-10-07T08:54:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-07T08:54:18.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:54:19.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.006+0000 7fb377138700 1 Processor -- start 2023-10-07T08:54:19.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.006+0000 7fb377138700 1 -- start start 2023-10-07T08:54:19.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.007+0000 7fb377138700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb370157ca0 0x7fb3700cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.007+0000 7fb377138700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3700d07c0 con 0x7fb3701578d0 2023-10-07T08:54:19.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.007+0000 7fb377138700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3700cfbb0 con 0x7fb37006d120 2023-10-07T08:54:19.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.007+0000 7fb377138700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700cfe90 con 0x7fb370157ca0 2023-10-07T08:54:19.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.007+0000 7fb374ed4700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb3701578d0 0x7fb37015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33724/0 (socket says 172.21.15.81:33724) 2023-10-07T08:54:19.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.007+0000 7fb374ed4700 1 -- 172.21.15.81:0/3618407356 learned_addr learned my addr 172.21.15.81:0/3618407356 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:19.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.007+0000 7fb367fff700 1 --2- 172.21.15.81:0/3618407356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb370157ca0 0x7fb3700cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.007+0000 7fb3677fe700 1 -- 172.21.15.81:0/3618407356 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076830948 0 0) 0x7fb3700d07c0 con 0x7fb3701578d0 2023-10-07T08:54:19.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb3677fe700 1 -- 172.21.15.81:0/3618407356 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb358003570 con 0x7fb3701578d0 2023-10-07T08:54:19.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb3677fe700 1 -- 172.21.15.81:0/3618407356 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1028725711 0 0) 0x7fb358003570 con 0x7fb3701578d0 2023-10-07T08:54:19.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb3677fe700 1 -- 172.21.15.81:0/3618407356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb370157ca0 msgr2=0x7fb3700cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:19.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb3677fe700 1 --2- 172.21.15.81:0/3618407356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb370157ca0 0x7fb3700cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb3677fe700 1 -- 172.21.15.81:0/3618407356 >> v1:172.21.15.89:6789/0 conn(0x7fb37006d120 legacy=0x7fb37015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb3677fe700 1 -- 172.21.15.81:0/3618407356 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3700d0170 con 0x7fb3701578d0 2023-10-07T08:54:19.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb3677fe700 1 -- 172.21.15.81:0/3618407356 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fb36c0017f0 con 0x7fb3701578d0 2023-10-07T08:54:19.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb3677fe700 1 -- 172.21.15.81:0/3618407356 >> v1:172.21.15.81:6789/0 conn(0x7fb3701578d0 legacy=0x7fb37015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb3677fe700 1 --2- 172.21.15.81:0/3618407356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb358003a90 0x7fb358003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb3677fe700 1 --2- 172.21.15.81:0/3618407356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb358004810 0x7fb358004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb3677fe700 1 --2- 172.21.15.81:0/3618407356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3580051c0 0x7fb35800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb3677fe700 1 -- 172.21.15.81:0/3618407356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700cfe90 con 0x7fb358003a90 2023-10-07T08:54:19.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb3677fe700 1 -- 172.21.15.81:0/3618407356 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35800c000 con 0x7fb358004810 2023-10-07T08:54:19.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb3677fe700 1 -- 172.21.15.81:0/3618407356 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35800c1c0 con 0x7fb3580051c0 2023-10-07T08:54:19.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb367fff700 1 --2- 172.21.15.81:0/3618407356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb370157ca0 0x7fb3700cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:54:19.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb374ed4700 1 --2- 172.21.15.81:0/3618407356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb358003a90 0x7fb358003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb3756d5700 1 --2- 172.21.15.81:0/3618407356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3580051c0 0x7fb35800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb367fff700 1 --2- 172.21.15.81:0/3618407356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb358004810 0x7fb358004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb374ed4700 1 -- 172.21.15.81:0/3618407356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3580051c0 msgr2=0x7fb35800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:19.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb374ed4700 1 --2- 172.21.15.81:0/3618407356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3580051c0 0x7fb35800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb374ed4700 1 -- 172.21.15.81:0/3618407356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb358004810 msgr2=0x7fb358004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:19.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb374ed4700 1 --2- 172.21.15.81:0/3618407356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb358004810 0x7fb358004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb374ed4700 1 -- 172.21.15.81:0/3618407356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb358003570 con 0x7fb358003a90 2023-10-07T08:54:19.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.008+0000 7fb374ed4700 1 --2- 172.21.15.81:0/3618407356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb358003a90 0x7fb358003e60 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fb36c002250 tx=0x7fb37015b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367505169f6eb729 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:19.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.009+0000 7fb3677fe700 1 -- 172.21.15.81:0/3618407356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c0070f0 con 0x7fb358003a90 2023-10-07T08:54:19.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.009+0000 7fb3677fe700 1 -- 172.21.15.81:0/3618407356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36c007250 con 0x7fb358003a90 2023-10-07T08:54:19.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.009+0000 7fb3677fe700 1 -- 172.21.15.81:0/3618407356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c007610 con 0x7fb358003a90 2023-10-07T08:54:19.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.009+0000 7fb377138700 1 -- 172.21.15.81:0/3618407356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb358003a90 msgr2=0x7fb358003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.009+0000 7fb377138700 1 --2- 172.21.15.81:0/3618407356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb358003a90 0x7fb358003e60 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fb36c002250 tx=0x7fb37015b610 comp rx=0 tx=0).stop 2023-10-07T08:54:19.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.009+0000 7fb3756d5700 1 -- 172.21.15.81:0/3618407356 reap_dead start 2023-10-07T08:54:19.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.009+0000 7fb377138700 1 -- 172.21.15.81:0/3618407356 shutdown_connections 2023-10-07T08:54:19.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.009+0000 7fb377138700 1 -- 172.21.15.81:0/3618407356 >> 172.21.15.81:0/3618407356 conn(0x7fb37006bb90 msgr2=0x7fb37006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:19.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.009+0000 7fb377138700 1 -- 172.21.15.81:0/3618407356 shutdown_connections 2023-10-07T08:54:19.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.009+0000 7fb377138700 1 -- 172.21.15.81:0/3618407356 wait complete. 2023-10-07T08:54:19.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.010+0000 7fb377138700 1 Processor -- start 2023-10-07T08:54:19.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.010+0000 7fb377138700 1 -- start start 2023-10-07T08:54:19.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.011+0000 7fb377138700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb358003a90 0x7fb37016bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.011+0000 7fb377138700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb37014f8f0 0x7fb3700b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.011+0000 7fb377138700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb370151b00 0x7fb37016e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.011+0000 7fb377138700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb370153100 con 0x7fb370151b00 2023-10-07T08:54:19.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.011+0000 7fb377138700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb370152480 con 0x7fb37014f8f0 2023-10-07T08:54:19.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.011+0000 7fb377138700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb370152760 con 0x7fb358003a90 2023-10-07T08:54:19.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.011+0000 7fb3756d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb370151b00 0x7fb37016e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.011+0000 7fb3756d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb370151b00 0x7fb37016e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56038/0 (socket says 172.21.15.81:56038) 2023-10-07T08:54:19.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.011+0000 7fb3756d5700 1 -- 172.21.15.81:0/4238216058 learned_addr learned my addr 172.21.15.81:0/4238216058 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:19.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.011+0000 7fb374ed4700 1 --2- 172.21.15.81:0/4238216058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb358003a90 0x7fb37016bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.011+0000 7fb367fff700 1 --2- 172.21.15.81:0/4238216058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb37014f8f0 0x7fb3700b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.011+0000 7fb3756d5700 1 -- 172.21.15.81:0/4238216058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb358003a90 msgr2=0x7fb37016bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.011+0000 7fb3756d5700 1 --2- 172.21.15.81:0/4238216058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb358003a90 0x7fb37016bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.011+0000 7fb3756d5700 1 -- 172.21.15.81:0/4238216058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb37014f8f0 msgr2=0x7fb3700b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.011+0000 7fb3756d5700 1 --2- 172.21.15.81:0/4238216058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb37014f8f0 0x7fb3700b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.011+0000 7fb3756d5700 1 -- 172.21.15.81:0/4238216058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb370152ab0 con 0x7fb370151b00 2023-10-07T08:54:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.012+0000 7fb3756d5700 1 --2- 172.21.15.81:0/4238216058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb370151b00 0x7fb37016e2b0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fb370063f40 tx=0x7fb368007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.012+0000 7fb364ff9700 1 -- 172.21.15.81:0/4238216058 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368013600 con 0x7fb370151b00 2023-10-07T08:54:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.012+0000 7fb364ff9700 1 -- 172.21.15.81:0/4238216058 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb368013780 con 0x7fb370151b00 2023-10-07T08:54:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.012+0000 7fb377138700 1 -- 172.21.15.81:0/4238216058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb370152d90 con 0x7fb370151b00 2023-10-07T08:54:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.012+0000 7fb364ff9700 1 -- 172.21.15.81:0/4238216058 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368013b40 con 0x7fb370151b00 2023-10-07T08:54:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.012+0000 7fb377138700 1 -- 172.21.15.81:0/4238216058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb370151f80 con 0x7fb370151b00 2023-10-07T08:54:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.013+0000 7fb377138700 1 -- 172.21.15.81:0/4238216058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb370067ac0 con 0x7fb370151b00 2023-10-07T08:54:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.013+0000 7fb364ff9700 1 -- 172.21.15.81:0/4238216058 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb36801e460 con 0x7fb370151b00 2023-10-07T08:54:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.013+0000 7fb364ff9700 1 --2- 172.21.15.81:0/4238216058 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb35c066f30 0x7fb35c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.014+0000 7fb374ed4700 1 --2- 172.21.15.81:0/4238216058 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb35c066f30 0x7fb35c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.014+0000 7fb364ff9700 1 -- 172.21.15.81:0/4238216058 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb368084450 con 0x7fb370151b00 2023-10-07T08:54:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.014+0000 7fb374ed4700 1 --2- 172.21.15.81:0/4238216058 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb35c066f30 0x7fb35c0693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb370154800 tx=0x7fb36c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:19.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.018+0000 7fb364ff9700 1 -- 172.21.15.81:0/4238216058 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3680516c0 con 0x7fb370151b00 2023-10-07T08:54:19.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.201+0000 7fb377138700 1 -- 172.21.15.81:0/4238216058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb370153240 con 0x7fb370151b00 2023-10-07T08:54:19.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.201+0000 7fb364ff9700 1 -- 172.21.15.81:0/4238216058 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+15324 (secure 0 0 0) 0x7fb368054ce0 con 0x7fb370151b00 2023-10-07T08:54:19.203 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:19.204 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":193,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:54:13.341950+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:53:46.818809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-07T08:53:47.460436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:54:19.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.204+0000 7fb377138700 1 -- 172.21.15.81:0/4238216058 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb35c066f30 msgr2=0x7fb35c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.204+0000 7fb377138700 1 --2- 172.21.15.81:0/4238216058 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb35c066f30 0x7fb35c0693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb370154800 tx=0x7fb36c016000 comp rx=0 tx=0).stop 2023-10-07T08:54:19.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.204+0000 7fb377138700 1 -- 172.21.15.81:0/4238216058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb370151b00 msgr2=0x7fb37016e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.204+0000 7fb377138700 1 --2- 172.21.15.81:0/4238216058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb370151b00 0x7fb37016e2b0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fb370063f40 tx=0x7fb368007d10 comp rx=0 tx=0).stop 2023-10-07T08:54:19.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.204+0000 7fb377138700 1 -- 172.21.15.81:0/4238216058 shutdown_connections 2023-10-07T08:54:19.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.204+0000 7fb377138700 1 --2- 172.21.15.81:0/4238216058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb370151b00 0x7fb37016e2b0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.204+0000 7fb377138700 1 --2- 172.21.15.81:0/4238216058 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fb35c066f30 0x7fb35c0693e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.204+0000 7fb377138700 1 --2- 172.21.15.81:0/4238216058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb358003a90 0x7fb37016bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.204+0000 7fb377138700 1 --2- 172.21.15.81:0/4238216058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb37014f8f0 0x7fb3700b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.204+0000 7fb377138700 1 -- 172.21.15.81:0/4238216058 >> 172.21.15.81:0/4238216058 conn(0x7fb37006bb90 msgr2=0x7fb37014ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.204+0000 7fb377138700 1 -- 172.21.15.81:0/4238216058 shutdown_connections 2023-10-07T08:54:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.204+0000 7fb377138700 1 -- 172.21.15.81:0/4238216058 wait complete. 2023-10-07T08:54:19.217 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-07T08:42:46.033308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-07T08:53:46.818809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '189', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-10-07T08:53:47.460436+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '193', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-07T08:54:19.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-07T08:54:19.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.332+0000 7f8cc5fc9700 1 Processor -- start 2023-10-07T08:54:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.332+0000 7f8cc5fc9700 1 -- start start 2023-10-07T08:54:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.333+0000 7f8cc5fc9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8cc0157ca0 0x7f8cc00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.333+0000 7f8cc5fc9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cc006d120 0x7f8cc006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.333+0000 7f8cc5fc9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc00d07c0 con 0x7f8cc01578d0 2023-10-07T08:54:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.333+0000 7f8cc5fc9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc006daa0 con 0x7f8cc0157ca0 2023-10-07T08:54:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.333+0000 7f8cc5fc9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc00cfbb0 con 0x7f8cc006d120 2023-10-07T08:54:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.333+0000 7f8cbeffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8cc0157ca0 0x7f8cc00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.333+0000 7f8cbf7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8cc01578d0 0x7f8cc015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33734/0 (socket says 172.21.15.81:33734) 2023-10-07T08:54:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.333+0000 7f8cbf7fe700 1 -- 172.21.15.81:0/1106406656 learned_addr learned my addr 172.21.15.81:0/1106406656 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.333+0000 7f8cbffff700 1 --2- 172.21.15.81:0/1106406656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cc006d120 0x7f8cc006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.333+0000 7f8cbeffd700 1 -- 172.21.15.81:0/1106406656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cc006d120 msgr2=0x7f8cc006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.333+0000 7f8cbeffd700 1 --2- 172.21.15.81:0/1106406656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cc006d120 0x7f8cc006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.333+0000 7f8cbeffd700 1 -- 172.21.15.81:0/1106406656 >> v1:172.21.15.81:6789/0 conn(0x7f8cc01578d0 legacy=0x7f8cc015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.334+0000 7f8cbe7fc700 1 -- 172.21.15.81:0/1106406656 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332580087 0 0) 0x7f8cc00d07c0 con 0x7f8cc01578d0 2023-10-07T08:54:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.334+0000 7f8cbeffd700 1 -- 172.21.15.81:0/1106406656 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc00cfe90 con 0x7f8cc0157ca0 2023-10-07T08:54:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.334+0000 7f8cbffff700 1 --2- 172.21.15.81:0/1106406656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cc006d120 0x7f8cc006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.334+0000 7f8cbeffd700 1 --2- 172.21.15.81:0/1106406656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cc0157ca0 0x7f8cc00cf4f0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40098e0 tx=0x7f8cb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19eb630f71bbed38 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.334+0000 7f8cbe7fc700 1 -- 172.21.15.81:0/1106406656 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4009e80 con 0x7f8cc0157ca0 2023-10-07T08:54:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.334+0000 7f8cbe7fc700 1 -- 172.21.15.81:0/1106406656 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb400b860 con 0x7f8cc0157ca0 2023-10-07T08:54:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.334+0000 7f8cbe7fc700 1 -- 172.21.15.81:0/1106406656 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb400bbe0 con 0x7f8cc0157ca0 2023-10-07T08:54:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.334+0000 7f8cc5fc9700 1 -- 172.21.15.81:0/1106406656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cc0157ca0 msgr2=0x7f8cc00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.334+0000 7f8cc5fc9700 1 --2- 172.21.15.81:0/1106406656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cc0157ca0 0x7f8cc00cf4f0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40098e0 tx=0x7f8cb40091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.334+0000 7f8cc5fc9700 1 -- 172.21.15.81:0/1106406656 shutdown_connections 2023-10-07T08:54:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.334+0000 7f8cc5fc9700 1 --2- 172.21.15.81:0/1106406656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cc006d120 0x7f8cc006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.334+0000 7f8cc5fc9700 1 --2- 172.21.15.81:0/1106406656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cc0157ca0 0x7f8cc00cf4f0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.334+0000 7f8cc5fc9700 1 -- 172.21.15.81:0/1106406656 >> 172.21.15.81:0/1106406656 conn(0x7f8cc006bb90 msgr2=0x7f8cc006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.334+0000 7f8cc5fc9700 1 -- 172.21.15.81:0/1106406656 shutdown_connections 2023-10-07T08:54:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.334+0000 7f8cc5fc9700 1 -- 172.21.15.81:0/1106406656 wait complete. 2023-10-07T08:54:19.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.336+0000 7f8cc5fc9700 1 Processor -- start 2023-10-07T08:54:19.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.336+0000 7f8cc5fc9700 1 -- start start 2023-10-07T08:54:19.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.336+0000 7f8cc5fc9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cc006d120 0x7f8cc0145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.336+0000 7f8cc5fc9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cc01578d0 0x7f8cc00b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.336+0000 7f8cc5fc9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8cc0157ca0 0x7f8cc00c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.336+0000 7f8cc5fc9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc00b50b0 con 0x7f8cc01578d0 2023-10-07T08:54:19.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.336+0000 7f8cc5fc9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc00b44a0 con 0x7f8cc0157ca0 2023-10-07T08:54:19.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.336+0000 7f8cc5fc9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc00b4780 con 0x7f8cc006d120 2023-10-07T08:54:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.336+0000 7f8cbeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cc01578d0 0x7f8cc00b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.336+0000 7f8cbeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cc01578d0 0x7f8cc00b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56062/0 (socket says 172.21.15.81:56062) 2023-10-07T08:54:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.336+0000 7f8cbeffd700 1 -- 172.21.15.81:0/2952688691 learned_addr learned my addr 172.21.15.81:0/2952688691 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.337+0000 7f8cbf7fe700 1 --2- 172.21.15.81:0/2952688691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cc006d120 0x7f8cc0145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.337+0000 7f8cbffff700 1 --2- 172.21.15.81:0/2952688691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8cc0157ca0 0x7f8cc00c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.337+0000 7f8cbeffd700 1 -- 172.21.15.81:0/2952688691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cc006d120 msgr2=0x7f8cc0145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.337+0000 7f8cbeffd700 1 --2- 172.21.15.81:0/2952688691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cc006d120 0x7f8cc0145760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.337+0000 7f8cbeffd700 1 -- 172.21.15.81:0/2952688691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8cc0157ca0 msgr2=0x7f8cc00c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.337+0000 7f8cbeffd700 1 --2- 172.21.15.81:0/2952688691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8cc0157ca0 0x7f8cc00c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.337+0000 7f8cbeffd700 1 -- 172.21.15.81:0/2952688691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb4009420 con 0x7f8cc01578d0 2023-10-07T08:54:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.337+0000 7f8cbffff700 1 --2- 172.21.15.81:0/2952688691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8cc0157ca0 0x7f8cc00c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:19.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.337+0000 7f8cbeffd700 1 --2- 172.21.15.81:0/2952688691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cc01578d0 0x7f8cc00b3ba0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4013000 tx=0x7f8cb4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:19.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.337+0000 7f8ca77fe700 1 -- 172.21.15.81:0/2952688691 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb400bbe0 con 0x7f8cc01578d0 2023-10-07T08:54:19.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.337+0000 7f8ca77fe700 1 -- 172.21.15.81:0/2952688691 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb4011420 con 0x7f8cc01578d0 2023-10-07T08:54:19.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.337+0000 7f8cc5fc9700 1 -- 172.21.15.81:0/2952688691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc00b4a60 con 0x7f8cc01578d0 2023-10-07T08:54:19.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.337+0000 7f8ca77fe700 1 -- 172.21.15.81:0/2952688691 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb40117c0 con 0x7f8cc01578d0 2023-10-07T08:54:19.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.337+0000 7f8cc5fc9700 1 -- 172.21.15.81:0/2952688691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc0145ca0 con 0x7f8cc01578d0 2023-10-07T08:54:19.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.338+0000 7f8cc5fc9700 1 -- 172.21.15.81:0/2952688691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc00b5260 con 0x7f8cc01578d0 2023-10-07T08:54:19.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.338+0000 7f8ca77fe700 1 -- 172.21.15.81:0/2952688691 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8cb4011bb0 con 0x7f8cc01578d0 2023-10-07T08:54:19.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.339+0000 7f8ca77fe700 1 --2- 172.21.15.81:0/2952688691 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8cac066f30 0x7f8cac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.339+0000 7f8ca77fe700 1 -- 172.21.15.81:0/2952688691 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8cb4085c30 con 0x7f8cc01578d0 2023-10-07T08:54:19.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.339+0000 7f8cbf7fe700 1 --2- 172.21.15.81:0/2952688691 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8cac066f30 0x7f8cac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.339+0000 7f8cbf7fe700 1 --2- 172.21.15.81:0/2952688691 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8cac066f30 0x7f8cac0693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00011e0 tx=0x7f8cb0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:19.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.343+0000 7f8ca77fe700 1 -- 172.21.15.81:0/2952688691 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8cc00b5260 con 0x7f8cc01578d0 2023-10-07T08:54:19.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.524+0000 7f8cc5fc9700 1 -- 172.21.15.81:0/2952688691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8cc00b51f0 con 0x7f8cc01578d0 2023-10-07T08:54:19.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.525+0000 7f8ca77fe700 1 -- 172.21.15.81:0/2952688691 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v193) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8cb4011e60 con 0x7f8cc01578d0 2023-10-07T08:54:19.526 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-07T08:54:19.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.527+0000 7f8cc5fc9700 1 -- 172.21.15.81:0/2952688691 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8cac066f30 msgr2=0x7f8cac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.527+0000 7f8cc5fc9700 1 --2- 172.21.15.81:0/2952688691 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8cac066f30 0x7f8cac0693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00011e0 tx=0x7f8cb0009040 comp rx=0 tx=0).stop 2023-10-07T08:54:19.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.527+0000 7f8cc5fc9700 1 -- 172.21.15.81:0/2952688691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cc01578d0 msgr2=0x7f8cc00b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.527+0000 7f8cc5fc9700 1 --2- 172.21.15.81:0/2952688691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cc01578d0 0x7f8cc00b3ba0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4013000 tx=0x7f8cb4017000 comp rx=0 tx=0).stop 2023-10-07T08:54:19.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.527+0000 7f8cc5fc9700 1 -- 172.21.15.81:0/2952688691 shutdown_connections 2023-10-07T08:54:19.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.527+0000 7f8cc5fc9700 1 --2- 172.21.15.81:0/2952688691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8cc0157ca0 0x7f8cc00c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.527+0000 7f8cc5fc9700 1 --2- 172.21.15.81:0/2952688691 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f8cac066f30 0x7f8cac0693e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.527+0000 7f8cc5fc9700 1 --2- 172.21.15.81:0/2952688691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8cc006d120 0x7f8cc0145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.527+0000 7f8cc5fc9700 1 --2- 172.21.15.81:0/2952688691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cc01578d0 0x7f8cc00b3ba0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.527+0000 7f8cc5fc9700 1 -- 172.21.15.81:0/2952688691 >> 172.21.15.81:0/2952688691 conn(0x7f8cc006bb90 msgr2=0x7f8cc01548a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:19.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.527+0000 7f8cc5fc9700 1 -- 172.21.15.81:0/2952688691 shutdown_connections 2023-10-07T08:54:19.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.527+0000 7f8cc5fc9700 1 -- 172.21.15.81:0/2952688691 wait complete. 2023-10-07T08:54:19.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-07T08:54:19.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.656+0000 7f7147161700 1 Processor -- start 2023-10-07T08:54:19.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.656+0000 7f7147161700 1 -- start start 2023-10-07T08:54:19.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f7147161700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71400ace20 0x7f7140159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f7147161700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714006e3d0 con 0x7f7140069860 2023-10-07T08:54:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f7147161700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7140069cf0 con 0x7f71400aca50 2023-10-07T08:54:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f7147161700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7140069fd0 con 0x7f71400ace20 2023-10-07T08:54:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714595e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7140069860 0x7f71400c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33748/0 (socket says 172.21.15.81:33748) 2023-10-07T08:54:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714595e700 1 -- 172.21.15.81:0/342765137 learned_addr learned my addr 172.21.15.81:0/342765137 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f7146960700 1 --2- 172.21.15.81:0/342765137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71400ace20 0x7f7140159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714515d700 1 -- 172.21.15.81:0/342765137 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227916739 0 0) 0x7f714006e3d0 con 0x7f7140069860 2023-10-07T08:54:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714515d700 1 -- 172.21.15.81:0/342765137 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f712c003570 con 0x7f7140069860 2023-10-07T08:54:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714515d700 1 -- 172.21.15.81:0/342765137 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4214679049 0 0) 0x7f712c003570 con 0x7f7140069860 2023-10-07T08:54:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714515d700 1 -- 172.21.15.81:0/342765137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71400ace20 msgr2=0x7f7140159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714515d700 1 --2- 172.21.15.81:0/342765137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71400ace20 0x7f7140159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714515d700 1 -- 172.21.15.81:0/342765137 >> v1:172.21.15.89:6789/0 conn(0x7f71400aca50 legacy=0x7f7140159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714515d700 1 -- 172.21.15.81:0/342765137 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714006a2b0 con 0x7f7140069860 2023-10-07T08:54:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714515d700 1 -- 172.21.15.81:0/342765137 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f7130001470 con 0x7f7140069860 2023-10-07T08:54:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714515d700 1 -- 172.21.15.81:0/342765137 >> v1:172.21.15.81:6789/0 conn(0x7f7140069860 legacy=0x7f71400c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714515d700 1 --2- 172.21.15.81:0/342765137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71400ace20 0x7f712c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714515d700 1 --2- 172.21.15.81:0/342765137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f712c004010 0x7f712c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714515d700 1 --2- 172.21.15.81:0/342765137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712c004d50 0x7f712c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714515d700 1 -- 172.21.15.81:0/342765137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7140069fd0 con 0x7f712c004d50 2023-10-07T08:54:19.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714515d700 1 -- 172.21.15.81:0/342765137 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c00bbf0 con 0x7f712c004010 2023-10-07T08:54:19.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.657+0000 7f714515d700 1 -- 172.21.15.81:0/342765137 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c00bdb0 con 0x7f71400ace20 2023-10-07T08:54:19.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.658+0000 7f7146960700 1 --2- 172.21.15.81:0/342765137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712c004d50 0x7f712c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.658+0000 7f714595e700 1 --2- 172.21.15.81:0/342765137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f712c004010 0x7f712c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.658+0000 7f714615f700 1 --2- 172.21.15.81:0/342765137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71400ace20 0x7f712c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.658+0000 7f7146960700 1 -- 172.21.15.81:0/342765137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71400ace20 msgr2=0x7f712c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:19.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.658+0000 7f7146960700 1 --2- 172.21.15.81:0/342765137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71400ace20 0x7f712c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.658+0000 7f7146960700 1 -- 172.21.15.81:0/342765137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f712c004010 msgr2=0x7f712c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:19.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.658+0000 7f7146960700 1 --2- 172.21.15.81:0/342765137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f712c004010 0x7f712c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.658+0000 7f7146960700 1 -- 172.21.15.81:0/342765137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c003570 con 0x7f712c004d50 2023-10-07T08:54:19.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.658+0000 7f7146960700 1 --2- 172.21.15.81:0/342765137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712c004d50 0x7f712c0051c0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f713c0094d0 tx=0x7f713c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e96be44faf0aff9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:19.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.658+0000 7f714515d700 1 -- 172.21.15.81:0/342765137 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c00ea90 con 0x7f712c004d50 2023-10-07T08:54:19.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.658+0000 7f714515d700 1 -- 172.21.15.81:0/342765137 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c00f040 con 0x7f712c004d50 2023-10-07T08:54:19.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.658+0000 7f714515d700 1 -- 172.21.15.81:0/342765137 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c00ee20 con 0x7f712c004d50 2023-10-07T08:54:19.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.659+0000 7f7147161700 1 -- 172.21.15.81:0/342765137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712c004d50 msgr2=0x7f712c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.659+0000 7f7147161700 1 --2- 172.21.15.81:0/342765137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712c004d50 0x7f712c0051c0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f713c0094d0 tx=0x7f713c00b040 comp rx=0 tx=0).stop 2023-10-07T08:54:19.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.659+0000 7f7146960700 1 -- 172.21.15.81:0/342765137 reap_dead start 2023-10-07T08:54:19.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.659+0000 7f7147161700 1 -- 172.21.15.81:0/342765137 shutdown_connections 2023-10-07T08:54:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.659+0000 7f7147161700 1 -- 172.21.15.81:0/342765137 >> 172.21.15.81:0/342765137 conn(0x7f714006cca0 msgr2=0x7f714006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.659+0000 7f7147161700 1 -- 172.21.15.81:0/342765137 shutdown_connections 2023-10-07T08:54:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.659+0000 7f7147161700 1 -- 172.21.15.81:0/342765137 wait complete. 2023-10-07T08:54:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.660+0000 7f7147161700 1 Processor -- start 2023-10-07T08:54:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.660+0000 7f7147161700 1 -- start start 2023-10-07T08:54:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.660+0000 7f7147161700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712c004d50 0x7f71400ad300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.660+0000 7f7147161700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f714015e180 0x7f714016b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.660+0000 7f7147161700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71401523a0 0x7f71400af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.660+0000 7f7147161700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71400ce060 con 0x7f712c004d50 2023-10-07T08:54:19.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.660+0000 7f7147161700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71400cb430 con 0x7f714015e180 2023-10-07T08:54:19.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.660+0000 7f7147161700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71400ad840 con 0x7f71401523a0 2023-10-07T08:54:19.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f714615f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712c004d50 0x7f71400ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f714615f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712c004d50 0x7f71400ad300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56076/0 (socket says 172.21.15.81:56076) 2023-10-07T08:54:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f714615f700 1 -- 172.21.15.81:0/577456337 learned_addr learned my addr 172.21.15.81:0/577456337 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f714595e700 1 --2- 172.21.15.81:0/577456337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f714015e180 0x7f714016b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f714615f700 1 -- 172.21.15.81:0/577456337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71401523a0 msgr2=0x7f71400af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f7146960700 1 --2- 172.21.15.81:0/577456337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71401523a0 0x7f71400af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f714615f700 1 --2- 172.21.15.81:0/577456337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71401523a0 0x7f71400af430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f714615f700 1 -- 172.21.15.81:0/577456337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f714015e180 msgr2=0x7f714016b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f714615f700 1 --2- 172.21.15.81:0/577456337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f714015e180 0x7f714016b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f714615f700 1 -- 172.21.15.81:0/577456337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714016b5c0 con 0x7f712c004d50 2023-10-07T08:54:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f714595e700 1 --2- 172.21.15.81:0/577456337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f714015e180 0x7f714016b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f714615f700 1 --2- 172.21.15.81:0/577456337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712c004d50 0x7f71400ad300 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f7138002980 tx=0x7f7138007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f71367fc700 1 -- 172.21.15.81:0/577456337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713800f8d0 con 0x7f712c004d50 2023-10-07T08:54:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f71367fc700 1 -- 172.21.15.81:0/577456337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713800fa30 con 0x7f712c004d50 2023-10-07T08:54:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f71367fc700 1 -- 172.21.15.81:0/577456337 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713800fdf0 con 0x7f712c004d50 2023-10-07T08:54:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f7147161700 1 -- 172.21.15.81:0/577456337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714015e680 con 0x7f712c004d50 2023-10-07T08:54:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.661+0000 7f7147161700 1 -- 172.21.15.81:0/577456337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71400cb960 con 0x7f712c004d50 2023-10-07T08:54:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.662+0000 7f7147161700 1 -- 172.21.15.81:0/577456337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71400684e0 con 0x7f712c004d50 2023-10-07T08:54:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.662+0000 7f71367fc700 1 -- 172.21.15.81:0/577456337 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7138013600 con 0x7f712c004d50 2023-10-07T08:54:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.663+0000 7f71367fc700 1 --2- 172.21.15.81:0/577456337 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7124066f30 0x7f71240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.663+0000 7f714595e700 1 --2- 172.21.15.81:0/577456337 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7124066f30 0x7f71240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.663+0000 7f71367fc700 1 -- 172.21.15.81:0/577456337 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f71380849b0 con 0x7f712c004d50 2023-10-07T08:54:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.663+0000 7f714595e700 1 --2- 172.21.15.81:0/577456337 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7124066f30 0x7f71240693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f71400af160 tx=0x7f7130009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.667+0000 7f71367fc700 1 -- 172.21.15.81:0/577456337 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7138051c20 con 0x7f712c004d50 2023-10-07T08:54:19.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.849+0000 7f7147161700 1 -- 172.21.15.81:0/577456337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7140071b10 con 0x7f712c004d50 2023-10-07T08:54:19.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.850+0000 7f71367fc700 1 -- 172.21.15.81:0/577456337 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v193) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7138055240 con 0x7f712c004d50 2023-10-07T08:54:19.851 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-07T08:54:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.851+0000 7f7147161700 1 -- 172.21.15.81:0/577456337 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7124066f30 msgr2=0x7f71240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.851+0000 7f7147161700 1 --2- 172.21.15.81:0/577456337 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7124066f30 0x7f71240693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f71400af160 tx=0x7f7130009040 comp rx=0 tx=0).stop 2023-10-07T08:54:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.851+0000 7f7147161700 1 -- 172.21.15.81:0/577456337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712c004d50 msgr2=0x7f71400ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.851+0000 7f7147161700 1 --2- 172.21.15.81:0/577456337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712c004d50 0x7f71400ad300 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f7138002980 tx=0x7f7138007d30 comp rx=0 tx=0).stop 2023-10-07T08:54:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.851+0000 7f7147161700 1 -- 172.21.15.81:0/577456337 shutdown_connections 2023-10-07T08:54:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.851+0000 7f7147161700 1 --2- 172.21.15.81:0/577456337 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f7124066f30 0x7f71240693e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.851+0000 7f7147161700 1 --2- 172.21.15.81:0/577456337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71401523a0 0x7f71400af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.851+0000 7f7147161700 1 --2- 172.21.15.81:0/577456337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712c004d50 0x7f71400ad300 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.851+0000 7f7147161700 1 --2- 172.21.15.81:0/577456337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f714015e180 0x7f714016b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.851+0000 7f7147161700 1 -- 172.21.15.81:0/577456337 >> 172.21.15.81:0/577456337 conn(0x7f714006cca0 msgr2=0x7f7140153130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.852+0000 7f7147161700 1 -- 172.21.15.81:0/577456337 shutdown_connections 2023-10-07T08:54:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.852+0000 7f7147161700 1 -- 172.21.15.81:0/577456337 wait complete. 2023-10-07T08:54:19.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-07T08:54:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.980+0000 7fa14eff8700 1 Processor -- start 2023-10-07T08:54:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.980+0000 7fa14eff8700 1 -- start start 2023-10-07T08:54:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.981+0000 7fa14eff8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1481578d0 0x7fa1480cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.981+0000 7fa14eff8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa14806d120 0x7fa14806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.981+0000 7fa14eff8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa14806dac0 con 0x7fa148157ca0 2023-10-07T08:54:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.981+0000 7fa14eff8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1480d07c0 con 0x7fa14806d120 2023-10-07T08:54:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.981+0000 7fa14eff8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480cfbb0 con 0x7fa1481578d0 2023-10-07T08:54:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.981+0000 7fa14d595700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa14806d120 0x7fa14806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.981+0000 7fa14cd94700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1481578d0 0x7fa1480cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.981+0000 7fa147fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa148157ca0 0x7fa14815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:56950/0 (socket says 172.21.15.81:56950) 2023-10-07T08:54:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.981+0000 7fa14d595700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa14806d120 0x7fa14806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:52246/0 (socket says 172.21.15.81:52246) 2023-10-07T08:54:19.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.981+0000 7fa147fff700 1 -- 172.21.15.81:0/1575356689 learned_addr learned my addr 172.21.15.81:0/1575356689 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:19.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.982+0000 7fa14cd94700 1 -- 172.21.15.81:0/1575356689 >> v2:172.21.15.89:3300/0 conn(0x7fa14806d120 msgr2=0x7fa14806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:19.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.982+0000 7fa14cd94700 1 --2- 172.21.15.81:0/1575356689 >> v2:172.21.15.89:3300/0 conn(0x7fa14806d120 0x7fa14806d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.982+0000 7fa14cd94700 1 -- 172.21.15.81:0/1575356689 >> v1:172.21.15.89:6789/0 conn(0x7fa148157ca0 legacy=0x7fa14815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.982+0000 7fa14cd94700 1 -- 172.21.15.81:0/1575356689 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1480cfe90 con 0x7fa1481578d0 2023-10-07T08:54:19.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.982+0000 7fa14cd94700 1 --2- 172.21.15.81:0/1575356689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1481578d0 0x7fa1480cf4f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa1380098e0 tx=0x7fa1380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dfc22b690a6c2d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:19.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.982+0000 7fa1477fe700 1 -- 172.21.15.81:0/1575356689 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13800b640 con 0x7fa1481578d0 2023-10-07T08:54:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.982+0000 7fa1477fe700 1 -- 172.21.15.81:0/1575356689 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13800b7a0 con 0x7fa1481578d0 2023-10-07T08:54:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.982+0000 7fa1477fe700 1 -- 172.21.15.81:0/1575356689 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13800bb40 con 0x7fa1481578d0 2023-10-07T08:54:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.983+0000 7fa14eff8700 1 -- 172.21.15.81:0/1575356689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1481578d0 msgr2=0x7fa1480cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.983+0000 7fa14eff8700 1 --2- 172.21.15.81:0/1575356689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1481578d0 0x7fa1480cf4f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa1380098e0 tx=0x7fa1380091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.983+0000 7fa14eff8700 1 -- 172.21.15.81:0/1575356689 shutdown_connections 2023-10-07T08:54:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.983+0000 7fa14eff8700 1 --2- 172.21.15.81:0/1575356689 >> v2:172.21.15.89:3300/0 conn(0x7fa14806d120 0x7fa14806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.983+0000 7fa14eff8700 1 --2- 172.21.15.81:0/1575356689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1481578d0 0x7fa1480cf4f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.983+0000 7fa14eff8700 1 -- 172.21.15.81:0/1575356689 >> 172.21.15.81:0/1575356689 conn(0x7fa14806bb90 msgr2=0x7fa14806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:19.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.983+0000 7fa14eff8700 1 -- 172.21.15.81:0/1575356689 shutdown_connections 2023-10-07T08:54:19.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.983+0000 7fa14eff8700 1 -- 172.21.15.81:0/1575356689 wait complete. 2023-10-07T08:54:19.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.984+0000 7fa14eff8700 1 Processor -- start 2023-10-07T08:54:19.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.984+0000 7fa14eff8700 1 -- start start 2023-10-07T08:54:19.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14eff8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa14806d120 0x7fa148153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14eff8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1481578d0 0x7fa14816ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14eff8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa148157ca0 0x7fa1480b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14eff8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480c6d20 con 0x7fa14806d120 2023-10-07T08:54:19.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14eff8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480c5e30 con 0x7fa1481578d0 2023-10-07T08:54:19.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14eff8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480c6110 con 0x7fa148157ca0 2023-10-07T08:54:19.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14cd94700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa14806d120 0x7fa148153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14cd94700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa14806d120 0x7fa148153af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56088/0 (socket says 172.21.15.81:56088) 2023-10-07T08:54:19.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14cd94700 1 -- 172.21.15.81:0/16949103 learned_addr learned my addr 172.21.15.81:0/16949103 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:19.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa147fff700 1 --2- 172.21.15.81:0/16949103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1481578d0 0x7fa14816ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14d595700 1 --2- 172.21.15.81:0/16949103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa148157ca0 0x7fa1480b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14cd94700 1 -- 172.21.15.81:0/16949103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa148157ca0 msgr2=0x7fa1480b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14cd94700 1 --2- 172.21.15.81:0/16949103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa148157ca0 0x7fa1480b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14cd94700 1 -- 172.21.15.81:0/16949103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1481578d0 msgr2=0x7fa14816ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14cd94700 1 --2- 172.21.15.81:0/16949103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1481578d0 0x7fa14816ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14cd94700 1 -- 172.21.15.81:0/16949103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa138009420 con 0x7fa14806d120 2023-10-07T08:54:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14cd94700 1 --2- 172.21.15.81:0/16949103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa14806d120 0x7fa148153af0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fa148068330 tx=0x7fa138017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa144ff9700 1 -- 172.21.15.81:0/16949103 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13801bc40 con 0x7fa14806d120 2023-10-07T08:54:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa144ff9700 1 -- 172.21.15.81:0/16949103 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13801bda0 con 0x7fa14806d120 2023-10-07T08:54:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14eff8700 1 -- 172.21.15.81:0/16949103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1480c63f0 con 0x7fa14806d120 2023-10-07T08:54:19.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa144ff9700 1 -- 172.21.15.81:0/16949103 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138011670 con 0x7fa14806d120 2023-10-07T08:54:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.985+0000 7fa14eff8700 1 -- 172.21.15.81:0/16949103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1480c69b0 con 0x7fa14806d120 2023-10-07T08:54:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.986+0000 7fa14eff8700 1 -- 172.21.15.81:0/16949103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa148067ac0 con 0x7fa14806d120 2023-10-07T08:54:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.987+0000 7fa144ff9700 1 -- 172.21.15.81:0/16949103 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa138011a20 con 0x7fa14806d120 2023-10-07T08:54:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.987+0000 7fa144ff9700 1 --2- 172.21.15.81:0/16949103 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa134066f30 0x7fa1340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.987+0000 7fa144ff9700 1 -- 172.21.15.81:0/16949103 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa138085ac0 con 0x7fa14806d120 2023-10-07T08:54:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.987+0000 7fa147fff700 1 --2- 172.21.15.81:0/16949103 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa134066f30 0x7fa1340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:19.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.987+0000 7fa147fff700 1 --2- 172.21.15.81:0/16949103 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa134066f30 0x7fa1340693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa14815a160 tx=0x7fa13c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:19.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:19.991+0000 7fa144ff9700 1 -- 172.21.15.81:0/16949103 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa138052d30 con 0x7fa14806d120 2023-10-07T08:54:20.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.176+0000 7fa14eff8700 1 -- 172.21.15.81:0/16949103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa1480d0170 con 0x7fa14806d120 2023-10-07T08:54:20.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.176+0000 7fa144ff9700 1 -- 172.21.15.81:0/16949103 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v193) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa138056350 con 0x7fa14806d120 2023-10-07T08:54:20.178 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-07T08:54:20.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.178+0000 7fa14eff8700 1 -- 172.21.15.81:0/16949103 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa134066f30 msgr2=0x7fa1340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:20.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.178+0000 7fa14eff8700 1 --2- 172.21.15.81:0/16949103 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa134066f30 0x7fa1340693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa14815a160 tx=0x7fa13c009040 comp rx=0 tx=0).stop 2023-10-07T08:54:20.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.178+0000 7fa14eff8700 1 -- 172.21.15.81:0/16949103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa14806d120 msgr2=0x7fa148153af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:20.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.178+0000 7fa14eff8700 1 --2- 172.21.15.81:0/16949103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa14806d120 0x7fa148153af0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fa148068330 tx=0x7fa138017000 comp rx=0 tx=0).stop 2023-10-07T08:54:20.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.178+0000 7fa14eff8700 1 -- 172.21.15.81:0/16949103 shutdown_connections 2023-10-07T08:54:20.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.178+0000 7fa14eff8700 1 --2- 172.21.15.81:0/16949103 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa134066f30 0x7fa1340693e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.178+0000 7fa14eff8700 1 --2- 172.21.15.81:0/16949103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa148157ca0 0x7fa1480b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.178+0000 7fa14eff8700 1 --2- 172.21.15.81:0/16949103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa14806d120 0x7fa148153af0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.178+0000 7fa14eff8700 1 --2- 172.21.15.81:0/16949103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1481578d0 0x7fa14816ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.178+0000 7fa14eff8700 1 -- 172.21.15.81:0/16949103 >> 172.21.15.81:0/16949103 conn(0x7fa14806bb90 msgr2=0x7fa148068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:20.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.178+0000 7fa14eff8700 1 -- 172.21.15.81:0/16949103 shutdown_connections 2023-10-07T08:54:20.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.178+0000 7fa14eff8700 1 -- 172.21.15.81:0/16949103 wait complete. 2023-10-07T08:54:20.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:54:20.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.303+0000 7fba7e201700 1 Processor -- start 2023-10-07T08:54:20.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.303+0000 7fba7e201700 1 -- start start 2023-10-07T08:54:20.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.304+0000 7fba7e201700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fba78159c90 0x7fba7815d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.304+0000 7fba7e201700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba780686e0 0x7fba780ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.304+0000 7fba7e201700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fba780b2b20 0x7fba780b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.304+0000 7fba7e201700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba780b34e0 con 0x7fba780b2b20 2023-10-07T08:54:20.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.304+0000 7fba7e201700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7815e830 con 0x7fba78159c90 2023-10-07T08:54:20.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.304+0000 7fba7e201700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba780cb3f0 con 0x7fba780686e0 2023-10-07T08:54:20.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.304+0000 7fba7da00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fba780b2b20 0x7fba780b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:20.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.304+0000 7fba7da00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fba780b2b20 0x7fba780b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56092/0 (socket says 172.21.15.81:56092) 2023-10-07T08:54:20.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.304+0000 7fba7da00700 1 -- 172.21.15.81:0/2276871853 learned_addr learned my addr 172.21.15.81:0/2276871853 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:20.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.304+0000 7fba7d1ff700 1 --2- 172.21.15.81:0/2276871853 >> v2:172.21.15.89:3300/0 conn(0x7fba78159c90 0x7fba7815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:20.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.304+0000 7fba7c9fe700 1 --2- 172.21.15.81:0/2276871853 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba780686e0 0x7fba780ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:20.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.305+0000 7fba7da00700 1 -- 172.21.15.81:0/2276871853 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba780686e0 msgr2=0x7fba780ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:20.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.305+0000 7fba7da00700 1 --2- 172.21.15.81:0/2276871853 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba780686e0 0x7fba780ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.305+0000 7fba7da00700 1 -- 172.21.15.81:0/2276871853 >> v2:172.21.15.89:3300/0 conn(0x7fba78159c90 msgr2=0x7fba7815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:20.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.305+0000 7fba7da00700 1 --2- 172.21.15.81:0/2276871853 >> v2:172.21.15.89:3300/0 conn(0x7fba78159c90 0x7fba7815d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.305+0000 7fba7da00700 1 -- 172.21.15.81:0/2276871853 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba780caf60 con 0x7fba780b2b20 2023-10-07T08:54:20.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.305+0000 7fba7d1ff700 1 --2- 172.21.15.81:0/2276871853 >> v2:172.21.15.89:3300/0 conn(0x7fba78159c90 0x7fba7815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:20.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.305+0000 7fba7da00700 1 --2- 172.21.15.81:0/2276871853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780b2b20 0x7fba780b2fa0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fba78068270 tx=0x7fba70009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6d185620ff656b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:20.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.305+0000 7fba6ffff700 1 -- 172.21.15.81:0/2276871853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7000e070 con 0x7fba780b2b20 2023-10-07T08:54:20.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.305+0000 7fba6ffff700 1 -- 172.21.15.81:0/2276871853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7000ba50 con 0x7fba780b2b20 2023-10-07T08:54:20.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.305+0000 7fba6ffff700 1 -- 172.21.15.81:0/2276871853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba700092e0 con 0x7fba780b2b20 2023-10-07T08:54:20.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.305+0000 7fba7e201700 1 -- 172.21.15.81:0/2276871853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780b2b20 msgr2=0x7fba780b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:20.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.305+0000 7fba7e201700 1 --2- 172.21.15.81:0/2276871853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780b2b20 0x7fba780b2fa0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fba78068270 tx=0x7fba70009840 comp rx=0 tx=0).stop 2023-10-07T08:54:20.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.306+0000 7fba7e201700 1 -- 172.21.15.81:0/2276871853 shutdown_connections 2023-10-07T08:54:20.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.306+0000 7fba7e201700 1 --2- 172.21.15.81:0/2276871853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780b2b20 0x7fba780b2fa0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.306+0000 7fba7e201700 1 --2- 172.21.15.81:0/2276871853 >> v2:172.21.15.89:3300/0 conn(0x7fba78159c90 0x7fba7815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.306+0000 7fba7e201700 1 --2- 172.21.15.81:0/2276871853 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba780686e0 0x7fba780ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.306+0000 7fba7e201700 1 -- 172.21.15.81:0/2276871853 >> 172.21.15.81:0/2276871853 conn(0x7fba7806bb90 msgr2=0x7fba7806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:20.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.306+0000 7fba7e201700 1 -- 172.21.15.81:0/2276871853 shutdown_connections 2023-10-07T08:54:20.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.306+0000 7fba7e201700 1 -- 172.21.15.81:0/2276871853 wait complete. 2023-10-07T08:54:20.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.307+0000 7fba7e201700 1 Processor -- start 2023-10-07T08:54:20.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.307+0000 7fba7e201700 1 -- start start 2023-10-07T08:54:20.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7e201700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780686e0 0x7fba780cea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7e201700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba780b2b20 0x7fba780ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7e201700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba78159c90 0x7fba78152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7e201700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba780b5560 con 0x7fba780686e0 2023-10-07T08:54:20.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7e201700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba780b63c0 con 0x7fba780b2b20 2023-10-07T08:54:20.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7e201700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba780b57b0 con 0x7fba78159c90 2023-10-07T08:54:20.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7d1ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780686e0 0x7fba780cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:20.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7d1ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780686e0 0x7fba780cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56106/0 (socket says 172.21.15.81:56106) 2023-10-07T08:54:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7d1ff700 1 -- 172.21.15.81:0/1752456975 learned_addr learned my addr 172.21.15.81:0/1752456975 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7d1ff700 1 -- 172.21.15.81:0/1752456975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba78159c90 msgr2=0x7fba78152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7d1ff700 1 --2- 172.21.15.81:0/1752456975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba78159c90 0x7fba78152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7d1ff700 1 -- 172.21.15.81:0/1752456975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba780b2b20 msgr2=0x7fba780ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7d1ff700 1 --2- 172.21.15.81:0/1752456975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba780b2b20 0x7fba780ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7d1ff700 1 -- 172.21.15.81:0/1752456975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba70009ae0 con 0x7fba780686e0 2023-10-07T08:54:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7d1ff700 1 --2- 172.21.15.81:0/1752456975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780686e0 0x7fba780cea40 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fba7400d890 tx=0x7fba74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba6d7fa700 1 -- 172.21.15.81:0/1752456975 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7400b600 con 0x7fba780686e0 2023-10-07T08:54:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba6d7fa700 1 -- 172.21.15.81:0/1752456975 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7400b760 con 0x7fba780686e0 2023-10-07T08:54:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7e201700 1 -- 172.21.15.81:0/1752456975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba780b5a90 con 0x7fba780686e0 2023-10-07T08:54:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba6d7fa700 1 -- 172.21.15.81:0/1752456975 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7400bb00 con 0x7fba780686e0 2023-10-07T08:54:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.308+0000 7fba7e201700 1 -- 172.21.15.81:0/1752456975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba780b6050 con 0x7fba780686e0 2023-10-07T08:54:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.309+0000 7fba7e201700 1 -- 172.21.15.81:0/1752456975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7806fbe0 con 0x7fba780686e0 2023-10-07T08:54:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.310+0000 7fba6d7fa700 1 -- 172.21.15.81:0/1752456975 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba74014430 con 0x7fba780686e0 2023-10-07T08:54:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.310+0000 7fba6d7fa700 1 --2- 172.21.15.81:0/1752456975 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fba5c066f30 0x7fba5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.310+0000 7fba6d7fa700 1 -- 172.21.15.81:0/1752456975 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba74084980 con 0x7fba780686e0 2023-10-07T08:54:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.310+0000 7fba7c9fe700 1 --2- 172.21.15.81:0/1752456975 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fba5c066f30 0x7fba5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.310+0000 7fba7c9fe700 1 --2- 172.21.15.81:0/1752456975 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fba5c066f30 0x7fba5c0693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fba78158ad0 tx=0x7fba68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:20.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.314+0000 7fba6d7fa700 1 -- 172.21.15.81:0/1752456975 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba74051ca0 con 0x7fba780686e0 2023-10-07T08:54:20.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.541+0000 7fba7e201700 1 -- 172.21.15.81:0/1752456975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba78071b10 con 0x7fba780686e0 2023-10-07T08:54:20.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.542+0000 7fba6d7fa700 1 -- 172.21.15.81:0/1752456975 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fba740552c0 con 0x7fba780686e0 2023-10-07T08:54:20.543 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:20.543 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1601080758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1601080758},{"type":"v1","addr":"172.21.15.81:6837","nonce":1601080758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2709611313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2709611313},{"type":"v1","addr":"172.21.15.89:6835","nonce":2709611313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/3085029167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3085029167},{"type":"v1","addr":"172.21.15.89:6834","nonce":3085029167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:53:48.496016+0000","modified":"2023-10-07T08:53:52.345717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6836/2531199109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2531199109},{"type":"v1","addr":"172.21.15.81:6836","nonce":2531199109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-07T08:54:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.544+0000 7fba7e201700 1 -- 172.21.15.81:0/1752456975 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fba5c066f30 msgr2=0x7fba5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.544+0000 7fba7e201700 1 --2- 172.21.15.81:0/1752456975 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fba5c066f30 0x7fba5c0693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fba78158ad0 tx=0x7fba68008040 comp rx=0 tx=0).stop 2023-10-07T08:54:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.544+0000 7fba7e201700 1 -- 172.21.15.81:0/1752456975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780686e0 msgr2=0x7fba780cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.544+0000 7fba7e201700 1 --2- 172.21.15.81:0/1752456975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780686e0 0x7fba780cea40 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fba7400d890 tx=0x7fba74008040 comp rx=0 tx=0).stop 2023-10-07T08:54:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.544+0000 7fba7e201700 1 -- 172.21.15.81:0/1752456975 shutdown_connections 2023-10-07T08:54:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.544+0000 7fba7e201700 1 --2- 172.21.15.81:0/1752456975 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fba5c066f30 0x7fba5c0693e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.544+0000 7fba7e201700 1 --2- 172.21.15.81:0/1752456975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba78159c90 0x7fba78152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.544+0000 7fba7e201700 1 --2- 172.21.15.81:0/1752456975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780686e0 0x7fba780cea40 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.544+0000 7fba7e201700 1 --2- 172.21.15.81:0/1752456975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba780b2b20 0x7fba780ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.544+0000 7fba7e201700 1 -- 172.21.15.81:0/1752456975 >> 172.21.15.81:0/1752456975 conn(0x7fba7806bb90 msgr2=0x7fba78153480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:20.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.544+0000 7fba7e201700 1 -- 172.21.15.81:0/1752456975 shutdown_connections 2023-10-07T08:54:20.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.544+0000 7fba7e201700 1 -- 172.21.15.81:0/1752456975 wait complete. 2023-10-07T08:54:20.547 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-07T08:54:20.557 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:54:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.670+0000 7f3cf39bb700 1 Processor -- start 2023-10-07T08:54:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.670+0000 7f3cf39bb700 1 -- start start 2023-10-07T08:54:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3cf39bb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3cec157ca0 0x7f3cec0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3cf39bb700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cec0d07c0 con 0x7f3cec06d120 2023-10-07T08:54:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3cf39bb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cec0cfbb0 con 0x7f3cec1578d0 2023-10-07T08:54:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3cf39bb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cec0cfe90 con 0x7f3cec157ca0 2023-10-07T08:54:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3cf1f58700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3cec06d120 0x7f3cec06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33762/0 (socket says 172.21.15.81:33762) 2023-10-07T08:54:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3cf1f58700 1 -- 172.21.15.81:0/737706189 learned_addr learned my addr 172.21.15.81:0/737706189 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3cf0f56700 1 --2- 172.21.15.81:0/737706189 >> v2:172.21.15.89:3300/0 conn(0x7f3cec157ca0 0x7f3cec0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3ce3fff700 1 -- 172.21.15.81:0/737706189 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4099731079 0 0) 0x7f3cec0d07c0 con 0x7f3cec06d120 2023-10-07T08:54:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3ce3fff700 1 -- 172.21.15.81:0/737706189 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cd8003570 con 0x7f3cec06d120 2023-10-07T08:54:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3ce3fff700 1 -- 172.21.15.81:0/737706189 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 844197030 0 0) 0x7f3cd8003570 con 0x7f3cec06d120 2023-10-07T08:54:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3ce3fff700 1 -- 172.21.15.81:0/737706189 >> v2:172.21.15.89:3300/0 conn(0x7f3cec157ca0 msgr2=0x7f3cec0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3ce3fff700 1 --2- 172.21.15.81:0/737706189 >> v2:172.21.15.89:3300/0 conn(0x7f3cec157ca0 0x7f3cec0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3ce3fff700 1 -- 172.21.15.81:0/737706189 >> v1:172.21.15.89:6789/0 conn(0x7f3cec1578d0 legacy=0x7f3cec15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3ce3fff700 1 -- 172.21.15.81:0/737706189 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec0d0170 con 0x7f3cec06d120 2023-10-07T08:54:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3ce3fff700 1 -- 172.21.15.81:0/737706189 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f3ce40017f0 con 0x7f3cec06d120 2023-10-07T08:54:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3ce3fff700 1 -- 172.21.15.81:0/737706189 >> v1:172.21.15.81:6789/0 conn(0x7f3cec06d120 legacy=0x7f3cec06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3ce3fff700 1 --2- 172.21.15.81:0/737706189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cd8003a60 0x7f3cd8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3ce3fff700 1 --2- 172.21.15.81:0/737706189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd8004810 0x7f3cd8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3ce3fff700 1 --2- 172.21.15.81:0/737706189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cd80051c0 0x7f3cd800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3ce3fff700 1 -- 172.21.15.81:0/737706189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec0cfe90 con 0x7f3cd8004810 2023-10-07T08:54:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3ce3fff700 1 -- 172.21.15.81:0/737706189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd800c0d0 con 0x7f3cd80051c0 2023-10-07T08:54:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3ce3fff700 1 -- 172.21.15.81:0/737706189 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd800c290 con 0x7f3cd8003a60 2023-10-07T08:54:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.671+0000 7f3cf0f56700 1 --2- 172.21.15.81:0/737706189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd8004810 0x7f3cd8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.672+0000 7f3cf1f58700 1 --2- 172.21.15.81:0/737706189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cd80051c0 0x7f3cd800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.672+0000 7f3cf1757700 1 --2- 172.21.15.81:0/737706189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cd8003a60 0x7f3cd8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.672+0000 7f3cf0f56700 1 -- 172.21.15.81:0/737706189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cd8003a60 msgr2=0x7f3cd8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.672+0000 7f3cf0f56700 1 --2- 172.21.15.81:0/737706189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cd8003a60 0x7f3cd8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.672+0000 7f3cf0f56700 1 -- 172.21.15.81:0/737706189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cd80051c0 msgr2=0x7f3cd800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.672+0000 7f3cf0f56700 1 --2- 172.21.15.81:0/737706189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cd80051c0 0x7f3cd800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.672+0000 7f3cf0f56700 1 -- 172.21.15.81:0/737706189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd8003570 con 0x7f3cd8004810 2023-10-07T08:54:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.672+0000 7f3cf1f58700 1 -- 172.21.15.81:0/737706189 reap_dead start 2023-10-07T08:54:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.672+0000 7f3cf0f56700 1 --2- 172.21.15.81:0/737706189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd8004810 0x7f3cd8004c80 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f3cec1580c0 tx=0x7f3cdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5249577f52b333 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.672+0000 7f3ce3fff700 1 -- 172.21.15.81:0/737706189 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00e710 con 0x7f3cd8004810 2023-10-07T08:54:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.672+0000 7f3ce3fff700 1 -- 172.21.15.81:0/737706189 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc00e870 con 0x7f3cd8004810 2023-10-07T08:54:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.672+0000 7f3ce3fff700 1 -- 172.21.15.81:0/737706189 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00ec30 con 0x7f3cd8004810 2023-10-07T08:54:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.672+0000 7f3cf39bb700 1 -- 172.21.15.81:0/737706189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd8004810 msgr2=0x7f3cd8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.672+0000 7f3cf39bb700 1 --2- 172.21.15.81:0/737706189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd8004810 0x7f3cd8004c80 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f3cec1580c0 tx=0x7f3cdc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.673+0000 7f3cf39bb700 1 -- 172.21.15.81:0/737706189 shutdown_connections 2023-10-07T08:54:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.673+0000 7f3cf39bb700 1 --2- 172.21.15.81:0/737706189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd8004810 0x7f3cd8004c80 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.673+0000 7f3cf39bb700 1 -- 172.21.15.81:0/737706189 >> 172.21.15.81:0/737706189 conn(0x7f3cec06bb90 msgr2=0x7f3cec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.673+0000 7f3cf39bb700 1 -- 172.21.15.81:0/737706189 shutdown_connections 2023-10-07T08:54:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.673+0000 7f3cf39bb700 1 -- 172.21.15.81:0/737706189 wait complete. 2023-10-07T08:54:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.674+0000 7f3cf39bb700 1 Processor -- start 2023-10-07T08:54:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.674+0000 7f3cf39bb700 1 -- start start 2023-10-07T08:54:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf39bb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd8004810 0x7f3cec154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf39bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cec0c8470 0x7f3cec0c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf39bb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cec0cad60 0x7f3cec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf39bb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec0c6f80 con 0x7f3cd8004810 2023-10-07T08:54:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf39bb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec0c6370 con 0x7f3cec0cad60 2023-10-07T08:54:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf39bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec0c6650 con 0x7f3cec0c8470 2023-10-07T08:54:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf1757700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd8004810 0x7f3cec154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf1757700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd8004810 0x7f3cec154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56126/0 (socket says 172.21.15.81:56126) 2023-10-07T08:54:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf1757700 1 -- 172.21.15.81:0/243534178 learned_addr learned my addr 172.21.15.81:0/243534178 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf1f58700 1 --2- 172.21.15.81:0/243534178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cec0cad60 0x7f3cec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf0f56700 1 --2- 172.21.15.81:0/243534178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cec0c8470 0x7f3cec0c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf1757700 1 -- 172.21.15.81:0/243534178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cec0c8470 msgr2=0x7f3cec0c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf1757700 1 --2- 172.21.15.81:0/243534178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cec0c8470 0x7f3cec0c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf1757700 1 -- 172.21.15.81:0/243534178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cec0cad60 msgr2=0x7f3cec068930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf1757700 1 --2- 172.21.15.81:0/243534178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cec0cad60 0x7f3cec068930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf1757700 1 -- 172.21.15.81:0/243534178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec0c6930 con 0x7f3cd8004810 2023-10-07T08:54:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf0f56700 1 --2- 172.21.15.81:0/243534178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cec0c8470 0x7f3cec0c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf1f58700 1 --2- 172.21.15.81:0/243534178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cec0cad60 0x7f3cec068930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf1757700 1 --2- 172.21.15.81:0/243534178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd8004810 0x7f3cec154dd0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8002950 tx=0x7f3ce8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3ce17fa700 1 -- 172.21.15.81:0/243534178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8002e90 con 0x7f3cd8004810 2023-10-07T08:54:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3ce17fa700 1 -- 172.21.15.81:0/243534178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce800f8d0 con 0x7f3cd8004810 2023-10-07T08:54:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf39bb700 1 -- 172.21.15.81:0/243534178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cec0c6c10 con 0x7f3cd8004810 2023-10-07T08:54:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3ce17fa700 1 -- 172.21.15.81:0/243534178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce800fc90 con 0x7f3cd8004810 2023-10-07T08:54:20.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.675+0000 7f3cf39bb700 1 -- 172.21.15.81:0/243534178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cec0c6060 con 0x7f3cd8004810 2023-10-07T08:54:20.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.676+0000 7f3cf39bb700 1 -- 172.21.15.81:0/243534178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cec067ac0 con 0x7f3cd8004810 2023-10-07T08:54:20.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.677+0000 7f3ce17fa700 1 -- 172.21.15.81:0/243534178 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ce8006a30 con 0x7f3cd8004810 2023-10-07T08:54:20.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.677+0000 7f3ce17fa700 1 --2- 172.21.15.81:0/243534178 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cd0066f30 0x7f3cd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.677+0000 7f3ce17fa700 1 -- 172.21.15.81:0/243534178 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ce8084530 con 0x7f3cd8004810 2023-10-07T08:54:20.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.677+0000 7f3cf0f56700 1 --2- 172.21.15.81:0/243534178 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cd0066f30 0x7f3cd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:20.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.677+0000 7f3cf0f56700 1 --2- 172.21.15.81:0/243534178 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cd0066f30 0x7f3cd00693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0b6c80 tx=0x7f3cdc01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:20.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.681+0000 7f3ce17fa700 1 -- 172.21.15.81:0/243534178 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ce80517a0 con 0x7f3cd8004810 2023-10-07T08:54:20.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.865+0000 7f3cf39bb700 1 -- 172.21.15.81:0/243534178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cec0c7260 con 0x7f3cd8004810 2023-10-07T08:54:20.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.866+0000 7f3ce17fa700 1 -- 172.21.15.81:0/243534178 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+15324 (secure 0 0 0) 0x7f3ce8054dc0 con 0x7f3cd8004810 2023-10-07T08:54:20.867 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:20.867 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":193,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:54:13.341950+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:53:46.818809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-07T08:53:47.460436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:54:20.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.868+0000 7f3cf39bb700 1 -- 172.21.15.81:0/243534178 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cd0066f30 msgr2=0x7f3cd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:20.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.868+0000 7f3cf39bb700 1 --2- 172.21.15.81:0/243534178 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cd0066f30 0x7f3cd00693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0b6c80 tx=0x7f3cdc01a000 comp rx=0 tx=0).stop 2023-10-07T08:54:20.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.868+0000 7f3cf39bb700 1 -- 172.21.15.81:0/243534178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd8004810 msgr2=0x7f3cec154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:20.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.868+0000 7f3cf39bb700 1 --2- 172.21.15.81:0/243534178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd8004810 0x7f3cec154dd0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8002950 tx=0x7f3ce8007d30 comp rx=0 tx=0).stop 2023-10-07T08:54:20.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.868+0000 7f3cf39bb700 1 -- 172.21.15.81:0/243534178 shutdown_connections 2023-10-07T08:54:20.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.868+0000 7f3cf39bb700 1 --2- 172.21.15.81:0/243534178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cec0cad60 0x7f3cec068930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.868+0000 7f3cf39bb700 1 --2- 172.21.15.81:0/243534178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd8004810 0x7f3cec154dd0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.868+0000 7f3cf39bb700 1 --2- 172.21.15.81:0/243534178 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3cd0066f30 0x7f3cd00693e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.868+0000 7f3cf39bb700 1 --2- 172.21.15.81:0/243534178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cec0c8470 0x7f3cec0c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:20.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.868+0000 7f3cf39bb700 1 -- 172.21.15.81:0/243534178 >> 172.21.15.81:0/243534178 conn(0x7f3cec06bb90 msgr2=0x7f3cec06bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:20.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.868+0000 7f3cf39bb700 1 -- 172.21.15.81:0/243534178 shutdown_connections 2023-10-07T08:54:20.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.868+0000 7f3cf39bb700 1 -- 172.21.15.81:0/243534178 wait complete. 2023-10-07T08:54:20.881 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T08:54:20.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:54:20.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.993+0000 7efe2831e700 1 Processor -- start 2023-10-07T08:54:20.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.993+0000 7efe2831e700 1 -- start start 2023-10-07T08:54:20.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.994+0000 7efe2831e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efe201578d0 0x7efe200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.994+0000 7efe2831e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20157ca0 0x7efe2015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:20.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.994+0000 7efe2831e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe200d07c0 con 0x7efe2006d120 2023-10-07T08:54:20.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.994+0000 7efe2831e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe200cfbb0 con 0x7efe201578d0 2023-10-07T08:54:20.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.994+0000 7efe2831e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe200cfe90 con 0x7efe20157ca0 2023-10-07T08:54:20.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe268bb700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efe2006d120 0x7efe2015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33776/0 (socket says 172.21.15.81:33776) 2023-10-07T08:54:20.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe268bb700 1 -- 172.21.15.81:0/3785655533 learned_addr learned my addr 172.21.15.81:0/3785655533 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:20.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe260ba700 1 --2- 172.21.15.81:0/3785655533 >> v2:172.21.15.89:3300/0 conn(0x7efe201578d0 0x7efe200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:20.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe258b9700 1 --2- 172.21.15.81:0/3785655533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20157ca0 0x7efe2015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:20.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe250b8700 1 -- 172.21.15.81:0/3785655533 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109309212 0 0) 0x7efe200d07c0 con 0x7efe2006d120 2023-10-07T08:54:20.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe250b8700 1 -- 172.21.15.81:0/3785655533 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe0c003570 con 0x7efe2006d120 2023-10-07T08:54:20.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe250b8700 1 -- 172.21.15.81:0/3785655533 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 884920605 0 0) 0x7efe0c003570 con 0x7efe2006d120 2023-10-07T08:54:20.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe250b8700 1 -- 172.21.15.81:0/3785655533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20157ca0 msgr2=0x7efe2015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe250b8700 1 --2- 172.21.15.81:0/3785655533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20157ca0 0x7efe2015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe250b8700 1 -- 172.21.15.81:0/3785655533 >> v2:172.21.15.89:3300/0 conn(0x7efe201578d0 msgr2=0x7efe200cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe250b8700 1 --2- 172.21.15.81:0/3785655533 >> v2:172.21.15.89:3300/0 conn(0x7efe201578d0 0x7efe200cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe250b8700 1 -- 172.21.15.81:0/3785655533 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe200d0170 con 0x7efe2006d120 2023-10-07T08:54:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe250b8700 1 -- 172.21.15.81:0/3785655533 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7efe18001470 con 0x7efe2006d120 2023-10-07T08:54:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe250b8700 1 -- 172.21.15.81:0/3785655533 >> v1:172.21.15.81:6789/0 conn(0x7efe2006d120 legacy=0x7efe2015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe250b8700 1 --2- 172.21.15.81:0/3785655533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c003a60 0x7efe0c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe250b8700 1 --2- 172.21.15.81:0/3785655533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20157ca0 0x7efe0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe250b8700 1 --2- 172.21.15.81:0/3785655533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe0c004d50 0x7efe0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe250b8700 1 -- 172.21.15.81:0/3785655533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe200cfbb0 con 0x7efe0c003a60 2023-10-07T08:54:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe250b8700 1 -- 172.21.15.81:0/3785655533 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe200cfe90 con 0x7efe0c004d50 2023-10-07T08:54:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe250b8700 1 -- 172.21.15.81:0/3785655533 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c00ba60 con 0x7efe20157ca0 2023-10-07T08:54:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe260ba700 1 --2- 172.21.15.81:0/3785655533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c003a60 0x7efe0c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe258b9700 1 --2- 172.21.15.81:0/3785655533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20157ca0 0x7efe0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.995+0000 7efe268bb700 1 --2- 172.21.15.81:0/3785655533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe0c004d50 0x7efe0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe260ba700 1 -- 172.21.15.81:0/3785655533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20157ca0 msgr2=0x7efe0c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe260ba700 1 --2- 172.21.15.81:0/3785655533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20157ca0 0x7efe0c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe260ba700 1 -- 172.21.15.81:0/3785655533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe0c004d50 msgr2=0x7efe0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe260ba700 1 --2- 172.21.15.81:0/3785655533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe0c004d50 0x7efe0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe260ba700 1 -- 172.21.15.81:0/3785655533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c003570 con 0x7efe0c003a60 2023-10-07T08:54:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe268bb700 1 --2- 172.21.15.81:0/3785655533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe0c004d50 0x7efe0c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe260ba700 1 --2- 172.21.15.81:0/3785655533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c003a60 0x7efe0c003e70 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00e210 tx=0x7efe1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550c59a86774820b server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe250b8700 1 -- 172.21.15.81:0/3785655533 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c00ea60 con 0x7efe0c003a60 2023-10-07T08:54:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe250b8700 1 -- 172.21.15.81:0/3785655533 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c00f040 con 0x7efe0c003a60 2023-10-07T08:54:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe250b8700 1 -- 172.21.15.81:0/3785655533 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c00ee10 con 0x7efe0c003a60 2023-10-07T08:54:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe2831e700 1 -- 172.21.15.81:0/3785655533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c003a60 msgr2=0x7efe0c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe2831e700 1 --2- 172.21.15.81:0/3785655533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c003a60 0x7efe0c003e70 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00e210 tx=0x7efe1c00b040 comp rx=0 tx=0).stop 2023-10-07T08:54:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe268bb700 1 -- 172.21.15.81:0/3785655533 reap_dead start 2023-10-07T08:54:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe2831e700 1 -- 172.21.15.81:0/3785655533 shutdown_connections 2023-10-07T08:54:21.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe2831e700 1 -- 172.21.15.81:0/3785655533 >> 172.21.15.81:0/3785655533 conn(0x7efe2006bb90 msgr2=0x7efe2006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:21.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe2831e700 1 -- 172.21.15.81:0/3785655533 shutdown_connections 2023-10-07T08:54:21.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.996+0000 7efe2831e700 1 -- 172.21.15.81:0/3785655533 wait complete. 2023-10-07T08:54:21.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.997+0000 7efe2831e700 1 Processor -- start 2023-10-07T08:54:21.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.998+0000 7efe2831e700 1 -- start start 2023-10-07T08:54:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.998+0000 7efe2831e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c003a60 0x7efe20148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.998+0000 7efe2831e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe20153a30 0x7efe200b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.998+0000 7efe2831e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20155500 0x7efe20155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.998+0000 7efe2831e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe20155ec0 con 0x7efe0c003a60 2023-10-07T08:54:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.998+0000 7efe2831e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2016a500 con 0x7efe20153a30 2023-10-07T08:54:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.998+0000 7efe2831e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe200c6730 con 0x7efe20155500 2023-10-07T08:54:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.998+0000 7efe260ba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c003a60 0x7efe20148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.998+0000 7efe260ba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c003a60 0x7efe20148690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56150/0 (socket says 172.21.15.81:56150) 2023-10-07T08:54:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.998+0000 7efe260ba700 1 -- 172.21.15.81:0/3526576360 learned_addr learned my addr 172.21.15.81:0/3526576360 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.999+0000 7efe260ba700 1 -- 172.21.15.81:0/3526576360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20155500 msgr2=0x7efe20155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.999+0000 7efe260ba700 1 --2- 172.21.15.81:0/3526576360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20155500 0x7efe20155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.999+0000 7efe260ba700 1 -- 172.21.15.81:0/3526576360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe20153a30 msgr2=0x7efe200b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.999+0000 7efe260ba700 1 --2- 172.21.15.81:0/3526576360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe20153a30 0x7efe200b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.999+0000 7efe260ba700 1 -- 172.21.15.81:0/3526576360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe200c5b20 con 0x7efe0c003a60 2023-10-07T08:54:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.999+0000 7efe260ba700 1 --2- 172.21.15.81:0/3526576360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c003a60 0x7efe20148690 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7efe0c004730 tx=0x7efe1c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.999+0000 7efe167fc700 1 -- 172.21.15.81:0/3526576360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c01d420 con 0x7efe0c003a60 2023-10-07T08:54:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.999+0000 7efe167fc700 1 -- 172.21.15.81:0/3526576360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c01d580 con 0x7efe0c003a60 2023-10-07T08:54:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.999+0000 7efe2831e700 1 -- 172.21.15.81:0/3526576360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe200c5e00 con 0x7efe0c003a60 2023-10-07T08:54:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.999+0000 7efe167fc700 1 -- 172.21.15.81:0/3526576360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c01d940 con 0x7efe0c003a60 2023-10-07T08:54:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:20.999+0000 7efe2831e700 1 -- 172.21.15.81:0/3526576360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe200c63c0 con 0x7efe0c003a60 2023-10-07T08:54:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.000+0000 7efe2831e700 1 -- 172.21.15.81:0/3526576360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe20067ac0 con 0x7efe0c003a60 2023-10-07T08:54:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.000+0000 7efe167fc700 1 -- 172.21.15.81:0/3526576360 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe1c003040 con 0x7efe0c003a60 2023-10-07T08:54:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.000+0000 7efe167fc700 1 --2- 172.21.15.81:0/3526576360 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe04066f30 0x7efe040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.001+0000 7efe167fc700 1 -- 172.21.15.81:0/3526576360 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efe1c086910 con 0x7efe0c003a60 2023-10-07T08:54:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.001+0000 7efe258b9700 1 --2- 172.21.15.81:0/3526576360 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe04066f30 0x7efe040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.001+0000 7efe258b9700 1 --2- 172.21.15.81:0/3526576360 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe04066f30 0x7efe040693e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efe20153e40 tx=0x7efe100091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:21.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.005+0000 7efe167fc700 1 -- 172.21.15.81:0/3526576360 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe1c053b80 con 0x7efe0c003a60 2023-10-07T08:54:21.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.229+0000 7efe2831e700 1 -- 172.21.15.81:0/3526576360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe200d0450 con 0x7efe0c003a60 2023-10-07T08:54:21.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.230+0000 7efe167fc700 1 -- 172.21.15.81:0/3526576360 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4601 (secure 0 0 0) 0x7efe1c018020 con 0x7efe0c003a60 2023-10-07T08:54:21.232 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:21.232 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1601080758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1601080758},{"type":"v1","addr":"172.21.15.81:6837","nonce":1601080758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2709611313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2709611313},{"type":"v1","addr":"172.21.15.89:6835","nonce":2709611313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/3085029167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3085029167},{"type":"v1","addr":"172.21.15.89:6834","nonce":3085029167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:53:48.496016+0000","modified":"2023-10-07T08:53:52.345717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6836/2531199109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2531199109},{"type":"v1","addr":"172.21.15.81:6836","nonce":2531199109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-07T08:54:21.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.232+0000 7efe2831e700 1 -- 172.21.15.81:0/3526576360 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe04066f30 msgr2=0x7efe040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.232+0000 7efe2831e700 1 --2- 172.21.15.81:0/3526576360 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe04066f30 0x7efe040693e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efe20153e40 tx=0x7efe100091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.232+0000 7efe2831e700 1 -- 172.21.15.81:0/3526576360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c003a60 msgr2=0x7efe20148690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.232+0000 7efe2831e700 1 --2- 172.21.15.81:0/3526576360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c003a60 0x7efe20148690 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7efe0c004730 tx=0x7efe1c01a000 comp rx=0 tx=0).stop 2023-10-07T08:54:21.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.232+0000 7efe2831e700 1 -- 172.21.15.81:0/3526576360 shutdown_connections 2023-10-07T08:54:21.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.232+0000 7efe2831e700 1 --2- 172.21.15.81:0/3526576360 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efe04066f30 0x7efe040693e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.232+0000 7efe2831e700 1 --2- 172.21.15.81:0/3526576360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe20155500 0x7efe20155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.232+0000 7efe2831e700 1 --2- 172.21.15.81:0/3526576360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c003a60 0x7efe20148690 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.232+0000 7efe2831e700 1 --2- 172.21.15.81:0/3526576360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe20153a30 0x7efe200b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.232+0000 7efe2831e700 1 -- 172.21.15.81:0/3526576360 >> 172.21.15.81:0/3526576360 conn(0x7efe2006bb90 msgr2=0x7efe20156590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:21.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.232+0000 7efe2831e700 1 -- 172.21.15.81:0/3526576360 shutdown_connections 2023-10-07T08:54:21.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.232+0000 7efe2831e700 1 -- 172.21.15.81:0/3526576360 wait complete. 2023-10-07T08:54:21.235 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-07T08:54:21.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:54:21.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.357+0000 7fd6980dd700 1 Processor -- start 2023-10-07T08:54:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.357+0000 7fd6980dd700 1 -- start start 2023-10-07T08:54:21.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.358+0000 7fd6980dd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6901578d0 0x7fd6900cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.358+0000 7fd6980dd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd69006d120 0x7fd69006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.358+0000 7fd6980dd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6900d07c0 con 0x7fd690157ca0 2023-10-07T08:54:21.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.358+0000 7fd6980dd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd69006da50 con 0x7fd6901578d0 2023-10-07T08:54:21.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.358+0000 7fd6980dd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6900cfbb0 con 0x7fd69006d120 2023-10-07T08:54:21.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.358+0000 7fd695e79700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6901578d0 0x7fd6900cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.358+0000 7fd695678700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd690157ca0 0x7fd69015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33782/0 (socket says 172.21.15.81:33782) 2023-10-07T08:54:21.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.358+0000 7fd695678700 1 -- 172.21.15.81:0/917158432 learned_addr learned my addr 172.21.15.81:0/917158432 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:21.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.358+0000 7fd69667a700 1 --2- 172.21.15.81:0/917158432 >> v2:172.21.15.89:3300/0 conn(0x7fd69006d120 0x7fd69006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.358+0000 7fd695e79700 1 -- 172.21.15.81:0/917158432 >> v2:172.21.15.89:3300/0 conn(0x7fd69006d120 msgr2=0x7fd69006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.358+0000 7fd695e79700 1 --2- 172.21.15.81:0/917158432 >> v2:172.21.15.89:3300/0 conn(0x7fd69006d120 0x7fd69006d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.358+0000 7fd695e79700 1 -- 172.21.15.81:0/917158432 >> v1:172.21.15.81:6789/0 conn(0x7fd690157ca0 legacy=0x7fd69015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.359+0000 7fd694e77700 1 -- 172.21.15.81:0/917158432 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717720667 0 0) 0x7fd6900d07c0 con 0x7fd690157ca0 2023-10-07T08:54:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.359+0000 7fd695e79700 1 -- 172.21.15.81:0/917158432 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6900cfe90 con 0x7fd6901578d0 2023-10-07T08:54:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.359+0000 7fd695e79700 1 --2- 172.21.15.81:0/917158432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6901578d0 0x7fd6900cf4f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fd690068300 tx=0x7fd68c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4180bafbcf333a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.359+0000 7fd694e77700 1 -- 172.21.15.81:0/917158432 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00e070 con 0x7fd6901578d0 2023-10-07T08:54:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.359+0000 7fd694e77700 1 -- 172.21.15.81:0/917158432 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c00bc30 con 0x7fd6901578d0 2023-10-07T08:54:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.359+0000 7fd694e77700 1 -- 172.21.15.81:0/917158432 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c012430 con 0x7fd6901578d0 2023-10-07T08:54:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.359+0000 7fd6980dd700 1 -- 172.21.15.81:0/917158432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6901578d0 msgr2=0x7fd6900cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.359+0000 7fd6980dd700 1 --2- 172.21.15.81:0/917158432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6901578d0 0x7fd6900cf4f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fd690068300 tx=0x7fd68c009780 comp rx=0 tx=0).stop 2023-10-07T08:54:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.359+0000 7fd6980dd700 1 -- 172.21.15.81:0/917158432 shutdown_connections 2023-10-07T08:54:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.359+0000 7fd6980dd700 1 --2- 172.21.15.81:0/917158432 >> v2:172.21.15.89:3300/0 conn(0x7fd69006d120 0x7fd69006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.359+0000 7fd6980dd700 1 --2- 172.21.15.81:0/917158432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6901578d0 0x7fd6900cf4f0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.359+0000 7fd6980dd700 1 -- 172.21.15.81:0/917158432 >> 172.21.15.81:0/917158432 conn(0x7fd69006bb90 msgr2=0x7fd69006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.359+0000 7fd6980dd700 1 -- 172.21.15.81:0/917158432 shutdown_connections 2023-10-07T08:54:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.359+0000 7fd6980dd700 1 -- 172.21.15.81:0/917158432 wait complete. 2023-10-07T08:54:21.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.361+0000 7fd6980dd700 1 Processor -- start 2023-10-07T08:54:21.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.361+0000 7fd6980dd700 1 -- start start 2023-10-07T08:54:21.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.361+0000 7fd6980dd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd69006d120 0x7fd69016dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.361+0000 7fd6980dd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6901578d0 0x7fd6900af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.361+0000 7fd6980dd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd690157ca0 0x7fd6900abe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.361+0000 7fd6980dd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6900b4c10 con 0x7fd690157ca0 2023-10-07T08:54:21.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.361+0000 7fd6980dd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6900b4ef0 con 0x7fd6901578d0 2023-10-07T08:54:21.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.361+0000 7fd6980dd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6900b51d0 con 0x7fd69006d120 2023-10-07T08:54:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.361+0000 7fd69667a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd690157ca0 0x7fd6900abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.361+0000 7fd69667a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd690157ca0 0x7fd6900abe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56156/0 (socket says 172.21.15.81:56156) 2023-10-07T08:54:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.361+0000 7fd69667a700 1 -- 172.21.15.81:0/2156161274 learned_addr learned my addr 172.21.15.81:0/2156161274 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.361+0000 7fd695e79700 1 --2- 172.21.15.81:0/2156161274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd69006d120 0x7fd69016dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.361+0000 7fd695678700 1 --2- 172.21.15.81:0/2156161274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6901578d0 0x7fd6900af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.362+0000 7fd69667a700 1 -- 172.21.15.81:0/2156161274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd69006d120 msgr2=0x7fd69016dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.362+0000 7fd69667a700 1 --2- 172.21.15.81:0/2156161274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd69006d120 0x7fd69016dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.362+0000 7fd69667a700 1 -- 172.21.15.81:0/2156161274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6901578d0 msgr2=0x7fd6900af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.362+0000 7fd69667a700 1 --2- 172.21.15.81:0/2156161274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6901578d0 0x7fd6900af820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.362+0000 7fd69667a700 1 -- 172.21.15.81:0/2156161274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c009a20 con 0x7fd690157ca0 2023-10-07T08:54:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.362+0000 7fd69667a700 1 --2- 172.21.15.81:0/2156161274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd690157ca0 0x7fd6900abe70 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fd68800d890 tx=0x7fd688008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.362+0000 7fd685ffb700 1 -- 172.21.15.81:0/2156161274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6880125f0 con 0x7fd690157ca0 2023-10-07T08:54:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.362+0000 7fd685ffb700 1 -- 172.21.15.81:0/2156161274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd688012770 con 0x7fd690157ca0 2023-10-07T08:54:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.362+0000 7fd6980dd700 1 -- 172.21.15.81:0/2156161274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6900b54b0 con 0x7fd690157ca0 2023-10-07T08:54:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.362+0000 7fd685ffb700 1 -- 172.21.15.81:0/2156161274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688012b30 con 0x7fd690157ca0 2023-10-07T08:54:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.362+0000 7fd6980dd700 1 -- 172.21.15.81:0/2156161274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69016e850 con 0x7fd690157ca0 2023-10-07T08:54:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.363+0000 7fd6980dd700 1 -- 172.21.15.81:0/2156161274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd690067ac0 con 0x7fd690157ca0 2023-10-07T08:54:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.363+0000 7fd685ffb700 1 -- 172.21.15.81:0/2156161274 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd68801e460 con 0x7fd690157ca0 2023-10-07T08:54:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.364+0000 7fd685ffb700 1 --2- 172.21.15.81:0/2156161274 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd674066f30 0x7fd6740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.364+0000 7fd685ffb700 1 -- 172.21.15.81:0/2156161274 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd688084a30 con 0x7fd690157ca0 2023-10-07T08:54:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.364+0000 7fd695e79700 1 --2- 172.21.15.81:0/2156161274 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd674066f30 0x7fd6740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.364+0000 7fd695e79700 1 --2- 172.21.15.81:0/2156161274 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd674066f30 0x7fd6740693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd690068300 tx=0x7fd68c019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.368+0000 7fd685ffb700 1 -- 172.21.15.81:0/2156161274 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd688051ca0 con 0x7fd690157ca0 2023-10-07T08:54:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.594+0000 7fd6980dd700 1 -- 172.21.15.81:0/2156161274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6900d0170 con 0x7fd690157ca0 2023-10-07T08:54:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.594+0000 7fd685ffb700 1 -- 172.21.15.81:0/2156161274 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fd6880552c0 con 0x7fd690157ca0 2023-10-07T08:54:21.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:21.596 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1601080758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1601080758},{"type":"v1","addr":"172.21.15.81:6837","nonce":1601080758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2709611313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2709611313},{"type":"v1","addr":"172.21.15.89:6835","nonce":2709611313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/3085029167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3085029167},{"type":"v1","addr":"172.21.15.89:6834","nonce":3085029167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-07T08:53:48.496016+0000","modified":"2023-10-07T08:53:52.345717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6836/2531199109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2531199109},{"type":"v1","addr":"172.21.15.81:6836","nonce":2531199109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-07T08:54:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.596+0000 7fd6980dd700 1 -- 172.21.15.81:0/2156161274 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd674066f30 msgr2=0x7fd6740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.596+0000 7fd6980dd700 1 --2- 172.21.15.81:0/2156161274 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd674066f30 0x7fd6740693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd690068300 tx=0x7fd68c019000 comp rx=0 tx=0).stop 2023-10-07T08:54:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.596+0000 7fd6980dd700 1 -- 172.21.15.81:0/2156161274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd690157ca0 msgr2=0x7fd6900abe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.596+0000 7fd6980dd700 1 --2- 172.21.15.81:0/2156161274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd690157ca0 0x7fd6900abe70 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fd68800d890 tx=0x7fd688008040 comp rx=0 tx=0).stop 2023-10-07T08:54:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.596+0000 7fd6980dd700 1 -- 172.21.15.81:0/2156161274 shutdown_connections 2023-10-07T08:54:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.596+0000 7fd6980dd700 1 --2- 172.21.15.81:0/2156161274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd690157ca0 0x7fd6900abe70 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.596+0000 7fd6980dd700 1 --2- 172.21.15.81:0/2156161274 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd674066f30 0x7fd6740693e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.596+0000 7fd6980dd700 1 --2- 172.21.15.81:0/2156161274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd69006d120 0x7fd69016dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.596+0000 7fd6980dd700 1 --2- 172.21.15.81:0/2156161274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6901578d0 0x7fd6900af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.596+0000 7fd6980dd700 1 -- 172.21.15.81:0/2156161274 >> 172.21.15.81:0/2156161274 conn(0x7fd69006bb90 msgr2=0x7fd690155ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.596+0000 7fd6980dd700 1 -- 172.21.15.81:0/2156161274 shutdown_connections 2023-10-07T08:54:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.596+0000 7fd6980dd700 1 -- 172.21.15.81:0/2156161274 wait complete. 2023-10-07T08:54:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 90 2023-10-07T08:54:21.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:54:21.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.722+0000 7fc62e131700 1 Processor -- start 2023-10-07T08:54:21.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.722+0000 7fc62e131700 1 -- start start 2023-10-07T08:54:21.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.723+0000 7fc62e131700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6281578d0 0x7fc6280cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.723+0000 7fc62e131700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc628157ca0 0x7fc62815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.723+0000 7fc62e131700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6280d07c0 con 0x7fc62806d120 2023-10-07T08:54:21.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.723+0000 7fc62e131700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6280cfbb0 con 0x7fc628157ca0 2023-10-07T08:54:21.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.723+0000 7fc62e131700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6280cfe90 con 0x7fc6281578d0 2023-10-07T08:54:21.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.723+0000 7fc627fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc62806d120 0x7fc62815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33786/0 (socket says 172.21.15.81:33786) 2023-10-07T08:54:21.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.723+0000 7fc627fff700 1 -- 172.21.15.81:0/2364268317 learned_addr learned my addr 172.21.15.81:0/2364268317 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:21.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.723+0000 7fc626ffd700 1 --2- 172.21.15.81:0/2364268317 >> v2:172.21.15.89:3300/0 conn(0x7fc628157ca0 0x7fc62815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.723+0000 7fc6277fe700 1 --2- 172.21.15.81:0/2364268317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6281578d0 0x7fc6280cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.723+0000 7fc6267fc700 1 -- 172.21.15.81:0/2364268317 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768448819 0 0) 0x7fc6280d07c0 con 0x7fc62806d120 2023-10-07T08:54:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.723+0000 7fc6267fc700 1 -- 172.21.15.81:0/2364268317 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc610003570 con 0x7fc62806d120 2023-10-07T08:54:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.724+0000 7fc626ffd700 1 -- 172.21.15.81:0/2364268317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6281578d0 msgr2=0x7fc6280cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.724+0000 7fc626ffd700 1 --2- 172.21.15.81:0/2364268317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6281578d0 0x7fc6280cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.724+0000 7fc626ffd700 1 -- 172.21.15.81:0/2364268317 >> v1:172.21.15.81:6789/0 conn(0x7fc62806d120 legacy=0x7fc62815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.724+0000 7fc626ffd700 1 -- 172.21.15.81:0/2364268317 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6280d0170 con 0x7fc628157ca0 2023-10-07T08:54:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.724+0000 7fc6277fe700 1 --2- 172.21.15.81:0/2364268317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6281578d0 0x7fc6280cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:54:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.724+0000 7fc626ffd700 1 --2- 172.21.15.81:0/2364268317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc628157ca0 0x7fc62815af00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0098e0 tx=0x7fc61c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a98dad9582ca68d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.724+0000 7fc6267fc700 1 -- 172.21.15.81:0/2364268317 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c011630 con 0x7fc628157ca0 2023-10-07T08:54:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.724+0000 7fc6267fc700 1 -- 172.21.15.81:0/2364268317 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c011790 con 0x7fc628157ca0 2023-10-07T08:54:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.724+0000 7fc6267fc700 1 -- 172.21.15.81:0/2364268317 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c011b30 con 0x7fc628157ca0 2023-10-07T08:54:21.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.724+0000 7fc62e131700 1 -- 172.21.15.81:0/2364268317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc628157ca0 msgr2=0x7fc62815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.724+0000 7fc62e131700 1 --2- 172.21.15.81:0/2364268317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc628157ca0 0x7fc62815af00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0098e0 tx=0x7fc61c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.725+0000 7fc62e131700 1 -- 172.21.15.81:0/2364268317 shutdown_connections 2023-10-07T08:54:21.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.725+0000 7fc62e131700 1 --2- 172.21.15.81:0/2364268317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6281578d0 0x7fc6280cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.725+0000 7fc62e131700 1 --2- 172.21.15.81:0/2364268317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc628157ca0 0x7fc62815af00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.725+0000 7fc62e131700 1 -- 172.21.15.81:0/2364268317 >> 172.21.15.81:0/2364268317 conn(0x7fc62806bb90 msgr2=0x7fc62806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:21.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.725+0000 7fc62e131700 1 -- 172.21.15.81:0/2364268317 shutdown_connections 2023-10-07T08:54:21.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.725+0000 7fc62e131700 1 -- 172.21.15.81:0/2364268317 wait complete. 2023-10-07T08:54:21.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.726+0000 7fc62e131700 1 Processor -- start 2023-10-07T08:54:21.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.726+0000 7fc62e131700 1 -- start start 2023-10-07T08:54:21.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.726+0000 7fc62e131700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62806d120 0x7fc6280cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.726+0000 7fc62e131700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6281578d0 0x7fc6280b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.726+0000 7fc62e131700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc628157ca0 0x7fc6280b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc62e131700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6280c69f0 con 0x7fc628157ca0 2023-10-07T08:54:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc62e131700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6280c5b20 con 0x7fc62806d120 2023-10-07T08:54:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc62e131700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6280c5de0 con 0x7fc6281578d0 2023-10-07T08:54:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc627fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc628157ca0 0x7fc6280b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc627fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc628157ca0 0x7fc6280b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56162/0 (socket says 172.21.15.81:56162) 2023-10-07T08:54:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc627fff700 1 -- 172.21.15.81:0/1468179359 learned_addr learned my addr 172.21.15.81:0/1468179359 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc6277fe700 1 --2- 172.21.15.81:0/1468179359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62806d120 0x7fc6280cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc626ffd700 1 --2- 172.21.15.81:0/1468179359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6281578d0 0x7fc6280b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc627fff700 1 -- 172.21.15.81:0/1468179359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6281578d0 msgr2=0x7fc6280b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc627fff700 1 --2- 172.21.15.81:0/1468179359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6281578d0 0x7fc6280b6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc627fff700 1 -- 172.21.15.81:0/1468179359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62806d120 msgr2=0x7fc6280cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc627fff700 1 --2- 172.21.15.81:0/1468179359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62806d120 0x7fc6280cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc627fff700 1 -- 172.21.15.81:0/1468179359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc618009a20 con 0x7fc628157ca0 2023-10-07T08:54:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc6277fe700 1 --2- 172.21.15.81:0/1468179359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62806d120 0x7fc6280cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc627fff700 1 --2- 172.21.15.81:0/1468179359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc628157ca0 0x7fc6280b6780 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fc6200010e0 tx=0x7fc620007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc60f7fe700 1 -- 172.21.15.81:0/1468179359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620005c00 con 0x7fc628157ca0 2023-10-07T08:54:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc60f7fe700 1 -- 172.21.15.81:0/1468179359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620005d60 con 0x7fc628157ca0 2023-10-07T08:54:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc62e131700 1 -- 172.21.15.81:0/1468179359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c009420 con 0x7fc628157ca0 2023-10-07T08:54:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc60f7fe700 1 -- 172.21.15.81:0/1468179359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6200072e0 con 0x7fc628157ca0 2023-10-07T08:54:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.727+0000 7fc62e131700 1 -- 172.21.15.81:0/1468179359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6280c63a0 con 0x7fc628157ca0 2023-10-07T08:54:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.728+0000 7fc62e131700 1 -- 172.21.15.81:0/1468179359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6280c6b60 con 0x7fc628157ca0 2023-10-07T08:54:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.729+0000 7fc60f7fe700 1 -- 172.21.15.81:0/1468179359 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc620007690 con 0x7fc628157ca0 2023-10-07T08:54:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.729+0000 7fc60f7fe700 1 --2- 172.21.15.81:0/1468179359 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc614066f30 0x7fc6140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.729+0000 7fc60f7fe700 1 -- 172.21.15.81:0/1468179359 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc620083a00 con 0x7fc628157ca0 2023-10-07T08:54:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.729+0000 7fc6277fe700 1 --2- 172.21.15.81:0/1468179359 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc614066f30 0x7fc6140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.729+0000 7fc6277fe700 1 --2- 172.21.15.81:0/1468179359 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc614066f30 0x7fc6140693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc6180099f0 tx=0x7fc61800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.733+0000 7fc60f7fe700 1 -- 172.21.15.81:0/1468179359 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc62004b5a0 con 0x7fc628157ca0 2023-10-07T08:54:21.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.917+0000 7fc62e131700 1 -- 172.21.15.81:0/1468179359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6280d0450 con 0x7fc628157ca0 2023-10-07T08:54:21.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.918+0000 7fc60f7fe700 1 -- 172.21.15.81:0/1468179359 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+15324 (secure 0 0 0) 0x7fc620017070 con 0x7fc628157ca0 2023-10-07T08:54:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:21.919 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":193,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:54:13.341950+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-07T08:53:46.818809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-07T08:53:47.460436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:54:21.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.919+0000 7fc62e131700 1 -- 172.21.15.81:0/1468179359 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc614066f30 msgr2=0x7fc6140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.919+0000 7fc62e131700 1 --2- 172.21.15.81:0/1468179359 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc614066f30 0x7fc6140693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc6180099f0 tx=0x7fc61800b040 comp rx=0 tx=0).stop 2023-10-07T08:54:21.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.919+0000 7fc62e131700 1 -- 172.21.15.81:0/1468179359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc628157ca0 msgr2=0x7fc6280b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:21.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.919+0000 7fc62e131700 1 --2- 172.21.15.81:0/1468179359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc628157ca0 0x7fc6280b6780 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fc6200010e0 tx=0x7fc620007dd0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.920+0000 7fc62e131700 1 -- 172.21.15.81:0/1468179359 shutdown_connections 2023-10-07T08:54:21.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.920+0000 7fc62e131700 1 --2- 172.21.15.81:0/1468179359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc628157ca0 0x7fc6280b6780 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.920+0000 7fc62e131700 1 --2- 172.21.15.81:0/1468179359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62806d120 0x7fc6280cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.920+0000 7fc62e131700 1 --2- 172.21.15.81:0/1468179359 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc614066f30 0x7fc6140693e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.920+0000 7fc62e131700 1 --2- 172.21.15.81:0/1468179359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6281578d0 0x7fc6280b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:21.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.920+0000 7fc62e131700 1 -- 172.21.15.81:0/1468179359 >> 172.21.15.81:0/1468179359 conn(0x7fc62806bb90 msgr2=0x7fc628156750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:21.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.920+0000 7fc62e131700 1 -- 172.21.15.81:0/1468179359 shutdown_connections 2023-10-07T08:54:21.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:21.920+0000 7fc62e131700 1 -- 172.21.15.81:0/1468179359 wait complete. 2023-10-07T08:54:21.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-07T08:54:22.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.046+0000 7fdcb584f700 1 Processor -- start 2023-10-07T08:54:22.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.046+0000 7fdcb584f700 1 -- start start 2023-10-07T08:54:22.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.047+0000 7fdcb584f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcb0157fe0 0x7fdcb00b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:22.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.047+0000 7fdcb584f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdcb01583b0 0x7fdcb00b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:22.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.047+0000 7fdcb584f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb00b2890 con 0x7fdcb00ceb30 2023-10-07T08:54:22.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.047+0000 7fdcb584f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb00b4070 con 0x7fdcb01583b0 2023-10-07T08:54:22.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.047+0000 7fdcb584f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00b4350 con 0x7fdcb0157fe0 2023-10-07T08:54:22.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.047+0000 7fdcaf7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdcb00ceb30 0x7fdcb00cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33798/0 (socket says 172.21.15.81:33798) 2023-10-07T08:54:22.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.047+0000 7fdcaf7fe700 1 -- 172.21.15.81:0/600459913 learned_addr learned my addr 172.21.15.81:0/600459913 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:22.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.047+0000 7fdcae7fc700 1 --2- 172.21.15.81:0/600459913 >> v2:172.21.15.89:3300/0 conn(0x7fdcb01583b0 0x7fdcb00b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:22.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.047+0000 7fdcaeffd700 1 --2- 172.21.15.81:0/600459913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcb0157fe0 0x7fdcb00b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:22.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.047+0000 7fdcadffb700 1 -- 172.21.15.81:0/600459913 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262064593 0 0) 0x7fdcb00b2890 con 0x7fdcb00ceb30 2023-10-07T08:54:22.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.047+0000 7fdcadffb700 1 -- 172.21.15.81:0/600459913 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc98003570 con 0x7fdcb00ceb30 2023-10-07T08:54:22.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 -- 172.21.15.81:0/600459913 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2176170638 0 0) 0x7fdc98003570 con 0x7fdcb00ceb30 2023-10-07T08:54:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 -- 172.21.15.81:0/600459913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcb0157fe0 msgr2=0x7fdcb00b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 --2- 172.21.15.81:0/600459913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcb0157fe0 0x7fdcb00b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 -- 172.21.15.81:0/600459913 >> v2:172.21.15.89:3300/0 conn(0x7fdcb01583b0 msgr2=0x7fdcb00b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 --2- 172.21.15.81:0/600459913 >> v2:172.21.15.89:3300/0 conn(0x7fdcb01583b0 0x7fdcb00b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 -- 172.21.15.81:0/600459913 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb00b4630 con 0x7fdcb00ceb30 2023-10-07T08:54:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 -- 172.21.15.81:0/600459913 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7fdca8001470 con 0x7fdcb00ceb30 2023-10-07T08:54:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 -- 172.21.15.81:0/600459913 >> v1:172.21.15.81:6789/0 conn(0x7fdcb00ceb30 legacy=0x7fdcb00cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 --2- 172.21.15.81:0/600459913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98003a60 0x7fdc98003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 --2- 172.21.15.81:0/600459913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc98004810 0x7fdc98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 --2- 172.21.15.81:0/600459913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcb0157fe0 0x7fdc980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 -- 172.21.15.81:0/600459913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00b4070 con 0x7fdc98003a60 2023-10-07T08:54:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 -- 172.21.15.81:0/600459913 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00b4350 con 0x7fdc98004810 2023-10-07T08:54:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 -- 172.21.15.81:0/600459913 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9800bae0 con 0x7fdcb0157fe0 2023-10-07T08:54:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcaeffd700 1 --2- 172.21.15.81:0/600459913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98003a60 0x7fdc98003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcae7fc700 1 --2- 172.21.15.81:0/600459913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc98004810 0x7fdc98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcaf7fe700 1 --2- 172.21.15.81:0/600459913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcb0157fe0 0x7fdc980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcaeffd700 1 -- 172.21.15.81:0/600459913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcb0157fe0 msgr2=0x7fdc980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcaeffd700 1 --2- 172.21.15.81:0/600459913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcb0157fe0 0x7fdc980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcaeffd700 1 -- 172.21.15.81:0/600459913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc98004810 msgr2=0x7fdc98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcaeffd700 1 --2- 172.21.15.81:0/600459913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc98004810 0x7fdc98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcaeffd700 1 -- 172.21.15.81:0/600459913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc98003570 con 0x7fdc98003a60 2023-10-07T08:54:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcaeffd700 1 --2- 172.21.15.81:0/600459913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98003a60 0x7fdc98003e70 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fdca000e210 tx=0x7fdca000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39752b99112ea376 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 -- 172.21.15.81:0/600459913 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca000eac0 con 0x7fdc98003a60 2023-10-07T08:54:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 -- 172.21.15.81:0/600459913 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca000f040 con 0x7fdc98003a60 2023-10-07T08:54:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.048+0000 7fdcadffb700 1 -- 172.21.15.81:0/600459913 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca000ee70 con 0x7fdc98003a60 2023-10-07T08:54:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.049+0000 7fdcb584f700 1 -- 172.21.15.81:0/600459913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98003a60 msgr2=0x7fdc98003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.049+0000 7fdcb584f700 1 --2- 172.21.15.81:0/600459913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98003a60 0x7fdc98003e70 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fdca000e210 tx=0x7fdca000b040 comp rx=0 tx=0).stop 2023-10-07T08:54:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.049+0000 7fdcaf7fe700 1 -- 172.21.15.81:0/600459913 reap_dead start 2023-10-07T08:54:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.049+0000 7fdcb584f700 1 -- 172.21.15.81:0/600459913 shutdown_connections 2023-10-07T08:54:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.049+0000 7fdcb584f700 1 -- 172.21.15.81:0/600459913 >> 172.21.15.81:0/600459913 conn(0x7fdcb0067640 msgr2=0x7fdcb0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.049+0000 7fdcb584f700 1 -- 172.21.15.81:0/600459913 shutdown_connections 2023-10-07T08:54:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.049+0000 7fdcb584f700 1 -- 172.21.15.81:0/600459913 wait complete. 2023-10-07T08:54:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.050+0000 7fdcb584f700 1 Processor -- start 2023-10-07T08:54:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.050+0000 7fdcb584f700 1 -- start start 2023-10-07T08:54:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcb584f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98003a60 0x7fdcb0168af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcb584f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb015a8e0 0x7fdcb015ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcb584f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcb0150170 0x7fdcb01505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcb584f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb015b290 con 0x7fdc98003a60 2023-10-07T08:54:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcb584f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00c3b70 con 0x7fdcb015a8e0 2023-10-07T08:54:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcb584f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb0150e30 con 0x7fdcb0150170 2023-10-07T08:54:22.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcaeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98003a60 0x7fdcb0168af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:22.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcaeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98003a60 0x7fdcb0168af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56172/0 (socket says 172.21.15.81:56172) 2023-10-07T08:54:22.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcaeffd700 1 -- 172.21.15.81:0/535883099 learned_addr learned my addr 172.21.15.81:0/535883099 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:22.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcae7fc700 1 --2- 172.21.15.81:0/535883099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb015a8e0 0x7fdcb015ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:22.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcaeffd700 1 -- 172.21.15.81:0/535883099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcb0150170 msgr2=0x7fdcb01505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:22.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcaf7fe700 1 --2- 172.21.15.81:0/535883099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcb0150170 0x7fdcb01505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:22.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcaeffd700 1 --2- 172.21.15.81:0/535883099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcb0150170 0x7fdcb01505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:22.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcaeffd700 1 -- 172.21.15.81:0/535883099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb015a8e0 msgr2=0x7fdcb015ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:22.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcaeffd700 1 --2- 172.21.15.81:0/535883099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb015a8e0 0x7fdcb015ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:22.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcaeffd700 1 -- 172.21.15.81:0/535883099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb0151110 con 0x7fdc98003a60 2023-10-07T08:54:22.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.051+0000 7fdcae7fc700 1 --2- 172.21.15.81:0/535883099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb015a8e0 0x7fdcb015ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.052+0000 7fdcaeffd700 1 --2- 172.21.15.81:0/535883099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98003a60 0x7fdcb0168af0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fdc980057d0 tx=0x7fdca001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.052+0000 7fdc96ffd700 1 -- 172.21.15.81:0/535883099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca001d420 con 0x7fdc98003a60 2023-10-07T08:54:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.052+0000 7fdc96ffd700 1 -- 172.21.15.81:0/535883099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca001d5a0 con 0x7fdc98003a60 2023-10-07T08:54:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.052+0000 7fdcb584f700 1 -- 172.21.15.81:0/535883099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb01513f0 con 0x7fdc98003a60 2023-10-07T08:54:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.052+0000 7fdc96ffd700 1 -- 172.21.15.81:0/535883099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca001d960 con 0x7fdc98003a60 2023-10-07T08:54:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.052+0000 7fdcb584f700 1 -- 172.21.15.81:0/535883099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb0169030 con 0x7fdc98003a60 2023-10-07T08:54:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.053+0000 7fdcb584f700 1 -- 172.21.15.81:0/535883099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb00c3940 con 0x7fdc98003a60 2023-10-07T08:54:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.053+0000 7fdc96ffd700 1 -- 172.21.15.81:0/535883099 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdca0003040 con 0x7fdc98003a60 2023-10-07T08:54:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.053+0000 7fdc96ffd700 1 --2- 172.21.15.81:0/535883099 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc9c066f30 0x7fdc9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.053+0000 7fdc96ffd700 1 -- 172.21.15.81:0/535883099 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdca0086a80 con 0x7fdc98003a60 2023-10-07T08:54:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.053+0000 7fdcae7fc700 1 --2- 172.21.15.81:0/535883099 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc9c066f30 0x7fdc9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.054+0000 7fdcae7fc700 1 --2- 172.21.15.81:0/535883099 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc9c066f30 0x7fdc9c0693e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fdca4006dc0 tx=0x7fdca4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:22.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.058+0000 7fdc96ffd700 1 -- 172.21.15.81:0/535883099 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdcb00c3940 con 0x7fdc98003a60 2023-10-07T08:54:22.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.282+0000 7fdcb584f700 1 -- 172.21.15.81:0/535883099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdcb00c3940 con 0x7fdc98003a60 2023-10-07T08:54:22.284 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-10-07T08:54:22.283+0000 7f43c472d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-07T08:54:22.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.288+0000 7fdc96ffd700 1 -- 172.21.15.81:0/535883099 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v91) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdcb00c3940 con 0x7fdc98003a60 2023-10-07T08:54:22.291 INFO:tasks.ceph.mds.a.smithi081.stderr: -7414> 2023-10-07T08:53:54.424+0000 7f0c399b9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-07T08:54:22.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.291+0000 7fdcb584f700 1 -- 172.21.15.81:0/535883099 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc9c066f30 msgr2=0x7fdc9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:22.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.291+0000 7fdcb584f700 1 --2- 172.21.15.81:0/535883099 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc9c066f30 0x7fdc9c0693e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fdca4006dc0 tx=0x7fdca4008040 comp rx=0 tx=0).stop 2023-10-07T08:54:22.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.291+0000 7fdcb584f700 1 -- 172.21.15.81:0/535883099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98003a60 msgr2=0x7fdcb0168af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:22.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.291+0000 7fdcb584f700 1 --2- 172.21.15.81:0/535883099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98003a60 0x7fdcb0168af0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fdc980057d0 tx=0x7fdca001a000 comp rx=0 tx=0).stop 2023-10-07T08:54:22.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.291+0000 7fdcb584f700 1 -- 172.21.15.81:0/535883099 shutdown_connections 2023-10-07T08:54:22.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.291+0000 7fdcb584f700 1 --2- 172.21.15.81:0/535883099 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdc9c066f30 0x7fdc9c0693e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:22.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.291+0000 7fdcb584f700 1 --2- 172.21.15.81:0/535883099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcb0150170 0x7fdcb01505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:22.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.291+0000 7fdcb584f700 1 --2- 172.21.15.81:0/535883099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98003a60 0x7fdcb0168af0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:22.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.291+0000 7fdcb584f700 1 --2- 172.21.15.81:0/535883099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb015a8e0 0x7fdcb015ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:22.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.291+0000 7fdcb584f700 1 -- 172.21.15.81:0/535883099 >> 172.21.15.81:0/535883099 conn(0x7fdcb0067640 msgr2=0x7fdcb00cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:22.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.291+0000 7fdcb584f700 1 -- 172.21.15.81:0/535883099 shutdown_connections 2023-10-07T08:54:22.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.291+0000 7fdcb584f700 1 -- 172.21.15.81:0/535883099 wait complete. 2023-10-07T08:54:22.294 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-07T08:54:22.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-07T08:54:22.320 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-07T08:54:22.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.420+0000 7f280ee97700 1 Processor -- start 2023-10-07T08:54:22.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.420+0000 7f280ee97700 1 -- start start 2023-10-07T08:54:22.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.420+0000 7f280ee97700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2808156db0 0x7f280806e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:22.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.420+0000 7f280ee97700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f280806e770 0x7f28080cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:22.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.420+0000 7f280ee97700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280806ebd0 con 0x7f28081569e0 2023-10-07T08:54:22.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.420+0000 7f280ee97700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28080b2290 con 0x7f2808156db0 2023-10-07T08:54:22.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.420+0000 7f280ee97700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2808157c00 con 0x7f280806e770 2023-10-07T08:54:22.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.421+0000 7f27fffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2808156db0 0x7f280806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:22.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.421+0000 7f280cc33700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f28081569e0 0x7f28080b17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35380/0 (socket says 172.21.15.81:35380) 2023-10-07T08:54:22.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.421+0000 7f280cc33700 1 -- 172.21.15.81:0/2706702938 learned_addr learned my addr 172.21.15.81:0/2706702938 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:22.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.421+0000 7f280d434700 1 --2- 172.21.15.81:0/2706702938 >> v2:172.21.15.89:3300/0 conn(0x7f280806e770 0x7f28080cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:22.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.421+0000 7f27fffff700 1 -- 172.21.15.81:0/2706702938 >> v2:172.21.15.89:3300/0 conn(0x7f280806e770 msgr2=0x7f28080cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:22.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.421+0000 7f27fffff700 1 --2- 172.21.15.81:0/2706702938 >> v2:172.21.15.89:3300/0 conn(0x7f280806e770 0x7f28080cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:22.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.421+0000 7f27fffff700 1 -- 172.21.15.81:0/2706702938 >> v1:172.21.15.81:6789/0 conn(0x7f28081569e0 legacy=0x7f28080b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:22.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.421+0000 7f27ff7fe700 1 -- 172.21.15.81:0/2706702938 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639745083 0 0) 0x7f2804001490 con 0x7f28081569e0 2023-10-07T08:54:22.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.421+0000 7f27fffff700 1 -- 172.21.15.81:0/2706702938 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28081572d0 con 0x7f2808156db0 2023-10-07T08:54:22.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.421+0000 7f280d434700 1 --2- 172.21.15.81:0/2706702938 >> v2:172.21.15.89:3300/0 conn(0x7f280806e770 0x7f28080cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:22.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.421+0000 7f27fffff700 1 --2- 172.21.15.81:0/2706702938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2808156db0 0x7f280806e230 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f2808068dd0 tx=0x7f27f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d97cd5bbbf7d09a server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:22.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.421+0000 7f27ff7fe700 1 -- 172.21.15.81:0/2706702938 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f800b6b0 con 0x7f2808156db0 2023-10-07T08:54:22.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.421+0000 7f27ff7fe700 1 -- 172.21.15.81:0/2706702938 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f800b810 con 0x7f2808156db0 2023-10-07T08:54:22.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.421+0000 7f27ff7fe700 1 -- 172.21.15.81:0/2706702938 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f800bbb0 con 0x7f2808156db0 2023-10-07T08:54:22.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.422+0000 7f280ee97700 1 -- 172.21.15.81:0/2706702938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2808156db0 msgr2=0x7f280806e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:22.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.422+0000 7f280ee97700 1 --2- 172.21.15.81:0/2706702938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2808156db0 0x7f280806e230 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f2808068dd0 tx=0x7f27f80091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:22.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.422+0000 7f280ee97700 1 -- 172.21.15.81:0/2706702938 shutdown_connections 2023-10-07T08:54:22.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.422+0000 7f280ee97700 1 --2- 172.21.15.81:0/2706702938 >> v2:172.21.15.89:3300/0 conn(0x7f280806e770 0x7f28080cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:22.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.422+0000 7f280ee97700 1 --2- 172.21.15.81:0/2706702938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2808156db0 0x7f280806e230 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:22.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.422+0000 7f280ee97700 1 -- 172.21.15.81:0/2706702938 >> 172.21.15.81:0/2706702938 conn(0x7f280806cca0 msgr2=0x7f280806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:22.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.422+0000 7f280ee97700 1 -- 172.21.15.81:0/2706702938 shutdown_connections 2023-10-07T08:54:22.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.422+0000 7f280ee97700 1 -- 172.21.15.81:0/2706702938 wait complete. 2023-10-07T08:54:22.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.423+0000 7f280ee97700 1 Processor -- start 2023-10-07T08:54:22.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.423+0000 7f280ee97700 1 -- start start 2023-10-07T08:54:22.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f280ee97700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f280806e770 0x7f28080b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:22.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f280ee97700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28081569e0 0x7f2808151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:22.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f280ee97700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2808156db0 0x7f280814f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f280ee97700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280814b430 con 0x7f2808156db0 2023-10-07T08:54:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f280ee97700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280814f3f0 con 0x7f28081569e0 2023-10-07T08:54:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f280ee97700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280814eb00 con 0x7f280806e770 2023-10-07T08:54:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f280d434700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2808156db0 0x7f280814f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f280d434700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2808156db0 0x7f280814f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34918/0 (socket says 172.21.15.81:34918) 2023-10-07T08:54:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f280d434700 1 -- 172.21.15.81:0/2667334686 learned_addr learned my addr 172.21.15.81:0/2667334686 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f27fffff700 1 --2- 172.21.15.81:0/2667334686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28081569e0 0x7f2808151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f280cc33700 1 --2- 172.21.15.81:0/2667334686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f280806e770 0x7f28080b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f280d434700 1 -- 172.21.15.81:0/2667334686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f280806e770 msgr2=0x7f28080b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f280d434700 1 --2- 172.21.15.81:0/2667334686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f280806e770 0x7f28080b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f280d434700 1 -- 172.21.15.81:0/2667334686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28081569e0 msgr2=0x7f2808151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f280d434700 1 --2- 172.21.15.81:0/2667334686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28081569e0 0x7f2808151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f280d434700 1 -- 172.21.15.81:0/2667334686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f8009420 con 0x7f2808156db0 2023-10-07T08:54:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f27fffff700 1 --2- 172.21.15.81:0/2667334686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28081569e0 0x7f2808151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.424+0000 7f280d434700 1 --2- 172.21.15.81:0/2667334686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2808156db0 0x7f280814f880 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f280000c880 tx=0x7f2800008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.425+0000 7f27fcff9700 1 -- 172.21.15.81:0/2667334686 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800011600 con 0x7f2808156db0 2023-10-07T08:54:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.425+0000 7f27fcff9700 1 -- 172.21.15.81:0/2667334686 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2800011760 con 0x7f2808156db0 2023-10-07T08:54:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.425+0000 7f27fcff9700 1 -- 172.21.15.81:0/2667334686 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800011b20 con 0x7f2808156db0 2023-10-07T08:54:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.425+0000 7f280ee97700 1 -- 172.21.15.81:0/2667334686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280814e530 con 0x7f2808156db0 2023-10-07T08:54:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.425+0000 7f280ee97700 1 -- 172.21.15.81:0/2667334686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280814f080 con 0x7f2808156db0 2023-10-07T08:54:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.426+0000 7f280ee97700 1 -- 172.21.15.81:0/2667334686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280814f560 con 0x7f2808156db0 2023-10-07T08:54:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.426+0000 7f27fcff9700 1 -- 172.21.15.81:0/2667334686 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28000193b0 con 0x7f2808156db0 2023-10-07T08:54:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.426+0000 7f27fcff9700 1 --2- 172.21.15.81:0/2667334686 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27f4066f30 0x7f27f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:22.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.426+0000 7f27fcff9700 1 -- 172.21.15.81:0/2667334686 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2800084600 con 0x7f2808156db0 2023-10-07T08:54:22.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.426+0000 7f280cc33700 1 --2- 172.21.15.81:0/2667334686 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27f4066f30 0x7f27f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:22.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.427+0000 7f280cc33700 1 --2- 172.21.15.81:0/2667334686 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27f4066f30 0x7f27f40693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2804002220 tx=0x7f2804009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:22.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.432+0000 7f27fcff9700 1 -- 172.21.15.81:0/2667334686 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28000552b0 con 0x7f2808156db0 2023-10-07T08:54:22.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:22.655+0000 7f280ee97700 1 -- 172.21.15.81:0/2667334686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f28081575b0 con 0x7f2808156db0 2023-10-07T08:54:23.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.288+0000 7f27fcff9700 1 -- 172.21.15.81:0/2667334686 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v92) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2800054e40 con 0x7f2808156db0 2023-10-07T08:54:23.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.290+0000 7f280ee97700 1 -- 172.21.15.81:0/2667334686 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27f4066f30 msgr2=0x7f27f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:23.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.290+0000 7f280ee97700 1 --2- 172.21.15.81:0/2667334686 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27f4066f30 0x7f27f40693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2804002220 tx=0x7f2804009040 comp rx=0 tx=0).stop 2023-10-07T08:54:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.290+0000 7f280ee97700 1 -- 172.21.15.81:0/2667334686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2808156db0 msgr2=0x7f280814f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.290+0000 7f280ee97700 1 --2- 172.21.15.81:0/2667334686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2808156db0 0x7f280814f880 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f280000c880 tx=0x7f2800008040 comp rx=0 tx=0).stop 2023-10-07T08:54:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.290+0000 7f280ee97700 1 -- 172.21.15.81:0/2667334686 shutdown_connections 2023-10-07T08:54:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.290+0000 7f280ee97700 1 --2- 172.21.15.81:0/2667334686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2808156db0 0x7f280814f880 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.290+0000 7f280ee97700 1 --2- 172.21.15.81:0/2667334686 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f27f4066f30 0x7f27f40693e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.290+0000 7f280ee97700 1 --2- 172.21.15.81:0/2667334686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f280806e770 0x7f28080b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.290+0000 7f280ee97700 1 --2- 172.21.15.81:0/2667334686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28081569e0 0x7f2808151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.290+0000 7f280ee97700 1 -- 172.21.15.81:0/2667334686 >> 172.21.15.81:0/2667334686 conn(0x7f280806cca0 msgr2=0x7f28080cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.290+0000 7f280ee97700 1 -- 172.21.15.81:0/2667334686 shutdown_connections 2023-10-07T08:54:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.290+0000 7f280ee97700 1 -- 172.21.15.81:0/2667334686 wait complete. 2023-10-07T08:54:23.303 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-07T08:54:23.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.464+0000 7fa1ffea3700 1 Processor -- start 2023-10-07T08:54:23.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.464+0000 7fa1ffea3700 1 -- start start 2023-10-07T08:54:23.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.465+0000 7fa1ffea3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa1f8157ca0 0x7fa1f80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:23.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.465+0000 7fa1ffea3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1f806d120 0x7fa1f806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:23.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.465+0000 7fa1ffea3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f80d07c0 con 0x7fa1f81578d0 2023-10-07T08:54:23.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.465+0000 7fa1ffea3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f806da50 con 0x7fa1f806d120 2023-10-07T08:54:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.465+0000 7fa1ffea3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f80cfbb0 con 0x7fa1f8157ca0 2023-10-07T08:54:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.465+0000 7fa1fe440700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1f806d120 0x7fa1f806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.465+0000 7fa1fe440700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1f806d120 0x7fa1f806d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34934/0 (socket says 172.21.15.81:34934) 2023-10-07T08:54:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.465+0000 7fa1fe440700 1 -- 172.21.15.81:0/4180283391 learned_addr learned my addr 172.21.15.81:0/4180283391 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.466+0000 7fa1fd43e700 1 --2- 172.21.15.81:0/4180283391 >> v2:172.21.15.89:3300/0 conn(0x7fa1f8157ca0 0x7fa1f80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.466+0000 7fa1fe440700 1 -- 172.21.15.81:0/4180283391 >> v2:172.21.15.89:3300/0 conn(0x7fa1f8157ca0 msgr2=0x7fa1f80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.466+0000 7fa1fe440700 1 --2- 172.21.15.81:0/4180283391 >> v2:172.21.15.89:3300/0 conn(0x7fa1f8157ca0 0x7fa1f80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:23.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.466+0000 7fa1fe440700 1 -- 172.21.15.81:0/4180283391 >> v1:172.21.15.89:6789/0 conn(0x7fa1f81578d0 legacy=0x7fa1f815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:23.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.466+0000 7fa1fe440700 1 -- 172.21.15.81:0/4180283391 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f80cfe90 con 0x7fa1f806d120 2023-10-07T08:54:23.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.466+0000 7fa1fd43e700 1 --2- 172.21.15.81:0/4180283391 >> v2:172.21.15.89:3300/0 conn(0x7fa1f8157ca0 0x7fa1f80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:23.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.466+0000 7fa1fe440700 1 --2- 172.21.15.81:0/4180283391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f806d120 0x7fa1f806d510 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8068510 tx=0x7fa1f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f0fb361035fe57 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:23.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.466+0000 7fa1fcc3d700 1 -- 172.21.15.81:0/4180283391 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f000b820 con 0x7fa1f806d120 2023-10-07T08:54:23.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.466+0000 7fa1fcc3d700 1 -- 172.21.15.81:0/4180283391 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f000b980 con 0x7fa1f806d120 2023-10-07T08:54:23.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.466+0000 7fa1fcc3d700 1 -- 172.21.15.81:0/4180283391 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f000bd20 con 0x7fa1f806d120 2023-10-07T08:54:23.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.466+0000 7fa1ffea3700 1 -- 172.21.15.81:0/4180283391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f806d120 msgr2=0x7fa1f806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:23.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.466+0000 7fa1ffea3700 1 --2- 172.21.15.81:0/4180283391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f806d120 0x7fa1f806d510 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8068510 tx=0x7fa1f0009250 comp rx=0 tx=0).stop 2023-10-07T08:54:23.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.466+0000 7fa1ffea3700 1 -- 172.21.15.81:0/4180283391 shutdown_connections 2023-10-07T08:54:23.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.466+0000 7fa1ffea3700 1 --2- 172.21.15.81:0/4180283391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f806d120 0x7fa1f806d510 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:23.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.466+0000 7fa1ffea3700 1 --2- 172.21.15.81:0/4180283391 >> v2:172.21.15.89:3300/0 conn(0x7fa1f8157ca0 0x7fa1f80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:23.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.467+0000 7fa1ffea3700 1 -- 172.21.15.81:0/4180283391 >> 172.21.15.81:0/4180283391 conn(0x7fa1f806bb90 msgr2=0x7fa1f806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:23.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.467+0000 7fa1ffea3700 1 -- 172.21.15.81:0/4180283391 shutdown_connections 2023-10-07T08:54:23.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.467+0000 7fa1ffea3700 1 -- 172.21.15.81:0/4180283391 wait complete. 2023-10-07T08:54:23.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.468+0000 7fa1ffea3700 1 Processor -- start 2023-10-07T08:54:23.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.468+0000 7fa1ffea3700 1 -- start start 2023-10-07T08:54:23.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.468+0000 7fa1ffea3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f806d120 0x7fa1f8154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:23.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.468+0000 7fa1ffea3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1f81578d0 0x7fa1f81565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:23.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.468+0000 7fa1ffea3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1f8157ca0 0x7fa1f816e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:23.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.468+0000 7fa1ffea3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8154de0 con 0x7fa1f806d120 2023-10-07T08:54:23.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.468+0000 7fa1ffea3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f816da10 con 0x7fa1f8157ca0 2023-10-07T08:54:23.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.468+0000 7fa1ffea3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f80c7fb0 con 0x7fa1f81578d0 2023-10-07T08:54:23.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.468+0000 7fa1fdc3f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f806d120 0x7fa1f8154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:23.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.469+0000 7fa1fdc3f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f806d120 0x7fa1f8154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34942/0 (socket says 172.21.15.81:34942) 2023-10-07T08:54:23.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.469+0000 7fa1fdc3f700 1 -- 172.21.15.81:0/502218707 learned_addr learned my addr 172.21.15.81:0/502218707 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:23.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.469+0000 7fa1fdc3f700 1 -- 172.21.15.81:0/502218707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1f81578d0 msgr2=0x7fa1f81565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:23.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.469+0000 7fa1fdc3f700 1 --2- 172.21.15.81:0/502218707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1f81578d0 0x7fa1f81565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:23.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.469+0000 7fa1fdc3f700 1 -- 172.21.15.81:0/502218707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1f8157ca0 msgr2=0x7fa1f816e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:23.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.469+0000 7fa1fdc3f700 1 --2- 172.21.15.81:0/502218707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1f8157ca0 0x7fa1f816e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:23.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.469+0000 7fa1fdc3f700 1 -- 172.21.15.81:0/502218707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f00094f0 con 0x7fa1f806d120 2023-10-07T08:54:23.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.469+0000 7fa1fdc3f700 1 --2- 172.21.15.81:0/502218707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f806d120 0x7fa1f8154230 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400c950 tx=0x7fa1f4002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:23.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.469+0000 7fa1edffb700 1 -- 172.21.15.81:0/502218707 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f400a7e0 con 0x7fa1f806d120 2023-10-07T08:54:23.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.469+0000 7fa1edffb700 1 -- 172.21.15.81:0/502218707 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f400a940 con 0x7fa1f806d120 2023-10-07T08:54:23.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.469+0000 7fa1edffb700 1 -- 172.21.15.81:0/502218707 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f400ad00 con 0x7fa1f806d120 2023-10-07T08:54:23.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.469+0000 7fa1ffea3700 1 -- 172.21.15.81:0/502218707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f80c8290 con 0x7fa1f806d120 2023-10-07T08:54:23.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.469+0000 7fa1ffea3700 1 -- 172.21.15.81:0/502218707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f816dc60 con 0x7fa1f806d120 2023-10-07T08:54:23.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.470+0000 7fa1ffea3700 1 -- 172.21.15.81:0/502218707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f8071b70 con 0x7fa1f806d120 2023-10-07T08:54:23.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.470+0000 7fa1edffb700 1 -- 172.21.15.81:0/502218707 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa1f4012630 con 0x7fa1f806d120 2023-10-07T08:54:23.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.471+0000 7fa1edffb700 1 --2- 172.21.15.81:0/502218707 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa1dc066fb0 0x7fa1dc069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:23.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.471+0000 7fa1edffb700 1 -- 172.21.15.81:0/502218707 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fa1f4084b40 con 0x7fa1f806d120 2023-10-07T08:54:23.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.471+0000 7fa1fd43e700 1 --2- 172.21.15.81:0/502218707 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa1dc066fb0 0x7fa1dc069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:23.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.471+0000 7fa1edffb700 1 -- 172.21.15.81:0/502218707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7fa1dc06eb70 con 0x7fa1f806d120 2023-10-07T08:54:23.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.471+0000 7fa1fd43e700 1 --2- 172.21.15.81:0/502218707 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa1dc066fb0 0x7fa1dc069460 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8006fd0 tx=0x7fa1e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:23.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.475+0000 7fa1edffb700 1 -- 172.21.15.81:0/502218707 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1f4016060 con 0x7fa1f806d120 2023-10-07T08:54:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:23.660+0000 7fa1ffea3700 1 -- 172.21.15.81:0/502218707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa1f816de80 con 0x7fa1f806d120 2023-10-07T08:54:24.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.441+0000 7fa1edffb700 1 -- 172.21.15.81:0/502218707 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(196..196 src has 1..196) v4 ==== 288+0+0 (secure 0 0 0) 0x7fa1f4056080 con 0x7fa1f806d120 2023-10-07T08:54:24.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.441+0000 7fa1edffb700 1 -- 172.21.15.81:0/502218707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=197}) v3 -- 0x7fa1dc06cfa0 con 0x7fa1f806d120 2023-10-07T08:54:24.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.444+0000 7fa1edffb700 1 -- 172.21.15.81:0/502218707 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v196) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa1f4084e60 con 0x7fa1f806d120 2023-10-07T08:54:24.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.448+0000 7fa1ffea3700 1 -- 172.21.15.81:0/502218707 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa1dc066fb0 msgr2=0x7fa1dc069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:24.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.448+0000 7fa1ffea3700 1 --2- 172.21.15.81:0/502218707 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa1dc066fb0 0x7fa1dc069460 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8006fd0 tx=0x7fa1e8008040 comp rx=0 tx=0).stop 2023-10-07T08:54:24.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.448+0000 7fa1ffea3700 1 -- 172.21.15.81:0/502218707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f806d120 msgr2=0x7fa1f8154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:24.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.448+0000 7fa1ffea3700 1 --2- 172.21.15.81:0/502218707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f806d120 0x7fa1f8154230 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400c950 tx=0x7fa1f4002760 comp rx=0 tx=0).stop 2023-10-07T08:54:24.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.448+0000 7fa1ffea3700 1 -- 172.21.15.81:0/502218707 shutdown_connections 2023-10-07T08:54:24.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.448+0000 7fa1ffea3700 1 --2- 172.21.15.81:0/502218707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1f8157ca0 0x7fa1f816e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:24.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.448+0000 7fa1ffea3700 1 --2- 172.21.15.81:0/502218707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f806d120 0x7fa1f8154230 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:24.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.448+0000 7fa1ffea3700 1 --2- 172.21.15.81:0/502218707 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fa1dc066fb0 0x7fa1dc069460 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:24.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.448+0000 7fa1ffea3700 1 --2- 172.21.15.81:0/502218707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1f81578d0 0x7fa1f81565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:24.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.448+0000 7fa1ffea3700 1 -- 172.21.15.81:0/502218707 >> 172.21.15.81:0/502218707 conn(0x7fa1f806bb90 msgr2=0x7fa1f81583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.449+0000 7fa1ffea3700 1 -- 172.21.15.81:0/502218707 shutdown_connections 2023-10-07T08:54:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.449+0000 7fa1ffea3700 1 -- 172.21.15.81:0/502218707 wait complete. 2023-10-07T08:54:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-07T08:54:24.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-07T08:54:24.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.583+0000 7f9866478700 1 Processor -- start 2023-10-07T08:54:24.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.583+0000 7f9866478700 1 -- start start 2023-10-07T08:54:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f9866478700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f98600d0b80 0x7f98600cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f9866478700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f98600d02b0 0x7f986006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f9866478700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98600cf2d0 con 0x7f98600d0f50 2023-10-07T08:54:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f9866478700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986015a690 con 0x7f98600d02b0 2023-10-07T08:54:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f9866478700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986006dc00 con 0x7f98600d0b80 2023-10-07T08:54:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f9864c75700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f98600d02b0 0x7f986006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f9865c77700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f98600d0f50 0x7f986015b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35386/0 (socket says 172.21.15.81:35386) 2023-10-07T08:54:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f9865c77700 1 -- 172.21.15.81:0/2622149729 learned_addr learned my addr 172.21.15.81:0/2622149729 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f9865476700 1 --2- 172.21.15.81:0/2622149729 >> v2:172.21.15.89:3300/0 conn(0x7f98600d0b80 0x7f98600cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f9864c75700 1 -- 172.21.15.81:0/2622149729 >> v2:172.21.15.89:3300/0 conn(0x7f98600d0b80 msgr2=0x7f98600cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f9864c75700 1 --2- 172.21.15.81:0/2622149729 >> v2:172.21.15.89:3300/0 conn(0x7f98600d0b80 0x7f98600cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f9864c75700 1 -- 172.21.15.81:0/2622149729 >> v1:172.21.15.81:6789/0 conn(0x7f98600d0f50 legacy=0x7f986015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f985ffff700 1 -- 172.21.15.81:0/2622149729 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447859484 0 0) 0x7f98600cf2d0 con 0x7f98600d0f50 2023-10-07T08:54:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f9864c75700 1 -- 172.21.15.81:0/2622149729 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98600cf570 con 0x7f98600d02b0 2023-10-07T08:54:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f9865476700 1 --2- 172.21.15.81:0/2622149729 >> v2:172.21.15.89:3300/0 conn(0x7f98600d0b80 0x7f98600cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f9864c75700 1 --2- 172.21.15.81:0/2622149729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98600d02b0 0x7f986006cff0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f986006cd80 tx=0x7f98540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32da412862aa003 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.584+0000 7f985ffff700 1 -- 172.21.15.81:0/2622149729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985400b6b0 con 0x7f98600d02b0 2023-10-07T08:54:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.585+0000 7f985ffff700 1 -- 172.21.15.81:0/2622149729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985400b810 con 0x7f98600d02b0 2023-10-07T08:54:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.585+0000 7f985ffff700 1 -- 172.21.15.81:0/2622149729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985400bbb0 con 0x7f98600d02b0 2023-10-07T08:54:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.585+0000 7f9866478700 1 -- 172.21.15.81:0/2622149729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98600d02b0 msgr2=0x7f986006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.585+0000 7f9866478700 1 --2- 172.21.15.81:0/2622149729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98600d02b0 0x7f986006cff0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f986006cd80 tx=0x7f98540091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:24.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.585+0000 7f9866478700 1 -- 172.21.15.81:0/2622149729 shutdown_connections 2023-10-07T08:54:24.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.585+0000 7f9866478700 1 --2- 172.21.15.81:0/2622149729 >> v2:172.21.15.89:3300/0 conn(0x7f98600d0b80 0x7f98600cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:24.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.585+0000 7f9866478700 1 --2- 172.21.15.81:0/2622149729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98600d02b0 0x7f986006cff0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:24.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.585+0000 7f9866478700 1 -- 172.21.15.81:0/2622149729 >> 172.21.15.81:0/2622149729 conn(0x7f9860063230 msgr2=0x7f9860063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:24.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.585+0000 7f9866478700 1 -- 172.21.15.81:0/2622149729 shutdown_connections 2023-10-07T08:54:24.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.585+0000 7f9866478700 1 -- 172.21.15.81:0/2622149729 wait complete. 2023-10-07T08:54:24.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.586+0000 7f9866478700 1 Processor -- start 2023-10-07T08:54:24.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.586+0000 7f9866478700 1 -- start start 2023-10-07T08:54:24.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.587+0000 7f9866478700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98600d02b0 0x7f98600acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:24.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.587+0000 7f9866478700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98600d0b80 0x7f98600b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:24.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.587+0000 7f9866478700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98600d0f50 0x7f986016a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:24.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.587+0000 7f9866478700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98601571c0 con 0x7f98600d0f50 2023-10-07T08:54:24.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.587+0000 7f9866478700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98600abe20 con 0x7f98600d0b80 2023-10-07T08:54:24.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.587+0000 7f9866478700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98600ac100 con 0x7f98600d02b0 2023-10-07T08:54:24.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.587+0000 7f9865c77700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98600d0f50 0x7f986016a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:24.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.587+0000 7f9865c77700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98600d0f50 0x7f986016a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34966/0 (socket says 172.21.15.81:34966) 2023-10-07T08:54:24.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.587+0000 7f9865c77700 1 -- 172.21.15.81:0/624986750 learned_addr learned my addr 172.21.15.81:0/624986750 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.587+0000 7f9864c75700 1 --2- 172.21.15.81:0/624986750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98600d0b80 0x7f98600b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.587+0000 7f9865476700 1 --2- 172.21.15.81:0/624986750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98600d02b0 0x7f98600acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.588+0000 7f9865c77700 1 -- 172.21.15.81:0/624986750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98600d02b0 msgr2=0x7f98600acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.588+0000 7f9865c77700 1 --2- 172.21.15.81:0/624986750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98600d02b0 0x7f98600acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.588+0000 7f9865c77700 1 -- 172.21.15.81:0/624986750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98600d0b80 msgr2=0x7f98600b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.588+0000 7f9865c77700 1 --2- 172.21.15.81:0/624986750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98600d0b80 0x7f98600b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.588+0000 7f9865c77700 1 -- 172.21.15.81:0/624986750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9854009420 con 0x7f98600d0f50 2023-10-07T08:54:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.588+0000 7f9865c77700 1 --2- 172.21.15.81:0/624986750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98600d0f50 0x7f986016a330 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f985800c530 tx=0x7f9858007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.588+0000 7f985d7fa700 1 -- 172.21.15.81:0/624986750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858005b30 con 0x7f98600d0f50 2023-10-07T08:54:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.588+0000 7f985d7fa700 1 -- 172.21.15.81:0/624986750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9858005c90 con 0x7f98600d0f50 2023-10-07T08:54:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.588+0000 7f9866478700 1 -- 172.21.15.81:0/624986750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98600ac3e0 con 0x7f98600d0f50 2023-10-07T08:54:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.588+0000 7f985d7fa700 1 -- 172.21.15.81:0/624986750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858007320 con 0x7f98600d0f50 2023-10-07T08:54:24.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.588+0000 7f9866478700 1 -- 172.21.15.81:0/624986750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98600ac9a0 con 0x7f98600d0f50 2023-10-07T08:54:24.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.589+0000 7f9866478700 1 -- 172.21.15.81:0/624986750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98600acb90 con 0x7f98600d0f50 2023-10-07T08:54:24.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.589+0000 7f985d7fa700 1 -- 172.21.15.81:0/624986750 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f985801b3b0 con 0x7f98600d0f50 2023-10-07T08:54:24.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.590+0000 7f985d7fa700 1 --2- 172.21.15.81:0/624986750 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f984c066f30 0x7f984c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:24.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.590+0000 7f9865476700 1 --2- 172.21.15.81:0/624986750 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f984c066f30 0x7f984c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:24.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.590+0000 7f985d7fa700 1 -- 172.21.15.81:0/624986750 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f98580837f0 con 0x7f98600d0f50 2023-10-07T08:54:24.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.590+0000 7f985d7fa700 1 -- 172.21.15.81:0/624986750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=197}) v3 -- 0x7f984c06dcf0 con 0x7f98600d0f50 2023-10-07T08:54:24.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.590+0000 7f9865476700 1 --2- 172.21.15.81:0/624986750 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f984c066f30 0x7f984c0693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f985000d6e0 tx=0x7f9850007850 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:24.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.594+0000 7f985d7fa700 1 -- 172.21.15.81:0/624986750 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9858017020 con 0x7f98600d0f50 2023-10-07T08:54:24.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:24.775+0000 7f9866478700 1 -- 172.21.15.81:0/624986750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f98600676e0 con 0x7f98600d0f50 2023-10-07T08:54:25.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.449+0000 7f985d7fa700 1 -- 172.21.15.81:0/624986750 <== mon.0 v2:172.21.15.81:3300/0 7 ==== osd_map(197..197 src has 1..197) v4 ==== 288+0+0 (secure 0 0 0) 0x7f9858054ee0 con 0x7f98600d0f50 2023-10-07T08:54:25.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.449+0000 7f985d7fa700 1 -- 172.21.15.81:0/624986750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=198}) v3 -- 0x7f984c06ca80 con 0x7f98600d0f50 2023-10-07T08:54:25.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.451+0000 7f985d7fa700 1 -- 172.21.15.81:0/624986750 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v197) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9858050b20 con 0x7f98600d0f50 2023-10-07T08:54:25.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.460+0000 7f9866478700 1 -- 172.21.15.81:0/624986750 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f984c066f30 msgr2=0x7f984c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:25.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.460+0000 7f9866478700 1 --2- 172.21.15.81:0/624986750 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f984c066f30 0x7f984c0693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f985000d6e0 tx=0x7f9850007850 comp rx=0 tx=0).stop 2023-10-07T08:54:25.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.460+0000 7f9866478700 1 -- 172.21.15.81:0/624986750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98600d0f50 msgr2=0x7f986016a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:25.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.460+0000 7f9866478700 1 --2- 172.21.15.81:0/624986750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98600d0f50 0x7f986016a330 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f985800c530 tx=0x7f9858007f90 comp rx=0 tx=0).stop 2023-10-07T08:54:25.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.461+0000 7f9866478700 1 -- 172.21.15.81:0/624986750 shutdown_connections 2023-10-07T08:54:25.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.461+0000 7f9866478700 1 --2- 172.21.15.81:0/624986750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98600d0f50 0x7f986016a330 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.461+0000 7f9866478700 1 --2- 172.21.15.81:0/624986750 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f984c066f30 0x7f984c0693e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.461+0000 7f9866478700 1 --2- 172.21.15.81:0/624986750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98600d02b0 0x7f98600acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.461+0000 7f9866478700 1 --2- 172.21.15.81:0/624986750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98600d0b80 0x7f98600b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.461+0000 7f9866478700 1 -- 172.21.15.81:0/624986750 >> 172.21.15.81:0/624986750 conn(0x7f9860063230 msgr2=0x7f9860068780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:25.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.462+0000 7f9866478700 1 -- 172.21.15.81:0/624986750 shutdown_connections 2023-10-07T08:54:25.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.462+0000 7f9866478700 1 -- 172.21.15.81:0/624986750 wait complete. 2023-10-07T08:54:25.464 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-07T08:54:25.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-07T08:54:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.593+0000 7f9bb19fc700 1 Processor -- start 2023-10-07T08:54:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.593+0000 7f9bb19fc700 1 -- start start 2023-10-07T08:54:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.594+0000 7f9bb19fc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9bac06d700 0x7f9bac15b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.594+0000 7f9bb19fc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bac0cf2d0 con 0x7f9bac0d0b80 2023-10-07T08:54:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.594+0000 7f9bb19fc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bac0d0480 con 0x7f9bac0d0f50 2023-10-07T08:54:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.594+0000 7f9bb19fc700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bac15a690 con 0x7f9bac06d700 2023-10-07T08:54:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.594+0000 7f9bb09fa700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9bac0d0b80 0x7f9bac0cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35390/0 (socket says 172.21.15.81:35390) 2023-10-07T08:54:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.594+0000 7f9bb09fa700 1 -- 172.21.15.81:0/1916181990 learned_addr learned my addr 172.21.15.81:0/1916181990 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.594+0000 7f9bb11fb700 1 --2- 172.21.15.81:0/1916181990 >> v2:172.21.15.89:3300/0 conn(0x7f9bac06d700 0x7f9bac15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.594+0000 7f9bab7fe700 1 -- 172.21.15.81:0/1916181990 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902428559 0 0) 0x7f9bac0cf2d0 con 0x7f9bac0d0b80 2023-10-07T08:54:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.594+0000 7f9bab7fe700 1 -- 172.21.15.81:0/1916181990 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b94003570 con 0x7f9bac0d0b80 2023-10-07T08:54:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.594+0000 7f9bab7fe700 1 -- 172.21.15.81:0/1916181990 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 815793946 0 0) 0x7f9b94003570 con 0x7f9bac0d0b80 2023-10-07T08:54:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.594+0000 7f9bab7fe700 1 -- 172.21.15.81:0/1916181990 >> v2:172.21.15.89:3300/0 conn(0x7f9bac06d700 msgr2=0x7f9bac15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.594+0000 7f9bab7fe700 1 --2- 172.21.15.81:0/1916181990 >> v2:172.21.15.89:3300/0 conn(0x7f9bac06d700 0x7f9bac15b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.594+0000 7f9bab7fe700 1 -- 172.21.15.81:0/1916181990 >> v1:172.21.15.89:6789/0 conn(0x7f9bac0d0f50 legacy=0x7f9bac06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.594+0000 7f9bab7fe700 1 -- 172.21.15.81:0/1916181990 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac06dc00 con 0x7f9bac0d0b80 2023-10-07T08:54:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.594+0000 7f9bab7fe700 1 -- 172.21.15.81:0/1916181990 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f9ba40017f0 con 0x7f9bac0d0b80 2023-10-07T08:54:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.594+0000 7f9bab7fe700 1 -- 172.21.15.81:0/1916181990 >> v1:172.21.15.81:6789/0 conn(0x7f9bac0d0b80 legacy=0x7f9bac0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bab7fe700 1 --2- 172.21.15.81:0/1916181990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b94003a60 0x7f9b94003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bab7fe700 1 --2- 172.21.15.81:0/1916181990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b94004810 0x7f9b94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bab7fe700 1 --2- 172.21.15.81:0/1916181990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b940051c0 0x7f9b9400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:25.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bab7fe700 1 -- 172.21.15.81:0/1916181990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac15a690 con 0x7f9b94003a60 2023-10-07T08:54:25.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bab7fe700 1 -- 172.21.15.81:0/1916181990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9400c0d0 con 0x7f9b94004810 2023-10-07T08:54:25.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bab7fe700 1 -- 172.21.15.81:0/1916181990 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9400c290 con 0x7f9b940051c0 2023-10-07T08:54:25.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bb09fa700 1 --2- 172.21.15.81:0/1916181990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b94003a60 0x7f9b94003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:25.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9babfff700 1 --2- 172.21.15.81:0/1916181990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b94004810 0x7f9b94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:25.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bb11fb700 1 --2- 172.21.15.81:0/1916181990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b940051c0 0x7f9b9400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:25.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bb09fa700 1 -- 172.21.15.81:0/1916181990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b940051c0 msgr2=0x7f9b9400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:25.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bb09fa700 1 --2- 172.21.15.81:0/1916181990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b940051c0 0x7f9b9400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bb09fa700 1 -- 172.21.15.81:0/1916181990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b94004810 msgr2=0x7f9b94004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:25.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bb09fa700 1 --2- 172.21.15.81:0/1916181990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b94004810 0x7f9b94004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bb09fa700 1 -- 172.21.15.81:0/1916181990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b94003570 con 0x7f9b94003a60 2023-10-07T08:54:25.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bb11fb700 1 -- 172.21.15.81:0/1916181990 reap_dead start 2023-10-07T08:54:25.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9babfff700 1 --2- 172.21.15.81:0/1916181990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b94004810 0x7f9b94004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:25.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bb09fa700 1 --2- 172.21.15.81:0/1916181990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b94003a60 0x7f9b94003e70 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400a930 tx=0x7f9ba40021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e709525c0ddaa1b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:25.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bab7fe700 1 -- 172.21.15.81:0/1916181990 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40070d0 con 0x7f9b94003a60 2023-10-07T08:54:25.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bab7fe700 1 -- 172.21.15.81:0/1916181990 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba4007230 con 0x7f9b94003a60 2023-10-07T08:54:25.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.595+0000 7f9bab7fe700 1 -- 172.21.15.81:0/1916181990 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40075d0 con 0x7f9b94003a60 2023-10-07T08:54:25.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.596+0000 7f9bb19fc700 1 -- 172.21.15.81:0/1916181990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b94003a60 msgr2=0x7f9b94003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:25.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.596+0000 7f9bb19fc700 1 --2- 172.21.15.81:0/1916181990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b94003a60 0x7f9b94003e70 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400a930 tx=0x7f9ba40021d0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.596+0000 7f9bb19fc700 1 -- 172.21.15.81:0/1916181990 shutdown_connections 2023-10-07T08:54:25.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.596+0000 7f9bb19fc700 1 --2- 172.21.15.81:0/1916181990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b94003a60 0x7f9b94003e70 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.596+0000 7f9bb19fc700 1 -- 172.21.15.81:0/1916181990 >> 172.21.15.81:0/1916181990 conn(0x7f9bac063230 msgr2=0x7f9bac063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:25.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.596+0000 7f9bb19fc700 1 -- 172.21.15.81:0/1916181990 shutdown_connections 2023-10-07T08:54:25.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.596+0000 7f9bb19fc700 1 -- 172.21.15.81:0/1916181990 wait complete. 2023-10-07T08:54:25.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.597+0000 7f9bb19fc700 1 Processor -- start 2023-10-07T08:54:25.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.597+0000 7f9bb19fc700 1 -- start start 2023-10-07T08:54:25.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb19fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b94003a60 0x7f9bac14a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:25.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb19fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9bac16d840 0x7f9bac0af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:25.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb19fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bac0af940 0x7f9bac15b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:25.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb19fc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac14ac60 con 0x7f9b94003a60 2023-10-07T08:54:25.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb19fc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac16dd40 con 0x7f9bac0af940 2023-10-07T08:54:25.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb19fc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac16e020 con 0x7f9bac16d840 2023-10-07T08:54:25.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb09fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b94003a60 0x7f9bac14a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:25.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb09fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b94003a60 0x7f9bac14a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34988/0 (socket says 172.21.15.81:34988) 2023-10-07T08:54:25.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb09fa700 1 -- 172.21.15.81:0/3064586503 learned_addr learned my addr 172.21.15.81:0/3064586503 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:25.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb11fb700 1 --2- 172.21.15.81:0/3064586503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bac0af940 0x7f9bac15b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:25.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9babfff700 1 --2- 172.21.15.81:0/3064586503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9bac16d840 0x7f9bac0af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:25.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb09fa700 1 -- 172.21.15.81:0/3064586503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9bac16d840 msgr2=0x7f9bac0af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:25.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb09fa700 1 --2- 172.21.15.81:0/3064586503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9bac16d840 0x7f9bac0af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb09fa700 1 -- 172.21.15.81:0/3064586503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bac0af940 msgr2=0x7f9bac15b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:25.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb09fa700 1 --2- 172.21.15.81:0/3064586503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bac0af940 0x7f9bac15b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb09fa700 1 -- 172.21.15.81:0/3064586503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac16e300 con 0x7f9b94003a60 2023-10-07T08:54:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb11fb700 1 --2- 172.21.15.81:0/3064586503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bac0af940 0x7f9bac15b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9babfff700 1 --2- 172.21.15.81:0/3064586503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9bac16d840 0x7f9bac0af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb09fa700 1 --2- 172.21.15.81:0/3064586503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b94003a60 0x7f9bac14a720 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400c0a0 tx=0x7f9ba4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9ba8ff9700 1 -- 172.21.15.81:0/3064586503 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40075b0 con 0x7f9b94003a60 2023-10-07T08:54:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9ba8ff9700 1 -- 172.21.15.81:0/3064586503 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba4027470 con 0x7f9b94003a60 2023-10-07T08:54:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb19fc700 1 -- 172.21.15.81:0/3064586503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bac16e5e0 con 0x7f9b94003a60 2023-10-07T08:54:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9ba8ff9700 1 -- 172.21.15.81:0/3064586503 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4027850 con 0x7f9b94003a60 2023-10-07T08:54:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.598+0000 7f9bb19fc700 1 -- 172.21.15.81:0/3064586503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bac0aeae0 con 0x7f9b94003a60 2023-10-07T08:54:25.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.599+0000 7f9bb19fc700 1 -- 172.21.15.81:0/3064586503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bac16a600 con 0x7f9b94003a60 2023-10-07T08:54:25.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.600+0000 7f9ba8ff9700 1 -- 172.21.15.81:0/3064586503 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ba4024070 con 0x7f9b94003a60 2023-10-07T08:54:25.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.600+0000 7f9ba8ff9700 1 --2- 172.21.15.81:0/3064586503 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b98066f30 0x7f9b980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:25.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.600+0000 7f9ba8ff9700 1 -- 172.21.15.81:0/3064586503 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9ba4086ac0 con 0x7f9b94003a60 2023-10-07T08:54:25.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.600+0000 7f9babfff700 1 --2- 172.21.15.81:0/3064586503 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b98066f30 0x7f9b980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:25.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.600+0000 7f9babfff700 1 --2- 172.21.15.81:0/3064586503 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b98066f30 0x7f9b980693e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0b1430 tx=0x7f9ba0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:25.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.604+0000 7f9ba8ff9700 1 -- 172.21.15.81:0/3064586503 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ba4054030 con 0x7f9b94003a60 2023-10-07T08:54:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.788+0000 7f9bb19fc700 1 -- 172.21.15.81:0/3064586503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9bac0aecd0 con 0x7f9b94003a60 2023-10-07T08:54:25.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.791+0000 7f9ba8ff9700 1 -- 172.21.15.81:0/3064586503 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9bac0aecd0 con 0x7f9b94003a60 2023-10-07T08:54:25.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.793+0000 7f9bb19fc700 1 -- 172.21.15.81:0/3064586503 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b98066f30 msgr2=0x7f9b980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:25.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.793+0000 7f9bb19fc700 1 --2- 172.21.15.81:0/3064586503 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b98066f30 0x7f9b980693e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0b1430 tx=0x7f9ba0009040 comp rx=0 tx=0).stop 2023-10-07T08:54:25.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.793+0000 7f9bb19fc700 1 -- 172.21.15.81:0/3064586503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b94003a60 msgr2=0x7f9bac14a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:25.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.793+0000 7f9bb19fc700 1 --2- 172.21.15.81:0/3064586503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b94003a60 0x7f9bac14a720 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400c0a0 tx=0x7f9ba4016000 comp rx=0 tx=0).stop 2023-10-07T08:54:25.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.793+0000 7f9bb19fc700 1 -- 172.21.15.81:0/3064586503 shutdown_connections 2023-10-07T08:54:25.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.793+0000 7f9bb19fc700 1 --2- 172.21.15.81:0/3064586503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bac0af940 0x7f9bac15b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.793+0000 7f9bb19fc700 1 --2- 172.21.15.81:0/3064586503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b94003a60 0x7f9bac14a720 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.793+0000 7f9bb19fc700 1 --2- 172.21.15.81:0/3064586503 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f9b98066f30 0x7f9b980693e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.793+0000 7f9bb19fc700 1 --2- 172.21.15.81:0/3064586503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9bac16d840 0x7f9bac0af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.793+0000 7f9bb19fc700 1 -- 172.21.15.81:0/3064586503 >> 172.21.15.81:0/3064586503 conn(0x7f9bac063230 msgr2=0x7f9bac0b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:25.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.793+0000 7f9bb19fc700 1 -- 172.21.15.81:0/3064586503 shutdown_connections 2023-10-07T08:54:25.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.793+0000 7f9bb19fc700 1 -- 172.21.15.81:0/3064586503 wait complete. 2023-10-07T08:54:25.807 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-10-07T08:54:25.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.920+0000 7f88477c3700 1 Processor -- start 2023-10-07T08:54:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.920+0000 7f88477c3700 1 -- start start 2023-10-07T08:54:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f88477c3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f88401578d0 0x7f88400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f88477c3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f884006d120 0x7f884006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f88477c3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88400d07c0 con 0x7f8840157ca0 2023-10-07T08:54:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f88477c3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884006da50 con 0x7f884006d120 2023-10-07T08:54:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f88477c3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88400cfbb0 con 0x7f88401578d0 2023-10-07T08:54:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f8845d60700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f884006d120 0x7f884006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f8844d5e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8840157ca0 0x7f884015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35404/0 (socket says 172.21.15.81:35404) 2023-10-07T08:54:25.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f8844d5e700 1 -- 172.21.15.81:0/2168610196 learned_addr learned my addr 172.21.15.81:0/2168610196 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:25.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f884555f700 1 --2- 172.21.15.81:0/2168610196 >> v2:172.21.15.89:3300/0 conn(0x7f88401578d0 0x7f88400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:25.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f8845d60700 1 -- 172.21.15.81:0/2168610196 >> v2:172.21.15.89:3300/0 conn(0x7f88401578d0 msgr2=0x7f88400cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:25.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f8845d60700 1 --2- 172.21.15.81:0/2168610196 >> v2:172.21.15.89:3300/0 conn(0x7f88401578d0 0x7f88400cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f8845d60700 1 -- 172.21.15.81:0/2168610196 >> v1:172.21.15.81:6789/0 conn(0x7f8840157ca0 legacy=0x7f884015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:25.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f883ffff700 1 -- 172.21.15.81:0/2168610196 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604345858 0 0) 0x7f88400d07c0 con 0x7f8840157ca0 2023-10-07T08:54:25.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f8845d60700 1 -- 172.21.15.81:0/2168610196 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88400cfe90 con 0x7f884006d120 2023-10-07T08:54:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f8845d60700 1 --2- 172.21.15.81:0/2168610196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884006d120 0x7f884006d510 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f88400646b0 tx=0x7f88300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0c7063051de13c server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f883ffff700 1 -- 172.21.15.81:0/2168610196 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883000b6b0 con 0x7f884006d120 2023-10-07T08:54:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f883ffff700 1 -- 172.21.15.81:0/2168610196 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883000b810 con 0x7f884006d120 2023-10-07T08:54:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.921+0000 7f883ffff700 1 -- 172.21.15.81:0/2168610196 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883000bbb0 con 0x7f884006d120 2023-10-07T08:54:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.922+0000 7f88477c3700 1 -- 172.21.15.81:0/2168610196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884006d120 msgr2=0x7f884006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.922+0000 7f88477c3700 1 --2- 172.21.15.81:0/2168610196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884006d120 0x7f884006d510 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f88400646b0 tx=0x7f88300091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.922+0000 7f88477c3700 1 -- 172.21.15.81:0/2168610196 shutdown_connections 2023-10-07T08:54:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.922+0000 7f88477c3700 1 --2- 172.21.15.81:0/2168610196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884006d120 0x7f884006d510 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.922+0000 7f88477c3700 1 --2- 172.21.15.81:0/2168610196 >> v2:172.21.15.89:3300/0 conn(0x7f88401578d0 0x7f88400cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.922+0000 7f88477c3700 1 -- 172.21.15.81:0/2168610196 >> 172.21.15.81:0/2168610196 conn(0x7f884006bb90 msgr2=0x7f884006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.922+0000 7f88477c3700 1 -- 172.21.15.81:0/2168610196 shutdown_connections 2023-10-07T08:54:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.922+0000 7f88477c3700 1 -- 172.21.15.81:0/2168610196 wait complete. 2023-10-07T08:54:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.923+0000 7f88477c3700 1 Processor -- start 2023-10-07T08:54:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.923+0000 7f88477c3700 1 -- start start 2023-10-07T08:54:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.924+0000 7f88477c3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884006d120 0x7f88400b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.924+0000 7f88477c3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88401578d0 0x7f88400ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.924+0000 7f88477c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8840157ca0 0x7f8840159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.924+0000 7f88477c3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88400b6240 con 0x7f884006d120 2023-10-07T08:54:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.924+0000 7f88477c3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88400b6490 con 0x7f88401578d0 2023-10-07T08:54:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.924+0000 7f88477c3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88400b6770 con 0x7f8840157ca0 2023-10-07T08:54:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.924+0000 7f884555f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884006d120 0x7f88400b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.924+0000 7f884555f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884006d120 0x7f88400b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35004/0 (socket says 172.21.15.81:35004) 2023-10-07T08:54:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.924+0000 7f884555f700 1 -- 172.21.15.81:0/709490433 learned_addr learned my addr 172.21.15.81:0/709490433 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.924+0000 7f8844d5e700 1 --2- 172.21.15.81:0/709490433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88401578d0 0x7f88400ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.924+0000 7f884555f700 1 -- 172.21.15.81:0/709490433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8840157ca0 msgr2=0x7f8840159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.924+0000 7f884555f700 1 --2- 172.21.15.81:0/709490433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8840157ca0 0x7f8840159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.924+0000 7f884555f700 1 -- 172.21.15.81:0/709490433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88401578d0 msgr2=0x7f88400ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.924+0000 7f884555f700 1 --2- 172.21.15.81:0/709490433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88401578d0 0x7f88400ab350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.924+0000 7f884555f700 1 -- 172.21.15.81:0/709490433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830009420 con 0x7f884006d120 2023-10-07T08:54:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.924+0000 7f884555f700 1 --2- 172.21.15.81:0/709490433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884006d120 0x7f88400b5b80 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f883800e190 tx=0x7f8838009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:25.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.925+0000 7f883d7fa700 1 -- 172.21.15.81:0/709490433 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883800ee30 con 0x7f884006d120 2023-10-07T08:54:25.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.925+0000 7f883d7fa700 1 -- 172.21.15.81:0/709490433 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8838014420 con 0x7f884006d120 2023-10-07T08:54:25.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.925+0000 7f88477c3700 1 -- 172.21.15.81:0/709490433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88400b6a50 con 0x7f884006d120 2023-10-07T08:54:25.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.925+0000 7f883d7fa700 1 -- 172.21.15.81:0/709490433 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88380147e0 con 0x7f884006d120 2023-10-07T08:54:25.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.925+0000 7f88477c3700 1 -- 172.21.15.81:0/709490433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88400ab910 con 0x7f884006d120 2023-10-07T08:54:25.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.926+0000 7f88477c3700 1 -- 172.21.15.81:0/709490433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884016a740 con 0x7f884006d120 2023-10-07T08:54:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.926+0000 7f883d7fa700 1 -- 172.21.15.81:0/709490433 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8838014b90 con 0x7f884006d120 2023-10-07T08:54:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.926+0000 7f883d7fa700 1 --2- 172.21.15.81:0/709490433 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f882c066f30 0x7f882c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.926+0000 7f883d7fa700 1 -- 172.21.15.81:0/709490433 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8838084a70 con 0x7f884006d120 2023-10-07T08:54:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.926+0000 7f8844d5e700 1 --2- 172.21.15.81:0/709490433 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f882c066f30 0x7f882c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:25.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.927+0000 7f8844d5e700 1 --2- 172.21.15.81:0/709490433 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f882c066f30 0x7f882c0693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f88400b60e0 tx=0x7f8834009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:25.930+0000 7f883d7fa700 1 -- 172.21.15.81:0/709490433 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8838051fe0 con 0x7f884006d120 2023-10-07T08:54:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:26.190+0000 7f88477c3700 1 -- 172.21.15.81:0/709490433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f88400d0170 con 0x7f884006d120 2023-10-07T08:54:26.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:26.442+0000 7f883d7fa700 1 -- 172.21.15.81:0/709490433 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v539) v1 ==== 135+0+0 (secure 0 0 0) 0x7f8838009a60 con 0x7f884006d120 2023-10-07T08:54:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:26.444+0000 7f88477c3700 1 -- 172.21.15.81:0/709490433 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f882c066f30 msgr2=0x7f882c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:26.444+0000 7f88477c3700 1 --2- 172.21.15.81:0/709490433 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f882c066f30 0x7f882c0693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f88400b60e0 tx=0x7f8834009040 comp rx=0 tx=0).stop 2023-10-07T08:54:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:26.444+0000 7f88477c3700 1 -- 172.21.15.81:0/709490433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884006d120 msgr2=0x7f88400b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:26.444+0000 7f88477c3700 1 --2- 172.21.15.81:0/709490433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884006d120 0x7f88400b5b80 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f883800e190 tx=0x7f8838009920 comp rx=0 tx=0).stop 2023-10-07T08:54:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:26.444+0000 7f88477c3700 1 -- 172.21.15.81:0/709490433 shutdown_connections 2023-10-07T08:54:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:26.444+0000 7f88477c3700 1 --2- 172.21.15.81:0/709490433 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f882c066f30 0x7f882c0693e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:26.444+0000 7f88477c3700 1 --2- 172.21.15.81:0/709490433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8840157ca0 0x7f8840159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:26.444+0000 7f88477c3700 1 --2- 172.21.15.81:0/709490433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884006d120 0x7f88400b5b80 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:26.444+0000 7f88477c3700 1 --2- 172.21.15.81:0/709490433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88401578d0 0x7f88400ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:26.444+0000 7f88477c3700 1 -- 172.21.15.81:0/709490433 >> 172.21.15.81:0/709490433 conn(0x7f884006bb90 msgr2=0x7f88401554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:26.444+0000 7f88477c3700 1 -- 172.21.15.81:0/709490433 shutdown_connections 2023-10-07T08:54:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:26.444+0000 7f88477c3700 1 -- 172.21.15.81:0/709490433 wait complete. 2023-10-07T08:54:26.457 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-07T08:54:26.458 INFO:tasks.cephfs_test_runner: 2023-10-07T08:54:26.458 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-07T08:54:26.458 INFO:tasks.cephfs_test_runner:Ran 10 tests in 658.927s 2023-10-07T08:54:26.458 INFO:tasks.cephfs_test_runner: 2023-10-07T08:54:26.458 INFO:tasks.cephfs_test_runner:OK 2023-10-07T08:54:26.458 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-07T08:54:26.469 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-07T08:54:26.478 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-07T08:54:26.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:54:26.479 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-07T08:54:26.493 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-07T08:54:26.493 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-07T08:54:26.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:54:26.494 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-07T08:54:26.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:54:26.579 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:54:26.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:54:26.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-07T08:54:26.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:54:26.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-10-07T08:54:26.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:54:26.763 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-07T08:54:26.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:54:26.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-10-07T08:54:26.846 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2023-10-07T08:54:26.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:54:26.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:54:26.848 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-07T08:54:26.864 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-07T08:54:26.864 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-07T08:54:26.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:54:26.865 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-07T08:54:26.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:54:26.948 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-07T08:54:27.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:54:27.032 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2023-10-07T08:54:27.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:54:27.125 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-07T08:54:27.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-07T08:54:27.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2023-10-07T08:54:27.209 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2023-10-07T08:54:27.210 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:54:27.211 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-07T08:54:27.221 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-07T08:54:27.222 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:54:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.337+0000 7feb1dd60700 1 Processor -- start 2023-10-07T08:54:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.337+0000 7feb1dd60700 1 -- start start 2023-10-07T08:54:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.338+0000 7feb1dd60700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb180aeea0 0x7feb180c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.338+0000 7feb1dd60700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1806aae0 con 0x7feb180af270 2023-10-07T08:54:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.338+0000 7feb1dd60700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb18069ed0 con 0x7feb180c8410 2023-10-07T08:54:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.338+0000 7feb1dd60700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1806a1b0 con 0x7feb180aeea0 2023-10-07T08:54:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.338+0000 7feb16ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feb180af270 0x7feb180c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35410/0 (socket says 172.21.15.81:35410) 2023-10-07T08:54:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.338+0000 7feb16ffd700 1 -- 172.21.15.81:0/3014331007 learned_addr learned my addr 172.21.15.81:0/3014331007 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.339+0000 7feb177fe700 1 --2- 172.21.15.81:0/3014331007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb180aeea0 0x7feb180c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.339+0000 7feb167fc700 1 -- 172.21.15.81:0/3014331007 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147649936 0 0) 0x7feb1806aae0 con 0x7feb180af270 2023-10-07T08:54:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.339+0000 7feb167fc700 1 -- 172.21.15.81:0/3014331007 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb00003570 con 0x7feb180af270 2023-10-07T08:54:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.339+0000 7feb167fc700 1 -- 172.21.15.81:0/3014331007 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1328223205 0 0) 0x7feb18069ed0 con 0x7feb180c8410 2023-10-07T08:54:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.339+0000 7feb167fc700 1 -- 172.21.15.81:0/3014331007 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb1806aae0 con 0x7feb180c8410 2023-10-07T08:54:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.339+0000 7feb177fe700 1 -- 172.21.15.81:0/3014331007 >> v1:172.21.15.89:6789/0 conn(0x7feb180c8410 legacy=0x7feb180ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.339+0000 7feb177fe700 1 -- 172.21.15.81:0/3014331007 >> v1:172.21.15.81:6789/0 conn(0x7feb180af270 legacy=0x7feb180c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.339+0000 7feb177fe700 1 -- 172.21.15.81:0/3014331007 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1806a490 con 0x7feb180aeea0 2023-10-07T08:54:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.339+0000 7feb177fe700 1 --2- 172.21.15.81:0/3014331007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb180aeea0 0x7feb180c2920 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feb08009910 tx=0x7feb080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=523a301b0b7113bf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.339+0000 7feb167fc700 1 -- 172.21.15.81:0/3014331007 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0800b690 con 0x7feb180aeea0 2023-10-07T08:54:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.339+0000 7feb167fc700 1 -- 172.21.15.81:0/3014331007 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0800b7f0 con 0x7feb180aeea0 2023-10-07T08:54:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.339+0000 7feb167fc700 1 -- 172.21.15.81:0/3014331007 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0800bb90 con 0x7feb180aeea0 2023-10-07T08:54:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.340+0000 7feb1dd60700 1 -- 172.21.15.81:0/3014331007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb180aeea0 msgr2=0x7feb180c2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.340+0000 7feb1dd60700 1 --2- 172.21.15.81:0/3014331007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb180aeea0 0x7feb180c2920 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feb08009910 tx=0x7feb080091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.340+0000 7feb1dd60700 1 -- 172.21.15.81:0/3014331007 shutdown_connections 2023-10-07T08:54:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.340+0000 7feb1dd60700 1 --2- 172.21.15.81:0/3014331007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb180aeea0 0x7feb180c2920 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.340+0000 7feb1dd60700 1 -- 172.21.15.81:0/3014331007 >> 172.21.15.81:0/3014331007 conn(0x7feb1806c660 msgr2=0x7feb180cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.340+0000 7feb1dd60700 1 -- 172.21.15.81:0/3014331007 shutdown_connections 2023-10-07T08:54:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.340+0000 7feb1dd60700 1 -- 172.21.15.81:0/3014331007 wait complete. 2023-10-07T08:54:27.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.341+0000 7feb1dd60700 1 Processor -- start 2023-10-07T08:54:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.341+0000 7feb1dd60700 1 -- start start 2023-10-07T08:54:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb1dd60700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb180aeea0 0x7feb181415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb1dd60700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb180af270 0x7feb18140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb1dd60700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb180c8410 0x7feb180c1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb1dd60700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb180c6f10 con 0x7feb180af270 2023-10-07T08:54:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb1dd60700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb180c46b0 con 0x7feb180aeea0 2023-10-07T08:54:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb1dd60700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb18141cd0 con 0x7feb180c8410 2023-10-07T08:54:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb16ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb180af270 0x7feb18140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:27.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb177fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb180aeea0 0x7feb181415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb177fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb180aeea0 0x7feb181415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:53650/0 (socket says 172.21.15.81:53650) 2023-10-07T08:54:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb177fe700 1 -- 172.21.15.81:0/2111178779 learned_addr learned my addr 172.21.15.81:0/2111178779 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb16ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb180af270 0x7feb18140d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35010/0 (socket says 172.21.15.81:35010) 2023-10-07T08:54:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb17fff700 1 --2- 172.21.15.81:0/2111178779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb180c8410 0x7feb180c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb177fe700 1 -- 172.21.15.81:0/2111178779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb180c8410 msgr2=0x7feb180c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb177fe700 1 --2- 172.21.15.81:0/2111178779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb180c8410 0x7feb180c1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb177fe700 1 -- 172.21.15.81:0/2111178779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb180af270 msgr2=0x7feb18140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb177fe700 1 --2- 172.21.15.81:0/2111178779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb180af270 0x7feb18140d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb177fe700 1 -- 172.21.15.81:0/2111178779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb08009420 con 0x7feb180aeea0 2023-10-07T08:54:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.342+0000 7feb16ffd700 1 --2- 172.21.15.81:0/2111178779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb180af270 0x7feb18140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:54:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.343+0000 7feb177fe700 1 --2- 172.21.15.81:0/2111178779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb180aeea0 0x7feb181415f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7feb18064700 tx=0x7feb08017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.343+0000 7feaff7fe700 1 -- 172.21.15.81:0/2111178779 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08000c90 con 0x7feb180aeea0 2023-10-07T08:54:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.343+0000 7feaff7fe700 1 -- 172.21.15.81:0/2111178779 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0800b960 con 0x7feb180aeea0 2023-10-07T08:54:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.343+0000 7feb1dd60700 1 -- 172.21.15.81:0/2111178779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb18141fb0 con 0x7feb180aeea0 2023-10-07T08:54:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.343+0000 7feaff7fe700 1 -- 172.21.15.81:0/2111178779 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08025420 con 0x7feb180aeea0 2023-10-07T08:54:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.343+0000 7feb1dd60700 1 -- 172.21.15.81:0/2111178779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb18142570 con 0x7feb180aeea0 2023-10-07T08:54:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.344+0000 7feb1dd60700 1 -- 172.21.15.81:0/2111178779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb18067bc0 con 0x7feb180aeea0 2023-10-07T08:54:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.344+0000 7feaff7fe700 1 -- 172.21.15.81:0/2111178779 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb08023070 con 0x7feb180aeea0 2023-10-07T08:54:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.344+0000 7feaff7fe700 1 --2- 172.21.15.81:0/2111178779 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb04066fe0 0x7feb04069490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.345+0000 7feaff7fe700 1 -- 172.21.15.81:0/2111178779 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7feb08085780 con 0x7feb180aeea0 2023-10-07T08:54:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.345+0000 7feb16ffd700 1 --2- 172.21.15.81:0/2111178779 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb04066fe0 0x7feb04069490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:27.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.345+0000 7feb16ffd700 1 --2- 172.21.15.81:0/2111178779 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb04066fe0 0x7feb04069490 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7feb180c2500 tx=0x7feb0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.349+0000 7feaff7fe700 1 -- 172.21.15.81:0/2111178779 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb08052c50 con 0x7feb180aeea0 2023-10-07T08:54:27.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.534+0000 7feb1dd60700 1 -- 172.21.15.81:0/2111178779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb1804bb80 con 0x7feb180aeea0 2023-10-07T08:54:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.535+0000 7feaff7fe700 1 -- 172.21.15.81:0/2111178779 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+12226 (secure 0 0 0) 0x7feb08056270 con 0x7feb180aeea0 2023-10-07T08:54:27.537 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:27.537 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":197,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:54:25.439800+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6836/2531199109":"2023-10-08T08:54:22.284103+0000","172.21.15.81:6834/2531199109":"2023-10-08T08:54:22.284103+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.537+0000 7feb1dd60700 1 -- 172.21.15.81:0/2111178779 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb04066fe0 msgr2=0x7feb04069490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.537+0000 7feb1dd60700 1 --2- 172.21.15.81:0/2111178779 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb04066fe0 0x7feb04069490 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7feb180c2500 tx=0x7feb0c009040 comp rx=0 tx=0).stop 2023-10-07T08:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.537+0000 7feb1dd60700 1 -- 172.21.15.81:0/2111178779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb180aeea0 msgr2=0x7feb181415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.537+0000 7feb1dd60700 1 --2- 172.21.15.81:0/2111178779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb180aeea0 0x7feb181415f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7feb18064700 tx=0x7feb08017000 comp rx=0 tx=0).stop 2023-10-07T08:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.537+0000 7feb1dd60700 1 -- 172.21.15.81:0/2111178779 shutdown_connections 2023-10-07T08:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.537+0000 7feb1dd60700 1 --2- 172.21.15.81:0/2111178779 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7feb04066fe0 0x7feb04069490 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.537+0000 7feb1dd60700 1 --2- 172.21.15.81:0/2111178779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb180c8410 0x7feb180c1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.537+0000 7feb1dd60700 1 --2- 172.21.15.81:0/2111178779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb180aeea0 0x7feb181415f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.537+0000 7feb1dd60700 1 --2- 172.21.15.81:0/2111178779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb180af270 0x7feb18140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.537+0000 7feb1dd60700 1 -- 172.21.15.81:0/2111178779 >> 172.21.15.81:0/2111178779 conn(0x7feb1806c660 msgr2=0x7feb181563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.537+0000 7feb1dd60700 1 -- 172.21.15.81:0/2111178779 shutdown_connections 2023-10-07T08:54:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.537+0000 7feb1dd60700 1 -- 172.21.15.81:0/2111178779 wait complete. 2023-10-07T08:54:27.551 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-07T08:54:27.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:54:27.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.663+0000 7fd06f59e700 1 Processor -- start 2023-10-07T08:54:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.663+0000 7fd06f59e700 1 -- start start 2023-10-07T08:54:27.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.664+0000 7fd06f59e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd070159f10 0x7fd070068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.664+0000 7fd06f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd070068cc0 0x7fd0700cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.664+0000 7fd06f59e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd070069120 con 0x7fd070159b40 2023-10-07T08:54:27.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.664+0000 7fd06f59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0700cee10 con 0x7fd070068cc0 2023-10-07T08:54:27.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.664+0000 7fd06f59e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0700cd040 con 0x7fd070159f10 2023-10-07T08:54:27.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.664+0000 7fd06ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd070068cc0 0x7fd0700cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:27.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.664+0000 7fd06ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd070068cc0 0x7fd0700cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35014/0 (socket says 172.21.15.81:35014) 2023-10-07T08:54:27.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.664+0000 7fd06ed9d700 1 -- 172.21.15.81:0/3520974008 learned_addr learned my addr 172.21.15.81:0/3520974008 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:27.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.664+0000 7fd06dd9b700 1 --2- 172.21.15.81:0/3520974008 >> v2:172.21.15.89:3300/0 conn(0x7fd070159f10 0x7fd070068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:27.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.664+0000 7fd06ed9d700 1 -- 172.21.15.81:0/3520974008 >> v2:172.21.15.89:3300/0 conn(0x7fd070159f10 msgr2=0x7fd070068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:27.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.664+0000 7fd06ed9d700 1 --2- 172.21.15.81:0/3520974008 >> v2:172.21.15.89:3300/0 conn(0x7fd070159f10 0x7fd070068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.664+0000 7fd06ed9d700 1 -- 172.21.15.81:0/3520974008 >> v1:172.21.15.89:6789/0 conn(0x7fd070159b40 legacy=0x7fd0700cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.664+0000 7fd06ed9d700 1 -- 172.21.15.81:0/3520974008 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0700cd320 con 0x7fd070068cc0 2023-10-07T08:54:27.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.664+0000 7fd06ed9d700 1 --2- 172.21.15.81:0/3520974008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd070068cc0 0x7fd0700cf2a0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fd07006fd80 tx=0x7fd060009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd28f85ca4f6ced server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:27.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.665+0000 7fd06d59a700 1 -- 172.21.15.81:0/3520974008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060009e70 con 0x7fd070068cc0 2023-10-07T08:54:27.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.665+0000 7fd06d59a700 1 -- 172.21.15.81:0/3520974008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06000b860 con 0x7fd070068cc0 2023-10-07T08:54:27.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.665+0000 7fd06d59a700 1 -- 172.21.15.81:0/3520974008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06000bc00 con 0x7fd070068cc0 2023-10-07T08:54:27.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.665+0000 7fd06f59e700 1 -- 172.21.15.81:0/3520974008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd070068cc0 msgr2=0x7fd0700cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.665+0000 7fd06f59e700 1 --2- 172.21.15.81:0/3520974008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd070068cc0 0x7fd0700cf2a0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fd07006fd80 tx=0x7fd060009250 comp rx=0 tx=0).stop 2023-10-07T08:54:27.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.665+0000 7fd06f59e700 1 -- 172.21.15.81:0/3520974008 shutdown_connections 2023-10-07T08:54:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.665+0000 7fd06f59e700 1 --2- 172.21.15.81:0/3520974008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd070068cc0 0x7fd0700cf2a0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.665+0000 7fd06f59e700 1 --2- 172.21.15.81:0/3520974008 >> v2:172.21.15.89:3300/0 conn(0x7fd070159f10 0x7fd070068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.665+0000 7fd06f59e700 1 -- 172.21.15.81:0/3520974008 >> 172.21.15.81:0/3520974008 conn(0x7fd0700cd660 msgr2=0x7fd0700cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.665+0000 7fd06f59e700 1 -- 172.21.15.81:0/3520974008 shutdown_connections 2023-10-07T08:54:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.665+0000 7fd06f59e700 1 -- 172.21.15.81:0/3520974008 wait complete. 2023-10-07T08:54:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.666+0000 7fd06f59e700 1 Processor -- start 2023-10-07T08:54:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.666+0000 7fd06f59e700 1 -- start start 2023-10-07T08:54:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.667+0000 7fd06f59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd070068cc0 0x7fd070155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.667+0000 7fd06f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd070159b40 0x7fd070153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.667+0000 7fd06f59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd070159f10 0x7fd07006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.667+0000 7fd06f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd070158810 con 0x7fd070159b40 2023-10-07T08:54:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.667+0000 7fd06f59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0701565a0 con 0x7fd070159f10 2023-10-07T08:54:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.667+0000 7fd06f59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd070156880 con 0x7fd070068cc0 2023-10-07T08:54:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.667+0000 7fd06dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd070159b40 0x7fd070153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.667+0000 7fd06dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd070159b40 0x7fd070153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35022/0 (socket says 172.21.15.81:35022) 2023-10-07T08:54:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.667+0000 7fd06dd9b700 1 -- 172.21.15.81:0/3672916291 learned_addr learned my addr 172.21.15.81:0/3672916291 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.667+0000 7fd06ed9d700 1 --2- 172.21.15.81:0/3672916291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd070159f10 0x7fd07006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.667+0000 7fd06e59c700 1 --2- 172.21.15.81:0/3672916291 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd070068cc0 0x7fd070155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.668+0000 7fd06dd9b700 1 -- 172.21.15.81:0/3672916291 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd070068cc0 msgr2=0x7fd070155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.668+0000 7fd06dd9b700 1 --2- 172.21.15.81:0/3672916291 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd070068cc0 0x7fd070155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.668+0000 7fd06dd9b700 1 -- 172.21.15.81:0/3672916291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd070159f10 msgr2=0x7fd07006ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.668+0000 7fd06dd9b700 1 --2- 172.21.15.81:0/3672916291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd070159f10 0x7fd07006ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.668+0000 7fd06dd9b700 1 -- 172.21.15.81:0/3672916291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0600094f0 con 0x7fd070159b40 2023-10-07T08:54:27.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.668+0000 7fd06e59c700 1 --2- 172.21.15.81:0/3672916291 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd070068cc0 0x7fd070155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:27.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.668+0000 7fd06dd9b700 1 --2- 172.21.15.81:0/3672916291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd070159b40 0x7fd070153a70 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fd06400e930 tx=0x7fd0640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:27.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.668+0000 7fd05e7fc700 1 -- 172.21.15.81:0/3672916291 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd064013680 con 0x7fd070159b40 2023-10-07T08:54:27.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.668+0000 7fd05e7fc700 1 -- 172.21.15.81:0/3672916291 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0640137e0 con 0x7fd070159b40 2023-10-07T08:54:27.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.668+0000 7fd05e7fc700 1 -- 172.21.15.81:0/3672916291 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd064013b80 con 0x7fd070159b40 2023-10-07T08:54:27.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.668+0000 7fd06f59e700 1 -- 172.21.15.81:0/3672916291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd070156b60 con 0x7fd070159b40 2023-10-07T08:54:27.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.668+0000 7fd06f59e700 1 -- 172.21.15.81:0/3672916291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd070153fb0 con 0x7fd070159b40 2023-10-07T08:54:27.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.669+0000 7fd06f59e700 1 -- 172.21.15.81:0/3672916291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0700d0130 con 0x7fd070159b40 2023-10-07T08:54:27.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.669+0000 7fd05e7fc700 1 -- 172.21.15.81:0/3672916291 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd06400c460 con 0x7fd070159b40 2023-10-07T08:54:27.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.670+0000 7fd05e7fc700 1 --2- 172.21.15.81:0/3672916291 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd050066f30 0x7fd0500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.670+0000 7fd05e7fc700 1 -- 172.21.15.81:0/3672916291 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd064084440 con 0x7fd070159b40 2023-10-07T08:54:27.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.670+0000 7fd06e59c700 1 --2- 172.21.15.81:0/3672916291 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd050066f30 0x7fd0500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:27.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.670+0000 7fd06e59c700 1 --2- 172.21.15.81:0/3672916291 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd050066f30 0x7fd0500693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd068007fd0 tx=0x7fd068009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:27.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.674+0000 7fd05e7fc700 1 -- 172.21.15.81:0/3672916291 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd064051910 con 0x7fd070159b40 2023-10-07T08:54:27.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.850+0000 7fd06f59e700 1 -- 172.21.15.81:0/3672916291 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd070063e90 con 0x7fd050066f30 2023-10-07T08:54:27.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.852+0000 7fd05e7fc700 1 -- 172.21.15.81:0/3672916291 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50261 (secure 0 0 0) 0x7fd070063e90 con 0x7fd050066f30 2023-10-07T08:54:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.854+0000 7fd06f59e700 1 -- 172.21.15.81:0/3672916291 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd050066f30 msgr2=0x7fd0500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.854+0000 7fd06f59e700 1 --2- 172.21.15.81:0/3672916291 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd050066f30 0x7fd0500693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd068007fd0 tx=0x7fd068009040 comp rx=0 tx=0).stop 2023-10-07T08:54:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.854+0000 7fd06f59e700 1 -- 172.21.15.81:0/3672916291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd070159b40 msgr2=0x7fd070153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.854+0000 7fd06f59e700 1 --2- 172.21.15.81:0/3672916291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd070159b40 0x7fd070153a70 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fd06400e930 tx=0x7fd0640091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.854+0000 7fd06f59e700 1 -- 172.21.15.81:0/3672916291 shutdown_connections 2023-10-07T08:54:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.854+0000 7fd06f59e700 1 --2- 172.21.15.81:0/3672916291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd070159f10 0x7fd07006ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.854+0000 7fd06f59e700 1 --2- 172.21.15.81:0/3672916291 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fd050066f30 0x7fd0500693e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.854+0000 7fd06f59e700 1 --2- 172.21.15.81:0/3672916291 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd070068cc0 0x7fd070155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.854+0000 7fd06f59e700 1 --2- 172.21.15.81:0/3672916291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd070159b40 0x7fd070153a70 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.854+0000 7fd06f59e700 1 -- 172.21.15.81:0/3672916291 >> 172.21.15.81:0/3672916291 conn(0x7fd0700cd660 msgr2=0x7fd07006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.854+0000 7fd06f59e700 1 -- 172.21.15.81:0/3672916291 shutdown_connections 2023-10-07T08:54:27.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.854+0000 7fd06f59e700 1 -- 172.21.15.81:0/3672916291 wait complete. 2023-10-07T08:54:27.857 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:54:27.867 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":539,"stamp":"2023-10-07T08:54:26.156969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":112146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450353,"statfs":{"total":1600000000,"available":1485162371,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489239,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-122,"num_write_kb":-85081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000579"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":311,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-07T08:54:23.620845+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:54:23.620845+0000","last_peered":"2023-10-07T08:54:23.620845+0000","last_clean":"2023-10-07T08:54:23.620845+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:54:23.620845+0000","last_undegraded":"2023-10-07T08:54:23.620845+0000","last_fullsized":"2023-10-07T08:54:23.620845+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574990,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9843,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185469,"statfs":{"total":200000000,"available":189920393,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.312,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52200000000000002,"15min":0.504},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":1.2150000000000001},"last":0.68000000000000005}]},{"osd":1,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54600000000000004,"15min":0.53000000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.55500000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":1.1659999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.432,"5min":0.314,"15min":0.314},"max":{"1min":0.72299999999999998,"5min":0.75,"15min":0.80300000000000005},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53600000000000003,"15min":0.51000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.53300000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56299999999999994,"15min":0.67100000000000004},"min":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":6.8570000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.57399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.98999999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.47899999999999998},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":0.71899999999999997,"5min":0.81299999999999994,"15min":0.98599999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.32400000000000001,"15min":0.26700000000000002},"max":{"1min":0.73599999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.47899999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.50800000000000001,"15min":0.501},"min":{"1min":0.34699999999999998,"5min":0.30499999999999999,"15min":0.27800000000000002},"max":{"1min":0.67500000000000004,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.36399999999999999,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":1.0669999999999999},"last":0.42099999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.34599999999999997},"max":{"1min":0.75600000000000001,"5min":0.78600000000000003,"15min":1.1020000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58599999999999997,"15min":0.56899999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.307},"max":{"1min":0.82999999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54600000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574990,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19506,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175805,"statfs":{"total":200000000,"available":180025001,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51800000000000002,"15min":0.49299999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.25700000000000001},"max":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.76600000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.501},"min":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.30199999999999999},"max":{"1min":0.67800000000000005,"5min":0.70699999999999996,"15min":0.77500000000000002},"last":0.42599999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70599999999999996,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.498},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29799999999999999},"max":{"1min":0.73099999999999998,"5min":0.753,"15min":1.0069999999999999},"last":0.59399999999999997}]},{"osd":2,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.54300000000000004,"15min":0.51500000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.29399999999999998},"max":{"1min":0.60399999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.53100000000000003},"min":{"1min":0.38100000000000001,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":0.71199999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.44400000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59299999999999997,"5min":0.751,"15min":0.752},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68500000000000005,"5min":0.83199999999999996,"15min":2.3879999999999999},"last":0.60399999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.308,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60999999999999999,"5min":0.71899999999999997,"15min":0.73699999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47799999999999998,"15min":0.49199999999999999},"min":{"1min":0.35699999999999998,"5min":0.30499999999999999,"15min":0.27400000000000002},"max":{"1min":0.59999999999999998,"5min":0.73599999999999999,"15min":0.79900000000000004},"last":0.53500000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48099999999999998,"15min":0.5},"min":{"1min":0.40000000000000002,"5min":0.30399999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.86799999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52800000000000002,"15min":0.53700000000000003},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.627}]},{"osd":7,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.372,"5min":0.35499999999999998,"15min":0.312},"max":{"1min":0.69199999999999995,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.375,"5min":0.36299999999999999,"15min":0.35199999999999998},"max":{"1min":0.66200000000000003,"5min":0.76100000000000001,"15min":1.052},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574990,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13362,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181949,"statfs":{"total":200000000,"available":186316457,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.26000000000000001,"5min":0.193,"15min":0.17499999999999999},"max":{"1min":0.50600000000000001,"5min":0.60399999999999998,"15min":1.9359999999999999},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36099999999999999,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.221,"15min":0.192},"max":{"1min":0.47699999999999998,"5min":0.61399999999999999,"15min":0.82999999999999996},"last":0.255}]},{"osd":2,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.33900000000000002},"min":{"1min":0.27800000000000002,"5min":0.224,"15min":0.19600000000000001},"max":{"1min":0.46400000000000002,"5min":0.57799999999999996,"15min":1.639},"last":0.307},{"interface":"front","average":{"1min":0.378,"5min":0.38600000000000001,"15min":0.36399999999999999},"min":{"1min":0.28000000000000003,"5min":0.245,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":0.69599999999999995,"15min":1.9039999999999999},"last":0.26800000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40799999999999997,"15min":0.38500000000000001},"min":{"1min":0.30299999999999999,"5min":0.27200000000000002,"15min":0.249},"max":{"1min":0.57199999999999995,"5min":0.64500000000000002,"15min":1.6819999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39900000000000002,"15min":0.375},"min":{"1min":0.30599999999999999,"5min":0.26500000000000001,"15min":0.24399999999999999},"max":{"1min":0.56899999999999995,"5min":0.63800000000000001,"15min":0.97599999999999998},"last":0.28399999999999997}]},{"osd":4,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57299999999999995,"15min":0.55600000000000005},"min":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.88300000000000001,"15min":0.91600000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.55700000000000005},"min":{"1min":0.42699999999999999,"5min":0.40500000000000003,"15min":0.28599999999999998},"max":{"1min":0.77200000000000002,"5min":0.86399999999999999,"15min":1.9570000000000001},"last":0.48999999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.59699999999999998},"min":{"1min":0.48199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84299999999999997,"5min":0.98199999999999998,"15min":1.0409999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.628,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.40300000000000002,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.89600000000000002,"15min":0.97299999999999998},"last":0.505}]},{"osd":6,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.47599999999999998,"5min":0.379,"15min":0.34200000000000003},"max":{"1min":0.72399999999999998,"5min":0.94299999999999995,"15min":1.2150000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59699999999999998,"15min":0.56399999999999995},"min":{"1min":0.40799999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.76400000000000001,"5min":0.83399999999999996,"15min":0.87},"last":0.65400000000000003}]},{"osd":7,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63400000000000001,"15min":0.60799999999999998},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":1.004,"15min":1.0800000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64600000000000002,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.40799999999999997},"max":{"1min":0.80200000000000005,"5min":0.92700000000000005,"15min":0.94299999999999995},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574990,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9843,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185469,"statfs":{"total":200000000,"available":189920393,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34899999999999998,"15min":0.35599999999999998},"min":{"1min":0.23100000000000001,"5min":0.224,"15min":0.20100000000000001},"max":{"1min":0.45700000000000002,"5min":0.71099999999999997,"15min":1.4339999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.36699999999999999,"15min":0.38100000000000001},"min":{"1min":0.24299999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.498,"5min":0.54300000000000004,"15min":1.079},"last":0.39500000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.372,"15min":0.38},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.61799999999999999,"15min":1.464},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39700000000000002},"min":{"1min":0.28499999999999998,"5min":0.247,"15min":0.21299999999999999},"max":{"1min":0.57999999999999996,"5min":0.627,"15min":1.1060000000000001},"last":0.26100000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.379,"15min":0.378},"min":{"1min":0.26800000000000002,"5min":0.249,"15min":0.23300000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":1.341},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41999999999999998,"15min":0.42599999999999999},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.25700000000000001},"max":{"1min":0.61199999999999999,"5min":0.65700000000000003,"15min":1.532},"last":0.38200000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59599999999999997,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81699999999999995,"5min":0.89400000000000002,"15min":1.3169999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.34699999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.51},"last":0.44700000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.623,"15min":0.60599999999999998},"min":{"1min":0.437,"5min":0.35799999999999998,"15min":0.33700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0529999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.85499999999999998,"5min":0.91000000000000003,"15min":1.25},"last":0.42999999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.48899999999999999,"5min":0.39700000000000002,"15min":0.376},"max":{"1min":0.95699999999999996,"5min":0.95799999999999996,"15min":1.488},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63600000000000001,"15min":0.61199999999999999},"min":{"1min":0.45800000000000002,"5min":0.41999999999999998,"15min":0.39000000000000001},"max":{"1min":0.80400000000000005,"5min":0.94599999999999995,"15min":1.024},"last":0.46000000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.47499999999999998,"5min":0.44,"15min":0.41999999999999998},"max":{"1min":0.873,"5min":0.97799999999999998,"15min":0.98499999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.623,"15min":0.61199999999999999},"min":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.374},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.288},"last":0.46899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574990,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173757,"statfs":{"total":200000000,"available":177927849,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33100000000000002,"15min":0.33500000000000002},"min":{"1min":0.20200000000000001,"5min":0.19400000000000001,"15min":0.17699999999999999},"max":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":1.665},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35899999999999999,"15min":0.35999999999999999},"min":{"1min":0.23899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48899999999999999,"5min":0.54900000000000004,"15min":1.579},"last":0.373}]},{"osd":1,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.374},"min":{"1min":0.23100000000000001,"5min":0.216,"15min":0.20499999999999999},"max":{"1min":0.626,"5min":0.626,"15min":2.4470000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.308,"5min":0.25800000000000001,"15min":0.20200000000000001},"max":{"1min":0.58999999999999997,"5min":0.65000000000000002,"15min":2.4620000000000002},"last":0.28799999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40200000000000002,"15min":0.39500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27100000000000002,"15min":0.24199999999999999},"max":{"1min":0.51600000000000001,"5min":0.56999999999999995,"15min":1.454},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39300000000000002,"15min":0.38900000000000001},"min":{"1min":0.28699999999999998,"5min":0.255,"15min":0.20899999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":1.6919999999999999},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61399999999999999,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.35499999999999998,"15min":0.28199999999999997},"max":{"1min":1.056,"5min":1.056,"15min":1.7210000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63600000000000001,"15min":0.60799999999999998},"min":{"1min":0.53600000000000003,"5min":0.40000000000000002,"15min":0.34100000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.5549999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58999999999999997,"15min":0.56299999999999994},"min":{"1min":0.44800000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.5269999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.58199999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.311},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":1.4039999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.57899999999999996},"min":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.92000000000000004,"5min":0.93999999999999995,"15min":1.3380000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.40799999999999997,"5min":0.371,"15min":0.34399999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.637},"last":0.46899999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.62,"15min":0.60199999999999998},"min":{"1min":0.497,"5min":0.443,"15min":0.379},"max":{"1min":1.014,"5min":1.014,"15min":1.49},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64800000000000002,"15min":0.622},"min":{"1min":0.45800000000000002,"5min":0.43099999999999999,"15min":0.35999999999999999},"max":{"1min":0.96199999999999997,"5min":0.96999999999999997,"15min":1.375},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9261,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186051,"statfs":{"total":200000000,"available":190516516,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.33000000000000002},"min":{"1min":0.24199999999999999,"5min":0.20599999999999999,"15min":0.19400000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":1.8220000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.35899999999999999,"15min":0.33800000000000002},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.93500000000000005},"last":0.22600000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.373,"15min":0.36599999999999999},"min":{"1min":0.25,"5min":0.23200000000000001,"15min":0.185},"max":{"1min":0.55900000000000005,"5min":0.65200000000000002,"15min":1.6519999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.254,"5min":0.23100000000000001,"15min":0.22500000000000001},"max":{"1min":0.51300000000000001,"5min":0.63700000000000001,"15min":1.885},"last":0.252}]},{"osd":2,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.38500000000000001},"min":{"1min":0.27500000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":1.274},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40400000000000003,"15min":0.40500000000000003},"min":{"1min":0.28899999999999998,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":1.8999999999999999},"last":0.32100000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.29999999999999999},"max":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.82799999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":0.84699999999999998,"15min":1.3109999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.35999999999999999},"max":{"1min":0.70599999999999996,"5min":0.83099999999999996,"15min":1.1639999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81200000000000006,"5min":0.89000000000000001,"15min":1.851},"last":0.52000000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.629,"15min":0.59199999999999997},"min":{"1min":0.44800000000000001,"5min":0.41799999999999998,"15min":0.34899999999999998},"max":{"1min":0.80700000000000005,"5min":0.91000000000000003,"15min":0.92700000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.40699999999999997,"15min":0.375},"max":{"1min":0.754,"5min":0.89200000000000002,"15min":1.1930000000000001},"last":0.59799999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.436,"5min":0.41499999999999998,"15min":0.39700000000000002},"max":{"1min":0.754,"5min":0.88,"15min":1.8700000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.58299999999999996},"min":{"1min":0.48199999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77900000000000003,"5min":0.85099999999999998,"15min":0.88400000000000001},"last":0.53200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7218,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188093,"statfs":{"total":200000000,"available":192607913,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51000000000000001,"15min":0.501},"min":{"1min":0.34599999999999997,"5min":0.28899999999999998,"15min":0.247},"max":{"1min":0.65500000000000003,"5min":0.78200000000000003,"15min":1.9419999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54400000000000004,"15min":0.52600000000000002},"min":{"1min":0.32800000000000001,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":0.78800000000000003,"5min":0.80200000000000005,"15min":1.6879999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.371,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":0.745,"5min":0.745,"15min":1.0169999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.40699999999999997,"5min":0.33000000000000002,"15min":0.28000000000000003},"max":{"1min":0.69699999999999995,"5min":0.74199999999999999,"15min":1.3580000000000001},"last":0.63500000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.32200000000000001,"15min":0.27800000000000002},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":2.1520000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.53300000000000003},"min":{"1min":0.433,"5min":0.376,"15min":0.30599999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.29},"last":0.66100000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.32500000000000001,"15min":0.29999999999999999},"max":{"1min":0.76800000000000002,"5min":0.77300000000000002,"15min":2.052},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":0.73599999999999999,"5min":0.78100000000000003,"15min":1.369},"last":0.52100000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.45000000000000001},"min":{"1min":0.30099999999999999,"5min":0.29099999999999998,"15min":0.27000000000000002},"max":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.89000000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.34499999999999997,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.68200000000000005,"5min":0.72599999999999998,"15min":0.88},"last":0.64800000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.0049999999999999},"last":0.622},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.71199999999999997,"5min":0.73899999999999999,"15min":0.95599999999999996},"last":0.67700000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52800000000000002,"15min":0.54200000000000004},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.30099999999999999},"max":{"1min":0.70699999999999996,"5min":0.72299999999999998,"15min":0.98899999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.33300000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.91300000000000003},"last":0.70399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574990,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173757,"statfs":{"total":200000000,"available":177927849,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.32800000000000001,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.71399999999999997,"5min":0.76200000000000001,"15min":1.7849999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.63100000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53100000000000003,"15min":0.51700000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.25},"max":{"1min":0.65200000000000002,"5min":0.75700000000000001,"15min":2.5670000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54400000000000004,"15min":0.63800000000000001},"min":{"1min":0.39000000000000001,"5min":0.375,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":0.79000000000000004,"15min":29.143999999999998},"last":0.70999999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.41599999999999998,"5min":0.31,"15min":0.26800000000000002},"max":{"1min":0.67700000000000005,"5min":0.83399999999999996,"15min":1.0740000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38200000000000001,"5min":0.34699999999999998,"15min":0.309},"max":{"1min":0.69199999999999995,"5min":0.78600000000000003,"15min":0.81899999999999995},"last":0.68500000000000005}]},{"osd":3,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.90200000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40400000000000003,"5min":0.39200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":0.83999999999999997,"15min":0.85099999999999998},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.46400000000000002,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.93500000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.80800000000000005,"15min":0.80900000000000005},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.496,"15min":0.52100000000000002},"min":{"1min":0.42299999999999999,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.81399999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.44,"5min":0.35699999999999998,"15min":0.34799999999999998},"max":{"1min":0.85999999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.752}]},{"osd":7,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.40300000000000002,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.93100000000000005},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77400000000000002,"5min":0.81599999999999995,"15min":0.91100000000000003},"last":0.73599999999999999}]}]}],"pool_statfs":[]}} 2023-10-07T08:54:27.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:54:27.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.982+0000 7f21b6478700 1 Processor -- start 2023-10-07T08:54:27.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.982+0000 7f21b6478700 1 -- start start 2023-10-07T08:54:27.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.983+0000 7f21b6478700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f21b01578d0 0x7f21b00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.983+0000 7f21b6478700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f21b006d120 0x7f21b006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.983+0000 7f21b6478700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b00d07c0 con 0x7f21b0157ca0 2023-10-07T08:54:27.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.983+0000 7f21b6478700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b006da50 con 0x7f21b006d120 2023-10-07T08:54:27.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.983+0000 7f21b6478700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b00cfbb0 con 0x7f21b01578d0 2023-10-07T08:54:27.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.983+0000 7f21b4a15700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f21b006d120 0x7f21b006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:27.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.983+0000 7f21af7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f21b0157ca0 0x7f21b015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35416/0 (socket says 172.21.15.81:35416) 2023-10-07T08:54:27.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.983+0000 7f21b4a15700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f21b006d120 0x7f21b006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35028/0 (socket says 172.21.15.81:35028) 2023-10-07T08:54:27.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.983+0000 7f21af7fe700 1 -- 172.21.15.81:0/3285900819 learned_addr learned my addr 172.21.15.81:0/3285900819 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:27.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.983+0000 7f21affff700 1 --2- 172.21.15.81:0/3285900819 >> v2:172.21.15.89:3300/0 conn(0x7f21b01578d0 0x7f21b00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:27.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.983+0000 7f21b4a15700 1 -- 172.21.15.81:0/3285900819 >> v2:172.21.15.89:3300/0 conn(0x7f21b01578d0 msgr2=0x7f21b00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:27.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.983+0000 7f21b4a15700 1 --2- 172.21.15.81:0/3285900819 >> v2:172.21.15.89:3300/0 conn(0x7f21b01578d0 0x7f21b00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.983+0000 7f21b4a15700 1 -- 172.21.15.81:0/3285900819 >> v1:172.21.15.81:6789/0 conn(0x7f21b0157ca0 legacy=0x7f21b015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.984+0000 7f21b4a15700 1 -- 172.21.15.81:0/3285900819 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b00cfe90 con 0x7f21b006d120 2023-10-07T08:54:27.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.984+0000 7f21b4a15700 1 --2- 172.21.15.81:0/3285900819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b006d120 0x7f21b006d510 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f21b00646b0 tx=0x7f21a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11919c7f972ccf07 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:27.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.984+0000 7f21aeffd700 1 -- 172.21.15.81:0/3285900819 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a800e070 con 0x7f21b006d120 2023-10-07T08:54:27.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.984+0000 7f21aeffd700 1 -- 172.21.15.81:0/3285900819 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a800bc30 con 0x7f21b006d120 2023-10-07T08:54:27.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.984+0000 7f21aeffd700 1 -- 172.21.15.81:0/3285900819 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8012430 con 0x7f21b006d120 2023-10-07T08:54:27.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.984+0000 7f21b6478700 1 -- 172.21.15.81:0/3285900819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b006d120 msgr2=0x7f21b006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.984+0000 7f21b6478700 1 --2- 172.21.15.81:0/3285900819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b006d120 0x7f21b006d510 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f21b00646b0 tx=0x7f21a8009780 comp rx=0 tx=0).stop 2023-10-07T08:54:27.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.984+0000 7f21b6478700 1 -- 172.21.15.81:0/3285900819 shutdown_connections 2023-10-07T08:54:27.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.984+0000 7f21b6478700 1 --2- 172.21.15.81:0/3285900819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b006d120 0x7f21b006d510 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.984+0000 7f21b6478700 1 --2- 172.21.15.81:0/3285900819 >> v2:172.21.15.89:3300/0 conn(0x7f21b01578d0 0x7f21b00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.984+0000 7f21b6478700 1 -- 172.21.15.81:0/3285900819 >> 172.21.15.81:0/3285900819 conn(0x7f21b006bb90 msgr2=0x7f21b006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:27.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.984+0000 7f21b6478700 1 -- 172.21.15.81:0/3285900819 shutdown_connections 2023-10-07T08:54:27.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.984+0000 7f21b6478700 1 -- 172.21.15.81:0/3285900819 wait complete. 2023-10-07T08:54:27.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.985+0000 7f21b6478700 1 Processor -- start 2023-10-07T08:54:27.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.986+0000 7f21b6478700 1 -- start start 2023-10-07T08:54:27.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.986+0000 7f21b6478700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21b006d120 0x7f21b00b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.986+0000 7f21b6478700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21b01578d0 0x7f21b01549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.986+0000 7f21b6478700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b0157ca0 0x7f21b0088fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.986+0000 7f21b6478700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00b3f40 con 0x7f21b0157ca0 2023-10-07T08:54:27.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.986+0000 7f21b6478700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00b3c40 con 0x7f21b01578d0 2023-10-07T08:54:27.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.986+0000 7f21b6478700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b008d100 con 0x7f21b006d120 2023-10-07T08:54:27.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.986+0000 7f21b4a15700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b0157ca0 0x7f21b0088fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:27.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.986+0000 7f21b4a15700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b0157ca0 0x7f21b0088fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35044/0 (socket says 172.21.15.81:35044) 2023-10-07T08:54:27.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.986+0000 7f21b4a15700 1 -- 172.21.15.81:0/1663446410 learned_addr learned my addr 172.21.15.81:0/1663446410 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:27.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.987+0000 7f21af7fe700 1 --2- 172.21.15.81:0/1663446410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21b01578d0 0x7f21b01549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:27.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.987+0000 7f21b4a15700 1 -- 172.21.15.81:0/1663446410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21b006d120 msgr2=0x7f21b00b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.987+0000 7f21b4a15700 1 --2- 172.21.15.81:0/1663446410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21b006d120 0x7f21b00b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.987+0000 7f21b4a15700 1 -- 172.21.15.81:0/1663446410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21b01578d0 msgr2=0x7f21b01549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:27.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.987+0000 7f21b4a15700 1 --2- 172.21.15.81:0/1663446410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21b01578d0 0x7f21b01549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:27.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.987+0000 7f21b4a15700 1 -- 172.21.15.81:0/1663446410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a8009a20 con 0x7f21b0157ca0 2023-10-07T08:54:27.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.987+0000 7f21b4a15700 1 --2- 172.21.15.81:0/1663446410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b0157ca0 0x7f21b0088fb0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f21b006fe20 tx=0x7f21a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:27.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.987+0000 7f2197fff700 1 -- 172.21.15.81:0/1663446410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a801e630 con 0x7f21b0157ca0 2023-10-07T08:54:27.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.987+0000 7f2197fff700 1 -- 172.21.15.81:0/1663446410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a801e7f0 con 0x7f21b0157ca0 2023-10-07T08:54:27.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.987+0000 7f21b6478700 1 -- 172.21.15.81:0/1663446410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b016e4a0 con 0x7f21b0157ca0 2023-10-07T08:54:27.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.987+0000 7f2197fff700 1 -- 172.21.15.81:0/1663446410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a801ebb0 con 0x7f21b0157ca0 2023-10-07T08:54:27.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.987+0000 7f21b6478700 1 -- 172.21.15.81:0/1663446410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b008b490 con 0x7f21b0157ca0 2023-10-07T08:54:27.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.988+0000 7f21b6478700 1 -- 172.21.15.81:0/1663446410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b0067ac0 con 0x7f21b0157ca0 2023-10-07T08:54:27.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.988+0000 7f2197fff700 1 -- 172.21.15.81:0/1663446410 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21a8024070 con 0x7f21b0157ca0 2023-10-07T08:54:27.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.989+0000 7f2197fff700 1 --2- 172.21.15.81:0/1663446410 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f219c066f30 0x7f219c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:27.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.989+0000 7f2197fff700 1 -- 172.21.15.81:0/1663446410 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f21a8086a00 con 0x7f21b0157ca0 2023-10-07T08:54:27.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.989+0000 7f21affff700 1 --2- 172.21.15.81:0/1663446410 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f219c066f30 0x7f219c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:27.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.989+0000 7f21affff700 1 --2- 172.21.15.81:0/1663446410 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f219c066f30 0x7f219c0693e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009a60 tx=0x7f21a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:27.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:27.993+0000 7f2197fff700 1 -- 172.21.15.81:0/1663446410 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21a8053f70 con 0x7f21b0157ca0 2023-10-07T08:54:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.173+0000 7f21b6478700 1 -- 172.21.15.81:0/1663446410 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21b00d0170 con 0x7f219c066f30 2023-10-07T08:54:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.175+0000 7f2197fff700 1 -- 172.21.15.81:0/1663446410 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50261 (secure 0 0 0) 0x7f21b00d0170 con 0x7f219c066f30 2023-10-07T08:54:28.177 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.178+0000 7f21b6478700 1 -- 172.21.15.81:0/1663446410 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f219c066f30 msgr2=0x7f219c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.178+0000 7f21b6478700 1 --2- 172.21.15.81:0/1663446410 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f219c066f30 0x7f219c0693e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009a60 tx=0x7f21a0008040 comp rx=0 tx=0).stop 2023-10-07T08:54:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.178+0000 7f21b6478700 1 -- 172.21.15.81:0/1663446410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b0157ca0 msgr2=0x7f21b0088fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.178+0000 7f21b6478700 1 --2- 172.21.15.81:0/1663446410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b0157ca0 0x7f21b0088fb0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f21b006fe20 tx=0x7f21a8019000 comp rx=0 tx=0).stop 2023-10-07T08:54:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.178+0000 7f21b6478700 1 -- 172.21.15.81:0/1663446410 shutdown_connections 2023-10-07T08:54:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.178+0000 7f21b6478700 1 --2- 172.21.15.81:0/1663446410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b0157ca0 0x7f21b0088fb0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.178+0000 7f21b6478700 1 --2- 172.21.15.81:0/1663446410 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f219c066f30 0x7f219c0693e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.178+0000 7f21b6478700 1 --2- 172.21.15.81:0/1663446410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21b006d120 0x7f21b00b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.178+0000 7f21b6478700 1 --2- 172.21.15.81:0/1663446410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21b01578d0 0x7f21b01549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.178+0000 7f21b6478700 1 -- 172.21.15.81:0/1663446410 >> 172.21.15.81:0/1663446410 conn(0x7f21b006bb90 msgr2=0x7f21b0155570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.178+0000 7f21b6478700 1 -- 172.21.15.81:0/1663446410 shutdown_connections 2023-10-07T08:54:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.178+0000 7f21b6478700 1 -- 172.21.15.81:0/1663446410 wait complete. 2023-10-07T08:54:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:54:28.191 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2023-10-07T08:54:28.157285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":112146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450353,"statfs":{"total":1600000000,"available":1485162371,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489239,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-122,"num_write_kb":-85081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.870736"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":311,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-07T08:54:23.620845+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:54:23.620845+0000","last_peered":"2023-10-07T08:54:23.620845+0000","last_clean":"2023-10-07T08:54:23.620845+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:54:23.620845+0000","last_undegraded":"2023-10-07T08:54:23.620845+0000","last_fullsized":"2023-10-07T08:54:23.620845+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574990,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9843,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185469,"statfs":{"total":200000000,"available":189920393,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.312,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52200000000000002,"15min":0.504},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":1.2150000000000001},"last":0.68000000000000005}]},{"osd":1,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54600000000000004,"15min":0.53000000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.55500000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":1.1659999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.432,"5min":0.314,"15min":0.314},"max":{"1min":0.72299999999999998,"5min":0.75,"15min":0.80300000000000005},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53600000000000003,"15min":0.51000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.53300000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56299999999999994,"15min":0.67100000000000004},"min":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":6.8570000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.57399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.98999999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.47899999999999998},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":0.71899999999999997,"5min":0.81299999999999994,"15min":0.98599999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.32400000000000001,"15min":0.26700000000000002},"max":{"1min":0.73599999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.47899999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.50800000000000001,"15min":0.501},"min":{"1min":0.34699999999999998,"5min":0.30499999999999999,"15min":0.27800000000000002},"max":{"1min":0.67500000000000004,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.36399999999999999,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":1.0669999999999999},"last":0.42099999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.34599999999999997},"max":{"1min":0.75600000000000001,"5min":0.78600000000000003,"15min":1.1020000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58599999999999997,"15min":0.56899999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.307},"max":{"1min":0.82999999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54600000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574990,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19506,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175805,"statfs":{"total":200000000,"available":180025001,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51800000000000002,"15min":0.49299999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.25700000000000001},"max":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.76600000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.501},"min":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.30199999999999999},"max":{"1min":0.67800000000000005,"5min":0.70699999999999996,"15min":0.77500000000000002},"last":0.42599999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70599999999999996,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.498},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29799999999999999},"max":{"1min":0.73099999999999998,"5min":0.753,"15min":1.0069999999999999},"last":0.59399999999999997}]},{"osd":2,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.54300000000000004,"15min":0.51500000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.29399999999999998},"max":{"1min":0.60399999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.53100000000000003},"min":{"1min":0.38100000000000001,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":0.71199999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.44400000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59299999999999997,"5min":0.751,"15min":0.752},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68500000000000005,"5min":0.83199999999999996,"15min":2.3879999999999999},"last":0.60399999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.308,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60999999999999999,"5min":0.71899999999999997,"15min":0.73699999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47799999999999998,"15min":0.49199999999999999},"min":{"1min":0.35699999999999998,"5min":0.30499999999999999,"15min":0.27400000000000002},"max":{"1min":0.59999999999999998,"5min":0.73599999999999999,"15min":0.79900000000000004},"last":0.53500000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48099999999999998,"15min":0.5},"min":{"1min":0.40000000000000002,"5min":0.30399999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.86799999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52800000000000002,"15min":0.53700000000000003},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.627}]},{"osd":7,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.372,"5min":0.35499999999999998,"15min":0.312},"max":{"1min":0.69199999999999995,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.375,"5min":0.36299999999999999,"15min":0.35199999999999998},"max":{"1min":0.66200000000000003,"5min":0.76100000000000001,"15min":1.052},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574990,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13362,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181949,"statfs":{"total":200000000,"available":186316457,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.26000000000000001,"5min":0.193,"15min":0.17499999999999999},"max":{"1min":0.50600000000000001,"5min":0.60399999999999998,"15min":1.9359999999999999},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36099999999999999,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.221,"15min":0.192},"max":{"1min":0.47699999999999998,"5min":0.61399999999999999,"15min":0.82999999999999996},"last":0.255}]},{"osd":2,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.33900000000000002},"min":{"1min":0.27800000000000002,"5min":0.224,"15min":0.19600000000000001},"max":{"1min":0.46400000000000002,"5min":0.57799999999999996,"15min":1.639},"last":0.307},{"interface":"front","average":{"1min":0.378,"5min":0.38600000000000001,"15min":0.36399999999999999},"min":{"1min":0.28000000000000003,"5min":0.245,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":0.69599999999999995,"15min":1.9039999999999999},"last":0.26800000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40799999999999997,"15min":0.38500000000000001},"min":{"1min":0.30299999999999999,"5min":0.27200000000000002,"15min":0.249},"max":{"1min":0.57199999999999995,"5min":0.64500000000000002,"15min":1.6819999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39900000000000002,"15min":0.375},"min":{"1min":0.30599999999999999,"5min":0.26500000000000001,"15min":0.24399999999999999},"max":{"1min":0.56899999999999995,"5min":0.63800000000000001,"15min":0.97599999999999998},"last":0.28399999999999997}]},{"osd":4,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57299999999999995,"15min":0.55600000000000005},"min":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.88300000000000001,"15min":0.91600000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.55700000000000005},"min":{"1min":0.42699999999999999,"5min":0.40500000000000003,"15min":0.28599999999999998},"max":{"1min":0.77200000000000002,"5min":0.86399999999999999,"15min":1.9570000000000001},"last":0.48999999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.59699999999999998},"min":{"1min":0.48199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84299999999999997,"5min":0.98199999999999998,"15min":1.0409999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.628,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.40300000000000002,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.89600000000000002,"15min":0.97299999999999998},"last":0.505}]},{"osd":6,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.47599999999999998,"5min":0.379,"15min":0.34200000000000003},"max":{"1min":0.72399999999999998,"5min":0.94299999999999995,"15min":1.2150000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59699999999999998,"15min":0.56399999999999995},"min":{"1min":0.40799999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.76400000000000001,"5min":0.83399999999999996,"15min":0.87},"last":0.65400000000000003}]},{"osd":7,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63400000000000001,"15min":0.60799999999999998},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":1.004,"15min":1.0800000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64600000000000002,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.40799999999999997},"max":{"1min":0.80200000000000005,"5min":0.92700000000000005,"15min":0.94299999999999995},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574990,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9843,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185469,"statfs":{"total":200000000,"available":189920393,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34899999999999998,"15min":0.35599999999999998},"min":{"1min":0.23100000000000001,"5min":0.224,"15min":0.20100000000000001},"max":{"1min":0.45700000000000002,"5min":0.71099999999999997,"15min":1.4339999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.36699999999999999,"15min":0.38100000000000001},"min":{"1min":0.24299999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.498,"5min":0.54300000000000004,"15min":1.079},"last":0.39500000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.372,"15min":0.38},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.61799999999999999,"15min":1.464},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39700000000000002},"min":{"1min":0.28499999999999998,"5min":0.247,"15min":0.21299999999999999},"max":{"1min":0.57999999999999996,"5min":0.627,"15min":1.1060000000000001},"last":0.26100000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.379,"15min":0.378},"min":{"1min":0.26800000000000002,"5min":0.249,"15min":0.23300000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":1.341},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41999999999999998,"15min":0.42599999999999999},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.25700000000000001},"max":{"1min":0.61199999999999999,"5min":0.65700000000000003,"15min":1.532},"last":0.38200000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59599999999999997,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81699999999999995,"5min":0.89400000000000002,"15min":1.3169999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.34699999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.51},"last":0.44700000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.623,"15min":0.60599999999999998},"min":{"1min":0.437,"5min":0.35799999999999998,"15min":0.33700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0529999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.85499999999999998,"5min":0.91000000000000003,"15min":1.25},"last":0.42999999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.48899999999999999,"5min":0.39700000000000002,"15min":0.376},"max":{"1min":0.95699999999999996,"5min":0.95799999999999996,"15min":1.488},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63600000000000001,"15min":0.61199999999999999},"min":{"1min":0.45800000000000002,"5min":0.41999999999999998,"15min":0.39000000000000001},"max":{"1min":0.80400000000000005,"5min":0.94599999999999995,"15min":1.024},"last":0.46000000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.47499999999999998,"5min":0.44,"15min":0.41999999999999998},"max":{"1min":0.873,"5min":0.97799999999999998,"15min":0.98499999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.623,"15min":0.61199999999999999},"min":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.374},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.288},"last":0.46899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574990,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173757,"statfs":{"total":200000000,"available":177927849,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33100000000000002,"15min":0.33500000000000002},"min":{"1min":0.20200000000000001,"5min":0.19400000000000001,"15min":0.17699999999999999},"max":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":1.665},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35899999999999999,"15min":0.35999999999999999},"min":{"1min":0.23899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48899999999999999,"5min":0.54900000000000004,"15min":1.579},"last":0.373}]},{"osd":1,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.374},"min":{"1min":0.23100000000000001,"5min":0.216,"15min":0.20499999999999999},"max":{"1min":0.626,"5min":0.626,"15min":2.4470000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.308,"5min":0.25800000000000001,"15min":0.20200000000000001},"max":{"1min":0.58999999999999997,"5min":0.65000000000000002,"15min":2.4620000000000002},"last":0.28799999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40200000000000002,"15min":0.39500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27100000000000002,"15min":0.24199999999999999},"max":{"1min":0.51600000000000001,"5min":0.56999999999999995,"15min":1.454},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39300000000000002,"15min":0.38900000000000001},"min":{"1min":0.28699999999999998,"5min":0.255,"15min":0.20899999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":1.6919999999999999},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61399999999999999,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.35499999999999998,"15min":0.28199999999999997},"max":{"1min":1.056,"5min":1.056,"15min":1.7210000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63600000000000001,"15min":0.60799999999999998},"min":{"1min":0.53600000000000003,"5min":0.40000000000000002,"15min":0.34100000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.5549999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58999999999999997,"15min":0.56299999999999994},"min":{"1min":0.44800000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.5269999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.58199999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.311},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":1.4039999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.57899999999999996},"min":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.92000000000000004,"5min":0.93999999999999995,"15min":1.3380000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.40799999999999997,"5min":0.371,"15min":0.34399999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.637},"last":0.46899999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.62,"15min":0.60199999999999998},"min":{"1min":0.497,"5min":0.443,"15min":0.379},"max":{"1min":1.014,"5min":1.014,"15min":1.49},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64800000000000002,"15min":0.622},"min":{"1min":0.45800000000000002,"5min":0.43099999999999999,"15min":0.35999999999999999},"max":{"1min":0.96199999999999997,"5min":0.96999999999999997,"15min":1.375},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9261,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186051,"statfs":{"total":200000000,"available":190516516,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.33000000000000002},"min":{"1min":0.24199999999999999,"5min":0.20599999999999999,"15min":0.19400000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":1.8220000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.35899999999999999,"15min":0.33800000000000002},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.93500000000000005},"last":0.22600000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.373,"15min":0.36599999999999999},"min":{"1min":0.25,"5min":0.23200000000000001,"15min":0.185},"max":{"1min":0.55900000000000005,"5min":0.65200000000000002,"15min":1.6519999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.254,"5min":0.23100000000000001,"15min":0.22500000000000001},"max":{"1min":0.51300000000000001,"5min":0.63700000000000001,"15min":1.885},"last":0.252}]},{"osd":2,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.38500000000000001},"min":{"1min":0.27500000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":1.274},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40400000000000003,"15min":0.40500000000000003},"min":{"1min":0.28899999999999998,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":1.8999999999999999},"last":0.32100000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.29999999999999999},"max":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.82799999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":0.84699999999999998,"15min":1.3109999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.35999999999999999},"max":{"1min":0.70599999999999996,"5min":0.83099999999999996,"15min":1.1639999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81200000000000006,"5min":0.89000000000000001,"15min":1.851},"last":0.52000000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.629,"15min":0.59199999999999997},"min":{"1min":0.44800000000000001,"5min":0.41799999999999998,"15min":0.34899999999999998},"max":{"1min":0.80700000000000005,"5min":0.91000000000000003,"15min":0.92700000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.40699999999999997,"15min":0.375},"max":{"1min":0.754,"5min":0.89200000000000002,"15min":1.1930000000000001},"last":0.59799999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.436,"5min":0.41499999999999998,"15min":0.39700000000000002},"max":{"1min":0.754,"5min":0.88,"15min":1.8700000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.58299999999999996},"min":{"1min":0.48199999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77900000000000003,"5min":0.85099999999999998,"15min":0.88400000000000001},"last":0.53200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7218,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188093,"statfs":{"total":200000000,"available":192607913,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51000000000000001,"15min":0.501},"min":{"1min":0.34599999999999997,"5min":0.28899999999999998,"15min":0.247},"max":{"1min":0.65500000000000003,"5min":0.78200000000000003,"15min":1.9419999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54400000000000004,"15min":0.52600000000000002},"min":{"1min":0.32800000000000001,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":0.78800000000000003,"5min":0.80200000000000005,"15min":1.6879999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.371,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":0.745,"5min":0.745,"15min":1.0169999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.40699999999999997,"5min":0.33000000000000002,"15min":0.28000000000000003},"max":{"1min":0.69699999999999995,"5min":0.74199999999999999,"15min":1.3580000000000001},"last":0.63500000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.32200000000000001,"15min":0.27800000000000002},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":2.1520000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.53300000000000003},"min":{"1min":0.433,"5min":0.376,"15min":0.30599999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.29},"last":0.66100000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.32500000000000001,"15min":0.29999999999999999},"max":{"1min":0.76800000000000002,"5min":0.77300000000000002,"15min":2.052},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":0.73599999999999999,"5min":0.78100000000000003,"15min":1.369},"last":0.52100000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.45000000000000001},"min":{"1min":0.30099999999999999,"5min":0.29099999999999998,"15min":0.27000000000000002},"max":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.89000000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.34499999999999997,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.68200000000000005,"5min":0.72599999999999998,"15min":0.88},"last":0.64800000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.0049999999999999},"last":0.622},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.71199999999999997,"5min":0.73899999999999999,"15min":0.95599999999999996},"last":0.67700000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52800000000000002,"15min":0.54200000000000004},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.30099999999999999},"max":{"1min":0.70699999999999996,"5min":0.72299999999999998,"15min":0.98899999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.33300000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.91300000000000003},"last":0.70399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574990,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173757,"statfs":{"total":200000000,"available":177927849,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.32800000000000001,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.71399999999999997,"5min":0.76200000000000001,"15min":1.7849999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.63100000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53100000000000003,"15min":0.51700000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.25},"max":{"1min":0.65200000000000002,"5min":0.75700000000000001,"15min":2.5670000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54400000000000004,"15min":0.63800000000000001},"min":{"1min":0.39000000000000001,"5min":0.375,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":0.79000000000000004,"15min":29.143999999999998},"last":0.70999999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.41599999999999998,"5min":0.31,"15min":0.26800000000000002},"max":{"1min":0.67700000000000005,"5min":0.83399999999999996,"15min":1.0740000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38200000000000001,"5min":0.34699999999999998,"15min":0.309},"max":{"1min":0.69199999999999995,"5min":0.78600000000000003,"15min":0.81899999999999995},"last":0.68500000000000005}]},{"osd":3,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.90200000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40400000000000003,"5min":0.39200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":0.83999999999999997,"15min":0.85099999999999998},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.46400000000000002,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.93500000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.80800000000000005,"15min":0.80900000000000005},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.496,"15min":0.52100000000000002},"min":{"1min":0.42299999999999999,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.81399999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.44,"5min":0.35699999999999998,"15min":0.34799999999999998},"max":{"1min":0.85999999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.752}]},{"osd":7,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.40300000000000002,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.93100000000000005},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77400000000000002,"5min":0.81599999999999995,"15min":0.91100000000000003},"last":0.73599999999999999}]}]}],"pool_statfs":[]}} 2023-10-07T08:54:28.192 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-07T08:54:28.193 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:54:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.305+0000 7f6f6e835700 1 Processor -- start 2023-10-07T08:54:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.305+0000 7f6f6e835700 1 -- start start 2023-10-07T08:54:28.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.306+0000 7f6f6e835700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6f680b3bd0 0x7f6f680ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:28.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.306+0000 7f6f6e835700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f681583b0 0x7f6f680cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:28.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.306+0000 7f6f6e835700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f680b2890 con 0x7f6f68157fe0 2023-10-07T08:54:28.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.306+0000 7f6f6e835700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f680b4070 con 0x7f6f680b3bd0 2023-10-07T08:54:28.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.306+0000 7f6f6e835700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680b4350 con 0x7f6f681583b0 2023-10-07T08:54:28.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.306+0000 7f6f67fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6f68157fe0 0x7f6f680b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35428/0 (socket says 172.21.15.81:35428) 2023-10-07T08:54:28.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.306+0000 7f6f67fff700 1 -- 172.21.15.81:0/995256788 learned_addr learned my addr 172.21.15.81:0/995256788 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:28.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f6cdd2700 1 --2- 172.21.15.81:0/995256788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f681583b0 0x7f6f680cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:28.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f677fe700 1 --2- 172.21.15.81:0/995256788 >> v2:172.21.15.89:3300/0 conn(0x7f6f680b3bd0 0x7f6f680ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:28.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f66ffd700 1 -- 172.21.15.81:0/995256788 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585972040 0 0) 0x7f6f680b2890 con 0x7f6f68157fe0 2023-10-07T08:54:28.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f66ffd700 1 -- 172.21.15.81:0/995256788 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f50003570 con 0x7f6f68157fe0 2023-10-07T08:54:28.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f66ffd700 1 -- 172.21.15.81:0/995256788 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3557869839 0 0) 0x7f6f50003570 con 0x7f6f68157fe0 2023-10-07T08:54:28.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f66ffd700 1 -- 172.21.15.81:0/995256788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f681583b0 msgr2=0x7f6f680cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:28.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f66ffd700 1 --2- 172.21.15.81:0/995256788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f681583b0 0x7f6f680cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f66ffd700 1 -- 172.21.15.81:0/995256788 >> v2:172.21.15.89:3300/0 conn(0x7f6f680b3bd0 msgr2=0x7f6f680ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:28.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f66ffd700 1 --2- 172.21.15.81:0/995256788 >> v2:172.21.15.89:3300/0 conn(0x7f6f680b3bd0 0x7f6f680ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f66ffd700 1 -- 172.21.15.81:0/995256788 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f680b4630 con 0x7f6f68157fe0 2023-10-07T08:54:28.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f66ffd700 1 -- 172.21.15.81:0/995256788 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f6f58001470 con 0x7f6f68157fe0 2023-10-07T08:54:28.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f66ffd700 1 -- 172.21.15.81:0/995256788 >> v1:172.21.15.81:6789/0 conn(0x7f6f68157fe0 legacy=0x7f6f680b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:28.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f66ffd700 1 --2- 172.21.15.81:0/995256788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f50003a60 0x7f6f50003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:28.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f66ffd700 1 --2- 172.21.15.81:0/995256788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f50004810 0x7f6f50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:28.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f66ffd700 1 --2- 172.21.15.81:0/995256788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f500051c0 0x7f6f5000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:28.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f66ffd700 1 -- 172.21.15.81:0/995256788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680b4070 con 0x7f6f50003a60 2023-10-07T08:54:28.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f66ffd700 1 -- 172.21.15.81:0/995256788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680b4350 con 0x7f6f500051c0 2023-10-07T08:54:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f66ffd700 1 -- 172.21.15.81:0/995256788 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5000bfa0 con 0x7f6f50004810 2023-10-07T08:54:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f6cdd2700 1 --2- 172.21.15.81:0/995256788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f681583b0 0x7f6f680cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:54:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f677fe700 1 --2- 172.21.15.81:0/995256788 >> v2:172.21.15.89:3300/0 conn(0x7f6f680b3bd0 0x7f6f680ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-07T08:54:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f67fff700 1 --2- 172.21.15.81:0/995256788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f50003a60 0x7f6f50003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f6cdd2700 1 --2- 172.21.15.81:0/995256788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f500051c0 0x7f6f5000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f677fe700 1 --2- 172.21.15.81:0/995256788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f50004810 0x7f6f50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f67fff700 1 -- 172.21.15.81:0/995256788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f50004810 msgr2=0x7f6f50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f67fff700 1 --2- 172.21.15.81:0/995256788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f50004810 0x7f6f50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f67fff700 1 -- 172.21.15.81:0/995256788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f500051c0 msgr2=0x7f6f5000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f67fff700 1 --2- 172.21.15.81:0/995256788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f500051c0 0x7f6f5000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.307+0000 7f6f67fff700 1 -- 172.21.15.81:0/995256788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f50003570 con 0x7f6f50003a60 2023-10-07T08:54:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.308+0000 7f6f67fff700 1 --2- 172.21.15.81:0/995256788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f50003a60 0x7f6f50003e70 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800c3f0 tx=0x7f6f58001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e425aef13b8f38d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.308+0000 7f6f66ffd700 1 -- 172.21.15.81:0/995256788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5800cc20 con 0x7f6f50003a60 2023-10-07T08:54:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.308+0000 7f6f66ffd700 1 -- 172.21.15.81:0/995256788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5800cdc0 con 0x7f6f50003a60 2023-10-07T08:54:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.308+0000 7f6f66ffd700 1 -- 172.21.15.81:0/995256788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f58005b70 con 0x7f6f50003a60 2023-10-07T08:54:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.308+0000 7f6f6e835700 1 -- 172.21.15.81:0/995256788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f50003a60 msgr2=0x7f6f50003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.308+0000 7f6f6e835700 1 --2- 172.21.15.81:0/995256788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f50003a60 0x7f6f50003e70 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800c3f0 tx=0x7f6f58001e90 comp rx=0 tx=0).stop 2023-10-07T08:54:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.308+0000 7f6f6cdd2700 1 -- 172.21.15.81:0/995256788 reap_dead start 2023-10-07T08:54:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.308+0000 7f6f6e835700 1 -- 172.21.15.81:0/995256788 shutdown_connections 2023-10-07T08:54:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.308+0000 7f6f6e835700 1 -- 172.21.15.81:0/995256788 >> 172.21.15.81:0/995256788 conn(0x7f6f68067640 msgr2=0x7f6f68067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.308+0000 7f6f6e835700 1 -- 172.21.15.81:0/995256788 shutdown_connections 2023-10-07T08:54:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.308+0000 7f6f6e835700 1 -- 172.21.15.81:0/995256788 wait complete. 2023-10-07T08:54:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.309+0000 7f6f6e835700 1 Processor -- start 2023-10-07T08:54:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.310+0000 7f6f6e835700 1 -- start start 2023-10-07T08:54:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.310+0000 7f6f6e835700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f50003a60 0x7f6f6814a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.310+0000 7f6f6e835700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f6815aeb0 0x7f6f6815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.310+0000 7f6f6e835700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6815b320 0x7f6f6815cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.310+0000 7f6f6e835700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6814f830 con 0x7f6f6815aeb0 2023-10-07T08:54:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.310+0000 7f6f6e835700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6814ef00 con 0x7f6f6815b320 2023-10-07T08:54:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.310+0000 7f6f6e835700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6814f1e0 con 0x7f6f50003a60 2023-10-07T08:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.310+0000 7f6f677fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f6815aeb0 0x7f6f6815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.310+0000 7f6f677fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f6815aeb0 0x7f6f6815c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35052/0 (socket says 172.21.15.81:35052) 2023-10-07T08:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.310+0000 7f6f677fe700 1 -- 172.21.15.81:0/3070691052 learned_addr learned my addr 172.21.15.81:0/3070691052 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.311+0000 7f6f67fff700 1 --2- 172.21.15.81:0/3070691052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f50003a60 0x7f6f6814a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.311+0000 7f6f6cdd2700 1 --2- 172.21.15.81:0/3070691052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6815b320 0x7f6f6815cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.311+0000 7f6f677fe700 1 -- 172.21.15.81:0/3070691052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f50003a60 msgr2=0x7f6f6814a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.311+0000 7f6f677fe700 1 --2- 172.21.15.81:0/3070691052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f50003a60 0x7f6f6814a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.311+0000 7f6f677fe700 1 -- 172.21.15.81:0/3070691052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6815b320 msgr2=0x7f6f6815cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.311+0000 7f6f677fe700 1 --2- 172.21.15.81:0/3070691052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6815b320 0x7f6f6815cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.311+0000 7f6f677fe700 1 -- 172.21.15.81:0/3070691052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6814f4c0 con 0x7f6f6815aeb0 2023-10-07T08:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.311+0000 7f6f677fe700 1 --2- 172.21.15.81:0/3070691052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f6815aeb0 0x7f6f6815c710 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c011990 tx=0x7f6f5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.311+0000 7f6f4ffff700 1 -- 172.21.15.81:0/3070691052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c00f860 con 0x7f6f6815aeb0 2023-10-07T08:54:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.311+0000 7f6f4ffff700 1 -- 172.21.15.81:0/3070691052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c00f9c0 con 0x7f6f6815aeb0 2023-10-07T08:54:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.311+0000 7f6f6e835700 1 -- 172.21.15.81:0/3070691052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6814ebb0 con 0x7f6f6815aeb0 2023-10-07T08:54:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.311+0000 7f6f4ffff700 1 -- 172.21.15.81:0/3070691052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c00fd80 con 0x7f6f6815aeb0 2023-10-07T08:54:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.311+0000 7f6f6e835700 1 -- 172.21.15.81:0/3070691052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6816c960 con 0x7f6f6815aeb0 2023-10-07T08:54:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.312+0000 7f6f6e835700 1 -- 172.21.15.81:0/3070691052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f68069e40 con 0x7f6f6815aeb0 2023-10-07T08:54:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.313+0000 7f6f4ffff700 1 -- 172.21.15.81:0/3070691052 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f5c015670 con 0x7f6f6815aeb0 2023-10-07T08:54:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.313+0000 7f6f4ffff700 1 --2- 172.21.15.81:0/3070691052 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6f54066f30 0x7f6f540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.313+0000 7f6f4ffff700 1 -- 172.21.15.81:0/3070691052 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6f5c084560 con 0x7f6f6815aeb0 2023-10-07T08:54:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.313+0000 7f6f67fff700 1 --2- 172.21.15.81:0/3070691052 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6f54066f30 0x7f6f540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.314+0000 7f6f67fff700 1 --2- 172.21.15.81:0/3070691052 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6f54066f30 0x7f6f540693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800c3f0 tx=0x7f6f58015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:28.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.317+0000 7f6f4ffff700 1 -- 172.21.15.81:0/3070691052 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f5c051ad0 con 0x7f6f6815aeb0 2023-10-07T08:54:28.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.499+0000 7f6f6e835700 1 -- 172.21.15.81:0/3070691052 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f680cc6b0 con 0x7f6f54066f30 2023-10-07T08:54:28.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.501+0000 7f6f4ffff700 1 -- 172.21.15.81:0/3070691052 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50261 (secure 0 0 0) 0x7f6f680cc6b0 con 0x7f6f54066f30 2023-10-07T08:54:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:28.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.503+0000 7f6f6e835700 1 -- 172.21.15.81:0/3070691052 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6f54066f30 msgr2=0x7f6f540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:28.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.503+0000 7f6f6e835700 1 --2- 172.21.15.81:0/3070691052 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6f54066f30 0x7f6f540693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800c3f0 tx=0x7f6f58015000 comp rx=0 tx=0).stop 2023-10-07T08:54:28.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.503+0000 7f6f6e835700 1 -- 172.21.15.81:0/3070691052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f6815aeb0 msgr2=0x7f6f6815c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:28.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.503+0000 7f6f6e835700 1 --2- 172.21.15.81:0/3070691052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f6815aeb0 0x7f6f6815c710 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c011990 tx=0x7f6f5c008040 comp rx=0 tx=0).stop 2023-10-07T08:54:28.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.503+0000 7f6f6e835700 1 -- 172.21.15.81:0/3070691052 shutdown_connections 2023-10-07T08:54:28.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.503+0000 7f6f6e835700 1 --2- 172.21.15.81:0/3070691052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6815b320 0x7f6f6815cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.503+0000 7f6f6e835700 1 --2- 172.21.15.81:0/3070691052 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6f54066f30 0x7f6f540693e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.503+0000 7f6f6e835700 1 --2- 172.21.15.81:0/3070691052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f50003a60 0x7f6f6814a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.503+0000 7f6f6e835700 1 --2- 172.21.15.81:0/3070691052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f6815aeb0 0x7f6f6815c710 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.503+0000 7f6f6e835700 1 -- 172.21.15.81:0/3070691052 >> 172.21.15.81:0/3070691052 conn(0x7f6f68067640 msgr2=0x7f6f680ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:28.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.503+0000 7f6f6e835700 1 -- 172.21.15.81:0/3070691052 shutdown_connections 2023-10-07T08:54:28.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.503+0000 7f6f6e835700 1 -- 172.21.15.81:0/3070691052 wait complete. 2023-10-07T08:54:28.506 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:54:28.516 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2023-10-07T08:54:28.157285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":112146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450353,"statfs":{"total":1600000000,"available":1485162371,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489239,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-122,"num_write_kb":-85081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.870736"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":311,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-10-07T08:54:23.620845+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:54:23.620845+0000","last_peered":"2023-10-07T08:54:23.620845+0000","last_clean":"2023-10-07T08:54:23.620845+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:54:23.620845+0000","last_undegraded":"2023-10-07T08:54:23.620845+0000","last_fullsized":"2023-10-07T08:54:23.620845+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574990,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9843,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185469,"statfs":{"total":200000000,"available":189920393,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.312,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52200000000000002,"15min":0.504},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":1.2150000000000001},"last":0.68000000000000005}]},{"osd":1,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54600000000000004,"15min":0.53000000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.55500000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":1.1659999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.432,"5min":0.314,"15min":0.314},"max":{"1min":0.72299999999999998,"5min":0.75,"15min":0.80300000000000005},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53600000000000003,"15min":0.51000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.53300000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56299999999999994,"15min":0.67100000000000004},"min":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":6.8570000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.57399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.98999999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.47899999999999998},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":0.71899999999999997,"5min":0.81299999999999994,"15min":0.98599999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.32400000000000001,"15min":0.26700000000000002},"max":{"1min":0.73599999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.47899999999999998}]},{"osd":5,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.50800000000000001,"15min":0.501},"min":{"1min":0.34699999999999998,"5min":0.30499999999999999,"15min":0.27800000000000002},"max":{"1min":0.67500000000000004,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.36399999999999999,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":1.0669999999999999},"last":0.42099999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.34599999999999997},"max":{"1min":0.75600000000000001,"5min":0.78600000000000003,"15min":1.1020000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58599999999999997,"15min":0.56899999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.307},"max":{"1min":0.82999999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54600000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574990,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19506,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175805,"statfs":{"total":200000000,"available":180025001,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51800000000000002,"15min":0.49299999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.25700000000000001},"max":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.76600000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.501},"min":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.30199999999999999},"max":{"1min":0.67800000000000005,"5min":0.70699999999999996,"15min":0.77500000000000002},"last":0.42599999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70599999999999996,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.498},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29799999999999999},"max":{"1min":0.73099999999999998,"5min":0.753,"15min":1.0069999999999999},"last":0.59399999999999997}]},{"osd":2,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.54300000000000004,"15min":0.51500000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.29399999999999998},"max":{"1min":0.60399999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.53100000000000003},"min":{"1min":0.38100000000000001,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":0.71199999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.44400000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59299999999999997,"5min":0.751,"15min":0.752},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68500000000000005,"5min":0.83199999999999996,"15min":2.3879999999999999},"last":0.60399999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.308,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60999999999999999,"5min":0.71899999999999997,"15min":0.73699999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47799999999999998,"15min":0.49199999999999999},"min":{"1min":0.35699999999999998,"5min":0.30499999999999999,"15min":0.27400000000000002},"max":{"1min":0.59999999999999998,"5min":0.73599999999999999,"15min":0.79900000000000004},"last":0.53500000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48099999999999998,"15min":0.5},"min":{"1min":0.40000000000000002,"5min":0.30399999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.86799999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52800000000000002,"15min":0.53700000000000003},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.627}]},{"osd":7,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.372,"5min":0.35499999999999998,"15min":0.312},"max":{"1min":0.69199999999999995,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.375,"5min":0.36299999999999999,"15min":0.35199999999999998},"max":{"1min":0.66200000000000003,"5min":0.76100000000000001,"15min":1.052},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574990,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13362,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181949,"statfs":{"total":200000000,"available":186316457,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.26000000000000001,"5min":0.193,"15min":0.17499999999999999},"max":{"1min":0.50600000000000001,"5min":0.60399999999999998,"15min":1.9359999999999999},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36099999999999999,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.221,"15min":0.192},"max":{"1min":0.47699999999999998,"5min":0.61399999999999999,"15min":0.82999999999999996},"last":0.255}]},{"osd":2,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.33900000000000002},"min":{"1min":0.27800000000000002,"5min":0.224,"15min":0.19600000000000001},"max":{"1min":0.46400000000000002,"5min":0.57799999999999996,"15min":1.639},"last":0.307},{"interface":"front","average":{"1min":0.378,"5min":0.38600000000000001,"15min":0.36399999999999999},"min":{"1min":0.28000000000000003,"5min":0.245,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":0.69599999999999995,"15min":1.9039999999999999},"last":0.26800000000000002}]},{"osd":3,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40799999999999997,"15min":0.38500000000000001},"min":{"1min":0.30299999999999999,"5min":0.27200000000000002,"15min":0.249},"max":{"1min":0.57199999999999995,"5min":0.64500000000000002,"15min":1.6819999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39900000000000002,"15min":0.375},"min":{"1min":0.30599999999999999,"5min":0.26500000000000001,"15min":0.24399999999999999},"max":{"1min":0.56899999999999995,"5min":0.63800000000000001,"15min":0.97599999999999998},"last":0.28399999999999997}]},{"osd":4,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57299999999999995,"15min":0.55600000000000005},"min":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.88300000000000001,"15min":0.91600000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.55700000000000005},"min":{"1min":0.42699999999999999,"5min":0.40500000000000003,"15min":0.28599999999999998},"max":{"1min":0.77200000000000002,"5min":0.86399999999999999,"15min":1.9570000000000001},"last":0.48999999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.59699999999999998},"min":{"1min":0.48199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84299999999999997,"5min":0.98199999999999998,"15min":1.0409999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.628,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.40300000000000002,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.89600000000000002,"15min":0.97299999999999998},"last":0.505}]},{"osd":6,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.47599999999999998,"5min":0.379,"15min":0.34200000000000003},"max":{"1min":0.72399999999999998,"5min":0.94299999999999995,"15min":1.2150000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59699999999999998,"15min":0.56399999999999995},"min":{"1min":0.40799999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.76400000000000001,"5min":0.83399999999999996,"15min":0.87},"last":0.65400000000000003}]},{"osd":7,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63400000000000001,"15min":0.60799999999999998},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":1.004,"15min":1.0800000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64600000000000002,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.40799999999999997},"max":{"1min":0.80200000000000005,"5min":0.92700000000000005,"15min":0.94299999999999995},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574990,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9843,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185469,"statfs":{"total":200000000,"available":189920393,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34899999999999998,"15min":0.35599999999999998},"min":{"1min":0.23100000000000001,"5min":0.224,"15min":0.20100000000000001},"max":{"1min":0.45700000000000002,"5min":0.71099999999999997,"15min":1.4339999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.36699999999999999,"15min":0.38100000000000001},"min":{"1min":0.24299999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.498,"5min":0.54300000000000004,"15min":1.079},"last":0.39500000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.372,"15min":0.38},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.61799999999999999,"15min":1.464},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39700000000000002},"min":{"1min":0.28499999999999998,"5min":0.247,"15min":0.21299999999999999},"max":{"1min":0.57999999999999996,"5min":0.627,"15min":1.1060000000000001},"last":0.26100000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.379,"15min":0.378},"min":{"1min":0.26800000000000002,"5min":0.249,"15min":0.23300000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":1.341},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41999999999999998,"15min":0.42599999999999999},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.25700000000000001},"max":{"1min":0.61199999999999999,"5min":0.65700000000000003,"15min":1.532},"last":0.38200000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59599999999999997,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81699999999999995,"5min":0.89400000000000002,"15min":1.3169999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.34699999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.51},"last":0.44700000000000001}]},{"osd":5,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.623,"15min":0.60599999999999998},"min":{"1min":0.437,"5min":0.35799999999999998,"15min":0.33700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0529999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.85499999999999998,"5min":0.91000000000000003,"15min":1.25},"last":0.42999999999999999}]},{"osd":6,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.48899999999999999,"5min":0.39700000000000002,"15min":0.376},"max":{"1min":0.95699999999999996,"5min":0.95799999999999996,"15min":1.488},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63600000000000001,"15min":0.61199999999999999},"min":{"1min":0.45800000000000002,"5min":0.41999999999999998,"15min":0.39000000000000001},"max":{"1min":0.80400000000000005,"5min":0.94599999999999995,"15min":1.024},"last":0.46000000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.47499999999999998,"5min":0.44,"15min":0.41999999999999998},"max":{"1min":0.873,"5min":0.97799999999999998,"15min":0.98499999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.623,"15min":0.61199999999999999},"min":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.374},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.288},"last":0.46899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574990,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173757,"statfs":{"total":200000000,"available":177927849,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33100000000000002,"15min":0.33500000000000002},"min":{"1min":0.20200000000000001,"5min":0.19400000000000001,"15min":0.17699999999999999},"max":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":1.665},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35899999999999999,"15min":0.35999999999999999},"min":{"1min":0.23899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48899999999999999,"5min":0.54900000000000004,"15min":1.579},"last":0.373}]},{"osd":1,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.374},"min":{"1min":0.23100000000000001,"5min":0.216,"15min":0.20499999999999999},"max":{"1min":0.626,"5min":0.626,"15min":2.4470000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.308,"5min":0.25800000000000001,"15min":0.20200000000000001},"max":{"1min":0.58999999999999997,"5min":0.65000000000000002,"15min":2.4620000000000002},"last":0.28799999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40200000000000002,"15min":0.39500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27100000000000002,"15min":0.24199999999999999},"max":{"1min":0.51600000000000001,"5min":0.56999999999999995,"15min":1.454},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39300000000000002,"15min":0.38900000000000001},"min":{"1min":0.28699999999999998,"5min":0.255,"15min":0.20899999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":1.6919999999999999},"last":0.33000000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61399999999999999,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.35499999999999998,"15min":0.28199999999999997},"max":{"1min":1.056,"5min":1.056,"15min":1.7210000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63600000000000001,"15min":0.60799999999999998},"min":{"1min":0.53600000000000003,"5min":0.40000000000000002,"15min":0.34100000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.5549999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58999999999999997,"15min":0.56299999999999994},"min":{"1min":0.44800000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.5269999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.58199999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.311},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":1.4039999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.57899999999999996},"min":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.92000000000000004,"5min":0.93999999999999995,"15min":1.3380000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.40799999999999997,"5min":0.371,"15min":0.34399999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.637},"last":0.46899999999999997}]},{"osd":7,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.62,"15min":0.60199999999999998},"min":{"1min":0.497,"5min":0.443,"15min":0.379},"max":{"1min":1.014,"5min":1.014,"15min":1.49},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64800000000000002,"15min":0.622},"min":{"1min":0.45800000000000002,"5min":0.43099999999999999,"15min":0.35999999999999999},"max":{"1min":0.96199999999999997,"5min":0.96999999999999997,"15min":1.375},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9261,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186051,"statfs":{"total":200000000,"available":190516516,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.33000000000000002},"min":{"1min":0.24199999999999999,"5min":0.20599999999999999,"15min":0.19400000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":1.8220000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.35899999999999999,"15min":0.33800000000000002},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.93500000000000005},"last":0.22600000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.373,"15min":0.36599999999999999},"min":{"1min":0.25,"5min":0.23200000000000001,"15min":0.185},"max":{"1min":0.55900000000000005,"5min":0.65200000000000002,"15min":1.6519999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.254,"5min":0.23100000000000001,"15min":0.22500000000000001},"max":{"1min":0.51300000000000001,"5min":0.63700000000000001,"15min":1.885},"last":0.252}]},{"osd":2,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.38500000000000001},"min":{"1min":0.27500000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":1.274},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40400000000000003,"15min":0.40500000000000003},"min":{"1min":0.28899999999999998,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":1.8999999999999999},"last":0.32100000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.29999999999999999},"max":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.82799999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":0.84699999999999998,"15min":1.3109999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.35999999999999999},"max":{"1min":0.70599999999999996,"5min":0.83099999999999996,"15min":1.1639999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81200000000000006,"5min":0.89000000000000001,"15min":1.851},"last":0.52000000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.629,"15min":0.59199999999999997},"min":{"1min":0.44800000000000001,"5min":0.41799999999999998,"15min":0.34899999999999998},"max":{"1min":0.80700000000000005,"5min":0.91000000000000003,"15min":0.92700000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.40699999999999997,"15min":0.375},"max":{"1min":0.754,"5min":0.89200000000000002,"15min":1.1930000000000001},"last":0.59799999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.436,"5min":0.41499999999999998,"15min":0.39700000000000002},"max":{"1min":0.754,"5min":0.88,"15min":1.8700000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.58299999999999996},"min":{"1min":0.48199999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77900000000000003,"5min":0.85099999999999998,"15min":0.88400000000000001},"last":0.53200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7218,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188093,"statfs":{"total":200000000,"available":192607913,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51000000000000001,"15min":0.501},"min":{"1min":0.34599999999999997,"5min":0.28899999999999998,"15min":0.247},"max":{"1min":0.65500000000000003,"5min":0.78200000000000003,"15min":1.9419999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54400000000000004,"15min":0.52600000000000002},"min":{"1min":0.32800000000000001,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":0.78800000000000003,"5min":0.80200000000000005,"15min":1.6879999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.371,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":0.745,"5min":0.745,"15min":1.0169999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.40699999999999997,"5min":0.33000000000000002,"15min":0.28000000000000003},"max":{"1min":0.69699999999999995,"5min":0.74199999999999999,"15min":1.3580000000000001},"last":0.63500000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.32200000000000001,"15min":0.27800000000000002},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":2.1520000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.53300000000000003},"min":{"1min":0.433,"5min":0.376,"15min":0.30599999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.29},"last":0.66100000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.32500000000000001,"15min":0.29999999999999999},"max":{"1min":0.76800000000000002,"5min":0.77300000000000002,"15min":2.052},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":0.73599999999999999,"5min":0.78100000000000003,"15min":1.369},"last":0.52100000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.45000000000000001},"min":{"1min":0.30099999999999999,"5min":0.29099999999999998,"15min":0.27000000000000002},"max":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.89000000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.34499999999999997,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.68200000000000005,"5min":0.72599999999999998,"15min":0.88},"last":0.64800000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.0049999999999999},"last":0.622},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.71199999999999997,"5min":0.73899999999999999,"15min":0.95599999999999996},"last":0.67700000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52800000000000002,"15min":0.54200000000000004},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.30099999999999999},"max":{"1min":0.70699999999999996,"5min":0.72299999999999998,"15min":0.98899999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.33300000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.91300000000000003},"last":0.70399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574990,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173757,"statfs":{"total":200000000,"available":177927849,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.32800000000000001,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.71399999999999997,"5min":0.76200000000000001,"15min":1.7849999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.63100000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53100000000000003,"15min":0.51700000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.25},"max":{"1min":0.65200000000000002,"5min":0.75700000000000001,"15min":2.5670000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54400000000000004,"15min":0.63800000000000001},"min":{"1min":0.39000000000000001,"5min":0.375,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":0.79000000000000004,"15min":29.143999999999998},"last":0.70999999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.41599999999999998,"5min":0.31,"15min":0.26800000000000002},"max":{"1min":0.67700000000000005,"5min":0.83399999999999996,"15min":1.0740000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38200000000000001,"5min":0.34699999999999998,"15min":0.309},"max":{"1min":0.69199999999999995,"5min":0.78600000000000003,"15min":0.81899999999999995},"last":0.68500000000000005}]},{"osd":3,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.90200000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40400000000000003,"5min":0.39200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":0.83999999999999997,"15min":0.85099999999999998},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.46400000000000002,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.93500000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.80800000000000005,"15min":0.80900000000000005},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.496,"15min":0.52100000000000002},"min":{"1min":0.42299999999999999,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.81399999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.44,"5min":0.35699999999999998,"15min":0.34799999999999998},"max":{"1min":0.85999999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.752}]},{"osd":7,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.40300000000000002,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.93100000000000005},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77400000000000002,"5min":0.81599999999999995,"15min":0.91100000000000003},"last":0.73599999999999999}]}]}],"pool_statfs":[]}} 2023-10-07T08:54:28.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-07T08:54:28.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.629+0000 7f6ef17c8700 1 Processor -- start 2023-10-07T08:54:28.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.629+0000 7f6ef17c8700 1 -- start start 2023-10-07T08:54:28.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.630+0000 7f6ef17c8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6eec1578d0 0x7f6eec0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:28.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.630+0000 7f6ef17c8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6eec157ca0 0x7f6eec15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:28.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.630+0000 7f6ef17c8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eec0d07c0 con 0x7f6eec06d120 2023-10-07T08:54:28.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.630+0000 7f6ef17c8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eec0cfbb0 con 0x7f6eec1578d0 2023-10-07T08:54:28.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.630+0000 7f6ef17c8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec0cfe90 con 0x7f6eec157ca0 2023-10-07T08:54:28.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.630+0000 7f6eeaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6eec1578d0 0x7f6eec0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:28.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.630+0000 7f6eeb7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6eec06d120 0x7f6eec15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35444/0 (socket says 172.21.15.81:35444) 2023-10-07T08:54:28.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.630+0000 7f6eeb7fe700 1 -- 172.21.15.81:0/3801600555 learned_addr learned my addr 172.21.15.81:0/3801600555 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:28.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.630+0000 7f6ee27fc700 1 --2- 172.21.15.81:0/3801600555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6eec157ca0 0x7f6eec15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:28.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.630+0000 7f6eeaffd700 1 -- 172.21.15.81:0/3801600555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6eec157ca0 msgr2=0x7f6eec15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:28.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.630+0000 7f6eeaffd700 1 --2- 172.21.15.81:0/3801600555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6eec157ca0 0x7f6eec15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.630+0000 7f6eeaffd700 1 -- 172.21.15.81:0/3801600555 >> v1:172.21.15.81:6789/0 conn(0x7f6eec06d120 legacy=0x7f6eec15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:28.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.630+0000 7f6eea7fc700 1 -- 172.21.15.81:0/3801600555 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316133576 0 0) 0x7f6eec0d07c0 con 0x7f6eec06d120 2023-10-07T08:54:28.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.630+0000 7f6eeaffd700 1 -- 172.21.15.81:0/3801600555 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec0d0170 con 0x7f6eec1578d0 2023-10-07T08:54:28.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.631+0000 7f6eeaffd700 1 --2- 172.21.15.81:0/3801600555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec1578d0 0x7f6eec0cf4f0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0098e0 tx=0x7f6edc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5a8886bc0bfd84 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:28.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.631+0000 7f6eea7fc700 1 -- 172.21.15.81:0/3801600555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc009e80 con 0x7f6eec1578d0 2023-10-07T08:54:28.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.631+0000 7f6eea7fc700 1 -- 172.21.15.81:0/3801600555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6edc00b860 con 0x7f6eec1578d0 2023-10-07T08:54:28.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.631+0000 7f6eea7fc700 1 -- 172.21.15.81:0/3801600555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc00bbe0 con 0x7f6eec1578d0 2023-10-07T08:54:28.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.631+0000 7f6ef17c8700 1 -- 172.21.15.81:0/3801600555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec1578d0 msgr2=0x7f6eec0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:28.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.631+0000 7f6ef17c8700 1 --2- 172.21.15.81:0/3801600555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec1578d0 0x7f6eec0cf4f0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0098e0 tx=0x7f6edc0091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.631+0000 7f6ef17c8700 1 -- 172.21.15.81:0/3801600555 shutdown_connections 2023-10-07T08:54:28.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.631+0000 7f6ef17c8700 1 --2- 172.21.15.81:0/3801600555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec1578d0 0x7f6eec0cf4f0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.631+0000 7f6ef17c8700 1 --2- 172.21.15.81:0/3801600555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6eec157ca0 0x7f6eec15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.631+0000 7f6ef17c8700 1 -- 172.21.15.81:0/3801600555 >> 172.21.15.81:0/3801600555 conn(0x7f6eec06bb90 msgr2=0x7f6eec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:28.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.631+0000 7f6ef17c8700 1 -- 172.21.15.81:0/3801600555 shutdown_connections 2023-10-07T08:54:28.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.631+0000 7f6ef17c8700 1 -- 172.21.15.81:0/3801600555 wait complete. 2023-10-07T08:54:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.632+0000 7f6ef17c8700 1 Processor -- start 2023-10-07T08:54:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.633+0000 7f6ef17c8700 1 -- start start 2023-10-07T08:54:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.633+0000 7f6ef17c8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6eec06d120 0x7f6eec0ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.633+0000 7f6ef17c8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6eec1578d0 0x7f6eec069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.633+0000 7f6ef17c8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec157ca0 0x7f6eec06a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.633+0000 7f6ef17c8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec16e7b0 con 0x7f6eec157ca0 2023-10-07T08:54:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.633+0000 7f6ef17c8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec0c9430 con 0x7f6eec06d120 2023-10-07T08:54:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.633+0000 7f6ef17c8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec16aa20 con 0x7f6eec1578d0 2023-10-07T08:54:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.633+0000 7f6eeb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec157ca0 0x7f6eec06a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.633+0000 7f6eeb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec157ca0 0x7f6eec06a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35078/0 (socket says 172.21.15.81:35078) 2023-10-07T08:54:28.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.633+0000 7f6eeb7fe700 1 -- 172.21.15.81:0/1516942713 learned_addr learned my addr 172.21.15.81:0/1516942713 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:28.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.634+0000 7f6eeaffd700 1 --2- 172.21.15.81:0/1516942713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6eec06d120 0x7f6eec0ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:28.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.634+0000 7f6ee27fc700 1 --2- 172.21.15.81:0/1516942713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6eec1578d0 0x7f6eec069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:28.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.634+0000 7f6eeb7fe700 1 -- 172.21.15.81:0/1516942713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6eec1578d0 msgr2=0x7f6eec069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:28.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.634+0000 7f6eeb7fe700 1 --2- 172.21.15.81:0/1516942713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6eec1578d0 0x7f6eec069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.634+0000 7f6eeb7fe700 1 -- 172.21.15.81:0/1516942713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6eec06d120 msgr2=0x7f6eec0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:28.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.634+0000 7f6eeb7fe700 1 --2- 172.21.15.81:0/1516942713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6eec06d120 0x7f6eec0ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.634+0000 7f6eeb7fe700 1 -- 172.21.15.81:0/1516942713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc009420 con 0x7f6eec157ca0 2023-10-07T08:54:28.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.634+0000 7f6eeaffd700 1 --2- 172.21.15.81:0/1516942713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6eec06d120 0x7f6eec0ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:28.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.634+0000 7f6ee27fc700 1 --2- 172.21.15.81:0/1516942713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6eec1578d0 0x7f6eec069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:28.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.634+0000 7f6eeb7fe700 1 --2- 172.21.15.81:0/1516942713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec157ca0 0x7f6eec06a020 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400ccc0 tx=0x7f6ee4001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:28.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.634+0000 7f6ee37fe700 1 -- 172.21.15.81:0/1516942713 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee400aaf0 con 0x7f6eec157ca0 2023-10-07T08:54:28.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.634+0000 7f6ee37fe700 1 -- 172.21.15.81:0/1516942713 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee400ac50 con 0x7f6eec157ca0 2023-10-07T08:54:28.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.634+0000 7f6ef17c8700 1 -- 172.21.15.81:0/1516942713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eec16e4d0 con 0x7f6eec157ca0 2023-10-07T08:54:28.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.634+0000 7f6ee37fe700 1 -- 172.21.15.81:0/1516942713 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee40070f0 con 0x7f6eec157ca0 2023-10-07T08:54:28.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.634+0000 7f6ef17c8700 1 -- 172.21.15.81:0/1516942713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eec16a6b0 con 0x7f6eec157ca0 2023-10-07T08:54:28.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.635+0000 7f6ef17c8700 1 -- 172.21.15.81:0/1516942713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eec16a230 con 0x7f6eec157ca0 2023-10-07T08:54:28.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.635+0000 7f6ee37fe700 1 -- 172.21.15.81:0/1516942713 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ee40074a0 con 0x7f6eec157ca0 2023-10-07T08:54:28.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.636+0000 7f6ee37fe700 1 --2- 172.21.15.81:0/1516942713 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ecc066f30 0x7f6ecc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:28.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.636+0000 7f6ee37fe700 1 -- 172.21.15.81:0/1516942713 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6ee40846f0 con 0x7f6eec157ca0 2023-10-07T08:54:28.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.636+0000 7f6eeaffd700 1 --2- 172.21.15.81:0/1516942713 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ecc066f30 0x7f6ecc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:28.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.636+0000 7f6eeaffd700 1 --2- 172.21.15.81:0/1516942713 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ecc066f30 0x7f6ecc0693e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0c8820 tx=0x7f6edc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.640+0000 7f6ee37fe700 1 -- 172.21.15.81:0/1516942713 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6eec16a230 con 0x7f6eec157ca0 2023-10-07T08:54:28.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.823+0000 7f6ef17c8700 1 -- 172.21.15.81:0/1516942713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6eec16a230 con 0x7f6eec157ca0 2023-10-07T08:54:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.824+0000 7f6ee37fe700 1 -- 172.21.15.81:0/1516942713 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+12226 (secure 0 0 0) 0x7f6eec16a230 con 0x7f6eec157ca0 2023-10-07T08:54:28.825 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:28.825 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":197,"fsid":"f2fc6535-cadc-4a0b-bdad-da2d602c784a","created":"2023-10-07T08:42:38.479823+0000","modified":"2023-10-07T08:54:25.439800+0000","last_up_change":"2023-10-07T08:42:44.280594+0000","last_in_change":"2023-10-07T08:42:41.275089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-07T08:42:46.033308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":86338},{"type":"v1","addr":"172.21.15.81:6801","nonce":86338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":86338},{"type":"v1","addr":"172.21.15.81:6803","nonce":86338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":86338},{"type":"v1","addr":"172.21.15.81:6807","nonce":86338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":86338},{"type":"v1","addr":"172.21.15.81:6805","nonce":86338}]},"public_addr":"172.21.15.81:6801/86338","cluster_addr":"172.21.15.81:6803/86338","heartbeat_back_addr":"172.21.15.81:6807/86338","heartbeat_front_addr":"172.21.15.81:6805/86338","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":86348},{"type":"v1","addr":"172.21.15.81:6819","nonce":86348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":86348},{"type":"v1","addr":"172.21.15.81:6823","nonce":86348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6829","nonce":86348},{"type":"v1","addr":"172.21.15.81:6831","nonce":86348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6825","nonce":86348},{"type":"v1","addr":"172.21.15.81:6827","nonce":86348}]},"public_addr":"172.21.15.81:6819/86348","cluster_addr":"172.21.15.81:6823/86348","heartbeat_back_addr":"172.21.15.81:6831/86348","heartbeat_front_addr":"172.21.15.81:6827/86348","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":86353},{"type":"v1","addr":"172.21.15.81:6818","nonce":86353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":86353},{"type":"v1","addr":"172.21.15.81:6822","nonce":86353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":86353},{"type":"v1","addr":"172.21.15.81:6830","nonce":86353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":86353},{"type":"v1","addr":"172.21.15.81:6826","nonce":86353}]},"public_addr":"172.21.15.81:6818/86353","cluster_addr":"172.21.15.81:6822/86353","heartbeat_back_addr":"172.21.15.81:6830/86353","heartbeat_front_addr":"172.21.15.81:6826/86353","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":86339},{"type":"v1","addr":"172.21.15.81:6809","nonce":86339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":86339},{"type":"v1","addr":"172.21.15.81:6811","nonce":86339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":86339},{"type":"v1","addr":"172.21.15.81:6815","nonce":86339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":86339},{"type":"v1","addr":"172.21.15.81:6813","nonce":86339}]},"public_addr":"172.21.15.81:6809/86339","cluster_addr":"172.21.15.81:6811/86339","heartbeat_back_addr":"172.21.15.81:6815/86339","heartbeat_front_addr":"172.21.15.81:6813/86339","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":86542},{"type":"v1","addr":"172.21.15.89:6801","nonce":86542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":86542},{"type":"v1","addr":"172.21.15.89:6803","nonce":86542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":86542},{"type":"v1","addr":"172.21.15.89:6807","nonce":86542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":86542},{"type":"v1","addr":"172.21.15.89:6805","nonce":86542}]},"public_addr":"172.21.15.89:6801/86542","cluster_addr":"172.21.15.89:6803/86542","heartbeat_back_addr":"172.21.15.89:6807/86542","heartbeat_front_addr":"172.21.15.89:6805/86542","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":86566},{"type":"v1","addr":"172.21.15.89:6817","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":86566},{"type":"v1","addr":"172.21.15.89:6819","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":86566},{"type":"v1","addr":"172.21.15.89:6825","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":86566},{"type":"v1","addr":"172.21.15.89:6821","nonce":86566}]},"public_addr":"172.21.15.89:6817/86566","cluster_addr":"172.21.15.89:6819/86566","heartbeat_back_addr":"172.21.15.89:6825/86566","heartbeat_front_addr":"172.21.15.89:6821/86566","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":86582},{"type":"v1","addr":"172.21.15.89:6824","nonce":86582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":86582},{"type":"v1","addr":"172.21.15.89:6827","nonce":86582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":86582},{"type":"v1","addr":"172.21.15.89:6831","nonce":86582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":86582},{"type":"v1","addr":"172.21.15.89:6829","nonce":86582}]},"public_addr":"172.21.15.89:6824/86582","cluster_addr":"172.21.15.89:6827/86582","heartbeat_back_addr":"172.21.15.89:6831/86582","heartbeat_front_addr":"172.21.15.89:6829/86582","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":86544},{"type":"v1","addr":"172.21.15.89:6809","nonce":86544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":86544},{"type":"v1","addr":"172.21.15.89:6811","nonce":86544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":86544},{"type":"v1","addr":"172.21.15.89:6815","nonce":86544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":86544},{"type":"v1","addr":"172.21.15.89:6813","nonce":86544}]},"public_addr":"172.21.15.89:6809/86544","cluster_addr":"172.21.15.89:6811/86544","heartbeat_back_addr":"172.21.15.89:6815/86544","heartbeat_front_addr":"172.21.15.89:6813/86544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.443306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.435414+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.468623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.388413+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.393480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.426564+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.397337+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-07T08:42:42.457260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6836/2531199109":"2023-10-08T08:54:22.284103+0000","172.21.15.81:6834/2531199109":"2023-10-08T08:54:22.284103+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-07T08:54:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.825+0000 7f6ef17c8700 1 -- 172.21.15.81:0/1516942713 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ecc066f30 msgr2=0x7f6ecc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.825+0000 7f6ef17c8700 1 --2- 172.21.15.81:0/1516942713 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ecc066f30 0x7f6ecc0693e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0c8820 tx=0x7f6edc017000 comp rx=0 tx=0).stop 2023-10-07T08:54:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.825+0000 7f6ef17c8700 1 -- 172.21.15.81:0/1516942713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec157ca0 msgr2=0x7f6eec06a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.825+0000 7f6ef17c8700 1 --2- 172.21.15.81:0/1516942713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec157ca0 0x7f6eec06a020 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400ccc0 tx=0x7f6ee4001a20 comp rx=0 tx=0).stop 2023-10-07T08:54:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.825+0000 7f6ef17c8700 1 -- 172.21.15.81:0/1516942713 shutdown_connections 2023-10-07T08:54:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.825+0000 7f6ef17c8700 1 --2- 172.21.15.81:0/1516942713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec157ca0 0x7f6eec06a020 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.825+0000 7f6ef17c8700 1 --2- 172.21.15.81:0/1516942713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6eec06d120 0x7f6eec0ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.825+0000 7f6ef17c8700 1 --2- 172.21.15.81:0/1516942713 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6ecc066f30 0x7f6ecc0693e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.825+0000 7f6ef17c8700 1 --2- 172.21.15.81:0/1516942713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6eec1578d0 0x7f6eec069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:28.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.826+0000 7f6ef17c8700 1 -- 172.21.15.81:0/1516942713 >> 172.21.15.81:0/1516942713 conn(0x7f6eec06bb90 msgr2=0x7f6eec155b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:28.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.826+0000 7f6ef17c8700 1 -- 172.21.15.81:0/1516942713 shutdown_connections 2023-10-07T08:54:28.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:28.826+0000 7f6ef17c8700 1 -- 172.21.15.81:0/1516942713 wait complete. 2023-10-07T08:54:29.840 INFO:tasks.ceph:Scrubbing osd.0 2023-10-07T08:54:29.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-07T08:54:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.969+0000 7f1b6de4c700 1 Processor -- start 2023-10-07T08:54:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.969+0000 7f1b6de4c700 1 -- start start 2023-10-07T08:54:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.970+0000 7f1b6de4c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b68157ca0 0x7f1b680cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.970+0000 7f1b6de4c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b6806d120 0x7f1b6806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.970+0000 7f1b6de4c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b680d07c0 con 0x7f1b681578d0 2023-10-07T08:54:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.970+0000 7f1b6de4c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6806daa0 con 0x7f1b68157ca0 2023-10-07T08:54:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.970+0000 7f1b6de4c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b680cfbb0 con 0x7f1b6806d120 2023-10-07T08:54:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.970+0000 7f1b66ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b68157ca0 0x7f1b680cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.970+0000 7f1b66ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b68157ca0 0x7f1b680cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35088/0 (socket says 172.21.15.81:35088) 2023-10-07T08:54:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.970+0000 7f1b66ffd700 1 -- 172.21.15.81:0/4200412890 learned_addr learned my addr 172.21.15.81:0/4200412890 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.970+0000 7f1b67fff700 1 --2- 172.21.15.81:0/4200412890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b6806d120 0x7f1b6806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.970+0000 7f1b66ffd700 1 -- 172.21.15.81:0/4200412890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b6806d120 msgr2=0x7f1b6806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.970+0000 7f1b66ffd700 1 --2- 172.21.15.81:0/4200412890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b6806d120 0x7f1b6806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.970+0000 7f1b66ffd700 1 -- 172.21.15.81:0/4200412890 >> v1:172.21.15.89:6789/0 conn(0x7f1b681578d0 legacy=0x7f1b6815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.970+0000 7f1b66ffd700 1 -- 172.21.15.81:0/4200412890 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b680cfe90 con 0x7f1b68157ca0 2023-10-07T08:54:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.970+0000 7f1b66ffd700 1 --2- 172.21.15.81:0/4200412890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b68157ca0 0x7f1b680cf4f0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c0099b0 tx=0x7f1b5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfafad598e96adc server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.970+0000 7f1b667fc700 1 -- 172.21.15.81:0/4200412890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00b820 con 0x7f1b68157ca0 2023-10-07T08:54:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.970+0000 7f1b667fc700 1 -- 172.21.15.81:0/4200412890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c00b980 con 0x7f1b68157ca0 2023-10-07T08:54:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.971+0000 7f1b667fc700 1 -- 172.21.15.81:0/4200412890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00bd20 con 0x7f1b68157ca0 2023-10-07T08:54:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.971+0000 7f1b6de4c700 1 -- 172.21.15.81:0/4200412890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b68157ca0 msgr2=0x7f1b680cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.971+0000 7f1b6de4c700 1 --2- 172.21.15.81:0/4200412890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b68157ca0 0x7f1b680cf4f0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c0099b0 tx=0x7f1b5c009250 comp rx=0 tx=0).stop 2023-10-07T08:54:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.971+0000 7f1b6de4c700 1 -- 172.21.15.81:0/4200412890 shutdown_connections 2023-10-07T08:54:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.971+0000 7f1b6de4c700 1 --2- 172.21.15.81:0/4200412890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b6806d120 0x7f1b6806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:29.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.971+0000 7f1b6de4c700 1 --2- 172.21.15.81:0/4200412890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b68157ca0 0x7f1b680cf4f0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:29.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.971+0000 7f1b6de4c700 1 -- 172.21.15.81:0/4200412890 >> 172.21.15.81:0/4200412890 conn(0x7f1b6806bb90 msgr2=0x7f1b6806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:29.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.971+0000 7f1b6de4c700 1 -- 172.21.15.81:0/4200412890 shutdown_connections 2023-10-07T08:54:29.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.971+0000 7f1b6de4c700 1 -- 172.21.15.81:0/4200412890 wait complete. 2023-10-07T08:54:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.972+0000 7f1b6de4c700 1 Processor -- start 2023-10-07T08:54:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.972+0000 7f1b6de4c700 1 -- start start 2023-10-07T08:54:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.973+0000 7f1b6de4c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b6806d120 0x7f1b681598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.973+0000 7f1b6de4c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b681578d0 0x7f1b6816da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.973+0000 7f1b6de4c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b68157ca0 0x7f1b6816df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.973+0000 7f1b6de4c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b680b1ec0 con 0x7f1b681578d0 2023-10-07T08:54:29.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.973+0000 7f1b6de4c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b680b21a0 con 0x7f1b68157ca0 2023-10-07T08:54:29.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.973+0000 7f1b6de4c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b680b2480 con 0x7f1b6806d120 2023-10-07T08:54:29.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.973+0000 7f1b66ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b681578d0 0x7f1b6816da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:29.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.973+0000 7f1b66ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b681578d0 0x7f1b6816da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35090/0 (socket says 172.21.15.81:35090) 2023-10-07T08:54:29.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.973+0000 7f1b66ffd700 1 -- 172.21.15.81:0/3578556395 learned_addr learned my addr 172.21.15.81:0/3578556395 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:29.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.973+0000 7f1b677fe700 1 --2- 172.21.15.81:0/3578556395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b6806d120 0x7f1b681598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:29.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.973+0000 7f1b67fff700 1 --2- 172.21.15.81:0/3578556395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b68157ca0 0x7f1b6816df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:29.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.974+0000 7f1b66ffd700 1 -- 172.21.15.81:0/3578556395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b6806d120 msgr2=0x7f1b681598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:29.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.974+0000 7f1b66ffd700 1 --2- 172.21.15.81:0/3578556395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b6806d120 0x7f1b681598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:29.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.974+0000 7f1b66ffd700 1 -- 172.21.15.81:0/3578556395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b68157ca0 msgr2=0x7f1b6816df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:29.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.974+0000 7f1b66ffd700 1 --2- 172.21.15.81:0/3578556395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b68157ca0 0x7f1b6816df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:29.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.974+0000 7f1b66ffd700 1 -- 172.21.15.81:0/3578556395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c0094f0 con 0x7f1b681578d0 2023-10-07T08:54:29.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.974+0000 7f1b66ffd700 1 --2- 172.21.15.81:0/3578556395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b681578d0 0x7f1b6816da40 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009290 tx=0x7f1b5c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:29.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.974+0000 7f1b4f7fe700 1 -- 172.21.15.81:0/3578556395 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c011c30 con 0x7f1b681578d0 2023-10-07T08:54:29.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.974+0000 7f1b4f7fe700 1 -- 172.21.15.81:0/3578556395 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c020070 con 0x7f1b681578d0 2023-10-07T08:54:29.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.974+0000 7f1b6de4c700 1 -- 172.21.15.81:0/3578556395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b680b2760 con 0x7f1b681578d0 2023-10-07T08:54:29.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.974+0000 7f1b4f7fe700 1 -- 172.21.15.81:0/3578556395 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c01b450 con 0x7f1b681578d0 2023-10-07T08:54:29.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.974+0000 7f1b6de4c700 1 -- 172.21.15.81:0/3578556395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b68159de0 con 0x7f1b681578d0 2023-10-07T08:54:29.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.975+0000 7f1b6de4c700 1 -- 172.21.15.81:0/3578556395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b680b2310 con 0x7f1b681578d0 2023-10-07T08:54:29.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.975+0000 7f1b4f7fe700 1 -- 172.21.15.81:0/3578556395 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b5c022030 con 0x7f1b681578d0 2023-10-07T08:54:29.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.976+0000 7f1b4f7fe700 1 --2- 172.21.15.81:0/3578556395 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1b54066f30 0x7f1b540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:29.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.976+0000 7f1b4f7fe700 1 -- 172.21.15.81:0/3578556395 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1b5c085fb0 con 0x7f1b681578d0 2023-10-07T08:54:29.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.976+0000 7f1b677fe700 1 --2- 172.21.15.81:0/3578556395 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1b54066f30 0x7f1b540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:29.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.976+0000 7f1b4f7fe700 1 --2- 172.21.15.81:0/3578556395 >> [v2:172.21.15.81:6800/86338,v1:172.21.15.81:6801/86338] conn(0x7f1b5406cd80 0x7f1b5406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:29.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.976+0000 7f1b4f7fe700 1 -- 172.21.15.81:0/3578556395 --> [v2:172.21.15.81:6800/86338,v1:172.21.15.81:6801/86338] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b5406f860 con 0x7f1b5406cd80 2023-10-07T08:54:29.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.976+0000 7f1b4f7fe700 1 -- 172.21.15.81:0/3578556395 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b5c088590 con 0x7f1b681578d0 2023-10-07T08:54:29.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.976+0000 7f1b67fff700 1 --2- 172.21.15.81:0/3578556395 >> [v2:172.21.15.81:6800/86338,v1:172.21.15.81:6801/86338] conn(0x7f1b5406cd80 0x7f1b5406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:29.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.976+0000 7f1b677fe700 1 --2- 172.21.15.81:0/3578556395 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1b54066f30 0x7f1b540693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1b58003a30 tx=0x7f1b58007ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:29.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.976+0000 7f1b67fff700 1 --2- 172.21.15.81:0/3578556395 >> [v2:172.21.15.81:6800/86338,v1:172.21.15.81:6801/86338] conn(0x7f1b5406cd80 0x7f1b5406f190 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:29.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.977+0000 7f1b4f7fe700 1 -- 172.21.15.81:0/3578556395 <== osd.0 v2:172.21.15.81:6800/86338 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f1b5406f860 con 0x7f1b5406cd80 2023-10-07T08:54:29.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.989+0000 7f1b6de4c700 1 -- 172.21.15.81:0/3578556395 --> [v2:172.21.15.81:6800/86338,v1:172.21.15.81:6801/86338] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1b68159fd0 con 0x7f1b5406cd80 2023-10-07T08:54:29.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.990+0000 7f1b4f7fe700 1 -- 172.21.15.81:0/3578556395 <== osd.0 v2:172.21.15.81:6800/86338 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f1b68159fd0 con 0x7f1b5406cd80 2023-10-07T08:54:29.992 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:54:29.992 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-07T08:54:29.992 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:54:29.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.990+0000 7f1b6de4c700 1 -- 172.21.15.81:0/3578556395 >> [v2:172.21.15.81:6800/86338,v1:172.21.15.81:6801/86338] conn(0x7f1b5406cd80 msgr2=0x7f1b5406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:29.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.990+0000 7f1b6de4c700 1 --2- 172.21.15.81:0/3578556395 >> [v2:172.21.15.81:6800/86338,v1:172.21.15.81:6801/86338] conn(0x7f1b5406cd80 0x7f1b5406f190 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:29.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.990+0000 7f1b6de4c700 1 -- 172.21.15.81:0/3578556395 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1b54066f30 msgr2=0x7f1b540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:29.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.990+0000 7f1b6de4c700 1 --2- 172.21.15.81:0/3578556395 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1b54066f30 0x7f1b540693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1b58003a30 tx=0x7f1b58007ea0 comp rx=0 tx=0).stop 2023-10-07T08:54:29.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.990+0000 7f1b6de4c700 1 -- 172.21.15.81:0/3578556395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b681578d0 msgr2=0x7f1b6816da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:29.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.990+0000 7f1b6de4c700 1 --2- 172.21.15.81:0/3578556395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b681578d0 0x7f1b6816da40 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009290 tx=0x7f1b5c016000 comp rx=0 tx=0).stop 2023-10-07T08:54:29.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.990+0000 7f1b67fff700 1 -- 172.21.15.81:0/3578556395 reap_dead start 2023-10-07T08:54:29.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.990+0000 7f1b6de4c700 1 -- 172.21.15.81:0/3578556395 shutdown_connections 2023-10-07T08:54:29.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.990+0000 7f1b6de4c700 1 -- 172.21.15.81:0/3578556395 >> 172.21.15.81:0/3578556395 conn(0x7f1b6806bb90 msgr2=0x7f1b6806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:29.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.990+0000 7f1b6de4c700 1 -- 172.21.15.81:0/3578556395 shutdown_connections 2023-10-07T08:54:29.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:29.990+0000 7f1b6de4c700 1 -- 172.21.15.81:0/3578556395 wait complete. 2023-10-07T08:54:30.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-07T08:54:30.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.117+0000 7f584f2ab700 1 Processor -- start 2023-10-07T08:54:30.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.117+0000 7f584f2ab700 1 -- start start 2023-10-07T08:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.118+0000 7f584f2ab700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5848159f10 0x7f5848068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.118+0000 7f584f2ab700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5848069120 con 0x7f5848159b40 2023-10-07T08:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.118+0000 7f584f2ab700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58480cee10 con 0x7f5848068cc0 2023-10-07T08:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.118+0000 7f584f2ab700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58480cd040 con 0x7f5848159f10 2023-10-07T08:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.118+0000 7f584e2a9700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5848159b40 0x7f58480cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35454/0 (socket says 172.21.15.81:35454) 2023-10-07T08:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.118+0000 7f584e2a9700 1 -- 172.21.15.81:0/1951671957 learned_addr learned my addr 172.21.15.81:0/1951671957 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.118+0000 7f584d2a7700 1 -- 172.21.15.81:0/1951671957 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857341581 0 0) 0x7f5840001490 con 0x7f5848159b40 2023-10-07T08:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.118+0000 7f584daa8700 1 --2- 172.21.15.81:0/1951671957 >> v2:172.21.15.89:3300/0 conn(0x7f5848159f10 0x7f5848068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.118+0000 7f584d2a7700 1 -- 172.21.15.81:0/1951671957 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5830003570 con 0x7f5848159b40 2023-10-07T08:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.118+0000 7f584d2a7700 1 -- 172.21.15.81:0/1951671957 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 422535571 0 0) 0x7f5830003570 con 0x7f5848159b40 2023-10-07T08:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.118+0000 7f584d2a7700 1 -- 172.21.15.81:0/1951671957 >> v2:172.21.15.89:3300/0 conn(0x7f5848159f10 msgr2=0x7f5848068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.118+0000 7f584d2a7700 1 --2- 172.21.15.81:0/1951671957 >> v2:172.21.15.89:3300/0 conn(0x7f5848159f10 0x7f5848068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.118+0000 7f584d2a7700 1 -- 172.21.15.81:0/1951671957 >> v1:172.21.15.89:6789/0 conn(0x7f5848068cc0 legacy=0x7f58480cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.118+0000 7f584d2a7700 1 -- 172.21.15.81:0/1951671957 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58480cd320 con 0x7f5848159b40 2023-10-07T08:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.118+0000 7f584d2a7700 1 -- 172.21.15.81:0/1951671957 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4099881305 0 0) 0x7f5840001980 con 0x7f5848159b40 2023-10-07T08:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584d2a7700 1 -- 172.21.15.81:0/1951671957 >> v1:172.21.15.81:6789/0 conn(0x7f5848159b40 legacy=0x7f58480cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584d2a7700 1 --2- 172.21.15.81:0/1951671957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5830003a60 0x7f5830003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584d2a7700 1 --2- 172.21.15.81:0/1951671957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5830004810 0x7f5830004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584d2a7700 1 --2- 172.21.15.81:0/1951671957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58300051c0 0x7f583000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584d2a7700 1 -- 172.21.15.81:0/1951671957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58480cd040 con 0x7f5830004810 2023-10-07T08:54:30.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584d2a7700 1 -- 172.21.15.81:0/1951671957 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583000c0d0 con 0x7f5830003a60 2023-10-07T08:54:30.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584d2a7700 1 -- 172.21.15.81:0/1951671957 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583000c290 con 0x7f58300051c0 2023-10-07T08:54:30.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584daa8700 1 --2- 172.21.15.81:0/1951671957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5830004810 0x7f5830004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584e2a9700 1 --2- 172.21.15.81:0/1951671957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5830003a60 0x7f5830003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584eaaa700 1 --2- 172.21.15.81:0/1951671957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58300051c0 0x7f583000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584daa8700 1 -- 172.21.15.81:0/1951671957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58300051c0 msgr2=0x7f583000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:30.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584daa8700 1 --2- 172.21.15.81:0/1951671957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58300051c0 0x7f583000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584daa8700 1 -- 172.21.15.81:0/1951671957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5830003a60 msgr2=0x7f5830003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:30.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584daa8700 1 --2- 172.21.15.81:0/1951671957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5830003a60 0x7f5830003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584daa8700 1 -- 172.21.15.81:0/1951671957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5830003570 con 0x7f5830004810 2023-10-07T08:54:30.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584eaaa700 1 --2- 172.21.15.81:0/1951671957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58300051c0 0x7f583000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:30.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584eaaa700 1 -- 172.21.15.81:0/1951671957 reap_dead start 2023-10-07T08:54:30.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584daa8700 1 --2- 172.21.15.81:0/1951671957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5830004810 0x7f5830004c80 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f583c009c00 tx=0x7f583c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ccc878cdc7dab22 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:30.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584d2a7700 1 -- 172.21.15.81:0/1951671957 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c00e710 con 0x7f5830004810 2023-10-07T08:54:30.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584d2a7700 1 -- 172.21.15.81:0/1951671957 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c00e870 con 0x7f5830004810 2023-10-07T08:54:30.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.119+0000 7f584d2a7700 1 -- 172.21.15.81:0/1951671957 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c00ec30 con 0x7f5830004810 2023-10-07T08:54:30.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.120+0000 7f584f2ab700 1 -- 172.21.15.81:0/1951671957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5830004810 msgr2=0x7f5830004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.120+0000 7f584f2ab700 1 --2- 172.21.15.81:0/1951671957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5830004810 0x7f5830004c80 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f583c009c00 tx=0x7f583c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.120+0000 7f584f2ab700 1 -- 172.21.15.81:0/1951671957 shutdown_connections 2023-10-07T08:54:30.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.120+0000 7f584f2ab700 1 --2- 172.21.15.81:0/1951671957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5830004810 0x7f5830004c80 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.120+0000 7f584f2ab700 1 -- 172.21.15.81:0/1951671957 >> 172.21.15.81:0/1951671957 conn(0x7f58480cd660 msgr2=0x7f58480cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:30.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.120+0000 7f584f2ab700 1 -- 172.21.15.81:0/1951671957 shutdown_connections 2023-10-07T08:54:30.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.120+0000 7f584f2ab700 1 -- 172.21.15.81:0/1951671957 wait complete. 2023-10-07T08:54:30.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.121+0000 7f584f2ab700 1 Processor -- start 2023-10-07T08:54:30.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.121+0000 7f584f2ab700 1 -- start start 2023-10-07T08:54:30.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584f2ab700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5830004810 0x7f58481589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584f2ab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f584816a2c0 0x7f584815c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584f2ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f584816a730 0x7f584816d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584f2ab700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58480c8ed0 con 0x7f584816a730 2023-10-07T08:54:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584f2ab700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58480c9a50 con 0x7f5830004810 2023-10-07T08:54:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584f2ab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584816e650 con 0x7f584816a2c0 2023-10-07T08:54:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584eaaa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f584816a730 0x7f584816d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584eaaa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f584816a730 0x7f584816d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35106/0 (socket says 172.21.15.81:35106) 2023-10-07T08:54:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584eaaa700 1 -- 172.21.15.81:0/2956624117 learned_addr learned my addr 172.21.15.81:0/2956624117 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584e2a9700 1 --2- 172.21.15.81:0/2956624117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5830004810 0x7f58481589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584daa8700 1 --2- 172.21.15.81:0/2956624117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f584816a2c0 0x7f584815c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584eaaa700 1 -- 172.21.15.81:0/2956624117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f584816a2c0 msgr2=0x7f584815c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584eaaa700 1 --2- 172.21.15.81:0/2956624117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f584816a2c0 0x7f584815c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584eaaa700 1 -- 172.21.15.81:0/2956624117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5830004810 msgr2=0x7f58481589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584eaaa700 1 --2- 172.21.15.81:0/2956624117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5830004810 0x7f58481589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584eaaa700 1 -- 172.21.15.81:0/2956624117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58480c9120 con 0x7f584816a730 2023-10-07T08:54:30.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584eaaa700 1 --2- 172.21.15.81:0/2956624117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f584816a730 0x7f584816d8c0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f58480cd630 tx=0x7f5838009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:30.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f58467fc700 1 -- 172.21.15.81:0/2956624117 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838014480 con 0x7f584816a730 2023-10-07T08:54:30.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f58467fc700 1 -- 172.21.15.81:0/2956624117 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5838014600 con 0x7f584816a730 2023-10-07T08:54:30.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f58467fc700 1 -- 172.21.15.81:0/2956624117 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58380149c0 con 0x7f584816a730 2023-10-07T08:54:30.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584f2ab700 1 -- 172.21.15.81:0/2956624117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58480c9400 con 0x7f584816a730 2023-10-07T08:54:30.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.122+0000 7f584f2ab700 1 -- 172.21.15.81:0/2956624117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5848158f00 con 0x7f584816a730 2023-10-07T08:54:30.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.123+0000 7f584f2ab700 1 -- 172.21.15.81:0/2956624117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58480c9b90 con 0x7f584816a730 2023-10-07T08:54:30.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.124+0000 7f58467fc700 1 -- 172.21.15.81:0/2956624117 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58380133e0 con 0x7f584816a730 2023-10-07T08:54:30.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.124+0000 7f58467fc700 1 --2- 172.21.15.81:0/2956624117 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5834066f30 0x7f58340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.124+0000 7f58467fc700 1 -- 172.21.15.81:0/2956624117 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5838083b80 con 0x7f584816a730 2023-10-07T08:54:30.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.124+0000 7f584e2a9700 1 --2- 172.21.15.81:0/2956624117 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5834066f30 0x7f58340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.125+0000 7f584e2a9700 1 --2- 172.21.15.81:0/2956624117 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5834066f30 0x7f58340693e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5840002250 tx=0x7f5840006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.128+0000 7f58467fc700 1 -- 172.21.15.81:0/2956624117 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58380511b0 con 0x7f584816a730 2023-10-07T08:54:30.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.313+0000 7f584f2ab700 1 -- 172.21.15.81:0/2956624117 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f58480ce7c0 con 0x7f5834066f30 2023-10-07T08:54:30.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.313+0000 7f58467fc700 1 -- 172.21.15.81:0/2956624117 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f58480ce7c0 con 0x7f5834066f30 2023-10-07T08:54:30.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.315+0000 7f584f2ab700 1 -- 172.21.15.81:0/2956624117 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5834066f30 msgr2=0x7f58340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.315+0000 7f584f2ab700 1 --2- 172.21.15.81:0/2956624117 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5834066f30 0x7f58340693e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5840002250 tx=0x7f5840006040 comp rx=0 tx=0).stop 2023-10-07T08:54:30.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.315+0000 7f584f2ab700 1 -- 172.21.15.81:0/2956624117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f584816a730 msgr2=0x7f584816d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.315+0000 7f584f2ab700 1 --2- 172.21.15.81:0/2956624117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f584816a730 0x7f584816d8c0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f58480cd630 tx=0x7f5838009040 comp rx=0 tx=0).stop 2023-10-07T08:54:30.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.315+0000 7f584f2ab700 1 -- 172.21.15.81:0/2956624117 shutdown_connections 2023-10-07T08:54:30.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.315+0000 7f584f2ab700 1 --2- 172.21.15.81:0/2956624117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f584816a730 0x7f584816d8c0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.315+0000 7f584f2ab700 1 --2- 172.21.15.81:0/2956624117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5830004810 0x7f58481589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.315+0000 7f584f2ab700 1 --2- 172.21.15.81:0/2956624117 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5834066f30 0x7f58340693e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.315+0000 7f584f2ab700 1 --2- 172.21.15.81:0/2956624117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f584816a2c0 0x7f584815c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.315+0000 7f584f2ab700 1 -- 172.21.15.81:0/2956624117 >> 172.21.15.81:0/2956624117 conn(0x7f58480cd660 msgr2=0x7f584806f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:30.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.315+0000 7f584f2ab700 1 -- 172.21.15.81:0/2956624117 shutdown_connections 2023-10-07T08:54:30.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.315+0000 7f584f2ab700 1 -- 172.21.15.81:0/2956624117 wait complete. 2023-10-07T08:54:30.320 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2023-10-07T08:54:30.328 INFO:tasks.ceph:Scrubbing osd.1 2023-10-07T08:54:30.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-07T08:54:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.445+0000 7fc0dcf32700 1 Processor -- start 2023-10-07T08:54:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.445+0000 7fc0dcf32700 1 -- start start 2023-10-07T08:54:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.446+0000 7fc0dcf32700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0d815a2a0 0x7fc0d80b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.446+0000 7fc0dcf32700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc0d80ceb30 0x7fc0d80cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.446+0000 7fc0dcf32700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d806d650 0x7fc0d806da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.446+0000 7fc0dcf32700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d806ea90 con 0x7fc0d815a2a0 2023-10-07T08:54:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.446+0000 7fc0dcf32700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d80cf4f0 con 0x7fc0d80ceb30 2023-10-07T08:54:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.446+0000 7fc0dcf32700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d80b0ca0 con 0x7fc0d806d650 2023-10-07T08:54:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.446+0000 7fc0d659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0d815a2a0 0x7fc0d80b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.446+0000 7fc0d659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0d815a2a0 0x7fc0d80b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35110/0 (socket says 172.21.15.81:35110) 2023-10-07T08:54:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.446+0000 7fc0d659c700 1 -- 172.21.15.81:0/1698939297 learned_addr learned my addr 172.21.15.81:0/1698939297 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.446+0000 7fc0d6d9d700 1 --2- 172.21.15.81:0/1698939297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d806d650 0x7fc0d806da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.446+0000 7fc0cffff700 1 --2- 172.21.15.81:0/1698939297 >> v2:172.21.15.89:3300/0 conn(0x7fc0d80ceb30 0x7fc0d80cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.446+0000 7fc0d659c700 1 -- 172.21.15.81:0/1698939297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d806d650 msgr2=0x7fc0d806da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.446+0000 7fc0d659c700 1 --2- 172.21.15.81:0/1698939297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d806d650 0x7fc0d806da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.446+0000 7fc0d659c700 1 -- 172.21.15.81:0/1698939297 >> v2:172.21.15.89:3300/0 conn(0x7fc0d80ceb30 msgr2=0x7fc0d80cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.446+0000 7fc0d659c700 1 --2- 172.21.15.81:0/1698939297 >> v2:172.21.15.89:3300/0 conn(0x7fc0d80ceb30 0x7fc0d80cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.446+0000 7fc0d659c700 1 -- 172.21.15.81:0/1698939297 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d80b00d0 con 0x7fc0d815a2a0 2023-10-07T08:54:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.447+0000 7fc0d659c700 1 --2- 172.21.15.81:0/1698939297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0d815a2a0 0x7fc0d80b1130 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fc0d806ab90 tx=0x7fc0c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e433ef0e0a5b0043 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.447+0000 7fc0d5d9b700 1 -- 172.21.15.81:0/1698939297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c800b640 con 0x7fc0d815a2a0 2023-10-07T08:54:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.447+0000 7fc0d5d9b700 1 -- 172.21.15.81:0/1698939297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c800b7a0 con 0x7fc0d815a2a0 2023-10-07T08:54:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.447+0000 7fc0d5d9b700 1 -- 172.21.15.81:0/1698939297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c800bb60 con 0x7fc0d815a2a0 2023-10-07T08:54:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.447+0000 7fc0dcf32700 1 -- 172.21.15.81:0/1698939297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0d815a2a0 msgr2=0x7fc0d80b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.447+0000 7fc0dcf32700 1 --2- 172.21.15.81:0/1698939297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0d815a2a0 0x7fc0d80b1130 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fc0d806ab90 tx=0x7fc0c8009250 comp rx=0 tx=0).stop 2023-10-07T08:54:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.447+0000 7fc0dcf32700 1 -- 172.21.15.81:0/1698939297 shutdown_connections 2023-10-07T08:54:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.447+0000 7fc0dcf32700 1 --2- 172.21.15.81:0/1698939297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d806d650 0x7fc0d806da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.447+0000 7fc0dcf32700 1 --2- 172.21.15.81:0/1698939297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0d815a2a0 0x7fc0d80b1130 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.447+0000 7fc0dcf32700 1 --2- 172.21.15.81:0/1698939297 >> v2:172.21.15.89:3300/0 conn(0x7fc0d80ceb30 0x7fc0d80cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.447+0000 7fc0dcf32700 1 -- 172.21.15.81:0/1698939297 >> 172.21.15.81:0/1698939297 conn(0x7fc0d8067640 msgr2=0x7fc0d8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.447+0000 7fc0dcf32700 1 -- 172.21.15.81:0/1698939297 shutdown_connections 2023-10-07T08:54:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.447+0000 7fc0dcf32700 1 -- 172.21.15.81:0/1698939297 wait complete. 2023-10-07T08:54:30.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.448+0000 7fc0dcf32700 1 Processor -- start 2023-10-07T08:54:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.448+0000 7fc0dcf32700 1 -- start start 2023-10-07T08:54:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.449+0000 7fc0dcf32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0d806d650 0x7fc0d80b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.449+0000 7fc0dcf32700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d80ceb30 0x7fc0d8153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.449+0000 7fc0dcf32700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d815a2a0 0x7fc0d8153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.449+0000 7fc0dcf32700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d80b30a0 con 0x7fc0d806d650 2023-10-07T08:54:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.449+0000 7fc0dcf32700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d80b3380 con 0x7fc0d815a2a0 2023-10-07T08:54:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.449+0000 7fc0dcf32700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d80b3660 con 0x7fc0d80ceb30 2023-10-07T08:54:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.449+0000 7fc0d659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0d806d650 0x7fc0d80b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.449+0000 7fc0d659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0d806d650 0x7fc0d80b27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35124/0 (socket says 172.21.15.81:35124) 2023-10-07T08:54:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.449+0000 7fc0d659c700 1 -- 172.21.15.81:0/785670466 learned_addr learned my addr 172.21.15.81:0/785670466 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.449+0000 7fc0cffff700 1 --2- 172.21.15.81:0/785670466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d80ceb30 0x7fc0d8153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.449+0000 7fc0d6d9d700 1 --2- 172.21.15.81:0/785670466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d815a2a0 0x7fc0d8153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.449+0000 7fc0d659c700 1 -- 172.21.15.81:0/785670466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d80ceb30 msgr2=0x7fc0d8153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.450+0000 7fc0d659c700 1 --2- 172.21.15.81:0/785670466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0d80ceb30 0x7fc0d8153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.450+0000 7fc0d659c700 1 -- 172.21.15.81:0/785670466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d815a2a0 msgr2=0x7fc0d8153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.450+0000 7fc0d659c700 1 --2- 172.21.15.81:0/785670466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d815a2a0 0x7fc0d8153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.450+0000 7fc0d659c700 1 -- 172.21.15.81:0/785670466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c80094f0 con 0x7fc0d806d650 2023-10-07T08:54:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.450+0000 7fc0d659c700 1 --2- 172.21.15.81:0/785670466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0d806d650 0x7fc0d80b27c0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fc0d806f990 tx=0x7fc0c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.451+0000 7fc0ce7fc700 1 -- 172.21.15.81:0/785670466 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c800b910 con 0x7fc0d806d650 2023-10-07T08:54:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.451+0000 7fc0dcf32700 1 -- 172.21.15.81:0/785670466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d80b3940 con 0x7fc0d806d650 2023-10-07T08:54:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.451+0000 7fc0dcf32700 1 -- 172.21.15.81:0/785670466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d80b4140 con 0x7fc0d806d650 2023-10-07T08:54:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.451+0000 7fc0ce7fc700 1 -- 172.21.15.81:0/785670466 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c8011420 con 0x7fc0d806d650 2023-10-07T08:54:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.451+0000 7fc0ce7fc700 1 -- 172.21.15.81:0/785670466 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c8011590 con 0x7fc0d806d650 2023-10-07T08:54:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.452+0000 7fc0dcf32700 1 -- 172.21.15.81:0/785670466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc0d80b34f0 con 0x7fc0d806d650 2023-10-07T08:54:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.453+0000 7fc0ce7fc700 1 -- 172.21.15.81:0/785670466 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0c8011900 con 0x7fc0d806d650 2023-10-07T08:54:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.453+0000 7fc0ce7fc700 1 --2- 172.21.15.81:0/785670466 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc0b8066f30 0x7fc0b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.453+0000 7fc0ce7fc700 1 -- 172.21.15.81:0/785670466 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc0c8085930 con 0x7fc0d806d650 2023-10-07T08:54:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.453+0000 7fc0cffff700 1 --2- 172.21.15.81:0/785670466 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc0b8066f30 0x7fc0b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.453+0000 7fc0ce7fc700 1 --2- 172.21.15.81:0/785670466 >> [v2:172.21.15.81:6817/86348,v1:172.21.15.81:6819/86348] conn(0x7fc0b806cd80 0x7fc0b806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.453+0000 7fc0ce7fc700 1 -- 172.21.15.81:0/785670466 --> [v2:172.21.15.81:6817/86348,v1:172.21.15.81:6819/86348] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0b806f860 con 0x7fc0b806cd80 2023-10-07T08:54:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.453+0000 7fc0ce7fc700 1 -- 172.21.15.81:0/785670466 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0c808a240 con 0x7fc0d806d650 2023-10-07T08:54:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.453+0000 7fc0d6d9d700 1 --2- 172.21.15.81:0/785670466 >> [v2:172.21.15.81:6817/86348,v1:172.21.15.81:6819/86348] conn(0x7fc0b806cd80 0x7fc0b806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.453+0000 7fc0cffff700 1 --2- 172.21.15.81:0/785670466 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc0b8066f30 0x7fc0b80693e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80af610 tx=0x7fc0c00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.453+0000 7fc0d6d9d700 1 --2- 172.21.15.81:0/785670466 >> [v2:172.21.15.81:6817/86348,v1:172.21.15.81:6819/86348] conn(0x7fc0b806cd80 0x7fc0b806f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.454+0000 7fc0ce7fc700 1 -- 172.21.15.81:0/785670466 <== osd.1 v2:172.21.15.81:6817/86348 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fc0b806f860 con 0x7fc0b806cd80 2023-10-07T08:54:30.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.466+0000 7fc0dcf32700 1 -- 172.21.15.81:0/785670466 --> [v2:172.21.15.81:6817/86348,v1:172.21.15.81:6819/86348] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc0d8069e40 con 0x7fc0b806cd80 2023-10-07T08:54:30.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.467+0000 7fc0ce7fc700 1 -- 172.21.15.81:0/785670466 <== osd.1 v2:172.21.15.81:6817/86348 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7fc0d8069e40 con 0x7fc0b806cd80 2023-10-07T08:54:30.468 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:54:30.468 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-07T08:54:30.468 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:54:30.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.467+0000 7fc0dcf32700 1 -- 172.21.15.81:0/785670466 >> [v2:172.21.15.81:6817/86348,v1:172.21.15.81:6819/86348] conn(0x7fc0b806cd80 msgr2=0x7fc0b806f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.467+0000 7fc0dcf32700 1 --2- 172.21.15.81:0/785670466 >> [v2:172.21.15.81:6817/86348,v1:172.21.15.81:6819/86348] conn(0x7fc0b806cd80 0x7fc0b806f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.467+0000 7fc0dcf32700 1 -- 172.21.15.81:0/785670466 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc0b8066f30 msgr2=0x7fc0b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.467+0000 7fc0dcf32700 1 --2- 172.21.15.81:0/785670466 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fc0b8066f30 0x7fc0b80693e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80af610 tx=0x7fc0c00091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.467+0000 7fc0dcf32700 1 -- 172.21.15.81:0/785670466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0d806d650 msgr2=0x7fc0d80b27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.467+0000 7fc0dcf32700 1 --2- 172.21.15.81:0/785670466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0d806d650 0x7fc0d80b27c0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fc0d806f990 tx=0x7fc0c8017000 comp rx=0 tx=0).stop 2023-10-07T08:54:30.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.467+0000 7fc0d6d9d700 1 -- 172.21.15.81:0/785670466 reap_dead start 2023-10-07T08:54:30.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.467+0000 7fc0dcf32700 1 -- 172.21.15.81:0/785670466 shutdown_connections 2023-10-07T08:54:30.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.467+0000 7fc0dcf32700 1 -- 172.21.15.81:0/785670466 >> 172.21.15.81:0/785670466 conn(0x7fc0d8067640 msgr2=0x7fc0d80cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:30.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.467+0000 7fc0dcf32700 1 -- 172.21.15.81:0/785670466 shutdown_connections 2023-10-07T08:54:30.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.467+0000 7fc0dcf32700 1 -- 172.21.15.81:0/785670466 wait complete. 2023-10-07T08:54:30.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-07T08:54:30.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.594+0000 7f1db2985700 1 Processor -- start 2023-10-07T08:54:30.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.594+0000 7f1db2985700 1 -- start start 2023-10-07T08:54:30.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.595+0000 7f1db2985700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dac1578d0 0x7f1dac0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.595+0000 7f1db2985700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1dac06d120 0x7f1dac06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.595+0000 7f1db2985700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dac06dac0 con 0x7f1dac157ca0 2023-10-07T08:54:30.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.595+0000 7f1db2985700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dac0d07c0 con 0x7f1dac06d120 2023-10-07T08:54:30.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.595+0000 7f1db2985700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac0cfbb0 con 0x7f1dac1578d0 2023-10-07T08:54:30.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.595+0000 7f1db0f22700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1dac06d120 0x7f1dac06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.595+0000 7f1db0f22700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1dac06d120 0x7f1dac06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35136/0 (socket says 172.21.15.81:35136) 2023-10-07T08:54:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.595+0000 7f1db0f22700 1 -- 172.21.15.81:0/1575981887 learned_addr learned my addr 172.21.15.81:0/1575981887 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.595+0000 7f1dabfff700 1 --2- 172.21.15.81:0/1575981887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dac1578d0 0x7f1dac0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.595+0000 7f1db0f22700 1 -- 172.21.15.81:0/1575981887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dac1578d0 msgr2=0x7f1dac0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.595+0000 7f1db0f22700 1 --2- 172.21.15.81:0/1575981887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dac1578d0 0x7f1dac0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.595+0000 7f1db0f22700 1 -- 172.21.15.81:0/1575981887 >> v1:172.21.15.89:6789/0 conn(0x7f1dac157ca0 legacy=0x7f1dac15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.595+0000 7f1db0f22700 1 -- 172.21.15.81:0/1575981887 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac0cfe90 con 0x7f1dac06d120 2023-10-07T08:54:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.595+0000 7f1dabfff700 1 --2- 172.21.15.81:0/1575981887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dac1578d0 0x7f1dac0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.596+0000 7f1db0f22700 1 --2- 172.21.15.81:0/1575981887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dac06d120 0x7f1dac06d580 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009f20 tx=0x7f1da4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d46723b42da6ea server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.596+0000 7f1daaffd700 1 -- 172.21.15.81:0/1575981887 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da400e070 con 0x7f1dac06d120 2023-10-07T08:54:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.596+0000 7f1daaffd700 1 -- 172.21.15.81:0/1575981887 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da400ba80 con 0x7f1dac06d120 2023-10-07T08:54:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.596+0000 7f1daaffd700 1 -- 172.21.15.81:0/1575981887 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da40092e0 con 0x7f1dac06d120 2023-10-07T08:54:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.596+0000 7f1db2985700 1 -- 172.21.15.81:0/1575981887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dac06d120 msgr2=0x7f1dac06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.596+0000 7f1db2985700 1 --2- 172.21.15.81:0/1575981887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dac06d120 0x7f1dac06d580 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009f20 tx=0x7f1da4009840 comp rx=0 tx=0).stop 2023-10-07T08:54:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.596+0000 7f1db2985700 1 -- 172.21.15.81:0/1575981887 shutdown_connections 2023-10-07T08:54:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.596+0000 7f1db2985700 1 --2- 172.21.15.81:0/1575981887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dac06d120 0x7f1dac06d580 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.596+0000 7f1db2985700 1 --2- 172.21.15.81:0/1575981887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dac1578d0 0x7f1dac0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.596+0000 7f1db2985700 1 -- 172.21.15.81:0/1575981887 >> 172.21.15.81:0/1575981887 conn(0x7f1dac06bb90 msgr2=0x7f1dac06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.596+0000 7f1db2985700 1 -- 172.21.15.81:0/1575981887 shutdown_connections 2023-10-07T08:54:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.596+0000 7f1db2985700 1 -- 172.21.15.81:0/1575981887 wait complete. 2023-10-07T08:54:30.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.597+0000 7f1db2985700 1 Processor -- start 2023-10-07T08:54:30.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.598+0000 7f1db2985700 1 -- start start 2023-10-07T08:54:30.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.598+0000 7f1db2985700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dac06d120 0x7f1dac1511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.598+0000 7f1db2985700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dac1578d0 0x7f1dac152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.598+0000 7f1db2985700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dac157ca0 0x7f1dac16e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.598+0000 7f1db2985700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac14b340 con 0x7f1dac157ca0 2023-10-07T08:54:30.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.598+0000 7f1db2985700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac16e570 con 0x7f1dac1578d0 2023-10-07T08:54:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.598+0000 7f1db2985700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac1535f0 con 0x7f1dac06d120 2023-10-07T08:54:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.598+0000 7f1db0f22700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dac157ca0 0x7f1dac16e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.598+0000 7f1db0f22700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dac157ca0 0x7f1dac16e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35146/0 (socket says 172.21.15.81:35146) 2023-10-07T08:54:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.598+0000 7f1db0f22700 1 -- 172.21.15.81:0/2123777167 learned_addr learned my addr 172.21.15.81:0/2123777167 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.599+0000 7f1dabfff700 1 --2- 172.21.15.81:0/2123777167 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dac06d120 0x7f1dac1511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.599+0000 7f1dab7fe700 1 --2- 172.21.15.81:0/2123777167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dac1578d0 0x7f1dac152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.599+0000 7f1db0f22700 1 -- 172.21.15.81:0/2123777167 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dac06d120 msgr2=0x7f1dac1511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.599+0000 7f1db0f22700 1 --2- 172.21.15.81:0/2123777167 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dac06d120 0x7f1dac1511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.599+0000 7f1db0f22700 1 -- 172.21.15.81:0/2123777167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dac1578d0 msgr2=0x7f1dac152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.599+0000 7f1db0f22700 1 --2- 172.21.15.81:0/2123777167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dac1578d0 0x7f1dac152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.599+0000 7f1db0f22700 1 -- 172.21.15.81:0/2123777167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da4009ae0 con 0x7f1dac157ca0 2023-10-07T08:54:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.599+0000 7f1dabfff700 1 --2- 172.21.15.81:0/2123777167 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dac06d120 0x7f1dac1511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.599+0000 7f1dab7fe700 1 --2- 172.21.15.81:0/2123777167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dac1578d0 0x7f1dac152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.599+0000 7f1db0f22700 1 --2- 172.21.15.81:0/2123777167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dac157ca0 0x7f1dac16e030 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f1da400b6c0 tx=0x7f1da4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.599+0000 7f1d93fff700 1 -- 172.21.15.81:0/2123777167 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da40032f0 con 0x7f1dac157ca0 2023-10-07T08:54:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.599+0000 7f1d93fff700 1 -- 172.21.15.81:0/2123777167 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da4008e40 con 0x7f1dac157ca0 2023-10-07T08:54:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.599+0000 7f1db2985700 1 -- 172.21.15.81:0/2123777167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dac1529c0 con 0x7f1dac157ca0 2023-10-07T08:54:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.599+0000 7f1d93fff700 1 -- 172.21.15.81:0/2123777167 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da4026690 con 0x7f1dac157ca0 2023-10-07T08:54:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.599+0000 7f1db2985700 1 -- 172.21.15.81:0/2123777167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dac152fa0 con 0x7f1dac157ca0 2023-10-07T08:54:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.600+0000 7f1db2985700 1 -- 172.21.15.81:0/2123777167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dac067ac0 con 0x7f1dac157ca0 2023-10-07T08:54:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.600+0000 7f1d93fff700 1 -- 172.21.15.81:0/2123777167 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1da4003040 con 0x7f1dac157ca0 2023-10-07T08:54:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.601+0000 7f1d93fff700 1 --2- 172.21.15.81:0/2123777167 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1d98066f30 0x7f1d980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.601+0000 7f1d93fff700 1 -- 172.21.15.81:0/2123777167 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1da40862d0 con 0x7f1dac157ca0 2023-10-07T08:54:30.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.601+0000 7f1dabfff700 1 --2- 172.21.15.81:0/2123777167 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1d98066f30 0x7f1d980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.601+0000 7f1dabfff700 1 --2- 172.21.15.81:0/2123777167 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1d98066f30 0x7f1d980693e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c006f00 tx=0x7f1d9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:30.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.605+0000 7f1d93fff700 1 -- 172.21.15.81:0/2123777167 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1da4053840 con 0x7f1dac157ca0 2023-10-07T08:54:30.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.787+0000 7f1db2985700 1 -- 172.21.15.81:0/2123777167 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1dac153730 con 0x7f1d98066f30 2023-10-07T08:54:30.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.788+0000 7f1d93fff700 1 -- 172.21.15.81:0/2123777167 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1dac153730 con 0x7f1d98066f30 2023-10-07T08:54:30.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.790+0000 7f1db2985700 1 -- 172.21.15.81:0/2123777167 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1d98066f30 msgr2=0x7f1d980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.790+0000 7f1db2985700 1 --2- 172.21.15.81:0/2123777167 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1d98066f30 0x7f1d980693e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c006f00 tx=0x7f1d9c008040 comp rx=0 tx=0).stop 2023-10-07T08:54:30.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.790+0000 7f1db2985700 1 -- 172.21.15.81:0/2123777167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dac157ca0 msgr2=0x7f1dac16e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.790+0000 7f1db2985700 1 --2- 172.21.15.81:0/2123777167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dac157ca0 0x7f1dac16e030 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f1da400b6c0 tx=0x7f1da4018000 comp rx=0 tx=0).stop 2023-10-07T08:54:30.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.790+0000 7f1db2985700 1 -- 172.21.15.81:0/2123777167 shutdown_connections 2023-10-07T08:54:30.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.790+0000 7f1db2985700 1 --2- 172.21.15.81:0/2123777167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dac157ca0 0x7f1dac16e030 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.790+0000 7f1db2985700 1 --2- 172.21.15.81:0/2123777167 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1d98066f30 0x7f1d980693e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.790+0000 7f1db2985700 1 --2- 172.21.15.81:0/2123777167 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1dac06d120 0x7f1dac1511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.790+0000 7f1db2985700 1 --2- 172.21.15.81:0/2123777167 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1dac1578d0 0x7f1dac152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.790+0000 7f1db2985700 1 -- 172.21.15.81:0/2123777167 >> 172.21.15.81:0/2123777167 conn(0x7f1dac06bb90 msgr2=0x7f1dac156af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:30.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.790+0000 7f1db2985700 1 -- 172.21.15.81:0/2123777167 shutdown_connections 2023-10-07T08:54:30.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.790+0000 7f1db2985700 1 -- 172.21.15.81:0/2123777167 wait complete. 2023-10-07T08:54:30.793 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2023-10-07T08:54:30.803 INFO:tasks.ceph:Scrubbing osd.2 2023-10-07T08:54:30.803 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-07T08:54:30.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.919+0000 7f3763197700 1 Processor -- start 2023-10-07T08:54:30.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.919+0000 7f3763197700 1 -- start start 2023-10-07T08:54:30.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3763197700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f375c15db40 0x7f375c0b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3763197700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f375c068650 0x7f375c068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3763197700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375c068ff0 con 0x7f375c0b6370 2023-10-07T08:54:30.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3763197700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375c0b5850 con 0x7f375c068650 2023-10-07T08:54:30.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3763197700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375c0b3ce0 con 0x7f375c15db40 2023-10-07T08:54:30.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3762996700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f375c068650 0x7f375c068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3762996700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f375c068650 0x7f375c068ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35148/0 (socket says 172.21.15.81:35148) 2023-10-07T08:54:30.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3762996700 1 -- 172.21.15.81:0/3949765429 learned_addr learned my addr 172.21.15.81:0/3949765429 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:30.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3761994700 1 --2- 172.21.15.81:0/3949765429 >> v2:172.21.15.89:3300/0 conn(0x7f375c15db40 0x7f375c0b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3762996700 1 -- 172.21.15.81:0/3949765429 >> v2:172.21.15.89:3300/0 conn(0x7f375c15db40 msgr2=0x7f375c0b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:30.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3762996700 1 --2- 172.21.15.81:0/3949765429 >> v2:172.21.15.89:3300/0 conn(0x7f375c15db40 0x7f375c0b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3762996700 1 -- 172.21.15.81:0/3949765429 >> v1:172.21.15.89:6789/0 conn(0x7f375c0b6370 legacy=0x7f375c15af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:30.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3762996700 1 -- 172.21.15.81:0/3949765429 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c15a400 con 0x7f375c068650 2023-10-07T08:54:30.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3762996700 1 --2- 172.21.15.81:0/3949765429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c068650 0x7f375c068ab0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f375c063f60 tx=0x7f3754009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc82701add159b12 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:30.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3761193700 1 -- 172.21.15.81:0/3949765429 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375400e070 con 0x7f375c068650 2023-10-07T08:54:30.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3761193700 1 -- 172.21.15.81:0/3949765429 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375400ba00 con 0x7f375c068650 2023-10-07T08:54:30.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.920+0000 7f3761193700 1 -- 172.21.15.81:0/3949765429 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540092e0 con 0x7f375c068650 2023-10-07T08:54:30.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.921+0000 7f3763197700 1 -- 172.21.15.81:0/3949765429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c068650 msgr2=0x7f375c068ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.921+0000 7f3763197700 1 --2- 172.21.15.81:0/3949765429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c068650 0x7f375c068ab0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f375c063f60 tx=0x7f3754009840 comp rx=0 tx=0).stop 2023-10-07T08:54:30.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.921+0000 7f3763197700 1 -- 172.21.15.81:0/3949765429 shutdown_connections 2023-10-07T08:54:30.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.921+0000 7f3763197700 1 --2- 172.21.15.81:0/3949765429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c068650 0x7f375c068ab0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.921+0000 7f3763197700 1 --2- 172.21.15.81:0/3949765429 >> v2:172.21.15.89:3300/0 conn(0x7f375c15db40 0x7f375c0b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.921+0000 7f3763197700 1 -- 172.21.15.81:0/3949765429 >> 172.21.15.81:0/3949765429 conn(0x7f375c06bb90 msgr2=0x7f375c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:30.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.921+0000 7f3763197700 1 -- 172.21.15.81:0/3949765429 shutdown_connections 2023-10-07T08:54:30.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.921+0000 7f3763197700 1 -- 172.21.15.81:0/3949765429 wait complete. 2023-10-07T08:54:30.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.922+0000 7f3763197700 1 Processor -- start 2023-10-07T08:54:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.922+0000 7f3763197700 1 -- start start 2023-10-07T08:54:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3763197700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f375c068650 0x7f375c14ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3763197700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f375c0b6370 0x7f375c0aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3763197700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c15db40 0x7f375c0af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3763197700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c0b1090 con 0x7f375c15db40 2023-10-07T08:54:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3763197700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c14b2a0 con 0x7f375c0b6370 2023-10-07T08:54:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3763197700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c148240 con 0x7f375c068650 2023-10-07T08:54:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3762996700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c15db40 0x7f375c0af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3762996700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c15db40 0x7f375c0af1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35156/0 (socket says 172.21.15.81:35156) 2023-10-07T08:54:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3762996700 1 -- 172.21.15.81:0/87438456 learned_addr learned my addr 172.21.15.81:0/87438456 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3761994700 1 --2- 172.21.15.81:0/87438456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f375c0b6370 0x7f375c0aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3762195700 1 --2- 172.21.15.81:0/87438456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f375c068650 0x7f375c14ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3762996700 1 -- 172.21.15.81:0/87438456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f375c068650 msgr2=0x7f375c14ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3762996700 1 --2- 172.21.15.81:0/87438456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f375c068650 0x7f375c14ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3762996700 1 -- 172.21.15.81:0/87438456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f375c0b6370 msgr2=0x7f375c0aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3762996700 1 --2- 172.21.15.81:0/87438456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f375c0b6370 0x7f375c0aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3762996700 1 -- 172.21.15.81:0/87438456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3754009ae0 con 0x7f375c15db40 2023-10-07T08:54:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3761994700 1 --2- 172.21.15.81:0/87438456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f375c0b6370 0x7f375c0aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3762195700 1 --2- 172.21.15.81:0/87438456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f375c068650 0x7f375c14ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3762996700 1 --2- 172.21.15.81:0/87438456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c15db40 0x7f375c0af1b0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f375c0713d0 tx=0x7f3754017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f37527fc700 1 -- 172.21.15.81:0/87438456 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540092e0 con 0x7f375c15db40 2023-10-07T08:54:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f37527fc700 1 -- 172.21.15.81:0/87438456 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375401d420 con 0x7f375c15db40 2023-10-07T08:54:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f37527fc700 1 -- 172.21.15.81:0/87438456 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375401d800 con 0x7f375c15db40 2023-10-07T08:54:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3763197700 1 -- 172.21.15.81:0/87438456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375c148dc0 con 0x7f375c15db40 2023-10-07T08:54:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.923+0000 7f3763197700 1 -- 172.21.15.81:0/87438456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375c148770 con 0x7f375c15db40 2023-10-07T08:54:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.924+0000 7f3763197700 1 -- 172.21.15.81:0/87438456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f375c06fb00 con 0x7f375c15db40 2023-10-07T08:54:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.925+0000 7f37527fc700 1 -- 172.21.15.81:0/87438456 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f375401dbf0 con 0x7f375c15db40 2023-10-07T08:54:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.925+0000 7f37527fc700 1 --2- 172.21.15.81:0/87438456 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3740066f30 0x7f37400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.925+0000 7f37527fc700 1 -- 172.21.15.81:0/87438456 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3754085e50 con 0x7f375c15db40 2023-10-07T08:54:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.925+0000 7f3762195700 1 --2- 172.21.15.81:0/87438456 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3740066f30 0x7f37400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.925+0000 7f37527fc700 1 --2- 172.21.15.81:0/87438456 >> [v2:172.21.15.81:6816/86353,v1:172.21.15.81:6818/86353] conn(0x7f374006cd80 0x7f374006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.925+0000 7f37527fc700 1 -- 172.21.15.81:0/87438456 --> [v2:172.21.15.81:6816/86353,v1:172.21.15.81:6818/86353] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f374006f860 con 0x7f374006cd80 2023-10-07T08:54:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.925+0000 7f37527fc700 1 -- 172.21.15.81:0/87438456 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3754086220 con 0x7f375c15db40 2023-10-07T08:54:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.925+0000 7f3761994700 1 --2- 172.21.15.81:0/87438456 >> [v2:172.21.15.81:6816/86353,v1:172.21.15.81:6818/86353] conn(0x7f374006cd80 0x7f374006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.925+0000 7f3762195700 1 --2- 172.21.15.81:0/87438456 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3740066f30 0x7f37400693e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f375c0d1a90 tx=0x7f3758009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:30.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.926+0000 7f3761994700 1 --2- 172.21.15.81:0/87438456 >> [v2:172.21.15.81:6816/86353,v1:172.21.15.81:6818/86353] conn(0x7f374006cd80 0x7f374006f190 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:30.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.926+0000 7f37527fc700 1 -- 172.21.15.81:0/87438456 <== osd.2 v2:172.21.15.81:6816/86353 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f374006f860 con 0x7f374006cd80 2023-10-07T08:54:30.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.938+0000 7f3763197700 1 -- 172.21.15.81:0/87438456 --> [v2:172.21.15.81:6816/86353,v1:172.21.15.81:6818/86353] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f375c068ff0 con 0x7f374006cd80 2023-10-07T08:54:30.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.939+0000 7f37527fc700 1 -- 172.21.15.81:0/87438456 <== osd.2 v2:172.21.15.81:6816/86353 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f375c068ff0 con 0x7f374006cd80 2023-10-07T08:54:30.940 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:54:30.940 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-07T08:54:30.940 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:54:30.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.939+0000 7f3763197700 1 -- 172.21.15.81:0/87438456 >> [v2:172.21.15.81:6816/86353,v1:172.21.15.81:6818/86353] conn(0x7f374006cd80 msgr2=0x7f374006f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.939+0000 7f3763197700 1 --2- 172.21.15.81:0/87438456 >> [v2:172.21.15.81:6816/86353,v1:172.21.15.81:6818/86353] conn(0x7f374006cd80 0x7f374006f190 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:30.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.939+0000 7f3763197700 1 -- 172.21.15.81:0/87438456 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3740066f30 msgr2=0x7f37400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.939+0000 7f3763197700 1 --2- 172.21.15.81:0/87438456 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f3740066f30 0x7f37400693e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f375c0d1a90 tx=0x7f3758009040 comp rx=0 tx=0).stop 2023-10-07T08:54:30.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.939+0000 7f3763197700 1 -- 172.21.15.81:0/87438456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c15db40 msgr2=0x7f375c0af1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.939+0000 7f3763197700 1 --2- 172.21.15.81:0/87438456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c15db40 0x7f375c0af1b0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f375c0713d0 tx=0x7f3754017000 comp rx=0 tx=0).stop 2023-10-07T08:54:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.939+0000 7f3762996700 1 -- 172.21.15.81:0/87438456 reap_dead start 2023-10-07T08:54:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.939+0000 7f3763197700 1 -- 172.21.15.81:0/87438456 shutdown_connections 2023-10-07T08:54:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.939+0000 7f3763197700 1 -- 172.21.15.81:0/87438456 >> 172.21.15.81:0/87438456 conn(0x7f375c06bb90 msgr2=0x7f375c158b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.939+0000 7f3763197700 1 -- 172.21.15.81:0/87438456 shutdown_connections 2023-10-07T08:54:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:30.939+0000 7f3763197700 1 -- 172.21.15.81:0/87438456 wait complete. 2023-10-07T08:54:30.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-07T08:54:31.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.065+0000 7f46ce07e700 1 Processor -- start 2023-10-07T08:54:31.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.065+0000 7f46ce07e700 1 -- start start 2023-10-07T08:54:31.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.066+0000 7f46ce07e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46c81578d0 0x7f46c80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.066+0000 7f46ce07e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c806d120 0x7f46c806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.066+0000 7f46ce07e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c80d07c0 con 0x7f46c8157ca0 2023-10-07T08:54:31.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.066+0000 7f46ce07e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c806daa0 con 0x7f46c81578d0 2023-10-07T08:54:31.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.066+0000 7f46ce07e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c80cfbb0 con 0x7f46c806d120 2023-10-07T08:54:31.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.066+0000 7f46c77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46c81578d0 0x7f46c80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.066+0000 7f46c77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46c81578d0 0x7f46c80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35164/0 (socket says 172.21.15.81:35164) 2023-10-07T08:54:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.066+0000 7f46c77fe700 1 -- 172.21.15.81:0/586838557 learned_addr learned my addr 172.21.15.81:0/586838557 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.066+0000 7f46c6ffd700 1 --1- 172.21.15.81:0/586838557 >> v1:172.21.15.81:6789/0 conn(0x7f46c8157ca0 0x7f46c815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35456/0 (socket says 172.21.15.81:35456) 2023-10-07T08:54:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.066+0000 7f46c7fff700 1 --2- 172.21.15.81:0/586838557 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c806d120 0x7f46c806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.066+0000 7f46c77fe700 1 -- 172.21.15.81:0/586838557 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c806d120 msgr2=0x7f46c806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.066+0000 7f46c77fe700 1 --2- 172.21.15.81:0/586838557 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c806d120 0x7f46c806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.066+0000 7f46c77fe700 1 -- 172.21.15.81:0/586838557 >> v1:172.21.15.81:6789/0 conn(0x7f46c8157ca0 legacy=0x7f46c815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.066+0000 7f46c67fc700 1 -- 172.21.15.81:0/586838557 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692897096 0 0) 0x7f46c80d07c0 con 0x7f46c8157ca0 2023-10-07T08:54:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.066+0000 7f46c77fe700 1 -- 172.21.15.81:0/586838557 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c80cfe90 con 0x7f46c81578d0 2023-10-07T08:54:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.067+0000 7f46c77fe700 1 --2- 172.21.15.81:0/586838557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c81578d0 0x7f46c80cf4f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f46b80099b0 tx=0x7f46b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bd96145a9b38d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.067+0000 7f46c67fc700 1 -- 172.21.15.81:0/586838557 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b800b860 con 0x7f46c81578d0 2023-10-07T08:54:31.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.067+0000 7f46c67fc700 1 -- 172.21.15.81:0/586838557 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b800b9c0 con 0x7f46c81578d0 2023-10-07T08:54:31.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.067+0000 7f46c67fc700 1 -- 172.21.15.81:0/586838557 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b800bd60 con 0x7f46c81578d0 2023-10-07T08:54:31.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.067+0000 7f46ce07e700 1 -- 172.21.15.81:0/586838557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c81578d0 msgr2=0x7f46c80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.067+0000 7f46ce07e700 1 --2- 172.21.15.81:0/586838557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c81578d0 0x7f46c80cf4f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f46b80099b0 tx=0x7f46b8009250 comp rx=0 tx=0).stop 2023-10-07T08:54:31.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.067+0000 7f46ce07e700 1 -- 172.21.15.81:0/586838557 shutdown_connections 2023-10-07T08:54:31.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.067+0000 7f46ce07e700 1 --2- 172.21.15.81:0/586838557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c81578d0 0x7f46c80cf4f0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.067+0000 7f46ce07e700 1 --2- 172.21.15.81:0/586838557 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c806d120 0x7f46c806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.067+0000 7f46ce07e700 1 -- 172.21.15.81:0/586838557 >> 172.21.15.81:0/586838557 conn(0x7f46c806bb90 msgr2=0x7f46c806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:31.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.067+0000 7f46ce07e700 1 -- 172.21.15.81:0/586838557 shutdown_connections 2023-10-07T08:54:31.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.067+0000 7f46ce07e700 1 -- 172.21.15.81:0/586838557 wait complete. 2023-10-07T08:54:31.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.068+0000 7f46ce07e700 1 Processor -- start 2023-10-07T08:54:31.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.069+0000 7f46ce07e700 1 -- start start 2023-10-07T08:54:31.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.069+0000 7f46ce07e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c806d120 0x7f46c8153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.069+0000 7f46ce07e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c81578d0 0x7f46c814f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.069+0000 7f46ce07e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c8157ca0 0x7f46c8152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.069+0000 7f46ce07e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c814f8a0 con 0x7f46c81578d0 2023-10-07T08:54:31.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.069+0000 7f46ce07e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c8150b20 con 0x7f46c806d120 2023-10-07T08:54:31.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.069+0000 7f46ce07e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c814fb20 con 0x7f46c8157ca0 2023-10-07T08:54:31.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.069+0000 7f46c6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c81578d0 0x7f46c814f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.069+0000 7f46c6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c81578d0 0x7f46c814f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35168/0 (socket says 172.21.15.81:35168) 2023-10-07T08:54:31.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.069+0000 7f46c6ffd700 1 -- 172.21.15.81:0/475736544 learned_addr learned my addr 172.21.15.81:0/475736544 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:31.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.070+0000 7f46c77fe700 1 --2- 172.21.15.81:0/475736544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c806d120 0x7f46c8153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.070+0000 7f46c7fff700 1 --2- 172.21.15.81:0/475736544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c8157ca0 0x7f46c8152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.070+0000 7f46c6ffd700 1 -- 172.21.15.81:0/475736544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c8157ca0 msgr2=0x7f46c8152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.070+0000 7f46c6ffd700 1 --2- 172.21.15.81:0/475736544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c8157ca0 0x7f46c8152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.070+0000 7f46c6ffd700 1 -- 172.21.15.81:0/475736544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c806d120 msgr2=0x7f46c8153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.070+0000 7f46c6ffd700 1 --2- 172.21.15.81:0/475736544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c806d120 0x7f46c8153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.070+0000 7f46c6ffd700 1 -- 172.21.15.81:0/475736544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b80094f0 con 0x7f46c81578d0 2023-10-07T08:54:31.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.070+0000 7f46c6ffd700 1 --2- 172.21.15.81:0/475736544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c81578d0 0x7f46c814f360 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00c510 tx=0x7f46bc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:31.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.070+0000 7f46af7fe700 1 -- 172.21.15.81:0/475736544 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc005a70 con 0x7f46c81578d0 2023-10-07T08:54:31.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.070+0000 7f46af7fe700 1 -- 172.21.15.81:0/475736544 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc005bf0 con 0x7f46c81578d0 2023-10-07T08:54:31.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.070+0000 7f46af7fe700 1 -- 172.21.15.81:0/475736544 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc0070d0 con 0x7f46c81578d0 2023-10-07T08:54:31.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.070+0000 7f46ce07e700 1 -- 172.21.15.81:0/475736544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c814fe00 con 0x7f46c81578d0 2023-10-07T08:54:31.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.070+0000 7f46ce07e700 1 -- 172.21.15.81:0/475736544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c81503c0 con 0x7f46c81578d0 2023-10-07T08:54:31.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.071+0000 7f46ce07e700 1 -- 172.21.15.81:0/475736544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c8150ce0 con 0x7f46c81578d0 2023-10-07T08:54:31.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.071+0000 7f46af7fe700 1 -- 172.21.15.81:0/475736544 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46bc007440 con 0x7f46c81578d0 2023-10-07T08:54:31.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.072+0000 7f46af7fe700 1 --2- 172.21.15.81:0/475736544 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f46b4066f30 0x7f46b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.072+0000 7f46af7fe700 1 -- 172.21.15.81:0/475736544 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f46bc083760 con 0x7f46c81578d0 2023-10-07T08:54:31.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.072+0000 7f46c77fe700 1 --2- 172.21.15.81:0/475736544 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f46b4066f30 0x7f46b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.072+0000 7f46c77fe700 1 --2- 172.21.15.81:0/475736544 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f46b4066f30 0x7f46b40693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f46b80099b0 tx=0x7f46b8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:31.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.076+0000 7f46af7fe700 1 -- 172.21.15.81:0/475736544 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46bc050cd0 con 0x7f46c81578d0 2023-10-07T08:54:31.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.257+0000 7f46ce07e700 1 -- 172.21.15.81:0/475736544 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f46c80d0170 con 0x7f46b4066f30 2023-10-07T08:54:31.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.258+0000 7f46af7fe700 1 -- 172.21.15.81:0/475736544 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f46c80d0170 con 0x7f46b4066f30 2023-10-07T08:54:31.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.260+0000 7f46ce07e700 1 -- 172.21.15.81:0/475736544 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f46b4066f30 msgr2=0x7f46b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.260+0000 7f46ce07e700 1 --2- 172.21.15.81:0/475736544 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f46b4066f30 0x7f46b40693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f46b80099b0 tx=0x7f46b8017000 comp rx=0 tx=0).stop 2023-10-07T08:54:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.260+0000 7f46ce07e700 1 -- 172.21.15.81:0/475736544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c81578d0 msgr2=0x7f46c814f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.260+0000 7f46ce07e700 1 --2- 172.21.15.81:0/475736544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c81578d0 0x7f46c814f360 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00c510 tx=0x7f46bc00c8d0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.260+0000 7f46ce07e700 1 -- 172.21.15.81:0/475736544 shutdown_connections 2023-10-07T08:54:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.260+0000 7f46ce07e700 1 --2- 172.21.15.81:0/475736544 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f46b4066f30 0x7f46b40693e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.260+0000 7f46ce07e700 1 --2- 172.21.15.81:0/475736544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c8157ca0 0x7f46c8152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.260+0000 7f46ce07e700 1 --2- 172.21.15.81:0/475736544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c806d120 0x7f46c8153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.260+0000 7f46ce07e700 1 --2- 172.21.15.81:0/475736544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c81578d0 0x7f46c814f360 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.260+0000 7f46ce07e700 1 -- 172.21.15.81:0/475736544 >> 172.21.15.81:0/475736544 conn(0x7f46c806bb90 msgr2=0x7f46c81583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.260+0000 7f46ce07e700 1 -- 172.21.15.81:0/475736544 shutdown_connections 2023-10-07T08:54:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.260+0000 7f46ce07e700 1 -- 172.21.15.81:0/475736544 wait complete. 2023-10-07T08:54:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2023-10-07T08:54:31.273 INFO:tasks.ceph:Scrubbing osd.3 2023-10-07T08:54:31.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-07T08:54:31.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.390+0000 7fe36689f700 1 Processor -- start 2023-10-07T08:54:31.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.390+0000 7fe36689f700 1 -- start start 2023-10-07T08:54:31.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.390+0000 7fe36689f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe3601578d0 0x7fe3600cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.390+0000 7fe36689f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe360157ca0 0x7fe36015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.390+0000 7fe36689f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe36006d120 0x7fe36006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.390+0000 7fe36689f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3600d07c0 con 0x7fe360157ca0 2023-10-07T08:54:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.390+0000 7fe36689f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36006daa0 con 0x7fe3601578d0 2023-10-07T08:54:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.390+0000 7fe36689f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3600cfbb0 con 0x7fe36006d120 2023-10-07T08:54:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.391+0000 7fe35f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe360157ca0 0x7fe36015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.391+0000 7fe35f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe360157ca0 0x7fe36015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35170/0 (socket says 172.21.15.81:35170) 2023-10-07T08:54:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.391+0000 7fe35f7fe700 1 -- 172.21.15.81:0/520451906 learned_addr learned my addr 172.21.15.81:0/520451906 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.391+0000 7fe364e3c700 1 --2- 172.21.15.81:0/520451906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe36006d120 0x7fe36006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.391+0000 7fe35ffff700 1 --2- 172.21.15.81:0/520451906 >> v2:172.21.15.89:3300/0 conn(0x7fe3601578d0 0x7fe3600cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.391+0000 7fe35f7fe700 1 -- 172.21.15.81:0/520451906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe36006d120 msgr2=0x7fe36006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.391+0000 7fe35f7fe700 1 --2- 172.21.15.81:0/520451906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe36006d120 0x7fe36006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.391+0000 7fe35f7fe700 1 -- 172.21.15.81:0/520451906 >> v2:172.21.15.89:3300/0 conn(0x7fe3601578d0 msgr2=0x7fe3600cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.391+0000 7fe35f7fe700 1 --2- 172.21.15.81:0/520451906 >> v2:172.21.15.89:3300/0 conn(0x7fe3601578d0 0x7fe3600cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.391+0000 7fe35f7fe700 1 -- 172.21.15.81:0/520451906 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3600cfe90 con 0x7fe360157ca0 2023-10-07T08:54:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.391+0000 7fe35f7fe700 1 --2- 172.21.15.81:0/520451906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe360157ca0 0x7fe36015af00 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fe3600646b0 tx=0x7fe354009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc43abfd4c95e234 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.391+0000 7fe35effd700 1 -- 172.21.15.81:0/520451906 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35400b860 con 0x7fe360157ca0 2023-10-07T08:54:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.391+0000 7fe35effd700 1 -- 172.21.15.81:0/520451906 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35400b9c0 con 0x7fe360157ca0 2023-10-07T08:54:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.391+0000 7fe35effd700 1 -- 172.21.15.81:0/520451906 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35400bd60 con 0x7fe360157ca0 2023-10-07T08:54:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.392+0000 7fe36689f700 1 -- 172.21.15.81:0/520451906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe360157ca0 msgr2=0x7fe36015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.392+0000 7fe36689f700 1 --2- 172.21.15.81:0/520451906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe360157ca0 0x7fe36015af00 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fe3600646b0 tx=0x7fe354009250 comp rx=0 tx=0).stop 2023-10-07T08:54:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.392+0000 7fe36689f700 1 -- 172.21.15.81:0/520451906 shutdown_connections 2023-10-07T08:54:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.392+0000 7fe36689f700 1 --2- 172.21.15.81:0/520451906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe36006d120 0x7fe36006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.392+0000 7fe36689f700 1 --2- 172.21.15.81:0/520451906 >> v2:172.21.15.89:3300/0 conn(0x7fe3601578d0 0x7fe3600cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.392+0000 7fe36689f700 1 --2- 172.21.15.81:0/520451906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe360157ca0 0x7fe36015af00 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.392+0000 7fe36689f700 1 -- 172.21.15.81:0/520451906 >> 172.21.15.81:0/520451906 conn(0x7fe36006bb90 msgr2=0x7fe36006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:31.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.392+0000 7fe36689f700 1 -- 172.21.15.81:0/520451906 shutdown_connections 2023-10-07T08:54:31.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.392+0000 7fe36689f700 1 -- 172.21.15.81:0/520451906 wait complete. 2023-10-07T08:54:31.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.393+0000 7fe36689f700 1 Processor -- start 2023-10-07T08:54:31.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.393+0000 7fe36689f700 1 -- start start 2023-10-07T08:54:31.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe36689f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe36006d120 0x7fe3600b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe36689f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3601578d0 0x7fe36016d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe36689f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe360157ca0 0x7fe3600c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe36689f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36016de50 con 0x7fe36006d120 2023-10-07T08:54:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe36689f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36016e080 con 0x7fe3601578d0 2023-10-07T08:54:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe36689f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36016e360 con 0x7fe360157ca0 2023-10-07T08:54:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe35ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe36006d120 0x7fe3600b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe35ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe36006d120 0x7fe3600b5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35186/0 (socket says 172.21.15.81:35186) 2023-10-07T08:54:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe35ffff700 1 -- 172.21.15.81:0/3946743388 learned_addr learned my addr 172.21.15.81:0/3946743388 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe35f7fe700 1 --2- 172.21.15.81:0/3946743388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3601578d0 0x7fe36016d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe364e3c700 1 --2- 172.21.15.81:0/3946743388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe360157ca0 0x7fe3600c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe35ffff700 1 -- 172.21.15.81:0/3946743388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe360157ca0 msgr2=0x7fe3600c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe35ffff700 1 --2- 172.21.15.81:0/3946743388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe360157ca0 0x7fe3600c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe35ffff700 1 -- 172.21.15.81:0/3946743388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3601578d0 msgr2=0x7fe36016d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe35ffff700 1 --2- 172.21.15.81:0/3946743388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3601578d0 0x7fe36016d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe35ffff700 1 -- 172.21.15.81:0/3946743388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3540094f0 con 0x7fe36006d120 2023-10-07T08:54:31.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe35ffff700 1 --2- 172.21.15.81:0/3946743388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe36006d120 0x7fe3600b5d50 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fe35000d890 tx=0x7fe350008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:31.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe347fff700 1 -- 172.21.15.81:0/3946743388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3500125f0 con 0x7fe36006d120 2023-10-07T08:54:31.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe347fff700 1 -- 172.21.15.81:0/3946743388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe350012750 con 0x7fe36006d120 2023-10-07T08:54:31.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe36689f700 1 -- 172.21.15.81:0/3946743388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36016e640 con 0x7fe36006d120 2023-10-07T08:54:31.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.394+0000 7fe347fff700 1 -- 172.21.15.81:0/3946743388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe350012af0 con 0x7fe36006d120 2023-10-07T08:54:31.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.395+0000 7fe36689f700 1 -- 172.21.15.81:0/3946743388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3600c7a50 con 0x7fe36006d120 2023-10-07T08:54:31.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.395+0000 7fe36689f700 1 -- 172.21.15.81:0/3946743388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe36016e880 con 0x7fe36006d120 2023-10-07T08:54:31.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.396+0000 7fe347fff700 1 -- 172.21.15.81:0/3946743388 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe35001e460 con 0x7fe36006d120 2023-10-07T08:54:31.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.396+0000 7fe347fff700 1 --2- 172.21.15.81:0/3946743388 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe34c066f30 0x7fe34c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.396+0000 7fe347fff700 1 -- 172.21.15.81:0/3946743388 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe3500847a0 con 0x7fe36006d120 2023-10-07T08:54:31.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.396+0000 7fe35f7fe700 1 --2- 172.21.15.81:0/3946743388 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe34c066f30 0x7fe34c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.396+0000 7fe347fff700 1 --2- 172.21.15.81:0/3946743388 >> [v2:172.21.15.81:6808/86339,v1:172.21.15.81:6809/86339] conn(0x7fe34c06cd80 0x7fe34c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.396+0000 7fe347fff700 1 -- 172.21.15.81:0/3946743388 --> [v2:172.21.15.81:6808/86339,v1:172.21.15.81:6809/86339] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe34c06f860 con 0x7fe34c06cd80 2023-10-07T08:54:31.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.396+0000 7fe347fff700 1 -- 172.21.15.81:0/3946743388 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe350086de0 con 0x7fe36006d120 2023-10-07T08:54:31.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.396+0000 7fe364e3c700 1 --2- 172.21.15.81:0/3946743388 >> [v2:172.21.15.81:6808/86339,v1:172.21.15.81:6809/86339] conn(0x7fe34c06cd80 0x7fe34c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.397+0000 7fe35f7fe700 1 --2- 172.21.15.81:0/3946743388 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe34c066f30 0x7fe34c0693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe3600646b0 tx=0x7fe354017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:31.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.397+0000 7fe364e3c700 1 --2- 172.21.15.81:0/3946743388 >> [v2:172.21.15.81:6808/86339,v1:172.21.15.81:6809/86339] conn(0x7fe34c06cd80 0x7fe34c06f190 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:31.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.397+0000 7fe347fff700 1 -- 172.21.15.81:0/3946743388 <== osd.3 v2:172.21.15.81:6808/86339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fe34c06f860 con 0x7fe34c06cd80 2023-10-07T08:54:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.409+0000 7fe36689f700 1 -- 172.21.15.81:0/3946743388 --> [v2:172.21.15.81:6808/86339,v1:172.21.15.81:6809/86339] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe3600b3ba0 con 0x7fe34c06cd80 2023-10-07T08:54:31.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.410+0000 7fe347fff700 1 -- 172.21.15.81:0/3946743388 <== osd.3 v2:172.21.15.81:6808/86339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7fe3600b3ba0 con 0x7fe34c06cd80 2023-10-07T08:54:31.411 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:54:31.411 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-07T08:54:31.412 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:54:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.410+0000 7fe36689f700 1 -- 172.21.15.81:0/3946743388 >> [v2:172.21.15.81:6808/86339,v1:172.21.15.81:6809/86339] conn(0x7fe34c06cd80 msgr2=0x7fe34c06f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.410+0000 7fe36689f700 1 --2- 172.21.15.81:0/3946743388 >> [v2:172.21.15.81:6808/86339,v1:172.21.15.81:6809/86339] conn(0x7fe34c06cd80 0x7fe34c06f190 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.410+0000 7fe36689f700 1 -- 172.21.15.81:0/3946743388 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe34c066f30 msgr2=0x7fe34c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.410+0000 7fe36689f700 1 --2- 172.21.15.81:0/3946743388 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fe34c066f30 0x7fe34c0693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe3600646b0 tx=0x7fe354017000 comp rx=0 tx=0).stop 2023-10-07T08:54:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.410+0000 7fe36689f700 1 -- 172.21.15.81:0/3946743388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe36006d120 msgr2=0x7fe3600b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.410+0000 7fe36689f700 1 --2- 172.21.15.81:0/3946743388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe36006d120 0x7fe3600b5d50 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fe35000d890 tx=0x7fe350008040 comp rx=0 tx=0).stop 2023-10-07T08:54:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.410+0000 7fe364e3c700 1 -- 172.21.15.81:0/3946743388 reap_dead start 2023-10-07T08:54:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.410+0000 7fe36689f700 1 -- 172.21.15.81:0/3946743388 shutdown_connections 2023-10-07T08:54:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.410+0000 7fe36689f700 1 -- 172.21.15.81:0/3946743388 >> 172.21.15.81:0/3946743388 conn(0x7fe36006bb90 msgr2=0x7fe3601546a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.410+0000 7fe36689f700 1 -- 172.21.15.81:0/3946743388 shutdown_connections 2023-10-07T08:54:31.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.410+0000 7fe36689f700 1 -- 172.21.15.81:0/3946743388 wait complete. 2023-10-07T08:54:31.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-07T08:54:31.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.536+0000 7f1ae53a0700 1 Processor -- start 2023-10-07T08:54:31.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.536+0000 7f1ae53a0700 1 -- start start 2023-10-07T08:54:31.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1ae53a0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ae0157ca0 0x7f1ae00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1ae53a0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ae006d120 0x7f1ae006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1ae53a0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae006dac0 con 0x7f1ae01578d0 2023-10-07T08:54:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1ae53a0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae00d07c0 con 0x7f1ae006d120 2023-10-07T08:54:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1ae53a0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae00cfbb0 con 0x7f1ae0157ca0 2023-10-07T08:54:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1adf7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ae006d120 0x7f1ae006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1adf7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ae006d120 0x7f1ae006d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35200/0 (socket says 172.21.15.81:35200) 2023-10-07T08:54:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1adf7fe700 1 -- 172.21.15.81:0/831144478 learned_addr learned my addr 172.21.15.81:0/831144478 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1ade7fc700 1 --2- 172.21.15.81:0/831144478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ae0157ca0 0x7f1ae00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1adf7fe700 1 -- 172.21.15.81:0/831144478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ae0157ca0 msgr2=0x7f1ae00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1adf7fe700 1 --2- 172.21.15.81:0/831144478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ae0157ca0 0x7f1ae00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1adf7fe700 1 -- 172.21.15.81:0/831144478 >> v1:172.21.15.89:6789/0 conn(0x7f1ae01578d0 legacy=0x7f1ae015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1adf7fe700 1 -- 172.21.15.81:0/831144478 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae00cfe90 con 0x7f1ae006d120 2023-10-07T08:54:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1adf7fe700 1 --2- 172.21.15.81:0/831144478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae006d120 0x7f1ae006d580 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80099b0 tx=0x7f1ad8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b115b7654d22b6ad server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1addffb700 1 -- 172.21.15.81:0/831144478 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800b820 con 0x7f1ae006d120 2023-10-07T08:54:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1addffb700 1 -- 172.21.15.81:0/831144478 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad800b980 con 0x7f1ae006d120 2023-10-07T08:54:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.537+0000 7f1addffb700 1 -- 172.21.15.81:0/831144478 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800bd20 con 0x7f1ae006d120 2023-10-07T08:54:31.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.538+0000 7f1ae53a0700 1 -- 172.21.15.81:0/831144478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae006d120 msgr2=0x7f1ae006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.538+0000 7f1ae53a0700 1 --2- 172.21.15.81:0/831144478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae006d120 0x7f1ae006d580 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80099b0 tx=0x7f1ad8009250 comp rx=0 tx=0).stop 2023-10-07T08:54:31.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.538+0000 7f1ae53a0700 1 -- 172.21.15.81:0/831144478 shutdown_connections 2023-10-07T08:54:31.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.538+0000 7f1ae53a0700 1 --2- 172.21.15.81:0/831144478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae006d120 0x7f1ae006d580 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.538+0000 7f1ae53a0700 1 --2- 172.21.15.81:0/831144478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ae0157ca0 0x7f1ae00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.538+0000 7f1ae53a0700 1 -- 172.21.15.81:0/831144478 >> 172.21.15.81:0/831144478 conn(0x7f1ae006bb90 msgr2=0x7f1ae006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:31.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.538+0000 7f1ae53a0700 1 -- 172.21.15.81:0/831144478 shutdown_connections 2023-10-07T08:54:31.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.538+0000 7f1ae53a0700 1 -- 172.21.15.81:0/831144478 wait complete. 2023-10-07T08:54:31.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.539+0000 7f1ae53a0700 1 Processor -- start 2023-10-07T08:54:31.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.539+0000 7f1ae53a0700 1 -- start start 2023-10-07T08:54:31.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.540+0000 7f1ae53a0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ae006d120 0x7f1ae0154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.540+0000 7f1ae53a0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae01578d0 0x7f1ae0154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.540+0000 7f1ae53a0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ae0157ca0 0x7f1ae01580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.540+0000 7f1ae53a0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0155e10 con 0x7f1ae01578d0 2023-10-07T08:54:31.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.540+0000 7f1ae53a0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae016a6f0 con 0x7f1ae0157ca0 2023-10-07T08:54:31.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.540+0000 7f1ae53a0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0156080 con 0x7f1ae006d120 2023-10-07T08:54:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.540+0000 7f1ade7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae01578d0 0x7f1ae0154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.540+0000 7f1adeffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ae006d120 0x7f1ae0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.540+0000 7f1ade7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae01578d0 0x7f1ae0154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35212/0 (socket says 172.21.15.81:35212) 2023-10-07T08:54:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.540+0000 7f1ade7fc700 1 -- 172.21.15.81:0/669555545 learned_addr learned my addr 172.21.15.81:0/669555545 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.540+0000 7f1adf7fe700 1 --2- 172.21.15.81:0/669555545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ae0157ca0 0x7f1ae01580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.540+0000 7f1ade7fc700 1 -- 172.21.15.81:0/669555545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ae006d120 msgr2=0x7f1ae0154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.540+0000 7f1ade7fc700 1 --2- 172.21.15.81:0/669555545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ae006d120 0x7f1ae0154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.540+0000 7f1ade7fc700 1 -- 172.21.15.81:0/669555545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ae0157ca0 msgr2=0x7f1ae01580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.540+0000 7f1ade7fc700 1 --2- 172.21.15.81:0/669555545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ae0157ca0 0x7f1ae01580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.540+0000 7f1ade7fc700 1 -- 172.21.15.81:0/669555545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad80094f0 con 0x7f1ae01578d0 2023-10-07T08:54:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.541+0000 7f1ade7fc700 1 --2- 172.21.15.81:0/669555545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae01578d0 0x7f1ae0154d50 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400c880 tx=0x7f1ad4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.541+0000 7f1ac6ffd700 1 -- 172.21.15.81:0/669555545 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4011600 con 0x7f1ae01578d0 2023-10-07T08:54:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.541+0000 7f1ac6ffd700 1 -- 172.21.15.81:0/669555545 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad4011760 con 0x7f1ae01578d0 2023-10-07T08:54:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.541+0000 7f1ac6ffd700 1 -- 172.21.15.81:0/669555545 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4011b00 con 0x7f1ae01578d0 2023-10-07T08:54:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.541+0000 7f1ae53a0700 1 -- 172.21.15.81:0/669555545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae016a990 con 0x7f1ae01578d0 2023-10-07T08:54:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.541+0000 7f1ae53a0700 1 -- 172.21.15.81:0/669555545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae0158f40 con 0x7f1ae01578d0 2023-10-07T08:54:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.542+0000 7f1ae53a0700 1 -- 172.21.15.81:0/669555545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae016af20 con 0x7f1ae01578d0 2023-10-07T08:54:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.542+0000 7f1ac6ffd700 1 -- 172.21.15.81:0/669555545 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ad4018360 con 0x7f1ae01578d0 2023-10-07T08:54:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.542+0000 7f1ac6ffd700 1 --2- 172.21.15.81:0/669555545 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1acc066f30 0x7f1acc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.543+0000 7f1ac6ffd700 1 -- 172.21.15.81:0/669555545 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1ad4084080 con 0x7f1ae01578d0 2023-10-07T08:54:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.543+0000 7f1adeffd700 1 --2- 172.21.15.81:0/669555545 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1acc066f30 0x7f1acc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.543+0000 7f1adeffd700 1 --2- 172.21.15.81:0/669555545 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1acc066f30 0x7f1acc0693e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0007fd0 tx=0x7f1ad00026a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:31.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.547+0000 7f1ac6ffd700 1 -- 172.21.15.81:0/669555545 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ae016af20 con 0x7f1ae01578d0 2023-10-07T08:54:31.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.729+0000 7f1ae53a0700 1 -- 172.21.15.81:0/669555545 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ae016af20 con 0x7f1acc066f30 2023-10-07T08:54:31.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.729+0000 7f1ac6ffd700 1 -- 172.21.15.81:0/669555545 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1ae016af20 con 0x7f1acc066f30 2023-10-07T08:54:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.732+0000 7f1ae53a0700 1 -- 172.21.15.81:0/669555545 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1acc066f30 msgr2=0x7f1acc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.732+0000 7f1ae53a0700 1 --2- 172.21.15.81:0/669555545 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1acc066f30 0x7f1acc0693e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0007fd0 tx=0x7f1ad00026a0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.732+0000 7f1ae53a0700 1 -- 172.21.15.81:0/669555545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae01578d0 msgr2=0x7f1ae0154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.732+0000 7f1ae53a0700 1 --2- 172.21.15.81:0/669555545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae01578d0 0x7f1ae0154d50 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400c880 tx=0x7f1ad4008040 comp rx=0 tx=0).stop 2023-10-07T08:54:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.732+0000 7f1ae53a0700 1 -- 172.21.15.81:0/669555545 shutdown_connections 2023-10-07T08:54:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.732+0000 7f1ae53a0700 1 --2- 172.21.15.81:0/669555545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ae0157ca0 0x7f1ae01580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.732+0000 7f1ae53a0700 1 --2- 172.21.15.81:0/669555545 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f1acc066f30 0x7f1acc0693e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.732+0000 7f1ae53a0700 1 --2- 172.21.15.81:0/669555545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ae006d120 0x7f1ae0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.732+0000 7f1ae53a0700 1 --2- 172.21.15.81:0/669555545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ae01578d0 0x7f1ae0154d50 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.732+0000 7f1ae53a0700 1 -- 172.21.15.81:0/669555545 >> 172.21.15.81:0/669555545 conn(0x7f1ae006bb90 msgr2=0x7f1ae0069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.732+0000 7f1ae53a0700 1 -- 172.21.15.81:0/669555545 shutdown_connections 2023-10-07T08:54:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.732+0000 7f1ae53a0700 1 -- 172.21.15.81:0/669555545 wait complete. 2023-10-07T08:54:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2023-10-07T08:54:31.746 INFO:tasks.ceph:Scrubbing osd.4 2023-10-07T08:54:31.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-07T08:54:31.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.864+0000 7f56939e8700 1 Processor -- start 2023-10-07T08:54:31.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.865+0000 7f56939e8700 1 -- start start 2023-10-07T08:54:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.865+0000 7f56939e8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f568c15a2a0 0x7f568c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.865+0000 7f56939e8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f568c0ceb30 0x7f568c0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.865+0000 7f56939e8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568c0b0ca0 con 0x7f568c06d650 2023-10-07T08:54:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.865+0000 7f56939e8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568c06e160 con 0x7f568c15a2a0 2023-10-07T08:54:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.865+0000 7f56939e8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568c06ea90 con 0x7f568c0ceb30 2023-10-07T08:54:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.865+0000 7f5691784700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f568c15a2a0 0x7f568c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.865+0000 7f5691784700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f568c15a2a0 0x7f568c0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35222/0 (socket says 172.21.15.81:35222) 2023-10-07T08:54:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.866+0000 7f5691784700 1 -- 172.21.15.81:0/698522669 learned_addr learned my addr 172.21.15.81:0/698522669 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.866+0000 7f5690f83700 1 --2- 172.21.15.81:0/698522669 >> v2:172.21.15.89:3300/0 conn(0x7f568c0ceb30 0x7f568c0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.866+0000 7f5691784700 1 -- 172.21.15.81:0/698522669 >> v2:172.21.15.89:3300/0 conn(0x7f568c0ceb30 msgr2=0x7f568c0cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.866+0000 7f5691784700 1 --2- 172.21.15.81:0/698522669 >> v2:172.21.15.89:3300/0 conn(0x7f568c0ceb30 0x7f568c0cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.866+0000 7f5691784700 1 -- 172.21.15.81:0/698522669 >> v1:172.21.15.89:6789/0 conn(0x7f568c06d650 legacy=0x7f568c06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.866+0000 7f5691784700 1 -- 172.21.15.81:0/698522669 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c0b00d0 con 0x7f568c15a2a0 2023-10-07T08:54:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.866+0000 7f5691784700 1 --2- 172.21.15.81:0/698522669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f568c15a2a0 0x7f568c0b1130 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f568c06ab90 tx=0x7f5688009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449493d65a9a8acd server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.866+0000 7f5683fff700 1 -- 172.21.15.81:0/698522669 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688009e70 con 0x7f568c15a2a0 2023-10-07T08:54:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.866+0000 7f5683fff700 1 -- 172.21.15.81:0/698522669 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568800b860 con 0x7f568c15a2a0 2023-10-07T08:54:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.866+0000 7f5683fff700 1 -- 172.21.15.81:0/698522669 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568800bc00 con 0x7f568c15a2a0 2023-10-07T08:54:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.867+0000 7f56939e8700 1 -- 172.21.15.81:0/698522669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f568c15a2a0 msgr2=0x7f568c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.867+0000 7f56939e8700 1 --2- 172.21.15.81:0/698522669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f568c15a2a0 0x7f568c0b1130 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f568c06ab90 tx=0x7f5688009250 comp rx=0 tx=0).stop 2023-10-07T08:54:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.867+0000 7f56939e8700 1 -- 172.21.15.81:0/698522669 shutdown_connections 2023-10-07T08:54:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.867+0000 7f56939e8700 1 --2- 172.21.15.81:0/698522669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f568c15a2a0 0x7f568c0b1130 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.867+0000 7f56939e8700 1 --2- 172.21.15.81:0/698522669 >> v2:172.21.15.89:3300/0 conn(0x7f568c0ceb30 0x7f568c0cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.867+0000 7f56939e8700 1 -- 172.21.15.81:0/698522669 >> 172.21.15.81:0/698522669 conn(0x7f568c067640 msgr2=0x7f568c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.867+0000 7f56939e8700 1 -- 172.21.15.81:0/698522669 shutdown_connections 2023-10-07T08:54:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.867+0000 7f56939e8700 1 -- 172.21.15.81:0/698522669 wait complete. 2023-10-07T08:54:31.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.868+0000 7f56939e8700 1 Processor -- start 2023-10-07T08:54:31.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.868+0000 7f56939e8700 1 -- start start 2023-10-07T08:54:31.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f56939e8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f568c06d650 0x7f568c156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f56939e8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f568c0ceb30 0x7f568c14ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f56939e8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f568c15a2a0 0x7f568c154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f56939e8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c1573a0 con 0x7f568c06d650 2023-10-07T08:54:31.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f56939e8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c150520 con 0x7f568c15a2a0 2023-10-07T08:54:31.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f56939e8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c154a90 con 0x7f568c0ceb30 2023-10-07T08:54:31.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f5691784700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f568c06d650 0x7f568c156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f5691784700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f568c06d650 0x7f568c156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35234/0 (socket says 172.21.15.81:35234) 2023-10-07T08:54:31.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f5691784700 1 -- 172.21.15.81:0/3992320086 learned_addr learned my addr 172.21.15.81:0/3992320086 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:31.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f5690f83700 1 --2- 172.21.15.81:0/3992320086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f568c0ceb30 0x7f568c14ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f5691f85700 1 --2- 172.21.15.81:0/3992320086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f568c15a2a0 0x7f568c154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f5691784700 1 -- 172.21.15.81:0/3992320086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f568c0ceb30 msgr2=0x7f568c14ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f5691784700 1 --2- 172.21.15.81:0/3992320086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f568c0ceb30 0x7f568c14ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f5691784700 1 -- 172.21.15.81:0/3992320086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f568c15a2a0 msgr2=0x7f568c154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f5691784700 1 --2- 172.21.15.81:0/3992320086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f568c15a2a0 0x7f568c154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f5691784700 1 -- 172.21.15.81:0/3992320086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56880094f0 con 0x7f568c06d650 2023-10-07T08:54:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f5691f85700 1 --2- 172.21.15.81:0/3992320086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f568c15a2a0 0x7f568c154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f5691784700 1 --2- 172.21.15.81:0/3992320086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f568c06d650 0x7f568c156e60 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f568c06f990 tx=0x7f5688017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f56817fa700 1 -- 172.21.15.81:0/3992320086 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568800b9d0 con 0x7f568c06d650 2023-10-07T08:54:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f56817fa700 1 -- 172.21.15.81:0/3992320086 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568800bb30 con 0x7f568c06d650 2023-10-07T08:54:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f56939e8700 1 -- 172.21.15.81:0/3992320086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568c152dc0 con 0x7f568c06d650 2023-10-07T08:54:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.869+0000 7f56817fa700 1 -- 172.21.15.81:0/3992320086 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688025670 con 0x7f568c06d650 2023-10-07T08:54:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.870+0000 7f56939e8700 1 -- 172.21.15.81:0/3992320086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568c153380 con 0x7f568c06d650 2023-10-07T08:54:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.870+0000 7f56939e8700 1 -- 172.21.15.81:0/3992320086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f568c0c9640 con 0x7f568c06d650 2023-10-07T08:54:31.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.871+0000 7f56817fa700 1 -- 172.21.15.81:0/3992320086 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5688023070 con 0x7f568c06d650 2023-10-07T08:54:31.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.871+0000 7f56817fa700 1 --2- 172.21.15.81:0/3992320086 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5670066f30 0x7f56700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.871+0000 7f56817fa700 1 -- 172.21.15.81:0/3992320086 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5688085730 con 0x7f568c06d650 2023-10-07T08:54:31.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.871+0000 7f5690f83700 1 --2- 172.21.15.81:0/3992320086 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5670066f30 0x7f56700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.871+0000 7f56817fa700 1 --2- 172.21.15.81:0/3992320086 >> [v2:172.21.15.89:6800/86542,v1:172.21.15.89:6801/86542] conn(0x7f567006cd80 0x7f567006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:31.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.871+0000 7f56817fa700 1 -- 172.21.15.81:0/3992320086 --> [v2:172.21.15.89:6800/86542,v1:172.21.15.89:6801/86542] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f567006f860 con 0x7f567006cd80 2023-10-07T08:54:31.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.871+0000 7f56817fa700 1 -- 172.21.15.81:0/3992320086 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5688087d70 con 0x7f568c06d650 2023-10-07T08:54:31.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.871+0000 7f5691f85700 1 --2- 172.21.15.81:0/3992320086 >> [v2:172.21.15.89:6800/86542,v1:172.21.15.89:6801/86542] conn(0x7f567006cd80 0x7f567006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:31.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.871+0000 7f5690f83700 1 --2- 172.21.15.81:0/3992320086 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5670066f30 0x7f56700693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f568c16ddf0 tx=0x7f567c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:31.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.872+0000 7f5691f85700 1 --2- 172.21.15.81:0/3992320086 >> [v2:172.21.15.89:6800/86542,v1:172.21.15.89:6801/86542] conn(0x7f567006cd80 0x7f567006f190 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:31.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.872+0000 7f56817fa700 1 -- 172.21.15.81:0/3992320086 <== osd.4 v2:172.21.15.89:6800/86542 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f567006f860 con 0x7f567006cd80 2023-10-07T08:54:31.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.885+0000 7f56939e8700 1 -- 172.21.15.81:0/3992320086 --> [v2:172.21.15.89:6800/86542,v1:172.21.15.89:6801/86542] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f568c069e40 con 0x7f567006cd80 2023-10-07T08:54:31.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.885+0000 7f56817fa700 1 -- 172.21.15.81:0/3992320086 <== osd.4 v2:172.21.15.89:6800/86542 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f568c069e40 con 0x7f567006cd80 2023-10-07T08:54:31.887 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:54:31.887 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-07T08:54:31.887 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:54:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.886+0000 7f56939e8700 1 -- 172.21.15.81:0/3992320086 >> [v2:172.21.15.89:6800/86542,v1:172.21.15.89:6801/86542] conn(0x7f567006cd80 msgr2=0x7f567006f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.886+0000 7f56939e8700 1 --2- 172.21.15.81:0/3992320086 >> [v2:172.21.15.89:6800/86542,v1:172.21.15.89:6801/86542] conn(0x7f567006cd80 0x7f567006f190 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.886+0000 7f56939e8700 1 -- 172.21.15.81:0/3992320086 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5670066f30 msgr2=0x7f56700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.886+0000 7f56939e8700 1 --2- 172.21.15.81:0/3992320086 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f5670066f30 0x7f56700693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f568c16ddf0 tx=0x7f567c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.886+0000 7f56939e8700 1 -- 172.21.15.81:0/3992320086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f568c06d650 msgr2=0x7f568c156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.886+0000 7f56939e8700 1 --2- 172.21.15.81:0/3992320086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f568c06d650 0x7f568c156e60 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f568c06f990 tx=0x7f5688017000 comp rx=0 tx=0).stop 2023-10-07T08:54:31.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.886+0000 7f5691f85700 1 -- 172.21.15.81:0/3992320086 reap_dead start 2023-10-07T08:54:31.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.886+0000 7f56939e8700 1 -- 172.21.15.81:0/3992320086 shutdown_connections 2023-10-07T08:54:31.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.886+0000 7f56939e8700 1 -- 172.21.15.81:0/3992320086 >> 172.21.15.81:0/3992320086 conn(0x7f568c067640 msgr2=0x7f568c0ad6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:31.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.886+0000 7f56939e8700 1 -- 172.21.15.81:0/3992320086 shutdown_connections 2023-10-07T08:54:31.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:31.886+0000 7f56939e8700 1 -- 172.21.15.81:0/3992320086 wait complete. 2023-10-07T08:54:31.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-07T08:54:32.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.012+0000 7fbedaa63700 1 Processor -- start 2023-10-07T08:54:32.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.012+0000 7fbedaa63700 1 -- start start 2023-10-07T08:54:32.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.013+0000 7fbedaa63700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbed4157ca0 0x7fbed40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.013+0000 7fbedaa63700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbed406d120 0x7fbed406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.013+0000 7fbedaa63700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed40d07c0 con 0x7fbed41578d0 2023-10-07T08:54:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.013+0000 7fbedaa63700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed406da50 con 0x7fbed4157ca0 2023-10-07T08:54:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.013+0000 7fbedaa63700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed40cfbb0 con 0x7fbed406d120 2023-10-07T08:54:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.013+0000 7fbed37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbed4157ca0 0x7fbed40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.013+0000 7fbed37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbed4157ca0 0x7fbed40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35250/0 (socket says 172.21.15.81:35250) 2023-10-07T08:54:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.013+0000 7fbed37fe700 1 -- 172.21.15.81:0/826384062 learned_addr learned my addr 172.21.15.81:0/826384062 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.014+0000 7fbed9000700 1 --2- 172.21.15.81:0/826384062 >> v2:172.21.15.89:3300/0 conn(0x7fbed406d120 0x7fbed406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.014+0000 7fbed37fe700 1 -- 172.21.15.81:0/826384062 >> v2:172.21.15.89:3300/0 conn(0x7fbed406d120 msgr2=0x7fbed406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.014+0000 7fbed37fe700 1 --2- 172.21.15.81:0/826384062 >> v2:172.21.15.89:3300/0 conn(0x7fbed406d120 0x7fbed406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.014+0000 7fbed37fe700 1 -- 172.21.15.81:0/826384062 >> v1:172.21.15.89:6789/0 conn(0x7fbed41578d0 legacy=0x7fbed415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.014+0000 7fbed37fe700 1 -- 172.21.15.81:0/826384062 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed40cfe90 con 0x7fbed4157ca0 2023-10-07T08:54:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.014+0000 7fbed9000700 1 --2- 172.21.15.81:0/826384062 >> v2:172.21.15.89:3300/0 conn(0x7fbed406d120 0x7fbed406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.014+0000 7fbed37fe700 1 --2- 172.21.15.81:0/826384062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed4157ca0 0x7fbed40cf4f0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fbed4068300 tx=0x7fbec8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fd7c2b3fd297c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.014+0000 7fbed2ffd700 1 -- 172.21.15.81:0/826384062 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec800b820 con 0x7fbed4157ca0 2023-10-07T08:54:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.014+0000 7fbed2ffd700 1 -- 172.21.15.81:0/826384062 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec800b980 con 0x7fbed4157ca0 2023-10-07T08:54:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.014+0000 7fbed2ffd700 1 -- 172.21.15.81:0/826384062 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec800bd20 con 0x7fbed4157ca0 2023-10-07T08:54:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.015+0000 7fbedaa63700 1 -- 172.21.15.81:0/826384062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed4157ca0 msgr2=0x7fbed40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.015+0000 7fbedaa63700 1 --2- 172.21.15.81:0/826384062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed4157ca0 0x7fbed40cf4f0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fbed4068300 tx=0x7fbec8009250 comp rx=0 tx=0).stop 2023-10-07T08:54:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.015+0000 7fbedaa63700 1 -- 172.21.15.81:0/826384062 shutdown_connections 2023-10-07T08:54:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.015+0000 7fbedaa63700 1 --2- 172.21.15.81:0/826384062 >> v2:172.21.15.89:3300/0 conn(0x7fbed406d120 0x7fbed406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.015+0000 7fbedaa63700 1 --2- 172.21.15.81:0/826384062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed4157ca0 0x7fbed40cf4f0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.015+0000 7fbedaa63700 1 -- 172.21.15.81:0/826384062 >> 172.21.15.81:0/826384062 conn(0x7fbed406bb90 msgr2=0x7fbed406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.015+0000 7fbedaa63700 1 -- 172.21.15.81:0/826384062 shutdown_connections 2023-10-07T08:54:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.015+0000 7fbedaa63700 1 -- 172.21.15.81:0/826384062 wait complete. 2023-10-07T08:54:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.016+0000 7fbedaa63700 1 Processor -- start 2023-10-07T08:54:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.016+0000 7fbedaa63700 1 -- start start 2023-10-07T08:54:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbedaa63700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed406d120 0x7fbed416a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbedaa63700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbed41578d0 0x7fbed416d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbedaa63700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed4157ca0 0x7fbed40b6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbedaa63700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed416aa20 con 0x7fbed406d120 2023-10-07T08:54:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbedaa63700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed4153320 con 0x7fbed4157ca0 2023-10-07T08:54:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbedaa63700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed40b3ba0 con 0x7fbed41578d0 2023-10-07T08:54:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbed3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed406d120 0x7fbed416a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbed3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed406d120 0x7fbed416a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35264/0 (socket says 172.21.15.81:35264) 2023-10-07T08:54:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbed3fff700 1 -- 172.21.15.81:0/3376084711 learned_addr learned my addr 172.21.15.81:0/3376084711 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbed37fe700 1 --2- 172.21.15.81:0/3376084711 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbed41578d0 0x7fbed416d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbed9000700 1 --2- 172.21.15.81:0/3376084711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed4157ca0 0x7fbed40b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbed3fff700 1 -- 172.21.15.81:0/3376084711 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbed41578d0 msgr2=0x7fbed416d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbed3fff700 1 --2- 172.21.15.81:0/3376084711 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbed41578d0 0x7fbed416d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbed3fff700 1 -- 172.21.15.81:0/3376084711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed4157ca0 msgr2=0x7fbed40b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbed3fff700 1 --2- 172.21.15.81:0/3376084711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed4157ca0 0x7fbed40b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbed3fff700 1 -- 172.21.15.81:0/3376084711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec80094f0 con 0x7fbed406d120 2023-10-07T08:54:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbed37fe700 1 --2- 172.21.15.81:0/3376084711 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbed41578d0 0x7fbed416d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbed3fff700 1 --2- 172.21.15.81:0/3376084711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed406d120 0x7fbed416a4e0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fbec400c600 tx=0x7fbec4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbebbfff700 1 -- 172.21.15.81:0/3376084711 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4011590 con 0x7fbed406d120 2023-10-07T08:54:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbebbfff700 1 -- 172.21.15.81:0/3376084711 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec40116f0 con 0x7fbed406d120 2023-10-07T08:54:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbedaa63700 1 -- 172.21.15.81:0/3376084711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed40b4720 con 0x7fbed406d120 2023-10-07T08:54:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbebbfff700 1 -- 172.21.15.81:0/3376084711 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4011ab0 con 0x7fbed406d120 2023-10-07T08:54:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.017+0000 7fbedaa63700 1 -- 172.21.15.81:0/3376084711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed40b3df0 con 0x7fbed406d120 2023-10-07T08:54:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.018+0000 7fbedaa63700 1 -- 172.21.15.81:0/3376084711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed4067ac0 con 0x7fbed406d120 2023-10-07T08:54:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.019+0000 7fbebbfff700 1 -- 172.21.15.81:0/3376084711 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbec401c460 con 0x7fbed406d120 2023-10-07T08:54:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.019+0000 7fbebbfff700 1 --2- 172.21.15.81:0/3376084711 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbec0066f30 0x7fbec00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.019+0000 7fbebbfff700 1 -- 172.21.15.81:0/3376084711 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbec4083f40 con 0x7fbed406d120 2023-10-07T08:54:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.019+0000 7fbed37fe700 1 --2- 172.21.15.81:0/3376084711 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbec0066f30 0x7fbec00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.020+0000 7fbed37fe700 1 --2- 172.21.15.81:0/3376084711 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbec0066f30 0x7fbec00693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fbed4068300 tx=0x7fbec8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.023+0000 7fbebbfff700 1 -- 172.21.15.81:0/3376084711 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbec40514b0 con 0x7fbed406d120 2023-10-07T08:54:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.205+0000 7fbedaa63700 1 -- 172.21.15.81:0/3376084711 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fbed40d0170 con 0x7fbec0066f30 2023-10-07T08:54:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.205+0000 7fbebbfff700 1 -- 172.21.15.81:0/3376084711 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbed40d0170 con 0x7fbec0066f30 2023-10-07T08:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.207+0000 7fbedaa63700 1 -- 172.21.15.81:0/3376084711 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbec0066f30 msgr2=0x7fbec00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.207+0000 7fbedaa63700 1 --2- 172.21.15.81:0/3376084711 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbec0066f30 0x7fbec00693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fbed4068300 tx=0x7fbec8016000 comp rx=0 tx=0).stop 2023-10-07T08:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.207+0000 7fbedaa63700 1 -- 172.21.15.81:0/3376084711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed406d120 msgr2=0x7fbed416a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.207+0000 7fbedaa63700 1 --2- 172.21.15.81:0/3376084711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed406d120 0x7fbed416a4e0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fbec400c600 tx=0x7fbec4007f60 comp rx=0 tx=0).stop 2023-10-07T08:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.207+0000 7fbedaa63700 1 -- 172.21.15.81:0/3376084711 shutdown_connections 2023-10-07T08:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.207+0000 7fbedaa63700 1 --2- 172.21.15.81:0/3376084711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed4157ca0 0x7fbed40b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.207+0000 7fbedaa63700 1 --2- 172.21.15.81:0/3376084711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed406d120 0x7fbed416a4e0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.207+0000 7fbedaa63700 1 --2- 172.21.15.81:0/3376084711 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fbec0066f30 0x7fbec00693e0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.207+0000 7fbedaa63700 1 --2- 172.21.15.81:0/3376084711 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbed41578d0 0x7fbed416d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.207+0000 7fbedaa63700 1 -- 172.21.15.81:0/3376084711 >> 172.21.15.81:0/3376084711 conn(0x7fbed406bb90 msgr2=0x7fbed415e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.207+0000 7fbedaa63700 1 -- 172.21.15.81:0/3376084711 shutdown_connections 2023-10-07T08:54:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.207+0000 7fbedaa63700 1 -- 172.21.15.81:0/3376084711 wait complete. 2023-10-07T08:54:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 4 to deep-scrub 2023-10-07T08:54:32.220 INFO:tasks.ceph:Scrubbing osd.5 2023-10-07T08:54:32.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-07T08:54:32.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.337+0000 7f19214bc700 1 Processor -- start 2023-10-07T08:54:32.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.337+0000 7f19214bc700 1 -- start start 2023-10-07T08:54:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.338+0000 7f19214bc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f191c1578d0 0x7f191c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.338+0000 7f19214bc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f191c157ca0 0x7f191c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.338+0000 7f19214bc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191c0d07c0 con 0x7f191c06d120 2023-10-07T08:54:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.338+0000 7f19214bc700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f191c0cfbb0 con 0x7f191c1578d0 2023-10-07T08:54:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.338+0000 7f19214bc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191c0cfe90 con 0x7f191c157ca0 2023-10-07T08:54:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.338+0000 7f191affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f191c1578d0 0x7f191c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.338+0000 7f191b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f191c06d120 0x7f191c15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59288/0 (socket says 172.21.15.81:59288) 2023-10-07T08:54:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.338+0000 7f191b7fe700 1 -- 172.21.15.81:0/3874274018 learned_addr learned my addr 172.21.15.81:0/3874274018 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.338+0000 7f191affd700 1 -- 172.21.15.81:0/3874274018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f191c157ca0 msgr2=0x7f191c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.338+0000 7f19127fc700 1 --2- 172.21.15.81:0/3874274018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f191c157ca0 0x7f191c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.338+0000 7f191affd700 1 --2- 172.21.15.81:0/3874274018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f191c157ca0 0x7f191c15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.338+0000 7f191a7fc700 1 -- 172.21.15.81:0/3874274018 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553533956 0 0) 0x7f191c0d07c0 con 0x7f191c06d120 2023-10-07T08:54:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.338+0000 7f191affd700 1 -- 172.21.15.81:0/3874274018 >> v1:172.21.15.81:6789/0 conn(0x7f191c06d120 legacy=0x7f191c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.338+0000 7f191affd700 1 -- 172.21.15.81:0/3874274018 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c0d0170 con 0x7f191c1578d0 2023-10-07T08:54:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.339+0000 7f191affd700 1 --2- 172.21.15.81:0/3874274018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c1578d0 0x7f191c0cf4f0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f190c0098e0 tx=0x7f190c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb6da5e3e9c9ba5 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.339+0000 7f191a7fc700 1 -- 172.21.15.81:0/3874274018 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c009e80 con 0x7f191c1578d0 2023-10-07T08:54:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.339+0000 7f191a7fc700 1 -- 172.21.15.81:0/3874274018 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c00b860 con 0x7f191c1578d0 2023-10-07T08:54:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.339+0000 7f191a7fc700 1 -- 172.21.15.81:0/3874274018 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c00bbe0 con 0x7f191c1578d0 2023-10-07T08:54:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.339+0000 7f19214bc700 1 -- 172.21.15.81:0/3874274018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c1578d0 msgr2=0x7f191c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.339+0000 7f19214bc700 1 --2- 172.21.15.81:0/3874274018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c1578d0 0x7f191c0cf4f0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f190c0098e0 tx=0x7f190c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.339+0000 7f19214bc700 1 -- 172.21.15.81:0/3874274018 shutdown_connections 2023-10-07T08:54:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.339+0000 7f19214bc700 1 --2- 172.21.15.81:0/3874274018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c1578d0 0x7f191c0cf4f0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.339+0000 7f19214bc700 1 --2- 172.21.15.81:0/3874274018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f191c157ca0 0x7f191c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.339+0000 7f19214bc700 1 -- 172.21.15.81:0/3874274018 >> 172.21.15.81:0/3874274018 conn(0x7f191c06bb90 msgr2=0x7f191c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.339+0000 7f19214bc700 1 -- 172.21.15.81:0/3874274018 shutdown_connections 2023-10-07T08:54:32.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.339+0000 7f19214bc700 1 -- 172.21.15.81:0/3874274018 wait complete. 2023-10-07T08:54:32.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.340+0000 7f19214bc700 1 Processor -- start 2023-10-07T08:54:32.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.341+0000 7f19214bc700 1 -- start start 2023-10-07T08:54:32.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.341+0000 7f19214bc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f191c06d120 0x7f191c143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.341+0000 7f19214bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c1578d0 0x7f191c0c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.341+0000 7f19214bc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f191c157ca0 0x7f191c0c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.341+0000 7f19214bc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c15c770 con 0x7f191c1578d0 2023-10-07T08:54:32.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.341+0000 7f19214bc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c143680 con 0x7f191c157ca0 2023-10-07T08:54:32.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.341+0000 7f19214bc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191c15b9b0 con 0x7f191c06d120 2023-10-07T08:54:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.341+0000 7f19127fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c1578d0 0x7f191c0c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.341+0000 7f19127fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c1578d0 0x7f191c0c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54188/0 (socket says 172.21.15.81:54188) 2023-10-07T08:54:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.341+0000 7f19127fc700 1 -- 172.21.15.81:0/3383300575 learned_addr learned my addr 172.21.15.81:0/3383300575 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.342+0000 7f191b7fe700 1 --2- 172.21.15.81:0/3383300575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f191c157ca0 0x7f191c0c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.342+0000 7f191affd700 1 --2- 172.21.15.81:0/3383300575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f191c06d120 0x7f191c143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.342+0000 7f19127fc700 1 -- 172.21.15.81:0/3383300575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f191c06d120 msgr2=0x7f191c143140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.342+0000 7f19127fc700 1 --2- 172.21.15.81:0/3383300575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f191c06d120 0x7f191c143140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.342+0000 7f19127fc700 1 -- 172.21.15.81:0/3383300575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f191c157ca0 msgr2=0x7f191c0c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.342+0000 7f19127fc700 1 --2- 172.21.15.81:0/3383300575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f191c157ca0 0x7f191c0c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.342+0000 7f19127fc700 1 -- 172.21.15.81:0/3383300575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190c009420 con 0x7f191c1578d0 2023-10-07T08:54:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.342+0000 7f19127fc700 1 --2- 172.21.15.81:0/3383300575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c1578d0 0x7f191c0c8180 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f190400c880 tx=0x7f1904008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.342+0000 7f19137fe700 1 -- 172.21.15.81:0/3383300575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1904011600 con 0x7f191c1578d0 2023-10-07T08:54:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.342+0000 7f19137fe700 1 -- 172.21.15.81:0/3383300575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1904011760 con 0x7f191c1578d0 2023-10-07T08:54:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.342+0000 7f19214bc700 1 -- 172.21.15.81:0/3383300575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191c15bc90 con 0x7f191c1578d0 2023-10-07T08:54:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.342+0000 7f19137fe700 1 -- 172.21.15.81:0/3383300575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1904011b00 con 0x7f191c1578d0 2023-10-07T08:54:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.342+0000 7f19214bc700 1 -- 172.21.15.81:0/3383300575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191c15c250 con 0x7f191c1578d0 2023-10-07T08:54:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.343+0000 7f19214bc700 1 -- 172.21.15.81:0/3383300575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f191c067ac0 con 0x7f191c1578d0 2023-10-07T08:54:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.343+0000 7f19137fe700 1 -- 172.21.15.81:0/3383300575 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19040233e0 con 0x7f191c1578d0 2023-10-07T08:54:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.344+0000 7f19137fe700 1 --2- 172.21.15.81:0/3383300575 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f18fc066f30 0x7f18fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.344+0000 7f19137fe700 1 -- 172.21.15.81:0/3383300575 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1904084640 con 0x7f191c1578d0 2023-10-07T08:54:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.344+0000 7f191affd700 1 --2- 172.21.15.81:0/3383300575 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f18fc066f30 0x7f18fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.344+0000 7f19137fe700 1 --2- 172.21.15.81:0/3383300575 >> [v2:172.21.15.89:6816/86566,v1:172.21.15.89:6817/86566] conn(0x7f18fc06cd80 0x7f18fc06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.344+0000 7f19137fe700 1 -- 172.21.15.81:0/3383300575 --> [v2:172.21.15.89:6816/86566,v1:172.21.15.89:6817/86566] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18fc06f860 con 0x7f18fc06cd80 2023-10-07T08:54:32.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.344+0000 7f19137fe700 1 -- 172.21.15.81:0/3383300575 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1904084a10 con 0x7f191c1578d0 2023-10-07T08:54:32.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.344+0000 7f191affd700 1 --2- 172.21.15.81:0/3383300575 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f18fc066f30 0x7f18fc0693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f190c0091e0 tx=0x7f190c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.344+0000 7f191b7fe700 1 --2- 172.21.15.81:0/3383300575 >> [v2:172.21.15.89:6816/86566,v1:172.21.15.89:6817/86566] conn(0x7f18fc06cd80 0x7f18fc06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.345+0000 7f191b7fe700 1 --2- 172.21.15.81:0/3383300575 >> [v2:172.21.15.89:6816/86566,v1:172.21.15.89:6817/86566] conn(0x7f18fc06cd80 0x7f18fc06f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.345+0000 7f19137fe700 1 -- 172.21.15.81:0/3383300575 <== osd.5 v2:172.21.15.89:6816/86566 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f18fc06f860 con 0x7f18fc06cd80 2023-10-07T08:54:32.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.358+0000 7f19214bc700 1 -- 172.21.15.81:0/3383300575 --> [v2:172.21.15.89:6816/86566,v1:172.21.15.89:6817/86566] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f191c0d0450 con 0x7f18fc06cd80 2023-10-07T08:54:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.358+0000 7f19137fe700 1 -- 172.21.15.81:0/3383300575 <== osd.5 v2:172.21.15.89:6816/86566 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f191c0d0450 con 0x7f18fc06cd80 2023-10-07T08:54:32.360 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:54:32.360 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-07T08:54:32.360 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:54:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.359+0000 7f19214bc700 1 -- 172.21.15.81:0/3383300575 >> [v2:172.21.15.89:6816/86566,v1:172.21.15.89:6817/86566] conn(0x7f18fc06cd80 msgr2=0x7f18fc06f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.359+0000 7f19214bc700 1 --2- 172.21.15.81:0/3383300575 >> [v2:172.21.15.89:6816/86566,v1:172.21.15.89:6817/86566] conn(0x7f18fc06cd80 0x7f18fc06f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.359+0000 7f19214bc700 1 -- 172.21.15.81:0/3383300575 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f18fc066f30 msgr2=0x7f18fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.359+0000 7f19214bc700 1 --2- 172.21.15.81:0/3383300575 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f18fc066f30 0x7f18fc0693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f190c0091e0 tx=0x7f190c017000 comp rx=0 tx=0).stop 2023-10-07T08:54:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.359+0000 7f19214bc700 1 -- 172.21.15.81:0/3383300575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c1578d0 msgr2=0x7f191c0c8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.359+0000 7f19214bc700 1 --2- 172.21.15.81:0/3383300575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c1578d0 0x7f191c0c8180 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f190400c880 tx=0x7f1904008040 comp rx=0 tx=0).stop 2023-10-07T08:54:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.359+0000 7f191b7fe700 1 -- 172.21.15.81:0/3383300575 reap_dead start 2023-10-07T08:54:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.359+0000 7f19214bc700 1 -- 172.21.15.81:0/3383300575 shutdown_connections 2023-10-07T08:54:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.359+0000 7f19214bc700 1 -- 172.21.15.81:0/3383300575 >> 172.21.15.81:0/3383300575 conn(0x7f191c06bb90 msgr2=0x7f191c068910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.359+0000 7f19214bc700 1 -- 172.21.15.81:0/3383300575 shutdown_connections 2023-10-07T08:54:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.359+0000 7f19214bc700 1 -- 172.21.15.81:0/3383300575 wait complete. 2023-10-07T08:54:32.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-07T08:54:32.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.486+0000 7f2873998700 1 Processor -- start 2023-10-07T08:54:32.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.487+0000 7f2873998700 1 -- start start 2023-10-07T08:54:32.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.487+0000 7f2873998700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f286c1578d0 0x7f286c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.487+0000 7f2873998700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f286c157ca0 0x7f286c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.487+0000 7f2873998700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f286c06d120 0x7f286c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.487+0000 7f2873998700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286c06dac0 con 0x7f286c1578d0 2023-10-07T08:54:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.487+0000 7f2873998700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286c0d07c0 con 0x7f286c06d120 2023-10-07T08:54:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.487+0000 7f2873998700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0cfbb0 con 0x7f286c157ca0 2023-10-07T08:54:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.488+0000 7f2871734700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f286c1578d0 0x7f286c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.488+0000 7f2871734700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f286c1578d0 0x7f286c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54194/0 (socket says 172.21.15.81:54194) 2023-10-07T08:54:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.488+0000 7f2871734700 1 -- 172.21.15.81:0/290062928 learned_addr learned my addr 172.21.15.81:0/290062928 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.488+0000 7f2870f33700 1 --2- 172.21.15.81:0/290062928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f286c157ca0 0x7f286c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.488+0000 7f2871f35700 1 --2- 172.21.15.81:0/290062928 >> v2:172.21.15.89:3300/0 conn(0x7f286c06d120 0x7f286c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.488+0000 7f2871734700 1 -- 172.21.15.81:0/290062928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f286c157ca0 msgr2=0x7f286c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:32.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.488+0000 7f2871734700 1 --2- 172.21.15.81:0/290062928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f286c157ca0 0x7f286c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.488+0000 7f2871734700 1 -- 172.21.15.81:0/290062928 >> v2:172.21.15.89:3300/0 conn(0x7f286c06d120 msgr2=0x7f286c06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:32.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.488+0000 7f2871734700 1 --2- 172.21.15.81:0/290062928 >> v2:172.21.15.89:3300/0 conn(0x7f286c06d120 0x7f286c06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.488+0000 7f2871734700 1 -- 172.21.15.81:0/290062928 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c0cfe90 con 0x7f286c1578d0 2023-10-07T08:54:32.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.488+0000 7f2871f35700 1 --2- 172.21.15.81:0/290062928 >> v2:172.21.15.89:3300/0 conn(0x7f286c06d120 0x7f286c06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:32.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.488+0000 7f2870f33700 1 --2- 172.21.15.81:0/290062928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f286c157ca0 0x7f286c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:32.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.488+0000 7f2871734700 1 --2- 172.21.15.81:0/290062928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c1578d0 0x7f286c0cf4f0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f286c0b3940 tx=0x7f2868009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244c406602ff7804 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.488+0000 7f2863fff700 1 -- 172.21.15.81:0/290062928 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286800b860 con 0x7f286c1578d0 2023-10-07T08:54:32.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.488+0000 7f2863fff700 1 -- 172.21.15.81:0/290062928 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286800b9c0 con 0x7f286c1578d0 2023-10-07T08:54:32.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.488+0000 7f2863fff700 1 -- 172.21.15.81:0/290062928 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286800bd60 con 0x7f286c1578d0 2023-10-07T08:54:32.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.489+0000 7f2873998700 1 -- 172.21.15.81:0/290062928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c1578d0 msgr2=0x7f286c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.489+0000 7f2873998700 1 --2- 172.21.15.81:0/290062928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c1578d0 0x7f286c0cf4f0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f286c0b3940 tx=0x7f2868009250 comp rx=0 tx=0).stop 2023-10-07T08:54:32.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.489+0000 7f2873998700 1 -- 172.21.15.81:0/290062928 shutdown_connections 2023-10-07T08:54:32.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.489+0000 7f2873998700 1 --2- 172.21.15.81:0/290062928 >> v2:172.21.15.89:3300/0 conn(0x7f286c06d120 0x7f286c06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.489+0000 7f2873998700 1 --2- 172.21.15.81:0/290062928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c1578d0 0x7f286c0cf4f0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.489+0000 7f2873998700 1 --2- 172.21.15.81:0/290062928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f286c157ca0 0x7f286c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.489+0000 7f2873998700 1 -- 172.21.15.81:0/290062928 >> 172.21.15.81:0/290062928 conn(0x7f286c06bb90 msgr2=0x7f286c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:32.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.489+0000 7f2873998700 1 -- 172.21.15.81:0/290062928 shutdown_connections 2023-10-07T08:54:32.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.489+0000 7f2873998700 1 -- 172.21.15.81:0/290062928 wait complete. 2023-10-07T08:54:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.490+0000 7f2873998700 1 Processor -- start 2023-10-07T08:54:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.490+0000 7f2873998700 1 -- start start 2023-10-07T08:54:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2873998700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f286c06d120 0x7f286c154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2873998700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f286c1578d0 0x7f286c0c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2873998700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c157ca0 0x7f286c069b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2873998700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0c9280 con 0x7f286c157ca0 2023-10-07T08:54:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2873998700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0cac70 con 0x7f286c1578d0 2023-10-07T08:54:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2873998700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0caf50 con 0x7f286c06d120 2023-10-07T08:54:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2871f35700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c157ca0 0x7f286c069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2871f35700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c157ca0 0x7f286c069b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54204/0 (socket says 172.21.15.81:54204) 2023-10-07T08:54:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2871f35700 1 -- 172.21.15.81:0/3499628536 learned_addr learned my addr 172.21.15.81:0/3499628536 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2870f33700 1 --2- 172.21.15.81:0/3499628536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f286c1578d0 0x7f286c0c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2871734700 1 --2- 172.21.15.81:0/3499628536 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f286c06d120 0x7f286c154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2871f35700 1 -- 172.21.15.81:0/3499628536 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f286c06d120 msgr2=0x7f286c154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2871f35700 1 --2- 172.21.15.81:0/3499628536 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f286c06d120 0x7f286c154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2871f35700 1 -- 172.21.15.81:0/3499628536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f286c1578d0 msgr2=0x7f286c0c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2871f35700 1 --2- 172.21.15.81:0/3499628536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f286c1578d0 0x7f286c0c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2871f35700 1 -- 172.21.15.81:0/3499628536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28680094f0 con 0x7f286c157ca0 2023-10-07T08:54:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2871f35700 1 --2- 172.21.15.81:0/3499628536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c157ca0 0x7f286c069b30 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f286400d180 tx=0x7f2864009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f28617fa700 1 -- 172.21.15.81:0/3499628536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286400dcc0 con 0x7f286c157ca0 2023-10-07T08:54:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f28617fa700 1 -- 172.21.15.81:0/3499628536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286400f040 con 0x7f286c157ca0 2023-10-07T08:54:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2873998700 1 -- 172.21.15.81:0/3499628536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286c0cb230 con 0x7f286c157ca0 2023-10-07T08:54:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f28617fa700 1 -- 172.21.15.81:0/3499628536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2864015690 con 0x7f286c157ca0 2023-10-07T08:54:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.491+0000 7f2873998700 1 -- 172.21.15.81:0/3499628536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286c0cd440 con 0x7f286c157ca0 2023-10-07T08:54:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.492+0000 7f2873998700 1 -- 172.21.15.81:0/3499628536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f286c0cb450 con 0x7f286c157ca0 2023-10-07T08:54:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.493+0000 7f28617fa700 1 -- 172.21.15.81:0/3499628536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f286401e3b0 con 0x7f286c157ca0 2023-10-07T08:54:32.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.493+0000 7f28617fa700 1 --2- 172.21.15.81:0/3499628536 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2850066f30 0x7f28500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.493+0000 7f28617fa700 1 -- 172.21.15.81:0/3499628536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f28640846d0 con 0x7f286c157ca0 2023-10-07T08:54:32.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.493+0000 7f2871734700 1 --2- 172.21.15.81:0/3499628536 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2850066f30 0x7f28500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.494+0000 7f2871734700 1 --2- 172.21.15.81:0/3499628536 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2850066f30 0x7f28500693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f286c0b3940 tx=0x7f2868017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.497+0000 7f28617fa700 1 -- 172.21.15.81:0/3499628536 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2864051c40 con 0x7f286c157ca0 2023-10-07T08:54:32.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.680+0000 7f2873998700 1 -- 172.21.15.81:0/3499628536 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f286c0c93c0 con 0x7f2850066f30 2023-10-07T08:54:32.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.680+0000 7f28617fa700 1 -- 172.21.15.81:0/3499628536 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f286c0c93c0 con 0x7f2850066f30 2023-10-07T08:54:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.682+0000 7f2873998700 1 -- 172.21.15.81:0/3499628536 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2850066f30 msgr2=0x7f28500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.682+0000 7f2873998700 1 --2- 172.21.15.81:0/3499628536 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2850066f30 0x7f28500693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f286c0b3940 tx=0x7f2868017000 comp rx=0 tx=0).stop 2023-10-07T08:54:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.682+0000 7f2873998700 1 -- 172.21.15.81:0/3499628536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c157ca0 msgr2=0x7f286c069b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.682+0000 7f2873998700 1 --2- 172.21.15.81:0/3499628536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c157ca0 0x7f286c069b30 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f286400d180 tx=0x7f2864009a50 comp rx=0 tx=0).stop 2023-10-07T08:54:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.682+0000 7f2873998700 1 -- 172.21.15.81:0/3499628536 shutdown_connections 2023-10-07T08:54:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.682+0000 7f2873998700 1 --2- 172.21.15.81:0/3499628536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c157ca0 0x7f286c069b30 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.682+0000 7f2873998700 1 --2- 172.21.15.81:0/3499628536 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f2850066f30 0x7f28500693e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.682+0000 7f2873998700 1 --2- 172.21.15.81:0/3499628536 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f286c06d120 0x7f286c154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.682+0000 7f2873998700 1 --2- 172.21.15.81:0/3499628536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f286c1578d0 0x7f286c0c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.682+0000 7f2873998700 1 -- 172.21.15.81:0/3499628536 >> 172.21.15.81:0/3499628536 conn(0x7f286c06bb90 msgr2=0x7f286c155ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.682+0000 7f2873998700 1 -- 172.21.15.81:0/3499628536 shutdown_connections 2023-10-07T08:54:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.682+0000 7f2873998700 1 -- 172.21.15.81:0/3499628536 wait complete. 2023-10-07T08:54:32.685 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 5 to deep-scrub 2023-10-07T08:54:32.695 INFO:tasks.ceph:Scrubbing osd.6 2023-10-07T08:54:32.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-07T08:54:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.811+0000 7f664249b700 1 Processor -- start 2023-10-07T08:54:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.811+0000 7f664249b700 1 -- start start 2023-10-07T08:54:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.812+0000 7f664249b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f663c15a2a0 0x7f663c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.812+0000 7f664249b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f663c0ceb30 0x7f663c0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.812+0000 7f664249b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c0b0ca0 con 0x7f663c06d650 2023-10-07T08:54:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.812+0000 7f664249b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c06ea90 con 0x7f663c15a2a0 2023-10-07T08:54:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.812+0000 7f664249b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0cf4c0 con 0x7f663c0ceb30 2023-10-07T08:54:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.812+0000 7f663bfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f663c15a2a0 0x7f663c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.812+0000 7f663b7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f663c0ceb30 0x7f663c0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.812+0000 7f6640a38700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f663c06d650 0x7f663c06da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.81:36892/0 (socket says 172.21.15.81:36892) 2023-10-07T08:54:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.812+0000 7f663b7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f663c0ceb30 0x7f663c0cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:44884/0 (socket says 172.21.15.81:44884) 2023-10-07T08:54:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.812+0000 7f663bfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f663c15a2a0 0x7f663c0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:45804/0 (socket says 172.21.15.81:45804) 2023-10-07T08:54:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.812+0000 7f663b7fe700 1 -- 172.21.15.81:0/3735583563 learned_addr learned my addr 172.21.15.81:0/3735583563 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.813+0000 7f663b7fe700 1 -- 172.21.15.81:0/3735583563 >> v2:172.21.15.89:3300/0 conn(0x7f663c15a2a0 msgr2=0x7f663c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.813+0000 7f663b7fe700 1 --2- 172.21.15.81:0/3735583563 >> v2:172.21.15.89:3300/0 conn(0x7f663c15a2a0 0x7f663c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.813+0000 7f663b7fe700 1 -- 172.21.15.81:0/3735583563 >> v1:172.21.15.89:6789/0 conn(0x7f663c06d650 legacy=0x7f663c06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.813+0000 7f663b7fe700 1 -- 172.21.15.81:0/3735583563 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c0b00d0 con 0x7f663c0ceb30 2023-10-07T08:54:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.813+0000 7f663b7fe700 1 --2- 172.21.15.81:0/3735583563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f663c0ceb30 0x7f663c0cef80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f66300099b0 tx=0x7f6630009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6acb2018502544b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.813+0000 7f663affd700 1 -- 172.21.15.81:0/3735583563 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6630009ea0 con 0x7f663c0ceb30 2023-10-07T08:54:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.813+0000 7f663affd700 1 -- 172.21.15.81:0/3735583563 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663000b860 con 0x7f663c0ceb30 2023-10-07T08:54:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.813+0000 7f663affd700 1 -- 172.21.15.81:0/3735583563 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663000bc00 con 0x7f663c0ceb30 2023-10-07T08:54:32.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.814+0000 7f664249b700 1 -- 172.21.15.81:0/3735583563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f663c0ceb30 msgr2=0x7f663c0cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.814+0000 7f664249b700 1 --2- 172.21.15.81:0/3735583563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f663c0ceb30 0x7f663c0cef80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f66300099b0 tx=0x7f6630009250 comp rx=0 tx=0).stop 2023-10-07T08:54:32.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.814+0000 7f664249b700 1 -- 172.21.15.81:0/3735583563 shutdown_connections 2023-10-07T08:54:32.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.814+0000 7f664249b700 1 --2- 172.21.15.81:0/3735583563 >> v2:172.21.15.89:3300/0 conn(0x7f663c15a2a0 0x7f663c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.814+0000 7f664249b700 1 --2- 172.21.15.81:0/3735583563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f663c0ceb30 0x7f663c0cef80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.814+0000 7f664249b700 1 -- 172.21.15.81:0/3735583563 >> 172.21.15.81:0/3735583563 conn(0x7f663c067640 msgr2=0x7f663c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:32.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.814+0000 7f664249b700 1 -- 172.21.15.81:0/3735583563 shutdown_connections 2023-10-07T08:54:32.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.814+0000 7f664249b700 1 -- 172.21.15.81:0/3735583563 wait complete. 2023-10-07T08:54:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.815+0000 7f664249b700 1 Processor -- start 2023-10-07T08:54:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.815+0000 7f664249b700 1 -- start start 2023-10-07T08:54:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f664249b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f663c06d650 0x7f663c154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f664249b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f663c0ceb30 0x7f663c0b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f664249b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f663c15a2a0 0x7f663c0b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f664249b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c15d6c0 con 0x7f663c0ceb30 2023-10-07T08:54:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f664249b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0b3a00 con 0x7f663c15a2a0 2023-10-07T08:54:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f664249b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0b3ce0 con 0x7f663c06d650 2023-10-07T08:54:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f663b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f663c0ceb30 0x7f663c0b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f663b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f663c0ceb30 0x7f663c0b2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54214/0 (socket says 172.21.15.81:54214) 2023-10-07T08:54:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f663b7fe700 1 -- 172.21.15.81:0/1374005860 learned_addr learned my addr 172.21.15.81:0/1374005860 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f663bfff700 1 --2- 172.21.15.81:0/1374005860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f663c06d650 0x7f663c154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f6640a38700 1 --2- 172.21.15.81:0/1374005860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f663c15a2a0 0x7f663c0b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f663b7fe700 1 -- 172.21.15.81:0/1374005860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f663c06d650 msgr2=0x7f663c154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f663b7fe700 1 --2- 172.21.15.81:0/1374005860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f663c06d650 0x7f663c154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f663b7fe700 1 -- 172.21.15.81:0/1374005860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f663c15a2a0 msgr2=0x7f663c0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f663b7fe700 1 --2- 172.21.15.81:0/1374005860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f663c15a2a0 0x7f663c0b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f663b7fe700 1 -- 172.21.15.81:0/1374005860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66300094f0 con 0x7f663c0ceb30 2023-10-07T08:54:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f663b7fe700 1 --2- 172.21.15.81:0/1374005860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f663c0ceb30 0x7f663c0b2e90 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f663c06ebd0 tx=0x7f6630017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f6623fff700 1 -- 172.21.15.81:0/1374005860 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6630000d10 con 0x7f663c0ceb30 2023-10-07T08:54:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f6623fff700 1 -- 172.21.15.81:0/1374005860 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663000bbe0 con 0x7f663c0ceb30 2023-10-07T08:54:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f664249b700 1 -- 172.21.15.81:0/1374005860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c0b3fc0 con 0x7f663c0ceb30 2023-10-07T08:54:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f6623fff700 1 -- 172.21.15.81:0/1374005860 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6630011670 con 0x7f663c0ceb30 2023-10-07T08:54:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.816+0000 7f664249b700 1 -- 172.21.15.81:0/1374005860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c0b4580 con 0x7f663c0ceb30 2023-10-07T08:54:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.817+0000 7f664249b700 1 -- 172.21.15.81:0/1374005860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f663c069e40 con 0x7f663c0ceb30 2023-10-07T08:54:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.818+0000 7f6623fff700 1 -- 172.21.15.81:0/1374005860 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6630011aa0 con 0x7f663c0ceb30 2023-10-07T08:54:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.818+0000 7f6623fff700 1 --2- 172.21.15.81:0/1374005860 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6628066f30 0x7f66280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.818+0000 7f6623fff700 1 -- 172.21.15.81:0/1374005860 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6630085a90 con 0x7f663c0ceb30 2023-10-07T08:54:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.818+0000 7f663bfff700 1 --2- 172.21.15.81:0/1374005860 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6628066f30 0x7f66280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.818+0000 7f6623fff700 1 --2- 172.21.15.81:0/1374005860 >> [v2:172.21.15.89:6822/86582,v1:172.21.15.89:6824/86582] conn(0x7f662806cc10 0x7f662806f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.818+0000 7f6623fff700 1 -- 172.21.15.81:0/1374005860 --> [v2:172.21.15.89:6822/86582,v1:172.21.15.89:6824/86582] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f662806f6f0 con 0x7f662806cc10 2023-10-07T08:54:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.818+0000 7f6623fff700 1 -- 172.21.15.81:0/1374005860 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f663008a240 con 0x7f663c0ceb30 2023-10-07T08:54:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.818+0000 7f663bfff700 1 --2- 172.21.15.81:0/1374005860 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6628066f30 0x7f66280693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f662c009d10 tx=0x7f662c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.818+0000 7f6640a38700 1 --2- 172.21.15.81:0/1374005860 >> [v2:172.21.15.89:6822/86582,v1:172.21.15.89:6824/86582] conn(0x7f662806cc10 0x7f662806f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.819+0000 7f6640a38700 1 --2- 172.21.15.81:0/1374005860 >> [v2:172.21.15.89:6822/86582,v1:172.21.15.89:6824/86582] conn(0x7f662806cc10 0x7f662806f020 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.819+0000 7f6623fff700 1 -- 172.21.15.81:0/1374005860 <== osd.6 v2:172.21.15.89:6822/86582 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f662806f6f0 con 0x7f662806cc10 2023-10-07T08:54:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.832+0000 7f664249b700 1 -- 172.21.15.81:0/1374005860 --> [v2:172.21.15.89:6822/86582,v1:172.21.15.89:6824/86582] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f663c04bb80 con 0x7f662806cc10 2023-10-07T08:54:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.832+0000 7f6623fff700 1 -- 172.21.15.81:0/1374005860 <== osd.6 v2:172.21.15.89:6822/86582 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f663c04bb80 con 0x7f662806cc10 2023-10-07T08:54:32.834 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:54:32.834 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-07T08:54:32.834 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:54:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.833+0000 7f664249b700 1 -- 172.21.15.81:0/1374005860 >> [v2:172.21.15.89:6822/86582,v1:172.21.15.89:6824/86582] conn(0x7f662806cc10 msgr2=0x7f662806f020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.833+0000 7f664249b700 1 --2- 172.21.15.81:0/1374005860 >> [v2:172.21.15.89:6822/86582,v1:172.21.15.89:6824/86582] conn(0x7f662806cc10 0x7f662806f020 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.833+0000 7f664249b700 1 -- 172.21.15.81:0/1374005860 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6628066f30 msgr2=0x7f66280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.833+0000 7f664249b700 1 --2- 172.21.15.81:0/1374005860 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f6628066f30 0x7f66280693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f662c009d10 tx=0x7f662c0091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.833+0000 7f664249b700 1 -- 172.21.15.81:0/1374005860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f663c0ceb30 msgr2=0x7f663c0b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.833+0000 7f664249b700 1 --2- 172.21.15.81:0/1374005860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f663c0ceb30 0x7f663c0b2e90 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f663c06ebd0 tx=0x7f6630017000 comp rx=0 tx=0).stop 2023-10-07T08:54:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.833+0000 7f6640a38700 1 -- 172.21.15.81:0/1374005860 reap_dead start 2023-10-07T08:54:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.833+0000 7f664249b700 1 -- 172.21.15.81:0/1374005860 shutdown_connections 2023-10-07T08:54:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.833+0000 7f664249b700 1 -- 172.21.15.81:0/1374005860 >> 172.21.15.81:0/1374005860 conn(0x7f663c067640 msgr2=0x7f663c0ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.833+0000 7f664249b700 1 -- 172.21.15.81:0/1374005860 shutdown_connections 2023-10-07T08:54:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.833+0000 7f664249b700 1 -- 172.21.15.81:0/1374005860 wait complete. 2023-10-07T08:54:32.846 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-07T08:54:32.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.960+0000 7efe116bd700 1 Processor -- start 2023-10-07T08:54:32.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.960+0000 7efe116bd700 1 -- start start 2023-10-07T08:54:32.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe116bd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efe0c157ca0 0x7efe0c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe116bd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efe0c06d120 0x7efe0c06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe116bd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0c0d07c0 con 0x7efe0c1578d0 2023-10-07T08:54:32.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe116bd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0c06da50 con 0x7efe0c06d120 2023-10-07T08:54:32.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe116bd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0c0cfbb0 con 0x7efe0c157ca0 2023-10-07T08:54:32.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe0b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efe0c06d120 0x7efe0c06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe0affd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efe0c1578d0 0x7efe0c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59300/0 (socket says 172.21.15.81:59300) 2023-10-07T08:54:32.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe0affd700 1 -- 172.21.15.81:0/2464006337 learned_addr learned my addr 172.21.15.81:0/2464006337 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:32.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe0b7fe700 1 -- 172.21.15.81:0/2464006337 >> v2:172.21.15.89:3300/0 conn(0x7efe0c157ca0 msgr2=0x7efe0c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:32.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe0a7fc700 1 --2- 172.21.15.81:0/2464006337 >> v2:172.21.15.89:3300/0 conn(0x7efe0c157ca0 0x7efe0c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe0b7fe700 1 --2- 172.21.15.81:0/2464006337 >> v2:172.21.15.89:3300/0 conn(0x7efe0c157ca0 0x7efe0c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe09ffb700 1 -- 172.21.15.81:0/2464006337 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435790310 0 0) 0x7efe0c0d07c0 con 0x7efe0c1578d0 2023-10-07T08:54:32.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe0b7fe700 1 -- 172.21.15.81:0/2464006337 >> v1:172.21.15.81:6789/0 conn(0x7efe0c1578d0 legacy=0x7efe0c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe0b7fe700 1 -- 172.21.15.81:0/2464006337 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c0cfe90 con 0x7efe0c06d120 2023-10-07T08:54:32.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe0a7fc700 1 --2- 172.21.15.81:0/2464006337 >> v2:172.21.15.89:3300/0 conn(0x7efe0c157ca0 0x7efe0c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:32.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe0b7fe700 1 --2- 172.21.15.81:0/2464006337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c06d120 0x7efe0c06d510 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7efe0c068510 tx=0x7efe040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7960330b51a14e server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe09ffb700 1 -- 172.21.15.81:0/2464006337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0400b6b0 con 0x7efe0c06d120 2023-10-07T08:54:32.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe09ffb700 1 -- 172.21.15.81:0/2464006337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0400b810 con 0x7efe0c06d120 2023-10-07T08:54:32.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.961+0000 7efe09ffb700 1 -- 172.21.15.81:0/2464006337 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0400bbb0 con 0x7efe0c06d120 2023-10-07T08:54:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.962+0000 7efe116bd700 1 -- 172.21.15.81:0/2464006337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c06d120 msgr2=0x7efe0c06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.962+0000 7efe116bd700 1 --2- 172.21.15.81:0/2464006337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c06d120 0x7efe0c06d510 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7efe0c068510 tx=0x7efe040091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.962+0000 7efe116bd700 1 -- 172.21.15.81:0/2464006337 shutdown_connections 2023-10-07T08:54:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.962+0000 7efe116bd700 1 --2- 172.21.15.81:0/2464006337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c06d120 0x7efe0c06d510 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.962+0000 7efe116bd700 1 --2- 172.21.15.81:0/2464006337 >> v2:172.21.15.89:3300/0 conn(0x7efe0c157ca0 0x7efe0c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.962+0000 7efe116bd700 1 -- 172.21.15.81:0/2464006337 >> 172.21.15.81:0/2464006337 conn(0x7efe0c06bb90 msgr2=0x7efe0c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.962+0000 7efe116bd700 1 -- 172.21.15.81:0/2464006337 shutdown_connections 2023-10-07T08:54:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.962+0000 7efe116bd700 1 -- 172.21.15.81:0/2464006337 wait complete. 2023-10-07T08:54:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.963+0000 7efe116bd700 1 Processor -- start 2023-10-07T08:54:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.963+0000 7efe116bd700 1 -- start start 2023-10-07T08:54:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe116bd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe0c06d120 0x7efe0c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe116bd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe0c1578d0 0x7efe0c158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe116bd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c157ca0 0x7efe0c14d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe116bd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0b57a0 con 0x7efe0c157ca0 2023-10-07T08:54:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe116bd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c158da0 con 0x7efe0c1578d0 2023-10-07T08:54:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe116bd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c159020 con 0x7efe0c06d120 2023-10-07T08:54:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe0b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c157ca0 0x7efe0c14d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe0b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c157ca0 0x7efe0c14d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54234/0 (socket says 172.21.15.81:54234) 2023-10-07T08:54:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe0b7fe700 1 -- 172.21.15.81:0/3395201963 learned_addr learned my addr 172.21.15.81:0/3395201963 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe0affd700 1 --2- 172.21.15.81:0/3395201963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe0c06d120 0x7efe0c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe0a7fc700 1 --2- 172.21.15.81:0/3395201963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe0c1578d0 0x7efe0c158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe0b7fe700 1 -- 172.21.15.81:0/3395201963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe0c06d120 msgr2=0x7efe0c15ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe0b7fe700 1 --2- 172.21.15.81:0/3395201963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe0c06d120 0x7efe0c15ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe0b7fe700 1 -- 172.21.15.81:0/3395201963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe0c1578d0 msgr2=0x7efe0c158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe0b7fe700 1 --2- 172.21.15.81:0/3395201963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe0c1578d0 0x7efe0c158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe0b7fe700 1 -- 172.21.15.81:0/3395201963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe04009420 con 0x7efe0c157ca0 2023-10-07T08:54:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe0affd700 1 --2- 172.21.15.81:0/3395201963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe0c06d120 0x7efe0c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:32.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe0a7fc700 1 --2- 172.21.15.81:0/3395201963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe0c1578d0 0x7efe0c158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:32.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.964+0000 7efe0b7fe700 1 --2- 172.21.15.81:0/3395201963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c157ca0 0x7efe0c14d8e0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7efe0400b0e0 tx=0x7efe04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.965+0000 7efe02ffd700 1 -- 172.21.15.81:0/3395201963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04025420 con 0x7efe0c157ca0 2023-10-07T08:54:32.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.965+0000 7efe02ffd700 1 -- 172.21.15.81:0/3395201963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe04025580 con 0x7efe0c157ca0 2023-10-07T08:54:32.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.965+0000 7efe116bd700 1 -- 172.21.15.81:0/3395201963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0c159300 con 0x7efe0c157ca0 2023-10-07T08:54:32.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.965+0000 7efe02ffd700 1 -- 172.21.15.81:0/3395201963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04025920 con 0x7efe0c157ca0 2023-10-07T08:54:32.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.965+0000 7efe116bd700 1 -- 172.21.15.81:0/3395201963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0c1598c0 con 0x7efe0c157ca0 2023-10-07T08:54:32.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.966+0000 7efe116bd700 1 -- 172.21.15.81:0/3395201963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0c0b5570 con 0x7efe0c157ca0 2023-10-07T08:54:32.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.966+0000 7efe02ffd700 1 -- 172.21.15.81:0/3395201963 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe04023070 con 0x7efe0c157ca0 2023-10-07T08:54:32.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.966+0000 7efe02ffd700 1 --2- 172.21.15.81:0/3395201963 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdec066f30 0x7efdec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:32.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.967+0000 7efe0affd700 1 --2- 172.21.15.81:0/3395201963 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdec066f30 0x7efdec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:32.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.967+0000 7efe02ffd700 1 -- 172.21.15.81:0/3395201963 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efe04085970 con 0x7efe0c157ca0 2023-10-07T08:54:32.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.967+0000 7efe0affd700 1 --2- 172.21.15.81:0/3395201963 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdec066f30 0x7efdec0693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00d270 tx=0x7efdfc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:32.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:32.971+0000 7efe02ffd700 1 -- 172.21.15.81:0/3395201963 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe0c0b5570 con 0x7efe0c157ca0 2023-10-07T08:54:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.151+0000 7efe116bd700 1 -- 172.21.15.81:0/3395201963 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7efe0c0b5570 con 0x7efdec066f30 2023-10-07T08:54:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.151+0000 7efe02ffd700 1 -- 172.21.15.81:0/3395201963 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efe0c0b5570 con 0x7efdec066f30 2023-10-07T08:54:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.153+0000 7efe116bd700 1 -- 172.21.15.81:0/3395201963 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdec066f30 msgr2=0x7efdec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.153+0000 7efe116bd700 1 --2- 172.21.15.81:0/3395201963 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdec066f30 0x7efdec0693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00d270 tx=0x7efdfc009040 comp rx=0 tx=0).stop 2023-10-07T08:54:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.153+0000 7efe116bd700 1 -- 172.21.15.81:0/3395201963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c157ca0 msgr2=0x7efe0c14d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.153+0000 7efe116bd700 1 --2- 172.21.15.81:0/3395201963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c157ca0 0x7efe0c14d8e0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7efe0400b0e0 tx=0x7efe04017000 comp rx=0 tx=0).stop 2023-10-07T08:54:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.153+0000 7efe116bd700 1 -- 172.21.15.81:0/3395201963 shutdown_connections 2023-10-07T08:54:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.153+0000 7efe116bd700 1 --2- 172.21.15.81:0/3395201963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe0c157ca0 0x7efe0c14d8e0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.153+0000 7efe116bd700 1 --2- 172.21.15.81:0/3395201963 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7efdec066f30 0x7efdec0693e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.153+0000 7efe116bd700 1 --2- 172.21.15.81:0/3395201963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe0c06d120 0x7efe0c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.153+0000 7efe116bd700 1 --2- 172.21.15.81:0/3395201963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe0c1578d0 0x7efe0c158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.153+0000 7efe116bd700 1 -- 172.21.15.81:0/3395201963 >> 172.21.15.81:0/3395201963 conn(0x7efe0c06bb90 msgr2=0x7efe0c156120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.153+0000 7efe116bd700 1 -- 172.21.15.81:0/3395201963 shutdown_connections 2023-10-07T08:54:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.154+0000 7efe116bd700 1 -- 172.21.15.81:0/3395201963 wait complete. 2023-10-07T08:54:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 6 to deep-scrub 2023-10-07T08:54:33.166 INFO:tasks.ceph:Scrubbing osd.7 2023-10-07T08:54:33.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-07T08:54:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.283+0000 7f90df59e700 1 Processor -- start 2023-10-07T08:54:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.283+0000 7f90df59e700 1 -- start start 2023-10-07T08:54:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.284+0000 7f90df59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90e00d0f50 0x7f90e006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.284+0000 7f90df59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e006d990 con 0x7f90e006d530 2023-10-07T08:54:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.284+0000 7f90df59e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e00cf2d0 con 0x7f90e00d0b80 2023-10-07T08:54:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.284+0000 7f90df59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e015a690 con 0x7f90e00d0f50 2023-10-07T08:54:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.284+0000 7f90ddd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90e00d0f50 0x7f90e006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.284+0000 7f90ded9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f90e006d530 0x7f90e015b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59306/0 (socket says 172.21.15.81:59306) 2023-10-07T08:54:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.284+0000 7f90ddd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90e00d0f50 0x7f90e006cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54250/0 (socket says 172.21.15.81:54250) 2023-10-07T08:54:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.284+0000 7f90ded9d700 1 -- 172.21.15.81:0/2186228690 learned_addr learned my addr 172.21.15.81:0/2186228690 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.284+0000 7f90ddd9b700 1 -- 172.21.15.81:0/2186228690 >> v1:172.21.15.89:6789/0 conn(0x7f90e00d0b80 legacy=0x7f90e00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.284+0000 7f90ddd9b700 1 -- 172.21.15.81:0/2186228690 >> v1:172.21.15.81:6789/0 conn(0x7f90e006d530 legacy=0x7f90e015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.284+0000 7f90ddd9b700 1 -- 172.21.15.81:0/2186228690 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e00d0480 con 0x7f90e00d0f50 2023-10-07T08:54:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.284+0000 7f90ddd9b700 1 --2- 172.21.15.81:0/2186228690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00d0f50 0x7f90e006cff0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f90c80098e0 tx=0x7f90c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc4e553504663a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.284+0000 7f90dd59a700 1 -- 172.21.15.81:0/2186228690 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8009e80 con 0x7f90e00d0f50 2023-10-07T08:54:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.284+0000 7f90dd59a700 1 -- 172.21.15.81:0/2186228690 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c800b860 con 0x7f90e00d0f50 2023-10-07T08:54:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.284+0000 7f90dd59a700 1 -- 172.21.15.81:0/2186228690 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c800bbe0 con 0x7f90e00d0f50 2023-10-07T08:54:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.285+0000 7f90df59e700 1 -- 172.21.15.81:0/2186228690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00d0f50 msgr2=0x7f90e006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.285+0000 7f90df59e700 1 --2- 172.21.15.81:0/2186228690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00d0f50 0x7f90e006cff0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f90c80098e0 tx=0x7f90c80091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.285+0000 7f90df59e700 1 -- 172.21.15.81:0/2186228690 shutdown_connections 2023-10-07T08:54:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.285+0000 7f90df59e700 1 --2- 172.21.15.81:0/2186228690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e00d0f50 0x7f90e006cff0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.285+0000 7f90df59e700 1 -- 172.21.15.81:0/2186228690 >> 172.21.15.81:0/2186228690 conn(0x7f90e0063230 msgr2=0x7f90e0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.285+0000 7f90df59e700 1 -- 172.21.15.81:0/2186228690 shutdown_connections 2023-10-07T08:54:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.285+0000 7f90df59e700 1 -- 172.21.15.81:0/2186228690 wait complete. 2023-10-07T08:54:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.286+0000 7f90df59e700 1 Processor -- start 2023-10-07T08:54:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.286+0000 7f90df59e700 1 -- start start 2023-10-07T08:54:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90df59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e006d530 0x7f90e00af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90df59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90e00d0b80 0x7f90e00b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90df59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90e00d0f50 0x7f90e00b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90df59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e00af600 con 0x7f90e006d530 2023-10-07T08:54:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90df59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e00af810 con 0x7f90e00d0f50 2023-10-07T08:54:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90df59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e00afaf0 con 0x7f90e00d0b80 2023-10-07T08:54:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90de59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e006d530 0x7f90e00af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90de59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e006d530 0x7f90e00af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54254/0 (socket says 172.21.15.81:54254) 2023-10-07T08:54:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90de59c700 1 -- 172.21.15.81:0/2284459574 learned_addr learned my addr 172.21.15.81:0/2284459574 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90ded9d700 1 --2- 172.21.15.81:0/2284459574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90e00d0f50 0x7f90e00b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90ddd9b700 1 --2- 172.21.15.81:0/2284459574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90e00d0b80 0x7f90e00b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90de59c700 1 -- 172.21.15.81:0/2284459574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90e00d0b80 msgr2=0x7f90e00b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90de59c700 1 --2- 172.21.15.81:0/2284459574 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90e00d0b80 0x7f90e00b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90de59c700 1 -- 172.21.15.81:0/2284459574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90e00d0f50 msgr2=0x7f90e00b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90de59c700 1 --2- 172.21.15.81:0/2284459574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90e00d0f50 0x7f90e00b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90de59c700 1 -- 172.21.15.81:0/2284459574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c8009420 con 0x7f90e006d530 2023-10-07T08:54:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90de59c700 1 --2- 172.21.15.81:0/2284459574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e006d530 0x7f90e00af0c0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f90d000cb40 tx=0x7f90d0001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90d67fc700 1 -- 172.21.15.81:0/2284459574 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d000a7e0 con 0x7f90e006d530 2023-10-07T08:54:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90d67fc700 1 -- 172.21.15.81:0/2284459574 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d000a940 con 0x7f90e006d530 2023-10-07T08:54:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90df59e700 1 -- 172.21.15.81:0/2284459574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e00afdd0 con 0x7f90e006d530 2023-10-07T08:54:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.287+0000 7f90d67fc700 1 -- 172.21.15.81:0/2284459574 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d000ad00 con 0x7f90e006d530 2023-10-07T08:54:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.288+0000 7f90df59e700 1 -- 172.21.15.81:0/2284459574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e00b0390 con 0x7f90e006d530 2023-10-07T08:54:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.288+0000 7f90df59e700 1 -- 172.21.15.81:0/2284459574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f90e00ce1b0 con 0x7f90e006d530 2023-10-07T08:54:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.289+0000 7f90d67fc700 1 -- 172.21.15.81:0/2284459574 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90d0003030 con 0x7f90e006d530 2023-10-07T08:54:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.289+0000 7f90d67fc700 1 --2- 172.21.15.81:0/2284459574 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f90c0066f30 0x7f90c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.289+0000 7f90d67fc700 1 -- 172.21.15.81:0/2284459574 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f90d0084aa0 con 0x7f90e006d530 2023-10-07T08:54:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.289+0000 7f90ddd9b700 1 --2- 172.21.15.81:0/2284459574 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f90c0066f30 0x7f90c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.289+0000 7f90d67fc700 1 --2- 172.21.15.81:0/2284459574 >> [v2:172.21.15.89:6808/86544,v1:172.21.15.89:6809/86544] conn(0x7f90c006cd80 0x7f90c006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.289+0000 7f90d67fc700 1 -- 172.21.15.81:0/2284459574 --> [v2:172.21.15.89:6808/86544,v1:172.21.15.89:6809/86544] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90c006f860 con 0x7f90c006cd80 2023-10-07T08:54:33.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.289+0000 7f90d67fc700 1 -- 172.21.15.81:0/2284459574 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90d0084e70 con 0x7f90e006d530 2023-10-07T08:54:33.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.290+0000 7f90ded9d700 1 --2- 172.21.15.81:0/2284459574 >> [v2:172.21.15.89:6808/86544,v1:172.21.15.89:6809/86544] conn(0x7f90c006cd80 0x7f90c006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:33.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.290+0000 7f90ddd9b700 1 --2- 172.21.15.81:0/2284459574 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f90c0066f30 0x7f90c00693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f90c80093f0 tx=0x7f90c8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:33.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.290+0000 7f90ded9d700 1 --2- 172.21.15.81:0/2284459574 >> [v2:172.21.15.89:6808/86544,v1:172.21.15.89:6809/86544] conn(0x7f90c006cd80 0x7f90c006f190 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:33.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.291+0000 7f90d67fc700 1 -- 172.21.15.81:0/2284459574 <== osd.7 v2:172.21.15.89:6808/86544 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f90c006f860 con 0x7f90c006cd80 2023-10-07T08:54:33.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.303+0000 7f90df59e700 1 -- 172.21.15.81:0/2284459574 --> [v2:172.21.15.89:6808/86544,v1:172.21.15.89:6809/86544] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f90e00676e0 con 0x7f90c006cd80 2023-10-07T08:54:33.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.304+0000 7f90d67fc700 1 -- 172.21.15.81:0/2284459574 <== osd.7 v2:172.21.15.89:6808/86544 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f90e00676e0 con 0x7f90c006cd80 2023-10-07T08:54:33.305 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-07T08:54:33.305 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-07T08:54:33.305 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-07T08:54:33.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.304+0000 7f90df59e700 1 -- 172.21.15.81:0/2284459574 >> [v2:172.21.15.89:6808/86544,v1:172.21.15.89:6809/86544] conn(0x7f90c006cd80 msgr2=0x7f90c006f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.304+0000 7f90df59e700 1 --2- 172.21.15.81:0/2284459574 >> [v2:172.21.15.89:6808/86544,v1:172.21.15.89:6809/86544] conn(0x7f90c006cd80 0x7f90c006f190 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.304+0000 7f90df59e700 1 -- 172.21.15.81:0/2284459574 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f90c0066f30 msgr2=0x7f90c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.304+0000 7f90df59e700 1 --2- 172.21.15.81:0/2284459574 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f90c0066f30 0x7f90c00693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f90c80093f0 tx=0x7f90c8017000 comp rx=0 tx=0).stop 2023-10-07T08:54:33.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.304+0000 7f90df59e700 1 -- 172.21.15.81:0/2284459574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e006d530 msgr2=0x7f90e00af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.304+0000 7f90df59e700 1 --2- 172.21.15.81:0/2284459574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e006d530 0x7f90e00af0c0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f90d000cb40 tx=0x7f90d0001770 comp rx=0 tx=0).stop 2023-10-07T08:54:33.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.304+0000 7f90ded9d700 1 -- 172.21.15.81:0/2284459574 reap_dead start 2023-10-07T08:54:33.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.304+0000 7f90df59e700 1 -- 172.21.15.81:0/2284459574 shutdown_connections 2023-10-07T08:54:33.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.304+0000 7f90df59e700 1 -- 172.21.15.81:0/2284459574 >> 172.21.15.81:0/2284459574 conn(0x7f90e0063230 msgr2=0x7f90e00b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:33.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.304+0000 7f90df59e700 1 -- 172.21.15.81:0/2284459574 shutdown_connections 2023-10-07T08:54:33.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.304+0000 7f90df59e700 1 -- 172.21.15.81:0/2284459574 wait complete. 2023-10-07T08:54:33.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-07T08:54:33.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.432+0000 7f48d56b4700 1 Processor -- start 2023-10-07T08:54:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.432+0000 7f48d56b4700 1 -- start start 2023-10-07T08:54:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.433+0000 7f48d56b4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f48d01578d0 0x7f48d00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.433+0000 7f48d56b4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d006d120 0x7f48d006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.433+0000 7f48d56b4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d00d07c0 con 0x7f48d0157ca0 2023-10-07T08:54:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.433+0000 7f48d56b4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d006daa0 con 0x7f48d01578d0 2023-10-07T08:54:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.433+0000 7f48d56b4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d00cfbb0 con 0x7f48d006d120 2023-10-07T08:54:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.433+0000 7f48ceffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f48d01578d0 0x7f48d00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.433+0000 7f48ceffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f48d01578d0 0x7f48d00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54258/0 (socket says 172.21.15.81:54258) 2023-10-07T08:54:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.433+0000 7f48ceffd700 1 -- 172.21.15.81:0/781527569 learned_addr learned my addr 172.21.15.81:0/781527569 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.434+0000 7f48cf7fe700 1 --2- 172.21.15.81:0/781527569 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d006d120 0x7f48d006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.434+0000 7f48ceffd700 1 -- 172.21.15.81:0/781527569 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d006d120 msgr2=0x7f48d006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.434+0000 7f48ceffd700 1 --2- 172.21.15.81:0/781527569 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d006d120 0x7f48d006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.434+0000 7f48ceffd700 1 -- 172.21.15.81:0/781527569 >> v1:172.21.15.89:6789/0 conn(0x7f48d0157ca0 legacy=0x7f48d015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.434+0000 7f48ceffd700 1 -- 172.21.15.81:0/781527569 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d00cfe90 con 0x7f48d01578d0 2023-10-07T08:54:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.434+0000 7f48cf7fe700 1 --2- 172.21.15.81:0/781527569 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d006d120 0x7f48d006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.434+0000 7f48ceffd700 1 --2- 172.21.15.81:0/781527569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01578d0 0x7f48d00cf4f0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f48c00099b0 tx=0x7f48c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803a70c5f89bf8a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.434+0000 7f48ce7fc700 1 -- 172.21.15.81:0/781527569 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c000b860 con 0x7f48d01578d0 2023-10-07T08:54:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.434+0000 7f48ce7fc700 1 -- 172.21.15.81:0/781527569 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c000b9c0 con 0x7f48d01578d0 2023-10-07T08:54:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.434+0000 7f48ce7fc700 1 -- 172.21.15.81:0/781527569 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c000bd60 con 0x7f48d01578d0 2023-10-07T08:54:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.434+0000 7f48d56b4700 1 -- 172.21.15.81:0/781527569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01578d0 msgr2=0x7f48d00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.434+0000 7f48d56b4700 1 --2- 172.21.15.81:0/781527569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01578d0 0x7f48d00cf4f0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f48c00099b0 tx=0x7f48c0009250 comp rx=0 tx=0).stop 2023-10-07T08:54:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.435+0000 7f48d56b4700 1 -- 172.21.15.81:0/781527569 shutdown_connections 2023-10-07T08:54:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.435+0000 7f48d56b4700 1 --2- 172.21.15.81:0/781527569 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d006d120 0x7f48d006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.435+0000 7f48d56b4700 1 --2- 172.21.15.81:0/781527569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01578d0 0x7f48d00cf4f0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.435+0000 7f48d56b4700 1 -- 172.21.15.81:0/781527569 >> 172.21.15.81:0/781527569 conn(0x7f48d006bb90 msgr2=0x7f48d006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.435+0000 7f48d56b4700 1 -- 172.21.15.81:0/781527569 shutdown_connections 2023-10-07T08:54:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.435+0000 7f48d56b4700 1 -- 172.21.15.81:0/781527569 wait complete. 2023-10-07T08:54:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.436+0000 7f48d56b4700 1 Processor -- start 2023-10-07T08:54:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.436+0000 7f48d56b4700 1 -- start start 2023-10-07T08:54:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.436+0000 7f48d56b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d006d120 0x7f48d00b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.436+0000 7f48d56b4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d01578d0 0x7f48d016b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.436+0000 7f48d56b4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d0157ca0 0x7f48d015da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.436+0000 7f48d56b4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d016adb0 con 0x7f48d006d120 2023-10-07T08:54:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.436+0000 7f48d56b4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d00b6350 con 0x7f48d01578d0 2023-10-07T08:54:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.436+0000 7f48d56b4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d00b4240 con 0x7f48d0157ca0 2023-10-07T08:54:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.436+0000 7f48ceffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d006d120 0x7f48d00b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.436+0000 7f48ceffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d006d120 0x7f48d00b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54270/0 (socket says 172.21.15.81:54270) 2023-10-07T08:54:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.436+0000 7f48ceffd700 1 -- 172.21.15.81:0/1913323904 learned_addr learned my addr 172.21.15.81:0/1913323904 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.437+0000 7f48c7fff700 1 --2- 172.21.15.81:0/1913323904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d01578d0 0x7f48d016b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.437+0000 7f48cf7fe700 1 --2- 172.21.15.81:0/1913323904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d0157ca0 0x7f48d015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.437+0000 7f48ceffd700 1 -- 172.21.15.81:0/1913323904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d0157ca0 msgr2=0x7f48d015da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.437+0000 7f48ceffd700 1 --2- 172.21.15.81:0/1913323904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d0157ca0 0x7f48d015da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.437+0000 7f48ceffd700 1 -- 172.21.15.81:0/1913323904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d01578d0 msgr2=0x7f48d016b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.437+0000 7f48ceffd700 1 --2- 172.21.15.81:0/1913323904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d01578d0 0x7f48d016b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.437+0000 7f48ceffd700 1 -- 172.21.15.81:0/1913323904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c00094f0 con 0x7f48d006d120 2023-10-07T08:54:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.437+0000 7f48c7fff700 1 --2- 172.21.15.81:0/1913323904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d01578d0 0x7f48d016b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.437+0000 7f48cf7fe700 1 --2- 172.21.15.81:0/1913323904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d0157ca0 0x7f48d015da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-07T08:54:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.437+0000 7f48ceffd700 1 --2- 172.21.15.81:0/1913323904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d006d120 0x7f48d00b3d00 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009290 tx=0x7f48c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.437+0000 7f48c6ffd700 1 -- 172.21.15.81:0/1913323904 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c0024440 con 0x7f48d006d120 2023-10-07T08:54:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.437+0000 7f48c6ffd700 1 -- 172.21.15.81:0/1913323904 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c00245a0 con 0x7f48d006d120 2023-10-07T08:54:33.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.437+0000 7f48d56b4700 1 -- 172.21.15.81:0/1913323904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d00b65f0 con 0x7f48d006d120 2023-10-07T08:54:33.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.437+0000 7f48c6ffd700 1 -- 172.21.15.81:0/1913323904 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c0024960 con 0x7f48d006d120 2023-10-07T08:54:33.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.437+0000 7f48d56b4700 1 -- 172.21.15.81:0/1913323904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d016a9f0 con 0x7f48d006d120 2023-10-07T08:54:33.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.438+0000 7f48d56b4700 1 -- 172.21.15.81:0/1913323904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d0068e20 con 0x7f48d006d120 2023-10-07T08:54:33.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.438+0000 7f48c6ffd700 1 -- 172.21.15.81:0/1913323904 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48c001a420 con 0x7f48d006d120 2023-10-07T08:54:33.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.439+0000 7f48c6ffd700 1 --2- 172.21.15.81:0/1913323904 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48b0066f30 0x7f48b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.439+0000 7f48c6ffd700 1 -- 172.21.15.81:0/1913323904 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f48c0086190 con 0x7f48d006d120 2023-10-07T08:54:33.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.439+0000 7f48c7fff700 1 --2- 172.21.15.81:0/1913323904 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48b0066f30 0x7f48b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:33.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.439+0000 7f48c7fff700 1 --2- 172.21.15.81:0/1913323904 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48b0066f30 0x7f48b00693e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f48d00b59a0 tx=0x7f48b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:33.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.443+0000 7f48c6ffd700 1 -- 172.21.15.81:0/1913323904 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48c0053700 con 0x7f48d006d120 2023-10-07T08:54:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.628+0000 7f48d56b4700 1 -- 172.21.15.81:0/1913323904 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f48d016aef0 con 0x7f48b0066f30 2023-10-07T08:54:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.628+0000 7f48c6ffd700 1 -- 172.21.15.81:0/1913323904 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f48b8006820 con 0x7f48b0066f30 2023-10-07T08:54:33.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.630+0000 7f48d56b4700 1 -- 172.21.15.81:0/1913323904 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48b0066f30 msgr2=0x7f48b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.630+0000 7f48d56b4700 1 --2- 172.21.15.81:0/1913323904 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48b0066f30 0x7f48b00693e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f48d00b59a0 tx=0x7f48b8009040 comp rx=0 tx=0).stop 2023-10-07T08:54:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.630+0000 7f48d56b4700 1 -- 172.21.15.81:0/1913323904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d006d120 msgr2=0x7f48d00b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.630+0000 7f48d56b4700 1 --2- 172.21.15.81:0/1913323904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d006d120 0x7f48d00b3d00 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009290 tx=0x7f48c0017000 comp rx=0 tx=0).stop 2023-10-07T08:54:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.630+0000 7f48d56b4700 1 -- 172.21.15.81:0/1913323904 shutdown_connections 2023-10-07T08:54:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.630+0000 7f48d56b4700 1 --2- 172.21.15.81:0/1913323904 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f48b0066f30 0x7f48b00693e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.630+0000 7f48d56b4700 1 --2- 172.21.15.81:0/1913323904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48d0157ca0 0x7f48d015da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.630+0000 7f48d56b4700 1 --2- 172.21.15.81:0/1913323904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d006d120 0x7f48d00b3d00 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.630+0000 7f48d56b4700 1 --2- 172.21.15.81:0/1913323904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48d01578d0 0x7f48d016b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.630+0000 7f48d56b4700 1 -- 172.21.15.81:0/1913323904 >> 172.21.15.81:0/1913323904 conn(0x7f48d006bb90 msgr2=0x7f48d01549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.630+0000 7f48d56b4700 1 -- 172.21.15.81:0/1913323904 shutdown_connections 2023-10-07T08:54:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.630+0000 7f48d56b4700 1 -- 172.21.15.81:0/1913323904 wait complete. 2023-10-07T08:54:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 7 to deep-scrub 2023-10-07T08:54:33.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:54:33.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.755+0000 7fdf4098c700 1 Processor -- start 2023-10-07T08:54:33.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.755+0000 7fdf4098c700 1 -- start start 2023-10-07T08:54:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.756+0000 7fdf4098c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdf3c159f10 0x7fdf3c068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.756+0000 7fdf4098c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf3c068cc0 0x7fdf3c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.756+0000 7fdf4098c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf3c069120 con 0x7fdf3c159b40 2023-10-07T08:54:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.756+0000 7fdf4098c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3c0cee10 con 0x7fdf3c068cc0 2023-10-07T08:54:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.756+0000 7fdf4098c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3c0cd040 con 0x7fdf3c159f10 2023-10-07T08:54:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.756+0000 7fdf3b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdf3c159b40 0x7fdf3c0cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59318/0 (socket says 172.21.15.81:59318) 2023-10-07T08:54:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.756+0000 7fdf3bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf3c068cc0 0x7fdf3c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.756+0000 7fdf3b7fe700 1 -- 172.21.15.81:0/3768547084 learned_addr learned my addr 172.21.15.81:0/3768547084 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.756+0000 7fdf3a7fc700 1 -- 172.21.15.81:0/3768547084 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407713972 0 0) 0x7fdf2c001490 con 0x7fdf3c159b40 2023-10-07T08:54:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.756+0000 7fdf3a7fc700 1 -- 172.21.15.81:0/3768547084 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf24003570 con 0x7fdf3c159b40 2023-10-07T08:54:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.756+0000 7fdf3bfff700 1 -- 172.21.15.81:0/3768547084 >> v2:172.21.15.89:3300/0 conn(0x7fdf3c159f10 msgr2=0x7fdf3c068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.756+0000 7fdf3bfff700 1 --2- 172.21.15.81:0/3768547084 >> v2:172.21.15.89:3300/0 conn(0x7fdf3c159f10 0x7fdf3c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.756+0000 7fdf3bfff700 1 -- 172.21.15.81:0/3768547084 >> v1:172.21.15.81:6789/0 conn(0x7fdf3c159b40 legacy=0x7fdf3c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.756+0000 7fdf3bfff700 1 -- 172.21.15.81:0/3768547084 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c0cd320 con 0x7fdf3c068cc0 2023-10-07T08:54:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.756+0000 7fdf3bfff700 1 --2- 172.21.15.81:0/3768547084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf3c068cc0 0x7fdf3c0cf2a0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c06fd80 tx=0x7fdf340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29eefa06e9068956 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.757+0000 7fdf3a7fc700 1 -- 172.21.15.81:0/3768547084 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34011630 con 0x7fdf3c068cc0 2023-10-07T08:54:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.757+0000 7fdf3a7fc700 1 -- 172.21.15.81:0/3768547084 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf34011790 con 0x7fdf3c068cc0 2023-10-07T08:54:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.757+0000 7fdf3a7fc700 1 -- 172.21.15.81:0/3768547084 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34011b30 con 0x7fdf3c068cc0 2023-10-07T08:54:33.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.757+0000 7fdf4098c700 1 -- 172.21.15.81:0/3768547084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf3c068cc0 msgr2=0x7fdf3c0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.757+0000 7fdf4098c700 1 --2- 172.21.15.81:0/3768547084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf3c068cc0 0x7fdf3c0cf2a0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c06fd80 tx=0x7fdf340091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.757+0000 7fdf4098c700 1 -- 172.21.15.81:0/3768547084 shutdown_connections 2023-10-07T08:54:33.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.757+0000 7fdf4098c700 1 --2- 172.21.15.81:0/3768547084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf3c068cc0 0x7fdf3c0cf2a0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.757+0000 7fdf4098c700 1 --2- 172.21.15.81:0/3768547084 >> v2:172.21.15.89:3300/0 conn(0x7fdf3c159f10 0x7fdf3c068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.757+0000 7fdf4098c700 1 -- 172.21.15.81:0/3768547084 >> 172.21.15.81:0/3768547084 conn(0x7fdf3c0cd660 msgr2=0x7fdf3c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:33.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.757+0000 7fdf4098c700 1 -- 172.21.15.81:0/3768547084 shutdown_connections 2023-10-07T08:54:33.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.757+0000 7fdf4098c700 1 -- 172.21.15.81:0/3768547084 wait complete. 2023-10-07T08:54:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.758+0000 7fdf4098c700 1 Processor -- start 2023-10-07T08:54:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.759+0000 7fdf4098c700 1 -- start start 2023-10-07T08:54:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.759+0000 7fdf4098c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf3c068cc0 0x7fdf3c0b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.759+0000 7fdf4098c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf3c159b40 0x7fdf3c0b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.759+0000 7fdf4098c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf3c159f10 0x7fdf3c158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.759+0000 7fdf4098c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c0b6510 con 0x7fdf3c068cc0 2023-10-07T08:54:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.759+0000 7fdf4098c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c15b710 con 0x7fdf3c159f10 2023-10-07T08:54:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.759+0000 7fdf4098c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c0b5fa0 con 0x7fdf3c159b40 2023-10-07T08:54:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.759+0000 7fdf3b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf3c068cc0 0x7fdf3c0b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.759+0000 7fdf3b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf3c068cc0 0x7fdf3c0b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54276/0 (socket says 172.21.15.81:54276) 2023-10-07T08:54:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.759+0000 7fdf3b7fe700 1 -- 172.21.15.81:0/1123751987 learned_addr learned my addr 172.21.15.81:0/1123751987 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.760+0000 7fdf3b7fe700 1 -- 172.21.15.81:0/1123751987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf3c159b40 msgr2=0x7fdf3c0b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.760+0000 7fdf3b7fe700 1 --2- 172.21.15.81:0/1123751987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf3c159b40 0x7fdf3c0b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.760+0000 7fdf3b7fe700 1 -- 172.21.15.81:0/1123751987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf3c159f10 msgr2=0x7fdf3c158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.760+0000 7fdf3b7fe700 1 --2- 172.21.15.81:0/1123751987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf3c159f10 0x7fdf3c158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.760+0000 7fdf3b7fe700 1 -- 172.21.15.81:0/1123751987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf34009420 con 0x7fdf3c068cc0 2023-10-07T08:54:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.760+0000 7fdf3b7fe700 1 --2- 172.21.15.81:0/1123751987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf3c068cc0 0x7fdf3c0b5520 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00cd30 tx=0x7fdf2c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.760+0000 7fdf237fe700 1 -- 172.21.15.81:0/1123751987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c00ab70 con 0x7fdf3c068cc0 2023-10-07T08:54:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.760+0000 7fdf237fe700 1 -- 172.21.15.81:0/1123751987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2c00acf0 con 0x7fdf3c068cc0 2023-10-07T08:54:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.760+0000 7fdf4098c700 1 -- 172.21.15.81:0/1123751987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3c0b6230 con 0x7fdf3c068cc0 2023-10-07T08:54:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.760+0000 7fdf237fe700 1 -- 172.21.15.81:0/1123751987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c007340 con 0x7fdf3c068cc0 2023-10-07T08:54:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.760+0000 7fdf4098c700 1 -- 172.21.15.81:0/1123751987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3c15b3a0 con 0x7fdf3c068cc0 2023-10-07T08:54:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.761+0000 7fdf4098c700 1 -- 172.21.15.81:0/1123751987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf3c063e90 con 0x7fdf3c068cc0 2023-10-07T08:54:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.761+0000 7fdf237fe700 1 -- 172.21.15.81:0/1123751987 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf2c007770 con 0x7fdf3c068cc0 2023-10-07T08:54:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.762+0000 7fdf237fe700 1 --2- 172.21.15.81:0/1123751987 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf28066f30 0x7fdf280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.762+0000 7fdf237fe700 1 -- 172.21.15.81:0/1123751987 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fdf2c084680 con 0x7fdf3c068cc0 2023-10-07T08:54:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.762+0000 7fdf3affd700 1 --2- 172.21.15.81:0/1123751987 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf28066f30 0x7fdf280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.762+0000 7fdf3affd700 1 --2- 172.21.15.81:0/1123751987 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf28066f30 0x7fdf280693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c15d4b0 tx=0x7fdf30006d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:33.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.766+0000 7fdf237fe700 1 -- 172.21.15.81:0/1123751987 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf2c051bd0 con 0x7fdf3c068cc0 2023-10-07T08:54:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.941+0000 7fdf4098c700 1 -- 172.21.15.81:0/1123751987 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf3c15b850 con 0x7fdf28066f30 2023-10-07T08:54:33.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.943+0000 7fdf237fe700 1 -- 172.21.15.81:0/1123751987 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50163 (secure 0 0 0) 0x7fdf300113f0 con 0x7fdf28066f30 2023-10-07T08:54:33.945 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.945+0000 7fdf4098c700 1 -- 172.21.15.81:0/1123751987 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf28066f30 msgr2=0x7fdf280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.945+0000 7fdf4098c700 1 --2- 172.21.15.81:0/1123751987 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf28066f30 0x7fdf280693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c15d4b0 tx=0x7fdf30006d10 comp rx=0 tx=0).stop 2023-10-07T08:54:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.945+0000 7fdf4098c700 1 -- 172.21.15.81:0/1123751987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf3c068cc0 msgr2=0x7fdf3c0b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.945+0000 7fdf4098c700 1 --2- 172.21.15.81:0/1123751987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf3c068cc0 0x7fdf3c0b5520 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00cd30 tx=0x7fdf2c001b10 comp rx=0 tx=0).stop 2023-10-07T08:54:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.946+0000 7fdf4098c700 1 -- 172.21.15.81:0/1123751987 shutdown_connections 2023-10-07T08:54:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.946+0000 7fdf4098c700 1 --2- 172.21.15.81:0/1123751987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf3c159f10 0x7fdf3c158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.946+0000 7fdf4098c700 1 --2- 172.21.15.81:0/1123751987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf3c068cc0 0x7fdf3c0b5520 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.946+0000 7fdf4098c700 1 --2- 172.21.15.81:0/1123751987 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7fdf28066f30 0x7fdf280693e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.946+0000 7fdf4098c700 1 --2- 172.21.15.81:0/1123751987 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf3c159b40 0x7fdf3c0b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.946+0000 7fdf4098c700 1 -- 172.21.15.81:0/1123751987 >> 172.21.15.81:0/1123751987 conn(0x7fdf3c0cd660 msgr2=0x7fdf3c0cbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.946+0000 7fdf4098c700 1 -- 172.21.15.81:0/1123751987 shutdown_connections 2023-10-07T08:54:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:33.946+0000 7fdf4098c700 1 -- 172.21.15.81:0/1123751987 wait complete. 2023-10-07T08:54:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:54:33.959 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":542,"stamp":"2023-10-07T08:54:32.157896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9795,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552704,"statfs":{"total":1600000000,"available":1589969792,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489239,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-122,"num_write_kb":-85081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001188"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":312,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-10-07T08:54:24.445143+0000","last_change":"2023-10-07T08:42:48.462477+0000","last_active":"2023-10-07T08:54:24.445143+0000","last_peered":"2023-10-07T08:54:24.445143+0000","last_clean":"2023-10-07T08:54:24.445143+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:54:24.445143+0000","last_undegraded":"2023-10-07T08:54:24.445143+0000","last_fullsized":"2023-10-07T08:54:24.445143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-07T08:42:47.005241+0000","last_clean_scrub_stamp":"2023-10-07T08:42:47.005241+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T10:16:44.063705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574991,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1656,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193655,"statfs":{"total":200000000,"available":198303448,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.312,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.252},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52200000000000002,"15min":0.504},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":1.2150000000000001},"last":0.29999999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54600000000000004,"15min":0.53000000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.55500000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":1.1659999999999999},"last":0.374}]},{"osd":2,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.432,"5min":0.314,"15min":0.314},"max":{"1min":0.72299999999999998,"5min":0.75,"15min":0.80300000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53600000000000003,"15min":0.51000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.35899999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56299999999999994,"15min":0.67100000000000004},"min":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":6.8570000000000002},"last":0.499},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.57399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.98999999999999999},"last":0.32700000000000001}]},{"osd":4,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.47899999999999998},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":0.71899999999999997,"5min":0.81299999999999994,"15min":0.98599999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.32400000000000001,"15min":0.26700000000000002},"max":{"1min":0.73599999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.45600000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.50800000000000001,"15min":0.501},"min":{"1min":0.34699999999999998,"5min":0.30499999999999999,"15min":0.27800000000000002},"max":{"1min":0.67500000000000004,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.434},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.36399999999999999,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":1.0669999999999999},"last":0.47399999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.34599999999999997},"max":{"1min":0.75600000000000001,"5min":0.78600000000000003,"15min":1.1020000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58599999999999997,"15min":0.56899999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.307},"max":{"1min":0.82999999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.53200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1080,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198893816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51800000000000002,"15min":0.49299999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.25700000000000001},"max":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.76600000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.501},"min":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.30199999999999999},"max":{"1min":0.67800000000000005,"5min":0.70699999999999996,"15min":0.77500000000000002},"last":0.45100000000000001}]},{"osd":1,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70599999999999996,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29799999999999999},"max":{"1min":0.73099999999999998,"5min":0.753,"15min":1.0069999999999999},"last":0.55900000000000005}]},{"osd":2,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.54300000000000004,"15min":0.51500000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.29399999999999998},"max":{"1min":0.60399999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.53100000000000003},"min":{"1min":0.38100000000000001,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":0.71199999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47399999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59299999999999997,"5min":0.751,"15min":0.752},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68500000000000005,"5min":0.83199999999999996,"15min":2.3879999999999999},"last":0.58399999999999996}]},{"osd":4,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.308,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60999999999999999,"5min":0.71899999999999997,"15min":0.73699999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47799999999999998,"15min":0.49199999999999999},"min":{"1min":0.35699999999999998,"5min":0.30499999999999999,"15min":0.27400000000000002},"max":{"1min":0.59999999999999998,"5min":0.73599999999999999,"15min":0.79900000000000004},"last":0.61399999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48099999999999998,"15min":0.5},"min":{"1min":0.40000000000000002,"5min":0.30399999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.86799999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52800000000000002,"15min":0.53700000000000003},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.63100000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.372,"5min":0.35499999999999998,"15min":0.312},"max":{"1min":0.69199999999999995,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.375,"5min":0.36299999999999999,"15min":0.35199999999999998},"max":{"1min":0.66200000000000003,"5min":0.76100000000000001,"15min":1.052},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1080,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198893816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.26000000000000001,"5min":0.193,"15min":0.17499999999999999},"max":{"1min":0.50600000000000001,"5min":0.60399999999999998,"15min":1.9359999999999999},"last":0.378},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36099999999999999,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.221,"15min":0.192},"max":{"1min":0.47699999999999998,"5min":0.61399999999999999,"15min":0.82999999999999996},"last":0.27800000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.33900000000000002},"min":{"1min":0.27800000000000002,"5min":0.224,"15min":0.19600000000000001},"max":{"1min":0.46400000000000002,"5min":0.57799999999999996,"15min":1.639},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.38600000000000001,"15min":0.36399999999999999},"min":{"1min":0.28000000000000003,"5min":0.245,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":0.69599999999999995,"15min":1.9039999999999999},"last":0.36099999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40799999999999997,"15min":0.38500000000000001},"min":{"1min":0.30299999999999999,"5min":0.27200000000000002,"15min":0.249},"max":{"1min":0.57199999999999995,"5min":0.64500000000000002,"15min":1.6819999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39900000000000002,"15min":0.375},"min":{"1min":0.30599999999999999,"5min":0.26500000000000001,"15min":0.24399999999999999},"max":{"1min":0.56899999999999995,"5min":0.63800000000000001,"15min":0.97599999999999998},"last":0.315}]},{"osd":4,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57299999999999995,"15min":0.55600000000000005},"min":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.88300000000000001,"15min":0.91600000000000004},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.55700000000000005},"min":{"1min":0.42699999999999999,"5min":0.40500000000000003,"15min":0.28599999999999998},"max":{"1min":0.77200000000000002,"5min":0.86399999999999999,"15min":1.9570000000000001},"last":0.747}]},{"osd":5,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.59699999999999998},"min":{"1min":0.48199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84299999999999997,"5min":0.98199999999999998,"15min":1.0409999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.628,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.40300000000000002,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.89600000000000002,"15min":0.97299999999999998},"last":0.77900000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.47599999999999998,"5min":0.379,"15min":0.34200000000000003},"max":{"1min":0.72399999999999998,"5min":0.94299999999999995,"15min":1.2150000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59699999999999998,"15min":0.56399999999999995},"min":{"1min":0.40799999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.76400000000000001,"5min":0.83399999999999996,"15min":0.87},"last":0.75600000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63400000000000001,"15min":0.60799999999999998},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":1.004,"15min":1.0800000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64600000000000002,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.40799999999999997},"max":{"1min":0.80200000000000005,"5min":0.92700000000000005,"15min":0.94299999999999995},"last":0.79400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574991,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1656,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193655,"statfs":{"total":200000000,"available":198303448,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34899999999999998,"15min":0.35599999999999998},"min":{"1min":0.23100000000000001,"5min":0.224,"15min":0.20100000000000001},"max":{"1min":0.45700000000000002,"5min":0.71099999999999997,"15min":1.4339999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.36699999999999999,"15min":0.38100000000000001},"min":{"1min":0.24299999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.498,"5min":0.54300000000000004,"15min":1.079},"last":0.39600000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.372,"15min":0.38},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.61799999999999999,"15min":1.464},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39700000000000002},"min":{"1min":0.28499999999999998,"5min":0.247,"15min":0.21299999999999999},"max":{"1min":0.57999999999999996,"5min":0.627,"15min":1.1060000000000001},"last":0.32900000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.379,"15min":0.378},"min":{"1min":0.26800000000000002,"5min":0.249,"15min":0.23300000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":1.341},"last":0.315},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41999999999999998,"15min":0.42599999999999999},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.25700000000000001},"max":{"1min":0.61199999999999999,"5min":0.65700000000000003,"15min":1.532},"last":0.34300000000000003}]},{"osd":4,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59599999999999997,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81699999999999995,"5min":0.89400000000000002,"15min":1.3169999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.34699999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.51},"last":0.46100000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.623,"15min":0.60599999999999998},"min":{"1min":0.437,"5min":0.35799999999999998,"15min":0.33700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0529999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.85499999999999998,"5min":0.91000000000000003,"15min":1.25},"last":0.55500000000000005}]},{"osd":6,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.48899999999999999,"5min":0.39700000000000002,"15min":0.376},"max":{"1min":0.95699999999999996,"5min":0.95799999999999996,"15min":1.488},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63600000000000001,"15min":0.61199999999999999},"min":{"1min":0.45800000000000002,"5min":0.41999999999999998,"15min":0.39000000000000001},"max":{"1min":0.80400000000000005,"5min":0.94599999999999995,"15min":1.024},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.47499999999999998,"5min":0.44,"15min":0.41999999999999998},"max":{"1min":0.873,"5min":0.97799999999999998,"15min":0.98499999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.623,"15min":0.61199999999999999},"min":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.374},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.288},"last":0.503}]}]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1080,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198893816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33100000000000002,"15min":0.33500000000000002},"min":{"1min":0.20200000000000001,"5min":0.19400000000000001,"15min":0.17699999999999999},"max":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":1.665},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35899999999999999,"15min":0.35999999999999999},"min":{"1min":0.23899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48899999999999999,"5min":0.54900000000000004,"15min":1.579},"last":0.40400000000000003}]},{"osd":1,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.374},"min":{"1min":0.23100000000000001,"5min":0.216,"15min":0.20499999999999999},"max":{"1min":0.626,"5min":0.626,"15min":2.4470000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.308,"5min":0.25800000000000001,"15min":0.20200000000000001},"max":{"1min":0.58999999999999997,"5min":0.65000000000000002,"15min":2.4620000000000002},"last":0.45300000000000001}]},{"osd":3,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40200000000000002,"15min":0.39500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27100000000000002,"15min":0.24199999999999999},"max":{"1min":0.51600000000000001,"5min":0.56999999999999995,"15min":1.454},"last":0.441},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39300000000000002,"15min":0.38900000000000001},"min":{"1min":0.28699999999999998,"5min":0.255,"15min":0.20899999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":1.6919999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61399999999999999,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.35499999999999998,"15min":0.28199999999999997},"max":{"1min":1.056,"5min":1.056,"15min":1.7210000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63600000000000001,"15min":0.60799999999999998},"min":{"1min":0.53600000000000003,"5min":0.40000000000000002,"15min":0.34100000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.5549999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58999999999999997,"15min":0.56299999999999994},"min":{"1min":0.44800000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.5269999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.58199999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.311},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":1.4039999999999999},"last":0.65800000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.57899999999999996},"min":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.92000000000000004,"5min":0.93999999999999995,"15min":1.3380000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.40799999999999997,"5min":0.371,"15min":0.34399999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.637},"last":0.63500000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.62,"15min":0.60199999999999998},"min":{"1min":0.497,"5min":0.443,"15min":0.379},"max":{"1min":1.014,"5min":1.014,"15min":1.49},"last":0.751},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64800000000000002,"15min":0.622},"min":{"1min":0.45800000000000002,"5min":0.43099999999999999,"15min":0.35999999999999999},"max":{"1min":0.96199999999999997,"5min":0.96999999999999997,"15min":1.375},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1080,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198893816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.33000000000000002},"min":{"1min":0.24199999999999999,"5min":0.20599999999999999,"15min":0.19400000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":1.8220000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.35899999999999999,"15min":0.33800000000000002},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.93500000000000005},"last":0.34599999999999997}]},{"osd":1,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.373,"15min":0.36599999999999999},"min":{"1min":0.25,"5min":0.23200000000000001,"15min":0.185},"max":{"1min":0.55900000000000005,"5min":0.65200000000000002,"15min":1.6519999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.254,"5min":0.23100000000000001,"15min":0.22500000000000001},"max":{"1min":0.51300000000000001,"5min":0.63700000000000001,"15min":1.885},"last":0.36499999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.38500000000000001},"min":{"1min":0.27500000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":1.274},"last":0.317},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40400000000000003,"15min":0.40500000000000003},"min":{"1min":0.28899999999999998,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":1.8999999999999999},"last":0.33200000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.29999999999999999},"max":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.82799999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":0.84699999999999998,"15min":1.3109999999999999},"last":0.629}]},{"osd":5,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.35999999999999999},"max":{"1min":0.70599999999999996,"5min":0.83099999999999996,"15min":1.1639999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81200000000000006,"5min":0.89000000000000001,"15min":1.851},"last":0.56699999999999995}]},{"osd":6,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.629,"15min":0.59199999999999997},"min":{"1min":0.44800000000000001,"5min":0.41799999999999998,"15min":0.34899999999999998},"max":{"1min":0.80700000000000005,"5min":0.91000000000000003,"15min":0.92700000000000005},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.40699999999999997,"15min":0.375},"max":{"1min":0.754,"5min":0.89200000000000002,"15min":1.1930000000000001},"last":0.75900000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.436,"5min":0.41499999999999998,"15min":0.39700000000000002},"max":{"1min":0.754,"5min":0.88,"15min":1.8700000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.58299999999999996},"min":{"1min":0.48199999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77900000000000003,"5min":0.85099999999999998,"15min":0.88400000000000001},"last":0.69299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574991,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1080,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198893816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51000000000000001,"15min":0.501},"min":{"1min":0.34599999999999997,"5min":0.28899999999999998,"15min":0.247},"max":{"1min":0.65500000000000003,"5min":0.78200000000000003,"15min":1.9419999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54400000000000004,"15min":0.52600000000000002},"min":{"1min":0.32800000000000001,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":0.78800000000000003,"5min":0.80200000000000005,"15min":1.6879999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.371,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":0.745,"5min":0.745,"15min":1.0169999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.40699999999999997,"5min":0.33000000000000002,"15min":0.28000000000000003},"max":{"1min":0.69699999999999995,"5min":0.74199999999999999,"15min":1.3580000000000001},"last":0.63500000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.32200000000000001,"15min":0.27800000000000002},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":2.1520000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.53300000000000003},"min":{"1min":0.433,"5min":0.376,"15min":0.30599999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.29},"last":0.66100000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.32500000000000001,"15min":0.29999999999999999},"max":{"1min":0.76800000000000002,"5min":0.77300000000000002,"15min":2.052},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":0.73599999999999999,"5min":0.78100000000000003,"15min":1.369},"last":0.52100000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.45000000000000001},"min":{"1min":0.30099999999999999,"5min":0.29099999999999998,"15min":0.27000000000000002},"max":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.89000000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.34499999999999997,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.68200000000000005,"5min":0.72599999999999998,"15min":0.88},"last":0.64800000000000002}]},{"osd":6,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.0049999999999999},"last":0.622},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.71199999999999997,"5min":0.73899999999999999,"15min":0.95599999999999996},"last":0.67700000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52800000000000002,"15min":0.54200000000000004},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.30099999999999999},"max":{"1min":0.70699999999999996,"5min":0.72299999999999998,"15min":0.98899999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.33300000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.91300000000000003},"last":0.70399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1080,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198893816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.32800000000000001,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.71399999999999997,"5min":0.76200000000000001,"15min":1.7849999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.51900000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53100000000000003,"15min":0.51700000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.25},"max":{"1min":0.65200000000000002,"5min":0.75700000000000001,"15min":2.5670000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54400000000000004,"15min":0.63800000000000001},"min":{"1min":0.39000000000000001,"5min":0.375,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":0.79000000000000004,"15min":29.143999999999998},"last":0.57499999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.41599999999999998,"5min":0.31,"15min":0.26800000000000002},"max":{"1min":0.67700000000000005,"5min":0.83399999999999996,"15min":1.0740000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38200000000000001,"5min":0.34699999999999998,"15min":0.309},"max":{"1min":0.69199999999999995,"5min":0.78600000000000003,"15min":0.81899999999999995},"last":0.41999999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.90200000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40400000000000003,"5min":0.39200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":0.83999999999999997,"15min":0.85099999999999998},"last":0.56499999999999995}]},{"osd":4,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.46400000000000002,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.93500000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.80800000000000005,"15min":0.80900000000000005},"last":0.59899999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.496,"15min":0.52100000000000002},"min":{"1min":0.42299999999999999,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.81399999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.44,"5min":0.35699999999999998,"15min":0.34799999999999998},"max":{"1min":0.85999999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.40300000000000002,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.93100000000000005},"last":0.629},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77400000000000002,"5min":0.81599999999999995,"15min":0.91100000000000003},"last":0.501}]}]}],"pool_statfs":[]}} 2023-10-07T08:54:33.963 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-07T08:42:47.005241+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=7, tm_hour=8, tm_min=42, tm_sec=47, tm_wday=5, tm_yday=280, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=7, tm_hour=8, tm_min=54, tm_sec=28, tm_wday=5, tm_yday=280, tm_isdst=0) 2023-10-07T08:54:33.963 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-07T08:54:53.963 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-07T08:54:54.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.090+0000 7f47a10c6700 1 Processor -- start 2023-10-07T08:54:54.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.090+0000 7f47a10c6700 1 -- start start 2023-10-07T08:54:54.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.091+0000 7f47a10c6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c15a2a0 0x7f479c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.091+0000 7f47a10c6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f479c0ceb30 0x7f479c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.091+0000 7f47a10c6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c0cf4e0 con 0x7f479c06d650 2023-10-07T08:54:54.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.091+0000 7f47a10c6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c06ea90 con 0x7f479c0ceb30 2023-10-07T08:54:54.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.091+0000 7f47a10c6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0b0ca0 con 0x7f479c15a2a0 2023-10-07T08:54:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.091+0000 7f479259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f479c0ceb30 0x7f479c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.091+0000 7f479b59e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f479c06d650 0x7f479c06da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34054/0 (socket says 172.21.15.81:34054) 2023-10-07T08:54:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.091+0000 7f479b59e700 1 -- 172.21.15.81:0/1678040024 learned_addr learned my addr 172.21.15.81:0/1678040024 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.091+0000 7f479259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f479c0ceb30 0x7f479c0cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38194/0 (socket says 172.21.15.81:38194) 2023-10-07T08:54:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.092+0000 7f479ad9d700 1 --2- 172.21.15.81:0/1678040024 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c15a2a0 0x7f479c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.092+0000 7f479259c700 1 -- 172.21.15.81:0/1678040024 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c15a2a0 msgr2=0x7f479c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.092+0000 7f479259c700 1 --2- 172.21.15.81:0/1678040024 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c15a2a0 0x7f479c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.092+0000 7f479259c700 1 -- 172.21.15.81:0/1678040024 >> v1:172.21.15.81:6789/0 conn(0x7f479c06d650 legacy=0x7f479c06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.092+0000 7f479259c700 1 -- 172.21.15.81:0/1678040024 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c0b00d0 con 0x7f479c0ceb30 2023-10-07T08:54:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.092+0000 7f479a59c700 1 -- 172.21.15.81:0/1678040024 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034311426 0 0) 0x7f479c0cf4e0 con 0x7f479c06d650 2023-10-07T08:54:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.092+0000 7f479259c700 1 --2- 172.21.15.81:0/1678040024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c0ceb30 0x7f479c0cefa0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f47840098e0 tx=0x7f47840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494b72c4cb8b0c14 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.092+0000 7f479a59c700 1 -- 172.21.15.81:0/1678040024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784009e80 con 0x7f479c0ceb30 2023-10-07T08:54:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.092+0000 7f479a59c700 1 -- 172.21.15.81:0/1678040024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478400b860 con 0x7f479c0ceb30 2023-10-07T08:54:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.092+0000 7f479a59c700 1 -- 172.21.15.81:0/1678040024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400bbe0 con 0x7f479c0ceb30 2023-10-07T08:54:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.092+0000 7f47a10c6700 1 -- 172.21.15.81:0/1678040024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c0ceb30 msgr2=0x7f479c0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.092+0000 7f47a10c6700 1 --2- 172.21.15.81:0/1678040024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c0ceb30 0x7f479c0cefa0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f47840098e0 tx=0x7f47840091a0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.092+0000 7f47a10c6700 1 -- 172.21.15.81:0/1678040024 shutdown_connections 2023-10-07T08:54:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.092+0000 7f47a10c6700 1 --2- 172.21.15.81:0/1678040024 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c15a2a0 0x7f479c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.092+0000 7f47a10c6700 1 --2- 172.21.15.81:0/1678040024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c0ceb30 0x7f479c0cefa0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.093+0000 7f47a10c6700 1 -- 172.21.15.81:0/1678040024 >> 172.21.15.81:0/1678040024 conn(0x7f479c067640 msgr2=0x7f479c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.093+0000 7f47a10c6700 1 -- 172.21.15.81:0/1678040024 shutdown_connections 2023-10-07T08:54:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.093+0000 7f47a10c6700 1 -- 172.21.15.81:0/1678040024 wait complete. 2023-10-07T08:54:54.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.094+0000 7f47a10c6700 1 Processor -- start 2023-10-07T08:54:54.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.094+0000 7f47a10c6700 1 -- start start 2023-10-07T08:54:54.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.094+0000 7f47a10c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c06d650 0x7f479c1501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.094+0000 7f47a10c6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f479c0ceb30 0x7f479c15f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.094+0000 7f47a10c6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c15a2a0 0x7f479c151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.094+0000 7f47a10c6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c150720 con 0x7f479c06d650 2023-10-07T08:54:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.094+0000 7f47a10c6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c15edd0 con 0x7f479c0ceb30 2023-10-07T08:54:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.094+0000 7f47a10c6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c153990 con 0x7f479c15a2a0 2023-10-07T08:54:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f479ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c06d650 0x7f479c1501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f479ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c06d650 0x7f479c1501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38210/0 (socket says 172.21.15.81:38210) 2023-10-07T08:54:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f479ad9d700 1 -- 172.21.15.81:0/2611249601 learned_addr learned my addr 172.21.15.81:0/2611249601 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f479b59e700 1 --2- 172.21.15.81:0/2611249601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c15a2a0 0x7f479c151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f479259c700 1 --2- 172.21.15.81:0/2611249601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f479c0ceb30 0x7f479c15f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f479ad9d700 1 -- 172.21.15.81:0/2611249601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c15a2a0 msgr2=0x7f479c151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f479ad9d700 1 --2- 172.21.15.81:0/2611249601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c15a2a0 0x7f479c151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f479ad9d700 1 -- 172.21.15.81:0/2611249601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f479c0ceb30 msgr2=0x7f479c15f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f479ad9d700 1 --2- 172.21.15.81:0/2611249601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f479c0ceb30 0x7f479c15f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f479ad9d700 1 -- 172.21.15.81:0/2611249601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4784009420 con 0x7f479c06d650 2023-10-07T08:54:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f479b59e700 1 --2- 172.21.15.81:0/2611249601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c15a2a0 0x7f479c151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f479259c700 1 --2- 172.21.15.81:0/2611249601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f479c0ceb30 0x7f479c15f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-07T08:54:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f479ad9d700 1 --2- 172.21.15.81:0/2611249601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c06d650 0x7f479c1501e0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f478c00d860 tx=0x7f478c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f47937fe700 1 -- 172.21.15.81:0/2611249601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c009610 con 0x7f479c06d650 2023-10-07T08:54:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f47937fe700 1 -- 172.21.15.81:0/2611249601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c009770 con 0x7f479c06d650 2023-10-07T08:54:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f47a10c6700 1 -- 172.21.15.81:0/2611249601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c15dee0 con 0x7f479c06d650 2023-10-07T08:54:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f47937fe700 1 -- 172.21.15.81:0/2611249601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c009b30 con 0x7f479c06d650 2023-10-07T08:54:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.095+0000 7f47a10c6700 1 -- 172.21.15.81:0/2611249601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c15e4a0 con 0x7f479c06d650 2023-10-07T08:54:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.096+0000 7f47a10c6700 1 -- 172.21.15.81:0/2611249601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c15f0b0 con 0x7f479c06d650 2023-10-07T08:54:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.097+0000 7f47937fe700 1 -- 172.21.15.81:0/2611249601 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f478c01e460 con 0x7f479c06d650 2023-10-07T08:54:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.097+0000 7f47937fe700 1 --2- 172.21.15.81:0/2611249601 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f477c066f60 0x7f477c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.097+0000 7f47937fe700 1 -- 172.21.15.81:0/2611249601 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f478c0847f0 con 0x7f479c06d650 2023-10-07T08:54:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.097+0000 7f479259c700 1 --2- 172.21.15.81:0/2611249601 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f477c066f60 0x7f477c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.097+0000 7f479259c700 1 --2- 172.21.15.81:0/2611249601 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f477c066f60 0x7f477c069410 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f47840091e0 tx=0x7f4784017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.101+0000 7f47937fe700 1 -- 172.21.15.81:0/2611249601 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f478c051d60 con 0x7f479c06d650 2023-10-07T08:54:54.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.279+0000 7f47a10c6700 1 -- 172.21.15.81:0/2611249601 --> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f479c15ef10 con 0x7f477c066f60 2023-10-07T08:54:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.281+0000 7f47937fe700 1 -- 172.21.15.81:0/2611249601 <== mgr.4104 v2:172.21.15.81:6832/86101 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50150 (secure 0 0 0) 0x7f478400b9d0 con 0x7f477c066f60 2023-10-07T08:54:54.284 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.283+0000 7f47a10c6700 1 -- 172.21.15.81:0/2611249601 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f477c066f60 msgr2=0x7f477c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.283+0000 7f47a10c6700 1 --2- 172.21.15.81:0/2611249601 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f477c066f60 0x7f477c069410 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f47840091e0 tx=0x7f4784017000 comp rx=0 tx=0).stop 2023-10-07T08:54:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.283+0000 7f47a10c6700 1 -- 172.21.15.81:0/2611249601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c06d650 msgr2=0x7f479c1501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.283+0000 7f47a10c6700 1 --2- 172.21.15.81:0/2611249601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c06d650 0x7f479c1501e0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f478c00d860 tx=0x7f478c008040 comp rx=0 tx=0).stop 2023-10-07T08:54:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.283+0000 7f47a10c6700 1 -- 172.21.15.81:0/2611249601 shutdown_connections 2023-10-07T08:54:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.283+0000 7f47a10c6700 1 --2- 172.21.15.81:0/2611249601 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f477c066f60 0x7f477c069410 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.283+0000 7f47a10c6700 1 --2- 172.21.15.81:0/2611249601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c15a2a0 0x7f479c151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.283+0000 7f47a10c6700 1 --2- 172.21.15.81:0/2611249601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c06d650 0x7f479c1501e0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.283+0000 7f47a10c6700 1 --2- 172.21.15.81:0/2611249601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f479c0ceb30 0x7f479c15f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.283+0000 7f47a10c6700 1 -- 172.21.15.81:0/2611249601 >> 172.21.15.81:0/2611249601 conn(0x7f479c067640 msgr2=0x7f479c0ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.283+0000 7f47a10c6700 1 -- 172.21.15.81:0/2611249601 shutdown_connections 2023-10-07T08:54:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.283+0000 7f47a10c6700 1 -- 172.21.15.81:0/2611249601 wait complete. 2023-10-07T08:54:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-07T08:54:54.296 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":553,"stamp":"2023-10-07T08:54:54.162039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9795,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552704,"statfs":{"total":1600000000,"available":1589969792,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002389"},"pg_stats":[{"pgid":"1.0","version":"197'119","reported_seq":325,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-07T08:54:37.554718+0000","last_change":"2023-10-07T08:54:37.554692+0000","last_active":"2023-10-07T08:54:37.554718+0000","last_peered":"2023-10-07T08:54:37.554718+0000","last_clean":"2023-10-07T08:54:37.554718+0000","last_became_active":"2023-10-07T08:42:48.461744+0000","last_became_peered":"2023-10-07T08:42:48.461744+0000","last_unstale":"2023-10-07T08:54:37.554718+0000","last_undegraded":"2023-10-07T08:54:37.554718+0000","last_fullsized":"2023-10-07T08:54:37.554718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"197'119","last_scrub_stamp":"2023-10-07T08:54:37.554637+0000","last_deep_scrub":"197'119","last_deep_scrub_stamp":"2023-10-07T08:54:37.554637+0000","last_clean_scrub_stamp":"2023-10-07T08:54:37.554637+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-08T16:24:49.475888+0000","scrub_duration":0.0026453140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574995,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1656,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193655,"statfs":{"total":200000000,"available":198303448,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.312,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52200000000000002,"15min":0.504},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":1.2150000000000001},"last":0.67500000000000004}]},{"osd":1,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54600000000000004,"15min":0.53000000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.622},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.55500000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":1.1659999999999999},"last":0.70699999999999996}]},{"osd":2,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.432,"5min":0.314,"15min":0.314},"max":{"1min":0.72299999999999998,"5min":0.75,"15min":0.80300000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53600000000000003,"15min":0.51000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56799999999999995}]},{"osd":3,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56299999999999994,"15min":0.67100000000000004},"min":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":6.8570000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59499999999999997,"15min":0.57399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.98999999999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.47899999999999998},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":0.71899999999999997,"5min":0.81299999999999994,"15min":0.98599999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.32400000000000001,"15min":0.26700000000000002},"max":{"1min":0.73599999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.53000000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.50800000000000001,"15min":0.501},"min":{"1min":0.34699999999999998,"5min":0.30499999999999999,"15min":0.27800000000000002},"max":{"1min":0.67500000000000004,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.497},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.36399999999999999,"5min":0.36299999999999999,"15min":0.30399999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":1.0669999999999999},"last":0.63800000000000001}]},{"osd":6,"last update":"Sat Oct 7 08:54:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.34599999999999997},"max":{"1min":0.75600000000000001,"5min":0.78600000000000003,"15min":1.1020000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58599999999999997,"15min":0.56899999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.307},"max":{"1min":0.82999999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.69299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1080,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198893816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51800000000000002,"15min":0.49299999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.25700000000000001},"max":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.76600000000000001},"last":0.505},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.501},"min":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.30199999999999999},"max":{"1min":0.67800000000000005,"5min":0.70699999999999996,"15min":0.77500000000000002},"last":0.64500000000000002}]},{"osd":1,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70599999999999996,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29799999999999999},"max":{"1min":0.73099999999999998,"5min":0.753,"15min":1.0069999999999999},"last":0.59199999999999997}]},{"osd":2,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.54300000000000004,"15min":0.51500000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.29399999999999998},"max":{"1min":0.60399999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.53100000000000003},"min":{"1min":0.38100000000000001,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":0.71199999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.48299999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.59299999999999997,"5min":0.751,"15min":0.752},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68500000000000005,"5min":0.83199999999999996,"15min":2.3879999999999999},"last":0.46500000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.308,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60999999999999999,"5min":0.71899999999999997,"15min":0.73699999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47799999999999998,"15min":0.49199999999999999},"min":{"1min":0.35699999999999998,"5min":0.30499999999999999,"15min":0.27400000000000002},"max":{"1min":0.59999999999999998,"5min":0.73599999999999999,"15min":0.79900000000000004},"last":0.30599999999999999}]},{"osd":5,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48099999999999998,"15min":0.5},"min":{"1min":0.40000000000000002,"5min":0.30399999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.86799999999999999},"last":0.378},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52800000000000002,"15min":0.53700000000000003},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.39100000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.372,"5min":0.35499999999999998,"15min":0.312},"max":{"1min":0.69199999999999995,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.375,"5min":0.36299999999999999,"15min":0.35199999999999998},"max":{"1min":0.66200000000000003,"5min":0.76100000000000001,"15min":1.052},"last":0.41499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1080,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198893816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.26000000000000001,"5min":0.193,"15min":0.17499999999999999},"max":{"1min":0.50600000000000001,"5min":0.60399999999999998,"15min":1.9359999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36099999999999999,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.221,"15min":0.192},"max":{"1min":0.47699999999999998,"5min":0.61399999999999999,"15min":0.82999999999999996},"last":0.55900000000000005}]},{"osd":2,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.33900000000000002},"min":{"1min":0.27800000000000002,"5min":0.224,"15min":0.19600000000000001},"max":{"1min":0.46400000000000002,"5min":0.57799999999999996,"15min":1.639},"last":0.504},{"interface":"front","average":{"1min":0.378,"5min":0.38600000000000001,"15min":0.36399999999999999},"min":{"1min":0.28000000000000003,"5min":0.245,"15min":0.22500000000000001},"max":{"1min":0.499,"5min":0.69599999999999995,"15min":1.9039999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40799999999999997,"15min":0.38500000000000001},"min":{"1min":0.30299999999999999,"5min":0.27200000000000002,"15min":0.249},"max":{"1min":0.57199999999999995,"5min":0.64500000000000002,"15min":1.6819999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39900000000000002,"15min":0.375},"min":{"1min":0.30599999999999999,"5min":0.26500000000000001,"15min":0.24399999999999999},"max":{"1min":0.56899999999999995,"5min":0.63800000000000001,"15min":0.97599999999999998},"last":0.52700000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57299999999999995,"15min":0.55600000000000005},"min":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.33600000000000002},"max":{"1min":0.78000000000000003,"5min":0.88300000000000001,"15min":0.91600000000000004},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.55700000000000005},"min":{"1min":0.42699999999999999,"5min":0.40500000000000003,"15min":0.28599999999999998},"max":{"1min":0.77200000000000002,"5min":0.86399999999999999,"15min":1.9570000000000001},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.59699999999999998},"min":{"1min":0.48199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84299999999999997,"5min":0.98199999999999998,"15min":1.0409999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.628,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.40300000000000002,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.89600000000000002,"15min":0.97299999999999998},"last":0.78900000000000003}]},{"osd":6,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.47599999999999998,"5min":0.379,"15min":0.34200000000000003},"max":{"1min":0.72399999999999998,"5min":0.94299999999999995,"15min":1.2150000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59699999999999998,"15min":0.56399999999999995},"min":{"1min":0.40799999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.76400000000000001,"5min":0.83399999999999996,"15min":0.87},"last":0.76700000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63400000000000001,"15min":0.60799999999999998},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":1.004,"15min":1.0800000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64600000000000002,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.40799999999999997},"max":{"1min":0.80200000000000005,"5min":0.92700000000000005,"15min":0.94299999999999995},"last":0.81299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574995,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1656,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193655,"statfs":{"total":200000000,"available":198303448,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34899999999999998,"15min":0.35599999999999998},"min":{"1min":0.23100000000000001,"5min":0.224,"15min":0.20100000000000001},"max":{"1min":0.45700000000000002,"5min":0.71099999999999997,"15min":1.4339999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.36699999999999999,"15min":0.38100000000000001},"min":{"1min":0.24299999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.498,"5min":0.54300000000000004,"15min":1.079},"last":0.318}]},{"osd":2,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.372,"15min":0.38},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.61799999999999999,"15min":1.464},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39700000000000002},"min":{"1min":0.28499999999999998,"5min":0.247,"15min":0.21299999999999999},"max":{"1min":0.57999999999999996,"5min":0.627,"15min":1.1060000000000001},"last":0.41799999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.379,"15min":0.378},"min":{"1min":0.26800000000000002,"5min":0.249,"15min":0.23300000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":1.341},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41999999999999998,"15min":0.42599999999999999},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.25700000000000001},"max":{"1min":0.61199999999999999,"5min":0.65700000000000003,"15min":1.532},"last":0.34000000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59599999999999997,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81699999999999995,"5min":0.89400000000000002,"15min":1.3169999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.34699999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.51},"last":0.56699999999999995}]},{"osd":5,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.623,"15min":0.60599999999999998},"min":{"1min":0.437,"5min":0.35799999999999998,"15min":0.33700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0529999999999999},"last":0.495},{"interface":"front","average":{"1min":0.628,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.85499999999999998,"5min":0.91000000000000003,"15min":1.25},"last":0.441}]},{"osd":6,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.48899999999999999,"5min":0.39700000000000002,"15min":0.376},"max":{"1min":0.95699999999999996,"5min":0.95799999999999996,"15min":1.488},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63600000000000001,"15min":0.61199999999999999},"min":{"1min":0.45800000000000002,"5min":0.41999999999999998,"15min":0.39000000000000001},"max":{"1min":0.80400000000000005,"5min":0.94599999999999995,"15min":1.024},"last":0.55600000000000005}]},{"osd":7,"last update":"Sat Oct 7 08:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.47499999999999998,"5min":0.44,"15min":0.41999999999999998},"max":{"1min":0.873,"5min":0.97799999999999998,"15min":0.98499999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.623,"15min":0.61199999999999999},"min":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.374},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.288},"last":0.51900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1080,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198893816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33100000000000002,"15min":0.33500000000000002},"min":{"1min":0.20200000000000001,"5min":0.19400000000000001,"15min":0.17699999999999999},"max":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":1.665},"last":0.255},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35899999999999999,"15min":0.35999999999999999},"min":{"1min":0.23899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48899999999999999,"5min":0.54900000000000004,"15min":1.579},"last":0.30299999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.374},"min":{"1min":0.23100000000000001,"5min":0.216,"15min":0.20499999999999999},"max":{"1min":0.626,"5min":0.626,"15min":2.4470000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41499999999999998,"15min":0.41999999999999998},"min":{"1min":0.308,"5min":0.25800000000000001,"15min":0.20200000000000001},"max":{"1min":0.58999999999999997,"5min":0.65000000000000002,"15min":2.4620000000000002},"last":0.36699999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40200000000000002,"15min":0.39500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27100000000000002,"15min":0.24199999999999999},"max":{"1min":0.51600000000000001,"5min":0.56999999999999995,"15min":1.454},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39300000000000002,"15min":0.38900000000000001},"min":{"1min":0.28699999999999998,"5min":0.255,"15min":0.20899999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":1.6919999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61399999999999999,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.35499999999999998,"15min":0.28199999999999997},"max":{"1min":1.056,"5min":1.056,"15min":1.7210000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63600000000000001,"15min":0.60799999999999998},"min":{"1min":0.53600000000000003,"5min":0.40000000000000002,"15min":0.34100000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.5549999999999999},"last":0.432}]},{"osd":5,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58999999999999997,"15min":0.56299999999999994},"min":{"1min":0.44800000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.5269999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.58199999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.311},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":1.4039999999999999},"last":0.443}]},{"osd":6,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.57899999999999996},"min":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.35499999999999998},"max":{"1min":0.92000000000000004,"5min":0.93999999999999995,"15min":1.3380000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.40799999999999997,"5min":0.371,"15min":0.34399999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.637},"last":0.46100000000000002}]},{"osd":7,"last update":"Sat Oct 7 08:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.62,"15min":0.60199999999999998},"min":{"1min":0.497,"5min":0.443,"15min":0.379},"max":{"1min":1.014,"5min":1.014,"15min":1.49},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64800000000000002,"15min":0.622},"min":{"1min":0.45800000000000002,"5min":0.43099999999999999,"15min":0.35999999999999999},"max":{"1min":0.96199999999999997,"5min":0.96999999999999997,"15min":1.375},"last":0.51900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1080,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198893816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.33000000000000002},"min":{"1min":0.24199999999999999,"5min":0.20599999999999999,"15min":0.19400000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":1.8220000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.35899999999999999,"15min":0.33800000000000002},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.93500000000000005},"last":0.48699999999999999}]},{"osd":1,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.373,"15min":0.36599999999999999},"min":{"1min":0.25,"5min":0.23200000000000001,"15min":0.185},"max":{"1min":0.55900000000000005,"5min":0.65200000000000002,"15min":1.6519999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.254,"5min":0.23100000000000001,"15min":0.22500000000000001},"max":{"1min":0.51300000000000001,"5min":0.63700000000000001,"15min":1.885},"last":0.61399999999999999}]},{"osd":2,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.38500000000000001},"min":{"1min":0.27500000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":1.274},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40400000000000003,"15min":0.40500000000000003},"min":{"1min":0.28899999999999998,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":1.8999999999999999},"last":0.51800000000000002}]},{"osd":4,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.29999999999999999},"max":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.82799999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":0.84699999999999998,"15min":1.3109999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.56299999999999994},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.35999999999999999},"max":{"1min":0.70599999999999996,"5min":0.83099999999999996,"15min":1.1639999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81200000000000006,"5min":0.89000000000000001,"15min":1.851},"last":0.72099999999999997}]},{"osd":6,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.629,"15min":0.59199999999999997},"min":{"1min":0.44800000000000001,"5min":0.41799999999999998,"15min":0.34899999999999998},"max":{"1min":0.80700000000000005,"5min":0.91000000000000003,"15min":0.92700000000000005},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.60799999999999998},"min":{"1min":0.45800000000000002,"5min":0.40699999999999997,"15min":0.375},"max":{"1min":0.754,"5min":0.89200000000000002,"15min":1.1930000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Sat Oct 7 08:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.436,"5min":0.41499999999999998,"15min":0.39700000000000002},"max":{"1min":0.754,"5min":0.88,"15min":1.8700000000000001},"last":0.75},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.58299999999999996},"min":{"1min":0.48199999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77900000000000003,"5min":0.85099999999999998,"15min":0.88400000000000001},"last":0.66700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1080,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198893816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51000000000000001,"15min":0.501},"min":{"1min":0.34599999999999997,"5min":0.28899999999999998,"15min":0.247},"max":{"1min":0.65500000000000003,"5min":0.78200000000000003,"15min":1.9419999999999999},"last":0.504},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54400000000000004,"15min":0.52600000000000002},"min":{"1min":0.32800000000000001,"5min":0.25800000000000001,"15min":0.22900000000000001},"max":{"1min":0.78800000000000003,"5min":0.80200000000000005,"15min":1.6879999999999999},"last":0.47899999999999998}]},{"osd":1,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.371,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":0.745,"5min":0.745,"15min":1.0169999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.40699999999999997,"5min":0.33000000000000002,"15min":0.28000000000000003},"max":{"1min":0.69699999999999995,"5min":0.74199999999999999,"15min":1.3580000000000001},"last":0.45100000000000001}]},{"osd":2,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.32200000000000001,"15min":0.27800000000000002},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":2.1520000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.53300000000000003},"min":{"1min":0.433,"5min":0.376,"15min":0.30599999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.29},"last":0.49399999999999999}]},{"osd":3,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.32500000000000001,"15min":0.29999999999999999},"max":{"1min":0.76800000000000002,"5min":0.77300000000000002,"15min":2.052},"last":0.439},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":0.73599999999999999,"5min":0.78100000000000003,"15min":1.369},"last":0.46800000000000003}]},{"osd":5,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.45000000000000001},"min":{"1min":0.30099999999999999,"5min":0.29099999999999998,"15min":0.27000000000000002},"max":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.89000000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.34499999999999997,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.68200000000000005,"5min":0.72599999999999998,"15min":0.88},"last":0.28599999999999998}]},{"osd":6,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.0049999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.71199999999999997,"5min":0.73899999999999999,"15min":0.95599999999999996},"last":0.38100000000000001}]},{"osd":7,"last update":"Sat Oct 7 08:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52800000000000002,"15min":0.54200000000000004},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.30099999999999999},"max":{"1min":0.70699999999999996,"5min":0.72299999999999998,"15min":0.98899999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.33300000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.91300000000000003},"last":0.40600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1080,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194232,"statfs":{"total":200000000,"available":198893816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.32800000000000001,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.71399999999999997,"5min":0.76200000000000001,"15min":1.7849999999999999},"last":0.443},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56000000000000005}]},{"osd":1,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53100000000000003,"15min":0.51700000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.25},"max":{"1min":0.65200000000000002,"5min":0.75700000000000001,"15min":2.5670000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54400000000000004,"15min":0.63800000000000001},"min":{"1min":0.39000000000000001,"5min":0.375,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":0.79000000000000004,"15min":29.143999999999998},"last":0.40200000000000002}]},{"osd":2,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.41599999999999998,"5min":0.31,"15min":0.26800000000000002},"max":{"1min":0.67700000000000005,"5min":0.83399999999999996,"15min":1.0740000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38200000000000001,"5min":0.34699999999999998,"15min":0.309},"max":{"1min":0.69199999999999995,"5min":0.78600000000000003,"15min":0.81899999999999995},"last":0.41699999999999998}]},{"osd":3,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.90200000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40400000000000003,"5min":0.39200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72899999999999998,"5min":0.83999999999999997,"15min":0.85099999999999998},"last":0.47599999999999998}]},{"osd":4,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.46400000000000002,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.93500000000000005},"last":0.497},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.80800000000000005,"15min":0.80900000000000005},"last":0.58499999999999996}]},{"osd":6,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.496,"15min":0.52100000000000002},"min":{"1min":0.42299999999999999,"5min":0.28799999999999998,"15min":0.28399999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.81399999999999995},"last":0.505},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.44,"5min":0.35699999999999998,"15min":0.34799999999999998},"max":{"1min":0.85999999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.57299999999999995}]},{"osd":7,"last update":"Sat Oct 7 08:54:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.40300000000000002,"5min":0.32800000000000001,"15min":0.313},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.93100000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77400000000000002,"5min":0.81599999999999995,"15min":0.91100000000000003},"last":0.53700000000000003}]}]}],"pool_statfs":[]}} 2023-10-07T08:54:54.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-07T08:54:54.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00b511f700 1 Processor -- start 2023-10-07T08:54:54.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00b511f700 1 -- start start 2023-10-07T08:54:54.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00b511f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f00b00b3bd0 0x7f00b00ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00b511f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b01583b0 0x7f00b00cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00b511f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b00b2890 con 0x7f00b0157fe0 2023-10-07T08:54:54.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00b511f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b00b4070 con 0x7f00b00b3bd0 2023-10-07T08:54:54.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00b511f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00b4350 con 0x7f00b01583b0 2023-10-07T08:54:54.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00ae59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f00b00b3bd0 0x7f00b00ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00ae59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f00b00b3bd0 0x7f00b00ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38214/0 (socket says 172.21.15.81:38214) 2023-10-07T08:54:54.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00ae59c700 1 -- 172.21.15.81:0/2278430229 learned_addr learned my addr 172.21.15.81:0/2278430229 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:54.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00ae59c700 1 -- 172.21.15.81:0/2278430229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b01583b0 msgr2=0x7f00b00cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:54.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00ae59c700 1 --2- 172.21.15.81:0/2278430229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b01583b0 0x7f00b00cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00ae59c700 1 -- 172.21.15.81:0/2278430229 >> v1:172.21.15.89:6789/0 conn(0x7f00b0157fe0 legacy=0x7f00b00b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:54.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00ae59c700 1 -- 172.21.15.81:0/2278430229 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b00b4630 con 0x7f00b00b3bd0 2023-10-07T08:54:54.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00ae59c700 1 --2- 172.21.15.81:0/2278430229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b00b3bd0 0x7f00b00ceb30 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f00a40099b0 tx=0x7f00a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53d45a41e5ccaaf server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:54.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00add9b700 1 -- 172.21.15.81:0/2278430229 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a400b820 con 0x7f00b00b3bd0 2023-10-07T08:54:54.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00add9b700 1 -- 172.21.15.81:0/2278430229 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a400b980 con 0x7f00b00b3bd0 2023-10-07T08:54:54.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.412+0000 7f00add9b700 1 -- 172.21.15.81:0/2278430229 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a400bd20 con 0x7f00b00b3bd0 2023-10-07T08:54:54.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.413+0000 7f00b511f700 1 -- 172.21.15.81:0/2278430229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b00b3bd0 msgr2=0x7f00b00ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.413+0000 7f00b511f700 1 --2- 172.21.15.81:0/2278430229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b00b3bd0 0x7f00b00ceb30 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f00a40099b0 tx=0x7f00a4009250 comp rx=0 tx=0).stop 2023-10-07T08:54:54.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.413+0000 7f00b511f700 1 -- 172.21.15.81:0/2278430229 shutdown_connections 2023-10-07T08:54:54.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.413+0000 7f00b511f700 1 --2- 172.21.15.81:0/2278430229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b01583b0 0x7f00b00cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.413+0000 7f00b511f700 1 --2- 172.21.15.81:0/2278430229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b00b3bd0 0x7f00b00ceb30 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.413+0000 7f00b511f700 1 -- 172.21.15.81:0/2278430229 >> 172.21.15.81:0/2278430229 conn(0x7f00b0067640 msgr2=0x7f00b0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:54.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.413+0000 7f00b511f700 1 -- 172.21.15.81:0/2278430229 shutdown_connections 2023-10-07T08:54:54.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.413+0000 7f00b511f700 1 -- 172.21.15.81:0/2278430229 wait complete. 2023-10-07T08:54:54.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.414+0000 7f00b511f700 1 Processor -- start 2023-10-07T08:54:54.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.414+0000 7f00b511f700 1 -- start start 2023-10-07T08:54:54.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00b511f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00b00b3bd0 0x7f00b014c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00b511f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b0157fe0 0x7f00b015c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00b511f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b01583b0 0x7f00b014b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00b511f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b015d670 con 0x7f00b01583b0 2023-10-07T08:54:54.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00b511f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b015cb40 con 0x7f00b00b3bd0 2023-10-07T08:54:54.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00b511f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b015cdd0 con 0x7f00b0157fe0 2023-10-07T08:54:54.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00af59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b01583b0 0x7f00b014b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00af59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b01583b0 0x7f00b014b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38224/0 (socket says 172.21.15.81:38224) 2023-10-07T08:54:54.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00af59e700 1 -- 172.21.15.81:0/3659255945 learned_addr learned my addr 172.21.15.81:0/3659255945 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:54.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00ae59c700 1 --2- 172.21.15.81:0/3659255945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b0157fe0 0x7f00b015c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00aed9d700 1 --2- 172.21.15.81:0/3659255945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00b00b3bd0 0x7f00b014c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00af59e700 1 -- 172.21.15.81:0/3659255945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b0157fe0 msgr2=0x7f00b015c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00af59e700 1 --2- 172.21.15.81:0/3659255945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b0157fe0 0x7f00b015c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00af59e700 1 -- 172.21.15.81:0/3659255945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00b00b3bd0 msgr2=0x7f00b014c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00af59e700 1 --2- 172.21.15.81:0/3659255945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00b00b3bd0 0x7f00b014c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00af59e700 1 -- 172.21.15.81:0/3659255945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a40094f0 con 0x7f00b01583b0 2023-10-07T08:54:54.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00af59e700 1 --2- 172.21.15.81:0/3659255945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b01583b0 0x7f00b014b6a0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f00a800bc30 tx=0x7f00a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:54.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f0096ffd700 1 -- 172.21.15.81:0/3659255945 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a80092e0 con 0x7f00b01583b0 2023-10-07T08:54:54.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f0096ffd700 1 -- 172.21.15.81:0/3659255945 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a800c7a0 con 0x7f00b01583b0 2023-10-07T08:54:54.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f0096ffd700 1 -- 172.21.15.81:0/3659255945 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a800cb80 con 0x7f00b01583b0 2023-10-07T08:54:54.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00b511f700 1 -- 172.21.15.81:0/3659255945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b015d0b0 con 0x7f00b01583b0 2023-10-07T08:54:54.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.415+0000 7f00b511f700 1 -- 172.21.15.81:0/3659255945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b015a1c0 con 0x7f00b01583b0 2023-10-07T08:54:54.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.416+0000 7f00b511f700 1 -- 172.21.15.81:0/3659255945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b015a020 con 0x7f00b01583b0 2023-10-07T08:54:54.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.417+0000 7f0096ffd700 1 -- 172.21.15.81:0/3659255945 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00a8012070 con 0x7f00b01583b0 2023-10-07T08:54:54.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.417+0000 7f0096ffd700 1 --2- 172.21.15.81:0/3659255945 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f009c066f30 0x7f009c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.417+0000 7f00aed9d700 1 --2- 172.21.15.81:0/3659255945 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f009c066f30 0x7f009c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.417+0000 7f0096ffd700 1 -- 172.21.15.81:0/3659255945 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f00a8083ef0 con 0x7f00b01583b0 2023-10-07T08:54:54.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.418+0000 7f00aed9d700 1 --2- 172.21.15.81:0/3659255945 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f009c066f30 0x7f009c0693e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f00a0006fd0 tx=0x7f00a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:54.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.421+0000 7f0096ffd700 1 -- 172.21.15.81:0/3659255945 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00b015a020 con 0x7f00b01583b0 2023-10-07T08:54:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.602+0000 7f00b511f700 1 -- 172.21.15.81:0/3659255945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f00b015a020 con 0x7f00b01583b0 2023-10-07T08:54:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.606+0000 7f0096ffd700 1 -- 172.21.15.81:0/3659255945 <== mon.0 v2:172.21.15.81:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f00a8051460 con 0x7f00b01583b0 2023-10-07T08:54:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.606+0000 7f0096ffd700 1 -- 172.21.15.81:0/3659255945 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f00b015a020 con 0x7f00b01583b0 2023-10-07T08:54:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.608+0000 7f00b511f700 1 -- 172.21.15.81:0/3659255945 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f009c066f30 msgr2=0x7f009c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.608+0000 7f00b511f700 1 --2- 172.21.15.81:0/3659255945 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f009c066f30 0x7f009c0693e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f00a0006fd0 tx=0x7f00a0008040 comp rx=0 tx=0).stop 2023-10-07T08:54:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.608+0000 7f00b511f700 1 -- 172.21.15.81:0/3659255945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b01583b0 msgr2=0x7f00b014b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.608+0000 7f00b511f700 1 --2- 172.21.15.81:0/3659255945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b01583b0 0x7f00b014b6a0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f00a800bc30 tx=0x7f00a8009840 comp rx=0 tx=0).stop 2023-10-07T08:54:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.608+0000 7f00b511f700 1 -- 172.21.15.81:0/3659255945 shutdown_connections 2023-10-07T08:54:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.608+0000 7f00b511f700 1 --2- 172.21.15.81:0/3659255945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b01583b0 0x7f00b014b6a0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.608+0000 7f00b511f700 1 --2- 172.21.15.81:0/3659255945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00b00b3bd0 0x7f00b014c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.608+0000 7f00b511f700 1 --2- 172.21.15.81:0/3659255945 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f009c066f30 0x7f009c0693e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.608+0000 7f00b511f700 1 --2- 172.21.15.81:0/3659255945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b0157fe0 0x7f00b015c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.608+0000 7f00b511f700 1 -- 172.21.15.81:0/3659255945 >> 172.21.15.81:0/3659255945 conn(0x7f00b0067640 msgr2=0x7f00b0155630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:54.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.609+0000 7f00b511f700 1 -- 172.21.15.81:0/3659255945 shutdown_connections 2023-10-07T08:54:54.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.609+0000 7f00b511f700 1 -- 172.21.15.81:0/3659255945 wait complete. 2023-10-07T08:54:54.622 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-07T08:54:54.622 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-07T08:54:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.735+0000 7f07cc71e700 1 Processor -- start 2023-10-07T08:54:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.735+0000 7f07cc71e700 1 -- start start 2023-10-07T08:54:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07cc71e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07c41578d0 0x7f07c40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07cc71e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f07c406d120 0x7f07c406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07cc71e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c40d07c0 con 0x7f07c4157ca0 2023-10-07T08:54:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07cc71e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c406da50 con 0x7f07c41578d0 2023-10-07T08:54:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07cc71e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c40cfbb0 con 0x7f07c406d120 2023-10-07T08:54:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07ca4ba700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07c41578d0 0x7f07c40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07c9cb9700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f07c4157ca0 0x7f07c415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34060/0 (socket says 172.21.15.81:34060) 2023-10-07T08:54:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07c9cb9700 1 -- 172.21.15.81:0/2411219505 learned_addr learned my addr 172.21.15.81:0/2411219505 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-10-07T08:54:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07cacbb700 1 --2- 172.21.15.81:0/2411219505 >> v2:172.21.15.89:3300/0 conn(0x7f07c406d120 0x7f07c406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07ca4ba700 1 -- 172.21.15.81:0/2411219505 >> v2:172.21.15.89:3300/0 conn(0x7f07c406d120 msgr2=0x7f07c406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-07T08:54:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07ca4ba700 1 --2- 172.21.15.81:0/2411219505 >> v2:172.21.15.89:3300/0 conn(0x7f07c406d120 0x7f07c406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07ca4ba700 1 -- 172.21.15.81:0/2411219505 >> v1:172.21.15.81:6789/0 conn(0x7f07c4157ca0 legacy=0x7f07c415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07ca4ba700 1 -- 172.21.15.81:0/2411219505 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c40cfe90 con 0x7f07c41578d0 2023-10-07T08:54:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07c94b8700 1 -- 172.21.15.81:0/2411219505 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031554878 0 0) 0x7f07c40d07c0 con 0x7f07c4157ca0 2023-10-07T08:54:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07ca4ba700 1 --2- 172.21.15.81:0/2411219505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c41578d0 0x7f07c40cf4f0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f07c4068300 tx=0x7f07bc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2537d33a54d11d server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07c94b8700 1 -- 172.21.15.81:0/2411219505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc00e070 con 0x7f07c41578d0 2023-10-07T08:54:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.736+0000 7f07c94b8700 1 -- 172.21.15.81:0/2411219505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f07bc00bc30 con 0x7f07c41578d0 2023-10-07T08:54:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.737+0000 7f07c94b8700 1 -- 172.21.15.81:0/2411219505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc012430 con 0x7f07c41578d0 2023-10-07T08:54:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.737+0000 7f07cc71e700 1 -- 172.21.15.81:0/2411219505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c41578d0 msgr2=0x7f07c40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.737+0000 7f07cc71e700 1 --2- 172.21.15.81:0/2411219505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c41578d0 0x7f07c40cf4f0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f07c4068300 tx=0x7f07bc009780 comp rx=0 tx=0).stop 2023-10-07T08:54:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.737+0000 7f07cc71e700 1 -- 172.21.15.81:0/2411219505 shutdown_connections 2023-10-07T08:54:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.737+0000 7f07cc71e700 1 --2- 172.21.15.81:0/2411219505 >> v2:172.21.15.89:3300/0 conn(0x7f07c406d120 0x7f07c406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.737+0000 7f07cc71e700 1 --2- 172.21.15.81:0/2411219505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c41578d0 0x7f07c40cf4f0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.737+0000 7f07cc71e700 1 -- 172.21.15.81:0/2411219505 >> 172.21.15.81:0/2411219505 conn(0x7f07c406bb90 msgr2=0x7f07c406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.737+0000 7f07cc71e700 1 -- 172.21.15.81:0/2411219505 shutdown_connections 2023-10-07T08:54:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.737+0000 7f07cc71e700 1 -- 172.21.15.81:0/2411219505 wait complete. 2023-10-07T08:54:54.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.738+0000 7f07cc71e700 1 Processor -- start 2023-10-07T08:54:54.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.738+0000 7f07cc71e700 1 -- start start 2023-10-07T08:54:54.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.739+0000 7f07cc71e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c406d120 0x7f07c40af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.739+0000 7f07cc71e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c41578d0 0x7f07c41595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.739+0000 7f07cc71e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c4157ca0 0x7f07c4159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.739+0000 7f07cc71e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40b1d70 con 0x7f07c41578d0 2023-10-07T08:54:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.739+0000 7f07cc71e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40b2050 con 0x7f07c406d120 2023-10-07T08:54:54.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.739+0000 7f07cc71e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40b2330 con 0x7f07c4157ca0 2023-10-07T08:54:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.739+0000 7f07c9cb9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c41578d0 0x7f07c41595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.739+0000 7f07c9cb9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c41578d0 0x7f07c41595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38250/0 (socket says 172.21.15.81:38250) 2023-10-07T08:54:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.739+0000 7f07c9cb9700 1 -- 172.21.15.81:0/912340387 learned_addr learned my addr 172.21.15.81:0/912340387 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-07T08:54:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.739+0000 7f07ca4ba700 1 --2- 172.21.15.81:0/912340387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c406d120 0x7f07c40af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.739+0000 7f07cacbb700 1 --2- 172.21.15.81:0/912340387 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c4157ca0 0x7f07c4159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.739+0000 7f07c9cb9700 1 -- 172.21.15.81:0/912340387 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c4157ca0 msgr2=0x7f07c4159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.739+0000 7f07c9cb9700 1 --2- 172.21.15.81:0/912340387 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c4157ca0 0x7f07c4159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.739+0000 7f07c9cb9700 1 -- 172.21.15.81:0/912340387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c406d120 msgr2=0x7f07c40af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.739+0000 7f07c9cb9700 1 --2- 172.21.15.81:0/912340387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c406d120 0x7f07c40af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.739+0000 7f07c9cb9700 1 -- 172.21.15.81:0/912340387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc009a20 con 0x7f07c41578d0 2023-10-07T08:54:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.740+0000 7f07c9cb9700 1 --2- 172.21.15.81:0/912340387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c41578d0 0x7f07c41595e0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f07b800c810 tx=0x7f07b8007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.740+0000 7f07c27fc700 1 -- 172.21.15.81:0/912340387 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8005c00 con 0x7f07c41578d0 2023-10-07T08:54:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.740+0000 7f07c27fc700 1 -- 172.21.15.81:0/912340387 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f07b8005d60 con 0x7f07c41578d0 2023-10-07T08:54:54.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.740+0000 7f07cc71e700 1 -- 172.21.15.81:0/912340387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c40b2610 con 0x7f07c41578d0 2023-10-07T08:54:54.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.740+0000 7f07c27fc700 1 -- 172.21.15.81:0/912340387 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8007320 con 0x7f07c41578d0 2023-10-07T08:54:54.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.740+0000 7f07cc71e700 1 -- 172.21.15.81:0/912340387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c40b0ff0 con 0x7f07c41578d0 2023-10-07T08:54:54.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.741+0000 7f07cc71e700 1 -- 172.21.15.81:0/912340387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c4067ac0 con 0x7f07c41578d0 2023-10-07T08:54:54.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.741+0000 7f07c27fc700 1 -- 172.21.15.81:0/912340387 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07b801b3b0 con 0x7f07c41578d0 2023-10-07T08:54:54.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.741+0000 7f07c27fc700 1 --2- 172.21.15.81:0/912340387 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f07b0066f30 0x7f07b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-07T08:54:54.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.741+0000 7f07c27fc700 1 -- 172.21.15.81:0/912340387 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f07b8083770 con 0x7f07c41578d0 2023-10-07T08:54:54.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.742+0000 7f07ca4ba700 1 --2- 172.21.15.81:0/912340387 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f07b0066f30 0x7f07b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-07T08:54:54.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.742+0000 7f07ca4ba700 1 --2- 172.21.15.81:0/912340387 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f07b0066f30 0x7f07b00693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f07c4068300 tx=0x7f07bc009780 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-07T08:54:54.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.747+0000 7f07c27fc700 1 -- 172.21.15.81:0/912340387 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07b8050cc0 con 0x7f07c41578d0 2023-10-07T08:54:54.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.967+0000 7f07cc71e700 1 -- 172.21.15.81:0/912340387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07c40d0170 con 0x7f07c41578d0 2023-10-07T08:54:54.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.968+0000 7f07c27fc700 1 -- 172.21.15.81:0/912340387 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f07b8017de0 con 0x7f07c41578d0 2023-10-07T08:54:54.971 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-07T08:54:54.971 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":92,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1601080758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1601080758},{"type":"v1","addr":"172.21.15.81:6837","nonce":1601080758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2709611313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":2709611313},{"type":"v1","addr":"172.21.15.89:6835","nonce":2709611313}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/3085029167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3085029167},{"type":"v1","addr":"172.21.15.89:6834","nonce":3085029167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":8481,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3233438900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3233438900},{"type":"v1","addr":"172.21.15.81:6836","nonce":3233438900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[]} 2023-10-07T08:54:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.970+0000 7f07cc71e700 1 -- 172.21.15.81:0/912340387 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f07b0066f30 msgr2=0x7f07b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.970+0000 7f07cc71e700 1 --2- 172.21.15.81:0/912340387 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f07b0066f30 0x7f07b00693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f07c4068300 tx=0x7f07bc009780 comp rx=0 tx=0).stop 2023-10-07T08:54:54.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.970+0000 7f07cc71e700 1 -- 172.21.15.81:0/912340387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c41578d0 msgr2=0x7f07c41595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-07T08:54:54.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.970+0000 7f07cc71e700 1 --2- 172.21.15.81:0/912340387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c41578d0 0x7f07c41595e0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f07b800c810 tx=0x7f07b8007db0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.970+0000 7f07cc71e700 1 -- 172.21.15.81:0/912340387 shutdown_connections 2023-10-07T08:54:54.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.970+0000 7f07cc71e700 1 --2- 172.21.15.81:0/912340387 >> [v2:172.21.15.81:6832/86101,v1:172.21.15.81:6833/86101] conn(0x7f07b0066f30 0x7f07b00693e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.970+0000 7f07cc71e700 1 --2- 172.21.15.81:0/912340387 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c4157ca0 0x7f07c4159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.970+0000 7f07cc71e700 1 --2- 172.21.15.81:0/912340387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c406d120 0x7f07c40af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.970+0000 7f07cc71e700 1 --2- 172.21.15.81:0/912340387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c41578d0 0x7f07c41595e0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-07T08:54:54.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.970+0000 7f07cc71e700 1 -- 172.21.15.81:0/912340387 >> 172.21.15.81:0/912340387 conn(0x7f07c406bb90 msgr2=0x7f07c406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-07T08:54:54.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.970+0000 7f07cc71e700 1 -- 172.21.15.81:0/912340387 shutdown_connections 2023-10-07T08:54:54.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-07T08:54:54.970+0000 7f07cc71e700 1 -- 172.21.15.81:0/912340387 wait complete. 2023-10-07T08:54:54.975 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 92 2023-10-07T08:54:54.983 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-07T08:54:54.983 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-07T08:54:54.984 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-07T08:54:54.984 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:54.992 INFO:tasks.ceph.mds.a:Stopped 2023-10-07T08:54:54.992 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-07T08:54:54.992 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:55.040 INFO:tasks.ceph.mds.c:Stopped 2023-10-07T08:54:55.040 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-07T08:54:55.041 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:55.051 INFO:tasks.ceph.mds.b:Stopped 2023-10-07T08:54:55.051 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-07T08:54:55.052 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:55.101 INFO:tasks.ceph.mds.d:Stopped 2023-10-07T08:54:55.102 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-07T08:54:55.103 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-07T08:54:55.103 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:55.123 INFO:tasks.ceph.osd.0:Stopped 2023-10-07T08:54:55.123 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-07T08:54:55.123 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:55.187 INFO:tasks.ceph.osd.1:Stopped 2023-10-07T08:54:55.187 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-07T08:54:55.187 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:55.252 INFO:tasks.ceph.osd.2:Stopped 2023-10-07T08:54:55.253 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-07T08:54:55.253 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:55.312 INFO:tasks.ceph.osd.3:Stopped 2023-10-07T08:54:55.312 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-07T08:54:55.312 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:55.333 INFO:tasks.ceph.osd.4:Stopped 2023-10-07T08:54:55.333 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-07T08:54:55.333 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:55.392 INFO:tasks.ceph.osd.5:Stopped 2023-10-07T08:54:55.392 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-07T08:54:55.392 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:55.456 INFO:tasks.ceph.osd.6:Stopped 2023-10-07T08:54:55.456 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-07T08:54:55.456 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:55.516 INFO:tasks.ceph.osd.7:Stopped 2023-10-07T08:54:55.517 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-07T08:54:55.517 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-07T08:54:55.517 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:55.541 INFO:tasks.ceph.mgr.y:Stopped 2023-10-07T08:54:55.541 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-07T08:54:55.542 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:55.580 INFO:tasks.ceph.mgr.x:Stopped 2023-10-07T08:54:55.580 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-07T08:54:55.580 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-07T08:54:55.580 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:55.592 INFO:tasks.ceph.mon.a:Stopped 2023-10-07T08:54:55.592 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-07T08:54:55.592 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:55.631 INFO:tasks.ceph.mon.b:Stopped 2023-10-07T08:54:55.631 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-07T08:54:55.631 INFO:teuthology.orchestra.run:waiting for 300 2023-10-07T08:54:55.682 INFO:tasks.ceph.mon.c:Stopped 2023-10-07T08:54:55.682 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-07T08:54:55.682 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-07T08:54:55.712 INFO:teuthology.orchestra.run.smithi081.stdout:1696668163.2975094 osd.6 (osd.6) 3 : cluster [WRN] OSD bench result of 241453.647540 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.6. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-10-07T08:54:55.712 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-07T08:54:55.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-07T08:54:55.781 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-07T08:54:55.851 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-07T08:54:55.921 INFO:teuthology.orchestra.run.smithi081.stdout:1696668163.2975094 osd.6 (osd.6) 3 : cluster [WRN] OSD bench result of 241453.647540 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.6. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-10-07T08:54:55.921 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:54:55.921 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-07T08:54:56.110 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:54:56.110 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-07T08:54:56.240 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:54:56.240 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-07T08:54:56.293 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:54:56.293 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-07T08:54:56.356 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:54:56.356 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-07T08:54:56.547 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:54:56.547 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-07T08:54:56.625 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:54:56.625 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-07T08:54:56.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:54:56.638 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:54:56.692 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:54:56.693 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-07T08:54:56.803 INFO:tasks.ceph:Archiving mon data... 2023-10-07T08:54:56.805 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273/data/mon.a.tgz 2023-10-07T08:54:56.805 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2023-10-07T08:54:56.820 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.8GfAYpdxU5 2023-10-07T08:54:56.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.8GfAYpdxU5 2023-10-07T08:54:56.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.8GfAYpdxU5 2023-10-07T08:54:57.064 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.8GfAYpdxU5 is 393KB 2023-10-07T08:54:57.160 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.8GfAYpdxU5 2023-10-07T08:54:57.174 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273/data/mon.b.tgz 2023-10-07T08:54:57.174 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-10-07T08:54:57.189 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.PAn258ep6K 2023-10-07T08:54:57.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.PAn258ep6K 2023-10-07T08:54:57.331 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.PAn258ep6K 2023-10-07T08:54:57.412 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.PAn258ep6K is 398KB 2023-10-07T08:54:57.509 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.PAn258ep6K 2023-10-07T08:54:57.523 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273/data/mon.c.tgz 2023-10-07T08:54:57.523 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-10-07T08:54:57.577 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.AHnkaGvBBG 2023-10-07T08:54:57.577 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.AHnkaGvBBG 2023-10-07T08:54:57.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.AHnkaGvBBG 2023-10-07T08:54:57.793 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.AHnkaGvBBG is 398KB 2023-10-07T08:54:57.889 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.AHnkaGvBBG 2023-10-07T08:54:57.903 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-07T08:54:57.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-07T08:54:57.905 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-07T08:54:57.966 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-07T08:54:57.966 DEBUG:teuthology.orchestra.run.smithi081:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-07T08:54:57.970 DEBUG:teuthology.orchestra.run.smithi089:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-07T08:54:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-07T08:54:58.031 INFO:teuthology.orchestra.run.smithi089.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-07T08:54:58.037 INFO:tasks.ceph:Archiving crash dumps... 2023-10-07T08:54:58.039 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273/remote/smithi081/crash 2023-10-07T08:54:58.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-07T08:54:58.064 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273/remote/smithi089/crash 2023-10-07T08:54:58.065 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-07T08:54:58.101 INFO:tasks.ceph:Shutting down logrotate 2023-10-07T08:54:58.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:54:58.108 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-07T08:54:58.194 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-07T08:54:58.219 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-07T08:54:58.243 INFO:tasks.ceph:Compressing logs... 2023-10-07T08:54:58.244 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-07T08:54:58.261 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-07T08:54:58.341 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89395.log 2023-10-07T08:54:58.342 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89792.log 2023-10-07T08:54:58.342 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.89395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.87743.log 2023-10-07T08:54:58.342 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89395.log.gz 2023-10-07T08:54:58.342 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.89792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90920.log 2023-10-07T08:54:58.342 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89792.log.gz 2023-10-07T08:54:58.342 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.3.87743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86275.log 2023-10-07T08:54:58.342 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.87743.log.gz 2023-10-07T08:54:58.342 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.90920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.87739.log 2023-10-07T08:54:58.342 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90920.log.gz 2023-10-07T08:54:58.343 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.86275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86401.log 2023-10-07T08:54:58.343 INFO:teuthology.orchestra.run.smithi089.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.86275.log.gz 2023-10-07T08:54:58.343 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.3.87739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90155.log 2023-10-07T08:54:58.343 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.87739.log.gz 2023-10-07T08:54:58.343 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.86401.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-07T08:54:58.343 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.90155.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.86401.log.gz 2023-10-07T08:54:58.343 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91823.log 2023-10-07T08:54:58.343 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90155.log.gz 2023-10-07T08:54:58.343 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91378.log 2023-10-07T08:54:58.343 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.91823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90524.log 2023-10-07T08:54:58.343 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91823.log.gz 2023-10-07T08:54:58.343 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.91378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88969.log 2023-10-07T08:54:58.343 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91378.log.gz 2023-10-07T08:54:58.344 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.90524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86188.log 2023-10-07T08:54:58.344 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90524.log.gz 2023-10-07T08:54:58.344 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.88969.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-07T08:54:58.344 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88969.log.gz 2023-10-07T08:54:58.344 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.86188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.87372.log 2023-10-07T08:54:58.344 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-07T08:54:58.344 INFO:teuthology.orchestra.run.smithi089.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86188.log.gz 2023-10-07T08:54:58.344 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.87372.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.1.87372.log.gz/var/log/ceph/ceph-client.admin.86442.log 2023-10-07T08:54:58.344 INFO:teuthology.orchestra.run.smithi089.stderr: 2023-10-07T08:54:58.344 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90916.log 2023-10-07T08:54:58.344 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.86442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89391.log 2023-10-07T08:54:58.345 INFO:teuthology.orchestra.run.smithi089.stderr: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-07T08:54:58.345 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86442.log.gz 2023-10-07T08:54:58.345 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.90916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86318.log 2023-10-07T08:54:58.345 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90916.log.gz 2023-10-07T08:54:58.345 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-07T08:54:58.345 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.89391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89391.log.gz 2023-10-07T08:54:58.345 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.86318.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-07T08:54:58.345 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86318.log.gz 2023-10-07T08:54:58.345 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-07T08:54:58.345 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88593.log 2023-10-07T08:54:58.345 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86360.log 2023-10-07T08:54:58.345 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.88593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88593.log.gz 2023-10-07T08:54:58.346 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.86360.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86360.log.gz 2023-10-07T08:54:58.346 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89788.log 2023-10-07T08:54:58.346 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-07T08:54:58.346 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.89788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90528.log 2023-10-07T08:54:58.346 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89788.log.gz 2023-10-07T08:54:58.346 INFO:teuthology.orchestra.run.smithi089.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-07T08:54:58.346 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-07T08:54:58.346 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.87381.log 2023-10-07T08:54:58.346 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.90528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90528.log.gz 2023-10-07T08:54:58.347 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88965.log 2023-10-07T08:54:58.347 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.87381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.87381.log.gz 2023-10-07T08:54:58.347 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91374.log 2023-10-07T08:54:58.347 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.88965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88965.log.gz 2023-10-07T08:54:58.347 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.91374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91374.log.gz 2023-10-07T08:54:58.347 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-07T08:54:58.347 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-07T08:54:58.347 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-osd.5.log: 94.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-07T08:54:58.347 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86146.log 2023-10-07T08:54:58.347 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.86146.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86146.log.gz 2023-10-07T08:54:58.347 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86231.log 2023-10-07T08:54:58.347 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.86231.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.86231.log.gz 2023-10-07T08:54:58.348 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91819.log 2023-10-07T08:54:58.348 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.91819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91819.log.gz 2023-10-07T08:54:58.348 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90151.log 2023-10-07T08:54:58.348 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.90151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90151.log.gz 2023-10-07T08:54:58.348 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-07T08:54:58.348 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88150.log 2023-10-07T08:54:58.357 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.88150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88150.log.gz 2023-10-07T08:54:58.364 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88597.log 2023-10-07T08:54:58.372 INFO:teuthology.orchestra.run.smithi089.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-07T08:54:58.372 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.88597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88597.log.gz 2023-10-07T08:54:58.373 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88146.log 2023-10-07T08:54:58.373 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.88146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88146.log.gz 2023-10-07T08:54:58.389 INFO:teuthology.orchestra.run.smithi089.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-07T08:54:58.487 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89476.log 2023-10-07T08:54:58.487 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110993.log 2023-10-07T08:54:58.487 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.89476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117482.log 2023-10-07T08:54:58.487 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89476.log.gz 2023-10-07T08:54:58.487 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96261.log 2023-10-07T08:54:58.487 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110993.log.gz 2023-10-07T08:54:58.487 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96711.log 2023-10-07T08:54:58.488 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.96261.log: gzip 88.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.117482.log.gz--verbose 2023-10-07T08:54:58.488 INFO:teuthology.orchestra.run.smithi081.stderr:-- /var/log/ceph/ceph-client.admin.88431.log 2023-10-07T08:54:58.488 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6%/var/log/ceph/ceph-client.admin.96711.log: -- replaced with /var/log/ceph/ceph-client.admin.96261.log.gz 2023-10-07T08:54:58.488 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94206.log 2023-10-07T08:54:58.488 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4%/var/log/ceph/ceph-client.admin.88431.log: -- replaced with /var/log/ceph/ceph-client.admin.96711.log.gz 2023-10-07T08:54:58.488 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86596.log 2023-10-07T08:54:58.488 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99404.log 2023-10-07T08:54:58.488 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88431.log.gz 2023-10-07T08:54:58.488 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94206.log.gz 2023-10-07T08:54:58.488 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.86596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107332.log 2023-10-07T08:54:58.488 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99404.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.86596.log.gz 2023-10-07T08:54:58.489 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99614.log 2023-10-07T08:54:58.489 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99404.log.gz/var/log/ceph/ceph-client.admin.107332.log: 2023-10-07T08:54:58.489 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92732.log 2023-10-07T08:54:58.489 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99614.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107332.log.gz 2023-10-07T08:54:58.489 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87011.log 2023-10-07T08:54:58.489 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92732.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.99614.log.gz 2023-10-07T08:54:58.489 INFO:teuthology.orchestra.run.smithi081.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.102523.log 2023-10-07T08:54:58.489 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87011.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92732.log.gz 2023-10-07T08:54:58.489 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90721.log 2023-10-07T08:54:58.489 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118005.log 2023-10-07T08:54:58.489 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.87011.log.gz 2023-10-07T08:54:58.489 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102523.log.gz 2023-10-07T08:54:58.490 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.90721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104004.log 2023-10-07T08:54:58.490 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0%/var/log/ceph/ceph-client.admin.118005.log: -- replaced with /var/log/ceph/ceph-client.admin.90721.log.gz 2023-10-07T08:54:58.490 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96219.log 2023-10-07T08:54:58.490 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92478.log 2023-10-07T08:54:58.490 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118005.log.gz 2023-10-07T08:54:58.490 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89182.log 2023-10-07T08:54:58.490 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.96219.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104004.log.gz 2023-10-07T08:54:58.490 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111358.log 2023-10-07T08:54:58.490 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96219.log.gz 2023-10-07T08:54:58.490 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.89182.log: gzip 88.7%-5 -- replaced with /var/log/ceph/ceph-client.admin.92478.log.gz--verbose 2023-10-07T08:54:58.490 INFO:teuthology.orchestra.run.smithi081.stderr:-- /var/log/ceph/ceph-client.admin.101306.log 2023-10-07T08:54:58.491 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111358.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.89182.log.gz 2023-10-07T08:54:58.491 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96669.log 2023-10-07T08:54:58.491 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.111358.log.gz 2023-10-07T08:54:58.491 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.101306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111316.log 2023-10-07T08:54:58.491 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.96669.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101306.log.gz 2023-10-07T08:54:58.491 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104641.log 2023-10-07T08:54:58.491 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111316.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96669.log.gz 2023-10-07T08:54:58.491 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108338.log 2023-10-07T08:54:58.491 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104641.log: gzip -5 89.2%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.111316.log.gz/var/log/ceph/ceph-client.admin.104557.log 2023-10-07T08:54:58.491 INFO:teuthology.orchestra.run.smithi081.stderr: 2023-10-07T08:54:58.491 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108338.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104641.log.gz 2023-10-07T08:54:58.492 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107374.log 2023-10-07T08:54:58.492 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108338.log.gz 2023-10-07T08:54:58.492 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103657.log 2023-10-07T08:54:58.492 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94802.log 2023-10-07T08:54:58.492 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104557.log.gz 2023-10-07T08:54:58.492 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107374.log.gz 2023-10-07T08:54:58.492 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.103657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112691.log 2023-10-07T08:54:58.492 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103657.log.gz 2023-10-07T08:54:58.492 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104515.log 2023-10-07T08:54:58.492 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106586.log 2023-10-07T08:54:58.492 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94802.log.gz 2023-10-07T08:54:58.492 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93848.log 2023-10-07T08:54:58.493 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112691.log.gz 2023-10-07T08:54:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.106586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117963.log 2023-10-07T08:54:58.493 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104515.log.gz 2023-10-07T08:54:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115048.log 2023-10-07T08:54:58.493 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106586.log.gz 2023-10-07T08:54:58.493 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93848.log.gz 2023-10-07T08:54:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115174.log 2023-10-07T08:54:58.493 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117963.log.gz 2023-10-07T08:54:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100943.log 2023-10-07T08:54:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91074.log 2023-10-07T08:54:58.493 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115048.log.gz 2023-10-07T08:54:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100424.log 2023-10-07T08:54:58.494 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.115174.log.gz 2023-10-07T08:54:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91242.log 2023-10-07T08:54:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100424.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91074.log.gz 2023-10-07T08:54:58.494 INFO:teuthology.orchestra.run.smithi081.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.100943.log.gz 2023-10-07T08:54:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99488.log 2023-10-07T08:54:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91242.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100424.log.gz 2023-10-07T08:54:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92604.log 2023-10-07T08:54:58.494 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91242.log.gz 2023-10-07T08:54:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112817.log 2023-10-07T08:54:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92604.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99488.log.gz 2023-10-07T08:54:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87670.log 2023-10-07T08:54:58.494 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92604.log.gz 2023-10-07T08:54:58.495 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95814.log 2023-10-07T08:54:58.495 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.90554.log 2023-10-07T08:54:58.495 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112817.log.gz 2023-10-07T08:54:58.495 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102439.log 2023-10-07T08:54:58.495 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87670.log.gz 2023-10-07T08:54:58.495 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.2.90554.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95814.log.gz 2023-10-07T08:54:58.495 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113046.log 2023-10-07T08:54:58.495 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.90554.log.gz 2023-10-07T08:54:58.495 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96174.log 2023-10-07T08:54:58.495 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118893.log 2023-10-07T08:54:58.495 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102439.log.gz 2023-10-07T08:54:58.496 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.96174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108032.log 2023-10-07T08:54:58.496 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113046.log.gz 2023-10-07T08:54:58.496 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96174.log.gz 2023-10-07T08:54:58.496 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117818.log 2023-10-07T08:54:58.496 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108032.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.118893.log.gz 2023-10-07T08:54:58.496 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106348.log 2023-10-07T08:54:58.496 INFO:teuthology.orchestra.run.smithi081.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.108032.log.gz 2023-10-07T08:54:58.496 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104911.log 2023-10-07T08:54:58.496 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.106348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105428.log 2023-10-07T08:54:58.496 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117818.log.gz 2023-10-07T08:54:58.496 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104911.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.106348.log.gz 2023-10-07T08:54:58.496 INFO:teuthology.orchestra.run.smithi081.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.111178.log 2023-10-07T08:54:58.497 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104911.log.gz 2023-10-07T08:54:58.497 INFO:teuthology.orchestra.run.smithi081.stderr:gzip /var/log/ceph/ceph-client.admin.105428.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.89350.log 2023-10-07T08:54:58.497 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105776.log 2023-10-07T08:54:58.497 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105428.log.gz 2023-10-07T08:54:58.497 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.89350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100380.log 2023-10-07T08:54:58.497 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111178.log.gz 2023-10-07T08:54:58.497 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89350.log.gz 2023-10-07T08:54:58.497 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98096.log 2023-10-07T08:54:58.497 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100380.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105776.log.gz 2023-10-07T08:54:58.497 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99759.log 2023-10-07T08:54:58.497 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.98096.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100380.log.gz 2023-10-07T08:54:58.497 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-07T08:54:58.498 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99759.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98096.log.gz 2023-10-07T08:54:58.498 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111266.log 2023-10-07T08:54:58.498 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mds.a.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99759.log.gz 2023-10-07T08:54:58.498 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99572.log 2023-10-07T08:54:58.498 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115132.log 2023-10-07T08:54:58.498 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111266.log.gz 2023-10-07T08:54:58.498 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90595.log 2023-10-07T08:54:58.498 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118641.log 2023-10-07T08:54:58.498 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99572.log.gz 2023-10-07T08:54:58.498 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.90595.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115132.log.gz 2023-10-07T08:54:58.498 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114003.log 2023-10-07T08:54:58.498 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118641.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.90595.log.gz 2023-10-07T08:54:58.499 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100212.log 2023-10-07T08:54:58.499 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114003.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118641.log.gz 2023-10-07T08:54:58.499 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96475.log 2023-10-07T08:54:58.499 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114003.log.gz 2023-10-07T08:54:58.499 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109328.log 2023-10-07T08:54:58.499 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100212.log.gz 2023-10-07T08:54:58.499 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.96475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109821.log 2023-10-07T08:54:58.499 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108560.log 2023-10-07T08:54:58.499 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96475.log.gz 2023-10-07T08:54:58.499 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109821.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109328.log.gz 2023-10-07T08:54:58.499 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98530.log 2023-10-07T08:54:58.500 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109821.log.gz 2023-10-07T08:54:58.500 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90847.log 2023-10-07T08:54:58.500 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.98530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112397.log 2023-10-07T08:54:58.500 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108560.log.gz 2023-10-07T08:54:58.500 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98530.log.gz 2023-10-07T08:54:58.500 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.90847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95688.log 2023-10-07T08:54:58.500 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90847.log.gz 2023-10-07T08:54:58.500 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98961.log 2023-10-07T08:54:58.500 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108730.log 2023-10-07T08:54:58.500 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112397.log.gz 2023-10-07T08:54:58.500 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95688.log.gz 2023-10-07T08:54:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.98961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92776.log 2023-10-07T08:54:58.501 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98961.log.gz 2023-10-07T08:54:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104996.log 2023-10-07T08:54:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108422.log 2023-10-07T08:54:58.501 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108730.log.gz 2023-10-07T08:54:58.501 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92776.log.gz 2023-10-07T08:54:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96517.log 2023-10-07T08:54:58.501 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104996.log.gz 2023-10-07T08:54:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115524.log 2023-10-07T08:54:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.96517.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108422.log.gz 2023-10-07T08:54:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111400.log 2023-10-07T08:54:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115524.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.96517.log.gz 2023-10-07T08:54:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112565.log 2023-10-07T08:54:58.502 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115524.log.gz 2023-10-07T08:54:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102259.log 2023-10-07T08:54:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110517.log 2023-10-07T08:54:58.502 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111400.log.gz 2023-10-07T08:54:58.502 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112565.log.gz 2023-10-07T08:54:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96627.log 2023-10-07T08:54:58.502 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102259.log.gz 2023-10-07T08:54:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104954.log 2023-10-07T08:54:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.96627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92646.log 2023-10-07T08:54:58.502 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.110517.log.gz 2023-10-07T08:54:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104954.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96627.log.gz 2023-10-07T08:54:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102321.log 2023-10-07T08:54:58.503 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104954.log.gz 2023-10-07T08:54:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97838.log 2023-10-07T08:54:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97408.log 2023-10-07T08:54:58.503 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92646.log.gz 2023-10-07T08:54:58.503 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102321.log.gz 2023-10-07T08:54:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105598.log 2023-10-07T08:54:58.503 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97838.log.gz 2023-10-07T08:54:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109779.log 2023-10-07T08:54:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98614.log 2023-10-07T08:54:58.503 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97408.log.gz 2023-10-07T08:54:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109779.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105598.log.gz 2023-10-07T08:54:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104240.log 2023-10-07T08:54:58.504 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109779.log.gz 2023-10-07T08:54:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.98614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95426.log 2023-10-07T08:54:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104240.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98614.log.gz 2023-10-07T08:54:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108172.log 2023-10-07T08:54:58.504 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104240.log.gz 2023-10-07T08:54:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91200.log 2023-10-07T08:54:58.504 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95426.log.gz 2023-10-07T08:54:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89266.log 2023-10-07T08:54:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91200.log: 88.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.108172.log.gz--verbose 2023-10-07T08:54:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:-- /var/log/ceph/ceph-client.admin.114712.log 2023-10-07T08:54:58.505 INFO:teuthology.orchestra.run.smithi081.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.91200.log.gz 2023-10-07T08:54:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.89266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111035.log 2023-10-07T08:54:58.505 INFO:teuthology.orchestra.run.smithi081.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.89266.log.gz 2023-10-07T08:54:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112775.log 2023-10-07T08:54:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111035.log: gzip -5 --verbose -- 88.9%/var/log/ceph/ceph-client.admin.105512.log 2023-10-07T08:54:58.505 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.114712.log.gz 2023-10-07T08:54:58.505 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111035.log.gz 2023-10-07T08:54:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116697.log 2023-10-07T08:54:58.505 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112775.log.gz 2023-10-07T08:54:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118809.log 2023-10-07T08:54:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89014.log 2023-10-07T08:54:58.505 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105512.log.gz 2023-10-07T08:54:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118809.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116697.log.gz 2023-10-07T08:54:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89308.log 2023-10-07T08:54:58.506 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118809.log.gz 2023-10-07T08:54:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.89014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92520.log 2023-10-07T08:54:58.506 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4%/var/log/ceph/ceph-client.admin.89308.log: -- replaced with /var/log/ceph/ceph-client.admin.89014.log.gz 2023-10-07T08:54:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106198.log 2023-10-07T08:54:58.506 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89308.log.gz 2023-10-07T08:54:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101758.log 2023-10-07T08:54:58.506 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92520.log.gz 2023-10-07T08:54:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.106198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91158.log 2023-10-07T08:54:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.101758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88767.log 88.7% 2023-10-07T08:54:58.506 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.106198.log.gz 2023-10-07T08:54:58.507 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101758.log.gz 2023-10-07T08:54:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100602.log 2023-10-07T08:54:58.507 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91158.log.gz 2023-10-07T08:54:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88765.log 2023-10-07T08:54:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95646.log 2023-10-07T08:54:58.507 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88767.log.gz 2023-10-07T08:54:58.507 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100602.log.gz 2023-10-07T08:54:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97138.log 2023-10-07T08:54:58.507 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88765.log.gz 2023-10-07T08:54:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88764.log 2023-10-07T08:54:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97138.log: 87.6%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.95646.log.gz--verbose 2023-10-07T08:54:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:-- /var/log/ceph/ceph-client.admin.117608.log 2023-10-07T08:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97138.log.gz 2023-10-07T08:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87578.log 2023-10-07T08:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88764.log.gz 2023-10-07T08:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113692.log 2023-10-07T08:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87578.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117608.log.gz 2023-10-07T08:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95915.log 2023-10-07T08:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87578.log.gz/var/log/ceph/ceph-client.admin.113692.log: 2023-10-07T08:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115300.log 2023-10-07T08:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95915.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113692.log.gz 2023-10-07T08:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103125.log 2023-10-07T08:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104473.log 2023-10-07T08:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115300.log.gz 2023-10-07T08:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.103125.log: gzip -5 91.2%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.95915.log.gz/var/log/ceph/ceph-client.admin.99003.log 2023-10-07T08:54:58.509 INFO:teuthology.orchestra.run.smithi081.stderr: 2023-10-07T08:54:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116040.log 2023-10-07T08:54:58.509 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8%/var/log/ceph/ceph-client.admin.104473.log: -- replaced with /var/log/ceph/ceph-client.admin.103125.log.gz 2023-10-07T08:54:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113478.log 2023-10-07T08:54:58.509 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104473.log.gz 2023-10-07T08:54:58.509 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99003.log.gz 2023-10-07T08:54:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116638.log 2023-10-07T08:54:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117440.log 2023-10-07T08:54:58.509 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.116040.log.gz 2023-10-07T08:54:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116638.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.113478.log.gz 2023-10-07T08:54:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100647.log 2023-10-07T08:54:58.509 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116638.log.gz 2023-10-07T08:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92562.log 2023-10-07T08:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104431.log 2023-10-07T08:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117440.log.gz 2023-10-07T08:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92562.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100647.log.gz 2023-10-07T08:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119186.log 2023-10-07T08:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.92562.log.gz 2023-10-07T08:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97698.log 2023-10-07T08:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.119186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101632.log 2023-10-07T08:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104431.log.gz 2023-10-07T08:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97698.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119186.log.gz 2023-10-07T08:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88097.log 2023-10-07T08:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97698.log.gz 2023-10-07T08:54:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.101632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88766.log 2023-10-07T08:54:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88097.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101632.log.gz 2023-10-07T08:54:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103268.log 2023-10-07T08:54:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88766.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88097.log.gz 2023-10-07T08:54:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100338.log 2023-10-07T08:54:58.511 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88766.log.gz 2023-10-07T08:54:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.103268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97928.log 2023-10-07T08:54:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100338.log: gzip -5 --verbose -- 87.5%/var/log/ceph/ceph-client.admin.95170.log 2023-10-07T08:54:58.511 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103268.log.gz 2023-10-07T08:54:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97928.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.100338.log.gz 2023-10-07T08:54:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91116.log 2023-10-07T08:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97928.log.gz 2023-10-07T08:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118599.log 2023-10-07T08:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91116.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95170.log.gz 2023-10-07T08:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-07T08:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118599.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.91116.log.gz 2023-10-07T08:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99927.log 2023-10-07T08:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118599.log.gz 2023-10-07T08:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89224.log 2023-10-07T08:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90150.log 2023-10-07T08:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.89224.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99927.log.gz 2023-10-07T08:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107033.log 2023-10-07T08:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89224.log.gz 2023-10-07T08:54:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.90150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110079.log 2023-10-07T08:54:58.513 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.90150.log.gz 2023-10-07T08:54:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92986.log 2023-10-07T08:54:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110289.log 2023-10-07T08:54:58.513 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107033.log.gz 2023-10-07T08:54:58.513 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110079.log.gz 2023-10-07T08:54:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117223.log 2023-10-07T08:54:58.513 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92986.log.gz 2023-10-07T08:54:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119146.log 2023-10-07T08:54:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110289.log: /var/log/ceph/ceph-client.admin.117223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95560.log 2023-10-07T08:54:58.513 INFO:teuthology.orchestra.run.smithi081.stderr: 85.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-07T08:54:58.513 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110289.log.gz 2023-10-07T08:54:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.119146.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117223.log.gz 2023-10-07T08:54:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103394.log 2023-10-07T08:54:58.514 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2%/var/log/ceph/ceph-client.admin.95560.log: -- replaced with /var/log/ceph/ceph-client.admin.119146.log.gz 2023-10-07T08:54:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110415.log 2023-10-07T08:54:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.103394.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95560.log.gz 2023-10-07T08:54:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100560.log 2023-10-07T08:54:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92066.log 2023-10-07T08:54:58.514 INFO:teuthology.orchestra.run.smithi081.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.103394.log.gz 2023-10-07T08:54:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100560.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110415.log.gz 2023-10-07T08:54:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94760.log 2023-10-07T08:54:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88092.log 2023-10-07T08:54:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92066.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100560.log.gz 2023-10-07T08:54:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90142.log 2023-10-07T08:54:58.515 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92066.log.gz 2023-10-07T08:54:58.515 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94760.log.gz 2023-10-07T08:54:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91432.log 2023-10-07T08:54:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.90142.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88092.log.gz 2023-10-07T08:54:58.515 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.0.90142.log.gz-5 2023-10-07T08:54:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:--verbose -- /var/log/ceph/ceph-client.admin.88429.log 2023-10-07T08:54:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93304.log 2023-10-07T08:54:58.515 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91432.log.gz 2023-10-07T08:54:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106282.log 2023-10-07T08:54:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93304.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.88429.log.gz 2023-10-07T08:54:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117139.log 2023-10-07T08:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.106282.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93304.log.gz 2023-10-07T08:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117776.log 2023-10-07T08:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88763.log 2023-10-07T08:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117139.log.gz 2023-10-07T08:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.106282.log.gz 2023-10-07T08:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106628.log 2023-10-07T08:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87053.log 2023-10-07T08:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88763.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117776.log.gz 2023-10-07T08:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.106628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93028.log 2023-10-07T08:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88763.log.gz 2023-10-07T08:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87053.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106628.log.gz 2023-10-07T08:54:58.517 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110331.log 2023-10-07T08:54:58.517 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87053.log.gz 2023-10-07T08:54:58.517 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111497.log 2023-10-07T08:54:58.517 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93028.log.gz 2023-10-07T08:54:58.517 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104282.log 2023-10-07T08:54:58.517 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111497.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110331.log.gz 2023-10-07T08:54:58.517 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99362.log 2023-10-07T08:54:58.517 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104282.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111497.log.gz 2023-10-07T08:54:58.517 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115648.log 2023-10-07T08:54:58.517 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104282.log.gz 2023-10-07T08:54:58.517 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102787.log 2023-10-07T08:54:58.517 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115648.log: gzip -5 88.4%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.99362.log.gz/var/log/ceph/ceph-client.admin.93196.log 2023-10-07T08:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr: 2023-10-07T08:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115648.log.gz 2023-10-07T08:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107718.log 2023-10-07T08:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102787.log.gz 2023-10-07T08:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109390.log 2023-10-07T08:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105122.log 2023-10-07T08:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93196.log.gz 2023-10-07T08:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109390.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107718.log.gz 2023-10-07T08:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115258.log 2023-10-07T08:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5%/var/log/ceph/ceph-client.admin.105122.log: -- replaced with /var/log/ceph/ceph-client.admin.109390.log.gz 2023-10-07T08:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100901.log 2023-10-07T08:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96928.log 2023-10-07T08:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105122.log.gz 2023-10-07T08:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100901.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115258.log.gz 2023-10-07T08:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92436.log 2023-10-07T08:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100901.log.gz 2023-10-07T08:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.96928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119019.log 2023-10-07T08:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105734.log 2023-10-07T08:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96928.log.gz 2023-10-07T08:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92436.log.gz 2023-10-07T08:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.119019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111077.log 2023-10-07T08:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119019.log.gz 2023-10-07T08:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115996.log 2023-10-07T08:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105734.log.gz 2023-10-07T08:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91856.log 2023-10-07T08:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115996.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.111077.log.gz 2023-10-07T08:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115690.log 2023-10-07T08:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115996.log.gz 2023-10-07T08:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91772.log 2023-10-07T08:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115690.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91856.log.gz 2023-10-07T08:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109643.log 2023-10-07T08:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115690.log.gz 2023-10-07T08:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92394.log 2023-10-07T08:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.91772.log.gz 2023-10-07T08:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102481.log 2023-10-07T08:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117921.log 2023-10-07T08:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109643.log.gz 2023-10-07T08:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92394.log.gz 2023-10-07T08:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96795.log 2023-10-07T08:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102481.log.gz 2023-10-07T08:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109905.log 2023-10-07T08:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.96795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94290.log 2023-10-07T08:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117921.log.gz 2023-10-07T08:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109905.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96795.log.gz 2023-10-07T08:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108688.log 2023-10-07T08:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109905.log.gz 2023-10-07T08:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94500.log 2023-10-07T08:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108688.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94290.log.gz 2023-10-07T08:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87368.log 2023-10-07T08:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94500.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108688.log.gz 2023-10-07T08:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104599.log 2023-10-07T08:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94500.log.gz 2023-10-07T08:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115732.log 2023-10-07T08:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104599.log: gzip 88.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.87368.log.gz--verbose 2023-10-07T08:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:-- /var/log/ceph/ceph-client.admin.105946.log 2023-10-07T08:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104599.log.gz 2023-10-07T08:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119228.log 2023-10-07T08:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105946.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115732.log.gz 2023-10-07T08:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119103.log 2023-10-07T08:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.119228.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105946.log.gz 2023-10-07T08:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95382.log 2023-10-07T08:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.119103.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119228.log.gz 2023-10-07T08:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95338.log 2023-10-07T08:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95382.log: gzip 87.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.119103.log.gz--verbose 2023-10-07T08:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:-- /var/log/ceph/ceph-client.admin.100733.log 2023-10-07T08:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95338.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95382.log.gz 2023-10-07T08:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107290.log 2023-10-07T08:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95338.log.gz 2023-10-07T08:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98722.log 2023-10-07T08:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107290.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100733.log.gz 2023-10-07T08:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101009.log 2023-10-07T08:54:58.524 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107290.log.gz 2023-10-07T08:54:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.98722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98446.log 2023-10-07T08:54:58.524 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98722.log.gz 2023-10-07T08:54:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.101009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98318.log 2023-10-07T08:54:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.98446.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.101009.log.gz 2023-10-07T08:54:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113564.log 2023-10-07T08:54:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.98318.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98446.log.gz 2023-10-07T08:54:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100518.log 2023-10-07T08:54:58.524 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1%/var/log/ceph/ceph-client.admin.113564.log: -- replaced with /var/log/ceph/ceph-client.admin.98318.log.gz 2023-10-07T08:54:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103083.log 2023-10-07T08:54:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100518.log: 87.8%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.113564.log.gz--verbose 2023-10-07T08:54:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:-- /var/log/ceph/ceph-client.admin.113734.log 2023-10-07T08:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.103083.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100518.log.gz 2023-10-07T08:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101986.log 2023-10-07T08:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113734.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103083.log.gz 2023-10-07T08:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98140.log 2023-10-07T08:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.101986.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113734.log.gzgzip 2023-10-07T08:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.97510.log 2023-10-07T08:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101986.log.gz 2023-10-07T08:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.98140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91646.log 2023-10-07T08:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98140.log.gz 2023-10-07T08:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92268.log 2023-10-07T08:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91646.log: gzip -5 --verbose -- 88.9%/var/log/ceph/ceph.audit.log 2023-10-07T08:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97510.log.gz 2023-10-07T08:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.91646.log.gz 2023-10-07T08:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95254.log 2023-10-07T08:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.audit.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.92268.log.gz 2023-10-07T08:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94248.log 2023-10-07T08:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88636.log 2023-10-07T08:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95254.log.gz 2023-10-07T08:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100817.log 2023-10-07T08:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99236.log 2023-10-07T08:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88636.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94248.log.gz 2023-10-07T08:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100817.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88636.log.gz 2023-10-07T08:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113352.log 2023-10-07T08:54:58.527 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100817.log.gz 2023-10-07T08:54:58.527 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118263.log 2023-10-07T08:54:58.527 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99236.log: /var/log/ceph/ceph-client.admin.113352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102029.log 2023-10-07T08:54:58.527 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99236.log.gz 2023-10-07T08:54:58.527 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118263.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113352.log.gz 2023-10-07T08:54:58.527 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95476.log 2023-10-07T08:54:58.527 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118263.log.gz 2023-10-07T08:54:58.527 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-07T08:54:58.527 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105862.log 2023-10-07T08:54:58.527 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95212.log 2023-10-07T08:54:58.527 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102029.log.gz 2023-10-07T08:54:58.528 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.98919.log 2023-10-07T08:54:58.528 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105862.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95476.log.gz 2023-10-07T08:54:58.528 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111749.log 2023-10-07T08:54:58.528 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105862.log.gz 2023-10-07T08:54:58.528 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.98919.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95212.log.gz 2023-10-07T08:54:58.528 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111119.log 2023-10-07T08:54:58.528 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.98919.log.gz 2023-10-07T08:54:58.528 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100859.log 2023-10-07T08:54:58.528 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105226.log 2023-10-07T08:54:58.528 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111119.log.gz 2023-10-07T08:54:58.528 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100859.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.111749.log.gz 2023-10-07T08:54:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106030.log 2023-10-07T08:54:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103310.log 2023-10-07T08:54:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105226.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100859.log.gz 2023-10-07T08:54:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.106030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107500.log 2023-10-07T08:54:58.529 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105226.log.gz 2023-10-07T08:54:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.103310.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.106030.log.gz 2023-10-07T08:54:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112053.log 2023-10-07T08:54:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107500.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103310.log.gz 2023-10-07T08:54:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103167.log 2023-10-07T08:54:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112053.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.107500.log.gz 2023-10-07T08:54:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110560.log 2023-10-07T08:54:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.103167.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112053.log.gz 2023-10-07T08:54:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88426.log 2023-10-07T08:54:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110560.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103167.log.gz 2023-10-07T08:54:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92310.log 2023-10-07T08:54:58.530 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110560.log.gz 2023-10-07T08:54:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102155.log 2023-10-07T08:54:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92310.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.88426.log.gz 2023-10-07T08:54:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108898.log 2023-10-07T08:54:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102155.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.92310.log.gz 2023-10-07T08:54:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100254.log 2023-10-07T08:54:58.530 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102155.log.gz 2023-10-07T08:54:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115446.log 2023-10-07T08:54:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97012.log 2023-10-07T08:54:58.531 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108898.log.gz 2023-10-07T08:54:58.531 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115446.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100254.log.gz 2023-10-07T08:54:58.531 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114475.log 2023-10-07T08:54:58.531 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115446.log.gz 2023-10-07T08:54:58.531 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97348.log 2023-10-07T08:54:58.531 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110373.log 2023-10-07T08:54:58.531 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97012.log.gz 2023-10-07T08:54:58.531 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1%/var/log/ceph/ceph-client.admin.97348.log: -- replaced with /var/log/ceph/ceph-client.admin.114475.log.gz 2023-10-07T08:54:58.531 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112607.log 2023-10-07T08:54:58.531 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110373.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97348.log.gz 2023-10-07T08:54:58.531 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.109241.log 2023-10-07T08:54:58.531 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112607.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110373.log.gz 2023-10-07T08:54:58.532 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101800.log 2023-10-07T08:54:58.532 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.109241.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112607.log.gz 2023-10-07T08:54:58.532 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.109241.log.gz 2023-10-07T08:54:58.532 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87095.log 2023-10-07T08:54:58.532 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.101800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93969.log 2023-10-07T08:54:58.532 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87095.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101800.log.gz 2023-10-07T08:54:58.532 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109863.log 2023-10-07T08:54:58.532 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93969.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87095.log.gz 2023-10-07T08:54:58.532 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102565.log 2023-10-07T08:54:58.532 INFO:teuthology.orchestra.run.smithi081.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.93969.log.gz 2023-10-07T08:54:58.532 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110247.log 2023-10-07T08:54:58.532 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101206.log 2023-10-07T08:54:58.533 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109863.log.gz 2023-10-07T08:54:58.533 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110247.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102565.log.gz 2023-10-07T08:54:58.533 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102113.log 2023-10-07T08:54:58.533 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110247.log.gz 2023-10-07T08:54:58.533 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.101206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91814.log 2023-10-07T08:54:58.533 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.101206.log.gz 2023-10-07T08:54:58.533 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113192.log 2023-10-07T08:54:58.533 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102113.log.gz 2023-10-07T08:54:58.533 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105904.log 2023-10-07T08:54:58.533 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94584.log 2023-10-07T08:54:58.533 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91814.log.gz 2023-10-07T08:54:58.533 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105904.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113192.log.gz 2023-10-07T08:54:58.534 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86925.log 2023-10-07T08:54:58.534 INFO:teuthology.orchestra.run.smithi081.stderr: 89.5%/var/log/ceph/ceph-client.admin.94584.log: -- replaced with /var/log/ceph/ceph-client.admin.105904.log.gz 2023-10-07T08:54:58.534 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103653.log 2023-10-07T08:54:58.534 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.86925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104683.log 2023-10-07T08:54:58.534 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94584.log.gz 2023-10-07T08:54:58.534 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.103653.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86925.log.gz 2023-10-07T08:54:58.534 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111581.log 2023-10-07T08:54:58.534 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103653.log.gz 2023-10-07T08:54:58.534 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104683.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-07T08:54:58.534 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111581.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104683.log.gz 2023-10-07T08:54:58.534 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107676.log 2023-10-07T08:54:58.534 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111581.log.gz 2023-10-07T08:54:58.535 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87712.log 2023-10-07T08:54:58.535 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94668.log 2023-10-07T08:54:58.535 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87712.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107676.log.gz 2023-10-07T08:54:58.535 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92860.log 2023-10-07T08:54:58.535 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.87712.log.gz 2023-10-07T08:54:58.535 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110121.log 2023-10-07T08:54:58.535 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94668.log: /var/log/ceph/ceph-client.admin.92860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97222.log 2023-10-07T08:54:58.535 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94668.log.gz 2023-10-07T08:54:58.535 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110121.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92860.log.gz 2023-10-07T08:54:58.535 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116961.log 2023-10-07T08:54:58.535 INFO:teuthology.orchestra.run.smithi081.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.110121.log.gz 2023-10-07T08:54:58.535 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98488.log 2023-10-07T08:54:58.536 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99801.log 2023-10-07T08:54:58.536 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97222.log.gz 2023-10-07T08:54:58.536 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116961.log: /var/log/ceph/ceph-client.admin.98488.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.116961.log.gz-5 2023-10-07T08:54:58.536 INFO:teuthology.orchestra.run.smithi081.stderr:--verbose -- /var/log/ceph/ceph-client.admin.103962.log 2023-10-07T08:54:58.536 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98488.log.gz 2023-10-07T08:54:58.536 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88090.log 2023-10-07T08:54:58.536 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99801.log: /var/log/ceph/ceph-client.admin.103962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110644.log 2023-10-07T08:54:58.536 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99801.log.gz 2023-10-07T08:54:58.536 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88090.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103962.log.gz 2023-10-07T08:54:58.536 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113961.log 2023-10-07T08:54:58.536 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88090.log.gz 2023-10-07T08:54:58.536 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115006.log 2023-10-07T08:54:58.537 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118767.log 2023-10-07T08:54:58.537 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113961.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110644.log.gz 2023-10-07T08:54:58.537 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117566.log 2023-10-07T08:54:58.537 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113961.log.gz 2023-10-07T08:54:58.537 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115006.log.gz 2023-10-07T08:54:58.537 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93112.log 2023-10-07T08:54:58.537 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118767.log: /var/log/ceph/ceph-client.admin.117566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113270.log 2023-10-07T08:54:58.537 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118767.log.gz 2023-10-07T08:54:58.537 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93112.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117566.log.gz 2023-10-07T08:54:58.537 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93238.log 2023-10-07T08:54:58.537 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93112.log.gz 2023-10-07T08:54:58.537 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98054.log 2023-10-07T08:54:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103748.log 2023-10-07T08:54:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93238.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113270.log.gz 2023-10-07T08:54:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.98054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103904.log 2023-10-07T08:54:58.538 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98054.log.gz 2023-10-07T08:54:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.103748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113088.log 2023-10-07T08:54:58.538 INFO:teuthology.orchestra.run.smithi081.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.93238.log.gz 2023-10-07T08:54:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111539.log 2023-10-07T08:54:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.103904.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103748.log.gz 2023-10-07T08:54:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91688.log 2023-10-07T08:54:58.538 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103904.log.gz 2023-10-07T08:54:58.538 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113088.log.gz 2023-10-07T08:54:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118935.log 2023-10-07T08:54:58.539 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111539.log.gz 2023-10-07T08:54:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119061.log 2023-10-07T08:54:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91688.log: /var/log/ceph/ceph-client.admin.118935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115954.log 2023-10-07T08:54:58.539 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91688.log.gz 2023-10-07T08:54:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.119061.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118935.log.gz 2023-10-07T08:54:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98012.log 2023-10-07T08:54:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106240.log 2023-10-07T08:54:58.539 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119061.log.gz 2023-10-07T08:54:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115954.log: /var/log/ceph/ceph-client.admin.98012.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115954.log.gz 2023-10-07T08:54:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88094.log 2023-10-07T08:54:58.539 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98012.log.gz 2023-10-07T08:54:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107592.log 2023-10-07T08:54:58.540 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.106240.log: /var/log/ceph/ceph-client.admin.88094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91328.log 2023-10-07T08:54:58.540 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106240.log.gz 2023-10-07T08:54:58.540 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107592.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.88094.log.gz 2023-10-07T08:54:58.540 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118725.log 2023-10-07T08:54:58.540 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107592.log.gz 2023-10-07T08:54:58.540 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112481.log 2023-10-07T08:54:58.540 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107634.log 2023-10-07T08:54:58.540 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8%/var/log/ceph/ceph-client.admin.118725.log: -- replaced with /var/log/ceph/ceph-client.admin.91328.log.gz 2023-10-07T08:54:58.540 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112481.log: gzip 88.5%-5 -- replaced with /var/log/ceph/ceph-client.admin.118725.log.gz--verbose 2023-10-07T08:54:58.540 INFO:teuthology.orchestra.run.smithi081.stderr:-- /var/log/ceph/ceph-client.admin.95518.log 2023-10-07T08:54:58.540 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112481.log.gz 2023-10-07T08:54:58.540 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96417.log 2023-10-07T08:54:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107634.log: /var/log/ceph/ceph-client.admin.95518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113835.log 2023-10-07T08:54:58.541 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107634.log.gz 2023-10-07T08:54:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.96417.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95518.log.gz 2023-10-07T08:54:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93497.log 2023-10-07T08:54:58.541 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96417.log.gz 2023-10-07T08:54:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108772.log 2023-10-07T08:54:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99885.log 2023-10-07T08:54:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.93497.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.113835.log.gz 2023-10-07T08:54:58.541 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.93497.log.gz 2023-10-07T08:54:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114922.log 2023-10-07T08:54:58.541 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108772.log.gz 2023-10-07T08:54:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96375.log 2023-10-07T08:54:58.542 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99885.log: /var/log/ceph/ceph-client.admin.114922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92352.log 2023-10-07T08:54:58.542 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99885.log.gz 2023-10-07T08:54:58.542 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.96375.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114922.log.gz 2023-10-07T08:54:58.542 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104809.log 2023-10-07T08:54:58.542 INFO:teuthology.orchestra.run.smithi081.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.96375.log.gz 2023-10-07T08:54:58.542 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99446.log 2023-10-07T08:54:58.542 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8%/var/log/ceph/ceph-client.admin.104809.log: -- replaced with /var/log/ceph/ceph-client.admin.92352.log.gz 2023-10-07T08:54:58.542 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87326.log 2023-10-07T08:54:58.542 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99446.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104809.log.gz 2023-10-07T08:54:58.542 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117524.log 2023-10-07T08:54:58.542 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99446.log.gz 2023-10-07T08:54:58.542 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102957.log 2023-10-07T08:54:58.543 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87326.log: /var/log/ceph/ceph-client.admin.117524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112733.log 2023-10-07T08:54:58.543 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87326.log.gz 2023-10-07T08:54:58.543 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95010.log 2023-10-07T08:54:58.543 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117524.log.gz 2023-10-07T08:54:58.543 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102957.log.gz 2023-10-07T08:54:58.543 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89736.log 2023-10-07T08:54:58.543 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112733.log.gz 2023-10-07T08:54:58.543 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108466.log 2023-10-07T08:54:58.543 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95010.log: /var/log/ceph/ceph-client.admin.89736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115862.log 2023-10-07T08:54:58.543 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95010.log.gz 2023-10-07T08:54:58.543 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89736.log.gz 2023-10-07T08:54:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88416.log 2023-10-07T08:54:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102071.log 2023-10-07T08:54:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115862.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108466.log.gz 2023-10-07T08:54:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97096.log 2023-10-07T08:54:58.544 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115862.log.gz 2023-10-07T08:54:58.544 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88416.log.gz 2023-10-07T08:54:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 /var/log/ceph/ceph-client.admin.102071.log: --verbose -- /var/log/ceph/ceph-client.admin.90889.log 2023-10-07T08:54:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112523.log 2023-10-07T08:54:58.544 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102071.log.gz 2023-10-07T08:54:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.90889.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97096.log.gz 2023-10-07T08:54:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92818.log 2023-10-07T08:54:58.544 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90889.log.gz 2023-10-07T08:54:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102915.log 2023-10-07T08:54:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112877.log 2023-10-07T08:54:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92818.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112523.log.gz 2023-10-07T08:54:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102915.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92818.log.gz 2023-10-07T08:54:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101674.log 2023-10-07T08:54:58.545 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102915.log.gz 2023-10-07T08:54:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107906.log 2023-10-07T08:54:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112877.log: /var/log/ceph/ceph-client.admin.101674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98362.log 2023-10-07T08:54:58.545 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112877.log.gz 2023-10-07T08:54:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107906.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101674.log.gz 2023-10-07T08:54:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118557.log 2023-10-07T08:54:58.545 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107906.log.gz/var/log/ceph/ceph-client.admin.98362.log: 2023-10-07T08:54:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89434.log 2023-10-07T08:54:58.546 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98362.log.gz 2023-10-07T08:54:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87620.log 2023-10-07T08:54:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118557.log: /var/log/ceph/ceph-client.admin.89434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106156.log 2023-10-07T08:54:58.546 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118557.log.gz 2023-10-07T08:54:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87620.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.89434.log.gz 2023-10-07T08:54:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103706.log 2023-10-07T08:54:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.106156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86844.log 2023-10-07T08:54:58.546 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87620.log.gz 2023-10-07T08:54:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.103706.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106156.log.gz 2023-10-07T08:54:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101884.log 2023-10-07T08:54:58.546 INFO:teuthology.orchestra.run.smithi081.stderr: 89.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.103706.log.gz--verbose 2023-10-07T08:54:58.547 INFO:teuthology.orchestra.run.smithi081.stderr:-- /var/log/ceph/ceph-client.admin.111707.log 2023-10-07T08:54:58.547 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.86844.log: /var/log/ceph/ceph-client.admin.101884.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86844.log.gz 2023-10-07T08:54:58.547 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114350.log 2023-10-07T08:54:58.547 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117734.log 2023-10-07T08:54:58.547 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111707.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101884.log.gz 2023-10-07T08:54:58.547 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.114350.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111707.log.gzgzip 2023-10-07T08:54:58.547 INFO:teuthology.orchestra.run.smithi081.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.92688.log 2023-10-07T08:54:58.547 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.114350.log.gz 2023-10-07T08:54:58.547 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109737.log 2023-10-07T08:54:58.547 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92688.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117734.log.gz 2023-10-07T08:54:58.547 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117003.log 2023-10-07T08:54:58.547 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114153.log 2023-10-07T08:54:58.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109737.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92688.log.gz 2023-10-07T08:54:58.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105038.log 2023-10-07T08:54:58.548 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109737.log.gz 2023-10-07T08:54:58.548 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94626.log 2023-10-07T08:54:58.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114153.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117003.log.gz 2023-10-07T08:54:58.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97760.log 2023-10-07T08:54:58.548 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114153.log.gz 2023-10-07T08:54:58.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98572.log 2023-10-07T08:54:58.548 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105038.log.gz 2023-10-07T08:54:58.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97760.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94626.log.gz 2023-10-07T08:54:58.548 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116853.log 2023-10-07T08:54:58.548 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97760.log.gz 2023-10-07T08:54:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93626.log 2023-10-07T08:54:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.98572.log: /var/log/ceph/ceph-client.admin.116853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101842.log 2023-10-07T08:54:58.549 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98572.log.gz 2023-10-07T08:54:58.549 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116853.log.gz 2023-10-07T08:54:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103460.log 2023-10-07T08:54:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.101842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111665.log 2023-10-07T08:54:58.549 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93626.log.gz 2023-10-07T08:54:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.103460.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101842.log.gz 2023-10-07T08:54:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94886.log 2023-10-07T08:54:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.116597.log 2023-10-07T08:54:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111665.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103460.log.gz 2023-10-07T08:54:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94886.log: gzip -5 --verbose 88.4%-- /var/log/ceph/ceph-client.admin.88432.log -- replaced with /var/log/ceph/ceph-client.admin.111665.log.gz 2023-10-07T08:54:58.550 INFO:teuthology.orchestra.run.smithi081.stderr: 2023-10-07T08:54:58.550 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99320.log 2023-10-07T08:54:58.550 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.116597.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94886.log.gz 2023-10-07T08:54:58.550 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.116597.log.gz 2023-10-07T08:54:58.550 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91940.log 2023-10-07T08:54:58.550 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100130.log 2023-10-07T08:54:58.550 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99320.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.88432.log.gz 2023-10-07T08:54:58.550 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91940.log: 88.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.99320.log.gz--verbose 2023-10-07T08:54:58.550 INFO:teuthology.orchestra.run.smithi081.stderr:-- /var/log/ceph/ceph-client.admin.116759.log 2023-10-07T08:54:58.550 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107990.log 2023-10-07T08:54:58.550 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100130.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91940.log.gz 2023-10-07T08:54:58.551 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107821.log 2023-10-07T08:54:58.551 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100130.log.gz 2023-10-07T08:54:58.551 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116250.log 2023-10-07T08:54:58.551 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3%/var/log/ceph/ceph-client.admin.107990.log: -- replaced with /var/log/ceph/ceph-client.admin.116759.log.gz 2023-10-07T08:54:58.551 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95604.log 2023-10-07T08:54:58.551 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107990.log.gz 2023-10-07T08:54:58.551 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.98915.log 2023-10-07T08:54:58.551 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116250.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107821.log.gz 2023-10-07T08:54:58.551 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95604.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116250.log.gz 2023-10-07T08:54:58.551 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-07T08:54:58.551 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112008.log 2023-10-07T08:54:58.551 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.98915.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95604.log.gz 2023-10-07T08:54:58.552 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.98915.log.gz 2023-10-07T08:54:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117097.log 2023-10-07T08:54:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118389.log 2023-10-07T08:54:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.112008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112008.log.gz 2023-10-07T08:54:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88428.log 2023-10-07T08:54:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108814.log 2023-10-07T08:54:58.552 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.117097.log.gz 2023-10-07T08:54:58.552 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118389.log.gz 2023-10-07T08:54:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108602.log 2023-10-07T08:54:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92108.log 2023-10-07T08:54:58.552 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5%/var/log/ceph/ceph-client.admin.108814.log: -- replaced with /var/log/ceph/ceph-client.admin.88428.log.gz 2023-10-07T08:54:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103862.log 2023-10-07T08:54:58.553 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108814.log.gz 2023-10-07T08:54:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92108.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108602.log.gz 2023-10-07T08:54:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-07T08:54:58.553 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92108.log.gz 2023-10-07T08:54:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.103862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94374.log 2023-10-07T08:54:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101716.log 2023-10-07T08:54:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.1.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103862.log.gz 2023-10-07T08:54:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95108.log 2023-10-07T08:54:58.553 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94374.log.gz 2023-10-07T08:54:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.101716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88769.log 2023-10-07T08:54:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95108.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101716.log.gz 2023-10-07T08:54:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88769.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95108.log.gz 2023-10-07T08:54:58.554 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113130.log 2023-10-07T08:54:58.554 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.88769.log.gz 2023-10-07T08:54:58.554 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97970.log 2023-10-07T08:54:58.554 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116166.log 2023-10-07T08:54:58.554 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113130.log.gz 2023-10-07T08:54:58.554 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97054.log 2023-10-07T08:54:58.554 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112920.log 2023-10-07T08:54:58.554 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116166.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97970.log.gz 2023-10-07T08:54:58.554 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87796.log 2023-10-07T08:54:58.554 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116166.log.gz 2023-10-07T08:54:58.554 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112920.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97054.log.gz 2023-10-07T08:54:58.554 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106912.log 2023-10-07T08:54:58.555 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.112920.log.gz 2023-10-07T08:54:58.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105692.log 2023-10-07T08:54:58.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.106912.log: gzip -5 --verbose 88.5%-- /var/log/ceph/ceph-client.admin.115912.log 2023-10-07T08:54:58.555 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87796.log.gz 2023-10-07T08:54:58.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105692.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106912.log.gz 2023-10-07T08:54:58.555 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105692.log.gz 2023-10-07T08:54:58.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97594.log 2023-10-07T08:54:58.555 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115912.log.gz 2023-10-07T08:54:58.555 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95856.log 2023-10-07T08:54:58.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118515.log 2023-10-07T08:54:58.555 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97594.log.gz 2023-10-07T08:54:58.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87179.log 2023-10-07T08:54:58.555 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109601.log 2023-10-07T08:54:58.556 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118515.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95856.log.gz 2023-10-07T08:54:58.556 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99278.log 2023-10-07T08:54:58.556 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118515.log.gz 2023-10-07T08:54:58.556 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109601.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87179.log.gz 2023-10-07T08:54:58.556 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109601.log.gz 2023-10-07T08:54:58.556 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99278.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99278.log.gz 2023-10-07T08:54:58.556 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100296.log 2023-10-07T08:54:58.556 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91286.log 2023-10-07T08:54:58.556 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103352.log 2023-10-07T08:54:58.556 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91286.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100296.log.gz 2023-10-07T08:54:58.556 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91286.log.gz 2023-10-07T08:54:58.556 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.103352.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103352.log.gz 2023-10-07T08:54:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105386.log 2023-10-07T08:54:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102693.log 2023-10-07T08:54:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109286.log 2023-10-07T08:54:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102693.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105386.log.gz 2023-10-07T08:54:58.557 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102693.log.gz 2023-10-07T08:54:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109286.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109286.log.gz 2023-10-07T08:54:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106114.log 2023-10-07T08:54:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118431.log 2023-10-07T08:54:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.106114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99656.log 2023-10-07T08:54:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118431.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106114.log.gz 2023-10-07T08:54:58.557 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118431.log.gz 2023-10-07T08:54:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99656.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99656.log.gz 2023-10-07T08:54:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86337.log 2023-10-07T08:54:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-07T08:54:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.86337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110602.log 2023-10-07T08:54:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.a.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.86337.log.gz 2023-10-07T08:54:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110602.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110602.log.gz 2023-10-07T08:54:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91982.log 2023-10-07T08:54:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107864.log 2023-10-07T08:54:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91982.log: /var/log/ceph/ceph-client.admin.107864.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91982.log.gz 2023-10-07T08:54:58.558 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107864.log.gz 2023-10-07T08:54:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98656.log 2023-10-07T08:54:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98276.log 2023-10-07T08:54:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.98656.log: /var/log/ceph/ceph-client.admin.98276.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98276.log.gz 2023-10-07T08:54:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110037.log 2023-10-07T08:54:58.559 INFO:teuthology.orchestra.run.smithi081.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.98656.log.gz 2023-10-07T08:54:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93789.log 2023-10-07T08:54:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110037.log: /var/log/ceph/ceph-client.admin.93789.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110037.log.gz 2023-10-07T08:54:58.559 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93789.log.gz 2023-10-07T08:54:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98234.log 2023-10-07T08:54:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87838.log 2023-10-07T08:54:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.98234.log: /var/log/ceph/ceph-client.admin.87838.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98234.log.gz 2023-10-07T08:54:58.559 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.87838.log.gz 2023-10-07T08:54:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102737.log 2023-10-07T08:54:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107458.log 2023-10-07T08:54:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102737.log: /var/log/ceph/ceph-client.admin.107458.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102737.log.gz 2023-10-07T08:54:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.90550.log 2023-10-07T08:54:58.560 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107458.log.gz 2023-10-07T08:54:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89056.log 2023-10-07T08:54:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.2.90550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.90550.log.gz 2023-10-07T08:54:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.89056.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.89056.log.gz 2023-10-07T08:54:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92944.log 2023-10-07T08:54:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112439.log 2023-10-07T08:54:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92944.log: /var/log/ceph/ceph-client.admin.112439.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.92944.log.gz 2023-10-07T08:54:58.560 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112439.log.gz 2023-10-07T08:54:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113650.log 2023-10-07T08:54:58.560 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110770.log 2023-10-07T08:54:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113650.log: /var/log/ceph/ceph-client.admin.110770.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113650.log.gz 2023-10-07T08:54:58.561 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110770.log.gz 2023-10-07T08:54:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118305.log 2023-10-07T08:54:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118977.log 2023-10-07T08:54:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118305.log: /var/log/ceph/ceph-client.admin.118977.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118305.log.gz 2023-10-07T08:54:58.561 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118977.log.gz 2023-10-07T08:54:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114964.log 2023-10-07T08:54:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102999.log 2023-10-07T08:54:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114964.log: /var/log/ceph/ceph-client.admin.102999.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114964.log.gz 2023-10-07T08:54:58.561 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102999.log.gz 2023-10-07T08:54:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94458.log 2023-10-07T08:54:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94844.log 2023-10-07T08:54:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117265.log 2023-10-07T08:54:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94458.log: /var/log/ceph/ceph-client.admin.94844.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94458.log.gz 2023-10-07T08:54:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117265.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94844.log.gz 2023-10-07T08:54:58.562 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117265.log.gz 2023-10-07T08:54:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101506.log 2023-10-07T08:54:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114796.log 2023-10-07T08:54:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.101506.log: /var/log/ceph/ceph-client.admin.114796.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101506.log.gz 2023-10-07T08:54:58.562 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114796.log.gz 2023-10-07T08:54:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93154.log 2023-10-07T08:54:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115384.log 2023-10-07T08:54:58.562 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118473.log 2023-10-07T08:54:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115384.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93154.log.gz 2023-10-07T08:54:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118473.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115384.log.gz 2023-10-07T08:54:58.563 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118473.log.gz 2023-10-07T08:54:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100691.log 2023-10-07T08:54:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91015.log 2023-10-07T08:54:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100691.log: /var/log/ceph/ceph-client.admin.91015.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100691.log.gz 2023-10-07T08:54:58.563 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.91015.log.gz 2023-10-07T08:54:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114391.log 2023-10-07T08:54:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106828.log 2023-10-07T08:54:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114391.log: /var/log/ceph/ceph-client.admin.106828.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114391.log.gz 2023-10-07T08:54:58.563 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106828.log.gz 2023-10-07T08:54:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88972.log 2023-10-07T08:54:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93070.log 2023-10-07T08:54:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117878.log 2023-10-07T08:54:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93070.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88972.log.gz 2023-10-07T08:54:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117878.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93070.log.gz 2023-10-07T08:54:58.564 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117878.log.gz 2023-10-07T08:54:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101590.log 2023-10-07T08:54:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110205.log 2023-10-07T08:54:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.101590.log: /var/log/ceph/ceph-client.admin.110205.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101590.log.gz 2023-10-07T08:54:58.564 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110205.log.gz 2023-10-07T08:54:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87410.log 2023-10-07T08:54:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107542.log 2023-10-07T08:54:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90931.log 2023-10-07T08:54:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107542.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87410.log.gz 2023-10-07T08:54:58.565 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107542.log.gz/var/log/ceph/ceph-client.admin.90931.log: 2023-10-07T08:54:58.565 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90931.log.gz 2023-10-07T08:54:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.116593.log 2023-10-07T08:54:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118047.log 2023-10-07T08:54:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.116593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.116593.log.gz 2023-10-07T08:54:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118047.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118047.log.gz 2023-10-07T08:54:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118347.log 2023-10-07T08:54:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89392.log 2023-10-07T08:54:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113394.log 2023-10-07T08:54:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.89392.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118347.log.gz 2023-10-07T08:54:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113394.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89392.log.gz 2023-10-07T08:54:58.566 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113394.log.gz 2023-10-07T08:54:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89560.log 2023-10-07T08:54:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100052.log 2023-10-07T08:54:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.89560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89098.log 2023-10-07T08:54:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100052.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89560.log.gz 2023-10-07T08:54:58.566 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100052.log.gz 2023-10-07T08:54:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91898.log 2023-10-07T08:54:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.89098.log: /var/log/ceph/ceph-client.admin.91898.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89098.log.gz 2023-10-07T08:54:58.566 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91898.log.gz 2023-10-07T08:54:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90763.log 2023-10-07T08:54:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115818.log 2023-10-07T08:54:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.90763.log: /var/log/ceph/ceph-client.admin.115818.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90763.log.gz 2023-10-07T08:54:58.567 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115818.log.gz 2023-10-07T08:54:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95981.log 2023-10-07T08:54:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90805.log 2023-10-07T08:54:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95981.log: /var/log/ceph/ceph-client.admin.90805.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.95981.log.gz 2023-10-07T08:54:58.567 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90805.log.gz 2023-10-07T08:54:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112649.log 2023-10-07T08:54:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116400.log 2023-10-07T08:54:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112649.log: /var/log/ceph/ceph-client.admin.116400.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112649.log.gz 2023-10-07T08:54:58.567 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116400.log.gz 2023-10-07T08:54:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114045.log 2023-10-07T08:54:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107778.log 2023-10-07T08:54:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114045.log: /var/log/ceph/ceph-client.admin.107778.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.114045.log.gz 2023-10-07T08:54:58.568 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.107778.log.gz 2023-10-07T08:54:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105642.log 2023-10-07T08:54:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97180.log 2023-10-07T08:54:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105642.log: /var/log/ceph/ceph-client.admin.97180.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105642.log.gz 2023-10-07T08:54:58.568 INFO:teuthology.orchestra.run.smithi081.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.97180.log.gz 2023-10-07T08:54:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116082.log 2023-10-07T08:54:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102871.log 2023-10-07T08:54:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112012.log 2023-10-07T08:54:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102871.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116082.log.gz 2023-10-07T08:54:58.568 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8%/var/log/ceph/ceph-client.0.112012.log: -- replaced with /var/log/ceph/ceph-client.admin.102871.log.gz 2023-10-07T08:54:58.568 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112012.log.gz 2023-10-07T08:54:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88430.log 2023-10-07T08:54:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114087.log 2023-10-07T08:54:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88430.log: /var/log/ceph/ceph-client.admin.114087.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88430.log.gz 2023-10-07T08:54:58.569 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.114087.log.gz 2023-10-07T08:54:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112962.log 2023-10-07T08:54:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115090.log 2023-10-07T08:54:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112962.log: /var/log/ceph/ceph-client.admin.115090.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112962.log.gz 2023-10-07T08:54:58.569 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115090.log.gz 2023-10-07T08:54:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110163.log 2023-10-07T08:54:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111222.log 2023-10-07T08:54:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110163.log: /var/log/ceph/ceph-client.admin.111222.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110163.log.gz 2023-10-07T08:54:58.569 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111222.log.gz 2023-10-07T08:54:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95296.log 2023-10-07T08:54:58.570 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97552.log 2023-10-07T08:54:58.570 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95296.log: /var/log/ceph/ceph-client.admin.97552.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95296.log.gz 2023-10-07T08:54:58.570 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97552.log.gz 2023-10-07T08:54:58.570 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116124.log 2023-10-07T08:54:58.570 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92902.log 2023-10-07T08:54:58.570 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116124.log: /var/log/ceph/ceph-client.admin.92902.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116124.log.gz 2023-10-07T08:54:58.570 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92902.log.gz 2023-10-07T08:54:58.570 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91730.log 2023-10-07T08:54:58.570 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98404.log 2023-10-07T08:54:58.570 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112095.log 2023-10-07T08:54:58.570 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.98404.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91730.log.gz 2023-10-07T08:54:58.570 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98404.log.gz 2023-10-07T08:54:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112095.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112095.log.gz 2023-10-07T08:54:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89602.log 2023-10-07T08:54:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103041.log 2023-10-07T08:54:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.89602.log: /var/log/ceph/ceph-client.admin.103041.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103041.log.gz 2023-10-07T08:54:58.571 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.89602.log.gz 2023-10-07T08:54:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87754.log 2023-10-07T08:54:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91604.log 2023-10-07T08:54:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87754.log: /var/log/ceph/ceph-client.admin.91604.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.87754.log.gz 2023-10-07T08:54:58.571 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91604.log.gz 2023-10-07T08:54:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94948.log 2023-10-07T08:54:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86751.log 2023-10-07T08:54:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94948.log: /var/log/ceph/ceph-client.admin.86751.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94948.log.gz 2023-10-07T08:54:58.572 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86751.log.gz 2023-10-07T08:54:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105470.log 2023-10-07T08:54:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91562.log 2023-10-07T08:54:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105470.log: /var/log/ceph/ceph-client.admin.91562.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105470.log.gz 2023-10-07T08:54:58.572 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.91562.log.gz 2023-10-07T08:54:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109484.log 2023-10-07T08:54:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-07T08:54:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109484.log: /var/log/ceph/ceph-osd.0.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109484.log.gz 2023-10-07T08:54:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104156.log 2023-10-07T08:54:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102829.log 2023-10-07T08:54:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104156.log: /var/log/ceph/ceph-client.admin.102829.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104156.log.gz 2023-10-07T08:54:58.572 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102829.log.gz 2023-10-07T08:54:58.573 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86062.log 2023-10-07T08:54:58.573 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99716.log 2023-10-07T08:54:58.573 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.86062.log: /var/log/ceph/ceph-client.admin.99716.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.86062.log.gz 2023-10-07T08:54:58.573 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99716.log.gz 2023-10-07T08:54:58.573 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102649.log 2023-10-07T08:54:58.573 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94718.log 2023-10-07T08:54:58.573 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102649.log: /var/log/ceph/ceph-client.admin.94718.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.102649.log.gz 2023-10-07T08:54:58.573 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94718.log.gz 2023-10-07T08:54:58.573 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113004.log 2023-10-07T08:54:58.573 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92186.log 2023-10-07T08:54:58.573 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113004.log: /var/log/ceph/ceph-client.admin.92186.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113004.log.gz 2023-10-07T08:54:58.573 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92186.log.gz 2023-10-07T08:54:58.574 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99989.log 2023-10-07T08:54:58.574 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90973.log 2023-10-07T08:54:58.574 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99989.log: 88.7%/var/log/ceph/ceph-client.admin.90973.log: -- replaced with /var/log/ceph/ceph-client.admin.99989.log.gz 2023-10-07T08:54:58.574 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90973.log.gz 2023-10-07T08:54:58.574 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116903.log 2023-10-07T08:54:58.574 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115342.log 2023-10-07T08:54:58.574 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116903.log: /var/log/ceph/ceph-client.admin.115342.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116903.log.gz 2023-10-07T08:54:58.574 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115342.log.gz 2023-10-07T08:54:58.574 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87536.log 2023-10-07T08:54:58.574 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97306.log 2023-10-07T08:54:58.574 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87536.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87536.log.gz 2023-10-07T08:54:58.574 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97306.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97306.log.gz 2023-10-07T08:54:58.575 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.109245.log 2023-10-07T08:54:58.575 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118683.log 2023-10-07T08:54:58.575 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.109245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.109245.log.gz 2023-10-07T08:54:58.575 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118683.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118683.log.gz 2023-10-07T08:54:58.575 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96178.log 2023-10-07T08:54:58.575 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110686.log 2023-10-07T08:54:58.575 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.96178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96178.log.gz 2023-10-07T08:54:58.575 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110686.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.110686.log.gz 2023-10-07T08:54:58.575 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104725.log 2023-10-07T08:54:58.575 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117181.log 2023-10-07T08:54:58.575 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104725.log: 87.2%/var/log/ceph/ceph-client.admin.117181.log: -- replaced with /var/log/ceph/ceph-client.admin.104725.log.gz 2023-10-07T08:54:58.575 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.117181.log.gz 2023-10-07T08:54:58.576 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110833.log 2023-10-07T08:54:58.576 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93747.log 2023-10-07T08:54:58.576 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110833.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110833.log.gz/var/log/ceph/ceph-client.admin.93747.log: 2023-10-07T08:54:58.576 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93747.log.gz 2023-10-07T08:54:58.576 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108254.log 2023-10-07T08:54:58.576 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113520.log 2023-10-07T08:54:58.576 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108254.log: /var/log/ceph/ceph-client.admin.113520.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108254.log.gz 2023-10-07T08:54:58.576 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.113520.log.gz 2023-10-07T08:54:58.576 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97468.log 2023-10-07T08:54:58.576 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108094.log 2023-10-07T08:54:58.576 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97468.log: /var/log/ceph/ceph-client.admin.108094.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97468.log.gz 2023-10-07T08:54:58.576 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108094.log.gz 2023-10-07T08:54:58.577 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93584.log 2023-10-07T08:54:58.577 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100775.log 2023-10-07T08:54:58.577 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.93584.log: /var/log/ceph/ceph-client.admin.100775.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93584.log.gz 2023-10-07T08:54:58.577 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100775.log.gz 2023-10-07T08:54:58.577 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108296.log 2023-10-07T08:54:58.577 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109048.log 2023-10-07T08:54:58.577 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108296.log: 87.8%/var/log/ceph/ceph-client.admin.109048.log: -- replaced with /var/log/ceph/ceph-client.admin.108296.log.gz 2023-10-07T08:54:58.577 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109048.log.gz 2023-10-07T08:54:58.577 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111447.log 2023-10-07T08:54:58.577 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114433.log 2023-10-07T08:54:58.577 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111447.log: /var/log/ceph/ceph-client.admin.114433.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111447.log.gz 2023-10-07T08:54:58.577 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114433.log.gz 2023-10-07T08:54:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106541.log 2023-10-07T08:54:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106690.log 2023-10-07T08:54:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.106541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.106541.log.gz 2023-10-07T08:54:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.106690.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106690.log.gz 2023-10-07T08:54:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112157.log 2023-10-07T08:54:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106870.log 2023-10-07T08:54:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112157.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112157.log.gz 2023-10-07T08:54:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.106870.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106870.log.gz 2023-10-07T08:54:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100468.log 2023-10-07T08:54:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107416.log 2023-10-07T08:54:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100468.log: /var/log/ceph/ceph-client.admin.107416.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100468.log.gz 2023-10-07T08:54:58.578 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107416.log.gz 2023-10-07T08:54:58.579 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88433.log 2023-10-07T08:54:58.579 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105304.log 2023-10-07T08:54:58.579 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88433.log: /var/log/ceph/ceph-client.admin.105304.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88433.log.gz 2023-10-07T08:54:58.579 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105304.log.gz 2023-10-07T08:54:58.579 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92024.log 2023-10-07T08:54:58.579 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108644.log 2023-10-07T08:54:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.92024.log: /var/log/ceph/ceph-client.admin.108644.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92024.log.gz 2023-10-07T08:54:58.588 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108644.log.gz 2023-10-07T08:54:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102607.log 2023-10-07T08:54:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110457.log 2023-10-07T08:54:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102607.log: /var/log/ceph/ceph-client.admin.110457.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102607.log.gz 2023-10-07T08:54:58.588 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110457.log.gz 2023-10-07T08:54:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113608.log 2023-10-07T08:54:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104851.log 2023-10-07T08:54:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113608.log: /var/log/ceph/ceph-client.admin.104851.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113608.log.gz 2023-10-07T08:54:58.588 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104851.log.gz 2023-10-07T08:54:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115606.log 2023-10-07T08:54:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101202.log 2023-10-07T08:54:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115606.log: /var/log/ceph/ceph-client.0.101202.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115606.log.gz 2023-10-07T08:54:58.589 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.101202.log.gz 2023-10-07T08:54:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114670.log 2023-10-07T08:54:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93542.log 2023-10-07T08:54:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114670.log: /var/log/ceph/ceph-client.admin.93542.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114670.log.gz 2023-10-07T08:54:58.589 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93542.log.gz 2023-10-07T08:54:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114838.log 2023-10-07T08:54:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-07T08:54:58.589 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114838.log: /var/log/ceph/ceph-mgr.y.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114838.log.gz 2023-10-07T08:54:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87240.log 2023-10-07T08:54:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87240.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.87240.log.gz 2023-10-07T08:54:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114346.log 2023-10-07T08:54:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.114346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.114346.log.gz 2023-10-07T08:54:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88089.log 2023-10-07T08:54:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88089.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88089.log.gz 2023-10-07T08:54:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114880.log 2023-10-07T08:54:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114880.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114880.log.gz 2023-10-07T08:54:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105820.log 2023-10-07T08:54:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105820.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105820.log.gz 2023-10-07T08:54:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117650.log 2023-10-07T08:54:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117650.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117650.log.gz 2023-10-07T08:54:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105080.log 2023-10-07T08:54:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105080.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105080.log.gz 2023-10-07T08:54:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.84612.log 2023-10-07T08:54:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.tmp-client.admin.84612.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.84612.log.gz 2023-10-07T08:54:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113776.log 2023-10-07T08:54:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113776.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113776.log.gz 2023-10-07T08:54:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107948.log 2023-10-07T08:54:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107948.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107948.log.gz 2023-10-07T08:54:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116208.log 2023-10-07T08:54:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116208.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116208.log.gz 2023-10-07T08:54:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102197.log 2023-10-07T08:54:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.102197.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102197.log.gz 2023-10-07T08:54:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101926.log 2023-10-07T08:54:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.101926.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101926.log.gz 2023-10-07T08:54:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106072.log 2023-10-07T08:54:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.106072.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106072.log.gz 2023-10-07T08:54:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104198.log 2023-10-07T08:54:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104198.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104198.log.gz 2023-10-07T08:54:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97636.log 2023-10-07T08:54:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97636.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97636.log.gz 2023-10-07T08:54:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114754.log 2023-10-07T08:54:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114754.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.114754.log.gz 2023-10-07T08:54:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95772.log 2023-10-07T08:54:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95772.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.95772.log.gz 2023-10-07T08:54:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99843.log 2023-10-07T08:54:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99843.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99843.log.gz 2023-10-07T08:54:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111815.log 2023-10-07T08:54:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111815.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111815.log.gz 2023-10-07T08:54:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105988.log 2023-10-07T08:54:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105988.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105988.log.gz 2023-10-07T08:54:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101247.log 2023-10-07T08:54:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.101247.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101247.log.gz 2023-10-07T08:54:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108380.log 2023-10-07T08:54:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108380.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108380.log.gz 2023-10-07T08:54:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87284.log 2023-10-07T08:54:58.593 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87284.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87284.log.gz 2023-10-07T08:54:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99530.log 2023-10-07T08:54:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.99530.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99530.log.gz 2023-10-07T08:54:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97264.log 2023-10-07T08:54:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.97264.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97264.log.gz 2023-10-07T08:54:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109543.log 2023-10-07T08:54:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109543.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109543.log.gz 2023-10-07T08:54:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87922.log 2023-10-07T08:54:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87922.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87922.log.gz 2023-10-07T08:54:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94542.log 2023-10-07T08:54:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94542.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94542.log.gz 2023-10-07T08:54:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88096.log 2023-10-07T08:54:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88096.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88096.log.gz 2023-10-07T08:54:58.595 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94332.log 2023-10-07T08:54:58.595 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94332.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94332.log.gz 2023-10-07T08:54:58.595 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115216.log 2023-10-07T08:54:58.595 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115216.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115216.log.gz 2023-10-07T08:54:58.595 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86968.log 2023-10-07T08:54:58.595 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.86968.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86968.log.gz 2023-10-07T08:54:58.595 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89140.log 2023-10-07T08:54:58.595 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.89140.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89140.log.gz 2023-10-07T08:54:58.595 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113919.log 2023-10-07T08:54:58.595 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113919.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113919.log.gz 2023-10-07T08:54:58.595 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89518.log 2023-10-07T08:54:58.595 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.89518.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89518.log.gz 2023-10-07T08:54:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113877.log 2023-10-07T08:54:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113877.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113877.log.gz 2023-10-07T08:54:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110911.log 2023-10-07T08:54:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110911.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.110911.log.gz 2023-10-07T08:54:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91370.log 2023-10-07T08:54:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.91370.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91370.log.gz 2023-10-07T08:54:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90191.log 2023-10-07T08:54:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.90191.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90191.log.gz 2023-10-07T08:54:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88091.log 2023-10-07T08:54:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88091.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88091.log.gz 2023-10-07T08:54:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116292.log 2023-10-07T08:54:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116292.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116292.log.gz 2023-10-07T08:54:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87880.log 2023-10-07T08:54:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87880.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87880.log.gz 2023-10-07T08:54:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87452.log 2023-10-07T08:54:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87452.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87452.log.gz 2023-10-07T08:54:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103226.log 2023-10-07T08:54:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.103226.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103226.log.gz 2023-10-07T08:54:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101548.log 2023-10-07T08:54:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.101548.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101548.log.gz 2023-10-07T08:54:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93501.log 2023-10-07T08:54:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.93501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.93501.log.gz 2023-10-07T08:54:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104767.log 2023-10-07T08:54:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104767.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104767.log.gz 2023-10-07T08:54:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105554.log 2023-10-07T08:54:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105554.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105554.log.gz 2023-10-07T08:54:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108856.log 2023-10-07T08:54:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108856.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108856.log.gz 2023-10-07T08:54:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117398.log 2023-10-07T08:54:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117398.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117398.log.gz 2023-10-07T08:54:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113436.log 2023-10-07T08:54:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113436.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113436.log.gz 2023-10-07T08:54:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118221.log 2023-10-07T08:54:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118221.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118221.log.gz 2023-10-07T08:54:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108510.log 2023-10-07T08:54:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108510.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108510.log.gz 2023-10-07T08:54:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96970.log 2023-10-07T08:54:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.96970.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96970.log.gz 2023-10-07T08:54:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108982.log 2023-10-07T08:54:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108982.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.108982.log.gz 2023-10-07T08:54:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88087.log 2023-10-07T08:54:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88087.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88087.log.gz 2023-10-07T08:54:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106545.log 2023-10-07T08:54:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.106545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.106545.log.gz 2023-10-07T08:54:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108940.log 2023-10-07T08:54:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108940.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.108940.log.gz 2023-10-07T08:54:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88768.log 2023-10-07T08:54:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.88768.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.88768.log.gz 2023-10-07T08:54:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98184.log 2023-10-07T08:54:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.98184.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98184.log.gz 2023-10-07T08:54:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110728.log 2023-10-07T08:54:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110728.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110728.log.gz 2023-10-07T08:54:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117692.log 2023-10-07T08:54:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117692.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117692.log.gz 2023-10-07T08:54:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90679.log 2023-10-07T08:54:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.90679.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90679.log.gz 2023-10-07T08:54:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94416.log 2023-10-07T08:54:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.94416.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94416.log.gz 2023-10-07T08:54:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111623.log 2023-10-07T08:54:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111623.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111623.log.gz 2023-10-07T08:54:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90637.log 2023-10-07T08:54:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.90637.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90637.log.gz 2023-10-07T08:54:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118851.log 2023-10-07T08:54:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118851.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118851.log.gz 2023-10-07T08:54:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87137.log 2023-10-07T08:54:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87137.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87137.log.gz 2023-10-07T08:54:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95730.log 2023-10-07T08:54:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.95730.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95730.log.gz 2023-10-07T08:54:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105164.log 2023-10-07T08:54:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.105164.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105164.log.gz 2023-10-07T08:54:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87494.log 2023-10-07T08:54:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.87494.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87494.log.gz 2023-10-07T08:54:58.601 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-07T08:54:58.602 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104114.log 2023-10-07T08:54:58.604 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.104114.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104114.log.gz 2023-10-07T08:54:58.615 INFO:teuthology.orchestra.run.smithi089.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-07T08:54:58.615 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96753.log 2023-10-07T08:54:58.616 INFO:teuthology.orchestra.run.smithi081.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-07T08:54:58.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.96753.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96753.log.gz 2023-10-07T08:54:58.616 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116334.log 2023-10-07T08:54:58.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116334.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.116334.log.gz 2023-10-07T08:54:58.616 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115774.log 2023-10-07T08:54:58.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115774.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115774.log.gz 2023-10-07T08:54:58.640 INFO:teuthology.orchestra.run.smithi081.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-07T08:54:58.642 INFO:teuthology.orchestra.run.smithi089.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-07T08:54:58.648 INFO:teuthology.orchestra.run.smithi081.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-07T08:54:58.946 INFO:teuthology.orchestra.run.smithi089.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-07T08:54:59.092 INFO:teuthology.orchestra.run.smithi089.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-07T08:54:59.108 INFO:teuthology.orchestra.run.smithi089.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-07T08:54:59.145 INFO:teuthology.orchestra.run.smithi089.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-07T08:54:59.147 INFO:teuthology.orchestra.run.smithi089.stderr: 2023-10-07T08:54:59.147 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m0.846s 2023-10-07T08:54:59.147 INFO:teuthology.orchestra.run.smithi089.stderr:user 0m3.638s 2023-10-07T08:54:59.147 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m0.157s 2023-10-07T08:54:59.173 INFO:teuthology.orchestra.run.smithi081.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-07T08:54:59.191 INFO:teuthology.orchestra.run.smithi081.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-07T08:54:59.229 INFO:teuthology.orchestra.run.smithi081.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-07T08:54:59.289 INFO:teuthology.orchestra.run.smithi081.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-07T08:54:59.446 INFO:teuthology.orchestra.run.smithi081.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-07T08:54:59.447 INFO:teuthology.orchestra.run.smithi081.stderr: 2023-10-07T08:54:59.447 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m1.175s 2023-10-07T08:54:59.448 INFO:teuthology.orchestra.run.smithi081.stderr:user 0m4.995s 2023-10-07T08:54:59.448 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m0.465s 2023-10-07T08:54:59.448 INFO:tasks.ceph:Archiving logs... 2023-10-07T08:54:59.448 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273/remote/smithi081/log 2023-10-07T08:54:59.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-07T08:55:00.603 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273/remote/smithi089/log 2023-10-07T08:55:00.604 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-07T08:55:01.125 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-07T08:55:01.135 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-07T08:55:01.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-07T08:55:01.138 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-07T08:55:01.226 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-07T08:55:01.236 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-07T08:55:01.236 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-07T08:55:01.239 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-07T08:55:01.253 INFO:teuthology.orchestra.run.smithi081.stderr:bash: ntpq: command not found 2023-10-07T08:55:01.254 INFO:teuthology.orchestra.run.smithi089.stderr:bash: ntpq: command not found 2023-10-07T08:55:01.258 INFO:teuthology.orchestra.run.smithi081.stdout:210 Number of sources = 4 2023-10-07T08:55:01.258 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-07T08:55:01.258 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2023-10-07T08:55:01.258 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 30 -30us[ -21us] +/- 81ms 2023-10-07T08:55:01.258 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv02.front.sepia.ceph.com 3 6 377 29 +81us[ +90us] +/- 77ms 2023-10-07T08:55:01.258 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 -5478ns[+3305ns] +/- 60ms 2023-10-07T08:55:01.258 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:55:01.259 INFO:teuthology.orchestra.run.smithi089.stdout:210 Number of sources = 4 2023-10-07T08:55:01.259 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-07T08:55:01.259 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2023-10-07T08:55:01.259 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 27 -21us[ -21us] +/- 81ms 2023-10-07T08:55:01.260 INFO:teuthology.orchestra.run.smithi089.stdout:^* hv02.front.sepia.ceph.com 3 6 377 28 +87us[ +101us] +/- 77ms 2023-10-07T08:55:01.260 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 -7103ns[+6675ns] +/- 60ms 2023-10-07T08:55:01.260 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-07T08:55:01.260 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-07T08:55:01.269 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-07T08:55:01.269 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-07T08:55:01.279 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-07T08:55:01.411 DEBUG:teuthology.orchestra.run.smithi089:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-07T08:55:01.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-07T08:55:01.542 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:55:01.543 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-07T08:55:01.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:55:01.573 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-07T08:55:01.584 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-07T08:55:01.594 INFO:teuthology.task.internal:Duration was 1368.472364 seconds 2023-10-07T08:55:01.594 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-07T08:55:01.603 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-07T08:55:01.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-07T08:55:01.606 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-07T08:55:01.647 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-07T08:55:01.658 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-07T08:55:01.984 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-07T08:55:01.985 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2023-10-07T08:55:01.985 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-07T08:55:02.044 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2023-10-07T08:55:02.045 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-07T08:55:02.064 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-07T08:55:02.064 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-07T08:55:02.087 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-07T08:55:02.144 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-07T08:55:02.144 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-07T08:55:02.172 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-07T08:55:02.261 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-07T08:55:02.272 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-07T08:55:02.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-07T08:55:02.297 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-07T08:55:02.321 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-07T08:55:02.382 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-07T08:55:02.385 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-07T08:55:02.405 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2023-10-07T08:55:02.408 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2023-10-07T08:55:02.422 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-07T08:55:02.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:55:02.473 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-07T08:55:02.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-07T08:55:02.487 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-07T08:55:02.497 INFO:teuthology.task.internal:Transferring archived files... 2023-10-07T08:55:02.498 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273/remote/smithi081 2023-10-07T08:55:02.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-07T08:55:02.552 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273/remote/smithi089 2023-10-07T08:55:02.552 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-07T08:55:02.589 INFO:teuthology.task.internal:Removing archive directory... 2023-10-07T08:55:02.589 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-07T08:55:02.592 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-07T08:55:02.637 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-07T08:55:02.649 INFO:teuthology.task.internal:Not uploading archives. 2023-10-07T08:55:02.649 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-07T08:55:02.659 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-07T08:55:02.659 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-07T08:55:02.661 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-07T08:55:02.673 INFO:teuthology.orchestra.run.smithi081.stdout: 262298 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 7 08:55 /home/ubuntu/cephtest 2023-10-07T08:55:02.691 INFO:teuthology.orchestra.run.smithi089.stdout: 262515 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 7 08:55 /home/ubuntu/cephtest 2023-10-07T08:55:02.692 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-07T08:55:02.703 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-07T08:55:02.787 INFO:teuthology.nuke:Checking targets against current locks 2023-10-07T08:55:02.813 DEBUG:teuthology.nuke:shortname: smithi081 2023-10-07T08:55:02.814 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-07T08:55:02.842 DEBUG:teuthology.nuke:shortname: smithi089 2023-10-07T08:55:02.842 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-07T08:55:02.846 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-07 08:25:03.942972', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBElw/sNKbAi6Re7S4J5mVhmqROP/WipIfjfAHplOVNjhPtKrO3UAC3ISPWFRULacki/Jpc40Jwkgf5VOHxeQFKo='} 2023-10-07T08:55:02.870 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_00:40:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7416273', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-07 08:25:03.941656', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBxW+7hJ4TMaHcy+kLXQTeuF6omXcB7/y1HwV4fhPoIIyk8MshvUK9K51g6IIDrBgosrywd/XASJBUlUyG1ZU+4='} 2023-10-07T08:55:02.899 INFO:teuthology.orchestra.console.smithi081:Power off 2023-10-07T08:55:02.900 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-07T08:55:02.922 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-10-07T08:55:02.922 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T08:55:02.937 INFO:teuthology.orchestra.console.smithi089:Power off 2023-10-07T08:55:02.937 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-07T08:55:02.945 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-07T08:55:02.958 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-10-07T08:55:02.959 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T08:55:02.981 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-10-07T08:55:06.946 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T08:55:06.983 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T08:55:07.056 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-07T08:55:07.092 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-10-07T08:55:11.059 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T08:55:11.093 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T08:55:11.170 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-07T08:55:11.203 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-10-07T08:55:15.172 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T08:55:15.204 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-07T08:55:15.288 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-07T08:55:15.314 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-10-07T08:55:15.389 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-10-07T08:55:15.415 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-10-07T08:55:15.520 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 1368.4723641872406 failure_reason: '"1696668163.2975094 osd.6 (osd.6) 3 : cluster [WRN] OSD bench result of 241453.647540 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.6. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-07T08:55:15.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-07T08:55:15.599 INFO:teuthology.run:FAIL